2023-12-20T04:31:33.364 INFO:root:teuthology version: 0.0.1.dev216+g5f3731e 2023-12-20T04:31:33.364 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} --verbose --owner scheduled_vshankar@teuthology --name vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi --archive /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497454 -- /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497454/orig.config.yaml 2023-12-20T04:31:33.418 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T04:31:33.519 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497454 branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} email: vshankar@redhat.com first_in_suite: false job_id: '7497454' kernel: kdb: true sha1: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi name: vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd - disabled conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 pid file: '' rados mon op timeout: 900 rados osd op timeout: 900 client.0: debug client: 20 debug objectcacher: 20 debug objecter: 20 client.1: debug client: 20 debug objectcacher: 20 debug objecter: 20 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 mon osd backfillfull ratio: 0.6 mon osd full ratio: 0.7 mon osd nearfull ratio: 0.6 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 memstore device bytes: 200000000 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 1.0 osd mon report interval: 5 osd objectstore: memstore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - overall HEALTH_ - \(FS_DEGRADED\) - \(MDS_FAILED\) - \(MDS_DEGRADED\) - \(FS_WITH_FAILED_MDS\) - \(MDS_DAMAGE\) - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(FS_INLINE_DATA_DEPRECATED\) - \(POOL_APP_NOT_ENABLED\) - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - OSD full dropping all updates - OSD near full - pausewr flag - failsafe engaged, dropping updates - failsafe disengaged, no longer dropping - is full \(reached quota - POOL_FULL - POOL_BACKFILLFULL - PG_RECOVERY_FULL - PG_DEGRADED sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: osd default pool size: 2 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e owner: scheduled_vshankar@teuthology priority: 50 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - client.2 - - mon.b - mon.c - mgr.x - mds.b - mds.d - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - client.3 seed: 430 sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e sleep_before_teardown: 0 subset: 301/1024 suite: fs suite_branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi132.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMKMc5umu6dc3nMXSj2lIUQb6ER6Kmo4DIxohFL9Ar8mG+H8vCTkamCZ9pNoEhBZwOZzzX1stzAOIVTwpqmVh3c= smithi187.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA3Cn1Njhrsb/vrAGajuNArLIRdWHRk2mKkuO8v3HPZErdXbb7YlUoWwAjQkEilEad3OmuXojCaBUMHaWiUrP6I= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - ceph-fuse: null - cephfs_test_runner: modules: - tasks.cephfs.test_full teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73 timestamp: 2023-12-20_03:59:06 tube: smithi use_shaman: true user: vshankar verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078 2023-12-20T04:31:33.520 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa; will attempt to use it 2023-12-20T04:31:33.521 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa/tasks 2023-12-20T04:31:33.521 INFO:teuthology.run_tasks:Running task internal.check_packages... 2023-12-20T04:31:33.524 INFO:teuthology.task.internal:Checking packages... 2023-12-20T04:31:33.556 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '568df92b7e50b2108bce4c77c393ff294d6a5e5e' 2023-12-20T04:31:33.556 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2023-12-20T04:31:33.556 INFO:teuthology.packaging:ref: None 2023-12-20T04:31:33.556 INFO:teuthology.packaging:tag: None 2023-12-20T04:31:33.556 INFO:teuthology.packaging:branch: wip-vshankar-testing1-2023-12-18-1207-reef-2 2023-12-20T04:31:33.556 INFO:teuthology.packaging:sha1: 568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-20T04:31:33.557 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-vshankar-testing1-2023-12-18-1207-reef-2 2023-12-20T04:31:33.697 INFO:teuthology.task.internal:Found packages for ceph version 18.2.1-132.g568df92b 2023-12-20T04:31:33.698 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2023-12-20T04:31:33.705 INFO:teuthology.task.internal:no buildpackages task found 2023-12-20T04:31:33.705 INFO:teuthology.run_tasks:Running task internal.save_config... 2023-12-20T04:31:33.729 INFO:teuthology.task.internal:Saving configuration 2023-12-20T04:31:33.747 INFO:teuthology.run_tasks:Running task internal.check_lock... 2023-12-20T04:31:33.753 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-20T04:31:33.780 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497454', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 04:26:48.967249', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMKMc5umu6dc3nMXSj2lIUQb6ER6Kmo4DIxohFL9Ar8mG+H8vCTkamCZ9pNoEhBZwOZzzX1stzAOIVTwpqmVh3c='} 2023-12-20T04:31:33.806 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497454', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 04:26:48.969244', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA3Cn1Njhrsb/vrAGajuNArLIRdWHRk2mKkuO8v3HPZErdXbb7YlUoWwAjQkEilEad3OmuXojCaBUMHaWiUrP6I='} 2023-12-20T04:31:33.806 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2023-12-20T04:31:33.812 INFO:teuthology.task.internal:roles: ubuntu@smithi132.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'] 2023-12-20T04:31:33.813 INFO:teuthology.task.internal:roles: ubuntu@smithi187.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3'] 2023-12-20T04:31:33.813 INFO:teuthology.run_tasks:Running task console_log... 2023-12-20T04:31:33.899 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f2c4b369dc0>, signals=[15]) 2023-12-20T04:31:33.899 INFO:teuthology.run_tasks:Running task internal.connect... 2023-12-20T04:31:33.905 INFO:teuthology.task.internal:Opening connections... 2023-12-20T04:31:33.905 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:31:33.907 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:31:33.997 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:31:33.998 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:31:34.082 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2023-12-20T04:31:34.089 DEBUG:teuthology.orchestra.run.smithi132:> uname -m 2023-12-20T04:31:34.107 INFO:teuthology.orchestra.run.smithi132.stdout:x86_64 2023-12-20T04:31:34.107 DEBUG:teuthology.orchestra.run.smithi132:> cat /etc/os-release 2023-12-20T04:31:34.167 INFO:teuthology.orchestra.run.smithi132.stdout:NAME="CentOS Stream" 2023-12-20T04:31:34.167 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION="9" 2023-12-20T04:31:34.167 INFO:teuthology.orchestra.run.smithi132.stdout:ID="centos" 2023-12-20T04:31:34.167 INFO:teuthology.orchestra.run.smithi132.stdout:ID_LIKE="rhel fedora" 2023-12-20T04:31:34.167 INFO:teuthology.orchestra.run.smithi132.stdout:VERSION_ID="9" 2023-12-20T04:31:34.168 INFO:teuthology.orchestra.run.smithi132.stdout:PLATFORM_ID="platform:el9" 2023-12-20T04:31:34.168 INFO:teuthology.orchestra.run.smithi132.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-20T04:31:34.168 INFO:teuthology.orchestra.run.smithi132.stdout:ANSI_COLOR="0;31" 2023-12-20T04:31:34.168 INFO:teuthology.orchestra.run.smithi132.stdout:LOGO="fedora-logo-icon" 2023-12-20T04:31:34.168 INFO:teuthology.orchestra.run.smithi132.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-20T04:31:34.168 INFO:teuthology.orchestra.run.smithi132.stdout:HOME_URL="https://centos.org/" 2023-12-20T04:31:34.168 INFO:teuthology.orchestra.run.smithi132.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-20T04:31:34.168 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-20T04:31:34.168 INFO:teuthology.orchestra.run.smithi132.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-20T04:31:34.169 INFO:teuthology.lock.ops:Updating smithi132.front.sepia.ceph.com on lock server 2023-12-20T04:31:34.187 DEBUG:teuthology.orchestra.run.smithi187:> uname -m 2023-12-20T04:31:34.205 INFO:teuthology.orchestra.run.smithi187.stdout:x86_64 2023-12-20T04:31:34.205 DEBUG:teuthology.orchestra.run.smithi187:> cat /etc/os-release 2023-12-20T04:31:34.262 INFO:teuthology.orchestra.run.smithi187.stdout:NAME="CentOS Stream" 2023-12-20T04:31:34.262 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION="9" 2023-12-20T04:31:34.262 INFO:teuthology.orchestra.run.smithi187.stdout:ID="centos" 2023-12-20T04:31:34.262 INFO:teuthology.orchestra.run.smithi187.stdout:ID_LIKE="rhel fedora" 2023-12-20T04:31:34.262 INFO:teuthology.orchestra.run.smithi187.stdout:VERSION_ID="9" 2023-12-20T04:31:34.262 INFO:teuthology.orchestra.run.smithi187.stdout:PLATFORM_ID="platform:el9" 2023-12-20T04:31:34.262 INFO:teuthology.orchestra.run.smithi187.stdout:PRETTY_NAME="CentOS Stream 9" 2023-12-20T04:31:34.262 INFO:teuthology.orchestra.run.smithi187.stdout:ANSI_COLOR="0;31" 2023-12-20T04:31:34.262 INFO:teuthology.orchestra.run.smithi187.stdout:LOGO="fedora-logo-icon" 2023-12-20T04:31:34.262 INFO:teuthology.orchestra.run.smithi187.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2023-12-20T04:31:34.262 INFO:teuthology.orchestra.run.smithi187.stdout:HOME_URL="https://centos.org/" 2023-12-20T04:31:34.263 INFO:teuthology.orchestra.run.smithi187.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2023-12-20T04:31:34.263 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2023-12-20T04:31:34.263 INFO:teuthology.orchestra.run.smithi187.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2023-12-20T04:31:34.263 INFO:teuthology.lock.ops:Updating smithi187.front.sepia.ceph.com on lock server 2023-12-20T04:31:34.290 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2023-12-20T04:31:34.299 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2023-12-20T04:31:34.306 INFO:teuthology.task.internal:Checking for old test directory... 2023-12-20T04:31:34.306 DEBUG:teuthology.orchestra.run.smithi132:> test '!' -e /home/ubuntu/cephtest 2023-12-20T04:31:34.309 DEBUG:teuthology.orchestra.run.smithi187:> test '!' -e /home/ubuntu/cephtest 2023-12-20T04:31:34.324 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2023-12-20T04:31:34.331 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2023-12-20T04:31:34.331 DEBUG:teuthology.orchestra.run.smithi132:> test -z $(ls -A /var/lib/ceph) 2023-12-20T04:31:34.369 DEBUG:teuthology.orchestra.run.smithi187:> test -z $(ls -A /var/lib/ceph) 2023-12-20T04:31:34.487 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2023-12-20T04:31:34.546 INFO:teuthology.run_tasks:Running task kernel... 2023-12-20T04:31:34.562 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2023-12-20T04:31:34.562 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2023-12-20T04:31:34.563 DEBUG:teuthology.orchestra.run.smithi132:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-20T04:31:34.563 DEBUG:teuthology.orchestra.run.smithi187:> test -f /run/.containerenv -o -f /.dockerenv 2023-12-20T04:31:34.579 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:31:34.579 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2023-12-20T04:31:34.580 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:31:34.580 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2023-12-20T04:31:34.637 INFO:teuthology.orchestra.run.smithi187.stdout:5.14.0-361.el9.x86_64 2023-12-20T04:31:34.638 INFO:teuthology.task.kernel:Running kernel on smithi187: 5.14.0-361.el9.x86_64 2023-12-20T04:31:34.638 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum install -y kernel 2023-12-20T04:31:34.639 INFO:teuthology.orchestra.run.smithi132.stdout:5.14.0-361.el9.x86_64 2023-12-20T04:31:34.639 INFO:teuthology.task.kernel:Running kernel on smithi132: 5.14.0-361.el9.x86_64 2023-12-20T04:31:34.639 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum install -y kernel 2023-12-20T04:31:36.868 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS-9 - AppStream 12 MB/s | 6.4 MB 00:00 2023-12-20T04:31:37.149 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - AppStream 7.3 MB/s | 6.4 MB 00:00 2023-12-20T04:31:38.551 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS-9 - BaseOS 3.1 MB/s | 2.0 MB 00:00 2023-12-20T04:31:38.724 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - BaseOS 3.9 MB/s | 2.0 MB 00:00 2023-12-20T04:31:39.367 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - BaseOS 16 MB/s | 7.9 MB 00:00 2023-12-20T04:31:39.648 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 13 MB/s | 7.9 MB 00:00 2023-12-20T04:31:42.124 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 13 MB/s | 18 MB 00:01 2023-12-20T04:31:46.009 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 11 MB/s | 5.8 MB 00:00 2023-12-20T04:31:47.451 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 15 kB 00:00 2023-12-20T04:31:49.227 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 12 MB/s | 20 MB 00:01 2023-12-20T04:31:52.341 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - AppStream 1.5 MB/s | 18 MB 00:11 2023-12-20T04:31:54.028 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-12-20T04:31:56.184 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-20T04:31:56.184 INFO:teuthology.orchestra.run.smithi132.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-20T04:31:56.275 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2023-12-20T04:31:56.281 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2023-12-20T04:31:56.281 INFO:teuthology.orchestra.run.smithi132.stdout: Package Architecture Version Repository Size 2023-12-20T04:31:56.281 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2023-12-20T04:31:56.281 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2023-12-20T04:31:56.281 INFO:teuthology.orchestra.run.smithi132.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-20T04:31:56.281 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2023-12-20T04:31:56.281 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-20T04:31:56.281 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-20T04:31:56.281 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-20T04:31:56.281 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:31:56.281 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2023-12-20T04:31:56.281 INFO:teuthology.orchestra.run.smithi132.stdout:================================================================================ 2023-12-20T04:31:56.282 INFO:teuthology.orchestra.run.smithi132.stdout:Install 4 Packages 2023-12-20T04:31:56.282 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:31:56.282 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 96 M 2023-12-20T04:31:56.282 INFO:teuthology.orchestra.run.smithi132.stdout:Installed size: 121 M 2023-12-20T04:31:56.282 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2023-12-20T04:31:58.425 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - CRB 2.2 MB/s | 5.8 MB 00:02 2023-12-20T04:31:58.578 INFO:teuthology.orchestra.run.smithi132.stdout:(1/4): kernel-5.14.0-391.el9.x86_64.rpm 2.8 MB/s | 5.6 MB 00:02 2023-12-20T04:31:59.976 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - Extras packages 33 kB/s | 15 kB 00:00 2023-12-20T04:32:01.871 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 11 MB/s | 20 MB 00:01 2023-12-20T04:32:03.278 INFO:teuthology.orchestra.run.smithi132.stdout:(2/4): kernel-core-5.14.0-391.el9.x86_64.rpm 3.0 MB/s | 20 MB 00:06 2023-12-20T04:32:04.228 INFO:teuthology.orchestra.run.smithi132.stdout:(3/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 4.9 MB/s | 38 MB 00:07 2023-12-20T04:32:06.626 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 12 kB/s | 1.7 kB 00:00 2023-12-20T04:32:06.770 INFO:teuthology.orchestra.run.smithi132.stdout:(4/4): kernel-modules-core-5.14.0-391.el9.x86_6 4.0 MB/s | 32 MB 00:08 2023-12-20T04:32:06.770 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2023-12-20T04:32:06.770 INFO:teuthology.orchestra.run.smithi132.stdout:Total 9.2 MB/s | 96 MB 00:10 2023-12-20T04:32:07.625 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2023-12-20T04:32:07.992 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2023-12-20T04:32:07.992 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2023-12-20T04:32:08.800 INFO:teuthology.orchestra.run.smithi187.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2023-12-20T04:32:08.800 INFO:teuthology.orchestra.run.smithi187.stdout:Package kernel-5.14.0-361.el9.x86_64 is already installed. 2023-12-20T04:32:08.890 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2023-12-20T04:32:08.895 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2023-12-20T04:32:08.895 INFO:teuthology.orchestra.run.smithi187.stdout: Package Architecture Version Repository Size 2023-12-20T04:32:08.896 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2023-12-20T04:32:08.896 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2023-12-20T04:32:08.896 INFO:teuthology.orchestra.run.smithi187.stdout: kernel x86_64 5.14.0-391.el9 baseos 5.6 M 2023-12-20T04:32:08.896 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2023-12-20T04:32:08.896 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-core x86_64 5.14.0-391.el9 baseos 20 M 2023-12-20T04:32:08.896 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-modules x86_64 5.14.0-391.el9 baseos 38 M 2023-12-20T04:32:08.896 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-modules-core x86_64 5.14.0-391.el9 baseos 32 M 2023-12-20T04:32:08.896 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:32:08.896 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2023-12-20T04:32:08.896 INFO:teuthology.orchestra.run.smithi187.stdout:================================================================================ 2023-12-20T04:32:08.896 INFO:teuthology.orchestra.run.smithi187.stdout:Install 4 Packages 2023-12-20T04:32:08.896 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:32:08.897 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 96 M 2023-12-20T04:32:08.897 INFO:teuthology.orchestra.run.smithi187.stdout:Installed size: 121 M 2023-12-20T04:32:08.897 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2023-12-20T04:32:09.290 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2023-12-20T04:32:09.290 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2023-12-20T04:32:11.286 INFO:teuthology.orchestra.run.smithi187.stdout:(1/4): kernel-5.14.0-391.el9.x86_64.rpm 2.4 MB/s | 5.6 MB 00:02 2023-12-20T04:32:11.940 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2023-12-20T04:32:12.582 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-20T04:32:12.721 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-20T04:32:13.994 INFO:teuthology.orchestra.run.smithi187.stdout:(2/4): kernel-core-5.14.0-391.el9.x86_64.rpm 4.0 MB/s | 20 MB 00:05 2023-12-20T04:32:14.336 INFO:teuthology.orchestra.run.smithi187.stdout:(3/4): kernel-modules-5.14.0-391.el9.x86_64.rpm 7.0 MB/s | 38 MB 00:05 2023-12-20T04:32:15.480 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-20T04:32:15.793 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-20T04:32:16.786 INFO:teuthology.orchestra.run.smithi187.stdout:(4/4): kernel-modules-core-5.14.0-391.el9.x86_6 5.9 MB/s | 32 MB 00:05 2023-12-20T04:32:16.786 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2023-12-20T04:32:16.786 INFO:teuthology.orchestra.run.smithi187.stdout:Total 12 MB/s | 96 MB 00:07 2023-12-20T04:32:17.640 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2023-12-20T04:32:17.990 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2023-12-20T04:32:17.991 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2023-12-20T04:32:19.328 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2023-12-20T04:32:19.328 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2023-12-20T04:32:20.377 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-20T04:32:20.568 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-20T04:32:22.274 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2023-12-20T04:32:22.921 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : kernel-modules-core-5.14.0-391.el9.x86_64 1/4 2023-12-20T04:32:23.052 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-20T04:32:25.189 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-20T04:32:25.805 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-20T04:32:25.987 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-20T04:32:30.626 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-20T04:32:30.845 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : kernel-5.14.0-391.el9.x86_64 4/4 2023-12-20T04:32:35.501 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-20T04:32:54.028 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-20T04:32:54.070 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-20T04:32:54.548 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-20T04:32:54.548 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-20T04:32:54.548 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-20T04:32:54.548 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-20T04:32:54.942 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-20T04:32:54.942 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:32:54.942 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2023-12-20T04:32:54.942 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-20T04:32:54.942 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-20T04:32:54.942 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-20T04:32:54.942 INFO:teuthology.orchestra.run.smithi132.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-20T04:32:54.942 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:32:54.942 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2023-12-20T04:32:55.438 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q kernel | sort -rV | head -n 1 2023-12-20T04:32:55.586 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-20T04:32:55.587 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-20T04:32:55.587 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-20T04:32:55.587 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-20T04:32:55.587 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-20T04:32:55.587 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2023-12-20T04:32:55.587 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi132.front.sepia.ceph.com, path=None, version=distro) 2023-12-20T04:32:55.588 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q kernel | sort -rV | head -n 1 2023-12-20T04:32:55.705 INFO:teuthology.orchestra.run.smithi132.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-20T04:32:55.705 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-20T04:32:55.706 DEBUG:teuthology.orchestra.run.smithi132:> sudo rpm -qi grub2-tools 2023-12-20T04:32:55.747 INFO:teuthology.orchestra.run.smithi132.stdout:Name : grub2-tools 2023-12-20T04:32:55.748 INFO:teuthology.orchestra.run.smithi132.stdout:Epoch : 1 2023-12-20T04:32:55.748 INFO:teuthology.orchestra.run.smithi132.stdout:Version : 2.06 2023-12-20T04:32:55.748 INFO:teuthology.orchestra.run.smithi132.stdout:Release : 68.el9 2023-12-20T04:32:55.748 INFO:teuthology.orchestra.run.smithi132.stdout:Architecture: x86_64 2023-12-20T04:32:55.748 INFO:teuthology.orchestra.run.smithi132.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-20T04:32:55.748 INFO:teuthology.orchestra.run.smithi132.stdout:Group : Unspecified 2023-12-20T04:32:55.748 INFO:teuthology.orchestra.run.smithi132.stdout:Size : 8264254 2023-12-20T04:32:55.748 INFO:teuthology.orchestra.run.smithi132.stdout:License : GPLv3+ 2023-12-20T04:32:55.748 INFO:teuthology.orchestra.run.smithi132.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-20T04:32:55.748 INFO:teuthology.orchestra.run.smithi132.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-20T04:32:55.748 INFO:teuthology.orchestra.run.smithi132.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-20T04:32:55.748 INFO:teuthology.orchestra.run.smithi132.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-20T04:32:55.748 INFO:teuthology.orchestra.run.smithi132.stdout:Packager : builder@centos.org 2023-12-20T04:32:55.748 INFO:teuthology.orchestra.run.smithi132.stdout:Vendor : CentOS 2023-12-20T04:32:55.748 INFO:teuthology.orchestra.run.smithi132.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-20T04:32:55.749 INFO:teuthology.orchestra.run.smithi132.stdout:Summary : Support tools for GRUB. 2023-12-20T04:32:55.749 INFO:teuthology.orchestra.run.smithi132.stdout:Description : 2023-12-20T04:32:55.749 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:32:55.749 INFO:teuthology.orchestra.run.smithi132.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-20T04:32:55.749 INFO:teuthology.orchestra.run.smithi132.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-20T04:32:55.749 INFO:teuthology.orchestra.run.smithi132.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-20T04:32:55.749 INFO:teuthology.orchestra.run.smithi132.stdout:hardware devices. 2023-12-20T04:32:55.749 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:32:55.749 INFO:teuthology.orchestra.run.smithi132.stdout:This subpackage provides tools for support of all platforms. 2023-12-20T04:32:55.750 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-20T04:32:55.750 INFO:teuthology.task.kernel:Updating grub on smithi132 to boot 5.14.0-391.el9.x86_64 2023-12-20T04:32:55.750 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-20T04:32:56.300 INFO:teuthology.orchestra.run.smithi132.stderr:Generating grub configuration file ... 2023-12-20T04:32:57.641 INFO:teuthology.orchestra.run.smithi132.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-20T04:32:57.677 INFO:teuthology.orchestra.run.smithi132.stderr:done 2023-12-20T04:32:57.679 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-12-20T04:32:57.694 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.EirenIy8qJ 2023-12-20T04:32:57.695 DEBUG:teuthology.orchestra.run.smithi132:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.EirenIy8qJ 2023-12-20T04:32:57.763 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.EirenIy8qJ 2023-12-20T04:32:57.901 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.EirenIy8qJ is 6KB 2023-12-20T04:32:57.949 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.EirenIy8qJ 2023-12-20T04:32:57.964 DEBUG:teuthology.orchestra.run.smithi132:> sudo /bin/ls /boot/loader/entries || true 2023-12-20T04:32:58.036 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-20T04:32:58.037 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-20T04:32:58.037 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-20T04:32:58.037 INFO:teuthology.orchestra.run.smithi132.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-20T04:32:58.038 DEBUG:teuthology.orchestra.run.smithi132:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-20T04:32:58.183 DEBUG:teuthology.orchestra.run.smithi132:> sudo shutdown -r now 2023-12-20T04:33:04.075 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: kernel-core-5.14.0-391.el9.x86_64 4/4 2023-12-20T04:33:04.119 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: kernel-modules-5.14.0-391.el9.x86_64 4/4 2023-12-20T04:33:04.594 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: kernel-5.14.0-391.el9.x86_64 4/4 2023-12-20T04:33:04.594 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : kernel-5.14.0-391.el9.x86_64 1/4 2023-12-20T04:33:04.594 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : kernel-core-5.14.0-391.el9.x86_64 2/4 2023-12-20T04:33:04.595 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : kernel-modules-5.14.0-391.el9.x86_64 3/4 2023-12-20T04:33:04.989 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : kernel-modules-core-5.14.0-391.el9.x86_64 4/4 2023-12-20T04:33:04.989 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:33:04.990 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2023-12-20T04:33:04.990 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-5.14.0-391.el9.x86_64 2023-12-20T04:33:04.990 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-core-5.14.0-391.el9.x86_64 2023-12-20T04:33:04.990 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-modules-5.14.0-391.el9.x86_64 2023-12-20T04:33:04.990 INFO:teuthology.orchestra.run.smithi187.stdout: kernel-modules-core-5.14.0-391.el9.x86_64 2023-12-20T04:33:04.990 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:33:04.990 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2023-12-20T04:33:05.510 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q kernel | sort -rV | head -n 1 2023-12-20T04:33:05.668 INFO:teuthology.orchestra.run.smithi187.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-20T04:33:05.668 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-20T04:33:05.668 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-361.el9.x86_64 Expected: 5.14.0-391.el9.x86_64 2023-12-20T04:33:05.668 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2023-12-20T04:33:05.668 DEBUG:teuthology.task.kernel:src is distro, skipping download 2023-12-20T04:33:05.669 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2023-12-20T04:33:05.669 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi187.front.sepia.ceph.com, path=None, version=distro) 2023-12-20T04:33:05.669 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q kernel | sort -rV | head -n 1 2023-12-20T04:33:05.787 INFO:teuthology.orchestra.run.smithi187.stdout:kernel-5.14.0-391.el9.x86_64 2023-12-20T04:33:05.787 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-391.el9.x86_64 2023-12-20T04:33:05.787 DEBUG:teuthology.orchestra.run.smithi187:> sudo rpm -qi grub2-tools 2023-12-20T04:33:05.830 INFO:teuthology.orchestra.run.smithi187.stdout:Name : grub2-tools 2023-12-20T04:33:05.830 INFO:teuthology.orchestra.run.smithi187.stdout:Epoch : 1 2023-12-20T04:33:05.830 INFO:teuthology.orchestra.run.smithi187.stdout:Version : 2.06 2023-12-20T04:33:05.830 INFO:teuthology.orchestra.run.smithi187.stdout:Release : 68.el9 2023-12-20T04:33:05.830 INFO:teuthology.orchestra.run.smithi187.stdout:Architecture: x86_64 2023-12-20T04:33:05.830 INFO:teuthology.orchestra.run.smithi187.stdout:Install Date: Fri 01 Sep 2023 09:14:30 PM UTC 2023-12-20T04:33:05.830 INFO:teuthology.orchestra.run.smithi187.stdout:Group : Unspecified 2023-12-20T04:33:05.830 INFO:teuthology.orchestra.run.smithi187.stdout:Size : 8264254 2023-12-20T04:33:05.830 INFO:teuthology.orchestra.run.smithi187.stdout:License : GPLv3+ 2023-12-20T04:33:05.830 INFO:teuthology.orchestra.run.smithi187.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2023-12-20T04:33:05.831 INFO:teuthology.orchestra.run.smithi187.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2023-12-20T04:33:05.831 INFO:teuthology.orchestra.run.smithi187.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2023-12-20T04:33:05.831 INFO:teuthology.orchestra.run.smithi187.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2023-12-20T04:33:05.831 INFO:teuthology.orchestra.run.smithi187.stdout:Packager : builder@centos.org 2023-12-20T04:33:05.831 INFO:teuthology.orchestra.run.smithi187.stdout:Vendor : CentOS 2023-12-20T04:33:05.831 INFO:teuthology.orchestra.run.smithi187.stdout:URL : http://www.gnu.org/software/grub/ 2023-12-20T04:33:05.831 INFO:teuthology.orchestra.run.smithi187.stdout:Summary : Support tools for GRUB. 2023-12-20T04:33:05.831 INFO:teuthology.orchestra.run.smithi187.stdout:Description : 2023-12-20T04:33:05.831 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:33:05.831 INFO:teuthology.orchestra.run.smithi187.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2023-12-20T04:33:05.831 INFO:teuthology.orchestra.run.smithi187.stdout:customizable bootloader with modular architecture. It supports a rich 2023-12-20T04:33:05.831 INFO:teuthology.orchestra.run.smithi187.stdout:variety of kernel formats, file systems, computer architectures and 2023-12-20T04:33:05.831 INFO:teuthology.orchestra.run.smithi187.stdout:hardware devices. 2023-12-20T04:33:05.831 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:33:05.831 INFO:teuthology.orchestra.run.smithi187.stdout:This subpackage provides tools for support of all platforms. 2023-12-20T04:33:05.832 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2023-12-20T04:33:05.832 INFO:teuthology.task.kernel:Updating grub on smithi187 to boot 5.14.0-391.el9.x86_64 2023-12-20T04:33:05.833 DEBUG:teuthology.orchestra.run.smithi187:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2023-12-20T04:33:06.478 INFO:teuthology.orchestra.run.smithi187.stderr:Generating grub configuration file ... 2023-12-20T04:33:07.775 INFO:teuthology.orchestra.run.smithi187.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2023-12-20T04:33:07.833 INFO:teuthology.orchestra.run.smithi187.stderr:done 2023-12-20T04:33:07.844 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2023-12-20T04:33:07.862 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.TTSDzT1ESZ 2023-12-20T04:33:07.862 DEBUG:teuthology.orchestra.run.smithi187:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.TTSDzT1ESZ 2023-12-20T04:33:07.931 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.TTSDzT1ESZ 2023-12-20T04:33:08.072 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.TTSDzT1ESZ is 6KB 2023-12-20T04:33:08.120 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.TTSDzT1ESZ 2023-12-20T04:33:08.134 DEBUG:teuthology.orchestra.run.smithi187:> sudo /bin/ls /boot/loader/entries || true 2023-12-20T04:33:08.199 INFO:teuthology.orchestra.run.smithi187.stdout:15949e3c88704300882482eddfd7baae-0-rescue.conf 2023-12-20T04:33:08.199 INFO:teuthology.orchestra.run.smithi187.stdout:15949e3c88704300882482eddfd7baae-5.14.0-239.el9.x86_64.conf 2023-12-20T04:33:08.200 INFO:teuthology.orchestra.run.smithi187.stdout:15949e3c88704300882482eddfd7baae-5.14.0-361.el9.x86_64.conf 2023-12-20T04:33:08.200 INFO:teuthology.orchestra.run.smithi187.stdout:15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64.conf 2023-12-20T04:33:08.201 DEBUG:teuthology.orchestra.run.smithi187:> sudo grub2-set-default 15949e3c88704300882482eddfd7baae-5.14.0-391.el9.x86_64 2023-12-20T04:33:08.351 DEBUG:teuthology.orchestra.run.smithi187:> sudo shutdown -r now 2023-12-20T04:33:28.205 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2023-12-20T04:33:28.206 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-12-20T04:33:28.207 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:33:38.364 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2023-12-20T04:33:38.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-20T04:33:38.364 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:34:28.258 DEBUG:teuthology.orchestra.remote:timed out 2023-12-20T04:34:37.265 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-12-20T04:34:37.266 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:34:37.690 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-12-20T04:34:38.091 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-12-20T04:34:38.091 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-391.el9.x86_64"... 2023-12-20T04:34:38.091 DEBUG:teuthology.orchestra.run.smithi132:> uname -r 2023-12-20T04:34:38.105 INFO:teuthology.orchestra.run.smithi132.stdout:5.14.0-391.el9.x86_64 2023-12-20T04:34:38.105 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-20T04:34:38.105 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-20T04:34:38.105 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-20T04:34:38.366 DEBUG:teuthology.orchestra.remote:timed out 2023-12-20T04:34:39.106 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2023-12-20T04:34:39.107 DEBUG:teuthology.orchestra.run.smithi132:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-20T04:34:39.175 INFO:teuthology.orchestra.run.smithi132.stdout:ttyS1 2023-12-20T04:34:39.226 DEBUG:teuthology.parallel:result is None 2023-12-20T04:34:47.367 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-20T04:34:47.367 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:34:47.659 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-12-20T04:34:48.040 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-20T04:34:48.040 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-391.el9.x86_64"... 2023-12-20T04:34:48.040 DEBUG:teuthology.orchestra.run.smithi187:> uname -r 2023-12-20T04:34:48.054 INFO:teuthology.orchestra.run.smithi187.stdout:5.14.0-391.el9.x86_64 2023-12-20T04:34:48.054 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-391.el9.x86_64 vs 5.14.0-391.el9.x86_64 2023-12-20T04:34:48.054 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2023-12-20T04:34:48.054 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2023-12-20T04:34:49.055 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2023-12-20T04:34:49.055 DEBUG:teuthology.orchestra.run.smithi187:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2023-12-20T04:34:49.114 INFO:teuthology.orchestra.run.smithi187.stdout:ttyS1 2023-12-20T04:34:49.157 DEBUG:teuthology.parallel:result is None 2023-12-20T04:34:49.157 INFO:teuthology.run_tasks:Running task internal.base... 2023-12-20T04:34:49.164 INFO:teuthology.task.internal:Creating test directory... 2023-12-20T04:34:49.165 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-20T04:34:49.168 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2023-12-20T04:34:49.185 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2023-12-20T04:34:49.197 INFO:teuthology.run_tasks:Running task internal.archive... 2023-12-20T04:34:49.210 INFO:teuthology.task.internal:Creating archive directory... 2023-12-20T04:34:49.210 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-20T04:34:49.228 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2023-12-20T04:34:49.386 INFO:teuthology.run_tasks:Running task internal.coredump... 2023-12-20T04:34:49.394 INFO:teuthology.task.internal:Enabling coredump saving... 2023-12-20T04:34:49.395 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-20T04:34:49.398 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2023-12-20T04:34:49.428 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-20T04:34:49.442 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-20T04:34:49.450 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-20T04:34:49.463 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2023-12-20T04:34:49.464 INFO:teuthology.run_tasks:Running task internal.sudo... 2023-12-20T04:34:49.472 INFO:teuthology.task.internal:Configuring sudo... 2023-12-20T04:34:49.472 DEBUG:teuthology.orchestra.run.smithi132:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-20T04:34:49.487 DEBUG:teuthology.orchestra.run.smithi187:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2023-12-20T04:34:49.515 INFO:teuthology.run_tasks:Running task internal.syslog... 2023-12-20T04:34:49.527 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2023-12-20T04:34:49.527 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-20T04:34:49.557 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2023-12-20T04:34:49.573 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-20T04:34:49.654 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-20T04:34:49.713 DEBUG:teuthology.orchestra.run.smithi132:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-20T04:34:49.796 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-20T04:34:49.840 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:34:49.840 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-20T04:34:49.907 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-20T04:34:49.944 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2023-12-20T04:34:50.002 DEBUG:teuthology.orchestra.run.smithi187:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-20T04:34:50.086 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2023-12-20T04:34:50.133 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:34:50.134 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2023-12-20T04:34:50.203 DEBUG:teuthology.orchestra.run.smithi132:> sudo service rsyslog restart 2023-12-20T04:34:50.206 DEBUG:teuthology.orchestra.run.smithi187:> sudo service rsyslog restart 2023-12-20T04:34:50.255 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-20T04:34:50.302 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-20T04:34:50.770 INFO:teuthology.run_tasks:Running task internal.timer... 2023-12-20T04:34:50.779 INFO:teuthology.task.internal:Starting timer... 2023-12-20T04:34:50.779 INFO:teuthology.run_tasks:Running task pcp... 2023-12-20T04:34:50.789 INFO:teuthology.run_tasks:Running task selinux... 2023-12-20T04:34:50.798 DEBUG:teuthology.orchestra.run.smithi132:> sudo service auditd rotate 2023-12-20T04:34:50.865 INFO:teuthology.orchestra.run.smithi132.stdout:Rotating logs: 2023-12-20T04:34:50.867 DEBUG:teuthology.orchestra.run.smithi187:> sudo service auditd rotate 2023-12-20T04:34:50.922 INFO:teuthology.orchestra.run.smithi187.stdout:Rotating logs: 2023-12-20T04:34:50.924 DEBUG:teuthology.task.selinux:Getting current SELinux state 2023-12-20T04:34:50.924 DEBUG:teuthology.orchestra.run.smithi132:> /usr/sbin/getenforce 2023-12-20T04:34:50.961 INFO:teuthology.orchestra.run.smithi132.stdout:Permissive 2023-12-20T04:34:50.961 DEBUG:teuthology.orchestra.run.smithi187:> /usr/sbin/getenforce 2023-12-20T04:34:50.980 INFO:teuthology.orchestra.run.smithi187.stdout:Permissive 2023-12-20T04:34:50.980 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi132.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi187.front.sepia.ceph.com': 'permissive'} 2023-12-20T04:34:50.980 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-20T04:34:51.031 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:34:51.032 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-20T04:34:51.062 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:34:51.062 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2023-12-20T04:34:51.062 DEBUG:teuthology.orchestra.run.smithi132:> sudo /usr/sbin/setenforce permissive 2023-12-20T04:34:51.105 DEBUG:teuthology.orchestra.run.smithi187:> sudo /usr/sbin/setenforce permissive 2023-12-20T04:34:51.140 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2023-12-20T04:34:51.150 INFO:teuthology.repo_utils:/home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main was just updated or references a specific commit; assuming it is current 2023-12-20T04:34:51.150 INFO:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2023-12-20T04:34:51.169 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2023-12-20T04:34:51.170 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi132.front.sepia.ceph.com,smithi187.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2023-12-20T04:40:27.180 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi132.front.sepia.ceph.com'), Remote(name='ubuntu@smithi187.front.sepia.ceph.com')] 2023-12-20T04:40:27.181 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-12-20T04:40:27.182 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi132.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:40:27.268 DEBUG:teuthology.orchestra.run.smithi132:> true 2023-12-20T04:40:27.336 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi132.front.sepia.ceph.com' 2023-12-20T04:40:27.336 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-20T04:40:27.337 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi187.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2023-12-20T04:40:27.421 DEBUG:teuthology.orchestra.run.smithi187:> true 2023-12-20T04:40:27.488 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi187.front.sepia.ceph.com' 2023-12-20T04:40:27.489 INFO:teuthology.run_tasks:Running task clock... 2023-12-20T04:40:27.505 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2023-12-20T04:40:27.506 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-20T04:40:27.506 DEBUG:teuthology.orchestra.run.smithi132:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-20T04:40:27.509 INFO:teuthology.orchestra.run:Running command with timeout 360 2023-12-20T04:40:27.509 DEBUG:teuthology.orchestra.run.smithi187:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-20T04:40:27.539 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-20T04:40:27.555 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-20T04:40:27.560 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2023-12-20T04:40:27.577 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2023-12-20T04:40:27.584 INFO:teuthology.orchestra.run.smithi132.stderr:sudo: ntpd: command not found 2023-12-20T04:40:27.600 INFO:teuthology.orchestra.run.smithi132.stdout:506 Cannot talk to daemon 2023-12-20T04:40:27.606 INFO:teuthology.orchestra.run.smithi187.stderr:sudo: ntpd: command not found 2023-12-20T04:40:27.614 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-20T04:40:27.620 INFO:teuthology.orchestra.run.smithi187.stdout:506 Cannot talk to daemon 2023-12-20T04:40:27.630 INFO:teuthology.orchestra.run.smithi132.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-20T04:40:27.636 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntp.service: Unit ntp.service not found. 2023-12-20T04:40:27.652 INFO:teuthology.orchestra.run.smithi187.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2023-12-20T04:40:27.673 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2023-12-20T04:40:27.677 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-20T04:40:27.677 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2023-12-20T04:40:27.677 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:40:27.677 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:40:27.677 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:40:27.677 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:40:27.695 INFO:teuthology.orchestra.run.smithi187.stderr:bash: line 1: ntpq: command not found 2023-12-20T04:40:27.698 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-20T04:40:27.699 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2023-12-20T04:40:27.699 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:40:27.699 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:40:27.699 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:40:27.699 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:40:27.699 INFO:teuthology.run_tasks:Running task install... 2023-12-20T04:40:27.708 DEBUG:teuthology.task.install:project ceph 2023-12-20T04:40:27.708 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}} 2023-12-20T04:40:27.709 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'} 2023-12-20T04:40:27.709 INFO:teuthology.task.install:Using flavor: default 2023-12-20T04:40:27.714 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2023-12-20T04:40:27.714 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2023-12-20T04:40:27.715 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'tag': None, 'wait_for_package': False} 2023-12-20T04:40:27.715 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-20T04:40:27.717 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'tag': None, 'wait_for_package': False} 2023-12-20T04:40:27.717 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-20T04:40:27.859 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/ 2023-12-20T04:40:27.860 INFO:teuthology.task.install.rpm:Package version is 18.2.1-132.g568df92b 2023-12-20T04:40:27.863 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/ 2023-12-20T04:40:27.864 INFO:teuthology.task.install.rpm:Package version is 18.2.1-132.g568df92b 2023-12-20T04:40:27.973 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-20T04:40:27.973 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:40:27.973 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-20T04:40:28.001 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-20T04:40:28.001 DEBUG:teuthology.orchestra.run.smithi132:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/568df92b7e50b2108bce4c77c393ff294d6a5e5e/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-20T04:40:28.032 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-vshankar-testing1-2023-12-18-1207-reef-2/568df92b7e50b2108bce4c77c393ff294d6a5e5e/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2023-12-20T04:40:28.033 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:40:28.033 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/yum.repos.d/ceph.repo 2023-12-20T04:40:28.062 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib, bison, flex, elfutils-libelf-devel, openssl-devel, NetworkManager, iproute, util-linux, libacl-devel, libaio-devel, libattr-devel, libtool, libuuid-devel, xfsdump, xfsprogs, xfsprogs-devel, libaio-devel, libtool, libuuid-devel, xfsprogs-devel, postgresql, postgresql-server, postgresql-contrib on remote rpm x86_64 2023-12-20T04:40:28.062 DEBUG:teuthology.orchestra.run.smithi187:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/568df92b7e50b2108bce4c77c393ff294d6a5e5e/;g' /etc/yum.repos.d/ceph.repo ; fi 2023-12-20T04:40:28.068 DEBUG:teuthology.orchestra.run.smithi132:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-20T04:40:28.130 DEBUG:teuthology.orchestra.run.smithi187:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2023-12-20T04:40:28.148 DEBUG:teuthology.orchestra.run.smithi132:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-20T04:40:28.210 DEBUG:teuthology.orchestra.run.smithi187:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2023-12-20T04:40:28.214 INFO:teuthology.orchestra.run.smithi132.stdout:check_obsoletes = 1 2023-12-20T04:40:28.216 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum clean all 2023-12-20T04:40:28.276 INFO:teuthology.orchestra.run.smithi187.stdout:check_obsoletes = 1 2023-12-20T04:40:28.277 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum clean all 2023-12-20T04:40:28.458 INFO:teuthology.orchestra.run.smithi132.stdout:73 files removed 2023-12-20T04:40:28.487 DEBUG:teuthology.orchestra.run.smithi132:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-20T04:40:28.523 INFO:teuthology.orchestra.run.smithi187.stdout:73 files removed 2023-12-20T04:40:28.553 DEBUG:teuthology.orchestra.run.smithi187:> sudo yum -y install ceph-radosgw ceph-test ceph ceph-base cephadm ceph-immutable-object-cache ceph-mgr ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-rook ceph-mgr-cephadm ceph-fuse ceph-volume librados-devel libcephfs2 libcephfs-devel librados2 librbd1 python3-rados python3-rgw python3-cephfs python3-rbd rbd-fuse rbd-mirror rbd-nbd python3-cephfs cephfs-shell cephfs-top cephfs-mirror bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib bison flex elfutils-libelf-devel openssl-devel NetworkManager iproute util-linux libacl-devel libaio-devel libattr-devel libtool libuuid-devel xfsdump xfsprogs xfsprogs-devel libaio-devel libtool libuuid-devel xfsprogs-devel postgresql postgresql-server postgresql-contrib 2023-12-20T04:40:29.131 INFO:teuthology.orchestra.run.smithi132.stdout:ceph packages for x86_64 239 kB/s | 77 kB 00:00 2023-12-20T04:40:29.198 INFO:teuthology.orchestra.run.smithi187.stdout:ceph packages for x86_64 239 kB/s | 77 kB 00:00 2023-12-20T04:40:29.490 INFO:teuthology.orchestra.run.smithi132.stdout:ceph noarch packages 31 kB/s | 9.5 kB 00:00 2023-12-20T04:40:29.565 INFO:teuthology.orchestra.run.smithi187.stdout:ceph noarch packages 30 kB/s | 9.5 kB 00:00 2023-12-20T04:40:29.807 INFO:teuthology.orchestra.run.smithi132.stdout:ceph source packages 6.7 kB/s | 1.9 kB 00:00 2023-12-20T04:40:30.701 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - AppStream 7.5 MB/s | 6.4 MB 00:00 2023-12-20T04:40:32.091 INFO:teuthology.orchestra.run.smithi187.stdout:ceph source packages 772 B/s | 1.9 kB 00:02 2023-12-20T04:40:32.352 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS-9 - BaseOS 3.6 MB/s | 2.0 MB 00:00 2023-12-20T04:40:32.485 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS-9 - AppStream 18 MB/s | 6.4 MB 00:00 2023-12-20T04:40:33.976 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS-9 - BaseOS 4.4 MB/s | 2.0 MB 00:00 2023-12-20T04:40:34.184 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 7.9 MB 00:01 2023-12-20T04:40:35.009 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - BaseOS 11 MB/s | 7.9 MB 00:00 2023-12-20T04:40:37.846 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - AppStream 10 MB/s | 18 MB 00:01 2023-12-20T04:40:42.094 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - CRB 7.6 MB/s | 5.8 MB 00:00 2023-12-20T04:40:43.395 INFO:teuthology.orchestra.run.smithi187.stdout:CentOS Stream 9 - Extras packages 82 kB/s | 15 kB 00:00 2023-12-20T04:40:44.647 INFO:teuthology.orchestra.run.smithi187.stdout:Extra Packages for Enterprise Linux 17 MB/s | 20 MB 00:01 2023-12-20T04:40:49.108 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - AppStream 1.3 MB/s | 18 MB 00:13 2023-12-20T04:40:49.363 INFO:teuthology.orchestra.run.smithi187.stdout:lab-extras 26 kB/s | 1.7 kB 00:00 2023-12-20T04:40:51.775 INFO:teuthology.orchestra.run.smithi187.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-20T04:40:51.776 INFO:teuthology.orchestra.run.smithi187.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-20T04:40:51.789 INFO:teuthology.orchestra.run.smithi187.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-20T04:40:51.790 INFO:teuthology.orchestra.run.smithi187.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-20T04:40:51.791 INFO:teuthology.orchestra.run.smithi187.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-20T04:40:51.792 INFO:teuthology.orchestra.run.smithi187.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-20T04:40:51.794 INFO:teuthology.orchestra.run.smithi187.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-20T04:40:51.796 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-20T04:40:51.797 INFO:teuthology.orchestra.run.smithi187.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-20T04:40:51.869 INFO:teuthology.orchestra.run.smithi187.stdout:Dependencies resolved. 2023-12-20T04:40:51.880 INFO:teuthology.orchestra.run.smithi187.stdout:=========================================================================================== 2023-12-20T04:40:51.881 INFO:teuthology.orchestra.run.smithi187.stdout: Package Arch Version Repository Size 2023-12-20T04:40:51.881 INFO:teuthology.orchestra.run.smithi187.stdout:=========================================================================================== 2023-12-20T04:40:51.881 INFO:teuthology.orchestra.run.smithi187.stdout:Installing: 2023-12-20T04:40:51.881 INFO:teuthology.orchestra.run.smithi187.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-20T04:40:51.881 INFO:teuthology.orchestra.run.smithi187.stdout: ceph x86_64 2:18.2.1-132.g568df92b.el9 ceph 6.5 k 2023-12-20T04:40:51.881 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base x86_64 2:18.2.1-132.g568df92b.el9 ceph 5.2 M 2023-12-20T04:40:51.881 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse x86_64 2:18.2.1-132.g568df92b.el9 ceph 840 k 2023-12-20T04:40:51.881 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-132.g568df92b.el9 ceph 142 k 2023-12-20T04:40:51.881 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr x86_64 2:18.2.1-132.g568df92b.el9 ceph 1.4 M 2023-12-20T04:40:51.881 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 132 k 2023-12-20T04:40:51.881 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 1.8 M 2023-12-20T04:40:51.881 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 7.4 M 2023-12-20T04:40:51.882 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 50 k 2023-12-20T04:40:51.882 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw x86_64 2:18.2.1-132.g568df92b.el9 ceph 7.7 M 2023-12-20T04:40:51.882 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test x86_64 2:18.2.1-132.g568df92b.el9 ceph 40 M 2023-12-20T04:40:51.882 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 262 k 2023-12-20T04:40:51.882 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 221 k 2023-12-20T04:40:51.882 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror x86_64 2:18.2.1-132.g568df92b.el9 ceph 219 k 2023-12-20T04:40:51.882 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-shell x86_64 2:18.2.1-132.g568df92b.el9 ceph 27 k 2023-12-20T04:40:51.882 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 18 k 2023-12-20T04:40:51.882 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-20T04:40:51.882 INFO:teuthology.orchestra.run.smithi187.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-20T04:40:51.882 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-20T04:40:51.882 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel x86_64 2:18.2.1-132.g568df92b.el9 ceph 31 k 2023-12-20T04:40:51.882 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 658 k 2023-12-20T04:40:51.882 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel x86_64 2:18.2.1-132.g568df92b.el9 ceph 126 k 2023-12-20T04:40:51.883 INFO:teuthology.orchestra.run.smithi187.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-20T04:40:51.883 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-20T04:40:51.883 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-20T04:40:51.883 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-20T04:40:51.883 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-20T04:40:51.883 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-20T04:40:51.883 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs x86_64 2:18.2.1-132.g568df92b.el9 ceph 161 k 2023-12-20T04:40:51.883 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados x86_64 2:18.2.1-132.g568df92b.el9 ceph 321 k 2023-12-20T04:40:51.883 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd x86_64 2:18.2.1-132.g568df92b.el9 ceph 298 k 2023-12-20T04:40:51.883 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw x86_64 2:18.2.1-132.g568df92b.el9 ceph 99 k 2023-12-20T04:40:51.883 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse x86_64 2:18.2.1-132.g568df92b.el9 ceph 86 k 2023-12-20T04:40:51.883 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.0 M 2023-12-20T04:40:51.883 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd x86_64 2:18.2.1-132.g568df92b.el9 ceph 171 k 2023-12-20T04:40:51.884 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-20T04:40:51.884 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrading: 2023-12-20T04:40:51.884 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-20T04:40:51.884 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-20T04:40:51.884 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-20T04:40:51.884 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-20T04:40:51.884 INFO:teuthology.orchestra.run.smithi187.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-20T04:40:51.884 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-20T04:40:51.884 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-20T04:40:51.884 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-20T04:40:51.884 INFO:teuthology.orchestra.run.smithi187.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-20T04:40:51.884 INFO:teuthology.orchestra.run.smithi187.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-20T04:40:51.884 INFO:teuthology.orchestra.run.smithi187.stdout: librados2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.3 M 2023-12-20T04:40:51.885 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1 x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.0 M 2023-12-20T04:40:51.885 INFO:teuthology.orchestra.run.smithi187.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-20T04:40:51.885 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-20T04:40:51.885 INFO:teuthology.orchestra.run.smithi187.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-20T04:40:51.885 INFO:teuthology.orchestra.run.smithi187.stdout:Installing dependencies: 2023-12-20T04:40:51.885 INFO:teuthology.orchestra.run.smithi187.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-20T04:40:51.885 INFO:teuthology.orchestra.run.smithi187.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-20T04:40:51.885 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common x86_64 2:18.2.1-132.g568df92b.el9 ceph 18 M 2023-12-20T04:40:51.885 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 23 k 2023-12-20T04:40:51.885 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds x86_64 2:18.2.1-132.g568df92b.el9 ceph 2.1 M 2023-12-20T04:40:51.885 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 242 k 2023-12-20T04:40:51.885 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon x86_64 2:18.2.1-132.g568df92b.el9 ceph 4.4 M 2023-12-20T04:40:51.885 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd x86_64 2:18.2.1-132.g568df92b.el9 ceph 18 M 2023-12-20T04:40:51.885 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 15 k 2023-12-20T04:40:51.886 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux x86_64 2:18.2.1-132.g568df92b.el9 ceph 24 k 2023-12-20T04:40:51.886 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-20T04:40:51.886 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-20T04:40:51.886 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-20T04:40:51.886 INFO:teuthology.orchestra.run.smithi187.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-20T04:40:51.886 INFO:teuthology.orchestra.run.smithi187.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-20T04:40:51.886 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-20T04:40:51.886 INFO:teuthology.orchestra.run.smithi187.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-20T04:40:51.886 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-20T04:40:51.886 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-20T04:40:51.886 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite x86_64 2:18.2.1-132.g568df92b.el9 ceph 166 k 2023-12-20T04:40:51.886 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-20T04:40:51.886 INFO:teuthology.orchestra.run.smithi187.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-20T04:40:51.886 INFO:teuthology.orchestra.run.smithi187.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-20T04:40:51.887 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-20T04:40:51.887 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-20T04:40:51.887 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1 x86_64 2:18.2.1-132.g568df92b.el9 ceph 475 k 2023-12-20T04:40:51.887 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-20T04:40:51.887 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 4.5 M 2023-12-20T04:40:51.887 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-20T04:40:51.887 INFO:teuthology.orchestra.run.smithi187.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-20T04:40:51.887 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-20T04:40:51.887 INFO:teuthology.orchestra.run.smithi187.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-20T04:40:51.887 INFO:teuthology.orchestra.run.smithi187.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-20T04:40:51.887 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-20T04:40:51.887 INFO:teuthology.orchestra.run.smithi187.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-20T04:40:51.887 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-20T04:40:51.887 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-20T04:40:51.887 INFO:teuthology.orchestra.run.smithi187.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-20T04:40:51.888 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-20T04:40:51.888 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-20T04:40:51.888 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-20T04:40:51.888 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse x86_64 2:18.2.1-132.g568df92b.el9 ceph 45 k 2023-12-20T04:40:51.888 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common x86_64 2:18.2.1-132.g568df92b.el9 ceph 124 k 2023-12-20T04:40:51.888 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-20T04:40:51.888 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-20T04:40:51.888 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-20T04:40:51.888 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-20T04:40:51.888 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-20T04:40:51.888 INFO:teuthology.orchestra.run.smithi187.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-20T04:40:51.888 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-20T04:40:51.888 INFO:teuthology.orchestra.run.smithi187.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-20T04:40:51.889 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-20T04:40:51.889 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-20T04:40:51.889 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-20T04:40:51.889 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-20T04:40:51.889 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-20T04:40:51.889 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-20T04:40:51.889 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-20T04:40:51.889 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-20T04:40:51.889 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-20T04:40:51.889 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-20T04:40:51.889 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-20T04:40:51.889 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-20T04:40:51.889 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-20T04:40:51.889 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-20T04:40:51.890 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-20T04:40:51.890 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-20T04:40:51.890 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-20T04:40:51.890 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-20T04:40:51.890 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-20T04:40:51.890 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-20T04:40:51.890 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-20T04:40:51.890 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-20T04:40:51.890 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-20T04:40:51.890 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-20T04:40:51.890 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-20T04:40:51.890 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-20T04:40:51.890 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-20T04:40:51.890 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-20T04:40:51.891 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-20T04:40:51.891 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-20T04:40:51.891 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-20T04:40:51.891 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-20T04:40:51.891 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-20T04:40:51.891 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-20T04:40:51.891 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-20T04:40:51.891 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-20T04:40:51.891 INFO:teuthology.orchestra.run.smithi187.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-20T04:40:51.891 INFO:teuthology.orchestra.run.smithi187.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-20T04:40:51.891 INFO:teuthology.orchestra.run.smithi187.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-20T04:40:51.891 INFO:teuthology.orchestra.run.smithi187.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-20T04:40:51.891 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-20T04:40:51.891 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-20T04:40:51.891 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-20T04:40:51.892 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-20T04:40:51.892 INFO:teuthology.orchestra.run.smithi187.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-20T04:40:51.892 INFO:teuthology.orchestra.run.smithi187.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-20T04:40:51.892 INFO:teuthology.orchestra.run.smithi187.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-20T04:40:51.892 INFO:teuthology.orchestra.run.smithi187.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-20T04:40:51.892 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-20T04:40:51.892 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-20T04:40:51.892 INFO:teuthology.orchestra.run.smithi187.stdout:Installing weak dependencies: 2023-12-20T04:40:51.892 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-20T04:40:51.892 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:40:51.892 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction Summary 2023-12-20T04:40:51.892 INFO:teuthology.orchestra.run.smithi187.stdout:=========================================================================================== 2023-12-20T04:40:51.892 INFO:teuthology.orchestra.run.smithi187.stdout:Install 139 Packages 2023-12-20T04:40:51.892 INFO:teuthology.orchestra.run.smithi187.stdout:Upgrade 15 Packages 2023-12-20T04:40:51.893 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:40:51.893 INFO:teuthology.orchestra.run.smithi187.stdout:Total download size: 200 M 2023-12-20T04:40:51.893 INFO:teuthology.orchestra.run.smithi187.stdout:Downloading Packages: 2023-12-20T04:40:52.689 INFO:teuthology.orchestra.run.smithi187.stdout:(1/154): ceph-18.2.1-132.g568df92b.el9.x86_64.r 37 kB/s | 6.5 kB 00:00 2023-12-20T04:40:52.914 INFO:teuthology.orchestra.run.smithi187.stdout:(2/154): ceph-fuse-18.2.1-132.g568df92b.el9.x86 3.6 MB/s | 840 kB 00:00 2023-12-20T04:40:52.989 INFO:teuthology.orchestra.run.smithi187.stdout:(3/154): ceph-immutable-object-cache-18.2.1-132 1.9 MB/s | 142 kB 00:00 2023-12-20T04:40:53.234 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - CRB 8.0 MB/s | 5.8 MB 00:00 2023-12-20T04:40:53.398 INFO:teuthology.orchestra.run.smithi187.stdout:(4/154): ceph-mds-18.2.1-132.g568df92b.el9.x86_ 5.2 MB/s | 2.1 MB 00:00 2023-12-20T04:40:53.632 INFO:teuthology.orchestra.run.smithi187.stdout:(5/154): ceph-mgr-18.2.1-132.g568df92b.el9.x86_ 6.2 MB/s | 1.4 MB 00:00 2023-12-20T04:40:53.807 INFO:teuthology.orchestra.run.smithi187.stdout:(6/154): ceph-common-18.2.1-132.g568df92b.el9.x 14 MB/s | 18 MB 00:01 2023-12-20T04:40:54.107 INFO:teuthology.orchestra.run.smithi187.stdout:(7/154): ceph-mon-18.2.1-132.g568df92b.el9.x86_ 9.3 MB/s | 4.4 MB 00:00 2023-12-20T04:40:54.941 INFO:teuthology.orchestra.run.smithi187.stdout:(8/154): ceph-base-18.2.1-132.g568df92b.el9.x86 2.1 MB/s | 5.2 MB 00:02 2023-12-20T04:40:55.033 INFO:teuthology.orchestra.run.smithi187.stdout:(9/154): ceph-radosgw-18.2.1-132.g568df92b.el9. 8.3 MB/s | 7.7 MB 00:00 2023-12-20T04:40:55.058 INFO:teuthology.orchestra.run.smithi187.stdout:(10/154): ceph-selinux-18.2.1-132.g568df92b.el9 206 kB/s | 24 kB 00:00 2023-12-20T04:40:55.233 INFO:teuthology.orchestra.run.smithi187.stdout:(11/154): ceph-osd-18.2.1-132.g568df92b.el9.x86 12 MB/s | 18 MB 00:01 2023-12-20T04:40:55.259 INFO:teuthology.orchestra.run.smithi187.stdout:(12/154): cephfs-mirror-18.2.1-132.g568df92b.el 1.1 MB/s | 219 kB 00:00 2023-12-20T04:40:55.275 INFO:teuthology.orchestra.run.smithi187.stdout:(13/154): cephfs-shell-18.2.1-132.g568df92b.el9 651 kB/s | 27 kB 00:00 2023-12-20T04:40:55.317 INFO:teuthology.orchestra.run.smithi187.stdout:(14/154): libcephfs-devel-18.2.1-132.g568df92b. 530 kB/s | 31 kB 00:00 2023-12-20T04:40:55.384 INFO:teuthology.orchestra.run.smithi187.stdout:(15/154): libcephfs2-18.2.1-132.g568df92b.el9.x 5.9 MB/s | 658 kB 00:00 2023-12-20T04:40:55.409 INFO:teuthology.orchestra.run.smithi187.stdout:(16/154): libcephsqlite-18.2.1-132.g568df92b.el 1.8 MB/s | 166 kB 00:00 2023-12-20T04:40:55.451 INFO:teuthology.orchestra.run.smithi187.stdout:(17/154): librados-devel-18.2.1-132.g568df92b.e 1.8 MB/s | 126 kB 00:00 2023-12-20T04:40:55.552 INFO:teuthology.orchestra.run.smithi187.stdout:(18/154): libradosstriper1-18.2.1-132.g568df92b 3.3 MB/s | 475 kB 00:00 2023-12-20T04:40:55.644 INFO:teuthology.orchestra.run.smithi187.stdout:(19/154): python3-ceph-argparse-18.2.1-132.g568 491 kB/s | 45 kB 00:00 2023-12-20T04:40:55.710 INFO:teuthology.orchestra.run.smithi132.stdout:CentOS Stream 9 - Extras packages 13 kB/s | 15 kB 00:01 2023-12-20T04:40:55.752 INFO:teuthology.orchestra.run.smithi187.stdout:(20/154): python3-ceph-common-18.2.1-132.g568df 1.1 MB/s | 124 kB 00:00 2023-12-20T04:40:55.820 INFO:teuthology.orchestra.run.smithi187.stdout:(21/154): librgw2-18.2.1-132.g568df92b.el9.x86_ 12 MB/s | 4.5 MB 00:00 2023-12-20T04:40:55.845 INFO:teuthology.orchestra.run.smithi187.stdout:(22/154): python3-cephfs-18.2.1-132.g568df92b.e 1.7 MB/s | 161 kB 00:00 2023-12-20T04:40:55.878 INFO:teuthology.orchestra.run.smithi187.stdout:(23/154): python3-rados-18.2.1-132.g568df92b.el 5.4 MB/s | 321 kB 00:00 2023-12-20T04:40:55.929 INFO:teuthology.orchestra.run.smithi187.stdout:(24/154): python3-rbd-18.2.1-132.g568df92b.el9. 3.5 MB/s | 298 kB 00:00 2023-12-20T04:40:55.954 INFO:teuthology.orchestra.run.smithi187.stdout:(25/154): python3-rgw-18.2.1-132.g568df92b.el9. 1.3 MB/s | 99 kB 00:00 2023-12-20T04:40:56.004 INFO:teuthology.orchestra.run.smithi187.stdout:(26/154): rbd-fuse-18.2.1-132.g568df92b.el9.x86 1.1 MB/s | 86 kB 00:00 2023-12-20T04:40:56.113 INFO:teuthology.orchestra.run.smithi187.stdout:(27/154): rbd-nbd-18.2.1-132.g568df92b.el9.x86_ 1.5 MB/s | 171 kB 00:00 2023-12-20T04:40:56.221 INFO:teuthology.orchestra.run.smithi187.stdout:(28/154): rbd-mirror-18.2.1-132.g568df92b.el9.x 11 MB/s | 3.0 MB 00:00 2023-12-20T04:40:56.248 INFO:teuthology.orchestra.run.smithi187.stdout:(29/154): ceph-grafana-dashboards-18.2.1-132.g5 172 kB/s | 23 kB 00:00 2023-12-20T04:40:56.264 INFO:teuthology.orchestra.run.smithi187.stdout:(30/154): ceph-mgr-cephadm-18.2.1-132.g568df92b 3.0 MB/s | 132 kB 00:00 2023-12-20T04:40:56.673 INFO:teuthology.orchestra.run.smithi187.stdout:(31/154): ceph-mgr-dashboard-18.2.1-132.g568df9 4.1 MB/s | 1.8 MB 00:00 2023-12-20T04:40:56.791 INFO:teuthology.orchestra.run.smithi187.stdout:(32/154): ceph-mgr-modules-core-18.2.1-132.g568 2.0 MB/s | 242 kB 00:00 2023-12-20T04:40:56.883 INFO:teuthology.orchestra.run.smithi187.stdout:(33/154): ceph-mgr-diskprediction-local-18.2.1- 12 MB/s | 7.4 MB 00:00 2023-12-20T04:40:56.908 INFO:teuthology.orchestra.run.smithi187.stdout:(34/154): ceph-mgr-rook-18.2.1-132.g568df92b.el 429 kB/s | 50 kB 00:00 2023-12-20T04:40:56.941 INFO:teuthology.orchestra.run.smithi187.stdout:(35/154): ceph-prometheus-alerts-18.2.1-132.g56 251 kB/s | 15 kB 00:00 2023-12-20T04:40:56.983 INFO:teuthology.orchestra.run.smithi187.stdout:(36/154): ceph-volume-18.2.1-132.g568df92b.el9. 3.4 MB/s | 262 kB 00:00 2023-12-20T04:40:57.008 INFO:teuthology.orchestra.run.smithi187.stdout:(37/154): cephadm-18.2.1-132.g568df92b.el9.noar 3.2 MB/s | 221 kB 00:00 2023-12-20T04:40:57.067 INFO:teuthology.orchestra.run.smithi187.stdout:(38/154): cephfs-top-18.2.1-132.g568df92b.el9.n 217 kB/s | 18 kB 00:00 2023-12-20T04:40:57.159 INFO:teuthology.orchestra.run.smithi187.stdout:(39/154): automake-1.16.2-8.el9.noarch.rpm 4.3 MB/s | 662 kB 00:00 2023-12-20T04:40:57.193 INFO:teuthology.orchestra.run.smithi187.stdout:(40/154): bison-3.7.4-5.el9.x86_64.rpm 7.3 MB/s | 920 kB 00:00 2023-12-20T04:40:57.218 INFO:teuthology.orchestra.run.smithi187.stdout:(41/154): boost-program-options-1.75.0-8.el9.x8 1.8 MB/s | 106 kB 00:00 2023-12-20T04:40:57.235 INFO:teuthology.orchestra.run.smithi187.stdout:(42/154): elfutils-libelf-devel-0.190-1.el9.x86 518 kB/s | 21 kB 00:00 2023-12-20T04:40:57.260 INFO:teuthology.orchestra.run.smithi187.stdout:(43/154): flex-2.6.4-9.el9.x86_64.rpm 7.2 MB/s | 307 kB 00:00 2023-12-20T04:40:57.277 INFO:teuthology.orchestra.run.smithi187.stdout:(44/154): flexiblas-3.0.4-8.el9.x86_64.rpm 762 kB/s | 32 kB 00:00 2023-12-20T04:40:57.353 INFO:teuthology.orchestra.run.smithi187.stdout:(45/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 33 MB/s | 3.0 MB 00:00 2023-12-20T04:40:57.353 INFO:teuthology.orchestra.run.smithi132.stdout:Extra Packages for Enterprise Linux 13 MB/s | 20 MB 00:01 2023-12-20T04:40:57.370 INFO:teuthology.orchestra.run.smithi187.stdout:(46/154): flexiblas-openblas-openmp-3.0.4-8.el9 189 kB/s | 17 kB 00:00 2023-12-20T04:40:57.395 INFO:teuthology.orchestra.run.smithi187.stdout:(47/154): jq-1.6-16.el9.x86_64.rpm 4.4 MB/s | 186 kB 00:00 2023-12-20T04:40:57.412 INFO:teuthology.orchestra.run.smithi187.stdout:(48/154): libaio-devel-0.3.111-13.el9.x86_64.rp 242 kB/s | 10 kB 00:00 2023-12-20T04:40:57.437 INFO:teuthology.orchestra.run.smithi187.stdout:(49/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 3.7 MB/s | 159 kB 00:00 2023-12-20T04:40:57.454 INFO:teuthology.orchestra.run.smithi187.stdout:(50/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2023-12-20T04:40:57.479 INFO:teuthology.orchestra.run.smithi187.stdout:(51/154): librdkafka-1.6.1-102.el9.x86_64.rpm 15 MB/s | 661 kB 00:00 2023-12-20T04:40:57.505 INFO:teuthology.orchestra.run.smithi187.stdout:(52/154): libtool-2.4.6-45.el9.x86_64.rpm 11 MB/s | 578 kB 00:00 2023-12-20T04:40:57.522 INFO:teuthology.orchestra.run.smithi187.stdout:(53/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 597 kB/s | 24 kB 00:00 2023-12-20T04:40:57.539 INFO:teuthology.orchestra.run.smithi187.stdout:(54/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 1.4 MB/s | 46 kB 00:00 2023-12-20T04:40:57.564 INFO:teuthology.orchestra.run.smithi187.stdout:(55/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.6 MB/s | 282 kB 00:00 2023-12-20T04:40:57.589 INFO:teuthology.orchestra.run.smithi187.stdout:(56/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 4.2 MB/s | 217 kB 00:00 2023-12-20T04:40:57.606 INFO:teuthology.orchestra.run.smithi187.stdout:(57/154): openblas-0.3.21-2.el9.x86_64.rpm 816 kB/s | 34 kB 00:00 2023-12-20T04:40:58.015 INFO:teuthology.orchestra.run.smithi187.stdout:(58/154): ceph-test-18.2.1-132.g568df92b.el9.x8 13 MB/s | 40 MB 00:02 2023-12-20T04:40:58.099 INFO:teuthology.orchestra.run.smithi187.stdout:(59/154): openblas-openmp-0.3.21-2.el9.x86_64.r 9.3 MB/s | 4.7 MB 00:00 2023-12-20T04:40:58.140 INFO:teuthology.orchestra.run.smithi187.stdout:(60/154): postgresql-13.11-1.el9.x86_64.rpm 2.9 MB/s | 1.5 MB 00:00 2023-12-20T04:40:58.174 INFO:teuthology.orchestra.run.smithi187.stdout:(61/154): postgresql-contrib-13.11-1.el9.x86_64 5.1 MB/s | 811 kB 00:00 2023-12-20T04:40:58.199 INFO:teuthology.orchestra.run.smithi187.stdout:(62/154): postgresql-private-libs-13.11-1.el9.x 1.3 MB/s | 134 kB 00:00 2023-12-20T04:40:58.225 INFO:teuthology.orchestra.run.smithi187.stdout:(63/154): python3-attrs-20.3.0-7.el9.noarch.rpm 1.5 MB/s | 78 kB 00:00 2023-12-20T04:40:58.333 INFO:teuthology.orchestra.run.smithi187.stdout:(64/154): postgresql-server-13.11-1.el9.x86_64. 36 MB/s | 5.7 MB 00:00 2023-12-20T04:40:58.384 INFO:teuthology.orchestra.run.smithi187.stdout:(65/154): python3-jinja2-2.11.3-4.el9.noarch.rp 1.4 MB/s | 228 kB 00:00 2023-12-20T04:40:58.450 INFO:teuthology.orchestra.run.smithi187.stdout:(66/154): python3-babel-2.9.1-2.el9.noarch.rpm 23 MB/s | 5.8 MB 00:00 2023-12-20T04:40:58.475 INFO:teuthology.orchestra.run.smithi187.stdout:(67/154): python3-jsonpatch-1.21-16.el9.noarch. 175 kB/s | 24 kB 00:00 2023-12-20T04:40:58.501 INFO:teuthology.orchestra.run.smithi187.stdout:(68/154): python3-jsonpointer-2.0-4.el9.noarch. 155 kB/s | 18 kB 00:00 2023-12-20T04:40:58.526 INFO:teuthology.orchestra.run.smithi187.stdout:(69/154): python3-markupsafe-1.1.1-12.el9.x86_6 633 kB/s | 32 kB 00:00 2023-12-20T04:40:58.551 INFO:teuthology.orchestra.run.smithi187.stdout:(70/154): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2023-12-20T04:40:58.635 INFO:teuthology.orchestra.run.smithi187.stdout:(71/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2023-12-20T04:40:58.660 INFO:teuthology.orchestra.run.smithi187.stdout:(72/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2023-12-20T04:40:58.685 INFO:teuthology.orchestra.run.smithi187.stdout:(73/154): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 174 kB 00:00 2023-12-20T04:40:58.711 INFO:teuthology.orchestra.run.smithi187.stdout:(74/154): python3-prettytable-0.7.2-27.el9.noar 553 kB/s | 41 kB 00:00 2023-12-20T04:40:58.736 INFO:teuthology.orchestra.run.smithi187.stdout:(75/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 132 kB 00:00 2023-12-20T04:40:58.761 INFO:teuthology.orchestra.run.smithi187.stdout:(76/154): python3-pyasn1-modules-0.4.8-6.el9.no 2.7 MB/s | 211 kB 00:00 2023-12-20T04:40:58.778 INFO:teuthology.orchestra.run.smithi187.stdout:(77/154): python3-pytz-2021.1-5.el9.noarch.rpm 714 kB/s | 47 kB 00:00 2023-12-20T04:40:58.795 INFO:teuthology.orchestra.run.smithi187.stdout:(78/154): python3-requests-oauthlib-1.3.0-12.el 1.3 MB/s | 43 kB 00:00 2023-12-20T04:40:58.887 INFO:teuthology.orchestra.run.smithi187.stdout:(79/154): python3-toml-0.10.2-6.el9.noarch.rpm 356 kB/s | 39 kB 00:00 2023-12-20T04:40:59.087 INFO:teuthology.orchestra.run.smithi187.stdout:(80/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 48 MB/s | 16 MB 00:00 2023-12-20T04:40:59.104 INFO:teuthology.orchestra.run.smithi187.stdout:(81/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 134 kB/s | 41 kB 00:00 2023-12-20T04:40:59.129 INFO:teuthology.orchestra.run.smithi187.stdout:(82/154): socat-1.7.4.1-5.el9.x86_64.rpm 1.2 MB/s | 300 kB 00:00 2023-12-20T04:40:59.149 INFO:teuthology.orchestra.run.smithi187.stdout:(83/154): uuid-1.6.2-55.el9.x86_64.rpm 922 kB/s | 56 kB 00:00 2023-12-20T04:40:59.174 INFO:teuthology.orchestra.run.smithi187.stdout:(84/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.9 MB/s | 85 kB 00:00 2023-12-20T04:40:59.191 INFO:teuthology.orchestra.run.smithi187.stdout:(85/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.0 MB/s | 63 kB 00:00 2023-12-20T04:40:59.208 INFO:teuthology.orchestra.run.smithi187.stdout:(86/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 755 kB/s | 44 kB 00:00 2023-12-20T04:40:59.242 INFO:teuthology.orchestra.run.smithi187.stdout:(87/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 16 MB/s | 803 kB 00:00 2023-12-20T04:40:59.267 INFO:teuthology.orchestra.run.smithi187.stdout:(88/154): fuse-2.9.9-15.el9.x86_64.rpm 1.0 MB/s | 79 kB 00:00 2023-12-20T04:40:59.292 INFO:teuthology.orchestra.run.smithi187.stdout:(89/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 2.3 MB/s | 195 kB 00:00 2023-12-20T04:40:59.318 INFO:teuthology.orchestra.run.smithi187.stdout:(90/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.1 MB/s | 241 kB 00:00 2023-12-20T04:40:59.343 INFO:teuthology.orchestra.run.smithi187.stdout:(91/154): python3-ply-3.11-14.el9.noarch.rpm 2.0 MB/s | 103 kB 00:00 2023-12-20T04:40:59.377 INFO:teuthology.orchestra.run.smithi187.stdout:(92/154): python3-cryptography-36.0.1-4.el9.x86 14 MB/s | 1.1 MB 00:00 2023-12-20T04:40:59.402 INFO:teuthology.orchestra.run.smithi187.stdout:(93/154): python3-pycparser-2.20-6.el9.noarch.r 1.4 MB/s | 124 kB 00:00 2023-12-20T04:40:59.427 INFO:teuthology.orchestra.run.smithi187.stdout:(94/154): python3-requests-2.25.1-7.el9.noarch. 1.3 MB/s | 113 kB 00:00 2023-12-20T04:40:59.452 INFO:teuthology.orchestra.run.smithi187.stdout:(95/154): python3-urllib3-1.26.5-4.el9.noarch.r 3.7 MB/s | 187 kB 00:00 2023-12-20T04:40:59.561 INFO:teuthology.orchestra.run.smithi187.stdout:(96/154): python3-devel-3.9.17-2.el9.x86_64.rpm 1.8 MB/s | 245 kB 00:00 2023-12-20T04:40:59.770 INFO:teuthology.orchestra.run.smithi187.stdout:(97/154): fmt-8.1.1-5.el9.x86_64.rpm 349 kB/s | 111 kB 00:00 2023-12-20T04:40:59.912 INFO:teuthology.orchestra.run.smithi187.stdout:(98/154): gperftools-libs-2.9.1-2.el9.x86_64.rp 882 kB/s | 309 kB 00:00 2023-12-20T04:40:59.997 INFO:teuthology.orchestra.run.smithi187.stdout:(99/154): openssl-devel-3.0.7-25.el9.x86_64.rpm 7.0 MB/s | 4.1 MB 00:00 2023-12-20T04:41:00.445 INFO:teuthology.orchestra.run.smithi187.stdout:(100/154): libarrow-9.0.0-10.el9.x86_64.rpm 6.5 MB/s | 4.4 MB 00:00 2023-12-20T04:41:00.471 INFO:teuthology.orchestra.run.smithi187.stdout:(101/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 46 kB/s | 26 kB 00:00 2023-12-20T04:41:00.495 INFO:teuthology.orchestra.run.smithi187.stdout:(102/154): liboath-2.6.7-2.el9.x86_64.rpm 97 kB/s | 49 kB 00:00 2023-12-20T04:41:00.521 INFO:teuthology.orchestra.run.smithi187.stdout:(103/154): libunwind-1.6.2-1.el9.x86_64.rpm 898 kB/s | 67 kB 00:00 2023-12-20T04:41:00.671 INFO:teuthology.orchestra.run.smithi187.stdout:(104/154): python3-asyncssh-2.13.2-3.el9.noarch 3.1 MB/s | 548 kB 00:00 2023-12-20T04:41:00.696 INFO:teuthology.orchestra.run.smithi187.stdout:(105/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 4.1 MB/s | 838 kB 00:00 2023-12-20T04:41:00.713 INFO:teuthology.orchestra.run.smithi187.stdout:(106/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 226 kB/s | 43 kB 00:00 2023-12-20T04:41:00.730 INFO:teuthology.orchestra.run.smithi187.stdout:(107/154): python3-cachetools-4.2.4-1.el9.noarc 555 kB/s | 32 kB 00:00 2023-12-20T04:41:00.772 INFO:teuthology.orchestra.run.smithi187.stdout:(108/154): python3-certifi-2021.10.8-2.el9.noar 256 kB/s | 15 kB 00:00 2023-12-20T04:41:00.798 INFO:teuthology.orchestra.run.smithi187.stdout:(109/154): python3-cheroot-8.6.0-4.el9.noarch.r 2.0 MB/s | 172 kB 00:00 2023-12-20T04:41:00.840 INFO:teuthology.orchestra.run.smithi187.stdout:(110/154): python3-cherrypy-18.6.1-2.el9.noarch 3.2 MB/s | 358 kB 00:00 2023-12-20T04:41:00.881 INFO:teuthology.orchestra.run.smithi187.stdout:(111/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 2.7 MB/s | 303 kB 00:00 2023-12-20T04:41:00.898 INFO:teuthology.orchestra.run.smithi187.stdout:(112/154): python3-colorama-0.4.4-12.el9.noarch 353 kB/s | 35 kB 00:00 2023-12-20T04:41:00.924 INFO:teuthology.orchestra.run.smithi187.stdout:(113/154): python3-google-auth-2.23.4-1.el9.noa 2.3 MB/s | 197 kB 00:00 2023-12-20T04:41:00.941 INFO:teuthology.orchestra.run.smithi187.stdout:(114/154): python3-jaraco-8.2.1-3.el9.noarch.rp 181 kB/s | 11 kB 00:00 2023-12-20T04:41:00.957 INFO:teuthology.orchestra.run.smithi187.stdout:(115/154): python3-jaraco-classes-3.2.1-5.el9.n 301 kB/s | 18 kB 00:00 2023-12-20T04:41:00.983 INFO:teuthology.orchestra.run.smithi187.stdout:(116/154): python3-jaraco-collections-3.0.0-8.e 394 kB/s | 23 kB 00:00 2023-12-20T04:41:01.000 INFO:teuthology.orchestra.run.smithi187.stdout:(117/154): python3-jaraco-functools-3.5.0-2.el9 331 kB/s | 19 kB 00:00 2023-12-20T04:41:01.017 INFO:teuthology.orchestra.run.smithi187.stdout:(118/154): python3-jaraco-text-3.2.0-6.el9.noar 334 kB/s | 20 kB 00:00 2023-12-20T04:41:01.042 INFO:teuthology.orchestra.run.smithi187.stdout:(119/154): python3-jwt+crypto-2.4.0-1.el9.noarc 154 kB/s | 9.0 kB 00:00 2023-12-20T04:41:01.059 INFO:teuthology.orchestra.run.smithi187.stdout:(120/154): python3-jwt-2.4.0-1.el9.noarch.rpm 696 kB/s | 41 kB 00:00 2023-12-20T04:41:01.176 INFO:teuthology.orchestra.run.smithi187.stdout:(121/154): python3-kubernetes-26.1.0-2.el9.noar 6.4 MB/s | 1.0 MB 00:00 2023-12-20T04:41:01.193 INFO:teuthology.orchestra.run.smithi187.stdout:(122/154): python3-logutils-0.3.5-21.el9.noarch 308 kB/s | 46 kB 00:00 2023-12-20T04:41:01.220 INFO:teuthology.orchestra.run.smithi187.stdout:(123/154): python3-more-itertools-8.12.0-2.el9. 497 kB/s | 79 kB 00:00 2023-12-20T04:41:01.235 INFO:teuthology.orchestra.run.smithi187.stdout:(124/154): python3-natsort-7.1.1-5.el9.noarch.r 989 kB/s | 58 kB 00:00 2023-12-20T04:41:01.285 INFO:teuthology.orchestra.run.smithi187.stdout:(125/154): python3-pecan-1.4.2-3.el9.noarch.rpm 4.0 MB/s | 272 kB 00:00 2023-12-20T04:41:01.310 INFO:teuthology.orchestra.run.smithi187.stdout:(126/154): python3-portend-3.1.0-2.el9.noarch.r 179 kB/s | 16 kB 00:00 2023-12-20T04:41:01.336 INFO:teuthology.orchestra.run.smithi187.stdout:(127/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 895 kB/s | 90 kB 00:00 2023-12-20T04:41:01.353 INFO:teuthology.orchestra.run.smithi187.stdout:(128/154): python3-pyperclip-1.8.2-2.el9.noarch 422 kB/s | 28 kB 00:00 2023-12-20T04:41:01.403 INFO:teuthology.orchestra.run.smithi187.stdout:(129/154): python3-repoze-lru-0.7-16.el9.noarch 461 kB/s | 31 kB 00:00 2023-12-20T04:41:01.428 INFO:teuthology.orchestra.run.smithi187.stdout:(130/154): python3-routes-2.5.1-5.el9.noarch.rp 2.0 MB/s | 188 kB 00:00 2023-12-20T04:41:01.454 INFO:teuthology.orchestra.run.smithi187.stdout:(131/154): python3-rsa-4.9-2.el9.noarch.rpm 589 kB/s | 59 kB 00:00 2023-12-20T04:41:01.479 INFO:teuthology.orchestra.run.smithi187.stdout:(132/154): python3-tempora-5.0.0-2.el9.noarch.r 478 kB/s | 36 kB 00:00 2023-12-20T04:41:01.520 INFO:teuthology.orchestra.run.smithi187.stdout:(133/154): python3-typing-extensions-4.4.0-2.el 767 kB/s | 51 kB 00:00 2023-12-20T04:41:01.546 INFO:teuthology.orchestra.run.smithi187.stdout:(134/154): python3-webob-1.8.7-6.el9.noarch.rpm 2.4 MB/s | 230 kB 00:00 2023-12-20T04:41:01.571 INFO:teuthology.orchestra.run.smithi187.stdout:(135/154): python3-websocket-client-1.2.3-2.el9 974 kB/s | 90 kB 00:00 2023-12-20T04:41:01.638 INFO:teuthology.orchestra.run.smithi187.stdout:(136/154): python3-werkzeug-2.0.3-3.el9.1.noarc 3.6 MB/s | 427 kB 00:00 2023-12-20T04:41:01.663 INFO:teuthology.orchestra.run.smithi187.stdout:(137/154): python3-zc-lockfile-2.0-10.el9.noarc 220 kB/s | 20 kB 00:00 2023-12-20T04:41:01.688 INFO:teuthology.orchestra.run.smithi187.stdout:(138/154): re2-20211101-3.el9.x86_64.rpm 1.6 MB/s | 192 kB 00:00 2023-12-20T04:41:01.872 INFO:teuthology.orchestra.run.smithi187.stdout:(139/154): thrift-0.15.0-2.el9.x86_64.rpm 6.8 MB/s | 1.6 MB 00:00 2023-12-20T04:41:01.906 INFO:teuthology.orchestra.run.smithi187.stdout:(140/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 68 kB 00:00 2023-12-20T04:41:01.939 INFO:teuthology.orchestra.run.smithi187.stdout:(141/154): acl-2.3.1-4.el9.x86_64.rpm 2.0 MB/s | 69 kB 00:00 2023-12-20T04:41:01.998 INFO:teuthology.orchestra.run.smithi187.stdout:(142/154): librados2-18.2.1-132.g568df92b.el9.x 11 MB/s | 3.3 MB 00:00 2023-12-20T04:41:02.012 INFO:teuthology.orchestra.run.smithi132.stdout:lab-extras 15 kB/s | 1.7 kB 00:00 2023-12-20T04:41:02.023 INFO:teuthology.orchestra.run.smithi187.stdout:(143/154): elfutils-debuginfod-client-0.190-1.e 437 kB/s | 36 kB 00:00 2023-12-20T04:41:02.048 INFO:teuthology.orchestra.run.smithi187.stdout:(144/154): elfutils-libelf-0.190-1.el9.x86_64.r 3.7 MB/s | 192 kB 00:00 2023-12-20T04:41:02.074 INFO:teuthology.orchestra.run.smithi187.stdout:(145/154): elfutils-libs-0.190-1.el9.x86_64.rpm 5.0 MB/s | 255 kB 00:00 2023-12-20T04:41:02.099 INFO:teuthology.orchestra.run.smithi187.stdout:(146/154): libacl-2.3.1-4.el9.x86_64.rpm 440 kB/s | 22 kB 00:00 2023-12-20T04:41:02.124 INFO:teuthology.orchestra.run.smithi187.stdout:(147/154): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2023-12-20T04:41:02.300 INFO:teuthology.orchestra.run.smithi187.stdout:(148/154): librbd1-18.2.1-132.g568df92b.el9.x86 4.9 MB/s | 3.0 MB 00:00 2023-12-20T04:41:02.450 INFO:teuthology.orchestra.run.smithi187.stdout:(149/154): NetworkManager-team-1.45.7-1.el9.x86 289 kB/s | 43 kB 00:00 2023-12-20T04:41:02.600 INFO:teuthology.orchestra.run.smithi187.stdout:(150/154): NetworkManager-libnm-1.45.7-1.el9.x8 3.7 MB/s | 1.8 MB 00:00 2023-12-20T04:41:02.676 INFO:teuthology.orchestra.run.smithi187.stdout:(151/154): NetworkManager-tui-1.45.7-1.el9.x86_ 1.1 MB/s | 246 kB 00:00 2023-12-20T04:41:02.734 INFO:teuthology.orchestra.run.smithi187.stdout:(152/154): NetworkManager-1.45.7-1.el9.x86_64.r 3.6 MB/s | 2.3 MB 00:00 2023-12-20T04:41:02.768 INFO:teuthology.orchestra.run.smithi187.stdout:(153/154): openssl-3.0.7-25.el9.x86_64.rpm 7.3 MB/s | 1.2 MB 00:00 2023-12-20T04:41:03.185 INFO:teuthology.orchestra.run.smithi187.stdout:(154/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 4.2 MB/s | 2.2 MB 00:00 2023-12-20T04:41:03.191 INFO:teuthology.orchestra.run.smithi187.stdout:-------------------------------------------------------------------------------- 2023-12-20T04:41:03.191 INFO:teuthology.orchestra.run.smithi187.stdout:Total 18 MB/s | 200 MB 00:11 2023-12-20T04:41:03.357 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction check 2023-12-20T04:41:03.542 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction check succeeded. 2023-12-20T04:41:03.542 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction test 2023-12-20T04:41:04.412 INFO:teuthology.orchestra.run.smithi132.stdout:Package librados2-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-20T04:41:04.413 INFO:teuthology.orchestra.run.smithi132.stdout:Package librbd1-2:16.2.4-5.el9.x86_64 is already installed. 2023-12-20T04:41:04.427 INFO:teuthology.orchestra.run.smithi132.stdout:Package NetworkManager-1:1.44.0-2.el9.x86_64 is already installed. 2023-12-20T04:41:04.428 INFO:teuthology.orchestra.run.smithi132.stdout:Package iproute-6.2.0-5.el9.x86_64 is already installed. 2023-12-20T04:41:04.429 INFO:teuthology.orchestra.run.smithi132.stdout:Package util-linux-2.37.4-15.el9.x86_64 is already installed. 2023-12-20T04:41:04.430 INFO:teuthology.orchestra.run.smithi132.stdout:Package libacl-devel-2.3.1-3.el9.x86_64 is already installed. 2023-12-20T04:41:04.432 INFO:teuthology.orchestra.run.smithi132.stdout:Package libattr-devel-2.5.1-3.el9.x86_64 is already installed. 2023-12-20T04:41:04.434 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsdump-3.1.12-3.el9.x86_64 is already installed. 2023-12-20T04:41:04.436 INFO:teuthology.orchestra.run.smithi132.stdout:Package xfsprogs-5.19.0-4.el9.x86_64 is already installed. 2023-12-20T04:41:04.509 INFO:teuthology.orchestra.run.smithi132.stdout:Dependencies resolved. 2023-12-20T04:41:04.523 INFO:teuthology.orchestra.run.smithi132.stdout:=========================================================================================== 2023-12-20T04:41:04.524 INFO:teuthology.orchestra.run.smithi132.stdout: Package Arch Version Repository Size 2023-12-20T04:41:04.524 INFO:teuthology.orchestra.run.smithi132.stdout:=========================================================================================== 2023-12-20T04:41:04.524 INFO:teuthology.orchestra.run.smithi132.stdout:Installing: 2023-12-20T04:41:04.524 INFO:teuthology.orchestra.run.smithi132.stdout: bison x86_64 3.7.4-5.el9 CentOS-AppStream 920 k 2023-12-20T04:41:04.524 INFO:teuthology.orchestra.run.smithi132.stdout: ceph x86_64 2:18.2.1-132.g568df92b.el9 ceph 6.5 k 2023-12-20T04:41:04.524 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base x86_64 2:18.2.1-132.g568df92b.el9 ceph 5.2 M 2023-12-20T04:41:04.524 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse x86_64 2:18.2.1-132.g568df92b.el9 ceph 840 k 2023-12-20T04:41:04.524 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache x86_64 2:18.2.1-132.g568df92b.el9 ceph 142 k 2023-12-20T04:41:04.524 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr x86_64 2:18.2.1-132.g568df92b.el9 ceph 1.4 M 2023-12-20T04:41:04.524 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 132 k 2023-12-20T04:41:04.524 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 1.8 M 2023-12-20T04:41:04.524 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 7.4 M 2023-12-20T04:41:04.524 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 50 k 2023-12-20T04:41:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw x86_64 2:18.2.1-132.g568df92b.el9 ceph 7.7 M 2023-12-20T04:41:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test x86_64 2:18.2.1-132.g568df92b.el9 ceph 40 M 2023-12-20T04:41:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 262 k 2023-12-20T04:41:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 221 k 2023-12-20T04:41:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror x86_64 2:18.2.1-132.g568df92b.el9 ceph 219 k 2023-12-20T04:41:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-shell x86_64 2:18.2.1-132.g568df92b.el9 ceph 27 k 2023-12-20T04:41:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 18 k 2023-12-20T04:41:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel x86_64 0.190-1.el9 CentOS-AppStream 21 k 2023-12-20T04:41:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: flex x86_64 2.6.4-9.el9 CentOS-AppStream 307 k 2023-12-20T04:41:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel x86_64 0.3.111-13.el9 CentOS-AppStream 10 k 2023-12-20T04:41:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel x86_64 2:18.2.1-132.g568df92b.el9 ceph 31 k 2023-12-20T04:41:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 658 k 2023-12-20T04:41:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel x86_64 2:18.2.1-132.g568df92b.el9 ceph 126 k 2023-12-20T04:41:04.525 INFO:teuthology.orchestra.run.smithi132.stdout: libtool x86_64 2.4.6-45.el9 CentOS-AppStream 578 k 2023-12-20T04:41:04.526 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel x86_64 2.37.4-15.el9 CentOS-AppStream 24 k 2023-12-20T04:41:04.526 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel x86_64 1:3.0.7-25.el9 appstream 4.1 M 2023-12-20T04:41:04.526 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql x86_64 13.11-1.el9 CentOS-AppStream 1.5 M 2023-12-20T04:41:04.526 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib x86_64 13.11-1.el9 CentOS-AppStream 811 k 2023-12-20T04:41:04.526 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server x86_64 13.11-1.el9 CentOS-AppStream 5.7 M 2023-12-20T04:41:04.526 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs x86_64 2:18.2.1-132.g568df92b.el9 ceph 161 k 2023-12-20T04:41:04.526 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados x86_64 2:18.2.1-132.g568df92b.el9 ceph 321 k 2023-12-20T04:41:04.526 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd x86_64 2:18.2.1-132.g568df92b.el9 ceph 298 k 2023-12-20T04:41:04.526 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw x86_64 2:18.2.1-132.g568df92b.el9 ceph 99 k 2023-12-20T04:41:04.526 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse x86_64 2:18.2.1-132.g568df92b.el9 ceph 86 k 2023-12-20T04:41:04.526 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.0 M 2023-12-20T04:41:04.526 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd x86_64 2:18.2.1-132.g568df92b.el9 ceph 171 k 2023-12-20T04:41:04.526 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel x86_64 5.19.0-4.el9 CentOS-AppStream 85 k 2023-12-20T04:41:04.527 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrading: 2023-12-20T04:41:04.527 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager x86_64 1:1.45.7-1.el9 baseos 2.3 M 2023-12-20T04:41:04.527 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-libnm x86_64 1:1.45.7-1.el9 baseos 1.8 M 2023-12-20T04:41:04.527 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-team x86_64 1:1.45.7-1.el9 baseos 43 k 2023-12-20T04:41:04.527 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-tui x86_64 1:1.45.7-1.el9 baseos 246 k 2023-12-20T04:41:04.527 INFO:teuthology.orchestra.run.smithi132.stdout: acl x86_64 2.3.1-4.el9 CentOS-BaseOS 69 k 2023-12-20T04:41:04.527 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-debuginfod-client x86_64 0.190-1.el9 CentOS-BaseOS 36 k 2023-12-20T04:41:04.527 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf x86_64 0.190-1.el9 CentOS-BaseOS 192 k 2023-12-20T04:41:04.527 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libs x86_64 0.190-1.el9 CentOS-BaseOS 255 k 2023-12-20T04:41:04.527 INFO:teuthology.orchestra.run.smithi132.stdout: libacl x86_64 2.3.1-4.el9 CentOS-BaseOS 22 k 2023-12-20T04:41:04.527 INFO:teuthology.orchestra.run.smithi132.stdout: libacl-devel x86_64 2.3.1-4.el9 CentOS-AppStream 68 k 2023-12-20T04:41:04.527 INFO:teuthology.orchestra.run.smithi132.stdout: librados2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.3 M 2023-12-20T04:41:04.527 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1 x86_64 2:18.2.1-132.g568df92b.el9 ceph 3.0 M 2023-12-20T04:41:04.527 INFO:teuthology.orchestra.run.smithi132.stdout: openssl x86_64 1:3.0.7-25.el9 baseos 1.2 M 2023-12-20T04:41:04.527 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-libs x86_64 1:3.0.7-25.el9 baseos 2.2 M 2023-12-20T04:41:04.528 INFO:teuthology.orchestra.run.smithi132.stdout: xfsdump x86_64 3.1.12-4.el9 CentOS-BaseOS 321 k 2023-12-20T04:41:04.528 INFO:teuthology.orchestra.run.smithi132.stdout:Installing dependencies: 2023-12-20T04:41:04.528 INFO:teuthology.orchestra.run.smithi132.stdout: automake noarch 1.16.2-8.el9 CentOS-AppStream 662 k 2023-12-20T04:41:04.528 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options x86_64 1.75.0-8.el9 CentOS-AppStream 106 k 2023-12-20T04:41:04.528 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common x86_64 2:18.2.1-132.g568df92b.el9 ceph 18 M 2023-12-20T04:41:04.528 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 23 k 2023-12-20T04:41:04.528 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds x86_64 2:18.2.1-132.g568df92b.el9 ceph 2.1 M 2023-12-20T04:41:04.528 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 242 k 2023-12-20T04:41:04.528 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon x86_64 2:18.2.1-132.g568df92b.el9 ceph 4.4 M 2023-12-20T04:41:04.528 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd x86_64 2:18.2.1-132.g568df92b.el9 ceph 18 M 2023-12-20T04:41:04.528 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts noarch 2:18.2.1-132.g568df92b.el9 ceph-noarch 15 k 2023-12-20T04:41:04.529 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux x86_64 2:18.2.1-132.g568df92b.el9 ceph 24 k 2023-12-20T04:41:04.529 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas x86_64 3.0.4-8.el9 CentOS-AppStream 32 k 2023-12-20T04:41:04.529 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 CentOS-AppStream 3.0 M 2023-12-20T04:41:04.529 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 CentOS-AppStream 17 k 2023-12-20T04:41:04.529 INFO:teuthology.orchestra.run.smithi132.stdout: fmt x86_64 8.1.1-5.el9 epel 111 k 2023-12-20T04:41:04.529 INFO:teuthology.orchestra.run.smithi132.stdout: fuse x86_64 2.9.9-15.el9 CentOS-BaseOS 79 k 2023-12-20T04:41:04.529 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs x86_64 2.9.1-2.el9 epel 309 k 2023-12-20T04:41:04.529 INFO:teuthology.orchestra.run.smithi132.stdout: jq x86_64 1.6-16.el9 CentOS-AppStream 186 k 2023-12-20T04:41:04.529 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow x86_64 9.0.0-10.el9 epel 4.4 M 2023-12-20T04:41:04.530 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc noarch 9.0.0-10.el9 epel 26 k 2023-12-20T04:41:04.530 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite x86_64 2:18.2.1-132.g568df92b.el9 ceph 166 k 2023-12-20T04:41:04.530 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran x86_64 11.4.1-2.3.el9 CentOS-BaseOS 803 k 2023-12-20T04:41:04.530 INFO:teuthology.orchestra.run.smithi132.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2023-12-20T04:41:04.530 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj x86_64 1.12.1-1.el9 CentOS-AppStream 159 k 2023-12-20T04:41:04.530 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath x86_64 11.4.1-2.3.el9 CentOS-BaseOS 195 k 2023-12-20T04:41:04.530 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq x86_64 0.11.0-7.el9 CentOS-AppStream 44 k 2023-12-20T04:41:04.530 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1 x86_64 2:18.2.1-132.g568df92b.el9 ceph 475 k 2023-12-20T04:41:04.530 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka x86_64 1.6.1-102.el9 CentOS-AppStream 661 k 2023-12-20T04:41:04.530 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2 x86_64 2:18.2.1-132.g568df92b.el9 ceph 4.5 M 2023-12-20T04:41:04.530 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2023-12-20T04:41:04.531 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel x86_64 1.5.1-2.el9 CentOS-AppStream 46 k 2023-12-20T04:41:04.531 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust x86_64 2.12.0-6.el9 CentOS-AppStream 282 k 2023-12-20T04:41:04.531 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma x86_64 6.9.6-1.el9.5 CentOS-AppStream 217 k 2023-12-20T04:41:04.531 INFO:teuthology.orchestra.run.smithi132.stdout: openblas x86_64 0.3.21-2.el9 CentOS-AppStream 34 k 2023-12-20T04:41:04.531 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp x86_64 0.3.21-2.el9 CentOS-AppStream 4.7 M 2023-12-20T04:41:04.531 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs x86_64 9.0.0-10.el9 epel 838 k 2023-12-20T04:41:04.531 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-private-libs x86_64 13.11-1.el9 CentOS-AppStream 134 k 2023-12-20T04:41:04.531 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh noarch 2.13.2-3.el9 epel 548 k 2023-12-20T04:41:04.531 INFO:teuthology.orchestra.run.smithi132.stdout: python3-attrs noarch 20.3.0-7.el9 CentOS-AppStream 78 k 2023-12-20T04:41:04.531 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel noarch 2.9.1-2.el9 CentOS-AppStream 5.8 M 2023-12-20T04:41:04.531 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2023-12-20T04:41:04.531 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2023-12-20T04:41:04.531 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse x86_64 2:18.2.1-132.g568df92b.el9 ceph 45 k 2023-12-20T04:41:04.531 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common x86_64 2:18.2.1-132.g568df92b.el9 ceph 124 k 2023-12-20T04:41:04.532 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi noarch 2021.10.8-2.el9 epel 15 k 2023-12-20T04:41:04.532 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi x86_64 1.14.5-5.el9 CentOS-BaseOS 241 k 2023-12-20T04:41:04.532 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2023-12-20T04:41:04.532 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2023-12-20T04:41:04.532 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cmd2 noarch 2.4.2-2.el9 epel 303 k 2023-12-20T04:41:04.532 INFO:teuthology.orchestra.run.smithi132.stdout: python3-colorama noarch 0.4.4-12.el9 epel 35 k 2023-12-20T04:41:04.532 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography x86_64 36.0.1-4.el9 CentOS-BaseOS 1.1 M 2023-12-20T04:41:04.532 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel x86_64 3.9.17-2.el9 appstream 245 k 2023-12-20T04:41:04.532 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth noarch 1:2.23.4-1.el9 epel 197 k 2023-12-20T04:41:04.532 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2023-12-20T04:41:04.532 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2023-12-20T04:41:04.532 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections noarch 3.0.0-8.el9 epel 23 k 2023-12-20T04:41:04.532 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2023-12-20T04:41:04.532 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2023-12-20T04:41:04.532 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2 noarch 2.11.3-4.el9 CentOS-AppStream 228 k 2023-12-20T04:41:04.533 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch noarch 1.21-16.el9 CentOS-AppStream 24 k 2023-12-20T04:41:04.533 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer noarch 2.0-4.el9 CentOS-AppStream 18 k 2023-12-20T04:41:04.533 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt noarch 2.4.0-1.el9 epel 41 k 2023-12-20T04:41:04.533 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2023-12-20T04:41:04.533 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2023-12-20T04:41:04.533 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako noarch 1.1.4-6.el9 CentOS-AppStream 144 k 2023-12-20T04:41:04.533 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe x86_64 1.1.1-12.el9 CentOS-AppStream 32 k 2023-12-20T04:41:04.533 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2023-12-20T04:41:04.533 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2023-12-20T04:41:04.533 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy x86_64 1:1.20.1-5.el9 CentOS-AppStream 4.8 M 2023-12-20T04:41:04.533 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 CentOS-AppStream 217 k 2023-12-20T04:41:04.533 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib noarch 3.1.1-5.el9 CentOS-AppStream 174 k 2023-12-20T04:41:04.533 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2023-12-20T04:41:04.533 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply noarch 3.11-14.el9 CentOS-BaseOS 103 k 2023-12-20T04:41:04.534 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2023-12-20T04:41:04.534 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable noarch 0.7.2-27.el9 CentOS-AppStream 41 k 2023-12-20T04:41:04.534 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2023-12-20T04:41:04.535 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1 noarch 0.4.8-6.el9 CentOS-AppStream 132 k 2023-12-20T04:41:04.535 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 CentOS-AppStream 211 k 2023-12-20T04:41:04.535 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser noarch 2.20-6.el9 CentOS-BaseOS 124 k 2023-12-20T04:41:04.535 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyperclip noarch 1.8.2-2.el9 epel 28 k 2023-12-20T04:41:04.535 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz noarch 2021.1-5.el9 CentOS-AppStream 47 k 2023-12-20T04:41:04.535 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2023-12-20T04:41:04.535 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests noarch 2.25.1-7.el9 CentOS-BaseOS 113 k 2023-12-20T04:41:04.536 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 CentOS-AppStream 43 k 2023-12-20T04:41:04.536 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2023-12-20T04:41:04.536 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2023-12-20T04:41:04.536 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy x86_64 1.6.2-8.el9 CentOS-AppStream 16 M 2023-12-20T04:41:04.536 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2023-12-20T04:41:04.537 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml noarch 0.10.2-6.el9 CentOS-AppStream 39 k 2023-12-20T04:41:04.537 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions noarch 4.4.0-2.el9 epel 51 k 2023-12-20T04:41:04.537 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3 noarch 1.26.5-4.el9 CentOS-BaseOS 187 k 2023-12-20T04:41:04.537 INFO:teuthology.orchestra.run.smithi132.stdout: python3-wcwidth noarch 0.2.5-8.el9 CentOS-AppStream 41 k 2023-12-20T04:41:04.537 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob noarch 1.8.7-6.el9 epel 230 k 2023-12-20T04:41:04.537 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2023-12-20T04:41:04.537 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2023-12-20T04:41:04.537 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2023-12-20T04:41:04.537 INFO:teuthology.orchestra.run.smithi132.stdout: re2 x86_64 1:20211101-3.el9 epel 192 k 2023-12-20T04:41:04.537 INFO:teuthology.orchestra.run.smithi132.stdout: socat x86_64 1.7.4.1-5.el9 CentOS-AppStream 300 k 2023-12-20T04:41:04.537 INFO:teuthology.orchestra.run.smithi132.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2023-12-20T04:41:04.537 INFO:teuthology.orchestra.run.smithi132.stdout: uuid x86_64 1.6.2-55.el9 CentOS-AppStream 56 k 2023-12-20T04:41:04.538 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet x86_64 1.6.1-20.el9 CentOS-AppStream 63 k 2023-12-20T04:41:04.538 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel x86_64 1.2.11-40.el9 CentOS-AppStream 44 k 2023-12-20T04:41:04.538 INFO:teuthology.orchestra.run.smithi132.stdout:Installing weak dependencies: 2023-12-20T04:41:04.538 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt+crypto noarch 2.4.0-1.el9 epel 9.0 k 2023-12-20T04:41:04.538 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:41:04.538 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction Summary 2023-12-20T04:41:04.538 INFO:teuthology.orchestra.run.smithi132.stdout:=========================================================================================== 2023-12-20T04:41:04.538 INFO:teuthology.orchestra.run.smithi132.stdout:Install 139 Packages 2023-12-20T04:41:04.538 INFO:teuthology.orchestra.run.smithi132.stdout:Upgrade 15 Packages 2023-12-20T04:41:04.538 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:41:04.539 INFO:teuthology.orchestra.run.smithi132.stdout:Total download size: 200 M 2023-12-20T04:41:04.539 INFO:teuthology.orchestra.run.smithi132.stdout:Downloading Packages: 2023-12-20T04:41:05.268 INFO:teuthology.orchestra.run.smithi132.stdout:(1/154): ceph-18.2.1-132.g568df92b.el9.x86_64.r 40 kB/s | 6.5 kB 00:00 2023-12-20T04:41:05.336 INFO:teuthology.orchestra.run.smithi187.stdout:Transaction test succeeded. 2023-12-20T04:41:05.337 INFO:teuthology.orchestra.run.smithi187.stdout:Running transaction 2023-12-20T04:41:05.510 INFO:teuthology.orchestra.run.smithi132.stdout:(2/154): ceph-fuse-18.2.1-132.g568df92b.el9.x86 3.4 MB/s | 840 kB 00:00 2023-12-20T04:41:05.569 INFO:teuthology.orchestra.run.smithi132.stdout:(3/154): ceph-immutable-object-cache-18.2.1-132 2.4 MB/s | 142 kB 00:00 2023-12-20T04:41:05.820 INFO:teuthology.orchestra.run.smithi132.stdout:(4/154): ceph-mds-18.2.1-132.g568df92b.el9.x86_ 8.4 MB/s | 2.1 MB 00:00 2023-12-20T04:41:05.995 INFO:teuthology.orchestra.run.smithi132.stdout:(5/154): ceph-mgr-18.2.1-132.g568df92b.el9.x86_ 8.3 MB/s | 1.4 MB 00:00 2023-12-20T04:41:06.095 INFO:teuthology.orchestra.run.smithi132.stdout:(6/154): ceph-base-18.2.1-132.g568df92b.el9.x86 5.3 MB/s | 5.2 MB 00:00 2023-12-20T04:41:06.495 INFO:teuthology.orchestra.run.smithi132.stdout:(7/154): ceph-mon-18.2.1-132.g568df92b.el9.x86_ 8.8 MB/s | 4.4 MB 00:00 2023-12-20T04:41:07.437 INFO:teuthology.orchestra.run.smithi132.stdout:(8/154): ceph-common-18.2.1-132.g568df92b.el9.x 7.9 MB/s | 18 MB 00:02 2023-12-20T04:41:07.529 INFO:teuthology.orchestra.run.smithi132.stdout:(9/154): ceph-radosgw-18.2.1-132.g568df92b.el9. 7.5 MB/s | 7.7 MB 00:01 2023-12-20T04:41:07.554 INFO:teuthology.orchestra.run.smithi132.stdout:(10/154): ceph-selinux-18.2.1-132.g568df92b.el9 206 kB/s | 24 kB 00:00 2023-12-20T04:41:07.646 INFO:teuthology.orchestra.run.smithi132.stdout:(11/154): cephfs-mirror-18.2.1-132.g568df92b.el 2.3 MB/s | 219 kB 00:00 2023-12-20T04:41:07.721 INFO:teuthology.orchestra.run.smithi132.stdout:(12/154): cephfs-shell-18.2.1-132.g568df92b.el9 361 kB/s | 27 kB 00:00 2023-12-20T04:41:07.805 INFO:teuthology.orchestra.run.smithi132.stdout:(13/154): libcephfs-devel-18.2.1-132.g568df92b. 373 kB/s | 31 kB 00:00 2023-12-20T04:41:07.905 INFO:teuthology.orchestra.run.smithi132.stdout:(14/154): libcephfs2-18.2.1-132.g568df92b.el9.x 6.4 MB/s | 658 kB 00:00 2023-12-20T04:41:08.114 INFO:teuthology.orchestra.run.smithi132.stdout:(15/154): ceph-osd-18.2.1-132.g568df92b.el9.x86 8.7 MB/s | 18 MB 00:02 2023-12-20T04:41:08.139 INFO:teuthology.orchestra.run.smithi132.stdout:(16/154): libcephsqlite-18.2.1-132.g568df92b.el 710 kB/s | 166 kB 00:00 2023-12-20T04:41:08.173 INFO:teuthology.orchestra.run.smithi132.stdout:(17/154): librados-devel-18.2.1-132.g568df92b.e 2.1 MB/s | 126 kB 00:00 2023-12-20T04:41:08.231 INFO:teuthology.orchestra.run.smithi132.stdout:(18/154): libradosstriper1-18.2.1-132.g568df92b 5.0 MB/s | 475 kB 00:00 2023-12-20T04:41:08.298 INFO:teuthology.orchestra.run.smithi132.stdout:(19/154): python3-ceph-argparse-18.2.1-132.g568 676 kB/s | 45 kB 00:00 2023-12-20T04:41:08.382 INFO:teuthology.orchestra.run.smithi132.stdout:(20/154): python3-ceph-common-18.2.1-132.g568df 1.5 MB/s | 124 kB 00:00 2023-12-20T04:41:08.466 INFO:teuthology.orchestra.run.smithi132.stdout:(21/154): python3-cephfs-18.2.1-132.g568df92b.e 1.9 MB/s | 161 kB 00:00 2023-12-20T04:41:08.566 INFO:teuthology.orchestra.run.smithi132.stdout:(22/154): python3-rados-18.2.1-132.g568df92b.el 3.1 MB/s | 321 kB 00:00 2023-12-20T04:41:08.666 INFO:teuthology.orchestra.run.smithi132.stdout:(23/154): librgw2-18.2.1-132.g568df92b.el9.x86_ 9.0 MB/s | 4.5 MB 00:00 2023-12-20T04:41:08.702 INFO:teuthology.orchestra.run.smithi132.stdout:(24/154): python3-rbd-18.2.1-132.g568df92b.el9. 2.3 MB/s | 298 kB 00:00 2023-12-20T04:41:08.742 INFO:teuthology.orchestra.run.smithi132.stdout:(25/154): python3-rgw-18.2.1-132.g568df92b.el9. 1.3 MB/s | 99 kB 00:00 2023-12-20T04:41:08.767 INFO:teuthology.orchestra.run.smithi132.stdout:(26/154): rbd-fuse-18.2.1-132.g568df92b.el9.x86 1.1 MB/s | 86 kB 00:00 2023-12-20T04:41:08.859 INFO:teuthology.orchestra.run.smithi132.stdout:(27/154): rbd-nbd-18.2.1-132.g568df92b.el9.x86_ 1.8 MB/s | 171 kB 00:00 2023-12-20T04:41:08.934 INFO:teuthology.orchestra.run.smithi132.stdout:(28/154): ceph-grafana-dashboards-18.2.1-132.g5 310 kB/s | 23 kB 00:00 2023-12-20T04:41:09.026 INFO:teuthology.orchestra.run.smithi132.stdout:(29/154): ceph-mgr-cephadm-18.2.1-132.g568df92b 1.4 MB/s | 132 kB 00:00 2023-12-20T04:41:09.093 INFO:teuthology.orchestra.run.smithi132.stdout:(30/154): rbd-mirror-18.2.1-132.g568df92b.el9.x 8.5 MB/s | 3.0 MB 00:00 2023-12-20T04:41:09.227 INFO:teuthology.orchestra.run.smithi132.stdout:(31/154): ceph-mgr-dashboard-18.2.1-132.g568df9 8.8 MB/s | 1.8 MB 00:00 2023-12-20T04:41:09.319 INFO:teuthology.orchestra.run.smithi132.stdout:(32/154): ceph-mgr-modules-core-18.2.1-132.g568 2.6 MB/s | 242 kB 00:00 2023-12-20T04:41:09.402 INFO:teuthology.orchestra.run.smithi132.stdout:(33/154): ceph-mgr-rook-18.2.1-132.g568df92b.el 603 kB/s | 50 kB 00:00 2023-12-20T04:41:09.486 INFO:teuthology.orchestra.run.smithi132.stdout:(34/154): ceph-prometheus-alerts-18.2.1-132.g56 176 kB/s | 15 kB 00:00 2023-12-20T04:41:09.586 INFO:teuthology.orchestra.run.smithi132.stdout:(35/154): ceph-volume-18.2.1-132.g568df92b.el9. 2.6 MB/s | 262 kB 00:00 2023-12-20T04:41:09.678 INFO:teuthology.orchestra.run.smithi132.stdout:(36/154): cephadm-18.2.1-132.g568df92b.el9.noar 2.4 MB/s | 221 kB 00:00 2023-12-20T04:41:09.762 INFO:teuthology.orchestra.run.smithi132.stdout:(37/154): cephfs-top-18.2.1-132.g568df92b.el9.n 217 kB/s | 18 kB 00:00 2023-12-20T04:41:09.854 INFO:teuthology.orchestra.run.smithi132.stdout:(38/154): ceph-mgr-diskprediction-local-18.2.1- 9.7 MB/s | 7.4 MB 00:00 2023-12-20T04:41:10.004 INFO:teuthology.orchestra.run.smithi132.stdout:(39/154): automake-1.16.2-8.el9.noarch.rpm 2.7 MB/s | 662 kB 00:00 2023-12-20T04:41:10.363 INFO:teuthology.orchestra.run.smithi132.stdout:(40/154): ceph-test-18.2.1-132.g568df92b.el9.x8 14 MB/s | 40 MB 00:02 2023-12-20T04:41:10.396 INFO:teuthology.orchestra.run.smithi132.stdout:(41/154): bison-3.7.4-5.el9.x86_64.rpm 1.7 MB/s | 920 kB 00:00 2023-12-20T04:41:10.421 INFO:teuthology.orchestra.run.smithi132.stdout:(42/154): boost-program-options-1.75.0-8.el9.x8 254 kB/s | 106 kB 00:00 2023-12-20T04:41:10.447 INFO:teuthology.orchestra.run.smithi132.stdout:(43/154): elfutils-libelf-devel-0.190-1.el9.x86 259 kB/s | 21 kB 00:00 2023-12-20T04:41:10.472 INFO:teuthology.orchestra.run.smithi132.stdout:(44/154): flexiblas-3.0.4-8.el9.x86_64.rpm 634 kB/s | 32 kB 00:00 2023-12-20T04:41:10.506 INFO:teuthology.orchestra.run.smithi132.stdout:(45/154): flex-2.6.4-9.el9.x86_64.rpm 3.6 MB/s | 307 kB 00:00 2023-12-20T04:41:10.556 INFO:teuthology.orchestra.run.smithi132.stdout:(46/154): flexiblas-netlib-3.0.4-8.el9.x86_64.r 27 MB/s | 3.0 MB 00:00 2023-12-20T04:41:10.581 INFO:teuthology.orchestra.run.smithi132.stdout:(47/154): flexiblas-openblas-openmp-3.0.4-8.el9 161 kB/s | 17 kB 00:00 2023-12-20T04:41:10.606 INFO:teuthology.orchestra.run.smithi132.stdout:(48/154): jq-1.6-16.el9.x86_64.rpm 1.9 MB/s | 186 kB 00:00 2023-12-20T04:41:10.623 INFO:teuthology.orchestra.run.smithi132.stdout:(49/154): libaio-devel-0.3.111-13.el9.x86_64.rp 242 kB/s | 10 kB 00:00 2023-12-20T04:41:10.648 INFO:teuthology.orchestra.run.smithi132.stdout:(50/154): libpmemobj-1.12.1-1.el9.x86_64.rpm 2.3 MB/s | 159 kB 00:00 2023-12-20T04:41:10.665 INFO:teuthology.orchestra.run.smithi132.stdout:(51/154): librabbitmq-0.11.0-7.el9.x86_64.rpm 758 kB/s | 44 kB 00:00 2023-12-20T04:41:10.699 INFO:teuthology.orchestra.run.smithi132.stdout:(52/154): librdkafka-1.6.1-102.el9.x86_64.rpm 13 MB/s | 661 kB 00:00 2023-12-20T04:41:10.724 INFO:teuthology.orchestra.run.smithi132.stdout:(53/154): libtool-2.4.6-45.el9.x86_64.rpm 7.5 MB/s | 578 kB 00:00 2023-12-20T04:41:10.741 INFO:teuthology.orchestra.run.smithi132.stdout:(54/154): libuuid-devel-2.37.4-15.el9.x86_64.rp 324 kB/s | 24 kB 00:00 2023-12-20T04:41:10.760 INFO:teuthology.orchestra.run.smithi132.stdout:(55/154): libzstd-devel-1.5.1-2.el9.x86_64.rpm 771 kB/s | 46 kB 00:00 2023-12-20T04:41:10.785 INFO:teuthology.orchestra.run.smithi132.stdout:(56/154): lttng-ust-2.12.0-6.el9.x86_64.rpm 6.4 MB/s | 282 kB 00:00 2023-12-20T04:41:10.810 INFO:teuthology.orchestra.run.smithi132.stdout:(57/154): oniguruma-6.9.6-1.el9.5.x86_64.rpm 3.1 MB/s | 217 kB 00:00 2023-12-20T04:41:10.827 INFO:teuthology.orchestra.run.smithi132.stdout:(58/154): openblas-0.3.21-2.el9.x86_64.rpm 511 kB/s | 34 kB 00:00 2023-12-20T04:41:10.885 INFO:teuthology.orchestra.run.smithi132.stdout:(59/154): postgresql-13.11-1.el9.x86_64.rpm 20 MB/s | 1.5 MB 00:00 2023-12-20T04:41:10.952 INFO:teuthology.orchestra.run.smithi132.stdout:(60/154): openblas-openmp-0.3.21-2.el9.x86_64.r 33 MB/s | 4.7 MB 00:00 2023-12-20T04:41:10.986 INFO:teuthology.orchestra.run.smithi132.stdout:(61/154): postgresql-contrib-13.11-1.el9.x86_64 5.0 MB/s | 811 kB 00:00 2023-12-20T04:41:11.011 INFO:teuthology.orchestra.run.smithi132.stdout:(62/154): postgresql-private-libs-13.11-1.el9.x 1.1 MB/s | 134 kB 00:00 2023-12-20T04:41:11.112 INFO:teuthology.orchestra.run.smithi132.stdout:(63/154): postgresql-server-13.11-1.el9.x86_64. 36 MB/s | 5.7 MB 00:00 2023-12-20T04:41:11.136 INFO:teuthology.orchestra.run.smithi132.stdout:(64/154): python3-attrs-20.3.0-7.el9.noarch.rpm 634 kB/s | 78 kB 00:00 2023-12-20T04:41:11.229 INFO:teuthology.orchestra.run.smithi132.stdout:(65/154): python3-babel-2.9.1-2.el9.noarch.rpm 27 MB/s | 5.8 MB 00:00 2023-12-20T04:41:11.254 INFO:teuthology.orchestra.run.smithi132.stdout:(66/154): python3-jinja2-2.11.3-4.el9.noarch.rp 1.6 MB/s | 228 kB 00:00 2023-12-20T04:41:11.279 INFO:teuthology.orchestra.run.smithi132.stdout:(67/154): python3-jsonpatch-1.21-16.el9.noarch. 175 kB/s | 24 kB 00:00 2023-12-20T04:41:11.304 INFO:teuthology.orchestra.run.smithi132.stdout:(68/154): python3-jsonpointer-2.0-4.el9.noarch. 242 kB/s | 18 kB 00:00 2023-12-20T04:41:11.329 INFO:teuthology.orchestra.run.smithi132.stdout:(69/154): python3-markupsafe-1.1.1-12.el9.x86_6 634 kB/s | 32 kB 00:00 2023-12-20T04:41:11.355 INFO:teuthology.orchestra.run.smithi132.stdout:(70/154): python3-mako-1.1.4-6.el9.noarch.rpm 1.9 MB/s | 144 kB 00:00 2023-12-20T04:41:11.427 INFO:teuthology.orchestra.run.smithi187.stdout: Preparing : 1/1 2023-12-20T04:41:11.438 INFO:teuthology.orchestra.run.smithi132.stdout:(71/154): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 4.8 MB 00:00 2023-12-20T04:41:11.464 INFO:teuthology.orchestra.run.smithi132.stdout:(72/154): python3-numpy-f2py-1.20.1-5.el9.x86_6 1.6 MB/s | 217 kB 00:00 2023-12-20T04:41:11.489 INFO:teuthology.orchestra.run.smithi132.stdout:(73/154): python3-oauthlib-3.1.1-5.el9.noarch.r 1.3 MB/s | 174 kB 00:00 2023-12-20T04:41:11.514 INFO:teuthology.orchestra.run.smithi132.stdout:(74/154): python3-prettytable-0.7.2-27.el9.noar 552 kB/s | 41 kB 00:00 2023-12-20T04:41:11.539 INFO:teuthology.orchestra.run.smithi132.stdout:(75/154): python3-pyasn1-modules-0.4.8-6.el9.no 4.1 MB/s | 211 kB 00:00 2023-12-20T04:41:11.554 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-20T04:41:11.564 INFO:teuthology.orchestra.run.smithi132.stdout:(76/154): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.7 MB/s | 132 kB 00:00 2023-12-20T04:41:11.590 INFO:teuthology.orchestra.run.smithi132.stdout:(77/154): python3-pytz-2021.1-5.el9.noarch.rpm 631 kB/s | 47 kB 00:00 2023-12-20T04:41:11.617 INFO:teuthology.orchestra.run.smithi132.stdout:(78/154): python3-requests-oauthlib-1.3.0-12.el 553 kB/s | 43 kB 00:00 2023-12-20T04:41:11.634 INFO:teuthology.orchestra.run.smithi132.stdout:(79/154): python3-toml-0.10.2-6.el9.noarch.rpm 884 kB/s | 39 kB 00:00 2023-12-20T04:41:11.637 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-20T04:41:11.743 INFO:teuthology.orchestra.run.smithi132.stdout:(80/154): python3-wcwidth-0.2.5-8.el9.noarch.rp 328 kB/s | 41 kB 00:00 2023-12-20T04:41:11.821 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-20T04:41:11.906 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-20T04:41:11.927 INFO:teuthology.orchestra.run.smithi132.stdout:(81/154): python3-scipy-1.6.2-8.el9.x86_64.rpm 47 MB/s | 16 MB 00:00 2023-12-20T04:41:11.931 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-20T04:41:11.952 INFO:teuthology.orchestra.run.smithi132.stdout:(82/154): socat-1.7.4.1-5.el9.x86_64.rpm 956 kB/s | 300 kB 00:00 2023-12-20T04:41:11.969 INFO:teuthology.orchestra.run.smithi132.stdout:(83/154): uuid-1.6.2-55.el9.x86_64.rpm 253 kB/s | 56 kB 00:00 2023-12-20T04:41:11.978 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-20T04:41:11.994 INFO:teuthology.orchestra.run.smithi132.stdout:(84/154): xfsprogs-devel-5.19.0-4.el9.x86_64.rp 1.3 MB/s | 85 kB 00:00 2023-12-20T04:41:12.011 INFO:teuthology.orchestra.run.smithi132.stdout:(85/154): zlib-devel-1.2.11-40.el9.x86_64.rpm 1.0 MB/s | 44 kB 00:00 2023-12-20T04:41:12.028 INFO:teuthology.orchestra.run.smithi132.stdout:(86/154): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.0 MB/s | 63 kB 00:00 2023-12-20T04:41:12.053 INFO:teuthology.orchestra.run.smithi132.stdout:(87/154): fuse-2.9.9-15.el9.x86_64.rpm 1.3 MB/s | 79 kB 00:00 2023-12-20T04:41:12.081 INFO:teuthology.orchestra.run.smithi132.stdout:(88/154): libgfortran-11.4.1-2.3.el9.x86_64.rpm 12 MB/s | 803 kB 00:00 2023-12-20T04:41:12.103 INFO:teuthology.orchestra.run.smithi132.stdout:(89/154): libquadmath-11.4.1-2.3.el9.x86_64.rpm 3.9 MB/s | 195 kB 00:00 2023-12-20T04:41:12.128 INFO:teuthology.orchestra.run.smithi132.stdout:(90/154): python3-cffi-1.14.5-5.el9.x86_64.rpm 3.2 MB/s | 241 kB 00:00 2023-12-20T04:41:12.171 INFO:teuthology.orchestra.run.smithi132.stdout:(91/154): python3-cryptography-36.0.1-4.el9.x86 13 MB/s | 1.1 MB 00:00 2023-12-20T04:41:12.196 INFO:teuthology.orchestra.run.smithi132.stdout:(92/154): python3-ply-3.11-14.el9.noarch.rpm 1.5 MB/s | 103 kB 00:00 2023-12-20T04:41:12.229 INFO:teuthology.orchestra.run.smithi132.stdout:(93/154): python3-pycparser-2.20-6.el9.noarch.r 1.2 MB/s | 124 kB 00:00 2023-12-20T04:41:12.255 INFO:teuthology.orchestra.run.smithi132.stdout:(94/154): python3-requests-2.25.1-7.el9.noarch. 1.3 MB/s | 113 kB 00:00 2023-12-20T04:41:12.293 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-20T04:41:12.313 INFO:teuthology.orchestra.run.smithi132.stdout:(95/154): python3-urllib3-1.26.5-4.el9.noarch.r 2.2 MB/s | 187 kB 00:00 2023-12-20T04:41:12.366 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librados2-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-20T04:41:12.422 INFO:teuthology.orchestra.run.smithi132.stdout:(96/154): python3-devel-3.9.17-2.el9.x86_64.rpm 1.4 MB/s | 245 kB 00:00 2023-12-20T04:41:12.484 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-20T04:41:12.534 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-20T04:41:12.589 INFO:teuthology.orchestra.run.smithi132.stdout:(97/154): openssl-devel-3.0.7-25.el9.x86_64.rpm 12 MB/s | 4.1 MB 00:00 2023-12-20T04:41:12.625 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-20T04:41:12.657 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 10/169 2023-12-20T04:41:12.712 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-20T04:41:12.886 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-20T04:41:12.927 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-20T04:41:12.955 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-20T04:41:13.014 INFO:teuthology.orchestra.run.smithi132.stdout:(98/154): fmt-8.1.1-5.el9.x86_64.rpm 158 kB/s | 111 kB 00:00 2023-12-20T04:41:13.038 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-20T04:41:13.064 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 15/169 2023-12-20T04:41:13.114 INFO:teuthology.orchestra.run.smithi132.stdout:(99/154): libarrow-doc-9.0.0-10.el9.noarch.rpm 260 kB/s | 26 kB 00:00 2023-12-20T04:41:13.214 INFO:teuthology.orchestra.run.smithi132.stdout:(100/154): liboath-2.6.7-2.el9.x86_64.rpm 486 kB/s | 49 kB 00:00 2023-12-20T04:41:13.261 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 15/169 2023-12-20T04:41:13.385 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-20T04:41:13.406 INFO:teuthology.orchestra.run.smithi132.stdout:(101/154): gperftools-libs-2.9.1-2.el9.x86_64.r 322 kB/s | 309 kB 00:00 2023-12-20T04:41:13.431 INFO:teuthology.orchestra.run.smithi132.stdout:(102/154): libunwind-1.6.2-1.el9.x86_64.rpm 310 kB/s | 67 kB 00:00 2023-12-20T04:41:13.445 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-20T04:41:13.549 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-20T04:41:13.596 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-20T04:41:13.798 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-20T04:41:13.897 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-20T04:41:13.935 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-20T04:41:14.004 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-20T04:41:14.057 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-20T04:41:14.088 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-20T04:41:14.133 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-20T04:41:14.172 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-20T04:41:14.198 INFO:teuthology.orchestra.run.smithi132.stdout:(103/154): python3-asyncssh-2.13.2-3.el9.noarch 715 kB/s | 548 kB 00:00 2023-12-20T04:41:14.236 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-20T04:41:14.271 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-20T04:41:14.299 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-20T04:41:14.307 INFO:teuthology.orchestra.run.smithi132.stdout:(104/154): python3-bcrypt-3.2.2-1.el9.x86_64.rp 402 kB/s | 43 kB 00:00 2023-12-20T04:41:14.366 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-20T04:41:14.404 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-common-2:18.2.1-132.g568df92b.el9.x 29/169 2023-12-20T04:41:14.424 INFO:teuthology.orchestra.run.smithi132.stdout:(105/154): python3-cachetools-4.2.4-1.el9.noarc 276 kB/s | 32 kB 00:00 2023-12-20T04:41:14.447 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ceph-argparse-2:18.2.1-132.g568df92b.el9 30/169 2023-12-20T04:41:14.491 INFO:teuthology.orchestra.run.smithi132.stdout:(106/154): parquet-libs-9.0.0-10.el9.x86_64.rpm 773 kB/s | 838 kB 00:01 2023-12-20T04:41:14.521 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 31/169 2023-12-20T04:41:14.524 INFO:teuthology.orchestra.run.smithi132.stdout:(107/154): python3-certifi-2021.10.8-2.el9.noar 149 kB/s | 15 kB 00:00 2023-12-20T04:41:14.654 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-20T04:41:14.708 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-20T04:41:14.758 INFO:teuthology.orchestra.run.smithi132.stdout:(108/154): python3-cheroot-8.6.0-4.el9.noarch.r 643 kB/s | 172 kB 00:00 2023-12-20T04:41:15.033 INFO:teuthology.orchestra.run.smithi132.stdout:(109/154): python3-cherrypy-18.6.1-2.el9.noarch 705 kB/s | 358 kB 00:00 2023-12-20T04:41:15.159 INFO:teuthology.orchestra.run.smithi132.stdout:(110/154): python3-colorama-0.4.4-12.el9.noarch 282 kB/s | 35 kB 00:00 2023-12-20T04:41:15.193 INFO:teuthology.orchestra.run.smithi132.stdout:(111/154): python3-cmd2-2.4.2-2.el9.noarch.rpm 698 kB/s | 303 kB 00:00 2023-12-20T04:41:15.238 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-20T04:41:15.309 INFO:teuthology.orchestra.run.smithi132.stdout:(112/154): python3-jaraco-8.2.1-3.el9.noarch.rp 92 kB/s | 11 kB 00:00 2023-12-20T04:41:15.320 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-20T04:41:15.365 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-20T04:41:15.414 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-20T04:41:15.426 INFO:teuthology.orchestra.run.smithi132.stdout:(113/154): python3-google-auth-2.23.4-1.el9.noa 739 kB/s | 197 kB 00:00 2023-12-20T04:41:15.448 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 38/169 2023-12-20T04:41:15.451 INFO:teuthology.orchestra.run.smithi132.stdout:(114/154): python3-jaraco-classes-3.2.1-5.el9.n 124 kB/s | 18 kB 00:00 2023-12-20T04:41:15.489 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-20T04:41:15.527 INFO:teuthology.orchestra.run.smithi132.stdout:(115/154): python3-jaraco-collections-3.0.0-8.e 231 kB/s | 23 kB 00:00 2023-12-20T04:41:15.560 INFO:teuthology.orchestra.run.smithi132.stdout:(116/154): python3-jaraco-functools-3.5.0-2.el9 179 kB/s | 19 kB 00:00 2023-12-20T04:41:15.622 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-20T04:41:15.627 INFO:teuthology.orchestra.run.smithi132.stdout:(117/154): python3-jaraco-text-3.2.0-6.el9.noar 196 kB/s | 20 kB 00:00 2023-12-20T04:41:15.661 INFO:teuthology.orchestra.run.smithi132.stdout:(118/154): python3-jwt+crypto-2.4.0-1.el9.noarc 90 kB/s | 9.0 kB 00:00 2023-12-20T04:41:15.665 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-20T04:41:15.720 INFO:teuthology.orchestra.run.smithi132.stdout:(119/154): python3-jwt-2.4.0-1.el9.noarch.rpm 445 kB/s | 41 kB 00:00 2023-12-20T04:41:15.772 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-20T04:41:15.810 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-20T04:41:15.828 INFO:teuthology.orchestra.run.smithi132.stdout:(120/154): python3-logutils-0.3.5-21.el9.noarch 428 kB/s | 46 kB 00:00 2023-12-20T04:41:15.864 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-20T04:41:15.928 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-20T04:41:15.937 INFO:teuthology.orchestra.run.smithi132.stdout:(121/154): python3-more-itertools-8.12.0-2.el9. 728 kB/s | 79 kB 00:00 2023-12-20T04:41:15.960 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-20T04:41:15.997 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-20T04:41:16.037 INFO:teuthology.orchestra.run.smithi132.stdout:(122/154): python3-natsort-7.1.1-5.el9.noarch.r 577 kB/s | 58 kB 00:00 2023-12-20T04:41:16.043 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-20T04:41:16.080 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-20T04:41:16.122 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-20T04:41:16.164 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-20T04:41:16.297 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-20T04:41:16.345 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-20T04:41:16.392 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-20T04:41:16.433 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-20T04:41:16.462 INFO:teuthology.orchestra.run.smithi132.stdout:(123/154): python3-pecan-1.4.2-3.el9.noarch.rpm 641 kB/s | 272 kB 00:00 2023-12-20T04:41:16.525 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-20T04:41:16.563 INFO:teuthology.orchestra.run.smithi132.stdout:(124/154): python3-portend-3.1.0-2.el9.noarch.r 164 kB/s | 16 kB 00:00 2023-12-20T04:41:16.567 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-20T04:41:16.609 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-20T04:41:16.641 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-20T04:41:16.667 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-20T04:41:16.738 INFO:teuthology.orchestra.run.smithi132.stdout:(125/154): python3-pyOpenSSL-21.0.0-1.el9.noarc 514 kB/s | 90 kB 00:00 2023-12-20T04:41:16.758 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-20T04:41:16.802 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-20T04:41:16.838 INFO:teuthology.orchestra.run.smithi132.stdout:(126/154): python3-pyperclip-1.8.2-2.el9.noarch 283 kB/s | 28 kB 00:00 2023-12-20T04:41:16.850 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-20T04:41:16.930 INFO:teuthology.orchestra.run.smithi132.stdout:(127/154): python3-repoze-lru-0.7-16.el9.noarch 335 kB/s | 31 kB 00:00 2023-12-20T04:41:16.999 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-20T04:41:17.005 INFO:teuthology.orchestra.run.smithi132.stdout:(128/154): python3-kubernetes-26.1.0-2.el9.noar 778 kB/s | 1.0 MB 00:01 2023-12-20T04:41:17.098 INFO:teuthology.orchestra.run.smithi132.stdout:(129/154): python3-rsa-4.9-2.el9.noarch.rpm 644 kB/s | 59 kB 00:00 2023-12-20T04:41:17.180 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-20T04:41:17.206 INFO:teuthology.orchestra.run.smithi132.stdout:(130/154): python3-routes-2.5.1-5.el9.noarch.rp 684 kB/s | 188 kB 00:00 2023-12-20T04:41:17.223 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-20T04:41:17.223 INFO:teuthology.orchestra.run.smithi132.stdout:(131/154): python3-tempora-5.0.0-2.el9.noarch.r 286 kB/s | 36 kB 00:00 2023-12-20T04:41:17.307 INFO:teuthology.orchestra.run.smithi132.stdout:(132/154): python3-typing-extensions-4.4.0-2.el 509 kB/s | 51 kB 00:00 2023-12-20T04:41:17.351 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-20T04:41:17.392 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-20T04:41:17.422 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-20T04:41:17.455 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-20T04:41:17.488 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-20T04:41:17.490 INFO:teuthology.orchestra.run.smithi132.stdout:(133/154): python3-websocket-client-1.2.3-2.el9 489 kB/s | 90 kB 00:00 2023-12-20T04:41:17.518 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-20T04:41:17.532 INFO:teuthology.orchestra.run.smithi132.stdout:(134/154): python3-webob-1.8.7-6.el9.noarch.rpm 744 kB/s | 230 kB 00:00 2023-12-20T04:41:17.562 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-20T04:41:17.605 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-20T04:41:17.649 INFO:teuthology.orchestra.run.smithi132.stdout:(135/154): python3-zc-lockfile-2.0-10.el9.noarc 171 kB/s | 20 kB 00:00 2023-12-20T04:41:17.653 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-20T04:41:17.685 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-20T04:41:17.714 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-20T04:41:17.789 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-20T04:41:17.825 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-20T04:41:17.858 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-20T04:41:17.899 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-20T04:41:17.926 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-20T04:41:17.933 INFO:teuthology.orchestra.run.smithi132.stdout:(136/154): re2-20211101-3.el9.x86_64.rpm 677 kB/s | 192 kB 00:00 2023-12-20T04:41:18.014 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-20T04:41:18.045 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-20T04:41:18.133 INFO:teuthology.orchestra.run.smithi132.stdout:(137/154): python3-werkzeug-2.0.3-3.el9.1.noarc 665 kB/s | 427 kB 00:00 2023-12-20T04:41:18.145 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-20T04:41:18.203 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-20T04:41:18.425 INFO:teuthology.orchestra.run.smithi132.stdout:(138/154): librados2-18.2.1-132.g568df92b.el9.x 11 MB/s | 3.3 MB 00:00 2023-12-20T04:41:18.592 INFO:teuthology.orchestra.run.smithi132.stdout:(139/154): librbd1-18.2.1-132.g568df92b.el9.x86 18 MB/s | 3.0 MB 00:00 2023-12-20T04:41:18.642 INFO:teuthology.orchestra.run.smithi132.stdout:(140/154): libacl-devel-2.3.1-4.el9.x86_64.rpm 1.3 MB/s | 68 kB 00:00 2023-12-20T04:41:18.685 INFO:teuthology.orchestra.run.smithi132.stdout:(141/154): acl-2.3.1-4.el9.x86_64.rpm 1.6 MB/s | 69 kB 00:00 2023-12-20T04:41:18.727 INFO:teuthology.orchestra.run.smithi132.stdout:(142/154): elfutils-debuginfod-client-0.190-1.e 879 kB/s | 36 kB 00:00 2023-12-20T04:41:18.785 INFO:teuthology.orchestra.run.smithi132.stdout:(143/154): elfutils-libelf-0.190-1.el9.x86_64.r 3.2 MB/s | 192 kB 00:00 2023-12-20T04:41:18.844 INFO:teuthology.orchestra.run.smithi132.stdout:(144/154): libarrow-9.0.0-10.el9.x86_64.rpm 726 kB/s | 4.4 MB 00:06 2023-12-20T04:41:18.869 INFO:teuthology.orchestra.run.smithi132.stdout:(145/154): elfutils-libs-0.190-1.el9.x86_64.rpm 3.0 MB/s | 255 kB 00:00 2023-12-20T04:41:18.894 INFO:teuthology.orchestra.run.smithi132.stdout:(146/154): libacl-2.3.1-4.el9.x86_64.rpm 441 kB/s | 22 kB 00:00 2023-12-20T04:41:18.913 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-20T04:41:18.919 INFO:teuthology.orchestra.run.smithi132.stdout:(147/154): xfsdump-3.1.12-4.el9.x86_64.rpm 6.3 MB/s | 321 kB 00:00 2023-12-20T04:41:18.959 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-20T04:41:18.993 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-20T04:41:19.040 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-20T04:41:19.119 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-20T04:41:19.161 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-20T04:41:19.286 INFO:teuthology.orchestra.run.smithi132.stdout:(148/154): NetworkManager-libnm-1.45.7-1.el9.x8 4.8 MB/s | 1.8 MB 00:00 2023-12-20T04:41:19.328 INFO:teuthology.orchestra.run.smithi132.stdout:(149/154): NetworkManager-team-1.45.7-1.el9.x86 1.0 MB/s | 43 kB 00:00 2023-12-20T04:41:19.337 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-20T04:41:19.370 INFO:teuthology.orchestra.run.smithi132.stdout:(150/154): NetworkManager-tui-1.45.7-1.el9.x86_ 5.8 MB/s | 246 kB 00:00 2023-12-20T04:41:19.383 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-20T04:41:19.466 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-20T04:41:19.529 INFO:teuthology.orchestra.run.smithi132.stdout:(151/154): NetworkManager-1.45.7-1.el9.x86_64.r 3.6 MB/s | 2.3 MB 00:00 2023-12-20T04:41:19.571 INFO:teuthology.orchestra.run.smithi132.stdout:(152/154): openssl-3.0.7-25.el9.x86_64.rpm 6.1 MB/s | 1.2 MB 00:00 2023-12-20T04:41:19.646 INFO:teuthology.orchestra.run.smithi132.stdout:(153/154): openssl-libs-3.0.7-25.el9.x86_64.rpm 18 MB/s | 2.2 MB 00:00 2023-12-20T04:41:20.112 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-20T04:41:20.163 INFO:teuthology.orchestra.run.smithi132.stdout:(154/154): thrift-0.15.0-2.el9.x86_64.rpm 726 kB/s | 1.6 MB 00:02 2023-12-20T04:41:20.170 INFO:teuthology.orchestra.run.smithi132.stdout:-------------------------------------------------------------------------------- 2023-12-20T04:41:20.170 INFO:teuthology.orchestra.run.smithi132.stdout:Total 13 MB/s | 200 MB 00:15 2023-12-20T04:41:20.220 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-20T04:41:20.330 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction check 2023-12-20T04:41:20.516 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction check succeeded. 2023-12-20T04:41:20.516 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction test 2023-12-20T04:41:21.464 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-20T04:41:21.542 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-20T04:41:21.573 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-20T04:41:21.604 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-20T04:41:21.632 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-20T04:41:21.666 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-20T04:41:21.972 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-20T04:41:22.188 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : librbd1-2:18.2.1-132.g568df92b.el9.x86_64 105/169 2023-12-20T04:41:22.279 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-2:18.2.1-132.g568df92b.el9.x86_64 105/169 2023-12-20T04:41:22.309 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 106/169 2023-12-20T04:41:22.310 INFO:teuthology.orchestra.run.smithi132.stdout:Transaction test succeeded. 2023-12-20T04:41:22.310 INFO:teuthology.orchestra.run.smithi132.stdout:Running transaction 2023-12-20T04:41:22.346 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-20T04:41:22.757 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-20T04:41:22.781 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : librgw2-2:18.2.1-132.g568df92b.el9.x86_64 109/169 2023-12-20T04:41:22.844 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librgw2-2:18.2.1-132.g568df92b.el9.x86_64 109/169 2023-12-20T04:41:22.866 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 110/169 2023-12-20T04:41:24.925 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-20T04:41:24.980 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-20T04:41:25.639 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-20T04:41:25.674 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 112/169 2023-12-20T04:41:25.760 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 112/169 2023-12-20T04:41:25.761 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-20T04:41:25.761 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-20T04:41:25.761 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:41:25.801 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 113/169 2023-12-20T04:41:28.408 INFO:teuthology.orchestra.run.smithi132.stdout: Preparing : 1/1 2023-12-20T04:41:28.532 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : openssl-libs-1:3.0.7-25.el9.x86_64 1/169 2023-12-20T04:41:28.610 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : thrift-0.15.0-2.el9.x86_64 2/169 2023-12-20T04:41:28.777 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/169 2023-12-20T04:41:28.851 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 4/169 2023-12-20T04:41:28.876 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 5/169 2023-12-20T04:41:28.932 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 6/169 2023-12-20T04:41:29.243 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 7/169 2023-12-20T04:41:29.310 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librados2-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-20T04:41:29.440 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-20T04:41:29.470 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-20T04:41:29.552 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-20T04:41:29.593 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 10/169 2023-12-20T04:41:29.636 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-private-libs-13.11-1.el9.x86_64 11/169 2023-12-20T04:41:29.835 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : elfutils-libelf-0.190-1.el9.x86_64 12/169 2023-12-20T04:41:29.889 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-13.11-1.el9.x86_64 13/169 2023-12-20T04:41:29.917 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-20T04:41:30.017 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-20T04:41:30.043 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 15/169 2023-12-20T04:41:30.247 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 15/169 2023-12-20T04:41:30.364 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-20T04:41:30.407 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 16/169 2023-12-20T04:41:30.497 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-20T04:41:30.558 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-20T04:41:30.768 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.45.7-1.el9.x86_64 17/169 2023-12-20T04:41:30.866 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libacl-2.3.1-4.el9.x86_64 18/169 2023-12-20T04:41:30.904 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 19/169 2023-12-20T04:41:30.972 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : liboath-2.6.7-2.el9.x86_64 20/169 2023-12-20T04:41:31.026 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-urllib3-1.26.5-4.el9.noarch 21/169 2023-12-20T04:41:31.057 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-2.25.1-7.el9.noarch 22/169 2023-12-20T04:41:31.096 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libquadmath-11.4.1-2.3.el9.x86_64 23/169 2023-12-20T04:41:31.133 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libgfortran-11.4.1-2.3.el9.x86_64 24/169 2023-12-20T04:41:31.196 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 25/169 2023-12-20T04:41:31.233 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 26/169 2023-12-20T04:41:31.260 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 27/169 2023-12-20T04:41:31.328 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 28/169 2023-12-20T04:41:31.373 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-common-2:18.2.1-132.g568df92b.el9.x 29/169 2023-12-20T04:41:31.416 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ceph-argparse-2:18.2.1-132.g568df92b.el9 30/169 2023-12-20T04:41:31.489 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 31/169 2023-12-20T04:41:31.622 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 32/169 2023-12-20T04:41:31.676 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 33/169 2023-12-20T04:41:32.191 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rsa-4.9-2.el9.noarch 34/169 2023-12-20T04:41:32.271 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 35/169 2023-12-20T04:41:32.313 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jinja2-2.11.3-4.el9.noarch 36/169 2023-12-20T04:41:32.363 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : elfutils-libs-0.190-1.el9.x86_64 37/169 2023-12-20T04:41:32.399 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 38/169 2023-12-20T04:41:32.441 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 39/169 2023-12-20T04:41:32.580 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : socat-1.7.4.1-5.el9.x86_64 40/169 2023-12-20T04:41:32.633 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : openssl-1:3.0.7-25.el9.x86_64 41/169 2023-12-20T04:41:32.740 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : re2-1:20211101-3.el9.x86_64 42/169 2023-12-20T04:41:32.778 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-9.0.0-10.el9.x86_64 43/169 2023-12-20T04:41:32.832 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 44/169 2023-12-20T04:41:32.905 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 45/169 2023-12-20T04:41:32.945 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-webob-1.8.7-6.el9.noarch 46/169 2023-12-20T04:41:32.982 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-typing-extensions-4.4.0-2.el9.noarch 47/169 2023-12-20T04:41:33.028 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 48/169 2023-12-20T04:41:33.064 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 49/169 2023-12-20T04:41:33.108 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyperclip-1.8.2-2.el9.noarch 50/169 2023-12-20T04:41:33.150 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 51/169 2023-12-20T04:41:33.282 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 52/169 2023-12-20T04:41:33.330 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 53/169 2023-12-20T04:41:33.360 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-colorama-0.4.4-12.el9.noarch 54/169 2023-12-20T04:41:33.402 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-certifi-2021.10.8-2.el9.noarch 55/169 2023-12-20T04:41:33.496 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 56/169 2023-12-20T04:41:33.537 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-google-auth-1:2.23.4-1.el9.noarch 57/169 2023-12-20T04:41:33.578 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 58/169 2023-12-20T04:41:33.609 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : gperftools-libs-2.9.1-2.el9.x86_64 59/169 2023-12-20T04:41:33.637 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libarrow-doc-9.0.0-10.el9.noarch 60/169 2023-12-20T04:41:33.730 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fmt-8.1.1-5.el9.x86_64 61/169 2023-12-20T04:41:33.780 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-devel-3.9.17-2.el9.x86_64 62/169 2023-12-20T04:41:33.829 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-ply-3.11-14.el9.noarch 63/169 2023-12-20T04:41:33.885 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 64/169 2023-12-20T04:41:34.066 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 65/169 2023-12-20T04:41:34.262 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 66/169 2023-12-20T04:41:34.425 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 67/169 2023-12-20T04:41:34.472 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-asyncssh-2.13.2-3.el9.noarch 68/169 2023-12-20T04:41:34.519 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jwt-2.4.0-1.el9.noarch 69/169 2023-12-20T04:41:34.552 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jwt+crypto-2.4.0-1.el9.noarch 70/169 2023-12-20T04:41:34.585 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 71/169 2023-12-20T04:41:34.615 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : fuse-2.9.9-15.el9.x86_64 72/169 2023-12-20T04:41:34.660 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : zlib-devel-1.2.11-40.el9.x86_64 73/169 2023-12-20T04:41:34.704 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 74/169 2023-12-20T04:41:34.742 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : uuid-1.6.2-55.el9.x86_64 75/169 2023-12-20T04:41:34.773 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-wcwidth-0.2.5-8.el9.noarch 76/169 2023-12-20T04:41:34.803 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 77/169 2023-12-20T04:41:34.880 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 78/169 2023-12-20T04:41:34.914 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 79/169 2023-12-20T04:41:34.947 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 80/169 2023-12-20T04:41:34.988 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 81/169 2023-12-20T04:41:35.023 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 82/169 2023-12-20T04:41:35.112 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 83/169 2023-12-20T04:41:35.142 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 84/169 2023-12-20T04:41:35.245 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 85/169 2023-12-20T04:41:35.302 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 86/169 2023-12-20T04:41:36.019 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 87/169 2023-12-20T04:41:36.057 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 88/169 2023-12-20T04:41:36.091 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 89/169 2023-12-20T04:41:36.139 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 90/169 2023-12-20T04:41:36.227 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-attrs-20.3.0-7.el9.noarch 91/169 2023-12-20T04:41:36.267 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-cmd2-2.4.2-2.el9.noarch 92/169 2023-12-20T04:41:36.444 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-0.3.21-2.el9.x86_64 93/169 2023-12-20T04:41:36.473 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openblas-openmp-0.3.21-2.el9.x86_64 94/169 2023-12-20T04:41:36.554 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 95/169 2023-12-20T04:41:37.259 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 96/169 2023-12-20T04:41:37.369 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 97/169 2023-12-20T04:41:37.495 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 113/169 2023-12-20T04:41:37.495 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /sys 2023-12-20T04:41:37.495 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /proc 2023-12-20T04:41:37.495 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /mnt 2023-12-20T04:41:37.495 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /var/tmp 2023-12-20T04:41:37.495 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /home 2023-12-20T04:41:37.495 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /root 2023-12-20T04:41:37.495 INFO:teuthology.orchestra.run.smithi187.stdout:skipping the directory /tmp 2023-12-20T04:41:37.495 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:41:37.662 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 114/169 2023-12-20T04:41:37.677 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 114/169 2023-12-20T04:41:37.677 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:37.677 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-20T04:41:37.677 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:41:38.629 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 98/169 2023-12-20T04:41:38.722 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 99/169 2023-12-20T04:41:38.756 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : oniguruma-6.9.6-1.el9.5.x86_64 100/169 2023-12-20T04:41:38.786 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : jq-1.6-16.el9.x86_64 101/169 2023-12-20T04:41:38.815 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libzstd-devel-1.5.1-2.el9.x86_64 102/169 2023-12-20T04:41:38.848 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libuuid-devel-2.37.4-15.el9.x86_64 103/169 2023-12-20T04:41:39.146 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 104/169 2023-12-20T04:41:39.178 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : librbd1-2:18.2.1-132.g568df92b.el9.x86_64 105/169 2023-12-20T04:41:39.224 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 115/169 2023-12-20T04:41:39.249 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 115/169 2023-12-20T04:41:39.249 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:39.249 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-20T04:41:39.249 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-20T04:41:39.250 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-20T04:41:39.250 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:41:39.259 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:18.2.1-132.g568df92b.el9.x86_64 105/169 2023-12-20T04:41:39.291 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 106/169 2023-12-20T04:41:39.327 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 107/169 2023-12-20T04:41:39.449 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 116/169 2023-12-20T04:41:39.471 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 116/169 2023-12-20T04:41:39.471 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:39.471 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-20T04:41:39.471 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-20T04:41:39.472 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-20T04:41:39.472 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:41:39.725 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : parquet-libs-9.0.0-10.el9.x86_64 108/169 2023-12-20T04:41:39.764 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : librgw2-2:18.2.1-132.g568df92b.el9.x86_64 109/169 2023-12-20T04:41:39.818 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librgw2-2:18.2.1-132.g568df92b.el9.x86_64 109/169 2023-12-20T04:41:39.841 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 110/169 2023-12-20T04:41:39.924 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 117/169 2023-12-20T04:41:39.946 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 117/169 2023-12-20T04:41:39.946 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:39.947 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-20T04:41:39.947 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-20T04:41:39.947 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-20T04:41:39.947 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:41:40.035 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-20T04:41:40.455 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephadm-2:18.2.1-132.g568df92b.el9.noarch 119/169 2023-12-20T04:41:40.475 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephadm-2:18.2.1-132.g568df92b.el9.noarch 119/169 2023-12-20T04:41:40.503 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el 120/169 2023-12-20T04:41:40.565 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-132.g568df92b.e 121/169 2023-12-20T04:41:40.589 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 122/169 2023-12-20T04:41:40.809 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 122/169 2023-12-20T04:41:40.840 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 123/169 2023-12-20T04:41:41.799 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 123/169 2023-12-20T04:41:41.824 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 124/169 2023-12-20T04:41:41.889 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-20T04:41:41.922 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 124/169 2023-12-20T04:41:41.929 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-20T04:41:42.079 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9 125/169 2023-12-20T04:41:42.110 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 126/169 2023-12-20T04:41:42.132 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 126/169 2023-12-20T04:41:42.133 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:42.133 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-20T04:41:42.133 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-20T04:41:42.133 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-20T04:41:42.133 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:41:42.177 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 127/169 2023-12-20T04:41:42.187 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 127/169 2023-12-20T04:41:42.232 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-2:18.2.1-132.g568df92b.el9.x86_64 128/169 2023-12-20T04:41:42.461 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 111/169 2023-12-20T04:41:42.499 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 112/169 2023-12-20T04:41:42.567 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 112/169 2023-12-20T04:41:42.567 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2023-12-20T04:41:42.567 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2023-12-20T04:41:42.567 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:41:42.609 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 113/169 2023-12-20T04:41:42.953 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-20T04:41:42.979 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 130/169 2023-12-20T04:41:43.001 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 130/169 2023-12-20T04:41:43.001 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:43.001 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-20T04:41:43.001 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-20T04:41:43.001 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-20T04:41:43.001 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:41:43.046 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-132.g568df9 131/169 2023-12-20T04:41:43.067 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-132.g568df9 131/169 2023-12-20T04:41:43.067 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:43.068 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-20T04:41:43.068 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:41:43.113 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 132/169 2023-12-20T04:41:43.135 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 132/169 2023-12-20T04:41:43.135 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:43.136 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-20T04:41:43.136 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-20T04:41:43.136 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-20T04:41:43.136 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:41:43.430 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 133/169 2023-12-20T04:41:43.453 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 133/169 2023-12-20T04:41:43.453 INFO:teuthology.orchestra.run.smithi187.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:43.453 INFO:teuthology.orchestra.run.smithi187.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-20T04:41:43.453 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-20T04:41:43.453 INFO:teuthology.orchestra.run.smithi187.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-20T04:41:43.453 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:41:47.134 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 134/169 2023-12-20T04:41:47.183 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 135/169 2023-12-20T04:41:47.224 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 136/169 2023-12-20T04:41:47.256 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-20T04:41:47.283 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-20T04:41:47.470 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 139/169 2023-12-20T04:41:47.578 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-20T04:41:47.621 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 141/169 2023-12-20T04:41:47.662 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_6 142/169 2023-12-20T04:41:47.726 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-20T04:41:47.792 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-20T04:41:47.830 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-20T04:41:47.862 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-20T04:41:47.898 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-20T04:41:48.481 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-20T04:41:48.521 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-20T04:41:48.540 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-20T04:41:49.352 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 149/169 2023-12-20T04:41:49.450 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-20T04:41:49.509 INFO:teuthology.orchestra.run.smithi187.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-20T04:41:49.541 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-20T04:41:49.641 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-20T04:41:49.679 INFO:teuthology.orchestra.run.smithi187.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-20T04:41:49.704 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-20T04:41:49.730 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-20T04:41:49.756 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-20T04:41:49.756 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-20T04:41:49.841 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-20T04:41:49.868 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-20T04:41:49.907 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-20T04:41:49.932 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-20T04:41:49.933 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-20T04:41:50.017 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-20T04:41:50.041 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-20T04:41:50.048 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-20T04:41:50.048 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-20T04:41:50.236 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-20T04:41:50.236 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-20T04:41:50.319 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-20T04:41:50.344 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-20T04:41:50.369 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-20T04:41:50.395 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-20T04:41:50.459 INFO:teuthology.orchestra.run.smithi187.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-20T04:41:54.004 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 113/169 2023-12-20T04:41:54.004 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /sys 2023-12-20T04:41:54.004 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /proc 2023-12-20T04:41:54.004 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /mnt 2023-12-20T04:41:54.004 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /var/tmp 2023-12-20T04:41:54.004 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /home 2023-12-20T04:41:54.004 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /root 2023-12-20T04:41:54.004 INFO:teuthology.orchestra.run.smithi132.stdout:skipping the directory /tmp 2023-12-20T04:41:54.004 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:41:54.165 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 114/169 2023-12-20T04:41:54.180 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 114/169 2023-12-20T04:41:54.180 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:54.180 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2023-12-20T04:41:54.180 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:41:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-20T04:41:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-2:18.2.1-132.g568df92b.el9.x86_64 1/169 2023-12-20T04:41:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 2/169 2023-12-20T04:41:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 3/169 2023-12-20T04:41:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 4/169 2023-12-20T04:41:54.777 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-132.g568df9 5/169 2023-12-20T04:41:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 6/169 2023-12-20T04:41:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 7/169 2023-12-20T04:41:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-20T04:41:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-20T04:41:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 10/169 2023-12-20T04:41:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 11/169 2023-12-20T04:41:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 12/169 2023-12-20T04:41:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 13/169 2023-12-20T04:41:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-20T04:41:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_6 15/169 2023-12-20T04:41:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 16/169 2023-12-20T04:41:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 17/169 2023-12-20T04:41:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 18/169 2023-12-20T04:41:54.778 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 19/169 2023-12-20T04:41:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librgw2-2:18.2.1-132.g568df92b.el9.x86_64 20/169 2023-12-20T04:41:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-argparse-2:18.2.1-132.g568df92b.el9 21/169 2023-12-20T04:41:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ceph-common-2:18.2.1-132.g568df92b.el9.x 22/169 2023-12-20T04:41:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 23/169 2023-12-20T04:41:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 24/169 2023-12-20T04:41:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 25/169 2023-12-20T04:41:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 26/169 2023-12-20T04:41:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 27/169 2023-12-20T04:41:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 28/169 2023-12-20T04:41:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 29/169 2023-12-20T04:41:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-132.g568df92b.e 30/169 2023-12-20T04:41:54.779 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 31/169 2023-12-20T04:41:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 32/169 2023-12-20T04:41:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 33/169 2023-12-20T04:41:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9 34/169 2023-12-20T04:41:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 35/169 2023-12-20T04:41:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el 36/169 2023-12-20T04:41:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 37/169 2023-12-20T04:41:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephadm-2:18.2.1-132.g568df92b.el9.noarch 38/169 2023-12-20T04:41:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 39/169 2023-12-20T04:41:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-20T04:41:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-20T04:41:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-20T04:41:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-20T04:41:54.780 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-20T04:41:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-20T04:41:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-20T04:41:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-20T04:41:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-20T04:41:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-20T04:41:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-20T04:41:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-20T04:41:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-20T04:41:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-20T04:41:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-20T04:41:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-20T04:41:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-20T04:41:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-20T04:41:54.781 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-20T04:41:54.782 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-20T04:41:54.782 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-20T04:41:54.782 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-20T04:41:54.782 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-20T04:41:54.782 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-20T04:41:54.782 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-20T04:41:54.782 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-20T04:41:54.782 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-20T04:41:54.782 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-20T04:41:54.782 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-20T04:41:54.782 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-20T04:41:54.782 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-20T04:41:54.782 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-20T04:41:54.782 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-20T04:41:54.782 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-20T04:41:54.783 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-20T04:41:54.783 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-20T04:41:54.783 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-20T04:41:54.783 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-20T04:41:54.783 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-20T04:41:54.783 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-20T04:41:54.783 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-20T04:41:54.783 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-20T04:41:54.783 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-20T04:41:54.783 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-20T04:41:54.783 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-20T04:41:54.783 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-20T04:41:54.783 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-20T04:41:54.783 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-20T04:41:54.783 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-20T04:41:54.784 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-20T04:41:54.784 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-20T04:41:54.784 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-20T04:41:54.784 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-20T04:41:54.784 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-20T04:41:54.784 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-20T04:41:54.784 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-20T04:41:54.784 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-20T04:41:54.784 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-20T04:41:54.784 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-20T04:41:54.784 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-20T04:41:54.784 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-20T04:41:54.785 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-20T04:41:54.785 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-20T04:41:54.785 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-20T04:41:54.785 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-20T04:41:54.785 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-20T04:41:54.785 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-20T04:41:54.785 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-20T04:41:54.785 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-20T04:41:54.785 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-20T04:41:54.785 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-20T04:41:54.785 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-20T04:41:54.785 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-20T04:41:54.786 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-20T04:41:54.786 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-20T04:41:54.786 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-20T04:41:54.786 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-20T04:41:54.786 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-20T04:41:54.786 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-20T04:41:54.786 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-20T04:41:54.786 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-20T04:41:54.786 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-20T04:41:54.786 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-20T04:41:54.786 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-20T04:41:54.786 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-20T04:41:54.786 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-20T04:41:54.786 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-20T04:41:54.787 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-20T04:41:54.787 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-20T04:41:54.787 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-20T04:41:54.787 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-20T04:41:54.787 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-20T04:41:54.787 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-20T04:41:54.787 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-20T04:41:54.787 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-20T04:41:54.787 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-20T04:41:54.787 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-20T04:41:54.787 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-20T04:41:54.787 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-20T04:41:54.787 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-20T04:41:54.787 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-2:18.2.1-132.g568df92b.el9.x86_64 140/169 2023-12-20T04:41:54.787 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-20T04:41:54.788 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-2:18.2.1-132.g568df92b.el9.x86_64 142/169 2023-12-20T04:41:54.788 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-20T04:41:54.788 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-20T04:41:54.788 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-20T04:41:54.788 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-20T04:41:54.788 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-20T04:41:54.788 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-20T04:41:54.788 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-20T04:41:54.788 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-20T04:41:54.788 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-20T04:41:54.788 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-20T04:41:54.788 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-20T04:41:54.788 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-20T04:41:54.788 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-20T04:41:54.788 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-20T04:41:54.789 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-20T04:41:54.789 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-20T04:41:54.789 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-20T04:41:54.789 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-20T04:41:54.789 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-20T04:41:54.789 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-20T04:41:54.789 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-20T04:41:54.789 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-20T04:41:54.789 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-20T04:41:54.789 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-20T04:41:54.789 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-20T04:41:54.789 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-20T04:41:55.726 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 115/169 2023-12-20T04:41:55.751 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 115/169 2023-12-20T04:41:55.751 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:55.751 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2023-12-20T04:41:55.751 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-20T04:41:55.751 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2023-12-20T04:41:55.751 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:41:55.960 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 116/169 2023-12-20T04:41:55.982 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 116/169 2023-12-20T04:41:55.982 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:55.982 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2023-12-20T04:41:55.982 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-20T04:41:55.983 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2023-12-20T04:41:55.983 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:41:56.427 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 117/169 2023-12-20T04:41:56.450 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 117/169 2023-12-20T04:41:56.450 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:56.450 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2023-12-20T04:41:56.450 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-20T04:41:56.450 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2023-12-20T04:41:56.450 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:41:56.538 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : automake-1.16.2-8.el9.noarch 118/169 2023-12-20T04:41:56.883 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephadm-2:18.2.1-132.g568df92b.el9.noarch 119/169 2023-12-20T04:41:56.911 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephadm-2:18.2.1-132.g568df92b.el9.noarch 119/169 2023-12-20T04:41:56.939 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el 120/169 2023-12-20T04:41:57.001 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-grafana-dashboards-2:18.2.1-132.g568df92b.e 121/169 2023-12-20T04:41:57.034 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 122/169 2023-12-20T04:41:57.254 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 122/169 2023-12-20T04:41:57.294 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 123/169 2023-12-20T04:41:57.328 INFO:teuthology.orchestra.run.smithi187.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-20T04:41:57.328 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:41:57.328 INFO:teuthology.orchestra.run.smithi187.stdout:Upgraded: 2023-12-20T04:41:57.328 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-20T04:41:57.328 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-20T04:41:57.328 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-20T04:41:57.328 INFO:teuthology.orchestra.run.smithi187.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-20T04:41:57.328 INFO:teuthology.orchestra.run.smithi187.stdout: acl-2.3.1-4.el9.x86_64 2023-12-20T04:41:57.328 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-20T04:41:57.328 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-20T04:41:57.328 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-20T04:41:57.328 INFO:teuthology.orchestra.run.smithi187.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-20T04:41:57.329 INFO:teuthology.orchestra.run.smithi187.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-20T04:41:57.329 INFO:teuthology.orchestra.run.smithi187.stdout: librados2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.329 INFO:teuthology.orchestra.run.smithi187.stdout: librbd1-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.329 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-20T04:41:57.329 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-20T04:41:57.329 INFO:teuthology.orchestra.run.smithi187.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-20T04:41:57.329 INFO:teuthology.orchestra.run.smithi187.stdout:Installed: 2023-12-20T04:41:57.329 INFO:teuthology.orchestra.run.smithi187.stdout: automake-1.16.2-8.el9.noarch 2023-12-20T04:41:57.329 INFO:teuthology.orchestra.run.smithi187.stdout: bison-3.7.4-5.el9.x86_64 2023-12-20T04:41:57.329 INFO:teuthology.orchestra.run.smithi187.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-20T04:41:57.329 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.329 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.329 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.329 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.330 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-grafana-dashboards-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:41:57.330 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-immutable-object-cache-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.330 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.330 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.330 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:41:57.330 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:41:57.330 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-diskprediction-local-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:41:57.330 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:41:57.330 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:41:57.330 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.330 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.330 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:41:57.330 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.330 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.331 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.331 INFO:teuthology.orchestra.run.smithi187.stdout: ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:41:57.331 INFO:teuthology.orchestra.run.smithi187.stdout: cephadm-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:41:57.331 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.331 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.331 INFO:teuthology.orchestra.run.smithi187.stdout: cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:41:57.331 INFO:teuthology.orchestra.run.smithi187.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-20T04:41:57.331 INFO:teuthology.orchestra.run.smithi187.stdout: flex-2.6.4-9.el9.x86_64 2023-12-20T04:41:57.331 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-20T04:41:57.331 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-20T04:41:57.331 INFO:teuthology.orchestra.run.smithi187.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-20T04:41:57.331 INFO:teuthology.orchestra.run.smithi187.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-20T04:41:57.331 INFO:teuthology.orchestra.run.smithi187.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-20T04:41:57.331 INFO:teuthology.orchestra.run.smithi187.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-20T04:41:57.331 INFO:teuthology.orchestra.run.smithi187.stdout: jq-1.6-16.el9.x86_64 2023-12-20T04:41:57.332 INFO:teuthology.orchestra.run.smithi187.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-20T04:41:57.332 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-20T04:41:57.332 INFO:teuthology.orchestra.run.smithi187.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-20T04:41:57.332 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.332 INFO:teuthology.orchestra.run.smithi187.stdout: libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.332 INFO:teuthology.orchestra.run.smithi187.stdout: libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.332 INFO:teuthology.orchestra.run.smithi187.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-20T04:41:57.332 INFO:teuthology.orchestra.run.smithi187.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-20T04:41:57.332 INFO:teuthology.orchestra.run.smithi187.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-20T04:41:57.332 INFO:teuthology.orchestra.run.smithi187.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-20T04:41:57.332 INFO:teuthology.orchestra.run.smithi187.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-20T04:41:57.332 INFO:teuthology.orchestra.run.smithi187.stdout: librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.332 INFO:teuthology.orchestra.run.smithi187.stdout: libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.332 INFO:teuthology.orchestra.run.smithi187.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-20T04:41:57.332 INFO:teuthology.orchestra.run.smithi187.stdout: librgw2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.333 INFO:teuthology.orchestra.run.smithi187.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-20T04:41:57.333 INFO:teuthology.orchestra.run.smithi187.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-20T04:41:57.333 INFO:teuthology.orchestra.run.smithi187.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-20T04:41:57.333 INFO:teuthology.orchestra.run.smithi187.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-20T04:41:57.333 INFO:teuthology.orchestra.run.smithi187.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-20T04:41:57.333 INFO:teuthology.orchestra.run.smithi187.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-20T04:41:57.333 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-20T04:41:57.333 INFO:teuthology.orchestra.run.smithi187.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-20T04:41:57.333 INFO:teuthology.orchestra.run.smithi187.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-20T04:41:57.333 INFO:teuthology.orchestra.run.smithi187.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-20T04:41:57.333 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-13.11-1.el9.x86_64 2023-12-20T04:41:57.333 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-20T04:41:57.333 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-20T04:41:57.333 INFO:teuthology.orchestra.run.smithi187.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-20T04:41:57.334 INFO:teuthology.orchestra.run.smithi187.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-20T04:41:57.334 INFO:teuthology.orchestra.run.smithi187.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-20T04:41:57.334 INFO:teuthology.orchestra.run.smithi187.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-20T04:41:57.334 INFO:teuthology.orchestra.run.smithi187.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-20T04:41:57.334 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-20T04:41:57.334 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-argparse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.334 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.334 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.334 INFO:teuthology.orchestra.run.smithi187.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-20T04:41:57.334 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-20T04:41:57.334 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-20T04:41:57.334 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-20T04:41:57.334 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-20T04:41:57.334 INFO:teuthology.orchestra.run.smithi187.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-20T04:41:57.335 INFO:teuthology.orchestra.run.smithi187.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-20T04:41:57.335 INFO:teuthology.orchestra.run.smithi187.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-20T04:41:57.335 INFO:teuthology.orchestra.run.smithi187.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-20T04:41:57.335 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-20T04:41:57.335 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-20T04:41:57.335 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-20T04:41:57.335 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-20T04:41:57.335 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-20T04:41:57.335 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-20T04:41:57.335 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-20T04:41:57.335 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-20T04:41:57.336 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-20T04:41:57.336 INFO:teuthology.orchestra.run.smithi187.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-20T04:41:57.336 INFO:teuthology.orchestra.run.smithi187.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-20T04:41:57.336 INFO:teuthology.orchestra.run.smithi187.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-20T04:41:57.336 INFO:teuthology.orchestra.run.smithi187.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-20T04:41:57.336 INFO:teuthology.orchestra.run.smithi187.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-20T04:41:57.336 INFO:teuthology.orchestra.run.smithi187.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-20T04:41:57.336 INFO:teuthology.orchestra.run.smithi187.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-20T04:41:57.336 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-20T04:41:57.336 INFO:teuthology.orchestra.run.smithi187.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-20T04:41:57.336 INFO:teuthology.orchestra.run.smithi187.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-20T04:41:57.336 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-20T04:41:57.336 INFO:teuthology.orchestra.run.smithi187.stdout: python3-ply-3.11-14.el9.noarch 2023-12-20T04:41:57.336 INFO:teuthology.orchestra.run.smithi187.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-20T04:41:57.337 INFO:teuthology.orchestra.run.smithi187.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-20T04:41:57.337 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-20T04:41:57.337 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-20T04:41:57.337 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-20T04:41:57.337 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-20T04:41:57.337 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-20T04:41:57.337 INFO:teuthology.orchestra.run.smithi187.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-20T04:41:57.337 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.337 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.337 INFO:teuthology.orchestra.run.smithi187.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-20T04:41:57.337 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-20T04:41:57.337 INFO:teuthology.orchestra.run.smithi187.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-20T04:41:57.337 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.337 INFO:teuthology.orchestra.run.smithi187.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-20T04:41:57.338 INFO:teuthology.orchestra.run.smithi187.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-20T04:41:57.338 INFO:teuthology.orchestra.run.smithi187.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-20T04:41:57.338 INFO:teuthology.orchestra.run.smithi187.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-20T04:41:57.338 INFO:teuthology.orchestra.run.smithi187.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-20T04:41:57.338 INFO:teuthology.orchestra.run.smithi187.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-20T04:41:57.338 INFO:teuthology.orchestra.run.smithi187.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-20T04:41:57.338 INFO:teuthology.orchestra.run.smithi187.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-20T04:41:57.338 INFO:teuthology.orchestra.run.smithi187.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-20T04:41:57.338 INFO:teuthology.orchestra.run.smithi187.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-20T04:41:57.338 INFO:teuthology.orchestra.run.smithi187.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-20T04:41:57.338 INFO:teuthology.orchestra.run.smithi187.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-20T04:41:57.338 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.338 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.338 INFO:teuthology.orchestra.run.smithi187.stdout: rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:41:57.338 INFO:teuthology.orchestra.run.smithi187.stdout: re2-1:20211101-3.el9.x86_64 2023-12-20T04:41:57.339 INFO:teuthology.orchestra.run.smithi187.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-20T04:41:57.339 INFO:teuthology.orchestra.run.smithi187.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-20T04:41:57.339 INFO:teuthology.orchestra.run.smithi187.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-20T04:41:57.339 INFO:teuthology.orchestra.run.smithi187.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-20T04:41:57.339 INFO:teuthology.orchestra.run.smithi187.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-20T04:41:57.339 INFO:teuthology.orchestra.run.smithi187.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-20T04:41:57.339 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:41:57.339 INFO:teuthology.orchestra.run.smithi187.stdout:Complete! 2023-12-20T04:41:57.941 DEBUG:teuthology.parallel:result is None 2023-12-20T04:41:58.249 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 123/169 2023-12-20T04:41:58.277 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 124/169 2023-12-20T04:41:58.375 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 124/169 2023-12-20T04:41:58.524 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9 125/169 2023-12-20T04:41:58.554 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 126/169 2023-12-20T04:41:58.577 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 126/169 2023-12-20T04:41:58.577 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:58.577 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2023-12-20T04:41:58.577 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-20T04:41:58.577 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2023-12-20T04:41:58.577 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:41:58.622 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 127/169 2023-12-20T04:41:58.632 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 127/169 2023-12-20T04:41:58.683 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-2:18.2.1-132.g568df92b.el9.x86_64 128/169 2023-12-20T04:41:59.399 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libtool-2.4.6-45.el9.x86_64 129/169 2023-12-20T04:41:59.435 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 130/169 2023-12-20T04:41:59.457 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 130/169 2023-12-20T04:41:59.457 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:59.457 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2023-12-20T04:41:59.457 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-20T04:41:59.458 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2023-12-20T04:41:59.458 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:41:59.499 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-immutable-object-cache-2:18.2.1-132.g568df9 131/169 2023-12-20T04:41:59.521 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: ceph-immutable-object-cache-2:18.2.1-132.g568df9 131/169 2023-12-20T04:41:59.521 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:59.521 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2023-12-20T04:41:59.522 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:41:59.567 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 132/169 2023-12-20T04:41:59.589 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 132/169 2023-12-20T04:41:59.589 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:59.589 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "cephfs-mirror@*.service" escaped as "cephfs-mirror@\x2a.service". 2023-12-20T04:41:59.589 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-20T04:41:59.589 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target → /usr/lib/systemd/system/cephfs-mirror.target. 2023-12-20T04:41:59.589 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:41:59.876 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 133/169 2023-12-20T04:41:59.898 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 133/169 2023-12-20T04:41:59.898 INFO:teuthology.orchestra.run.smithi132.stdout:Glob pattern passed to enable, but globs are not supported for this. 2023-12-20T04:41:59.898 INFO:teuthology.orchestra.run.smithi132.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2023-12-20T04:41:59.898 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-20T04:41:59.898 INFO:teuthology.orchestra.run.smithi132.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2023-12-20T04:41:59.899 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:03.573 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 134/169 2023-12-20T04:42:03.614 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 135/169 2023-12-20T04:42:03.654 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 136/169 2023-12-20T04:42:03.687 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : xfsprogs-devel-5.19.0-4.el9.x86_64 137/169 2023-12-20T04:42:03.714 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : elfutils-libelf-devel-0.190-1.el9.x86_64 138/169 2023-12-20T04:42:03.898 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 139/169 2023-12-20T04:42:04.009 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-contrib-13.11-1.el9.x86_64 140/169 2023-12-20T04:42:04.036 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 141/169 2023-12-20T04:42:04.069 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_6 142/169 2023-12-20T04:42:04.142 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : elfutils-debuginfod-client-0.190-1.el9.x86_64 143/169 2023-12-20T04:42:04.209 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-20T04:42:04.245 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : acl-2.3.1-4.el9.x86_64 145/169 2023-12-20T04:42:04.276 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-team-1:1.45.7-1.el9.x86_64 146/169 2023-12-20T04:42:04.312 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : NetworkManager-tui-1:1.45.7-1.el9.x86_64 147/169 2023-12-20T04:42:04.890 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-20T04:42:04.929 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-20T04:42:04.948 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: postgresql-server-13.11-1.el9.x86_64 148/169 2023-12-20T04:42:05.753 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 149/169 2023-12-20T04:42:05.861 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : openssl-devel-1:3.0.7-25.el9.x86_64 150/169 2023-12-20T04:42:05.908 INFO:teuthology.orchestra.run.smithi132.stdout: Upgrading : xfsdump-3.1.12-4.el9.x86_64 151/169 2023-12-20T04:42:05.941 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : libaio-devel-0.3.111-13.el9.x86_64 152/169 2023-12-20T04:42:06.033 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : flex-2.6.4-9.el9.x86_64 153/169 2023-12-20T04:42:06.070 INFO:teuthology.orchestra.run.smithi132.stdout: Installing : bison-3.7.4-5.el9.x86_64 154/169 2023-12-20T04:42:06.095 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-tui-1:1.44.0-2.el9.x86_64 155/169 2023-12-20T04:42:06.121 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : elfutils-debuginfod-client-0.189-3.el9.x86_64 156/169 2023-12-20T04:42:06.147 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : elfutils-libs-0.189-3.el9.x86_64 157/169 2023-12-20T04:42:06.148 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-20T04:42:06.215 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 158/169 2023-12-20T04:42:06.243 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libacl-devel-2.3.1-3.el9.x86_64 159/169 2023-12-20T04:42:06.274 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : openssl-1:3.0.7-24.el9.x86_64 160/169 2023-12-20T04:42:06.315 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : acl-2.3.1-3.el9.x86_64 161/169 2023-12-20T04:42:06.315 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-20T04:42:06.400 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 162/169 2023-12-20T04:42:06.425 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-20T04:42:06.431 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-20T04:42:06.432 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-20T04:42:06.611 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-1:1.44.0-2.el9.x86_64 164/169 2023-12-20T04:42:06.611 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-20T04:42:06.695 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: NetworkManager-libnm-1:1.44.0-2.el9.x86_64 165/169 2023-12-20T04:42:06.719 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : openssl-libs-1:3.0.7-24.el9.x86_64 166/169 2023-12-20T04:42:06.744 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : libacl-2.3.1-3.el9.x86_64 167/169 2023-12-20T04:42:06.770 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : elfutils-libelf-0.189-3.el9.x86_64 168/169 2023-12-20T04:42:06.844 INFO:teuthology.orchestra.run.smithi132.stdout: Cleanup : xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-20T04:42:11.422 INFO:teuthology.orchestra.run.smithi132.stdout: Running scriptlet: xfsdump-3.1.12-3.el9.x86_64 169/169 2023-12-20T04:42:11.422 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-2:18.2.1-132.g568df92b.el9.x86_64 1/169 2023-12-20T04:42:11.422 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 2/169 2023-12-20T04:42:11.423 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 3/169 2023-12-20T04:42:11.423 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 4/169 2023-12-20T04:42:11.423 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-immutable-object-cache-2:18.2.1-132.g568df9 5/169 2023-12-20T04:42:11.423 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 6/169 2023-12-20T04:42:11.423 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 7/169 2023-12-20T04:42:11.423 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 8/169 2023-12-20T04:42:11.423 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 9/169 2023-12-20T04:42:11.423 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 10/169 2023-12-20T04:42:11.423 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 11/169 2023-12-20T04:42:11.423 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 12/169 2023-12-20T04:42:11.423 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 13/169 2023-12-20T04:42:11.423 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 14/169 2023-12-20T04:42:11.423 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_6 15/169 2023-12-20T04:42:11.423 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 16/169 2023-12-20T04:42:11.423 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 17/169 2023-12-20T04:42:11.424 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 18/169 2023-12-20T04:42:11.424 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_ 19/169 2023-12-20T04:42:11.424 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librgw2-2:18.2.1-132.g568df92b.el9.x86_64 20/169 2023-12-20T04:42:11.424 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-argparse-2:18.2.1-132.g568df92b.el9 21/169 2023-12-20T04:42:11.424 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ceph-common-2:18.2.1-132.g568df92b.el9.x 22/169 2023-12-20T04:42:11.424 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 23/169 2023-12-20T04:42:11.424 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 24/169 2023-12-20T04:42:11.424 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 25/169 2023-12-20T04:42:11.424 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 26/169 2023-12-20T04:42:11.424 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 27/169 2023-12-20T04:42:11.424 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 28/169 2023-12-20T04:42:11.424 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 29/169 2023-12-20T04:42:11.424 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-grafana-dashboards-2:18.2.1-132.g568df92b.e 30/169 2023-12-20T04:42:11.424 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noar 31/169 2023-12-20T04:42:11.425 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.no 32/169 2023-12-20T04:42:11.425 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-diskprediction-local-2:18.2.1-132.g568d 33/169 2023-12-20T04:42:11.425 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9 34/169 2023-12-20T04:42:11.425 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 35/169 2023-12-20T04:42:11.425 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el 36/169 2023-12-20T04:42:11.425 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 37/169 2023-12-20T04:42:11.425 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephadm-2:18.2.1-132.g568df92b.el9.noarch 38/169 2023-12-20T04:42:11.425 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 39/169 2023-12-20T04:42:11.425 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : automake-1.16.2-8.el9.noarch 40/169 2023-12-20T04:42:11.425 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : bison-3.7.4-5.el9.x86_64 41/169 2023-12-20T04:42:11.425 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 42/169 2023-12-20T04:42:11.425 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-devel-0.190-1.el9.x86_64 43/169 2023-12-20T04:42:11.425 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flex-2.6.4-9.el9.x86_64 44/169 2023-12-20T04:42:11.425 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 45/169 2023-12-20T04:42:11.426 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 46/169 2023-12-20T04:42:11.426 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 47/169 2023-12-20T04:42:11.426 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : jq-1.6-16.el9.x86_64 48/169 2023-12-20T04:42:11.426 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libaio-devel-0.3.111-13.el9.x86_64 49/169 2023-12-20T04:42:11.426 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 50/169 2023-12-20T04:42:11.426 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 51/169 2023-12-20T04:42:11.426 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 52/169 2023-12-20T04:42:11.426 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libtool-2.4.6-45.el9.x86_64 53/169 2023-12-20T04:42:11.426 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libuuid-devel-2.37.4-15.el9.x86_64 54/169 2023-12-20T04:42:11.426 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libzstd-devel-1.5.1-2.el9.x86_64 55/169 2023-12-20T04:42:11.426 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 56/169 2023-12-20T04:42:11.426 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : oniguruma-6.9.6-1.el9.5.x86_64 57/169 2023-12-20T04:42:11.426 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-0.3.21-2.el9.x86_64 58/169 2023-12-20T04:42:11.426 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openblas-openmp-0.3.21-2.el9.x86_64 59/169 2023-12-20T04:42:11.427 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-13.11-1.el9.x86_64 60/169 2023-12-20T04:42:11.427 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-contrib-13.11-1.el9.x86_64 61/169 2023-12-20T04:42:11.427 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-private-libs-13.11-1.el9.x86_64 62/169 2023-12-20T04:42:11.427 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : postgresql-server-13.11-1.el9.x86_64 63/169 2023-12-20T04:42:11.427 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-attrs-20.3.0-7.el9.noarch 64/169 2023-12-20T04:42:11.427 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 65/169 2023-12-20T04:42:11.427 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jinja2-2.11.3-4.el9.noarch 66/169 2023-12-20T04:42:11.427 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 67/169 2023-12-20T04:42:11.427 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 68/169 2023-12-20T04:42:11.427 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 69/169 2023-12-20T04:42:11.427 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 70/169 2023-12-20T04:42:11.427 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 71/169 2023-12-20T04:42:11.427 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 72/169 2023-12-20T04:42:11.427 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 73/169 2023-12-20T04:42:11.427 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 74/169 2023-12-20T04:42:11.428 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 75/169 2023-12-20T04:42:11.428 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 76/169 2023-12-20T04:42:11.428 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 77/169 2023-12-20T04:42:11.428 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 78/169 2023-12-20T04:42:11.428 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 79/169 2023-12-20T04:42:11.428 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 80/169 2023-12-20T04:42:11.428 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-wcwidth-0.2.5-8.el9.noarch 81/169 2023-12-20T04:42:11.428 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : socat-1.7.4.1-5.el9.x86_64 82/169 2023-12-20T04:42:11.428 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : uuid-1.6.2-55.el9.x86_64 83/169 2023-12-20T04:42:11.428 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsprogs-devel-5.19.0-4.el9.x86_64 84/169 2023-12-20T04:42:11.428 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 85/169 2023-12-20T04:42:11.428 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : zlib-devel-1.2.11-40.el9.x86_64 86/169 2023-12-20T04:42:11.428 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fuse-2.9.9-15.el9.x86_64 87/169 2023-12-20T04:42:11.428 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libgfortran-11.4.1-2.3.el9.x86_64 88/169 2023-12-20T04:42:11.428 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libquadmath-11.4.1-2.3.el9.x86_64 89/169 2023-12-20T04:42:11.429 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 90/169 2023-12-20T04:42:11.429 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 91/169 2023-12-20T04:42:11.429 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-ply-3.11-14.el9.noarch 92/169 2023-12-20T04:42:11.429 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 93/169 2023-12-20T04:42:11.429 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-requests-2.25.1-7.el9.noarch 94/169 2023-12-20T04:42:11.429 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-urllib3-1.26.5-4.el9.noarch 95/169 2023-12-20T04:42:11.429 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-devel-1:3.0.7-25.el9.x86_64 96/169 2023-12-20T04:42:11.429 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-devel-3.9.17-2.el9.x86_64 97/169 2023-12-20T04:42:11.429 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : fmt-8.1.1-5.el9.x86_64 98/169 2023-12-20T04:42:11.429 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : gperftools-libs-2.9.1-2.el9.x86_64 99/169 2023-12-20T04:42:11.429 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-9.0.0-10.el9.x86_64 100/169 2023-12-20T04:42:11.429 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libarrow-doc-9.0.0-10.el9.noarch 101/169 2023-12-20T04:42:11.429 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 102/169 2023-12-20T04:42:11.429 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 103/169 2023-12-20T04:42:11.430 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : parquet-libs-9.0.0-10.el9.x86_64 104/169 2023-12-20T04:42:11.430 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-asyncssh-2.13.2-3.el9.noarch 105/169 2023-12-20T04:42:11.430 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 106/169 2023-12-20T04:42:11.430 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 107/169 2023-12-20T04:42:11.430 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-certifi-2021.10.8-2.el9.noarch 108/169 2023-12-20T04:42:11.430 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 109/169 2023-12-20T04:42:11.430 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 110/169 2023-12-20T04:42:11.430 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-cmd2-2.4.2-2.el9.noarch 111/169 2023-12-20T04:42:11.430 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-colorama-0.4.4-12.el9.noarch 112/169 2023-12-20T04:42:11.430 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-google-auth-1:2.23.4-1.el9.noarch 113/169 2023-12-20T04:42:11.430 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 114/169 2023-12-20T04:42:11.430 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 115/169 2023-12-20T04:42:11.430 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 116/169 2023-12-20T04:42:11.430 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 117/169 2023-12-20T04:42:11.430 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 118/169 2023-12-20T04:42:11.431 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jwt+crypto-2.4.0-1.el9.noarch 119/169 2023-12-20T04:42:11.431 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-jwt-2.4.0-1.el9.noarch 120/169 2023-12-20T04:42:11.431 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 121/169 2023-12-20T04:42:11.431 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 122/169 2023-12-20T04:42:11.431 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 123/169 2023-12-20T04:42:11.431 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 124/169 2023-12-20T04:42:11.431 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 125/169 2023-12-20T04:42:11.431 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 126/169 2023-12-20T04:42:11.431 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 127/169 2023-12-20T04:42:11.431 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-pyperclip-1.8.2-2.el9.noarch 128/169 2023-12-20T04:42:11.431 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 129/169 2023-12-20T04:42:11.431 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 130/169 2023-12-20T04:42:11.431 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 131/169 2023-12-20T04:42:11.431 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 132/169 2023-12-20T04:42:11.432 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-typing-extensions-4.4.0-2.el9.noarch 133/169 2023-12-20T04:42:11.432 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-webob-1.8.7-6.el9.noarch 134/169 2023-12-20T04:42:11.432 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 135/169 2023-12-20T04:42:11.432 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 136/169 2023-12-20T04:42:11.432 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 137/169 2023-12-20T04:42:11.432 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : re2-1:20211101-3.el9.x86_64 138/169 2023-12-20T04:42:11.432 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 139/169 2023-12-20T04:42:11.432 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:18.2.1-132.g568df92b.el9.x86_64 140/169 2023-12-20T04:42:11.432 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 141/169 2023-12-20T04:42:11.432 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:18.2.1-132.g568df92b.el9.x86_64 142/169 2023-12-20T04:42:11.432 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 143/169 2023-12-20T04:42:11.432 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-devel-2.3.1-4.el9.x86_64 144/169 2023-12-20T04:42:11.432 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-devel-2.3.1-3.el9.x86_64 145/169 2023-12-20T04:42:11.432 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : acl-2.3.1-4.el9.x86_64 146/169 2023-12-20T04:42:11.432 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : acl-2.3.1-3.el9.x86_64 147/169 2023-12-20T04:42:11.433 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-debuginfod-client-0.190-1.el9.x86_64 148/169 2023-12-20T04:42:11.433 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-debuginfod-client-0.189-3.el9.x86_64 149/169 2023-12-20T04:42:11.433 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-0.190-1.el9.x86_64 150/169 2023-12-20T04:42:11.433 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libelf-0.189-3.el9.x86_64 151/169 2023-12-20T04:42:11.433 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libs-0.190-1.el9.x86_64 152/169 2023-12-20T04:42:11.433 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : elfutils-libs-0.189-3.el9.x86_64 153/169 2023-12-20T04:42:11.433 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-2.3.1-4.el9.x86_64 154/169 2023-12-20T04:42:11.433 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : libacl-2.3.1-3.el9.x86_64 155/169 2023-12-20T04:42:11.433 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsdump-3.1.12-4.el9.x86_64 156/169 2023-12-20T04:42:11.433 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : xfsdump-3.1.12-3.el9.x86_64 157/169 2023-12-20T04:42:11.433 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-1:1.45.7-1.el9.x86_64 158/169 2023-12-20T04:42:11.433 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-1:1.44.0-2.el9.x86_64 159/169 2023-12-20T04:42:11.433 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-libnm-1:1.45.7-1.el9.x86_64 160/169 2023-12-20T04:42:11.433 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-libnm-1:1.44.0-2.el9.x86_64 161/169 2023-12-20T04:42:11.434 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-team-1:1.45.7-1.el9.x86_64 162/169 2023-12-20T04:42:11.434 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-team-1:1.44.0-2.el9.x86_64 163/169 2023-12-20T04:42:11.434 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-tui-1:1.45.7-1.el9.x86_64 164/169 2023-12-20T04:42:11.434 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : NetworkManager-tui-1:1.44.0-2.el9.x86_64 165/169 2023-12-20T04:42:11.434 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-1:3.0.7-25.el9.x86_64 166/169 2023-12-20T04:42:11.434 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-1:3.0.7-24.el9.x86_64 167/169 2023-12-20T04:42:11.434 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-libs-1:3.0.7-25.el9.x86_64 168/169 2023-12-20T04:42:14.241 INFO:teuthology.orchestra.run.smithi132.stdout: Verifying : openssl-libs-1:3.0.7-24.el9.x86_64 169/169 2023-12-20T04:42:14.241 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:14.241 INFO:teuthology.orchestra.run.smithi132.stdout:Upgraded: 2023-12-20T04:42:14.241 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-1:1.45.7-1.el9.x86_64 2023-12-20T04:42:14.241 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-libnm-1:1.45.7-1.el9.x86_64 2023-12-20T04:42:14.241 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-team-1:1.45.7-1.el9.x86_64 2023-12-20T04:42:14.242 INFO:teuthology.orchestra.run.smithi132.stdout: NetworkManager-tui-1:1.45.7-1.el9.x86_64 2023-12-20T04:42:14.242 INFO:teuthology.orchestra.run.smithi132.stdout: acl-2.3.1-4.el9.x86_64 2023-12-20T04:42:14.242 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-debuginfod-client-0.190-1.el9.x86_64 2023-12-20T04:42:14.242 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-0.190-1.el9.x86_64 2023-12-20T04:42:14.242 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libs-0.190-1.el9.x86_64 2023-12-20T04:42:14.242 INFO:teuthology.orchestra.run.smithi132.stdout: libacl-2.3.1-4.el9.x86_64 2023-12-20T04:42:14.242 INFO:teuthology.orchestra.run.smithi132.stdout: libacl-devel-2.3.1-4.el9.x86_64 2023-12-20T04:42:14.242 INFO:teuthology.orchestra.run.smithi132.stdout: librados2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.242 INFO:teuthology.orchestra.run.smithi132.stdout: librbd1-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.242 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-1:3.0.7-25.el9.x86_64 2023-12-20T04:42:14.242 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-libs-1:3.0.7-25.el9.x86_64 2023-12-20T04:42:14.242 INFO:teuthology.orchestra.run.smithi132.stdout: xfsdump-3.1.12-4.el9.x86_64 2023-12-20T04:42:14.242 INFO:teuthology.orchestra.run.smithi132.stdout:Installed: 2023-12-20T04:42:14.242 INFO:teuthology.orchestra.run.smithi132.stdout: automake-1.16.2-8.el9.noarch 2023-12-20T04:42:14.243 INFO:teuthology.orchestra.run.smithi132.stdout: bison-3.7.4-5.el9.x86_64 2023-12-20T04:42:14.243 INFO:teuthology.orchestra.run.smithi132.stdout: boost-program-options-1.75.0-8.el9.x86_64 2023-12-20T04:42:14.243 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.243 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-base-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.243 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.243 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-fuse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.243 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-grafana-dashboards-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:42:14.243 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-immutable-object-cache-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.243 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mds-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.243 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.243 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-cephadm-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:42:14.243 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-dashboard-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:42:14.243 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-diskprediction-local-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:42:14.243 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-modules-core-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:42:14.244 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mgr-rook-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:42:14.244 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-mon-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.244 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-osd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.244 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-prometheus-alerts-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:42:14.244 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-radosgw-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.244 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-selinux-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.244 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-test-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.244 INFO:teuthology.orchestra.run.smithi132.stdout: ceph-volume-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:42:14.244 INFO:teuthology.orchestra.run.smithi132.stdout: cephadm-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:42:14.244 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-mirror-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.244 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-shell-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.244 INFO:teuthology.orchestra.run.smithi132.stdout: cephfs-top-2:18.2.1-132.g568df92b.el9.noarch 2023-12-20T04:42:14.244 INFO:teuthology.orchestra.run.smithi132.stdout: elfutils-libelf-devel-0.190-1.el9.x86_64 2023-12-20T04:42:14.245 INFO:teuthology.orchestra.run.smithi132.stdout: flex-2.6.4-9.el9.x86_64 2023-12-20T04:42:14.245 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-3.0.4-8.el9.x86_64 2023-12-20T04:42:14.245 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2023-12-20T04:42:14.245 INFO:teuthology.orchestra.run.smithi132.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2023-12-20T04:42:14.245 INFO:teuthology.orchestra.run.smithi132.stdout: fmt-8.1.1-5.el9.x86_64 2023-12-20T04:42:14.245 INFO:teuthology.orchestra.run.smithi132.stdout: fuse-2.9.9-15.el9.x86_64 2023-12-20T04:42:14.245 INFO:teuthology.orchestra.run.smithi132.stdout: gperftools-libs-2.9.1-2.el9.x86_64 2023-12-20T04:42:14.245 INFO:teuthology.orchestra.run.smithi132.stdout: jq-1.6-16.el9.x86_64 2023-12-20T04:42:14.245 INFO:teuthology.orchestra.run.smithi132.stdout: libaio-devel-0.3.111-13.el9.x86_64 2023-12-20T04:42:14.245 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-9.0.0-10.el9.x86_64 2023-12-20T04:42:14.245 INFO:teuthology.orchestra.run.smithi132.stdout: libarrow-doc-9.0.0-10.el9.noarch 2023-12-20T04:42:14.245 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs-devel-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.245 INFO:teuthology.orchestra.run.smithi132.stdout: libcephfs2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.245 INFO:teuthology.orchestra.run.smithi132.stdout: libcephsqlite-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.246 INFO:teuthology.orchestra.run.smithi132.stdout: libgfortran-11.4.1-2.3.el9.x86_64 2023-12-20T04:42:14.246 INFO:teuthology.orchestra.run.smithi132.stdout: liboath-2.6.7-2.el9.x86_64 2023-12-20T04:42:14.246 INFO:teuthology.orchestra.run.smithi132.stdout: libpmemobj-1.12.1-1.el9.x86_64 2023-12-20T04:42:14.246 INFO:teuthology.orchestra.run.smithi132.stdout: libquadmath-11.4.1-2.3.el9.x86_64 2023-12-20T04:42:14.246 INFO:teuthology.orchestra.run.smithi132.stdout: librabbitmq-0.11.0-7.el9.x86_64 2023-12-20T04:42:14.246 INFO:teuthology.orchestra.run.smithi132.stdout: librados-devel-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.246 INFO:teuthology.orchestra.run.smithi132.stdout: libradosstriper1-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.246 INFO:teuthology.orchestra.run.smithi132.stdout: librdkafka-1.6.1-102.el9.x86_64 2023-12-20T04:42:14.246 INFO:teuthology.orchestra.run.smithi132.stdout: librgw2-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.246 INFO:teuthology.orchestra.run.smithi132.stdout: libtool-2.4.6-45.el9.x86_64 2023-12-20T04:42:14.246 INFO:teuthology.orchestra.run.smithi132.stdout: libunwind-1.6.2-1.el9.x86_64 2023-12-20T04:42:14.246 INFO:teuthology.orchestra.run.smithi132.stdout: libuuid-devel-2.37.4-15.el9.x86_64 2023-12-20T04:42:14.246 INFO:teuthology.orchestra.run.smithi132.stdout: libzstd-devel-1.5.1-2.el9.x86_64 2023-12-20T04:42:14.246 INFO:teuthology.orchestra.run.smithi132.stdout: lttng-ust-2.12.0-6.el9.x86_64 2023-12-20T04:42:14.246 INFO:teuthology.orchestra.run.smithi132.stdout: oniguruma-6.9.6-1.el9.5.x86_64 2023-12-20T04:42:14.247 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-0.3.21-2.el9.x86_64 2023-12-20T04:42:14.247 INFO:teuthology.orchestra.run.smithi132.stdout: openblas-openmp-0.3.21-2.el9.x86_64 2023-12-20T04:42:14.247 INFO:teuthology.orchestra.run.smithi132.stdout: openssl-devel-1:3.0.7-25.el9.x86_64 2023-12-20T04:42:14.247 INFO:teuthology.orchestra.run.smithi132.stdout: parquet-libs-9.0.0-10.el9.x86_64 2023-12-20T04:42:14.247 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-13.11-1.el9.x86_64 2023-12-20T04:42:14.247 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-contrib-13.11-1.el9.x86_64 2023-12-20T04:42:14.247 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-private-libs-13.11-1.el9.x86_64 2023-12-20T04:42:14.247 INFO:teuthology.orchestra.run.smithi132.stdout: postgresql-server-13.11-1.el9.x86_64 2023-12-20T04:42:14.247 INFO:teuthology.orchestra.run.smithi132.stdout: python3-asyncssh-2.13.2-3.el9.noarch 2023-12-20T04:42:14.247 INFO:teuthology.orchestra.run.smithi132.stdout: python3-attrs-20.3.0-7.el9.noarch 2023-12-20T04:42:14.247 INFO:teuthology.orchestra.run.smithi132.stdout: python3-babel-2.9.1-2.el9.noarch 2023-12-20T04:42:14.247 INFO:teuthology.orchestra.run.smithi132.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2023-12-20T04:42:14.247 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cachetools-4.2.4-1.el9.noarch 2023-12-20T04:42:14.247 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-argparse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.248 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ceph-common-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.248 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cephfs-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.248 INFO:teuthology.orchestra.run.smithi132.stdout: python3-certifi-2021.10.8-2.el9.noarch 2023-12-20T04:42:14.248 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cffi-1.14.5-5.el9.x86_64 2023-12-20T04:42:14.248 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cheroot-8.6.0-4.el9.noarch 2023-12-20T04:42:14.248 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2023-12-20T04:42:14.248 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cmd2-2.4.2-2.el9.noarch 2023-12-20T04:42:14.248 INFO:teuthology.orchestra.run.smithi132.stdout: python3-colorama-0.4.4-12.el9.noarch 2023-12-20T04:42:14.248 INFO:teuthology.orchestra.run.smithi132.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2023-12-20T04:42:14.248 INFO:teuthology.orchestra.run.smithi132.stdout: python3-devel-3.9.17-2.el9.x86_64 2023-12-20T04:42:14.248 INFO:teuthology.orchestra.run.smithi132.stdout: python3-google-auth-1:2.23.4-1.el9.noarch 2023-12-20T04:42:14.248 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-8.2.1-3.el9.noarch 2023-12-20T04:42:14.248 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2023-12-20T04:42:14.248 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2023-12-20T04:42:14.249 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2023-12-20T04:42:14.249 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2023-12-20T04:42:14.249 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jinja2-2.11.3-4.el9.noarch 2023-12-20T04:42:14.249 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpatch-1.21-16.el9.noarch 2023-12-20T04:42:14.249 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jsonpointer-2.0-4.el9.noarch 2023-12-20T04:42:14.249 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt-2.4.0-1.el9.noarch 2023-12-20T04:42:14.249 INFO:teuthology.orchestra.run.smithi132.stdout: python3-jwt+crypto-2.4.0-1.el9.noarch 2023-12-20T04:42:14.249 INFO:teuthology.orchestra.run.smithi132.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2023-12-20T04:42:14.249 INFO:teuthology.orchestra.run.smithi132.stdout: python3-logutils-0.3.5-21.el9.noarch 2023-12-20T04:42:14.249 INFO:teuthology.orchestra.run.smithi132.stdout: python3-mako-1.1.4-6.el9.noarch 2023-12-20T04:42:14.249 INFO:teuthology.orchestra.run.smithi132.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2023-12-20T04:42:14.249 INFO:teuthology.orchestra.run.smithi132.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2023-12-20T04:42:14.249 INFO:teuthology.orchestra.run.smithi132.stdout: python3-natsort-7.1.1-5.el9.noarch 2023-12-20T04:42:14.250 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2023-12-20T04:42:14.250 INFO:teuthology.orchestra.run.smithi132.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2023-12-20T04:42:14.250 INFO:teuthology.orchestra.run.smithi132.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2023-12-20T04:42:14.250 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pecan-1.4.2-3.el9.noarch 2023-12-20T04:42:14.250 INFO:teuthology.orchestra.run.smithi132.stdout: python3-ply-3.11-14.el9.noarch 2023-12-20T04:42:14.250 INFO:teuthology.orchestra.run.smithi132.stdout: python3-portend-3.1.0-2.el9.noarch 2023-12-20T04:42:14.250 INFO:teuthology.orchestra.run.smithi132.stdout: python3-prettytable-0.7.2-27.el9.noarch 2023-12-20T04:42:14.250 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2023-12-20T04:42:14.250 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2023-12-20T04:42:14.250 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2023-12-20T04:42:14.250 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pycparser-2.20-6.el9.noarch 2023-12-20T04:42:14.250 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pyperclip-1.8.2-2.el9.noarch 2023-12-20T04:42:14.250 INFO:teuthology.orchestra.run.smithi132.stdout: python3-pytz-2021.1-5.el9.noarch 2023-12-20T04:42:14.250 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rados-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.250 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rbd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.251 INFO:teuthology.orchestra.run.smithi132.stdout: python3-repoze-lru-0.7-16.el9.noarch 2023-12-20T04:42:14.251 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-2.25.1-7.el9.noarch 2023-12-20T04:42:14.251 INFO:teuthology.orchestra.run.smithi132.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2023-12-20T04:42:14.251 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rgw-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.251 INFO:teuthology.orchestra.run.smithi132.stdout: python3-routes-2.5.1-5.el9.noarch 2023-12-20T04:42:14.251 INFO:teuthology.orchestra.run.smithi132.stdout: python3-rsa-4.9-2.el9.noarch 2023-12-20T04:42:14.251 INFO:teuthology.orchestra.run.smithi132.stdout: python3-scipy-1.6.2-8.el9.x86_64 2023-12-20T04:42:14.251 INFO:teuthology.orchestra.run.smithi132.stdout: python3-tempora-5.0.0-2.el9.noarch 2023-12-20T04:42:14.251 INFO:teuthology.orchestra.run.smithi132.stdout: python3-toml-0.10.2-6.el9.noarch 2023-12-20T04:42:14.251 INFO:teuthology.orchestra.run.smithi132.stdout: python3-typing-extensions-4.4.0-2.el9.noarch 2023-12-20T04:42:14.251 INFO:teuthology.orchestra.run.smithi132.stdout: python3-urllib3-1.26.5-4.el9.noarch 2023-12-20T04:42:14.251 INFO:teuthology.orchestra.run.smithi132.stdout: python3-wcwidth-0.2.5-8.el9.noarch 2023-12-20T04:42:14.251 INFO:teuthology.orchestra.run.smithi132.stdout: python3-webob-1.8.7-6.el9.noarch 2023-12-20T04:42:14.251 INFO:teuthology.orchestra.run.smithi132.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2023-12-20T04:42:14.252 INFO:teuthology.orchestra.run.smithi132.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2023-12-20T04:42:14.252 INFO:teuthology.orchestra.run.smithi132.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2023-12-20T04:42:14.252 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-fuse-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.252 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-mirror-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.252 INFO:teuthology.orchestra.run.smithi132.stdout: rbd-nbd-2:18.2.1-132.g568df92b.el9.x86_64 2023-12-20T04:42:14.252 INFO:teuthology.orchestra.run.smithi132.stdout: re2-1:20211101-3.el9.x86_64 2023-12-20T04:42:14.252 INFO:teuthology.orchestra.run.smithi132.stdout: socat-1.7.4.1-5.el9.x86_64 2023-12-20T04:42:14.252 INFO:teuthology.orchestra.run.smithi132.stdout: thrift-0.15.0-2.el9.x86_64 2023-12-20T04:42:14.252 INFO:teuthology.orchestra.run.smithi132.stdout: uuid-1.6.2-55.el9.x86_64 2023-12-20T04:42:14.252 INFO:teuthology.orchestra.run.smithi132.stdout: xfsprogs-devel-5.19.0-4.el9.x86_64 2023-12-20T04:42:14.252 INFO:teuthology.orchestra.run.smithi132.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2023-12-20T04:42:14.253 INFO:teuthology.orchestra.run.smithi132.stdout: zlib-devel-1.2.11-40.el9.x86_64 2023-12-20T04:42:14.253 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:14.253 INFO:teuthology.orchestra.run.smithi132.stdout:Complete! 2023-12-20T04:42:14.839 DEBUG:teuthology.parallel:result is None 2023-12-20T04:42:14.839 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-20T04:42:14.984 DEBUG:teuthology.orchestra.run.smithi132:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-20T04:42:15.007 INFO:teuthology.orchestra.run.smithi132.stdout:18.2.1-132.g568df92b.el9 2023-12-20T04:42:15.008 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-132.g568df92b.el9 2023-12-20T04:42:15.008 INFO:teuthology.task.install:The correct ceph version 18.2.1-132.g568df92b is installed. 2023-12-20T04:42:15.009 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=568df92b7e50b2108bce4c77c393ff294d6a5e5e 2023-12-20T04:42:15.151 DEBUG:teuthology.orchestra.run.smithi187:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2023-12-20T04:42:15.177 INFO:teuthology.orchestra.run.smithi187.stdout:18.2.1-132.g568df92b.el9 2023-12-20T04:42:15.177 INFO:teuthology.packaging:The installed version of ceph is 18.2.1-132.g568df92b.el9 2023-12-20T04:42:15.177 INFO:teuthology.task.install:The correct ceph version 18.2.1-132.g568df92b is installed. 2023-12-20T04:42:15.179 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2023-12-20T04:42:15.179 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:15.179 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-20T04:42:15.213 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:15.213 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2023-12-20T04:42:15.251 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2023-12-20T04:42:15.251 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:15.251 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/daemon-helper 2023-12-20T04:42:15.283 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-20T04:42:15.352 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:15.352 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/daemon-helper 2023-12-20T04:42:15.383 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/daemon-helper 2023-12-20T04:42:15.454 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2023-12-20T04:42:15.454 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:15.454 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-20T04:42:15.482 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-20T04:42:15.550 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:15.550 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/adjust-ulimits 2023-12-20T04:42:15.579 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2023-12-20T04:42:15.647 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2023-12-20T04:42:15.647 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:15.648 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/usr/bin/stdin-killer 2023-12-20T04:42:15.675 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-20T04:42:15.742 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:15.743 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/usr/bin/stdin-killer 2023-12-20T04:42:15.770 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod a=rx -- /usr/bin/stdin-killer 2023-12-20T04:42:15.838 INFO:teuthology.run_tasks:Running task ceph... 2023-12-20T04:42:15.908 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2023-12-20T04:42:15.908 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 777 /var/log/ceph 2023-12-20T04:42:15.913 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 777 /var/log/ceph 2023-12-20T04:42:15.941 INFO:tasks.ceph:Disabling ceph logrotate... 2023-12-20T04:42:15.942 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-20T04:42:15.978 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/logrotate.d/ceph 2023-12-20T04:42:16.008 INFO:tasks.ceph:Creating extra log directories... 2023-12-20T04:42:16.008 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-20T04:42:16.045 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2023-12-20T04:42:16.083 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2023-12-20T04:42:16.083 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2023-12-20T04:42:16.083 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2023-12-20T04:42:16.083 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:16.083 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-20T04:42:16.124 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-20T04:42:16.244 DEBUG:teuthology.orchestra.run.smithi132:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-20T04:42:16.271 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:16.271 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2023-12-20T04:42:16.286 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2023-12-20T04:42:16.402 DEBUG:teuthology.orchestra.run.smithi187:> sudo chcon system_u:object_r:etc_t:s0 /etc/logrotate.d/ceph-test.conf 2023-12-20T04:42:16.434 INFO:tasks.ceph:Creating ceph cluster ceph... 2023-12-20T04:42:16.434 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2023-12-20T04:42:16.435 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497454', 'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'description': 'fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full}', 'email': 'vshankar@redhat.com', 'first_in_suite': False, 'job_id': '7497454', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'name': 'vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {'osd default pool size': 2}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, 'owner': 'scheduled_vshankar@teuthology', 'priority': 50, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'client.2'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'client.3']], 'seed': 430, 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'sleep_before_teardown': 0, 'subset': '301/1024', 'suite': 'fs', 'suite_branch': 'wip-vshankar-testing1-2023-12-18-1207-reef-2', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_568df92b7e50b2108bce4c77c393ff294d6a5e5e/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi132.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMKMc5umu6dc3nMXSj2lIUQb6ER6Kmo4DIxohFL9Ar8mG+H8vCTkamCZ9pNoEhBZwOZzzX1stzAOIVTwpqmVh3c=', 'smithi187.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA3Cn1Njhrsb/vrAGajuNArLIRdWHRk2mKkuO8v3HPZErdXbb7YlUoWwAjQkEilEad3OmuXojCaBUMHaWiUrP6I='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']}, 'conf': {'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'overall HEALTH_', '\\(FS_DEGRADED\\)', '\\(MDS_FAILED\\)', '\\(MDS_DEGRADED\\)', '\\(FS_WITH_FAILED_MDS\\)', '\\(MDS_DAMAGE\\)', '\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(FS_INLINE_DATA_DEPRECATED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'OSD full dropping all updates', 'OSD near full', 'pausewr flag', 'failsafe engaged, dropping updates', 'failsafe disengaged, no longer dropping', 'is full \\(reached quota', 'POOL_FULL', 'POOL_BACKFILLFULL', 'PG_RECOVERY_FULL', 'PG_DEGRADED'], 'sha1': '568df92b7e50b2108bce4c77c393ff294d6a5e5e', 'cluster': 'ceph'}}, {'ceph-fuse': None}, {'cephfs_test_runner': {'modules': ['tasks.cephfs.test_full']}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '5f3731ee8689ef3b0ef7d571e4cc2cb968c78d73', 'timestamp': '2023-12-20_03:59:06', 'tube': 'smithi', 'use_shaman': True, 'user': 'vshankar', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.1485078'} 2023-12-20T04:42:16.435 DEBUG:teuthology.orchestra.run.smithi132:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-20T04:42:16.437 DEBUG:teuthology.orchestra.run.smithi187:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2023-12-20T04:42:16.484 DEBUG:teuthology.orchestra.run.smithi132:> sudo install -d -m0777 -- /var/run/ceph 2023-12-20T04:42:16.493 DEBUG:teuthology.orchestra.run.smithi187:> sudo install -d -m0777 -- /var/run/ceph 2023-12-20T04:42:16.551 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:16.551 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/scratch_devs of=/dev/stdout 2023-12-20T04:42:16.574 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-20T04:42:16.574 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_1 2023-12-20T04:42:16.628 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-20T04:42:16.628 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-20T04:42:16.628 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-12-20T04:42:16.628 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-20T04:42:16.628 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2023-12-20T04:42:16.629 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-12-20 04:42:07.213242651 +0000 2023-12-20T04:42:16.629 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-12-20 04:39:58.220667460 +0000 2023-12-20T04:42:16.629 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-12-20 04:39:58.220667460 +0000 2023-12-20T04:42:16.629 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-12-20 04:39:58.220667460 +0000 2023-12-20T04:42:16.629 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-20T04:42:16.693 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-12-20T04:42:16.694 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-12-20T04:42:16.694 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000203048 s, 2.5 MB/s 2023-12-20T04:42:16.695 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-20T04:42:16.751 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_2 2023-12-20T04:42:16.806 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-20T04:42:16.806 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-20T04:42:16.806 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 684 Links: 1 2023-12-20T04:42:16.806 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-20T04:42:16.806 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2023-12-20T04:42:16.806 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-12-20 04:42:07.213242651 +0000 2023-12-20T04:42:16.806 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-12-20 04:39:58.742654309 +0000 2023-12-20T04:42:16.807 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-12-20 04:39:58.742654309 +0000 2023-12-20T04:42:16.807 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-12-20 04:39:58.742654309 +0000 2023-12-20T04:42:16.807 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-20T04:42:16.872 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-12-20T04:42:16.872 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-12-20T04:42:16.872 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000209153 s, 2.4 MB/s 2023-12-20T04:42:16.873 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-20T04:42:16.929 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_3 2023-12-20T04:42:16.984 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-20T04:42:16.984 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-20T04:42:16.984 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 700 Links: 1 2023-12-20T04:42:16.984 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-20T04:42:16.984 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2023-12-20T04:42:16.985 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-12-20 04:42:07.214242627 +0000 2023-12-20T04:42:16.985 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-12-20 04:39:59.245641637 +0000 2023-12-20T04:42:16.985 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-12-20 04:39:59.245641637 +0000 2023-12-20T04:42:16.985 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-12-20 04:39:59.245641637 +0000 2023-12-20T04:42:16.985 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-20T04:42:17.050 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-12-20T04:42:17.050 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-12-20T04:42:17.050 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000205454 s, 2.5 MB/s 2023-12-20T04:42:17.051 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-20T04:42:17.107 DEBUG:teuthology.orchestra.run.smithi132:> stat /dev/vg_nvme/lv_4 2023-12-20T04:42:17.162 INFO:teuthology.orchestra.run.smithi132.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-20T04:42:17.162 INFO:teuthology.orchestra.run.smithi132.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-20T04:42:17.162 INFO:teuthology.orchestra.run.smithi132.stdout:Device: 5h/5d Inode: 721 Links: 1 2023-12-20T04:42:17.162 INFO:teuthology.orchestra.run.smithi132.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-20T04:42:17.162 INFO:teuthology.orchestra.run.smithi132.stdout:Context: system_u:object_r:device_t:s0 2023-12-20T04:42:17.162 INFO:teuthology.orchestra.run.smithi132.stdout:Access: 2023-12-20 04:42:07.214242627 +0000 2023-12-20T04:42:17.162 INFO:teuthology.orchestra.run.smithi132.stdout:Modify: 2023-12-20 04:39:59.742629116 +0000 2023-12-20T04:42:17.163 INFO:teuthology.orchestra.run.smithi132.stdout:Change: 2023-12-20 04:39:59.742629116 +0000 2023-12-20T04:42:17.163 INFO:teuthology.orchestra.run.smithi132.stdout: Birth: 2023-12-20 04:39:59.742629116 +0000 2023-12-20T04:42:17.163 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-20T04:42:17.228 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records in 2023-12-20T04:42:17.228 INFO:teuthology.orchestra.run.smithi132.stderr:1+0 records out 2023-12-20T04:42:17.228 INFO:teuthology.orchestra.run.smithi132.stderr:512 bytes copied, 0.000225417 s, 2.3 MB/s 2023-12-20T04:42:17.229 DEBUG:teuthology.orchestra.run.smithi132:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-20T04:42:17.285 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-20T04:42:17.285 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:17.286 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/scratch_devs of=/dev/stdout 2023-12-20T04:42:17.302 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2023-12-20T04:42:17.302 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_1 2023-12-20T04:42:17.358 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2023-12-20T04:42:17.358 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-20T04:42:17.358 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 663 Links: 1 2023-12-20T04:42:17.358 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-20T04:42:17.358 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-12-20T04:42:17.358 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-12-20 04:41:50.771992122 +0000 2023-12-20T04:42:17.358 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-12-20 04:39:57.908209113 +0000 2023-12-20T04:42:17.358 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-12-20 04:39:57.908209113 +0000 2023-12-20T04:42:17.358 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-12-20 04:39:57.908209113 +0000 2023-12-20T04:42:17.358 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2023-12-20T04:42:17.425 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-12-20T04:42:17.425 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-12-20T04:42:17.425 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000204655 s, 2.5 MB/s 2023-12-20T04:42:17.426 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2023-12-20T04:42:17.482 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_2 2023-12-20T04:42:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2023-12-20T04:42:17.539 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-20T04:42:17.539 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 683 Links: 1 2023-12-20T04:42:17.539 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-20T04:42:17.540 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-12-20T04:42:17.540 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-12-20 04:41:50.772992106 +0000 2023-12-20T04:42:17.540 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-12-20 04:39:58.405201485 +0000 2023-12-20T04:42:17.540 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-12-20 04:39:58.405201485 +0000 2023-12-20T04:42:17.540 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-12-20 04:39:58.405201485 +0000 2023-12-20T04:42:17.540 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2023-12-20T04:42:17.605 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-12-20T04:42:17.605 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-12-20T04:42:17.605 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000210976 s, 2.4 MB/s 2023-12-20T04:42:17.606 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2023-12-20T04:42:17.662 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_3 2023-12-20T04:42:17.717 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2023-12-20T04:42:17.717 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-20T04:42:17.717 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 702 Links: 1 2023-12-20T04:42:17.718 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-20T04:42:17.718 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-12-20T04:42:17.718 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-12-20 04:41:50.772992106 +0000 2023-12-20T04:42:17.718 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-12-20 04:39:58.899193904 +0000 2023-12-20T04:42:17.718 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-12-20 04:39:58.899193904 +0000 2023-12-20T04:42:17.718 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-12-20 04:39:58.899193904 +0000 2023-12-20T04:42:17.718 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2023-12-20T04:42:17.783 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-12-20T04:42:17.783 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-12-20T04:42:17.783 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000203405 s, 2.5 MB/s 2023-12-20T04:42:17.784 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2023-12-20T04:42:17.840 DEBUG:teuthology.orchestra.run.smithi187:> stat /dev/vg_nvme/lv_4 2023-12-20T04:42:17.895 INFO:teuthology.orchestra.run.smithi187.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2023-12-20T04:42:17.895 INFO:teuthology.orchestra.run.smithi187.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2023-12-20T04:42:17.895 INFO:teuthology.orchestra.run.smithi187.stdout:Device: 5h/5d Inode: 719 Links: 1 2023-12-20T04:42:17.895 INFO:teuthology.orchestra.run.smithi187.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2023-12-20T04:42:17.895 INFO:teuthology.orchestra.run.smithi187.stdout:Context: system_u:object_r:device_t:s0 2023-12-20T04:42:17.895 INFO:teuthology.orchestra.run.smithi187.stdout:Access: 2023-12-20 04:41:50.772992106 +0000 2023-12-20T04:42:17.895 INFO:teuthology.orchestra.run.smithi187.stdout:Modify: 2023-12-20 04:39:59.391186352 +0000 2023-12-20T04:42:17.895 INFO:teuthology.orchestra.run.smithi187.stdout:Change: 2023-12-20 04:39:59.391186352 +0000 2023-12-20T04:42:17.896 INFO:teuthology.orchestra.run.smithi187.stdout: Birth: 2023-12-20 04:39:59.391186352 +0000 2023-12-20T04:42:17.896 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2023-12-20T04:42:17.960 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records in 2023-12-20T04:42:17.960 INFO:teuthology.orchestra.run.smithi187.stderr:1+0 records out 2023-12-20T04:42:17.961 INFO:teuthology.orchestra.run.smithi187.stderr:512 bytes copied, 0.000231702 s, 2.2 MB/s 2023-12-20T04:42:17.962 DEBUG:teuthology.orchestra.run.smithi187:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2023-12-20T04:42:18.017 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-20T04:42:18.018 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-20T04:42:18.018 INFO:tasks.ceph:Generating config... 2023-12-20T04:42:18.019 INFO:tasks.ceph:[client] client mount timeout = 600 2023-12-20T04:42:18.019 INFO:tasks.ceph:[client] debug client = 20 2023-12-20T04:42:18.019 INFO:tasks.ceph:[client] debug ms = 1 2023-12-20T04:42:18.019 INFO:tasks.ceph:[client] pid file = 2023-12-20T04:42:18.019 INFO:tasks.ceph:[client] rados mon op timeout = 900 2023-12-20T04:42:18.019 INFO:tasks.ceph:[client] rados osd op timeout = 900 2023-12-20T04:42:18.020 INFO:tasks.ceph:[client.0] debug client = 20 2023-12-20T04:42:18.020 INFO:tasks.ceph:[client.0] debug objectcacher = 20 2023-12-20T04:42:18.020 INFO:tasks.ceph:[client.0] debug objecter = 20 2023-12-20T04:42:18.020 INFO:tasks.ceph:[client.1] debug client = 20 2023-12-20T04:42:18.020 INFO:tasks.ceph:[client.1] debug objectcacher = 20 2023-12-20T04:42:18.020 INFO:tasks.ceph:[client.1] debug objecter = 20 2023-12-20T04:42:18.020 INFO:tasks.ceph:[mds] debug mds = 20 2023-12-20T04:42:18.020 INFO:tasks.ceph:[mds] debug mds balancer = 20 2023-12-20T04:42:18.020 INFO:tasks.ceph:[mds] debug ms = 1 2023-12-20T04:42:18.020 INFO:tasks.ceph:[mds] mds debug frag = True 2023-12-20T04:42:18.020 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2023-12-20T04:42:18.020 INFO:tasks.ceph:[mds] mds op complaint time = 180 2023-12-20T04:42:18.020 INFO:tasks.ceph:[mds] mds verify scatter = True 2023-12-20T04:42:18.020 INFO:tasks.ceph:[mds] osd op complaint time = 180 2023-12-20T04:42:18.021 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2023-12-20T04:42:18.021 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2023-12-20T04:42:18.021 INFO:tasks.ceph:[mgr] debug mgr = 20 2023-12-20T04:42:18.021 INFO:tasks.ceph:[mgr] debug ms = 1 2023-12-20T04:42:18.021 INFO:tasks.ceph:[mon] debug mon = 20 2023-12-20T04:42:18.021 INFO:tasks.ceph:[mon] debug ms = 1 2023-12-20T04:42:18.021 INFO:tasks.ceph:[mon] debug paxos = 20 2023-12-20T04:42:18.021 INFO:tasks.ceph:[mon] mon op complaint time = 120 2023-12-20T04:42:18.021 INFO:tasks.ceph:[mon] mon osd backfillfull ratio = 0.6 2023-12-20T04:42:18.021 INFO:tasks.ceph:[mon] mon osd full ratio = 0.7 2023-12-20T04:42:18.021 INFO:tasks.ceph:[mon] mon osd nearfull ratio = 0.6 2023-12-20T04:42:18.021 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2023-12-20T04:42:18.021 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2023-12-20T04:42:18.022 INFO:tasks.ceph:[osd] debug bluefs = 20 2023-12-20T04:42:18.022 INFO:tasks.ceph:[osd] debug bluestore = 20 2023-12-20T04:42:18.022 INFO:tasks.ceph:[osd] debug ms = 1 2023-12-20T04:42:18.022 INFO:tasks.ceph:[osd] debug osd = 20 2023-12-20T04:42:18.022 INFO:tasks.ceph:[osd] debug rocksdb = 10 2023-12-20T04:42:18.022 INFO:tasks.ceph:[osd] memstore device bytes = 200000000 2023-12-20T04:42:18.022 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2023-12-20T04:42:18.022 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2023-12-20T04:42:18.022 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2023-12-20T04:42:18.022 INFO:tasks.ceph:[osd] osd failsafe full ratio = 1.0 2023-12-20T04:42:18.022 INFO:tasks.ceph:[osd] osd mon report interval = 5 2023-12-20T04:42:18.022 INFO:tasks.ceph:[osd] osd objectstore = memstore 2023-12-20T04:42:18.022 INFO:tasks.ceph:[osd] osd op complaint time = 180 2023-12-20T04:42:18.023 INFO:tasks.ceph:Setting up mon.a... 2023-12-20T04:42:18.023 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2023-12-20T04:42:18.078 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.keyring 2023-12-20T04:42:18.081 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2023-12-20T04:42:18.126 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-20T04:42:18.153 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.132'), ('mon.b', '172.21.15.187'), ('mon.c', '[v2:172.21.15.187:3301,v1:172.21.15.187:6790]')] 2023-12-20T04:42:18.153 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.132,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'memstore device bytes': 200000000, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 1.0, 'osd mon report interval': 5, 'osd objectstore': 'memstore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon op complaint time': 120, 'mon osd backfillfull ratio': 0.6, 'mon osd full ratio': 0.7, 'mon osd nearfull ratio': 0.6}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'pid file': '', 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.b': {}, 'mds.d': {}, 'client.0': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'client.1': {'debug client': 20, 'debug objectcacher': 20, 'debug objecter': 20}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2023-12-20T04:42:18.154 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:18.154 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2023-12-20T04:42:18.208 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.132 --add b 172.21.15.187 --addv c '[v2:172.21.15.187:3301,v1:172.21.15.187:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:42:18.293 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:42:18.293 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: generated fsid b146884a-3712-4b4e-ac9f-636a781b2cda 2023-12-20T04:42:18.293 INFO:teuthology.orchestra.run.smithi132.stdout:setting min_mon_release = pacific 2023-12-20T04:42:18.293 INFO:teuthology.orchestra.run.smithi132.stdout:epoch 0 2023-12-20T04:42:18.293 INFO:teuthology.orchestra.run.smithi132.stdout:fsid b146884a-3712-4b4e-ac9f-636a781b2cda 2023-12-20T04:42:18.293 INFO:teuthology.orchestra.run.smithi132.stdout:last_changed 2023-12-20T04:42:18.292571+0000 2023-12-20T04:42:18.293 INFO:teuthology.orchestra.run.smithi132.stdout:created 2023-12-20T04:42:18.292571+0000 2023-12-20T04:42:18.293 INFO:teuthology.orchestra.run.smithi132.stdout:min_mon_release 16 (pacific) 2023-12-20T04:42:18.293 INFO:teuthology.orchestra.run.smithi132.stdout:election_strategy: 1 2023-12-20T04:42:18.293 INFO:teuthology.orchestra.run.smithi132.stdout:0: [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] mon.a 2023-12-20T04:42:18.293 INFO:teuthology.orchestra.run.smithi132.stdout:1: [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] mon.b 2023-12-20T04:42:18.294 INFO:teuthology.orchestra.run.smithi132.stdout:2: [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] mon.c 2023-12-20T04:42:18.294 INFO:teuthology.orchestra.run.smithi132.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2023-12-20T04:42:18.295 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2023-12-20T04:42:18.309 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID b146884a-3712-4b4e-ac9f-636a781b2cda... 2023-12-20T04:42:18.310 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-20T04:42:18.352 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2023-12-20T04:42:18.400 INFO:teuthology.orchestra.run.smithi132.stdout:[global] 2023-12-20T04:42:18.400 INFO:teuthology.orchestra.run.smithi132.stdout: chdir = "" 2023-12-20T04:42:18.401 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-20T04:42:18.401 INFO:teuthology.orchestra.run.smithi132.stdout: auth supported = cephx 2023-12-20T04:42:18.401 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.401 INFO:teuthology.orchestra.run.smithi132.stdout: filestore xattr use omap = true 2023-12-20T04:42:18.401 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.401 INFO:teuthology.orchestra.run.smithi132.stdout: mon clock drift allowed = 1.000 2023-12-20T04:42:18.401 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.401 INFO:teuthology.orchestra.run.smithi132.stdout: osd crush chooseleaf type = 0 2023-12-20T04:42:18.401 INFO:teuthology.orchestra.run.smithi132.stdout: auth debug = true 2023-12-20T04:42:18.401 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.401 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on old message = true 2023-12-20T04:42:18.401 INFO:teuthology.orchestra.run.smithi132.stdout: ms die on bug = true 2023-12-20T04:42:18.401 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.401 INFO:teuthology.orchestra.run.smithi132.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-20T04:42:18.402 INFO:teuthology.orchestra.run.smithi132.stdout: mon pg warn max object skew = 0 2023-12-20T04:42:18.402 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.402 INFO:teuthology.orchestra.run.smithi132.stdout: # disable pg_autoscaler by default for new pools 2023-12-20T04:42:18.402 INFO:teuthology.orchestra.run.smithi132.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-20T04:42:18.402 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.402 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default size = 2 2023-12-20T04:42:18.402 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.402 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow primary affinity = true 2023-12-20T04:42:18.402 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd allow pg remap = true 2023-12-20T04:42:18.402 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on legacy crush tunables = false 2023-12-20T04:42:18.402 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on crush straw calc version zero = false 2023-12-20T04:42:18.402 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on no sortbitwise = false 2023-12-20T04:42:18.402 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on osd down out interval zero = false 2023-12-20T04:42:18.402 INFO:teuthology.orchestra.run.smithi132.stdout: mon warn on too few osds = false 2023-12-20T04:42:18.402 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-20T04:42:18.403 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-20T04:42:18.403 INFO:teuthology.orchestra.run.smithi132.stdout: mon_allow_pool_size_one = true 2023-12-20T04:42:18.403 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.403 INFO:teuthology.orchestra.run.smithi132.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-20T04:42:18.403 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.403 INFO:teuthology.orchestra.run.smithi132.stdout: osd default data pool replay window = 5 2023-12-20T04:42:18.403 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.403 INFO:teuthology.orchestra.run.smithi132.stdout: mon allow pool delete = true 2023-12-20T04:42:18.403 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.403 INFO:teuthology.orchestra.run.smithi132.stdout: mon cluster log file level = debug 2023-12-20T04:42:18.403 INFO:teuthology.orchestra.run.smithi132.stdout: debug asserts on shutdown = true 2023-12-20T04:42:18.403 INFO:teuthology.orchestra.run.smithi132.stdout: mon health detail to clog = false 2023-12-20T04:42:18.403 INFO:teuthology.orchestra.run.smithi132.stdout: mon host = "172.21.15.132,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]" 2023-12-20T04:42:18.403 INFO:teuthology.orchestra.run.smithi132.stdout: fsid = b146884a-3712-4b4e-ac9f-636a781b2cda 2023-12-20T04:42:18.403 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.404 INFO:teuthology.orchestra.run.smithi132.stdout:[osd] 2023-12-20T04:42:18.404 INFO:teuthology.orchestra.run.smithi132.stdout: osd journal size = 100 2023-12-20T04:42:18.404 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.404 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub load threshold = 5.0 2023-12-20T04:42:18.404 INFO:teuthology.orchestra.run.smithi132.stdout: osd scrub max interval = 600 2023-12-20T04:42:18.404 INFO:teuthology.orchestra.run.smithi132.stdout: osd mclock profile = high_recovery_ops 2023-12-20T04:42:18.404 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.404 INFO:teuthology.orchestra.run.smithi132.stdout: osd recover clone overlap = true 2023-12-20T04:42:18.404 INFO:teuthology.orchestra.run.smithi132.stdout: osd recovery max chunk = 1048576 2023-12-20T04:42:18.404 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.404 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug shutdown = true 2023-12-20T04:42:18.404 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug op order = true 2023-12-20T04:42:18.404 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug verify stray on activate = true 2023-12-20T04:42:18.404 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.404 INFO:teuthology.orchestra.run.smithi132.stdout: osd open classes on start = true 2023-12-20T04:42:18.404 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug pg log writeout = true 2023-12-20T04:42:18.405 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.405 INFO:teuthology.orchestra.run.smithi132.stdout: osd deep scrub update digest min age = 30 2023-12-20T04:42:18.405 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.405 INFO:teuthology.orchestra.run.smithi132.stdout: osd map max advance = 10 2023-12-20T04:42:18.405 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.405 INFO:teuthology.orchestra.run.smithi132.stdout: journal zero on create = true 2023-12-20T04:42:18.405 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.405 INFO:teuthology.orchestra.run.smithi132.stdout: filestore ondisk finisher threads = 3 2023-12-20T04:42:18.405 INFO:teuthology.orchestra.run.smithi132.stdout: filestore apply finisher threads = 3 2023-12-20T04:42:18.405 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.405 INFO:teuthology.orchestra.run.smithi132.stdout: bdev debug aio = true 2023-12-20T04:42:18.405 INFO:teuthology.orchestra.run.smithi132.stdout: osd debug misdirected ops = true 2023-12-20T04:42:18.405 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore block size = 96636764160 2023-12-20T04:42:18.405 INFO:teuthology.orchestra.run.smithi132.stdout: bluestore fsck on mount = True 2023-12-20T04:42:18.406 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluefs = 20 2023-12-20T04:42:18.406 INFO:teuthology.orchestra.run.smithi132.stdout: debug bluestore = 20 2023-12-20T04:42:18.406 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-12-20T04:42:18.406 INFO:teuthology.orchestra.run.smithi132.stdout: debug osd = 20 2023-12-20T04:42:18.406 INFO:teuthology.orchestra.run.smithi132.stdout: debug rocksdb = 10 2023-12-20T04:42:18.406 INFO:teuthology.orchestra.run.smithi132.stdout: memstore device bytes = 200000000 2023-12-20T04:42:18.406 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd backfillfull_ratio = 0.85 2023-12-20T04:42:18.406 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd full ratio = 0.9 2023-12-20T04:42:18.406 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd nearfull ratio = 0.8 2023-12-20T04:42:18.406 INFO:teuthology.orchestra.run.smithi132.stdout: osd failsafe full ratio = 1.0 2023-12-20T04:42:18.406 INFO:teuthology.orchestra.run.smithi132.stdout: osd mon report interval = 5 2023-12-20T04:42:18.406 INFO:teuthology.orchestra.run.smithi132.stdout: osd objectstore = memstore 2023-12-20T04:42:18.406 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2023-12-20T04:42:18.406 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.406 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr] 2023-12-20T04:42:18.407 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-12-20T04:42:18.407 INFO:teuthology.orchestra.run.smithi132.stdout: debug mgr = 20 2023-12-20T04:42:18.407 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2023-12-20T04:42:18.407 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2023-12-20T04:42:18.407 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2023-12-20T04:42:18.407 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2023-12-20T04:42:18.407 INFO:teuthology.orchestra.run.smithi132.stdout: mgr/telemetry/nag = false 2023-12-20T04:42:18.407 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.407 INFO:teuthology.orchestra.run.smithi132.stdout:[mon] 2023-12-20T04:42:18.407 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-12-20T04:42:18.407 INFO:teuthology.orchestra.run.smithi132.stdout: debug mon = 20 2023-12-20T04:42:18.407 INFO:teuthology.orchestra.run.smithi132.stdout: debug paxos = 20 2023-12-20T04:42:18.407 INFO:teuthology.orchestra.run.smithi132.stdout: debug auth = 20 2023-12-20T04:42:18.407 INFO:teuthology.orchestra.run.smithi132.stdout: mon data avail warn = 5 2023-12-20T04:42:18.407 INFO:teuthology.orchestra.run.smithi132.stdout: mon mgr mkfs grace = 240 2023-12-20T04:42:18.407 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min pgs per osd = 4 2023-12-20T04:42:18.408 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd reporter subtree level = osd 2023-12-20T04:42:18.408 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd prime pg temp = true 2023-12-20T04:42:18.408 INFO:teuthology.orchestra.run.smithi132.stdout: mon reweight min bytes per osd = 10 2023-12-20T04:42:18.408 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.408 INFO:teuthology.orchestra.run.smithi132.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-20T04:42:18.408 INFO:teuthology.orchestra.run.smithi132.stdout: auth mon ticket ttl = 660 # 11m 2023-12-20T04:42:18.408 INFO:teuthology.orchestra.run.smithi132.stdout: auth service ticket ttl = 240 # 4m 2023-12-20T04:42:18.408 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.408 INFO:teuthology.orchestra.run.smithi132.stdout: # don't complain about insecure global_id in the test suite 2023-12-20T04:42:18.408 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-20T04:42:18.408 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-20T04:42:18.408 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.408 INFO:teuthology.orchestra.run.smithi132.stdout: # 1m isn't quite enough 2023-12-20T04:42:18.408 INFO:teuthology.orchestra.run.smithi132.stdout: mon_down_mkfs_grace = 2m 2023-12-20T04:42:18.409 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.409 INFO:teuthology.orchestra.run.smithi132.stdout: mon_warn_on_filestore_osds = false 2023-12-20T04:42:18.409 INFO:teuthology.orchestra.run.smithi132.stdout: mon op complaint time = 120 2023-12-20T04:42:18.409 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd backfillfull ratio = 0.6 2023-12-20T04:42:18.409 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd full ratio = 0.7 2023-12-20T04:42:18.409 INFO:teuthology.orchestra.run.smithi132.stdout: mon osd nearfull ratio = 0.6 2023-12-20T04:42:18.409 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:18.409 INFO:teuthology.orchestra.run.smithi132.stdout:[client] 2023-12-20T04:42:18.409 INFO:teuthology.orchestra.run.smithi132.stdout: rgw cache enabled = true 2023-12-20T04:42:18.409 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable ops log = true 2023-12-20T04:42:18.409 INFO:teuthology.orchestra.run.smithi132.stdout: rgw enable usage log = true 2023-12-20T04:42:18.409 INFO:teuthology.orchestra.run.smithi132.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-20T04:42:18.409 INFO:teuthology.orchestra.run.smithi132.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-20T04:42:18.409 INFO:teuthology.orchestra.run.smithi132.stdout: client mount timeout = 600 2023-12-20T04:42:18.410 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2023-12-20T04:42:18.410 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-12-20T04:42:18.410 INFO:teuthology.orchestra.run.smithi132.stdout: pid file = "" 2023-12-20T04:42:18.410 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2023-12-20T04:42:18.410 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2023-12-20T04:42:18.410 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.a] 2023-12-20T04:42:18.410 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.b] 2023-12-20T04:42:18.410 INFO:teuthology.orchestra.run.smithi132.stdout:[mon.c] 2023-12-20T04:42:18.410 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2023-12-20T04:42:18.410 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2023-12-20T04:42:18.410 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2023-12-20T04:42:18.410 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2023-12-20T04:42:18.411 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2023-12-20T04:42:18.411 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2023-12-20T04:42:18.411 INFO:teuthology.orchestra.run.smithi132.stdout: debug objectcacher = 20 2023-12-20T04:42:18.411 INFO:teuthology.orchestra.run.smithi132.stdout: debug objecter = 20 2023-12-20T04:42:18.411 INFO:teuthology.orchestra.run.smithi132.stdout:[client.1] 2023-12-20T04:42:18.411 INFO:teuthology.orchestra.run.smithi132.stdout: debug client = 20 2023-12-20T04:42:18.411 INFO:teuthology.orchestra.run.smithi132.stdout: debug objectcacher = 20 2023-12-20T04:42:18.411 INFO:teuthology.orchestra.run.smithi132.stdout: debug objecter = 20 2023-12-20T04:42:18.411 INFO:teuthology.orchestra.run.smithi132.stdout:[mds] 2023-12-20T04:42:18.411 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds = 20 2023-12-20T04:42:18.411 INFO:teuthology.orchestra.run.smithi132.stdout: debug mds balancer = 20 2023-12-20T04:42:18.411 INFO:teuthology.orchestra.run.smithi132.stdout: debug ms = 1 2023-12-20T04:42:18.411 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug frag = True 2023-12-20T04:42:18.411 INFO:teuthology.orchestra.run.smithi132.stdout: mds debug scatterstat = True 2023-12-20T04:42:18.411 INFO:teuthology.orchestra.run.smithi132.stdout: mds op complaint time = 180 2023-12-20T04:42:18.412 INFO:teuthology.orchestra.run.smithi132.stdout: mds verify scatter = True 2023-12-20T04:42:18.412 INFO:teuthology.orchestra.run.smithi132.stdout: osd op complaint time = 180 2023-12-20T04:42:18.412 INFO:teuthology.orchestra.run.smithi132.stdout: rados mon op timeout = 900 2023-12-20T04:42:18.412 INFO:teuthology.orchestra.run.smithi132.stdout: rados osd op timeout = 900 2023-12-20T04:42:18.412 INFO:teuthology.orchestra.run.smithi187.stdout:[global] 2023-12-20T04:42:18.412 INFO:teuthology.orchestra.run.smithi187.stdout: chdir = "" 2023-12-20T04:42:18.412 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2023-12-20T04:42:18.412 INFO:teuthology.orchestra.run.smithi187.stdout: auth supported = cephx 2023-12-20T04:42:18.413 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.413 INFO:teuthology.orchestra.run.smithi187.stdout: filestore xattr use omap = true 2023-12-20T04:42:18.413 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.413 INFO:teuthology.orchestra.run.smithi187.stdout: mon clock drift allowed = 1.000 2023-12-20T04:42:18.413 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.413 INFO:teuthology.orchestra.run.smithi187.stdout: osd crush chooseleaf type = 0 2023-12-20T04:42:18.413 INFO:teuthology.orchestra.run.smithi187.stdout: auth debug = true 2023-12-20T04:42:18.413 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.413 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on old message = true 2023-12-20T04:42:18.413 INFO:teuthology.orchestra.run.smithi187.stdout: ms die on bug = true 2023-12-20T04:42:18.413 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.413 INFO:teuthology.orchestra.run.smithi187.stdout: mon max pg per osd = 10000 # >= luminous 2023-12-20T04:42:18.413 INFO:teuthology.orchestra.run.smithi187.stdout: mon pg warn max object skew = 0 2023-12-20T04:42:18.413 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.413 INFO:teuthology.orchestra.run.smithi187.stdout: # disable pg_autoscaler by default for new pools 2023-12-20T04:42:18.414 INFO:teuthology.orchestra.run.smithi187.stdout: osd_pool_default_pg_autoscale_mode = off 2023-12-20T04:42:18.414 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.414 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default size = 2 2023-12-20T04:42:18.414 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.414 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow primary affinity = true 2023-12-20T04:42:18.414 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd allow pg remap = true 2023-12-20T04:42:18.414 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on legacy crush tunables = false 2023-12-20T04:42:18.414 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on crush straw calc version zero = false 2023-12-20T04:42:18.414 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on no sortbitwise = false 2023-12-20T04:42:18.414 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on osd down out interval zero = false 2023-12-20T04:42:18.414 INFO:teuthology.orchestra.run.smithi187.stdout: mon warn on too few osds = false 2023-12-20T04:42:18.414 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2023-12-20T04:42:18.414 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_pool_no_redundancy = false 2023-12-20T04:42:18.414 INFO:teuthology.orchestra.run.smithi187.stdout: mon_allow_pool_size_one = true 2023-12-20T04:42:18.414 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.415 INFO:teuthology.orchestra.run.smithi187.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2023-12-20T04:42:18.415 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.415 INFO:teuthology.orchestra.run.smithi187.stdout: osd default data pool replay window = 5 2023-12-20T04:42:18.415 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.415 INFO:teuthology.orchestra.run.smithi187.stdout: mon allow pool delete = true 2023-12-20T04:42:18.415 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.415 INFO:teuthology.orchestra.run.smithi187.stdout: mon cluster log file level = debug 2023-12-20T04:42:18.415 INFO:teuthology.orchestra.run.smithi187.stdout: debug asserts on shutdown = true 2023-12-20T04:42:18.415 INFO:teuthology.orchestra.run.smithi187.stdout: mon health detail to clog = false 2023-12-20T04:42:18.415 INFO:teuthology.orchestra.run.smithi187.stdout: mon host = "172.21.15.132,172.21.15.187,[v2:172.21.15.187:3301,v1:172.21.15.187:6790]" 2023-12-20T04:42:18.415 INFO:teuthology.orchestra.run.smithi187.stdout: fsid = b146884a-3712-4b4e-ac9f-636a781b2cda 2023-12-20T04:42:18.415 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.415 INFO:teuthology.orchestra.run.smithi187.stdout:[osd] 2023-12-20T04:42:18.415 INFO:teuthology.orchestra.run.smithi187.stdout: osd journal size = 100 2023-12-20T04:42:18.415 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.416 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub load threshold = 5.0 2023-12-20T04:42:18.416 INFO:teuthology.orchestra.run.smithi187.stdout: osd scrub max interval = 600 2023-12-20T04:42:18.416 INFO:teuthology.orchestra.run.smithi187.stdout: osd mclock profile = high_recovery_ops 2023-12-20T04:42:18.416 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.416 INFO:teuthology.orchestra.run.smithi187.stdout: osd recover clone overlap = true 2023-12-20T04:42:18.416 INFO:teuthology.orchestra.run.smithi187.stdout: osd recovery max chunk = 1048576 2023-12-20T04:42:18.416 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.416 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug shutdown = true 2023-12-20T04:42:18.416 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug op order = true 2023-12-20T04:42:18.416 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug verify stray on activate = true 2023-12-20T04:42:18.416 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.416 INFO:teuthology.orchestra.run.smithi187.stdout: osd open classes on start = true 2023-12-20T04:42:18.416 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug pg log writeout = true 2023-12-20T04:42:18.416 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.416 INFO:teuthology.orchestra.run.smithi187.stdout: osd deep scrub update digest min age = 30 2023-12-20T04:42:18.416 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.417 INFO:teuthology.orchestra.run.smithi187.stdout: osd map max advance = 10 2023-12-20T04:42:18.417 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.417 INFO:teuthology.orchestra.run.smithi187.stdout: journal zero on create = true 2023-12-20T04:42:18.417 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.417 INFO:teuthology.orchestra.run.smithi187.stdout: filestore ondisk finisher threads = 3 2023-12-20T04:42:18.417 INFO:teuthology.orchestra.run.smithi187.stdout: filestore apply finisher threads = 3 2023-12-20T04:42:18.417 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.417 INFO:teuthology.orchestra.run.smithi187.stdout: bdev debug aio = true 2023-12-20T04:42:18.417 INFO:teuthology.orchestra.run.smithi187.stdout: osd debug misdirected ops = true 2023-12-20T04:42:18.417 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore block size = 96636764160 2023-12-20T04:42:18.417 INFO:teuthology.orchestra.run.smithi187.stdout: bluestore fsck on mount = True 2023-12-20T04:42:18.417 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluefs = 20 2023-12-20T04:42:18.417 INFO:teuthology.orchestra.run.smithi187.stdout: debug bluestore = 20 2023-12-20T04:42:18.417 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-12-20T04:42:18.417 INFO:teuthology.orchestra.run.smithi187.stdout: debug osd = 20 2023-12-20T04:42:18.418 INFO:teuthology.orchestra.run.smithi187.stdout: debug rocksdb = 10 2023-12-20T04:42:18.418 INFO:teuthology.orchestra.run.smithi187.stdout: memstore device bytes = 200000000 2023-12-20T04:42:18.418 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd backfillfull_ratio = 0.85 2023-12-20T04:42:18.418 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd full ratio = 0.9 2023-12-20T04:42:18.418 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd nearfull ratio = 0.8 2023-12-20T04:42:18.418 INFO:teuthology.orchestra.run.smithi187.stdout: osd failsafe full ratio = 1.0 2023-12-20T04:42:18.418 INFO:teuthology.orchestra.run.smithi187.stdout: osd mon report interval = 5 2023-12-20T04:42:18.418 INFO:teuthology.orchestra.run.smithi187.stdout: osd objectstore = memstore 2023-12-20T04:42:18.418 INFO:teuthology.orchestra.run.smithi187.stdout: osd op complaint time = 180 2023-12-20T04:42:18.418 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.418 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr] 2023-12-20T04:42:18.418 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-12-20T04:42:18.418 INFO:teuthology.orchestra.run.smithi187.stdout: debug mgr = 20 2023-12-20T04:42:18.418 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2023-12-20T04:42:18.418 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2023-12-20T04:42:18.419 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2023-12-20T04:42:18.419 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2023-12-20T04:42:18.419 INFO:teuthology.orchestra.run.smithi187.stdout: mgr/telemetry/nag = false 2023-12-20T04:42:18.419 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.419 INFO:teuthology.orchestra.run.smithi187.stdout:[mon] 2023-12-20T04:42:18.419 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-12-20T04:42:18.419 INFO:teuthology.orchestra.run.smithi187.stdout: debug mon = 20 2023-12-20T04:42:18.419 INFO:teuthology.orchestra.run.smithi187.stdout: debug paxos = 20 2023-12-20T04:42:18.419 INFO:teuthology.orchestra.run.smithi187.stdout: debug auth = 20 2023-12-20T04:42:18.419 INFO:teuthology.orchestra.run.smithi187.stdout: mon data avail warn = 5 2023-12-20T04:42:18.419 INFO:teuthology.orchestra.run.smithi187.stdout: mon mgr mkfs grace = 240 2023-12-20T04:42:18.420 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min pgs per osd = 4 2023-12-20T04:42:18.420 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd reporter subtree level = osd 2023-12-20T04:42:18.420 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd prime pg temp = true 2023-12-20T04:42:18.420 INFO:teuthology.orchestra.run.smithi187.stdout: mon reweight min bytes per osd = 10 2023-12-20T04:42:18.420 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.420 INFO:teuthology.orchestra.run.smithi187.stdout: # rotate auth tickets quickly to exercise renewal paths 2023-12-20T04:42:18.420 INFO:teuthology.orchestra.run.smithi187.stdout: auth mon ticket ttl = 660 # 11m 2023-12-20T04:42:18.420 INFO:teuthology.orchestra.run.smithi187.stdout: auth service ticket ttl = 240 # 4m 2023-12-20T04:42:18.420 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.420 INFO:teuthology.orchestra.run.smithi187.stdout: # don't complain about insecure global_id in the test suite 2023-12-20T04:42:18.420 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim = false 2023-12-20T04:42:18.420 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2023-12-20T04:42:18.420 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.420 INFO:teuthology.orchestra.run.smithi187.stdout: # 1m isn't quite enough 2023-12-20T04:42:18.420 INFO:teuthology.orchestra.run.smithi187.stdout: mon_down_mkfs_grace = 2m 2023-12-20T04:42:18.421 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.421 INFO:teuthology.orchestra.run.smithi187.stdout: mon_warn_on_filestore_osds = false 2023-12-20T04:42:18.421 INFO:teuthology.orchestra.run.smithi187.stdout: mon op complaint time = 120 2023-12-20T04:42:18.421 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd backfillfull ratio = 0.6 2023-12-20T04:42:18.421 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd full ratio = 0.7 2023-12-20T04:42:18.421 INFO:teuthology.orchestra.run.smithi187.stdout: mon osd nearfull ratio = 0.6 2023-12-20T04:42:18.421 INFO:teuthology.orchestra.run.smithi187.stdout: 2023-12-20T04:42:18.421 INFO:teuthology.orchestra.run.smithi187.stdout:[client] 2023-12-20T04:42:18.421 INFO:teuthology.orchestra.run.smithi187.stdout: rgw cache enabled = true 2023-12-20T04:42:18.421 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable ops log = true 2023-12-20T04:42:18.421 INFO:teuthology.orchestra.run.smithi187.stdout: rgw enable usage log = true 2023-12-20T04:42:18.421 INFO:teuthology.orchestra.run.smithi187.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2023-12-20T04:42:18.421 INFO:teuthology.orchestra.run.smithi187.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2023-12-20T04:42:18.421 INFO:teuthology.orchestra.run.smithi187.stdout: client mount timeout = 600 2023-12-20T04:42:18.421 INFO:teuthology.orchestra.run.smithi187.stdout: debug client = 20 2023-12-20T04:42:18.422 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-12-20T04:42:18.422 INFO:teuthology.orchestra.run.smithi187.stdout: pid file = "" 2023-12-20T04:42:18.422 INFO:teuthology.orchestra.run.smithi187.stdout: rados mon op timeout = 900 2023-12-20T04:42:18.422 INFO:teuthology.orchestra.run.smithi187.stdout: rados osd op timeout = 900 2023-12-20T04:42:18.422 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.a] 2023-12-20T04:42:18.422 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.b] 2023-12-20T04:42:18.422 INFO:teuthology.orchestra.run.smithi187.stdout:[mon.c] 2023-12-20T04:42:18.422 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2023-12-20T04:42:18.422 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.c] 2023-12-20T04:42:18.422 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.b] 2023-12-20T04:42:18.422 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.d] 2023-12-20T04:42:18.422 INFO:teuthology.orchestra.run.smithi187.stdout:[client.0] 2023-12-20T04:42:18.422 INFO:teuthology.orchestra.run.smithi187.stdout: debug client = 20 2023-12-20T04:42:18.422 INFO:teuthology.orchestra.run.smithi187.stdout: debug objectcacher = 20 2023-12-20T04:42:18.422 INFO:teuthology.orchestra.run.smithi187.stdout: debug objecter = 20 2023-12-20T04:42:18.422 INFO:teuthology.orchestra.run.smithi187.stdout:[client.1] 2023-12-20T04:42:18.423 INFO:teuthology.orchestra.run.smithi187.stdout: debug client = 20 2023-12-20T04:42:18.423 INFO:teuthology.orchestra.run.smithi187.stdout: debug objectcacher = 20 2023-12-20T04:42:18.423 INFO:teuthology.orchestra.run.smithi187.stdout: debug objecter = 20 2023-12-20T04:42:18.423 INFO:teuthology.orchestra.run.smithi187.stdout:[mds] 2023-12-20T04:42:18.423 INFO:teuthology.orchestra.run.smithi187.stdout: debug mds = 20 2023-12-20T04:42:18.423 INFO:teuthology.orchestra.run.smithi187.stdout: debug mds balancer = 20 2023-12-20T04:42:18.423 INFO:teuthology.orchestra.run.smithi187.stdout: debug ms = 1 2023-12-20T04:42:18.423 INFO:teuthology.orchestra.run.smithi187.stdout: mds debug frag = True 2023-12-20T04:42:18.423 INFO:teuthology.orchestra.run.smithi187.stdout: mds debug scatterstat = True 2023-12-20T04:42:18.423 INFO:teuthology.orchestra.run.smithi187.stdout: mds op complaint time = 180 2023-12-20T04:42:18.423 INFO:teuthology.orchestra.run.smithi187.stdout: mds verify scatter = True 2023-12-20T04:42:18.423 INFO:teuthology.orchestra.run.smithi187.stdout: osd op complaint time = 180 2023-12-20T04:42:18.423 INFO:teuthology.orchestra.run.smithi187.stdout: rados mon op timeout = 900 2023-12-20T04:42:18.423 INFO:teuthology.orchestra.run.smithi187.stdout: rados osd op timeout = 900 2023-12-20T04:42:18.425 INFO:tasks.ceph:Creating admin key on mon.a... 2023-12-20T04:42:18.425 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2023-12-20T04:42:18.521 INFO:tasks.ceph:Copying monmap to all nodes... 2023-12-20T04:42:18.521 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:18.521 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2023-12-20T04:42:18.535 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:18.536 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2023-12-20T04:42:18.589 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:42:18.590 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:18.590 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-20T04:42:18.590 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-20T04:42:18.668 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:18.668 DEBUG:teuthology.orchestra.run.smithi132:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:42:18.723 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:42:18.723 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:18.723 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd of=/etc/ceph/ceph.keyring 2023-12-20T04:42:18.723 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0644 /etc/ceph/ceph.keyring 2023-12-20T04:42:18.763 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:18.763 DEBUG:teuthology.orchestra.run.smithi187:> dd of=/home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:42:18.818 INFO:tasks.ceph:Setting up mon nodes... 2023-12-20T04:42:18.818 INFO:tasks.ceph:Setting up mgr nodes... 2023-12-20T04:42:18.818 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2023-12-20T04:42:18.873 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2023-12-20T04:42:18.876 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2023-12-20T04:42:18.939 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2023-12-20T04:42:18.941 INFO:tasks.ceph:Setting up mds nodes... 2023-12-20T04:42:18.941 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2023-12-20T04:42:18.996 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2023-12-20T04:42:18.998 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2023-12-20T04:42:19.024 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2023-12-20T04:42:19.119 INFO:teuthology.orchestra.run.smithi132.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2023-12-20T04:42:19.121 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2023-12-20T04:42:19.148 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2023-12-20T04:42:19.203 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2023-12-20T04:42:19.205 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2023-12-20T04:42:19.233 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2023-12-20T04:42:19.327 INFO:teuthology.orchestra.run.smithi187.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2023-12-20T04:42:19.329 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2023-12-20T04:42:19.356 INFO:tasks.ceph_client:Setting up client nodes... 2023-12-20T04:42:19.356 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2023-12-20T04:42:19.399 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.client.0.keyring 2023-12-20T04:42:19.414 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.2 /etc/ceph/ceph.client.2.keyring && sudo chmod 0644 /etc/ceph/ceph.client.2.keyring 2023-12-20T04:42:19.496 INFO:teuthology.orchestra.run.smithi132.stdout:creating /etc/ceph/ceph.client.2.keyring 2023-12-20T04:42:19.511 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2023-12-20T04:42:19.553 INFO:teuthology.orchestra.run.smithi187.stdout:creating /etc/ceph/ceph.client.1.keyring 2023-12-20T04:42:19.569 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.3 /etc/ceph/ceph.client.3.keyring && sudo chmod 0644 /etc/ceph/ceph.client.3.keyring 2023-12-20T04:42:19.650 INFO:teuthology.orchestra.run.smithi187.stdout:creating /etc/ceph/ceph.client.3.keyring 2023-12-20T04:42:19.665 INFO:tasks.ceph:Running mkfs on osd nodes... 2023-12-20T04:42:19.665 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi132.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi187.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2023-12-20T04:42:19.665 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2023-12-20T04:42:19.691 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-20T04:42:19.691 INFO:tasks.ceph:role: osd.0 2023-12-20T04:42:19.692 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:42:19.692 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-20T04:42:19.765 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-20T04:42:19.765 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-20T04:42:19.766 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-20T04:42:19.766 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-20T04:42:19.766 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-20T04:42:19.766 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-12-20T04:42:19.766 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-20T04:42:19.766 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-20T04:42:19.766 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-20T04:42:19.766 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-20T04:42:20.284 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-12-20T04:42:20.286 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-12-20T04:42:20.286 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2023-12-20T04:42:20.420 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2023-12-20T04:42:20.457 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2023-12-20T04:42:20.525 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-20T04:42:20.526 INFO:tasks.ceph:role: osd.1 2023-12-20T04:42:20.526 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:42:20.526 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-20T04:42:20.603 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-20T04:42:20.603 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-20T04:42:20.603 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-20T04:42:20.603 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-20T04:42:20.603 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-20T04:42:20.604 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-12-20T04:42:20.604 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-20T04:42:20.604 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-20T04:42:20.604 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-20T04:42:20.604 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-20T04:42:21.047 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-12-20T04:42:21.049 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-12-20T04:42:21.049 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2023-12-20T04:42:21.145 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2023-12-20T04:42:21.179 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2023-12-20T04:42:21.248 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-20T04:42:21.248 INFO:tasks.ceph:role: osd.2 2023-12-20T04:42:21.248 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:42:21.248 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-20T04:42:21.325 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-20T04:42:21.325 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-20T04:42:21.325 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-20T04:42:21.325 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-20T04:42:21.325 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-20T04:42:21.325 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-12-20T04:42:21.326 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-20T04:42:21.326 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-20T04:42:21.326 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-20T04:42:21.326 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-20T04:42:21.802 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-12-20T04:42:21.805 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-12-20T04:42:21.805 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2023-12-20T04:42:21.941 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2023-12-20T04:42:21.977 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2023-12-20T04:42:22.046 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2023-12-20T04:42:22.046 INFO:tasks.ceph:role: osd.3 2023-12-20T04:42:22.047 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:42:22.047 DEBUG:teuthology.orchestra.run.smithi132:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-20T04:42:22.122 INFO:teuthology.orchestra.run.smithi132.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-20T04:42:22.123 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-20T04:42:22.123 INFO:teuthology.orchestra.run.smithi132.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-20T04:42:22.123 INFO:teuthology.orchestra.run.smithi132.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-20T04:42:22.123 INFO:teuthology.orchestra.run.smithi132.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-20T04:42:22.123 INFO:teuthology.orchestra.run.smithi132.stdout: = sunit=0 swidth=0 blks 2023-12-20T04:42:22.123 INFO:teuthology.orchestra.run.smithi132.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-20T04:42:22.123 INFO:teuthology.orchestra.run.smithi132.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-20T04:42:22.123 INFO:teuthology.orchestra.run.smithi132.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-20T04:42:22.123 INFO:teuthology.orchestra.run.smithi132.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-20T04:42:22.656 INFO:teuthology.orchestra.run.smithi132.stdout:Discarding blocks...Done. 2023-12-20T04:42:22.658 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi132.front.sepia.ceph.com -o noatime 2023-12-20T04:42:22.658 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2023-12-20T04:42:22.796 DEBUG:teuthology.orchestra.run.smithi132:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2023-12-20T04:42:22.834 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:42:22.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:22.971+0000 7f5d0e0a1500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2023-12-20T04:42:22.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:22.971+0000 7f5d0e0a1500 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2023-12-20T04:42:22.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:22.971+0000 7f5d0e0a1500 -1 memstore(/var/lib/ceph/osd/ceph-0) /var/lib/ceph/osd/ceph-0 2023-12-20T04:42:22.982 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2023-12-20T04:42:23.010 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:42:23.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:23.096+0000 7f6740303500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2023-12-20T04:42:23.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:23.097+0000 7f6740303500 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2023-12-20T04:42:23.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:23.097+0000 7f6740303500 -1 memstore(/var/lib/ceph/osd/ceph-1) /var/lib/ceph/osd/ceph-1 2023-12-20T04:42:23.105 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2023-12-20T04:42:23.132 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:42:23.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:23.216+0000 7fbc1de12500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2023-12-20T04:42:23.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:23.217+0000 7fbc1de12500 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2023-12-20T04:42:23.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:23.217+0000 7fbc1de12500 -1 memstore(/var/lib/ceph/osd/ceph-2) /var/lib/ceph/osd/ceph-2 2023-12-20T04:42:23.226 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2023-12-20T04:42:23.252 DEBUG:teuthology.orchestra.run.smithi132:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:42:23.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:23.336+0000 7fdcbbc26500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2023-12-20T04:42:23.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:23.336+0000 7fdcbbc26500 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2023-12-20T04:42:23.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:23.337+0000 7fdcbbc26500 -1 memstore(/var/lib/ceph/osd/ceph-3) /var/lib/ceph/osd/ceph-3 2023-12-20T04:42:23.344 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2023-12-20T04:42:23.371 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2023-12-20T04:42:23.403 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-20T04:42:23.403 INFO:tasks.ceph:role: osd.4 2023-12-20T04:42:23.403 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:42:23.403 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2023-12-20T04:42:23.482 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2023-12-20T04:42:23.482 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-20T04:42:23.482 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-20T04:42:23.482 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-20T04:42:23.482 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-20T04:42:23.482 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-12-20T04:42:23.482 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-20T04:42:23.482 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-20T04:42:23.482 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-20T04:42:23.482 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-20T04:42:23.993 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-12-20T04:42:23.995 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-12-20T04:42:23.995 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2023-12-20T04:42:24.130 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2023-12-20T04:42:24.166 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2023-12-20T04:42:24.235 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-20T04:42:24.236 INFO:tasks.ceph:role: osd.5 2023-12-20T04:42:24.236 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:42:24.236 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2023-12-20T04:42:24.313 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2023-12-20T04:42:24.313 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-20T04:42:24.313 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-20T04:42:24.313 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-20T04:42:24.313 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-20T04:42:24.313 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-12-20T04:42:24.313 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-20T04:42:24.313 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-20T04:42:24.313 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-20T04:42:24.313 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-20T04:42:24.761 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-12-20T04:42:24.764 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-12-20T04:42:24.764 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2023-12-20T04:42:24.865 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2023-12-20T04:42:24.899 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2023-12-20T04:42:24.966 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-20T04:42:24.966 INFO:tasks.ceph:role: osd.6 2023-12-20T04:42:24.966 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:42:24.966 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2023-12-20T04:42:25.042 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2023-12-20T04:42:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-20T04:42:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-20T04:42:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-20T04:42:25.042 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-20T04:42:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-12-20T04:42:25.042 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-20T04:42:25.042 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-20T04:42:25.042 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-20T04:42:25.043 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-20T04:42:25.531 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-12-20T04:42:25.534 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-12-20T04:42:25.534 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2023-12-20T04:42:25.679 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2023-12-20T04:42:25.713 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2023-12-20T04:42:25.782 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2023-12-20T04:42:25.782 INFO:tasks.ceph:role: osd.7 2023-12-20T04:42:25.782 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:42:25.782 DEBUG:teuthology.orchestra.run.smithi187:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2023-12-20T04:42:25.857 INFO:teuthology.orchestra.run.smithi187.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2023-12-20T04:42:25.857 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 attr=2, projid32bit=1 2023-12-20T04:42:25.857 INFO:teuthology.orchestra.run.smithi187.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2023-12-20T04:42:25.857 INFO:teuthology.orchestra.run.smithi187.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2023-12-20T04:42:25.858 INFO:teuthology.orchestra.run.smithi187.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2023-12-20T04:42:25.858 INFO:teuthology.orchestra.run.smithi187.stdout: = sunit=0 swidth=0 blks 2023-12-20T04:42:25.858 INFO:teuthology.orchestra.run.smithi187.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2023-12-20T04:42:25.858 INFO:teuthology.orchestra.run.smithi187.stdout:log =internal log bsize=4096 blocks=16384, version=2 2023-12-20T04:42:25.858 INFO:teuthology.orchestra.run.smithi187.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2023-12-20T04:42:25.858 INFO:teuthology.orchestra.run.smithi187.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2023-12-20T04:42:26.367 INFO:teuthology.orchestra.run.smithi187.stdout:Discarding blocks...Done. 2023-12-20T04:42:26.369 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi187.front.sepia.ceph.com -o noatime 2023-12-20T04:42:26.369 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2023-12-20T04:42:26.506 DEBUG:teuthology.orchestra.run.smithi187:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2023-12-20T04:42:26.542 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:42:26.648 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:26.646+0000 7fb060012500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2023-12-20T04:42:26.649 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:26.647+0000 7fb060012500 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2023-12-20T04:42:26.649 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:26.647+0000 7fb060012500 -1 memstore(/var/lib/ceph/osd/ceph-4) /var/lib/ceph/osd/ceph-4 2023-12-20T04:42:26.660 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2023-12-20T04:42:26.687 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:42:26.774 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:26.772+0000 7f4ff4614500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2023-12-20T04:42:26.774 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:26.772+0000 7f4ff4614500 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2023-12-20T04:42:26.774 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:26.772+0000 7f4ff4614500 -1 memstore(/var/lib/ceph/osd/ceph-5) /var/lib/ceph/osd/ceph-5 2023-12-20T04:42:26.779 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2023-12-20T04:42:26.806 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:42:26.891 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:26.890+0000 7ffa968f8500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2023-12-20T04:42:26.892 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:26.890+0000 7ffa968f8500 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2023-12-20T04:42:26.892 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:26.890+0000 7ffa968f8500 -1 memstore(/var/lib/ceph/osd/ceph-6) /var/lib/ceph/osd/ceph-6 2023-12-20T04:42:26.900 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2023-12-20T04:42:26.927 DEBUG:teuthology.orchestra.run.smithi187:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:42:27.013 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:27.011+0000 7fdd82616500 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2023-12-20T04:42:27.013 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:27.012+0000 7fdd82616500 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2023-12-20T04:42:27.013 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:27.012+0000 7fdd82616500 -1 memstore(/var/lib/ceph/osd/ceph-7) /var/lib/ceph/osd/ceph-7 2023-12-20T04:42:27.019 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2023-12-20T04:42:27.046 INFO:tasks.ceph:Reading keys from all nodes... 2023-12-20T04:42:27.046 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:27.046 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2023-12-20T04:42:27.078 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:27.078 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2023-12-20T04:42:27.149 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:27.149 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2023-12-20T04:42:27.218 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:27.218 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2023-12-20T04:42:27.286 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:27.286 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2023-12-20T04:42:27.353 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:27.353 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2023-12-20T04:42:27.420 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:27.420 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2023-12-20T04:42:27.487 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:27.487 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2023-12-20T04:42:27.515 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:27.515 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2023-12-20T04:42:27.582 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:27.582 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2023-12-20T04:42:27.649 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:27.649 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2023-12-20T04:42:27.717 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:27.717 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2023-12-20T04:42:27.784 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:27.784 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2023-12-20T04:42:27.851 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:27.851 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2023-12-20T04:42:27.918 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:27.918 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2023-12-20T04:42:27.933 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:27.933 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/etc/ceph/ceph.client.2.keyring of=/dev/stdout 2023-12-20T04:42:27.988 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:27.988 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2023-12-20T04:42:28.003 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:28.003 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/etc/ceph/ceph.client.3.keyring of=/dev/stdout 2023-12-20T04:42:28.058 INFO:tasks.ceph:Adding keys to all mons... 2023-12-20T04:42:28.058 DEBUG:teuthology.orchestra.run.smithi132:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-20T04:42:28.060 DEBUG:teuthology.orchestra.run.smithi187:> sudo tee -a /etc/ceph/ceph.keyring 2023-12-20T04:42:28.102 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.y] 2023-12-20T04:42:28.102 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCqcIJlMyAMNBAAWpoBNevgGIkZ7zKEdKn3Ag== 2023-12-20T04:42:28.102 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.a] 2023-12-20T04:42:28.102 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCqcIJlbTdZOxAAUDz0Eno9DYvrYM1xg5jG/A== 2023-12-20T04:42:28.102 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.c] 2023-12-20T04:42:28.102 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCrcIJlaSUVBxAA7HN3dSo9xfvkjvc6bwMxWg== 2023-12-20T04:42:28.102 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.0] 2023-12-20T04:42:28.102 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCucIJlwZfxORAAiT2g1poLu3OkmoyxNJQc8Q== 2023-12-20T04:42:28.102 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.1] 2023-12-20T04:42:28.102 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCvcIJlejHYBRAAKurKpW5gyOAQ+E4Su4xMSQ== 2023-12-20T04:42:28.102 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.2] 2023-12-20T04:42:28.102 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCvcIJlyfz8DBAA9a6tUjHF8IRIKeldwVFMcw== 2023-12-20T04:42:28.103 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.3] 2023-12-20T04:42:28.103 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCvcIJllFEeFBAA6URrqUjQqHsrI5+qEBVs3g== 2023-12-20T04:42:28.103 INFO:teuthology.orchestra.run.smithi132.stdout:[mgr.x] 2023-12-20T04:42:28.103 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCqcIJl+KnxNxAAM/b3mubTMYlB9QUbfcPW8g== 2023-12-20T04:42:28.103 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.b] 2023-12-20T04:42:28.103 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCrcIJl43gVDBAA1qJwUU+Ii4BalGf3NtJnGA== 2023-12-20T04:42:28.103 INFO:teuthology.orchestra.run.smithi132.stdout:[mds.d] 2023-12-20T04:42:28.103 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCrcIJl1DR4ExAANNOyGlf1Ayre/xZEb9JHYg== 2023-12-20T04:42:28.103 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.4] 2023-12-20T04:42:28.103 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCycIJlvGqcJhAAgn2wuSTwLT+TOHoE4iaVSg== 2023-12-20T04:42:28.103 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.5] 2023-12-20T04:42:28.103 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCycIJlWrkTLhAA2KlpxTFPaiXLCvmURpg5rw== 2023-12-20T04:42:28.103 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.6] 2023-12-20T04:42:28.103 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCycIJlnOQfNRAA//EVx0BZYQd7ovK2tFhgfA== 2023-12-20T04:42:28.103 INFO:teuthology.orchestra.run.smithi132.stdout:[osd.7] 2023-12-20T04:42:28.104 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCzcIJl4nfDABAAtBdl2qkzKcqhmzsukC7G5w== 2023-12-20T04:42:28.104 INFO:teuthology.orchestra.run.smithi132.stdout:[client.0] 2023-12-20T04:42:28.104 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCrcIJlm/nGFxAA6zndayizc50Il7l74BxkgQ== 2023-12-20T04:42:28.104 INFO:teuthology.orchestra.run.smithi132.stdout:[client.2] 2023-12-20T04:42:28.104 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCrcIJlMgWUHRAAqSdmRGx+9J+3dO7ntaApdw== 2023-12-20T04:42:28.104 INFO:teuthology.orchestra.run.smithi132.stdout:[client.1] 2023-12-20T04:42:28.104 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCrcIJlppb6IBAArqCoSlSE5coxkj4+XjPoWg== 2023-12-20T04:42:28.104 INFO:teuthology.orchestra.run.smithi132.stdout:[client.3] 2023-12-20T04:42:28.104 INFO:teuthology.orchestra.run.smithi132.stdout: key = AQCrcIJlcIe3JhAAjv9KfknxwySJURWdePN7vw== 2023-12-20T04:42:28.124 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.y] 2023-12-20T04:42:28.124 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCqcIJlMyAMNBAAWpoBNevgGIkZ7zKEdKn3Ag== 2023-12-20T04:42:28.124 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.a] 2023-12-20T04:42:28.124 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCqcIJlbTdZOxAAUDz0Eno9DYvrYM1xg5jG/A== 2023-12-20T04:42:28.125 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.c] 2023-12-20T04:42:28.125 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCrcIJlaSUVBxAA7HN3dSo9xfvkjvc6bwMxWg== 2023-12-20T04:42:28.125 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.0] 2023-12-20T04:42:28.126 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCucIJlwZfxORAAiT2g1poLu3OkmoyxNJQc8Q== 2023-12-20T04:42:28.126 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.1] 2023-12-20T04:42:28.126 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCvcIJlejHYBRAAKurKpW5gyOAQ+E4Su4xMSQ== 2023-12-20T04:42:28.126 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.2] 2023-12-20T04:42:28.126 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCvcIJlyfz8DBAA9a6tUjHF8IRIKeldwVFMcw== 2023-12-20T04:42:28.126 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.3] 2023-12-20T04:42:28.126 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCvcIJllFEeFBAA6URrqUjQqHsrI5+qEBVs3g== 2023-12-20T04:42:28.126 INFO:teuthology.orchestra.run.smithi187.stdout:[mgr.x] 2023-12-20T04:42:28.126 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCqcIJl+KnxNxAAM/b3mubTMYlB9QUbfcPW8g== 2023-12-20T04:42:28.126 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.b] 2023-12-20T04:42:28.126 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCrcIJl43gVDBAA1qJwUU+Ii4BalGf3NtJnGA== 2023-12-20T04:42:28.126 INFO:teuthology.orchestra.run.smithi187.stdout:[mds.d] 2023-12-20T04:42:28.126 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCrcIJl1DR4ExAANNOyGlf1Ayre/xZEb9JHYg== 2023-12-20T04:42:28.126 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.4] 2023-12-20T04:42:28.126 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCycIJlvGqcJhAAgn2wuSTwLT+TOHoE4iaVSg== 2023-12-20T04:42:28.127 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.5] 2023-12-20T04:42:28.127 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCycIJlWrkTLhAA2KlpxTFPaiXLCvmURpg5rw== 2023-12-20T04:42:28.127 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.6] 2023-12-20T04:42:28.127 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCycIJlnOQfNRAA//EVx0BZYQd7ovK2tFhgfA== 2023-12-20T04:42:28.127 INFO:teuthology.orchestra.run.smithi187.stdout:[osd.7] 2023-12-20T04:42:28.127 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCzcIJl4nfDABAAtBdl2qkzKcqhmzsukC7G5w== 2023-12-20T04:42:28.127 INFO:teuthology.orchestra.run.smithi187.stdout:[client.0] 2023-12-20T04:42:28.127 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCrcIJlm/nGFxAA6zndayizc50Il7l74BxkgQ== 2023-12-20T04:42:28.127 INFO:teuthology.orchestra.run.smithi187.stdout:[client.2] 2023-12-20T04:42:28.127 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCrcIJlMgWUHRAAqSdmRGx+9J+3dO7ntaApdw== 2023-12-20T04:42:28.127 INFO:teuthology.orchestra.run.smithi187.stdout:[client.1] 2023-12-20T04:42:28.127 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCrcIJlppb6IBAArqCoSlSE5coxkj4+XjPoWg== 2023-12-20T04:42:28.127 INFO:teuthology.orchestra.run.smithi187.stdout:[client.3] 2023-12-20T04:42:28.127 INFO:teuthology.orchestra.run.smithi187.stdout: key = AQCrcIJlcIe3JhAAjv9KfknxwySJURWdePN7vw== 2023-12-20T04:42:28.128 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-20T04:42:28.147 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-20T04:42:28.219 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-20T04:42:28.222 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-20T04:42:28.276 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-20T04:42:28.279 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-20T04:42:28.333 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:42:28.336 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:42:28.387 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:42:28.389 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:42:28.440 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:42:28.442 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:42:28.494 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:42:28.496 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:42:28.549 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-20T04:42:28.551 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2023-12-20T04:42:28.602 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-20T04:42:28.604 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-20T04:42:28.659 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-20T04:42:28.661 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2023-12-20T04:42:28.715 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:42:28.717 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:42:28.769 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:42:28.771 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:42:28.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:42:28.824 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:42:28.875 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:42:28.877 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2023-12-20T04:42:28.929 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-20T04:42:28.931 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-20T04:42:28.985 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-20T04:42:28.988 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.2 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-20T04:42:29.043 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-20T04:42:29.045 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-20T04:42:29.100 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-20T04:42:29.102 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.3 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2023-12-20T04:42:29.157 INFO:tasks.ceph:Running mkfs on mon nodes... 2023-12-20T04:42:29.157 DEBUG:teuthology.orchestra.run.smithi132:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2023-12-20T04:42:29.183 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-20T04:42:29.280 DEBUG:teuthology.orchestra.run.smithi132:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2023-12-20T04:42:29.306 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2023-12-20T04:42:29.333 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-20T04:42:29.429 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2023-12-20T04:42:29.456 DEBUG:teuthology.orchestra.run.smithi187:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2023-12-20T04:42:29.523 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2023-12-20T04:42:29.619 DEBUG:teuthology.orchestra.run.smithi187:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2023-12-20T04:42:29.645 DEBUG:teuthology.orchestra.run.smithi132:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:42:29.648 DEBUG:teuthology.orchestra.run.smithi187:> rm -- /home/ubuntu/cephtest/ceph.monmap 2023-12-20T04:42:29.700 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2023-12-20T04:42:29.700 INFO:tasks.ceph.mon.a:Restarting daemon 2023-12-20T04:42:29.701 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2023-12-20T04:42:29.703 INFO:tasks.ceph.mon.a:Started 2023-12-20T04:42:29.704 INFO:tasks.ceph.mon.b:Restarting daemon 2023-12-20T04:42:29.704 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2023-12-20T04:42:29.743 INFO:tasks.ceph.mon.b:Started 2023-12-20T04:42:29.743 INFO:tasks.ceph.mon.c:Restarting daemon 2023-12-20T04:42:29.743 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2023-12-20T04:42:29.746 INFO:tasks.ceph.mon.c:Started 2023-12-20T04:42:29.746 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2023-12-20T04:42:29.747 INFO:tasks.ceph.mgr.y:Restarting daemon 2023-12-20T04:42:29.747 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2023-12-20T04:42:29.750 INFO:tasks.ceph.mgr.y:Started 2023-12-20T04:42:29.750 INFO:tasks.ceph.mgr.x:Restarting daemon 2023-12-20T04:42:29.750 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2023-12-20T04:42:29.753 INFO:tasks.ceph.mgr.x:Started 2023-12-20T04:42:29.754 INFO:tasks.ceph:Setting crush tunables to default 2023-12-20T04:42:29.754 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph osd crush tunables default 2023-12-20T04:42:29.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.853+0000 7feed339f640 1 Processor -- start 2023-12-20T04:42:29.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.853+0000 7feed339f640 1 -- start start 2023-12-20T04:42:29.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed339f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7feecc15d300 0x7feecc0d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:29.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed339f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 0x7feecc0cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:29.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed339f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feecc0cfdc0 0x7feecc0b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed339f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feecc0d0230 con 0x7feecc0cfdc0 2023-12-20T04:42:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed339f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feecc0d1a90 con 0x7feecc15d300 2023-12-20T04:42:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed339f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc0d1d70 con 0x7feecc0d1550 2023-12-20T04:42:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed193c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feecc0cfdc0 0x7feecc0b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed193c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feecc0cfdc0 0x7feecc0b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56024/0 (socket says 172.21.15.132:56024) 2023-12-20T04:42:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed193c640 1 -- 172.21.15.132:0/2484918537 learned_addr learned my addr 172.21.15.132:0/2484918537 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed193c640 1 -- 172.21.15.132:0/2484918537 >> v2:172.21.15.132:3300/0 conn(0x7feecc0cfdc0 msgr2=0x7feecc0b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-20T04:42:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed193c640 1 -- 172.21.15.132:0/2484918537 >> v2:172.21.15.132:3300/0 conn(0x7feecc0cfdc0 msgr2=0x7feecc0b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-20T04:42:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed193c640 1 --2- 172.21.15.132:0/2484918537 >> v2:172.21.15.132:3300/0 conn(0x7feecc0cfdc0 0x7feecc0b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-20T04:42:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed113b640 1 --2- 172.21.15.132:0/2484918537 >> v2:172.21.15.187:3300/0 conn(0x7feecc15d300 0x7feecc0d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed093a640 1 --2- 172.21.15.132:0/2484918537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 0x7feecc0cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:29.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed193c640 1 --2- 172.21.15.132:0/2484918537 >> v2:172.21.15.132:3300/0 conn(0x7feecc0cfdc0 0x7feecc0b48f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-20T04:42:29.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed113b640 1 -- 172.21.15.132:0/2484918537 >> v2:172.21.15.187:3300/0 conn(0x7feecc15d300 msgr2=0x7feecc0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-20T04:42:29.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed113b640 1 -- 172.21.15.132:0/2484918537 >> v2:172.21.15.187:3300/0 conn(0x7feecc15d300 msgr2=0x7feecc0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-20T04:42:29.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed113b640 1 --2- 172.21.15.132:0/2484918537 >> v2:172.21.15.187:3300/0 conn(0x7feecc15d300 0x7feecc0d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-20T04:42:29.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed113b640 1 --2- 172.21.15.132:0/2484918537 >> v2:172.21.15.187:3300/0 conn(0x7feecc15d300 0x7feecc0d1010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-20T04:42:29.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed093a640 1 -- 172.21.15.132:0/2484918537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 msgr2=0x7feecc0cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-20T04:42:29.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed093a640 1 -- 172.21.15.132:0/2484918537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 msgr2=0x7feecc0cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-20T04:42:29.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed093a640 1 --2- 172.21.15.132:0/2484918537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 0x7feecc0cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-20T04:42:29.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:29.854+0000 7feed093a640 1 --2- 172.21.15.132:0/2484918537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 0x7feecc0cf880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2023-12-20T04:42:30.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.055+0000 7feed193c640 1 --2- 172.21.15.132:0/2484918537 >> v2:172.21.15.132:3300/0 conn(0x7feecc0cfdc0 0x7feecc0b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:30.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.055+0000 7feed093a640 1 --2- 172.21.15.132:0/2484918537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 0x7feecc0cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:30.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.055+0000 7feed113b640 1 --2- 172.21.15.132:0/2484918537 >> v2:172.21.15.187:3300/0 conn(0x7feecc15d300 0x7feecc0d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:30.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.055+0000 7feed193c640 1 -- 172.21.15.132:0/2484918537 >> v2:172.21.15.132:3300/0 conn(0x7feecc0cfdc0 msgr2=0x7feecc0b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2023-12-20T04:42:30.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.055+0000 7feed193c640 1 -- 172.21.15.132:0/2484918537 >> v2:172.21.15.132:3300/0 conn(0x7feecc0cfdc0 msgr2=0x7feecc0b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-20T04:42:30.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.055+0000 7feed193c640 1 --2- 172.21.15.132:0/2484918537 >> v2:172.21.15.132:3300/0 conn(0x7feecc0cfdc0 0x7feecc0b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-20T04:42:30.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.055+0000 7feed093a640 1 -- 172.21.15.132:0/2484918537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 msgr2=0x7feecc0cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 14 2023-12-20T04:42:30.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.055+0000 7feed093a640 1 -- 172.21.15.132:0/2484918537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 msgr2=0x7feecc0cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-20T04:42:30.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.055+0000 7feed093a640 1 --2- 172.21.15.132:0/2484918537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 0x7feecc0cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-20T04:42:30.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.055+0000 7feed193c640 1 --2- 172.21.15.132:0/2484918537 >> v2:172.21.15.132:3300/0 conn(0x7feecc0cfdc0 0x7feecc0b48f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-20T04:42:30.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.055+0000 7feed093a640 1 --2- 172.21.15.132:0/2484918537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 0x7feecc0cf880 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-20T04:42:30.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.055+0000 7feed113b640 1 -- 172.21.15.132:0/2484918537 >> v2:172.21.15.187:3300/0 conn(0x7feecc15d300 msgr2=0x7feecc0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2023-12-20T04:42:30.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.055+0000 7feed113b640 1 -- 172.21.15.132:0/2484918537 >> v2:172.21.15.187:3300/0 conn(0x7feecc15d300 msgr2=0x7feecc0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2023-12-20T04:42:30.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.055+0000 7feed113b640 1 --2- 172.21.15.132:0/2484918537 >> v2:172.21.15.187:3300/0 conn(0x7feecc15d300 0x7feecc0d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2023-12-20T04:42:30.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.055+0000 7feed113b640 1 --2- 172.21.15.132:0/2484918537 >> v2:172.21.15.187:3300/0 conn(0x7feecc15d300 0x7feecc0d1010 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2023-12-20T04:42:30.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.456+0000 7feed193c640 1 --2- 172.21.15.132:0/2484918537 >> v2:172.21.15.132:3300/0 conn(0x7feecc0cfdc0 0x7feecc0b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:30.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.456+0000 7feed113b640 1 --2- 172.21.15.132:0/2484918537 >> v2:172.21.15.187:3300/0 conn(0x7feecc15d300 0x7feecc0d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:30.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.456+0000 7feed093a640 1 --2- 172.21.15.132:0/2484918537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 0x7feecc0cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:30.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.456+0000 7feed193c640 1 -- 172.21.15.132:0/2484918537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 msgr2=0x7feecc0cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:30.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.456+0000 7feed193c640 1 --2- 172.21.15.132:0/2484918537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 0x7feecc0cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:30.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.456+0000 7feed193c640 1 -- 172.21.15.132:0/2484918537 >> v2:172.21.15.187:3300/0 conn(0x7feecc15d300 msgr2=0x7feecc0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:30.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.456+0000 7feed193c640 1 --2- 172.21.15.132:0/2484918537 >> v2:172.21.15.187:3300/0 conn(0x7feecc15d300 0x7feecc0d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:30.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.456+0000 7feed193c640 1 -- 172.21.15.132:0/2484918537 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feecc0d2050 con 0x7feecc0cfdc0 2023-12-20T04:42:30.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.457+0000 7feed193c640 1 --2- 172.21.15.132:0/2484918537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feecc0cfdc0 0x7feecc0b48f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7feecc0cf850 tx=0x7feec402c240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d36baa0bb526b4d3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:30.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.457+0000 7feec3fff640 1 -- 172.21.15.132:0/2484918537 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4036400 con 0x7feecc0cfdc0 2023-12-20T04:42:30.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.457+0000 7feec3fff640 1 -- 172.21.15.132:0/2484918537 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec4030070 con 0x7feecc0cfdc0 2023-12-20T04:42:30.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.457+0000 7feec3fff640 1 -- 172.21.15.132:0/2484918537 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4036800 con 0x7feecc0cfdc0 2023-12-20T04:42:30.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.458+0000 7feed339f640 1 -- 172.21.15.132:0/2484918537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feecc0cfdc0 msgr2=0x7feecc0b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:30.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.458+0000 7feed339f640 1 --2- 172.21.15.132:0/2484918537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feecc0cfdc0 0x7feecc0b48f0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7feecc0cf850 tx=0x7feec402c240 comp rx=0 tx=0).stop 2023-12-20T04:42:30.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.458+0000 7feed339f640 1 -- 172.21.15.132:0/2484918537 shutdown_connections 2023-12-20T04:42:30.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.458+0000 7feed339f640 1 --2- 172.21.15.132:0/2484918537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feecc0cfdc0 0x7feecc0b48f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:30.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.458+0000 7feed339f640 1 --2- 172.21.15.132:0/2484918537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 0x7feecc0cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:30.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.458+0000 7feed339f640 1 --2- 172.21.15.132:0/2484918537 >> v2:172.21.15.187:3300/0 conn(0x7feecc15d300 0x7feecc0d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:30.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.458+0000 7feed339f640 1 -- 172.21.15.132:0/2484918537 >> 172.21.15.132:0/2484918537 conn(0x7feecc06a3d0 msgr2=0x7feecc06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:30.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.458+0000 7feed339f640 1 -- 172.21.15.132:0/2484918537 shutdown_connections 2023-12-20T04:42:30.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.458+0000 7feed339f640 1 -- 172.21.15.132:0/2484918537 wait complete. 2023-12-20T04:42:30.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.459+0000 7feed339f640 1 Processor -- start 2023-12-20T04:42:30.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.459+0000 7feed339f640 1 -- start start 2023-12-20T04:42:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed339f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feecc0cfdc0 0x7feecc1f5750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed339f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 0x7feecc0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed339f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feecc15d300 0x7feecc0b3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed339f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc0cb9a0 con 0x7feecc15d300 2023-12-20T04:42:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed339f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feecc1f5c90 con 0x7feecc0cfdc0 2023-12-20T04:42:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed339f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feecc0cbc60 con 0x7feecc0d1550 2023-12-20T04:42:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed193c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feecc15d300 0x7feecc0b3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed193c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feecc15d300 0x7feecc0b3d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56076/0 (socket says 172.21.15.132:56076) 2023-12-20T04:42:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed193c640 1 -- 172.21.15.132:0/3770711364 learned_addr learned my addr 172.21.15.132:0/3770711364 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed093a640 1 --2- 172.21.15.132:0/3770711364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 0x7feecc0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed113b640 1 --2- 172.21.15.132:0/3770711364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feecc0cfdc0 0x7feecc1f5750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed193c640 1 -- 172.21.15.132:0/3770711364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 msgr2=0x7feecc0b3810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed193c640 1 --2- 172.21.15.132:0/3770711364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 0x7feecc0b3810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed193c640 1 -- 172.21.15.132:0/3770711364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feecc0cfdc0 msgr2=0x7feecc1f5750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:30.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed193c640 1 --2- 172.21.15.132:0/3770711364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feecc0cfdc0 0x7feecc1f5750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:30.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed193c640 1 -- 172.21.15.132:0/3770711364 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feec40097e0 con 0x7feecc15d300 2023-12-20T04:42:30.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed193c640 1 --2- 172.21.15.132:0/3770711364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feecc15d300 0x7feecc0b3d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feec40096d0 tx=0x7feec4004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:30.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feec1ffb640 1 -- 172.21.15.132:0/3770711364 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4041670 con 0x7feecc15d300 2023-12-20T04:42:30.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feec1ffb640 1 -- 172.21.15.132:0/3770711364 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feec40417d0 con 0x7feecc15d300 2023-12-20T04:42:30.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feed339f640 1 -- 172.21.15.132:0/3770711364 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feecc0cbf40 con 0x7feecc15d300 2023-12-20T04:42:30.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.460+0000 7feec1ffb640 1 -- 172.21.15.132:0/3770711364 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feec4041b40 con 0x7feecc15d300 2023-12-20T04:42:30.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.461+0000 7feed339f640 1 -- 172.21.15.132:0/3770711364 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feecc0cc500 con 0x7feecc15d300 2023-12-20T04:42:30.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.461+0000 7feec1ffb640 1 -- 172.21.15.132:0/3770711364 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7feec403f440 con 0x7feecc15d300 2023-12-20T04:42:30.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.461+0000 7feec1ffb640 1 -- 172.21.15.132:0/3770711364 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 725+0+0 (secure 0 0 0) 0x7feec404a400 con 0x7feecc15d300 2023-12-20T04:42:30.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.461+0000 7feed339f640 1 -- 172.21.15.132:0/3770711364 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feecc04e840 con 0x7feecc15d300 2023-12-20T04:42:30.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.464+0000 7feec1ffb640 1 -- 172.21.15.132:0/3770711364 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7feec4045020 con 0x7feecc15d300 2023-12-20T04:42:30.519 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:30.518+0000 7fa685010040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-20T04:42:30.528 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:30.526+0000 7f2203645040 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2023-12-20T04:42:30.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.527+0000 7feed339f640 1 -- 172.21.15.132:0/3770711364 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7feecc0ccf70 con 0x7feecc15d300 2023-12-20T04:42:30.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.530+0000 7feec1ffb640 1 -- 172.21.15.132:0/3770711364 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) v1 ==== 124+0+0 (secure 0 0 0) 0x7feec4058090 con 0x7feecc15d300 2023-12-20T04:42:30.532 INFO:teuthology.orchestra.run.smithi132.stderr:adjusted tunables profile to default 2023-12-20T04:42:30.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.531+0000 7feed339f640 1 -- 172.21.15.132:0/3770711364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feecc15d300 msgr2=0x7feecc0b3d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:30.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.531+0000 7feed339f640 1 --2- 172.21.15.132:0/3770711364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feecc15d300 0x7feecc0b3d50 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7feec40096d0 tx=0x7feec4004ab0 comp rx=0 tx=0).stop 2023-12-20T04:42:30.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.531+0000 7feed339f640 1 -- 172.21.15.132:0/3770711364 shutdown_connections 2023-12-20T04:42:30.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.531+0000 7feed339f640 1 --2- 172.21.15.132:0/3770711364 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feecc15d300 0x7feecc0b3d50 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:30.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.531+0000 7feed339f640 1 --2- 172.21.15.132:0/3770711364 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feecc0d1550 0x7feecc0b3810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:30.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.531+0000 7feed339f640 1 --2- 172.21.15.132:0/3770711364 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feecc0cfdc0 0x7feecc1f5750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:30.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.531+0000 7feed339f640 1 -- 172.21.15.132:0/3770711364 >> 172.21.15.132:0/3770711364 conn(0x7feecc06a3d0 msgr2=0x7feecc0d2b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:30.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.531+0000 7feed339f640 1 -- 172.21.15.132:0/3770711364 shutdown_connections 2023-12-20T04:42:30.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:30.531+0000 7feed339f640 1 -- 172.21.15.132:0/3770711364 wait complete. 2023-12-20T04:42:30.543 INFO:tasks.ceph:check_enable_crimson: False 2023-12-20T04:42:30.543 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2023-12-20T04:42:30.543 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:30.543 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2023-12-20T04:42:30.570 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:30.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2023-12-20T04:42:30.575 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:30.574+0000 7fa685010040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-20T04:42:30.579 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:30.578+0000 7f2203645040 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2023-12-20T04:42:30.605 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:30.605 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2023-12-20T04:42:30.669 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:42:30.669 DEBUG:teuthology.orchestra.run.smithi132:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2023-12-20T04:42:30.736 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:30.736 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2023-12-20T04:42:30.763 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:30.764 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2023-12-20T04:42:30.830 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:30.830 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2023-12-20T04:42:30.897 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:42:30.897 DEBUG:teuthology.orchestra.run.smithi187:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2023-12-20T04:42:30.964 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 0 2023-12-20T04:42:31.106 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.104+0000 7f5bc308f640 1 Processor -- start 2023-12-20T04:42:31.106 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.104+0000 7f5bc308f640 1 -- start start 2023-12-20T04:42:31.107 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bc308f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bbc158820 0x7f5bbc0cae00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.108 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bc308f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5bbc0cb450 0x7f5bbc0b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.108 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bc308f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5bbc0b17c0 0x7f5bbc0cf2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.108 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bc308f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc0b1c30 con 0x7f5bbc0cb450 2023-12-20T04:42:31.108 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bc308f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bbc15b2b0 con 0x7f5bbc0b17c0 2023-12-20T04:42:31.108 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bc308f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc158c00 con 0x7f5bbc158820 2023-12-20T04:42:31.108 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bc0e2b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bbc158820 0x7f5bbc0cae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.108 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bc162c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5bbc0b17c0 0x7f5bbc0cf2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.108 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bc162c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5bbc0b17c0 0x7f5bbc0cf2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:44930/0 (socket says 172.21.15.187:44930) 2023-12-20T04:42:31.108 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bc0e2b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bbc158820 0x7f5bbc0cae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:45438/0 (socket says 172.21.15.187:45438) 2023-12-20T04:42:31.108 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bc162c640 1 -- 172.21.15.187:0/2894684841 learned_addr learned my addr 172.21.15.187:0/2894684841 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-20T04:42:31.108 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bbbfff640 1 --2- 172.21.15.187:0/2894684841 >> v2:172.21.15.132:3300/0 conn(0x7f5bbc0cb450 0x7f5bbc0b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.108 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bc0e2b640 1 -- 172.21.15.187:0/2894684841 >> v2:172.21.15.187:3300/0 conn(0x7f5bbc0b17c0 msgr2=0x7f5bbc0cf2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:31.108 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bc0e2b640 1 --2- 172.21.15.187:0/2894684841 >> v2:172.21.15.187:3300/0 conn(0x7f5bbc0b17c0 0x7f5bbc0cf2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.108 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bc0e2b640 1 -- 172.21.15.187:0/2894684841 >> v2:172.21.15.132:3300/0 conn(0x7f5bbc0cb450 msgr2=0x7f5bbc0b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:31.109 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bc0e2b640 1 --2- 172.21.15.187:0/2894684841 >> v2:172.21.15.132:3300/0 conn(0x7f5bbc0cb450 0x7f5bbc0b1280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.109 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bc0e2b640 1 -- 172.21.15.187:0/2894684841 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bbc06ffb0 con 0x7f5bbc158820 2023-12-20T04:42:31.109 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bc162c640 1 --2- 172.21.15.187:0/2894684841 >> v2:172.21.15.187:3300/0 conn(0x7f5bbc0b17c0 0x7f5bbc0cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:31.109 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.105+0000 7f5bbbfff640 1 --2- 172.21.15.187:0/2894684841 >> v2:172.21.15.132:3300/0 conn(0x7f5bbc0cb450 0x7f5bbc0b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:31.109 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.106+0000 7f5bc0e2b640 1 --2- 172.21.15.187:0/2894684841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bbc158820 0x7f5bbc0cae00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0b0fd0 tx=0x7f5bb002b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b974c6385d330141 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:31.109 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.106+0000 7f5bbb7fe640 1 -- 172.21.15.187:0/2894684841 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb002f050 con 0x7f5bbc158820 2023-12-20T04:42:31.109 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.106+0000 7f5bbb7fe640 1 -- 172.21.15.187:0/2894684841 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb0031700 con 0x7f5bbc158820 2023-12-20T04:42:31.109 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.106+0000 7f5bbb7fe640 1 -- 172.21.15.187:0/2894684841 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb0031a90 con 0x7f5bbc158820 2023-12-20T04:42:31.112 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.107+0000 7f5bc308f640 1 -- 172.21.15.187:0/2894684841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bbc158820 msgr2=0x7f5bbc0cae00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.112 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.107+0000 7f5bc308f640 1 --2- 172.21.15.187:0/2894684841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bbc158820 0x7f5bbc0cae00 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f5bbc0b0fd0 tx=0x7f5bb002b7a0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.112 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.107+0000 7f5bc308f640 1 -- 172.21.15.187:0/2894684841 shutdown_connections 2023-12-20T04:42:31.113 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.107+0000 7f5bc308f640 1 --2- 172.21.15.187:0/2894684841 >> v2:172.21.15.187:3300/0 conn(0x7f5bbc0b17c0 0x7f5bbc0cf2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.113 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.107+0000 7f5bc308f640 1 --2- 172.21.15.187:0/2894684841 >> v2:172.21.15.132:3300/0 conn(0x7f5bbc0cb450 0x7f5bbc0b1280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.113 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.107+0000 7f5bc308f640 1 --2- 172.21.15.187:0/2894684841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bbc158820 0x7f5bbc0cae00 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.113 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.107+0000 7f5bc308f640 1 -- 172.21.15.187:0/2894684841 >> 172.21.15.187:0/2894684841 conn(0x7f5bbc06bfc0 msgr2=0x7f5bbc06c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:31.113 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.107+0000 7f5bc308f640 1 -- 172.21.15.187:0/2894684841 shutdown_connections 2023-12-20T04:42:31.113 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.107+0000 7f5bc308f640 1 -- 172.21.15.187:0/2894684841 wait complete. 2023-12-20T04:42:31.113 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.108+0000 7f5bc308f640 1 Processor -- start 2023-12-20T04:42:31.113 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.108+0000 7f5bc308f640 1 -- start start 2023-12-20T04:42:31.113 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bc308f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bbc0b17c0 0x7f5bbc1566c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.113 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bc308f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5bbc0cb450 0x7f5bbc0c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.113 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bc308f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bbc158820 0x7f5bbc0c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.113 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bc308f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc15bf50 con 0x7f5bbc158820 2023-12-20T04:42:31.113 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bc308f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc1456a0 con 0x7f5bbc0cb450 2023-12-20T04:42:31.113 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bc308f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bbc157160 con 0x7f5bbc0b17c0 2023-12-20T04:42:31.114 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bc0e2b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bbc0b17c0 0x7f5bbc1566c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.114 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bbbfff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5bbc0cb450 0x7f5bbc0c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.114 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bc0e2b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bbc0b17c0 0x7f5bbc1566c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:45448/0 (socket says 172.21.15.187:45448) 2023-12-20T04:42:31.114 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bc0e2b640 1 -- 172.21.15.187:0/1390809795 learned_addr learned my addr 172.21.15.187:0/1390809795 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-20T04:42:31.114 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bc162c640 1 --2- 172.21.15.187:0/1390809795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bbc158820 0x7f5bbc0c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.114 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bc0e2b640 1 -- 172.21.15.187:0/1390809795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5bbc0cb450 msgr2=0x7f5bbc0c86c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.114 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bc0e2b640 1 --2- 172.21.15.187:0/1390809795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5bbc0cb450 0x7f5bbc0c86c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.114 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bc0e2b640 1 -- 172.21.15.187:0/1390809795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bbc158820 msgr2=0x7f5bbc0c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.114 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bc0e2b640 1 --2- 172.21.15.187:0/1390809795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bbc158820 0x7f5bbc0c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.114 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bc0e2b640 1 -- 172.21.15.187:0/1390809795 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bb4009b30 con 0x7f5bbc0b17c0 2023-12-20T04:42:31.114 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bbbfff640 1 --2- 172.21.15.187:0/1390809795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5bbc0cb450 0x7f5bbc0c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:31.114 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bc0e2b640 1 --2- 172.21.15.187:0/1390809795 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bbc0b17c0 0x7f5bbc1566c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0000c00 tx=0x7f5bb00046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:31.114 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.109+0000 7f5bb97fa640 1 -- 172.21.15.187:0/1390809795 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb00339b0 con 0x7f5bbc0b17c0 2023-12-20T04:42:31.114 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.110+0000 7f5bb97fa640 1 -- 172.21.15.187:0/1390809795 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bb0033b30 con 0x7f5bbc0b17c0 2023-12-20T04:42:31.114 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.110+0000 7f5bc308f640 1 -- 172.21.15.187:0/1390809795 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bb0009400 con 0x7f5bbc0b17c0 2023-12-20T04:42:31.115 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.110+0000 7f5bb97fa640 1 -- 172.21.15.187:0/1390809795 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bb003c400 con 0x7f5bbc0b17c0 2023-12-20T04:42:31.115 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.110+0000 7f5bc308f640 1 -- 172.21.15.187:0/1390809795 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bbc157720 con 0x7f5bbc0b17c0 2023-12-20T04:42:31.115 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.110+0000 7f5bb97fa640 1 -- 172.21.15.187:0/1390809795 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f5bb003a040 con 0x7f5bbc0b17c0 2023-12-20T04:42:31.115 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.110+0000 7f5bb97fa640 1 -- 172.21.15.187:0/1390809795 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 725+0+0 (secure 0 0 0) 0x7f5bb00485e0 con 0x7f5bbc0b17c0 2023-12-20T04:42:31.115 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.110+0000 7f5bc308f640 1 -- 172.21.15.187:0/1390809795 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bbc15b520 con 0x7f5bbc0b17c0 2023-12-20T04:42:31.115 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:31.112+0000 7fa685010040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-20T04:42:31.115 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.113+0000 7f5bb97fa640 1 -- 172.21.15.187:0/1390809795 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f5bb0043020 con 0x7f5bbc0b17c0 2023-12-20T04:42:31.126 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:31.124+0000 7f2203645040 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2023-12-20T04:42:31.165 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:31.163+0000 7fa685010040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-20T04:42:31.179 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:31.178+0000 7f2203645040 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2023-12-20T04:42:31.185 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.183+0000 7f5bc308f640 1 -- 172.21.15.187:0/1390809795 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0} v 0) v1 -- 0x7f5bbc04e840 con 0x7f5bbc0b17c0 2023-12-20T04:42:31.193 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.191+0000 7f5bb97fa640 1 -- 172.21.15.187:0/1390809795 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 0}]=0 v3) v1 ==== 112+0+2 (secure 0 0 0) 0x7f5bb0038070 con 0x7f5bbc0b17c0 2023-12-20T04:42:31.194 INFO:teuthology.orchestra.run.smithi187.stdout:0 2023-12-20T04:42:31.195 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.192+0000 7f5bc308f640 1 -- 172.21.15.187:0/1390809795 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bbc0b17c0 msgr2=0x7f5bbc1566c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.195 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.192+0000 7f5bc308f640 1 --2- 172.21.15.187:0/1390809795 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bbc0b17c0 0x7f5bbc1566c0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f5bb0000c00 tx=0x7f5bb00046c0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.195 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.192+0000 7f5bc308f640 1 -- 172.21.15.187:0/1390809795 shutdown_connections 2023-12-20T04:42:31.195 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.192+0000 7f5bc308f640 1 --2- 172.21.15.187:0/1390809795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bbc158820 0x7f5bbc0c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.195 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.192+0000 7f5bc308f640 1 --2- 172.21.15.187:0/1390809795 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5bbc0cb450 0x7f5bbc0c86c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.195 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.192+0000 7f5bc308f640 1 --2- 172.21.15.187:0/1390809795 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bbc0b17c0 0x7f5bbc1566c0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.195 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.192+0000 7f5bc308f640 1 -- 172.21.15.187:0/1390809795 >> 172.21.15.187:0/1390809795 conn(0x7f5bbc06bfc0 msgr2=0x7f5bbc0aefb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:31.195 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.192+0000 7f5bc308f640 1 -- 172.21.15.187:0/1390809795 shutdown_connections 2023-12-20T04:42:31.195 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.192+0000 7f5bc308f640 1 -- 172.21.15.187:0/1390809795 wait complete. 2023-12-20T04:42:31.204 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 1 2023-12-20T04:42:31.209 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:31.208+0000 7fa685010040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-20T04:42:31.228 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:31.227+0000 7f2203645040 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2023-12-20T04:42:31.262 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:31.260+0000 7fa685010040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-20T04:42:31.284 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:31.283+0000 7f2203645040 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2023-12-20T04:42:31.303 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:31.301+0000 7fa685010040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-20T04:42:31.304 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.302+0000 7f98050e0640 1 Processor -- start 2023-12-20T04:42:31.304 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.302+0000 7f98050e0640 1 -- start start 2023-12-20T04:42:31.305 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.303+0000 7f98050e0640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f98000cf1d0 0x7f980015e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.305 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.303+0000 7f98050e0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9800070460 0x7f98000708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.305 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.303+0000 7f98050e0640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9800070e00 con 0x7f98000c4a70 2023-12-20T04:42:31.305 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.303+0000 7f98050e0640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f980015e740 con 0x7f98000cf1d0 2023-12-20T04:42:31.305 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.303+0000 7f98050e0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98000cb6b0 con 0x7f9800070460 2023-12-20T04:42:31.306 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.303+0000 7f97f7fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9800070460 0x7f98000708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.306 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.303+0000 7f97fed9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f98000cf1d0 0x7f980015e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.306 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.303+0000 7f97fed9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f98000cf1d0 0x7f980015e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:44944/0 (socket says 172.21.15.187:44944) 2023-12-20T04:42:31.306 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.303+0000 7f97f7fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9800070460 0x7f98000708c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:45460/0 (socket says 172.21.15.187:45460) 2023-12-20T04:42:31.306 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.303+0000 7f97fed9d640 1 -- 172.21.15.187:0/3262262544 learned_addr learned my addr 172.21.15.187:0/3262262544 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-20T04:42:31.306 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.304+0000 7f97fed9d640 1 -- 172.21.15.187:0/3262262544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9800070460 msgr2=0x7f98000708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:31.306 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.304+0000 7f97fed9d640 1 --2- 172.21.15.187:0/3262262544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9800070460 0x7f98000708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.306 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.304+0000 7f97fed9d640 1 -- 172.21.15.187:0/3262262544 >> v1:172.21.15.187:6789/0 conn(0x7f98000c4a70 legacy=0x7f98000c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.306 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.304+0000 7f97fed9d640 1 -- 172.21.15.187:0/3262262544 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98000cb990 con 0x7f98000cf1d0 2023-12-20T04:42:31.306 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.304+0000 7f97f7fff640 1 --2- 172.21.15.187:0/3262262544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9800070460 0x7f98000708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:31.307 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.304+0000 7f97fed9d640 1 --2- 172.21.15.187:0/3262262544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98000cf1d0 0x7f980015e200 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009870 tx=0x7f97f002b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a5d98822418d7723 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:31.307 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.305+0000 7f97fe59c640 1 -- 172.21.15.187:0/3262262544 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f0030840 con 0x7f98000cf1d0 2023-12-20T04:42:31.308 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.305+0000 7f97fe59c640 1 -- 172.21.15.187:0/3262262544 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f00309a0 con 0x7f98000cf1d0 2023-12-20T04:42:31.308 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.305+0000 7f97fe59c640 1 -- 172.21.15.187:0/3262262544 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f0030d30 con 0x7f98000cf1d0 2023-12-20T04:42:31.308 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.305+0000 7f98050e0640 1 -- 172.21.15.187:0/3262262544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98000cf1d0 msgr2=0x7f980015e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.308 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.305+0000 7f98050e0640 1 --2- 172.21.15.187:0/3262262544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98000cf1d0 0x7f980015e200 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f97f0009870 tx=0x7f97f002b980 comp rx=0 tx=0).stop 2023-12-20T04:42:31.308 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.305+0000 7f98050e0640 1 -- 172.21.15.187:0/3262262544 shutdown_connections 2023-12-20T04:42:31.308 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.305+0000 7f98050e0640 1 --2- 172.21.15.187:0/3262262544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9800070460 0x7f98000708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.308 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.305+0000 7f98050e0640 1 --2- 172.21.15.187:0/3262262544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98000cf1d0 0x7f980015e200 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.308 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.305+0000 7f98050e0640 1 -- 172.21.15.187:0/3262262544 >> 172.21.15.187:0/3262262544 conn(0x7f98000cc630 msgr2=0x7f98000cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:31.308 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.305+0000 7f98050e0640 1 -- 172.21.15.187:0/3262262544 shutdown_connections 2023-12-20T04:42:31.308 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.305+0000 7f98050e0640 1 -- 172.21.15.187:0/3262262544 wait complete. 2023-12-20T04:42:31.313 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.307+0000 7f98050e0640 1 Processor -- start 2023-12-20T04:42:31.313 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.307+0000 7f98050e0640 1 -- start start 2023-12-20T04:42:31.313 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.307+0000 7f98050e0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9800070460 0x7f9800137ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.313 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.307+0000 7f98050e0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98000c4a70 0x7f980015b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.313 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.307+0000 7f98050e0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98000cf1d0 0x7f980015c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.314 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.307+0000 7f98050e0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9800138020 con 0x7f9800070460 2023-12-20T04:42:31.314 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.307+0000 7f98050e0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9800148220 con 0x7f98000cf1d0 2023-12-20T04:42:31.314 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.307+0000 7f98050e0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9800148500 con 0x7f98000c4a70 2023-12-20T04:42:31.314 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.307+0000 7f97f7fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98000c4a70 0x7f980015b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.314 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.307+0000 7f97f7fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98000c4a70 0x7f980015b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:45476/0 (socket says 172.21.15.187:45476) 2023-12-20T04:42:31.314 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.307+0000 7f97f7fff640 1 -- 172.21.15.187:0/2860985563 learned_addr learned my addr 172.21.15.187:0/2860985563 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-20T04:42:31.315 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.307+0000 7f97ff59e640 1 --2- 172.21.15.187:0/2860985563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98000cf1d0 0x7f980015c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.315 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.307+0000 7f97fed9d640 1 --2- 172.21.15.187:0/2860985563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9800070460 0x7f9800137ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.315 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.308+0000 7f97ff59e640 1 -- 172.21.15.187:0/2860985563 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98000c4a70 msgr2=0x7f980015b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.315 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.308+0000 7f97ff59e640 1 --2- 172.21.15.187:0/2860985563 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98000c4a70 0x7f980015b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.315 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.308+0000 7f97ff59e640 1 -- 172.21.15.187:0/2860985563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9800070460 msgr2=0x7f9800137ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.316 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.308+0000 7f97ff59e640 1 --2- 172.21.15.187:0/2860985563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9800070460 0x7f9800137ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.316 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.308+0000 7f97ff59e640 1 -- 172.21.15.187:0/2860985563 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e800b6a0 con 0x7f98000cf1d0 2023-12-20T04:42:31.316 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.308+0000 7f97fed9d640 1 --2- 172.21.15.187:0/2860985563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9800070460 0x7f9800137ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:31.316 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.308+0000 7f97f7fff640 1 --2- 172.21.15.187:0/2860985563 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98000c4a70 0x7f980015b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:31.316 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.308+0000 7f97ff59e640 1 --2- 172.21.15.187:0/2860985563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98000cf1d0 0x7f980015c9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f97f800c690 tx=0x7f97f800cb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:31.316 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.308+0000 7f97f77fe640 1 -- 172.21.15.187:0/2860985563 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8003b70 con 0x7f98000cf1d0 2023-12-20T04:42:31.317 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.308+0000 7f97f77fe640 1 -- 172.21.15.187:0/2860985563 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f8003cd0 con 0x7f98000cf1d0 2023-12-20T04:42:31.317 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.308+0000 7f98050e0640 1 -- 172.21.15.187:0/2860985563 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97f00094d0 con 0x7f98000cf1d0 2023-12-20T04:42:31.317 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.308+0000 7f97f77fe640 1 -- 172.21.15.187:0/2860985563 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8005310 con 0x7f98000cf1d0 2023-12-20T04:42:31.317 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.308+0000 7f98050e0640 1 -- 172.21.15.187:0/2860985563 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9800148ac0 con 0x7f98000cf1d0 2023-12-20T04:42:31.317 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.308+0000 7f97f77fe640 1 -- 172.21.15.187:0/2860985563 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f97f800a640 con 0x7f98000cf1d0 2023-12-20T04:42:31.317 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.308+0000 7f97f77fe640 1 -- 172.21.15.187:0/2860985563 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 840+0+0 (secure 0 0 0) 0x7f97f8012470 con 0x7f98000cf1d0 2023-12-20T04:42:31.317 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.309+0000 7f98050e0640 1 -- 172.21.15.187:0/2860985563 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9800066eb0 con 0x7f98000cf1d0 2023-12-20T04:42:31.317 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.311+0000 7f97f77fe640 1 -- 172.21.15.187:0/2860985563 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f97f800aa80 con 0x7f98000cf1d0 2023-12-20T04:42:31.329 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:31.327+0000 7f2203645040 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2023-12-20T04:42:31.384 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.382+0000 7f98050e0640 1 -- 172.21.15.187:0/2860985563 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1} v 0) v1 -- 0x7f980004e840 con 0x7f98000cf1d0 2023-12-20T04:42:31.391 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.390+0000 7f97f77fe640 1 -- 172.21.15.187:0/2860985563 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 1}]=0 v4) v1 ==== 112+0+2 (secure 0 0 0) 0x7f97f800ac20 con 0x7f98000cf1d0 2023-12-20T04:42:31.391 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-12-20T04:42:31.392 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.391+0000 7f98050e0640 1 -- 172.21.15.187:0/2860985563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98000cf1d0 msgr2=0x7f980015c9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.393 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.391+0000 7f98050e0640 1 --2- 172.21.15.187:0/2860985563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98000cf1d0 0x7f980015c9e0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f97f800c690 tx=0x7f97f800cb50 comp rx=0 tx=0).stop 2023-12-20T04:42:31.393 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.391+0000 7f98050e0640 1 -- 172.21.15.187:0/2860985563 shutdown_connections 2023-12-20T04:42:31.393 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.391+0000 7f98050e0640 1 --2- 172.21.15.187:0/2860985563 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98000cf1d0 0x7f980015c9e0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.393 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.391+0000 7f98050e0640 1 --2- 172.21.15.187:0/2860985563 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98000c4a70 0x7f980015b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.393 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.391+0000 7f98050e0640 1 --2- 172.21.15.187:0/2860985563 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9800070460 0x7f9800137ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.393 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.391+0000 7f98050e0640 1 -- 172.21.15.187:0/2860985563 >> 172.21.15.187:0/2860985563 conn(0x7f98000cc630 msgr2=0x7f98001433f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:31.393 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.391+0000 7f98050e0640 1 -- 172.21.15.187:0/2860985563 shutdown_connections 2023-12-20T04:42:31.393 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.391+0000 7f98050e0640 1 -- 172.21.15.187:0/2860985563 wait complete. 2023-12-20T04:42:31.402 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 2 2023-12-20T04:42:31.403 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:31.401+0000 7fa685010040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-20T04:42:31.434 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:31.433+0000 7f2203645040 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2023-12-20T04:42:31.471 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:31.470+0000 7fa685010040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-20T04:42:31.508 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:31.506+0000 7f2203645040 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2023-12-20T04:42:31.516 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:31.514+0000 7fa685010040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-20T04:42:31.535 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.533+0000 7f3c3afd9640 1 Processor -- start 2023-12-20T04:42:31.535 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.533+0000 7f3c3afd9640 1 -- start start 2023-12-20T04:42:31.537 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.534+0000 7f3c3afd9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3c34070460 0x7f3c340708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.537 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.534+0000 7f3c3afd9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c340cd7d0 0x7f3c340cdc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.537 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.534+0000 7f3c3afd9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c340cb6b0 con 0x7f3c340cf1d0 2023-12-20T04:42:31.537 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.534+0000 7f3c3afd9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c34070e30 con 0x7f3c34070460 2023-12-20T04:42:31.537 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.534+0000 7f3c3afd9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c340cb990 con 0x7f3c340cd7d0 2023-12-20T04:42:31.537 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.534+0000 7f3c38d75640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f3c340cf1d0 0x7f3c3415e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.187:40940/0 (socket says 172.21.15.187:40940) 2023-12-20T04:42:31.537 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.534+0000 7f3c38d75640 1 -- 172.21.15.187:0/254984082 learned_addr learned my addr 172.21.15.187:0/254984082 (peer_addr_for_me v1:172.21.15.187:0/0) 2023-12-20T04:42:31.537 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.534+0000 7f3c39576640 1 --2- 172.21.15.187:0/254984082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c340cd7d0 0x7f3c340cdc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.537 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.534+0000 7f3c33fff640 1 --2- 172.21.15.187:0/254984082 >> v2:172.21.15.132:3300/0 conn(0x7f3c34070460 0x7f3c340708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.537 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.534+0000 7f3c337fe640 1 -- 172.21.15.187:0/254984082 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1844677265 0 0) 0x7f3c340cb6b0 con 0x7f3c340cf1d0 2023-12-20T04:42:31.537 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.534+0000 7f3c337fe640 1 -- 172.21.15.187:0/254984082 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c24003520 con 0x7f3c340cf1d0 2023-12-20T04:42:31.538 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.535+0000 7f3c39576640 1 -- 172.21.15.187:0/254984082 >> v2:172.21.15.132:3300/0 conn(0x7f3c34070460 msgr2=0x7f3c340708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:31.538 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.535+0000 7f3c39576640 1 --2- 172.21.15.187:0/254984082 >> v2:172.21.15.132:3300/0 conn(0x7f3c34070460 0x7f3c340708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.538 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.535+0000 7f3c39576640 1 -- 172.21.15.187:0/254984082 >> v1:172.21.15.187:6789/0 conn(0x7f3c340cf1d0 legacy=0x7f3c3415e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.538 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.535+0000 7f3c39576640 1 -- 172.21.15.187:0/254984082 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c340cbc70 con 0x7f3c340cd7d0 2023-12-20T04:42:31.538 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.535+0000 7f3c39576640 1 --2- 172.21.15.187:0/254984082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c340cd7d0 0x7f3c340cdc00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009d90 tx=0x7f3c2c02beb0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d3b507a2d54007d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:31.538 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.535+0000 7f3c337fe640 1 -- 172.21.15.187:0/254984082 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c02cc60 con 0x7f3c340cd7d0 2023-12-20T04:42:31.538 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.535+0000 7f3c337fe640 1 -- 172.21.15.187:0/254984082 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c2c02cdc0 con 0x7f3c340cd7d0 2023-12-20T04:42:31.538 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.535+0000 7f3c337fe640 1 -- 172.21.15.187:0/254984082 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c2c034660 con 0x7f3c340cd7d0 2023-12-20T04:42:31.539 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.536+0000 7f3c3afd9640 1 -- 172.21.15.187:0/254984082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c340cd7d0 msgr2=0x7f3c340cdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.539 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.536+0000 7f3c3afd9640 1 --2- 172.21.15.187:0/254984082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c340cd7d0 0x7f3c340cdc00 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7f3c2c009d90 tx=0x7f3c2c02beb0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.539 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.536+0000 7f3c3afd9640 1 -- 172.21.15.187:0/254984082 shutdown_connections 2023-12-20T04:42:31.539 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.536+0000 7f3c3afd9640 1 --2- 172.21.15.187:0/254984082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c340cd7d0 0x7f3c340cdc00 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.539 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.536+0000 7f3c3afd9640 1 --2- 172.21.15.187:0/254984082 >> v2:172.21.15.132:3300/0 conn(0x7f3c34070460 0x7f3c340708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.539 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.536+0000 7f3c3afd9640 1 -- 172.21.15.187:0/254984082 >> 172.21.15.187:0/254984082 conn(0x7f3c340cc630 msgr2=0x7f3c340cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:31.539 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.536+0000 7f3c3afd9640 1 -- 172.21.15.187:0/254984082 shutdown_connections 2023-12-20T04:42:31.540 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.536+0000 7f3c3afd9640 1 -- 172.21.15.187:0/254984082 wait complete. 2023-12-20T04:42:31.540 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.537+0000 7f3c3afd9640 1 Processor -- start 2023-12-20T04:42:31.540 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.537+0000 7f3c3afd9640 1 -- start start 2023-12-20T04:42:31.542 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.538+0000 7f3c3afd9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c34070460 0x7f3c3413b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.542 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.538+0000 7f3c3afd9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c340cd7d0 0x7f3c341f5f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.543 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.538+0000 7f3c3afd9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c340cf1d0 0x7f3c341592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.543 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.538+0000 7f3c3afd9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3413d2e0 con 0x7f3c340cf1d0 2023-12-20T04:42:31.543 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.538+0000 7f3c3afd9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3413c240 con 0x7f3c340cd7d0 2023-12-20T04:42:31.543 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.538+0000 7f3c3afd9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3413c520 con 0x7f3c34070460 2023-12-20T04:42:31.543 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.538+0000 7f3c38d75640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c34070460 0x7f3c3413b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.543 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.538+0000 7f3c33fff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c340cd7d0 0x7f3c341f5f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.543 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.538+0000 7f3c38d75640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c34070460 0x7f3c3413b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:45494/0 (socket says 172.21.15.187:45494) 2023-12-20T04:42:31.543 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.538+0000 7f3c38d75640 1 -- 172.21.15.187:0/1885837580 learned_addr learned my addr 172.21.15.187:0/1885837580 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-20T04:42:31.543 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.538+0000 7f3c39576640 1 --2- 172.21.15.187:0/1885837580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c340cf1d0 0x7f3c341592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.543 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.539+0000 7f3c38d75640 1 -- 172.21.15.187:0/1885837580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c340cd7d0 msgr2=0x7f3c341f5f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.543 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.539+0000 7f3c38d75640 1 --2- 172.21.15.187:0/1885837580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c340cd7d0 0x7f3c341f5f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.543 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.539+0000 7f3c38d75640 1 -- 172.21.15.187:0/1885837580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c340cf1d0 msgr2=0x7f3c341592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.543 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.539+0000 7f3c38d75640 1 --2- 172.21.15.187:0/1885837580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c340cf1d0 0x7f3c341592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.543 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.539+0000 7f3c38d75640 1 -- 172.21.15.187:0/1885837580 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c2c009a70 con 0x7f3c34070460 2023-12-20T04:42:31.543 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.539+0000 7f3c33fff640 1 --2- 172.21.15.187:0/1885837580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c340cd7d0 0x7f3c341f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:31.544 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.539+0000 7f3c38d75640 1 --2- 172.21.15.187:0/1885837580 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c34070460 0x7f3c3413b8f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800c400 tx=0x7f3c2800c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:31.544 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.539+0000 7f3c317fa640 1 -- 172.21.15.187:0/1885837580 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c28005ce0 con 0x7f3c34070460 2023-12-20T04:42:31.544 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.539+0000 7f3c317fa640 1 -- 172.21.15.187:0/1885837580 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c28005e40 con 0x7f3c34070460 2023-12-20T04:42:31.544 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.539+0000 7f3c3afd9640 1 -- 172.21.15.187:0/1885837580 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c3413c800 con 0x7f3c34070460 2023-12-20T04:42:31.544 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.539+0000 7f3c317fa640 1 -- 172.21.15.187:0/1885837580 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c280072d0 con 0x7f3c34070460 2023-12-20T04:42:31.544 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.539+0000 7f3c3afd9640 1 -- 172.21.15.187:0/1885837580 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c3413cdc0 con 0x7f3c34070460 2023-12-20T04:42:31.544 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.539+0000 7f3c317fa640 1 -- 172.21.15.187:0/1885837580 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f3c2801c440 con 0x7f3c34070460 2023-12-20T04:42:31.544 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.539+0000 7f3c317fa640 1 -- 172.21.15.187:0/1885837580 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 955+0+0 (secure 0 0 0) 0x7f3c28012820 con 0x7f3c34070460 2023-12-20T04:42:31.544 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.540+0000 7f3c3afd9640 1 -- 172.21.15.187:0/1885837580 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c3404e840 con 0x7f3c34070460 2023-12-20T04:42:31.544 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.542+0000 7f3c317fa640 1 -- 172.21.15.187:0/1885837580 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f3c28021060 con 0x7f3c34070460 2023-12-20T04:42:31.556 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:31.555+0000 7f2203645040 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2023-12-20T04:42:31.567 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:31.566+0000 7fa685010040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-20T04:42:31.610 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:31.608+0000 7f2203645040 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2023-12-20T04:42:31.613 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:31.611+0000 7fa685010040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-20T04:42:31.614 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.613+0000 7f3c3afd9640 1 -- 172.21.15.187:0/1885837580 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2} v 0) v1 -- 0x7f3c340c9fe0 con 0x7f3c34070460 2023-12-20T04:42:31.622 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.621+0000 7f3c317fa640 1 -- 172.21.15.187:0/1885837580 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 2}]=0 v5) v1 ==== 112+0+2 (secure 0 0 0) 0x7f3c28017070 con 0x7f3c34070460 2023-12-20T04:42:31.623 INFO:teuthology.orchestra.run.smithi187.stdout:2 2023-12-20T04:42:31.623 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.622+0000 7f3c3afd9640 1 -- 172.21.15.187:0/1885837580 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c34070460 msgr2=0x7f3c3413b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.623 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.622+0000 7f3c3afd9640 1 --2- 172.21.15.187:0/1885837580 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c34070460 0x7f3c3413b8f0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f3c2800c400 tx=0x7f3c2800c8c0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.624 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.622+0000 7f3c3afd9640 1 -- 172.21.15.187:0/1885837580 shutdown_connections 2023-12-20T04:42:31.624 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.622+0000 7f3c3afd9640 1 --2- 172.21.15.187:0/1885837580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c340cf1d0 0x7f3c341592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.624 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.622+0000 7f3c3afd9640 1 --2- 172.21.15.187:0/1885837580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c340cd7d0 0x7f3c341f5f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.624 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.622+0000 7f3c3afd9640 1 --2- 172.21.15.187:0/1885837580 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c34070460 0x7f3c3413b8f0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.624 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.622+0000 7f3c3afd9640 1 -- 172.21.15.187:0/1885837580 >> 172.21.15.187:0/1885837580 conn(0x7f3c340cc630 msgr2=0x7f3c34069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:31.624 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.622+0000 7f3c3afd9640 1 -- 172.21.15.187:0/1885837580 shutdown_connections 2023-12-20T04:42:31.624 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.622+0000 7f3c3afd9640 1 -- 172.21.15.187:0/1885837580 wait complete. 2023-12-20T04:42:31.634 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 3 2023-12-20T04:42:31.660 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:31.659+0000 7f2203645040 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2023-12-20T04:42:31.733 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.732+0000 7f7e189d9640 1 Processor -- start 2023-12-20T04:42:31.733 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.732+0000 7f7e189d9640 1 -- start start 2023-12-20T04:42:31.734 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.732+0000 7f7e189d9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e1415aee0 0x7f7e1415eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.735 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.732+0000 7f7e189d9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7e140cb2b0 0x7f7e140cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.735 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.732+0000 7f7e189d9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e140d0130 con 0x7f7e140cdbb0 2023-12-20T04:42:31.735 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.732+0000 7f7e189d9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e140ce040 con 0x7f7e140cb2b0 2023-12-20T04:42:31.735 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.732+0000 7f7e189d9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1415f370 con 0x7f7e1415aee0 2023-12-20T04:42:31.735 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.733+0000 7f7e1259c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e1415aee0 0x7f7e1415eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.735 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.733+0000 7f7e11d9b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7e140cb2b0 0x7f7e140cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.735 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.733+0000 7f7e1259c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e1415aee0 0x7f7e1415eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:45506/0 (socket says 172.21.15.187:45506) 2023-12-20T04:42:31.735 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.733+0000 7f7e1259c640 1 -- 172.21.15.187:0/3456045689 learned_addr learned my addr 172.21.15.187:0/3456045689 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-20T04:42:31.735 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.733+0000 7f7e1259c640 1 -- 172.21.15.187:0/3456045689 >> v2:172.21.15.187:3300/0 conn(0x7f7e140cb2b0 msgr2=0x7f7e140cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:31.735 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.733+0000 7f7e1259c640 1 --2- 172.21.15.187:0/3456045689 >> v2:172.21.15.187:3300/0 conn(0x7f7e140cb2b0 0x7f7e140cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.735 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.733+0000 7f7e1259c640 1 -- 172.21.15.187:0/3456045689 >> v1:172.21.15.132:6789/0 conn(0x7f7e140cdbb0 legacy=0x7f7e140ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.735 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.733+0000 7f7e1259c640 1 -- 172.21.15.187:0/3456045689 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e1415f650 con 0x7f7e1415aee0 2023-12-20T04:42:31.735 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.733+0000 7f7e11d9b640 1 --2- 172.21.15.187:0/3456045689 >> v2:172.21.15.187:3300/0 conn(0x7f7e140cb2b0 0x7f7e140cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:31.736 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.734+0000 7f7e1259c640 1 --2- 172.21.15.187:0/3456045689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e1415aee0 0x7f7e1415eb40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009870 tx=0x7f7e0402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8e922155fd4f02a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:31.737 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.734+0000 7f7e1159a640 1 -- 172.21.15.187:0/3456045689 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04030840 con 0x7f7e1415aee0 2023-12-20T04:42:31.737 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.734+0000 7f7e1159a640 1 -- 172.21.15.187:0/3456045689 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e040309a0 con 0x7f7e1415aee0 2023-12-20T04:42:31.737 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.734+0000 7f7e1159a640 1 -- 172.21.15.187:0/3456045689 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e04030d30 con 0x7f7e1415aee0 2023-12-20T04:42:31.737 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.734+0000 7f7e189d9640 1 -- 172.21.15.187:0/3456045689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e1415aee0 msgr2=0x7f7e1415eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.737 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.734+0000 7f7e189d9640 1 --2- 172.21.15.187:0/3456045689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e1415aee0 0x7f7e1415eb40 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f7e04009870 tx=0x7f7e0402b980 comp rx=0 tx=0).stop 2023-12-20T04:42:31.737 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.734+0000 7f7e189d9640 1 -- 172.21.15.187:0/3456045689 shutdown_connections 2023-12-20T04:42:31.737 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.734+0000 7f7e189d9640 1 --2- 172.21.15.187:0/3456045689 >> v2:172.21.15.187:3300/0 conn(0x7f7e140cb2b0 0x7f7e140cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.737 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.734+0000 7f7e189d9640 1 --2- 172.21.15.187:0/3456045689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e1415aee0 0x7f7e1415eb40 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.737 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.734+0000 7f7e189d9640 1 -- 172.21.15.187:0/3456045689 >> 172.21.15.187:0/3456045689 conn(0x7f7e14072c60 msgr2=0x7f7e14073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:31.737 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.735+0000 7f7e189d9640 1 -- 172.21.15.187:0/3456045689 shutdown_connections 2023-12-20T04:42:31.737 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.735+0000 7f7e189d9640 1 -- 172.21.15.187:0/3456045689 wait complete. 2023-12-20T04:42:31.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.736+0000 7f7e189d9640 1 Processor -- start 2023-12-20T04:42:31.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.736+0000 7f7e189d9640 1 -- start start 2023-12-20T04:42:31.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e189d9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e140cb2b0 0x7f7e140b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e189d9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e140cdbb0 0x7f7e1415e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e189d9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e1415aee0 0x7f7e140d0b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e189d9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e140caa10 con 0x7f7e140cdbb0 2023-12-20T04:42:31.740 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e189d9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e14149930 con 0x7f7e1415aee0 2023-12-20T04:42:31.741 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e189d9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e1414c860 con 0x7f7e140cb2b0 2023-12-20T04:42:31.741 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e1259c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e140cb2b0 0x7f7e140b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.741 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e1259c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e140cb2b0 0x7f7e140b2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:45510/0 (socket says 172.21.15.187:45510) 2023-12-20T04:42:31.741 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e1259c640 1 -- 172.21.15.187:0/1721309894 learned_addr learned my addr 172.21.15.187:0/1721309894 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-20T04:42:31.741 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e12d9d640 1 --2- 172.21.15.187:0/1721309894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e1415aee0 0x7f7e140d0b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.741 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e11d9b640 1 --2- 172.21.15.187:0/1721309894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e140cdbb0 0x7f7e1415e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.741 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e12d9d640 1 -- 172.21.15.187:0/1721309894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e140cb2b0 msgr2=0x7f7e140b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.741 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e12d9d640 1 --2- 172.21.15.187:0/1721309894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e140cb2b0 0x7f7e140b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.741 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e12d9d640 1 -- 172.21.15.187:0/1721309894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e140cdbb0 msgr2=0x7f7e1415e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.741 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e12d9d640 1 --2- 172.21.15.187:0/1721309894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e140cdbb0 0x7f7e1415e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.741 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e12d9d640 1 -- 172.21.15.187:0/1721309894 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e08009400 con 0x7f7e1415aee0 2023-12-20T04:42:31.741 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e1259c640 1 --2- 172.21.15.187:0/1721309894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e140cb2b0 0x7f7e140b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:31.741 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e12d9d640 1 --2- 172.21.15.187:0/1721309894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e1415aee0 0x7f7e140d0b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00c700 tx=0x7f7e0c00cbc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:31.742 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e02ffd640 1 -- 172.21.15.187:0/1721309894 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c003b70 con 0x7f7e1415aee0 2023-12-20T04:42:31.742 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e02ffd640 1 -- 172.21.15.187:0/1721309894 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e0c003cd0 con 0x7f7e1415aee0 2023-12-20T04:42:31.742 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e189d9640 1 -- 172.21.15.187:0/1721309894 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e040094d0 con 0x7f7e1415aee0 2023-12-20T04:42:31.742 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e02ffd640 1 -- 172.21.15.187:0/1721309894 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e0c005310 con 0x7f7e1415aee0 2023-12-20T04:42:31.742 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e189d9640 1 -- 172.21.15.187:0/1721309894 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e1415d8c0 con 0x7f7e1415aee0 2023-12-20T04:42:31.742 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.737+0000 7f7e02ffd640 1 -- 172.21.15.187:0/1721309894 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7e0c00a640 con 0x7f7e1415aee0 2023-12-20T04:42:31.742 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.738+0000 7f7e02ffd640 1 -- 172.21.15.187:0/1721309894 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1070+0+0 (secure 0 0 0) 0x7f7e0c0128b0 con 0x7f7e1415aee0 2023-12-20T04:42:31.742 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.738+0000 7f7e189d9640 1 -- 172.21.15.187:0/1721309894 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e1415d440 con 0x7f7e1415aee0 2023-12-20T04:42:31.743 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.742+0000 7f7e02ffd640 1 -- 172.21.15.187:0/1721309894 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f7e1415d440 con 0x7f7e1415aee0 2023-12-20T04:42:31.815 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.814+0000 7f7e189d9640 1 -- 172.21.15.187:0/1721309894 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3} v 0) v1 -- 0x7f7e1404e840 con 0x7f7e1415aee0 2023-12-20T04:42:31.823 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.822+0000 7f7e02ffd640 1 -- 172.21.15.187:0/1721309894 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 3}]=0 v6) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7e0c012420 con 0x7f7e1415aee0 2023-12-20T04:42:31.824 INFO:teuthology.orchestra.run.smithi187.stdout:3 2023-12-20T04:42:31.824 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.823+0000 7f7e189d9640 1 -- 172.21.15.187:0/1721309894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e1415aee0 msgr2=0x7f7e140d0b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.825 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.823+0000 7f7e189d9640 1 --2- 172.21.15.187:0/1721309894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e1415aee0 0x7f7e140d0b80 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7e0c00c700 tx=0x7f7e0c00cbc0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.825 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.823+0000 7f7e189d9640 1 -- 172.21.15.187:0/1721309894 shutdown_connections 2023-12-20T04:42:31.825 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.823+0000 7f7e189d9640 1 --2- 172.21.15.187:0/1721309894 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e1415aee0 0x7f7e140d0b80 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.825 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.823+0000 7f7e189d9640 1 --2- 172.21.15.187:0/1721309894 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e140cdbb0 0x7f7e1415e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.825 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.823+0000 7f7e189d9640 1 --2- 172.21.15.187:0/1721309894 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e140cb2b0 0x7f7e140b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.825 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.823+0000 7f7e189d9640 1 -- 172.21.15.187:0/1721309894 >> 172.21.15.187:0/1721309894 conn(0x7f7e14072c60 msgr2=0x7f7e140ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:31.825 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.823+0000 7f7e189d9640 1 -- 172.21.15.187:0/1721309894 shutdown_connections 2023-12-20T04:42:31.825 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.823+0000 7f7e189d9640 1 -- 172.21.15.187:0/1721309894 wait complete. 2023-12-20T04:42:31.835 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 4 2023-12-20T04:42:31.975 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.974+0000 7f7eb3169640 1 Processor -- start 2023-12-20T04:42:31.975 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.974+0000 7f7eb3169640 1 -- start start 2023-12-20T04:42:31.977 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.974+0000 7f7eb3169640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eac15aee0 0x7f7eac15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.977 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.974+0000 7f7eb3169640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7eac0cb2b0 0x7f7eac0cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.977 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.974+0000 7f7eb3169640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eac0d0130 con 0x7f7eac0cdbb0 2023-12-20T04:42:31.977 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.974+0000 7f7eb3169640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7eac0ce040 con 0x7f7eac0cb2b0 2023-12-20T04:42:31.977 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.974+0000 7f7eb3169640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac15f370 con 0x7f7eac15aee0 2023-12-20T04:42:31.977 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.975+0000 7f7eb0f05640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eac15aee0 0x7f7eac15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.977 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.975+0000 7f7eabfff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7eac0cb2b0 0x7f7eac0cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.977 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.975+0000 7f7eb0f05640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eac15aee0 0x7f7eac15eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:45512/0 (socket says 172.21.15.187:45512) 2023-12-20T04:42:31.977 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.975+0000 7f7eb0f05640 1 -- 172.21.15.187:0/834347062 learned_addr learned my addr 172.21.15.187:0/834347062 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-20T04:42:31.977 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.975+0000 7f7eb0f05640 1 -- 172.21.15.187:0/834347062 >> v2:172.21.15.187:3300/0 conn(0x7f7eac0cb2b0 msgr2=0x7f7eac0cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:31.977 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.975+0000 7f7eb0f05640 1 --2- 172.21.15.187:0/834347062 >> v2:172.21.15.187:3300/0 conn(0x7f7eac0cb2b0 0x7f7eac0cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.978 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.975+0000 7f7eb0f05640 1 -- 172.21.15.187:0/834347062 >> v1:172.21.15.187:6789/0 conn(0x7f7eac0cdbb0 legacy=0x7f7eac0ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.978 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.975+0000 7f7eb0f05640 1 -- 172.21.15.187:0/834347062 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eac15f650 con 0x7f7eac15aee0 2023-12-20T04:42:31.978 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.975+0000 7f7eabfff640 1 --2- 172.21.15.187:0/834347062 >> v2:172.21.15.187:3300/0 conn(0x7f7eac0cb2b0 0x7f7eac0cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:31.979 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.976+0000 7f7eb0f05640 1 --2- 172.21.15.187:0/834347062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eac15aee0 0x7f7eac15eb40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009870 tx=0x7f7ea002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b405dbfe09475745 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:31.979 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.976+0000 7f7eab7fe640 1 -- 172.21.15.187:0/834347062 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0030840 con 0x7f7eac15aee0 2023-12-20T04:42:31.979 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.976+0000 7f7eab7fe640 1 -- 172.21.15.187:0/834347062 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea00309a0 con 0x7f7eac15aee0 2023-12-20T04:42:31.979 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.976+0000 7f7eab7fe640 1 -- 172.21.15.187:0/834347062 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea0030d30 con 0x7f7eac15aee0 2023-12-20T04:42:31.979 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.976+0000 7f7eb3169640 1 -- 172.21.15.187:0/834347062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eac15aee0 msgr2=0x7f7eac15eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.979 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.976+0000 7f7eb3169640 1 --2- 172.21.15.187:0/834347062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eac15aee0 0x7f7eac15eb40 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f7ea0009870 tx=0x7f7ea002b980 comp rx=0 tx=0).stop 2023-12-20T04:42:31.979 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.976+0000 7f7eb3169640 1 -- 172.21.15.187:0/834347062 shutdown_connections 2023-12-20T04:42:31.980 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.976+0000 7f7eb3169640 1 --2- 172.21.15.187:0/834347062 >> v2:172.21.15.187:3300/0 conn(0x7f7eac0cb2b0 0x7f7eac0cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.980 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.976+0000 7f7eb3169640 1 --2- 172.21.15.187:0/834347062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eac15aee0 0x7f7eac15eb40 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.980 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.976+0000 7f7eb3169640 1 -- 172.21.15.187:0/834347062 >> 172.21.15.187:0/834347062 conn(0x7f7eac072c60 msgr2=0x7f7eac073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:31.980 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.976+0000 7f7eb3169640 1 -- 172.21.15.187:0/834347062 shutdown_connections 2023-12-20T04:42:31.980 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.977+0000 7f7eb3169640 1 -- 172.21.15.187:0/834347062 wait complete. 2023-12-20T04:42:31.980 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.978+0000 7f7eb3169640 1 Processor -- start 2023-12-20T04:42:31.980 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.978+0000 7f7eb3169640 1 -- start start 2023-12-20T04:42:31.982 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.978+0000 7f7eb3169640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7eac0cb2b0 0x7f7eac0ca720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.982 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.978+0000 7f7eb3169640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eac0cdbb0 0x7f7eac0c98c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.982 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.978+0000 7f7eb3169640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eac15aee0 0x7f7eac1f0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:31.983 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.978+0000 7f7eb3169640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac0c9e00 con 0x7f7eac0cdbb0 2023-12-20T04:42:31.983 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.978+0000 7f7eb3169640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac15b2c0 con 0x7f7eac0cb2b0 2023-12-20T04:42:31.983 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7eb3169640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eac15b5a0 con 0x7f7eac15aee0 2023-12-20T04:42:31.983 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7eb0f05640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7eac0cb2b0 0x7f7eac0ca720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.983 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7eb1706640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eac15aee0 0x7f7eac1f0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.983 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7eb0f05640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7eac0cb2b0 0x7f7eac0ca720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:44994/0 (socket says 172.21.15.187:44994) 2023-12-20T04:42:31.983 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7eb0f05640 1 -- 172.21.15.187:0/2204423871 learned_addr learned my addr 172.21.15.187:0/2204423871 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-20T04:42:31.983 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7eabfff640 1 --2- 172.21.15.187:0/2204423871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eac0cdbb0 0x7f7eac0c98c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:31.983 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7eb1706640 1 -- 172.21.15.187:0/2204423871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7eac0cb2b0 msgr2=0x7f7eac0ca720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.983 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7eb1706640 1 --2- 172.21.15.187:0/2204423871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7eac0cb2b0 0x7f7eac0ca720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.983 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7eb1706640 1 -- 172.21.15.187:0/2204423871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eac0cdbb0 msgr2=0x7f7eac0c98c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:31.983 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7eb1706640 1 --2- 172.21.15.187:0/2204423871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eac0cdbb0 0x7f7eac0c98c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:31.983 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7eb1706640 1 -- 172.21.15.187:0/2204423871 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e98009400 con 0x7f7eac15aee0 2023-12-20T04:42:31.983 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7eb0f05640 1 --2- 172.21.15.187:0/2204423871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7eac0cb2b0 0x7f7eac0ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:31.983 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7eb1706640 1 --2- 172.21.15.187:0/2204423871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eac15aee0 0x7f7eac1f0110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4001db0 tx=0x7f7ea4010420 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:31.984 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7ea97fa640 1 -- 172.21.15.187:0/2204423871 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4013070 con 0x7f7eac15aee0 2023-12-20T04:42:31.984 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7ea97fa640 1 -- 172.21.15.187:0/2204423871 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea400e2e0 con 0x7f7eac15aee0 2023-12-20T04:42:31.984 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7eb3169640 1 -- 172.21.15.187:0/2204423871 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ea00094d0 con 0x7f7eac15aee0 2023-12-20T04:42:31.984 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7ea97fa640 1 -- 172.21.15.187:0/2204423871 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea40020c0 con 0x7f7eac15aee0 2023-12-20T04:42:31.984 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7eb3169640 1 -- 172.21.15.187:0/2204423871 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eac15bb60 con 0x7f7eac15aee0 2023-12-20T04:42:31.984 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7ea97fa640 1 -- 172.21.15.187:0/2204423871 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f7ea4003970 con 0x7f7eac15aee0 2023-12-20T04:42:31.984 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.979+0000 7f7ea97fa640 1 -- 172.21.15.187:0/2204423871 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(6..6 src has 1..6) v4 ==== 1185+0+0 (secure 0 0 0) 0x7f7ea4005580 con 0x7f7eac15aee0 2023-12-20T04:42:31.984 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.980+0000 7f7eb3169640 1 -- 172.21.15.187:0/2204423871 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eac04e840 con 0x7f7eac15aee0 2023-12-20T04:42:31.984 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:31.982+0000 7f7ea97fa640 1 -- 172.21.15.187:0/2204423871 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f7ea4010e30 con 0x7f7eac15aee0 2023-12-20T04:42:31.989 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:31.988+0000 7fa685010040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-20T04:42:32.056 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.054+0000 7f7eb3169640 1 -- 172.21.15.187:0/2204423871 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4} v 0) v1 -- 0x7f7eac0b2890 con 0x7f7eac15aee0 2023-12-20T04:42:32.061 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:32.059+0000 7f2203645040 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2023-12-20T04:42:32.064 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.062+0000 7f7ea97fa640 1 -- 172.21.15.187:0/2204423871 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 4}]=0 v7) v1 ==== 112+0+2 (secure 0 0 0) 0x7f7ea4003e00 con 0x7f7eac15aee0 2023-12-20T04:42:32.064 INFO:teuthology.orchestra.run.smithi187.stdout:4 2023-12-20T04:42:32.065 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.063+0000 7f7eb3169640 1 -- 172.21.15.187:0/2204423871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eac15aee0 msgr2=0x7f7eac1f0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.065 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.063+0000 7f7eb3169640 1 --2- 172.21.15.187:0/2204423871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eac15aee0 0x7f7eac1f0110 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f7ea4001db0 tx=0x7f7ea4010420 comp rx=0 tx=0).stop 2023-12-20T04:42:32.065 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.063+0000 7f7eb3169640 1 -- 172.21.15.187:0/2204423871 shutdown_connections 2023-12-20T04:42:32.065 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.063+0000 7f7eb3169640 1 --2- 172.21.15.187:0/2204423871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eac15aee0 0x7f7eac1f0110 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.065 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.063+0000 7f7eb3169640 1 --2- 172.21.15.187:0/2204423871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7eac0cdbb0 0x7f7eac0c98c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.065 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.063+0000 7f7eb3169640 1 --2- 172.21.15.187:0/2204423871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7eac0cb2b0 0x7f7eac0ca720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.065 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.063+0000 7f7eb3169640 1 -- 172.21.15.187:0/2204423871 >> 172.21.15.187:0/2204423871 conn(0x7f7eac072c60 msgr2=0x7f7eac0ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:32.065 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.063+0000 7f7eb3169640 1 -- 172.21.15.187:0/2204423871 shutdown_connections 2023-12-20T04:42:32.066 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.063+0000 7f7eb3169640 1 -- 172.21.15.187:0/2204423871 wait complete. 2023-12-20T04:42:32.076 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 5 2023-12-20T04:42:32.124 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:32.122+0000 7fa685010040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-20T04:42:32.175 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.174+0000 7ffaa0599640 1 Processor -- start 2023-12-20T04:42:32.176 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.174+0000 7ffaa0599640 1 -- start start 2023-12-20T04:42:32.177 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.175+0000 7ffaa0599640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffa980cf1d0 0x7ffa9815e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.177 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.175+0000 7ffaa0599640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ffa980ce7e0 0x7ffa980708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.177 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.175+0000 7ffaa0599640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffa9815e740 con 0x7ffa98070460 2023-12-20T04:42:32.177 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.175+0000 7ffaa0599640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa98070e30 con 0x7ffa980cf1d0 2023-12-20T04:42:32.177 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.175+0000 7ffaa0599640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffa980cb6b0 con 0x7ffa980ce7e0 2023-12-20T04:42:32.177 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.175+0000 7ffa9eb36640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ffa980ce7e0 0x7ffa980708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.177 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.175+0000 7ffa9eb36640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ffa980ce7e0 0x7ffa980708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:45002/0 (socket says 172.21.15.187:45002) 2023-12-20T04:42:32.177 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.175+0000 7ffa9eb36640 1 -- 172.21.15.187:0/2165626953 learned_addr learned my addr 172.21.15.187:0/2165626953 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-20T04:42:32.177 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.175+0000 7ffa9e335640 1 --2- 172.21.15.187:0/2165626953 >> v2:172.21.15.132:3300/0 conn(0x7ffa980cf1d0 0x7ffa9815e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.178 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.175+0000 7ffa9eb36640 1 -- 172.21.15.187:0/2165626953 >> v2:172.21.15.132:3300/0 conn(0x7ffa980cf1d0 msgr2=0x7ffa9815e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:32.178 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.175+0000 7ffa9eb36640 1 --2- 172.21.15.187:0/2165626953 >> v2:172.21.15.132:3300/0 conn(0x7ffa980cf1d0 0x7ffa9815e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.178 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.175+0000 7ffa9eb36640 1 -- 172.21.15.187:0/2165626953 >> v1:172.21.15.132:6789/0 conn(0x7ffa98070460 legacy=0x7ffa980c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.178 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.175+0000 7ffa9eb36640 1 -- 172.21.15.187:0/2165626953 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa980cb990 con 0x7ffa980ce7e0 2023-12-20T04:42:32.179 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.176+0000 7ffa9eb36640 1 --2- 172.21.15.187:0/2165626953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa980ce7e0 0x7ffa980708f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffa980cd6a0 tx=0x7ffa9002e180 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e6ac97627f5ee8b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:32.179 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.176+0000 7ffa9d333640 1 -- 172.21.15.187:0/2165626953 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa9000b0d0 con 0x7ffa980ce7e0 2023-12-20T04:42:32.179 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.176+0000 7ffa9d333640 1 -- 172.21.15.187:0/2165626953 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa9000b230 con 0x7ffa980ce7e0 2023-12-20T04:42:32.179 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.176+0000 7ffa9d333640 1 -- 172.21.15.187:0/2165626953 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90009600 con 0x7ffa980ce7e0 2023-12-20T04:42:32.179 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.177+0000 7ffaa0599640 1 -- 172.21.15.187:0/2165626953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa980ce7e0 msgr2=0x7ffa980708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.180 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.177+0000 7ffaa0599640 1 --2- 172.21.15.187:0/2165626953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa980ce7e0 0x7ffa980708f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7ffa980cd6a0 tx=0x7ffa9002e180 comp rx=0 tx=0).stop 2023-12-20T04:42:32.180 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.177+0000 7ffaa0599640 1 -- 172.21.15.187:0/2165626953 shutdown_connections 2023-12-20T04:42:32.180 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.177+0000 7ffaa0599640 1 --2- 172.21.15.187:0/2165626953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa980ce7e0 0x7ffa980708f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.180 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.177+0000 7ffaa0599640 1 --2- 172.21.15.187:0/2165626953 >> v2:172.21.15.132:3300/0 conn(0x7ffa980cf1d0 0x7ffa9815e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.180 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.177+0000 7ffaa0599640 1 -- 172.21.15.187:0/2165626953 >> 172.21.15.187:0/2165626953 conn(0x7ffa980cc630 msgr2=0x7ffa980cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:32.180 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.177+0000 7ffaa0599640 1 -- 172.21.15.187:0/2165626953 shutdown_connections 2023-12-20T04:42:32.180 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.177+0000 7ffaa0599640 1 -- 172.21.15.187:0/2165626953 wait complete. 2023-12-20T04:42:32.180 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.178+0000 7ffaa0599640 1 Processor -- start 2023-12-20T04:42:32.180 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.178+0000 7ffaa0599640 1 -- start start 2023-12-20T04:42:32.182 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffaa0599640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa98070460 0x7ffa980cd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.182 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffaa0599640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa980ce7e0 0x7ffa980cdc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.182 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffaa0599640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa980cf1d0 0x7ffa980b2950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.182 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffaa0599640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9815c330 con 0x7ffa980ce7e0 2023-12-20T04:42:32.182 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffaa0599640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9815b6b0 con 0x7ffa980cf1d0 2023-12-20T04:42:32.183 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffaa0599640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffa9815b990 con 0x7ffa98070460 2023-12-20T04:42:32.183 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffa9eb36640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa980cf1d0 0x7ffa980b2950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.183 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffa9eb36640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa980cf1d0 0x7ffa980b2950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:45010/0 (socket says 172.21.15.187:45010) 2023-12-20T04:42:32.183 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffa9e335640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa98070460 0x7ffa980cd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.183 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffa9eb36640 1 -- 172.21.15.187:0/2811049901 learned_addr learned my addr 172.21.15.187:0/2811049901 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-20T04:42:32.183 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffa9db34640 1 --2- 172.21.15.187:0/2811049901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa980ce7e0 0x7ffa980cdc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.183 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffa9eb36640 1 -- 172.21.15.187:0/2811049901 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa98070460 msgr2=0x7ffa980cd6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.183 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffa9eb36640 1 --2- 172.21.15.187:0/2811049901 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa98070460 0x7ffa980cd6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.183 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffa9eb36640 1 -- 172.21.15.187:0/2811049901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa980ce7e0 msgr2=0x7ffa980cdc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.183 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffa9eb36640 1 --2- 172.21.15.187:0/2811049901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa980ce7e0 0x7ffa980cdc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.183 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffa9eb36640 1 -- 172.21.15.187:0/2811049901 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa9000bd40 con 0x7ffa980cf1d0 2023-12-20T04:42:32.183 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffa9eb36640 1 --2- 172.21.15.187:0/2811049901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa980cf1d0 0x7ffa980b2950 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffa90038040 tx=0x7ffa90004a40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:32.183 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffa8effd640 1 -- 172.21.15.187:0/2811049901 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90036800 con 0x7ffa980cf1d0 2023-12-20T04:42:32.183 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffa8effd640 1 -- 172.21.15.187:0/2811049901 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffa90036980 con 0x7ffa980cf1d0 2023-12-20T04:42:32.184 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffaa0599640 1 -- 172.21.15.187:0/2811049901 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa9815bc70 con 0x7ffa980cf1d0 2023-12-20T04:42:32.184 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.179+0000 7ffa8effd640 1 -- 172.21.15.187:0/2811049901 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffa90036d30 con 0x7ffa980cf1d0 2023-12-20T04:42:32.184 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.180+0000 7ffaa0599640 1 -- 172.21.15.187:0/2811049901 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa9815b2d0 con 0x7ffa980cf1d0 2023-12-20T04:42:32.184 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.180+0000 7ffa8effd640 1 -- 172.21.15.187:0/2811049901 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7ffa9004a460 con 0x7ffa980cf1d0 2023-12-20T04:42:32.184 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.180+0000 7ffa8effd640 1 -- 172.21.15.187:0/2811049901 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(7..7 src has 1..7) v4 ==== 1300+0+0 (secure 0 0 0) 0x7ffa90009e30 con 0x7ffa980cf1d0 2023-12-20T04:42:32.184 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.180+0000 7ffaa0599640 1 -- 172.21.15.187:0/2811049901 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa9815c470 con 0x7ffa980cf1d0 2023-12-20T04:42:32.184 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.182+0000 7ffa8effd640 1 -- 172.21.15.187:0/2811049901 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7ffa9815c470 con 0x7ffa980cf1d0 2023-12-20T04:42:32.203 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:32.201+0000 7f2203645040 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2023-12-20T04:42:32.247 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:32.246+0000 7fa685010040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-20T04:42:32.255 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.254+0000 7ffaa0599640 1 -- 172.21.15.187:0/2811049901 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5} v 0) v1 -- 0x7ffa98066eb0 con 0x7ffa980cf1d0 2023-12-20T04:42:32.259 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.258+0000 7ffa8effd640 1 -- 172.21.15.187:0/2811049901 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 5}]=0 v8) v1 ==== 112+0+2 (secure 0 0 0) 0x7ffa90009440 con 0x7ffa980cf1d0 2023-12-20T04:42:32.259 INFO:teuthology.orchestra.run.smithi187.stdout:5 2023-12-20T04:42:32.260 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.259+0000 7ffaa0599640 1 -- 172.21.15.187:0/2811049901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa980cf1d0 msgr2=0x7ffa980b2950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.260 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.259+0000 7ffaa0599640 1 --2- 172.21.15.187:0/2811049901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa980cf1d0 0x7ffa980b2950 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7ffa90038040 tx=0x7ffa90004a40 comp rx=0 tx=0).stop 2023-12-20T04:42:32.261 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.259+0000 7ffaa0599640 1 -- 172.21.15.187:0/2811049901 shutdown_connections 2023-12-20T04:42:32.261 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.259+0000 7ffaa0599640 1 --2- 172.21.15.187:0/2811049901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffa980cf1d0 0x7ffa980b2950 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.261 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.259+0000 7ffaa0599640 1 --2- 172.21.15.187:0/2811049901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffa980ce7e0 0x7ffa980cdc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.261 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.259+0000 7ffaa0599640 1 --2- 172.21.15.187:0/2811049901 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffa98070460 0x7ffa980cd6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.261 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.259+0000 7ffaa0599640 1 -- 172.21.15.187:0/2811049901 >> 172.21.15.187:0/2811049901 conn(0x7ffa980cc630 msgr2=0x7ffa98140e00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:32.261 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.259+0000 7ffaa0599640 1 -- 172.21.15.187:0/2811049901 shutdown_connections 2023-12-20T04:42:32.261 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.259+0000 7ffaa0599640 1 -- 172.21.15.187:0/2811049901 wait complete. 2023-12-20T04:42:32.270 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 6 2023-12-20T04:42:32.293 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:32.291+0000 7fa685010040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-20T04:42:32.323 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:32.321+0000 7f2203645040 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2023-12-20T04:42:32.370 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:32.368+0000 7f2203645040 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2023-12-20T04:42:32.371 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.369+0000 7fd116eee640 1 Processor -- start 2023-12-20T04:42:32.371 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.369+0000 7fd116eee640 1 -- start start 2023-12-20T04:42:32.373 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.370+0000 7fd116eee640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd1100cf1d0 0x7fd11015e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.373 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.370+0000 7fd116eee640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd110070460 0x7fd1100708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.373 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.370+0000 7fd116eee640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd110070e00 con 0x7fd1100c4a70 2023-12-20T04:42:32.373 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.370+0000 7fd116eee640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd11015e740 con 0x7fd1100cf1d0 2023-12-20T04:42:32.373 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.370+0000 7fd116eee640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1100cb6b0 con 0x7fd110070460 2023-12-20T04:42:32.373 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.370+0000 7fd10ffff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd110070460 0x7fd1100708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.373 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.370+0000 7fd114c8a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd1100cf1d0 0x7fd11015e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.374 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.370+0000 7fd10ffff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd110070460 0x7fd1100708c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:45550/0 (socket says 172.21.15.187:45550) 2023-12-20T04:42:32.374 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.370+0000 7fd114c8a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd1100cf1d0 0x7fd11015e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:45024/0 (socket says 172.21.15.187:45024) 2023-12-20T04:42:32.374 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.370+0000 7fd10ffff640 1 -- 172.21.15.187:0/1541329100 learned_addr learned my addr 172.21.15.187:0/1541329100 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-20T04:42:32.374 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.371+0000 7fd114c8a640 1 -- 172.21.15.187:0/1541329100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd110070460 msgr2=0x7fd1100708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:32.374 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.371+0000 7fd114c8a640 1 --2- 172.21.15.187:0/1541329100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd110070460 0x7fd1100708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.374 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.371+0000 7fd114c8a640 1 -- 172.21.15.187:0/1541329100 >> v1:172.21.15.187:6789/0 conn(0x7fd1100c4a70 legacy=0x7fd1100c4e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.374 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.371+0000 7fd114c8a640 1 -- 172.21.15.187:0/1541329100 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1100cb990 con 0x7fd1100cf1d0 2023-12-20T04:42:32.374 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.371+0000 7fd10ffff640 1 --2- 172.21.15.187:0/1541329100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd110070460 0x7fd1100708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:32.374 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.371+0000 7fd114c8a640 1 --2- 172.21.15.187:0/1541329100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1100cf1d0 0x7fd11015e200 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd1040097a0 tx=0x7fd10402b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=779c3300014180ef server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:32.374 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.372+0000 7fd10f7fe640 1 -- 172.21.15.187:0/1541329100 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd10402d040 con 0x7fd1100cf1d0 2023-12-20T04:42:32.374 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.372+0000 7fd10f7fe640 1 -- 172.21.15.187:0/1541329100 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd104031810 con 0x7fd1100cf1d0 2023-12-20T04:42:32.374 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.372+0000 7fd10f7fe640 1 -- 172.21.15.187:0/1541329100 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd104031ba0 con 0x7fd1100cf1d0 2023-12-20T04:42:32.378 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.372+0000 7fd116eee640 1 -- 172.21.15.187:0/1541329100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1100cf1d0 msgr2=0x7fd11015e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.378 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.372+0000 7fd116eee640 1 --2- 172.21.15.187:0/1541329100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1100cf1d0 0x7fd11015e200 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7fd1040097a0 tx=0x7fd10402b8b0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.378 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.372+0000 7fd116eee640 1 -- 172.21.15.187:0/1541329100 shutdown_connections 2023-12-20T04:42:32.378 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.372+0000 7fd116eee640 1 --2- 172.21.15.187:0/1541329100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd110070460 0x7fd1100708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.378 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.372+0000 7fd116eee640 1 --2- 172.21.15.187:0/1541329100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1100cf1d0 0x7fd11015e200 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.378 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.372+0000 7fd116eee640 1 -- 172.21.15.187:0/1541329100 >> 172.21.15.187:0/1541329100 conn(0x7fd1100cc630 msgr2=0x7fd1100cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:32.378 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.372+0000 7fd116eee640 1 -- 172.21.15.187:0/1541329100 shutdown_connections 2023-12-20T04:42:32.378 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.372+0000 7fd116eee640 1 -- 172.21.15.187:0/1541329100 wait complete. 2023-12-20T04:42:32.378 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.373+0000 7fd116eee640 1 Processor -- start 2023-12-20T04:42:32.378 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.373+0000 7fd116eee640 1 -- start start 2023-12-20T04:42:32.379 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.374+0000 7fd116eee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd110070460 0x7fd1101594b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.379 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.374+0000 7fd116eee640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1100c4a70 0x7fd1100c7850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.379 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.374+0000 7fd116eee640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1100cf1d0 0x7fd11006c5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.379 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.374+0000 7fd116eee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd11013fd30 con 0x7fd110070460 2023-12-20T04:42:32.379 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.374+0000 7fd116eee640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1100c73c0 con 0x7fd1100c4a70 2023-12-20T04:42:32.379 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.374+0000 7fd116eee640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1100b5740 con 0x7fd1100cf1d0 2023-12-20T04:42:32.379 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.374+0000 7fd10ffff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1100c4a70 0x7fd1100c7850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.379 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.374+0000 7fd11548b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1100cf1d0 0x7fd11006c5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.379 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.374+0000 7fd10ffff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1100c4a70 0x7fd1100c7850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:45028/0 (socket says 172.21.15.187:45028) 2023-12-20T04:42:32.379 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.374+0000 7fd10ffff640 1 -- 172.21.15.187:0/2034235292 learned_addr learned my addr 172.21.15.187:0/2034235292 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-20T04:42:32.380 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.375+0000 7fd114c8a640 1 --2- 172.21.15.187:0/2034235292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd110070460 0x7fd1101594b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.380 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.375+0000 7fd11548b640 1 -- 172.21.15.187:0/2034235292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1100c4a70 msgr2=0x7fd1100c7850 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.380 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.375+0000 7fd11548b640 1 --2- 172.21.15.187:0/2034235292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1100c4a70 0x7fd1100c7850 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.380 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.375+0000 7fd11548b640 1 -- 172.21.15.187:0/2034235292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd110070460 msgr2=0x7fd1101594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.380 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.375+0000 7fd11548b640 1 --2- 172.21.15.187:0/2034235292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd110070460 0x7fd1101594b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.380 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.375+0000 7fd11548b640 1 -- 172.21.15.187:0/2034235292 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0fc0094d0 con 0x7fd1100cf1d0 2023-12-20T04:42:32.380 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.375+0000 7fd10ffff640 1 --2- 172.21.15.187:0/2034235292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1100c4a70 0x7fd1100c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:32.380 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.375+0000 7fd11548b640 1 --2- 172.21.15.187:0/2034235292 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1100cf1d0 0x7fd11006c5f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd10800c6c0 tx=0x7fd10800cb80 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:32.380 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.375+0000 7fd10d7fa640 1 -- 172.21.15.187:0/2034235292 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd108003b70 con 0x7fd1100cf1d0 2023-12-20T04:42:32.380 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.375+0000 7fd10d7fa640 1 -- 172.21.15.187:0/2034235292 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd108003cd0 con 0x7fd1100cf1d0 2023-12-20T04:42:32.380 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.375+0000 7fd116eee640 1 -- 172.21.15.187:0/2034235292 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd104009400 con 0x7fd1100cf1d0 2023-12-20T04:42:32.380 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.375+0000 7fd10d7fa640 1 -- 172.21.15.187:0/2034235292 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1080052f0 con 0x7fd1100cf1d0 2023-12-20T04:42:32.380 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.375+0000 7fd116eee640 1 -- 172.21.15.187:0/2034235292 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1100c7050 con 0x7fd1100cf1d0 2023-12-20T04:42:32.381 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.375+0000 7fd10d7fa640 1 -- 172.21.15.187:0/2034235292 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fd10800a640 con 0x7fd1100cf1d0 2023-12-20T04:42:32.381 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.375+0000 7fd10d7fa640 1 -- 172.21.15.187:0/2034235292 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(8..8 src has 1..8) v4 ==== 1415+0+0 (secure 0 0 0) 0x7fd108012a10 con 0x7fd1100cf1d0 2023-12-20T04:42:32.381 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.376+0000 7fd116eee640 1 -- 172.21.15.187:0/2034235292 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1100cbc20 con 0x7fd1100cf1d0 2023-12-20T04:42:32.381 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.378+0000 7fd10d7fa640 1 -- 172.21.15.187:0/2034235292 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fd108012c70 con 0x7fd1100cf1d0 2023-12-20T04:42:32.388 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:32.387+0000 7fa685010040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-20T04:42:32.451 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.449+0000 7fd116eee640 1 -- 172.21.15.187:0/2034235292 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6} v 0) v1 -- 0x7fd1100c7530 con 0x7fd1100cf1d0 2023-12-20T04:42:32.455 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.453+0000 7fd10d7fa640 1 -- 172.21.15.187:0/2034235292 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 6}]=0 v9) v1 ==== 112+0+2 (secure 0 0 0) 0x7fd108012e10 con 0x7fd1100cf1d0 2023-12-20T04:42:32.455 INFO:teuthology.orchestra.run.smithi187.stdout:6 2023-12-20T04:42:32.456 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.454+0000 7fd116eee640 1 -- 172.21.15.187:0/2034235292 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1100cf1d0 msgr2=0x7fd11006c5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.456 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.454+0000 7fd116eee640 1 --2- 172.21.15.187:0/2034235292 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1100cf1d0 0x7fd11006c5f0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fd10800c6c0 tx=0x7fd10800cb80 comp rx=0 tx=0).stop 2023-12-20T04:42:32.456 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.454+0000 7fd116eee640 1 -- 172.21.15.187:0/2034235292 shutdown_connections 2023-12-20T04:42:32.456 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.454+0000 7fd116eee640 1 --2- 172.21.15.187:0/2034235292 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1100cf1d0 0x7fd11006c5f0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.456 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.454+0000 7fd116eee640 1 --2- 172.21.15.187:0/2034235292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1100c4a70 0x7fd1100c7850 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.457 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.454+0000 7fd116eee640 1 --2- 172.21.15.187:0/2034235292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd110070460 0x7fd1101594b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.457 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.454+0000 7fd116eee640 1 -- 172.21.15.187:0/2034235292 >> 172.21.15.187:0/2034235292 conn(0x7fd1100cc630 msgr2=0x7fd110143170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:32.457 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.454+0000 7fd116eee640 1 -- 172.21.15.187:0/2034235292 shutdown_connections 2023-12-20T04:42:32.457 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.454+0000 7fd116eee640 1 -- 172.21.15.187:0/2034235292 wait complete. 2023-12-20T04:42:32.466 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --cluster ceph osd new 00000000-0000-0000-0000-000000000000 7 2023-12-20T04:42:32.473 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:32.472+0000 7f2203645040 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2023-12-20T04:42:32.482 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:32.481+0000 7fa685010040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-20T04:42:32.566 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.564+0000 7fac37f00640 1 Processor -- start 2023-12-20T04:42:32.566 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.565+0000 7fac37f00640 1 -- start start 2023-12-20T04:42:32.567 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.565+0000 7fac37f00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac30069c30 0x7fac30070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.568 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.565+0000 7fac37f00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fac300cbde0 0x7fac300ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.568 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.565+0000 7fac37f00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac300c4f40 con 0x7fac3015d360 2023-12-20T04:42:32.568 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.565+0000 7fac37f00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac300af5b0 con 0x7fac300cbde0 2023-12-20T04:42:32.568 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.565+0000 7fac37f00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac30070a40 con 0x7fac30069c30 2023-12-20T04:42:32.568 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.566+0000 7fac3649d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fac300cbde0 0x7fac300ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.568 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.566+0000 7fac35c9c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac30069c30 0x7fac30070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.568 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.566+0000 7fac35c9c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac30069c30 0x7fac30070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:45572/0 (socket says 172.21.15.187:45572) 2023-12-20T04:42:32.568 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.566+0000 7fac3649d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fac300cbde0 0x7fac300ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.187:45038/0 (socket says 172.21.15.187:45038) 2023-12-20T04:42:32.568 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.566+0000 7fac35c9c640 1 -- 172.21.15.187:0/3182712156 learned_addr learned my addr 172.21.15.187:0/3182712156 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-20T04:42:32.568 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.566+0000 7fac35c9c640 1 -- 172.21.15.187:0/3182712156 >> v2:172.21.15.187:3300/0 conn(0x7fac300cbde0 msgr2=0x7fac300ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:32.568 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.566+0000 7fac35c9c640 1 --2- 172.21.15.187:0/3182712156 >> v2:172.21.15.187:3300/0 conn(0x7fac300cbde0 0x7fac300ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.569 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.566+0000 7fac35c9c640 1 -- 172.21.15.187:0/3182712156 >> v1:172.21.15.187:6789/0 conn(0x7fac3015d360 legacy=0x7fac3006a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.569 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.566+0000 7fac35c9c640 1 -- 172.21.15.187:0/3182712156 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac30070d20 con 0x7fac30069c30 2023-12-20T04:42:32.570 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.567+0000 7fac35c9c640 1 --2- 172.21.15.187:0/3182712156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac30069c30 0x7fac30070460 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fac28009e50 tx=0x7fac2802bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bfb276f9bc7b2417 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:32.570 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.567+0000 7fac34c9a640 1 -- 172.21.15.187:0/3182712156 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac2802cb00 con 0x7fac30069c30 2023-12-20T04:42:32.570 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.567+0000 7fac34c9a640 1 -- 172.21.15.187:0/3182712156 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac2802cc60 con 0x7fac30069c30 2023-12-20T04:42:32.570 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.567+0000 7fac34c9a640 1 -- 172.21.15.187:0/3182712156 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac280343f0 con 0x7fac30069c30 2023-12-20T04:42:32.570 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.567+0000 7fac37f00640 1 -- 172.21.15.187:0/3182712156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac30069c30 msgr2=0x7fac30070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.570 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.567+0000 7fac37f00640 1 --2- 172.21.15.187:0/3182712156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac30069c30 0x7fac30070460 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7fac28009e50 tx=0x7fac2802bf60 comp rx=0 tx=0).stop 2023-12-20T04:42:32.570 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.567+0000 7fac37f00640 1 -- 172.21.15.187:0/3182712156 shutdown_connections 2023-12-20T04:42:32.571 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.567+0000 7fac37f00640 1 --2- 172.21.15.187:0/3182712156 >> v2:172.21.15.187:3300/0 conn(0x7fac300cbde0 0x7fac300ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.571 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.567+0000 7fac37f00640 1 --2- 172.21.15.187:0/3182712156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac30069c30 0x7fac30070460 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.571 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.567+0000 7fac37f00640 1 -- 172.21.15.187:0/3182712156 >> 172.21.15.187:0/3182712156 conn(0x7fac300cc630 msgr2=0x7fac300cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:32.571 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.567+0000 7fac37f00640 1 -- 172.21.15.187:0/3182712156 shutdown_connections 2023-12-20T04:42:32.571 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.567+0000 7fac37f00640 1 -- 172.21.15.187:0/3182712156 wait complete. 2023-12-20T04:42:32.571 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.568+0000 7fac37f00640 1 Processor -- start 2023-12-20T04:42:32.571 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.569+0000 7fac37f00640 1 -- start start 2023-12-20T04:42:32.573 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.569+0000 7fac37f00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac30069c30 0x7fac30158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.573 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.569+0000 7fac37f00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac300cbde0 0x7fac3015bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.573 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.569+0000 7fac37f00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac3015d360 0x7fac300b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.573 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.569+0000 7fac37f00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac300b3e90 con 0x7fac3015d360 2023-12-20T04:42:32.573 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.569+0000 7fac37f00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac300b3340 con 0x7fac300cbde0 2023-12-20T04:42:32.574 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.569+0000 7fac37f00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac300b42b0 con 0x7fac30069c30 2023-12-20T04:42:32.574 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.569+0000 7fac35c9c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac30069c30 0x7fac30158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.574 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.569+0000 7fac3549b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac300cbde0 0x7fac3015bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.574 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.569+0000 7fac35c9c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac30069c30 0x7fac30158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.187:45586/0 (socket says 172.21.15.187:45586) 2023-12-20T04:42:32.574 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.569+0000 7fac35c9c640 1 -- 172.21.15.187:0/1619952204 learned_addr learned my addr 172.21.15.187:0/1619952204 (peer_addr_for_me v2:172.21.15.187:0/0) 2023-12-20T04:42:32.574 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.570+0000 7fac3649d640 1 --2- 172.21.15.187:0/1619952204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac3015d360 0x7fac300b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.574 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.570+0000 7fac3549b640 1 -- 172.21.15.187:0/1619952204 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac30069c30 msgr2=0x7fac30158980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.574 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.570+0000 7fac3549b640 1 --2- 172.21.15.187:0/1619952204 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac30069c30 0x7fac30158980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.574 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.570+0000 7fac3549b640 1 -- 172.21.15.187:0/1619952204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac3015d360 msgr2=0x7fac300b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.575 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.570+0000 7fac3549b640 1 --2- 172.21.15.187:0/1619952204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac3015d360 0x7fac300b28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.575 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.570+0000 7fac3549b640 1 -- 172.21.15.187:0/1619952204 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac28009b30 con 0x7fac300cbde0 2023-12-20T04:42:32.575 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.570+0000 7fac35c9c640 1 --2- 172.21.15.187:0/1619952204 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac30069c30 0x7fac30158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:32.575 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.570+0000 7fac3549b640 1 --2- 172.21.15.187:0/1619952204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac300cbde0 0x7fac3015bcd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fac2000c390 tx=0x7fac2000c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:32.575 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.570+0000 7fac267fc640 1 -- 172.21.15.187:0/1619952204 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac200052d0 con 0x7fac300cbde0 2023-12-20T04:42:32.575 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.570+0000 7fac267fc640 1 -- 172.21.15.187:0/1619952204 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac20005430 con 0x7fac300cbde0 2023-12-20T04:42:32.576 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.570+0000 7fac37f00640 1 -- 172.21.15.187:0/1619952204 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac300b2e00 con 0x7fac300cbde0 2023-12-20T04:42:32.576 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.570+0000 7fac267fc640 1 -- 172.21.15.187:0/1619952204 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac20003830 con 0x7fac300cbde0 2023-12-20T04:42:32.576 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.570+0000 7fac37f00640 1 -- 172.21.15.187:0/1619952204 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac300b37d0 con 0x7fac300cbde0 2023-12-20T04:42:32.576 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.570+0000 7fac267fc640 1 -- 172.21.15.187:0/1619952204 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fac20003c90 con 0x7fac300cbde0 2023-12-20T04:42:32.576 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.570+0000 7fac267fc640 1 -- 172.21.15.187:0/1619952204 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(9..9 src has 1..9) v4 ==== 1530+0+0 (secure 0 0 0) 0x7fac20011e40 con 0x7fac300cbde0 2023-12-20T04:42:32.576 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.571+0000 7fac37f00640 1 -- 172.21.15.187:0/1619952204 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac300b3fd0 con 0x7fac300cbde0 2023-12-20T04:42:32.576 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:32.572+0000 7f2203645040 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2023-12-20T04:42:32.577 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.573+0000 7fac267fc640 1 -- 172.21.15.187:0/1619952204 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fac300b3fd0 con 0x7fac300cbde0 2023-12-20T04:42:32.619 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:32.617+0000 7fa685010040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-20T04:42:32.646 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.644+0000 7fac37f00640 1 -- 172.21.15.187:0/1619952204 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7} v 0) v1 -- 0x7fac3004e840 con 0x7fac300cbde0 2023-12-20T04:42:32.649 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.648+0000 7fac267fc640 1 -- 172.21.15.187:0/1619952204 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "00000000-0000-0000-0000-000000000000", "id": 7}]=0 v10) v1 ==== 112+0+2 (secure 0 0 0) 0x7fac20017070 con 0x7fac300cbde0 2023-12-20T04:42:32.649 INFO:teuthology.orchestra.run.smithi187.stdout:7 2023-12-20T04:42:32.653 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.649+0000 7fac37f00640 1 -- 172.21.15.187:0/1619952204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac300cbde0 msgr2=0x7fac3015bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.653 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.649+0000 7fac37f00640 1 --2- 172.21.15.187:0/1619952204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac300cbde0 0x7fac3015bcd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7fac2000c390 tx=0x7fac2000c850 comp rx=0 tx=0).stop 2023-12-20T04:42:32.653 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.649+0000 7fac37f00640 1 -- 172.21.15.187:0/1619952204 shutdown_connections 2023-12-20T04:42:32.654 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.649+0000 7fac37f00640 1 --2- 172.21.15.187:0/1619952204 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac3015d360 0x7fac300b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.654 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.649+0000 7fac37f00640 1 --2- 172.21.15.187:0/1619952204 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac300cbde0 0x7fac3015bcd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.654 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.649+0000 7fac37f00640 1 --2- 172.21.15.187:0/1619952204 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac30069c30 0x7fac30158980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.654 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.649+0000 7fac37f00640 1 -- 172.21.15.187:0/1619952204 >> 172.21.15.187:0/1619952204 conn(0x7fac300cc630 msgr2=0x7fac3006a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:32.654 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.649+0000 7fac37f00640 1 -- 172.21.15.187:0/1619952204 shutdown_connections 2023-12-20T04:42:32.654 INFO:teuthology.orchestra.run.smithi187.stderr:2023-12-20T04:42:32.649+0000 7fac37f00640 1 -- 172.21.15.187:0/1619952204 wait complete. 2023-12-20T04:42:32.660 INFO:tasks.ceph.osd.0:Restarting daemon 2023-12-20T04:42:32.661 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2023-12-20T04:42:32.661 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:32.660+0000 7fa685010040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-20T04:42:32.663 INFO:tasks.ceph.osd.0:Started 2023-12-20T04:42:32.663 INFO:tasks.ceph.osd.1:Restarting daemon 2023-12-20T04:42:32.664 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2023-12-20T04:42:32.666 INFO:tasks.ceph.osd.1:Started 2023-12-20T04:42:32.666 INFO:tasks.ceph.osd.2:Restarting daemon 2023-12-20T04:42:32.666 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2023-12-20T04:42:32.668 INFO:tasks.ceph.osd.2:Started 2023-12-20T04:42:32.668 INFO:tasks.ceph.osd.3:Restarting daemon 2023-12-20T04:42:32.668 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2023-12-20T04:42:32.671 INFO:tasks.ceph.osd.3:Started 2023-12-20T04:42:32.671 INFO:tasks.ceph.osd.4:Restarting daemon 2023-12-20T04:42:32.671 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2023-12-20T04:42:32.703 INFO:tasks.ceph.osd.4:Started 2023-12-20T04:42:32.703 INFO:tasks.ceph.osd.5:Restarting daemon 2023-12-20T04:42:32.703 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2023-12-20T04:42:32.705 INFO:tasks.ceph.osd.5:Started 2023-12-20T04:42:32.705 INFO:tasks.ceph.osd.6:Restarting daemon 2023-12-20T04:42:32.705 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2023-12-20T04:42:32.707 INFO:tasks.ceph.osd.6:Started 2023-12-20T04:42:32.707 INFO:tasks.ceph.osd.7:Restarting daemon 2023-12-20T04:42:32.707 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2023-12-20T04:42:32.709 INFO:tasks.ceph.osd.7:Started 2023-12-20T04:42:32.710 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:42:32.722 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:32.720+0000 7f2203645040 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2023-12-20T04:42:32.750 INFO:tasks.ceph.osd.0.smithi132.stderr:2023-12-20T04:42:32.748+0000 7f0329220500 -1 Falling back to public interface 2023-12-20T04:42:32.754 INFO:tasks.ceph.osd.2.smithi132.stderr:2023-12-20T04:42:32.753+0000 7fe124416500 -1 Falling back to public interface 2023-12-20T04:42:32.767 INFO:tasks.ceph.osd.0.smithi132.stderr:2023-12-20T04:42:32.765+0000 7f0329220500 -1 osd.0 0 log_to_monitors true 2023-12-20T04:42:32.770 INFO:tasks.ceph.osd.3.smithi132.stderr:2023-12-20T04:42:32.768+0000 7fb6a2a49500 -1 Falling back to public interface 2023-12-20T04:42:32.770 INFO:tasks.ceph.osd.1.smithi132.stderr:2023-12-20T04:42:32.769+0000 7fc71ba25500 -1 Falling back to public interface 2023-12-20T04:42:32.771 INFO:tasks.ceph.osd.1.smithi132.stderr:2023-12-20T04:42:32.770+0000 7fc71a9ce640 -1 PosixStack listen unable to listen on v1:0.0.0.0:6820/0: (98) Address already in use 2023-12-20T04:42:32.773 INFO:tasks.ceph.osd.2.smithi132.stderr:2023-12-20T04:42:32.772+0000 7fe124416500 -1 osd.2 0 log_to_monitors true 2023-12-20T04:42:32.785 INFO:tasks.ceph.osd.3.smithi132.stderr:2023-12-20T04:42:32.784+0000 7fb6a2a49500 -1 osd.3 0 log_to_monitors true 2023-12-20T04:42:32.787 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-20T04:42:32.786+0000 7ff5811fe500 -1 Falling back to public interface 2023-12-20T04:42:32.788 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-20T04:42:32.786+0000 7efe5f014500 -1 Falling back to public interface 2023-12-20T04:42:32.788 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-20T04:42:32.786+0000 7ff5801a5640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6801/0: (98) Address already in use 2023-12-20T04:42:32.788 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-20T04:42:32.786+0000 7f33edc12500 -1 Falling back to public interface 2023-12-20T04:42:32.788 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-20T04:42:32.786+0000 7ff5801a5640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6802/0: (98) Address already in use 2023-12-20T04:42:32.789 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-20T04:42:32.786+0000 7f33ec522640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6805/0: (98) Address already in use 2023-12-20T04:42:32.791 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:32.790+0000 7f2203645040 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2023-12-20T04:42:32.792 INFO:tasks.ceph.osd.1.smithi132.stderr:2023-12-20T04:42:32.790+0000 7fc71ba25500 -1 osd.1 0 log_to_monitors true 2023-12-20T04:42:32.800 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-20T04:42:32.799+0000 7ff5811fe500 -1 osd.5 0 log_to_monitors true 2023-12-20T04:42:32.800 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-20T04:42:32.799+0000 7efe5f014500 -1 osd.4 0 log_to_monitors true 2023-12-20T04:42:32.805 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-20T04:42:32.804+0000 7f33edc12500 -1 osd.6 0 log_to_monitors true 2023-12-20T04:42:32.815 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-20T04:42:32.813+0000 7f2bfc61d500 -1 Falling back to public interface 2023-12-20T04:42:32.826 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-20T04:42:32.825+0000 7f2bfc61d500 -1 osd.7 0 log_to_monitors true 2023-12-20T04:42:32.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.837+0000 7f8915a69640 1 Processor -- start 2023-12-20T04:42:32.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.837+0000 7f8915a69640 1 -- start start 2023-12-20T04:42:32.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.838+0000 7f8915a69640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f891015a960 0x7f89100ca200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.838+0000 7f8915a69640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f891015ad40 0x7f89100cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.838+0000 7f8915a69640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f891015e9b0 con 0x7f891015b1c0 2023-12-20T04:42:32.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.838+0000 7f8915a69640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f891015de30 con 0x7f891015a960 2023-12-20T04:42:32.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.838+0000 7f8915a69640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f891015e110 con 0x7f891015ad40 2023-12-20T04:42:32.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.838+0000 7f890ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f891015b1c0 0x7f89100ce250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:59362/0 (socket says 172.21.15.132:59362) 2023-12-20T04:42:32.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.838+0000 7f890ffff640 1 -- 172.21.15.132:0/338555638 learned_addr learned my addr 172.21.15.132:0/338555638 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:32.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.838+0000 7f890f7fe640 1 --2- 172.21.15.132:0/338555638 >> v2:172.21.15.187:3300/0 conn(0x7f891015a960 0x7f89100ca200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.838+0000 7f890effd640 1 --2- 172.21.15.132:0/338555638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f891015ad40 0x7f89100cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.838+0000 7f890e7fc640 1 -- 172.21.15.132:0/338555638 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 332570737 0 0) 0x7f891015e9b0 con 0x7f891015b1c0 2023-12-20T04:42:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.838+0000 7f890e7fc640 1 -- 172.21.15.132:0/338555638 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88f8003520 con 0x7f891015b1c0 2023-12-20T04:42:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.839+0000 7f890effd640 1 -- 172.21.15.132:0/338555638 >> v2:172.21.15.187:3300/0 conn(0x7f891015a960 msgr2=0x7f89100ca200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.839+0000 7f890effd640 1 --2- 172.21.15.132:0/338555638 >> v2:172.21.15.187:3300/0 conn(0x7f891015a960 0x7f89100ca200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.839+0000 7f890effd640 1 -- 172.21.15.132:0/338555638 >> v1:172.21.15.132:6789/0 conn(0x7f891015b1c0 legacy=0x7f89100ce250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.839+0000 7f890effd640 1 -- 172.21.15.132:0/338555638 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f891015e3f0 con 0x7f891015ad40 2023-12-20T04:42:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.839+0000 7f890f7fe640 1 --2- 172.21.15.132:0/338555638 >> v2:172.21.15.187:3300/0 conn(0x7f891015a960 0x7f89100ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.839+0000 7f890effd640 1 --2- 172.21.15.132:0/338555638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f891015ad40 0x7f89100cc350 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f89000097a0 tx=0x7f890002da50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=24563ae3210fd730 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.840+0000 7f890e7fc640 1 -- 172.21.15.132:0/338555638 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8900031870 con 0x7f891015ad40 2023-12-20T04:42:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.840+0000 7f890e7fc640 1 -- 172.21.15.132:0/338555638 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89000319d0 con 0x7f891015ad40 2023-12-20T04:42:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.840+0000 7f890e7fc640 1 -- 172.21.15.132:0/338555638 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8900031d60 con 0x7f891015ad40 2023-12-20T04:42:32.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.840+0000 7f8915a69640 1 -- 172.21.15.132:0/338555638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f891015ad40 msgr2=0x7f89100cc350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.840+0000 7f8915a69640 1 --2- 172.21.15.132:0/338555638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f891015ad40 0x7f89100cc350 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f89000097a0 tx=0x7f890002da50 comp rx=0 tx=0).stop 2023-12-20T04:42:32.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.840+0000 7f8915a69640 1 -- 172.21.15.132:0/338555638 shutdown_connections 2023-12-20T04:42:32.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.840+0000 7f8915a69640 1 --2- 172.21.15.132:0/338555638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f891015ad40 0x7f89100cc350 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.840+0000 7f8915a69640 1 --2- 172.21.15.132:0/338555638 >> v2:172.21.15.187:3300/0 conn(0x7f891015a960 0x7f89100ca200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.840+0000 7f8915a69640 1 -- 172.21.15.132:0/338555638 >> 172.21.15.132:0/338555638 conn(0x7f891006a050 msgr2=0x7f891006a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:32.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.840+0000 7f8915a69640 1 -- 172.21.15.132:0/338555638 shutdown_connections 2023-12-20T04:42:32.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.840+0000 7f8915a69640 1 -- 172.21.15.132:0/338555638 wait complete. 2023-12-20T04:42:32.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.841+0000 7f8915a69640 1 Processor -- start 2023-12-20T04:42:32.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.842+0000 7f8915a69640 1 -- start start 2023-12-20T04:42:32.844 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:32.842+0000 7fa685010040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-20T04:42:32.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.842+0000 7f8915a69640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f891015a960 0x7f8910155f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.842+0000 7f8915a69640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f891015ad40 0x7f89100c9070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.842+0000 7f8915a69640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f891015b1c0 0x7f89101585c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:32.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.842+0000 7f8915a69640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89100c40b0 con 0x7f891015b1c0 2023-12-20T04:42:32.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.842+0000 7f8915a69640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8910156480 con 0x7f891015ad40 2023-12-20T04:42:32.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.842+0000 7f8915a69640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89100c7340 con 0x7f891015a960 2023-12-20T04:42:32.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.842+0000 7f890ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f891015b1c0 0x7f89101585c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.842+0000 7f890ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f891015b1c0 0x7f89101585c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56148/0 (socket says 172.21.15.132:56148) 2023-12-20T04:42:32.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.842+0000 7f890ffff640 1 -- 172.21.15.132:0/759050708 learned_addr learned my addr 172.21.15.132:0/759050708 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:32.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.842+0000 7f890f7fe640 1 --2- 172.21.15.132:0/759050708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f891015a960 0x7f8910155f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.842+0000 7f890effd640 1 --2- 172.21.15.132:0/759050708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f891015ad40 0x7f89100c9070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:32.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.843+0000 7f890f7fe640 1 -- 172.21.15.132:0/759050708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f891015ad40 msgr2=0x7f89100c9070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.843+0000 7f890f7fe640 1 --2- 172.21.15.132:0/759050708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f891015ad40 0x7f89100c9070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.843+0000 7f890f7fe640 1 -- 172.21.15.132:0/759050708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f891015b1c0 msgr2=0x7f89101585c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.843+0000 7f890f7fe640 1 --2- 172.21.15.132:0/759050708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f891015b1c0 0x7f89101585c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.843+0000 7f890f7fe640 1 -- 172.21.15.132:0/759050708 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8904009400 con 0x7f891015a960 2023-12-20T04:42:32.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.843+0000 7f890f7fe640 1 --2- 172.21.15.132:0/759050708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f891015a960 0x7f8910155f40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f890400e900 tx=0x7f890400edc0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:32.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.843+0000 7f88f7fff640 1 -- 172.21.15.132:0/759050708 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f890400ca00 con 0x7f891015a960 2023-12-20T04:42:32.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.843+0000 7f88f7fff640 1 -- 172.21.15.132:0/759050708 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f890400cb60 con 0x7f891015a960 2023-12-20T04:42:32.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.843+0000 7f8915a69640 1 -- 172.21.15.132:0/759050708 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8900009400 con 0x7f891015a960 2023-12-20T04:42:32.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.843+0000 7f88f7fff640 1 -- 172.21.15.132:0/759050708 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8904013470 con 0x7f891015a960 2023-12-20T04:42:32.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.843+0000 7f88f7fff640 1 -- 172.21.15.132:0/759050708 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7f89040138d0 con 0x7f891015a960 2023-12-20T04:42:32.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.844+0000 7f8915a69640 1 -- 172.21.15.132:0/759050708 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89100c7900 con 0x7f891015a960 2023-12-20T04:42:32.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.844+0000 7f88f7fff640 1 -- 172.21.15.132:0/759050708 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1645+0+0 (secure 0 0 0) 0x7f890401c450 con 0x7f891015a960 2023-12-20T04:42:32.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.845+0000 7f88f5ffb640 1 -- 172.21.15.132:0/759050708 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88e8005250 con 0x7f891015a960 2023-12-20T04:42:32.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.847+0000 7f88f7fff640 1 -- 172.21.15.132:0/759050708 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7f8904021060 con 0x7f891015a960 2023-12-20T04:42:32.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.906+0000 7f88f5ffb640 1 -- 172.21.15.132:0/759050708 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f88e80057d0 con 0x7f891015a960 2023-12-20T04:42:32.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.907+0000 7f88f7fff640 1 -- 172.21.15.132:0/759050708 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) v1 ==== 74+0+7057 (secure 0 0 0) 0x7f890402a020 con 0x7f891015a960 2023-12-20T04:42:32.909 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:32.909 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":10,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:32.646555+0000","last_up_change":"0.000000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:42:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.908+0000 7f88f5ffb640 1 -- 172.21.15.132:0/759050708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f891015a960 msgr2=0x7f8910155f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.908+0000 7f88f5ffb640 1 --2- 172.21.15.132:0/759050708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f891015a960 0x7f8910155f40 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f890400e900 tx=0x7f890400edc0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.908+0000 7f88f5ffb640 1 -- 172.21.15.132:0/759050708 shutdown_connections 2023-12-20T04:42:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.908+0000 7f88f5ffb640 1 --2- 172.21.15.132:0/759050708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f891015b1c0 0x7f89101585c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.908+0000 7f88f5ffb640 1 --2- 172.21.15.132:0/759050708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f891015ad40 0x7f89100c9070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.908+0000 7f88f5ffb640 1 --2- 172.21.15.132:0/759050708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f891015a960 0x7f8910155f40 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:32.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.908+0000 7f88f5ffb640 1 -- 172.21.15.132:0/759050708 >> 172.21.15.132:0/759050708 conn(0x7f891006a050 msgr2=0x7f8910159c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.908+0000 7f88f5ffb640 1 -- 172.21.15.132:0/759050708 shutdown_connections 2023-12-20T04:42:32.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:32.908+0000 7f88f5ffb640 1 -- 172.21.15.132:0/759050708 wait complete. 2023-12-20T04:42:32.920 INFO:tasks.ceph.ceph_manager.ceph:[] 2023-12-20T04:42:32.920 INFO:tasks.ceph:Waiting for OSDs to come up 2023-12-20T04:42:32.940 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:32.939+0000 7f2203645040 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2023-12-20T04:42:33.641 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:33.640+0000 7fa685010040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-20T04:42:33.726 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-20T04:42:33.731 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:33.729+0000 7f2203645040 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2023-12-20T04:42:33.816 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.814+0000 7fc40f4a0640 1 Processor -- start 2023-12-20T04:42:33.816 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.814+0000 7fc40f4a0640 1 -- start start 2023-12-20T04:42:33.817 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.815+0000 7fc40f4a0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc4080cec00 0x7fc4080cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:33.817 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.815+0000 7fc40f4a0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4080cf520 0x7fc4080b3c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:33.817 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.815+0000 7fc40f4a0640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4080b3800 con 0x7fc4080b4150 2023-12-20T04:42:33.817 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.815+0000 7fc40f4a0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4080ce250 con 0x7fc4080cec00 2023-12-20T04:42:33.817 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.815+0000 7fc40f4a0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4080b2c00 con 0x7fc4080cf520 2023-12-20T04:42:33.817 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.815+0000 7fc40d23c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc4080cec00 0x7fc4080cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:33.818 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.815+0000 7fc40d23c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc4080cec00 0x7fc4080cefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56150/0 (socket says 172.21.15.132:56150) 2023-12-20T04:42:33.818 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.815+0000 7fc40d23c640 1 -- 172.21.15.132:0/2678413856 learned_addr learned my addr 172.21.15.132:0/2678413856 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:33.818 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.815+0000 7fc40ca3b640 1 --2- 172.21.15.132:0/2678413856 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4080cf520 0x7fc4080b3c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:33.818 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.815+0000 7fc40d23c640 1 -- 172.21.15.132:0/2678413856 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4080cf520 msgr2=0x7fc4080b3c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:33.818 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.815+0000 7fc40d23c640 1 --2- 172.21.15.132:0/2678413856 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4080cf520 0x7fc4080b3c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:33.818 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.815+0000 7fc40d23c640 1 -- 172.21.15.132:0/2678413856 >> v1:172.21.15.187:6789/0 conn(0x7fc4080b4150 legacy=0x7fc4080d1380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:33.818 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.815+0000 7fc40d23c640 1 -- 172.21.15.132:0/2678413856 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4080b3240 con 0x7fc4080cec00 2023-12-20T04:42:33.819 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.816+0000 7fc40d23c640 1 --2- 172.21.15.132:0/2678413856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4080cec00 0x7fc4080cefe0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc404009870 tx=0x7fc40402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c76669950ba52118 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:33.820 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.816+0000 7fc3fffff640 1 -- 172.21.15.132:0/2678413856 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404031640 con 0x7fc4080cec00 2023-12-20T04:42:33.820 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.816+0000 7fc3fffff640 1 -- 172.21.15.132:0/2678413856 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4040317a0 con 0x7fc4080cec00 2023-12-20T04:42:33.820 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.816+0000 7fc3fffff640 1 -- 172.21.15.132:0/2678413856 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc404031b30 con 0x7fc4080cec00 2023-12-20T04:42:33.820 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.817+0000 7fc40f4a0640 1 -- 172.21.15.132:0/2678413856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4080cec00 msgr2=0x7fc4080cefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:33.820 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.817+0000 7fc40f4a0640 1 --2- 172.21.15.132:0/2678413856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4080cec00 0x7fc4080cefe0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fc404009870 tx=0x7fc40402b8f0 comp rx=0 tx=0).stop 2023-12-20T04:42:33.820 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.817+0000 7fc40f4a0640 1 -- 172.21.15.132:0/2678413856 shutdown_connections 2023-12-20T04:42:33.820 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.817+0000 7fc40f4a0640 1 --2- 172.21.15.132:0/2678413856 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4080cf520 0x7fc4080b3c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:33.820 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.817+0000 7fc40f4a0640 1 --2- 172.21.15.132:0/2678413856 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4080cec00 0x7fc4080cefe0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:33.820 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.817+0000 7fc40f4a0640 1 -- 172.21.15.132:0/2678413856 >> 172.21.15.132:0/2678413856 conn(0x7fc40806d710 msgr2=0x7fc40806daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:33.820 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.817+0000 7fc40f4a0640 1 -- 172.21.15.132:0/2678413856 shutdown_connections 2023-12-20T04:42:33.820 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.817+0000 7fc40f4a0640 1 -- 172.21.15.132:0/2678413856 wait complete. 2023-12-20T04:42:33.820 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.818+0000 7fc40f4a0640 1 Processor -- start 2023-12-20T04:42:33.820 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.818+0000 7fc40f4a0640 1 -- start start 2023-12-20T04:42:33.823 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40f4a0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4080b4150 0x7fc4081544b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:33.823 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40f4a0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4080cec00 0x7fc40815a7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:33.823 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40f4a0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4080cf520 0x7fc40815ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:33.823 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40f4a0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40815d840 con 0x7fc4080b4150 2023-12-20T04:42:33.823 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40f4a0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4081f38e0 con 0x7fc4080cf520 2023-12-20T04:42:33.823 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40f4a0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4080c5ec0 con 0x7fc4080cec00 2023-12-20T04:42:33.823 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40d23c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4080b4150 0x7fc4081544b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:33.823 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40d23c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4080b4150 0x7fc4081544b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56162/0 (socket says 172.21.15.132:56162) 2023-12-20T04:42:33.823 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40d23c640 1 -- 172.21.15.132:0/2412291343 learned_addr learned my addr 172.21.15.132:0/2412291343 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:33.823 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40ca3b640 1 --2- 172.21.15.132:0/2412291343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4080cec00 0x7fc40815a7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:33.823 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40da3d640 1 --2- 172.21.15.132:0/2412291343 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4080cf520 0x7fc40815ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:33.823 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40d23c640 1 -- 172.21.15.132:0/2412291343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4080cec00 msgr2=0x7fc40815a7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:33.824 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40d23c640 1 --2- 172.21.15.132:0/2412291343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4080cec00 0x7fc40815a7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:33.824 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40d23c640 1 -- 172.21.15.132:0/2412291343 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4080cf520 msgr2=0x7fc40815ad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:33.824 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40d23c640 1 --2- 172.21.15.132:0/2412291343 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4080cf520 0x7fc40815ad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:33.824 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40d23c640 1 -- 172.21.15.132:0/2412291343 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4040094d0 con 0x7fc4080b4150 2023-12-20T04:42:33.824 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40ca3b640 1 --2- 172.21.15.132:0/2412291343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4080cec00 0x7fc40815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:33.824 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40d23c640 1 --2- 172.21.15.132:0/2412291343 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4080b4150 0x7fc4081544b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc404000c00 tx=0x7fc4040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:33.824 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc3fdffb640 1 -- 172.21.15.132:0/2412291343 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40403a930 con 0x7fc4080b4150 2023-12-20T04:42:33.824 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc3fdffb640 1 -- 172.21.15.132:0/2412291343 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40403aa90 con 0x7fc4080b4150 2023-12-20T04:42:33.824 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc40f4a0640 1 -- 172.21.15.132:0/2412291343 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4081f3b30 con 0x7fc4080b4150 2023-12-20T04:42:33.824 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.819+0000 7fc3fdffb640 1 -- 172.21.15.132:0/2412291343 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40403ae40 con 0x7fc4080b4150 2023-12-20T04:42:33.824 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.820+0000 7fc40f4a0640 1 -- 172.21.15.132:0/2412291343 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4081f40f0 con 0x7fc4080b4150 2023-12-20T04:42:33.824 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.820+0000 7fc3fdffb640 1 -- 172.21.15.132:0/2412291343 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 1) v1 ==== 660+0+0 (secure 0 0 0) 0x7fc40402f050 con 0x7fc4080b4150 2023-12-20T04:42:33.824 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.820+0000 7fc3fdffb640 1 -- 172.21.15.132:0/2412291343 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(11..11 src has 1..11) v4 ==== 1883+0+0 (secure 0 0 0) 0x7fc404044de0 con 0x7fc4080b4150 2023-12-20T04:42:33.824 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.821+0000 7fc40f4a0640 1 -- 172.21.15.132:0/2412291343 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc408067120 con 0x7fc4080b4150 2023-12-20T04:42:33.826 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.825+0000 7fc3fdffb640 1 -- 172.21.15.132:0/2412291343 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+72491 (secure 0 0 0) 0x7fc404035020 con 0x7fc4080b4150 2023-12-20T04:42:33.886 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.884+0000 7fc40f4a0640 1 -- 172.21.15.132:0/2412291343 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc4080b5410 con 0x7fc4080b4150 2023-12-20T04:42:33.886 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.885+0000 7fc3fdffb640 1 -- 172.21.15.132:0/2412291343 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v11) v1 ==== 74+0+7057 (secure 0 0 0) 0x7fc40402d040 con 0x7fc4080b4150 2023-12-20T04:42:33.887 INFO:teuthology.misc.health.smithi132.stdout: 2023-12-20T04:42:33.887 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":11,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:33.647790+0000","last_up_change":"0.000000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":3,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:42:33.888 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.886+0000 7fc40f4a0640 1 -- 172.21.15.132:0/2412291343 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4080b4150 msgr2=0x7fc4081544b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:33.888 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.886+0000 7fc40f4a0640 1 --2- 172.21.15.132:0/2412291343 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4080b4150 0x7fc4081544b0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7fc404000c00 tx=0x7fc4040046c0 comp rx=0 tx=0).stop 2023-12-20T04:42:33.888 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.886+0000 7fc40f4a0640 1 -- 172.21.15.132:0/2412291343 shutdown_connections 2023-12-20T04:42:33.888 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.886+0000 7fc40f4a0640 1 --2- 172.21.15.132:0/2412291343 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4080cf520 0x7fc40815ad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:33.888 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.886+0000 7fc40f4a0640 1 --2- 172.21.15.132:0/2412291343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4080cec00 0x7fc40815a7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:33.888 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.886+0000 7fc40f4a0640 1 --2- 172.21.15.132:0/2412291343 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4080b4150 0x7fc4081544b0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:33.888 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.886+0000 7fc40f4a0640 1 -- 172.21.15.132:0/2412291343 >> 172.21.15.132:0/2412291343 conn(0x7fc40806d710 msgr2=0x7fc4080b0d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:33.888 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.886+0000 7fc40f4a0640 1 -- 172.21.15.132:0/2412291343 shutdown_connections 2023-12-20T04:42:33.888 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:33.886+0000 7fc40f4a0640 1 -- 172.21.15.132:0/2412291343 wait complete. 2023-12-20T04:42:33.897 DEBUG:teuthology.misc:0 of 8 OSDs are up 2023-12-20T04:42:33.925 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:33.923+0000 7fa685010040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-20T04:42:33.975 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:33.974+0000 7fa685010040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-20T04:42:34.003 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:34.002+0000 7f2203645040 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2023-12-20T04:42:34.055 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:34.053+0000 7f2203645040 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2023-12-20T04:42:34.074 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:34.072+0000 7fa685010040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-20T04:42:34.159 INFO:tasks.ceph.mgr.x.smithi187.stderr:2023-12-20T04:42:34.157+0000 7f2203645040 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2023-12-20T04:42:34.668 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-20T04:42:34.667+0000 7efe5a8dc640 -1 osd.4 0 waiting for initial osdmap 2023-12-20T04:42:34.669 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-20T04:42:34.668+0000 7f2bf7f5e640 -1 osd.7 0 waiting for initial osdmap 2023-12-20T04:42:34.670 INFO:tasks.ceph.osd.4.smithi187.stderr:2023-12-20T04:42:34.668+0000 7efe53f10640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-20T04:42:34.671 INFO:tasks.ceph.osd.7.smithi187.stderr:2023-12-20T04:42:34.670+0000 7f2bf1592640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-20T04:42:34.675 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-20T04:42:34.673+0000 7ff57d189640 -1 osd.5 0 waiting for initial osdmap 2023-12-20T04:42:34.675 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-20T04:42:34.674+0000 7f33e9506640 -1 osd.6 0 waiting for initial osdmap 2023-12-20T04:42:34.676 INFO:tasks.ceph.osd.2.smithi132.stderr:2023-12-20T04:42:34.675+0000 7fe11fe02640 -1 osd.2 0 waiting for initial osdmap 2023-12-20T04:42:34.676 INFO:tasks.ceph.osd.3.smithi132.stderr:2023-12-20T04:42:34.675+0000 7fb69e9d4640 -1 osd.3 0 waiting for initial osdmap 2023-12-20T04:42:34.677 INFO:tasks.ceph.osd.1.smithi132.stderr:2023-12-20T04:42:34.675+0000 7fc7179b2640 -1 osd.1 0 waiting for initial osdmap 2023-12-20T04:42:34.677 INFO:tasks.ceph.osd.0.smithi132.stderr:2023-12-20T04:42:34.675+0000 7f0324b62640 -1 osd.0 0 waiting for initial osdmap 2023-12-20T04:42:34.677 INFO:tasks.ceph.osd.5.smithi187.stderr:2023-12-20T04:42:34.675+0000 7ff5767bd640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-20T04:42:34.678 INFO:tasks.ceph.osd.6.smithi187.stderr:2023-12-20T04:42:34.675+0000 7f33e2b3a640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-20T04:42:34.678 INFO:tasks.ceph.osd.1.smithi132.stderr:2023-12-20T04:42:34.676+0000 7fc710fe6640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-20T04:42:34.678 INFO:tasks.ceph.osd.2.smithi132.stderr:2023-12-20T04:42:34.676+0000 7fe119436640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-20T04:42:34.679 INFO:tasks.ceph.osd.3.smithi132.stderr:2023-12-20T04:42:34.676+0000 7fb698008640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-20T04:42:34.679 INFO:tasks.ceph.osd.0.smithi132.stderr:2023-12-20T04:42:34.677+0000 7f031e196640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2023-12-20T04:42:35.099 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:35.097+0000 7fa626115640 -1 mgr.server handle_report got status from non-daemon mon.b 2023-12-20T04:42:35.102 INFO:tasks.ceph.mgr.y.smithi132.stderr:2023-12-20T04:42:35.100+0000 7fa626115640 -1 mgr.server handle_report got status from non-daemon mon.c 2023-12-20T04:42:40.704 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2023-12-20T04:42:40.803 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.801+0000 7f3ab7eb9640 1 Processor -- start 2023-12-20T04:42:40.803 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.801+0000 7f3ab7eb9640 1 -- start start 2023-12-20T04:42:40.804 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.802+0000 7f3ab7eb9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3ab015d410 0x7f3ab00d11a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:40.804 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.802+0000 7f3ab7eb9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab00ce500 0x7f3ab00b6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:40.804 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.802+0000 7f3ab7eb9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ab00d1c40 con 0x7f3ab00d16e0 2023-12-20T04:42:40.805 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.802+0000 7f3ab7eb9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ab00d1f20 con 0x7f3ab015d410 2023-12-20T04:42:40.805 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.802+0000 7f3ab7eb9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00d2200 con 0x7f3ab00ce500 2023-12-20T04:42:40.805 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.802+0000 7f3ab5c55640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3ab015d410 0x7f3ab00d11a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:40.805 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.802+0000 7f3ab5454640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3ab00d16e0 0x7f3ab00cddf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38846/0 (socket says 172.21.15.132:38846) 2023-12-20T04:42:40.805 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.802+0000 7f3ab5454640 1 -- 172.21.15.132:0/2335490807 learned_addr learned my addr 172.21.15.132:0/2335490807 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:40.805 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.802+0000 7f3ab6456640 1 --2- 172.21.15.132:0/2335490807 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab00ce500 0x7f3ab00b6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:40.805 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.802+0000 7f3ab5c55640 1 -- 172.21.15.132:0/2335490807 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab00ce500 msgr2=0x7f3ab00b6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:40.805 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.802+0000 7f3ab5c55640 1 --2- 172.21.15.132:0/2335490807 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab00ce500 0x7f3ab00b6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:40.805 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.802+0000 7f3ab5c55640 1 -- 172.21.15.132:0/2335490807 >> v1:172.21.15.132:6789/0 conn(0x7f3ab00d16e0 legacy=0x7f3ab00cddf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:40.805 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.802+0000 7f3ab5c55640 1 -- 172.21.15.132:0/2335490807 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ab00d24e0 con 0x7f3ab015d410 2023-12-20T04:42:40.805 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.802+0000 7f3ab4c53640 1 -- 172.21.15.132:0/2335490807 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3913667657 0 0) 0x7f3ab00d1c40 con 0x7f3ab00d16e0 2023-12-20T04:42:40.805 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.803+0000 7f3ab6456640 1 --2- 172.21.15.132:0/2335490807 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab00ce500 0x7f3ab00b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:40.807 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.803+0000 7f3ab5c55640 1 --2- 172.21.15.132:0/2335490807 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ab015d410 0x7f3ab00d11a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009d90 tx=0x7f3aac02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fdf7448af190c7d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:40.807 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.803+0000 7f3ab4c53640 1 -- 172.21.15.132:0/2335490807 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac02cc50 con 0x7f3ab015d410 2023-12-20T04:42:40.807 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.803+0000 7f3ab4c53640 1 -- 172.21.15.132:0/2335490807 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aac02cdb0 con 0x7f3ab015d410 2023-12-20T04:42:40.807 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.803+0000 7f3ab4c53640 1 -- 172.21.15.132:0/2335490807 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aac034660 con 0x7f3ab015d410 2023-12-20T04:42:40.807 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.804+0000 7f3ab7eb9640 1 -- 172.21.15.132:0/2335490807 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ab015d410 msgr2=0x7f3ab00d11a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:40.807 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.804+0000 7f3ab7eb9640 1 --2- 172.21.15.132:0/2335490807 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ab015d410 0x7f3ab00d11a0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f3aac009d90 tx=0x7f3aac02bea0 comp rx=0 tx=0).stop 2023-12-20T04:42:40.808 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.804+0000 7f3ab7eb9640 1 -- 172.21.15.132:0/2335490807 shutdown_connections 2023-12-20T04:42:40.808 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.804+0000 7f3ab7eb9640 1 --2- 172.21.15.132:0/2335490807 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab00ce500 0x7f3ab00b6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:40.808 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.804+0000 7f3ab7eb9640 1 --2- 172.21.15.132:0/2335490807 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ab015d410 0x7f3ab00d11a0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:40.808 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.804+0000 7f3ab7eb9640 1 -- 172.21.15.132:0/2335490807 >> 172.21.15.132:0/2335490807 conn(0x7f3ab0069c30 msgr2=0x7f3ab006a040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:40.808 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.804+0000 7f3ab7eb9640 1 -- 172.21.15.132:0/2335490807 shutdown_connections 2023-12-20T04:42:40.808 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.804+0000 7f3ab7eb9640 1 -- 172.21.15.132:0/2335490807 wait complete. 2023-12-20T04:42:40.808 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.805+0000 7f3ab7eb9640 1 Processor -- start 2023-12-20T04:42:40.808 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.805+0000 7f3ab7eb9640 1 -- start start 2023-12-20T04:42:40.812 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.806+0000 7f3ab7eb9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab00ce500 0x7f3ab00cb2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:40.812 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.806+0000 7f3ab7eb9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ab00d16e0 0x7f3ab015fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:40.812 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.806+0000 7f3ab7eb9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ab015d410 0x7f3ab015e200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:40.812 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.806+0000 7f3ab7eb9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00c74d0 con 0x7f3ab015d410 2023-12-20T04:42:40.813 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.806+0000 7f3ab7eb9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00c9900 con 0x7f3ab00d16e0 2023-12-20T04:42:40.813 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.806+0000 7f3ab7eb9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ab00c6b50 con 0x7f3ab00ce500 2023-12-20T04:42:40.813 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.806+0000 7f3ab6456640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ab015d410 0x7f3ab015e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:40.813 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.806+0000 7f3ab6456640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ab015d410 0x7f3ab015e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39616/0 (socket says 172.21.15.132:39616) 2023-12-20T04:42:40.813 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.806+0000 7f3ab6456640 1 -- 172.21.15.132:0/275519264 learned_addr learned my addr 172.21.15.132:0/275519264 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:40.813 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.806+0000 7f3ab5454640 1 --2- 172.21.15.132:0/275519264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ab00d16e0 0x7f3ab015fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:40.813 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.806+0000 7f3ab5c55640 1 --2- 172.21.15.132:0/275519264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab00ce500 0x7f3ab00cb2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:40.813 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.806+0000 7f3ab6456640 1 -- 172.21.15.132:0/275519264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab00ce500 msgr2=0x7f3ab00cb2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:40.814 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.806+0000 7f3ab6456640 1 --2- 172.21.15.132:0/275519264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab00ce500 0x7f3ab00cb2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:40.814 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.806+0000 7f3ab6456640 1 -- 172.21.15.132:0/275519264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ab00d16e0 msgr2=0x7f3ab015fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:40.814 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.806+0000 7f3ab6456640 1 --2- 172.21.15.132:0/275519264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ab00d16e0 0x7f3ab015fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:40.814 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.806+0000 7f3ab6456640 1 -- 172.21.15.132:0/275519264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3aac009a70 con 0x7f3ab015d410 2023-12-20T04:42:40.814 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.806+0000 7f3ab5454640 1 --2- 172.21.15.132:0/275519264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ab00d16e0 0x7f3ab015fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:40.814 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.807+0000 7f3ab6456640 1 --2- 172.21.15.132:0/275519264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ab015d410 0x7f3ab015e200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800c7c0 tx=0x7f3aa800cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:40.814 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.807+0000 7f3aa67fc640 1 -- 172.21.15.132:0/275519264 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8004230 con 0x7f3ab015d410 2023-12-20T04:42:40.815 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.807+0000 7f3aa67fc640 1 -- 172.21.15.132:0/275519264 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3aa8004390 con 0x7f3ab015d410 2023-12-20T04:42:40.815 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.807+0000 7f3ab7eb9640 1 -- 172.21.15.132:0/275519264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ab015ee10 con 0x7f3ab015d410 2023-12-20T04:42:40.815 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.807+0000 7f3aa67fc640 1 -- 172.21.15.132:0/275519264 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3aa8007860 con 0x7f3ab015d410 2023-12-20T04:42:40.815 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.807+0000 7f3ab7eb9640 1 -- 172.21.15.132:0/275519264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ab00c70f0 con 0x7f3ab015d410 2023-12-20T04:42:40.815 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.808+0000 7f3ab7eb9640 1 -- 172.21.15.132:0/275519264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ab004dff0 con 0x7f3ab015d410 2023-12-20T04:42:40.816 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.808+0000 7f3aa67fc640 1 -- 172.21.15.132:0/275519264 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3aa80079c0 con 0x7f3ab015d410 2023-12-20T04:42:40.816 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.809+0000 7f3aa67fc640 1 --2- 172.21.15.132:0/275519264 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3a9406a430 0x7f3a9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:40.816 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.809+0000 7f3aa67fc640 1 -- 172.21.15.132:0/275519264 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3aa8088790 con 0x7f3ab015d410 2023-12-20T04:42:40.816 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.809+0000 7f3ab5c55640 1 --2- 172.21.15.132:0/275519264 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3a9406a430 0x7f3a9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:40.817 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.809+0000 7f3ab5c55640 1 --2- 172.21.15.132:0/275519264 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3a9406a430 0x7f3a9406c8f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3aac036000 tx=0x7f3aac030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:40.817 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.813+0000 7f3aa67fc640 1 -- 172.21.15.132:0/275519264 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3aa8054220 con 0x7f3ab015d410 2023-12-20T04:42:40.984 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.980+0000 7f3ab7eb9640 1 -- 172.21.15.132:0/275519264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ab0159b90 con 0x7f3ab015d410 2023-12-20T04:42:40.984 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.981+0000 7f3aa67fc640 1 -- 172.21.15.132:0/275519264 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f3aa8057840 con 0x7f3ab015d410 2023-12-20T04:42:40.985 INFO:teuthology.misc.health.smithi132.stdout: 2023-12-20T04:42:40.985 INFO:teuthology.misc.health.smithi132.stdout:{"epoch":16,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:38.672188+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:42:40.986 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.983+0000 7f3ab7eb9640 1 -- 172.21.15.132:0/275519264 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3a9406a430 msgr2=0x7f3a9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:40.986 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.983+0000 7f3ab7eb9640 1 --2- 172.21.15.132:0/275519264 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3a9406a430 0x7f3a9406c8f0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f3aac036000 tx=0x7f3aac030000 comp rx=0 tx=0).stop 2023-12-20T04:42:40.986 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.983+0000 7f3ab7eb9640 1 -- 172.21.15.132:0/275519264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ab015d410 msgr2=0x7f3ab015e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:40.986 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.983+0000 7f3ab7eb9640 1 --2- 172.21.15.132:0/275519264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ab015d410 0x7f3ab015e200 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3aa800c7c0 tx=0x7f3aa800cc80 comp rx=0 tx=0).stop 2023-12-20T04:42:40.986 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.983+0000 7f3ab7eb9640 1 -- 172.21.15.132:0/275519264 shutdown_connections 2023-12-20T04:42:40.986 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.983+0000 7f3ab7eb9640 1 --2- 172.21.15.132:0/275519264 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3a9406a430 0x7f3a9406c8f0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:40.986 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.983+0000 7f3ab7eb9640 1 --2- 172.21.15.132:0/275519264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ab015d410 0x7f3ab015e200 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:40.986 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.983+0000 7f3ab7eb9640 1 --2- 172.21.15.132:0/275519264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ab00d16e0 0x7f3ab015fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:40.986 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.983+0000 7f3ab7eb9640 1 --2- 172.21.15.132:0/275519264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ab00ce500 0x7f3ab00cb2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:40.986 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.983+0000 7f3ab7eb9640 1 -- 172.21.15.132:0/275519264 >> 172.21.15.132:0/275519264 conn(0x7f3ab0069c30 msgr2=0x7f3ab00c6310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:40.986 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.983+0000 7f3ab7eb9640 1 -- 172.21.15.132:0/275519264 shutdown_connections 2023-12-20T04:42:40.986 INFO:teuthology.misc.health.smithi132.stderr:2023-12-20T04:42:40.983+0000 7f3ab7eb9640 1 -- 172.21.15.132:0/275519264 wait complete. 2023-12-20T04:42:40.995 DEBUG:teuthology.misc:8 of 8 OSDs are up 2023-12-20T04:42:40.995 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2023-12-20T04:42:40.995 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-20T04:42:40.995 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-20T04:42:40.997 INFO:tasks.ceph.mds.a:Started 2023-12-20T04:42:40.998 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-20T04:42:40.998 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-20T04:42:40.999 INFO:tasks.ceph.mds.c:Started 2023-12-20T04:42:41.000 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-20T04:42:41.000 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-20T04:42:41.002 INFO:tasks.ceph.mds.b:Started 2023-12-20T04:42:41.002 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-20T04:42:41.002 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-20T04:42:41.004 INFO:tasks.ceph.mds.d:Started 2023-12-20T04:42:41.004 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2023-12-20T04:42:41.005 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:42:41.074 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-12-20T04:42:41.074 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-12-20T04:42:41.088 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-12-20T04:42:41.088 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-12-20T04:42:41.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.107+0000 7f7fc782b640 1 Processor -- start 2023-12-20T04:42:41.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.108+0000 7f7fc782b640 1 -- start start 2023-12-20T04:42:41.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.108+0000 7f7fc782b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7fc015ab70 0x7f7fc0160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.108+0000 7f7fc782b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc00cf280 0x7f7fc0069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.109+0000 7f7fc782b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7fc006d530 con 0x7f7fc00cf730 2023-12-20T04:42:41.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.109+0000 7f7fc782b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc0070540 con 0x7f7fc015ab70 2023-12-20T04:42:41.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.109+0000 7f7fc782b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc0070790 con 0x7f7fc00cf280 2023-12-20T04:42:41.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.109+0000 7f7fc55c7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7fc015ab70 0x7f7fc0160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.109+0000 7f7fc55c7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7fc015ab70 0x7f7fc0160d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39644/0 (socket says 172.21.15.132:39644) 2023-12-20T04:42:41.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.109+0000 7f7fc55c7640 1 -- 172.21.15.132:0/2135697832 learned_addr learned my addr 172.21.15.132:0/2135697832 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:41.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.109+0000 7f7fc4dc6640 1 --2- 172.21.15.132:0/2135697832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc00cf280 0x7f7fc0069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.109+0000 7f7fb7fff640 1 -- 172.21.15.132:0/2135697832 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2852839099 0 0) 0x7f7fc006d530 con 0x7f7fc00cf730 2023-12-20T04:42:41.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.109+0000 7f7fc55c7640 1 -- 172.21.15.132:0/2135697832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc00cf280 msgr2=0x7f7fc0069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:41.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.109+0000 7f7fc55c7640 1 --2- 172.21.15.132:0/2135697832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc00cf280 0x7f7fc0069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.109+0000 7f7fc55c7640 1 -- 172.21.15.132:0/2135697832 >> v1:172.21.15.187:6789/0 conn(0x7f7fc00cf730 legacy=0x7f7fc015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.109+0000 7f7fc55c7640 1 -- 172.21.15.132:0/2135697832 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc0070a70 con 0x7f7fc015ab70 2023-12-20T04:42:41.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.110+0000 7f7fc55c7640 1 --2- 172.21.15.132:0/2135697832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc015ab70 0x7f7fc0160d70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009870 tx=0x7f7fbc02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=319af0b39ff62491 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:41.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.110+0000 7f7fb7fff640 1 -- 172.21.15.132:0/2135697832 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc030840 con 0x7f7fc015ab70 2023-12-20T04:42:41.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.110+0000 7f7fb7fff640 1 -- 172.21.15.132:0/2135697832 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc0309a0 con 0x7f7fc015ab70 2023-12-20T04:42:41.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.110+0000 7f7fb7fff640 1 -- 172.21.15.132:0/2135697832 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc030d30 con 0x7f7fc015ab70 2023-12-20T04:42:41.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.111+0000 7f7fc782b640 1 -- 172.21.15.132:0/2135697832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc015ab70 msgr2=0x7f7fc0160d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.111+0000 7f7fc782b640 1 --2- 172.21.15.132:0/2135697832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc015ab70 0x7f7fc0160d70 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc009870 tx=0x7f7fbc02b980 comp rx=0 tx=0).stop 2023-12-20T04:42:41.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.111+0000 7f7fc782b640 1 -- 172.21.15.132:0/2135697832 shutdown_connections 2023-12-20T04:42:41.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.111+0000 7f7fc782b640 1 --2- 172.21.15.132:0/2135697832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc00cf280 0x7f7fc0069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.111+0000 7f7fc782b640 1 --2- 172.21.15.132:0/2135697832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc015ab70 0x7f7fc0160d70 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.111+0000 7f7fc782b640 1 -- 172.21.15.132:0/2135697832 >> 172.21.15.132:0/2135697832 conn(0x7f7fc00cfca0 msgr2=0x7f7fc00d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:41.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.111+0000 7f7fc782b640 1 -- 172.21.15.132:0/2135697832 shutdown_connections 2023-12-20T04:42:41.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.111+0000 7f7fc782b640 1 -- 172.21.15.132:0/2135697832 wait complete. 2023-12-20T04:42:41.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.112+0000 7f7fc782b640 1 Processor -- start 2023-12-20T04:42:41.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.112+0000 7f7fc782b640 1 -- start start 2023-12-20T04:42:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc782b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc00cf280 0x7f7fc0161280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc782b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc00cf730 0x7f7fc01ea3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc4dc6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc00cf730 0x7f7fc01ea3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc4dc6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc00cf730 0x7f7fc01ea3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39654/0 (socket says 172.21.15.132:39654) 2023-12-20T04:42:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc782b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fc015ab70 0x7f7fc00b41f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc4dc6640 1 -- 172.21.15.132:0/269539512 learned_addr learned my addr 172.21.15.132:0/269539512 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc782b640 1 -- 172.21.15.132:0/269539512 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc01488c0 con 0x7f7fc00cf730 2023-12-20T04:42:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc782b640 1 -- 172.21.15.132:0/269539512 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc00c5b20 con 0x7f7fc015ab70 2023-12-20T04:42:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc55c7640 1 --2- 172.21.15.132:0/269539512 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc00cf280 0x7f7fc0161280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc782b640 1 -- 172.21.15.132:0/269539512 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc01617c0 con 0x7f7fc00cf280 2023-12-20T04:42:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc5dc8640 1 --2- 172.21.15.132:0/269539512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fc015ab70 0x7f7fc00b41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc4dc6640 1 -- 172.21.15.132:0/269539512 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc00cf280 msgr2=0x7f7fc0161280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc4dc6640 1 --2- 172.21.15.132:0/269539512 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc00cf280 0x7f7fc0161280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc4dc6640 1 -- 172.21.15.132:0/269539512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fc015ab70 msgr2=0x7f7fc00b41f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc4dc6640 1 --2- 172.21.15.132:0/269539512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fc015ab70 0x7f7fc00b41f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc4dc6640 1 -- 172.21.15.132:0/269539512 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fbc0094d0 con 0x7f7fc00cf730 2023-12-20T04:42:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc55c7640 1 --2- 172.21.15.132:0/269539512 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc00cf280 0x7f7fc0161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.113+0000 7f7fc4dc6640 1 --2- 172.21.15.132:0/269539512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc00cf730 0x7f7fc01ea3a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000e9b0 tx=0x7f7fb000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.114+0000 7f7fb5ffb640 1 -- 172.21.15.132:0/269539512 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb0009670 con 0x7f7fc00cf730 2023-12-20T04:42:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.114+0000 7f7fb5ffb640 1 -- 172.21.15.132:0/269539512 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb000c9a0 con 0x7f7fc00cf730 2023-12-20T04:42:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.114+0000 7f7fb5ffb640 1 -- 172.21.15.132:0/269539512 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb000cd50 con 0x7f7fc00cf730 2023-12-20T04:42:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.114+0000 7f7fc782b640 1 -- 172.21.15.132:0/269539512 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc0147c40 con 0x7f7fc00cf730 2023-12-20T04:42:41.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.114+0000 7f7fc782b640 1 -- 172.21.15.132:0/269539512 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc0148200 con 0x7f7fc00cf730 2023-12-20T04:42:41.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.115+0000 7f7fc782b640 1 -- 172.21.15.132:0/269539512 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc0148a00 con 0x7f7fc00cf730 2023-12-20T04:42:41.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.115+0000 7f7fb5ffb640 1 -- 172.21.15.132:0/269539512 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7fb0013470 con 0x7f7fc00cf730 2023-12-20T04:42:41.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.115+0000 7f7fb5ffb640 1 --2- 172.21.15.132:0/269539512 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7fa406a430 0x7f7fa406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.116+0000 7f7fb5ffb640 1 -- 172.21.15.132:0/269539512 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7fb00887a0 con 0x7f7fc00cf730 2023-12-20T04:42:41.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.116+0000 7f7fc55c7640 1 --2- 172.21.15.132:0/269539512 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7fa406a430 0x7f7fa406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.116+0000 7f7fc55c7640 1 --2- 172.21.15.132:0/269539512 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7fa406a430 0x7f7fa406c8f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc036000 tx=0x7f7fbc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:41.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.120+0000 7f7fb5ffb640 1 -- 172.21.15.132:0/269539512 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7fc0148a00 con 0x7f7fc00cf730 2023-12-20T04:42:41.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.286+0000 7f7fc782b640 1 -- 172.21.15.132:0/269539512 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7fc0148a00 con 0x7f7fc00cf730 2023-12-20T04:42:41.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.287+0000 7f7fb5ffb640 1 -- 172.21.15.132:0/269539512 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f7fc0148a00 con 0x7f7fc00cf730 2023-12-20T04:42:41.289 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:41.289 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":16,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:38.672188+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:42:41.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.289+0000 7f7fc782b640 1 -- 172.21.15.132:0/269539512 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7fa406a430 msgr2=0x7f7fa406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.289+0000 7f7fc782b640 1 --2- 172.21.15.132:0/269539512 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7fa406a430 0x7f7fa406c8f0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc036000 tx=0x7f7fbc008030 comp rx=0 tx=0).stop 2023-12-20T04:42:41.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.289+0000 7f7fc782b640 1 -- 172.21.15.132:0/269539512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc00cf730 msgr2=0x7f7fc01ea3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.289+0000 7f7fc782b640 1 --2- 172.21.15.132:0/269539512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc00cf730 0x7f7fc01ea3a0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f7fb000e9b0 tx=0x7f7fb000ee70 comp rx=0 tx=0).stop 2023-12-20T04:42:41.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.289+0000 7f7fc782b640 1 -- 172.21.15.132:0/269539512 shutdown_connections 2023-12-20T04:42:41.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.289+0000 7f7fc782b640 1 --2- 172.21.15.132:0/269539512 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7fa406a430 0x7f7fa406c8f0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.289+0000 7f7fc782b640 1 --2- 172.21.15.132:0/269539512 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fc015ab70 0x7f7fc00b41f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.289+0000 7f7fc782b640 1 --2- 172.21.15.132:0/269539512 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc00cf730 0x7f7fc01ea3a0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.289+0000 7f7fc782b640 1 --2- 172.21.15.132:0/269539512 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc00cf280 0x7f7fc0161280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.289+0000 7f7fc782b640 1 -- 172.21.15.132:0/269539512 >> 172.21.15.132:0/269539512 conn(0x7f7fc00cfca0 msgr2=0x7f7fc015c400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:41.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.289+0000 7f7fc782b640 1 -- 172.21.15.132:0/269539512 shutdown_connections 2023-12-20T04:42:41.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.289+0000 7f7fc782b640 1 -- 172.21.15.132:0/269539512 wait complete. 2023-12-20T04:42:41.302 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:42:41.302 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:42:41.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.401+0000 7fcbc4ce0640 1 Processor -- start 2023-12-20T04:42:41.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.402+0000 7fcbc4ce0640 1 -- start start 2023-12-20T04:42:41.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.402+0000 7fcbc4ce0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbc015cf20 0x7fcbc006c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.402+0000 7fcbc4ce0640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcbc015d300 0x7fcbc0161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.402+0000 7fcbc4ce0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcbc0161c40 con 0x7fcbc00cd4b0 2023-12-20T04:42:41.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.402+0000 7fcbc4ce0640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcbc006cc90 con 0x7fcbc015d300 2023-12-20T04:42:41.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.402+0000 7fcbc4ce0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00b2f30 con 0x7fcbc015cf20 2023-12-20T04:42:41.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.402+0000 7fcbbed9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcbc00cd4b0 0x7fcbc00ceb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38880/0 (socket says 172.21.15.132:38880) 2023-12-20T04:42:41.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.402+0000 7fcbbed9d640 1 -- 172.21.15.132:0/26035269 learned_addr learned my addr 172.21.15.132:0/26035269 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:41.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbe59c640 1 --2- 172.21.15.132:0/26035269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbc015cf20 0x7fcbc006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbb7fff640 1 --2- 172.21.15.132:0/26035269 >> v2:172.21.15.187:3300/0 conn(0x7fcbc015d300 0x7fcbc0161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbdd9b640 1 -- 172.21.15.132:0/26035269 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4029309358 0 0) 0x7fcbc0161c40 con 0x7fcbc00cd4b0 2023-12-20T04:42:41.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbdd9b640 1 -- 172.21.15.132:0/26035269 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbac003520 con 0x7fcbc00cd4b0 2023-12-20T04:42:41.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbdd9b640 1 -- 172.21.15.132:0/26035269 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 515270478 0 0) 0x7fcbac003520 con 0x7fcbc00cd4b0 2023-12-20T04:42:41.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbdd9b640 1 -- 172.21.15.132:0/26035269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbc015cf20 msgr2=0x7fcbc006c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:41.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbdd9b640 1 --2- 172.21.15.132:0/26035269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbc015cf20 0x7fcbc006c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbdd9b640 1 -- 172.21.15.132:0/26035269 >> v2:172.21.15.187:3300/0 conn(0x7fcbc015d300 msgr2=0x7fcbc0161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:41.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbdd9b640 1 --2- 172.21.15.132:0/26035269 >> v2:172.21.15.187:3300/0 conn(0x7fcbc015d300 0x7fcbc0161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbdd9b640 1 -- 172.21.15.132:0/26035269 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc00b3210 con 0x7fcbc00cd4b0 2023-12-20T04:42:41.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbdd9b640 1 -- 172.21.15.132:0/26035269 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fcbb80019f0 con 0x7fcbc00cd4b0 2023-12-20T04:42:41.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbb7fff640 1 --2- 172.21.15.132:0/26035269 >> v2:172.21.15.187:3300/0 conn(0x7fcbc015d300 0x7fcbc0161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:41.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbdd9b640 1 -- 172.21.15.132:0/26035269 >> v1:172.21.15.132:6789/0 conn(0x7fcbc00cd4b0 legacy=0x7fcbc00ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbdd9b640 1 --2- 172.21.15.132:0/26035269 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbac003970 0x7fcbac003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbdd9b640 1 --2- 172.21.15.132:0/26035269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbac0047c0 0x7fcbac004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbdd9b640 1 --2- 172.21.15.132:0/26035269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbc015cf20 0x7fcbac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbdd9b640 1 -- 172.21.15.132:0/26035269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc006cc90 con 0x7fcbac0047c0 2023-12-20T04:42:41.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbdd9b640 1 -- 172.21.15.132:0/26035269 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00b2f30 con 0x7fcbac003970 2023-12-20T04:42:41.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbdd9b640 1 -- 172.21.15.132:0/26035269 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbac00b980 con 0x7fcbc015cf20 2023-12-20T04:42:41.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbb7fff640 1 --2- 172.21.15.132:0/26035269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbac0047c0 0x7fcbac004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbe59c640 1 --2- 172.21.15.132:0/26035269 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbac003970 0x7fcbac003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbbed9d640 1 --2- 172.21.15.132:0/26035269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbc015cf20 0x7fcbac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbb7fff640 1 -- 172.21.15.132:0/26035269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbc015cf20 msgr2=0x7fcbac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbb7fff640 1 --2- 172.21.15.132:0/26035269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbc015cf20 0x7fcbac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbb7fff640 1 -- 172.21.15.132:0/26035269 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbac003970 msgr2=0x7fcbac003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbb7fff640 1 --2- 172.21.15.132:0/26035269 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbac003970 0x7fcbac003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.403+0000 7fcbb7fff640 1 -- 172.21.15.132:0/26035269 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbac003520 con 0x7fcbac0047c0 2023-12-20T04:42:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.404+0000 7fcbb7fff640 1 --2- 172.21.15.132:0/26035269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbac0047c0 0x7fcbac004c40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcba8009c90 tx=0x7fcbac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=430dff898bd085a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.404+0000 7fcbbdd9b640 1 -- 172.21.15.132:0/26035269 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba802c980 con 0x7fcbac0047c0 2023-12-20T04:42:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.404+0000 7fcbbdd9b640 1 -- 172.21.15.132:0/26035269 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba802cae0 con 0x7fcbac0047c0 2023-12-20T04:42:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.404+0000 7fcbbdd9b640 1 -- 172.21.15.132:0/26035269 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba802ce90 con 0x7fcbac0047c0 2023-12-20T04:42:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.405+0000 7fcbc4ce0640 1 -- 172.21.15.132:0/26035269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbac0047c0 msgr2=0x7fcbac004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.405+0000 7fcbc4ce0640 1 --2- 172.21.15.132:0/26035269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbac0047c0 0x7fcbac004c40 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7fcba8009c90 tx=0x7fcbac0057f0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.405+0000 7fcbbed9d640 1 -- 172.21.15.132:0/26035269 reap_dead start 2023-12-20T04:42:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.405+0000 7fcbc4ce0640 1 -- 172.21.15.132:0/26035269 shutdown_connections 2023-12-20T04:42:41.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.405+0000 7fcbc4ce0640 1 -- 172.21.15.132:0/26035269 >> 172.21.15.132:0/26035269 conn(0x7fcbc0072c60 msgr2=0x7fcbc0073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.405+0000 7fcbc4ce0640 1 -- 172.21.15.132:0/26035269 shutdown_connections 2023-12-20T04:42:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.405+0000 7fcbc4ce0640 1 -- 172.21.15.132:0/26035269 wait complete. 2023-12-20T04:42:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.406+0000 7fcbc4ce0640 1 Processor -- start 2023-12-20T04:42:41.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.406+0000 7fcbc4ce0640 1 -- start start 2023-12-20T04:42:41.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbc4ce0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbac0047c0 0x7fcbc01e79c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbc4ce0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbc00b3730 0x7fcbc014dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbc4ce0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbc00b4260 0x7fcbc00b46e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbc4ce0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00ae300 con 0x7fcbc00b3730 2023-12-20T04:42:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbc4ce0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00b4c20 con 0x7fcbac0047c0 2023-12-20T04:42:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbc4ce0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcbc00af2d0 con 0x7fcbc00b4260 2023-12-20T04:42:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbb7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbc00b3730 0x7fcbc014dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbb7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbc00b3730 0x7fcbc014dfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39672/0 (socket says 172.21.15.132:39672) 2023-12-20T04:42:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbb7fff640 1 -- 172.21.15.132:0/4040858490 learned_addr learned my addr 172.21.15.132:0/4040858490 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbbed9d640 1 --2- 172.21.15.132:0/4040858490 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbc00b4260 0x7fcbc00b46e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbbe59c640 1 --2- 172.21.15.132:0/4040858490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbac0047c0 0x7fcbc01e79c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbb7fff640 1 -- 172.21.15.132:0/4040858490 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbc00b4260 msgr2=0x7fcbc00b46e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbb7fff640 1 --2- 172.21.15.132:0/4040858490 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbc00b4260 0x7fcbc00b46e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbb7fff640 1 -- 172.21.15.132:0/4040858490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbac0047c0 msgr2=0x7fcbc01e79c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbb7fff640 1 --2- 172.21.15.132:0/4040858490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbac0047c0 0x7fcbc01e79c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbb7fff640 1 -- 172.21.15.132:0/4040858490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbc00aee40 con 0x7fcbc00b3730 2023-12-20T04:42:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbb7fff640 1 --2- 172.21.15.132:0/4040858490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbc00b3730 0x7fcbc014dfa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcba8009db0 tx=0x7fcba8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbb6ffd640 1 -- 172.21.15.132:0/4040858490 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba8034c80 con 0x7fcbc00b3730 2023-12-20T04:42:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbb6ffd640 1 -- 172.21.15.132:0/4040858490 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcba8034e20 con 0x7fcbc00b3730 2023-12-20T04:42:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbc4ce0640 1 -- 172.21.15.132:0/4040858490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbc00ae510 con 0x7fcbc00b3730 2023-12-20T04:42:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.407+0000 7fcbb6ffd640 1 -- 172.21.15.132:0/4040858490 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcba8040690 con 0x7fcbc00b3730 2023-12-20T04:42:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.408+0000 7fcbc4ce0640 1 -- 172.21.15.132:0/4040858490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcbc00aead0 con 0x7fcbc00b3730 2023-12-20T04:42:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.409+0000 7fcbc4ce0640 1 -- 172.21.15.132:0/4040858490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcbc00aec90 con 0x7fcbc00b3730 2023-12-20T04:42:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.409+0000 7fcbb6ffd640 1 -- 172.21.15.132:0/4040858490 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcba80407f0 con 0x7fcbc00b3730 2023-12-20T04:42:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.409+0000 7fcbb6ffd640 1 --2- 172.21.15.132:0/4040858490 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcba006a430 0x7fcba006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.409+0000 7fcbb6ffd640 1 -- 172.21.15.132:0/4040858490 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcba80aa860 con 0x7fcbc00b3730 2023-12-20T04:42:41.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.409+0000 7fcbbe59c640 1 --2- 172.21.15.132:0/4040858490 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcba006a430 0x7fcba006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.410+0000 7fcbbe59c640 1 --2- 172.21.15.132:0/4040858490 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcba006a430 0x7fcba006c8f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009ae0 tx=0x7fcbb0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:41.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.414+0000 7fcbb6ffd640 1 -- 172.21.15.132:0/4040858490 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcba80762e0 con 0x7fcbc00b3730 2023-12-20T04:42:41.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.580+0000 7fcbc4ce0640 1 -- 172.21.15.132:0/4040858490 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fcbc00aefd0 con 0x7fcbc00b3730 2023-12-20T04:42:41.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.580+0000 7fcbb6ffd640 1 -- 172.21.15.132:0/4040858490 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fcba80390a0 con 0x7fcbc00b3730 2023-12-20T04:42:41.582 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:42:41.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.582+0000 7fcbc4ce0640 1 -- 172.21.15.132:0/4040858490 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcba006a430 msgr2=0x7fcba006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.582+0000 7fcbc4ce0640 1 --2- 172.21.15.132:0/4040858490 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcba006a430 0x7fcba006c8f0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fcbb0009ae0 tx=0x7fcbb0009190 comp rx=0 tx=0).stop 2023-12-20T04:42:41.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.582+0000 7fcbc4ce0640 1 -- 172.21.15.132:0/4040858490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbc00b3730 msgr2=0x7fcbc014dfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.582+0000 7fcbc4ce0640 1 --2- 172.21.15.132:0/4040858490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbc00b3730 0x7fcbc014dfa0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fcba8009db0 tx=0x7fcba8004730 comp rx=0 tx=0).stop 2023-12-20T04:42:41.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.582+0000 7fcbc4ce0640 1 -- 172.21.15.132:0/4040858490 shutdown_connections 2023-12-20T04:42:41.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.582+0000 7fcbc4ce0640 1 --2- 172.21.15.132:0/4040858490 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcba006a430 0x7fcba006c8f0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.582+0000 7fcbc4ce0640 1 --2- 172.21.15.132:0/4040858490 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcbc00b4260 0x7fcbc00b46e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.582+0000 7fcbc4ce0640 1 --2- 172.21.15.132:0/4040858490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcbc00b3730 0x7fcbc014dfa0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.582+0000 7fcbc4ce0640 1 --2- 172.21.15.132:0/4040858490 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcbac0047c0 0x7fcbc01e79c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.582+0000 7fcbc4ce0640 1 -- 172.21.15.132:0/4040858490 >> 172.21.15.132:0/4040858490 conn(0x7fcbc0072c60 msgr2=0x7fcbc015bfc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:41.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.582+0000 7fcbc4ce0640 1 -- 172.21.15.132:0/4040858490 shutdown_connections 2023-12-20T04:42:41.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.582+0000 7fcbc4ce0640 1 -- 172.21.15.132:0/4040858490 wait complete. 2023-12-20T04:42:41.595 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:42:41.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.692+0000 7f941c351640 1 Processor -- start 2023-12-20T04:42:41.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.692+0000 7f941c351640 1 -- start start 2023-12-20T04:42:41.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.693+0000 7f941c351640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9414160ba0 0x7f94140cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.693+0000 7f941c351640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94140ce2a0 0x7f94140cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.693+0000 7f941c351640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9414161ff0 con 0x7f94140b0290 2023-12-20T04:42:41.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.693+0000 7f941c351640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94140cca40 con 0x7f94140ce2a0 2023-12-20T04:42:41.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.693+0000 7f941c351640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94141613e0 con 0x7f9414160ba0 2023-12-20T04:42:41.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.694+0000 7f94198ec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94140ce2a0 0x7f94140cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.694+0000 7f94198ec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94140ce2a0 0x7f94140cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39674/0 (socket says 172.21.15.132:39674) 2023-12-20T04:42:41.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.694+0000 7f94198ec640 1 -- 172.21.15.132:0/2197032499 learned_addr learned my addr 172.21.15.132:0/2197032499 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:41.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.694+0000 7f941a0ed640 1 --2- 172.21.15.132:0/2197032499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9414160ba0 0x7f94140cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.694+0000 7f94198ec640 1 -- 172.21.15.132:0/2197032499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9414160ba0 msgr2=0x7f94140cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:41.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.694+0000 7f94198ec640 1 --2- 172.21.15.132:0/2197032499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9414160ba0 0x7f94140cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.694+0000 7f94198ec640 1 -- 172.21.15.132:0/2197032499 >> v1:172.21.15.187:6789/0 conn(0x7f94140b0290 legacy=0x7f941406f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.694+0000 7f94198ec640 1 -- 172.21.15.132:0/2197032499 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94141616c0 con 0x7f94140ce2a0 2023-12-20T04:42:41.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.694+0000 7f941a0ed640 1 --2- 172.21.15.132:0/2197032499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9414160ba0 0x7f94140cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:41.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.695+0000 7f94198ec640 1 --2- 172.21.15.132:0/2197032499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94140ce2a0 0x7f94140cb8c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9404009870 tx=0x7f940402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8e73e9147df556a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:41.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.695+0000 7f94190eb640 1 -- 172.21.15.132:0/2197032499 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404031640 con 0x7f94140ce2a0 2023-12-20T04:42:41.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.695+0000 7f94190eb640 1 -- 172.21.15.132:0/2197032499 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94040317a0 con 0x7f94140ce2a0 2023-12-20T04:42:41.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.695+0000 7f94190eb640 1 -- 172.21.15.132:0/2197032499 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9404031b30 con 0x7f94140ce2a0 2023-12-20T04:42:41.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.695+0000 7f941c351640 1 -- 172.21.15.132:0/2197032499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94140ce2a0 msgr2=0x7f94140cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.695+0000 7f941c351640 1 --2- 172.21.15.132:0/2197032499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94140ce2a0 0x7f94140cb8c0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f9404009870 tx=0x7f940402b8f0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.695+0000 7f941c351640 1 -- 172.21.15.132:0/2197032499 shutdown_connections 2023-12-20T04:42:41.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.695+0000 7f941c351640 1 --2- 172.21.15.132:0/2197032499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94140ce2a0 0x7f94140cb8c0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.695+0000 7f941c351640 1 --2- 172.21.15.132:0/2197032499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9414160ba0 0x7f94140cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.695+0000 7f941c351640 1 -- 172.21.15.132:0/2197032499 >> 172.21.15.132:0/2197032499 conn(0x7f94140cd7b0 msgr2=0x7f94140cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:41.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.695+0000 7f941c351640 1 -- 172.21.15.132:0/2197032499 shutdown_connections 2023-12-20T04:42:41.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.695+0000 7f941c351640 1 -- 172.21.15.132:0/2197032499 wait complete. 2023-12-20T04:42:41.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.696+0000 7f941c351640 1 Processor -- start 2023-12-20T04:42:41.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.696+0000 7f941c351640 1 -- start start 2023-12-20T04:42:41.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.697+0000 7f941c351640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94140b0290 0x7f941415f280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.697+0000 7f941c351640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94140ce2a0 0x7f941414d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.697+0000 7f941c351640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9414160ba0 0x7f94140b1700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.697+0000 7f941c351640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94140b06f0 con 0x7f94140b0290 2023-12-20T04:42:41.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.697+0000 7f941c351640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94140b1270 con 0x7f94140ce2a0 2023-12-20T04:42:41.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.697+0000 7f941c351640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941415f7c0 con 0x7f9414160ba0 2023-12-20T04:42:41.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.697+0000 7f941a0ed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94140b0290 0x7f941415f280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.697+0000 7f941a0ed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94140b0290 0x7f941415f280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39682/0 (socket says 172.21.15.132:39682) 2023-12-20T04:42:41.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.697+0000 7f941a0ed640 1 -- 172.21.15.132:0/4226667606 learned_addr learned my addr 172.21.15.132:0/4226667606 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:41.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.697+0000 7f94198ec640 1 --2- 172.21.15.132:0/4226667606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94140ce2a0 0x7f941414d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.697+0000 7f941a8ee640 1 --2- 172.21.15.132:0/4226667606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9414160ba0 0x7f94140b1700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.698+0000 7f941a0ed640 1 -- 172.21.15.132:0/4226667606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9414160ba0 msgr2=0x7f94140b1700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.698+0000 7f941a0ed640 1 --2- 172.21.15.132:0/4226667606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9414160ba0 0x7f94140b1700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.698+0000 7f941a0ed640 1 -- 172.21.15.132:0/4226667606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94140ce2a0 msgr2=0x7f941414d290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.698+0000 7f941a0ed640 1 --2- 172.21.15.132:0/4226667606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94140ce2a0 0x7f941414d290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.698+0000 7f941a0ed640 1 -- 172.21.15.132:0/4226667606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94040094d0 con 0x7f94140b0290 2023-12-20T04:42:41.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.698+0000 7f94198ec640 1 --2- 172.21.15.132:0/4226667606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94140ce2a0 0x7f941414d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:41.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.698+0000 7f941a8ee640 1 --2- 172.21.15.132:0/4226667606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9414160ba0 0x7f94140b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:41.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.698+0000 7f941a0ed640 1 --2- 172.21.15.132:0/4226667606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94140b0290 0x7f941415f280 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f941000d800 tx=0x7f941000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:41.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.698+0000 7f940affd640 1 -- 172.21.15.132:0/4226667606 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9410004030 con 0x7f94140b0290 2023-12-20T04:42:41.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.698+0000 7f940affd640 1 -- 172.21.15.132:0/4226667606 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9410004190 con 0x7f94140b0290 2023-12-20T04:42:41.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.698+0000 7f941c351640 1 -- 172.21.15.132:0/4226667606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941414d7d0 con 0x7f94140b0290 2023-12-20T04:42:41.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.698+0000 7f940affd640 1 -- 172.21.15.132:0/4226667606 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9410004520 con 0x7f94140b0290 2023-12-20T04:42:41.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.698+0000 7f941c351640 1 -- 172.21.15.132:0/4226667606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94140b0c20 con 0x7f94140b0290 2023-12-20T04:42:41.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.699+0000 7f941c351640 1 -- 172.21.15.132:0/4226667606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941404e840 con 0x7f94140b0290 2023-12-20T04:42:41.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.699+0000 7f940affd640 1 -- 172.21.15.132:0/4226667606 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f94100096a0 con 0x7f94140b0290 2023-12-20T04:42:41.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.700+0000 7f940affd640 1 --2- 172.21.15.132:0/4226667606 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f93f806a460 0x7f93f806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:41.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.700+0000 7f940affd640 1 -- 172.21.15.132:0/4226667606 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f9410088720 con 0x7f94140b0290 2023-12-20T04:42:41.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.700+0000 7f94198ec640 1 --2- 172.21.15.132:0/4226667606 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f93f806a460 0x7f93f806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:41.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.700+0000 7f94198ec640 1 --2- 172.21.15.132:0/4226667606 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f93f806a460 0x7f93f806c920 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9404036000 tx=0x7f940403c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:41.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.704+0000 7f940affd640 1 -- 172.21.15.132:0/4226667606 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9410054050 con 0x7f94140b0290 2023-12-20T04:42:41.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.903+0000 7f941c351640 1 -- 172.21.15.132:0/4226667606 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f94140b6cb0 con 0x7f94140b0290 2023-12-20T04:42:41.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.903+0000 7f940affd640 1 -- 172.21.15.132:0/4226667606 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) v1 ==== 93+0+1259 (secure 0 0 0) 0x7f9410057670 con 0x7f94140b0290 2023-12-20T04:42:41.905 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:41.905 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2678730048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2678730048},{"type":"v1","addr":"172.21.15.132:6836","nonce":2678730048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2}],"filesystems":[]} 2023-12-20T04:42:41.906 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 2 2023-12-20T04:42:41.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.905+0000 7f941c351640 1 -- 172.21.15.132:0/4226667606 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f93f806a460 msgr2=0x7f93f806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.905+0000 7f941c351640 1 --2- 172.21.15.132:0/4226667606 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f93f806a460 0x7f93f806c920 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f9404036000 tx=0x7f940403c040 comp rx=0 tx=0).stop 2023-12-20T04:42:41.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.905+0000 7f941c351640 1 -- 172.21.15.132:0/4226667606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94140b0290 msgr2=0x7f941415f280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:41.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.905+0000 7f941c351640 1 --2- 172.21.15.132:0/4226667606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94140b0290 0x7f941415f280 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f941000d800 tx=0x7f941000dcc0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.905+0000 7f941c351640 1 -- 172.21.15.132:0/4226667606 shutdown_connections 2023-12-20T04:42:41.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.905+0000 7f941c351640 1 --2- 172.21.15.132:0/4226667606 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f93f806a460 0x7f93f806c920 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.905+0000 7f941c351640 1 --2- 172.21.15.132:0/4226667606 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9414160ba0 0x7f94140b1700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.905+0000 7f941c351640 1 --2- 172.21.15.132:0/4226667606 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94140ce2a0 0x7f941414d290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.905+0000 7f941c351640 1 --2- 172.21.15.132:0/4226667606 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94140b0290 0x7f941415f280 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:41.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.905+0000 7f941c351640 1 -- 172.21.15.132:0/4226667606 >> 172.21.15.132:0/4226667606 conn(0x7f94140cd7b0 msgr2=0x7f94140ca580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:41.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.905+0000 7f941c351640 1 -- 172.21.15.132:0/4226667606 shutdown_connections 2023-12-20T04:42:41.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:41.905+0000 7f941c351640 1 -- 172.21.15.132:0/4226667606 wait complete. 2023-12-20T04:42:43.919 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:42:44.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.028+0000 7f57cc48f640 1 Processor -- start 2023-12-20T04:42:44.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.028+0000 7f57cc48f640 1 -- start start 2023-12-20T04:42:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.029+0000 7f57cc48f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f57c406d340 0x7f57c40caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.029+0000 7f57cc48f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c415e4c0 con 0x7f57c40caa90 2023-12-20T04:42:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.029+0000 7f57cc48f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57c415e7a0 con 0x7f57c4159d00 2023-12-20T04:42:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.029+0000 7f57cc48f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57c406c220 con 0x7f57c406d340 2023-12-20T04:42:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.029+0000 7f57caa2c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f57c406d340 0x7f57c40caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.030+0000 7f57caa2c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f57c406d340 0x7f57c40caf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39688/0 (socket says 172.21.15.132:39688) 2023-12-20T04:42:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.030+0000 7f57caa2c640 1 -- 172.21.15.132:0/122910319 learned_addr learned my addr 172.21.15.132:0/122910319 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.029+0000 7f57c9a2a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f57c40caa90 0x7f57c406cc30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38894/0 (socket says 172.21.15.132:38894) 2023-12-20T04:42:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.030+0000 7f57caa2c640 1 -- 172.21.15.132:0/122910319 >> v1:172.21.15.187:6789/0 conn(0x7f57c4159d00 legacy=0x7f57c415da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.030+0000 7f57caa2c640 1 -- 172.21.15.132:0/122910319 >> v1:172.21.15.132:6789/0 conn(0x7f57c40caa90 legacy=0x7f57c406cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.030+0000 7f57caa2c640 1 -- 172.21.15.132:0/122910319 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c406c430 con 0x7f57c406d340 2023-12-20T04:42:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.030+0000 7f57c9229640 1 -- 172.21.15.132:0/122910319 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1329336615 0 0) 0x7f57c415e4c0 con 0x7f57c40caa90 2023-12-20T04:42:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.031+0000 7f57caa2c640 1 --2- 172.21.15.132:0/122910319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57c406d340 0x7f57c40caf20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f57c0009870 tx=0x7f57c002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=24afd221935a8b1d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.031+0000 7f57c9229640 1 -- 172.21.15.132:0/122910319 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c002f840 con 0x7f57c406d340 2023-12-20T04:42:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.031+0000 7f57c9229640 1 -- 172.21.15.132:0/122910319 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57c002f9a0 con 0x7f57c406d340 2023-12-20T04:42:44.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.031+0000 7f57c9229640 1 -- 172.21.15.132:0/122910319 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57c002fd30 con 0x7f57c406d340 2023-12-20T04:42:44.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.031+0000 7f57cc48f640 1 -- 172.21.15.132:0/122910319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57c406d340 msgr2=0x7f57c40caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.031+0000 7f57cc48f640 1 --2- 172.21.15.132:0/122910319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57c406d340 0x7f57c40caf20 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f57c0009870 tx=0x7f57c002ba20 comp rx=0 tx=0).stop 2023-12-20T04:42:44.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.031+0000 7f57cc48f640 1 -- 172.21.15.132:0/122910319 shutdown_connections 2023-12-20T04:42:44.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.031+0000 7f57cc48f640 1 --2- 172.21.15.132:0/122910319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57c406d340 0x7f57c40caf20 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.031+0000 7f57cc48f640 1 -- 172.21.15.132:0/122910319 >> 172.21.15.132:0/122910319 conn(0x7f57c40cfca0 msgr2=0x7f57c40d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:44.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.031+0000 7f57cc48f640 1 -- 172.21.15.132:0/122910319 shutdown_connections 2023-12-20T04:42:44.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.031+0000 7f57cc48f640 1 -- 172.21.15.132:0/122910319 wait complete. 2023-12-20T04:42:44.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.032+0000 7f57cc48f640 1 Processor -- start 2023-12-20T04:42:44.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.033+0000 7f57cc48f640 1 -- start start 2023-12-20T04:42:44.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.033+0000 7f57cc48f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57c406d340 0x7f57c41f0330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.033+0000 7f57cc48f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57c40caa90 0x7f57c40b39b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.033+0000 7f57cc48f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57c4159d00 0x7f57c41f3fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.033+0000 7f57cc48f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c41f12d0 con 0x7f57c406d340 2023-12-20T04:42:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.033+0000 7f57cc48f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57c41507d0 con 0x7f57c40caa90 2023-12-20T04:42:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.033+0000 7f57cc48f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57c40b3ef0 con 0x7f57c4159d00 2023-12-20T04:42:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.033+0000 7f57ca22b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57c406d340 0x7f57c41f0330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.033+0000 7f57ca22b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57c406d340 0x7f57c41f0330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39696/0 (socket says 172.21.15.132:39696) 2023-12-20T04:42:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.033+0000 7f57ca22b640 1 -- 172.21.15.132:0/1455733373 learned_addr learned my addr 172.21.15.132:0/1455733373 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.034+0000 7f57c9a2a640 1 --2- 172.21.15.132:0/1455733373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57c40caa90 0x7f57c40b39b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.034+0000 7f57caa2c640 1 --2- 172.21.15.132:0/1455733373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57c4159d00 0x7f57c41f3fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.034+0000 7f57ca22b640 1 -- 172.21.15.132:0/1455733373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57c4159d00 msgr2=0x7f57c41f3fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.034+0000 7f57ca22b640 1 --2- 172.21.15.132:0/1455733373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57c4159d00 0x7f57c41f3fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.034+0000 7f57ca22b640 1 -- 172.21.15.132:0/1455733373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57c40caa90 msgr2=0x7f57c40b39b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.034+0000 7f57ca22b640 1 --2- 172.21.15.132:0/1455733373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57c40caa90 0x7f57c40b39b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.034+0000 7f57ca22b640 1 -- 172.21.15.132:0/1455733373 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57c00094d0 con 0x7f57c406d340 2023-12-20T04:42:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.034+0000 7f57c9a2a640 1 --2- 172.21.15.132:0/1455733373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57c40caa90 0x7f57c40b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.034+0000 7f57ca22b640 1 --2- 172.21.15.132:0/1455733373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57c406d340 0x7f57c41f0330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00c730 tx=0x7f57bc00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.034+0000 7f57baffd640 1 -- 172.21.15.132:0/1455733373 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc003b70 con 0x7f57c406d340 2023-12-20T04:42:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.034+0000 7f57baffd640 1 -- 172.21.15.132:0/1455733373 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57bc003cf0 con 0x7f57c406d340 2023-12-20T04:42:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.034+0000 7f57cc48f640 1 -- 172.21.15.132:0/1455733373 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57c41f0a30 con 0x7f57c406d340 2023-12-20T04:42:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.034+0000 7f57baffd640 1 -- 172.21.15.132:0/1455733373 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57bc003ea0 con 0x7f57c406d340 2023-12-20T04:42:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.034+0000 7f57cc48f640 1 -- 172.21.15.132:0/1455733373 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57c41f0ff0 con 0x7f57c406d340 2023-12-20T04:42:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.035+0000 7f57cc48f640 1 -- 172.21.15.132:0/1455733373 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57c404e840 con 0x7f57c406d340 2023-12-20T04:42:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.035+0000 7f57baffd640 1 -- 172.21.15.132:0/1455733373 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f57bc00aa90 con 0x7f57c406d340 2023-12-20T04:42:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.036+0000 7f57baffd640 1 --2- 172.21.15.132:0/1455733373 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f57a806a430 0x7f57a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.036+0000 7f57c9a2a640 1 --2- 172.21.15.132:0/1455733373 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f57a806a430 0x7f57a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.036+0000 7f57baffd640 1 -- 172.21.15.132:0/1455733373 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f57bc0883e0 con 0x7f57c406d340 2023-12-20T04:42:44.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.036+0000 7f57c9a2a640 1 --2- 172.21.15.132:0/1455733373 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f57a806a430 0x7f57a806c8f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f57c4152fd0 tx=0x7f57b4007c10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:44.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.040+0000 7f57baffd640 1 -- 172.21.15.132:0/1455733373 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f57bc053d20 con 0x7f57c406d340 2023-12-20T04:42:44.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.241+0000 7f57cc48f640 1 -- 172.21.15.132:0/1455733373 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f57c4153500 con 0x7f57c406d340 2023-12-20T04:42:44.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.242+0000 7f57baffd640 1 -- 172.21.15.132:0/1455733373 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) v1 ==== 93+0+3530 (secure 0 0 0) 0x7f57bc057340 con 0x7f57c406d340 2023-12-20T04:42:44.244 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:44.244 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/342123967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":342123967},{"type":"v1","addr":"172.21.15.187:6835","nonce":342123967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2678730048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2678730048},{"type":"v1","addr":"172.21.15.132:6836","nonce":2678730048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2874427434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2874427434},{"type":"v1","addr":"172.21.15.132:6837","nonce":2874427434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4267,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/839566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":839566266},{"type":"v1","addr":"172.21.15.187:6834","nonce":839566266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[]} 2023-12-20T04:42:44.245 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 3 2023-12-20T04:42:44.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.244+0000 7f57cc48f640 1 -- 172.21.15.132:0/1455733373 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f57a806a430 msgr2=0x7f57a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.244+0000 7f57cc48f640 1 --2- 172.21.15.132:0/1455733373 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f57a806a430 0x7f57a806c8f0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f57c4152fd0 tx=0x7f57b4007c10 comp rx=0 tx=0).stop 2023-12-20T04:42:44.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.244+0000 7f57cc48f640 1 -- 172.21.15.132:0/1455733373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57c406d340 msgr2=0x7f57c41f0330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.244+0000 7f57cc48f640 1 --2- 172.21.15.132:0/1455733373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57c406d340 0x7f57c41f0330 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f57bc00c730 tx=0x7f57bc00cbf0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.244+0000 7f57cc48f640 1 -- 172.21.15.132:0/1455733373 shutdown_connections 2023-12-20T04:42:44.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.244+0000 7f57cc48f640 1 --2- 172.21.15.132:0/1455733373 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f57a806a430 0x7f57a806c8f0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.244+0000 7f57cc48f640 1 --2- 172.21.15.132:0/1455733373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57c4159d00 0x7f57c41f3fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.244+0000 7f57cc48f640 1 --2- 172.21.15.132:0/1455733373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57c40caa90 0x7f57c40b39b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.244+0000 7f57cc48f640 1 --2- 172.21.15.132:0/1455733373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57c406d340 0x7f57c41f0330 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.244+0000 7f57cc48f640 1 -- 172.21.15.132:0/1455733373 >> 172.21.15.132:0/1455733373 conn(0x7f57c40cfca0 msgr2=0x7f57c4151040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:44.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.244+0000 7f57cc48f640 1 -- 172.21.15.132:0/1455733373 shutdown_connections 2023-12-20T04:42:44.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.244+0000 7f57cc48f640 1 -- 172.21.15.132:0/1455733373 wait complete. 2023-12-20T04:42:44.257 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:42:44.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.354+0000 7f94e6c54640 1 Processor -- start 2023-12-20T04:42:44.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.354+0000 7f94e6c54640 1 -- start start 2023-12-20T04:42:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.355+0000 7f94e6c54640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015d640 0x7f94e00d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.355+0000 7f94e6c54640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f94e00d1900 0x7f94e00cf910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.355+0000 7f94e6c54640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f94e00d02e0 con 0x7f94e00cfe50 2023-12-20T04:42:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.355+0000 7f94e6c54640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94e00d2a90 con 0x7f94e00d1900 2023-12-20T04:42:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.355+0000 7f94e6c54640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00d1e80 con 0x7f94e015d640 2023-12-20T04:42:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.355+0000 7f94e51f1640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f94e00cfe50 0x7f94e00b4a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38900/0 (socket says 172.21.15.132:38900) 2023-12-20T04:42:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.355+0000 7f94e51f1640 1 -- 172.21.15.132:0/961355854 learned_addr learned my addr 172.21.15.132:0/961355854 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94e49f0640 1 --2- 172.21.15.132:0/961355854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015d640 0x7f94e00d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94df7fe640 1 -- 172.21.15.132:0/961355854 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012211042 0 0) 0x7f94d8001490 con 0x7f94e00cfe50 2023-12-20T04:42:44.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94df7fe640 1 -- 172.21.15.132:0/961355854 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f94c8003520 con 0x7f94e00cfe50 2023-12-20T04:42:44.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94dffff640 1 --2- 172.21.15.132:0/961355854 >> v2:172.21.15.187:3300/0 conn(0x7f94e00d1900 0x7f94e00cf910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94df7fe640 1 -- 172.21.15.132:0/961355854 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3031005163 0 0) 0x7f94c8003520 con 0x7f94e00cfe50 2023-12-20T04:42:44.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94df7fe640 1 -- 172.21.15.132:0/961355854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015d640 msgr2=0x7f94e00d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:44.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94df7fe640 1 --2- 172.21.15.132:0/961355854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015d640 0x7f94e00d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94df7fe640 1 -- 172.21.15.132:0/961355854 >> v2:172.21.15.187:3300/0 conn(0x7f94e00d1900 msgr2=0x7f94e00cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:44.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94df7fe640 1 --2- 172.21.15.132:0/961355854 >> v2:172.21.15.187:3300/0 conn(0x7f94e00d1900 0x7f94e00cf910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94df7fe640 1 -- 172.21.15.132:0/961355854 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e00d2160 con 0x7f94e00cfe50 2023-12-20T04:42:44.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94df7fe640 1 -- 172.21.15.132:0/961355854 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f94d8001b80 con 0x7f94e00cfe50 2023-12-20T04:42:44.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94df7fe640 1 -- 172.21.15.132:0/961355854 >> v1:172.21.15.132:6789/0 conn(0x7f94e00cfe50 legacy=0x7f94e00b4a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94df7fe640 1 --2- 172.21.15.132:0/961355854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94c8003970 0x7f94c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94df7fe640 1 --2- 172.21.15.132:0/961355854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94c80047c0 0x7f94c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94df7fe640 1 --2- 172.21.15.132:0/961355854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015d640 0x7f94c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94df7fe640 1 -- 172.21.15.132:0/961355854 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00d2a90 con 0x7f94c80047c0 2023-12-20T04:42:44.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94df7fe640 1 -- 172.21.15.132:0/961355854 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00d1e80 con 0x7f94c8003970 2023-12-20T04:42:44.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94df7fe640 1 -- 172.21.15.132:0/961355854 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94c800b980 con 0x7f94e015d640 2023-12-20T04:42:44.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94dffff640 1 --2- 172.21.15.132:0/961355854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94c80047c0 0x7f94c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94e49f0640 1 --2- 172.21.15.132:0/961355854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94c8003970 0x7f94c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94e51f1640 1 --2- 172.21.15.132:0/961355854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015d640 0x7f94c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94dffff640 1 -- 172.21.15.132:0/961355854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015d640 msgr2=0x7f94c8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:44.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94dffff640 1 --2- 172.21.15.132:0/961355854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e015d640 0x7f94c8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94dffff640 1 -- 172.21.15.132:0/961355854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94c8003970 msgr2=0x7f94c8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:44.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94dffff640 1 --2- 172.21.15.132:0/961355854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94c8003970 0x7f94c8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.356+0000 7f94dffff640 1 -- 172.21.15.132:0/961355854 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94c8003520 con 0x7f94c80047c0 2023-12-20T04:42:44.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.357+0000 7f94dffff640 1 --2- 172.21.15.132:0/961355854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94c80047c0 0x7f94c8004c40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f94d4009ac0 tx=0x7f94c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c698026ab1308e7b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:44.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.357+0000 7f94df7fe640 1 -- 172.21.15.132:0/961355854 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d402c710 con 0x7f94c80047c0 2023-12-20T04:42:44.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.357+0000 7f94df7fe640 1 -- 172.21.15.132:0/961355854 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d402c870 con 0x7f94c80047c0 2023-12-20T04:42:44.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.357+0000 7f94df7fe640 1 -- 172.21.15.132:0/961355854 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d402cc00 con 0x7f94c80047c0 2023-12-20T04:42:44.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.358+0000 7f94e6c54640 1 -- 172.21.15.132:0/961355854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94c80047c0 msgr2=0x7f94c8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.358+0000 7f94e6c54640 1 --2- 172.21.15.132:0/961355854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94c80047c0 0x7f94c8004c40 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f94d4009ac0 tx=0x7f94c80057f0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.358+0000 7f94e51f1640 1 -- 172.21.15.132:0/961355854 reap_dead start 2023-12-20T04:42:44.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.358+0000 7f94e6c54640 1 -- 172.21.15.132:0/961355854 shutdown_connections 2023-12-20T04:42:44.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.358+0000 7f94e6c54640 1 -- 172.21.15.132:0/961355854 >> 172.21.15.132:0/961355854 conn(0x7f94e006be70 msgr2=0x7f94e006c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:44.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.358+0000 7f94e6c54640 1 -- 172.21.15.132:0/961355854 shutdown_connections 2023-12-20T04:42:44.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.358+0000 7f94e6c54640 1 -- 172.21.15.132:0/961355854 wait complete. 2023-12-20T04:42:44.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.359+0000 7f94e6c54640 1 Processor -- start 2023-12-20T04:42:44.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.359+0000 7f94e6c54640 1 -- start start 2023-12-20T04:42:44.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e6c54640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94c80047c0 0x7f94e00c8d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e6c54640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94e01f6900 0x7f94e0143ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e6c54640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e00cb940 0x7f94e00b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e6c54640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e00cb520 con 0x7f94c80047c0 2023-12-20T04:42:44.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e6c54640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94e01447d0 con 0x7f94e01f6900 2023-12-20T04:42:44.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e6c54640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94e0144ab0 con 0x7f94e00cb940 2023-12-20T04:42:44.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e49f0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94c80047c0 0x7f94e00c8d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e49f0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94c80047c0 0x7f94e00c8d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39706/0 (socket says 172.21.15.132:39706) 2023-12-20T04:42:44.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e49f0640 1 -- 172.21.15.132:0/3208539824 learned_addr learned my addr 172.21.15.132:0/3208539824 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:44.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e51f1640 1 --2- 172.21.15.132:0/3208539824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e00cb940 0x7f94e00b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94dffff640 1 --2- 172.21.15.132:0/3208539824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94e01f6900 0x7f94e0143ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e49f0640 1 -- 172.21.15.132:0/3208539824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e00cb940 msgr2=0x7f94e00b72c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e49f0640 1 --2- 172.21.15.132:0/3208539824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e00cb940 0x7f94e00b72c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e49f0640 1 -- 172.21.15.132:0/3208539824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94e01f6900 msgr2=0x7f94e0143ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e49f0640 1 --2- 172.21.15.132:0/3208539824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94e01f6900 0x7f94e0143ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e49f0640 1 -- 172.21.15.132:0/3208539824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94e00cb140 con 0x7f94c80047c0 2023-12-20T04:42:44.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e51f1640 1 --2- 172.21.15.132:0/3208539824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e00cb940 0x7f94e00b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:44.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94dffff640 1 --2- 172.21.15.132:0/3208539824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94e01f6900 0x7f94e0143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:44.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e49f0640 1 --2- 172.21.15.132:0/3208539824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94c80047c0 0x7f94e00c8d20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f94d00118e0 tx=0x7f94d0011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:44.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94dd7fa640 1 -- 172.21.15.132:0/3208539824 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d000faf0 con 0x7f94c80047c0 2023-12-20T04:42:44.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94dd7fa640 1 -- 172.21.15.132:0/3208539824 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94d000fc50 con 0x7f94c80047c0 2023-12-20T04:42:44.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94e6c54640 1 -- 172.21.15.132:0/3208539824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94e0144d90 con 0x7f94c80047c0 2023-12-20T04:42:44.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.360+0000 7f94dd7fa640 1 -- 172.21.15.132:0/3208539824 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94d0014440 con 0x7f94c80047c0 2023-12-20T04:42:44.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.361+0000 7f94e6c54640 1 -- 172.21.15.132:0/3208539824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94e00cbdc0 con 0x7f94c80047c0 2023-12-20T04:42:44.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.362+0000 7f94e6c54640 1 -- 172.21.15.132:0/3208539824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94e00cc040 con 0x7f94c80047c0 2023-12-20T04:42:44.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.362+0000 7f94dd7fa640 1 -- 172.21.15.132:0/3208539824 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f94d00145a0 con 0x7f94c80047c0 2023-12-20T04:42:44.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.362+0000 7f94dd7fa640 1 --2- 172.21.15.132:0/3208539824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f94cc06a460 0x7f94cc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.363+0000 7f94dd7fa640 1 -- 172.21.15.132:0/3208539824 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f94d0088d40 con 0x7f94c80047c0 2023-12-20T04:42:44.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.363+0000 7f94dffff640 1 --2- 172.21.15.132:0/3208539824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f94cc06a460 0x7f94cc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.363+0000 7f94dffff640 1 --2- 172.21.15.132:0/3208539824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f94cc06a460 0x7f94cc06c920 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f94d4036000 tx=0x7f94d4030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:44.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.367+0000 7f94dd7fa640 1 -- 172.21.15.132:0/3208539824 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f94d0054710 con 0x7f94c80047c0 2023-12-20T04:42:44.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.534+0000 7f94e6c54640 1 -- 172.21.15.132:0/3208539824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f94e004e840 con 0x7f94c80047c0 2023-12-20T04:42:44.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.535+0000 7f94dd7fa640 1 -- 172.21.15.132:0/3208539824 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) v1 ==== 74+0+12430 (secure 0 0 0) 0x7f94d0057d30 con 0x7f94c80047c0 2023-12-20T04:42:44.537 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:44.537 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":16,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:38.672188+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:42:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.537+0000 7f94e6c54640 1 -- 172.21.15.132:0/3208539824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f94cc06a460 msgr2=0x7f94cc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.537+0000 7f94e6c54640 1 --2- 172.21.15.132:0/3208539824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f94cc06a460 0x7f94cc06c920 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f94d4036000 tx=0x7f94d4030000 comp rx=0 tx=0).stop 2023-12-20T04:42:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.537+0000 7f94e6c54640 1 -- 172.21.15.132:0/3208539824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94c80047c0 msgr2=0x7f94e00c8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.537+0000 7f94e6c54640 1 --2- 172.21.15.132:0/3208539824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94c80047c0 0x7f94e00c8d20 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f94d00118e0 tx=0x7f94d0011da0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.537+0000 7f94e6c54640 1 -- 172.21.15.132:0/3208539824 shutdown_connections 2023-12-20T04:42:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.537+0000 7f94e6c54640 1 --2- 172.21.15.132:0/3208539824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f94cc06a460 0x7f94cc06c920 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.537+0000 7f94e6c54640 1 --2- 172.21.15.132:0/3208539824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94e00cb940 0x7f94e00b72c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.537+0000 7f94e6c54640 1 --2- 172.21.15.132:0/3208539824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94e01f6900 0x7f94e0143ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.537+0000 7f94e6c54640 1 --2- 172.21.15.132:0/3208539824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94c80047c0 0x7f94e00c8d20 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.537+0000 7f94e6c54640 1 -- 172.21.15.132:0/3208539824 >> 172.21.15.132:0/3208539824 conn(0x7f94e006be70 msgr2=0x7f94e0159220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.537+0000 7f94e6c54640 1 -- 172.21.15.132:0/3208539824 shutdown_connections 2023-12-20T04:42:44.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.537+0000 7f94e6c54640 1 -- 172.21.15.132:0/3208539824 wait complete. 2023-12-20T04:42:44.551 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:42:44.551 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:42:44.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.651+0000 7fd3837c9640 1 Processor -- start 2023-12-20T04:42:44.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.651+0000 7fd3837c9640 1 -- start start 2023-12-20T04:42:44.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.652+0000 7fd3837c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd37c069c30 0x7fd37c070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.652+0000 7fd3837c9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd37c15d360 0x7fd37c06a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.652+0000 7fd3837c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37c0cbde0 0x7fd37c0ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.652+0000 7fd3837c9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37c0c4f40 con 0x7fd37c069c30 2023-12-20T04:42:44.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.652+0000 7fd3837c9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd37c0af5b0 con 0x7fd37c15d360 2023-12-20T04:42:44.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.652+0000 7fd3837c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c06a550 con 0x7fd37c0cbde0 2023-12-20T04:42:44.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.652+0000 7fd381565640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd37c069c30 0x7fd37c070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.652+0000 7fd381565640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd37c069c30 0x7fd37c070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39722/0 (socket says 172.21.15.132:39722) 2023-12-20T04:42:44.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.652+0000 7fd381565640 1 -- 172.21.15.132:0/2500064932 learned_addr learned my addr 172.21.15.132:0/2500064932 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:44.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.652+0000 7fd381d66640 1 --2- 172.21.15.132:0/2500064932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37c0cbde0 0x7fd37c0ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.653+0000 7fd380d64640 1 --2- 172.21.15.132:0/2500064932 >> v2:172.21.15.187:3300/0 conn(0x7fd37c15d360 0x7fd37c06a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.653+0000 7fd381565640 1 -- 172.21.15.132:0/2500064932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37c0cbde0 msgr2=0x7fd37c0ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:44.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.653+0000 7fd381565640 1 --2- 172.21.15.132:0/2500064932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37c0cbde0 0x7fd37c0ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.653+0000 7fd381565640 1 -- 172.21.15.132:0/2500064932 >> v2:172.21.15.187:3300/0 conn(0x7fd37c15d360 msgr2=0x7fd37c06a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:44.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.653+0000 7fd381565640 1 --2- 172.21.15.132:0/2500064932 >> v2:172.21.15.187:3300/0 conn(0x7fd37c15d360 0x7fd37c06a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.653+0000 7fd381565640 1 -- 172.21.15.132:0/2500064932 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd37c070a40 con 0x7fd37c069c30 2023-12-20T04:42:44.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.653+0000 7fd381565640 1 --2- 172.21.15.132:0/2500064932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd37c069c30 0x7fd37c070460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0b5dc0 tx=0x7fd37802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95e83af82b509aa5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:44.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.654+0000 7fd373fff640 1 -- 172.21.15.132:0/2500064932 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378031870 con 0x7fd37c069c30 2023-12-20T04:42:44.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.654+0000 7fd373fff640 1 -- 172.21.15.132:0/2500064932 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd3780319d0 con 0x7fd37c069c30 2023-12-20T04:42:44.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.654+0000 7fd373fff640 1 -- 172.21.15.132:0/2500064932 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378031d60 con 0x7fd37c069c30 2023-12-20T04:42:44.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.654+0000 7fd3837c9640 1 -- 172.21.15.132:0/2500064932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd37c069c30 msgr2=0x7fd37c070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.654+0000 7fd3837c9640 1 --2- 172.21.15.132:0/2500064932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd37c069c30 0x7fd37c070460 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0b5dc0 tx=0x7fd37802b910 comp rx=0 tx=0).stop 2023-12-20T04:42:44.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.654+0000 7fd3837c9640 1 -- 172.21.15.132:0/2500064932 shutdown_connections 2023-12-20T04:42:44.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.654+0000 7fd3837c9640 1 --2- 172.21.15.132:0/2500064932 >> v2:172.21.15.187:3300/0 conn(0x7fd37c15d360 0x7fd37c06a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.654+0000 7fd3837c9640 1 --2- 172.21.15.132:0/2500064932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37c0cbde0 0x7fd37c0ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.654+0000 7fd3837c9640 1 --2- 172.21.15.132:0/2500064932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd37c069c30 0x7fd37c070460 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.654+0000 7fd3837c9640 1 -- 172.21.15.132:0/2500064932 >> 172.21.15.132:0/2500064932 conn(0x7fd37c0cc630 msgr2=0x7fd37c0cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:44.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.654+0000 7fd3837c9640 1 -- 172.21.15.132:0/2500064932 shutdown_connections 2023-12-20T04:42:44.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.654+0000 7fd3837c9640 1 -- 172.21.15.132:0/2500064932 wait complete. 2023-12-20T04:42:44.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.655+0000 7fd3837c9640 1 Processor -- start 2023-12-20T04:42:44.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.655+0000 7fd3837c9640 1 -- start start 2023-12-20T04:42:44.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.656+0000 7fd3837c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd37c069c30 0x7fd37c0b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.656+0000 7fd3837c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37c0cbde0 0x7fd37c0b3a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.656+0000 7fd3837c9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd37c15d360 0x7fd37c15a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.656+0000 7fd3837c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c15e150 con 0x7fd37c069c30 2023-12-20T04:42:44.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.656+0000 7fd3837c9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0b2e30 con 0x7fd37c15d360 2023-12-20T04:42:44.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.656+0000 7fd3837c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd37c0b3060 con 0x7fd37c0cbde0 2023-12-20T04:42:44.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.656+0000 7fd381565640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd37c069c30 0x7fd37c0b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.656+0000 7fd381565640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd37c069c30 0x7fd37c0b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39726/0 (socket says 172.21.15.132:39726) 2023-12-20T04:42:44.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.656+0000 7fd381565640 1 -- 172.21.15.132:0/2021111099 learned_addr learned my addr 172.21.15.132:0/2021111099 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:44.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.656+0000 7fd380d64640 1 --2- 172.21.15.132:0/2021111099 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37c0cbde0 0x7fd37c0b3a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.656+0000 7fd381565640 1 -- 172.21.15.132:0/2021111099 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37c0cbde0 msgr2=0x7fd37c0b3a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.656+0000 7fd381565640 1 --2- 172.21.15.132:0/2021111099 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37c0cbde0 0x7fd37c0b3a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.656+0000 7fd381d66640 1 --2- 172.21.15.132:0/2021111099 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd37c15d360 0x7fd37c15a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.656+0000 7fd381565640 1 -- 172.21.15.132:0/2021111099 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd37c15d360 msgr2=0x7fd37c15a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.656+0000 7fd381565640 1 --2- 172.21.15.132:0/2021111099 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd37c15d360 0x7fd37c15a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.656+0000 7fd381565640 1 -- 172.21.15.132:0/2021111099 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3780094d0 con 0x7fd37c069c30 2023-12-20T04:42:44.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.657+0000 7fd381565640 1 --2- 172.21.15.132:0/2021111099 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd37c069c30 0x7fd37c0b28f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd37802b950 tx=0x7fd3780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:44.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.657+0000 7fd371ffb640 1 -- 172.21.15.132:0/2021111099 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd37803ac60 con 0x7fd37c069c30 2023-12-20T04:42:44.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.657+0000 7fd371ffb640 1 -- 172.21.15.132:0/2021111099 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd37803adc0 con 0x7fd37c069c30 2023-12-20T04:42:44.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.657+0000 7fd3837c9640 1 -- 172.21.15.132:0/2021111099 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd37c0b3340 con 0x7fd37c069c30 2023-12-20T04:42:44.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.657+0000 7fd371ffb640 1 -- 172.21.15.132:0/2021111099 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd378044630 con 0x7fd37c069c30 2023-12-20T04:42:44.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.657+0000 7fd3837c9640 1 -- 172.21.15.132:0/2021111099 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd37c15e640 con 0x7fd37c069c30 2023-12-20T04:42:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.658+0000 7fd3837c9640 1 -- 172.21.15.132:0/2021111099 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37c04e840 con 0x7fd37c069c30 2023-12-20T04:42:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.658+0000 7fd371ffb640 1 -- 172.21.15.132:0/2021111099 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd37804d450 con 0x7fd37c069c30 2023-12-20T04:42:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.659+0000 7fd371ffb640 1 --2- 172.21.15.132:0/2021111099 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd36006a460 0x7fd36006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.659+0000 7fd371ffb640 1 -- 172.21.15.132:0/2021111099 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd37802d040 con 0x7fd37c069c30 2023-12-20T04:42:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.659+0000 7fd380d64640 1 --2- 172.21.15.132:0/2021111099 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd36006a460 0x7fd36006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.659+0000 7fd380d64640 1 --2- 172.21.15.132:0/2021111099 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd36006a460 0x7fd36006c920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0caf50 tx=0x7fd36c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:44.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.663+0000 7fd371ffb640 1 -- 172.21.15.132:0/2021111099 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd3780764c0 con 0x7fd37c069c30 2023-12-20T04:42:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.830+0000 7fd3837c9640 1 -- 172.21.15.132:0/2021111099 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd37c06a9a0 con 0x7fd37c069c30 2023-12-20T04:42:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.830+0000 7fd371ffb640 1 -- 172.21.15.132:0/2021111099 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd378035020 con 0x7fd37c069c30 2023-12-20T04:42:44.832 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:42:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.832+0000 7fd3837c9640 1 -- 172.21.15.132:0/2021111099 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd36006a460 msgr2=0x7fd36006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.832+0000 7fd3837c9640 1 --2- 172.21.15.132:0/2021111099 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd36006a460 0x7fd36006c920 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fd37c0caf50 tx=0x7fd36c008040 comp rx=0 tx=0).stop 2023-12-20T04:42:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.832+0000 7fd3837c9640 1 -- 172.21.15.132:0/2021111099 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd37c069c30 msgr2=0x7fd37c0b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.832+0000 7fd3837c9640 1 --2- 172.21.15.132:0/2021111099 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd37c069c30 0x7fd37c0b28f0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fd37802b950 tx=0x7fd3780046c0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.832+0000 7fd3837c9640 1 -- 172.21.15.132:0/2021111099 shutdown_connections 2023-12-20T04:42:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.832+0000 7fd3837c9640 1 --2- 172.21.15.132:0/2021111099 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd36006a460 0x7fd36006c920 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.832+0000 7fd3837c9640 1 --2- 172.21.15.132:0/2021111099 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd37c15d360 0x7fd37c15a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.832+0000 7fd3837c9640 1 --2- 172.21.15.132:0/2021111099 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd37c0cbde0 0x7fd37c0b3a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.832+0000 7fd3837c9640 1 --2- 172.21.15.132:0/2021111099 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd37c069c30 0x7fd37c0b28f0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.832+0000 7fd3837c9640 1 -- 172.21.15.132:0/2021111099 >> 172.21.15.132:0/2021111099 conn(0x7fd37c0cc630 msgr2=0x7fd37c15c050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.832+0000 7fd3837c9640 1 -- 172.21.15.132:0/2021111099 shutdown_connections 2023-12-20T04:42:44.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.832+0000 7fd3837c9640 1 -- 172.21.15.132:0/2021111099 wait complete. 2023-12-20T04:42:44.845 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-20T04:42:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.942+0000 7f4767c2c640 1 Processor -- start 2023-12-20T04:42:44.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.942+0000 7f4767c2c640 1 -- start start 2023-12-20T04:42:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.943+0000 7f4767c2c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4760159bb0 0x7f476006f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.943+0000 7f4767c2c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f476006bba0 0x7f47600ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.943+0000 7f4767c2c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f476006c8e0 con 0x7f47600ad720 2023-12-20T04:42:44.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.943+0000 7f4767c2c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f476015e420 con 0x7f4760159bb0 2023-12-20T04:42:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.943+0000 7f4767c2c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f476015e700 con 0x7f476006bba0 2023-12-20T04:42:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.943+0000 7f47659c8640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4760159bb0 0x7f476006f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.943+0000 7f47661c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f476006bba0 0x7f47600ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.943+0000 7f47661c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f476006bba0 0x7f47600ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:58718/0 (socket says 172.21.15.132:58718) 2023-12-20T04:42:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.943+0000 7f47659c8640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4760159bb0 0x7f476006f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:36310/0 (socket says 172.21.15.132:36310) 2023-12-20T04:42:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.943+0000 7f47661c9640 1 -- 172.21.15.132:0/835109435 learned_addr learned my addr 172.21.15.132:0/835109435 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.944+0000 7f47659c8640 1 -- 172.21.15.132:0/835109435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f476006bba0 msgr2=0x7f47600ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.944+0000 7f47659c8640 1 --2- 172.21.15.132:0/835109435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f476006bba0 0x7f47600ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.944+0000 7f47659c8640 1 -- 172.21.15.132:0/835109435 >> v1:172.21.15.187:6789/0 conn(0x7f47600ad720 legacy=0x7f476006b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.944+0000 7f47659c8640 1 -- 172.21.15.132:0/835109435 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47600c9d10 con 0x7f4760159bb0 2023-12-20T04:42:44.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.944+0000 7f47661c9640 1 --2- 172.21.15.132:0/835109435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f476006bba0 0x7f47600ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.944+0000 7f47659c8640 1 --2- 172.21.15.132:0/835109435 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4760159bb0 0x7f476006f3e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f475c0097a0 tx=0x7f475c02b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c124f0e5bbf66972 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.945+0000 7f47649c6640 1 -- 172.21.15.132:0/835109435 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c031830 con 0x7f4760159bb0 2023-12-20T04:42:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.945+0000 7f47649c6640 1 -- 172.21.15.132:0/835109435 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f475c031990 con 0x7f4760159bb0 2023-12-20T04:42:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.945+0000 7f47649c6640 1 -- 172.21.15.132:0/835109435 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f475c031d20 con 0x7f4760159bb0 2023-12-20T04:42:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.945+0000 7f4767c2c640 1 -- 172.21.15.132:0/835109435 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4760159bb0 msgr2=0x7f476006f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.945+0000 7f4767c2c640 1 --2- 172.21.15.132:0/835109435 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4760159bb0 0x7f476006f3e0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7f475c0097a0 tx=0x7f475c02b8d0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.945+0000 7f4767c2c640 1 -- 172.21.15.132:0/835109435 shutdown_connections 2023-12-20T04:42:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.945+0000 7f4767c2c640 1 --2- 172.21.15.132:0/835109435 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f476006bba0 0x7f47600ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.945+0000 7f4767c2c640 1 --2- 172.21.15.132:0/835109435 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4760159bb0 0x7f476006f3e0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.945+0000 7f4767c2c640 1 -- 172.21.15.132:0/835109435 >> 172.21.15.132:0/835109435 conn(0x7f476006a260 msgr2=0x7f47600b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.945+0000 7f4767c2c640 1 -- 172.21.15.132:0/835109435 shutdown_connections 2023-12-20T04:42:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.945+0000 7f4767c2c640 1 -- 172.21.15.132:0/835109435 wait complete. 2023-12-20T04:42:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.946+0000 7f4767c2c640 1 Processor -- start 2023-12-20T04:42:44.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.946+0000 7f4767c2c640 1 -- start start 2023-12-20T04:42:44.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.947+0000 7f4767c2c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f476006bba0 0x7f476015b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.947+0000 7f4767c2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47600ad720 0x7f47600c4c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.947+0000 7f4767c2c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4760159bb0 0x7f4760147730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.947+0000 7f4767c2c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f476015b610 con 0x7f47600ad720 2023-12-20T04:42:44.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.947+0000 7f4767c2c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4760145b70 con 0x7f476006bba0 2023-12-20T04:42:44.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.947+0000 7f4767c2c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4760144f60 con 0x7f4760159bb0 2023-12-20T04:42:44.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.947+0000 7f47651c7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47600ad720 0x7f47600c4c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.947+0000 7f47651c7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47600ad720 0x7f47600c4c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39736/0 (socket says 172.21.15.132:39736) 2023-12-20T04:42:44.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.947+0000 7f47651c7640 1 -- 172.21.15.132:0/3503508489 learned_addr learned my addr 172.21.15.132:0/3503508489 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:44.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.947+0000 7f47659c8640 1 --2- 172.21.15.132:0/3503508489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f476006bba0 0x7f476015b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.947+0000 7f47661c9640 1 --2- 172.21.15.132:0/3503508489 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4760159bb0 0x7f4760147730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.947+0000 7f47651c7640 1 -- 172.21.15.132:0/3503508489 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4760159bb0 msgr2=0x7f4760147730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.947+0000 7f47651c7640 1 --2- 172.21.15.132:0/3503508489 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4760159bb0 0x7f4760147730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.947+0000 7f47651c7640 1 -- 172.21.15.132:0/3503508489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f476006bba0 msgr2=0x7f476015b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:44.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.947+0000 7f47651c7640 1 --2- 172.21.15.132:0/3503508489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f476006bba0 0x7f476015b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:44.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.947+0000 7f47651c7640 1 -- 172.21.15.132:0/3503508489 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4758009b30 con 0x7f47600ad720 2023-12-20T04:42:44.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.948+0000 7f47651c7640 1 --2- 172.21.15.132:0/3503508489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47600ad720 0x7f47600c4c90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f475000c450 tx=0x7f475000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:44.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.948+0000 7f47567fc640 1 -- 172.21.15.132:0/3503508489 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47500052d0 con 0x7f47600ad720 2023-12-20T04:42:44.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.948+0000 7f47567fc640 1 -- 172.21.15.132:0/3503508489 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4750005430 con 0x7f47600ad720 2023-12-20T04:42:44.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.948+0000 7f47567fc640 1 -- 172.21.15.132:0/3503508489 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4750012870 con 0x7f47600ad720 2023-12-20T04:42:44.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.948+0000 7f4767c2c640 1 -- 172.21.15.132:0/3503508489 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f475c009400 con 0x7f47600ad720 2023-12-20T04:42:44.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.948+0000 7f4767c2c640 1 -- 172.21.15.132:0/3503508489 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4760145520 con 0x7f47600ad720 2023-12-20T04:42:44.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.949+0000 7f4767c2c640 1 -- 172.21.15.132:0/3503508489 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4760145d00 con 0x7f47600ad720 2023-12-20T04:42:44.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.949+0000 7f47567fc640 1 -- 172.21.15.132:0/3503508489 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f47500129d0 con 0x7f47600ad720 2023-12-20T04:42:44.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.950+0000 7f47567fc640 1 --2- 172.21.15.132:0/3503508489 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f474406a430 0x7f474406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:44.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.950+0000 7f47567fc640 1 -- 172.21.15.132:0/3503508489 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4750088130 con 0x7f47600ad720 2023-12-20T04:42:44.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.950+0000 7f47659c8640 1 --2- 172.21.15.132:0/3503508489 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f474406a430 0x7f474406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:44.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.950+0000 7f47659c8640 1 --2- 172.21.15.132:0/3503508489 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f474406a430 0x7f474406c8f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f475c036000 tx=0x7f475c03c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:44.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:44.954+0000 7f47567fc640 1 -- 172.21.15.132:0/3503508489 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4750053a70 con 0x7f47600ad720 2023-12-20T04:42:45.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.122+0000 7f4767c2c640 1 -- 172.21.15.132:0/3503508489 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f47600cc590 con 0x7f47600ad720 2023-12-20T04:42:45.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.122+0000 7f47567fc640 1 -- 172.21.15.132:0/3503508489 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) v1 ==== 84+0+65 (secure 0 0 0) 0x7f4750057090 con 0x7f47600ad720 2023-12-20T04:42:45.124 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:45.124 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-12-20T04:42:45.124 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:42:45.124 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-12-20T04:42:45.124 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-12-20T04:42:45.124 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:42:45.124 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-12-20T04:42:45.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.124+0000 7f4767c2c640 1 -- 172.21.15.132:0/3503508489 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f474406a430 msgr2=0x7f474406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:45.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.124+0000 7f4767c2c640 1 --2- 172.21.15.132:0/3503508489 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f474406a430 0x7f474406c8f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f475c036000 tx=0x7f475c03c040 comp rx=0 tx=0).stop 2023-12-20T04:42:45.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.124+0000 7f4767c2c640 1 -- 172.21.15.132:0/3503508489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47600ad720 msgr2=0x7f47600c4c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:45.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.124+0000 7f4767c2c640 1 --2- 172.21.15.132:0/3503508489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47600ad720 0x7f47600c4c90 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f475000c450 tx=0x7f475000c910 comp rx=0 tx=0).stop 2023-12-20T04:42:45.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.124+0000 7f4767c2c640 1 -- 172.21.15.132:0/3503508489 shutdown_connections 2023-12-20T04:42:45.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.124+0000 7f4767c2c640 1 --2- 172.21.15.132:0/3503508489 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f474406a430 0x7f474406c8f0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.124+0000 7f4767c2c640 1 --2- 172.21.15.132:0/3503508489 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4760159bb0 0x7f4760147730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.124+0000 7f4767c2c640 1 --2- 172.21.15.132:0/3503508489 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47600ad720 0x7f47600c4c90 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.124+0000 7f4767c2c640 1 --2- 172.21.15.132:0/3503508489 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f476006bba0 0x7f476015b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.124+0000 7f4767c2c640 1 -- 172.21.15.132:0/3503508489 >> 172.21.15.132:0/3503508489 conn(0x7f476006a260 msgr2=0x7f47600af130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:45.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.124+0000 7f4767c2c640 1 -- 172.21.15.132:0/3503508489 shutdown_connections 2023-12-20T04:42:45.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.124+0000 7f4767c2c640 1 -- 172.21.15.132:0/3503508489 wait complete. 2023-12-20T04:42:45.137 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-20T04:42:45.137 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-20T04:42:45.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.238+0000 7fdcc545f640 1 Processor -- start 2023-12-20T04:42:45.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.238+0000 7fdcc545f640 1 -- start start 2023-12-20T04:42:45.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.239+0000 7fdcc545f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc015d300 0x7fdcc00d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:45.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.239+0000 7fdcc545f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdcc00d17d0 0x7fdcc00cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:45.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.239+0000 7fdcc545f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc00d2920 con 0x7fdcc00cfcd0 2023-12-20T04:42:45.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.239+0000 7fdcc545f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc00d0160 con 0x7fdcc00d17d0 2023-12-20T04:42:45.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.239+0000 7fdcc545f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc00d1d10 con 0x7fdcc015d300 2023-12-20T04:42:45.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.239+0000 7fdcbeffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc015d300 0x7fdcc00d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:45.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.239+0000 7fdcbe7fc640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdcc00d17d0 0x7fdcc00cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:45.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.240+0000 7fdcbeffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc015d300 0x7fdcc00d1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:58738/0 (socket says 172.21.15.132:58738) 2023-12-20T04:42:45.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.240+0000 7fdcbeffd640 1 -- 172.21.15.132:0/1042069305 learned_addr learned my addr 172.21.15.132:0/1042069305 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:45.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.240+0000 7fdcbf7fe640 1 --1- 172.21.15.132:0/1042069305 >> v1:172.21.15.187:6789/0 conn(0x7fdcc00cfcd0 0x7fdcc00b48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:46586/0 (socket says 172.21.15.132:46586) 2023-12-20T04:42:45.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.240+0000 7fdcbe7fc640 1 -- 172.21.15.132:0/1042069305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc015d300 msgr2=0x7fdcc00d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:45.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.240+0000 7fdcbe7fc640 1 --2- 172.21.15.132:0/1042069305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc015d300 0x7fdcc00d1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.240+0000 7fdcbe7fc640 1 -- 172.21.15.132:0/1042069305 >> v1:172.21.15.187:6789/0 conn(0x7fdcc00cfcd0 legacy=0x7fdcc00b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:45.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.240+0000 7fdcbe7fc640 1 -- 172.21.15.132:0/1042069305 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc00d1ff0 con 0x7fdcc00d17d0 2023-12-20T04:42:45.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.240+0000 7fdcbeffd640 1 --2- 172.21.15.132:0/1042069305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc015d300 0x7fdcc00d1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.241+0000 7fdcbe7fc640 1 --2- 172.21.15.132:0/1042069305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcc00d17d0 0x7fdcc00cf790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40097a0 tx=0x7fdcb402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=831ade6d25986488 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.241+0000 7fdcbdffb640 1 -- 172.21.15.132:0/1042069305 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4031830 con 0x7fdcc00d17d0 2023-12-20T04:42:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.241+0000 7fdcbdffb640 1 -- 172.21.15.132:0/1042069305 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb4031990 con 0x7fdcc00d17d0 2023-12-20T04:42:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.241+0000 7fdcbdffb640 1 -- 172.21.15.132:0/1042069305 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb4031d20 con 0x7fdcc00d17d0 2023-12-20T04:42:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.241+0000 7fdcc545f640 1 -- 172.21.15.132:0/1042069305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcc00d17d0 msgr2=0x7fdcc00cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.241+0000 7fdcc545f640 1 --2- 172.21.15.132:0/1042069305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcc00d17d0 0x7fdcc00cf790 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdcb40097a0 tx=0x7fdcb402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.241+0000 7fdcc545f640 1 -- 172.21.15.132:0/1042069305 shutdown_connections 2023-12-20T04:42:45.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.241+0000 7fdcc545f640 1 --2- 172.21.15.132:0/1042069305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcc00d17d0 0x7fdcc00cf790 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.241+0000 7fdcc545f640 1 --2- 172.21.15.132:0/1042069305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc015d300 0x7fdcc00d1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.241+0000 7fdcc545f640 1 -- 172.21.15.132:0/1042069305 >> 172.21.15.132:0/1042069305 conn(0x7fdcc006a3d0 msgr2=0x7fdcc006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.241+0000 7fdcc545f640 1 -- 172.21.15.132:0/1042069305 shutdown_connections 2023-12-20T04:42:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.241+0000 7fdcc545f640 1 -- 172.21.15.132:0/1042069305 wait complete. 2023-12-20T04:42:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.243+0000 7fdcc545f640 1 Processor -- start 2023-12-20T04:42:45.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.243+0000 7fdcc545f640 1 -- start start 2023-12-20T04:42:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.243+0000 7fdcc545f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcc00cfcd0 0x7fdcc014fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.243+0000 7fdcc545f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00d17d0 0x7fdcc0150d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.243+0000 7fdcc545f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcc015d300 0x7fdcc015f890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:45.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.243+0000 7fdcc545f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc015da80 con 0x7fdcc015d300 2023-12-20T04:42:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.243+0000 7fdcc545f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc01503d0 con 0x7fdcc00cfcd0 2023-12-20T04:42:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.243+0000 7fdcc545f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc01508d0 con 0x7fdcc00d17d0 2023-12-20T04:42:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.243+0000 7fdcbf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcc015d300 0x7fdcc015f890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.243+0000 7fdcbf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcc015d300 0x7fdcc015f890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39742/0 (socket says 172.21.15.132:39742) 2023-12-20T04:42:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.243+0000 7fdcbf7fe640 1 -- 172.21.15.132:0/806605264 learned_addr learned my addr 172.21.15.132:0/806605264 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.244+0000 7fdcbe7fc640 1 --2- 172.21.15.132:0/806605264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00d17d0 0x7fdcc0150d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.244+0000 7fdcbeffd640 1 --2- 172.21.15.132:0/806605264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcc00cfcd0 0x7fdcc014fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.244+0000 7fdcbf7fe640 1 -- 172.21.15.132:0/806605264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00d17d0 msgr2=0x7fdcc0150d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.244+0000 7fdcbf7fe640 1 --2- 172.21.15.132:0/806605264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00d17d0 0x7fdcc0150d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.244+0000 7fdcbf7fe640 1 -- 172.21.15.132:0/806605264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcc00cfcd0 msgr2=0x7fdcc014fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.244+0000 7fdcbf7fe640 1 --2- 172.21.15.132:0/806605264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcc00cfcd0 0x7fdcc014fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.244+0000 7fdcbf7fe640 1 -- 172.21.15.132:0/806605264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb0009b30 con 0x7fdcc015d300 2023-12-20T04:42:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.244+0000 7fdcbeffd640 1 --2- 172.21.15.132:0/806605264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcc00cfcd0 0x7fdcc014fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:45.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.244+0000 7fdcbf7fe640 1 --2- 172.21.15.132:0/806605264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcc015d300 0x7fdcc015f890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8001eb0 tx=0x7fdcb800c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:45.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.244+0000 7fdca77fe640 1 -- 172.21.15.132:0/806605264 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb80074e0 con 0x7fdcc015d300 2023-12-20T04:42:45.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.244+0000 7fdca77fe640 1 -- 172.21.15.132:0/806605264 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb8007640 con 0x7fdcc015d300 2023-12-20T04:42:45.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.244+0000 7fdcc545f640 1 -- 172.21.15.132:0/806605264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb4009400 con 0x7fdcc015d300 2023-12-20T04:42:45.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.244+0000 7fdca77fe640 1 -- 172.21.15.132:0/806605264 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb80049e0 con 0x7fdcc015d300 2023-12-20T04:42:45.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.244+0000 7fdcc545f640 1 -- 172.21.15.132:0/806605264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc01539e0 con 0x7fdcc015d300 2023-12-20T04:42:45.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.245+0000 7fdcc545f640 1 -- 172.21.15.132:0/806605264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc00d15f0 con 0x7fdcc015d300 2023-12-20T04:42:45.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.245+0000 7fdca77fe640 1 -- 172.21.15.132:0/806605264 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdcb8004b40 con 0x7fdcc015d300 2023-12-20T04:42:45.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.246+0000 7fdca77fe640 1 --2- 172.21.15.132:0/806605264 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdcac06a460 0x7fdcac06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:45.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.246+0000 7fdcbeffd640 1 --2- 172.21.15.132:0/806605264 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdcac06a460 0x7fdcac06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:45.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.246+0000 7fdca77fe640 1 -- 172.21.15.132:0/806605264 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(16..16 src has 1..16) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fdcb8087df0 con 0x7fdcc015d300 2023-12-20T04:42:45.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.246+0000 7fdcbeffd640 1 --2- 172.21.15.132:0/806605264 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdcac06a460 0x7fdcac06c920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009360 tx=0x7fdcb000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:45.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.250+0000 7fdca77fe640 1 -- 172.21.15.132:0/806605264 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdcb80537c0 con 0x7fdcc015d300 2023-12-20T04:42:45.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.415+0000 7fdcc545f640 1 -- 172.21.15.132:0/806605264 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fdcc004e840 con 0x7fdcc015d300 2023-12-20T04:42:45.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.809+0000 7fdca77fe640 1 -- 172.21.15.132:0/806605264 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) v1 ==== 138+0+0 (secure 0 0 0) 0x7fdcb8056de0 con 0x7fdcc015d300 2023-12-20T04:42:45.811 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2023-12-20T04:42:45.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.812+0000 7fdcc545f640 1 -- 172.21.15.132:0/806605264 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdcac06a460 msgr2=0x7fdcac06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:45.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.812+0000 7fdcc545f640 1 --2- 172.21.15.132:0/806605264 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdcac06a460 0x7fdcac06c920 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009360 tx=0x7fdcb000b040 comp rx=0 tx=0).stop 2023-12-20T04:42:45.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.812+0000 7fdcc545f640 1 -- 172.21.15.132:0/806605264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcc015d300 msgr2=0x7fdcc015f890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:45.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.812+0000 7fdcc545f640 1 --2- 172.21.15.132:0/806605264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcc015d300 0x7fdcc015f890 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fdcb8001eb0 tx=0x7fdcb800c820 comp rx=0 tx=0).stop 2023-12-20T04:42:45.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.812+0000 7fdcc545f640 1 -- 172.21.15.132:0/806605264 shutdown_connections 2023-12-20T04:42:45.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.812+0000 7fdcc545f640 1 --2- 172.21.15.132:0/806605264 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdcac06a460 0x7fdcac06c920 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.812+0000 7fdcc545f640 1 --2- 172.21.15.132:0/806605264 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcc015d300 0x7fdcc015f890 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.812+0000 7fdcc545f640 1 --2- 172.21.15.132:0/806605264 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00d17d0 0x7fdcc0150d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.812+0000 7fdcc545f640 1 --2- 172.21.15.132:0/806605264 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcc00cfcd0 0x7fdcc014fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.812+0000 7fdcc545f640 1 -- 172.21.15.132:0/806605264 >> 172.21.15.132:0/806605264 conn(0x7fdcc006a3d0 msgr2=0x7fdcc00b7be0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:45.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.812+0000 7fdcc545f640 1 -- 172.21.15.132:0/806605264 shutdown_connections 2023-12-20T04:42:45.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.812+0000 7fdcc545f640 1 -- 172.21.15.132:0/806605264 wait complete. 2023-12-20T04:42:45.825 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-20T04:42:45.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.931+0000 7f3e983a9640 1 Processor -- start 2023-12-20T04:42:45.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.931+0000 7f3e983a9640 1 -- start start 2023-12-20T04:42:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.932+0000 7f3e983a9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3e9015d300 0x7f3e900d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.932+0000 7f3e983a9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e900cfea0 0x7f3e900b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.932+0000 7f3e983a9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e900d2920 con 0x7f3e900d17d0 2023-12-20T04:42:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.932+0000 7f3e983a9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e900d1d10 con 0x7f3e9015d300 2023-12-20T04:42:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.932+0000 7f3e983a9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900d1ff0 con 0x7f3e900cfea0 2023-12-20T04:42:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.932+0000 7f3e95944640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3e900d17d0 0x7f3e900cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38908/0 (socket says 172.21.15.132:38908) 2023-12-20T04:42:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.932+0000 7f3e95944640 1 -- 172.21.15.132:0/1903845067 learned_addr learned my addr 172.21.15.132:0/1903845067 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.932+0000 7f3e95143640 1 -- 172.21.15.132:0/1903845067 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1671929929 0 0) 0x7f3e900d2920 con 0x7f3e900d17d0 2023-12-20T04:42:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.932+0000 7f3e95143640 1 -- 172.21.15.132:0/1903845067 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e7c003520 con 0x7f3e900d17d0 2023-12-20T04:42:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.932+0000 7f3e96946640 1 --2- 172.21.15.132:0/1903845067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e900cfea0 0x7f3e900b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:45.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.932+0000 7f3e96145640 1 --2- 172.21.15.132:0/1903845067 >> v2:172.21.15.187:3300/0 conn(0x7f3e9015d300 0x7f3e900d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e95143640 1 -- 172.21.15.132:0/1903845067 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1810175800 0 0) 0x7f3e7c003520 con 0x7f3e900d17d0 2023-12-20T04:42:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e95143640 1 -- 172.21.15.132:0/1903845067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e900cfea0 msgr2=0x7f3e900b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e95143640 1 --2- 172.21.15.132:0/1903845067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e900cfea0 0x7f3e900b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e95143640 1 -- 172.21.15.132:0/1903845067 >> v2:172.21.15.187:3300/0 conn(0x7f3e9015d300 msgr2=0x7f3e900d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e95143640 1 --2- 172.21.15.132:0/1903845067 >> v2:172.21.15.187:3300/0 conn(0x7f3e9015d300 0x7f3e900d1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e95143640 1 -- 172.21.15.132:0/1903845067 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e900d22d0 con 0x7f3e900d17d0 2023-12-20T04:42:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e95143640 1 -- 172.21.15.132:0/1903845067 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f3e80001670 con 0x7f3e900d17d0 2023-12-20T04:42:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e95143640 1 -- 172.21.15.132:0/1903845067 >> v1:172.21.15.132:6789/0 conn(0x7f3e900d17d0 legacy=0x7f3e900cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e95143640 1 --2- 172.21.15.132:0/1903845067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e7c003970 0x7f3e7c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e95143640 1 --2- 172.21.15.132:0/1903845067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e900cfea0 0x7f3e7c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e95143640 1 --2- 172.21.15.132:0/1903845067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c004d00 0x7f3e7c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e95143640 1 -- 172.21.15.132:0/1903845067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900d1d10 con 0x7f3e7c003970 2023-12-20T04:42:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e95143640 1 -- 172.21.15.132:0/1903845067 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900d1ff0 con 0x7f3e7c004d00 2023-12-20T04:42:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e95143640 1 -- 172.21.15.132:0/1903845067 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e7c00b980 con 0x7f3e900cfea0 2023-12-20T04:42:45.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e96145640 1 --2- 172.21.15.132:0/1903845067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e7c003970 0x7f3e7c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e95944640 1 --2- 172.21.15.132:0/1903845067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e900cfea0 0x7f3e7c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e96946640 1 --2- 172.21.15.132:0/1903845067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c004d00 0x7f3e7c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e96145640 1 -- 172.21.15.132:0/1903845067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e900cfea0 msgr2=0x7f3e7c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e96145640 1 --2- 172.21.15.132:0/1903845067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e900cfea0 0x7f3e7c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e96145640 1 -- 172.21.15.132:0/1903845067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c004d00 msgr2=0x7f3e7c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e96145640 1 --2- 172.21.15.132:0/1903845067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c004d00 0x7f3e7c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e96145640 1 -- 172.21.15.132:0/1903845067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e7c003520 con 0x7f3e7c003970 2023-12-20T04:42:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e95944640 1 --2- 172.21.15.132:0/1903845067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e900cfea0 0x7f3e7c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:45.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.933+0000 7f3e96946640 1 --2- 172.21.15.132:0/1903845067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c004d00 0x7f3e7c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:45.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.934+0000 7f3e96145640 1 --2- 172.21.15.132:0/1903845067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e7c003970 0x7f3e7c003d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00e170 tx=0x7f3e7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16ef2c7084e0c332 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:45.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.934+0000 7f3e95143640 1 -- 172.21.15.132:0/1903845067 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c02cc20 con 0x7f3e7c003970 2023-12-20T04:42:45.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.934+0000 7f3e95143640 1 -- 172.21.15.132:0/1903845067 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8c00f040 con 0x7f3e7c003970 2023-12-20T04:42:45.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.934+0000 7f3e95143640 1 -- 172.21.15.132:0/1903845067 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e8c034440 con 0x7f3e7c003970 2023-12-20T04:42:45.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.934+0000 7f3e983a9640 1 -- 172.21.15.132:0/1903845067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e7c003970 msgr2=0x7f3e7c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:45.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.935+0000 7f3e983a9640 1 --2- 172.21.15.132:0/1903845067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e7c003970 0x7f3e7c003d90 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c00e170 tx=0x7f3e7c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.935+0000 7f3e96946640 1 -- 172.21.15.132:0/1903845067 reap_dead start 2023-12-20T04:42:45.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.935+0000 7f3e983a9640 1 -- 172.21.15.132:0/1903845067 shutdown_connections 2023-12-20T04:42:45.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.935+0000 7f3e983a9640 1 -- 172.21.15.132:0/1903845067 >> 172.21.15.132:0/1903845067 conn(0x7f3e9006a3d0 msgr2=0x7f3e9006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:45.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.935+0000 7f3e983a9640 1 -- 172.21.15.132:0/1903845067 shutdown_connections 2023-12-20T04:42:45.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.935+0000 7f3e983a9640 1 -- 172.21.15.132:0/1903845067 wait complete. 2023-12-20T04:42:45.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.936+0000 7f3e983a9640 1 Processor -- start 2023-12-20T04:42:45.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.936+0000 7f3e983a9640 1 -- start start 2023-12-20T04:42:45.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.936+0000 7f3e983a9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c003970 0x7f3e9014d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:45.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.936+0000 7f3e983a9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e900b3e60 0x7f3e901579a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:45.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.936+0000 7f3e983a9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e900b42c0 0x7f3e90157ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:45.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.936+0000 7f3e983a9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900cad30 con 0x7f3e900b42c0 2023-12-20T04:42:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.936+0000 7f3e983a9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900cb010 con 0x7f3e7c003970 2023-12-20T04:42:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.936+0000 7f3e983a9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e900cb2f0 con 0x7f3e900b3e60 2023-12-20T04:42:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.937+0000 7f3e96946640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e900b42c0 0x7f3e90157ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.937+0000 7f3e96946640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e900b42c0 0x7f3e90157ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39760/0 (socket says 172.21.15.132:39760) 2023-12-20T04:42:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.937+0000 7f3e96946640 1 -- 172.21.15.132:0/165368182 learned_addr learned my addr 172.21.15.132:0/165368182 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.937+0000 7f3e95944640 1 --2- 172.21.15.132:0/165368182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e900b3e60 0x7f3e901579a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.937+0000 7f3e96145640 1 --2- 172.21.15.132:0/165368182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c003970 0x7f3e9014d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.937+0000 7f3e96946640 1 -- 172.21.15.132:0/165368182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e900b3e60 msgr2=0x7f3e901579a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.937+0000 7f3e96946640 1 --2- 172.21.15.132:0/165368182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e900b3e60 0x7f3e901579a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.937+0000 7f3e96946640 1 -- 172.21.15.132:0/165368182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c003970 msgr2=0x7f3e9014d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.937+0000 7f3e96946640 1 --2- 172.21.15.132:0/165368182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c003970 0x7f3e9014d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.937+0000 7f3e96946640 1 -- 172.21.15.132:0/165368182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e900cb5d0 con 0x7f3e900b42c0 2023-12-20T04:42:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.937+0000 7f3e96946640 1 --2- 172.21.15.132:0/165368182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e900b42c0 0x7f3e90157ee0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3e88006fd0 tx=0x7f3e88004610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:45.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.937+0000 7f3e86ffd640 1 -- 172.21.15.132:0/165368182 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e88014660 con 0x7f3e900b42c0 2023-12-20T04:42:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.937+0000 7f3e86ffd640 1 -- 172.21.15.132:0/165368182 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e8800fed0 con 0x7f3e900b42c0 2023-12-20T04:42:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.937+0000 7f3e983a9640 1 -- 172.21.15.132:0/165368182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e900cb8b0 con 0x7f3e900b42c0 2023-12-20T04:42:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.937+0000 7f3e86ffd640 1 -- 172.21.15.132:0/165368182 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e88014a40 con 0x7f3e900b42c0 2023-12-20T04:42:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.937+0000 7f3e983a9640 1 -- 172.21.15.132:0/165368182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e900ca950 con 0x7f3e900b42c0 2023-12-20T04:42:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.938+0000 7f3e983a9640 1 -- 172.21.15.132:0/165368182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e900cbaa0 con 0x7f3e900b42c0 2023-12-20T04:42:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.939+0000 7f3e86ffd640 1 -- 172.21.15.132:0/165368182 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3e88014ba0 con 0x7f3e900b42c0 2023-12-20T04:42:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.939+0000 7f3e86ffd640 1 --2- 172.21.15.132:0/165368182 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e7406a460 0x7f3e7406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.939+0000 7f3e96145640 1 --2- 172.21.15.132:0/165368182 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e7406a460 0x7f3e7406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.939+0000 7f3e86ffd640 1 -- 172.21.15.132:0/165368182 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(17..17 src has 1..17) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f3e88088540 con 0x7f3e900b42c0 2023-12-20T04:42:45.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.940+0000 7f3e96145640 1 --2- 172.21.15.132:0/165368182 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e7406a460 0x7f3e7406c920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c036000 tx=0x7f3e8c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:45.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:45.944+0000 7f3e86ffd640 1 -- 172.21.15.132:0/165368182 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3e88053da0 con 0x7f3e900b42c0 2023-12-20T04:42:46.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.110+0000 7f3e983a9640 1 -- 172.21.15.132:0/165368182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f3e9004e840 con 0x7f3e900b42c0 2023-12-20T04:42:46.437 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:42:46.439 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:42:46.816 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2023-12-20T04:42:46.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.813+0000 7f3e86ffd640 1 -- 172.21.15.132:0/165368182 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v18) v1 ==== 170+0+0 (secure 0 0 0) 0x7f3e880573c0 con 0x7f3e900b42c0 2023-12-20T04:42:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.818+0000 7f3e983a9640 1 -- 172.21.15.132:0/165368182 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e7406a460 msgr2=0x7f3e7406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.818+0000 7f3e983a9640 1 --2- 172.21.15.132:0/165368182 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e7406a460 0x7f3e7406c920 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3e8c036000 tx=0x7f3e8c02e000 comp rx=0 tx=0).stop 2023-12-20T04:42:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.818+0000 7f3e983a9640 1 -- 172.21.15.132:0/165368182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e900b42c0 msgr2=0x7f3e90157ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.818+0000 7f3e983a9640 1 --2- 172.21.15.132:0/165368182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e900b42c0 0x7f3e90157ee0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f3e88006fd0 tx=0x7f3e88004610 comp rx=0 tx=0).stop 2023-12-20T04:42:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.819+0000 7f3e983a9640 1 -- 172.21.15.132:0/165368182 shutdown_connections 2023-12-20T04:42:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.819+0000 7f3e983a9640 1 --2- 172.21.15.132:0/165368182 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e7406a460 0x7f3e7406c920 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.819+0000 7f3e983a9640 1 --2- 172.21.15.132:0/165368182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e900b42c0 0x7f3e90157ee0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:46.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.819+0000 7f3e983a9640 1 --2- 172.21.15.132:0/165368182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e900b3e60 0x7f3e901579a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:46.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.819+0000 7f3e983a9640 1 --2- 172.21.15.132:0/165368182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e7c003970 0x7f3e9014d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:46.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.819+0000 7f3e983a9640 1 -- 172.21.15.132:0/165368182 >> 172.21.15.132:0/165368182 conn(0x7f3e9006a3d0 msgr2=0x7f3e90153290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:46.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.819+0000 7f3e983a9640 1 -- 172.21.15.132:0/165368182 shutdown_connections 2023-12-20T04:42:46.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.820+0000 7f3e983a9640 1 -- 172.21.15.132:0/165368182 wait complete. 2023-12-20T04:42:46.835 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-20T04:42:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.935+0000 7f47acee0640 1 Processor -- start 2023-12-20T04:42:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.935+0000 7f47acee0640 1 -- start start 2023-12-20T04:42:46.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.936+0000 7f47acee0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47a80cfc40 0x7f47a80b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:46.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.936+0000 7f47acee0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a80d2920 con 0x7f47a815d300 2023-12-20T04:42:46.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.936+0000 7f47acee0640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47a80d1d10 con 0x7f47a80cf790 2023-12-20T04:42:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.936+0000 7f47acee0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80d1ff0 con 0x7f47a80cfc40 2023-12-20T04:42:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.936+0000 7f47a659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f47a815d300 0x7f47a80d1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38924/0 (socket says 172.21.15.132:38924) 2023-12-20T04:42:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.936+0000 7f47a659c640 1 -- 172.21.15.132:0/566556397 learned_addr learned my addr 172.21.15.132:0/566556397 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a6d9d640 1 --2- 172.21.15.132:0/566556397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47a80cfc40 0x7f47a80b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a559a640 1 -- 172.21.15.132:0/566556397 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921398204 0 0) 0x7f47a80d2920 con 0x7f47a815d300 2023-12-20T04:42:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a559a640 1 -- 172.21.15.132:0/566556397 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4794003520 con 0x7f47a815d300 2023-12-20T04:42:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a559a640 1 -- 172.21.15.132:0/566556397 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3810841291 0 0) 0x7f47a80d1d10 con 0x7f47a80cf790 2023-12-20T04:42:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a559a640 1 -- 172.21.15.132:0/566556397 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47a80d2920 con 0x7f47a80cf790 2023-12-20T04:42:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a559a640 1 -- 172.21.15.132:0/566556397 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4060287953 0 0) 0x7f4794003520 con 0x7f47a815d300 2023-12-20T04:42:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a559a640 1 -- 172.21.15.132:0/566556397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47a80cfc40 msgr2=0x7f47a80b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a559a640 1 --2- 172.21.15.132:0/566556397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47a80cfc40 0x7f47a80b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a559a640 1 -- 172.21.15.132:0/566556397 >> v1:172.21.15.187:6789/0 conn(0x7f47a80cf790 legacy=0x7f47a80b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a559a640 1 -- 172.21.15.132:0/566556397 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a80d22d0 con 0x7f47a815d300 2023-12-20T04:42:46.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a559a640 1 -- 172.21.15.132:0/566556397 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f47980019f0 con 0x7f47a815d300 2023-12-20T04:42:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a559a640 1 -- 172.21.15.132:0/566556397 >> v1:172.21.15.132:6789/0 conn(0x7f47a815d300 legacy=0x7f47a80d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a559a640 1 --2- 172.21.15.132:0/566556397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4794003b30 0x7f4794003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a559a640 1 --2- 172.21.15.132:0/566556397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47940047c0 0x7f4794004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a559a640 1 --2- 172.21.15.132:0/566556397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47a80cfc40 0x7f4794005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a559a640 1 -- 172.21.15.132:0/566556397 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a80d1ff0 con 0x7f4794003b30 2023-12-20T04:42:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a559a640 1 -- 172.21.15.132:0/566556397 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f479400ba30 con 0x7f47940047c0 2023-12-20T04:42:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a559a640 1 -- 172.21.15.132:0/566556397 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f479400bbc0 con 0x7f47a80cfc40 2023-12-20T04:42:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a659c640 1 --2- 172.21.15.132:0/566556397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4794003b30 0x7f4794003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a5d9b640 1 --2- 172.21.15.132:0/566556397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47940047c0 0x7f4794004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a6d9d640 1 --2- 172.21.15.132:0/566556397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47a80cfc40 0x7f4794005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a659c640 1 -- 172.21.15.132:0/566556397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47a80cfc40 msgr2=0x7f4794005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a659c640 1 --2- 172.21.15.132:0/566556397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47a80cfc40 0x7f4794005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a659c640 1 -- 172.21.15.132:0/566556397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47940047c0 msgr2=0x7f4794004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a659c640 1 --2- 172.21.15.132:0/566556397 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47940047c0 0x7f4794004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.937+0000 7f47a659c640 1 -- 172.21.15.132:0/566556397 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4794003520 con 0x7f4794003b30 2023-12-20T04:42:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.938+0000 7f47a659c640 1 --2- 172.21.15.132:0/566556397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4794003b30 0x7f4794003f30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f479800a7c0 tx=0x7f47940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb947abd33bd40e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.938+0000 7f47a559a640 1 -- 172.21.15.132:0/566556397 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798034630 con 0x7f4794003b30 2023-12-20T04:42:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.938+0000 7f47a559a640 1 -- 172.21.15.132:0/566556397 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f479802f070 con 0x7f4794003b30 2023-12-20T04:42:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.938+0000 7f47a559a640 1 -- 172.21.15.132:0/566556397 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47980349f0 con 0x7f4794003b30 2023-12-20T04:42:46.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.939+0000 7f47acee0640 1 -- 172.21.15.132:0/566556397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4794003b30 msgr2=0x7f4794003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:46.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.939+0000 7f47acee0640 1 --2- 172.21.15.132:0/566556397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4794003b30 0x7f4794003f30 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f479800a7c0 tx=0x7f47940057f0 comp rx=0 tx=0).stop 2023-12-20T04:42:46.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.939+0000 7f47a6d9d640 1 -- 172.21.15.132:0/566556397 reap_dead start 2023-12-20T04:42:46.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.939+0000 7f47acee0640 1 -- 172.21.15.132:0/566556397 shutdown_connections 2023-12-20T04:42:46.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.939+0000 7f47acee0640 1 -- 172.21.15.132:0/566556397 >> 172.21.15.132:0/566556397 conn(0x7f47a806a3d0 msgr2=0x7f47a806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:46.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.939+0000 7f47acee0640 1 -- 172.21.15.132:0/566556397 shutdown_connections 2023-12-20T04:42:46.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.939+0000 7f47acee0640 1 -- 172.21.15.132:0/566556397 wait complete. 2023-12-20T04:42:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.940+0000 7f47acee0640 1 Processor -- start 2023-12-20T04:42:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.940+0000 7f47acee0640 1 -- start start 2023-12-20T04:42:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47acee0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4794003b30 0x7f47a8152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47acee0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47a81567c0 0x7f47a815d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47acee0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47a815dc20 0x7f47a8153e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47acee0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a81557c0 con 0x7f4794003b30 2023-12-20T04:42:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47acee0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47a815e720 con 0x7f47a81567c0 2023-12-20T04:42:46.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47acee0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47a8153420 con 0x7f47a815dc20 2023-12-20T04:42:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47a659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4794003b30 0x7f47a8152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47a659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4794003b30 0x7f47a8152a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39786/0 (socket says 172.21.15.132:39786) 2023-12-20T04:42:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47a659c640 1 -- 172.21.15.132:0/2879322318 learned_addr learned my addr 172.21.15.132:0/2879322318 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47a5d9b640 1 --2- 172.21.15.132:0/2879322318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47a81567c0 0x7f47a815d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47a6d9d640 1 --2- 172.21.15.132:0/2879322318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47a815dc20 0x7f47a8153e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47a659c640 1 -- 172.21.15.132:0/2879322318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47a815dc20 msgr2=0x7f47a8153e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47a659c640 1 --2- 172.21.15.132:0/2879322318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47a815dc20 0x7f47a8153e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47a659c640 1 -- 172.21.15.132:0/2879322318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47a81567c0 msgr2=0x7f47a815d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47a659c640 1 --2- 172.21.15.132:0/2879322318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47a81567c0 0x7f47a815d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47a659c640 1 -- 172.21.15.132:0/2879322318 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47a8155200 con 0x7f4794003b30 2023-12-20T04:42:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47a5d9b640 1 --2- 172.21.15.132:0/2879322318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47a81567c0 0x7f47a815d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47a659c640 1 --2- 172.21.15.132:0/2879322318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4794003b30 0x7f47a8152a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f479800a7c0 tx=0x7f4798001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f479effd640 1 -- 172.21.15.132:0/2879322318 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47980346c0 con 0x7f4794003b30 2023-12-20T04:42:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f479effd640 1 -- 172.21.15.132:0/2879322318 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4798034820 con 0x7f4794003b30 2023-12-20T04:42:46.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f47acee0640 1 -- 172.21.15.132:0/2879322318 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47a81554e0 con 0x7f4794003b30 2023-12-20T04:42:46.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.941+0000 7f479effd640 1 -- 172.21.15.132:0/2879322318 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4798034b90 con 0x7f4794003b30 2023-12-20T04:42:46.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.942+0000 7f47acee0640 1 -- 172.21.15.132:0/2879322318 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47a815ebb0 con 0x7f4794003b30 2023-12-20T04:42:46.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.943+0000 7f47acee0640 1 -- 172.21.15.132:0/2879322318 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47a804e840 con 0x7f4794003b30 2023-12-20T04:42:46.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.943+0000 7f479effd640 1 -- 172.21.15.132:0/2879322318 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4798031030 con 0x7f4794003b30 2023-12-20T04:42:46.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.943+0000 7f479effd640 1 --2- 172.21.15.132:0/2879322318 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f478806a460 0x7f478806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:46.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.943+0000 7f47a5d9b640 1 --2- 172.21.15.132:0/2879322318 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f478806a460 0x7f478806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:46.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.943+0000 7f479effd640 1 -- 172.21.15.132:0/2879322318 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(18..18 src has 1..18) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f47980aad60 con 0x7f4794003b30 2023-12-20T04:42:46.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.944+0000 7f47a5d9b640 1 --2- 172.21.15.132:0/2879322318 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f478806a460 0x7f478806c920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f47a8156750 tx=0x7f4790009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:46.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:46.948+0000 7f479effd640 1 -- 172.21.15.132:0/2879322318 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4798076440 con 0x7f4794003b30 2023-12-20T04:42:47.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.148+0000 7f47acee0640 1 -- 172.21.15.132:0/2879322318 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f47a815c4f0 con 0x7f4794003b30 2023-12-20T04:42:47.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.155+0000 7f479effd640 1 -- 172.21.15.132:0/2879322318 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) v1 ==== 172+0+0 (secure 0 0 0) 0x7f4798079a60 con 0x7f4794003b30 2023-12-20T04:42:47.158 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 2 and data pool 3 2023-12-20T04:42:47.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.160+0000 7f47acee0640 1 -- 172.21.15.132:0/2879322318 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f478806a460 msgr2=0x7f478806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.160+0000 7f47acee0640 1 --2- 172.21.15.132:0/2879322318 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f478806a460 0x7f478806c920 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7f47a8156750 tx=0x7f4790009040 comp rx=0 tx=0).stop 2023-12-20T04:42:47.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.160+0000 7f47acee0640 1 -- 172.21.15.132:0/2879322318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4794003b30 msgr2=0x7f47a8152a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.160+0000 7f47acee0640 1 --2- 172.21.15.132:0/2879322318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4794003b30 0x7f47a8152a70 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f479800a7c0 tx=0x7f4798001d00 comp rx=0 tx=0).stop 2023-12-20T04:42:47.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.162+0000 7f47acee0640 1 -- 172.21.15.132:0/2879322318 shutdown_connections 2023-12-20T04:42:47.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.162+0000 7f47acee0640 1 --2- 172.21.15.132:0/2879322318 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f478806a460 0x7f478806c920 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.162+0000 7f47acee0640 1 --2- 172.21.15.132:0/2879322318 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47a815dc20 0x7f47a8153e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.162+0000 7f47acee0640 1 --2- 172.21.15.132:0/2879322318 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47a81567c0 0x7f47a815d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.162+0000 7f47acee0640 1 --2- 172.21.15.132:0/2879322318 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4794003b30 0x7f47a8152a70 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.162+0000 7f47acee0640 1 -- 172.21.15.132:0/2879322318 >> 172.21.15.132:0/2879322318 conn(0x7f47a806a3d0 msgr2=0x7f47a80b7bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:47.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.162+0000 7f47acee0640 1 -- 172.21.15.132:0/2879322318 shutdown_connections 2023-12-20T04:42:47.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.162+0000 7f47acee0640 1 -- 172.21.15.132:0/2879322318 wait complete. 2023-12-20T04:42:47.178 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:42:47.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.276+0000 7f2b76696640 1 Processor -- start 2023-12-20T04:42:47.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.276+0000 7f2b76696640 1 -- start start 2023-12-20T04:42:47.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.276+0000 7f2b76696640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2b70160450 0x7f2b70160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.276+0000 7f2b76696640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b700b5090 0x7f2b700d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.276+0000 7f2b76696640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b700b5ec0 con 0x7f2b701611b0 2023-12-20T04:42:47.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.276+0000 7f2b76696640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b701617e0 con 0x7f2b70160450 2023-12-20T04:42:47.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.276+0000 7f2b76696640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700d0fc0 con 0x7f2b700b5090 2023-12-20T04:42:47.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2b701611b0 0x7f2b700b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38928/0 (socket says 172.21.15.132:38928) 2023-12-20T04:42:47.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6f7fe640 1 -- 172.21.15.132:0/2852375866 learned_addr learned my addr 172.21.15.132:0/2852375866 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:47.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6ffff640 1 --2- 172.21.15.132:0/2852375866 >> v2:172.21.15.187:3300/0 conn(0x7f2b70160450 0x7f2b70160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b74c33640 1 --2- 172.21.15.132:0/2852375866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b700b5090 0x7f2b700d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6effd640 1 -- 172.21.15.132:0/2852375866 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576716842 0 0) 0x7f2b700b5ec0 con 0x7f2b701611b0 2023-12-20T04:42:47.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6effd640 1 -- 172.21.15.132:0/2852375866 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b58003520 con 0x7f2b701611b0 2023-12-20T04:42:47.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6effd640 1 -- 172.21.15.132:0/2852375866 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1946324818 0 0) 0x7f2b58003520 con 0x7f2b701611b0 2023-12-20T04:42:47.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6effd640 1 -- 172.21.15.132:0/2852375866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b700b5090 msgr2=0x7f2b700d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:47.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6effd640 1 --2- 172.21.15.132:0/2852375866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b700b5090 0x7f2b700d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6effd640 1 -- 172.21.15.132:0/2852375866 >> v2:172.21.15.187:3300/0 conn(0x7f2b70160450 msgr2=0x7f2b70160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:47.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6effd640 1 --2- 172.21.15.132:0/2852375866 >> v2:172.21.15.187:3300/0 conn(0x7f2b70160450 0x7f2b70160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6effd640 1 -- 172.21.15.132:0/2852375866 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b700d12a0 con 0x7f2b701611b0 2023-12-20T04:42:47.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6effd640 1 -- 172.21.15.132:0/2852375866 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f2b60001670 con 0x7f2b701611b0 2023-12-20T04:42:47.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6effd640 1 -- 172.21.15.132:0/2852375866 >> v1:172.21.15.132:6789/0 conn(0x7f2b701611b0 legacy=0x7f2b700b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6effd640 1 --2- 172.21.15.132:0/2852375866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b58003970 0x7f2b58003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6effd640 1 --2- 172.21.15.132:0/2852375866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b700b5090 0x7f2b580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6effd640 1 --2- 172.21.15.132:0/2852375866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b58004d00 0x7f2b58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6effd640 1 -- 172.21.15.132:0/2852375866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b701617e0 con 0x7f2b58003970 2023-12-20T04:42:47.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6effd640 1 -- 172.21.15.132:0/2852375866 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700d0fc0 con 0x7f2b58004d00 2023-12-20T04:42:47.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6effd640 1 -- 172.21.15.132:0/2852375866 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5800b980 con 0x7f2b700b5090 2023-12-20T04:42:47.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6ffff640 1 --2- 172.21.15.132:0/2852375866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b58003970 0x7f2b58003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6f7fe640 1 --2- 172.21.15.132:0/2852375866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b700b5090 0x7f2b580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b74c33640 1 --2- 172.21.15.132:0/2852375866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b58004d00 0x7f2b58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6ffff640 1 -- 172.21.15.132:0/2852375866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b700b5090 msgr2=0x7f2b580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:47.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6ffff640 1 --2- 172.21.15.132:0/2852375866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b700b5090 0x7f2b580047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6ffff640 1 -- 172.21.15.132:0/2852375866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b58004d00 msgr2=0x7f2b58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:47.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.277+0000 7f2b6ffff640 1 --2- 172.21.15.132:0/2852375866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b58004d00 0x7f2b58005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.278+0000 7f2b6ffff640 1 -- 172.21.15.132:0/2852375866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b58003520 con 0x7f2b58003970 2023-12-20T04:42:47.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.278+0000 7f2b6ffff640 1 --2- 172.21.15.132:0/2852375866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b58003970 0x7f2b58003d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009ac0 tx=0x7f2b580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=503de95de051e814 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:47.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.278+0000 7f2b6effd640 1 -- 172.21.15.132:0/2852375866 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6402c710 con 0x7f2b58003970 2023-12-20T04:42:47.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.278+0000 7f2b6effd640 1 -- 172.21.15.132:0/2852375866 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6402c870 con 0x7f2b58003970 2023-12-20T04:42:47.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.278+0000 7f2b6effd640 1 -- 172.21.15.132:0/2852375866 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b6402cc00 con 0x7f2b58003970 2023-12-20T04:42:47.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.279+0000 7f2b76696640 1 -- 172.21.15.132:0/2852375866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b58003970 msgr2=0x7f2b58003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.279+0000 7f2b76696640 1 --2- 172.21.15.132:0/2852375866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b58003970 0x7f2b58003d90 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f2b64009ac0 tx=0x7f2b580057f0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.279+0000 7f2b74c33640 1 -- 172.21.15.132:0/2852375866 reap_dead start 2023-12-20T04:42:47.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.279+0000 7f2b76696640 1 -- 172.21.15.132:0/2852375866 shutdown_connections 2023-12-20T04:42:47.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.279+0000 7f2b76696640 1 -- 172.21.15.132:0/2852375866 >> 172.21.15.132:0/2852375866 conn(0x7f2b700cf980 msgr2=0x7f2b700cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:47.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.279+0000 7f2b76696640 1 -- 172.21.15.132:0/2852375866 shutdown_connections 2023-12-20T04:42:47.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.279+0000 7f2b76696640 1 -- 172.21.15.132:0/2852375866 wait complete. 2023-12-20T04:42:47.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.280+0000 7f2b76696640 1 Processor -- start 2023-12-20T04:42:47.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.280+0000 7f2b76696640 1 -- start start 2023-12-20T04:42:47.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.281+0000 7f2b76696640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b58003970 0x7f2b700cc960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.281+0000 7f2b76696640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7015f3a0 0x7f2b7015f820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.281+0000 7f2b76696640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b7015c650 0x7f2b7015cae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.281+0000 7f2b76696640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b7015d020 con 0x7f2b58003970 2023-12-20T04:42:47.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.281+0000 7f2b76696640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700cb5e0 con 0x7f2b7015c650 2023-12-20T04:42:47.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.281+0000 7f2b76696640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b700cb8c0 con 0x7f2b7015f3a0 2023-12-20T04:42:47.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.281+0000 7f2b6ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b58003970 0x7f2b700cc960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.281+0000 7f2b6ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b58003970 0x7f2b700cc960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:39804/0 (socket says 172.21.15.132:39804) 2023-12-20T04:42:47.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.281+0000 7f2b6ffff640 1 -- 172.21.15.132:0/344846721 learned_addr learned my addr 172.21.15.132:0/344846721 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:47.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.281+0000 7f2b6ffff640 1 -- 172.21.15.132:0/344846721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7015f3a0 msgr2=0x7f2b7015f820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.281+0000 7f2b74c33640 1 --2- 172.21.15.132:0/344846721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b7015c650 0x7f2b7015cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.281+0000 7f2b6ffff640 1 --2- 172.21.15.132:0/344846721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7015f3a0 0x7f2b7015f820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.281+0000 7f2b6ffff640 1 -- 172.21.15.132:0/344846721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b7015c650 msgr2=0x7f2b7015cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.281+0000 7f2b6ffff640 1 --2- 172.21.15.132:0/344846721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b7015c650 0x7f2b7015cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.281+0000 7f2b6ffff640 1 -- 172.21.15.132:0/344846721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b700cbba0 con 0x7f2b58003970 2023-12-20T04:42:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.282+0000 7f2b6ffff640 1 --2- 172.21.15.132:0/344846721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b58003970 0x7f2b700cc960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2b6402c2b0 tx=0x7f2b64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.282+0000 7f2b6cff9640 1 -- 172.21.15.132:0/344846721 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64003810 con 0x7f2b58003970 2023-12-20T04:42:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.282+0000 7f2b6cff9640 1 -- 172.21.15.132:0/344846721 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b6402de90 con 0x7f2b58003970 2023-12-20T04:42:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.282+0000 7f2b76696640 1 -- 172.21.15.132:0/344846721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b700cbe80 con 0x7f2b58003970 2023-12-20T04:42:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.282+0000 7f2b6cff9640 1 -- 172.21.15.132:0/344846721 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b64003b70 con 0x7f2b58003970 2023-12-20T04:42:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.282+0000 7f2b76696640 1 -- 172.21.15.132:0/344846721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b700cc440 con 0x7f2b58003970 2023-12-20T04:42:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.283+0000 7f2b76696640 1 -- 172.21.15.132:0/344846721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b7004e840 con 0x7f2b58003970 2023-12-20T04:42:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.283+0000 7f2b6cff9640 1 -- 172.21.15.132:0/344846721 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2b64003cd0 con 0x7f2b58003970 2023-12-20T04:42:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.283+0000 7f2b6cff9640 1 --2- 172.21.15.132:0/344846721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b5c06a460 0x7f2b5c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.284+0000 7f2b6f7fe640 1 --2- 172.21.15.132:0/344846721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b5c06a460 0x7f2b5c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.284+0000 7f2b6cff9640 1 -- 172.21.15.132:0/344846721 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b640aa710 con 0x7f2b58003970 2023-12-20T04:42:47.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.284+0000 7f2b6f7fe640 1 --2- 172.21.15.132:0/344846721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b5c06a460 0x7f2b5c06c920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2b600014f0 tx=0x7f2b60007bf0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:47.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.288+0000 7f2b6cff9640 1 -- 172.21.15.132:0/344846721 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2b64075d90 con 0x7f2b58003970 2023-12-20T04:42:47.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.455+0000 7f2b76696640 1 -- 172.21.15.132:0/344846721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b700d0ad0 con 0x7f2b58003970 2023-12-20T04:42:47.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.456+0000 7f2b6cff9640 1 -- 172.21.15.132:0/344846721 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16098 (secure 0 0 0) 0x7f2b640793b0 con 0x7f2b58003970 2023-12-20T04:42:47.458 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:47.458 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:47.150348+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:42:47.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.458+0000 7f2b76696640 1 -- 172.21.15.132:0/344846721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b5c06a460 msgr2=0x7f2b5c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.458+0000 7f2b76696640 1 --2- 172.21.15.132:0/344846721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b5c06a460 0x7f2b5c06c920 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7f2b600014f0 tx=0x7f2b60007bf0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.458+0000 7f2b76696640 1 -- 172.21.15.132:0/344846721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b58003970 msgr2=0x7f2b700cc960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.458+0000 7f2b76696640 1 --2- 172.21.15.132:0/344846721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b58003970 0x7f2b700cc960 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f2b6402c2b0 tx=0x7f2b64004730 comp rx=0 tx=0).stop 2023-12-20T04:42:47.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.458+0000 7f2b76696640 1 -- 172.21.15.132:0/344846721 shutdown_connections 2023-12-20T04:42:47.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.458+0000 7f2b76696640 1 --2- 172.21.15.132:0/344846721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b5c06a460 0x7f2b5c06c920 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.458+0000 7f2b76696640 1 --2- 172.21.15.132:0/344846721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b7015c650 0x7f2b7015cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.458+0000 7f2b76696640 1 --2- 172.21.15.132:0/344846721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b7015f3a0 0x7f2b7015f820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.458+0000 7f2b76696640 1 --2- 172.21.15.132:0/344846721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b58003970 0x7f2b700cc960 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.458+0000 7f2b76696640 1 -- 172.21.15.132:0/344846721 >> 172.21.15.132:0/344846721 conn(0x7f2b700cf980 msgr2=0x7f2b700d19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:47.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.458+0000 7f2b76696640 1 -- 172.21.15.132:0/344846721 shutdown_connections 2023-12-20T04:42:47.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.458+0000 7f2b76696640 1 -- 172.21.15.132:0/344846721 wait complete. 2023-12-20T04:42:47.471 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:42:47.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.569+0000 7fa3186af640 1 Processor -- start 2023-12-20T04:42:47.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.569+0000 7fa3186af640 1 -- start start 2023-12-20T04:42:47.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.570+0000 7fa3186af640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa310160450 0x7fa310160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.570+0000 7fa3186af640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3100b5090 0x7fa3100d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.570+0000 7fa3186af640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3100b5ec0 con 0x7fa3101611b0 2023-12-20T04:42:47.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.570+0000 7fa3186af640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3101617e0 con 0x7fa310160450 2023-12-20T04:42:47.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.570+0000 7fa3186af640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3100d0fc0 con 0x7fa3100b5090 2023-12-20T04:42:47.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.570+0000 7fa31644b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa310160450 0x7fa310160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.570+0000 7fa31644b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa310160450 0x7fa310160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48916/0 (socket says 172.21.15.132:48916) 2023-12-20T04:42:47.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.570+0000 7fa31644b640 1 -- 172.21.15.132:0/4119758634 learned_addr learned my addr 172.21.15.132:0/4119758634 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:47.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.570+0000 7fa315c4a640 1 --1- 172.21.15.132:0/4119758634 >> v1:172.21.15.132:6789/0 conn(0x7fa3101611b0 0x7fa3100b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45832/0 (socket says 172.21.15.132:45832) 2023-12-20T04:42:47.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.570+0000 7fa316c4c640 1 --2- 172.21.15.132:0/4119758634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3100b5090 0x7fa3100d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.570+0000 7fa31644b640 1 -- 172.21.15.132:0/4119758634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3100b5090 msgr2=0x7fa3100d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:47.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.570+0000 7fa31644b640 1 --2- 172.21.15.132:0/4119758634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3100b5090 0x7fa3100d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.570+0000 7fa31644b640 1 -- 172.21.15.132:0/4119758634 >> v1:172.21.15.132:6789/0 conn(0x7fa3101611b0 legacy=0x7fa3100b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.570+0000 7fa31644b640 1 -- 172.21.15.132:0/4119758634 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3100d12a0 con 0x7fa310160450 2023-12-20T04:42:47.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.570+0000 7fa315449640 1 -- 172.21.15.132:0/4119758634 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251080238 0 0) 0x7fa3100b5ec0 con 0x7fa3101611b0 2023-12-20T04:42:47.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.571+0000 7fa31644b640 1 --2- 172.21.15.132:0/4119758634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa310160450 0x7fa310160c70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009870 tx=0x7fa30c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7592286cc6f1375a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:47.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.571+0000 7fa315449640 1 -- 172.21.15.132:0/4119758634 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c02f840 con 0x7fa310160450 2023-12-20T04:42:47.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.571+0000 7fa315449640 1 -- 172.21.15.132:0/4119758634 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30c02f9a0 con 0x7fa310160450 2023-12-20T04:42:47.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.571+0000 7fa315449640 1 -- 172.21.15.132:0/4119758634 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30c02fd30 con 0x7fa310160450 2023-12-20T04:42:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.572+0000 7fa3186af640 1 -- 172.21.15.132:0/4119758634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa310160450 msgr2=0x7fa310160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.572+0000 7fa3186af640 1 --2- 172.21.15.132:0/4119758634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa310160450 0x7fa310160c70 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fa30c009870 tx=0x7fa30c02ba20 comp rx=0 tx=0).stop 2023-12-20T04:42:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.572+0000 7fa3186af640 1 -- 172.21.15.132:0/4119758634 shutdown_connections 2023-12-20T04:42:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.572+0000 7fa3186af640 1 --2- 172.21.15.132:0/4119758634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3100b5090 0x7fa3100d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.572+0000 7fa3186af640 1 --2- 172.21.15.132:0/4119758634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa310160450 0x7fa310160c70 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.572+0000 7fa3186af640 1 -- 172.21.15.132:0/4119758634 >> 172.21.15.132:0/4119758634 conn(0x7fa3100cf980 msgr2=0x7fa3100cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.572+0000 7fa3186af640 1 -- 172.21.15.132:0/4119758634 shutdown_connections 2023-12-20T04:42:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.572+0000 7fa3186af640 1 -- 172.21.15.132:0/4119758634 wait complete. 2023-12-20T04:42:47.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.573+0000 7fa3186af640 1 Processor -- start 2023-12-20T04:42:47.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.573+0000 7fa3186af640 1 -- start start 2023-12-20T04:42:47.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa3186af640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3100b5090 0x7fa3100c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa3186af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa310160450 0x7fa31014ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa3186af640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3101611b0 0x7fa3100b6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa3186af640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31014b900 con 0x7fa310160450 2023-12-20T04:42:47.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa3186af640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa31014a7a0 con 0x7fa3101611b0 2023-12-20T04:42:47.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa3186af640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa310149b90 con 0x7fa3100b5090 2023-12-20T04:42:47.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa315c4a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa310160450 0x7fa31014ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa315c4a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa310160450 0x7fa31014ac30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48918/0 (socket says 172.21.15.132:48918) 2023-12-20T04:42:47.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa315c4a640 1 -- 172.21.15.132:0/2023093037 learned_addr learned my addr 172.21.15.132:0/2023093037 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:47.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa31644b640 1 --2- 172.21.15.132:0/2023093037 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3100b5090 0x7fa3100c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa315c4a640 1 -- 172.21.15.132:0/2023093037 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3100b5090 msgr2=0x7fa3100c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa315c4a640 1 --2- 172.21.15.132:0/2023093037 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3100b5090 0x7fa3100c87a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa315c4a640 1 -- 172.21.15.132:0/2023093037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3101611b0 msgr2=0x7fa3100b6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa316c4c640 1 --2- 172.21.15.132:0/2023093037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3101611b0 0x7fa3100b6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa315c4a640 1 --2- 172.21.15.132:0/2023093037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3101611b0 0x7fa3100b6630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa315c4a640 1 -- 172.21.15.132:0/2023093037 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c0094d0 con 0x7fa310160450 2023-12-20T04:42:47.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa315c4a640 1 --2- 172.21.15.132:0/2023093037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa310160450 0x7fa31014ac30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa30000c430 tx=0x7fa30000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:47.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa306ffd640 1 -- 172.21.15.132:0/2023093037 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3000074e0 con 0x7fa310160450 2023-12-20T04:42:47.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa306ffd640 1 -- 172.21.15.132:0/2023093037 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa300007660 con 0x7fa310160450 2023-12-20T04:42:47.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa306ffd640 1 -- 172.21.15.132:0/2023093037 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa300004a20 con 0x7fa310160450 2023-12-20T04:42:47.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa3186af640 1 -- 172.21.15.132:0/2023093037 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa310149e70 con 0x7fa310160450 2023-12-20T04:42:47.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.574+0000 7fa3186af640 1 -- 172.21.15.132:0/2023093037 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa31014a430 con 0x7fa310160450 2023-12-20T04:42:47.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.575+0000 7fa3186af640 1 -- 172.21.15.132:0/2023093037 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa31014a950 con 0x7fa310160450 2023-12-20T04:42:47.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.576+0000 7fa306ffd640 1 -- 172.21.15.132:0/2023093037 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa300004b80 con 0x7fa310160450 2023-12-20T04:42:47.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.576+0000 7fa306ffd640 1 --2- 172.21.15.132:0/2023093037 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2f406a430 0x7fa2f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.576+0000 7fa31644b640 1 --2- 172.21.15.132:0/2023093037 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2f406a430 0x7fa2f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.576+0000 7fa306ffd640 1 -- 172.21.15.132:0/2023093037 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa300088740 con 0x7fa310160450 2023-12-20T04:42:47.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.577+0000 7fa31644b640 1 --2- 172.21.15.132:0/2023093037 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2f406a430 0x7fa2f406c8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa30c036000 tx=0x7fa30c039040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:47.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.580+0000 7fa306ffd640 1 -- 172.21.15.132:0/2023093037 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa31014a950 con 0x7fa310160450 2023-12-20T04:42:47.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.744+0000 7fa3186af640 1 -- 172.21.15.132:0/2023093037 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa31014a910 con 0x7fa310160450 2023-12-20T04:42:47.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.746+0000 7fa306ffd640 1 -- 172.21.15.132:0/2023093037 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) v1 ==== 74+0+16098 (secure 0 0 0) 0x7fa300053d30 con 0x7fa310160450 2023-12-20T04:42:47.747 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:47.747 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:47.150348+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:42:47.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.747+0000 7fa3186af640 1 -- 172.21.15.132:0/2023093037 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2f406a430 msgr2=0x7fa2f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.747+0000 7fa3186af640 1 --2- 172.21.15.132:0/2023093037 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2f406a430 0x7fa2f406c8f0 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7fa30c036000 tx=0x7fa30c039040 comp rx=0 tx=0).stop 2023-12-20T04:42:47.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.747+0000 7fa3186af640 1 -- 172.21.15.132:0/2023093037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa310160450 msgr2=0x7fa31014ac30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.747+0000 7fa3186af640 1 --2- 172.21.15.132:0/2023093037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa310160450 0x7fa31014ac30 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fa30000c430 tx=0x7fa30000c8f0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.747+0000 7fa3186af640 1 -- 172.21.15.132:0/2023093037 shutdown_connections 2023-12-20T04:42:47.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.747+0000 7fa3186af640 1 --2- 172.21.15.132:0/2023093037 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2f406a430 0x7fa2f406c8f0 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.747+0000 7fa3186af640 1 --2- 172.21.15.132:0/2023093037 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3101611b0 0x7fa3100b6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.747+0000 7fa3186af640 1 --2- 172.21.15.132:0/2023093037 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa310160450 0x7fa31014ac30 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.747+0000 7fa3186af640 1 --2- 172.21.15.132:0/2023093037 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3100b5090 0x7fa3100c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.748+0000 7fa3186af640 1 -- 172.21.15.132:0/2023093037 >> 172.21.15.132:0/2023093037 conn(0x7fa3100cf980 msgr2=0x7fa3100c9140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:47.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.748+0000 7fa3186af640 1 -- 172.21.15.132:0/2023093037 shutdown_connections 2023-12-20T04:42:47.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.748+0000 7fa3186af640 1 -- 172.21.15.132:0/2023093037 wait complete. 2023-12-20T04:42:47.760 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-20T04:42:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.861+0000 7f362d021640 1 Processor -- start 2023-12-20T04:42:47.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.861+0000 7f362d021640 1 -- start start 2023-12-20T04:42:47.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.862+0000 7f362d021640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36280c41f0 0x7f36280caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.862+0000 7f362d021640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36281439f0 con 0x7f3628143610 2023-12-20T04:42:47.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.862+0000 7f362d021640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36280c46f0 con 0x7f36280cd950 2023-12-20T04:42:47.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.862+0000 7f362d021640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36280c49d0 con 0x7f36280c41f0 2023-12-20T04:42:47.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.862+0000 7f3626d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3628143610 0x7f36280cd240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45840/0 (socket says 172.21.15.132:45840) 2023-12-20T04:42:47.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.862+0000 7f3626d9d640 1 -- 172.21.15.132:0/2968420025 learned_addr learned my addr 172.21.15.132:0/2968420025 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:47.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.862+0000 7f362759e640 1 --2- 172.21.15.132:0/2968420025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36280c41f0 0x7f36280caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.862+0000 7f3625d9b640 1 -- 172.21.15.132:0/2968420025 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3661691007 0 0) 0x7f36281439f0 con 0x7f3628143610 2023-12-20T04:42:47.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.862+0000 7f3625d9b640 1 -- 172.21.15.132:0/2968420025 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3610003520 con 0x7f3628143610 2023-12-20T04:42:47.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.862+0000 7f3625d9b640 1 -- 172.21.15.132:0/2968420025 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049394756 0 0) 0x7f36280c46f0 con 0x7f36280cd950 2023-12-20T04:42:47.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.862+0000 7f3625d9b640 1 -- 172.21.15.132:0/2968420025 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36281439f0 con 0x7f36280cd950 2023-12-20T04:42:47.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.862+0000 7f3625d9b640 1 -- 172.21.15.132:0/2968420025 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 710675136 0 0) 0x7f3610003520 con 0x7f3628143610 2023-12-20T04:42:47.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3625d9b640 1 -- 172.21.15.132:0/2968420025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36280c41f0 msgr2=0x7f36280caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:47.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3625d9b640 1 --2- 172.21.15.132:0/2968420025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36280c41f0 0x7f36280caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3625d9b640 1 -- 172.21.15.132:0/2968420025 >> v1:172.21.15.187:6789/0 conn(0x7f36280cd950 legacy=0x7f362806b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3625d9b640 1 -- 172.21.15.132:0/2968420025 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36280c4cb0 con 0x7f3628143610 2023-12-20T04:42:47.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3625d9b640 1 -- 172.21.15.132:0/2968420025 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f3618001a10 con 0x7f3628143610 2023-12-20T04:42:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3625d9b640 1 -- 172.21.15.132:0/2968420025 >> v1:172.21.15.132:6789/0 conn(0x7f3628143610 legacy=0x7f36280cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3625d9b640 1 --2- 172.21.15.132:0/2968420025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3610003b30 0x7f3610003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3625d9b640 1 --2- 172.21.15.132:0/2968420025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36100047c0 0x7f3610004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3625d9b640 1 --2- 172.21.15.132:0/2968420025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36280c41f0 0x7f3610005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3625d9b640 1 -- 172.21.15.132:0/2968420025 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36280c49d0 con 0x7f3610003b30 2023-12-20T04:42:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3625d9b640 1 -- 172.21.15.132:0/2968420025 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f361000dc40 con 0x7f36100047c0 2023-12-20T04:42:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3625d9b640 1 -- 172.21.15.132:0/2968420025 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f361000de00 con 0x7f36280c41f0 2023-12-20T04:42:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3626d9d640 1 --2- 172.21.15.132:0/2968420025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3610003b30 0x7f3610003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f362659c640 1 --2- 172.21.15.132:0/2968420025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36100047c0 0x7f3610004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f362759e640 1 --2- 172.21.15.132:0/2968420025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36280c41f0 0x7f3610005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3626d9d640 1 -- 172.21.15.132:0/2968420025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36280c41f0 msgr2=0x7f3610005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3626d9d640 1 --2- 172.21.15.132:0/2968420025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36280c41f0 0x7f3610005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3626d9d640 1 -- 172.21.15.132:0/2968420025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36100047c0 msgr2=0x7f3610004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3626d9d640 1 --2- 172.21.15.132:0/2968420025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36100047c0 0x7f3610004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f3626d9d640 1 -- 172.21.15.132:0/2968420025 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3610003520 con 0x7f3610003b30 2023-12-20T04:42:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.863+0000 7f362659c640 1 --2- 172.21.15.132:0/2968420025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36100047c0 0x7f3610004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.864+0000 7f3626d9d640 1 --2- 172.21.15.132:0/2968420025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3610003b30 0x7f3610003f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3618002230 tx=0x7f36100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ea5d4aaf7c3bdfd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.864+0000 7f3625d9b640 1 -- 172.21.15.132:0/2968420025 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618034630 con 0x7f3610003b30 2023-12-20T04:42:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.864+0000 7f3625d9b640 1 -- 172.21.15.132:0/2968420025 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f361802f070 con 0x7f3610003b30 2023-12-20T04:42:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.864+0000 7f3625d9b640 1 -- 172.21.15.132:0/2968420025 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36180349f0 con 0x7f3610003b30 2023-12-20T04:42:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.864+0000 7f362d021640 1 -- 172.21.15.132:0/2968420025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3610003b30 msgr2=0x7f3610003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.864+0000 7f362d021640 1 --2- 172.21.15.132:0/2968420025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3610003b30 0x7f3610003f30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f3618002230 tx=0x7f36100057f0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.864+0000 7f362759e640 1 -- 172.21.15.132:0/2968420025 reap_dead start 2023-12-20T04:42:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.864+0000 7f362d021640 1 -- 172.21.15.132:0/2968420025 shutdown_connections 2023-12-20T04:42:47.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.864+0000 7f362d021640 1 -- 172.21.15.132:0/2968420025 >> 172.21.15.132:0/2968420025 conn(0x7f362806a260 msgr2=0x7f36280b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.864+0000 7f362d021640 1 -- 172.21.15.132:0/2968420025 shutdown_connections 2023-12-20T04:42:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.864+0000 7f362d021640 1 -- 172.21.15.132:0/2968420025 wait complete. 2023-12-20T04:42:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.866+0000 7f362d021640 1 Processor -- start 2023-12-20T04:42:47.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.866+0000 7f362d021640 1 -- start start 2023-12-20T04:42:47.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.866+0000 7f362d021640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3610003b30 0x7f36280b14b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.866+0000 7f362d021640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3628159890 0x7f36280af310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.866+0000 7f362d021640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36280c61a0 0x7f36280afbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.866+0000 7f362d021640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36280af850 con 0x7f3610003b30 2023-12-20T04:42:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.866+0000 7f362d021640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36280b1b40 con 0x7f36280c61a0 2023-12-20T04:42:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.866+0000 7f362d021640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36280b1e20 con 0x7f3628159890 2023-12-20T04:42:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f3626d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3610003b30 0x7f36280b14b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f3626d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3610003b30 0x7f36280b14b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48938/0 (socket says 172.21.15.132:48938) 2023-12-20T04:42:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f3626d9d640 1 -- 172.21.15.132:0/763368186 learned_addr learned my addr 172.21.15.132:0/763368186 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f362759e640 1 --2- 172.21.15.132:0/763368186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36280c61a0 0x7f36280afbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f362659c640 1 --2- 172.21.15.132:0/763368186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3628159890 0x7f36280af310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f3626d9d640 1 -- 172.21.15.132:0/763368186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3628159890 msgr2=0x7f36280af310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f3626d9d640 1 --2- 172.21.15.132:0/763368186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3628159890 0x7f36280af310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f3626d9d640 1 -- 172.21.15.132:0/763368186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36280c61a0 msgr2=0x7f36280afbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f3626d9d640 1 --2- 172.21.15.132:0/763368186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36280c61a0 0x7f36280afbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f3626d9d640 1 -- 172.21.15.132:0/763368186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36280b2100 con 0x7f3610003b30 2023-12-20T04:42:47.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f362759e640 1 --2- 172.21.15.132:0/763368186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36280c61a0 0x7f36280afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f362659c640 1 --2- 172.21.15.132:0/763368186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3628159890 0x7f36280af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f3626d9d640 1 --2- 172.21.15.132:0/763368186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3610003b30 0x7f36280b14b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3618000f80 tx=0x7f3618001d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f360f7fe640 1 -- 172.21.15.132:0/763368186 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618034640 con 0x7f3610003b30 2023-12-20T04:42:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f360f7fe640 1 -- 172.21.15.132:0/763368186 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36180347a0 con 0x7f3610003b30 2023-12-20T04:42:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f362d021640 1 -- 172.21.15.132:0/763368186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36280b23e0 con 0x7f3610003b30 2023-12-20T04:42:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f360f7fe640 1 -- 172.21.15.132:0/763368186 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3618034b50 con 0x7f3610003b30 2023-12-20T04:42:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.867+0000 7f362d021640 1 -- 172.21.15.132:0/763368186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36280c6650 con 0x7f3610003b30 2023-12-20T04:42:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.868+0000 7f362d021640 1 -- 172.21.15.132:0/763368186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f362804e840 con 0x7f3610003b30 2023-12-20T04:42:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.869+0000 7f360f7fe640 1 -- 172.21.15.132:0/763368186 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3618031030 con 0x7f3610003b30 2023-12-20T04:42:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.869+0000 7f360f7fe640 1 --2- 172.21.15.132:0/763368186 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f361406a460 0x7f361406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.869+0000 7f362659c640 1 --2- 172.21.15.132:0/763368186 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f361406a460 0x7f361406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.869+0000 7f360f7fe640 1 -- 172.21.15.132:0/763368186 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(19..19 src has 1..19) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36180aae50 con 0x7f3610003b30 2023-12-20T04:42:47.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.869+0000 7f362659c640 1 --2- 172.21.15.132:0/763368186 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f361406a460 0x7f361406c920 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f36280c5c90 tx=0x7f361c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:47.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:47.873+0000 7f360f7fe640 1 -- 172.21.15.132:0/763368186 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3618076560 con 0x7f3610003b30 2023-12-20T04:42:48.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.079+0000 7f362d021640 1 -- 172.21.15.132:0/763368186 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f36280c3fa0 con 0x7f3610003b30 2023-12-20T04:42:48.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.154+0000 7f360f7fe640 1 -- 172.21.15.132:0/763368186 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v5) v1 ==== 118+0+0 (secure 0 0 0) 0x7f3618034cb0 con 0x7f3610003b30 2023-12-20T04:42:48.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.156+0000 7f362d021640 1 -- 172.21.15.132:0/763368186 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f361406a460 msgr2=0x7f361406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:48.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.156+0000 7f362d021640 1 --2- 172.21.15.132:0/763368186 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f361406a460 0x7f361406c920 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f36280c5c90 tx=0x7f361c009040 comp rx=0 tx=0).stop 2023-12-20T04:42:48.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.156+0000 7f362d021640 1 -- 172.21.15.132:0/763368186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3610003b30 msgr2=0x7f36280b14b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:48.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.156+0000 7f362d021640 1 --2- 172.21.15.132:0/763368186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3610003b30 0x7f36280b14b0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3618000f80 tx=0x7f3618001d20 comp rx=0 tx=0).stop 2023-12-20T04:42:48.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.156+0000 7f362d021640 1 -- 172.21.15.132:0/763368186 shutdown_connections 2023-12-20T04:42:48.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.156+0000 7f362d021640 1 --2- 172.21.15.132:0/763368186 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f361406a460 0x7f361406c920 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:48.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.156+0000 7f362d021640 1 --2- 172.21.15.132:0/763368186 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36280c61a0 0x7f36280afbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:48.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.156+0000 7f362d021640 1 --2- 172.21.15.132:0/763368186 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3628159890 0x7f36280af310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:48.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.156+0000 7f362d021640 1 --2- 172.21.15.132:0/763368186 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3610003b30 0x7f36280b14b0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:48.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.156+0000 7f362d021640 1 -- 172.21.15.132:0/763368186 >> 172.21.15.132:0/763368186 conn(0x7f362806a260 msgr2=0x7f36280cd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:48.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.156+0000 7f362d021640 1 -- 172.21.15.132:0/763368186 shutdown_connections 2023-12-20T04:42:48.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.156+0000 7f362d021640 1 -- 172.21.15.132:0/763368186 wait complete. 2023-12-20T04:42:48.170 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd', 'disabled']} 2023-12-20T04:42:48.170 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-20T04:42:48.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.271+0000 7f31e0adf640 1 Processor -- start 2023-12-20T04:42:48.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.271+0000 7f31e0adf640 1 -- start start 2023-12-20T04:42:48.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.271+0000 7f31e0adf640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f31dc0cd950 0x7f31dc0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:48.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.271+0000 7f31e0adf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31dc1439f0 con 0x7f31dc0c41f0 2023-12-20T04:42:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.271+0000 7f31e0adf640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31dc0c46f0 con 0x7f31dc143610 2023-12-20T04:42:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.271+0000 7f31e0adf640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31dc0c49d0 con 0x7f31dc0cd950 2023-12-20T04:42:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31dad9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f31dc0c41f0 0x7f31dc06b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45852/0 (socket says 172.21.15.132:45852) 2023-12-20T04:42:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31dad9d640 1 -- 172.21.15.132:0/389194035 learned_addr learned my addr 172.21.15.132:0/389194035 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31d3fff640 1 --2- 172.21.15.132:0/389194035 >> v2:172.21.15.187:3300/0 conn(0x7f31dc0cd950 0x7f31dc0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31d9d9b640 1 -- 172.21.15.132:0/389194035 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 576677354 0 0) 0x7f31dc1439f0 con 0x7f31dc0c41f0 2023-12-20T04:42:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31d9d9b640 1 -- 172.21.15.132:0/389194035 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f31c8003520 con 0x7f31dc0c41f0 2023-12-20T04:42:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31d9d9b640 1 -- 172.21.15.132:0/389194035 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1451073492 0 0) 0x7f31c8003520 con 0x7f31dc0c41f0 2023-12-20T04:42:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31d9d9b640 1 -- 172.21.15.132:0/389194035 >> v2:172.21.15.187:3300/0 conn(0x7f31dc0cd950 msgr2=0x7f31dc0caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31d9d9b640 1 --2- 172.21.15.132:0/389194035 >> v2:172.21.15.187:3300/0 conn(0x7f31dc0cd950 0x7f31dc0caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31d9d9b640 1 -- 172.21.15.132:0/389194035 >> v1:172.21.15.187:6789/0 conn(0x7f31dc143610 legacy=0x7f31dc0cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31d9d9b640 1 -- 172.21.15.132:0/389194035 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31dc0c4cb0 con 0x7f31dc0c41f0 2023-12-20T04:42:48.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31d9d9b640 1 -- 172.21.15.132:0/389194035 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f31d4001a10 con 0x7f31dc0c41f0 2023-12-20T04:42:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31d9d9b640 1 -- 172.21.15.132:0/389194035 >> v1:172.21.15.132:6789/0 conn(0x7f31dc0c41f0 legacy=0x7f31dc06b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31d9d9b640 1 --2- 172.21.15.132:0/389194035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31c8003970 0x7f31c8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31d9d9b640 1 --2- 172.21.15.132:0/389194035 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31c80047c0 0x7f31c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31d9d9b640 1 --2- 172.21.15.132:0/389194035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31c8005180 0x7f31c800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31d9d9b640 1 -- 172.21.15.132:0/389194035 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc0c49d0 con 0x7f31c8003970 2023-12-20T04:42:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31d9d9b640 1 -- 172.21.15.132:0/389194035 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c800c020 con 0x7f31c8005180 2023-12-20T04:42:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31d9d9b640 1 -- 172.21.15.132:0/389194035 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31c800c1e0 con 0x7f31c80047c0 2023-12-20T04:42:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31da59c640 1 --2- 172.21.15.132:0/389194035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31c8003970 0x7f31c8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31dad9d640 1 --2- 172.21.15.132:0/389194035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31c8005180 0x7f31c800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31d3fff640 1 --2- 172.21.15.132:0/389194035 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31c80047c0 0x7f31c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31da59c640 1 -- 172.21.15.132:0/389194035 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31c80047c0 msgr2=0x7f31c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31da59c640 1 --2- 172.21.15.132:0/389194035 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31c80047c0 0x7f31c8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31da59c640 1 -- 172.21.15.132:0/389194035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31c8005180 msgr2=0x7f31c800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31da59c640 1 --2- 172.21.15.132:0/389194035 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31c8005180 0x7f31c800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:48.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31da59c640 1 -- 172.21.15.132:0/389194035 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31c8003520 con 0x7f31c8003970 2023-12-20T04:42:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.272+0000 7f31dad9d640 1 -- 172.21.15.132:0/389194035 reap_dead start 2023-12-20T04:42:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.273+0000 7f31da59c640 1 --2- 172.21.15.132:0/389194035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31c8003970 0x7f31c8003d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f31cc001750 tx=0x7f31c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30c09c96a7cefc4f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.273+0000 7f31d9d9b640 1 -- 172.21.15.132:0/389194035 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0052d0 con 0x7f31c8003970 2023-12-20T04:42:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.273+0000 7f31d9d9b640 1 -- 172.21.15.132:0/389194035 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc02e050 con 0x7f31c8003970 2023-12-20T04:42:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.273+0000 7f31d9d9b640 1 -- 172.21.15.132:0/389194035 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc003830 con 0x7f31c8003970 2023-12-20T04:42:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.274+0000 7f31e0adf640 1 -- 172.21.15.132:0/389194035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31c8003970 msgr2=0x7f31c8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.274+0000 7f31e0adf640 1 --2- 172.21.15.132:0/389194035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31c8003970 0x7f31c8003d90 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f31cc001750 tx=0x7f31c80057f0 comp rx=0 tx=0).stop 2023-12-20T04:42:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.274+0000 7f31e0adf640 1 -- 172.21.15.132:0/389194035 shutdown_connections 2023-12-20T04:42:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.274+0000 7f31e0adf640 1 --2- 172.21.15.132:0/389194035 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31c8003970 0x7f31c8003d90 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.274+0000 7f31e0adf640 1 -- 172.21.15.132:0/389194035 >> 172.21.15.132:0/389194035 conn(0x7f31dc06a260 msgr2=0x7f31dc0b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.274+0000 7f31e0adf640 1 -- 172.21.15.132:0/389194035 shutdown_connections 2023-12-20T04:42:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.274+0000 7f31e0adf640 1 -- 172.21.15.132:0/389194035 wait complete. 2023-12-20T04:42:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.275+0000 7f31e0adf640 1 Processor -- start 2023-12-20T04:42:48.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.275+0000 7f31e0adf640 1 -- start start 2023-12-20T04:42:48.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31e0adf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31c8003970 0x7f31dc0c7e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:48.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31e0adf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31dc0c5b70 0x7f31dc0ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:48.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31e0adf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31dc0c5fd0 0x7f31dc0ceed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:48.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31e0adf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc1445f0 con 0x7f31c8003970 2023-12-20T04:42:48.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31e0adf640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc0c83b0 con 0x7f31dc0c5fd0 2023-12-20T04:42:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31e0adf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31dc0c87f0 con 0x7f31dc0c5b70 2023-12-20T04:42:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31da59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31c8003970 0x7f31dc0c7e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31da59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31c8003970 0x7f31dc0c7e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48958/0 (socket says 172.21.15.132:48958) 2023-12-20T04:42:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31da59c640 1 -- 172.21.15.132:0/3557321315 learned_addr learned my addr 172.21.15.132:0/3557321315 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31dad9d640 1 --2- 172.21.15.132:0/3557321315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31dc0c5fd0 0x7f31dc0ceed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31d3fff640 1 --2- 172.21.15.132:0/3557321315 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31dc0c5b70 0x7f31dc0ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31da59c640 1 -- 172.21.15.132:0/3557321315 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31dc0c5b70 msgr2=0x7f31dc0ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31da59c640 1 --2- 172.21.15.132:0/3557321315 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31dc0c5b70 0x7f31dc0ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31da59c640 1 -- 172.21.15.132:0/3557321315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31dc0c5fd0 msgr2=0x7f31dc0ceed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31da59c640 1 --2- 172.21.15.132:0/3557321315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31dc0c5fd0 0x7f31dc0ceed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31da59c640 1 -- 172.21.15.132:0/3557321315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31dc144840 con 0x7f31c8003970 2023-12-20T04:42:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31dad9d640 1 --2- 172.21.15.132:0/3557321315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31dc0c5fd0 0x7f31dc0ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31da59c640 1 --2- 172.21.15.132:0/3557321315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31c8003970 0x7f31dc0c7e70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f31cc02bc00 tx=0x7f31cc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:48.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31d2ffd640 1 -- 172.21.15.132:0/3557321315 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc0076c0 con 0x7f31c8003970 2023-12-20T04:42:48.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31d2ffd640 1 -- 172.21.15.132:0/3557321315 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31cc007a30 con 0x7f31c8003970 2023-12-20T04:42:48.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31e0adf640 1 -- 172.21.15.132:0/3557321315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31dc144b20 con 0x7f31c8003970 2023-12-20T04:42:48.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31d2ffd640 1 -- 172.21.15.132:0/3557321315 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31cc006be0 con 0x7f31c8003970 2023-12-20T04:42:48.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.276+0000 7f31e0adf640 1 -- 172.21.15.132:0/3557321315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31dc1450e0 con 0x7f31c8003970 2023-12-20T04:42:48.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.277+0000 7f31e0adf640 1 -- 172.21.15.132:0/3557321315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31dc0b4860 con 0x7f31c8003970 2023-12-20T04:42:48.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.278+0000 7f31d2ffd640 1 -- 172.21.15.132:0/3557321315 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f31cc006d40 con 0x7f31c8003970 2023-12-20T04:42:48.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.278+0000 7f31d2ffd640 1 --2- 172.21.15.132:0/3557321315 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31bc06a460 0x7f31bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:48.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.278+0000 7f31d3fff640 1 --2- 172.21.15.132:0/3557321315 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31bc06a460 0x7f31bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:48.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.278+0000 7f31d2ffd640 1 -- 172.21.15.132:0/3557321315 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31cc0aa5e0 con 0x7f31c8003970 2023-12-20T04:42:48.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.279+0000 7f31d3fff640 1 --2- 172.21.15.132:0/3557321315 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31bc06a460 0x7f31bc06c920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f31dc06bb50 tx=0x7f31c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:48.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.283+0000 7f31d2ffd640 1 -- 172.21.15.132:0/3557321315 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f31cc075b40 con 0x7f31c8003970 2023-12-20T04:42:48.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:48.484+0000 7f31e0adf640 1 -- 172.21.15.132:0/3557321315 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f31dc0b12a0 con 0x7f31c8003970 2023-12-20T04:42:49.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.161+0000 7f31d2ffd640 1 -- 172.21.15.132:0/3557321315 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f31cc079160 con 0x7f31c8003970 2023-12-20T04:42:49.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.164+0000 7f31e0adf640 1 -- 172.21.15.132:0/3557321315 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31bc06a460 msgr2=0x7f31bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.164+0000 7f31e0adf640 1 --2- 172.21.15.132:0/3557321315 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31bc06a460 0x7f31bc06c920 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7f31dc06bb50 tx=0x7f31c4008040 comp rx=0 tx=0).stop 2023-12-20T04:42:49.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.164+0000 7f31e0adf640 1 -- 172.21.15.132:0/3557321315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31c8003970 msgr2=0x7f31dc0c7e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.164+0000 7f31e0adf640 1 --2- 172.21.15.132:0/3557321315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31c8003970 0x7f31dc0c7e70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f31cc02bc00 tx=0x7f31cc001120 comp rx=0 tx=0).stop 2023-12-20T04:42:49.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.164+0000 7f31e0adf640 1 -- 172.21.15.132:0/3557321315 shutdown_connections 2023-12-20T04:42:49.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.164+0000 7f31e0adf640 1 --2- 172.21.15.132:0/3557321315 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31bc06a460 0x7f31bc06c920 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.164+0000 7f31e0adf640 1 --2- 172.21.15.132:0/3557321315 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31dc0c5fd0 0x7f31dc0ceed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.164+0000 7f31e0adf640 1 --2- 172.21.15.132:0/3557321315 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31dc0c5b70 0x7f31dc0ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.164+0000 7f31e0adf640 1 --2- 172.21.15.132:0/3557321315 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31c8003970 0x7f31dc0c7e70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.164+0000 7f31e0adf640 1 -- 172.21.15.132:0/3557321315 >> 172.21.15.132:0/3557321315 conn(0x7f31dc06a260 msgr2=0x7f31dc0b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:49.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.164+0000 7f31e0adf640 1 -- 172.21.15.132:0/3557321315 shutdown_connections 2023-12-20T04:42:49.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.164+0000 7f31e0adf640 1 -- 172.21.15.132:0/3557321315 wait complete. 2023-12-20T04:42:49.178 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-20T04:42:49.178 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:42:49.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.278+0000 7fee35cce640 1 Processor -- start 2023-12-20T04:42:49.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.278+0000 7fee35cce640 1 -- start start 2023-12-20T04:42:49.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.279+0000 7fee35cce640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fee3015e2d0 0x7fee300b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.279+0000 7fee35cce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fee300cb420 0x7fee300ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.279+0000 7fee35cce640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fee300cd740 con 0x7fee300ceee0 2023-12-20T04:42:49.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.279+0000 7fee35cce640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee300ce230 con 0x7fee300cb420 2023-12-20T04:42:49.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.279+0000 7fee35cce640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fee300cf2f0 con 0x7fee3015e2d0 2023-12-20T04:42:49.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.279+0000 7fee2effd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fee300cb420 0x7fee300ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:49.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.279+0000 7fee2effd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fee300cb420 0x7fee300ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48962/0 (socket says 172.21.15.132:48962) 2023-12-20T04:42:49.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.279+0000 7fee2effd640 1 -- 172.21.15.132:0/3735832838 learned_addr learned my addr 172.21.15.132:0/3735832838 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:49.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.279+0000 7fee2ffff640 1 --1- 172.21.15.132:0/3735832838 >> v1:172.21.15.132:6789/0 conn(0x7fee300ceee0 0x7fee3015ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45858/0 (socket says 172.21.15.132:45858) 2023-12-20T04:42:49.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.279+0000 7fee2f7fe640 1 --2- 172.21.15.132:0/3735832838 >> v2:172.21.15.187:3300/0 conn(0x7fee3015e2d0 0x7fee300b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:49.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.280+0000 7fee2effd640 1 -- 172.21.15.132:0/3735832838 >> v2:172.21.15.187:3300/0 conn(0x7fee3015e2d0 msgr2=0x7fee300b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:49.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.280+0000 7fee2effd640 1 --2- 172.21.15.132:0/3735832838 >> v2:172.21.15.187:3300/0 conn(0x7fee3015e2d0 0x7fee300b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.280+0000 7fee2effd640 1 -- 172.21.15.132:0/3735832838 >> v1:172.21.15.132:6789/0 conn(0x7fee300ceee0 legacy=0x7fee3015ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.280+0000 7fee2effd640 1 -- 172.21.15.132:0/3735832838 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee300cd990 con 0x7fee300cb420 2023-12-20T04:42:49.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.280+0000 7fee2e7fc640 1 -- 172.21.15.132:0/3735832838 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3026161987 0 0) 0x7fee300cd740 con 0x7fee300ceee0 2023-12-20T04:42:49.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.280+0000 7fee2f7fe640 1 --2- 172.21.15.132:0/3735832838 >> v2:172.21.15.187:3300/0 conn(0x7fee3015e2d0 0x7fee300b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:49.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.280+0000 7fee2effd640 1 --2- 172.21.15.132:0/3735832838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee300cb420 0x7fee300ce9a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee3006d070 tx=0x7fee2402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f23f57d1704361ae server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:49.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.280+0000 7fee2e7fc640 1 -- 172.21.15.132:0/3735832838 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24031870 con 0x7fee300cb420 2023-12-20T04:42:49.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.280+0000 7fee2e7fc640 1 -- 172.21.15.132:0/3735832838 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee240319d0 con 0x7fee300cb420 2023-12-20T04:42:49.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.280+0000 7fee2e7fc640 1 -- 172.21.15.132:0/3735832838 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24031d60 con 0x7fee300cb420 2023-12-20T04:42:49.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.281+0000 7fee35cce640 1 -- 172.21.15.132:0/3735832838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee300cb420 msgr2=0x7fee300ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.281+0000 7fee35cce640 1 --2- 172.21.15.132:0/3735832838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee300cb420 0x7fee300ce9a0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fee3006d070 tx=0x7fee2402b910 comp rx=0 tx=0).stop 2023-12-20T04:42:49.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.281+0000 7fee35cce640 1 -- 172.21.15.132:0/3735832838 shutdown_connections 2023-12-20T04:42:49.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.281+0000 7fee35cce640 1 --2- 172.21.15.132:0/3735832838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee300cb420 0x7fee300ce9a0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.281+0000 7fee35cce640 1 --2- 172.21.15.132:0/3735832838 >> v2:172.21.15.187:3300/0 conn(0x7fee3015e2d0 0x7fee300b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.281+0000 7fee35cce640 1 -- 172.21.15.132:0/3735832838 >> 172.21.15.132:0/3735832838 conn(0x7fee3006d7c0 msgr2=0x7fee3006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:49.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.281+0000 7fee35cce640 1 -- 172.21.15.132:0/3735832838 shutdown_connections 2023-12-20T04:42:49.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.281+0000 7fee35cce640 1 -- 172.21.15.132:0/3735832838 wait complete. 2023-12-20T04:42:49.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.282+0000 7fee35cce640 1 Processor -- start 2023-12-20T04:42:49.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.282+0000 7fee35cce640 1 -- start start 2023-12-20T04:42:49.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.283+0000 7fee35cce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee300cb420 0x7fee301587c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.283+0000 7fee35cce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee300ceee0 0x7fee301f0b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.283+0000 7fee35cce640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee3015e2d0 0x7fee300b15c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.283+0000 7fee35cce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee300c5f60 con 0x7fee300ceee0 2023-12-20T04:42:49.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.283+0000 7fee35cce640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee300c9c90 con 0x7fee3015e2d0 2023-12-20T04:42:49.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.283+0000 7fee35cce640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fee30158d00 con 0x7fee300cb420 2023-12-20T04:42:49.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.283+0000 7fee2effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee300ceee0 0x7fee301f0b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:49.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.283+0000 7fee2effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee300ceee0 0x7fee301f0b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48976/0 (socket says 172.21.15.132:48976) 2023-12-20T04:42:49.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.283+0000 7fee2effd640 1 -- 172.21.15.132:0/4058090277 learned_addr learned my addr 172.21.15.132:0/4058090277 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:49.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.283+0000 7fee2effd640 1 -- 172.21.15.132:0/4058090277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee300cb420 msgr2=0x7fee301587c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.283+0000 7fee2effd640 1 --2- 172.21.15.132:0/4058090277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee300cb420 0x7fee301587c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.283+0000 7fee2effd640 1 -- 172.21.15.132:0/4058090277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee3015e2d0 msgr2=0x7fee300b15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.283+0000 7fee2ffff640 1 --2- 172.21.15.132:0/4058090277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee3015e2d0 0x7fee300b15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:49.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.283+0000 7fee2effd640 1 --2- 172.21.15.132:0/4058090277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee3015e2d0 0x7fee300b15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.283+0000 7fee2effd640 1 -- 172.21.15.132:0/4058090277 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee240094d0 con 0x7fee300ceee0 2023-12-20T04:42:49.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.283+0000 7fee2effd640 1 --2- 172.21.15.132:0/4058090277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee300ceee0 0x7fee301f0b20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fee24000c00 tx=0x7fee240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:49.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.284+0000 7fee17fff640 1 -- 172.21.15.132:0/4058090277 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee2403bbf0 con 0x7fee300ceee0 2023-12-20T04:42:49.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.284+0000 7fee17fff640 1 -- 172.21.15.132:0/4058090277 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fee2403bd50 con 0x7fee300ceee0 2023-12-20T04:42:49.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.284+0000 7fee35cce640 1 -- 172.21.15.132:0/4058090277 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee300c9360 con 0x7fee300ceee0 2023-12-20T04:42:49.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.284+0000 7fee17fff640 1 -- 172.21.15.132:0/4058090277 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fee24004270 con 0x7fee300ceee0 2023-12-20T04:42:49.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.284+0000 7fee35cce640 1 -- 172.21.15.132:0/4058090277 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee300c9920 con 0x7fee300ceee0 2023-12-20T04:42:49.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.285+0000 7fee35cce640 1 -- 172.21.15.132:0/4058090277 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee3004e840 con 0x7fee300ceee0 2023-12-20T04:42:49.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.285+0000 7fee17fff640 1 -- 172.21.15.132:0/4058090277 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fee24043070 con 0x7fee300ceee0 2023-12-20T04:42:49.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.285+0000 7fee17fff640 1 --2- 172.21.15.132:0/4058090277 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fee1c06a430 0x7fee1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.285+0000 7fee17fff640 1 -- 172.21.15.132:0/4058090277 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fee2402d040 con 0x7fee300ceee0 2023-12-20T04:42:49.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.285+0000 7fee2f7fe640 1 --2- 172.21.15.132:0/4058090277 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fee1c06a430 0x7fee1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:49.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.286+0000 7fee2f7fe640 1 --2- 172.21.15.132:0/4058090277 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fee1c06a430 0x7fee1c06c8f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee20006fd0 tx=0x7fee20008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:49.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.290+0000 7fee17fff640 1 -- 172.21.15.132:0/4058090277 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fee24076240 con 0x7fee300ceee0 2023-12-20T04:42:49.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.488+0000 7fee35cce640 1 -- 172.21.15.132:0/4058090277 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fee300c9e00 con 0x7fee300ceee0 2023-12-20T04:42:49.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.488+0000 7fee17fff640 1 -- 172.21.15.132:0/4058090277 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4709 (secure 0 0 0) 0x7fee24035020 con 0x7fee300ceee0 2023-12-20T04:42:49.490 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:49.490 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/342123967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":342123967},{"type":"v1","addr":"172.21.15.187:6835","nonce":342123967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2678730048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2678730048},{"type":"v1","addr":"172.21.15.132:6836","nonce":2678730048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2874427434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2874427434},{"type":"v1","addr":"172.21.15.132:6837","nonce":2874427434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:42:47.150648+0000","modified":"2023-12-20T04:42:49.158537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/839566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":839566266},{"type":"v1","addr":"172.21.15.187:6834","nonce":839566266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-20T04:42:49.491 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2023-12-20T04:42:49.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.490+0000 7fee35cce640 1 -- 172.21.15.132:0/4058090277 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fee1c06a430 msgr2=0x7fee1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.490+0000 7fee35cce640 1 --2- 172.21.15.132:0/4058090277 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fee1c06a430 0x7fee1c06c8f0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7fee20006fd0 tx=0x7fee20008040 comp rx=0 tx=0).stop 2023-12-20T04:42:49.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.490+0000 7fee35cce640 1 -- 172.21.15.132:0/4058090277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee300ceee0 msgr2=0x7fee301f0b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.490+0000 7fee35cce640 1 --2- 172.21.15.132:0/4058090277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee300ceee0 0x7fee301f0b20 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fee24000c00 tx=0x7fee240046c0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.490+0000 7fee35cce640 1 -- 172.21.15.132:0/4058090277 shutdown_connections 2023-12-20T04:42:49.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.490+0000 7fee35cce640 1 --2- 172.21.15.132:0/4058090277 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fee1c06a430 0x7fee1c06c8f0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.490+0000 7fee35cce640 1 --2- 172.21.15.132:0/4058090277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fee3015e2d0 0x7fee300b15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.490+0000 7fee35cce640 1 --2- 172.21.15.132:0/4058090277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fee300ceee0 0x7fee301f0b20 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.490+0000 7fee35cce640 1 --2- 172.21.15.132:0/4058090277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fee300cb420 0x7fee301587c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.490+0000 7fee35cce640 1 -- 172.21.15.132:0/4058090277 >> 172.21.15.132:0/4058090277 conn(0x7fee3006d7c0 msgr2=0x7fee3015d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:49.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.490+0000 7fee35cce640 1 -- 172.21.15.132:0/4058090277 shutdown_connections 2023-12-20T04:42:49.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.490+0000 7fee35cce640 1 -- 172.21.15.132:0/4058090277 wait complete. 2023-12-20T04:42:49.504 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:42:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.601+0000 7ff8bc6af640 1 Processor -- start 2023-12-20T04:42:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.601+0000 7ff8bc6af640 1 -- start start 2023-12-20T04:42:49.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.602+0000 7ff8bc6af640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff8b406f0e0 0x7ff8b415f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.602+0000 7ff8bc6af640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b406f750 con 0x7ff8b415f9c0 2023-12-20T04:42:49.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.602+0000 7ff8bc6af640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8b406fa30 con 0x7ff8b40d08c0 2023-12-20T04:42:49.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.602+0000 7ff8bc6af640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8b415f060 con 0x7ff8b406f0e0 2023-12-20T04:42:49.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.602+0000 7ff8bac4c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff8b415f9c0 0x7ff8b415b7d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45860/0 (socket says 172.21.15.132:45860) 2023-12-20T04:42:49.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8bac4c640 1 -- 172.21.15.132:0/2945568745 learned_addr learned my addr 172.21.15.132:0/2945568745 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:49.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8b9c4a640 1 --2- 172.21.15.132:0/2945568745 >> v2:172.21.15.187:3300/0 conn(0x7ff8b406f0e0 0x7ff8b415f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:49.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8b9449640 1 -- 172.21.15.132:0/2945568745 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 336115916 0 0) 0x7ff8b406f750 con 0x7ff8b415f9c0 2023-12-20T04:42:49.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8b9449640 1 -- 172.21.15.132:0/2945568745 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff8a0003520 con 0x7ff8b415f9c0 2023-12-20T04:42:49.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8b9449640 1 -- 172.21.15.132:0/2945568745 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2597575945 0 0) 0x7ff8a0003520 con 0x7ff8b415f9c0 2023-12-20T04:42:49.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8b9449640 1 -- 172.21.15.132:0/2945568745 >> v2:172.21.15.187:3300/0 conn(0x7ff8b406f0e0 msgr2=0x7ff8b415f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:49.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8b9449640 1 --2- 172.21.15.132:0/2945568745 >> v2:172.21.15.187:3300/0 conn(0x7ff8b406f0e0 0x7ff8b415f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8b9449640 1 -- 172.21.15.132:0/2945568745 >> v1:172.21.15.187:6789/0 conn(0x7ff8b40d08c0 legacy=0x7ff8b40cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8b9449640 1 -- 172.21.15.132:0/2945568745 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b406fd10 con 0x7ff8b415f9c0 2023-12-20T04:42:49.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8b9449640 1 -- 172.21.15.132:0/2945568745 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7ff8ac001670 con 0x7ff8b415f9c0 2023-12-20T04:42:49.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8b9449640 1 -- 172.21.15.132:0/2945568745 >> v1:172.21.15.132:6789/0 conn(0x7ff8b415f9c0 legacy=0x7ff8b415b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8b9449640 1 --2- 172.21.15.132:0/2945568745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8a0003970 0x7ff8a0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8b9449640 1 --2- 172.21.15.132:0/2945568745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8a00047c0 0x7ff8a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8b9449640 1 --2- 172.21.15.132:0/2945568745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8a00052a0 0x7ff8a000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8b9449640 1 -- 172.21.15.132:0/2945568745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b415f060 con 0x7ff8a0003970 2023-12-20T04:42:49.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8b9449640 1 -- 172.21.15.132:0/2945568745 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a000c170 con 0x7ff8a00052a0 2023-12-20T04:42:49.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8b9449640 1 -- 172.21.15.132:0/2945568745 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8a000c330 con 0x7ff8a00047c0 2023-12-20T04:42:49.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8ba44b640 1 --2- 172.21.15.132:0/2945568745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8a0003970 0x7ff8a0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:49.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8bac4c640 1 --2- 172.21.15.132:0/2945568745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8a00052a0 0x7ff8a000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8b9c4a640 1 --2- 172.21.15.132:0/2945568745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8a00047c0 0x7ff8a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8ba44b640 1 -- 172.21.15.132:0/2945568745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8a00047c0 msgr2=0x7ff8a0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8ba44b640 1 --2- 172.21.15.132:0/2945568745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8a00047c0 0x7ff8a0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8ba44b640 1 -- 172.21.15.132:0/2945568745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8a00052a0 msgr2=0x7ff8a000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8ba44b640 1 --2- 172.21.15.132:0/2945568745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8a00052a0 0x7ff8a000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8bac4c640 1 -- 172.21.15.132:0/2945568745 reap_dead start 2023-12-20T04:42:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.603+0000 7ff8ba44b640 1 -- 172.21.15.132:0/2945568745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8a0003520 con 0x7ff8a0003970 2023-12-20T04:42:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.604+0000 7ff8ba44b640 1 --2- 172.21.15.132:0/2945568745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8a0003970 0x7ff8a0003d90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0001e20 tx=0x7ff8a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6a0c84100f3411a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.604+0000 7ff8b9449640 1 -- 172.21.15.132:0/2945568745 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0003b70 con 0x7ff8a0003970 2023-12-20T04:42:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.604+0000 7ff8b9449640 1 -- 172.21.15.132:0/2945568745 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b0003cd0 con 0x7ff8a0003970 2023-12-20T04:42:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.604+0000 7ff8b9449640 1 -- 172.21.15.132:0/2945568745 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b0005310 con 0x7ff8a0003970 2023-12-20T04:42:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.605+0000 7ff8bc6af640 1 -- 172.21.15.132:0/2945568745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8a0003970 msgr2=0x7ff8a0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.605+0000 7ff8bc6af640 1 --2- 172.21.15.132:0/2945568745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8a0003970 0x7ff8a0003d90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7ff8b0001e20 tx=0x7ff8a00057f0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.605+0000 7ff8bc6af640 1 -- 172.21.15.132:0/2945568745 shutdown_connections 2023-12-20T04:42:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.605+0000 7ff8bc6af640 1 --2- 172.21.15.132:0/2945568745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8a0003970 0x7ff8a0003d90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.605+0000 7ff8bc6af640 1 -- 172.21.15.132:0/2945568745 >> 172.21.15.132:0/2945568745 conn(0x7ff8b40cd7b0 msgr2=0x7ff8b40cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.605+0000 7ff8bc6af640 1 -- 172.21.15.132:0/2945568745 shutdown_connections 2023-12-20T04:42:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.605+0000 7ff8bc6af640 1 -- 172.21.15.132:0/2945568745 wait complete. 2023-12-20T04:42:49.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.606+0000 7ff8bc6af640 1 Processor -- start 2023-12-20T04:42:49.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.606+0000 7ff8bc6af640 1 -- start start 2023-12-20T04:42:49.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8bc6af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8a0003970 0x7ff8b4156440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8bc6af640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8b40c4860 0x7ff8b40c5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8bc6af640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8b40c8ea0 0x7ff8b40c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8bc6af640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40c8a80 con 0x7ff8a0003970 2023-12-20T04:42:49.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8bc6af640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40c7e00 con 0x7ff8b40c4860 2023-12-20T04:42:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8bc6af640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8b40c80e0 con 0x7ff8b40c8ea0 2023-12-20T04:42:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8ba44b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8a0003970 0x7ff8b4156440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8ba44b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8a0003970 0x7ff8b4156440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48988/0 (socket says 172.21.15.132:48988) 2023-12-20T04:42:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8ba44b640 1 -- 172.21.15.132:0/2747200317 learned_addr learned my addr 172.21.15.132:0/2747200317 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8ba44b640 1 -- 172.21.15.132:0/2747200317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8b40c8ea0 msgr2=0x7ff8b40c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8ba44b640 1 --2- 172.21.15.132:0/2747200317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8b40c8ea0 0x7ff8b40c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8ba44b640 1 -- 172.21.15.132:0/2747200317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8b40c4860 msgr2=0x7ff8b40c5740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8ba44b640 1 --2- 172.21.15.132:0/2747200317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8b40c4860 0x7ff8b40c5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8ba44b640 1 -- 172.21.15.132:0/2747200317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8b40c83c0 con 0x7ff8a0003970 2023-12-20T04:42:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8ba44b640 1 --2- 172.21.15.132:0/2747200317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8a0003970 0x7ff8b4156440 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff8b002bf50 tx=0x7ff8b00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8aaffd640 1 -- 172.21.15.132:0/2747200317 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b003e070 con 0x7ff8a0003970 2023-12-20T04:42:49.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8aaffd640 1 -- 172.21.15.132:0/2747200317 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8b0003e40 con 0x7ff8a0003970 2023-12-20T04:42:49.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8aaffd640 1 -- 172.21.15.132:0/2747200317 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8b00057e0 con 0x7ff8a0003970 2023-12-20T04:42:49.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8bc6af640 1 -- 172.21.15.132:0/2747200317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8b40c86a0 con 0x7ff8a0003970 2023-12-20T04:42:49.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.607+0000 7ff8bc6af640 1 -- 172.21.15.132:0/2747200317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8b40c6cf0 con 0x7ff8a0003970 2023-12-20T04:42:49.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.608+0000 7ff8bc6af640 1 -- 172.21.15.132:0/2747200317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8b40c8cf0 con 0x7ff8a0003970 2023-12-20T04:42:49.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.609+0000 7ff8aaffd640 1 -- 172.21.15.132:0/2747200317 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff8b0007030 con 0x7ff8a0003970 2023-12-20T04:42:49.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.609+0000 7ff8aaffd640 1 --2- 172.21.15.132:0/2747200317 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff89806a460 0x7ff89806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.609+0000 7ff8aaffd640 1 -- 172.21.15.132:0/2747200317 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff8b00aa430 con 0x7ff8a0003970 2023-12-20T04:42:49.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.609+0000 7ff8b9c4a640 1 --2- 172.21.15.132:0/2747200317 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff89806a460 0x7ff89806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:49.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.609+0000 7ff8b9c4a640 1 --2- 172.21.15.132:0/2747200317 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff89806a460 0x7ff89806c920 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff8b415e6e0 tx=0x7ff8a4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:49.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.613+0000 7ff8aaffd640 1 -- 172.21.15.132:0/2747200317 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff8b0075ab0 con 0x7ff8a0003970 2023-12-20T04:42:49.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.778+0000 7ff8bc6af640 1 -- 172.21.15.132:0/2747200317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff8b40c8220 con 0x7ff8a0003970 2023-12-20T04:42:49.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.779+0000 7ff8aaffd640 1 -- 172.21.15.132:0/2747200317 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7ff8b40c8220 con 0x7ff8a0003970 2023-12-20T04:42:49.781 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:49.781 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:42:49.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.781+0000 7ff8bc6af640 1 -- 172.21.15.132:0/2747200317 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff89806a460 msgr2=0x7ff89806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.781+0000 7ff8bc6af640 1 --2- 172.21.15.132:0/2747200317 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff89806a460 0x7ff89806c920 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7ff8b415e6e0 tx=0x7ff8a4008040 comp rx=0 tx=0).stop 2023-12-20T04:42:49.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.781+0000 7ff8bc6af640 1 -- 172.21.15.132:0/2747200317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8a0003970 msgr2=0x7ff8b4156440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.781+0000 7ff8bc6af640 1 --2- 172.21.15.132:0/2747200317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8a0003970 0x7ff8b4156440 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7ff8b002bf50 tx=0x7ff8b00014a0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.781+0000 7ff8bc6af640 1 -- 172.21.15.132:0/2747200317 shutdown_connections 2023-12-20T04:42:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.781+0000 7ff8bc6af640 1 --2- 172.21.15.132:0/2747200317 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff89806a460 0x7ff89806c920 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.781+0000 7ff8bc6af640 1 --2- 172.21.15.132:0/2747200317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8b40c8ea0 0x7ff8b40c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.781+0000 7ff8bc6af640 1 --2- 172.21.15.132:0/2747200317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8b40c4860 0x7ff8b40c5740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.781+0000 7ff8bc6af640 1 --2- 172.21.15.132:0/2747200317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8a0003970 0x7ff8b4156440 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.781+0000 7ff8bc6af640 1 -- 172.21.15.132:0/2747200317 >> 172.21.15.132:0/2747200317 conn(0x7ff8b40cd7b0 msgr2=0x7ff8b40b1850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.781+0000 7ff8bc6af640 1 -- 172.21.15.132:0/2747200317 shutdown_connections 2023-12-20T04:42:49.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.781+0000 7ff8bc6af640 1 -- 172.21.15.132:0/2747200317 wait complete. 2023-12-20T04:42:49.794 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-20T04:42:49.794 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:42:49.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.892+0000 7f09bed3e640 1 Processor -- start 2023-12-20T04:42:49.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.892+0000 7f09bed3e640 1 -- start start 2023-12-20T04:42:49.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.893+0000 7f09bed3e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f09b8160450 0x7f09b8160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.893+0000 7f09bed3e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09b80b5090 0x7f09b80d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.893+0000 7f09bed3e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09b80b5ec0 con 0x7f09b81611b0 2023-12-20T04:42:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.893+0000 7f09bed3e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09b81617e0 con 0x7f09b8160450 2023-12-20T04:42:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.893+0000 7f09bed3e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b80d0fc0 con 0x7f09b80b5090 2023-12-20T04:42:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.893+0000 7f09bcada640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f09b8160450 0x7f09b8160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.893+0000 7f09bcada640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f09b8160450 0x7f09b8160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48996/0 (socket says 172.21.15.132:48996) 2023-12-20T04:42:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.893+0000 7f09bcada640 1 -- 172.21.15.132:0/2696451445 learned_addr learned my addr 172.21.15.132:0/2696451445 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.893+0000 7f09bd2db640 1 --2- 172.21.15.132:0/2696451445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09b80b5090 0x7f09b80d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.893+0000 7f09bcada640 1 -- 172.21.15.132:0/2696451445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09b80b5090 msgr2=0x7f09b80d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.893+0000 7f09bcada640 1 --2- 172.21.15.132:0/2696451445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09b80b5090 0x7f09b80d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.893+0000 7f09bcada640 1 -- 172.21.15.132:0/2696451445 >> v1:172.21.15.187:6789/0 conn(0x7f09b81611b0 legacy=0x7f09b80b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:49.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.893+0000 7f09bcada640 1 -- 172.21.15.132:0/2696451445 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09b80d12a0 con 0x7f09b8160450 2023-12-20T04:42:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.894+0000 7f09bcada640 1 --2- 172.21.15.132:0/2696451445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09b8160450 0x7f09b8160c70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009870 tx=0x7f09ac02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c182f04ef0d4f92c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.894+0000 7f09b77fe640 1 -- 172.21.15.132:0/2696451445 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac030840 con 0x7f09b8160450 2023-12-20T04:42:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.894+0000 7f09b77fe640 1 -- 172.21.15.132:0/2696451445 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09ac0309a0 con 0x7f09b8160450 2023-12-20T04:42:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.894+0000 7f09b77fe640 1 -- 172.21.15.132:0/2696451445 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09ac030d30 con 0x7f09b8160450 2023-12-20T04:42:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.894+0000 7f09bed3e640 1 -- 172.21.15.132:0/2696451445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09b8160450 msgr2=0x7f09b8160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.894+0000 7f09bed3e640 1 --2- 172.21.15.132:0/2696451445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09b8160450 0x7f09b8160c70 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f09ac009870 tx=0x7f09ac02b980 comp rx=0 tx=0).stop 2023-12-20T04:42:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.894+0000 7f09bed3e640 1 -- 172.21.15.132:0/2696451445 shutdown_connections 2023-12-20T04:42:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.894+0000 7f09bed3e640 1 --2- 172.21.15.132:0/2696451445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09b80b5090 0x7f09b80d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.894+0000 7f09bed3e640 1 --2- 172.21.15.132:0/2696451445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09b8160450 0x7f09b8160c70 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.894+0000 7f09bed3e640 1 -- 172.21.15.132:0/2696451445 >> 172.21.15.132:0/2696451445 conn(0x7f09b80cf980 msgr2=0x7f09b80cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.894+0000 7f09bed3e640 1 -- 172.21.15.132:0/2696451445 shutdown_connections 2023-12-20T04:42:49.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.895+0000 7f09bed3e640 1 -- 172.21.15.132:0/2696451445 wait complete. 2023-12-20T04:42:49.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.896+0000 7f09bed3e640 1 Processor -- start 2023-12-20T04:42:49.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.896+0000 7f09bed3e640 1 -- start start 2023-12-20T04:42:49.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.896+0000 7f09bed3e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09b80b5090 0x7f09b815f8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.896+0000 7f09bed3e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09b8160450 0x7f09b815e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.896+0000 7f09bed3e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09b81611b0 0x7f09b815eee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.896+0000 7f09bed3e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b814adf0 con 0x7f09b8160450 2023-12-20T04:42:49.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.896+0000 7f09bed3e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09b8156f40 con 0x7f09b80b5090 2023-12-20T04:42:49.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.896+0000 7f09bed3e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09b8157190 con 0x7f09b81611b0 2023-12-20T04:42:49.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.897+0000 7f09b7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09b8160450 0x7f09b815e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:49.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.897+0000 7f09b7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09b8160450 0x7f09b815e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49000/0 (socket says 172.21.15.132:49000) 2023-12-20T04:42:49.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.897+0000 7f09b7fff640 1 -- 172.21.15.132:0/1224924775 learned_addr learned my addr 172.21.15.132:0/1224924775 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:49.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.897+0000 7f09bd2db640 1 --2- 172.21.15.132:0/1224924775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09b81611b0 0x7f09b815eee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:49.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.897+0000 7f09bcada640 1 --2- 172.21.15.132:0/1224924775 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09b80b5090 0x7f09b815f8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:49.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.897+0000 7f09b7fff640 1 -- 172.21.15.132:0/1224924775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09b81611b0 msgr2=0x7f09b815eee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.897+0000 7f09b7fff640 1 --2- 172.21.15.132:0/1224924775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09b81611b0 0x7f09b815eee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.897+0000 7f09b7fff640 1 -- 172.21.15.132:0/1224924775 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09b80b5090 msgr2=0x7f09b815f8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:49.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.897+0000 7f09b7fff640 1 --2- 172.21.15.132:0/1224924775 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09b80b5090 0x7f09b815f8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:49.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.897+0000 7f09b7fff640 1 -- 172.21.15.132:0/1224924775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09ac0094d0 con 0x7f09b8160450 2023-12-20T04:42:49.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.897+0000 7f09bcada640 1 --2- 172.21.15.132:0/1224924775 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09b80b5090 0x7f09b815f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:49.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.897+0000 7f09b7fff640 1 --2- 172.21.15.132:0/1224924775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09b8160450 0x7f09b815e9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f09a400b3f0 tx=0x7f09a400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:49.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.897+0000 7f09b57fa640 1 -- 172.21.15.132:0/1224924775 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a4011830 con 0x7f09b8160450 2023-12-20T04:42:49.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.897+0000 7f09b57fa640 1 -- 172.21.15.132:0/1224924775 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09a4011990 con 0x7f09b8160450 2023-12-20T04:42:49.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.897+0000 7f09bed3e640 1 -- 172.21.15.132:0/1224924775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09b8157470 con 0x7f09b8160450 2023-12-20T04:42:49.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.897+0000 7f09b57fa640 1 -- 172.21.15.132:0/1224924775 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09a4011d40 con 0x7f09b8160450 2023-12-20T04:42:49.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.897+0000 7f09bed3e640 1 -- 172.21.15.132:0/1224924775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f09b8157a30 con 0x7f09b8160450 2023-12-20T04:42:49.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.898+0000 7f09bed3e640 1 -- 172.21.15.132:0/1224924775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f09b804e840 con 0x7f09b8160450 2023-12-20T04:42:49.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.899+0000 7f09b57fa640 1 -- 172.21.15.132:0/1224924775 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f09a401a400 con 0x7f09b8160450 2023-12-20T04:42:49.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.899+0000 7f09b57fa640 1 --2- 172.21.15.132:0/1224924775 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f099c06a430 0x7f099c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:49.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.899+0000 7f09b57fa640 1 -- 172.21.15.132:0/1224924775 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09a4088740 con 0x7f09b8160450 2023-12-20T04:42:49.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.899+0000 7f09bcada640 1 --2- 172.21.15.132:0/1224924775 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f099c06a430 0x7f099c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:49.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.900+0000 7f09bcada640 1 --2- 172.21.15.132:0/1224924775 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f099c06a430 0x7f099c06c8f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f09ac036000 tx=0x7f09ac03b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:49.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:49.903+0000 7f09b57fa640 1 -- 172.21.15.132:0/1224924775 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f09a4053d30 con 0x7f09b8160450 2023-12-20T04:42:50.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.065+0000 7f09bed3e640 1 -- 172.21.15.132:0/1224924775 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f09b80b89d0 con 0x7f099c06a430 2023-12-20T04:42:50.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.071+0000 7f09b57fa640 1 -- 172.21.15.132:0/1224924775 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251313 (secure 0 0 0) 0x7f09ac030c10 con 0x7f099c06a430 2023-12-20T04:42:50.076 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:50.078 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:42:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.074+0000 7f09bed3e640 1 -- 172.21.15.132:0/1224924775 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f099c06a430 msgr2=0x7f099c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.074+0000 7f09bed3e640 1 --2- 172.21.15.132:0/1224924775 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f099c06a430 0x7f099c06c8f0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f09ac036000 tx=0x7f09ac03b040 comp rx=0 tx=0).stop 2023-12-20T04:42:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.074+0000 7f09bed3e640 1 -- 172.21.15.132:0/1224924775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09b8160450 msgr2=0x7f09b815e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.074+0000 7f09bed3e640 1 --2- 172.21.15.132:0/1224924775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09b8160450 0x7f09b815e9a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f09a400b3f0 tx=0x7f09a400b8b0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.074+0000 7f09bed3e640 1 -- 172.21.15.132:0/1224924775 shutdown_connections 2023-12-20T04:42:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.074+0000 7f09bed3e640 1 --2- 172.21.15.132:0/1224924775 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f099c06a430 0x7f099c06c8f0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.074+0000 7f09bed3e640 1 --2- 172.21.15.132:0/1224924775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09b81611b0 0x7f09b815eee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.074+0000 7f09bed3e640 1 --2- 172.21.15.132:0/1224924775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09b8160450 0x7f09b815e9a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.074+0000 7f09bed3e640 1 --2- 172.21.15.132:0/1224924775 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09b80b5090 0x7f09b815f8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.074+0000 7f09bed3e640 1 -- 172.21.15.132:0/1224924775 >> 172.21.15.132:0/1224924775 conn(0x7f09b80cf980 msgr2=0x7f09b80d3430 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.074+0000 7f09bed3e640 1 -- 172.21.15.132:0/1224924775 shutdown_connections 2023-12-20T04:42:50.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.074+0000 7f09bed3e640 1 -- 172.21.15.132:0/1224924775 wait complete. 2023-12-20T04:42:50.086 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":18,"stamp":"2023-12-20T04:42:48.169265+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1520,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560979,"statfs":{"total":1600000000,"available":1598443062,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.077021"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811868+0000","last_change":"2023-12-20T04:42:45.811868+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811868+0000","last_undegraded":"2023-12-20T04:42:45.811868+0000","last_fullsized":"2023-12-20T04:42:45.811868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:31:43.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810682+0000","last_change":"2023-12-20T04:42:45.810682+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810682+0000","last_undegraded":"2023-12-20T04:42:45.810682+0000","last_fullsized":"2023-12-20T04:42:45.810682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811827+0000","last_change":"2023-12-20T04:42:45.811827+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811827+0000","last_undegraded":"2023-12-20T04:42:45.811827+0000","last_fullsized":"2023-12-20T04:42:45.811827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:16.851777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811795+0000","last_change":"2023-12-20T04:42:45.811795+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811795+0000","last_undegraded":"2023-12-20T04:42:45.811795+0000","last_fullsized":"2023-12-20T04:42:45.811795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810766+0000","last_change":"2023-12-20T04:42:45.810766+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810766+0000","last_undegraded":"2023-12-20T04:42:45.810766+0000","last_fullsized":"2023-12-20T04:42:45.810766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811538+0000","last_change":"2023-12-20T04:42:45.811538+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811538+0000","last_undegraded":"2023-12-20T04:42:45.811538+0000","last_fullsized":"2023-12-20T04:42:45.811538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811459+0000","last_change":"2023-12-20T04:42:45.811459+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811459+0000","last_undegraded":"2023-12-20T04:42:45.811459+0000","last_fullsized":"2023-12-20T04:42:45.811459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810714+0000","last_change":"2023-12-20T04:42:45.810714+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810714+0000","last_undegraded":"2023-12-20T04:42:45.810714+0000","last_fullsized":"2023-12-20T04:42:45.810714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.807707+0000","last_change":"2023-12-20T04:42:45.807707+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.807707+0000","last_undegraded":"2023-12-20T04:42:45.807707+0000","last_fullsized":"2023-12-20T04:42:45.807707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:45:29.219298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811532+0000","last_change":"2023-12-20T04:42:45.811532+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811532+0000","last_undegraded":"2023-12-20T04:42:45.811532+0000","last_fullsized":"2023-12-20T04:42:45.811532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811351+0000","last_change":"2023-12-20T04:42:45.811351+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811351+0000","last_undegraded":"2023-12-20T04:42:45.811351+0000","last_fullsized":"2023-12-20T04:42:45.811351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812664+0000","last_change":"2023-12-20T04:42:45.812664+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812664+0000","last_undegraded":"2023-12-20T04:42:45.812664+0000","last_fullsized":"2023-12-20T04:42:45.812664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.808656+0000","last_change":"2023-12-20T04:42:45.808656+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.808656+0000","last_undegraded":"2023-12-20T04:42:45.808656+0000","last_fullsized":"2023-12-20T04:42:45.808656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:46:37.703321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812327+0000","last_change":"2023-12-20T04:42:45.812327+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812327+0000","last_undegraded":"2023-12-20T04:42:45.812327+0000","last_fullsized":"2023-12-20T04:42:45.812327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811507+0000","last_change":"2023-12-20T04:42:45.811507+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811507+0000","last_undegraded":"2023-12-20T04:42:45.811507+0000","last_fullsized":"2023-12-20T04:42:45.811507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812419+0000","last_change":"2023-12-20T04:42:45.812419+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812419+0000","last_undegraded":"2023-12-20T04:42:45.812419+0000","last_fullsized":"2023-12-20T04:42:45.812419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-20T04:42:41.100496+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:42:41.100496+0000","last_peered":"2023-12-20T04:42:41.100496+0000","last_clean":"2023-12-20T04:42:41.100496+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:42:41.100496+0000","last_undegraded":"2023-12-20T04:42:41.100496+0000","last_fullsized":"2023-12-20T04:42:41.100496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811102+0000","last_change":"2023-12-20T04:42:45.811102+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811102+0000","last_undegraded":"2023-12-20T04:42:45.811102+0000","last_fullsized":"2023-12-20T04:42:45.811102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.807944+0000","last_change":"2023-12-20T04:42:45.807944+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.807944+0000","last_undegraded":"2023-12-20T04:42:45.807944+0000","last_fullsized":"2023-12-20T04:42:45.807944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812305+0000","last_change":"2023-12-20T04:42:45.812305+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812305+0000","last_undegraded":"2023-12-20T04:42:45.812305+0000","last_fullsized":"2023-12-20T04:42:45.812305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:16.851777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811113+0000","last_change":"2023-12-20T04:42:45.811113+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811113+0000","last_undegraded":"2023-12-20T04:42:45.811113+0000","last_fullsized":"2023-12-20T04:42:45.811113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810952+0000","last_change":"2023-12-20T04:42:45.810952+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810952+0000","last_undegraded":"2023-12-20T04:42:45.810952+0000","last_fullsized":"2023-12-20T04:42:45.810952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.808525+0000","last_change":"2023-12-20T04:42:45.808525+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.808525+0000","last_undegraded":"2023-12-20T04:42:45.808525+0000","last_fullsized":"2023-12-20T04:42:45.808525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810950+0000","last_change":"2023-12-20T04:42:45.810950+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810950+0000","last_undegraded":"2023-12-20T04:42:45.810950+0000","last_fullsized":"2023-12-20T04:42:45.810950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810713+0000","last_change":"2023-12-20T04:42:45.810713+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810713+0000","last_undegraded":"2023-12-20T04:42:45.810713+0000","last_fullsized":"2023-12-20T04:42:45.810713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.808540+0000","last_change":"2023-12-20T04:42:45.808540+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.808540+0000","last_undegraded":"2023-12-20T04:42:45.808540+0000","last_fullsized":"2023-12-20T04:42:45.808540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811336+0000","last_change":"2023-12-20T04:42:45.811336+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811336+0000","last_undegraded":"2023-12-20T04:42:45.811336+0000","last_fullsized":"2023-12-20T04:42:45.811336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811602+0000","last_change":"2023-12-20T04:42:45.811602+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811602+0000","last_undegraded":"2023-12-20T04:42:45.811602+0000","last_fullsized":"2023-12-20T04:42:45.811602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.809002+0000","last_change":"2023-12-20T04:42:45.809002+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.809002+0000","last_undegraded":"2023-12-20T04:42:45.809002+0000","last_fullsized":"2023-12-20T04:42:45.809002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.809065+0000","last_change":"2023-12-20T04:42:45.809065+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.809065+0000","last_undegraded":"2023-12-20T04:42:45.809065+0000","last_fullsized":"2023-12-20T04:42:45.809065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:50.327147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.809676+0000","last_change":"2023-12-20T04:42:45.809676+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.809676+0000","last_undegraded":"2023-12-20T04:42:45.809676+0000","last_fullsized":"2023-12-20T04:42:45.809676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:57:22.907798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812183+0000","last_change":"2023-12-20T04:42:45.812183+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812183+0000","last_undegraded":"2023-12-20T04:42:45.812183+0000","last_fullsized":"2023-12-20T04:42:45.812183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.807707+0000","last_change":"2023-12-20T04:42:45.807707+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.807707+0000","last_undegraded":"2023-12-20T04:42:45.807707+0000","last_fullsized":"2023-12-20T04:42:45.807707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:46:37.703321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":621,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194691,"statfs":{"total":200000000,"available":199364061,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]}],"pool_statfs":[]}} 2023-12-20T04:42:50.092 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:42:50.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.225+0000 7f06e5588640 1 Processor -- start 2023-12-20T04:42:50.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.225+0000 7f06e5588640 1 -- start start 2023-12-20T04:42:50.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.226+0000 7f06e5588640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06e00b4980 0x7f06e00b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.226+0000 7f06e5588640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f06e00d1aa0 0x7f06e00d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.226+0000 7f06e5588640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06e00b5320 con 0x7f06e0160450 2023-12-20T04:42:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.226+0000 7f06e5588640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06e00b5ec0 con 0x7f06e00d1aa0 2023-12-20T04:42:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.226+0000 7f06e5588640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e01617e0 con 0x7f06e00b4980 2023-12-20T04:42:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.226+0000 7f06df7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f06e00d1aa0 0x7f06e00d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.226+0000 7f06df7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f06e00d1aa0 0x7f06e00d1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49002/0 (socket says 172.21.15.132:49002) 2023-12-20T04:42:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.226+0000 7f06df7fe640 1 -- 172.21.15.132:0/1853982241 learned_addr learned my addr 172.21.15.132:0/1853982241 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.226+0000 7f06d7fff640 1 --2- 172.21.15.132:0/1853982241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06e00b4980 0x7f06e00b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.226+0000 7f06df7fe640 1 -- 172.21.15.132:0/1853982241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06e00b4980 msgr2=0x7f06e00b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:50.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.226+0000 7f06df7fe640 1 --2- 172.21.15.132:0/1853982241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06e00b4980 0x7f06e00b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.226+0000 7f06df7fe640 1 -- 172.21.15.132:0/1853982241 >> v1:172.21.15.187:6789/0 conn(0x7f06e0160450 legacy=0x7f06e0160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:50.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.226+0000 7f06df7fe640 1 -- 172.21.15.132:0/1853982241 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e00d0fc0 con 0x7f06e00d1aa0 2023-12-20T04:42:50.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.227+0000 7f06df7fe640 1 --2- 172.21.15.132:0/1853982241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06e00d1aa0 0x7f06e00d1f30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009e50 tx=0x7f06d802bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5c90235683fd237 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:50.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.227+0000 7f06de7fc640 1 -- 172.21.15.132:0/1853982241 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d802cb90 con 0x7f06e00d1aa0 2023-12-20T04:42:50.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.227+0000 7f06de7fc640 1 -- 172.21.15.132:0/1853982241 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d802ccf0 con 0x7f06e00d1aa0 2023-12-20T04:42:50.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.227+0000 7f06de7fc640 1 -- 172.21.15.132:0/1853982241 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d8034610 con 0x7f06e00d1aa0 2023-12-20T04:42:50.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.228+0000 7f06e5588640 1 -- 172.21.15.132:0/1853982241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06e00d1aa0 msgr2=0x7f06e00d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:50.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.228+0000 7f06e5588640 1 --2- 172.21.15.132:0/1853982241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06e00d1aa0 0x7f06e00d1f30 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f06d8009e50 tx=0x7f06d802bff0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.228+0000 7f06e5588640 1 -- 172.21.15.132:0/1853982241 shutdown_connections 2023-12-20T04:42:50.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.228+0000 7f06e5588640 1 --2- 172.21.15.132:0/1853982241 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06e00d1aa0 0x7f06e00d1f30 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.228+0000 7f06e5588640 1 --2- 172.21.15.132:0/1853982241 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06e00b4980 0x7f06e00b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.228+0000 7f06e5588640 1 -- 172.21.15.132:0/1853982241 >> 172.21.15.132:0/1853982241 conn(0x7f06e00cf980 msgr2=0x7f06e00cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:50.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.228+0000 7f06e5588640 1 -- 172.21.15.132:0/1853982241 shutdown_connections 2023-12-20T04:42:50.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.228+0000 7f06e5588640 1 -- 172.21.15.132:0/1853982241 wait complete. 2023-12-20T04:42:50.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.229+0000 7f06e5588640 1 Processor -- start 2023-12-20T04:42:50.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.229+0000 7f06e5588640 1 -- start start 2023-12-20T04:42:50.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06e5588640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06e00b4980 0x7f06e0145fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06e5588640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06e00d1aa0 0x7f06e00cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06e5588640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06e0160450 0x7f06e00c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06e5588640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e0146610 con 0x7f06e00d1aa0 2023-12-20T04:42:50.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06e5588640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06e01468f0 con 0x7f06e0160450 2023-12-20T04:42:50.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06e5588640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06e0146bd0 con 0x7f06e00b4980 2023-12-20T04:42:50.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06d7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06e00d1aa0 0x7f06e00cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:50.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06d7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06e00d1aa0 0x7f06e00cc9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49006/0 (socket says 172.21.15.132:49006) 2023-12-20T04:42:50.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06d7fff640 1 -- 172.21.15.132:0/570022670 learned_addr learned my addr 172.21.15.132:0/570022670 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:50.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06deffd640 1 --2- 172.21.15.132:0/570022670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06e00b4980 0x7f06e0145fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:50.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06df7fe640 1 --2- 172.21.15.132:0/570022670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06e0160450 0x7f06e00c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:50.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06d7fff640 1 -- 172.21.15.132:0/570022670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06e00b4980 msgr2=0x7f06e0145fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:50.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06d7fff640 1 --2- 172.21.15.132:0/570022670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06e00b4980 0x7f06e0145fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06d7fff640 1 -- 172.21.15.132:0/570022670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06e0160450 msgr2=0x7f06e00c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:50.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06d7fff640 1 --2- 172.21.15.132:0/570022670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06e0160450 0x7f06e00c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06d7fff640 1 -- 172.21.15.132:0/570022670 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d8009b30 con 0x7f06e00d1aa0 2023-12-20T04:42:50.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06df7fe640 1 --2- 172.21.15.132:0/570022670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06e0160450 0x7f06e00c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:50.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06d7fff640 1 --2- 172.21.15.132:0/570022670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06e00d1aa0 0x7f06e00cc9b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f06c800e9b0 tx=0x7f06c800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:50.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06d77fe640 1 -- 172.21.15.132:0/570022670 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c8009670 con 0x7f06e00d1aa0 2023-12-20T04:42:50.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06d77fe640 1 -- 172.21.15.132:0/570022670 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06c800c9a0 con 0x7f06e00d1aa0 2023-12-20T04:42:50.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06e5588640 1 -- 172.21.15.132:0/570022670 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06e0146eb0 con 0x7f06e00d1aa0 2023-12-20T04:42:50.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06d77fe640 1 -- 172.21.15.132:0/570022670 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06c800cd50 con 0x7f06e00d1aa0 2023-12-20T04:42:50.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.230+0000 7f06e5588640 1 -- 172.21.15.132:0/570022670 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06e00c8ce0 con 0x7f06e00d1aa0 2023-12-20T04:42:50.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.231+0000 7f06e5588640 1 -- 172.21.15.132:0/570022670 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06e00ca2f0 con 0x7f06e00d1aa0 2023-12-20T04:42:50.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.232+0000 7f06d77fe640 1 -- 172.21.15.132:0/570022670 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f06c8013470 con 0x7f06e00d1aa0 2023-12-20T04:42:50.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.232+0000 7f06d77fe640 1 --2- 172.21.15.132:0/570022670 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06c006a430 0x7f06c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.232+0000 7f06d77fe640 1 -- 172.21.15.132:0/570022670 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06c8088b30 con 0x7f06e00d1aa0 2023-12-20T04:42:50.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.232+0000 7f06deffd640 1 --2- 172.21.15.132:0/570022670 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06c006a430 0x7f06c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:50.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.233+0000 7f06deffd640 1 --2- 172.21.15.132:0/570022670 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06c006a430 0x7f06c006c8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f06d0000f60 tx=0x7f06d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:50.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.236+0000 7f06d77fe640 1 -- 172.21.15.132:0/570022670 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f06c80541d0 con 0x7f06e00d1aa0 2023-12-20T04:42:50.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.400+0000 7f06e5588640 1 -- 172.21.15.132:0/570022670 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f06e00d1580 con 0x7f06c006a430 2023-12-20T04:42:50.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.406+0000 7f06d77fe640 1 -- 172.21.15.132:0/570022670 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251313 (secure 0 0 0) 0x7f06d0001d10 con 0x7f06c006a430 2023-12-20T04:42:50.411 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:50.413 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:42:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.409+0000 7f06e5588640 1 -- 172.21.15.132:0/570022670 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06c006a430 msgr2=0x7f06c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:50.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.409+0000 7f06e5588640 1 --2- 172.21.15.132:0/570022670 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06c006a430 0x7f06c006c8f0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f06d0000f60 tx=0x7f06d0009040 comp rx=0 tx=0).stop 2023-12-20T04:42:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.409+0000 7f06e5588640 1 -- 172.21.15.132:0/570022670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06e00d1aa0 msgr2=0x7f06e00cc9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.409+0000 7f06e5588640 1 --2- 172.21.15.132:0/570022670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06e00d1aa0 0x7f06e00cc9b0 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f06c800e9b0 tx=0x7f06c800ee70 comp rx=0 tx=0).stop 2023-12-20T04:42:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.409+0000 7f06e5588640 1 -- 172.21.15.132:0/570022670 shutdown_connections 2023-12-20T04:42:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.409+0000 7f06e5588640 1 --2- 172.21.15.132:0/570022670 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06c006a430 0x7f06c006c8f0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.409+0000 7f06e5588640 1 --2- 172.21.15.132:0/570022670 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06e0160450 0x7f06e00c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.409+0000 7f06e5588640 1 --2- 172.21.15.132:0/570022670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06e00d1aa0 0x7f06e00cc9b0 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.409+0000 7f06e5588640 1 --2- 172.21.15.132:0/570022670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06e00b4980 0x7f06e0145fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.409+0000 7f06e5588640 1 -- 172.21.15.132:0/570022670 >> 172.21.15.132:0/570022670 conn(0x7f06e00cf980 msgr2=0x7f06e00b6840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.409+0000 7f06e5588640 1 -- 172.21.15.132:0/570022670 shutdown_connections 2023-12-20T04:42:50.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.409+0000 7f06e5588640 1 -- 172.21.15.132:0/570022670 wait complete. 2023-12-20T04:42:50.422 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-12-20T04:42:50.093250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1520,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560979,"statfs":{"total":1600000000,"available":1598443062,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.284258"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811868+0000","last_change":"2023-12-20T04:42:45.811868+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811868+0000","last_undegraded":"2023-12-20T04:42:45.811868+0000","last_fullsized":"2023-12-20T04:42:45.811868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:31:43.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810682+0000","last_change":"2023-12-20T04:42:45.810682+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810682+0000","last_undegraded":"2023-12-20T04:42:45.810682+0000","last_fullsized":"2023-12-20T04:42:45.810682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811827+0000","last_change":"2023-12-20T04:42:45.811827+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811827+0000","last_undegraded":"2023-12-20T04:42:45.811827+0000","last_fullsized":"2023-12-20T04:42:45.811827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:16.851777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811795+0000","last_change":"2023-12-20T04:42:45.811795+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811795+0000","last_undegraded":"2023-12-20T04:42:45.811795+0000","last_fullsized":"2023-12-20T04:42:45.811795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810766+0000","last_change":"2023-12-20T04:42:45.810766+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810766+0000","last_undegraded":"2023-12-20T04:42:45.810766+0000","last_fullsized":"2023-12-20T04:42:45.810766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811538+0000","last_change":"2023-12-20T04:42:45.811538+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811538+0000","last_undegraded":"2023-12-20T04:42:45.811538+0000","last_fullsized":"2023-12-20T04:42:45.811538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811459+0000","last_change":"2023-12-20T04:42:45.811459+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811459+0000","last_undegraded":"2023-12-20T04:42:45.811459+0000","last_fullsized":"2023-12-20T04:42:45.811459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810714+0000","last_change":"2023-12-20T04:42:45.810714+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810714+0000","last_undegraded":"2023-12-20T04:42:45.810714+0000","last_fullsized":"2023-12-20T04:42:45.810714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.807707+0000","last_change":"2023-12-20T04:42:45.807707+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.807707+0000","last_undegraded":"2023-12-20T04:42:45.807707+0000","last_fullsized":"2023-12-20T04:42:45.807707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:45:29.219298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811532+0000","last_change":"2023-12-20T04:42:45.811532+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811532+0000","last_undegraded":"2023-12-20T04:42:45.811532+0000","last_fullsized":"2023-12-20T04:42:45.811532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811351+0000","last_change":"2023-12-20T04:42:45.811351+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811351+0000","last_undegraded":"2023-12-20T04:42:45.811351+0000","last_fullsized":"2023-12-20T04:42:45.811351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812664+0000","last_change":"2023-12-20T04:42:45.812664+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812664+0000","last_undegraded":"2023-12-20T04:42:45.812664+0000","last_fullsized":"2023-12-20T04:42:45.812664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.808656+0000","last_change":"2023-12-20T04:42:45.808656+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.808656+0000","last_undegraded":"2023-12-20T04:42:45.808656+0000","last_fullsized":"2023-12-20T04:42:45.808656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:46:37.703321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812327+0000","last_change":"2023-12-20T04:42:45.812327+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812327+0000","last_undegraded":"2023-12-20T04:42:45.812327+0000","last_fullsized":"2023-12-20T04:42:45.812327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811507+0000","last_change":"2023-12-20T04:42:45.811507+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811507+0000","last_undegraded":"2023-12-20T04:42:45.811507+0000","last_fullsized":"2023-12-20T04:42:45.811507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812419+0000","last_change":"2023-12-20T04:42:45.812419+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812419+0000","last_undegraded":"2023-12-20T04:42:45.812419+0000","last_fullsized":"2023-12-20T04:42:45.812419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-20T04:42:41.100496+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:42:41.100496+0000","last_peered":"2023-12-20T04:42:41.100496+0000","last_clean":"2023-12-20T04:42:41.100496+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:42:41.100496+0000","last_undegraded":"2023-12-20T04:42:41.100496+0000","last_fullsized":"2023-12-20T04:42:41.100496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811102+0000","last_change":"2023-12-20T04:42:45.811102+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811102+0000","last_undegraded":"2023-12-20T04:42:45.811102+0000","last_fullsized":"2023-12-20T04:42:45.811102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.807944+0000","last_change":"2023-12-20T04:42:45.807944+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.807944+0000","last_undegraded":"2023-12-20T04:42:45.807944+0000","last_fullsized":"2023-12-20T04:42:45.807944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812305+0000","last_change":"2023-12-20T04:42:45.812305+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812305+0000","last_undegraded":"2023-12-20T04:42:45.812305+0000","last_fullsized":"2023-12-20T04:42:45.812305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:16.851777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811113+0000","last_change":"2023-12-20T04:42:45.811113+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811113+0000","last_undegraded":"2023-12-20T04:42:45.811113+0000","last_fullsized":"2023-12-20T04:42:45.811113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810952+0000","last_change":"2023-12-20T04:42:45.810952+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810952+0000","last_undegraded":"2023-12-20T04:42:45.810952+0000","last_fullsized":"2023-12-20T04:42:45.810952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.808525+0000","last_change":"2023-12-20T04:42:45.808525+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.808525+0000","last_undegraded":"2023-12-20T04:42:45.808525+0000","last_fullsized":"2023-12-20T04:42:45.808525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810950+0000","last_change":"2023-12-20T04:42:45.810950+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810950+0000","last_undegraded":"2023-12-20T04:42:45.810950+0000","last_fullsized":"2023-12-20T04:42:45.810950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810713+0000","last_change":"2023-12-20T04:42:45.810713+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810713+0000","last_undegraded":"2023-12-20T04:42:45.810713+0000","last_fullsized":"2023-12-20T04:42:45.810713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.808540+0000","last_change":"2023-12-20T04:42:45.808540+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.808540+0000","last_undegraded":"2023-12-20T04:42:45.808540+0000","last_fullsized":"2023-12-20T04:42:45.808540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811336+0000","last_change":"2023-12-20T04:42:45.811336+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811336+0000","last_undegraded":"2023-12-20T04:42:45.811336+0000","last_fullsized":"2023-12-20T04:42:45.811336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811602+0000","last_change":"2023-12-20T04:42:45.811602+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811602+0000","last_undegraded":"2023-12-20T04:42:45.811602+0000","last_fullsized":"2023-12-20T04:42:45.811602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.809002+0000","last_change":"2023-12-20T04:42:45.809002+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.809002+0000","last_undegraded":"2023-12-20T04:42:45.809002+0000","last_fullsized":"2023-12-20T04:42:45.809002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.809065+0000","last_change":"2023-12-20T04:42:45.809065+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.809065+0000","last_undegraded":"2023-12-20T04:42:45.809065+0000","last_fullsized":"2023-12-20T04:42:45.809065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:50.327147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.809676+0000","last_change":"2023-12-20T04:42:45.809676+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.809676+0000","last_undegraded":"2023-12-20T04:42:45.809676+0000","last_fullsized":"2023-12-20T04:42:45.809676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:57:22.907798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812183+0000","last_change":"2023-12-20T04:42:45.812183+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812183+0000","last_undegraded":"2023-12-20T04:42:45.812183+0000","last_fullsized":"2023-12-20T04:42:45.812183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.807707+0000","last_change":"2023-12-20T04:42:45.807707+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.807707+0000","last_undegraded":"2023-12-20T04:42:45.807707+0000","last_fullsized":"2023-12-20T04:42:45.807707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:46:37.703321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":621,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194691,"statfs":{"total":200000000,"available":199364061,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]}],"pool_statfs":[]}} 2023-12-20T04:42:50.429 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:42:50.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.561+0000 7eff120ab640 1 Processor -- start 2023-12-20T04:42:50.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.561+0000 7eff120ab640 1 -- start start 2023-12-20T04:42:50.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.561+0000 7eff120ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7eff0c0b4980 0x7eff0c0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.561+0000 7eff120ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff0c0d1aa0 0x7eff0c0d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.561+0000 7eff120ab640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7eff0c0b5320 con 0x7eff0c160450 2023-12-20T04:42:50.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.561+0000 7eff120ab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7eff0c0b5ec0 con 0x7eff0c0b4980 2023-12-20T04:42:50.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.562+0000 7eff120ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c1617e0 con 0x7eff0c0d1aa0 2023-12-20T04:42:50.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.562+0000 7eff0affd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7eff0c0b4980 0x7eff0c0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:50.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.562+0000 7eff0affd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7eff0c0b4980 0x7eff0c0b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49012/0 (socket says 172.21.15.132:49012) 2023-12-20T04:42:50.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.562+0000 7eff0affd640 1 -- 172.21.15.132:0/719871206 learned_addr learned my addr 172.21.15.132:0/719871206 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:50.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.562+0000 7eff0bfff640 1 --2- 172.21.15.132:0/719871206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff0c0d1aa0 0x7eff0c0d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:50.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.562+0000 7eff0affd640 1 -- 172.21.15.132:0/719871206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff0c0d1aa0 msgr2=0x7eff0c0d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:50.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.562+0000 7eff0affd640 1 --2- 172.21.15.132:0/719871206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff0c0d1aa0 0x7eff0c0d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.562+0000 7eff0affd640 1 -- 172.21.15.132:0/719871206 >> v1:172.21.15.187:6789/0 conn(0x7eff0c160450 legacy=0x7eff0c160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:50.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.562+0000 7eff0affd640 1 -- 172.21.15.132:0/719871206 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff0c0d0fc0 con 0x7eff0c0b4980 2023-12-20T04:42:50.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.563+0000 7eff0affd640 1 --2- 172.21.15.132:0/719871206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff0c0b4980 0x7eff0c0b4de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff00009870 tx=0x7eff0002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f2bfd6305618ae4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:50.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.563+0000 7eff0a7fc640 1 -- 172.21.15.132:0/719871206 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0002f840 con 0x7eff0c0b4980 2023-12-20T04:42:50.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.563+0000 7eff0a7fc640 1 -- 172.21.15.132:0/719871206 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0002f9a0 con 0x7eff0c0b4980 2023-12-20T04:42:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.563+0000 7eff0a7fc640 1 -- 172.21.15.132:0/719871206 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff0002fd30 con 0x7eff0c0b4980 2023-12-20T04:42:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.563+0000 7eff120ab640 1 -- 172.21.15.132:0/719871206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff0c0b4980 msgr2=0x7eff0c0b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.563+0000 7eff120ab640 1 --2- 172.21.15.132:0/719871206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff0c0b4980 0x7eff0c0b4de0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7eff00009870 tx=0x7eff0002ba20 comp rx=0 tx=0).stop 2023-12-20T04:42:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.563+0000 7eff120ab640 1 -- 172.21.15.132:0/719871206 shutdown_connections 2023-12-20T04:42:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.563+0000 7eff120ab640 1 --2- 172.21.15.132:0/719871206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff0c0d1aa0 0x7eff0c0d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.563+0000 7eff120ab640 1 --2- 172.21.15.132:0/719871206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff0c0b4980 0x7eff0c0b4de0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.563+0000 7eff120ab640 1 -- 172.21.15.132:0/719871206 >> 172.21.15.132:0/719871206 conn(0x7eff0c0cf980 msgr2=0x7eff0c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:50.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.563+0000 7eff120ab640 1 -- 172.21.15.132:0/719871206 shutdown_connections 2023-12-20T04:42:50.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.563+0000 7eff120ab640 1 -- 172.21.15.132:0/719871206 wait complete. 2023-12-20T04:42:50.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.565+0000 7eff120ab640 1 Processor -- start 2023-12-20T04:42:50.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.565+0000 7eff120ab640 1 -- start start 2023-12-20T04:42:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.565+0000 7eff120ab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff0c0b4980 0x7eff0c15b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.565+0000 7eff120ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff0c0d1aa0 0x7eff0c06a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.565+0000 7eff120ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff0c160450 0x7eff0c151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.565+0000 7eff120ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c1580a0 con 0x7eff0c160450 2023-12-20T04:42:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.565+0000 7eff120ab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c157420 con 0x7eff0c0b4980 2023-12-20T04:42:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.565+0000 7eff120ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7eff0c157700 con 0x7eff0c0d1aa0 2023-12-20T04:42:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.566+0000 7eff0bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff0c160450 0x7eff0c151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.566+0000 7eff0bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff0c160450 0x7eff0c151fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49026/0 (socket says 172.21.15.132:49026) 2023-12-20T04:42:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.566+0000 7eff0bfff640 1 -- 172.21.15.132:0/2131385936 learned_addr learned my addr 172.21.15.132:0/2131385936 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.566+0000 7eff0affd640 1 --2- 172.21.15.132:0/2131385936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff0c0d1aa0 0x7eff0c06a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.566+0000 7eff0b7fe640 1 --2- 172.21.15.132:0/2131385936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff0c0b4980 0x7eff0c15b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.566+0000 7eff0bfff640 1 -- 172.21.15.132:0/2131385936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff0c0d1aa0 msgr2=0x7eff0c06a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:50.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.566+0000 7eff0bfff640 1 --2- 172.21.15.132:0/2131385936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff0c0d1aa0 0x7eff0c06a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.566+0000 7eff0bfff640 1 -- 172.21.15.132:0/2131385936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff0c0b4980 msgr2=0x7eff0c15b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.566+0000 7eff0bfff640 1 --2- 172.21.15.132:0/2131385936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff0c0b4980 0x7eff0c15b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.566+0000 7eff0bfff640 1 -- 172.21.15.132:0/2131385936 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff000094d0 con 0x7eff0c160450 2023-12-20T04:42:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.566+0000 7eff0b7fe640 1 --2- 172.21.15.132:0/2131385936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff0c0b4980 0x7eff0c15b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.566+0000 7eff0bfff640 1 --2- 172.21.15.132:0/2131385936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff0c160450 0x7eff0c151fd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff0400efc0 tx=0x7eff0400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:50.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.566+0000 7efef3fff640 1 -- 172.21.15.132:0/2131385936 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04014480 con 0x7eff0c160450 2023-12-20T04:42:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.566+0000 7efef3fff640 1 -- 172.21.15.132:0/2131385936 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7eff0400f040 con 0x7eff0c160450 2023-12-20T04:42:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.566+0000 7efef3fff640 1 -- 172.21.15.132:0/2131385936 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7eff04014820 con 0x7eff0c160450 2023-12-20T04:42:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.566+0000 7eff120ab640 1 -- 172.21.15.132:0/2131385936 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff0c1579e0 con 0x7eff0c160450 2023-12-20T04:42:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.566+0000 7eff120ab640 1 -- 172.21.15.132:0/2131385936 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff0c15be90 con 0x7eff0c160450 2023-12-20T04:42:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.567+0000 7eff120ab640 1 -- 172.21.15.132:0/2131385936 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff0c1581e0 con 0x7eff0c160450 2023-12-20T04:42:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.568+0000 7efef3fff640 1 -- 172.21.15.132:0/2131385936 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7eff04014980 con 0x7eff0c160450 2023-12-20T04:42:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.568+0000 7efef3fff640 1 --2- 172.21.15.132:0/2131385936 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efef806a430 0x7efef806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.568+0000 7efef3fff640 1 -- 172.21.15.132:0/2131385936 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7eff04089370 con 0x7eff0c160450 2023-12-20T04:42:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.568+0000 7eff0b7fe640 1 --2- 172.21.15.132:0/2131385936 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efef806a430 0x7efef806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.568+0000 7eff0b7fe640 1 --2- 172.21.15.132:0/2131385936 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efef806a430 0x7efef806c8f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efefc000f60 tx=0x7efefc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:50.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.572+0000 7efef3fff640 1 -- 172.21.15.132:0/2131385936 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7eff040549f0 con 0x7eff0c160450 2023-12-20T04:42:50.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.733+0000 7eff120ab640 1 -- 172.21.15.132:0/2131385936 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7eff0c0d1580 con 0x7efef806a430 2023-12-20T04:42:50.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.739+0000 7efef3fff640 1 -- 172.21.15.132:0/2131385936 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251313 (secure 0 0 0) 0x7efefc0013a0 con 0x7efef806a430 2023-12-20T04:42:50.744 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:50.745 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:42:50.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.742+0000 7eff120ab640 1 -- 172.21.15.132:0/2131385936 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efef806a430 msgr2=0x7efef806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:50.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.742+0000 7eff120ab640 1 --2- 172.21.15.132:0/2131385936 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efef806a430 0x7efef806c8f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7efefc000f60 tx=0x7efefc009040 comp rx=0 tx=0).stop 2023-12-20T04:42:50.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.742+0000 7eff120ab640 1 -- 172.21.15.132:0/2131385936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff0c160450 msgr2=0x7eff0c151fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:50.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.742+0000 7eff120ab640 1 --2- 172.21.15.132:0/2131385936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff0c160450 0x7eff0c151fd0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7eff0400efc0 tx=0x7eff0400c490 comp rx=0 tx=0).stop 2023-12-20T04:42:50.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.742+0000 7eff120ab640 1 -- 172.21.15.132:0/2131385936 shutdown_connections 2023-12-20T04:42:50.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.742+0000 7eff120ab640 1 --2- 172.21.15.132:0/2131385936 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efef806a430 0x7efef806c8f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.742+0000 7eff120ab640 1 --2- 172.21.15.132:0/2131385936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7eff0c160450 0x7eff0c151fd0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.742+0000 7eff120ab640 1 --2- 172.21.15.132:0/2131385936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7eff0c0d1aa0 0x7eff0c06a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.742+0000 7eff120ab640 1 --2- 172.21.15.132:0/2131385936 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7eff0c0b4980 0x7eff0c15b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.742+0000 7eff120ab640 1 -- 172.21.15.132:0/2131385936 >> 172.21.15.132:0/2131385936 conn(0x7eff0c0cf980 msgr2=0x7eff0c0b6940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:50.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.742+0000 7eff120ab640 1 -- 172.21.15.132:0/2131385936 shutdown_connections 2023-12-20T04:42:50.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.742+0000 7eff120ab640 1 -- 172.21.15.132:0/2131385936 wait complete. 2023-12-20T04:42:50.755 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-12-20T04:42:50.093250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1520,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560979,"statfs":{"total":1600000000,"available":1598443062,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.284258"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811868+0000","last_change":"2023-12-20T04:42:45.811868+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811868+0000","last_undegraded":"2023-12-20T04:42:45.811868+0000","last_fullsized":"2023-12-20T04:42:45.811868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:31:43.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810682+0000","last_change":"2023-12-20T04:42:45.810682+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810682+0000","last_undegraded":"2023-12-20T04:42:45.810682+0000","last_fullsized":"2023-12-20T04:42:45.810682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811827+0000","last_change":"2023-12-20T04:42:45.811827+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811827+0000","last_undegraded":"2023-12-20T04:42:45.811827+0000","last_fullsized":"2023-12-20T04:42:45.811827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:16.851777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811795+0000","last_change":"2023-12-20T04:42:45.811795+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811795+0000","last_undegraded":"2023-12-20T04:42:45.811795+0000","last_fullsized":"2023-12-20T04:42:45.811795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810766+0000","last_change":"2023-12-20T04:42:45.810766+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810766+0000","last_undegraded":"2023-12-20T04:42:45.810766+0000","last_fullsized":"2023-12-20T04:42:45.810766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811538+0000","last_change":"2023-12-20T04:42:45.811538+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811538+0000","last_undegraded":"2023-12-20T04:42:45.811538+0000","last_fullsized":"2023-12-20T04:42:45.811538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811459+0000","last_change":"2023-12-20T04:42:45.811459+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811459+0000","last_undegraded":"2023-12-20T04:42:45.811459+0000","last_fullsized":"2023-12-20T04:42:45.811459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810714+0000","last_change":"2023-12-20T04:42:45.810714+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810714+0000","last_undegraded":"2023-12-20T04:42:45.810714+0000","last_fullsized":"2023-12-20T04:42:45.810714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.807707+0000","last_change":"2023-12-20T04:42:45.807707+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.807707+0000","last_undegraded":"2023-12-20T04:42:45.807707+0000","last_fullsized":"2023-12-20T04:42:45.807707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:45:29.219298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811532+0000","last_change":"2023-12-20T04:42:45.811532+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811532+0000","last_undegraded":"2023-12-20T04:42:45.811532+0000","last_fullsized":"2023-12-20T04:42:45.811532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811351+0000","last_change":"2023-12-20T04:42:45.811351+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811351+0000","last_undegraded":"2023-12-20T04:42:45.811351+0000","last_fullsized":"2023-12-20T04:42:45.811351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812664+0000","last_change":"2023-12-20T04:42:45.812664+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812664+0000","last_undegraded":"2023-12-20T04:42:45.812664+0000","last_fullsized":"2023-12-20T04:42:45.812664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.808656+0000","last_change":"2023-12-20T04:42:45.808656+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.808656+0000","last_undegraded":"2023-12-20T04:42:45.808656+0000","last_fullsized":"2023-12-20T04:42:45.808656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:46:37.703321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812327+0000","last_change":"2023-12-20T04:42:45.812327+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812327+0000","last_undegraded":"2023-12-20T04:42:45.812327+0000","last_fullsized":"2023-12-20T04:42:45.812327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811507+0000","last_change":"2023-12-20T04:42:45.811507+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811507+0000","last_undegraded":"2023-12-20T04:42:45.811507+0000","last_fullsized":"2023-12-20T04:42:45.811507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812419+0000","last_change":"2023-12-20T04:42:45.812419+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812419+0000","last_undegraded":"2023-12-20T04:42:45.812419+0000","last_fullsized":"2023-12-20T04:42:45.812419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-20T04:42:41.100496+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:42:41.100496+0000","last_peered":"2023-12-20T04:42:41.100496+0000","last_clean":"2023-12-20T04:42:41.100496+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:42:41.100496+0000","last_undegraded":"2023-12-20T04:42:41.100496+0000","last_fullsized":"2023-12-20T04:42:41.100496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811102+0000","last_change":"2023-12-20T04:42:45.811102+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811102+0000","last_undegraded":"2023-12-20T04:42:45.811102+0000","last_fullsized":"2023-12-20T04:42:45.811102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.807944+0000","last_change":"2023-12-20T04:42:45.807944+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.807944+0000","last_undegraded":"2023-12-20T04:42:45.807944+0000","last_fullsized":"2023-12-20T04:42:45.807944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812305+0000","last_change":"2023-12-20T04:42:45.812305+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812305+0000","last_undegraded":"2023-12-20T04:42:45.812305+0000","last_fullsized":"2023-12-20T04:42:45.812305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:16.851777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811113+0000","last_change":"2023-12-20T04:42:45.811113+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811113+0000","last_undegraded":"2023-12-20T04:42:45.811113+0000","last_fullsized":"2023-12-20T04:42:45.811113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810952+0000","last_change":"2023-12-20T04:42:45.810952+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810952+0000","last_undegraded":"2023-12-20T04:42:45.810952+0000","last_fullsized":"2023-12-20T04:42:45.810952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.808525+0000","last_change":"2023-12-20T04:42:45.808525+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.808525+0000","last_undegraded":"2023-12-20T04:42:45.808525+0000","last_fullsized":"2023-12-20T04:42:45.808525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810950+0000","last_change":"2023-12-20T04:42:45.810950+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810950+0000","last_undegraded":"2023-12-20T04:42:45.810950+0000","last_fullsized":"2023-12-20T04:42:45.810950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810713+0000","last_change":"2023-12-20T04:42:45.810713+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810713+0000","last_undegraded":"2023-12-20T04:42:45.810713+0000","last_fullsized":"2023-12-20T04:42:45.810713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.808540+0000","last_change":"2023-12-20T04:42:45.808540+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.808540+0000","last_undegraded":"2023-12-20T04:42:45.808540+0000","last_fullsized":"2023-12-20T04:42:45.808540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811336+0000","last_change":"2023-12-20T04:42:45.811336+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811336+0000","last_undegraded":"2023-12-20T04:42:45.811336+0000","last_fullsized":"2023-12-20T04:42:45.811336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811602+0000","last_change":"2023-12-20T04:42:45.811602+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811602+0000","last_undegraded":"2023-12-20T04:42:45.811602+0000","last_fullsized":"2023-12-20T04:42:45.811602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.809002+0000","last_change":"2023-12-20T04:42:45.809002+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.809002+0000","last_undegraded":"2023-12-20T04:42:45.809002+0000","last_fullsized":"2023-12-20T04:42:45.809002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.809065+0000","last_change":"2023-12-20T04:42:45.809065+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.809065+0000","last_undegraded":"2023-12-20T04:42:45.809065+0000","last_fullsized":"2023-12-20T04:42:45.809065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:50.327147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.809676+0000","last_change":"2023-12-20T04:42:45.809676+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.809676+0000","last_undegraded":"2023-12-20T04:42:45.809676+0000","last_fullsized":"2023-12-20T04:42:45.809676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:57:22.907798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812183+0000","last_change":"2023-12-20T04:42:45.812183+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812183+0000","last_undegraded":"2023-12-20T04:42:45.812183+0000","last_fullsized":"2023-12-20T04:42:45.812183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.807707+0000","last_change":"2023-12-20T04:42:45.807707+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.807707+0000","last_undegraded":"2023-12-20T04:42:45.807707+0000","last_fullsized":"2023-12-20T04:42:45.807707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:46:37.703321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":621,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194691,"statfs":{"total":200000000,"available":199364061,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]}],"pool_statfs":[]}} 2023-12-20T04:42:50.759 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3f is not active+clean 2023-12-20T04:42:50.759 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.759 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3e is not active+clean 2023-12-20T04:42:50.759 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3d is not active+clean 2023-12-20T04:42:50.760 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3c is not active+clean 2023-12-20T04:42:50.760 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3b is not active+clean 2023-12-20T04:42:50.760 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3a is not active+clean 2023-12-20T04:42:50.760 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.39 is not active+clean 2023-12-20T04:42:50.760 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.760 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.38 is not active+clean 2023-12-20T04:42:50.761 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.761 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.37 is not active+clean 2023-12-20T04:42:50.761 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.761 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.36 is not active+clean 2023-12-20T04:42:50.761 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.761 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.35 is not active+clean 2023-12-20T04:42:50.761 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.761 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.34 is not active+clean 2023-12-20T04:42:50.761 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.761 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.33 is not active+clean 2023-12-20T04:42:50.761 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.32 is not active+clean 2023-12-20T04:42:50.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.31 is not active+clean 2023-12-20T04:42:50.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.30 is not active+clean 2023-12-20T04:42:50.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2f is not active+clean 2023-12-20T04:42:50.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2e is not active+clean 2023-12-20T04:42:50.762 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.762 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2d is not active+clean 2023-12-20T04:42:50.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2c is not active+clean 2023-12-20T04:42:50.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2b is not active+clean 2023-12-20T04:42:50.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2a is not active+clean 2023-12-20T04:42:50.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.29 is not active+clean 2023-12-20T04:42:50.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.763 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.28 is not active+clean 2023-12-20T04:42:50.763 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.27 is not active+clean 2023-12-20T04:42:50.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.26 is not active+clean 2023-12-20T04:42:50.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.25 is not active+clean 2023-12-20T04:42:50.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.24 is not active+clean 2023-12-20T04:42:50.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.764 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.23 is not active+clean 2023-12-20T04:42:50.764 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.22 is not active+clean 2023-12-20T04:42:50.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.21 is not active+clean 2023-12-20T04:42:50.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.20 is not active+clean 2023-12-20T04:42:50.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1a is not active+clean 2023-12-20T04:42:50.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.765 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1b is not active+clean 2023-12-20T04:42:50.765 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.811868+0000', 'last_change': '2023-12-20T04:42:45.811868+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.811868+0000', 'last_undegraded': '2023-12-20T04:42:45.811868+0000', 'last_fullsized': '2023-12-20T04:42:45.811868+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T05:31:43.881906+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:42:50.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1b is not active+clean 2023-12-20T04:42:50.766 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1a is not active+clean 2023-12-20T04:42:50.766 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.810682+0000', 'last_change': '2023-12-20T04:42:45.810682+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.810682+0000', 'last_undegraded': '2023-12-20T04:42:45.810682+0000', 'last_fullsized': '2023-12-20T04:42:45.810682+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:42:50.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.19 is not active+clean 2023-12-20T04:42:50.766 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.811827+0000', 'last_change': '2023-12-20T04:42:45.811827+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.811827+0000', 'last_undegraded': '2023-12-20T04:42:45.811827+0000', 'last_fullsized': '2023-12-20T04:42:45.811827+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:09:16.851777+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:42:50.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.18 is not active+clean 2023-12-20T04:42:50.766 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.766 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.18 is not active+clean 2023-12-20T04:42:50.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.811795+0000', 'last_change': '2023-12-20T04:42:45.811795+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.811795+0000', 'last_undegraded': '2023-12-20T04:42:45.811795+0000', 'last_fullsized': '2023-12-20T04:42:45.811795+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:42:50.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.19 is not active+clean 2023-12-20T04:42:50.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.17 is not active+clean 2023-12-20T04:42:50.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.810766+0000', 'last_change': '2023-12-20T04:42:45.810766+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.810766+0000', 'last_undegraded': '2023-12-20T04:42:45.810766+0000', 'last_fullsized': '2023-12-20T04:42:45.810766+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:42:50.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.16 is not active+clean 2023-12-20T04:42:50.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.16 is not active+clean 2023-12-20T04:42:50.767 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.811538+0000', 'last_change': '2023-12-20T04:42:45.811538+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.811538+0000', 'last_undegraded': '2023-12-20T04:42:45.811538+0000', 'last_fullsized': '2023-12-20T04:42:45.811538+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:42:50.767 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.17 is not active+clean 2023-12-20T04:42:50.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.768 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.15 is not active+clean 2023-12-20T04:42:50.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.811459+0000', 'last_change': '2023-12-20T04:42:45.811459+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.811459+0000', 'last_undegraded': '2023-12-20T04:42:45.811459+0000', 'last_fullsized': '2023-12-20T04:42:45.811459+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:42:50.768 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.14 is not active+clean 2023-12-20T04:42:50.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.768 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.14 is not active+clean 2023-12-20T04:42:50.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.810714+0000', 'last_change': '2023-12-20T04:42:45.810714+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.810714+0000', 'last_undegraded': '2023-12-20T04:42:45.810714+0000', 'last_fullsized': '2023-12-20T04:42:45.810714+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:42:50.768 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.15 is not active+clean 2023-12-20T04:42:50.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.768 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.13 is not active+clean 2023-12-20T04:42:50.768 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.807707+0000', 'last_change': '2023-12-20T04:42:45.807707+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.807707+0000', 'last_undegraded': '2023-12-20T04:42:45.807707+0000', 'last_fullsized': '2023-12-20T04:42:45.807707+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T08:45:29.219298+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:42:50.769 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.12 is not active+clean 2023-12-20T04:42:50.769 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.769 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.12 is not active+clean 2023-12-20T04:42:50.769 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.811532+0000', 'last_change': '2023-12-20T04:42:45.811532+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.811532+0000', 'last_undegraded': '2023-12-20T04:42:45.811532+0000', 'last_fullsized': '2023-12-20T04:42:45.811532+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:42:50.769 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.13 is not active+clean 2023-12-20T04:42:50.769 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.769 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.11 is not active+clean 2023-12-20T04:42:50.769 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.811351+0000', 'last_change': '2023-12-20T04:42:45.811351+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.811351+0000', 'last_undegraded': '2023-12-20T04:42:45.811351+0000', 'last_fullsized': '2023-12-20T04:42:45.811351+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:42:50.769 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.10 is not active+clean 2023-12-20T04:42:50.770 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.770 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.10 is not active+clean 2023-12-20T04:42:50.770 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.812664+0000', 'last_change': '2023-12-20T04:42:45.812664+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.812664+0000', 'last_undegraded': '2023-12-20T04:42:45.812664+0000', 'last_fullsized': '2023-12-20T04:42:45.812664+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:42:50.770 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.11 is not active+clean 2023-12-20T04:42:50.770 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.770 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.f is not active+clean 2023-12-20T04:42:50.770 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.808656+0000', 'last_change': '2023-12-20T04:42:45.808656+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.808656+0000', 'last_undegraded': '2023-12-20T04:42:45.808656+0000', 'last_fullsized': '2023-12-20T04:42:45.808656+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T11:46:37.703321+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:42:50.770 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.e is not active+clean 2023-12-20T04:42:50.770 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.770 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.e is not active+clean 2023-12-20T04:42:50.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.812327+0000', 'last_change': '2023-12-20T04:42:45.812327+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.812327+0000', 'last_undegraded': '2023-12-20T04:42:45.812327+0000', 'last_fullsized': '2023-12-20T04:42:45.812327+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:42:50.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.f is not active+clean 2023-12-20T04:42:50.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.d is not active+clean 2023-12-20T04:42:50.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.811507+0000', 'last_change': '2023-12-20T04:42:45.811507+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.811507+0000', 'last_undegraded': '2023-12-20T04:42:45.811507+0000', 'last_fullsized': '2023-12-20T04:42:45.811507+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:42:50.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.c is not active+clean 2023-12-20T04:42:50.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.c is not active+clean 2023-12-20T04:42:50.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.812419+0000', 'last_change': '2023-12-20T04:42:45.812419+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.812419+0000', 'last_undegraded': '2023-12-20T04:42:45.812419+0000', 'last_fullsized': '2023-12-20T04:42:45.812419+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:42:50.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.d is not active+clean 2023-12-20T04:42:50.771 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.771 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.3 is not active+clean 2023-12-20T04:42:50.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.811102+0000', 'last_change': '2023-12-20T04:42:45.811102+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.811102+0000', 'last_undegraded': '2023-12-20T04:42:45.811102+0000', 'last_fullsized': '2023-12-20T04:42:45.811102+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:42:50.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.2 is not active+clean 2023-12-20T04:42:50.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.0 is not active+clean 2023-12-20T04:42:50.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.807944+0000', 'last_change': '2023-12-20T04:42:45.807944+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.807944+0000', 'last_undegraded': '2023-12-20T04:42:45.807944+0000', 'last_fullsized': '2023-12-20T04:42:45.807944+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:42:50.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1 is not active+clean 2023-12-20T04:42:50.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1 is not active+clean 2023-12-20T04:42:50.772 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.812305+0000', 'last_change': '2023-12-20T04:42:45.812305+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.812305+0000', 'last_undegraded': '2023-12-20T04:42:45.812305+0000', 'last_fullsized': '2023-12-20T04:42:45.812305+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:09:16.851777+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:42:50.772 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.0 is not active+clean 2023-12-20T04:42:50.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.2 is not active+clean 2023-12-20T04:42:50.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.811113+0000', 'last_change': '2023-12-20T04:42:45.811113+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.811113+0000', 'last_undegraded': '2023-12-20T04:42:45.811113+0000', 'last_fullsized': '2023-12-20T04:42:45.811113+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:42:50.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.3 is not active+clean 2023-12-20T04:42:50.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.4 is not active+clean 2023-12-20T04:42:50.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.810952+0000', 'last_change': '2023-12-20T04:42:45.810952+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.810952+0000', 'last_undegraded': '2023-12-20T04:42:45.810952+0000', 'last_fullsized': '2023-12-20T04:42:45.810952+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:42:50.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.5 is not active+clean 2023-12-20T04:42:50.773 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.773 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.5 is not active+clean 2023-12-20T04:42:50.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.808525+0000', 'last_change': '2023-12-20T04:42:45.808525+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.808525+0000', 'last_undegraded': '2023-12-20T04:42:45.808525+0000', 'last_fullsized': '2023-12-20T04:42:45.808525+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:42:50.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.4 is not active+clean 2023-12-20T04:42:50.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.6 is not active+clean 2023-12-20T04:42:50.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.810950+0000', 'last_change': '2023-12-20T04:42:45.810950+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.810950+0000', 'last_undegraded': '2023-12-20T04:42:45.810950+0000', 'last_fullsized': '2023-12-20T04:42:45.810950+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:42:50.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.7 is not active+clean 2023-12-20T04:42:50.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.7 is not active+clean 2023-12-20T04:42:50.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.810713+0000', 'last_change': '2023-12-20T04:42:45.810713+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.810713+0000', 'last_undegraded': '2023-12-20T04:42:45.810713+0000', 'last_fullsized': '2023-12-20T04:42:45.810713+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 7], 'acting': [6, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:42:50.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.6 is not active+clean 2023-12-20T04:42:50.774 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.774 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.8 is not active+clean 2023-12-20T04:42:50.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.808540+0000', 'last_change': '2023-12-20T04:42:45.808540+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.808540+0000', 'last_undegraded': '2023-12-20T04:42:45.808540+0000', 'last_fullsized': '2023-12-20T04:42:45.808540+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 0], 'acting': [7, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:42:50.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.9 is not active+clean 2023-12-20T04:42:50.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.9 is not active+clean 2023-12-20T04:42:50.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.811336+0000', 'last_change': '2023-12-20T04:42:45.811336+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.811336+0000', 'last_undegraded': '2023-12-20T04:42:45.811336+0000', 'last_fullsized': '2023-12-20T04:42:45.811336+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:42:50.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.8 is not active+clean 2023-12-20T04:42:50.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.a is not active+clean 2023-12-20T04:42:50.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.811602+0000', 'last_change': '2023-12-20T04:42:45.811602+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.811602+0000', 'last_undegraded': '2023-12-20T04:42:45.811602+0000', 'last_fullsized': '2023-12-20T04:42:45.811602+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 3], 'acting': [1, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:42:50.775 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.b is not active+clean 2023-12-20T04:42:50.775 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.b is not active+clean 2023-12-20T04:42:50.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.809002+0000', 'last_change': '2023-12-20T04:42:45.809002+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.809002+0000', 'last_undegraded': '2023-12-20T04:42:45.809002+0000', 'last_fullsized': '2023-12-20T04:42:45.809002+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:42:50.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.a is not active+clean 2023-12-20T04:42:50.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1d is not active+clean 2023-12-20T04:42:50.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1c is not active+clean 2023-12-20T04:42:50.776 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.809065+0000', 'last_change': '2023-12-20T04:42:45.809065+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.809065+0000', 'last_undegraded': '2023-12-20T04:42:45.809065+0000', 'last_fullsized': '2023-12-20T04:42:45.809065+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T16:08:50.327147+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:42:50.776 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1c is not active+clean 2023-12-20T04:42:50.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1d is not active+clean 2023-12-20T04:42:50.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.809676+0000', 'last_change': '2023-12-20T04:42:45.809676+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.809676+0000', 'last_undegraded': '2023-12-20T04:42:45.809676+0000', 'last_fullsized': '2023-12-20T04:42:45.809676+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T05:57:22.907798+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:42:50.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1f is not active+clean 2023-12-20T04:42:50.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1e is not active+clean 2023-12-20T04:42:50.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.812183+0000', 'last_change': '2023-12-20T04:42:45.812183+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.812183+0000', 'last_undegraded': '2023-12-20T04:42:45.812183+0000', 'last_fullsized': '2023-12-20T04:42:45.812183+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:42:50.777 INFO:tasks.cephfs.filesystem.ceph_manager:PG 3.1e is not active+clean 2023-12-20T04:42:50.777 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '3.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:42:46.806803+0000', 'last_change': '2023-12-20T04:42:46.806803+0000', 'last_active': '2023-12-20T04:42:46.806803+0000', 'last_peered': '2023-12-20T04:42:46.806803+0000', 'last_clean': '2023-12-20T04:42:46.806803+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:46.806803+0000', 'last_undegraded': '2023-12-20T04:42:46.806803+0000', 'last_fullsized': '2023-12-20T04:42:46.806803+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:46.806803+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:42:50.778 INFO:tasks.cephfs.filesystem.ceph_manager:PG 2.1f is not active+clean 2023-12-20T04:42:50.778 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '2.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 17, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:42:45.807707+0000', 'last_change': '2023-12-20T04:42:45.807707+0000', 'last_active': '2023-12-20T04:42:45.800195+0000', 'last_peered': '2023-12-20T04:42:45.800195+0000', 'last_clean': '2023-12-20T04:42:45.800195+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:42:45.807707+0000', 'last_undegraded': '2023-12-20T04:42:45.807707+0000', 'last_fullsized': '2023-12-20T04:42:45.807707+0000', 'mapping_epoch': 17, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 17, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'last_clean_scrub_stamp': '2023-12-20T04:42:45.800195+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T11:46:37.703321+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:42:50.778 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-20T04:42:50.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.894+0000 7f7c3ace0640 1 Processor -- start 2023-12-20T04:42:50.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.894+0000 7f7c3ace0640 1 -- start start 2023-12-20T04:42:50.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.895+0000 7f7c3ace0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7c340b4f90 0x7f7c340b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.895+0000 7f7c3ace0640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7c340b1d10 0x7f7c340d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.895+0000 7f7c3ace0640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c340cd660 con 0x7f7c3415d110 2023-12-20T04:42:50.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.895+0000 7f7c3ace0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c340cd940 con 0x7f7c340b4f90 2023-12-20T04:42:50.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.895+0000 7f7c3ace0640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c34160e60 con 0x7f7c340b1d10 2023-12-20T04:42:50.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.895+0000 7f7c33fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7c340b4f90 0x7f7c340b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:50.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.895+0000 7f7c33fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7c340b4f90 0x7f7c340b21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49036/0 (socket says 172.21.15.132:49036) 2023-12-20T04:42:50.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.895+0000 7f7c33fff640 1 -- 172.21.15.132:0/1004622805 learned_addr learned my addr 172.21.15.132:0/1004622805 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:50.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.895+0000 7f7c33fff640 1 -- 172.21.15.132:0/1004622805 >> v2:172.21.15.187:3300/0 conn(0x7f7c340b1d10 msgr2=0x7f7c340d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:50.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.896+0000 7f7c33fff640 1 --2- 172.21.15.132:0/1004622805 >> v2:172.21.15.187:3300/0 conn(0x7f7c340b1d10 0x7f7c340d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.896+0000 7f7c33fff640 1 -- 172.21.15.132:0/1004622805 >> v1:172.21.15.187:6789/0 conn(0x7f7c3415d110 legacy=0x7f7c340b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:50.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.896+0000 7f7c33fff640 1 -- 172.21.15.132:0/1004622805 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c34161140 con 0x7f7c340b4f90 2023-12-20T04:42:50.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.896+0000 7f7c33fff640 1 --2- 172.21.15.132:0/1004622805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c340b4f90 0x7f7c340b21f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c340d3ed0 tx=0x7f7c2802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ac19f40b0ac72b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:50.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.896+0000 7f7c337fe640 1 -- 172.21.15.132:0/1004622805 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28031870 con 0x7f7c340b4f90 2023-12-20T04:42:50.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.896+0000 7f7c337fe640 1 -- 172.21.15.132:0/1004622805 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c280319d0 con 0x7f7c340b4f90 2023-12-20T04:42:50.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.896+0000 7f7c337fe640 1 -- 172.21.15.132:0/1004622805 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c28031d60 con 0x7f7c340b4f90 2023-12-20T04:42:50.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.897+0000 7f7c3ace0640 1 -- 172.21.15.132:0/1004622805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c340b4f90 msgr2=0x7f7c340b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:50.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.897+0000 7f7c3ace0640 1 --2- 172.21.15.132:0/1004622805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c340b4f90 0x7f7c340b21f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7c340d3ed0 tx=0x7f7c2802b910 comp rx=0 tx=0).stop 2023-12-20T04:42:50.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.897+0000 7f7c3ace0640 1 -- 172.21.15.132:0/1004622805 shutdown_connections 2023-12-20T04:42:50.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.897+0000 7f7c3ace0640 1 --2- 172.21.15.132:0/1004622805 >> v2:172.21.15.187:3300/0 conn(0x7f7c340b1d10 0x7f7c340d0f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.897+0000 7f7c3ace0640 1 --2- 172.21.15.132:0/1004622805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c340b4f90 0x7f7c340b21f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.897+0000 7f7c3ace0640 1 -- 172.21.15.132:0/1004622805 >> 172.21.15.132:0/1004622805 conn(0x7f7c340cf880 msgr2=0x7f7c340cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:50.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.897+0000 7f7c3ace0640 1 -- 172.21.15.132:0/1004622805 shutdown_connections 2023-12-20T04:42:50.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.897+0000 7f7c3ace0640 1 -- 172.21.15.132:0/1004622805 wait complete. 2023-12-20T04:42:50.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.898+0000 7f7c3ace0640 1 Processor -- start 2023-12-20T04:42:50.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.898+0000 7f7c3ace0640 1 -- start start 2023-12-20T04:42:50.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c3ace0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c340b1d10 0x7f7c340c8980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c3ace0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c340b4f90 0x7f7c340cc520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c3ace0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c3415d110 0x7f7c340b6e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c3ace0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c341f61c0 con 0x7f7c340b1d10 2023-12-20T04:42:50.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c3ace0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c341f64a0 con 0x7f7c3415d110 2023-12-20T04:42:50.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c3ace0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c341f6780 con 0x7f7c340b4f90 2023-12-20T04:42:50.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c38a7c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c340b1d10 0x7f7c340c8980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:50.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c38a7c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c340b1d10 0x7f7c340c8980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49042/0 (socket says 172.21.15.132:49042) 2023-12-20T04:42:50.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c38a7c640 1 -- 172.21.15.132:0/2029038114 learned_addr learned my addr 172.21.15.132:0/2029038114 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:50.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c33fff640 1 --2- 172.21.15.132:0/2029038114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c340b4f90 0x7f7c340cc520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:50.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c3927d640 1 --2- 172.21.15.132:0/2029038114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c3415d110 0x7f7c340b6e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:50.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c38a7c640 1 -- 172.21.15.132:0/2029038114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c340b4f90 msgr2=0x7f7c340cc520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:50.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c38a7c640 1 --2- 172.21.15.132:0/2029038114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c340b4f90 0x7f7c340cc520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c38a7c640 1 -- 172.21.15.132:0/2029038114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c3415d110 msgr2=0x7f7c340b6e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:50.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c38a7c640 1 --2- 172.21.15.132:0/2029038114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c3415d110 0x7f7c340b6e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:50.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c38a7c640 1 -- 172.21.15.132:0/2029038114 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c280094d0 con 0x7f7c340b1d10 2023-12-20T04:42:50.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c3927d640 1 --2- 172.21.15.132:0/2029038114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c3415d110 0x7f7c340b6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:50.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.899+0000 7f7c38a7c640 1 --2- 172.21.15.132:0/2029038114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c340b1d10 0x7f7c340c8980 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400b3e0 tx=0x7f7c2400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:50.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.900+0000 7f7c317fa640 1 -- 172.21.15.132:0/2029038114 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24011830 con 0x7f7c340b1d10 2023-12-20T04:42:50.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.900+0000 7f7c317fa640 1 -- 172.21.15.132:0/2029038114 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c240119b0 con 0x7f7c340b1d10 2023-12-20T04:42:50.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.900+0000 7f7c317fa640 1 -- 172.21.15.132:0/2029038114 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c24011d60 con 0x7f7c340b1d10 2023-12-20T04:42:50.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.900+0000 7f7c3ace0640 1 -- 172.21.15.132:0/2029038114 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c341f6a60 con 0x7f7c340b1d10 2023-12-20T04:42:50.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.900+0000 7f7c3ace0640 1 -- 172.21.15.132:0/2029038114 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c341602d0 con 0x7f7c340b1d10 2023-12-20T04:42:50.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.901+0000 7f7c3ace0640 1 -- 172.21.15.132:0/2029038114 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c3404e840 con 0x7f7c340b1d10 2023-12-20T04:42:50.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.901+0000 7f7c317fa640 1 -- 172.21.15.132:0/2029038114 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7c2401a400 con 0x7f7c340b1d10 2023-12-20T04:42:50.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.901+0000 7f7c317fa640 1 --2- 172.21.15.132:0/2029038114 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c2006a430 0x7f7c2006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:50.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.902+0000 7f7c33fff640 1 --2- 172.21.15.132:0/2029038114 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c2006a430 0x7f7c2006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:50.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.902+0000 7f7c317fa640 1 -- 172.21.15.132:0/2029038114 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c24088ac0 con 0x7f7c340b1d10 2023-12-20T04:42:50.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.902+0000 7f7c33fff640 1 --2- 172.21.15.132:0/2029038114 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c2006a430 0x7f7c2006c8f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7c28036000 tx=0x7f7c2803c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:50.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:50.906+0000 7f7c317fa640 1 -- 172.21.15.132:0/2029038114 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7c240540b0 con 0x7f7c340b1d10 2023-12-20T04:42:51.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.136+0000 7f7c3ace0640 1 -- 172.21.15.132:0/2029038114 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f7c340d1c90 con 0x7f7c340b1d10 2023-12-20T04:42:51.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.137+0000 7f7c317fa640 1 -- 172.21.15.132:0/2029038114 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1100 (secure 0 0 0) 0x7f7c24088e60 con 0x7f7c340b1d10 2023-12-20T04:42:51.139 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:51.139 INFO:teuthology.orchestra.run.smithi132.stdout:{"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":21,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":20,"num_osds":8,"num_up_osds":8,"osd_up_since":1703047355,"num_in_osds":8,"osd_in_since":1703047352,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":1556938,"bytes_avail":1598443062,"bytes_total":1600000000,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":6,"id":1,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":1,"rank":0,"name":"b","status":"up:active","gid":4267}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":1,"modified":"2023-12-20T04:42:30.056304+0000","services":{}},"progress_events":{}} 2023-12-20T04:42:51.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.138+0000 7f7c3ace0640 1 -- 172.21.15.132:0/2029038114 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c2006a430 msgr2=0x7f7c2006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:51.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.138+0000 7f7c3ace0640 1 --2- 172.21.15.132:0/2029038114 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c2006a430 0x7f7c2006c8f0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f7c28036000 tx=0x7f7c2803c040 comp rx=0 tx=0).stop 2023-12-20T04:42:51.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.139+0000 7f7c3ace0640 1 -- 172.21.15.132:0/2029038114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c340b1d10 msgr2=0x7f7c340c8980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:51.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.139+0000 7f7c3ace0640 1 --2- 172.21.15.132:0/2029038114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c340b1d10 0x7f7c340c8980 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7c2400b3e0 tx=0x7f7c2400b8a0 comp rx=0 tx=0).stop 2023-12-20T04:42:51.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.139+0000 7f7c3ace0640 1 -- 172.21.15.132:0/2029038114 shutdown_connections 2023-12-20T04:42:51.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.139+0000 7f7c3ace0640 1 --2- 172.21.15.132:0/2029038114 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c2006a430 0x7f7c2006c8f0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:51.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.139+0000 7f7c3ace0640 1 --2- 172.21.15.132:0/2029038114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c3415d110 0x7f7c340b6e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:51.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.139+0000 7f7c3ace0640 1 --2- 172.21.15.132:0/2029038114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c340b4f90 0x7f7c340cc520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:51.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.139+0000 7f7c3ace0640 1 --2- 172.21.15.132:0/2029038114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c340b1d10 0x7f7c340c8980 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:51.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.139+0000 7f7c3ace0640 1 -- 172.21.15.132:0/2029038114 >> 172.21.15.132:0/2029038114 conn(0x7f7c340cf880 msgr2=0x7f7c340b7f00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:51.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.139+0000 7f7c3ace0640 1 -- 172.21.15.132:0/2029038114 shutdown_connections 2023-12-20T04:42:51.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.139+0000 7f7c3ace0640 1 -- 172.21.15.132:0/2029038114 wait complete. 2023-12-20T04:42:51.151 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-20T04:42:51.151 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:42:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.248+0000 7f7d3f64d640 1 Processor -- start 2023-12-20T04:42:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.248+0000 7f7d3f64d640 1 -- start start 2023-12-20T04:42:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.249+0000 7f7d3f64d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d3815d100 0x7f7d380b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.249+0000 7f7d3f64d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7d380d0370 0x7f7d380cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.249+0000 7f7d3f64d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7d38161850 0x7f7d380cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.249+0000 7f7d3f64d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d380b2f90 con 0x7f7d38161850 2023-12-20T04:42:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.249+0000 7f7d3f64d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7d381613c0 con 0x7f7d380d0370 2023-12-20T04:42:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.249+0000 7f7d3f64d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380d0810 con 0x7f7d3815d100 2023-12-20T04:42:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.249+0000 7f7d3dbea640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7d38161850 0x7f7d380cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.249+0000 7f7d3dbea640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7d38161850 0x7f7d380cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49056/0 (socket says 172.21.15.132:49056) 2023-12-20T04:42:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.249+0000 7f7d3dbea640 1 -- 172.21.15.132:0/1672162221 learned_addr learned my addr 172.21.15.132:0/1672162221 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.249+0000 7f7d3d3e9640 1 --2- 172.21.15.132:0/1672162221 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d3815d100 0x7f7d380b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.249+0000 7f7d3cbe8640 1 --2- 172.21.15.132:0/1672162221 >> v2:172.21.15.187:3300/0 conn(0x7f7d380d0370 0x7f7d380cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.249+0000 7f7d3dbea640 1 -- 172.21.15.132:0/1672162221 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d3815d100 msgr2=0x7f7d380b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:51.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.249+0000 7f7d3dbea640 1 --2- 172.21.15.132:0/1672162221 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d3815d100 0x7f7d380b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.249+0000 7f7d3dbea640 1 -- 172.21.15.132:0/1672162221 >> v2:172.21.15.187:3300/0 conn(0x7f7d380d0370 msgr2=0x7f7d380cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.249+0000 7f7d3dbea640 1 --2- 172.21.15.132:0/1672162221 >> v2:172.21.15.187:3300/0 conn(0x7f7d380d0370 0x7f7d380cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.249+0000 7f7d3dbea640 1 -- 172.21.15.132:0/1672162221 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d38160d70 con 0x7f7d38161850 2023-12-20T04:42:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.249+0000 7f7d3d3e9640 1 --2- 172.21.15.132:0/1672162221 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d3815d100 0x7f7d380b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.250+0000 7f7d3dbea640 1 --2- 172.21.15.132:0/1672162221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d38161850 0x7f7d380cda40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7d380d1e30 tx=0x7f7d3002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36aed6c34672a60 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.250+0000 7f7d37fff640 1 -- 172.21.15.132:0/1672162221 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d300317e0 con 0x7f7d38161850 2023-12-20T04:42:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.250+0000 7f7d37fff640 1 -- 172.21.15.132:0/1672162221 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d30031940 con 0x7f7d38161850 2023-12-20T04:42:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.250+0000 7f7d37fff640 1 -- 172.21.15.132:0/1672162221 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30031cd0 con 0x7f7d38161850 2023-12-20T04:42:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.251+0000 7f7d3f64d640 1 -- 172.21.15.132:0/1672162221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d38161850 msgr2=0x7f7d380cda40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.251+0000 7f7d3f64d640 1 --2- 172.21.15.132:0/1672162221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d38161850 0x7f7d380cda40 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f7d380d1e30 tx=0x7f7d3002b880 comp rx=0 tx=0).stop 2023-12-20T04:42:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.251+0000 7f7d3f64d640 1 -- 172.21.15.132:0/1672162221 shutdown_connections 2023-12-20T04:42:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.251+0000 7f7d3f64d640 1 --2- 172.21.15.132:0/1672162221 >> v2:172.21.15.187:3300/0 conn(0x7f7d380d0370 0x7f7d380cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.251+0000 7f7d3f64d640 1 --2- 172.21.15.132:0/1672162221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d38161850 0x7f7d380cda40 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.251+0000 7f7d3f64d640 1 --2- 172.21.15.132:0/1672162221 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d3815d100 0x7f7d380b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.251+0000 7f7d3f64d640 1 -- 172.21.15.132:0/1672162221 >> 172.21.15.132:0/1672162221 conn(0x7f7d3806d7c0 msgr2=0x7f7d3806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.251+0000 7f7d3f64d640 1 -- 172.21.15.132:0/1672162221 shutdown_connections 2023-12-20T04:42:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.251+0000 7f7d3f64d640 1 -- 172.21.15.132:0/1672162221 wait complete. 2023-12-20T04:42:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.252+0000 7f7d3f64d640 1 Processor -- start 2023-12-20T04:42:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.252+0000 7f7d3f64d640 1 -- start start 2023-12-20T04:42:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3f64d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d380d0370 0x7f7d381f38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3f64d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d3815d100 0x7f7d380acb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3f64d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d38161850 0x7f7d380ae8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3f64d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d380af9c0 con 0x7f7d38161850 2023-12-20T04:42:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3f64d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d381f3df0 con 0x7f7d3815d100 2023-12-20T04:42:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3f64d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7d381f6cd0 con 0x7f7d380d0370 2023-12-20T04:42:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3dbea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d38161850 0x7f7d380ae8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3dbea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d38161850 0x7f7d380ae8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49072/0 (socket says 172.21.15.132:49072) 2023-12-20T04:42:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3dbea640 1 -- 172.21.15.132:0/2560363240 learned_addr learned my addr 172.21.15.132:0/2560363240 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3d3e9640 1 --2- 172.21.15.132:0/2560363240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d380d0370 0x7f7d381f38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:51.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3cbe8640 1 --2- 172.21.15.132:0/2560363240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d3815d100 0x7f7d380acb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3dbea640 1 -- 172.21.15.132:0/2560363240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d380d0370 msgr2=0x7f7d381f38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3dbea640 1 --2- 172.21.15.132:0/2560363240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d380d0370 0x7f7d381f38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3dbea640 1 -- 172.21.15.132:0/2560363240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d3815d100 msgr2=0x7f7d380acb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3dbea640 1 --2- 172.21.15.132:0/2560363240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d3815d100 0x7f7d380acb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3dbea640 1 -- 172.21.15.132:0/2560363240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d300094d0 con 0x7f7d38161850 2023-12-20T04:42:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3d3e9640 1 --2- 172.21.15.132:0/2560363240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d380d0370 0x7f7d381f38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3dbea640 1 --2- 172.21.15.132:0/2560363240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d38161850 0x7f7d380ae8d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7d300090b0 tx=0x7f7d300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d35ffb640 1 -- 172.21.15.132:0/2560363240 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30032880 con 0x7f7d38161850 2023-12-20T04:42:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d35ffb640 1 -- 172.21.15.132:0/2560363240 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7d30032a20 con 0x7f7d38161850 2023-12-20T04:42:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d35ffb640 1 -- 172.21.15.132:0/2560363240 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7d30032dd0 con 0x7f7d38161850 2023-12-20T04:42:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.253+0000 7f7d3f64d640 1 -- 172.21.15.132:0/2560363240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d380af6e0 con 0x7f7d38161850 2023-12-20T04:42:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.254+0000 7f7d3f64d640 1 -- 172.21.15.132:0/2560363240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d380c9370 con 0x7f7d38161850 2023-12-20T04:42:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.255+0000 7f7d3f64d640 1 -- 172.21.15.132:0/2560363240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d380c8f50 con 0x7f7d38161850 2023-12-20T04:42:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.255+0000 7f7d35ffb640 1 -- 172.21.15.132:0/2560363240 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7d3004e450 con 0x7f7d38161850 2023-12-20T04:42:51.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.255+0000 7f7d35ffb640 1 --2- 172.21.15.132:0/2560363240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7d2406a430 0x7f7d2406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.255+0000 7f7d35ffb640 1 -- 172.21.15.132:0/2560363240 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7d300aaa50 con 0x7f7d38161850 2023-12-20T04:42:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.255+0000 7f7d3d3e9640 1 --2- 172.21.15.132:0/2560363240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7d2406a430 0x7f7d2406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:51.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.256+0000 7f7d3d3e9640 1 --2- 172.21.15.132:0/2560363240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7d2406a430 0x7f7d2406c8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7d380cad20 tx=0x7f7d28003a50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:51.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.260+0000 7f7d35ffb640 1 -- 172.21.15.132:0/2560363240 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7d380c8f50 con 0x7f7d38161850 2023-12-20T04:42:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.420+0000 7f7d3f64d640 1 -- 172.21.15.132:0/2560363240 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7d380cebc0 con 0x7f7d2406a430 2023-12-20T04:42:51.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.426+0000 7f7d35ffb640 1 -- 172.21.15.132:0/2560363240 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+251313 (secure 0 0 0) 0x7f7d280047b0 con 0x7f7d2406a430 2023-12-20T04:42:51.431 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:51.432 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:42:51.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.429+0000 7f7d3f64d640 1 -- 172.21.15.132:0/2560363240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7d2406a430 msgr2=0x7f7d2406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.429+0000 7f7d3f64d640 1 --2- 172.21.15.132:0/2560363240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7d2406a430 0x7f7d2406c8f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f7d380cad20 tx=0x7f7d28003a50 comp rx=0 tx=0).stop 2023-12-20T04:42:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.429+0000 7f7d3f64d640 1 -- 172.21.15.132:0/2560363240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d38161850 msgr2=0x7f7d380ae8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.429+0000 7f7d3f64d640 1 --2- 172.21.15.132:0/2560363240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d38161850 0x7f7d380ae8d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f7d300090b0 tx=0x7f7d300046c0 comp rx=0 tx=0).stop 2023-12-20T04:42:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.429+0000 7f7d3f64d640 1 -- 172.21.15.132:0/2560363240 shutdown_connections 2023-12-20T04:42:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.429+0000 7f7d3f64d640 1 --2- 172.21.15.132:0/2560363240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7d2406a430 0x7f7d2406c8f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.429+0000 7f7d3f64d640 1 --2- 172.21.15.132:0/2560363240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7d38161850 0x7f7d380ae8d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.429+0000 7f7d3f64d640 1 --2- 172.21.15.132:0/2560363240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7d3815d100 0x7f7d380acb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.429+0000 7f7d3f64d640 1 --2- 172.21.15.132:0/2560363240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7d380d0370 0x7f7d381f38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.429+0000 7f7d3f64d640 1 -- 172.21.15.132:0/2560363240 >> 172.21.15.132:0/2560363240 conn(0x7f7d3806d7c0 msgr2=0x7f7d3815b750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.429+0000 7f7d3f64d640 1 -- 172.21.15.132:0/2560363240 shutdown_connections 2023-12-20T04:42:51.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:51.429+0000 7f7d3f64d640 1 -- 172.21.15.132:0/2560363240 wait complete. 2023-12-20T04:42:51.443 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":19,"stamp":"2023-12-20T04:42:50.093250+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1520,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560979,"statfs":{"total":1600000000,"available":1598443062,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.284258"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811868+0000","last_change":"2023-12-20T04:42:45.811868+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811868+0000","last_undegraded":"2023-12-20T04:42:45.811868+0000","last_fullsized":"2023-12-20T04:42:45.811868+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:31:43.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810682+0000","last_change":"2023-12-20T04:42:45.810682+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810682+0000","last_undegraded":"2023-12-20T04:42:45.810682+0000","last_fullsized":"2023-12-20T04:42:45.810682+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811827+0000","last_change":"2023-12-20T04:42:45.811827+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811827+0000","last_undegraded":"2023-12-20T04:42:45.811827+0000","last_fullsized":"2023-12-20T04:42:45.811827+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:16.851777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811795+0000","last_change":"2023-12-20T04:42:45.811795+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811795+0000","last_undegraded":"2023-12-20T04:42:45.811795+0000","last_fullsized":"2023-12-20T04:42:45.811795+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810766+0000","last_change":"2023-12-20T04:42:45.810766+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810766+0000","last_undegraded":"2023-12-20T04:42:45.810766+0000","last_fullsized":"2023-12-20T04:42:45.810766+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811538+0000","last_change":"2023-12-20T04:42:45.811538+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811538+0000","last_undegraded":"2023-12-20T04:42:45.811538+0000","last_fullsized":"2023-12-20T04:42:45.811538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.15","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811459+0000","last_change":"2023-12-20T04:42:45.811459+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811459+0000","last_undegraded":"2023-12-20T04:42:45.811459+0000","last_fullsized":"2023-12-20T04:42:45.811459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.14","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810714+0000","last_change":"2023-12-20T04:42:45.810714+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810714+0000","last_undegraded":"2023-12-20T04:42:45.810714+0000","last_fullsized":"2023-12-20T04:42:45.810714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.13","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.807707+0000","last_change":"2023-12-20T04:42:45.807707+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.807707+0000","last_undegraded":"2023-12-20T04:42:45.807707+0000","last_fullsized":"2023-12-20T04:42:45.807707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:45:29.219298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811532+0000","last_change":"2023-12-20T04:42:45.811532+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811532+0000","last_undegraded":"2023-12-20T04:42:45.811532+0000","last_fullsized":"2023-12-20T04:42:45.811532+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811351+0000","last_change":"2023-12-20T04:42:45.811351+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811351+0000","last_undegraded":"2023-12-20T04:42:45.811351+0000","last_fullsized":"2023-12-20T04:42:45.811351+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.10","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812664+0000","last_change":"2023-12-20T04:42:45.812664+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812664+0000","last_undegraded":"2023-12-20T04:42:45.812664+0000","last_fullsized":"2023-12-20T04:42:45.812664+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.808656+0000","last_change":"2023-12-20T04:42:45.808656+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.808656+0000","last_undegraded":"2023-12-20T04:42:45.808656+0000","last_fullsized":"2023-12-20T04:42:45.808656+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:46:37.703321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812327+0000","last_change":"2023-12-20T04:42:45.812327+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812327+0000","last_undegraded":"2023-12-20T04:42:45.812327+0000","last_fullsized":"2023-12-20T04:42:45.812327+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811507+0000","last_change":"2023-12-20T04:42:45.811507+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811507+0000","last_undegraded":"2023-12-20T04:42:45.811507+0000","last_fullsized":"2023-12-20T04:42:45.811507+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812419+0000","last_change":"2023-12-20T04:42:45.812419+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812419+0000","last_undegraded":"2023-12-20T04:42:45.812419+0000","last_fullsized":"2023-12-20T04:42:45.812419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":161,"reported_epoch":16,"state":"active+clean","last_fresh":"2023-12-20T04:42:41.100496+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:42:41.100496+0000","last_peered":"2023-12-20T04:42:41.100496+0000","last_clean":"2023-12-20T04:42:41.100496+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:42:41.100496+0000","last_undegraded":"2023-12-20T04:42:41.100496+0000","last_fullsized":"2023-12-20T04:42:41.100496+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811102+0000","last_change":"2023-12-20T04:42:45.811102+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811102+0000","last_undegraded":"2023-12-20T04:42:45.811102+0000","last_fullsized":"2023-12-20T04:42:45.811102+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.807944+0000","last_change":"2023-12-20T04:42:45.807944+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.807944+0000","last_undegraded":"2023-12-20T04:42:45.807944+0000","last_fullsized":"2023-12-20T04:42:45.807944+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812305+0000","last_change":"2023-12-20T04:42:45.812305+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812305+0000","last_undegraded":"2023-12-20T04:42:45.812305+0000","last_fullsized":"2023-12-20T04:42:45.812305+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:16.851777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811113+0000","last_change":"2023-12-20T04:42:45.811113+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811113+0000","last_undegraded":"2023-12-20T04:42:45.811113+0000","last_fullsized":"2023-12-20T04:42:45.811113+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810952+0000","last_change":"2023-12-20T04:42:45.810952+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810952+0000","last_undegraded":"2023-12-20T04:42:45.810952+0000","last_fullsized":"2023-12-20T04:42:45.810952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.808525+0000","last_change":"2023-12-20T04:42:45.808525+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.808525+0000","last_undegraded":"2023-12-20T04:42:45.808525+0000","last_fullsized":"2023-12-20T04:42:45.808525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810950+0000","last_change":"2023-12-20T04:42:45.810950+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810950+0000","last_undegraded":"2023-12-20T04:42:45.810950+0000","last_fullsized":"2023-12-20T04:42:45.810950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.810713+0000","last_change":"2023-12-20T04:42:45.810713+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.810713+0000","last_undegraded":"2023-12-20T04:42:45.810713+0000","last_fullsized":"2023-12-20T04:42:45.810713+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.808540+0000","last_change":"2023-12-20T04:42:45.808540+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.808540+0000","last_undegraded":"2023-12-20T04:42:45.808540+0000","last_fullsized":"2023-12-20T04:42:45.808540+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811336+0000","last_change":"2023-12-20T04:42:45.811336+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811336+0000","last_undegraded":"2023-12-20T04:42:45.811336+0000","last_fullsized":"2023-12-20T04:42:45.811336+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.811602+0000","last_change":"2023-12-20T04:42:45.811602+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.811602+0000","last_undegraded":"2023-12-20T04:42:45.811602+0000","last_fullsized":"2023-12-20T04:42:45.811602+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.b","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.809002+0000","last_change":"2023-12-20T04:42:45.809002+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.809002+0000","last_undegraded":"2023-12-20T04:42:45.809002+0000","last_fullsized":"2023-12-20T04:42:45.809002+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1c","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.809065+0000","last_change":"2023-12-20T04:42:45.809065+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.809065+0000","last_undegraded":"2023-12-20T04:42:45.809065+0000","last_fullsized":"2023-12-20T04:42:45.809065+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:50.327147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1d","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.809676+0000","last_change":"2023-12-20T04:42:45.809676+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.809676+0000","last_undegraded":"2023-12-20T04:42:45.809676+0000","last_fullsized":"2023-12-20T04:42:45.809676+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:57:22.907798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1e","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.812183+0000","last_change":"2023-12-20T04:42:45.812183+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.812183+0000","last_undegraded":"2023-12-20T04:42:45.812183+0000","last_fullsized":"2023-12-20T04:42:45.812183+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:42:46.806803+0000","last_change":"2023-12-20T04:42:46.806803+0000","last_active":"2023-12-20T04:42:46.806803+0000","last_peered":"2023-12-20T04:42:46.806803+0000","last_clean":"2023-12-20T04:42:46.806803+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:46.806803+0000","last_undegraded":"2023-12-20T04:42:46.806803+0000","last_fullsized":"2023-12-20T04:42:46.806803+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"2.1f","version":"0'0","reported_seq":1,"reported_epoch":17,"state":"creating+peering","last_fresh":"2023-12-20T04:42:45.807707+0000","last_change":"2023-12-20T04:42:45.807707+0000","last_active":"2023-12-20T04:42:45.800195+0000","last_peered":"2023-12-20T04:42:45.800195+0000","last_clean":"2023-12-20T04:42:45.800195+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:42:45.807707+0000","last_undegraded":"2023-12-20T04:42:45.807707+0000","last_fullsized":"2023-12-20T04:42:45.807707+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:46:37.703321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":621,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194691,"statfs":{"total":200000000,"available":199364061,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59899999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64600000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69099999999999995}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.74299999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63200000000000001}]}]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55300000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51000000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46200000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72399999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68700000000000006}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63500000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57699999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.55200000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53500000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39900000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34300000000000003}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28499999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.219}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27500000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.378}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51300000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574851,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":44,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195267,"statfs":{"total":200000000,"available":199954429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23599999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.17999999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.22}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":50,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195262,"statfs":{"total":200000000,"available":199948612,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52200000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69299999999999995}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.625}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574851,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":626,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194685,"statfs":{"total":200000000,"available":199358244,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30399999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29199999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41499999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.436}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47699999999999998}]}]}],"pool_statfs":[]}} 2023-12-20T04:42:52.097 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-12-20T04:42:52.096+0000 7f26ea756640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:42:54.449 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:42:54.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.559+0000 7fc671b88640 1 Processor -- start 2023-12-20T04:42:54.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.559+0000 7fc671b88640 1 -- start start 2023-12-20T04:42:54.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.560+0000 7fc671b88640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c13df60 0x7fc66c0caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:54.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.560+0000 7fc671b88640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc66c13e690 0x7fc66c069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:54.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.560+0000 7fc671b88640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc66c141660 con 0x7fc66c06a170 2023-12-20T04:42:54.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.560+0000 7fc671b88640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc66c155a30 con 0x7fc66c13e690 2023-12-20T04:42:54.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.560+0000 7fc671b88640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c06a600 con 0x7fc66c13df60 2023-12-20T04:42:54.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.560+0000 7fc66b7fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c13df60 0x7fc66c0caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.560+0000 7fc66affd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc66c13e690 0x7fc66c069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.560+0000 7fc66b7fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c13df60 0x7fc66c0caa20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:52258/0 (socket says 172.21.15.132:52258) 2023-12-20T04:42:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.560+0000 7fc66b7fe640 1 -- 172.21.15.132:0/2847338648 learned_addr learned my addr 172.21.15.132:0/2847338648 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.561+0000 7fc66b7fe640 1 -- 172.21.15.132:0/2847338648 >> v2:172.21.15.187:3300/0 conn(0x7fc66c13e690 msgr2=0x7fc66c069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.561+0000 7fc66b7fe640 1 --2- 172.21.15.132:0/2847338648 >> v2:172.21.15.187:3300/0 conn(0x7fc66c13e690 0x7fc66c069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.561+0000 7fc66b7fe640 1 -- 172.21.15.132:0/2847338648 >> v1:172.21.15.187:6789/0 conn(0x7fc66c06a170 legacy=0x7fc66c0708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.561+0000 7fc66b7fe640 1 -- 172.21.15.132:0/2847338648 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc66c0caf60 con 0x7fc66c13df60 2023-12-20T04:42:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.561+0000 7fc66b7fe640 1 --2- 172.21.15.132:0/2847338648 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c13df60 0x7fc66c0caa20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc65c009850 tx=0x7fc65c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e66bc75dc2303804 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.562+0000 7fc66a7fc640 1 -- 172.21.15.132:0/2847338648 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c004230 con 0x7fc66c13df60 2023-12-20T04:42:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.562+0000 7fc66a7fc640 1 -- 172.21.15.132:0/2847338648 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc65c004390 con 0x7fc66c13df60 2023-12-20T04:42:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.562+0000 7fc66a7fc640 1 -- 172.21.15.132:0/2847338648 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc65c031830 con 0x7fc66c13df60 2023-12-20T04:42:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.562+0000 7fc671b88640 1 -- 172.21.15.132:0/2847338648 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c13df60 msgr2=0x7fc66c0caa20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.562+0000 7fc671b88640 1 --2- 172.21.15.132:0/2847338648 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c13df60 0x7fc66c0caa20 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7fc65c009850 tx=0x7fc65c02b8d0 comp rx=0 tx=0).stop 2023-12-20T04:42:54.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.562+0000 7fc671b88640 1 -- 172.21.15.132:0/2847338648 shutdown_connections 2023-12-20T04:42:54.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.562+0000 7fc671b88640 1 --2- 172.21.15.132:0/2847338648 >> v2:172.21.15.187:3300/0 conn(0x7fc66c13e690 0x7fc66c069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:54.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.562+0000 7fc671b88640 1 --2- 172.21.15.132:0/2847338648 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c13df60 0x7fc66c0caa20 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:54.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.562+0000 7fc671b88640 1 -- 172.21.15.132:0/2847338648 >> 172.21.15.132:0/2847338648 conn(0x7fc66c0cfbd0 msgr2=0x7fc66c0cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:54.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.562+0000 7fc671b88640 1 -- 172.21.15.132:0/2847338648 shutdown_connections 2023-12-20T04:42:54.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.562+0000 7fc671b88640 1 -- 172.21.15.132:0/2847338648 wait complete. 2023-12-20T04:42:54.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.563+0000 7fc671b88640 1 Processor -- start 2023-12-20T04:42:54.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.564+0000 7fc671b88640 1 -- start start 2023-12-20T04:42:54.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.564+0000 7fc671b88640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66c06a170 0x7fc66c128c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:54.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.564+0000 7fc671b88640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc66c13df60 0x7fc66c129170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:54.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.564+0000 7fc671b88640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c13e690 0x7fc66c1296b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:54.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.564+0000 7fc671b88640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c142330 con 0x7fc66c13df60 2023-12-20T04:42:54.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.564+0000 7fc671b88640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c142610 con 0x7fc66c06a170 2023-12-20T04:42:54.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.564+0000 7fc671b88640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc66c1428f0 con 0x7fc66c13e690 2023-12-20T04:42:54.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.564+0000 7fc66affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc66c13df60 0x7fc66c129170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:54.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.564+0000 7fc66affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc66c13df60 0x7fc66c129170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49088/0 (socket says 172.21.15.132:49088) 2023-12-20T04:42:54.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.564+0000 7fc66affd640 1 -- 172.21.15.132:0/4170275362 learned_addr learned my addr 172.21.15.132:0/4170275362 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:54.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.565+0000 7fc66b7fe640 1 --2- 172.21.15.132:0/4170275362 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66c06a170 0x7fc66c128c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:54.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.565+0000 7fc66bfff640 1 --2- 172.21.15.132:0/4170275362 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c13e690 0x7fc66c1296b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:54.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.565+0000 7fc66affd640 1 -- 172.21.15.132:0/4170275362 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c13e690 msgr2=0x7fc66c1296b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:54.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.565+0000 7fc66affd640 1 --2- 172.21.15.132:0/4170275362 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c13e690 0x7fc66c1296b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:54.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.565+0000 7fc66affd640 1 -- 172.21.15.132:0/4170275362 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66c06a170 msgr2=0x7fc66c128c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:54.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.565+0000 7fc66affd640 1 --2- 172.21.15.132:0/4170275362 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66c06a170 0x7fc66c128c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:54.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.565+0000 7fc66affd640 1 -- 172.21.15.132:0/4170275362 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc65c009460 con 0x7fc66c13df60 2023-12-20T04:42:54.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.565+0000 7fc66affd640 1 --2- 172.21.15.132:0/4170275362 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc66c13df60 0x7fc66c129170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc66000e870 tx=0x7fc66000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:54.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.565+0000 7fc653fff640 1 -- 172.21.15.132:0/4170275362 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6600094f0 con 0x7fc66c13df60 2023-12-20T04:42:54.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.565+0000 7fc653fff640 1 -- 172.21.15.132:0/4170275362 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc66000c940 con 0x7fc66c13df60 2023-12-20T04:42:54.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.565+0000 7fc671b88640 1 -- 172.21.15.132:0/4170275362 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc66c142bd0 con 0x7fc66c13df60 2023-12-20T04:42:54.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.565+0000 7fc653fff640 1 -- 172.21.15.132:0/4170275362 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc66000ccf0 con 0x7fc66c13df60 2023-12-20T04:42:54.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.565+0000 7fc671b88640 1 -- 172.21.15.132:0/4170275362 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc66c1f0aa0 con 0x7fc66c13df60 2023-12-20T04:42:54.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.566+0000 7fc671b88640 1 -- 172.21.15.132:0/4170275362 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc66c04e840 con 0x7fc66c13df60 2023-12-20T04:42:54.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.567+0000 7fc653fff640 1 -- 172.21.15.132:0/4170275362 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc660013470 con 0x7fc66c13df60 2023-12-20T04:42:54.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.567+0000 7fc653fff640 1 --2- 172.21.15.132:0/4170275362 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc65806a430 0x7fc65806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:54.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.567+0000 7fc66b7fe640 1 --2- 172.21.15.132:0/4170275362 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc65806a430 0x7fc65806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:54.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.567+0000 7fc653fff640 1 -- 172.21.15.132:0/4170275362 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc660088970 con 0x7fc66c13df60 2023-12-20T04:42:54.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.568+0000 7fc66b7fe640 1 --2- 172.21.15.132:0/4170275362 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc65806a430 0x7fc65806c8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc65c035000 tx=0x7fc65c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:54.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.571+0000 7fc653fff640 1 -- 172.21.15.132:0/4170275362 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc660053f90 con 0x7fc66c13df60 2023-12-20T04:42:54.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.735+0000 7fc671b88640 1 -- 172.21.15.132:0/4170275362 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc66c142780 con 0x7fc65806a430 2023-12-20T04:42:54.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.741+0000 7fc653fff640 1 -- 172.21.15.132:0/4170275362 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260197 (secure 0 0 0) 0x7fc66c142780 con 0x7fc65806a430 2023-12-20T04:42:54.744 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:54.745 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:42:54.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.744+0000 7fc671b88640 1 -- 172.21.15.132:0/4170275362 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc65806a430 msgr2=0x7fc65806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:54.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.744+0000 7fc671b88640 1 --2- 172.21.15.132:0/4170275362 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc65806a430 0x7fc65806c8f0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fc65c035000 tx=0x7fc65c008030 comp rx=0 tx=0).stop 2023-12-20T04:42:54.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.744+0000 7fc671b88640 1 -- 172.21.15.132:0/4170275362 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc66c13df60 msgr2=0x7fc66c129170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:54.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.744+0000 7fc671b88640 1 --2- 172.21.15.132:0/4170275362 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc66c13df60 0x7fc66c129170 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fc66000e870 tx=0x7fc66000ed30 comp rx=0 tx=0).stop 2023-12-20T04:42:54.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.744+0000 7fc671b88640 1 -- 172.21.15.132:0/4170275362 shutdown_connections 2023-12-20T04:42:54.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.744+0000 7fc671b88640 1 --2- 172.21.15.132:0/4170275362 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc65806a430 0x7fc65806c8f0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:54.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.744+0000 7fc671b88640 1 --2- 172.21.15.132:0/4170275362 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc66c13e690 0x7fc66c1296b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:54.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.744+0000 7fc671b88640 1 --2- 172.21.15.132:0/4170275362 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc66c13df60 0x7fc66c129170 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:54.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.744+0000 7fc671b88640 1 --2- 172.21.15.132:0/4170275362 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc66c06a170 0x7fc66c128c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:54.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.744+0000 7fc671b88640 1 -- 172.21.15.132:0/4170275362 >> 172.21.15.132:0/4170275362 conn(0x7fc66c0cfbd0 msgr2=0x7fc66c065910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:54.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.744+0000 7fc671b88640 1 -- 172.21.15.132:0/4170275362 shutdown_connections 2023-12-20T04:42:54.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.744+0000 7fc671b88640 1 -- 172.21.15.132:0/4170275362 wait complete. 2023-12-20T04:42:54.755 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":21,"stamp":"2023-12-20T04:42:54.094209+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":169,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.282402"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271408+0000","last_change":"2023-12-20T04:42:47.172892+0000","last_active":"2023-12-20T04:42:50.271408+0000","last_peered":"2023-12-20T04:42:50.271408+0000","last_clean":"2023-12-20T04:42:50.271408+0000","last_became_active":"2023-12-20T04:42:47.172487+0000","last_became_peered":"2023-12-20T04:42:47.172487+0000","last_unstale":"2023-12-20T04:42:50.271408+0000","last_undegraded":"2023-12-20T04:42:50.271408+0000","last_fullsized":"2023-12-20T04:42:50.271408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:58:34.559072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270445+0000","last_change":"2023-12-20T04:42:47.157323+0000","last_active":"2023-12-20T04:42:50.270445+0000","last_peered":"2023-12-20T04:42:50.270445+0000","last_clean":"2023-12-20T04:42:50.270445+0000","last_became_active":"2023-12-20T04:42:47.157120+0000","last_became_peered":"2023-12-20T04:42:47.157120+0000","last_unstale":"2023-12-20T04:42:50.270445+0000","last_undegraded":"2023-12-20T04:42:50.270445+0000","last_fullsized":"2023-12-20T04:42:50.270445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:56:01.988189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159802+0000","last_change":"2023-12-20T04:42:47.157566+0000","last_active":"2023-12-20T04:42:48.159802+0000","last_peered":"2023-12-20T04:42:48.159802+0000","last_clean":"2023-12-20T04:42:48.159802+0000","last_became_active":"2023-12-20T04:42:47.157364+0000","last_became_peered":"2023-12-20T04:42:47.157364+0000","last_unstale":"2023-12-20T04:42:48.159802+0000","last_undegraded":"2023-12-20T04:42:48.159802+0000","last_fullsized":"2023-12-20T04:42:48.159802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:22.324414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270992+0000","last_change":"2023-12-20T04:42:47.162525+0000","last_active":"2023-12-20T04:42:50.270992+0000","last_peered":"2023-12-20T04:42:50.270992+0000","last_clean":"2023-12-20T04:42:50.270992+0000","last_became_active":"2023-12-20T04:42:47.162288+0000","last_became_peered":"2023-12-20T04:42:47.162288+0000","last_unstale":"2023-12-20T04:42:50.270992+0000","last_undegraded":"2023-12-20T04:42:50.270992+0000","last_fullsized":"2023-12-20T04:42:50.270992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:43:18.176211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271016+0000","last_change":"2023-12-20T04:42:47.170675+0000","last_active":"2023-12-20T04:42:50.271016+0000","last_peered":"2023-12-20T04:42:50.271016+0000","last_clean":"2023-12-20T04:42:50.271016+0000","last_became_active":"2023-12-20T04:42:47.170447+0000","last_became_peered":"2023-12-20T04:42:47.170447+0000","last_unstale":"2023-12-20T04:42:50.271016+0000","last_undegraded":"2023-12-20T04:42:50.271016+0000","last_fullsized":"2023-12-20T04:42:50.271016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:32:36.919150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271060+0000","last_change":"2023-12-20T04:42:47.161917+0000","last_active":"2023-12-20T04:42:50.271060+0000","last_peered":"2023-12-20T04:42:50.271060+0000","last_clean":"2023-12-20T04:42:50.271060+0000","last_became_active":"2023-12-20T04:42:47.161408+0000","last_became_peered":"2023-12-20T04:42:47.161408+0000","last_unstale":"2023-12-20T04:42:50.271060+0000","last_undegraded":"2023-12-20T04:42:50.271060+0000","last_fullsized":"2023-12-20T04:42:50.271060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:14.550271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271240+0000","last_change":"2023-12-20T04:42:47.170652+0000","last_active":"2023-12-20T04:42:50.271240+0000","last_peered":"2023-12-20T04:42:50.271240+0000","last_clean":"2023-12-20T04:42:50.271240+0000","last_became_active":"2023-12-20T04:42:47.169793+0000","last_became_peered":"2023-12-20T04:42:47.169793+0000","last_unstale":"2023-12-20T04:42:50.271240+0000","last_undegraded":"2023-12-20T04:42:50.271240+0000","last_fullsized":"2023-12-20T04:42:50.271240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:21:51.595583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.161981+0000","last_change":"2023-12-20T04:42:47.162013+0000","last_active":"2023-12-20T04:42:48.161981+0000","last_peered":"2023-12-20T04:42:48.161981+0000","last_clean":"2023-12-20T04:42:48.161981+0000","last_became_active":"2023-12-20T04:42:47.161508+0000","last_became_peered":"2023-12-20T04:42:47.161508+0000","last_unstale":"2023-12-20T04:42:48.161981+0000","last_undegraded":"2023-12-20T04:42:48.161981+0000","last_fullsized":"2023-12-20T04:42:48.161981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:32:36.919150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270807+0000","last_change":"2023-12-20T04:42:47.172593+0000","last_active":"2023-12-20T04:42:50.270807+0000","last_peered":"2023-12-20T04:42:50.270807+0000","last_clean":"2023-12-20T04:42:50.270807+0000","last_became_active":"2023-12-20T04:42:47.172365+0000","last_became_peered":"2023-12-20T04:42:47.172365+0000","last_unstale":"2023-12-20T04:42:50.270807+0000","last_undegraded":"2023-12-20T04:42:50.270807+0000","last_fullsized":"2023-12-20T04:42:50.270807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:43:18.176211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210109+0000","last_change":"2023-12-20T04:42:47.174800+0000","last_active":"2023-12-20T04:42:50.210109+0000","last_peered":"2023-12-20T04:42:50.210109+0000","last_clean":"2023-12-20T04:42:50.210109+0000","last_became_active":"2023-12-20T04:42:47.173945+0000","last_became_peered":"2023-12-20T04:42:47.173945+0000","last_unstale":"2023-12-20T04:42:50.210109+0000","last_undegraded":"2023-12-20T04:42:50.210109+0000","last_fullsized":"2023-12-20T04:42:50.210109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:06:51.757769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210076+0000","last_change":"2023-12-20T04:42:47.175065+0000","last_active":"2023-12-20T04:42:50.210076+0000","last_peered":"2023-12-20T04:42:50.210076+0000","last_clean":"2023-12-20T04:42:50.210076+0000","last_became_active":"2023-12-20T04:42:47.174727+0000","last_became_peered":"2023-12-20T04:42:47.174727+0000","last_unstale":"2023-12-20T04:42:50.210076+0000","last_undegraded":"2023-12-20T04:42:50.210076+0000","last_fullsized":"2023-12-20T04:42:50.210076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:26:45.550542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160074+0000","last_change":"2023-12-20T04:42:47.173698+0000","last_active":"2023-12-20T04:42:48.160074+0000","last_peered":"2023-12-20T04:42:48.160074+0000","last_clean":"2023-12-20T04:42:48.160074+0000","last_became_active":"2023-12-20T04:42:47.173475+0000","last_became_peered":"2023-12-20T04:42:47.173475+0000","last_unstale":"2023-12-20T04:42:48.160074+0000","last_undegraded":"2023-12-20T04:42:48.160074+0000","last_fullsized":"2023-12-20T04:42:48.160074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:51.333755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162603+0000","last_change":"2023-12-20T04:42:47.173376+0000","last_active":"2023-12-20T04:42:48.162603+0000","last_peered":"2023-12-20T04:42:48.162603+0000","last_clean":"2023-12-20T04:42:48.162603+0000","last_became_active":"2023-12-20T04:42:47.173161+0000","last_became_peered":"2023-12-20T04:42:47.173161+0000","last_unstale":"2023-12-20T04:42:48.162603+0000","last_undegraded":"2023-12-20T04:42:48.162603+0000","last_fullsized":"2023-12-20T04:42:48.162603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:36:59.141749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159777+0000","last_change":"2023-12-20T04:42:47.158093+0000","last_active":"2023-12-20T04:42:48.159777+0000","last_peered":"2023-12-20T04:42:48.159777+0000","last_clean":"2023-12-20T04:42:48.159777+0000","last_became_active":"2023-12-20T04:42:47.157875+0000","last_became_peered":"2023-12-20T04:42:47.157875+0000","last_unstale":"2023-12-20T04:42:48.159777+0000","last_undegraded":"2023-12-20T04:42:48.159777+0000","last_fullsized":"2023-12-20T04:42:48.159777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:16:25.525832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270765+0000","last_change":"2023-12-20T04:42:47.162450+0000","last_active":"2023-12-20T04:42:50.270765+0000","last_peered":"2023-12-20T04:42:50.270765+0000","last_clean":"2023-12-20T04:42:50.270765+0000","last_became_active":"2023-12-20T04:42:47.162241+0000","last_became_peered":"2023-12-20T04:42:47.162241+0000","last_unstale":"2023-12-20T04:42:50.270765+0000","last_undegraded":"2023-12-20T04:42:50.270765+0000","last_fullsized":"2023-12-20T04:42:50.270765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:06:51.757769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270959+0000","last_change":"2023-12-20T04:42:47.161716+0000","last_active":"2023-12-20T04:42:50.270959+0000","last_peered":"2023-12-20T04:42:50.270959+0000","last_clean":"2023-12-20T04:42:50.270959+0000","last_became_active":"2023-12-20T04:42:47.160957+0000","last_became_peered":"2023-12-20T04:42:47.160957+0000","last_unstale":"2023-12-20T04:42:50.270959+0000","last_undegraded":"2023-12-20T04:42:50.270959+0000","last_fullsized":"2023-12-20T04:42:50.270959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:19:34.422422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270634+0000","last_change":"2023-12-20T04:42:47.171037+0000","last_active":"2023-12-20T04:42:50.270634+0000","last_peered":"2023-12-20T04:42:50.270634+0000","last_clean":"2023-12-20T04:42:50.270634+0000","last_became_active":"2023-12-20T04:42:47.169708+0000","last_became_peered":"2023-12-20T04:42:47.169708+0000","last_unstale":"2023-12-20T04:42:50.270634+0000","last_undegraded":"2023-12-20T04:42:50.270634+0000","last_fullsized":"2023-12-20T04:42:50.270634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:21:51.595583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270756+0000","last_change":"2023-12-20T04:42:47.170134+0000","last_active":"2023-12-20T04:42:50.270756+0000","last_peered":"2023-12-20T04:42:50.270756+0000","last_clean":"2023-12-20T04:42:50.270756+0000","last_became_active":"2023-12-20T04:42:47.169981+0000","last_became_peered":"2023-12-20T04:42:47.169981+0000","last_unstale":"2023-12-20T04:42:50.270756+0000","last_undegraded":"2023-12-20T04:42:50.270756+0000","last_fullsized":"2023-12-20T04:42:50.270756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:36:27.559291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271028+0000","last_change":"2023-12-20T04:42:47.175894+0000","last_active":"2023-12-20T04:42:50.271028+0000","last_peered":"2023-12-20T04:42:50.271028+0000","last_clean":"2023-12-20T04:42:50.271028+0000","last_became_active":"2023-12-20T04:42:47.175537+0000","last_became_peered":"2023-12-20T04:42:47.175537+0000","last_unstale":"2023-12-20T04:42:50.271028+0000","last_undegraded":"2023-12-20T04:42:50.271028+0000","last_fullsized":"2023-12-20T04:42:50.271028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:30:36.340710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210255+0000","last_change":"2023-12-20T04:42:47.171952+0000","last_active":"2023-12-20T04:42:50.210255+0000","last_peered":"2023-12-20T04:42:50.210255+0000","last_clean":"2023-12-20T04:42:50.210255+0000","last_became_active":"2023-12-20T04:42:47.171750+0000","last_became_peered":"2023-12-20T04:42:47.171750+0000","last_unstale":"2023-12-20T04:42:50.210255+0000","last_undegraded":"2023-12-20T04:42:50.210255+0000","last_fullsized":"2023-12-20T04:42:50.210255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:35.275699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159981+0000","last_change":"2023-12-20T04:42:47.172461+0000","last_active":"2023-12-20T04:42:48.159981+0000","last_peered":"2023-12-20T04:42:48.159981+0000","last_clean":"2023-12-20T04:42:48.159981+0000","last_became_active":"2023-12-20T04:42:47.172294+0000","last_became_peered":"2023-12-20T04:42:47.172294+0000","last_unstale":"2023-12-20T04:42:48.159981+0000","last_undegraded":"2023-12-20T04:42:48.159981+0000","last_fullsized":"2023-12-20T04:42:48.159981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:35.275699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270887+0000","last_change":"2023-12-20T04:42:47.171292+0000","last_active":"2023-12-20T04:42:50.270887+0000","last_peered":"2023-12-20T04:42:50.270887+0000","last_clean":"2023-12-20T04:42:50.270887+0000","last_became_active":"2023-12-20T04:42:47.170762+0000","last_became_peered":"2023-12-20T04:42:47.170762+0000","last_unstale":"2023-12-20T04:42:50.270887+0000","last_undegraded":"2023-12-20T04:42:50.270887+0000","last_fullsized":"2023-12-20T04:42:50.270887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:36:59.141749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162359+0000","last_change":"2023-12-20T04:42:47.163401+0000","last_active":"2023-12-20T04:42:48.162359+0000","last_peered":"2023-12-20T04:42:48.162359+0000","last_clean":"2023-12-20T04:42:48.162359+0000","last_became_active":"2023-12-20T04:42:47.162913+0000","last_became_peered":"2023-12-20T04:42:47.162913+0000","last_unstale":"2023-12-20T04:42:48.162359+0000","last_undegraded":"2023-12-20T04:42:48.162359+0000","last_fullsized":"2023-12-20T04:42:48.162359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:26:45.550542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271131+0000","last_change":"2023-12-20T04:42:47.163326+0000","last_active":"2023-12-20T04:42:50.271131+0000","last_peered":"2023-12-20T04:42:50.271131+0000","last_clean":"2023-12-20T04:42:50.271131+0000","last_became_active":"2023-12-20T04:42:47.162735+0000","last_became_peered":"2023-12-20T04:42:47.162735+0000","last_unstale":"2023-12-20T04:42:50.271131+0000","last_undegraded":"2023-12-20T04:42:50.271131+0000","last_fullsized":"2023-12-20T04:42:50.271131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:25:43.498709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162147+0000","last_change":"2023-12-20T04:42:47.163875+0000","last_active":"2023-12-20T04:42:48.162147+0000","last_peered":"2023-12-20T04:42:48.162147+0000","last_clean":"2023-12-20T04:42:48.162147+0000","last_became_active":"2023-12-20T04:42:47.163660+0000","last_became_peered":"2023-12-20T04:42:47.163660+0000","last_unstale":"2023-12-20T04:42:48.162147+0000","last_undegraded":"2023-12-20T04:42:48.162147+0000","last_fullsized":"2023-12-20T04:42:48.162147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:44:36.145099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210189+0000","last_change":"2023-12-20T04:42:47.171538+0000","last_active":"2023-12-20T04:42:50.210189+0000","last_peered":"2023-12-20T04:42:50.210189+0000","last_clean":"2023-12-20T04:42:50.210189+0000","last_became_active":"2023-12-20T04:42:47.171331+0000","last_became_peered":"2023-12-20T04:42:47.171331+0000","last_unstale":"2023-12-20T04:42:50.210189+0000","last_undegraded":"2023-12-20T04:42:50.210189+0000","last_fullsized":"2023-12-20T04:42:50.210189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:06:04.707201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270540+0000","last_change":"2023-12-20T04:42:47.158991+0000","last_active":"2023-12-20T04:42:50.270540+0000","last_peered":"2023-12-20T04:42:50.270540+0000","last_clean":"2023-12-20T04:42:50.270540+0000","last_became_active":"2023-12-20T04:42:47.158764+0000","last_became_peered":"2023-12-20T04:42:47.158764+0000","last_unstale":"2023-12-20T04:42:50.270540+0000","last_undegraded":"2023-12-20T04:42:50.270540+0000","last_fullsized":"2023-12-20T04:42:50.270540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:44:36.145099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162479+0000","last_change":"2023-12-20T04:42:47.164066+0000","last_active":"2023-12-20T04:42:48.162479+0000","last_peered":"2023-12-20T04:42:48.162479+0000","last_clean":"2023-12-20T04:42:48.162479+0000","last_became_active":"2023-12-20T04:42:47.163199+0000","last_became_peered":"2023-12-20T04:42:47.163199+0000","last_unstale":"2023-12-20T04:42:48.162479+0000","last_undegraded":"2023-12-20T04:42:48.162479+0000","last_fullsized":"2023-12-20T04:42:48.162479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:06:51.757769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159867+0000","last_change":"2023-12-20T04:42:47.160204+0000","last_active":"2023-12-20T04:42:48.159867+0000","last_peered":"2023-12-20T04:42:48.159867+0000","last_clean":"2023-12-20T04:42:48.159867+0000","last_became_active":"2023-12-20T04:42:47.159938+0000","last_became_peered":"2023-12-20T04:42:47.159938+0000","last_unstale":"2023-12-20T04:42:48.159867+0000","last_undegraded":"2023-12-20T04:42:48.159867+0000","last_fullsized":"2023-12-20T04:42:48.159867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:44:36.145099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270898+0000","last_change":"2023-12-20T04:42:47.158942+0000","last_active":"2023-12-20T04:42:50.270898+0000","last_peered":"2023-12-20T04:42:50.270898+0000","last_clean":"2023-12-20T04:42:50.270898+0000","last_became_active":"2023-12-20T04:42:47.158714+0000","last_became_peered":"2023-12-20T04:42:47.158714+0000","last_unstale":"2023-12-20T04:42:50.270898+0000","last_undegraded":"2023-12-20T04:42:50.270898+0000","last_fullsized":"2023-12-20T04:42:50.270898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:05.054526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270809+0000","last_change":"2023-12-20T04:42:47.162973+0000","last_active":"2023-12-20T04:42:50.270809+0000","last_peered":"2023-12-20T04:42:50.270809+0000","last_clean":"2023-12-20T04:42:50.270809+0000","last_became_active":"2023-12-20T04:42:47.162767+0000","last_became_peered":"2023-12-20T04:42:47.162767+0000","last_unstale":"2023-12-20T04:42:50.270809+0000","last_undegraded":"2023-12-20T04:42:50.270809+0000","last_fullsized":"2023-12-20T04:42:50.270809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:51.333755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210131+0000","last_change":"2023-12-20T04:42:47.173155+0000","last_active":"2023-12-20T04:42:50.210131+0000","last_peered":"2023-12-20T04:42:50.210131+0000","last_clean":"2023-12-20T04:42:50.210131+0000","last_became_active":"2023-12-20T04:42:47.172736+0000","last_became_peered":"2023-12-20T04:42:47.172736+0000","last_unstale":"2023-12-20T04:42:50.210131+0000","last_undegraded":"2023-12-20T04:42:50.210131+0000","last_fullsized":"2023-12-20T04:42:50.210131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:44:36.145099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160135+0000","last_change":"2023-12-20T04:42:47.162810+0000","last_active":"2023-12-20T04:42:48.160135+0000","last_peered":"2023-12-20T04:42:48.160135+0000","last_clean":"2023-12-20T04:42:48.160135+0000","last_became_active":"2023-12-20T04:42:47.162466+0000","last_became_peered":"2023-12-20T04:42:47.162466+0000","last_unstale":"2023-12-20T04:42:48.160135+0000","last_undegraded":"2023-12-20T04:42:48.160135+0000","last_fullsized":"2023-12-20T04:42:48.160135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:07.145100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.176214+0000","last_change":"2023-12-20T04:42:46.820730+0000","last_active":"2023-12-20T04:42:47.176214+0000","last_peered":"2023-12-20T04:42:47.176214+0000","last_clean":"2023-12-20T04:42:47.176214+0000","last_became_active":"2023-12-20T04:42:46.820359+0000","last_became_peered":"2023-12-20T04:42:46.820359+0000","last_unstale":"2023-12-20T04:42:47.176214+0000","last_undegraded":"2023-12-20T04:42:47.176214+0000","last_fullsized":"2023-12-20T04:42:47.176214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:31:43.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159914+0000","last_change":"2023-12-20T04:42:47.162872+0000","last_active":"2023-12-20T04:42:48.159914+0000","last_peered":"2023-12-20T04:42:48.159914+0000","last_clean":"2023-12-20T04:42:48.159914+0000","last_became_active":"2023-12-20T04:42:47.162666+0000","last_became_peered":"2023-12-20T04:42:47.162666+0000","last_unstale":"2023-12-20T04:42:48.159914+0000","last_undegraded":"2023-12-20T04:42:48.159914+0000","last_fullsized":"2023-12-20T04:42:48.159914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:06:04.707201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.171213+0000","last_change":"2023-12-20T04:42:46.824209+0000","last_active":"2023-12-20T04:42:47.171213+0000","last_peered":"2023-12-20T04:42:47.171213+0000","last_clean":"2023-12-20T04:42:47.171213+0000","last_became_active":"2023-12-20T04:42:46.823998+0000","last_became_peered":"2023-12-20T04:42:46.823998+0000","last_unstale":"2023-12-20T04:42:47.171213+0000","last_undegraded":"2023-12-20T04:42:47.171213+0000","last_fullsized":"2023-12-20T04:42:47.171213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.158401+0000","last_change":"2023-12-20T04:42:46.826875+0000","last_active":"2023-12-20T04:42:47.158401+0000","last_peered":"2023-12-20T04:42:47.158401+0000","last_clean":"2023-12-20T04:42:47.158401+0000","last_became_active":"2023-12-20T04:42:46.826615+0000","last_became_peered":"2023-12-20T04:42:46.826615+0000","last_unstale":"2023-12-20T04:42:47.158401+0000","last_undegraded":"2023-12-20T04:42:47.158401+0000","last_fullsized":"2023-12-20T04:42:47.158401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:16.851777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162225+0000","last_change":"2023-12-20T04:42:47.161608+0000","last_active":"2023-12-20T04:42:48.162225+0000","last_peered":"2023-12-20T04:42:48.162225+0000","last_clean":"2023-12-20T04:42:48.162225+0000","last_became_active":"2023-12-20T04:42:47.161405+0000","last_became_peered":"2023-12-20T04:42:47.161405+0000","last_unstale":"2023-12-20T04:42:48.162225+0000","last_undegraded":"2023-12-20T04:42:48.162225+0000","last_fullsized":"2023-12-20T04:42:48.162225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:35.275699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.156329+0000","last_change":"2023-12-20T04:42:46.818215+0000","last_active":"2023-12-20T04:42:47.156329+0000","last_peered":"2023-12-20T04:42:47.156329+0000","last_clean":"2023-12-20T04:42:47.156329+0000","last_became_active":"2023-12-20T04:42:46.817966+0000","last_became_peered":"2023-12-20T04:42:46.817966+0000","last_unstale":"2023-12-20T04:42:47.156329+0000","last_undegraded":"2023-12-20T04:42:47.156329+0000","last_fullsized":"2023-12-20T04:42:47.156329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270511+0000","last_change":"2023-12-20T04:42:47.162162+0000","last_active":"2023-12-20T04:42:50.270511+0000","last_peered":"2023-12-20T04:42:50.270511+0000","last_clean":"2023-12-20T04:42:50.270511+0000","last_became_active":"2023-12-20T04:42:47.161952+0000","last_became_peered":"2023-12-20T04:42:47.161952+0000","last_unstale":"2023-12-20T04:42:50.270511+0000","last_undegraded":"2023-12-20T04:42:50.270511+0000","last_fullsized":"2023-12-20T04:42:50.270511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:16:25.525832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.168131+0000","last_change":"2023-12-20T04:42:46.827199+0000","last_active":"2023-12-20T04:42:47.168131+0000","last_peered":"2023-12-20T04:42:47.168131+0000","last_clean":"2023-12-20T04:42:47.168131+0000","last_became_active":"2023-12-20T04:42:46.826970+0000","last_became_peered":"2023-12-20T04:42:46.826970+0000","last_unstale":"2023-12-20T04:42:47.168131+0000","last_undegraded":"2023-12-20T04:42:47.168131+0000","last_fullsized":"2023-12-20T04:42:47.168131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270793+0000","last_change":"2023-12-20T04:42:47.171167+0000","last_active":"2023-12-20T04:42:50.270793+0000","last_peered":"2023-12-20T04:42:50.270793+0000","last_clean":"2023-12-20T04:42:50.270793+0000","last_became_active":"2023-12-20T04:42:47.170353+0000","last_became_peered":"2023-12-20T04:42:47.170353+0000","last_unstale":"2023-12-20T04:42:50.270793+0000","last_undegraded":"2023-12-20T04:42:50.270793+0000","last_fullsized":"2023-12-20T04:42:50.270793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:56:01.988189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.158781+0000","last_change":"2023-12-20T04:42:46.826890+0000","last_active":"2023-12-20T04:42:47.158781+0000","last_peered":"2023-12-20T04:42:47.158781+0000","last_clean":"2023-12-20T04:42:47.158781+0000","last_became_active":"2023-12-20T04:42:46.826678+0000","last_became_peered":"2023-12-20T04:42:46.826678+0000","last_unstale":"2023-12-20T04:42:47.158781+0000","last_undegraded":"2023-12-20T04:42:47.158781+0000","last_fullsized":"2023-12-20T04:42:47.158781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160052+0000","last_change":"2023-12-20T04:42:47.163479+0000","last_active":"2023-12-20T04:42:48.160052+0000","last_peered":"2023-12-20T04:42:48.160052+0000","last_clean":"2023-12-20T04:42:48.160052+0000","last_became_active":"2023-12-20T04:42:47.163153+0000","last_became_peered":"2023-12-20T04:42:47.163153+0000","last_unstale":"2023-12-20T04:42:48.160052+0000","last_undegraded":"2023-12-20T04:42:48.160052+0000","last_fullsized":"2023-12-20T04:42:48.160052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:06:20.064610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.168914+0000","last_change":"2023-12-20T04:42:46.817481+0000","last_active":"2023-12-20T04:42:47.168914+0000","last_peered":"2023-12-20T04:42:47.168914+0000","last_clean":"2023-12-20T04:42:47.168914+0000","last_became_active":"2023-12-20T04:42:46.817263+0000","last_became_peered":"2023-12-20T04:42:46.817263+0000","last_unstale":"2023-12-20T04:42:47.168914+0000","last_undegraded":"2023-12-20T04:42:47.168914+0000","last_fullsized":"2023-12-20T04:42:47.168914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159913+0000","last_change":"2023-12-20T04:42:47.172460+0000","last_active":"2023-12-20T04:42:48.159913+0000","last_peered":"2023-12-20T04:42:48.159913+0000","last_clean":"2023-12-20T04:42:48.159913+0000","last_became_active":"2023-12-20T04:42:47.172208+0000","last_became_peered":"2023-12-20T04:42:47.172208+0000","last_unstale":"2023-12-20T04:42:48.159913+0000","last_undegraded":"2023-12-20T04:42:48.159913+0000","last_fullsized":"2023-12-20T04:42:48.159913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:36:27.559291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.177027+0000","last_change":"2023-12-20T04:42:46.826412+0000","last_active":"2023-12-20T04:42:47.177027+0000","last_peered":"2023-12-20T04:42:47.177027+0000","last_clean":"2023-12-20T04:42:47.177027+0000","last_became_active":"2023-12-20T04:42:46.826121+0000","last_became_peered":"2023-12-20T04:42:46.826121+0000","last_unstale":"2023-12-20T04:42:47.177027+0000","last_undegraded":"2023-12-20T04:42:47.177027+0000","last_fullsized":"2023-12-20T04:42:47.177027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270828+0000","last_change":"2023-12-20T04:42:47.168998+0000","last_active":"2023-12-20T04:42:50.270828+0000","last_peered":"2023-12-20T04:42:50.270828+0000","last_clean":"2023-12-20T04:42:50.270828+0000","last_became_active":"2023-12-20T04:42:47.168390+0000","last_became_peered":"2023-12-20T04:42:47.168390+0000","last_unstale":"2023-12-20T04:42:50.270828+0000","last_undegraded":"2023-12-20T04:42:50.270828+0000","last_fullsized":"2023-12-20T04:42:50.270828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:19:34.422422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.164299+0000","last_change":"2023-12-20T04:42:46.819640+0000","last_active":"2023-12-20T04:42:47.164299+0000","last_peered":"2023-12-20T04:42:47.164299+0000","last_clean":"2023-12-20T04:42:47.164299+0000","last_became_active":"2023-12-20T04:42:46.819432+0000","last_became_peered":"2023-12-20T04:42:46.819432+0000","last_unstale":"2023-12-20T04:42:47.164299+0000","last_undegraded":"2023-12-20T04:42:47.164299+0000","last_fullsized":"2023-12-20T04:42:47.164299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:45:29.219298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160133+0000","last_change":"2023-12-20T04:42:47.168232+0000","last_active":"2023-12-20T04:42:48.160133+0000","last_peered":"2023-12-20T04:42:48.160133+0000","last_clean":"2023-12-20T04:42:48.160133+0000","last_became_active":"2023-12-20T04:42:47.168055+0000","last_became_peered":"2023-12-20T04:42:47.168055+0000","last_unstale":"2023-12-20T04:42:48.160133+0000","last_undegraded":"2023-12-20T04:42:48.160133+0000","last_fullsized":"2023-12-20T04:42:48.160133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:56:01.988189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.157450+0000","last_change":"2023-12-20T04:42:46.816370+0000","last_active":"2023-12-20T04:42:47.157450+0000","last_peered":"2023-12-20T04:42:47.157450+0000","last_clean":"2023-12-20T04:42:47.157450+0000","last_became_active":"2023-12-20T04:42:46.816114+0000","last_became_peered":"2023-12-20T04:42:46.816114+0000","last_unstale":"2023-12-20T04:42:47.157450+0000","last_undegraded":"2023-12-20T04:42:47.157450+0000","last_fullsized":"2023-12-20T04:42:47.157450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271116+0000","last_change":"2023-12-20T04:42:47.171159+0000","last_active":"2023-12-20T04:42:50.271116+0000","last_peered":"2023-12-20T04:42:50.271116+0000","last_clean":"2023-12-20T04:42:50.271116+0000","last_became_active":"2023-12-20T04:42:47.170942+0000","last_became_peered":"2023-12-20T04:42:47.170942+0000","last_unstale":"2023-12-20T04:42:50.271116+0000","last_undegraded":"2023-12-20T04:42:50.271116+0000","last_fullsized":"2023-12-20T04:42:50.271116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:34.757109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.166819+0000","last_change":"2023-12-20T04:42:46.825683+0000","last_active":"2023-12-20T04:42:47.166819+0000","last_peered":"2023-12-20T04:42:47.166819+0000","last_clean":"2023-12-20T04:42:47.166819+0000","last_became_active":"2023-12-20T04:42:46.825470+0000","last_became_peered":"2023-12-20T04:42:46.825470+0000","last_unstale":"2023-12-20T04:42:47.166819+0000","last_undegraded":"2023-12-20T04:42:47.166819+0000","last_fullsized":"2023-12-20T04:42:47.166819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210262+0000","last_change":"2023-12-20T04:42:47.169217+0000","last_active":"2023-12-20T04:42:50.210262+0000","last_peered":"2023-12-20T04:42:50.210262+0000","last_clean":"2023-12-20T04:42:50.210262+0000","last_became_active":"2023-12-20T04:42:47.169014+0000","last_became_peered":"2023-12-20T04:42:47.169014+0000","last_unstale":"2023-12-20T04:42:50.210262+0000","last_undegraded":"2023-12-20T04:42:50.210262+0000","last_fullsized":"2023-12-20T04:42:50.210262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:16:25.525832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.178263+0000","last_change":"2023-12-20T04:42:46.817215+0000","last_active":"2023-12-20T04:42:47.178263+0000","last_peered":"2023-12-20T04:42:47.178263+0000","last_clean":"2023-12-20T04:42:47.178263+0000","last_became_active":"2023-12-20T04:42:46.816975+0000","last_became_peered":"2023-12-20T04:42:46.816975+0000","last_unstale":"2023-12-20T04:42:47.178263+0000","last_undegraded":"2023-12-20T04:42:47.178263+0000","last_fullsized":"2023-12-20T04:42:47.178263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271418+0000","last_change":"2023-12-20T04:42:47.170830+0000","last_active":"2023-12-20T04:42:50.271418+0000","last_peered":"2023-12-20T04:42:50.271418+0000","last_clean":"2023-12-20T04:42:50.271418+0000","last_became_active":"2023-12-20T04:42:47.170087+0000","last_became_peered":"2023-12-20T04:42:47.170087+0000","last_unstale":"2023-12-20T04:42:50.271418+0000","last_undegraded":"2023-12-20T04:42:50.271418+0000","last_fullsized":"2023-12-20T04:42:50.271418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:25:43.498709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.167518+0000","last_change":"2023-12-20T04:42:46.822400+0000","last_active":"2023-12-20T04:42:47.167518+0000","last_peered":"2023-12-20T04:42:47.167518+0000","last_clean":"2023-12-20T04:42:47.167518+0000","last_became_active":"2023-12-20T04:42:46.822183+0000","last_became_peered":"2023-12-20T04:42:46.822183+0000","last_unstale":"2023-12-20T04:42:47.167518+0000","last_undegraded":"2023-12-20T04:42:47.167518+0000","last_fullsized":"2023-12-20T04:42:47.167518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:46:37.703321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271233+0000","last_change":"2023-12-20T04:42:47.174998+0000","last_active":"2023-12-20T04:42:50.271233+0000","last_peered":"2023-12-20T04:42:50.271233+0000","last_clean":"2023-12-20T04:42:50.271233+0000","last_became_active":"2023-12-20T04:42:47.174732+0000","last_became_peered":"2023-12-20T04:42:47.174732+0000","last_unstale":"2023-12-20T04:42:50.271233+0000","last_undegraded":"2023-12-20T04:42:50.271233+0000","last_fullsized":"2023-12-20T04:42:50.271233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:26:45.550542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.176524+0000","last_change":"2023-12-20T04:42:46.819085+0000","last_active":"2023-12-20T04:42:47.176524+0000","last_peered":"2023-12-20T04:42:47.176524+0000","last_clean":"2023-12-20T04:42:47.176524+0000","last_became_active":"2023-12-20T04:42:46.818499+0000","last_became_peered":"2023-12-20T04:42:46.818499+0000","last_unstale":"2023-12-20T04:42:47.176524+0000","last_undegraded":"2023-12-20T04:42:47.176524+0000","last_fullsized":"2023-12-20T04:42:47.176524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270918+0000","last_change":"2023-12-20T04:42:47.175762+0000","last_active":"2023-12-20T04:42:50.270918+0000","last_peered":"2023-12-20T04:42:50.270918+0000","last_clean":"2023-12-20T04:42:50.270918+0000","last_became_active":"2023-12-20T04:42:47.175199+0000","last_became_peered":"2023-12-20T04:42:47.175199+0000","last_unstale":"2023-12-20T04:42:50.270918+0000","last_undegraded":"2023-12-20T04:42:50.270918+0000","last_fullsized":"2023-12-20T04:42:50.270918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:14.550271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.165334+0000","last_change":"2023-12-20T04:42:46.817202+0000","last_active":"2023-12-20T04:42:47.165334+0000","last_peered":"2023-12-20T04:42:47.165334+0000","last_clean":"2023-12-20T04:42:47.165334+0000","last_became_active":"2023-12-20T04:42:46.817002+0000","last_became_peered":"2023-12-20T04:42:46.817002+0000","last_unstale":"2023-12-20T04:42:47.165334+0000","last_undegraded":"2023-12-20T04:42:47.165334+0000","last_fullsized":"2023-12-20T04:42:47.165334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270972+0000","last_change":"2023-12-20T04:42:47.161745+0000","last_active":"2023-12-20T04:42:50.270972+0000","last_peered":"2023-12-20T04:42:50.270972+0000","last_clean":"2023-12-20T04:42:50.270972+0000","last_became_active":"2023-12-20T04:42:47.161525+0000","last_became_peered":"2023-12-20T04:42:47.161525+0000","last_unstale":"2023-12-20T04:42:50.270972+0000","last_undegraded":"2023-12-20T04:42:50.270972+0000","last_fullsized":"2023-12-20T04:42:50.270972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:06:04.707201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.156445+0000","last_change":"2023-12-20T04:42:46.819196+0000","last_active":"2023-12-20T04:42:47.156445+0000","last_peered":"2023-12-20T04:42:47.156445+0000","last_clean":"2023-12-20T04:42:47.156445+0000","last_became_active":"2023-12-20T04:42:46.818898+0000","last_became_peered":"2023-12-20T04:42:46.818898+0000","last_unstale":"2023-12-20T04:42:47.156445+0000","last_undegraded":"2023-12-20T04:42:47.156445+0000","last_fullsized":"2023-12-20T04:42:47.156445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271496+0000","last_change":"2023-12-20T04:42:47.173543+0000","last_active":"2023-12-20T04:42:50.271496+0000","last_peered":"2023-12-20T04:42:50.271496+0000","last_clean":"2023-12-20T04:42:50.271496+0000","last_became_active":"2023-12-20T04:42:47.173310+0000","last_became_peered":"2023-12-20T04:42:47.173310+0000","last_unstale":"2023-12-20T04:42:50.271496+0000","last_undegraded":"2023-12-20T04:42:50.271496+0000","last_fullsized":"2023-12-20T04:42:50.271496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:36:59.141749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.169782+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:42:47.169782+0000","last_peered":"2023-12-20T04:42:47.169782+0000","last_clean":"2023-12-20T04:42:47.169782+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:42:47.169782+0000","last_undegraded":"2023-12-20T04:42:47.169782+0000","last_fullsized":"2023-12-20T04:42:47.169782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.157704+0000","last_change":"2023-12-20T04:42:46.817346+0000","last_active":"2023-12-20T04:42:47.157704+0000","last_peered":"2023-12-20T04:42:47.157704+0000","last_clean":"2023-12-20T04:42:47.157704+0000","last_became_active":"2023-12-20T04:42:46.817109+0000","last_became_peered":"2023-12-20T04:42:46.817109+0000","last_unstale":"2023-12-20T04:42:47.157704+0000","last_undegraded":"2023-12-20T04:42:47.157704+0000","last_fullsized":"2023-12-20T04:42:47.157704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162197+0000","last_change":"2023-12-20T04:42:47.161230+0000","last_active":"2023-12-20T04:42:48.162197+0000","last_peered":"2023-12-20T04:42:48.162197+0000","last_clean":"2023-12-20T04:42:48.162197+0000","last_became_active":"2023-12-20T04:42:47.160935+0000","last_became_peered":"2023-12-20T04:42:47.160935+0000","last_unstale":"2023-12-20T04:42:48.162197+0000","last_undegraded":"2023-12-20T04:42:48.162197+0000","last_fullsized":"2023-12-20T04:42:48.162197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:55:31.909374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.169693+0000","last_change":"2023-12-20T04:42:46.822802+0000","last_active":"2023-12-20T04:42:47.169693+0000","last_peered":"2023-12-20T04:42:47.169693+0000","last_clean":"2023-12-20T04:42:47.169693+0000","last_became_active":"2023-12-20T04:42:46.821659+0000","last_became_peered":"2023-12-20T04:42:46.821659+0000","last_unstale":"2023-12-20T04:42:47.169693+0000","last_undegraded":"2023-12-20T04:42:47.169693+0000","last_fullsized":"2023-12-20T04:42:47.169693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160044+0000","last_change":"2023-12-20T04:42:47.161946+0000","last_active":"2023-12-20T04:42:48.160044+0000","last_peered":"2023-12-20T04:42:48.160044+0000","last_clean":"2023-12-20T04:42:48.160044+0000","last_became_active":"2023-12-20T04:42:47.161746+0000","last_became_peered":"2023-12-20T04:42:47.161746+0000","last_unstale":"2023-12-20T04:42:48.160044+0000","last_undegraded":"2023-12-20T04:42:48.160044+0000","last_fullsized":"2023-12-20T04:42:48.160044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:06:51.757769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.156531+0000","last_change":"2023-12-20T04:42:46.822874+0000","last_active":"2023-12-20T04:42:47.156531+0000","last_peered":"2023-12-20T04:42:47.156531+0000","last_clean":"2023-12-20T04:42:47.156531+0000","last_became_active":"2023-12-20T04:42:46.822617+0000","last_became_peered":"2023-12-20T04:42:46.822617+0000","last_unstale":"2023-12-20T04:42:47.156531+0000","last_undegraded":"2023-12-20T04:42:47.156531+0000","last_fullsized":"2023-12-20T04:42:47.156531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:16.851777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270598+0000","last_change":"2023-12-20T04:42:47.157587+0000","last_active":"2023-12-20T04:42:50.270598+0000","last_peered":"2023-12-20T04:42:50.270598+0000","last_clean":"2023-12-20T04:42:50.270598+0000","last_became_active":"2023-12-20T04:42:47.157401+0000","last_became_peered":"2023-12-20T04:42:47.157401+0000","last_unstale":"2023-12-20T04:42:50.270598+0000","last_undegraded":"2023-12-20T04:42:50.270598+0000","last_fullsized":"2023-12-20T04:42:50.270598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:06:04.707201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.158891+0000","last_change":"2023-12-20T04:42:46.816516+0000","last_active":"2023-12-20T04:42:47.158891+0000","last_peered":"2023-12-20T04:42:47.158891+0000","last_clean":"2023-12-20T04:42:47.158891+0000","last_became_active":"2023-12-20T04:42:46.816286+0000","last_became_peered":"2023-12-20T04:42:46.816286+0000","last_unstale":"2023-12-20T04:42:47.158891+0000","last_undegraded":"2023-12-20T04:42:47.158891+0000","last_fullsized":"2023-12-20T04:42:47.158891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160017+0000","last_change":"2023-12-20T04:42:47.163376+0000","last_active":"2023-12-20T04:42:48.160017+0000","last_peered":"2023-12-20T04:42:48.160017+0000","last_clean":"2023-12-20T04:42:48.160017+0000","last_became_active":"2023-12-20T04:42:47.163133+0000","last_became_peered":"2023-12-20T04:42:47.163133+0000","last_unstale":"2023-12-20T04:42:48.160017+0000","last_undegraded":"2023-12-20T04:42:48.160017+0000","last_fullsized":"2023-12-20T04:42:48.160017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:26.441913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.153830+0000","last_change":"2023-12-20T04:42:46.820405+0000","last_active":"2023-12-20T04:42:47.153830+0000","last_peered":"2023-12-20T04:42:47.153830+0000","last_clean":"2023-12-20T04:42:47.153830+0000","last_became_active":"2023-12-20T04:42:46.820205+0000","last_became_peered":"2023-12-20T04:42:46.820205+0000","last_unstale":"2023-12-20T04:42:47.153830+0000","last_undegraded":"2023-12-20T04:42:47.153830+0000","last_fullsized":"2023-12-20T04:42:47.153830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271250+0000","last_change":"2023-12-20T04:42:47.163460+0000","last_active":"2023-12-20T04:42:50.271250+0000","last_peered":"2023-12-20T04:42:50.271250+0000","last_clean":"2023-12-20T04:42:50.271250+0000","last_became_active":"2023-12-20T04:42:47.163064+0000","last_became_peered":"2023-12-20T04:42:47.163064+0000","last_unstale":"2023-12-20T04:42:50.271250+0000","last_undegraded":"2023-12-20T04:42:50.271250+0000","last_fullsized":"2023-12-20T04:42:50.271250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:35.275699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.169599+0000","last_change":"2023-12-20T04:42:46.824778+0000","last_active":"2023-12-20T04:42:47.169599+0000","last_peered":"2023-12-20T04:42:47.169599+0000","last_clean":"2023-12-20T04:42:47.169599+0000","last_became_active":"2023-12-20T04:42:46.824553+0000","last_became_peered":"2023-12-20T04:42:46.824553+0000","last_unstale":"2023-12-20T04:42:47.169599+0000","last_undegraded":"2023-12-20T04:42:47.169599+0000","last_fullsized":"2023-12-20T04:42:47.169599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270687+0000","last_change":"2023-12-20T04:42:47.158315+0000","last_active":"2023-12-20T04:42:50.270687+0000","last_peered":"2023-12-20T04:42:50.270687+0000","last_clean":"2023-12-20T04:42:50.270687+0000","last_became_active":"2023-12-20T04:42:47.157906+0000","last_became_peered":"2023-12-20T04:42:47.157906+0000","last_unstale":"2023-12-20T04:42:50.270687+0000","last_undegraded":"2023-12-20T04:42:50.270687+0000","last_fullsized":"2023-12-20T04:42:50.270687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:22.324414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270691+0000","last_change":"2023-12-20T04:42:46.825192+0000","last_active":"2023-12-20T04:42:50.270691+0000","last_peered":"2023-12-20T04:42:50.270691+0000","last_clean":"2023-12-20T04:42:50.270691+0000","last_became_active":"2023-12-20T04:42:46.825028+0000","last_became_peered":"2023-12-20T04:42:46.825028+0000","last_unstale":"2023-12-20T04:42:50.270691+0000","last_undegraded":"2023-12-20T04:42:50.270691+0000","last_fullsized":"2023-12-20T04:42:50.270691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162117+0000","last_change":"2023-12-20T04:42:47.169513+0000","last_active":"2023-12-20T04:42:48.162117+0000","last_peered":"2023-12-20T04:42:48.162117+0000","last_clean":"2023-12-20T04:42:48.162117+0000","last_became_active":"2023-12-20T04:42:47.169369+0000","last_became_peered":"2023-12-20T04:42:47.169369+0000","last_unstale":"2023-12-20T04:42:48.162117+0000","last_undegraded":"2023-12-20T04:42:48.162117+0000","last_fullsized":"2023-12-20T04:42:48.162117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:22.324414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.172956+0000","last_change":"2023-12-20T04:42:46.825085+0000","last_active":"2023-12-20T04:42:47.172956+0000","last_peered":"2023-12-20T04:42:47.172956+0000","last_clean":"2023-12-20T04:42:47.172956+0000","last_became_active":"2023-12-20T04:42:46.824862+0000","last_became_peered":"2023-12-20T04:42:46.824862+0000","last_unstale":"2023-12-20T04:42:47.172956+0000","last_undegraded":"2023-12-20T04:42:47.172956+0000","last_fullsized":"2023-12-20T04:42:47.172956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159882+0000","last_change":"2023-12-20T04:42:47.156391+0000","last_active":"2023-12-20T04:42:48.159882+0000","last_peered":"2023-12-20T04:42:48.159882+0000","last_clean":"2023-12-20T04:42:48.159882+0000","last_became_active":"2023-12-20T04:42:47.156193+0000","last_became_peered":"2023-12-20T04:42:47.156193+0000","last_unstale":"2023-12-20T04:42:48.159882+0000","last_undegraded":"2023-12-20T04:42:48.159882+0000","last_fullsized":"2023-12-20T04:42:48.159882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:40:53.166559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.167542+0000","last_change":"2023-12-20T04:42:46.823814+0000","last_active":"2023-12-20T04:42:47.167542+0000","last_peered":"2023-12-20T04:42:47.167542+0000","last_clean":"2023-12-20T04:42:47.167542+0000","last_became_active":"2023-12-20T04:42:46.823599+0000","last_became_peered":"2023-12-20T04:42:46.823599+0000","last_unstale":"2023-12-20T04:42:47.167542+0000","last_undegraded":"2023-12-20T04:42:47.167542+0000","last_fullsized":"2023-12-20T04:42:47.167542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160182+0000","last_change":"2023-12-20T04:42:47.163562+0000","last_active":"2023-12-20T04:42:48.160182+0000","last_peered":"2023-12-20T04:42:48.160182+0000","last_clean":"2023-12-20T04:42:48.160182+0000","last_became_active":"2023-12-20T04:42:47.161870+0000","last_became_peered":"2023-12-20T04:42:47.161870+0000","last_unstale":"2023-12-20T04:42:48.160182+0000","last_undegraded":"2023-12-20T04:42:48.160182+0000","last_fullsized":"2023-12-20T04:42:48.160182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:57.927799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.153758+0000","last_change":"2023-12-20T04:42:46.819894+0000","last_active":"2023-12-20T04:42:47.153758+0000","last_peered":"2023-12-20T04:42:47.153758+0000","last_clean":"2023-12-20T04:42:47.153758+0000","last_became_active":"2023-12-20T04:42:46.819686+0000","last_became_peered":"2023-12-20T04:42:46.819686+0000","last_unstale":"2023-12-20T04:42:47.153758+0000","last_undegraded":"2023-12-20T04:42:47.153758+0000","last_fullsized":"2023-12-20T04:42:47.153758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162110+0000","last_change":"2023-12-20T04:42:47.158866+0000","last_active":"2023-12-20T04:42:48.162110+0000","last_peered":"2023-12-20T04:42:48.162110+0000","last_clean":"2023-12-20T04:42:48.162110+0000","last_became_active":"2023-12-20T04:42:47.158669+0000","last_became_peered":"2023-12-20T04:42:47.158669+0000","last_unstale":"2023-12-20T04:42:48.162110+0000","last_undegraded":"2023-12-20T04:42:48.162110+0000","last_fullsized":"2023-12-20T04:42:48.162110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:40:53.166559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.153743+0000","last_change":"2023-12-20T04:42:46.817033+0000","last_active":"2023-12-20T04:42:47.153743+0000","last_peered":"2023-12-20T04:42:47.153743+0000","last_clean":"2023-12-20T04:42:47.153743+0000","last_became_active":"2023-12-20T04:42:46.816816+0000","last_became_peered":"2023-12-20T04:42:46.816816+0000","last_unstale":"2023-12-20T04:42:47.153743+0000","last_undegraded":"2023-12-20T04:42:47.153743+0000","last_fullsized":"2023-12-20T04:42:47.153743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162532+0000","last_change":"2023-12-20T04:42:47.162339+0000","last_active":"2023-12-20T04:42:48.162532+0000","last_peered":"2023-12-20T04:42:48.162532+0000","last_clean":"2023-12-20T04:42:48.162532+0000","last_became_active":"2023-12-20T04:42:47.161781+0000","last_became_peered":"2023-12-20T04:42:47.161781+0000","last_unstale":"2023-12-20T04:42:48.162532+0000","last_undegraded":"2023-12-20T04:42:48.162532+0000","last_fullsized":"2023-12-20T04:42:48.162532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:23:36.035902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.174419+0000","last_change":"2023-12-20T04:42:46.822584+0000","last_active":"2023-12-20T04:42:47.174419+0000","last_peered":"2023-12-20T04:42:47.174419+0000","last_clean":"2023-12-20T04:42:47.174419+0000","last_became_active":"2023-12-20T04:42:46.821836+0000","last_became_peered":"2023-12-20T04:42:46.821836+0000","last_unstale":"2023-12-20T04:42:47.174419+0000","last_undegraded":"2023-12-20T04:42:47.174419+0000","last_fullsized":"2023-12-20T04:42:47.174419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210128+0000","last_change":"2023-12-20T04:42:47.168746+0000","last_active":"2023-12-20T04:42:50.210128+0000","last_peered":"2023-12-20T04:42:50.210128+0000","last_clean":"2023-12-20T04:42:50.210128+0000","last_became_active":"2023-12-20T04:42:47.168532+0000","last_became_peered":"2023-12-20T04:42:47.168532+0000","last_unstale":"2023-12-20T04:42:50.210128+0000","last_undegraded":"2023-12-20T04:42:50.210128+0000","last_fullsized":"2023-12-20T04:42:50.210128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:22.324414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271029+0000","last_change":"2023-12-20T04:42:47.165381+0000","last_active":"2023-12-20T04:42:50.271029+0000","last_peered":"2023-12-20T04:42:50.271029+0000","last_clean":"2023-12-20T04:42:50.271029+0000","last_became_active":"2023-12-20T04:42:47.165153+0000","last_became_peered":"2023-12-20T04:42:47.165153+0000","last_unstale":"2023-12-20T04:42:50.271029+0000","last_undegraded":"2023-12-20T04:42:50.271029+0000","last_fullsized":"2023-12-20T04:42:50.271029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:34.757109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.173061+0000","last_change":"2023-12-20T04:42:46.823242+0000","last_active":"2023-12-20T04:42:47.173061+0000","last_peered":"2023-12-20T04:42:47.173061+0000","last_clean":"2023-12-20T04:42:47.173061+0000","last_became_active":"2023-12-20T04:42:46.823034+0000","last_became_peered":"2023-12-20T04:42:46.823034+0000","last_unstale":"2023-12-20T04:42:47.173061+0000","last_undegraded":"2023-12-20T04:42:47.173061+0000","last_fullsized":"2023-12-20T04:42:47.173061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:50.327147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271160+0000","last_change":"2023-12-20T04:42:47.166605+0000","last_active":"2023-12-20T04:42:50.271160+0000","last_peered":"2023-12-20T04:42:50.271160+0000","last_clean":"2023-12-20T04:42:50.271160+0000","last_became_active":"2023-12-20T04:42:47.165776+0000","last_became_peered":"2023-12-20T04:42:47.165776+0000","last_unstale":"2023-12-20T04:42:50.271160+0000","last_undegraded":"2023-12-20T04:42:50.271160+0000","last_fullsized":"2023-12-20T04:42:50.271160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:58:34.559072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.172428+0000","last_change":"2023-12-20T04:42:46.826590+0000","last_active":"2023-12-20T04:42:47.172428+0000","last_peered":"2023-12-20T04:42:47.172428+0000","last_clean":"2023-12-20T04:42:47.172428+0000","last_became_active":"2023-12-20T04:42:46.826364+0000","last_became_peered":"2023-12-20T04:42:46.826364+0000","last_unstale":"2023-12-20T04:42:47.172428+0000","last_undegraded":"2023-12-20T04:42:47.172428+0000","last_fullsized":"2023-12-20T04:42:47.172428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:57:22.907798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159966+0000","last_change":"2023-12-20T04:42:47.159221+0000","last_active":"2023-12-20T04:42:48.159966+0000","last_peered":"2023-12-20T04:42:48.159966+0000","last_clean":"2023-12-20T04:42:48.159966+0000","last_became_active":"2023-12-20T04:42:47.159003+0000","last_became_peered":"2023-12-20T04:42:47.159003+0000","last_unstale":"2023-12-20T04:42:48.159966+0000","last_undegraded":"2023-12-20T04:42:48.159966+0000","last_fullsized":"2023-12-20T04:42:48.159966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:55:31.909374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.176324+0000","last_change":"2023-12-20T04:42:46.823580+0000","last_active":"2023-12-20T04:42:47.176324+0000","last_peered":"2023-12-20T04:42:47.176324+0000","last_clean":"2023-12-20T04:42:47.176324+0000","last_became_active":"2023-12-20T04:42:46.822923+0000","last_became_peered":"2023-12-20T04:42:46.822923+0000","last_unstale":"2023-12-20T04:42:47.176324+0000","last_undegraded":"2023-12-20T04:42:47.176324+0000","last_fullsized":"2023-12-20T04:42:47.176324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162163+0000","last_change":"2023-12-20T04:42:47.173382+0000","last_active":"2023-12-20T04:42:48.162163+0000","last_peered":"2023-12-20T04:42:48.162163+0000","last_clean":"2023-12-20T04:42:48.162163+0000","last_became_active":"2023-12-20T04:42:47.173150+0000","last_became_peered":"2023-12-20T04:42:47.173150+0000","last_unstale":"2023-12-20T04:42:48.162163+0000","last_undegraded":"2023-12-20T04:42:48.162163+0000","last_fullsized":"2023-12-20T04:42:48.162163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:05.054526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.167668+0000","last_change":"2023-12-20T04:42:46.821155+0000","last_active":"2023-12-20T04:42:47.167668+0000","last_peered":"2023-12-20T04:42:47.167668+0000","last_clean":"2023-12-20T04:42:47.167668+0000","last_became_active":"2023-12-20T04:42:46.820776+0000","last_became_peered":"2023-12-20T04:42:46.820776+0000","last_unstale":"2023-12-20T04:42:47.167668+0000","last_undegraded":"2023-12-20T04:42:47.167668+0000","last_fullsized":"2023-12-20T04:42:47.167668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:46:37.703321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574853,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52400000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53900000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.68400000000000005}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60099999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46000000000000002}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574852,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51800000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41799999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64200000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59299999999999997}]}]},{"osd":4,"up_from":13,"seq":55834574852,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.435}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34399999999999997}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.37}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53700000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27600000000000002}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29599999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39600000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48299999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48999999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45100000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574852,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.308}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.34899999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49399999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58399999999999996}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.501}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574853,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929102,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.253}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28999999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41699999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48399999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52500000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574852,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338256,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35199999999999998}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.504}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53400000000000003}]}]}],"pool_statfs":[]}} 2023-12-20T04:42:54.760 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-20T04:42:54.760 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2023-12-20T04:42:54.760 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2023-12-20T04:42:54.760 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2023-12-20T04:42:54.761 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2023-12-20T04:42:54.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.896+0000 7fda3c205640 1 Processor -- start 2023-12-20T04:42:54.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.896+0000 7fda3c205640 1 -- start start 2023-12-20T04:42:54.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.897+0000 7fda3c205640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fda340b4de0 0x7fda340d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:54.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.897+0000 7fda3c205640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda340b5ec0 con 0x7fda340b4980 2023-12-20T04:42:54.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.897+0000 7fda3c205640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda341617e0 con 0x7fda34160450 2023-12-20T04:42:54.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.897+0000 7fda3c205640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda340d0fc0 con 0x7fda340b4de0 2023-12-20T04:42:54.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.897+0000 7fda3a7a2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fda340b4de0 0x7fda340d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:54.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.897+0000 7fda3a7a2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fda340b4de0 0x7fda340d21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49098/0 (socket says 172.21.15.132:49098) 2023-12-20T04:42:54.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.897+0000 7fda397a0640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fda340b4980 0x7fda340d1aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45866/0 (socket says 172.21.15.132:45866) 2023-12-20T04:42:54.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.897+0000 7fda3a7a2640 1 -- 172.21.15.132:0/2551244918 learned_addr learned my addr 172.21.15.132:0/2551244918 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:54.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.898+0000 7fda3a7a2640 1 -- 172.21.15.132:0/2551244918 >> v1:172.21.15.187:6789/0 conn(0x7fda34160450 legacy=0x7fda34160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:54.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.898+0000 7fda3a7a2640 1 -- 172.21.15.132:0/2551244918 >> v1:172.21.15.132:6789/0 conn(0x7fda340b4980 legacy=0x7fda340d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:54.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.898+0000 7fda3a7a2640 1 -- 172.21.15.132:0/2551244918 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda340d12a0 con 0x7fda340b4de0 2023-12-20T04:42:54.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.898+0000 7fda3a7a2640 1 --2- 172.21.15.132:0/2551244918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda340b4de0 0x7fda340d21b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009870 tx=0x7fda2c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63d2ef4ccb6f0040 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:54.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.898+0000 7fda38f9f640 1 -- 172.21.15.132:0/2551244918 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c02f840 con 0x7fda340b4de0 2023-12-20T04:42:54.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.898+0000 7fda38f9f640 1 -- 172.21.15.132:0/2551244918 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda2c02f9a0 con 0x7fda340b4de0 2023-12-20T04:42:54.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.898+0000 7fda38f9f640 1 -- 172.21.15.132:0/2551244918 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda2c02fd30 con 0x7fda340b4de0 2023-12-20T04:42:54.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.899+0000 7fda3c205640 1 -- 172.21.15.132:0/2551244918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda340b4de0 msgr2=0x7fda340d21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:54.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.899+0000 7fda3c205640 1 --2- 172.21.15.132:0/2551244918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda340b4de0 0x7fda340d21b0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fda2c009870 tx=0x7fda2c02ba20 comp rx=0 tx=0).stop 2023-12-20T04:42:54.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.899+0000 7fda3c205640 1 -- 172.21.15.132:0/2551244918 shutdown_connections 2023-12-20T04:42:54.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.899+0000 7fda3c205640 1 --2- 172.21.15.132:0/2551244918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda340b4de0 0x7fda340d21b0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:54.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.899+0000 7fda3c205640 1 -- 172.21.15.132:0/2551244918 >> 172.21.15.132:0/2551244918 conn(0x7fda340cf980 msgr2=0x7fda340cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:54.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.899+0000 7fda3c205640 1 -- 172.21.15.132:0/2551244918 shutdown_connections 2023-12-20T04:42:54.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.899+0000 7fda3c205640 1 -- 172.21.15.132:0/2551244918 wait complete. 2023-12-20T04:42:54.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.900+0000 7fda3c205640 1 Processor -- start 2023-12-20T04:42:54.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.900+0000 7fda3c205640 1 -- start start 2023-12-20T04:42:54.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda3c205640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda340b4980 0x7fda340ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:54.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda3c205640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda340b4de0 0x7fda341585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:54.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda3c205640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda34160450 0x7fda341541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:54.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda3c205640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda341599f0 con 0x7fda340b4de0 2023-12-20T04:42:54.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda3c205640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda34158de0 con 0x7fda34160450 2023-12-20T04:42:54.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda3c205640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda341590c0 con 0x7fda340b4980 2023-12-20T04:42:54.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda397a0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda340b4de0 0x7fda341585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:54.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda397a0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda340b4de0 0x7fda341585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49106/0 (socket says 172.21.15.132:49106) 2023-12-20T04:42:54.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda397a0640 1 -- 172.21.15.132:0/4288557405 learned_addr learned my addr 172.21.15.132:0/4288557405 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:54.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda397a0640 1 -- 172.21.15.132:0/4288557405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda340b4980 msgr2=0x7fda340ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:54.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda397a0640 1 --2- 172.21.15.132:0/4288557405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda340b4980 0x7fda340ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:54.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda397a0640 1 -- 172.21.15.132:0/4288557405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda34160450 msgr2=0x7fda341541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:54.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda3a7a2640 1 --2- 172.21.15.132:0/4288557405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda34160450 0x7fda341541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:54.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda397a0640 1 --2- 172.21.15.132:0/4288557405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda34160450 0x7fda341541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:54.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda397a0640 1 -- 172.21.15.132:0/4288557405 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda2c0094d0 con 0x7fda340b4de0 2023-12-20T04:42:54.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda3a7a2640 1 --2- 172.21.15.132:0/4288557405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda34160450 0x7fda341541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:54.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda397a0640 1 --2- 172.21.15.132:0/4288557405 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda340b4de0 0x7fda341585b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fda2400c4d0 tx=0x7fda2400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:54.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.901+0000 7fda2a7fc640 1 -- 172.21.15.132:0/4288557405 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda24007480 con 0x7fda340b4de0 2023-12-20T04:42:54.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.902+0000 7fda2a7fc640 1 -- 172.21.15.132:0/4288557405 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda240075e0 con 0x7fda340b4de0 2023-12-20T04:42:54.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.902+0000 7fda2a7fc640 1 -- 172.21.15.132:0/4288557405 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda240049e0 con 0x7fda340b4de0 2023-12-20T04:42:54.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.902+0000 7fda3c205640 1 -- 172.21.15.132:0/4288557405 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda341593a0 con 0x7fda340b4de0 2023-12-20T04:42:54.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.902+0000 7fda3c205640 1 -- 172.21.15.132:0/4288557405 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda34158af0 con 0x7fda340b4de0 2023-12-20T04:42:54.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.903+0000 7fda3c205640 1 -- 172.21.15.132:0/4288557405 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda3404e840 con 0x7fda340b4de0 2023-12-20T04:42:54.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.903+0000 7fda2a7fc640 1 -- 172.21.15.132:0/4288557405 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fda24004b40 con 0x7fda340b4de0 2023-12-20T04:42:54.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.903+0000 7fda2a7fc640 1 --2- 172.21.15.132:0/4288557405 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fda1806a430 0x7fda1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:54.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.903+0000 7fda2a7fc640 1 -- 172.21.15.132:0/4288557405 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fda24087970 con 0x7fda340b4de0 2023-12-20T04:42:54.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.903+0000 7fda39fa1640 1 --2- 172.21.15.132:0/4288557405 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fda1806a430 0x7fda1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:54.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.904+0000 7fda39fa1640 1 --2- 172.21.15.132:0/4288557405 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fda1806a430 0x7fda1806c8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fda3000ab90 tx=0x7fda30009230 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:54.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:54.908+0000 7fda2a7fc640 1 -- 172.21.15.132:0/4288557405 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fda24053010 con 0x7fda340b4de0 2023-12-20T04:42:55.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.118+0000 7fda3c205640 1 -- 172.21.15.132:0/4288557405 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7fda340d0ad0 con 0x7fda340b4de0 2023-12-20T04:42:55.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.121+0000 7fda2a7fc640 1 -- 172.21.15.132:0/4288557405 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) v1 ==== 74+0+169969 (secure 0 0 0) 0x7fda24018020 con 0x7fda340b4de0 2023-12-20T04:42:55.124 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:55.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.123+0000 7fda3c205640 1 -- 172.21.15.132:0/4288557405 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fda1806a430 msgr2=0x7fda1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.123+0000 7fda3c205640 1 --2- 172.21.15.132:0/4288557405 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fda1806a430 0x7fda1806c8f0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fda3000ab90 tx=0x7fda30009230 comp rx=0 tx=0).stop 2023-12-20T04:42:55.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.123+0000 7fda3c205640 1 -- 172.21.15.132:0/4288557405 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda340b4de0 msgr2=0x7fda341585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.123+0000 7fda3c205640 1 --2- 172.21.15.132:0/4288557405 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda340b4de0 0x7fda341585b0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fda2400c4d0 tx=0x7fda2400c990 comp rx=0 tx=0).stop 2023-12-20T04:42:55.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.123+0000 7fda3c205640 1 -- 172.21.15.132:0/4288557405 shutdown_connections 2023-12-20T04:42:55.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.123+0000 7fda3c205640 1 --2- 172.21.15.132:0/4288557405 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fda1806a430 0x7fda1806c8f0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.123+0000 7fda3c205640 1 --2- 172.21.15.132:0/4288557405 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda34160450 0x7fda341541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.123+0000 7fda3c205640 1 --2- 172.21.15.132:0/4288557405 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda340b4de0 0x7fda341585b0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.123+0000 7fda3c205640 1 --2- 172.21.15.132:0/4288557405 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda340b4980 0x7fda340ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.123+0000 7fda3c205640 1 -- 172.21.15.132:0/4288557405 >> 172.21.15.132:0/4288557405 conn(0x7fda340cf980 msgr2=0x7fda3415f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:55.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.124+0000 7fda3c205640 1 -- 172.21.15.132:0/4288557405 shutdown_connections 2023-12-20T04:42:55.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.124+0000 7fda3c205640 1 -- 172.21.15.132:0/4288557405 wait complete. 2023-12-20T04:42:55.135 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":5,"active_gid":4098,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6832","nonce":84767},{"type":"v1","addr":"172.21.15.132:6833","nonce":84767}]},"active_addr":"172.21.15.132:6833/84767","active_change":"2023-12-20T04:42:34.085914+0000","active_mgr_features":4540138322906710015,"available":true,"standbys":[{"gid":4103,"name":"x","mgr_features":4540138322906710015,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:9.4.7","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:0.0.2","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"secs","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":1512687476}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":1883356088}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":3283731671}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.132:0","nonce":757833803}]}]} 2023-12-20T04:42:55.139 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2023-12-20T04:42:55.140 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2023-12-20T04:42:55.140 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:42:55.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.240+0000 7f14e15fa640 1 Processor -- start 2023-12-20T04:42:55.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.240+0000 7f14e15fa640 1 -- start start 2023-12-20T04:42:55.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.241+0000 7f14e15fa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14dc160450 0x7f14dc160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.241+0000 7f14e15fa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f14dc1611b0 0x7f14dc0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.241+0000 7f14e15fa640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f14dc0b4ec0 0x7f14dc06a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.241+0000 7f14e15fa640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14dc0b5350 con 0x7f14dc1611b0 2023-12-20T04:42:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.241+0000 7f14e15fa640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f14dc0b5ec0 con 0x7f14dc0b4ec0 2023-12-20T04:42:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.241+0000 7f14e15fa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc1617e0 con 0x7f14dc160450 2023-12-20T04:42:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.241+0000 7f14d3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f14dc1611b0 0x7f14dc0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.241+0000 7f14d3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f14dc1611b0 0x7f14dc0b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49120/0 (socket says 172.21.15.132:49120) 2023-12-20T04:42:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.241+0000 7f14d3fff640 1 -- 172.21.15.132:0/3626020657 learned_addr learned my addr 172.21.15.132:0/3626020657 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.241+0000 7f14daffd640 1 --2- 172.21.15.132:0/3626020657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14dc160450 0x7f14dc160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.241+0000 7f14db7fe640 1 --2- 172.21.15.132:0/3626020657 >> v2:172.21.15.187:3300/0 conn(0x7f14dc0b4ec0 0x7f14dc06a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.241+0000 7f14d3fff640 1 -- 172.21.15.132:0/3626020657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14dc160450 msgr2=0x7f14dc160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.241+0000 7f14d3fff640 1 --2- 172.21.15.132:0/3626020657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14dc160450 0x7f14dc160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.241+0000 7f14d3fff640 1 -- 172.21.15.132:0/3626020657 >> v2:172.21.15.187:3300/0 conn(0x7f14dc0b4ec0 msgr2=0x7f14dc06a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.241+0000 7f14d3fff640 1 --2- 172.21.15.132:0/3626020657 >> v2:172.21.15.187:3300/0 conn(0x7f14dc0b4ec0 0x7f14dc06a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.241+0000 7f14d3fff640 1 -- 172.21.15.132:0/3626020657 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14dc0d0fc0 con 0x7f14dc1611b0 2023-12-20T04:42:55.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.242+0000 7f14d3fff640 1 --2- 172.21.15.132:0/3626020657 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14dc1611b0 0x7f14dc0b4980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0b59d0 tx=0x7f14c402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9eb2dc09e64f2738 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.242+0000 7f14da7fc640 1 -- 172.21.15.132:0/3626020657 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c4030860 con 0x7f14dc1611b0 2023-12-20T04:42:55.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.242+0000 7f14da7fc640 1 -- 172.21.15.132:0/3626020657 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14c40309c0 con 0x7f14dc1611b0 2023-12-20T04:42:55.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.242+0000 7f14da7fc640 1 -- 172.21.15.132:0/3626020657 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14c4030d50 con 0x7f14dc1611b0 2023-12-20T04:42:55.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.242+0000 7f14e15fa640 1 -- 172.21.15.132:0/3626020657 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14dc1611b0 msgr2=0x7f14dc0b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.242+0000 7f14e15fa640 1 --2- 172.21.15.132:0/3626020657 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14dc1611b0 0x7f14dc0b4980 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f14dc0b59d0 tx=0x7f14c402b9a0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.243+0000 7f14e15fa640 1 -- 172.21.15.132:0/3626020657 shutdown_connections 2023-12-20T04:42:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.243+0000 7f14e15fa640 1 --2- 172.21.15.132:0/3626020657 >> v2:172.21.15.187:3300/0 conn(0x7f14dc0b4ec0 0x7f14dc06a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.243+0000 7f14e15fa640 1 --2- 172.21.15.132:0/3626020657 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14dc1611b0 0x7f14dc0b4980 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.243+0000 7f14e15fa640 1 --2- 172.21.15.132:0/3626020657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14dc160450 0x7f14dc160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.243+0000 7f14e15fa640 1 -- 172.21.15.132:0/3626020657 >> 172.21.15.132:0/3626020657 conn(0x7f14dc0cf980 msgr2=0x7f14dc0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.243+0000 7f14e15fa640 1 -- 172.21.15.132:0/3626020657 shutdown_connections 2023-12-20T04:42:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.243+0000 7f14e15fa640 1 -- 172.21.15.132:0/3626020657 wait complete. 2023-12-20T04:42:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.244+0000 7f14e15fa640 1 Processor -- start 2023-12-20T04:42:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.244+0000 7f14e15fa640 1 -- start start 2023-12-20T04:42:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.244+0000 7f14e15fa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14dc0b4ec0 0x7f14dc152f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.244+0000 7f14e15fa640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14dc160450 0x7f14dc0ccb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.244+0000 7f14e15fa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14dc1611b0 0x7f14dc0d2b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.244+0000 7f14e15fa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc0cb550 con 0x7f14dc0b4ec0 2023-12-20T04:42:55.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.244+0000 7f14e15fa640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc0ca9d0 con 0x7f14dc160450 2023-12-20T04:42:55.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.244+0000 7f14e15fa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc0cacb0 con 0x7f14dc1611b0 2023-12-20T04:42:55.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.245+0000 7f14daffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14dc0b4ec0 0x7f14dc152f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.245+0000 7f14daffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14dc0b4ec0 0x7f14dc152f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49128/0 (socket says 172.21.15.132:49128) 2023-12-20T04:42:55.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.245+0000 7f14daffd640 1 -- 172.21.15.132:0/3235554605 learned_addr learned my addr 172.21.15.132:0/3235554605 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:55.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.245+0000 7f14db7fe640 1 --2- 172.21.15.132:0/3235554605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14dc1611b0 0x7f14dc0d2b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.245+0000 7f14d3fff640 1 --2- 172.21.15.132:0/3235554605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14dc160450 0x7f14dc0ccb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.245+0000 7f14daffd640 1 -- 172.21.15.132:0/3235554605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14dc1611b0 msgr2=0x7f14dc0d2b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.245+0000 7f14daffd640 1 --2- 172.21.15.132:0/3235554605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14dc1611b0 0x7f14dc0d2b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.245+0000 7f14daffd640 1 -- 172.21.15.132:0/3235554605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14dc160450 msgr2=0x7f14dc0ccb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.245+0000 7f14daffd640 1 --2- 172.21.15.132:0/3235554605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14dc160450 0x7f14dc0ccb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.245+0000 7f14daffd640 1 -- 172.21.15.132:0/3235554605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c40094d0 con 0x7f14dc0b4ec0 2023-12-20T04:42:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.245+0000 7f14db7fe640 1 --2- 172.21.15.132:0/3235554605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14dc1611b0 0x7f14dc0d2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.245+0000 7f14daffd640 1 --2- 172.21.15.132:0/3235554605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14dc0b4ec0 0x7f14dc152f50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00e9b0 tx=0x7f14cc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.245+0000 7f14d37fe640 1 -- 172.21.15.132:0/3235554605 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc009670 con 0x7f14dc0b4ec0 2023-12-20T04:42:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.245+0000 7f14d37fe640 1 -- 172.21.15.132:0/3235554605 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f14cc00c9a0 con 0x7f14dc0b4ec0 2023-12-20T04:42:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.245+0000 7f14e15fa640 1 -- 172.21.15.132:0/3235554605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14dc0caf90 con 0x7f14dc0b4ec0 2023-12-20T04:42:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.245+0000 7f14d37fe640 1 -- 172.21.15.132:0/3235554605 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f14cc00cd50 con 0x7f14dc0b4ec0 2023-12-20T04:42:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.245+0000 7f14e15fa640 1 -- 172.21.15.132:0/3235554605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14dc1f28f0 con 0x7f14dc0b4ec0 2023-12-20T04:42:55.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.246+0000 7f14e15fa640 1 -- 172.21.15.132:0/3235554605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14dc04e840 con 0x7f14dc0b4ec0 2023-12-20T04:42:55.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.247+0000 7f14d37fe640 1 -- 172.21.15.132:0/3235554605 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f14cc013470 con 0x7f14dc0b4ec0 2023-12-20T04:42:55.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.247+0000 7f14d37fe640 1 --2- 172.21.15.132:0/3235554605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f14bc06a430 0x7f14bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.247+0000 7f14d37fe640 1 -- 172.21.15.132:0/3235554605 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f14cc088aa0 con 0x7f14dc0b4ec0 2023-12-20T04:42:55.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.247+0000 7f14d3fff640 1 --2- 172.21.15.132:0/3235554605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f14bc06a430 0x7f14bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.247+0000 7f14d3fff640 1 --2- 172.21.15.132:0/3235554605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f14bc06a430 0x7f14bc06c8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f14c4036000 tx=0x7f14c403b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.251+0000 7f14d37fe640 1 -- 172.21.15.132:0/3235554605 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f14cc054120 con 0x7f14dc0b4ec0 2023-12-20T04:42:55.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.416+0000 7f14e15fa640 1 -- 172.21.15.132:0/3235554605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f14dc0d0ad0 con 0x7f14dc0b4ec0 2023-12-20T04:42:55.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.417+0000 7f14d37fe640 1 -- 172.21.15.132:0/3235554605 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f14cc017090 con 0x7f14dc0b4ec0 2023-12-20T04:42:55.418 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:55.418 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:42:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.419+0000 7f14e15fa640 1 -- 172.21.15.132:0/3235554605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f14bc06a430 msgr2=0x7f14bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.419+0000 7f14e15fa640 1 --2- 172.21.15.132:0/3235554605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f14bc06a430 0x7f14bc06c8f0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f14c4036000 tx=0x7f14c403b040 comp rx=0 tx=0).stop 2023-12-20T04:42:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.419+0000 7f14e15fa640 1 -- 172.21.15.132:0/3235554605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14dc0b4ec0 msgr2=0x7f14dc152f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.419+0000 7f14e15fa640 1 --2- 172.21.15.132:0/3235554605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14dc0b4ec0 0x7f14dc152f50 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f14cc00e9b0 tx=0x7f14cc00ee70 comp rx=0 tx=0).stop 2023-12-20T04:42:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.419+0000 7f14e15fa640 1 -- 172.21.15.132:0/3235554605 shutdown_connections 2023-12-20T04:42:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.419+0000 7f14e15fa640 1 --2- 172.21.15.132:0/3235554605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f14bc06a430 0x7f14bc06c8f0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.419+0000 7f14e15fa640 1 --2- 172.21.15.132:0/3235554605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f14dc1611b0 0x7f14dc0d2b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.419+0000 7f14e15fa640 1 --2- 172.21.15.132:0/3235554605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f14dc160450 0x7f14dc0ccb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.419+0000 7f14e15fa640 1 --2- 172.21.15.132:0/3235554605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f14dc0b4ec0 0x7f14dc152f50 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.420+0000 7f14e15fa640 1 -- 172.21.15.132:0/3235554605 >> 172.21.15.132:0/3235554605 conn(0x7f14dc0cf980 msgr2=0x7f14dc15bc30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.420+0000 7f14e15fa640 1 -- 172.21.15.132:0/3235554605 shutdown_connections 2023-12-20T04:42:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.420+0000 7f14e15fa640 1 -- 172.21.15.132:0/3235554605 wait complete. 2023-12-20T04:42:55.431 INFO:tasks.ceph.ceph_manager.ceph:all up! 2023-12-20T04:42:55.432 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:42:55.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.530+0000 7f71caa41640 1 Processor -- start 2023-12-20T04:42:55.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.530+0000 7f71caa41640 1 -- start start 2023-12-20T04:42:55.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.531+0000 7f71caa41640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f71c40b4980 0x7f71c40b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.531+0000 7f71caa41640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c40b5320 con 0x7f71c40d1aa0 2023-12-20T04:42:55.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.531+0000 7f71caa41640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71c40b5ec0 con 0x7f71c4160450 2023-12-20T04:42:55.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.531+0000 7f71caa41640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71c41617e0 con 0x7f71c40b4980 2023-12-20T04:42:55.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.531+0000 7f71c37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f71c40b4980 0x7f71c40b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.531+0000 7f71c8fde640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f71c40d1aa0 0x7f71c40d1ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45870/0 (socket says 172.21.15.132:45870) 2023-12-20T04:42:55.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.531+0000 7f71c8fde640 1 -- 172.21.15.132:0/100666275 learned_addr learned my addr 172.21.15.132:0/100666275 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:55.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.532+0000 7f71c37fe640 1 -- 172.21.15.132:0/100666275 >> v1:172.21.15.187:6789/0 conn(0x7f71c4160450 legacy=0x7f71c4160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.532+0000 7f71c37fe640 1 -- 172.21.15.132:0/100666275 >> v1:172.21.15.132:6789/0 conn(0x7f71c40d1aa0 legacy=0x7f71c40d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.532+0000 7f71c37fe640 1 -- 172.21.15.132:0/100666275 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c40d0fc0 con 0x7f71c40b4980 2023-12-20T04:42:55.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.532+0000 7f71c2ffd640 1 -- 172.21.15.132:0/100666275 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2649059004 0 0) 0x7f71c40b5320 con 0x7f71c40d1aa0 2023-12-20T04:42:55.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.532+0000 7f71c37fe640 1 --2- 172.21.15.132:0/100666275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71c40b4980 0x7f71c40b4de0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f71b80097a0 tx=0x7f71b802b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1261562f1f73eb server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.532+0000 7f71c2ffd640 1 -- 172.21.15.132:0/100666275 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b802f810 con 0x7f71c40b4980 2023-12-20T04:42:55.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.533+0000 7f71c2ffd640 1 -- 172.21.15.132:0/100666275 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b802f970 con 0x7f71c40b4980 2023-12-20T04:42:55.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.533+0000 7f71c2ffd640 1 -- 172.21.15.132:0/100666275 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b802fd00 con 0x7f71c40b4980 2023-12-20T04:42:55.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.533+0000 7f71caa41640 1 -- 172.21.15.132:0/100666275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71c40b4980 msgr2=0x7f71c40b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.533+0000 7f71caa41640 1 --2- 172.21.15.132:0/100666275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71c40b4980 0x7f71c40b4de0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f71b80097a0 tx=0x7f71b802b9f0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.533+0000 7f71caa41640 1 -- 172.21.15.132:0/100666275 shutdown_connections 2023-12-20T04:42:55.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.533+0000 7f71caa41640 1 --2- 172.21.15.132:0/100666275 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71c40b4980 0x7f71c40b4de0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.533+0000 7f71caa41640 1 -- 172.21.15.132:0/100666275 >> 172.21.15.132:0/100666275 conn(0x7f71c40cf980 msgr2=0x7f71c40cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:55.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.533+0000 7f71caa41640 1 -- 172.21.15.132:0/100666275 shutdown_connections 2023-12-20T04:42:55.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.533+0000 7f71caa41640 1 -- 172.21.15.132:0/100666275 wait complete. 2023-12-20T04:42:55.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.534+0000 7f71caa41640 1 Processor -- start 2023-12-20T04:42:55.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.534+0000 7f71caa41640 1 -- start start 2023-12-20T04:42:55.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.535+0000 7f71caa41640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71c40b4980 0x7f71c40caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.535+0000 7f71caa41640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71c40d1aa0 0x7f71c4159930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.535+0000 7f71caa41640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c4160450 0x7f71c41f3470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.535+0000 7f71caa41640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40cb5f0 con 0x7f71c40b4980 2023-12-20T04:42:55.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.535+0000 7f71caa41640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71c40cb8d0 con 0x7f71c4160450 2023-12-20T04:42:55.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.535+0000 7f71caa41640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71c41f3d70 con 0x7f71c40d1aa0 2023-12-20T04:42:55.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.535+0000 7f71c3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71c40b4980 0x7f71c40caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.535+0000 7f71c3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71c40b4980 0x7f71c40caf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49134/0 (socket says 172.21.15.132:49134) 2023-12-20T04:42:55.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.535+0000 7f71c3fff640 1 -- 172.21.15.132:0/810722776 learned_addr learned my addr 172.21.15.132:0/810722776 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:55.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.535+0000 7f71c37fe640 1 --2- 172.21.15.132:0/810722776 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71c40d1aa0 0x7f71c4159930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.535+0000 7f71c8fde640 1 --2- 172.21.15.132:0/810722776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c4160450 0x7f71c41f3470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.536+0000 7f71c3fff640 1 -- 172.21.15.132:0/810722776 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71c40d1aa0 msgr2=0x7f71c4159930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.536+0000 7f71c3fff640 1 --2- 172.21.15.132:0/810722776 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71c40d1aa0 0x7f71c4159930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.536+0000 7f71c3fff640 1 -- 172.21.15.132:0/810722776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c4160450 msgr2=0x7f71c41f3470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.536+0000 7f71c3fff640 1 --2- 172.21.15.132:0/810722776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c4160450 0x7f71c41f3470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.536+0000 7f71c3fff640 1 -- 172.21.15.132:0/810722776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71b8009400 con 0x7f71c40b4980 2023-12-20T04:42:55.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.536+0000 7f71c3fff640 1 --2- 172.21.15.132:0/810722776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71c40b4980 0x7f71c40caf60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f71b400c400 tx=0x7f71b400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.536+0000 7f71c0ff9640 1 -- 172.21.15.132:0/810722776 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b40052d0 con 0x7f71c40b4980 2023-12-20T04:42:55.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.536+0000 7f71c0ff9640 1 -- 172.21.15.132:0/810722776 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71b4005430 con 0x7f71c40b4980 2023-12-20T04:42:55.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.536+0000 7f71caa41640 1 -- 172.21.15.132:0/810722776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71c41f4050 con 0x7f71c40b4980 2023-12-20T04:42:55.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.536+0000 7f71c0ff9640 1 -- 172.21.15.132:0/810722776 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71b4003830 con 0x7f71c40b4980 2023-12-20T04:42:55.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.536+0000 7f71caa41640 1 -- 172.21.15.132:0/810722776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71c415da40 con 0x7f71c40b4980 2023-12-20T04:42:55.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.537+0000 7f71caa41640 1 -- 172.21.15.132:0/810722776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71c41f3b90 con 0x7f71c40b4980 2023-12-20T04:42:55.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.537+0000 7f71c0ff9640 1 -- 172.21.15.132:0/810722776 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f71b4003990 con 0x7f71c40b4980 2023-12-20T04:42:55.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.538+0000 7f71c0ff9640 1 --2- 172.21.15.132:0/810722776 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71b006a430 0x7f71b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.538+0000 7f71c0ff9640 1 -- 172.21.15.132:0/810722776 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f71b4087eb0 con 0x7f71c40b4980 2023-12-20T04:42:55.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.538+0000 7f71c37fe640 1 --2- 172.21.15.132:0/810722776 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71b006a430 0x7f71b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.538+0000 7f71c37fe640 1 --2- 172.21.15.132:0/810722776 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71b006a430 0x7f71b006c8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f71b8036000 tx=0x7f71b8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.542+0000 7f71c0ff9640 1 -- 172.21.15.132:0/810722776 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f71b40534d0 con 0x7f71c40b4980 2023-12-20T04:42:55.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.710+0000 7f71caa41640 1 -- 172.21.15.132:0/810722776 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f71c404e840 con 0x7f71c40b4980 2023-12-20T04:42:55.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.711+0000 7f71c0ff9640 1 -- 172.21.15.132:0/810722776 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f71b4056af0 con 0x7f71c40b4980 2023-12-20T04:42:55.712 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:55.712 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:42:55.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.713+0000 7f71caa41640 1 -- 172.21.15.132:0/810722776 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71b006a430 msgr2=0x7f71b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.713+0000 7f71caa41640 1 --2- 172.21.15.132:0/810722776 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71b006a430 0x7f71b006c8f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f71b8036000 tx=0x7f71b8008030 comp rx=0 tx=0).stop 2023-12-20T04:42:55.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.713+0000 7f71caa41640 1 -- 172.21.15.132:0/810722776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71c40b4980 msgr2=0x7f71c40caf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.713+0000 7f71caa41640 1 --2- 172.21.15.132:0/810722776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71c40b4980 0x7f71c40caf60 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f71b400c400 tx=0x7f71b400c8c0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.713+0000 7f71caa41640 1 -- 172.21.15.132:0/810722776 shutdown_connections 2023-12-20T04:42:55.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.713+0000 7f71caa41640 1 --2- 172.21.15.132:0/810722776 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71b006a430 0x7f71b006c8f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.713+0000 7f71caa41640 1 --2- 172.21.15.132:0/810722776 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71c4160450 0x7f71c41f3470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.713+0000 7f71caa41640 1 --2- 172.21.15.132:0/810722776 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71c40d1aa0 0x7f71c4159930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.713+0000 7f71caa41640 1 --2- 172.21.15.132:0/810722776 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71c40b4980 0x7f71c40caf60 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.713+0000 7f71caa41640 1 -- 172.21.15.132:0/810722776 >> 172.21.15.132:0/810722776 conn(0x7f71c40cf980 msgr2=0x7f71c415ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:55.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.714+0000 7f71caa41640 1 -- 172.21.15.132:0/810722776 shutdown_connections 2023-12-20T04:42:55.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.714+0000 7f71caa41640 1 -- 172.21.15.132:0/810722776 wait complete. 2023-12-20T04:42:55.726 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2023-12-20T04:42:55.726 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2023-12-20T04:42:55.727 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2023-12-20T04:42:55.727 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2023-12-20T04:42:55.728 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2023-12-20T04:42:55.728 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2023-12-20T04:42:55.728 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2023-12-20T04:42:55.729 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2023-12-20T04:42:55.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.896+0000 7f48dceb4640 1 Processor -- start 2023-12-20T04:42:55.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.896+0000 7f9c0960b640 1 Processor -- start 2023-12-20T04:42:55.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.897+0000 7f9c0960b640 1 -- start start 2023-12-20T04:42:55.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.897+0000 7f48dceb4640 1 -- start start 2023-12-20T04:42:55.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.898+0000 7f90616b4640 1 Processor -- start 2023-12-20T04:42:55.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.898+0000 7f9c0960b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9c04161560 0x7f9c04165c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.898+0000 7f48dceb4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48d806d630 0x7f48d80ca070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.898+0000 7f48dceb4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d80ce460 con 0x7f48d8159420 2023-12-20T04:42:55.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.898+0000 7f48dceb4640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48d80cdb50 con 0x7f48d8159800 2023-12-20T04:42:55.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.898+0000 7f48dceb4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d80ca770 con 0x7f48d806d630 2023-12-20T04:42:55.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.898+0000 7f9c0960b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c040ce840 con 0x7f9c040cba60 2023-12-20T04:42:55.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.898+0000 7f9c037fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9c040cba60 0x7f9c040cecd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45892/0 (socket says 172.21.15.132:45892) 2023-12-20T04:42:55.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.898+0000 7f9c037fe640 1 -- 172.21.15.132:0/3390453373 learned_addr learned my addr 172.21.15.132:0/3390453373 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:55.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.898+0000 7f9c02ffd640 1 --2- 172.21.15.132:0/3390453373 >> v2:172.21.15.132:3300/0 conn(0x7f9c04161560 0x7f9c04165c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.898+0000 7f48d77fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f48d8159420 0x7f48d80ce8f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45878/0 (socket says 172.21.15.132:45878) 2023-12-20T04:42:55.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.898+0000 7f48d77fe640 1 -- 172.21.15.132:0/2424787488 learned_addr learned my addr 172.21.15.132:0/2424787488 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:55.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.898+0000 7f48d7fff640 1 --2- 172.21.15.132:0/2424787488 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48d806d630 0x7f48d80ca070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.898+0000 7f90616b4640 1 -- start start 2023-12-20T04:42:55.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.899+0000 7fb57124b640 1 Processor -- start 2023-12-20T04:42:55.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.899+0000 7f48d7fff640 1 -- 172.21.15.132:0/2424787488 >> v1:172.21.15.187:6789/0 conn(0x7f48d8159800 legacy=0x7f48d806cf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.899+0000 7fb57124b640 1 -- start start 2023-12-20T04:42:55.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.899+0000 7fe0549b3640 1 Processor -- start 2023-12-20T04:42:55.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.899+0000 7f48d7fff640 1 -- 172.21.15.132:0/2424787488 >> v1:172.21.15.132:6789/0 conn(0x7f48d8159420 legacy=0x7f48d80ce8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.899+0000 7f48d7fff640 1 -- 172.21.15.132:0/2424787488 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d80cde10 con 0x7f48d806d630 2023-12-20T04:42:55.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.899+0000 7fe0549b3640 1 -- start start 2023-12-20T04:42:55.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.899+0000 7f9c0960b640 1 -- 172.21.15.132:0/3390453373 --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c040ce510 con 0x7f9c040cb620 2023-12-20T04:42:55.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.899+0000 7f9c0960b640 1 -- 172.21.15.132:0/3390453373 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c040c9ae0 con 0x7f9c04161560 2023-12-20T04:42:55.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.899+0000 7f90616b4640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f905404fc30 0x7f90540481b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.899+0000 7f90616b4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90540062a0 con 0x7f905404b430 2023-12-20T04:42:55.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.899+0000 7f90616b4640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9054006580 con 0x7f9054052b10 2023-12-20T04:42:55.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.899+0000 7f90616b4640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f905404b810 con 0x7f905404fc30 2023-12-20T04:42:55.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7f905b7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f905404fc30 0x7f90540481b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7f905b7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f905404fc30 0x7f90540481b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:45008/0 (socket says 172.21.15.132:45008) 2023-12-20T04:42:55.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7f905b7fe640 1 -- 172.21.15.132:0/2204416509 learned_addr learned my addr 172.21.15.132:0/2204416509 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:55.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7effff59e640 1 Processor -- start 2023-12-20T04:42:55.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7fb57124b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb56c161320 0x7fb56c0c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7f48d7fff640 1 --2- 172.21.15.132:0/2424787488 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48d806d630 0x7f48d80ca070 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f48d000bec0 tx=0x7f48d002dc20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25c860e775832379 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7f905b7fe640 1 -- 172.21.15.132:0/2204416509 >> v1:172.21.15.187:6789/0 conn(0x7f9054052b10 legacy=0x7f9054006a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7f905b7fe640 1 -- 172.21.15.132:0/2204416509 >> v1:172.21.15.132:6789/0 conn(0x7f905404b430 legacy=0x7f905404f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:55.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7fe0549b3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0500c1980 0x7fe0500c1d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7fb56ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb56c161320 0x7fb56c0c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7fb56ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb56c161320 0x7fb56c0c53f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49154/0 (socket says 172.21.15.132:49154) 2023-12-20T04:42:55.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7fb56a59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb56c0adb40 0x7fb56c0b0550 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45910/0 (socket says 172.21.15.132:45910) 2023-12-20T04:42:55.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7fe0549b3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe050165c80 0x7fe050069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.899+0000 7f9c02ffd640 1 -- 172.21.15.132:0/3390453373 >> v1:172.21.15.187:6789/0 conn(0x7f9c040cb620 legacy=0x7f9c040cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.899+0000 7f9c02ffd640 1 -- 172.21.15.132:0/3390453373 >> v1:172.21.15.132:6789/0 conn(0x7f9c040cba60 legacy=0x7f9c040cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.899+0000 7f9c02ffd640 1 -- 172.21.15.132:0/3390453373 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c040c9dc0 con 0x7f9c04161560 2023-12-20T04:42:55.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7fe0549b3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0500cb2f0 con 0x7fe0500ce250 2023-12-20T04:42:55.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7f905b7fe640 1 -- 172.21.15.132:0/2204416509 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90540ec0a0 con 0x7f905404fc30 2023-12-20T04:42:55.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7fb56ad9d640 1 -- 172.21.15.132:0/201886642 learned_addr learned my addr 172.21.15.132:0/201886642 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:55.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7f9c02ffd640 1 --2- 172.21.15.132:0/3390453373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c04161560 0x7f9c04165c10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40097a0 tx=0x7f9bf402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a4893b79c92ec56 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fe04f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0500c1980 0x7fe0500c1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fe046ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe0500ce250 0x7fe05006f370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45916/0 (socket says 172.21.15.132:45916) 2023-12-20T04:42:55.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fe04f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0500c1980 0x7fe0500c1d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49164/0 (socket says 172.21.15.132:49164) 2023-12-20T04:42:55.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fe04f7fe640 1 -- 172.21.15.132:0/2652122601 learned_addr learned my addr 172.21.15.132:0/2652122601 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:55.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fe04ffff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe050165c80 0x7fe050069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fe0549b3640 1 -- 172.21.15.132:0/2652122601 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0500c93d0 con 0x7fe0500c1980 2023-12-20T04:42:55.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fb57124b640 1 -- 172.21.15.132:0/201886642 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56c0ce090 con 0x7fb56c0adb40 2023-12-20T04:42:55.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fe0549b3640 1 -- 172.21.15.132:0/2652122601 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe05006fa80 con 0x7fe050165c80 2023-12-20T04:42:55.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fb57124b640 1 -- 172.21.15.132:0/201886642 --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb56c0c4240 con 0x7fb56c0b0c60 2023-12-20T04:42:55.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.900+0000 7effff59e640 1 -- start start 2023-12-20T04:42:55.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fb57124b640 1 -- 172.21.15.132:0/201886642 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb56c161700 con 0x7fb56c161320 2023-12-20T04:42:55.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7f48d67fc640 1 -- 172.21.15.132:0/2424787488 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d002e950 con 0x7f48d806d630 2023-12-20T04:42:55.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7f48d67fc640 1 -- 172.21.15.132:0/2424787488 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d0032070 con 0x7f48d806d630 2023-12-20T04:42:55.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7f48d67fc640 1 -- 172.21.15.132:0/2424787488 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d002ecd0 con 0x7f48d806d630 2023-12-20T04:42:55.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fb569d9b640 1 -- 172.21.15.132:0/201886642 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 820498469 0 0) 0x7fb56c0c4240 con 0x7fb56c0b0c60 2023-12-20T04:42:55.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fb569d9b640 1 -- 172.21.15.132:0/201886642 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb554003520 con 0x7fb56c0b0c60 2023-12-20T04:42:55.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fb569d9b640 1 -- 172.21.15.132:0/201886642 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3124011344 0 0) 0x7fb56c0ce090 con 0x7fb56c0adb40 2023-12-20T04:42:55.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fe04f7fe640 1 -- 172.21.15.132:0/2652122601 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe050165c80 msgr2=0x7fe050069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:55.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fe04f7fe640 1 --2- 172.21.15.132:0/2652122601 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe050165c80 0x7fe050069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fe04f7fe640 1 -- 172.21.15.132:0/2652122601 >> v1:172.21.15.132:6789/0 conn(0x7fe0500ce250 legacy=0x7fe05006f370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fe04f7fe640 1 -- 172.21.15.132:0/2652122601 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe050166130 con 0x7fe0500c1980 2023-12-20T04:42:55.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7f9c01ffb640 1 -- 172.21.15.132:0/3390453373 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4030840 con 0x7f9c04161560 2023-12-20T04:42:55.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7f9c01ffb640 1 -- 172.21.15.132:0/3390453373 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf40309a0 con 0x7f9c04161560 2023-12-20T04:42:55.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7f9c01ffb640 1 -- 172.21.15.132:0/3390453373 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf4030d10 con 0x7f9c04161560 2023-12-20T04:42:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fb569d9b640 1 -- 172.21.15.132:0/201886642 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb56c0c4240 con 0x7fb56c0adb40 2023-12-20T04:42:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fb569d9b640 1 -- 172.21.15.132:0/201886642 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3478741755 0 0) 0x7fb554003520 con 0x7fb56c0b0c60 2023-12-20T04:42:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fb569d9b640 1 -- 172.21.15.132:0/201886642 >> v2:172.21.15.132:3300/0 conn(0x7fb56c161320 msgr2=0x7fb56c0c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fb569d9b640 1 --2- 172.21.15.132:0/201886642 >> v2:172.21.15.132:3300/0 conn(0x7fb56c161320 0x7fb56c0c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fb569d9b640 1 -- 172.21.15.132:0/201886642 >> v1:172.21.15.132:6789/0 conn(0x7fb56c0adb40 legacy=0x7fb56c0b0550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fb569d9b640 1 -- 172.21.15.132:0/201886642 --> v1:172.21.15.187:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56c0ae2d0 con 0x7fb56c0b0c60 2023-12-20T04:42:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fb569d9b640 1 -- 172.21.15.132:0/201886642 <== mon.1 v1:172.21.15.187:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fb5640019f0 con 0x7fb56c0b0c60 2023-12-20T04:42:55.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fb569d9b640 1 -- 172.21.15.132:0/201886642 >> v1:172.21.15.187:6789/0 conn(0x7fb56c0b0c60 legacy=0x7fb56c06b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fb569d9b640 1 --2- 172.21.15.132:0/201886642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb554003b00 0x7fb554003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7fb569d9b640 1 --2- 172.21.15.132:0/201886642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb554007960 0x7fb554009d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7fb569d9b640 1 --2- 172.21.15.132:0/201886642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55400a420 0x7fb55400c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7fb569d9b640 1 -- 172.21.15.132:0/201886642 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c161700 con 0x7fb554003b00 2023-12-20T04:42:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7fb569d9b640 1 -- 172.21.15.132:0/201886642 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55400d190 con 0x7fb55400a420 2023-12-20T04:42:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7fb569d9b640 1 -- 172.21.15.132:0/201886642 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55400d350 con 0x7fb554007960 2023-12-20T04:42:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7fb56b59e640 1 --2- 172.21.15.132:0/201886642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55400a420 0x7fb55400c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7fb56ad9d640 1 --2- 172.21.15.132:0/201886642 >> v2:172.21.15.132:3300/0 conn(0x7fb56c161320 0x7fb56c0c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7f48dceb4640 1 -- 172.21.15.132:0/2424787488 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48d806d630 msgr2=0x7f48d80ca070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7f48dceb4640 1 --2- 172.21.15.132:0/2424787488 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48d806d630 0x7f48d80ca070 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f48d000bec0 tx=0x7f48d002dc20 comp rx=0 tx=0).stop 2023-12-20T04:42:55.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7effff59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f00001612d0 0x7f00000cdf30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7effff59e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00000ce470 0x7f00000b08f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7effff59e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f00000b0e30 0x7f00000cc8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7effff59e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000006c080 con 0x7f00001612d0 2023-12-20T04:42:55.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7effff59e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f000006f5b0 con 0x7f00000b0e30 2023-12-20T04:42:55.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.901+0000 7effff59e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00000ce8f0 con 0x7f00000ce470 2023-12-20T04:42:55.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7efffed9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f00000b0e30 0x7f00000cc8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7efff7fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00000ce470 0x7f00000b08f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7efffed9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f00000b0e30 0x7f00000cc8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:45018/0 (socket says 172.21.15.132:45018) 2023-12-20T04:42:55.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7efffed9d640 1 -- 172.21.15.132:0/1257801830 learned_addr learned my addr 172.21.15.132:0/1257801830 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7efffed9d640 1 -- 172.21.15.132:0/1257801830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00000ce470 msgr2=0x7f00000b08f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7efffed9d640 1 --2- 172.21.15.132:0/1257801830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00000ce470 0x7f00000b08f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7efffed9d640 1 -- 172.21.15.132:0/1257801830 >> v2:172.21.15.132:3300/0 conn(0x7f00001612d0 msgr2=0x7f00000cdf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7efffed9d640 1 --2- 172.21.15.132:0/1257801830 >> v2:172.21.15.132:3300/0 conn(0x7f00001612d0 0x7f00000cdf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7efffed9d640 1 -- 172.21.15.132:0/1257801830 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00001616b0 con 0x7f00000b0e30 2023-12-20T04:42:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7f48dceb4640 1 -- 172.21.15.132:0/2424787488 shutdown_connections 2023-12-20T04:42:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7f48dceb4640 1 --2- 172.21.15.132:0/2424787488 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48d806d630 0x7f48d80ca070 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7f48dceb4640 1 -- 172.21.15.132:0/2424787488 >> 172.21.15.132:0/2424787488 conn(0x7f48d80cf240 msgr2=0x7f48d80cf650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7f48dceb4640 1 -- 172.21.15.132:0/2424787488 shutdown_connections 2023-12-20T04:42:55.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7f48dceb4640 1 -- 172.21.15.132:0/2424787488 wait complete. 2023-12-20T04:42:55.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7fb56a59c640 1 --2- 172.21.15.132:0/201886642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb554007960 0x7fb554009d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7fb56b59e640 1 -- 172.21.15.132:0/201886642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb554007960 msgr2=0x7fb554009d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:55.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7fb56b59e640 1 --2- 172.21.15.132:0/201886642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb554007960 0x7fb554009d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7fb56ad9d640 1 --2- 172.21.15.132:0/201886642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb554003b00 0x7fb554003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7fb56b59e640 1 -- 172.21.15.132:0/201886642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb554003b00 msgr2=0x7fb554003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:55.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7fb56b59e640 1 --2- 172.21.15.132:0/201886642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb554003b00 0x7fb554003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7f9c0960b640 1 -- 172.21.15.132:0/3390453373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c04161560 msgr2=0x7f9c04165c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7fb56b59e640 1 -- 172.21.15.132:0/201886642 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56c0ae2d0 con 0x7fb55400a420 2023-12-20T04:42:55.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7fb56ad9d640 1 --2- 172.21.15.132:0/201886642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb554003b00 0x7fb554003f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:55.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7fe04f7fe640 1 --2- 172.21.15.132:0/2652122601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0500c1980 0x7fe0500c1d60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe0380098a0 tx=0x7fe03802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4e7d34fec28d279 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7f9c0960b640 1 --2- 172.21.15.132:0/3390453373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c04161560 0x7f9c04165c10 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40097a0 tx=0x7f9bf402b980 comp rx=0 tx=0).stop 2023-12-20T04:42:55.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7f905b7fe640 1 --2- 172.21.15.132:0/2204416509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f905404fc30 0x7f90540481b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9048009870 tx=0x7f904802b9c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c5e0aa91aa3d1e05 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7f905affd640 1 -- 172.21.15.132:0/2204416509 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048030880 con 0x7f905404fc30 2023-12-20T04:42:55.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7f905affd640 1 -- 172.21.15.132:0/2204416509 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90480309e0 con 0x7f905404fc30 2023-12-20T04:42:55.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.902+0000 7f905affd640 1 -- 172.21.15.132:0/2204416509 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048030d70 con 0x7f905404fc30 2023-12-20T04:42:55.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7fe04effd640 1 -- 172.21.15.132:0/2652122601 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038031640 con 0x7fe0500c1980 2023-12-20T04:42:55.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7f90616b4640 1 -- 172.21.15.132:0/2204416509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f905404fc30 msgr2=0x7f90540481b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7fe04effd640 1 -- 172.21.15.132:0/2652122601 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0380317a0 con 0x7fe0500c1980 2023-12-20T04:42:55.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7f9c0960b640 1 -- 172.21.15.132:0/3390453373 shutdown_connections 2023-12-20T04:42:55.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7f9c0960b640 1 --2- 172.21.15.132:0/3390453373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c04161560 0x7f9c04165c10 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7f9c0960b640 1 -- 172.21.15.132:0/3390453373 >> 172.21.15.132:0/3390453373 conn(0x7f9c0406a050 msgr2=0x7f9c0406a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:55.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7fe04effd640 1 -- 172.21.15.132:0/2652122601 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038031b30 con 0x7fe0500c1980 2023-12-20T04:42:55.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7f9c0960b640 1 -- 172.21.15.132:0/3390453373 shutdown_connections 2023-12-20T04:42:55.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7f9c0960b640 1 -- 172.21.15.132:0/3390453373 wait complete. 2023-12-20T04:42:55.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7f90616b4640 1 --2- 172.21.15.132:0/2204416509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f905404fc30 0x7f90540481b0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7f9048009870 tx=0x7f904802b9c0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7f90616b4640 1 -- 172.21.15.132:0/2204416509 shutdown_connections 2023-12-20T04:42:55.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7f90616b4640 1 --2- 172.21.15.132:0/2204416509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f905404fc30 0x7f90540481b0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7f90616b4640 1 -- 172.21.15.132:0/2204416509 >> 172.21.15.132:0/2204416509 conn(0x7f9054054ed0 msgr2=0x7f90540552e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:55.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7f90616b4640 1 -- 172.21.15.132:0/2204416509 shutdown_connections 2023-12-20T04:42:55.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7f90616b4640 1 -- 172.21.15.132:0/2204416509 wait complete. 2023-12-20T04:42:55.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.904+0000 7fb56b59e640 1 -- 172.21.15.132:0/201886642 reap_dead start 2023-12-20T04:42:55.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.904+0000 7fb56b59e640 1 --2- 172.21.15.132:0/201886642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55400a420 0x7fb55400c8b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb564018fd0 tx=0x7fb5540057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f1272ff4c2e20552 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7f541c7e3640 1 Processor -- start 2023-12-20T04:42:55.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.903+0000 7f541c7e3640 1 -- start start 2023-12-20T04:42:55.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.904+0000 7f48dceb4640 1 Processor -- start 2023-12-20T04:42:55.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.904+0000 7fb569d9b640 1 -- 172.21.15.132:0/201886642 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb56403dcf0 con 0x7fb55400a420 2023-12-20T04:42:55.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.904+0000 7fb569d9b640 1 -- 172.21.15.132:0/201886642 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb56403de70 con 0x7fb55400a420 2023-12-20T04:42:55.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.904+0000 7fb569d9b640 1 -- 172.21.15.132:0/201886642 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb564045660 con 0x7fb55400a420 2023-12-20T04:42:55.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.904+0000 7f48dceb4640 1 -- start start 2023-12-20T04:42:55.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.904+0000 7fe0549b3640 1 -- 172.21.15.132:0/2652122601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0500c1980 msgr2=0x7fe0500c1d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.904+0000 7efffed9d640 1 --2- 172.21.15.132:0/1257801830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00000b0e30 0x7f00000cc8c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f00000c27b0 tx=0x7efff802be70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9310e4d727fe8d8b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.904+0000 7efffdd9b640 1 -- 172.21.15.132:0/1257801830 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff802ca10 con 0x7f00000b0e30 2023-12-20T04:42:55.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.904+0000 7efffdd9b640 1 -- 172.21.15.132:0/1257801830 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff802cb70 con 0x7f00000b0e30 2023-12-20T04:42:55.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.904+0000 7efffdd9b640 1 -- 172.21.15.132:0/1257801830 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff80343f0 con 0x7f00000b0e30 2023-12-20T04:42:55.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7fe0549b3640 1 --2- 172.21.15.132:0/2652122601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0500c1980 0x7fe0500c1d60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe0380098a0 tx=0x7fe03802b8f0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7f541c7e3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f54141619d0 0x7f54140b0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7f541c7e3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541406bb90 con 0x7f54140b0cd0 2023-12-20T04:42:55.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7fe0549b3640 1 -- 172.21.15.132:0/2652122601 shutdown_connections 2023-12-20T04:42:55.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7fe0549b3640 1 --2- 172.21.15.132:0/2652122601 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe050165c80 0x7fe050069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7fe0549b3640 1 --2- 172.21.15.132:0/2652122601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0500c1980 0x7fe0500c1d60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7f9c0960b640 1 Processor -- start 2023-12-20T04:42:55.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7effff59e640 1 -- 172.21.15.132:0/1257801830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00000b0e30 msgr2=0x7f00000cc8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7fb57124b640 1 -- 172.21.15.132:0/201886642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55400a420 msgr2=0x7fb55400c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7fb57124b640 1 --2- 172.21.15.132:0/201886642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55400a420 0x7fb55400c8b0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fb564018fd0 tx=0x7fb5540057f0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7fe0549b3640 1 -- 172.21.15.132:0/2652122601 >> 172.21.15.132:0/2652122601 conn(0x7fe0500cea50 msgr2=0x7fe0500cee30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:55.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7f90616b4640 1 Processor -- start 2023-12-20T04:42:55.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7f90616b4640 1 -- start start 2023-12-20T04:42:55.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f9c0960b640 1 -- start start 2023-12-20T04:42:55.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7fe0549b3640 1 -- 172.21.15.132:0/2652122601 shutdown_connections 2023-12-20T04:42:55.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7effff59e640 1 --2- 172.21.15.132:0/1257801830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00000b0e30 0x7f00000cc8c0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f00000c27b0 tx=0x7efff802be70 comp rx=0 tx=0).stop 2023-12-20T04:42:55.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7fe0549b3640 1 -- 172.21.15.132:0/2652122601 wait complete. 2023-12-20T04:42:55.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7effff59e640 1 -- 172.21.15.132:0/1257801830 shutdown_connections 2023-12-20T04:42:55.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7effff59e640 1 --2- 172.21.15.132:0/1257801830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00000b0e30 0x7f00000cc8c0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7effff59e640 1 --2- 172.21.15.132:0/1257801830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00000ce470 0x7f00000b08f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7effff59e640 1 --2- 172.21.15.132:0/1257801830 >> v2:172.21.15.132:3300/0 conn(0x7f00001612d0 0x7f00000cdf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7effff59e640 1 -- 172.21.15.132:0/1257801830 >> 172.21.15.132:0/1257801830 conn(0x7f00000cb800 msgr2=0x7f00000cbbe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:55.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7f541c7e3640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f541406b260 con 0x7f54140c20e0 2023-12-20T04:42:55.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7f541c7e3640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54140b1140 con 0x7f54141619d0 2023-12-20T04:42:55.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7f541ad80640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f54140b0cd0 0x7f54140cdee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45918/0 (socket says 172.21.15.132:45918) 2023-12-20T04:42:55.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7f541ad80640 1 -- 172.21.15.132:0/509565338 learned_addr learned my addr 172.21.15.132:0/509565338 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:55.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.905+0000 7f541957d640 1 -- 172.21.15.132:0/509565338 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3592700316 0 0) 0x7f541406bb90 con 0x7f54140b0cd0 2023-12-20T04:42:55.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f541957d640 1 -- 172.21.15.132:0/509565338 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5400003520 con 0x7f54140b0cd0 2023-12-20T04:42:55.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f48dceb4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48d806d630 0x7f48d8147eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7effff59e640 1 -- 172.21.15.132:0/1257801830 shutdown_connections 2023-12-20T04:42:55.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7effff59e640 1 -- 172.21.15.132:0/1257801830 wait complete. 2023-12-20T04:42:55.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f48dceb4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48d8159420 0x7f48d80c6990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f48d77fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48d806d630 0x7f48d8147eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f48d77fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48d806d630 0x7f48d8147eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:45040/0 (socket says 172.21.15.132:45040) 2023-12-20T04:42:55.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f541957d640 1 -- 172.21.15.132:0/509565338 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1703957002 0 0) 0x7f5400003520 con 0x7f54140b0cd0 2023-12-20T04:42:55.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f541957d640 1 -- 172.21.15.132:0/509565338 >> v2:172.21.15.132:3300/0 conn(0x7f54141619d0 msgr2=0x7f54140b0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:55.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f541957d640 1 --2- 172.21.15.132:0/509565338 >> v2:172.21.15.132:3300/0 conn(0x7f54141619d0 0x7f54140b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f541957d640 1 -- 172.21.15.132:0/509565338 >> v1:172.21.15.187:6789/0 conn(0x7f54140c20e0 legacy=0x7f54140cace0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-20T04:42:55.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f541957d640 1 -- 172.21.15.132:0/509565338 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541406b540 con 0x7f54140b0cd0 2023-12-20T04:42:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f541957d640 1 -- 172.21.15.132:0/509565338 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f540c0019f0 con 0x7f54140b0cd0 2023-12-20T04:42:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f541957d640 1 -- 172.21.15.132:0/509565338 >> v1:172.21.15.132:6789/0 conn(0x7f54140b0cd0 legacy=0x7f54140cdee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f541957d640 1 --2- 172.21.15.132:0/509565338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5400003970 0x7f5400003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f541957d640 1 --2- 172.21.15.132:0/509565338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54000047c0 0x7f5400004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f541957d640 1 --2- 172.21.15.132:0/509565338 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5400005380 0x7f540000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f541957d640 1 -- 172.21.15.132:0/509565338 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54140b1140 con 0x7f54000047c0 2023-12-20T04:42:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f541957d640 1 -- 172.21.15.132:0/509565338 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f540000c220 con 0x7f5400003970 2023-12-20T04:42:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f541957d640 1 -- 172.21.15.132:0/509565338 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f540000c3e0 con 0x7f5400005380 2023-12-20T04:42:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f541a57f640 1 --2- 172.21.15.132:0/509565338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5400003970 0x7f5400003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f90616b4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f905404b430 0x7f905417dd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f48d77fe640 1 -- 172.21.15.132:0/1492612200 learned_addr learned my addr 172.21.15.132:0/1492612200 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:55.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f6c6ff89640 1 Processor -- start 2023-12-20T04:42:55.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f6c6ff89640 1 -- start start 2023-12-20T04:42:55.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.906+0000 7f541ad80640 1 --2- 172.21.15.132:0/509565338 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5400005380 0x7f540000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f48dceb4640 1 --2- 172.21.15.132:0/1492612200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48d8159800 0x7f48d80b4440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f48d6ffd640 1 --2- 172.21.15.132:0/1492612200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48d8159420 0x7f48d80c6990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f541a57f640 1 -- 172.21.15.132:0/509565338 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5400005380 msgr2=0x7f540000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f541a57f640 1 --2- 172.21.15.132:0/509565338 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5400005380 0x7f540000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f541a57f640 1 -- 172.21.15.132:0/509565338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54000047c0 msgr2=0x7f5400004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f5419d7e640 1 --2- 172.21.15.132:0/509565338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54000047c0 0x7f5400004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f9c0960b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c040cb620 0x7f9c041fa110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f905bfff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f905404b430 0x7f905417dd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f48d7fff640 1 --2- 172.21.15.132:0/1492612200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48d8159800 0x7f48d80b4440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f9c0960b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c040cba60 0x7f9c040c48d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f905bfff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f905404b430 0x7f905417dd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:52372/0 (socket says 172.21.15.132:52372) 2023-12-20T04:42:55.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f9c02ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c040cb620 0x7f9c041fa110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f9c02ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c040cb620 0x7f9c041fa110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49220/0 (socket says 172.21.15.132:49220) 2023-12-20T04:42:55.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f9c0960b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c04161560 0x7f9c04164260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f9c0960b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c04163b30 con 0x7f9c040cb620 2023-12-20T04:42:55.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f9c02ffd640 1 -- 172.21.15.132:0/436405229 learned_addr learned my addr 172.21.15.132:0/436405229 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:55.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f48dceb4640 1 -- 172.21.15.132:0/1492612200 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d81451a0 con 0x7f48d8159800 2023-12-20T04:42:55.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f48dceb4640 1 -- 172.21.15.132:0/1492612200 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48d81483f0 con 0x7f48d806d630 2023-12-20T04:42:55.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f48dceb4640 1 -- 172.21.15.132:0/1492612200 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48d8145410 con 0x7f48d8159420 2023-12-20T04:42:55.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f9c0960b640 1 -- 172.21.15.132:0/436405229 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c041fa650 con 0x7f9c04161560 2023-12-20T04:42:55.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f9c0960b640 1 -- 172.21.15.132:0/436405229 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c041fa8f0 con 0x7f9c040cba60 2023-12-20T04:42:55.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f90616b4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f905404fc30 0x7f9054037a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f90616b4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9054052b10 0x7f905417a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f90616b4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9054037f50 con 0x7f905404fc30 2023-12-20T04:42:55.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7fb57124b640 1 -- 172.21.15.132:0/201886642 shutdown_connections 2023-12-20T04:42:55.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7fb57124b640 1 --2- 172.21.15.132:0/201886642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55400a420 0x7fb55400c8b0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7fb57124b640 1 -- 172.21.15.132:0/201886642 >> 172.21.15.132:0/201886642 conn(0x7fb56c0ce970 msgr2=0x7fb56c0ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:55.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7fb57124b640 1 -- 172.21.15.132:0/201886642 shutdown_connections 2023-12-20T04:42:55.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7fe0549b3640 1 Processor -- start 2023-12-20T04:42:55.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7effff59e640 1 Processor -- start 2023-12-20T04:42:55.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f541a57f640 1 --2- 172.21.15.132:0/509565338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54000047c0 0x7f5400004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f541a57f640 1 -- 172.21.15.132:0/509565338 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f541406b540 con 0x7f5400003970 2023-12-20T04:42:55.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f541ad80640 1 -- 172.21.15.132:0/509565338 reap_dead start 2023-12-20T04:42:55.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7fe0549b3640 1 -- start start 2023-12-20T04:42:55.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f48d6ffd640 1 -- 172.21.15.132:0/1492612200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48d806d630 msgr2=0x7f48d8147eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f48d6ffd640 1 --2- 172.21.15.132:0/1492612200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48d806d630 0x7f48d8147eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f48d6ffd640 1 -- 172.21.15.132:0/1492612200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48d8159800 msgr2=0x7f48d80b4440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f48d6ffd640 1 --2- 172.21.15.132:0/1492612200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48d8159800 0x7f48d80b4440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f48d6ffd640 1 -- 172.21.15.132:0/1492612200 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d000bb70 con 0x7f48d8159420 2023-12-20T04:42:55.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f48d7fff640 1 --2- 172.21.15.132:0/1492612200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48d8159800 0x7f48d80b4440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:55.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f6c6ff89640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6c6808ab60 0x7f6c6806bbd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f6c6ff89640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c680c92d0 0x7f6c680cace0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f6c6ff89640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6c6816d7b0 con 0x7f6c680b0790 2023-12-20T04:42:55.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f6c6ff89640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6c6816da00 con 0x7f6c6808ab60 2023-12-20T04:42:55.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f6c6ff89640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c6816dce0 con 0x7f6c680c92d0 2023-12-20T04:42:55.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f6c6d524640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c680c92d0 0x7f6c680cace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f6c6d524640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c680c92d0 0x7f6c680cace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:52382/0 (socket says 172.21.15.132:52382) 2023-12-20T04:42:55.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f6c6d524640 1 -- 172.21.15.132:0/1809338175 learned_addr learned my addr 172.21.15.132:0/1809338175 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:55.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f48d77fe640 1 --2- 172.21.15.132:0/1492612200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48d806d630 0x7f48d8147eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:55.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f48d6ffd640 1 --2- 172.21.15.132:0/1492612200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48d8159420 0x7f48d80c6990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f48c800c450 tx=0x7f48c800c910 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7effff59e640 1 -- start start 2023-12-20T04:42:55.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7fb57124b640 1 -- 172.21.15.132:0/201886642 wait complete. 2023-12-20T04:42:55.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f9c027fc640 1 --2- 172.21.15.132:0/436405229 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c040cba60 0x7f9c040c48d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f9c037fe640 1 --2- 172.21.15.132:0/436405229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c04161560 0x7f9c04164260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f9c027fc640 1 -- 172.21.15.132:0/436405229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c04161560 msgr2=0x7f9c04164260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f9c027fc640 1 --2- 172.21.15.132:0/436405229 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c04161560 0x7f9c04164260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7f9c027fc640 1 -- 172.21.15.132:0/436405229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c040cb620 msgr2=0x7f9c041fa110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7f9c027fc640 1 --2- 172.21.15.132:0/436405229 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c040cb620 0x7f9c041fa110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7f9c027fc640 1 -- 172.21.15.132:0/436405229 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf4009400 con 0x7f9c040cba60 2023-12-20T04:42:55.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f5419d7e640 1 --2- 172.21.15.132:0/509565338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54000047c0 0x7f5400004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:55.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7f48bffff640 1 -- 172.21.15.132:0/1492612200 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c80035f0 con 0x7f48d8159420 2023-12-20T04:42:55.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7f48bffff640 1 -- 172.21.15.132:0/1492612200 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48c8003770 con 0x7f48d8159420 2023-12-20T04:42:55.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7f48bffff640 1 -- 172.21.15.132:0/1492612200 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48c8003b20 con 0x7f48d8159420 2023-12-20T04:42:55.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7f48dceb4640 1 -- 172.21.15.132:0/1492612200 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48d81456b0 con 0x7f48d8159420 2023-12-20T04:42:55.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f6c6d524640 1 -- 172.21.15.132:0/1809338175 >> v2:172.21.15.132:3300/0 conn(0x7f6c6808ab60 msgr2=0x7f6c6806bbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:55.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f6c6d524640 1 --2- 172.21.15.132:0/1809338175 >> v2:172.21.15.132:3300/0 conn(0x7f6c6808ab60 0x7f6c6806bbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f6c6d524640 1 -- 172.21.15.132:0/1809338175 >> v1:172.21.15.132:6789/0 conn(0x7f6c680b0790 legacy=0x7f6c6816c890 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-20T04:42:55.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f6c6d524640 1 -- 172.21.15.132:0/1809338175 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c6816dfc0 con 0x7f6c680c92d0 2023-12-20T04:42:55.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f90616b4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f905417ac30 con 0x7f9054052b10 2023-12-20T04:42:55.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f90616b4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90540381b0 con 0x7f905404b430 2023-12-20T04:42:55.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.907+0000 7f905bfff640 1 -- 172.21.15.132:0/2627095830 learned_addr learned my addr 172.21.15.132:0/2627095830 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:55.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f9060eb3640 1 --2- 172.21.15.132:0/2627095830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9054052b10 0x7f905417a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f905b7fe640 1 --2- 172.21.15.132:0/2627095830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f905404fc30 0x7f9054037a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f905b7fe640 1 -- 172.21.15.132:0/2627095830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f905404b430 msgr2=0x7f905417dd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f905b7fe640 1 --2- 172.21.15.132:0/2627095830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f905404b430 0x7f905417dd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f905b7fe640 1 -- 172.21.15.132:0/2627095830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9054052b10 msgr2=0x7f905417a6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f905b7fe640 1 --2- 172.21.15.132:0/2627095830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9054052b10 0x7f905417a6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f905b7fe640 1 -- 172.21.15.132:0/2627095830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90480094d0 con 0x7f905404fc30 2023-12-20T04:42:55.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.908+0000 7f9060eb3640 1 --2- 172.21.15.132:0/2627095830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9054052b10 0x7f905417a6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:55.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7f905b7fe640 1 --2- 172.21.15.132:0/2627095830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f905404fc30 0x7f9054037a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9048033000 tx=0x7f9048004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7f541a57f640 1 --2- 172.21.15.132:0/509565338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5400003970 0x7f5400003d70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5404009860 tx=0x7f54000057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c380ca496ac12d20 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7f48dceb4640 1 -- 172.21.15.132:0/1492612200 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48d8145c70 con 0x7f48d8159420 2023-12-20T04:42:55.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7f9c027fc640 1 --2- 172.21.15.132:0/436405229 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c040cba60 0x7f9c040c48d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800c410 tx=0x7f9bf800c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7f9058ff9640 1 -- 172.21.15.132:0/2627095830 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048047070 con 0x7f905404fc30 2023-12-20T04:42:55.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7effff59e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00000b0e30 0x7f00001f5e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7f9058ff9640 1 -- 172.21.15.132:0/2627095830 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9048039b60 con 0x7f905404fc30 2023-12-20T04:42:55.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7effff59e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00000ce470 0x7f00000c4e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7f9058ff9640 1 -- 172.21.15.132:0/2627095830 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9048043400 con 0x7f905404fc30 2023-12-20T04:42:55.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7f541957d640 1 -- 172.21.15.132:0/509565338 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404032600 con 0x7f5400003970 2023-12-20T04:42:55.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7fe0549b3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0500c1980 0x7fe0501f7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7fe0549b3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0500ce250 0x7fe050162660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7f90616b4640 1 -- 172.21.15.132:0/2627095830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9054038490 con 0x7f905404fc30 2023-12-20T04:42:55.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7fe04f7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0500c1980 0x7fe0501f7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7fe04f7fe640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0500c1980 0x7fe0501f7890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:45086/0 (socket says 172.21.15.132:45086) 2023-12-20T04:42:55.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7fe04f7fe640 1 -- 172.21.15.132:0/300856666 learned_addr learned my addr 172.21.15.132:0/300856666 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:55.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7fe046ffd640 1 --2- 172.21.15.132:0/300856666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0500ce250 0x7fe050162660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7f9beb7fe640 1 -- 172.21.15.132:0/436405229 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8011790 con 0x7f9c040cba60 2023-12-20T04:42:55.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7f541957d640 1 -- 172.21.15.132:0/509565338 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540402e050 con 0x7f5400003970 2023-12-20T04:42:55.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7fe0549b3640 1 --2- 172.21.15.132:0/300856666 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe050165c80 0x7fe0500c4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7f6c6d524640 1 --2- 172.21.15.132:0/1809338175 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c680c92d0 0x7f6c680cace0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6c64014a00 tx=0x7f6c64034970 comp rx=0 tx=0).ready entity=mon.2 client_cookie=64cac2ab643b760f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7f9beb7fe640 1 -- 172.21.15.132:0/436405229 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf80118f0 con 0x7f9c040cba60 2023-12-20T04:42:55.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7f541957d640 1 -- 172.21.15.132:0/509565338 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5404032600 con 0x7f5400003970 2023-12-20T04:42:55.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7f541c7e3640 1 -- 172.21.15.132:0/509565338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5400003970 msgr2=0x7f5400003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7f541c7e3640 1 --2- 172.21.15.132:0/509565338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5400003970 0x7f5400003d70 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f5404009860 tx=0x7f54000057f0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7f9beb7fe640 1 -- 172.21.15.132:0/436405229 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf8011ca0 con 0x7f9c040cba60 2023-12-20T04:42:55.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7fe0549b3640 1 -- 172.21.15.132:0/300856666 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe050161cd0 con 0x7fe0500ce250 2023-12-20T04:42:55.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7fe0549b3640 1 -- 172.21.15.132:0/300856666 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0501f6dd0 con 0x7fe0500c1980 2023-12-20T04:42:55.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7f9c0960b640 1 -- 172.21.15.132:0/436405229 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c041fabd0 con 0x7f9c040cba60 2023-12-20T04:42:55.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7fe0549b3640 1 -- 172.21.15.132:0/300856666 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe050161f20 con 0x7fe050165c80 2023-12-20T04:42:55.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7fe04ffff640 1 --2- 172.21.15.132:0/300856666 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe050165c80 0x7fe0500c4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7f6c6cd23640 1 -- 172.21.15.132:0/1809338175 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640114e0 con 0x7f6c680c92d0 2023-12-20T04:42:55.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7efffe59c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00000b0e30 0x7f00001f5e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7efffe59c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00000b0e30 0x7f00001f5e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:45080/0 (socket says 172.21.15.132:45080) 2023-12-20T04:42:55.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7effff59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00001612d0 0x7f00000c39c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7f9c0960b640 1 -- 172.21.15.132:0/436405229 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c04163d40 con 0x7f9c040cba60 2023-12-20T04:42:55.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7efff7fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00000ce470 0x7f00000c4e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7efff7fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00000ce470 0x7f00000c4e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:52386/0 (socket says 172.21.15.132:52386) 2023-12-20T04:42:55.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7efffe59c640 1 -- 172.21.15.132:0/1551190985 learned_addr learned my addr 172.21.15.132:0/1551190985 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:55.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7effff59e640 1 -- 172.21.15.132:0/1551190985 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00000c2640 con 0x7f00001612d0 2023-12-20T04:42:55.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7effff59e640 1 -- 172.21.15.132:0/1551190985 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00000c2920 con 0x7f00000b0e30 2023-12-20T04:42:55.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7effff59e640 1 -- 172.21.15.132:0/1551190985 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00000c2c00 con 0x7f00000ce470 2023-12-20T04:42:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.909+0000 7efffed9d640 1 --2- 172.21.15.132:0/1551190985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00001612d0 0x7f00000c39c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7efffe59c640 1 -- 172.21.15.132:0/1551190985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00000ce470 msgr2=0x7f00000c4e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7efffe59c640 1 --2- 172.21.15.132:0/1551190985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00000ce470 0x7f00000c4e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7efffe59c640 1 -- 172.21.15.132:0/1551190985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00001612d0 msgr2=0x7f00000c39c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7efffe59c640 1 --2- 172.21.15.132:0/1551190985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00001612d0 0x7f00000c39c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7efffe59c640 1 -- 172.21.15.132:0/1551190985 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff8009b30 con 0x7f00000b0e30 2023-12-20T04:42:55.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7fb57124b640 1 Processor -- start 2023-12-20T04:42:55.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7f6c6cd23640 1 -- 172.21.15.132:0/1809338175 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c64011640 con 0x7f6c680c92d0 2023-12-20T04:42:55.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7f6c6cd23640 1 -- 172.21.15.132:0/1809338175 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c640119d0 con 0x7f6c680c92d0 2023-12-20T04:42:55.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.910+0000 7fb57124b640 1 -- start start 2023-12-20T04:42:55.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7efffe59c640 1 --2- 172.21.15.132:0/1551190985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00000b0e30 0x7f00001f5e20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efff000b4a0 tx=0x7efff000b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7f541c7e3640 1 -- 172.21.15.132:0/509565338 shutdown_connections 2023-12-20T04:42:55.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7f541c7e3640 1 --2- 172.21.15.132:0/509565338 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5400003970 0x7f5400003d70 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7f541c7e3640 1 -- 172.21.15.132:0/509565338 >> 172.21.15.132:0/509565338 conn(0x7f54140ced10 msgr2=0x7f54140cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:55.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7f48bffff640 1 -- 172.21.15.132:0/1492612200 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f48c8003c80 con 0x7f48d8159420 2023-12-20T04:42:55.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7f48dceb4640 1 -- 172.21.15.132:0/1492612200 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f48b8000fc0 con 0x7f48d8159420 2023-12-20T04:42:55.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7efffed9d640 1 --2- 172.21.15.132:0/1551190985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00001612d0 0x7f00000c39c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:55.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7efff6ffd640 1 -- 172.21.15.132:0/1551190985 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff0010610 con 0x7f00000b0e30 2023-12-20T04:42:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7f541c7e3640 1 -- 172.21.15.132:0/509565338 shutdown_connections 2023-12-20T04:42:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7efff6ffd640 1 -- 172.21.15.132:0/1551190985 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff0010770 con 0x7f00000b0e30 2023-12-20T04:42:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7fe04f7fe640 1 -- 172.21.15.132:0/300856666 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe050165c80 msgr2=0x7fe0500c4750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7fe04f7fe640 1 --2- 172.21.15.132:0/300856666 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe050165c80 0x7fe0500c4750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7fe04f7fe640 1 -- 172.21.15.132:0/300856666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0500ce250 msgr2=0x7fe050162660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7fe04f7fe640 1 --2- 172.21.15.132:0/300856666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0500ce250 0x7fe050162660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7fe04f7fe640 1 -- 172.21.15.132:0/300856666 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0380094d0 con 0x7fe0500c1980 2023-12-20T04:42:55.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7fe046ffd640 1 --2- 172.21.15.132:0/300856666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0500ce250 0x7fe050162660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:55.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7fb57124b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb55400a420 0x7fb56c14a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.911+0000 7f48bffff640 1 --2- 172.21.15.132:0/1492612200 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f48c406a500 0x7f48c406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fb57124b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb56c14a5f0 0x7fb56c14c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fb57124b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb56c14c570 0x7fb56c14c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7f48bffff640 1 -- 172.21.15.132:0/1492612200 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48c8087ea0 con 0x7f48d8159420 2023-12-20T04:42:55.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fb56ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb55400a420 0x7fb56c14a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fb57124b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c1544f0 con 0x7fb55400a420 2023-12-20T04:42:55.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fb56ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb55400a420 0x7fb56c14a0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49286/0 (socket says 172.21.15.132:49286) 2023-12-20T04:42:55.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fb56ad9d640 1 -- 172.21.15.132:0/3573568889 learned_addr learned my addr 172.21.15.132:0/3573568889 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:55.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fb56a59c640 1 --2- 172.21.15.132:0/3573568889 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb56c14a5f0 0x7fb56c14c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fb57124b640 1 -- 172.21.15.132:0/3573568889 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c0b20a0 con 0x7fb56c14c570 2023-12-20T04:42:55.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fb57124b640 1 -- 172.21.15.132:0/3573568889 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb56c14aa50 con 0x7fb56c14a5f0 2023-12-20T04:42:55.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7f48bffff640 1 --2- 172.21.15.132:0/1492612200 >> [v2:172.21.15.132:6816/84982,v1:172.21.15.132:6817/84982] conn(0x7f48c40726a0 0x7f48c4074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fe04f7fe640 1 --2- 172.21.15.132:0/300856666 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0500c1980 0x7fe0501f7890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0380098a0 tx=0x7fe0380046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7efff6ffd640 1 -- 172.21.15.132:0/1551190985 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff0010b00 con 0x7f00000b0e30 2023-12-20T04:42:55.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fe04cff9640 1 -- 172.21.15.132:0/300856666 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe03803abe0 con 0x7fe0500c1980 2023-12-20T04:42:55.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7f6c6ff89640 1 -- 172.21.15.132:0/1809338175 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c680c92d0 msgr2=0x7f6c680cace0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7f6c6ff89640 1 --2- 172.21.15.132:0/1809338175 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c680c92d0 0x7f6c680cace0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6c64014a00 tx=0x7f6c64034970 comp rx=0 tx=0).stop 2023-12-20T04:42:55.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fe04cff9640 1 -- 172.21.15.132:0/300856666 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe03803ad40 con 0x7fe0500c1980 2023-12-20T04:42:55.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fe04cff9640 1 -- 172.21.15.132:0/300856666 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038044630 con 0x7fe0500c1980 2023-12-20T04:42:55.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fb56ad9d640 1 -- 172.21.15.132:0/3573568889 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb56c14a5f0 msgr2=0x7fb56c14c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fb56ad9d640 1 --2- 172.21.15.132:0/3573568889 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb56c14a5f0 0x7fb56c14c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fb56ad9d640 1 -- 172.21.15.132:0/3573568889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb56c14c570 msgr2=0x7fb56c14c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fb56ad9d640 1 --2- 172.21.15.132:0/3573568889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb56c14c570 0x7fb56c14c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fb56ad9d640 1 -- 172.21.15.132:0/3573568889 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb56c147cb0 con 0x7fb55400a420 2023-12-20T04:42:55.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7effff59e640 1 -- 172.21.15.132:0/1551190985 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00000c2ee0 con 0x7f00000b0e30 2023-12-20T04:42:55.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7f48d77fe640 1 --2- 172.21.15.132:0/1492612200 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f48c406a500 0x7f48c406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7f48d7fff640 1 --2- 172.21.15.132:0/1492612200 >> [v2:172.21.15.132:6816/84982,v1:172.21.15.132:6817/84982] conn(0x7f48c40726a0 0x7f48c4074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.913+0000 7f48d7fff640 1 --2- 172.21.15.132:0/1492612200 >> [v2:172.21.15.132:6816/84982,v1:172.21.15.132:6817/84982] conn(0x7f48c40726a0 0x7f48c4074ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.913+0000 7f48bffff640 1 -- 172.21.15.132:0/1492612200 --> [v2:172.21.15.132:6816/84982,v1:172.21.15.132:6817/84982] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f48c4075170 con 0x7f48c40726a0 2023-12-20T04:42:55.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7f90616b4640 1 -- 172.21.15.132:0/2627095830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9054038a50 con 0x7f905404fc30 2023-12-20T04:42:55.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.913+0000 7fb56ad9d640 1 --2- 172.21.15.132:0/3573568889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb55400a420 0x7fb56c14a0b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00d830 tx=0x7fb55c00dcf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.913+0000 7f48bffff640 1 -- 172.21.15.132:0/1492612200 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f48c805d0d0 con 0x7f48d8159420 2023-12-20T04:42:55.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.913+0000 7f9058ff9640 1 -- 172.21.15.132:0/2627095830 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f904804c410 con 0x7f905404fc30 2023-12-20T04:42:55.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fe0549b3640 1 -- 172.21.15.132:0/300856666 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe050162200 con 0x7fe0500c1980 2023-12-20T04:42:55.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7fe0549b3640 1 -- 172.21.15.132:0/300856666 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0501f7370 con 0x7fe0500c1980 2023-12-20T04:42:55.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.913+0000 7f48d77fe640 1 --2- 172.21.15.132:0/1492612200 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f48c406a500 0x7f48c406c9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f48cc000f60 tx=0x7f48cc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.913+0000 7fb56a59c640 1 --2- 172.21.15.132:0/3573568889 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb56c14a5f0 0x7fb56c14c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:55.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.913+0000 7effff59e640 1 -- 172.21.15.132:0/1551190985 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00000c34a0 con 0x7f00000b0e30 2023-12-20T04:42:55.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.913+0000 7fb5537fe640 1 -- 172.21.15.132:0/3573568889 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c00dee0 con 0x7fb55400a420 2023-12-20T04:42:55.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.913+0000 7fb5537fe640 1 -- 172.21.15.132:0/3573568889 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55c00c040 con 0x7fb55400a420 2023-12-20T04:42:55.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.912+0000 7f541c7e3640 1 -- 172.21.15.132:0/509565338 wait complete. 2023-12-20T04:42:55.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.913+0000 7f6c6ff89640 1 -- 172.21.15.132:0/1809338175 shutdown_connections 2023-12-20T04:42:55.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.913+0000 7f6c6ff89640 1 --2- 172.21.15.132:0/1809338175 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c680c92d0 0x7f6c680cace0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.913+0000 7f6c6ff89640 1 --2- 172.21.15.132:0/1809338175 >> v2:172.21.15.132:3300/0 conn(0x7f6c6808ab60 0x7f6c6806bbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.913+0000 7f6c6ff89640 1 -- 172.21.15.132:0/1809338175 >> 172.21.15.132:0/1809338175 conn(0x7f6c680ced10 msgr2=0x7f6c680cf120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:55.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.914+0000 7f90616b4640 1 -- 172.21.15.132:0/2627095830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f9054054b30 con 0x7f905404fc30 2023-12-20T04:42:55.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.914+0000 7fb5537fe640 1 -- 172.21.15.132:0/3573568889 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55c008ca0 con 0x7fb55400a420 2023-12-20T04:42:55.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.914+0000 7fb57124b640 1 -- 172.21.15.132:0/3573568889 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb56c14cf30 con 0x7fb55400a420 2023-12-20T04:42:55.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.914+0000 7fb57124b640 1 -- 172.21.15.132:0/3573568889 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb56c148230 con 0x7fb55400a420 2023-12-20T04:42:55.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.914+0000 7f9058ff9640 1 --2- 172.21.15.132:0/2627095830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f904006a430 0x7f904006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.914+0000 7f905bfff640 1 --2- 172.21.15.132:0/2627095830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f904006a430 0x7f904006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f9058ff9640 1 -- 172.21.15.132:0/2627095830 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f904803e070 con 0x7f905404fc30 2023-12-20T04:42:55.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f9058ff9640 1 --2- 172.21.15.132:0/2627095830 >> [v2:172.21.15.187:6824/84651,v1:172.21.15.187:6825/84651] conn(0x7f90400725d0 0x7f90400749f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f9058ff9640 1 -- 172.21.15.132:0/2627095830 --> [v2:172.21.15.187:6824/84651,v1:172.21.15.187:6825/84651] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f90400750a0 con 0x7f90400725d0 2023-12-20T04:42:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7fb57124b640 1 -- 172.21.15.132:0/3573568889 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb56c0ce5a0 con 0x7fb55400a420 2023-12-20T04:42:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7fe04cff9640 1 -- 172.21.15.132:0/300856666 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe03802f050 con 0x7fe0500c1980 2023-12-20T04:42:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.914+0000 7f541c7e3640 1 Processor -- start 2023-12-20T04:42:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.914+0000 7f541c7e3640 1 -- start start 2023-12-20T04:42:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f541c7e3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5400003970 0x7f5414156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f541c7e3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54140c31c0 0x7f54140c80f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f541c7e3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54140c8630 0x7f54141fa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7efff6ffd640 1 -- 172.21.15.132:0/1551190985 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efff0010c60 con 0x7f00000b0e30 2023-12-20T04:42:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f9058ff9640 1 -- 172.21.15.132:0/2627095830 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f9048076330 con 0x7f905404fc30 2023-12-20T04:42:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f9060eb3640 1 --2- 172.21.15.132:0/2627095830 >> [v2:172.21.15.187:6824/84651,v1:172.21.15.187:6825/84651] conn(0x7f90400725d0 0x7f90400749f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f5419d7e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54140c31c0 0x7f54140c80f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f5419d7e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54140c31c0 0x7f54140c80f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:52430/0 (socket says 172.21.15.132:52430) 2023-12-20T04:42:55.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f541c7e3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54140c8ab0 con 0x7f5400003970 2023-12-20T04:42:55.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f541c7e3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54140c4de0 con 0x7f54140c8630 2023-12-20T04:42:55.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f905bfff640 1 --2- 172.21.15.132:0/2627095830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f904006a430 0x7f904006c8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9050006fd0 tx=0x7f9050008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7fe04cff9640 1 --2- 172.21.15.132:0/300856666 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe03406a500 0x7fe03406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f541c7e3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54141567d0 con 0x7f54140c31c0 2023-12-20T04:42:55.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f541ad80640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54140c8630 0x7f54141fa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f541ad80640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54140c8630 0x7f54141fa6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:45108/0 (socket says 172.21.15.132:45108) 2023-12-20T04:42:55.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f541ad80640 1 -- 172.21.15.132:0/1906322029 learned_addr learned my addr 172.21.15.132:0/1906322029 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:55.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7efff6ffd640 1 --2- 172.21.15.132:0/1551190985 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7effe006a500 0x7effe006c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f541a57f640 1 --2- 172.21.15.132:0/1906322029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5400003970 0x7f5414156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7fe04cff9640 1 -- 172.21.15.132:0/300856666 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0380aa790 con 0x7fe0500c1980 2023-12-20T04:42:55.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f541ad80640 1 -- 172.21.15.132:0/1906322029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54140c31c0 msgr2=0x7f54140c80f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f6c6ff89640 1 -- 172.21.15.132:0/1809338175 shutdown_connections 2023-12-20T04:42:55.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f6c6ff89640 1 -- 172.21.15.132:0/1809338175 wait complete. 2023-12-20T04:42:55.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7effff59e640 1 -- 172.21.15.132:0/1551190985 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f000006c4a0 con 0x7f00000b0e30 2023-12-20T04:42:55.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.914+0000 7f9beb7fe640 1 -- 172.21.15.132:0/436405229 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9bf8005080 con 0x7f9c040cba60 2023-12-20T04:42:55.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f9beb7fe640 1 --2- 172.21.15.132:0/436405229 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9bf006a500 0x7f9bf006c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f9beb7fe640 1 -- 172.21.15.132:0/436405229 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9bf80882b0 con 0x7f9c040cba60 2023-12-20T04:42:55.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.915+0000 7f9c02ffd640 1 --2- 172.21.15.132:0/436405229 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9bf006a500 0x7f9bf006c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f9c02ffd640 1 --2- 172.21.15.132:0/436405229 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9bf006a500 0x7f9bf006c9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40097a0 tx=0x7f9bf4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f541ad80640 1 --2- 172.21.15.132:0/1906322029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54140c31c0 0x7f54140c80f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f9be97fa640 1 --2- 172.21.15.132:0/436405229 >> [v2:172.21.15.187:6806/84619,v1:172.21.15.187:6809/84619] conn(0x7f9c040c4e10 0x7f9c040c3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f9be97fa640 1 -- 172.21.15.132:0/436405229 --> [v2:172.21.15.187:6806/84619,v1:172.21.15.187:6809/84619] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f9c04163f60 con 0x7f9c040c4e10 2023-12-20T04:42:55.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f9060eb3640 1 --2- 172.21.15.132:0/2627095830 >> [v2:172.21.15.187:6824/84651,v1:172.21.15.187:6825/84651] conn(0x7f90400725d0 0x7f90400749f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f541ad80640 1 -- 172.21.15.132:0/1906322029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5400003970 msgr2=0x7f5414156290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f541ad80640 1 --2- 172.21.15.132:0/1906322029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5400003970 0x7f5414156290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7efff6ffd640 1 -- 172.21.15.132:0/1551190985 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efff0087fd0 con 0x7f00000b0e30 2023-12-20T04:42:55.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7efff7fff640 1 --2- 172.21.15.132:0/1551190985 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7effe006a500 0x7effe006c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f541ad80640 1 -- 172.21.15.132:0/1906322029 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54140c41d0 con 0x7f54140c8630 2023-12-20T04:42:55.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f541a57f640 1 --2- 172.21.15.132:0/1906322029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5400003970 0x7f5414156290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:55.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f5419d7e640 1 --2- 172.21.15.132:0/1906322029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54140c31c0 0x7f54140c80f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:55.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f541ad80640 1 --2- 172.21.15.132:0/1906322029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54140c8630 0x7f54141fa6f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f54140caa50 tx=0x7f540c00e530 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7efff6ffd640 1 --2- 172.21.15.132:0/1551190985 >> [v2:172.21.15.187:6800/84618,v1:172.21.15.187:6801/84618] conn(0x7effe00726a0 0x7effe0074ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7efff6ffd640 1 -- 172.21.15.132:0/1551190985 --> [v2:172.21.15.187:6800/84618,v1:172.21.15.187:6801/84618] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7effe0075170 con 0x7effe00726a0 2023-12-20T04:42:55.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7efff6ffd640 1 -- 172.21.15.132:0/1551190985 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7efff00535c0 con 0x7f00000b0e30 2023-12-20T04:42:55.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7fe046ffd640 1 --2- 172.21.15.132:0/300856666 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe03406a500 0x7fe03406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f540affd640 1 -- 172.21.15.132:0/1906322029 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c007aa0 con 0x7f54140c8630 2023-12-20T04:42:55.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f540affd640 1 -- 172.21.15.132:0/1906322029 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f540c00ee20 con 0x7f54140c8630 2023-12-20T04:42:55.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.917+0000 7f540affd640 1 -- 172.21.15.132:0/1906322029 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f540c014650 con 0x7f54140c8630 2023-12-20T04:42:55.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.917+0000 7f541c7e3640 1 -- 172.21.15.132:0/1906322029 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54140c44b0 con 0x7f54140c8630 2023-12-20T04:42:55.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7f48bffff640 1 -- 172.21.15.132:0/1492612200 <== osd.3 v2:172.21.15.132:6816/84982 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f48c4075170 con 0x7f48c40726a0 2023-12-20T04:42:55.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.917+0000 7efff7fff640 1 --2- 172.21.15.132:0/1551190985 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7effe006a500 0x7effe006c9c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00000cd6a0 tx=0x7effe8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.917+0000 7f9058ff9640 1 -- 172.21.15.132:0/2627095830 <== osd.7 v2:172.21.15.187:6824/84651 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f90400750a0 con 0x7f90400725d0 2023-12-20T04:42:55.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.917+0000 7f541c7e3640 1 -- 172.21.15.132:0/1906322029 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54140c4a70 con 0x7f54140c8630 2023-12-20T04:42:55.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.917+0000 7fe0549b3640 1 --2- 172.21.15.132:0/300856666 >> [v2:172.21.15.132:6818/84981,v1:172.21.15.132:6821/84981] conn(0x7fe0280015e0 0x7fe028003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.917+0000 7f9c037fe640 1 --2- 172.21.15.132:0/436405229 >> [v2:172.21.15.187:6806/84619,v1:172.21.15.187:6809/84619] conn(0x7f9c040c4e10 0x7f9c040c3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.917+0000 7fe0549b3640 1 -- 172.21.15.132:0/300856666 --> [v2:172.21.15.132:6818/84981,v1:172.21.15.132:6821/84981] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fe028006b40 con 0x7fe0280015e0 2023-12-20T04:42:55.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.916+0000 7fb5537fe640 1 -- 172.21.15.132:0/3573568889 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb55c012460 con 0x7fb55400a420 2023-12-20T04:42:55.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.917+0000 7fe04ffff640 1 --2- 172.21.15.132:0/300856666 >> [v2:172.21.15.132:6818/84981,v1:172.21.15.132:6821/84981] conn(0x7fe0280015e0 0x7fe028003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.918+0000 7fe046ffd640 1 --2- 172.21.15.132:0/300856666 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe03406a500 0x7fe03406c9c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe0500b22f0 tx=0x7fe040000ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.917+0000 7efffed9d640 1 --2- 172.21.15.132:0/1551190985 >> [v2:172.21.15.187:6800/84618,v1:172.21.15.187:6801/84618] conn(0x7effe00726a0 0x7effe0074ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.918+0000 7f6c6ff89640 1 Processor -- start 2023-12-20T04:42:55.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.917+0000 7fb5537fe640 1 --2- 172.21.15.132:0/3573568889 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb55806a530 0x7fb55806c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.917+0000 7fb5537fe640 1 -- 172.21.15.132:0/3573568889 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb55c088c80 con 0x7fb55400a420 2023-12-20T04:42:55.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.917+0000 7fb5537fe640 1 --2- 172.21.15.132:0/3573568889 >> [v2:172.21.15.132:6800/84977,v1:172.21.15.132:6801/84977] conn(0x7fb558072750 0x7fb558074b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.917+0000 7fb5537fe640 1 -- 172.21.15.132:0/3573568889 --> [v2:172.21.15.132:6800/84977,v1:172.21.15.132:6801/84977] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb558075220 con 0x7fb558072750 2023-12-20T04:42:55.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.917+0000 7fb5537fe640 1 -- 172.21.15.132:0/3573568889 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb55c08d2a0 con 0x7fb55400a420 2023-12-20T04:42:55.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.918+0000 7fb56b59e640 1 --2- 172.21.15.132:0/3573568889 >> [v2:172.21.15.132:6800/84977,v1:172.21.15.132:6801/84977] conn(0x7fb558072750 0x7fb558074b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.918+0000 7fe04ffff640 1 --2- 172.21.15.132:0/300856666 >> [v2:172.21.15.132:6818/84981,v1:172.21.15.132:6821/84981] conn(0x7fe0280015e0 0x7fe028003aa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.918+0000 7f6c6ff89640 1 -- start start 2023-12-20T04:42:55.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.918+0000 7f9c037fe640 1 --2- 172.21.15.132:0/436405229 >> [v2:172.21.15.187:6806/84619,v1:172.21.15.187:6809/84619] conn(0x7f9c040c4e10 0x7f9c040c3210 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.918+0000 7fb56b59e640 1 --2- 172.21.15.132:0/3573568889 >> [v2:172.21.15.132:6800/84977,v1:172.21.15.132:6801/84977] conn(0x7fb558072750 0x7fb558074b70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.918+0000 7efffed9d640 1 --2- 172.21.15.132:0/1551190985 >> [v2:172.21.15.187:6800/84618,v1:172.21.15.187:6801/84618] conn(0x7effe00726a0 0x7effe0074ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.918+0000 7fb56a59c640 1 --2- 172.21.15.132:0/3573568889 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb55806a530 0x7fb55806c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.919+0000 7f6c6ff89640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c6808ab60 0x7f6c680c38a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.919+0000 7f9beb7fe640 1 -- 172.21.15.132:0/436405229 <== osd.6 v2:172.21.15.187:6806/84619 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f9c04163f60 con 0x7f9c040c4e10 2023-12-20T04:42:55.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.919+0000 7fe04cff9640 1 -- 172.21.15.132:0/300856666 <== osd.1 v2:172.21.15.132:6818/84981 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fe028006b40 con 0x7fe0280015e0 2023-12-20T04:42:55.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.919+0000 7f541c7e3640 1 -- 172.21.15.132:0/1906322029 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5414161df0 con 0x7f54140c8630 2023-12-20T04:42:55.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.919+0000 7f6c6ff89640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c680b0790 0x7f6c681681e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.919+0000 7fb56a59c640 1 --2- 172.21.15.132:0/3573568889 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb55806a530 0x7fb55806c9f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb56c136c90 tx=0x7fb560009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.919+0000 7f6c6ff89640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c680c92d0 0x7f6c68168720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.919+0000 7f6c6ff89640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c680c6dd0 con 0x7f6c6808ab60 2023-12-20T04:42:55.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.919+0000 7f6c6ff89640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6c680c6130 con 0x7f6c680b0790 2023-12-20T04:42:55.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.919+0000 7f6c6ff89640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6c680c6810 con 0x7f6c680c92d0 2023-12-20T04:42:55.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.919+0000 7f6c6e526640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c680c92d0 0x7f6c68168720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.919+0000 7f6c6e526640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c680c92d0 0x7f6c68168720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:52438/0 (socket says 172.21.15.132:52438) 2023-12-20T04:42:55.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.919+0000 7f6c6e526640 1 -- 172.21.15.132:0/2812678134 learned_addr learned my addr 172.21.15.132:0/2812678134 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:55.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.919+0000 7f6c6dd25640 1 --2- 172.21.15.132:0/2812678134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c6808ab60 0x7f6c680c38a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.919+0000 7f540affd640 1 -- 172.21.15.132:0/1906322029 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f540c0147b0 con 0x7f54140c8630 2023-12-20T04:42:55.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.919+0000 7f540affd640 1 --2- 172.21.15.132:0/1906322029 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f53f806a500 0x7f53f806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.920+0000 7f6c6e526640 1 -- 172.21.15.132:0/2812678134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c680b0790 msgr2=0x7f6c681681e0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-20T04:42:55.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.920+0000 7f6c6e526640 1 --2- 172.21.15.132:0/2812678134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6c680b0790 0x7f6c681681e0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.920+0000 7f6c6e526640 1 -- 172.21.15.132:0/2812678134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c6808ab60 msgr2=0x7f6c680c38a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:55.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.920+0000 7f6c6e526640 1 --2- 172.21.15.132:0/2812678134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6c6808ab60 0x7f6c680c38a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:55.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.920+0000 7f6c6e526640 1 -- 172.21.15.132:0/2812678134 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6c64014660 con 0x7f6c680c92d0 2023-12-20T04:42:55.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.920+0000 7f540affd640 1 -- 172.21.15.132:0/1906322029 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f540c088640 con 0x7f54140c8630 2023-12-20T04:42:55.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.920+0000 7f540affd640 1 --2- 172.21.15.132:0/1906322029 >> [v2:172.21.15.132:6808/84979,v1:172.21.15.132:6809/84979] conn(0x7f53f8072720 0x7f53f8074b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:55.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.920+0000 7f540affd640 1 -- 172.21.15.132:0/1906322029 --> [v2:172.21.15.132:6808/84979,v1:172.21.15.132:6809/84979] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f53f80751f0 con 0x7f53f8072720 2023-12-20T04:42:55.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.920+0000 7f540affd640 1 -- 172.21.15.132:0/1906322029 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_get_version_reply(handle=1 version=20) v2 ==== 24+0+0 (secure 0 0 0) 0x7f540c08ac60 con 0x7f54140c8630 2023-12-20T04:42:55.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.920+0000 7f5419d7e640 1 --2- 172.21.15.132:0/1906322029 >> [v2:172.21.15.132:6808/84979,v1:172.21.15.132:6809/84979] conn(0x7f53f8072720 0x7f53f8074b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:55.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.920+0000 7f6c6e526640 1 --2- 172.21.15.132:0/2812678134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c680c92d0 0x7f6c68168720 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800b3f0 tx=0x7f6c5800b8b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:55.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.919+0000 7fb5537fe640 1 -- 172.21.15.132:0/3573568889 <== osd.0 v2:172.21.15.132:6800/84977 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fb558075220 con 0x7fb558072750 2023-12-20T04:42:56.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.920+0000 7f6c5e7fc640 1 -- 172.21.15.132:0/2812678134 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c58011830 con 0x7f6c680c92d0 2023-12-20T04:42:56.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.920+0000 7f6c5e7fc640 1 -- 172.21.15.132:0/2812678134 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6c58011990 con 0x7f6c680c92d0 2023-12-20T04:42:56.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.920+0000 7f6c6ff89640 1 -- 172.21.15.132:0/2812678134 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6c680c6af0 con 0x7f6c680c92d0 2023-12-20T04:42:56.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.920+0000 7f6c6ff89640 1 -- 172.21.15.132:0/2812678134 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6c680c3de0 con 0x7f6c680c92d0 2023-12-20T04:42:56.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.921+0000 7f6c5e7fc640 1 -- 172.21.15.132:0/2812678134 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6c58011d20 con 0x7f6c680c92d0 2023-12-20T04:42:56.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.922+0000 7efff6ffd640 1 -- 172.21.15.132:0/1551190985 <== osd.4 v2:172.21.15.187:6800/84618 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7effe0075170 con 0x7effe00726a0 2023-12-20T04:42:56.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.922+0000 7f5419d7e640 1 --2- 172.21.15.132:0/1906322029 >> [v2:172.21.15.132:6808/84979,v1:172.21.15.132:6809/84979] conn(0x7f53f8072720 0x7f53f8074b40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.922+0000 7f6c5e7fc640 1 -- 172.21.15.132:0/2812678134 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6c5801a400 con 0x7f6c680c92d0 2023-12-20T04:42:56.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.923+0000 7f541a57f640 1 --2- 172.21.15.132:0/1906322029 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f53f806a500 0x7f53f806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.923+0000 7f540affd640 1 -- 172.21.15.132:0/1906322029 <== osd.2 v2:172.21.15.132:6808/84979 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f53f80751f0 con 0x7f53f8072720 2023-12-20T04:42:56.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.923+0000 7f6c5e7fc640 1 --2- 172.21.15.132:0/2812678134 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6c4c06a430 0x7f6c4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.923+0000 7f6c6dd25640 1 --2- 172.21.15.132:0/2812678134 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6c4c06a430 0x7f6c4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.923+0000 7f6c6dd25640 1 --2- 172.21.15.132:0/2812678134 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6c4c06a430 0x7f6c4c06c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009930 tx=0x7f6c60009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.923+0000 7f6c5e7fc640 1 -- 172.21.15.132:0/2812678134 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6c58088ad0 con 0x7f6c680c92d0 2023-12-20T04:42:56.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.924+0000 7f6c6ff89640 1 --2- 172.21.15.132:0/2812678134 >> [v2:172.21.15.187:6803/84620,v1:172.21.15.187:6805/84620] conn(0x7f6c500015e0 0x7f6c50003aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.924+0000 7f6c6ff89640 1 -- 172.21.15.132:0/2812678134 --> [v2:172.21.15.187:6803/84620,v1:172.21.15.187:6805/84620] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f6c50006b40 con 0x7f6c500015e0 2023-12-20T04:42:56.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.924+0000 7f6c6d524640 1 --2- 172.21.15.132:0/2812678134 >> [v2:172.21.15.187:6803/84620,v1:172.21.15.187:6805/84620] conn(0x7f6c500015e0 0x7f6c50003aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.923+0000 7f541a57f640 1 --2- 172.21.15.132:0/1906322029 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f53f806a500 0x7f53f806c9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5404034000 tx=0x7f5404008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.925+0000 7f6c6d524640 1 --2- 172.21.15.132:0/2812678134 >> [v2:172.21.15.187:6803/84620,v1:172.21.15.187:6805/84620] conn(0x7f6c500015e0 0x7f6c50003aa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.925+0000 7f6c5e7fc640 1 -- 172.21.15.132:0/2812678134 <== osd.5 v2:172.21.15.187:6803/84620 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f6c50006b40 con 0x7f6c500015e0 2023-12-20T04:42:56.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.943+0000 7f48dceb4640 1 -- 172.21.15.132:0/1492612200 --> [v2:172.21.15.132:6816/84982,v1:172.21.15.132:6817/84982] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f48b8002cb0 con 0x7f48c40726a0 2023-12-20T04:42:56.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.944+0000 7f48bffff640 1 -- 172.21.15.132:0/1492612200 <== osd.3 v2:172.21.15.132:6816/84982 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f48b8002cb0 con 0x7f48c40726a0 2023-12-20T04:42:56.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.945+0000 7f48bdffb640 1 -- 172.21.15.132:0/1492612200 >> [v2:172.21.15.132:6816/84982,v1:172.21.15.132:6817/84982] conn(0x7f48c40726a0 msgr2=0x7f48c4074ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.945+0000 7f48bdffb640 1 --2- 172.21.15.132:0/1492612200 >> [v2:172.21.15.132:6816/84982,v1:172.21.15.132:6817/84982] conn(0x7f48c40726a0 0x7f48c4074ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.945+0000 7f48bdffb640 1 -- 172.21.15.132:0/1492612200 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f48c406a500 msgr2=0x7f48c406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.945+0000 7f48bdffb640 1 --2- 172.21.15.132:0/1492612200 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f48c406a500 0x7f48c406c9c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f48cc000f60 tx=0x7f48cc009040 comp rx=0 tx=0).stop 2023-12-20T04:42:56.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.945+0000 7f48bdffb640 1 -- 172.21.15.132:0/1492612200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48d8159420 msgr2=0x7f48d80c6990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.945+0000 7f48bdffb640 1 --2- 172.21.15.132:0/1492612200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48d8159420 0x7f48d80c6990 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f48c800c450 tx=0x7f48c800c910 comp rx=0 tx=0).stop 2023-12-20T04:42:56.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.945+0000 7f48d7fff640 1 -- 172.21.15.132:0/1492612200 reap_dead start 2023-12-20T04:42:56.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.945+0000 7f48bdffb640 1 -- 172.21.15.132:0/1492612200 shutdown_connections 2023-12-20T04:42:56.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.946+0000 7f48bdffb640 1 -- 172.21.15.132:0/1492612200 >> 172.21.15.132:0/1492612200 conn(0x7f48d80cf240 msgr2=0x7f48d80cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.946+0000 7fb57124b640 1 -- 172.21.15.132:0/3573568889 --> [v2:172.21.15.132:6800/84977,v1:172.21.15.132:6801/84977] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fb56c0ce2c0 con 0x7fb558072750 2023-12-20T04:42:56.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.946+0000 7f48bdffb640 1 -- 172.21.15.132:0/1492612200 shutdown_connections 2023-12-20T04:42:56.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.946+0000 7f48bdffb640 1 -- 172.21.15.132:0/1492612200 wait complete. 2023-12-20T04:42:56.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.946+0000 7f90616b4640 1 -- 172.21.15.132:0/2627095830 --> [v2:172.21.15.187:6824/84651,v1:172.21.15.187:6825/84651] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9054054850 con 0x7f90400725d0 2023-12-20T04:42:56.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.947+0000 7fb5537fe640 1 -- 172.21.15.132:0/3573568889 <== osd.0 v2:172.21.15.132:6800/84977 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fb564001930 con 0x7fb558072750 2023-12-20T04:42:56.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.947+0000 7fb57124b640 1 -- 172.21.15.132:0/3573568889 >> [v2:172.21.15.132:6800/84977,v1:172.21.15.132:6801/84977] conn(0x7fb558072750 msgr2=0x7fb558074b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.947+0000 7fb57124b640 1 --2- 172.21.15.132:0/3573568889 >> [v2:172.21.15.132:6800/84977,v1:172.21.15.132:6801/84977] conn(0x7fb558072750 0x7fb558074b70 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.947+0000 7f9058ff9640 1 -- 172.21.15.132:0/2627095830 <== osd.7 v2:172.21.15.187:6824/84651 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f905c08f040 con 0x7f90400725d0 2023-12-20T04:42:56.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.948+0000 7fb57124b640 1 -- 172.21.15.132:0/3573568889 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb55806a530 msgr2=0x7fb55806c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.948+0000 7fb57124b640 1 --2- 172.21.15.132:0/3573568889 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb55806a530 0x7fb55806c9f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fb56c136c90 tx=0x7fb560009040 comp rx=0 tx=0).stop 2023-12-20T04:42:56.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.948+0000 7fb57124b640 1 -- 172.21.15.132:0/3573568889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb55400a420 msgr2=0x7fb56c14a0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.948+0000 7fb57124b640 1 --2- 172.21.15.132:0/3573568889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb55400a420 0x7fb56c14a0b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb55c00d830 tx=0x7fb55c00dcf0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.948+0000 7fb56b59e640 1 -- 172.21.15.132:0/3573568889 reap_dead start 2023-12-20T04:42:56.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.948+0000 7fb57124b640 1 -- 172.21.15.132:0/3573568889 shutdown_connections 2023-12-20T04:42:56.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.948+0000 7fb57124b640 1 -- 172.21.15.132:0/3573568889 >> 172.21.15.132:0/3573568889 conn(0x7fb56c0ce970 msgr2=0x7fb56c0af050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.948+0000 7f90467fc640 1 -- 172.21.15.132:0/2627095830 >> [v2:172.21.15.187:6824/84651,v1:172.21.15.187:6825/84651] conn(0x7f90400725d0 msgr2=0x7f90400749f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.948+0000 7f90467fc640 1 --2- 172.21.15.132:0/2627095830 >> [v2:172.21.15.187:6824/84651,v1:172.21.15.187:6825/84651] conn(0x7f90400725d0 0x7f90400749f0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.948+0000 7f90467fc640 1 -- 172.21.15.132:0/2627095830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f904006a430 msgr2=0x7f904006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.948+0000 7f9be97fa640 1 -- 172.21.15.132:0/436405229 --> [v2:172.21.15.187:6806/84619,v1:172.21.15.187:6809/84619] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f9c0404e840 con 0x7f9c040c4e10 2023-12-20T04:42:56.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.948+0000 7f90467fc640 1 --2- 172.21.15.132:0/2627095830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f904006a430 0x7f904006c8f0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f9050006fd0 tx=0x7f9050008040 comp rx=0 tx=0).stop 2023-12-20T04:42:56.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.948+0000 7f90467fc640 1 -- 172.21.15.132:0/2627095830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f905404fc30 msgr2=0x7f9054037a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.948+0000 7f90467fc640 1 --2- 172.21.15.132:0/2627095830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f905404fc30 0x7f9054037a10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f9048033000 tx=0x7f9048004730 comp rx=0 tx=0).stop 2023-12-20T04:42:56.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.949+0000 7f9060eb3640 1 -- 172.21.15.132:0/2627095830 reap_dead start 2023-12-20T04:42:56.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.949+0000 7fb57124b640 1 -- 172.21.15.132:0/3573568889 shutdown_connections 2023-12-20T04:42:56.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.949+0000 7f90467fc640 1 -- 172.21.15.132:0/2627095830 shutdown_connections 2023-12-20T04:42:56.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.949+0000 7f90467fc640 1 -- 172.21.15.132:0/2627095830 >> 172.21.15.132:0/2627095830 conn(0x7f9054054ed0 msgr2=0x7f9054048a00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.949+0000 7f9beb7fe640 1 -- 172.21.15.132:0/436405229 <== osd.6 v2:172.21.15.187:6806/84619 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f9c0404e840 con 0x7f9c040c4e10 2023-12-20T04:42:56.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.949+0000 7fb57124b640 1 -- 172.21.15.132:0/3573568889 wait complete. 2023-12-20T04:42:56.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.949+0000 7f9be97fa640 1 -- 172.21.15.132:0/436405229 >> [v2:172.21.15.187:6806/84619,v1:172.21.15.187:6809/84619] conn(0x7f9c040c4e10 msgr2=0x7f9c040c3210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.949+0000 7f9be97fa640 1 --2- 172.21.15.132:0/436405229 >> [v2:172.21.15.187:6806/84619,v1:172.21.15.187:6809/84619] conn(0x7f9c040c4e10 0x7f9c040c3210 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.949+0000 7fe0549b3640 1 -- 172.21.15.132:0/300856666 --> [v2:172.21.15.132:6818/84981,v1:172.21.15.132:6821/84981] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fe028005c20 con 0x7fe0280015e0 2023-12-20T04:42:56.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.950+0000 7f9be97fa640 1 -- 172.21.15.132:0/436405229 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9bf006a500 msgr2=0x7f9bf006c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.950+0000 7f90467fc640 1 -- 172.21.15.132:0/2627095830 shutdown_connections 2023-12-20T04:42:56.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.950+0000 7f9be97fa640 1 --2- 172.21.15.132:0/436405229 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9bf006a500 0x7f9bf006c9c0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f9bf40097a0 tx=0x7f9bf4008030 comp rx=0 tx=0).stop 2023-12-20T04:42:56.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.950+0000 7f9be97fa640 1 -- 172.21.15.132:0/436405229 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c040cba60 msgr2=0x7f9c040c48d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.950+0000 7f9be97fa640 1 --2- 172.21.15.132:0/436405229 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c040cba60 0x7f9c040c48d0 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f9bf800c410 tx=0x7f9bf800c8d0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.950+0000 7f9c037fe640 1 -- 172.21.15.132:0/436405229 reap_dead start 2023-12-20T04:42:56.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.950+0000 7f9be97fa640 1 -- 172.21.15.132:0/436405229 shutdown_connections 2023-12-20T04:42:56.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.950+0000 7f9be97fa640 1 -- 172.21.15.132:0/436405229 >> 172.21.15.132:0/436405229 conn(0x7f9c0406a050 msgr2=0x7f9c04165150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.950+0000 7f90467fc640 1 -- 172.21.15.132:0/2627095830 wait complete. 2023-12-20T04:42:56.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.950+0000 7f9be97fa640 1 -- 172.21.15.132:0/436405229 shutdown_connections 2023-12-20T04:42:56.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.950+0000 7f9be97fa640 1 -- 172.21.15.132:0/436405229 wait complete. 2023-12-20T04:42:56.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.950+0000 7fe04cff9640 1 -- 172.21.15.132:0/300856666 <== osd.1 v2:172.21.15.132:6818/84981 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fe028005c20 con 0x7fe0280015e0 2023-12-20T04:42:56.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.950+0000 7effff59e640 1 -- 172.21.15.132:0/1551190985 --> [v2:172.21.15.187:6800/84618,v1:172.21.15.187:6801/84618] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f000006b750 con 0x7effe00726a0 2023-12-20T04:42:56.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.951+0000 7fe045ffb640 1 -- 172.21.15.132:0/300856666 >> [v2:172.21.15.132:6818/84981,v1:172.21.15.132:6821/84981] conn(0x7fe0280015e0 msgr2=0x7fe028003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.951+0000 7fe045ffb640 1 --2- 172.21.15.132:0/300856666 >> [v2:172.21.15.132:6818/84981,v1:172.21.15.132:6821/84981] conn(0x7fe0280015e0 0x7fe028003aa0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.951+0000 7f541c7e3640 1 -- 172.21.15.132:0/1906322029 --> [v2:172.21.15.132:6808/84979,v1:172.21.15.132:6809/84979] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f541406b820 con 0x7f53f8072720 2023-12-20T04:42:56.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.951+0000 7f6c6ff89640 1 -- 172.21.15.132:0/2812678134 --> [v2:172.21.15.187:6803/84620,v1:172.21.15.187:6805/84620] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f6c50005bc0 con 0x7f6c500015e0 2023-12-20T04:42:56.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.951+0000 7fe045ffb640 1 -- 172.21.15.132:0/300856666 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe03406a500 msgr2=0x7fe03406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.951+0000 7fe045ffb640 1 --2- 172.21.15.132:0/300856666 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe03406a500 0x7fe03406c9c0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fe0500b22f0 tx=0x7fe040000ed0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.951+0000 7fe045ffb640 1 -- 172.21.15.132:0/300856666 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0500c1980 msgr2=0x7fe0501f7890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.951+0000 7fe045ffb640 1 --2- 172.21.15.132:0/300856666 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0500c1980 0x7fe0501f7890 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7fe0380098a0 tx=0x7fe0380046c0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.951+0000 7fe04ffff640 1 -- 172.21.15.132:0/300856666 reap_dead start 2023-12-20T04:42:56.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.951+0000 7efff6ffd640 1 -- 172.21.15.132:0/1551190985 <== osd.4 v2:172.21.15.187:6800/84618 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7efff803e400 con 0x7effe00726a0 2023-12-20T04:42:56.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.951+0000 7fe045ffb640 1 -- 172.21.15.132:0/300856666 shutdown_connections 2023-12-20T04:42:56.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.951+0000 7fe045ffb640 1 -- 172.21.15.132:0/300856666 >> 172.21.15.132:0/300856666 conn(0x7fe0500cea50 msgr2=0x7fe0501602d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.951+0000 7f540affd640 1 -- 172.21.15.132:0/1906322029 <== osd.2 v2:172.21.15.132:6808/84979 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f53f80751f0 con 0x7f53f8072720 2023-12-20T04:42:56.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.951+0000 7f6c5e7fc640 1 -- 172.21.15.132:0/2812678134 <== osd.5 v2:172.21.15.187:6803/84620 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f6c50005bc0 con 0x7f6c500015e0 2023-12-20T04:42:56.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.952+0000 7effff59e640 1 -- 172.21.15.132:0/1551190985 >> [v2:172.21.15.187:6800/84618,v1:172.21.15.187:6801/84618] conn(0x7effe00726a0 msgr2=0x7effe0074ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.952+0000 7effff59e640 1 --2- 172.21.15.132:0/1551190985 >> [v2:172.21.15.187:6800/84618,v1:172.21.15.187:6801/84618] conn(0x7effe00726a0 0x7effe0074ac0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.952+0000 7f6c6ff89640 1 -- 172.21.15.132:0/2812678134 >> [v2:172.21.15.187:6803/84620,v1:172.21.15.187:6805/84620] conn(0x7f6c500015e0 msgr2=0x7f6c50003aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.952+0000 7f6c6ff89640 1 --2- 172.21.15.132:0/2812678134 >> [v2:172.21.15.187:6803/84620,v1:172.21.15.187:6805/84620] conn(0x7f6c500015e0 0x7f6c50003aa0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.952+0000 7f541c7e3640 1 -- 172.21.15.132:0/1906322029 >> [v2:172.21.15.132:6808/84979,v1:172.21.15.132:6809/84979] conn(0x7f53f8072720 msgr2=0x7f53f8074b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.952+0000 7f541c7e3640 1 --2- 172.21.15.132:0/1906322029 >> [v2:172.21.15.132:6808/84979,v1:172.21.15.132:6809/84979] conn(0x7f53f8072720 0x7f53f8074b40 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.952+0000 7f6c6ff89640 1 -- 172.21.15.132:0/2812678134 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6c4c06a430 msgr2=0x7f6c4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.952+0000 7f6c6ff89640 1 --2- 172.21.15.132:0/2812678134 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6c4c06a430 0x7f6c4c06c8f0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6c60009930 tx=0x7f6c60009060 comp rx=0 tx=0).stop 2023-12-20T04:42:56.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.952+0000 7f541c7e3640 1 -- 172.21.15.132:0/1906322029 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f53f806a500 msgr2=0x7f53f806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.952+0000 7f541c7e3640 1 --2- 172.21.15.132:0/1906322029 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f53f806a500 0x7f53f806c9c0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5404034000 tx=0x7f5404008030 comp rx=0 tx=0).stop 2023-12-20T04:42:56.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.952+0000 7f541c7e3640 1 -- 172.21.15.132:0/1906322029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54140c8630 msgr2=0x7f54141fa6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.952+0000 7f541c7e3640 1 --2- 172.21.15.132:0/1906322029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f54140c8630 0x7f54141fa6f0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f54140caa50 tx=0x7f540c00e530 comp rx=0 tx=0).stop 2023-12-20T04:42:56.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.952+0000 7f6c6ff89640 1 -- 172.21.15.132:0/2812678134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c680c92d0 msgr2=0x7f6c68168720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.952+0000 7f6c6ff89640 1 --2- 172.21.15.132:0/2812678134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6c680c92d0 0x7f6c68168720 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f6c5800b3f0 tx=0x7f6c5800b8b0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.952+0000 7f541ad80640 1 -- 172.21.15.132:0/1906322029 reap_dead start 2023-12-20T04:42:56.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.952+0000 7f6c6e526640 1 -- 172.21.15.132:0/2812678134 reap_dead start 2023-12-20T04:42:56.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7f6c6ff89640 1 -- 172.21.15.132:0/2812678134 shutdown_connections 2023-12-20T04:42:56.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7f6c6ff89640 1 -- 172.21.15.132:0/2812678134 >> 172.21.15.132:0/2812678134 conn(0x7f6c680ced10 msgr2=0x7f6c680cdf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7fe045ffb640 1 -- 172.21.15.132:0/300856666 shutdown_connections 2023-12-20T04:42:56.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7fe045ffb640 1 -- 172.21.15.132:0/300856666 wait complete. 2023-12-20T04:42:56.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7effff59e640 1 -- 172.21.15.132:0/1551190985 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7effe006a500 msgr2=0x7effe006c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7effff59e640 1 --2- 172.21.15.132:0/1551190985 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7effe006a500 0x7effe006c9c0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7f00000cd6a0 tx=0x7effe8009190 comp rx=0 tx=0).stop 2023-12-20T04:42:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7f541c7e3640 1 -- 172.21.15.132:0/1906322029 shutdown_connections 2023-12-20T04:42:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7f541c7e3640 1 -- 172.21.15.132:0/1906322029 >> 172.21.15.132:0/1906322029 conn(0x7f54140ced10 msgr2=0x7f54140cdcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7effff59e640 1 -- 172.21.15.132:0/1551190985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00000b0e30 msgr2=0x7f00001f5e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7effff59e640 1 --2- 172.21.15.132:0/1551190985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00000b0e30 0x7f00001f5e20 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7efff000b4a0 tx=0x7efff000b960 comp rx=0 tx=0).stop 2023-12-20T04:42:56.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7efffed9d640 1 -- 172.21.15.132:0/1551190985 reap_dead start 2023-12-20T04:42:56.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7f6c6ff89640 1 -- 172.21.15.132:0/2812678134 shutdown_connections 2023-12-20T04:42:56.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7effff59e640 1 -- 172.21.15.132:0/1551190985 shutdown_connections 2023-12-20T04:42:56.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7f6c6ff89640 1 -- 172.21.15.132:0/2812678134 wait complete. 2023-12-20T04:42:56.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7effff59e640 1 -- 172.21.15.132:0/1551190985 >> 172.21.15.132:0/1551190985 conn(0x7f00000cb800 msgr2=0x7f00000caca0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7f541c7e3640 1 -- 172.21.15.132:0/1906322029 shutdown_connections 2023-12-20T04:42:56.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7f541c7e3640 1 -- 172.21.15.132:0/1906322029 wait complete. 2023-12-20T04:42:56.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7effff59e640 1 -- 172.21.15.132:0/1551190985 shutdown_connections 2023-12-20T04:42:56.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:55.953+0000 7effff59e640 1 -- 172.21.15.132:0/1551190985 wait complete. 2023-12-20T04:42:56.031 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2023-12-20T04:42:56.032 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-20T04:42:56.033 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2023-12-20T04:42:56.033 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-20T04:42:56.034 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2023-12-20T04:42:56.034 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-20T04:42:56.035 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2023-12-20T04:42:56.035 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-20T04:42:56.036 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2023-12-20T04:42:56.036 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-20T04:42:56.037 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2023-12-20T04:42:56.037 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-20T04:42:56.038 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2023-12-20T04:42:56.038 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-20T04:42:56.039 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2023-12-20T04:42:56.039 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-20T04:42:56.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.240+0000 7f942353e640 1 Processor -- start 2023-12-20T04:42:56.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.240+0000 7f942353e640 1 -- start start 2023-12-20T04:42:56.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.241+0000 7f942353e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f941c165c10 0x7f941c0cc290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.241+0000 7f942353e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f941c0cc7d0 0x7f941c0cecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.241+0000 7f942353e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f941c0ce840 con 0x7f941c161560 2023-12-20T04:42:56.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.241+0000 7f942353e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f941c0ccc60 con 0x7f941c165c10 2023-12-20T04:42:56.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.241+0000 7f942353e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c166050 con 0x7f941c0cc7d0 2023-12-20T04:42:56.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.241+0000 7f94212da640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f941c161560 0x7f941c0cb620 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45928/0 (socket says 172.21.15.132:45928) 2023-12-20T04:42:56.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.241+0000 7f94212da640 1 -- 172.21.15.132:0/226335373 learned_addr learned my addr 172.21.15.132:0/226335373 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:56.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.242+0000 7f651676c640 1 Processor -- start 2023-12-20T04:42:56.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.242+0000 7f002f5fa640 1 Processor -- start 2023-12-20T04:42:56.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.242+0000 7f651676c640 1 -- start start 2023-12-20T04:42:56.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.242+0000 7f9413fff640 1 -- 172.21.15.132:0/226335373 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2817166946 0 0) 0x7f941c0ce840 con 0x7f941c161560 2023-12-20T04:42:56.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.242+0000 7f9413fff640 1 -- 172.21.15.132:0/226335373 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9408003520 con 0x7f941c161560 2023-12-20T04:42:56.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.242+0000 7f9421adb640 1 --2- 172.21.15.132:0/226335373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f941c0cc7d0 0x7f941c0cecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.242+0000 7f9420ad9640 1 --2- 172.21.15.132:0/226335373 >> v2:172.21.15.187:3300/0 conn(0x7f941c165c10 0x7f941c0cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f9413fff640 1 -- 172.21.15.132:0/226335373 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 897282364 0 0) 0x7f9408003520 con 0x7f941c161560 2023-12-20T04:42:56.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f9413fff640 1 -- 172.21.15.132:0/226335373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f941c0cc7d0 msgr2=0x7f941c0cecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:56.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f9413fff640 1 --2- 172.21.15.132:0/226335373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f941c0cc7d0 0x7f941c0cecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f9413fff640 1 -- 172.21.15.132:0/226335373 >> v2:172.21.15.187:3300/0 conn(0x7f941c165c10 msgr2=0x7f941c0cc290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:56.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f9413fff640 1 --2- 172.21.15.132:0/226335373 >> v2:172.21.15.187:3300/0 conn(0x7f941c165c10 0x7f941c0cc290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f9413fff640 1 -- 172.21.15.132:0/226335373 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0ce510 con 0x7f941c161560 2023-12-20T04:42:56.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.242+0000 7f002f5fa640 1 -- start start 2023-12-20T04:42:56.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.242+0000 7fecc7ff0640 1 Processor -- start 2023-12-20T04:42:56.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f651676c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f651015d740 0x7f65100cd890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f651676c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f65100cc9a0 0x7f65100cb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f651676c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f65100cbc40 con 0x7f65100cb2a0 2023-12-20T04:42:56.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f651676c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65100ca310 con 0x7f65100cc9a0 2023-12-20T04:42:56.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f651676c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6510071790 con 0x7f651015d740 2023-12-20T04:42:56.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f9413fff640 1 -- 172.21.15.132:0/226335373 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f94140019f0 con 0x7f941c161560 2023-12-20T04:42:56.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f9413fff640 1 -- 172.21.15.132:0/226335373 >> v1:172.21.15.132:6789/0 conn(0x7f941c161560 legacy=0x7f941c0cb620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7fecc7ff0640 1 -- start start 2023-12-20T04:42:56.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f9413fff640 1 --2- 172.21.15.132:0/226335373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9408003970 0x7f9408003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f6515f6b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f65100cc9a0 0x7f65100cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f6515f6b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f65100cc9a0 0x7f65100cb700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:45142/0 (socket says 172.21.15.132:45142) 2023-12-20T04:42:56.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f6515f6b640 1 -- 172.21.15.132:0/368423072 learned_addr learned my addr 172.21.15.132:0/368423072 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:56.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f9413fff640 1 --2- 172.21.15.132:0/226335373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f941c0cc7d0 0x7f94080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f9413fff640 1 --2- 172.21.15.132:0/226335373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9408004d00 0x7f9408005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f9413fff640 1 -- 172.21.15.132:0/226335373 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0ccc60 con 0x7f9408003970 2023-12-20T04:42:56.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f9413fff640 1 -- 172.21.15.132:0/226335373 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c166050 con 0x7f9408004d00 2023-12-20T04:42:56.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.243+0000 7f9413fff640 1 -- 172.21.15.132:0/226335373 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f940800bac0 con 0x7f941c0cc7d0 2023-12-20T04:42:56.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7f651576a640 1 --2- 172.21.15.132:0/368423072 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f651015d740 0x7f65100cd890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7fecc7ff0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb80eac80 0x7fecb8047bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7fecc7ff0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fecb8006a50 0x7fecb8052f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7fecc7ff0640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fecb8037b50 con 0x7fecb8005ec0 2023-12-20T04:42:56.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7fecc7ff0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fecb804f710 con 0x7fecb8006a50 2023-12-20T04:42:56.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7fecc7ff0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb804f150 con 0x7fecb80eac80 2023-12-20T04:42:56.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7f9421adb640 1 --2- 172.21.15.132:0/226335373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9408004d00 0x7f9408005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7f002f5fa640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f00280cf910 0x7f00280cfd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7f002f5fa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f00280b6320 0x7f00280b67b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7fecc658d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fecb8006a50 0x7fecb8052f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7fecc658d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fecb8006a50 0x7fecb8052f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49334/0 (socket says 172.21.15.132:49334) 2023-12-20T04:42:56.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7fecc658d640 1 -- 172.21.15.132:0/1990634718 learned_addr learned my addr 172.21.15.132:0/1990634718 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7f6515f6b640 1 -- 172.21.15.132:0/368423072 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f651015d740 msgr2=0x7f65100cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7f6515f6b640 1 --2- 172.21.15.132:0/368423072 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f651015d740 0x7f65100cd890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7f6515f6b640 1 -- 172.21.15.132:0/368423072 >> v1:172.21.15.187:6789/0 conn(0x7f65100cb2a0 legacy=0x7f65100cc290 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-20T04:42:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7f6515f6b640 1 -- 172.21.15.132:0/368423072 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65100ca800 con 0x7f65100cc9a0 2023-12-20T04:42:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7f002f5fa640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00280d2a90 con 0x7f002815d640 2023-12-20T04:42:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7fecc5d8c640 1 --2- 172.21.15.132:0/1990634718 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb80eac80 0x7fecb8047bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7f002f5fa640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00280d02b0 con 0x7f00280b6320 2023-12-20T04:42:56.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7f002f5fa640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00280d1e80 con 0x7f00280cf910 2023-12-20T04:42:56.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7f002db97640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f00280b6320 0x7f00280b67b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7fecc5d8c640 1 -- 172.21.15.132:0/1990634718 >> v2:172.21.15.132:3300/0 conn(0x7fecb8006a50 msgr2=0x7fecb8052f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:56.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7f002db97640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f00280b6320 0x7f00280b67b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49342/0 (socket says 172.21.15.132:49342) 2023-12-20T04:42:56.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7f002db97640 1 -- 172.21.15.132:0/3932694024 learned_addr learned my addr 172.21.15.132:0/3932694024 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:56.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.244+0000 7f002cb95640 1 --2- 172.21.15.132:0/3932694024 >> v2:172.21.15.187:3300/0 conn(0x7f00280cf910 0x7f00280cfd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7f9421adb640 1 -- 172.21.15.132:0/226335373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f941c0cc7d0 msgr2=0x7f94080047c0 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-20T04:42:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7f9421adb640 1 --2- 172.21.15.132:0/226335373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f941c0cc7d0 0x7f94080047c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7f9421adb640 1 -- 172.21.15.132:0/226335373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9408003970 msgr2=0x7f9408003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7f9421adb640 1 --2- 172.21.15.132:0/226335373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9408003970 0x7f9408003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7f9421adb640 1 -- 172.21.15.132:0/226335373 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9408003520 con 0x7f9408004d00 2023-12-20T04:42:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7f002db97640 1 -- 172.21.15.132:0/3932694024 >> v2:172.21.15.187:3300/0 conn(0x7f00280cf910 msgr2=0x7f00280cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7f002db97640 1 --2- 172.21.15.132:0/3932694024 >> v2:172.21.15.187:3300/0 conn(0x7f00280cf910 0x7f00280cfd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7f002db97640 1 -- 172.21.15.132:0/3932694024 >> v1:172.21.15.132:6789/0 conn(0x7f002815d640 legacy=0x7f00280d13c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2023-12-20T04:42:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7f002db97640 1 -- 172.21.15.132:0/3932694024 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00280d2160 con 0x7f00280b6320 2023-12-20T04:42:56.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7f6515f6b640 1 --2- 172.21.15.132:0/368423072 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65100cc9a0 0x7f65100cb700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f65100c6b10 tx=0x7f650802e0c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1596587a2cbc9ab5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7f67b56d5640 1 Processor -- start 2023-12-20T04:42:56.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7f67b56d5640 1 -- start start 2023-12-20T04:42:56.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7f6503fff640 1 -- 172.21.15.132:0/368423072 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f650802ea60 con 0x7f65100cc9a0 2023-12-20T04:42:56.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7fecc5d8c640 1 --2- 172.21.15.132:0/1990634718 >> v2:172.21.15.132:3300/0 conn(0x7fecb8006a50 0x7fecb8052f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7fecc5d8c640 1 -- 172.21.15.132:0/1990634718 >> v1:172.21.15.187:6789/0 conn(0x7fecb8005ec0 legacy=0x7fecb8006340 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2023-12-20T04:42:56.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7fecc5d8c640 1 -- 172.21.15.132:0/1990634718 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecb804f430 con 0x7fecb80eac80 2023-12-20T04:42:56.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.245+0000 7f6503fff640 1 -- 172.21.15.132:0/368423072 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f650802ebc0 con 0x7f65100cc9a0 2023-12-20T04:42:56.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7f3567a70640 1 Processor -- start 2023-12-20T04:42:56.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7f6503fff640 1 -- 172.21.15.132:0/368423072 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6508009600 con 0x7f65100cc9a0 2023-12-20T04:42:56.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7f3567a70640 1 -- start start 2023-12-20T04:42:56.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7fecc658d640 1 --2- 172.21.15.132:0/1990634718 >> v2:172.21.15.132:3300/0 conn(0x7fecb8006a50 0x7fecb8052f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:56.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7f002db97640 1 --2- 172.21.15.132:0/3932694024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00280b6320 0x7f00280b67b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f00280d3f30 tx=0x7f002002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95186ff61a5da396 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7f001ffff640 1 -- 172.21.15.132:0/3932694024 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002002ca80 con 0x7f00280b6320 2023-12-20T04:42:56.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7fbd61a5b640 1 Processor -- start 2023-12-20T04:42:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7f67b56d5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f67b006bd00 0x7f67b015c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7f67b56d5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67b00b30f0 0x7f67b015cd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7f67b56d5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67b00b3580 con 0x7f67b006c0e0 2023-12-20T04:42:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7f67b56d5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f67b00cd420 con 0x7f67b006bd00 2023-12-20T04:42:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7f67b56d5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b00cf870 con 0x7f67b00b30f0 2023-12-20T04:42:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7f651676c640 1 -- 172.21.15.132:0/368423072 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65100cc9a0 msgr2=0x7f65100cb700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7f651676c640 1 --2- 172.21.15.132:0/368423072 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65100cc9a0 0x7f65100cb700 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f65100c6b10 tx=0x7f650802e0c0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7fbd61a5b640 1 -- start start 2023-12-20T04:42:56.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7f001ffff640 1 -- 172.21.15.132:0/3932694024 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002002cbe0 con 0x7f00280b6320 2023-12-20T04:42:56.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7f001ffff640 1 -- 172.21.15.132:0/3932694024 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00200343f0 con 0x7f00280b6320 2023-12-20T04:42:56.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7f651676c640 1 -- 172.21.15.132:0/368423072 shutdown_connections 2023-12-20T04:42:56.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7f651676c640 1 --2- 172.21.15.132:0/368423072 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65100cc9a0 0x7f65100cb700 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.246+0000 7f651676c640 1 --2- 172.21.15.132:0/368423072 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f651015d740 0x7f65100cd890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.247+0000 7f651676c640 1 -- 172.21.15.132:0/368423072 >> 172.21.15.132:0/368423072 conn(0x7f65100b1640 msgr2=0x7f65100b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.247+0000 7f9421adb640 1 --2- 172.21.15.132:0/226335373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9408004d00 0x7f9408005180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9418009ac0 tx=0x7f94080057f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=6e468540f6948126 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.247+0000 7f67b4ed4640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f67b006c0e0 0x7f67b00ce730 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45944/0 (socket says 172.21.15.132:45944) 2023-12-20T04:42:56.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.247+0000 7f67b4ed4640 1 -- 172.21.15.132:0/1070195084 learned_addr learned my addr 172.21.15.132:0/1070195084 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:56.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.247+0000 7f67affff640 1 --2- 172.21.15.132:0/1070195084 >> v2:172.21.15.132:3300/0 conn(0x7f67b006bd00 0x7f67b015c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.247+0000 7f9413fff640 1 -- 172.21.15.132:0/226335373 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f941802c6d0 con 0x7f9408004d00 2023-12-20T04:42:56.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.247+0000 7f9413fff640 1 -- 172.21.15.132:0/226335373 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f941802c830 con 0x7f9408004d00 2023-12-20T04:42:56.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.247+0000 7f67af7fe640 1 --2- 172.21.15.132:0/1070195084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67b00b30f0 0x7f67b015cd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.247+0000 7f3567a70640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f35580e7700 0x7f355803ab70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.247+0000 7f3567a70640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f355804f500 0x7f355804f990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.247+0000 7f67aeffd640 1 -- 172.21.15.132:0/1070195084 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1949257156 0 0) 0x7f67b00b3580 con 0x7f67b006c0e0 2023-12-20T04:42:56.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.247+0000 7f3567a70640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3558053260 con 0x7f3558052a80 2023-12-20T04:42:56.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.247+0000 7f3567a70640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f355804fed0 con 0x7f35580e7700 2023-12-20T04:42:56.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.247+0000 7f3567a70640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3558053540 con 0x7f355804f500 2023-12-20T04:42:56.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.247+0000 7f356600d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f355804f500 0x7f355804f990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.247+0000 7f67aeffd640 1 -- 172.21.15.132:0/1070195084 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f679800bd30 con 0x7f67b006c0e0 2023-12-20T04:42:56.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f356600d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f355804f500 0x7f355804f990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:45148/0 (socket says 172.21.15.132:45148) 2023-12-20T04:42:56.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f356600d640 1 -- 172.21.15.132:0/352620843 learned_addr learned my addr 172.21.15.132:0/352620843 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:56.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f356580c640 1 --2- 172.21.15.132:0/352620843 >> v2:172.21.15.132:3300/0 conn(0x7f35580e7700 0x7f355803ab70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fbd61a5b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbd540e78b0 0x7fbd5404f260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f002f5fa640 1 -- 172.21.15.132:0/3932694024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00280b6320 msgr2=0x7f00280b67b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f002f5fa640 1 --2- 172.21.15.132:0/3932694024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00280b6320 0x7f00280b67b0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f00280d3f30 tx=0x7f002002bee0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f002f5fa640 1 -- 172.21.15.132:0/3932694024 shutdown_connections 2023-12-20T04:42:56.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fbd61a5b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd540eb2c0 0x7fbd540eb700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fbd61a5b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbd54052fe0 0x7fbd54053470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fbd61a5b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd54050340 con 0x7fbd540e78b0 2023-12-20T04:42:56.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fbd61a5b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd54006480 con 0x7fbd54052fe0 2023-12-20T04:42:56.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fbd61a5b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540ebc40 con 0x7fbd540eb2c0 2023-12-20T04:42:56.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f942353e640 1 -- 172.21.15.132:0/226335373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9408004d00 msgr2=0x7f9408005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fbd60a59640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbd540e78b0 0x7fbd5404f260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f942353e640 1 --2- 172.21.15.132:0/226335373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9408004d00 0x7f9408005180 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f9418009ac0 tx=0x7f94080057f0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fbd60a59640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbd540e78b0 0x7fbd5404f260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49378/0 (socket says 172.21.15.132:49378) 2023-12-20T04:42:56.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f356580c640 1 -- 172.21.15.132:0/352620843 >> v2:172.21.15.187:3300/0 conn(0x7f355804f500 msgr2=0x7f355804f990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:56.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f356580c640 1 --2- 172.21.15.132:0/352620843 >> v2:172.21.15.187:3300/0 conn(0x7f355804f500 0x7f355804f990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fbd60a59640 1 -- 172.21.15.132:0/3766304461 learned_addr learned my addr 172.21.15.132:0/3766304461 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:56.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f9421adb640 1 -- 172.21.15.132:0/226335373 reap_dead start 2023-12-20T04:42:56.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.247+0000 7fecc5d8c640 1 --2- 172.21.15.132:0/1990634718 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb80eac80 0x7fecb8047bb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0097a0 tx=0x7fecbc02b810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3f3ed097ece6d81c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fbd6125a640 1 --2- 172.21.15.132:0/3766304461 >> v2:172.21.15.187:3300/0 conn(0x7fbd54052fe0 0x7fbd54053470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f356580c640 1 -- 172.21.15.132:0/352620843 >> v1:172.21.15.132:6789/0 conn(0x7f3558052a80 legacy=0x7f3558054300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:56.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f942353e640 1 -- 172.21.15.132:0/226335373 shutdown_connections 2023-12-20T04:42:56.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f942353e640 1 -- 172.21.15.132:0/226335373 >> 172.21.15.132:0/226335373 conn(0x7f941c06a050 msgr2=0x7f941c06a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f651676c640 1 -- 172.21.15.132:0/368423072 shutdown_connections 2023-12-20T04:42:56.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f002f5fa640 1 --2- 172.21.15.132:0/3932694024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00280b6320 0x7f00280b67b0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f69ec609640 1 Processor -- start 2023-12-20T04:42:56.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f002f5fa640 1 --2- 172.21.15.132:0/3932694024 >> v2:172.21.15.187:3300/0 conn(0x7f00280cf910 0x7f00280cfd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f002f5fa640 1 -- 172.21.15.132:0/3932694024 >> 172.21.15.132:0/3932694024 conn(0x7f002806be70 msgr2=0x7f002806c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fbd5bfff640 1 --2- 172.21.15.132:0/3766304461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd540eb2c0 0x7fbd540eb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fecc4d8a640 1 -- 172.21.15.132:0/1990634718 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc031770 con 0x7fecb80eac80 2023-12-20T04:42:56.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fecc4d8a640 1 -- 172.21.15.132:0/1990634718 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecbc0318d0 con 0x7fecb80eac80 2023-12-20T04:42:56.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fecc4d8a640 1 -- 172.21.15.132:0/1990634718 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecbc031ca0 con 0x7fecb80eac80 2023-12-20T04:42:56.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f69ec609640 1 -- start start 2023-12-20T04:42:56.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f002f5fa640 1 -- 172.21.15.132:0/3932694024 shutdown_connections 2023-12-20T04:42:56.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fbd6125a640 1 -- 172.21.15.132:0/3766304461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd540eb2c0 msgr2=0x7fbd540eb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:56.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fbd6125a640 1 --2- 172.21.15.132:0/3766304461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd540eb2c0 0x7fbd540eb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fbd6125a640 1 -- 172.21.15.132:0/3766304461 >> v2:172.21.15.132:3300/0 conn(0x7fbd540e78b0 msgr2=0x7fbd5404f260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:56.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fbd6125a640 1 --2- 172.21.15.132:0/3766304461 >> v2:172.21.15.132:3300/0 conn(0x7fbd540e78b0 0x7fbd5404f260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7fbd6125a640 1 -- 172.21.15.132:0/3766304461 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5404fd80 con 0x7fbd54052fe0 2023-12-20T04:42:56.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f002f5fa640 1 -- 172.21.15.132:0/3932694024 wait complete. 2023-12-20T04:42:56.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f651676c640 1 -- 172.21.15.132:0/368423072 wait complete. 2023-12-20T04:42:56.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f356580c640 1 -- 172.21.15.132:0/352620843 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3558053820 con 0x7f35580e7700 2023-12-20T04:42:56.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.249+0000 7f69ec609640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f69e40c3380 0x7f69e4070f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.249+0000 7f356580c640 1 --2- 172.21.15.132:0/352620843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35580e7700 0x7f355803ab70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3558004ea0 tx=0x7f355c02b7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f8faae863fe2bcc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f67affff640 1 -- 172.21.15.132:0/1070195084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67b00b30f0 msgr2=0x7f67b015cd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:56.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f67affff640 1 --2- 172.21.15.132:0/1070195084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67b00b30f0 0x7f67b015cd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f67affff640 1 -- 172.21.15.132:0/1070195084 >> v1:172.21.15.132:6789/0 conn(0x7f67b006c0e0 legacy=0x7f67b00ce730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.248+0000 7f67affff640 1 -- 172.21.15.132:0/1070195084 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67b00cd630 con 0x7f67b006bd00 2023-12-20T04:42:56.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.249+0000 7f69ec609640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e40cf280 con 0x7f69e406cff0 2023-12-20T04:42:56.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.249+0000 7f69ec609640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f69e40cfa70 con 0x7f69e40c2fa0 2023-12-20T04:42:56.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.249+0000 7f67af7fe640 1 --2- 172.21.15.132:0/1070195084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67b00b30f0 0x7f67b015cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:56.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.249+0000 7f69ec609640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f69e4071490 con 0x7f69e40c3380 2023-12-20T04:42:56.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7f67affff640 1 --2- 172.21.15.132:0/1070195084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b006bd00 0x7f67b015c7d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009a00 tx=0x7f67a402bb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3eba5ae57e627a7b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7f69eaba6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f69e40c3380 0x7f69e4070f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7f69eaba6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f69e40c3380 0x7f69e4070f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49390/0 (socket says 172.21.15.132:49390) 2023-12-20T04:42:56.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7f69eaba6640 1 -- 172.21.15.132:0/2157276966 learned_addr learned my addr 172.21.15.132:0/2157276966 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:56.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7fecc7ff0640 1 -- 172.21.15.132:0/1990634718 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb80eac80 msgr2=0x7fecb8047bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7fecc7ff0640 1 --2- 172.21.15.132:0/1990634718 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb80eac80 0x7fecb8047bb0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7fecbc0097a0 tx=0x7fecbc02b810 comp rx=0 tx=0).stop 2023-12-20T04:42:56.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7f356480a640 1 -- 172.21.15.132:0/352620843 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c02f050 con 0x7f35580e7700 2023-12-20T04:42:56.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7fecc7ff0640 1 -- 172.21.15.132:0/1990634718 shutdown_connections 2023-12-20T04:42:56.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7fecc7ff0640 1 --2- 172.21.15.132:0/1990634718 >> v2:172.21.15.132:3300/0 conn(0x7fecb8006a50 0x7fecb8052f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7fecc7ff0640 1 --2- 172.21.15.132:0/1990634718 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb80eac80 0x7fecb8047bb0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7fecc7ff0640 1 -- 172.21.15.132:0/1990634718 >> 172.21.15.132:0/1990634718 conn(0x7fecb8009fe0 msgr2=0x7fecb800a3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7f356480a640 1 -- 172.21.15.132:0/352620843 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c031700 con 0x7f35580e7700 2023-12-20T04:42:56.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7fbd6125a640 1 --2- 172.21.15.132:0/3766304461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd54052fe0 0x7fbd54053470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c079df0 tx=0x7fbd5c0a5ee0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9956aa712c47c224 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7fecc7ff0640 1 -- 172.21.15.132:0/1990634718 shutdown_connections 2023-12-20T04:42:56.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7fecc7ff0640 1 -- 172.21.15.132:0/1990634718 wait complete. 2023-12-20T04:42:56.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7f651676c640 1 Processor -- start 2023-12-20T04:42:56.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7f651676c640 1 -- start start 2023-12-20T04:42:56.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7f69e93a3640 1 -- 172.21.15.132:0/2157276966 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1326781606 0 0) 0x7f69e40cf280 con 0x7f69e406cff0 2023-12-20T04:42:56.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7f69e93a3640 1 -- 172.21.15.132:0/2157276966 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69d0003520 con 0x7f69e406cff0 2023-12-20T04:42:56.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7f69e93a3640 1 -- 172.21.15.132:0/2157276966 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3479140276 0 0) 0x7f69e40cfa70 con 0x7f69e40c2fa0 2023-12-20T04:42:56.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7fbd5b7fe640 1 -- 172.21.15.132:0/3766304461 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c0a6b40 con 0x7fbd54052fe0 2023-12-20T04:42:56.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7f002f5fa640 1 Processor -- start 2023-12-20T04:42:56.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7f69e93a3640 1 -- 172.21.15.132:0/2157276966 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f69e40cf280 con 0x7f69e40c2fa0 2023-12-20T04:42:56.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7fbd5b7fe640 1 -- 172.21.15.132:0/3766304461 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd5c0a6ca0 con 0x7fbd54052fe0 2023-12-20T04:42:56.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7fbd5b7fe640 1 -- 172.21.15.132:0/3766304461 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd5c0ae660 con 0x7fbd54052fe0 2023-12-20T04:42:56.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7f69eaba6640 1 -- 172.21.15.132:0/2157276966 >> v1:172.21.15.187:6789/0 conn(0x7f69e40c2fa0 legacy=0x7f69e4162350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7f69eaba6640 1 -- 172.21.15.132:0/2157276966 >> v1:172.21.15.132:6789/0 conn(0x7f69e406cff0 legacy=0x7f69e4165210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7f69eaba6640 1 -- 172.21.15.132:0/2157276966 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69e406d4d0 con 0x7f69e40c3380 2023-12-20T04:42:56.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f67aeffd640 1 -- 172.21.15.132:0/1070195084 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a402d6e0 con 0x7f67b006bd00 2023-12-20T04:42:56.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f67aeffd640 1 -- 172.21.15.132:0/1070195084 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a402d840 con 0x7f67b006bd00 2023-12-20T04:42:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f3567a70640 1 -- 172.21.15.132:0/352620843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35580e7700 msgr2=0x7f355803ab70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f356480a640 1 -- 172.21.15.132:0/352620843 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c02f050 con 0x7f35580e7700 2023-12-20T04:42:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f3567a70640 1 --2- 172.21.15.132:0/352620843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35580e7700 0x7f355803ab70 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f3558004ea0 tx=0x7f355c02b7a0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f3567a70640 1 -- 172.21.15.132:0/352620843 shutdown_connections 2023-12-20T04:42:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f3567a70640 1 --2- 172.21.15.132:0/352620843 >> v2:172.21.15.187:3300/0 conn(0x7f355804f500 0x7f355804f990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f3567a70640 1 --2- 172.21.15.132:0/352620843 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35580e7700 0x7f355803ab70 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f3567a70640 1 -- 172.21.15.132:0/352620843 >> 172.21.15.132:0/352620843 conn(0x7f355800a430 msgr2=0x7f355800a840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f651676c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65100cb2a0 0x7f65100c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f3567a70640 1 -- 172.21.15.132:0/352620843 shutdown_connections 2023-12-20T04:42:56.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.249+0000 7f942353e640 1 -- 172.21.15.132:0/226335373 shutdown_connections 2023-12-20T04:42:56.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.250+0000 7f002f5fa640 1 -- start start 2023-12-20T04:42:56.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f002f5fa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00280b6320 0x7f00281f6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f002f5fa640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00280cf910 0x7f0028153a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f69eaba6640 1 --2- 172.21.15.132:0/2157276966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69e40c3380 0x7f69e4070f50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009e50 tx=0x7f69dc02bf70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c579f6d87eb8a10 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f002f5fa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f002815d640 0x7f00281fac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f69e93a3640 1 -- 172.21.15.132:0/2157276966 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc02cb10 con 0x7f69e40c3380 2023-12-20T04:42:56.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7fecc7ff0640 1 Processor -- start 2023-12-20T04:42:56.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7fecc7ff0640 1 -- start start 2023-12-20T04:42:56.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f69e93a3640 1 -- 172.21.15.132:0/2157276966 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc02cc70 con 0x7f69e40c3380 2023-12-20T04:42:56.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f002cb95640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00280cf910 0x7f0028153a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f002cb95640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00280cf910 0x7f0028153a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:45174/0 (socket says 172.21.15.132:45174) 2023-12-20T04:42:56.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f69e93a3640 1 -- 172.21.15.132:0/2157276966 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc0343f0 con 0x7f69e40c3380 2023-12-20T04:42:56.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f002d396640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00280b6320 0x7f00281f6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f002d396640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00280b6320 0x7f00281f6f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:52494/0 (socket says 172.21.15.132:52494) 2023-12-20T04:42:56.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f67b56d5640 1 -- 172.21.15.132:0/1070195084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b006bd00 msgr2=0x7f67b015c7d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f67b56d5640 1 --2- 172.21.15.132:0/1070195084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b006bd00 0x7f67b015c7d0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f67a4009a00 tx=0x7f67a402bb30 comp rx=0 tx=0).stop 2023-12-20T04:42:56.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f002cb95640 1 -- 172.21.15.132:0/1637066642 learned_addr learned my addr 172.21.15.132:0/1637066642 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:56.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f002f5fa640 1 -- 172.21.15.132:0/1637066642 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0028153f70 con 0x7f002815d640 2023-12-20T04:42:56.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f002db97640 1 --2- 172.21.15.132:0/1637066642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f002815d640 0x7f00281fac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f002f5fa640 1 -- 172.21.15.132:0/1637066642 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00281f7ed0 con 0x7f00280cf910 2023-12-20T04:42:56.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f002f5fa640 1 -- 172.21.15.132:0/1637066642 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00281f7630 con 0x7f00280b6320 2023-12-20T04:42:56.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f3567a70640 1 -- 172.21.15.132:0/352620843 wait complete. 2023-12-20T04:42:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f651676c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65100cc9a0 0x7f65100c3930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f651676c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f651015d740 0x7f65100c3e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f651676c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65100c9a40 con 0x7f65100cc9a0 2023-12-20T04:42:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f651676c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65100c6180 con 0x7f651015d740 2023-12-20T04:42:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f651676c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65100c43b0 con 0x7f65100cb2a0 2023-12-20T04:42:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f6514f69640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65100cc9a0 0x7f65100c3930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f6514f69640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65100cc9a0 0x7f65100c3930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49402/0 (socket says 172.21.15.132:49402) 2023-12-20T04:42:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f6514f69640 1 -- 172.21.15.132:0/2720944690 learned_addr learned my addr 172.21.15.132:0/2720944690 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f651576a640 1 --2- 172.21.15.132:0/2720944690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65100cb2a0 0x7f65100c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f6515f6b640 1 --2- 172.21.15.132:0/2720944690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f651015d740 0x7f65100c3e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f6514f69640 1 -- 172.21.15.132:0/2720944690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65100cb2a0 msgr2=0x7f65100c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f6514f69640 1 --2- 172.21.15.132:0/2720944690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65100cb2a0 0x7f65100c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f6514f69640 1 -- 172.21.15.132:0/2720944690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f651015d740 msgr2=0x7f65100c3e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f6514f69640 1 --2- 172.21.15.132:0/2720944690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f651015d740 0x7f65100c3e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f6514f69640 1 -- 172.21.15.132:0/2720944690 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f650800bd40 con 0x7f65100cc9a0 2023-12-20T04:42:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f651576a640 1 --2- 172.21.15.132:0/2720944690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65100cb2a0 0x7f65100c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f6514f69640 1 --2- 172.21.15.132:0/2720944690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65100cc9a0 0x7f65100c3930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f650400b410 tx=0x7f650400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f6501ffb640 1 -- 172.21.15.132:0/2720944690 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6504011830 con 0x7f65100cc9a0 2023-12-20T04:42:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.252+0000 7f6501ffb640 1 -- 172.21.15.132:0/2720944690 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6504011990 con 0x7f65100cc9a0 2023-12-20T04:42:56.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fbd61a5b640 1 -- 172.21.15.132:0/3766304461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd54052fe0 msgr2=0x7fbd54053470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fbd61a5b640 1 --2- 172.21.15.132:0/3766304461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd54052fe0 0x7fbd54053470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7fbd5c079df0 tx=0x7fbd5c0a5ee0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fecc7ff0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecb8005ec0 0x7fecb8185100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fecc7ff0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb8006a50 0x7fecb80df4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fecc7ff0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb80eac80 0x7fecb8038330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fecc7ff0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb8185640 con 0x7fecb8006a50 2023-12-20T04:42:56.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fecc7ff0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80dfcf0 con 0x7fecb8005ec0 2023-12-20T04:42:56.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fecc7ff0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fecb80dffd0 con 0x7fecb80eac80 2023-12-20T04:42:56.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fbd61a5b640 1 -- 172.21.15.132:0/3766304461 shutdown_connections 2023-12-20T04:42:56.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fbd61a5b640 1 --2- 172.21.15.132:0/3766304461 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd54052fe0 0x7fbd54053470 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fbd61a5b640 1 --2- 172.21.15.132:0/3766304461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd540eb2c0 0x7fbd540eb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f002cb95640 1 -- 172.21.15.132:0/1637066642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00280b6320 msgr2=0x7f00281f6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f002cb95640 1 --2- 172.21.15.132:0/1637066642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00280b6320 0x7f00281f6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f002cb95640 1 -- 172.21.15.132:0/1637066642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f002815d640 msgr2=0x7f00281fac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f002cb95640 1 --2- 172.21.15.132:0/1637066642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f002815d640 0x7f00281fac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f002cb95640 1 -- 172.21.15.132:0/1637066642 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0020009b30 con 0x7f00280cf910 2023-12-20T04:42:56.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fbd61a5b640 1 --2- 172.21.15.132:0/3766304461 >> v2:172.21.15.132:3300/0 conn(0x7fbd540e78b0 0x7fbd5404f260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fbd61a5b640 1 -- 172.21.15.132:0/3766304461 >> 172.21.15.132:0/3766304461 conn(0x7fbd54054c10 msgr2=0x7fbd54054ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.251+0000 7f942353e640 1 -- 172.21.15.132:0/226335373 wait complete. 2023-12-20T04:42:56.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f002db97640 1 --2- 172.21.15.132:0/1637066642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f002815d640 0x7f00281fac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:56.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fecc658d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb80eac80 0x7fecb8038330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fecc658d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb80eac80 0x7fecb8038330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:52504/0 (socket says 172.21.15.132:52504) 2023-12-20T04:42:56.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fecc658d640 1 -- 172.21.15.132:0/1452218356 learned_addr learned my addr 172.21.15.132:0/1452218356 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:56.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f69ec609640 1 -- 172.21.15.132:0/2157276966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69e40c3380 msgr2=0x7f69e4070f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f69ec609640 1 --2- 172.21.15.132:0/2157276966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69e40c3380 0x7f69e4070f50 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f69dc009e50 tx=0x7f69dc02bf70 comp rx=0 tx=0).stop 2023-12-20T04:42:56.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fecc558b640 1 --2- 172.21.15.132:0/1452218356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb8006a50 0x7fecb80df4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fbd61a5b640 1 -- 172.21.15.132:0/3766304461 shutdown_connections 2023-12-20T04:42:56.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fecc5d8c640 1 --2- 172.21.15.132:0/1452218356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecb8005ec0 0x7fecb8185100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f002cb95640 1 --2- 172.21.15.132:0/1637066642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00280cf910 0x7f0028153a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f001800d800 tx=0x7f001800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fbd61a5b640 1 -- 172.21.15.132:0/3766304461 wait complete. 2023-12-20T04:42:56.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f67b56d5640 1 -- 172.21.15.132:0/1070195084 shutdown_connections 2023-12-20T04:42:56.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f67b56d5640 1 --2- 172.21.15.132:0/1070195084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67b00b30f0 0x7f67b015cd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f67b56d5640 1 --2- 172.21.15.132:0/1070195084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b006bd00 0x7f67b015c7d0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fecc658d640 1 -- 172.21.15.132:0/1452218356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecb8005ec0 msgr2=0x7fecb8185100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f67b56d5640 1 -- 172.21.15.132:0/1070195084 >> 172.21.15.132:0/1070195084 conn(0x7f67b0072c60 msgr2=0x7f67b0073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f6501ffb640 1 -- 172.21.15.132:0/2720944690 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6504011d40 con 0x7f65100cc9a0 2023-12-20T04:42:56.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fecc658d640 1 --2- 172.21.15.132:0/1452218356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecb8005ec0 0x7fecb8185100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fecc658d640 1 -- 172.21.15.132:0/1452218356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb8006a50 msgr2=0x7fecb80df4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fecc658d640 1 --2- 172.21.15.132:0/1452218356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb8006a50 0x7fecb80df4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7fecc658d640 1 -- 172.21.15.132:0/1452218356 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecbc009400 con 0x7fecb80eac80 2023-12-20T04:42:56.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f942353e640 1 Processor -- start 2023-12-20T04:42:56.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f67b56d5640 1 -- 172.21.15.132:0/1070195084 shutdown_connections 2023-12-20T04:42:56.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f67b56d5640 1 -- 172.21.15.132:0/1070195084 wait complete. 2023-12-20T04:42:56.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f69ec609640 1 -- 172.21.15.132:0/2157276966 shutdown_connections 2023-12-20T04:42:56.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f69ec609640 1 --2- 172.21.15.132:0/2157276966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69e40c3380 0x7f69e4070f50 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f69ec609640 1 -- 172.21.15.132:0/2157276966 >> 172.21.15.132:0/2157276966 conn(0x7f69e40cfca0 msgr2=0x7f69e40d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f001dffb640 1 -- 172.21.15.132:0/1637066642 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001800b6c0 con 0x7f00280cf910 2023-12-20T04:42:56.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f001dffb640 1 -- 172.21.15.132:0/1637066642 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f001800b820 con 0x7f00280cf910 2023-12-20T04:42:56.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.254+0000 7fecc658d640 1 --2- 172.21.15.132:0/1452218356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb80eac80 0x7fecb8038330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fecc0079a20 tx=0x7fecc004e650 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f3567a70640 1 Processor -- start 2023-12-20T04:42:56.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f3567a70640 1 -- start start 2023-12-20T04:42:56.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.254+0000 7f942353e640 1 -- start start 2023-12-20T04:42:56.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.253+0000 7f651676c640 1 -- 172.21.15.132:0/2720944690 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65100c7730 con 0x7f65100cc9a0 2023-12-20T04:42:56.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.254+0000 7f651676c640 1 -- 172.21.15.132:0/2720944690 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65100c7cf0 con 0x7f65100cc9a0 2023-12-20T04:42:56.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.254+0000 7f001dffb640 1 -- 172.21.15.132:0/1637066642 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f001800bb90 con 0x7f00280cf910 2023-12-20T04:42:56.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.254+0000 7f002f5fa640 1 -- 172.21.15.132:0/1637066642 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00281f7910 con 0x7f00280cf910 2023-12-20T04:42:56.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.254+0000 7fecc558b640 1 --2- 172.21.15.132:0/1452218356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb8006a50 0x7fecb80df4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:56.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.254+0000 7f002f5fa640 1 -- 172.21.15.132:0/1637066642 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00281fa6e0 con 0x7f00280cf910 2023-12-20T04:42:56.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7f3567a70640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f355804f500 0x7f3558044d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7f3567a70640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3558052a80 0x7f3558006f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7f3567a70640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355817d4e0 0x7f35580e22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7f3567a70640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f355817d050 con 0x7f355817d4e0 2023-12-20T04:42:56.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7f3567a70640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35580458f0 con 0x7f3558052a80 2023-12-20T04:42:56.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7f3567a70640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3558045610 con 0x7f355804f500 2023-12-20T04:42:56.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.254+0000 7fecb67fc640 1 -- 172.21.15.132:0/1452218356 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc00906c0 con 0x7fecb80eac80 2023-12-20T04:42:56.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.254+0000 7fecb67fc640 1 -- 172.21.15.132:0/1452218356 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecc0090820 con 0x7fecb80eac80 2023-12-20T04:42:56.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.254+0000 7fecb67fc640 1 -- 172.21.15.132:0/1452218356 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecc0090b90 con 0x7fecb80eac80 2023-12-20T04:42:56.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7f356580c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f355804f500 0x7f3558044d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7f942353e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f941c0b47e0 0x7f941c0c5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7f356580c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f355804f500 0x7f3558044d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:52506/0 (socket says 172.21.15.132:52506) 2023-12-20T04:42:56.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7f356580c640 1 -- 172.21.15.132:0/4100990724 learned_addr learned my addr 172.21.15.132:0/4100990724 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:56.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7fbd61a5b640 1 Processor -- start 2023-12-20T04:42:56.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7f942353e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f941c15e250 0x7f941c1f6b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7f69ec609640 1 -- 172.21.15.132:0/2157276966 shutdown_connections 2023-12-20T04:42:56.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7fbd61a5b640 1 -- start start 2023-12-20T04:42:56.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7f94212da640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f941c0b47e0 0x7f941c0c5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7f356500b640 1 --2- 172.21.15.132:0/4100990724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3558052a80 0x7f3558006f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7f94212da640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f941c0b47e0 0x7f941c0c5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:45190/0 (socket says 172.21.15.132:45190) 2023-12-20T04:42:56.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f651676c640 1 -- 172.21.15.132:0/2720944690 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65100673e0 con 0x7f65100cc9a0 2023-12-20T04:42:56.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7f94212da640 1 -- 172.21.15.132:0/1945976876 learned_addr learned my addr 172.21.15.132:0/1945976876 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:56.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f356580c640 1 -- 172.21.15.132:0/4100990724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3558052a80 msgr2=0x7f3558006f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f356580c640 1 --2- 172.21.15.132:0/4100990724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3558052a80 0x7f3558006f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f356580c640 1 -- 172.21.15.132:0/4100990724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355817d4e0 msgr2=0x7f35580e22d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f356580c640 1 --2- 172.21.15.132:0/4100990724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355817d4e0 0x7f35580e22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f9420ad9640 1 --2- 172.21.15.132:0/1945976876 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f941c15e250 0x7f941c1f6b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f942353e640 1 --2- 172.21.15.132:0/1945976876 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f941c15d410 0x7f941c15d890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f942353e640 1 -- 172.21.15.132:0/1945976876 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c1f70b0 con 0x7f941c15d410 2023-12-20T04:42:56.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f942353e640 1 -- 172.21.15.132:0/1945976876 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c15ddd0 con 0x7f941c0b47e0 2023-12-20T04:42:56.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f942353e640 1 -- 172.21.15.132:0/1945976876 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f941c0c65f0 con 0x7f941c15e250 2023-12-20T04:42:56.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f356580c640 1 -- 172.21.15.132:0/4100990724 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f355c009400 con 0x7f355804f500 2023-12-20T04:42:56.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.255+0000 7f69ec609640 1 -- 172.21.15.132:0/2157276966 wait complete. 2023-12-20T04:42:56.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f67b56d5640 1 Processor -- start 2023-12-20T04:42:56.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f000b7fe640 1 -- 172.21.15.132:0/1637066642 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0004005250 con 0x7f00280cf910 2023-12-20T04:42:56.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f6501ffb640 1 -- 172.21.15.132:0/2720944690 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f650401a410 con 0x7f65100cc9a0 2023-12-20T04:42:56.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7fecc7ff0640 1 -- 172.21.15.132:0/1452218356 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fecb8048550 con 0x7fecb80eac80 2023-12-20T04:42:56.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7fecc7ff0640 1 -- 172.21.15.132:0/1452218356 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fecb8048b10 con 0x7fecb80eac80 2023-12-20T04:42:56.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f356580c640 1 --2- 172.21.15.132:0/4100990724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f355804f500 0x7f3558044d30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f355c036040 tx=0x7f355c0046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f9420ad9640 1 -- 172.21.15.132:0/1945976876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f941c0b47e0 msgr2=0x7f941c0c5890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f9420ad9640 1 --2- 172.21.15.132:0/1945976876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f941c0b47e0 0x7f941c0c5890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f9420ad9640 1 -- 172.21.15.132:0/1945976876 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f941c15d410 msgr2=0x7f941c15d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f9420ad9640 1 --2- 172.21.15.132:0/1945976876 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f941c15d410 0x7f941c15d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.256+0000 7f9420ad9640 1 -- 172.21.15.132:0/1945976876 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f941c0c68d0 con 0x7f941c15e250 2023-12-20T04:42:56.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7f9420ad9640 1 --2- 172.21.15.132:0/1945976876 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f941c15e250 0x7f941c1f6b70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f940c00d560 tx=0x7f940c00da20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7f67b56d5640 1 -- start start 2023-12-20T04:42:56.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7f35567fc640 1 -- 172.21.15.132:0/4100990724 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c031500 con 0x7f355804f500 2023-12-20T04:42:56.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7fbd61a5b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd54052fe0 0x7fbd540da4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7fbd61a5b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd540e78b0 0x7fbd540e6680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7f69ec609640 1 Processor -- start 2023-12-20T04:42:56.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7fbd61a5b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd540eb2c0 0x7fbd54170ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7fbd5bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd540e78b0 0x7fbd540e6680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7fbd61a5b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540e6bc0 con 0x7fbd540e78b0 2023-12-20T04:42:56.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7fbd5bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd540e78b0 0x7fbd540e6680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49442/0 (socket says 172.21.15.132:49442) 2023-12-20T04:42:56.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7fbd5bfff640 1 -- 172.21.15.132:0/3112259362 learned_addr learned my addr 172.21.15.132:0/3112259362 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:56.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7fbd61a5b640 1 -- 172.21.15.132:0/3112259362 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540e4ea0 con 0x7fbd54052fe0 2023-12-20T04:42:56.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7fbd61a5b640 1 -- 172.21.15.132:0/3112259362 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd540e9780 con 0x7fbd540eb2c0 2023-12-20T04:42:56.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7f3567a70640 1 -- 172.21.15.132:0/4100990724 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f355817ca00 con 0x7f355804f500 2023-12-20T04:42:56.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7fbd6125a640 1 --2- 172.21.15.132:0/3112259362 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd540eb2c0 0x7fbd54170ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7f3567a70640 1 -- 172.21.15.132:0/4100990724 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3558045270 con 0x7f355804f500 2023-12-20T04:42:56.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7f35567fc640 1 -- 172.21.15.132:0/4100990724 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f355c003820 con 0x7f355804f500 2023-12-20T04:42:56.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7f35567fc640 1 -- 172.21.15.132:0/4100990724 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f355c003b90 con 0x7f355804f500 2023-12-20T04:42:56.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7f001dffb640 1 -- 172.21.15.132:0/1637066642 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f001800bcf0 con 0x7f00280cf910 2023-12-20T04:42:56.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7f001dffb640 1 --2- 172.21.15.132:0/1637066642 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f000c06a430 0x7f000c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7f001dffb640 1 -- 172.21.15.132:0/1637066642 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0018088dd0 con 0x7f00280cf910 2023-12-20T04:42:56.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7fbd60a59640 1 --2- 172.21.15.132:0/3112259362 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd54052fe0 0x7fbd540da4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7f69ec609640 1 -- start start 2023-12-20T04:42:56.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7f67b56d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b006bd00 0x7f67b0158c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7f67b56d5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67b006c0e0 0x7f67b00c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7f67b56d5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67b00c6d40 0x7f67b00c9330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7f67b56d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b00c71c0 con 0x7f67b006bd00 2023-12-20T04:42:56.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7f67b56d5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67b01ee180 con 0x7f67b00c6d40 2023-12-20T04:42:56.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7f67b56d5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67b00ca0d0 con 0x7f67b006c0e0 2023-12-20T04:42:56.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7f002d396640 1 --2- 172.21.15.132:0/1637066642 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f000c06a430 0x7f000c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7f9411ffb640 1 -- 172.21.15.132:0/1945976876 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c0125f0 con 0x7f941c15e250 2023-12-20T04:42:56.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7f942353e640 1 -- 172.21.15.132:0/1945976876 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c0c6bb0 con 0x7f941c15e250 2023-12-20T04:42:56.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7fbd60a59640 1 -- 172.21.15.132:0/3112259362 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd540eb2c0 msgr2=0x7fbd54170ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7fbd60a59640 1 --2- 172.21.15.132:0/3112259362 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd540eb2c0 0x7fbd54170ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7fbd60a59640 1 -- 172.21.15.132:0/3112259362 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd540e78b0 msgr2=0x7fbd540e6680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7fbd60a59640 1 --2- 172.21.15.132:0/3112259362 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd540e78b0 0x7fbd540e6680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7fbd60a59640 1 -- 172.21.15.132:0/3112259362 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd5404a5f0 con 0x7fbd54052fe0 2023-12-20T04:42:56.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.259+0000 7f942353e640 1 -- 172.21.15.132:0/1945976876 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c0b4bc0 con 0x7f941c15e250 2023-12-20T04:42:56.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.259+0000 7f002d396640 1 --2- 172.21.15.132:0/1637066642 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f000c06a430 0x7f000c06c8f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0024009930 tx=0x7f0024009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.259+0000 7f9411ffb640 1 -- 172.21.15.132:0/1945976876 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f940c012750 con 0x7f941c15e250 2023-12-20T04:42:56.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.259+0000 7f3567a70640 1 -- 172.21.15.132:0/4100990724 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3548005250 con 0x7f355804f500 2023-12-20T04:42:56.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.259+0000 7fbd60a59640 1 --2- 172.21.15.132:0/3112259362 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd54052fe0 0x7fbd540da4b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00e870 tx=0x7fbd4c00ed30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.257+0000 7f6501ffb640 1 --2- 172.21.15.132:0/2720944690 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f64f407b540 0x7f64f407da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7f6501ffb640 1 -- 172.21.15.132:0/2720944690 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6504088470 con 0x7f65100cc9a0 2023-12-20T04:42:56.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.258+0000 7f651576a640 1 --2- 172.21.15.132:0/2720944690 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f64f407b540 0x7f64f407da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.259+0000 7f651576a640 1 --2- 172.21.15.132:0/2720944690 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f64f407b540 0x7f64f407da00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f650c006fd0 tx=0x7f650c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.259+0000 7f9411ffb640 1 -- 172.21.15.132:0/1945976876 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f940c012b00 con 0x7f941c15e250 2023-12-20T04:42:56.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.259+0000 7fecb67fc640 1 -- 172.21.15.132:0/1452218356 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fecc0090cf0 con 0x7fecb80eac80 2023-12-20T04:42:56.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.259+0000 7fecc7ff0640 1 -- 172.21.15.132:0/1452218356 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fecb8005330 con 0x7fecb80eac80 2023-12-20T04:42:56.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.259+0000 7f67affff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b006bd00 0x7f67b0158c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.259+0000 7f67affff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b006bd00 0x7f67b0158c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49446/0 (socket says 172.21.15.132:49446) 2023-12-20T04:42:56.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.259+0000 7f67affff640 1 -- 172.21.15.132:0/1521984437 learned_addr learned my addr 172.21.15.132:0/1521984437 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:56.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.259+0000 7f69ec609640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69e406cff0 0x7f69e40c5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f69ec609640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69e40c2fa0 0x7f69e415ce70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f69ec609640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69e40c3380 0x7f69e415d3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f69ec609640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e40c5490 con 0x7f69e40c3380 2023-12-20T04:42:56.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7fecb67fc640 1 --2- 172.21.15.132:0/1452218356 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feca406a480 0x7feca406c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f69ec609640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e40c6240 con 0x7f69e40c2fa0 2023-12-20T04:42:56.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f69ec609640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f69e4162460 con 0x7f69e406cff0 2023-12-20T04:42:56.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7fecb67fc640 1 -- 172.21.15.132:0/1452218356 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fecc0102930 con 0x7fecb80eac80 2023-12-20T04:42:56.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f67affff640 1 -- 172.21.15.132:0/1521984437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67b006c0e0 msgr2=0x7f67b00c6800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-20T04:42:56.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f67affff640 1 --2- 172.21.15.132:0/1521984437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67b006c0e0 0x7f67b00c6800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f67affff640 1 -- 172.21.15.132:0/1521984437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67b00c6d40 msgr2=0x7f67b00c9330 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2023-12-20T04:42:56.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f67affff640 1 --2- 172.21.15.132:0/1521984437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67b00c6d40 0x7f67b00c9330 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f67affff640 1 -- 172.21.15.132:0/1521984437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a4009400 con 0x7f67b006bd00 2023-12-20T04:42:56.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f69e9ba4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69e40c2fa0 0x7f69e415ce70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f69ea3a5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69e406cff0 0x7f69e40c5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7fecc5d8c640 1 --2- 172.21.15.132:0/1452218356 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feca406a480 0x7feca406c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f35567fc640 1 -- 172.21.15.132:0/4100990724 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f355c003cf0 con 0x7f355804f500 2023-12-20T04:42:56.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f69e9ba4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69e40c2fa0 0x7f69e415ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:45222/0 (socket says 172.21.15.132:45222) 2023-12-20T04:42:56.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.261+0000 7f35567fc640 1 --2- 172.21.15.132:0/4100990724 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f354406a430 0x7f354406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.261+0000 7fecc5d8c640 1 --2- 172.21.15.132:0/1452218356 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feca406a480 0x7feca406c940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fecbc036000 tx=0x7fecbc03d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.261+0000 7f67affff640 1 --2- 172.21.15.132:0/1521984437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b006bd00 0x7f67b0158c30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f67a4037040 tx=0x7f67a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f69eaba6640 1 --2- 172.21.15.132:0/3107716149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69e40c3380 0x7f69e415d3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f69eaba6640 1 -- 172.21.15.132:0/3107716149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69e406cff0 msgr2=0x7f69e40c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.261+0000 7f35567fc640 1 -- 172.21.15.132:0/4100990724 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f355c0aa970 con 0x7f355804f500 2023-12-20T04:42:56.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.261+0000 7f356500b640 1 --2- 172.21.15.132:0/4100990724 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f354406a430 0x7f354406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f69eaba6640 1 --2- 172.21.15.132:0/3107716149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69e406cff0 0x7f69e40c5b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f69eaba6640 1 -- 172.21.15.132:0/3107716149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69e40c2fa0 msgr2=0x7f69e415ce70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f69eaba6640 1 --2- 172.21.15.132:0/3107716149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69e40c2fa0 0x7f69e415ce70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f69eaba6640 1 -- 172.21.15.132:0/3107716149 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69dc009b30 con 0x7f69e40c3380 2023-12-20T04:42:56.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.261+0000 7f69eaba6640 1 --2- 172.21.15.132:0/3107716149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69e40c3380 0x7f69e415d3b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f69e40cfc00 tx=0x7f69dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.260+0000 7f69e9ba4640 1 -- 172.21.15.132:0/3107716149 learned_addr learned my addr 172.21.15.132:0/3107716149 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:56.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.261+0000 7f69e9ba4640 1 --2- 172.21.15.132:0/3107716149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69e40c2fa0 0x7f69e415ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2023-12-20T04:42:56.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.261+0000 7f9411ffb640 1 -- 172.21.15.132:0/1945976876 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f940c012c60 con 0x7f941c15e250 2023-12-20T04:42:56.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.261+0000 7f356500b640 1 --2- 172.21.15.132:0/4100990724 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f354406a430 0x7f354406c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f355804dd50 tx=0x7f3550009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.261+0000 7f9411ffb640 1 --2- 172.21.15.132:0/1945976876 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f940006a500 0x7f940006c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.261+0000 7f942353e640 1 -- 172.21.15.132:0/1945976876 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93fc005250 con 0x7f941c15e250 2023-12-20T04:42:56.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.261+0000 7f94212da640 1 --2- 172.21.15.132:0/1945976876 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f940006a500 0x7f940006c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.262+0000 7f9411ffb640 1 -- 172.21.15.132:0/1945976876 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f940c088ba0 con 0x7f941c15e250 2023-12-20T04:42:56.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.262+0000 7f94212da640 1 --2- 172.21.15.132:0/1945976876 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f940006a500 0x7f940006c9c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9414007460 tx=0x7f9414001e10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.262+0000 7fbd597fa640 1 -- 172.21.15.132:0/3112259362 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c009e10 con 0x7fbd54052fe0 2023-12-20T04:42:56.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.262+0000 7fbd597fa640 1 -- 172.21.15.132:0/3112259362 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd4c00c940 con 0x7fbd54052fe0 2023-12-20T04:42:56.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.262+0000 7fbd597fa640 1 -- 172.21.15.132:0/3112259362 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd4c00ccd0 con 0x7fbd54052fe0 2023-12-20T04:42:56.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.262+0000 7fbd61a5b640 1 -- 172.21.15.132:0/3112259362 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd5404a8d0 con 0x7fbd54052fe0 2023-12-20T04:42:56.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.262+0000 7fbd61a5b640 1 -- 172.21.15.132:0/3112259362 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd54171000 con 0x7fbd54052fe0 2023-12-20T04:42:56.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.262+0000 7f001dffb640 1 -- 172.21.15.132:0/1637066642 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f001808c030 con 0x7f00280cf910 2023-12-20T04:42:56.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.263+0000 7fbd61a5b640 1 -- 172.21.15.132:0/3112259362 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd541711c0 con 0x7fbd54052fe0 2023-12-20T04:42:56.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.264+0000 7fbd597fa640 1 -- 172.21.15.132:0/3112259362 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbd4c013470 con 0x7fbd54052fe0 2023-12-20T04:42:56.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.264+0000 7f69daffd640 1 -- 172.21.15.132:0/3107716149 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc03e450 con 0x7f69e40c3380 2023-12-20T04:42:56.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.264+0000 7f69ec609640 1 -- 172.21.15.132:0/3107716149 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e4162740 con 0x7f69e40c3380 2023-12-20T04:42:56.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.264+0000 7f69ec609640 1 -- 172.21.15.132:0/3107716149 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e4162d00 con 0x7f69e40c3380 2023-12-20T04:42:56.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.264+0000 7f69daffd640 1 -- 172.21.15.132:0/3107716149 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f69dc03e5b0 con 0x7f69e40c3380 2023-12-20T04:42:56.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.264+0000 7f67acff9640 1 -- 172.21.15.132:0/1521984437 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a4003ae0 con 0x7f67b006bd00 2023-12-20T04:42:56.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.264+0000 7f6501ffb640 1 -- 172.21.15.132:0/2720944690 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6504053a40 con 0x7f65100cc9a0 2023-12-20T04:42:56.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.264+0000 7f69daffd640 1 -- 172.21.15.132:0/3107716149 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f69dc03e960 con 0x7f69e40c3380 2023-12-20T04:42:56.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.264+0000 7fbd597fa640 1 --2- 172.21.15.132:0/3112259362 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd4806a430 0x7fbd4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.264+0000 7f67acff9640 1 -- 172.21.15.132:0/1521984437 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67a4003c40 con 0x7f67b006bd00 2023-12-20T04:42:56.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.264+0000 7f67acff9640 1 -- 172.21.15.132:0/1521984437 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f67a4041470 con 0x7f67b006bd00 2023-12-20T04:42:56.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.264+0000 7fbd597fa640 1 -- 172.21.15.132:0/3112259362 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd4c088850 con 0x7fbd54052fe0 2023-12-20T04:42:56.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.265+0000 7f35567fc640 1 -- 172.21.15.132:0/4100990724 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f355c076060 con 0x7f355804f500 2023-12-20T04:42:56.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.265+0000 7fbd5bfff640 1 --2- 172.21.15.132:0/3112259362 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd4806a430 0x7fbd4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.265+0000 7fbd5bfff640 1 --2- 172.21.15.132:0/3112259362 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd4806a430 0x7fbd4806c8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbd54173c90 tx=0x7fbd50008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.265+0000 7f67b56d5640 1 -- 172.21.15.132:0/1521984437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67b00ca3b0 con 0x7f67b006bd00 2023-12-20T04:42:56.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.265+0000 7f67b56d5640 1 -- 172.21.15.132:0/1521984437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67b00ca970 con 0x7f67b006bd00 2023-12-20T04:42:56.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.265+0000 7f69ec609640 1 -- 172.21.15.132:0/3107716149 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e4162ee0 con 0x7f69e40c3380 2023-12-20T04:42:56.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.266+0000 7f69daffd640 1 -- 172.21.15.132:0/3107716149 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f69dc03eac0 con 0x7f69e40c3380 2023-12-20T04:42:56.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.267+0000 7f69daffd640 1 --2- 172.21.15.132:0/3107716149 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f69c806a430 0x7f69c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.267+0000 7f69daffd640 1 -- 172.21.15.132:0/3107716149 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f69dc0ab3a0 con 0x7f69e40c3380 2023-12-20T04:42:56.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.267+0000 7f69ea3a5640 1 --2- 172.21.15.132:0/3107716149 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f69c806a430 0x7f69c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.267+0000 7f67b56d5640 1 -- 172.21.15.132:0/1521984437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67b00673e0 con 0x7f67b006bd00 2023-12-20T04:42:56.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.268+0000 7f69ea3a5640 1 --2- 172.21.15.132:0/3107716149 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f69c806a430 0x7f69c806c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f69e0001110 tx=0x7f69e0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.269+0000 7f67acff9640 1 -- 172.21.15.132:0/1521984437 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f67a402d9b0 con 0x7f67b006bd00 2023-12-20T04:42:56.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.269+0000 7fbd597fa640 1 -- 172.21.15.132:0/3112259362 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbd4c053ee0 con 0x7fbd54052fe0 2023-12-20T04:42:56.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.269+0000 7fecb67fc640 1 -- 172.21.15.132:0/1452218356 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fecc00ce090 con 0x7fecb80eac80 2023-12-20T04:42:56.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.269+0000 7f67acff9640 1 --2- 172.21.15.132:0/1521984437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f679c06a4b0 0x7f679c06c970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:56.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.269+0000 7f67af7fe640 1 --2- 172.21.15.132:0/1521984437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f679c06a4b0 0x7f679c06c970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:56.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.270+0000 7f67af7fe640 1 --2- 172.21.15.132:0/1521984437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f679c06a4b0 0x7f679c06c970 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f67a0006fd0 tx=0x7f67a0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:56.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.274+0000 7f9411ffb640 1 -- 172.21.15.132:0/1945976876 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f940c054240 con 0x7f941c15e250 2023-12-20T04:42:56.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.276+0000 7f69daffd640 1 -- 172.21.15.132:0/3107716149 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f69dc076a20 con 0x7f69e40c3380 2023-12-20T04:42:56.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.285+0000 7f67acff9640 1 -- 172.21.15.132:0/1521984437 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f67a4031070 con 0x7f67b006bd00 2023-12-20T04:42:56.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.285+0000 7f67acff9640 1 -- 172.21.15.132:0/1521984437 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f67a4077000 con 0x7f67b006bd00 2023-12-20T04:42:56.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.652+0000 7f651676c640 1 -- 172.21.15.132:0/2720944690 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f651006cd60 con 0x7f65100cc9a0 2023-12-20T04:42:56.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.653+0000 7f6501ffb640 1 -- 172.21.15.132:0/2720944690 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6504057060 con 0x7f65100cc9a0 2023-12-20T04:42:56.653 INFO:teuthology.orchestra.run.smithi132.stdout:55834574852 2023-12-20T04:42:56.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.656+0000 7f64f37fe640 1 -- 172.21.15.132:0/2720944690 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f64f407b540 msgr2=0x7f64f407da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.656+0000 7f64f37fe640 1 --2- 172.21.15.132:0/2720944690 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f64f407b540 0x7f64f407da00 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f650c006fd0 tx=0x7f650c008040 comp rx=0 tx=0).stop 2023-12-20T04:42:56.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.656+0000 7f64f37fe640 1 -- 172.21.15.132:0/2720944690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65100cc9a0 msgr2=0x7f65100c3930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.657+0000 7f64f37fe640 1 --2- 172.21.15.132:0/2720944690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65100cc9a0 0x7f65100c3930 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f650400b410 tx=0x7f650400b8d0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.657+0000 7f64f37fe640 1 -- 172.21.15.132:0/2720944690 shutdown_connections 2023-12-20T04:42:56.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.657+0000 7f64f37fe640 1 --2- 172.21.15.132:0/2720944690 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f64f407b540 0x7f64f407da00 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.657+0000 7f64f37fe640 1 --2- 172.21.15.132:0/2720944690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f651015d740 0x7f65100c3e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.657+0000 7f64f37fe640 1 --2- 172.21.15.132:0/2720944690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f65100cc9a0 0x7f65100c3930 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.657+0000 7f64f37fe640 1 --2- 172.21.15.132:0/2720944690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65100cb2a0 0x7f65100c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.657+0000 7f64f37fe640 1 -- 172.21.15.132:0/2720944690 >> 172.21.15.132:0/2720944690 conn(0x7f65100b1640 msgr2=0x7f65100b1a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.657+0000 7f64f37fe640 1 -- 172.21.15.132:0/2720944690 shutdown_connections 2023-12-20T04:42:56.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.658+0000 7f64f37fe640 1 -- 172.21.15.132:0/2720944690 wait complete. 2023-12-20T04:42:56.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.663+0000 7fecc7ff0640 1 -- 172.21.15.132:0/1452218356 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fecb8052810 con 0x7fecb80eac80 2023-12-20T04:42:56.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.664+0000 7fecb67fc640 1 -- 172.21.15.132:0/1452218356 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fecc008f090 con 0x7fecb80eac80 2023-12-20T04:42:56.665 INFO:teuthology.orchestra.run.smithi132.stdout:55834574852 2023-12-20T04:42:56.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.664+0000 7fbd61a5b640 1 -- 172.21.15.132:0/3112259362 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7fbd54005490 con 0x7fbd54052fe0 2023-12-20T04:42:56.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.665+0000 7fbd597fa640 1 -- 172.21.15.132:0/3112259362 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fbd4c021020 con 0x7fbd54052fe0 2023-12-20T04:42:56.665 INFO:teuthology.orchestra.run.smithi132.stdout:55834574852 2023-12-20T04:42:56.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.667+0000 7feca3fff640 1 -- 172.21.15.132:0/1452218356 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feca406a480 msgr2=0x7feca406c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.667+0000 7feca3fff640 1 --2- 172.21.15.132:0/1452218356 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feca406a480 0x7feca406c940 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fecbc036000 tx=0x7fecbc03d040 comp rx=0 tx=0).stop 2023-12-20T04:42:56.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.668+0000 7feca3fff640 1 -- 172.21.15.132:0/1452218356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb80eac80 msgr2=0x7fecb8038330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.668+0000 7feca3fff640 1 --2- 172.21.15.132:0/1452218356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb80eac80 0x7fecb8038330 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fecc0079a20 tx=0x7fecc004e650 comp rx=0 tx=0).stop 2023-12-20T04:42:56.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.668+0000 7feca3fff640 1 -- 172.21.15.132:0/1452218356 shutdown_connections 2023-12-20T04:42:56.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.668+0000 7feca3fff640 1 --2- 172.21.15.132:0/1452218356 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feca406a480 0x7feca406c940 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.668+0000 7feca3fff640 1 --2- 172.21.15.132:0/1452218356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fecb80eac80 0x7fecb8038330 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.668+0000 7feca3fff640 1 --2- 172.21.15.132:0/1452218356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fecb8006a50 0x7fecb80df4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.668+0000 7feca3fff640 1 --2- 172.21.15.132:0/1452218356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fecb8005ec0 0x7fecb8185100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.668+0000 7feca3fff640 1 -- 172.21.15.132:0/1452218356 >> 172.21.15.132:0/1452218356 conn(0x7fecb8009fe0 msgr2=0x7fecb8039970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.668+0000 7feca3fff640 1 -- 172.21.15.132:0/1452218356 shutdown_connections 2023-12-20T04:42:56.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.668+0000 7feca3fff640 1 -- 172.21.15.132:0/1452218356 wait complete. 2023-12-20T04:42:56.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.668+0000 7f000b7fe640 1 -- 172.21.15.132:0/1637066642 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7f0004005500 con 0x7f00280cf910 2023-12-20T04:42:56.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.669+0000 7f942353e640 1 -- 172.21.15.132:0/1945976876 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f93fc005500 con 0x7f941c15e250 2023-12-20T04:42:56.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.669+0000 7fbd61a5b640 1 -- 172.21.15.132:0/3112259362 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd4806a430 msgr2=0x7fbd4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.669+0000 7fbd61a5b640 1 --2- 172.21.15.132:0/3112259362 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd4806a430 0x7fbd4806c8f0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fbd54173c90 tx=0x7fbd50008040 comp rx=0 tx=0).stop 2023-12-20T04:42:56.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.669+0000 7f001dffb640 1 -- 172.21.15.132:0/1637066642 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f00180543b0 con 0x7f00280cf910 2023-12-20T04:42:56.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.669+0000 7fbd61a5b640 1 -- 172.21.15.132:0/3112259362 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd54052fe0 msgr2=0x7fbd540da4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.669+0000 7fbd61a5b640 1 --2- 172.21.15.132:0/3112259362 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd54052fe0 0x7fbd540da4b0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fbd4c00e870 tx=0x7fbd4c00ed30 comp rx=0 tx=0).stop 2023-12-20T04:42:56.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.669+0000 7f3567a70640 1 -- 172.21.15.132:0/4100990724 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7f35480057d0 con 0x7f355804f500 2023-12-20T04:42:56.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.669+0000 7fbd61a5b640 1 -- 172.21.15.132:0/3112259362 shutdown_connections 2023-12-20T04:42:56.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.669+0000 7fbd61a5b640 1 --2- 172.21.15.132:0/3112259362 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd4806a430 0x7fbd4806c8f0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.674 INFO:teuthology.orchestra.run.smithi132.stdout:55834574852 2023-12-20T04:42:56.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.669+0000 7fbd61a5b640 1 --2- 172.21.15.132:0/3112259362 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd540eb2c0 0x7fbd54170ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.669+0000 7fbd61a5b640 1 --2- 172.21.15.132:0/3112259362 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd540e78b0 0x7fbd540e6680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.669+0000 7fbd61a5b640 1 --2- 172.21.15.132:0/3112259362 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd54052fe0 0x7fbd540da4b0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.669+0000 7fbd61a5b640 1 -- 172.21.15.132:0/3112259362 >> 172.21.15.132:0/3112259362 conn(0x7fbd54054c10 msgr2=0x7fbd5404c2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.669+0000 7fbd61a5b640 1 -- 172.21.15.132:0/3112259362 shutdown_connections 2023-12-20T04:42:56.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.669+0000 7fbd61a5b640 1 -- 172.21.15.132:0/3112259362 wait complete. 2023-12-20T04:42:56.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.669+0000 7f35567fc640 1 -- 172.21.15.132:0/4100990724 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f355c079680 con 0x7f355804f500 2023-12-20T04:42:56.676 INFO:teuthology.orchestra.run.smithi132.stdout:55834574852 2023-12-20T04:42:56.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.669+0000 7f9411ffb640 1 -- 172.21.15.132:0/1945976876 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f940c057820 con 0x7f941c15e250 2023-12-20T04:42:56.676 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2023-12-20T04:42:56.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.671+0000 7f69ec609640 1 -- 172.21.15.132:0/3107716149 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f69e41625a0 con 0x7f69e40c3380 2023-12-20T04:42:56.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.672+0000 7f000b7fe640 1 -- 172.21.15.132:0/1637066642 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f000c06a430 msgr2=0x7f000c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.673+0000 7f000b7fe640 1 --2- 172.21.15.132:0/1637066642 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f000c06a430 0x7f000c06c8f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f0024009930 tx=0x7f0024009060 comp rx=0 tx=0).stop 2023-12-20T04:42:56.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.673+0000 7f000b7fe640 1 -- 172.21.15.132:0/1637066642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00280cf910 msgr2=0x7f0028153a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.673+0000 7f000b7fe640 1 --2- 172.21.15.132:0/1637066642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00280cf910 0x7f0028153a30 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f001800d800 tx=0x7f001800dcc0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.673+0000 7f000b7fe640 1 -- 172.21.15.132:0/1637066642 shutdown_connections 2023-12-20T04:42:56.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.673+0000 7f000b7fe640 1 --2- 172.21.15.132:0/1637066642 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f000c06a430 0x7f000c06c8f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.673+0000 7f000b7fe640 1 --2- 172.21.15.132:0/1637066642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f002815d640 0x7f00281fac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.673+0000 7f000b7fe640 1 --2- 172.21.15.132:0/1637066642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00280cf910 0x7f0028153a30 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.673+0000 7f000b7fe640 1 --2- 172.21.15.132:0/1637066642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f00280b6320 0x7f00281f6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.673+0000 7f000b7fe640 1 -- 172.21.15.132:0/1637066642 >> 172.21.15.132:0/1637066642 conn(0x7f002806be70 msgr2=0x7f00280b8140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.673+0000 7f69daffd640 1 -- 172.21.15.132:0/3107716149 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f69e41625a0 con 0x7f69e40c3380 2023-12-20T04:42:56.679 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2023-12-20T04:42:56.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.673+0000 7f000b7fe640 1 -- 172.21.15.132:0/1637066642 shutdown_connections 2023-12-20T04:42:56.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.673+0000 7f000b7fe640 1 -- 172.21.15.132:0/1637066642 wait complete. 2023-12-20T04:42:56.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.673+0000 7f3567a70640 1 -- 172.21.15.132:0/4100990724 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f354406a430 msgr2=0x7f354406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.673+0000 7f3567a70640 1 --2- 172.21.15.132:0/4100990724 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f354406a430 0x7f354406c8f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f355804dd50 tx=0x7f3550009040 comp rx=0 tx=0).stop 2023-12-20T04:42:56.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.674+0000 7f942353e640 1 -- 172.21.15.132:0/1945976876 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f940006a500 msgr2=0x7f940006c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.673+0000 7f3567a70640 1 -- 172.21.15.132:0/4100990724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f355804f500 msgr2=0x7f3558044d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.674+0000 7f3567a70640 1 --2- 172.21.15.132:0/4100990724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f355804f500 0x7f3558044d30 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f355c036040 tx=0x7f355c0046c0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.674+0000 7f942353e640 1 --2- 172.21.15.132:0/1945976876 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f940006a500 0x7f940006c9c0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9414007460 tx=0x7f9414001e10 comp rx=0 tx=0).stop 2023-12-20T04:42:56.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.674+0000 7f942353e640 1 -- 172.21.15.132:0/1945976876 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f941c15e250 msgr2=0x7f941c1f6b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.674+0000 7f942353e640 1 --2- 172.21.15.132:0/1945976876 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f941c15e250 0x7f941c1f6b70 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7f940c00d560 tx=0x7f940c00da20 comp rx=0 tx=0).stop 2023-12-20T04:42:56.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.674+0000 7f942353e640 1 -- 172.21.15.132:0/1945976876 shutdown_connections 2023-12-20T04:42:56.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.674+0000 7f942353e640 1 --2- 172.21.15.132:0/1945976876 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f940006a500 0x7f940006c9c0 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f9414007460 tx=0x7f9414001e10 comp rx=0 tx=0).stop 2023-12-20T04:42:56.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.674+0000 7f942353e640 1 --2- 172.21.15.132:0/1945976876 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f941c15d410 0x7f941c15d890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.674+0000 7f942353e640 1 --2- 172.21.15.132:0/1945976876 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f941c15e250 0x7f941c1f6b70 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.674+0000 7f3567a70640 1 -- 172.21.15.132:0/4100990724 shutdown_connections 2023-12-20T04:42:56.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.674+0000 7f3567a70640 1 --2- 172.21.15.132:0/4100990724 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f354406a430 0x7f354406c8f0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.674+0000 7f3567a70640 1 --2- 172.21.15.132:0/4100990724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f355817d4e0 0x7f35580e22d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.674+0000 7f3567a70640 1 --2- 172.21.15.132:0/4100990724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3558052a80 0x7f3558006f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.674+0000 7f942353e640 1 --2- 172.21.15.132:0/1945976876 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f941c0b47e0 0x7f941c0c5890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.674+0000 7f3567a70640 1 --2- 172.21.15.132:0/4100990724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f355804f500 0x7f3558044d30 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.674+0000 7f3567a70640 1 -- 172.21.15.132:0/4100990724 >> 172.21.15.132:0/4100990724 conn(0x7f355800a430 msgr2=0x7f3558005ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.674+0000 7f942353e640 1 -- 172.21.15.132:0/1945976876 >> 172.21.15.132:0/1945976876 conn(0x7f941c06a050 msgr2=0x7f941c06fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.675+0000 7f942353e640 1 -- 172.21.15.132:0/1945976876 shutdown_connections 2023-12-20T04:42:56.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.675+0000 7f942353e640 1 -- 172.21.15.132:0/1945976876 wait complete. 2023-12-20T04:42:56.685 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2023-12-20T04:42:56.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.676+0000 7f3567a70640 1 -- 172.21.15.132:0/4100990724 shutdown_connections 2023-12-20T04:42:56.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.676+0000 7f3567a70640 1 -- 172.21.15.132:0/4100990724 wait complete. 2023-12-20T04:42:56.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.677+0000 7f69ec609640 1 -- 172.21.15.132:0/3107716149 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f69c806a430 msgr2=0x7f69c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.677+0000 7f69ec609640 1 --2- 172.21.15.132:0/3107716149 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f69c806a430 0x7f69c806c8f0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f69e0001110 tx=0x7f69e0009040 comp rx=0 tx=0).stop 2023-12-20T04:42:56.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.677+0000 7f69ec609640 1 -- 172.21.15.132:0/3107716149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69e40c3380 msgr2=0x7f69e415d3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.677+0000 7f69ec609640 1 --2- 172.21.15.132:0/3107716149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69e40c3380 0x7f69e415d3b0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f69e40cfc00 tx=0x7f69dc004a40 comp rx=0 tx=0).stop 2023-12-20T04:42:56.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.677+0000 7f69ec609640 1 -- 172.21.15.132:0/3107716149 shutdown_connections 2023-12-20T04:42:56.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.677+0000 7f69ec609640 1 --2- 172.21.15.132:0/3107716149 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f69c806a430 0x7f69c806c8f0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.677+0000 7f69ec609640 1 --2- 172.21.15.132:0/3107716149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f69e40c3380 0x7f69e415d3b0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.677+0000 7f69ec609640 1 --2- 172.21.15.132:0/3107716149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f69e40c2fa0 0x7f69e415ce70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.677+0000 7f69ec609640 1 --2- 172.21.15.132:0/3107716149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f69e406cff0 0x7f69e40c5b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.677+0000 7f69ec609640 1 -- 172.21.15.132:0/3107716149 >> 172.21.15.132:0/3107716149 conn(0x7f69e40cfca0 msgr2=0x7f69e40af800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.678+0000 7f69ec609640 1 -- 172.21.15.132:0/3107716149 shutdown_connections 2023-12-20T04:42:56.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.681+0000 7f69ec609640 1 -- 172.21.15.132:0/3107716149 wait complete. 2023-12-20T04:42:56.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.681+0000 7f67b56d5640 1 -- 172.21.15.132:0/1521984437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7f67b006e190 con 0x7f67b006bd00 2023-12-20T04:42:56.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.682+0000 7f67acff9640 1 -- 172.21.15.132:0/1521984437 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f67a407a620 con 0x7f67b006bd00 2023-12-20T04:42:56.688 INFO:teuthology.orchestra.run.smithi132.stdout:55834574852 2023-12-20T04:42:56.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.686+0000 7f67b56d5640 1 -- 172.21.15.132:0/1521984437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f679c06a4b0 msgr2=0x7f679c06c970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.686+0000 7f67b56d5640 1 --2- 172.21.15.132:0/1521984437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f679c06a4b0 0x7f679c06c970 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f67a0006fd0 tx=0x7f67a0008040 comp rx=0 tx=0).stop 2023-12-20T04:42:56.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.686+0000 7f67b56d5640 1 -- 172.21.15.132:0/1521984437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b006bd00 msgr2=0x7f67b0158c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:56.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.686+0000 7f67b56d5640 1 --2- 172.21.15.132:0/1521984437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b006bd00 0x7f67b0158c30 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f67a4037040 tx=0x7f67a40046c0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.687+0000 7f67b56d5640 1 -- 172.21.15.132:0/1521984437 shutdown_connections 2023-12-20T04:42:56.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.687+0000 7f67b56d5640 1 --2- 172.21.15.132:0/1521984437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f679c06a4b0 0x7f679c06c970 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.687+0000 7f67b56d5640 1 --2- 172.21.15.132:0/1521984437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67b00c6d40 0x7f67b00c9330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.687+0000 7f67b56d5640 1 --2- 172.21.15.132:0/1521984437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67b006c0e0 0x7f67b00c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.687+0000 7f67b56d5640 1 --2- 172.21.15.132:0/1521984437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67b006bd00 0x7f67b0158c30 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:56.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.687+0000 7f67b56d5640 1 -- 172.21.15.132:0/1521984437 >> 172.21.15.132:0/1521984437 conn(0x7f67b0072c60 msgr2=0x7f67b015cb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:56.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.687+0000 7f67b56d5640 1 -- 172.21.15.132:0/1521984437 shutdown_connections 2023-12-20T04:42:56.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:56.687+0000 7f67b56d5640 1 -- 172.21.15.132:0/1521984437 wait complete. 2023-12-20T04:42:56.691 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2023-12-20T04:42:56.693 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2023-12-20T04:42:56.696 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.7 2023-12-20T04:42:56.698 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.3 2023-12-20T04:42:56.699 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2023-12-20T04:42:56.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.6 2023-12-20T04:42:56.703 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2023-12-20T04:42:57.686 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2023-12-20T04:42:57.692 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2023-12-20T04:42:57.694 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2023-12-20T04:42:57.697 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2023-12-20T04:42:57.699 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2023-12-20T04:42:57.700 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2023-12-20T04:42:57.701 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2023-12-20T04:42:57.703 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2023-12-20T04:42:57.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.853+0000 7f4eb66fa640 1 Processor -- start 2023-12-20T04:42:57.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.853+0000 7f4eb66fa640 1 -- start start 2023-12-20T04:42:57.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.854+0000 7f4eb66fa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4ea8050af0 0x7f4ea8054e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.854+0000 7f4eb66fa640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4ea8050ed0 0x7f4ea8053c50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.854+0000 7f4eb66fa640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ea8007d30 con 0x7f4ea8054190 2023-12-20T04:42:57.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.854+0000 7f4eb66fa640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea8038ee0 con 0x7f4ea8050af0 2023-12-20T04:42:57.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.854+0000 7f4eb66fa640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ea803bb60 con 0x7f4ea8050ed0 2023-12-20T04:42:57.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.855+0000 7f4eb4ef7640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4ea8050ed0 0x7f4ea8053c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.855+0000 7f4eb5ef9640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f4ea8054190 0x7f4ea80084a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:41572/0 (socket says 172.21.15.132:41572) 2023-12-20T04:42:57.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.855+0000 7f4eb5ef9640 1 -- 172.21.15.132:0/742418859 learned_addr learned my addr 172.21.15.132:0/742418859 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:57.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.855+0000 7f4eb56f8640 1 --2- 172.21.15.132:0/742418859 >> v2:172.21.15.132:3300/0 conn(0x7f4ea8050af0 0x7f4ea8054e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.855+0000 7f4eb4ef7640 1 -- 172.21.15.132:0/742418859 >> v2:172.21.15.132:3300/0 conn(0x7f4ea8050af0 msgr2=0x7f4ea8054e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:57.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.855+0000 7f4eb4ef7640 1 --2- 172.21.15.132:0/742418859 >> v2:172.21.15.132:3300/0 conn(0x7f4ea8050af0 0x7f4ea8054e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.855+0000 7f4eb4ef7640 1 -- 172.21.15.132:0/742418859 >> v1:172.21.15.187:6789/0 conn(0x7f4ea8054190 legacy=0x7f4ea80084a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.856+0000 7f4eb4ef7640 1 -- 172.21.15.132:0/742418859 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea80e45b0 con 0x7f4ea8050ed0 2023-12-20T04:42:57.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.857+0000 7f4eb56f8640 1 --2- 172.21.15.132:0/742418859 >> v2:172.21.15.132:3300/0 conn(0x7f4ea8050af0 0x7f4ea8054e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:57.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.857+0000 7f4eb4ef7640 1 --2- 172.21.15.132:0/742418859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ea8050ed0 0x7f4ea8053c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009900 tx=0x7f4eac02b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=695d98945a238b1a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.858+0000 7f4ea7fff640 1 -- 172.21.15.132:0/742418859 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eac030710 con 0x7f4ea8050ed0 2023-12-20T04:42:57.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.858+0000 7f4ea7fff640 1 -- 172.21.15.132:0/742418859 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eac02e050 con 0x7f4ea8050ed0 2023-12-20T04:42:57.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.859+0000 7f4eb66fa640 1 -- 172.21.15.132:0/742418859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ea8050ed0 msgr2=0x7f4ea8053c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.859+0000 7f4eb66fa640 1 --2- 172.21.15.132:0/742418859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ea8050ed0 0x7f4ea8053c50 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f4ea8009900 tx=0x7f4eac02b710 comp rx=0 tx=0).stop 2023-12-20T04:42:57.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.860+0000 7f4eb66fa640 1 -- 172.21.15.132:0/742418859 shutdown_connections 2023-12-20T04:42:57.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.860+0000 7f4eb66fa640 1 --2- 172.21.15.132:0/742418859 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ea8050ed0 0x7f4ea8053c50 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.860+0000 7f4eb66fa640 1 --2- 172.21.15.132:0/742418859 >> v2:172.21.15.132:3300/0 conn(0x7f4ea8050af0 0x7f4ea8054e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.860+0000 7f4eb66fa640 1 -- 172.21.15.132:0/742418859 >> 172.21.15.132:0/742418859 conn(0x7f4ea8055d20 msgr2=0x7f4ea8056130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:57.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.860+0000 7f4eb66fa640 1 -- 172.21.15.132:0/742418859 shutdown_connections 2023-12-20T04:42:57.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.860+0000 7f4eb66fa640 1 -- 172.21.15.132:0/742418859 wait complete. 2023-12-20T04:42:57.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.862+0000 7f4eb66fa640 1 Processor -- start 2023-12-20T04:42:57.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.862+0000 7f4eb66fa640 1 -- start start 2023-12-20T04:42:57.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.863+0000 7f4eb66fa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ea8050af0 0x7f4ea804cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.864+0000 7f4eb66fa640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ea8050ed0 0x7f4ea804ace0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.864+0000 7f4eb56f8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ea8050af0 0x7f4ea804cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.864+0000 7f4eb56f8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ea8050af0 0x7f4ea804cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:55482/0 (socket says 172.21.15.132:55482) 2023-12-20T04:42:57.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.864+0000 7f4eb4ef7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ea8050ed0 0x7f4ea804ace0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.864+0000 7f4eb4ef7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ea8050ed0 0x7f4ea804ace0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:37150/0 (socket says 172.21.15.132:37150) 2023-12-20T04:42:57.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.864+0000 7f4eb66fa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ea8054190 0x7f4ea80d5e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.864+0000 7f4eb5ef9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ea8054190 0x7f4ea80d5e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.864+0000 7f4eb5ef9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ea8054190 0x7f4ea80d5e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59944/0 (socket says 172.21.15.132:59944) 2023-12-20T04:42:57.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.865+0000 7f4eb4ef7640 1 -- 172.21.15.132:0/3537234781 learned_addr learned my addr 172.21.15.132:0/3537234781 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:57.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.865+0000 7f4eb66fa640 1 -- 172.21.15.132:0/3537234781 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80d4d90 con 0x7f4ea8054190 2023-12-20T04:42:57.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.865+0000 7f4eb66fa640 1 -- 172.21.15.132:0/3537234781 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80d5070 con 0x7f4ea8050ed0 2023-12-20T04:42:57.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.865+0000 7f4eb66fa640 1 -- 172.21.15.132:0/3537234781 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ea80d5350 con 0x7f4ea8050af0 2023-12-20T04:42:57.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.865+0000 7f4eb5ef9640 1 -- 172.21.15.132:0/3537234781 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ea8050af0 msgr2=0x7f4ea804cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.865+0000 7f4eb5ef9640 1 --2- 172.21.15.132:0/3537234781 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ea8050af0 0x7f4ea804cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.865+0000 7f4eb5ef9640 1 -- 172.21.15.132:0/3537234781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ea8050ed0 msgr2=0x7f4ea804ace0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.865+0000 7f4eb5ef9640 1 --2- 172.21.15.132:0/3537234781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ea8050ed0 0x7f4ea804ace0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.865+0000 7f4eb5ef9640 1 -- 172.21.15.132:0/3537234781 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4eac009400 con 0x7f4ea8054190 2023-12-20T04:42:57.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.866+0000 7f4eb5ef9640 1 --2- 172.21.15.132:0/3537234781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ea8054190 0x7f4ea80d5e30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0063840 tx=0x7f4eb0074040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.867+0000 7f4ea5ffb640 1 -- 172.21.15.132:0/3537234781 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb008e030 con 0x7f4ea8054190 2023-12-20T04:42:57.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.867+0000 7f4eb66fa640 1 -- 172.21.15.132:0/3537234781 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ea80d5630 con 0x7f4ea8054190 2023-12-20T04:42:57.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.867+0000 7f4eb66fa640 1 -- 172.21.15.132:0/3537234781 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ea804d330 con 0x7f4ea8054190 2023-12-20T04:42:57.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.870+0000 7f4ea5ffb640 1 -- 172.21.15.132:0/3537234781 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4eb00935d0 con 0x7f4ea8054190 2023-12-20T04:42:57.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.870+0000 7f4ea5ffb640 1 -- 172.21.15.132:0/3537234781 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4eb0072320 con 0x7f4ea8054190 2023-12-20T04:42:57.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.870+0000 7f4ea5ffb640 1 -- 172.21.15.132:0/3537234781 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4eb0091030 con 0x7f4ea8054190 2023-12-20T04:42:57.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.871+0000 7f4ea5ffb640 1 --2- 172.21.15.132:0/3537234781 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e9406a580 0x7f4e9406ca40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.871+0000 7f4ea5ffb640 1 -- 172.21.15.132:0/3537234781 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4eb008f070 con 0x7f4ea8054190 2023-12-20T04:42:57.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.871+0000 7f4eb56f8640 1 --2- 172.21.15.132:0/3537234781 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e9406a580 0x7f4e9406ca40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.872+0000 7f4eb56f8640 1 --2- 172.21.15.132:0/3537234781 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e9406a580 0x7f4e9406ca40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0003610 tx=0x7f4ea0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.875+0000 7f4eb66fa640 1 -- 172.21.15.132:0/3537234781 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e90005250 con 0x7f4ea8054190 2023-12-20T04:42:57.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.884+0000 7f4ea5ffb640 1 -- 172.21.15.132:0/3537234781 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4eb0099080 con 0x7f4ea8054190 2023-12-20T04:42:57.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.904+0000 7fdbccd99640 1 Processor -- start 2023-12-20T04:42:57.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.904+0000 7fdbccd99640 1 -- start start 2023-12-20T04:42:57.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.904+0000 7f6fc6aec640 1 Processor -- start 2023-12-20T04:42:57.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.905+0000 7f6fc6aec640 1 -- start start 2023-12-20T04:42:57.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.905+0000 7fc256e7e640 1 Processor -- start 2023-12-20T04:42:57.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.906+0000 7fdbccd99640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdbc80d02c0 0x7fdbc80b20f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.906+0000 7fdbccd99640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdbc80d21a0 0x7fdbc80b5ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.906+0000 7fdbccd99640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdbc80b1ef0 con 0x7fdbc80b47a0 2023-12-20T04:42:57.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.906+0000 7fdbccd99640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc80b86b0 con 0x7fdbc80d02c0 2023-12-20T04:42:57.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.906+0000 7fdbccd99640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdbc80b8970 con 0x7fdbc80d21a0 2023-12-20T04:42:57.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.906+0000 7fc256e7e640 1 -- start start 2023-12-20T04:42:57.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.906+0000 7f0fd0d15640 1 Processor -- start 2023-12-20T04:42:57.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.906+0000 7f6fc6aec640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6fc0153550 0x7f6fc00b0550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.906+0000 7f6fc6aec640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fc00b0a90 0x7f6fc00cc590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.906+0000 7f6fc4888640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6fc0153550 0x7f6fc00b0550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.906+0000 7f6fc4888640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6fc0153550 0x7f6fc00b0550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:37176/0 (socket says 172.21.15.132:37176) 2023-12-20T04:42:57.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7f6fc4888640 1 -- 172.21.15.132:0/2958171325 learned_addr learned my addr 172.21.15.132:0/2958171325 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:57.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7f6fc6aec640 1 --2- 172.21.15.132:0/2958171325 >> v2:172.21.15.132:3300/0 conn(0x7f6fc00ccad0 0x7f6fc006b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7f6fc6aec640 1 -- 172.21.15.132:0/2958171325 --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc015a240 con 0x7f6fc00ccad0 2023-12-20T04:42:57.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7f6fc6aec640 1 -- 172.21.15.132:0/2958171325 --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fc00b0f10 con 0x7f6fc0153550 2023-12-20T04:42:57.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7f6fc5089640 1 --2- 172.21.15.132:0/2958171325 >> v2:172.21.15.132:3300/0 conn(0x7f6fc00ccad0 0x7f6fc006b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.906+0000 7fdbc6d9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdbc80d21a0 0x7fdbc80b5ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.906+0000 7fdbc6d9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdbc80d21a0 0x7fdbc80b5ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:37160/0 (socket says 172.21.15.132:37160) 2023-12-20T04:42:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.906+0000 7fdbc6d9d640 1 -- 172.21.15.132:0/809261395 learned_addr learned my addr 172.21.15.132:0/809261395 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.906+0000 7fdbc5d9b640 1 --2- 172.21.15.132:0/809261395 >> v2:172.21.15.132:3300/0 conn(0x7fdbc80d02c0 0x7fdbc80b20f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7fdbc6d9d640 1 -- 172.21.15.132:0/809261395 >> v2:172.21.15.132:3300/0 conn(0x7fdbc80d02c0 msgr2=0x7fdbc80b20f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7fdbc6d9d640 1 --2- 172.21.15.132:0/809261395 >> v2:172.21.15.132:3300/0 conn(0x7fdbc80d02c0 0x7fdbc80b20f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7fdbc6d9d640 1 -- 172.21.15.132:0/809261395 >> v1:172.21.15.187:6789/0 conn(0x7fdbc80b47a0 legacy=0x7fdbc80b4b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7fdbc6d9d640 1 -- 172.21.15.132:0/809261395 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc80d19a0 con 0x7fdbc80d21a0 2023-12-20T04:42:57.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7f6fc6aec640 1 -- 172.21.15.132:0/2958171325 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc0153930 con 0x7f6fc00b0a90 2023-12-20T04:42:57.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7f6fbffff640 1 --2- 172.21.15.132:0/2958171325 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fc00b0a90 0x7f6fc00cc590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7fc256e7e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc25015b030 0x7fc2500cc790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7fc256e7e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2500cccd0 0x7fc2500cfc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.906+0000 7f0fd0d15640 1 -- start start 2023-12-20T04:42:57.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7fc256e7e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2500b35f0 con 0x7fc25015ac50 2023-12-20T04:42:57.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7fc256e7e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2500d0ff0 con 0x7fc25015b030 2023-12-20T04:42:57.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7fc256e7e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2500d12d0 con 0x7fc2500cccd0 2023-12-20T04:42:57.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7fc25567b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc25015b030 0x7fc2500cc790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7f342f59e640 1 Processor -- start 2023-12-20T04:42:57.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7f342f59e640 1 -- start start 2023-12-20T04:42:57.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7fc25567b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc25015b030 0x7fc2500cc790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:37184/0 (socket says 172.21.15.132:37184) 2023-12-20T04:42:57.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7fc255e7c640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fc25015ac50 0x7fc2500b64d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:41588/0 (socket says 172.21.15.132:41588) 2023-12-20T04:42:57.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.907+0000 7fc25567b640 1 -- 172.21.15.132:0/1204052686 learned_addr learned my addr 172.21.15.132:0/1204052686 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:57.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7fdbc5d9b640 1 --2- 172.21.15.132:0/809261395 >> v2:172.21.15.132:3300/0 conn(0x7fdbc80d02c0 0x7fdbc80b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:57.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7fc25667d640 1 --2- 172.21.15.132:0/1204052686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2500cccd0 0x7fc2500cfc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7fc254e7a640 1 -- 172.21.15.132:0/1204052686 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1742227935 0 0) 0x7fc2500b35f0 con 0x7fc25015ac50 2023-12-20T04:42:57.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7fc254e7a640 1 -- 172.21.15.132:0/1204052686 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc23c003520 con 0x7fc25015ac50 2023-12-20T04:42:57.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7fdbc6d9d640 1 --2- 172.21.15.132:0/809261395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbc80d21a0 0x7fdbc80b5ec0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8073c20 tx=0x7fdbc0034710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f23f544eee769675 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7f0fd0d15640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0fcc06e1a0 0x7f0fcc159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7f0fd0d15640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0fcc0c9840 0x7f0fcc072c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7f0fd0d15640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fcc0cde20 con 0x7f0fcc0c9ca0 2023-12-20T04:42:57.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7f0fd0d15640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fcc0ca140 con 0x7f0fcc0c9840 2023-12-20T04:42:57.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7f0fd0d15640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fcc0ca420 con 0x7f0fcc06e1a0 2023-12-20T04:42:57.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7f0fcb7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0fcc06e1a0 0x7f0fcc159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7f0fcb7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0fcc06e1a0 0x7f0fcc159470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:37192/0 (socket says 172.21.15.132:37192) 2023-12-20T04:42:57.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7f0fcb7fe640 1 -- 172.21.15.132:0/4209744274 learned_addr learned my addr 172.21.15.132:0/4209744274 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:57.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7fdbc559a640 1 -- 172.21.15.132:0/809261395 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbc003b600 con 0x7fdbc80d21a0 2023-12-20T04:42:57.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7fdbc559a640 1 -- 172.21.15.132:0/809261395 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbc0037050 con 0x7fdbc80d21a0 2023-12-20T04:42:57.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7f342f59e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f342800c2b0 0x7f34280df130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7f342f59e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f34280e3350 0x7f3428053900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7f342f59e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3428006520 con 0x7f34280072e0 2023-12-20T04:42:57.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7f342f59e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3428006800 con 0x7f34280e3350 2023-12-20T04:42:57.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7f342f59e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3428006ae0 con 0x7f342800c2b0 2023-12-20T04:42:57.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7f6fc4888640 1 -- 172.21.15.132:0/2958171325 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fc00b0a90 msgr2=0x7f6fc00cc590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:57.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7f6fc4888640 1 --2- 172.21.15.132:0/2958171325 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fc00b0a90 0x7f6fc00cc590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7f6fc4888640 1 -- 172.21.15.132:0/2958171325 >> v2:172.21.15.132:3300/0 conn(0x7f6fc00ccad0 msgr2=0x7f6fc006b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:57.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7f6fc4888640 1 --2- 172.21.15.132:0/2958171325 >> v2:172.21.15.132:3300/0 conn(0x7f6fc00ccad0 0x7f6fc006b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7f6fc4888640 1 -- 172.21.15.132:0/2958171325 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fc01595c0 con 0x7f6fc0153550 2023-12-20T04:42:57.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7f6fc5089640 1 --2- 172.21.15.132:0/2958171325 >> v2:172.21.15.132:3300/0 conn(0x7f6fc00ccad0 0x7f6fc006b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:57.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7f342e59c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f342800c2b0 0x7f34280df130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7f342e59c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f342800c2b0 0x7f34280df130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:55502/0 (socket says 172.21.15.132:55502) 2023-12-20T04:42:57.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7f342e59c640 1 -- 172.21.15.132:0/4156471029 learned_addr learned my addr 172.21.15.132:0/4156471029 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:57.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7f3434adf640 1 --2- 172.21.15.132:0/4156471029 >> v2:172.21.15.187:3300/0 conn(0x7f34280e3350 0x7f3428053900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7f0fcaffd640 1 --2- 172.21.15.132:0/4209744274 >> v2:172.21.15.132:3300/0 conn(0x7f0fcc0c9840 0x7f0fcc072c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7f0fcaffd640 1 -- 172.21.15.132:0/4209744274 >> v2:172.21.15.187:3300/0 conn(0x7f0fcc06e1a0 msgr2=0x7f0fcc159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:57.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7f0fcaffd640 1 --2- 172.21.15.132:0/4209744274 >> v2:172.21.15.187:3300/0 conn(0x7f0fcc06e1a0 0x7f0fcc159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7f0fcaffd640 1 -- 172.21.15.132:0/4209744274 >> v1:172.21.15.132:6789/0 conn(0x7f0fcc0c9ca0 legacy=0x7f0fcc06fbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:57.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7f0fcaffd640 1 -- 172.21.15.132:0/4209744274 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fcc0cd7d0 con 0x7f0fcc0c9840 2023-12-20T04:42:57.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7fe08aaab640 1 Processor -- start 2023-12-20T04:42:57.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7fe08aaab640 1 -- start start 2023-12-20T04:42:57.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7fdbccd99640 1 -- 172.21.15.132:0/809261395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbc80d21a0 msgr2=0x7fdbc80b5ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.909+0000 7fdbccd99640 1 --2- 172.21.15.132:0/809261395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbc80d21a0 0x7fdbc80b5ec0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8073c20 tx=0x7fdbc0034710 comp rx=0 tx=0).stop 2023-12-20T04:42:57.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7fc25567b640 1 -- 172.21.15.132:0/1204052686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2500cccd0 msgr2=0x7fc2500cfc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:57.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7fc25567b640 1 --2- 172.21.15.132:0/1204052686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2500cccd0 0x7fc2500cfc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7fc25567b640 1 -- 172.21.15.132:0/1204052686 >> v1:172.21.15.187:6789/0 conn(0x7fc25015ac50 legacy=0x7fc2500b64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.908+0000 7fc25567b640 1 -- 172.21.15.132:0/1204052686 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2500d15b0 con 0x7fc25015b030 2023-12-20T04:42:57.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7fdbccd99640 1 -- 172.21.15.132:0/809261395 shutdown_connections 2023-12-20T04:42:57.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7fdbccd99640 1 --2- 172.21.15.132:0/809261395 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbc80d21a0 0x7fdbc80b5ec0 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7fdbccd99640 1 --2- 172.21.15.132:0/809261395 >> v2:172.21.15.132:3300/0 conn(0x7fdbc80d02c0 0x7fdbc80b20f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7fdbccd99640 1 -- 172.21.15.132:0/809261395 >> 172.21.15.132:0/809261395 conn(0x7fdbc80cf7a0 msgr2=0x7fdbc80cfbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:57.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7f342e59c640 1 -- 172.21.15.132:0/4156471029 >> v2:172.21.15.187:3300/0 conn(0x7f34280e3350 msgr2=0x7f3428053900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:57.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7f342e59c640 1 --2- 172.21.15.132:0/4156471029 >> v2:172.21.15.187:3300/0 conn(0x7f34280e3350 0x7f3428053900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7f342e59c640 1 -- 172.21.15.132:0/4156471029 >> v1:172.21.15.132:6789/0 conn(0x7f34280072e0 legacy=0x7f34280e2c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7f342e59c640 1 -- 172.21.15.132:0/4156471029 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3428006dc0 con 0x7f342800c2b0 2023-12-20T04:42:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7fc25567b640 1 --2- 172.21.15.132:0/1204052686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc25015b030 0x7fc2500cc790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc248009e50 tx=0x7fc24802bdf0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da6287bc0bf3e0d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7fc254e7a640 1 -- 172.21.15.132:0/1204052686 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24c001670 con 0x7fc25015b030 2023-12-20T04:42:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7fc254e7a640 1 -- 172.21.15.132:0/1204052686 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc24802c710 con 0x7fc25015b030 2023-12-20T04:42:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7fc254e7a640 1 -- 172.21.15.132:0/1204052686 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc24802caa0 con 0x7fc25015b030 2023-12-20T04:42:57.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7f6fc4888640 1 --2- 172.21.15.132:0/2958171325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fc0153550 0x7f6fc00b0550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6fc006abc0 tx=0x7f6fb802ca50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3a9034273860094a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7f6fbf7fe640 1 -- 172.21.15.132:0/2958171325 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8008df0 con 0x7f6fc0153550 2023-12-20T04:42:57.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7f6fbf7fe640 1 -- 172.21.15.132:0/2958171325 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb800a0d0 con 0x7f6fc0153550 2023-12-20T04:42:57.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7f6fbf7fe640 1 -- 172.21.15.132:0/2958171325 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8008df0 con 0x7f6fc0153550 2023-12-20T04:42:57.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7faf9ee04640 1 Processor -- start 2023-12-20T04:42:57.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7fdbccd99640 1 -- 172.21.15.132:0/809261395 shutdown_connections 2023-12-20T04:42:57.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7fdbccd99640 1 -- 172.21.15.132:0/809261395 wait complete. 2023-12-20T04:42:57.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7f0fcaffd640 1 --2- 172.21.15.132:0/4209744274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fcc0c9840 0x7f0fcc072c60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0cbc40 tx=0x7f0fc402be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ce1bc4ddcb92ed server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.910+0000 7faf9ee04640 1 -- start start 2023-12-20T04:42:57.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7f342e59c640 1 --2- 172.21.15.132:0/4156471029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f342800c2b0 0x7f34280df130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3424009870 tx=0x7f342402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3babb0739aed1e0a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7fe08aaab640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe07c0e10f0 0x7fe07c0e14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7fe08aaab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe07c0e5630 0x7fe07c034d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7fe08aaab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe07c035b00 con 0x7fe07c0e5b00 2023-12-20T04:42:57.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7fe08aaab640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe07c0352c0 con 0x7fe07c0e10f0 2023-12-20T04:42:57.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7fe08aaab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c035de0 con 0x7fe07c0e5630 2023-12-20T04:42:57.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7fe083fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe07c0e5b00 0x7fe07c0e4f20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60528/0 (socket says 172.21.15.132:60528) 2023-12-20T04:42:57.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7fe083fff640 1 -- 172.21.15.132:0/3508744212 learned_addr learned my addr 172.21.15.132:0/3508744212 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:57.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7faf9ee04640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faf98161320 0x7faf980c53f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7faf9ee04640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faf980adb40 0x7faf980cc6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7faf9ee04640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf980ce090 con 0x7faf980b0550 2023-12-20T04:42:57.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7faf9ee04640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf980c4240 con 0x7faf98161320 2023-12-20T04:42:57.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7faf9ee04640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf98161700 con 0x7faf980adb40 2023-12-20T04:42:57.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7fe088847640 1 --2- 172.21.15.132:0/3508744212 >> v2:172.21.15.187:3300/0 conn(0x7fe07c0e10f0 0x7fe07c0e14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7fc256e7e640 1 -- 172.21.15.132:0/1204052686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc25015b030 msgr2=0x7fc2500cc790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7faf9d3a1640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7faf980b0550 0x7faf9806b2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:41592/0 (socket says 172.21.15.132:41592) 2023-12-20T04:42:57.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7faf9d3a1640 1 -- 172.21.15.132:0/2235145743 learned_addr learned my addr 172.21.15.132:0/2235145743 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:42:57.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7f342d59a640 1 -- 172.21.15.132:0/4156471029 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424030610 con 0x7f342800c2b0 2023-12-20T04:42:57.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7f342d59a640 1 -- 172.21.15.132:0/4156471029 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3424030770 con 0x7f342800c2b0 2023-12-20T04:42:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7fe089048640 1 --2- 172.21.15.132:0/3508744212 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe07c0e5630 0x7fe07c034d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7f6fc6aec640 1 -- 172.21.15.132:0/2958171325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fc0153550 msgr2=0x7f6fc00b0550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7f6fc6aec640 1 --2- 172.21.15.132:0/2958171325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fc0153550 0x7f6fc00b0550 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f6fc006abc0 tx=0x7f6fb802ca50 comp rx=0 tx=0).stop 2023-12-20T04:42:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7fc256e7e640 1 --2- 172.21.15.132:0/1204052686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc25015b030 0x7fc2500cc790 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fc248009e50 tx=0x7fc24802bdf0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7faf9cba0640 1 --2- 172.21.15.132:0/2235145743 >> v2:172.21.15.132:3300/0 conn(0x7faf98161320 0x7faf980c53f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7f6fc6aec640 1 -- 172.21.15.132:0/2958171325 shutdown_connections 2023-12-20T04:42:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7f6fc6aec640 1 --2- 172.21.15.132:0/2958171325 >> v2:172.21.15.132:3300/0 conn(0x7f6fc00ccad0 0x7f6fc006b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7f6fc6aec640 1 --2- 172.21.15.132:0/2958171325 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fc00b0a90 0x7f6fc00cc590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7f6fc6aec640 1 --2- 172.21.15.132:0/2958171325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fc0153550 0x7f6fc00b0550 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7fe089048640 1 -- 172.21.15.132:0/3508744212 >> v2:172.21.15.187:3300/0 conn(0x7fe07c0e10f0 msgr2=0x7fe07c0e14d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7fe089048640 1 --2- 172.21.15.132:0/3508744212 >> v2:172.21.15.187:3300/0 conn(0x7fe07c0e10f0 0x7fe07c0e14d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7f6fc6aec640 1 -- 172.21.15.132:0/2958171325 >> 172.21.15.132:0/2958171325 conn(0x7f6fc0069c30 msgr2=0x7f6fc006a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.911+0000 7faf97fff640 1 --2- 172.21.15.132:0/2235145743 >> v2:172.21.15.187:3300/0 conn(0x7faf980adb40 0x7faf980cc6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7faf977fe640 1 -- 172.21.15.132:0/2235145743 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1384129089 0 0) 0x7faf980ce090 con 0x7faf980b0550 2023-12-20T04:42:57.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7faf977fe640 1 -- 172.21.15.132:0/2235145743 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faf80003520 con 0x7faf980b0550 2023-12-20T04:42:57.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7f0fca7fc640 1 -- 172.21.15.132:0/4209744274 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc402cbe0 con 0x7f0fcc0c9840 2023-12-20T04:42:57.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7f0fca7fc640 1 -- 172.21.15.132:0/4209744274 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc402cd40 con 0x7f0fcc0c9840 2023-12-20T04:42:57.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7f0fca7fc640 1 -- 172.21.15.132:0/4209744274 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc4034660 con 0x7f0fcc0c9840 2023-12-20T04:42:57.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7f342d59a640 1 -- 172.21.15.132:0/4156471029 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3424030b00 con 0x7f342800c2b0 2023-12-20T04:42:57.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7fc256e7e640 1 -- 172.21.15.132:0/1204052686 shutdown_connections 2023-12-20T04:42:57.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7faf977fe640 1 -- 172.21.15.132:0/2235145743 <== mon.1 v1:172.21.15.187:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2242411398 0 0) 0x7faf80003520 con 0x7faf980b0550 2023-12-20T04:42:57.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7faf97fff640 1 -- 172.21.15.132:0/2235145743 >> v2:172.21.15.132:3300/0 conn(0x7faf98161320 msgr2=0x7faf980c53f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:57.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7faf97fff640 1 --2- 172.21.15.132:0/2235145743 >> v2:172.21.15.132:3300/0 conn(0x7faf98161320 0x7faf980c53f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7faf97fff640 1 -- 172.21.15.132:0/2235145743 >> v1:172.21.15.187:6789/0 conn(0x7faf980b0550 legacy=0x7faf9806b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7fc256e7e640 1 --2- 172.21.15.132:0/1204052686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2500cccd0 0x7fc2500cfc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7fdbccd99640 1 Processor -- start 2023-12-20T04:42:57.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7fc256e7e640 1 --2- 172.21.15.132:0/1204052686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc25015b030 0x7fc2500cc790 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7fc256e7e640 1 -- 172.21.15.132:0/1204052686 >> 172.21.15.132:0/1204052686 conn(0x7fc250072c60 msgr2=0x7fc250073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:57.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7fdbccd99640 1 -- start start 2023-12-20T04:42:57.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7fc256e7e640 1 -- 172.21.15.132:0/1204052686 shutdown_connections 2023-12-20T04:42:57.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7f342f59e640 1 -- 172.21.15.132:0/4156471029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f342800c2b0 msgr2=0x7f34280df130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7f342f59e640 1 --2- 172.21.15.132:0/4156471029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f342800c2b0 0x7f34280df130 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3424009870 tx=0x7f342402b960 comp rx=0 tx=0).stop 2023-12-20T04:42:57.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7fc256e7e640 1 -- 172.21.15.132:0/1204052686 wait complete. 2023-12-20T04:42:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7fe089048640 1 -- 172.21.15.132:0/3508744212 >> v1:172.21.15.132:6789/0 conn(0x7fe07c0e5b00 legacy=0x7fe07c0e4f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7fe089048640 1 -- 172.21.15.132:0/3508744212 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe07c0360c0 con 0x7fe07c0e5630 2023-12-20T04:42:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7fe0837fe640 1 -- 172.21.15.132:0/3508744212 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1667908546 0 0) 0x7fe07c035b00 con 0x7fe07c0e5b00 2023-12-20T04:42:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7f342f59e640 1 -- 172.21.15.132:0/4156471029 shutdown_connections 2023-12-20T04:42:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7f342f59e640 1 --2- 172.21.15.132:0/4156471029 >> v2:172.21.15.187:3300/0 conn(0x7f34280e3350 0x7f3428053900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7f342f59e640 1 --2- 172.21.15.132:0/4156471029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f342800c2b0 0x7f34280df130 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7f342f59e640 1 -- 172.21.15.132:0/4156471029 >> 172.21.15.132:0/4156471029 conn(0x7f3428054cd0 msgr2=0x7f34280550e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:57.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.912+0000 7faf97fff640 1 -- 172.21.15.132:0/2235145743 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf980ae2d0 con 0x7faf980adb40 2023-12-20T04:42:57.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7f342f59e640 1 -- 172.21.15.132:0/4156471029 shutdown_connections 2023-12-20T04:42:57.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7f6fc6aec640 1 -- 172.21.15.132:0/2958171325 shutdown_connections 2023-12-20T04:42:57.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7f0fd0d15640 1 -- 172.21.15.132:0/4209744274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fcc0c9840 msgr2=0x7f0fcc072c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7fe089048640 1 --2- 172.21.15.132:0/3508744212 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe07c0e5630 0x7fe07c034d80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe0780097a0 tx=0x7fe07802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1ef60c2d5b5b2f10 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7f0fd0d15640 1 --2- 172.21.15.132:0/4209744274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fcc0c9840 0x7f0fcc072c60 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0fcc0cbc40 tx=0x7f0fc402be30 comp rx=0 tx=0).stop 2023-12-20T04:42:57.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7f6fc6aec640 1 -- 172.21.15.132:0/2958171325 wait complete. 2023-12-20T04:42:57.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7f342f59e640 1 -- 172.21.15.132:0/4156471029 wait complete. 2023-12-20T04:42:57.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7fe0837fe640 1 -- 172.21.15.132:0/3508744212 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe078031830 con 0x7fe07c0e5630 2023-12-20T04:42:57.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7fe0837fe640 1 -- 172.21.15.132:0/3508744212 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe078031990 con 0x7fe07c0e5630 2023-12-20T04:42:57.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7faf97fff640 1 --2- 172.21.15.132:0/2235145743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf980adb40 0x7faf980cc6d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faf9806ee60 tx=0x7faf8802b790 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a9d35c8e3f92d1e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.914+0000 7fdbccd99640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbc80b47a0 0x7fdbc8159350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.914+0000 7fdbccd99640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbc80d02c0 0x7fdbc80ccf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.914+0000 7fc256e7e640 1 Processor -- start 2023-12-20T04:42:57.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.914+0000 7fdbc659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbc80b47a0 0x7fdbc8159350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.914+0000 7fc256e7e640 1 -- start start 2023-12-20T04:42:57.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.914+0000 7fdbc659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbc80b47a0 0x7fdbc8159350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59986/0 (socket says 172.21.15.132:59986) 2023-12-20T04:42:57.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.914+0000 7fdbc659c640 1 -- 172.21.15.132:0/662561310 learned_addr learned my addr 172.21.15.132:0/662561310 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:57.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.914+0000 7fdbccd99640 1 --2- 172.21.15.132:0/662561310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbc80d21a0 0x7fdbc81ee620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.914+0000 7fe0837fe640 1 -- 172.21.15.132:0/3508744212 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe078031d20 con 0x7fe07c0e5630 2023-12-20T04:42:57.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.914+0000 7fe08aaab640 1 -- 172.21.15.132:0/3508744212 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe07c0e5630 msgr2=0x7fe07c034d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.914+0000 7fe08aaab640 1 --2- 172.21.15.132:0/3508744212 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe07c0e5630 0x7fe07c034d80 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fe0780097a0 tx=0x7fe07802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.914+0000 7fdbc5d9b640 1 --2- 172.21.15.132:0/662561310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbc80d02c0 0x7fdbc80ccf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7f0fd0d15640 1 -- 172.21.15.132:0/4209744274 shutdown_connections 2023-12-20T04:42:57.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7f0fd0d15640 1 --2- 172.21.15.132:0/4209744274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fcc0c9840 0x7f0fcc072c60 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.914+0000 7fdbccd99640 1 -- 172.21.15.132:0/662561310 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc80ccb40 con 0x7fdbc80b47a0 2023-12-20T04:42:57.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7f0fd0d15640 1 --2- 172.21.15.132:0/4209744274 >> v2:172.21.15.187:3300/0 conn(0x7f0fcc06e1a0 0x7f0fcc159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7faf977fe640 1 -- 172.21.15.132:0/2235145743 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c001670 con 0x7faf980adb40 2023-12-20T04:42:57.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7faf977fe640 1 -- 172.21.15.132:0/2235145743 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8802e050 con 0x7faf980adb40 2023-12-20T04:42:57.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fdbc6d9d640 1 --2- 172.21.15.132:0/662561310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbc80d21a0 0x7fdbc81ee620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7faf977fe640 1 -- 172.21.15.132:0/2235145743 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf88030730 con 0x7faf980adb40 2023-12-20T04:42:57.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.914+0000 7faf9ee04640 1 -- 172.21.15.132:0/2235145743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf980adb40 msgr2=0x7faf980cc6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.914+0000 7faf9ee04640 1 --2- 172.21.15.132:0/2235145743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf980adb40 0x7faf980cc6d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faf9806ee60 tx=0x7faf8802b790 comp rx=0 tx=0).stop 2023-12-20T04:42:57.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7faf9ee04640 1 -- 172.21.15.132:0/2235145743 shutdown_connections 2023-12-20T04:42:57.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7faf9ee04640 1 --2- 172.21.15.132:0/2235145743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf980adb40 0x7faf980cc6d0 secure :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7faf9806ee60 tx=0x7faf8802b790 comp rx=0 tx=0).stop 2023-12-20T04:42:57.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7faf9ee04640 1 --2- 172.21.15.132:0/2235145743 >> v2:172.21.15.132:3300/0 conn(0x7faf98161320 0x7faf980c53f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fdbccd99640 1 -- 172.21.15.132:0/662561310 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc80cc1a0 con 0x7fdbc80d02c0 2023-12-20T04:42:57.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7faf9ee04640 1 -- 172.21.15.132:0/2235145743 >> 172.21.15.132:0/2235145743 conn(0x7faf980ce970 msgr2=0x7faf980ced80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:57.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fdbccd99640 1 -- 172.21.15.132:0/662561310 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdbc80cc480 con 0x7fdbc80d21a0 2023-12-20T04:42:57.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7f342f59e640 1 Processor -- start 2023-12-20T04:42:57.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.913+0000 7f0fd0d15640 1 -- 172.21.15.132:0/4209744274 >> 172.21.15.132:0/4209744274 conn(0x7f0fcc0cbc70 msgr2=0x7f0fcc0cc080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:57.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7f0fd0d15640 1 -- 172.21.15.132:0/4209744274 shutdown_connections 2023-12-20T04:42:57.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fe08aaab640 1 -- 172.21.15.132:0/3508744212 shutdown_connections 2023-12-20T04:42:57.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fe08aaab640 1 --2- 172.21.15.132:0/3508744212 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe07c0e5630 0x7fe07c034d80 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fe08aaab640 1 --2- 172.21.15.132:0/3508744212 >> v2:172.21.15.187:3300/0 conn(0x7fe07c0e10f0 0x7fe07c0e14d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fe08aaab640 1 -- 172.21.15.132:0/3508744212 >> 172.21.15.132:0/3508744212 conn(0x7fe07c03a460 msgr2=0x7fe07c0383d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:57.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fc256e7e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2500cccd0 0x7fc250148590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fc256e7e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc25015ac50 0x7fc250146a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fc256e7e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc25015b030 0x7fc250146050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fc256e7e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc250149ca0 con 0x7fc2500cccd0 2023-12-20T04:42:57.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fc256e7e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc250149810 con 0x7fc25015b030 2023-12-20T04:42:57.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7f6fc6aec640 1 Processor -- start 2023-12-20T04:42:57.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fc256e7e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc250148c00 con 0x7fc25015ac50 2023-12-20T04:42:57.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7f6fc6aec640 1 -- start start 2023-12-20T04:42:57.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fc255e7c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2500cccd0 0x7fc250148590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fc255e7c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2500cccd0 0x7fc250148590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60002/0 (socket says 172.21.15.132:60002) 2023-12-20T04:42:57.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fdbc659c640 1 -- 172.21.15.132:0/662561310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbc80d21a0 msgr2=0x7fdbc81ee620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fdbc659c640 1 --2- 172.21.15.132:0/662561310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbc80d21a0 0x7fdbc81ee620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fdbc659c640 1 -- 172.21.15.132:0/662561310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbc80d02c0 msgr2=0x7fdbc80ccf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fdbc659c640 1 --2- 172.21.15.132:0/662561310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbc80d02c0 0x7fdbc80ccf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fdbc659c640 1 -- 172.21.15.132:0/662561310 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdbc0009b30 con 0x7fdbc80b47a0 2023-12-20T04:42:57.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fc255e7c640 1 -- 172.21.15.132:0/1332772009 learned_addr learned my addr 172.21.15.132:0/1332772009 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:57.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fc25567b640 1 --2- 172.21.15.132:0/1332772009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc25015ac50 0x7fc250146a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fc25667d640 1 --2- 172.21.15.132:0/1332772009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc25015b030 0x7fc250146050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7fc25567b640 1 -- 172.21.15.132:0/1332772009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc25015b030 msgr2=0x7fc250146050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7fc25567b640 1 --2- 172.21.15.132:0/1332772009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc25015b030 0x7fc250146050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7fc25567b640 1 -- 172.21.15.132:0/1332772009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2500cccd0 msgr2=0x7fc250148590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7fdbc659c640 1 --2- 172.21.15.132:0/662561310 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbc80b47a0 0x7fdbc8159350 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00c400 tx=0x7fdbbc00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7fc25567b640 1 --2- 172.21.15.132:0/1332772009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2500cccd0 0x7fc250148590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7fc25567b640 1 -- 172.21.15.132:0/1332772009 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc248009b30 con 0x7fc25015ac50 2023-12-20T04:42:57.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7fe08aaab640 1 -- 172.21.15.132:0/3508744212 shutdown_connections 2023-12-20T04:42:57.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7f342f59e640 1 -- start start 2023-12-20T04:42:57.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7fe08aaab640 1 -- 172.21.15.132:0/3508744212 wait complete. 2023-12-20T04:42:57.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7f342f59e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34280072e0 0x7f342804aac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7f342f59e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f342800c2b0 0x7f342804b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7f342f59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34280e3350 0x7f34280e1710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7f342f59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342804c360 con 0x7f34280e3350 2023-12-20T04:42:57.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7f342f59e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f342804d820 con 0x7f342800c2b0 2023-12-20T04:42:57.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7f342f59e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f342804efb0 con 0x7f34280072e0 2023-12-20T04:42:57.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7fc255e7c640 1 --2- 172.21.15.132:0/1332772009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2500cccd0 0x7fc250148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:57.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7f342dd9b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f342800c2b0 0x7f342804b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7fdbb6ffd640 1 -- 172.21.15.132:0/662561310 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc0052d0 con 0x7fdbc80b47a0 2023-12-20T04:42:57.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7f342dd9b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f342800c2b0 0x7f342804b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:37246/0 (socket says 172.21.15.132:37246) 2023-12-20T04:42:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7fc25567b640 1 --2- 172.21.15.132:0/1332772009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc25015ac50 0x7fc250146a20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc248032000 tx=0x7fc248004a40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7f342dd9b640 1 -- 172.21.15.132:0/1659208245 learned_addr learned my addr 172.21.15.132:0/1659208245 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7f342dd9b640 1 -- 172.21.15.132:0/1659208245 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34280072e0 msgr2=0x7f342804aac0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-20T04:42:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7f342dd9b640 1 --2- 172.21.15.132:0/1659208245 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34280072e0 0x7f342804aac0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7f342dd9b640 1 -- 172.21.15.132:0/1659208245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34280e3350 msgr2=0x7f34280e1710 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2023-12-20T04:42:57.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.917+0000 7f3434adf640 1 --2- 172.21.15.132:0/1659208245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34280e3350 0x7f34280e1710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.917+0000 7f342dd9b640 1 --2- 172.21.15.132:0/1659208245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34280e3350 0x7f34280e1710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.917+0000 7f6fc6aec640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fc00b0a90 0x7f6fc00b1b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.917+0000 7f342dd9b640 1 -- 172.21.15.132:0/1659208245 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34240094d0 con 0x7f342800c2b0 2023-12-20T04:42:57.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.917+0000 7f6fc6aec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc00ccad0 0x7f6fc0153b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7fdbb6ffd640 1 -- 172.21.15.132:0/662561310 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdbbc005430 con 0x7fdbc80b47a0 2023-12-20T04:42:57.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7fdbccd99640 1 -- 172.21.15.132:0/662561310 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdbc80cc760 con 0x7fdbc80b47a0 2023-12-20T04:42:57.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.916+0000 7fdbccd99640 1 -- 172.21.15.132:0/662561310 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdbc80cbde0 con 0x7fdbc80b47a0 2023-12-20T04:42:57.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.917+0000 7f6fc4888640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fc00b0a90 0x7f6fc00b1b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.917+0000 7f6fc4888640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fc00b0a90 0x7f6fc00b1b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:55550/0 (socket says 172.21.15.132:55550) 2023-12-20T04:42:57.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.917+0000 7fdbb6ffd640 1 -- 172.21.15.132:0/662561310 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdbbc0052d0 con 0x7fdbc80b47a0 2023-12-20T04:42:57.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f6fbffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc00ccad0 0x7f6fc0153b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f6fc6aec640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fc0153550 0x7f6fc00afe20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.917+0000 7fc2467fc640 1 -- 172.21.15.132:0/1332772009 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248007930 con 0x7fc25015ac50 2023-12-20T04:42:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.917+0000 7fc2467fc640 1 -- 172.21.15.132:0/1332772009 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc248007a90 con 0x7fc25015ac50 2023-12-20T04:42:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.917+0000 7fc2467fc640 1 -- 172.21.15.132:0/1332772009 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc248007e20 con 0x7fc25015ac50 2023-12-20T04:42:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7fe08aaab640 1 Processor -- start 2023-12-20T04:42:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7fc256e7e640 1 -- 172.21.15.132:0/1332772009 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc250148ee0 con 0x7fc25015ac50 2023-12-20T04:42:57.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7fc256e7e640 1 -- 172.21.15.132:0/1332772009 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2501494a0 con 0x7fc25015ac50 2023-12-20T04:42:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f6fc6aec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc0154310 con 0x7f6fc00ccad0 2023-12-20T04:42:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f6fc6aec640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00b2b30 con 0x7f6fc0153550 2023-12-20T04:42:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f6fc6aec640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fc00ae530 con 0x7f6fc00b0a90 2023-12-20T04:42:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f6fbffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc00ccad0 0x7f6fc0153b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60012/0 (socket says 172.21.15.132:60012) 2023-12-20T04:42:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f6fbffff640 1 -- 172.21.15.132:0/3963172692 learned_addr learned my addr 172.21.15.132:0/3963172692 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7fe08aaab640 1 -- start start 2023-12-20T04:42:57.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f6fc5089640 1 --2- 172.21.15.132:0/3963172692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fc0153550 0x7f6fc00afe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7fdbccd99640 1 -- 172.21.15.132:0/662561310 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdbc80ccdb0 con 0x7fdbc80b47a0 2023-12-20T04:42:57.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.915+0000 7f0fd0d15640 1 -- 172.21.15.132:0/4209744274 wait complete. 2023-12-20T04:42:57.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.917+0000 7f0fd0d15640 1 Processor -- start 2023-12-20T04:42:57.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7faf9ee04640 1 -- 172.21.15.132:0/2235145743 shutdown_connections 2023-12-20T04:42:57.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.917+0000 7f3434adf640 1 --2- 172.21.15.132:0/1659208245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34280e3350 0x7f34280e1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:57.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.917+0000 7f342dd9b640 1 --2- 172.21.15.132:0/1659208245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f342800c2b0 0x7f342804b000 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f342000c400 tx=0x7f342000c8c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f6fc4888640 1 -- 172.21.15.132:0/3963172692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fc0153550 msgr2=0x7f6fc00afe20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f6fc4888640 1 --2- 172.21.15.132:0/3963172692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fc0153550 0x7f6fc00afe20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f6fc4888640 1 -- 172.21.15.132:0/3963172692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc00ccad0 msgr2=0x7f6fc0153b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f6fc4888640 1 --2- 172.21.15.132:0/3963172692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc00ccad0 0x7f6fc0153b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f6fc4888640 1 -- 172.21.15.132:0/3963172692 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fb8007040 con 0x7f6fc00b0a90 2023-12-20T04:42:57.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f6fc5089640 1 --2- 172.21.15.132:0/3963172692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fc0153550 0x7f6fc00afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:57.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.917+0000 7f0fd0d15640 1 -- start start 2023-12-20T04:42:57.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.919+0000 7f6fc4888640 1 --2- 172.21.15.132:0/3963172692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fc00b0a90 0x7f6fc00b1b70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8033000 tx=0x7f6fb80046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f0fd0d15640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fcc06e1a0 0x7f0fcc085170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f0fd0d15640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fcc0c9840 0x7f0fcc1e26a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f0fd0d15640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fcc0c9ca0 0x7f0fcc14b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f0fd0d15640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc14c410 con 0x7f0fcc0c9840 2023-12-20T04:42:57.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f0fd0d15640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc084ce0 con 0x7f0fcc0c9ca0 2023-12-20T04:42:57.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f0fd0d15640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fcc14be50 con 0x7f0fcc06e1a0 2023-12-20T04:42:57.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.919+0000 7f6fbd7fa640 1 -- 172.21.15.132:0/3963172692 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb803e070 con 0x7f6fc00b0a90 2023-12-20T04:42:57.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f0fcb7fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fcc06e1a0 0x7f0fcc085170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.919+0000 7f6fbd7fa640 1 -- 172.21.15.132:0/3963172692 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fb8007ae0 con 0x7f6fc00b0a90 2023-12-20T04:42:57.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f0fcb7fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fcc06e1a0 0x7f0fcc085170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:55564/0 (socket says 172.21.15.132:55564) 2023-12-20T04:42:57.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f0fcb7fe640 1 -- 172.21.15.132:0/3059694094 learned_addr learned my addr 172.21.15.132:0/3059694094 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:57.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f0fcaffd640 1 --2- 172.21.15.132:0/3059694094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fcc0c9840 0x7f0fcc1e26a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.919+0000 7fe08aaab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe07c0e10f0 0x7fe07c178510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.919+0000 7fe08aaab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe07c0e5630 0x7fe07c04b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.919+0000 7fe08aaab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe07c0e5b00 0x7fe07c00b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f0fcbfff640 1 --2- 172.21.15.132:0/3059694094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fcc0c9ca0 0x7f0fcc14b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.919+0000 7f0fcb7fe640 1 -- 172.21.15.132:0/3059694094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fcc0c9ca0 msgr2=0x7f0fcc14b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.919+0000 7f0fcb7fe640 1 --2- 172.21.15.132:0/3059694094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fcc0c9ca0 0x7f0fcc14b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.919+0000 7f0fcb7fe640 1 -- 172.21.15.132:0/3059694094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fcc0c9840 msgr2=0x7f0fcc1e26a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.917+0000 7f341effd640 1 -- 172.21.15.132:0/1659208245 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34200052d0 con 0x7f342800c2b0 2023-12-20T04:42:57.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f341effd640 1 -- 172.21.15.132:0/1659208245 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3420005430 con 0x7f342800c2b0 2023-12-20T04:42:57.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.918+0000 7f341effd640 1 -- 172.21.15.132:0/1659208245 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3420003830 con 0x7f342800c2b0 2023-12-20T04:42:57.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.919+0000 7f0fcb7fe640 1 --2- 172.21.15.132:0/3059694094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fcc0c9840 0x7f0fcc1e26a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.919+0000 7f0fcb7fe640 1 -- 172.21.15.132:0/3059694094 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fc4009a70 con 0x7f0fcc06e1a0 2023-12-20T04:42:57.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.919+0000 7f0fcb7fe640 1 --2- 172.21.15.132:0/3059694094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fcc06e1a0 0x7f0fcc085170 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0015630 tx=0x7f0fc0015af0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7fe08aaab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c049120 con 0x7fe07c0e5630 2023-12-20T04:42:57.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7fe083fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe07c0e5630 0x7fe07c04b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7fe083fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe07c0e5630 0x7fe07c04b8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60030/0 (socket says 172.21.15.132:60030) 2023-12-20T04:42:57.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7fe083fff640 1 -- 172.21.15.132:0/3165687547 learned_addr learned my addr 172.21.15.132:0/3165687547 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:57.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7fe08aaab640 1 -- 172.21.15.132:0/3165687547 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c178a50 con 0x7fe07c0e10f0 2023-12-20T04:42:57.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7fe08aaab640 1 -- 172.21.15.132:0/3165687547 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c0dbed0 con 0x7fe07c0e5b00 2023-12-20T04:42:57.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7fe088847640 1 --2- 172.21.15.132:0/3165687547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe07c0e10f0 0x7fe07c178510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7f0fb3fff640 1 -- 172.21.15.132:0/3059694094 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc000fdb0 con 0x7f0fcc06e1a0 2023-12-20T04:42:57.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7f0fd0d15640 1 -- 172.21.15.132:0/3059694094 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fcc14c130 con 0x7f0fcc06e1a0 2023-12-20T04:42:57.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7f0fd0d15640 1 -- 172.21.15.132:0/3059694094 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fcc0856b0 con 0x7f0fcc06e1a0 2023-12-20T04:42:57.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7f6fbd7fa640 1 -- 172.21.15.132:0/3963172692 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fb8008df0 con 0x7f6fc00b0a90 2023-12-20T04:42:57.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7f6fc6aec640 1 -- 172.21.15.132:0/3963172692 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fc0154040 con 0x7f6fc00b0a90 2023-12-20T04:42:57.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7fe089048640 1 --2- 172.21.15.132:0/3165687547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe07c0e5b00 0x7fe07c00b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7f0fb3fff640 1 -- 172.21.15.132:0/3059694094 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fc00148e0 con 0x7f0fcc06e1a0 2023-12-20T04:42:57.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7f0fb3fff640 1 -- 172.21.15.132:0/3059694094 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fc0014c70 con 0x7f0fcc06e1a0 2023-12-20T04:42:57.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7f6fc6aec640 1 -- 172.21.15.132:0/3963172692 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fc00b3020 con 0x7f6fc00b0a90 2023-12-20T04:42:57.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7fdbb6ffd640 1 -- 172.21.15.132:0/662561310 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdbbc0035f0 con 0x7fdbc80b47a0 2023-12-20T04:42:57.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7fe089048640 1 -- 172.21.15.132:0/3165687547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe07c0e10f0 msgr2=0x7fe07c178510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7fe089048640 1 --2- 172.21.15.132:0/3165687547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe07c0e10f0 0x7fe07c178510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.921+0000 7fe089048640 1 -- 172.21.15.132:0/3165687547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe07c0e5630 msgr2=0x7fe07c04b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.921+0000 7fe089048640 1 --2- 172.21.15.132:0/3165687547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe07c0e5630 0x7fe07c04b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.921+0000 7fe089048640 1 -- 172.21.15.132:0/3165687547 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe078009400 con 0x7fe07c0e5b00 2023-12-20T04:42:57.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.921+0000 7fdbb6ffd640 1 --2- 172.21.15.132:0/662561310 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdba806a4f0 0x7fdba806c9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.921+0000 7fe089048640 1 --2- 172.21.15.132:0/3165687547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe07c0e5b00 0x7fe07c00b000 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe078033000 tx=0x7fe0780046c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.921+0000 7fe083fff640 1 --2- 172.21.15.132:0/3165687547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe07c0e5630 0x7fe07c04b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:57.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.921+0000 7fdbb6ffd640 1 -- 172.21.15.132:0/662561310 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdbbc088170 con 0x7fdbc80b47a0 2023-12-20T04:42:57.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.921+0000 7fdbc5d9b640 1 --2- 172.21.15.132:0/662561310 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdba806a4f0 0x7fdba806c9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.921+0000 7fe0817fa640 1 -- 172.21.15.132:0/3165687547 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07803b970 con 0x7fe07c0e5b00 2023-12-20T04:42:57.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7fc2467fc640 1 -- 172.21.15.132:0/1332772009 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc24803e450 con 0x7fc25015ac50 2023-12-20T04:42:57.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.921+0000 7fc2467fc640 1 --2- 172.21.15.132:0/1332772009 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc23406a500 0x7fc23406c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.921+0000 7fc2467fc640 1 -- 172.21.15.132:0/1332772009 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2480aaff0 con 0x7fc25015ac50 2023-12-20T04:42:57.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.921+0000 7fe08aaab640 1 -- 172.21.15.132:0/3165687547 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07c0db2c0 con 0x7fe07c0e5b00 2023-12-20T04:42:57.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.921+0000 7fe08aaab640 1 -- 172.21.15.132:0/3165687547 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07c0db880 con 0x7fe07c0e5b00 2023-12-20T04:42:57.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.921+0000 7fe0817fa640 1 -- 172.21.15.132:0/3165687547 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe07803bad0 con 0x7fe07c0e5b00 2023-12-20T04:42:57.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.921+0000 7fc255e7c640 1 --2- 172.21.15.132:0/1332772009 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc23406a500 0x7fc23406c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.921+0000 7fe0817fa640 1 -- 172.21.15.132:0/3165687547 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe07803be80 con 0x7fe07c0e5b00 2023-12-20T04:42:57.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.922+0000 7fc255e7c640 1 --2- 172.21.15.132:0/1332772009 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc23406a500 0x7fc23406c9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0017a0 tx=0x7fc24c016040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.922+0000 7f0fd0d15640 1 -- 172.21.15.132:0/3059694094 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fcc0847d0 con 0x7f0fcc06e1a0 2023-12-20T04:42:57.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.923+0000 7fdbc5d9b640 1 --2- 172.21.15.132:0/662561310 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdba806a4f0 0x7fdba806c9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8159890 tx=0x7fdbb8004730 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.923+0000 7f342f59e640 1 -- 172.21.15.132:0/1659208245 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34280475c0 con 0x7f342800c2b0 2023-12-20T04:42:57.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.923+0000 7f342f59e640 1 -- 172.21.15.132:0/1659208245 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f342804bda0 con 0x7f342800c2b0 2023-12-20T04:42:57.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.920+0000 7faf9ee04640 1 -- 172.21.15.132:0/2235145743 wait complete. 2023-12-20T04:42:57.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.922+0000 7faf9ee04640 1 Processor -- start 2023-12-20T04:42:57.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.922+0000 7faf9ee04640 1 -- start start 2023-12-20T04:42:57.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.923+0000 7faf9ee04640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf980b0550 0x7faf9815ffe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.923+0000 7faf9ee04640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf98161320 0x7faf98162520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.923+0000 7faf9ee04640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf981619f0 0x7faf98156c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.923+0000 7fe0817fa640 1 -- 172.21.15.132:0/3165687547 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe07804e450 con 0x7fe07c0e5b00 2023-12-20T04:42:57.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.923+0000 7faf9cba0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf980b0550 0x7faf9815ffe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.923+0000 7faf9cba0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf980b0550 0x7faf9815ffe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:55580/0 (socket says 172.21.15.132:55580) 2023-12-20T04:42:57.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.923+0000 7f6fbd7fa640 1 -- 172.21.15.132:0/3963172692 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6fb8007c90 con 0x7f6fc00b0a90 2023-12-20T04:42:57.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.924+0000 7f0fb3fff640 1 -- 172.21.15.132:0/3059694094 <== mon.2 v2:172.21.15.187:3301/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0fc001f410 con 0x7f0fcc06e1a0 2023-12-20T04:42:57.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.923+0000 7f6fbd7fa640 1 --2- 172.21.15.132:0/3963172692 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fac06a500 0x7f6fac06c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.923+0000 7f6fbd7fa640 1 -- 172.21.15.132:0/3963172692 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fb80aa9b0 con 0x7f6fc00b0a90 2023-12-20T04:42:57.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.924+0000 7fe0817fa640 1 --2- 172.21.15.132:0/3165687547 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe06806a500 0x7fe06806c9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.924+0000 7f6fbffff640 1 --2- 172.21.15.132:0/3963172692 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fac06a500 0x7f6fac06c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.924+0000 7fe0817fa640 1 -- 172.21.15.132:0/3165687547 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe0780aaa00 con 0x7fe07c0e5b00 2023-12-20T04:42:57.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.924+0000 7fe088847640 1 --2- 172.21.15.132:0/3165687547 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe06806a500 0x7fe06806c9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.924+0000 7f0fb3fff640 1 --2- 172.21.15.132:0/3059694094 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fb806a530 0x7f0fb806c9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.924+0000 7f0fb3fff640 1 -- 172.21.15.132:0/3059694094 <== mon.2 v2:172.21.15.187:3301/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fc0091d20 con 0x7f0fcc06e1a0 2023-12-20T04:42:57.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.924+0000 7f342f59e640 1 -- 172.21.15.132:0/1659208245 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34280362f0 con 0x7f342800c2b0 2023-12-20T04:42:57.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.923+0000 7faf9d3a1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf981619f0 0x7faf98156c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.923+0000 7faf9d3a1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf981619f0 0x7faf98156c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:37272/0 (socket says 172.21.15.132:37272) 2023-12-20T04:42:57.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.923+0000 7faf97fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf98161320 0x7faf98162520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.925+0000 7fe088847640 1 --2- 172.21.15.132:0/3165687547 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe06806a500 0x7fe06806c9c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe070009970 tx=0x7fe070008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.925+0000 7faf97fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf98161320 0x7faf98162520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60044/0 (socket says 172.21.15.132:60044) 2023-12-20T04:42:57.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.925+0000 7f6fbffff640 1 --2- 172.21.15.132:0/3963172692 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fac06a500 0x7f6fac06c9c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6fc01584e0 tx=0x7f6fb0003a50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.925+0000 7fc256e7e640 1 -- 172.21.15.132:0/1332772009 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2500673e0 con 0x7fc25015ac50 2023-12-20T04:42:57.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.925+0000 7fe08aaab640 1 -- 172.21.15.132:0/3165687547 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe07c006250 con 0x7fe07c0e5b00 2023-12-20T04:42:57.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.925+0000 7f0fcaffd640 1 --2- 172.21.15.132:0/3059694094 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fb806a530 0x7f0fb806c9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.925+0000 7faf9ee04640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf980b16b0 con 0x7faf98161320 2023-12-20T04:42:57.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.925+0000 7faf9ee04640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf98160520 con 0x7faf981619f0 2023-12-20T04:42:57.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.925+0000 7faf9ee04640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf980b1900 con 0x7faf980b0550 2023-12-20T04:42:57.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.925+0000 7faf9cba0640 1 -- 172.21.15.132:0/2057916618 learned_addr learned my addr 172.21.15.132:0/2057916618 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:57.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.925+0000 7f0fcaffd640 1 --2- 172.21.15.132:0/3059694094 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fb806a530 0x7f0fb806c9f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4036000 tx=0x7f0fc4030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.925+0000 7faf9d3a1640 1 -- 172.21.15.132:0/2057916618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf980b0550 msgr2=0x7faf9815ffe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.925+0000 7faf9d3a1640 1 --2- 172.21.15.132:0/2057916618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf980b0550 0x7faf9815ffe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.925+0000 7faf9d3a1640 1 -- 172.21.15.132:0/2057916618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf98161320 msgr2=0x7faf98162520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:57.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.925+0000 7faf9d3a1640 1 --2- 172.21.15.132:0/2057916618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf98161320 0x7faf98162520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:57.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.925+0000 7faf9d3a1640 1 -- 172.21.15.132:0/2057916618 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf880093a0 con 0x7faf981619f0 2023-12-20T04:42:57.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.926+0000 7faf97fff640 1 --2- 172.21.15.132:0/2057916618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf98161320 0x7faf98162520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:57.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.926+0000 7faf9d3a1640 1 --2- 172.21.15.132:0/2057916618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf981619f0 0x7faf98156c30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faf8c005880 tx=0x7faf8c00cbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.926+0000 7f6fc6aec640 1 -- 172.21.15.132:0/3963172692 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fc00673e0 con 0x7f6fc00b0a90 2023-12-20T04:42:57.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.926+0000 7faf957fa640 1 -- 172.21.15.132:0/2057916618 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c005ad0 con 0x7faf981619f0 2023-12-20T04:42:57.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.926+0000 7faf9ee04640 1 -- 172.21.15.132:0/2057916618 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf980b1be0 con 0x7faf981619f0 2023-12-20T04:42:57.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.926+0000 7faf9ee04640 1 -- 172.21.15.132:0/2057916618 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf980b21a0 con 0x7faf981619f0 2023-12-20T04:42:57.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.927+0000 7fdbb6ffd640 1 -- 172.21.15.132:0/662561310 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdbbc053800 con 0x7fdbc80b47a0 2023-12-20T04:42:57.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.928+0000 7faf9ee04640 1 -- 172.21.15.132:0/2057916618 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf980673e0 con 0x7faf981619f0 2023-12-20T04:42:57.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.928+0000 7f341effd640 1 -- 172.21.15.132:0/1659208245 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3420003990 con 0x7f342800c2b0 2023-12-20T04:42:57.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.928+0000 7f341effd640 1 --2- 172.21.15.132:0/1659208245 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f341006a480 0x7f341006c940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.928+0000 7f341effd640 1 -- 172.21.15.132:0/1659208245 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3420088240 con 0x7f342800c2b0 2023-12-20T04:42:57.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.928+0000 7f342e59c640 1 --2- 172.21.15.132:0/1659208245 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f341006a480 0x7f341006c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.929+0000 7f0fb3fff640 1 -- 172.21.15.132:0/3059694094 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0fcc0847d0 con 0x7f0fcc06e1a0 2023-12-20T04:42:57.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.929+0000 7f342e59c640 1 --2- 172.21.15.132:0/1659208245 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f341006a480 0x7f341006c940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3424036000 tx=0x7f342403b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.931+0000 7faf957fa640 1 -- 172.21.15.132:0/2057916618 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf8c005c30 con 0x7faf981619f0 2023-12-20T04:42:57.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.931+0000 7faf957fa640 1 -- 172.21.15.132:0/2057916618 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf8c007070 con 0x7faf981619f0 2023-12-20T04:42:57.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.931+0000 7f341effd640 1 -- 172.21.15.132:0/1659208245 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f34200539a0 con 0x7f342800c2b0 2023-12-20T04:42:57.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.933+0000 7faf957fa640 1 -- 172.21.15.132:0/2057916618 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faf8c0071d0 con 0x7faf981619f0 2023-12-20T04:42:57.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.933+0000 7faf957fa640 1 --2- 172.21.15.132:0/2057916618 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faf8406a430 0x7faf8406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:57.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.933+0000 7fc2467fc640 1 -- 172.21.15.132:0/1332772009 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc248076650 con 0x7fc25015ac50 2023-12-20T04:42:57.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.933+0000 7faf957fa640 1 -- 172.21.15.132:0/2057916618 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faf8c0882a0 con 0x7faf981619f0 2023-12-20T04:42:57.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.934+0000 7faf9cba0640 1 --2- 172.21.15.132:0/2057916618 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faf8406a430 0x7faf8406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:57.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.934+0000 7faf9cba0640 1 --2- 172.21.15.132:0/2057916618 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faf8406a430 0x7faf8406c8f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faf98160d30 tx=0x7faf90003a70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:57.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.936+0000 7faf957fa640 1 -- 172.21.15.132:0/2057916618 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7faf8c0538a0 con 0x7faf981619f0 2023-12-20T04:42:57.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.937+0000 7f6fbd7fa640 1 -- 172.21.15.132:0/3963172692 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6fb8076030 con 0x7f6fc00b0a90 2023-12-20T04:42:57.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:57.944+0000 7fe0817fa640 1 -- 172.21.15.132:0/3165687547 <== mon.2 v2:172.21.15.187:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe07c006250 con 0x7fe07c0e5b00 2023-12-20T04:42:58.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.263+0000 7f4eb66fa640 1 -- 172.21.15.132:0/3537234781 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7f4e90005500 con 0x7f4ea8054190 2023-12-20T04:42:58.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.264+0000 7f4ea5ffb640 1 -- 172.21.15.132:0/3537234781 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f4eb00d1990 con 0x7f4ea8054190 2023-12-20T04:42:58.269 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2023-12-20T04:42:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.268+0000 7f4e9b7fe640 1 -- 172.21.15.132:0/3537234781 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e9406a580 msgr2=0x7f4e9406ca40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.268+0000 7f4e9b7fe640 1 --2- 172.21.15.132:0/3537234781 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e9406a580 0x7f4e9406ca40 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f4ea0003610 tx=0x7f4ea0008040 comp rx=0 tx=0).stop 2023-12-20T04:42:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.268+0000 7f4e9b7fe640 1 -- 172.21.15.132:0/3537234781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ea8054190 msgr2=0x7f4ea80d5e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.268+0000 7f4e9b7fe640 1 --2- 172.21.15.132:0/3537234781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ea8054190 0x7f4ea80d5e30 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f4eb0063840 tx=0x7f4eb0074040 comp rx=0 tx=0).stop 2023-12-20T04:42:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.269+0000 7f4e9b7fe640 1 -- 172.21.15.132:0/3537234781 shutdown_connections 2023-12-20T04:42:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.269+0000 7f4e9b7fe640 1 --2- 172.21.15.132:0/3537234781 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e9406a580 0x7f4e9406ca40 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.269+0000 7f4e9b7fe640 1 --2- 172.21.15.132:0/3537234781 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ea8054190 0x7f4ea80d5e30 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.269+0000 7f4e9b7fe640 1 --2- 172.21.15.132:0/3537234781 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ea8050ed0 0x7f4ea804ace0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.269+0000 7f4e9b7fe640 1 --2- 172.21.15.132:0/3537234781 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ea8050af0 0x7f4ea804cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.269+0000 7f4e9b7fe640 1 -- 172.21.15.132:0/3537234781 >> 172.21.15.132:0/3537234781 conn(0x7f4ea8055d20 msgr2=0x7f4ea80398b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:58.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.269+0000 7f4e9b7fe640 1 -- 172.21.15.132:0/3537234781 shutdown_connections 2023-12-20T04:42:58.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.269+0000 7f4e9b7fe640 1 -- 172.21.15.132:0/3537234781 wait complete. 2023-12-20T04:42:58.287 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2023-12-20T04:42:58.288 DEBUG:teuthology.parallel:result is None 2023-12-20T04:42:58.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.302+0000 7fc256e7e640 1 -- 172.21.15.132:0/1332772009 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) v1 -- 0x7fc250149950 con 0x7fc25015ac50 2023-12-20T04:42:58.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.303+0000 7fc2467fc640 1 -- 172.21.15.132:0/1332772009 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc248043070 con 0x7fc25015ac50 2023-12-20T04:42:58.305 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2023-12-20T04:42:58.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.305+0000 7fc256e7e640 1 -- 172.21.15.132:0/1332772009 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc23406a500 msgr2=0x7fc23406c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.305+0000 7fc256e7e640 1 --2- 172.21.15.132:0/1332772009 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc23406a500 0x7fc23406c9c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fc24c0017a0 tx=0x7fc24c016040 comp rx=0 tx=0).stop 2023-12-20T04:42:58.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.305+0000 7fc256e7e640 1 -- 172.21.15.132:0/1332772009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc25015ac50 msgr2=0x7fc250146a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.305+0000 7fc256e7e640 1 --2- 172.21.15.132:0/1332772009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc25015ac50 0x7fc250146a20 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fc248032000 tx=0x7fc248004a40 comp rx=0 tx=0).stop 2023-12-20T04:42:58.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.305+0000 7fc256e7e640 1 -- 172.21.15.132:0/1332772009 shutdown_connections 2023-12-20T04:42:58.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.305+0000 7fc256e7e640 1 --2- 172.21.15.132:0/1332772009 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc23406a500 0x7fc23406c9c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.305+0000 7fc256e7e640 1 --2- 172.21.15.132:0/1332772009 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc25015b030 0x7fc250146050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.305+0000 7fc256e7e640 1 --2- 172.21.15.132:0/1332772009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc25015ac50 0x7fc250146a20 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.305+0000 7fc256e7e640 1 --2- 172.21.15.132:0/1332772009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2500cccd0 0x7fc250148590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.305+0000 7fc256e7e640 1 -- 172.21.15.132:0/1332772009 >> 172.21.15.132:0/1332772009 conn(0x7fc250072c60 msgr2=0x7fc2500b0410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:58.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.309+0000 7fc256e7e640 1 -- 172.21.15.132:0/1332772009 shutdown_connections 2023-12-20T04:42:58.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.309+0000 7fc256e7e640 1 -- 172.21.15.132:0/1332772009 wait complete. 2023-12-20T04:42:58.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.312+0000 7fdbccd99640 1 -- 172.21.15.132:0/662561310 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7fdbc80673e0 con 0x7fdbc80b47a0 2023-12-20T04:42:58.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.313+0000 7fdbb6ffd640 1 -- 172.21.15.132:0/662561310 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fdbbc017020 con 0x7fdbc80b47a0 2023-12-20T04:42:58.317 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2023-12-20T04:42:58.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.316+0000 7fdbccd99640 1 -- 172.21.15.132:0/662561310 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdba806a4f0 msgr2=0x7fdba806c9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.316+0000 7fdbccd99640 1 --2- 172.21.15.132:0/662561310 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdba806a4f0 0x7fdba806c9b0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8159890 tx=0x7fdbb8004730 comp rx=0 tx=0).stop 2023-12-20T04:42:58.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.316+0000 7fdbccd99640 1 -- 172.21.15.132:0/662561310 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbc80b47a0 msgr2=0x7fdbc8159350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.316+0000 7fdbccd99640 1 --2- 172.21.15.132:0/662561310 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbc80b47a0 0x7fdbc8159350 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fdbbc00c400 tx=0x7fdbbc00c8c0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.317+0000 7fdbccd99640 1 -- 172.21.15.132:0/662561310 shutdown_connections 2023-12-20T04:42:58.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.317+0000 7fdbccd99640 1 --2- 172.21.15.132:0/662561310 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdba806a4f0 0x7fdba806c9b0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.317+0000 7fdbccd99640 1 --2- 172.21.15.132:0/662561310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdbc80d21a0 0x7fdbc81ee620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.317+0000 7fdbccd99640 1 --2- 172.21.15.132:0/662561310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdbc80d02c0 0x7fdbc80ccf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.317+0000 7fdbccd99640 1 --2- 172.21.15.132:0/662561310 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdbc80b47a0 0x7fdbc8159350 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.317+0000 7fdbccd99640 1 -- 172.21.15.132:0/662561310 >> 172.21.15.132:0/662561310 conn(0x7fdbc80cf7a0 msgr2=0x7fdbc80b5fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:58.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.317+0000 7fdbccd99640 1 -- 172.21.15.132:0/662561310 shutdown_connections 2023-12-20T04:42:58.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.317+0000 7fdbccd99640 1 -- 172.21.15.132:0/662561310 wait complete. 2023-12-20T04:42:58.324 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.7 2023-12-20T04:42:58.324 DEBUG:teuthology.parallel:result is None 2023-12-20T04:42:58.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.327+0000 7f0fd0d15640 1 -- 172.21.15.132:0/3059694094 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7f0fcc0847d0 con 0x7f0fcc06e1a0 2023-12-20T04:42:58.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.327+0000 7f0fb3fff640 1 -- 172.21.15.132:0/3059694094 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f0fcc0847d0 con 0x7f0fcc06e1a0 2023-12-20T04:42:58.329 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2023-12-20T04:42:58.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.330+0000 7f0fd0d15640 1 -- 172.21.15.132:0/3059694094 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fb806a530 msgr2=0x7f0fb806c9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.330+0000 7f0fd0d15640 1 --2- 172.21.15.132:0/3059694094 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fb806a530 0x7f0fb806c9f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f0fc4036000 tx=0x7f0fc4030000 comp rx=0 tx=0).stop 2023-12-20T04:42:58.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.330+0000 7f0fd0d15640 1 -- 172.21.15.132:0/3059694094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fcc06e1a0 msgr2=0x7f0fcc085170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.330+0000 7f0fd0d15640 1 --2- 172.21.15.132:0/3059694094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fcc06e1a0 0x7f0fcc085170 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f0fc0015630 tx=0x7f0fc0015af0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.330+0000 7f0fd0d15640 1 -- 172.21.15.132:0/3059694094 shutdown_connections 2023-12-20T04:42:58.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.330+0000 7f0fd0d15640 1 --2- 172.21.15.132:0/3059694094 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fb806a530 0x7f0fb806c9f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.330+0000 7f0fd0d15640 1 --2- 172.21.15.132:0/3059694094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fcc0c9ca0 0x7f0fcc14b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.330+0000 7f0fd0d15640 1 --2- 172.21.15.132:0/3059694094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fcc0c9840 0x7f0fcc1e26a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.330+0000 7f0fd0d15640 1 --2- 172.21.15.132:0/3059694094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fcc06e1a0 0x7f0fcc085170 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.330+0000 7f0fd0d15640 1 -- 172.21.15.132:0/3059694094 >> 172.21.15.132:0/3059694094 conn(0x7f0fcc0cbc70 msgr2=0x7f0fcc0c5920 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:58.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.330+0000 7f0fd0d15640 1 -- 172.21.15.132:0/3059694094 shutdown_connections 2023-12-20T04:42:58.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.330+0000 7f0fd0d15640 1 -- 172.21.15.132:0/3059694094 wait complete. 2023-12-20T04:42:58.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.331+0000 7f342f59e640 1 -- 172.21.15.132:0/1659208245 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f3428005510 con 0x7f342800c2b0 2023-12-20T04:42:58.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.331+0000 7f341effd640 1 -- 172.21.15.132:0/1659208245 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f3420056fc0 con 0x7f342800c2b0 2023-12-20T04:42:58.334 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2023-12-20T04:42:58.335 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2023-12-20T04:42:58.335 DEBUG:teuthology.parallel:result is None 2023-12-20T04:42:58.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.334+0000 7fe08aaab640 1 -- 172.21.15.132:0/3165687547 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) v1 -- 0x7fe07c006250 con 0x7fe07c0e5b00 2023-12-20T04:42:58.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.334+0000 7f342f59e640 1 -- 172.21.15.132:0/1659208245 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f341006a480 msgr2=0x7f341006c940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.334+0000 7f342f59e640 1 --2- 172.21.15.132:0/1659208245 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f341006a480 0x7f341006c940 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3424036000 tx=0x7f342403b040 comp rx=0 tx=0).stop 2023-12-20T04:42:58.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.334+0000 7f342f59e640 1 -- 172.21.15.132:0/1659208245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f342800c2b0 msgr2=0x7f342804b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.334+0000 7f342f59e640 1 --2- 172.21.15.132:0/1659208245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f342800c2b0 0x7f342804b000 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f342000c400 tx=0x7f342000c8c0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.335+0000 7f342f59e640 1 -- 172.21.15.132:0/1659208245 shutdown_connections 2023-12-20T04:42:58.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.335+0000 7f342f59e640 1 --2- 172.21.15.132:0/1659208245 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f341006a480 0x7f341006c940 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.335+0000 7f342f59e640 1 --2- 172.21.15.132:0/1659208245 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34280e3350 0x7f34280e1710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.335+0000 7f342f59e640 1 --2- 172.21.15.132:0/1659208245 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f342800c2b0 0x7f342804b000 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.335+0000 7f342f59e640 1 --2- 172.21.15.132:0/1659208245 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34280072e0 0x7f342804aac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.335+0000 7f342f59e640 1 -- 172.21.15.132:0/1659208245 >> 172.21.15.132:0/1659208245 conn(0x7f3428054cd0 msgr2=0x7f342804f2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:58.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.335+0000 7f342f59e640 1 -- 172.21.15.132:0/1659208245 shutdown_connections 2023-12-20T04:42:58.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.335+0000 7f342f59e640 1 -- 172.21.15.132:0/1659208245 wait complete. 2023-12-20T04:42:58.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.335+0000 7fe0817fa640 1 -- 172.21.15.132:0/3165687547 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe07c006250 con 0x7fe07c0e5b00 2023-12-20T04:42:58.338 INFO:teuthology.orchestra.run.smithi132.stdout:55834574854 2023-12-20T04:42:58.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.337+0000 7fe08aaab640 1 -- 172.21.15.132:0/3165687547 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe06806a500 msgr2=0x7fe06806c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.337+0000 7fe08aaab640 1 --2- 172.21.15.132:0/3165687547 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe06806a500 0x7fe06806c9c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fe070009970 tx=0x7fe070008040 comp rx=0 tx=0).stop 2023-12-20T04:42:58.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.337+0000 7fe08aaab640 1 -- 172.21.15.132:0/3165687547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe07c0e5b00 msgr2=0x7fe07c00b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.337+0000 7fe08aaab640 1 --2- 172.21.15.132:0/3165687547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe07c0e5b00 0x7fe07c00b000 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fe078033000 tx=0x7fe0780046c0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.337+0000 7f6fc6aec640 1 -- 172.21.15.132:0/3963172692 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f6fc006c4b0 con 0x7f6fc00b0a90 2023-12-20T04:42:58.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.337+0000 7fe08aaab640 1 -- 172.21.15.132:0/3165687547 shutdown_connections 2023-12-20T04:42:58.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.337+0000 7fe08aaab640 1 --2- 172.21.15.132:0/3165687547 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe06806a500 0x7fe06806c9c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.337+0000 7fe08aaab640 1 --2- 172.21.15.132:0/3165687547 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe07c0e5b00 0x7fe07c00b000 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.337+0000 7fe08aaab640 1 --2- 172.21.15.132:0/3165687547 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe07c0e5630 0x7fe07c04b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.337+0000 7fe08aaab640 1 --2- 172.21.15.132:0/3165687547 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe07c0e10f0 0x7fe07c178510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.337+0000 7fe08aaab640 1 -- 172.21.15.132:0/3165687547 >> 172.21.15.132:0/3165687547 conn(0x7fe07c03a460 msgr2=0x7fe07c0df9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:58.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.337+0000 7fe08aaab640 1 -- 172.21.15.132:0/3165687547 shutdown_connections 2023-12-20T04:42:58.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.337+0000 7fe08aaab640 1 -- 172.21.15.132:0/3165687547 wait complete. 2023-12-20T04:42:58.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.338+0000 7f6fbd7fa640 1 -- 172.21.15.132:0/3963172692 <== mon.2 v2:172.21.15.187:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f6fb8034090 con 0x7f6fc00b0a90 2023-12-20T04:42:58.341 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2023-12-20T04:42:58.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.340+0000 7f6fc6aec640 1 -- 172.21.15.132:0/3963172692 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fac06a500 msgr2=0x7f6fac06c9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.340+0000 7f6fc6aec640 1 --2- 172.21.15.132:0/3963172692 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fac06a500 0x7f6fac06c9c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6fc01584e0 tx=0x7f6fb0003a50 comp rx=0 tx=0).stop 2023-12-20T04:42:58.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.340+0000 7f6fc6aec640 1 -- 172.21.15.132:0/3963172692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fc00b0a90 msgr2=0x7f6fc00b1b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.340+0000 7f6fc6aec640 1 --2- 172.21.15.132:0/3963172692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fc00b0a90 0x7f6fc00b1b70 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f6fb8033000 tx=0x7f6fb80046c0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.340+0000 7f6fc6aec640 1 -- 172.21.15.132:0/3963172692 shutdown_connections 2023-12-20T04:42:58.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.340+0000 7f6fc6aec640 1 --2- 172.21.15.132:0/3963172692 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fac06a500 0x7f6fac06c9c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.340+0000 7f6fc6aec640 1 --2- 172.21.15.132:0/3963172692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fc0153550 0x7f6fc00afe20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.340+0000 7f6fc6aec640 1 --2- 172.21.15.132:0/3963172692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fc00ccad0 0x7f6fc0153b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.340+0000 7f6fc6aec640 1 --2- 172.21.15.132:0/3963172692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fc00b0a90 0x7f6fc00b1b70 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.340+0000 7f6fc6aec640 1 -- 172.21.15.132:0/3963172692 >> 172.21.15.132:0/3963172692 conn(0x7f6fc0069c30 msgr2=0x7f6fc01e30e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:58.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.340+0000 7f6fc6aec640 1 -- 172.21.15.132:0/3963172692 shutdown_connections 2023-12-20T04:42:58.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.340+0000 7f6fc6aec640 1 -- 172.21.15.132:0/3963172692 wait complete. 2023-12-20T04:42:58.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.344+0000 7faf9ee04640 1 -- 172.21.15.132:0/2057916618 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7faf9806c800 con 0x7faf981619f0 2023-12-20T04:42:58.346 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2023-12-20T04:42:58.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.344+0000 7faf957fa640 1 -- 172.21.15.132:0/2057916618 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7faf8c056ec0 con 0x7faf981619f0 2023-12-20T04:42:58.346 INFO:teuthology.orchestra.run.smithi132.stdout:55834574853 2023-12-20T04:42:58.347 DEBUG:teuthology.parallel:result is None 2023-12-20T04:42:58.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.348+0000 7faf9ee04640 1 -- 172.21.15.132:0/2057916618 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faf8406a430 msgr2=0x7faf8406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.348+0000 7faf9ee04640 1 --2- 172.21.15.132:0/2057916618 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faf8406a430 0x7faf8406c8f0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7faf98160d30 tx=0x7faf90003a70 comp rx=0 tx=0).stop 2023-12-20T04:42:58.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.348+0000 7faf9ee04640 1 -- 172.21.15.132:0/2057916618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf981619f0 msgr2=0x7faf98156c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.348+0000 7faf9ee04640 1 --2- 172.21.15.132:0/2057916618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf981619f0 0x7faf98156c30 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7faf8c005880 tx=0x7faf8c00cbe0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.348+0000 7faf9ee04640 1 -- 172.21.15.132:0/2057916618 shutdown_connections 2023-12-20T04:42:58.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.348+0000 7faf9ee04640 1 --2- 172.21.15.132:0/2057916618 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faf8406a430 0x7faf8406c8f0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.348+0000 7faf9ee04640 1 --2- 172.21.15.132:0/2057916618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf981619f0 0x7faf98156c30 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.348+0000 7faf9ee04640 1 --2- 172.21.15.132:0/2057916618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf98161320 0x7faf98162520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.348+0000 7faf9ee04640 1 --2- 172.21.15.132:0/2057916618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf980b0550 0x7faf9815ffe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.348+0000 7faf9ee04640 1 -- 172.21.15.132:0/2057916618 >> 172.21.15.132:0/2057916618 conn(0x7faf980ce970 msgr2=0x7faf980ced50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:58.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.348+0000 7faf9ee04640 1 -- 172.21.15.132:0/2057916618 shutdown_connections 2023-12-20T04:42:58.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.348+0000 7faf9ee04640 1 -- 172.21.15.132:0/2057916618 wait complete. 2023-12-20T04:42:58.354 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.6 2023-12-20T04:42:58.355 DEBUG:teuthology.parallel:result is None 2023-12-20T04:42:58.355 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2023-12-20T04:42:58.356 DEBUG:teuthology.parallel:result is None 2023-12-20T04:42:58.356 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.3 2023-12-20T04:42:58.356 DEBUG:teuthology.parallel:result is None 2023-12-20T04:42:58.362 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2023-12-20T04:42:58.362 DEBUG:teuthology.parallel:result is None 2023-12-20T04:42:58.362 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-20T04:42:58.362 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:42:58.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.499+0000 7ffbaad9f640 1 Processor -- start 2023-12-20T04:42:58.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.499+0000 7ffbaad9f640 1 -- start start 2023-12-20T04:42:58.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.500+0000 7ffbaad9f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffba4160450 0x7ffba4160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:58.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.500+0000 7ffbaad9f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ffba41611b0 0x7ffba40b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:58.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.500+0000 7ffbaad9f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffba40b4ec0 0x7ffba406a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:58.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.500+0000 7ffbaad9f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba40b5350 con 0x7ffba4160450 2023-12-20T04:42:58.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.500+0000 7ffbaad9f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffba40b5ec0 con 0x7ffba41611b0 2023-12-20T04:42:58.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.500+0000 7ffbaad9f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba41617e0 con 0x7ffba40b4ec0 2023-12-20T04:42:58.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.500+0000 7ffba8b3b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffba4160450 0x7ffba4160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:58.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.500+0000 7ffba8b3b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffba4160450 0x7ffba4160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60060/0 (socket says 172.21.15.132:60060) 2023-12-20T04:42:58.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.500+0000 7ffba8b3b640 1 -- 172.21.15.132:0/2923168363 learned_addr learned my addr 172.21.15.132:0/2923168363 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:58.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.501+0000 7ffba8b3b640 1 -- 172.21.15.132:0/2923168363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffba40b4ec0 msgr2=0x7ffba406a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:58.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.501+0000 7ffba8b3b640 1 --2- 172.21.15.132:0/2923168363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffba40b4ec0 0x7ffba406a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.501+0000 7ffba8b3b640 1 -- 172.21.15.132:0/2923168363 >> v2:172.21.15.187:3300/0 conn(0x7ffba41611b0 msgr2=0x7ffba40b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:58.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.501+0000 7ffba8b3b640 1 --2- 172.21.15.132:0/2923168363 >> v2:172.21.15.187:3300/0 conn(0x7ffba41611b0 0x7ffba40b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.501+0000 7ffba8b3b640 1 -- 172.21.15.132:0/2923168363 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffba40d0fc0 con 0x7ffba4160450 2023-12-20T04:42:58.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.501+0000 7ffba8b3b640 1 --2- 172.21.15.132:0/2923168363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffba4160450 0x7ffba4160c70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffba408b100 tx=0x7ffb9402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f37f55180b5dacd7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:58.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.501+0000 7ffba37fe640 1 -- 172.21.15.132:0/2923168363 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb94030860 con 0x7ffba4160450 2023-12-20T04:42:58.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.501+0000 7ffba37fe640 1 -- 172.21.15.132:0/2923168363 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb940309c0 con 0x7ffba4160450 2023-12-20T04:42:58.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.501+0000 7ffba37fe640 1 -- 172.21.15.132:0/2923168363 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb94030d50 con 0x7ffba4160450 2023-12-20T04:42:58.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.502+0000 7ffbaad9f640 1 -- 172.21.15.132:0/2923168363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffba4160450 msgr2=0x7ffba4160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.502+0000 7ffbaad9f640 1 --2- 172.21.15.132:0/2923168363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffba4160450 0x7ffba4160c70 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7ffba408b100 tx=0x7ffb9402b9a0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.502+0000 7ffbaad9f640 1 -- 172.21.15.132:0/2923168363 shutdown_connections 2023-12-20T04:42:58.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.502+0000 7ffbaad9f640 1 --2- 172.21.15.132:0/2923168363 >> v2:172.21.15.187:3300/0 conn(0x7ffba41611b0 0x7ffba40b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.502+0000 7ffbaad9f640 1 --2- 172.21.15.132:0/2923168363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffba40b4ec0 0x7ffba406a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.502+0000 7ffbaad9f640 1 --2- 172.21.15.132:0/2923168363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffba4160450 0x7ffba4160c70 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.502+0000 7ffbaad9f640 1 -- 172.21.15.132:0/2923168363 >> 172.21.15.132:0/2923168363 conn(0x7ffba40cf980 msgr2=0x7ffba40cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:58.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.502+0000 7ffbaad9f640 1 -- 172.21.15.132:0/2923168363 shutdown_connections 2023-12-20T04:42:58.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.502+0000 7ffbaad9f640 1 -- 172.21.15.132:0/2923168363 wait complete. 2023-12-20T04:42:58.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.503+0000 7ffbaad9f640 1 Processor -- start 2023-12-20T04:42:58.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.503+0000 7ffbaad9f640 1 -- start start 2023-12-20T04:42:58.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.504+0000 7ffbaad9f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffba40b4ec0 0x7ffba415e9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:58.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.504+0000 7ffbaad9f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffba4160450 0x7ffba41f31d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:58.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.504+0000 7ffbaad9f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffba41611b0 0x7ffba40d1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:58.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.504+0000 7ffbaad9f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba41f3a00 con 0x7ffba40b4ec0 2023-12-20T04:42:58.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.504+0000 7ffbaad9f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffba415aee0 con 0x7ffba4160450 2023-12-20T04:42:58.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.504+0000 7ffbaad9f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffba415a120 con 0x7ffba41611b0 2023-12-20T04:42:58.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.504+0000 7ffba8b3b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffba40b4ec0 0x7ffba415e9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:58.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.504+0000 7ffba8b3b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffba40b4ec0 0x7ffba415e9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60062/0 (socket says 172.21.15.132:60062) 2023-12-20T04:42:58.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.504+0000 7ffba8b3b640 1 -- 172.21.15.132:0/3051280091 learned_addr learned my addr 172.21.15.132:0/3051280091 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:58.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.504+0000 7ffba3fff640 1 --2- 172.21.15.132:0/3051280091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffba4160450 0x7ffba41f31d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:58.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.504+0000 7ffba933c640 1 --2- 172.21.15.132:0/3051280091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffba41611b0 0x7ffba40d1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:58.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.504+0000 7ffba8b3b640 1 -- 172.21.15.132:0/3051280091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffba41611b0 msgr2=0x7ffba40d1d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.504+0000 7ffba8b3b640 1 --2- 172.21.15.132:0/3051280091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffba41611b0 0x7ffba40d1d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.504+0000 7ffba8b3b640 1 -- 172.21.15.132:0/3051280091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffba4160450 msgr2=0x7ffba41f31d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.504+0000 7ffba8b3b640 1 --2- 172.21.15.132:0/3051280091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffba4160450 0x7ffba41f31d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.504+0000 7ffba8b3b640 1 -- 172.21.15.132:0/3051280091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb940094d0 con 0x7ffba40b4ec0 2023-12-20T04:42:58.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.505+0000 7ffba8b3b640 1 --2- 172.21.15.132:0/3051280091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffba40b4ec0 0x7ffba415e9a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffb94000c00 tx=0x7ffb94004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:58.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.505+0000 7ffba17fa640 1 -- 172.21.15.132:0/3051280091 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb94039d40 con 0x7ffba40b4ec0 2023-12-20T04:42:58.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.505+0000 7ffba17fa640 1 -- 172.21.15.132:0/3051280091 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb94043400 con 0x7ffba40b4ec0 2023-12-20T04:42:58.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.505+0000 7ffbaad9f640 1 -- 172.21.15.132:0/3051280091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffba415a400 con 0x7ffba40b4ec0 2023-12-20T04:42:58.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.505+0000 7ffba17fa640 1 -- 172.21.15.132:0/3051280091 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb94039ea0 con 0x7ffba40b4ec0 2023-12-20T04:42:58.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.505+0000 7ffbaad9f640 1 -- 172.21.15.132:0/3051280091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffba415a9c0 con 0x7ffba40b4ec0 2023-12-20T04:42:58.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.506+0000 7ffbaad9f640 1 -- 172.21.15.132:0/3051280091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffba404e840 con 0x7ffba40b4ec0 2023-12-20T04:42:58.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.506+0000 7ffba17fa640 1 -- 172.21.15.132:0/3051280091 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffb940437b0 con 0x7ffba40b4ec0 2023-12-20T04:42:58.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.506+0000 7ffba17fa640 1 --2- 172.21.15.132:0/3051280091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ffb9006a430 0x7ffb9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:58.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.506+0000 7ffba17fa640 1 -- 172.21.15.132:0/3051280091 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ffb9403e070 con 0x7ffba40b4ec0 2023-12-20T04:42:58.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.506+0000 7ffba3fff640 1 --2- 172.21.15.132:0/3051280091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ffb9006a430 0x7ffb9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:58.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.507+0000 7ffba3fff640 1 --2- 172.21.15.132:0/3051280091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ffb9006a430 0x7ffb9006c8f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffba40aa6f0 tx=0x7ffb98008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:58.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.511+0000 7ffba17fa640 1 -- 172.21.15.132:0/3051280091 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ffb940771d0 con 0x7ffba40b4ec0 2023-12-20T04:42:58.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.673+0000 7ffbaad9f640 1 -- 172.21.15.132:0/3051280091 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ffba40d1580 con 0x7ffb9006a430 2023-12-20T04:42:58.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.679+0000 7ffba17fa640 1 -- 172.21.15.132:0/3051280091 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260212 (secure 0 0 0) 0x7ffb9800bdc0 con 0x7ffb9006a430 2023-12-20T04:42:58.684 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:58.685 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:42:58.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.683+0000 7ffbaad9f640 1 -- 172.21.15.132:0/3051280091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ffb9006a430 msgr2=0x7ffb9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.683+0000 7ffbaad9f640 1 --2- 172.21.15.132:0/3051280091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ffb9006a430 0x7ffb9006c8f0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7ffba40aa6f0 tx=0x7ffb98008040 comp rx=0 tx=0).stop 2023-12-20T04:42:58.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.683+0000 7ffbaad9f640 1 -- 172.21.15.132:0/3051280091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffba40b4ec0 msgr2=0x7ffba415e9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.683+0000 7ffbaad9f640 1 --2- 172.21.15.132:0/3051280091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffba40b4ec0 0x7ffba415e9a0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7ffb94000c00 tx=0x7ffb94004730 comp rx=0 tx=0).stop 2023-12-20T04:42:58.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.683+0000 7ffbaad9f640 1 -- 172.21.15.132:0/3051280091 shutdown_connections 2023-12-20T04:42:58.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.683+0000 7ffbaad9f640 1 --2- 172.21.15.132:0/3051280091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ffb9006a430 0x7ffb9006c8f0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.683+0000 7ffbaad9f640 1 --2- 172.21.15.132:0/3051280091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffba41611b0 0x7ffba40d1d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.683+0000 7ffbaad9f640 1 --2- 172.21.15.132:0/3051280091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffba4160450 0x7ffba41f31d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.683+0000 7ffbaad9f640 1 --2- 172.21.15.132:0/3051280091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffba40b4ec0 0x7ffba415e9a0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.683+0000 7ffbaad9f640 1 -- 172.21.15.132:0/3051280091 >> 172.21.15.132:0/3051280091 conn(0x7ffba40cf980 msgr2=0x7ffba40c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:58.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.683+0000 7ffbaad9f640 1 -- 172.21.15.132:0/3051280091 shutdown_connections 2023-12-20T04:42:58.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.683+0000 7ffbaad9f640 1 -- 172.21.15.132:0/3051280091 wait complete. 2023-12-20T04:42:58.696 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-20T04:42:58.095257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002308"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271408+0000","last_change":"2023-12-20T04:42:47.172892+0000","last_active":"2023-12-20T04:42:50.271408+0000","last_peered":"2023-12-20T04:42:50.271408+0000","last_clean":"2023-12-20T04:42:50.271408+0000","last_became_active":"2023-12-20T04:42:47.172487+0000","last_became_peered":"2023-12-20T04:42:47.172487+0000","last_unstale":"2023-12-20T04:42:50.271408+0000","last_undegraded":"2023-12-20T04:42:50.271408+0000","last_fullsized":"2023-12-20T04:42:50.271408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:58:34.559072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270445+0000","last_change":"2023-12-20T04:42:47.157323+0000","last_active":"2023-12-20T04:42:50.270445+0000","last_peered":"2023-12-20T04:42:50.270445+0000","last_clean":"2023-12-20T04:42:50.270445+0000","last_became_active":"2023-12-20T04:42:47.157120+0000","last_became_peered":"2023-12-20T04:42:47.157120+0000","last_unstale":"2023-12-20T04:42:50.270445+0000","last_undegraded":"2023-12-20T04:42:50.270445+0000","last_fullsized":"2023-12-20T04:42:50.270445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:56:01.988189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159802+0000","last_change":"2023-12-20T04:42:47.157566+0000","last_active":"2023-12-20T04:42:48.159802+0000","last_peered":"2023-12-20T04:42:48.159802+0000","last_clean":"2023-12-20T04:42:48.159802+0000","last_became_active":"2023-12-20T04:42:47.157364+0000","last_became_peered":"2023-12-20T04:42:47.157364+0000","last_unstale":"2023-12-20T04:42:48.159802+0000","last_undegraded":"2023-12-20T04:42:48.159802+0000","last_fullsized":"2023-12-20T04:42:48.159802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:22.324414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270992+0000","last_change":"2023-12-20T04:42:47.162525+0000","last_active":"2023-12-20T04:42:50.270992+0000","last_peered":"2023-12-20T04:42:50.270992+0000","last_clean":"2023-12-20T04:42:50.270992+0000","last_became_active":"2023-12-20T04:42:47.162288+0000","last_became_peered":"2023-12-20T04:42:47.162288+0000","last_unstale":"2023-12-20T04:42:50.270992+0000","last_undegraded":"2023-12-20T04:42:50.270992+0000","last_fullsized":"2023-12-20T04:42:50.270992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:43:18.176211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271016+0000","last_change":"2023-12-20T04:42:47.170675+0000","last_active":"2023-12-20T04:42:50.271016+0000","last_peered":"2023-12-20T04:42:50.271016+0000","last_clean":"2023-12-20T04:42:50.271016+0000","last_became_active":"2023-12-20T04:42:47.170447+0000","last_became_peered":"2023-12-20T04:42:47.170447+0000","last_unstale":"2023-12-20T04:42:50.271016+0000","last_undegraded":"2023-12-20T04:42:50.271016+0000","last_fullsized":"2023-12-20T04:42:50.271016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:32:36.919150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271060+0000","last_change":"2023-12-20T04:42:47.161917+0000","last_active":"2023-12-20T04:42:50.271060+0000","last_peered":"2023-12-20T04:42:50.271060+0000","last_clean":"2023-12-20T04:42:50.271060+0000","last_became_active":"2023-12-20T04:42:47.161408+0000","last_became_peered":"2023-12-20T04:42:47.161408+0000","last_unstale":"2023-12-20T04:42:50.271060+0000","last_undegraded":"2023-12-20T04:42:50.271060+0000","last_fullsized":"2023-12-20T04:42:50.271060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:14.550271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271240+0000","last_change":"2023-12-20T04:42:47.170652+0000","last_active":"2023-12-20T04:42:50.271240+0000","last_peered":"2023-12-20T04:42:50.271240+0000","last_clean":"2023-12-20T04:42:50.271240+0000","last_became_active":"2023-12-20T04:42:47.169793+0000","last_became_peered":"2023-12-20T04:42:47.169793+0000","last_unstale":"2023-12-20T04:42:50.271240+0000","last_undegraded":"2023-12-20T04:42:50.271240+0000","last_fullsized":"2023-12-20T04:42:50.271240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:21:51.595583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.161981+0000","last_change":"2023-12-20T04:42:47.162013+0000","last_active":"2023-12-20T04:42:48.161981+0000","last_peered":"2023-12-20T04:42:48.161981+0000","last_clean":"2023-12-20T04:42:48.161981+0000","last_became_active":"2023-12-20T04:42:47.161508+0000","last_became_peered":"2023-12-20T04:42:47.161508+0000","last_unstale":"2023-12-20T04:42:48.161981+0000","last_undegraded":"2023-12-20T04:42:48.161981+0000","last_fullsized":"2023-12-20T04:42:48.161981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:32:36.919150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270807+0000","last_change":"2023-12-20T04:42:47.172593+0000","last_active":"2023-12-20T04:42:50.270807+0000","last_peered":"2023-12-20T04:42:50.270807+0000","last_clean":"2023-12-20T04:42:50.270807+0000","last_became_active":"2023-12-20T04:42:47.172365+0000","last_became_peered":"2023-12-20T04:42:47.172365+0000","last_unstale":"2023-12-20T04:42:50.270807+0000","last_undegraded":"2023-12-20T04:42:50.270807+0000","last_fullsized":"2023-12-20T04:42:50.270807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:43:18.176211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210109+0000","last_change":"2023-12-20T04:42:47.174800+0000","last_active":"2023-12-20T04:42:50.210109+0000","last_peered":"2023-12-20T04:42:50.210109+0000","last_clean":"2023-12-20T04:42:50.210109+0000","last_became_active":"2023-12-20T04:42:47.173945+0000","last_became_peered":"2023-12-20T04:42:47.173945+0000","last_unstale":"2023-12-20T04:42:50.210109+0000","last_undegraded":"2023-12-20T04:42:50.210109+0000","last_fullsized":"2023-12-20T04:42:50.210109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:06:51.757769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210076+0000","last_change":"2023-12-20T04:42:47.175065+0000","last_active":"2023-12-20T04:42:50.210076+0000","last_peered":"2023-12-20T04:42:50.210076+0000","last_clean":"2023-12-20T04:42:50.210076+0000","last_became_active":"2023-12-20T04:42:47.174727+0000","last_became_peered":"2023-12-20T04:42:47.174727+0000","last_unstale":"2023-12-20T04:42:50.210076+0000","last_undegraded":"2023-12-20T04:42:50.210076+0000","last_fullsized":"2023-12-20T04:42:50.210076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:26:45.550542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160074+0000","last_change":"2023-12-20T04:42:47.173698+0000","last_active":"2023-12-20T04:42:48.160074+0000","last_peered":"2023-12-20T04:42:48.160074+0000","last_clean":"2023-12-20T04:42:48.160074+0000","last_became_active":"2023-12-20T04:42:47.173475+0000","last_became_peered":"2023-12-20T04:42:47.173475+0000","last_unstale":"2023-12-20T04:42:48.160074+0000","last_undegraded":"2023-12-20T04:42:48.160074+0000","last_fullsized":"2023-12-20T04:42:48.160074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:51.333755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162603+0000","last_change":"2023-12-20T04:42:47.173376+0000","last_active":"2023-12-20T04:42:48.162603+0000","last_peered":"2023-12-20T04:42:48.162603+0000","last_clean":"2023-12-20T04:42:48.162603+0000","last_became_active":"2023-12-20T04:42:47.173161+0000","last_became_peered":"2023-12-20T04:42:47.173161+0000","last_unstale":"2023-12-20T04:42:48.162603+0000","last_undegraded":"2023-12-20T04:42:48.162603+0000","last_fullsized":"2023-12-20T04:42:48.162603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:36:59.141749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159777+0000","last_change":"2023-12-20T04:42:47.158093+0000","last_active":"2023-12-20T04:42:48.159777+0000","last_peered":"2023-12-20T04:42:48.159777+0000","last_clean":"2023-12-20T04:42:48.159777+0000","last_became_active":"2023-12-20T04:42:47.157875+0000","last_became_peered":"2023-12-20T04:42:47.157875+0000","last_unstale":"2023-12-20T04:42:48.159777+0000","last_undegraded":"2023-12-20T04:42:48.159777+0000","last_fullsized":"2023-12-20T04:42:48.159777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:16:25.525832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270765+0000","last_change":"2023-12-20T04:42:47.162450+0000","last_active":"2023-12-20T04:42:50.270765+0000","last_peered":"2023-12-20T04:42:50.270765+0000","last_clean":"2023-12-20T04:42:50.270765+0000","last_became_active":"2023-12-20T04:42:47.162241+0000","last_became_peered":"2023-12-20T04:42:47.162241+0000","last_unstale":"2023-12-20T04:42:50.270765+0000","last_undegraded":"2023-12-20T04:42:50.270765+0000","last_fullsized":"2023-12-20T04:42:50.270765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:06:51.757769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270959+0000","last_change":"2023-12-20T04:42:47.161716+0000","last_active":"2023-12-20T04:42:50.270959+0000","last_peered":"2023-12-20T04:42:50.270959+0000","last_clean":"2023-12-20T04:42:50.270959+0000","last_became_active":"2023-12-20T04:42:47.160957+0000","last_became_peered":"2023-12-20T04:42:47.160957+0000","last_unstale":"2023-12-20T04:42:50.270959+0000","last_undegraded":"2023-12-20T04:42:50.270959+0000","last_fullsized":"2023-12-20T04:42:50.270959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:19:34.422422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270634+0000","last_change":"2023-12-20T04:42:47.171037+0000","last_active":"2023-12-20T04:42:50.270634+0000","last_peered":"2023-12-20T04:42:50.270634+0000","last_clean":"2023-12-20T04:42:50.270634+0000","last_became_active":"2023-12-20T04:42:47.169708+0000","last_became_peered":"2023-12-20T04:42:47.169708+0000","last_unstale":"2023-12-20T04:42:50.270634+0000","last_undegraded":"2023-12-20T04:42:50.270634+0000","last_fullsized":"2023-12-20T04:42:50.270634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:21:51.595583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270756+0000","last_change":"2023-12-20T04:42:47.170134+0000","last_active":"2023-12-20T04:42:50.270756+0000","last_peered":"2023-12-20T04:42:50.270756+0000","last_clean":"2023-12-20T04:42:50.270756+0000","last_became_active":"2023-12-20T04:42:47.169981+0000","last_became_peered":"2023-12-20T04:42:47.169981+0000","last_unstale":"2023-12-20T04:42:50.270756+0000","last_undegraded":"2023-12-20T04:42:50.270756+0000","last_fullsized":"2023-12-20T04:42:50.270756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:36:27.559291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271028+0000","last_change":"2023-12-20T04:42:47.175894+0000","last_active":"2023-12-20T04:42:50.271028+0000","last_peered":"2023-12-20T04:42:50.271028+0000","last_clean":"2023-12-20T04:42:50.271028+0000","last_became_active":"2023-12-20T04:42:47.175537+0000","last_became_peered":"2023-12-20T04:42:47.175537+0000","last_unstale":"2023-12-20T04:42:50.271028+0000","last_undegraded":"2023-12-20T04:42:50.271028+0000","last_fullsized":"2023-12-20T04:42:50.271028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:30:36.340710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210255+0000","last_change":"2023-12-20T04:42:47.171952+0000","last_active":"2023-12-20T04:42:50.210255+0000","last_peered":"2023-12-20T04:42:50.210255+0000","last_clean":"2023-12-20T04:42:50.210255+0000","last_became_active":"2023-12-20T04:42:47.171750+0000","last_became_peered":"2023-12-20T04:42:47.171750+0000","last_unstale":"2023-12-20T04:42:50.210255+0000","last_undegraded":"2023-12-20T04:42:50.210255+0000","last_fullsized":"2023-12-20T04:42:50.210255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:35.275699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159981+0000","last_change":"2023-12-20T04:42:47.172461+0000","last_active":"2023-12-20T04:42:48.159981+0000","last_peered":"2023-12-20T04:42:48.159981+0000","last_clean":"2023-12-20T04:42:48.159981+0000","last_became_active":"2023-12-20T04:42:47.172294+0000","last_became_peered":"2023-12-20T04:42:47.172294+0000","last_unstale":"2023-12-20T04:42:48.159981+0000","last_undegraded":"2023-12-20T04:42:48.159981+0000","last_fullsized":"2023-12-20T04:42:48.159981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:35.275699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270887+0000","last_change":"2023-12-20T04:42:47.171292+0000","last_active":"2023-12-20T04:42:50.270887+0000","last_peered":"2023-12-20T04:42:50.270887+0000","last_clean":"2023-12-20T04:42:50.270887+0000","last_became_active":"2023-12-20T04:42:47.170762+0000","last_became_peered":"2023-12-20T04:42:47.170762+0000","last_unstale":"2023-12-20T04:42:50.270887+0000","last_undegraded":"2023-12-20T04:42:50.270887+0000","last_fullsized":"2023-12-20T04:42:50.270887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:36:59.141749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162359+0000","last_change":"2023-12-20T04:42:47.163401+0000","last_active":"2023-12-20T04:42:48.162359+0000","last_peered":"2023-12-20T04:42:48.162359+0000","last_clean":"2023-12-20T04:42:48.162359+0000","last_became_active":"2023-12-20T04:42:47.162913+0000","last_became_peered":"2023-12-20T04:42:47.162913+0000","last_unstale":"2023-12-20T04:42:48.162359+0000","last_undegraded":"2023-12-20T04:42:48.162359+0000","last_fullsized":"2023-12-20T04:42:48.162359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:26:45.550542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271131+0000","last_change":"2023-12-20T04:42:47.163326+0000","last_active":"2023-12-20T04:42:50.271131+0000","last_peered":"2023-12-20T04:42:50.271131+0000","last_clean":"2023-12-20T04:42:50.271131+0000","last_became_active":"2023-12-20T04:42:47.162735+0000","last_became_peered":"2023-12-20T04:42:47.162735+0000","last_unstale":"2023-12-20T04:42:50.271131+0000","last_undegraded":"2023-12-20T04:42:50.271131+0000","last_fullsized":"2023-12-20T04:42:50.271131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:25:43.498709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162147+0000","last_change":"2023-12-20T04:42:47.163875+0000","last_active":"2023-12-20T04:42:48.162147+0000","last_peered":"2023-12-20T04:42:48.162147+0000","last_clean":"2023-12-20T04:42:48.162147+0000","last_became_active":"2023-12-20T04:42:47.163660+0000","last_became_peered":"2023-12-20T04:42:47.163660+0000","last_unstale":"2023-12-20T04:42:48.162147+0000","last_undegraded":"2023-12-20T04:42:48.162147+0000","last_fullsized":"2023-12-20T04:42:48.162147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:44:36.145099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210189+0000","last_change":"2023-12-20T04:42:47.171538+0000","last_active":"2023-12-20T04:42:50.210189+0000","last_peered":"2023-12-20T04:42:50.210189+0000","last_clean":"2023-12-20T04:42:50.210189+0000","last_became_active":"2023-12-20T04:42:47.171331+0000","last_became_peered":"2023-12-20T04:42:47.171331+0000","last_unstale":"2023-12-20T04:42:50.210189+0000","last_undegraded":"2023-12-20T04:42:50.210189+0000","last_fullsized":"2023-12-20T04:42:50.210189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:06:04.707201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270540+0000","last_change":"2023-12-20T04:42:47.158991+0000","last_active":"2023-12-20T04:42:50.270540+0000","last_peered":"2023-12-20T04:42:50.270540+0000","last_clean":"2023-12-20T04:42:50.270540+0000","last_became_active":"2023-12-20T04:42:47.158764+0000","last_became_peered":"2023-12-20T04:42:47.158764+0000","last_unstale":"2023-12-20T04:42:50.270540+0000","last_undegraded":"2023-12-20T04:42:50.270540+0000","last_fullsized":"2023-12-20T04:42:50.270540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:44:36.145099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162479+0000","last_change":"2023-12-20T04:42:47.164066+0000","last_active":"2023-12-20T04:42:48.162479+0000","last_peered":"2023-12-20T04:42:48.162479+0000","last_clean":"2023-12-20T04:42:48.162479+0000","last_became_active":"2023-12-20T04:42:47.163199+0000","last_became_peered":"2023-12-20T04:42:47.163199+0000","last_unstale":"2023-12-20T04:42:48.162479+0000","last_undegraded":"2023-12-20T04:42:48.162479+0000","last_fullsized":"2023-12-20T04:42:48.162479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:06:51.757769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159867+0000","last_change":"2023-12-20T04:42:47.160204+0000","last_active":"2023-12-20T04:42:48.159867+0000","last_peered":"2023-12-20T04:42:48.159867+0000","last_clean":"2023-12-20T04:42:48.159867+0000","last_became_active":"2023-12-20T04:42:47.159938+0000","last_became_peered":"2023-12-20T04:42:47.159938+0000","last_unstale":"2023-12-20T04:42:48.159867+0000","last_undegraded":"2023-12-20T04:42:48.159867+0000","last_fullsized":"2023-12-20T04:42:48.159867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:44:36.145099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270898+0000","last_change":"2023-12-20T04:42:47.158942+0000","last_active":"2023-12-20T04:42:50.270898+0000","last_peered":"2023-12-20T04:42:50.270898+0000","last_clean":"2023-12-20T04:42:50.270898+0000","last_became_active":"2023-12-20T04:42:47.158714+0000","last_became_peered":"2023-12-20T04:42:47.158714+0000","last_unstale":"2023-12-20T04:42:50.270898+0000","last_undegraded":"2023-12-20T04:42:50.270898+0000","last_fullsized":"2023-12-20T04:42:50.270898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:05.054526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270809+0000","last_change":"2023-12-20T04:42:47.162973+0000","last_active":"2023-12-20T04:42:50.270809+0000","last_peered":"2023-12-20T04:42:50.270809+0000","last_clean":"2023-12-20T04:42:50.270809+0000","last_became_active":"2023-12-20T04:42:47.162767+0000","last_became_peered":"2023-12-20T04:42:47.162767+0000","last_unstale":"2023-12-20T04:42:50.270809+0000","last_undegraded":"2023-12-20T04:42:50.270809+0000","last_fullsized":"2023-12-20T04:42:50.270809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:51.333755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210131+0000","last_change":"2023-12-20T04:42:47.173155+0000","last_active":"2023-12-20T04:42:50.210131+0000","last_peered":"2023-12-20T04:42:50.210131+0000","last_clean":"2023-12-20T04:42:50.210131+0000","last_became_active":"2023-12-20T04:42:47.172736+0000","last_became_peered":"2023-12-20T04:42:47.172736+0000","last_unstale":"2023-12-20T04:42:50.210131+0000","last_undegraded":"2023-12-20T04:42:50.210131+0000","last_fullsized":"2023-12-20T04:42:50.210131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:44:36.145099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160135+0000","last_change":"2023-12-20T04:42:47.162810+0000","last_active":"2023-12-20T04:42:48.160135+0000","last_peered":"2023-12-20T04:42:48.160135+0000","last_clean":"2023-12-20T04:42:48.160135+0000","last_became_active":"2023-12-20T04:42:47.162466+0000","last_became_peered":"2023-12-20T04:42:47.162466+0000","last_unstale":"2023-12-20T04:42:48.160135+0000","last_undegraded":"2023-12-20T04:42:48.160135+0000","last_fullsized":"2023-12-20T04:42:48.160135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:07.145100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.176214+0000","last_change":"2023-12-20T04:42:46.820730+0000","last_active":"2023-12-20T04:42:47.176214+0000","last_peered":"2023-12-20T04:42:47.176214+0000","last_clean":"2023-12-20T04:42:47.176214+0000","last_became_active":"2023-12-20T04:42:46.820359+0000","last_became_peered":"2023-12-20T04:42:46.820359+0000","last_unstale":"2023-12-20T04:42:47.176214+0000","last_undegraded":"2023-12-20T04:42:47.176214+0000","last_fullsized":"2023-12-20T04:42:47.176214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:31:43.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159914+0000","last_change":"2023-12-20T04:42:47.162872+0000","last_active":"2023-12-20T04:42:48.159914+0000","last_peered":"2023-12-20T04:42:48.159914+0000","last_clean":"2023-12-20T04:42:48.159914+0000","last_became_active":"2023-12-20T04:42:47.162666+0000","last_became_peered":"2023-12-20T04:42:47.162666+0000","last_unstale":"2023-12-20T04:42:48.159914+0000","last_undegraded":"2023-12-20T04:42:48.159914+0000","last_fullsized":"2023-12-20T04:42:48.159914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:06:04.707201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.171213+0000","last_change":"2023-12-20T04:42:46.824209+0000","last_active":"2023-12-20T04:42:47.171213+0000","last_peered":"2023-12-20T04:42:47.171213+0000","last_clean":"2023-12-20T04:42:47.171213+0000","last_became_active":"2023-12-20T04:42:46.823998+0000","last_became_peered":"2023-12-20T04:42:46.823998+0000","last_unstale":"2023-12-20T04:42:47.171213+0000","last_undegraded":"2023-12-20T04:42:47.171213+0000","last_fullsized":"2023-12-20T04:42:47.171213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.158401+0000","last_change":"2023-12-20T04:42:46.826875+0000","last_active":"2023-12-20T04:42:47.158401+0000","last_peered":"2023-12-20T04:42:47.158401+0000","last_clean":"2023-12-20T04:42:47.158401+0000","last_became_active":"2023-12-20T04:42:46.826615+0000","last_became_peered":"2023-12-20T04:42:46.826615+0000","last_unstale":"2023-12-20T04:42:47.158401+0000","last_undegraded":"2023-12-20T04:42:47.158401+0000","last_fullsized":"2023-12-20T04:42:47.158401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:16.851777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162225+0000","last_change":"2023-12-20T04:42:47.161608+0000","last_active":"2023-12-20T04:42:48.162225+0000","last_peered":"2023-12-20T04:42:48.162225+0000","last_clean":"2023-12-20T04:42:48.162225+0000","last_became_active":"2023-12-20T04:42:47.161405+0000","last_became_peered":"2023-12-20T04:42:47.161405+0000","last_unstale":"2023-12-20T04:42:48.162225+0000","last_undegraded":"2023-12-20T04:42:48.162225+0000","last_fullsized":"2023-12-20T04:42:48.162225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:35.275699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.156329+0000","last_change":"2023-12-20T04:42:46.818215+0000","last_active":"2023-12-20T04:42:47.156329+0000","last_peered":"2023-12-20T04:42:47.156329+0000","last_clean":"2023-12-20T04:42:47.156329+0000","last_became_active":"2023-12-20T04:42:46.817966+0000","last_became_peered":"2023-12-20T04:42:46.817966+0000","last_unstale":"2023-12-20T04:42:47.156329+0000","last_undegraded":"2023-12-20T04:42:47.156329+0000","last_fullsized":"2023-12-20T04:42:47.156329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270511+0000","last_change":"2023-12-20T04:42:47.162162+0000","last_active":"2023-12-20T04:42:50.270511+0000","last_peered":"2023-12-20T04:42:50.270511+0000","last_clean":"2023-12-20T04:42:50.270511+0000","last_became_active":"2023-12-20T04:42:47.161952+0000","last_became_peered":"2023-12-20T04:42:47.161952+0000","last_unstale":"2023-12-20T04:42:50.270511+0000","last_undegraded":"2023-12-20T04:42:50.270511+0000","last_fullsized":"2023-12-20T04:42:50.270511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:16:25.525832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.168131+0000","last_change":"2023-12-20T04:42:46.827199+0000","last_active":"2023-12-20T04:42:47.168131+0000","last_peered":"2023-12-20T04:42:47.168131+0000","last_clean":"2023-12-20T04:42:47.168131+0000","last_became_active":"2023-12-20T04:42:46.826970+0000","last_became_peered":"2023-12-20T04:42:46.826970+0000","last_unstale":"2023-12-20T04:42:47.168131+0000","last_undegraded":"2023-12-20T04:42:47.168131+0000","last_fullsized":"2023-12-20T04:42:47.168131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270793+0000","last_change":"2023-12-20T04:42:47.171167+0000","last_active":"2023-12-20T04:42:50.270793+0000","last_peered":"2023-12-20T04:42:50.270793+0000","last_clean":"2023-12-20T04:42:50.270793+0000","last_became_active":"2023-12-20T04:42:47.170353+0000","last_became_peered":"2023-12-20T04:42:47.170353+0000","last_unstale":"2023-12-20T04:42:50.270793+0000","last_undegraded":"2023-12-20T04:42:50.270793+0000","last_fullsized":"2023-12-20T04:42:50.270793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:56:01.988189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.158781+0000","last_change":"2023-12-20T04:42:46.826890+0000","last_active":"2023-12-20T04:42:47.158781+0000","last_peered":"2023-12-20T04:42:47.158781+0000","last_clean":"2023-12-20T04:42:47.158781+0000","last_became_active":"2023-12-20T04:42:46.826678+0000","last_became_peered":"2023-12-20T04:42:46.826678+0000","last_unstale":"2023-12-20T04:42:47.158781+0000","last_undegraded":"2023-12-20T04:42:47.158781+0000","last_fullsized":"2023-12-20T04:42:47.158781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160052+0000","last_change":"2023-12-20T04:42:47.163479+0000","last_active":"2023-12-20T04:42:48.160052+0000","last_peered":"2023-12-20T04:42:48.160052+0000","last_clean":"2023-12-20T04:42:48.160052+0000","last_became_active":"2023-12-20T04:42:47.163153+0000","last_became_peered":"2023-12-20T04:42:47.163153+0000","last_unstale":"2023-12-20T04:42:48.160052+0000","last_undegraded":"2023-12-20T04:42:48.160052+0000","last_fullsized":"2023-12-20T04:42:48.160052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:06:20.064610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.168914+0000","last_change":"2023-12-20T04:42:46.817481+0000","last_active":"2023-12-20T04:42:47.168914+0000","last_peered":"2023-12-20T04:42:47.168914+0000","last_clean":"2023-12-20T04:42:47.168914+0000","last_became_active":"2023-12-20T04:42:46.817263+0000","last_became_peered":"2023-12-20T04:42:46.817263+0000","last_unstale":"2023-12-20T04:42:47.168914+0000","last_undegraded":"2023-12-20T04:42:47.168914+0000","last_fullsized":"2023-12-20T04:42:47.168914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159913+0000","last_change":"2023-12-20T04:42:47.172460+0000","last_active":"2023-12-20T04:42:48.159913+0000","last_peered":"2023-12-20T04:42:48.159913+0000","last_clean":"2023-12-20T04:42:48.159913+0000","last_became_active":"2023-12-20T04:42:47.172208+0000","last_became_peered":"2023-12-20T04:42:47.172208+0000","last_unstale":"2023-12-20T04:42:48.159913+0000","last_undegraded":"2023-12-20T04:42:48.159913+0000","last_fullsized":"2023-12-20T04:42:48.159913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:36:27.559291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.177027+0000","last_change":"2023-12-20T04:42:46.826412+0000","last_active":"2023-12-20T04:42:47.177027+0000","last_peered":"2023-12-20T04:42:47.177027+0000","last_clean":"2023-12-20T04:42:47.177027+0000","last_became_active":"2023-12-20T04:42:46.826121+0000","last_became_peered":"2023-12-20T04:42:46.826121+0000","last_unstale":"2023-12-20T04:42:47.177027+0000","last_undegraded":"2023-12-20T04:42:47.177027+0000","last_fullsized":"2023-12-20T04:42:47.177027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270828+0000","last_change":"2023-12-20T04:42:47.168998+0000","last_active":"2023-12-20T04:42:50.270828+0000","last_peered":"2023-12-20T04:42:50.270828+0000","last_clean":"2023-12-20T04:42:50.270828+0000","last_became_active":"2023-12-20T04:42:47.168390+0000","last_became_peered":"2023-12-20T04:42:47.168390+0000","last_unstale":"2023-12-20T04:42:50.270828+0000","last_undegraded":"2023-12-20T04:42:50.270828+0000","last_fullsized":"2023-12-20T04:42:50.270828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:19:34.422422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.164299+0000","last_change":"2023-12-20T04:42:46.819640+0000","last_active":"2023-12-20T04:42:47.164299+0000","last_peered":"2023-12-20T04:42:47.164299+0000","last_clean":"2023-12-20T04:42:47.164299+0000","last_became_active":"2023-12-20T04:42:46.819432+0000","last_became_peered":"2023-12-20T04:42:46.819432+0000","last_unstale":"2023-12-20T04:42:47.164299+0000","last_undegraded":"2023-12-20T04:42:47.164299+0000","last_fullsized":"2023-12-20T04:42:47.164299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:45:29.219298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160133+0000","last_change":"2023-12-20T04:42:47.168232+0000","last_active":"2023-12-20T04:42:48.160133+0000","last_peered":"2023-12-20T04:42:48.160133+0000","last_clean":"2023-12-20T04:42:48.160133+0000","last_became_active":"2023-12-20T04:42:47.168055+0000","last_became_peered":"2023-12-20T04:42:47.168055+0000","last_unstale":"2023-12-20T04:42:48.160133+0000","last_undegraded":"2023-12-20T04:42:48.160133+0000","last_fullsized":"2023-12-20T04:42:48.160133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:56:01.988189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.157450+0000","last_change":"2023-12-20T04:42:46.816370+0000","last_active":"2023-12-20T04:42:47.157450+0000","last_peered":"2023-12-20T04:42:47.157450+0000","last_clean":"2023-12-20T04:42:47.157450+0000","last_became_active":"2023-12-20T04:42:46.816114+0000","last_became_peered":"2023-12-20T04:42:46.816114+0000","last_unstale":"2023-12-20T04:42:47.157450+0000","last_undegraded":"2023-12-20T04:42:47.157450+0000","last_fullsized":"2023-12-20T04:42:47.157450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271116+0000","last_change":"2023-12-20T04:42:47.171159+0000","last_active":"2023-12-20T04:42:50.271116+0000","last_peered":"2023-12-20T04:42:50.271116+0000","last_clean":"2023-12-20T04:42:50.271116+0000","last_became_active":"2023-12-20T04:42:47.170942+0000","last_became_peered":"2023-12-20T04:42:47.170942+0000","last_unstale":"2023-12-20T04:42:50.271116+0000","last_undegraded":"2023-12-20T04:42:50.271116+0000","last_fullsized":"2023-12-20T04:42:50.271116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:34.757109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.166819+0000","last_change":"2023-12-20T04:42:46.825683+0000","last_active":"2023-12-20T04:42:47.166819+0000","last_peered":"2023-12-20T04:42:47.166819+0000","last_clean":"2023-12-20T04:42:47.166819+0000","last_became_active":"2023-12-20T04:42:46.825470+0000","last_became_peered":"2023-12-20T04:42:46.825470+0000","last_unstale":"2023-12-20T04:42:47.166819+0000","last_undegraded":"2023-12-20T04:42:47.166819+0000","last_fullsized":"2023-12-20T04:42:47.166819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210262+0000","last_change":"2023-12-20T04:42:47.169217+0000","last_active":"2023-12-20T04:42:50.210262+0000","last_peered":"2023-12-20T04:42:50.210262+0000","last_clean":"2023-12-20T04:42:50.210262+0000","last_became_active":"2023-12-20T04:42:47.169014+0000","last_became_peered":"2023-12-20T04:42:47.169014+0000","last_unstale":"2023-12-20T04:42:50.210262+0000","last_undegraded":"2023-12-20T04:42:50.210262+0000","last_fullsized":"2023-12-20T04:42:50.210262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:16:25.525832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.178263+0000","last_change":"2023-12-20T04:42:46.817215+0000","last_active":"2023-12-20T04:42:47.178263+0000","last_peered":"2023-12-20T04:42:47.178263+0000","last_clean":"2023-12-20T04:42:47.178263+0000","last_became_active":"2023-12-20T04:42:46.816975+0000","last_became_peered":"2023-12-20T04:42:46.816975+0000","last_unstale":"2023-12-20T04:42:47.178263+0000","last_undegraded":"2023-12-20T04:42:47.178263+0000","last_fullsized":"2023-12-20T04:42:47.178263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271418+0000","last_change":"2023-12-20T04:42:47.170830+0000","last_active":"2023-12-20T04:42:50.271418+0000","last_peered":"2023-12-20T04:42:50.271418+0000","last_clean":"2023-12-20T04:42:50.271418+0000","last_became_active":"2023-12-20T04:42:47.170087+0000","last_became_peered":"2023-12-20T04:42:47.170087+0000","last_unstale":"2023-12-20T04:42:50.271418+0000","last_undegraded":"2023-12-20T04:42:50.271418+0000","last_fullsized":"2023-12-20T04:42:50.271418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:25:43.498709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.167518+0000","last_change":"2023-12-20T04:42:46.822400+0000","last_active":"2023-12-20T04:42:47.167518+0000","last_peered":"2023-12-20T04:42:47.167518+0000","last_clean":"2023-12-20T04:42:47.167518+0000","last_became_active":"2023-12-20T04:42:46.822183+0000","last_became_peered":"2023-12-20T04:42:46.822183+0000","last_unstale":"2023-12-20T04:42:47.167518+0000","last_undegraded":"2023-12-20T04:42:47.167518+0000","last_fullsized":"2023-12-20T04:42:47.167518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:46:37.703321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271233+0000","last_change":"2023-12-20T04:42:47.174998+0000","last_active":"2023-12-20T04:42:50.271233+0000","last_peered":"2023-12-20T04:42:50.271233+0000","last_clean":"2023-12-20T04:42:50.271233+0000","last_became_active":"2023-12-20T04:42:47.174732+0000","last_became_peered":"2023-12-20T04:42:47.174732+0000","last_unstale":"2023-12-20T04:42:50.271233+0000","last_undegraded":"2023-12-20T04:42:50.271233+0000","last_fullsized":"2023-12-20T04:42:50.271233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:26:45.550542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.176524+0000","last_change":"2023-12-20T04:42:46.819085+0000","last_active":"2023-12-20T04:42:47.176524+0000","last_peered":"2023-12-20T04:42:47.176524+0000","last_clean":"2023-12-20T04:42:47.176524+0000","last_became_active":"2023-12-20T04:42:46.818499+0000","last_became_peered":"2023-12-20T04:42:46.818499+0000","last_unstale":"2023-12-20T04:42:47.176524+0000","last_undegraded":"2023-12-20T04:42:47.176524+0000","last_fullsized":"2023-12-20T04:42:47.176524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270918+0000","last_change":"2023-12-20T04:42:47.175762+0000","last_active":"2023-12-20T04:42:50.270918+0000","last_peered":"2023-12-20T04:42:50.270918+0000","last_clean":"2023-12-20T04:42:50.270918+0000","last_became_active":"2023-12-20T04:42:47.175199+0000","last_became_peered":"2023-12-20T04:42:47.175199+0000","last_unstale":"2023-12-20T04:42:50.270918+0000","last_undegraded":"2023-12-20T04:42:50.270918+0000","last_fullsized":"2023-12-20T04:42:50.270918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:14.550271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.165334+0000","last_change":"2023-12-20T04:42:46.817202+0000","last_active":"2023-12-20T04:42:47.165334+0000","last_peered":"2023-12-20T04:42:47.165334+0000","last_clean":"2023-12-20T04:42:47.165334+0000","last_became_active":"2023-12-20T04:42:46.817002+0000","last_became_peered":"2023-12-20T04:42:46.817002+0000","last_unstale":"2023-12-20T04:42:47.165334+0000","last_undegraded":"2023-12-20T04:42:47.165334+0000","last_fullsized":"2023-12-20T04:42:47.165334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270972+0000","last_change":"2023-12-20T04:42:47.161745+0000","last_active":"2023-12-20T04:42:50.270972+0000","last_peered":"2023-12-20T04:42:50.270972+0000","last_clean":"2023-12-20T04:42:50.270972+0000","last_became_active":"2023-12-20T04:42:47.161525+0000","last_became_peered":"2023-12-20T04:42:47.161525+0000","last_unstale":"2023-12-20T04:42:50.270972+0000","last_undegraded":"2023-12-20T04:42:50.270972+0000","last_fullsized":"2023-12-20T04:42:50.270972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:06:04.707201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.156445+0000","last_change":"2023-12-20T04:42:46.819196+0000","last_active":"2023-12-20T04:42:47.156445+0000","last_peered":"2023-12-20T04:42:47.156445+0000","last_clean":"2023-12-20T04:42:47.156445+0000","last_became_active":"2023-12-20T04:42:46.818898+0000","last_became_peered":"2023-12-20T04:42:46.818898+0000","last_unstale":"2023-12-20T04:42:47.156445+0000","last_undegraded":"2023-12-20T04:42:47.156445+0000","last_fullsized":"2023-12-20T04:42:47.156445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271496+0000","last_change":"2023-12-20T04:42:47.173543+0000","last_active":"2023-12-20T04:42:50.271496+0000","last_peered":"2023-12-20T04:42:50.271496+0000","last_clean":"2023-12-20T04:42:50.271496+0000","last_became_active":"2023-12-20T04:42:47.173310+0000","last_became_peered":"2023-12-20T04:42:47.173310+0000","last_unstale":"2023-12-20T04:42:50.271496+0000","last_undegraded":"2023-12-20T04:42:50.271496+0000","last_fullsized":"2023-12-20T04:42:50.271496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:36:59.141749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.169782+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:42:47.169782+0000","last_peered":"2023-12-20T04:42:47.169782+0000","last_clean":"2023-12-20T04:42:47.169782+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:42:47.169782+0000","last_undegraded":"2023-12-20T04:42:47.169782+0000","last_fullsized":"2023-12-20T04:42:47.169782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.157704+0000","last_change":"2023-12-20T04:42:46.817346+0000","last_active":"2023-12-20T04:42:47.157704+0000","last_peered":"2023-12-20T04:42:47.157704+0000","last_clean":"2023-12-20T04:42:47.157704+0000","last_became_active":"2023-12-20T04:42:46.817109+0000","last_became_peered":"2023-12-20T04:42:46.817109+0000","last_unstale":"2023-12-20T04:42:47.157704+0000","last_undegraded":"2023-12-20T04:42:47.157704+0000","last_fullsized":"2023-12-20T04:42:47.157704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162197+0000","last_change":"2023-12-20T04:42:47.161230+0000","last_active":"2023-12-20T04:42:48.162197+0000","last_peered":"2023-12-20T04:42:48.162197+0000","last_clean":"2023-12-20T04:42:48.162197+0000","last_became_active":"2023-12-20T04:42:47.160935+0000","last_became_peered":"2023-12-20T04:42:47.160935+0000","last_unstale":"2023-12-20T04:42:48.162197+0000","last_undegraded":"2023-12-20T04:42:48.162197+0000","last_fullsized":"2023-12-20T04:42:48.162197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:55:31.909374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.169693+0000","last_change":"2023-12-20T04:42:46.822802+0000","last_active":"2023-12-20T04:42:47.169693+0000","last_peered":"2023-12-20T04:42:47.169693+0000","last_clean":"2023-12-20T04:42:47.169693+0000","last_became_active":"2023-12-20T04:42:46.821659+0000","last_became_peered":"2023-12-20T04:42:46.821659+0000","last_unstale":"2023-12-20T04:42:47.169693+0000","last_undegraded":"2023-12-20T04:42:47.169693+0000","last_fullsized":"2023-12-20T04:42:47.169693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160044+0000","last_change":"2023-12-20T04:42:47.161946+0000","last_active":"2023-12-20T04:42:48.160044+0000","last_peered":"2023-12-20T04:42:48.160044+0000","last_clean":"2023-12-20T04:42:48.160044+0000","last_became_active":"2023-12-20T04:42:47.161746+0000","last_became_peered":"2023-12-20T04:42:47.161746+0000","last_unstale":"2023-12-20T04:42:48.160044+0000","last_undegraded":"2023-12-20T04:42:48.160044+0000","last_fullsized":"2023-12-20T04:42:48.160044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:06:51.757769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.156531+0000","last_change":"2023-12-20T04:42:46.822874+0000","last_active":"2023-12-20T04:42:47.156531+0000","last_peered":"2023-12-20T04:42:47.156531+0000","last_clean":"2023-12-20T04:42:47.156531+0000","last_became_active":"2023-12-20T04:42:46.822617+0000","last_became_peered":"2023-12-20T04:42:46.822617+0000","last_unstale":"2023-12-20T04:42:47.156531+0000","last_undegraded":"2023-12-20T04:42:47.156531+0000","last_fullsized":"2023-12-20T04:42:47.156531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:16.851777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270598+0000","last_change":"2023-12-20T04:42:47.157587+0000","last_active":"2023-12-20T04:42:50.270598+0000","last_peered":"2023-12-20T04:42:50.270598+0000","last_clean":"2023-12-20T04:42:50.270598+0000","last_became_active":"2023-12-20T04:42:47.157401+0000","last_became_peered":"2023-12-20T04:42:47.157401+0000","last_unstale":"2023-12-20T04:42:50.270598+0000","last_undegraded":"2023-12-20T04:42:50.270598+0000","last_fullsized":"2023-12-20T04:42:50.270598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:06:04.707201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.158891+0000","last_change":"2023-12-20T04:42:46.816516+0000","last_active":"2023-12-20T04:42:47.158891+0000","last_peered":"2023-12-20T04:42:47.158891+0000","last_clean":"2023-12-20T04:42:47.158891+0000","last_became_active":"2023-12-20T04:42:46.816286+0000","last_became_peered":"2023-12-20T04:42:46.816286+0000","last_unstale":"2023-12-20T04:42:47.158891+0000","last_undegraded":"2023-12-20T04:42:47.158891+0000","last_fullsized":"2023-12-20T04:42:47.158891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160017+0000","last_change":"2023-12-20T04:42:47.163376+0000","last_active":"2023-12-20T04:42:48.160017+0000","last_peered":"2023-12-20T04:42:48.160017+0000","last_clean":"2023-12-20T04:42:48.160017+0000","last_became_active":"2023-12-20T04:42:47.163133+0000","last_became_peered":"2023-12-20T04:42:47.163133+0000","last_unstale":"2023-12-20T04:42:48.160017+0000","last_undegraded":"2023-12-20T04:42:48.160017+0000","last_fullsized":"2023-12-20T04:42:48.160017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:26.441913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.153830+0000","last_change":"2023-12-20T04:42:46.820405+0000","last_active":"2023-12-20T04:42:47.153830+0000","last_peered":"2023-12-20T04:42:47.153830+0000","last_clean":"2023-12-20T04:42:47.153830+0000","last_became_active":"2023-12-20T04:42:46.820205+0000","last_became_peered":"2023-12-20T04:42:46.820205+0000","last_unstale":"2023-12-20T04:42:47.153830+0000","last_undegraded":"2023-12-20T04:42:47.153830+0000","last_fullsized":"2023-12-20T04:42:47.153830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271250+0000","last_change":"2023-12-20T04:42:47.163460+0000","last_active":"2023-12-20T04:42:50.271250+0000","last_peered":"2023-12-20T04:42:50.271250+0000","last_clean":"2023-12-20T04:42:50.271250+0000","last_became_active":"2023-12-20T04:42:47.163064+0000","last_became_peered":"2023-12-20T04:42:47.163064+0000","last_unstale":"2023-12-20T04:42:50.271250+0000","last_undegraded":"2023-12-20T04:42:50.271250+0000","last_fullsized":"2023-12-20T04:42:50.271250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:35.275699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.169599+0000","last_change":"2023-12-20T04:42:46.824778+0000","last_active":"2023-12-20T04:42:47.169599+0000","last_peered":"2023-12-20T04:42:47.169599+0000","last_clean":"2023-12-20T04:42:47.169599+0000","last_became_active":"2023-12-20T04:42:46.824553+0000","last_became_peered":"2023-12-20T04:42:46.824553+0000","last_unstale":"2023-12-20T04:42:47.169599+0000","last_undegraded":"2023-12-20T04:42:47.169599+0000","last_fullsized":"2023-12-20T04:42:47.169599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270687+0000","last_change":"2023-12-20T04:42:47.158315+0000","last_active":"2023-12-20T04:42:50.270687+0000","last_peered":"2023-12-20T04:42:50.270687+0000","last_clean":"2023-12-20T04:42:50.270687+0000","last_became_active":"2023-12-20T04:42:47.157906+0000","last_became_peered":"2023-12-20T04:42:47.157906+0000","last_unstale":"2023-12-20T04:42:50.270687+0000","last_undegraded":"2023-12-20T04:42:50.270687+0000","last_fullsized":"2023-12-20T04:42:50.270687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:22.324414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270691+0000","last_change":"2023-12-20T04:42:46.825192+0000","last_active":"2023-12-20T04:42:50.270691+0000","last_peered":"2023-12-20T04:42:50.270691+0000","last_clean":"2023-12-20T04:42:50.270691+0000","last_became_active":"2023-12-20T04:42:46.825028+0000","last_became_peered":"2023-12-20T04:42:46.825028+0000","last_unstale":"2023-12-20T04:42:50.270691+0000","last_undegraded":"2023-12-20T04:42:50.270691+0000","last_fullsized":"2023-12-20T04:42:50.270691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162117+0000","last_change":"2023-12-20T04:42:47.169513+0000","last_active":"2023-12-20T04:42:48.162117+0000","last_peered":"2023-12-20T04:42:48.162117+0000","last_clean":"2023-12-20T04:42:48.162117+0000","last_became_active":"2023-12-20T04:42:47.169369+0000","last_became_peered":"2023-12-20T04:42:47.169369+0000","last_unstale":"2023-12-20T04:42:48.162117+0000","last_undegraded":"2023-12-20T04:42:48.162117+0000","last_fullsized":"2023-12-20T04:42:48.162117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:22.324414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.172956+0000","last_change":"2023-12-20T04:42:46.825085+0000","last_active":"2023-12-20T04:42:47.172956+0000","last_peered":"2023-12-20T04:42:47.172956+0000","last_clean":"2023-12-20T04:42:47.172956+0000","last_became_active":"2023-12-20T04:42:46.824862+0000","last_became_peered":"2023-12-20T04:42:46.824862+0000","last_unstale":"2023-12-20T04:42:47.172956+0000","last_undegraded":"2023-12-20T04:42:47.172956+0000","last_fullsized":"2023-12-20T04:42:47.172956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159882+0000","last_change":"2023-12-20T04:42:47.156391+0000","last_active":"2023-12-20T04:42:48.159882+0000","last_peered":"2023-12-20T04:42:48.159882+0000","last_clean":"2023-12-20T04:42:48.159882+0000","last_became_active":"2023-12-20T04:42:47.156193+0000","last_became_peered":"2023-12-20T04:42:47.156193+0000","last_unstale":"2023-12-20T04:42:48.159882+0000","last_undegraded":"2023-12-20T04:42:48.159882+0000","last_fullsized":"2023-12-20T04:42:48.159882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:40:53.166559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.167542+0000","last_change":"2023-12-20T04:42:46.823814+0000","last_active":"2023-12-20T04:42:47.167542+0000","last_peered":"2023-12-20T04:42:47.167542+0000","last_clean":"2023-12-20T04:42:47.167542+0000","last_became_active":"2023-12-20T04:42:46.823599+0000","last_became_peered":"2023-12-20T04:42:46.823599+0000","last_unstale":"2023-12-20T04:42:47.167542+0000","last_undegraded":"2023-12-20T04:42:47.167542+0000","last_fullsized":"2023-12-20T04:42:47.167542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160182+0000","last_change":"2023-12-20T04:42:47.163562+0000","last_active":"2023-12-20T04:42:48.160182+0000","last_peered":"2023-12-20T04:42:48.160182+0000","last_clean":"2023-12-20T04:42:48.160182+0000","last_became_active":"2023-12-20T04:42:47.161870+0000","last_became_peered":"2023-12-20T04:42:47.161870+0000","last_unstale":"2023-12-20T04:42:48.160182+0000","last_undegraded":"2023-12-20T04:42:48.160182+0000","last_fullsized":"2023-12-20T04:42:48.160182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:57.927799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.153758+0000","last_change":"2023-12-20T04:42:46.819894+0000","last_active":"2023-12-20T04:42:47.153758+0000","last_peered":"2023-12-20T04:42:47.153758+0000","last_clean":"2023-12-20T04:42:47.153758+0000","last_became_active":"2023-12-20T04:42:46.819686+0000","last_became_peered":"2023-12-20T04:42:46.819686+0000","last_unstale":"2023-12-20T04:42:47.153758+0000","last_undegraded":"2023-12-20T04:42:47.153758+0000","last_fullsized":"2023-12-20T04:42:47.153758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162110+0000","last_change":"2023-12-20T04:42:47.158866+0000","last_active":"2023-12-20T04:42:48.162110+0000","last_peered":"2023-12-20T04:42:48.162110+0000","last_clean":"2023-12-20T04:42:48.162110+0000","last_became_active":"2023-12-20T04:42:47.158669+0000","last_became_peered":"2023-12-20T04:42:47.158669+0000","last_unstale":"2023-12-20T04:42:48.162110+0000","last_undegraded":"2023-12-20T04:42:48.162110+0000","last_fullsized":"2023-12-20T04:42:48.162110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:40:53.166559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.153743+0000","last_change":"2023-12-20T04:42:46.817033+0000","last_active":"2023-12-20T04:42:47.153743+0000","last_peered":"2023-12-20T04:42:47.153743+0000","last_clean":"2023-12-20T04:42:47.153743+0000","last_became_active":"2023-12-20T04:42:46.816816+0000","last_became_peered":"2023-12-20T04:42:46.816816+0000","last_unstale":"2023-12-20T04:42:47.153743+0000","last_undegraded":"2023-12-20T04:42:47.153743+0000","last_fullsized":"2023-12-20T04:42:47.153743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162532+0000","last_change":"2023-12-20T04:42:47.162339+0000","last_active":"2023-12-20T04:42:48.162532+0000","last_peered":"2023-12-20T04:42:48.162532+0000","last_clean":"2023-12-20T04:42:48.162532+0000","last_became_active":"2023-12-20T04:42:47.161781+0000","last_became_peered":"2023-12-20T04:42:47.161781+0000","last_unstale":"2023-12-20T04:42:48.162532+0000","last_undegraded":"2023-12-20T04:42:48.162532+0000","last_fullsized":"2023-12-20T04:42:48.162532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:23:36.035902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.174419+0000","last_change":"2023-12-20T04:42:46.822584+0000","last_active":"2023-12-20T04:42:47.174419+0000","last_peered":"2023-12-20T04:42:47.174419+0000","last_clean":"2023-12-20T04:42:47.174419+0000","last_became_active":"2023-12-20T04:42:46.821836+0000","last_became_peered":"2023-12-20T04:42:46.821836+0000","last_unstale":"2023-12-20T04:42:47.174419+0000","last_undegraded":"2023-12-20T04:42:47.174419+0000","last_fullsized":"2023-12-20T04:42:47.174419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210128+0000","last_change":"2023-12-20T04:42:47.168746+0000","last_active":"2023-12-20T04:42:50.210128+0000","last_peered":"2023-12-20T04:42:50.210128+0000","last_clean":"2023-12-20T04:42:50.210128+0000","last_became_active":"2023-12-20T04:42:47.168532+0000","last_became_peered":"2023-12-20T04:42:47.168532+0000","last_unstale":"2023-12-20T04:42:50.210128+0000","last_undegraded":"2023-12-20T04:42:50.210128+0000","last_fullsized":"2023-12-20T04:42:50.210128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:22.324414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271029+0000","last_change":"2023-12-20T04:42:47.165381+0000","last_active":"2023-12-20T04:42:50.271029+0000","last_peered":"2023-12-20T04:42:50.271029+0000","last_clean":"2023-12-20T04:42:50.271029+0000","last_became_active":"2023-12-20T04:42:47.165153+0000","last_became_peered":"2023-12-20T04:42:47.165153+0000","last_unstale":"2023-12-20T04:42:50.271029+0000","last_undegraded":"2023-12-20T04:42:50.271029+0000","last_fullsized":"2023-12-20T04:42:50.271029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:34.757109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.173061+0000","last_change":"2023-12-20T04:42:46.823242+0000","last_active":"2023-12-20T04:42:47.173061+0000","last_peered":"2023-12-20T04:42:47.173061+0000","last_clean":"2023-12-20T04:42:47.173061+0000","last_became_active":"2023-12-20T04:42:46.823034+0000","last_became_peered":"2023-12-20T04:42:46.823034+0000","last_unstale":"2023-12-20T04:42:47.173061+0000","last_undegraded":"2023-12-20T04:42:47.173061+0000","last_fullsized":"2023-12-20T04:42:47.173061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:50.327147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271160+0000","last_change":"2023-12-20T04:42:47.166605+0000","last_active":"2023-12-20T04:42:50.271160+0000","last_peered":"2023-12-20T04:42:50.271160+0000","last_clean":"2023-12-20T04:42:50.271160+0000","last_became_active":"2023-12-20T04:42:47.165776+0000","last_became_peered":"2023-12-20T04:42:47.165776+0000","last_unstale":"2023-12-20T04:42:50.271160+0000","last_undegraded":"2023-12-20T04:42:50.271160+0000","last_fullsized":"2023-12-20T04:42:50.271160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:58:34.559072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.172428+0000","last_change":"2023-12-20T04:42:46.826590+0000","last_active":"2023-12-20T04:42:47.172428+0000","last_peered":"2023-12-20T04:42:47.172428+0000","last_clean":"2023-12-20T04:42:47.172428+0000","last_became_active":"2023-12-20T04:42:46.826364+0000","last_became_peered":"2023-12-20T04:42:46.826364+0000","last_unstale":"2023-12-20T04:42:47.172428+0000","last_undegraded":"2023-12-20T04:42:47.172428+0000","last_fullsized":"2023-12-20T04:42:47.172428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:57:22.907798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159966+0000","last_change":"2023-12-20T04:42:47.159221+0000","last_active":"2023-12-20T04:42:48.159966+0000","last_peered":"2023-12-20T04:42:48.159966+0000","last_clean":"2023-12-20T04:42:48.159966+0000","last_became_active":"2023-12-20T04:42:47.159003+0000","last_became_peered":"2023-12-20T04:42:47.159003+0000","last_unstale":"2023-12-20T04:42:48.159966+0000","last_undegraded":"2023-12-20T04:42:48.159966+0000","last_fullsized":"2023-12-20T04:42:48.159966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:55:31.909374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.176324+0000","last_change":"2023-12-20T04:42:46.823580+0000","last_active":"2023-12-20T04:42:47.176324+0000","last_peered":"2023-12-20T04:42:47.176324+0000","last_clean":"2023-12-20T04:42:47.176324+0000","last_became_active":"2023-12-20T04:42:46.822923+0000","last_became_peered":"2023-12-20T04:42:46.822923+0000","last_unstale":"2023-12-20T04:42:47.176324+0000","last_undegraded":"2023-12-20T04:42:47.176324+0000","last_fullsized":"2023-12-20T04:42:47.176324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162163+0000","last_change":"2023-12-20T04:42:47.173382+0000","last_active":"2023-12-20T04:42:48.162163+0000","last_peered":"2023-12-20T04:42:48.162163+0000","last_clean":"2023-12-20T04:42:48.162163+0000","last_became_active":"2023-12-20T04:42:47.173150+0000","last_became_peered":"2023-12-20T04:42:47.173150+0000","last_unstale":"2023-12-20T04:42:48.162163+0000","last_undegraded":"2023-12-20T04:42:48.162163+0000","last_fullsized":"2023-12-20T04:42:48.162163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:05.054526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.167668+0000","last_change":"2023-12-20T04:42:46.821155+0000","last_active":"2023-12-20T04:42:47.167668+0000","last_peered":"2023-12-20T04:42:47.167668+0000","last_clean":"2023-12-20T04:42:47.167668+0000","last_became_active":"2023-12-20T04:42:46.820776+0000","last_became_peered":"2023-12-20T04:42:46.820776+0000","last_unstale":"2023-12-20T04:42:47.167668+0000","last_undegraded":"2023-12-20T04:42:47.167668+0000","last_fullsized":"2023-12-20T04:42:47.167668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:46:37.703321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929102,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338256,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]}],"pool_statfs":[]}} 2023-12-20T04:42:58.700 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:42:58.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.833+0000 7fdd7ba69640 1 Processor -- start 2023-12-20T04:42:58.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.834+0000 7fdd7ba69640 1 -- start start 2023-12-20T04:42:58.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.834+0000 7fdd7ba69640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd740d08c0 0x7fdd7406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:58.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.834+0000 7fdd7ba69640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd740cd030 0x7fdd7415f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:58.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.834+0000 7fdd7ba69640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdd7415f9c0 0x7fdd7415b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:58.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.834+0000 7fdd7ba69640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd7415f060 con 0x7fdd740cd030 2023-12-20T04:42:58.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.834+0000 7fdd7ba69640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd7406fff0 con 0x7fdd7415f9c0 2023-12-20T04:42:58.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.834+0000 7fdd7ba69640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd7406f750 con 0x7fdd740d08c0 2023-12-20T04:42:58.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.835+0000 7fdd79004640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd740cd030 0x7fdd7415f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:58.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.835+0000 7fdd79805640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd740d08c0 0x7fdd7406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:58.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.835+0000 7fdd7a006640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdd7415f9c0 0x7fdd7415b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:58.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.835+0000 7fdd79004640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd740cd030 0x7fdd7415f480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60068/0 (socket says 172.21.15.132:60068) 2023-12-20T04:42:58.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.835+0000 7fdd79805640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd740d08c0 0x7fdd7406f0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:55598/0 (socket says 172.21.15.132:55598) 2023-12-20T04:42:58.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.835+0000 7fdd79004640 1 -- 172.21.15.132:0/2692367145 learned_addr learned my addr 172.21.15.132:0/2692367145 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:58.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.835+0000 7fdd79004640 1 -- 172.21.15.132:0/2692367145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd740d08c0 msgr2=0x7fdd7406f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:58.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.835+0000 7fdd79004640 1 --2- 172.21.15.132:0/2692367145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd740d08c0 0x7fdd7406f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.835+0000 7fdd79004640 1 -- 172.21.15.132:0/2692367145 >> v2:172.21.15.187:3300/0 conn(0x7fdd7415f9c0 msgr2=0x7fdd7415b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:58.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.835+0000 7fdd79004640 1 --2- 172.21.15.132:0/2692367145 >> v2:172.21.15.187:3300/0 conn(0x7fdd7415f9c0 0x7fdd7415b7d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.835+0000 7fdd79004640 1 -- 172.21.15.132:0/2692367145 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd7406fa30 con 0x7fdd740cd030 2023-12-20T04:42:58.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.836+0000 7fdd79004640 1 --2- 172.21.15.132:0/2692367145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd740cd030 0x7fdd7415f480 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdd7415ed00 tx=0x7fdd7002b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de819cb124a99489 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:58.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.836+0000 7fdd78803640 1 -- 172.21.15.132:0/2692367145 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70031750 con 0x7fdd740cd030 2023-12-20T04:42:58.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.836+0000 7fdd78803640 1 -- 172.21.15.132:0/2692367145 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd700318b0 con 0x7fdd740cd030 2023-12-20T04:42:58.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.836+0000 7fdd78803640 1 -- 172.21.15.132:0/2692367145 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd70031c40 con 0x7fdd740cd030 2023-12-20T04:42:58.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.836+0000 7fdd7ba69640 1 -- 172.21.15.132:0/2692367145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd740cd030 msgr2=0x7fdd7415f480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.836+0000 7fdd7ba69640 1 --2- 172.21.15.132:0/2692367145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd740cd030 0x7fdd7415f480 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fdd7415ed00 tx=0x7fdd7002b7f0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.836+0000 7fdd7ba69640 1 -- 172.21.15.132:0/2692367145 shutdown_connections 2023-12-20T04:42:58.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.836+0000 7fdd7ba69640 1 --2- 172.21.15.132:0/2692367145 >> v2:172.21.15.187:3300/0 conn(0x7fdd7415f9c0 0x7fdd7415b7d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.836+0000 7fdd7ba69640 1 --2- 172.21.15.132:0/2692367145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd740cd030 0x7fdd7415f480 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.836+0000 7fdd7ba69640 1 --2- 172.21.15.132:0/2692367145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd740d08c0 0x7fdd7406f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.836+0000 7fdd7ba69640 1 -- 172.21.15.132:0/2692367145 >> 172.21.15.132:0/2692367145 conn(0x7fdd740cd7b0 msgr2=0x7fdd740cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:58.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.837+0000 7fdd7ba69640 1 -- 172.21.15.132:0/2692367145 shutdown_connections 2023-12-20T04:42:58.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.837+0000 7fdd7ba69640 1 -- 172.21.15.132:0/2692367145 wait complete. 2023-12-20T04:42:58.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.838+0000 7fdd7ba69640 1 Processor -- start 2023-12-20T04:42:58.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.838+0000 7fdd7ba69640 1 -- start start 2023-12-20T04:42:58.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.838+0000 7fdd7ba69640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd740cd030 0x7fdd740b1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:58.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.838+0000 7fdd7ba69640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd740d08c0 0x7fdd740c4860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:58.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.838+0000 7fdd7ba69640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd7415f9c0 0x7fdd740c69e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:58.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.838+0000 7fdd7ba69640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd741565d0 con 0x7fdd740cd030 2023-12-20T04:42:58.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.838+0000 7fdd7ba69640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd740c5300 con 0x7fdd740d08c0 2023-12-20T04:42:58.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.838+0000 7fdd7ba69640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd74156820 con 0x7fdd7415f9c0 2023-12-20T04:42:58.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.838+0000 7fdd79805640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd740cd030 0x7fdd740b1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:58.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.838+0000 7fdd79805640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd740cd030 0x7fdd740b1ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60078/0 (socket says 172.21.15.132:60078) 2023-12-20T04:42:58.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.838+0000 7fdd79805640 1 -- 172.21.15.132:0/172871621 learned_addr learned my addr 172.21.15.132:0/172871621 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:58.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.839+0000 7fdd7a006640 1 --2- 172.21.15.132:0/172871621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd7415f9c0 0x7fdd740c69e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:58.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.839+0000 7fdd79004640 1 --2- 172.21.15.132:0/172871621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd740d08c0 0x7fdd740c4860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:58.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.839+0000 7fdd79805640 1 -- 172.21.15.132:0/172871621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd7415f9c0 msgr2=0x7fdd740c69e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.839+0000 7fdd79805640 1 --2- 172.21.15.132:0/172871621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd7415f9c0 0x7fdd740c69e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.839+0000 7fdd79805640 1 -- 172.21.15.132:0/172871621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd740d08c0 msgr2=0x7fdd740c4860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:58.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.839+0000 7fdd79805640 1 --2- 172.21.15.132:0/172871621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd740d08c0 0x7fdd740c4860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:58.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.839+0000 7fdd79805640 1 -- 172.21.15.132:0/172871621 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd700094d0 con 0x7fdd740cd030 2023-12-20T04:42:58.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.839+0000 7fdd79004640 1 --2- 172.21.15.132:0/172871621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd740d08c0 0x7fdd740c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:58.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.839+0000 7fdd79805640 1 --2- 172.21.15.132:0/172871621 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd740cd030 0x7fdd740b1ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdd6800e870 tx=0x7fdd6800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:58.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.839+0000 7fdd667fc640 1 -- 172.21.15.132:0/172871621 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6800ee60 con 0x7fdd740cd030 2023-12-20T04:42:58.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.839+0000 7fdd667fc640 1 -- 172.21.15.132:0/172871621 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd6800c940 con 0x7fdd740cd030 2023-12-20T04:42:58.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.839+0000 7fdd667fc640 1 -- 172.21.15.132:0/172871621 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd6800ccf0 con 0x7fdd740cd030 2023-12-20T04:42:58.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.839+0000 7fdd7ba69640 1 -- 172.21.15.132:0/172871621 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd74156b00 con 0x7fdd740cd030 2023-12-20T04:42:58.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.839+0000 7fdd7ba69640 1 -- 172.21.15.132:0/172871621 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd74151220 con 0x7fdd740cd030 2023-12-20T04:42:58.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.840+0000 7fdd7ba69640 1 -- 172.21.15.132:0/172871621 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd7404e840 con 0x7fdd740cd030 2023-12-20T04:42:58.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.840+0000 7fdd667fc640 1 -- 172.21.15.132:0/172871621 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdd68013470 con 0x7fdd740cd030 2023-12-20T04:42:58.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.841+0000 7fdd667fc640 1 --2- 172.21.15.132:0/172871621 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd5806a430 0x7fdd5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:58.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.841+0000 7fdd667fc640 1 -- 172.21.15.132:0/172871621 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd680888c0 con 0x7fdd740cd030 2023-12-20T04:42:58.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.841+0000 7fdd79004640 1 --2- 172.21.15.132:0/172871621 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd5806a430 0x7fdd5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:58.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.841+0000 7fdd79004640 1 --2- 172.21.15.132:0/172871621 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd5806a430 0x7fdd5806c8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdd70035000 tx=0x7fdd70008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:58.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:58.845+0000 7fdd667fc640 1 -- 172.21.15.132:0/172871621 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdd68053f70 con 0x7fdd740cd030 2023-12-20T04:42:59.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.009+0000 7fdd7ba69640 1 -- 172.21.15.132:0/172871621 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdd7406fd10 con 0x7fdd5806a430 2023-12-20T04:42:59.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.016+0000 7fdd667fc640 1 -- 172.21.15.132:0/172871621 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+260212 (secure 0 0 0) 0x7fdd70031b20 con 0x7fdd5806a430 2023-12-20T04:42:59.020 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:59.021 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:42:59.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.019+0000 7fdd7ba69640 1 -- 172.21.15.132:0/172871621 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd5806a430 msgr2=0x7fdd5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.019+0000 7fdd7ba69640 1 --2- 172.21.15.132:0/172871621 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd5806a430 0x7fdd5806c8f0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fdd70035000 tx=0x7fdd70008030 comp rx=0 tx=0).stop 2023-12-20T04:42:59.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.019+0000 7fdd7ba69640 1 -- 172.21.15.132:0/172871621 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd740cd030 msgr2=0x7fdd740b1ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.019+0000 7fdd7ba69640 1 --2- 172.21.15.132:0/172871621 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd740cd030 0x7fdd740b1ee0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fdd6800e870 tx=0x7fdd6800ed30 comp rx=0 tx=0).stop 2023-12-20T04:42:59.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.019+0000 7fdd7ba69640 1 -- 172.21.15.132:0/172871621 shutdown_connections 2023-12-20T04:42:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.019+0000 7fdd7ba69640 1 --2- 172.21.15.132:0/172871621 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd5806a430 0x7fdd5806c8f0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.019+0000 7fdd7ba69640 1 --2- 172.21.15.132:0/172871621 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd7415f9c0 0x7fdd740c69e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.019+0000 7fdd7ba69640 1 --2- 172.21.15.132:0/172871621 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd740d08c0 0x7fdd740c4860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.019+0000 7fdd7ba69640 1 --2- 172.21.15.132:0/172871621 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd740cd030 0x7fdd740b1ee0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.019+0000 7fdd7ba69640 1 -- 172.21.15.132:0/172871621 >> 172.21.15.132:0/172871621 conn(0x7fdd740cd7b0 msgr2=0x7fdd740cb550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.019+0000 7fdd7ba69640 1 -- 172.21.15.132:0/172871621 shutdown_connections 2023-12-20T04:42:59.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.019+0000 7fdd7ba69640 1 -- 172.21.15.132:0/172871621 wait complete. 2023-12-20T04:42:59.031 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2023-12-20T04:42:58.095257+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":1710,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560789,"statfs":{"total":1600000000,"available":1598248636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002308"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271408+0000","last_change":"2023-12-20T04:42:47.172892+0000","last_active":"2023-12-20T04:42:50.271408+0000","last_peered":"2023-12-20T04:42:50.271408+0000","last_clean":"2023-12-20T04:42:50.271408+0000","last_became_active":"2023-12-20T04:42:47.172487+0000","last_became_peered":"2023-12-20T04:42:47.172487+0000","last_unstale":"2023-12-20T04:42:50.271408+0000","last_undegraded":"2023-12-20T04:42:50.271408+0000","last_fullsized":"2023-12-20T04:42:50.271408+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:58:34.559072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270445+0000","last_change":"2023-12-20T04:42:47.157323+0000","last_active":"2023-12-20T04:42:50.270445+0000","last_peered":"2023-12-20T04:42:50.270445+0000","last_clean":"2023-12-20T04:42:50.270445+0000","last_became_active":"2023-12-20T04:42:47.157120+0000","last_became_peered":"2023-12-20T04:42:47.157120+0000","last_unstale":"2023-12-20T04:42:50.270445+0000","last_undegraded":"2023-12-20T04:42:50.270445+0000","last_fullsized":"2023-12-20T04:42:50.270445+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:56:01.988189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159802+0000","last_change":"2023-12-20T04:42:47.157566+0000","last_active":"2023-12-20T04:42:48.159802+0000","last_peered":"2023-12-20T04:42:48.159802+0000","last_clean":"2023-12-20T04:42:48.159802+0000","last_became_active":"2023-12-20T04:42:47.157364+0000","last_became_peered":"2023-12-20T04:42:47.157364+0000","last_unstale":"2023-12-20T04:42:48.159802+0000","last_undegraded":"2023-12-20T04:42:48.159802+0000","last_fullsized":"2023-12-20T04:42:48.159802+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:22.324414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270992+0000","last_change":"2023-12-20T04:42:47.162525+0000","last_active":"2023-12-20T04:42:50.270992+0000","last_peered":"2023-12-20T04:42:50.270992+0000","last_clean":"2023-12-20T04:42:50.270992+0000","last_became_active":"2023-12-20T04:42:47.162288+0000","last_became_peered":"2023-12-20T04:42:47.162288+0000","last_unstale":"2023-12-20T04:42:50.270992+0000","last_undegraded":"2023-12-20T04:42:50.270992+0000","last_fullsized":"2023-12-20T04:42:50.270992+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:43:18.176211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271016+0000","last_change":"2023-12-20T04:42:47.170675+0000","last_active":"2023-12-20T04:42:50.271016+0000","last_peered":"2023-12-20T04:42:50.271016+0000","last_clean":"2023-12-20T04:42:50.271016+0000","last_became_active":"2023-12-20T04:42:47.170447+0000","last_became_peered":"2023-12-20T04:42:47.170447+0000","last_unstale":"2023-12-20T04:42:50.271016+0000","last_undegraded":"2023-12-20T04:42:50.271016+0000","last_fullsized":"2023-12-20T04:42:50.271016+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:32:36.919150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271060+0000","last_change":"2023-12-20T04:42:47.161917+0000","last_active":"2023-12-20T04:42:50.271060+0000","last_peered":"2023-12-20T04:42:50.271060+0000","last_clean":"2023-12-20T04:42:50.271060+0000","last_became_active":"2023-12-20T04:42:47.161408+0000","last_became_peered":"2023-12-20T04:42:47.161408+0000","last_unstale":"2023-12-20T04:42:50.271060+0000","last_undegraded":"2023-12-20T04:42:50.271060+0000","last_fullsized":"2023-12-20T04:42:50.271060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:14.550271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271240+0000","last_change":"2023-12-20T04:42:47.170652+0000","last_active":"2023-12-20T04:42:50.271240+0000","last_peered":"2023-12-20T04:42:50.271240+0000","last_clean":"2023-12-20T04:42:50.271240+0000","last_became_active":"2023-12-20T04:42:47.169793+0000","last_became_peered":"2023-12-20T04:42:47.169793+0000","last_unstale":"2023-12-20T04:42:50.271240+0000","last_undegraded":"2023-12-20T04:42:50.271240+0000","last_fullsized":"2023-12-20T04:42:50.271240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:21:51.595583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.161981+0000","last_change":"2023-12-20T04:42:47.162013+0000","last_active":"2023-12-20T04:42:48.161981+0000","last_peered":"2023-12-20T04:42:48.161981+0000","last_clean":"2023-12-20T04:42:48.161981+0000","last_became_active":"2023-12-20T04:42:47.161508+0000","last_became_peered":"2023-12-20T04:42:47.161508+0000","last_unstale":"2023-12-20T04:42:48.161981+0000","last_undegraded":"2023-12-20T04:42:48.161981+0000","last_fullsized":"2023-12-20T04:42:48.161981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:32:36.919150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270807+0000","last_change":"2023-12-20T04:42:47.172593+0000","last_active":"2023-12-20T04:42:50.270807+0000","last_peered":"2023-12-20T04:42:50.270807+0000","last_clean":"2023-12-20T04:42:50.270807+0000","last_became_active":"2023-12-20T04:42:47.172365+0000","last_became_peered":"2023-12-20T04:42:47.172365+0000","last_unstale":"2023-12-20T04:42:50.270807+0000","last_undegraded":"2023-12-20T04:42:50.270807+0000","last_fullsized":"2023-12-20T04:42:50.270807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:43:18.176211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210109+0000","last_change":"2023-12-20T04:42:47.174800+0000","last_active":"2023-12-20T04:42:50.210109+0000","last_peered":"2023-12-20T04:42:50.210109+0000","last_clean":"2023-12-20T04:42:50.210109+0000","last_became_active":"2023-12-20T04:42:47.173945+0000","last_became_peered":"2023-12-20T04:42:47.173945+0000","last_unstale":"2023-12-20T04:42:50.210109+0000","last_undegraded":"2023-12-20T04:42:50.210109+0000","last_fullsized":"2023-12-20T04:42:50.210109+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:06:51.757769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210076+0000","last_change":"2023-12-20T04:42:47.175065+0000","last_active":"2023-12-20T04:42:50.210076+0000","last_peered":"2023-12-20T04:42:50.210076+0000","last_clean":"2023-12-20T04:42:50.210076+0000","last_became_active":"2023-12-20T04:42:47.174727+0000","last_became_peered":"2023-12-20T04:42:47.174727+0000","last_unstale":"2023-12-20T04:42:50.210076+0000","last_undegraded":"2023-12-20T04:42:50.210076+0000","last_fullsized":"2023-12-20T04:42:50.210076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:26:45.550542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160074+0000","last_change":"2023-12-20T04:42:47.173698+0000","last_active":"2023-12-20T04:42:48.160074+0000","last_peered":"2023-12-20T04:42:48.160074+0000","last_clean":"2023-12-20T04:42:48.160074+0000","last_became_active":"2023-12-20T04:42:47.173475+0000","last_became_peered":"2023-12-20T04:42:47.173475+0000","last_unstale":"2023-12-20T04:42:48.160074+0000","last_undegraded":"2023-12-20T04:42:48.160074+0000","last_fullsized":"2023-12-20T04:42:48.160074+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:51.333755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162603+0000","last_change":"2023-12-20T04:42:47.173376+0000","last_active":"2023-12-20T04:42:48.162603+0000","last_peered":"2023-12-20T04:42:48.162603+0000","last_clean":"2023-12-20T04:42:48.162603+0000","last_became_active":"2023-12-20T04:42:47.173161+0000","last_became_peered":"2023-12-20T04:42:47.173161+0000","last_unstale":"2023-12-20T04:42:48.162603+0000","last_undegraded":"2023-12-20T04:42:48.162603+0000","last_fullsized":"2023-12-20T04:42:48.162603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:36:59.141749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159777+0000","last_change":"2023-12-20T04:42:47.158093+0000","last_active":"2023-12-20T04:42:48.159777+0000","last_peered":"2023-12-20T04:42:48.159777+0000","last_clean":"2023-12-20T04:42:48.159777+0000","last_became_active":"2023-12-20T04:42:47.157875+0000","last_became_peered":"2023-12-20T04:42:47.157875+0000","last_unstale":"2023-12-20T04:42:48.159777+0000","last_undegraded":"2023-12-20T04:42:48.159777+0000","last_fullsized":"2023-12-20T04:42:48.159777+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:16:25.525832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270765+0000","last_change":"2023-12-20T04:42:47.162450+0000","last_active":"2023-12-20T04:42:50.270765+0000","last_peered":"2023-12-20T04:42:50.270765+0000","last_clean":"2023-12-20T04:42:50.270765+0000","last_became_active":"2023-12-20T04:42:47.162241+0000","last_became_peered":"2023-12-20T04:42:47.162241+0000","last_unstale":"2023-12-20T04:42:50.270765+0000","last_undegraded":"2023-12-20T04:42:50.270765+0000","last_fullsized":"2023-12-20T04:42:50.270765+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:06:51.757769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270959+0000","last_change":"2023-12-20T04:42:47.161716+0000","last_active":"2023-12-20T04:42:50.270959+0000","last_peered":"2023-12-20T04:42:50.270959+0000","last_clean":"2023-12-20T04:42:50.270959+0000","last_became_active":"2023-12-20T04:42:47.160957+0000","last_became_peered":"2023-12-20T04:42:47.160957+0000","last_unstale":"2023-12-20T04:42:50.270959+0000","last_undegraded":"2023-12-20T04:42:50.270959+0000","last_fullsized":"2023-12-20T04:42:50.270959+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:19:34.422422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270634+0000","last_change":"2023-12-20T04:42:47.171037+0000","last_active":"2023-12-20T04:42:50.270634+0000","last_peered":"2023-12-20T04:42:50.270634+0000","last_clean":"2023-12-20T04:42:50.270634+0000","last_became_active":"2023-12-20T04:42:47.169708+0000","last_became_peered":"2023-12-20T04:42:47.169708+0000","last_unstale":"2023-12-20T04:42:50.270634+0000","last_undegraded":"2023-12-20T04:42:50.270634+0000","last_fullsized":"2023-12-20T04:42:50.270634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:21:51.595583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270756+0000","last_change":"2023-12-20T04:42:47.170134+0000","last_active":"2023-12-20T04:42:50.270756+0000","last_peered":"2023-12-20T04:42:50.270756+0000","last_clean":"2023-12-20T04:42:50.270756+0000","last_became_active":"2023-12-20T04:42:47.169981+0000","last_became_peered":"2023-12-20T04:42:47.169981+0000","last_unstale":"2023-12-20T04:42:50.270756+0000","last_undegraded":"2023-12-20T04:42:50.270756+0000","last_fullsized":"2023-12-20T04:42:50.270756+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:36:27.559291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271028+0000","last_change":"2023-12-20T04:42:47.175894+0000","last_active":"2023-12-20T04:42:50.271028+0000","last_peered":"2023-12-20T04:42:50.271028+0000","last_clean":"2023-12-20T04:42:50.271028+0000","last_became_active":"2023-12-20T04:42:47.175537+0000","last_became_peered":"2023-12-20T04:42:47.175537+0000","last_unstale":"2023-12-20T04:42:50.271028+0000","last_undegraded":"2023-12-20T04:42:50.271028+0000","last_fullsized":"2023-12-20T04:42:50.271028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:30:36.340710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210255+0000","last_change":"2023-12-20T04:42:47.171952+0000","last_active":"2023-12-20T04:42:50.210255+0000","last_peered":"2023-12-20T04:42:50.210255+0000","last_clean":"2023-12-20T04:42:50.210255+0000","last_became_active":"2023-12-20T04:42:47.171750+0000","last_became_peered":"2023-12-20T04:42:47.171750+0000","last_unstale":"2023-12-20T04:42:50.210255+0000","last_undegraded":"2023-12-20T04:42:50.210255+0000","last_fullsized":"2023-12-20T04:42:50.210255+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:35.275699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159981+0000","last_change":"2023-12-20T04:42:47.172461+0000","last_active":"2023-12-20T04:42:48.159981+0000","last_peered":"2023-12-20T04:42:48.159981+0000","last_clean":"2023-12-20T04:42:48.159981+0000","last_became_active":"2023-12-20T04:42:47.172294+0000","last_became_peered":"2023-12-20T04:42:47.172294+0000","last_unstale":"2023-12-20T04:42:48.159981+0000","last_undegraded":"2023-12-20T04:42:48.159981+0000","last_fullsized":"2023-12-20T04:42:48.159981+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:35.275699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270887+0000","last_change":"2023-12-20T04:42:47.171292+0000","last_active":"2023-12-20T04:42:50.270887+0000","last_peered":"2023-12-20T04:42:50.270887+0000","last_clean":"2023-12-20T04:42:50.270887+0000","last_became_active":"2023-12-20T04:42:47.170762+0000","last_became_peered":"2023-12-20T04:42:47.170762+0000","last_unstale":"2023-12-20T04:42:50.270887+0000","last_undegraded":"2023-12-20T04:42:50.270887+0000","last_fullsized":"2023-12-20T04:42:50.270887+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:36:59.141749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162359+0000","last_change":"2023-12-20T04:42:47.163401+0000","last_active":"2023-12-20T04:42:48.162359+0000","last_peered":"2023-12-20T04:42:48.162359+0000","last_clean":"2023-12-20T04:42:48.162359+0000","last_became_active":"2023-12-20T04:42:47.162913+0000","last_became_peered":"2023-12-20T04:42:47.162913+0000","last_unstale":"2023-12-20T04:42:48.162359+0000","last_undegraded":"2023-12-20T04:42:48.162359+0000","last_fullsized":"2023-12-20T04:42:48.162359+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:26:45.550542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271131+0000","last_change":"2023-12-20T04:42:47.163326+0000","last_active":"2023-12-20T04:42:50.271131+0000","last_peered":"2023-12-20T04:42:50.271131+0000","last_clean":"2023-12-20T04:42:50.271131+0000","last_became_active":"2023-12-20T04:42:47.162735+0000","last_became_peered":"2023-12-20T04:42:47.162735+0000","last_unstale":"2023-12-20T04:42:50.271131+0000","last_undegraded":"2023-12-20T04:42:50.271131+0000","last_fullsized":"2023-12-20T04:42:50.271131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:25:43.498709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162147+0000","last_change":"2023-12-20T04:42:47.163875+0000","last_active":"2023-12-20T04:42:48.162147+0000","last_peered":"2023-12-20T04:42:48.162147+0000","last_clean":"2023-12-20T04:42:48.162147+0000","last_became_active":"2023-12-20T04:42:47.163660+0000","last_became_peered":"2023-12-20T04:42:47.163660+0000","last_unstale":"2023-12-20T04:42:48.162147+0000","last_undegraded":"2023-12-20T04:42:48.162147+0000","last_fullsized":"2023-12-20T04:42:48.162147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:44:36.145099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210189+0000","last_change":"2023-12-20T04:42:47.171538+0000","last_active":"2023-12-20T04:42:50.210189+0000","last_peered":"2023-12-20T04:42:50.210189+0000","last_clean":"2023-12-20T04:42:50.210189+0000","last_became_active":"2023-12-20T04:42:47.171331+0000","last_became_peered":"2023-12-20T04:42:47.171331+0000","last_unstale":"2023-12-20T04:42:50.210189+0000","last_undegraded":"2023-12-20T04:42:50.210189+0000","last_fullsized":"2023-12-20T04:42:50.210189+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:06:04.707201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270540+0000","last_change":"2023-12-20T04:42:47.158991+0000","last_active":"2023-12-20T04:42:50.270540+0000","last_peered":"2023-12-20T04:42:50.270540+0000","last_clean":"2023-12-20T04:42:50.270540+0000","last_became_active":"2023-12-20T04:42:47.158764+0000","last_became_peered":"2023-12-20T04:42:47.158764+0000","last_unstale":"2023-12-20T04:42:50.270540+0000","last_undegraded":"2023-12-20T04:42:50.270540+0000","last_fullsized":"2023-12-20T04:42:50.270540+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:44:36.145099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162479+0000","last_change":"2023-12-20T04:42:47.164066+0000","last_active":"2023-12-20T04:42:48.162479+0000","last_peered":"2023-12-20T04:42:48.162479+0000","last_clean":"2023-12-20T04:42:48.162479+0000","last_became_active":"2023-12-20T04:42:47.163199+0000","last_became_peered":"2023-12-20T04:42:47.163199+0000","last_unstale":"2023-12-20T04:42:48.162479+0000","last_undegraded":"2023-12-20T04:42:48.162479+0000","last_fullsized":"2023-12-20T04:42:48.162479+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:06:51.757769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159867+0000","last_change":"2023-12-20T04:42:47.160204+0000","last_active":"2023-12-20T04:42:48.159867+0000","last_peered":"2023-12-20T04:42:48.159867+0000","last_clean":"2023-12-20T04:42:48.159867+0000","last_became_active":"2023-12-20T04:42:47.159938+0000","last_became_peered":"2023-12-20T04:42:47.159938+0000","last_unstale":"2023-12-20T04:42:48.159867+0000","last_undegraded":"2023-12-20T04:42:48.159867+0000","last_fullsized":"2023-12-20T04:42:48.159867+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:44:36.145099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270898+0000","last_change":"2023-12-20T04:42:47.158942+0000","last_active":"2023-12-20T04:42:50.270898+0000","last_peered":"2023-12-20T04:42:50.270898+0000","last_clean":"2023-12-20T04:42:50.270898+0000","last_became_active":"2023-12-20T04:42:47.158714+0000","last_became_peered":"2023-12-20T04:42:47.158714+0000","last_unstale":"2023-12-20T04:42:50.270898+0000","last_undegraded":"2023-12-20T04:42:50.270898+0000","last_fullsized":"2023-12-20T04:42:50.270898+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:05.054526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270809+0000","last_change":"2023-12-20T04:42:47.162973+0000","last_active":"2023-12-20T04:42:50.270809+0000","last_peered":"2023-12-20T04:42:50.270809+0000","last_clean":"2023-12-20T04:42:50.270809+0000","last_became_active":"2023-12-20T04:42:47.162767+0000","last_became_peered":"2023-12-20T04:42:47.162767+0000","last_unstale":"2023-12-20T04:42:50.270809+0000","last_undegraded":"2023-12-20T04:42:50.270809+0000","last_fullsized":"2023-12-20T04:42:50.270809+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:51.333755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210131+0000","last_change":"2023-12-20T04:42:47.173155+0000","last_active":"2023-12-20T04:42:50.210131+0000","last_peered":"2023-12-20T04:42:50.210131+0000","last_clean":"2023-12-20T04:42:50.210131+0000","last_became_active":"2023-12-20T04:42:47.172736+0000","last_became_peered":"2023-12-20T04:42:47.172736+0000","last_unstale":"2023-12-20T04:42:50.210131+0000","last_undegraded":"2023-12-20T04:42:50.210131+0000","last_fullsized":"2023-12-20T04:42:50.210131+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:44:36.145099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160135+0000","last_change":"2023-12-20T04:42:47.162810+0000","last_active":"2023-12-20T04:42:48.160135+0000","last_peered":"2023-12-20T04:42:48.160135+0000","last_clean":"2023-12-20T04:42:48.160135+0000","last_became_active":"2023-12-20T04:42:47.162466+0000","last_became_peered":"2023-12-20T04:42:47.162466+0000","last_unstale":"2023-12-20T04:42:48.160135+0000","last_undegraded":"2023-12-20T04:42:48.160135+0000","last_fullsized":"2023-12-20T04:42:48.160135+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:07.145100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1b","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.176214+0000","last_change":"2023-12-20T04:42:46.820730+0000","last_active":"2023-12-20T04:42:47.176214+0000","last_peered":"2023-12-20T04:42:47.176214+0000","last_clean":"2023-12-20T04:42:47.176214+0000","last_became_active":"2023-12-20T04:42:46.820359+0000","last_became_peered":"2023-12-20T04:42:46.820359+0000","last_unstale":"2023-12-20T04:42:47.176214+0000","last_undegraded":"2023-12-20T04:42:47.176214+0000","last_fullsized":"2023-12-20T04:42:47.176214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:31:43.881906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159914+0000","last_change":"2023-12-20T04:42:47.162872+0000","last_active":"2023-12-20T04:42:48.159914+0000","last_peered":"2023-12-20T04:42:48.159914+0000","last_clean":"2023-12-20T04:42:48.159914+0000","last_became_active":"2023-12-20T04:42:47.162666+0000","last_became_peered":"2023-12-20T04:42:47.162666+0000","last_unstale":"2023-12-20T04:42:48.159914+0000","last_undegraded":"2023-12-20T04:42:48.159914+0000","last_fullsized":"2023-12-20T04:42:48.159914+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:06:04.707201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1a","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.171213+0000","last_change":"2023-12-20T04:42:46.824209+0000","last_active":"2023-12-20T04:42:47.171213+0000","last_peered":"2023-12-20T04:42:47.171213+0000","last_clean":"2023-12-20T04:42:47.171213+0000","last_became_active":"2023-12-20T04:42:46.823998+0000","last_became_peered":"2023-12-20T04:42:46.823998+0000","last_unstale":"2023-12-20T04:42:47.171213+0000","last_undegraded":"2023-12-20T04:42:47.171213+0000","last_fullsized":"2023-12-20T04:42:47.171213+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.158401+0000","last_change":"2023-12-20T04:42:46.826875+0000","last_active":"2023-12-20T04:42:47.158401+0000","last_peered":"2023-12-20T04:42:47.158401+0000","last_clean":"2023-12-20T04:42:47.158401+0000","last_became_active":"2023-12-20T04:42:46.826615+0000","last_became_peered":"2023-12-20T04:42:46.826615+0000","last_unstale":"2023-12-20T04:42:47.158401+0000","last_undegraded":"2023-12-20T04:42:47.158401+0000","last_fullsized":"2023-12-20T04:42:47.158401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:16.851777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162225+0000","last_change":"2023-12-20T04:42:47.161608+0000","last_active":"2023-12-20T04:42:48.162225+0000","last_peered":"2023-12-20T04:42:48.162225+0000","last_clean":"2023-12-20T04:42:48.162225+0000","last_became_active":"2023-12-20T04:42:47.161405+0000","last_became_peered":"2023-12-20T04:42:47.161405+0000","last_unstale":"2023-12-20T04:42:48.162225+0000","last_undegraded":"2023-12-20T04:42:48.162225+0000","last_fullsized":"2023-12-20T04:42:48.162225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:35.275699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.156329+0000","last_change":"2023-12-20T04:42:46.818215+0000","last_active":"2023-12-20T04:42:47.156329+0000","last_peered":"2023-12-20T04:42:47.156329+0000","last_clean":"2023-12-20T04:42:47.156329+0000","last_became_active":"2023-12-20T04:42:46.817966+0000","last_became_peered":"2023-12-20T04:42:46.817966+0000","last_unstale":"2023-12-20T04:42:47.156329+0000","last_undegraded":"2023-12-20T04:42:47.156329+0000","last_fullsized":"2023-12-20T04:42:47.156329+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270511+0000","last_change":"2023-12-20T04:42:47.162162+0000","last_active":"2023-12-20T04:42:50.270511+0000","last_peered":"2023-12-20T04:42:50.270511+0000","last_clean":"2023-12-20T04:42:50.270511+0000","last_became_active":"2023-12-20T04:42:47.161952+0000","last_became_peered":"2023-12-20T04:42:47.161952+0000","last_unstale":"2023-12-20T04:42:50.270511+0000","last_undegraded":"2023-12-20T04:42:50.270511+0000","last_fullsized":"2023-12-20T04:42:50.270511+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:16:25.525832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.168131+0000","last_change":"2023-12-20T04:42:46.827199+0000","last_active":"2023-12-20T04:42:47.168131+0000","last_peered":"2023-12-20T04:42:47.168131+0000","last_clean":"2023-12-20T04:42:47.168131+0000","last_became_active":"2023-12-20T04:42:46.826970+0000","last_became_peered":"2023-12-20T04:42:46.826970+0000","last_unstale":"2023-12-20T04:42:47.168131+0000","last_undegraded":"2023-12-20T04:42:47.168131+0000","last_fullsized":"2023-12-20T04:42:47.168131+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270793+0000","last_change":"2023-12-20T04:42:47.171167+0000","last_active":"2023-12-20T04:42:50.270793+0000","last_peered":"2023-12-20T04:42:50.270793+0000","last_clean":"2023-12-20T04:42:50.270793+0000","last_became_active":"2023-12-20T04:42:47.170353+0000","last_became_peered":"2023-12-20T04:42:47.170353+0000","last_unstale":"2023-12-20T04:42:50.270793+0000","last_undegraded":"2023-12-20T04:42:50.270793+0000","last_fullsized":"2023-12-20T04:42:50.270793+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:56:01.988189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.158781+0000","last_change":"2023-12-20T04:42:46.826890+0000","last_active":"2023-12-20T04:42:47.158781+0000","last_peered":"2023-12-20T04:42:47.158781+0000","last_clean":"2023-12-20T04:42:47.158781+0000","last_became_active":"2023-12-20T04:42:46.826678+0000","last_became_peered":"2023-12-20T04:42:46.826678+0000","last_unstale":"2023-12-20T04:42:47.158781+0000","last_undegraded":"2023-12-20T04:42:47.158781+0000","last_fullsized":"2023-12-20T04:42:47.158781+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160052+0000","last_change":"2023-12-20T04:42:47.163479+0000","last_active":"2023-12-20T04:42:48.160052+0000","last_peered":"2023-12-20T04:42:48.160052+0000","last_clean":"2023-12-20T04:42:48.160052+0000","last_became_active":"2023-12-20T04:42:47.163153+0000","last_became_peered":"2023-12-20T04:42:47.163153+0000","last_unstale":"2023-12-20T04:42:48.160052+0000","last_undegraded":"2023-12-20T04:42:48.160052+0000","last_fullsized":"2023-12-20T04:42:48.160052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:06:20.064610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.15","version":"19'3","reported_seq":14,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.168914+0000","last_change":"2023-12-20T04:42:46.817481+0000","last_active":"2023-12-20T04:42:47.168914+0000","last_peered":"2023-12-20T04:42:47.168914+0000","last_clean":"2023-12-20T04:42:47.168914+0000","last_became_active":"2023-12-20T04:42:46.817263+0000","last_became_peered":"2023-12-20T04:42:46.817263+0000","last_unstale":"2023-12-20T04:42:47.168914+0000","last_undegraded":"2023-12-20T04:42:47.168914+0000","last_fullsized":"2023-12-20T04:42:47.168914+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159913+0000","last_change":"2023-12-20T04:42:47.172460+0000","last_active":"2023-12-20T04:42:48.159913+0000","last_peered":"2023-12-20T04:42:48.159913+0000","last_clean":"2023-12-20T04:42:48.159913+0000","last_became_active":"2023-12-20T04:42:47.172208+0000","last_became_peered":"2023-12-20T04:42:47.172208+0000","last_unstale":"2023-12-20T04:42:48.159913+0000","last_undegraded":"2023-12-20T04:42:48.159913+0000","last_fullsized":"2023-12-20T04:42:48.159913+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:36:27.559291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.14","version":"19'6","reported_seq":17,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.177027+0000","last_change":"2023-12-20T04:42:46.826412+0000","last_active":"2023-12-20T04:42:47.177027+0000","last_peered":"2023-12-20T04:42:47.177027+0000","last_clean":"2023-12-20T04:42:47.177027+0000","last_became_active":"2023-12-20T04:42:46.826121+0000","last_became_peered":"2023-12-20T04:42:46.826121+0000","last_unstale":"2023-12-20T04:42:47.177027+0000","last_undegraded":"2023-12-20T04:42:47.177027+0000","last_fullsized":"2023-12-20T04:42:47.177027+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270828+0000","last_change":"2023-12-20T04:42:47.168998+0000","last_active":"2023-12-20T04:42:50.270828+0000","last_peered":"2023-12-20T04:42:50.270828+0000","last_clean":"2023-12-20T04:42:50.270828+0000","last_became_active":"2023-12-20T04:42:47.168390+0000","last_became_peered":"2023-12-20T04:42:47.168390+0000","last_unstale":"2023-12-20T04:42:50.270828+0000","last_undegraded":"2023-12-20T04:42:50.270828+0000","last_fullsized":"2023-12-20T04:42:50.270828+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:19:34.422422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.13","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.164299+0000","last_change":"2023-12-20T04:42:46.819640+0000","last_active":"2023-12-20T04:42:47.164299+0000","last_peered":"2023-12-20T04:42:47.164299+0000","last_clean":"2023-12-20T04:42:47.164299+0000","last_became_active":"2023-12-20T04:42:46.819432+0000","last_became_peered":"2023-12-20T04:42:46.819432+0000","last_unstale":"2023-12-20T04:42:47.164299+0000","last_undegraded":"2023-12-20T04:42:47.164299+0000","last_fullsized":"2023-12-20T04:42:47.164299+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:45:29.219298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160133+0000","last_change":"2023-12-20T04:42:47.168232+0000","last_active":"2023-12-20T04:42:48.160133+0000","last_peered":"2023-12-20T04:42:48.160133+0000","last_clean":"2023-12-20T04:42:48.160133+0000","last_became_active":"2023-12-20T04:42:47.168055+0000","last_became_peered":"2023-12-20T04:42:47.168055+0000","last_unstale":"2023-12-20T04:42:48.160133+0000","last_undegraded":"2023-12-20T04:42:48.160133+0000","last_fullsized":"2023-12-20T04:42:48.160133+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:56:01.988189+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.157450+0000","last_change":"2023-12-20T04:42:46.816370+0000","last_active":"2023-12-20T04:42:47.157450+0000","last_peered":"2023-12-20T04:42:47.157450+0000","last_clean":"2023-12-20T04:42:47.157450+0000","last_became_active":"2023-12-20T04:42:46.816114+0000","last_became_peered":"2023-12-20T04:42:46.816114+0000","last_unstale":"2023-12-20T04:42:47.157450+0000","last_undegraded":"2023-12-20T04:42:47.157450+0000","last_fullsized":"2023-12-20T04:42:47.157450+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271116+0000","last_change":"2023-12-20T04:42:47.171159+0000","last_active":"2023-12-20T04:42:50.271116+0000","last_peered":"2023-12-20T04:42:50.271116+0000","last_clean":"2023-12-20T04:42:50.271116+0000","last_became_active":"2023-12-20T04:42:47.170942+0000","last_became_peered":"2023-12-20T04:42:47.170942+0000","last_unstale":"2023-12-20T04:42:50.271116+0000","last_undegraded":"2023-12-20T04:42:50.271116+0000","last_fullsized":"2023-12-20T04:42:50.271116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:34.757109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.166819+0000","last_change":"2023-12-20T04:42:46.825683+0000","last_active":"2023-12-20T04:42:47.166819+0000","last_peered":"2023-12-20T04:42:47.166819+0000","last_clean":"2023-12-20T04:42:47.166819+0000","last_became_active":"2023-12-20T04:42:46.825470+0000","last_became_peered":"2023-12-20T04:42:46.825470+0000","last_unstale":"2023-12-20T04:42:47.166819+0000","last_undegraded":"2023-12-20T04:42:47.166819+0000","last_fullsized":"2023-12-20T04:42:47.166819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210262+0000","last_change":"2023-12-20T04:42:47.169217+0000","last_active":"2023-12-20T04:42:50.210262+0000","last_peered":"2023-12-20T04:42:50.210262+0000","last_clean":"2023-12-20T04:42:50.210262+0000","last_became_active":"2023-12-20T04:42:47.169014+0000","last_became_peered":"2023-12-20T04:42:47.169014+0000","last_unstale":"2023-12-20T04:42:50.210262+0000","last_undegraded":"2023-12-20T04:42:50.210262+0000","last_fullsized":"2023-12-20T04:42:50.210262+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:16:25.525832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.10","version":"19'8","reported_seq":19,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.178263+0000","last_change":"2023-12-20T04:42:46.817215+0000","last_active":"2023-12-20T04:42:47.178263+0000","last_peered":"2023-12-20T04:42:47.178263+0000","last_clean":"2023-12-20T04:42:47.178263+0000","last_became_active":"2023-12-20T04:42:46.816975+0000","last_became_peered":"2023-12-20T04:42:46.816975+0000","last_unstale":"2023-12-20T04:42:47.178263+0000","last_undegraded":"2023-12-20T04:42:47.178263+0000","last_fullsized":"2023-12-20T04:42:47.178263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271418+0000","last_change":"2023-12-20T04:42:47.170830+0000","last_active":"2023-12-20T04:42:50.271418+0000","last_peered":"2023-12-20T04:42:50.271418+0000","last_clean":"2023-12-20T04:42:50.271418+0000","last_became_active":"2023-12-20T04:42:47.170087+0000","last_became_peered":"2023-12-20T04:42:47.170087+0000","last_unstale":"2023-12-20T04:42:50.271418+0000","last_undegraded":"2023-12-20T04:42:50.271418+0000","last_fullsized":"2023-12-20T04:42:50.271418+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:25:43.498709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.167518+0000","last_change":"2023-12-20T04:42:46.822400+0000","last_active":"2023-12-20T04:42:47.167518+0000","last_peered":"2023-12-20T04:42:47.167518+0000","last_clean":"2023-12-20T04:42:47.167518+0000","last_became_active":"2023-12-20T04:42:46.822183+0000","last_became_peered":"2023-12-20T04:42:46.822183+0000","last_unstale":"2023-12-20T04:42:47.167518+0000","last_undegraded":"2023-12-20T04:42:47.167518+0000","last_fullsized":"2023-12-20T04:42:47.167518+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:46:37.703321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271233+0000","last_change":"2023-12-20T04:42:47.174998+0000","last_active":"2023-12-20T04:42:50.271233+0000","last_peered":"2023-12-20T04:42:50.271233+0000","last_clean":"2023-12-20T04:42:50.271233+0000","last_became_active":"2023-12-20T04:42:47.174732+0000","last_became_peered":"2023-12-20T04:42:47.174732+0000","last_unstale":"2023-12-20T04:42:50.271233+0000","last_undegraded":"2023-12-20T04:42:50.271233+0000","last_fullsized":"2023-12-20T04:42:50.271233+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:26:45.550542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.176524+0000","last_change":"2023-12-20T04:42:46.819085+0000","last_active":"2023-12-20T04:42:47.176524+0000","last_peered":"2023-12-20T04:42:47.176524+0000","last_clean":"2023-12-20T04:42:47.176524+0000","last_became_active":"2023-12-20T04:42:46.818499+0000","last_became_peered":"2023-12-20T04:42:46.818499+0000","last_unstale":"2023-12-20T04:42:47.176524+0000","last_undegraded":"2023-12-20T04:42:47.176524+0000","last_fullsized":"2023-12-20T04:42:47.176524+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270918+0000","last_change":"2023-12-20T04:42:47.175762+0000","last_active":"2023-12-20T04:42:50.270918+0000","last_peered":"2023-12-20T04:42:50.270918+0000","last_clean":"2023-12-20T04:42:50.270918+0000","last_became_active":"2023-12-20T04:42:47.175199+0000","last_became_peered":"2023-12-20T04:42:47.175199+0000","last_unstale":"2023-12-20T04:42:50.270918+0000","last_undegraded":"2023-12-20T04:42:50.270918+0000","last_fullsized":"2023-12-20T04:42:50.270918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:52:14.550271+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.d","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.165334+0000","last_change":"2023-12-20T04:42:46.817202+0000","last_active":"2023-12-20T04:42:47.165334+0000","last_peered":"2023-12-20T04:42:47.165334+0000","last_clean":"2023-12-20T04:42:47.165334+0000","last_became_active":"2023-12-20T04:42:46.817002+0000","last_became_peered":"2023-12-20T04:42:46.817002+0000","last_unstale":"2023-12-20T04:42:47.165334+0000","last_undegraded":"2023-12-20T04:42:47.165334+0000","last_fullsized":"2023-12-20T04:42:47.165334+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:56.921191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270972+0000","last_change":"2023-12-20T04:42:47.161745+0000","last_active":"2023-12-20T04:42:50.270972+0000","last_peered":"2023-12-20T04:42:50.270972+0000","last_clean":"2023-12-20T04:42:50.270972+0000","last_became_active":"2023-12-20T04:42:47.161525+0000","last_became_peered":"2023-12-20T04:42:47.161525+0000","last_unstale":"2023-12-20T04:42:50.270972+0000","last_undegraded":"2023-12-20T04:42:50.270972+0000","last_fullsized":"2023-12-20T04:42:50.270972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:06:04.707201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.156445+0000","last_change":"2023-12-20T04:42:46.819196+0000","last_active":"2023-12-20T04:42:47.156445+0000","last_peered":"2023-12-20T04:42:47.156445+0000","last_clean":"2023-12-20T04:42:47.156445+0000","last_became_active":"2023-12-20T04:42:46.818898+0000","last_became_peered":"2023-12-20T04:42:46.818898+0000","last_unstale":"2023-12-20T04:42:47.156445+0000","last_undegraded":"2023-12-20T04:42:47.156445+0000","last_fullsized":"2023-12-20T04:42:47.156445+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271496+0000","last_change":"2023-12-20T04:42:47.173543+0000","last_active":"2023-12-20T04:42:50.271496+0000","last_peered":"2023-12-20T04:42:50.271496+0000","last_clean":"2023-12-20T04:42:50.271496+0000","last_became_active":"2023-12-20T04:42:47.173310+0000","last_became_peered":"2023-12-20T04:42:47.173310+0000","last_unstale":"2023-12-20T04:42:50.271496+0000","last_undegraded":"2023-12-20T04:42:50.271496+0000","last_fullsized":"2023-12-20T04:42:50.271496+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:36:59.141749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":164,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.169782+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:42:47.169782+0000","last_peered":"2023-12-20T04:42:47.169782+0000","last_clean":"2023-12-20T04:42:47.169782+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:42:47.169782+0000","last_undegraded":"2023-12-20T04:42:47.169782+0000","last_fullsized":"2023-12-20T04:42:47.169782+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.157704+0000","last_change":"2023-12-20T04:42:46.817346+0000","last_active":"2023-12-20T04:42:47.157704+0000","last_peered":"2023-12-20T04:42:47.157704+0000","last_clean":"2023-12-20T04:42:47.157704+0000","last_became_active":"2023-12-20T04:42:46.817109+0000","last_became_peered":"2023-12-20T04:42:46.817109+0000","last_unstale":"2023-12-20T04:42:47.157704+0000","last_undegraded":"2023-12-20T04:42:47.157704+0000","last_fullsized":"2023-12-20T04:42:47.157704+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162197+0000","last_change":"2023-12-20T04:42:47.161230+0000","last_active":"2023-12-20T04:42:48.162197+0000","last_peered":"2023-12-20T04:42:48.162197+0000","last_clean":"2023-12-20T04:42:48.162197+0000","last_became_active":"2023-12-20T04:42:47.160935+0000","last_became_peered":"2023-12-20T04:42:47.160935+0000","last_unstale":"2023-12-20T04:42:48.162197+0000","last_undegraded":"2023-12-20T04:42:48.162197+0000","last_fullsized":"2023-12-20T04:42:48.162197+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:55:31.909374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.169693+0000","last_change":"2023-12-20T04:42:46.822802+0000","last_active":"2023-12-20T04:42:47.169693+0000","last_peered":"2023-12-20T04:42:47.169693+0000","last_clean":"2023-12-20T04:42:47.169693+0000","last_became_active":"2023-12-20T04:42:46.821659+0000","last_became_peered":"2023-12-20T04:42:46.821659+0000","last_unstale":"2023-12-20T04:42:47.169693+0000","last_undegraded":"2023-12-20T04:42:47.169693+0000","last_fullsized":"2023-12-20T04:42:47.169693+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160044+0000","last_change":"2023-12-20T04:42:47.161946+0000","last_active":"2023-12-20T04:42:48.160044+0000","last_peered":"2023-12-20T04:42:48.160044+0000","last_clean":"2023-12-20T04:42:48.160044+0000","last_became_active":"2023-12-20T04:42:47.161746+0000","last_became_peered":"2023-12-20T04:42:47.161746+0000","last_unstale":"2023-12-20T04:42:48.160044+0000","last_undegraded":"2023-12-20T04:42:48.160044+0000","last_fullsized":"2023-12-20T04:42:48.160044+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:06:51.757769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.156531+0000","last_change":"2023-12-20T04:42:46.822874+0000","last_active":"2023-12-20T04:42:47.156531+0000","last_peered":"2023-12-20T04:42:47.156531+0000","last_clean":"2023-12-20T04:42:47.156531+0000","last_became_active":"2023-12-20T04:42:46.822617+0000","last_became_peered":"2023-12-20T04:42:46.822617+0000","last_unstale":"2023-12-20T04:42:47.156531+0000","last_undegraded":"2023-12-20T04:42:47.156531+0000","last_fullsized":"2023-12-20T04:42:47.156531+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:09:16.851777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270598+0000","last_change":"2023-12-20T04:42:47.157587+0000","last_active":"2023-12-20T04:42:50.270598+0000","last_peered":"2023-12-20T04:42:50.270598+0000","last_clean":"2023-12-20T04:42:50.270598+0000","last_became_active":"2023-12-20T04:42:47.157401+0000","last_became_peered":"2023-12-20T04:42:47.157401+0000","last_unstale":"2023-12-20T04:42:50.270598+0000","last_undegraded":"2023-12-20T04:42:50.270598+0000","last_fullsized":"2023-12-20T04:42:50.270598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:06:04.707201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.158891+0000","last_change":"2023-12-20T04:42:46.816516+0000","last_active":"2023-12-20T04:42:47.158891+0000","last_peered":"2023-12-20T04:42:47.158891+0000","last_clean":"2023-12-20T04:42:47.158891+0000","last_became_active":"2023-12-20T04:42:46.816286+0000","last_became_peered":"2023-12-20T04:42:46.816286+0000","last_unstale":"2023-12-20T04:42:47.158891+0000","last_undegraded":"2023-12-20T04:42:47.158891+0000","last_fullsized":"2023-12-20T04:42:47.158891+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160017+0000","last_change":"2023-12-20T04:42:47.163376+0000","last_active":"2023-12-20T04:42:48.160017+0000","last_peered":"2023-12-20T04:42:48.160017+0000","last_clean":"2023-12-20T04:42:48.160017+0000","last_became_active":"2023-12-20T04:42:47.163133+0000","last_became_peered":"2023-12-20T04:42:47.163133+0000","last_unstale":"2023-12-20T04:42:48.160017+0000","last_undegraded":"2023-12-20T04:42:48.160017+0000","last_fullsized":"2023-12-20T04:42:48.160017+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:26.441913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.153830+0000","last_change":"2023-12-20T04:42:46.820405+0000","last_active":"2023-12-20T04:42:47.153830+0000","last_peered":"2023-12-20T04:42:47.153830+0000","last_clean":"2023-12-20T04:42:47.153830+0000","last_became_active":"2023-12-20T04:42:46.820205+0000","last_became_peered":"2023-12-20T04:42:46.820205+0000","last_unstale":"2023-12-20T04:42:47.153830+0000","last_undegraded":"2023-12-20T04:42:47.153830+0000","last_fullsized":"2023-12-20T04:42:47.153830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271250+0000","last_change":"2023-12-20T04:42:47.163460+0000","last_active":"2023-12-20T04:42:50.271250+0000","last_peered":"2023-12-20T04:42:50.271250+0000","last_clean":"2023-12-20T04:42:50.271250+0000","last_became_active":"2023-12-20T04:42:47.163064+0000","last_became_peered":"2023-12-20T04:42:47.163064+0000","last_unstale":"2023-12-20T04:42:50.271250+0000","last_undegraded":"2023-12-20T04:42:50.271250+0000","last_fullsized":"2023-12-20T04:42:50.271250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:35.275699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.169599+0000","last_change":"2023-12-20T04:42:46.824778+0000","last_active":"2023-12-20T04:42:47.169599+0000","last_peered":"2023-12-20T04:42:47.169599+0000","last_clean":"2023-12-20T04:42:47.169599+0000","last_became_active":"2023-12-20T04:42:46.824553+0000","last_became_peered":"2023-12-20T04:42:46.824553+0000","last_unstale":"2023-12-20T04:42:47.169599+0000","last_undegraded":"2023-12-20T04:42:47.169599+0000","last_fullsized":"2023-12-20T04:42:47.169599+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:50:16.590922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270687+0000","last_change":"2023-12-20T04:42:47.158315+0000","last_active":"2023-12-20T04:42:50.270687+0000","last_peered":"2023-12-20T04:42:50.270687+0000","last_clean":"2023-12-20T04:42:50.270687+0000","last_became_active":"2023-12-20T04:42:47.157906+0000","last_became_peered":"2023-12-20T04:42:47.157906+0000","last_unstale":"2023-12-20T04:42:50.270687+0000","last_undegraded":"2023-12-20T04:42:50.270687+0000","last_fullsized":"2023-12-20T04:42:50.270687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:22.324414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.6","version":"20'1","reported_seq":12,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.270691+0000","last_change":"2023-12-20T04:42:46.825192+0000","last_active":"2023-12-20T04:42:50.270691+0000","last_peered":"2023-12-20T04:42:50.270691+0000","last_clean":"2023-12-20T04:42:50.270691+0000","last_became_active":"2023-12-20T04:42:46.825028+0000","last_became_peered":"2023-12-20T04:42:46.825028+0000","last_unstale":"2023-12-20T04:42:50.270691+0000","last_undegraded":"2023-12-20T04:42:50.270691+0000","last_fullsized":"2023-12-20T04:42:50.270691+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162117+0000","last_change":"2023-12-20T04:42:47.169513+0000","last_active":"2023-12-20T04:42:48.162117+0000","last_peered":"2023-12-20T04:42:48.162117+0000","last_clean":"2023-12-20T04:42:48.162117+0000","last_became_active":"2023-12-20T04:42:47.169369+0000","last_became_peered":"2023-12-20T04:42:47.169369+0000","last_unstale":"2023-12-20T04:42:48.162117+0000","last_undegraded":"2023-12-20T04:42:48.162117+0000","last_fullsized":"2023-12-20T04:42:48.162117+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:22.324414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.172956+0000","last_change":"2023-12-20T04:42:46.825085+0000","last_active":"2023-12-20T04:42:47.172956+0000","last_peered":"2023-12-20T04:42:47.172956+0000","last_clean":"2023-12-20T04:42:47.172956+0000","last_became_active":"2023-12-20T04:42:46.824862+0000","last_became_peered":"2023-12-20T04:42:46.824862+0000","last_unstale":"2023-12-20T04:42:47.172956+0000","last_undegraded":"2023-12-20T04:42:47.172956+0000","last_fullsized":"2023-12-20T04:42:47.172956+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:21:59.613837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159882+0000","last_change":"2023-12-20T04:42:47.156391+0000","last_active":"2023-12-20T04:42:48.159882+0000","last_peered":"2023-12-20T04:42:48.159882+0000","last_clean":"2023-12-20T04:42:48.159882+0000","last_became_active":"2023-12-20T04:42:47.156193+0000","last_became_peered":"2023-12-20T04:42:47.156193+0000","last_unstale":"2023-12-20T04:42:48.159882+0000","last_undegraded":"2023-12-20T04:42:48.159882+0000","last_fullsized":"2023-12-20T04:42:48.159882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:40:53.166559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.167542+0000","last_change":"2023-12-20T04:42:46.823814+0000","last_active":"2023-12-20T04:42:47.167542+0000","last_peered":"2023-12-20T04:42:47.167542+0000","last_clean":"2023-12-20T04:42:47.167542+0000","last_became_active":"2023-12-20T04:42:46.823599+0000","last_became_peered":"2023-12-20T04:42:46.823599+0000","last_unstale":"2023-12-20T04:42:47.167542+0000","last_undegraded":"2023-12-20T04:42:47.167542+0000","last_fullsized":"2023-12-20T04:42:47.167542+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.160182+0000","last_change":"2023-12-20T04:42:47.163562+0000","last_active":"2023-12-20T04:42:48.160182+0000","last_peered":"2023-12-20T04:42:48.160182+0000","last_clean":"2023-12-20T04:42:48.160182+0000","last_became_active":"2023-12-20T04:42:47.161870+0000","last_became_peered":"2023-12-20T04:42:47.161870+0000","last_unstale":"2023-12-20T04:42:48.160182+0000","last_undegraded":"2023-12-20T04:42:48.160182+0000","last_fullsized":"2023-12-20T04:42:48.160182+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:56:57.927799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.153758+0000","last_change":"2023-12-20T04:42:46.819894+0000","last_active":"2023-12-20T04:42:47.153758+0000","last_peered":"2023-12-20T04:42:47.153758+0000","last_clean":"2023-12-20T04:42:47.153758+0000","last_became_active":"2023-12-20T04:42:46.819686+0000","last_became_peered":"2023-12-20T04:42:46.819686+0000","last_unstale":"2023-12-20T04:42:47.153758+0000","last_undegraded":"2023-12-20T04:42:47.153758+0000","last_fullsized":"2023-12-20T04:42:47.153758+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:24:25.435305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162110+0000","last_change":"2023-12-20T04:42:47.158866+0000","last_active":"2023-12-20T04:42:48.162110+0000","last_peered":"2023-12-20T04:42:48.162110+0000","last_clean":"2023-12-20T04:42:48.162110+0000","last_became_active":"2023-12-20T04:42:47.158669+0000","last_became_peered":"2023-12-20T04:42:47.158669+0000","last_unstale":"2023-12-20T04:42:48.162110+0000","last_undegraded":"2023-12-20T04:42:48.162110+0000","last_fullsized":"2023-12-20T04:42:48.162110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:40:53.166559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":11,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.153743+0000","last_change":"2023-12-20T04:42:46.817033+0000","last_active":"2023-12-20T04:42:47.153743+0000","last_peered":"2023-12-20T04:42:47.153743+0000","last_clean":"2023-12-20T04:42:47.153743+0000","last_became_active":"2023-12-20T04:42:46.816816+0000","last_became_peered":"2023-12-20T04:42:46.816816+0000","last_unstale":"2023-12-20T04:42:47.153743+0000","last_undegraded":"2023-12-20T04:42:47.153743+0000","last_fullsized":"2023-12-20T04:42:47.153743+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162532+0000","last_change":"2023-12-20T04:42:47.162339+0000","last_active":"2023-12-20T04:42:48.162532+0000","last_peered":"2023-12-20T04:42:48.162532+0000","last_clean":"2023-12-20T04:42:48.162532+0000","last_became_active":"2023-12-20T04:42:47.161781+0000","last_became_peered":"2023-12-20T04:42:47.161781+0000","last_unstale":"2023-12-20T04:42:48.162532+0000","last_undegraded":"2023-12-20T04:42:48.162532+0000","last_fullsized":"2023-12-20T04:42:48.162532+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:23:36.035902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.b","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.174419+0000","last_change":"2023-12-20T04:42:46.822584+0000","last_active":"2023-12-20T04:42:47.174419+0000","last_peered":"2023-12-20T04:42:47.174419+0000","last_clean":"2023-12-20T04:42:47.174419+0000","last_became_active":"2023-12-20T04:42:46.821836+0000","last_became_peered":"2023-12-20T04:42:46.821836+0000","last_unstale":"2023-12-20T04:42:47.174419+0000","last_undegraded":"2023-12-20T04:42:47.174419+0000","last_fullsized":"2023-12-20T04:42:47.174419+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:22:06.138491+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.210128+0000","last_change":"2023-12-20T04:42:47.168746+0000","last_active":"2023-12-20T04:42:50.210128+0000","last_peered":"2023-12-20T04:42:50.210128+0000","last_clean":"2023-12-20T04:42:50.210128+0000","last_became_active":"2023-12-20T04:42:47.168532+0000","last_became_peered":"2023-12-20T04:42:47.168532+0000","last_unstale":"2023-12-20T04:42:50.210128+0000","last_undegraded":"2023-12-20T04:42:50.210128+0000","last_fullsized":"2023-12-20T04:42:50.210128+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:09:22.324414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271029+0000","last_change":"2023-12-20T04:42:47.165381+0000","last_active":"2023-12-20T04:42:50.271029+0000","last_peered":"2023-12-20T04:42:50.271029+0000","last_clean":"2023-12-20T04:42:50.271029+0000","last_became_active":"2023-12-20T04:42:47.165153+0000","last_became_peered":"2023-12-20T04:42:47.165153+0000","last_unstale":"2023-12-20T04:42:50.271029+0000","last_undegraded":"2023-12-20T04:42:50.271029+0000","last_fullsized":"2023-12-20T04:42:50.271029+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:34.757109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1c","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.173061+0000","last_change":"2023-12-20T04:42:46.823242+0000","last_active":"2023-12-20T04:42:47.173061+0000","last_peered":"2023-12-20T04:42:47.173061+0000","last_clean":"2023-12-20T04:42:47.173061+0000","last_became_active":"2023-12-20T04:42:46.823034+0000","last_became_peered":"2023-12-20T04:42:46.823034+0000","last_unstale":"2023-12-20T04:42:47.173061+0000","last_undegraded":"2023-12-20T04:42:47.173061+0000","last_fullsized":"2023-12-20T04:42:47.173061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:50.327147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:50.271160+0000","last_change":"2023-12-20T04:42:47.166605+0000","last_active":"2023-12-20T04:42:50.271160+0000","last_peered":"2023-12-20T04:42:50.271160+0000","last_clean":"2023-12-20T04:42:50.271160+0000","last_became_active":"2023-12-20T04:42:47.165776+0000","last_became_peered":"2023-12-20T04:42:47.165776+0000","last_unstale":"2023-12-20T04:42:50.271160+0000","last_undegraded":"2023-12-20T04:42:50.271160+0000","last_fullsized":"2023-12-20T04:42:50.271160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:58:34.559072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1d","version":"19'2","reported_seq":13,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.172428+0000","last_change":"2023-12-20T04:42:46.826590+0000","last_active":"2023-12-20T04:42:47.172428+0000","last_peered":"2023-12-20T04:42:47.172428+0000","last_clean":"2023-12-20T04:42:47.172428+0000","last_became_active":"2023-12-20T04:42:46.826364+0000","last_became_peered":"2023-12-20T04:42:46.826364+0000","last_unstale":"2023-12-20T04:42:47.172428+0000","last_undegraded":"2023-12-20T04:42:47.172428+0000","last_fullsized":"2023-12-20T04:42:47.172428+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:57:22.907798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.159966+0000","last_change":"2023-12-20T04:42:47.159221+0000","last_active":"2023-12-20T04:42:48.159966+0000","last_peered":"2023-12-20T04:42:48.159966+0000","last_clean":"2023-12-20T04:42:48.159966+0000","last_became_active":"2023-12-20T04:42:47.159003+0000","last_became_peered":"2023-12-20T04:42:47.159003+0000","last_unstale":"2023-12-20T04:42:48.159966+0000","last_undegraded":"2023-12-20T04:42:48.159966+0000","last_fullsized":"2023-12-20T04:42:48.159966+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:55:31.909374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1e","version":"19'1","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.176324+0000","last_change":"2023-12-20T04:42:46.823580+0000","last_active":"2023-12-20T04:42:47.176324+0000","last_peered":"2023-12-20T04:42:47.176324+0000","last_clean":"2023-12-20T04:42:47.176324+0000","last_became_active":"2023-12-20T04:42:46.822923+0000","last_became_peered":"2023-12-20T04:42:46.822923+0000","last_unstale":"2023-12-20T04:42:47.176324+0000","last_undegraded":"2023-12-20T04:42:47.176324+0000","last_fullsized":"2023-12-20T04:42:47.176324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:58:02.183076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":10,"reported_epoch":20,"state":"active+clean","last_fresh":"2023-12-20T04:42:48.162163+0000","last_change":"2023-12-20T04:42:47.173382+0000","last_active":"2023-12-20T04:42:48.162163+0000","last_peered":"2023-12-20T04:42:48.162163+0000","last_clean":"2023-12-20T04:42:48.162163+0000","last_became_active":"2023-12-20T04:42:47.173150+0000","last_became_peered":"2023-12-20T04:42:47.173150+0000","last_unstale":"2023-12-20T04:42:48.162163+0000","last_undegraded":"2023-12-20T04:42:48.162163+0000","last_fullsized":"2023-12-20T04:42:48.162163+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:46.806803+0000","last_clean_scrub_stamp":"2023-12-20T04:42:46.806803+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:05.054526+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1f","version":"19'4","reported_seq":15,"reported_epoch":19,"state":"active+clean","last_fresh":"2023-12-20T04:42:47.167668+0000","last_change":"2023-12-20T04:42:46.821155+0000","last_active":"2023-12-20T04:42:47.167668+0000","last_peered":"2023-12-20T04:42:47.167668+0000","last_clean":"2023-12-20T04:42:47.167668+0000","last_became_active":"2023-12-20T04:42:46.820776+0000","last_became_peered":"2023-12-20T04:42:46.820776+0000","last_unstale":"2023-12-20T04:42:47.167668+0000","last_undegraded":"2023-12-20T04:42:47.167668+0000","last_fullsized":"2023-12-20T04:42:47.167668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:45.800195+0000","last_clean_scrub_stamp":"2023-12-20T04:42:45.800195+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:46:37.703321+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338312,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46800000000000003}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65500000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.56999999999999995}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53800000000000003}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44500000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.73799999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.89800000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574855,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57099999999999995}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.5}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48799999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64800000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54700000000000004}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59199999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574854,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929172,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.503}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.59399999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53100000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48899999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.38800000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41099999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47299999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574854,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929136,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63300000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.53300000000000003}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.64500000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.51400000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.433}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574854,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":70,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195241,"statfs":{"total":200000000,"available":199927698,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.41599999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57999999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67800000000000005}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.69799999999999995}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574854,"num_pgs":13,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929262,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.251}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.36799999999999999}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.30199999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67200000000000004}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.60399999999999998}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.72699999999999998}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65200000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574855,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":69,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195243,"statfs":{"total":200000000,"available":199929102,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.249}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.23300000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.29499999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63100000000000001}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.61699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574854,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":646,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194666,"statfs":{"total":200000000,"available":199338256,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.248}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.33100000000000002}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.27400000000000002}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.40799999999999997}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.443}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.46600000000000003}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.432}]}]}],"pool_statfs":[]}} 2023-12-20T04:42:59.037 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-20T04:42:59.037 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2023-12-20T04:42:59.037 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2023-12-20T04:42:59.037 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2023-12-20T04:42:59.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.170+0000 7fa92c55c640 1 Processor -- start 2023-12-20T04:42:59.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.170+0000 7fa92c55c640 1 -- start start 2023-12-20T04:42:59.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.170+0000 7fa92c55c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa92415d110 0x7fa9240b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.170+0000 7fa92c55c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa9240b1d10 0x7fa9240b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.171+0000 7fa92c55c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9240cd660 con 0x7fa924161940 2023-12-20T04:42:59.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.171+0000 7fa92c55c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9240cd940 con 0x7fa92415d110 2023-12-20T04:42:59.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.171+0000 7fa92c55c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa924160e60 con 0x7fa9240b1d10 2023-12-20T04:42:59.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.171+0000 7fa92a2f8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa92415d110 0x7fa9240b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.171+0000 7fa92a2f8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa92415d110 0x7fa9240b21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60094/0 (socket says 172.21.15.132:60094) 2023-12-20T04:42:59.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.171+0000 7fa92a2f8640 1 -- 172.21.15.132:0/3126747619 learned_addr learned my addr 172.21.15.132:0/3126747619 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:59.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.171+0000 7fa929af7640 1 --2- 172.21.15.132:0/3126747619 >> v2:172.21.15.187:3300/0 conn(0x7fa9240b1d10 0x7fa9240b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.171+0000 7fa92a2f8640 1 -- 172.21.15.132:0/3126747619 >> v2:172.21.15.187:3300/0 conn(0x7fa9240b1d10 msgr2=0x7fa9240b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:59.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.171+0000 7fa92a2f8640 1 --2- 172.21.15.132:0/3126747619 >> v2:172.21.15.187:3300/0 conn(0x7fa9240b1d10 0x7fa9240b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.171+0000 7fa92a2f8640 1 -- 172.21.15.132:0/3126747619 >> v1:172.21.15.187:6789/0 conn(0x7fa924161940 legacy=0x7fa92406bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.171+0000 7fa92a2f8640 1 -- 172.21.15.132:0/3126747619 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa924161140 con 0x7fa92415d110 2023-12-20T04:42:59.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.171+0000 7fa929af7640 1 --2- 172.21.15.132:0/3126747619 >> v2:172.21.15.187:3300/0 conn(0x7fa9240b1d10 0x7fa9240b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:42:59.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.172+0000 7fa92a2f8640 1 --2- 172.21.15.132:0/3126747619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa92415d110 0x7fa9240b21f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa924073c00 tx=0x7fa91402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60127999b9925da9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:59.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.172+0000 7fa9292f6640 1 -- 172.21.15.132:0/3126747619 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914030860 con 0x7fa92415d110 2023-12-20T04:42:59.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.172+0000 7fa9292f6640 1 -- 172.21.15.132:0/3126747619 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9140309c0 con 0x7fa92415d110 2023-12-20T04:42:59.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.172+0000 7fa9292f6640 1 -- 172.21.15.132:0/3126747619 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa914030d50 con 0x7fa92415d110 2023-12-20T04:42:59.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.172+0000 7fa92c55c640 1 -- 172.21.15.132:0/3126747619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa92415d110 msgr2=0x7fa9240b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.172+0000 7fa92c55c640 1 --2- 172.21.15.132:0/3126747619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa92415d110 0x7fa9240b21f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fa924073c00 tx=0x7fa91402b9a0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.172+0000 7fa92c55c640 1 -- 172.21.15.132:0/3126747619 shutdown_connections 2023-12-20T04:42:59.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.172+0000 7fa92c55c640 1 --2- 172.21.15.132:0/3126747619 >> v2:172.21.15.187:3300/0 conn(0x7fa9240b1d10 0x7fa9240b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.172+0000 7fa92c55c640 1 --2- 172.21.15.132:0/3126747619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa92415d110 0x7fa9240b21f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.172+0000 7fa92c55c640 1 -- 172.21.15.132:0/3126747619 >> 172.21.15.132:0/3126747619 conn(0x7fa9240cf880 msgr2=0x7fa9240cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:59.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.173+0000 7fa92c55c640 1 -- 172.21.15.132:0/3126747619 shutdown_connections 2023-12-20T04:42:59.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.173+0000 7fa92c55c640 1 -- 172.21.15.132:0/3126747619 wait complete. 2023-12-20T04:42:59.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.174+0000 7fa92c55c640 1 Processor -- start 2023-12-20T04:42:59.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.174+0000 7fa92c55c640 1 -- start start 2023-12-20T04:42:59.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.174+0000 7fa92c55c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9240b1d10 0x7fa9240ca7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.174+0000 7fa92c55c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa92415d110 0x7fa9240b3c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.174+0000 7fa92c55c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa924161940 0x7fa9240b4140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.174+0000 7fa92c55c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa924155b70 con 0x7fa92415d110 2023-12-20T04:42:59.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.174+0000 7fa92c55c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240cad00 con 0x7fa9240b1d10 2023-12-20T04:42:59.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.174+0000 7fa92c55c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9240cc030 con 0x7fa924161940 2023-12-20T04:42:59.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.174+0000 7fa929af7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa92415d110 0x7fa9240b3c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.174+0000 7fa929af7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa92415d110 0x7fa9240b3c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60110/0 (socket says 172.21.15.132:60110) 2023-12-20T04:42:59.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.174+0000 7fa929af7640 1 -- 172.21.15.132:0/3314460759 learned_addr learned my addr 172.21.15.132:0/3314460759 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:59.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.175+0000 7fa92a2f8640 1 --2- 172.21.15.132:0/3314460759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9240b1d10 0x7fa9240ca7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.175+0000 7fa92aaf9640 1 --2- 172.21.15.132:0/3314460759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa924161940 0x7fa9240b4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.175+0000 7fa929af7640 1 -- 172.21.15.132:0/3314460759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa924161940 msgr2=0x7fa9240b4140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.175+0000 7fa929af7640 1 --2- 172.21.15.132:0/3314460759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa924161940 0x7fa9240b4140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.175+0000 7fa929af7640 1 -- 172.21.15.132:0/3314460759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9240b1d10 msgr2=0x7fa9240ca7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.175+0000 7fa929af7640 1 --2- 172.21.15.132:0/3314460759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9240b1d10 0x7fa9240ca7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.175+0000 7fa929af7640 1 -- 172.21.15.132:0/3314460759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9140094d0 con 0x7fa92415d110 2023-12-20T04:42:59.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.175+0000 7fa929af7640 1 --2- 172.21.15.132:0/3314460759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa92415d110 0x7fa9240b3c00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa92000e7e0 tx=0x7fa92000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:59.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.175+0000 7fa91affd640 1 -- 172.21.15.132:0/3314460759 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920004030 con 0x7fa92415d110 2023-12-20T04:42:59.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.175+0000 7fa91affd640 1 -- 172.21.15.132:0/3314460759 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa920004190 con 0x7fa92415d110 2023-12-20T04:42:59.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.175+0000 7fa92c55c640 1 -- 172.21.15.132:0/3314460759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9240cc310 con 0x7fa92415d110 2023-12-20T04:42:59.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.175+0000 7fa91affd640 1 -- 172.21.15.132:0/3314460759 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa920004520 con 0x7fa92415d110 2023-12-20T04:42:59.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.175+0000 7fa92c55c640 1 -- 172.21.15.132:0/3314460759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9240cc8d0 con 0x7fa92415d110 2023-12-20T04:42:59.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.176+0000 7fa92c55c640 1 -- 172.21.15.132:0/3314460759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa92404e840 con 0x7fa92415d110 2023-12-20T04:42:59.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.177+0000 7fa91affd640 1 -- 172.21.15.132:0/3314460759 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa92000c6d0 con 0x7fa92415d110 2023-12-20T04:42:59.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.177+0000 7fa91affd640 1 --2- 172.21.15.132:0/3314460759 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa90806a430 0x7fa90806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.177+0000 7fa91affd640 1 -- 172.21.15.132:0/3314460759 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9200885c0 con 0x7fa92415d110 2023-12-20T04:42:59.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.177+0000 7fa92a2f8640 1 --2- 172.21.15.132:0/3314460759 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa90806a430 0x7fa90806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.177+0000 7fa92a2f8640 1 --2- 172.21.15.132:0/3314460759 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa90806a430 0x7fa90806c8f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa914036000 tx=0x7fa914008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:59.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.181+0000 7fa91affd640 1 -- 172.21.15.132:0/3314460759 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa920053c40 con 0x7fa92415d110 2023-12-20T04:42:59.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.386+0000 7fa92c55c640 1 -- 172.21.15.132:0/3314460759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7fa9240c9760 con 0x7fa92415d110 2023-12-20T04:42:59.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.386+0000 7fa91affd640 1 -- 172.21.15.132:0/3314460759 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+46 (secure 0 0 0) 0x7fa920057260 con 0x7fa92415d110 2023-12-20T04:42:59.388 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:59.388 INFO:teuthology.orchestra.run.smithi132.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2023-12-20T04:42:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.388+0000 7fa92c55c640 1 -- 172.21.15.132:0/3314460759 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa90806a430 msgr2=0x7fa90806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.388+0000 7fa92c55c640 1 --2- 172.21.15.132:0/3314460759 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa90806a430 0x7fa90806c8f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fa914036000 tx=0x7fa914008030 comp rx=0 tx=0).stop 2023-12-20T04:42:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.388+0000 7fa92c55c640 1 -- 172.21.15.132:0/3314460759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa92415d110 msgr2=0x7fa9240b3c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.388+0000 7fa92c55c640 1 --2- 172.21.15.132:0/3314460759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa92415d110 0x7fa9240b3c00 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fa92000e7e0 tx=0x7fa92000eca0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.388+0000 7fa92c55c640 1 -- 172.21.15.132:0/3314460759 shutdown_connections 2023-12-20T04:42:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.388+0000 7fa92c55c640 1 --2- 172.21.15.132:0/3314460759 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa90806a430 0x7fa90806c8f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.388+0000 7fa92c55c640 1 --2- 172.21.15.132:0/3314460759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa924161940 0x7fa9240b4140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.388+0000 7fa92c55c640 1 --2- 172.21.15.132:0/3314460759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa92415d110 0x7fa9240b3c00 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.388+0000 7fa92c55c640 1 --2- 172.21.15.132:0/3314460759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9240b1d10 0x7fa9240ca7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.388+0000 7fa92c55c640 1 -- 172.21.15.132:0/3314460759 >> 172.21.15.132:0/3314460759 conn(0x7fa9240cf880 msgr2=0x7fa9240d1780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:59.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.388+0000 7fa92c55c640 1 -- 172.21.15.132:0/3314460759 shutdown_connections 2023-12-20T04:42:59.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.388+0000 7fa92c55c640 1 -- 172.21.15.132:0/3314460759 wait complete. 2023-12-20T04:42:59.401 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2023-12-20T04:42:59.401 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:42:59.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.499+0000 7fbeabb7e640 1 Processor -- start 2023-12-20T04:42:59.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.499+0000 7fbeabb7e640 1 -- start start 2023-12-20T04:42:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.500+0000 7fbeabb7e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbea415d110 0x7fbea4069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.500+0000 7fbeabb7e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbea40af210 0x7fbea406a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.500+0000 7fbeabb7e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbea4161ce0 con 0x7fbea415d4f0 2023-12-20T04:42:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.500+0000 7fbeabb7e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea40aca50 con 0x7fbea415d110 2023-12-20T04:42:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.500+0000 7fbeabb7e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbea4160df0 con 0x7fbea40af210 2023-12-20T04:42:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.500+0000 7fbea991a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbea415d110 0x7fbea4069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.500+0000 7fbea991a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbea415d110 0x7fbea4069de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60126/0 (socket says 172.21.15.132:60126) 2023-12-20T04:42:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.500+0000 7fbea991a640 1 -- 172.21.15.132:0/802434903 learned_addr learned my addr 172.21.15.132:0/802434903 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.500+0000 7fbeaa11b640 1 --2- 172.21.15.132:0/802434903 >> v2:172.21.15.187:3300/0 conn(0x7fbea40af210 0x7fbea406a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.500+0000 7fbea991a640 1 -- 172.21.15.132:0/802434903 >> v2:172.21.15.187:3300/0 conn(0x7fbea40af210 msgr2=0x7fbea406a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:59.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.500+0000 7fbea991a640 1 --2- 172.21.15.132:0/802434903 >> v2:172.21.15.187:3300/0 conn(0x7fbea40af210 0x7fbea406a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.500+0000 7fbea991a640 1 -- 172.21.15.132:0/802434903 >> v1:172.21.15.187:6789/0 conn(0x7fbea415d4f0 legacy=0x7fbea40aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:59.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.500+0000 7fbea991a640 1 -- 172.21.15.132:0/802434903 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea41610d0 con 0x7fbea415d110 2023-12-20T04:42:59.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.501+0000 7fbea991a640 1 --2- 172.21.15.132:0/802434903 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea415d110 0x7fbea4069de0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbea40704f0 tx=0x7fbea002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e0a7e7a6dc2958f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:59.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.501+0000 7fbea8918640 1 -- 172.21.15.132:0/802434903 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0004230 con 0x7fbea415d110 2023-12-20T04:42:59.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.501+0000 7fbea8918640 1 -- 172.21.15.132:0/802434903 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea0004390 con 0x7fbea415d110 2023-12-20T04:42:59.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.501+0000 7fbea8918640 1 -- 172.21.15.132:0/802434903 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0003810 con 0x7fbea415d110 2023-12-20T04:42:59.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.502+0000 7fbeabb7e640 1 -- 172.21.15.132:0/802434903 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea415d110 msgr2=0x7fbea4069de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.502+0000 7fbeabb7e640 1 --2- 172.21.15.132:0/802434903 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea415d110 0x7fbea4069de0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fbea40704f0 tx=0x7fbea002b8f0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.502+0000 7fbeabb7e640 1 -- 172.21.15.132:0/802434903 shutdown_connections 2023-12-20T04:42:59.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.502+0000 7fbeabb7e640 1 --2- 172.21.15.132:0/802434903 >> v2:172.21.15.187:3300/0 conn(0x7fbea40af210 0x7fbea406a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.502+0000 7fbeabb7e640 1 --2- 172.21.15.132:0/802434903 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea415d110 0x7fbea4069de0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.502+0000 7fbeabb7e640 1 -- 172.21.15.132:0/802434903 >> 172.21.15.132:0/802434903 conn(0x7fbea40cfbd0 msgr2=0x7fbea40cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:59.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.502+0000 7fbeabb7e640 1 -- 172.21.15.132:0/802434903 shutdown_connections 2023-12-20T04:42:59.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.502+0000 7fbeabb7e640 1 -- 172.21.15.132:0/802434903 wait complete. 2023-12-20T04:42:59.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.503+0000 7fbeabb7e640 1 Processor -- start 2023-12-20T04:42:59.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.503+0000 7fbeabb7e640 1 -- start start 2023-12-20T04:42:59.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbeabb7e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea40af210 0x7fbea40c6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbeabb7e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbea415d110 0x7fbea40c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbeabb7e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbea415d4f0 0x7fbea41f2490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbeabb7e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea41f7080 con 0x7fbea40af210 2023-12-20T04:42:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbeabb7e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbea41f29d0 con 0x7fbea415d4f0 2023-12-20T04:42:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbeabb7e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbea40c9b60 con 0x7fbea415d110 2023-12-20T04:42:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbea991a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea40af210 0x7fbea40c6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbea991a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea40af210 0x7fbea40c6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60130/0 (socket says 172.21.15.132:60130) 2023-12-20T04:42:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbea991a640 1 -- 172.21.15.132:0/4054928669 learned_addr learned my addr 172.21.15.132:0/4054928669 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbea9119640 1 --2- 172.21.15.132:0/4054928669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbea415d110 0x7fbea40c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbeaa11b640 1 --2- 172.21.15.132:0/4054928669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbea415d4f0 0x7fbea41f2490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbea991a640 1 -- 172.21.15.132:0/4054928669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbea415d110 msgr2=0x7fbea40c7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbea991a640 1 --2- 172.21.15.132:0/4054928669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbea415d110 0x7fbea40c7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbea991a640 1 -- 172.21.15.132:0/4054928669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbea415d4f0 msgr2=0x7fbea41f2490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbea991a640 1 --2- 172.21.15.132:0/4054928669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbea415d4f0 0x7fbea41f2490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbea991a640 1 -- 172.21.15.132:0/4054928669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbea0009460 con 0x7fbea40af210 2023-12-20T04:42:59.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbea9119640 1 --2- 172.21.15.132:0/4054928669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbea415d110 0x7fbea40c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:59.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbeaa11b640 1 --2- 172.21.15.132:0/4054928669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbea415d4f0 0x7fbea41f2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:42:59.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbea991a640 1 --2- 172.21.15.132:0/4054928669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea40af210 0x7fbea40c6eb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbea002b930 tx=0x7fbea00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:59.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbe9a7fc640 1 -- 172.21.15.132:0/4054928669 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0003e50 con 0x7fbea40af210 2023-12-20T04:42:59.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbe9a7fc640 1 -- 172.21.15.132:0/4054928669 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbea0004500 con 0x7fbea40af210 2023-12-20T04:42:59.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbeabb7e640 1 -- 172.21.15.132:0/4054928669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbea40c9300 con 0x7fbea40af210 2023-12-20T04:42:59.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbe9a7fc640 1 -- 172.21.15.132:0/4054928669 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbea0006240 con 0x7fbea40af210 2023-12-20T04:42:59.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.504+0000 7fbeabb7e640 1 -- 172.21.15.132:0/4054928669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbea40c95a0 con 0x7fbea40af210 2023-12-20T04:42:59.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.505+0000 7fbeabb7e640 1 -- 172.21.15.132:0/4054928669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbea404e840 con 0x7fbea40af210 2023-12-20T04:42:59.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.506+0000 7fbe9a7fc640 1 -- 172.21.15.132:0/4054928669 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbea002f050 con 0x7fbea40af210 2023-12-20T04:42:59.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.506+0000 7fbe9a7fc640 1 --2- 172.21.15.132:0/4054928669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbe8806a430 0x7fbe8806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.506+0000 7fbea9119640 1 --2- 172.21.15.132:0/4054928669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbe8806a430 0x7fbe8806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.506+0000 7fbe9a7fc640 1 -- 172.21.15.132:0/4054928669 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbea00aa820 con 0x7fbea40af210 2023-12-20T04:42:59.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.507+0000 7fbea9119640 1 --2- 172.21.15.132:0/4054928669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbe8806a430 0x7fbe8806c8f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbea406d430 tx=0x7fbe94009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:59.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.510+0000 7fbe9a7fc640 1 -- 172.21.15.132:0/4054928669 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbea0075e10 con 0x7fbea40af210 2023-12-20T04:42:59.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.678+0000 7fbeabb7e640 1 -- 172.21.15.132:0/4054928669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbea40c7490 con 0x7fbea40af210 2023-12-20T04:42:59.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.680+0000 7fbe9a7fc640 1 -- 172.21.15.132:0/4054928669 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fbea003f090 con 0x7fbea40af210 2023-12-20T04:42:59.681 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:42:59.681 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:42:59.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.681+0000 7fbeabb7e640 1 -- 172.21.15.132:0/4054928669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbe8806a430 msgr2=0x7fbe8806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.681+0000 7fbeabb7e640 1 --2- 172.21.15.132:0/4054928669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbe8806a430 0x7fbe8806c8f0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fbea406d430 tx=0x7fbe94009040 comp rx=0 tx=0).stop 2023-12-20T04:42:59.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.681+0000 7fbeabb7e640 1 -- 172.21.15.132:0/4054928669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea40af210 msgr2=0x7fbea40c6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.681+0000 7fbeabb7e640 1 --2- 172.21.15.132:0/4054928669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea40af210 0x7fbea40c6eb0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fbea002b930 tx=0x7fbea00046c0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.681+0000 7fbeabb7e640 1 -- 172.21.15.132:0/4054928669 shutdown_connections 2023-12-20T04:42:59.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.681+0000 7fbeabb7e640 1 --2- 172.21.15.132:0/4054928669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbe8806a430 0x7fbe8806c8f0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.681+0000 7fbeabb7e640 1 --2- 172.21.15.132:0/4054928669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbea415d4f0 0x7fbea41f2490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.681+0000 7fbeabb7e640 1 --2- 172.21.15.132:0/4054928669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbea415d110 0x7fbea40c7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.681+0000 7fbeabb7e640 1 --2- 172.21.15.132:0/4054928669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbea40af210 0x7fbea40c6eb0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.681+0000 7fbeabb7e640 1 -- 172.21.15.132:0/4054928669 >> 172.21.15.132:0/4054928669 conn(0x7fbea40cfbd0 msgr2=0x7fbea415c830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:59.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.681+0000 7fbeabb7e640 1 -- 172.21.15.132:0/4054928669 shutdown_connections 2023-12-20T04:42:59.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.682+0000 7fbeabb7e640 1 -- 172.21.15.132:0/4054928669 wait complete. 2023-12-20T04:42:59.694 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:42:45.433456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:42:46.128920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:42:59.695 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:42:59.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.795+0000 7fba36dc9640 1 Processor -- start 2023-12-20T04:42:59.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.795+0000 7fba36dc9640 1 -- start start 2023-12-20T04:42:59.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.796+0000 7fba36dc9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba30160710 0x7fba300b2d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.796+0000 7fba36dc9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fba300afa40 0x7fba300b3290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.796+0000 7fba36dc9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fba300d1490 con 0x7fba300b3d60 2023-12-20T04:42:59.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.796+0000 7fba36dc9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fba300b58a0 con 0x7fba300afa40 2023-12-20T04:42:59.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.796+0000 7fba36dc9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba300d1770 con 0x7fba30160710 2023-12-20T04:42:59.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.796+0000 7fba34b65640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba30160710 0x7fba300b2d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.796+0000 7fba34b65640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba30160710 0x7fba300b2d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:55652/0 (socket says 172.21.15.132:55652) 2023-12-20T04:42:59.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.796+0000 7fba2ffff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fba300afa40 0x7fba300b3290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.796+0000 7fba34b65640 1 -- 172.21.15.132:0/2108645051 learned_addr learned my addr 172.21.15.132:0/2108645051 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:59.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.796+0000 7fba2f7fe640 1 -- 172.21.15.132:0/2108645051 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3276669886 0 0) 0x7fba300d1490 con 0x7fba300b3d60 2023-12-20T04:42:59.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.796+0000 7fba2f7fe640 1 -- 172.21.15.132:0/2108645051 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fba20003520 con 0x7fba300b3d60 2023-12-20T04:42:59.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.796+0000 7fba2ffff640 1 -- 172.21.15.132:0/2108645051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba30160710 msgr2=0x7fba300b2d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:42:59.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.796+0000 7fba2ffff640 1 --2- 172.21.15.132:0/2108645051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba30160710 0x7fba300b2d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.796+0000 7fba2ffff640 1 -- 172.21.15.132:0/2108645051 >> v1:172.21.15.187:6789/0 conn(0x7fba300b3d60 legacy=0x7fba300cd890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.796+0000 7fba2ffff640 1 -- 172.21.15.132:0/2108645051 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba300d1a50 con 0x7fba300afa40 2023-12-20T04:42:59.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.796+0000 7fba34b65640 1 --2- 172.21.15.132:0/2108645051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba30160710 0x7fba300b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:42:59.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.797+0000 7fba2ffff640 1 --2- 172.21.15.132:0/2108645051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba300afa40 0x7fba300b3290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0097a0 tx=0x7fba1c02b840 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2a0ff68653c4832d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:59.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.797+0000 7fba2f7fe640 1 -- 172.21.15.132:0/2108645051 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c02e070 con 0x7fba300afa40 2023-12-20T04:42:59.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.797+0000 7fba2f7fe640 1 -- 172.21.15.132:0/2108645051 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba1c0315a0 con 0x7fba300afa40 2023-12-20T04:42:59.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.797+0000 7fba2f7fe640 1 -- 172.21.15.132:0/2108645051 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba1c031910 con 0x7fba300afa40 2023-12-20T04:42:59.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.798+0000 7fba36dc9640 1 -- 172.21.15.132:0/2108645051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba300afa40 msgr2=0x7fba300b3290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.798+0000 7fba36dc9640 1 --2- 172.21.15.132:0/2108645051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba300afa40 0x7fba300b3290 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fba1c0097a0 tx=0x7fba1c02b840 comp rx=0 tx=0).stop 2023-12-20T04:42:59.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.798+0000 7fba36dc9640 1 -- 172.21.15.132:0/2108645051 shutdown_connections 2023-12-20T04:42:59.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.798+0000 7fba36dc9640 1 --2- 172.21.15.132:0/2108645051 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba300afa40 0x7fba300b3290 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.798+0000 7fba36dc9640 1 --2- 172.21.15.132:0/2108645051 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba30160710 0x7fba300b2d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.798+0000 7fba36dc9640 1 -- 172.21.15.132:0/2108645051 >> 172.21.15.132:0/2108645051 conn(0x7fba300d2e10 msgr2=0x7fba300d3220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:59.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.798+0000 7fba36dc9640 1 -- 172.21.15.132:0/2108645051 shutdown_connections 2023-12-20T04:42:59.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.798+0000 7fba36dc9640 1 -- 172.21.15.132:0/2108645051 wait complete. 2023-12-20T04:42:59.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.799+0000 7fba36dc9640 1 Processor -- start 2023-12-20T04:42:59.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.799+0000 7fba36dc9640 1 -- start start 2023-12-20T04:42:59.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.800+0000 7fba36dc9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba300afa40 0x7fba3014f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.800+0000 7fba36dc9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba300b3d60 0x7fba300b7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.800+0000 7fba36dc9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba30160710 0x7fba300b7fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.800+0000 7fba36dc9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba3014f820 con 0x7fba300afa40 2023-12-20T04:42:59.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.800+0000 7fba36dc9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba300cb1f0 con 0x7fba30160710 2023-12-20T04:42:59.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.800+0000 7fba36dc9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fba300cb4d0 con 0x7fba300b3d60 2023-12-20T04:42:59.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.800+0000 7fba34b65640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba300afa40 0x7fba3014f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.800+0000 7fba34b65640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba300afa40 0x7fba3014f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60138/0 (socket says 172.21.15.132:60138) 2023-12-20T04:42:59.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.800+0000 7fba34b65640 1 -- 172.21.15.132:0/1287983491 learned_addr learned my addr 172.21.15.132:0/1287983491 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:42:59.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.800+0000 7fba2ffff640 1 --2- 172.21.15.132:0/1287983491 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba300b3d60 0x7fba300b7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.800+0000 7fba35366640 1 --2- 172.21.15.132:0/1287983491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba30160710 0x7fba300b7fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.800+0000 7fba34b65640 1 -- 172.21.15.132:0/1287983491 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba300b3d60 msgr2=0x7fba300b7a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.800+0000 7fba34b65640 1 --2- 172.21.15.132:0/1287983491 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba300b3d60 0x7fba300b7a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.800+0000 7fba34b65640 1 -- 172.21.15.132:0/1287983491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba30160710 msgr2=0x7fba300b7fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.800+0000 7fba34b65640 1 --2- 172.21.15.132:0/1287983491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba30160710 0x7fba300b7fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.800+0000 7fba34b65640 1 -- 172.21.15.132:0/1287983491 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba240094d0 con 0x7fba300afa40 2023-12-20T04:42:59.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.801+0000 7fba34b65640 1 --2- 172.21.15.132:0/1287983491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba300afa40 0x7fba3014f2e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fba2400e9d0 tx=0x7fba2400ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:59.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.801+0000 7fba2d7fa640 1 -- 172.21.15.132:0/1287983491 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba2400ca60 con 0x7fba300afa40 2023-12-20T04:42:59.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.801+0000 7fba2d7fa640 1 -- 172.21.15.132:0/1287983491 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fba2400cbc0 con 0x7fba300afa40 2023-12-20T04:42:59.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.801+0000 7fba2d7fa640 1 -- 172.21.15.132:0/1287983491 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fba24013470 con 0x7fba300afa40 2023-12-20T04:42:59.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.801+0000 7fba36dc9640 1 -- 172.21.15.132:0/1287983491 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba1c009400 con 0x7fba300afa40 2023-12-20T04:42:59.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.801+0000 7fba36dc9640 1 -- 172.21.15.132:0/1287983491 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba300cba90 con 0x7fba300afa40 2023-12-20T04:42:59.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.802+0000 7fba36dc9640 1 -- 172.21.15.132:0/1287983491 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba3004e840 con 0x7fba300afa40 2023-12-20T04:42:59.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.802+0000 7fba2d7fa640 1 -- 172.21.15.132:0/1287983491 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fba240135d0 con 0x7fba300afa40 2023-12-20T04:42:59.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.802+0000 7fba2d7fa640 1 --2- 172.21.15.132:0/1287983491 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fba1406a430 0x7fba1406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:42:59.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.803+0000 7fba2d7fa640 1 -- 172.21.15.132:0/1287983491 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fba24088b70 con 0x7fba300afa40 2023-12-20T04:42:59.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.803+0000 7fba2ffff640 1 --2- 172.21.15.132:0/1287983491 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fba1406a430 0x7fba1406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:42:59.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.803+0000 7fba2ffff640 1 --2- 172.21.15.132:0/1287983491 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fba1406a430 0x7fba1406c8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fba1c036000 tx=0x7fba1c03d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:42:59.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.807+0000 7fba2d7fa640 1 -- 172.21.15.132:0/1287983491 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fba240542a0 con 0x7fba300afa40 2023-12-20T04:42:59.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.972+0000 7fba36dc9640 1 -- 172.21.15.132:0/1287983491 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fba300d3b80 con 0x7fba300afa40 2023-12-20T04:42:59.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.972+0000 7fba2d7fa640 1 -- 172.21.15.132:0/1287983491 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fba240170a0 con 0x7fba300afa40 2023-12-20T04:42:59.974 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:42:59.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.974+0000 7fba36dc9640 1 -- 172.21.15.132:0/1287983491 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fba1406a430 msgr2=0x7fba1406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.974+0000 7fba36dc9640 1 --2- 172.21.15.132:0/1287983491 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fba1406a430 0x7fba1406c8f0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fba1c036000 tx=0x7fba1c03d040 comp rx=0 tx=0).stop 2023-12-20T04:42:59.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.974+0000 7fba36dc9640 1 -- 172.21.15.132:0/1287983491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba300afa40 msgr2=0x7fba3014f2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:42:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.974+0000 7fba36dc9640 1 --2- 172.21.15.132:0/1287983491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba300afa40 0x7fba3014f2e0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7fba2400e9d0 tx=0x7fba2400ee90 comp rx=0 tx=0).stop 2023-12-20T04:42:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.975+0000 7fba36dc9640 1 -- 172.21.15.132:0/1287983491 shutdown_connections 2023-12-20T04:42:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.975+0000 7fba36dc9640 1 --2- 172.21.15.132:0/1287983491 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fba1406a430 0x7fba1406c8f0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.975+0000 7fba36dc9640 1 --2- 172.21.15.132:0/1287983491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fba30160710 0x7fba300b7fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.975+0000 7fba36dc9640 1 --2- 172.21.15.132:0/1287983491 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fba300b3d60 0x7fba300b7a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.975+0000 7fba36dc9640 1 --2- 172.21.15.132:0/1287983491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fba300afa40 0x7fba3014f2e0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:42:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.975+0000 7fba36dc9640 1 -- 172.21.15.132:0/1287983491 >> 172.21.15.132:0/1287983491 conn(0x7fba300d2e10 msgr2=0x7fba3015d2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:42:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.975+0000 7fba36dc9640 1 -- 172.21.15.132:0/1287983491 shutdown_connections 2023-12-20T04:42:59.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:42:59.975+0000 7fba36dc9640 1 -- 172.21.15.132:0/1287983491 wait complete. 2023-12-20T04:42:59.988 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:43:00.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.089+0000 7f3534bb9640 1 Processor -- start 2023-12-20T04:43:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.089+0000 7f3534bb9640 1 -- start start 2023-12-20T04:43:00.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.090+0000 7f3534bb9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f35300cb2b0 0x7f35300cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.090+0000 7f3534bb9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35300ce000 con 0x7f353015aee0 2023-12-20T04:43:00.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.090+0000 7f3534bb9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35300d0130 con 0x7f35300cdbb0 2023-12-20T04:43:00.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.090+0000 7f3534bb9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f353015f370 con 0x7f35300cb2b0 2023-12-20T04:43:00.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.090+0000 7f352e59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f353015aee0 0x7f353015eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60540/0 (socket says 172.21.15.132:60540) 2023-12-20T04:43:00.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.090+0000 7f352e59c640 1 -- 172.21.15.132:0/3865864330 learned_addr learned my addr 172.21.15.132:0/3865864330 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:00.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.090+0000 7f352dd9b640 1 --2- 172.21.15.132:0/3865864330 >> v2:172.21.15.187:3300/0 conn(0x7f35300cb2b0 0x7f35300cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.091+0000 7f352d59a640 1 -- 172.21.15.132:0/3865864330 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3438534098 0 0) 0x7f3520001490 con 0x7f353015aee0 2023-12-20T04:43:00.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.091+0000 7f352d59a640 1 -- 172.21.15.132:0/3865864330 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3518003520 con 0x7f353015aee0 2023-12-20T04:43:00.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.091+0000 7f352d59a640 1 -- 172.21.15.132:0/3865864330 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1987788538 0 0) 0x7f35300d0130 con 0x7f35300cdbb0 2023-12-20T04:43:00.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.091+0000 7f352d59a640 1 -- 172.21.15.132:0/3865864330 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3520001490 con 0x7f35300cdbb0 2023-12-20T04:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.091+0000 7f352d59a640 1 -- 172.21.15.132:0/3865864330 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1789660908 0 0) 0x7f3518003520 con 0x7f353015aee0 2023-12-20T04:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.091+0000 7f352dd9b640 1 -- 172.21.15.132:0/3865864330 >> v1:172.21.15.187:6789/0 conn(0x7f35300cdbb0 legacy=0x7f35300d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.091+0000 7f352dd9b640 1 -- 172.21.15.132:0/3865864330 >> v1:172.21.15.132:6789/0 conn(0x7f353015aee0 legacy=0x7f353015eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.091+0000 7f352dd9b640 1 -- 172.21.15.132:0/3865864330 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f353015f650 con 0x7f35300cb2b0 2023-12-20T04:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.092+0000 7f352dd9b640 1 --2- 172.21.15.132:0/3865864330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35300cb2b0 0x7f35300cd670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f35240097d0 tx=0x7f352402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d6931a75cd1374b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.092+0000 7f352d59a640 1 -- 172.21.15.132:0/3865864330 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352402f050 con 0x7f35300cb2b0 2023-12-20T04:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.092+0000 7f352d59a640 1 -- 172.21.15.132:0/3865864330 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3524031500 con 0x7f35300cb2b0 2023-12-20T04:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.092+0000 7f352d59a640 1 -- 172.21.15.132:0/3865864330 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3520001b80 con 0x7f35300cb2b0 2023-12-20T04:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.092+0000 7f3534bb9640 1 -- 172.21.15.132:0/3865864330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35300cb2b0 msgr2=0x7f35300cd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.092+0000 7f3534bb9640 1 --2- 172.21.15.132:0/3865864330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35300cb2b0 0x7f35300cd670 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f35240097d0 tx=0x7f352402b820 comp rx=0 tx=0).stop 2023-12-20T04:43:00.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.092+0000 7f3534bb9640 1 -- 172.21.15.132:0/3865864330 shutdown_connections 2023-12-20T04:43:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.092+0000 7f3534bb9640 1 --2- 172.21.15.132:0/3865864330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35300cb2b0 0x7f35300cd670 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.092+0000 7f3534bb9640 1 -- 172.21.15.132:0/3865864330 >> 172.21.15.132:0/3865864330 conn(0x7f3530072c60 msgr2=0x7f3530073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.092+0000 7f3534bb9640 1 -- 172.21.15.132:0/3865864330 shutdown_connections 2023-12-20T04:43:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.092+0000 7f3534bb9640 1 -- 172.21.15.132:0/3865864330 wait complete. 2023-12-20T04:43:00.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.094+0000 7f3534bb9640 1 Processor -- start 2023-12-20T04:43:00.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.094+0000 7f3534bb9640 1 -- start start 2023-12-20T04:43:00.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.094+0000 7f3534bb9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35300cb2b0 0x7f35300cfc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.094+0000 7f3534bb9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35300cdbb0 0x7f353006c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.094+0000 7f3534bb9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f353015aee0 0x7f3530155240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.094+0000 7f3534bb9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353006b750 con 0x7f35300cdbb0 2023-12-20T04:43:00.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.094+0000 7f3534bb9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f353006bd10 con 0x7f35300cb2b0 2023-12-20T04:43:00.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.094+0000 7f3534bb9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f353015c610 con 0x7f353015aee0 2023-12-20T04:43:00.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.095+0000 7f352dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35300cdbb0 0x7f353006c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.095+0000 7f352dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35300cdbb0 0x7f353006c1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60144/0 (socket says 172.21.15.132:60144) 2023-12-20T04:43:00.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.095+0000 7f352dd9b640 1 -- 172.21.15.132:0/2883424154 learned_addr learned my addr 172.21.15.132:0/2883424154 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:00.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.095+0000 7f352e59c640 1 --2- 172.21.15.132:0/2883424154 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35300cb2b0 0x7f35300cfc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.095+0000 7f352ed9d640 1 --2- 172.21.15.132:0/2883424154 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f353015aee0 0x7f3530155240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.095+0000 7f352dd9b640 1 -- 172.21.15.132:0/2883424154 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f353015aee0 msgr2=0x7f3530155240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.095+0000 7f352dd9b640 1 --2- 172.21.15.132:0/2883424154 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f353015aee0 0x7f3530155240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.095+0000 7f352dd9b640 1 -- 172.21.15.132:0/2883424154 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35300cb2b0 msgr2=0x7f35300cfc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.095+0000 7f352dd9b640 1 --2- 172.21.15.132:0/2883424154 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35300cb2b0 0x7f35300cfc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.095+0000 7f352dd9b640 1 -- 172.21.15.132:0/2883424154 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3524009400 con 0x7f35300cdbb0 2023-12-20T04:43:00.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.095+0000 7f352dd9b640 1 --2- 172.21.15.132:0/2883424154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35300cdbb0 0x7f353006c1a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3524036040 tx=0x7f35240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:00.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.095+0000 7f351effd640 1 -- 172.21.15.132:0/2883424154 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3524004220 con 0x7f35300cdbb0 2023-12-20T04:43:00.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.095+0000 7f351effd640 1 -- 172.21.15.132:0/2883424154 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3524004380 con 0x7f35300cdbb0 2023-12-20T04:43:00.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.095+0000 7f3534bb9640 1 -- 172.21.15.132:0/2883424154 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f353006c6e0 con 0x7f35300cdbb0 2023-12-20T04:43:00.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.095+0000 7f351effd640 1 -- 172.21.15.132:0/2883424154 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f352403c910 con 0x7f35300cdbb0 2023-12-20T04:43:00.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.095+0000 7f3534bb9640 1 -- 172.21.15.132:0/2883424154 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f353006b9a0 con 0x7f35300cdbb0 2023-12-20T04:43:00.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.096+0000 7f3534bb9640 1 -- 172.21.15.132:0/2883424154 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35300c6be0 con 0x7f35300cdbb0 2023-12-20T04:43:00.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.097+0000 7f351effd640 1 -- 172.21.15.132:0/2883424154 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f352403a040 con 0x7f35300cdbb0 2023-12-20T04:43:00.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.097+0000 7f351effd640 1 --2- 172.21.15.132:0/2883424154 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f351006a430 0x7f351006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.097+0000 7f352e59c640 1 --2- 172.21.15.132:0/2883424154 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f351006a430 0x7f351006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.097+0000 7f351effd640 1 -- 172.21.15.132:0/2883424154 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f35240a9770 con 0x7f35300cdbb0 2023-12-20T04:43:00.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.098+0000 7f352e59c640 1 --2- 172.21.15.132:0/2883424154 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f351006a430 0x7f351006c8f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f35200012e0 tx=0x7f3520009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:00.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.102+0000 7f351effd640 1 -- 172.21.15.132:0/2883424154 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3524074ea0 con 0x7f35300cdbb0 2023-12-20T04:43:00.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.267+0000 7f3534bb9640 1 -- 172.21.15.132:0/2883424154 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f353006be80 con 0x7f35300cdbb0 2023-12-20T04:43:00.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.268+0000 7f351effd640 1 -- 172.21.15.132:0/2883424154 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3524040020 con 0x7f35300cdbb0 2023-12-20T04:43:00.269 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:43:00.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.270+0000 7f3534bb9640 1 -- 172.21.15.132:0/2883424154 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f351006a430 msgr2=0x7f351006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.270+0000 7f3534bb9640 1 --2- 172.21.15.132:0/2883424154 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f351006a430 0x7f351006c8f0 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f35200012e0 tx=0x7f3520009040 comp rx=0 tx=0).stop 2023-12-20T04:43:00.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.270+0000 7f3534bb9640 1 -- 172.21.15.132:0/2883424154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35300cdbb0 msgr2=0x7f353006c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.270+0000 7f3534bb9640 1 --2- 172.21.15.132:0/2883424154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35300cdbb0 0x7f353006c1a0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f3524036040 tx=0x7f35240046c0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.270+0000 7f3534bb9640 1 -- 172.21.15.132:0/2883424154 shutdown_connections 2023-12-20T04:43:00.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.270+0000 7f3534bb9640 1 --2- 172.21.15.132:0/2883424154 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f351006a430 0x7f351006c8f0 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.270+0000 7f3534bb9640 1 --2- 172.21.15.132:0/2883424154 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f353015aee0 0x7f3530155240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.270+0000 7f3534bb9640 1 --2- 172.21.15.132:0/2883424154 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35300cdbb0 0x7f353006c1a0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.270+0000 7f3534bb9640 1 --2- 172.21.15.132:0/2883424154 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35300cb2b0 0x7f35300cfc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.270+0000 7f3534bb9640 1 -- 172.21.15.132:0/2883424154 >> 172.21.15.132:0/2883424154 conn(0x7f3530072c60 msgr2=0x7f353015a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:00.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.270+0000 7f3534bb9640 1 -- 172.21.15.132:0/2883424154 shutdown_connections 2023-12-20T04:43:00.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.270+0000 7f3534bb9640 1 -- 172.21.15.132:0/2883424154 wait complete. 2023-12-20T04:43:00.283 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:43:00.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.383+0000 7f98dfe1e640 1 Processor -- start 2023-12-20T04:43:00.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.384+0000 7f98dfe1e640 1 -- start start 2023-12-20T04:43:00.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.384+0000 7f98dfe1e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98d80cf790 0x7f98d80cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.384+0000 7f98dfe1e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f98d80b6080 0x7f98d80b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.384+0000 7f98dfe1e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98d80d0150 con 0x7f98d815d300 2023-12-20T04:43:00.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.384+0000 7f98dfe1e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98d80d2920 con 0x7f98d80b6080 2023-12-20T04:43:00.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.384+0000 7f98dfe1e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80d1d10 con 0x7f98d80cf790 2023-12-20T04:43:00.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98ddbba640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f98d815d300 0x7f98d80d1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60552/0 (socket says 172.21.15.132:60552) 2023-12-20T04:43:00.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98ddbba640 1 -- 172.21.15.132:0/412070062 learned_addr learned my addr 172.21.15.132:0/412070062 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:00.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dcbb8640 1 -- 172.21.15.132:0/412070062 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 337207398 0 0) 0x7f98d80d0150 con 0x7f98d815d300 2023-12-20T04:43:00.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dd3b9640 1 --2- 172.21.15.132:0/412070062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98d80cf790 0x7f98d80cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98de3bb640 1 --2- 172.21.15.132:0/412070062 >> v2:172.21.15.187:3300/0 conn(0x7f98d80b6080 0x7f98d80b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dcbb8640 1 -- 172.21.15.132:0/412070062 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f98c4003520 con 0x7f98d815d300 2023-12-20T04:43:00.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dcbb8640 1 -- 172.21.15.132:0/412070062 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3032137056 0 0) 0x7f98c4003520 con 0x7f98d815d300 2023-12-20T04:43:00.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dcbb8640 1 -- 172.21.15.132:0/412070062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98d80cf790 msgr2=0x7f98d80cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:00.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dcbb8640 1 --2- 172.21.15.132:0/412070062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98d80cf790 0x7f98d80cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dcbb8640 1 -- 172.21.15.132:0/412070062 >> v2:172.21.15.187:3300/0 conn(0x7f98d80b6080 msgr2=0x7f98d80b64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:00.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dcbb8640 1 --2- 172.21.15.132:0/412070062 >> v2:172.21.15.187:3300/0 conn(0x7f98d80b6080 0x7f98d80b64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dcbb8640 1 -- 172.21.15.132:0/412070062 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d80d1ff0 con 0x7f98d815d300 2023-12-20T04:43:00.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dcbb8640 1 -- 172.21.15.132:0/412070062 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f98d00019f0 con 0x7f98d815d300 2023-12-20T04:43:00.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dcbb8640 1 -- 172.21.15.132:0/412070062 >> v1:172.21.15.132:6789/0 conn(0x7f98d815d300 legacy=0x7f98d80d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dcbb8640 1 --2- 172.21.15.132:0/412070062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98c4003970 0x7f98c4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dcbb8640 1 --2- 172.21.15.132:0/412070062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98c40047c0 0x7f98c4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dcbb8640 1 --2- 172.21.15.132:0/412070062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c4005180 0x7f98c400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dcbb8640 1 -- 172.21.15.132:0/412070062 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80d2920 con 0x7f98c4005180 2023-12-20T04:43:00.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dcbb8640 1 -- 172.21.15.132:0/412070062 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d80d1d10 con 0x7f98c40047c0 2023-12-20T04:43:00.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dcbb8640 1 -- 172.21.15.132:0/412070062 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98c400bfc0 con 0x7f98c4003970 2023-12-20T04:43:00.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98de3bb640 1 --2- 172.21.15.132:0/412070062 >> v2:172.21.15.187:3300/0 conn(0x7f98d80b6080 0x7f98d80b64d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:00.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dd3b9640 1 --2- 172.21.15.132:0/412070062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98d80cf790 0x7f98d80cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:00.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98de3bb640 1 --2- 172.21.15.132:0/412070062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c4005180 0x7f98c400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98ddbba640 1 --2- 172.21.15.132:0/412070062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98c4003970 0x7f98c4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98dd3b9640 1 --2- 172.21.15.132:0/412070062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98c40047c0 0x7f98c4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98de3bb640 1 -- 172.21.15.132:0/412070062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98c4003970 msgr2=0x7f98c4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:00.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.385+0000 7f98de3bb640 1 --2- 172.21.15.132:0/412070062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98c4003970 0x7f98c4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.386+0000 7f98de3bb640 1 -- 172.21.15.132:0/412070062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98c40047c0 msgr2=0x7f98c4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:00.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.386+0000 7f98de3bb640 1 --2- 172.21.15.132:0/412070062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98c40047c0 0x7f98c4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.386+0000 7f98de3bb640 1 -- 172.21.15.132:0/412070062 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98c4003520 con 0x7f98c4005180 2023-12-20T04:43:00.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.386+0000 7f98de3bb640 1 --2- 172.21.15.132:0/412070062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c4005180 0x7f98c400b980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f98d40098d0 tx=0x7f98c40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1db871c5f9bb96e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:00.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.386+0000 7f98dcbb8640 1 -- 172.21.15.132:0/412070062 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d4030680 con 0x7f98c4005180 2023-12-20T04:43:00.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.386+0000 7f98dcbb8640 1 -- 172.21.15.132:0/412070062 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d40307e0 con 0x7f98c4005180 2023-12-20T04:43:00.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.386+0000 7f98dcbb8640 1 -- 172.21.15.132:0/412070062 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d4030b50 con 0x7f98c4005180 2023-12-20T04:43:00.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.387+0000 7f98dfe1e640 1 -- 172.21.15.132:0/412070062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c4005180 msgr2=0x7f98c400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.387+0000 7f98dfe1e640 1 --2- 172.21.15.132:0/412070062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c4005180 0x7f98c400b980 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f98d40098d0 tx=0x7f98c40057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.387+0000 7f98de3bb640 1 -- 172.21.15.132:0/412070062 reap_dead start 2023-12-20T04:43:00.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.387+0000 7f98dfe1e640 1 -- 172.21.15.132:0/412070062 shutdown_connections 2023-12-20T04:43:00.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.387+0000 7f98dfe1e640 1 -- 172.21.15.132:0/412070062 >> 172.21.15.132:0/412070062 conn(0x7f98d806a3d0 msgr2=0x7f98d806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:00.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.387+0000 7f98dfe1e640 1 -- 172.21.15.132:0/412070062 shutdown_connections 2023-12-20T04:43:00.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.387+0000 7f98dfe1e640 1 -- 172.21.15.132:0/412070062 wait complete. 2023-12-20T04:43:00.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.388+0000 7f98dfe1e640 1 Processor -- start 2023-12-20T04:43:00.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.388+0000 7f98dfe1e640 1 -- start start 2023-12-20T04:43:00.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98dfe1e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c4005180 0x7f98d815ec50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98dfe1e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98d80c8f90 0x7f98d8158320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98dfe1e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98d80c9410 0x7f98d8158860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98dfe1e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d8154d60 con 0x7f98c4005180 2023-12-20T04:43:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98dfe1e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98d815f190 con 0x7f98d80c9410 2023-12-20T04:43:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98dfe1e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98d8154a80 con 0x7f98d80c8f90 2023-12-20T04:43:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98ddbba640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c4005180 0x7f98d815ec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98ddbba640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c4005180 0x7f98d815ec50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60154/0 (socket says 172.21.15.132:60154) 2023-12-20T04:43:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98ddbba640 1 -- 172.21.15.132:0/2595946950 learned_addr learned my addr 172.21.15.132:0/2595946950 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98dd3b9640 1 --2- 172.21.15.132:0/2595946950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98d80c8f90 0x7f98d8158320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98de3bb640 1 --2- 172.21.15.132:0/2595946950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98d80c9410 0x7f98d8158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98ddbba640 1 -- 172.21.15.132:0/2595946950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98d80c8f90 msgr2=0x7f98d8158320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98ddbba640 1 --2- 172.21.15.132:0/2595946950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98d80c8f90 0x7f98d8158320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98ddbba640 1 -- 172.21.15.132:0/2595946950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98d80c9410 msgr2=0x7f98d8158860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98ddbba640 1 --2- 172.21.15.132:0/2595946950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98d80c9410 0x7f98d8158860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98ddbba640 1 -- 172.21.15.132:0/2595946950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d815e170 con 0x7f98c4005180 2023-12-20T04:43:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98ddbba640 1 --2- 172.21.15.132:0/2595946950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c4005180 0x7f98d815ec50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f98d0007a20 tx=0x7f98d000a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98ce7fc640 1 -- 172.21.15.132:0/2595946950 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d0001990 con 0x7f98c4005180 2023-12-20T04:43:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98ce7fc640 1 -- 172.21.15.132:0/2595946950 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f98d00133f0 con 0x7f98c4005180 2023-12-20T04:43:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98ce7fc640 1 -- 172.21.15.132:0/2595946950 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f98d00137a0 con 0x7f98c4005180 2023-12-20T04:43:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.389+0000 7f98dfe1e640 1 -- 172.21.15.132:0/2595946950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98d815e450 con 0x7f98c4005180 2023-12-20T04:43:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.390+0000 7f98dfe1e640 1 -- 172.21.15.132:0/2595946950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98d8153d50 con 0x7f98c4005180 2023-12-20T04:43:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.390+0000 7f98dfe1e640 1 -- 172.21.15.132:0/2595946950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98d815dfd0 con 0x7f98c4005180 2023-12-20T04:43:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.391+0000 7f98ce7fc640 1 -- 172.21.15.132:0/2595946950 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f98d0013900 con 0x7f98c4005180 2023-12-20T04:43:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.391+0000 7f98ce7fc640 1 --2- 172.21.15.132:0/2595946950 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f98bc06a430 0x7f98bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.391+0000 7f98ce7fc640 1 -- 172.21.15.132:0/2595946950 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98d00895b0 con 0x7f98c4005180 2023-12-20T04:43:00.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.391+0000 7f98dd3b9640 1 --2- 172.21.15.132:0/2595946950 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f98bc06a430 0x7f98bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.392+0000 7f98dd3b9640 1 --2- 172.21.15.132:0/2595946950 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f98bc06a430 0x7f98bc06c8f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f98d8153b70 tx=0x7f98c8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:00.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.396+0000 7f98ce7fc640 1 -- 172.21.15.132:0/2595946950 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f98d815dfd0 con 0x7f98c4005180 2023-12-20T04:43:00.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.560+0000 7f98dfe1e640 1 -- 172.21.15.132:0/2595946950 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f98d815dfd0 con 0x7f98c4005180 2023-12-20T04:43:00.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.561+0000 7f98ce7fc640 1 -- 172.21.15.132:0/2595946950 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f98d815dfd0 con 0x7f98c4005180 2023-12-20T04:43:00.563 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:43:00.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.562+0000 7f98dfe1e640 1 -- 172.21.15.132:0/2595946950 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f98bc06a430 msgr2=0x7f98bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.562+0000 7f98dfe1e640 1 --2- 172.21.15.132:0/2595946950 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f98bc06a430 0x7f98bc06c8f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f98d8153b70 tx=0x7f98c8008040 comp rx=0 tx=0).stop 2023-12-20T04:43:00.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.562+0000 7f98dfe1e640 1 -- 172.21.15.132:0/2595946950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c4005180 msgr2=0x7f98d815ec50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.562+0000 7f98dfe1e640 1 --2- 172.21.15.132:0/2595946950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c4005180 0x7f98d815ec50 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f98d0007a20 tx=0x7f98d000a730 comp rx=0 tx=0).stop 2023-12-20T04:43:00.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.563+0000 7f98dfe1e640 1 -- 172.21.15.132:0/2595946950 shutdown_connections 2023-12-20T04:43:00.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.563+0000 7f98dfe1e640 1 --2- 172.21.15.132:0/2595946950 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f98bc06a430 0x7f98bc06c8f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.563+0000 7f98dfe1e640 1 --2- 172.21.15.132:0/2595946950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98d80c9410 0x7f98d8158860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.563+0000 7f98dfe1e640 1 --2- 172.21.15.132:0/2595946950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98d80c8f90 0x7f98d8158320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.563+0000 7f98dfe1e640 1 --2- 172.21.15.132:0/2595946950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98c4005180 0x7f98d815ec50 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.563+0000 7f98dfe1e640 1 -- 172.21.15.132:0/2595946950 >> 172.21.15.132:0/2595946950 conn(0x7f98d806a3d0 msgr2=0x7f98d8159d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:00.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.563+0000 7f98dfe1e640 1 -- 172.21.15.132:0/2595946950 shutdown_connections 2023-12-20T04:43:00.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.563+0000 7f98dfe1e640 1 -- 172.21.15.132:0/2595946950 wait complete. 2023-12-20T04:43:00.575 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:43:00.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.671+0000 7f6ad6c2c640 1 Processor -- start 2023-12-20T04:43:00.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.671+0000 7f6ad6c2c640 1 -- start start 2023-12-20T04:43:00.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.672+0000 7f6ad6c2c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ad006cf00 0x7f6ad00b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.672+0000 7f6ad6c2c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad006ea90 con 0x7f6ad006a340 2023-12-20T04:43:00.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.672+0000 7f6ad6c2c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ad006e160 con 0x7f6ad01588e0 2023-12-20T04:43:00.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.672+0000 7f6ad6c2c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad006d520 con 0x7f6ad006cf00 2023-12-20T04:43:00.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.672+0000 7f6acffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6ad006a340 0x7f6ad006c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60560/0 (socket says 172.21.15.132:60560) 2023-12-20T04:43:00.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.672+0000 7f6acffff640 1 -- 172.21.15.132:0/4031688868 learned_addr learned my addr 172.21.15.132:0/4031688868 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:00.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6ad51c9640 1 --2- 172.21.15.132:0/4031688868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ad006cf00 0x7f6ad00b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acf7fe640 1 -- 172.21.15.132:0/4031688868 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 616583689 0 0) 0x7f6ad006ea90 con 0x7f6ad006a340 2023-12-20T04:43:00.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acf7fe640 1 -- 172.21.15.132:0/4031688868 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ab8003520 con 0x7f6ad006a340 2023-12-20T04:43:00.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acf7fe640 1 -- 172.21.15.132:0/4031688868 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 962377049 0 0) 0x7f6ad006e160 con 0x7f6ad01588e0 2023-12-20T04:43:00.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acf7fe640 1 -- 172.21.15.132:0/4031688868 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6ad006ea90 con 0x7f6ad01588e0 2023-12-20T04:43:00.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acf7fe640 1 -- 172.21.15.132:0/4031688868 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3606931799 0 0) 0x7f6ab8003520 con 0x7f6ad006a340 2023-12-20T04:43:00.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acf7fe640 1 -- 172.21.15.132:0/4031688868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ad006cf00 msgr2=0x7f6ad00b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:00.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acf7fe640 1 --2- 172.21.15.132:0/4031688868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ad006cf00 0x7f6ad00b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acf7fe640 1 -- 172.21.15.132:0/4031688868 >> v1:172.21.15.187:6789/0 conn(0x7f6ad01588e0 legacy=0x7f6ad0069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acf7fe640 1 -- 172.21.15.132:0/4031688868 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad006e440 con 0x7f6ad006a340 2023-12-20T04:43:00.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acf7fe640 1 -- 172.21.15.132:0/4031688868 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f6ac4001670 con 0x7f6ad006a340 2023-12-20T04:43:00.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acf7fe640 1 -- 172.21.15.132:0/4031688868 >> v1:172.21.15.132:6789/0 conn(0x7f6ad006a340 legacy=0x7f6ad006c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acf7fe640 1 --2- 172.21.15.132:0/4031688868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ad006cf00 0x7f6ab8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acf7fe640 1 --2- 172.21.15.132:0/4031688868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ab80040e0 0x7f6ab80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acf7fe640 1 --2- 172.21.15.132:0/4031688868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ab8004d00 0x7f6ab8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acf7fe640 1 -- 172.21.15.132:0/4031688868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad006d520 con 0x7f6ab8004d00 2023-12-20T04:43:00.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acf7fe640 1 -- 172.21.15.132:0/4031688868 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab800bac0 con 0x7f6ab80040e0 2023-12-20T04:43:00.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acf7fe640 1 -- 172.21.15.132:0/4031688868 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ab800bc80 con 0x7f6ad006cf00 2023-12-20T04:43:00.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6ad49c8640 1 --2- 172.21.15.132:0/4031688868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ad006cf00 0x7f6ab8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6ad51c9640 1 --2- 172.21.15.132:0/4031688868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ab8004d00 0x7f6ab8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6acffff640 1 --2- 172.21.15.132:0/4031688868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ab80040e0 0x7f6ab80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6ad51c9640 1 -- 172.21.15.132:0/4031688868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ad006cf00 msgr2=0x7f6ab8003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:00.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6ad51c9640 1 --2- 172.21.15.132:0/4031688868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ad006cf00 0x7f6ab8003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6ad51c9640 1 -- 172.21.15.132:0/4031688868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ab80040e0 msgr2=0x7f6ab80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:00.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6ad51c9640 1 --2- 172.21.15.132:0/4031688868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ab80040e0 0x7f6ab80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6ad51c9640 1 -- 172.21.15.132:0/4031688868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ab8003520 con 0x7f6ab8004d00 2023-12-20T04:43:00.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.673+0000 7f6ad49c8640 1 --2- 172.21.15.132:0/4031688868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ad006cf00 0x7f6ab8003b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:43:00.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.674+0000 7f6ad51c9640 1 --2- 172.21.15.132:0/4031688868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ab8004d00 0x7f6ab8005180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8009fc0 tx=0x7f6ab80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e18cb89335244cfc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:00.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.674+0000 7f6acf7fe640 1 -- 172.21.15.132:0/4031688868 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac802cc20 con 0x7f6ab8004d00 2023-12-20T04:43:00.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.674+0000 7f6acf7fe640 1 -- 172.21.15.132:0/4031688868 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac800f040 con 0x7f6ab8004d00 2023-12-20T04:43:00.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.674+0000 7f6acf7fe640 1 -- 172.21.15.132:0/4031688868 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac8034440 con 0x7f6ab8004d00 2023-12-20T04:43:00.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.675+0000 7f6ad6c2c640 1 -- 172.21.15.132:0/4031688868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ab8004d00 msgr2=0x7f6ab8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.675+0000 7f6ad6c2c640 1 --2- 172.21.15.132:0/4031688868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ab8004d00 0x7f6ab8005180 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f6ac8009fc0 tx=0x7f6ab80057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.675+0000 7f6ad51c9640 1 -- 172.21.15.132:0/4031688868 reap_dead start 2023-12-20T04:43:00.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.675+0000 7f6ad6c2c640 1 -- 172.21.15.132:0/4031688868 shutdown_connections 2023-12-20T04:43:00.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.675+0000 7f6ad6c2c640 1 -- 172.21.15.132:0/4031688868 >> 172.21.15.132:0/4031688868 conn(0x7f6ad00cfca0 msgr2=0x7f6ad00d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:00.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.675+0000 7f6ad6c2c640 1 -- 172.21.15.132:0/4031688868 shutdown_connections 2023-12-20T04:43:00.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.675+0000 7f6ad6c2c640 1 -- 172.21.15.132:0/4031688868 wait complete. 2023-12-20T04:43:00.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.676+0000 7f6ad6c2c640 1 Processor -- start 2023-12-20T04:43:00.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.676+0000 7f6ad6c2c640 1 -- start start 2023-12-20T04:43:00.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6ad6c2c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ab8004d00 0x7f6ad00c5500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6ad6c2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ad00c8c10 0x7f6ad00c9310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6ad6c2c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ad01f5fe0 0x7f6ad01f6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6ad6c2c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad01f69d0 con 0x7f6ad00c8c10 2023-12-20T04:43:00.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6ad6c2c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad00c7820 con 0x7f6ab8004d00 2023-12-20T04:43:00.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6ad6c2c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ad00c7b00 con 0x7f6ad01f5fe0 2023-12-20T04:43:00.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6acffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ad00c8c10 0x7f6ad00c9310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6acffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ad00c8c10 0x7f6ad00c9310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60164/0 (socket says 172.21.15.132:60164) 2023-12-20T04:43:00.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6acffff640 1 -- 172.21.15.132:0/2207623770 learned_addr learned my addr 172.21.15.132:0/2207623770 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:00.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6ad49c8640 1 --2- 172.21.15.132:0/2207623770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ab8004d00 0x7f6ad00c5500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6ad51c9640 1 --2- 172.21.15.132:0/2207623770 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ad01f5fe0 0x7f6ad01f6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6acffff640 1 -- 172.21.15.132:0/2207623770 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ad01f5fe0 msgr2=0x7f6ad01f6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6acffff640 1 --2- 172.21.15.132:0/2207623770 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ad01f5fe0 0x7f6ad01f6490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6acffff640 1 -- 172.21.15.132:0/2207623770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ab8004d00 msgr2=0x7f6ad00c5500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6acffff640 1 --2- 172.21.15.132:0/2207623770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ab8004d00 0x7f6ad00c5500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6acffff640 1 -- 172.21.15.132:0/2207623770 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ad00c7de0 con 0x7f6ad00c8c10 2023-12-20T04:43:00.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6acffff640 1 --2- 172.21.15.132:0/2207623770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ad00c8c10 0x7f6ad00c9310 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4007290 tx=0x7f6ac4007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:00.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6acd7fa640 1 -- 172.21.15.132:0/2207623770 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac4001620 con 0x7f6ad00c8c10 2023-12-20T04:43:00.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6acd7fa640 1 -- 172.21.15.132:0/2207623770 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ac400f9c0 con 0x7f6ad00c8c10 2023-12-20T04:43:00.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6ad6c2c640 1 -- 172.21.15.132:0/2207623770 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ad00c80c0 con 0x7f6ad00c8c10 2023-12-20T04:43:00.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.677+0000 7f6acd7fa640 1 -- 172.21.15.132:0/2207623770 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ac400fd70 con 0x7f6ad00c8c10 2023-12-20T04:43:00.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.678+0000 7f6ad6c2c640 1 -- 172.21.15.132:0/2207623770 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ad00c9850 con 0x7f6ad00c8c10 2023-12-20T04:43:00.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.678+0000 7f6ad6c2c640 1 -- 172.21.15.132:0/2207623770 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ad00c85e0 con 0x7f6ad00c8c10 2023-12-20T04:43:00.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.679+0000 7f6acd7fa640 1 -- 172.21.15.132:0/2207623770 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6ac401d460 con 0x7f6ad00c8c10 2023-12-20T04:43:00.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.679+0000 7f6acd7fa640 1 --2- 172.21.15.132:0/2207623770 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6abc06a430 0x7f6abc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.679+0000 7f6ad49c8640 1 --2- 172.21.15.132:0/2207623770 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6abc06a430 0x7f6abc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:00.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.679+0000 7f6acd7fa640 1 -- 172.21.15.132:0/2207623770 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6ac40889b0 con 0x7f6ad00c8c10 2023-12-20T04:43:00.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.680+0000 7f6ad49c8640 1 --2- 172.21.15.132:0/2207623770 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6abc06a430 0x7f6abc06c8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0005490 tx=0x7f6ac0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:00.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.684+0000 7f6acd7fa640 1 -- 172.21.15.132:0/2207623770 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6ad00c85e0 con 0x7f6ad00c8c10 2023-12-20T04:43:00.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.883+0000 7f6ad6c2c640 1 -- 172.21.15.132:0/2207623770 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f6ad00c85e0 con 0x7f6ad00c8c10 2023-12-20T04:43:00.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.883+0000 7f6acd7fa640 1 -- 172.21.15.132:0/2207623770 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4709 (secure 0 0 0) 0x7f6ad00c85e0 con 0x7f6ad00c8c10 2023-12-20T04:43:00.885 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:00.886 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/342123967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":342123967},{"type":"v1","addr":"172.21.15.187:6835","nonce":342123967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2678730048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2678730048},{"type":"v1","addr":"172.21.15.132:6836","nonce":2678730048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2874427434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2874427434},{"type":"v1","addr":"172.21.15.132:6837","nonce":2874427434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:42:47.150648+0000","modified":"2023-12-20T04:42:49.158537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/839566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":839566266},{"type":"v1","addr":"172.21.15.187:6834","nonce":839566266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-20T04:43:00.886 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2023-12-20T04:43:00.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.885+0000 7f6ad6c2c640 1 -- 172.21.15.132:0/2207623770 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6abc06a430 msgr2=0x7f6abc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.885+0000 7f6ad6c2c640 1 --2- 172.21.15.132:0/2207623770 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6abc06a430 0x7f6abc06c8f0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f6ac0005490 tx=0x7f6ac0009040 comp rx=0 tx=0).stop 2023-12-20T04:43:00.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.885+0000 7f6ad6c2c640 1 -- 172.21.15.132:0/2207623770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ad00c8c10 msgr2=0x7f6ad00c9310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:00.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.885+0000 7f6ad6c2c640 1 --2- 172.21.15.132:0/2207623770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ad00c8c10 0x7f6ad00c9310 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f6ac4007290 tx=0x7f6ac4007750 comp rx=0 tx=0).stop 2023-12-20T04:43:00.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.886+0000 7f6ad6c2c640 1 -- 172.21.15.132:0/2207623770 shutdown_connections 2023-12-20T04:43:00.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.886+0000 7f6ad6c2c640 1 --2- 172.21.15.132:0/2207623770 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6abc06a430 0x7f6abc06c8f0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.886+0000 7f6ad6c2c640 1 --2- 172.21.15.132:0/2207623770 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ad01f5fe0 0x7f6ad01f6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.886+0000 7f6ad6c2c640 1 --2- 172.21.15.132:0/2207623770 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ad00c8c10 0x7f6ad00c9310 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.886+0000 7f6ad6c2c640 1 --2- 172.21.15.132:0/2207623770 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ab8004d00 0x7f6ad00c5500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:00.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.886+0000 7f6ad6c2c640 1 -- 172.21.15.132:0/2207623770 >> 172.21.15.132:0/2207623770 conn(0x7f6ad00cfca0 msgr2=0x7f6ad00cd870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:00.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.886+0000 7f6ad6c2c640 1 -- 172.21.15.132:0/2207623770 shutdown_connections 2023-12-20T04:43:00.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.886+0000 7f6ad6c2c640 1 -- 172.21.15.132:0/2207623770 wait complete. 2023-12-20T04:43:00.899 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:00.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.996+0000 7fae0d8db640 1 Processor -- start 2023-12-20T04:43:00.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.996+0000 7fae0d8db640 1 -- start start 2023-12-20T04:43:00.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.997+0000 7fae0d8db640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fae08160450 0x7fae08160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.997+0000 7fae0d8db640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae080b5090 0x7fae080d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:00.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.997+0000 7fae0d8db640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae080b5ec0 con 0x7fae081611b0 2023-12-20T04:43:01.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.997+0000 7fae0d8db640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae081617e0 con 0x7fae08160450 2023-12-20T04:43:01.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.997+0000 7fae0d8db640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae080d0fc0 con 0x7fae080b5090 2023-12-20T04:43:01.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.997+0000 7fae077fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae080b5090 0x7fae080d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.997+0000 7fae06ffd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fae08160450 0x7fae08160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.997+0000 7fae077fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae080b5090 0x7fae080d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:55734/0 (socket says 172.21.15.132:55734) 2023-12-20T04:43:01.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.997+0000 7fae077fe640 1 -- 172.21.15.132:0/1651443344 learned_addr learned my addr 172.21.15.132:0/1651443344 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:01.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.998+0000 7fae06ffd640 1 -- 172.21.15.132:0/1651443344 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae080b5090 msgr2=0x7fae080d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:01.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.998+0000 7fae06ffd640 1 --2- 172.21.15.132:0/1651443344 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae080b5090 0x7fae080d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.998+0000 7fae06ffd640 1 -- 172.21.15.132:0/1651443344 >> v1:172.21.15.187:6789/0 conn(0x7fae081611b0 legacy=0x7fae080b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.998+0000 7fae06ffd640 1 -- 172.21.15.132:0/1651443344 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae080d12a0 con 0x7fae08160450 2023-12-20T04:43:01.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.998+0000 7fae077fe640 1 --2- 172.21.15.132:0/1651443344 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae080b5090 0x7fae080d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:43:01.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.998+0000 7fae06ffd640 1 --2- 172.21.15.132:0/1651443344 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae08160450 0x7fae08160c70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fadf80097a0 tx=0x7fadf802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2cd187282cbb3ad5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:01.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.998+0000 7fae05ffb640 1 -- 172.21.15.132:0/1651443344 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8030610 con 0x7fae08160450 2023-12-20T04:43:01.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.998+0000 7fae05ffb640 1 -- 172.21.15.132:0/1651443344 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf8030770 con 0x7fae08160450 2023-12-20T04:43:01.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.998+0000 7fae05ffb640 1 -- 172.21.15.132:0/1651443344 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8030b00 con 0x7fae08160450 2023-12-20T04:43:01.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.999+0000 7fae0d8db640 1 -- 172.21.15.132:0/1651443344 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae08160450 msgr2=0x7fae08160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.999+0000 7fae0d8db640 1 --2- 172.21.15.132:0/1651443344 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae08160450 0x7fae08160c70 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7fadf80097a0 tx=0x7fadf802b960 comp rx=0 tx=0).stop 2023-12-20T04:43:01.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.999+0000 7fae0d8db640 1 -- 172.21.15.132:0/1651443344 shutdown_connections 2023-12-20T04:43:01.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.999+0000 7fae0d8db640 1 --2- 172.21.15.132:0/1651443344 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae080b5090 0x7fae080d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.999+0000 7fae0d8db640 1 --2- 172.21.15.132:0/1651443344 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae08160450 0x7fae08160c70 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.999+0000 7fae0d8db640 1 -- 172.21.15.132:0/1651443344 >> 172.21.15.132:0/1651443344 conn(0x7fae080cf980 msgr2=0x7fae080cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:01.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.999+0000 7fae0d8db640 1 -- 172.21.15.132:0/1651443344 shutdown_connections 2023-12-20T04:43:01.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:00.999+0000 7fae0d8db640 1 -- 172.21.15.132:0/1651443344 wait complete. 2023-12-20T04:43:01.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.000+0000 7fae0d8db640 1 Processor -- start 2023-12-20T04:43:01.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.000+0000 7fae0d8db640 1 -- start start 2023-12-20T04:43:01.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.001+0000 7fae0d8db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae080b5090 0x7fae0815d510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.001+0000 7fae0d8db640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae08160450 0x7fae08159c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.001+0000 7fae0d8db640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae081611b0 0x7fae0815a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.001+0000 7fae0d8db640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0815da50 con 0x7fae080b5090 2023-12-20T04:43:01.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.001+0000 7fae0d8db640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae0815dcf0 con 0x7fae081611b0 2023-12-20T04:43:01.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.001+0000 7fae0d8db640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae0815dfd0 con 0x7fae08160450 2023-12-20T04:43:01.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.001+0000 7fae06ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae080b5090 0x7fae0815d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.001+0000 7fae06ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae080b5090 0x7fae0815d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60178/0 (socket says 172.21.15.132:60178) 2023-12-20T04:43:01.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.001+0000 7fae06ffd640 1 -- 172.21.15.132:0/1720041668 learned_addr learned my addr 172.21.15.132:0/1720041668 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:01.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.001+0000 7fae067fc640 1 --2- 172.21.15.132:0/1720041668 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae08160450 0x7fae08159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.001+0000 7fae077fe640 1 --2- 172.21.15.132:0/1720041668 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae081611b0 0x7fae0815a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.001+0000 7fae06ffd640 1 -- 172.21.15.132:0/1720041668 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae08160450 msgr2=0x7fae08159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.001+0000 7fae06ffd640 1 --2- 172.21.15.132:0/1720041668 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae08160450 0x7fae08159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.001+0000 7fae06ffd640 1 -- 172.21.15.132:0/1720041668 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae081611b0 msgr2=0x7fae0815a1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.001+0000 7fae06ffd640 1 --2- 172.21.15.132:0/1720041668 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae081611b0 0x7fae0815a1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.001+0000 7fae06ffd640 1 -- 172.21.15.132:0/1720041668 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae00009b30 con 0x7fae080b5090 2023-12-20T04:43:01.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.001+0000 7fae077fe640 1 --2- 172.21.15.132:0/1720041668 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae081611b0 0x7fae0815a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:01.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.002+0000 7fae06ffd640 1 --2- 172.21.15.132:0/1720041668 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae080b5090 0x7fae0815d510 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fadf80098c0 tx=0x7fadf8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:01.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.002+0000 7fadeffff640 1 -- 172.21.15.132:0/1720041668 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf803e040 con 0x7fae080b5090 2023-12-20T04:43:01.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.002+0000 7fadeffff640 1 -- 172.21.15.132:0/1720041668 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadf8039cb0 con 0x7fae080b5090 2023-12-20T04:43:01.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.002+0000 7fadeffff640 1 -- 172.21.15.132:0/1720041668 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadf8044630 con 0x7fae080b5090 2023-12-20T04:43:01.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.002+0000 7fae0d8db640 1 -- 172.21.15.132:0/1720041668 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadf8009400 con 0x7fae080b5090 2023-12-20T04:43:01.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.002+0000 7fae0d8db640 1 -- 172.21.15.132:0/1720041668 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0815e590 con 0x7fae080b5090 2023-12-20T04:43:01.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.003+0000 7fae0d8db640 1 -- 172.21.15.132:0/1720041668 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0804e840 con 0x7fae080b5090 2023-12-20T04:43:01.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.003+0000 7fadeffff640 1 -- 172.21.15.132:0/1720041668 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fadf8043390 con 0x7fae080b5090 2023-12-20T04:43:01.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.003+0000 7fadeffff640 1 --2- 172.21.15.132:0/1720041668 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fadf406a430 0x7fadf406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.004+0000 7fae067fc640 1 --2- 172.21.15.132:0/1720041668 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fadf406a430 0x7fadf406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.004+0000 7fadeffff640 1 -- 172.21.15.132:0/1720041668 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadf80aaa60 con 0x7fae080b5090 2023-12-20T04:43:01.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.004+0000 7fae067fc640 1 --2- 172.21.15.132:0/1720041668 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fadf406a430 0x7fadf406c8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fae0815f250 tx=0x7fadfc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:01.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.008+0000 7fadeffff640 1 -- 172.21.15.132:0/1720041668 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fadf8076100 con 0x7fae080b5090 2023-12-20T04:43:01.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.177+0000 7fae0d8db640 1 -- 172.21.15.132:0/1720041668 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fae080d0ad0 con 0x7fae080b5090 2023-12-20T04:43:01.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.178+0000 7fadeffff640 1 -- 172.21.15.132:0/1720041668 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fadf8079720 con 0x7fae080b5090 2023-12-20T04:43:01.180 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:01.180 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:01.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.181+0000 7fae0d8db640 1 -- 172.21.15.132:0/1720041668 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fadf406a430 msgr2=0x7fadf406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.181+0000 7fae0d8db640 1 --2- 172.21.15.132:0/1720041668 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fadf406a430 0x7fadf406c8f0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fae0815f250 tx=0x7fadfc009040 comp rx=0 tx=0).stop 2023-12-20T04:43:01.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.181+0000 7fae0d8db640 1 -- 172.21.15.132:0/1720041668 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae080b5090 msgr2=0x7fae0815d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.181+0000 7fae0d8db640 1 --2- 172.21.15.132:0/1720041668 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae080b5090 0x7fae0815d510 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7fadf80098c0 tx=0x7fadf8004730 comp rx=0 tx=0).stop 2023-12-20T04:43:01.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.181+0000 7fae0d8db640 1 -- 172.21.15.132:0/1720041668 shutdown_connections 2023-12-20T04:43:01.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.181+0000 7fae0d8db640 1 --2- 172.21.15.132:0/1720041668 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fadf406a430 0x7fadf406c8f0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.181+0000 7fae0d8db640 1 --2- 172.21.15.132:0/1720041668 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae081611b0 0x7fae0815a1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.181+0000 7fae0d8db640 1 --2- 172.21.15.132:0/1720041668 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae08160450 0x7fae08159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.181+0000 7fae0d8db640 1 --2- 172.21.15.132:0/1720041668 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae080b5090 0x7fae0815d510 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.181+0000 7fae0d8db640 1 -- 172.21.15.132:0/1720041668 >> 172.21.15.132:0/1720041668 conn(0x7fae080cf980 msgr2=0x7fae080d3350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:01.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.181+0000 7fae0d8db640 1 -- 172.21.15.132:0/1720041668 shutdown_connections 2023-12-20T04:43:01.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.181+0000 7fae0d8db640 1 -- 172.21.15.132:0/1720041668 wait complete. 2023-12-20T04:43:01.194 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:42:45.433456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:42:46.128920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:43:01.194 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:43:01.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.294+0000 7f0a30c2c640 1 Processor -- start 2023-12-20T04:43:01.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.294+0000 7f0a30c2c640 1 -- start start 2023-12-20T04:43:01.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.295+0000 7f0a30c2c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0a2c15d300 0x7f0a2c06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.295+0000 7f0a30c2c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a2c0cd4b0 0x7f0a2c0cd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.295+0000 7f0a30c2c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0a2c06cc90 con 0x7f0a2c15cf20 2023-12-20T04:43:01.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.295+0000 7f0a30c2c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a2c0cdea0 con 0x7f0a2c15d300 2023-12-20T04:43:01.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.295+0000 7f0a30c2c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0b2f30 con 0x7f0a2c0cd4b0 2023-12-20T04:43:01.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.295+0000 7f0a29d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0a2c15d300 0x7f0a2c06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.295+0000 7f0a29d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0a2c15d300 0x7f0a2c06c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60182/0 (socket says 172.21.15.132:60182) 2023-12-20T04:43:01.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.295+0000 7f0a29d9b640 1 -- 172.21.15.132:0/1051183461 learned_addr learned my addr 172.21.15.132:0/1051183461 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:01.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.295+0000 7f0a2ad9d640 1 --2- 172.21.15.132:0/1051183461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a2c0cd4b0 0x7f0a2c0cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.295+0000 7f0a29d9b640 1 -- 172.21.15.132:0/1051183461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a2c0cd4b0 msgr2=0x7f0a2c0cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:01.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.295+0000 7f0a29d9b640 1 --2- 172.21.15.132:0/1051183461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a2c0cd4b0 0x7f0a2c0cd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.295+0000 7f0a29d9b640 1 -- 172.21.15.132:0/1051183461 >> v1:172.21.15.187:6789/0 conn(0x7f0a2c15cf20 legacy=0x7f0a2c161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.295+0000 7f0a29d9b640 1 -- 172.21.15.132:0/1051183461 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a2c0b3210 con 0x7f0a2c15d300 2023-12-20T04:43:01.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.295+0000 7f0a2ad9d640 1 --2- 172.21.15.132:0/1051183461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a2c0cd4b0 0x7f0a2c0cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:01.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.296+0000 7f0a29d9b640 1 --2- 172.21.15.132:0/1051183461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a2c15d300 0x7f0a2c06c590 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009870 tx=0x7f0a2002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b641007d720d24ea server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:01.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.296+0000 7f0a2959a640 1 -- 172.21.15.132:0/1051183461 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20030840 con 0x7f0a2c15d300 2023-12-20T04:43:01.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.296+0000 7f0a2959a640 1 -- 172.21.15.132:0/1051183461 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a200309a0 con 0x7f0a2c15d300 2023-12-20T04:43:01.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.296+0000 7f0a2959a640 1 -- 172.21.15.132:0/1051183461 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a20030d30 con 0x7f0a2c15d300 2023-12-20T04:43:01.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.297+0000 7f0a30c2c640 1 -- 172.21.15.132:0/1051183461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a2c15d300 msgr2=0x7f0a2c06c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.297+0000 7f0a30c2c640 1 --2- 172.21.15.132:0/1051183461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a2c15d300 0x7f0a2c06c590 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f0a20009870 tx=0x7f0a2002b980 comp rx=0 tx=0).stop 2023-12-20T04:43:01.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.297+0000 7f0a30c2c640 1 -- 172.21.15.132:0/1051183461 shutdown_connections 2023-12-20T04:43:01.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.297+0000 7f0a30c2c640 1 --2- 172.21.15.132:0/1051183461 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a2c0cd4b0 0x7f0a2c0cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.297+0000 7f0a30c2c640 1 --2- 172.21.15.132:0/1051183461 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a2c15d300 0x7f0a2c06c590 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.297+0000 7f0a30c2c640 1 -- 172.21.15.132:0/1051183461 >> 172.21.15.132:0/1051183461 conn(0x7f0a2c072c60 msgr2=0x7f0a2c073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:01.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.297+0000 7f0a30c2c640 1 -- 172.21.15.132:0/1051183461 shutdown_connections 2023-12-20T04:43:01.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.297+0000 7f0a30c2c640 1 -- 172.21.15.132:0/1051183461 wait complete. 2023-12-20T04:43:01.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.298+0000 7f0a30c2c640 1 Processor -- start 2023-12-20T04:43:01.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.298+0000 7f0a30c2c640 1 -- start start 2023-12-20T04:43:01.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.299+0000 7f0a30c2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a2c0cd4b0 0x7f0a2c0ad5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.299+0000 7f0a30c2c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a2c15cf20 0x7f0a2c14f170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.299+0000 7f0a30c2c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a2c15d300 0x7f0a2c0b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.299+0000 7f0a30c2c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0adae0 con 0x7f0a2c0cd4b0 2023-12-20T04:43:01.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.299+0000 7f0a30c2c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c14f6b0 con 0x7f0a2c15d300 2023-12-20T04:43:01.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.299+0000 7f0a30c2c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a2c0b4ff0 con 0x7f0a2c15cf20 2023-12-20T04:43:01.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.299+0000 7f0a2a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a2c0cd4b0 0x7f0a2c0ad5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.299+0000 7f0a2a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a2c0cd4b0 0x7f0a2c0ad5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60190/0 (socket says 172.21.15.132:60190) 2023-12-20T04:43:01.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.299+0000 7f0a2a59c640 1 -- 172.21.15.132:0/957257783 learned_addr learned my addr 172.21.15.132:0/957257783 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:01.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.299+0000 7f0a29d9b640 1 --2- 172.21.15.132:0/957257783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a2c15cf20 0x7f0a2c14f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.299+0000 7f0a2ad9d640 1 --2- 172.21.15.132:0/957257783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a2c15d300 0x7f0a2c0b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.299+0000 7f0a2a59c640 1 -- 172.21.15.132:0/957257783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a2c15cf20 msgr2=0x7f0a2c14f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.299+0000 7f0a2a59c640 1 --2- 172.21.15.132:0/957257783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a2c15cf20 0x7f0a2c14f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.299+0000 7f0a2a59c640 1 -- 172.21.15.132:0/957257783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a2c15d300 msgr2=0x7f0a2c0b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.299+0000 7f0a2a59c640 1 --2- 172.21.15.132:0/957257783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a2c15d300 0x7f0a2c0b4780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.299+0000 7f0a2a59c640 1 -- 172.21.15.132:0/957257783 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a200094d0 con 0x7f0a2c0cd4b0 2023-12-20T04:43:01.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.299+0000 7f0a2a59c640 1 --2- 172.21.15.132:0/957257783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a2c0cd4b0 0x7f0a2c0ad5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00c870 tx=0x7f0a1c00cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:01.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.300+0000 7f0a1affd640 1 -- 172.21.15.132:0/957257783 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c003b70 con 0x7f0a2c0cd4b0 2023-12-20T04:43:01.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.300+0000 7f0a1affd640 1 -- 172.21.15.132:0/957257783 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a1c003cf0 con 0x7f0a2c0cd4b0 2023-12-20T04:43:01.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.300+0000 7f0a1affd640 1 -- 172.21.15.132:0/957257783 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a1c00aa30 con 0x7f0a2c0cd4b0 2023-12-20T04:43:01.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.300+0000 7f0a30c2c640 1 -- 172.21.15.132:0/957257783 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a2c0b52d0 con 0x7f0a2c0cd4b0 2023-12-20T04:43:01.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.300+0000 7f0a30c2c640 1 -- 172.21.15.132:0/957257783 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a2c0c4b10 con 0x7f0a2c0cd4b0 2023-12-20T04:43:01.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.301+0000 7f0a30c2c640 1 -- 172.21.15.132:0/957257783 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a2c04e840 con 0x7f0a2c0cd4b0 2023-12-20T04:43:01.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.301+0000 7f0a1affd640 1 -- 172.21.15.132:0/957257783 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0a1c00ab90 con 0x7f0a2c0cd4b0 2023-12-20T04:43:01.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.301+0000 7f0a1affd640 1 --2- 172.21.15.132:0/957257783 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0a0c06a430 0x7f0a0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.301+0000 7f0a1affd640 1 -- 172.21.15.132:0/957257783 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0a1c088650 con 0x7f0a2c0cd4b0 2023-12-20T04:43:01.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.301+0000 7f0a29d9b640 1 --2- 172.21.15.132:0/957257783 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0a0c06a430 0x7f0a0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.302+0000 7f0a29d9b640 1 --2- 172.21.15.132:0/957257783 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0a0c06a430 0x7f0a0c06c8f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a20036000 tx=0x7f0a2003b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:01.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.306+0000 7f0a1affd640 1 -- 172.21.15.132:0/957257783 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0a1c053cf0 con 0x7f0a2c0cd4b0 2023-12-20T04:43:01.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.471+0000 7f0a30c2c640 1 -- 172.21.15.132:0/957257783 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0a2c15e960 con 0x7f0a2c0cd4b0 2023-12-20T04:43:01.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.472+0000 7f0a1affd640 1 -- 172.21.15.132:0/957257783 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0a1c003e60 con 0x7f0a2c0cd4b0 2023-12-20T04:43:01.474 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:43:01.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.474+0000 7f0a30c2c640 1 -- 172.21.15.132:0/957257783 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0a0c06a430 msgr2=0x7f0a0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.474+0000 7f0a30c2c640 1 --2- 172.21.15.132:0/957257783 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0a0c06a430 0x7f0a0c06c8f0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a20036000 tx=0x7f0a2003b040 comp rx=0 tx=0).stop 2023-12-20T04:43:01.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.474+0000 7f0a30c2c640 1 -- 172.21.15.132:0/957257783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a2c0cd4b0 msgr2=0x7f0a2c0ad5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.474+0000 7f0a30c2c640 1 --2- 172.21.15.132:0/957257783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a2c0cd4b0 0x7f0a2c0ad5a0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f0a1c00c870 tx=0x7f0a1c00cd30 comp rx=0 tx=0).stop 2023-12-20T04:43:01.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.474+0000 7f0a30c2c640 1 -- 172.21.15.132:0/957257783 shutdown_connections 2023-12-20T04:43:01.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.474+0000 7f0a30c2c640 1 --2- 172.21.15.132:0/957257783 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0a0c06a430 0x7f0a0c06c8f0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.474+0000 7f0a30c2c640 1 --2- 172.21.15.132:0/957257783 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a2c15d300 0x7f0a2c0b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.474+0000 7f0a30c2c640 1 --2- 172.21.15.132:0/957257783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a2c15cf20 0x7f0a2c14f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.474+0000 7f0a30c2c640 1 --2- 172.21.15.132:0/957257783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a2c0cd4b0 0x7f0a2c0ad5a0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.474+0000 7f0a30c2c640 1 -- 172.21.15.132:0/957257783 >> 172.21.15.132:0/957257783 conn(0x7f0a2c072c60 msgr2=0x7f0a2c0ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:01.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.474+0000 7f0a30c2c640 1 -- 172.21.15.132:0/957257783 shutdown_connections 2023-12-20T04:43:01.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.474+0000 7f0a30c2c640 1 -- 172.21.15.132:0/957257783 wait complete. 2023-12-20T04:43:01.487 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:43:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.588+0000 7f548ce2c640 1 Processor -- start 2023-12-20T04:43:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.588+0000 7f548ce2c640 1 -- start start 2023-12-20T04:43:01.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.588+0000 7f548ce2c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f548815d300 0x7f54880d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.588+0000 7f548ce2c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f54880d1550 0x7f54880cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.588+0000 7f548ce2c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54880cfdc0 0x7f54880b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.588+0000 7f548ce2c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54880d01f0 con 0x7f54880d1550 2023-12-20T04:43:01.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.588+0000 7f548ce2c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f54880d1a90 con 0x7f548815d300 2023-12-20T04:43:01.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.588+0000 7f548ce2c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54880d1d70 con 0x7f54880cfdc0 2023-12-20T04:43:01.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.589+0000 7f547dd9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f54880d1550 0x7f54880cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.589+0000 7f547dd9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f54880d1550 0x7f54880cf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60200/0 (socket says 172.21.15.132:60200) 2023-12-20T04:43:01.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.589+0000 7f547dd9b640 1 -- 172.21.15.132:0/656218540 learned_addr learned my addr 172.21.15.132:0/656218540 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:01.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.589+0000 7f5486d9d640 1 --2- 172.21.15.132:0/656218540 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54880cfdc0 0x7f54880b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.589+0000 7f548659c640 1 --2- 172.21.15.132:0/656218540 >> v2:172.21.15.187:3300/0 conn(0x7f548815d300 0x7f54880d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.589+0000 7f547dd9b640 1 -- 172.21.15.132:0/656218540 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54880cfdc0 msgr2=0x7f54880b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:01.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.589+0000 7f547dd9b640 1 --2- 172.21.15.132:0/656218540 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54880cfdc0 0x7f54880b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.589+0000 7f547dd9b640 1 -- 172.21.15.132:0/656218540 >> v2:172.21.15.187:3300/0 conn(0x7f548815d300 msgr2=0x7f54880d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:01.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.589+0000 7f547dd9b640 1 --2- 172.21.15.132:0/656218540 >> v2:172.21.15.187:3300/0 conn(0x7f548815d300 0x7f54880d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.589+0000 7f547dd9b640 1 -- 172.21.15.132:0/656218540 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f54880d2050 con 0x7f54880d1550 2023-12-20T04:43:01.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.589+0000 7f547dd9b640 1 --2- 172.21.15.132:0/656218540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54880d1550 0x7f54880cf880 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f54880cf850 tx=0x7f547002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30b0f6922154b172 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:01.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.590+0000 7f5485d9b640 1 -- 172.21.15.132:0/656218540 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470004230 con 0x7f54880d1550 2023-12-20T04:43:01.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.590+0000 7f5485d9b640 1 -- 172.21.15.132:0/656218540 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5470004390 con 0x7f54880d1550 2023-12-20T04:43:01.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.590+0000 7f5485d9b640 1 -- 172.21.15.132:0/656218540 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470003810 con 0x7f54880d1550 2023-12-20T04:43:01.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.590+0000 7f548ce2c640 1 -- 172.21.15.132:0/656218540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54880d1550 msgr2=0x7f54880cf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.590+0000 7f548ce2c640 1 --2- 172.21.15.132:0/656218540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54880d1550 0x7f54880cf880 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f54880cf850 tx=0x7f547002b8f0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.590+0000 7f548ce2c640 1 -- 172.21.15.132:0/656218540 shutdown_connections 2023-12-20T04:43:01.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.590+0000 7f548ce2c640 1 --2- 172.21.15.132:0/656218540 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54880cfdc0 0x7f54880b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.590+0000 7f548ce2c640 1 --2- 172.21.15.132:0/656218540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54880d1550 0x7f54880cf880 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.590+0000 7f548ce2c640 1 --2- 172.21.15.132:0/656218540 >> v2:172.21.15.187:3300/0 conn(0x7f548815d300 0x7f54880d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.590+0000 7f548ce2c640 1 -- 172.21.15.132:0/656218540 >> 172.21.15.132:0/656218540 conn(0x7f548806a3d0 msgr2=0x7f548806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:01.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.590+0000 7f548ce2c640 1 -- 172.21.15.132:0/656218540 shutdown_connections 2023-12-20T04:43:01.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.590+0000 7f548ce2c640 1 -- 172.21.15.132:0/656218540 wait complete. 2023-12-20T04:43:01.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.592+0000 7f548ce2c640 1 Processor -- start 2023-12-20T04:43:01.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.592+0000 7f548ce2c640 1 -- start start 2023-12-20T04:43:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.592+0000 7f548ce2c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54880cfdc0 0x7f548814a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.592+0000 7f548ce2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54880d1550 0x7f54880cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.592+0000 7f548ce2c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f548815d300 0x7f54880c8a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.592+0000 7f548ce2c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54880cb110 con 0x7f54880d1550 2023-12-20T04:43:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.592+0000 7f548ce2c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f54880cbae0 con 0x7f548815d300 2023-12-20T04:43:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.592+0000 7f548ce2c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f54880ca500 con 0x7f54880cfdc0 2023-12-20T04:43:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.592+0000 7f547dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54880d1550 0x7f54880cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.592+0000 7f547dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54880d1550 0x7f54880cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60210/0 (socket says 172.21.15.132:60210) 2023-12-20T04:43:01.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.592+0000 7f547dd9b640 1 -- 172.21.15.132:0/1173828312 learned_addr learned my addr 172.21.15.132:0/1173828312 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.593+0000 7f548659c640 1 --2- 172.21.15.132:0/1173828312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54880cfdc0 0x7f548814a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.593+0000 7f5486d9d640 1 --2- 172.21.15.132:0/1173828312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f548815d300 0x7f54880c8a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.593+0000 7f547dd9b640 1 -- 172.21.15.132:0/1173828312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54880cfdc0 msgr2=0x7f548814a050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.593+0000 7f547dd9b640 1 --2- 172.21.15.132:0/1173828312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54880cfdc0 0x7f548814a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.593+0000 7f547dd9b640 1 -- 172.21.15.132:0/1173828312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f548815d300 msgr2=0x7f54880c8a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.593+0000 7f547dd9b640 1 --2- 172.21.15.132:0/1173828312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f548815d300 0x7f54880c8a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.593+0000 7f547dd9b640 1 -- 172.21.15.132:0/1173828312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5470009460 con 0x7f54880d1550 2023-12-20T04:43:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.593+0000 7f547dd9b640 1 --2- 172.21.15.132:0/1173828312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54880d1550 0x7f54880cb5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5470000c00 tx=0x7f54700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.593+0000 7f547f7fe640 1 -- 172.21.15.132:0/1173828312 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470003c40 con 0x7f54880d1550 2023-12-20T04:43:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.593+0000 7f547f7fe640 1 -- 172.21.15.132:0/1173828312 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f547003f070 con 0x7f54880d1550 2023-12-20T04:43:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.593+0000 7f548ce2c640 1 -- 172.21.15.132:0/1173828312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f54880ca7e0 con 0x7f54880d1550 2023-12-20T04:43:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.593+0000 7f547f7fe640 1 -- 172.21.15.132:0/1173828312 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5470004500 con 0x7f54880d1550 2023-12-20T04:43:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.593+0000 7f548ce2c640 1 -- 172.21.15.132:0/1173828312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f54880cada0 con 0x7f54880d1550 2023-12-20T04:43:01.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.594+0000 7f548ce2c640 1 -- 172.21.15.132:0/1173828312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f54880caf30 con 0x7f54880d1550 2023-12-20T04:43:01.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.594+0000 7f547f7fe640 1 -- 172.21.15.132:0/1173828312 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5470041030 con 0x7f54880d1550 2023-12-20T04:43:01.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.595+0000 7f547f7fe640 1 --2- 172.21.15.132:0/1173828312 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f546806a460 0x7f546806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.595+0000 7f548659c640 1 --2- 172.21.15.132:0/1173828312 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f546806a460 0x7f546806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.595+0000 7f547f7fe640 1 -- 172.21.15.132:0/1173828312 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f54700aab90 con 0x7f54880d1550 2023-12-20T04:43:01.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.595+0000 7f548659c640 1 --2- 172.21.15.132:0/1173828312 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f546806a460 0x7f546806c920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5478006fd0 tx=0x7f5478008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:01.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.599+0000 7f547f7fe640 1 -- 172.21.15.132:0/1173828312 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f54700762a0 con 0x7f54880d1550 2023-12-20T04:43:01.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.763+0000 7f548ce2c640 1 -- 172.21.15.132:0/1173828312 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f548804e840 con 0x7f54880d1550 2023-12-20T04:43:01.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.763+0000 7f547f7fe640 1 -- 172.21.15.132:0/1173828312 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f54700798c0 con 0x7f54880d1550 2023-12-20T04:43:01.767 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:43:01.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.765+0000 7f548ce2c640 1 -- 172.21.15.132:0/1173828312 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f546806a460 msgr2=0x7f546806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.765+0000 7f548ce2c640 1 --2- 172.21.15.132:0/1173828312 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f546806a460 0x7f546806c920 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f5478006fd0 tx=0x7f5478008040 comp rx=0 tx=0).stop 2023-12-20T04:43:01.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.765+0000 7f548ce2c640 1 -- 172.21.15.132:0/1173828312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54880d1550 msgr2=0x7f54880cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.765+0000 7f548ce2c640 1 --2- 172.21.15.132:0/1173828312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54880d1550 0x7f54880cb5a0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f5470000c00 tx=0x7f54700046c0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.765+0000 7f548ce2c640 1 -- 172.21.15.132:0/1173828312 shutdown_connections 2023-12-20T04:43:01.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.765+0000 7f548ce2c640 1 --2- 172.21.15.132:0/1173828312 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f546806a460 0x7f546806c920 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.765+0000 7f548ce2c640 1 --2- 172.21.15.132:0/1173828312 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f548815d300 0x7f54880c8a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.765+0000 7f548ce2c640 1 --2- 172.21.15.132:0/1173828312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f54880d1550 0x7f54880cb5a0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.765+0000 7f548ce2c640 1 --2- 172.21.15.132:0/1173828312 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f54880cfdc0 0x7f548814a050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.765+0000 7f548ce2c640 1 -- 172.21.15.132:0/1173828312 >> 172.21.15.132:0/1173828312 conn(0x7f548806a3d0 msgr2=0x7f5488158d00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:01.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.765+0000 7f548ce2c640 1 -- 172.21.15.132:0/1173828312 shutdown_connections 2023-12-20T04:43:01.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.765+0000 7f548ce2c640 1 -- 172.21.15.132:0/1173828312 wait complete. 2023-12-20T04:43:01.778 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:43:01.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.879+0000 7f935eaa1640 1 Processor -- start 2023-12-20T04:43:01.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.879+0000 7f935eaa1640 1 -- start start 2023-12-20T04:43:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.880+0000 7f935eaa1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f93580cf1d0 0x7f935815e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.880+0000 7f935eaa1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93580ce7e0 0x7f93580708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.880+0000 7f935eaa1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f935815e740 con 0x7f9358070460 2023-12-20T04:43:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.880+0000 7f935eaa1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9358070e30 con 0x7f93580cf1d0 2023-12-20T04:43:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.880+0000 7f935eaa1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93580cb6b0 con 0x7f93580ce7e0 2023-12-20T04:43:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.880+0000 7f935c83d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f93580cf1d0 0x7f935815e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.880+0000 7f935c83d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f93580cf1d0 0x7f935815e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60218/0 (socket says 172.21.15.132:60218) 2023-12-20T04:43:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.880+0000 7f935c83d640 1 -- 172.21.15.132:0/3627079017 learned_addr learned my addr 172.21.15.132:0/3627079017 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.880+0000 7f9357fff640 1 --1- 172.21.15.132:0/3627079017 >> v1:172.21.15.132:6789/0 conn(0x7f9358070460 0x7f93580c4a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60566/0 (socket says 172.21.15.132:60566) 2023-12-20T04:43:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.881+0000 7f935c83d640 1 -- 172.21.15.132:0/3627079017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93580ce7e0 msgr2=0x7f93580708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.881+0000 7f935d03e640 1 --2- 172.21.15.132:0/3627079017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93580ce7e0 0x7f93580708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.881+0000 7f93577fe640 1 -- 172.21.15.132:0/3627079017 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1146140098 0 0) 0x7f935815e740 con 0x7f9358070460 2023-12-20T04:43:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.881+0000 7f935c83d640 1 --2- 172.21.15.132:0/3627079017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93580ce7e0 0x7f93580708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.881+0000 7f935c83d640 1 -- 172.21.15.132:0/3627079017 >> v1:172.21.15.132:6789/0 conn(0x7f9358070460 legacy=0x7f93580c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.881+0000 7f935c83d640 1 -- 172.21.15.132:0/3627079017 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93580cb990 con 0x7f93580cf1d0 2023-12-20T04:43:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.881+0000 7f935c83d640 1 --2- 172.21.15.132:0/3627079017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93580cf1d0 0x7f935815e200 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9348009870 tx=0x7f934802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43c2c5f0419b675 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.882+0000 7f93577fe640 1 -- 172.21.15.132:0/3627079017 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348030840 con 0x7f93580cf1d0 2023-12-20T04:43:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.882+0000 7f93577fe640 1 -- 172.21.15.132:0/3627079017 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93480309a0 con 0x7f93580cf1d0 2023-12-20T04:43:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.882+0000 7f93577fe640 1 -- 172.21.15.132:0/3627079017 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9348030d30 con 0x7f93580cf1d0 2023-12-20T04:43:01.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.882+0000 7f935eaa1640 1 -- 172.21.15.132:0/3627079017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93580cf1d0 msgr2=0x7f935815e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.882+0000 7f935eaa1640 1 --2- 172.21.15.132:0/3627079017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93580cf1d0 0x7f935815e200 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f9348009870 tx=0x7f934802b980 comp rx=0 tx=0).stop 2023-12-20T04:43:01.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.882+0000 7f935eaa1640 1 -- 172.21.15.132:0/3627079017 shutdown_connections 2023-12-20T04:43:01.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.882+0000 7f935eaa1640 1 --2- 172.21.15.132:0/3627079017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93580ce7e0 0x7f93580708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.882+0000 7f935eaa1640 1 --2- 172.21.15.132:0/3627079017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93580cf1d0 0x7f935815e200 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.882+0000 7f935eaa1640 1 -- 172.21.15.132:0/3627079017 >> 172.21.15.132:0/3627079017 conn(0x7f93580cc630 msgr2=0x7f93580cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:01.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.882+0000 7f935eaa1640 1 -- 172.21.15.132:0/3627079017 shutdown_connections 2023-12-20T04:43:01.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.882+0000 7f935eaa1640 1 -- 172.21.15.132:0/3627079017 wait complete. 2023-12-20T04:43:01.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.883+0000 7f935eaa1640 1 Processor -- start 2023-12-20T04:43:01.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.883+0000 7f935eaa1640 1 -- start start 2023-12-20T04:43:01.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.884+0000 7f935eaa1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9358070460 0x7f935815be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.884+0000 7f935eaa1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93580ce7e0 0x7f93581f2580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.884+0000 7f935eaa1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93580cf1d0 0x7f93580b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.884+0000 7f935eaa1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93581f2ac0 con 0x7f93580ce7e0 2023-12-20T04:43:01.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.884+0000 7f935eaa1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f935815cd40 con 0x7f9358070460 2023-12-20T04:43:01.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.884+0000 7f935eaa1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9358159ce0 con 0x7f93580cf1d0 2023-12-20T04:43:01.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.884+0000 7f9357fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93580ce7e0 0x7f93581f2580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.884+0000 7f9357fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93580ce7e0 0x7f93581f2580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60222/0 (socket says 172.21.15.132:60222) 2023-12-20T04:43:01.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.884+0000 7f9357fff640 1 -- 172.21.15.132:0/477357330 learned_addr learned my addr 172.21.15.132:0/477357330 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:01.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.884+0000 7f935d03e640 1 --2- 172.21.15.132:0/477357330 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93580cf1d0 0x7f93580b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.884+0000 7f935c83d640 1 --2- 172.21.15.132:0/477357330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9358070460 0x7f935815be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.885+0000 7f9357fff640 1 -- 172.21.15.132:0/477357330 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93580cf1d0 msgr2=0x7f93580b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.885+0000 7f9357fff640 1 --2- 172.21.15.132:0/477357330 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93580cf1d0 0x7f93580b28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.885+0000 7f9357fff640 1 -- 172.21.15.132:0/477357330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9358070460 msgr2=0x7f935815be10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:01.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.885+0000 7f9357fff640 1 --2- 172.21.15.132:0/477357330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9358070460 0x7f935815be10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:01.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.885+0000 7f9357fff640 1 -- 172.21.15.132:0/477357330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93480094d0 con 0x7f93580ce7e0 2023-12-20T04:43:01.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.885+0000 7f9357fff640 1 --2- 172.21.15.132:0/477357330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93580ce7e0 0x7f93581f2580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f934c00c4d0 tx=0x7f934c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:01.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.885+0000 7f93557fa640 1 -- 172.21.15.132:0/477357330 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c0074e0 con 0x7f93580ce7e0 2023-12-20T04:43:01.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.885+0000 7f93557fa640 1 -- 172.21.15.132:0/477357330 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f934c007660 con 0x7f93580ce7e0 2023-12-20T04:43:01.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.885+0000 7f935eaa1640 1 -- 172.21.15.132:0/477357330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f935815c4a0 con 0x7f93580ce7e0 2023-12-20T04:43:01.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.885+0000 7f93557fa640 1 -- 172.21.15.132:0/477357330 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f934c004a20 con 0x7f93580ce7e0 2023-12-20T04:43:01.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.885+0000 7f935eaa1640 1 -- 172.21.15.132:0/477357330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f935815ca60 con 0x7f93580ce7e0 2023-12-20T04:43:01.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.886+0000 7f935eaa1640 1 -- 172.21.15.132:0/477357330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f935804e840 con 0x7f93580ce7e0 2023-12-20T04:43:01.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.886+0000 7f93557fa640 1 -- 172.21.15.132:0/477357330 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f934c004b80 con 0x7f93580ce7e0 2023-12-20T04:43:01.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.887+0000 7f93557fa640 1 --2- 172.21.15.132:0/477357330 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f934406a430 0x7f934406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:01.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.887+0000 7f93557fa640 1 -- 172.21.15.132:0/477357330 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f934c087dd0 con 0x7f93580ce7e0 2023-12-20T04:43:01.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.887+0000 7f935c83d640 1 --2- 172.21.15.132:0/477357330 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f934406a430 0x7f934406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:01.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.887+0000 7f935c83d640 1 --2- 172.21.15.132:0/477357330 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f934406a430 0x7f934406c8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9348036000 tx=0x7f934803b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:01.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:01.891+0000 7f93557fa640 1 -- 172.21.15.132:0/477357330 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f934c053450 con 0x7f93580ce7e0 2023-12-20T04:43:02.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.057+0000 7f935eaa1640 1 -- 172.21.15.132:0/477357330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f93580cf860 con 0x7f93580ce7e0 2023-12-20T04:43:02.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.058+0000 7f93557fa640 1 -- 172.21.15.132:0/477357330 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f934c0180a0 con 0x7f93580ce7e0 2023-12-20T04:43:02.060 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:43:02.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.060+0000 7f935eaa1640 1 -- 172.21.15.132:0/477357330 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f934406a430 msgr2=0x7f934406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.060+0000 7f935eaa1640 1 --2- 172.21.15.132:0/477357330 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f934406a430 0x7f934406c8f0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f9348036000 tx=0x7f934803b040 comp rx=0 tx=0).stop 2023-12-20T04:43:02.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.060+0000 7f935eaa1640 1 -- 172.21.15.132:0/477357330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93580ce7e0 msgr2=0x7f93581f2580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.060+0000 7f935eaa1640 1 --2- 172.21.15.132:0/477357330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93580ce7e0 0x7f93581f2580 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f934c00c4d0 tx=0x7f934c00c990 comp rx=0 tx=0).stop 2023-12-20T04:43:02.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.060+0000 7f935eaa1640 1 -- 172.21.15.132:0/477357330 shutdown_connections 2023-12-20T04:43:02.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.060+0000 7f935eaa1640 1 --2- 172.21.15.132:0/477357330 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f934406a430 0x7f934406c8f0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.060+0000 7f935eaa1640 1 --2- 172.21.15.132:0/477357330 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93580cf1d0 0x7f93580b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.060+0000 7f935eaa1640 1 --2- 172.21.15.132:0/477357330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93580ce7e0 0x7f93581f2580 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.060+0000 7f935eaa1640 1 --2- 172.21.15.132:0/477357330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9358070460 0x7f935815be10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.060+0000 7f935eaa1640 1 -- 172.21.15.132:0/477357330 >> 172.21.15.132:0/477357330 conn(0x7f93580cc630 msgr2=0x7f935806e950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:02.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.060+0000 7f935eaa1640 1 -- 172.21.15.132:0/477357330 shutdown_connections 2023-12-20T04:43:02.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.060+0000 7f935eaa1640 1 -- 172.21.15.132:0/477357330 wait complete. 2023-12-20T04:43:02.073 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:43:02.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.170+0000 7f8f50700640 1 Processor -- start 2023-12-20T04:43:02.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.170+0000 7f8f50700640 1 -- start start 2023-12-20T04:43:02.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.171+0000 7f8f50700640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8f4815d100 0x7f8f480b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.171+0000 7f8f50700640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f480d0370 0x7f8f480cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.171+0000 7f8f50700640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8f480b2f90 con 0x7f8f48161850 2023-12-20T04:43:02.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.171+0000 7f8f50700640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8f481613c0 con 0x7f8f4815d100 2023-12-20T04:43:02.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.171+0000 7f8f50700640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f480d1b00 con 0x7f8f480d0370 2023-12-20T04:43:02.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.171+0000 7f8f4dc9b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f480d0370 0x7f8f480cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:02.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.171+0000 7f8f4e49c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8f4815d100 0x7f8f480b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:02.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.171+0000 7f8f4dc9b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f480d0370 0x7f8f480cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:55814/0 (socket says 172.21.15.132:55814) 2023-12-20T04:43:02.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.171+0000 7f8f4dc9b640 1 -- 172.21.15.132:0/2312183160 learned_addr learned my addr 172.21.15.132:0/2312183160 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:02.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.171+0000 7f8f4ec9d640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f8f48161850 0x7f8f4806c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:41658/0 (socket says 172.21.15.132:41658) 2023-12-20T04:43:02.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.171+0000 7f8f4dc9b640 1 -- 172.21.15.132:0/2312183160 >> v2:172.21.15.187:3300/0 conn(0x7f8f4815d100 msgr2=0x7f8f480b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:02.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.171+0000 7f8f4dc9b640 1 --2- 172.21.15.132:0/2312183160 >> v2:172.21.15.187:3300/0 conn(0x7f8f4815d100 0x7f8f480b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.171+0000 7f8f4dc9b640 1 -- 172.21.15.132:0/2312183160 >> v1:172.21.15.187:6789/0 conn(0x7f8f48161850 legacy=0x7f8f4806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.171+0000 7f8f4dc9b640 1 -- 172.21.15.132:0/2312183160 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f480d0810 con 0x7f8f480d0370 2023-12-20T04:43:02.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.171+0000 7f8f4e49c640 1 --2- 172.21.15.132:0/2312183160 >> v2:172.21.15.187:3300/0 conn(0x7f8f4815d100 0x7f8f480b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:43:02.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.172+0000 7f8f4dc9b640 1 --2- 172.21.15.132:0/2312183160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f480d0370 0x7f8f480cd500 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009870 tx=0x7f8f3802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf31e9becf0d1f85 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:02.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.172+0000 7f8f4d49a640 1 -- 172.21.15.132:0/2312183160 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38031640 con 0x7f8f480d0370 2023-12-20T04:43:02.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.172+0000 7f8f4d49a640 1 -- 172.21.15.132:0/2312183160 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f380317a0 con 0x7f8f480d0370 2023-12-20T04:43:02.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.172+0000 7f8f4d49a640 1 -- 172.21.15.132:0/2312183160 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f38031b30 con 0x7f8f480d0370 2023-12-20T04:43:02.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.173+0000 7f8f50700640 1 -- 172.21.15.132:0/2312183160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f480d0370 msgr2=0x7f8f480cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.173+0000 7f8f50700640 1 --2- 172.21.15.132:0/2312183160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f480d0370 0x7f8f480cd500 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f8f38009870 tx=0x7f8f3802b8f0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.173+0000 7f8f50700640 1 -- 172.21.15.132:0/2312183160 shutdown_connections 2023-12-20T04:43:02.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.173+0000 7f8f50700640 1 --2- 172.21.15.132:0/2312183160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f480d0370 0x7f8f480cd500 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.173+0000 7f8f50700640 1 --2- 172.21.15.132:0/2312183160 >> v2:172.21.15.187:3300/0 conn(0x7f8f4815d100 0x7f8f480b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.173+0000 7f8f50700640 1 -- 172.21.15.132:0/2312183160 >> 172.21.15.132:0/2312183160 conn(0x7f8f4806d7c0 msgr2=0x7f8f4806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:02.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.173+0000 7f8f50700640 1 -- 172.21.15.132:0/2312183160 shutdown_connections 2023-12-20T04:43:02.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.173+0000 7f8f50700640 1 -- 172.21.15.132:0/2312183160 wait complete. 2023-12-20T04:43:02.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.174+0000 7f8f50700640 1 Processor -- start 2023-12-20T04:43:02.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.174+0000 7f8f50700640 1 -- start start 2023-12-20T04:43:02.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f50700640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f480d0370 0x7f8f480c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f50700640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f4815d100 0x7f8f481582e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f50700640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f48161850 0x7f8f480ca4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f50700640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f480c5310 con 0x7f8f480d0370 2023-12-20T04:43:02.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f50700640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f480c55f0 con 0x7f8f48161850 2023-12-20T04:43:02.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f50700640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8f480c58d0 con 0x7f8f4815d100 2023-12-20T04:43:02.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f4e49c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f480d0370 0x7f8f480c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:02.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f4e49c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f480d0370 0x7f8f480c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60236/0 (socket says 172.21.15.132:60236) 2023-12-20T04:43:02.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f4e49c640 1 -- 172.21.15.132:0/160029239 learned_addr learned my addr 172.21.15.132:0/160029239 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:02.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f4dc9b640 1 --2- 172.21.15.132:0/160029239 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f4815d100 0x7f8f481582e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:02.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f4ec9d640 1 --2- 172.21.15.132:0/160029239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f48161850 0x7f8f480ca4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:02.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f4e49c640 1 -- 172.21.15.132:0/160029239 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f4815d100 msgr2=0x7f8f481582e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f4e49c640 1 --2- 172.21.15.132:0/160029239 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f4815d100 0x7f8f481582e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f4e49c640 1 -- 172.21.15.132:0/160029239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f48161850 msgr2=0x7f8f480ca4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f4e49c640 1 --2- 172.21.15.132:0/160029239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f48161850 0x7f8f480ca4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f4e49c640 1 -- 172.21.15.132:0/160029239 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f44009400 con 0x7f8f480d0370 2023-12-20T04:43:02.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f4dc9b640 1 --2- 172.21.15.132:0/160029239 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f4815d100 0x7f8f481582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:02.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.175+0000 7f8f4e49c640 1 --2- 172.21.15.132:0/160029239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f480d0370 0x7f8f480c7ea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400ebe0 tx=0x7f8f4400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:02.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.176+0000 7f8f3effd640 1 -- 172.21.15.132:0/160029239 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f44009760 con 0x7f8f480d0370 2023-12-20T04:43:02.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.176+0000 7f8f3effd640 1 -- 172.21.15.132:0/160029239 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8f4400cc30 con 0x7f8f480d0370 2023-12-20T04:43:02.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.176+0000 7f8f50700640 1 -- 172.21.15.132:0/160029239 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f380094d0 con 0x7f8f480d0370 2023-12-20T04:43:02.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.176+0000 7f8f3effd640 1 -- 172.21.15.132:0/160029239 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8f4400eee0 con 0x7f8f480d0370 2023-12-20T04:43:02.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.176+0000 7f8f50700640 1 -- 172.21.15.132:0/160029239 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f480b4b10 con 0x7f8f480d0370 2023-12-20T04:43:02.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.177+0000 7f8f50700640 1 -- 172.21.15.132:0/160029239 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f480b4970 con 0x7f8f480d0370 2023-12-20T04:43:02.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.177+0000 7f8f3effd640 1 -- 172.21.15.132:0/160029239 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8f44013470 con 0x7f8f480d0370 2023-12-20T04:43:02.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.178+0000 7f8f3effd640 1 --2- 172.21.15.132:0/160029239 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8f2c06a430 0x7f8f2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.178+0000 7f8f3effd640 1 -- 172.21.15.132:0/160029239 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8f44088ca0 con 0x7f8f480d0370 2023-12-20T04:43:02.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.178+0000 7f8f4dc9b640 1 --2- 172.21.15.132:0/160029239 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8f2c06a430 0x7f8f2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:02.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.178+0000 7f8f4dc9b640 1 --2- 172.21.15.132:0/160029239 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8f2c06a430 0x7f8f2c06c8f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f38036000 tx=0x7f8f3803c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.182+0000 7f8f3effd640 1 -- 172.21.15.132:0/160029239 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8f480b4970 con 0x7f8f480d0370 2023-12-20T04:43:02.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.381+0000 7f8f50700640 1 -- 172.21.15.132:0/160029239 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8f480b4970 con 0x7f8f480d0370 2023-12-20T04:43:02.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.381+0000 7f8f3effd640 1 -- 172.21.15.132:0/160029239 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4709 (secure 0 0 0) 0x7f8f480b4970 con 0x7f8f480d0370 2023-12-20T04:43:02.383 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:02.383 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/342123967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":342123967},{"type":"v1","addr":"172.21.15.187:6835","nonce":342123967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2678730048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2678730048},{"type":"v1","addr":"172.21.15.132:6836","nonce":2678730048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2874427434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2874427434},{"type":"v1","addr":"172.21.15.132:6837","nonce":2874427434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:42:47.150648+0000","modified":"2023-12-20T04:42:49.158537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/839566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":839566266},{"type":"v1","addr":"172.21.15.187:6834","nonce":839566266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-20T04:43:02.383 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2023-12-20T04:43:02.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.383+0000 7f8f50700640 1 -- 172.21.15.132:0/160029239 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8f2c06a430 msgr2=0x7f8f2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.383+0000 7f8f50700640 1 --2- 172.21.15.132:0/160029239 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8f2c06a430 0x7f8f2c06c8f0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f8f38036000 tx=0x7f8f3803c040 comp rx=0 tx=0).stop 2023-12-20T04:43:02.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.383+0000 7f8f50700640 1 -- 172.21.15.132:0/160029239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f480d0370 msgr2=0x7f8f480c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.383+0000 7f8f50700640 1 --2- 172.21.15.132:0/160029239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f480d0370 0x7f8f480c7ea0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f8f4400ebe0 tx=0x7f8f4400c520 comp rx=0 tx=0).stop 2023-12-20T04:43:02.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.383+0000 7f8f50700640 1 -- 172.21.15.132:0/160029239 shutdown_connections 2023-12-20T04:43:02.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.383+0000 7f8f50700640 1 --2- 172.21.15.132:0/160029239 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8f2c06a430 0x7f8f2c06c8f0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.383+0000 7f8f50700640 1 --2- 172.21.15.132:0/160029239 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8f48161850 0x7f8f480ca4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.383+0000 7f8f50700640 1 --2- 172.21.15.132:0/160029239 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8f4815d100 0x7f8f481582e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.383+0000 7f8f50700640 1 --2- 172.21.15.132:0/160029239 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8f480d0370 0x7f8f480c7ea0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.383+0000 7f8f50700640 1 -- 172.21.15.132:0/160029239 >> 172.21.15.132:0/160029239 conn(0x7f8f4806d7c0 msgr2=0x7f8f480b1730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:02.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.383+0000 7f8f50700640 1 -- 172.21.15.132:0/160029239 shutdown_connections 2023-12-20T04:43:02.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.383+0000 7f8f50700640 1 -- 172.21.15.132:0/160029239 wait complete. 2023-12-20T04:43:02.395 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:02.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.494+0000 7f1dd34ab640 1 Processor -- start 2023-12-20T04:43:02.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.494+0000 7f1dd34ab640 1 -- start start 2023-12-20T04:43:02.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.495+0000 7f1dd34ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1dcc0b4980 0x7f1dcc0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.495+0000 7f1dd34ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1dcc0d1aa0 0x7f1dcc0d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.495+0000 7f1dd34ab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1dcc0b5320 con 0x7f1dcc160450 2023-12-20T04:43:02.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.495+0000 7f1dd34ab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1dcc0b5ec0 con 0x7f1dcc0b4980 2023-12-20T04:43:02.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.495+0000 7f1dd34ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc1617e0 con 0x7f1dcc0d1aa0 2023-12-20T04:43:02.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.495+0000 7f1dd0a46640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1dcc0b4980 0x7f1dcc0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:02.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.495+0000 7f1dd1247640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1dcc160450 0x7f1dcc160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60568/0 (socket says 172.21.15.132:60568) 2023-12-20T04:43:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.495+0000 7f1dd1247640 1 -- 172.21.15.132:0/2534571432 learned_addr learned my addr 172.21.15.132:0/2534571432 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.495+0000 7f1dd0a46640 1 -- 172.21.15.132:0/2534571432 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1dcc0d1aa0 msgr2=0x7f1dcc0d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.495+0000 7f1dd0a46640 1 --2- 172.21.15.132:0/2534571432 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1dcc0d1aa0 0x7f1dcc0d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.495+0000 7f1dd0a46640 1 -- 172.21.15.132:0/2534571432 >> v1:172.21.15.132:6789/0 conn(0x7f1dcc160450 legacy=0x7f1dcc160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.495+0000 7f1dd0a46640 1 -- 172.21.15.132:0/2534571432 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dcc0d0fc0 con 0x7f1dcc0b4980 2023-12-20T04:43:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.495+0000 7f1dc3fff640 1 -- 172.21.15.132:0/2534571432 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2988694094 0 0) 0x7f1dcc0b5320 con 0x7f1dcc160450 2023-12-20T04:43:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.496+0000 7f1dd0a46640 1 --2- 172.21.15.132:0/2534571432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1dcc0b4980 0x7f1dcc0b4de0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0097a0 tx=0x7f1dbc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6af7ffc7d3beca8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.496+0000 7f1dc3fff640 1 -- 172.21.15.132:0/2534571432 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc030610 con 0x7f1dcc0b4980 2023-12-20T04:43:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.496+0000 7f1dc3fff640 1 -- 172.21.15.132:0/2534571432 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc030770 con 0x7f1dcc0b4980 2023-12-20T04:43:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.496+0000 7f1dc3fff640 1 -- 172.21.15.132:0/2534571432 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc030b00 con 0x7f1dcc0b4980 2023-12-20T04:43:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.496+0000 7f1dd34ab640 1 -- 172.21.15.132:0/2534571432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1dcc0b4980 msgr2=0x7f1dcc0b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.496+0000 7f1dd34ab640 1 --2- 172.21.15.132:0/2534571432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1dcc0b4980 0x7f1dcc0b4de0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0097a0 tx=0x7f1dbc02b960 comp rx=0 tx=0).stop 2023-12-20T04:43:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.496+0000 7f1dd34ab640 1 -- 172.21.15.132:0/2534571432 shutdown_connections 2023-12-20T04:43:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.496+0000 7f1dd34ab640 1 --2- 172.21.15.132:0/2534571432 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1dcc0d1aa0 0x7f1dcc0d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.496+0000 7f1dd34ab640 1 --2- 172.21.15.132:0/2534571432 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1dcc0b4980 0x7f1dcc0b4de0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.496+0000 7f1dd34ab640 1 -- 172.21.15.132:0/2534571432 >> 172.21.15.132:0/2534571432 conn(0x7f1dcc0cf980 msgr2=0x7f1dcc0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.497+0000 7f1dd34ab640 1 -- 172.21.15.132:0/2534571432 shutdown_connections 2023-12-20T04:43:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.497+0000 7f1dd34ab640 1 -- 172.21.15.132:0/2534571432 wait complete. 2023-12-20T04:43:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.498+0000 7f1dd34ab640 1 Processor -- start 2023-12-20T04:43:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.498+0000 7f1dd34ab640 1 -- start start 2023-12-20T04:43:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.498+0000 7f1dd34ab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1dcc0b4980 0x7f1dcc157a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.498+0000 7f1dd34ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1dcc0d1aa0 0x7f1dcc1f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.498+0000 7f1dd34ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1dcc160450 0x7f1dcc15e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.498+0000 7f1dd34ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc1585b0 con 0x7f1dcc0d1aa0 2023-12-20T04:43:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.498+0000 7f1dd34ab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc1f6830 con 0x7f1dcc0b4980 2023-12-20T04:43:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.498+0000 7f1dd34ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1dcc1582d0 con 0x7f1dcc160450 2023-12-20T04:43:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.498+0000 7f1dd0a46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1dcc0d1aa0 0x7f1dcc1f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:02.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.498+0000 7f1dd0a46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1dcc0d1aa0 0x7f1dcc1f2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60256/0 (socket says 172.21.15.132:60256) 2023-12-20T04:43:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.498+0000 7f1dd0a46640 1 -- 172.21.15.132:0/2081029382 learned_addr learned my addr 172.21.15.132:0/2081029382 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.499+0000 7f1dd0a46640 1 -- 172.21.15.132:0/2081029382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1dcc160450 msgr2=0x7f1dcc15e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.499+0000 7f1dd0a46640 1 --2- 172.21.15.132:0/2081029382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1dcc160450 0x7f1dcc15e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.499+0000 7f1dd0a46640 1 -- 172.21.15.132:0/2081029382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1dcc0b4980 msgr2=0x7f1dcc157a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.499+0000 7f1dd0a46640 1 --2- 172.21.15.132:0/2081029382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1dcc0b4980 0x7f1dcc157a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.499+0000 7f1dd0a46640 1 -- 172.21.15.132:0/2081029382 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1dbc009400 con 0x7f1dcc0d1aa0 2023-12-20T04:43:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.499+0000 7f1dd0a46640 1 --2- 172.21.15.132:0/2081029382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1dcc0d1aa0 0x7f1dcc1f2150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0098c0 tx=0x7f1dbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.499+0000 7f1dc1ffb640 1 -- 172.21.15.132:0/2081029382 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc039c90 con 0x7f1dcc0d1aa0 2023-12-20T04:43:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.499+0000 7f1dc1ffb640 1 -- 172.21.15.132:0/2081029382 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1dbc03f040 con 0x7f1dcc0d1aa0 2023-12-20T04:43:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.499+0000 7f1dd34ab640 1 -- 172.21.15.132:0/2081029382 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1dcc1f6170 con 0x7f1dcc0d1aa0 2023-12-20T04:43:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.499+0000 7f1dc1ffb640 1 -- 172.21.15.132:0/2081029382 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1dbc006e10 con 0x7f1dcc0d1aa0 2023-12-20T04:43:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.499+0000 7f1dd34ab640 1 -- 172.21.15.132:0/2081029382 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1dcc157f70 con 0x7f1dcc0d1aa0 2023-12-20T04:43:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.500+0000 7f1dd34ab640 1 -- 172.21.15.132:0/2081029382 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1dcc1f5fd0 con 0x7f1dcc0d1aa0 2023-12-20T04:43:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.501+0000 7f1dc1ffb640 1 -- 172.21.15.132:0/2081029382 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1dbc004030 con 0x7f1dcc0d1aa0 2023-12-20T04:43:02.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.501+0000 7f1dc1ffb640 1 --2- 172.21.15.132:0/2081029382 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1db006a430 0x7f1db006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.501+0000 7f1dc1ffb640 1 -- 172.21.15.132:0/2081029382 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1dbc0aaa10 con 0x7f1dcc0d1aa0 2023-12-20T04:43:02.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.501+0000 7f1dd1247640 1 --2- 172.21.15.132:0/2081029382 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1db006a430 0x7f1db006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:02.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.501+0000 7f1dd1247640 1 --2- 172.21.15.132:0/2081029382 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1db006a430 0x7f1db006c8f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8005880 tx=0x7f1dc8007a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:02.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.505+0000 7f1dc1ffb640 1 -- 172.21.15.132:0/2081029382 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1dcc1f5fd0 con 0x7f1dcc0d1aa0 2023-12-20T04:43:02.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.672+0000 7f1dd34ab640 1 -- 172.21.15.132:0/2081029382 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1dcc1f6970 con 0x7f1dcc0d1aa0 2023-12-20T04:43:02.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.673+0000 7f1dc1ffb640 1 -- 172.21.15.132:0/2081029382 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f1dcc1f6970 con 0x7f1dcc0d1aa0 2023-12-20T04:43:02.675 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:02.675 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:02.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.676+0000 7f1dd34ab640 1 -- 172.21.15.132:0/2081029382 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1db006a430 msgr2=0x7f1db006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.676+0000 7f1dd34ab640 1 --2- 172.21.15.132:0/2081029382 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1db006a430 0x7f1db006c8f0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f1dc8005880 tx=0x7f1dc8007a00 comp rx=0 tx=0).stop 2023-12-20T04:43:02.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.676+0000 7f1dd34ab640 1 -- 172.21.15.132:0/2081029382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1dcc0d1aa0 msgr2=0x7f1dcc1f2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.676+0000 7f1dd34ab640 1 --2- 172.21.15.132:0/2081029382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1dcc0d1aa0 0x7f1dcc1f2150 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f1dbc0098c0 tx=0x7f1dbc0046c0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.676+0000 7f1dd34ab640 1 -- 172.21.15.132:0/2081029382 shutdown_connections 2023-12-20T04:43:02.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.676+0000 7f1dd34ab640 1 --2- 172.21.15.132:0/2081029382 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1db006a430 0x7f1db006c8f0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.676+0000 7f1dd34ab640 1 --2- 172.21.15.132:0/2081029382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1dcc160450 0x7f1dcc15e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.676+0000 7f1dd34ab640 1 --2- 172.21.15.132:0/2081029382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1dcc0d1aa0 0x7f1dcc1f2150 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.676+0000 7f1dd34ab640 1 --2- 172.21.15.132:0/2081029382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1dcc0b4980 0x7f1dcc157a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.676+0000 7f1dd34ab640 1 -- 172.21.15.132:0/2081029382 >> 172.21.15.132:0/2081029382 conn(0x7f1dcc0cf980 msgr2=0x7f1dcc154f70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:02.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.676+0000 7f1dd34ab640 1 -- 172.21.15.132:0/2081029382 shutdown_connections 2023-12-20T04:43:02.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.676+0000 7f1dd34ab640 1 -- 172.21.15.132:0/2081029382 wait complete. 2023-12-20T04:43:02.689 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:43:02.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.786+0000 7fc57d100640 1 Processor -- start 2023-12-20T04:43:02.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.786+0000 7fc57d100640 1 -- start start 2023-12-20T04:43:02.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.786+0000 7fc57d100640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc578160450 0x7fc578160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.787+0000 7fc57d100640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5780b5090 0x7fc5780d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.787+0000 7fc57d100640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5780b5ec0 con 0x7fc5781611b0 2023-12-20T04:43:02.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.787+0000 7fc57d100640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5781617e0 con 0x7fc578160450 2023-12-20T04:43:02.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.787+0000 7fc57d100640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5780d0fc0 con 0x7fc5780b5090 2023-12-20T04:43:02.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.787+0000 7fc576d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc578160450 0x7fc578160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:02.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.787+0000 7fc56e59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc5781611b0 0x7fc5780b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60576/0 (socket says 172.21.15.132:60576) 2023-12-20T04:43:02.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.787+0000 7fc56e59c640 1 -- 172.21.15.132:0/1888431576 learned_addr learned my addr 172.21.15.132:0/1888431576 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:02.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.787+0000 7fc57759e640 1 --2- 172.21.15.132:0/1888431576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5780b5090 0x7fc5780d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:02.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.787+0000 7fc576d9d640 1 -- 172.21.15.132:0/1888431576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5780b5090 msgr2=0x7fc5780d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:02.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.787+0000 7fc576d9d640 1 --2- 172.21.15.132:0/1888431576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5780b5090 0x7fc5780d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.787+0000 7fc576d9d640 1 -- 172.21.15.132:0/1888431576 >> v1:172.21.15.132:6789/0 conn(0x7fc5781611b0 legacy=0x7fc5780b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.787+0000 7fc576d9d640 1 -- 172.21.15.132:0/1888431576 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5780d12a0 con 0x7fc578160450 2023-12-20T04:43:02.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.787+0000 7fc57759e640 1 --2- 172.21.15.132:0/1888431576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5780b5090 0x7fc5780d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:02.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.788+0000 7fc576d9d640 1 --2- 172.21.15.132:0/1888431576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc578160450 0x7fc578160c70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc5680097a0 tx=0x7fc56802b940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca63ea7ba1e25a4a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:02.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.788+0000 7fc57659c640 1 -- 172.21.15.132:0/1888431576 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568030800 con 0x7fc578160450 2023-12-20T04:43:02.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.788+0000 7fc57659c640 1 -- 172.21.15.132:0/1888431576 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc568030960 con 0x7fc578160450 2023-12-20T04:43:02.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.788+0000 7fc57659c640 1 -- 172.21.15.132:0/1888431576 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc568030cf0 con 0x7fc578160450 2023-12-20T04:43:02.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.788+0000 7fc57d100640 1 -- 172.21.15.132:0/1888431576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc578160450 msgr2=0x7fc578160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.788+0000 7fc57d100640 1 --2- 172.21.15.132:0/1888431576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc578160450 0x7fc578160c70 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fc5680097a0 tx=0x7fc56802b940 comp rx=0 tx=0).stop 2023-12-20T04:43:02.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.788+0000 7fc57d100640 1 -- 172.21.15.132:0/1888431576 shutdown_connections 2023-12-20T04:43:02.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.788+0000 7fc57d100640 1 --2- 172.21.15.132:0/1888431576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5780b5090 0x7fc5780d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.788+0000 7fc57d100640 1 --2- 172.21.15.132:0/1888431576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc578160450 0x7fc578160c70 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.788+0000 7fc57d100640 1 -- 172.21.15.132:0/1888431576 >> 172.21.15.132:0/1888431576 conn(0x7fc5780cf980 msgr2=0x7fc5780cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:02.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.788+0000 7fc57d100640 1 -- 172.21.15.132:0/1888431576 shutdown_connections 2023-12-20T04:43:02.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.788+0000 7fc57d100640 1 -- 172.21.15.132:0/1888431576 wait complete. 2023-12-20T04:43:02.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.790+0000 7fc57d100640 1 Processor -- start 2023-12-20T04:43:02.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.790+0000 7fc57d100640 1 -- start start 2023-12-20T04:43:02.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc57d100640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5780b5090 0x7fc5781f5f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc57d100640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc578160450 0x7fc5781f64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc57d100640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5781611b0 0x7fc57814a3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc57d100640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5780c93d0 con 0x7fc578160450 2023-12-20T04:43:02.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc57d100640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc57814b150 con 0x7fc5780b5090 2023-12-20T04:43:02.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc57d100640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc57814b430 con 0x7fc5781611b0 2023-12-20T04:43:02.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc56e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc578160450 0x7fc5781f64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:02.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc56e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc578160450 0x7fc5781f64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60274/0 (socket says 172.21.15.132:60274) 2023-12-20T04:43:02.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc56e59c640 1 -- 172.21.15.132:0/2346500717 learned_addr learned my addr 172.21.15.132:0/2346500717 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:02.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc57759e640 1 --2- 172.21.15.132:0/2346500717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5781611b0 0x7fc57814a3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:02.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc576d9d640 1 --2- 172.21.15.132:0/2346500717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5780b5090 0x7fc5781f5f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:02.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc56e59c640 1 -- 172.21.15.132:0/2346500717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5781611b0 msgr2=0x7fc57814a3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc56e59c640 1 --2- 172.21.15.132:0/2346500717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5781611b0 0x7fc57814a3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc56e59c640 1 -- 172.21.15.132:0/2346500717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5780b5090 msgr2=0x7fc5781f5f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:02.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc56e59c640 1 --2- 172.21.15.132:0/2346500717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5780b5090 0x7fc5781f5f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:02.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc56e59c640 1 -- 172.21.15.132:0/2346500717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc568009400 con 0x7fc578160450 2023-12-20T04:43:02.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc56e59c640 1 --2- 172.21.15.132:0/2346500717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc578160450 0x7fc5781f64d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc56000c480 tx=0x7fc56000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:02.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc56ffff640 1 -- 172.21.15.132:0/2346500717 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc560005ce0 con 0x7fc578160450 2023-12-20T04:43:02.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc56ffff640 1 -- 172.21.15.132:0/2346500717 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc560005e40 con 0x7fc578160450 2023-12-20T04:43:02.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc57d100640 1 -- 172.21.15.132:0/2346500717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc57814b710 con 0x7fc578160450 2023-12-20T04:43:02.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc56ffff640 1 -- 172.21.15.132:0/2346500717 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5600072f0 con 0x7fc578160450 2023-12-20T04:43:02.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.791+0000 7fc57d100640 1 -- 172.21.15.132:0/2346500717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc57814bcd0 con 0x7fc578160450 2023-12-20T04:43:02.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.792+0000 7fc57d100640 1 -- 172.21.15.132:0/2346500717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc57814bef0 con 0x7fc578160450 2023-12-20T04:43:02.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.793+0000 7fc56ffff640 1 -- 172.21.15.132:0/2346500717 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc560007450 con 0x7fc578160450 2023-12-20T04:43:02.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.793+0000 7fc56ffff640 1 --2- 172.21.15.132:0/2346500717 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc55806a430 0x7fc55806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:02.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.793+0000 7fc56ffff640 1 -- 172.21.15.132:0/2346500717 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc560087cd0 con 0x7fc578160450 2023-12-20T04:43:02.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.793+0000 7fc576d9d640 1 --2- 172.21.15.132:0/2346500717 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc55806a430 0x7fc55806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:02.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.794+0000 7fc576d9d640 1 --2- 172.21.15.132:0/2346500717 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc55806a430 0x7fc55806c8f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc568036000 tx=0x7fc56803b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:02.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:02.797+0000 7fc56ffff640 1 -- 172.21.15.132:0/2346500717 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc560053400 con 0x7fc578160450 2023-12-20T04:43:03.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.000+0000 7fc57d100640 1 -- 172.21.15.132:0/2346500717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc57804e840 con 0x7fc578160450 2023-12-20T04:43:03.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.001+0000 7fc56ffff640 1 -- 172.21.15.132:0/2346500717 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4709 (secure 0 0 0) 0x7fc560017090 con 0x7fc578160450 2023-12-20T04:43:03.003 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:03.003 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/342123967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":342123967},{"type":"v1","addr":"172.21.15.187:6835","nonce":342123967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2678730048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2678730048},{"type":"v1","addr":"172.21.15.132:6836","nonce":2678730048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2874427434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2874427434},{"type":"v1","addr":"172.21.15.132:6837","nonce":2874427434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:42:47.150648+0000","modified":"2023-12-20T04:42:49.158537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/839566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":839566266},{"type":"v1","addr":"172.21.15.187:6834","nonce":839566266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-20T04:43:03.003 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2023-12-20T04:43:03.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.002+0000 7fc57d100640 1 -- 172.21.15.132:0/2346500717 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc55806a430 msgr2=0x7fc55806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:03.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.002+0000 7fc57d100640 1 --2- 172.21.15.132:0/2346500717 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc55806a430 0x7fc55806c8f0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7fc568036000 tx=0x7fc56803b040 comp rx=0 tx=0).stop 2023-12-20T04:43:03.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.003+0000 7fc57d100640 1 -- 172.21.15.132:0/2346500717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc578160450 msgr2=0x7fc5781f64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:03.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.003+0000 7fc57d100640 1 --2- 172.21.15.132:0/2346500717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc578160450 0x7fc5781f64d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc56000c480 tx=0x7fc56000c940 comp rx=0 tx=0).stop 2023-12-20T04:43:03.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.003+0000 7fc57d100640 1 -- 172.21.15.132:0/2346500717 shutdown_connections 2023-12-20T04:43:03.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.003+0000 7fc57d100640 1 --2- 172.21.15.132:0/2346500717 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc55806a430 0x7fc55806c8f0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.003+0000 7fc57d100640 1 --2- 172.21.15.132:0/2346500717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5781611b0 0x7fc57814a3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.003+0000 7fc57d100640 1 --2- 172.21.15.132:0/2346500717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc578160450 0x7fc5781f64d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.003+0000 7fc57d100640 1 --2- 172.21.15.132:0/2346500717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc5780b5090 0x7fc5781f5f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.003+0000 7fc57d100640 1 -- 172.21.15.132:0/2346500717 >> 172.21.15.132:0/2346500717 conn(0x7fc5780cf980 msgr2=0x7fc5780d33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:03.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.003+0000 7fc57d100640 1 -- 172.21.15.132:0/2346500717 shutdown_connections 2023-12-20T04:43:03.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.003+0000 7fc57d100640 1 -- 172.21.15.132:0/2346500717 wait complete. 2023-12-20T04:43:03.418 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-20T04:42:47.150648+0000', 'modified': '2023-12-20T04:42:49.158537+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4267}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4267': {'gid': 4267, 'name': 'b', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.187:6834/839566266', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6832', 'nonce': 839566266}, {'type': 'v1', 'addr': '172.21.15.187:6834', 'nonce': 839566266}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [3], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-20T04:43:03.418 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-20T04:43:03.418 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-20T04:43:03.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.519+0000 7fd821d63640 1 Processor -- start 2023-12-20T04:43:03.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.519+0000 7fd821d63640 1 -- start start 2023-12-20T04:43:03.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.519+0000 7fd821d63640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd81c15aec0 0x7fd81c0ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.519+0000 7fd821d63640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81c0ce640 con 0x7fd81c0cfaa0 2023-12-20T04:43:03.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.519+0000 7fd821d63640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd81c15f610 con 0x7fd81c0cd0d0 2023-12-20T04:43:03.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.519+0000 7fd821d63640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c15b2a0 con 0x7fd81c15aec0 2023-12-20T04:43:03.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81affd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd81c0cfaa0 0x7fd81c0cc9c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60586/0 (socket says 172.21.15.132:60586) 2023-12-20T04:43:03.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81affd640 1 -- 172.21.15.132:0/1865204469 learned_addr learned my addr 172.21.15.132:0/1865204469 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:03.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81a7fc640 1 -- 172.21.15.132:0/1865204469 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 109108908 0 0) 0x7fd81c0ce640 con 0x7fd81c0cfaa0 2023-12-20T04:43:03.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81a7fc640 1 -- 172.21.15.132:0/1865204469 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd804003520 con 0x7fd81c0cfaa0 2023-12-20T04:43:03.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81b7fe640 1 --2- 172.21.15.132:0/1865204469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd81c15aec0 0x7fd81c0ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81a7fc640 1 -- 172.21.15.132:0/1865204469 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1040890255 0 0) 0x7fd804003520 con 0x7fd81c0cfaa0 2023-12-20T04:43:03.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81a7fc640 1 -- 172.21.15.132:0/1865204469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd81c15aec0 msgr2=0x7fd81c0ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:03.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81a7fc640 1 --2- 172.21.15.132:0/1865204469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd81c15aec0 0x7fd81c0ce100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81a7fc640 1 -- 172.21.15.132:0/1865204469 >> v1:172.21.15.187:6789/0 conn(0x7fd81c0cd0d0 legacy=0x7fd81c0d0210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:03.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81a7fc640 1 -- 172.21.15.132:0/1865204469 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81c15ea00 con 0x7fd81c0cfaa0 2023-12-20T04:43:03.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81a7fc640 1 -- 172.21.15.132:0/1865204469 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fd810001690 con 0x7fd81c0cfaa0 2023-12-20T04:43:03.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81a7fc640 1 -- 172.21.15.132:0/1865204469 >> v1:172.21.15.132:6789/0 conn(0x7fd81c0cfaa0 legacy=0x7fd81c0cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:03.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81a7fc640 1 --2- 172.21.15.132:0/1865204469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd81c15aec0 0x7fd8040039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81a7fc640 1 --2- 172.21.15.132:0/1865204469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd804003f20 0x7fd8040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81a7fc640 1 --2- 172.21.15.132:0/1865204469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd804004d00 0x7fd804005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81a7fc640 1 -- 172.21.15.132:0/1865204469 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c15b2a0 con 0x7fd804004d00 2023-12-20T04:43:03.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81a7fc640 1 -- 172.21.15.132:0/1865204469 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd80400bbc0 con 0x7fd804003f20 2023-12-20T04:43:03.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81a7fc640 1 -- 172.21.15.132:0/1865204469 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd80400bd80 con 0x7fd81c15aec0 2023-12-20T04:43:03.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81bfff640 1 --2- 172.21.15.132:0/1865204469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd804004d00 0x7fd804005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81b7fe640 1 --2- 172.21.15.132:0/1865204469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd81c15aec0 0x7fd8040039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81affd640 1 --2- 172.21.15.132:0/1865204469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd804003f20 0x7fd8040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.520+0000 7fd81bfff640 1 -- 172.21.15.132:0/1865204469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd81c15aec0 msgr2=0x7fd8040039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:03.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.521+0000 7fd81bfff640 1 --2- 172.21.15.132:0/1865204469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd81c15aec0 0x7fd8040039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.521+0000 7fd81bfff640 1 -- 172.21.15.132:0/1865204469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd804003f20 msgr2=0x7fd8040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:03.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.521+0000 7fd81bfff640 1 --2- 172.21.15.132:0/1865204469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd804003f20 0x7fd8040047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.521+0000 7fd81bfff640 1 -- 172.21.15.132:0/1865204469 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd804003520 con 0x7fd804004d00 2023-12-20T04:43:03.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.521+0000 7fd81bfff640 1 --2- 172.21.15.132:0/1865204469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd804004d00 0x7fd804005180 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd814001e50 tx=0x7fd8040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=30dd2d6e4e2f62dd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:03.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.521+0000 7fd81a7fc640 1 -- 172.21.15.132:0/1865204469 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd814003b70 con 0x7fd804004d00 2023-12-20T04:43:03.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.521+0000 7fd81a7fc640 1 -- 172.21.15.132:0/1865204469 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd814003cd0 con 0x7fd804004d00 2023-12-20T04:43:03.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.521+0000 7fd81a7fc640 1 -- 172.21.15.132:0/1865204469 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd814005310 con 0x7fd804004d00 2023-12-20T04:43:03.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.522+0000 7fd821d63640 1 -- 172.21.15.132:0/1865204469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd804004d00 msgr2=0x7fd804005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:03.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.522+0000 7fd821d63640 1 --2- 172.21.15.132:0/1865204469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd804004d00 0x7fd804005180 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fd814001e50 tx=0x7fd8040057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.522+0000 7fd81bfff640 1 -- 172.21.15.132:0/1865204469 reap_dead start 2023-12-20T04:43:03.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.522+0000 7fd821d63640 1 -- 172.21.15.132:0/1865204469 shutdown_connections 2023-12-20T04:43:03.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.522+0000 7fd821d63640 1 -- 172.21.15.132:0/1865204469 >> 172.21.15.132:0/1865204469 conn(0x7fd81c072c60 msgr2=0x7fd81c073070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:03.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.522+0000 7fd821d63640 1 -- 172.21.15.132:0/1865204469 shutdown_connections 2023-12-20T04:43:03.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.522+0000 7fd821d63640 1 -- 172.21.15.132:0/1865204469 wait complete. 2023-12-20T04:43:03.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.523+0000 7fd821d63640 1 Processor -- start 2023-12-20T04:43:03.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.523+0000 7fd821d63640 1 -- start start 2023-12-20T04:43:03.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.524+0000 7fd821d63640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd81c1562a0 0x7fd81c1f08d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.524+0000 7fd821d63640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd81c0c8760 0x7fd81c15c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.524+0000 7fd821d63640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd81c0c8be0 0x7fd81c15cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.524+0000 7fd821d63640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c0a9710 con 0x7fd81c0c8be0 2023-12-20T04:43:03.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.524+0000 7fd821d63640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c0a8ed0 con 0x7fd81c1562a0 2023-12-20T04:43:03.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.524+0000 7fd821d63640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd81c0ca130 con 0x7fd81c0c8760 2023-12-20T04:43:03.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.524+0000 7fd81bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd81c0c8be0 0x7fd81c15cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.524+0000 7fd81bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd81c0c8be0 0x7fd81c15cbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60294/0 (socket says 172.21.15.132:60294) 2023-12-20T04:43:03.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.524+0000 7fd81bfff640 1 -- 172.21.15.132:0/1405235857 learned_addr learned my addr 172.21.15.132:0/1405235857 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:03.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.524+0000 7fd81affd640 1 --2- 172.21.15.132:0/1405235857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd81c0c8760 0x7fd81c15c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.524+0000 7fd81b7fe640 1 --2- 172.21.15.132:0/1405235857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd81c1562a0 0x7fd81c1f08d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.524+0000 7fd81bfff640 1 -- 172.21.15.132:0/1405235857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd81c0c8760 msgr2=0x7fd81c15c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:03.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.524+0000 7fd81bfff640 1 --2- 172.21.15.132:0/1405235857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd81c0c8760 0x7fd81c15c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.524+0000 7fd81bfff640 1 -- 172.21.15.132:0/1405235857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd81c1562a0 msgr2=0x7fd81c1f08d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:03.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.524+0000 7fd81bfff640 1 --2- 172.21.15.132:0/1405235857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd81c1562a0 0x7fd81c1f08d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.524+0000 7fd81bfff640 1 -- 172.21.15.132:0/1405235857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd81c156680 con 0x7fd81c0c8be0 2023-12-20T04:43:03.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.524+0000 7fd81bfff640 1 --2- 172.21.15.132:0/1405235857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd81c0c8be0 0x7fd81c15cbb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd81402c060 tx=0x7fd8140014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:03.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.525+0000 7fd803fff640 1 -- 172.21.15.132:0/1405235857 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81403e070 con 0x7fd81c0c8be0 2023-12-20T04:43:03.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.525+0000 7fd803fff640 1 -- 172.21.15.132:0/1405235857 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd814003e40 con 0x7fd81c0c8be0 2023-12-20T04:43:03.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.525+0000 7fd821d63640 1 -- 172.21.15.132:0/1405235857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd81c0c9520 con 0x7fd81c0c8be0 2023-12-20T04:43:03.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.525+0000 7fd803fff640 1 -- 172.21.15.132:0/1405235857 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd814006d90 con 0x7fd81c0c8be0 2023-12-20T04:43:03.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.525+0000 7fd821d63640 1 -- 172.21.15.132:0/1405235857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81c0c9ae0 con 0x7fd81c0c8be0 2023-12-20T04:43:03.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.526+0000 7fd803fff640 1 -- 172.21.15.132:0/1405235857 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd814041070 con 0x7fd81c0c8be0 2023-12-20T04:43:03.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.527+0000 7fd803fff640 1 --2- 172.21.15.132:0/1405235857 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd80806a430 0x7fd80806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.527+0000 7fd81b7fe640 1 --2- 172.21.15.132:0/1405235857 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd80806a430 0x7fd80806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.527+0000 7fd803fff640 1 -- 172.21.15.132:0/1405235857 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8140a9610 con 0x7fd81c0c8be0 2023-12-20T04:43:03.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.527+0000 7fd81b7fe640 1 --2- 172.21.15.132:0/1405235857 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd80806a430 0x7fd80806c8f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009bc0 tx=0x7fd80c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:03.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.528+0000 7fd8249b5740 1 Processor -- start 2023-12-20T04:43:03.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.528+0000 7fd8249b5740 1 -- start start 2023-12-20T04:43:03.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.528+0000 7fd8249b5740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945c0390 0x555d94593520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.528+0000 7fd8249b5740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945c0770 0x555d945c3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.528+0000 7fd8249b5740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d94593a60 0x555d945c3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.528+0000 7fd8249b5740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d945030b0 con 0x555d94593a60 2023-12-20T04:43:03.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.528+0000 7fd8249b5740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d94500840 con 0x555d945c0770 2023-12-20T04:43:03.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.528+0000 7fd8249b5740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d944fc130 con 0x555d945c0390 2023-12-20T04:43:03.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.529+0000 7fd81bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d94593a60 0x555d945c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.529+0000 7fd81bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d94593a60 0x555d945c3660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60298/0 (socket says 172.21.15.132:60298) 2023-12-20T04:43:03.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.529+0000 7fd81bfff640 1 -- 172.21.15.132:0/3517499629 learned_addr learned my addr 172.21.15.132:0/3517499629 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:03.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.529+0000 7fd81b7fe640 1 --2- 172.21.15.132:0/3517499629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945c0390 0x555d94593520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.529+0000 7fd81affd640 1 --2- 172.21.15.132:0/3517499629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945c0770 0x555d945c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.529+0000 7fd81bfff640 1 -- 172.21.15.132:0/3517499629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945c0390 msgr2=0x555d94593520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:03.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.529+0000 7fd81bfff640 1 --2- 172.21.15.132:0/3517499629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945c0390 0x555d94593520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.529+0000 7fd81bfff640 1 -- 172.21.15.132:0/3517499629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945c0770 msgr2=0x555d945c3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:03.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.529+0000 7fd81bfff640 1 --2- 172.21.15.132:0/3517499629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945c0770 0x555d945c3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.529+0000 7fd81bfff640 1 -- 172.21.15.132:0/3517499629 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d944b6c40 con 0x555d94593a60 2023-12-20T04:43:03.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.529+0000 7fd81bfff640 1 --2- 172.21.15.132:0/3517499629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d94593a60 0x555d945c3660 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd814003fd0 tx=0x7fd8140784f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=281f79dc34757a0c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:03.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.529+0000 7fd8017fa640 1 -- 172.21.15.132:0/3517499629 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd81407c730 con 0x555d94593a60 2023-12-20T04:43:03.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.529+0000 7fd8017fa640 1 -- 172.21.15.132:0/3517499629 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8140808e0 con 0x555d94593a60 2023-12-20T04:43:03.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.529+0000 7fd8017fa640 1 -- 172.21.15.132:0/3517499629 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd814001a70 con 0x555d94593a60 2023-12-20T04:43:03.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.530+0000 7fd8249b5740 1 -- 172.21.15.132:0/3517499629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d94593a60 msgr2=0x555d945c3660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:03.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.530+0000 7fd8249b5740 1 --2- 172.21.15.132:0/3517499629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d94593a60 0x555d945c3660 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fd814003fd0 tx=0x7fd8140784f0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.530+0000 7fd8249b5740 1 -- 172.21.15.132:0/3517499629 shutdown_connections 2023-12-20T04:43:03.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.530+0000 7fd8249b5740 1 --2- 172.21.15.132:0/3517499629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d94593a60 0x555d945c3660 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.530+0000 7fd8249b5740 1 --2- 172.21.15.132:0/3517499629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945c0770 0x555d945c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.530+0000 7fd8249b5740 1 --2- 172.21.15.132:0/3517499629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945c0390 0x555d94593520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.530+0000 7fd8249b5740 1 -- 172.21.15.132:0/3517499629 >> 172.21.15.132:0/3517499629 conn(0x555d94595830 msgr2=0x555d945de120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:03.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.530+0000 7fd8249b5740 1 -- 172.21.15.132:0/3517499629 shutdown_connections 2023-12-20T04:43:03.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.530+0000 7fd8249b5740 1 -- 172.21.15.132:0/3517499629 wait complete. 2023-12-20T04:43:03.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.530+0000 7fd8249b5740 1 -- start start 2023-12-20T04:43:03.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.531+0000 7fd8249b5740 1 Processor -- start 2023-12-20T04:43:03.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.531+0000 7fd8249b5740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945c0390 0x555d945ed410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.531+0000 7fd8249b5740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0770 0x555d945c3010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.531+0000 7fd8249b5740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945ed950 0x555d945c3550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.531+0000 7fd8249b5740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d944ba840 con 0x555d945c0770 2023-12-20T04:43:03.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.531+0000 7fd8249b5740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d944ba4e0 con 0x555d945c0390 2023-12-20T04:43:03.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.531+0000 7fd8249b5740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d94480230 con 0x555d945ed950 2023-12-20T04:43:03.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.531+0000 7fd8249b5740 10 client.0 _ll_register_callbacks cb 0x555d944d16d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:43:03.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.531+0000 7fd81affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0770 0x555d945c3010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.531+0000 7fd81affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0770 0x555d945c3010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60310/0 (socket says 172.21.15.132:60310) 2023-12-20T04:43:03.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.531+0000 7fd81affd640 1 -- 172.21.15.132:0/386109624 learned_addr learned my addr 172.21.15.132:0/386109624 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:03.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd81b7fe640 1 --2- 172.21.15.132:0/386109624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945c0390 0x555d945ed410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd81bfff640 1 --2- 172.21.15.132:0/386109624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945ed950 0x555d945c3550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd81affd640 1 -- 172.21.15.132:0/386109624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945ed950 msgr2=0x555d945c3550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:03.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd81affd640 1 --2- 172.21.15.132:0/386109624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945ed950 0x555d945c3550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd81affd640 1 -- 172.21.15.132:0/386109624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945c0390 msgr2=0x555d945ed410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:03.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd81affd640 1 --2- 172.21.15.132:0/386109624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945c0390 0x555d945ed410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd81affd640 1 -- 172.21.15.132:0/386109624 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd81c0c9ae0 con 0x555d945c0770 2023-12-20T04:43:03.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd81b7fe640 1 --2- 172.21.15.132:0/386109624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945c0390 0x555d945ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:03.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd81bfff640 1 --2- 172.21.15.132:0/386109624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945ed950 0x555d945c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:03.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd81affd640 1 --2- 172.21.15.132:0/386109624 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0770 0x555d945c3010 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd810004ef0 tx=0x7fd810007410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21063b47bc27372 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:03.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd7fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:43:03.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd7fa7fc640 1 -- 172.21.15.132:0/386109624 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8100158b0 con 0x555d945c0770 2023-12-20T04:43:03.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd7fa7fc640 1 -- 172.21.15.132:0/386109624 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd810015a10 con 0x555d945c0770 2023-12-20T04:43:03.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd8249b5740 1 -- 172.21.15.132:0/386109624 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x555d94525970 con 0x555d945c0770 2023-12-20T04:43:03.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd7fa7fc640 1 -- 172.21.15.132:0/386109624 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd810015bd0 con 0x555d945c0770 2023-12-20T04:43:03.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd8249b5740 10 client.4662 fetch_fsmap learned FSMap version 6 2023-12-20T04:43:03.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd8249b5740 1 -- 172.21.15.132:0/386109624 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x555d944fa7b0 con 0x555d945c0770 2023-12-20T04:43:03.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd7fa7fc640 1 -- 172.21.15.132:0/386109624 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x555d94525970 con 0x555d945c0770 2023-12-20T04:43:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd7fa7fc640 1 -- 172.21.15.132:0/386109624 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 6) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd810012050 con 0x555d945c0770 2023-12-20T04:43:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd8249b5740 10 client.4662 fetch_fsmap finished waiting for FSMap version 6 2023-12-20T04:43:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd8249b5740 10 client.4662 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-20T04:43:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd8249b5740 20 client.4662 populate_metadata read hostname 'smithi132' 2023-12-20T04:43:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd8249b5740 1 --2- 172.21.15.132:0/386109624 >> [v2:172.21.15.187:6832/839566266,v1:172.21.15.187:6834/839566266] conn(0x555d945c2250 0x555d945c2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd8249b5740 4 client.4662 mds_command: new command op to 4267 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-20T04:43:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd8249b5740 1 -- 172.21.15.132:0/386109624 --> [v2:172.21.15.187:6832/839566266,v1:172.21.15.187:6834/839566266] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x555d944edf00 con 0x555d945c2250 2023-12-20T04:43:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.532+0000 7fd81b7fe640 1 --2- 172.21.15.132:0/386109624 >> [v2:172.21.15.187:6832/839566266,v1:172.21.15.187:6834/839566266] conn(0x555d945c2250 0x555d945c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.533+0000 7fd7fa7fc640 10 client.4662 ms_handle_connect on v2:172.21.15.187:6832/839566266 2023-12-20T04:43:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.533+0000 7fd81b7fe640 1 --2- 172.21.15.132:0/386109624 >> [v2:172.21.15.187:6832/839566266,v1:172.21.15.187:6834/839566266] conn(0x555d945c2250 0x555d945c2630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67963ea5d37e7ed6 server_cookie=27622a879e244d5d in_seq=0 out_seq=0 2023-12-20T04:43:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.533+0000 7fd7fa7fc640 1 -- 172.21.15.132:0/386109624 <== mds.0 v2:172.21.15.187:6832/839566266 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x555d944edf00 con 0x555d945c2250 2023-12-20T04:43:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.533+0000 7fd7fa7fc640 10 client.4662 handle_command_reply: tid=0 2023-12-20T04:43:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.533+0000 7fd8249b5740 1 client.4662 shutdown 2023-12-20T04:43:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.534+0000 7fd8249b5740 1 -- 172.21.15.132:0/386109624 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0770 msgr2=0x555d945c3010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:03.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.534+0000 7fd8249b5740 1 --2- 172.21.15.132:0/386109624 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0770 0x555d945c3010 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fd810004ef0 tx=0x7fd810007410 comp rx=0 tx=0).stop 2023-12-20T04:43:03.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.534+0000 7fd8249b5740 1 -- 172.21.15.132:0/386109624 shutdown_connections 2023-12-20T04:43:03.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.534+0000 7fd8249b5740 1 --2- 172.21.15.132:0/386109624 >> [v2:172.21.15.187:6832/839566266,v1:172.21.15.187:6834/839566266] conn(0x555d945c2250 0x555d945c2630 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.534+0000 7fd8249b5740 1 --2- 172.21.15.132:0/386109624 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945ed950 0x555d945c3550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.534+0000 7fd8249b5740 1 --2- 172.21.15.132:0/386109624 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0770 0x555d945c3010 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.534+0000 7fd8249b5740 1 --2- 172.21.15.132:0/386109624 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945c0390 0x555d945ed410 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.534+0000 7fd7fa7fc640 0 client.4662 ms_handle_reset on v2:172.21.15.187:6832/839566266 2023-12-20T04:43:03.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.534+0000 7fd8249b5740 1 -- 172.21.15.132:0/386109624 >> 172.21.15.132:0/386109624 conn(0x555d94593a60 msgr2=0x555d94597280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:03.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.534+0000 7fd8249b5740 1 -- 172.21.15.132:0/386109624 shutdown_connections 2023-12-20T04:43:03.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.534+0000 7fd8249b5740 1 -- 172.21.15.132:0/386109624 wait complete. 2023-12-20T04:43:03.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.534+0000 7fd8249b5740 20 client.4662 trim_cache size 0 max 16384 2023-12-20T04:43:03.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.549+0000 7fd8249b5740 1 Processor -- start 2023-12-20T04:43:03.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.549+0000 7fd8249b5740 1 -- start start 2023-12-20T04:43:03.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.549+0000 7fd8249b5740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945c0390 0x555d945e1630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.549+0000 7fd8249b5740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0770 0x555d945e0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.549+0000 7fd8249b5740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945ed950 0x555d946420c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.549+0000 7fd8249b5740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d945c16b0 con 0x555d945c0770 2023-12-20T04:43:03.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.549+0000 7fd8249b5740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d945df080 con 0x555d945ed950 2023-12-20T04:43:03.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.549+0000 7fd8249b5740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d945ed790 con 0x555d945c0390 2023-12-20T04:43:03.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.550+0000 7fd81affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0770 0x555d945e0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.550+0000 7fd81affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0770 0x555d945e0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60314/0 (socket says 172.21.15.132:60314) 2023-12-20T04:43:03.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.550+0000 7fd81affd640 1 -- 172.21.15.132:0/2720107217 learned_addr learned my addr 172.21.15.132:0/2720107217 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:03.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.550+0000 7fd81b7fe640 1 --2- 172.21.15.132:0/2720107217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945c0390 0x555d945e1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.550+0000 7fd81affd640 1 -- 172.21.15.132:0/2720107217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945c0390 msgr2=0x555d945e1630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:03.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.550+0000 7fd81affd640 1 --2- 172.21.15.132:0/2720107217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945c0390 0x555d945e1630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.550+0000 7fd81affd640 1 -- 172.21.15.132:0/2720107217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945ed950 msgr2=0x555d946420c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:03.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.550+0000 7fd81bfff640 1 --2- 172.21.15.132:0/2720107217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945ed950 0x555d946420c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.550+0000 7fd81affd640 1 --2- 172.21.15.132:0/2720107217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945ed950 0x555d946420c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.550+0000 7fd81affd640 1 -- 172.21.15.132:0/2720107217 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x555d9449cbe0 con 0x555d945c0770 2023-12-20T04:43:03.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.550+0000 7fd81affd640 1 --2- 172.21.15.132:0/2720107217 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0770 0x555d945e0ba0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd810004920 tx=0x7fd810018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f467b97bb9e9deae server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:03.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.550+0000 7fd801ffb640 1 -- 172.21.15.132:0/2720107217 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd810015780 con 0x555d945c0770 2023-12-20T04:43:03.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.550+0000 7fd801ffb640 1 -- 172.21.15.132:0/2720107217 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd81001a070 con 0x555d945c0770 2023-12-20T04:43:03.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.550+0000 7fd801ffb640 1 -- 172.21.15.132:0/2720107217 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd810015ae0 con 0x555d945c0770 2023-12-20T04:43:03.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.551+0000 7fd8249b5740 1 -- 172.21.15.132:0/2720107217 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0770 msgr2=0x555d945e0ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:03.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.551+0000 7fd8249b5740 1 --2- 172.21.15.132:0/2720107217 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0770 0x555d945e0ba0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7fd810004920 tx=0x7fd810018000 comp rx=0 tx=0).stop 2023-12-20T04:43:03.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.551+0000 7fd8249b5740 1 -- 172.21.15.132:0/2720107217 shutdown_connections 2023-12-20T04:43:03.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.551+0000 7fd8249b5740 1 --2- 172.21.15.132:0/2720107217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945ed950 0x555d946420c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.551+0000 7fd8249b5740 1 --2- 172.21.15.132:0/2720107217 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0770 0x555d945e0ba0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.551+0000 7fd8249b5740 1 --2- 172.21.15.132:0/2720107217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945c0390 0x555d945e1630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.551+0000 7fd8249b5740 1 -- 172.21.15.132:0/2720107217 >> 172.21.15.132:0/2720107217 conn(0x555d94593a60 msgr2=0x555d945c45f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:03.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.551+0000 7fd8249b5740 1 -- 172.21.15.132:0/2720107217 shutdown_connections 2023-12-20T04:43:03.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.551+0000 7fd8249b5740 1 -- 172.21.15.132:0/2720107217 wait complete. 2023-12-20T04:43:03.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.551+0000 7fd8249b5740 1 -- start start 2023-12-20T04:43:03.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.551+0000 7fd8249b5740 1 Processor -- start 2023-12-20T04:43:03.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd8249b5740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0390 0x555d945dfc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd8249b5740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945c0770 0x555d9463f4d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd8249b5740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945ed950 0x555d945c56d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd8249b5740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d945df9d0 con 0x555d945c0390 2023-12-20T04:43:03.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd8249b5740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x555d9463fe20 con 0x555d945c0770 2023-12-20T04:43:03.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd8249b5740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x555d945e1d10 con 0x555d945ed950 2023-12-20T04:43:03.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd8249b5740 10 client.0 _ll_register_callbacks cb 0x7fd814006ef0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:43:03.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd81b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0390 0x555d945dfc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd81b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0390 0x555d945dfc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60320/0 (socket says 172.21.15.132:60320) 2023-12-20T04:43:03.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd81b7fe640 1 -- 172.21.15.132:0/2231356420 learned_addr learned my addr 172.21.15.132:0/2231356420 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:03.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd81affd640 1 --2- 172.21.15.132:0/2231356420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945c0770 0x555d9463f4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd81bfff640 1 --2- 172.21.15.132:0/2231356420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945ed950 0x555d945c56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd81b7fe640 1 -- 172.21.15.132:0/2231356420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945ed950 msgr2=0x555d945c56d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:03.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd81b7fe640 1 --2- 172.21.15.132:0/2231356420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945ed950 0x555d945c56d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd81b7fe640 1 -- 172.21.15.132:0/2231356420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945c0770 msgr2=0x555d9463f4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:03.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd81b7fe640 1 --2- 172.21.15.132:0/2231356420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945c0770 0x555d9463f4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd81b7fe640 1 -- 172.21.15.132:0/2231356420 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x555d944fa7b0 con 0x555d945c0390 2023-12-20T04:43:03.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd81affd640 1 --2- 172.21.15.132:0/2231356420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945c0770 0x555d9463f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:03.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd81b7fe640 1 --2- 172.21.15.132:0/2231356420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0390 0x555d945dfc80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x555d945991d0 tx=0x7fd80c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1e05fa4fbd07c77 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:03.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.552+0000 7fd7fa7fc640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:43:03.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.553+0000 7fd7fa7fc640 1 -- 172.21.15.132:0/2231356420 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd80c02b1c0 con 0x555d945c0390 2023-12-20T04:43:03.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.553+0000 7fd7fa7fc640 1 -- 172.21.15.132:0/2231356420 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd80c02b320 con 0x555d945c0390 2023-12-20T04:43:03.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.553+0000 7fd8249b5740 1 -- 172.21.15.132:0/2231356420 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd8140808e0 con 0x555d945c0390 2023-12-20T04:43:03.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.553+0000 7fd7fa7fc640 1 -- 172.21.15.132:0/2231356420 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=6) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd80c02b620 con 0x555d945c0390 2023-12-20T04:43:03.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.553+0000 7fd8249b5740 10 client.4668 fetch_fsmap learned FSMap version 6 2023-12-20T04:43:03.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.553+0000 7fd8249b5740 1 -- 172.21.15.132:0/2231356420 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=6,monmap=2+}) v3 -- 0x555d944c22f0 con 0x555d945c0390 2023-12-20T04:43:03.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.553+0000 7fd7fa7fc640 1 -- 172.21.15.132:0/2231356420 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8140808e0 con 0x555d945c0390 2023-12-20T04:43:03.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.553+0000 7fd7fa7fc640 1 -- 172.21.15.132:0/2231356420 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 6) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd80c031020 con 0x555d945c0390 2023-12-20T04:43:03.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.553+0000 7fd8249b5740 10 client.4668 fetch_fsmap finished waiting for FSMap version 6 2023-12-20T04:43:03.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.553+0000 7fd8249b5740 10 client.4668 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-20T04:43:03.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.553+0000 7fd8249b5740 20 client.4668 populate_metadata read hostname 'smithi132' 2023-12-20T04:43:03.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.553+0000 7fd8249b5740 1 --2- 172.21.15.132:0/2231356420 >> [v2:172.21.15.187:6832/839566266,v1:172.21.15.187:6834/839566266] conn(0x555d945c2630 0x555d945c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.553+0000 7fd8249b5740 4 client.4668 mds_command: new command op to 4267 tid=0[{"prefix": "status"}] 2023-12-20T04:43:03.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.553+0000 7fd8249b5740 1 -- 172.21.15.132:0/2231356420 --> [v2:172.21.15.187:6832/839566266,v1:172.21.15.187:6834/839566266] -- command(tid 0: {"prefix": "status"}) v1 -- 0x555d944f51b0 con 0x555d945c2630 2023-12-20T04:43:03.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.553+0000 7fd81affd640 1 --2- 172.21.15.132:0/2231356420 >> [v2:172.21.15.187:6832/839566266,v1:172.21.15.187:6834/839566266] conn(0x555d945c2630 0x555d945c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd7fa7fc640 10 client.4668 ms_handle_connect on v2:172.21.15.187:6832/839566266 2023-12-20T04:43:03.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd81affd640 1 --2- 172.21.15.132:0/2231356420 >> [v2:172.21.15.187:6832/839566266,v1:172.21.15.187:6834/839566266] conn(0x555d945c2630 0x555d945c5c10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=80ce4238c7845d7f server_cookie=cc1f671c12da83f6 in_seq=0 out_seq=0 2023-12-20T04:43:03.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd7fa7fc640 1 -- 172.21.15.132:0/2231356420 <== mds.0 v2:172.21.15.187:6832/839566266 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+316 (crc 0 0 0) 0x555d944f51b0 con 0x555d945c2630 2023-12-20T04:43:03.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd7fa7fc640 10 client.4668 handle_command_reply: tid=0 2023-12-20T04:43:03.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd8249b5740 1 client.4668 shutdown 2023-12-20T04:43:03.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd8249b5740 1 -- 172.21.15.132:0/2231356420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0390 msgr2=0x555d945dfc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:03.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd8249b5740 1 --2- 172.21.15.132:0/2231356420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0390 0x555d945dfc80 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x555d945991d0 tx=0x7fd80c0046c0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd8249b5740 1 -- 172.21.15.132:0/2231356420 shutdown_connections 2023-12-20T04:43:03.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd8249b5740 1 --2- 172.21.15.132:0/2231356420 >> [v2:172.21.15.187:6832/839566266,v1:172.21.15.187:6834/839566266] conn(0x555d945c2630 0x555d945c5c10 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd8249b5740 1 --2- 172.21.15.132:0/2231356420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x555d945ed950 0x555d945c56d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd8249b5740 1 --2- 172.21.15.132:0/2231356420 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x555d945c0770 0x555d9463f4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd7fa7fc640 0 client.4668 ms_handle_reset on v2:172.21.15.187:6832/839566266 2023-12-20T04:43:03.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd8249b5740 1 --2- 172.21.15.132:0/2231356420 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x555d945c0390 0x555d945dfc80 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd8249b5740 1 -- 172.21.15.132:0/2231356420 >> 172.21.15.132:0/2231356420 conn(0x555d94593a60 msgr2=0x555d945f0110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:03.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd8249b5740 1 -- 172.21.15.132:0/2231356420 shutdown_connections 2023-12-20T04:43:03.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd8249b5740 1 -- 172.21.15.132:0/2231356420 wait complete. 2023-12-20T04:43:03.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd8249b5740 20 client.4668 trim_cache size 0 max 16384 2023-12-20T04:43:03.563 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:43:03.563 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:43:03.564 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-12-20T04:43:03.564 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4267, 2023-12-20T04:43:03.564 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-12-20T04:43:03.564 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-12-20T04:43:03.564 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-12-20T04:43:03.564 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 16.401869495, 2023-12-20T04:43:03.564 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 6, 2023-12-20T04:43:03.564 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 20, 2023-12-20T04:43:03.564 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 20, 2023-12-20T04:43:03.564 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 22.4661765 2023-12-20T04:43:03.565 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:43:03.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd821d63640 1 -- 172.21.15.132:0/1405235857 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd80806a430 msgr2=0x7fd80806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:03.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd821d63640 1 --2- 172.21.15.132:0/1405235857 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd80806a430 0x7fd80806c8f0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fd80c009bc0 tx=0x7fd80c009190 comp rx=0 tx=0).stop 2023-12-20T04:43:03.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd821d63640 1 -- 172.21.15.132:0/1405235857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd81c0c8be0 msgr2=0x7fd81c15cbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:03.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.554+0000 7fd821d63640 1 --2- 172.21.15.132:0/1405235857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd81c0c8be0 0x7fd81c15cbb0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fd81402c060 tx=0x7fd8140014a0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.555+0000 7fd821d63640 1 -- 172.21.15.132:0/1405235857 shutdown_connections 2023-12-20T04:43:03.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.555+0000 7fd821d63640 1 --2- 172.21.15.132:0/1405235857 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd80806a430 0x7fd80806c8f0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.555+0000 7fd821d63640 1 --2- 172.21.15.132:0/1405235857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd81c0c8be0 0x7fd81c15cbb0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.555+0000 7fd821d63640 1 --2- 172.21.15.132:0/1405235857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd81c0c8760 0x7fd81c15c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.555+0000 7fd821d63640 1 --2- 172.21.15.132:0/1405235857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd81c1562a0 0x7fd81c1f08d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.555+0000 7fd821d63640 1 -- 172.21.15.132:0/1405235857 >> 172.21.15.132:0/1405235857 conn(0x7fd81c072c60 msgr2=0x7fd81c0b5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:03.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.555+0000 7fd821d63640 1 -- 172.21.15.132:0/1405235857 shutdown_connections 2023-12-20T04:43:03.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.555+0000 7fd821d63640 1 -- 172.21.15.132:0/1405235857 wait complete. 2023-12-20T04:43:03.567 INFO:teuthology.run_tasks:Running task ceph-fuse... 2023-12-20T04:43:03.591 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2023-12-20T04:43:03.592 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.2': {}, 'client.1': {}, 'client.3': {}} 2023-12-20T04:43:03.592 INFO:tasks.ceph_fuse:client.0 config is {} 2023-12-20T04:43:03.592 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-20T04:43:03.592 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-20T04:43:03.592 INFO:tasks.ceph_fuse:client.2 config is {} 2023-12-20T04:43:03.592 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-20T04:43:03.592 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-20T04:43:03.592 INFO:tasks.ceph_fuse:client.1 config is {} 2023-12-20T04:43:03.592 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-20T04:43:03.592 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-20T04:43:03.592 INFO:tasks.ceph_fuse:client.3 config is {} 2023-12-20T04:43:03.593 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2023-12-20T04:43:03.593 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-20T04:43:03.593 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:03.593 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-20T04:43:03.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:03.614 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2023-12-20T04:43:03.686 INFO:teuthology.orchestra.run.smithi187.stderr:Cannot find device "ceph-brx" 2023-12-20T04:43:03.687 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:43:03.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:03.688 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-20T04:43:03.703 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:03.703 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link delete ceph-brx 2023-12-20T04:43:03.772 INFO:teuthology.orchestra.run.smithi132.stderr:Cannot find device "ceph-brx" 2023-12-20T04:43:03.774 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:43:03.774 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2023-12-20T04:43:03.774 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:43:03.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.913+0000 7fa7e3548640 1 Processor -- start 2023-12-20T04:43:03.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.914+0000 7fa7e3548640 1 -- start start 2023-12-20T04:43:03.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.914+0000 7fa7e3548640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa7dc159b50 0x7fa7dc0c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.914+0000 7fa7e3548640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7dc06c240 0x7fa7dc06c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.914+0000 7fa7e3548640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7dc0ccf30 con 0x7fa7dc15e530 2023-12-20T04:43:03.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.914+0000 7fa7e3548640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7dc06cc10 con 0x7fa7dc159b50 2023-12-20T04:43:03.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.914+0000 7fa7e3548640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc0caa60 con 0x7fa7dc06c240 2023-12-20T04:43:03.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.914+0000 7fa7e12e4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa7dc159b50 0x7fa7dc0c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.914+0000 7fa7e12e4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa7dc159b50 0x7fa7dc0c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60322/0 (socket says 172.21.15.132:60322) 2023-12-20T04:43:03.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.914+0000 7fa7e0ae3640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa7dc15e530 0x7fa7dc06fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60600/0 (socket says 172.21.15.132:60600) 2023-12-20T04:43:03.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.915+0000 7fa7e12e4640 1 -- 172.21.15.132:0/1148232870 learned_addr learned my addr 172.21.15.132:0/1148232870 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.915+0000 7fa7e1ae5640 1 --2- 172.21.15.132:0/1148232870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7dc06c240 0x7fa7dc06c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.915+0000 7fa7e12e4640 1 -- 172.21.15.132:0/1148232870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7dc06c240 msgr2=0x7fa7dc06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.915+0000 7fa7e12e4640 1 --2- 172.21.15.132:0/1148232870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7dc06c240 0x7fa7dc06c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.915+0000 7fa7e12e4640 1 -- 172.21.15.132:0/1148232870 >> v1:172.21.15.132:6789/0 conn(0x7fa7dc15e530 legacy=0x7fa7dc06fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.915+0000 7fa7e12e4640 1 -- 172.21.15.132:0/1148232870 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7dc0ca1c0 con 0x7fa7dc159b50 2023-12-20T04:43:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.915+0000 7fa7d3fff640 1 -- 172.21.15.132:0/1148232870 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 641242565 0 0) 0x7fa7dc0ccf30 con 0x7fa7dc15e530 2023-12-20T04:43:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.915+0000 7fa7e1ae5640 1 --2- 172.21.15.132:0/1148232870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7dc06c240 0x7fa7dc06c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.915+0000 7fa7e12e4640 1 --2- 172.21.15.132:0/1148232870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7dc159b50 0x7fa7dc0c9930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009e50 tx=0x7fa7d802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ea685fb52ba1d5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.916+0000 7fa7d3fff640 1 -- 172.21.15.132:0/1148232870 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d802cb00 con 0x7fa7dc159b50 2023-12-20T04:43:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.916+0000 7fa7d3fff640 1 -- 172.21.15.132:0/1148232870 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d802cc60 con 0x7fa7dc159b50 2023-12-20T04:43:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.916+0000 7fa7d3fff640 1 -- 172.21.15.132:0/1148232870 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d80343f0 con 0x7fa7dc159b50 2023-12-20T04:43:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.916+0000 7fa7e3548640 1 -- 172.21.15.132:0/1148232870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7dc159b50 msgr2=0x7fa7dc0c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.916+0000 7fa7e3548640 1 --2- 172.21.15.132:0/1148232870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7dc159b50 0x7fa7dc0c9930 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8009e50 tx=0x7fa7d802bf60 comp rx=0 tx=0).stop 2023-12-20T04:43:03.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.916+0000 7fa7e3548640 1 -- 172.21.15.132:0/1148232870 shutdown_connections 2023-12-20T04:43:03.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.916+0000 7fa7e3548640 1 --2- 172.21.15.132:0/1148232870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7dc06c240 0x7fa7dc06c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.916+0000 7fa7e3548640 1 --2- 172.21.15.132:0/1148232870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7dc159b50 0x7fa7dc0c9930 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.916+0000 7fa7e3548640 1 -- 172.21.15.132:0/1148232870 >> 172.21.15.132:0/1148232870 conn(0x7fa7dc0ced10 msgr2=0x7fa7dc0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:03.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.916+0000 7fa7e3548640 1 -- 172.21.15.132:0/1148232870 shutdown_connections 2023-12-20T04:43:03.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.916+0000 7fa7e3548640 1 -- 172.21.15.132:0/1148232870 wait complete. 2023-12-20T04:43:03.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.917+0000 7fa7e3548640 1 Processor -- start 2023-12-20T04:43:03.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.917+0000 7fa7e3548640 1 -- start start 2023-12-20T04:43:03.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.918+0000 7fa7e3548640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7dc06c240 0x7fa7dc1f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.918+0000 7fa7e3548640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7dc159b50 0x7fa7dc14e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.918+0000 7fa7e3548640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7dc15e530 0x7fa7dc14ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.918+0000 7fa7e3548640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc1f4710 con 0x7fa7dc159b50 2023-12-20T04:43:03.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.918+0000 7fa7e3548640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc14eb20 con 0x7fa7dc06c240 2023-12-20T04:43:03.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.918+0000 7fa7e3548640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7dc150510 con 0x7fa7dc15e530 2023-12-20T04:43:03.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.918+0000 7fa7e0ae3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7dc159b50 0x7fa7dc14e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.918+0000 7fa7e0ae3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7dc159b50 0x7fa7dc14e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60332/0 (socket says 172.21.15.132:60332) 2023-12-20T04:43:03.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.918+0000 7fa7e0ae3640 1 -- 172.21.15.132:0/4012376745 learned_addr learned my addr 172.21.15.132:0/4012376745 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:03.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.918+0000 7fa7e0ae3640 1 -- 172.21.15.132:0/4012376745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7dc15e530 msgr2=0x7fa7dc14ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:03.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.918+0000 7fa7e0ae3640 1 --2- 172.21.15.132:0/4012376745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7dc15e530 0x7fa7dc14ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.918+0000 7fa7e0ae3640 1 -- 172.21.15.132:0/4012376745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7dc06c240 msgr2=0x7fa7dc1f41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:03.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.918+0000 7fa7e12e4640 1 --2- 172.21.15.132:0/4012376745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7dc06c240 0x7fa7dc1f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.918+0000 7fa7e0ae3640 1 --2- 172.21.15.132:0/4012376745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7dc06c240 0x7fa7dc1f41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:03.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.918+0000 7fa7e0ae3640 1 -- 172.21.15.132:0/4012376745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d8009b30 con 0x7fa7dc159b50 2023-12-20T04:43:03.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.919+0000 7fa7e0ae3640 1 --2- 172.21.15.132:0/4012376745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7dc159b50 0x7fa7dc14e5e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00c4d0 tx=0x7fa7cc00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:03.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.919+0000 7fa7d1ffb640 1 -- 172.21.15.132:0/4012376745 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc0074e0 con 0x7fa7dc159b50 2023-12-20T04:43:03.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.919+0000 7fa7d1ffb640 1 -- 172.21.15.132:0/4012376745 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7cc007660 con 0x7fa7dc159b50 2023-12-20T04:43:03.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.919+0000 7fa7e3548640 1 -- 172.21.15.132:0/4012376745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7dc1f4940 con 0x7fa7dc159b50 2023-12-20T04:43:03.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.919+0000 7fa7d1ffb640 1 -- 172.21.15.132:0/4012376745 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7cc004a20 con 0x7fa7dc159b50 2023-12-20T04:43:03.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.919+0000 7fa7e3548640 1 -- 172.21.15.132:0/4012376745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7dc1f4f00 con 0x7fa7dc159b50 2023-12-20T04:43:03.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.920+0000 7fa7e3548640 1 -- 172.21.15.132:0/4012376745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7dc1f5120 con 0x7fa7dc159b50 2023-12-20T04:43:03.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.920+0000 7fa7d1ffb640 1 -- 172.21.15.132:0/4012376745 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa7cc004b80 con 0x7fa7dc159b50 2023-12-20T04:43:03.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.920+0000 7fa7d1ffb640 1 --2- 172.21.15.132:0/4012376745 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa7c006a460 0x7fa7c006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:03.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.921+0000 7fa7d1ffb640 1 -- 172.21.15.132:0/4012376745 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7cc087aa0 con 0x7fa7dc159b50 2023-12-20T04:43:03.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.921+0000 7fa7e12e4640 1 --2- 172.21.15.132:0/4012376745 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa7c006a460 0x7fa7c006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:03.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.921+0000 7fa7e12e4640 1 --2- 172.21.15.132:0/4012376745 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa7c006a460 0x7fa7c006c920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8035000 tx=0x7fa7d8030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:03.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:03.925+0000 7fa7d1ffb640 1 -- 172.21.15.132:0/4012376745 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa7cc053090 con 0x7fa7dc159b50 2023-12-20T04:43:04.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:04.127+0000 7fa7e3548640 1 -- 172.21.15.132:0/4012376745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa7dc06f560 con 0x7fa7dc159b50 2023-12-20T04:43:04.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:04.127+0000 7fa7d1ffb640 1 -- 172.21.15.132:0/4012376745 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa7cc018020 con 0x7fa7dc159b50 2023-12-20T04:43:04.129 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:43:04.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:04.129+0000 7fa7e3548640 1 -- 172.21.15.132:0/4012376745 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa7c006a460 msgr2=0x7fa7c006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:04.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:04.129+0000 7fa7e3548640 1 --2- 172.21.15.132:0/4012376745 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa7c006a460 0x7fa7c006c920 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fa7d8035000 tx=0x7fa7d8030000 comp rx=0 tx=0).stop 2023-12-20T04:43:04.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:04.129+0000 7fa7e3548640 1 -- 172.21.15.132:0/4012376745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7dc159b50 msgr2=0x7fa7dc14e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:04.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:04.129+0000 7fa7e3548640 1 --2- 172.21.15.132:0/4012376745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7dc159b50 0x7fa7dc14e5e0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fa7cc00c4d0 tx=0x7fa7cc00c990 comp rx=0 tx=0).stop 2023-12-20T04:43:04.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:04.129+0000 7fa7e3548640 1 -- 172.21.15.132:0/4012376745 shutdown_connections 2023-12-20T04:43:04.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:04.129+0000 7fa7e3548640 1 --2- 172.21.15.132:0/4012376745 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa7c006a460 0x7fa7c006c920 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:04.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:04.129+0000 7fa7e3548640 1 --2- 172.21.15.132:0/4012376745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7dc15e530 0x7fa7dc14ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:04.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:04.129+0000 7fa7e3548640 1 --2- 172.21.15.132:0/4012376745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7dc159b50 0x7fa7dc14e5e0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:04.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:04.129+0000 7fa7e3548640 1 --2- 172.21.15.132:0/4012376745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7dc06c240 0x7fa7dc1f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:04.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:04.129+0000 7fa7e3548640 1 -- 172.21.15.132:0/4012376745 >> 172.21.15.132:0/4012376745 conn(0x7fa7dc0ced10 msgr2=0x7fa7dc158dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:04.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:04.129+0000 7fa7e3548640 1 -- 172.21.15.132:0/4012376745 shutdown_connections 2023-12-20T04:43:04.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:04.129+0000 7fa7e3548640 1 -- 172.21.15.132:0/4012376745 wait complete. 2023-12-20T04:43:04.141 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:43:04.141 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:43:04.142 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-12-20T04:43:04.142 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-20T04:43:04.142 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-20T04:43:04.142 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:43:04.142 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:43:04.142 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:43:04.142 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:43:04.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:04.142 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-12-20T04:43:04.157 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:43:04.157 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:43:04.157 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:43:04.157 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:04.157 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-20T04:43:04.157 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:04.158 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:04.158 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:04.158 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-12-20T04:43:04.158 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:04.158 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:04.158 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-12-20T04:43:04.158 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:04.158 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:04.158 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:43:04.158 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:04.158 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:43:04.158 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42690sec preferred_lft 42690sec 2023-12-20T04:43:04.158 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-12-20T04:43:04.158 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:04.159 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-20T04:43:04.159 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:04.159 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:43:04.159 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:43:04.159 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add name ceph-brx type bridge 2023-12-20T04:43:04.159 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr flush dev ceph-brx 2023-12-20T04:43:04.159 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set ceph-brx up 2023-12-20T04:43:04.160 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-20T04:43:04.160 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:43:04.320 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:04.320 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:43:04.346 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-20T04:43:04.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:04.348 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-12-20T04:43:04.416 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-12-20T04:43:04.417 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:43:04.417 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:43:04.417 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:43:04.417 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:43:04.417 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:04.417 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:43:04.418 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:43:04.418 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:43:04.418 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:43:04.418 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:43:04.418 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:43:04.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:04.684 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-20T04:43:04.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:04.700 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list-id 2023-12-20T04:43:04.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:04.755 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:43:04.755 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:43:04.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-20T04:43:04.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2023-12-20T04:43:04.755 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:43:04.840 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2023-12-20T04:43:04.840 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:04.840 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:43:04.840 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:43:04.840 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2023-12-20T04:43:04.840 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-20T04:43:04.840 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2023-12-20T04:43:04.840 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2023-12-20T04:43:04.840 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2023-12-20T04:43:04.841 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:43:04.949 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:04.949 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:43:04.949 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:43:04.949 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-12-20T04:43:04.949 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set dev brx.0 master ceph-brx 2023-12-20T04:43:04.949 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:43:04.990 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-20T04:43:04.991 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:43:04.991 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-20T04:43:05.046 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:43:05.046 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:43:05.047 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:43:05.101 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:43:05.170 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:43:05.170 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:43:05.237 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:43:05.238 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:43:05.238 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:05.238 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:43:05.294 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:43:05.294 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-20T04:43:05.337 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:43:05.364 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:43:05.364 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:43:05.432 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:43:05.433 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:43:05.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:05.434 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:43:05.434 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:2023-12-20T04:43:05.431+0000 7fc32c038480 -1 init, newargv = 0x55eb72a385d0 newargc=15 2023-12-20T04:43:05.434 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[88749]: starting ceph client 2023-12-20T04:43:05.438 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[88749]: starting fuse 2023-12-20T04:43:05.452 INFO:teuthology.orchestra.run.smithi132.stdout:41 2023-12-20T04:43:05.452 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:43:05.452 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:43:05.452 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:43:05.453 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:43:05.453 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:43:05.453 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:43:05.453 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:05.453 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:43:05.453 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:43:05.453 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:43:05.453 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:43:05.453 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:05.453 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:43:05.453 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:43:05.453 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:43:05.453 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:43:05.453 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:05.453 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:43:05.454 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:43:05.454 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:43:05.454 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:43:05.454 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:43:05.454 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:43:05.454 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:43:05.454 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:43:05.455 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:05.455 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:43:05.455 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:43:05.568 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.88749.asok 2023-12-20T04:43:05.755 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.88749.asok 2023-12-20T04:43:05.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:05.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.88749.asok status 2023-12-20T04:43:05.891 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:43:05.891 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:43:05.891 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:43:05.891 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:43:05.891 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:43:05.892 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:43:05.892 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:43:05.892 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "88749", 2023-12-20T04:43:05.892 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:43:05.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:05.892 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2023-12-20T04:43:05.892 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:43:05.892 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4683, 2023-12-20T04:43:05.892 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:43:05.892 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:43:05.892 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:43:05.892 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 4683 2023-12-20T04:43:05.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:05.892 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:43:05.892 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:43:05.893 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:43:05.893 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 583915439 2023-12-20T04:43:05.893 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:05.893 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:05.893 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:43:05.893 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:43:05.893 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:43:05.893 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 583915439 2023-12-20T04:43:05.893 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:05.893 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.4683 192.168.0.1:0/583915439", 2023-12-20T04:43:05.893 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/583915439", 2023-12-20T04:43:05.893 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2023-12-20T04:43:05.893 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 6, 2023-12-20T04:43:05.893 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 20, 2023-12-20T04:43:05.894 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:43:05.894 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:43:05.894 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:43:05.894 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:43:05.900 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:43:06.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:05.998+0000 7f73eca77640 1 Processor -- start 2023-12-20T04:43:06.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:05.998+0000 7f73eca77640 1 -- start start 2023-12-20T04:43:06.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:05.999+0000 7f73eca77640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e806c240 0x7f73e806c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:06.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:05.999+0000 7f73eca77640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e80ccf30 con 0x7f73e815e530 2023-12-20T04:43:06.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:05.999+0000 7f73eca77640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73e80ca1c0 con 0x7f73e8159b50 2023-12-20T04:43:06.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:05.999+0000 7f73eca77640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e806cc10 con 0x7f73e806c240 2023-12-20T04:43:06.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:05.999+0000 7f73e5d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f73e815e530 0x7f73e806fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60602/0 (socket says 172.21.15.132:60602) 2023-12-20T04:43:06.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:05.999+0000 7f73e5d9b640 1 -- 172.21.15.132:0/1977553001 learned_addr learned my addr 172.21.15.132:0/1977553001 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:06.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:05.999+0000 7f73e6d9d640 1 --2- 172.21.15.132:0/1977553001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e806c240 0x7f73e806c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:06.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:05.999+0000 7f73e559a640 1 -- 172.21.15.132:0/1977553001 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617459861 0 0) 0x7f73e80ccf30 con 0x7f73e815e530 2023-12-20T04:43:06.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:05.999+0000 7f73e559a640 1 -- 172.21.15.132:0/1977553001 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73d0003520 con 0x7f73e815e530 2023-12-20T04:43:06.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e559a640 1 -- 172.21.15.132:0/1977553001 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3445364215 0 0) 0x7f73d0003520 con 0x7f73e815e530 2023-12-20T04:43:06.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e559a640 1 -- 172.21.15.132:0/1977553001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e806c240 msgr2=0x7f73e806c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:06.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e559a640 1 --2- 172.21.15.132:0/1977553001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e806c240 0x7f73e806c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:06.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e559a640 1 -- 172.21.15.132:0/1977553001 >> v1:172.21.15.187:6789/0 conn(0x7f73e8159b50 legacy=0x7f73e80c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:06.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e559a640 1 -- 172.21.15.132:0/1977553001 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e80ca4a0 con 0x7f73e815e530 2023-12-20T04:43:06.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e559a640 1 -- 172.21.15.132:0/1977553001 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f73dc001670 con 0x7f73e815e530 2023-12-20T04:43:06.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e559a640 1 -- 172.21.15.132:0/1977553001 >> v1:172.21.15.132:6789/0 conn(0x7f73e815e530 legacy=0x7f73e806fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:06.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e559a640 1 --2- 172.21.15.132:0/1977553001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e806c240 0x7f73d00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:06.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e559a640 1 --2- 172.21.15.132:0/1977553001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73d0003f20 0x7f73d00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:06.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e559a640 1 --2- 172.21.15.132:0/1977553001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73d0004d00 0x7f73d0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:06.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e559a640 1 -- 172.21.15.132:0/1977553001 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e806cc10 con 0x7f73d0004d00 2023-12-20T04:43:06.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e559a640 1 -- 172.21.15.132:0/1977553001 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73d000ba60 con 0x7f73d0003f20 2023-12-20T04:43:06.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e559a640 1 -- 172.21.15.132:0/1977553001 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73d000de30 con 0x7f73e806c240 2023-12-20T04:43:06.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e6d9d640 1 --2- 172.21.15.132:0/1977553001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73d0004d00 0x7f73d0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:06.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e659c640 1 --2- 172.21.15.132:0/1977553001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e806c240 0x7f73d00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:06.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e5d9b640 1 --2- 172.21.15.132:0/1977553001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73d0003f20 0x7f73d00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:06.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e6d9d640 1 -- 172.21.15.132:0/1977553001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e806c240 msgr2=0x7f73d00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:06.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e6d9d640 1 --2- 172.21.15.132:0/1977553001 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e806c240 0x7f73d00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:06.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e6d9d640 1 -- 172.21.15.132:0/1977553001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73d0003f20 msgr2=0x7f73d00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:06.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e6d9d640 1 --2- 172.21.15.132:0/1977553001 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73d0003f20 0x7f73d00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:06.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.000+0000 7f73e6d9d640 1 -- 172.21.15.132:0/1977553001 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d0003520 con 0x7f73d0004d00 2023-12-20T04:43:06.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.001+0000 7f73e6d9d640 1 --2- 172.21.15.132:0/1977553001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73d0004d00 0x7f73d0005180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009fc0 tx=0x7f73d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8e07b012fd8d24c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:06.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.001+0000 7f73e559a640 1 -- 172.21.15.132:0/1977553001 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e002cc20 con 0x7f73d0004d00 2023-12-20T04:43:06.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.001+0000 7f73e559a640 1 -- 172.21.15.132:0/1977553001 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73e000f040 con 0x7f73d0004d00 2023-12-20T04:43:06.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.001+0000 7f73e559a640 1 -- 172.21.15.132:0/1977553001 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73e0034440 con 0x7f73d0004d00 2023-12-20T04:43:06.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.001+0000 7f73eca77640 1 -- 172.21.15.132:0/1977553001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73d0004d00 msgr2=0x7f73d0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:06.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.001+0000 7f73eca77640 1 --2- 172.21.15.132:0/1977553001 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73d0004d00 0x7f73d0005180 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f73e0009fc0 tx=0x7f73d00057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:06.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.001+0000 7f73e6d9d640 1 -- 172.21.15.132:0/1977553001 reap_dead start 2023-12-20T04:43:06.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.001+0000 7f73eca77640 1 -- 172.21.15.132:0/1977553001 shutdown_connections 2023-12-20T04:43:06.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.001+0000 7f73eca77640 1 -- 172.21.15.132:0/1977553001 >> 172.21.15.132:0/1977553001 conn(0x7f73e80ced10 msgr2=0x7f73e80cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:06.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.002+0000 7f73eca77640 1 -- 172.21.15.132:0/1977553001 shutdown_connections 2023-12-20T04:43:06.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.002+0000 7f73eca77640 1 -- 172.21.15.132:0/1977553001 wait complete. 2023-12-20T04:43:06.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.003+0000 7f73eca77640 1 Processor -- start 2023-12-20T04:43:06.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.003+0000 7f73eca77640 1 -- start start 2023-12-20T04:43:06.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73eca77640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73d0004d00 0x7f73e8155520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:06.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73eca77640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e814ffa0 0x7f73e8144ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:06.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73eca77640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e815c830 0x7f73e815ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:06.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73eca77640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e815d1f0 con 0x7f73e814ffa0 2023-12-20T04:43:06.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73eca77640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e81568d0 con 0x7f73d0004d00 2023-12-20T04:43:06.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73eca77640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e8155a60 con 0x7f73e815c830 2023-12-20T04:43:06.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73e5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e814ffa0 0x7f73e8144ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:06.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73e5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e814ffa0 0x7f73e8144ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:60350/0 (socket says 172.21.15.132:60350) 2023-12-20T04:43:06.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73e5d9b640 1 -- 172.21.15.132:0/2601770717 learned_addr learned my addr 172.21.15.132:0/2601770717 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:06.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73e6d9d640 1 --2- 172.21.15.132:0/2601770717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e815c830 0x7f73e815ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:06.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73e659c640 1 --2- 172.21.15.132:0/2601770717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73d0004d00 0x7f73e8155520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:06.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73e5d9b640 1 -- 172.21.15.132:0/2601770717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e815c830 msgr2=0x7f73e815ccb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:06.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73e5d9b640 1 --2- 172.21.15.132:0/2601770717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e815c830 0x7f73e815ccb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:06.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73e5d9b640 1 -- 172.21.15.132:0/2601770717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73d0004d00 msgr2=0x7f73e8155520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:06.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73e5d9b640 1 --2- 172.21.15.132:0/2601770717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73d0004d00 0x7f73e8155520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:06.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73e5d9b640 1 -- 172.21.15.132:0/2601770717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e8155cc0 con 0x7f73e814ffa0 2023-12-20T04:43:06.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73e5d9b640 1 --2- 172.21.15.132:0/2601770717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e814ffa0 0x7f73e8144ee0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0011e0 tx=0x7f73dc007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:06.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73d6ffd640 1 -- 172.21.15.132:0/2601770717 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc00f9c0 con 0x7f73e814ffa0 2023-12-20T04:43:06.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73d6ffd640 1 -- 172.21.15.132:0/2601770717 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73dc00fb40 con 0x7f73e814ffa0 2023-12-20T04:43:06.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73eca77640 1 -- 172.21.15.132:0/2601770717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e8155fa0 con 0x7f73e814ffa0 2023-12-20T04:43:06.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73d6ffd640 1 -- 172.21.15.132:0/2601770717 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73dc0133f0 con 0x7f73e814ffa0 2023-12-20T04:43:06.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.004+0000 7f73eca77640 1 -- 172.21.15.132:0/2601770717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e8156560 con 0x7f73e814ffa0 2023-12-20T04:43:06.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.005+0000 7f73eca77640 1 -- 172.21.15.132:0/2601770717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e81566f0 con 0x7f73e814ffa0 2023-12-20T04:43:06.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.006+0000 7f73d6ffd640 1 -- 172.21.15.132:0/2601770717 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f73dc013550 con 0x7f73e814ffa0 2023-12-20T04:43:06.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.006+0000 7f73d6ffd640 1 --2- 172.21.15.132:0/2601770717 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73c806a430 0x7f73c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:06.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.006+0000 7f73d6ffd640 1 -- 172.21.15.132:0/2601770717 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73dc088ab0 con 0x7f73e814ffa0 2023-12-20T04:43:06.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.006+0000 7f73e659c640 1 --2- 172.21.15.132:0/2601770717 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73c806a430 0x7f73c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:06.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.007+0000 7f73e659c640 1 --2- 172.21.15.132:0/2601770717 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73c806a430 0x7f73c806c8f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f73d80035f0 tx=0x7f73d8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:06.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.011+0000 7f73d6ffd640 1 -- 172.21.15.132:0/2601770717 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f73dc0540a0 con 0x7f73e814ffa0 2023-12-20T04:43:06.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.213+0000 7f73eca77640 1 -- 172.21.15.132:0/2601770717 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f73e804e840 con 0x7f73e814ffa0 2023-12-20T04:43:06.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.213+0000 7f73d6ffd640 1 -- 172.21.15.132:0/2601770717 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f73dc0576c0 con 0x7f73e814ffa0 2023-12-20T04:43:06.215 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:43:06.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.215+0000 7f73eca77640 1 -- 172.21.15.132:0/2601770717 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73c806a430 msgr2=0x7f73c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:06.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.215+0000 7f73eca77640 1 --2- 172.21.15.132:0/2601770717 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73c806a430 0x7f73c806c8f0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f73d80035f0 tx=0x7f73d8009040 comp rx=0 tx=0).stop 2023-12-20T04:43:06.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.215+0000 7f73eca77640 1 -- 172.21.15.132:0/2601770717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e814ffa0 msgr2=0x7f73e8144ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:06.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.215+0000 7f73eca77640 1 --2- 172.21.15.132:0/2601770717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e814ffa0 0x7f73e8144ee0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f73dc0011e0 tx=0x7f73dc007720 comp rx=0 tx=0).stop 2023-12-20T04:43:06.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.215+0000 7f73eca77640 1 -- 172.21.15.132:0/2601770717 shutdown_connections 2023-12-20T04:43:06.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.215+0000 7f73eca77640 1 --2- 172.21.15.132:0/2601770717 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73c806a430 0x7f73c806c8f0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:06.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.215+0000 7f73eca77640 1 --2- 172.21.15.132:0/2601770717 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e815c830 0x7f73e815ccb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:06.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.215+0000 7f73eca77640 1 --2- 172.21.15.132:0/2601770717 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e814ffa0 0x7f73e8144ee0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:06.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.215+0000 7f73eca77640 1 --2- 172.21.15.132:0/2601770717 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73d0004d00 0x7f73e8155520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:06.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.215+0000 7f73eca77640 1 -- 172.21.15.132:0/2601770717 >> 172.21.15.132:0/2601770717 conn(0x7f73e80ced10 msgr2=0x7f73e80cb190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:06.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.215+0000 7f73eca77640 1 -- 172.21.15.132:0/2601770717 shutdown_connections 2023-12-20T04:43:06.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:06.215+0000 7f73eca77640 1 -- 172.21.15.132:0/2601770717 wait complete. 2023-12-20T04:43:06.227 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:43:06.227 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:43:06.227 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-12-20T04:43:06.227 INFO:tasks.cephfs.mount:self.client.name = client.2 2023-12-20T04:43:06.227 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.2 2023-12-20T04:43:06.228 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:43:06.228 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:43:06.228 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:43:06.228 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.2' 2023-12-20T04:43:06.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:06.228 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-12-20T04:43:06.243 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:43:06.243 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:43:06.244 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:43:06.244 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:06.244 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-20T04:43:06.244 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:06.244 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:06.244 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:06.244 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-12-20T04:43:06.244 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:06.244 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:06.244 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-12-20T04:43:06.244 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:06.244 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:06.244 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:43:06.244 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:06.244 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:43:06.245 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42688sec preferred_lft 42688sec 2023-12-20T04:43:06.245 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-12-20T04:43:06.245 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:06.245 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:43:06.245 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 86:13:fe:55:4c:04 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:06.245 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:43:06.245 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:06.245 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::60dd:37ff:fe28:558b/64 scope link tentative 2023-12-20T04:43:06.245 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:06.245 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:43:06.245 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 86:13:fe:55:4c:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-20T04:43:06.245 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::8413:feff:fe55:4c04/64 scope link 2023-12-20T04:43:06.245 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:06.246 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:06.246 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:43:06.310 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-20T04:43:06.311 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:06.311 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-12-20T04:43:06.367 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-12-20T04:43:06.367 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:43:06.367 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:43:06.367 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:43:06.368 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:43:06.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:06.368 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:43:06.368 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:43:06.368 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:43:06.368 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:43:06.368 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:43:06.368 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:43:06.463 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:06.464 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-20T04:43:06.480 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-20T04:43:06.480 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:06.480 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list-id 2023-12-20T04:43:06.535 INFO:teuthology.orchestra.run.smithi132.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.0) 2023-12-20T04:43:06.535 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:06.535 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:43:06.535 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:43:06.535 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-20T04:43:06.536 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.2 1 2023-12-20T04:43:06.536 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:43:06.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:06.618 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-20T04:43:06.684 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:43:06.684 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:43:06.684 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:43:06.684 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:06.684 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-20T04:43:06.684 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:06.684 INFO:teuthology.orchestra.run.smithi132.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:43:06.684 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 62:60:cb:22:08:c5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-20T04:43:06.684 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-20T04:43:06.684 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:06.684 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::6060:cbff:fe22:8c5/64 scope link 2023-12-20T04:43:06.685 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:06.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:06.686 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr 2023-12-20T04:43:06.752 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:43:06.752 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:43:06.752 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:43:06.752 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:06.752 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-20T04:43:06.752 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:06.753 INFO:teuthology.orchestra.run.smithi132.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:43:06.753 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 62:60:cb:22:08:c5 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-20T04:43:06.753 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-20T04:43:06.753 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:06.753 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::6060:cbff:fe22:8c5/64 scope link 2023-12-20T04:43:06.753 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:06.754 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.2' with 192.168.0.2/16 2023-12-20T04:43:06.754 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:06.754 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:43:06.755 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:43:06.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.2 type veth peer name brx.1 2023-12-20T04:43:06.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-20T04:43:06.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set veth0 up 2023-12-20T04:43:06.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip link set lo up 2023-12-20T04:43:06.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.2 ip route add default via 192.168.255.254 2023-12-20T04:43:06.755 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:43:06.879 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:06.879 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:43:06.879 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:43:06.879 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.1 up 2023-12-20T04:43:06.879 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set dev brx.1 master ceph-brx 2023-12-20T04:43:06.879 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:43:06.920 INFO:tasks.cephfs.fuse_mount:Client client.2 config is {} 2023-12-20T04:43:06.921 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:43:06.921 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.2 2023-12-20T04:43:06.975 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.2' 2023-12-20T04:43:06.975 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:43:06.975 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.2 2023-12-20T04:43:07.030 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:43:07.096 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:43:07.097 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:43:07.162 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:43:07.163 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:43:07.164 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:07.164 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:43:07.219 INFO:teuthology.orchestra.run.smithi132.stdout:41 2023-12-20T04:43:07.219 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2023-12-20T04:43:07.219 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.2 --id 2) 2023-12-20T04:43:07.262 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:43:07.288 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:43:07.288 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:43:07.348 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi132.stderr:2023-12-20T04:43:07.346+0000 7f885a673480 -1 init, newargv = 0x55dacf3325d0 newargc=15 2023-12-20T04:43:07.348 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi132.stderr:ceph-fuse[89239]: starting ceph client 2023-12-20T04:43:07.352 INFO:tasks.cephfs.fuse_mount.ceph-fuse.2.smithi132.stderr:ceph-fuse[89239]: starting fuse 2023-12-20T04:43:07.357 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:43:07.358 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:43:07.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:07.359 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:43:07.414 INFO:teuthology.orchestra.run.smithi132.stdout:41 2023-12-20T04:43:07.414 INFO:teuthology.orchestra.run.smithi132.stdout:44 2023-12-20T04:43:07.414 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2023-12-20T04:43:07.415 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:43:07.415 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:43:07.415 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:43:07.415 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:43:07.415 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:43:07.415 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:07.415 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:43:07.415 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.2.*.asok" 2023-12-20T04:43:07.415 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:43:07.415 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.2" 2023-12-20T04:43:07.415 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:07.415 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:43:07.415 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:43:07.415 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:43:07.415 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:43:07.416 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:07.416 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:43:07.416 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:43:07.416 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:43:07.416 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:43:07.416 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:43:07.416 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:43:07.416 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:43:07.416 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:43:07.416 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:07.416 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.2")) 2023-12-20T04:43:07.416 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:43:07.531 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.2.89239.asok 2023-12-20T04:43:07.717 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.2.89239.asok 2023-12-20T04:43:07.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:07.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.2.89239.asok status 2023-12-20T04:43:07.852 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:43:07.852 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:43:07.852 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:43:07.852 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:43:07.853 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "2", 2023-12-20T04:43:07.853 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:43:07.853 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.2", 2023-12-20T04:43:07.853 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "89239", 2023-12-20T04:43:07.853 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:43:07.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:07.853 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2023-12-20T04:43:07.853 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:43:07.853 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4695, 2023-12-20T04:43:07.853 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:43:07.853 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:43:07.853 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:43:07.853 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 4695 2023-12-20T04:43:07.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:07.854 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:43:07.854 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:43:07.854 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.2:0", 2023-12-20T04:43:07.854 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 1315257111 2023-12-20T04:43:07.854 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:07.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:07.854 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:43:07.854 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:43:07.854 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.2:0", 2023-12-20T04:43:07.854 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 1315257111 2023-12-20T04:43:07.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:07.854 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.4695 192.168.0.2:0/1315257111", 2023-12-20T04:43:07.854 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.2:0/1315257111", 2023-12-20T04:43:07.854 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2023-12-20T04:43:07.855 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 6, 2023-12-20T04:43:07.855 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 20, 2023-12-20T04:43:07.855 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:43:07.855 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:43:07.855 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:43:07.855 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:43:07.861 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:43:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.959+0000 7f0e06947640 1 Processor -- start 2023-12-20T04:43:07.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.959+0000 7f0e06947640 1 -- start start 2023-12-20T04:43:07.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.959+0000 7f0e06947640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e00159b50 0x7f0e000c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:07.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.959+0000 7f0e06947640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0e0006c240 0x7f0e0006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:07.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.959+0000 7f0e06947640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e000ccf30 con 0x7f0e0015e530 2023-12-20T04:43:07.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.959+0000 7f0e06947640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e0006cc10 con 0x7f0e0006c240 2023-12-20T04:43:07.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.959+0000 7f0e06947640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000caa60 con 0x7f0e00159b50 2023-12-20T04:43:07.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.960+0000 7f0e04ee4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0e0006c240 0x7f0e0006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:07.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.960+0000 7f0dff7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0e0015e530 0x7f0e0006fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44518/0 (socket says 172.21.15.132:44518) 2023-12-20T04:43:07.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.960+0000 7f0dff7fe640 1 -- 172.21.15.132:0/2221458423 learned_addr learned my addr 172.21.15.132:0/2221458423 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.960+0000 7f0dfffff640 1 --2- 172.21.15.132:0/2221458423 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e00159b50 0x7f0e000c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.960+0000 7f0e04ee4640 1 -- 172.21.15.132:0/2221458423 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e00159b50 msgr2=0x7f0e000c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.960+0000 7f0e04ee4640 1 --2- 172.21.15.132:0/2221458423 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e00159b50 0x7f0e000c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.960+0000 7f0e04ee4640 1 -- 172.21.15.132:0/2221458423 >> v1:172.21.15.132:6789/0 conn(0x7f0e0015e530 legacy=0x7f0e0006fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.960+0000 7f0e04ee4640 1 -- 172.21.15.132:0/2221458423 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e000ca1c0 con 0x7f0e0006c240 2023-12-20T04:43:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.960+0000 7f0dfeffd640 1 -- 172.21.15.132:0/2221458423 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1272089608 0 0) 0x7f0e000ccf30 con 0x7f0e0015e530 2023-12-20T04:43:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.960+0000 7f0dfffff640 1 --2- 172.21.15.132:0/2221458423 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e00159b50 0x7f0e000c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.961+0000 7f0e04ee4640 1 --2- 172.21.15.132:0/2221458423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006c240 0x7f0e0006c6d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009d90 tx=0x7f0df802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d9c3c0501e14f10 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.961+0000 7f0dfeffd640 1 -- 172.21.15.132:0/2221458423 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df802cc50 con 0x7f0e0006c240 2023-12-20T04:43:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.961+0000 7f0dfeffd640 1 -- 172.21.15.132:0/2221458423 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df802cdb0 con 0x7f0e0006c240 2023-12-20T04:43:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.961+0000 7f0dfeffd640 1 -- 172.21.15.132:0/2221458423 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df8034660 con 0x7f0e0006c240 2023-12-20T04:43:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.961+0000 7f0e06947640 1 -- 172.21.15.132:0/2221458423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006c240 msgr2=0x7f0e0006c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.961+0000 7f0e06947640 1 --2- 172.21.15.132:0/2221458423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006c240 0x7f0e0006c6d0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009d90 tx=0x7f0df802bea0 comp rx=0 tx=0).stop 2023-12-20T04:43:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.961+0000 7f0e06947640 1 -- 172.21.15.132:0/2221458423 shutdown_connections 2023-12-20T04:43:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.961+0000 7f0e06947640 1 --2- 172.21.15.132:0/2221458423 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006c240 0x7f0e0006c6d0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.961+0000 7f0e06947640 1 --2- 172.21.15.132:0/2221458423 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e00159b50 0x7f0e000c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.961+0000 7f0e06947640 1 -- 172.21.15.132:0/2221458423 >> 172.21.15.132:0/2221458423 conn(0x7f0e000ced10 msgr2=0x7f0e000cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.961+0000 7f0e06947640 1 -- 172.21.15.132:0/2221458423 shutdown_connections 2023-12-20T04:43:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.961+0000 7f0e06947640 1 -- 172.21.15.132:0/2221458423 wait complete. 2023-12-20T04:43:07.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.962+0000 7f0e06947640 1 Processor -- start 2023-12-20T04:43:07.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.963+0000 7f0e06947640 1 -- start start 2023-12-20T04:43:07.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.963+0000 7f0e06947640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006c240 0x7f0e000c2fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:07.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.963+0000 7f0e06947640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e00159b50 0x7f0e0014d200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:07.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.963+0000 7f0e06947640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e0015e530 0x7f0e000c3c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:07.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.963+0000 7f0e06947640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0015a620 con 0x7f0e0006c240 2023-12-20T04:43:07.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.963+0000 7f0e06947640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0014d740 con 0x7f0e00159b50 2023-12-20T04:43:07.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.963+0000 7f0e06947640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000c44a0 con 0x7f0e0015e530 2023-12-20T04:43:07.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.963+0000 7f0dfffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006c240 0x7f0e000c2fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.963+0000 7f0dfffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006c240 0x7f0e000c2fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45944/0 (socket says 172.21.15.132:45944) 2023-12-20T04:43:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.963+0000 7f0dfffff640 1 -- 172.21.15.132:0/517121240 learned_addr learned my addr 172.21.15.132:0/517121240 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.964+0000 7f0e04ee4640 1 --2- 172.21.15.132:0/517121240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e0015e530 0x7f0e000c3c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.964+0000 7f0dff7fe640 1 --2- 172.21.15.132:0/517121240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e00159b50 0x7f0e0014d200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.964+0000 7f0dfffff640 1 -- 172.21.15.132:0/517121240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e0015e530 msgr2=0x7f0e000c3c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.964+0000 7f0dfffff640 1 --2- 172.21.15.132:0/517121240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e0015e530 0x7f0e000c3c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.964+0000 7f0dfffff640 1 -- 172.21.15.132:0/517121240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e00159b50 msgr2=0x7f0e0014d200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.964+0000 7f0dfffff640 1 --2- 172.21.15.132:0/517121240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e00159b50 0x7f0e0014d200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.964+0000 7f0dfffff640 1 -- 172.21.15.132:0/517121240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df8009a70 con 0x7f0e0006c240 2023-12-20T04:43:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.964+0000 7f0dff7fe640 1 --2- 172.21.15.132:0/517121240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e00159b50 0x7f0e0014d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.964+0000 7f0dfffff640 1 --2- 172.21.15.132:0/517121240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006c240 0x7f0e000c2fe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0df000e760 tx=0x7f0df000ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.964+0000 7f0dfcff9640 1 -- 172.21.15.132:0/517121240 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df0004230 con 0x7f0e0006c240 2023-12-20T04:43:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.964+0000 7f0dfcff9640 1 -- 172.21.15.132:0/517121240 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df0004390 con 0x7f0e0006c240 2023-12-20T04:43:07.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.964+0000 7f0e06947640 1 -- 172.21.15.132:0/517121240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e000c4780 con 0x7f0e0006c240 2023-12-20T04:43:07.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.964+0000 7f0dfcff9640 1 -- 172.21.15.132:0/517121240 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df000c8d0 con 0x7f0e0006c240 2023-12-20T04:43:07.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.964+0000 7f0e06947640 1 -- 172.21.15.132:0/517121240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e0015a2b0 con 0x7f0e0006c240 2023-12-20T04:43:07.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.965+0000 7f0e06947640 1 -- 172.21.15.132:0/517121240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e0004e840 con 0x7f0e0006c240 2023-12-20T04:43:07.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.965+0000 7f0dfcff9640 1 -- 172.21.15.132:0/517121240 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0df000ca30 con 0x7f0e0006c240 2023-12-20T04:43:07.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.966+0000 7f0dfcff9640 1 --2- 172.21.15.132:0/517121240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0dec06a430 0x7f0dec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:07.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.966+0000 7f0dfcff9640 1 -- 172.21.15.132:0/517121240 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0df0088590 con 0x7f0e0006c240 2023-12-20T04:43:07.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.966+0000 7f0dff7fe640 1 --2- 172.21.15.132:0/517121240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0dec06a430 0x7f0dec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:07.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.966+0000 7f0dff7fe640 1 --2- 172.21.15.132:0/517121240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0dec06a430 0x7f0dec06c8f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e0015d220 tx=0x7f0df4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:07.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:07.970+0000 7f0dfcff9640 1 -- 172.21.15.132:0/517121240 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0df0053b80 con 0x7f0e0006c240 2023-12-20T04:43:08.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:08.173+0000 7f0e06947640 1 -- 172.21.15.132:0/517121240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0e000b4c90 con 0x7f0e0006c240 2023-12-20T04:43:08.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:08.173+0000 7f0dfcff9640 1 -- 172.21.15.132:0/517121240 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0df00571a0 con 0x7f0e0006c240 2023-12-20T04:43:08.175 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:43:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:08.175+0000 7f0e06947640 1 -- 172.21.15.132:0/517121240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0dec06a430 msgr2=0x7f0dec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:08.175+0000 7f0e06947640 1 --2- 172.21.15.132:0/517121240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0dec06a430 0x7f0dec06c8f0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f0e0015d220 tx=0x7f0df4009040 comp rx=0 tx=0).stop 2023-12-20T04:43:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:08.175+0000 7f0e06947640 1 -- 172.21.15.132:0/517121240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006c240 msgr2=0x7f0e000c2fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:08.175+0000 7f0e06947640 1 --2- 172.21.15.132:0/517121240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006c240 0x7f0e000c2fe0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f0df000e760 tx=0x7f0df000ec20 comp rx=0 tx=0).stop 2023-12-20T04:43:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:08.175+0000 7f0e06947640 1 -- 172.21.15.132:0/517121240 shutdown_connections 2023-12-20T04:43:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:08.175+0000 7f0e06947640 1 --2- 172.21.15.132:0/517121240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0dec06a430 0x7f0dec06c8f0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:08.175+0000 7f0e06947640 1 --2- 172.21.15.132:0/517121240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e0015e530 0x7f0e000c3c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:08.175+0000 7f0e06947640 1 --2- 172.21.15.132:0/517121240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e00159b50 0x7f0e0014d200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:08.175+0000 7f0e06947640 1 --2- 172.21.15.132:0/517121240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006c240 0x7f0e000c2fe0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:08.175+0000 7f0e06947640 1 -- 172.21.15.132:0/517121240 >> 172.21.15.132:0/517121240 conn(0x7f0e000ced10 msgr2=0x7f0e0006fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:08.175+0000 7f0e06947640 1 -- 172.21.15.132:0/517121240 shutdown_connections 2023-12-20T04:43:08.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:08.175+0000 7f0e06947640 1 -- 172.21.15.132:0/517121240 wait complete. 2023-12-20T04:43:08.187 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:43:08.187 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:43:08.187 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-12-20T04:43:08.187 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-20T04:43:08.187 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-20T04:43:08.187 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:43:08.187 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:43:08.187 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:43:08.187 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:43:08.188 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:08.188 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-12-20T04:43:08.206 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:43:08.207 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:43:08.207 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:43:08.207 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:08.207 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-20T04:43:08.207 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:08.207 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:08.207 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:08.207 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-12-20T04:43:08.207 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:08.207 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:08.207 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-12-20T04:43:08.207 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:08.207 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:08.207 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:43:08.208 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:08.208 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:43:08.208 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42697sec preferred_lft 42697sec 2023-12-20T04:43:08.208 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-12-20T04:43:08.208 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:08.208 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2023-12-20T04:43:08.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:08.208 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:43:08.208 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:43:08.208 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add name ceph-brx type bridge 2023-12-20T04:43:08.209 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip addr flush dev ceph-brx 2023-12-20T04:43:08.209 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set ceph-brx up 2023-12-20T04:43:08.209 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2023-12-20T04:43:08.209 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:43:08.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:08.435 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:43:08.464 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-12-20T04:43:08.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:08.465 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-12-20T04:43:08.529 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-12-20T04:43:08.529 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:43:08.529 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:43:08.529 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:43:08.529 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:43:08.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:08.530 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:43:08.530 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:43:08.530 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:43:08.531 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:43:08.531 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:43:08.531 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:43:08.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:08.800 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-20T04:43:08.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:08.815 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list-id 2023-12-20T04:43:08.870 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:08.870 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:43:08.870 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:43:08.870 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-20T04:43:08.871 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2023-12-20T04:43:08.871 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:43:08.953 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2023-12-20T04:43:08.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:08.953 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:43:08.953 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:43:08.953 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2023-12-20T04:43:08.953 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2023-12-20T04:43:08.953 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2023-12-20T04:43:08.954 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2023-12-20T04:43:08.954 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2023-12-20T04:43:08.954 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:43:09.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:09.089 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:43:09.089 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:43:09.089 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2023-12-20T04:43:09.089 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set dev brx.0 master ceph-brx 2023-12-20T04:43:09.089 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:43:09.131 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-20T04:43:09.131 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:43:09.131 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-20T04:43:09.184 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:43:09.184 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:43:09.184 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:43:09.239 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:43:09.307 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:43:09.307 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:43:09.374 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:43:09.375 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:43:09.375 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:09.375 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:43:09.430 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:43:09.430 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-20T04:43:09.473 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:43:09.499 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:43:09.499 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:43:09.566 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:43:09.566 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:43:09.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:09.567 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:43:09.569 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:2023-12-20T04:43:09.567+0000 7f2e776f6480 -1 init, newargv = 0x562c9f077480 newargc=15 2023-12-20T04:43:09.569 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[85403]: starting ceph client 2023-12-20T04:43:09.572 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[85403]: starting fuse 2023-12-20T04:43:09.583 INFO:teuthology.orchestra.run.smithi187.stdout:41 2023-12-20T04:43:09.583 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:43:09.584 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:43:09.584 DEBUG:teuthology.orchestra.run.smithi187:> import glob 2023-12-20T04:43:09.584 DEBUG:teuthology.orchestra.run.smithi187:> import re 2023-12-20T04:43:09.584 DEBUG:teuthology.orchestra.run.smithi187:> import os 2023-12-20T04:43:09.584 DEBUG:teuthology.orchestra.run.smithi187:> import subprocess 2023-12-20T04:43:09.584 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:43:09.584 DEBUG:teuthology.orchestra.run.smithi187:> def _find_admin_socket(client_name): 2023-12-20T04:43:09.584 DEBUG:teuthology.orchestra.run.smithi187:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-20T04:43:09.584 DEBUG:teuthology.orchestra.run.smithi187:> files = glob.glob(asok_path) 2023-12-20T04:43:09.584 DEBUG:teuthology.orchestra.run.smithi187:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-20T04:43:09.584 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:43:09.584 DEBUG:teuthology.orchestra.run.smithi187:> # Given a non-glob path, it better be there 2023-12-20T04:43:09.584 DEBUG:teuthology.orchestra.run.smithi187:> if "*" not in asok_path: 2023-12-20T04:43:09.584 DEBUG:teuthology.orchestra.run.smithi187:> assert(len(files) == 1) 2023-12-20T04:43:09.584 DEBUG:teuthology.orchestra.run.smithi187:> return files[0] 2023-12-20T04:43:09.584 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:43:09.585 DEBUG:teuthology.orchestra.run.smithi187:> for f in files: 2023-12-20T04:43:09.585 DEBUG:teuthology.orchestra.run.smithi187:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:43:09.585 DEBUG:teuthology.orchestra.run.smithi187:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:43:09.585 DEBUG:teuthology.orchestra.run.smithi187:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:43:09.585 DEBUG:teuthology.orchestra.run.smithi187:> contents = proc_f.read() 2023-12-20T04:43:09.585 DEBUG:teuthology.orchestra.run.smithi187:> if mountpoint in contents: 2023-12-20T04:43:09.585 DEBUG:teuthology.orchestra.run.smithi187:> return f 2023-12-20T04:43:09.585 DEBUG:teuthology.orchestra.run.smithi187:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:43:09.585 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:43:09.585 DEBUG:teuthology.orchestra.run.smithi187:> print(_find_admin_socket("client.1")) 2023-12-20T04:43:09.585 DEBUG:teuthology.orchestra.run.smithi187:> ' 2023-12-20T04:43:09.699 INFO:teuthology.orchestra.run.smithi187.stdout:/var/run/ceph/ceph-client.1.85403.asok 2023-12-20T04:43:09.885 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.85403.asok 2023-12-20T04:43:09.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:09.886 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.85403.asok status 2023-12-20T04:43:10.020 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-12-20T04:43:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "metadata": { 2023-12-20T04:43:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:43:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:43:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "entity_id": "1", 2023-12-20T04:43:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "hostname": "smithi187", 2023-12-20T04:43:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-20T04:43:10.020 INFO:teuthology.orchestra.run.smithi187.stdout: "pid": "85403", 2023-12-20T04:43:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "root": "/" 2023-12-20T04:43:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:43:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_count": 0, 2023-12-20T04:43:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_pinned_count": 0, 2023-12-20T04:43:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "id": 4538, 2023-12-20T04:43:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "inst": { 2023-12-20T04:43:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "name": { 2023-12-20T04:43:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "client", 2023-12-20T04:43:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "num": 4538 2023-12-20T04:43:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:43:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:43:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:43:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:43:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 1982558192 2023-12-20T04:43:10.021 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-12-20T04:43:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:43:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:43:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:43:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:43:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 1982558192 2023-12-20T04:43:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:43:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "inst_str": "client.4538 192.168.0.1:0/1982558192", 2023-12-20T04:43:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "addr_str": "192.168.0.1:0/1982558192", 2023-12-20T04:43:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "inode_count": 1, 2023-12-20T04:43:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_epoch": 6, 2023-12-20T04:43:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch": 20, 2023-12-20T04:43:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:43:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "blocklisted": false, 2023-12-20T04:43:10.022 INFO:teuthology.orchestra.run.smithi187.stdout: "fs_name": "cephfs" 2023-12-20T04:43:10.023 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-12-20T04:43:10.028 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:43:10.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.137+0000 7f2d48e43640 1 Processor -- start 2023-12-20T04:43:10.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.137+0000 7f2d48e43640 1 -- start start 2023-12-20T04:43:10.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.138+0000 7f2d48e43640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d44160450 0x7f2d44160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:10.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.138+0000 7f2d48e43640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2d440b5090 0x7f2d440d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:10.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.138+0000 7f2d48e43640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d440b5ec0 con 0x7f2d441611b0 2023-12-20T04:43:10.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.138+0000 7f2d48e43640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d441617e0 con 0x7f2d440b5090 2023-12-20T04:43:10.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.138+0000 7f2d48e43640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d440d0fc0 con 0x7f2d44160450 2023-12-20T04:43:10.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.139+0000 7f2d41d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2d441611b0 0x7f2d440b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44528/0 (socket says 172.21.15.132:44528) 2023-12-20T04:43:10.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.139+0000 7f2d41d9b640 1 -- 172.21.15.132:0/471155508 learned_addr learned my addr 172.21.15.132:0/471155508 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:10.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.139+0000 7f2d42d9d640 1 --2- 172.21.15.132:0/471155508 >> v2:172.21.15.187:3300/0 conn(0x7f2d440b5090 0x7f2d440d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:10.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.139+0000 7f2d4259c640 1 --2- 172.21.15.132:0/471155508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d44160450 0x7f2d44160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:10.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.139+0000 7f2d4159a640 1 -- 172.21.15.132:0/471155508 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2773994925 0 0) 0x7f2d440b5ec0 con 0x7f2d441611b0 2023-12-20T04:43:10.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.139+0000 7f2d4159a640 1 -- 172.21.15.132:0/471155508 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d2c003520 con 0x7f2d441611b0 2023-12-20T04:43:10.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.139+0000 7f2d4259c640 1 -- 172.21.15.132:0/471155508 >> v2:172.21.15.187:3300/0 conn(0x7f2d440b5090 msgr2=0x7f2d440d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:10.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.139+0000 7f2d4259c640 1 --2- 172.21.15.132:0/471155508 >> v2:172.21.15.187:3300/0 conn(0x7f2d440b5090 0x7f2d440d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:10.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.139+0000 7f2d4259c640 1 -- 172.21.15.132:0/471155508 >> v1:172.21.15.132:6789/0 conn(0x7f2d441611b0 legacy=0x7f2d440b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:10.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.139+0000 7f2d4159a640 1 -- 172.21.15.132:0/471155508 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 602758633 0 0) 0x7f2d2c003520 con 0x7f2d441611b0 2023-12-20T04:43:10.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.139+0000 7f2d4259c640 1 -- 172.21.15.132:0/471155508 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d440d12a0 con 0x7f2d44160450 2023-12-20T04:43:10.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.139+0000 7f2d42d9d640 1 --2- 172.21.15.132:0/471155508 >> v2:172.21.15.187:3300/0 conn(0x7f2d440b5090 0x7f2d440d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:43:10.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.140+0000 7f2d4259c640 1 --2- 172.21.15.132:0/471155508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d44160450 0x7f2d44160c70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d34009d90 tx=0x7f2d3402be00 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f3110427780f3561 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:10.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.140+0000 7f2d4159a640 1 -- 172.21.15.132:0/471155508 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38001670 con 0x7f2d44160450 2023-12-20T04:43:10.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.140+0000 7f2d4159a640 1 -- 172.21.15.132:0/471155508 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d3402c930 con 0x7f2d44160450 2023-12-20T04:43:10.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.140+0000 7f2d4159a640 1 -- 172.21.15.132:0/471155508 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d3402ccc0 con 0x7f2d44160450 2023-12-20T04:43:10.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.141+0000 7f2d48e43640 1 -- 172.21.15.132:0/471155508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d44160450 msgr2=0x7f2d44160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:10.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.141+0000 7f2d48e43640 1 --2- 172.21.15.132:0/471155508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d44160450 0x7f2d44160c70 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f2d34009d90 tx=0x7f2d3402be00 comp rx=0 tx=0).stop 2023-12-20T04:43:10.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.141+0000 7f2d48e43640 1 -- 172.21.15.132:0/471155508 shutdown_connections 2023-12-20T04:43:10.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.141+0000 7f2d48e43640 1 --2- 172.21.15.132:0/471155508 >> v2:172.21.15.187:3300/0 conn(0x7f2d440b5090 0x7f2d440d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:10.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.141+0000 7f2d48e43640 1 --2- 172.21.15.132:0/471155508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d44160450 0x7f2d44160c70 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:10.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.141+0000 7f2d48e43640 1 -- 172.21.15.132:0/471155508 >> 172.21.15.132:0/471155508 conn(0x7f2d440cf980 msgr2=0x7f2d440cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:10.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.141+0000 7f2d48e43640 1 -- 172.21.15.132:0/471155508 shutdown_connections 2023-12-20T04:43:10.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.141+0000 7f2d48e43640 1 -- 172.21.15.132:0/471155508 wait complete. 2023-12-20T04:43:10.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.142+0000 7f2d48e43640 1 Processor -- start 2023-12-20T04:43:10.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.142+0000 7f2d48e43640 1 -- start start 2023-12-20T04:43:10.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d48e43640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d440b5090 0x7f2d44145de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:10.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d48e43640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d44160450 0x7f2d441f65d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:10.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d48e43640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d441611b0 0x7f2d44159cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:10.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d48e43640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d44146e00 con 0x7f2d44160450 2023-12-20T04:43:10.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d48e43640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d4414a150 con 0x7f2d441611b0 2023-12-20T04:43:10.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d48e43640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d44146320 con 0x7f2d440b5090 2023-12-20T04:43:10.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d41d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d44160450 0x7f2d441f65d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:10.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d41d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d44160450 0x7f2d441f65d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45956/0 (socket says 172.21.15.132:45956) 2023-12-20T04:43:10.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d41d9b640 1 -- 172.21.15.132:0/1965149223 learned_addr learned my addr 172.21.15.132:0/1965149223 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:10.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d42d9d640 1 --2- 172.21.15.132:0/1965149223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d441611b0 0x7f2d44159cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:10.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d4259c640 1 --2- 172.21.15.132:0/1965149223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d440b5090 0x7f2d44145de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:10.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d41d9b640 1 -- 172.21.15.132:0/1965149223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d440b5090 msgr2=0x7f2d44145de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:10.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d41d9b640 1 --2- 172.21.15.132:0/1965149223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d440b5090 0x7f2d44145de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:10.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d41d9b640 1 -- 172.21.15.132:0/1965149223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d441611b0 msgr2=0x7f2d44159cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:10.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d41d9b640 1 --2- 172.21.15.132:0/1965149223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d441611b0 0x7f2d44159cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:10.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d41d9b640 1 -- 172.21.15.132:0/1965149223 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d3c009400 con 0x7f2d44160450 2023-12-20T04:43:10.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d42d9d640 1 --2- 172.21.15.132:0/1965149223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d441611b0 0x7f2d44159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:10.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d41d9b640 1 --2- 172.21.15.132:0/1965149223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d44160450 0x7f2d441f65d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800c780 tx=0x7f2d3800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:10.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d32ffd640 1 -- 172.21.15.132:0/1965149223 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38005ad0 con 0x7f2d44160450 2023-12-20T04:43:10.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d32ffd640 1 -- 172.21.15.132:0/1965149223 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d38005c50 con 0x7f2d44160450 2023-12-20T04:43:10.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.143+0000 7f2d48e43640 1 -- 172.21.15.132:0/1965149223 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d34009a70 con 0x7f2d44160450 2023-12-20T04:43:10.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.144+0000 7f2d32ffd640 1 -- 172.21.15.132:0/1965149223 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d38007070 con 0x7f2d44160450 2023-12-20T04:43:10.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.144+0000 7f2d48e43640 1 -- 172.21.15.132:0/1965149223 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d441f6140 con 0x7f2d44160450 2023-12-20T04:43:10.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.145+0000 7f2d48e43640 1 -- 172.21.15.132:0/1965149223 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d441f62d0 con 0x7f2d44160450 2023-12-20T04:43:10.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.145+0000 7f2d32ffd640 1 -- 172.21.15.132:0/1965149223 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2d380071d0 con 0x7f2d44160450 2023-12-20T04:43:10.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.145+0000 7f2d32ffd640 1 --2- 172.21.15.132:0/1965149223 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d2406a430 0x7f2d2406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:10.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.146+0000 7f2d4259c640 1 --2- 172.21.15.132:0/1965149223 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d2406a430 0x7f2d2406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:10.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.146+0000 7f2d32ffd640 1 -- 172.21.15.132:0/1965149223 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2d380885c0 con 0x7f2d44160450 2023-12-20T04:43:10.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.146+0000 7f2d4259c640 1 --2- 172.21.15.132:0/1965149223 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d2406a430 0x7f2d2406c8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2d34036000 tx=0x7f2d34030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:10.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.150+0000 7f2d32ffd640 1 -- 172.21.15.132:0/1965149223 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2d38053bb0 con 0x7f2d44160450 2023-12-20T04:43:10.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.349+0000 7f2d48e43640 1 -- 172.21.15.132:0/1965149223 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f2d4404e840 con 0x7f2d44160450 2023-12-20T04:43:10.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.349+0000 7f2d32ffd640 1 -- 172.21.15.132:0/1965149223 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v6) v1 ==== 53+0+73 (secure 0 0 0) 0x7f2d380571d0 con 0x7f2d44160450 2023-12-20T04:43:10.351 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:43:10.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.351+0000 7f2d48e43640 1 -- 172.21.15.132:0/1965149223 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d2406a430 msgr2=0x7f2d2406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:10.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.351+0000 7f2d48e43640 1 --2- 172.21.15.132:0/1965149223 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d2406a430 0x7f2d2406c8f0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7f2d34036000 tx=0x7f2d34030000 comp rx=0 tx=0).stop 2023-12-20T04:43:10.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.351+0000 7f2d48e43640 1 -- 172.21.15.132:0/1965149223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d44160450 msgr2=0x7f2d441f65d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:10.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.351+0000 7f2d48e43640 1 --2- 172.21.15.132:0/1965149223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d44160450 0x7f2d441f65d0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f2d3800c780 tx=0x7f2d3800cc40 comp rx=0 tx=0).stop 2023-12-20T04:43:10.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.351+0000 7f2d48e43640 1 -- 172.21.15.132:0/1965149223 shutdown_connections 2023-12-20T04:43:10.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.351+0000 7f2d48e43640 1 --2- 172.21.15.132:0/1965149223 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d2406a430 0x7f2d2406c8f0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:10.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.351+0000 7f2d48e43640 1 --2- 172.21.15.132:0/1965149223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d441611b0 0x7f2d44159cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:10.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.351+0000 7f2d48e43640 1 --2- 172.21.15.132:0/1965149223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d44160450 0x7f2d441f65d0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:10.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.351+0000 7f2d48e43640 1 --2- 172.21.15.132:0/1965149223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d440b5090 0x7f2d44145de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:10.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.351+0000 7f2d48e43640 1 -- 172.21.15.132:0/1965149223 >> 172.21.15.132:0/1965149223 conn(0x7f2d440cf980 msgr2=0x7f2d44156730 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:10.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.351+0000 7f2d48e43640 1 -- 172.21.15.132:0/1965149223 shutdown_connections 2023-12-20T04:43:10.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:10.351+0000 7f2d48e43640 1 -- 172.21.15.132:0/1965149223 wait complete. 2023-12-20T04:43:10.363 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:43:10.363 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:43:10.363 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-12-20T04:43:10.363 INFO:tasks.cephfs.mount:self.client.name = client.3 2023-12-20T04:43:10.364 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.3 2023-12-20T04:43:10.364 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:43:10.364 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:43:10.364 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:43:10.364 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.3' 2023-12-20T04:43:10.364 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:10.364 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-12-20T04:43:10.380 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:43:10.380 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:43:10.380 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:43:10.380 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:10.380 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-20T04:43:10.380 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:10.380 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:10.380 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:10.380 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-12-20T04:43:10.380 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:10.381 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:10.381 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-12-20T04:43:10.381 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:10.381 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:10.381 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:43:10.381 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:10.381 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:43:10.381 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42695sec preferred_lft 42695sec 2023-12-20T04:43:10.381 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-12-20T04:43:10.381 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:10.381 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:43:10.381 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:10.381 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:43:10.382 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:10.382 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::a8bc:1cff:fe40:54ea/64 scope link tentative 2023-12-20T04:43:10.382 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:10.382 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:43:10.382 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-20T04:43:10.382 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c8e:c0ff:fe7a:bdc/64 scope link tentative 2023-12-20T04:43:10.382 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:10.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:10.383 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:43:10.446 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-12-20T04:43:10.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:10.448 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-12-20T04:43:10.504 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-12-20T04:43:10.504 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:43:10.504 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:43:10.504 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:43:10.504 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:43:10.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:10.504 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:43:10.504 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:43:10.505 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:43:10.505 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:43:10.505 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:43:10.505 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:43:10.600 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:10.601 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-20T04:43:10.615 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-20T04:43:10.616 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:10.616 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list-id 2023-12-20T04:43:10.670 INFO:teuthology.orchestra.run.smithi187.stdout:nsid 0 (iproute2 netns name: ceph-ns--home-ubuntu-cephtest-mnt.1) 2023-12-20T04:43:10.670 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:10.670 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:43:10.670 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:43:10.671 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-20T04:43:10.671 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.3 1 2023-12-20T04:43:10.671 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:43:10.752 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:10.752 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-20T04:43:10.819 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:43:10.819 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:43:10.819 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:43:10.820 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:10.820 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-20T04:43:10.820 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:10.820 INFO:teuthology.orchestra.run.smithi187.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:43:10.820 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 9a:58:e2:6a:52:e8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-20T04:43:10.820 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-20T04:43:10.820 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:10.820 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::9858:e2ff:fe6a:52e8/64 scope link 2023-12-20T04:43:10.820 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:10.821 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:10.821 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr 2023-12-20T04:43:10.887 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:43:10.887 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:43:10.887 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:43:10.888 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:10.888 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-20T04:43:10.888 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:10.888 INFO:teuthology.orchestra.run.smithi187.stdout:2: veth0@if7: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:43:10.888 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 9a:58:e2:6a:52:e8 brd ff:ff:ff:ff:ff:ff link-netnsid 0 2023-12-20T04:43:10.888 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.0.1/16 brd 192.168.255.255 scope global veth0 2023-12-20T04:43:10.888 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:10.888 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::9858:e2ff:fe6a:52e8/64 scope link 2023-12-20T04:43:10.888 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:10.889 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.3' with 192.168.0.2/16 2023-12-20T04:43:10.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:10.889 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:43:10.890 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:43:10.890 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.3 type veth peer name brx.1 2023-12-20T04:43:10.890 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip addr add 192.168.0.2/16 brd 192.168.255.255 dev veth0 2023-12-20T04:43:10.890 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set veth0 up 2023-12-20T04:43:10.890 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip link set lo up 2023-12-20T04:43:10.890 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.3 ip route add default via 192.168.255.254 2023-12-20T04:43:10.890 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:43:11.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:11.014 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:43:11.014 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:43:11.014 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.1 up 2023-12-20T04:43:11.014 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set dev brx.1 master ceph-brx 2023-12-20T04:43:11.014 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:43:11.055 INFO:tasks.cephfs.fuse_mount:Client client.3 config is {} 2023-12-20T04:43:11.056 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:43:11.056 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.3 2023-12-20T04:43:11.110 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.3' 2023-12-20T04:43:11.110 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:43:11.110 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.3 2023-12-20T04:43:11.166 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:43:11.237 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:43:11.237 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:43:11.302 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:43:11.304 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:43:11.304 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:11.304 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:43:11.359 INFO:teuthology.orchestra.run.smithi187.stdout:41 2023-12-20T04:43:11.359 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [41] 2023-12-20T04:43:11.359 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.3 --id 3) 2023-12-20T04:43:11.401 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:43:11.429 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:43:11.429 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:43:11.485 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi187.stderr:2023-12-20T04:43:11.484+0000 7f02ceb60480 -1 init, newargv = 0x556784a414b0 newargc=15 2023-12-20T04:43:11.485 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi187.stderr:ceph-fuse[85848]: starting ceph client 2023-12-20T04:43:11.489 INFO:tasks.cephfs.fuse_mount.ceph-fuse.3.smithi187.stderr:ceph-fuse[85848]: starting fuse 2023-12-20T04:43:11.495 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:43:11.496 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:43:11.497 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:11.497 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:43:11.552 INFO:teuthology.orchestra.run.smithi187.stdout:41 2023-12-20T04:43:11.552 INFO:teuthology.orchestra.run.smithi187.stdout:44 2023-12-20T04:43:11.552 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41, 44] 2023-12-20T04:43:11.552 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:43:11.552 DEBUG:teuthology.orchestra.run.smithi187:> import glob 2023-12-20T04:43:11.552 DEBUG:teuthology.orchestra.run.smithi187:> import re 2023-12-20T04:43:11.553 DEBUG:teuthology.orchestra.run.smithi187:> import os 2023-12-20T04:43:11.553 DEBUG:teuthology.orchestra.run.smithi187:> import subprocess 2023-12-20T04:43:11.553 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:43:11.553 DEBUG:teuthology.orchestra.run.smithi187:> def _find_admin_socket(client_name): 2023-12-20T04:43:11.553 DEBUG:teuthology.orchestra.run.smithi187:> asok_path = "/var/run/ceph/ceph-client.3.*.asok" 2023-12-20T04:43:11.553 DEBUG:teuthology.orchestra.run.smithi187:> files = glob.glob(asok_path) 2023-12-20T04:43:11.553 DEBUG:teuthology.orchestra.run.smithi187:> mountpoint = "/home/ubuntu/cephtest/mnt.3" 2023-12-20T04:43:11.553 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:43:11.553 DEBUG:teuthology.orchestra.run.smithi187:> # Given a non-glob path, it better be there 2023-12-20T04:43:11.553 DEBUG:teuthology.orchestra.run.smithi187:> if "*" not in asok_path: 2023-12-20T04:43:11.553 DEBUG:teuthology.orchestra.run.smithi187:> assert(len(files) == 1) 2023-12-20T04:43:11.553 DEBUG:teuthology.orchestra.run.smithi187:> return files[0] 2023-12-20T04:43:11.553 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:43:11.553 DEBUG:teuthology.orchestra.run.smithi187:> for f in files: 2023-12-20T04:43:11.554 DEBUG:teuthology.orchestra.run.smithi187:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:43:11.554 DEBUG:teuthology.orchestra.run.smithi187:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:43:11.554 DEBUG:teuthology.orchestra.run.smithi187:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:43:11.554 DEBUG:teuthology.orchestra.run.smithi187:> contents = proc_f.read() 2023-12-20T04:43:11.554 DEBUG:teuthology.orchestra.run.smithi187:> if mountpoint in contents: 2023-12-20T04:43:11.554 DEBUG:teuthology.orchestra.run.smithi187:> return f 2023-12-20T04:43:11.554 DEBUG:teuthology.orchestra.run.smithi187:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:43:11.554 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:43:11.554 DEBUG:teuthology.orchestra.run.smithi187:> print(_find_admin_socket("client.3")) 2023-12-20T04:43:11.554 DEBUG:teuthology.orchestra.run.smithi187:> ' 2023-12-20T04:43:11.667 INFO:teuthology.orchestra.run.smithi187.stdout:/var/run/ceph/ceph-client.3.85848.asok 2023-12-20T04:43:11.854 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.3.85848.asok 2023-12-20T04:43:11.855 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:11.855 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.3.85848.asok status 2023-12-20T04:43:11.989 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-12-20T04:43:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: "metadata": { 2023-12-20T04:43:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:43:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:43:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: "entity_id": "3", 2023-12-20T04:43:11.989 INFO:teuthology.orchestra.run.smithi187.stdout: "hostname": "smithi187", 2023-12-20T04:43:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.3", 2023-12-20T04:43:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "pid": "85848", 2023-12-20T04:43:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "root": "/" 2023-12-20T04:43:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:43:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_count": 0, 2023-12-20T04:43:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_pinned_count": 0, 2023-12-20T04:43:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "id": 4627, 2023-12-20T04:43:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "inst": { 2023-12-20T04:43:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "name": { 2023-12-20T04:43:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "client", 2023-12-20T04:43:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "num": 4627 2023-12-20T04:43:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:43:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:43:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:43:11.990 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.2:0", 2023-12-20T04:43:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 3528347249 2023-12-20T04:43:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-12-20T04:43:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:43:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:43:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:43:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.2:0", 2023-12-20T04:43:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 3528347249 2023-12-20T04:43:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:43:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "inst_str": "client.4627 192.168.0.2:0/3528347249", 2023-12-20T04:43:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "addr_str": "192.168.0.2:0/3528347249", 2023-12-20T04:43:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "inode_count": 1, 2023-12-20T04:43:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_epoch": 6, 2023-12-20T04:43:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch": 20, 2023-12-20T04:43:11.991 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:43:11.992 INFO:teuthology.orchestra.run.smithi187.stdout: "blocklisted": false, 2023-12-20T04:43:11.992 INFO:teuthology.orchestra.run.smithi187.stdout: "fs_name": "cephfs" 2023-12-20T04:43:11.992 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-12-20T04:43:11.997 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:11.997 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2023-12-20T04:43:11.997 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-20T04:43:12.016 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2023-12-20T04:43:12.016 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-20T04:43:12.016 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:12.016 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:43:12.090 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:12.090 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2023-12-20T04:43:12.090 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.2 2023-12-20T04:43:12.148 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2023-12-20T04:43:12.148 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.2 2023-12-20T04:43:12.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:12.149 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.2 2023-12-20T04:43:12.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:12.220 DEBUG:teuthology.orchestra.run.smithi187:> stat --file-system '--printf=%T 2023-12-20T04:43:12.220 DEBUG:teuthology.orchestra.run.smithi187:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-20T04:43:12.235 INFO:teuthology.orchestra.run.smithi187.stdout:fuseblk 2023-12-20T04:43:12.236 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-20T04:43:12.236 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:12.236 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:43:12.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:12.303 DEBUG:teuthology.orchestra.run.smithi187:> stat --file-system '--printf=%T 2023-12-20T04:43:12.303 DEBUG:teuthology.orchestra.run.smithi187:> ' -- /home/ubuntu/cephtest/mnt.3 2023-12-20T04:43:12.358 INFO:teuthology.orchestra.run.smithi187.stdout:fuseblk 2023-12-20T04:43:12.358 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.3 2023-12-20T04:43:12.359 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:12.359 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.3 2023-12-20T04:43:12.425 INFO:teuthology.run_tasks:Running task cephfs_test_runner... 2023-12-20T04:43:12.445 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:12.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.550+0000 7f3bf1bf0640 1 Processor -- start 2023-12-20T04:43:12.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.550+0000 7f3bf1bf0640 1 -- start start 2023-12-20T04:43:12.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.551+0000 7f3bf1bf0640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3bec160450 0x7f3bec160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:12.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.551+0000 7f3bf1bf0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bec1611b0 0x7f3bec0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:12.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.551+0000 7f3bf1bf0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3bec0b4ec0 0x7f3bec06a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:12.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.551+0000 7f3bf1bf0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bec0b5350 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.551+0000 7f3bf1bf0640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bec0b5ec0 con 0x7f3bec160450 2023-12-20T04:43:12.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.551+0000 7f3bf1bf0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec1617e0 con 0x7f3bec1611b0 2023-12-20T04:43:12.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.551+0000 7f3bebfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3bec0b4ec0 0x7f3bec06a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:12.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.551+0000 7f3bebfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3bec0b4ec0 0x7f3bec06a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45958/0 (socket says 172.21.15.132:45958) 2023-12-20T04:43:12.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.551+0000 7f3bebfff640 1 -- 172.21.15.132:0/2653930785 learned_addr learned my addr 172.21.15.132:0/2653930785 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:12.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.551+0000 7f3beaffd640 1 --2- 172.21.15.132:0/2653930785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bec1611b0 0x7f3bec0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:12.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.551+0000 7f3beb7fe640 1 --2- 172.21.15.132:0/2653930785 >> v2:172.21.15.187:3300/0 conn(0x7f3bec160450 0x7f3bec160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:12.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.552+0000 7f3bebfff640 1 -- 172.21.15.132:0/2653930785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bec1611b0 msgr2=0x7f3bec0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:12.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.552+0000 7f3bebfff640 1 --2- 172.21.15.132:0/2653930785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bec1611b0 0x7f3bec0b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:12.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.552+0000 7f3bebfff640 1 -- 172.21.15.132:0/2653930785 >> v2:172.21.15.187:3300/0 conn(0x7f3bec160450 msgr2=0x7f3bec160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:12.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.552+0000 7f3bebfff640 1 --2- 172.21.15.132:0/2653930785 >> v2:172.21.15.187:3300/0 conn(0x7f3bec160450 0x7f3bec160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:12.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.552+0000 7f3bebfff640 1 -- 172.21.15.132:0/2653930785 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bec0d0fc0 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.552+0000 7f3bebfff640 1 --2- 172.21.15.132:0/2653930785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bec0b4ec0 0x7f3bec06a1a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3bec08b150 tx=0x7f3be402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79441b8767c8104d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:12.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.552+0000 7f3bea7fc640 1 -- 172.21.15.132:0/2653930785 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be402cb00 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.552+0000 7f3bea7fc640 1 -- 172.21.15.132:0/2653930785 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3be402cc60 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.552+0000 7f3bea7fc640 1 -- 172.21.15.132:0/2653930785 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3be40343f0 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.553+0000 7f3bf1bf0640 1 -- 172.21.15.132:0/2653930785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bec0b4ec0 msgr2=0x7f3bec06a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.553+0000 7f3bf1bf0640 1 --2- 172.21.15.132:0/2653930785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bec0b4ec0 0x7f3bec06a1a0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f3bec08b150 tx=0x7f3be402bf60 comp rx=0 tx=0).stop 2023-12-20T04:43:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.553+0000 7f3bf1bf0640 1 -- 172.21.15.132:0/2653930785 shutdown_connections 2023-12-20T04:43:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.553+0000 7f3bf1bf0640 1 --2- 172.21.15.132:0/2653930785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bec0b4ec0 0x7f3bec06a1a0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.553+0000 7f3bf1bf0640 1 --2- 172.21.15.132:0/2653930785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bec1611b0 0x7f3bec0b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.553+0000 7f3bf1bf0640 1 --2- 172.21.15.132:0/2653930785 >> v2:172.21.15.187:3300/0 conn(0x7f3bec160450 0x7f3bec160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.553+0000 7f3bf1bf0640 1 -- 172.21.15.132:0/2653930785 >> 172.21.15.132:0/2653930785 conn(0x7f3bec0cf980 msgr2=0x7f3bec0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.553+0000 7f3bf1bf0640 1 -- 172.21.15.132:0/2653930785 shutdown_connections 2023-12-20T04:43:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.553+0000 7f3bf1bf0640 1 -- 172.21.15.132:0/2653930785 wait complete. 2023-12-20T04:43:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.554+0000 7f3bf1bf0640 1 Processor -- start 2023-12-20T04:43:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.554+0000 7f3bf1bf0640 1 -- start start 2023-12-20T04:43:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.555+0000 7f3bf1bf0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bec0b4ec0 0x7f3bec152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:12.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.555+0000 7f3bf1bf0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bec160450 0x7f3bec0d2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.555+0000 7f3bf1bf0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bec1611b0 0x7f3bec15b510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.555+0000 7f3bf1bf0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec1f3640 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.555+0000 7f3bf1bf0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec152960 con 0x7f3bec160450 2023-12-20T04:43:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.555+0000 7f3bf1bf0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bec1f2a70 con 0x7f3bec1611b0 2023-12-20T04:43:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.555+0000 7f3beb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bec0b4ec0 0x7f3bec152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.555+0000 7f3beb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bec0b4ec0 0x7f3bec152420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45972/0 (socket says 172.21.15.132:45972) 2023-12-20T04:43:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.555+0000 7f3beb7fe640 1 -- 172.21.15.132:0/750782890 learned_addr learned my addr 172.21.15.132:0/750782890 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.555+0000 7f3beb7fe640 1 -- 172.21.15.132:0/750782890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bec1611b0 msgr2=0x7f3bec15b510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.555+0000 7f3beb7fe640 1 --2- 172.21.15.132:0/750782890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bec1611b0 0x7f3bec15b510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.555+0000 7f3beb7fe640 1 -- 172.21.15.132:0/750782890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bec160450 msgr2=0x7f3bec0d2d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.555+0000 7f3beb7fe640 1 --2- 172.21.15.132:0/750782890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bec160450 0x7f3bec0d2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.555+0000 7f3beb7fe640 1 -- 172.21.15.132:0/750782890 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3be4009b30 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.556+0000 7f3beb7fe640 1 --2- 172.21.15.132:0/750782890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bec0b4ec0 0x7f3bec152420 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00e9b0 tx=0x7f3bdc00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.556+0000 7f3bd3fff640 1 -- 172.21.15.132:0/750782890 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc00c9a0 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.556+0000 7f3bd3fff640 1 -- 172.21.15.132:0/750782890 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bdc00cb00 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.556+0000 7f3bf1bf0640 1 -- 172.21.15.132:0/750782890 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bec1f2d10 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.556+0000 7f3bd3fff640 1 -- 172.21.15.132:0/750782890 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bdc013470 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.556+0000 7f3bf1bf0640 1 -- 172.21.15.132:0/750782890 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bec1f32d0 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.557+0000 7f3bf1bf0640 1 -- 172.21.15.132:0/750782890 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bec04e840 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.557+0000 7f3bd3fff640 1 -- 172.21.15.132:0/750782890 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3bdc0135d0 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.558+0000 7f3bd3fff640 1 --2- 172.21.15.132:0/750782890 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3bd806a460 0x7f3bd806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:12.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.558+0000 7f3beaffd640 1 --2- 172.21.15.132:0/750782890 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3bd806a460 0x7f3bd806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:12.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.558+0000 7f3bd3fff640 1 -- 172.21.15.132:0/750782890 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3bdc088b50 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.558+0000 7f3beaffd640 1 --2- 172.21.15.132:0/750782890 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3bd806a460 0x7f3bd806c920 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0c95f0 tx=0x7f3be0009460 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:12.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.562+0000 7f3bd3fff640 1 -- 172.21.15.132:0/750782890 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3bdc0541d0 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.729+0000 7f3bf1bf0640 1 -- 172.21.15.132:0/750782890 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3bec0b7070 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.730+0000 7f3bd3fff640 1 -- 172.21.15.132:0/750782890 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f3bdc017090 con 0x7f3bec0b4ec0 2023-12-20T04:43:12.732 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:12.732 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.732+0000 7f3bf1bf0640 1 -- 172.21.15.132:0/750782890 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3bd806a460 msgr2=0x7f3bd806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.732+0000 7f3bf1bf0640 1 --2- 172.21.15.132:0/750782890 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3bd806a460 0x7f3bd806c920 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f3bec0c95f0 tx=0x7f3be0009460 comp rx=0 tx=0).stop 2023-12-20T04:43:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.732+0000 7f3bf1bf0640 1 -- 172.21.15.132:0/750782890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bec0b4ec0 msgr2=0x7f3bec152420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.732+0000 7f3bf1bf0640 1 --2- 172.21.15.132:0/750782890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bec0b4ec0 0x7f3bec152420 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f3bdc00e9b0 tx=0x7f3bdc00ee70 comp rx=0 tx=0).stop 2023-12-20T04:43:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.732+0000 7f3bf1bf0640 1 -- 172.21.15.132:0/750782890 shutdown_connections 2023-12-20T04:43:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.732+0000 7f3bf1bf0640 1 --2- 172.21.15.132:0/750782890 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3bd806a460 0x7f3bd806c920 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.732+0000 7f3bf1bf0640 1 --2- 172.21.15.132:0/750782890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bec1611b0 0x7f3bec15b510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.732+0000 7f3bf1bf0640 1 --2- 172.21.15.132:0/750782890 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bec160450 0x7f3bec0d2d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.732+0000 7f3bf1bf0640 1 --2- 172.21.15.132:0/750782890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bec0b4ec0 0x7f3bec152420 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:12.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.732+0000 7f3bf1bf0640 1 -- 172.21.15.132:0/750782890 >> 172.21.15.132:0/750782890 conn(0x7f3bec0cf980 msgr2=0x7f3bec15e740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:12.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.732+0000 7f3bf1bf0640 1 -- 172.21.15.132:0/750782890 shutdown_connections 2023-12-20T04:43:12.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.732+0000 7f3bf1bf0640 1 -- 172.21.15.132:0/750782890 wait complete. 2023-12-20T04:43:12.745 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:42:45.433456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:42:46.128920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:43:12.745 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:43:12.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.846+0000 7f7c9b3fb640 1 Processor -- start 2023-12-20T04:43:12.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.847+0000 7f7c9b3fb640 1 -- start start 2023-12-20T04:43:12.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.847+0000 7f7c9b3fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c940cbb60 0x7f7c940cf040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:12.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.847+0000 7f7c9b3fb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7c9415e0c0 0x7f7c940b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:12.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.847+0000 7f7c9b3fb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c940cf9e0 con 0x7f7c940cb780 2023-12-20T04:43:12.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.847+0000 7f7c9b3fb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c940cdaf0 con 0x7f7c9415e0c0 2023-12-20T04:43:12.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.847+0000 7f7c9b3fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c940cfcc0 con 0x7f7c940cbb60 2023-12-20T04:43:12.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.848+0000 7f7c98996640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c940cbb60 0x7f7c940cf040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:12.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.848+0000 7f7c99197640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f7c940cb780 0x7f7c940cd3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:54568/0 (socket says 172.21.15.132:54568) 2023-12-20T04:43:12.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.848+0000 7f7c99998640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7c9415e0c0 0x7f7c940b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:12.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.848+0000 7f7c99197640 1 -- 172.21.15.132:0/567664540 learned_addr learned my addr 172.21.15.132:0/567664540 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:12.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.848+0000 7f7c99998640 1 -- 172.21.15.132:0/567664540 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c940cbb60 msgr2=0x7f7c940cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:12.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.848+0000 7f7c99998640 1 --2- 172.21.15.132:0/567664540 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c940cbb60 0x7f7c940cf040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:12.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.848+0000 7f7c99998640 1 -- 172.21.15.132:0/567664540 >> v1:172.21.15.187:6789/0 conn(0x7f7c940cb780 legacy=0x7f7c940cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:12.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.848+0000 7f7c99998640 1 -- 172.21.15.132:0/567664540 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c940cffa0 con 0x7f7c9415e0c0 2023-12-20T04:43:12.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.848+0000 7f7c8bfff640 1 -- 172.21.15.132:0/567664540 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2529514152 0 0) 0x7f7c940cf9e0 con 0x7f7c940cb780 2023-12-20T04:43:12.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.848+0000 7f7c98996640 1 --2- 172.21.15.132:0/567664540 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c940cbb60 0x7f7c940cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:43:12.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.849+0000 7f7c99998640 1 --2- 172.21.15.132:0/567664540 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c9415e0c0 0x7f7c940b1280 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009d90 tx=0x7f7c8c02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eb64f4ea34864d3b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:12.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.849+0000 7f7c8bfff640 1 -- 172.21.15.132:0/567664540 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c02cc50 con 0x7f7c9415e0c0 2023-12-20T04:43:12.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.849+0000 7f7c8bfff640 1 -- 172.21.15.132:0/567664540 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8c02cdb0 con 0x7f7c9415e0c0 2023-12-20T04:43:12.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.849+0000 7f7c8bfff640 1 -- 172.21.15.132:0/567664540 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8c034660 con 0x7f7c9415e0c0 2023-12-20T04:43:12.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.849+0000 7f7c9b3fb640 1 -- 172.21.15.132:0/567664540 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c9415e0c0 msgr2=0x7f7c940b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:12.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.849+0000 7f7c9b3fb640 1 --2- 172.21.15.132:0/567664540 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c9415e0c0 0x7f7c940b1280 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7c8c009d90 tx=0x7f7c8c02bea0 comp rx=0 tx=0).stop 2023-12-20T04:43:12.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.849+0000 7f7c9b3fb640 1 -- 172.21.15.132:0/567664540 shutdown_connections 2023-12-20T04:43:12.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.849+0000 7f7c9b3fb640 1 --2- 172.21.15.132:0/567664540 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c9415e0c0 0x7f7c940b1280 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:12.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.849+0000 7f7c9b3fb640 1 --2- 172.21.15.132:0/567664540 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c940cbb60 0x7f7c940cf040 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:12.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.849+0000 7f7c9b3fb640 1 -- 172.21.15.132:0/567664540 >> 172.21.15.132:0/567664540 conn(0x7f7c9406bfc0 msgr2=0x7f7c9406c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:12.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.849+0000 7f7c9b3fb640 1 -- 172.21.15.132:0/567664540 shutdown_connections 2023-12-20T04:43:12.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.849+0000 7f7c9b3fb640 1 -- 172.21.15.132:0/567664540 wait complete. 2023-12-20T04:43:12.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.851+0000 7f7c9b3fb640 1 Processor -- start 2023-12-20T04:43:12.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.851+0000 7f7c9b3fb640 1 -- start start 2023-12-20T04:43:12.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.851+0000 7f7c9b3fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c940cb780 0x7f7c94158760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:12.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.851+0000 7f7c9b3fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c940cbb60 0x7f7c941477a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:12.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.851+0000 7f7c9b3fb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c9415e0c0 0x7f7c94070d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:12.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.851+0000 7f7c9b3fb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c94071be0 con 0x7f7c940cbb60 2023-12-20T04:43:12.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.851+0000 7f7c9b3fb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c9415a160 con 0x7f7c9415e0c0 2023-12-20T04:43:12.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.851+0000 7f7c9b3fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c94147ce0 con 0x7f7c940cb780 2023-12-20T04:43:12.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.851+0000 7f7c98996640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c940cbb60 0x7f7c941477a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:12.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.851+0000 7f7c98996640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c940cbb60 0x7f7c941477a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45986/0 (socket says 172.21.15.132:45986) 2023-12-20T04:43:12.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.851+0000 7f7c98996640 1 -- 172.21.15.132:0/1634538437 learned_addr learned my addr 172.21.15.132:0/1634538437 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:12.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.852+0000 7f7c99197640 1 --2- 172.21.15.132:0/1634538437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c940cb780 0x7f7c94158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:12.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.852+0000 7f7c99998640 1 --2- 172.21.15.132:0/1634538437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c9415e0c0 0x7f7c94070d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:12.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.852+0000 7f7c98996640 1 -- 172.21.15.132:0/1634538437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c940cb780 msgr2=0x7f7c94158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:12.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.852+0000 7f7c98996640 1 --2- 172.21.15.132:0/1634538437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c940cb780 0x7f7c94158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:12.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.852+0000 7f7c98996640 1 -- 172.21.15.132:0/1634538437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c9415e0c0 msgr2=0x7f7c94070d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:12.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.852+0000 7f7c98996640 1 --2- 172.21.15.132:0/1634538437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c9415e0c0 0x7f7c94070d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:12.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.852+0000 7f7c98996640 1 -- 172.21.15.132:0/1634538437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c84009400 con 0x7f7c940cbb60 2023-12-20T04:43:12.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.852+0000 7f7c98996640 1 --2- 172.21.15.132:0/1634538437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c940cbb60 0x7f7c941477a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400ebe0 tx=0x7f7c8400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:12.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.852+0000 7f7c89ffb640 1 -- 172.21.15.132:0/1634538437 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c84009760 con 0x7f7c940cbb60 2023-12-20T04:43:12.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.852+0000 7f7c89ffb640 1 -- 172.21.15.132:0/1634538437 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c8400cc30 con 0x7f7c940cbb60 2023-12-20T04:43:12.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.852+0000 7f7c9b3fb640 1 -- 172.21.15.132:0/1634538437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c8c009a70 con 0x7f7c940cbb60 2023-12-20T04:43:12.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.852+0000 7f7c89ffb640 1 -- 172.21.15.132:0/1634538437 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c8400eee0 con 0x7f7c940cbb60 2023-12-20T04:43:12.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.852+0000 7f7c9b3fb640 1 -- 172.21.15.132:0/1634538437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c94157c80 con 0x7f7c940cbb60 2023-12-20T04:43:12.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.853+0000 7f7c9b3fb640 1 -- 172.21.15.132:0/1634538437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c9404e840 con 0x7f7c940cbb60 2023-12-20T04:43:12.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.854+0000 7f7c89ffb640 1 -- 172.21.15.132:0/1634538437 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7c84013470 con 0x7f7c940cbb60 2023-12-20T04:43:12.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.854+0000 7f7c89ffb640 1 --2- 172.21.15.132:0/1634538437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c7806a430 0x7f7c7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:12.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.854+0000 7f7c89ffb640 1 -- 172.21.15.132:0/1634538437 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c84088c80 con 0x7f7c940cbb60 2023-12-20T04:43:12.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.854+0000 7f7c99197640 1 --2- 172.21.15.132:0/1634538437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c7806a430 0x7f7c7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:12.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.854+0000 7f7c99197640 1 --2- 172.21.15.132:0/1634538437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c7806a430 0x7f7c7806c8f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7c90000f60 tx=0x7f7c90007d50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:12.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:12.858+0000 7f7c89ffb640 1 -- 172.21.15.132:0/1634538437 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7c840542a0 con 0x7f7c940cbb60 2023-12-20T04:43:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.025+0000 7f7c9b3fb640 1 -- 172.21.15.132:0/1634538437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f7c940cc3f0 con 0x7f7c940cbb60 2023-12-20T04:43:13.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.025+0000 7f7c89ffb640 1 -- 172.21.15.132:0/1634538437 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f7c840578c0 con 0x7f7c940cbb60 2023-12-20T04:43:13.027 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:43:13.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.027+0000 7f7c9b3fb640 1 -- 172.21.15.132:0/1634538437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c7806a430 msgr2=0x7f7c7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.027+0000 7f7c9b3fb640 1 --2- 172.21.15.132:0/1634538437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c7806a430 0x7f7c7806c8f0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f7c90000f60 tx=0x7f7c90007d50 comp rx=0 tx=0).stop 2023-12-20T04:43:13.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.027+0000 7f7c9b3fb640 1 -- 172.21.15.132:0/1634538437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c940cbb60 msgr2=0x7f7c941477a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.027+0000 7f7c9b3fb640 1 --2- 172.21.15.132:0/1634538437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c940cbb60 0x7f7c941477a0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400ebe0 tx=0x7f7c8400c520 comp rx=0 tx=0).stop 2023-12-20T04:43:13.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.027+0000 7f7c9b3fb640 1 -- 172.21.15.132:0/1634538437 shutdown_connections 2023-12-20T04:43:13.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.027+0000 7f7c9b3fb640 1 --2- 172.21.15.132:0/1634538437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c7806a430 0x7f7c7806c8f0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.027+0000 7f7c9b3fb640 1 --2- 172.21.15.132:0/1634538437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c9415e0c0 0x7f7c94070d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.027+0000 7f7c9b3fb640 1 --2- 172.21.15.132:0/1634538437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c940cbb60 0x7f7c941477a0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.027+0000 7f7c9b3fb640 1 --2- 172.21.15.132:0/1634538437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c940cb780 0x7f7c94158760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.027+0000 7f7c9b3fb640 1 -- 172.21.15.132:0/1634538437 >> 172.21.15.132:0/1634538437 conn(0x7f7c9406bfc0 msgr2=0x7f7c9406c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.027+0000 7f7c9b3fb640 1 -- 172.21.15.132:0/1634538437 shutdown_connections 2023-12-20T04:43:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.027+0000 7f7c9b3fb640 1 -- 172.21.15.132:0/1634538437 wait complete. 2023-12-20T04:43:13.039 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:43:13.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.141+0000 7f7f935ea640 1 Processor -- start 2023-12-20T04:43:13.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.141+0000 7f7f935ea640 1 -- start start 2023-12-20T04:43:13.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.142+0000 7f7f935ea640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f8c0cf1d0 0x7f7f8c15e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.142+0000 7f7f935ea640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7f8c0ce7e0 0x7f7f8c0708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.142+0000 7f7f935ea640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f8c070e00 con 0x7f7f8c070460 2023-12-20T04:43:13.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.142+0000 7f7f935ea640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f8c15e740 con 0x7f7f8c0ce7e0 2023-12-20T04:43:13.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.142+0000 7f7f935ea640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0cb6b0 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.143+0000 7f7f91b87640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7f8c0ce7e0 0x7f7f8c0708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:13.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.143+0000 7f7f91386640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f8c0cf1d0 0x7f7f8c15e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:13.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.143+0000 7f7f90b85640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f7f8c070460 0x7f7f8c0c4a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:54572/0 (socket says 172.21.15.132:54572) 2023-12-20T04:43:13.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.143+0000 7f7f90b85640 1 -- 172.21.15.132:0/4052025564 learned_addr learned my addr 172.21.15.132:0/4052025564 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:13.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.143+0000 7f7f91386640 1 -- 172.21.15.132:0/4052025564 >> v2:172.21.15.187:3300/0 conn(0x7f7f8c0ce7e0 msgr2=0x7f7f8c0708c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:13.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.143+0000 7f7f91386640 1 --2- 172.21.15.132:0/4052025564 >> v2:172.21.15.187:3300/0 conn(0x7f7f8c0ce7e0 0x7f7f8c0708c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.143+0000 7f7f91386640 1 -- 172.21.15.132:0/4052025564 >> v1:172.21.15.187:6789/0 conn(0x7f7f8c070460 legacy=0x7f7f8c0c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.143+0000 7f7f91386640 1 -- 172.21.15.132:0/4052025564 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c0cb990 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.143+0000 7f7f91b87640 1 --2- 172.21.15.132:0/4052025564 >> v2:172.21.15.187:3300/0 conn(0x7f7f8c0ce7e0 0x7f7f8c0708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:43:13.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.144+0000 7f7f91386640 1 --2- 172.21.15.132:0/4052025564 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f8c0cf1d0 0x7f7f8c15e200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7f88009d90 tx=0x7f7f8802bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=da78122097ff9120 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:13.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.144+0000 7f7f83fff640 1 -- 172.21.15.132:0/4052025564 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f8802cc50 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.144+0000 7f7f83fff640 1 -- 172.21.15.132:0/4052025564 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f8802cdb0 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.144+0000 7f7f83fff640 1 -- 172.21.15.132:0/4052025564 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f88034660 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.144+0000 7f7f935ea640 1 -- 172.21.15.132:0/4052025564 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f8c0cf1d0 msgr2=0x7f7f8c15e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.144+0000 7f7f935ea640 1 --2- 172.21.15.132:0/4052025564 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f8c0cf1d0 0x7f7f8c15e200 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f7f88009d90 tx=0x7f7f8802bea0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.144+0000 7f7f935ea640 1 -- 172.21.15.132:0/4052025564 shutdown_connections 2023-12-20T04:43:13.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.144+0000 7f7f935ea640 1 --2- 172.21.15.132:0/4052025564 >> v2:172.21.15.187:3300/0 conn(0x7f7f8c0ce7e0 0x7f7f8c0708c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.144+0000 7f7f935ea640 1 --2- 172.21.15.132:0/4052025564 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f8c0cf1d0 0x7f7f8c15e200 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.144+0000 7f7f935ea640 1 -- 172.21.15.132:0/4052025564 >> 172.21.15.132:0/4052025564 conn(0x7f7f8c0cc630 msgr2=0x7f7f8c0cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:13.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.144+0000 7f7f935ea640 1 -- 172.21.15.132:0/4052025564 shutdown_connections 2023-12-20T04:43:13.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.144+0000 7f7f935ea640 1 -- 172.21.15.132:0/4052025564 wait complete. 2023-12-20T04:43:13.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.146+0000 7f7f935ea640 1 Processor -- start 2023-12-20T04:43:13.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.146+0000 7f7f935ea640 1 -- start start 2023-12-20T04:43:13.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.146+0000 7f7f935ea640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f8c070460 0x7f7f8c0b5570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.146+0000 7f7f935ea640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f8c0ce7e0 0x7f7f8c15cc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.146+0000 7f7f935ea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f8c0cf1d0 0x7f7f8c0c5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.146+0000 7f7f935ea640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0c7da0 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.146+0000 7f7f935ea640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c15c950 con 0x7f7f8c070460 2023-12-20T04:43:13.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.146+0000 7f7f935ea640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f8c0c7120 con 0x7f7f8c0ce7e0 2023-12-20T04:43:13.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.146+0000 7f7f91b87640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f8c0cf1d0 0x7f7f8c0c5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:13.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.146+0000 7f7f91b87640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f8c0cf1d0 0x7f7f8c0c5eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46000/0 (socket says 172.21.15.132:46000) 2023-12-20T04:43:13.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.146+0000 7f7f91b87640 1 -- 172.21.15.132:0/3782722363 learned_addr learned my addr 172.21.15.132:0/3782722363 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:13.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.147+0000 7f7f90b85640 1 --2- 172.21.15.132:0/3782722363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f8c0ce7e0 0x7f7f8c15cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:13.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.147+0000 7f7f91386640 1 --2- 172.21.15.132:0/3782722363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f8c070460 0x7f7f8c0b5570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:13.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.147+0000 7f7f91b87640 1 -- 172.21.15.132:0/3782722363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f8c0ce7e0 msgr2=0x7f7f8c15cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.147+0000 7f7f91b87640 1 --2- 172.21.15.132:0/3782722363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f8c0ce7e0 0x7f7f8c15cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.147+0000 7f7f91b87640 1 -- 172.21.15.132:0/3782722363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f8c070460 msgr2=0x7f7f8c0b5570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.147+0000 7f7f91b87640 1 --2- 172.21.15.132:0/3782722363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f8c070460 0x7f7f8c0b5570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.147+0000 7f7f91b87640 1 -- 172.21.15.132:0/3782722363 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8400b6a0 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.147+0000 7f7f91b87640 1 --2- 172.21.15.132:0/3782722363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f8c0cf1d0 0x7f7f8c0c5eb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400ecf0 tx=0x7f7f8400d720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:13.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.147+0000 7f7f81ffb640 1 -- 172.21.15.132:0/3782722363 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f84004230 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.147+0000 7f7f81ffb640 1 -- 172.21.15.132:0/3782722363 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f84004390 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.147+0000 7f7f81ffb640 1 -- 172.21.15.132:0/3782722363 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f84003830 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.147+0000 7f7f935ea640 1 -- 172.21.15.132:0/3782722363 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f88009a70 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.147+0000 7f7f935ea640 1 -- 172.21.15.132:0/3782722363 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f8c0c76e0 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.148+0000 7f7f935ea640 1 -- 172.21.15.132:0/3782722363 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f8c04e840 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.149+0000 7f7f81ffb640 1 -- 172.21.15.132:0/3782722363 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7f84003990 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.149+0000 7f7f81ffb640 1 --2- 172.21.15.132:0/3782722363 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7f7006a460 0x7f7f7006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.149+0000 7f7f91386640 1 --2- 172.21.15.132:0/3782722363 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7f7006a460 0x7f7f7006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:13.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.149+0000 7f7f81ffb640 1 -- 172.21.15.132:0/3782722363 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f84088ea0 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.149+0000 7f7f91386640 1 --2- 172.21.15.132:0/3782722363 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7f7006a460 0x7f7f7006c920 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7f88036000 tx=0x7f7f88030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:13.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.153+0000 7f7f81ffb640 1 -- 172.21.15.132:0/3782722363 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7f840545d0 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.317+0000 7f7f935ea640 1 -- 172.21.15.132:0/3782722363 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7f8c0717c0 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.317+0000 7f7f81ffb640 1 -- 172.21.15.132:0/3782722363 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7f84057bf0 con 0x7f7f8c0cf1d0 2023-12-20T04:43:13.319 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:43:13.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.319+0000 7f7f935ea640 1 -- 172.21.15.132:0/3782722363 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7f7006a460 msgr2=0x7f7f7006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.319+0000 7f7f935ea640 1 --2- 172.21.15.132:0/3782722363 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7f7006a460 0x7f7f7006c920 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f7f88036000 tx=0x7f7f88030000 comp rx=0 tx=0).stop 2023-12-20T04:43:13.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.319+0000 7f7f935ea640 1 -- 172.21.15.132:0/3782722363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f8c0cf1d0 msgr2=0x7f7f8c0c5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.319+0000 7f7f935ea640 1 --2- 172.21.15.132:0/3782722363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f8c0cf1d0 0x7f7f8c0c5eb0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400ecf0 tx=0x7f7f8400d720 comp rx=0 tx=0).stop 2023-12-20T04:43:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.319+0000 7f7f935ea640 1 -- 172.21.15.132:0/3782722363 shutdown_connections 2023-12-20T04:43:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.319+0000 7f7f935ea640 1 --2- 172.21.15.132:0/3782722363 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7f7006a460 0x7f7f7006c920 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.319+0000 7f7f935ea640 1 --2- 172.21.15.132:0/3782722363 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f8c0cf1d0 0x7f7f8c0c5eb0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.319+0000 7f7f935ea640 1 --2- 172.21.15.132:0/3782722363 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f8c0ce7e0 0x7f7f8c15cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.319+0000 7f7f935ea640 1 --2- 172.21.15.132:0/3782722363 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f8c070460 0x7f7f8c0b5570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.319+0000 7f7f935ea640 1 -- 172.21.15.132:0/3782722363 >> 172.21.15.132:0/3782722363 conn(0x7f7f8c0cc630 msgr2=0x7f7f8c06c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.319+0000 7f7f935ea640 1 -- 172.21.15.132:0/3782722363 shutdown_connections 2023-12-20T04:43:13.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.319+0000 7f7f935ea640 1 -- 172.21.15.132:0/3782722363 wait complete. 2023-12-20T04:43:13.331 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:43:13.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.432+0000 7f48eb0af640 1 Processor -- start 2023-12-20T04:43:13.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.432+0000 7f48eb0af640 1 -- start start 2023-12-20T04:43:13.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.433+0000 7f48eb0af640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f48e4069c30 0x7f48e4070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.433+0000 7f48eb0af640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e40c4f40 con 0x7f48e40cbde0 2023-12-20T04:43:13.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.433+0000 7f48eb0af640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48e40af5b0 con 0x7f48e415d360 2023-12-20T04:43:13.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.433+0000 7f48eb0af640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48e4070a40 con 0x7f48e4069c30 2023-12-20T04:43:13.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.433+0000 7f48e8e4b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f48e4069c30 0x7f48e4070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:13.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.433+0000 7f48e8e4b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f48e4069c30 0x7f48e4070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46012/0 (socket says 172.21.15.132:46012) 2023-12-20T04:43:13.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.433+0000 7f48e8e4b640 1 -- 172.21.15.132:0/1202642546 learned_addr learned my addr 172.21.15.132:0/1202642546 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:13.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.433+0000 7f48e964c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f48e40cbde0 0x7f48e40ca170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44534/0 (socket says 172.21.15.132:44534) 2023-12-20T04:43:13.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.434+0000 7f48e8e4b640 1 -- 172.21.15.132:0/1202642546 >> v1:172.21.15.187:6789/0 conn(0x7f48e415d360 legacy=0x7f48e406a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.434+0000 7f48e8e4b640 1 -- 172.21.15.132:0/1202642546 >> v1:172.21.15.132:6789/0 conn(0x7f48e40cbde0 legacy=0x7f48e40ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.434+0000 7f48e8e4b640 1 -- 172.21.15.132:0/1202642546 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48e4070d20 con 0x7f48e4069c30 2023-12-20T04:43:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.434+0000 7f48e8e4b640 1 --2- 172.21.15.132:0/1202642546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48e4069c30 0x7f48e4070460 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009870 tx=0x7f48d402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c3457aa0fff0c60 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.435+0000 7f48e37fe640 1 -- 172.21.15.132:0/1202642546 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d402f840 con 0x7f48e4069c30 2023-12-20T04:43:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.435+0000 7f48e37fe640 1 -- 172.21.15.132:0/1202642546 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48d402f9a0 con 0x7f48e4069c30 2023-12-20T04:43:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.435+0000 7f48e37fe640 1 -- 172.21.15.132:0/1202642546 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48d402fd30 con 0x7f48e4069c30 2023-12-20T04:43:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.435+0000 7f48eb0af640 1 -- 172.21.15.132:0/1202642546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48e4069c30 msgr2=0x7f48e4070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.435+0000 7f48eb0af640 1 --2- 172.21.15.132:0/1202642546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48e4069c30 0x7f48e4070460 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f48d4009870 tx=0x7f48d402ba20 comp rx=0 tx=0).stop 2023-12-20T04:43:13.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.435+0000 7f48eb0af640 1 -- 172.21.15.132:0/1202642546 shutdown_connections 2023-12-20T04:43:13.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.435+0000 7f48eb0af640 1 --2- 172.21.15.132:0/1202642546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48e4069c30 0x7f48e4070460 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.435+0000 7f48eb0af640 1 -- 172.21.15.132:0/1202642546 >> 172.21.15.132:0/1202642546 conn(0x7f48e40cc630 msgr2=0x7f48e40cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:13.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.435+0000 7f48eb0af640 1 -- 172.21.15.132:0/1202642546 shutdown_connections 2023-12-20T04:43:13.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.435+0000 7f48eb0af640 1 -- 172.21.15.132:0/1202642546 wait complete. 2023-12-20T04:43:13.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.436+0000 7f48eb0af640 1 Processor -- start 2023-12-20T04:43:13.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.436+0000 7f48eb0af640 1 -- start start 2023-12-20T04:43:13.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.437+0000 7f48eb0af640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48e40cbde0 0x7f48e406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.437+0000 7f48eb0af640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48e415d360 0x7f48e41f38c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.437+0000 7f48eb0af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48e406d640 0x7f48e415e1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.437+0000 7f48eb0af640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e41f3e00 con 0x7f48e406d640 2023-12-20T04:43:13.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.437+0000 7f48eb0af640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48e406dc00 con 0x7f48e40cbde0 2023-12-20T04:43:13.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.437+0000 7f48eb0af640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48e406dee0 con 0x7f48e415d360 2023-12-20T04:43:13.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.437+0000 7f48e964c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48e406d640 0x7f48e415e1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:13.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.437+0000 7f48e964c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48e406d640 0x7f48e415e1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46022/0 (socket says 172.21.15.132:46022) 2023-12-20T04:43:13.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.437+0000 7f48e964c640 1 -- 172.21.15.132:0/357658721 learned_addr learned my addr 172.21.15.132:0/357658721 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:13.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.438+0000 7f48e964c640 1 -- 172.21.15.132:0/357658721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48e415d360 msgr2=0x7f48e41f38c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.438+0000 7f48e964c640 1 --2- 172.21.15.132:0/357658721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48e415d360 0x7f48e41f38c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.438+0000 7f48e964c640 1 -- 172.21.15.132:0/357658721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48e40cbde0 msgr2=0x7f48e406ec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.438+0000 7f48e964c640 1 --2- 172.21.15.132:0/357658721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48e40cbde0 0x7f48e406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.438+0000 7f48e964c640 1 -- 172.21.15.132:0/357658721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48d40094d0 con 0x7f48e406d640 2023-12-20T04:43:13.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.438+0000 7f48e964c640 1 --2- 172.21.15.132:0/357658721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48e406d640 0x7f48e415e1f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00c780 tx=0x7f48dc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:13.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.438+0000 7f48e17fa640 1 -- 172.21.15.132:0/357658721 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc00ce90 con 0x7f48e406d640 2023-12-20T04:43:13.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.438+0000 7f48e17fa640 1 -- 172.21.15.132:0/357658721 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48dc00a640 con 0x7f48e406d640 2023-12-20T04:43:13.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.438+0000 7f48eb0af640 1 -- 172.21.15.132:0/357658721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48e406e1c0 con 0x7f48e406d640 2023-12-20T04:43:13.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.438+0000 7f48e17fa640 1 -- 172.21.15.132:0/357658721 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48dc00a9f0 con 0x7f48e406d640 2023-12-20T04:43:13.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.438+0000 7f48eb0af640 1 -- 172.21.15.132:0/357658721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48e406e780 con 0x7f48e406d640 2023-12-20T04:43:13.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.439+0000 7f48eb0af640 1 -- 172.21.15.132:0/357658721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48e404e840 con 0x7f48e406d640 2023-12-20T04:43:13.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.439+0000 7f48e17fa640 1 -- 172.21.15.132:0/357658721 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f48dc00ab50 con 0x7f48e406d640 2023-12-20T04:43:13.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.440+0000 7f48e17fa640 1 --2- 172.21.15.132:0/357658721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f48d006a430 0x7f48d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.440+0000 7f48e17fa640 1 -- 172.21.15.132:0/357658721 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48dc088000 con 0x7f48e406d640 2023-12-20T04:43:13.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.440+0000 7f48e8e4b640 1 --2- 172.21.15.132:0/357658721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f48d006a430 0x7f48d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:13.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.440+0000 7f48e8e4b640 1 --2- 172.21.15.132:0/357658721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f48d006a430 0x7f48d006c8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48d4036000 tx=0x7f48d4039040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:13.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.444+0000 7f48e17fa640 1 -- 172.21.15.132:0/357658721 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f48dc0571c0 con 0x7f48e406d640 2023-12-20T04:43:13.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.609+0000 7f48eb0af640 1 -- 172.21.15.132:0/357658721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f48e406a9a0 con 0x7f48e406d640 2023-12-20T04:43:13.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.609+0000 7f48e17fa640 1 -- 172.21.15.132:0/357658721 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f48dc056d50 con 0x7f48e406d640 2023-12-20T04:43:13.611 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:43:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.611+0000 7f48eb0af640 1 -- 172.21.15.132:0/357658721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f48d006a430 msgr2=0x7f48d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.611+0000 7f48eb0af640 1 --2- 172.21.15.132:0/357658721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f48d006a430 0x7f48d006c8f0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f48d4036000 tx=0x7f48d4039040 comp rx=0 tx=0).stop 2023-12-20T04:43:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.611+0000 7f48eb0af640 1 -- 172.21.15.132:0/357658721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48e406d640 msgr2=0x7f48e415e1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.611+0000 7f48eb0af640 1 --2- 172.21.15.132:0/357658721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48e406d640 0x7f48e415e1f0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f48dc00c780 tx=0x7f48dc00cc40 comp rx=0 tx=0).stop 2023-12-20T04:43:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.611+0000 7f48eb0af640 1 -- 172.21.15.132:0/357658721 shutdown_connections 2023-12-20T04:43:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.611+0000 7f48eb0af640 1 --2- 172.21.15.132:0/357658721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f48d006a430 0x7f48d006c8f0 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.611+0000 7f48eb0af640 1 --2- 172.21.15.132:0/357658721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48e406d640 0x7f48e415e1f0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.611+0000 7f48eb0af640 1 --2- 172.21.15.132:0/357658721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48e415d360 0x7f48e41f38c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.611+0000 7f48eb0af640 1 --2- 172.21.15.132:0/357658721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48e40cbde0 0x7f48e406ec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.611+0000 7f48eb0af640 1 -- 172.21.15.132:0/357658721 >> 172.21.15.132:0/357658721 conn(0x7f48e40cc630 msgr2=0x7f48e40ad710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:13.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.611+0000 7f48eb0af640 1 -- 172.21.15.132:0/357658721 shutdown_connections 2023-12-20T04:43:13.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.611+0000 7f48eb0af640 1 -- 172.21.15.132:0/357658721 wait complete. 2023-12-20T04:43:13.623 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:13.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.721+0000 7ff50c5d2640 1 Processor -- start 2023-12-20T04:43:13.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.721+0000 7ff50c5d2640 1 -- start start 2023-12-20T04:43:13.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.722+0000 7ff50c5d2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff50415d100 0x7ff5040b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.722+0000 7ff50c5d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5040d0370 0x7ff5040cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.722+0000 7ff50c5d2640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff504161850 0x7ff5040cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.722+0000 7ff50c5d2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5040b2f90 con 0x7ff50415d100 2023-12-20T04:43:13.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.722+0000 7ff50c5d2640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5041613c0 con 0x7ff504161850 2023-12-20T04:43:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.722+0000 7ff50c5d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5040d0810 con 0x7ff5040d0370 2023-12-20T04:43:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.722+0000 7ff50a36e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff50415d100 0x7ff5040b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.722+0000 7ff50a36e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff50415d100 0x7ff5040b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46024/0 (socket says 172.21.15.132:46024) 2023-12-20T04:43:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.722+0000 7ff50a36e640 1 -- 172.21.15.132:0/4275558321 learned_addr learned my addr 172.21.15.132:0/4275558321 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.722+0000 7ff50a36e640 1 -- 172.21.15.132:0/4275558321 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5040d0370 msgr2=0x7ff5040cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.722+0000 7ff50a36e640 1 --2- 172.21.15.132:0/4275558321 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5040d0370 0x7ff5040cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.722+0000 7ff50a36e640 1 -- 172.21.15.132:0/4275558321 >> v2:172.21.15.187:3300/0 conn(0x7ff504161850 msgr2=0x7ff5040cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.722+0000 7ff50a36e640 1 --2- 172.21.15.132:0/4275558321 >> v2:172.21.15.187:3300/0 conn(0x7ff504161850 0x7ff5040cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.722+0000 7ff50a36e640 1 -- 172.21.15.132:0/4275558321 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff504160d70 con 0x7ff50415d100 2023-12-20T04:43:13.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.723+0000 7ff50a36e640 1 --2- 172.21.15.132:0/4275558321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff50415d100 0x7ff5040b2a50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff50406e790 tx=0x7ff50002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b8f96dd31b4f82eb server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.723+0000 7ff50936c640 1 -- 172.21.15.132:0/4275558321 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5000317e0 con 0x7ff50415d100 2023-12-20T04:43:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.723+0000 7ff50936c640 1 -- 172.21.15.132:0/4275558321 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff500031940 con 0x7ff50415d100 2023-12-20T04:43:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.723+0000 7ff50936c640 1 -- 172.21.15.132:0/4275558321 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff500031cd0 con 0x7ff50415d100 2023-12-20T04:43:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.724+0000 7ff50c5d2640 1 -- 172.21.15.132:0/4275558321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff50415d100 msgr2=0x7ff5040b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.724+0000 7ff50c5d2640 1 --2- 172.21.15.132:0/4275558321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff50415d100 0x7ff5040b2a50 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ff50406e790 tx=0x7ff50002b880 comp rx=0 tx=0).stop 2023-12-20T04:43:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.724+0000 7ff50c5d2640 1 -- 172.21.15.132:0/4275558321 shutdown_connections 2023-12-20T04:43:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.724+0000 7ff50c5d2640 1 --2- 172.21.15.132:0/4275558321 >> v2:172.21.15.187:3300/0 conn(0x7ff504161850 0x7ff5040cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.724+0000 7ff50c5d2640 1 --2- 172.21.15.132:0/4275558321 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5040d0370 0x7ff5040cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.724+0000 7ff50c5d2640 1 --2- 172.21.15.132:0/4275558321 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff50415d100 0x7ff5040b2a50 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.724+0000 7ff50c5d2640 1 -- 172.21.15.132:0/4275558321 >> 172.21.15.132:0/4275558321 conn(0x7ff50406d7c0 msgr2=0x7ff50406dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.724+0000 7ff50c5d2640 1 -- 172.21.15.132:0/4275558321 shutdown_connections 2023-12-20T04:43:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.724+0000 7ff50c5d2640 1 -- 172.21.15.132:0/4275558321 wait complete. 2023-12-20T04:43:13.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.725+0000 7ff50c5d2640 1 Processor -- start 2023-12-20T04:43:13.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.725+0000 7ff50c5d2640 1 -- start start 2023-12-20T04:43:13.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff50c5d2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5040d0370 0x7ff504157c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff50c5d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff50415d100 0x7ff5040c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff50c5d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff504161850 0x7ff50415fdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff50c5d2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50415f010 con 0x7ff50415d100 2023-12-20T04:43:13.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff50c5d2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50415f2f0 con 0x7ff5040d0370 2023-12-20T04:43:13.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff50c5d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50415f5d0 con 0x7ff504161850 2023-12-20T04:43:13.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff509b6d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff50415d100 0x7ff5040c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:13.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff509b6d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff50415d100 0x7ff5040c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46026/0 (socket says 172.21.15.132:46026) 2023-12-20T04:43:13.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff509b6d640 1 -- 172.21.15.132:0/3168571127 learned_addr learned my addr 172.21.15.132:0/3168571127 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:13.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff509b6d640 1 -- 172.21.15.132:0/3168571127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff504161850 msgr2=0x7ff50415fdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff509b6d640 1 --2- 172.21.15.132:0/3168571127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff504161850 0x7ff50415fdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff509b6d640 1 -- 172.21.15.132:0/3168571127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5040d0370 msgr2=0x7ff504157c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff509b6d640 1 --2- 172.21.15.132:0/3168571127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5040d0370 0x7ff504157c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff509b6d640 1 -- 172.21.15.132:0/3168571127 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5000094d0 con 0x7ff50415d100 2023-12-20T04:43:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff509b6d640 1 --2- 172.21.15.132:0/3168571127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff50415d100 0x7ff5040c7ea0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff4f400b4a0 tx=0x7ff4f400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff4faffd640 1 -- 172.21.15.132:0/3168571127 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4010610 con 0x7ff50415d100 2023-12-20T04:43:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff4faffd640 1 -- 172.21.15.132:0/3168571127 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4f4010770 con 0x7ff50415d100 2023-12-20T04:43:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff50c5d2640 1 -- 172.21.15.132:0/3168571127 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff50415f8b0 con 0x7ff50415d100 2023-12-20T04:43:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff4faffd640 1 -- 172.21.15.132:0/3168571127 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4f4010b20 con 0x7ff50415d100 2023-12-20T04:43:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.726+0000 7ff50c5d2640 1 -- 172.21.15.132:0/3168571127 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5040c83e0 con 0x7ff50415d100 2023-12-20T04:43:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.727+0000 7ff50c5d2640 1 -- 172.21.15.132:0/3168571127 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff50415faa0 con 0x7ff50415d100 2023-12-20T04:43:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.728+0000 7ff4faffd640 1 -- 172.21.15.132:0/3168571127 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff4f4010c80 con 0x7ff50415d100 2023-12-20T04:43:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.728+0000 7ff4faffd640 1 --2- 172.21.15.132:0/3168571127 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4e806a430 0x7ff4e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.728+0000 7ff4faffd640 1 -- 172.21.15.132:0/3168571127 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4f4088510 con 0x7ff50415d100 2023-12-20T04:43:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.728+0000 7ff50a36e640 1 --2- 172.21.15.132:0/3168571127 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4e806a430 0x7ff4e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:13.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.729+0000 7ff50a36e640 1 --2- 172.21.15.132:0/3168571127 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4e806a430 0x7ff4e806c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff500036000 tx=0x7ff500030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:13.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.732+0000 7ff4faffd640 1 -- 172.21.15.132:0/3168571127 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff4f4053b00 con 0x7ff50415d100 2023-12-20T04:43:13.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.899+0000 7ff50c5d2640 1 -- 172.21.15.132:0/3168571127 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff50415f150 con 0x7ff50415d100 2023-12-20T04:43:13.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.900+0000 7ff4faffd640 1 -- 172.21.15.132:0/3168571127 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7ff50415f150 con 0x7ff50415d100 2023-12-20T04:43:13.902 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:13.902 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:13.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.902+0000 7ff50c5d2640 1 -- 172.21.15.132:0/3168571127 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4e806a430 msgr2=0x7ff4e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.902+0000 7ff50c5d2640 1 --2- 172.21.15.132:0/3168571127 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4e806a430 0x7ff4e806c8f0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7ff500036000 tx=0x7ff500030000 comp rx=0 tx=0).stop 2023-12-20T04:43:13.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.902+0000 7ff50c5d2640 1 -- 172.21.15.132:0/3168571127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff50415d100 msgr2=0x7ff5040c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:13.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.902+0000 7ff50c5d2640 1 --2- 172.21.15.132:0/3168571127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff50415d100 0x7ff5040c7ea0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7ff4f400b4a0 tx=0x7ff4f400b960 comp rx=0 tx=0).stop 2023-12-20T04:43:13.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.902+0000 7ff50c5d2640 1 -- 172.21.15.132:0/3168571127 shutdown_connections 2023-12-20T04:43:13.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.902+0000 7ff50c5d2640 1 --2- 172.21.15.132:0/3168571127 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4e806a430 0x7ff4e806c8f0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.902+0000 7ff50c5d2640 1 --2- 172.21.15.132:0/3168571127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff504161850 0x7ff50415fdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.902+0000 7ff50c5d2640 1 --2- 172.21.15.132:0/3168571127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff50415d100 0x7ff5040c7ea0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.902+0000 7ff50c5d2640 1 --2- 172.21.15.132:0/3168571127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5040d0370 0x7ff504157c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:13.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.902+0000 7ff50c5d2640 1 -- 172.21.15.132:0/3168571127 >> 172.21.15.132:0/3168571127 conn(0x7ff50406d7c0 msgr2=0x7ff50406c790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:13.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.902+0000 7ff50c5d2640 1 -- 172.21.15.132:0/3168571127 shutdown_connections 2023-12-20T04:43:13.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:13.902+0000 7ff50c5d2640 1 -- 172.21.15.132:0/3168571127 wait complete. 2023-12-20T04:43:13.915 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:42:45.433456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:42:46.128920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:43:13.915 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:43:14.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.017+0000 7f019559c640 1 Processor -- start 2023-12-20T04:43:14.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.017+0000 7f019559c640 1 -- start start 2023-12-20T04:43:14.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f019559c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01900cf790 0x7f01900cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f019559c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f01900b6080 0x7f01900b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f019559c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01900d0150 con 0x7f019015d300 2023-12-20T04:43:14.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f019559c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01900d2920 con 0x7f01900b6080 2023-12-20T04:43:14.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f019559c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01900d1d10 con 0x7f01900cf790 2023-12-20T04:43:14.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f018effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f019015d300 0x7f01900d1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44546/0 (socket says 172.21.15.132:44546) 2023-12-20T04:43:14.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f018effd640 1 -- 172.21.15.132:0/1533997550 learned_addr learned my addr 172.21.15.132:0/1533997550 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:14.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f018dffb640 1 -- 172.21.15.132:0/1533997550 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 870924813 0 0) 0x7f01900d0150 con 0x7f019015d300 2023-12-20T04:43:14.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f018dffb640 1 -- 172.21.15.132:0/1533997550 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0178003520 con 0x7f019015d300 2023-12-20T04:43:14.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f018f7fe640 1 --2- 172.21.15.132:0/1533997550 >> v2:172.21.15.187:3300/0 conn(0x7f01900b6080 0x7f01900b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f018e7fc640 1 --2- 172.21.15.132:0/1533997550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01900cf790 0x7f01900cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f018dffb640 1 -- 172.21.15.132:0/1533997550 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1817054090 0 0) 0x7f0178003520 con 0x7f019015d300 2023-12-20T04:43:14.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f018dffb640 1 -- 172.21.15.132:0/1533997550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01900cf790 msgr2=0x7f01900cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:14.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f018dffb640 1 --2- 172.21.15.132:0/1533997550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01900cf790 0x7f01900cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f018dffb640 1 -- 172.21.15.132:0/1533997550 >> v2:172.21.15.187:3300/0 conn(0x7f01900b6080 msgr2=0x7f01900b64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:14.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f018dffb640 1 --2- 172.21.15.132:0/1533997550 >> v2:172.21.15.187:3300/0 conn(0x7f01900b6080 0x7f01900b64d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f018dffb640 1 -- 172.21.15.132:0/1533997550 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01900d1ff0 con 0x7f019015d300 2023-12-20T04:43:14.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f018dffb640 1 -- 172.21.15.132:0/1533997550 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f0180001670 con 0x7f019015d300 2023-12-20T04:43:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f018dffb640 1 -- 172.21.15.132:0/1533997550 >> v1:172.21.15.132:6789/0 conn(0x7f019015d300 legacy=0x7f01900d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.018+0000 7f018dffb640 1 --2- 172.21.15.132:0/1533997550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0178003970 0x7f0178003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.019+0000 7f018dffb640 1 --2- 172.21.15.132:0/1533997550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01780047c0 0x7f0178004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.019+0000 7f018dffb640 1 --2- 172.21.15.132:0/1533997550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01900cf790 0x7f0178005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.019+0000 7f018dffb640 1 -- 172.21.15.132:0/1533997550 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01900d2920 con 0x7f0178003970 2023-12-20T04:43:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.019+0000 7f018dffb640 1 -- 172.21.15.132:0/1533997550 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01900d1d10 con 0x7f01780047c0 2023-12-20T04:43:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.019+0000 7f018dffb640 1 -- 172.21.15.132:0/1533997550 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f017800b9b0 con 0x7f01900cf790 2023-12-20T04:43:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.019+0000 7f018effd640 1 --2- 172.21.15.132:0/1533997550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0178003970 0x7f0178003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.019+0000 7f018e7fc640 1 --2- 172.21.15.132:0/1533997550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01780047c0 0x7f0178004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.019+0000 7f018f7fe640 1 --2- 172.21.15.132:0/1533997550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01900cf790 0x7f0178005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.019+0000 7f018effd640 1 -- 172.21.15.132:0/1533997550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01900cf790 msgr2=0x7f0178005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.019+0000 7f018effd640 1 --2- 172.21.15.132:0/1533997550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01900cf790 0x7f0178005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.019+0000 7f018effd640 1 -- 172.21.15.132:0/1533997550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01780047c0 msgr2=0x7f0178004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:14.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.019+0000 7f018effd640 1 --2- 172.21.15.132:0/1533997550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01780047c0 0x7f0178004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.019+0000 7f018effd640 1 -- 172.21.15.132:0/1533997550 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0178003520 con 0x7f0178003970 2023-12-20T04:43:14.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.020+0000 7f018effd640 1 --2- 172.21.15.132:0/1533997550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0178003970 0x7f0178003d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f018000c290 tx=0x7f01780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8141fd3221a61695 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:14.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.020+0000 7f018dffb640 1 -- 172.21.15.132:0/1533997550 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0180005ad0 con 0x7f0178003970 2023-12-20T04:43:14.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.020+0000 7f018dffb640 1 -- 172.21.15.132:0/1533997550 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0180005c30 con 0x7f0178003970 2023-12-20T04:43:14.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.020+0000 7f018dffb640 1 -- 172.21.15.132:0/1533997550 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f018002c8d0 con 0x7f0178003970 2023-12-20T04:43:14.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.020+0000 7f019559c640 1 -- 172.21.15.132:0/1533997550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0178003970 msgr2=0x7f0178003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.020+0000 7f019559c640 1 --2- 172.21.15.132:0/1533997550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0178003970 0x7f0178003d90 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f018000c290 tx=0x7f01780057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.020+0000 7f018f7fe640 1 -- 172.21.15.132:0/1533997550 reap_dead start 2023-12-20T04:43:14.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.020+0000 7f019559c640 1 -- 172.21.15.132:0/1533997550 shutdown_connections 2023-12-20T04:43:14.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.020+0000 7f019559c640 1 -- 172.21.15.132:0/1533997550 >> 172.21.15.132:0/1533997550 conn(0x7f019006a3d0 msgr2=0x7f019006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:14.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.020+0000 7f019559c640 1 -- 172.21.15.132:0/1533997550 shutdown_connections 2023-12-20T04:43:14.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.020+0000 7f019559c640 1 -- 172.21.15.132:0/1533997550 wait complete. 2023-12-20T04:43:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.022+0000 7f019559c640 1 Processor -- start 2023-12-20T04:43:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.022+0000 7f019559c640 1 -- start start 2023-12-20T04:43:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.022+0000 7f019559c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0178003970 0x7f01900c90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.022+0000 7f019559c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01900b4f80 0x7f01900c74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.022+0000 7f019559c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01900c5520 0x7f01900c59a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.022+0000 7f019559c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01900b4b60 con 0x7f01900b4f80 2023-12-20T04:43:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.022+0000 7f019559c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01900b53e0 con 0x7f01900c5520 2023-12-20T04:43:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.022+0000 7f019559c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01900c5ee0 con 0x7f0178003970 2023-12-20T04:43:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.022+0000 7f018e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01900b4f80 0x7f01900c74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.023+0000 7f018e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01900b4f80 0x7f01900c74a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46052/0 (socket says 172.21.15.132:46052) 2023-12-20T04:43:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.023+0000 7f018e7fc640 1 -- 172.21.15.132:0/507053063 learned_addr learned my addr 172.21.15.132:0/507053063 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.023+0000 7f018effd640 1 --2- 172.21.15.132:0/507053063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0178003970 0x7f01900c90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.023+0000 7f018f7fe640 1 --2- 172.21.15.132:0/507053063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01900c5520 0x7f01900c59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.023+0000 7f018e7fc640 1 -- 172.21.15.132:0/507053063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0178003970 msgr2=0x7f01900c90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.023+0000 7f018e7fc640 1 --2- 172.21.15.132:0/507053063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0178003970 0x7f01900c90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.023+0000 7f018e7fc640 1 -- 172.21.15.132:0/507053063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01900c5520 msgr2=0x7f01900c59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.023+0000 7f018e7fc640 1 --2- 172.21.15.132:0/507053063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01900c5520 0x7f01900c59a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.023+0000 7f018e7fc640 1 -- 172.21.15.132:0/507053063 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01900b3ee0 con 0x7f01900b4f80 2023-12-20T04:43:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.023+0000 7f018f7fe640 1 --2- 172.21.15.132:0/507053063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01900c5520 0x7f01900c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.023+0000 7f018e7fc640 1 --2- 172.21.15.132:0/507053063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01900b4f80 0x7f01900c74a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f018400b7c0 tx=0x7f018400bc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.023+0000 7f01777fe640 1 -- 172.21.15.132:0/507053063 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0184010830 con 0x7f01900b4f80 2023-12-20T04:43:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.023+0000 7f01777fe640 1 -- 172.21.15.132:0/507053063 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0184010990 con 0x7f01900b4f80 2023-12-20T04:43:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.023+0000 7f019559c640 1 -- 172.21.15.132:0/507053063 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01900b41c0 con 0x7f01900b4f80 2023-12-20T04:43:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.023+0000 7f01777fe640 1 -- 172.21.15.132:0/507053063 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0184010d20 con 0x7f01900b4f80 2023-12-20T04:43:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.023+0000 7f019559c640 1 -- 172.21.15.132:0/507053063 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01900b4780 con 0x7f01900b4f80 2023-12-20T04:43:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.024+0000 7f019559c640 1 -- 172.21.15.132:0/507053063 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01900d1980 con 0x7f01900b4f80 2023-12-20T04:43:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.024+0000 7f01777fe640 1 -- 172.21.15.132:0/507053063 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0184014430 con 0x7f01900b4f80 2023-12-20T04:43:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.025+0000 7f01777fe640 1 --2- 172.21.15.132:0/507053063 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f017c06a460 0x7f017c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.025+0000 7f01777fe640 1 -- 172.21.15.132:0/507053063 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0184088fa0 con 0x7f01900b4f80 2023-12-20T04:43:14.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.025+0000 7f018effd640 1 --2- 172.21.15.132:0/507053063 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f017c06a460 0x7f017c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.025+0000 7f018effd640 1 --2- 172.21.15.132:0/507053063 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f017c06a460 0x7f017c06c920 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0180034000 tx=0x7f0180007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:14.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.029+0000 7f01777fe640 1 -- 172.21.15.132:0/507053063 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f01840bbca0 con 0x7f01900b4f80 2023-12-20T04:43:14.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.194+0000 7f019559c640 1 -- 172.21.15.132:0/507053063 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f019004e840 con 0x7f01900b4f80 2023-12-20T04:43:14.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.194+0000 7f01777fe640 1 -- 172.21.15.132:0/507053063 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0184022020 con 0x7f01900b4f80 2023-12-20T04:43:14.196 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:43:14.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.196+0000 7f019559c640 1 -- 172.21.15.132:0/507053063 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f017c06a460 msgr2=0x7f017c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.196+0000 7f019559c640 1 --2- 172.21.15.132:0/507053063 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f017c06a460 0x7f017c06c920 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f0180034000 tx=0x7f0180007000 comp rx=0 tx=0).stop 2023-12-20T04:43:14.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.196+0000 7f019559c640 1 -- 172.21.15.132:0/507053063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01900b4f80 msgr2=0x7f01900c74a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.196+0000 7f019559c640 1 --2- 172.21.15.132:0/507053063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01900b4f80 0x7f01900c74a0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f018400b7c0 tx=0x7f018400bc80 comp rx=0 tx=0).stop 2023-12-20T04:43:14.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.196+0000 7f019559c640 1 -- 172.21.15.132:0/507053063 shutdown_connections 2023-12-20T04:43:14.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.196+0000 7f019559c640 1 --2- 172.21.15.132:0/507053063 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f017c06a460 0x7f017c06c920 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.196+0000 7f019559c640 1 --2- 172.21.15.132:0/507053063 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01900c5520 0x7f01900c59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.196+0000 7f019559c640 1 --2- 172.21.15.132:0/507053063 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01900b4f80 0x7f01900c74a0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.196+0000 7f019559c640 1 --2- 172.21.15.132:0/507053063 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0178003970 0x7f01900c90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.196+0000 7f019559c640 1 -- 172.21.15.132:0/507053063 >> 172.21.15.132:0/507053063 conn(0x7f019006a3d0 msgr2=0x7f01901534c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:14.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.196+0000 7f019559c640 1 -- 172.21.15.132:0/507053063 shutdown_connections 2023-12-20T04:43:14.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.196+0000 7f019559c640 1 -- 172.21.15.132:0/507053063 wait complete. 2023-12-20T04:43:14.209 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:43:14.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.309+0000 7f689454e640 1 Processor -- start 2023-12-20T04:43:14.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.309+0000 7f689454e640 1 -- start start 2023-12-20T04:43:14.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.310+0000 7f689454e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f688c143610 0x7f688c0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.310+0000 7f689454e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f688c0c41f0 0x7f688c0cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.310+0000 7f689454e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f688c0cd780 0x7f688c15d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.310+0000 7f689454e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688c0cdc30 con 0x7f688c0cd780 2023-12-20T04:43:14.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.310+0000 7f689454e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f688c1439f0 con 0x7f688c0c41f0 2023-12-20T04:43:14.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.310+0000 7f689454e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688c0c46f0 con 0x7f688c143610 2023-12-20T04:43:14.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.310+0000 7f6892aeb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f688c0cd780 0x7f688c15d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.310+0000 7f6892aeb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f688c0cd780 0x7f688c15d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46060/0 (socket says 172.21.15.132:46060) 2023-12-20T04:43:14.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.310+0000 7f6892aeb640 1 -- 172.21.15.132:0/1625881499 learned_addr learned my addr 172.21.15.132:0/1625881499 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:14.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.310+0000 7f6892aeb640 1 -- 172.21.15.132:0/1625881499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f688c143610 msgr2=0x7f688c0caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:14.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.310+0000 7f68922ea640 1 --2- 172.21.15.132:0/1625881499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f688c143610 0x7f688c0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.310+0000 7f6891ae9640 1 --2- 172.21.15.132:0/1625881499 >> v2:172.21.15.187:3300/0 conn(0x7f688c0c41f0 0x7f688c0cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.310+0000 7f6892aeb640 1 --2- 172.21.15.132:0/1625881499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f688c143610 0x7f688c0caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.310+0000 7f6892aeb640 1 -- 172.21.15.132:0/1625881499 >> v2:172.21.15.187:3300/0 conn(0x7f688c0c41f0 msgr2=0x7f688c0cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:14.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.310+0000 7f6892aeb640 1 --2- 172.21.15.132:0/1625881499 >> v2:172.21.15.187:3300/0 conn(0x7f688c0c41f0 0x7f688c0cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.310+0000 7f6892aeb640 1 -- 172.21.15.132:0/1625881499 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688c0c49d0 con 0x7f688c0cd780 2023-12-20T04:43:14.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.311+0000 7f68922ea640 1 --2- 172.21.15.132:0/1625881499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f688c143610 0x7f688c0caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.311+0000 7f6892aeb640 1 --2- 172.21.15.132:0/1625881499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f688c0cd780 0x7f688c15d890 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f688c06d6d0 tx=0x7f688402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c00114be0df08e5c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.311+0000 7f68912e8640 1 -- 172.21.15.132:0/1625881499 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688402ee90 con 0x7f688c0cd780 2023-12-20T04:43:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.311+0000 7f68912e8640 1 -- 172.21.15.132:0/1625881499 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6884036440 con 0x7f688c0cd780 2023-12-20T04:43:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.311+0000 7f68912e8640 1 -- 172.21.15.132:0/1625881499 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f68840367d0 con 0x7f688c0cd780 2023-12-20T04:43:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.312+0000 7f689454e640 1 -- 172.21.15.132:0/1625881499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f688c0cd780 msgr2=0x7f688c15d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.312+0000 7f689454e640 1 --2- 172.21.15.132:0/1625881499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f688c0cd780 0x7f688c15d890 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f688c06d6d0 tx=0x7f688402e0e0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.312+0000 7f689454e640 1 -- 172.21.15.132:0/1625881499 shutdown_connections 2023-12-20T04:43:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.312+0000 7f689454e640 1 --2- 172.21.15.132:0/1625881499 >> v2:172.21.15.187:3300/0 conn(0x7f688c0c41f0 0x7f688c0cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.312+0000 7f689454e640 1 --2- 172.21.15.132:0/1625881499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f688c0cd780 0x7f688c15d890 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.312+0000 7f689454e640 1 --2- 172.21.15.132:0/1625881499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f688c143610 0x7f688c0caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.312+0000 7f689454e640 1 -- 172.21.15.132:0/1625881499 >> 172.21.15.132:0/1625881499 conn(0x7f688c06a260 msgr2=0x7f688c0b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:14.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.312+0000 7f689454e640 1 -- 172.21.15.132:0/1625881499 shutdown_connections 2023-12-20T04:43:14.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.312+0000 7f689454e640 1 -- 172.21.15.132:0/1625881499 wait complete. 2023-12-20T04:43:14.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.313+0000 7f689454e640 1 Processor -- start 2023-12-20T04:43:14.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.313+0000 7f689454e640 1 -- start start 2023-12-20T04:43:14.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f689454e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f688c0c41f0 0x7f688c0b4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f689454e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f688c0cd780 0x7f688c0c6bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f689454e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f688c143610 0x7f688c0c7100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f689454e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c13fce0 con 0x7f688c0c41f0 2023-12-20T04:43:14.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f689454e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c140230 con 0x7f688c143610 2023-12-20T04:43:14.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f689454e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f688c0b29e0 con 0x7f688c0cd780 2023-12-20T04:43:14.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f68922ea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f688c0c41f0 0x7f688c0b4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f68922ea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f688c0c41f0 0x7f688c0b4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46076/0 (socket says 172.21.15.132:46076) 2023-12-20T04:43:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f68922ea640 1 -- 172.21.15.132:0/1108642953 learned_addr learned my addr 172.21.15.132:0/1108642953 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f6892aeb640 1 --2- 172.21.15.132:0/1108642953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f688c143610 0x7f688c0c7100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f6891ae9640 1 --2- 172.21.15.132:0/1108642953 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f688c0cd780 0x7f688c0c6bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f68922ea640 1 -- 172.21.15.132:0/1108642953 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f688c0cd780 msgr2=0x7f688c0c6bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f68922ea640 1 --2- 172.21.15.132:0/1108642953 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f688c0cd780 0x7f688c0c6bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f68922ea640 1 -- 172.21.15.132:0/1108642953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f688c143610 msgr2=0x7f688c0c7100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f68922ea640 1 --2- 172.21.15.132:0/1108642953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f688c143610 0x7f688c0c7100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f68922ea640 1 -- 172.21.15.132:0/1108642953 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f688400b770 con 0x7f688c0c41f0 2023-12-20T04:43:14.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f6892aeb640 1 --2- 172.21.15.132:0/1108642953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f688c143610 0x7f688c0c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:14.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f6891ae9640 1 --2- 172.21.15.132:0/1108642953 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f688c0cd780 0x7f688c0c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:14.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.314+0000 7f68922ea640 1 --2- 172.21.15.132:0/1108642953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f688c0c41f0 0x7f688c0b4180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f688800ce30 tx=0x7f688800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:14.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.315+0000 7f6882ffd640 1 -- 172.21.15.132:0/1108642953 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688800f890 con 0x7f688c0c41f0 2023-12-20T04:43:14.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.315+0000 7f6882ffd640 1 -- 172.21.15.132:0/1108642953 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f688800f9f0 con 0x7f688c0c41f0 2023-12-20T04:43:14.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.315+0000 7f6882ffd640 1 -- 172.21.15.132:0/1108642953 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f688800fd80 con 0x7f688c0c41f0 2023-12-20T04:43:14.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.315+0000 7f689454e640 1 -- 172.21.15.132:0/1108642953 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688c0b2420 con 0x7f688c0c41f0 2023-12-20T04:43:14.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.315+0000 7f689454e640 1 -- 172.21.15.132:0/1108642953 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688c13fec0 con 0x7f688c0c41f0 2023-12-20T04:43:14.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.316+0000 7f689454e640 1 -- 172.21.15.132:0/1108642953 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f688c04e840 con 0x7f688c0c41f0 2023-12-20T04:43:14.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.316+0000 7f6882ffd640 1 -- 172.21.15.132:0/1108642953 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f688800b040 con 0x7f688c0c41f0 2023-12-20T04:43:14.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.316+0000 7f6882ffd640 1 --2- 172.21.15.132:0/1108642953 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f687006a430 0x7f687006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.317+0000 7f6882ffd640 1 -- 172.21.15.132:0/1108642953 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6888089280 con 0x7f688c0c41f0 2023-12-20T04:43:14.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.317+0000 7f6891ae9640 1 --2- 172.21.15.132:0/1108642953 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f687006a430 0x7f687006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.317+0000 7f6891ae9640 1 --2- 172.21.15.132:0/1108642953 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f687006a430 0x7f687006c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f688c06f450 tx=0x7f687c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:14.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.321+0000 7f6882ffd640 1 -- 172.21.15.132:0/1108642953 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6888054870 con 0x7f688c0c41f0 2023-12-20T04:43:14.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.491+0000 7f689454e640 1 -- 172.21.15.132:0/1108642953 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f688c142740 con 0x7f688c0c41f0 2023-12-20T04:43:14.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.492+0000 7f6882ffd640 1 -- 172.21.15.132:0/1108642953 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f688801d020 con 0x7f688c0c41f0 2023-12-20T04:43:14.494 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:43:14.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.494+0000 7f689454e640 1 -- 172.21.15.132:0/1108642953 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f687006a430 msgr2=0x7f687006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.494+0000 7f689454e640 1 --2- 172.21.15.132:0/1108642953 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f687006a430 0x7f687006c8f0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f688c06f450 tx=0x7f687c008040 comp rx=0 tx=0).stop 2023-12-20T04:43:14.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.494+0000 7f689454e640 1 -- 172.21.15.132:0/1108642953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f688c0c41f0 msgr2=0x7f688c0b4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.494+0000 7f689454e640 1 --2- 172.21.15.132:0/1108642953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f688c0c41f0 0x7f688c0b4180 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f688800ce30 tx=0x7f688800a650 comp rx=0 tx=0).stop 2023-12-20T04:43:14.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.494+0000 7f689454e640 1 -- 172.21.15.132:0/1108642953 shutdown_connections 2023-12-20T04:43:14.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.494+0000 7f689454e640 1 --2- 172.21.15.132:0/1108642953 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f687006a430 0x7f687006c8f0 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.494+0000 7f689454e640 1 --2- 172.21.15.132:0/1108642953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f688c143610 0x7f688c0c7100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.494+0000 7f689454e640 1 --2- 172.21.15.132:0/1108642953 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f688c0cd780 0x7f688c0c6bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.494+0000 7f689454e640 1 --2- 172.21.15.132:0/1108642953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f688c0c41f0 0x7f688c0b4180 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.494+0000 7f689454e640 1 -- 172.21.15.132:0/1108642953 >> 172.21.15.132:0/1108642953 conn(0x7f688c06a260 msgr2=0x7f688c070d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:14.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.494+0000 7f689454e640 1 -- 172.21.15.132:0/1108642953 shutdown_connections 2023-12-20T04:43:14.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.494+0000 7f689454e640 1 -- 172.21.15.132:0/1108642953 wait complete. 2023-12-20T04:43:14.506 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:43:14.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.607+0000 7fab568af640 1 Processor -- start 2023-12-20T04:43:14.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.607+0000 7fab568af640 1 -- start start 2023-12-20T04:43:14.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.608+0000 7fab568af640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fab5015aee0 0x7fab5015eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.608+0000 7fab568af640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fab500cdd80 0x7fab500d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.608+0000 7fab568af640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab500d0130 con 0x7fab500cb2b0 2023-12-20T04:43:14.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.608+0000 7fab568af640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5015f370 con 0x7fab5015aee0 2023-12-20T04:43:14.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.608+0000 7fab568af640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab5015f650 con 0x7fab500cdd80 2023-12-20T04:43:14.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.608+0000 7fab4ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fab5015aee0 0x7fab5015eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.608+0000 7fab4ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fab5015aee0 0x7fab5015eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46078/0 (socket says 172.21.15.132:46078) 2023-12-20T04:43:14.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.608+0000 7fab4ffff640 1 -- 172.21.15.132:0/3361820744 learned_addr learned my addr 172.21.15.132:0/3361820744 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:14.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.608+0000 7fab54e4c640 1 --2- 172.21.15.132:0/3361820744 >> v2:172.21.15.187:3300/0 conn(0x7fab500cdd80 0x7fab500d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.608+0000 7fab4ffff640 1 -- 172.21.15.132:0/3361820744 >> v2:172.21.15.187:3300/0 conn(0x7fab500cdd80 msgr2=0x7fab500d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:14.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.608+0000 7fab4ffff640 1 --2- 172.21.15.132:0/3361820744 >> v2:172.21.15.187:3300/0 conn(0x7fab500cdd80 0x7fab500d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.608+0000 7fab4ffff640 1 -- 172.21.15.132:0/3361820744 >> v1:172.21.15.187:6789/0 conn(0x7fab500cb2b0 legacy=0x7fab500cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:14.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.608+0000 7fab4ffff640 1 -- 172.21.15.132:0/3361820744 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab5015f930 con 0x7fab5015aee0 2023-12-20T04:43:14.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.609+0000 7fab4ffff640 1 --2- 172.21.15.132:0/3361820744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5015aee0 0x7fab5015eb40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fab40009870 tx=0x7fab4002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea84f8145565b479 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:14.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.609+0000 7fab4effd640 1 -- 172.21.15.132:0/3361820744 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40031870 con 0x7fab5015aee0 2023-12-20T04:43:14.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.609+0000 7fab4effd640 1 -- 172.21.15.132:0/3361820744 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab400319d0 con 0x7fab5015aee0 2023-12-20T04:43:14.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.609+0000 7fab4effd640 1 -- 172.21.15.132:0/3361820744 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab40031d60 con 0x7fab5015aee0 2023-12-20T04:43:14.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.610+0000 7fab568af640 1 -- 172.21.15.132:0/3361820744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5015aee0 msgr2=0x7fab5015eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.610+0000 7fab568af640 1 --2- 172.21.15.132:0/3361820744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5015aee0 0x7fab5015eb40 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fab40009870 tx=0x7fab4002b910 comp rx=0 tx=0).stop 2023-12-20T04:43:14.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.610+0000 7fab568af640 1 -- 172.21.15.132:0/3361820744 shutdown_connections 2023-12-20T04:43:14.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.610+0000 7fab568af640 1 --2- 172.21.15.132:0/3361820744 >> v2:172.21.15.187:3300/0 conn(0x7fab500cdd80 0x7fab500d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.610+0000 7fab568af640 1 --2- 172.21.15.132:0/3361820744 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5015aee0 0x7fab5015eb40 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.610+0000 7fab568af640 1 -- 172.21.15.132:0/3361820744 >> 172.21.15.132:0/3361820744 conn(0x7fab50072c60 msgr2=0x7fab50073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:14.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.610+0000 7fab568af640 1 -- 172.21.15.132:0/3361820744 shutdown_connections 2023-12-20T04:43:14.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.610+0000 7fab568af640 1 -- 172.21.15.132:0/3361820744 wait complete. 2023-12-20T04:43:14.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.611+0000 7fab568af640 1 Processor -- start 2023-12-20T04:43:14.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.611+0000 7fab568af640 1 -- start start 2023-12-20T04:43:14.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.612+0000 7fab568af640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab500cb2b0 0x7fab5015dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.612+0000 7fab568af640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab500cdd80 0x7fab50159240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.612+0000 7fab568af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5015aee0 0x7fab50159780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.612+0000 7fab568af640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab500c95d0 con 0x7fab5015aee0 2023-12-20T04:43:14.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.612+0000 7fab568af640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab500c98b0 con 0x7fab500cb2b0 2023-12-20T04:43:14.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.612+0000 7fab568af640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab500c9b90 con 0x7fab500cdd80 2023-12-20T04:43:14.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.612+0000 7fab54e4c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5015aee0 0x7fab50159780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.612+0000 7fab54e4c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5015aee0 0x7fab50159780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46094/0 (socket says 172.21.15.132:46094) 2023-12-20T04:43:14.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.612+0000 7fab54e4c640 1 -- 172.21.15.132:0/2406057385 learned_addr learned my addr 172.21.15.132:0/2406057385 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:14.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.612+0000 7fab4ffff640 1 --2- 172.21.15.132:0/2406057385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab500cb2b0 0x7fab5015dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.612+0000 7fab4f7fe640 1 --2- 172.21.15.132:0/2406057385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab500cdd80 0x7fab50159240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.612+0000 7fab54e4c640 1 -- 172.21.15.132:0/2406057385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab500cdd80 msgr2=0x7fab50159240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.612+0000 7fab54e4c640 1 --2- 172.21.15.132:0/2406057385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab500cdd80 0x7fab50159240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.612+0000 7fab54e4c640 1 -- 172.21.15.132:0/2406057385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab500cb2b0 msgr2=0x7fab5015dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.612+0000 7fab54e4c640 1 --2- 172.21.15.132:0/2406057385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab500cb2b0 0x7fab5015dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.612+0000 7fab54e4c640 1 -- 172.21.15.132:0/2406057385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab400094d0 con 0x7fab5015aee0 2023-12-20T04:43:14.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.612+0000 7fab4ffff640 1 --2- 172.21.15.132:0/2406057385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab500cb2b0 0x7fab5015dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:14.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.613+0000 7fab54e4c640 1 --2- 172.21.15.132:0/2406057385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5015aee0 0x7fab50159780 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fab4800cc00 tx=0x7fab4800a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:14.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.613+0000 7fab4cff9640 1 -- 172.21.15.132:0/2406057385 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab4800ce10 con 0x7fab5015aee0 2023-12-20T04:43:14.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.613+0000 7fab4cff9640 1 -- 172.21.15.132:0/2406057385 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab48003990 con 0x7fab5015aee0 2023-12-20T04:43:14.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.613+0000 7fab4cff9640 1 -- 172.21.15.132:0/2406057385 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab48003d20 con 0x7fab5015aee0 2023-12-20T04:43:14.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.613+0000 7fab568af640 1 -- 172.21.15.132:0/2406057385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab500c9e70 con 0x7fab5015aee0 2023-12-20T04:43:14.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.613+0000 7fab568af640 1 -- 172.21.15.132:0/2406057385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab500c8b10 con 0x7fab5015aee0 2023-12-20T04:43:14.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.614+0000 7fab568af640 1 -- 172.21.15.132:0/2406057385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab500ca060 con 0x7fab5015aee0 2023-12-20T04:43:14.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.614+0000 7fab4cff9640 1 -- 172.21.15.132:0/2406057385 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fab48003e80 con 0x7fab5015aee0 2023-12-20T04:43:14.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.615+0000 7fab4cff9640 1 --2- 172.21.15.132:0/2406057385 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab3c06a430 0x7fab3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.615+0000 7fab4ffff640 1 --2- 172.21.15.132:0/2406057385 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab3c06a430 0x7fab3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.615+0000 7fab4cff9640 1 -- 172.21.15.132:0/2406057385 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab48088c70 con 0x7fab5015aee0 2023-12-20T04:43:14.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.615+0000 7fab4ffff640 1 --2- 172.21.15.132:0/2406057385 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab3c06a430 0x7fab3c06c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fab40036000 tx=0x7fab4003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:14.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.619+0000 7fab4cff9640 1 -- 172.21.15.132:0/2406057385 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fab48054260 con 0x7fab5015aee0 2023-12-20T04:43:14.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.784+0000 7fab568af640 1 -- 172.21.15.132:0/2406057385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fab500c9710 con 0x7fab5015aee0 2023-12-20T04:43:14.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.784+0000 7fab4cff9640 1 -- 172.21.15.132:0/2406057385 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fab500c9710 con 0x7fab5015aee0 2023-12-20T04:43:14.787 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:43:14.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.786+0000 7fab568af640 1 -- 172.21.15.132:0/2406057385 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab3c06a430 msgr2=0x7fab3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.786+0000 7fab568af640 1 --2- 172.21.15.132:0/2406057385 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab3c06a430 0x7fab3c06c8f0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fab40036000 tx=0x7fab4003c040 comp rx=0 tx=0).stop 2023-12-20T04:43:14.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.786+0000 7fab568af640 1 -- 172.21.15.132:0/2406057385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5015aee0 msgr2=0x7fab50159780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.786+0000 7fab568af640 1 --2- 172.21.15.132:0/2406057385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5015aee0 0x7fab50159780 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fab4800cc00 tx=0x7fab4800a5c0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.786+0000 7fab568af640 1 -- 172.21.15.132:0/2406057385 shutdown_connections 2023-12-20T04:43:14.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.786+0000 7fab568af640 1 --2- 172.21.15.132:0/2406057385 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab3c06a430 0x7fab3c06c8f0 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.786+0000 7fab568af640 1 --2- 172.21.15.132:0/2406057385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab5015aee0 0x7fab50159780 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.786+0000 7fab568af640 1 --2- 172.21.15.132:0/2406057385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab500cdd80 0x7fab50159240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.786+0000 7fab568af640 1 --2- 172.21.15.132:0/2406057385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab500cb2b0 0x7fab5015dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.786+0000 7fab568af640 1 -- 172.21.15.132:0/2406057385 >> 172.21.15.132:0/2406057385 conn(0x7fab50072c60 msgr2=0x7fab500c6b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:14.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.786+0000 7fab568af640 1 -- 172.21.15.132:0/2406057385 shutdown_connections 2023-12-20T04:43:14.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.787+0000 7fab568af640 1 -- 172.21.15.132:0/2406057385 wait complete. 2023-12-20T04:43:14.799 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:14.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.897+0000 7f031f266640 1 Processor -- start 2023-12-20T04:43:14.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.897+0000 7f031f266640 1 -- start start 2023-12-20T04:43:14.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.898+0000 7f031f266640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f031815e2d0 0x7f03180b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.898+0000 7f031f266640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03180cb420 0x7f03180ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.898+0000 7f031f266640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03180cd740 con 0x7f03180ceee0 2023-12-20T04:43:14.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.898+0000 7f031f266640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03180ce230 con 0x7f031815e2d0 2023-12-20T04:43:14.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.898+0000 7f031f266640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03180cf310 con 0x7f03180cb420 2023-12-20T04:43:14.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.898+0000 7f031d803640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f03180ceee0 0x7f031815ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44556/0 (socket says 172.21.15.132:44556) 2023-12-20T04:43:14.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.898+0000 7f031d803640 1 -- 172.21.15.132:0/889457521 learned_addr learned my addr 172.21.15.132:0/889457521 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:14.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.898+0000 7f031d002640 1 --2- 172.21.15.132:0/889457521 >> v2:172.21.15.187:3300/0 conn(0x7f031815e2d0 0x7f03180b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.899+0000 7f031c801640 1 --2- 172.21.15.132:0/889457521 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03180cb420 0x7f03180ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.899+0000 7f030ffff640 1 -- 172.21.15.132:0/889457521 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1181311176 0 0) 0x7f03180cd740 con 0x7f03180ceee0 2023-12-20T04:43:14.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.899+0000 7f030ffff640 1 -- 172.21.15.132:0/889457521 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0304003520 con 0x7f03180ceee0 2023-12-20T04:43:14.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.899+0000 7f030ffff640 1 -- 172.21.15.132:0/889457521 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2154075001 0 0) 0x7f0304003520 con 0x7f03180ceee0 2023-12-20T04:43:14.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.899+0000 7f031c801640 1 -- 172.21.15.132:0/889457521 >> v2:172.21.15.187:3300/0 conn(0x7f031815e2d0 msgr2=0x7f03180b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:14.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.899+0000 7f031c801640 1 --2- 172.21.15.132:0/889457521 >> v2:172.21.15.187:3300/0 conn(0x7f031815e2d0 0x7f03180b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.899+0000 7f031c801640 1 -- 172.21.15.132:0/889457521 >> v1:172.21.15.132:6789/0 conn(0x7f03180ceee0 legacy=0x7f031815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.899+0000 7f031c801640 1 -- 172.21.15.132:0/889457521 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03180cd990 con 0x7f03180cb420 2023-12-20T04:43:14.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.899+0000 7f031d002640 1 --2- 172.21.15.132:0/889457521 >> v2:172.21.15.187:3300/0 conn(0x7f031815e2d0 0x7f03180b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:43:14.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.900+0000 7f031c801640 1 --2- 172.21.15.132:0/889457521 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03180cb420 0x7f03180ce9a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f03080097a0 tx=0x7f030802b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6371cecdfbf7233 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:14.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.900+0000 7f030ffff640 1 -- 172.21.15.132:0/889457521 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0310001670 con 0x7f03180cb420 2023-12-20T04:43:14.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.900+0000 7f030ffff640 1 -- 172.21.15.132:0/889457521 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f030802e050 con 0x7f03180cb420 2023-12-20T04:43:14.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.900+0000 7f030ffff640 1 -- 172.21.15.132:0/889457521 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0308030710 con 0x7f03180cb420 2023-12-20T04:43:14.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.900+0000 7f031f266640 1 -- 172.21.15.132:0/889457521 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03180cb420 msgr2=0x7f03180ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.900+0000 7f031f266640 1 --2- 172.21.15.132:0/889457521 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03180cb420 0x7f03180ce9a0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f03080097a0 tx=0x7f030802b710 comp rx=0 tx=0).stop 2023-12-20T04:43:14.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.901+0000 7f031f266640 1 -- 172.21.15.132:0/889457521 shutdown_connections 2023-12-20T04:43:14.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.901+0000 7f031f266640 1 --2- 172.21.15.132:0/889457521 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03180cb420 0x7f03180ce9a0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.901+0000 7f031f266640 1 --2- 172.21.15.132:0/889457521 >> v2:172.21.15.187:3300/0 conn(0x7f031815e2d0 0x7f03180b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.901+0000 7f031f266640 1 -- 172.21.15.132:0/889457521 >> 172.21.15.132:0/889457521 conn(0x7f031806d7c0 msgr2=0x7f031806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:14.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.901+0000 7f031f266640 1 -- 172.21.15.132:0/889457521 shutdown_connections 2023-12-20T04:43:14.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.901+0000 7f031f266640 1 -- 172.21.15.132:0/889457521 wait complete. 2023-12-20T04:43:14.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.902+0000 7f031f266640 1 Processor -- start 2023-12-20T04:43:14.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.902+0000 7f031f266640 1 -- start start 2023-12-20T04:43:14.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.902+0000 7f031f266640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03180cb420 0x7f03181f1a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f031f266640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03180ceee0 0x7f03181f3620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f031f266640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f031815e2d0 0x7f0318153800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f031f266640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0318156370 con 0x7f031815e2d0 2023-12-20T04:43:14.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f031f266640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03181f1f50 con 0x7f03180cb420 2023-12-20T04:43:14.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f031f266640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0318156550 con 0x7f03180ceee0 2023-12-20T04:43:14.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f031d803640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f031815e2d0 0x7f0318153800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f031d803640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f031815e2d0 0x7f0318153800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46104/0 (socket says 172.21.15.132:46104) 2023-12-20T04:43:14.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f031d803640 1 -- 172.21.15.132:0/478437652 learned_addr learned my addr 172.21.15.132:0/478437652 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:14.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f031c801640 1 --2- 172.21.15.132:0/478437652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03180ceee0 0x7f03181f3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f031d002640 1 --2- 172.21.15.132:0/478437652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03180cb420 0x7f03181f1a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f031d803640 1 -- 172.21.15.132:0/478437652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03180ceee0 msgr2=0x7f03181f3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f031d803640 1 --2- 172.21.15.132:0/478437652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03180ceee0 0x7f03181f3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f031d803640 1 -- 172.21.15.132:0/478437652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03180cb420 msgr2=0x7f03181f1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:14.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f031d803640 1 --2- 172.21.15.132:0/478437652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03180cb420 0x7f03181f1a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:14.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f031d803640 1 -- 172.21.15.132:0/478437652 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0314009a70 con 0x7f031815e2d0 2023-12-20T04:43:14.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f031d803640 1 --2- 172.21.15.132:0/478437652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f031815e2d0 0x7f0318153800 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f031000c750 tx=0x7f031000cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:14.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f030dffb640 1 -- 172.21.15.132:0/478437652 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0310005ad0 con 0x7f031815e2d0 2023-12-20T04:43:14.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f030dffb640 1 -- 172.21.15.132:0/478437652 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0310005c30 con 0x7f031815e2d0 2023-12-20T04:43:14.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f031f266640 1 -- 172.21.15.132:0/478437652 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0308009400 con 0x7f031815e2d0 2023-12-20T04:43:14.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.903+0000 7f030dffb640 1 -- 172.21.15.132:0/478437652 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0310007070 con 0x7f031815e2d0 2023-12-20T04:43:14.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.904+0000 7f031f266640 1 -- 172.21.15.132:0/478437652 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0318156b10 con 0x7f031815e2d0 2023-12-20T04:43:14.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.905+0000 7f031f266640 1 -- 172.21.15.132:0/478437652 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f031804e840 con 0x7f031815e2d0 2023-12-20T04:43:14.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.905+0000 7f030dffb640 1 -- 172.21.15.132:0/478437652 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f03100071d0 con 0x7f031815e2d0 2023-12-20T04:43:14.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.905+0000 7f030dffb640 1 --2- 172.21.15.132:0/478437652 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f02fc06a460 0x7f02fc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:14.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.906+0000 7f031d002640 1 --2- 172.21.15.132:0/478437652 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f02fc06a460 0x7f02fc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:14.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.906+0000 7f030dffb640 1 -- 172.21.15.132:0/478437652 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0310088530 con 0x7f031815e2d0 2023-12-20T04:43:14.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.906+0000 7f031d002640 1 --2- 172.21.15.132:0/478437652 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f02fc06a460 0x7f02fc06c920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0314007600 tx=0x7f031400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:14.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:14.910+0000 7f030dffb640 1 -- 172.21.15.132:0/478437652 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0310053bb0 con 0x7f031815e2d0 2023-12-20T04:43:15.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.079+0000 7f031f266640 1 -- 172.21.15.132:0/478437652 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f03180ce480 con 0x7f031815e2d0 2023-12-20T04:43:15.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.081+0000 7f030dffb640 1 -- 172.21.15.132:0/478437652 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f03100571d0 con 0x7f031815e2d0 2023-12-20T04:43:15.083 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:15.083 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:15.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.083+0000 7f031f266640 1 -- 172.21.15.132:0/478437652 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f02fc06a460 msgr2=0x7f02fc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.083+0000 7f031f266640 1 --2- 172.21.15.132:0/478437652 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f02fc06a460 0x7f02fc06c920 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f0314007600 tx=0x7f031400b040 comp rx=0 tx=0).stop 2023-12-20T04:43:15.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.083+0000 7f031f266640 1 -- 172.21.15.132:0/478437652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f031815e2d0 msgr2=0x7f0318153800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.083+0000 7f031f266640 1 --2- 172.21.15.132:0/478437652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f031815e2d0 0x7f0318153800 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f031000c750 tx=0x7f031000cc10 comp rx=0 tx=0).stop 2023-12-20T04:43:15.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.083+0000 7f031f266640 1 -- 172.21.15.132:0/478437652 shutdown_connections 2023-12-20T04:43:15.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.083+0000 7f031f266640 1 --2- 172.21.15.132:0/478437652 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f02fc06a460 0x7f02fc06c920 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.083+0000 7f031f266640 1 --2- 172.21.15.132:0/478437652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f031815e2d0 0x7f0318153800 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.083+0000 7f031f266640 1 --2- 172.21.15.132:0/478437652 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03180ceee0 0x7f03181f3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.083+0000 7f031f266640 1 --2- 172.21.15.132:0/478437652 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03180cb420 0x7f03181f1a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.083+0000 7f031f266640 1 -- 172.21.15.132:0/478437652 >> 172.21.15.132:0/478437652 conn(0x7f031806d7c0 msgr2=0x7f03180b1d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:15.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.083+0000 7f031f266640 1 -- 172.21.15.132:0/478437652 shutdown_connections 2023-12-20T04:43:15.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.083+0000 7f031f266640 1 -- 172.21.15.132:0/478437652 wait complete. 2023-12-20T04:43:15.097 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:42:45.433456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:42:46.128920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:43:15.097 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:43:15.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.199+0000 7fd3a60ab640 1 Processor -- start 2023-12-20T04:43:15.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.199+0000 7fd3a60ab640 1 -- start start 2023-12-20T04:43:15.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.200+0000 7fd3a60ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3a00cfd10 0x7fd3a00b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.200+0000 7fd3a60ab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a00d1a90 con 0x7fd3a015d300 2023-12-20T04:43:15.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.200+0000 7fd3a60ab640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd3a00d1d70 con 0x7fd3a00cf880 2023-12-20T04:43:15.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.200+0000 7fd3a60ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a00d2050 con 0x7fd3a00cfd10 2023-12-20T04:43:15.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.200+0000 7fd39f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd3a015d300 0x7fd3a00d1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44566/0 (socket says 172.21.15.132:44566) 2023-12-20T04:43:15.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.200+0000 7fd39f7fe640 1 -- 172.21.15.132:0/2160686883 learned_addr learned my addr 172.21.15.132:0/2160686883 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:15.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.200+0000 7fd39ffff640 1 --2- 172.21.15.132:0/2160686883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3a00cfd10 0x7fd3a00b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.200+0000 7fd39e7fc640 1 -- 172.21.15.132:0/2160686883 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360665584 0 0) 0x7fd3a00d1a90 con 0x7fd3a015d300 2023-12-20T04:43:15.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.200+0000 7fd39e7fc640 1 -- 172.21.15.132:0/2160686883 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd388003520 con 0x7fd3a015d300 2023-12-20T04:43:15.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39e7fc640 1 -- 172.21.15.132:0/2160686883 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2066684092 0 0) 0x7fd388003520 con 0x7fd3a015d300 2023-12-20T04:43:15.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39e7fc640 1 -- 172.21.15.132:0/2160686883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3a00cfd10 msgr2=0x7fd3a00b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:15.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39e7fc640 1 --2- 172.21.15.132:0/2160686883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3a00cfd10 0x7fd3a00b67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39e7fc640 1 -- 172.21.15.132:0/2160686883 >> v1:172.21.15.187:6789/0 conn(0x7fd3a00cf880 legacy=0x7fd3a00b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39e7fc640 1 -- 172.21.15.132:0/2160686883 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a00d2330 con 0x7fd3a015d300 2023-12-20T04:43:15.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39e7fc640 1 -- 172.21.15.132:0/2160686883 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fd390001670 con 0x7fd3a015d300 2023-12-20T04:43:15.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39e7fc640 1 -- 172.21.15.132:0/2160686883 >> v1:172.21.15.132:6789/0 conn(0x7fd3a015d300 legacy=0x7fd3a00d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39e7fc640 1 --2- 172.21.15.132:0/2160686883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3880039a0 0x7fd388003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39e7fc640 1 --2- 172.21.15.132:0/2160686883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd388004350 0x7fd388004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39e7fc640 1 --2- 172.21.15.132:0/2160686883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3a00cfd10 0x7fd388005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39e7fc640 1 -- 172.21.15.132:0/2160686883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a00d2050 con 0x7fd3880039a0 2023-12-20T04:43:15.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39e7fc640 1 -- 172.21.15.132:0/2160686883 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd38800b980 con 0x7fd388004350 2023-12-20T04:43:15.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39e7fc640 1 -- 172.21.15.132:0/2160686883 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd38800bb40 con 0x7fd3a00cfd10 2023-12-20T04:43:15.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39f7fe640 1 --2- 172.21.15.132:0/2160686883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3880039a0 0x7fd388003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39ffff640 1 --2- 172.21.15.132:0/2160686883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3a00cfd10 0x7fd388005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39effd640 1 --2- 172.21.15.132:0/2160686883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd388004350 0x7fd388004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39f7fe640 1 -- 172.21.15.132:0/2160686883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3a00cfd10 msgr2=0x7fd388005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:15.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39f7fe640 1 --2- 172.21.15.132:0/2160686883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3a00cfd10 0x7fd388005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39f7fe640 1 -- 172.21.15.132:0/2160686883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd388004350 msgr2=0x7fd388004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:15.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39f7fe640 1 --2- 172.21.15.132:0/2160686883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd388004350 0x7fd388004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39f7fe640 1 -- 172.21.15.132:0/2160686883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd388003520 con 0x7fd3880039a0 2023-12-20T04:43:15.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.201+0000 7fd39effd640 1 --2- 172.21.15.132:0/2160686883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd388004350 0x7fd388004820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:15.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.202+0000 7fd39f7fe640 1 --2- 172.21.15.132:0/2160686883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3880039a0 0x7fd388003d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd39000c210 tx=0x7fd3880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b9c8977b5e74e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:15.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.202+0000 7fd39e7fc640 1 -- 172.21.15.132:0/2160686883 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd39002cae0 con 0x7fd3880039a0 2023-12-20T04:43:15.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.202+0000 7fd39e7fc640 1 -- 172.21.15.132:0/2160686883 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd39002cc60 con 0x7fd3880039a0 2023-12-20T04:43:15.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.202+0000 7fd39e7fc640 1 -- 172.21.15.132:0/2160686883 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3900058d0 con 0x7fd3880039a0 2023-12-20T04:43:15.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.202+0000 7fd3a60ab640 1 -- 172.21.15.132:0/2160686883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3880039a0 msgr2=0x7fd388003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.202+0000 7fd3a60ab640 1 --2- 172.21.15.132:0/2160686883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3880039a0 0x7fd388003d80 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7fd39000c210 tx=0x7fd3880057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.202+0000 7fd39ffff640 1 -- 172.21.15.132:0/2160686883 reap_dead start 2023-12-20T04:43:15.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.202+0000 7fd3a60ab640 1 -- 172.21.15.132:0/2160686883 shutdown_connections 2023-12-20T04:43:15.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.202+0000 7fd3a60ab640 1 -- 172.21.15.132:0/2160686883 >> 172.21.15.132:0/2160686883 conn(0x7fd3a006a3d0 msgr2=0x7fd3a006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:15.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.203+0000 7fd3a60ab640 1 -- 172.21.15.132:0/2160686883 shutdown_connections 2023-12-20T04:43:15.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.203+0000 7fd3a60ab640 1 -- 172.21.15.132:0/2160686883 wait complete. 2023-12-20T04:43:15.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.204+0000 7fd3a60ab640 1 Processor -- start 2023-12-20T04:43:15.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.204+0000 7fd3a60ab640 1 -- start start 2023-12-20T04:43:15.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.204+0000 7fd3a60ab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3880039a0 0x7fd3a014a0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.204+0000 7fd3a60ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a015dc10 0x7fd3a0152c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.204+0000 7fd3a60ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3a01f5d40 0x7fd3a0153190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd3a60ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a00ca000 con 0x7fd3a015dc10 2023-12-20T04:43:15.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd3a60ab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a01f6290 con 0x7fd3880039a0 2023-12-20T04:43:15.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd3a60ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a01f6570 con 0x7fd3a01f5d40 2023-12-20T04:43:15.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd39effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a015dc10 0x7fd3a0152c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd39effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a015dc10 0x7fd3a0152c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46126/0 (socket says 172.21.15.132:46126) 2023-12-20T04:43:15.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd39effd640 1 -- 172.21.15.132:0/1520807749 learned_addr learned my addr 172.21.15.132:0/1520807749 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:15.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd39f7fe640 1 --2- 172.21.15.132:0/1520807749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3880039a0 0x7fd3a014a0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd39ffff640 1 --2- 172.21.15.132:0/1520807749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3a01f5d40 0x7fd3a0153190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd39effd640 1 -- 172.21.15.132:0/1520807749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3a01f5d40 msgr2=0x7fd3a0153190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd39effd640 1 --2- 172.21.15.132:0/1520807749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3a01f5d40 0x7fd3a0153190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd39effd640 1 -- 172.21.15.132:0/1520807749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3880039a0 msgr2=0x7fd3a014a0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd39effd640 1 --2- 172.21.15.132:0/1520807749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3880039a0 0x7fd3a014a0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd39effd640 1 -- 172.21.15.132:0/1520807749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a01f6850 con 0x7fd3a015dc10 2023-12-20T04:43:15.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd39f7fe640 1 --2- 172.21.15.132:0/1520807749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3880039a0 0x7fd3a014a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:15.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd39effd640 1 --2- 172.21.15.132:0/1520807749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a015dc10 0x7fd3a0152c50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd394001f00 tx=0x7fd39400ea30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:15.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd387fff640 1 -- 172.21.15.132:0/1520807749 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3940052e0 con 0x7fd3a015dc10 2023-12-20T04:43:15.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd387fff640 1 -- 172.21.15.132:0/1520807749 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd394005440 con 0x7fd3a015dc10 2023-12-20T04:43:15.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd3a60ab640 1 -- 172.21.15.132:0/1520807749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a01f6b30 con 0x7fd3a015dc10 2023-12-20T04:43:15.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd387fff640 1 -- 172.21.15.132:0/1520807749 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd394003840 con 0x7fd3a015dc10 2023-12-20T04:43:15.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.205+0000 7fd3a60ab640 1 -- 172.21.15.132:0/1520807749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a014a620 con 0x7fd3a015dc10 2023-12-20T04:43:15.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.206+0000 7fd3a60ab640 1 -- 172.21.15.132:0/1520807749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a004e840 con 0x7fd3a015dc10 2023-12-20T04:43:15.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.207+0000 7fd387fff640 1 -- 172.21.15.132:0/1520807749 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd3940039a0 con 0x7fd3a015dc10 2023-12-20T04:43:15.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.207+0000 7fd387fff640 1 --2- 172.21.15.132:0/1520807749 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd38c06a460 0x7fd38c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.207+0000 7fd387fff640 1 -- 172.21.15.132:0/1520807749 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd3940887a0 con 0x7fd3a015dc10 2023-12-20T04:43:15.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.207+0000 7fd39f7fe640 1 --2- 172.21.15.132:0/1520807749 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd38c06a460 0x7fd38c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.207+0000 7fd39f7fe640 1 --2- 172.21.15.132:0/1520807749 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd38c06a460 0x7fd38c06c920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd39002cfd0 tx=0x7fd390039040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:15.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.211+0000 7fd387fff640 1 -- 172.21.15.132:0/1520807749 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd394053d90 con 0x7fd3a015dc10 2023-12-20T04:43:15.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.375+0000 7fd3a60ab640 1 -- 172.21.15.132:0/1520807749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd3a01e71f0 con 0x7fd3a015dc10 2023-12-20T04:43:15.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.376+0000 7fd387fff640 1 -- 172.21.15.132:0/1520807749 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd3940573b0 con 0x7fd3a015dc10 2023-12-20T04:43:15.378 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:43:15.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.378+0000 7fd3a60ab640 1 -- 172.21.15.132:0/1520807749 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd38c06a460 msgr2=0x7fd38c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.378+0000 7fd3a60ab640 1 --2- 172.21.15.132:0/1520807749 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd38c06a460 0x7fd38c06c920 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fd39002cfd0 tx=0x7fd390039040 comp rx=0 tx=0).stop 2023-12-20T04:43:15.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.378+0000 7fd3a60ab640 1 -- 172.21.15.132:0/1520807749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a015dc10 msgr2=0x7fd3a0152c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.378+0000 7fd3a60ab640 1 --2- 172.21.15.132:0/1520807749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a015dc10 0x7fd3a0152c50 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fd394001f00 tx=0x7fd39400ea30 comp rx=0 tx=0).stop 2023-12-20T04:43:15.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.378+0000 7fd3a60ab640 1 -- 172.21.15.132:0/1520807749 shutdown_connections 2023-12-20T04:43:15.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.378+0000 7fd3a60ab640 1 --2- 172.21.15.132:0/1520807749 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd38c06a460 0x7fd38c06c920 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.378+0000 7fd3a60ab640 1 --2- 172.21.15.132:0/1520807749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd3a01f5d40 0x7fd3a0153190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.378+0000 7fd3a60ab640 1 --2- 172.21.15.132:0/1520807749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd3a015dc10 0x7fd3a0152c50 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.378+0000 7fd3a60ab640 1 --2- 172.21.15.132:0/1520807749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd3880039a0 0x7fd3a014a0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.378+0000 7fd3a60ab640 1 -- 172.21.15.132:0/1520807749 >> 172.21.15.132:0/1520807749 conn(0x7fd3a006a3d0 msgr2=0x7fd3a00c9160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:15.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.378+0000 7fd3a60ab640 1 -- 172.21.15.132:0/1520807749 shutdown_connections 2023-12-20T04:43:15.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.378+0000 7fd3a60ab640 1 -- 172.21.15.132:0/1520807749 wait complete. 2023-12-20T04:43:15.390 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:43:15.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.490+0000 7ff16cd3e640 1 Processor -- start 2023-12-20T04:43:15.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.490+0000 7ff16cd3e640 1 -- start start 2023-12-20T04:43:15.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.491+0000 7ff16cd3e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff16815cf20 0x7ff16806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.491+0000 7ff16cd3e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff16815d300 0x7ff168161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.491+0000 7ff16cd3e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff168161c40 con 0x7ff1680cd4b0 2023-12-20T04:43:15.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.491+0000 7ff16cd3e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff16806cc90 con 0x7ff16815d300 2023-12-20T04:43:15.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.491+0000 7ff16cd3e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1680b2f30 con 0x7ff16815cf20 2023-12-20T04:43:15.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.491+0000 7ff165d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff16815d300 0x7ff168161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.491+0000 7ff166d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff1680cd4b0 0x7ff1680ceb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44582/0 (socket says 172.21.15.132:44582) 2023-12-20T04:43:15.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.491+0000 7ff166d9d640 1 -- 172.21.15.132:0/4134026092 learned_addr learned my addr 172.21.15.132:0/4134026092 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:15.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.492+0000 7ff16659c640 1 --2- 172.21.15.132:0/4134026092 >> v2:172.21.15.187:3300/0 conn(0x7ff16815cf20 0x7ff16806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.492+0000 7ff165d9b640 1 -- 172.21.15.132:0/4134026092 >> v2:172.21.15.187:3300/0 conn(0x7ff16815cf20 msgr2=0x7ff16806c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:15.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.492+0000 7ff165d9b640 1 --2- 172.21.15.132:0/4134026092 >> v2:172.21.15.187:3300/0 conn(0x7ff16815cf20 0x7ff16806c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.492+0000 7ff165d9b640 1 -- 172.21.15.132:0/4134026092 >> v1:172.21.15.132:6789/0 conn(0x7ff1680cd4b0 legacy=0x7ff1680ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.492+0000 7ff165d9b640 1 -- 172.21.15.132:0/4134026092 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1680b3210 con 0x7ff16815d300 2023-12-20T04:43:15.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.492+0000 7ff16559a640 1 -- 172.21.15.132:0/4134026092 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3654730536 0 0) 0x7ff168161c40 con 0x7ff1680cd4b0 2023-12-20T04:43:15.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.492+0000 7ff165d9b640 1 --2- 172.21.15.132:0/4134026092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff16815d300 0x7ff168161700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff168071180 tx=0x7ff15c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b93c901b09424400 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:15.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.493+0000 7ff16559a640 1 -- 172.21.15.132:0/4134026092 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c031830 con 0x7ff16815d300 2023-12-20T04:43:15.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.493+0000 7ff16559a640 1 -- 172.21.15.132:0/4134026092 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff15c031990 con 0x7ff16815d300 2023-12-20T04:43:15.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.493+0000 7ff16559a640 1 -- 172.21.15.132:0/4134026092 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff15c031d20 con 0x7ff16815d300 2023-12-20T04:43:15.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.493+0000 7ff16cd3e640 1 -- 172.21.15.132:0/4134026092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff16815d300 msgr2=0x7ff168161700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.493+0000 7ff16cd3e640 1 --2- 172.21.15.132:0/4134026092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff16815d300 0x7ff168161700 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff168071180 tx=0x7ff15c02b8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.493+0000 7ff16cd3e640 1 -- 172.21.15.132:0/4134026092 shutdown_connections 2023-12-20T04:43:15.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.493+0000 7ff16cd3e640 1 --2- 172.21.15.132:0/4134026092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff16815d300 0x7ff168161700 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.493+0000 7ff16cd3e640 1 --2- 172.21.15.132:0/4134026092 >> v2:172.21.15.187:3300/0 conn(0x7ff16815cf20 0x7ff16806c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.493+0000 7ff16cd3e640 1 -- 172.21.15.132:0/4134026092 >> 172.21.15.132:0/4134026092 conn(0x7ff168072c60 msgr2=0x7ff168073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:15.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.493+0000 7ff16cd3e640 1 -- 172.21.15.132:0/4134026092 shutdown_connections 2023-12-20T04:43:15.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.493+0000 7ff16cd3e640 1 -- 172.21.15.132:0/4134026092 wait complete. 2023-12-20T04:43:15.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.495+0000 7ff16cd3e640 1 Processor -- start 2023-12-20T04:43:15.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.495+0000 7ff16cd3e640 1 -- start start 2023-12-20T04:43:15.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.495+0000 7ff16cd3e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1680cd4b0 0x7ff1681f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.495+0000 7ff16cd3e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff16815cf20 0x7ff1680ae920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.495+0000 7ff16cd3e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff16815d300 0x7ff1680b1c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.495+0000 7ff16cd3e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680ac970 con 0x7ff16815d300 2023-12-20T04:43:15.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.495+0000 7ff16cd3e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1680b2180 con 0x7ff1680cd4b0 2023-12-20T04:43:15.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.495+0000 7ff16cd3e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1681f29a0 con 0x7ff16815cf20 2023-12-20T04:43:15.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.495+0000 7ff166d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff16815d300 0x7ff1680b1c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.495+0000 7ff166d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff16815d300 0x7ff1680b1c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46150/0 (socket says 172.21.15.132:46150) 2023-12-20T04:43:15.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.495+0000 7ff166d9d640 1 -- 172.21.15.132:0/1877446700 learned_addr learned my addr 172.21.15.132:0/1877446700 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:15.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.496+0000 7ff16659c640 1 --2- 172.21.15.132:0/1877446700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1680cd4b0 0x7ff1681f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.496+0000 7ff165d9b640 1 --2- 172.21.15.132:0/1877446700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff16815cf20 0x7ff1680ae920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.496+0000 7ff166d9d640 1 -- 172.21.15.132:0/1877446700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff16815cf20 msgr2=0x7ff1680ae920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.496+0000 7ff166d9d640 1 --2- 172.21.15.132:0/1877446700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff16815cf20 0x7ff1680ae920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.496+0000 7ff166d9d640 1 -- 172.21.15.132:0/1877446700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1680cd4b0 msgr2=0x7ff1681f2360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.496+0000 7ff166d9d640 1 --2- 172.21.15.132:0/1877446700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1680cd4b0 0x7ff1681f2360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.496+0000 7ff166d9d640 1 -- 172.21.15.132:0/1877446700 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff15c009400 con 0x7ff16815d300 2023-12-20T04:43:15.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.496+0000 7ff165d9b640 1 --2- 172.21.15.132:0/1877446700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff16815cf20 0x7ff1680ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:15.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.496+0000 7ff166d9d640 1 --2- 172.21.15.132:0/1877446700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff16815d300 0x7ff1680b1c40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff160001eb0 tx=0x7ff16000c870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:15.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.496+0000 7ff156ffd640 1 -- 172.21.15.132:0/1877446700 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1600074e0 con 0x7ff16815d300 2023-12-20T04:43:15.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.496+0000 7ff156ffd640 1 -- 172.21.15.132:0/1877446700 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff160007640 con 0x7ff16815d300 2023-12-20T04:43:15.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.496+0000 7ff156ffd640 1 -- 172.21.15.132:0/1877446700 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff160004a00 con 0x7ff16815d300 2023-12-20T04:43:15.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.496+0000 7ff16cd3e640 1 -- 172.21.15.132:0/1877446700 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1681f2c80 con 0x7ff16815d300 2023-12-20T04:43:15.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.496+0000 7ff16cd3e640 1 -- 172.21.15.132:0/1877446700 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1681f3240 con 0x7ff16815d300 2023-12-20T04:43:15.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.497+0000 7ff16cd3e640 1 -- 172.21.15.132:0/1877446700 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1680acae0 con 0x7ff16815d300 2023-12-20T04:43:15.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.497+0000 7ff156ffd640 1 -- 172.21.15.132:0/1877446700 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff160004b60 con 0x7ff16815d300 2023-12-20T04:43:15.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.498+0000 7ff156ffd640 1 --2- 172.21.15.132:0/1877446700 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff14806a430 0x7ff14806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.498+0000 7ff16659c640 1 --2- 172.21.15.132:0/1877446700 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff14806a430 0x7ff14806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.498+0000 7ff156ffd640 1 -- 172.21.15.132:0/1877446700 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff160088740 con 0x7ff16815d300 2023-12-20T04:43:15.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.498+0000 7ff16659c640 1 --2- 172.21.15.132:0/1877446700 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff14806a430 0x7ff14806c8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff1580074a0 tx=0x7ff15800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:15.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.502+0000 7ff156ffd640 1 -- 172.21.15.132:0/1877446700 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff160053d30 con 0x7ff16815d300 2023-12-20T04:43:15.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.667+0000 7ff16cd3e640 1 -- 172.21.15.132:0/1877446700 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7ff16804e840 con 0x7ff16815d300 2023-12-20T04:43:15.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.668+0000 7ff156ffd640 1 -- 172.21.15.132:0/1877446700 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7ff160057350 con 0x7ff16815d300 2023-12-20T04:43:15.670 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:43:15.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.670+0000 7ff16cd3e640 1 -- 172.21.15.132:0/1877446700 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff14806a430 msgr2=0x7ff14806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.670+0000 7ff16cd3e640 1 --2- 172.21.15.132:0/1877446700 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff14806a430 0x7ff14806c8f0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff1580074a0 tx=0x7ff15800b040 comp rx=0 tx=0).stop 2023-12-20T04:43:15.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.670+0000 7ff16cd3e640 1 -- 172.21.15.132:0/1877446700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff16815d300 msgr2=0x7ff1680b1c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.670+0000 7ff16cd3e640 1 --2- 172.21.15.132:0/1877446700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff16815d300 0x7ff1680b1c40 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7ff160001eb0 tx=0x7ff16000c870 comp rx=0 tx=0).stop 2023-12-20T04:43:15.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.670+0000 7ff16cd3e640 1 -- 172.21.15.132:0/1877446700 shutdown_connections 2023-12-20T04:43:15.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.670+0000 7ff16cd3e640 1 --2- 172.21.15.132:0/1877446700 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff14806a430 0x7ff14806c8f0 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.670+0000 7ff16cd3e640 1 --2- 172.21.15.132:0/1877446700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff16815d300 0x7ff1680b1c40 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.670+0000 7ff16cd3e640 1 --2- 172.21.15.132:0/1877446700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff16815cf20 0x7ff1680ae920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.670+0000 7ff16cd3e640 1 --2- 172.21.15.132:0/1877446700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1680cd4b0 0x7ff1681f2360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.670+0000 7ff16cd3e640 1 -- 172.21.15.132:0/1877446700 >> 172.21.15.132:0/1877446700 conn(0x7ff168072c60 msgr2=0x7ff1680b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:15.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.670+0000 7ff16cd3e640 1 -- 172.21.15.132:0/1877446700 shutdown_connections 2023-12-20T04:43:15.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.670+0000 7ff16cd3e640 1 -- 172.21.15.132:0/1877446700 wait complete. 2023-12-20T04:43:15.684 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:43:15.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.785+0000 7fcc0788b640 1 Processor -- start 2023-12-20T04:43:15.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.785+0000 7fcc0788b640 1 -- start start 2023-12-20T04:43:15.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.786+0000 7fcc0788b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc000ca170 0x7fcc000ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.786+0000 7fcc0788b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcc00069c30 0x7fcc0006a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.786+0000 7fcc0788b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcc000c4f40 con 0x7fcc001447b0 2023-12-20T04:43:15.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.786+0000 7fcc0788b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcc0006a600 con 0x7fcc00069c30 2023-12-20T04:43:15.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.786+0000 7fcc0788b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000c6380 con 0x7fcc000ca170 2023-12-20T04:43:15.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.786+0000 7fcc04e26640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc000ca170 0x7fcc000ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.786+0000 7fcc05e28640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcc00069c30 0x7fcc0006a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.786+0000 7fcc05627640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fcc001447b0 0x7fcc000c5c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:54624/0 (socket says 172.21.15.132:54624) 2023-12-20T04:43:15.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.786+0000 7fcc05627640 1 -- 172.21.15.132:0/261933912 learned_addr learned my addr 172.21.15.132:0/261933912 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:15.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.786+0000 7fcbf7fff640 1 -- 172.21.15.132:0/261933912 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3779581454 0 0) 0x7fcc000c4f40 con 0x7fcc001447b0 2023-12-20T04:43:15.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.787+0000 7fcbf7fff640 1 -- 172.21.15.132:0/261933912 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcbec003520 con 0x7fcc001447b0 2023-12-20T04:43:15.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.787+0000 7fcc05e28640 1 -- 172.21.15.132:0/261933912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc000ca170 msgr2=0x7fcc000ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:15.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.787+0000 7fcc05e28640 1 --2- 172.21.15.132:0/261933912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc000ca170 0x7fcc000ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.787+0000 7fcc05e28640 1 -- 172.21.15.132:0/261933912 >> v1:172.21.15.187:6789/0 conn(0x7fcc001447b0 legacy=0x7fcc000c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.787+0000 7fcc05e28640 1 -- 172.21.15.132:0/261933912 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc00144b90 con 0x7fcc00069c30 2023-12-20T04:43:15.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.787+0000 7fcc04e26640 1 --2- 172.21.15.132:0/261933912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc000ca170 0x7fcc000ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:43:15.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.787+0000 7fcc05e28640 1 --2- 172.21.15.132:0/261933912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc00069c30 0x7fcc0006a0c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8009dc0 tx=0x7fcbf802be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6e0ecff964e9cd8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:15.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.788+0000 7fcbf7fff640 1 -- 172.21.15.132:0/261933912 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf802cbb0 con 0x7fcc00069c30 2023-12-20T04:43:15.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.788+0000 7fcbf7fff640 1 -- 172.21.15.132:0/261933912 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf802cd10 con 0x7fcc00069c30 2023-12-20T04:43:15.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.788+0000 7fcbf7fff640 1 -- 172.21.15.132:0/261933912 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf8034640 con 0x7fcc00069c30 2023-12-20T04:43:15.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.788+0000 7fcc0788b640 1 -- 172.21.15.132:0/261933912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc00069c30 msgr2=0x7fcc0006a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.788+0000 7fcc0788b640 1 --2- 172.21.15.132:0/261933912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc00069c30 0x7fcc0006a0c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fcbf8009dc0 tx=0x7fcbf802be00 comp rx=0 tx=0).stop 2023-12-20T04:43:15.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.788+0000 7fcc0788b640 1 -- 172.21.15.132:0/261933912 shutdown_connections 2023-12-20T04:43:15.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.788+0000 7fcc0788b640 1 --2- 172.21.15.132:0/261933912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc00069c30 0x7fcc0006a0c0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.788+0000 7fcc0788b640 1 --2- 172.21.15.132:0/261933912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc000ca170 0x7fcc000ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.788+0000 7fcc0788b640 1 -- 172.21.15.132:0/261933912 >> 172.21.15.132:0/261933912 conn(0x7fcc000cc630 msgr2=0x7fcc000cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:15.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.788+0000 7fcc0788b640 1 -- 172.21.15.132:0/261933912 shutdown_connections 2023-12-20T04:43:15.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.788+0000 7fcc0788b640 1 -- 172.21.15.132:0/261933912 wait complete. 2023-12-20T04:43:15.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.789+0000 7fcc0788b640 1 Processor -- start 2023-12-20T04:43:15.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.789+0000 7fcc0788b640 1 -- start start 2023-12-20T04:43:15.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.790+0000 7fcc0788b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc00069c30 0x7fcc000b1780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.790+0000 7fcc0788b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcc000ca170 0x7fcc001342e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.790+0000 7fcc0788b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc001447b0 0x7fcc0015cf50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.790+0000 7fcc0788b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc00134820 con 0x7fcc000ca170 2023-12-20T04:43:15.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.790+0000 7fcc0788b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc000c6bf0 con 0x7fcc00069c30 2023-12-20T04:43:15.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.790+0000 7fcc0788b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcc0015d810 con 0x7fcc001447b0 2023-12-20T04:43:15.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.790+0000 7fcc04e26640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcc000ca170 0x7fcc001342e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.790+0000 7fcc04e26640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcc000ca170 0x7fcc001342e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46152/0 (socket says 172.21.15.132:46152) 2023-12-20T04:43:15.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.790+0000 7fcc04e26640 1 -- 172.21.15.132:0/2989492608 learned_addr learned my addr 172.21.15.132:0/2989492608 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:15.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.790+0000 7fcc05627640 1 --2- 172.21.15.132:0/2989492608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc00069c30 0x7fcc000b1780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.790+0000 7fcc05e28640 1 --2- 172.21.15.132:0/2989492608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc001447b0 0x7fcc0015cf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.790+0000 7fcc04e26640 1 -- 172.21.15.132:0/2989492608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc001447b0 msgr2=0x7fcc0015cf50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.790+0000 7fcc04e26640 1 --2- 172.21.15.132:0/2989492608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc001447b0 0x7fcc0015cf50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.790+0000 7fcc04e26640 1 -- 172.21.15.132:0/2989492608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc00069c30 msgr2=0x7fcc000b1780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.790+0000 7fcc04e26640 1 --2- 172.21.15.132:0/2989492608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc00069c30 0x7fcc000b1780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.790+0000 7fcc04e26640 1 -- 172.21.15.132:0/2989492608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcbf0009400 con 0x7fcc000ca170 2023-12-20T04:43:15.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.790+0000 7fcc05627640 1 --2- 172.21.15.132:0/2989492608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc00069c30 0x7fcc000b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:15.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.791+0000 7fcc04e26640 1 --2- 172.21.15.132:0/2989492608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcc000ca170 0x7fcc001342e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000e960 tx=0x7fcbf000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:15.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.791+0000 7fcbf5ffb640 1 -- 172.21.15.132:0/2989492608 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf000ca00 con 0x7fcc000ca170 2023-12-20T04:43:15.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.791+0000 7fcbf5ffb640 1 -- 172.21.15.132:0/2989492608 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcbf000cb60 con 0x7fcc000ca170 2023-12-20T04:43:15.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.791+0000 7fcc0788b640 1 -- 172.21.15.132:0/2989492608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcbf8009a70 con 0x7fcc000ca170 2023-12-20T04:43:15.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.791+0000 7fcbf5ffb640 1 -- 172.21.15.132:0/2989492608 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcbf0013470 con 0x7fcc000ca170 2023-12-20T04:43:15.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.791+0000 7fcc0788b640 1 -- 172.21.15.132:0/2989492608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc0015ddd0 con 0x7fcc000ca170 2023-12-20T04:43:15.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.792+0000 7fcc0788b640 1 -- 172.21.15.132:0/2989492608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc000c6e10 con 0x7fcc000ca170 2023-12-20T04:43:15.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.792+0000 7fcbf5ffb640 1 -- 172.21.15.132:0/2989492608 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcbf00135d0 con 0x7fcc000ca170 2023-12-20T04:43:15.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.793+0000 7fcbf5ffb640 1 --2- 172.21.15.132:0/2989492608 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcbe406a430 0x7fcbe406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:15.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.793+0000 7fcbf5ffb640 1 -- 172.21.15.132:0/2989492608 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcbf0088b90 con 0x7fcc000ca170 2023-12-20T04:43:15.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.793+0000 7fcc05627640 1 --2- 172.21.15.132:0/2989492608 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcbe406a430 0x7fcbe406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:15.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.793+0000 7fcc05627640 1 --2- 172.21.15.132:0/2989492608 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcbe406a430 0x7fcbe406c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc007fd0 tx=0x7fcbfc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:15.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.797+0000 7fcbf5ffb640 1 -- 172.21.15.132:0/2989492608 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcc000c6e10 con 0x7fcc000ca170 2023-12-20T04:43:15.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.964+0000 7fcc0788b640 1 -- 172.21.15.132:0/2989492608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcc000c6db0 con 0x7fcc000ca170 2023-12-20T04:43:15.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.964+0000 7fcbf5ffb640 1 -- 172.21.15.132:0/2989492608 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcbf0054180 con 0x7fcc000ca170 2023-12-20T04:43:15.966 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:43:15.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.966+0000 7fcc0788b640 1 -- 172.21.15.132:0/2989492608 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcbe406a430 msgr2=0x7fcbe406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.966+0000 7fcc0788b640 1 --2- 172.21.15.132:0/2989492608 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcbe406a430 0x7fcbe406c8f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fcbfc007fd0 tx=0x7fcbfc009040 comp rx=0 tx=0).stop 2023-12-20T04:43:15.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.966+0000 7fcc0788b640 1 -- 172.21.15.132:0/2989492608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcc000ca170 msgr2=0x7fcc001342e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:15.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.966+0000 7fcc0788b640 1 --2- 172.21.15.132:0/2989492608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcc000ca170 0x7fcc001342e0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fcbf000e960 tx=0x7fcbf000ee20 comp rx=0 tx=0).stop 2023-12-20T04:43:15.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.966+0000 7fcc0788b640 1 -- 172.21.15.132:0/2989492608 shutdown_connections 2023-12-20T04:43:15.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.966+0000 7fcc0788b640 1 --2- 172.21.15.132:0/2989492608 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcbe406a430 0x7fcbe406c8f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.966+0000 7fcc0788b640 1 --2- 172.21.15.132:0/2989492608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcc001447b0 0x7fcc0015cf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.966+0000 7fcc0788b640 1 --2- 172.21.15.132:0/2989492608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcc000ca170 0x7fcc001342e0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.966+0000 7fcc0788b640 1 --2- 172.21.15.132:0/2989492608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcc00069c30 0x7fcc000b1780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:15.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.966+0000 7fcc0788b640 1 -- 172.21.15.132:0/2989492608 >> 172.21.15.132:0/2989492608 conn(0x7fcc000cc630 msgr2=0x7fcc000b2050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:15.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.966+0000 7fcc0788b640 1 -- 172.21.15.132:0/2989492608 shutdown_connections 2023-12-20T04:43:15.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:15.966+0000 7fcc0788b640 1 -- 172.21.15.132:0/2989492608 wait complete. 2023-12-20T04:43:15.979 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:16.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.078+0000 7fbb35f47640 1 Processor -- start 2023-12-20T04:43:16.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.078+0000 7fbb35f47640 1 -- start start 2023-12-20T04:43:16.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.078+0000 7fbb35f47640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbb300d08c0 0x7fbb3006f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.078+0000 7fbb35f47640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3006f750 con 0x7fbb300cd030 2023-12-20T04:43:16.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.078+0000 7fbb35f47640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb3006fa30 con 0x7fbb3015b7d0 2023-12-20T04:43:16.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.078+0000 7fbb35f47640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb3015f060 con 0x7fbb300d08c0 2023-12-20T04:43:16.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.078+0000 7fbb2effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbb300cd030 0x7fbb3015f480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44586/0 (socket says 172.21.15.132:44586) 2023-12-20T04:43:16.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.078+0000 7fbb2effd640 1 -- 172.21.15.132:0/1592714230 learned_addr learned my addr 172.21.15.132:0/1592714230 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:16.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2e7fc640 1 -- 172.21.15.132:0/1592714230 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3927273919 0 0) 0x7fbb3006f750 con 0x7fbb300cd030 2023-12-20T04:43:16.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2e7fc640 1 -- 172.21.15.132:0/1592714230 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb18003520 con 0x7fbb300cd030 2023-12-20T04:43:16.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2f7fe640 1 --2- 172.21.15.132:0/1592714230 >> v2:172.21.15.187:3300/0 conn(0x7fbb300d08c0 0x7fbb3006f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2e7fc640 1 -- 172.21.15.132:0/1592714230 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3312452290 0 0) 0x7fbb18003520 con 0x7fbb300cd030 2023-12-20T04:43:16.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2e7fc640 1 -- 172.21.15.132:0/1592714230 >> v2:172.21.15.187:3300/0 conn(0x7fbb300d08c0 msgr2=0x7fbb3006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:16.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2e7fc640 1 --2- 172.21.15.132:0/1592714230 >> v2:172.21.15.187:3300/0 conn(0x7fbb300d08c0 0x7fbb3006f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2e7fc640 1 -- 172.21.15.132:0/1592714230 >> v1:172.21.15.187:6789/0 conn(0x7fbb3015b7d0 legacy=0x7fbb300b27b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:16.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2e7fc640 1 -- 172.21.15.132:0/1592714230 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb3006fd10 con 0x7fbb300cd030 2023-12-20T04:43:16.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2e7fc640 1 -- 172.21.15.132:0/1592714230 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fbb24001670 con 0x7fbb300cd030 2023-12-20T04:43:16.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2e7fc640 1 -- 172.21.15.132:0/1592714230 >> v1:172.21.15.132:6789/0 conn(0x7fbb300cd030 legacy=0x7fbb3015f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:16.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2e7fc640 1 --2- 172.21.15.132:0/1592714230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb18003970 0x7fbb18003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2e7fc640 1 --2- 172.21.15.132:0/1592714230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb180047c0 0x7fbb18004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2e7fc640 1 --2- 172.21.15.132:0/1592714230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb180052a0 0x7fbb1800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2e7fc640 1 -- 172.21.15.132:0/1592714230 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb3015f060 con 0x7fbb18003970 2023-12-20T04:43:16.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2e7fc640 1 -- 172.21.15.132:0/1592714230 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1800c170 con 0x7fbb180047c0 2023-12-20T04:43:16.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2e7fc640 1 -- 172.21.15.132:0/1592714230 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb1800c330 con 0x7fbb180052a0 2023-12-20T04:43:16.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2f7fe640 1 --2- 172.21.15.132:0/1592714230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb18003970 0x7fbb18003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2effd640 1 --2- 172.21.15.132:0/1592714230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb180047c0 0x7fbb18004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2ffff640 1 --2- 172.21.15.132:0/1592714230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb180052a0 0x7fbb1800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2f7fe640 1 -- 172.21.15.132:0/1592714230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb180052a0 msgr2=0x7fbb1800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:16.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2f7fe640 1 --2- 172.21.15.132:0/1592714230 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb180052a0 0x7fbb1800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2f7fe640 1 -- 172.21.15.132:0/1592714230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb180047c0 msgr2=0x7fbb18004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:16.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2f7fe640 1 --2- 172.21.15.132:0/1592714230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb180047c0 0x7fbb18004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2ffff640 1 -- 172.21.15.132:0/1592714230 reap_dead start 2023-12-20T04:43:16.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2f7fe640 1 -- 172.21.15.132:0/1592714230 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb18003520 con 0x7fbb18003970 2023-12-20T04:43:16.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.079+0000 7fbb2effd640 1 --2- 172.21.15.132:0/1592714230 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb180047c0 0x7fbb18004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:16.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.080+0000 7fbb2f7fe640 1 --2- 172.21.15.132:0/1592714230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb18003970 0x7fbb18003d90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009a90 tx=0x7fbb180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=963830382ced3f77 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:16.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.080+0000 7fbb2e7fc640 1 -- 172.21.15.132:0/1592714230 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2002c680 con 0x7fbb18003970 2023-12-20T04:43:16.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.080+0000 7fbb2e7fc640 1 -- 172.21.15.132:0/1592714230 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2002c7e0 con 0x7fbb18003970 2023-12-20T04:43:16.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.080+0000 7fbb2e7fc640 1 -- 172.21.15.132:0/1592714230 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2002cb70 con 0x7fbb18003970 2023-12-20T04:43:16.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.081+0000 7fbb35f47640 1 -- 172.21.15.132:0/1592714230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb18003970 msgr2=0x7fbb18003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:16.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.081+0000 7fbb35f47640 1 --2- 172.21.15.132:0/1592714230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb18003970 0x7fbb18003d90 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fbb20009a90 tx=0x7fbb180057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.081+0000 7fbb35f47640 1 -- 172.21.15.132:0/1592714230 shutdown_connections 2023-12-20T04:43:16.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.081+0000 7fbb35f47640 1 --2- 172.21.15.132:0/1592714230 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb18003970 0x7fbb18003d90 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.081+0000 7fbb35f47640 1 -- 172.21.15.132:0/1592714230 >> 172.21.15.132:0/1592714230 conn(0x7fbb300cd7b0 msgr2=0x7fbb300cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:16.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.081+0000 7fbb35f47640 1 -- 172.21.15.132:0/1592714230 shutdown_connections 2023-12-20T04:43:16.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.081+0000 7fbb35f47640 1 -- 172.21.15.132:0/1592714230 wait complete. 2023-12-20T04:43:16.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.082+0000 7fbb35f47640 1 Processor -- start 2023-12-20T04:43:16.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.082+0000 7fbb35f47640 1 -- start start 2023-12-20T04:43:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb35f47640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb18003970 0x7fbb3014b170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb35f47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb30155f20 0x7fbb3006ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb35f47640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb30156380 0x7fbb3006b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb35f47640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb300c5020 con 0x7fbb30155f20 2023-12-20T04:43:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb35f47640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb30158c30 con 0x7fbb18003970 2023-12-20T04:43:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb35f47640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb30158f10 con 0x7fbb30156380 2023-12-20T04:43:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb2effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb30155f20 0x7fbb3006ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb2effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb30155f20 0x7fbb3006ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46178/0 (socket says 172.21.15.132:46178) 2023-12-20T04:43:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb2effd640 1 -- 172.21.15.132:0/512423572 learned_addr learned my addr 172.21.15.132:0/512423572 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb2f7fe640 1 --2- 172.21.15.132:0/512423572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb18003970 0x7fbb3014b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb2ffff640 1 --2- 172.21.15.132:0/512423572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb30156380 0x7fbb3006b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb2effd640 1 -- 172.21.15.132:0/512423572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb30156380 msgr2=0x7fbb3006b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:16.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb2effd640 1 --2- 172.21.15.132:0/512423572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb30156380 0x7fbb3006b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb2effd640 1 -- 172.21.15.132:0/512423572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb18003970 msgr2=0x7fbb3014b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:16.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb2effd640 1 --2- 172.21.15.132:0/512423572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb18003970 0x7fbb3014b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb2effd640 1 -- 172.21.15.132:0/512423572 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb300c4cb0 con 0x7fbb30155f20 2023-12-20T04:43:16.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb2f7fe640 1 --2- 172.21.15.132:0/512423572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb18003970 0x7fbb3014b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:16.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb2ffff640 1 --2- 172.21.15.132:0/512423572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb30156380 0x7fbb3006b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:16.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.083+0000 7fbb2effd640 1 --2- 172.21.15.132:0/512423572 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb30155f20 0x7fbb3006ad40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400e730 tx=0x7fbb2400ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:16.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.084+0000 7fbb17fff640 1 -- 172.21.15.132:0/512423572 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2400c6c0 con 0x7fbb30155f20 2023-12-20T04:43:16.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.084+0000 7fbb17fff640 1 -- 172.21.15.132:0/512423572 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb2400c820 con 0x7fbb30155f20 2023-12-20T04:43:16.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.084+0000 7fbb35f47640 1 -- 172.21.15.132:0/512423572 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb3006b7c0 con 0x7fbb30155f20 2023-12-20T04:43:16.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.084+0000 7fbb17fff640 1 -- 172.21.15.132:0/512423572 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb2400cbd0 con 0x7fbb30155f20 2023-12-20T04:43:16.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.084+0000 7fbb35f47640 1 -- 172.21.15.132:0/512423572 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb30157a90 con 0x7fbb30155f20 2023-12-20T04:43:16.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.085+0000 7fbb35f47640 1 -- 172.21.15.132:0/512423572 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb300c4b10 con 0x7fbb30155f20 2023-12-20T04:43:16.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.085+0000 7fbb17fff640 1 -- 172.21.15.132:0/512423572 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbb2400cd30 con 0x7fbb30155f20 2023-12-20T04:43:16.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.085+0000 7fbb17fff640 1 --2- 172.21.15.132:0/512423572 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb1c06a430 0x7fbb1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.085+0000 7fbb17fff640 1 -- 172.21.15.132:0/512423572 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbb240887a0 con 0x7fbb30155f20 2023-12-20T04:43:16.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.085+0000 7fbb2f7fe640 1 --2- 172.21.15.132:0/512423572 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb1c06a430 0x7fbb1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.086+0000 7fbb2f7fe640 1 --2- 172.21.15.132:0/512423572 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb1c06a430 0x7fbb1c06c8f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbb20036000 tx=0x7fbb20030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:16.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.090+0000 7fbb17fff640 1 -- 172.21.15.132:0/512423572 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbb300c4b10 con 0x7fbb30155f20 2023-12-20T04:43:16.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.256+0000 7fbb35f47640 1 -- 172.21.15.132:0/512423572 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb300c4b10 con 0x7fbb30155f20 2023-12-20T04:43:16.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.257+0000 7fbb17fff640 1 -- 172.21.15.132:0/512423572 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fbb300c4b10 con 0x7fbb30155f20 2023-12-20T04:43:16.259 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:16.259 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.259+0000 7fbb35f47640 1 -- 172.21.15.132:0/512423572 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb1c06a430 msgr2=0x7fbb1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.259+0000 7fbb35f47640 1 --2- 172.21.15.132:0/512423572 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb1c06a430 0x7fbb1c06c8f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fbb20036000 tx=0x7fbb20030000 comp rx=0 tx=0).stop 2023-12-20T04:43:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.259+0000 7fbb35f47640 1 -- 172.21.15.132:0/512423572 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb30155f20 msgr2=0x7fbb3006ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.259+0000 7fbb35f47640 1 --2- 172.21.15.132:0/512423572 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb30155f20 0x7fbb3006ad40 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fbb2400e730 tx=0x7fbb2400ebf0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.259+0000 7fbb35f47640 1 -- 172.21.15.132:0/512423572 shutdown_connections 2023-12-20T04:43:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.259+0000 7fbb35f47640 1 --2- 172.21.15.132:0/512423572 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb1c06a430 0x7fbb1c06c8f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.259+0000 7fbb35f47640 1 --2- 172.21.15.132:0/512423572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb30156380 0x7fbb3006b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.259+0000 7fbb35f47640 1 --2- 172.21.15.132:0/512423572 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb30155f20 0x7fbb3006ad40 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.259+0000 7fbb35f47640 1 --2- 172.21.15.132:0/512423572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb18003970 0x7fbb3014b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.259+0000 7fbb35f47640 1 -- 172.21.15.132:0/512423572 >> 172.21.15.132:0/512423572 conn(0x7fbb300cd7b0 msgr2=0x7fbb3015add0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:16.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.259+0000 7fbb35f47640 1 -- 172.21.15.132:0/512423572 shutdown_connections 2023-12-20T04:43:16.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.259+0000 7fbb35f47640 1 -- 172.21.15.132:0/512423572 wait complete. 2023-12-20T04:43:16.272 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:42:45.433456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:42:46.128920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:43:16.273 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:43:16.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.374+0000 7f4ceca82640 1 Processor -- start 2023-12-20T04:43:16.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.374+0000 7f4ceca82640 1 -- start start 2023-12-20T04:43:16.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.375+0000 7f4ceca82640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4ce815cf20 0x7f4ce806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.375+0000 7f4ceca82640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4ce815d300 0x7f4ce8161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.375+0000 7f4ceca82640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ce80cd4b0 0x7f4ce80cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.375+0000 7f4ceca82640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce80cde60 con 0x7f4ce815d300 2023-12-20T04:43:16.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.375+0000 7f4ceca82640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ce8161c40 con 0x7f4ce815cf20 2023-12-20T04:43:16.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.375+0000 7f4ceca82640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce806cc90 con 0x7f4ce80cd4b0 2023-12-20T04:43:16.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.375+0000 7f4ce5d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4ce815d300 0x7f4ce8161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.375+0000 7f4ce5d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4ce815d300 0x7f4ce8161700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46190/0 (socket says 172.21.15.132:46190) 2023-12-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.375+0000 7f4ce5d9b640 1 -- 172.21.15.132:0/3880830603 learned_addr learned my addr 172.21.15.132:0/3880830603 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.375+0000 7f4ce659c640 1 --2- 172.21.15.132:0/3880830603 >> v2:172.21.15.187:3300/0 conn(0x7f4ce815cf20 0x7f4ce806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.375+0000 7f4ce6d9d640 1 --2- 172.21.15.132:0/3880830603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ce80cd4b0 0x7f4ce80cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.376+0000 7f4ce5d9b640 1 -- 172.21.15.132:0/3880830603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ce80cd4b0 msgr2=0x7f4ce80cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.376+0000 7f4ce5d9b640 1 --2- 172.21.15.132:0/3880830603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ce80cd4b0 0x7f4ce80cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.376+0000 7f4ce5d9b640 1 -- 172.21.15.132:0/3880830603 >> v2:172.21.15.187:3300/0 conn(0x7f4ce815cf20 msgr2=0x7f4ce806c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.376+0000 7f4ce5d9b640 1 --2- 172.21.15.132:0/3880830603 >> v2:172.21.15.187:3300/0 conn(0x7f4ce815cf20 0x7f4ce806c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.376+0000 7f4ce5d9b640 1 -- 172.21.15.132:0/3880830603 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ce80b2f30 con 0x7f4ce815d300 2023-12-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.376+0000 7f4ce5d9b640 1 --2- 172.21.15.132:0/3880830603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ce815d300 0x7f4ce8161700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8071180 tx=0x7f4cdc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb1778fbb7b50c02 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.376+0000 7f4ce559a640 1 -- 172.21.15.132:0/3880830603 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc031870 con 0x7f4ce815d300 2023-12-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.377+0000 7f4ce559a640 1 -- 172.21.15.132:0/3880830603 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cdc0319d0 con 0x7f4ce815d300 2023-12-20T04:43:16.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.377+0000 7f4ce559a640 1 -- 172.21.15.132:0/3880830603 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cdc031d60 con 0x7f4ce815d300 2023-12-20T04:43:16.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.377+0000 7f4ceca82640 1 -- 172.21.15.132:0/3880830603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ce815d300 msgr2=0x7f4ce8161700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:16.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.377+0000 7f4ceca82640 1 --2- 172.21.15.132:0/3880830603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ce815d300 0x7f4ce8161700 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4ce8071180 tx=0x7f4cdc02b910 comp rx=0 tx=0).stop 2023-12-20T04:43:16.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.377+0000 7f4ceca82640 1 -- 172.21.15.132:0/3880830603 shutdown_connections 2023-12-20T04:43:16.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.377+0000 7f4ceca82640 1 --2- 172.21.15.132:0/3880830603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ce80cd4b0 0x7f4ce80cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.377+0000 7f4ceca82640 1 --2- 172.21.15.132:0/3880830603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ce815d300 0x7f4ce8161700 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.377+0000 7f4ceca82640 1 --2- 172.21.15.132:0/3880830603 >> v2:172.21.15.187:3300/0 conn(0x7f4ce815cf20 0x7f4ce806c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.377+0000 7f4ceca82640 1 -- 172.21.15.132:0/3880830603 >> 172.21.15.132:0/3880830603 conn(0x7f4ce8072c60 msgr2=0x7f4ce8073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.377+0000 7f4ceca82640 1 -- 172.21.15.132:0/3880830603 shutdown_connections 2023-12-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.377+0000 7f4ceca82640 1 -- 172.21.15.132:0/3880830603 wait complete. 2023-12-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.378+0000 7f4ceca82640 1 Processor -- start 2023-12-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.379+0000 7f4ceca82640 1 -- start start 2023-12-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.379+0000 7f4ceca82640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ce80cd4b0 0x7f4ce80af360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.379+0000 7f4ceca82640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ce815cf20 0x7f4ce81f5680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.379+0000 7f4ceca82640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ce815d300 0x7f4ce8160ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.379+0000 7f4ceca82640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80c62e0 con 0x7f4ce80cd4b0 2023-12-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.379+0000 7f4ceca82640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce81f5bc0 con 0x7f4ce815cf20 2023-12-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.379+0000 7f4ceca82640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ce80c5660 con 0x7f4ce815d300 2023-12-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.379+0000 7f4ce659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ce80cd4b0 0x7f4ce80af360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.379+0000 7f4ce659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ce80cd4b0 0x7f4ce80af360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46194/0 (socket says 172.21.15.132:46194) 2023-12-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.379+0000 7f4ce659c640 1 -- 172.21.15.132:0/2307417347 learned_addr learned my addr 172.21.15.132:0/2307417347 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.379+0000 7f4ce6d9d640 1 --2- 172.21.15.132:0/2307417347 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ce815d300 0x7f4ce8160ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.379+0000 7f4ce5d9b640 1 --2- 172.21.15.132:0/2307417347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ce815cf20 0x7f4ce81f5680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.380+0000 7f4ce659c640 1 -- 172.21.15.132:0/2307417347 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ce815d300 msgr2=0x7f4ce8160ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.380+0000 7f4ce659c640 1 --2- 172.21.15.132:0/2307417347 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ce815d300 0x7f4ce8160ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.380+0000 7f4ce659c640 1 -- 172.21.15.132:0/2307417347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ce815cf20 msgr2=0x7f4ce81f5680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.380+0000 7f4ce659c640 1 --2- 172.21.15.132:0/2307417347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ce815cf20 0x7f4ce81f5680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.380+0000 7f4ce659c640 1 -- 172.21.15.132:0/2307417347 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4cdc0094d0 con 0x7f4ce80cd4b0 2023-12-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.380+0000 7f4ce5d9b640 1 --2- 172.21.15.132:0/2307417347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ce815cf20 0x7f4ce81f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.380+0000 7f4ce659c640 1 --2- 172.21.15.132:0/2307417347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ce80cd4b0 0x7f4ce80af360 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800e9b0 tx=0x7f4cd800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.380+0000 7f4cd6ffd640 1 -- 172.21.15.132:0/2307417347 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd8009670 con 0x7f4ce80cd4b0 2023-12-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.380+0000 7f4cd6ffd640 1 -- 172.21.15.132:0/2307417347 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4cd800c9a0 con 0x7f4ce80cd4b0 2023-12-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.380+0000 7f4ceca82640 1 -- 172.21.15.132:0/2307417347 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ce80c5940 con 0x7f4ce80cd4b0 2023-12-20T04:43:16.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.380+0000 7f4cd6ffd640 1 -- 172.21.15.132:0/2307417347 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4cd800cd50 con 0x7f4ce80cd4b0 2023-12-20T04:43:16.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.380+0000 7f4ceca82640 1 -- 172.21.15.132:0/2307417347 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ce80c5f00 con 0x7f4ce80cd4b0 2023-12-20T04:43:16.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.381+0000 7f4ceca82640 1 -- 172.21.15.132:0/2307417347 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ce804e840 con 0x7f4ce80cd4b0 2023-12-20T04:43:16.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.381+0000 7f4cd6ffd640 1 -- 172.21.15.132:0/2307417347 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4cd8013470 con 0x7f4ce80cd4b0 2023-12-20T04:43:16.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.382+0000 7f4cd6ffd640 1 --2- 172.21.15.132:0/2307417347 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4cc806a430 0x7f4cc806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.382+0000 7f4cd6ffd640 1 -- 172.21.15.132:0/2307417347 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4cd8088b30 con 0x7f4ce80cd4b0 2023-12-20T04:43:16.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.382+0000 7f4ce5d9b640 1 --2- 172.21.15.132:0/2307417347 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4cc806a430 0x7f4cc806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.382+0000 7f4ce5d9b640 1 --2- 172.21.15.132:0/2307417347 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4cc806a430 0x7f4cc806c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc036000 tx=0x7f4cdc03c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:16.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.386+0000 7f4cd6ffd640 1 -- 172.21.15.132:0/2307417347 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4cd8054120 con 0x7f4ce80cd4b0 2023-12-20T04:43:16.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.555+0000 7f4ceca82640 1 -- 172.21.15.132:0/2307417347 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4ce80b0810 con 0x7f4ce80cd4b0 2023-12-20T04:43:16.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.555+0000 7f4cd6ffd640 1 -- 172.21.15.132:0/2307417347 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4cd80170a0 con 0x7f4ce80cd4b0 2023-12-20T04:43:16.557 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:43:16.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.557+0000 7f4ceca82640 1 -- 172.21.15.132:0/2307417347 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4cc806a430 msgr2=0x7f4cc806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:16.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.557+0000 7f4ceca82640 1 --2- 172.21.15.132:0/2307417347 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4cc806a430 0x7f4cc806c8f0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f4cdc036000 tx=0x7f4cdc03c040 comp rx=0 tx=0).stop 2023-12-20T04:43:16.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.557+0000 7f4ceca82640 1 -- 172.21.15.132:0/2307417347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ce80cd4b0 msgr2=0x7f4ce80af360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:16.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.557+0000 7f4ceca82640 1 --2- 172.21.15.132:0/2307417347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ce80cd4b0 0x7f4ce80af360 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f4cd800e9b0 tx=0x7f4cd800ee70 comp rx=0 tx=0).stop 2023-12-20T04:43:16.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.557+0000 7f4ceca82640 1 -- 172.21.15.132:0/2307417347 shutdown_connections 2023-12-20T04:43:16.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.557+0000 7f4ceca82640 1 --2- 172.21.15.132:0/2307417347 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4cc806a430 0x7f4cc806c8f0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.557+0000 7f4ceca82640 1 --2- 172.21.15.132:0/2307417347 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ce815d300 0x7f4ce8160ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.557+0000 7f4ceca82640 1 --2- 172.21.15.132:0/2307417347 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ce815cf20 0x7f4ce81f5680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.557+0000 7f4ceca82640 1 --2- 172.21.15.132:0/2307417347 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ce80cd4b0 0x7f4ce80af360 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.557+0000 7f4ceca82640 1 -- 172.21.15.132:0/2307417347 >> 172.21.15.132:0/2307417347 conn(0x7f4ce8072c60 msgr2=0x7f4ce8160080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:16.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.557+0000 7f4ceca82640 1 -- 172.21.15.132:0/2307417347 shutdown_connections 2023-12-20T04:43:16.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.557+0000 7f4ceca82640 1 -- 172.21.15.132:0/2307417347 wait complete. 2023-12-20T04:43:16.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:43:16.580 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:43:16.615 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:43:16.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.672+0000 7f721f638640 1 Processor -- start 2023-12-20T04:43:16.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.672+0000 7f721f638640 1 -- start start 2023-12-20T04:43:16.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.673+0000 7f721f638640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f721815d300 0x7f72180d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.673+0000 7f721f638640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72180cfea0 0x7f72180b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.673+0000 7f721f638640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72180d2920 con 0x7f72180d17d0 2023-12-20T04:43:16.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.673+0000 7f721f638640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72180d1d10 con 0x7f721815d300 2023-12-20T04:43:16.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.673+0000 7f721f638640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72180d1ff0 con 0x7f72180cfea0 2023-12-20T04:43:16.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.673+0000 7f721d3d4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f721815d300 0x7f72180d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.673+0000 7f721d3d4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f721815d300 0x7f72180d1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46208/0 (socket says 172.21.15.132:46208) 2023-12-20T04:43:16.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.673+0000 7f721d3d4640 1 -- 172.21.15.132:0/4007808950 learned_addr learned my addr 172.21.15.132:0/4007808950 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:16.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.673+0000 7f721dbd5640 1 --2- 172.21.15.132:0/4007808950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72180cfea0 0x7f72180b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.673+0000 7f721d3d4640 1 -- 172.21.15.132:0/4007808950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72180cfea0 msgr2=0x7f72180b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:16.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.673+0000 7f721d3d4640 1 --2- 172.21.15.132:0/4007808950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72180cfea0 0x7f72180b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.673+0000 7f721d3d4640 1 -- 172.21.15.132:0/4007808950 >> v1:172.21.15.187:6789/0 conn(0x7f72180d17d0 legacy=0x7f72180cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:16.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.673+0000 7f721d3d4640 1 -- 172.21.15.132:0/4007808950 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72180d22d0 con 0x7f721815d300 2023-12-20T04:43:16.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.674+0000 7f721d3d4640 1 --2- 172.21.15.132:0/4007808950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721815d300 0x7f72180d1290 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7210009e50 tx=0x7f721002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65755ec7e36f2c7b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:16.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.674+0000 7f720ffff640 1 -- 172.21.15.132:0/4007808950 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721002ca70 con 0x7f721815d300 2023-12-20T04:43:16.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.674+0000 7f720ffff640 1 -- 172.21.15.132:0/4007808950 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721002cbd0 con 0x7f721815d300 2023-12-20T04:43:16.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.674+0000 7f720ffff640 1 -- 172.21.15.132:0/4007808950 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72100343f0 con 0x7f721815d300 2023-12-20T04:43:16.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.675+0000 7f721f638640 1 -- 172.21.15.132:0/4007808950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721815d300 msgr2=0x7f72180d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:16.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.675+0000 7f721f638640 1 --2- 172.21.15.132:0/4007808950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721815d300 0x7f72180d1290 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f7210009e50 tx=0x7f721002bed0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.675+0000 7f721f638640 1 -- 172.21.15.132:0/4007808950 shutdown_connections 2023-12-20T04:43:16.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.675+0000 7f721f638640 1 --2- 172.21.15.132:0/4007808950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72180cfea0 0x7f72180b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.675+0000 7f721f638640 1 --2- 172.21.15.132:0/4007808950 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f721815d300 0x7f72180d1290 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.675+0000 7f721f638640 1 -- 172.21.15.132:0/4007808950 >> 172.21.15.132:0/4007808950 conn(0x7f721806a3d0 msgr2=0x7f721806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:16.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.675+0000 7f721f638640 1 -- 172.21.15.132:0/4007808950 shutdown_connections 2023-12-20T04:43:16.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.675+0000 7f721f638640 1 -- 172.21.15.132:0/4007808950 wait complete. 2023-12-20T04:43:16.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.676+0000 7f721f638640 1 Processor -- start 2023-12-20T04:43:16.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.676+0000 7f721f638640 1 -- start start 2023-12-20T04:43:16.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721f638640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72180cfea0 0x7f72181503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721f638640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72180d17d0 0x7f72180cc470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721f638640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f721815d300 0x7f72180cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721f638640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72180ca950 con 0x7f72180cfea0 2023-12-20T04:43:16.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721f638640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7218150920 con 0x7f72180d17d0 2023-12-20T04:43:16.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721f638640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72180caba0 con 0x7f721815d300 2023-12-20T04:43:16.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721d3d4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72180cfea0 0x7f72181503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721d3d4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72180cfea0 0x7f72181503e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46212/0 (socket says 172.21.15.132:46212) 2023-12-20T04:43:16.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721d3d4640 1 -- 172.21.15.132:0/1651339615 learned_addr learned my addr 172.21.15.132:0/1651339615 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:16.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721cbd3640 1 --2- 172.21.15.132:0/1651339615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72180d17d0 0x7f72180cc470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721dbd5640 1 --2- 172.21.15.132:0/1651339615 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f721815d300 0x7f72180cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721d3d4640 1 -- 172.21.15.132:0/1651339615 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f721815d300 msgr2=0x7f72180cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:16.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721d3d4640 1 --2- 172.21.15.132:0/1651339615 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f721815d300 0x7f72180cc9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721d3d4640 1 -- 172.21.15.132:0/1651339615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72180d17d0 msgr2=0x7f72180cc470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:16.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721d3d4640 1 --2- 172.21.15.132:0/1651339615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72180d17d0 0x7f72180cc470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721d3d4640 1 -- 172.21.15.132:0/1651339615 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7210009b30 con 0x7f72180cfea0 2023-12-20T04:43:16.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721cbd3640 1 --2- 172.21.15.132:0/1651339615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72180d17d0 0x7f72180cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:16.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721d3d4640 1 --2- 172.21.15.132:0/1651339615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72180cfea0 0x7f72181503e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7210009e50 tx=0x7f7210004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:16.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f720dffb640 1 -- 172.21.15.132:0/1651339615 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7210009510 con 0x7f72180cfea0 2023-12-20T04:43:16.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f720dffb640 1 -- 172.21.15.132:0/1651339615 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f721003e450 con 0x7f72180cfea0 2023-12-20T04:43:16.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f720dffb640 1 -- 172.21.15.132:0/1651339615 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f721003e800 con 0x7f72180cfea0 2023-12-20T04:43:16.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.677+0000 7f721f638640 1 -- 172.21.15.132:0/1651339615 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72180cae80 con 0x7f72180cfea0 2023-12-20T04:43:16.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.678+0000 7f721f638640 1 -- 172.21.15.132:0/1651339615 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72180cb440 con 0x7f72180cfea0 2023-12-20T04:43:16.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.678+0000 7f721f638640 1 -- 172.21.15.132:0/1651339615 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f721804e840 con 0x7f72180cfea0 2023-12-20T04:43:16.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.679+0000 7f720dffb640 1 -- 172.21.15.132:0/1651339615 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f721003e960 con 0x7f72180cfea0 2023-12-20T04:43:16.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.679+0000 7f720dffb640 1 --2- 172.21.15.132:0/1651339615 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71fc06a430 0x7f71fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:16.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.679+0000 7f720dffb640 1 -- 172.21.15.132:0/1651339615 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72100ab760 con 0x7f72180cfea0 2023-12-20T04:43:16.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.679+0000 7f721cbd3640 1 --2- 172.21.15.132:0/1651339615 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71fc06a430 0x7f71fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:16.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.680+0000 7f721cbd3640 1 --2- 172.21.15.132:0/1651339615 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71fc06a430 0x7f71fc06c8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f721815fdc0 tx=0x7f7208009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:16.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.683+0000 7f720dffb640 1 -- 172.21.15.132:0/1651339615 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7210076cc0 con 0x7f72180cfea0 2023-12-20T04:43:16.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.849+0000 7f721f638640 1 -- 172.21.15.132:0/1651339615 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f72181595c0 con 0x7f72180cfea0 2023-12-20T04:43:16.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.849+0000 7f720dffb640 1 -- 172.21.15.132:0/1651339615 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f721007a2e0 con 0x7f72180cfea0 2023-12-20T04:43:16.851 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:43:16.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.851+0000 7f721f638640 1 -- 172.21.15.132:0/1651339615 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71fc06a430 msgr2=0x7f71fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:16.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.851+0000 7f721f638640 1 --2- 172.21.15.132:0/1651339615 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71fc06a430 0x7f71fc06c8f0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f721815fdc0 tx=0x7f7208009040 comp rx=0 tx=0).stop 2023-12-20T04:43:16.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.851+0000 7f721f638640 1 -- 172.21.15.132:0/1651339615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72180cfea0 msgr2=0x7f72181503e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:16.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.851+0000 7f721f638640 1 --2- 172.21.15.132:0/1651339615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72180cfea0 0x7f72181503e0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f7210009e50 tx=0x7f7210004a40 comp rx=0 tx=0).stop 2023-12-20T04:43:16.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.851+0000 7f721f638640 1 -- 172.21.15.132:0/1651339615 shutdown_connections 2023-12-20T04:43:16.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.851+0000 7f721f638640 1 --2- 172.21.15.132:0/1651339615 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71fc06a430 0x7f71fc06c8f0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.851+0000 7f721f638640 1 --2- 172.21.15.132:0/1651339615 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f721815d300 0x7f72180cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.851+0000 7f721f638640 1 --2- 172.21.15.132:0/1651339615 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72180d17d0 0x7f72180cc470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.851+0000 7f721f638640 1 --2- 172.21.15.132:0/1651339615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72180cfea0 0x7f72181503e0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:16.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.851+0000 7f721f638640 1 -- 172.21.15.132:0/1651339615 >> 172.21.15.132:0/1651339615 conn(0x7f721806a3d0 msgr2=0x7f72180b7350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:16.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.851+0000 7f721f638640 1 -- 172.21.15.132:0/1651339615 shutdown_connections 2023-12-20T04:43:16.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:16.851+0000 7f721f638640 1 -- 172.21.15.132:0/1651339615 wait complete. 2023-12-20T04:43:16.864 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:43:17.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.006+0000 7f06fe42c640 1 Processor -- start 2023-12-20T04:43:17.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.006+0000 7f06fe42c640 1 -- start start 2023-12-20T04:43:17.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.007+0000 7f06fe42c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f06f815d300 0x7f06f80d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:17.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.007+0000 7f06fe42c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06f80cff90 0x7f06f80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:17.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.007+0000 7f06fe42c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06f80d1a90 con 0x7f06f80d1550 2023-12-20T04:43:17.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.007+0000 7f06fe42c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06f80d1d70 con 0x7f06f815d300 2023-12-20T04:43:17.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.007+0000 7f06fe42c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80d2050 con 0x7f06f80cff90 2023-12-20T04:43:17.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.007+0000 7f06f7fff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f06f815d300 0x7f06f80d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:17.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.007+0000 7f06f77fe640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f06f80d1550 0x7f06f80cf880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:54642/0 (socket says 172.21.15.132:54642) 2023-12-20T04:43:17.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.007+0000 7f06fc9c9640 1 --2- 172.21.15.132:0/3659269950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06f80cff90 0x7f06f80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:17.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.007+0000 7f06f77fe640 1 -- 172.21.15.132:0/3659269950 learned_addr learned my addr 172.21.15.132:0/3659269950 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:17.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.008+0000 7f06f6ffd640 1 -- 172.21.15.132:0/3659269950 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 822730652 0 0) 0x7f06f80d1a90 con 0x7f06f80d1550 2023-12-20T04:43:17.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.008+0000 7f06f6ffd640 1 -- 172.21.15.132:0/3659269950 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f06e0003520 con 0x7f06f80d1550 2023-12-20T04:43:17.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.008+0000 7f06fc9c9640 1 -- 172.21.15.132:0/3659269950 >> v2:172.21.15.187:3300/0 conn(0x7f06f815d300 msgr2=0x7f06f80d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:17.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.008+0000 7f06fc9c9640 1 --2- 172.21.15.132:0/3659269950 >> v2:172.21.15.187:3300/0 conn(0x7f06f815d300 0x7f06f80d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.008+0000 7f06fc9c9640 1 -- 172.21.15.132:0/3659269950 >> v1:172.21.15.187:6789/0 conn(0x7f06f80d1550 legacy=0x7f06f80cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:17.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.008+0000 7f06fc9c9640 1 -- 172.21.15.132:0/3659269950 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06f80d2330 con 0x7f06f80cff90 2023-12-20T04:43:17.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.008+0000 7f06f7fff640 1 --2- 172.21.15.132:0/3659269950 >> v2:172.21.15.187:3300/0 conn(0x7f06f815d300 0x7f06f80d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:43:17.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.009+0000 7f06fc9c9640 1 --2- 172.21.15.132:0/3659269950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06f80cff90 0x7f06f80b60e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009d90 tx=0x7f06f002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9515d134c25efcca server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:17.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.009+0000 7f06f6ffd640 1 -- 172.21.15.132:0/3659269950 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f002cc50 con 0x7f06f80cff90 2023-12-20T04:43:17.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.009+0000 7f06f6ffd640 1 -- 172.21.15.132:0/3659269950 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f002cdb0 con 0x7f06f80cff90 2023-12-20T04:43:17.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.009+0000 7f06f6ffd640 1 -- 172.21.15.132:0/3659269950 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f0034640 con 0x7f06f80cff90 2023-12-20T04:43:17.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.009+0000 7f06fe42c640 1 -- 172.21.15.132:0/3659269950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06f80cff90 msgr2=0x7f06f80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:17.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.009+0000 7f06fe42c640 1 --2- 172.21.15.132:0/3659269950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06f80cff90 0x7f06f80b60e0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f06f0009d90 tx=0x7f06f002bea0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.009+0000 7f06fe42c640 1 -- 172.21.15.132:0/3659269950 shutdown_connections 2023-12-20T04:43:17.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.009+0000 7f06fe42c640 1 --2- 172.21.15.132:0/3659269950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06f80cff90 0x7f06f80b60e0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.009+0000 7f06fe42c640 1 --2- 172.21.15.132:0/3659269950 >> v2:172.21.15.187:3300/0 conn(0x7f06f815d300 0x7f06f80d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.009+0000 7f06fe42c640 1 -- 172.21.15.132:0/3659269950 >> 172.21.15.132:0/3659269950 conn(0x7f06f806a3d0 msgr2=0x7f06f806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:17.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.009+0000 7f06fe42c640 1 -- 172.21.15.132:0/3659269950 shutdown_connections 2023-12-20T04:43:17.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.009+0000 7f06fe42c640 1 -- 172.21.15.132:0/3659269950 wait complete. 2023-12-20T04:43:17.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.011+0000 7f06fe42c640 1 Processor -- start 2023-12-20T04:43:17.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.011+0000 7f06fe42c640 1 -- start start 2023-12-20T04:43:17.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.011+0000 7f06fe42c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06f80cff90 0x7f06f80c84f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:17.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.011+0000 7f06fe42c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06f80d1550 0x7f06f80cc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.011+0000 7f06fe42c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06f815d300 0x7f06f814a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.011+0000 7f06fe42c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80cb540 con 0x7f06f815d300 2023-12-20T04:43:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.011+0000 7f06fe42c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06f80ca920 con 0x7f06f80d1550 2023-12-20T04:43:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.011+0000 7f06fe42c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06f81606e0 con 0x7f06f80cff90 2023-12-20T04:43:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.012+0000 7f06fc9c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06f815d300 0x7f06f814a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.012+0000 7f06fc9c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06f815d300 0x7f06f814a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46224/0 (socket says 172.21.15.132:46224) 2023-12-20T04:43:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.012+0000 7f06fc9c9640 1 -- 172.21.15.132:0/503098071 learned_addr learned my addr 172.21.15.132:0/503098071 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.012+0000 7f06f77fe640 1 --2- 172.21.15.132:0/503098071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06f80d1550 0x7f06f80cc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.012+0000 7f06f7fff640 1 --2- 172.21.15.132:0/503098071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06f80cff90 0x7f06f80c84f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.012+0000 7f06fc9c9640 1 -- 172.21.15.132:0/503098071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06f80cff90 msgr2=0x7f06f80c84f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.012+0000 7f06fc9c9640 1 --2- 172.21.15.132:0/503098071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06f80cff90 0x7f06f80c84f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.012+0000 7f06fc9c9640 1 -- 172.21.15.132:0/503098071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06f80d1550 msgr2=0x7f06f80cc7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.012+0000 7f06fc9c9640 1 --2- 172.21.15.132:0/503098071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06f80d1550 0x7f06f80cc7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.012+0000 7f06fc9c9640 1 -- 172.21.15.132:0/503098071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06e8009400 con 0x7f06f815d300 2023-12-20T04:43:17.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.012+0000 7f06fc9c9640 1 --2- 172.21.15.132:0/503098071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06f815d300 0x7f06f814a210 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f06f002c4b0 tx=0x7f06f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:17.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.012+0000 7f06f4ff9640 1 -- 172.21.15.132:0/503098071 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f003e610 con 0x7f06f815d300 2023-12-20T04:43:17.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.012+0000 7f06f4ff9640 1 -- 172.21.15.132:0/503098071 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06f003e770 con 0x7f06f815d300 2023-12-20T04:43:17.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.012+0000 7f06f4ff9640 1 -- 172.21.15.132:0/503098071 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06f003eb60 con 0x7f06f815d300 2023-12-20T04:43:17.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.012+0000 7f06fe42c640 1 -- 172.21.15.132:0/503098071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06f0009a70 con 0x7f06f815d300 2023-12-20T04:43:17.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.012+0000 7f06fe42c640 1 -- 172.21.15.132:0/503098071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06f80cae80 con 0x7f06f815d300 2023-12-20T04:43:17.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.013+0000 7f06fe42c640 1 -- 172.21.15.132:0/503098071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06f804e840 con 0x7f06f815d300 2023-12-20T04:43:17.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.014+0000 7f06f4ff9640 1 -- 172.21.15.132:0/503098071 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f06f003b050 con 0x7f06f815d300 2023-12-20T04:43:17.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.014+0000 7f06f4ff9640 1 --2- 172.21.15.132:0/503098071 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06e406a430 0x7f06e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:17.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.014+0000 7f06f4ff9640 1 -- 172.21.15.132:0/503098071 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f06f00aa930 con 0x7f06f815d300 2023-12-20T04:43:17.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.014+0000 7f06f7fff640 1 --2- 172.21.15.132:0/503098071 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06e406a430 0x7f06e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:17.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.014+0000 7f06f7fff640 1 --2- 172.21.15.132:0/503098071 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06e406a430 0x7f06e406c8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06f80c99c0 tx=0x7f06e8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:17.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.018+0000 7f06f4ff9640 1 -- 172.21.15.132:0/503098071 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f06f0076060 con 0x7f06f815d300 2023-12-20T04:43:17.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.183+0000 7f06fe42c640 1 -- 172.21.15.132:0/503098071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f06f8159ee0 con 0x7f06f815d300 2023-12-20T04:43:17.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.184+0000 7f06f4ff9640 1 -- 172.21.15.132:0/503098071 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f06f0039020 con 0x7f06f815d300 2023-12-20T04:43:17.185 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:43:17.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.185+0000 7f06fe42c640 1 -- 172.21.15.132:0/503098071 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06e406a430 msgr2=0x7f06e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:17.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.185+0000 7f06fe42c640 1 --2- 172.21.15.132:0/503098071 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06e406a430 0x7f06e406c8f0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f06f80c99c0 tx=0x7f06e8009190 comp rx=0 tx=0).stop 2023-12-20T04:43:17.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.185+0000 7f06fe42c640 1 -- 172.21.15.132:0/503098071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06f815d300 msgr2=0x7f06f814a210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:17.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.185+0000 7f06fe42c640 1 --2- 172.21.15.132:0/503098071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06f815d300 0x7f06f814a210 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f06f002c4b0 tx=0x7f06f0004a40 comp rx=0 tx=0).stop 2023-12-20T04:43:17.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.185+0000 7f06fe42c640 1 -- 172.21.15.132:0/503098071 shutdown_connections 2023-12-20T04:43:17.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.185+0000 7f06fe42c640 1 --2- 172.21.15.132:0/503098071 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06e406a430 0x7f06e406c8f0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.185+0000 7f06fe42c640 1 --2- 172.21.15.132:0/503098071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06f815d300 0x7f06f814a210 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.185+0000 7f06fe42c640 1 --2- 172.21.15.132:0/503098071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06f80d1550 0x7f06f80cc7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.185+0000 7f06fe42c640 1 --2- 172.21.15.132:0/503098071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06f80cff90 0x7f06f80c84f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.185+0000 7f06fe42c640 1 -- 172.21.15.132:0/503098071 >> 172.21.15.132:0/503098071 conn(0x7f06f806a3d0 msgr2=0x7f06f80cde00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:17.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.185+0000 7f06fe42c640 1 -- 172.21.15.132:0/503098071 shutdown_connections 2023-12-20T04:43:17.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.185+0000 7f06fe42c640 1 -- 172.21.15.132:0/503098071 wait complete. 2023-12-20T04:43:17.226 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestClusterFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-12-20T04:43:17.226 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestClusterFull) 2023-12-20T04:43:17.227 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-12-20T04:43:17.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.324+0000 7f0f71070640 1 Processor -- start 2023-12-20T04:43:17.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.325+0000 7f0f71070640 1 -- start start 2023-12-20T04:43:17.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.325+0000 7f0f71070640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0f6c15ab70 0x7f0f6c160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:17.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.325+0000 7f0f71070640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0f6c0cf280 0x7f0f6c069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:17.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.325+0000 7f0f71070640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f6c0cf730 0x7f0f6c06a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:17.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.325+0000 7f0f71070640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6c06d530 con 0x7f0f6c15ab70 2023-12-20T04:43:17.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.325+0000 7f0f71070640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f6c070540 con 0x7f0f6c0cf280 2023-12-20T04:43:17.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.325+0000 7f0f71070640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c070790 con 0x7f0f6c0cf730 2023-12-20T04:43:17.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.325+0000 7f0f6ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0f6c15ab70 0x7f0f6c160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:17.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.325+0000 7f0f6ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0f6c15ab70 0x7f0f6c160d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46226/0 (socket says 172.21.15.132:46226) 2023-12-20T04:43:17.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.325+0000 7f0f6ad9d640 1 -- 172.21.15.132:0/2769831085 learned_addr learned my addr 172.21.15.132:0/2769831085 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:17.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.326+0000 7f0f63fff640 1 --2- 172.21.15.132:0/2769831085 >> v2:172.21.15.187:3300/0 conn(0x7f0f6c0cf280 0x7f0f6c069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:17.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.326+0000 7f0f6b59e640 1 --2- 172.21.15.132:0/2769831085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f6c0cf730 0x7f0f6c06a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:17.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.326+0000 7f0f6ad9d640 1 -- 172.21.15.132:0/2769831085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f6c0cf730 msgr2=0x7f0f6c06a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:17.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.326+0000 7f0f6ad9d640 1 --2- 172.21.15.132:0/2769831085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f6c0cf730 0x7f0f6c06a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.326+0000 7f0f6ad9d640 1 -- 172.21.15.132:0/2769831085 >> v2:172.21.15.187:3300/0 conn(0x7f0f6c0cf280 msgr2=0x7f0f6c069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:17.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.326+0000 7f0f6ad9d640 1 --2- 172.21.15.132:0/2769831085 >> v2:172.21.15.187:3300/0 conn(0x7f0f6c0cf280 0x7f0f6c069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.326+0000 7f0f6ad9d640 1 -- 172.21.15.132:0/2769831085 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f6c070a70 con 0x7f0f6c15ab70 2023-12-20T04:43:17.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.326+0000 7f0f63fff640 1 --2- 172.21.15.132:0/2769831085 >> v2:172.21.15.187:3300/0 conn(0x7f0f6c0cf280 0x7f0f6c069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:17.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.326+0000 7f0f6b59e640 1 --2- 172.21.15.132:0/2769831085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f6c0cf730 0x7f0f6c06a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:17.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.326+0000 7f0f6ad9d640 1 --2- 172.21.15.132:0/2769831085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f6c15ab70 0x7f0f6c160d70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0cc440 tx=0x7f0f5c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=37312ed79f308cb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:17.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.327+0000 7f0f6a59c640 1 -- 172.21.15.132:0/2769831085 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c031870 con 0x7f0f6c15ab70 2023-12-20T04:43:17.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.327+0000 7f0f6a59c640 1 -- 172.21.15.132:0/2769831085 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f5c0319d0 con 0x7f0f6c15ab70 2023-12-20T04:43:17.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.327+0000 7f0f6a59c640 1 -- 172.21.15.132:0/2769831085 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f5c031d60 con 0x7f0f6c15ab70 2023-12-20T04:43:17.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.327+0000 7f0f71070640 1 -- 172.21.15.132:0/2769831085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f6c15ab70 msgr2=0x7f0f6c160d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:17.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.327+0000 7f0f71070640 1 --2- 172.21.15.132:0/2769831085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f6c15ab70 0x7f0f6c160d70 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c0cc440 tx=0x7f0f5c02b910 comp rx=0 tx=0).stop 2023-12-20T04:43:17.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.327+0000 7f0f71070640 1 -- 172.21.15.132:0/2769831085 shutdown_connections 2023-12-20T04:43:17.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.327+0000 7f0f71070640 1 --2- 172.21.15.132:0/2769831085 >> v2:172.21.15.187:3300/0 conn(0x7f0f6c0cf280 0x7f0f6c069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.327+0000 7f0f71070640 1 --2- 172.21.15.132:0/2769831085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f6c0cf730 0x7f0f6c06a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.327+0000 7f0f71070640 1 --2- 172.21.15.132:0/2769831085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f6c15ab70 0x7f0f6c160d70 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.327+0000 7f0f71070640 1 -- 172.21.15.132:0/2769831085 >> 172.21.15.132:0/2769831085 conn(0x7f0f6c0cfca0 msgr2=0x7f0f6c0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:17.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.327+0000 7f0f71070640 1 -- 172.21.15.132:0/2769831085 shutdown_connections 2023-12-20T04:43:17.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.327+0000 7f0f71070640 1 -- 172.21.15.132:0/2769831085 wait complete. 2023-12-20T04:43:17.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.329+0000 7f0f71070640 1 Processor -- start 2023-12-20T04:43:17.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.329+0000 7f0f71070640 1 -- start start 2023-12-20T04:43:17.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.329+0000 7f0f71070640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f6c0cf280 0x7f0f6c0ae5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:17.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.329+0000 7f0f71070640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f6c0cf730 0x7f0f6c1487e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:17.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.329+0000 7f0f71070640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f6c15ab70 0x7f0f6c15ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:17.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.329+0000 7f0f71070640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c149180 con 0x7f0f6c15ab70 2023-12-20T04:43:17.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.329+0000 7f0f71070640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c14ab60 con 0x7f0f6c0cf730 2023-12-20T04:43:17.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.329+0000 7f0f71070640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f6c0aeee0 con 0x7f0f6c0cf280 2023-12-20T04:43:17.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.329+0000 7f0f6b59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f6c15ab70 0x7f0f6c15ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:17.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.329+0000 7f0f6b59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f6c15ab70 0x7f0f6c15ffb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:46240/0 (socket says 172.21.15.132:46240) 2023-12-20T04:43:17.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.329+0000 7f0f6b59e640 1 -- 172.21.15.132:0/1876066493 learned_addr learned my addr 172.21.15.132:0/1876066493 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:17.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.330+0000 7f0f6ad9d640 1 --2- 172.21.15.132:0/1876066493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f6c0cf280 0x7f0f6c0ae5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.330+0000 7f0f6b59e640 1 -- 172.21.15.132:0/1876066493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f6c0cf280 msgr2=0x7f0f6c0ae5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.330+0000 7f0f63fff640 1 --2- 172.21.15.132:0/1876066493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f6c0cf730 0x7f0f6c1487e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.330+0000 7f0f6b59e640 1 --2- 172.21.15.132:0/1876066493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f6c0cf280 0x7f0f6c0ae5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.330+0000 7f0f6b59e640 1 -- 172.21.15.132:0/1876066493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f6c0cf730 msgr2=0x7f0f6c1487e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.330+0000 7f0f6b59e640 1 --2- 172.21.15.132:0/1876066493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f6c0cf730 0x7f0f6c1487e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.330+0000 7f0f6b59e640 1 -- 172.21.15.132:0/1876066493 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c0094d0 con 0x7f0f6c15ab70 2023-12-20T04:43:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.330+0000 7f0f6ad9d640 1 --2- 172.21.15.132:0/1876066493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f6c0cf280 0x7f0f6c0ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.330+0000 7f0f63fff640 1 --2- 172.21.15.132:0/1876066493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f6c0cf730 0x7f0f6c1487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.330+0000 7f0f6b59e640 1 --2- 172.21.15.132:0/1876066493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f6c15ab70 0x7f0f6c15ffb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400cef0 tx=0x7f0f6400a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.330+0000 7f0f637fe640 1 -- 172.21.15.132:0/1876066493 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6400d840 con 0x7f0f6c15ab70 2023-12-20T04:43:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.330+0000 7f0f637fe640 1 -- 172.21.15.132:0/1876066493 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f6400d9c0 con 0x7f0f6c15ab70 2023-12-20T04:43:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.330+0000 7f0f637fe640 1 -- 172.21.15.132:0/1876066493 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f6400dd70 con 0x7f0f6c15ab70 2023-12-20T04:43:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.330+0000 7f0f71070640 1 -- 172.21.15.132:0/1876066493 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6c0af1c0 con 0x7f0f6c15ab70 2023-12-20T04:43:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.330+0000 7f0f71070640 1 -- 172.21.15.132:0/1876066493 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6c149390 con 0x7f0f6c15ab70 2023-12-20T04:43:17.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.331+0000 7f0f71070640 1 -- 172.21.15.132:0/1876066493 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6c0737d0 con 0x7f0f6c15ab70 2023-12-20T04:43:17.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.331+0000 7f0f637fe640 1 -- 172.21.15.132:0/1876066493 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0f6401e3b0 con 0x7f0f6c15ab70 2023-12-20T04:43:17.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.332+0000 7f0f637fe640 1 --2- 172.21.15.132:0/1876066493 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f4c06a430 0x7f0f4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:17.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.332+0000 7f0f6ad9d640 1 --2- 172.21.15.132:0/1876066493 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f4c06a430 0x7f0f4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:17.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.332+0000 7f0f637fe640 1 -- 172.21.15.132:0/1876066493 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f64089350 con 0x7f0f6c15ab70 2023-12-20T04:43:17.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.332+0000 7f0f6ad9d640 1 --2- 172.21.15.132:0/1876066493 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f4c06a430 0x7f0f4c06c8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c036000 tx=0x7f0f5c03c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:17.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.336+0000 7f0f637fe640 1 -- 172.21.15.132:0/1876066493 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0f6c0737d0 con 0x7f0f6c15ab70 2023-12-20T04:43:17.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.566+0000 7f0f71070640 1 -- 172.21.15.132:0/1876066493 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f0f6c0737d0 con 0x7f0f6c15ab70 2023-12-20T04:43:17.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.942+0000 7f0f637fe640 1 -- 172.21.15.132:0/1876066493 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v47) v1 ==== 133+0+0 (secure 0 0 0) 0x7f0f6c0737d0 con 0x7f0f6c15ab70 2023-12-20T04:43:17.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.944+0000 7f0f71070640 1 -- 172.21.15.132:0/1876066493 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f4c06a430 msgr2=0x7f0f4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:17.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.944+0000 7f0f71070640 1 --2- 172.21.15.132:0/1876066493 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f4c06a430 0x7f0f4c06c8f0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f0f5c036000 tx=0x7f0f5c03c040 comp rx=0 tx=0).stop 2023-12-20T04:43:17.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.944+0000 7f0f71070640 1 -- 172.21.15.132:0/1876066493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f6c15ab70 msgr2=0x7f0f6c15ffb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:17.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.944+0000 7f0f71070640 1 --2- 172.21.15.132:0/1876066493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f6c15ab70 0x7f0f6c15ffb0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f0f6400cef0 tx=0x7f0f6400a710 comp rx=0 tx=0).stop 2023-12-20T04:43:17.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.944+0000 7f0f71070640 1 -- 172.21.15.132:0/1876066493 shutdown_connections 2023-12-20T04:43:17.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.944+0000 7f0f71070640 1 --2- 172.21.15.132:0/1876066493 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f4c06a430 0x7f0f4c06c8f0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.944+0000 7f0f71070640 1 --2- 172.21.15.132:0/1876066493 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f6c15ab70 0x7f0f6c15ffb0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.944+0000 7f0f71070640 1 --2- 172.21.15.132:0/1876066493 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f6c0cf730 0x7f0f6c1487e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.944+0000 7f0f71070640 1 --2- 172.21.15.132:0/1876066493 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f6c0cf280 0x7f0f6c0ae5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:17.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.944+0000 7f0f71070640 1 -- 172.21.15.132:0/1876066493 >> 172.21.15.132:0/1876066493 conn(0x7f0f6c0cfca0 msgr2=0x7f0f6c0b0e70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:17.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.944+0000 7f0f71070640 1 -- 172.21.15.132:0/1876066493 shutdown_connections 2023-12-20T04:43:17.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:17.944+0000 7f0f71070640 1 -- 172.21.15.132:0/1876066493 wait complete. 2023-12-20T04:43:17.957 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-20T04:43:18.070 INFO:teuthology.orchestra.run.smithi132.stdout:{"osd_objectstore":"memstore"} 2023-12-20T04:43:18.070 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-20T04:43:18.070 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-20T04:43:18.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.171+0000 7f0ffd284640 1 Processor -- start 2023-12-20T04:43:18.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.171+0000 7f0ffd284640 1 -- start start 2023-12-20T04:43:18.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.172+0000 7f0ffd284640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0ff81447b0 0x7f0ff80c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.172+0000 7f0ffd284640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff80c4f40 con 0x7f0ff806a340 2023-12-20T04:43:18.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.172+0000 7f0ffd284640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff8144b90 con 0x7f0ff80ca170 2023-12-20T04:43:18.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.172+0000 7f0ffd284640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ff80cac30 con 0x7f0ff81447b0 2023-12-20T04:43:18.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.172+0000 7f0ff6ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0ff81447b0 0x7f0ff80c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:18.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.172+0000 7f0ff6ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0ff81447b0 0x7f0ff80c5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35546/0 (socket says 172.21.15.132:35546) 2023-12-20T04:43:18.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.172+0000 7f0ff6ffd640 1 -- 172.21.15.132:0/4114188797 learned_addr learned my addr 172.21.15.132:0/4114188797 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:18.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.172+0000 7f0ff77fe640 1 --1- 172.21.15.132:0/4114188797 >> v1:172.21.15.132:6789/0 conn(0x7f0ff806a340 0x7f0ff806c610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60060/0 (socket says 172.21.15.132:60060) 2023-12-20T04:43:18.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.172+0000 7f0ff6ffd640 1 -- 172.21.15.132:0/4114188797 >> v1:172.21.15.187:6789/0 conn(0x7f0ff80ca170 legacy=0x7f0ff8069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:18.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.172+0000 7f0ff6ffd640 1 -- 172.21.15.132:0/4114188797 >> v1:172.21.15.132:6789/0 conn(0x7f0ff806a340 legacy=0x7f0ff806c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:18.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.172+0000 7f0ff6ffd640 1 -- 172.21.15.132:0/4114188797 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff80c5190 con 0x7f0ff81447b0 2023-12-20T04:43:18.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.172+0000 7f0ff5ffb640 1 -- 172.21.15.132:0/4114188797 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1565611546 0 0) 0x7f0ff80c4f40 con 0x7f0ff806a340 2023-12-20T04:43:18.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.173+0000 7f0ff6ffd640 1 --2- 172.21.15.132:0/4114188797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff81447b0 0x7f0ff80c5c70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009e50 tx=0x7f0fe802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55adc481afcab210 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:18.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.173+0000 7f0ff5ffb640 1 -- 172.21.15.132:0/4114188797 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe802ca80 con 0x7f0ff81447b0 2023-12-20T04:43:18.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.173+0000 7f0ff5ffb640 1 -- 172.21.15.132:0/4114188797 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fe802cbe0 con 0x7f0ff81447b0 2023-12-20T04:43:18.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.173+0000 7f0ff5ffb640 1 -- 172.21.15.132:0/4114188797 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fe80343f0 con 0x7f0ff81447b0 2023-12-20T04:43:18.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.174+0000 7f0ffd284640 1 -- 172.21.15.132:0/4114188797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff81447b0 msgr2=0x7f0ff80c5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:18.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.174+0000 7f0ffd284640 1 --2- 172.21.15.132:0/4114188797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff81447b0 0x7f0ff80c5c70 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8009e50 tx=0x7f0fe802bee0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.174+0000 7f0ffd284640 1 -- 172.21.15.132:0/4114188797 shutdown_connections 2023-12-20T04:43:18.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.174+0000 7f0ffd284640 1 --2- 172.21.15.132:0/4114188797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff81447b0 0x7f0ff80c5c70 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.174+0000 7f0ffd284640 1 -- 172.21.15.132:0/4114188797 >> 172.21.15.132:0/4114188797 conn(0x7f0ff80cc630 msgr2=0x7f0ff80cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:18.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.174+0000 7f0ffd284640 1 -- 172.21.15.132:0/4114188797 shutdown_connections 2023-12-20T04:43:18.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.174+0000 7f0ffd284640 1 -- 172.21.15.132:0/4114188797 wait complete. 2023-12-20T04:43:18.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.175+0000 7f0ffd284640 1 Processor -- start 2023-12-20T04:43:18.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.175+0000 7f0ffd284640 1 -- start start 2023-12-20T04:43:18.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0ffd284640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff806a340 0x7f0ff8132360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0ffd284640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff80ca170 0x7f0ff81f2240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0ffd284640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ff81447b0 0x7f0ff80afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0ffd284640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8132bb0 con 0x7f0ff80ca170 2023-12-20T04:43:18.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0ffd284640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8132e90 con 0x7f0ff81447b0 2023-12-20T04:43:18.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0ffd284640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff8133170 con 0x7f0ff806a340 2023-12-20T04:43:18.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0ff67fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff80ca170 0x7f0ff81f2240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:18.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0ff67fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff80ca170 0x7f0ff81f2240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35556/0 (socket says 172.21.15.132:35556) 2023-12-20T04:43:18.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0ff67fc640 1 -- 172.21.15.132:0/2612891908 learned_addr learned my addr 172.21.15.132:0/2612891908 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:18.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0ff6ffd640 1 --2- 172.21.15.132:0/2612891908 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff806a340 0x7f0ff8132360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:18.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0ff77fe640 1 --2- 172.21.15.132:0/2612891908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ff81447b0 0x7f0ff80afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:18.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0ff67fc640 1 -- 172.21.15.132:0/2612891908 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff806a340 msgr2=0x7f0ff8132360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:18.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0ff67fc640 1 --2- 172.21.15.132:0/2612891908 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff806a340 0x7f0ff8132360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0ff67fc640 1 -- 172.21.15.132:0/2612891908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ff81447b0 msgr2=0x7f0ff80afb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:18.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0ff67fc640 1 --2- 172.21.15.132:0/2612891908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ff81447b0 0x7f0ff80afb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0ff67fc640 1 -- 172.21.15.132:0/2612891908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe8009b30 con 0x7f0ff80ca170 2023-12-20T04:43:18.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0ff67fc640 1 --2- 172.21.15.132:0/2612891908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff80ca170 0x7f0ff81f2240 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0fec00c410 tx=0x7f0fec00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:18.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.176+0000 7f0fdf7fe640 1 -- 172.21.15.132:0/2612891908 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec0035f0 con 0x7f0ff80ca170 2023-12-20T04:43:18.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.177+0000 7f0fdf7fe640 1 -- 172.21.15.132:0/2612891908 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fec003750 con 0x7f0ff80ca170 2023-12-20T04:43:18.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.177+0000 7f0ffd284640 1 -- 172.21.15.132:0/2612891908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff815cac0 con 0x7f0ff80ca170 2023-12-20T04:43:18.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.177+0000 7f0fdf7fe640 1 -- 172.21.15.132:0/2612891908 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fec003b40 con 0x7f0ff80ca170 2023-12-20T04:43:18.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.177+0000 7f0ffd284640 1 -- 172.21.15.132:0/2612891908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff81f2780 con 0x7f0ff80ca170 2023-12-20T04:43:18.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.178+0000 7f0ffd284640 1 -- 172.21.15.132:0/2612891908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff815cd00 con 0x7f0ff80ca170 2023-12-20T04:43:18.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.178+0000 7f0fdf7fe640 1 -- 172.21.15.132:0/2612891908 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0fec003ca0 con 0x7f0ff80ca170 2023-12-20T04:43:18.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.178+0000 7f0fdf7fe640 1 --2- 172.21.15.132:0/2612891908 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fe406a430 0x7f0fe406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.178+0000 7f0fdf7fe640 1 -- 172.21.15.132:0/2612891908 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fec087b50 con 0x7f0ff80ca170 2023-12-20T04:43:18.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.178+0000 7f0ff6ffd640 1 --2- 172.21.15.132:0/2612891908 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fe406a430 0x7f0fe406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:18.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.179+0000 7f0ff6ffd640 1 --2- 172.21.15.132:0/2612891908 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fe406a430 0x7f0fe406c8f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8035000 tx=0x7f0fe8030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:18.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.183+0000 7f0fdf7fe640 1 -- 172.21.15.132:0/2612891908 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0ff815cd00 con 0x7f0ff80ca170 2023-12-20T04:43:18.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.349+0000 7f0ffd284640 1 -- 172.21.15.132:0/2612891908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f0ff815cd00 con 0x7f0ff80ca170 2023-12-20T04:43:18.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.354+0000 7f0fdf7fe640 1 -- 172.21.15.132:0/2612891908 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v2)=0 v2) v1 ==== 122+0+0 (secure 0 0 0) 0x7f0ff815cd00 con 0x7f0ff80ca170 2023-12-20T04:43:18.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.357+0000 7f0ffd284640 1 -- 172.21.15.132:0/2612891908 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fe406a430 msgr2=0x7f0fe406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:18.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.357+0000 7f0ffd284640 1 --2- 172.21.15.132:0/2612891908 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fe406a430 0x7f0fe406c8f0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f0fe8035000 tx=0x7f0fe8030000 comp rx=0 tx=0).stop 2023-12-20T04:43:18.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.357+0000 7f0ffd284640 1 -- 172.21.15.132:0/2612891908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff80ca170 msgr2=0x7f0ff81f2240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:18.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.357+0000 7f0ffd284640 1 --2- 172.21.15.132:0/2612891908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff80ca170 0x7f0ff81f2240 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f0fec00c410 tx=0x7f0fec00c8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.357+0000 7f0ffd284640 1 -- 172.21.15.132:0/2612891908 shutdown_connections 2023-12-20T04:43:18.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.357+0000 7f0ffd284640 1 --2- 172.21.15.132:0/2612891908 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fe406a430 0x7f0fe406c8f0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.357+0000 7f0ffd284640 1 --2- 172.21.15.132:0/2612891908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ff81447b0 0x7f0ff80afb30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.357+0000 7f0ffd284640 1 --2- 172.21.15.132:0/2612891908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff80ca170 0x7f0ff81f2240 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.357+0000 7f0ffd284640 1 --2- 172.21.15.132:0/2612891908 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff806a340 0x7f0ff8132360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.357+0000 7f0ffd284640 1 -- 172.21.15.132:0/2612891908 >> 172.21.15.132:0/2612891908 conn(0x7f0ff80cc630 msgr2=0x7f0ff8069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:18.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.357+0000 7f0ffd284640 1 -- 172.21.15.132:0/2612891908 shutdown_connections 2023-12-20T04:43:18.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.357+0000 7f0ffd284640 1 -- 172.21.15.132:0/2612891908 wait complete. 2023-12-20T04:43:18.369 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:43:18.370 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:43:18.414 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:43:18.457 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:43:18.457 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:43:18.458 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:43:18.473 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:43:18.473 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:43:18.529 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:18.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.666+0000 7fcb8631b640 1 Processor -- start 2023-12-20T04:43:18.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.666+0000 7fcb8631b640 1 -- start start 2023-12-20T04:43:18.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.667+0000 7fcb8631b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcb800b4980 0x7fcb800b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.667+0000 7fcb8631b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb800d1aa0 0x7fcb800d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.667+0000 7fcb8631b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb800b5320 con 0x7fcb80160450 2023-12-20T04:43:18.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.667+0000 7fcb8631b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb800b5ec0 con 0x7fcb800b4980 2023-12-20T04:43:18.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.667+0000 7fcb8631b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb801617e0 con 0x7fcb800d1aa0 2023-12-20T04:43:18.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.667+0000 7fcb7f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcb800b4980 0x7fcb800b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:18.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.667+0000 7fcb7f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcb800b4980 0x7fcb800b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35564/0 (socket says 172.21.15.132:35564) 2023-12-20T04:43:18.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.667+0000 7fcb7f7fe640 1 -- 172.21.15.132:0/1319100148 learned_addr learned my addr 172.21.15.132:0/1319100148 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:18.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.667+0000 7fcb848b8640 1 --2- 172.21.15.132:0/1319100148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb800d1aa0 0x7fcb800d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:18.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.667+0000 7fcb7f7fe640 1 -- 172.21.15.132:0/1319100148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb800d1aa0 msgr2=0x7fcb800d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:18.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.667+0000 7fcb7f7fe640 1 --2- 172.21.15.132:0/1319100148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb800d1aa0 0x7fcb800d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.667+0000 7fcb7f7fe640 1 -- 172.21.15.132:0/1319100148 >> v1:172.21.15.187:6789/0 conn(0x7fcb80160450 legacy=0x7fcb80160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:18.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.667+0000 7fcb7f7fe640 1 -- 172.21.15.132:0/1319100148 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb800d0fc0 con 0x7fcb800b4980 2023-12-20T04:43:18.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.668+0000 7fcb7f7fe640 1 --2- 172.21.15.132:0/1319100148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb800b4980 0x7fcb800b4de0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009870 tx=0x7fcb7402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c0e27d65a7bac87 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:18.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.668+0000 7fcb7effd640 1 -- 172.21.15.132:0/1319100148 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7402f840 con 0x7fcb800b4980 2023-12-20T04:43:18.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.668+0000 7fcb7effd640 1 -- 172.21.15.132:0/1319100148 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb7402f9a0 con 0x7fcb800b4980 2023-12-20T04:43:18.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.668+0000 7fcb7effd640 1 -- 172.21.15.132:0/1319100148 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb7402fd30 con 0x7fcb800b4980 2023-12-20T04:43:18.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.668+0000 7fcb8631b640 1 -- 172.21.15.132:0/1319100148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb800b4980 msgr2=0x7fcb800b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:18.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.668+0000 7fcb8631b640 1 --2- 172.21.15.132:0/1319100148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb800b4980 0x7fcb800b4de0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fcb74009870 tx=0x7fcb7402ba20 comp rx=0 tx=0).stop 2023-12-20T04:43:18.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.668+0000 7fcb8631b640 1 -- 172.21.15.132:0/1319100148 shutdown_connections 2023-12-20T04:43:18.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.668+0000 7fcb8631b640 1 --2- 172.21.15.132:0/1319100148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb800d1aa0 0x7fcb800d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.668+0000 7fcb8631b640 1 --2- 172.21.15.132:0/1319100148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb800b4980 0x7fcb800b4de0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.668+0000 7fcb8631b640 1 -- 172.21.15.132:0/1319100148 >> 172.21.15.132:0/1319100148 conn(0x7fcb800cf980 msgr2=0x7fcb800cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:18.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.669+0000 7fcb8631b640 1 -- 172.21.15.132:0/1319100148 shutdown_connections 2023-12-20T04:43:18.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.669+0000 7fcb8631b640 1 -- 172.21.15.132:0/1319100148 wait complete. 2023-12-20T04:43:18.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.670+0000 7fcb8631b640 1 Processor -- start 2023-12-20T04:43:18.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.670+0000 7fcb8631b640 1 -- start start 2023-12-20T04:43:18.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.670+0000 7fcb8631b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb800b4980 0x7fcb8015c600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.670+0000 7fcb8631b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb800d1aa0 0x7fcb800c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.670+0000 7fcb8631b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb80160450 0x7fcb800cb9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.670+0000 7fcb8631b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb801f6530 con 0x7fcb800b4980 2023-12-20T04:43:18.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.670+0000 7fcb8631b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb801f6810 con 0x7fcb800d1aa0 2023-12-20T04:43:18.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.670+0000 7fcb8631b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb801f6af0 con 0x7fcb80160450 2023-12-20T04:43:18.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.671+0000 7fcb7ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb800b4980 0x7fcb8015c600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:18.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.671+0000 7fcb7ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb800b4980 0x7fcb8015c600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35566/0 (socket says 172.21.15.132:35566) 2023-12-20T04:43:18.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.671+0000 7fcb7ffff640 1 -- 172.21.15.132:0/1200506505 learned_addr learned my addr 172.21.15.132:0/1200506505 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:18.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.671+0000 7fcb848b8640 1 --2- 172.21.15.132:0/1200506505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb80160450 0x7fcb800cb9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:18.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.671+0000 7fcb7f7fe640 1 --2- 172.21.15.132:0/1200506505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb800d1aa0 0x7fcb800c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:18.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.671+0000 7fcb7ffff640 1 -- 172.21.15.132:0/1200506505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb80160450 msgr2=0x7fcb800cb9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:18.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.671+0000 7fcb7ffff640 1 --2- 172.21.15.132:0/1200506505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb80160450 0x7fcb800cb9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.671+0000 7fcb7ffff640 1 -- 172.21.15.132:0/1200506505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb800d1aa0 msgr2=0x7fcb800c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:18.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.671+0000 7fcb7ffff640 1 --2- 172.21.15.132:0/1200506505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb800d1aa0 0x7fcb800c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.671+0000 7fcb7ffff640 1 -- 172.21.15.132:0/1200506505 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb740094d0 con 0x7fcb800b4980 2023-12-20T04:43:18.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.671+0000 7fcb7f7fe640 1 --2- 172.21.15.132:0/1200506505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb800d1aa0 0x7fcb800c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:18.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.671+0000 7fcb7ffff640 1 --2- 172.21.15.132:0/1200506505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb800b4980 0x7fcb8015c600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000c390 tx=0x7fcb7000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:18.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.671+0000 7fcb7cff9640 1 -- 172.21.15.132:0/1200506505 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb700052d0 con 0x7fcb800b4980 2023-12-20T04:43:18.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.671+0000 7fcb7cff9640 1 -- 172.21.15.132:0/1200506505 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb70005430 con 0x7fcb800b4980 2023-12-20T04:43:18.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.671+0000 7fcb8631b640 1 -- 172.21.15.132:0/1200506505 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb801f6dd0 con 0x7fcb800b4980 2023-12-20T04:43:18.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.671+0000 7fcb7cff9640 1 -- 172.21.15.132:0/1200506505 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb70003830 con 0x7fcb800b4980 2023-12-20T04:43:18.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.671+0000 7fcb8631b640 1 -- 172.21.15.132:0/1200506505 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb801f6200 con 0x7fcb800b4980 2023-12-20T04:43:18.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.672+0000 7fcb8631b640 1 -- 172.21.15.132:0/1200506505 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb8004e840 con 0x7fcb800b4980 2023-12-20T04:43:18.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.673+0000 7fcb7cff9640 1 -- 172.21.15.132:0/1200506505 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcb70003990 con 0x7fcb800b4980 2023-12-20T04:43:18.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.673+0000 7fcb7cff9640 1 --2- 172.21.15.132:0/1200506505 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcb6c06a460 0x7fcb6c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.673+0000 7fcb7f7fe640 1 --2- 172.21.15.132:0/1200506505 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcb6c06a460 0x7fcb6c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:18.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.673+0000 7fcb7cff9640 1 -- 172.21.15.132:0/1200506505 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb70087da0 con 0x7fcb800b4980 2023-12-20T04:43:18.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.674+0000 7fcb7f7fe640 1 --2- 172.21.15.132:0/1200506505 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcb6c06a460 0x7fcb6c06c920 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcb74036000 tx=0x7fcb74008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:18.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.677+0000 7fcb7cff9640 1 -- 172.21.15.132:0/1200506505 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcb70053440 con 0x7fcb800b4980 2023-12-20T04:43:18.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.845+0000 7fcb8631b640 1 -- 172.21.15.132:0/1200506505 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb801f2c80 con 0x7fcb800b4980 2023-12-20T04:43:18.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.846+0000 7fcb7cff9640 1 -- 172.21.15.132:0/1200506505 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fcb70056a60 con 0x7fcb800b4980 2023-12-20T04:43:18.847 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:18.848 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:18.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.848+0000 7fcb8631b640 1 -- 172.21.15.132:0/1200506505 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcb6c06a460 msgr2=0x7fcb6c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:18.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.848+0000 7fcb8631b640 1 --2- 172.21.15.132:0/1200506505 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcb6c06a460 0x7fcb6c06c920 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fcb74036000 tx=0x7fcb74008030 comp rx=0 tx=0).stop 2023-12-20T04:43:18.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.848+0000 7fcb8631b640 1 -- 172.21.15.132:0/1200506505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb800b4980 msgr2=0x7fcb8015c600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:18.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.848+0000 7fcb8631b640 1 --2- 172.21.15.132:0/1200506505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb800b4980 0x7fcb8015c600 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7fcb7000c390 tx=0x7fcb7000c850 comp rx=0 tx=0).stop 2023-12-20T04:43:18.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.848+0000 7fcb8631b640 1 -- 172.21.15.132:0/1200506505 shutdown_connections 2023-12-20T04:43:18.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.848+0000 7fcb8631b640 1 --2- 172.21.15.132:0/1200506505 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcb6c06a460 0x7fcb6c06c920 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.848+0000 7fcb8631b640 1 --2- 172.21.15.132:0/1200506505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb80160450 0x7fcb800cb9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.848+0000 7fcb8631b640 1 --2- 172.21.15.132:0/1200506505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb800d1aa0 0x7fcb800c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.848+0000 7fcb8631b640 1 --2- 172.21.15.132:0/1200506505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb800b4980 0x7fcb8015c600 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.848+0000 7fcb8631b640 1 -- 172.21.15.132:0/1200506505 >> 172.21.15.132:0/1200506505 conn(0x7fcb800cf980 msgr2=0x7fcb800b6440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:18.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.848+0000 7fcb8631b640 1 -- 172.21.15.132:0/1200506505 shutdown_connections 2023-12-20T04:43:18.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.848+0000 7fcb8631b640 1 -- 172.21.15.132:0/1200506505 wait complete. 2023-12-20T04:43:18.861 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:42:45.433456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:42:46.128920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:43:18.862 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:43:18.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.964+0000 7f73e53e7640 1 Processor -- start 2023-12-20T04:43:18.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.964+0000 7f73e53e7640 1 -- start start 2023-12-20T04:43:18.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.965+0000 7f73e53e7640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f73e0069c30 0x7f73e0070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.965+0000 7f73e53e7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e015d360 0x7f73e006a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.965+0000 7f73e53e7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f73e00cbde0 0x7f73e00ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.965+0000 7f73e53e7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e00c4f40 con 0x7f73e00cbde0 2023-12-20T04:43:18.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.965+0000 7f73e53e7640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73e00af5b0 con 0x7f73e0069c30 2023-12-20T04:43:18.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.965+0000 7f73e53e7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e006a550 con 0x7f73e015d360 2023-12-20T04:43:18.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.965+0000 7f73df7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f73e00cbde0 0x7f73e00ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:18.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.965+0000 7f73df7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f73e00cbde0 0x7f73e00ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35572/0 (socket says 172.21.15.132:35572) 2023-12-20T04:43:18.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.965+0000 7f73df7fe640 1 -- 172.21.15.132:0/1882676433 learned_addr learned my addr 172.21.15.132:0/1882676433 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:18.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.965+0000 7f73deffd640 1 --2- 172.21.15.132:0/1882676433 >> v2:172.21.15.187:3300/0 conn(0x7f73e0069c30 0x7f73e0070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:18.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.965+0000 7f73de7fc640 1 --2- 172.21.15.132:0/1882676433 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e015d360 0x7f73e006a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:18.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.965+0000 7f73df7fe640 1 -- 172.21.15.132:0/1882676433 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e015d360 msgr2=0x7f73e006a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:18.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.965+0000 7f73df7fe640 1 --2- 172.21.15.132:0/1882676433 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e015d360 0x7f73e006a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.965+0000 7f73df7fe640 1 -- 172.21.15.132:0/1882676433 >> v2:172.21.15.187:3300/0 conn(0x7f73e0069c30 msgr2=0x7f73e0070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:18.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.965+0000 7f73df7fe640 1 --2- 172.21.15.132:0/1882676433 >> v2:172.21.15.187:3300/0 conn(0x7f73e0069c30 0x7f73e0070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.965+0000 7f73df7fe640 1 -- 172.21.15.132:0/1882676433 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e0070a40 con 0x7f73e00cbde0 2023-12-20T04:43:18.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.966+0000 7f73df7fe640 1 --2- 172.21.15.132:0/1882676433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e00cbde0 0x7f73e00ca170 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f73e0071870 tx=0x7f73d802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7041f8b2b556f67d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:18.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.966+0000 7f73ddffb640 1 -- 172.21.15.132:0/1882676433 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d802ca70 con 0x7f73e00cbde0 2023-12-20T04:43:18.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.966+0000 7f73ddffb640 1 -- 172.21.15.132:0/1882676433 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d802cbd0 con 0x7f73e00cbde0 2023-12-20T04:43:18.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.966+0000 7f73ddffb640 1 -- 172.21.15.132:0/1882676433 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d80343f0 con 0x7f73e00cbde0 2023-12-20T04:43:18.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.967+0000 7f73e53e7640 1 -- 172.21.15.132:0/1882676433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e00cbde0 msgr2=0x7f73e00ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:18.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.967+0000 7f73e53e7640 1 --2- 172.21.15.132:0/1882676433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e00cbde0 0x7f73e00ca170 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f73e0071870 tx=0x7f73d802bed0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.967+0000 7f73e53e7640 1 -- 172.21.15.132:0/1882676433 shutdown_connections 2023-12-20T04:43:18.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.967+0000 7f73e53e7640 1 --2- 172.21.15.132:0/1882676433 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e00cbde0 0x7f73e00ca170 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.967+0000 7f73e53e7640 1 --2- 172.21.15.132:0/1882676433 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e015d360 0x7f73e006a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.967+0000 7f73e53e7640 1 --2- 172.21.15.132:0/1882676433 >> v2:172.21.15.187:3300/0 conn(0x7f73e0069c30 0x7f73e0070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.967+0000 7f73e53e7640 1 -- 172.21.15.132:0/1882676433 >> 172.21.15.132:0/1882676433 conn(0x7f73e00cc630 msgr2=0x7f73e00cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:18.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.967+0000 7f73e53e7640 1 -- 172.21.15.132:0/1882676433 shutdown_connections 2023-12-20T04:43:18.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.967+0000 7f73e53e7640 1 -- 172.21.15.132:0/1882676433 wait complete. 2023-12-20T04:43:18.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.968+0000 7f73e53e7640 1 Processor -- start 2023-12-20T04:43:18.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.968+0000 7f73e53e7640 1 -- start start 2023-12-20T04:43:18.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.969+0000 7f73e53e7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73e0069c30 0x7f73e01516d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.969+0000 7f73e53e7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e00cbde0 0x7f73e0159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.969+0000 7f73e53e7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e015d360 0x7f73e015a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.969+0000 7f73e53e7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e006d310 con 0x7f73e00cbde0 2023-12-20T04:43:18.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.969+0000 7f73e53e7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73e006c690 con 0x7f73e0069c30 2023-12-20T04:43:18.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.969+0000 7f73e53e7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73e006c970 con 0x7f73e015d360 2023-12-20T04:43:18.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.969+0000 7f73de7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e00cbde0 0x7f73e0159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:18.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.969+0000 7f73de7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e00cbde0 0x7f73e0159eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35580/0 (socket says 172.21.15.132:35580) 2023-12-20T04:43:18.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.969+0000 7f73de7fc640 1 -- 172.21.15.132:0/4129807981 learned_addr learned my addr 172.21.15.132:0/4129807981 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:18.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.969+0000 7f73de7fc640 1 -- 172.21.15.132:0/4129807981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e015d360 msgr2=0x7f73e015a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:18.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.969+0000 7f73de7fc640 1 --2- 172.21.15.132:0/4129807981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e015d360 0x7f73e015a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.969+0000 7f73de7fc640 1 -- 172.21.15.132:0/4129807981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73e0069c30 msgr2=0x7f73e01516d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:18.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.969+0000 7f73de7fc640 1 --2- 172.21.15.132:0/4129807981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73e0069c30 0x7f73e01516d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:18.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.969+0000 7f73de7fc640 1 -- 172.21.15.132:0/4129807981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73d8009b30 con 0x7f73e00cbde0 2023-12-20T04:43:18.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.969+0000 7f73de7fc640 1 --2- 172.21.15.132:0/4129807981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e00cbde0 0x7f73e0159eb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f73d400d800 tx=0x7f73d400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:18.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.970+0000 7f73c77fe640 1 -- 172.21.15.132:0/4129807981 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d400b6c0 con 0x7f73e00cbde0 2023-12-20T04:43:18.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.970+0000 7f73c77fe640 1 -- 172.21.15.132:0/4129807981 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73d400b820 con 0x7f73e00cbde0 2023-12-20T04:43:18.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.970+0000 7f73c77fe640 1 -- 172.21.15.132:0/4129807981 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73d400bbb0 con 0x7f73e00cbde0 2023-12-20T04:43:18.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.970+0000 7f73e53e7640 1 -- 172.21.15.132:0/4129807981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73e006cc50 con 0x7f73e00cbde0 2023-12-20T04:43:18.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.970+0000 7f73e53e7640 1 -- 172.21.15.132:0/4129807981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73e0151c10 con 0x7f73e00cbde0 2023-12-20T04:43:18.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.971+0000 7f73e53e7640 1 -- 172.21.15.132:0/4129807981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73e004e840 con 0x7f73e00cbde0 2023-12-20T04:43:18.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.971+0000 7f73c77fe640 1 -- 172.21.15.132:0/4129807981 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f73d400bd10 con 0x7f73e00cbde0 2023-12-20T04:43:18.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.971+0000 7f73c77fe640 1 --2- 172.21.15.132:0/4129807981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73cc06a430 0x7f73cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:18.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.971+0000 7f73c77fe640 1 -- 172.21.15.132:0/4129807981 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f73d4088da0 con 0x7f73e00cbde0 2023-12-20T04:43:18.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.972+0000 7f73deffd640 1 --2- 172.21.15.132:0/4129807981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73cc06a430 0x7f73cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:18.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.972+0000 7f73deffd640 1 --2- 172.21.15.132:0/4129807981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73cc06a430 0x7f73cc06c8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f73d0006fd0 tx=0x7f73d0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:18.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:18.976+0000 7f73c77fe640 1 -- 172.21.15.132:0/4129807981 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f73d4054390 con 0x7f73e00cbde0 2023-12-20T04:43:19.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.141+0000 7f73e53e7640 1 -- 172.21.15.132:0/4129807981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f73e006a9a0 con 0x7f73e00cbde0 2023-12-20T04:43:19.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.141+0000 7f73c77fe640 1 -- 172.21.15.132:0/4129807981 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73d40579b0 con 0x7f73e00cbde0 2023-12-20T04:43:19.143 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:43:19.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.143+0000 7f73e53e7640 1 -- 172.21.15.132:0/4129807981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73cc06a430 msgr2=0x7f73cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:19.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.143+0000 7f73e53e7640 1 --2- 172.21.15.132:0/4129807981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73cc06a430 0x7f73cc06c8f0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f73d0006fd0 tx=0x7f73d0008040 comp rx=0 tx=0).stop 2023-12-20T04:43:19.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.143+0000 7f73e53e7640 1 -- 172.21.15.132:0/4129807981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e00cbde0 msgr2=0x7f73e0159eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:19.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.143+0000 7f73e53e7640 1 --2- 172.21.15.132:0/4129807981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e00cbde0 0x7f73e0159eb0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f73d400d800 tx=0x7f73d400dcc0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.143+0000 7f73e53e7640 1 -- 172.21.15.132:0/4129807981 shutdown_connections 2023-12-20T04:43:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.143+0000 7f73e53e7640 1 --2- 172.21.15.132:0/4129807981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73cc06a430 0x7f73cc06c8f0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.143+0000 7f73e53e7640 1 --2- 172.21.15.132:0/4129807981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73e015d360 0x7f73e015a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.143+0000 7f73e53e7640 1 --2- 172.21.15.132:0/4129807981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73e00cbde0 0x7f73e0159eb0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.143+0000 7f73e53e7640 1 --2- 172.21.15.132:0/4129807981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73e0069c30 0x7f73e01516d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.143+0000 7f73e53e7640 1 -- 172.21.15.132:0/4129807981 >> 172.21.15.132:0/4129807981 conn(0x7f73e00cc630 msgr2=0x7f73e015c930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.143+0000 7f73e53e7640 1 -- 172.21.15.132:0/4129807981 shutdown_connections 2023-12-20T04:43:19.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.143+0000 7f73e53e7640 1 -- 172.21.15.132:0/4129807981 wait complete. 2023-12-20T04:43:19.156 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:43:19.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.256+0000 7f1bac155640 1 Processor -- start 2023-12-20T04:43:19.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.257+0000 7f1bac155640 1 -- start start 2023-12-20T04:43:19.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.257+0000 7f1bac155640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1ba4069c30 0x7f1ba4070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.257+0000 7f1bac155640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1ba40cbde0 0x7f1ba40ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.257+0000 7f1bac155640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1ba40c4f40 con 0x7f1ba415d360 2023-12-20T04:43:19.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.257+0000 7f1bac155640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba40af5b0 con 0x7f1ba4069c30 2023-12-20T04:43:19.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.257+0000 7f1bac155640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1ba4070a40 con 0x7f1ba40cbde0 2023-12-20T04:43:19.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.257+0000 7f1ba9ef1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1ba4069c30 0x7f1ba4070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.257+0000 7f1ba9ef1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1ba4069c30 0x7f1ba4070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35584/0 (socket says 172.21.15.132:35584) 2023-12-20T04:43:19.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.257+0000 7f1ba9ef1640 1 -- 172.21.15.132:0/3274444313 learned_addr learned my addr 172.21.15.132:0/3274444313 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:19.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.258+0000 7f1baa6f2640 1 --2- 172.21.15.132:0/3274444313 >> v2:172.21.15.187:3300/0 conn(0x7f1ba40cbde0 0x7f1ba40ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.258+0000 7f1ba9ef1640 1 -- 172.21.15.132:0/3274444313 >> v2:172.21.15.187:3300/0 conn(0x7f1ba40cbde0 msgr2=0x7f1ba40ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:19.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.258+0000 7f1ba9ef1640 1 --2- 172.21.15.132:0/3274444313 >> v2:172.21.15.187:3300/0 conn(0x7f1ba40cbde0 0x7f1ba40ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.258+0000 7f1ba9ef1640 1 -- 172.21.15.132:0/3274444313 >> v1:172.21.15.187:6789/0 conn(0x7f1ba415d360 legacy=0x7f1ba406a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:19.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.258+0000 7f1ba9ef1640 1 -- 172.21.15.132:0/3274444313 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba4070d20 con 0x7f1ba4069c30 2023-12-20T04:43:19.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.258+0000 7f1baa6f2640 1 --2- 172.21.15.132:0/3274444313 >> v2:172.21.15.187:3300/0 conn(0x7f1ba40cbde0 0x7f1ba40ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:19.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.258+0000 7f1ba9ef1640 1 --2- 172.21.15.132:0/3274444313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ba4069c30 0x7f1ba4070460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4066600 tx=0x7f1ba002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e345b7fbdf509c75 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:19.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.259+0000 7f1ba8eef640 1 -- 172.21.15.132:0/3274444313 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba002ca80 con 0x7f1ba4069c30 2023-12-20T04:43:19.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.259+0000 7f1ba8eef640 1 -- 172.21.15.132:0/3274444313 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1ba002cbe0 con 0x7f1ba4069c30 2023-12-20T04:43:19.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.259+0000 7f1ba8eef640 1 -- 172.21.15.132:0/3274444313 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1ba00343f0 con 0x7f1ba4069c30 2023-12-20T04:43:19.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.259+0000 7f1bac155640 1 -- 172.21.15.132:0/3274444313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ba4069c30 msgr2=0x7f1ba4070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:19.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.259+0000 7f1bac155640 1 --2- 172.21.15.132:0/3274444313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ba4069c30 0x7f1ba4070460 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f1ba4066600 tx=0x7f1ba002bee0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.259+0000 7f1bac155640 1 -- 172.21.15.132:0/3274444313 shutdown_connections 2023-12-20T04:43:19.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.259+0000 7f1bac155640 1 --2- 172.21.15.132:0/3274444313 >> v2:172.21.15.187:3300/0 conn(0x7f1ba40cbde0 0x7f1ba40ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.259+0000 7f1bac155640 1 --2- 172.21.15.132:0/3274444313 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ba4069c30 0x7f1ba4070460 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.259+0000 7f1bac155640 1 -- 172.21.15.132:0/3274444313 >> 172.21.15.132:0/3274444313 conn(0x7f1ba40cc630 msgr2=0x7f1ba40cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:19.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.259+0000 7f1bac155640 1 -- 172.21.15.132:0/3274444313 shutdown_connections 2023-12-20T04:43:19.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.259+0000 7f1bac155640 1 -- 172.21.15.132:0/3274444313 wait complete. 2023-12-20T04:43:19.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.260+0000 7f1bac155640 1 Processor -- start 2023-12-20T04:43:19.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.260+0000 7f1bac155640 1 -- start start 2023-12-20T04:43:19.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.261+0000 7f1bac155640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ba4069c30 0x7f1ba40c7060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.261+0000 7f1bac155640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ba40cbde0 0x7f1ba40c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.261+0000 7f1bac155640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ba415d360 0x7f1ba40afa10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.261+0000 7f1bac155640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba41f3ce0 con 0x7f1ba415d360 2023-12-20T04:43:19.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.261+0000 7f1bac155640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba40c75a0 con 0x7f1ba4069c30 2023-12-20T04:43:19.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.261+0000 7f1bac155640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1ba41f3160 con 0x7f1ba40cbde0 2023-12-20T04:43:19.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.261+0000 7f1baa6f2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ba415d360 0x7f1ba40afa10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.261+0000 7f1baa6f2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ba415d360 0x7f1ba40afa10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35596/0 (socket says 172.21.15.132:35596) 2023-12-20T04:43:19.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.261+0000 7f1baa6f2640 1 -- 172.21.15.132:0/3913575669 learned_addr learned my addr 172.21.15.132:0/3913575669 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:19.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.261+0000 7f1baa6f2640 1 -- 172.21.15.132:0/3913575669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ba40cbde0 msgr2=0x7f1ba40c8ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:19.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.261+0000 7f1baa6f2640 1 --2- 172.21.15.132:0/3913575669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ba40cbde0 0x7f1ba40c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.261+0000 7f1baa6f2640 1 -- 172.21.15.132:0/3913575669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ba4069c30 msgr2=0x7f1ba40c7060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:19.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.261+0000 7f1baa6f2640 1 --2- 172.21.15.132:0/3913575669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ba4069c30 0x7f1ba40c7060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.261+0000 7f1baa6f2640 1 -- 172.21.15.132:0/3913575669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ba0009b30 con 0x7f1ba415d360 2023-12-20T04:43:19.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.262+0000 7f1baa6f2640 1 --2- 172.21.15.132:0/3913575669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ba415d360 0x7f1ba40afa10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00c7f0 tx=0x7f1b9c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:19.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.262+0000 7f1b9a7fc640 1 -- 172.21.15.132:0/3913575669 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c007820 con 0x7f1ba415d360 2023-12-20T04:43:19.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.262+0000 7f1b9a7fc640 1 -- 172.21.15.132:0/3913575669 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1b9c007980 con 0x7f1ba415d360 2023-12-20T04:43:19.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.262+0000 7f1b9a7fc640 1 -- 172.21.15.132:0/3913575669 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1b9c007d30 con 0x7f1ba415d360 2023-12-20T04:43:19.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.262+0000 7f1bac155640 1 -- 172.21.15.132:0/3913575669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ba41f3720 con 0x7f1ba415d360 2023-12-20T04:43:19.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.262+0000 7f1bac155640 1 -- 172.21.15.132:0/3913575669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ba40b3000 con 0x7f1ba415d360 2023-12-20T04:43:19.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.263+0000 7f1bac155640 1 -- 172.21.15.132:0/3913575669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ba40b15b0 con 0x7f1ba415d360 2023-12-20T04:43:19.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.263+0000 7f1b9a7fc640 1 -- 172.21.15.132:0/3913575669 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1b9c0113f0 con 0x7f1ba415d360 2023-12-20T04:43:19.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.263+0000 7f1b9a7fc640 1 --2- 172.21.15.132:0/3913575669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1b8806a430 0x7f1b8806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.264+0000 7f1b9a7fc640 1 -- 172.21.15.132:0/3913575669 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1b9c088be0 con 0x7f1ba415d360 2023-12-20T04:43:19.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.264+0000 7f1ba9ef1640 1 --2- 172.21.15.132:0/3913575669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1b8806a430 0x7f1b8806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.264+0000 7f1ba9ef1640 1 --2- 172.21.15.132:0/3913575669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1b8806a430 0x7f1b8806c8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0035000 tx=0x7f1ba002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:19.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.268+0000 7f1b9a7fc640 1 -- 172.21.15.132:0/3913575669 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1b9c054260 con 0x7f1ba415d360 2023-12-20T04:43:19.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.431+0000 7f1bac155640 1 -- 172.21.15.132:0/3913575669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1ba404e840 con 0x7f1ba415d360 2023-12-20T04:43:19.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.432+0000 7f1b9a7fc640 1 -- 172.21.15.132:0/3913575669 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1b9c01f020 con 0x7f1ba415d360 2023-12-20T04:43:19.434 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:43:19.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.434+0000 7f1bac155640 1 -- 172.21.15.132:0/3913575669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1b8806a430 msgr2=0x7f1b8806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:19.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.434+0000 7f1bac155640 1 --2- 172.21.15.132:0/3913575669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1b8806a430 0x7f1b8806c8f0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f1ba0035000 tx=0x7f1ba002e000 comp rx=0 tx=0).stop 2023-12-20T04:43:19.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.434+0000 7f1bac155640 1 -- 172.21.15.132:0/3913575669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ba415d360 msgr2=0x7f1ba40afa10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:19.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.434+0000 7f1bac155640 1 --2- 172.21.15.132:0/3913575669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ba415d360 0x7f1ba40afa10 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f1b9c00c7f0 tx=0x7f1b9c00ccb0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.434+0000 7f1bac155640 1 -- 172.21.15.132:0/3913575669 shutdown_connections 2023-12-20T04:43:19.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.434+0000 7f1bac155640 1 --2- 172.21.15.132:0/3913575669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1b8806a430 0x7f1b8806c8f0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.434+0000 7f1bac155640 1 --2- 172.21.15.132:0/3913575669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1ba415d360 0x7f1ba40afa10 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.434+0000 7f1bac155640 1 --2- 172.21.15.132:0/3913575669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1ba40cbde0 0x7f1ba40c8ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.434+0000 7f1bac155640 1 --2- 172.21.15.132:0/3913575669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1ba4069c30 0x7f1ba40c7060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.434+0000 7f1bac155640 1 -- 172.21.15.132:0/3913575669 >> 172.21.15.132:0/3913575669 conn(0x7f1ba40cc630 msgr2=0x7f1ba406ea40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:19.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.434+0000 7f1bac155640 1 -- 172.21.15.132:0/3913575669 shutdown_connections 2023-12-20T04:43:19.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.434+0000 7f1bac155640 1 -- 172.21.15.132:0/3913575669 wait complete. 2023-12-20T04:43:19.446 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:43:19.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.547+0000 7f80343b9640 1 Processor -- start 2023-12-20T04:43:19.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.547+0000 7f80343b9640 1 -- start start 2023-12-20T04:43:19.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.548+0000 7f80343b9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f802c0cf1d0 0x7f802c15e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.548+0000 7f80343b9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f802c070460 0x7f802c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.548+0000 7f80343b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c0c4a70 0x7f802c0c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.548+0000 7f80343b9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802c070e30 con 0x7f802c0cf1d0 2023-12-20T04:43:19.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.548+0000 7f80343b9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802c15e740 con 0x7f802c070460 2023-12-20T04:43:19.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.548+0000 7f80343b9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0cb6b0 con 0x7f802c0c4a70 2023-12-20T04:43:19.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.548+0000 7f8032155640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f802c0cf1d0 0x7f802c15e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.548+0000 7f8032155640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f802c0cf1d0 0x7f802c15e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35602/0 (socket says 172.21.15.132:35602) 2023-12-20T04:43:19.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.548+0000 7f8032155640 1 -- 172.21.15.132:0/613673178 learned_addr learned my addr 172.21.15.132:0/613673178 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:19.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.549+0000 7f8032155640 1 -- 172.21.15.132:0/613673178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c0c4a70 msgr2=0x7f802c0c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:19.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.549+0000 7f8032155640 1 --2- 172.21.15.132:0/613673178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c0c4a70 0x7f802c0c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.549+0000 7f8032155640 1 -- 172.21.15.132:0/613673178 >> v2:172.21.15.187:3300/0 conn(0x7f802c070460 msgr2=0x7f802c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:19.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.549+0000 7f8031954640 1 --2- 172.21.15.132:0/613673178 >> v2:172.21.15.187:3300/0 conn(0x7f802c070460 0x7f802c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.549+0000 7f8032155640 1 --2- 172.21.15.132:0/613673178 >> v2:172.21.15.187:3300/0 conn(0x7f802c070460 0x7f802c0708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.549+0000 7f8032155640 1 -- 172.21.15.132:0/613673178 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c0cb990 con 0x7f802c0cf1d0 2023-12-20T04:43:19.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.549+0000 7f8031954640 1 --2- 172.21.15.132:0/613673178 >> v2:172.21.15.187:3300/0 conn(0x7f802c070460 0x7f802c0708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:19.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.549+0000 7f8032155640 1 --2- 172.21.15.132:0/613673178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0cf1d0 0x7f802c15e200 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f802c0d0af0 tx=0x7f802802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=121e9d72e76bb07b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:19.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.550+0000 7f8031153640 1 -- 172.21.15.132:0/613673178 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802802ca70 con 0x7f802c0cf1d0 2023-12-20T04:43:19.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.550+0000 7f8031153640 1 -- 172.21.15.132:0/613673178 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f802802cbd0 con 0x7f802c0cf1d0 2023-12-20T04:43:19.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.550+0000 7f8031153640 1 -- 172.21.15.132:0/613673178 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80280343f0 con 0x7f802c0cf1d0 2023-12-20T04:43:19.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.550+0000 7f80343b9640 1 -- 172.21.15.132:0/613673178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0cf1d0 msgr2=0x7f802c15e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:19.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.550+0000 7f80343b9640 1 --2- 172.21.15.132:0/613673178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0cf1d0 0x7f802c15e200 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f802c0d0af0 tx=0x7f802802bed0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.550+0000 7f80343b9640 1 -- 172.21.15.132:0/613673178 shutdown_connections 2023-12-20T04:43:19.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.550+0000 7f80343b9640 1 --2- 172.21.15.132:0/613673178 >> v2:172.21.15.187:3300/0 conn(0x7f802c070460 0x7f802c0708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.550+0000 7f80343b9640 1 --2- 172.21.15.132:0/613673178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c0c4a70 0x7f802c0c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.550+0000 7f80343b9640 1 --2- 172.21.15.132:0/613673178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0cf1d0 0x7f802c15e200 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.550+0000 7f80343b9640 1 -- 172.21.15.132:0/613673178 >> 172.21.15.132:0/613673178 conn(0x7f802c0cc630 msgr2=0x7f802c0cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:19.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.550+0000 7f80343b9640 1 -- 172.21.15.132:0/613673178 shutdown_connections 2023-12-20T04:43:19.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.550+0000 7f80343b9640 1 -- 172.21.15.132:0/613673178 wait complete. 2023-12-20T04:43:19.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.551+0000 7f80343b9640 1 Processor -- start 2023-12-20T04:43:19.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.552+0000 7f80343b9640 1 -- start start 2023-12-20T04:43:19.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.552+0000 7f80343b9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f802c070460 0x7f802c1f4670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.552+0000 7f80343b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0c4a70 0x7f802c13fd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.552+0000 7f80343b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c0cf1d0 0x7f802c15b470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.552+0000 7f80343b9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c15b1e0 con 0x7f802c0c4a70 2023-12-20T04:43:19.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.552+0000 7f80343b9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c1f4bb0 con 0x7f802c070460 2023-12-20T04:43:19.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.552+0000 7f80343b9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c13e580 con 0x7f802c0cf1d0 2023-12-20T04:43:19.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.552+0000 7f8031954640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0c4a70 0x7f802c13fd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.552+0000 7f8031954640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0c4a70 0x7f802c13fd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35610/0 (socket says 172.21.15.132:35610) 2023-12-20T04:43:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.552+0000 7f8031954640 1 -- 172.21.15.132:0/4024232607 learned_addr learned my addr 172.21.15.132:0/4024232607 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.552+0000 7f8032956640 1 --2- 172.21.15.132:0/4024232607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c0cf1d0 0x7f802c15b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.552+0000 7f8032155640 1 --2- 172.21.15.132:0/4024232607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f802c070460 0x7f802c1f4670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.553+0000 7f8031954640 1 -- 172.21.15.132:0/4024232607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c0cf1d0 msgr2=0x7f802c15b470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.553+0000 7f8031954640 1 --2- 172.21.15.132:0/4024232607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c0cf1d0 0x7f802c15b470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.553+0000 7f8031954640 1 -- 172.21.15.132:0/4024232607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f802c070460 msgr2=0x7f802c1f4670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.553+0000 7f8031954640 1 --2- 172.21.15.132:0/4024232607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f802c070460 0x7f802c1f4670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.553+0000 7f8031954640 1 -- 172.21.15.132:0/4024232607 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8028009b30 con 0x7f802c0c4a70 2023-12-20T04:43:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.553+0000 7f8031954640 1 --2- 172.21.15.132:0/4024232607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0c4a70 0x7f802c13fd90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c7f0 tx=0x7f801c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.553+0000 7f8022ffd640 1 -- 172.21.15.132:0/4024232607 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c007820 con 0x7f802c0c4a70 2023-12-20T04:43:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.553+0000 7f8022ffd640 1 -- 172.21.15.132:0/4024232607 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f801c007980 con 0x7f802c0c4a70 2023-12-20T04:43:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.553+0000 7f80343b9640 1 -- 172.21.15.132:0/4024232607 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f802c13da00 con 0x7f802c0c4a70 2023-12-20T04:43:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.553+0000 7f8022ffd640 1 -- 172.21.15.132:0/4024232607 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f801c007cf0 con 0x7f802c0c4a70 2023-12-20T04:43:19.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.553+0000 7f80343b9640 1 -- 172.21.15.132:0/4024232607 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802c13dfc0 con 0x7f802c0c4a70 2023-12-20T04:43:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.554+0000 7f80343b9640 1 -- 172.21.15.132:0/4024232607 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802c0ca860 con 0x7f802c0c4a70 2023-12-20T04:43:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.554+0000 7f8022ffd640 1 -- 172.21.15.132:0/4024232607 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f801c0113f0 con 0x7f802c0c4a70 2023-12-20T04:43:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.555+0000 7f8022ffd640 1 --2- 172.21.15.132:0/4024232607 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f801006a430 0x7f801006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.555+0000 7f8022ffd640 1 -- 172.21.15.132:0/4024232607 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f801c088c40 con 0x7f802c0c4a70 2023-12-20T04:43:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.555+0000 7f8032155640 1 --2- 172.21.15.132:0/4024232607 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f801006a430 0x7f801006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.555+0000 7f8032155640 1 --2- 172.21.15.132:0/4024232607 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f801006a430 0x7f801006c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8028035000 tx=0x7f8028030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:19.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.559+0000 7f8022ffd640 1 -- 172.21.15.132:0/4024232607 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f801c054230 con 0x7f802c0c4a70 2023-12-20T04:43:19.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.724+0000 7f80343b9640 1 -- 172.21.15.132:0/4024232607 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f802c04e840 con 0x7f802c0c4a70 2023-12-20T04:43:19.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.725+0000 7f8022ffd640 1 -- 172.21.15.132:0/4024232607 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f801c01f0a0 con 0x7f802c0c4a70 2023-12-20T04:43:19.727 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:43:19.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.727+0000 7f80343b9640 1 -- 172.21.15.132:0/4024232607 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f801006a430 msgr2=0x7f801006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:19.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.727+0000 7f80343b9640 1 --2- 172.21.15.132:0/4024232607 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f801006a430 0x7f801006c8f0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8028035000 tx=0x7f8028030000 comp rx=0 tx=0).stop 2023-12-20T04:43:19.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.727+0000 7f80343b9640 1 -- 172.21.15.132:0/4024232607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0c4a70 msgr2=0x7f802c13fd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:19.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.727+0000 7f80343b9640 1 --2- 172.21.15.132:0/4024232607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0c4a70 0x7f802c13fd90 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f801c00c7f0 tx=0x7f801c00ccb0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.727+0000 7f80343b9640 1 -- 172.21.15.132:0/4024232607 shutdown_connections 2023-12-20T04:43:19.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.727+0000 7f80343b9640 1 --2- 172.21.15.132:0/4024232607 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f801006a430 0x7f801006c8f0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.727+0000 7f80343b9640 1 --2- 172.21.15.132:0/4024232607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c0cf1d0 0x7f802c15b470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.727+0000 7f80343b9640 1 --2- 172.21.15.132:0/4024232607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0c4a70 0x7f802c13fd90 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.727+0000 7f80343b9640 1 --2- 172.21.15.132:0/4024232607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f802c070460 0x7f802c1f4670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.727+0000 7f80343b9640 1 -- 172.21.15.132:0/4024232607 >> 172.21.15.132:0/4024232607 conn(0x7f802c0cc630 msgr2=0x7f802c15a310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:19.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.727+0000 7f80343b9640 1 -- 172.21.15.132:0/4024232607 shutdown_connections 2023-12-20T04:43:19.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.727+0000 7f80343b9640 1 -- 172.21.15.132:0/4024232607 wait complete. 2023-12-20T04:43:19.740 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:43:19.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.839+0000 7fdcc7d51640 1 Processor -- start 2023-12-20T04:43:19.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.839+0000 7fdcc7d51640 1 -- start start 2023-12-20T04:43:19.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc7d51640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdcc00ade90 0x7fdcc00b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc7d51640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00ccfb0 0x7fdcc00cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc7d51640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcc00cb130 con 0x7fdcc015ae50 2023-12-20T04:43:19.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc7d51640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcc00ce010 con 0x7fdcc00ade90 2023-12-20T04:43:19.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc7d51640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc015b230 con 0x7fdcc00ccfb0 2023-12-20T04:43:19.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc5aed640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdcc015ae50 0x7fdcc00caa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60062/0 (socket says 172.21.15.132:60062) 2023-12-20T04:43:19.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc5aed640 1 -- 172.21.15.132:0/1320038115 learned_addr learned my addr 172.21.15.132:0/1320038115 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:19.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc52ec640 1 --2- 172.21.15.132:0/1320038115 >> v2:172.21.15.187:3300/0 conn(0x7fdcc00ade90 0x7fdcc00b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc62ee640 1 --2- 172.21.15.132:0/1320038115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00ccfb0 0x7fdcc00cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc4aeb640 1 -- 172.21.15.132:0/1320038115 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 809791554 0 0) 0x7fdcc00cb130 con 0x7fdcc015ae50 2023-12-20T04:43:19.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc4aeb640 1 -- 172.21.15.132:0/1320038115 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdcac003520 con 0x7fdcc015ae50 2023-12-20T04:43:19.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc4aeb640 1 -- 172.21.15.132:0/1320038115 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2867733510 0 0) 0x7fdcac003520 con 0x7fdcc015ae50 2023-12-20T04:43:19.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc4aeb640 1 -- 172.21.15.132:0/1320038115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00ccfb0 msgr2=0x7fdcc00cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:19.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc4aeb640 1 --2- 172.21.15.132:0/1320038115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00ccfb0 0x7fdcc00cd440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc4aeb640 1 -- 172.21.15.132:0/1320038115 >> v2:172.21.15.187:3300/0 conn(0x7fdcc00ade90 msgr2=0x7fdcc00b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:19.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc4aeb640 1 --2- 172.21.15.132:0/1320038115 >> v2:172.21.15.187:3300/0 conn(0x7fdcc00ade90 0x7fdcc00b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc4aeb640 1 -- 172.21.15.132:0/1320038115 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc00c9050 con 0x7fdcc015ae50 2023-12-20T04:43:19.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc4aeb640 1 -- 172.21.15.132:0/1320038115 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fdcbc001670 con 0x7fdcc015ae50 2023-12-20T04:43:19.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc4aeb640 1 -- 172.21.15.132:0/1320038115 >> v1:172.21.15.132:6789/0 conn(0x7fdcc015ae50 legacy=0x7fdcc00caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:19.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc4aeb640 1 --2- 172.21.15.132:0/1320038115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00ccfb0 0x7fdcac003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc4aeb640 1 --2- 172.21.15.132:0/1320038115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcac003ef0 0x7fdcac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.840+0000 7fdcc4aeb640 1 --2- 172.21.15.132:0/1320038115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcac004d00 0x7fdcac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.841+0000 7fdcc4aeb640 1 -- 172.21.15.132:0/1320038115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc00ce010 con 0x7fdcac003ef0 2023-12-20T04:43:19.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.841+0000 7fdcc4aeb640 1 -- 172.21.15.132:0/1320038115 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc015b230 con 0x7fdcac004d00 2023-12-20T04:43:19.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.841+0000 7fdcc4aeb640 1 -- 172.21.15.132:0/1320038115 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcac00b980 con 0x7fdcc00ccfb0 2023-12-20T04:43:19.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.841+0000 7fdcc52ec640 1 --2- 172.21.15.132:0/1320038115 >> v2:172.21.15.187:3300/0 conn(0x7fdcc00ade90 0x7fdcc00b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:43:19.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.841+0000 7fdcc52ec640 1 --2- 172.21.15.132:0/1320038115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcac003ef0 0x7fdcac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.841+0000 7fdcc5aed640 1 --2- 172.21.15.132:0/1320038115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00ccfb0 0x7fdcac003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.841+0000 7fdcc62ee640 1 --2- 172.21.15.132:0/1320038115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcac004d00 0x7fdcac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.841+0000 7fdcc52ec640 1 -- 172.21.15.132:0/1320038115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00ccfb0 msgr2=0x7fdcac003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:19.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.841+0000 7fdcc52ec640 1 --2- 172.21.15.132:0/1320038115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00ccfb0 0x7fdcac003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.841+0000 7fdcc52ec640 1 -- 172.21.15.132:0/1320038115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcac004d00 msgr2=0x7fdcac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:19.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.841+0000 7fdcc52ec640 1 --2- 172.21.15.132:0/1320038115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcac004d00 0x7fdcac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.841+0000 7fdcc52ec640 1 -- 172.21.15.132:0/1320038115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcac003520 con 0x7fdcac003ef0 2023-12-20T04:43:19.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.842+0000 7fdcc52ec640 1 --2- 172.21.15.132:0/1320038115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcac003ef0 0x7fdcac0047c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009c70 tx=0x7fdcac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=253b5c0c234368f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:19.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.842+0000 7fdcc4aeb640 1 -- 172.21.15.132:0/1320038115 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb0004020 con 0x7fdcac003ef0 2023-12-20T04:43:19.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.842+0000 7fdcc4aeb640 1 -- 172.21.15.132:0/1320038115 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcb0004180 con 0x7fdcac003ef0 2023-12-20T04:43:19.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.842+0000 7fdcc4aeb640 1 -- 172.21.15.132:0/1320038115 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcb002c950 con 0x7fdcac003ef0 2023-12-20T04:43:19.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.842+0000 7fdcc7d51640 1 -- 172.21.15.132:0/1320038115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcac003ef0 msgr2=0x7fdcac0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:19.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.842+0000 7fdcc7d51640 1 --2- 172.21.15.132:0/1320038115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcac003ef0 0x7fdcac0047c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0009c70 tx=0x7fdcac0057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.842+0000 7fdcc62ee640 1 -- 172.21.15.132:0/1320038115 reap_dead start 2023-12-20T04:43:19.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.842+0000 7fdcc7d51640 1 -- 172.21.15.132:0/1320038115 shutdown_connections 2023-12-20T04:43:19.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.842+0000 7fdcc7d51640 1 -- 172.21.15.132:0/1320038115 >> 172.21.15.132:0/1320038115 conn(0x7fdcc006a260 msgr2=0x7fdcc00b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:19.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.842+0000 7fdcc7d51640 1 -- 172.21.15.132:0/1320038115 shutdown_connections 2023-12-20T04:43:19.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.842+0000 7fdcc7d51640 1 -- 172.21.15.132:0/1320038115 wait complete. 2023-12-20T04:43:19.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.843+0000 7fdcc7d51640 1 Processor -- start 2023-12-20T04:43:19.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.844+0000 7fdcc7d51640 1 -- start start 2023-12-20T04:43:19.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.844+0000 7fdcc7d51640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcac003ef0 0x7fdcc00c6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.844+0000 7fdcc7d51640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00b16f0 0x7fdcc01efdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.844+0000 7fdcc7d51640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcc01f0310 0x7fdcc0070330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.844+0000 7fdcc7d51640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc0152c60 con 0x7fdcac003ef0 2023-12-20T04:43:19.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.844+0000 7fdcc7d51640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc00b1e90 con 0x7fdcc01f0310 2023-12-20T04:43:19.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.844+0000 7fdcc7d51640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcc00b2170 con 0x7fdcc00b16f0 2023-12-20T04:43:19.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.844+0000 7fdcc5aed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcac003ef0 0x7fdcc00c6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.844+0000 7fdcc5aed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcac003ef0 0x7fdcc00c6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35626/0 (socket says 172.21.15.132:35626) 2023-12-20T04:43:19.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.844+0000 7fdcc5aed640 1 -- 172.21.15.132:0/942088200 learned_addr learned my addr 172.21.15.132:0/942088200 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:19.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.845+0000 7fdcc62ee640 1 --2- 172.21.15.132:0/942088200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcc01f0310 0x7fdcc0070330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.845+0000 7fdcc52ec640 1 --2- 172.21.15.132:0/942088200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00b16f0 0x7fdcc01efdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.845+0000 7fdcc5aed640 1 -- 172.21.15.132:0/942088200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00b16f0 msgr2=0x7fdcc01efdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:19.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.845+0000 7fdcc5aed640 1 --2- 172.21.15.132:0/942088200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00b16f0 0x7fdcc01efdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.845+0000 7fdcc5aed640 1 -- 172.21.15.132:0/942088200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcc01f0310 msgr2=0x7fdcc0070330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:19.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.845+0000 7fdcc5aed640 1 --2- 172.21.15.132:0/942088200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcc01f0310 0x7fdcc0070330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:19.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.845+0000 7fdcc5aed640 1 -- 172.21.15.132:0/942088200 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcc00b2450 con 0x7fdcac003ef0 2023-12-20T04:43:19.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.845+0000 7fdcc62ee640 1 --2- 172.21.15.132:0/942088200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcc01f0310 0x7fdcc0070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:19.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.845+0000 7fdcc5aed640 1 --2- 172.21.15.132:0/942088200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcac003ef0 0x7fdcc00c6a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc007310 tx=0x7fdcbc0077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:19.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.845+0000 7fdcb67fc640 1 -- 172.21.15.132:0/942088200 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc00f9c0 con 0x7fdcac003ef0 2023-12-20T04:43:19.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.845+0000 7fdcb67fc640 1 -- 172.21.15.132:0/942088200 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdcbc00fb40 con 0x7fdcac003ef0 2023-12-20T04:43:19.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.845+0000 7fdcc7d51640 1 -- 172.21.15.132:0/942088200 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcc00b2730 con 0x7fdcac003ef0 2023-12-20T04:43:19.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.845+0000 7fdcb67fc640 1 -- 172.21.15.132:0/942088200 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdcbc0133f0 con 0x7fdcac003ef0 2023-12-20T04:43:19.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.845+0000 7fdcc7d51640 1 -- 172.21.15.132:0/942088200 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcc00b1b70 con 0x7fdcac003ef0 2023-12-20T04:43:19.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.846+0000 7fdcc7d51640 1 -- 172.21.15.132:0/942088200 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcc004e840 con 0x7fdcac003ef0 2023-12-20T04:43:19.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.846+0000 7fdcb67fc640 1 -- 172.21.15.132:0/942088200 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdcbc013550 con 0x7fdcac003ef0 2023-12-20T04:43:19.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.847+0000 7fdcb67fc640 1 --2- 172.21.15.132:0/942088200 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdca406a430 0x7fdca406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:19.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.847+0000 7fdcb67fc640 1 -- 172.21.15.132:0/942088200 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdcbc0889f0 con 0x7fdcac003ef0 2023-12-20T04:43:19.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.847+0000 7fdcc52ec640 1 --2- 172.21.15.132:0/942088200 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdca406a430 0x7fdca406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:19.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.847+0000 7fdcc52ec640 1 --2- 172.21.15.132:0/942088200 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdca406a430 0x7fdca406c8f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0035000 tx=0x7fdcb0030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:19.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:19.851+0000 7fdcb67fc640 1 -- 172.21.15.132:0/942088200 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdcbc053fe0 con 0x7fdcac003ef0 2023-12-20T04:43:20.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.031+0000 7fdcc7d51640 1 -- 172.21.15.132:0/942088200 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdcc00adc50 con 0x7fdcac003ef0 2023-12-20T04:43:20.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.031+0000 7fdcb67fc640 1 -- 172.21.15.132:0/942088200 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdcbc001690 con 0x7fdcac003ef0 2023-12-20T04:43:20.033 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:43:20.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.033+0000 7fdcc7d51640 1 -- 172.21.15.132:0/942088200 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdca406a430 msgr2=0x7fdca406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.033+0000 7fdcc7d51640 1 --2- 172.21.15.132:0/942088200 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdca406a430 0x7fdca406c8f0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7fdcb0035000 tx=0x7fdcb0030000 comp rx=0 tx=0).stop 2023-12-20T04:43:20.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.033+0000 7fdcc7d51640 1 -- 172.21.15.132:0/942088200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcac003ef0 msgr2=0x7fdcc00c6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.033+0000 7fdcc7d51640 1 --2- 172.21.15.132:0/942088200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcac003ef0 0x7fdcc00c6a10 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7fdcbc007310 tx=0x7fdcbc0077d0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.033+0000 7fdcc7d51640 1 -- 172.21.15.132:0/942088200 shutdown_connections 2023-12-20T04:43:20.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.033+0000 7fdcc7d51640 1 --2- 172.21.15.132:0/942088200 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdca406a430 0x7fdca406c8f0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.033+0000 7fdcc7d51640 1 --2- 172.21.15.132:0/942088200 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcc01f0310 0x7fdcc0070330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.033+0000 7fdcc7d51640 1 --2- 172.21.15.132:0/942088200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcc00b16f0 0x7fdcc01efdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.033+0000 7fdcc7d51640 1 --2- 172.21.15.132:0/942088200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcac003ef0 0x7fdcc00c6a10 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.033+0000 7fdcc7d51640 1 -- 172.21.15.132:0/942088200 >> 172.21.15.132:0/942088200 conn(0x7fdcc006a260 msgr2=0x7fdcc0157bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:20.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.033+0000 7fdcc7d51640 1 -- 172.21.15.132:0/942088200 shutdown_connections 2023-12-20T04:43:20.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.033+0000 7fdcc7d51640 1 -- 172.21.15.132:0/942088200 wait complete. 2023-12-20T04:43:20.046 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:43:20.046 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:43:20.062 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:20.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.200+0000 7f2c77451640 1 Processor -- start 2023-12-20T04:43:20.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.200+0000 7f2c77451640 1 -- start start 2023-12-20T04:43:20.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c77451640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2c700b4ac0 0x7f2c700cb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c77451640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c7006fdd0 0x7f2c700cc350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c77451640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2c700cc890 0x7f2c70158030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c77451640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c700cbba0 con 0x7f2c700cc890 2023-12-20T04:43:20.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c77451640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c7006c520 con 0x7f2c700b4ac0 2023-12-20T04:43:20.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c77451640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c700ccd00 con 0x7f2c7006fdd0 2023-12-20T04:43:20.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c759ee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2c700cc890 0x7f2c70158030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c759ee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2c700cc890 0x7f2c70158030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35642/0 (socket says 172.21.15.132:35642) 2023-12-20T04:43:20.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c759ee640 1 -- 172.21.15.132:0/2384591747 learned_addr learned my addr 172.21.15.132:0/2384591747 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:20.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c759ee640 1 -- 172.21.15.132:0/2384591747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c7006fdd0 msgr2=0x7f2c700cc350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:20.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c749ec640 1 --2- 172.21.15.132:0/2384591747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c7006fdd0 0x7f2c700cc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c751ed640 1 --2- 172.21.15.132:0/2384591747 >> v2:172.21.15.187:3300/0 conn(0x7f2c700b4ac0 0x7f2c700cb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c759ee640 1 --2- 172.21.15.132:0/2384591747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c7006fdd0 0x7f2c700cc350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c759ee640 1 -- 172.21.15.132:0/2384591747 >> v2:172.21.15.187:3300/0 conn(0x7f2c700b4ac0 msgr2=0x7f2c700cb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:20.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c759ee640 1 --2- 172.21.15.132:0/2384591747 >> v2:172.21.15.187:3300/0 conn(0x7f2c700b4ac0 0x7f2c700cb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c759ee640 1 -- 172.21.15.132:0/2384591747 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c7015c050 con 0x7f2c700cc890 2023-12-20T04:43:20.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c749ec640 1 --2- 172.21.15.132:0/2384591747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c7006fdd0 0x7f2c700cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:20.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.201+0000 7f2c751ed640 1 --2- 172.21.15.132:0/2384591747 >> v2:172.21.15.187:3300/0 conn(0x7f2c700b4ac0 0x7f2c700cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:20.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.202+0000 7f2c759ee640 1 --2- 172.21.15.132:0/2384591747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c700cc890 0x7f2c70158030 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2c700734a0 tx=0x7f2c6802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ceb8e5ea5f28640 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:20.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.202+0000 7f2c67fff640 1 -- 172.21.15.132:0/2384591747 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6802ca70 con 0x7f2c700cc890 2023-12-20T04:43:20.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.202+0000 7f2c67fff640 1 -- 172.21.15.132:0/2384591747 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6802cbd0 con 0x7f2c700cc890 2023-12-20T04:43:20.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.202+0000 7f2c67fff640 1 -- 172.21.15.132:0/2384591747 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c680343f0 con 0x7f2c700cc890 2023-12-20T04:43:20.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.203+0000 7f2c77451640 1 -- 172.21.15.132:0/2384591747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c700cc890 msgr2=0x7f2c70158030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.203+0000 7f2c77451640 1 --2- 172.21.15.132:0/2384591747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c700cc890 0x7f2c70158030 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f2c700734a0 tx=0x7f2c6802bed0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.203+0000 7f2c77451640 1 -- 172.21.15.132:0/2384591747 shutdown_connections 2023-12-20T04:43:20.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.203+0000 7f2c77451640 1 --2- 172.21.15.132:0/2384591747 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c700cc890 0x7f2c70158030 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.203+0000 7f2c77451640 1 --2- 172.21.15.132:0/2384591747 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c7006fdd0 0x7f2c700cc350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.203+0000 7f2c77451640 1 --2- 172.21.15.132:0/2384591747 >> v2:172.21.15.187:3300/0 conn(0x7f2c700b4ac0 0x7f2c700cb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.203+0000 7f2c77451640 1 -- 172.21.15.132:0/2384591747 >> 172.21.15.132:0/2384591747 conn(0x7f2c7006a050 msgr2=0x7f2c7006a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:20.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.203+0000 7f2c77451640 1 -- 172.21.15.132:0/2384591747 shutdown_connections 2023-12-20T04:43:20.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.203+0000 7f2c77451640 1 -- 172.21.15.132:0/2384591747 wait complete. 2023-12-20T04:43:20.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.204+0000 7f2c77451640 1 Processor -- start 2023-12-20T04:43:20.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.204+0000 7f2c77451640 1 -- start start 2023-12-20T04:43:20.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c77451640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c7006fdd0 0x7f2c700c9c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c77451640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c700b4ac0 0x7f2c700c5900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c77451640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c700cc890 0x7f2c700ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c77451640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c700ad990 con 0x7f2c7006fdd0 2023-12-20T04:43:20.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c77451640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c701454d0 con 0x7f2c700cc890 2023-12-20T04:43:20.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c77451640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c701f2730 con 0x7f2c700b4ac0 2023-12-20T04:43:20.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c751ed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c7006fdd0 0x7f2c700c9c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c751ed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c7006fdd0 0x7f2c700c9c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35648/0 (socket says 172.21.15.132:35648) 2023-12-20T04:43:20.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c751ed640 1 -- 172.21.15.132:0/3735545521 learned_addr learned my addr 172.21.15.132:0/3735545521 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:20.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c751ed640 1 -- 172.21.15.132:0/3735545521 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c700b4ac0 msgr2=0x7f2c700c5900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c751ed640 1 --2- 172.21.15.132:0/3735545521 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c700b4ac0 0x7f2c700c5900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c751ed640 1 -- 172.21.15.132:0/3735545521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c700cc890 msgr2=0x7f2c700ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c751ed640 1 --2- 172.21.15.132:0/3735545521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c700cc890 0x7f2c700ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c751ed640 1 -- 172.21.15.132:0/3735545521 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c68009b30 con 0x7f2c7006fdd0 2023-12-20T04:43:20.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c751ed640 1 --2- 172.21.15.132:0/3735545521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c7006fdd0 0x7f2c700c9c10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00c7f0 tx=0x7f2c6c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:20.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c65ffb640 1 -- 172.21.15.132:0/3735545521 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c007a30 con 0x7f2c7006fdd0 2023-12-20T04:43:20.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c65ffb640 1 -- 172.21.15.132:0/3735545521 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c6c007b90 con 0x7f2c7006fdd0 2023-12-20T04:43:20.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c77451640 1 -- 172.21.15.132:0/3735545521 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c700c5e40 con 0x7f2c7006fdd0 2023-12-20T04:43:20.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c65ffb640 1 -- 172.21.15.132:0/3735545521 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c6c00ce40 con 0x7f2c7006fdd0 2023-12-20T04:43:20.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.205+0000 7f2c77451640 1 -- 172.21.15.132:0/3735545521 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c700ad0f0 con 0x7f2c7006fdd0 2023-12-20T04:43:20.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.207+0000 7f2c77451640 1 -- 172.21.15.132:0/3735545521 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c7004e840 con 0x7f2c7006fdd0 2023-12-20T04:43:20.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.207+0000 7f2c65ffb640 1 -- 172.21.15.132:0/3735545521 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2c6c0113f0 con 0x7f2c7006fdd0 2023-12-20T04:43:20.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.207+0000 7f2c65ffb640 1 --2- 172.21.15.132:0/3735545521 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2c5406a430 0x7f2c5406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.207+0000 7f2c65ffb640 1 -- 172.21.15.132:0/3735545521 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2c6c088b00 con 0x7f2c7006fdd0 2023-12-20T04:43:20.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.207+0000 7f2c749ec640 1 --2- 172.21.15.132:0/3735545521 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2c5406a430 0x7f2c5406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.207+0000 7f2c749ec640 1 --2- 172.21.15.132:0/3735545521 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2c5406a430 0x7f2c5406c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2c60006b10 tx=0x7f2c60008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:20.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.211+0000 7f2c65ffb640 1 -- 172.21.15.132:0/3735545521 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2c6c0540f0 con 0x7f2c7006fdd0 2023-12-20T04:43:20.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.379+0000 7f2c77451640 1 -- 172.21.15.132:0/3735545521 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2c7015adf0 con 0x7f2c7006fdd0 2023-12-20T04:43:20.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.380+0000 7f2c65ffb640 1 -- 172.21.15.132:0/3735545521 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f2c6c085ef0 con 0x7f2c7006fdd0 2023-12-20T04:43:20.381 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:20.382 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:20.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.382+0000 7f2c77451640 1 -- 172.21.15.132:0/3735545521 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2c5406a430 msgr2=0x7f2c5406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.382+0000 7f2c77451640 1 --2- 172.21.15.132:0/3735545521 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2c5406a430 0x7f2c5406c8f0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2c60006b10 tx=0x7f2c60008040 comp rx=0 tx=0).stop 2023-12-20T04:43:20.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.382+0000 7f2c77451640 1 -- 172.21.15.132:0/3735545521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c7006fdd0 msgr2=0x7f2c700c9c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.382+0000 7f2c77451640 1 --2- 172.21.15.132:0/3735545521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c7006fdd0 0x7f2c700c9c10 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f2c6c00c7f0 tx=0x7f2c6c00cbf0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.382+0000 7f2c77451640 1 -- 172.21.15.132:0/3735545521 shutdown_connections 2023-12-20T04:43:20.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.382+0000 7f2c77451640 1 --2- 172.21.15.132:0/3735545521 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2c5406a430 0x7f2c5406c8f0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.382+0000 7f2c77451640 1 --2- 172.21.15.132:0/3735545521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c700cc890 0x7f2c700ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.382+0000 7f2c77451640 1 --2- 172.21.15.132:0/3735545521 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c700b4ac0 0x7f2c700c5900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.382+0000 7f2c77451640 1 --2- 172.21.15.132:0/3735545521 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c7006fdd0 0x7f2c700c9c10 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.382+0000 7f2c77451640 1 -- 172.21.15.132:0/3735545521 >> 172.21.15.132:0/3735545521 conn(0x7f2c7006a050 msgr2=0x7f2c700b03c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:20.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.382+0000 7f2c77451640 1 -- 172.21.15.132:0/3735545521 shutdown_connections 2023-12-20T04:43:20.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.382+0000 7f2c77451640 1 -- 172.21.15.132:0/3735545521 wait complete. 2023-12-20T04:43:20.395 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:42:45.433456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:42:46.128920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:43:20.395 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:43:20.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.496+0000 7f85963fa640 1 Processor -- start 2023-12-20T04:43:20.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.496+0000 7f85963fa640 1 -- start start 2023-12-20T04:43:20.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.497+0000 7f85963fa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f859015cf20 0x7f859006c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.497+0000 7f85963fa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859015d300 0x7f8590161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.497+0000 7f85963fa640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8590161c40 con 0x7f85900cd4b0 2023-12-20T04:43:20.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.497+0000 7f85963fa640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f859006cc90 con 0x7f859015cf20 2023-12-20T04:43:20.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.497+0000 7f85963fa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85900b2f30 con 0x7f859015d300 2023-12-20T04:43:20.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.497+0000 7f858ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f859015cf20 0x7f859006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.497+0000 7f8594997640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f85900cd4b0 0x7f85900ceb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60068/0 (socket says 172.21.15.132:60068) 2023-12-20T04:43:20.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.497+0000 7f8594997640 1 -- 172.21.15.132:0/3671525531 learned_addr learned my addr 172.21.15.132:0/3671525531 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:20.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.497+0000 7f858f7fe640 1 --2- 172.21.15.132:0/3671525531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859015d300 0x7f8590161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.497+0000 7f858ffff640 1 -- 172.21.15.132:0/3671525531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859015d300 msgr2=0x7f8590161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:20.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.497+0000 7f858ffff640 1 --2- 172.21.15.132:0/3671525531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859015d300 0x7f8590161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.497+0000 7f858ffff640 1 -- 172.21.15.132:0/3671525531 >> v1:172.21.15.132:6789/0 conn(0x7f85900cd4b0 legacy=0x7f85900ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.497+0000 7f858effd640 1 -- 172.21.15.132:0/3671525531 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3561012313 0 0) 0x7f8590161c40 con 0x7f85900cd4b0 2023-12-20T04:43:20.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.497+0000 7f858ffff640 1 -- 172.21.15.132:0/3671525531 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85900b3210 con 0x7f859015cf20 2023-12-20T04:43:20.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.498+0000 7f858ffff640 1 --2- 172.21.15.132:0/3671525531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859015cf20 0x7f859006c590 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f85800097a0 tx=0x7f858002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce520ee221595773 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:20.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.498+0000 7f858effd640 1 -- 172.21.15.132:0/3671525531 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580031830 con 0x7f859015cf20 2023-12-20T04:43:20.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.498+0000 7f858effd640 1 -- 172.21.15.132:0/3671525531 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8580031990 con 0x7f859015cf20 2023-12-20T04:43:20.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.498+0000 7f858effd640 1 -- 172.21.15.132:0/3671525531 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8580031d20 con 0x7f859015cf20 2023-12-20T04:43:20.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.499+0000 7f85963fa640 1 -- 172.21.15.132:0/3671525531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859015cf20 msgr2=0x7f859006c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.499+0000 7f85963fa640 1 --2- 172.21.15.132:0/3671525531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859015cf20 0x7f859006c590 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f85800097a0 tx=0x7f858002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.499+0000 7f85963fa640 1 -- 172.21.15.132:0/3671525531 shutdown_connections 2023-12-20T04:43:20.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.499+0000 7f85963fa640 1 --2- 172.21.15.132:0/3671525531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859015d300 0x7f8590161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.499+0000 7f85963fa640 1 --2- 172.21.15.132:0/3671525531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859015cf20 0x7f859006c590 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.499+0000 7f85963fa640 1 -- 172.21.15.132:0/3671525531 >> 172.21.15.132:0/3671525531 conn(0x7f8590072c60 msgr2=0x7f8590073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.499+0000 7f85963fa640 1 -- 172.21.15.132:0/3671525531 shutdown_connections 2023-12-20T04:43:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.499+0000 7f85963fa640 1 -- 172.21.15.132:0/3671525531 wait complete. 2023-12-20T04:43:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.500+0000 7f85963fa640 1 Processor -- start 2023-12-20T04:43:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.500+0000 7f85963fa640 1 -- start start 2023-12-20T04:43:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f85963fa640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85900cd4b0 0x7f859015a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f85963fa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859015cf20 0x7f85900b5740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f85963fa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859015d300 0x7f85901591f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f85963fa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859015b720 con 0x7f859015cf20 2023-12-20T04:43:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f85963fa640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85900b5c80 con 0x7f85900cd4b0 2023-12-20T04:43:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f85963fa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f859015aba0 con 0x7f859015d300 2023-12-20T04:43:20.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f858f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859015cf20 0x7f85900b5740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f858f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859015cf20 0x7f85900b5740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35652/0 (socket says 172.21.15.132:35652) 2023-12-20T04:43:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f858f7fe640 1 -- 172.21.15.132:0/21671566 learned_addr learned my addr 172.21.15.132:0/21671566 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f858ffff640 1 --2- 172.21.15.132:0/21671566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85900cd4b0 0x7f859015a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f858f7fe640 1 -- 172.21.15.132:0/21671566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859015d300 msgr2=0x7f85901591f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f858f7fe640 1 --2- 172.21.15.132:0/21671566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859015d300 0x7f85901591f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f858f7fe640 1 -- 172.21.15.132:0/21671566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85900cd4b0 msgr2=0x7f859015a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f858f7fe640 1 --2- 172.21.15.132:0/21671566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85900cd4b0 0x7f859015a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f858f7fe640 1 -- 172.21.15.132:0/21671566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8580009400 con 0x7f859015cf20 2023-12-20T04:43:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f858ffff640 1 --2- 172.21.15.132:0/21671566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85900cd4b0 0x7f859015a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f858f7fe640 1 --2- 172.21.15.132:0/21671566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859015cf20 0x7f85900b5740 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f858400d800 tx=0x7f858400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f858cff9640 1 -- 172.21.15.132:0/21671566 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858400b6c0 con 0x7f859015cf20 2023-12-20T04:43:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f858cff9640 1 -- 172.21.15.132:0/21671566 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f858400b820 con 0x7f859015cf20 2023-12-20T04:43:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f85963fa640 1 -- 172.21.15.132:0/21671566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859015ae80 con 0x7f859015cf20 2023-12-20T04:43:20.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.501+0000 7f858cff9640 1 -- 172.21.15.132:0/21671566 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f858400bbb0 con 0x7f859015cf20 2023-12-20T04:43:20.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.502+0000 7f85963fa640 1 -- 172.21.15.132:0/21671566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859015b440 con 0x7f859015cf20 2023-12-20T04:43:20.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.502+0000 7f85963fa640 1 -- 172.21.15.132:0/21671566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f859004e840 con 0x7f859015cf20 2023-12-20T04:43:20.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.503+0000 7f858cff9640 1 -- 172.21.15.132:0/21671566 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f858400bd10 con 0x7f859015cf20 2023-12-20T04:43:20.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.503+0000 7f858cff9640 1 --2- 172.21.15.132:0/21671566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f857c06a460 0x7f857c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.503+0000 7f858cff9640 1 -- 172.21.15.132:0/21671566 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8584088de0 con 0x7f859015cf20 2023-12-20T04:43:20.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.503+0000 7f858ffff640 1 --2- 172.21.15.132:0/21671566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f857c06a460 0x7f857c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.504+0000 7f858ffff640 1 --2- 172.21.15.132:0/21671566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f857c06a460 0x7f857c06c920 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8580036000 tx=0x7f8580008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:20.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.508+0000 7f858cff9640 1 -- 172.21.15.132:0/21671566 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f85840543d0 con 0x7f859015cf20 2023-12-20T04:43:20.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.670+0000 7f85963fa640 1 -- 172.21.15.132:0/21671566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f85900b2890 con 0x7f859015cf20 2023-12-20T04:43:20.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.671+0000 7f858cff9640 1 -- 172.21.15.132:0/21671566 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f85840579f0 con 0x7f859015cf20 2023-12-20T04:43:20.673 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:43:20.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.673+0000 7f85963fa640 1 -- 172.21.15.132:0/21671566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f857c06a460 msgr2=0x7f857c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.673+0000 7f85963fa640 1 --2- 172.21.15.132:0/21671566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f857c06a460 0x7f857c06c920 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f8580036000 tx=0x7f8580008030 comp rx=0 tx=0).stop 2023-12-20T04:43:20.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.673+0000 7f85963fa640 1 -- 172.21.15.132:0/21671566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859015cf20 msgr2=0x7f85900b5740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.673+0000 7f85963fa640 1 --2- 172.21.15.132:0/21671566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859015cf20 0x7f85900b5740 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f858400d800 tx=0x7f858400dcc0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.673+0000 7f85963fa640 1 -- 172.21.15.132:0/21671566 shutdown_connections 2023-12-20T04:43:20.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.673+0000 7f85963fa640 1 --2- 172.21.15.132:0/21671566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f857c06a460 0x7f857c06c920 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.673+0000 7f85963fa640 1 --2- 172.21.15.132:0/21671566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f859015d300 0x7f85901591f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.673+0000 7f85963fa640 1 --2- 172.21.15.132:0/21671566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f859015cf20 0x7f85900b5740 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.673+0000 7f85963fa640 1 --2- 172.21.15.132:0/21671566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f85900cd4b0 0x7f859015a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.673+0000 7f85963fa640 1 -- 172.21.15.132:0/21671566 >> 172.21.15.132:0/21671566 conn(0x7f8590072c60 msgr2=0x7f85900b1e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:20.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.673+0000 7f85963fa640 1 -- 172.21.15.132:0/21671566 shutdown_connections 2023-12-20T04:43:20.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.673+0000 7f85963fa640 1 -- 172.21.15.132:0/21671566 wait complete. 2023-12-20T04:43:20.686 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:43:20.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.786+0000 7f334ec0b640 1 Processor -- start 2023-12-20T04:43:20.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.786+0000 7f334ec0b640 1 -- start start 2023-12-20T04:43:20.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.787+0000 7f334ec0b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33480cf1d0 0x7f334815e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.787+0000 7f334ec0b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33480c5890 con 0x7f33480ce7e0 2023-12-20T04:43:20.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.787+0000 7f334ec0b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f334815e740 con 0x7f3348070460 2023-12-20T04:43:20.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.787+0000 7f334ec0b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33480cb6b0 con 0x7f33480cf1d0 2023-12-20T04:43:20.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.787+0000 7f334d1a8640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f33480ce7e0 0x7f33480c5180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60082/0 (socket says 172.21.15.132:60082) 2023-12-20T04:43:20.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.787+0000 7f334d1a8640 1 -- 172.21.15.132:0/84174222 learned_addr learned my addr 172.21.15.132:0/84174222 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:20.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f33477fe640 1 -- 172.21.15.132:0/84174222 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293065699 0 0) 0x7f33480c5890 con 0x7f33480ce7e0 2023-12-20T04:43:20.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f33477fe640 1 -- 172.21.15.132:0/84174222 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3338003520 con 0x7f33480ce7e0 2023-12-20T04:43:20.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f334c9a7640 1 --2- 172.21.15.132:0/84174222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33480cf1d0 0x7f334815e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f33477fe640 1 -- 172.21.15.132:0/84174222 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2570450278 0 0) 0x7f3338003520 con 0x7f33480ce7e0 2023-12-20T04:43:20.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f33477fe640 1 -- 172.21.15.132:0/84174222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33480cf1d0 msgr2=0x7f334815e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:20.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f33477fe640 1 --2- 172.21.15.132:0/84174222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33480cf1d0 0x7f334815e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f33477fe640 1 -- 172.21.15.132:0/84174222 >> v1:172.21.15.187:6789/0 conn(0x7f3348070460 legacy=0x7f33480c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f33477fe640 1 -- 172.21.15.132:0/84174222 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33480cb990 con 0x7f33480ce7e0 2023-12-20T04:43:20.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f33477fe640 1 -- 172.21.15.132:0/84174222 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f33400019f0 con 0x7f33480ce7e0 2023-12-20T04:43:20.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f33477fe640 1 -- 172.21.15.132:0/84174222 >> v1:172.21.15.132:6789/0 conn(0x7f33480ce7e0 legacy=0x7f33480c5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f33477fe640 1 --2- 172.21.15.132:0/84174222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33480cf1d0 0x7f33380039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f33477fe640 1 --2- 172.21.15.132:0/84174222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3338003f20 0x7f33380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f33477fe640 1 --2- 172.21.15.132:0/84174222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3338004d00 0x7f3338005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f33477fe640 1 -- 172.21.15.132:0/84174222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33480cb6b0 con 0x7f3338004d00 2023-12-20T04:43:20.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f33477fe640 1 -- 172.21.15.132:0/84174222 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f333800ba60 con 0x7f3338003f20 2023-12-20T04:43:20.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f33477fe640 1 -- 172.21.15.132:0/84174222 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f333800bc20 con 0x7f33480cf1d0 2023-12-20T04:43:20.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f334d1a8640 1 --2- 172.21.15.132:0/84174222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3338004d00 0x7f3338005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f3347fff640 1 --2- 172.21.15.132:0/84174222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3338003f20 0x7f33380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f334c9a7640 1 --2- 172.21.15.132:0/84174222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33480cf1d0 0x7f33380039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f334d1a8640 1 -- 172.21.15.132:0/84174222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33480cf1d0 msgr2=0x7f33380039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:20.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f334d1a8640 1 --2- 172.21.15.132:0/84174222 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33480cf1d0 0x7f33380039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f334d1a8640 1 -- 172.21.15.132:0/84174222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3338003f20 msgr2=0x7f33380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:20.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f334d1a8640 1 --2- 172.21.15.132:0/84174222 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3338003f20 0x7f33380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.788+0000 7f334d1a8640 1 -- 172.21.15.132:0/84174222 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338003520 con 0x7f3338004d00 2023-12-20T04:43:20.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.789+0000 7f334d1a8640 1 --2- 172.21.15.132:0/84174222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3338004d00 0x7f3338005180 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f334000a7f0 tx=0x7f33380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fc3ffcc5a8ff5a0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:20.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.789+0000 7f33477fe640 1 -- 172.21.15.132:0/84174222 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3340034630 con 0x7f3338004d00 2023-12-20T04:43:20.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.789+0000 7f33477fe640 1 -- 172.21.15.132:0/84174222 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f334002f070 con 0x7f3338004d00 2023-12-20T04:43:20.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.789+0000 7f33477fe640 1 -- 172.21.15.132:0/84174222 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33400349f0 con 0x7f3338004d00 2023-12-20T04:43:20.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.790+0000 7f334ec0b640 1 -- 172.21.15.132:0/84174222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3338004d00 msgr2=0x7f3338005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.790+0000 7f334ec0b640 1 --2- 172.21.15.132:0/84174222 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3338004d00 0x7f3338005180 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f334000a7f0 tx=0x7f33380057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.790+0000 7f334d1a8640 1 -- 172.21.15.132:0/84174222 reap_dead start 2023-12-20T04:43:20.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.790+0000 7f334ec0b640 1 -- 172.21.15.132:0/84174222 shutdown_connections 2023-12-20T04:43:20.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.790+0000 7f334ec0b640 1 -- 172.21.15.132:0/84174222 >> 172.21.15.132:0/84174222 conn(0x7f33480cc630 msgr2=0x7f33480cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:20.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.790+0000 7f334ec0b640 1 -- 172.21.15.132:0/84174222 shutdown_connections 2023-12-20T04:43:20.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.790+0000 7f334ec0b640 1 -- 172.21.15.132:0/84174222 wait complete. 2023-12-20T04:43:20.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.791+0000 7f334ec0b640 1 Processor -- start 2023-12-20T04:43:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.791+0000 7f334ec0b640 1 -- start start 2023-12-20T04:43:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f334ec0b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33481424b0 0x7f334806d460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f334ec0b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3348142890 0x7f33480af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f334ec0b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33480c8dc0 0x7f33480c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f334ec0b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33480aecd0 con 0x7f3348142890 2023-12-20T04:43:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f334ec0b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33480c97b0 con 0x7f33481424b0 2023-12-20T04:43:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f334ec0b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33480ae050 con 0x7f33480c8dc0 2023-12-20T04:43:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f3347fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3348142890 0x7f33480af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f3347fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3348142890 0x7f33480af0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35668/0 (socket says 172.21.15.132:35668) 2023-12-20T04:43:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f3347fff640 1 -- 172.21.15.132:0/1242905625 learned_addr learned my addr 172.21.15.132:0/1242905625 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f334c9a7640 1 --2- 172.21.15.132:0/1242905625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33481424b0 0x7f334806d460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f334d1a8640 1 --2- 172.21.15.132:0/1242905625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33480c8dc0 0x7f33480c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f3347fff640 1 -- 172.21.15.132:0/1242905625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33480c8dc0 msgr2=0x7f33480c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f3347fff640 1 --2- 172.21.15.132:0/1242905625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33480c8dc0 0x7f33480c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f3347fff640 1 -- 172.21.15.132:0/1242905625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33481424b0 msgr2=0x7f334806d460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f3347fff640 1 --2- 172.21.15.132:0/1242905625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33481424b0 0x7f334806d460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f3347fff640 1 -- 172.21.15.132:0/1242905625 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33480ae330 con 0x7f3348142890 2023-12-20T04:43:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f334d1a8640 1 --2- 172.21.15.132:0/1242905625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33480c8dc0 0x7f33480c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.792+0000 7f3347fff640 1 --2- 172.21.15.132:0/1242905625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3348142890 0x7f33480af0f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f333400f820 tx=0x7f333400fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.793+0000 7f33457fa640 1 -- 172.21.15.132:0/1242905625 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33340050d0 con 0x7f3348142890 2023-12-20T04:43:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.793+0000 7f33457fa640 1 -- 172.21.15.132:0/1242905625 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3334005230 con 0x7f3348142890 2023-12-20T04:43:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.793+0000 7f334ec0b640 1 -- 172.21.15.132:0/1242905625 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33480ae610 con 0x7f3348142890 2023-12-20T04:43:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.793+0000 7f33457fa640 1 -- 172.21.15.132:0/1242905625 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333400d730 con 0x7f3348142890 2023-12-20T04:43:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.793+0000 7f334ec0b640 1 -- 172.21.15.132:0/1242905625 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33480af630 con 0x7f3348142890 2023-12-20T04:43:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.794+0000 7f334ec0b640 1 -- 172.21.15.132:0/1242905625 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f334804e840 con 0x7f3348142890 2023-12-20T04:43:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.794+0000 7f33457fa640 1 -- 172.21.15.132:0/1242905625 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f333400d890 con 0x7f3348142890 2023-12-20T04:43:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.794+0000 7f33457fa640 1 --2- 172.21.15.132:0/1242905625 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f332c06a430 0x7f332c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:20.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.795+0000 7f33457fa640 1 -- 172.21.15.132:0/1242905625 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3334088700 con 0x7f3348142890 2023-12-20T04:43:20.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.795+0000 7f334c9a7640 1 --2- 172.21.15.132:0/1242905625 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f332c06a430 0x7f332c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:20.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.795+0000 7f334c9a7640 1 --2- 172.21.15.132:0/1242905625 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f332c06a430 0x7f332c06c8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f333c009bc0 tx=0x7f333c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:20.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.799+0000 7f33457fa640 1 -- 172.21.15.132:0/1242905625 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3334053d80 con 0x7f3348142890 2023-12-20T04:43:20.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.966+0000 7f334ec0b640 1 -- 172.21.15.132:0/1242905625 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f33480717c0 con 0x7f3348142890 2023-12-20T04:43:20.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.966+0000 7f33457fa640 1 -- 172.21.15.132:0/1242905625 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f33340573a0 con 0x7f3348142890 2023-12-20T04:43:20.968 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:43:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.968+0000 7f334ec0b640 1 -- 172.21.15.132:0/1242905625 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f332c06a430 msgr2=0x7f332c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.968+0000 7f334ec0b640 1 --2- 172.21.15.132:0/1242905625 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f332c06a430 0x7f332c06c8f0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f333c009bc0 tx=0x7f333c009190 comp rx=0 tx=0).stop 2023-12-20T04:43:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.968+0000 7f334ec0b640 1 -- 172.21.15.132:0/1242905625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3348142890 msgr2=0x7f33480af0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:20.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.968+0000 7f334ec0b640 1 --2- 172.21.15.132:0/1242905625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3348142890 0x7f33480af0f0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f333400f820 tx=0x7f333400fc20 comp rx=0 tx=0).stop 2023-12-20T04:43:20.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.968+0000 7f334ec0b640 1 -- 172.21.15.132:0/1242905625 shutdown_connections 2023-12-20T04:43:20.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.969+0000 7f334ec0b640 1 --2- 172.21.15.132:0/1242905625 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f332c06a430 0x7f332c06c8f0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.969+0000 7f334ec0b640 1 --2- 172.21.15.132:0/1242905625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33480c8dc0 0x7f33480c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.969+0000 7f334ec0b640 1 --2- 172.21.15.132:0/1242905625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3348142890 0x7f33480af0f0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.969+0000 7f334ec0b640 1 --2- 172.21.15.132:0/1242905625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33481424b0 0x7f334806d460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:20.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.969+0000 7f334ec0b640 1 -- 172.21.15.132:0/1242905625 >> 172.21.15.132:0/1242905625 conn(0x7f33480cc630 msgr2=0x7f33480b48d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:20.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.969+0000 7f334ec0b640 1 -- 172.21.15.132:0/1242905625 shutdown_connections 2023-12-20T04:43:20.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:20.969+0000 7f334ec0b640 1 -- 172.21.15.132:0/1242905625 wait complete. 2023-12-20T04:43:20.981 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:43:21.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.081+0000 7f88cef8b640 1 Processor -- start 2023-12-20T04:43:21.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.081+0000 7f88cef8b640 1 -- start start 2023-12-20T04:43:21.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.082+0000 7f88cef8b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f88c815cf20 0x7f88c806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.082+0000 7f88cef8b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c815d300 0x7f88c8161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.082+0000 7f88cef8b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f88c80cd4b0 0x7f88c80cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.082+0000 7f88cef8b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c80cde40 con 0x7f88c80cd4b0 2023-12-20T04:43:21.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.082+0000 7f88cef8b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88c8161c40 con 0x7f88c815cf20 2023-12-20T04:43:21.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.082+0000 7f88cef8b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c806cc90 con 0x7f88c815d300 2023-12-20T04:43:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.082+0000 7f88cd528640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f88c80cd4b0 0x7f88c80cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.082+0000 7f88cd528640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f88c80cd4b0 0x7f88c80cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35670/0 (socket says 172.21.15.132:35670) 2023-12-20T04:43:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.082+0000 7f88cd528640 1 -- 172.21.15.132:0/1408979734 learned_addr learned my addr 172.21.15.132:0/1408979734 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.083+0000 7f88ccd27640 1 --2- 172.21.15.132:0/1408979734 >> v2:172.21.15.187:3300/0 conn(0x7f88c815cf20 0x7f88c806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.083+0000 7f88cd528640 1 -- 172.21.15.132:0/1408979734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c815d300 msgr2=0x7f88c8161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.083+0000 7f88cd528640 1 --2- 172.21.15.132:0/1408979734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c815d300 0x7f88c8161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.083+0000 7f88cd528640 1 -- 172.21.15.132:0/1408979734 >> v2:172.21.15.187:3300/0 conn(0x7f88c815cf20 msgr2=0x7f88c806c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.083+0000 7f88cd528640 1 --2- 172.21.15.132:0/1408979734 >> v2:172.21.15.187:3300/0 conn(0x7f88c815cf20 0x7f88c806c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.083+0000 7f88cd528640 1 -- 172.21.15.132:0/1408979734 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c80b2f30 con 0x7f88c80cd4b0 2023-12-20T04:43:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.083+0000 7f88ccd27640 1 --2- 172.21.15.132:0/1408979734 >> v2:172.21.15.187:3300/0 conn(0x7f88c815cf20 0x7f88c806c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.083+0000 7f88cd528640 1 --2- 172.21.15.132:0/1408979734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88c80cd4b0 0x7f88c80cd900 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f88c8071180 tx=0x7f88c002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d1333b3db03c629 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.083+0000 7f88c77fe640 1 -- 172.21.15.132:0/1408979734 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c002ca70 con 0x7f88c80cd4b0 2023-12-20T04:43:21.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.084+0000 7f88c77fe640 1 -- 172.21.15.132:0/1408979734 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c002cbd0 con 0x7f88c80cd4b0 2023-12-20T04:43:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.084+0000 7f88c77fe640 1 -- 172.21.15.132:0/1408979734 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c00343f0 con 0x7f88c80cd4b0 2023-12-20T04:43:21.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.084+0000 7f88cef8b640 1 -- 172.21.15.132:0/1408979734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88c80cd4b0 msgr2=0x7f88c80cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:21.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.084+0000 7f88cef8b640 1 --2- 172.21.15.132:0/1408979734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88c80cd4b0 0x7f88c80cd900 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f88c8071180 tx=0x7f88c002bed0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.084+0000 7f88cef8b640 1 -- 172.21.15.132:0/1408979734 shutdown_connections 2023-12-20T04:43:21.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.084+0000 7f88cef8b640 1 --2- 172.21.15.132:0/1408979734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88c80cd4b0 0x7f88c80cd900 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.084+0000 7f88cef8b640 1 --2- 172.21.15.132:0/1408979734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c815d300 0x7f88c8161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.084+0000 7f88cef8b640 1 --2- 172.21.15.132:0/1408979734 >> v2:172.21.15.187:3300/0 conn(0x7f88c815cf20 0x7f88c806c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.084+0000 7f88cef8b640 1 -- 172.21.15.132:0/1408979734 >> 172.21.15.132:0/1408979734 conn(0x7f88c8072c60 msgr2=0x7f88c8073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:21.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.084+0000 7f88cef8b640 1 -- 172.21.15.132:0/1408979734 shutdown_connections 2023-12-20T04:43:21.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.084+0000 7f88cef8b640 1 -- 172.21.15.132:0/1408979734 wait complete. 2023-12-20T04:43:21.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.085+0000 7f88cef8b640 1 Processor -- start 2023-12-20T04:43:21.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.085+0000 7f88cef8b640 1 -- start start 2023-12-20T04:43:21.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.086+0000 7f88cef8b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88c80cd4b0 0x7f88c815d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.086+0000 7f88cef8b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c815cf20 0x7f88c815aa80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.086+0000 7f88cef8b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88c815d300 0x7f88c815afc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.086+0000 7f88cef8b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c81f6c10 con 0x7f88c815d300 2023-12-20T04:43:21.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.086+0000 7f88cef8b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88c81f5f90 con 0x7f88c80cd4b0 2023-12-20T04:43:21.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.086+0000 7f88cef8b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88c81f6270 con 0x7f88c815cf20 2023-12-20T04:43:21.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.086+0000 7f88cd528640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88c815d300 0x7f88c815afc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.086+0000 7f88cd528640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88c815d300 0x7f88c815afc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35680/0 (socket says 172.21.15.132:35680) 2023-12-20T04:43:21.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.086+0000 7f88cd528640 1 -- 172.21.15.132:0/2881300891 learned_addr learned my addr 172.21.15.132:0/2881300891 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:21.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.087+0000 7f88ccd27640 1 --2- 172.21.15.132:0/2881300891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88c80cd4b0 0x7f88c815d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.087+0000 7f88c7fff640 1 --2- 172.21.15.132:0/2881300891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c815cf20 0x7f88c815aa80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.087+0000 7f88cd528640 1 -- 172.21.15.132:0/2881300891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c815cf20 msgr2=0x7f88c815aa80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:21.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.087+0000 7f88cd528640 1 --2- 172.21.15.132:0/2881300891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c815cf20 0x7f88c815aa80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.087+0000 7f88cd528640 1 -- 172.21.15.132:0/2881300891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88c80cd4b0 msgr2=0x7f88c815d9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:21.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.087+0000 7f88cd528640 1 --2- 172.21.15.132:0/2881300891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88c80cd4b0 0x7f88c815d9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.087+0000 7f88cd528640 1 -- 172.21.15.132:0/2881300891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88c0009b30 con 0x7f88c815d300 2023-12-20T04:43:21.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.087+0000 7f88ccd27640 1 --2- 172.21.15.132:0/2881300891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88c80cd4b0 0x7f88c815d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:21.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.087+0000 7f88c7fff640 1 --2- 172.21.15.132:0/2881300891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c815cf20 0x7f88c815aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:21.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.087+0000 7f88cd528640 1 --2- 172.21.15.132:0/2881300891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88c815d300 0x7f88c815afc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f88c0036040 tx=0x7f88c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:21.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.087+0000 7f88c57fa640 1 -- 172.21.15.132:0/2881300891 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c003e450 con 0x7f88c815d300 2023-12-20T04:43:21.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.087+0000 7f88c57fa640 1 -- 172.21.15.132:0/2881300891 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88c003e5d0 con 0x7f88c815d300 2023-12-20T04:43:21.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.087+0000 7f88cef8b640 1 -- 172.21.15.132:0/2881300891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88c81f6550 con 0x7f88c815d300 2023-12-20T04:43:21.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.087+0000 7f88c57fa640 1 -- 172.21.15.132:0/2881300891 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88c003e980 con 0x7f88c815d300 2023-12-20T04:43:21.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.087+0000 7f88cef8b640 1 -- 172.21.15.132:0/2881300891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88c815df30 con 0x7f88c815d300 2023-12-20T04:43:21.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.088+0000 7f88cef8b640 1 -- 172.21.15.132:0/2881300891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88c81f6d50 con 0x7f88c815d300 2023-12-20T04:43:21.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.088+0000 7f88c57fa640 1 -- 172.21.15.132:0/2881300891 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f88c003eae0 con 0x7f88c815d300 2023-12-20T04:43:21.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.089+0000 7f88c57fa640 1 --2- 172.21.15.132:0/2881300891 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f88b406a460 0x7f88b406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.089+0000 7f88c57fa640 1 -- 172.21.15.132:0/2881300891 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88c00ab490 con 0x7f88c815d300 2023-12-20T04:43:21.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.089+0000 7f88ccd27640 1 --2- 172.21.15.132:0/2881300891 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f88b406a460 0x7f88b406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.089+0000 7f88ccd27640 1 --2- 172.21.15.132:0/2881300891 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f88b406a460 0x7f88b406c920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f88b8006fd0 tx=0x7f88b8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:21.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.093+0000 7f88c57fa640 1 -- 172.21.15.132:0/2881300891 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f88c81f6d50 con 0x7f88c815d300 2023-12-20T04:43:21.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.259+0000 7f88cef8b640 1 -- 172.21.15.132:0/2881300891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f88c81f6d50 con 0x7f88c815d300 2023-12-20T04:43:21.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.259+0000 7f88c57fa640 1 -- 172.21.15.132:0/2881300891 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f88c81f6d50 con 0x7f88c815d300 2023-12-20T04:43:21.261 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:43:21.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.261+0000 7f88cef8b640 1 -- 172.21.15.132:0/2881300891 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f88b406a460 msgr2=0x7f88b406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:21.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.261+0000 7f88cef8b640 1 --2- 172.21.15.132:0/2881300891 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f88b406a460 0x7f88b406c920 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f88b8006fd0 tx=0x7f88b8008040 comp rx=0 tx=0).stop 2023-12-20T04:43:21.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.261+0000 7f88cef8b640 1 -- 172.21.15.132:0/2881300891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88c815d300 msgr2=0x7f88c815afc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:21.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.261+0000 7f88cef8b640 1 --2- 172.21.15.132:0/2881300891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88c815d300 0x7f88c815afc0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f88c0036040 tx=0x7f88c0004a40 comp rx=0 tx=0).stop 2023-12-20T04:43:21.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.261+0000 7f88cef8b640 1 -- 172.21.15.132:0/2881300891 shutdown_connections 2023-12-20T04:43:21.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.261+0000 7f88cef8b640 1 --2- 172.21.15.132:0/2881300891 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f88b406a460 0x7f88b406c920 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.261+0000 7f88cef8b640 1 --2- 172.21.15.132:0/2881300891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88c815d300 0x7f88c815afc0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.261+0000 7f88cef8b640 1 --2- 172.21.15.132:0/2881300891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88c815cf20 0x7f88c815aa80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.261+0000 7f88cef8b640 1 --2- 172.21.15.132:0/2881300891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88c80cd4b0 0x7f88c815d9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.261+0000 7f88cef8b640 1 -- 172.21.15.132:0/2881300891 >> 172.21.15.132:0/2881300891 conn(0x7f88c8072c60 msgr2=0x7f88c8065910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:21.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.261+0000 7f88cef8b640 1 -- 172.21.15.132:0/2881300891 shutdown_connections 2023-12-20T04:43:21.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.261+0000 7f88cef8b640 1 -- 172.21.15.132:0/2881300891 wait complete. 2023-12-20T04:43:21.274 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:43:21.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.373+0000 7f24ad927640 1 Processor -- start 2023-12-20T04:43:21.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.373+0000 7f24ad927640 1 -- start start 2023-12-20T04:43:21.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.373+0000 7f24ad927640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f24a80d30a0 0x7f24a80cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.373+0000 7f24ad927640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f24a815d2c0 0x7f24a80d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.373+0000 7f24ad927640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24a80d0060 0x7f24a8160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.373+0000 7f24ad927640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a80d0cf0 con 0x7f24a815d2c0 2023-12-20T04:43:21.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.373+0000 7f24ad927640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f24a80d39c0 con 0x7f24a80d30a0 2023-12-20T04:43:21.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.373+0000 7f24ad927640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80d0550 con 0x7f24a80d0060 2023-12-20T04:43:21.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.374+0000 7f24a67fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f24a815d2c0 0x7f24a80d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.374+0000 7f24a67fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f24a815d2c0 0x7f24a80d3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35686/0 (socket says 172.21.15.132:35686) 2023-12-20T04:43:21.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.374+0000 7f24a67fc640 1 -- 172.21.15.132:0/2014206519 learned_addr learned my addr 172.21.15.132:0/2014206519 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:21.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.374+0000 7f24a6ffd640 1 --2- 172.21.15.132:0/2014206519 >> v2:172.21.15.187:3300/0 conn(0x7f24a80d30a0 0x7f24a80cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.374+0000 7f24a77fe640 1 --2- 172.21.15.132:0/2014206519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24a80d0060 0x7f24a8160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.374+0000 7f24a67fc640 1 -- 172.21.15.132:0/2014206519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24a80d0060 msgr2=0x7f24a8160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:21.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.374+0000 7f24a67fc640 1 --2- 172.21.15.132:0/2014206519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24a80d0060 0x7f24a8160c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.374+0000 7f24a67fc640 1 -- 172.21.15.132:0/2014206519 >> v2:172.21.15.187:3300/0 conn(0x7f24a80d30a0 msgr2=0x7f24a80cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:21.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.374+0000 7f24a67fc640 1 --2- 172.21.15.132:0/2014206519 >> v2:172.21.15.187:3300/0 conn(0x7f24a80d30a0 0x7f24a80cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.374+0000 7f24a67fc640 1 -- 172.21.15.132:0/2014206519 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24a80cddc0 con 0x7f24a815d2c0 2023-12-20T04:43:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.374+0000 7f24a77fe640 1 --2- 172.21.15.132:0/2014206519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24a80d0060 0x7f24a8160c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.375+0000 7f24a67fc640 1 --2- 172.21.15.132:0/2014206519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a815d2c0 0x7f24a80d3480 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f24a8073c00 tx=0x7f249c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6196d5a1e4ed1187 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.375+0000 7f24a5ffb640 1 -- 172.21.15.132:0/2014206519 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c031870 con 0x7f24a815d2c0 2023-12-20T04:43:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.375+0000 7f24a5ffb640 1 -- 172.21.15.132:0/2014206519 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f249c0319d0 con 0x7f24a815d2c0 2023-12-20T04:43:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.375+0000 7f24a5ffb640 1 -- 172.21.15.132:0/2014206519 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f249c031d60 con 0x7f24a815d2c0 2023-12-20T04:43:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.375+0000 7f24ad927640 1 -- 172.21.15.132:0/2014206519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a815d2c0 msgr2=0x7f24a80d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.375+0000 7f24ad927640 1 --2- 172.21.15.132:0/2014206519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a815d2c0 0x7f24a80d3480 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f24a8073c00 tx=0x7f249c02b910 comp rx=0 tx=0).stop 2023-12-20T04:43:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.375+0000 7f24ad927640 1 -- 172.21.15.132:0/2014206519 shutdown_connections 2023-12-20T04:43:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.375+0000 7f24ad927640 1 --2- 172.21.15.132:0/2014206519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24a80d0060 0x7f24a8160c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.375+0000 7f24ad927640 1 --2- 172.21.15.132:0/2014206519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a815d2c0 0x7f24a80d3480 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.375+0000 7f24ad927640 1 --2- 172.21.15.132:0/2014206519 >> v2:172.21.15.187:3300/0 conn(0x7f24a80d30a0 0x7f24a80cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.375+0000 7f24ad927640 1 -- 172.21.15.132:0/2014206519 >> 172.21.15.132:0/2014206519 conn(0x7f24a8072e40 msgr2=0x7f24a8073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:21.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.375+0000 7f24ad927640 1 -- 172.21.15.132:0/2014206519 shutdown_connections 2023-12-20T04:43:21.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.375+0000 7f24ad927640 1 -- 172.21.15.132:0/2014206519 wait complete. 2023-12-20T04:43:21.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.376+0000 7f24ad927640 1 Processor -- start 2023-12-20T04:43:21.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.377+0000 7f24ad927640 1 -- start start 2023-12-20T04:43:21.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.377+0000 7f24ad927640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a80d0060 0x7f24a80c6740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.377+0000 7f24ad927640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24a80d30a0 0x7f24a8154210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.377+0000 7f24ad927640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24a815d2c0 0x7f24a815e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.377+0000 7f24ad927640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a81602a0 con 0x7f24a80d0060 2023-12-20T04:43:21.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.377+0000 7f24ad927640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24a80cbb60 con 0x7f24a80d30a0 2023-12-20T04:43:21.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.377+0000 7f24ad927640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24a815ec90 con 0x7f24a815d2c0 2023-12-20T04:43:21.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.377+0000 7f24a6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a80d0060 0x7f24a80c6740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.377+0000 7f24a6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a80d0060 0x7f24a80c6740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35694/0 (socket says 172.21.15.132:35694) 2023-12-20T04:43:21.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.377+0000 7f24a6ffd640 1 -- 172.21.15.132:0/2673876294 learned_addr learned my addr 172.21.15.132:0/2673876294 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:21.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.378+0000 7f24a67fc640 1 --2- 172.21.15.132:0/2673876294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24a80d30a0 0x7f24a8154210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.378+0000 7f24a77fe640 1 --2- 172.21.15.132:0/2673876294 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24a815d2c0 0x7f24a815e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.378+0000 7f24a6ffd640 1 -- 172.21.15.132:0/2673876294 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24a815d2c0 msgr2=0x7f24a815e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:21.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.378+0000 7f24a6ffd640 1 --2- 172.21.15.132:0/2673876294 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24a815d2c0 0x7f24a815e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.378+0000 7f24a6ffd640 1 -- 172.21.15.132:0/2673876294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24a80d30a0 msgr2=0x7f24a8154210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:21.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.378+0000 7f24a6ffd640 1 --2- 172.21.15.132:0/2673876294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24a80d30a0 0x7f24a8154210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.378+0000 7f24a6ffd640 1 -- 172.21.15.132:0/2673876294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f249c0094d0 con 0x7f24a80d0060 2023-12-20T04:43:21.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.378+0000 7f24a6ffd640 1 --2- 172.21.15.132:0/2673876294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a80d0060 0x7f24a80c6740 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f24a000e870 tx=0x7f24a000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:21.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.378+0000 7f248ffff640 1 -- 172.21.15.132:0/2673876294 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a00094f0 con 0x7f24a80d0060 2023-12-20T04:43:21.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.378+0000 7f248ffff640 1 -- 172.21.15.132:0/2673876294 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f24a000c940 con 0x7f24a80d0060 2023-12-20T04:43:21.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.378+0000 7f248ffff640 1 -- 172.21.15.132:0/2673876294 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24a000ccf0 con 0x7f24a80d0060 2023-12-20T04:43:21.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.378+0000 7f24ad927640 1 -- 172.21.15.132:0/2673876294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24a80cb230 con 0x7f24a80d0060 2023-12-20T04:43:21.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.378+0000 7f24ad927640 1 -- 172.21.15.132:0/2673876294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24a80cb7f0 con 0x7f24a80d0060 2023-12-20T04:43:21.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.379+0000 7f24ad927640 1 -- 172.21.15.132:0/2673876294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24a804e840 con 0x7f24a80d0060 2023-12-20T04:43:21.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.379+0000 7f248ffff640 1 -- 172.21.15.132:0/2673876294 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f24a0013470 con 0x7f24a80d0060 2023-12-20T04:43:21.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.380+0000 7f248ffff640 1 --2- 172.21.15.132:0/2673876294 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f249406a430 0x7f249406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.380+0000 7f248ffff640 1 -- 172.21.15.132:0/2673876294 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f24a00888f0 con 0x7f24a80d0060 2023-12-20T04:43:21.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.380+0000 7f24a67fc640 1 --2- 172.21.15.132:0/2673876294 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f249406a430 0x7f249406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.380+0000 7f24a67fc640 1 --2- 172.21.15.132:0/2673876294 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f249406a430 0x7f249406c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f249c036000 tx=0x7f249c03c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:21.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.384+0000 7f248ffff640 1 -- 172.21.15.132:0/2673876294 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f24a0053f70 con 0x7f24a80d0060 2023-12-20T04:43:21.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.561+0000 7f24ad927640 1 -- 172.21.15.132:0/2673876294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f24a80cdba0 con 0x7f24a80d0060 2023-12-20T04:43:21.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.561+0000 7f248ffff640 1 -- 172.21.15.132:0/2673876294 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f24a0017080 con 0x7f24a80d0060 2023-12-20T04:43:21.563 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:43:21.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.563+0000 7f24ad927640 1 -- 172.21.15.132:0/2673876294 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f249406a430 msgr2=0x7f249406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:21.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.563+0000 7f24ad927640 1 --2- 172.21.15.132:0/2673876294 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f249406a430 0x7f249406c8f0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f249c036000 tx=0x7f249c03c040 comp rx=0 tx=0).stop 2023-12-20T04:43:21.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.563+0000 7f24ad927640 1 -- 172.21.15.132:0/2673876294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a80d0060 msgr2=0x7f24a80c6740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:21.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.563+0000 7f24ad927640 1 --2- 172.21.15.132:0/2673876294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a80d0060 0x7f24a80c6740 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f24a000e870 tx=0x7f24a000ed30 comp rx=0 tx=0).stop 2023-12-20T04:43:21.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.563+0000 7f24ad927640 1 -- 172.21.15.132:0/2673876294 shutdown_connections 2023-12-20T04:43:21.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.563+0000 7f24ad927640 1 --2- 172.21.15.132:0/2673876294 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f249406a430 0x7f249406c8f0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.563+0000 7f24ad927640 1 --2- 172.21.15.132:0/2673876294 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f24a815d2c0 0x7f24a815e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.563+0000 7f24ad927640 1 --2- 172.21.15.132:0/2673876294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24a80d30a0 0x7f24a8154210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.563+0000 7f24ad927640 1 --2- 172.21.15.132:0/2673876294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f24a80d0060 0x7f24a80c6740 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.563+0000 7f24ad927640 1 -- 172.21.15.132:0/2673876294 >> 172.21.15.132:0/2673876294 conn(0x7f24a8072e40 msgr2=0x7f24a80d1060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:21.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.563+0000 7f24ad927640 1 -- 172.21.15.132:0/2673876294 shutdown_connections 2023-12-20T04:43:21.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.563+0000 7f24ad927640 1 -- 172.21.15.132:0/2673876294 wait complete. 2023-12-20T04:43:21.576 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2023-12-20T04:43:21.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:21.577 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-20T04:43:21.603 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:43:21.603 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:43:21.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:21.604 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-20T04:43:21.668 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:43:21.668 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:43:21.687 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:43:21.687 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:43:21.747 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:21.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.845+0000 7f375978b640 1 Processor -- start 2023-12-20T04:43:21.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.845+0000 7f375978b640 1 -- start start 2023-12-20T04:43:21.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.846+0000 7f375978b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f37541588e0 0x7f3754069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.846+0000 7f375978b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375406ea90 con 0x7f375406a170 2023-12-20T04:43:21.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.846+0000 7f375978b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f375406e160 con 0x7f375406cf00 2023-12-20T04:43:21.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.846+0000 7f375978b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f375406d520 con 0x7f37541588e0 2023-12-20T04:43:21.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.846+0000 7f3752ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f37541588e0 0x7f3754069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.846+0000 7f37527fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f375406a170 0x7f375406c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60092/0 (socket says 172.21.15.132:60092) 2023-12-20T04:43:21.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.846+0000 7f37527fc640 1 -- 172.21.15.132:0/87551618 learned_addr learned my addr 172.21.15.132:0/87551618 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:21.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.846+0000 7f3752ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f37541588e0 0x7f3754069c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35700/0 (socket says 172.21.15.132:35700) 2023-12-20T04:43:21.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.847+0000 7f3752ffd640 1 -- 172.21.15.132:0/87551618 >> v1:172.21.15.187:6789/0 conn(0x7f375406cf00 legacy=0x7f37540b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:21.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.847+0000 7f3752ffd640 1 -- 172.21.15.132:0/87551618 >> v1:172.21.15.132:6789/0 conn(0x7f375406a170 legacy=0x7f375406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:21.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.847+0000 7f3752ffd640 1 -- 172.21.15.132:0/87551618 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f375406e440 con 0x7f37541588e0 2023-12-20T04:43:21.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.847+0000 7f3751ffb640 1 -- 172.21.15.132:0/87551618 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2714395880 0 0) 0x7f375406ea90 con 0x7f375406a170 2023-12-20T04:43:21.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.847+0000 7f3752ffd640 1 --2- 172.21.15.132:0/87551618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37541588e0 0x7f3754069c30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3744009d90 tx=0x7f374402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9daba29ee7d6cc3c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:21.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.847+0000 7f3751ffb640 1 -- 172.21.15.132:0/87551618 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374402cc60 con 0x7f37541588e0 2023-12-20T04:43:21.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.848+0000 7f3751ffb640 1 -- 172.21.15.132:0/87551618 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374402cdc0 con 0x7f37541588e0 2023-12-20T04:43:21.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.848+0000 7f3751ffb640 1 -- 172.21.15.132:0/87551618 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3744034660 con 0x7f37541588e0 2023-12-20T04:43:21.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.848+0000 7f375978b640 1 -- 172.21.15.132:0/87551618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37541588e0 msgr2=0x7f3754069c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:21.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.848+0000 7f375978b640 1 --2- 172.21.15.132:0/87551618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37541588e0 0x7f3754069c30 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3744009d90 tx=0x7f374402beb0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.848+0000 7f375978b640 1 -- 172.21.15.132:0/87551618 shutdown_connections 2023-12-20T04:43:21.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.848+0000 7f375978b640 1 --2- 172.21.15.132:0/87551618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37541588e0 0x7f3754069c30 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.848+0000 7f375978b640 1 -- 172.21.15.132:0/87551618 >> 172.21.15.132:0/87551618 conn(0x7f37540cfca0 msgr2=0x7f37540d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:21.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.848+0000 7f375978b640 1 -- 172.21.15.132:0/87551618 shutdown_connections 2023-12-20T04:43:21.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.848+0000 7f375978b640 1 -- 172.21.15.132:0/87551618 wait complete. 2023-12-20T04:43:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.849+0000 7f375978b640 1 Processor -- start 2023-12-20T04:43:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.849+0000 7f375978b640 1 -- start start 2023-12-20T04:43:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.850+0000 7f375978b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f375406a170 0x7f37540b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.850+0000 7f375978b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f375406cf00 0x7f37540aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.850+0000 7f375978b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37541588e0 0x7f3754157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.850+0000 7f375978b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37540af400 con 0x7f37541588e0 2023-12-20T04:43:21.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.850+0000 7f375978b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f37540c6d70 con 0x7f375406cf00 2023-12-20T04:43:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.850+0000 7f375978b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f37540cd970 con 0x7f375406a170 2023-12-20T04:43:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.850+0000 7f37537fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37541588e0 0x7f3754157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.850+0000 7f37537fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37541588e0 0x7f3754157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35710/0 (socket says 172.21.15.132:35710) 2023-12-20T04:43:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.850+0000 7f37537fe640 1 -- 172.21.15.132:0/3765147934 learned_addr learned my addr 172.21.15.132:0/3765147934 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.851+0000 7f37527fc640 1 --2- 172.21.15.132:0/3765147934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f375406cf00 0x7f37540aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.851+0000 7f37537fe640 1 -- 172.21.15.132:0/3765147934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f375406a170 msgr2=0x7f37540b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.851+0000 7f3752ffd640 1 --2- 172.21.15.132:0/3765147934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f375406a170 0x7f37540b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.851+0000 7f37537fe640 1 --2- 172.21.15.132:0/3765147934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f375406a170 0x7f37540b39d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.851+0000 7f37537fe640 1 -- 172.21.15.132:0/3765147934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f375406cf00 msgr2=0x7f37540aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.851+0000 7f37537fe640 1 --2- 172.21.15.132:0/3765147934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f375406cf00 0x7f37540aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.851+0000 7f37537fe640 1 -- 172.21.15.132:0/3765147934 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3744009a70 con 0x7f37541588e0 2023-12-20T04:43:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.851+0000 7f37527fc640 1 --2- 172.21.15.132:0/3765147934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f375406cf00 0x7f37540aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.851+0000 7f37537fe640 1 --2- 172.21.15.132:0/3765147934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37541588e0 0x7f3754157500 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f374c00b4c0 tx=0x7f374c00b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.851+0000 7f373b7fe640 1 -- 172.21.15.132:0/3765147934 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c011830 con 0x7f37541588e0 2023-12-20T04:43:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.851+0000 7f373b7fe640 1 -- 172.21.15.132:0/3765147934 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f374c0119b0 con 0x7f37541588e0 2023-12-20T04:43:21.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.851+0000 7f375978b640 1 -- 172.21.15.132:0/3765147934 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f37540b40d0 con 0x7f37541588e0 2023-12-20T04:43:21.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.851+0000 7f373b7fe640 1 -- 172.21.15.132:0/3765147934 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f374c011d60 con 0x7f37541588e0 2023-12-20T04:43:21.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.851+0000 7f375978b640 1 -- 172.21.15.132:0/3765147934 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37540b4690 con 0x7f37541588e0 2023-12-20T04:43:21.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.852+0000 7f375978b640 1 -- 172.21.15.132:0/3765147934 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f375404e840 con 0x7f37541588e0 2023-12-20T04:43:21.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.852+0000 7f373b7fe640 1 -- 172.21.15.132:0/3765147934 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f374c01a410 con 0x7f37541588e0 2023-12-20T04:43:21.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.853+0000 7f373b7fe640 1 --2- 172.21.15.132:0/3765147934 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f374006a460 0x7f374006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:21.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.853+0000 7f373b7fe640 1 -- 172.21.15.132:0/3765147934 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f374c088370 con 0x7f37541588e0 2023-12-20T04:43:21.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.853+0000 7f3752ffd640 1 --2- 172.21.15.132:0/3765147934 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f374006a460 0x7f374006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:21.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.853+0000 7f3752ffd640 1 --2- 172.21.15.132:0/3765147934 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f374006a460 0x7f374006c920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3744036000 tx=0x7f3744030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:21.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:21.857+0000 7f373b7fe640 1 -- 172.21.15.132:0/3765147934 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f374c0539f0 con 0x7f37541588e0 2023-12-20T04:43:22.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.026+0000 7f375978b640 1 -- 172.21.15.132:0/3765147934 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f37540c35b0 con 0x7f37541588e0 2023-12-20T04:43:22.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.027+0000 7f373b7fe640 1 -- 172.21.15.132:0/3765147934 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f374c057010 con 0x7f37541588e0 2023-12-20T04:43:22.029 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:22.029 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:22.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.029+0000 7f375978b640 1 -- 172.21.15.132:0/3765147934 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f374006a460 msgr2=0x7f374006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.029+0000 7f375978b640 1 --2- 172.21.15.132:0/3765147934 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f374006a460 0x7f374006c920 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f3744036000 tx=0x7f3744030000 comp rx=0 tx=0).stop 2023-12-20T04:43:22.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.029+0000 7f375978b640 1 -- 172.21.15.132:0/3765147934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37541588e0 msgr2=0x7f3754157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.029+0000 7f375978b640 1 --2- 172.21.15.132:0/3765147934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37541588e0 0x7f3754157500 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f374c00b4c0 tx=0x7f374c00b980 comp rx=0 tx=0).stop 2023-12-20T04:43:22.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.029+0000 7f375978b640 1 -- 172.21.15.132:0/3765147934 shutdown_connections 2023-12-20T04:43:22.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.029+0000 7f375978b640 1 --2- 172.21.15.132:0/3765147934 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f374006a460 0x7f374006c920 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.029+0000 7f375978b640 1 --2- 172.21.15.132:0/3765147934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f37541588e0 0x7f3754157500 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.029+0000 7f375978b640 1 --2- 172.21.15.132:0/3765147934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f375406cf00 0x7f37540aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.029+0000 7f375978b640 1 --2- 172.21.15.132:0/3765147934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f375406a170 0x7f37540b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.029+0000 7f375978b640 1 -- 172.21.15.132:0/3765147934 >> 172.21.15.132:0/3765147934 conn(0x7f37540cfca0 msgr2=0x7f37540d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:22.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.030+0000 7f375978b640 1 -- 172.21.15.132:0/3765147934 shutdown_connections 2023-12-20T04:43:22.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.030+0000 7f375978b640 1 -- 172.21.15.132:0/3765147934 wait complete. 2023-12-20T04:43:22.043 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:42:45.433456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:42:46.128920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:43:22.043 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:43:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.144+0000 7fca14355640 1 Processor -- start 2023-12-20T04:43:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.144+0000 7fca14355640 1 -- start start 2023-12-20T04:43:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.145+0000 7fca14355640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca0c0c5430 0x7fca0c0cb4b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.145+0000 7fca14355640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fca0c0cb9f0 0x7fca0c06f450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.145+0000 7fca14355640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca0c06c2c0 con 0x7fca0c144920 2023-12-20T04:43:22.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.145+0000 7fca14355640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca0c0cbe80 con 0x7fca0c0cb9f0 2023-12-20T04:43:22.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.145+0000 7fca14355640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c0cb290 con 0x7fca0c0c5430 2023-12-20T04:43:22.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.145+0000 7fca118f0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca0c0c5430 0x7fca0c0cb4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.145+0000 7fca128f2640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fca0c0cb9f0 0x7fca0c06f450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.145+0000 7fca120f1640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fca0c144920 0x7fca0c0c90f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:59588/0 (socket says 172.21.15.132:59588) 2023-12-20T04:43:22.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.145+0000 7fca120f1640 1 -- 172.21.15.132:0/3787839319 learned_addr learned my addr 172.21.15.132:0/3787839319 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:22.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.146+0000 7fca110ef640 1 -- 172.21.15.132:0/3787839319 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1919629916 0 0) 0x7fca0c06c2c0 con 0x7fca0c144920 2023-12-20T04:43:22.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.146+0000 7fca110ef640 1 -- 172.21.15.132:0/3787839319 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc9f8003520 con 0x7fca0c144920 2023-12-20T04:43:22.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.146+0000 7fca118f0640 1 -- 172.21.15.132:0/3787839319 >> v2:172.21.15.187:3300/0 conn(0x7fca0c0cb9f0 msgr2=0x7fca0c06f450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:22.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.146+0000 7fca118f0640 1 --2- 172.21.15.132:0/3787839319 >> v2:172.21.15.187:3300/0 conn(0x7fca0c0cb9f0 0x7fca0c06f450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.146+0000 7fca118f0640 1 -- 172.21.15.132:0/3787839319 >> v1:172.21.15.187:6789/0 conn(0x7fca0c144920 legacy=0x7fca0c0c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.146+0000 7fca118f0640 1 -- 172.21.15.132:0/3787839319 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca0c0cad10 con 0x7fca0c0c5430 2023-12-20T04:43:22.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.146+0000 7fca128f2640 1 --2- 172.21.15.132:0/3787839319 >> v2:172.21.15.187:3300/0 conn(0x7fca0c0cb9f0 0x7fca0c06f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:43:22.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.147+0000 7fca118f0640 1 --2- 172.21.15.132:0/3787839319 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca0c0c5430 0x7fca0c0cb4b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0097a0 tx=0x7fc9fc02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c71c45a485d2abc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:22.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.147+0000 7fca110ef640 1 -- 172.21.15.132:0/3787839319 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc02e070 con 0x7fca0c0c5430 2023-12-20T04:43:22.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.147+0000 7fca110ef640 1 -- 172.21.15.132:0/3787839319 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc0315a0 con 0x7fca0c0c5430 2023-12-20T04:43:22.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.147+0000 7fca110ef640 1 -- 172.21.15.132:0/3787839319 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc031910 con 0x7fca0c0c5430 2023-12-20T04:43:22.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.147+0000 7fca14355640 1 -- 172.21.15.132:0/3787839319 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca0c0c5430 msgr2=0x7fca0c0cb4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.147+0000 7fca14355640 1 --2- 172.21.15.132:0/3787839319 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca0c0c5430 0x7fca0c0cb4b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0097a0 tx=0x7fc9fc02b840 comp rx=0 tx=0).stop 2023-12-20T04:43:22.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.147+0000 7fca14355640 1 -- 172.21.15.132:0/3787839319 shutdown_connections 2023-12-20T04:43:22.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.147+0000 7fca14355640 1 --2- 172.21.15.132:0/3787839319 >> v2:172.21.15.187:3300/0 conn(0x7fca0c0cb9f0 0x7fca0c06f450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.147+0000 7fca14355640 1 --2- 172.21.15.132:0/3787839319 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca0c0c5430 0x7fca0c0cb4b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.147+0000 7fca14355640 1 -- 172.21.15.132:0/3787839319 >> 172.21.15.132:0/3787839319 conn(0x7fca0c06a260 msgr2=0x7fca0c0b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:22.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.147+0000 7fca14355640 1 -- 172.21.15.132:0/3787839319 shutdown_connections 2023-12-20T04:43:22.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.147+0000 7fca14355640 1 -- 172.21.15.132:0/3787839319 wait complete. 2023-12-20T04:43:22.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.149+0000 7fca14355640 1 Processor -- start 2023-12-20T04:43:22.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.149+0000 7fca14355640 1 -- start start 2023-12-20T04:43:22.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.149+0000 7fca14355640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca0c0c5430 0x7fca0c0c7a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.149+0000 7fca14355640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca0c0cb9f0 0x7fca0c1f0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.149+0000 7fca14355640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca0c144920 0x7fca0c1e3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.149+0000 7fca14355640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c159800 con 0x7fca0c0cb9f0 2023-12-20T04:43:22.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.149+0000 7fca14355640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c0c80e0 con 0x7fca0c0c5430 2023-12-20T04:43:22.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.149+0000 7fca14355640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca0c0c83c0 con 0x7fca0c144920 2023-12-20T04:43:22.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.149+0000 7fca118f0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca0c0cb9f0 0x7fca0c1f0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.149+0000 7fca118f0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca0c0cb9f0 0x7fca0c1f0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35720/0 (socket says 172.21.15.132:35720) 2023-12-20T04:43:22.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.149+0000 7fca118f0640 1 -- 172.21.15.132:0/72131742 learned_addr learned my addr 172.21.15.132:0/72131742 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:22.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.149+0000 7fca128f2640 1 --2- 172.21.15.132:0/72131742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca0c144920 0x7fca0c1e3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.150+0000 7fca120f1640 1 --2- 172.21.15.132:0/72131742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca0c0c5430 0x7fca0c0c7a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.150+0000 7fca118f0640 1 -- 172.21.15.132:0/72131742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca0c144920 msgr2=0x7fca0c1e3cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.150+0000 7fca118f0640 1 --2- 172.21.15.132:0/72131742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca0c144920 0x7fca0c1e3cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.150+0000 7fca118f0640 1 -- 172.21.15.132:0/72131742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca0c0c5430 msgr2=0x7fca0c0c7a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.150+0000 7fca118f0640 1 --2- 172.21.15.132:0/72131742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca0c0c5430 0x7fca0c0c7a10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.150+0000 7fca118f0640 1 -- 172.21.15.132:0/72131742 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca04009400 con 0x7fca0c0cb9f0 2023-12-20T04:43:22.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.150+0000 7fca118f0640 1 --2- 172.21.15.132:0/72131742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca0c0cb9f0 0x7fca0c1f0b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0097a0 tx=0x7fc9fc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:22.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.150+0000 7fca02ffd640 1 -- 172.21.15.132:0/72131742 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc032630 con 0x7fca0c0cb9f0 2023-12-20T04:43:22.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.150+0000 7fca02ffd640 1 -- 172.21.15.132:0/72131742 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9fc032790 con 0x7fca0c0cb9f0 2023-12-20T04:43:22.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.150+0000 7fca14355640 1 -- 172.21.15.132:0/72131742 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9fc009400 con 0x7fca0c0cb9f0 2023-12-20T04:43:22.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.150+0000 7fca02ffd640 1 -- 172.21.15.132:0/72131742 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9fc032b20 con 0x7fca0c0cb9f0 2023-12-20T04:43:22.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.150+0000 7fca14355640 1 -- 172.21.15.132:0/72131742 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca0c1f05f0 con 0x7fca0c0cb9f0 2023-12-20T04:43:22.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.151+0000 7fca14355640 1 -- 172.21.15.132:0/72131742 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca0c15b090 con 0x7fca0c0cb9f0 2023-12-20T04:43:22.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.151+0000 7fca02ffd640 1 -- 172.21.15.132:0/72131742 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc9fc032c80 con 0x7fca0c0cb9f0 2023-12-20T04:43:22.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.152+0000 7fca02ffd640 1 --2- 172.21.15.132:0/72131742 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc9f006a430 0x7fc9f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.152+0000 7fca120f1640 1 --2- 172.21.15.132:0/72131742 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc9f006a430 0x7fc9f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.152+0000 7fca02ffd640 1 -- 172.21.15.132:0/72131742 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9fc0aa640 con 0x7fca0c0cb9f0 2023-12-20T04:43:22.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.152+0000 7fca120f1640 1 --2- 172.21.15.132:0/72131742 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc9f006a430 0x7fc9f006c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca08005c00 tx=0x7fca08009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:22.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.156+0000 7fca02ffd640 1 -- 172.21.15.132:0/72131742 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc9fc075d50 con 0x7fca0c0cb9f0 2023-12-20T04:43:22.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.324+0000 7fca14355640 1 -- 172.21.15.132:0/72131742 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fca0c04e840 con 0x7fca0c0cb9f0 2023-12-20T04:43:22.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.325+0000 7fca02ffd640 1 -- 172.21.15.132:0/72131742 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fc9fc079370 con 0x7fca0c0cb9f0 2023-12-20T04:43:22.327 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:43:22.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.327+0000 7fca14355640 1 -- 172.21.15.132:0/72131742 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc9f006a430 msgr2=0x7fc9f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.327+0000 7fca14355640 1 --2- 172.21.15.132:0/72131742 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc9f006a430 0x7fc9f006c8f0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7fca08005c00 tx=0x7fca08009040 comp rx=0 tx=0).stop 2023-12-20T04:43:22.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.327+0000 7fca14355640 1 -- 172.21.15.132:0/72131742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca0c0cb9f0 msgr2=0x7fca0c1f0b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.327+0000 7fca14355640 1 --2- 172.21.15.132:0/72131742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca0c0cb9f0 0x7fca0c1f0b10 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fc9fc0097a0 tx=0x7fc9fc0046c0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.327+0000 7fca14355640 1 -- 172.21.15.132:0/72131742 shutdown_connections 2023-12-20T04:43:22.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.327+0000 7fca14355640 1 --2- 172.21.15.132:0/72131742 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc9f006a430 0x7fc9f006c8f0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.327+0000 7fca14355640 1 --2- 172.21.15.132:0/72131742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca0c144920 0x7fca0c1e3cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.327+0000 7fca14355640 1 --2- 172.21.15.132:0/72131742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca0c0cb9f0 0x7fca0c1f0b10 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.327+0000 7fca14355640 1 --2- 172.21.15.132:0/72131742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca0c0c5430 0x7fca0c0c7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.327+0000 7fca14355640 1 -- 172.21.15.132:0/72131742 >> 172.21.15.132:0/72131742 conn(0x7fca0c06a260 msgr2=0x7fca0c0ae660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:22.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.327+0000 7fca14355640 1 -- 172.21.15.132:0/72131742 shutdown_connections 2023-12-20T04:43:22.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.327+0000 7fca14355640 1 -- 172.21.15.132:0/72131742 wait complete. 2023-12-20T04:43:22.340 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:43:22.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.440+0000 7f9e49a28640 1 Processor -- start 2023-12-20T04:43:22.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.440+0000 7f9e49a28640 1 -- start start 2023-12-20T04:43:22.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.441+0000 7f9e49a28640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9e4415d300 0x7f9e440d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.441+0000 7f9e49a28640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e440d2920 con 0x7f9e440d17d0 2023-12-20T04:43:22.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.441+0000 7f9e49a28640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e440d1d10 con 0x7f9e440cfea0 2023-12-20T04:43:22.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.441+0000 7f9e49a28640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e440d1ff0 con 0x7f9e4415d300 2023-12-20T04:43:22.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.441+0000 7f9e427fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9e440d17d0 0x7f9e440cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60106/0 (socket says 172.21.15.132:60106) 2023-12-20T04:43:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.441+0000 7f9e427fc640 1 -- 172.21.15.132:0/3392814530 learned_addr learned my addr 172.21.15.132:0/3392814530 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.441+0000 7f9e41ffb640 1 -- 172.21.15.132:0/3392814530 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1889456090 0 0) 0x7f9e440d2920 con 0x7f9e440d17d0 2023-12-20T04:43:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.441+0000 7f9e42ffd640 1 --2- 172.21.15.132:0/3392814530 >> v2:172.21.15.187:3300/0 conn(0x7f9e4415d300 0x7f9e440d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.441+0000 7f9e41ffb640 1 -- 172.21.15.132:0/3392814530 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9e2c003520 con 0x7f9e440d17d0 2023-12-20T04:43:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.441+0000 7f9e41ffb640 1 -- 172.21.15.132:0/3392814530 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2915991936 0 0) 0x7f9e2c003520 con 0x7f9e440d17d0 2023-12-20T04:43:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.441+0000 7f9e41ffb640 1 -- 172.21.15.132:0/3392814530 >> v2:172.21.15.187:3300/0 conn(0x7f9e4415d300 msgr2=0x7f9e440d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.441+0000 7f9e41ffb640 1 --2- 172.21.15.132:0/3392814530 >> v2:172.21.15.187:3300/0 conn(0x7f9e4415d300 0x7f9e440d1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.441+0000 7f9e41ffb640 1 -- 172.21.15.132:0/3392814530 >> v1:172.21.15.187:6789/0 conn(0x7f9e440cfea0 legacy=0x7f9e440b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.441+0000 7f9e41ffb640 1 -- 172.21.15.132:0/3392814530 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e440d22d0 con 0x7f9e440d17d0 2023-12-20T04:43:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.441+0000 7f9e41ffb640 1 -- 172.21.15.132:0/3392814530 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f9e38001670 con 0x7f9e440d17d0 2023-12-20T04:43:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.442+0000 7f9e41ffb640 1 -- 172.21.15.132:0/3392814530 >> v1:172.21.15.132:6789/0 conn(0x7f9e440d17d0 legacy=0x7f9e440cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.442+0000 7f9e41ffb640 1 --2- 172.21.15.132:0/3392814530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e2c003970 0x7f9e2c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.442+0000 7f9e41ffb640 1 --2- 172.21.15.132:0/3392814530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e2c0047c0 0x7f9e2c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.442+0000 7f9e41ffb640 1 --2- 172.21.15.132:0/3392814530 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e2c005180 0x7f9e2c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.442+0000 7f9e41ffb640 1 -- 172.21.15.132:0/3392814530 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e440d1ff0 con 0x7f9e2c003970 2023-12-20T04:43:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.442+0000 7f9e41ffb640 1 -- 172.21.15.132:0/3392814530 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c00c020 con 0x7f9e2c0047c0 2023-12-20T04:43:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.442+0000 7f9e41ffb640 1 -- 172.21.15.132:0/3392814530 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e2c00c1e0 con 0x7f9e2c005180 2023-12-20T04:43:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.442+0000 7f9e42ffd640 1 --2- 172.21.15.132:0/3392814530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e2c003970 0x7f9e2c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.442+0000 7f9e427fc640 1 --2- 172.21.15.132:0/3392814530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e2c0047c0 0x7f9e2c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.442+0000 7f9e437fe640 1 --2- 172.21.15.132:0/3392814530 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e2c005180 0x7f9e2c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.442+0000 7f9e42ffd640 1 -- 172.21.15.132:0/3392814530 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e2c005180 msgr2=0x7f9e2c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.442+0000 7f9e42ffd640 1 --2- 172.21.15.132:0/3392814530 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e2c005180 0x7f9e2c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.442+0000 7f9e42ffd640 1 -- 172.21.15.132:0/3392814530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e2c0047c0 msgr2=0x7f9e2c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.442+0000 7f9e42ffd640 1 --2- 172.21.15.132:0/3392814530 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e2c0047c0 0x7f9e2c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.442+0000 7f9e42ffd640 1 -- 172.21.15.132:0/3392814530 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2c003520 con 0x7f9e2c003970 2023-12-20T04:43:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.442+0000 7f9e437fe640 1 --2- 172.21.15.132:0/3392814530 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e2c005180 0x7f9e2c00b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.442+0000 7f9e437fe640 1 -- 172.21.15.132:0/3392814530 reap_dead start 2023-12-20T04:43:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.443+0000 7f9e42ffd640 1 --2- 172.21.15.132:0/3392814530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e2c003970 0x7f9e2c003d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009ac0 tx=0x7f9e2c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07adde563145da6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.443+0000 7f9e41ffb640 1 -- 172.21.15.132:0/3392814530 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3402c6b0 con 0x7f9e2c003970 2023-12-20T04:43:22.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.443+0000 7f9e41ffb640 1 -- 172.21.15.132:0/3392814530 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3402c810 con 0x7f9e2c003970 2023-12-20T04:43:22.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.443+0000 7f9e41ffb640 1 -- 172.21.15.132:0/3392814530 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3402cba0 con 0x7f9e2c003970 2023-12-20T04:43:22.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.443+0000 7f9e49a28640 1 -- 172.21.15.132:0/3392814530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e2c003970 msgr2=0x7f9e2c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.443+0000 7f9e49a28640 1 --2- 172.21.15.132:0/3392814530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e2c003970 0x7f9e2c003d90 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f9e34009ac0 tx=0x7f9e2c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.443+0000 7f9e49a28640 1 -- 172.21.15.132:0/3392814530 shutdown_connections 2023-12-20T04:43:22.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.443+0000 7f9e49a28640 1 --2- 172.21.15.132:0/3392814530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e2c003970 0x7f9e2c003d90 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.443+0000 7f9e49a28640 1 -- 172.21.15.132:0/3392814530 >> 172.21.15.132:0/3392814530 conn(0x7f9e4406a3d0 msgr2=0x7f9e4406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:22.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.443+0000 7f9e49a28640 1 -- 172.21.15.132:0/3392814530 shutdown_connections 2023-12-20T04:43:22.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.443+0000 7f9e49a28640 1 -- 172.21.15.132:0/3392814530 wait complete. 2023-12-20T04:43:22.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.444+0000 7f9e49a28640 1 Processor -- start 2023-12-20T04:43:22.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.445+0000 7f9e49a28640 1 -- start start 2023-12-20T04:43:22.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.445+0000 7f9e49a28640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e2c003970 0x7f9e44160250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.445+0000 7f9e49a28640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e441efe20 0x7f9e440cc4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.445+0000 7f9e49a28640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e441f5fa0 0x7f9e441f6420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.445+0000 7f9e49a28640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e441f6960 con 0x7f9e441f5fa0 2023-12-20T04:43:22.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.445+0000 7f9e49a28640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e440cabf0 con 0x7f9e441efe20 2023-12-20T04:43:22.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.445+0000 7f9e49a28640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e440c9fe0 con 0x7f9e2c003970 2023-12-20T04:43:22.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.445+0000 7f9e437fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e441f5fa0 0x7f9e441f6420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.445+0000 7f9e437fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e441f5fa0 0x7f9e441f6420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35730/0 (socket says 172.21.15.132:35730) 2023-12-20T04:43:22.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.445+0000 7f9e437fe640 1 -- 172.21.15.132:0/2145239692 learned_addr learned my addr 172.21.15.132:0/2145239692 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:22.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.446+0000 7f9e427fc640 1 --2- 172.21.15.132:0/2145239692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e441efe20 0x7f9e440cc4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.446+0000 7f9e42ffd640 1 --2- 172.21.15.132:0/2145239692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e2c003970 0x7f9e44160250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.446+0000 7f9e437fe640 1 -- 172.21.15.132:0/2145239692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e2c003970 msgr2=0x7f9e44160250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.446+0000 7f9e437fe640 1 --2- 172.21.15.132:0/2145239692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e2c003970 0x7f9e44160250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.446+0000 7f9e437fe640 1 -- 172.21.15.132:0/2145239692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e441efe20 msgr2=0x7f9e440cc4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.446+0000 7f9e437fe640 1 --2- 172.21.15.132:0/2145239692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e441efe20 0x7f9e440cc4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.446+0000 7f9e437fe640 1 -- 172.21.15.132:0/2145239692 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e440ca2c0 con 0x7f9e441f5fa0 2023-12-20T04:43:22.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.446+0000 7f9e437fe640 1 --2- 172.21.15.132:0/2145239692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e441f5fa0 0x7f9e441f6420 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9e440ce9c0 tx=0x7f9e3c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:22.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.446+0000 7f9e2bfff640 1 -- 172.21.15.132:0/2145239692 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c00eed0 con 0x7f9e441f5fa0 2023-12-20T04:43:22.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.446+0000 7f9e2bfff640 1 -- 172.21.15.132:0/2145239692 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e3c003970 con 0x7f9e441f5fa0 2023-12-20T04:43:22.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.446+0000 7f9e49a28640 1 -- 172.21.15.132:0/2145239692 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e440ca5a0 con 0x7f9e441f5fa0 2023-12-20T04:43:22.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.446+0000 7f9e2bfff640 1 -- 172.21.15.132:0/2145239692 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e3c003d20 con 0x7f9e441f5fa0 2023-12-20T04:43:22.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.446+0000 7f9e49a28640 1 -- 172.21.15.132:0/2145239692 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e441f0280 con 0x7f9e441f5fa0 2023-12-20T04:43:22.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.447+0000 7f9e49a28640 1 -- 172.21.15.132:0/2145239692 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e4404e840 con 0x7f9e441f5fa0 2023-12-20T04:43:22.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.447+0000 7f9e2bfff640 1 -- 172.21.15.132:0/2145239692 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9e3c0050d0 con 0x7f9e441f5fa0 2023-12-20T04:43:22.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.448+0000 7f9e2bfff640 1 --2- 172.21.15.132:0/2145239692 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9e3006a460 0x7f9e3006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.448+0000 7f9e2bfff640 1 -- 172.21.15.132:0/2145239692 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e3c088570 con 0x7f9e441f5fa0 2023-12-20T04:43:22.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.448+0000 7f9e42ffd640 1 --2- 172.21.15.132:0/2145239692 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9e3006a460 0x7f9e3006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.448+0000 7f9e42ffd640 1 --2- 172.21.15.132:0/2145239692 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9e3006a460 0x7f9e3006c920 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9e34036000 tx=0x7f9e34030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:22.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.452+0000 7f9e2bfff640 1 -- 172.21.15.132:0/2145239692 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9e3c053b60 con 0x7f9e441f5fa0 2023-12-20T04:43:22.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.618+0000 7f9e49a28640 1 -- 172.21.15.132:0/2145239692 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9e440cad30 con 0x7f9e441f5fa0 2023-12-20T04:43:22.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.619+0000 7f9e2bfff640 1 -- 172.21.15.132:0/2145239692 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9e3c057180 con 0x7f9e441f5fa0 2023-12-20T04:43:22.620 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:43:22.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.620+0000 7f9e49a28640 1 -- 172.21.15.132:0/2145239692 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9e3006a460 msgr2=0x7f9e3006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.620+0000 7f9e49a28640 1 --2- 172.21.15.132:0/2145239692 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9e3006a460 0x7f9e3006c920 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9e34036000 tx=0x7f9e34030000 comp rx=0 tx=0).stop 2023-12-20T04:43:22.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.620+0000 7f9e49a28640 1 -- 172.21.15.132:0/2145239692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e441f5fa0 msgr2=0x7f9e441f6420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.620+0000 7f9e49a28640 1 --2- 172.21.15.132:0/2145239692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e441f5fa0 0x7f9e441f6420 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f9e440ce9c0 tx=0x7f9e3c00eb90 comp rx=0 tx=0).stop 2023-12-20T04:43:22.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.621+0000 7f9e49a28640 1 -- 172.21.15.132:0/2145239692 shutdown_connections 2023-12-20T04:43:22.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.621+0000 7f9e49a28640 1 --2- 172.21.15.132:0/2145239692 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9e3006a460 0x7f9e3006c920 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.621+0000 7f9e49a28640 1 --2- 172.21.15.132:0/2145239692 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e441f5fa0 0x7f9e441f6420 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.621+0000 7f9e49a28640 1 --2- 172.21.15.132:0/2145239692 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e441efe20 0x7f9e440cc4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.621+0000 7f9e49a28640 1 --2- 172.21.15.132:0/2145239692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e2c003970 0x7f9e44160250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.621+0000 7f9e49a28640 1 -- 172.21.15.132:0/2145239692 >> 172.21.15.132:0/2145239692 conn(0x7f9e4406a3d0 msgr2=0x7f9e44158330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:22.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.621+0000 7f9e49a28640 1 -- 172.21.15.132:0/2145239692 shutdown_connections 2023-12-20T04:43:22.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.621+0000 7f9e49a28640 1 -- 172.21.15.132:0/2145239692 wait complete. 2023-12-20T04:43:22.634 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:43:22.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.734+0000 7f94b6ea1640 1 Processor -- start 2023-12-20T04:43:22.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.734+0000 7f94b6ea1640 1 -- start start 2023-12-20T04:43:22.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.735+0000 7f94b6ea1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94b015d300 0x7f94b00d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.735+0000 7f94b6ea1640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f94b00d1550 0x7f94b00cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.735+0000 7f94b6ea1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94b00cfdc0 0x7f94b00b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.735+0000 7f94b6ea1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b00d0230 con 0x7f94b00cfdc0 2023-12-20T04:43:22.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.735+0000 7f94b6ea1640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f94b00d1a90 con 0x7f94b00d1550 2023-12-20T04:43:22.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.735+0000 7f94b6ea1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b00d1d70 con 0x7f94b015d300 2023-12-20T04:43:22.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.735+0000 7f94b543e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94b00cfdc0 0x7f94b00b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.735+0000 7f94b543e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f94b00cfdc0 0x7f94b00b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35746/0 (socket says 172.21.15.132:35746) 2023-12-20T04:43:22.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.735+0000 7f94b543e640 1 -- 172.21.15.132:0/3505862793 learned_addr learned my addr 172.21.15.132:0/3505862793 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:22.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.735+0000 7f94affff640 1 --2- 172.21.15.132:0/3505862793 >> v2:172.21.15.187:3300/0 conn(0x7f94b00d1550 0x7f94b00cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.735+0000 7f94b4c3d640 1 --2- 172.21.15.132:0/3505862793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94b015d300 0x7f94b00d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.736+0000 7f94b543e640 1 -- 172.21.15.132:0/3505862793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94b015d300 msgr2=0x7f94b00d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:22.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.736+0000 7f94b543e640 1 --2- 172.21.15.132:0/3505862793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94b015d300 0x7f94b00d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.736+0000 7f94b543e640 1 -- 172.21.15.132:0/3505862793 >> v2:172.21.15.187:3300/0 conn(0x7f94b00d1550 msgr2=0x7f94b00cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:22.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.736+0000 7f94b543e640 1 --2- 172.21.15.132:0/3505862793 >> v2:172.21.15.187:3300/0 conn(0x7f94b00d1550 0x7f94b00cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.736+0000 7f94b543e640 1 -- 172.21.15.132:0/3505862793 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94b00d2050 con 0x7f94b00cfdc0 2023-12-20T04:43:22.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.736+0000 7f94b543e640 1 --2- 172.21.15.132:0/3505862793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94b00cfdc0 0x7f94b00b48f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f94b00b59f0 tx=0x7f94a802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93393a64d76ef2c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:22.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.736+0000 7f94af7fe640 1 -- 172.21.15.132:0/3505862793 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a802ca70 con 0x7f94b00cfdc0 2023-12-20T04:43:22.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.736+0000 7f94af7fe640 1 -- 172.21.15.132:0/3505862793 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a802cbd0 con 0x7f94b00cfdc0 2023-12-20T04:43:22.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.736+0000 7f94af7fe640 1 -- 172.21.15.132:0/3505862793 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a80343f0 con 0x7f94b00cfdc0 2023-12-20T04:43:22.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.737+0000 7f94b6ea1640 1 -- 172.21.15.132:0/3505862793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94b00cfdc0 msgr2=0x7f94b00b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.737+0000 7f94b6ea1640 1 --2- 172.21.15.132:0/3505862793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94b00cfdc0 0x7f94b00b48f0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f94b00b59f0 tx=0x7f94a802bed0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.737+0000 7f94b6ea1640 1 -- 172.21.15.132:0/3505862793 shutdown_connections 2023-12-20T04:43:22.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.737+0000 7f94b6ea1640 1 --2- 172.21.15.132:0/3505862793 >> v2:172.21.15.187:3300/0 conn(0x7f94b00d1550 0x7f94b00cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.737+0000 7f94b6ea1640 1 --2- 172.21.15.132:0/3505862793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94b00cfdc0 0x7f94b00b48f0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.737+0000 7f94b6ea1640 1 --2- 172.21.15.132:0/3505862793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94b015d300 0x7f94b00d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.737+0000 7f94b6ea1640 1 -- 172.21.15.132:0/3505862793 >> 172.21.15.132:0/3505862793 conn(0x7f94b006a3d0 msgr2=0x7f94b006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:22.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.737+0000 7f94b6ea1640 1 -- 172.21.15.132:0/3505862793 shutdown_connections 2023-12-20T04:43:22.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.737+0000 7f94b6ea1640 1 -- 172.21.15.132:0/3505862793 wait complete. 2023-12-20T04:43:22.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.738+0000 7f94b6ea1640 1 Processor -- start 2023-12-20T04:43:22.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.738+0000 7f94b6ea1640 1 -- start start 2023-12-20T04:43:22.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.739+0000 7f94b6ea1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94b00cfdc0 0x7f94b00b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.739+0000 7f94b6ea1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94b00d1550 0x7f94b00c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.739+0000 7f94b6ea1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94b015d300 0x7f94b01493b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.739+0000 7f94b6ea1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b014a600 con 0x7f94b015d300 2023-12-20T04:43:22.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.739+0000 7f94b6ea1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94b00b3170 con 0x7f94b00d1550 2023-12-20T04:43:22.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.739+0000 7f94b6ea1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f94b00b2e90 con 0x7f94b00cfdc0 2023-12-20T04:43:22.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.739+0000 7f94b543e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94b015d300 0x7f94b01493b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.739+0000 7f94b543e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94b015d300 0x7f94b01493b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35756/0 (socket says 172.21.15.132:35756) 2023-12-20T04:43:22.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.739+0000 7f94b543e640 1 -- 172.21.15.132:0/2596479992 learned_addr learned my addr 172.21.15.132:0/2596479992 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:22.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.739+0000 7f94b4c3d640 1 --2- 172.21.15.132:0/2596479992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94b00cfdc0 0x7f94b00b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.739+0000 7f94affff640 1 --2- 172.21.15.132:0/2596479992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94b00d1550 0x7f94b00c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.739+0000 7f94b543e640 1 -- 172.21.15.132:0/2596479992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94b00cfdc0 msgr2=0x7f94b00b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.739+0000 7f94b543e640 1 --2- 172.21.15.132:0/2596479992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94b00cfdc0 0x7f94b00b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.739+0000 7f94b543e640 1 -- 172.21.15.132:0/2596479992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94b00d1550 msgr2=0x7f94b00c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.739+0000 7f94b543e640 1 --2- 172.21.15.132:0/2596479992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94b00d1550 0x7f94b00c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.739+0000 7f94b543e640 1 -- 172.21.15.132:0/2596479992 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f94a8009b30 con 0x7f94b015d300 2023-12-20T04:43:22.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.740+0000 7f94b543e640 1 --2- 172.21.15.132:0/2596479992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94b015d300 0x7f94b01493b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f94a8036040 tx=0x7f94a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:22.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.740+0000 7f94ad7fa640 1 -- 172.21.15.132:0/2596479992 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a8009510 con 0x7f94b015d300 2023-12-20T04:43:22.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.740+0000 7f94ad7fa640 1 -- 172.21.15.132:0/2596479992 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f94a803e450 con 0x7f94b015d300 2023-12-20T04:43:22.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.740+0000 7f94b6ea1640 1 -- 172.21.15.132:0/2596479992 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94b0149f40 con 0x7f94b015d300 2023-12-20T04:43:22.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.740+0000 7f94ad7fa640 1 -- 172.21.15.132:0/2596479992 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f94a803e800 con 0x7f94b015d300 2023-12-20T04:43:22.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.740+0000 7f94b6ea1640 1 -- 172.21.15.132:0/2596479992 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f94b00c97b0 con 0x7f94b015d300 2023-12-20T04:43:22.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.741+0000 7f94b6ea1640 1 -- 172.21.15.132:0/2596479992 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f94b004e840 con 0x7f94b015d300 2023-12-20T04:43:22.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.741+0000 7f94ad7fa640 1 -- 172.21.15.132:0/2596479992 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f94a803e960 con 0x7f94b015d300 2023-12-20T04:43:22.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.742+0000 7f94ad7fa640 1 --2- 172.21.15.132:0/2596479992 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f949c06a430 0x7f949c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:22.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.742+0000 7f94b4c3d640 1 --2- 172.21.15.132:0/2596479992 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f949c06a430 0x7f949c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:22.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.742+0000 7f94ad7fa640 1 -- 172.21.15.132:0/2596479992 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f94a80ab620 con 0x7f94b015d300 2023-12-20T04:43:22.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.742+0000 7f94b4c3d640 1 --2- 172.21.15.132:0/2596479992 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f949c06a430 0x7f949c06c8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f94a0006fd0 tx=0x7f94a0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:22.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.746+0000 7f94ad7fa640 1 -- 172.21.15.132:0/2596479992 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f94a8076ca0 con 0x7f94b015d300 2023-12-20T04:43:22.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.914+0000 7f94b6ea1640 1 -- 172.21.15.132:0/2596479992 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f94b00c9c00 con 0x7f94b015d300 2023-12-20T04:43:22.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.914+0000 7f94ad7fa640 1 -- 172.21.15.132:0/2596479992 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f94a807a2c0 con 0x7f94b015d300 2023-12-20T04:43:22.918 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:43:22.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.916+0000 7f94b6ea1640 1 -- 172.21.15.132:0/2596479992 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f949c06a430 msgr2=0x7f949c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.916+0000 7f94b6ea1640 1 --2- 172.21.15.132:0/2596479992 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f949c06a430 0x7f949c06c8f0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f94a0006fd0 tx=0x7f94a0008040 comp rx=0 tx=0).stop 2023-12-20T04:43:22.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.916+0000 7f94b6ea1640 1 -- 172.21.15.132:0/2596479992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94b015d300 msgr2=0x7f94b01493b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:22.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.916+0000 7f94b6ea1640 1 --2- 172.21.15.132:0/2596479992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94b015d300 0x7f94b01493b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f94a8036040 tx=0x7f94a8004a40 comp rx=0 tx=0).stop 2023-12-20T04:43:22.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.916+0000 7f94b6ea1640 1 -- 172.21.15.132:0/2596479992 shutdown_connections 2023-12-20T04:43:22.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.916+0000 7f94b6ea1640 1 --2- 172.21.15.132:0/2596479992 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f949c06a430 0x7f949c06c8f0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.916+0000 7f94b6ea1640 1 --2- 172.21.15.132:0/2596479992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f94b015d300 0x7f94b01493b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.916+0000 7f94b6ea1640 1 --2- 172.21.15.132:0/2596479992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f94b00d1550 0x7f94b00c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.916+0000 7f94b6ea1640 1 --2- 172.21.15.132:0/2596479992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f94b00cfdc0 0x7f94b00b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:22.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.916+0000 7f94b6ea1640 1 -- 172.21.15.132:0/2596479992 >> 172.21.15.132:0/2596479992 conn(0x7f94b006a3d0 msgr2=0x7f94b015a3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:22.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.916+0000 7f94b6ea1640 1 -- 172.21.15.132:0/2596479992 shutdown_connections 2023-12-20T04:43:22.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:22.916+0000 7f94b6ea1640 1 -- 172.21.15.132:0/2596479992 wait complete. 2023-12-20T04:43:22.929 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:43:23.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.030+0000 7f20fbc5f640 1 Processor -- start 2023-12-20T04:43:23.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.030+0000 7f20fbc5f640 1 -- start start 2023-12-20T04:43:23.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.031+0000 7f20fbc5f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f20f4143bc0 0x7f20f40704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.031+0000 7f20fbc5f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f20f406a340 0x7f20f40cdeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.031+0000 7f20fbc5f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f20f40cda20 con 0x7f20f4144090 2023-12-20T04:43:23.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.031+0000 7f20fbc5f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f406c5c0 con 0x7f20f4143bc0 2023-12-20T04:43:23.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.031+0000 7f20fbc5f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f20f4144910 con 0x7f20f406a340 2023-12-20T04:43:23.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.031+0000 7f20f99fb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f20f4143bc0 0x7f20f40704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.031+0000 7f20f99fb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f20f4143bc0 0x7f20f40704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35770/0 (socket says 172.21.15.132:35770) 2023-12-20T04:43:23.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.031+0000 7f20f99fb640 1 -- 172.21.15.132:0/4290731499 learned_addr learned my addr 172.21.15.132:0/4290731499 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:23.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.031+0000 7f20fa1fc640 1 --2- 172.21.15.132:0/4290731499 >> v2:172.21.15.187:3300/0 conn(0x7f20f406a340 0x7f20f40cdeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.031+0000 7f20f99fb640 1 -- 172.21.15.132:0/4290731499 >> v2:172.21.15.187:3300/0 conn(0x7f20f406a340 msgr2=0x7f20f40cdeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:23.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.031+0000 7f20f99fb640 1 --2- 172.21.15.132:0/4290731499 >> v2:172.21.15.187:3300/0 conn(0x7f20f406a340 0x7f20f40cdeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.031+0000 7f20f99fb640 1 -- 172.21.15.132:0/4290731499 >> v1:172.21.15.187:6789/0 conn(0x7f20f4144090 legacy=0x7f20f4069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.031+0000 7f20f99fb640 1 -- 172.21.15.132:0/4290731499 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f4070bf0 con 0x7f20f4143bc0 2023-12-20T04:43:23.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.032+0000 7f20f99fb640 1 --2- 172.21.15.132:0/4290731499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20f4143bc0 0x7f20f40704f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f20f406ac30 tx=0x7f20f002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd55268f0d5c0781 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.032+0000 7f20f89f9640 1 -- 172.21.15.132:0/4290731499 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0030860 con 0x7f20f4143bc0 2023-12-20T04:43:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.032+0000 7f20f89f9640 1 -- 172.21.15.132:0/4290731499 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f00309c0 con 0x7f20f4143bc0 2023-12-20T04:43:23.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.032+0000 7f20f89f9640 1 -- 172.21.15.132:0/4290731499 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0030d50 con 0x7f20f4143bc0 2023-12-20T04:43:23.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.033+0000 7f20fbc5f640 1 -- 172.21.15.132:0/4290731499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20f4143bc0 msgr2=0x7f20f40704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.033+0000 7f20fbc5f640 1 --2- 172.21.15.132:0/4290731499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20f4143bc0 0x7f20f40704f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f20f406ac30 tx=0x7f20f002b9a0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.033+0000 7f20fbc5f640 1 -- 172.21.15.132:0/4290731499 shutdown_connections 2023-12-20T04:43:23.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.033+0000 7f20fbc5f640 1 --2- 172.21.15.132:0/4290731499 >> v2:172.21.15.187:3300/0 conn(0x7f20f406a340 0x7f20f40cdeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.033+0000 7f20fbc5f640 1 --2- 172.21.15.132:0/4290731499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20f4143bc0 0x7f20f40704f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.033+0000 7f20fbc5f640 1 -- 172.21.15.132:0/4290731499 >> 172.21.15.132:0/4290731499 conn(0x7f20f40cfb10 msgr2=0x7f20f40cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:23.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.033+0000 7f20fbc5f640 1 -- 172.21.15.132:0/4290731499 shutdown_connections 2023-12-20T04:43:23.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.033+0000 7f20fbc5f640 1 -- 172.21.15.132:0/4290731499 wait complete. 2023-12-20T04:43:23.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.034+0000 7f20fbc5f640 1 Processor -- start 2023-12-20T04:43:23.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.034+0000 7f20fbc5f640 1 -- start start 2023-12-20T04:43:23.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20fbc5f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20f406a340 0x7f20f41f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20fbc5f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f20f4143bc0 0x7f20f4141c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20fbc5f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f20f4144090 0x7f20f415a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20fbc5f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f4140290 con 0x7f20f406a340 2023-12-20T04:43:23.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20fbc5f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20f41421b0 con 0x7f20f4143bc0 2023-12-20T04:43:23.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20fbc5f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f20f4142450 con 0x7f20f4144090 2023-12-20T04:43:23.039 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20f99fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20f406a340 0x7f20f41f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20f99fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20f406a340 0x7f20f41f6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35782/0 (socket says 172.21.15.132:35782) 2023-12-20T04:43:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20f99fb640 1 -- 172.21.15.132:0/1926610449 learned_addr learned my addr 172.21.15.132:0/1926610449 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20f91fa640 1 --2- 172.21.15.132:0/1926610449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f20f4143bc0 0x7f20f4141c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20fa1fc640 1 --2- 172.21.15.132:0/1926610449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f20f4144090 0x7f20f415a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20f99fb640 1 -- 172.21.15.132:0/1926610449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f20f4144090 msgr2=0x7f20f415a530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20f99fb640 1 --2- 172.21.15.132:0/1926610449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f20f4144090 0x7f20f415a530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20f99fb640 1 -- 172.21.15.132:0/1926610449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f20f4143bc0 msgr2=0x7f20f4141c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20f99fb640 1 --2- 172.21.15.132:0/1926610449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f20f4143bc0 0x7f20f4141c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20f99fb640 1 -- 172.21.15.132:0/1926610449 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20f00094d0 con 0x7f20f406a340 2023-12-20T04:43:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20f99fb640 1 --2- 172.21.15.132:0/1926610449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20f406a340 0x7f20f41f6b60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f20f0000c00 tx=0x7f20f0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20ea7fc640 1 -- 172.21.15.132:0/1926610449 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0039a90 con 0x7f20f406a340 2023-12-20T04:43:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20ea7fc640 1 -- 172.21.15.132:0/1926610449 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f20f0039bf0 con 0x7f20f406a340 2023-12-20T04:43:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20fbc5f640 1 -- 172.21.15.132:0/1926610449 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20f413fc40 con 0x7f20f406a340 2023-12-20T04:43:23.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20ea7fc640 1 -- 172.21.15.132:0/1926610449 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f20f0043410 con 0x7f20f406a340 2023-12-20T04:43:23.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.035+0000 7f20fbc5f640 1 -- 172.21.15.132:0/1926610449 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20f4142730 con 0x7f20f406a340 2023-12-20T04:43:23.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.036+0000 7f20fbc5f640 1 -- 172.21.15.132:0/1926610449 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20f404e840 con 0x7f20f406a340 2023-12-20T04:43:23.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.037+0000 7f20ea7fc640 1 -- 172.21.15.132:0/1926610449 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f20f004c3b0 con 0x7f20f406a340 2023-12-20T04:43:23.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.037+0000 7f20ea7fc640 1 --2- 172.21.15.132:0/1926610449 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f20d806a460 0x7f20d806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.037+0000 7f20ea7fc640 1 -- 172.21.15.132:0/1926610449 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f20f00aad10 con 0x7f20f406a340 2023-12-20T04:43:23.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.037+0000 7f20f91fa640 1 --2- 172.21.15.132:0/1926610449 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f20d806a460 0x7f20d806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.038+0000 7f20f91fa640 1 --2- 172.21.15.132:0/1926610449 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f20d806a460 0x7f20d806c920 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f20f413ab20 tx=0x7f20e4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:23.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.041+0000 7f20ea7fc640 1 -- 172.21.15.132:0/1926610449 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f20f00763b0 con 0x7f20f406a340 2023-12-20T04:43:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.218+0000 7f20fbc5f640 1 -- 172.21.15.132:0/1926610449 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f20f40d06d0 con 0x7f20f406a340 2023-12-20T04:43:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.218+0000 7f20ea7fc640 1 -- 172.21.15.132:0/1926610449 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f20f00799d0 con 0x7f20f406a340 2023-12-20T04:43:23.220 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:43:23.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.220+0000 7f20fbc5f640 1 -- 172.21.15.132:0/1926610449 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f20d806a460 msgr2=0x7f20d806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.220+0000 7f20fbc5f640 1 --2- 172.21.15.132:0/1926610449 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f20d806a460 0x7f20d806c920 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f20f413ab20 tx=0x7f20e4009040 comp rx=0 tx=0).stop 2023-12-20T04:43:23.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.220+0000 7f20fbc5f640 1 -- 172.21.15.132:0/1926610449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20f406a340 msgr2=0x7f20f41f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.220+0000 7f20fbc5f640 1 --2- 172.21.15.132:0/1926610449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20f406a340 0x7f20f41f6b60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f20f0000c00 tx=0x7f20f0004730 comp rx=0 tx=0).stop 2023-12-20T04:43:23.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.220+0000 7f20fbc5f640 1 -- 172.21.15.132:0/1926610449 shutdown_connections 2023-12-20T04:43:23.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.220+0000 7f20fbc5f640 1 --2- 172.21.15.132:0/1926610449 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f20d806a460 0x7f20d806c920 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.221+0000 7f20fbc5f640 1 --2- 172.21.15.132:0/1926610449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f20f4144090 0x7f20f415a530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.221+0000 7f20fbc5f640 1 --2- 172.21.15.132:0/1926610449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f20f4143bc0 0x7f20f4141c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.221+0000 7f20fbc5f640 1 --2- 172.21.15.132:0/1926610449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f20f406a340 0x7f20f41f6b60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.221+0000 7f20fbc5f640 1 -- 172.21.15.132:0/1926610449 >> 172.21.15.132:0/1926610449 conn(0x7f20f40cfb10 msgr2=0x7f20f4136d50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:23.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.221+0000 7f20fbc5f640 1 -- 172.21.15.132:0/1926610449 shutdown_connections 2023-12-20T04:43:23.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.221+0000 7f20fbc5f640 1 -- 172.21.15.132:0/1926610449 wait complete. 2023-12-20T04:43:23.233 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:43:23.233 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:43:23.253 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:23.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.350+0000 7f77dc920640 1 Processor -- start 2023-12-20T04:43:23.352 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.351+0000 7f77dc920640 1 -- start start 2023-12-20T04:43:23.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.351+0000 7f77dc920640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f77d80b4980 0x7f77d80b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.351+0000 7f77dc920640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d80d1aa0 0x7f77d80d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.351+0000 7f77dc920640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f77d80b5320 con 0x7f77d8160450 2023-12-20T04:43:23.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.351+0000 7f77dc920640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77d80b5ec0 con 0x7f77d80b4980 2023-12-20T04:43:23.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.351+0000 7f77dc920640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d81617e0 con 0x7f77d80d1aa0 2023-12-20T04:43:23.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.352+0000 7f77d6d9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d80d1aa0 0x7f77d80d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.352+0000 7f77cffff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f77d80b4980 0x7f77d80b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.352+0000 7f77d659c640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f77d8160450 0x7f77d8160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:59624/0 (socket says 172.21.15.132:59624) 2023-12-20T04:43:23.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.352+0000 7f77d6d9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d80d1aa0 0x7f77d80d1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:35282/0 (socket says 172.21.15.132:35282) 2023-12-20T04:43:23.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.352+0000 7f77cffff640 1 --2- 172.21.15.132:0/845265428 >> v2:172.21.15.187:3300/0 conn(0x7f77d80b4980 0x7f77d80b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:58358/0 (socket says 172.21.15.132:58358) 2023-12-20T04:43:23.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.352+0000 7f77d659c640 1 -- 172.21.15.132:0/845265428 learned_addr learned my addr 172.21.15.132:0/845265428 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:23.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.352+0000 7f77d6d9d640 1 -- 172.21.15.132:0/845265428 >> v2:172.21.15.187:3300/0 conn(0x7f77d80b4980 msgr2=0x7f77d80b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:23.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.352+0000 7f77d6d9d640 1 --2- 172.21.15.132:0/845265428 >> v2:172.21.15.187:3300/0 conn(0x7f77d80b4980 0x7f77d80b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.352+0000 7f77d6d9d640 1 -- 172.21.15.132:0/845265428 >> v1:172.21.15.187:6789/0 conn(0x7f77d8160450 legacy=0x7f77d8160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.352+0000 7f77d5d9b640 1 -- 172.21.15.132:0/845265428 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1170074091 0 0) 0x7f77d80b5320 con 0x7f77d8160450 2023-12-20T04:43:23.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.352+0000 7f77d6d9d640 1 -- 172.21.15.132:0/845265428 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77d80d0fc0 con 0x7f77d80d1aa0 2023-12-20T04:43:23.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.352+0000 7f77cffff640 1 --2- 172.21.15.132:0/845265428 >> v2:172.21.15.187:3300/0 conn(0x7f77d80b4980 0x7f77d80b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:43:23.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.353+0000 7f77d6d9d640 1 --2- 172.21.15.132:0/845265428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d80d1aa0 0x7f77d80d1f30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009d90 tx=0x7f77d002bf30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cca5393ab40edcd0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:23.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.353+0000 7f77d5d9b640 1 -- 172.21.15.132:0/845265428 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d002cce0 con 0x7f77d80d1aa0 2023-12-20T04:43:23.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.353+0000 7f77d5d9b640 1 -- 172.21.15.132:0/845265428 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d002ce40 con 0x7f77d80d1aa0 2023-12-20T04:43:23.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.353+0000 7f77d5d9b640 1 -- 172.21.15.132:0/845265428 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0034660 con 0x7f77d80d1aa0 2023-12-20T04:43:23.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.354+0000 7f77dc920640 1 -- 172.21.15.132:0/845265428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d80d1aa0 msgr2=0x7f77d80d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.354+0000 7f77dc920640 1 --2- 172.21.15.132:0/845265428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d80d1aa0 0x7f77d80d1f30 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009d90 tx=0x7f77d002bf30 comp rx=0 tx=0).stop 2023-12-20T04:43:23.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.354+0000 7f77dc920640 1 -- 172.21.15.132:0/845265428 shutdown_connections 2023-12-20T04:43:23.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.354+0000 7f77dc920640 1 --2- 172.21.15.132:0/845265428 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d80d1aa0 0x7f77d80d1f30 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.354+0000 7f77dc920640 1 --2- 172.21.15.132:0/845265428 >> v2:172.21.15.187:3300/0 conn(0x7f77d80b4980 0x7f77d80b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.354+0000 7f77dc920640 1 -- 172.21.15.132:0/845265428 >> 172.21.15.132:0/845265428 conn(0x7f77d80cf980 msgr2=0x7f77d80cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:23.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.354+0000 7f77dc920640 1 -- 172.21.15.132:0/845265428 shutdown_connections 2023-12-20T04:43:23.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.354+0000 7f77dc920640 1 -- 172.21.15.132:0/845265428 wait complete. 2023-12-20T04:43:23.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.355+0000 7f77dc920640 1 Processor -- start 2023-12-20T04:43:23.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.355+0000 7f77dc920640 1 -- start start 2023-12-20T04:43:23.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77dc920640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77d80b4980 0x7f77d81f6a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77dc920640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d80d1aa0 0x7f77d8154ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77dc920640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77d8160450 0x7f77d8155420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77dc920640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d81f6fd0 con 0x7f77d8160450 2023-12-20T04:43:23.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77dc920640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f77d814dc70 con 0x7f77d80b4980 2023-12-20T04:43:23.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77dc920640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f77d813dd00 con 0x7f77d80d1aa0 2023-12-20T04:43:23.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77d6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77d8160450 0x7f77d8155420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77d659c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77d80b4980 0x7f77d81f6a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77d6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77d8160450 0x7f77d8155420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35784/0 (socket says 172.21.15.132:35784) 2023-12-20T04:43:23.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77d6d9d640 1 -- 172.21.15.132:0/1066941830 learned_addr learned my addr 172.21.15.132:0/1066941830 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:23.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77cffff640 1 --2- 172.21.15.132:0/1066941830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d80d1aa0 0x7f77d8154ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77d6d9d640 1 -- 172.21.15.132:0/1066941830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d80d1aa0 msgr2=0x7f77d8154ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77d6d9d640 1 --2- 172.21.15.132:0/1066941830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d80d1aa0 0x7f77d8154ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77d6d9d640 1 -- 172.21.15.132:0/1066941830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77d80b4980 msgr2=0x7f77d81f6a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77d6d9d640 1 --2- 172.21.15.132:0/1066941830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77d80b4980 0x7f77d81f6a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77d6d9d640 1 -- 172.21.15.132:0/1066941830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77c0009400 con 0x7f77d8160450 2023-12-20T04:43:23.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77d6d9d640 1 --2- 172.21.15.132:0/1066941830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77d8160450 0x7f77d8155420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009eb0 tx=0x7f77d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:23.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77ceffd640 1 -- 172.21.15.132:0/1066941830 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0003b90 con 0x7f77d8160450 2023-12-20T04:43:23.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77ceffd640 1 -- 172.21.15.132:0/1066941830 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77d0003cf0 con 0x7f77d8160450 2023-12-20T04:43:23.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77dc920640 1 -- 172.21.15.132:0/1066941830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f77d0009a70 con 0x7f77d8160450 2023-12-20T04:43:23.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.356+0000 7f77ceffd640 1 -- 172.21.15.132:0/1066941830 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f77d0004250 con 0x7f77d8160450 2023-12-20T04:43:23.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.357+0000 7f77dc920640 1 -- 172.21.15.132:0/1066941830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f77d814df10 con 0x7f77d8160450 2023-12-20T04:43:23.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.357+0000 7f77dc920640 1 -- 172.21.15.132:0/1066941830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f77d814e0a0 con 0x7f77d8160450 2023-12-20T04:43:23.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.358+0000 7f77ceffd640 1 -- 172.21.15.132:0/1066941830 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f77d003b050 con 0x7f77d8160450 2023-12-20T04:43:23.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.358+0000 7f77ceffd640 1 --2- 172.21.15.132:0/1066941830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f77b806a430 0x7f77b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.358+0000 7f77ceffd640 1 -- 172.21.15.132:0/1066941830 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f77d00aad50 con 0x7f77d8160450 2023-12-20T04:43:23.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.358+0000 7f77d659c640 1 --2- 172.21.15.132:0/1066941830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f77b806a430 0x7f77b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.359+0000 7f77d659c640 1 --2- 172.21.15.132:0/1066941830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f77b806a430 0x7f77b806c8f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77c8000f60 tx=0x7f77c8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:23.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.362+0000 7f77ceffd640 1 -- 172.21.15.132:0/1066941830 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f77d00ae030 con 0x7f77d8160450 2023-12-20T04:43:23.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.527+0000 7f77dc920640 1 -- 172.21.15.132:0/1066941830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f77d804e840 con 0x7f77d8160450 2023-12-20T04:43:23.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.529+0000 7f77ceffd640 1 -- 172.21.15.132:0/1066941830 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f77d0076370 con 0x7f77d8160450 2023-12-20T04:43:23.534 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:23.534 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:23.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.530+0000 7f77dc920640 1 -- 172.21.15.132:0/1066941830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f77b806a430 msgr2=0x7f77b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.530+0000 7f77dc920640 1 --2- 172.21.15.132:0/1066941830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f77b806a430 0x7f77b806c8f0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f77c8000f60 tx=0x7f77c8009040 comp rx=0 tx=0).stop 2023-12-20T04:43:23.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.530+0000 7f77dc920640 1 -- 172.21.15.132:0/1066941830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77d8160450 msgr2=0x7f77d8155420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.530+0000 7f77dc920640 1 --2- 172.21.15.132:0/1066941830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77d8160450 0x7f77d8155420 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f77d0009eb0 tx=0x7f77d0004a40 comp rx=0 tx=0).stop 2023-12-20T04:43:23.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.531+0000 7f77dc920640 1 -- 172.21.15.132:0/1066941830 shutdown_connections 2023-12-20T04:43:23.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.531+0000 7f77dc920640 1 --2- 172.21.15.132:0/1066941830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f77b806a430 0x7f77b806c8f0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.531+0000 7f77dc920640 1 --2- 172.21.15.132:0/1066941830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f77d8160450 0x7f77d8155420 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.531+0000 7f77dc920640 1 --2- 172.21.15.132:0/1066941830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77d80d1aa0 0x7f77d8154ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.531+0000 7f77dc920640 1 --2- 172.21.15.132:0/1066941830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f77d80b4980 0x7f77d81f6a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.531+0000 7f77dc920640 1 -- 172.21.15.132:0/1066941830 >> 172.21.15.132:0/1066941830 conn(0x7f77d80cf980 msgr2=0x7f77d80d2500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:23.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.531+0000 7f77dc920640 1 -- 172.21.15.132:0/1066941830 shutdown_connections 2023-12-20T04:43:23.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.531+0000 7f77dc920640 1 -- 172.21.15.132:0/1066941830 wait complete. 2023-12-20T04:43:23.544 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:42:45.433456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:42:46.128920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:43:23.544 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:43:23.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.645+0000 7ff63cb00640 1 Processor -- start 2023-12-20T04:43:23.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.645+0000 7ff63cb00640 1 -- start start 2023-12-20T04:43:23.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.645+0000 7ff63cb00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff638069c30 0x7ff638070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.645+0000 7ff63cb00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff6380cbde0 0x7ff6380ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.645+0000 7ff63cb00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6380c4f40 con 0x7ff63815d360 2023-12-20T04:43:23.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.645+0000 7ff63cb00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6380af5b0 con 0x7ff6380cbde0 2023-12-20T04:43:23.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.645+0000 7ff63cb00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff638070a40 con 0x7ff638069c30 2023-12-20T04:43:23.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.646+0000 7ff636d9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff6380cbde0 0x7ff6380ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.646+0000 7ff63659c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff638069c30 0x7ff638070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.646+0000 7ff63659c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff638069c30 0x7ff638070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:35292/0 (socket says 172.21.15.132:35292) 2023-12-20T04:43:23.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.646+0000 7ff636d9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff6380cbde0 0x7ff6380ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:58372/0 (socket says 172.21.15.132:58372) 2023-12-20T04:43:23.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.646+0000 7ff63659c640 1 -- 172.21.15.132:0/509456256 learned_addr learned my addr 172.21.15.132:0/509456256 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:23.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.646+0000 7ff63659c640 1 -- 172.21.15.132:0/509456256 >> v2:172.21.15.187:3300/0 conn(0x7ff6380cbde0 msgr2=0x7ff6380ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:23.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.646+0000 7ff63659c640 1 --2- 172.21.15.132:0/509456256 >> v2:172.21.15.187:3300/0 conn(0x7ff6380cbde0 0x7ff6380ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.646+0000 7ff63659c640 1 -- 172.21.15.132:0/509456256 >> v1:172.21.15.187:6789/0 conn(0x7ff63815d360 legacy=0x7ff63806a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.646+0000 7ff63659c640 1 -- 172.21.15.132:0/509456256 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff638070d20 con 0x7ff638069c30 2023-12-20T04:43:23.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.647+0000 7ff63659c640 1 --2- 172.21.15.132:0/509456256 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff638069c30 0x7ff638070460 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff628009870 tx=0x7ff62802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=8a60e6ec96301f59 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:23.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.647+0000 7ff635d9b640 1 -- 172.21.15.132:0/509456256 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628030840 con 0x7ff638069c30 2023-12-20T04:43:23.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.647+0000 7ff635d9b640 1 -- 172.21.15.132:0/509456256 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6280309a0 con 0x7ff638069c30 2023-12-20T04:43:23.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.647+0000 7ff635d9b640 1 -- 172.21.15.132:0/509456256 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff628030d30 con 0x7ff638069c30 2023-12-20T04:43:23.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.647+0000 7ff63cb00640 1 -- 172.21.15.132:0/509456256 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff638069c30 msgr2=0x7ff638070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.647+0000 7ff63cb00640 1 --2- 172.21.15.132:0/509456256 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff638069c30 0x7ff638070460 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7ff628009870 tx=0x7ff62802b980 comp rx=0 tx=0).stop 2023-12-20T04:43:23.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.648+0000 7ff63cb00640 1 -- 172.21.15.132:0/509456256 shutdown_connections 2023-12-20T04:43:23.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.648+0000 7ff63cb00640 1 --2- 172.21.15.132:0/509456256 >> v2:172.21.15.187:3300/0 conn(0x7ff6380cbde0 0x7ff6380ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.648+0000 7ff63cb00640 1 --2- 172.21.15.132:0/509456256 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff638069c30 0x7ff638070460 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.648+0000 7ff63cb00640 1 -- 172.21.15.132:0/509456256 >> 172.21.15.132:0/509456256 conn(0x7ff6380cc630 msgr2=0x7ff6380cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:23.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.648+0000 7ff63cb00640 1 -- 172.21.15.132:0/509456256 shutdown_connections 2023-12-20T04:43:23.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.648+0000 7ff63cb00640 1 -- 172.21.15.132:0/509456256 wait complete. 2023-12-20T04:43:23.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.649+0000 7ff63cb00640 1 Processor -- start 2023-12-20T04:43:23.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.649+0000 7ff63cb00640 1 -- start start 2023-12-20T04:43:23.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.650+0000 7ff63cb00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff638069c30 0x7ff638158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.650+0000 7ff63cb00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6380cbde0 0x7ff6380c53d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.650+0000 7ff63cb00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff63815d360 0x7ff6380c5910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.650+0000 7ff63cb00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff638159760 con 0x7ff6380cbde0 2023-12-20T04:43:23.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.650+0000 7ff63cb00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff638159a40 con 0x7ff63815d360 2023-12-20T04:43:23.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.650+0000 7ff63cb00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff638159d20 con 0x7ff638069c30 2023-12-20T04:43:23.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.650+0000 7ff62dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6380cbde0 0x7ff6380c53d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.650+0000 7ff62dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6380cbde0 0x7ff6380c53d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35786/0 (socket says 172.21.15.132:35786) 2023-12-20T04:43:23.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.650+0000 7ff62dd9b640 1 -- 172.21.15.132:0/355393039 learned_addr learned my addr 172.21.15.132:0/355393039 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:23.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.650+0000 7ff63659c640 1 --2- 172.21.15.132:0/355393039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff638069c30 0x7ff638158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.650+0000 7ff636d9d640 1 --2- 172.21.15.132:0/355393039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff63815d360 0x7ff6380c5910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.650+0000 7ff62dd9b640 1 -- 172.21.15.132:0/355393039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff638069c30 msgr2=0x7ff638158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.650+0000 7ff62dd9b640 1 --2- 172.21.15.132:0/355393039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff638069c30 0x7ff638158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.650+0000 7ff62dd9b640 1 -- 172.21.15.132:0/355393039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff63815d360 msgr2=0x7ff6380c5910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.650+0000 7ff62dd9b640 1 --2- 172.21.15.132:0/355393039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff63815d360 0x7ff6380c5910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.650+0000 7ff62dd9b640 1 -- 172.21.15.132:0/355393039 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6280094d0 con 0x7ff6380cbde0 2023-12-20T04:43:23.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.650+0000 7ff62dd9b640 1 --2- 172.21.15.132:0/355393039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6380cbde0 0x7ff6380c53d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff62000c3c0 tx=0x7ff62000c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:23.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.651+0000 7ff62f7fe640 1 -- 172.21.15.132:0/355393039 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6200052d0 con 0x7ff6380cbde0 2023-12-20T04:43:23.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.651+0000 7ff62f7fe640 1 -- 172.21.15.132:0/355393039 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff620005450 con 0x7ff6380cbde0 2023-12-20T04:43:23.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.651+0000 7ff63cb00640 1 -- 172.21.15.132:0/355393039 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff63815a000 con 0x7ff6380cbde0 2023-12-20T04:43:23.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.651+0000 7ff62f7fe640 1 -- 172.21.15.132:0/355393039 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff620007260 con 0x7ff6380cbde0 2023-12-20T04:43:23.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.651+0000 7ff63cb00640 1 -- 172.21.15.132:0/355393039 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff638159450 con 0x7ff6380cbde0 2023-12-20T04:43:23.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.652+0000 7ff63cb00640 1 -- 172.21.15.132:0/355393039 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff63804e840 con 0x7ff6380cbde0 2023-12-20T04:43:23.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.652+0000 7ff62f7fe640 1 -- 172.21.15.132:0/355393039 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff6200073c0 con 0x7ff6380cbde0 2023-12-20T04:43:23.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.652+0000 7ff62f7fe640 1 --2- 172.21.15.132:0/355393039 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff61806a430 0x7ff61806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.652+0000 7ff62f7fe640 1 -- 172.21.15.132:0/355393039 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff620087c00 con 0x7ff6380cbde0 2023-12-20T04:43:23.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.652+0000 7ff63659c640 1 --2- 172.21.15.132:0/355393039 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff61806a430 0x7ff61806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.653+0000 7ff63659c640 1 --2- 172.21.15.132:0/355393039 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff61806a430 0x7ff61806c8f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff628036000 tx=0x7ff628008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:23.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.657+0000 7ff62f7fe640 1 -- 172.21.15.132:0/355393039 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff62008e080 con 0x7ff6380cbde0 2023-12-20T04:43:23.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.821+0000 7ff63cb00640 1 -- 172.21.15.132:0/355393039 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff638070fd0 con 0x7ff6380cbde0 2023-12-20T04:43:23.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.821+0000 7ff62f7fe640 1 -- 172.21.15.132:0/355393039 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff6200532a0 con 0x7ff6380cbde0 2023-12-20T04:43:23.823 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:43:23.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.823+0000 7ff63cb00640 1 -- 172.21.15.132:0/355393039 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff61806a430 msgr2=0x7ff61806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.823+0000 7ff63cb00640 1 --2- 172.21.15.132:0/355393039 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff61806a430 0x7ff61806c8f0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7ff628036000 tx=0x7ff628008030 comp rx=0 tx=0).stop 2023-12-20T04:43:23.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.823+0000 7ff63cb00640 1 -- 172.21.15.132:0/355393039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6380cbde0 msgr2=0x7ff6380c53d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.823+0000 7ff63cb00640 1 --2- 172.21.15.132:0/355393039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6380cbde0 0x7ff6380c53d0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7ff62000c3c0 tx=0x7ff62000c880 comp rx=0 tx=0).stop 2023-12-20T04:43:23.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.823+0000 7ff63cb00640 1 -- 172.21.15.132:0/355393039 shutdown_connections 2023-12-20T04:43:23.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.823+0000 7ff63cb00640 1 --2- 172.21.15.132:0/355393039 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff61806a430 0x7ff61806c8f0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.823+0000 7ff63cb00640 1 --2- 172.21.15.132:0/355393039 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff63815d360 0x7ff6380c5910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.823+0000 7ff63cb00640 1 --2- 172.21.15.132:0/355393039 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6380cbde0 0x7ff6380c53d0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.823+0000 7ff63cb00640 1 --2- 172.21.15.132:0/355393039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff638069c30 0x7ff638158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.823+0000 7ff63cb00640 1 -- 172.21.15.132:0/355393039 >> 172.21.15.132:0/355393039 conn(0x7ff6380cc630 msgr2=0x7ff63806e9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:23.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.823+0000 7ff63cb00640 1 -- 172.21.15.132:0/355393039 shutdown_connections 2023-12-20T04:43:23.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.823+0000 7ff63cb00640 1 -- 172.21.15.132:0/355393039 wait complete. 2023-12-20T04:43:23.835 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:43:23.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.936+0000 7fec466d5640 1 Processor -- start 2023-12-20T04:43:23.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.936+0000 7fec466d5640 1 -- start start 2023-12-20T04:43:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.937+0000 7fec466d5640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fec400cb8b0 0x7fec40159a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.937+0000 7fec466d5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fec40159f40 0x7fec400c9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.937+0000 7fec466d5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec400cb420 con 0x7fec400cc940 2023-12-20T04:43:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.937+0000 7fec466d5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec40153ee0 con 0x7fec40159f40 2023-12-20T04:43:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.937+0000 7fec466d5640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fec4015a4f0 con 0x7fec400cb8b0 2023-12-20T04:43:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.937+0000 7fec44c72640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fec40159f40 0x7fec400c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.937+0000 7fec3ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fec400cc940 0x7fec400ccd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60110/0 (socket says 172.21.15.132:60110) 2023-12-20T04:43:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.937+0000 7fec3ffff640 1 -- 172.21.15.132:0/3221686510 learned_addr learned my addr 172.21.15.132:0/3221686510 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.937+0000 7fec44c72640 1 --2- 172.21.15.132:0/3221686510 >> v2:172.21.15.132:3300/0 conn(0x7fec40159f40 0x7fec400c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35788/0 (socket says 172.21.15.132:35788) 2023-12-20T04:43:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.937+0000 7fec3f7fe640 1 --2- 172.21.15.132:0/3221686510 >> v2:172.21.15.187:3300/0 conn(0x7fec400cb8b0 0x7fec40159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.937+0000 7fec44c72640 1 -- 172.21.15.132:0/3221686510 >> v2:172.21.15.187:3300/0 conn(0x7fec400cb8b0 msgr2=0x7fec40159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.937+0000 7fec44c72640 1 --2- 172.21.15.132:0/3221686510 >> v2:172.21.15.187:3300/0 conn(0x7fec400cb8b0 0x7fec40159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.937+0000 7fec44c72640 1 -- 172.21.15.132:0/3221686510 >> v1:172.21.15.132:6789/0 conn(0x7fec400cc940 legacy=0x7fec400ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.937+0000 7fec3effd640 1 -- 172.21.15.132:0/3221686510 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 305773804 0 0) 0x7fec400cb420 con 0x7fec400cc940 2023-12-20T04:43:23.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.937+0000 7fec44c72640 1 -- 172.21.15.132:0/3221686510 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec4015a7d0 con 0x7fec40159f40 2023-12-20T04:43:23.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.938+0000 7fec44c72640 1 --2- 172.21.15.132:0/3221686510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec40159f40 0x7fec400c9280 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fec4006d570 tx=0x7fec3802bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee7e711ba498028 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:23.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.938+0000 7fec3effd640 1 -- 172.21.15.132:0/3221686510 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3802cd00 con 0x7fec40159f40 2023-12-20T04:43:23.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.938+0000 7fec3effd640 1 -- 172.21.15.132:0/3221686510 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3802ce60 con 0x7fec40159f40 2023-12-20T04:43:23.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.938+0000 7fec3effd640 1 -- 172.21.15.132:0/3221686510 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec38034660 con 0x7fec40159f40 2023-12-20T04:43:23.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.939+0000 7fec466d5640 1 -- 172.21.15.132:0/3221686510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec40159f40 msgr2=0x7fec400c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.939+0000 7fec466d5640 1 --2- 172.21.15.132:0/3221686510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec40159f40 0x7fec400c9280 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fec4006d570 tx=0x7fec3802bf50 comp rx=0 tx=0).stop 2023-12-20T04:43:23.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.939+0000 7fec466d5640 1 -- 172.21.15.132:0/3221686510 shutdown_connections 2023-12-20T04:43:23.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.939+0000 7fec466d5640 1 --2- 172.21.15.132:0/3221686510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec40159f40 0x7fec400c9280 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.939+0000 7fec466d5640 1 --2- 172.21.15.132:0/3221686510 >> v2:172.21.15.187:3300/0 conn(0x7fec400cb8b0 0x7fec40159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.939+0000 7fec466d5640 1 -- 172.21.15.132:0/3221686510 >> 172.21.15.132:0/3221686510 conn(0x7fec4006a260 msgr2=0x7fec400b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:23.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.939+0000 7fec466d5640 1 -- 172.21.15.132:0/3221686510 shutdown_connections 2023-12-20T04:43:23.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.939+0000 7fec466d5640 1 -- 172.21.15.132:0/3221686510 wait complete. 2023-12-20T04:43:23.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.940+0000 7fec466d5640 1 Processor -- start 2023-12-20T04:43:23.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.940+0000 7fec466d5640 1 -- start start 2023-12-20T04:43:23.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec466d5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec400cb8b0 0x7fec401364b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec466d5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec400cc940 0x7fec400b17d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec466d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec40159f40 0x7fec4014a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec466d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec401369f0 con 0x7fec40159f40 2023-12-20T04:43:23.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec466d5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec400b2290 con 0x7fec400cb8b0 2023-12-20T04:43:23.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec466d5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec400b2570 con 0x7fec400cc940 2023-12-20T04:43:23.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec44c72640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec40159f40 0x7fec4014a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec44c72640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec40159f40 0x7fec4014a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35802/0 (socket says 172.21.15.132:35802) 2023-12-20T04:43:23.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec44c72640 1 -- 172.21.15.132:0/1168552076 learned_addr learned my addr 172.21.15.132:0/1168552076 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:23.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec3f7fe640 1 --2- 172.21.15.132:0/1168552076 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec400cc940 0x7fec400b17d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec3ffff640 1 --2- 172.21.15.132:0/1168552076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec400cb8b0 0x7fec401364b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec44c72640 1 -- 172.21.15.132:0/1168552076 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec400cc940 msgr2=0x7fec400b17d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec44c72640 1 --2- 172.21.15.132:0/1168552076 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec400cc940 0x7fec400b17d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec44c72640 1 -- 172.21.15.132:0/1168552076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec400cb8b0 msgr2=0x7fec401364b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:23.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec44c72640 1 --2- 172.21.15.132:0/1168552076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec400cb8b0 0x7fec401364b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:23.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec44c72640 1 -- 172.21.15.132:0/1168552076 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec38009a70 con 0x7fec40159f40 2023-12-20T04:43:23.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec44c72640 1 --2- 172.21.15.132:0/1168552076 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec40159f40 0x7fec4014a5f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fec38009e80 tx=0x7fec38004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:23.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.941+0000 7fec3cff9640 1 -- 172.21.15.132:0/1168552076 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3803d600 con 0x7fec40159f40 2023-12-20T04:43:23.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.942+0000 7fec3cff9640 1 -- 172.21.15.132:0/1168552076 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec3803d780 con 0x7fec40159f40 2023-12-20T04:43:23.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.942+0000 7fec466d5640 1 -- 172.21.15.132:0/1168552076 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec400b2850 con 0x7fec40159f40 2023-12-20T04:43:23.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.942+0000 7fec3cff9640 1 -- 172.21.15.132:0/1168552076 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec3803db30 con 0x7fec40159f40 2023-12-20T04:43:23.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.942+0000 7fec466d5640 1 -- 172.21.15.132:0/1168552076 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec400b2e10 con 0x7fec40159f40 2023-12-20T04:43:23.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.943+0000 7fec466d5640 1 -- 172.21.15.132:0/1168552076 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec4004e840 con 0x7fec40159f40 2023-12-20T04:43:23.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.943+0000 7fec3cff9640 1 -- 172.21.15.132:0/1168552076 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fec3803b040 con 0x7fec40159f40 2023-12-20T04:43:23.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.943+0000 7fec3cff9640 1 --2- 172.21.15.132:0/1168552076 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fec2006a430 0x7fec2006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:23.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.944+0000 7fec3ffff640 1 --2- 172.21.15.132:0/1168552076 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fec2006a430 0x7fec2006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:23.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.944+0000 7fec3cff9640 1 -- 172.21.15.132:0/1168552076 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec380ab040 con 0x7fec40159f40 2023-12-20T04:43:23.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.944+0000 7fec3ffff640 1 --2- 172.21.15.132:0/1168552076 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fec2006a430 0x7fec2006c8f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fec30000f60 tx=0x7fec30007b70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:23.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:23.948+0000 7fec3cff9640 1 -- 172.21.15.132:0/1168552076 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fec380765b0 con 0x7fec40159f40 2023-12-20T04:43:24.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.115+0000 7fec466d5640 1 -- 172.21.15.132:0/1168552076 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fec4015cb40 con 0x7fec40159f40 2023-12-20T04:43:24.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.116+0000 7fec3cff9640 1 -- 172.21.15.132:0/1168552076 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fec38079bd0 con 0x7fec40159f40 2023-12-20T04:43:24.118 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:43:24.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.118+0000 7fec466d5640 1 -- 172.21.15.132:0/1168552076 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fec2006a430 msgr2=0x7fec2006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:24.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.118+0000 7fec466d5640 1 --2- 172.21.15.132:0/1168552076 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fec2006a430 0x7fec2006c8f0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fec30000f60 tx=0x7fec30007b70 comp rx=0 tx=0).stop 2023-12-20T04:43:24.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.118+0000 7fec466d5640 1 -- 172.21.15.132:0/1168552076 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec40159f40 msgr2=0x7fec4014a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:24.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.118+0000 7fec466d5640 1 --2- 172.21.15.132:0/1168552076 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec40159f40 0x7fec4014a5f0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fec38009e80 tx=0x7fec38004a40 comp rx=0 tx=0).stop 2023-12-20T04:43:24.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.118+0000 7fec466d5640 1 -- 172.21.15.132:0/1168552076 shutdown_connections 2023-12-20T04:43:24.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.118+0000 7fec466d5640 1 --2- 172.21.15.132:0/1168552076 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fec2006a430 0x7fec2006c8f0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.118+0000 7fec466d5640 1 --2- 172.21.15.132:0/1168552076 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec40159f40 0x7fec4014a5f0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.118+0000 7fec466d5640 1 --2- 172.21.15.132:0/1168552076 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec400cc940 0x7fec400b17d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.118+0000 7fec466d5640 1 --2- 172.21.15.132:0/1168552076 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec400cb8b0 0x7fec401364b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.118+0000 7fec466d5640 1 -- 172.21.15.132:0/1168552076 >> 172.21.15.132:0/1168552076 conn(0x7fec4006a260 msgr2=0x7fec401587d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:24.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.118+0000 7fec466d5640 1 -- 172.21.15.132:0/1168552076 shutdown_connections 2023-12-20T04:43:24.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.118+0000 7fec466d5640 1 -- 172.21.15.132:0/1168552076 wait complete. 2023-12-20T04:43:24.130 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:43:24.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.231+0000 7f09984d8640 1 Processor -- start 2023-12-20T04:43:24.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.231+0000 7f09984d8640 1 -- start start 2023-12-20T04:43:24.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.232+0000 7f09984d8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09900cf790 0x7f09900cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:24.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.232+0000 7f09984d8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f09900b6080 0x7f09900b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:24.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.232+0000 7f09984d8640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f09900d0150 con 0x7f099015d300 2023-12-20T04:43:24.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.232+0000 7f09984d8640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f09900d2920 con 0x7f09900b6080 2023-12-20T04:43:24.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.232+0000 7f09984d8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09900d1d10 con 0x7f09900cf790 2023-12-20T04:43:24.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.232+0000 7f0996a75640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f09900b6080 0x7f09900b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:24.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.232+0000 7f0996a75640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f09900b6080 0x7f09900b64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35812/0 (socket says 172.21.15.132:35812) 2023-12-20T04:43:24.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.232+0000 7f0996a75640 1 -- 172.21.15.132:0/3401474957 learned_addr learned my addr 172.21.15.132:0/3401474957 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:24.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.233+0000 7f0995a73640 1 --2- 172.21.15.132:0/3401474957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09900cf790 0x7f09900cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:24.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.233+0000 7f0996a75640 1 -- 172.21.15.132:0/3401474957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09900cf790 msgr2=0x7f09900cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:24.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.233+0000 7f0996a75640 1 --2- 172.21.15.132:0/3401474957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09900cf790 0x7f09900cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.233+0000 7f0996a75640 1 -- 172.21.15.132:0/3401474957 >> v1:172.21.15.187:6789/0 conn(0x7f099015d300 legacy=0x7f09900d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:24.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.233+0000 7f0996a75640 1 -- 172.21.15.132:0/3401474957 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09900d1ff0 con 0x7f09900b6080 2023-12-20T04:43:24.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.233+0000 7f0995a73640 1 --2- 172.21.15.132:0/3401474957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09900cf790 0x7f09900cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:24.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.233+0000 7f0996a75640 1 --2- 172.21.15.132:0/3401474957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09900b6080 0x7f09900b64d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0988009870 tx=0x7f098802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ec9ef253bbfb293 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:24.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.233+0000 7f0995272640 1 -- 172.21.15.132:0/3401474957 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988031640 con 0x7f09900b6080 2023-12-20T04:43:24.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.234+0000 7f0995272640 1 -- 172.21.15.132:0/3401474957 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09880317a0 con 0x7f09900b6080 2023-12-20T04:43:24.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.234+0000 7f0995272640 1 -- 172.21.15.132:0/3401474957 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988031b30 con 0x7f09900b6080 2023-12-20T04:43:24.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.234+0000 7f09984d8640 1 -- 172.21.15.132:0/3401474957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09900b6080 msgr2=0x7f09900b64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:24.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.234+0000 7f09984d8640 1 --2- 172.21.15.132:0/3401474957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09900b6080 0x7f09900b64d0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f0988009870 tx=0x7f098802b8f0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.234+0000 7f09984d8640 1 -- 172.21.15.132:0/3401474957 shutdown_connections 2023-12-20T04:43:24.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.234+0000 7f09984d8640 1 --2- 172.21.15.132:0/3401474957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f09900b6080 0x7f09900b64d0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.234+0000 7f09984d8640 1 --2- 172.21.15.132:0/3401474957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09900cf790 0x7f09900cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.234+0000 7f09984d8640 1 -- 172.21.15.132:0/3401474957 >> 172.21.15.132:0/3401474957 conn(0x7f099006a3d0 msgr2=0x7f099006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:24.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.234+0000 7f09984d8640 1 -- 172.21.15.132:0/3401474957 shutdown_connections 2023-12-20T04:43:24.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.234+0000 7f09984d8640 1 -- 172.21.15.132:0/3401474957 wait complete. 2023-12-20T04:43:24.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.235+0000 7f09984d8640 1 Processor -- start 2023-12-20T04:43:24.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.235+0000 7f09984d8640 1 -- start start 2023-12-20T04:43:24.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.236+0000 7f09984d8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09900b6080 0x7f099015e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:24.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.236+0000 7f09984d8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09900cf790 0x7f099015d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:24.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.236+0000 7f09984d8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f099015d300 0x7f0990156040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:24.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.236+0000 7f09984d8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f09900ca950 con 0x7f099015d300 2023-12-20T04:43:24.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.236+0000 7f09984d8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f099015e050 con 0x7f09900b6080 2023-12-20T04:43:24.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.236+0000 7f09984d8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f09900cab60 con 0x7f09900cf790 2023-12-20T04:43:24.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.236+0000 7f0996a75640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f099015d300 0x7f0990156040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:24.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.236+0000 7f0996a75640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f099015d300 0x7f0990156040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35824/0 (socket says 172.21.15.132:35824) 2023-12-20T04:43:24.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.236+0000 7f0996a75640 1 -- 172.21.15.132:0/3195975285 learned_addr learned my addr 172.21.15.132:0/3195975285 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:24.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.236+0000 7f0996a75640 1 -- 172.21.15.132:0/3195975285 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09900cf790 msgr2=0x7f099015d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:24.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.236+0000 7f0996a75640 1 --2- 172.21.15.132:0/3195975285 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09900cf790 0x7f099015d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.236+0000 7f0996a75640 1 -- 172.21.15.132:0/3195975285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09900b6080 msgr2=0x7f099015e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:24.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.236+0000 7f0996274640 1 --2- 172.21.15.132:0/3195975285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09900b6080 0x7f099015e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:24.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.236+0000 7f0996a75640 1 --2- 172.21.15.132:0/3195975285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09900b6080 0x7f099015e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.236+0000 7f0996a75640 1 -- 172.21.15.132:0/3195975285 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f09880094d0 con 0x7f099015d300 2023-12-20T04:43:24.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.237+0000 7f0996a75640 1 --2- 172.21.15.132:0/3195975285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f099015d300 0x7f0990156040 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f098802b930 tx=0x7f09880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:24.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.237+0000 7f0986ffd640 1 -- 172.21.15.132:0/3195975285 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f098803ac60 con 0x7f099015d300 2023-12-20T04:43:24.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.237+0000 7f0986ffd640 1 -- 172.21.15.132:0/3195975285 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f098803ade0 con 0x7f099015d300 2023-12-20T04:43:24.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.237+0000 7f09984d8640 1 -- 172.21.15.132:0/3195975285 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f09900cae40 con 0x7f099015d300 2023-12-20T04:43:24.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.237+0000 7f0986ffd640 1 -- 172.21.15.132:0/3195975285 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0988044630 con 0x7f099015d300 2023-12-20T04:43:24.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.237+0000 7f09984d8640 1 -- 172.21.15.132:0/3195975285 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f099015ed00 con 0x7f099015d300 2023-12-20T04:43:24.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.238+0000 7f09984d8640 1 -- 172.21.15.132:0/3195975285 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f099015eef0 con 0x7f099015d300 2023-12-20T04:43:24.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.238+0000 7f0986ffd640 1 -- 172.21.15.132:0/3195975285 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f098802f050 con 0x7f099015d300 2023-12-20T04:43:24.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.239+0000 7f0986ffd640 1 --2- 172.21.15.132:0/3195975285 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f097406a430 0x7f097406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:24.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.239+0000 7f0996274640 1 --2- 172.21.15.132:0/3195975285 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f097406a430 0x7f097406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:24.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.239+0000 7f0986ffd640 1 -- 172.21.15.132:0/3195975285 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09880aaa00 con 0x7f099015d300 2023-12-20T04:43:24.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.239+0000 7f0996274640 1 --2- 172.21.15.132:0/3195975285 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f097406a430 0x7f097406c8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f098c007bf0 tx=0x7f098c007240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:24.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.243+0000 7f0986ffd640 1 -- 172.21.15.132:0/3195975285 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0988076140 con 0x7f099015d300 2023-12-20T04:43:24.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.409+0000 7f09984d8640 1 -- 172.21.15.132:0/3195975285 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f09900cb360 con 0x7f099015d300 2023-12-20T04:43:24.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.410+0000 7f0986ffd640 1 -- 172.21.15.132:0/3195975285 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f098804d450 con 0x7f099015d300 2023-12-20T04:43:24.411 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:43:24.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.412+0000 7f09984d8640 1 -- 172.21.15.132:0/3195975285 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f097406a430 msgr2=0x7f097406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:24.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.412+0000 7f09984d8640 1 --2- 172.21.15.132:0/3195975285 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f097406a430 0x7f097406c8f0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f098c007bf0 tx=0x7f098c007240 comp rx=0 tx=0).stop 2023-12-20T04:43:24.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.412+0000 7f09984d8640 1 -- 172.21.15.132:0/3195975285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f099015d300 msgr2=0x7f0990156040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:24.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.412+0000 7f09984d8640 1 --2- 172.21.15.132:0/3195975285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f099015d300 0x7f0990156040 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f098802b930 tx=0x7f09880046c0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.412+0000 7f09984d8640 1 -- 172.21.15.132:0/3195975285 shutdown_connections 2023-12-20T04:43:24.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.412+0000 7f09984d8640 1 --2- 172.21.15.132:0/3195975285 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f097406a430 0x7f097406c8f0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.412+0000 7f09984d8640 1 --2- 172.21.15.132:0/3195975285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f099015d300 0x7f0990156040 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.412+0000 7f09984d8640 1 --2- 172.21.15.132:0/3195975285 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f09900cf790 0x7f099015d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.412+0000 7f09984d8640 1 --2- 172.21.15.132:0/3195975285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f09900b6080 0x7f099015e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.412+0000 7f09984d8640 1 -- 172.21.15.132:0/3195975285 >> 172.21.15.132:0/3195975285 conn(0x7f099006a3d0 msgr2=0x7f09900d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:24.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.412+0000 7f09984d8640 1 -- 172.21.15.132:0/3195975285 shutdown_connections 2023-12-20T04:43:24.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.412+0000 7f09984d8640 1 -- 172.21.15.132:0/3195975285 wait complete. 2023-12-20T04:43:24.425 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:43:24.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.524+0000 7fe61493e640 1 Processor -- start 2023-12-20T04:43:24.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.524+0000 7fe61493e640 1 -- start start 2023-12-20T04:43:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.525+0000 7fe61493e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe6100d0520 0x7fe61015e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.525+0000 7fe61493e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe61015b2e0 con 0x7fe61015af00 2023-12-20T04:43:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.525+0000 7fe61493e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe610161660 con 0x7fe61015e570 2023-12-20T04:43:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.525+0000 7fe61493e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe61015dc10 con 0x7fe6100d0520 2023-12-20T04:43:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.525+0000 7fe607fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe6100d0520 0x7fe61015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.525+0000 7fe60e59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe61015af00 0x7fe610160e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60114/0 (socket says 172.21.15.132:60114) 2023-12-20T04:43:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.525+0000 7fe60e59c640 1 -- 172.21.15.132:0/3609335029 learned_addr learned my addr 172.21.15.132:0/3609335029 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.525+0000 7fe607fff640 1 -- 172.21.15.132:0/3609335029 >> v1:172.21.15.187:6789/0 conn(0x7fe61015e570 legacy=0x7fe61006ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.525+0000 7fe607fff640 1 -- 172.21.15.132:0/3609335029 >> v1:172.21.15.132:6789/0 conn(0x7fe61015af00 legacy=0x7fe610160e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.525+0000 7fe607fff640 1 -- 172.21.15.132:0/3609335029 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe610161940 con 0x7fe6100d0520 2023-12-20T04:43:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.525+0000 7fe60dd9b640 1 -- 172.21.15.132:0/3609335029 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2165130871 0 0) 0x7fe61015b2e0 con 0x7fe61015af00 2023-12-20T04:43:24.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.526+0000 7fe607fff640 1 --2- 172.21.15.132:0/3609335029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6100d0520 0x7fe61015e030 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80097a0 tx=0x7fe5f802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2982bc00e5ff892b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:24.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.526+0000 7fe60dd9b640 1 -- 172.21.15.132:0/3609335029 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f802e070 con 0x7fe6100d0520 2023-12-20T04:43:24.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.526+0000 7fe60dd9b640 1 -- 172.21.15.132:0/3609335029 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5f80315a0 con 0x7fe6100d0520 2023-12-20T04:43:24.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.526+0000 7fe60dd9b640 1 -- 172.21.15.132:0/3609335029 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe5f8031930 con 0x7fe6100d0520 2023-12-20T04:43:24.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.526+0000 7fe61493e640 1 -- 172.21.15.132:0/3609335029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6100d0520 msgr2=0x7fe61015e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:24.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.526+0000 7fe61493e640 1 --2- 172.21.15.132:0/3609335029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6100d0520 0x7fe61015e030 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7fe5f80097a0 tx=0x7fe5f802b840 comp rx=0 tx=0).stop 2023-12-20T04:43:24.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.527+0000 7fe61493e640 1 -- 172.21.15.132:0/3609335029 shutdown_connections 2023-12-20T04:43:24.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.527+0000 7fe61493e640 1 --2- 172.21.15.132:0/3609335029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6100d0520 0x7fe61015e030 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.527+0000 7fe61493e640 1 -- 172.21.15.132:0/3609335029 >> 172.21.15.132:0/3609335029 conn(0x7fe61006d640 msgr2=0x7fe61006da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:24.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.527+0000 7fe61493e640 1 -- 172.21.15.132:0/3609335029 shutdown_connections 2023-12-20T04:43:24.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.527+0000 7fe61493e640 1 -- 172.21.15.132:0/3609335029 wait complete. 2023-12-20T04:43:24.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.528+0000 7fe61493e640 1 Processor -- start 2023-12-20T04:43:24.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.528+0000 7fe61493e640 1 -- start start 2023-12-20T04:43:24.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.528+0000 7fe61493e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6100d0520 0x7fe610157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:24.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe61493e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe61015af00 0x7fe6100b3cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:24.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe61493e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe61015e570 0x7fe6100b4210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:24.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe61493e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe61015cef0 con 0x7fe61015e570 2023-12-20T04:43:24.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe61493e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6101577c0 con 0x7fe61015af00 2023-12-20T04:43:24.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe61493e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6101e7cd0 con 0x7fe6100d0520 2023-12-20T04:43:24.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe60ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe61015e570 0x7fe6100b4210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:24.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe60ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe61015e570 0x7fe6100b4210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35850/0 (socket says 172.21.15.132:35850) 2023-12-20T04:43:24.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe60ed9d640 1 -- 172.21.15.132:0/3167416638 learned_addr learned my addr 172.21.15.132:0/3167416638 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:24.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe60e59c640 1 --2- 172.21.15.132:0/3167416638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6100d0520 0x7fe610157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:24.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe607fff640 1 --2- 172.21.15.132:0/3167416638 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe61015af00 0x7fe6100b3cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:24.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe60ed9d640 1 -- 172.21.15.132:0/3167416638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6100d0520 msgr2=0x7fe610157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:24.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe60ed9d640 1 --2- 172.21.15.132:0/3167416638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6100d0520 0x7fe610157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe60ed9d640 1 -- 172.21.15.132:0/3167416638 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe61015af00 msgr2=0x7fe6100b3cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:24.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe60ed9d640 1 --2- 172.21.15.132:0/3167416638 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe61015af00 0x7fe6100b3cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe60ed9d640 1 -- 172.21.15.132:0/3167416638 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f8009400 con 0x7fe61015e570 2023-12-20T04:43:24.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe607fff640 1 --2- 172.21.15.132:0/3167416638 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe61015af00 0x7fe6100b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:24.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe60ed9d640 1 --2- 172.21.15.132:0/3167416638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe61015e570 0x7fe6100b4210 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe60800b970 tx=0x7fe60800be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:24.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe606ffd640 1 -- 172.21.15.132:0/3167416638 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe60800cb40 con 0x7fe61015e570 2023-12-20T04:43:24.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe606ffd640 1 -- 172.21.15.132:0/3167416638 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe60800cca0 con 0x7fe61015e570 2023-12-20T04:43:24.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe61493e640 1 -- 172.21.15.132:0/3167416638 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe61015c930 con 0x7fe61015e570 2023-12-20T04:43:24.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe606ffd640 1 -- 172.21.15.132:0/3167416638 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe608014680 con 0x7fe61015e570 2023-12-20T04:43:24.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.529+0000 7fe61493e640 1 -- 172.21.15.132:0/3167416638 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6101e7960 con 0x7fe61015e570 2023-12-20T04:43:24.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.530+0000 7fe61493e640 1 -- 172.21.15.132:0/3167416638 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6101e77c0 con 0x7fe61015e570 2023-12-20T04:43:24.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.531+0000 7fe606ffd640 1 -- 172.21.15.132:0/3167416638 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe60801d3b0 con 0x7fe61015e570 2023-12-20T04:43:24.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.531+0000 7fe606ffd640 1 --2- 172.21.15.132:0/3167416638 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe5f006a460 0x7fe5f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:24.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.531+0000 7fe606ffd640 1 -- 172.21.15.132:0/3167416638 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe608088590 con 0x7fe61015e570 2023-12-20T04:43:24.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.531+0000 7fe60e59c640 1 --2- 172.21.15.132:0/3167416638 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe5f006a460 0x7fe5f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:24.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.532+0000 7fe60e59c640 1 --2- 172.21.15.132:0/3167416638 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe5f006a460 0x7fe5f006c920 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe600000f60 tx=0x7fe600007d50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:24.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.535+0000 7fe606ffd640 1 -- 172.21.15.132:0/3167416638 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe6101e77c0 con 0x7fe61015e570 2023-12-20T04:43:24.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.711+0000 7fe61493e640 1 -- 172.21.15.132:0/3167416638 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fe6101e77c0 con 0x7fe61015e570 2023-12-20T04:43:24.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.711+0000 7fe606ffd640 1 -- 172.21.15.132:0/3167416638 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fe6101e77c0 con 0x7fe61015e570 2023-12-20T04:43:24.713 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:43:24.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.713+0000 7fe61493e640 1 -- 172.21.15.132:0/3167416638 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe5f006a460 msgr2=0x7fe5f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:24.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.713+0000 7fe61493e640 1 --2- 172.21.15.132:0/3167416638 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe5f006a460 0x7fe5f006c920 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fe600000f60 tx=0x7fe600007d50 comp rx=0 tx=0).stop 2023-12-20T04:43:24.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.713+0000 7fe61493e640 1 -- 172.21.15.132:0/3167416638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe61015e570 msgr2=0x7fe6100b4210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:24.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.713+0000 7fe61493e640 1 --2- 172.21.15.132:0/3167416638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe61015e570 0x7fe6100b4210 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fe60800b970 tx=0x7fe60800be30 comp rx=0 tx=0).stop 2023-12-20T04:43:24.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.713+0000 7fe61493e640 1 -- 172.21.15.132:0/3167416638 shutdown_connections 2023-12-20T04:43:24.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.713+0000 7fe61493e640 1 --2- 172.21.15.132:0/3167416638 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe5f006a460 0x7fe5f006c920 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.713+0000 7fe61493e640 1 --2- 172.21.15.132:0/3167416638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe61015e570 0x7fe6100b4210 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.713+0000 7fe61493e640 1 --2- 172.21.15.132:0/3167416638 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe61015af00 0x7fe6100b3cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.713+0000 7fe61493e640 1 --2- 172.21.15.132:0/3167416638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe6100d0520 0x7fe610157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:24.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.713+0000 7fe61493e640 1 -- 172.21.15.132:0/3167416638 >> 172.21.15.132:0/3167416638 conn(0x7fe61006d640 msgr2=0x7fe6100cd690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:24.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.713+0000 7fe61493e640 1 -- 172.21.15.132:0/3167416638 shutdown_connections 2023-12-20T04:43:24.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:24.713+0000 7fe61493e640 1 -- 172.21.15.132:0/3167416638 wait complete. 2023-12-20T04:43:24.726 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi187.front.sepia.ceph.com... 2023-12-20T04:43:24.726 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:24.726 DEBUG:teuthology.orchestra.run.smithi187:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-20T04:43:24.759 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:43:24.759 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:43:24.759 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:24.760 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-20T04:43:24.835 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:43:24.836 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:43:24.851 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:43:24.852 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:43:24.907 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:25.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.045+0000 7f6520177640 1 Processor -- start 2023-12-20T04:43:25.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.045+0000 7f6520177640 1 -- start start 2023-12-20T04:43:25.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.045+0000 7f6520177640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f651815e2d0 0x7f65180b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.045+0000 7f6520177640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65180cb420 0x7f65180ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.045+0000 7f6520177640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f65180ceee0 0x7f651815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.046+0000 7f6520177640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65180cd740 con 0x7f651815e2d0 2023-12-20T04:43:25.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.046+0000 7f6520177640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f65180ce230 con 0x7f65180ceee0 2023-12-20T04:43:25.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.046+0000 7f6520177640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65180cf310 con 0x7f65180cb420 2023-12-20T04:43:25.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.046+0000 7f651df13640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f651815e2d0 0x7f65180b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.046+0000 7f651df13640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f651815e2d0 0x7f65180b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35856/0 (socket says 172.21.15.132:35856) 2023-12-20T04:43:25.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.046+0000 7f651df13640 1 -- 172.21.15.132:0/753061160 learned_addr learned my addr 172.21.15.132:0/753061160 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:25.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.046+0000 7f651d712640 1 --2- 172.21.15.132:0/753061160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65180cb420 0x7f65180ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.046+0000 7f651e714640 1 --2- 172.21.15.132:0/753061160 >> v2:172.21.15.187:3300/0 conn(0x7f65180ceee0 0x7f651815ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.046+0000 7f651df13640 1 -- 172.21.15.132:0/753061160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65180cb420 msgr2=0x7f65180ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:25.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.046+0000 7f651df13640 1 --2- 172.21.15.132:0/753061160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65180cb420 0x7f65180ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.046+0000 7f651df13640 1 -- 172.21.15.132:0/753061160 >> v2:172.21.15.187:3300/0 conn(0x7f65180ceee0 msgr2=0x7f651815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:25.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.046+0000 7f651df13640 1 --2- 172.21.15.132:0/753061160 >> v2:172.21.15.187:3300/0 conn(0x7f65180ceee0 0x7f651815ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.046+0000 7f651df13640 1 -- 172.21.15.132:0/753061160 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65180cd990 con 0x7f651815e2d0 2023-12-20T04:43:25.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.046+0000 7f651e714640 1 --2- 172.21.15.132:0/753061160 >> v2:172.21.15.187:3300/0 conn(0x7f65180ceee0 0x7f651815ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:25.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.047+0000 7f651df13640 1 --2- 172.21.15.132:0/753061160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f651815e2d0 0x7f65180b3330 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f65180cf960 tx=0x7f650802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2563a54ccc65df9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:25.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.047+0000 7f651cf11640 1 -- 172.21.15.132:0/753061160 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f65080317e0 con 0x7f651815e2d0 2023-12-20T04:43:25.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.047+0000 7f651cf11640 1 -- 172.21.15.132:0/753061160 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6508031940 con 0x7f651815e2d0 2023-12-20T04:43:25.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.047+0000 7f651cf11640 1 -- 172.21.15.132:0/753061160 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6508031cd0 con 0x7f651815e2d0 2023-12-20T04:43:25.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.047+0000 7f6520177640 1 -- 172.21.15.132:0/753061160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f651815e2d0 msgr2=0x7f65180b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.047+0000 7f6520177640 1 --2- 172.21.15.132:0/753061160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f651815e2d0 0x7f65180b3330 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f65180cf960 tx=0x7f650802b880 comp rx=0 tx=0).stop 2023-12-20T04:43:25.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.047+0000 7f6520177640 1 -- 172.21.15.132:0/753061160 shutdown_connections 2023-12-20T04:43:25.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.047+0000 7f6520177640 1 --2- 172.21.15.132:0/753061160 >> v2:172.21.15.187:3300/0 conn(0x7f65180ceee0 0x7f651815ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.047+0000 7f6520177640 1 --2- 172.21.15.132:0/753061160 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65180cb420 0x7f65180ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.047+0000 7f6520177640 1 --2- 172.21.15.132:0/753061160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f651815e2d0 0x7f65180b3330 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.047+0000 7f6520177640 1 -- 172.21.15.132:0/753061160 >> 172.21.15.132:0/753061160 conn(0x7f651806d7c0 msgr2=0x7f651806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:25.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.047+0000 7f6520177640 1 -- 172.21.15.132:0/753061160 shutdown_connections 2023-12-20T04:43:25.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.047+0000 7f6520177640 1 -- 172.21.15.132:0/753061160 wait complete. 2023-12-20T04:43:25.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.048+0000 7f6520177640 1 Processor -- start 2023-12-20T04:43:25.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.049+0000 7f6520177640 1 -- start start 2023-12-20T04:43:25.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.049+0000 7f6520177640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65180cb420 0x7f65180cad10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.049+0000 7f6520177640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65180ceee0 0x7f65181effb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.049+0000 7f6520177640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f651815e2d0 0x7f65180b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.049+0000 7f6520177640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65181f47e0 con 0x7f651815e2d0 2023-12-20T04:43:25.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.049+0000 7f6520177640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65181f3bf0 con 0x7f65180cb420 2023-12-20T04:43:25.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.049+0000 7f6520177640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f65181f04f0 con 0x7f65180ceee0 2023-12-20T04:43:25.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.049+0000 7f651e714640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f651815e2d0 0x7f65180b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.049+0000 7f651e714640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f651815e2d0 0x7f65180b5510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35870/0 (socket says 172.21.15.132:35870) 2023-12-20T04:43:25.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.049+0000 7f651e714640 1 -- 172.21.15.132:0/359809821 learned_addr learned my addr 172.21.15.132:0/359809821 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:25.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.050+0000 7f651df13640 1 --2- 172.21.15.132:0/359809821 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65180cb420 0x7f65180cad10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.050+0000 7f651d712640 1 --2- 172.21.15.132:0/359809821 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65180ceee0 0x7f65181effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.050+0000 7f651e714640 1 -- 172.21.15.132:0/359809821 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65180ceee0 msgr2=0x7f65181effb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.050+0000 7f651e714640 1 --2- 172.21.15.132:0/359809821 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65180ceee0 0x7f65181effb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.050+0000 7f651e714640 1 -- 172.21.15.132:0/359809821 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65180cb420 msgr2=0x7f65180cad10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.050+0000 7f651e714640 1 --2- 172.21.15.132:0/359809821 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65180cb420 0x7f65180cad10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.050+0000 7f651e714640 1 -- 172.21.15.132:0/359809821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65080094d0 con 0x7f651815e2d0 2023-12-20T04:43:25.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.050+0000 7f651d712640 1 --2- 172.21.15.132:0/359809821 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65180ceee0 0x7f65181effb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:25.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.050+0000 7f651e714640 1 --2- 172.21.15.132:0/359809821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f651815e2d0 0x7f65180b5510 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f651000cef0 tx=0x7f651000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:25.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.050+0000 7f650e7fc640 1 -- 172.21.15.132:0/359809821 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651000d840 con 0x7f651815e2d0 2023-12-20T04:43:25.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.050+0000 7f650e7fc640 1 -- 172.21.15.132:0/359809821 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f651000d9c0 con 0x7f651815e2d0 2023-12-20T04:43:25.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.050+0000 7f6520177640 1 -- 172.21.15.132:0/359809821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65181f3e40 con 0x7f651815e2d0 2023-12-20T04:43:25.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.050+0000 7f650e7fc640 1 -- 172.21.15.132:0/359809821 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f651000dd70 con 0x7f651815e2d0 2023-12-20T04:43:25.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.050+0000 7f6520177640 1 -- 172.21.15.132:0/359809821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65181f4400 con 0x7f651815e2d0 2023-12-20T04:43:25.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.051+0000 7f6520177640 1 -- 172.21.15.132:0/359809821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65181f4920 con 0x7f651815e2d0 2023-12-20T04:43:25.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.051+0000 7f650e7fc640 1 -- 172.21.15.132:0/359809821 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f651001e3b0 con 0x7f651815e2d0 2023-12-20T04:43:25.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.052+0000 7f650e7fc640 1 --2- 172.21.15.132:0/359809821 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f64fc06a430 0x7f64fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.052+0000 7f650e7fc640 1 -- 172.21.15.132:0/359809821 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f65100893e0 con 0x7f651815e2d0 2023-12-20T04:43:25.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.052+0000 7f651df13640 1 --2- 172.21.15.132:0/359809821 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f64fc06a430 0x7f64fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.052+0000 7f651df13640 1 --2- 172.21.15.132:0/359809821 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f64fc06a430 0x7f64fc06c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6508036000 tx=0x7f650803d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:25.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.056+0000 7f650e7fc640 1 -- 172.21.15.132:0/359809821 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f65181f4920 con 0x7f651815e2d0 2023-12-20T04:43:25.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.225+0000 7f6520177640 1 -- 172.21.15.132:0/359809821 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f65181f4920 con 0x7f651815e2d0 2023-12-20T04:43:25.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.226+0000 7f650e7fc640 1 -- 172.21.15.132:0/359809821 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f65181f4920 con 0x7f651815e2d0 2023-12-20T04:43:25.228 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:25.228 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:25.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.227+0000 7f6520177640 1 -- 172.21.15.132:0/359809821 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f64fc06a430 msgr2=0x7f64fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.227+0000 7f6520177640 1 --2- 172.21.15.132:0/359809821 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f64fc06a430 0x7f64fc06c8f0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f6508036000 tx=0x7f650803d040 comp rx=0 tx=0).stop 2023-12-20T04:43:25.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.227+0000 7f6520177640 1 -- 172.21.15.132:0/359809821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f651815e2d0 msgr2=0x7f65180b5510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.227+0000 7f6520177640 1 --2- 172.21.15.132:0/359809821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f651815e2d0 0x7f65180b5510 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f651000cef0 tx=0x7f651000a710 comp rx=0 tx=0).stop 2023-12-20T04:43:25.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.228+0000 7f6520177640 1 -- 172.21.15.132:0/359809821 shutdown_connections 2023-12-20T04:43:25.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.228+0000 7f6520177640 1 --2- 172.21.15.132:0/359809821 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f64fc06a430 0x7f64fc06c8f0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.228+0000 7f6520177640 1 --2- 172.21.15.132:0/359809821 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f651815e2d0 0x7f65180b5510 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.228+0000 7f6520177640 1 --2- 172.21.15.132:0/359809821 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f65180ceee0 0x7f65181effb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.228+0000 7f6520177640 1 --2- 172.21.15.132:0/359809821 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f65180cb420 0x7f65180cad10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.228+0000 7f6520177640 1 -- 172.21.15.132:0/359809821 >> 172.21.15.132:0/359809821 conn(0x7f651806d7c0 msgr2=0x7f651806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:25.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.228+0000 7f6520177640 1 -- 172.21.15.132:0/359809821 shutdown_connections 2023-12-20T04:43:25.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.228+0000 7f6520177640 1 -- 172.21.15.132:0/359809821 wait complete. 2023-12-20T04:43:25.241 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:42:45.433456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:42:46.128920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:43:25.241 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:43:25.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.341+0000 7f39c5612640 1 Processor -- start 2023-12-20T04:43:25.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.341+0000 7f39c5612640 1 -- start start 2023-12-20T04:43:25.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.342+0000 7f39c5612640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39c015d300 0x7f39c00d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.342+0000 7f39c5612640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f39c00d17d0 0x7f39c00cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.342+0000 7f39c5612640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39c00d2920 con 0x7f39c00cfcd0 2023-12-20T04:43:25.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.342+0000 7f39c5612640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39c00d0160 con 0x7f39c00d17d0 2023-12-20T04:43:25.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.342+0000 7f39c5612640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c00d1d10 con 0x7f39c015d300 2023-12-20T04:43:25.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.342+0000 7f39b7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f39c00d17d0 0x7f39c00cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.342+0000 7f39b7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f39c00d17d0 0x7f39c00cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35872/0 (socket says 172.21.15.132:35872) 2023-12-20T04:43:25.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.342+0000 7f39b7fff640 1 -- 172.21.15.132:0/858619650 learned_addr learned my addr 172.21.15.132:0/858619650 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:25.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.342+0000 7f39beffd640 1 --2- 172.21.15.132:0/858619650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39c015d300 0x7f39c00d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.342+0000 7f39b7fff640 1 -- 172.21.15.132:0/858619650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39c015d300 msgr2=0x7f39c00d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:25.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.342+0000 7f39b7fff640 1 --2- 172.21.15.132:0/858619650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39c015d300 0x7f39c00d1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.342+0000 7f39b7fff640 1 -- 172.21.15.132:0/858619650 >> v1:172.21.15.187:6789/0 conn(0x7f39c00cfcd0 legacy=0x7f39c00b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.342+0000 7f39b7fff640 1 -- 172.21.15.132:0/858619650 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39c00d1ff0 con 0x7f39c00d17d0 2023-12-20T04:43:25.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.343+0000 7f39b7fff640 1 --2- 172.21.15.132:0/858619650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39c00d17d0 0x7f39c00cf790 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f39a8009870 tx=0x7f39a802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f99ee6a87801e69 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:25.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.343+0000 7f39be7fc640 1 -- 172.21.15.132:0/858619650 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8030840 con 0x7f39c00d17d0 2023-12-20T04:43:25.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.343+0000 7f39be7fc640 1 -- 172.21.15.132:0/858619650 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a80309a0 con 0x7f39c00d17d0 2023-12-20T04:43:25.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.343+0000 7f39be7fc640 1 -- 172.21.15.132:0/858619650 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8030d30 con 0x7f39c00d17d0 2023-12-20T04:43:25.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.343+0000 7f39c5612640 1 -- 172.21.15.132:0/858619650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39c00d17d0 msgr2=0x7f39c00cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.343+0000 7f39c5612640 1 --2- 172.21.15.132:0/858619650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39c00d17d0 0x7f39c00cf790 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f39a8009870 tx=0x7f39a802b980 comp rx=0 tx=0).stop 2023-12-20T04:43:25.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.343+0000 7f39c5612640 1 -- 172.21.15.132:0/858619650 shutdown_connections 2023-12-20T04:43:25.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.343+0000 7f39c5612640 1 --2- 172.21.15.132:0/858619650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39c00d17d0 0x7f39c00cf790 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.343+0000 7f39c5612640 1 --2- 172.21.15.132:0/858619650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39c015d300 0x7f39c00d1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.343+0000 7f39c5612640 1 -- 172.21.15.132:0/858619650 >> 172.21.15.132:0/858619650 conn(0x7f39c006a3d0 msgr2=0x7f39c006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:25.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.343+0000 7f39c5612640 1 -- 172.21.15.132:0/858619650 shutdown_connections 2023-12-20T04:43:25.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.344+0000 7f39c5612640 1 -- 172.21.15.132:0/858619650 wait complete. 2023-12-20T04:43:25.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.345+0000 7f39c5612640 1 Processor -- start 2023-12-20T04:43:25.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.345+0000 7f39c5612640 1 -- start start 2023-12-20T04:43:25.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.345+0000 7f39c5612640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39c00cfcd0 0x7f39c00c8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.345+0000 7f39c5612640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39c00d17d0 0x7f39c01f2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.345+0000 7f39c5612640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39c015d300 0x7f39c01515c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.345+0000 7f39c5612640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c015e640 con 0x7f39c00d17d0 2023-12-20T04:43:25.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.345+0000 7f39c5612640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39c015e310 con 0x7f39c00cfcd0 2023-12-20T04:43:25.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.345+0000 7f39c5612640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39c0152690 con 0x7f39c015d300 2023-12-20T04:43:25.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.345+0000 7f39b7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39c00d17d0 0x7f39c01f2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.345+0000 7f39b7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39c00d17d0 0x7f39c01f2290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35878/0 (socket says 172.21.15.132:35878) 2023-12-20T04:43:25.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.345+0000 7f39b7fff640 1 -- 172.21.15.132:0/3656653885 learned_addr learned my addr 172.21.15.132:0/3656653885 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:25.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.346+0000 7f39b7fff640 1 -- 172.21.15.132:0/3656653885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39c015d300 msgr2=0x7f39c01515c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.346+0000 7f39b7fff640 1 --2- 172.21.15.132:0/3656653885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39c015d300 0x7f39c01515c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.346+0000 7f39b7fff640 1 -- 172.21.15.132:0/3656653885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39c00cfcd0 msgr2=0x7f39c00c8cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.346+0000 7f39b7fff640 1 --2- 172.21.15.132:0/3656653885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39c00cfcd0 0x7f39c00c8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.346+0000 7f39b7fff640 1 -- 172.21.15.132:0/3656653885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39a80094d0 con 0x7f39c00d17d0 2023-12-20T04:43:25.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.346+0000 7f39b7fff640 1 --2- 172.21.15.132:0/3656653885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39c00d17d0 0x7f39c01f2290 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f39a802b9c0 tx=0x7f39a8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:25.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.346+0000 7f39b77fe640 1 -- 172.21.15.132:0/3656653885 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8039a90 con 0x7f39c00d17d0 2023-12-20T04:43:25.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.346+0000 7f39b77fe640 1 -- 172.21.15.132:0/3656653885 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39a8039bf0 con 0x7f39c00d17d0 2023-12-20T04:43:25.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.346+0000 7f39b77fe640 1 -- 172.21.15.132:0/3656653885 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39a8043410 con 0x7f39c00d17d0 2023-12-20T04:43:25.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.346+0000 7f39c5612640 1 -- 172.21.15.132:0/3656653885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39c0151df0 con 0x7f39c00d17d0 2023-12-20T04:43:25.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.346+0000 7f39c5612640 1 -- 172.21.15.132:0/3656653885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39c01523b0 con 0x7f39c00d17d0 2023-12-20T04:43:25.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.347+0000 7f39c5612640 1 -- 172.21.15.132:0/3656653885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39c00b5c10 con 0x7f39c00d17d0 2023-12-20T04:43:25.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.347+0000 7f39b77fe640 1 -- 172.21.15.132:0/3656653885 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f39a802f390 con 0x7f39c00d17d0 2023-12-20T04:43:25.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.348+0000 7f39b77fe640 1 --2- 172.21.15.132:0/3656653885 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f39a006a430 0x7f39a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.348+0000 7f39b77fe640 1 -- 172.21.15.132:0/3656653885 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39a80aab50 con 0x7f39c00d17d0 2023-12-20T04:43:25.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.348+0000 7f39beffd640 1 --2- 172.21.15.132:0/3656653885 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f39a006a430 0x7f39a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.348+0000 7f39beffd640 1 --2- 172.21.15.132:0/3656653885 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f39a006a430 0x7f39a006c8f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f39b00098f0 tx=0x7f39b0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:25.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.352+0000 7f39b77fe640 1 -- 172.21.15.132:0/3656653885 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f39a8076180 con 0x7f39c00d17d0 2023-12-20T04:43:25.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.515+0000 7f39c5612640 1 -- 172.21.15.132:0/3656653885 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f39c004e840 con 0x7f39c00d17d0 2023-12-20T04:43:25.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.515+0000 7f39b77fe640 1 -- 172.21.15.132:0/3656653885 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f39a80797a0 con 0x7f39c00d17d0 2023-12-20T04:43:25.517 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:43:25.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.517+0000 7f39c5612640 1 -- 172.21.15.132:0/3656653885 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f39a006a430 msgr2=0x7f39a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.517+0000 7f39c5612640 1 --2- 172.21.15.132:0/3656653885 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f39a006a430 0x7f39a006c8f0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f39b00098f0 tx=0x7f39b0008040 comp rx=0 tx=0).stop 2023-12-20T04:43:25.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.517+0000 7f39c5612640 1 -- 172.21.15.132:0/3656653885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39c00d17d0 msgr2=0x7f39c01f2290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.517+0000 7f39c5612640 1 --2- 172.21.15.132:0/3656653885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39c00d17d0 0x7f39c01f2290 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f39a802b9c0 tx=0x7f39a8004730 comp rx=0 tx=0).stop 2023-12-20T04:43:25.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.517+0000 7f39c5612640 1 -- 172.21.15.132:0/3656653885 shutdown_connections 2023-12-20T04:43:25.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.517+0000 7f39c5612640 1 --2- 172.21.15.132:0/3656653885 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f39a006a430 0x7f39a006c8f0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.517+0000 7f39c5612640 1 --2- 172.21.15.132:0/3656653885 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39c015d300 0x7f39c01515c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.517+0000 7f39c5612640 1 --2- 172.21.15.132:0/3656653885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39c00d17d0 0x7f39c01f2290 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.517+0000 7f39c5612640 1 --2- 172.21.15.132:0/3656653885 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39c00cfcd0 0x7f39c00c8cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.517+0000 7f39c5612640 1 -- 172.21.15.132:0/3656653885 >> 172.21.15.132:0/3656653885 conn(0x7f39c006a3d0 msgr2=0x7f39c00b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:25.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.517+0000 7f39c5612640 1 -- 172.21.15.132:0/3656653885 shutdown_connections 2023-12-20T04:43:25.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.517+0000 7f39c5612640 1 -- 172.21.15.132:0/3656653885 wait complete. 2023-12-20T04:43:25.529 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:43:25.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.629+0000 7f0cf40ee640 1 Processor -- start 2023-12-20T04:43:25.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.630+0000 7f0cf40ee640 1 -- start start 2023-12-20T04:43:25.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.630+0000 7f0cf40ee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0cec069c30 0x7f0cec070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.630+0000 7f0cf40ee640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0cec15d360 0x7f0cec06a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.630+0000 7f0cf40ee640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0cec0c4f40 con 0x7f0cec0cbde0 2023-12-20T04:43:25.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.630+0000 7f0cf40ee640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cec0af5b0 con 0x7f0cec069c30 2023-12-20T04:43:25.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.630+0000 7f0cf40ee640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0cec06a550 con 0x7f0cec15d360 2023-12-20T04:43:25.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.631+0000 7f0cf1e8a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0cec069c30 0x7f0cec070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.631+0000 7f0cf1e8a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0cec069c30 0x7f0cec070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35884/0 (socket says 172.21.15.132:35884) 2023-12-20T04:43:25.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.631+0000 7f0cf1e8a640 1 -- 172.21.15.132:0/1987707301 learned_addr learned my addr 172.21.15.132:0/1987707301 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:25.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.631+0000 7f0cf1689640 1 --2- 172.21.15.132:0/1987707301 >> v2:172.21.15.187:3300/0 conn(0x7f0cec15d360 0x7f0cec06a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.631+0000 7f0cf1e8a640 1 -- 172.21.15.132:0/1987707301 >> v2:172.21.15.187:3300/0 conn(0x7f0cec15d360 msgr2=0x7f0cec06a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:25.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.631+0000 7f0cf1e8a640 1 --2- 172.21.15.132:0/1987707301 >> v2:172.21.15.187:3300/0 conn(0x7f0cec15d360 0x7f0cec06a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.631+0000 7f0cf1e8a640 1 -- 172.21.15.132:0/1987707301 >> v1:172.21.15.187:6789/0 conn(0x7f0cec0cbde0 legacy=0x7f0cec0ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:25.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.631+0000 7f0cf1e8a640 1 -- 172.21.15.132:0/1987707301 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cec070a40 con 0x7f0cec069c30 2023-12-20T04:43:25.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.631+0000 7f0cf1689640 1 --2- 172.21.15.132:0/1987707301 >> v2:172.21.15.187:3300/0 conn(0x7f0cec15d360 0x7f0cec06a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:25.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.632+0000 7f0cf1e8a640 1 --2- 172.21.15.132:0/1987707301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cec069c30 0x7f0cec070460 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0b5dc0 tx=0x7f0ce402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=460c1701ef45fb07 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:25.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.632+0000 7f0cf0e88640 1 -- 172.21.15.132:0/1987707301 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce402ca80 con 0x7f0cec069c30 2023-12-20T04:43:25.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.632+0000 7f0cf0e88640 1 -- 172.21.15.132:0/1987707301 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce402cbe0 con 0x7f0cec069c30 2023-12-20T04:43:25.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.632+0000 7f0cf0e88640 1 -- 172.21.15.132:0/1987707301 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce40343f0 con 0x7f0cec069c30 2023-12-20T04:43:25.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.632+0000 7f0cf40ee640 1 -- 172.21.15.132:0/1987707301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cec069c30 msgr2=0x7f0cec070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.632+0000 7f0cf40ee640 1 --2- 172.21.15.132:0/1987707301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cec069c30 0x7f0cec070460 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f0cec0b5dc0 tx=0x7f0ce402bee0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.632+0000 7f0cf40ee640 1 -- 172.21.15.132:0/1987707301 shutdown_connections 2023-12-20T04:43:25.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.632+0000 7f0cf40ee640 1 --2- 172.21.15.132:0/1987707301 >> v2:172.21.15.187:3300/0 conn(0x7f0cec15d360 0x7f0cec06a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.632+0000 7f0cf40ee640 1 --2- 172.21.15.132:0/1987707301 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cec069c30 0x7f0cec070460 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.632+0000 7f0cf40ee640 1 -- 172.21.15.132:0/1987707301 >> 172.21.15.132:0/1987707301 conn(0x7f0cec0cc630 msgr2=0x7f0cec0cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:25.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.632+0000 7f0cf40ee640 1 -- 172.21.15.132:0/1987707301 shutdown_connections 2023-12-20T04:43:25.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.632+0000 7f0cf40ee640 1 -- 172.21.15.132:0/1987707301 wait complete. 2023-12-20T04:43:25.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.634+0000 7f0cf40ee640 1 Processor -- start 2023-12-20T04:43:25.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.634+0000 7f0cf40ee640 1 -- start start 2023-12-20T04:43:25.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.634+0000 7f0cf40ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cec069c30 0x7f0cec14a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.634+0000 7f0cf40ee640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cec0cbde0 0x7f0cec15d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.634+0000 7f0cf40ee640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cec15d360 0x7f0cec15dc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.634+0000 7f0cf40ee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec0c66c0 con 0x7f0cec069c30 2023-12-20T04:43:25.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.634+0000 7f0cf40ee640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec15e2b0 con 0x7f0cec0cbde0 2023-12-20T04:43:25.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.634+0000 7f0cf40ee640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0cec15e590 con 0x7f0cec15d360 2023-12-20T04:43:25.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.634+0000 7f0cf1e8a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cec069c30 0x7f0cec14a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.634+0000 7f0cf1e8a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cec069c30 0x7f0cec14a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35898/0 (socket says 172.21.15.132:35898) 2023-12-20T04:43:25.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.634+0000 7f0cf1e8a640 1 -- 172.21.15.132:0/2245133317 learned_addr learned my addr 172.21.15.132:0/2245133317 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:25.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.635+0000 7f0cf1e8a640 1 -- 172.21.15.132:0/2245133317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cec15d360 msgr2=0x7f0cec15dc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.635+0000 7f0cf1e8a640 1 --2- 172.21.15.132:0/2245133317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cec15d360 0x7f0cec15dc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.635+0000 7f0cf1e8a640 1 -- 172.21.15.132:0/2245133317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cec0cbde0 msgr2=0x7f0cec15d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.635+0000 7f0cf1e8a640 1 --2- 172.21.15.132:0/2245133317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cec0cbde0 0x7f0cec15d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.635+0000 7f0cf1e8a640 1 -- 172.21.15.132:0/2245133317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce4009b30 con 0x7f0cec069c30 2023-12-20T04:43:25.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.635+0000 7f0cf1e8a640 1 --2- 172.21.15.132:0/2245133317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cec069c30 0x7f0cec14a5f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4000f80 tx=0x7f0ce4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:25.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.635+0000 7f0ce27fc640 1 -- 172.21.15.132:0/2245133317 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce403e450 con 0x7f0cec069c30 2023-12-20T04:43:25.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.635+0000 7f0ce27fc640 1 -- 172.21.15.132:0/2245133317 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ce403e5f0 con 0x7f0cec069c30 2023-12-20T04:43:25.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.635+0000 7f0cf40ee640 1 -- 172.21.15.132:0/2245133317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cec15e870 con 0x7f0cec069c30 2023-12-20T04:43:25.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.635+0000 7f0ce27fc640 1 -- 172.21.15.132:0/2245133317 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ce403e9a0 con 0x7f0cec069c30 2023-12-20T04:43:25.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.635+0000 7f0cf40ee640 1 -- 172.21.15.132:0/2245133317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0cec15ee30 con 0x7f0cec069c30 2023-12-20T04:43:25.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.636+0000 7f0cf40ee640 1 -- 172.21.15.132:0/2245133317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0cec04e840 con 0x7f0cec069c30 2023-12-20T04:43:25.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.636+0000 7f0ce27fc640 1 -- 172.21.15.132:0/2245133317 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0ce402cd50 con 0x7f0cec069c30 2023-12-20T04:43:25.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.637+0000 7f0ce27fc640 1 --2- 172.21.15.132:0/2245133317 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0cd006a430 0x7f0cd006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.637+0000 7f0cf1689640 1 --2- 172.21.15.132:0/2245133317 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0cd006a430 0x7f0cd006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.637+0000 7f0ce27fc640 1 -- 172.21.15.132:0/2245133317 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ce40ab550 con 0x7f0cec069c30 2023-12-20T04:43:25.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.637+0000 7f0cf1689640 1 --2- 172.21.15.132:0/2245133317 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0cd006a430 0x7f0cd006c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc006fd0 tx=0x7f0cdc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:25.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.641+0000 7f0ce27fc640 1 -- 172.21.15.132:0/2245133317 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0ce4076b40 con 0x7f0cec069c30 2023-12-20T04:43:25.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.807+0000 7f0cf40ee640 1 -- 172.21.15.132:0/2245133317 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0cec06a9a0 con 0x7f0cec069c30 2023-12-20T04:43:25.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.807+0000 7f0ce27fc640 1 -- 172.21.15.132:0/2245133317 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f0ce407a160 con 0x7f0cec069c30 2023-12-20T04:43:25.810 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:43:25.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.809+0000 7f0cf40ee640 1 -- 172.21.15.132:0/2245133317 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0cd006a430 msgr2=0x7f0cd006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.809+0000 7f0cf40ee640 1 --2- 172.21.15.132:0/2245133317 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0cd006a430 0x7f0cd006c8f0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f0cdc006fd0 tx=0x7f0cdc008040 comp rx=0 tx=0).stop 2023-12-20T04:43:25.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.809+0000 7f0cf40ee640 1 -- 172.21.15.132:0/2245133317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cec069c30 msgr2=0x7f0cec14a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.809+0000 7f0cf40ee640 1 --2- 172.21.15.132:0/2245133317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cec069c30 0x7f0cec14a5f0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f0ce4000f80 tx=0x7f0ce4004a40 comp rx=0 tx=0).stop 2023-12-20T04:43:25.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.809+0000 7f0cf40ee640 1 -- 172.21.15.132:0/2245133317 shutdown_connections 2023-12-20T04:43:25.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.809+0000 7f0cf40ee640 1 --2- 172.21.15.132:0/2245133317 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0cd006a430 0x7f0cd006c8f0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.809+0000 7f0cf40ee640 1 --2- 172.21.15.132:0/2245133317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0cec15d360 0x7f0cec15dc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.809+0000 7f0cf40ee640 1 --2- 172.21.15.132:0/2245133317 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0cec0cbde0 0x7f0cec15d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.809+0000 7f0cf40ee640 1 --2- 172.21.15.132:0/2245133317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0cec069c30 0x7f0cec14a5f0 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.809+0000 7f0cf40ee640 1 -- 172.21.15.132:0/2245133317 >> 172.21.15.132:0/2245133317 conn(0x7f0cec0cc630 msgr2=0x7f0cec0b0ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:25.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.809+0000 7f0cf40ee640 1 -- 172.21.15.132:0/2245133317 shutdown_connections 2023-12-20T04:43:25.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.809+0000 7f0cf40ee640 1 -- 172.21.15.132:0/2245133317 wait complete. 2023-12-20T04:43:25.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:43:25.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.923+0000 7f6dbd500640 1 Processor -- start 2023-12-20T04:43:25.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.923+0000 7f6dbd500640 1 -- start start 2023-12-20T04:43:25.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6dbd500640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6db815d300 0x7f6db80d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6dbd500640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db80d2920 con 0x7f6db80cfea0 2023-12-20T04:43:25.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6dbd500640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6db80d1d10 con 0x7f6db80d17d0 2023-12-20T04:43:25.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6dbd500640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db80d1ff0 con 0x7f6db815d300 2023-12-20T04:43:25.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6db77fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6db80cfea0 0x7f6db80b6080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60124/0 (socket says 172.21.15.132:60124) 2023-12-20T04:43:25.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6db77fe640 1 -- 172.21.15.132:0/2400079977 learned_addr learned my addr 172.21.15.132:0/2400079977 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:25.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6db6ffd640 1 --2- 172.21.15.132:0/2400079977 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6db815d300 0x7f6db80d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6db67fc640 1 -- 172.21.15.132:0/2400079977 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 396949819 0 0) 0x7f6db80d2920 con 0x7f6db80cfea0 2023-12-20T04:43:25.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6db67fc640 1 -- 172.21.15.132:0/2400079977 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6da4003520 con 0x7f6db80cfea0 2023-12-20T04:43:25.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6db67fc640 1 -- 172.21.15.132:0/2400079977 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2719704444 0 0) 0x7f6da4003520 con 0x7f6db80cfea0 2023-12-20T04:43:25.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6db67fc640 1 -- 172.21.15.132:0/2400079977 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6db815d300 msgr2=0x7f6db80d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:25.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6db67fc640 1 --2- 172.21.15.132:0/2400079977 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6db815d300 0x7f6db80d1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6db67fc640 1 -- 172.21.15.132:0/2400079977 >> v1:172.21.15.187:6789/0 conn(0x7f6db80d17d0 legacy=0x7f6db80cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6db67fc640 1 -- 172.21.15.132:0/2400079977 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db80d22d0 con 0x7f6db80cfea0 2023-12-20T04:43:25.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6db67fc640 1 -- 172.21.15.132:0/2400079977 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f6db00019f0 con 0x7f6db80cfea0 2023-12-20T04:43:25.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6db67fc640 1 -- 172.21.15.132:0/2400079977 >> v1:172.21.15.132:6789/0 conn(0x7f6db80cfea0 legacy=0x7f6db80b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6db67fc640 1 --2- 172.21.15.132:0/2400079977 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6da40039a0 0x7f6da4003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.924+0000 7f6db67fc640 1 --2- 172.21.15.132:0/2400079977 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6db815d300 0x7f6da40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.925+0000 7f6db67fc640 1 --2- 172.21.15.132:0/2400079977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6da4004d00 0x7f6da4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.925+0000 7f6db67fc640 1 -- 172.21.15.132:0/2400079977 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db80d1ff0 con 0x7f6da4004d00 2023-12-20T04:43:25.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.925+0000 7f6db67fc640 1 -- 172.21.15.132:0/2400079977 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6da400b980 con 0x7f6da40039a0 2023-12-20T04:43:25.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.925+0000 7f6db67fc640 1 -- 172.21.15.132:0/2400079977 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6da400bb40 con 0x7f6db815d300 2023-12-20T04:43:25.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.925+0000 7f6db77fe640 1 --2- 172.21.15.132:0/2400079977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6da4004d00 0x7f6da4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.925+0000 7f6db6ffd640 1 --2- 172.21.15.132:0/2400079977 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6da40039a0 0x7f6da4003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.925+0000 7f6daffff640 1 --2- 172.21.15.132:0/2400079977 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6db815d300 0x7f6da40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.925+0000 7f6db77fe640 1 -- 172.21.15.132:0/2400079977 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6db815d300 msgr2=0x7f6da40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:25.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.925+0000 7f6db77fe640 1 --2- 172.21.15.132:0/2400079977 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6db815d300 0x7f6da40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.925+0000 7f6db77fe640 1 -- 172.21.15.132:0/2400079977 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6da40039a0 msgr2=0x7f6da4003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:25.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.925+0000 7f6db77fe640 1 --2- 172.21.15.132:0/2400079977 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6da40039a0 0x7f6da4003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.925+0000 7f6db77fe640 1 -- 172.21.15.132:0/2400079977 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6da4003520 con 0x7f6da4004d00 2023-12-20T04:43:25.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.926+0000 7f6db77fe640 1 --2- 172.21.15.132:0/2400079977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6da4004d00 0x7f6da4005180 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6db80ce9e0 tx=0x7f6da40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b684e4d1c384631d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:25.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.926+0000 7f6db67fc640 1 -- 172.21.15.132:0/2400079977 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0034630 con 0x7f6da4004d00 2023-12-20T04:43:25.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.926+0000 7f6db67fc640 1 -- 172.21.15.132:0/2400079977 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db002f070 con 0x7f6da4004d00 2023-12-20T04:43:25.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.926+0000 7f6db67fc640 1 -- 172.21.15.132:0/2400079977 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db00349d0 con 0x7f6da4004d00 2023-12-20T04:43:25.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.926+0000 7f6dbd500640 1 -- 172.21.15.132:0/2400079977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6da4004d00 msgr2=0x7f6da4005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.926+0000 7f6dbd500640 1 --2- 172.21.15.132:0/2400079977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6da4004d00 0x7f6da4005180 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7f6db80ce9e0 tx=0x7f6da40057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.926+0000 7f6db77fe640 1 -- 172.21.15.132:0/2400079977 reap_dead start 2023-12-20T04:43:25.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.926+0000 7f6dbd500640 1 -- 172.21.15.132:0/2400079977 shutdown_connections 2023-12-20T04:43:25.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.926+0000 7f6dbd500640 1 -- 172.21.15.132:0/2400079977 >> 172.21.15.132:0/2400079977 conn(0x7f6db806a3d0 msgr2=0x7f6db806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:25.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.926+0000 7f6dbd500640 1 -- 172.21.15.132:0/2400079977 shutdown_connections 2023-12-20T04:43:25.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.926+0000 7f6dbd500640 1 -- 172.21.15.132:0/2400079977 wait complete. 2023-12-20T04:43:25.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.927+0000 7f6dbd500640 1 Processor -- start 2023-12-20T04:43:25.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.928+0000 7f6dbd500640 1 -- start start 2023-12-20T04:43:25.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.928+0000 7f6dbd500640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6da4004d00 0x7f6db81f6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.928+0000 7f6dbd500640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6db815e920 0x7f6db814f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.928+0000 7f6dbd500640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6db81f28d0 0x7f6db815b100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.928+0000 7f6dbd500640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db814faa0 con 0x7f6db81f28d0 2023-12-20T04:43:25.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.928+0000 7f6dbd500640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6db80ca190 con 0x7f6da4004d00 2023-12-20T04:43:25.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.928+0000 7f6dbd500640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6db81f30f0 con 0x7f6db815e920 2023-12-20T04:43:25.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.928+0000 7f6db77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6db81f28d0 0x7f6db815b100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.928+0000 7f6db77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6db81f28d0 0x7f6db815b100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35916/0 (socket says 172.21.15.132:35916) 2023-12-20T04:43:25.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.928+0000 7f6db77fe640 1 -- 172.21.15.132:0/1725980483 learned_addr learned my addr 172.21.15.132:0/1725980483 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:25.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.928+0000 7f6db77fe640 1 -- 172.21.15.132:0/1725980483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6db815e920 msgr2=0x7f6db814f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.929+0000 7f6db77fe640 1 --2- 172.21.15.132:0/1725980483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6db815e920 0x7f6db814f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.929+0000 7f6db77fe640 1 -- 172.21.15.132:0/1725980483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6da4004d00 msgr2=0x7f6db81f6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:25.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.929+0000 7f6db77fe640 1 --2- 172.21.15.132:0/1725980483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6da4004d00 0x7f6db81f6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:25.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.929+0000 7f6db77fe640 1 -- 172.21.15.132:0/1725980483 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6db81f33d0 con 0x7f6db81f28d0 2023-12-20T04:43:25.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.929+0000 7f6db77fe640 1 --2- 172.21.15.132:0/1725980483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6db81f28d0 0x7f6db815b100 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6db0001580 tx=0x7f6db0001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:25.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.929+0000 7f6daf7fe640 1 -- 172.21.15.132:0/1725980483 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0034630 con 0x7f6db81f28d0 2023-12-20T04:43:25.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.929+0000 7f6daf7fe640 1 -- 172.21.15.132:0/1725980483 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6db00019e0 con 0x7f6db81f28d0 2023-12-20T04:43:25.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.929+0000 7f6dbd500640 1 -- 172.21.15.132:0/1725980483 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6db81f36b0 con 0x7f6db81f28d0 2023-12-20T04:43:25.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.929+0000 7f6daf7fe640 1 -- 172.21.15.132:0/1725980483 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6db0034990 con 0x7f6db81f28d0 2023-12-20T04:43:25.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.929+0000 7f6dbd500640 1 -- 172.21.15.132:0/1725980483 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6db815b640 con 0x7f6db81f28d0 2023-12-20T04:43:25.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.930+0000 7f6dbd500640 1 -- 172.21.15.132:0/1725980483 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6db80c9f40 con 0x7f6db81f28d0 2023-12-20T04:43:25.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.930+0000 7f6daf7fe640 1 -- 172.21.15.132:0/1725980483 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6db0031030 con 0x7f6db81f28d0 2023-12-20T04:43:25.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.931+0000 7f6daf7fe640 1 --2- 172.21.15.132:0/1725980483 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6d9806a430 0x7f6d9806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:25.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.931+0000 7f6db6ffd640 1 --2- 172.21.15.132:0/1725980483 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6d9806a430 0x7f6d9806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:25.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.931+0000 7f6daf7fe640 1 -- 172.21.15.132:0/1725980483 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6db00aa980 con 0x7f6db81f28d0 2023-12-20T04:43:25.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.931+0000 7f6db6ffd640 1 --2- 172.21.15.132:0/1725980483 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6d9806a430 0x7f6d9806c8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6db80c5cd0 tx=0x7f6da80095d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:25.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:25.935+0000 7f6daf7fe640 1 -- 172.21.15.132:0/1725980483 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6db0079b20 con 0x7f6db81f28d0 2023-12-20T04:43:26.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.103+0000 7f6dbd500640 1 -- 172.21.15.132:0/1725980483 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f6db80c9f40 con 0x7f6db81f28d0 2023-12-20T04:43:26.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.103+0000 7f6daf7fe640 1 -- 172.21.15.132:0/1725980483 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f6db00796b0 con 0x7f6db81f28d0 2023-12-20T04:43:26.105 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:43:26.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.105+0000 7f6dbd500640 1 -- 172.21.15.132:0/1725980483 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6d9806a430 msgr2=0x7f6d9806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:26.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.105+0000 7f6dbd500640 1 --2- 172.21.15.132:0/1725980483 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6d9806a430 0x7f6d9806c8f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f6db80c5cd0 tx=0x7f6da80095d0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.105+0000 7f6dbd500640 1 -- 172.21.15.132:0/1725980483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6db81f28d0 msgr2=0x7f6db815b100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:26.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.105+0000 7f6dbd500640 1 --2- 172.21.15.132:0/1725980483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6db81f28d0 0x7f6db815b100 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7f6db0001580 tx=0x7f6db0001d80 comp rx=0 tx=0).stop 2023-12-20T04:43:26.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.105+0000 7f6dbd500640 1 -- 172.21.15.132:0/1725980483 shutdown_connections 2023-12-20T04:43:26.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.105+0000 7f6dbd500640 1 --2- 172.21.15.132:0/1725980483 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6d9806a430 0x7f6d9806c8f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.105+0000 7f6dbd500640 1 --2- 172.21.15.132:0/1725980483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6db81f28d0 0x7f6db815b100 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.105+0000 7f6dbd500640 1 --2- 172.21.15.132:0/1725980483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6db815e920 0x7f6db814f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.105+0000 7f6dbd500640 1 --2- 172.21.15.132:0/1725980483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6da4004d00 0x7f6db81f6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.105+0000 7f6dbd500640 1 -- 172.21.15.132:0/1725980483 >> 172.21.15.132:0/1725980483 conn(0x7f6db806a3d0 msgr2=0x7f6db80b50a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:26.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.106+0000 7f6dbd500640 1 -- 172.21.15.132:0/1725980483 shutdown_connections 2023-12-20T04:43:26.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.106+0000 7f6dbd500640 1 -- 172.21.15.132:0/1725980483 wait complete. 2023-12-20T04:43:26.118 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:43:26.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.218+0000 7fa74b2af640 1 Processor -- start 2023-12-20T04:43:26.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.218+0000 7fa74b2af640 1 -- start start 2023-12-20T04:43:26.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.219+0000 7fa74b2af640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa744159bb0 0x7fa74406f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.219+0000 7fa74b2af640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa74406bba0 0x7fa7440ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.219+0000 7fa74b2af640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa74406c8e0 con 0x7fa7440ad720 2023-12-20T04:43:26.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.219+0000 7fa74b2af640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74415e420 con 0x7fa74406bba0 2023-12-20T04:43:26.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.219+0000 7fa74b2af640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa74415e700 con 0x7fa744159bb0 2023-12-20T04:43:26.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.219+0000 7fa74984c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa74406bba0 0x7fa7440ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.219+0000 7fa74984c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa74406bba0 0x7fa7440ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35930/0 (socket says 172.21.15.132:35930) 2023-12-20T04:43:26.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.219+0000 7fa74984c640 1 -- 172.21.15.132:0/2590084820 learned_addr learned my addr 172.21.15.132:0/2590084820 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:26.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.219+0000 7fa74904b640 1 --2- 172.21.15.132:0/2590084820 >> v2:172.21.15.187:3300/0 conn(0x7fa744159bb0 0x7fa74406f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.219+0000 7fa74984c640 1 -- 172.21.15.132:0/2590084820 >> v2:172.21.15.187:3300/0 conn(0x7fa744159bb0 msgr2=0x7fa74406f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:26.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.219+0000 7fa74984c640 1 --2- 172.21.15.132:0/2590084820 >> v2:172.21.15.187:3300/0 conn(0x7fa744159bb0 0x7fa74406f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.219+0000 7fa74984c640 1 -- 172.21.15.132:0/2590084820 >> v1:172.21.15.187:6789/0 conn(0x7fa7440ad720 legacy=0x7fa74406b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:26.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.219+0000 7fa74984c640 1 -- 172.21.15.132:0/2590084820 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7440c9d10 con 0x7fa74406bba0 2023-12-20T04:43:26.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.220+0000 7fa74984c640 1 --2- 172.21.15.132:0/2590084820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74406bba0 0x7fa7440ca510 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa74406d5c0 tx=0x7fa73c02bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd7be7852d50622 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:26.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.220+0000 7fa73bfff640 1 -- 172.21.15.132:0/2590084820 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c02cb20 con 0x7fa74406bba0 2023-12-20T04:43:26.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.220+0000 7fa73bfff640 1 -- 172.21.15.132:0/2590084820 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa73c02cc80 con 0x7fa74406bba0 2023-12-20T04:43:26.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.220+0000 7fa73bfff640 1 -- 172.21.15.132:0/2590084820 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa73c0343f0 con 0x7fa74406bba0 2023-12-20T04:43:26.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.221+0000 7fa74b2af640 1 -- 172.21.15.132:0/2590084820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74406bba0 msgr2=0x7fa7440ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.221+0000 7fa74b2af640 1 --2- 172.21.15.132:0/2590084820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74406bba0 0x7fa7440ca510 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7fa74406d5c0 tx=0x7fa73c02bf80 comp rx=0 tx=0).stop 2023-12-20T04:43:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.221+0000 7fa74b2af640 1 -- 172.21.15.132:0/2590084820 shutdown_connections 2023-12-20T04:43:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.221+0000 7fa74b2af640 1 --2- 172.21.15.132:0/2590084820 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74406bba0 0x7fa7440ca510 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.221+0000 7fa74b2af640 1 --2- 172.21.15.132:0/2590084820 >> v2:172.21.15.187:3300/0 conn(0x7fa744159bb0 0x7fa74406f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.221+0000 7fa74b2af640 1 -- 172.21.15.132:0/2590084820 >> 172.21.15.132:0/2590084820 conn(0x7fa74406a260 msgr2=0x7fa7440b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.221+0000 7fa74b2af640 1 -- 172.21.15.132:0/2590084820 shutdown_connections 2023-12-20T04:43:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.221+0000 7fa74b2af640 1 -- 172.21.15.132:0/2590084820 wait complete. 2023-12-20T04:43:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.222+0000 7fa74b2af640 1 Processor -- start 2023-12-20T04:43:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.222+0000 7fa74b2af640 1 -- start start 2023-12-20T04:43:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74b2af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74406bba0 0x7fa744149290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74b2af640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7440ad720 0x7fa7440c8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74b2af640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa744159bb0 0x7fa744158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74b2af640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa744158070 con 0x7fa74406bba0 2023-12-20T04:43:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74b2af640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7441571a0 con 0x7fa7440ad720 2023-12-20T04:43:26.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74b2af640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7441497d0 con 0x7fa744159bb0 2023-12-20T04:43:26.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74904b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74406bba0 0x7fa744149290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74904b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74406bba0 0x7fa744149290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35934/0 (socket says 172.21.15.132:35934) 2023-12-20T04:43:26.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74904b640 1 -- 172.21.15.132:0/1324795761 learned_addr learned my addr 172.21.15.132:0/1324795761 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:26.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74884a640 1 --2- 172.21.15.132:0/1324795761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7440ad720 0x7fa7440c8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74984c640 1 --2- 172.21.15.132:0/1324795761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa744159bb0 0x7fa744158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74904b640 1 -- 172.21.15.132:0/1324795761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa744159bb0 msgr2=0x7fa744158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:26.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74904b640 1 --2- 172.21.15.132:0/1324795761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa744159bb0 0x7fa744158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74904b640 1 -- 172.21.15.132:0/1324795761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7440ad720 msgr2=0x7fa7440c8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:26.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74904b640 1 --2- 172.21.15.132:0/1324795761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7440ad720 0x7fa7440c8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74904b640 1 -- 172.21.15.132:0/1324795761 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa73c009b30 con 0x7fa74406bba0 2023-12-20T04:43:26.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74984c640 1 --2- 172.21.15.132:0/1324795761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa744159bb0 0x7fa744158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:26.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74904b640 1 --2- 172.21.15.132:0/1324795761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74406bba0 0x7fa744149290 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa74000e8a0 tx=0x7fa74000ed60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:26.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa739ffb640 1 -- 172.21.15.132:0/1324795761 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7400094f0 con 0x7fa74406bba0 2023-12-20T04:43:26.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa739ffb640 1 -- 172.21.15.132:0/1324795761 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa74000c940 con 0x7fa74406bba0 2023-12-20T04:43:26.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa74b2af640 1 -- 172.21.15.132:0/1324795761 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7441573f0 con 0x7fa74406bba0 2023-12-20T04:43:26.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.223+0000 7fa739ffb640 1 -- 172.21.15.132:0/1324795761 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa74000ccf0 con 0x7fa74406bba0 2023-12-20T04:43:26.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.224+0000 7fa74b2af640 1 -- 172.21.15.132:0/1324795761 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7441579b0 con 0x7fa74406bba0 2023-12-20T04:43:26.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.224+0000 7fa74b2af640 1 -- 172.21.15.132:0/1324795761 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7441582e0 con 0x7fa74406bba0 2023-12-20T04:43:26.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.225+0000 7fa739ffb640 1 -- 172.21.15.132:0/1324795761 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa740013470 con 0x7fa74406bba0 2023-12-20T04:43:26.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.225+0000 7fa739ffb640 1 --2- 172.21.15.132:0/1324795761 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa72806a430 0x7fa72806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.225+0000 7fa739ffb640 1 -- 172.21.15.132:0/1324795761 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7400888c0 con 0x7fa74406bba0 2023-12-20T04:43:26.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.225+0000 7fa74884a640 1 --2- 172.21.15.132:0/1324795761 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa72806a430 0x7fa72806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.226+0000 7fa74884a640 1 --2- 172.21.15.132:0/1324795761 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa72806a430 0x7fa72806c8f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa7440c9090 tx=0x7fa734009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:26.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.229+0000 7fa739ffb640 1 -- 172.21.15.132:0/1324795761 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa740053f60 con 0x7fa74406bba0 2023-12-20T04:43:26.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.409+0000 7fa74b2af640 1 -- 172.21.15.132:0/1324795761 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa74404e840 con 0x7fa74406bba0 2023-12-20T04:43:26.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.409+0000 7fa739ffb640 1 -- 172.21.15.132:0/1324795761 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa740021080 con 0x7fa74406bba0 2023-12-20T04:43:26.411 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:43:26.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.411+0000 7fa74b2af640 1 -- 172.21.15.132:0/1324795761 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa72806a430 msgr2=0x7fa72806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:26.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.411+0000 7fa74b2af640 1 --2- 172.21.15.132:0/1324795761 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa72806a430 0x7fa72806c8f0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7fa7440c9090 tx=0x7fa734009040 comp rx=0 tx=0).stop 2023-12-20T04:43:26.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.411+0000 7fa74b2af640 1 -- 172.21.15.132:0/1324795761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74406bba0 msgr2=0x7fa744149290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:26.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.411+0000 7fa74b2af640 1 --2- 172.21.15.132:0/1324795761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74406bba0 0x7fa744149290 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fa74000e8a0 tx=0x7fa74000ed60 comp rx=0 tx=0).stop 2023-12-20T04:43:26.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.411+0000 7fa74b2af640 1 -- 172.21.15.132:0/1324795761 shutdown_connections 2023-12-20T04:43:26.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.411+0000 7fa74b2af640 1 --2- 172.21.15.132:0/1324795761 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa72806a430 0x7fa72806c8f0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.411+0000 7fa74b2af640 1 --2- 172.21.15.132:0/1324795761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa744159bb0 0x7fa744158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.411+0000 7fa74b2af640 1 --2- 172.21.15.132:0/1324795761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7440ad720 0x7fa7440c8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.411+0000 7fa74b2af640 1 --2- 172.21.15.132:0/1324795761 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa74406bba0 0x7fa744149290 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.411+0000 7fa74b2af640 1 -- 172.21.15.132:0/1324795761 >> 172.21.15.132:0/1324795761 conn(0x7fa74406a260 msgr2=0x7fa74406f940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:26.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.412+0000 7fa74b2af640 1 -- 172.21.15.132:0/1324795761 shutdown_connections 2023-12-20T04:43:26.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.412+0000 7fa74b2af640 1 -- 172.21.15.132:0/1324795761 wait complete. 2023-12-20T04:43:26.425 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:43:26.425 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:43:26.441 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:26.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.579+0000 7fe7886af640 1 Processor -- start 2023-12-20T04:43:26.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.579+0000 7fe7886af640 1 -- start start 2023-12-20T04:43:26.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.580+0000 7fe7886af640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe780160450 0x7fe780160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.580+0000 7fe7886af640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe7800b5090 0x7fe7800d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.580+0000 7fe7886af640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7800b5ec0 con 0x7fe7801611b0 2023-12-20T04:43:26.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.580+0000 7fe7886af640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7801617e0 con 0x7fe780160450 2023-12-20T04:43:26.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.580+0000 7fe7886af640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7800d0fc0 con 0x7fe7800b5090 2023-12-20T04:43:26.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.580+0000 7fe78644b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe780160450 0x7fe780160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.580+0000 7fe785c4a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe7801611b0 0x7fe7800b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60130/0 (socket says 172.21.15.132:60130) 2023-12-20T04:43:26.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.580+0000 7fe78644b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe780160450 0x7fe780160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35948/0 (socket says 172.21.15.132:35948) 2023-12-20T04:43:26.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.580+0000 7fe785c4a640 1 -- 172.21.15.132:0/838255855 learned_addr learned my addr 172.21.15.132:0/838255855 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:26.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.580+0000 7fe786c4c640 1 --2- 172.21.15.132:0/838255855 >> v2:172.21.15.187:3300/0 conn(0x7fe7800b5090 0x7fe7800d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.580+0000 7fe78644b640 1 -- 172.21.15.132:0/838255855 >> v2:172.21.15.187:3300/0 conn(0x7fe7800b5090 msgr2=0x7fe7800d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:26.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.580+0000 7fe78644b640 1 --2- 172.21.15.132:0/838255855 >> v2:172.21.15.187:3300/0 conn(0x7fe7800b5090 0x7fe7800d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.580+0000 7fe78644b640 1 -- 172.21.15.132:0/838255855 >> v1:172.21.15.132:6789/0 conn(0x7fe7801611b0 legacy=0x7fe7800b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:26.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.580+0000 7fe785449640 1 -- 172.21.15.132:0/838255855 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3097129787 0 0) 0x7fe7800b5ec0 con 0x7fe7801611b0 2023-12-20T04:43:26.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.580+0000 7fe78644b640 1 -- 172.21.15.132:0/838255855 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7800d12a0 con 0x7fe780160450 2023-12-20T04:43:26.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.581+0000 7fe78644b640 1 --2- 172.21.15.132:0/838255855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe780160450 0x7fe780160c70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe780073c40 tx=0x7fe77c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=51f8644dcd22433a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:26.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.581+0000 7fe785449640 1 -- 172.21.15.132:0/838255855 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c02cd00 con 0x7fe780160450 2023-12-20T04:43:26.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.581+0000 7fe785449640 1 -- 172.21.15.132:0/838255855 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c02ce60 con 0x7fe780160450 2023-12-20T04:43:26.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.581+0000 7fe785449640 1 -- 172.21.15.132:0/838255855 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c034660 con 0x7fe780160450 2023-12-20T04:43:26.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.582+0000 7fe7886af640 1 -- 172.21.15.132:0/838255855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe780160450 msgr2=0x7fe780160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:26.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.582+0000 7fe7886af640 1 --2- 172.21.15.132:0/838255855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe780160450 0x7fe780160c70 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7fe780073c40 tx=0x7fe77c02bf50 comp rx=0 tx=0).stop 2023-12-20T04:43:26.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.582+0000 7fe7886af640 1 -- 172.21.15.132:0/838255855 shutdown_connections 2023-12-20T04:43:26.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.582+0000 7fe7886af640 1 --2- 172.21.15.132:0/838255855 >> v2:172.21.15.187:3300/0 conn(0x7fe7800b5090 0x7fe7800d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.582+0000 7fe7886af640 1 --2- 172.21.15.132:0/838255855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe780160450 0x7fe780160c70 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.582+0000 7fe7886af640 1 -- 172.21.15.132:0/838255855 >> 172.21.15.132:0/838255855 conn(0x7fe7800cf980 msgr2=0x7fe7800cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:26.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.582+0000 7fe7886af640 1 -- 172.21.15.132:0/838255855 shutdown_connections 2023-12-20T04:43:26.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.582+0000 7fe7886af640 1 -- 172.21.15.132:0/838255855 wait complete. 2023-12-20T04:43:26.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.583+0000 7fe7886af640 1 Processor -- start 2023-12-20T04:43:26.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.583+0000 7fe7886af640 1 -- start start 2023-12-20T04:43:26.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.583+0000 7fe7886af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7800b5090 0x7fe7800c8ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.583+0000 7fe7886af640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe780160450 0x7fe78015b490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.583+0000 7fe7886af640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7801611b0 0x7fe7800d3030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.583+0000 7fe7886af640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7800c9000 con 0x7fe7800b5090 2023-12-20T04:43:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe7886af640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7801570c0 con 0x7fe7801611b0 2023-12-20T04:43:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe7886af640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7801573a0 con 0x7fe780160450 2023-12-20T04:43:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe78644b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7800b5090 0x7fe7800c8ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe78644b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7800b5090 0x7fe7800c8ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35958/0 (socket says 172.21.15.132:35958) 2023-12-20T04:43:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe78644b640 1 -- 172.21.15.132:0/3909866677 learned_addr learned my addr 172.21.15.132:0/3909866677 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe786c4c640 1 --2- 172.21.15.132:0/3909866677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7801611b0 0x7fe7800d3030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe785c4a640 1 --2- 172.21.15.132:0/3909866677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe780160450 0x7fe78015b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe78644b640 1 -- 172.21.15.132:0/3909866677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe780160450 msgr2=0x7fe78015b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:26.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe78644b640 1 --2- 172.21.15.132:0/3909866677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe780160450 0x7fe78015b490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe78644b640 1 -- 172.21.15.132:0/3909866677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7801611b0 msgr2=0x7fe7800d3030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe78644b640 1 --2- 172.21.15.132:0/3909866677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7801611b0 0x7fe7800d3030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe78644b640 1 -- 172.21.15.132:0/3909866677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe77c009a70 con 0x7fe7800b5090 2023-12-20T04:43:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe785c4a640 1 --2- 172.21.15.132:0/3909866677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe780160450 0x7fe78015b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe78644b640 1 --2- 172.21.15.132:0/3909866677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7800b5090 0x7fe7800c8ac0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009e80 tx=0x7fe77c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe776ffd640 1 -- 172.21.15.132:0/3909866677 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c03e610 con 0x7fe7800b5090 2023-12-20T04:43:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe776ffd640 1 -- 172.21.15.132:0/3909866677 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c03e770 con 0x7fe7800b5090 2023-12-20T04:43:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe7886af640 1 -- 172.21.15.132:0/3909866677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe780157680 con 0x7fe7800b5090 2023-12-20T04:43:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe776ffd640 1 -- 172.21.15.132:0/3909866677 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c03eae0 con 0x7fe7800b5090 2023-12-20T04:43:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.584+0000 7fe7886af640 1 -- 172.21.15.132:0/3909866677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe780157c40 con 0x7fe7800b5090 2023-12-20T04:43:26.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.585+0000 7fe7886af640 1 -- 172.21.15.132:0/3909866677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78004e840 con 0x7fe7800b5090 2023-12-20T04:43:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.586+0000 7fe776ffd640 1 -- 172.21.15.132:0/3909866677 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe77c03b050 con 0x7fe7800b5090 2023-12-20T04:43:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.586+0000 7fe776ffd640 1 --2- 172.21.15.132:0/3909866677 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe76406a430 0x7fe76406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.586+0000 7fe776ffd640 1 -- 172.21.15.132:0/3909866677 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe77c0aae50 con 0x7fe7800b5090 2023-12-20T04:43:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.586+0000 7fe785c4a640 1 --2- 172.21.15.132:0/3909866677 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe76406a430 0x7fe76406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.586+0000 7fe785c4a640 1 --2- 172.21.15.132:0/3909866677 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe76406a430 0x7fe76406c8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe7800b85c0 tx=0x7fe770007cc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:26.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.590+0000 7fe776ffd640 1 -- 172.21.15.132:0/3909866677 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe77c076580 con 0x7fe7800b5090 2023-12-20T04:43:26.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.760+0000 7fe7886af640 1 -- 172.21.15.132:0/3909866677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe780157e30 con 0x7fe7800b5090 2023-12-20T04:43:26.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.761+0000 7fe776ffd640 1 -- 172.21.15.132:0/3909866677 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fe77c039090 con 0x7fe7800b5090 2023-12-20T04:43:26.762 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:26.763 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:26.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.763+0000 7fe7886af640 1 -- 172.21.15.132:0/3909866677 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe76406a430 msgr2=0x7fe76406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:26.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.763+0000 7fe7886af640 1 --2- 172.21.15.132:0/3909866677 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe76406a430 0x7fe76406c8f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe7800b85c0 tx=0x7fe770007cc0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.763+0000 7fe7886af640 1 -- 172.21.15.132:0/3909866677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7800b5090 msgr2=0x7fe7800c8ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:26.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.763+0000 7fe7886af640 1 --2- 172.21.15.132:0/3909866677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7800b5090 0x7fe7800c8ac0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009e80 tx=0x7fe77c004a40 comp rx=0 tx=0).stop 2023-12-20T04:43:26.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.763+0000 7fe7886af640 1 -- 172.21.15.132:0/3909866677 shutdown_connections 2023-12-20T04:43:26.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.763+0000 7fe7886af640 1 --2- 172.21.15.132:0/3909866677 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe76406a430 0x7fe76406c8f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.763+0000 7fe7886af640 1 --2- 172.21.15.132:0/3909866677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7801611b0 0x7fe7800d3030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.763+0000 7fe7886af640 1 --2- 172.21.15.132:0/3909866677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe780160450 0x7fe78015b490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.763+0000 7fe7886af640 1 --2- 172.21.15.132:0/3909866677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7800b5090 0x7fe7800c8ac0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.763+0000 7fe7886af640 1 -- 172.21.15.132:0/3909866677 >> 172.21.15.132:0/3909866677 conn(0x7fe7800cf980 msgr2=0x7fe780065910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:26.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.763+0000 7fe7886af640 1 -- 172.21.15.132:0/3909866677 shutdown_connections 2023-12-20T04:43:26.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.763+0000 7fe7886af640 1 -- 172.21.15.132:0/3909866677 wait complete. 2023-12-20T04:43:26.776 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:42:45.433456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:42:46.128920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:43:26.776 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:43:26.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.878+0000 7f21d6b3c640 1 Processor -- start 2023-12-20T04:43:26.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.878+0000 7f21d6b3c640 1 -- start start 2023-12-20T04:43:26.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.879+0000 7f21d6b3c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d0069c30 0x7f21d0070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.879+0000 7f21d6b3c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f21d015d360 0x7f21d006a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.879+0000 7f21d6b3c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f21d00cbde0 0x7f21d00ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.879+0000 7f21d6b3c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d00c4f40 con 0x7f21d015d360 2023-12-20T04:43:26.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.879+0000 7f21d6b3c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f21d00af5b0 con 0x7f21d00cbde0 2023-12-20T04:43:26.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.879+0000 7f21d6b3c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d006a550 con 0x7f21d0069c30 2023-12-20T04:43:26.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.879+0000 7f21cffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f21d015d360 0x7f21d006a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.879+0000 7f21cffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f21d015d360 0x7f21d006a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35974/0 (socket says 172.21.15.132:35974) 2023-12-20T04:43:26.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.879+0000 7f21cffff640 1 -- 172.21.15.132:0/1311937386 learned_addr learned my addr 172.21.15.132:0/1311937386 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:26.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.879+0000 7f21d48d8640 1 --2- 172.21.15.132:0/1311937386 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d0069c30 0x7f21d0070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.879+0000 7f21d50d9640 1 --2- 172.21.15.132:0/1311937386 >> v2:172.21.15.187:3300/0 conn(0x7f21d00cbde0 0x7f21d00ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.879+0000 7f21cffff640 1 -- 172.21.15.132:0/1311937386 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d0069c30 msgr2=0x7f21d0070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:26.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.879+0000 7f21cffff640 1 --2- 172.21.15.132:0/1311937386 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d0069c30 0x7f21d0070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.879+0000 7f21cffff640 1 -- 172.21.15.132:0/1311937386 >> v2:172.21.15.187:3300/0 conn(0x7f21d00cbde0 msgr2=0x7f21d00ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:26.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.879+0000 7f21cffff640 1 --2- 172.21.15.132:0/1311937386 >> v2:172.21.15.187:3300/0 conn(0x7f21d00cbde0 0x7f21d00ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.879+0000 7f21cffff640 1 -- 172.21.15.132:0/1311937386 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21d0070a40 con 0x7f21d015d360 2023-12-20T04:43:26.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.879+0000 7f21d50d9640 1 --2- 172.21.15.132:0/1311937386 >> v2:172.21.15.187:3300/0 conn(0x7f21d00cbde0 0x7f21d00ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:26.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.880+0000 7f21cffff640 1 --2- 172.21.15.132:0/1311937386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21d015d360 0x7f21d006a010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f21d00719e0 tx=0x7f21c402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8a3ad15c0e8393 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:26.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.880+0000 7f21cf7fe640 1 -- 172.21.15.132:0/1311937386 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4031870 con 0x7f21d015d360 2023-12-20T04:43:26.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.880+0000 7f21cf7fe640 1 -- 172.21.15.132:0/1311937386 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c40319d0 con 0x7f21d015d360 2023-12-20T04:43:26.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.880+0000 7f21cf7fe640 1 -- 172.21.15.132:0/1311937386 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c4031d60 con 0x7f21d015d360 2023-12-20T04:43:26.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.881+0000 7f21d6b3c640 1 -- 172.21.15.132:0/1311937386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21d015d360 msgr2=0x7f21d006a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:26.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.881+0000 7f21d6b3c640 1 --2- 172.21.15.132:0/1311937386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21d015d360 0x7f21d006a010 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f21d00719e0 tx=0x7f21c402b910 comp rx=0 tx=0).stop 2023-12-20T04:43:26.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.881+0000 7f21d6b3c640 1 -- 172.21.15.132:0/1311937386 shutdown_connections 2023-12-20T04:43:26.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.881+0000 7f21d6b3c640 1 --2- 172.21.15.132:0/1311937386 >> v2:172.21.15.187:3300/0 conn(0x7f21d00cbde0 0x7f21d00ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.881+0000 7f21d6b3c640 1 --2- 172.21.15.132:0/1311937386 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21d015d360 0x7f21d006a010 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.881+0000 7f21d6b3c640 1 --2- 172.21.15.132:0/1311937386 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d0069c30 0x7f21d0070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.881+0000 7f21d6b3c640 1 -- 172.21.15.132:0/1311937386 >> 172.21.15.132:0/1311937386 conn(0x7f21d00cc630 msgr2=0x7f21d00cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:26.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.881+0000 7f21d6b3c640 1 -- 172.21.15.132:0/1311937386 shutdown_connections 2023-12-20T04:43:26.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.881+0000 7f21d6b3c640 1 -- 172.21.15.132:0/1311937386 wait complete. 2023-12-20T04:43:26.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.882+0000 7f21d6b3c640 1 Processor -- start 2023-12-20T04:43:26.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.882+0000 7f21d6b3c640 1 -- start start 2023-12-20T04:43:26.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21d6b3c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21d0069c30 0x7f21d0158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21d6b3c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21d00cbde0 0x7f21d00c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21d6b3c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d015d360 0x7f21d015fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21d6b3c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00c9ac0 con 0x7f21d00cbde0 2023-12-20T04:43:26.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21d6b3c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d00c7ea0 con 0x7f21d0069c30 2023-12-20T04:43:26.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21d6b3c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0159ff0 con 0x7f21d015d360 2023-12-20T04:43:26.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21cffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21d00cbde0 0x7f21d00c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21cffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21d00cbde0 0x7f21d00c9270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35980/0 (socket says 172.21.15.132:35980) 2023-12-20T04:43:26.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21cffff640 1 -- 172.21.15.132:0/4110626964 learned_addr learned my addr 172.21.15.132:0/4110626964 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:26.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21d48d8640 1 --2- 172.21.15.132:0/4110626964 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21d0069c30 0x7f21d0158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21d50d9640 1 --2- 172.21.15.132:0/4110626964 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d015d360 0x7f21d015fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21cffff640 1 -- 172.21.15.132:0/4110626964 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d015d360 msgr2=0x7f21d015fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:26.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21cffff640 1 --2- 172.21.15.132:0/4110626964 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d015d360 0x7f21d015fc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21cffff640 1 -- 172.21.15.132:0/4110626964 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21d0069c30 msgr2=0x7f21d0158e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:26.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21cffff640 1 --2- 172.21.15.132:0/4110626964 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21d0069c30 0x7f21d0158e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:26.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21cffff640 1 -- 172.21.15.132:0/4110626964 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c40094d0 con 0x7f21d00cbde0 2023-12-20T04:43:26.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21d48d8640 1 --2- 172.21.15.132:0/4110626964 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21d0069c30 0x7f21d0158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:26.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.883+0000 7f21cffff640 1 --2- 172.21.15.132:0/4110626964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21d00cbde0 0x7f21d00c9270 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f21c402b950 tx=0x7f21c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:26.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.884+0000 7f21cd7fa640 1 -- 172.21.15.132:0/4110626964 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c403ad30 con 0x7f21d00cbde0 2023-12-20T04:43:26.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.884+0000 7f21cd7fa640 1 -- 172.21.15.132:0/4110626964 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f21c40443f0 con 0x7f21d00cbde0 2023-12-20T04:43:26.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.884+0000 7f21d6b3c640 1 -- 172.21.15.132:0/4110626964 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d015a2d0 con 0x7f21d00cbde0 2023-12-20T04:43:26.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.884+0000 7f21cd7fa640 1 -- 172.21.15.132:0/4110626964 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f21c40447a0 con 0x7f21d00cbde0 2023-12-20T04:43:26.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.884+0000 7f21d6b3c640 1 -- 172.21.15.132:0/4110626964 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d00c97b0 con 0x7f21d00cbde0 2023-12-20T04:43:26.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.885+0000 7f21d6b3c640 1 -- 172.21.15.132:0/4110626964 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d006c680 con 0x7f21d00cbde0 2023-12-20T04:43:26.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.885+0000 7f21cd7fa640 1 -- 172.21.15.132:0/4110626964 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f21c404d450 con 0x7f21d00cbde0 2023-12-20T04:43:26.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.885+0000 7f21cd7fa640 1 --2- 172.21.15.132:0/4110626964 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f21bc06a430 0x7f21bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:26.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.885+0000 7f21cd7fa640 1 -- 172.21.15.132:0/4110626964 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f21c402d040 con 0x7f21d00cbde0 2023-12-20T04:43:26.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.885+0000 7f21d48d8640 1 --2- 172.21.15.132:0/4110626964 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f21bc06a430 0x7f21bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:26.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.886+0000 7f21d48d8640 1 --2- 172.21.15.132:0/4110626964 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f21bc06a430 0x7f21bc06c8f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f21c0006fd0 tx=0x7f21c0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:26.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:26.889+0000 7f21cd7fa640 1 -- 172.21.15.132:0/4110626964 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f21d006c680 con 0x7f21d00cbde0 2023-12-20T04:43:27.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.056+0000 7f21d6b3c640 1 -- 172.21.15.132:0/4110626964 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f21d006c680 con 0x7f21d00cbde0 2023-12-20T04:43:27.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.057+0000 7f21cd7fa640 1 -- 172.21.15.132:0/4110626964 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f21d006c680 con 0x7f21d00cbde0 2023-12-20T04:43:27.059 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:43:27.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.059+0000 7f21d6b3c640 1 -- 172.21.15.132:0/4110626964 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f21bc06a430 msgr2=0x7f21bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.059+0000 7f21d6b3c640 1 --2- 172.21.15.132:0/4110626964 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f21bc06a430 0x7f21bc06c8f0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7f21c0006fd0 tx=0x7f21c0008040 comp rx=0 tx=0).stop 2023-12-20T04:43:27.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.059+0000 7f21d6b3c640 1 -- 172.21.15.132:0/4110626964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21d00cbde0 msgr2=0x7f21d00c9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.059+0000 7f21d6b3c640 1 --2- 172.21.15.132:0/4110626964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21d00cbde0 0x7f21d00c9270 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f21c402b950 tx=0x7f21c40046c0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.059+0000 7f21d6b3c640 1 -- 172.21.15.132:0/4110626964 shutdown_connections 2023-12-20T04:43:27.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.059+0000 7f21d6b3c640 1 --2- 172.21.15.132:0/4110626964 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f21bc06a430 0x7f21bc06c8f0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.059+0000 7f21d6b3c640 1 --2- 172.21.15.132:0/4110626964 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f21d015d360 0x7f21d015fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.059+0000 7f21d6b3c640 1 --2- 172.21.15.132:0/4110626964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f21d00cbde0 0x7f21d00c9270 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.059+0000 7f21d6b3c640 1 --2- 172.21.15.132:0/4110626964 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f21d0069c30 0x7f21d0158e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.059+0000 7f21d6b3c640 1 -- 172.21.15.132:0/4110626964 >> 172.21.15.132:0/4110626964 conn(0x7f21d00cc630 msgr2=0x7f21d015b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:27.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.059+0000 7f21d6b3c640 1 -- 172.21.15.132:0/4110626964 shutdown_connections 2023-12-20T04:43:27.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.059+0000 7f21d6b3c640 1 -- 172.21.15.132:0/4110626964 wait complete. 2023-12-20T04:43:27.071 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:43:27.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.173+0000 7f6fddbb9640 1 Processor -- start 2023-12-20T04:43:27.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.174+0000 7f6fddbb9640 1 -- start start 2023-12-20T04:43:27.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.174+0000 7f6fddbb9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6fd80cfc40 0x7f6fd80b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:27.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.174+0000 7f6fddbb9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd80d2920 con 0x7f6fd815d300 2023-12-20T04:43:27.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.174+0000 7f6fddbb9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6fd80d1d10 con 0x7f6fd80cf790 2023-12-20T04:43:27.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.174+0000 7f6fddbb9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6fd80d1ff0 con 0x7f6fd80cfc40 2023-12-20T04:43:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.174+0000 7f6fd77fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6fd815d300 0x7f6fd80d1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60144/0 (socket says 172.21.15.132:60144) 2023-12-20T04:43:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.174+0000 7f6fd77fe640 1 -- 172.21.15.132:0/2795948441 learned_addr learned my addr 172.21.15.132:0/2795948441 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.175+0000 7f6fd7fff640 1 --2- 172.21.15.132:0/2795948441 >> v2:172.21.15.187:3300/0 conn(0x7f6fd80cfc40 0x7f6fd80b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.175+0000 7f6fd6ffd640 1 -- 172.21.15.132:0/2795948441 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1854398277 0 0) 0x7f6fd80d2920 con 0x7f6fd815d300 2023-12-20T04:43:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.175+0000 7f6fd6ffd640 1 -- 172.21.15.132:0/2795948441 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fc4003520 con 0x7f6fd815d300 2023-12-20T04:43:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.175+0000 7f6fd6ffd640 1 -- 172.21.15.132:0/2795948441 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3357165848 0 0) 0x7f6fd80d1d10 con 0x7f6fd80cf790 2023-12-20T04:43:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.175+0000 7f6fd6ffd640 1 -- 172.21.15.132:0/2795948441 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6fd80d2920 con 0x7f6fd80cf790 2023-12-20T04:43:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.175+0000 7f6fd7fff640 1 -- 172.21.15.132:0/2795948441 >> v1:172.21.15.187:6789/0 conn(0x7f6fd80cf790 legacy=0x7f6fd80b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.175+0000 7f6fd7fff640 1 -- 172.21.15.132:0/2795948441 >> v1:172.21.15.132:6789/0 conn(0x7f6fd815d300 legacy=0x7f6fd80d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.175+0000 7f6fd7fff640 1 -- 172.21.15.132:0/2795948441 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd80d22d0 con 0x7f6fd80cfc40 2023-12-20T04:43:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.176+0000 7f6fd7fff640 1 --2- 172.21.15.132:0/2795948441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fd80cfc40 0x7f6fd80b6790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009d90 tx=0x7f6fd002bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=37d7a8a57fa42ceb server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.176+0000 7f6fd6ffd640 1 -- 172.21.15.132:0/2795948441 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd002cd00 con 0x7f6fd80cfc40 2023-12-20T04:43:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.176+0000 7f6fd6ffd640 1 -- 172.21.15.132:0/2795948441 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fd002ce60 con 0x7f6fd80cfc40 2023-12-20T04:43:27.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.176+0000 7f6fd6ffd640 1 -- 172.21.15.132:0/2795948441 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fd0034660 con 0x7f6fd80cfc40 2023-12-20T04:43:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.176+0000 7f6fddbb9640 1 -- 172.21.15.132:0/2795948441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fd80cfc40 msgr2=0x7f6fd80b6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.176+0000 7f6fddbb9640 1 --2- 172.21.15.132:0/2795948441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fd80cfc40 0x7f6fd80b6790 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6fd0009d90 tx=0x7f6fd002bf50 comp rx=0 tx=0).stop 2023-12-20T04:43:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.176+0000 7f6fddbb9640 1 -- 172.21.15.132:0/2795948441 shutdown_connections 2023-12-20T04:43:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.176+0000 7f6fddbb9640 1 --2- 172.21.15.132:0/2795948441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fd80cfc40 0x7f6fd80b6790 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.176+0000 7f6fddbb9640 1 -- 172.21.15.132:0/2795948441 >> 172.21.15.132:0/2795948441 conn(0x7f6fd806a3d0 msgr2=0x7f6fd806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.176+0000 7f6fddbb9640 1 -- 172.21.15.132:0/2795948441 shutdown_connections 2023-12-20T04:43:27.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.176+0000 7f6fddbb9640 1 -- 172.21.15.132:0/2795948441 wait complete. 2023-12-20T04:43:27.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.178+0000 7f6fddbb9640 1 Processor -- start 2023-12-20T04:43:27.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.178+0000 7f6fddbb9640 1 -- start start 2023-12-20T04:43:27.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.178+0000 7f6fddbb9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fd80cf790 0x7f6fd81e5980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:27.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.178+0000 7f6fddbb9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fd80cfc40 0x7f6fd80c5930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:27.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.178+0000 7f6fddbb9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fd815d300 0x7f6fd81596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:27.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.178+0000 7f6fddbb9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd80c6ad0 con 0x7f6fd80cfc40 2023-12-20T04:43:27.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.178+0000 7f6fddbb9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd81e6060 con 0x7f6fd815d300 2023-12-20T04:43:27.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.178+0000 7f6fddbb9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6fd81e6340 con 0x7f6fd80cf790 2023-12-20T04:43:27.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.179+0000 7f6fceffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fd80cfc40 0x7f6fd80c5930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:27.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.179+0000 7f6fceffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fd80cfc40 0x7f6fd80c5930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35984/0 (socket says 172.21.15.132:35984) 2023-12-20T04:43:27.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.179+0000 7f6fceffd640 1 -- 172.21.15.132:0/3248757713 learned_addr learned my addr 172.21.15.132:0/3248757713 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:27.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.179+0000 7f6fd77fe640 1 --2- 172.21.15.132:0/3248757713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fd80cf790 0x7f6fd81e5980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:27.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.179+0000 7f6fd7fff640 1 --2- 172.21.15.132:0/3248757713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fd815d300 0x7f6fd81596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:27.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.179+0000 7f6fceffd640 1 -- 172.21.15.132:0/3248757713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fd80cf790 msgr2=0x7f6fd81e5980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.179+0000 7f6fceffd640 1 --2- 172.21.15.132:0/3248757713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fd80cf790 0x7f6fd81e5980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.179+0000 7f6fceffd640 1 -- 172.21.15.132:0/3248757713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fd815d300 msgr2=0x7f6fd81596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.179+0000 7f6fceffd640 1 --2- 172.21.15.132:0/3248757713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fd815d300 0x7f6fd81596e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.179+0000 7f6fceffd640 1 -- 172.21.15.132:0/3248757713 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6fd0009a70 con 0x7f6fd80cfc40 2023-12-20T04:43:27.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.179+0000 7f6fceffd640 1 --2- 172.21.15.132:0/3248757713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fd80cfc40 0x7f6fd80c5930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000c430 tx=0x7f6fc000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:27.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.179+0000 7f6fd4ff9640 1 -- 172.21.15.132:0/3248757713 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc00052d0 con 0x7f6fd80cfc40 2023-12-20T04:43:27.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.179+0000 7f6fd4ff9640 1 -- 172.21.15.132:0/3248757713 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6fc0005450 con 0x7f6fd80cfc40 2023-12-20T04:43:27.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.179+0000 7f6fddbb9640 1 -- 172.21.15.132:0/3248757713 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6fd81e6620 con 0x7f6fd80cfc40 2023-12-20T04:43:27.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.179+0000 7f6fd4ff9640 1 -- 172.21.15.132:0/3248757713 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6fc0003830 con 0x7f6fd80cfc40 2023-12-20T04:43:27.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.179+0000 7f6fddbb9640 1 -- 172.21.15.132:0/3248757713 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6fd80cbd10 con 0x7f6fd80cfc40 2023-12-20T04:43:27.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.180+0000 7f6fddbb9640 1 -- 172.21.15.132:0/3248757713 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6fd804e840 con 0x7f6fd80cfc40 2023-12-20T04:43:27.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.181+0000 7f6fd4ff9640 1 -- 172.21.15.132:0/3248757713 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6fc0003990 con 0x7f6fd80cfc40 2023-12-20T04:43:27.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.181+0000 7f6fd4ff9640 1 --2- 172.21.15.132:0/3248757713 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fb806a430 0x7f6fb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:27.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.181+0000 7f6fd4ff9640 1 -- 172.21.15.132:0/3248757713 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6fc0087f10 con 0x7f6fd80cfc40 2023-12-20T04:43:27.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.181+0000 7f6fd77fe640 1 --2- 172.21.15.132:0/3248757713 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fb806a430 0x7f6fb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:27.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.182+0000 7f6fd77fe640 1 --2- 172.21.15.132:0/3248757713 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fb806a430 0x7f6fb806c8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80011e0 tx=0x7f6fc8007d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:27.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.185+0000 7f6fd4ff9640 1 -- 172.21.15.132:0/3248757713 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6fc00535b0 con 0x7f6fd80cfc40 2023-12-20T04:43:27.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.352+0000 7f6fddbb9640 1 -- 172.21.15.132:0/3248757713 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f6fd80b7420 con 0x7f6fd80cfc40 2023-12-20T04:43:27.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.353+0000 7f6fd4ff9640 1 -- 172.21.15.132:0/3248757713 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6fc0056bd0 con 0x7f6fd80cfc40 2023-12-20T04:43:27.355 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:43:27.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.355+0000 7f6fddbb9640 1 -- 172.21.15.132:0/3248757713 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fb806a430 msgr2=0x7f6fb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.355+0000 7f6fddbb9640 1 --2- 172.21.15.132:0/3248757713 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fb806a430 0x7f6fb806c8f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f6fc80011e0 tx=0x7f6fc8007d30 comp rx=0 tx=0).stop 2023-12-20T04:43:27.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.355+0000 7f6fddbb9640 1 -- 172.21.15.132:0/3248757713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fd80cfc40 msgr2=0x7f6fd80c5930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.355+0000 7f6fddbb9640 1 --2- 172.21.15.132:0/3248757713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fd80cfc40 0x7f6fd80c5930 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f6fc000c430 tx=0x7f6fc000c8f0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.355+0000 7f6fddbb9640 1 -- 172.21.15.132:0/3248757713 shutdown_connections 2023-12-20T04:43:27.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.355+0000 7f6fddbb9640 1 --2- 172.21.15.132:0/3248757713 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fb806a430 0x7f6fb806c8f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.355+0000 7f6fddbb9640 1 --2- 172.21.15.132:0/3248757713 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6fd815d300 0x7f6fd81596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.355+0000 7f6fddbb9640 1 --2- 172.21.15.132:0/3248757713 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6fd80cfc40 0x7f6fd80c5930 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.355+0000 7f6fddbb9640 1 --2- 172.21.15.132:0/3248757713 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6fd80cf790 0x7f6fd81e5980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.355+0000 7f6fddbb9640 1 -- 172.21.15.132:0/3248757713 >> 172.21.15.132:0/3248757713 conn(0x7f6fd806a3d0 msgr2=0x7f6fd80b6a70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:27.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.355+0000 7f6fddbb9640 1 -- 172.21.15.132:0/3248757713 shutdown_connections 2023-12-20T04:43:27.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.355+0000 7f6fddbb9640 1 -- 172.21.15.132:0/3248757713 wait complete. 2023-12-20T04:43:27.367 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:43:27.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.468+0000 7ff101243640 1 Processor -- start 2023-12-20T04:43:27.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.468+0000 7ff101243640 1 -- start start 2023-12-20T04:43:27.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.469+0000 7ff101243640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff0fc15cf20 0x7ff0fc06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:27.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.469+0000 7ff101243640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0fc15d300 0x7ff0fc161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:27.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.469+0000 7ff101243640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0fc161c40 con 0x7ff0fc0cd4b0 2023-12-20T04:43:27.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.469+0000 7ff101243640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0fc06cc90 con 0x7ff0fc15d300 2023-12-20T04:43:27.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.469+0000 7ff101243640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0fc0b2f30 con 0x7ff0fc15cf20 2023-12-20T04:43:27.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.469+0000 7ff0fa59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0fc15d300 0x7ff0fc161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:27.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.469+0000 7ff0fa59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0fc15d300 0x7ff0fc161700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55242/0 (socket says 172.21.15.132:55242) 2023-12-20T04:43:27.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.469+0000 7ff0fa59c640 1 -- 172.21.15.132:0/2567816513 learned_addr learned my addr 172.21.15.132:0/2567816513 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:27.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.469+0000 7ff0fad9d640 1 --2- 172.21.15.132:0/2567816513 >> v2:172.21.15.187:3300/0 conn(0x7ff0fc15cf20 0x7ff0fc06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:27.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.470+0000 7ff0fa59c640 1 -- 172.21.15.132:0/2567816513 >> v2:172.21.15.187:3300/0 conn(0x7ff0fc15cf20 msgr2=0x7ff0fc06c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:27.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.470+0000 7ff0fa59c640 1 --2- 172.21.15.132:0/2567816513 >> v2:172.21.15.187:3300/0 conn(0x7ff0fc15cf20 0x7ff0fc06c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.470+0000 7ff0fa59c640 1 -- 172.21.15.132:0/2567816513 >> v1:172.21.15.187:6789/0 conn(0x7ff0fc0cd4b0 legacy=0x7ff0fc0ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.470+0000 7ff0fa59c640 1 -- 172.21.15.132:0/2567816513 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0fc0b3210 con 0x7ff0fc15d300 2023-12-20T04:43:27.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.470+0000 7ff0fa59c640 1 --2- 172.21.15.132:0/2567816513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0fc15d300 0x7ff0fc161700 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc071180 tx=0x7ff0f002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccaf346552787849 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:27.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.470+0000 7ff0f9d9b640 1 -- 172.21.15.132:0/2567816513 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0030860 con 0x7ff0fc15d300 2023-12-20T04:43:27.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.470+0000 7ff0f9d9b640 1 -- 172.21.15.132:0/2567816513 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f00309c0 con 0x7ff0fc15d300 2023-12-20T04:43:27.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.470+0000 7ff0f9d9b640 1 -- 172.21.15.132:0/2567816513 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f0030d50 con 0x7ff0fc15d300 2023-12-20T04:43:27.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.471+0000 7ff101243640 1 -- 172.21.15.132:0/2567816513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0fc15d300 msgr2=0x7ff0fc161700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.471+0000 7ff101243640 1 --2- 172.21.15.132:0/2567816513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0fc15d300 0x7ff0fc161700 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc071180 tx=0x7ff0f002b9a0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.471+0000 7ff101243640 1 -- 172.21.15.132:0/2567816513 shutdown_connections 2023-12-20T04:43:27.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.471+0000 7ff101243640 1 --2- 172.21.15.132:0/2567816513 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0fc15d300 0x7ff0fc161700 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.471+0000 7ff101243640 1 --2- 172.21.15.132:0/2567816513 >> v2:172.21.15.187:3300/0 conn(0x7ff0fc15cf20 0x7ff0fc06c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.471+0000 7ff101243640 1 -- 172.21.15.132:0/2567816513 >> 172.21.15.132:0/2567816513 conn(0x7ff0fc072c60 msgr2=0x7ff0fc073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:27.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.471+0000 7ff101243640 1 -- 172.21.15.132:0/2567816513 shutdown_connections 2023-12-20T04:43:27.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.471+0000 7ff101243640 1 -- 172.21.15.132:0/2567816513 wait complete. 2023-12-20T04:43:27.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.472+0000 7ff101243640 1 Processor -- start 2023-12-20T04:43:27.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.473+0000 7ff101243640 1 -- start start 2023-12-20T04:43:27.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.473+0000 7ff101243640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0fc0cd4b0 0x7ff0fc0c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:27.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.473+0000 7ff101243640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0fc15cf20 0x7ff0fc0b5c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:27.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.473+0000 7ff101243640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0fc15d300 0x7ff0fc1f1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:27.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.473+0000 7ff101243640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc14ae90 con 0x7ff0fc0cd4b0 2023-12-20T04:43:27.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.473+0000 7ff101243640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc0c5bf0 con 0x7ff0fc15cf20 2023-12-20T04:43:27.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.473+0000 7ff101243640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0fc14ac00 con 0x7ff0fc15d300 2023-12-20T04:43:27.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.473+0000 7ff0fad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0fc0cd4b0 0x7ff0fc0c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:27.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.473+0000 7ff0fad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0fc0cd4b0 0x7ff0fc0c4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55248/0 (socket says 172.21.15.132:55248) 2023-12-20T04:43:27.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.473+0000 7ff0fad9d640 1 -- 172.21.15.132:0/759896705 learned_addr learned my addr 172.21.15.132:0/759896705 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:27.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.474+0000 7ff0fad9d640 1 -- 172.21.15.132:0/759896705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0fc15d300 msgr2=0x7ff0fc1f1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.474+0000 7ff0fad9d640 1 --2- 172.21.15.132:0/759896705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0fc15d300 0x7ff0fc1f1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.474+0000 7ff0fad9d640 1 -- 172.21.15.132:0/759896705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0fc15cf20 msgr2=0x7ff0fc0b5c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.474+0000 7ff0fad9d640 1 --2- 172.21.15.132:0/759896705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0fc15cf20 0x7ff0fc0b5c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.474+0000 7ff0fad9d640 1 -- 172.21.15.132:0/759896705 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0f00094d0 con 0x7ff0fc0cd4b0 2023-12-20T04:43:27.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.474+0000 7ff0fad9d640 1 --2- 172.21.15.132:0/759896705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0fc0cd4b0 0x7ff0fc0c4790 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009db0 tx=0x7ff0ec00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:27.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.474+0000 7ff0e37fe640 1 -- 172.21.15.132:0/759896705 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec014480 con 0x7ff0fc0cd4b0 2023-12-20T04:43:27.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.474+0000 7ff0e37fe640 1 -- 172.21.15.132:0/759896705 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ec00f040 con 0x7ff0fc0cd4b0 2023-12-20T04:43:27.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.474+0000 7ff101243640 1 -- 172.21.15.132:0/759896705 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0fc0c4fe0 con 0x7ff0fc0cd4b0 2023-12-20T04:43:27.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.474+0000 7ff0e37fe640 1 -- 172.21.15.132:0/759896705 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ec014800 con 0x7ff0fc0cd4b0 2023-12-20T04:43:27.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.474+0000 7ff101243640 1 -- 172.21.15.132:0/759896705 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0fc0c55a0 con 0x7ff0fc0cd4b0 2023-12-20T04:43:27.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.475+0000 7ff101243640 1 -- 172.21.15.132:0/759896705 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0fc04e840 con 0x7ff0fc0cd4b0 2023-12-20T04:43:27.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.475+0000 7ff0e37fe640 1 -- 172.21.15.132:0/759896705 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff0ec014960 con 0x7ff0fc0cd4b0 2023-12-20T04:43:27.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.476+0000 7ff0e37fe640 1 --2- 172.21.15.132:0/759896705 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0e806a430 0x7ff0e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:27.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.476+0000 7ff0e37fe640 1 -- 172.21.15.132:0/759896705 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff0ec089440 con 0x7ff0fc0cd4b0 2023-12-20T04:43:27.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.476+0000 7ff0fa59c640 1 --2- 172.21.15.132:0/759896705 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0e806a430 0x7ff0e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:27.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.476+0000 7ff0fa59c640 1 --2- 172.21.15.132:0/759896705 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0e806a430 0x7ff0e806c8f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0036000 tx=0x7ff0f003b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:27.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.480+0000 7ff0e37fe640 1 -- 172.21.15.132:0/759896705 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff0ec054ac0 con 0x7ff0fc0cd4b0 2023-12-20T04:43:27.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.645+0000 7ff101243640 1 -- 172.21.15.132:0/759896705 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff0fc0b2890 con 0x7ff0fc0cd4b0 2023-12-20T04:43:27.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.645+0000 7ff0e37fe640 1 -- 172.21.15.132:0/759896705 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff0ec0580e0 con 0x7ff0fc0cd4b0 2023-12-20T04:43:27.647 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:43:27.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.647+0000 7ff101243640 1 -- 172.21.15.132:0/759896705 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0e806a430 msgr2=0x7ff0e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.647+0000 7ff101243640 1 --2- 172.21.15.132:0/759896705 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0e806a430 0x7ff0e806c8f0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7ff0f0036000 tx=0x7ff0f003b040 comp rx=0 tx=0).stop 2023-12-20T04:43:27.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.647+0000 7ff101243640 1 -- 172.21.15.132:0/759896705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0fc0cd4b0 msgr2=0x7ff0fc0c4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.647+0000 7ff101243640 1 --2- 172.21.15.132:0/759896705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0fc0cd4b0 0x7ff0fc0c4790 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7ff0ec009db0 tx=0x7ff0ec00c490 comp rx=0 tx=0).stop 2023-12-20T04:43:27.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.647+0000 7ff101243640 1 -- 172.21.15.132:0/759896705 shutdown_connections 2023-12-20T04:43:27.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.647+0000 7ff101243640 1 --2- 172.21.15.132:0/759896705 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0e806a430 0x7ff0e806c8f0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.647+0000 7ff101243640 1 --2- 172.21.15.132:0/759896705 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0fc15d300 0x7ff0fc1f1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.647+0000 7ff101243640 1 --2- 172.21.15.132:0/759896705 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0fc15cf20 0x7ff0fc0b5c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.647+0000 7ff101243640 1 --2- 172.21.15.132:0/759896705 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0fc0cd4b0 0x7ff0fc0c4790 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.647+0000 7ff101243640 1 -- 172.21.15.132:0/759896705 >> 172.21.15.132:0/759896705 conn(0x7ff0fc072c60 msgr2=0x7ff0fc0b1600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:27.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.648+0000 7ff101243640 1 -- 172.21.15.132:0/759896705 shutdown_connections 2023-12-20T04:43:27.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.648+0000 7ff101243640 1 -- 172.21.15.132:0/759896705 wait complete. 2023-12-20T04:43:27.660 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:43:27.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.759+0000 7fcfcc828640 1 Processor -- start 2023-12-20T04:43:27.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.759+0000 7fcfcc828640 1 -- start start 2023-12-20T04:43:27.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.760+0000 7fcfcc828640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcfc815d050 0x7fcfc80c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:27.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.760+0000 7fcfcc828640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc806a340 0x7fcfc80acbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:27.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.760+0000 7fcfcc828640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc80708d0 con 0x7fcfc80c6690 2023-12-20T04:43:27.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.760+0000 7fcfcc828640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc8070bb0 con 0x7fcfc815d050 2023-12-20T04:43:27.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.760+0000 7fcfcc828640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc8070e90 con 0x7fcfc806a340 2023-12-20T04:43:27.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.760+0000 7fcfc5d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcfc80c6690 0x7fcfc8069c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40588/0 (socket says 172.21.15.132:40588) 2023-12-20T04:43:27.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.760+0000 7fcfc5d9b640 1 -- 172.21.15.132:0/2040092912 learned_addr learned my addr 172.21.15.132:0/2040092912 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:27.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.761+0000 7fcfc659c640 1 --2- 172.21.15.132:0/2040092912 >> v2:172.21.15.187:3300/0 conn(0x7fcfc815d050 0x7fcfc80c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:27.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.761+0000 7fcfc6d9d640 1 --2- 172.21.15.132:0/2040092912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc806a340 0x7fcfc80acbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:27.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.761+0000 7fcfc559a640 1 -- 172.21.15.132:0/2040092912 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2076295692 0 0) 0x7fcfc80708d0 con 0x7fcfc80c6690 2023-12-20T04:43:27.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.761+0000 7fcfc559a640 1 -- 172.21.15.132:0/2040092912 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfb4003520 con 0x7fcfc80c6690 2023-12-20T04:43:27.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.761+0000 7fcfc6d9d640 1 -- 172.21.15.132:0/2040092912 >> v2:172.21.15.187:3300/0 conn(0x7fcfc815d050 msgr2=0x7fcfc80c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:27.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.761+0000 7fcfc6d9d640 1 --2- 172.21.15.132:0/2040092912 >> v2:172.21.15.187:3300/0 conn(0x7fcfc815d050 0x7fcfc80c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.761+0000 7fcfc6d9d640 1 -- 172.21.15.132:0/2040092912 >> v1:172.21.15.132:6789/0 conn(0x7fcfc80c6690 legacy=0x7fcfc8069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.761+0000 7fcfc6d9d640 1 -- 172.21.15.132:0/2040092912 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc8071170 con 0x7fcfc806a340 2023-12-20T04:43:27.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.762+0000 7fcfc6d9d640 1 --2- 172.21.15.132:0/2040092912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc806a340 0x7fcfc80acbb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80097a0 tx=0x7fcfb802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=243d934c7c2d6216 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:27.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.762+0000 7fcfc559a640 1 -- 172.21.15.132:0/2040092912 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8031830 con 0x7fcfc806a340 2023-12-20T04:43:27.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.762+0000 7fcfc559a640 1 -- 172.21.15.132:0/2040092912 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb8031990 con 0x7fcfc806a340 2023-12-20T04:43:27.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.762+0000 7fcfc559a640 1 -- 172.21.15.132:0/2040092912 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb8031d00 con 0x7fcfc806a340 2023-12-20T04:43:27.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.762+0000 7fcfcc828640 1 -- 172.21.15.132:0/2040092912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc806a340 msgr2=0x7fcfc80acbb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.762+0000 7fcfcc828640 1 --2- 172.21.15.132:0/2040092912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc806a340 0x7fcfc80acbb0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7fcfb80097a0 tx=0x7fcfb802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.762+0000 7fcfcc828640 1 -- 172.21.15.132:0/2040092912 shutdown_connections 2023-12-20T04:43:27.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.762+0000 7fcfcc828640 1 --2- 172.21.15.132:0/2040092912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc806a340 0x7fcfc80acbb0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.763+0000 7fcfcc828640 1 --2- 172.21.15.132:0/2040092912 >> v2:172.21.15.187:3300/0 conn(0x7fcfc815d050 0x7fcfc80c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.763+0000 7fcfcc828640 1 -- 172.21.15.132:0/2040092912 >> 172.21.15.132:0/2040092912 conn(0x7fcfc80cfb10 msgr2=0x7fcfc80cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:27.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.763+0000 7fcfcc828640 1 -- 172.21.15.132:0/2040092912 shutdown_connections 2023-12-20T04:43:27.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.763+0000 7fcfcc828640 1 -- 172.21.15.132:0/2040092912 wait complete. 2023-12-20T04:43:27.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.764+0000 7fcfcc828640 1 Processor -- start 2023-12-20T04:43:27.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.764+0000 7fcfcc828640 1 -- start start 2023-12-20T04:43:27.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfcc828640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc806a340 0x7fcfc815fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:27.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfcc828640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc80c6690 0x7fcfc80b38e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:27.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfcc828640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc815d050 0x7fcfc8149230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:27.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfcc828640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc80b3450 con 0x7fcfc80c6690 2023-12-20T04:43:27.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfcc828640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc80b2840 con 0x7fcfc815d050 2023-12-20T04:43:27.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfcc828640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc80b2b20 con 0x7fcfc806a340 2023-12-20T04:43:27.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfc5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc80c6690 0x7fcfc80b38e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:27.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfc5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc80c6690 0x7fcfc80b38e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55254/0 (socket says 172.21.15.132:55254) 2023-12-20T04:43:27.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfc5d9b640 1 -- 172.21.15.132:0/3271713567 learned_addr learned my addr 172.21.15.132:0/3271713567 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:27.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfc659c640 1 --2- 172.21.15.132:0/3271713567 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc806a340 0x7fcfc815fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:27.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfc6d9d640 1 --2- 172.21.15.132:0/3271713567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc815d050 0x7fcfc8149230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:27.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfc5d9b640 1 -- 172.21.15.132:0/3271713567 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc806a340 msgr2=0x7fcfc815fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfc5d9b640 1 --2- 172.21.15.132:0/3271713567 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc806a340 0x7fcfc815fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfc5d9b640 1 -- 172.21.15.132:0/3271713567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc815d050 msgr2=0x7fcfc8149230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfc5d9b640 1 --2- 172.21.15.132:0/3271713567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc815d050 0x7fcfc8149230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfc5d9b640 1 -- 172.21.15.132:0/3271713567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb8009400 con 0x7fcfc80c6690 2023-12-20T04:43:27.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfc5d9b640 1 --2- 172.21.15.132:0/3271713567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc80c6690 0x7fcfc80b38e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000c400 tx=0x7fcfb000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:27.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfbeffd640 1 -- 172.21.15.132:0/3271713567 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb0005ce0 con 0x7fcfc80c6690 2023-12-20T04:43:27.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfbeffd640 1 -- 172.21.15.132:0/3271713567 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb0005e60 con 0x7fcfc80c6690 2023-12-20T04:43:27.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfbeffd640 1 -- 172.21.15.132:0/3271713567 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb00072f0 con 0x7fcfc80c6690 2023-12-20T04:43:27.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfcc828640 1 -- 172.21.15.132:0/3271713567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc80b2e00 con 0x7fcfc80c6690 2023-12-20T04:43:27.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.765+0000 7fcfcc828640 1 -- 172.21.15.132:0/3271713567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc8160290 con 0x7fcfc80c6690 2023-12-20T04:43:27.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.766+0000 7fcfcc828640 1 -- 172.21.15.132:0/3271713567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc80b35c0 con 0x7fcfc80c6690 2023-12-20T04:43:27.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.767+0000 7fcfbeffd640 1 -- 172.21.15.132:0/3271713567 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcfb0007450 con 0x7fcfc80c6690 2023-12-20T04:43:27.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.767+0000 7fcfbeffd640 1 --2- 172.21.15.132:0/3271713567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfa806a430 0x7fcfa806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:27.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.767+0000 7fcfbeffd640 1 -- 172.21.15.132:0/3271713567 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfb0087fa0 con 0x7fcfc80c6690 2023-12-20T04:43:27.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.767+0000 7fcfc659c640 1 --2- 172.21.15.132:0/3271713567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfa806a430 0x7fcfa806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:27.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.768+0000 7fcfc659c640 1 --2- 172.21.15.132:0/3271713567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfa806a430 0x7fcfa806c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00074a0 tx=0x7fcfc000b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:27.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.771+0000 7fcfbeffd640 1 -- 172.21.15.132:0/3271713567 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcfb00baca0 con 0x7fcfc80c6690 2023-12-20T04:43:27.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.948+0000 7fcfcc828640 1 -- 172.21.15.132:0/3271713567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcfc804e840 con 0x7fcfc80c6690 2023-12-20T04:43:27.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.949+0000 7fcfbeffd640 1 -- 172.21.15.132:0/3271713567 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcfb0017080 con 0x7fcfc80c6690 2023-12-20T04:43:27.951 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:43:27.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.951+0000 7fcfcc828640 1 -- 172.21.15.132:0/3271713567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfa806a430 msgr2=0x7fcfa806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.951+0000 7fcfcc828640 1 --2- 172.21.15.132:0/3271713567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfa806a430 0x7fcfa806c8f0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcfc00074a0 tx=0x7fcfc000b040 comp rx=0 tx=0).stop 2023-12-20T04:43:27.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.951+0000 7fcfcc828640 1 -- 172.21.15.132:0/3271713567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc80c6690 msgr2=0x7fcfc80b38e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:27.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.951+0000 7fcfcc828640 1 --2- 172.21.15.132:0/3271713567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc80c6690 0x7fcfc80b38e0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fcfb000c400 tx=0x7fcfb000c8c0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.951+0000 7fcfcc828640 1 -- 172.21.15.132:0/3271713567 shutdown_connections 2023-12-20T04:43:27.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.951+0000 7fcfcc828640 1 --2- 172.21.15.132:0/3271713567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfa806a430 0x7fcfa806c8f0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.951+0000 7fcfcc828640 1 --2- 172.21.15.132:0/3271713567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc815d050 0x7fcfc8149230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.951+0000 7fcfcc828640 1 --2- 172.21.15.132:0/3271713567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc80c6690 0x7fcfc80b38e0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.951+0000 7fcfcc828640 1 --2- 172.21.15.132:0/3271713567 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc806a340 0x7fcfc815fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:27.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.951+0000 7fcfcc828640 1 -- 172.21.15.132:0/3271713567 >> 172.21.15.132:0/3271713567 conn(0x7fcfc80cfb10 msgr2=0x7fcfc815c870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:27.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.951+0000 7fcfcc828640 1 -- 172.21.15.132:0/3271713567 shutdown_connections 2023-12-20T04:43:27.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:27.951+0000 7fcfcc828640 1 -- 172.21.15.132:0/3271713567 wait complete. 2023-12-20T04:43:27.963 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2023-12-20T04:43:27.963 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:27.964 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.2 2023-12-20T04:43:27.990 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:43:27.991 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:43:27.991 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:27.991 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-20T04:43:28.046 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:43:28.046 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:43:28.065 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:43:28.065 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:43:28.123 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:28.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.221+0000 7f2988a70640 1 Processor -- start 2023-12-20T04:43:28.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.221+0000 7f2988a70640 1 -- start start 2023-12-20T04:43:28.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.222+0000 7f2988a70640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f298415e2d0 0x7f29840b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.222+0000 7f2988a70640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29840cd740 con 0x7f29840cf0b0 2023-12-20T04:43:28.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.222+0000 7f2988a70640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29840ce230 con 0x7f29840cb420 2023-12-20T04:43:28.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.222+0000 7f2988a70640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29840cd990 con 0x7f298415e2d0 2023-12-20T04:43:28.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.222+0000 7f2982d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f29840cf0b0 0x7f29840d07f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40598/0 (socket says 172.21.15.132:40598) 2023-12-20T04:43:28.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.222+0000 7f2982d9d640 1 -- 172.21.15.132:0/321410889 learned_addr learned my addr 172.21.15.132:0/321410889 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:28.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.222+0000 7f298259c640 1 --2- 172.21.15.132:0/321410889 >> v2:172.21.15.187:3300/0 conn(0x7f298415e2d0 0x7f29840b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.222+0000 7f298159a640 1 -- 172.21.15.132:0/321410889 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 205361950 0 0) 0x7f29840cd740 con 0x7f29840cf0b0 2023-12-20T04:43:28.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.222+0000 7f298159a640 1 -- 172.21.15.132:0/321410889 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f296c003520 con 0x7f29840cf0b0 2023-12-20T04:43:28.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f298159a640 1 -- 172.21.15.132:0/321410889 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3958069693 0 0) 0x7f296c003520 con 0x7f29840cf0b0 2023-12-20T04:43:28.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f298159a640 1 -- 172.21.15.132:0/321410889 >> v2:172.21.15.187:3300/0 conn(0x7f298415e2d0 msgr2=0x7f29840b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:28.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f298159a640 1 --2- 172.21.15.132:0/321410889 >> v2:172.21.15.187:3300/0 conn(0x7f298415e2d0 0x7f29840b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f298159a640 1 -- 172.21.15.132:0/321410889 >> v1:172.21.15.187:6789/0 conn(0x7f29840cb420 legacy=0x7f29840ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:28.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f298159a640 1 -- 172.21.15.132:0/321410889 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29840cdc70 con 0x7f29840cf0b0 2023-12-20T04:43:28.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f298159a640 1 -- 172.21.15.132:0/321410889 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f297c0019f0 con 0x7f29840cf0b0 2023-12-20T04:43:28.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f298159a640 1 -- 172.21.15.132:0/321410889 >> v1:172.21.15.132:6789/0 conn(0x7f29840cf0b0 legacy=0x7f29840d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f298159a640 1 --2- 172.21.15.132:0/321410889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f296c003970 0x7f296c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f298159a640 1 --2- 172.21.15.132:0/321410889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f296c0047c0 0x7f296c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f298159a640 1 --2- 172.21.15.132:0/321410889 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f296c005180 0x7f296c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f298159a640 1 -- 172.21.15.132:0/321410889 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29840cd990 con 0x7f296c0047c0 2023-12-20T04:43:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f298159a640 1 -- 172.21.15.132:0/321410889 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f296c00c120 con 0x7f296c003970 2023-12-20T04:43:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f298159a640 1 -- 172.21.15.132:0/321410889 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f296c00c2e0 con 0x7f296c005180 2023-12-20T04:43:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f2981d9b640 1 --2- 172.21.15.132:0/321410889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f296c0047c0 0x7f296c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f298259c640 1 --2- 172.21.15.132:0/321410889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f296c003970 0x7f296c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f2982d9d640 1 --2- 172.21.15.132:0/321410889 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f296c005180 0x7f296c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f2981d9b640 1 -- 172.21.15.132:0/321410889 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f296c005180 msgr2=0x7f296c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f2981d9b640 1 --2- 172.21.15.132:0/321410889 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f296c005180 0x7f296c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f2981d9b640 1 -- 172.21.15.132:0/321410889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f296c003970 msgr2=0x7f296c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f2981d9b640 1 --2- 172.21.15.132:0/321410889 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f296c003970 0x7f296c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f2981d9b640 1 -- 172.21.15.132:0/321410889 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f296c003520 con 0x7f296c0047c0 2023-12-20T04:43:28.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.223+0000 7f2982d9d640 1 -- 172.21.15.132:0/321410889 reap_dead start 2023-12-20T04:43:28.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.224+0000 7f2981d9b640 1 --2- 172.21.15.132:0/321410889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f296c0047c0 0x7f296c004c40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2978001750 tx=0x7f296c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5392f032598e6f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:28.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.224+0000 7f298159a640 1 -- 172.21.15.132:0/321410889 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29780052d0 con 0x7f296c0047c0 2023-12-20T04:43:28.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.224+0000 7f298159a640 1 -- 172.21.15.132:0/321410889 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f297802e050 con 0x7f296c0047c0 2023-12-20T04:43:28.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.224+0000 7f298159a640 1 -- 172.21.15.132:0/321410889 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2978003830 con 0x7f296c0047c0 2023-12-20T04:43:28.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.225+0000 7f2988a70640 1 -- 172.21.15.132:0/321410889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f296c0047c0 msgr2=0x7f296c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:28.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.225+0000 7f2988a70640 1 --2- 172.21.15.132:0/321410889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f296c0047c0 0x7f296c004c40 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f2978001750 tx=0x7f296c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.225+0000 7f2988a70640 1 -- 172.21.15.132:0/321410889 shutdown_connections 2023-12-20T04:43:28.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.225+0000 7f2988a70640 1 --2- 172.21.15.132:0/321410889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f296c0047c0 0x7f296c004c40 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.225+0000 7f2988a70640 1 -- 172.21.15.132:0/321410889 >> 172.21.15.132:0/321410889 conn(0x7f298406d7c0 msgr2=0x7f298406dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:28.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.225+0000 7f2988a70640 1 -- 172.21.15.132:0/321410889 shutdown_connections 2023-12-20T04:43:28.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.225+0000 7f2988a70640 1 -- 172.21.15.132:0/321410889 wait complete. 2023-12-20T04:43:28.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.226+0000 7f2988a70640 1 Processor -- start 2023-12-20T04:43:28.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.226+0000 7f2988a70640 1 -- start start 2023-12-20T04:43:28.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f2988a70640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f296c0047c0 0x7f29841f1550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f2988a70640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29841f40c0 0x7f29840b5000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f2988a70640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29840b5540 0x7f2984147870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f2988a70640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29841f1a90 con 0x7f296c0047c0 2023-12-20T04:43:28.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f2988a70640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29840b59c0 con 0x7f29841f40c0 2023-12-20T04:43:28.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f2988a70640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2984147390 con 0x7f29840b5540 2023-12-20T04:43:28.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f298259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f296c0047c0 0x7f29841f1550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f298259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f296c0047c0 0x7f29841f1550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55276/0 (socket says 172.21.15.132:55276) 2023-12-20T04:43:28.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f298259c640 1 -- 172.21.15.132:0/3926945337 learned_addr learned my addr 172.21.15.132:0/3926945337 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:28.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f2982d9d640 1 --2- 172.21.15.132:0/3926945337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29840b5540 0x7f2984147870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f2981d9b640 1 --2- 172.21.15.132:0/3926945337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29841f40c0 0x7f29840b5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f298259c640 1 -- 172.21.15.132:0/3926945337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29840b5540 msgr2=0x7f2984147870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f298259c640 1 --2- 172.21.15.132:0/3926945337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29840b5540 0x7f2984147870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f298259c640 1 -- 172.21.15.132:0/3926945337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29841f40c0 msgr2=0x7f29840b5000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f298259c640 1 --2- 172.21.15.132:0/3926945337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29841f40c0 0x7f29840b5000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f298259c640 1 -- 172.21.15.132:0/3926945337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29841f4680 con 0x7f296c0047c0 2023-12-20T04:43:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f298259c640 1 --2- 172.21.15.132:0/3926945337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f296c0047c0 0x7f29841f1550 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2974011890 tx=0x7f2974011d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f2972ffd640 1 -- 172.21.15.132:0/3926945337 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2974004240 con 0x7f296c0047c0 2023-12-20T04:43:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f2972ffd640 1 -- 172.21.15.132:0/3926945337 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29740043a0 con 0x7f296c0047c0 2023-12-20T04:43:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.227+0000 7f2988a70640 1 -- 172.21.15.132:0/3926945337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29841f4960 con 0x7f296c0047c0 2023-12-20T04:43:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.228+0000 7f2972ffd640 1 -- 172.21.15.132:0/3926945337 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f297400fa20 con 0x7f296c0047c0 2023-12-20T04:43:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.228+0000 7f2988a70640 1 -- 172.21.15.132:0/3926945337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29841f4f20 con 0x7f296c0047c0 2023-12-20T04:43:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.228+0000 7f2988a70640 1 -- 172.21.15.132:0/3926945337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f298404e840 con 0x7f296c0047c0 2023-12-20T04:43:28.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.229+0000 7f2972ffd640 1 -- 172.21.15.132:0/3926945337 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f297400fb80 con 0x7f296c0047c0 2023-12-20T04:43:28.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.229+0000 7f2972ffd640 1 --2- 172.21.15.132:0/3926945337 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f296406a430 0x7f296406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.229+0000 7f2972ffd640 1 -- 172.21.15.132:0/3926945337 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2974088ef0 con 0x7f296c0047c0 2023-12-20T04:43:28.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.229+0000 7f2981d9b640 1 --2- 172.21.15.132:0/3926945337 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f296406a430 0x7f296406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.230+0000 7f2981d9b640 1 --2- 172.21.15.132:0/3926945337 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f296406a430 0x7f296406c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2978033000 tx=0x7f2978009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:28.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.234+0000 7f2972ffd640 1 -- 172.21.15.132:0/3926945337 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2974054590 con 0x7f296c0047c0 2023-12-20T04:43:28.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.399+0000 7f2988a70640 1 -- 172.21.15.132:0/3926945337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f29840ce480 con 0x7f296c0047c0 2023-12-20T04:43:28.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.400+0000 7f2972ffd640 1 -- 172.21.15.132:0/3926945337 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f2974019090 con 0x7f296c0047c0 2023-12-20T04:43:28.402 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:28.402 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:28.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.402+0000 7f2988a70640 1 -- 172.21.15.132:0/3926945337 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f296406a430 msgr2=0x7f296406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:28.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.402+0000 7f2988a70640 1 --2- 172.21.15.132:0/3926945337 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f296406a430 0x7f296406c8f0 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f2978033000 tx=0x7f2978009030 comp rx=0 tx=0).stop 2023-12-20T04:43:28.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.402+0000 7f2988a70640 1 -- 172.21.15.132:0/3926945337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f296c0047c0 msgr2=0x7f29841f1550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:28.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.402+0000 7f2988a70640 1 --2- 172.21.15.132:0/3926945337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f296c0047c0 0x7f29841f1550 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f2974011890 tx=0x7f2974011d50 comp rx=0 tx=0).stop 2023-12-20T04:43:28.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.402+0000 7f2988a70640 1 -- 172.21.15.132:0/3926945337 shutdown_connections 2023-12-20T04:43:28.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.402+0000 7f2988a70640 1 --2- 172.21.15.132:0/3926945337 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f296406a430 0x7f296406c8f0 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.402+0000 7f2988a70640 1 --2- 172.21.15.132:0/3926945337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29840b5540 0x7f2984147870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.402+0000 7f2988a70640 1 --2- 172.21.15.132:0/3926945337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29841f40c0 0x7f29840b5000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.402+0000 7f2988a70640 1 --2- 172.21.15.132:0/3926945337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f296c0047c0 0x7f29841f1550 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.402+0000 7f2988a70640 1 -- 172.21.15.132:0/3926945337 >> 172.21.15.132:0/3926945337 conn(0x7f298406d7c0 msgr2=0x7f298415bef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:28.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.402+0000 7f2988a70640 1 -- 172.21.15.132:0/3926945337 shutdown_connections 2023-12-20T04:43:28.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.402+0000 7f2988a70640 1 -- 172.21.15.132:0/3926945337 wait complete. 2023-12-20T04:43:28.416 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:42:45.433456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:42:46.128920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:43:28.416 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:43:28.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.520+0000 7f3eba5b9640 1 Processor -- start 2023-12-20T04:43:28.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.520+0000 7f3eba5b9640 1 -- start start 2023-12-20T04:43:28.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.521+0000 7f3eba5b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb40cf790 0x7f3eb40cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.521+0000 7f3eba5b9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3eb40b6080 0x7f3eb40b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.521+0000 7f3eba5b9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb40d0150 con 0x7f3eb415d300 2023-12-20T04:43:28.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.521+0000 7f3eba5b9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3eb40d2920 con 0x7f3eb40b6080 2023-12-20T04:43:28.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.521+0000 7f3eba5b9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40d1d10 con 0x7f3eb40cf790 2023-12-20T04:43:28.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.521+0000 7f3eb8b56640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3eb40b6080 0x7f3eb40b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.521+0000 7f3eb37fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb40cf790 0x7f3eb40cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.521+0000 7f3eb3fff640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f3eb415d300 0x7f3eb40d1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:36596/0 (socket says 172.21.15.132:36596) 2023-12-20T04:43:28.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.521+0000 7f3eb3fff640 1 -- 172.21.15.132:0/3719022689 learned_addr learned my addr 172.21.15.132:0/3719022689 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:28.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.522+0000 7f3eb8b56640 1 -- 172.21.15.132:0/3719022689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb40cf790 msgr2=0x7f3eb40cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:28.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.522+0000 7f3eb8b56640 1 --2- 172.21.15.132:0/3719022689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb40cf790 0x7f3eb40cfc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.522+0000 7f3eb8b56640 1 -- 172.21.15.132:0/3719022689 >> v1:172.21.15.187:6789/0 conn(0x7f3eb415d300 legacy=0x7f3eb40d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:28.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.522+0000 7f3eb8b56640 1 -- 172.21.15.132:0/3719022689 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb40d1ff0 con 0x7f3eb40b6080 2023-12-20T04:43:28.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.522+0000 7f3eb8b56640 1 --2- 172.21.15.132:0/3719022689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3eb40b6080 0x7f3eb40b64d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009d90 tx=0x7f3eac02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=66f5694a57d2ff3e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:28.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.523+0000 7f3eb2ffd640 1 -- 172.21.15.132:0/3719022689 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac02cc50 con 0x7f3eb40b6080 2023-12-20T04:43:28.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.523+0000 7f3eb2ffd640 1 -- 172.21.15.132:0/3719022689 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eac02cdb0 con 0x7f3eb40b6080 2023-12-20T04:43:28.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.523+0000 7f3eb2ffd640 1 -- 172.21.15.132:0/3719022689 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eac034660 con 0x7f3eb40b6080 2023-12-20T04:43:28.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.523+0000 7f3eba5b9640 1 -- 172.21.15.132:0/3719022689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3eb40b6080 msgr2=0x7f3eb40b64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:28.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.523+0000 7f3eba5b9640 1 --2- 172.21.15.132:0/3719022689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3eb40b6080 0x7f3eb40b64d0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f3eac009d90 tx=0x7f3eac02bea0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.523+0000 7f3eba5b9640 1 -- 172.21.15.132:0/3719022689 shutdown_connections 2023-12-20T04:43:28.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.523+0000 7f3eba5b9640 1 --2- 172.21.15.132:0/3719022689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3eb40b6080 0x7f3eb40b64d0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.523+0000 7f3eba5b9640 1 --2- 172.21.15.132:0/3719022689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb40cf790 0x7f3eb40cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.523+0000 7f3eba5b9640 1 -- 172.21.15.132:0/3719022689 >> 172.21.15.132:0/3719022689 conn(0x7f3eb406a3d0 msgr2=0x7f3eb406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:28.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.523+0000 7f3eba5b9640 1 -- 172.21.15.132:0/3719022689 shutdown_connections 2023-12-20T04:43:28.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.523+0000 7f3eba5b9640 1 -- 172.21.15.132:0/3719022689 wait complete. 2023-12-20T04:43:28.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.524+0000 7f3eba5b9640 1 Processor -- start 2023-12-20T04:43:28.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.525+0000 7f3eba5b9640 1 -- start start 2023-12-20T04:43:28.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.525+0000 7f3eba5b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb40b6080 0x7f3eb41f5a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.525+0000 7f3eba5b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb40cf790 0x7f3eb4154900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.525+0000 7f3eba5b9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3eb415d300 0x7f3eb40b3b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.525+0000 7f3eba5b9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40ca0e0 con 0x7f3eb40b6080 2023-12-20T04:43:28.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.525+0000 7f3eba5b9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40ca3c0 con 0x7f3eb415d300 2023-12-20T04:43:28.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.525+0000 7f3eba5b9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb40ca6a0 con 0x7f3eb40cf790 2023-12-20T04:43:28.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.525+0000 7f3eb3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb40b6080 0x7f3eb41f5a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.525+0000 7f3eb3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb40b6080 0x7f3eb41f5a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55290/0 (socket says 172.21.15.132:55290) 2023-12-20T04:43:28.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.525+0000 7f3eb3fff640 1 -- 172.21.15.132:0/1896757635 learned_addr learned my addr 172.21.15.132:0/1896757635 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:28.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.526+0000 7f3eb8b56640 1 --2- 172.21.15.132:0/1896757635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3eb415d300 0x7f3eb40b3b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.526+0000 7f3eb37fe640 1 --2- 172.21.15.132:0/1896757635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb40cf790 0x7f3eb4154900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.526+0000 7f3eb3fff640 1 -- 172.21.15.132:0/1896757635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb40cf790 msgr2=0x7f3eb4154900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:28.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.526+0000 7f3eb3fff640 1 --2- 172.21.15.132:0/1896757635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb40cf790 0x7f3eb4154900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.526+0000 7f3eb3fff640 1 -- 172.21.15.132:0/1896757635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3eb415d300 msgr2=0x7f3eb40b3b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:28.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.526+0000 7f3eb3fff640 1 --2- 172.21.15.132:0/1896757635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3eb415d300 0x7f3eb40b3b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.526+0000 7f3eb3fff640 1 -- 172.21.15.132:0/1896757635 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eac009a70 con 0x7f3eb40b6080 2023-12-20T04:43:28.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.526+0000 7f3eb8b56640 1 --2- 172.21.15.132:0/1896757635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3eb415d300 0x7f3eb40b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:28.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.526+0000 7f3eb37fe640 1 --2- 172.21.15.132:0/1896757635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb40cf790 0x7f3eb4154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:28.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.526+0000 7f3eb3fff640 1 --2- 172.21.15.132:0/1896757635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb40b6080 0x7f3eb41f5a10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800c480 tx=0x7f3ea800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:28.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.526+0000 7f3eb0ff9640 1 -- 172.21.15.132:0/1896757635 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8005ce0 con 0x7f3eb40b6080 2023-12-20T04:43:28.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.526+0000 7f3eb0ff9640 1 -- 172.21.15.132:0/1896757635 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ea8005e40 con 0x7f3eb40b6080 2023-12-20T04:43:28.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.526+0000 7f3eba5b9640 1 -- 172.21.15.132:0/1896757635 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb40ca980 con 0x7f3eb40b6080 2023-12-20T04:43:28.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.526+0000 7f3eb0ff9640 1 -- 172.21.15.132:0/1896757635 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea80072f0 con 0x7f3eb40b6080 2023-12-20T04:43:28.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.526+0000 7f3eba5b9640 1 -- 172.21.15.132:0/1896757635 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb4155d50 con 0x7f3eb40b6080 2023-12-20T04:43:28.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.527+0000 7f3eba5b9640 1 -- 172.21.15.132:0/1896757635 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb40caea0 con 0x7f3eb40b6080 2023-12-20T04:43:28.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.528+0000 7f3eb0ff9640 1 -- 172.21.15.132:0/1896757635 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3ea8007510 con 0x7f3eb40b6080 2023-12-20T04:43:28.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.528+0000 7f3eb0ff9640 1 --2- 172.21.15.132:0/1896757635 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ea006a430 0x7f3ea006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.528+0000 7f3eb0ff9640 1 -- 172.21.15.132:0/1896757635 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ea8087dc0 con 0x7f3eb40b6080 2023-12-20T04:43:28.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.528+0000 7f3eb37fe640 1 --2- 172.21.15.132:0/1896757635 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ea006a430 0x7f3ea006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.528+0000 7f3eb37fe640 1 --2- 172.21.15.132:0/1896757635 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ea006a430 0x7f3ea006c8f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40b4890 tx=0x7f3ea4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:28.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.536+0000 7f3eb0ff9640 1 -- 172.21.15.132:0/1896757635 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3eb40caea0 con 0x7f3eb40b6080 2023-12-20T04:43:28.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.708+0000 7f3eba5b9640 1 -- 172.21.15.132:0/1896757635 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3eb40caea0 con 0x7f3eb40b6080 2023-12-20T04:43:28.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.708+0000 7f3eb0ff9640 1 -- 172.21.15.132:0/1896757635 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3ea8017020 con 0x7f3eb40b6080 2023-12-20T04:43:28.710 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:43:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.710+0000 7f3eba5b9640 1 -- 172.21.15.132:0/1896757635 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ea006a430 msgr2=0x7f3ea006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.710+0000 7f3eba5b9640 1 --2- 172.21.15.132:0/1896757635 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ea006a430 0x7f3ea006c8f0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f3eb40b4890 tx=0x7f3ea4008040 comp rx=0 tx=0).stop 2023-12-20T04:43:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.710+0000 7f3eba5b9640 1 -- 172.21.15.132:0/1896757635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb40b6080 msgr2=0x7f3eb41f5a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.710+0000 7f3eba5b9640 1 --2- 172.21.15.132:0/1896757635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb40b6080 0x7f3eb41f5a10 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f3ea800c480 tx=0x7f3ea800c940 comp rx=0 tx=0).stop 2023-12-20T04:43:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.710+0000 7f3eba5b9640 1 -- 172.21.15.132:0/1896757635 shutdown_connections 2023-12-20T04:43:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.710+0000 7f3eba5b9640 1 --2- 172.21.15.132:0/1896757635 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ea006a430 0x7f3ea006c8f0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.710+0000 7f3eba5b9640 1 --2- 172.21.15.132:0/1896757635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3eb415d300 0x7f3eb40b3b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.710+0000 7f3eba5b9640 1 --2- 172.21.15.132:0/1896757635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb40cf790 0x7f3eb4154900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.710+0000 7f3eba5b9640 1 --2- 172.21.15.132:0/1896757635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb40b6080 0x7f3eb41f5a10 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.710+0000 7f3eba5b9640 1 -- 172.21.15.132:0/1896757635 >> 172.21.15.132:0/1896757635 conn(0x7f3eb406a3d0 msgr2=0x7f3eb40d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:28.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.710+0000 7f3eba5b9640 1 -- 172.21.15.132:0/1896757635 shutdown_connections 2023-12-20T04:43:28.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.710+0000 7f3eba5b9640 1 -- 172.21.15.132:0/1896757635 wait complete. 2023-12-20T04:43:28.723 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:43:28.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.827+0000 7f700d07a640 1 Processor -- start 2023-12-20T04:43:28.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.827+0000 7f700d07a640 1 -- start start 2023-12-20T04:43:28.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.828+0000 7f700d07a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f70080cf1d0 0x7f700815e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.828+0000 7f700d07a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f70080ce7e0 0x7f70080708c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.828+0000 7f700d07a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7008070e00 con 0x7f7008070460 2023-12-20T04:43:28.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.828+0000 7f700d07a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f700815e740 con 0x7f70080ce7e0 2023-12-20T04:43:28.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.828+0000 7f700d07a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f70080cb6b0 con 0x7f70080cf1d0 2023-12-20T04:43:28.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.828+0000 7f700759e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f70080ce7e0 0x7f70080708c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.828+0000 7f6ffffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7008070460 0x7f70080c4a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40604/0 (socket says 172.21.15.132:40604) 2023-12-20T04:43:28.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.828+0000 7f6ffffff640 1 -- 172.21.15.132:0/791224526 learned_addr learned my addr 172.21.15.132:0/791224526 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:28.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.828+0000 7f7006d9d640 1 --2- 172.21.15.132:0/791224526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f70080cf1d0 0x7f700815e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.828+0000 7f700759e640 1 -- 172.21.15.132:0/791224526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f70080cf1d0 msgr2=0x7f700815e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:28.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.828+0000 7f700759e640 1 --2- 172.21.15.132:0/791224526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f70080cf1d0 0x7f700815e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.828+0000 7f700759e640 1 -- 172.21.15.132:0/791224526 >> v1:172.21.15.132:6789/0 conn(0x7f7008070460 legacy=0x7f70080c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:28.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.828+0000 7f700759e640 1 -- 172.21.15.132:0/791224526 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70080cb990 con 0x7f70080ce7e0 2023-12-20T04:43:28.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.828+0000 7f7006d9d640 1 --2- 172.21.15.132:0/791224526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f70080cf1d0 0x7f700815e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:28.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.829+0000 7f700759e640 1 --2- 172.21.15.132:0/791224526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70080ce7e0 0x7f70080708c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7000009d90 tx=0x7f700002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a42a2f640a74947d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:28.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.829+0000 7f700659c640 1 -- 172.21.15.132:0/791224526 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f700002cc50 con 0x7f70080ce7e0 2023-12-20T04:43:28.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.829+0000 7f700659c640 1 -- 172.21.15.132:0/791224526 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f700002cdb0 con 0x7f70080ce7e0 2023-12-20T04:43:28.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.829+0000 7f700659c640 1 -- 172.21.15.132:0/791224526 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000034660 con 0x7f70080ce7e0 2023-12-20T04:43:28.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.830+0000 7f700d07a640 1 -- 172.21.15.132:0/791224526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70080ce7e0 msgr2=0x7f70080708c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:28.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.830+0000 7f700d07a640 1 --2- 172.21.15.132:0/791224526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70080ce7e0 0x7f70080708c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f7000009d90 tx=0x7f700002bea0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.830+0000 7f700d07a640 1 -- 172.21.15.132:0/791224526 shutdown_connections 2023-12-20T04:43:28.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.830+0000 7f700d07a640 1 --2- 172.21.15.132:0/791224526 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70080ce7e0 0x7f70080708c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.830+0000 7f700d07a640 1 --2- 172.21.15.132:0/791224526 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f70080cf1d0 0x7f700815e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.830+0000 7f700d07a640 1 -- 172.21.15.132:0/791224526 >> 172.21.15.132:0/791224526 conn(0x7f70080cc630 msgr2=0x7f70080cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:28.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.830+0000 7f700d07a640 1 -- 172.21.15.132:0/791224526 shutdown_connections 2023-12-20T04:43:28.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.830+0000 7f700d07a640 1 -- 172.21.15.132:0/791224526 wait complete. 2023-12-20T04:43:28.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.831+0000 7f700d07a640 1 Processor -- start 2023-12-20T04:43:28.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.831+0000 7f700d07a640 1 -- start start 2023-12-20T04:43:28.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.832+0000 7f700d07a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7008070460 0x7f700815caa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.832+0000 7f700d07a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70080ce7e0 0x7f7008159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.832+0000 7f700d07a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70080cf1d0 0x7f7008069f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.832+0000 7f700d07a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700815b7d0 con 0x7f70080cf1d0 2023-12-20T04:43:28.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.832+0000 7f700d07a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f700815bab0 con 0x7f70080ce7e0 2023-12-20T04:43:28.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.832+0000 7f700d07a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f700815bd90 con 0x7f7008070460 2023-12-20T04:43:28.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.832+0000 7f700759e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70080cf1d0 0x7f7008069f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.832+0000 7f700759e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70080cf1d0 0x7f7008069f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55304/0 (socket says 172.21.15.132:55304) 2023-12-20T04:43:28.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.832+0000 7f700759e640 1 -- 172.21.15.132:0/1488570468 learned_addr learned my addr 172.21.15.132:0/1488570468 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:28.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.832+0000 7f6ffffff640 1 --2- 172.21.15.132:0/1488570468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70080ce7e0 0x7f7008159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.832+0000 7f7006d9d640 1 --2- 172.21.15.132:0/1488570468 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7008070460 0x7f700815caa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.832+0000 7f700759e640 1 -- 172.21.15.132:0/1488570468 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7008070460 msgr2=0x7f700815caa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:28.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.832+0000 7f700759e640 1 --2- 172.21.15.132:0/1488570468 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7008070460 0x7f700815caa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.832+0000 7f700759e640 1 -- 172.21.15.132:0/1488570468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70080ce7e0 msgr2=0x7f7008159620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:28.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.832+0000 7f700759e640 1 --2- 172.21.15.132:0/1488570468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70080ce7e0 0x7f7008159620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:28.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.832+0000 7f700759e640 1 -- 172.21.15.132:0/1488570468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7000009a70 con 0x7f70080cf1d0 2023-12-20T04:43:28.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.833+0000 7f700759e640 1 --2- 172.21.15.132:0/1488570468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70080cf1d0 0x7f7008069f30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7000009d90 tx=0x7f7000004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:28.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.833+0000 7f6fff7fe640 1 -- 172.21.15.132:0/1488570468 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000040650 con 0x7f70080cf1d0 2023-12-20T04:43:28.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.833+0000 7f6fff7fe640 1 -- 172.21.15.132:0/1488570468 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f70000407d0 con 0x7f70080cf1d0 2023-12-20T04:43:28.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.833+0000 7f6fff7fe640 1 -- 172.21.15.132:0/1488570468 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7000040b80 con 0x7f70080cf1d0 2023-12-20T04:43:28.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.833+0000 7f700d07a640 1 -- 172.21.15.132:0/1488570468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f700815c070 con 0x7f70080cf1d0 2023-12-20T04:43:28.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.833+0000 7f700d07a640 1 -- 172.21.15.132:0/1488570468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70080c7670 con 0x7f70080cf1d0 2023-12-20T04:43:28.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.834+0000 7f700d07a640 1 -- 172.21.15.132:0/1488570468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f700815c260 con 0x7f70080cf1d0 2023-12-20T04:43:28.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.834+0000 7f6fff7fe640 1 -- 172.21.15.132:0/1488570468 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7000040ce0 con 0x7f70080cf1d0 2023-12-20T04:43:28.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.835+0000 7f6fff7fe640 1 --2- 172.21.15.132:0/1488570468 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fe806a430 0x7f6fe806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:28.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.835+0000 7f6fff7fe640 1 -- 172.21.15.132:0/1488570468 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f70000ab640 con 0x7f70080cf1d0 2023-12-20T04:43:28.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.835+0000 7f7006d9d640 1 --2- 172.21.15.132:0/1488570468 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fe806a430 0x7f6fe806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:28.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.835+0000 7f7006d9d640 1 --2- 172.21.15.132:0/1488570468 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fe806a430 0x7f6fe806c8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800aac0 tx=0x7f6ff8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:28.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:28.839+0000 7f6fff7fe640 1 -- 172.21.15.132:0/1488570468 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7000076cc0 con 0x7f70080cf1d0 2023-12-20T04:43:29.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.133+0000 7f700d07a640 1 -- 172.21.15.132:0/1488570468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f700804e840 con 0x7f70080cf1d0 2023-12-20T04:43:29.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.133+0000 7f6fff7fe640 1 -- 172.21.15.132:0/1488570468 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7f700007a2e0 con 0x7f70080cf1d0 2023-12-20T04:43:29.135 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:43:29.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.136+0000 7f700d07a640 1 -- 172.21.15.132:0/1488570468 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fe806a430 msgr2=0x7f6fe806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.136+0000 7f700d07a640 1 --2- 172.21.15.132:0/1488570468 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fe806a430 0x7f6fe806c8f0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f6ff800aac0 tx=0x7f6ff8008040 comp rx=0 tx=0).stop 2023-12-20T04:43:29.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.136+0000 7f700d07a640 1 -- 172.21.15.132:0/1488570468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70080cf1d0 msgr2=0x7f7008069f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.136+0000 7f700d07a640 1 --2- 172.21.15.132:0/1488570468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70080cf1d0 0x7f7008069f30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7000009d90 tx=0x7f7000004a40 comp rx=0 tx=0).stop 2023-12-20T04:43:29.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.136+0000 7f700d07a640 1 -- 172.21.15.132:0/1488570468 shutdown_connections 2023-12-20T04:43:29.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.136+0000 7f700d07a640 1 --2- 172.21.15.132:0/1488570468 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6fe806a430 0x7f6fe806c8f0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.136+0000 7f700d07a640 1 --2- 172.21.15.132:0/1488570468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f70080cf1d0 0x7f7008069f30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.136+0000 7f700d07a640 1 --2- 172.21.15.132:0/1488570468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f70080ce7e0 0x7f7008159620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.136+0000 7f700d07a640 1 --2- 172.21.15.132:0/1488570468 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7008070460 0x7f700815caa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.136+0000 7f700d07a640 1 -- 172.21.15.132:0/1488570468 >> 172.21.15.132:0/1488570468 conn(0x7f70080cc630 msgr2=0x7f700806c710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:29.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.136+0000 7f700d07a640 1 -- 172.21.15.132:0/1488570468 shutdown_connections 2023-12-20T04:43:29.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.136+0000 7f700d07a640 1 -- 172.21.15.132:0/1488570468 wait complete. 2023-12-20T04:43:29.149 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:43:29.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.250+0000 7f9f0a412640 1 Processor -- start 2023-12-20T04:43:29.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.251+0000 7f9f0a412640 1 -- start start 2023-12-20T04:43:29.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.251+0000 7f9f0a412640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9f04069c30 0x7f9f04070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:29.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.251+0000 7f9f0a412640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f040c4f40 con 0x7f9f040cbde0 2023-12-20T04:43:29.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.251+0000 7f9f0a412640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9f040af5b0 con 0x7f9f0415d360 2023-12-20T04:43:29.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.251+0000 7f9f0a412640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9f04070a40 con 0x7f9f04069c30 2023-12-20T04:43:29.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.252+0000 7f9f089af640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9f040cbde0 0x7f9f040ca170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40612/0 (socket says 172.21.15.132:40612) 2023-12-20T04:43:29.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.252+0000 7f9f089af640 1 -- 172.21.15.132:0/3994684055 learned_addr learned my addr 172.21.15.132:0/3994684055 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:29.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.252+0000 7f9f03fff640 1 --2- 172.21.15.132:0/3994684055 >> v2:172.21.15.187:3300/0 conn(0x7f9f04069c30 0x7f9f04070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:29.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.252+0000 7f9f02ffd640 1 -- 172.21.15.132:0/3994684055 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 95637751 0 0) 0x7f9f040c4f40 con 0x7f9f040cbde0 2023-12-20T04:43:29.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.252+0000 7f9f02ffd640 1 -- 172.21.15.132:0/3994684055 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9eec003520 con 0x7f9f040cbde0 2023-12-20T04:43:29.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.252+0000 7f9f02ffd640 1 -- 172.21.15.132:0/3994684055 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3136441035 0 0) 0x7f9eec003520 con 0x7f9f040cbde0 2023-12-20T04:43:29.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.252+0000 7f9f03fff640 1 -- 172.21.15.132:0/3994684055 >> v1:172.21.15.187:6789/0 conn(0x7f9f0415d360 legacy=0x7f9f0406a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.252+0000 7f9f03fff640 1 -- 172.21.15.132:0/3994684055 >> v1:172.21.15.132:6789/0 conn(0x7f9f040cbde0 legacy=0x7f9f040ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.252+0000 7f9f03fff640 1 -- 172.21.15.132:0/3994684055 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9f04070d20 con 0x7f9f04069c30 2023-12-20T04:43:29.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.253+0000 7f9f03fff640 1 --2- 172.21.15.132:0/3994684055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f04069c30 0x7f9f04070460 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40097a0 tx=0x7f9ef402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7f8df45d0316469d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:29.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.253+0000 7f9f02ffd640 1 -- 172.21.15.132:0/3994684055 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ef402f050 con 0x7f9f04069c30 2023-12-20T04:43:29.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.253+0000 7f9f02ffd640 1 -- 172.21.15.132:0/3994684055 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ef4031500 con 0x7f9f04069c30 2023-12-20T04:43:29.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.253+0000 7f9f02ffd640 1 -- 172.21.15.132:0/3994684055 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc0019f0 con 0x7f9f04069c30 2023-12-20T04:43:29.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.254+0000 7f9f0a412640 1 -- 172.21.15.132:0/3994684055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f04069c30 msgr2=0x7f9f04070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.254+0000 7f9f0a412640 1 --2- 172.21.15.132:0/3994684055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f04069c30 0x7f9f04070460 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f9ef40097a0 tx=0x7f9ef402b820 comp rx=0 tx=0).stop 2023-12-20T04:43:29.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.254+0000 7f9f0a412640 1 -- 172.21.15.132:0/3994684055 shutdown_connections 2023-12-20T04:43:29.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.254+0000 7f9f0a412640 1 --2- 172.21.15.132:0/3994684055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f04069c30 0x7f9f04070460 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.254+0000 7f9f0a412640 1 -- 172.21.15.132:0/3994684055 >> 172.21.15.132:0/3994684055 conn(0x7f9f040cc630 msgr2=0x7f9f040cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:29.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.254+0000 7f9f0a412640 1 -- 172.21.15.132:0/3994684055 shutdown_connections 2023-12-20T04:43:29.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.254+0000 7f9f0a412640 1 -- 172.21.15.132:0/3994684055 wait complete. 2023-12-20T04:43:29.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.255+0000 7f9f0a412640 1 Processor -- start 2023-12-20T04:43:29.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.255+0000 7f9f0a412640 1 -- start start 2023-12-20T04:43:29.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.256+0000 7f9f0a412640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f04069c30 0x7f9f0414d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:29.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.256+0000 7f9f0a412640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f040cbde0 0x7f9f040b5510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:29.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.256+0000 7f9f0a412640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f0415d360 0x7f9f040b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:29.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.256+0000 7f9f0a412640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040b3200 con 0x7f9f0415d360 2023-12-20T04:43:29.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.256+0000 7f9f0a412640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040b3d80 con 0x7f9f04069c30 2023-12-20T04:43:29.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.256+0000 7f9f0a412640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9f040b3450 con 0x7f9f040cbde0 2023-12-20T04:43:29.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.256+0000 7f9f089af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f0415d360 0x7f9f040b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:29.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.256+0000 7f9f089af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f0415d360 0x7f9f040b28f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55308/0 (socket says 172.21.15.132:55308) 2023-12-20T04:43:29.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.256+0000 7f9f089af640 1 -- 172.21.15.132:0/980008972 learned_addr learned my addr 172.21.15.132:0/980008972 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:29.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.256+0000 7f9f03fff640 1 --2- 172.21.15.132:0/980008972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f04069c30 0x7f9f0414d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:29.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.256+0000 7f9f037fe640 1 --2- 172.21.15.132:0/980008972 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f040cbde0 0x7f9f040b5510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:29.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.256+0000 7f9f089af640 1 -- 172.21.15.132:0/980008972 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f040cbde0 msgr2=0x7f9f040b5510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.256+0000 7f9f089af640 1 --2- 172.21.15.132:0/980008972 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f040cbde0 0x7f9f040b5510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.256+0000 7f9f089af640 1 -- 172.21.15.132:0/980008972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f04069c30 msgr2=0x7f9f0414d0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.256+0000 7f9f089af640 1 --2- 172.21.15.132:0/980008972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f04069c30 0x7f9f0414d0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.256+0000 7f9f089af640 1 -- 172.21.15.132:0/980008972 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ef4009400 con 0x7f9f0415d360 2023-12-20T04:43:29.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.256+0000 7f9f089af640 1 --2- 172.21.15.132:0/980008972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f0415d360 0x7f9f040b28f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9efc001830 tx=0x7f9efc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:29.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.257+0000 7f9f00ff9640 1 -- 172.21.15.132:0/980008972 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc012400 con 0x7f9f0415d360 2023-12-20T04:43:29.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.257+0000 7f9f00ff9640 1 -- 172.21.15.132:0/980008972 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9efc012560 con 0x7f9f0415d360 2023-12-20T04:43:29.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.257+0000 7f9f00ff9640 1 -- 172.21.15.132:0/980008972 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9efc012910 con 0x7f9f0415d360 2023-12-20T04:43:29.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.257+0000 7f9f0a412640 1 -- 172.21.15.132:0/980008972 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9f040b3730 con 0x7f9f0415d360 2023-12-20T04:43:29.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.257+0000 7f9f0a412640 1 -- 172.21.15.132:0/980008972 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9f0414c730 con 0x7f9f0415d360 2023-12-20T04:43:29.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.258+0000 7f9f0a412640 1 -- 172.21.15.132:0/980008972 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9f0404e840 con 0x7f9f0415d360 2023-12-20T04:43:29.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.258+0000 7f9f00ff9640 1 -- 172.21.15.132:0/980008972 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9efc012a70 con 0x7f9f0415d360 2023-12-20T04:43:29.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.258+0000 7f9f00ff9640 1 --2- 172.21.15.132:0/980008972 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9ef006a430 0x7f9ef006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:29.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.259+0000 7f9f00ff9640 1 -- 172.21.15.132:0/980008972 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9efc0890d0 con 0x7f9f0415d360 2023-12-20T04:43:29.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.259+0000 7f9f03fff640 1 --2- 172.21.15.132:0/980008972 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9ef006a430 0x7f9ef006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:29.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.259+0000 7f9f03fff640 1 --2- 172.21.15.132:0/980008972 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9ef006a430 0x7f9ef006c8f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4035000 tx=0x7f9ef4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:29.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.263+0000 7f9f00ff9640 1 -- 172.21.15.132:0/980008972 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9efc0546c0 con 0x7f9f0415d360 2023-12-20T04:43:29.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.434+0000 7f9f0a412640 1 -- 172.21.15.132:0/980008972 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f9f0406a9a0 con 0x7f9f0415d360 2023-12-20T04:43:29.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.435+0000 7f9f00ff9640 1 -- 172.21.15.132:0/980008972 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f9efc057ce0 con 0x7f9f0415d360 2023-12-20T04:43:29.437 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:43:29.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.436+0000 7f9f0a412640 1 -- 172.21.15.132:0/980008972 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9ef006a430 msgr2=0x7f9ef006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.436+0000 7f9f0a412640 1 --2- 172.21.15.132:0/980008972 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9ef006a430 0x7f9ef006c8f0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9ef4035000 tx=0x7f9ef4008030 comp rx=0 tx=0).stop 2023-12-20T04:43:29.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.436+0000 7f9f0a412640 1 -- 172.21.15.132:0/980008972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f0415d360 msgr2=0x7f9f040b28f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.436+0000 7f9f0a412640 1 --2- 172.21.15.132:0/980008972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f0415d360 0x7f9f040b28f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f9efc001830 tx=0x7f9efc00a430 comp rx=0 tx=0).stop 2023-12-20T04:43:29.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.437+0000 7f9f0a412640 1 -- 172.21.15.132:0/980008972 shutdown_connections 2023-12-20T04:43:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.437+0000 7f9f0a412640 1 --2- 172.21.15.132:0/980008972 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9ef006a430 0x7f9ef006c8f0 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.437+0000 7f9f0a412640 1 --2- 172.21.15.132:0/980008972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9f0415d360 0x7f9f040b28f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.437+0000 7f9f0a412640 1 --2- 172.21.15.132:0/980008972 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9f040cbde0 0x7f9f040b5510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.437+0000 7f9f0a412640 1 --2- 172.21.15.132:0/980008972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9f04069c30 0x7f9f0414d0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.437+0000 7f9f0a412640 1 -- 172.21.15.132:0/980008972 >> 172.21.15.132:0/980008972 conn(0x7f9f040cc630 msgr2=0x7f9f040ace90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.437+0000 7f9f0a412640 1 -- 172.21.15.132:0/980008972 shutdown_connections 2023-12-20T04:43:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.437+0000 7f9f0a412640 1 -- 172.21.15.132:0/980008972 wait complete. 2023-12-20T04:43:29.449 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:43:29.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.550+0000 7f5caa388640 1 Processor -- start 2023-12-20T04:43:29.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.550+0000 7f5caa388640 1 -- start start 2023-12-20T04:43:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.551+0000 7f5caa388640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5ca415d050 0x7f5ca40c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.551+0000 7f5caa388640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5ca40c6690 0x7f5ca4069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.551+0000 7f5caa388640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5ca406a5a0 con 0x7f5ca406a170 2023-12-20T04:43:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.551+0000 7f5caa388640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca40708d0 con 0x7f5ca40c6690 2023-12-20T04:43:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.551+0000 7f5caa388640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5ca4070bb0 con 0x7f5ca415d050 2023-12-20T04:43:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.551+0000 7f5ca37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5ca40c6690 0x7f5ca4069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.551+0000 7f5ca8925640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5ca406a170 0x7f5ca40c4ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40618/0 (socket says 172.21.15.132:40618) 2023-12-20T04:43:29.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.551+0000 7f5ca8925640 1 -- 172.21.15.132:0/961681061 learned_addr learned my addr 172.21.15.132:0/961681061 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:29.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.551+0000 7f5ca3fff640 1 --2- 172.21.15.132:0/961681061 >> v2:172.21.15.187:3300/0 conn(0x7f5ca415d050 0x7f5ca40c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:29.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.551+0000 7f5ca37fe640 1 -- 172.21.15.132:0/961681061 >> v2:172.21.15.187:3300/0 conn(0x7f5ca415d050 msgr2=0x7f5ca40c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:29.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.551+0000 7f5ca37fe640 1 --2- 172.21.15.132:0/961681061 >> v2:172.21.15.187:3300/0 conn(0x7f5ca415d050 0x7f5ca40c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.551+0000 7f5ca37fe640 1 -- 172.21.15.132:0/961681061 >> v1:172.21.15.132:6789/0 conn(0x7f5ca406a170 legacy=0x7f5ca40c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.551+0000 7f5ca37fe640 1 -- 172.21.15.132:0/961681061 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ca4070e90 con 0x7f5ca40c6690 2023-12-20T04:43:29.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.551+0000 7f5ca2ffd640 1 -- 172.21.15.132:0/961681061 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 718598138 0 0) 0x7f5ca406a5a0 con 0x7f5ca406a170 2023-12-20T04:43:29.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.552+0000 7f5ca37fe640 1 --2- 172.21.15.132:0/961681061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ca40c6690 0x7f5ca4069c30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4071970 tx=0x7f5c9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437832f902d572c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:29.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.552+0000 7f5ca2ffd640 1 -- 172.21.15.132:0/961681061 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c98031830 con 0x7f5ca40c6690 2023-12-20T04:43:29.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.552+0000 7f5ca2ffd640 1 -- 172.21.15.132:0/961681061 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c98031990 con 0x7f5ca40c6690 2023-12-20T04:43:29.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.552+0000 7f5ca2ffd640 1 -- 172.21.15.132:0/961681061 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c98031d20 con 0x7f5ca40c6690 2023-12-20T04:43:29.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.553+0000 7f5caa388640 1 -- 172.21.15.132:0/961681061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ca40c6690 msgr2=0x7f5ca4069c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.553+0000 7f5caa388640 1 --2- 172.21.15.132:0/961681061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ca40c6690 0x7f5ca4069c30 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f5ca4071970 tx=0x7f5c9802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.553+0000 7f5caa388640 1 -- 172.21.15.132:0/961681061 shutdown_connections 2023-12-20T04:43:29.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.553+0000 7f5caa388640 1 --2- 172.21.15.132:0/961681061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ca40c6690 0x7f5ca4069c30 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.553+0000 7f5caa388640 1 --2- 172.21.15.132:0/961681061 >> v2:172.21.15.187:3300/0 conn(0x7f5ca415d050 0x7f5ca40c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.553+0000 7f5caa388640 1 -- 172.21.15.132:0/961681061 >> 172.21.15.132:0/961681061 conn(0x7f5ca40cfb10 msgr2=0x7f5ca40cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:29.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.553+0000 7f5caa388640 1 -- 172.21.15.132:0/961681061 shutdown_connections 2023-12-20T04:43:29.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.553+0000 7f5caa388640 1 -- 172.21.15.132:0/961681061 wait complete. 2023-12-20T04:43:29.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.554+0000 7f5caa388640 1 Processor -- start 2023-12-20T04:43:29.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.554+0000 7f5caa388640 1 -- start start 2023-12-20T04:43:29.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5caa388640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ca406a170 0x7f5ca4159cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:29.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5caa388640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ca40c6690 0x7f5ca41f23e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:29.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5caa388640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ca415d050 0x7f5ca40c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:29.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5caa388640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca41f3310 con 0x7f5ca415d050 2023-12-20T04:43:29.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5caa388640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca41f2d50 con 0x7f5ca406a170 2023-12-20T04:43:29.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5caa388640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ca41f3030 con 0x7f5ca40c6690 2023-12-20T04:43:29.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5ca8925640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ca415d050 0x7f5ca40c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:29.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5ca8925640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ca415d050 0x7f5ca40c4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55326/0 (socket says 172.21.15.132:55326) 2023-12-20T04:43:29.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5ca8925640 1 -- 172.21.15.132:0/933201387 learned_addr learned my addr 172.21.15.132:0/933201387 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:29.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5ca37fe640 1 --2- 172.21.15.132:0/933201387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ca40c6690 0x7f5ca41f23e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5ca3fff640 1 --2- 172.21.15.132:0/933201387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ca406a170 0x7f5ca4159cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5ca8925640 1 -- 172.21.15.132:0/933201387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ca40c6690 msgr2=0x7f5ca41f23e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5ca8925640 1 --2- 172.21.15.132:0/933201387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ca40c6690 0x7f5ca41f23e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5ca8925640 1 -- 172.21.15.132:0/933201387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ca406a170 msgr2=0x7f5ca4159cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5ca8925640 1 --2- 172.21.15.132:0/933201387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ca406a170 0x7f5ca4159cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5ca8925640 1 -- 172.21.15.132:0/933201387 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c98009400 con 0x7f5ca415d050 2023-12-20T04:43:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5ca8925640 1 --2- 172.21.15.132:0/933201387 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ca415d050 0x7f5ca40c4ea0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00c780 tx=0x7f5c9c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5ca0ff9640 1 -- 172.21.15.132:0/933201387 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00ce30 con 0x7f5ca415d050 2023-12-20T04:43:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5ca0ff9640 1 -- 172.21.15.132:0/933201387 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c9c00a640 con 0x7f5ca415d050 2023-12-20T04:43:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5caa388640 1 -- 172.21.15.132:0/933201387 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5ca415d770 con 0x7f5ca415d050 2023-12-20T04:43:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5ca0ff9640 1 -- 172.21.15.132:0/933201387 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c9c00aa70 con 0x7f5ca415d050 2023-12-20T04:43:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.555+0000 7f5caa388640 1 -- 172.21.15.132:0/933201387 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5ca41f2920 con 0x7f5ca415d050 2023-12-20T04:43:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.556+0000 7f5caa388640 1 -- 172.21.15.132:0/933201387 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5ca415dc90 con 0x7f5ca415d050 2023-12-20T04:43:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.557+0000 7f5ca0ff9640 1 -- 172.21.15.132:0/933201387 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5c9c00abd0 con 0x7f5ca415d050 2023-12-20T04:43:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.557+0000 7f5ca0ff9640 1 --2- 172.21.15.132:0/933201387 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5c9006a430 0x7f5c9006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.557+0000 7f5ca0ff9640 1 -- 172.21.15.132:0/933201387 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5c9c0880b0 con 0x7f5ca415d050 2023-12-20T04:43:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.557+0000 7f5ca3fff640 1 --2- 172.21.15.132:0/933201387 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5c9006a430 0x7f5c9006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.558+0000 7f5ca3fff640 1 --2- 172.21.15.132:0/933201387 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5c9006a430 0x7f5c9006c8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5c94006fd0 tx=0x7f5c94008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.562+0000 7f5ca0ff9640 1 -- 172.21.15.132:0/933201387 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5ca415dc90 con 0x7f5ca415d050 2023-12-20T04:43:29.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.747+0000 7f5caa388640 1 -- 172.21.15.132:0/933201387 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5ca415dc90 con 0x7f5ca415d050 2023-12-20T04:43:29.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.747+0000 7f5ca0ff9640 1 -- 172.21.15.132:0/933201387 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5ca415dc90 con 0x7f5ca415d050 2023-12-20T04:43:29.749 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:43:29.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.749+0000 7f5caa388640 1 -- 172.21.15.132:0/933201387 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5c9006a430 msgr2=0x7f5c9006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.749+0000 7f5caa388640 1 --2- 172.21.15.132:0/933201387 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5c9006a430 0x7f5c9006c8f0 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f5c94006fd0 tx=0x7f5c94008040 comp rx=0 tx=0).stop 2023-12-20T04:43:29.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.749+0000 7f5caa388640 1 -- 172.21.15.132:0/933201387 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ca415d050 msgr2=0x7f5ca40c4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.749+0000 7f5caa388640 1 --2- 172.21.15.132:0/933201387 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ca415d050 0x7f5ca40c4ea0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f5c9c00c780 tx=0x7f5c9c00cc40 comp rx=0 tx=0).stop 2023-12-20T04:43:29.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.749+0000 7f5caa388640 1 -- 172.21.15.132:0/933201387 shutdown_connections 2023-12-20T04:43:29.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.749+0000 7f5caa388640 1 --2- 172.21.15.132:0/933201387 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5c9006a430 0x7f5c9006c8f0 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.749+0000 7f5caa388640 1 --2- 172.21.15.132:0/933201387 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ca415d050 0x7f5ca40c4ea0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.749+0000 7f5caa388640 1 --2- 172.21.15.132:0/933201387 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5ca40c6690 0x7f5ca41f23e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.749+0000 7f5caa388640 1 --2- 172.21.15.132:0/933201387 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ca406a170 0x7f5ca4159cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.749+0000 7f5caa388640 1 -- 172.21.15.132:0/933201387 >> 172.21.15.132:0/933201387 conn(0x7f5ca40cfb10 msgr2=0x7f5ca415c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:29.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.749+0000 7f5caa388640 1 -- 172.21.15.132:0/933201387 shutdown_connections 2023-12-20T04:43:29.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.749+0000 7f5caa388640 1 -- 172.21.15.132:0/933201387 wait complete. 2023-12-20T04:43:29.762 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:43:29.762 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:43:29.780 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:29.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.879+0000 7f9ce8a69640 1 Processor -- start 2023-12-20T04:43:29.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.879+0000 7f9ce8a69640 1 -- start start 2023-12-20T04:43:29.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.880+0000 7f9ce8a69640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9ce415ab70 0x7f9ce4160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:29.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.880+0000 7f9ce8a69640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9ce40cf280 0x7f9ce4069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:29.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.880+0000 7f9ce8a69640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce406d530 con 0x7f9ce40cf730 2023-12-20T04:43:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.880+0000 7f9ce8a69640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce4070540 con 0x7f9ce415ab70 2023-12-20T04:43:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.880+0000 7f9ce8a69640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce4070790 con 0x7f9ce40cf280 2023-12-20T04:43:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.880+0000 7f9ce259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9ce415ab70 0x7f9ce4160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.880+0000 7f9ce259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9ce415ab70 0x7f9ce4160d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55336/0 (socket says 172.21.15.132:55336) 2023-12-20T04:43:29.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.880+0000 7f9ce259c640 1 -- 172.21.15.132:0/260697693 learned_addr learned my addr 172.21.15.132:0/260697693 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.880+0000 7f9ce2d9d640 1 --1- 172.21.15.132:0/260697693 >> v1:172.21.15.132:6789/0 conn(0x7f9ce40cf730 0x7f9ce415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40622/0 (socket says 172.21.15.132:40622) 2023-12-20T04:43:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.881+0000 7f9ce259c640 1 -- 172.21.15.132:0/260697693 >> v2:172.21.15.187:3300/0 conn(0x7f9ce40cf280 msgr2=0x7f9ce4069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.881+0000 7f9ce1d9b640 1 --2- 172.21.15.132:0/260697693 >> v2:172.21.15.187:3300/0 conn(0x7f9ce40cf280 0x7f9ce4069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.881+0000 7f9ce159a640 1 -- 172.21.15.132:0/260697693 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 492036703 0 0) 0x7f9ce406d530 con 0x7f9ce40cf730 2023-12-20T04:43:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.881+0000 7f9ce259c640 1 --2- 172.21.15.132:0/260697693 >> v2:172.21.15.187:3300/0 conn(0x7f9ce40cf280 0x7f9ce4069c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.881+0000 7f9ce259c640 1 -- 172.21.15.132:0/260697693 >> v1:172.21.15.132:6789/0 conn(0x7f9ce40cf730 legacy=0x7f9ce415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.881+0000 7f9ce259c640 1 -- 172.21.15.132:0/260697693 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce4070a70 con 0x7f9ce415ab70 2023-12-20T04:43:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.881+0000 7f9ce259c640 1 --2- 172.21.15.132:0/260697693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce415ab70 0x7f9ce4160d70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40cc440 tx=0x7f9cd402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5d20d60ebcc67f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.881+0000 7f9ce159a640 1 -- 172.21.15.132:0/260697693 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd402cb20 con 0x7f9ce415ab70 2023-12-20T04:43:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.882+0000 7f9ce159a640 1 -- 172.21.15.132:0/260697693 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd402cc80 con 0x7f9ce415ab70 2023-12-20T04:43:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.882+0000 7f9ce159a640 1 -- 172.21.15.132:0/260697693 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd40343f0 con 0x7f9ce415ab70 2023-12-20T04:43:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.882+0000 7f9ce8a69640 1 -- 172.21.15.132:0/260697693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce415ab70 msgr2=0x7f9ce4160d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.882+0000 7f9ce8a69640 1 --2- 172.21.15.132:0/260697693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce415ab70 0x7f9ce4160d70 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40cc440 tx=0x7f9cd402bf80 comp rx=0 tx=0).stop 2023-12-20T04:43:29.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.882+0000 7f9ce8a69640 1 -- 172.21.15.132:0/260697693 shutdown_connections 2023-12-20T04:43:29.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.882+0000 7f9ce8a69640 1 --2- 172.21.15.132:0/260697693 >> v2:172.21.15.187:3300/0 conn(0x7f9ce40cf280 0x7f9ce4069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.882+0000 7f9ce8a69640 1 --2- 172.21.15.132:0/260697693 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce415ab70 0x7f9ce4160d70 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.882+0000 7f9ce8a69640 1 -- 172.21.15.132:0/260697693 >> 172.21.15.132:0/260697693 conn(0x7f9ce40cfca0 msgr2=0x7f9ce40d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:29.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.882+0000 7f9ce8a69640 1 -- 172.21.15.132:0/260697693 shutdown_connections 2023-12-20T04:43:29.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.882+0000 7f9ce8a69640 1 -- 172.21.15.132:0/260697693 wait complete. 2023-12-20T04:43:29.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.883+0000 7f9ce8a69640 1 Processor -- start 2023-12-20T04:43:29.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.883+0000 7f9ce8a69640 1 -- start start 2023-12-20T04:43:29.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.884+0000 7f9ce8a69640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce40cf280 0x7f9ce414da60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:29.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.884+0000 7f9ce8a69640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce40cf730 0x7f9ce415c5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:29.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.884+0000 7f9ce8a69640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ce415ab70 0x7f9ce415cb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:29.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.884+0000 7f9ce8a69640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40aef30 con 0x7f9ce40cf280 2023-12-20T04:43:29.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.884+0000 7f9ce8a69640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40ae2b0 con 0x7f9ce40cf730 2023-12-20T04:43:29.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.884+0000 7f9ce8a69640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40ae590 con 0x7f9ce415ab70 2023-12-20T04:43:29.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.884+0000 7f9ce259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce40cf280 0x7f9ce414da60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:29.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.884+0000 7f9ce259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce40cf280 0x7f9ce414da60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55338/0 (socket says 172.21.15.132:55338) 2023-12-20T04:43:29.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.884+0000 7f9ce259c640 1 -- 172.21.15.132:0/1629325137 learned_addr learned my addr 172.21.15.132:0/1629325137 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.884+0000 7f9ce2d9d640 1 --2- 172.21.15.132:0/1629325137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ce415ab70 0x7f9ce415cb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.884+0000 7f9ce1d9b640 1 --2- 172.21.15.132:0/1629325137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce40cf730 0x7f9ce415c5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.884+0000 7f9ce259c640 1 -- 172.21.15.132:0/1629325137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ce415ab70 msgr2=0x7f9ce415cb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.884+0000 7f9ce259c640 1 --2- 172.21.15.132:0/1629325137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ce415ab70 0x7f9ce415cb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.884+0000 7f9ce259c640 1 -- 172.21.15.132:0/1629325137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce40cf730 msgr2=0x7f9ce415c5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.884+0000 7f9ce259c640 1 --2- 172.21.15.132:0/1629325137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce40cf730 0x7f9ce415c5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.884+0000 7f9ce259c640 1 -- 172.21.15.132:0/1629325137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd4009b30 con 0x7f9ce40cf280 2023-12-20T04:43:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.884+0000 7f9ce1d9b640 1 --2- 172.21.15.132:0/1629325137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce40cf730 0x7f9ce415c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.885+0000 7f9ce259c640 1 --2- 172.21.15.132:0/1629325137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce40cf280 0x7f9ce414da60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4000f80 tx=0x7f9cd4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.885+0000 7f9cd2ffd640 1 -- 172.21.15.132:0/1629325137 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4009510 con 0x7f9ce40cf280 2023-12-20T04:43:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.885+0000 7f9cd2ffd640 1 -- 172.21.15.132:0/1629325137 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd403e450 con 0x7f9ce40cf280 2023-12-20T04:43:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.885+0000 7f9ce8a69640 1 -- 172.21.15.132:0/1629325137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce40ae870 con 0x7f9ce40cf280 2023-12-20T04:43:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.885+0000 7f9cd2ffd640 1 -- 172.21.15.132:0/1629325137 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd403e800 con 0x7f9ce40cf280 2023-12-20T04:43:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.885+0000 7f9ce8a69640 1 -- 172.21.15.132:0/1629325137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce414dfa0 con 0x7f9ce40cf280 2023-12-20T04:43:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.886+0000 7f9ce8a69640 1 -- 172.21.15.132:0/1629325137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce414e130 con 0x7f9ce40cf280 2023-12-20T04:43:29.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.886+0000 7f9cd2ffd640 1 -- 172.21.15.132:0/1629325137 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9cd403e960 con 0x7f9ce40cf280 2023-12-20T04:43:29.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.887+0000 7f9cd2ffd640 1 --2- 172.21.15.132:0/1629325137 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc406a430 0x7f9cc406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:29.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.887+0000 7f9cd2ffd640 1 -- 172.21.15.132:0/1629325137 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9cd40ab660 con 0x7f9ce40cf280 2023-12-20T04:43:29.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.887+0000 7f9ce1d9b640 1 --2- 172.21.15.132:0/1629325137 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc406a430 0x7f9cc406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:29.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.887+0000 7f9ce1d9b640 1 --2- 172.21.15.132:0/1629325137 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc406a430 0x7f9cc406c8f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9ce415b540 tx=0x7f9cd8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:29.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:29.891+0000 7f9cd2ffd640 1 -- 172.21.15.132:0/1629325137 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9cd4076c50 con 0x7f9ce40cf280 2023-12-20T04:43:30.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.060+0000 7f9ce8a69640 1 -- 172.21.15.132:0/1629325137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9ce404e840 con 0x7f9ce40cf280 2023-12-20T04:43:30.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.061+0000 7f9cd2ffd640 1 -- 172.21.15.132:0/1629325137 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f9cd407a270 con 0x7f9ce40cf280 2023-12-20T04:43:30.063 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:30.063 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:30.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.063+0000 7f9ce8a69640 1 -- 172.21.15.132:0/1629325137 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc406a430 msgr2=0x7f9cc406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.063+0000 7f9ce8a69640 1 --2- 172.21.15.132:0/1629325137 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc406a430 0x7f9cc406c8f0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f9ce415b540 tx=0x7f9cd8008040 comp rx=0 tx=0).stop 2023-12-20T04:43:30.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.063+0000 7f9ce8a69640 1 -- 172.21.15.132:0/1629325137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce40cf280 msgr2=0x7f9ce414da60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.063+0000 7f9ce8a69640 1 --2- 172.21.15.132:0/1629325137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce40cf280 0x7f9ce414da60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4000f80 tx=0x7f9cd4004a40 comp rx=0 tx=0).stop 2023-12-20T04:43:30.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.063+0000 7f9ce8a69640 1 -- 172.21.15.132:0/1629325137 shutdown_connections 2023-12-20T04:43:30.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.063+0000 7f9ce8a69640 1 --2- 172.21.15.132:0/1629325137 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc406a430 0x7f9cc406c8f0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.063+0000 7f9ce8a69640 1 --2- 172.21.15.132:0/1629325137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ce415ab70 0x7f9ce415cb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.063+0000 7f9ce8a69640 1 --2- 172.21.15.132:0/1629325137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce40cf730 0x7f9ce415c5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.063+0000 7f9ce8a69640 1 --2- 172.21.15.132:0/1629325137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce40cf280 0x7f9ce414da60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.063+0000 7f9ce8a69640 1 -- 172.21.15.132:0/1629325137 >> 172.21.15.132:0/1629325137 conn(0x7f9ce40cfca0 msgr2=0x7f9ce40b3530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:30.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.063+0000 7f9ce8a69640 1 -- 172.21.15.132:0/1629325137 shutdown_connections 2023-12-20T04:43:30.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.063+0000 7f9ce8a69640 1 -- 172.21.15.132:0/1629325137 wait complete. 2023-12-20T04:43:30.076 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:42:45.433456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:42:46.128920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:43:30.077 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:43:30.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.177+0000 7f4a48fc3640 1 Processor -- start 2023-12-20T04:43:30.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.177+0000 7f4a48fc3640 1 -- start start 2023-12-20T04:43:30.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.178+0000 7f4a48fc3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4a44069c30 0x7f4a44070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:30.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.178+0000 7f4a48fc3640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4a4415d360 0x7f4a4406a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:30.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.178+0000 7f4a48fc3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a440c4f40 con 0x7f4a440cbde0 2023-12-20T04:43:30.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.178+0000 7f4a48fc3640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a440af5b0 con 0x7f4a44069c30 2023-12-20T04:43:30.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.178+0000 7f4a48fc3640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a4406a550 con 0x7f4a4415d360 2023-12-20T04:43:30.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.178+0000 7f4a4259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4a44069c30 0x7f4a44070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:30.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.178+0000 7f4a42d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4a440cbde0 0x7f4a440ca170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40630/0 (socket says 172.21.15.132:40630) 2023-12-20T04:43:30.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.178+0000 7f4a42d9d640 1 -- 172.21.15.132:0/3358207160 learned_addr learned my addr 172.21.15.132:0/3358207160 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:30.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.178+0000 7f4a4259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4a44069c30 0x7f4a44070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55340/0 (socket says 172.21.15.132:55340) 2023-12-20T04:43:30.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.178+0000 7f4a39d9b640 1 --2- 172.21.15.132:0/3358207160 >> v2:172.21.15.187:3300/0 conn(0x7f4a4415d360 0x7f4a4406a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:30.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.178+0000 7f4a4259c640 1 -- 172.21.15.132:0/3358207160 >> v2:172.21.15.187:3300/0 conn(0x7f4a4415d360 msgr2=0x7f4a4406a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:30.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.178+0000 7f4a4259c640 1 --2- 172.21.15.132:0/3358207160 >> v2:172.21.15.187:3300/0 conn(0x7f4a4415d360 0x7f4a4406a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.178+0000 7f4a4259c640 1 -- 172.21.15.132:0/3358207160 >> v1:172.21.15.132:6789/0 conn(0x7f4a440cbde0 legacy=0x7f4a440ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.178+0000 7f4a4259c640 1 -- 172.21.15.132:0/3358207160 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a44070a40 con 0x7f4a44069c30 2023-12-20T04:43:30.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.178+0000 7f4a41d9b640 1 -- 172.21.15.132:0/3358207160 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3447895017 0 0) 0x7f4a440c4f40 con 0x7f4a440cbde0 2023-12-20T04:43:30.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.178+0000 7f4a39d9b640 1 --2- 172.21.15.132:0/3358207160 >> v2:172.21.15.187:3300/0 conn(0x7f4a4415d360 0x7f4a4406a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:30.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.179+0000 7f4a4259c640 1 --2- 172.21.15.132:0/3358207160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a44069c30 0x7f4a44070460 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4a440b5dc0 tx=0x7f4a3402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c60051eae60608df server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:30.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.179+0000 7f4a41d9b640 1 -- 172.21.15.132:0/3358207160 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a34031830 con 0x7f4a44069c30 2023-12-20T04:43:30.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.179+0000 7f4a41d9b640 1 -- 172.21.15.132:0/3358207160 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a34031990 con 0x7f4a44069c30 2023-12-20T04:43:30.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.179+0000 7f4a41d9b640 1 -- 172.21.15.132:0/3358207160 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a34031d20 con 0x7f4a44069c30 2023-12-20T04:43:30.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.179+0000 7f4a48fc3640 1 -- 172.21.15.132:0/3358207160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a44069c30 msgr2=0x7f4a44070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.179+0000 7f4a48fc3640 1 --2- 172.21.15.132:0/3358207160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a44069c30 0x7f4a44070460 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f4a440b5dc0 tx=0x7f4a3402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.179+0000 7f4a48fc3640 1 -- 172.21.15.132:0/3358207160 shutdown_connections 2023-12-20T04:43:30.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.180+0000 7f4a48fc3640 1 --2- 172.21.15.132:0/3358207160 >> v2:172.21.15.187:3300/0 conn(0x7f4a4415d360 0x7f4a4406a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.180+0000 7f4a48fc3640 1 --2- 172.21.15.132:0/3358207160 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a44069c30 0x7f4a44070460 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.180+0000 7f4a48fc3640 1 -- 172.21.15.132:0/3358207160 >> 172.21.15.132:0/3358207160 conn(0x7f4a440cc630 msgr2=0x7f4a440cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:30.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.180+0000 7f4a48fc3640 1 -- 172.21.15.132:0/3358207160 shutdown_connections 2023-12-20T04:43:30.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.180+0000 7f4a48fc3640 1 -- 172.21.15.132:0/3358207160 wait complete. 2023-12-20T04:43:30.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.181+0000 7f4a48fc3640 1 Processor -- start 2023-12-20T04:43:30.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.181+0000 7f4a48fc3640 1 -- start start 2023-12-20T04:43:30.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a48fc3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a44069c30 0x7f4a44157880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:30.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a48fc3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a440cbde0 0x7f4a440b0ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:30.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a48fc3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a4415d360 0x7f4a44159cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:30.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a48fc3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a441598f0 con 0x7f4a440cbde0 2023-12-20T04:43:30.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a48fc3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a44157dc0 con 0x7f4a4415d360 2023-12-20T04:43:30.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a48fc3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a440b3980 con 0x7f4a44069c30 2023-12-20T04:43:30.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a39d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a440cbde0 0x7f4a440b0ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:30.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a39d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a440cbde0 0x7f4a440b0ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55348/0 (socket says 172.21.15.132:55348) 2023-12-20T04:43:30.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a39d9b640 1 -- 172.21.15.132:0/1804380716 learned_addr learned my addr 172.21.15.132:0/1804380716 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:30.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a4259c640 1 --2- 172.21.15.132:0/1804380716 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a44069c30 0x7f4a44157880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:30.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a42d9d640 1 --2- 172.21.15.132:0/1804380716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a4415d360 0x7f4a44159cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:30.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a39d9b640 1 -- 172.21.15.132:0/1804380716 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a44069c30 msgr2=0x7f4a44157880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a39d9b640 1 --2- 172.21.15.132:0/1804380716 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a44069c30 0x7f4a44157880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a39d9b640 1 -- 172.21.15.132:0/1804380716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a4415d360 msgr2=0x7f4a44159cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a39d9b640 1 --2- 172.21.15.132:0/1804380716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a4415d360 0x7f4a44159cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a39d9b640 1 -- 172.21.15.132:0/1804380716 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a34009400 con 0x7f4a440cbde0 2023-12-20T04:43:30.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a42d9d640 1 --2- 172.21.15.132:0/1804380716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a4415d360 0x7f4a44159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:30.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a39d9b640 1 --2- 172.21.15.132:0/1804380716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a440cbde0 0x7f4a440b0ed0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00c7f0 tx=0x7f4a2c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:30.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a3b7fe640 1 -- 172.21.15.132:0/1804380716 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c007820 con 0x7f4a440cbde0 2023-12-20T04:43:30.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a3b7fe640 1 -- 172.21.15.132:0/1804380716 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a2c007980 con 0x7f4a440cbde0 2023-12-20T04:43:30.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a48fc3640 1 -- 172.21.15.132:0/1804380716 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a440b3c60 con 0x7f4a440cbde0 2023-12-20T04:43:30.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a3b7fe640 1 -- 172.21.15.132:0/1804380716 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a2c007cf0 con 0x7f4a440cbde0 2023-12-20T04:43:30.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.182+0000 7f4a48fc3640 1 -- 172.21.15.132:0/1804380716 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a441594d0 con 0x7f4a440cbde0 2023-12-20T04:43:30.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.183+0000 7f4a48fc3640 1 -- 172.21.15.132:0/1804380716 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a44159660 con 0x7f4a440cbde0 2023-12-20T04:43:30.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.184+0000 7f4a3b7fe640 1 -- 172.21.15.132:0/1804380716 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4a2c0113f0 con 0x7f4a440cbde0 2023-12-20T04:43:30.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.184+0000 7f4a3b7fe640 1 --2- 172.21.15.132:0/1804380716 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a2406a430 0x7f4a2406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:30.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.184+0000 7f4a3b7fe640 1 -- 172.21.15.132:0/1804380716 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a2c088b00 con 0x7f4a440cbde0 2023-12-20T04:43:30.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.184+0000 7f4a4259c640 1 --2- 172.21.15.132:0/1804380716 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a2406a430 0x7f4a2406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:30.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.185+0000 7f4a4259c640 1 --2- 172.21.15.132:0/1804380716 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a2406a430 0x7f4a2406c8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4a34036000 tx=0x7f4a3403c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:30.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.189+0000 7f4a3b7fe640 1 -- 172.21.15.132:0/1804380716 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4a2c054230 con 0x7f4a440cbde0 2023-12-20T04:43:30.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.352+0000 7f4a48fc3640 1 -- 172.21.15.132:0/1804380716 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4a4404e840 con 0x7f4a440cbde0 2023-12-20T04:43:30.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.353+0000 7f4a3b7fe640 1 -- 172.21.15.132:0/1804380716 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4a2c01f0a0 con 0x7f4a440cbde0 2023-12-20T04:43:30.355 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:43:30.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.355+0000 7f4a48fc3640 1 -- 172.21.15.132:0/1804380716 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a2406a430 msgr2=0x7f4a2406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.355+0000 7f4a48fc3640 1 --2- 172.21.15.132:0/1804380716 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a2406a430 0x7f4a2406c8f0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4a34036000 tx=0x7f4a3403c040 comp rx=0 tx=0).stop 2023-12-20T04:43:30.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.355+0000 7f4a48fc3640 1 -- 172.21.15.132:0/1804380716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a440cbde0 msgr2=0x7f4a440b0ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.355+0000 7f4a48fc3640 1 --2- 172.21.15.132:0/1804380716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a440cbde0 0x7f4a440b0ed0 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f4a2c00c7f0 tx=0x7f4a2c00ccb0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.355+0000 7f4a48fc3640 1 -- 172.21.15.132:0/1804380716 shutdown_connections 2023-12-20T04:43:30.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.355+0000 7f4a48fc3640 1 --2- 172.21.15.132:0/1804380716 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a2406a430 0x7f4a2406c8f0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.355+0000 7f4a48fc3640 1 --2- 172.21.15.132:0/1804380716 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a4415d360 0x7f4a44159cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.355+0000 7f4a48fc3640 1 --2- 172.21.15.132:0/1804380716 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a440cbde0 0x7f4a440b0ed0 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.355+0000 7f4a48fc3640 1 --2- 172.21.15.132:0/1804380716 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a44069c30 0x7f4a44157880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.355+0000 7f4a48fc3640 1 -- 172.21.15.132:0/1804380716 >> 172.21.15.132:0/1804380716 conn(0x7f4a440cc630 msgr2=0x7f4a440ae600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:30.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.355+0000 7f4a48fc3640 1 -- 172.21.15.132:0/1804380716 shutdown_connections 2023-12-20T04:43:30.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.355+0000 7f4a48fc3640 1 -- 172.21.15.132:0/1804380716 wait complete. 2023-12-20T04:43:30.368 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:43:30.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.469+0000 7fb72f53c640 1 Processor -- start 2023-12-20T04:43:30.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.469+0000 7fb72f53c640 1 -- start start 2023-12-20T04:43:30.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.470+0000 7fb72f53c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb7280cb780 0x7fb7280cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:30.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.470+0000 7fb72f53c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7280cf750 con 0x7fb72815e0c0 2023-12-20T04:43:30.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.470+0000 7fb72f53c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7280cf9e0 con 0x7fb7280cbb60 2023-12-20T04:43:30.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.470+0000 7fb72f53c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7280cfcc0 con 0x7fb7280cb780 2023-12-20T04:43:30.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.470+0000 7fb72d2d8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb7280cb780 0x7fb7280cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:30.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.470+0000 7fb72dad9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb72815e0c0 0x7fb7280b1280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40644/0 (socket says 172.21.15.132:40644) 2023-12-20T04:43:30.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.470+0000 7fb72dad9640 1 -- 172.21.15.132:0/2744110426 learned_addr learned my addr 172.21.15.132:0/2744110426 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:30.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.471+0000 7fb72d2d8640 1 -- 172.21.15.132:0/2744110426 >> v1:172.21.15.187:6789/0 conn(0x7fb7280cbb60 legacy=0x7fb7280cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:30.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.471+0000 7fb72d2d8640 1 -- 172.21.15.132:0/2744110426 >> v1:172.21.15.132:6789/0 conn(0x7fb72815e0c0 legacy=0x7fb7280b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.471+0000 7fb71ffff640 1 -- 172.21.15.132:0/2744110426 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3968930444 0 0) 0x7fb7280cf750 con 0x7fb72815e0c0 2023-12-20T04:43:30.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.471+0000 7fb72d2d8640 1 -- 172.21.15.132:0/2744110426 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7280cffa0 con 0x7fb7280cb780 2023-12-20T04:43:30.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.471+0000 7fb72d2d8640 1 --2- 172.21.15.132:0/2744110426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7280cb780 0x7fb7280cd3e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb724009d90 tx=0x7fb72402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=353c3b7f35dc2b43 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:30.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.472+0000 7fb71ffff640 1 -- 172.21.15.132:0/2744110426 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72402cbd0 con 0x7fb7280cb780 2023-12-20T04:43:30.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.472+0000 7fb71ffff640 1 -- 172.21.15.132:0/2744110426 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb72402cd30 con 0x7fb7280cb780 2023-12-20T04:43:30.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.472+0000 7fb71ffff640 1 -- 172.21.15.132:0/2744110426 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb72402cea0 con 0x7fb7280cb780 2023-12-20T04:43:30.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.472+0000 7fb72f53c640 1 -- 172.21.15.132:0/2744110426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7280cb780 msgr2=0x7fb7280cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.472+0000 7fb72f53c640 1 --2- 172.21.15.132:0/2744110426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7280cb780 0x7fb7280cd3e0 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fb724009d90 tx=0x7fb72402be20 comp rx=0 tx=0).stop 2023-12-20T04:43:30.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.472+0000 7fb72f53c640 1 -- 172.21.15.132:0/2744110426 shutdown_connections 2023-12-20T04:43:30.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.472+0000 7fb72f53c640 1 --2- 172.21.15.132:0/2744110426 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7280cb780 0x7fb7280cd3e0 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.472+0000 7fb72f53c640 1 -- 172.21.15.132:0/2744110426 >> 172.21.15.132:0/2744110426 conn(0x7fb72806bfc0 msgr2=0x7fb72806c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:30.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.472+0000 7fb72f53c640 1 -- 172.21.15.132:0/2744110426 shutdown_connections 2023-12-20T04:43:30.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.472+0000 7fb72f53c640 1 -- 172.21.15.132:0/2744110426 wait complete. 2023-12-20T04:43:30.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.473+0000 7fb72f53c640 1 Processor -- start 2023-12-20T04:43:30.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.473+0000 7fb72f53c640 1 -- start start 2023-12-20T04:43:30.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.474+0000 7fb72f53c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7280cb780 0x7fb72815e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:30.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.474+0000 7fb72f53c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7280cbb60 0x7fb72814c440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:30.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.474+0000 7fb72f53c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb72815e0c0 0x7fb72815c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:30.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.474+0000 7fb72f53c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb72815ee10 con 0x7fb72815e0c0 2023-12-20T04:43:30.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.474+0000 7fb72f53c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb728160e20 con 0x7fb7280cb780 2023-12-20T04:43:30.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.474+0000 7fb72f53c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7281604f0 con 0x7fb7280cbb60 2023-12-20T04:43:30.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.474+0000 7fb72dad9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb72815e0c0 0x7fb72815c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:30.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.474+0000 7fb72dad9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb72815e0c0 0x7fb72815c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55362/0 (socket says 172.21.15.132:55362) 2023-12-20T04:43:30.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.474+0000 7fb72dad9640 1 -- 172.21.15.132:0/568699504 learned_addr learned my addr 172.21.15.132:0/568699504 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:30.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.474+0000 7fb72d2d8640 1 --2- 172.21.15.132:0/568699504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7280cb780 0x7fb72815e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:30.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.474+0000 7fb72cad7640 1 --2- 172.21.15.132:0/568699504 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7280cbb60 0x7fb72814c440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:30.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.474+0000 7fb72dad9640 1 -- 172.21.15.132:0/568699504 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7280cbb60 msgr2=0x7fb72814c440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.474+0000 7fb72dad9640 1 --2- 172.21.15.132:0/568699504 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7280cbb60 0x7fb72814c440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.474+0000 7fb72dad9640 1 -- 172.21.15.132:0/568699504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7280cb780 msgr2=0x7fb72815e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.474+0000 7fb72dad9640 1 --2- 172.21.15.132:0/568699504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7280cb780 0x7fb72815e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.474+0000 7fb72dad9640 1 -- 172.21.15.132:0/568699504 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb724009a70 con 0x7fb72815e0c0 2023-12-20T04:43:30.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.475+0000 7fb72dad9640 1 --2- 172.21.15.132:0/568699504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb72815e0c0 0x7fb72815c090 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb72000c410 tx=0x7fb72000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:30.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.475+0000 7fb71dffb640 1 -- 172.21.15.132:0/568699504 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7200074e0 con 0x7fb72815e0c0 2023-12-20T04:43:30.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.475+0000 7fb71dffb640 1 -- 172.21.15.132:0/568699504 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb720007640 con 0x7fb72815e0c0 2023-12-20T04:43:30.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.475+0000 7fb72f53c640 1 -- 172.21.15.132:0/568699504 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7281607d0 con 0x7fb72815e0c0 2023-12-20T04:43:30.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.475+0000 7fb71dffb640 1 -- 172.21.15.132:0/568699504 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb720004a20 con 0x7fb72815e0c0 2023-12-20T04:43:30.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.475+0000 7fb72f53c640 1 -- 172.21.15.132:0/568699504 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb72815eb20 con 0x7fb72815e0c0 2023-12-20T04:43:30.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.476+0000 7fb72f53c640 1 -- 172.21.15.132:0/568699504 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb728160f90 con 0x7fb72815e0c0 2023-12-20T04:43:30.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.476+0000 7fb71dffb640 1 -- 172.21.15.132:0/568699504 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb720004b80 con 0x7fb72815e0c0 2023-12-20T04:43:30.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.477+0000 7fb71dffb640 1 --2- 172.21.15.132:0/568699504 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb70c06a430 0x7fb70c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:30.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.477+0000 7fb71dffb640 1 -- 172.21.15.132:0/568699504 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb7200885c0 con 0x7fb72815e0c0 2023-12-20T04:43:30.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.477+0000 7fb72d2d8640 1 --2- 172.21.15.132:0/568699504 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb70c06a430 0x7fb70c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:30.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.477+0000 7fb72d2d8640 1 --2- 172.21.15.132:0/568699504 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb70c06a430 0x7fb70c06c8f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb724036000 tx=0x7fb724030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:30.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.481+0000 7fb71dffb640 1 -- 172.21.15.132:0/568699504 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb720053d20 con 0x7fb72815e0c0 2023-12-20T04:43:30.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.647+0000 7fb72f53c640 1 -- 172.21.15.132:0/568699504 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb728160240 con 0x7fb72815e0c0 2023-12-20T04:43:30.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.647+0000 7fb71dffb640 1 -- 172.21.15.132:0/568699504 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb720057340 con 0x7fb72815e0c0 2023-12-20T04:43:30.649 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:43:30.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.649+0000 7fb72f53c640 1 -- 172.21.15.132:0/568699504 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb70c06a430 msgr2=0x7fb70c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.649+0000 7fb72f53c640 1 --2- 172.21.15.132:0/568699504 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb70c06a430 0x7fb70c06c8f0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fb724036000 tx=0x7fb724030000 comp rx=0 tx=0).stop 2023-12-20T04:43:30.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.649+0000 7fb72f53c640 1 -- 172.21.15.132:0/568699504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb72815e0c0 msgr2=0x7fb72815c090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.649+0000 7fb72f53c640 1 --2- 172.21.15.132:0/568699504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb72815e0c0 0x7fb72815c090 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7fb72000c410 tx=0x7fb72000c8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.649+0000 7fb72f53c640 1 -- 172.21.15.132:0/568699504 shutdown_connections 2023-12-20T04:43:30.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.649+0000 7fb72f53c640 1 --2- 172.21.15.132:0/568699504 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb70c06a430 0x7fb70c06c8f0 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.649+0000 7fb72f53c640 1 --2- 172.21.15.132:0/568699504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb72815e0c0 0x7fb72815c090 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.649+0000 7fb72f53c640 1 --2- 172.21.15.132:0/568699504 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb7280cbb60 0x7fb72814c440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.649+0000 7fb72f53c640 1 --2- 172.21.15.132:0/568699504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7280cb780 0x7fb72815e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.649+0000 7fb72f53c640 1 -- 172.21.15.132:0/568699504 >> 172.21.15.132:0/568699504 conn(0x7fb72806bfc0 msgr2=0x7fb72815d290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:30.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.649+0000 7fb72f53c640 1 -- 172.21.15.132:0/568699504 shutdown_connections 2023-12-20T04:43:30.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.649+0000 7fb72f53c640 1 -- 172.21.15.132:0/568699504 wait complete. 2023-12-20T04:43:30.662 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:43:30.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.764+0000 7f987845f640 1 Processor -- start 2023-12-20T04:43:30.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.764+0000 7f987845f640 1 -- start start 2023-12-20T04:43:30.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.765+0000 7f987845f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f987015d300 0x7f98700d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:30.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.765+0000 7f987845f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f98700d17d0 0x7f98700cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:30.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.765+0000 7f987845f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98700d2920 con 0x7f98700cfcd0 2023-12-20T04:43:30.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.765+0000 7f987845f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f98700d0160 con 0x7f98700d17d0 2023-12-20T04:43:30.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.765+0000 7f987845f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98700d1d10 con 0x7f987015d300 2023-12-20T04:43:30.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.765+0000 7f98759fa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f98700d17d0 0x7f98700cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:30.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.766+0000 7f98769fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f98700cfcd0 0x7f98700b48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40652/0 (socket says 172.21.15.132:40652) 2023-12-20T04:43:30.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.766+0000 7f98769fc640 1 -- 172.21.15.132:0/3268110476 learned_addr learned my addr 172.21.15.132:0/3268110476 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:30.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.766+0000 7f98761fb640 1 --2- 172.21.15.132:0/3268110476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f987015d300 0x7f98700d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:30.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.766+0000 7f98759fa640 1 -- 172.21.15.132:0/3268110476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f987015d300 msgr2=0x7f98700d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:30.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.766+0000 7f98759fa640 1 --2- 172.21.15.132:0/3268110476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f987015d300 0x7f98700d1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.766+0000 7f98759fa640 1 -- 172.21.15.132:0/3268110476 >> v1:172.21.15.132:6789/0 conn(0x7f98700cfcd0 legacy=0x7f98700b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.766+0000 7f98759fa640 1 -- 172.21.15.132:0/3268110476 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98700d1ff0 con 0x7f98700d17d0 2023-12-20T04:43:30.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.766+0000 7f98751f9640 1 -- 172.21.15.132:0/3268110476 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251385009 0 0) 0x7f98700d2920 con 0x7f98700cfcd0 2023-12-20T04:43:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.767+0000 7f98759fa640 1 --2- 172.21.15.132:0/3268110476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98700d17d0 0x7f98700cf790 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f98600097a0 tx=0x7f986002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f54873b0fa34df6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.767+0000 7f98751f9640 1 -- 172.21.15.132:0/3268110476 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860031830 con 0x7f98700d17d0 2023-12-20T04:43:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.767+0000 7f98751f9640 1 -- 172.21.15.132:0/3268110476 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9860031990 con 0x7f98700d17d0 2023-12-20T04:43:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.767+0000 7f98751f9640 1 -- 172.21.15.132:0/3268110476 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860031d20 con 0x7f98700d17d0 2023-12-20T04:43:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.767+0000 7f987845f640 1 -- 172.21.15.132:0/3268110476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98700d17d0 msgr2=0x7f98700cf790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.767+0000 7f987845f640 1 --2- 172.21.15.132:0/3268110476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98700d17d0 0x7f98700cf790 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f98600097a0 tx=0x7f986002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.767+0000 7f987845f640 1 -- 172.21.15.132:0/3268110476 shutdown_connections 2023-12-20T04:43:30.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.767+0000 7f987845f640 1 --2- 172.21.15.132:0/3268110476 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98700d17d0 0x7f98700cf790 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.767+0000 7f987845f640 1 --2- 172.21.15.132:0/3268110476 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f987015d300 0x7f98700d1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.767+0000 7f987845f640 1 -- 172.21.15.132:0/3268110476 >> 172.21.15.132:0/3268110476 conn(0x7f987006a3d0 msgr2=0x7f987006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:30.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.767+0000 7f987845f640 1 -- 172.21.15.132:0/3268110476 shutdown_connections 2023-12-20T04:43:30.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.767+0000 7f987845f640 1 -- 172.21.15.132:0/3268110476 wait complete. 2023-12-20T04:43:30.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.769+0000 7f987845f640 1 Processor -- start 2023-12-20T04:43:30.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.769+0000 7f987845f640 1 -- start start 2023-12-20T04:43:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.769+0000 7f987845f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98700cfcd0 0x7f98701f5cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.769+0000 7f987845f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98700d17d0 0x7f98700c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.769+0000 7f987845f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f987015d300 0x7f98700c77f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.769+0000 7f987845f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98701f2cd0 con 0x7f98700d17d0 2023-12-20T04:43:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.769+0000 7f987845f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98701f2fb0 con 0x7f987015d300 2023-12-20T04:43:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.769+0000 7f987845f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98701f3290 con 0x7f98700cfcd0 2023-12-20T04:43:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.769+0000 7f98759fa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98700d17d0 0x7f98700c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.769+0000 7f98759fa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98700d17d0 0x7f98700c72b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55372/0 (socket says 172.21.15.132:55372) 2023-12-20T04:43:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.769+0000 7f98759fa640 1 -- 172.21.15.132:0/1451125067 learned_addr learned my addr 172.21.15.132:0/1451125067 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.770+0000 7f98761fb640 1 --2- 172.21.15.132:0/1451125067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98700cfcd0 0x7f98701f5cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.770+0000 7f98769fc640 1 --2- 172.21.15.132:0/1451125067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f987015d300 0x7f98700c77f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.770+0000 7f98759fa640 1 -- 172.21.15.132:0/1451125067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98700cfcd0 msgr2=0x7f98701f5cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.770+0000 7f98759fa640 1 --2- 172.21.15.132:0/1451125067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98700cfcd0 0x7f98701f5cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.770+0000 7f98759fa640 1 -- 172.21.15.132:0/1451125067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f987015d300 msgr2=0x7f98700c77f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.770+0000 7f98759fa640 1 --2- 172.21.15.132:0/1451125067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f987015d300 0x7f98700c77f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.770+0000 7f98759fa640 1 -- 172.21.15.132:0/1451125067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9860009400 con 0x7f98700d17d0 2023-12-20T04:43:30.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.770+0000 7f98769fc640 1 --2- 172.21.15.132:0/1451125067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f987015d300 0x7f98700c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:30.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.770+0000 7f98759fa640 1 --2- 172.21.15.132:0/1451125067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98700d17d0 0x7f98700c72b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9860034040 tx=0x7f98600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:30.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.770+0000 7f9866ffd640 1 -- 172.21.15.132:0/1451125067 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f986003aa60 con 0x7f98700d17d0 2023-12-20T04:43:30.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.770+0000 7f9866ffd640 1 -- 172.21.15.132:0/1451125067 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f986003abe0 con 0x7f98700d17d0 2023-12-20T04:43:30.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.770+0000 7f987845f640 1 -- 172.21.15.132:0/1451125067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98701f3570 con 0x7f98700d17d0 2023-12-20T04:43:30.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.770+0000 7f9866ffd640 1 -- 172.21.15.132:0/1451125067 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9860044400 con 0x7f98700d17d0 2023-12-20T04:43:30.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.770+0000 7f987845f640 1 -- 172.21.15.132:0/1451125067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98700c9310 con 0x7f98700d17d0 2023-12-20T04:43:30.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.771+0000 7f987845f640 1 -- 172.21.15.132:0/1451125067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98700c6fd0 con 0x7f98700d17d0 2023-12-20T04:43:30.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.771+0000 7f9866ffd640 1 -- 172.21.15.132:0/1451125067 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f986004d440 con 0x7f98700d17d0 2023-12-20T04:43:30.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.772+0000 7f9866ffd640 1 --2- 172.21.15.132:0/1451125067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f985406a430 0x7f985406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:30.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.772+0000 7f9866ffd640 1 -- 172.21.15.132:0/1451125067 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f98600aaae0 con 0x7f98700d17d0 2023-12-20T04:43:30.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.772+0000 7f98761fb640 1 --2- 172.21.15.132:0/1451125067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f985406a430 0x7f985406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:30.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.772+0000 7f98761fb640 1 --2- 172.21.15.132:0/1451125067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f985406a430 0x7f985406c8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f986c009a60 tx=0x7f986c003990 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:30.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.776+0000 7f9866ffd640 1 -- 172.21.15.132:0/1451125067 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f98700c6fd0 con 0x7f98700d17d0 2023-12-20T04:43:30.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.939+0000 7f987845f640 1 -- 172.21.15.132:0/1451125067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f98700c6fd0 con 0x7f98700d17d0 2023-12-20T04:43:30.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.939+0000 7f9866ffd640 1 -- 172.21.15.132:0/1451125067 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7f98700c6fd0 con 0x7f98700d17d0 2023-12-20T04:43:30.941 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:43:30.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.941+0000 7f987845f640 1 -- 172.21.15.132:0/1451125067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f985406a430 msgr2=0x7f985406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.941+0000 7f987845f640 1 --2- 172.21.15.132:0/1451125067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f985406a430 0x7f985406c8f0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f986c009a60 tx=0x7f986c003990 comp rx=0 tx=0).stop 2023-12-20T04:43:30.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.941+0000 7f987845f640 1 -- 172.21.15.132:0/1451125067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98700d17d0 msgr2=0x7f98700c72b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:30.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.941+0000 7f987845f640 1 --2- 172.21.15.132:0/1451125067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98700d17d0 0x7f98700c72b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f9860034040 tx=0x7f98600046c0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.941+0000 7f987845f640 1 -- 172.21.15.132:0/1451125067 shutdown_connections 2023-12-20T04:43:30.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.941+0000 7f987845f640 1 --2- 172.21.15.132:0/1451125067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f985406a430 0x7f985406c8f0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.941+0000 7f987845f640 1 --2- 172.21.15.132:0/1451125067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f987015d300 0x7f98700c77f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.941+0000 7f987845f640 1 --2- 172.21.15.132:0/1451125067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98700d17d0 0x7f98700c72b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.941+0000 7f987845f640 1 --2- 172.21.15.132:0/1451125067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f98700cfcd0 0x7f98701f5cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:30.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.941+0000 7f987845f640 1 -- 172.21.15.132:0/1451125067 >> 172.21.15.132:0/1451125067 conn(0x7f987006a3d0 msgr2=0x7f98700b6040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:30.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.941+0000 7f987845f640 1 -- 172.21.15.132:0/1451125067 shutdown_connections 2023-12-20T04:43:30.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:30.941+0000 7f987845f640 1 -- 172.21.15.132:0/1451125067 wait complete. 2023-12-20T04:43:30.954 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:43:31.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.055+0000 7fc3ad0ab640 1 Processor -- start 2023-12-20T04:43:31.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.055+0000 7fc3ad0ab640 1 -- start start 2023-12-20T04:43:31.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.056+0000 7fc3ad0ab640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc3a815af00 0x7fc3a80d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.056+0000 7fc3ad0ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc3a8160e80 0x7fc3a815e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.056+0000 7fc3ad0ab640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3a815b2e0 con 0x7fc3a815e570 2023-12-20T04:43:31.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.056+0000 7fc3ad0ab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a815dc10 con 0x7fc3a8160e80 2023-12-20T04:43:31.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.056+0000 7fc3ad0ab640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3a8161660 con 0x7fc3a815af00 2023-12-20T04:43:31.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.056+0000 7fc3a659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc3a8160e80 0x7fc3a815e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.056+0000 7fc3a659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc3a8160e80 0x7fc3a815e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55380/0 (socket says 172.21.15.132:55380) 2023-12-20T04:43:31.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.056+0000 7fc3a659c640 1 -- 172.21.15.132:0/1945834649 learned_addr learned my addr 172.21.15.132:0/1945834649 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:31.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.057+0000 7fc3a6d9d640 1 --2- 172.21.15.132:0/1945834649 >> v2:172.21.15.187:3300/0 conn(0x7fc3a815af00 0x7fc3a80d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.057+0000 7fc3a659c640 1 -- 172.21.15.132:0/1945834649 >> v2:172.21.15.187:3300/0 conn(0x7fc3a815af00 msgr2=0x7fc3a80d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:31.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.057+0000 7fc3a659c640 1 --2- 172.21.15.132:0/1945834649 >> v2:172.21.15.187:3300/0 conn(0x7fc3a815af00 0x7fc3a80d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.057+0000 7fc3a659c640 1 -- 172.21.15.132:0/1945834649 >> v1:172.21.15.187:6789/0 conn(0x7fc3a815e570 legacy=0x7fc3a806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:31.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.057+0000 7fc3a659c640 1 -- 172.21.15.132:0/1945834649 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3a8161940 con 0x7fc3a8160e80 2023-12-20T04:43:31.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.057+0000 7fc3a6d9d640 1 --2- 172.21.15.132:0/1945834649 >> v2:172.21.15.187:3300/0 conn(0x7fc3a815af00 0x7fc3a80d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.057+0000 7fc3a659c640 1 --2- 172.21.15.132:0/1945834649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3a8160e80 0x7fc3a815e030 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8067fc0 tx=0x7fc39002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4af326939707f49d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.058+0000 7fc3a5d9b640 1 -- 172.21.15.132:0/1945834649 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390031870 con 0x7fc3a8160e80 2023-12-20T04:43:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.058+0000 7fc3a5d9b640 1 -- 172.21.15.132:0/1945834649 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3900319d0 con 0x7fc3a8160e80 2023-12-20T04:43:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.058+0000 7fc3a5d9b640 1 -- 172.21.15.132:0/1945834649 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc390031d60 con 0x7fc3a8160e80 2023-12-20T04:43:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.058+0000 7fc3ad0ab640 1 -- 172.21.15.132:0/1945834649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3a8160e80 msgr2=0x7fc3a815e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.058+0000 7fc3ad0ab640 1 --2- 172.21.15.132:0/1945834649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3a8160e80 0x7fc3a815e030 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc3a8067fc0 tx=0x7fc39002b910 comp rx=0 tx=0).stop 2023-12-20T04:43:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.058+0000 7fc3ad0ab640 1 -- 172.21.15.132:0/1945834649 shutdown_connections 2023-12-20T04:43:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.058+0000 7fc3ad0ab640 1 --2- 172.21.15.132:0/1945834649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3a8160e80 0x7fc3a815e030 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.058+0000 7fc3ad0ab640 1 --2- 172.21.15.132:0/1945834649 >> v2:172.21.15.187:3300/0 conn(0x7fc3a815af00 0x7fc3a80d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.058+0000 7fc3ad0ab640 1 -- 172.21.15.132:0/1945834649 >> 172.21.15.132:0/1945834649 conn(0x7fc3a806d640 msgr2=0x7fc3a806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:31.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.058+0000 7fc3ad0ab640 1 -- 172.21.15.132:0/1945834649 shutdown_connections 2023-12-20T04:43:31.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.058+0000 7fc3ad0ab640 1 -- 172.21.15.132:0/1945834649 wait complete. 2023-12-20T04:43:31.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.060+0000 7fc3ad0ab640 1 Processor -- start 2023-12-20T04:43:31.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.060+0000 7fc3ad0ab640 1 -- start start 2023-12-20T04:43:31.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.060+0000 7fc3ad0ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3a815af00 0x7fc3a80b5a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.060+0000 7fc3ad0ab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3a815e570 0x7fc3a815fca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.060+0000 7fc3ad0ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3a8160e80 0x7fc3a814c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.060+0000 7fc3ad0ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a81f2920 con 0x7fc3a815af00 2023-12-20T04:43:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.060+0000 7fc3ad0ab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80b49d0 con 0x7fc3a815e570 2023-12-20T04:43:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.060+0000 7fc3ad0ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3a80b4c90 con 0x7fc3a8160e80 2023-12-20T04:43:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.060+0000 7fc3a6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3a815af00 0x7fc3a80b5a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.060+0000 7fc3a6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3a815af00 0x7fc3a80b5a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55382/0 (socket says 172.21.15.132:55382) 2023-12-20T04:43:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.060+0000 7fc3a6d9d640 1 -- 172.21.15.132:0/2925457824 learned_addr learned my addr 172.21.15.132:0/2925457824 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.061+0000 7fc3a6d9d640 1 -- 172.21.15.132:0/2925457824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3a8160e80 msgr2=0x7fc3a814c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.061+0000 7fc3a659c640 1 --2- 172.21.15.132:0/2925457824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3a815e570 0x7fc3a815fca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.061+0000 7fc3a759e640 1 --2- 172.21.15.132:0/2925457824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3a8160e80 0x7fc3a814c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.061+0000 7fc3a6d9d640 1 --2- 172.21.15.132:0/2925457824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3a8160e80 0x7fc3a814c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.061+0000 7fc3a6d9d640 1 -- 172.21.15.132:0/2925457824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3a815e570 msgr2=0x7fc3a815fca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.061+0000 7fc3a6d9d640 1 --2- 172.21.15.132:0/2925457824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3a815e570 0x7fc3a815fca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.061+0000 7fc3a6d9d640 1 -- 172.21.15.132:0/2925457824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3900094d0 con 0x7fc3a815af00 2023-12-20T04:43:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.061+0000 7fc3a6d9d640 1 --2- 172.21.15.132:0/2925457824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3a815af00 0x7fc3a80b5a50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0007ef0 tx=0x7fc3a000d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:31.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.061+0000 7fc39f7fe640 1 -- 172.21.15.132:0/2925457824 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a0003b90 con 0x7fc3a815af00 2023-12-20T04:43:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.061+0000 7fc39f7fe640 1 -- 172.21.15.132:0/2925457824 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3a000f040 con 0x7fc3a815af00 2023-12-20T04:43:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.061+0000 7fc3ad0ab640 1 -- 172.21.15.132:0/2925457824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3a80b4f70 con 0x7fc3a815af00 2023-12-20T04:43:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.061+0000 7fc39f7fe640 1 -- 172.21.15.132:0/2925457824 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3a000de80 con 0x7fc3a815af00 2023-12-20T04:43:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.061+0000 7fc3ad0ab640 1 -- 172.21.15.132:0/2925457824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3a80b5530 con 0x7fc3a815af00 2023-12-20T04:43:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.062+0000 7fc3ad0ab640 1 -- 172.21.15.132:0/2925457824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc3a804e840 con 0x7fc3a815af00 2023-12-20T04:43:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.063+0000 7fc39f7fe640 1 -- 172.21.15.132:0/2925457824 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc3a0004030 con 0x7fc3a815af00 2023-12-20T04:43:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.063+0000 7fc39f7fe640 1 --2- 172.21.15.132:0/2925457824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc38806a430 0x7fc38806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.063+0000 7fc39f7fe640 1 -- 172.21.15.132:0/2925457824 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc3a0088bb0 con 0x7fc3a815af00 2023-12-20T04:43:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.063+0000 7fc3a659c640 1 --2- 172.21.15.132:0/2925457824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc38806a430 0x7fc38806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.063+0000 7fc3a659c640 1 --2- 172.21.15.132:0/2925457824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc38806a430 0x7fc38806c8f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc390036000 tx=0x7fc39003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:31.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.067+0000 7fc39f7fe640 1 -- 172.21.15.132:0/2925457824 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc3a0054250 con 0x7fc3a815af00 2023-12-20T04:43:31.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.244+0000 7fc3ad0ab640 1 -- 172.21.15.132:0/2925457824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc3a806a930 con 0x7fc3a815af00 2023-12-20T04:43:31.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.244+0000 7fc39f7fe640 1 -- 172.21.15.132:0/2925457824 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v20) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc3a001a080 con 0x7fc3a815af00 2023-12-20T04:43:31.246 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:43:31.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.246+0000 7fc3ad0ab640 1 -- 172.21.15.132:0/2925457824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc38806a430 msgr2=0x7fc38806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:31.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.246+0000 7fc3ad0ab640 1 --2- 172.21.15.132:0/2925457824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc38806a430 0x7fc38806c8f0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7fc390036000 tx=0x7fc39003c040 comp rx=0 tx=0).stop 2023-12-20T04:43:31.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.246+0000 7fc3ad0ab640 1 -- 172.21.15.132:0/2925457824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3a815af00 msgr2=0x7fc3a80b5a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:31.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.246+0000 7fc3ad0ab640 1 --2- 172.21.15.132:0/2925457824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3a815af00 0x7fc3a80b5a50 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc3a0007ef0 tx=0x7fc3a000d4a0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.246+0000 7fc3ad0ab640 1 -- 172.21.15.132:0/2925457824 shutdown_connections 2023-12-20T04:43:31.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.246+0000 7fc3ad0ab640 1 --2- 172.21.15.132:0/2925457824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc38806a430 0x7fc38806c8f0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.246+0000 7fc3ad0ab640 1 --2- 172.21.15.132:0/2925457824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3a8160e80 0x7fc3a814c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.246+0000 7fc3ad0ab640 1 --2- 172.21.15.132:0/2925457824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3a815e570 0x7fc3a815fca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.246+0000 7fc3ad0ab640 1 --2- 172.21.15.132:0/2925457824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3a815af00 0x7fc3a80b5a50 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.246+0000 7fc3ad0ab640 1 -- 172.21.15.132:0/2925457824 >> 172.21.15.132:0/2925457824 conn(0x7fc3a806d640 msgr2=0x7fc3a806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:31.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.246+0000 7fc3ad0ab640 1 -- 172.21.15.132:0/2925457824 shutdown_connections 2023-12-20T04:43:31.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.246+0000 7fc3ad0ab640 1 -- 172.21.15.132:0/2925457824 wait complete. 2023-12-20T04:43:31.259 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi187.front.sepia.ceph.com... 2023-12-20T04:43:31.259 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:31.259 DEBUG:teuthology.orchestra.run.smithi187:> sudo fusermount -u /home/ubuntu/cephtest/mnt.3 2023-12-20T04:43:31.293 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:43:31.294 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:43:31.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:31.294 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-20T04:43:31.351 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-20T04:43:31.351 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:43:31.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.451+0000 7fa1d3dcb640 1 Processor -- start 2023-12-20T04:43:31.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.451+0000 7fa1d3dcb640 1 -- start start 2023-12-20T04:43:31.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.452+0000 7fa1d3dcb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa1cc159b50 0x7fa1cc0c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.452+0000 7fa1d3dcb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1cc06c240 0x7fa1cc06c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.452+0000 7fa1d3dcb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1cc0ccf30 con 0x7fa1cc15e530 2023-12-20T04:43:31.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.452+0000 7fa1d3dcb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1cc06cc10 con 0x7fa1cc06c240 2023-12-20T04:43:31.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.452+0000 7fa1d3dcb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa1cc0caa60 con 0x7fa1cc159b50 2023-12-20T04:43:31.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.452+0000 7fa1d2368640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1cc06c240 0x7fa1cc06c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.452+0000 7fa1d2368640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa1cc06c240 0x7fa1cc06c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55394/0 (socket says 172.21.15.132:55394) 2023-12-20T04:43:31.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.452+0000 7fa1d2368640 1 -- 172.21.15.132:0/2691227525 learned_addr learned my addr 172.21.15.132:0/2691227525 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:31.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.452+0000 7fa1d1b67640 1 --2- 172.21.15.132:0/2691227525 >> v2:172.21.15.187:3300/0 conn(0x7fa1cc159b50 0x7fa1cc0c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.452+0000 7fa1d2368640 1 -- 172.21.15.132:0/2691227525 >> v2:172.21.15.187:3300/0 conn(0x7fa1cc159b50 msgr2=0x7fa1cc0c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:31.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.452+0000 7fa1d2368640 1 --2- 172.21.15.132:0/2691227525 >> v2:172.21.15.187:3300/0 conn(0x7fa1cc159b50 0x7fa1cc0c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.452+0000 7fa1d2368640 1 -- 172.21.15.132:0/2691227525 >> v1:172.21.15.187:6789/0 conn(0x7fa1cc15e530 legacy=0x7fa1cc06fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:31.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.452+0000 7fa1d2368640 1 -- 172.21.15.132:0/2691227525 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1cc0ca1c0 con 0x7fa1cc06c240 2023-12-20T04:43:31.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.452+0000 7fa1d1b67640 1 --2- 172.21.15.132:0/2691227525 >> v2:172.21.15.187:3300/0 conn(0x7fa1cc159b50 0x7fa1cc0c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:31.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.453+0000 7fa1d2368640 1 --2- 172.21.15.132:0/2691227525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1cc06c240 0x7fa1cc06c6d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009e50 tx=0x7fa1c402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5cd9aef43bcaff server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:31.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.453+0000 7fa1d0b65640 1 -- 172.21.15.132:0/2691227525 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c402ca80 con 0x7fa1cc06c240 2023-12-20T04:43:31.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.453+0000 7fa1d0b65640 1 -- 172.21.15.132:0/2691227525 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c402cbe0 con 0x7fa1cc06c240 2023-12-20T04:43:31.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.453+0000 7fa1d0b65640 1 -- 172.21.15.132:0/2691227525 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c40343f0 con 0x7fa1cc06c240 2023-12-20T04:43:31.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.454+0000 7fa1d3dcb640 1 -- 172.21.15.132:0/2691227525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1cc06c240 msgr2=0x7fa1cc06c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:31.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.454+0000 7fa1d3dcb640 1 --2- 172.21.15.132:0/2691227525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1cc06c240 0x7fa1cc06c6d0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009e50 tx=0x7fa1c402bee0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.454+0000 7fa1d3dcb640 1 -- 172.21.15.132:0/2691227525 shutdown_connections 2023-12-20T04:43:31.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.454+0000 7fa1d3dcb640 1 --2- 172.21.15.132:0/2691227525 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1cc06c240 0x7fa1cc06c6d0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.454+0000 7fa1d3dcb640 1 --2- 172.21.15.132:0/2691227525 >> v2:172.21.15.187:3300/0 conn(0x7fa1cc159b50 0x7fa1cc0c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.454+0000 7fa1d3dcb640 1 -- 172.21.15.132:0/2691227525 >> 172.21.15.132:0/2691227525 conn(0x7fa1cc0ced10 msgr2=0x7fa1cc0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:31.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.454+0000 7fa1d3dcb640 1 -- 172.21.15.132:0/2691227525 shutdown_connections 2023-12-20T04:43:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.454+0000 7fa1d3dcb640 1 -- 172.21.15.132:0/2691227525 wait complete. 2023-12-20T04:43:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.455+0000 7fa1d3dcb640 1 Processor -- start 2023-12-20T04:43:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.455+0000 7fa1d3dcb640 1 -- start start 2023-12-20T04:43:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d3dcb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1cc06c240 0x7fa1cc150730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d3dcb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1cc159b50 0x7fa1cc15b710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d3dcb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1cc15e530 0x7fa1cc0c4970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d3dcb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc15ca90 con 0x7fa1cc15e530 2023-12-20T04:43:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d3dcb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc14f500 con 0x7fa1cc06c240 2023-12-20T04:43:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d3dcb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1cc0c4eb0 con 0x7fa1cc159b50 2023-12-20T04:43:31.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d2368640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1cc15e530 0x7fa1cc0c4970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d2368640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1cc15e530 0x7fa1cc0c4970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55402/0 (socket says 172.21.15.132:55402) 2023-12-20T04:43:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d2368640 1 -- 172.21.15.132:0/3327079943 learned_addr learned my addr 172.21.15.132:0/3327079943 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d1b67640 1 --2- 172.21.15.132:0/3327079943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1cc06c240 0x7fa1cc150730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d1366640 1 --2- 172.21.15.132:0/3327079943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1cc159b50 0x7fa1cc15b710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d2368640 1 -- 172.21.15.132:0/3327079943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1cc159b50 msgr2=0x7fa1cc15b710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d2368640 1 --2- 172.21.15.132:0/3327079943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1cc159b50 0x7fa1cc15b710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d2368640 1 -- 172.21.15.132:0/3327079943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1cc06c240 msgr2=0x7fa1cc150730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d2368640 1 --2- 172.21.15.132:0/3327079943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1cc06c240 0x7fa1cc150730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d2368640 1 -- 172.21.15.132:0/3327079943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1c4009b30 con 0x7fa1cc15e530 2023-12-20T04:43:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d1b67640 1 --2- 172.21.15.132:0/3327079943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1cc06c240 0x7fa1cc150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d2368640 1 --2- 172.21.15.132:0/3327079943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1cc15e530 0x7fa1cc0c4970 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009e50 tx=0x7fa1c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1c27fc640 1 -- 172.21.15.132:0/3327079943 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c4009510 con 0x7fa1cc15e530 2023-12-20T04:43:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1c27fc640 1 -- 172.21.15.132:0/3327079943 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1c403e450 con 0x7fa1cc15e530 2023-12-20T04:43:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d3dcb640 1 -- 172.21.15.132:0/3327079943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1cc15be10 con 0x7fa1cc15e530 2023-12-20T04:43:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1c27fc640 1 -- 172.21.15.132:0/3327079943 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1c403e800 con 0x7fa1cc15e530 2023-12-20T04:43:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.456+0000 7fa1d3dcb640 1 -- 172.21.15.132:0/3327079943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1cc15c3d0 con 0x7fa1cc15e530 2023-12-20T04:43:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.457+0000 7fa1d3dcb640 1 -- 172.21.15.132:0/3327079943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1cc15cbd0 con 0x7fa1cc15e530 2023-12-20T04:43:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.458+0000 7fa1c27fc640 1 -- 172.21.15.132:0/3327079943 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa1c402cd50 con 0x7fa1cc15e530 2023-12-20T04:43:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.458+0000 7fa1c27fc640 1 --2- 172.21.15.132:0/3327079943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa1b006a430 0x7fa1b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.458+0000 7fa1d1b67640 1 --2- 172.21.15.132:0/3327079943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa1b006a430 0x7fa1b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.458+0000 7fa1c27fc640 1 -- 172.21.15.132:0/3327079943 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa1c40ab3e0 con 0x7fa1cc15e530 2023-12-20T04:43:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.459+0000 7fa1d1b67640 1 --2- 172.21.15.132:0/3327079943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa1b006a430 0x7fa1b006c8f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800aa30 tx=0x7fa1c8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.462+0000 7fa1c27fc640 1 -- 172.21.15.132:0/3327079943 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa1cc15cbd0 con 0x7fa1cc15e530 2023-12-20T04:43:31.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.664+0000 7fa1d3dcb640 1 -- 172.21.15.132:0/3327079943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa1cc15cbd0 con 0x7fa1cc15e530 2023-12-20T04:43:31.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.665+0000 7fa1c27fc640 1 -- 172.21.15.132:0/3327079943 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4709 (secure 0 0 0) 0x7fa1cc15cbd0 con 0x7fa1cc15e530 2023-12-20T04:43:31.667 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:31.667 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/342123967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":342123967},{"type":"v1","addr":"172.21.15.187:6835","nonce":342123967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2678730048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2678730048},{"type":"v1","addr":"172.21.15.132:6836","nonce":2678730048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2874427434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2874427434},{"type":"v1","addr":"172.21.15.132:6837","nonce":2874427434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:42:47.150648+0000","modified":"2023-12-20T04:42:49.158537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/839566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":839566266},{"type":"v1","addr":"172.21.15.187:6834","nonce":839566266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-20T04:43:31.669 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2023-12-20T04:43:31.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.666+0000 7fa1d3dcb640 1 -- 172.21.15.132:0/3327079943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa1b006a430 msgr2=0x7fa1b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:31.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.667+0000 7fa1d3dcb640 1 --2- 172.21.15.132:0/3327079943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa1b006a430 0x7fa1b006c8f0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800aa30 tx=0x7fa1c8008040 comp rx=0 tx=0).stop 2023-12-20T04:43:31.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.667+0000 7fa1d3dcb640 1 -- 172.21.15.132:0/3327079943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1cc15e530 msgr2=0x7fa1cc0c4970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:31.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.667+0000 7fa1d3dcb640 1 --2- 172.21.15.132:0/3327079943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1cc15e530 0x7fa1cc0c4970 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa1c4009e50 tx=0x7fa1c4004a40 comp rx=0 tx=0).stop 2023-12-20T04:43:31.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.667+0000 7fa1d3dcb640 1 -- 172.21.15.132:0/3327079943 shutdown_connections 2023-12-20T04:43:31.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.667+0000 7fa1d3dcb640 1 --2- 172.21.15.132:0/3327079943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa1b006a430 0x7fa1b006c8f0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.667+0000 7fa1d3dcb640 1 --2- 172.21.15.132:0/3327079943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa1cc15e530 0x7fa1cc0c4970 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.667+0000 7fa1d3dcb640 1 --2- 172.21.15.132:0/3327079943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1cc159b50 0x7fa1cc15b710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.667+0000 7fa1d3dcb640 1 --2- 172.21.15.132:0/3327079943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1cc06c240 0x7fa1cc150730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.667+0000 7fa1d3dcb640 1 -- 172.21.15.132:0/3327079943 >> 172.21.15.132:0/3327079943 conn(0x7fa1cc0ced10 msgr2=0x7fa1cc158ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:31.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.667+0000 7fa1d3dcb640 1 -- 172.21.15.132:0/3327079943 shutdown_connections 2023-12-20T04:43:31.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.667+0000 7fa1d3dcb640 1 -- 172.21.15.132:0/3327079943 wait complete. 2023-12-20T04:43:31.680 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:31.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.778+0000 7fe791e84640 1 Processor -- start 2023-12-20T04:43:31.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.778+0000 7fe791e84640 1 -- start start 2023-12-20T04:43:31.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.778+0000 7fe791e84640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe78c15d100 0x7fe78c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.778+0000 7fe791e84640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78c0cdc10 0x7fe78c06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.778+0000 7fe791e84640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe78c0b2f90 con 0x7fe78c0d0370 2023-12-20T04:43:31.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe791e84640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe78c1613c0 con 0x7fe78c15d100 2023-12-20T04:43:31.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe791e84640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c0d1b00 con 0x7fe78c0cdc10 2023-12-20T04:43:31.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78affd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe78c0d0370 0x7fe78c0cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40660/0 (socket says 172.21.15.132:40660) 2023-12-20T04:43:31.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78affd640 1 -- 172.21.15.132:0/987960742 learned_addr learned my addr 172.21.15.132:0/987960742 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:31.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78bfff640 1 --2- 172.21.15.132:0/987960742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78c0cdc10 0x7fe78c06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78b7fe640 1 --2- 172.21.15.132:0/987960742 >> v2:172.21.15.187:3300/0 conn(0x7fe78c15d100 0x7fe78c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78a7fc640 1 -- 172.21.15.132:0/987960742 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4252255887 0 0) 0x7fe780001110 con 0x7fe78c0d0370 2023-12-20T04:43:31.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78a7fc640 1 -- 172.21.15.132:0/987960742 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe774003520 con 0x7fe78c0d0370 2023-12-20T04:43:31.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78a7fc640 1 -- 172.21.15.132:0/987960742 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1585185366 0 0) 0x7fe774003520 con 0x7fe78c0d0370 2023-12-20T04:43:31.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78a7fc640 1 -- 172.21.15.132:0/987960742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78c0cdc10 msgr2=0x7fe78c06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:31.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78a7fc640 1 --2- 172.21.15.132:0/987960742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78c0cdc10 0x7fe78c06c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78a7fc640 1 -- 172.21.15.132:0/987960742 >> v2:172.21.15.187:3300/0 conn(0x7fe78c15d100 msgr2=0x7fe78c0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:31.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78a7fc640 1 --2- 172.21.15.132:0/987960742 >> v2:172.21.15.187:3300/0 conn(0x7fe78c15d100 0x7fe78c0b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78a7fc640 1 -- 172.21.15.132:0/987960742 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c0d0810 con 0x7fe78c0d0370 2023-12-20T04:43:31.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78a7fc640 1 -- 172.21.15.132:0/987960742 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fe780001800 con 0x7fe78c0d0370 2023-12-20T04:43:31.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78a7fc640 1 -- 172.21.15.132:0/987960742 >> v1:172.21.15.132:6789/0 conn(0x7fe78c0d0370 legacy=0x7fe78c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:31.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78a7fc640 1 --2- 172.21.15.132:0/987960742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe774003970 0x7fe774003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78a7fc640 1 --2- 172.21.15.132:0/987960742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7740047c0 0x7fe774004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78a7fc640 1 --2- 172.21.15.132:0/987960742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78c0cdc10 0x7fe774005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78a7fc640 1 -- 172.21.15.132:0/987960742 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c1613c0 con 0x7fe774003970 2023-12-20T04:43:31.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78a7fc640 1 -- 172.21.15.132:0/987960742 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c0d1b00 con 0x7fe7740047c0 2023-12-20T04:43:31.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78a7fc640 1 -- 172.21.15.132:0/987960742 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe77400b980 con 0x7fe78c0cdc10 2023-12-20T04:43:31.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78b7fe640 1 --2- 172.21.15.132:0/987960742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe774003970 0x7fe774003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78affd640 1 --2- 172.21.15.132:0/987960742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7740047c0 0x7fe774004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.779+0000 7fe78bfff640 1 --2- 172.21.15.132:0/987960742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78c0cdc10 0x7fe774005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.780+0000 7fe78b7fe640 1 -- 172.21.15.132:0/987960742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78c0cdc10 msgr2=0x7fe774005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:31.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.780+0000 7fe78b7fe640 1 --2- 172.21.15.132:0/987960742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78c0cdc10 0x7fe774005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.780+0000 7fe78b7fe640 1 -- 172.21.15.132:0/987960742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7740047c0 msgr2=0x7fe774004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:31.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.780+0000 7fe78b7fe640 1 --2- 172.21.15.132:0/987960742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7740047c0 0x7fe774004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.780+0000 7fe78b7fe640 1 -- 172.21.15.132:0/987960742 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe774003520 con 0x7fe774003970 2023-12-20T04:43:31.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.780+0000 7fe78affd640 1 --2- 172.21.15.132:0/987960742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7740047c0 0x7fe774004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:31.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.780+0000 7fe78b7fe640 1 --2- 172.21.15.132:0/987960742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe774003970 0x7fe774003d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009ac0 tx=0x7fe7740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa49c0a776ea22c8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:31.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.780+0000 7fe78a7fc640 1 -- 172.21.15.132:0/987960742 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c02c710 con 0x7fe774003970 2023-12-20T04:43:31.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.780+0000 7fe78a7fc640 1 -- 172.21.15.132:0/987960742 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c02c870 con 0x7fe774003970 2023-12-20T04:43:31.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.780+0000 7fe78a7fc640 1 -- 172.21.15.132:0/987960742 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c02cc00 con 0x7fe774003970 2023-12-20T04:43:31.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.781+0000 7fe791e84640 1 -- 172.21.15.132:0/987960742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe774003970 msgr2=0x7fe774003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:31.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.781+0000 7fe791e84640 1 --2- 172.21.15.132:0/987960742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe774003970 0x7fe774003d90 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7fe77c009ac0 tx=0x7fe7740057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.781+0000 7fe78bfff640 1 -- 172.21.15.132:0/987960742 reap_dead start 2023-12-20T04:43:31.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.781+0000 7fe791e84640 1 -- 172.21.15.132:0/987960742 shutdown_connections 2023-12-20T04:43:31.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.781+0000 7fe791e84640 1 -- 172.21.15.132:0/987960742 >> 172.21.15.132:0/987960742 conn(0x7fe78c06d7c0 msgr2=0x7fe78c06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:31.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.781+0000 7fe791e84640 1 -- 172.21.15.132:0/987960742 shutdown_connections 2023-12-20T04:43:31.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.781+0000 7fe791e84640 1 -- 172.21.15.132:0/987960742 wait complete. 2023-12-20T04:43:31.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.782+0000 7fe791e84640 1 Processor -- start 2023-12-20T04:43:31.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.782+0000 7fe791e84640 1 -- start start 2023-12-20T04:43:31.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.783+0000 7fe791e84640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe774003970 0x7fe78c15bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.783+0000 7fe791e84640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe78c1e86a0 0x7fe78c0b4310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.783+0000 7fe791e84640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78c0b4850 0x7fe78c0b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.783+0000 7fe791e84640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c0c4b10 con 0x7fe774003970 2023-12-20T04:43:31.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.783+0000 7fe791e84640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c1e8b30 con 0x7fe78c1e86a0 2023-12-20T04:43:31.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.783+0000 7fe791e84640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe78c1e8e10 con 0x7fe78c0b4850 2023-12-20T04:43:31.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.783+0000 7fe78b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe774003970 0x7fe78c15bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.783+0000 7fe78b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe774003970 0x7fe78c15bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55426/0 (socket says 172.21.15.132:55426) 2023-12-20T04:43:31.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.783+0000 7fe78b7fe640 1 -- 172.21.15.132:0/2708068755 learned_addr learned my addr 172.21.15.132:0/2708068755 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:31.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.783+0000 7fe78affd640 1 --2- 172.21.15.132:0/2708068755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe78c1e86a0 0x7fe78c0b4310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.783+0000 7fe78bfff640 1 --2- 172.21.15.132:0/2708068755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78c0b4850 0x7fe78c0b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.783+0000 7fe78b7fe640 1 -- 172.21.15.132:0/2708068755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78c0b4850 msgr2=0x7fe78c0b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:31.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.783+0000 7fe78b7fe640 1 --2- 172.21.15.132:0/2708068755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78c0b4850 0x7fe78c0b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.783+0000 7fe78b7fe640 1 -- 172.21.15.132:0/2708068755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe78c1e86a0 msgr2=0x7fe78c0b4310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:31.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.783+0000 7fe78b7fe640 1 --2- 172.21.15.132:0/2708068755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe78c1e86a0 0x7fe78c0b4310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.783+0000 7fe78b7fe640 1 -- 172.21.15.132:0/2708068755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe78c1e90f0 con 0x7fe774003970 2023-12-20T04:43:31.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.783+0000 7fe78affd640 1 --2- 172.21.15.132:0/2708068755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe78c1e86a0 0x7fe78c0b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:31.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.784+0000 7fe78b7fe640 1 --2- 172.21.15.132:0/2708068755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe774003970 0x7fe78c15bed0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe77c02c2b0 tx=0x7fe77c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:31.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.784+0000 7fe773fff640 1 -- 172.21.15.132:0/2708068755 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c003810 con 0x7fe774003970 2023-12-20T04:43:31.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.784+0000 7fe773fff640 1 -- 172.21.15.132:0/2708068755 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe77c02de90 con 0x7fe774003970 2023-12-20T04:43:31.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.784+0000 7fe791e84640 1 -- 172.21.15.132:0/2708068755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe78c0b64a0 con 0x7fe774003970 2023-12-20T04:43:31.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.784+0000 7fe773fff640 1 -- 172.21.15.132:0/2708068755 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe77c003bb0 con 0x7fe774003970 2023-12-20T04:43:31.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.784+0000 7fe791e84640 1 -- 172.21.15.132:0/2708068755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe78c0b6970 con 0x7fe774003970 2023-12-20T04:43:31.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.785+0000 7fe791e84640 1 -- 172.21.15.132:0/2708068755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe78c1e8f50 con 0x7fe774003970 2023-12-20T04:43:31.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.785+0000 7fe773fff640 1 -- 172.21.15.132:0/2708068755 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe77c003d10 con 0x7fe774003970 2023-12-20T04:43:31.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.786+0000 7fe773fff640 1 --2- 172.21.15.132:0/2708068755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe77806a460 0x7fe77806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:31.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.786+0000 7fe78affd640 1 --2- 172.21.15.132:0/2708068755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe77806a460 0x7fe77806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:31.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.786+0000 7fe773fff640 1 -- 172.21.15.132:0/2708068755 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe77c0aa7f0 con 0x7fe774003970 2023-12-20T04:43:31.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.786+0000 7fe78affd640 1 --2- 172.21.15.132:0/2708068755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe77806a460 0x7fe77806c920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe780001010 tx=0x7fe780009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:31.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.790+0000 7fe773fff640 1 -- 172.21.15.132:0/2708068755 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe78c1e8f50 con 0x7fe774003970 2023-12-20T04:43:31.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.956+0000 7fe791e84640 1 -- 172.21.15.132:0/2708068755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe78c1e8f50 con 0x7fe774003970 2023-12-20T04:43:31.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.957+0000 7fe773fff640 1 -- 172.21.15.132:0/2708068755 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fe78c1e8f50 con 0x7fe774003970 2023-12-20T04:43:31.959 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:31.959 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.959+0000 7fe791e84640 1 -- 172.21.15.132:0/2708068755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe77806a460 msgr2=0x7fe77806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.959+0000 7fe791e84640 1 --2- 172.21.15.132:0/2708068755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe77806a460 0x7fe77806c920 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe780001010 tx=0x7fe780009040 comp rx=0 tx=0).stop 2023-12-20T04:43:31.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.959+0000 7fe791e84640 1 -- 172.21.15.132:0/2708068755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe774003970 msgr2=0x7fe78c15bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.959+0000 7fe791e84640 1 --2- 172.21.15.132:0/2708068755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe774003970 0x7fe78c15bed0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe77c02c2b0 tx=0x7fe77c004730 comp rx=0 tx=0).stop 2023-12-20T04:43:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.959+0000 7fe791e84640 1 -- 172.21.15.132:0/2708068755 shutdown_connections 2023-12-20T04:43:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.959+0000 7fe791e84640 1 --2- 172.21.15.132:0/2708068755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe77806a460 0x7fe77806c920 secure :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe780001010 tx=0x7fe780009040 comp rx=0 tx=0).stop 2023-12-20T04:43:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.959+0000 7fe791e84640 1 --2- 172.21.15.132:0/2708068755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe78c0b4850 0x7fe78c0b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.959+0000 7fe791e84640 1 --2- 172.21.15.132:0/2708068755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe78c1e86a0 0x7fe78c0b4310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.959+0000 7fe791e84640 1 --2- 172.21.15.132:0/2708068755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe774003970 0x7fe78c15bed0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.959+0000 7fe791e84640 1 -- 172.21.15.132:0/2708068755 >> 172.21.15.132:0/2708068755 conn(0x7fe78c06d7c0 msgr2=0x7fe78c0b1650 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.959+0000 7fe791e84640 1 -- 172.21.15.132:0/2708068755 shutdown_connections 2023-12-20T04:43:31.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:31.959+0000 7fe791e84640 1 -- 172.21.15.132:0/2708068755 wait complete. 2023-12-20T04:43:31.972 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:42:45.433456+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:42:46.128920+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:43:31.972 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:43:32.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.074+0000 7fa28f947640 1 Processor -- start 2023-12-20T04:43:32.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.075+0000 7fa28f947640 1 -- start start 2023-12-20T04:43:32.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.075+0000 7fa28f947640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2880cdbc0 0x7fa28806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.075+0000 7fa28f947640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa28806cc90 con 0x7fa28815d300 2023-12-20T04:43:32.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.075+0000 7fa28f947640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2880b2f30 con 0x7fa28815cf20 2023-12-20T04:43:32.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.075+0000 7fa28f947640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2880b3210 con 0x7fa2880cdbc0 2023-12-20T04:43:32.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.075+0000 7fa28cee2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa28815d300 0x7fa2880cd4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40662/0 (socket says 172.21.15.132:40662) 2023-12-20T04:43:32.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.075+0000 7fa28cee2640 1 -- 172.21.15.132:0/3825841138 learned_addr learned my addr 172.21.15.132:0/3825841138 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:32.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa28dee4640 1 --2- 172.21.15.132:0/3825841138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2880cdbc0 0x7fa28806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa27ffff640 1 -- 172.21.15.132:0/3825841138 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1397330737 0 0) 0x7fa28806cc90 con 0x7fa28815d300 2023-12-20T04:43:32.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa27ffff640 1 -- 172.21.15.132:0/3825841138 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa274003520 con 0x7fa28815d300 2023-12-20T04:43:32.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa27ffff640 1 -- 172.21.15.132:0/3825841138 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2155751255 0 0) 0x7fa2880b2f30 con 0x7fa28815cf20 2023-12-20T04:43:32.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa27ffff640 1 -- 172.21.15.132:0/3825841138 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa28806cc90 con 0x7fa28815cf20 2023-12-20T04:43:32.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa27ffff640 1 -- 172.21.15.132:0/3825841138 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2288291374 0 0) 0x7fa274003520 con 0x7fa28815d300 2023-12-20T04:43:32.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa27ffff640 1 -- 172.21.15.132:0/3825841138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2880cdbc0 msgr2=0x7fa28806c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:32.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa27ffff640 1 --2- 172.21.15.132:0/3825841138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2880cdbc0 0x7fa28806c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa27ffff640 1 -- 172.21.15.132:0/3825841138 >> v1:172.21.15.187:6789/0 conn(0x7fa28815cf20 legacy=0x7fa288161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa27ffff640 1 -- 172.21.15.132:0/3825841138 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2880b34f0 con 0x7fa28815d300 2023-12-20T04:43:32.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa27ffff640 1 -- 172.21.15.132:0/3825841138 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fa278001670 con 0x7fa28815d300 2023-12-20T04:43:32.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa27ffff640 1 -- 172.21.15.132:0/3825841138 >> v1:172.21.15.132:6789/0 conn(0x7fa28815d300 legacy=0x7fa2880cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa27ffff640 1 --2- 172.21.15.132:0/3825841138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa274003b30 0x7fa274003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa27ffff640 1 --2- 172.21.15.132:0/3825841138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2880cdbc0 0x7fa2740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa27ffff640 1 --2- 172.21.15.132:0/3825841138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa274004d00 0x7fa274005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa27ffff640 1 -- 172.21.15.132:0/3825841138 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2880b3210 con 0x7fa274004d00 2023-12-20T04:43:32.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa27ffff640 1 -- 172.21.15.132:0/3825841138 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa27400ba30 con 0x7fa274003b30 2023-12-20T04:43:32.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa27ffff640 1 -- 172.21.15.132:0/3825841138 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa27400bbf0 con 0x7fa2880cdbc0 2023-12-20T04:43:32.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa28dee4640 1 --2- 172.21.15.132:0/3825841138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa274004d00 0x7fa274005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa28cee2640 1 --2- 172.21.15.132:0/3825841138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2880cdbc0 0x7fa2740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa28d6e3640 1 --2- 172.21.15.132:0/3825841138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa274003b30 0x7fa274003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa28dee4640 1 -- 172.21.15.132:0/3825841138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2880cdbc0 msgr2=0x7fa2740047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:32.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa28dee4640 1 --2- 172.21.15.132:0/3825841138 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2880cdbc0 0x7fa2740047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa28dee4640 1 -- 172.21.15.132:0/3825841138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa274003b30 msgr2=0x7fa274003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:32.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa28dee4640 1 --2- 172.21.15.132:0/3825841138 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa274003b30 0x7fa274003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.076+0000 7fa28dee4640 1 -- 172.21.15.132:0/3825841138 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa274003520 con 0x7fa274004d00 2023-12-20T04:43:32.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.077+0000 7fa28dee4640 1 --2- 172.21.15.132:0/3825841138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa274004d00 0x7fa274005180 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa28806ebe0 tx=0x7fa2740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da850dd4c08d6f35 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:32.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.077+0000 7fa27ffff640 1 -- 172.21.15.132:0/3825841138 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28002c660 con 0x7fa274004d00 2023-12-20T04:43:32.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.077+0000 7fa27ffff640 1 -- 172.21.15.132:0/3825841138 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa28002c7c0 con 0x7fa274004d00 2023-12-20T04:43:32.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.077+0000 7fa27ffff640 1 -- 172.21.15.132:0/3825841138 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa28002cb50 con 0x7fa274004d00 2023-12-20T04:43:32.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.078+0000 7fa28f947640 1 -- 172.21.15.132:0/3825841138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa274004d00 msgr2=0x7fa274005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.078+0000 7fa28f947640 1 --2- 172.21.15.132:0/3825841138 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa274004d00 0x7fa274005180 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7fa28806ebe0 tx=0x7fa2740057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.078+0000 7fa28dee4640 1 -- 172.21.15.132:0/3825841138 reap_dead start 2023-12-20T04:43:32.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.078+0000 7fa28f947640 1 -- 172.21.15.132:0/3825841138 shutdown_connections 2023-12-20T04:43:32.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.078+0000 7fa28f947640 1 -- 172.21.15.132:0/3825841138 >> 172.21.15.132:0/3825841138 conn(0x7fa288072c60 msgr2=0x7fa288073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:32.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.078+0000 7fa28f947640 1 -- 172.21.15.132:0/3825841138 shutdown_connections 2023-12-20T04:43:32.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.078+0000 7fa28f947640 1 -- 172.21.15.132:0/3825841138 wait complete. 2023-12-20T04:43:32.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.079+0000 7fa28f947640 1 Processor -- start 2023-12-20T04:43:32.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.079+0000 7fa28f947640 1 -- start start 2023-12-20T04:43:32.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28f947640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa274004d00 0x7fa2880c6f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28f947640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2880c4790 0x7fa2881611d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28f947640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa288161710 0x7fa2880b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28f947640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa288161ba0 con 0x7fa288161710 2023-12-20T04:43:32.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28f947640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2880b4d60 con 0x7fa2880c4790 2023-12-20T04:43:32.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28f947640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2880c4bf0 con 0x7fa274004d00 2023-12-20T04:43:32.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28dee4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa288161710 0x7fa2880b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28dee4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa288161710 0x7fa2880b5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55446/0 (socket says 172.21.15.132:55446) 2023-12-20T04:43:32.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28dee4640 1 -- 172.21.15.132:0/931672987 learned_addr learned my addr 172.21.15.132:0/931672987 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:32.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28d6e3640 1 --2- 172.21.15.132:0/931672987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa274004d00 0x7fa2880c6f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28cee2640 1 --2- 172.21.15.132:0/931672987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2880c4790 0x7fa2881611d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28dee4640 1 -- 172.21.15.132:0/931672987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa274004d00 msgr2=0x7fa2880c6f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28dee4640 1 --2- 172.21.15.132:0/931672987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa274004d00 0x7fa2880c6f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28dee4640 1 -- 172.21.15.132:0/931672987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2880c4790 msgr2=0x7fa2881611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28dee4640 1 --2- 172.21.15.132:0/931672987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2880c4790 0x7fa2881611d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28dee4640 1 -- 172.21.15.132:0/931672987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2880b4fe0 con 0x7fa288161710 2023-12-20T04:43:32.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28d6e3640 1 --2- 172.21.15.132:0/931672987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa274004d00 0x7fa2880c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:32.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28cee2640 1 --2- 172.21.15.132:0/931672987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2880c4790 0x7fa2881611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:32.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.080+0000 7fa28dee4640 1 --2- 172.21.15.132:0/931672987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa288161710 0x7fa2880b5aa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa280009b80 tx=0x7fa280004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:32.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.081+0000 7fa27dffb640 1 -- 172.21.15.132:0/931672987 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2800044c0 con 0x7fa288161710 2023-12-20T04:43:32.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.081+0000 7fa27dffb640 1 -- 172.21.15.132:0/931672987 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa280003610 con 0x7fa288161710 2023-12-20T04:43:32.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.081+0000 7fa28f947640 1 -- 172.21.15.132:0/931672987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2880c7550 con 0x7fa288161710 2023-12-20T04:43:32.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.081+0000 7fa27dffb640 1 -- 172.21.15.132:0/931672987 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2800039a0 con 0x7fa288161710 2023-12-20T04:43:32.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.081+0000 7fa28f947640 1 -- 172.21.15.132:0/931672987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2880b5580 con 0x7fa288161710 2023-12-20T04:43:32.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.082+0000 7fa28f947640 1 -- 172.21.15.132:0/931672987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa28804e840 con 0x7fa288161710 2023-12-20T04:43:32.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.082+0000 7fa27dffb640 1 -- 172.21.15.132:0/931672987 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa280003b00 con 0x7fa288161710 2023-12-20T04:43:32.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.083+0000 7fa27dffb640 1 --2- 172.21.15.132:0/931672987 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa26c06a430 0x7fa26c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.083+0000 7fa28d6e3640 1 --2- 172.21.15.132:0/931672987 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa26c06a430 0x7fa26c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.083+0000 7fa27dffb640 1 -- 172.21.15.132:0/931672987 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa280000e40 con 0x7fa288161710 2023-12-20T04:43:32.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.083+0000 7fa28d6e3640 1 --2- 172.21.15.132:0/931672987 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa26c06a430 0x7fa26c06c8f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa284003f10 tx=0x7fa284009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:32.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.088+0000 7fa27dffb640 1 -- 172.21.15.132:0/931672987 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa2800754e0 con 0x7fa288161710 2023-12-20T04:43:32.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.250+0000 7fa28f947640 1 -- 172.21.15.132:0/931672987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fa2880cee10 con 0x7fa288161710 2023-12-20T04:43:32.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.250+0000 7fa27dffb640 1 -- 172.21.15.132:0/931672987 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v20) v1 ==== 93+0+10 (secure 0 0 0) 0x7fa280078b00 con 0x7fa288161710 2023-12-20T04:43:32.252 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:43:32.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.252+0000 7fa28f947640 1 -- 172.21.15.132:0/931672987 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa26c06a430 msgr2=0x7fa26c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.252+0000 7fa28f947640 1 --2- 172.21.15.132:0/931672987 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa26c06a430 0x7fa26c06c8f0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7fa284003f10 tx=0x7fa284009040 comp rx=0 tx=0).stop 2023-12-20T04:43:32.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.252+0000 7fa28f947640 1 -- 172.21.15.132:0/931672987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa288161710 msgr2=0x7fa2880b5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.252+0000 7fa28f947640 1 --2- 172.21.15.132:0/931672987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa288161710 0x7fa2880b5aa0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa280009b80 tx=0x7fa280004730 comp rx=0 tx=0).stop 2023-12-20T04:43:32.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.252+0000 7fa28f947640 1 -- 172.21.15.132:0/931672987 shutdown_connections 2023-12-20T04:43:32.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.252+0000 7fa28f947640 1 --2- 172.21.15.132:0/931672987 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa26c06a430 0x7fa26c06c8f0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.252+0000 7fa28f947640 1 --2- 172.21.15.132:0/931672987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa288161710 0x7fa2880b5aa0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.252+0000 7fa28f947640 1 --2- 172.21.15.132:0/931672987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2880c4790 0x7fa2881611d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.252+0000 7fa28f947640 1 --2- 172.21.15.132:0/931672987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa274004d00 0x7fa2880c6f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.252+0000 7fa28f947640 1 -- 172.21.15.132:0/931672987 >> 172.21.15.132:0/931672987 conn(0x7fa288072c60 msgr2=0x7fa288160060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:32.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.252+0000 7fa28f947640 1 -- 172.21.15.132:0/931672987 shutdown_connections 2023-12-20T04:43:32.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.252+0000 7fa28f947640 1 -- 172.21.15.132:0/931672987 wait complete. 2023-12-20T04:43:32.265 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:43:32.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.365+0000 7febeb607640 1 Processor -- start 2023-12-20T04:43:32.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.365+0000 7febeb607640 1 -- start start 2023-12-20T04:43:32.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.366+0000 7febeb607640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7febe4072c60 0x7febe4161520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.366+0000 7febeb607640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe4161a60 con 0x7febe415cf60 2023-12-20T04:43:32.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.366+0000 7febeb607640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7febe40731d0 con 0x7febe406c2a0 2023-12-20T04:43:32.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.366+0000 7febeb607640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7febe406cca0 con 0x7febe4072c60 2023-12-20T04:43:32.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.366+0000 7febe93a3640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7febe415cf60 0x7febe406bb90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40666/0 (socket says 172.21.15.132:40666) 2023-12-20T04:43:32.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.366+0000 7febe93a3640 1 -- 172.21.15.132:0/3422396446 learned_addr learned my addr 172.21.15.132:0/3422396446 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:32.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.366+0000 7febe9ba4640 1 --2- 172.21.15.132:0/3422396446 >> v2:172.21.15.132:3300/0 conn(0x7febe4072c60 0x7febe4161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.366+0000 7febe9ba4640 1 -- 172.21.15.132:0/3422396446 >> v1:172.21.15.187:6789/0 conn(0x7febe406c2a0 legacy=0x7febe40ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.366+0000 7febe9ba4640 1 -- 172.21.15.132:0/3422396446 >> v1:172.21.15.132:6789/0 conn(0x7febe415cf60 legacy=0x7febe406bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.366+0000 7febe9ba4640 1 -- 172.21.15.132:0/3422396446 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febe40ae4d0 con 0x7febe4072c60 2023-12-20T04:43:32.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.367+0000 7febe9ba4640 1 --2- 172.21.15.132:0/3422396446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe4072c60 0x7febe4161520 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7febdc0097a0 tx=0x7febdc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f7e563860a59071 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:32.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.367+0000 7febdbfff640 1 -- 172.21.15.132:0/3422396446 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc030610 con 0x7febe4072c60 2023-12-20T04:43:32.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.367+0000 7febdbfff640 1 -- 172.21.15.132:0/3422396446 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc030770 con 0x7febe4072c60 2023-12-20T04:43:32.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.367+0000 7febdbfff640 1 -- 172.21.15.132:0/3422396446 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc030b00 con 0x7febe4072c60 2023-12-20T04:43:32.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.368+0000 7febeb607640 1 -- 172.21.15.132:0/3422396446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe4072c60 msgr2=0x7febe4161520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.368+0000 7febeb607640 1 --2- 172.21.15.132:0/3422396446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe4072c60 0x7febe4161520 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7febdc0097a0 tx=0x7febdc02b960 comp rx=0 tx=0).stop 2023-12-20T04:43:32.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.368+0000 7febeb607640 1 -- 172.21.15.132:0/3422396446 shutdown_connections 2023-12-20T04:43:32.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.368+0000 7febeb607640 1 --2- 172.21.15.132:0/3422396446 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe4072c60 0x7febe4161520 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.368+0000 7febeb607640 1 -- 172.21.15.132:0/3422396446 >> 172.21.15.132:0/3422396446 conn(0x7febe40cf2d0 msgr2=0x7febe40cf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:32.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.368+0000 7febeb607640 1 -- 172.21.15.132:0/3422396446 shutdown_connections 2023-12-20T04:43:32.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.368+0000 7febeb607640 1 -- 172.21.15.132:0/3422396446 wait complete. 2023-12-20T04:43:32.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.369+0000 7febeb607640 1 Processor -- start 2023-12-20T04:43:32.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.369+0000 7febeb607640 1 -- start start 2023-12-20T04:43:32.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febeb607640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febe406c2a0 0x7febe4154ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febeb607640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febe4072c60 0x7febe41f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febeb607640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe415cf60 0x7febe4070b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febeb607640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe40c4e60 con 0x7febe415cf60 2023-12-20T04:43:32.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febeb607640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7febe4155010 con 0x7febe406c2a0 2023-12-20T04:43:32.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febeb607640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7febe40c4530 con 0x7febe4072c60 2023-12-20T04:43:32.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febe9ba4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe415cf60 0x7febe4070b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febe9ba4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe415cf60 0x7febe4070b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55458/0 (socket says 172.21.15.132:55458) 2023-12-20T04:43:32.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febe9ba4640 1 -- 172.21.15.132:0/1757501729 learned_addr learned my addr 172.21.15.132:0/1757501729 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:32.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febe93a3640 1 --2- 172.21.15.132:0/1757501729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febe406c2a0 0x7febe4154ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febe8ba2640 1 --2- 172.21.15.132:0/1757501729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febe4072c60 0x7febe41f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febe9ba4640 1 -- 172.21.15.132:0/1757501729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febe4072c60 msgr2=0x7febe41f2e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febe9ba4640 1 --2- 172.21.15.132:0/1757501729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febe4072c60 0x7febe41f2e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febe9ba4640 1 -- 172.21.15.132:0/1757501729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febe406c2a0 msgr2=0x7febe4154ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febe9ba4640 1 --2- 172.21.15.132:0/1757501729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febe406c2a0 0x7febe4154ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febe9ba4640 1 -- 172.21.15.132:0/1757501729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7febdc009400 con 0x7febe415cf60 2023-12-20T04:43:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febe8ba2640 1 --2- 172.21.15.132:0/1757501729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febe4072c60 0x7febe41f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febe93a3640 1 --2- 172.21.15.132:0/1757501729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febe406c2a0 0x7febe4154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febe9ba4640 1 --2- 172.21.15.132:0/1757501729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe415cf60 0x7febe4070b80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7febdc0098c0 tx=0x7febdc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febd9ffb640 1 -- 172.21.15.132:0/1757501729 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc03e040 con 0x7febe415cf60 2023-12-20T04:43:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febd9ffb640 1 -- 172.21.15.132:0/1757501729 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7febdc039c10 con 0x7febe415cf60 2023-12-20T04:43:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febeb607640 1 -- 172.21.15.132:0/1757501729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7febe40c4810 con 0x7febe415cf60 2023-12-20T04:43:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.370+0000 7febd9ffb640 1 -- 172.21.15.132:0/1757501729 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7febdc030e10 con 0x7febe415cf60 2023-12-20T04:43:32.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.371+0000 7febeb607640 1 -- 172.21.15.132:0/1757501729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7febe4156d00 con 0x7febe415cf60 2023-12-20T04:43:32.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.372+0000 7febeb607640 1 -- 172.21.15.132:0/1757501729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7febe40c4fd0 con 0x7febe415cf60 2023-12-20T04:43:32.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.372+0000 7febd9ffb640 1 -- 172.21.15.132:0/1757501729 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7febdc04d3b0 con 0x7febe415cf60 2023-12-20T04:43:32.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.373+0000 7febd9ffb640 1 --2- 172.21.15.132:0/1757501729 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7febc806a430 0x7febc806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.373+0000 7febe93a3640 1 --2- 172.21.15.132:0/1757501729 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7febc806a430 0x7febc806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.373+0000 7febd9ffb640 1 -- 172.21.15.132:0/1757501729 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7febdc0aaea0 con 0x7febe415cf60 2023-12-20T04:43:32.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.373+0000 7febe93a3640 1 --2- 172.21.15.132:0/1757501729 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7febc806a430 0x7febc806c8f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7febe0005c00 tx=0x7febe0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:32.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.378+0000 7febd9ffb640 1 -- 172.21.15.132:0/1757501729 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7febdc076520 con 0x7febe415cf60 2023-12-20T04:43:32.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.544+0000 7febeb607640 1 -- 172.21.15.132:0/1757501729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7febe404e840 con 0x7febe415cf60 2023-12-20T04:43:32.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.545+0000 7febd9ffb640 1 -- 172.21.15.132:0/1757501729 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v20) v1 ==== 104+0+11 (secure 0 0 0) 0x7febdc049020 con 0x7febe415cf60 2023-12-20T04:43:32.546 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:43:32.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.546+0000 7febeb607640 1 -- 172.21.15.132:0/1757501729 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7febc806a430 msgr2=0x7febc806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.546+0000 7febeb607640 1 --2- 172.21.15.132:0/1757501729 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7febc806a430 0x7febc806c8f0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7febe0005c00 tx=0x7febe0009040 comp rx=0 tx=0).stop 2023-12-20T04:43:32.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.546+0000 7febeb607640 1 -- 172.21.15.132:0/1757501729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe415cf60 msgr2=0x7febe4070b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.546+0000 7febeb607640 1 --2- 172.21.15.132:0/1757501729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe415cf60 0x7febe4070b80 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7febdc0098c0 tx=0x7febdc004730 comp rx=0 tx=0).stop 2023-12-20T04:43:32.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.546+0000 7febeb607640 1 -- 172.21.15.132:0/1757501729 shutdown_connections 2023-12-20T04:43:32.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.546+0000 7febeb607640 1 --2- 172.21.15.132:0/1757501729 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7febc806a430 0x7febc806c8f0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.546+0000 7febeb607640 1 --2- 172.21.15.132:0/1757501729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7febe415cf60 0x7febe4070b80 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.546+0000 7febeb607640 1 --2- 172.21.15.132:0/1757501729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7febe4072c60 0x7febe41f2e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.546+0000 7febeb607640 1 --2- 172.21.15.132:0/1757501729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7febe406c2a0 0x7febe4154ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.546+0000 7febeb607640 1 -- 172.21.15.132:0/1757501729 >> 172.21.15.132:0/1757501729 conn(0x7febe40cf2d0 msgr2=0x7febe40ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:32.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.547+0000 7febeb607640 1 -- 172.21.15.132:0/1757501729 shutdown_connections 2023-12-20T04:43:32.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.547+0000 7febeb607640 1 -- 172.21.15.132:0/1757501729 wait complete. 2023-12-20T04:43:32.559 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:43:32.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.659+0000 7fdc1c19c640 1 Processor -- start 2023-12-20T04:43:32.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.660+0000 7fdc1c19c640 1 -- start start 2023-12-20T04:43:32.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.660+0000 7fdc1c19c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdc140cf790 0x7fdc140cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.660+0000 7fdc1c19c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc140b6080 0x7fdc140b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.660+0000 7fdc1c19c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc140d2920 con 0x7fdc1415d300 2023-12-20T04:43:32.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.660+0000 7fdc1c19c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc140d0180 con 0x7fdc140cf790 2023-12-20T04:43:32.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.660+0000 7fdc1c19c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc140d1d10 con 0x7fdc140b6080 2023-12-20T04:43:32.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.660+0000 7fdc19737640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdc140cf790 0x7fdc140cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.660+0000 7fdc19737640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdc140cf790 0x7fdc140cfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55464/0 (socket says 172.21.15.132:55464) 2023-12-20T04:43:32.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.660+0000 7fdc19737640 1 -- 172.21.15.132:0/3567451605 learned_addr learned my addr 172.21.15.132:0/3567451605 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:32.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.661+0000 7fdc1a739640 1 --2- 172.21.15.132:0/3567451605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc140b6080 0x7fdc140b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.661+0000 7fdc19737640 1 -- 172.21.15.132:0/3567451605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc140b6080 msgr2=0x7fdc140b64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:32.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.661+0000 7fdc19737640 1 --2- 172.21.15.132:0/3567451605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc140b6080 0x7fdc140b64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.661+0000 7fdc19737640 1 -- 172.21.15.132:0/3567451605 >> v1:172.21.15.187:6789/0 conn(0x7fdc1415d300 legacy=0x7fdc140d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.661+0000 7fdc19737640 1 -- 172.21.15.132:0/3567451605 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc140d1ff0 con 0x7fdc140cf790 2023-12-20T04:43:32.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.661+0000 7fdc19737640 1 --2- 172.21.15.132:0/3567451605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc140cf790 0x7fdc140cfc40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009870 tx=0x7fdc0802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb642d90ce49e0db server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:32.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.662+0000 7fdc18f36640 1 -- 172.21.15.132:0/3567451605 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08030840 con 0x7fdc140cf790 2023-12-20T04:43:32.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.662+0000 7fdc18f36640 1 -- 172.21.15.132:0/3567451605 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc080309a0 con 0x7fdc140cf790 2023-12-20T04:43:32.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.662+0000 7fdc18f36640 1 -- 172.21.15.132:0/3567451605 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc08030d30 con 0x7fdc140cf790 2023-12-20T04:43:32.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.662+0000 7fdc1c19c640 1 -- 172.21.15.132:0/3567451605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc140cf790 msgr2=0x7fdc140cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.662+0000 7fdc1c19c640 1 --2- 172.21.15.132:0/3567451605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc140cf790 0x7fdc140cfc40 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fdc08009870 tx=0x7fdc0802b980 comp rx=0 tx=0).stop 2023-12-20T04:43:32.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.662+0000 7fdc1c19c640 1 -- 172.21.15.132:0/3567451605 shutdown_connections 2023-12-20T04:43:32.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.662+0000 7fdc1c19c640 1 --2- 172.21.15.132:0/3567451605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc140b6080 0x7fdc140b64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.662+0000 7fdc1c19c640 1 --2- 172.21.15.132:0/3567451605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc140cf790 0x7fdc140cfc40 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.662+0000 7fdc1c19c640 1 -- 172.21.15.132:0/3567451605 >> 172.21.15.132:0/3567451605 conn(0x7fdc1406a3d0 msgr2=0x7fdc1406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:32.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.662+0000 7fdc1c19c640 1 -- 172.21.15.132:0/3567451605 shutdown_connections 2023-12-20T04:43:32.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.662+0000 7fdc1c19c640 1 -- 172.21.15.132:0/3567451605 wait complete. 2023-12-20T04:43:32.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.663+0000 7fdc1c19c640 1 Processor -- start 2023-12-20T04:43:32.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.663+0000 7fdc1c19c640 1 -- start start 2023-12-20T04:43:32.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.664+0000 7fdc1c19c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc140b6080 0x7fdc14150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.664+0000 7fdc1c19c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc140cf790 0x7fdc141f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.664+0000 7fdc1c19c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc1415d300 0x7fdc140cc360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.664+0000 7fdc1c19c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc14150990 con 0x7fdc140b6080 2023-12-20T04:43:32.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.664+0000 7fdc1c19c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc141f65d0 con 0x7fdc140cf790 2023-12-20T04:43:32.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.664+0000 7fdc1c19c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc141f68b0 con 0x7fdc1415d300 2023-12-20T04:43:32.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.664+0000 7fdc19f38640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc140b6080 0x7fdc14150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.664+0000 7fdc19f38640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc140b6080 0x7fdc14150450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55480/0 (socket says 172.21.15.132:55480) 2023-12-20T04:43:32.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.664+0000 7fdc19f38640 1 -- 172.21.15.132:0/2313126751 learned_addr learned my addr 172.21.15.132:0/2313126751 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.664+0000 7fdc19f38640 1 -- 172.21.15.132:0/2313126751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc1415d300 msgr2=0x7fdc140cc360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.664+0000 7fdc19f38640 1 --2- 172.21.15.132:0/2313126751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc1415d300 0x7fdc140cc360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.664+0000 7fdc19f38640 1 -- 172.21.15.132:0/2313126751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc140cf790 msgr2=0x7fdc141f5da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.664+0000 7fdc19f38640 1 --2- 172.21.15.132:0/2313126751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc140cf790 0x7fdc141f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.664+0000 7fdc19f38640 1 -- 172.21.15.132:0/2313126751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc080094d0 con 0x7fdc140b6080 2023-12-20T04:43:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.665+0000 7fdc19f38640 1 --2- 172.21.15.132:0/2313126751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc140b6080 0x7fdc14150450 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400c450 tx=0x7fdc0400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.665+0000 7fdc127fc640 1 -- 172.21.15.132:0/2313126751 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc040052d0 con 0x7fdc140b6080 2023-12-20T04:43:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.665+0000 7fdc127fc640 1 -- 172.21.15.132:0/2313126751 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc04005430 con 0x7fdc140b6080 2023-12-20T04:43:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.665+0000 7fdc1c19c640 1 -- 172.21.15.132:0/2313126751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc141f6b90 con 0x7fdc140b6080 2023-12-20T04:43:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.665+0000 7fdc127fc640 1 -- 172.21.15.132:0/2313126751 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc04003830 con 0x7fdc140b6080 2023-12-20T04:43:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.665+0000 7fdc1c19c640 1 -- 172.21.15.132:0/2313126751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc140ca220 con 0x7fdc140b6080 2023-12-20T04:43:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.666+0000 7fdc1c19c640 1 -- 172.21.15.132:0/2313126751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc1404e840 con 0x7fdc140b6080 2023-12-20T04:43:32.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.666+0000 7fdc127fc640 1 -- 172.21.15.132:0/2313126751 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdc04003990 con 0x7fdc140b6080 2023-12-20T04:43:32.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.666+0000 7fdc127fc640 1 --2- 172.21.15.132:0/2313126751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc0006a430 0x7fdc0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.667+0000 7fdc127fc640 1 -- 172.21.15.132:0/2313126751 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc04087f20 con 0x7fdc140b6080 2023-12-20T04:43:32.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.667+0000 7fdc19737640 1 --2- 172.21.15.132:0/2313126751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc0006a430 0x7fdc0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.667+0000 7fdc19737640 1 --2- 172.21.15.132:0/2313126751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc0006a430 0x7fdc0006c8f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdc08036000 tx=0x7fdc0803b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:32.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.671+0000 7fdc127fc640 1 -- 172.21.15.132:0/2313126751 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdc04053510 con 0x7fdc140b6080 2023-12-20T04:43:32.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.837+0000 7fdc1c19c640 1 -- 172.21.15.132:0/2313126751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fdc140b7680 con 0x7fdc140b6080 2023-12-20T04:43:32.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.837+0000 7fdc127fc640 1 -- 172.21.15.132:0/2313126751 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v20) v1 ==== 100+0+11 (secure 0 0 0) 0x7fdc04017020 con 0x7fdc140b6080 2023-12-20T04:43:32.839 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:43:32.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.839+0000 7fdc1c19c640 1 -- 172.21.15.132:0/2313126751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc0006a430 msgr2=0x7fdc0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.839+0000 7fdc1c19c640 1 --2- 172.21.15.132:0/2313126751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc0006a430 0x7fdc0006c8f0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fdc08036000 tx=0x7fdc0803b040 comp rx=0 tx=0).stop 2023-12-20T04:43:32.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.839+0000 7fdc1c19c640 1 -- 172.21.15.132:0/2313126751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc140b6080 msgr2=0x7fdc14150450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.839+0000 7fdc1c19c640 1 --2- 172.21.15.132:0/2313126751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc140b6080 0x7fdc14150450 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fdc0400c450 tx=0x7fdc0400c910 comp rx=0 tx=0).stop 2023-12-20T04:43:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.839+0000 7fdc1c19c640 1 -- 172.21.15.132:0/2313126751 shutdown_connections 2023-12-20T04:43:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.839+0000 7fdc1c19c640 1 --2- 172.21.15.132:0/2313126751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc0006a430 0x7fdc0006c8f0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.839+0000 7fdc1c19c640 1 --2- 172.21.15.132:0/2313126751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc1415d300 0x7fdc140cc360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.839+0000 7fdc1c19c640 1 --2- 172.21.15.132:0/2313126751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc140cf790 0x7fdc141f5da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.839+0000 7fdc1c19c640 1 --2- 172.21.15.132:0/2313126751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc140b6080 0x7fdc14150450 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.839+0000 7fdc1c19c640 1 -- 172.21.15.132:0/2313126751 >> 172.21.15.132:0/2313126751 conn(0x7fdc1406a3d0 msgr2=0x7fdc140b7ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.840+0000 7fdc1c19c640 1 -- 172.21.15.132:0/2313126751 shutdown_connections 2023-12-20T04:43:32.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.840+0000 7fdc1c19c640 1 -- 172.21.15.132:0/2313126751 wait complete. 2023-12-20T04:43:32.852 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:43:32.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.950+0000 7fc1f699f640 1 Processor -- start 2023-12-20T04:43:32.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.950+0000 7fc1f699f640 1 -- start start 2023-12-20T04:43:32.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.951+0000 7fc1f699f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1f00718e0 0x7fc1f00cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.951+0000 7fc1f699f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc1f006fd60 0x7fc1f0071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.951+0000 7fc1f699f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc1f00cbba0 con 0x7fc1f00ca8e0 2023-12-20T04:43:32.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.951+0000 7fc1f699f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc1f015b3f0 con 0x7fc1f006fd60 2023-12-20T04:43:32.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.951+0000 7fc1f699f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f0072200 con 0x7fc1f00718e0 2023-12-20T04:43:32.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.951+0000 7fc1f4f3c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc1f00ca8e0 0x7fc1f00b2180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40672/0 (socket says 172.21.15.132:40672) 2023-12-20T04:43:32.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.951+0000 7fc1f4f3c640 1 -- 172.21.15.132:0/1644671879 learned_addr learned my addr 172.21.15.132:0/1644671879 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:32.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.951+0000 7fc1effff640 1 --2- 172.21.15.132:0/1644671879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1f00718e0 0x7fc1f00cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.951+0000 7fc1ef7fe640 1 --2- 172.21.15.132:0/1644671879 >> v2:172.21.15.187:3300/0 conn(0x7fc1f006fd60 0x7fc1f0071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.951+0000 7fc1eeffd640 1 -- 172.21.15.132:0/1644671879 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1484948422 0 0) 0x7fc1e8001490 con 0x7fc1f00ca8e0 2023-12-20T04:43:32.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.951+0000 7fc1eeffd640 1 -- 172.21.15.132:0/1644671879 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc1d8003520 con 0x7fc1f00ca8e0 2023-12-20T04:43:32.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1eeffd640 1 -- 172.21.15.132:0/1644671879 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 455806503 0 0) 0x7fc1d8003520 con 0x7fc1f00ca8e0 2023-12-20T04:43:32.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1eeffd640 1 -- 172.21.15.132:0/1644671879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1f00718e0 msgr2=0x7fc1f00cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:32.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1eeffd640 1 --2- 172.21.15.132:0/1644671879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1f00718e0 0x7fc1f00cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1eeffd640 1 -- 172.21.15.132:0/1644671879 >> v2:172.21.15.187:3300/0 conn(0x7fc1f006fd60 msgr2=0x7fc1f0071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:32.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1eeffd640 1 --2- 172.21.15.132:0/1644671879 >> v2:172.21.15.187:3300/0 conn(0x7fc1f006fd60 0x7fc1f0071cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1eeffd640 1 -- 172.21.15.132:0/1644671879 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f006cde0 con 0x7fc1f00ca8e0 2023-12-20T04:43:32.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1eeffd640 1 -- 172.21.15.132:0/1644671879 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fc1e8001b80 con 0x7fc1f00ca8e0 2023-12-20T04:43:32.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1eeffd640 1 -- 172.21.15.132:0/1644671879 >> v1:172.21.15.132:6789/0 conn(0x7fc1f00ca8e0 legacy=0x7fc1f00b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1eeffd640 1 --2- 172.21.15.132:0/1644671879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1f00718e0 0x7fc1d8003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1eeffd640 1 --2- 172.21.15.132:0/1644671879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1d8003ef0 0x7fc1d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1eeffd640 1 --2- 172.21.15.132:0/1644671879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1d8004d00 0x7fc1d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1eeffd640 1 -- 172.21.15.132:0/1644671879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f015b3f0 con 0x7fc1d8003ef0 2023-12-20T04:43:32.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1eeffd640 1 -- 172.21.15.132:0/1644671879 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f0072200 con 0x7fc1d8004d00 2023-12-20T04:43:32.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1eeffd640 1 -- 172.21.15.132:0/1644671879 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1d800b9d0 con 0x7fc1f00718e0 2023-12-20T04:43:32.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1ef7fe640 1 --2- 172.21.15.132:0/1644671879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1d8003ef0 0x7fc1d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1effff640 1 --2- 172.21.15.132:0/1644671879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1f00718e0 0x7fc1d8003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1f4f3c640 1 --2- 172.21.15.132:0/1644671879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1d8004d00 0x7fc1d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1ef7fe640 1 -- 172.21.15.132:0/1644671879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1f00718e0 msgr2=0x7fc1d8003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:32.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1ef7fe640 1 --2- 172.21.15.132:0/1644671879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1f00718e0 0x7fc1d8003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1ef7fe640 1 -- 172.21.15.132:0/1644671879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1d8004d00 msgr2=0x7fc1d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:32.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1ef7fe640 1 --2- 172.21.15.132:0/1644671879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1d8004d00 0x7fc1d8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1ef7fe640 1 -- 172.21.15.132:0/1644671879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1d8003520 con 0x7fc1d8003ef0 2023-12-20T04:43:32.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.952+0000 7fc1f4f3c640 1 --2- 172.21.15.132:0/1644671879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1d8004d00 0x7fc1d8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:32.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.953+0000 7fc1ef7fe640 1 --2- 172.21.15.132:0/1644671879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1d8003ef0 0x7fc1d80047c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009af0 tx=0x7fc1d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc65e8061b3333d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:32.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.953+0000 7fc1eeffd640 1 -- 172.21.15.132:0/1644671879 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e402c710 con 0x7fc1d8003ef0 2023-12-20T04:43:32.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.953+0000 7fc1eeffd640 1 -- 172.21.15.132:0/1644671879 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e402c870 con 0x7fc1d8003ef0 2023-12-20T04:43:32.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.953+0000 7fc1eeffd640 1 -- 172.21.15.132:0/1644671879 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e402cc00 con 0x7fc1d8003ef0 2023-12-20T04:43:32.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.953+0000 7fc1f699f640 1 -- 172.21.15.132:0/1644671879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1d8003ef0 msgr2=0x7fc1d80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.953+0000 7fc1f699f640 1 --2- 172.21.15.132:0/1644671879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1d8003ef0 0x7fc1d80047c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4009af0 tx=0x7fc1d80057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.953+0000 7fc1f4f3c640 1 -- 172.21.15.132:0/1644671879 reap_dead start 2023-12-20T04:43:32.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.953+0000 7fc1f699f640 1 -- 172.21.15.132:0/1644671879 shutdown_connections 2023-12-20T04:43:32.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.953+0000 7fc1f699f640 1 -- 172.21.15.132:0/1644671879 >> 172.21.15.132:0/1644671879 conn(0x7fc1f00cf330 msgr2=0x7fc1f00cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:32.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.954+0000 7fc1f699f640 1 -- 172.21.15.132:0/1644671879 shutdown_connections 2023-12-20T04:43:32.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.954+0000 7fc1f699f640 1 -- 172.21.15.132:0/1644671879 wait complete. 2023-12-20T04:43:32.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.955+0000 7fc1f699f640 1 Processor -- start 2023-12-20T04:43:32.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.955+0000 7fc1f699f640 1 -- start start 2023-12-20T04:43:32.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1f699f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1d8003ef0 0x7fc1f01520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1f699f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f015bf40 0x7fc1f0159620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1f699f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1f00c6c20 0x7fc1f015d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1f699f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f00c61a0 con 0x7fc1f015bf40 2023-12-20T04:43:32.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1f699f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f01f3150 con 0x7fc1d8003ef0 2023-12-20T04:43:32.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1f699f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc1f0158330 con 0x7fc1f00c6c20 2023-12-20T04:43:32.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1ef7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f015bf40 0x7fc1f0159620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1ef7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f015bf40 0x7fc1f0159620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55492/0 (socket says 172.21.15.132:55492) 2023-12-20T04:43:32.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1ef7fe640 1 -- 172.21.15.132:0/1032622852 learned_addr learned my addr 172.21.15.132:0/1032622852 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:32.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1effff640 1 --2- 172.21.15.132:0/1032622852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1d8003ef0 0x7fc1f01520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1f4f3c640 1 --2- 172.21.15.132:0/1032622852 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1f00c6c20 0x7fc1f015d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1ef7fe640 1 -- 172.21.15.132:0/1032622852 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1f00c6c20 msgr2=0x7fc1f015d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1ef7fe640 1 --2- 172.21.15.132:0/1032622852 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1f00c6c20 0x7fc1f015d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1ef7fe640 1 -- 172.21.15.132:0/1032622852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1d8003ef0 msgr2=0x7fc1f01520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:32.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1ef7fe640 1 --2- 172.21.15.132:0/1032622852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1d8003ef0 0x7fc1f01520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:32.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1ef7fe640 1 -- 172.21.15.132:0/1032622852 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc1f0159190 con 0x7fc1f015bf40 2023-12-20T04:43:32.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1effff640 1 --2- 172.21.15.132:0/1032622852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1d8003ef0 0x7fc1f01520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:32.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1ef7fe640 1 --2- 172.21.15.132:0/1032622852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f015bf40 0x7fc1f0159620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4037040 tx=0x7fc1e4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:32.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1ecff9640 1 -- 172.21.15.132:0/1032622852 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4003810 con 0x7fc1f015bf40 2023-12-20T04:43:32.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1ecff9640 1 -- 172.21.15.132:0/1032622852 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc1e402de90 con 0x7fc1f015bf40 2023-12-20T04:43:32.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1f699f640 1 -- 172.21.15.132:0/1032622852 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc1f0158580 con 0x7fc1f015bf40 2023-12-20T04:43:32.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1ecff9640 1 -- 172.21.15.132:0/1032622852 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc1e4003b70 con 0x7fc1f015bf40 2023-12-20T04:43:32.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.956+0000 7fc1f699f640 1 -- 172.21.15.132:0/1032622852 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1f0158b40 con 0x7fc1f015bf40 2023-12-20T04:43:32.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.957+0000 7fc1f699f640 1 -- 172.21.15.132:0/1032622852 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1f0159320 con 0x7fc1f015bf40 2023-12-20T04:43:32.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.958+0000 7fc1ecff9640 1 -- 172.21.15.132:0/1032622852 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc1e4003cd0 con 0x7fc1f015bf40 2023-12-20T04:43:32.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.958+0000 7fc1ecff9640 1 --2- 172.21.15.132:0/1032622852 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc1dc06a460 0x7fc1dc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:32.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.958+0000 7fc1ecff9640 1 -- 172.21.15.132:0/1032622852 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc1e40aa790 con 0x7fc1f015bf40 2023-12-20T04:43:32.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.958+0000 7fc1effff640 1 --2- 172.21.15.132:0/1032622852 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc1dc06a460 0x7fc1dc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:32.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.958+0000 7fc1effff640 1 --2- 172.21.15.132:0/1032622852 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc1dc06a460 0x7fc1dc06c920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009ae0 tx=0x7fc1e0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:32.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:32.962+0000 7fc1ecff9640 1 -- 172.21.15.132:0/1032622852 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc1e4075e10 con 0x7fc1f015bf40 2023-12-20T04:43:33.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.163+0000 7fc1f699f640 1 -- 172.21.15.132:0/1032622852 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc1f004e840 con 0x7fc1f015bf40 2023-12-20T04:43:33.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.163+0000 7fc1ecff9640 1 -- 172.21.15.132:0/1032622852 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4709 (secure 0 0 0) 0x7fc1e4079430 con 0x7fc1f015bf40 2023-12-20T04:43:33.165 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:33.165 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/342123967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":342123967},{"type":"v1","addr":"172.21.15.187:6835","nonce":342123967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2678730048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2678730048},{"type":"v1","addr":"172.21.15.132:6836","nonce":2678730048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2874427434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2874427434},{"type":"v1","addr":"172.21.15.132:6837","nonce":2874427434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:42:47.150648+0000","modified":"2023-12-20T04:42:49.158537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/839566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":839566266},{"type":"v1","addr":"172.21.15.187:6834","nonce":839566266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-20T04:43:33.166 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2023-12-20T04:43:33.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.165+0000 7fc1f699f640 1 -- 172.21.15.132:0/1032622852 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc1dc06a460 msgr2=0x7fc1dc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.165+0000 7fc1f699f640 1 --2- 172.21.15.132:0/1032622852 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc1dc06a460 0x7fc1dc06c920 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fc1e0009ae0 tx=0x7fc1e0008040 comp rx=0 tx=0).stop 2023-12-20T04:43:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.165+0000 7fc1f699f640 1 -- 172.21.15.132:0/1032622852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f015bf40 msgr2=0x7fc1f0159620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.165+0000 7fc1f699f640 1 --2- 172.21.15.132:0/1032622852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f015bf40 0x7fc1f0159620 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fc1e4037040 tx=0x7fc1e4004730 comp rx=0 tx=0).stop 2023-12-20T04:43:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.165+0000 7fc1f699f640 1 -- 172.21.15.132:0/1032622852 shutdown_connections 2023-12-20T04:43:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.166+0000 7fc1f699f640 1 --2- 172.21.15.132:0/1032622852 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc1dc06a460 0x7fc1dc06c920 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.166+0000 7fc1f699f640 1 --2- 172.21.15.132:0/1032622852 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc1f00c6c20 0x7fc1f015d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.166+0000 7fc1f699f640 1 --2- 172.21.15.132:0/1032622852 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc1f015bf40 0x7fc1f0159620 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.166+0000 7fc1f699f640 1 --2- 172.21.15.132:0/1032622852 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc1d8003ef0 0x7fc1f01520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.166+0000 7fc1f699f640 1 -- 172.21.15.132:0/1032622852 >> 172.21.15.132:0/1032622852 conn(0x7fc1f00cf330 msgr2=0x7fc1f00b48b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.166+0000 7fc1f699f640 1 -- 172.21.15.132:0/1032622852 shutdown_connections 2023-12-20T04:43:33.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.166+0000 7fc1f699f640 1 -- 172.21.15.132:0/1032622852 wait complete. 2023-12-20T04:43:33.177 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:33.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.275+0000 7fa134884640 1 Processor -- start 2023-12-20T04:43:33.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.275+0000 7fa134884640 1 -- start start 2023-12-20T04:43:33.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.276+0000 7fa134884640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa130160d70 0x7fa130069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:33.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.276+0000 7fa134884640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa130161220 con 0x7fa13006a170 2023-12-20T04:43:33.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.276+0000 7fa134884640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13006d530 con 0x7fa13015ab70 2023-12-20T04:43:33.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.276+0000 7fa134884640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa130070540 con 0x7fa130160d70 2023-12-20T04:43:33.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.277+0000 7fa12dd9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa130160d70 0x7fa130069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:33.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.277+0000 7fa12dd9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa130160d70 0x7fa130069c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55508/0 (socket says 172.21.15.132:55508) 2023-12-20T04:43:33.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.277+0000 7fa12dd9b640 1 -- 172.21.15.132:0/2490025169 learned_addr learned my addr 172.21.15.132:0/2490025169 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:33.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.277+0000 7fa12ed9d640 1 --1- 172.21.15.132:0/2490025169 >> v1:172.21.15.132:6789/0 conn(0x7fa13006a170 0x7fa13015dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40674/0 (socket says 172.21.15.132:40674) 2023-12-20T04:43:33.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.277+0000 7fa12dd9b640 1 -- 172.21.15.132:0/2490025169 >> v1:172.21.15.187:6789/0 conn(0x7fa13015ab70 legacy=0x7fa1300cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.277+0000 7fa12dd9b640 1 -- 172.21.15.132:0/2490025169 >> v1:172.21.15.132:6789/0 conn(0x7fa13006a170 legacy=0x7fa13015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.277+0000 7fa12dd9b640 1 -- 172.21.15.132:0/2490025169 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13006a580 con 0x7fa130160d70 2023-12-20T04:43:33.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.277+0000 7fa12d59a640 1 -- 172.21.15.132:0/2490025169 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2182396313 0 0) 0x7fa130161220 con 0x7fa13006a170 2023-12-20T04:43:33.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.278+0000 7fa12dd9b640 1 --2- 172.21.15.132:0/2490025169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa130160d70 0x7fa130069c30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa124009e50 tx=0x7fa12402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49f2f63bb43cf226 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:33.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.278+0000 7fa12d59a640 1 -- 172.21.15.132:0/2490025169 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12402cbb0 con 0x7fa130160d70 2023-12-20T04:43:33.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.278+0000 7fa12d59a640 1 -- 172.21.15.132:0/2490025169 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12402cd10 con 0x7fa130160d70 2023-12-20T04:43:33.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.278+0000 7fa12d59a640 1 -- 172.21.15.132:0/2490025169 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa124034610 con 0x7fa130160d70 2023-12-20T04:43:33.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.278+0000 7fa134884640 1 -- 172.21.15.132:0/2490025169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa130160d70 msgr2=0x7fa130069c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.278+0000 7fa134884640 1 --2- 172.21.15.132:0/2490025169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa130160d70 0x7fa130069c30 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fa124009e50 tx=0x7fa12402c010 comp rx=0 tx=0).stop 2023-12-20T04:43:33.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.278+0000 7fa134884640 1 -- 172.21.15.132:0/2490025169 shutdown_connections 2023-12-20T04:43:33.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.278+0000 7fa134884640 1 --2- 172.21.15.132:0/2490025169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa130160d70 0x7fa130069c30 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.278+0000 7fa134884640 1 -- 172.21.15.132:0/2490025169 >> 172.21.15.132:0/2490025169 conn(0x7fa1300cfca0 msgr2=0x7fa1300d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:33.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.278+0000 7fa134884640 1 -- 172.21.15.132:0/2490025169 shutdown_connections 2023-12-20T04:43:33.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.278+0000 7fa134884640 1 -- 172.21.15.132:0/2490025169 wait complete. 2023-12-20T04:43:33.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.280+0000 7fa134884640 1 Processor -- start 2023-12-20T04:43:33.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.280+0000 7fa134884640 1 -- start start 2023-12-20T04:43:33.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.280+0000 7fa134884640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa13006a170 0x7fa1300b0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:33.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.280+0000 7fa134884640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa13015ab70 0x7fa1300af130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:33.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.280+0000 7fa134884640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa130160d70 0x7fa1300c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:33.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.280+0000 7fa134884640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1301f6230 con 0x7fa13006a170 2023-12-20T04:43:33.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.280+0000 7fa134884640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1301f6510 con 0x7fa130160d70 2023-12-20T04:43:33.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.280+0000 7fa134884640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1301f67f0 con 0x7fa13015ab70 2023-12-20T04:43:33.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.280+0000 7fa12e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa13006a170 0x7fa1300b0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:33.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.281+0000 7fa12e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa13006a170 0x7fa1300b0180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55524/0 (socket says 172.21.15.132:55524) 2023-12-20T04:43:33.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.281+0000 7fa12e59c640 1 -- 172.21.15.132:0/1636183323 learned_addr learned my addr 172.21.15.132:0/1636183323 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:33.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.281+0000 7fa12e59c640 1 -- 172.21.15.132:0/1636183323 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa13015ab70 msgr2=0x7fa1300af130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.281+0000 7fa12e59c640 1 --2- 172.21.15.132:0/1636183323 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa13015ab70 0x7fa1300af130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.281+0000 7fa12e59c640 1 -- 172.21.15.132:0/1636183323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa130160d70 msgr2=0x7fa1300c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.281+0000 7fa12e59c640 1 --2- 172.21.15.132:0/1636183323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa130160d70 0x7fa1300c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.281+0000 7fa12e59c640 1 -- 172.21.15.132:0/1636183323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa124009b30 con 0x7fa13006a170 2023-12-20T04:43:33.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.281+0000 7fa12e59c640 1 --2- 172.21.15.132:0/1636183323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa13006a170 0x7fa1300b0180 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa12800c450 tx=0x7fa12800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:33.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.281+0000 7fa11effd640 1 -- 172.21.15.132:0/1636183323 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1280052d0 con 0x7fa13006a170 2023-12-20T04:43:33.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.281+0000 7fa11effd640 1 -- 172.21.15.132:0/1636183323 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa128005430 con 0x7fa13006a170 2023-12-20T04:43:33.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.281+0000 7fa11effd640 1 -- 172.21.15.132:0/1636183323 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128012870 con 0x7fa13006a170 2023-12-20T04:43:33.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.281+0000 7fa134884640 1 -- 172.21.15.132:0/1636183323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1301f6ad0 con 0x7fa13006a170 2023-12-20T04:43:33.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.281+0000 7fa134884640 1 -- 172.21.15.132:0/1636183323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1300af670 con 0x7fa13006a170 2023-12-20T04:43:33.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.282+0000 7fa134884640 1 -- 172.21.15.132:0/1636183323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13004e840 con 0x7fa13006a170 2023-12-20T04:43:33.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.282+0000 7fa11effd640 1 -- 172.21.15.132:0/1636183323 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa1280129d0 con 0x7fa13006a170 2023-12-20T04:43:33.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.283+0000 7fa11effd640 1 --2- 172.21.15.132:0/1636183323 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa11006a430 0x7fa11006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:33.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.283+0000 7fa12dd9b640 1 --2- 172.21.15.132:0/1636183323 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa11006a430 0x7fa11006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:33.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.283+0000 7fa11effd640 1 -- 172.21.15.132:0/1636183323 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa128088480 con 0x7fa13006a170 2023-12-20T04:43:33.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.283+0000 7fa12dd9b640 1 --2- 172.21.15.132:0/1636183323 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa11006a430 0x7fa11006c8f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa124035000 tx=0x7fa12402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:33.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.287+0000 7fa11effd640 1 -- 172.21.15.132:0/1636183323 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa128053a70 con 0x7fa13006a170 2023-12-20T04:43:33.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.453+0000 7fa134884640 1 -- 172.21.15.132:0/1636183323 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa1300d08c0 con 0x7fa13006a170 2023-12-20T04:43:33.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.454+0000 7fa11effd640 1 -- 172.21.15.132:0/1636183323 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7fa128057090 con 0x7fa13006a170 2023-12-20T04:43:33.455 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:33.455 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:33.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.456+0000 7fa134884640 1 -- 172.21.15.132:0/1636183323 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa11006a430 msgr2=0x7fa11006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.456+0000 7fa134884640 1 --2- 172.21.15.132:0/1636183323 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa11006a430 0x7fa11006c8f0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa124035000 tx=0x7fa12402e000 comp rx=0 tx=0).stop 2023-12-20T04:43:33.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.456+0000 7fa134884640 1 -- 172.21.15.132:0/1636183323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa13006a170 msgr2=0x7fa1300b0180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.456+0000 7fa134884640 1 --2- 172.21.15.132:0/1636183323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa13006a170 0x7fa1300b0180 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fa12800c450 tx=0x7fa12800c910 comp rx=0 tx=0).stop 2023-12-20T04:43:33.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.456+0000 7fa134884640 1 -- 172.21.15.132:0/1636183323 shutdown_connections 2023-12-20T04:43:33.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.456+0000 7fa134884640 1 --2- 172.21.15.132:0/1636183323 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa11006a430 0x7fa11006c8f0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.456+0000 7fa134884640 1 --2- 172.21.15.132:0/1636183323 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa130160d70 0x7fa1300c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.456+0000 7fa134884640 1 --2- 172.21.15.132:0/1636183323 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa13015ab70 0x7fa1300af130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.456+0000 7fa134884640 1 --2- 172.21.15.132:0/1636183323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa13006a170 0x7fa1300b0180 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.456+0000 7fa134884640 1 -- 172.21.15.132:0/1636183323 >> 172.21.15.132:0/1636183323 conn(0x7fa1300cfca0 msgr2=0x7fa13015a160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:33.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.456+0000 7fa134884640 1 -- 172.21.15.132:0/1636183323 shutdown_connections 2023-12-20T04:43:33.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.456+0000 7fa134884640 1 -- 172.21.15.132:0/1636183323 wait complete. 2023-12-20T04:43:33.468 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-20T04:43:33.468 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:43:33.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.567+0000 7f2b61192640 1 Processor -- start 2023-12-20T04:43:33.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.567+0000 7f2b61192640 1 -- start start 2023-12-20T04:43:33.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.568+0000 7f2b61192640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2b5c06a340 0x7f2b5c06c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:33.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.568+0000 7f2b61192640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b5c06cd30 0x7f2b5c0b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:33.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.568+0000 7f2b61192640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b5c06ea90 con 0x7f2b5c1588e0 2023-12-20T04:43:33.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.568+0000 7f2b61192640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b5c06d520 con 0x7f2b5c06a340 2023-12-20T04:43:33.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.568+0000 7f2b61192640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c06e160 con 0x7f2b5c06cd30 2023-12-20T04:43:33.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.568+0000 7f2b5a59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2b5c06a340 0x7f2b5c06c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:33.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.568+0000 7f2b5a59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2b5c06a340 0x7f2b5c06c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55536/0 (socket says 172.21.15.132:55536) 2023-12-20T04:43:33.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.568+0000 7f2b5a59c640 1 -- 172.21.15.132:0/3854132586 learned_addr learned my addr 172.21.15.132:0/3854132586 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:33.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.568+0000 7f2b5ad9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2b5c1588e0 0x7f2b5c069c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40680/0 (socket says 172.21.15.132:40680) 2023-12-20T04:43:33.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.569+0000 7f2b5b59e640 1 --2- 172.21.15.132:0/3854132586 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b5c06cd30 0x7f2b5c0b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:33.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.569+0000 7f2b5a59c640 1 -- 172.21.15.132:0/3854132586 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b5c06cd30 msgr2=0x7f2b5c0b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:33.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.569+0000 7f2b5a59c640 1 --2- 172.21.15.132:0/3854132586 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b5c06cd30 0x7f2b5c0b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.569+0000 7f2b5a59c640 1 -- 172.21.15.132:0/3854132586 >> v1:172.21.15.132:6789/0 conn(0x7f2b5c1588e0 legacy=0x7f2b5c069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.569+0000 7f2b59d9b640 1 -- 172.21.15.132:0/3854132586 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3523401145 0 0) 0x7f2b5c06ea90 con 0x7f2b5c1588e0 2023-12-20T04:43:33.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.569+0000 7f2b5a59c640 1 -- 172.21.15.132:0/3854132586 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b5c06e440 con 0x7f2b5c06a340 2023-12-20T04:43:33.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.569+0000 7f2b5a59c640 1 --2- 172.21.15.132:0/3854132586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c06a340 0x7f2b5c06c7f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009870 tx=0x7f2b5002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801e7e3ca36bc1f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:33.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.569+0000 7f2b59d9b640 1 -- 172.21.15.132:0/3854132586 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50030840 con 0x7f2b5c06a340 2023-12-20T04:43:33.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.570+0000 7f2b59d9b640 1 -- 172.21.15.132:0/3854132586 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b500309a0 con 0x7f2b5c06a340 2023-12-20T04:43:33.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.570+0000 7f2b59d9b640 1 -- 172.21.15.132:0/3854132586 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50030d30 con 0x7f2b5c06a340 2023-12-20T04:43:33.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.570+0000 7f2b61192640 1 -- 172.21.15.132:0/3854132586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c06a340 msgr2=0x7f2b5c06c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.570+0000 7f2b61192640 1 --2- 172.21.15.132:0/3854132586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c06a340 0x7f2b5c06c7f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f2b50009870 tx=0x7f2b5002b980 comp rx=0 tx=0).stop 2023-12-20T04:43:33.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.570+0000 7f2b61192640 1 -- 172.21.15.132:0/3854132586 shutdown_connections 2023-12-20T04:43:33.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.570+0000 7f2b61192640 1 --2- 172.21.15.132:0/3854132586 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b5c06cd30 0x7f2b5c0b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.570+0000 7f2b61192640 1 --2- 172.21.15.132:0/3854132586 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c06a340 0x7f2b5c06c7f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.570+0000 7f2b61192640 1 -- 172.21.15.132:0/3854132586 >> 172.21.15.132:0/3854132586 conn(0x7f2b5c0cfca0 msgr2=0x7f2b5c0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:33.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.570+0000 7f2b61192640 1 -- 172.21.15.132:0/3854132586 shutdown_connections 2023-12-20T04:43:33.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.570+0000 7f2b61192640 1 -- 172.21.15.132:0/3854132586 wait complete. 2023-12-20T04:43:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.572+0000 7f2b61192640 1 Processor -- start 2023-12-20T04:43:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.572+0000 7f2b61192640 1 -- start start 2023-12-20T04:43:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.572+0000 7f2b61192640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b5c06a340 0x7f2b5c0ca140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.572+0000 7f2b61192640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c06cd30 0x7f2b5c1f0110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.572+0000 7f2b61192640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b5c1588e0 0x7f2b5c14ff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.572+0000 7f2b61192640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0c4940 con 0x7f2b5c06cd30 2023-12-20T04:43:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.572+0000 7f2b61192640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c14e880 con 0x7f2b5c06a340 2023-12-20T04:43:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.572+0000 7f2b61192640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b5c0c4b90 con 0x7f2b5c1588e0 2023-12-20T04:43:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.572+0000 7f2b5a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c06cd30 0x7f2b5c1f0110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.572+0000 7f2b5a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c06cd30 0x7f2b5c1f0110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55552/0 (socket says 172.21.15.132:55552) 2023-12-20T04:43:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.572+0000 7f2b5a59c640 1 -- 172.21.15.132:0/2394976987 learned_addr learned my addr 172.21.15.132:0/2394976987 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.573+0000 7f2b5b59e640 1 --2- 172.21.15.132:0/2394976987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b5c1588e0 0x7f2b5c14ff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.573+0000 7f2b5ad9d640 1 --2- 172.21.15.132:0/2394976987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b5c06a340 0x7f2b5c0ca140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.573+0000 7f2b5a59c640 1 -- 172.21.15.132:0/2394976987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b5c1588e0 msgr2=0x7f2b5c14ff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.573+0000 7f2b5a59c640 1 --2- 172.21.15.132:0/2394976987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b5c1588e0 0x7f2b5c14ff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.573+0000 7f2b5a59c640 1 -- 172.21.15.132:0/2394976987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b5c06a340 msgr2=0x7f2b5c0ca140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.573+0000 7f2b5a59c640 1 --2- 172.21.15.132:0/2394976987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b5c06a340 0x7f2b5c0ca140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.573+0000 7f2b5a59c640 1 -- 172.21.15.132:0/2394976987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b500094d0 con 0x7f2b5c06cd30 2023-12-20T04:43:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.573+0000 7f2b5a59c640 1 --2- 172.21.15.132:0/2394976987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c06cd30 0x7f2b5c1f0110 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2b50000c00 tx=0x7f2b50004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.573+0000 7f2b437fe640 1 -- 172.21.15.132:0/2394976987 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50039a90 con 0x7f2b5c06cd30 2023-12-20T04:43:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.573+0000 7f2b437fe640 1 -- 172.21.15.132:0/2394976987 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b50039bf0 con 0x7f2b5c06cd30 2023-12-20T04:43:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.573+0000 7f2b61192640 1 -- 172.21.15.132:0/2394976987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b5c0c4e70 con 0x7f2b5c06cd30 2023-12-20T04:43:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.573+0000 7f2b437fe640 1 -- 172.21.15.132:0/2394976987 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b50043410 con 0x7f2b5c06cd30 2023-12-20T04:43:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.573+0000 7f2b61192640 1 -- 172.21.15.132:0/2394976987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b5c1f0650 con 0x7f2b5c06cd30 2023-12-20T04:43:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.574+0000 7f2b61192640 1 -- 172.21.15.132:0/2394976987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b5c04e840 con 0x7f2b5c06cd30 2023-12-20T04:43:33.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.575+0000 7f2b437fe640 1 -- 172.21.15.132:0/2394976987 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2b5004c3b0 con 0x7f2b5c06cd30 2023-12-20T04:43:33.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.575+0000 7f2b437fe640 1 --2- 172.21.15.132:0/2394976987 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b4806a430 0x7f2b4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:33.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.575+0000 7f2b437fe640 1 -- 172.21.15.132:0/2394976987 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b500aad80 con 0x7f2b5c06cd30 2023-12-20T04:43:33.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.575+0000 7f2b5ad9d640 1 --2- 172.21.15.132:0/2394976987 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b4806a430 0x7f2b4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:33.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.575+0000 7f2b5ad9d640 1 --2- 172.21.15.132:0/2394976987 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b4806a430 0x7f2b4806c8f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0012e0 tx=0x7f2b4c001700 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:33.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.579+0000 7f2b437fe640 1 -- 172.21.15.132:0/2394976987 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2b50076420 con 0x7f2b5c06cd30 2023-12-20T04:43:33.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.778+0000 7f2b61192640 1 -- 172.21.15.132:0/2394976987 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2b5c0c35b0 con 0x7f2b5c06cd30 2023-12-20T04:43:33.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.779+0000 7f2b437fe640 1 -- 172.21.15.132:0/2394976987 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4709 (secure 0 0 0) 0x7f2b50079a40 con 0x7f2b5c06cd30 2023-12-20T04:43:33.781 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:33.781 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/342123967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":342123967},{"type":"v1","addr":"172.21.15.187:6835","nonce":342123967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2678730048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2678730048},{"type":"v1","addr":"172.21.15.132:6836","nonce":2678730048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2874427434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2874427434},{"type":"v1","addr":"172.21.15.132:6837","nonce":2874427434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:42:47.150648+0000","modified":"2023-12-20T04:42:49.158537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/839566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":839566266},{"type":"v1","addr":"172.21.15.187:6834","nonce":839566266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-20T04:43:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2023-12-20T04:43:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.780+0000 7f2b61192640 1 -- 172.21.15.132:0/2394976987 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b4806a430 msgr2=0x7f2b4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.780+0000 7f2b61192640 1 --2- 172.21.15.132:0/2394976987 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b4806a430 0x7f2b4806c8f0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f2b4c0012e0 tx=0x7f2b4c001700 comp rx=0 tx=0).stop 2023-12-20T04:43:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.780+0000 7f2b61192640 1 -- 172.21.15.132:0/2394976987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c06cd30 msgr2=0x7f2b5c1f0110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.780+0000 7f2b61192640 1 --2- 172.21.15.132:0/2394976987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c06cd30 0x7f2b5c1f0110 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f2b50000c00 tx=0x7f2b50004730 comp rx=0 tx=0).stop 2023-12-20T04:43:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.781+0000 7f2b61192640 1 -- 172.21.15.132:0/2394976987 shutdown_connections 2023-12-20T04:43:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.781+0000 7f2b61192640 1 --2- 172.21.15.132:0/2394976987 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b4806a430 0x7f2b4806c8f0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.781+0000 7f2b61192640 1 --2- 172.21.15.132:0/2394976987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b5c1588e0 0x7f2b5c14ff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.781+0000 7f2b61192640 1 --2- 172.21.15.132:0/2394976987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b5c06cd30 0x7f2b5c1f0110 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.781+0000 7f2b61192640 1 --2- 172.21.15.132:0/2394976987 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b5c06a340 0x7f2b5c0ca140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.781+0000 7f2b61192640 1 -- 172.21.15.132:0/2394976987 >> 172.21.15.132:0/2394976987 conn(0x7f2b5c0cfca0 msgr2=0x7f2b5c158cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:33.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.781+0000 7f2b61192640 1 -- 172.21.15.132:0/2394976987 shutdown_connections 2023-12-20T04:43:33.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.781+0000 7f2b61192640 1 -- 172.21.15.132:0/2394976987 wait complete. 2023-12-20T04:43:33.792 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:43:33.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.891+0000 7fc068c32640 1 Processor -- start 2023-12-20T04:43:33.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.891+0000 7fc068c32640 1 -- start start 2023-12-20T04:43:33.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.892+0000 7fc068c32640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc064160450 0x7fc064160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:33.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.892+0000 7fc068c32640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0641611b0 0x7fc0640b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:33.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.892+0000 7fc068c32640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0640b5ec0 con 0x7fc0640b4ec0 2023-12-20T04:43:33.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.892+0000 7fc068c32640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0640b5350 con 0x7fc064160450 2023-12-20T04:43:33.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.892+0000 7fc068c32640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0641617e0 con 0x7fc0641611b0 2023-12-20T04:43:33.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.892+0000 7fc06259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc064160450 0x7fc064160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:33.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.892+0000 7fc062d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc0640b4ec0 0x7fc06406a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40690/0 (socket says 172.21.15.132:40690) 2023-12-20T04:43:33.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.892+0000 7fc06259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc064160450 0x7fc064160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55556/0 (socket says 172.21.15.132:55556) 2023-12-20T04:43:33.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.892+0000 7fc062d9d640 1 -- 172.21.15.132:0/2040294594 learned_addr learned my addr 172.21.15.132:0/2040294594 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:33.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.892+0000 7fc05bfff640 1 --2- 172.21.15.132:0/2040294594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0641611b0 0x7fc0640b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:33.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.892+0000 7fc06259c640 1 -- 172.21.15.132:0/2040294594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0641611b0 msgr2=0x7fc0640b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:33.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.892+0000 7fc06259c640 1 --2- 172.21.15.132:0/2040294594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0641611b0 0x7fc0640b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.892+0000 7fc06259c640 1 -- 172.21.15.132:0/2040294594 >> v1:172.21.15.132:6789/0 conn(0x7fc0640b4ec0 legacy=0x7fc06406a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.892+0000 7fc061d9b640 1 -- 172.21.15.132:0/2040294594 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2607357255 0 0) 0x7fc0640b5ec0 con 0x7fc0640b4ec0 2023-12-20T04:43:33.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.892+0000 7fc06259c640 1 -- 172.21.15.132:0/2040294594 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0640d0fc0 con 0x7fc064160450 2023-12-20T04:43:33.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.893+0000 7fc06259c640 1 --2- 172.21.15.132:0/2040294594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc064160450 0x7fc064160c70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc0540097a0 tx=0x7fc05402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e22391a391f7ee9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:33.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.893+0000 7fc061d9b640 1 -- 172.21.15.132:0/2040294594 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054030610 con 0x7fc064160450 2023-12-20T04:43:33.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.893+0000 7fc061d9b640 1 -- 172.21.15.132:0/2040294594 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc054030770 con 0x7fc064160450 2023-12-20T04:43:33.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.893+0000 7fc061d9b640 1 -- 172.21.15.132:0/2040294594 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054030b00 con 0x7fc064160450 2023-12-20T04:43:33.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.893+0000 7fc068c32640 1 -- 172.21.15.132:0/2040294594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc064160450 msgr2=0x7fc064160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.893+0000 7fc068c32640 1 --2- 172.21.15.132:0/2040294594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc064160450 0x7fc064160c70 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7fc0540097a0 tx=0x7fc05402b960 comp rx=0 tx=0).stop 2023-12-20T04:43:33.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.894+0000 7fc068c32640 1 -- 172.21.15.132:0/2040294594 shutdown_connections 2023-12-20T04:43:33.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.894+0000 7fc068c32640 1 --2- 172.21.15.132:0/2040294594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0641611b0 0x7fc0640b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.894+0000 7fc068c32640 1 --2- 172.21.15.132:0/2040294594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc064160450 0x7fc064160c70 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.894+0000 7fc068c32640 1 -- 172.21.15.132:0/2040294594 >> 172.21.15.132:0/2040294594 conn(0x7fc0640cf980 msgr2=0x7fc0640cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:33.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.894+0000 7fc068c32640 1 -- 172.21.15.132:0/2040294594 shutdown_connections 2023-12-20T04:43:33.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.894+0000 7fc068c32640 1 -- 172.21.15.132:0/2040294594 wait complete. 2023-12-20T04:43:33.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.895+0000 7fc068c32640 1 Processor -- start 2023-12-20T04:43:33.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.895+0000 7fc068c32640 1 -- start start 2023-12-20T04:43:33.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.895+0000 7fc068c32640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0640b4ec0 0x7fc06415eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:33.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc068c32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc064160450 0x7fc0640d3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:33.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc068c32640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0641611b0 0x7fc064150870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:33.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc068c32640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06415f430 con 0x7fc064160450 2023-12-20T04:43:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc068c32640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc06415e9c0 con 0x7fc0641611b0 2023-12-20T04:43:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc068c32640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc064159060 con 0x7fc0640b4ec0 2023-12-20T04:43:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc05bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc064160450 0x7fc0640d3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc05bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc064160450 0x7fc0640d3140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55558/0 (socket says 172.21.15.132:55558) 2023-12-20T04:43:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc05bfff640 1 -- 172.21.15.132:0/3732486943 learned_addr learned my addr 172.21.15.132:0/3732486943 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc06259c640 1 --2- 172.21.15.132:0/3732486943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0640b4ec0 0x7fc06415eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc062d9d640 1 --2- 172.21.15.132:0/3732486943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0641611b0 0x7fc064150870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc05bfff640 1 -- 172.21.15.132:0/3732486943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0640b4ec0 msgr2=0x7fc06415eef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc05bfff640 1 --2- 172.21.15.132:0/3732486943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0640b4ec0 0x7fc06415eef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc05bfff640 1 -- 172.21.15.132:0/3732486943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0641611b0 msgr2=0x7fc064150870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc05bfff640 1 --2- 172.21.15.132:0/3732486943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0641611b0 0x7fc064150870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc05bfff640 1 -- 172.21.15.132:0/3732486943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc054009400 con 0x7fc064160450 2023-12-20T04:43:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc05bfff640 1 --2- 172.21.15.132:0/3732486943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc064160450 0x7fc0640d3140 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00d5f0 tx=0x7fc04c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:33.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc05affd640 1 -- 172.21.15.132:0/3732486943 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c0125f0 con 0x7fc064160450 2023-12-20T04:43:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc05affd640 1 -- 172.21.15.132:0/3732486943 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc04c012750 con 0x7fc064160450 2023-12-20T04:43:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc068c32640 1 -- 172.21.15.132:0/3732486943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0641584e0 con 0x7fc064160450 2023-12-20T04:43:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc05affd640 1 -- 172.21.15.132:0/3732486943 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc04c012b00 con 0x7fc064160450 2023-12-20T04:43:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.896+0000 7fc068c32640 1 -- 172.21.15.132:0/3732486943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc064158aa0 con 0x7fc064160450 2023-12-20T04:43:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.897+0000 7fc068c32640 1 -- 172.21.15.132:0/3732486943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0640cdb60 con 0x7fc064160450 2023-12-20T04:43:33.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.898+0000 7fc05affd640 1 -- 172.21.15.132:0/3732486943 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc04c012c60 con 0x7fc064160450 2023-12-20T04:43:33.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.898+0000 7fc05affd640 1 --2- 172.21.15.132:0/3732486943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc04406a460 0x7fc04406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:33.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.898+0000 7fc06259c640 1 --2- 172.21.15.132:0/3732486943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc04406a460 0x7fc04406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:33.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.898+0000 7fc05affd640 1 -- 172.21.15.132:0/3732486943 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc04c088cd0 con 0x7fc064160450 2023-12-20T04:43:33.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.898+0000 7fc06259c640 1 --2- 172.21.15.132:0/3732486943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc04406a460 0x7fc04406c920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc054036000 tx=0x7fc054008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:33.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:33.902+0000 7fc05affd640 1 -- 172.21.15.132:0/3732486943 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc04c054350 con 0x7fc064160450 2023-12-20T04:43:34.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.106+0000 7fc068c32640 1 -- 172.21.15.132:0/3732486943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc06404e840 con 0x7fc064160450 2023-12-20T04:43:34.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.107+0000 7fc05affd640 1 -- 172.21.15.132:0/3732486943 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 6 v6) v1 ==== 93+0+4709 (secure 0 0 0) 0x7fc04c057970 con 0x7fc064160450 2023-12-20T04:43:34.107 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:34.108 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":6,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4250,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/342123967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":342123967},{"type":"v1","addr":"172.21.15.187:6835","nonce":342123967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3},{"gid":4263,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2678730048","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2678730048},{"type":"v1","addr":"172.21.15.132:6836","nonce":2678730048}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":2},{"gid":4266,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2874427434","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2874427434},{"type":"v1","addr":"172.21.15.132:6837","nonce":2874427434}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:42:47.150648+0000","modified":"2023-12-20T04:42:49.158537+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":4267},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4267":{"gid":4267,"name":"b","rank":0,"incarnation":4,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/839566266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":839566266},{"type":"v1","addr":"172.21.15.187:6834","nonce":839566266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":1}]} 2023-12-20T04:43:34.108 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 6 2023-12-20T04:43:34.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.108+0000 7fc068c32640 1 -- 172.21.15.132:0/3732486943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc04406a460 msgr2=0x7fc04406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.108+0000 7fc068c32640 1 --2- 172.21.15.132:0/3732486943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc04406a460 0x7fc04406c920 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7fc054036000 tx=0x7fc054008030 comp rx=0 tx=0).stop 2023-12-20T04:43:34.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.108+0000 7fc068c32640 1 -- 172.21.15.132:0/3732486943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc064160450 msgr2=0x7fc0640d3140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.108+0000 7fc068c32640 1 --2- 172.21.15.132:0/3732486943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc064160450 0x7fc0640d3140 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fc04c00d5f0 tx=0x7fc04c00dab0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.108+0000 7fc068c32640 1 -- 172.21.15.132:0/3732486943 shutdown_connections 2023-12-20T04:43:34.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.108+0000 7fc068c32640 1 --2- 172.21.15.132:0/3732486943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc04406a460 0x7fc04406c920 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.108+0000 7fc068c32640 1 --2- 172.21.15.132:0/3732486943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0641611b0 0x7fc064150870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.108+0000 7fc068c32640 1 --2- 172.21.15.132:0/3732486943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc064160450 0x7fc0640d3140 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.108+0000 7fc068c32640 1 --2- 172.21.15.132:0/3732486943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0640b4ec0 0x7fc06415eef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.109+0000 7fc068c32640 1 -- 172.21.15.132:0/3732486943 >> 172.21.15.132:0/3732486943 conn(0x7fc0640cf980 msgr2=0x7fc064156480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:34.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.109+0000 7fc068c32640 1 -- 172.21.15.132:0/3732486943 shutdown_connections 2023-12-20T04:43:34.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.109+0000 7fc068c32640 1 -- 172.21.15.132:0/3732486943 wait complete. 2023-12-20T04:43:34.121 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:34.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.220+0000 7f21612b9640 1 Processor -- start 2023-12-20T04:43:34.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.220+0000 7f21612b9640 1 -- start start 2023-12-20T04:43:34.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.221+0000 7f21612b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f215c0caa90 0x7f215c0caef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.221+0000 7f21612b9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f215c06cc30 0x7f215c06d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.221+0000 7f21612b9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f215c15e4c0 con 0x7f215c159d00 2023-12-20T04:43:34.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.221+0000 7f21612b9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f215c06c220 con 0x7f215c06cc30 2023-12-20T04:43:34.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.221+0000 7f21612b9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215c06d5e0 con 0x7f215c0caa90 2023-12-20T04:43:34.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.221+0000 7f215a7fc640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f215c0caa90 0x7f215c0caef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:34.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.221+0000 7f215b7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f215c06cc30 0x7f215c06d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:34.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.221+0000 7f215a7fc640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f215c0caa90 0x7f215c0caef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:37200/0 (socket says 172.21.15.132:37200) 2023-12-20T04:43:34.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.221+0000 7f215affd640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f215c159d00 0x7f215c15da00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:36672/0 (socket says 172.21.15.132:36672) 2023-12-20T04:43:34.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.221+0000 7f215a7fc640 1 -- 172.21.15.132:0/727585505 learned_addr learned my addr 172.21.15.132:0/727585505 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:34.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.222+0000 7f2159ffb640 1 -- 172.21.15.132:0/727585505 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3168533435 0 0) 0x7f215c15e4c0 con 0x7f215c159d00 2023-12-20T04:43:34.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.222+0000 7f2159ffb640 1 -- 172.21.15.132:0/727585505 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2144003520 con 0x7f215c159d00 2023-12-20T04:43:34.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.222+0000 7f215b7fe640 1 -- 172.21.15.132:0/727585505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f215c0caa90 msgr2=0x7f215c0caef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:34.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.222+0000 7f215b7fe640 1 --2- 172.21.15.132:0/727585505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f215c0caa90 0x7f215c0caef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.222+0000 7f215b7fe640 1 -- 172.21.15.132:0/727585505 >> v1:172.21.15.187:6789/0 conn(0x7f215c159d00 legacy=0x7f215c15da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.222+0000 7f215b7fe640 1 -- 172.21.15.132:0/727585505 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f215c15e7a0 con 0x7f215c06cc30 2023-12-20T04:43:34.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.222+0000 7f215a7fc640 1 --2- 172.21.15.132:0/727585505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f215c0caa90 0x7f215c0caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:43:34.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.223+0000 7f215b7fe640 1 --2- 172.21.15.132:0/727585505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f215c06cc30 0x7f215c06d0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f21540097a0 tx=0x7f215402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7a6ca921fdf70fa6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:34.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.223+0000 7f2159ffb640 1 -- 172.21.15.132:0/727585505 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2154031830 con 0x7f215c06cc30 2023-12-20T04:43:34.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.223+0000 7f2159ffb640 1 -- 172.21.15.132:0/727585505 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2154031990 con 0x7f215c06cc30 2023-12-20T04:43:34.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.223+0000 7f2159ffb640 1 -- 172.21.15.132:0/727585505 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2154031d00 con 0x7f215c06cc30 2023-12-20T04:43:34.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.223+0000 7f21612b9640 1 -- 172.21.15.132:0/727585505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f215c06cc30 msgr2=0x7f215c06d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.223+0000 7f21612b9640 1 --2- 172.21.15.132:0/727585505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f215c06cc30 0x7f215c06d0a0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f21540097a0 tx=0x7f215402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.223+0000 7f21612b9640 1 -- 172.21.15.132:0/727585505 shutdown_connections 2023-12-20T04:43:34.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.223+0000 7f21612b9640 1 --2- 172.21.15.132:0/727585505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f215c06cc30 0x7f215c06d0a0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.223+0000 7f21612b9640 1 --2- 172.21.15.132:0/727585505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f215c0caa90 0x7f215c0caef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.223+0000 7f21612b9640 1 -- 172.21.15.132:0/727585505 >> 172.21.15.132:0/727585505 conn(0x7f215c0cfca0 msgr2=0x7f215c0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:34.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.223+0000 7f21612b9640 1 -- 172.21.15.132:0/727585505 shutdown_connections 2023-12-20T04:43:34.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.223+0000 7f21612b9640 1 -- 172.21.15.132:0/727585505 wait complete. 2023-12-20T04:43:34.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.225+0000 7f21612b9640 1 Processor -- start 2023-12-20T04:43:34.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.225+0000 7f21612b9640 1 -- start start 2023-12-20T04:43:34.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.225+0000 7f21612b9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f215c06cc30 0x7f215c1445e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.225+0000 7f21612b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f215c0caa90 0x7f215c14edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.225+0000 7f21612b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f215c159d00 0x7f215c1f2e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.225+0000 7f21612b9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c1f4510 con 0x7f215c0caa90 2023-12-20T04:43:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.225+0000 7f21612b9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f215c1f3900 con 0x7f215c06cc30 2023-12-20T04:43:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.225+0000 7f21612b9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f215c1f3be0 con 0x7f215c159d00 2023-12-20T04:43:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.225+0000 7f215a7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f215c0caa90 0x7f215c14edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.225+0000 7f215a7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f215c0caa90 0x7f215c14edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55568/0 (socket says 172.21.15.132:55568) 2023-12-20T04:43:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.225+0000 7f215a7fc640 1 -- 172.21.15.132:0/229977832 learned_addr learned my addr 172.21.15.132:0/229977832 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.226+0000 7f215b7fe640 1 --2- 172.21.15.132:0/229977832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f215c159d00 0x7f215c1f2e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.226+0000 7f215affd640 1 --2- 172.21.15.132:0/229977832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f215c06cc30 0x7f215c1445e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.226+0000 7f215a7fc640 1 -- 172.21.15.132:0/229977832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f215c159d00 msgr2=0x7f215c1f2e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.226+0000 7f215a7fc640 1 --2- 172.21.15.132:0/229977832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f215c159d00 0x7f215c1f2e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.226+0000 7f215a7fc640 1 -- 172.21.15.132:0/229977832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f215c06cc30 msgr2=0x7f215c1445e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.226+0000 7f215a7fc640 1 --2- 172.21.15.132:0/229977832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f215c06cc30 0x7f215c1445e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.226+0000 7f215a7fc640 1 -- 172.21.15.132:0/229977832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21500094d0 con 0x7f215c0caa90 2023-12-20T04:43:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.226+0000 7f215b7fe640 1 --2- 172.21.15.132:0/229977832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f215c159d00 0x7f215c1f2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.226+0000 7f215a7fc640 1 --2- 172.21.15.132:0/229977832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f215c0caa90 0x7f215c14edf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f215000e9d0 tx=0x7f215000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.226+0000 7f21437fe640 1 -- 172.21.15.132:0/229977832 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f215000ca60 con 0x7f215c0caa90 2023-12-20T04:43:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.226+0000 7f21437fe640 1 -- 172.21.15.132:0/229977832 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f215000cbc0 con 0x7f215c0caa90 2023-12-20T04:43:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.226+0000 7f21437fe640 1 -- 172.21.15.132:0/229977832 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2150013470 con 0x7f215c0caa90 2023-12-20T04:43:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.226+0000 7f21612b9640 1 -- 172.21.15.132:0/229977832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2154009400 con 0x7f215c0caa90 2023-12-20T04:43:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.226+0000 7f21612b9640 1 -- 172.21.15.132:0/229977832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f215c1f41a0 con 0x7f215c0caa90 2023-12-20T04:43:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.227+0000 7f21612b9640 1 -- 172.21.15.132:0/229977832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f215c1f4680 con 0x7f215c0caa90 2023-12-20T04:43:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.228+0000 7f21437fe640 1 -- 172.21.15.132:0/229977832 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f21500135d0 con 0x7f215c0caa90 2023-12-20T04:43:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.228+0000 7f21437fe640 1 --2- 172.21.15.132:0/229977832 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f214806a430 0x7f214806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.228+0000 7f21437fe640 1 -- 172.21.15.132:0/229977832 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2150088c00 con 0x7f215c0caa90 2023-12-20T04:43:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.228+0000 7f215affd640 1 --2- 172.21.15.132:0/229977832 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f214806a430 0x7f214806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:34.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.228+0000 7f215affd640 1 --2- 172.21.15.132:0/229977832 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f214806a430 0x7f214806c8f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f214c0012e0 tx=0x7f214c0016d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.232+0000 7f21437fe640 1 -- 172.21.15.132:0/229977832 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f215008f080 con 0x7f215c0caa90 2023-12-20T04:43:34.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.397+0000 7f21612b9640 1 -- 172.21.15.132:0/229977832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f215c0ce360 con 0x7f215c0caa90 2023-12-20T04:43:34.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.398+0000 7f21437fe640 1 -- 172.21.15.132:0/229977832 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v20) v1 ==== 74+0+16085 (secure 0 0 0) 0x7f2150017090 con 0x7f215c0caa90 2023-12-20T04:43:34.399 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:34.399 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":20,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:42:48.152541+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:42:45.433456+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2023-12-20T04:42:46.128920+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.400+0000 7f21612b9640 1 -- 172.21.15.132:0/229977832 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f214806a430 msgr2=0x7f214806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.400+0000 7f21612b9640 1 --2- 172.21.15.132:0/229977832 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f214806a430 0x7f214806c8f0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f214c0012e0 tx=0x7f214c0016d0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.400+0000 7f21612b9640 1 -- 172.21.15.132:0/229977832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f215c0caa90 msgr2=0x7f215c14edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.400+0000 7f21612b9640 1 --2- 172.21.15.132:0/229977832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f215c0caa90 0x7f215c14edf0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f215000e9d0 tx=0x7f215000ee90 comp rx=0 tx=0).stop 2023-12-20T04:43:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.400+0000 7f21612b9640 1 -- 172.21.15.132:0/229977832 shutdown_connections 2023-12-20T04:43:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.400+0000 7f21612b9640 1 --2- 172.21.15.132:0/229977832 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f214806a430 0x7f214806c8f0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.400+0000 7f21612b9640 1 --2- 172.21.15.132:0/229977832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f215c159d00 0x7f215c1f2e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.400+0000 7f21612b9640 1 --2- 172.21.15.132:0/229977832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f215c0caa90 0x7f215c14edf0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.400+0000 7f21612b9640 1 --2- 172.21.15.132:0/229977832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f215c06cc30 0x7f215c1445e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.400+0000 7f21612b9640 1 -- 172.21.15.132:0/229977832 >> 172.21.15.132:0/229977832 conn(0x7f215c0cfca0 msgr2=0x7f215c0c65a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.400+0000 7f21612b9640 1 -- 172.21.15.132:0/229977832 shutdown_connections 2023-12-20T04:43:34.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.400+0000 7f21612b9640 1 -- 172.21.15.132:0/229977832 wait complete. 2023-12-20T04:43:34.412 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-20T04:43:34.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.513+0000 7fdb125f0640 1 Processor -- start 2023-12-20T04:43:34.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.513+0000 7fdb125f0640 1 -- start start 2023-12-20T04:43:34.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.514+0000 7fdb125f0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb0c15d110 0x7fdb0c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.514+0000 7fdb125f0640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdb0c0b1d10 0x7fdb0c0b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.514+0000 7fdb125f0640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdb0c0cd660 con 0x7fdb0c161940 2023-12-20T04:43:34.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.514+0000 7fdb125f0640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdb0c0cd940 con 0x7fdb0c0b1d10 2023-12-20T04:43:34.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.514+0000 7fdb125f0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c160e60 con 0x7fdb0c15d110 2023-12-20T04:43:34.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.514+0000 7fdb0bfff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb0c15d110 0x7fdb0c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:34.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.514+0000 7fdb0b7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdb0c0b1d10 0x7fdb0c0b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:34.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.514+0000 7fdb10b8d640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fdb0c161940 0x7fdb0c06bcc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:36682/0 (socket says 172.21.15.132:36682) 2023-12-20T04:43:34.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.514+0000 7fdb10b8d640 1 -- 172.21.15.132:0/3730756715 learned_addr learned my addr 172.21.15.132:0/3730756715 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:34.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.514+0000 7fdb0bfff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb0c15d110 0x7fdb0c0b21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:37216/0 (socket says 172.21.15.132:37216) 2023-12-20T04:43:34.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.514+0000 7fdb0bfff640 1 -- 172.21.15.132:0/3730756715 >> v2:172.21.15.187:3300/0 conn(0x7fdb0c0b1d10 msgr2=0x7fdb0c0b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:34.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.514+0000 7fdb0bfff640 1 --2- 172.21.15.132:0/3730756715 >> v2:172.21.15.187:3300/0 conn(0x7fdb0c0b1d10 0x7fdb0c0b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.514+0000 7fdb0bfff640 1 -- 172.21.15.132:0/3730756715 >> v1:172.21.15.187:6789/0 conn(0x7fdb0c161940 legacy=0x7fdb0c06bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.514+0000 7fdb0bfff640 1 -- 172.21.15.132:0/3730756715 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb0c161140 con 0x7fdb0c15d110 2023-12-20T04:43:34.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.515+0000 7fdb0bfff640 1 --2- 172.21.15.132:0/3730756715 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb0c15d110 0x7fdb0c0b21f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0097a0 tx=0x7fdafc02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1645f9a13ef825af server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.515+0000 7fdb0affd640 1 -- 172.21.15.132:0/3730756715 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc031830 con 0x7fdb0c15d110 2023-12-20T04:43:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.515+0000 7fdb0affd640 1 -- 172.21.15.132:0/3730756715 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc031990 con 0x7fdb0c15d110 2023-12-20T04:43:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.515+0000 7fdb0affd640 1 -- 172.21.15.132:0/3730756715 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc031d20 con 0x7fdb0c15d110 2023-12-20T04:43:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.516+0000 7fdb125f0640 1 -- 172.21.15.132:0/3730756715 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb0c15d110 msgr2=0x7fdb0c0b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.516+0000 7fdb125f0640 1 --2- 172.21.15.132:0/3730756715 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb0c15d110 0x7fdb0c0b21f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0097a0 tx=0x7fdafc02b8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.516+0000 7fdb125f0640 1 -- 172.21.15.132:0/3730756715 shutdown_connections 2023-12-20T04:43:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.516+0000 7fdb125f0640 1 --2- 172.21.15.132:0/3730756715 >> v2:172.21.15.187:3300/0 conn(0x7fdb0c0b1d10 0x7fdb0c0b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.516+0000 7fdb125f0640 1 --2- 172.21.15.132:0/3730756715 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb0c15d110 0x7fdb0c0b21f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.516+0000 7fdb125f0640 1 -- 172.21.15.132:0/3730756715 >> 172.21.15.132:0/3730756715 conn(0x7fdb0c0cf880 msgr2=0x7fdb0c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.516+0000 7fdb125f0640 1 -- 172.21.15.132:0/3730756715 shutdown_connections 2023-12-20T04:43:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.516+0000 7fdb125f0640 1 -- 172.21.15.132:0/3730756715 wait complete. 2023-12-20T04:43:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.517+0000 7fdb125f0640 1 Processor -- start 2023-12-20T04:43:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.517+0000 7fdb125f0640 1 -- start start 2023-12-20T04:43:34.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.518+0000 7fdb125f0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb0c0b1d10 0x7fdb0c1f20c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.518+0000 7fdb125f0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb0c15d110 0x7fdb0c15dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.518+0000 7fdb125f0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb0c161940 0x7fdb0c0b5ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.518+0000 7fdb125f0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c1f6d60 con 0x7fdb0c0b1d10 2023-12-20T04:43:34.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.518+0000 7fdb125f0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c1f5e90 con 0x7fdb0c161940 2023-12-20T04:43:34.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.518+0000 7fdb125f0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdb0c1f6150 con 0x7fdb0c15d110 2023-12-20T04:43:34.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.518+0000 7fdb0bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb0c0b1d10 0x7fdb0c1f20c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:34.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.518+0000 7fdb0bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb0c0b1d10 0x7fdb0c1f20c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55578/0 (socket says 172.21.15.132:55578) 2023-12-20T04:43:34.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.518+0000 7fdb0bfff640 1 -- 172.21.15.132:0/3487548188 learned_addr learned my addr 172.21.15.132:0/3487548188 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:34.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.518+0000 7fdb0b7fe640 1 --2- 172.21.15.132:0/3487548188 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb0c15d110 0x7fdb0c15dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:34.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.518+0000 7fdb10b8d640 1 --2- 172.21.15.132:0/3487548188 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb0c161940 0x7fdb0c0b5ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:34.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.518+0000 7fdb0bfff640 1 -- 172.21.15.132:0/3487548188 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb0c15d110 msgr2=0x7fdb0c15dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.518+0000 7fdb0bfff640 1 --2- 172.21.15.132:0/3487548188 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb0c15d110 0x7fdb0c15dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.518+0000 7fdb0bfff640 1 -- 172.21.15.132:0/3487548188 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb0c161940 msgr2=0x7fdb0c0b5ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.518+0000 7fdb0bfff640 1 --2- 172.21.15.132:0/3487548188 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb0c161940 0x7fdb0c0b5ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.518+0000 7fdb0bfff640 1 -- 172.21.15.132:0/3487548188 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc009400 con 0x7fdb0c0b1d10 2023-12-20T04:43:34.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.518+0000 7fdb10b8d640 1 --2- 172.21.15.132:0/3487548188 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb0c161940 0x7fdb0c0b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:34.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.519+0000 7fdb0bfff640 1 --2- 172.21.15.132:0/3487548188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb0c0b1d10 0x7fdb0c1f20c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdafc02bee0 tx=0x7fdafc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:34.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.519+0000 7fdb08ff9640 1 -- 172.21.15.132:0/3487548188 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc03a6f0 con 0x7fdb0c0b1d10 2023-12-20T04:43:34.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.519+0000 7fdb08ff9640 1 -- 172.21.15.132:0/3487548188 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdafc03a870 con 0x7fdb0c0b1d10 2023-12-20T04:43:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.519+0000 7fdb125f0640 1 -- 172.21.15.132:0/3487548188 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb0c1f6430 con 0x7fdb0c0b1d10 2023-12-20T04:43:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.519+0000 7fdb08ff9640 1 -- 172.21.15.132:0/3487548188 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdafc03ac20 con 0x7fdb0c0b1d10 2023-12-20T04:43:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.519+0000 7fdb125f0640 1 -- 172.21.15.132:0/3487548188 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb0c1f69f0 con 0x7fdb0c0b1d10 2023-12-20T04:43:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.520+0000 7fdb125f0640 1 -- 172.21.15.132:0/3487548188 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb0c04e840 con 0x7fdb0c0b1d10 2023-12-20T04:43:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.520+0000 7fdb08ff9640 1 -- 172.21.15.132:0/3487548188 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdafc030380 con 0x7fdb0c0b1d10 2023-12-20T04:43:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.521+0000 7fdb08ff9640 1 --2- 172.21.15.132:0/3487548188 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdaf806a430 0x7fdaf806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.521+0000 7fdb08ff9640 1 -- 172.21.15.132:0/3487548188 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(20..20 src has 1..20) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdafc0aa2c0 con 0x7fdb0c0b1d10 2023-12-20T04:43:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.521+0000 7fdb0b7fe640 1 --2- 172.21.15.132:0/3487548188 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdaf806a430 0x7fdaf806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.521+0000 7fdb0b7fe640 1 --2- 172.21.15.132:0/3487548188 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdaf806a430 0x7fdaf806c8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c1f5df0 tx=0x7fdb00008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:34.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.525+0000 7fdb08ff9640 1 -- 172.21.15.132:0/3487548188 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdafc0759d0 con 0x7fdb0c0b1d10 2023-12-20T04:43:34.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.723+0000 7fdb125f0640 1 -- 172.21.15.132:0/3487548188 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fdb0c0b87b0 con 0x7fdb0c0b1d10 2023-12-20T04:43:34.725 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:43:34.724+0000 7f1a5cbbd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-20T04:43:34.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.735+0000 7fdb08ff9640 1 -- 172.21.15.132:0/3487548188 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v7) v1 ==== 161+0+0 (secure 0 0 0) 0x7fdafc078ff0 con 0x7fdb0c0b1d10 2023-12-20T04:43:34.736 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-20T04:43:34.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.737+0000 7fdb125f0640 1 -- 172.21.15.132:0/3487548188 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdaf806a430 msgr2=0x7fdaf806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.737+0000 7fdb125f0640 1 --2- 172.21.15.132:0/3487548188 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdaf806a430 0x7fdaf806c8f0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7fdb0c1f5df0 tx=0x7fdb00008040 comp rx=0 tx=0).stop 2023-12-20T04:43:34.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.737+0000 7fdb125f0640 1 -- 172.21.15.132:0/3487548188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb0c0b1d10 msgr2=0x7fdb0c1f20c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.737+0000 7fdb125f0640 1 --2- 172.21.15.132:0/3487548188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb0c0b1d10 0x7fdb0c1f20c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fdafc02bee0 tx=0x7fdafc0046c0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.737+0000 7fdb125f0640 1 -- 172.21.15.132:0/3487548188 shutdown_connections 2023-12-20T04:43:34.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.737+0000 7fdb125f0640 1 --2- 172.21.15.132:0/3487548188 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdaf806a430 0x7fdaf806c8f0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.737+0000 7fdb125f0640 1 --2- 172.21.15.132:0/3487548188 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdb0c161940 0x7fdb0c0b5ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.737+0000 7fdb125f0640 1 --2- 172.21.15.132:0/3487548188 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdb0c15d110 0x7fdb0c15dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.737+0000 7fdb125f0640 1 --2- 172.21.15.132:0/3487548188 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdb0c0b1d10 0x7fdb0c1f20c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.737+0000 7fdb125f0640 1 -- 172.21.15.132:0/3487548188 >> 172.21.15.132:0/3487548188 conn(0x7fdb0c0cf880 msgr2=0x7fdb0c0b7fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:34.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.738+0000 7fdb125f0640 1 -- 172.21.15.132:0/3487548188 shutdown_connections 2023-12-20T04:43:34.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.738+0000 7fdb125f0640 1 -- 172.21.15.132:0/3487548188 wait complete. 2023-12-20T04:43:34.741 INFO:tasks.ceph.mds.b.smithi187.stderr: -2609> 2023-12-20T04:42:52.096+0000 7f26ea756640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:43:34.749 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-20T04:43:34.769 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-12-20T04:43:34.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.852+0000 7f90edbcb640 1 Processor -- start 2023-12-20T04:43:34.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.852+0000 7f90edbcb640 1 -- start start 2023-12-20T04:43:34.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.852+0000 7f90edbcb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f90e815d300 0x7f90e80d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.852+0000 7f90edbcb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90e80cfea0 0x7f90e80b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.852+0000 7f90edbcb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90e80d2920 con 0x7f90e80d17d0 2023-12-20T04:43:34.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.852+0000 7f90edbcb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90e80d1d10 con 0x7f90e815d300 2023-12-20T04:43:34.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.852+0000 7f90edbcb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e80d1ff0 con 0x7f90e80cfea0 2023-12-20T04:43:34.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.853+0000 7f90e77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f90e815d300 0x7f90e80d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:34.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.853+0000 7f90dffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f90e80d17d0 0x7f90e80cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40702/0 (socket says 172.21.15.132:40702) 2023-12-20T04:43:34.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.853+0000 7f90dffff640 1 -- 172.21.15.132:0/2524694437 learned_addr learned my addr 172.21.15.132:0/2524694437 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:34.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.853+0000 7f90e7fff640 1 --2- 172.21.15.132:0/2524694437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90e80cfea0 0x7f90e80b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:34.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.853+0000 7f90e77fe640 1 -- 172.21.15.132:0/2524694437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90e80cfea0 msgr2=0x7f90e80b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:34.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.853+0000 7f90e77fe640 1 --2- 172.21.15.132:0/2524694437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90e80cfea0 0x7f90e80b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.853+0000 7f90e77fe640 1 -- 172.21.15.132:0/2524694437 >> v1:172.21.15.132:6789/0 conn(0x7f90e80d17d0 legacy=0x7f90e80cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.853+0000 7f90e77fe640 1 -- 172.21.15.132:0/2524694437 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90e80d22d0 con 0x7f90e815d300 2023-12-20T04:43:34.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.853+0000 7f90e6ffd640 1 -- 172.21.15.132:0/2524694437 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 278864100 0 0) 0x7f90e80d2920 con 0x7f90e80d17d0 2023-12-20T04:43:34.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.853+0000 7f90e7fff640 1 --2- 172.21.15.132:0/2524694437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90e80cfea0 0x7f90e80b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:34.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.854+0000 7f90e77fe640 1 --2- 172.21.15.132:0/2524694437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90e815d300 0x7f90e80d1290 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f90d80097a0 tx=0x7f90d802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3df5cdd1316075ea server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:34.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.854+0000 7f90e6ffd640 1 -- 172.21.15.132:0/2524694437 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8031830 con 0x7f90e815d300 2023-12-20T04:43:34.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.854+0000 7f90e6ffd640 1 -- 172.21.15.132:0/2524694437 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90d8031990 con 0x7f90e815d300 2023-12-20T04:43:34.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.854+0000 7f90e6ffd640 1 -- 172.21.15.132:0/2524694437 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90d8031d20 con 0x7f90e815d300 2023-12-20T04:43:34.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.854+0000 7f90edbcb640 1 -- 172.21.15.132:0/2524694437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90e815d300 msgr2=0x7f90e80d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.854+0000 7f90edbcb640 1 --2- 172.21.15.132:0/2524694437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90e815d300 0x7f90e80d1290 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f90d80097a0 tx=0x7f90d802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.854+0000 7f90edbcb640 1 -- 172.21.15.132:0/2524694437 shutdown_connections 2023-12-20T04:43:34.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.854+0000 7f90edbcb640 1 --2- 172.21.15.132:0/2524694437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90e80cfea0 0x7f90e80b6080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.854+0000 7f90edbcb640 1 --2- 172.21.15.132:0/2524694437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90e815d300 0x7f90e80d1290 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.854+0000 7f90edbcb640 1 -- 172.21.15.132:0/2524694437 >> 172.21.15.132:0/2524694437 conn(0x7f90e806a3d0 msgr2=0x7f90e806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:34.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.854+0000 7f90edbcb640 1 -- 172.21.15.132:0/2524694437 shutdown_connections 2023-12-20T04:43:34.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.854+0000 7f90edbcb640 1 -- 172.21.15.132:0/2524694437 wait complete. 2023-12-20T04:43:34.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.855+0000 7f90edbcb640 1 Processor -- start 2023-12-20T04:43:34.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.856+0000 7f90edbcb640 1 -- start start 2023-12-20T04:43:34.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.856+0000 7f90edbcb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90e80cfea0 0x7f90e80b2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.856+0000 7f90edbcb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90e80d17d0 0x7f90e8154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.856+0000 7f90edbcb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90e815d300 0x7f90e8150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.856+0000 7f90edbcb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e8154a60 con 0x7f90e815d300 2023-12-20T04:43:34.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.856+0000 7f90edbcb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90e81558a0 con 0x7f90e80cfea0 2023-12-20T04:43:34.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.856+0000 7f90edbcb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90e80c8fb0 con 0x7f90e80d17d0 2023-12-20T04:43:34.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.856+0000 7f90e7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90e815d300 0x7f90e8150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:34.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.856+0000 7f90e7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90e815d300 0x7f90e8150cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55598/0 (socket says 172.21.15.132:55598) 2023-12-20T04:43:34.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.856+0000 7f90e7fff640 1 -- 172.21.15.132:0/2152170272 learned_addr learned my addr 172.21.15.132:0/2152170272 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:34.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.857+0000 7f90dffff640 1 --2- 172.21.15.132:0/2152170272 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90e80d17d0 0x7f90e8154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:34.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.857+0000 7f90e7fff640 1 -- 172.21.15.132:0/2152170272 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90e80d17d0 msgr2=0x7f90e8154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.857+0000 7f90e7fff640 1 --2- 172.21.15.132:0/2152170272 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90e80d17d0 0x7f90e8154520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.857+0000 7f90e7fff640 1 -- 172.21.15.132:0/2152170272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90e80cfea0 msgr2=0x7f90e80b2b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:34.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.857+0000 7f90e7fff640 1 --2- 172.21.15.132:0/2152170272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90e80cfea0 0x7f90e80b2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:34.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.857+0000 7f90e7fff640 1 -- 172.21.15.132:0/2152170272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d8009400 con 0x7f90e815d300 2023-12-20T04:43:34.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.857+0000 7f90e7fff640 1 --2- 172.21.15.132:0/2152170272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90e815d300 0x7f90e8150cf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f90e000ce70 tx=0x7f90e000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:34.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.857+0000 7f90e4ff9640 1 -- 172.21.15.132:0/2152170272 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e0003b90 con 0x7f90e815d300 2023-12-20T04:43:34.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.857+0000 7f90e4ff9640 1 -- 172.21.15.132:0/2152170272 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90e0003d10 con 0x7f90e815d300 2023-12-20T04:43:34.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.857+0000 7f90e4ff9640 1 -- 172.21.15.132:0/2152170272 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90e0004260 con 0x7f90e815d300 2023-12-20T04:43:34.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.857+0000 7f90edbcb640 1 -- 172.21.15.132:0/2152170272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90e8154c90 con 0x7f90e815d300 2023-12-20T04:43:34.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.857+0000 7f90edbcb640 1 -- 172.21.15.132:0/2152170272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90e8155250 con 0x7f90e815d300 2023-12-20T04:43:34.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.858+0000 7f90edbcb640 1 -- 172.21.15.132:0/2152170272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90e804e840 con 0x7f90e815d300 2023-12-20T04:43:34.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.858+0000 7f90e4ff9640 1 -- 172.21.15.132:0/2152170272 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f90e00043c0 con 0x7f90e815d300 2023-12-20T04:43:34.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.859+0000 7f90e4ff9640 1 --2- 172.21.15.132:0/2152170272 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90c806a430 0x7f90c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:34.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.859+0000 7f90e4ff9640 1 -- 172.21.15.132:0/2152170272 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(21..21 src has 1..21) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f90e00892e0 con 0x7f90e815d300 2023-12-20T04:43:34.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.859+0000 7f90e77fe640 1 --2- 172.21.15.132:0/2152170272 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90c806a430 0x7f90c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:34.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.859+0000 7f90e77fe640 1 --2- 172.21.15.132:0/2152170272 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90c806a430 0x7f90c806c8f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f90d8036000 tx=0x7f90d8030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:34.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:34.863+0000 7f90e4ff9640 1 -- 172.21.15.132:0/2152170272 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f90e0054800 con 0x7f90e815d300 2023-12-20T04:43:35.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.064+0000 7f90edbcb640 1 -- 172.21.15.132:0/2152170272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f90e8155a10 con 0x7f90e815d300 2023-12-20T04:43:35.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.736+0000 7f90e4ff9640 1 -- 172.21.15.132:0/2152170272 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v8) v1 ==== 104+0+0 (secure 0 0 0) 0x7f90e0003e80 con 0x7f90e815d300 2023-12-20T04:43:35.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.739+0000 7f90edbcb640 1 -- 172.21.15.132:0/2152170272 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90c806a430 msgr2=0x7f90c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:35.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.739+0000 7f90edbcb640 1 --2- 172.21.15.132:0/2152170272 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90c806a430 0x7f90c806c8f0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f90d8036000 tx=0x7f90d8030000 comp rx=0 tx=0).stop 2023-12-20T04:43:35.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.739+0000 7f90edbcb640 1 -- 172.21.15.132:0/2152170272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90e815d300 msgr2=0x7f90e8150cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:35.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.739+0000 7f90edbcb640 1 --2- 172.21.15.132:0/2152170272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90e815d300 0x7f90e8150cf0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f90e000ce70 tx=0x7f90e000a710 comp rx=0 tx=0).stop 2023-12-20T04:43:35.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.739+0000 7f90edbcb640 1 -- 172.21.15.132:0/2152170272 shutdown_connections 2023-12-20T04:43:35.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.739+0000 7f90edbcb640 1 --2- 172.21.15.132:0/2152170272 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90c806a430 0x7f90c806c8f0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:35.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.739+0000 7f90edbcb640 1 --2- 172.21.15.132:0/2152170272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90e815d300 0x7f90e8150cf0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:35.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.739+0000 7f90edbcb640 1 --2- 172.21.15.132:0/2152170272 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90e80d17d0 0x7f90e8154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:35.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.739+0000 7f90edbcb640 1 --2- 172.21.15.132:0/2152170272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90e80cfea0 0x7f90e80b2b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:35.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.739+0000 7f90edbcb640 1 -- 172.21.15.132:0/2152170272 >> 172.21.15.132:0/2152170272 conn(0x7f90e806a3d0 msgr2=0x7f90e8158030 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:35.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.739+0000 7f90edbcb640 1 -- 172.21.15.132:0/2152170272 shutdown_connections 2023-12-20T04:43:35.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.739+0000 7f90edbcb640 1 -- 172.21.15.132:0/2152170272 wait complete. 2023-12-20T04:43:35.751 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-20T04:43:35.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.855+0000 7f8523f88640 1 Processor -- start 2023-12-20T04:43:35.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.856+0000 7f8523f88640 1 -- start start 2023-12-20T04:43:35.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.856+0000 7f8523f88640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c15d590 0x7f851c0aed80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:35.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.856+0000 7f8523f88640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f851c069c30 0x7f851c06a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:35.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.856+0000 7f8523f88640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f851c160b80 con 0x7f851c0cb200 2023-12-20T04:43:35.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.856+0000 7f8523f88640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f851c06a600 con 0x7f851c069c30 2023-12-20T04:43:35.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.856+0000 7f8523f88640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c15dac0 con 0x7f851c15d590 2023-12-20T04:43:35.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.856+0000 7f8521d24640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f851c0cb200 0x7f851c0cb5e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40704/0 (socket says 172.21.15.132:40704) 2023-12-20T04:43:35.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.856+0000 7f8521d24640 1 -- 172.21.15.132:0/3566701103 learned_addr learned my addr 172.21.15.132:0/3566701103 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:35.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8520d22640 1 -- 172.21.15.132:0/3566701103 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 825401747 0 0) 0x7f851c160b80 con 0x7f851c0cb200 2023-12-20T04:43:35.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8520d22640 1 -- 172.21.15.132:0/3566701103 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8508003520 con 0x7f851c0cb200 2023-12-20T04:43:35.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8522525640 1 --2- 172.21.15.132:0/3566701103 >> v2:172.21.15.187:3300/0 conn(0x7f851c069c30 0x7f851c06a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:35.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8521523640 1 --2- 172.21.15.132:0/3566701103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c15d590 0x7f851c0aed80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:35.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8520d22640 1 -- 172.21.15.132:0/3566701103 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1529019126 0 0) 0x7f8508003520 con 0x7f851c0cb200 2023-12-20T04:43:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8520d22640 1 -- 172.21.15.132:0/3566701103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c15d590 msgr2=0x7f851c0aed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8520d22640 1 --2- 172.21.15.132:0/3566701103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c15d590 0x7f851c0aed80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8520d22640 1 -- 172.21.15.132:0/3566701103 >> v2:172.21.15.187:3300/0 conn(0x7f851c069c30 msgr2=0x7f851c06a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8520d22640 1 --2- 172.21.15.132:0/3566701103 >> v2:172.21.15.187:3300/0 conn(0x7f851c069c30 0x7f851c06a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8520d22640 1 -- 172.21.15.132:0/3566701103 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c15dda0 con 0x7f851c0cb200 2023-12-20T04:43:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8520d22640 1 -- 172.21.15.132:0/3566701103 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f85180019f0 con 0x7f851c0cb200 2023-12-20T04:43:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8520d22640 1 -- 172.21.15.132:0/3566701103 >> v1:172.21.15.132:6789/0 conn(0x7f851c0cb200 legacy=0x7f851c0cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8520d22640 1 --2- 172.21.15.132:0/3566701103 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8508003970 0x7f8508003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8520d22640 1 --2- 172.21.15.132:0/3566701103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85080047c0 0x7f8508004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8520d22640 1 --2- 172.21.15.132:0/3566701103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c15d590 0x7f8508005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8520d22640 1 -- 172.21.15.132:0/3566701103 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c06a600 con 0x7f85080047c0 2023-12-20T04:43:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8520d22640 1 -- 172.21.15.132:0/3566701103 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c15dac0 con 0x7f8508003970 2023-12-20T04:43:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8520d22640 1 -- 172.21.15.132:0/3566701103 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f850800b980 con 0x7f851c15d590 2023-12-20T04:43:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8521523640 1 --2- 172.21.15.132:0/3566701103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85080047c0 0x7f8508004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:35.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8521d24640 1 --2- 172.21.15.132:0/3566701103 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8508003970 0x7f8508003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:35.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8522525640 1 --2- 172.21.15.132:0/3566701103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c15d590 0x7f8508005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:35.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8521523640 1 -- 172.21.15.132:0/3566701103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c15d590 msgr2=0x7f8508005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:35.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8521523640 1 --2- 172.21.15.132:0/3566701103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c15d590 0x7f8508005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:35.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8521523640 1 -- 172.21.15.132:0/3566701103 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8508003970 msgr2=0x7f8508003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:35.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8521523640 1 --2- 172.21.15.132:0/3566701103 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8508003970 0x7f8508003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:35.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.857+0000 7f8521523640 1 -- 172.21.15.132:0/3566701103 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8508003520 con 0x7f85080047c0 2023-12-20T04:43:35.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.858+0000 7f8521523640 1 --2- 172.21.15.132:0/3566701103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85080047c0 0x7f8508004c40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f850c009ac0 tx=0x7f85080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a03aee3e78f54977 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:35.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.858+0000 7f8520d22640 1 -- 172.21.15.132:0/3566701103 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c02c6b0 con 0x7f85080047c0 2023-12-20T04:43:35.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.858+0000 7f8520d22640 1 -- 172.21.15.132:0/3566701103 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f850c02c810 con 0x7f85080047c0 2023-12-20T04:43:35.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.858+0000 7f8520d22640 1 -- 172.21.15.132:0/3566701103 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f850c02cba0 con 0x7f85080047c0 2023-12-20T04:43:35.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.859+0000 7f8523f88640 1 -- 172.21.15.132:0/3566701103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85080047c0 msgr2=0x7f8508004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:35.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.859+0000 7f8523f88640 1 --2- 172.21.15.132:0/3566701103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85080047c0 0x7f8508004c40 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f850c009ac0 tx=0x7f85080057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:35.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.859+0000 7f8522525640 1 -- 172.21.15.132:0/3566701103 reap_dead start 2023-12-20T04:43:35.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.859+0000 7f8523f88640 1 -- 172.21.15.132:0/3566701103 shutdown_connections 2023-12-20T04:43:35.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.859+0000 7f8523f88640 1 -- 172.21.15.132:0/3566701103 >> 172.21.15.132:0/3566701103 conn(0x7f851c0b16b0 msgr2=0x7f851c0b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:35.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.859+0000 7f8523f88640 1 -- 172.21.15.132:0/3566701103 shutdown_connections 2023-12-20T04:43:35.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.859+0000 7f8523f88640 1 -- 172.21.15.132:0/3566701103 wait complete. 2023-12-20T04:43:35.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.860+0000 7f8523f88640 1 Processor -- start 2023-12-20T04:43:35.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.860+0000 7f8523f88640 1 -- start start 2023-12-20T04:43:35.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8523f88640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85080047c0 0x7f851c1549d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:35.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8523f88640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f851c154f10 0x7f851c0c7a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:35.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8523f88640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c0c7fa0 0x7f851c0cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:35.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8523f88640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c0b54f0 con 0x7f85080047c0 2023-12-20T04:43:35.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8523f88640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f851c0b2720 con 0x7f851c154f10 2023-12-20T04:43:35.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8523f88640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f851c160420 con 0x7f851c0c7fa0 2023-12-20T04:43:35.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8521d24640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85080047c0 0x7f851c1549d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:35.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8521d24640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85080047c0 0x7f851c1549d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55628/0 (socket says 172.21.15.132:55628) 2023-12-20T04:43:35.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8521d24640 1 -- 172.21.15.132:0/3900814148 learned_addr learned my addr 172.21.15.132:0/3900814148 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:35.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8522525640 1 --2- 172.21.15.132:0/3900814148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c0c7fa0 0x7f851c0cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:35.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8521523640 1 --2- 172.21.15.132:0/3900814148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f851c154f10 0x7f851c0c7a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:35.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8521d24640 1 -- 172.21.15.132:0/3900814148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c0c7fa0 msgr2=0x7f851c0cb5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:35.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8521d24640 1 --2- 172.21.15.132:0/3900814148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c0c7fa0 0x7f851c0cb5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:35.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8521d24640 1 -- 172.21.15.132:0/3900814148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f851c154f10 msgr2=0x7f851c0c7a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:35.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8521d24640 1 --2- 172.21.15.132:0/3900814148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f851c154f10 0x7f851c0c7a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:35.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8521d24640 1 -- 172.21.15.132:0/3900814148 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f851c0b2930 con 0x7f85080047c0 2023-12-20T04:43:35.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8521523640 1 --2- 172.21.15.132:0/3900814148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f851c154f10 0x7f851c0c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:35.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8521d24640 1 --2- 172.21.15.132:0/3900814148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85080047c0 0x7f851c1549d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8518007a50 tx=0x7f851800a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:35.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f85127fc640 1 -- 172.21.15.132:0/3900814148 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8518001a40 con 0x7f85080047c0 2023-12-20T04:43:35.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f85127fc640 1 -- 172.21.15.132:0/3900814148 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f85180133f0 con 0x7f85080047c0 2023-12-20T04:43:35.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.861+0000 7f8523f88640 1 -- 172.21.15.132:0/3900814148 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f851c0b2c10 con 0x7f85080047c0 2023-12-20T04:43:35.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.862+0000 7f85127fc640 1 -- 172.21.15.132:0/3900814148 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f85180137a0 con 0x7f85080047c0 2023-12-20T04:43:35.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.862+0000 7f8523f88640 1 -- 172.21.15.132:0/3900814148 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f851c0b31d0 con 0x7f85080047c0 2023-12-20T04:43:35.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.862+0000 7f8523f88640 1 -- 172.21.15.132:0/3900814148 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f851c0b2da0 con 0x7f85080047c0 2023-12-20T04:43:35.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.863+0000 7f85127fc640 1 -- 172.21.15.132:0/3900814148 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8518013b10 con 0x7f85080047c0 2023-12-20T04:43:35.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.863+0000 7f85127fc640 1 --2- 172.21.15.132:0/3900814148 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f850006a460 0x7f850006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:35.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.863+0000 7f8521523640 1 --2- 172.21.15.132:0/3900814148 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f850006a460 0x7f850006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:35.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.863+0000 7f85127fc640 1 -- 172.21.15.132:0/3900814148 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 5911+0+0 (secure 0 0 0) 0x7f85180896d0 con 0x7f85080047c0 2023-12-20T04:43:35.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.864+0000 7f8521523640 1 --2- 172.21.15.132:0/3900814148 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f850006a460 0x7f850006c920 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f850c036000 tx=0x7f850c030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:35.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:35.868+0000 7f85127fc640 1 -- 172.21.15.132:0/3900814148 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8518054c80 con 0x7f85080047c0 2023-12-20T04:43:36.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:36.038+0000 7f8523f88640 1 -- 172.21.15.132:0/3900814148 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f851c0b33c0 con 0x7f85080047c0 2023-12-20T04:43:37.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.018+0000 7f85127fc640 1 -- 172.21.15.132:0/3900814148 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v23) v1 ==== 181+0+0 (secure 0 0 0) 0x7f85180582a0 con 0x7f85080047c0 2023-12-20T04:43:37.020 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2023-12-20T04:43:37.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.021+0000 7f8523f88640 1 -- 172.21.15.132:0/3900814148 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f850006a460 msgr2=0x7f850006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:37.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.021+0000 7f8523f88640 1 --2- 172.21.15.132:0/3900814148 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f850006a460 0x7f850006c920 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f850c036000 tx=0x7f850c030000 comp rx=0 tx=0).stop 2023-12-20T04:43:37.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.021+0000 7f8523f88640 1 -- 172.21.15.132:0/3900814148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85080047c0 msgr2=0x7f851c1549d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:37.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.021+0000 7f8523f88640 1 --2- 172.21.15.132:0/3900814148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85080047c0 0x7f851c1549d0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f8518007a50 tx=0x7f851800a730 comp rx=0 tx=0).stop 2023-12-20T04:43:37.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.021+0000 7f8523f88640 1 -- 172.21.15.132:0/3900814148 shutdown_connections 2023-12-20T04:43:37.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.021+0000 7f8523f88640 1 --2- 172.21.15.132:0/3900814148 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f850006a460 0x7f850006c920 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:37.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.021+0000 7f8523f88640 1 --2- 172.21.15.132:0/3900814148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f851c0c7fa0 0x7f851c0cb5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:37.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.021+0000 7f8523f88640 1 --2- 172.21.15.132:0/3900814148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f851c154f10 0x7f851c0c7a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:37.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.021+0000 7f8523f88640 1 --2- 172.21.15.132:0/3900814148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85080047c0 0x7f851c1549d0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:37.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.021+0000 7f8523f88640 1 -- 172.21.15.132:0/3900814148 >> 172.21.15.132:0/3900814148 conn(0x7f851c0b16b0 msgr2=0x7f851c0ccfb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:37.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.021+0000 7f8523f88640 1 -- 172.21.15.132:0/3900814148 shutdown_connections 2023-12-20T04:43:37.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.021+0000 7f8523f88640 1 -- 172.21.15.132:0/3900814148 wait complete. 2023-12-20T04:43:37.036 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-20T04:43:37.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.143+0000 7fafc230a640 1 Processor -- start 2023-12-20T04:43:37.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.143+0000 7fafc230a640 1 -- start start 2023-12-20T04:43:37.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.144+0000 7fafc230a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fafbc071510 0x7fafbc0cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:37.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.144+0000 7fafc230a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fafbc070890 0x7fafbc0cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:37.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.144+0000 7fafc230a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fafbc0cdcb0 con 0x7fafbc069ea0 2023-12-20T04:43:37.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.144+0000 7fafc230a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafbc06e8b0 con 0x7fafbc070890 2023-12-20T04:43:37.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.144+0000 7fafc230a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fafbc0aed40 con 0x7fafbc071510 2023-12-20T04:43:37.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.144+0000 7fafc08a7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fafbc070890 0x7fafbc0cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:37.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.144+0000 7fafc08a7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fafbc070890 0x7fafbc0cf0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55644/0 (socket says 172.21.15.132:55644) 2023-12-20T04:43:37.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.144+0000 7fafc08a7640 1 -- 172.21.15.132:0/1688113490 learned_addr learned my addr 172.21.15.132:0/1688113490 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:37.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.144+0000 7fafbbfff640 1 --1- 172.21.15.132:0/1688113490 >> v1:172.21.15.132:6789/0 conn(0x7fafbc069ea0 0x7fafbc06c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40712/0 (socket says 172.21.15.132:40712) 2023-12-20T04:43:37.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.144+0000 7fafc08a7640 1 -- 172.21.15.132:0/1688113490 >> v2:172.21.15.187:3300/0 conn(0x7fafbc071510 msgr2=0x7fafbc0cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:37.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.144+0000 7fafbb7fe640 1 --2- 172.21.15.132:0/1688113490 >> v2:172.21.15.187:3300/0 conn(0x7fafbc071510 0x7fafbc0cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:37.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.144+0000 7fafbaffd640 1 -- 172.21.15.132:0/1688113490 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 398148430 0 0) 0x7fafac001110 con 0x7fafbc069ea0 2023-12-20T04:43:37.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.144+0000 7fafc08a7640 1 --2- 172.21.15.132:0/1688113490 >> v2:172.21.15.187:3300/0 conn(0x7fafbc071510 0x7fafbc0cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:37.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.145+0000 7fafc08a7640 1 -- 172.21.15.132:0/1688113490 >> v1:172.21.15.132:6789/0 conn(0x7fafbc069ea0 legacy=0x7fafbc06c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:37.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.145+0000 7fafc08a7640 1 -- 172.21.15.132:0/1688113490 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafbc0af020 con 0x7fafbc070890 2023-12-20T04:43:37.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.145+0000 7fafbb7fe640 1 --2- 172.21.15.132:0/1688113490 >> v2:172.21.15.187:3300/0 conn(0x7fafbc071510 0x7fafbc0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:37.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.145+0000 7fafc08a7640 1 --2- 172.21.15.132:0/1688113490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafbc070890 0x7fafbc0cf0d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fafbc06a7d0 tx=0x7fafb402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77b05e1ed926d4fa server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:37.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.145+0000 7fafbaffd640 1 -- 172.21.15.132:0/1688113490 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb402ca80 con 0x7fafbc070890 2023-12-20T04:43:37.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.145+0000 7fafbaffd640 1 -- 172.21.15.132:0/1688113490 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb402cbe0 con 0x7fafbc070890 2023-12-20T04:43:37.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.145+0000 7fafbaffd640 1 -- 172.21.15.132:0/1688113490 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb40343f0 con 0x7fafbc070890 2023-12-20T04:43:37.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.146+0000 7fafc230a640 1 -- 172.21.15.132:0/1688113490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafbc070890 msgr2=0x7fafbc0cf0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:37.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.146+0000 7fafc230a640 1 --2- 172.21.15.132:0/1688113490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafbc070890 0x7fafbc0cf0d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fafbc06a7d0 tx=0x7fafb402bee0 comp rx=0 tx=0).stop 2023-12-20T04:43:37.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.146+0000 7fafc230a640 1 -- 172.21.15.132:0/1688113490 shutdown_connections 2023-12-20T04:43:37.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.146+0000 7fafc230a640 1 --2- 172.21.15.132:0/1688113490 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafbc070890 0x7fafbc0cf0d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:37.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.146+0000 7fafc230a640 1 --2- 172.21.15.132:0/1688113490 >> v2:172.21.15.187:3300/0 conn(0x7fafbc071510 0x7fafbc0cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:37.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.146+0000 7fafc230a640 1 -- 172.21.15.132:0/1688113490 >> 172.21.15.132:0/1688113490 conn(0x7fafbc0b16b0 msgr2=0x7fafbc0b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:37.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.146+0000 7fafc230a640 1 -- 172.21.15.132:0/1688113490 shutdown_connections 2023-12-20T04:43:37.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.146+0000 7fafc230a640 1 -- 172.21.15.132:0/1688113490 wait complete. 2023-12-20T04:43:37.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.147+0000 7fafc230a640 1 Processor -- start 2023-12-20T04:43:37.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.147+0000 7fafc230a640 1 -- start start 2023-12-20T04:43:37.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafc230a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fafbc069ea0 0x7fafbc14fda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:37.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafc230a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafbc070890 0x7fafbc0c5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:37.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafc230a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafbc071510 0x7fafbc0b3670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:37.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafc230a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0c4a70 con 0x7fafbc071510 2023-12-20T04:43:37.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafc230a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0c58d0 con 0x7fafbc070890 2023-12-20T04:43:37.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafc230a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fafbc0c4cc0 con 0x7fafbc069ea0 2023-12-20T04:43:37.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafc08a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafbc071510 0x7fafbc0b3670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:37.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafc08a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafbc071510 0x7fafbc0b3670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:55652/0 (socket says 172.21.15.132:55652) 2023-12-20T04:43:37.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafc08a7640 1 -- 172.21.15.132:0/4153736853 learned_addr learned my addr 172.21.15.132:0/4153736853 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:37.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafbbfff640 1 --2- 172.21.15.132:0/4153736853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fafbc069ea0 0x7fafbc14fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:37.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafc08a7640 1 -- 172.21.15.132:0/4153736853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fafbc069ea0 msgr2=0x7fafbc14fda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:37.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafbb7fe640 1 --2- 172.21.15.132:0/4153736853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafbc070890 0x7fafbc0c5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:37.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafc08a7640 1 --2- 172.21.15.132:0/4153736853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fafbc069ea0 0x7fafbc14fda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:37.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafc08a7640 1 -- 172.21.15.132:0/4153736853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafbc070890 msgr2=0x7fafbc0c5d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:37.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafc08a7640 1 --2- 172.21.15.132:0/4153736853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafbc070890 0x7fafbc0c5d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:37.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafc08a7640 1 -- 172.21.15.132:0/4153736853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafb4009b30 con 0x7fafbc071510 2023-12-20T04:43:37.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafbb7fe640 1 --2- 172.21.15.132:0/4153736853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafbc070890 0x7fafbc0c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:37.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.148+0000 7fafbbfff640 1 --2- 172.21.15.132:0/4153736853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fafbc069ea0 0x7fafbc14fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:37.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.149+0000 7fafc08a7640 1 --2- 172.21.15.132:0/4153736853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafbc071510 0x7fafbc0b3670 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009f40 tx=0x7fafb4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:37.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.149+0000 7fafb8ff9640 1 -- 172.21.15.132:0/4153736853 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb403e450 con 0x7fafbc071510 2023-12-20T04:43:37.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.149+0000 7fafb8ff9640 1 -- 172.21.15.132:0/4153736853 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fafb403e5d0 con 0x7fafbc071510 2023-12-20T04:43:37.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.149+0000 7fafc230a640 1 -- 172.21.15.132:0/4153736853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafbc0c4fa0 con 0x7fafbc071510 2023-12-20T04:43:37.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.149+0000 7fafb8ff9640 1 -- 172.21.15.132:0/4153736853 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fafb403e780 con 0x7fafbc071510 2023-12-20T04:43:37.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.149+0000 7fafc230a640 1 -- 172.21.15.132:0/4153736853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafbc0c5560 con 0x7fafbc071510 2023-12-20T04:43:37.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.150+0000 7fafc230a640 1 -- 172.21.15.132:0/4153736853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafbc0c5a60 con 0x7fafbc071510 2023-12-20T04:43:37.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.150+0000 7fafb8ff9640 1 -- 172.21.15.132:0/4153736853 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fafb402cd50 con 0x7fafbc071510 2023-12-20T04:43:37.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.150+0000 7fafb8ff9640 1 --2- 172.21.15.132:0/4153736853 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fafa806a460 0x7fafa806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:37.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.151+0000 7fafbbfff640 1 --2- 172.21.15.132:0/4153736853 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fafa806a460 0x7fafa806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:37.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.151+0000 7fafb8ff9640 1 -- 172.21.15.132:0/4153736853 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(23..23 src has 1..23) v4 ==== 5473+0+0 (secure 0 0 0) 0x7fafb40ab150 con 0x7fafbc071510 2023-12-20T04:43:37.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.151+0000 7fafbbfff640 1 --2- 172.21.15.132:0/4153736853 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fafa806a460 0x7fafa806c920 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fafac000f60 tx=0x7fafac009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:37.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.155+0000 7fafb8ff9640 1 -- 172.21.15.132:0/4153736853 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fafb40768b0 con 0x7fafbc071510 2023-12-20T04:43:37.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:37.321+0000 7fafc230a640 1 -- 172.21.15.132:0/4153736853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fafbc04e840 con 0x7fafbc071510 2023-12-20T04:43:38.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.022+0000 7fafb8ff9640 1 -- 172.21.15.132:0/4153736853 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v24) v1 ==== 169+0+0 (secure 0 0 0) 0x7fafb4033e80 con 0x7fafbc071510 2023-12-20T04:43:38.024 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2023-12-20T04:43:38.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.026+0000 7fafc230a640 1 -- 172.21.15.132:0/4153736853 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fafa806a460 msgr2=0x7fafa806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:38.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.026+0000 7fafc230a640 1 --2- 172.21.15.132:0/4153736853 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fafa806a460 0x7fafa806c920 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7fafac000f60 tx=0x7fafac009040 comp rx=0 tx=0).stop 2023-12-20T04:43:38.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.026+0000 7fafc230a640 1 -- 172.21.15.132:0/4153736853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafbc071510 msgr2=0x7fafbc0b3670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:38.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.026+0000 7fafc230a640 1 --2- 172.21.15.132:0/4153736853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafbc071510 0x7fafbc0b3670 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fafb4009f40 tx=0x7fafb4004a40 comp rx=0 tx=0).stop 2023-12-20T04:43:38.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.026+0000 7fafc230a640 1 -- 172.21.15.132:0/4153736853 shutdown_connections 2023-12-20T04:43:38.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.026+0000 7fafc230a640 1 --2- 172.21.15.132:0/4153736853 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fafa806a460 0x7fafa806c920 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:38.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.026+0000 7fafc230a640 1 --2- 172.21.15.132:0/4153736853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fafbc071510 0x7fafbc0b3670 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:38.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.027+0000 7fafc230a640 1 --2- 172.21.15.132:0/4153736853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fafbc070890 0x7fafbc0c5d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:38.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.027+0000 7fafc230a640 1 --2- 172.21.15.132:0/4153736853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fafbc069ea0 0x7fafbc14fda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:38.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.027+0000 7fafc230a640 1 -- 172.21.15.132:0/4153736853 >> 172.21.15.132:0/4153736853 conn(0x7fafbc0b16b0 msgr2=0x7fafbc0adaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:38.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.027+0000 7fafc230a640 1 -- 172.21.15.132:0/4153736853 shutdown_connections 2023-12-20T04:43:38.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.027+0000 7fafc230a640 1 -- 172.21.15.132:0/4153736853 wait complete. 2023-12-20T04:43:38.041 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-20T04:43:38.041 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-20T04:43:38.042 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-20T04:43:38.042 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:43:38.042 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-20T04:43:38.042 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-20T04:43:38.042 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-20T04:43:38.043 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:43:38.043 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-20T04:43:38.043 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-20T04:43:38.043 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-20T04:43:38.044 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:43:38.044 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-20T04:43:38.044 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-20T04:43:38.044 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-20T04:43:38.045 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:43:38.052 INFO:tasks.ceph.mds.a:Stopped 2023-12-20T04:43:38.052 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-20T04:43:38.053 INFO:tasks.ceph.mds.c:Stopped 2023-12-20T04:43:38.054 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-20T04:43:38.058 INFO:tasks.ceph.mds.b:Stopped 2023-12-20T04:43:38.058 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-20T04:43:38.058 INFO:tasks.ceph.mds.d:Stopped 2023-12-20T04:43:38.059 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-20T04:43:38.094 INFO:tasks.ceph.mds.a:Started 2023-12-20T04:43:38.094 DEBUG:teuthology.parallel:result is None 2023-12-20T04:43:38.095 INFO:tasks.ceph.mds.c:Started 2023-12-20T04:43:38.095 DEBUG:teuthology.parallel:result is None 2023-12-20T04:43:38.100 INFO:tasks.ceph.mds.b:Started 2023-12-20T04:43:38.101 DEBUG:teuthology.parallel:result is None 2023-12-20T04:43:38.101 INFO:tasks.ceph.mds.d:Started 2023-12-20T04:43:38.102 DEBUG:teuthology.parallel:result is None 2023-12-20T04:43:38.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-20T04:43:38.174 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-12-20T04:43:38.174 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-12-20T04:43:38.188 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-12-20T04:43:38.189 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-12-20T04:43:38.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.211+0000 7f8700cd5640 1 Processor -- start 2023-12-20T04:43:38.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.211+0000 7f8700cd5640 1 -- start start 2023-12-20T04:43:38.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.212+0000 7f8700cd5640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f86fc15d2c0 0x7f86fc0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:38.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.212+0000 7f8700cd5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f86fc0d0060 0x7f86fc0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:38.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.212+0000 7f8700cd5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86fc0d0cf0 con 0x7f86fc0d30a0 2023-12-20T04:43:38.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.212+0000 7f8700cd5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86fc0d0550 con 0x7f86fc0d0060 2023-12-20T04:43:38.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.212+0000 7f8700cd5640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86fc0cddc0 con 0x7f86fc15d2c0 2023-12-20T04:43:38.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.212+0000 7f86fad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f86fc0d0060 0x7f86fc0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.212+0000 7f86fa59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f86fc0d30a0 0x7f86fc0d3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52430/0 (socket says 172.21.15.132:52430) 2023-12-20T04:43:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.212+0000 7f86fa59c640 1 -- 172.21.15.132:0/1894582312 learned_addr learned my addr 172.21.15.132:0/1894582312 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.212+0000 7f86fad9d640 1 --2- 172.21.15.132:0/1894582312 >> v2:172.21.15.132:3300/0 conn(0x7f86fc0d0060 0x7f86fc0d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35294/0 (socket says 172.21.15.132:35294) 2023-12-20T04:43:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.212+0000 7f86f9d9b640 1 --2- 172.21.15.132:0/1894582312 >> v2:172.21.15.187:3300/0 conn(0x7f86fc15d2c0 0x7f86fc0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.212+0000 7f86fad9d640 1 -- 172.21.15.132:0/1894582312 >> v2:172.21.15.187:3300/0 conn(0x7f86fc15d2c0 msgr2=0x7f86fc0cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.212+0000 7f86fad9d640 1 --2- 172.21.15.132:0/1894582312 >> v2:172.21.15.187:3300/0 conn(0x7f86fc15d2c0 0x7f86fc0cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.212+0000 7f86fad9d640 1 -- 172.21.15.132:0/1894582312 >> v1:172.21.15.132:6789/0 conn(0x7f86fc0d30a0 legacy=0x7f86fc0d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.212+0000 7f86fad9d640 1 -- 172.21.15.132:0/1894582312 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86fc0ce0a0 con 0x7f86fc0d0060 2023-12-20T04:43:38.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.212+0000 7f86f959a640 1 -- 172.21.15.132:0/1894582312 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2093619524 0 0) 0x7f86fc0d0cf0 con 0x7f86fc0d30a0 2023-12-20T04:43:38.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.213+0000 7f86fad9d640 1 --2- 172.21.15.132:0/1894582312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86fc0d0060 0x7f86fc0d1180 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0b59c0 tx=0x7f86f402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a099475adbd4a195 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:38.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.213+0000 7f86f959a640 1 -- 172.21.15.132:0/1894582312 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f402cc80 con 0x7f86fc0d0060 2023-12-20T04:43:38.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.213+0000 7f86f959a640 1 -- 172.21.15.132:0/1894582312 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f402cde0 con 0x7f86fc0d0060 2023-12-20T04:43:38.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.213+0000 7f86f959a640 1 -- 172.21.15.132:0/1894582312 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f4034660 con 0x7f86fc0d0060 2023-12-20T04:43:38.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.214+0000 7f8700cd5640 1 -- 172.21.15.132:0/1894582312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86fc0d0060 msgr2=0x7f86fc0d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:38.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.214+0000 7f8700cd5640 1 --2- 172.21.15.132:0/1894582312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86fc0d0060 0x7f86fc0d1180 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f86fc0b59c0 tx=0x7f86f402bed0 comp rx=0 tx=0).stop 2023-12-20T04:43:38.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.214+0000 7f8700cd5640 1 -- 172.21.15.132:0/1894582312 shutdown_connections 2023-12-20T04:43:38.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.214+0000 7f8700cd5640 1 --2- 172.21.15.132:0/1894582312 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86fc0d0060 0x7f86fc0d1180 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:38.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.214+0000 7f8700cd5640 1 --2- 172.21.15.132:0/1894582312 >> v2:172.21.15.187:3300/0 conn(0x7f86fc15d2c0 0x7f86fc0cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:38.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.214+0000 7f8700cd5640 1 -- 172.21.15.132:0/1894582312 >> 172.21.15.132:0/1894582312 conn(0x7f86fc072e40 msgr2=0x7f86fc073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:38.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.214+0000 7f8700cd5640 1 -- 172.21.15.132:0/1894582312 shutdown_connections 2023-12-20T04:43:38.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.214+0000 7f8700cd5640 1 -- 172.21.15.132:0/1894582312 wait complete. 2023-12-20T04:43:38.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.215+0000 7f8700cd5640 1 Processor -- start 2023-12-20T04:43:38.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.215+0000 7f8700cd5640 1 -- start start 2023-12-20T04:43:38.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.216+0000 7f8700cd5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86fc0d0060 0x7f86fc0cb030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:38.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.216+0000 7f8700cd5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86fc0d30a0 0x7f86fc0cb570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:38.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.216+0000 7f8700cd5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86fc15d2c0 0x7f86fc0b7260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:38.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.216+0000 7f8700cd5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc0ccc40 con 0x7f86fc15d2c0 2023-12-20T04:43:38.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.216+0000 7f8700cd5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc15e190 con 0x7f86fc0d30a0 2023-12-20T04:43:38.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.216+0000 7f8700cd5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc0cbba0 con 0x7f86fc0d0060 2023-12-20T04:43:38.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.216+0000 7f86fad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86fc15d2c0 0x7f86fc0b7260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:38.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.216+0000 7f86f9d9b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86fc0d30a0 0x7f86fc0cb570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:38.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.216+0000 7f86fa59c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86fc0d0060 0x7f86fc0cb030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:38.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.216+0000 7f86f9d9b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86fc0d30a0 0x7f86fc0cb570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:44660/0 (socket says 172.21.15.132:44660) 2023-12-20T04:43:38.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.216+0000 7f86f9d9b640 1 -- 172.21.15.132:0/2087595532 learned_addr learned my addr 172.21.15.132:0/2087595532 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:38.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.216+0000 7f86fad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86fc15d2c0 0x7f86fc0b7260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35306/0 (socket says 172.21.15.132:35306) 2023-12-20T04:43:38.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.217+0000 7f86fad9d640 1 -- 172.21.15.132:0/2087595532 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86fc0d0060 msgr2=0x7f86fc0cb030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:38.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.217+0000 7f86fad9d640 1 --2- 172.21.15.132:0/2087595532 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86fc0d0060 0x7f86fc0cb030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:38.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.217+0000 7f86fad9d640 1 -- 172.21.15.132:0/2087595532 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86fc0d30a0 msgr2=0x7f86fc0cb570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:38.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.217+0000 7f86fad9d640 1 --2- 172.21.15.132:0/2087595532 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86fc0d30a0 0x7f86fc0cb570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:38.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.217+0000 7f86fad9d640 1 -- 172.21.15.132:0/2087595532 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86f4009a70 con 0x7f86fc15d2c0 2023-12-20T04:43:38.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.217+0000 7f86f9d9b640 1 --2- 172.21.15.132:0/2087595532 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86fc0d30a0 0x7f86fc0cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:43:38.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.217+0000 7f86fad9d640 1 --2- 172.21.15.132:0/2087595532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86fc15d2c0 0x7f86fc0b7260 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f86f4033000 tx=0x7f86f4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:38.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.217+0000 7f86eaffd640 1 -- 172.21.15.132:0/2087595532 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f4040650 con 0x7f86fc15d2c0 2023-12-20T04:43:38.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.217+0000 7f86eaffd640 1 -- 172.21.15.132:0/2087595532 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86f40407b0 con 0x7f86fc15d2c0 2023-12-20T04:43:38.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.217+0000 7f86eaffd640 1 -- 172.21.15.132:0/2087595532 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f86f4040b60 con 0x7f86fc15d2c0 2023-12-20T04:43:38.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.217+0000 7f8700cd5640 1 -- 172.21.15.132:0/2087595532 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86fc0cbe80 con 0x7f86fc15d2c0 2023-12-20T04:43:38.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.217+0000 7f8700cd5640 1 -- 172.21.15.132:0/2087595532 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86fc0cc440 con 0x7f86fc15d2c0 2023-12-20T04:43:38.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.218+0000 7f8700cd5640 1 -- 172.21.15.132:0/2087595532 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86fc04e840 con 0x7f86fc15d2c0 2023-12-20T04:43:38.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.223+0000 7f86eaffd640 1 -- 172.21.15.132:0/2087595532 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f86f4040cc0 con 0x7f86fc15d2c0 2023-12-20T04:43:38.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.223+0000 7f86eaffd640 1 --2- 172.21.15.132:0/2087595532 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f86dc06a430 0x7f86dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:38.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.223+0000 7f86fa59c640 1 --2- 172.21.15.132:0/2087595532 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f86dc06a430 0x7f86dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:38.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.223+0000 7f86eaffd640 1 -- 172.21.15.132:0/2087595532 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f86f40ab5f0 con 0x7f86fc15d2c0 2023-12-20T04:43:38.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.224+0000 7f86fa59c640 1 --2- 172.21.15.132:0/2087595532 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f86dc06a430 0x7f86dc06c8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f86ec000f60 tx=0x7f86ec007d50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:38.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.226+0000 7f86eaffd640 1 -- 172.21.15.132:0/2087595532 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f86f4077090 con 0x7f86fc15d2c0 2023-12-20T04:43:38.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:38.403+0000 7f8700cd5640 1 -- 172.21.15.132:0/2087595532 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f86fc0d1180 con 0x7f86fc15d2c0 2023-12-20T04:43:39.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.221+0000 7f86eaffd640 1 -- 172.21.15.132:0/2087595532 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v29) v1 ==== 97+0+0 (secure 0 0 0) 0x7f86f4009450 con 0x7f86fc15d2c0 2023-12-20T04:43:39.223 INFO:teuthology.orchestra.run.smithi132.stderr: removed all blocklist entries 2023-12-20T04:43:39.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.224+0000 7f8700cd5640 1 -- 172.21.15.132:0/2087595532 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f86dc06a430 msgr2=0x7f86dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:39.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.224+0000 7f8700cd5640 1 --2- 172.21.15.132:0/2087595532 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f86dc06a430 0x7f86dc06c8f0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f86ec000f60 tx=0x7f86ec007d50 comp rx=0 tx=0).stop 2023-12-20T04:43:39.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.224+0000 7f8700cd5640 1 -- 172.21.15.132:0/2087595532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86fc15d2c0 msgr2=0x7f86fc0b7260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:39.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.224+0000 7f8700cd5640 1 --2- 172.21.15.132:0/2087595532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86fc15d2c0 0x7f86fc0b7260 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f86f4033000 tx=0x7f86f4004a40 comp rx=0 tx=0).stop 2023-12-20T04:43:39.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.224+0000 7f8700cd5640 1 -- 172.21.15.132:0/2087595532 shutdown_connections 2023-12-20T04:43:39.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.224+0000 7f8700cd5640 1 --2- 172.21.15.132:0/2087595532 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f86dc06a430 0x7f86dc06c8f0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.224+0000 7f8700cd5640 1 --2- 172.21.15.132:0/2087595532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86fc15d2c0 0x7f86fc0b7260 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.224+0000 7f8700cd5640 1 --2- 172.21.15.132:0/2087595532 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f86fc0d30a0 0x7f86fc0cb570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.224+0000 7f8700cd5640 1 --2- 172.21.15.132:0/2087595532 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86fc0d0060 0x7f86fc0cb030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.224+0000 7f8700cd5640 1 -- 172.21.15.132:0/2087595532 >> 172.21.15.132:0/2087595532 conn(0x7f86fc072e40 msgr2=0x7f86fc0b3ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:39.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.224+0000 7f8700cd5640 1 -- 172.21.15.132:0/2087595532 shutdown_connections 2023-12-20T04:43:39.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.224+0000 7f8700cd5640 1 -- 172.21.15.132:0/2087595532 wait complete. 2023-12-20T04:43:39.237 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-20T04:43:39.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.335+0000 7fbd95ed5640 1 Processor -- start 2023-12-20T04:43:39.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.336+0000 7fbd95ed5640 1 -- start start 2023-12-20T04:43:39.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.336+0000 7fbd95ed5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbd9015d100 0x7fbd900b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:39.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.336+0000 7fbd95ed5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd900d0370 0x7fbd900cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:39.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.336+0000 7fbd95ed5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd900b2f90 con 0x7fbd90161850 2023-12-20T04:43:39.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.336+0000 7fbd95ed5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd901613c0 con 0x7fbd9015d100 2023-12-20T04:43:39.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.336+0000 7fbd95ed5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd900d1b00 con 0x7fbd900d0370 2023-12-20T04:43:39.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.336+0000 7fbd8f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbd9015d100 0x7fbd900b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:39.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.337+0000 7fbd8ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbd90161850 0x7fbd9006c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52440/0 (socket says 172.21.15.132:52440) 2023-12-20T04:43:39.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.337+0000 7fbd8ffff640 1 -- 172.21.15.132:0/1867787487 learned_addr learned my addr 172.21.15.132:0/1867787487 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:39.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.337+0000 7fbd8f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbd9015d100 0x7fbd900b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35322/0 (socket says 172.21.15.132:35322) 2023-12-20T04:43:39.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.337+0000 7fbd8effd640 1 --2- 172.21.15.132:0/1867787487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd900d0370 0x7fbd900cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:39.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.337+0000 7fbd8f7fe640 1 -- 172.21.15.132:0/1867787487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd900d0370 msgr2=0x7fbd900cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:39.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.337+0000 7fbd8f7fe640 1 --2- 172.21.15.132:0/1867787487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd900d0370 0x7fbd900cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.337+0000 7fbd8f7fe640 1 -- 172.21.15.132:0/1867787487 >> v1:172.21.15.132:6789/0 conn(0x7fbd90161850 legacy=0x7fbd9006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:39.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.337+0000 7fbd8e7fc640 1 -- 172.21.15.132:0/1867787487 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2705671553 0 0) 0x7fbd88001490 con 0x7fbd90161850 2023-12-20T04:43:39.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.337+0000 7fbd8f7fe640 1 -- 172.21.15.132:0/1867787487 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd900d0810 con 0x7fbd9015d100 2023-12-20T04:43:39.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.338+0000 7fbd8f7fe640 1 --2- 172.21.15.132:0/1867787487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd9015d100 0x7fbd900b2a50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbd800097a0 tx=0x7fbd8002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d746e46f01664265 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:39.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.338+0000 7fbd8e7fc640 1 -- 172.21.15.132:0/1867787487 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8002e070 con 0x7fbd9015d100 2023-12-20T04:43:39.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.338+0000 7fbd8e7fc640 1 -- 172.21.15.132:0/1867787487 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd800315a0 con 0x7fbd9015d100 2023-12-20T04:43:39.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.338+0000 7fbd8e7fc640 1 -- 172.21.15.132:0/1867787487 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd80031930 con 0x7fbd9015d100 2023-12-20T04:43:39.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.338+0000 7fbd95ed5640 1 -- 172.21.15.132:0/1867787487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd9015d100 msgr2=0x7fbd900b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:39.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.338+0000 7fbd95ed5640 1 --2- 172.21.15.132:0/1867787487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd9015d100 0x7fbd900b2a50 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7fbd800097a0 tx=0x7fbd8002b840 comp rx=0 tx=0).stop 2023-12-20T04:43:39.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.338+0000 7fbd95ed5640 1 -- 172.21.15.132:0/1867787487 shutdown_connections 2023-12-20T04:43:39.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.338+0000 7fbd95ed5640 1 --2- 172.21.15.132:0/1867787487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd900d0370 0x7fbd900cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.338+0000 7fbd95ed5640 1 --2- 172.21.15.132:0/1867787487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd9015d100 0x7fbd900b2a50 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.338+0000 7fbd95ed5640 1 -- 172.21.15.132:0/1867787487 >> 172.21.15.132:0/1867787487 conn(0x7fbd9006d7c0 msgr2=0x7fbd9006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:39.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.338+0000 7fbd95ed5640 1 -- 172.21.15.132:0/1867787487 shutdown_connections 2023-12-20T04:43:39.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.338+0000 7fbd95ed5640 1 -- 172.21.15.132:0/1867787487 wait complete. 2023-12-20T04:43:39.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.339+0000 7fbd95ed5640 1 Processor -- start 2023-12-20T04:43:39.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.340+0000 7fbd95ed5640 1 -- start start 2023-12-20T04:43:39.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.340+0000 7fbd95ed5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd900d0370 0x7fbd90157240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:39.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.340+0000 7fbd95ed5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd9015d100 0x7fbd900c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:39.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.340+0000 7fbd95ed5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd90161850 0x7fbd9015a180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:39.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.340+0000 7fbd95ed5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd900c9a40 con 0x7fbd9015d100 2023-12-20T04:43:39.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.340+0000 7fbd95ed5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd900c9d20 con 0x7fbd90161850 2023-12-20T04:43:39.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.340+0000 7fbd95ed5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd900ca000 con 0x7fbd900d0370 2023-12-20T04:43:39.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.340+0000 7fbd8effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd9015d100 0x7fbd900c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:39.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.340+0000 7fbd8effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd9015d100 0x7fbd900c5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35328/0 (socket says 172.21.15.132:35328) 2023-12-20T04:43:39.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.340+0000 7fbd8effd640 1 -- 172.21.15.132:0/848848310 learned_addr learned my addr 172.21.15.132:0/848848310 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:39.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.341+0000 7fbd8f7fe640 1 --2- 172.21.15.132:0/848848310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd900d0370 0x7fbd90157240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:39.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.341+0000 7fbd8ffff640 1 --2- 172.21.15.132:0/848848310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd90161850 0x7fbd9015a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:39.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.341+0000 7fbd8effd640 1 -- 172.21.15.132:0/848848310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd900d0370 msgr2=0x7fbd90157240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:39.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.341+0000 7fbd8effd640 1 --2- 172.21.15.132:0/848848310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd900d0370 0x7fbd90157240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.341+0000 7fbd8effd640 1 -- 172.21.15.132:0/848848310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd90161850 msgr2=0x7fbd9015a180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:39.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.341+0000 7fbd8effd640 1 --2- 172.21.15.132:0/848848310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd90161850 0x7fbd9015a180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.341+0000 7fbd8effd640 1 -- 172.21.15.132:0/848848310 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd80009400 con 0x7fbd9015d100 2023-12-20T04:43:39.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.341+0000 7fbd8effd640 1 --2- 172.21.15.132:0/848848310 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd9015d100 0x7fbd900c5c70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400d800 tx=0x7fbd8400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:39.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.341+0000 7fbd77fff640 1 -- 172.21.15.132:0/848848310 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8400b6c0 con 0x7fbd9015d100 2023-12-20T04:43:39.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.341+0000 7fbd77fff640 1 -- 172.21.15.132:0/848848310 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd8400b820 con 0x7fbd9015d100 2023-12-20T04:43:39.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.341+0000 7fbd77fff640 1 -- 172.21.15.132:0/848848310 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd8400bbb0 con 0x7fbd9015d100 2023-12-20T04:43:39.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.341+0000 7fbd95ed5640 1 -- 172.21.15.132:0/848848310 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd900ca2e0 con 0x7fbd9015d100 2023-12-20T04:43:39.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.341+0000 7fbd95ed5640 1 -- 172.21.15.132:0/848848310 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd90157780 con 0x7fbd9015d100 2023-12-20T04:43:39.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.342+0000 7fbd95ed5640 1 -- 172.21.15.132:0/848848310 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd900c7810 con 0x7fbd9015d100 2023-12-20T04:43:39.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.342+0000 7fbd77fff640 1 -- 172.21.15.132:0/848848310 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbd8400bd10 con 0x7fbd9015d100 2023-12-20T04:43:39.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.343+0000 7fbd77fff640 1 --2- 172.21.15.132:0/848848310 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd7c06a430 0x7fbd7c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:39.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.343+0000 7fbd77fff640 1 -- 172.21.15.132:0/848848310 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fbd84088a80 con 0x7fbd9015d100 2023-12-20T04:43:39.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.343+0000 7fbd8f7fe640 1 --2- 172.21.15.132:0/848848310 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd7c06a430 0x7fbd7c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:39.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.343+0000 7fbd8f7fe640 1 --2- 172.21.15.132:0/848848310 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd7c06a430 0x7fbd7c06c8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbd80036000 tx=0x7fbd8003d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:39.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.347+0000 7fbd77fff640 1 -- 172.21.15.132:0/848848310 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbd84054450 con 0x7fbd9015d100 2023-12-20T04:43:39.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.573+0000 7fbd95ed5640 1 -- 172.21.15.132:0/848848310 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fbd900b4920 con 0x7fbd9015d100 2023-12-20T04:43:39.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.573+0000 7fbd77fff640 1 -- 172.21.15.132:0/848848310 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v6) v1 ==== 80+0+6645 (secure 0 0 0) 0x7fbd84057a70 con 0x7fbd9015d100 2023-12-20T04:43:39.575 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:39.575 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:43:39.575 INFO:teuthology.orchestra.run.smithi132.stdout: "auth_dump": [ 2023-12-20T04:43:39.576 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.576 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.a", 2023-12-20T04:43:39.576 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlbTdZOxAAUDz0Eno9DYvrYM1xg5jG/A==", 2023-12-20T04:43:39.576 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.576 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:43:39.576 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:43:39.576 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:43:39.576 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:43:39.576 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.576 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.577 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.577 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.b", 2023-12-20T04:43:39.577 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl43gVDBAA1qJwUU+Ii4BalGf3NtJnGA==", 2023-12-20T04:43:39.577 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.577 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:43:39.577 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:43:39.577 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:43:39.577 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:43:39.577 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.577 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.577 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.577 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.c", 2023-12-20T04:43:39.577 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlaSUVBxAA7HN3dSo9xfvkjvc6bwMxWg==", 2023-12-20T04:43:39.578 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.578 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:43:39.578 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:43:39.578 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:43:39.578 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:43:39.578 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.578 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.578 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.578 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.d", 2023-12-20T04:43:39.578 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl1DR4ExAANNOyGlf1Ayre/xZEb9JHYg==", 2023-12-20T04:43:39.578 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.578 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:43:39.578 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:43:39.578 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:43:39.578 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:43:39.579 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.579 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.579 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.0", 2023-12-20T04:43:39.579 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCucIJlwZfxORAAiT2g1poLu3OkmoyxNJQc8Q==", 2023-12-20T04:43:39.579 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.579 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:43:39.579 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:43:39.579 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:43:39.579 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.579 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.579 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.1", 2023-12-20T04:43:39.579 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlejHYBRAAKurKpW5gyOAQ+E4Su4xMSQ==", 2023-12-20T04:43:39.580 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.580 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:43:39.580 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:43:39.580 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:43:39.580 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.580 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.580 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.580 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.2", 2023-12-20T04:43:39.580 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlyfz8DBAA9a6tUjHF8IRIKeldwVFMcw==", 2023-12-20T04:43:39.580 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.580 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:43:39.580 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:43:39.580 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:43:39.580 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.581 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.581 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.3", 2023-12-20T04:43:39.581 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJllFEeFBAA6URrqUjQqHsrI5+qEBVs3g==", 2023-12-20T04:43:39.581 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.581 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:43:39.581 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:43:39.581 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:43:39.581 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.581 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.581 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.4", 2023-12-20T04:43:39.581 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlvGqcJhAAgn2wuSTwLT+TOHoE4iaVSg==", 2023-12-20T04:43:39.581 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.581 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:43:39.582 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:43:39.582 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:43:39.582 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.582 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.582 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.5", 2023-12-20T04:43:39.582 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlWrkTLhAA2KlpxTFPaiXLCvmURpg5rw==", 2023-12-20T04:43:39.582 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.582 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:43:39.582 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:43:39.582 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:43:39.582 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.582 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.582 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.6", 2023-12-20T04:43:39.583 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlnOQfNRAA//EVx0BZYQd7ovK2tFhgfA==", 2023-12-20T04:43:39.583 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.583 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:43:39.583 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:43:39.583 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:43:39.583 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.583 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.583 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.583 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.7", 2023-12-20T04:43:39.583 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCzcIJl4nfDABAAtBdl2qkzKcqhmzsukC7G5w==", 2023-12-20T04:43:39.583 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.583 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:43:39.583 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:43:39.583 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:43:39.583 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.584 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.0", 2023-12-20T04:43:39.584 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlm/nGFxAA6zndayizc50Il7l74BxkgQ==", 2023-12-20T04:43:39.584 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.584 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:43:39.584 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:43:39.584 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:43:39.584 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:43:39.584 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.584 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.1", 2023-12-20T04:43:39.584 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlppb6IBAArqCoSlSE5coxkj4+XjPoWg==", 2023-12-20T04:43:39.584 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.584 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:43:39.585 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:43:39.585 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:43:39.585 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:43:39.585 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.585 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.585 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.585 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.2", 2023-12-20T04:43:39.585 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlMgWUHRAAqSdmRGx+9J+3dO7ntaApdw==", 2023-12-20T04:43:39.585 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.585 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:43:39.585 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:43:39.585 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:43:39.585 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:43:39.585 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.586 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.3", 2023-12-20T04:43:39.586 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlcIe3JhAAjv9KfknxwySJURWdePN7vw==", 2023-12-20T04:43:39.586 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.586 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:43:39.586 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:43:39.586 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:43:39.586 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:43:39.586 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.586 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.admin", 2023-12-20T04:43:39.586 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJljrTdHhAAsAlaFaKctSv71GrifKs6zA==", 2023-12-20T04:43:39.586 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.586 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:43:39.587 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:43:39.587 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:43:39.587 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:43:39.587 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.587 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-mds", 2023-12-20T04:43:39.587 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQC2cIJlxHJPAxAAON8BVY/Xoz788xpCMfLd5A==", 2023-12-20T04:43:39.587 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.587 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-mds" 2023-12-20T04:43:39.587 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.587 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-mgr", 2023-12-20T04:43:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQC2cIJl0ntPAxAADe61IeTvb9Dn7Tu8n09QZA==", 2023-12-20T04:43:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-mgr" 2023-12-20T04:43:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-osd", 2023-12-20T04:43:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQC2cIJlQYJPAxAA4ZYPeZNiKcv8a5J44TQFtA==", 2023-12-20T04:43:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-osd" 2023-12-20T04:43:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-rbd", 2023-12-20T04:43:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQC2cIJlrIhPAxAA52b3soEZeKy2mG8Rf92PbA==", 2023-12-20T04:43:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-rbd" 2023-12-20T04:43:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-rbd-mirror", 2023-12-20T04:43:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQC2cIJl+Y5PAxAAx83bKrsELIob2r0U16m1nA==", 2023-12-20T04:43:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-rbd-mirror" 2023-12-20T04:43:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.bootstrap-rgw", 2023-12-20T04:43:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQC2cIJlXJVPAxAAVoy5iwTzpLtTs2o/SlooFQ==", 2023-12-20T04:43:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile bootstrap-rgw" 2023-12-20T04:43:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.x", 2023-12-20T04:43:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJl+KnxNxAAM/b3mubTMYlB9QUbfcPW8g==", 2023-12-20T04:43:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:43:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:43:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:43:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.y", 2023-12-20T04:43:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlMyAMNBAAWpoBNevgGIkZ7zKEdKn3Ag==", 2023-12-20T04:43:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:43:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:43:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:43:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:43:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:43:39.591 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:43:39.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.575+0000 7fbd95ed5640 1 -- 172.21.15.132:0/848848310 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd7c06a430 msgr2=0x7fbd7c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:39.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.575+0000 7fbd95ed5640 1 --2- 172.21.15.132:0/848848310 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd7c06a430 0x7fbd7c06c8f0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fbd80036000 tx=0x7fbd8003d040 comp rx=0 tx=0).stop 2023-12-20T04:43:39.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.575+0000 7fbd95ed5640 1 -- 172.21.15.132:0/848848310 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd9015d100 msgr2=0x7fbd900c5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:39.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.575+0000 7fbd95ed5640 1 --2- 172.21.15.132:0/848848310 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd9015d100 0x7fbd900c5c70 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7fbd8400d800 tx=0x7fbd8400dcc0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.575+0000 7fbd95ed5640 1 -- 172.21.15.132:0/848848310 shutdown_connections 2023-12-20T04:43:39.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.575+0000 7fbd95ed5640 1 --2- 172.21.15.132:0/848848310 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd7c06a430 0x7fbd7c06c8f0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.575+0000 7fbd95ed5640 1 --2- 172.21.15.132:0/848848310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd90161850 0x7fbd9015a180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.575+0000 7fbd95ed5640 1 --2- 172.21.15.132:0/848848310 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd9015d100 0x7fbd900c5c70 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.575+0000 7fbd95ed5640 1 --2- 172.21.15.132:0/848848310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd900d0370 0x7fbd90157240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.575+0000 7fbd95ed5640 1 -- 172.21.15.132:0/848848310 >> 172.21.15.132:0/848848310 conn(0x7fbd9006d7c0 msgr2=0x7fbd9006b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:39.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.575+0000 7fbd95ed5640 1 -- 172.21.15.132:0/848848310 shutdown_connections 2023-12-20T04:43:39.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.575+0000 7fbd95ed5640 1 -- 172.21.15.132:0/848848310 wait complete. 2023-12-20T04:43:39.594 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mds 2023-12-20T04:43:39.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.693+0000 7f1da4d22640 1 Processor -- start 2023-12-20T04:43:39.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.693+0000 7f1da4d22640 1 -- start start 2023-12-20T04:43:39.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.694+0000 7f1da4d22640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1da0160450 0x7f1da0160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:39.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.694+0000 7f1da4d22640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1da00b5090 0x7f1da00d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:39.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.694+0000 7f1da4d22640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1da00b5ec0 con 0x7f1da01611b0 2023-12-20T04:43:39.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.694+0000 7f1da4d22640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1da01617e0 con 0x7f1da0160450 2023-12-20T04:43:39.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.694+0000 7f1da4d22640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da00d0fc0 con 0x7f1da00b5090 2023-12-20T04:43:39.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.694+0000 7f1d9e59c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1da0160450 0x7f1da0160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:39.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.694+0000 7f1d9ed9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1da00b5090 0x7f1da00d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:39.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.694+0000 7f1d9e59c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1da0160450 0x7f1da0160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:44680/0 (socket says 172.21.15.132:44680) 2023-12-20T04:43:39.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.694+0000 7f1d9e59c640 1 -- 172.21.15.132:0/2582603092 learned_addr learned my addr 172.21.15.132:0/2582603092 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:39.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.694+0000 7f1d9e59c640 1 -- 172.21.15.132:0/2582603092 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1da00b5090 msgr2=0x7f1da00d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:39.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.694+0000 7f1d9e59c640 1 --2- 172.21.15.132:0/2582603092 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1da00b5090 0x7f1da00d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.694+0000 7f1d9e59c640 1 -- 172.21.15.132:0/2582603092 >> v1:172.21.15.187:6789/0 conn(0x7f1da01611b0 legacy=0x7f1da00b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:39.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.694+0000 7f1d9e59c640 1 -- 172.21.15.132:0/2582603092 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1da00d12a0 con 0x7f1da0160450 2023-12-20T04:43:39.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.695+0000 7f1d9e59c640 1 --2- 172.21.15.132:0/2582603092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1da0160450 0x7f1da0160c70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009870 tx=0x7f1d9002b860 comp rx=0 tx=0).ready entity=mon.1 client_cookie=53f2d48606f35d71 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:39.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.695+0000 7f1d9dd9b640 1 -- 172.21.15.132:0/2582603092 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90031740 con 0x7f1da0160450 2023-12-20T04:43:39.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.695+0000 7f1d9dd9b640 1 -- 172.21.15.132:0/2582603092 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d900318a0 con 0x7f1da0160450 2023-12-20T04:43:39.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.695+0000 7f1d9dd9b640 1 -- 172.21.15.132:0/2582603092 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90031c30 con 0x7f1da0160450 2023-12-20T04:43:39.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.696+0000 7f1da4d22640 1 -- 172.21.15.132:0/2582603092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1da0160450 msgr2=0x7f1da0160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:39.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.696+0000 7f1da4d22640 1 --2- 172.21.15.132:0/2582603092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1da0160450 0x7f1da0160c70 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1d90009870 tx=0x7f1d9002b860 comp rx=0 tx=0).stop 2023-12-20T04:43:39.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.696+0000 7f1da4d22640 1 -- 172.21.15.132:0/2582603092 shutdown_connections 2023-12-20T04:43:39.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.696+0000 7f1da4d22640 1 --2- 172.21.15.132:0/2582603092 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1da00b5090 0x7f1da00d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.696+0000 7f1da4d22640 1 --2- 172.21.15.132:0/2582603092 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1da0160450 0x7f1da0160c70 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.696+0000 7f1da4d22640 1 -- 172.21.15.132:0/2582603092 >> 172.21.15.132:0/2582603092 conn(0x7f1da00cf980 msgr2=0x7f1da00cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:39.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.696+0000 7f1da4d22640 1 -- 172.21.15.132:0/2582603092 shutdown_connections 2023-12-20T04:43:39.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.696+0000 7f1da4d22640 1 -- 172.21.15.132:0/2582603092 wait complete. 2023-12-20T04:43:39.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.697+0000 7f1da4d22640 1 Processor -- start 2023-12-20T04:43:39.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.697+0000 7f1da4d22640 1 -- start start 2023-12-20T04:43:39.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.698+0000 7f1da4d22640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1da00b5090 0x7f1da015b530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:39.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.698+0000 7f1da4d22640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da0160450 0x7f1da015ba70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:39.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.698+0000 7f1da4d22640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1da01611b0 0x7f1da01f4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:39.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.698+0000 7f1da4d22640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da0153090 con 0x7f1da0160450 2023-12-20T04:43:39.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.698+0000 7f1da4d22640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1da015a6e0 con 0x7f1da00b5090 2023-12-20T04:43:39.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.698+0000 7f1da4d22640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1da0159830 con 0x7f1da01611b0 2023-12-20T04:43:39.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.698+0000 7f1d97fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da0160450 0x7f1da015ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:39.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.698+0000 7f1d97fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da0160450 0x7f1da015ba70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35338/0 (socket says 172.21.15.132:35338) 2023-12-20T04:43:39.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.698+0000 7f1d97fff640 1 -- 172.21.15.132:0/1882260449 learned_addr learned my addr 172.21.15.132:0/1882260449 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:39.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.698+0000 7f1d9e59c640 1 --2- 172.21.15.132:0/1882260449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1da00b5090 0x7f1da015b530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:39.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.698+0000 7f1d9ed9d640 1 --2- 172.21.15.132:0/1882260449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1da01611b0 0x7f1da01f4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:39.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.698+0000 7f1d9e59c640 1 -- 172.21.15.132:0/1882260449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1da01611b0 msgr2=0x7f1da01f4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:39.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.698+0000 7f1d9e59c640 1 --2- 172.21.15.132:0/1882260449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1da01611b0 0x7f1da01f4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.698+0000 7f1d9e59c640 1 -- 172.21.15.132:0/1882260449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da0160450 msgr2=0x7f1da015ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:39.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.699+0000 7f1d9e59c640 1 --2- 172.21.15.132:0/1882260449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da0160450 0x7f1da015ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.699+0000 7f1d9e59c640 1 -- 172.21.15.132:0/1882260449 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d900094d0 con 0x7f1da00b5090 2023-12-20T04:43:39.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.699+0000 7f1d97fff640 1 --2- 172.21.15.132:0/1882260449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da0160450 0x7f1da015ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:43:39.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.699+0000 7f1d9e59c640 1 --2- 172.21.15.132:0/1882260449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1da00b5090 0x7f1da015b530 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1d90033000 tx=0x7f1d900046c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:39.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.699+0000 7f1d96ffd640 1 -- 172.21.15.132:0/1882260449 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d90033a00 con 0x7f1da00b5090 2023-12-20T04:43:39.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.699+0000 7f1d96ffd640 1 -- 172.21.15.132:0/1882260449 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d90033b80 con 0x7f1da00b5090 2023-12-20T04:43:39.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.699+0000 7f1da4d22640 1 -- 172.21.15.132:0/1882260449 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1da0159ad0 con 0x7f1da00b5090 2023-12-20T04:43:39.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.699+0000 7f1d96ffd640 1 -- 172.21.15.132:0/1882260449 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d9003c400 con 0x7f1da00b5090 2023-12-20T04:43:39.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.699+0000 7f1da4d22640 1 -- 172.21.15.132:0/1882260449 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1da015a090 con 0x7f1da00b5090 2023-12-20T04:43:39.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.700+0000 7f1da4d22640 1 -- 172.21.15.132:0/1882260449 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1da004e840 con 0x7f1da00b5090 2023-12-20T04:43:39.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.700+0000 7f1d96ffd640 1 -- 172.21.15.132:0/1882260449 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1d9003a040 con 0x7f1da00b5090 2023-12-20T04:43:39.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.701+0000 7f1d96ffd640 1 --2- 172.21.15.132:0/1882260449 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d8006a430 0x7f1d8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:39.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.701+0000 7f1d96ffd640 1 -- 172.21.15.132:0/1882260449 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1d900aa440 con 0x7f1da00b5090 2023-12-20T04:43:39.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.701+0000 7f1d97fff640 1 --2- 172.21.15.132:0/1882260449 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d8006a430 0x7f1d8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:39.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.701+0000 7f1d97fff640 1 --2- 172.21.15.132:0/1882260449 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d8006a430 0x7f1d8006c8f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1da015ab70 tx=0x7f1d88009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:39.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.705+0000 7f1d96ffd640 1 -- 172.21.15.132:0/1882260449 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1d90075e20 con 0x7f1da00b5090 2023-12-20T04:43:39.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.940+0000 7f1da4d22640 1 -- 172.21.15.132:0/1882260449 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mds"} v 0) v1 -- 0x7f1da00d0ad0 con 0x7f1da00b5090 2023-12-20T04:43:39.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.944+0000 7f1d96ffd640 1 -- 172.21.15.132:0/1882260449 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mds"}]=0 v7) v1 ==== 90+0+0 (secure 0 0 0) 0x7f1d9004d0a0 con 0x7f1da00b5090 2023-12-20T04:43:39.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.946+0000 7f1da4d22640 1 -- 172.21.15.132:0/1882260449 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d8006a430 msgr2=0x7f1d8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:39.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.946+0000 7f1da4d22640 1 --2- 172.21.15.132:0/1882260449 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d8006a430 0x7f1d8006c8f0 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1da015ab70 tx=0x7f1d88009040 comp rx=0 tx=0).stop 2023-12-20T04:43:39.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.946+0000 7f1da4d22640 1 -- 172.21.15.132:0/1882260449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1da00b5090 msgr2=0x7f1da015b530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:39.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.946+0000 7f1da4d22640 1 --2- 172.21.15.132:0/1882260449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1da00b5090 0x7f1da015b530 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f1d90033000 tx=0x7f1d900046c0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.946+0000 7f1da4d22640 1 -- 172.21.15.132:0/1882260449 shutdown_connections 2023-12-20T04:43:39.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.946+0000 7f1da4d22640 1 --2- 172.21.15.132:0/1882260449 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d8006a430 0x7f1d8006c8f0 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.946+0000 7f1da4d22640 1 --2- 172.21.15.132:0/1882260449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1da01611b0 0x7f1da01f4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.946+0000 7f1da4d22640 1 --2- 172.21.15.132:0/1882260449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1da0160450 0x7f1da015ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.946+0000 7f1da4d22640 1 --2- 172.21.15.132:0/1882260449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1da00b5090 0x7f1da015b530 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:39.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.946+0000 7f1da4d22640 1 -- 172.21.15.132:0/1882260449 >> 172.21.15.132:0/1882260449 conn(0x7f1da00cf980 msgr2=0x7f1da00b72b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:39.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.946+0000 7f1da4d22640 1 -- 172.21.15.132:0/1882260449 shutdown_connections 2023-12-20T04:43:39.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:39.946+0000 7f1da4d22640 1 -- 172.21.15.132:0/1882260449 wait complete. 2023-12-20T04:43:39.959 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-mgr 2023-12-20T04:43:40.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.059+0000 7f88561cb640 1 Processor -- start 2023-12-20T04:43:40.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.060+0000 7f88561cb640 1 -- start start 2023-12-20T04:43:40.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.060+0000 7f88561cb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88500b4de0 0x7f88500d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.060+0000 7f88561cb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88500b5ec0 con 0x7f88500b4980 2023-12-20T04:43:40.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.060+0000 7f88561cb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88501617e0 con 0x7f8850160450 2023-12-20T04:43:40.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.060+0000 7f88561cb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88500d0fc0 con 0x7f88500b4de0 2023-12-20T04:43:40.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.060+0000 7f884effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f88500b4980 0x7f88500d1aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52446/0 (socket says 172.21.15.132:52446) 2023-12-20T04:43:40.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.060+0000 7f884effd640 1 -- 172.21.15.132:0/1391052727 learned_addr learned my addr 172.21.15.132:0/1391052727 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:40.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884e7fc640 1 -- 172.21.15.132:0/1391052727 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4021312356 0 0) 0x7f88500b5ec0 con 0x7f88500b4980 2023-12-20T04:43:40.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884e7fc640 1 -- 172.21.15.132:0/1391052727 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8838003520 con 0x7f88500b4980 2023-12-20T04:43:40.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884ffff640 1 --2- 172.21.15.132:0/1391052727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88500b4de0 0x7f88500d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884e7fc640 1 -- 172.21.15.132:0/1391052727 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2381926383 0 0) 0x7f8838003520 con 0x7f88500b4980 2023-12-20T04:43:40.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884e7fc640 1 -- 172.21.15.132:0/1391052727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88500b4de0 msgr2=0x7f88500d21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:40.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884e7fc640 1 --2- 172.21.15.132:0/1391052727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88500b4de0 0x7f88500d21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884e7fc640 1 -- 172.21.15.132:0/1391052727 >> v1:172.21.15.187:6789/0 conn(0x7f8850160450 legacy=0x7f8850160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:40.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884e7fc640 1 -- 172.21.15.132:0/1391052727 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88500d12a0 con 0x7f88500b4980 2023-12-20T04:43:40.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884e7fc640 1 -- 172.21.15.132:0/1391052727 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f8844001690 con 0x7f88500b4980 2023-12-20T04:43:40.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884e7fc640 1 -- 172.21.15.132:0/1391052727 >> v1:172.21.15.132:6789/0 conn(0x7f88500b4980 legacy=0x7f88500d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:40.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884e7fc640 1 --2- 172.21.15.132:0/1391052727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88380039a0 0x7f8838003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884e7fc640 1 --2- 172.21.15.132:0/1391052727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88500b4de0 0x7f88380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884e7fc640 1 --2- 172.21.15.132:0/1391052727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8838004d00 0x7f8838005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884e7fc640 1 -- 172.21.15.132:0/1391052727 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88500d0fc0 con 0x7f8838004d00 2023-12-20T04:43:40.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884e7fc640 1 -- 172.21.15.132:0/1391052727 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f883800baf0 con 0x7f88380039a0 2023-12-20T04:43:40.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884e7fc640 1 -- 172.21.15.132:0/1391052727 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f883800bcb0 con 0x7f88500b4de0 2023-12-20T04:43:40.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884ffff640 1 --2- 172.21.15.132:0/1391052727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8838004d00 0x7f8838005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884effd640 1 --2- 172.21.15.132:0/1391052727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88500b4de0 0x7f88380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884f7fe640 1 --2- 172.21.15.132:0/1391052727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88380039a0 0x7f8838003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884ffff640 1 -- 172.21.15.132:0/1391052727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88500b4de0 msgr2=0x7f88380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:40.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.061+0000 7f884ffff640 1 --2- 172.21.15.132:0/1391052727 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88500b4de0 0x7f88380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.062+0000 7f884ffff640 1 -- 172.21.15.132:0/1391052727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88380039a0 msgr2=0x7f8838003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:40.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.062+0000 7f884ffff640 1 --2- 172.21.15.132:0/1391052727 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88380039a0 0x7f8838003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.062+0000 7f884ffff640 1 -- 172.21.15.132:0/1391052727 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8838003520 con 0x7f8838004d00 2023-12-20T04:43:40.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.062+0000 7f884ffff640 1 --2- 172.21.15.132:0/1391052727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8838004d00 0x7f8838005180 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8848009f90 tx=0x7f88380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=52b438832104ba4c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:40.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.062+0000 7f884e7fc640 1 -- 172.21.15.132:0/1391052727 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884802cbd0 con 0x7f8838004d00 2023-12-20T04:43:40.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.062+0000 7f884e7fc640 1 -- 172.21.15.132:0/1391052727 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f884800f040 con 0x7f8838004d00 2023-12-20T04:43:40.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.062+0000 7f884e7fc640 1 -- 172.21.15.132:0/1391052727 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8848034440 con 0x7f8838004d00 2023-12-20T04:43:40.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.063+0000 7f88561cb640 1 -- 172.21.15.132:0/1391052727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8838004d00 msgr2=0x7f8838005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:40.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.063+0000 7f88561cb640 1 --2- 172.21.15.132:0/1391052727 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8838004d00 0x7f8838005180 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f8848009f90 tx=0x7f88380057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.063+0000 7f884ffff640 1 -- 172.21.15.132:0/1391052727 reap_dead start 2023-12-20T04:43:40.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.063+0000 7f88561cb640 1 -- 172.21.15.132:0/1391052727 shutdown_connections 2023-12-20T04:43:40.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.063+0000 7f88561cb640 1 -- 172.21.15.132:0/1391052727 >> 172.21.15.132:0/1391052727 conn(0x7f88500cf980 msgr2=0x7f88500cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:40.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.063+0000 7f88561cb640 1 -- 172.21.15.132:0/1391052727 shutdown_connections 2023-12-20T04:43:40.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.063+0000 7f88561cb640 1 -- 172.21.15.132:0/1391052727 wait complete. 2023-12-20T04:43:40.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.064+0000 7f88561cb640 1 Processor -- start 2023-12-20T04:43:40.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.064+0000 7f88561cb640 1 -- start start 2023-12-20T04:43:40.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f88561cb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8838004d00 0x7f8850155000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f88561cb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8850157cb0 0x7f8850152b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f88561cb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f885006a1a0 0x7f885006a620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f88561cb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8850155fa0 con 0x7f8838004d00 2023-12-20T04:43:40.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f88561cb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f885006ab60 con 0x7f8850157cb0 2023-12-20T04:43:40.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f88561cb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88501f2c70 con 0x7f885006a1a0 2023-12-20T04:43:40.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f884f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8838004d00 0x7f8850155000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f884f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8838004d00 0x7f8850155000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35358/0 (socket says 172.21.15.132:35358) 2023-12-20T04:43:40.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f884f7fe640 1 -- 172.21.15.132:0/1376611686 learned_addr learned my addr 172.21.15.132:0/1376611686 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:40.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f884ffff640 1 --2- 172.21.15.132:0/1376611686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f885006a1a0 0x7f885006a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f884f7fe640 1 -- 172.21.15.132:0/1376611686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f885006a1a0 msgr2=0x7f885006a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:40.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f884effd640 1 --2- 172.21.15.132:0/1376611686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8850157cb0 0x7f8850152b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f884f7fe640 1 --2- 172.21.15.132:0/1376611686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f885006a1a0 0x7f885006a620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f884f7fe640 1 -- 172.21.15.132:0/1376611686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8850157cb0 msgr2=0x7f8850152b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:40.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f884f7fe640 1 --2- 172.21.15.132:0/1376611686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8850157cb0 0x7f8850152b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f884f7fe640 1 -- 172.21.15.132:0/1376611686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88501f2f50 con 0x7f8838004d00 2023-12-20T04:43:40.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f884ffff640 1 --2- 172.21.15.132:0/1376611686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f885006a1a0 0x7f885006a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:40.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f884effd640 1 --2- 172.21.15.132:0/1376611686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8850157cb0 0x7f8850152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:40.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.065+0000 7f884f7fe640 1 --2- 172.21.15.132:0/1376611686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8838004d00 0x7f8850155000 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f884000f820 tx=0x7f884000fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:40.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.066+0000 7f8837fff640 1 -- 172.21.15.132:0/1376611686 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88400050d0 con 0x7f8838004d00 2023-12-20T04:43:40.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.066+0000 7f8837fff640 1 -- 172.21.15.132:0/1376611686 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8840005230 con 0x7f8838004d00 2023-12-20T04:43:40.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.066+0000 7f8837fff640 1 -- 172.21.15.132:0/1376611686 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f884000d730 con 0x7f8838004d00 2023-12-20T04:43:40.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.066+0000 7f88561cb640 1 -- 172.21.15.132:0/1376611686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88501f3230 con 0x7f8838004d00 2023-12-20T04:43:40.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.066+0000 7f88561cb640 1 -- 172.21.15.132:0/1376611686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8850155540 con 0x7f8838004d00 2023-12-20T04:43:40.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.067+0000 7f88561cb640 1 -- 172.21.15.132:0/1376611686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f885004e840 con 0x7f8838004d00 2023-12-20T04:43:40.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.067+0000 7f8837fff640 1 -- 172.21.15.132:0/1376611686 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f884000d890 con 0x7f8838004d00 2023-12-20T04:43:40.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.067+0000 7f8837fff640 1 --2- 172.21.15.132:0/1376611686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f883c06a460 0x7f883c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.068+0000 7f8837fff640 1 -- 172.21.15.132:0/1376611686 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8840088440 con 0x7f8838004d00 2023-12-20T04:43:40.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.068+0000 7f884effd640 1 --2- 172.21.15.132:0/1376611686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f883c06a460 0x7f883c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.068+0000 7f884effd640 1 --2- 172.21.15.132:0/1376611686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f883c06a460 0x7f883c06c920 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8850154e90 tx=0x7f8844009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:40.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.072+0000 7f8837fff640 1 -- 172.21.15.132:0/1376611686 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8840053e10 con 0x7f8838004d00 2023-12-20T04:43:40.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.302+0000 7f88561cb640 1 -- 172.21.15.132:0/1376611686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-mgr"} v 0) v1 -- 0x7f88501f5e60 con 0x7f8838004d00 2023-12-20T04:43:40.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.305+0000 7f8837fff640 1 -- 172.21.15.132:0/1376611686 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-mgr"}]=0 v8) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8840057430 con 0x7f8838004d00 2023-12-20T04:43:40.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.307+0000 7f88561cb640 1 -- 172.21.15.132:0/1376611686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f883c06a460 msgr2=0x7f883c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:40.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.307+0000 7f88561cb640 1 --2- 172.21.15.132:0/1376611686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f883c06a460 0x7f883c06c920 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8850154e90 tx=0x7f8844009040 comp rx=0 tx=0).stop 2023-12-20T04:43:40.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.307+0000 7f88561cb640 1 -- 172.21.15.132:0/1376611686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8838004d00 msgr2=0x7f8850155000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:40.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.307+0000 7f88561cb640 1 --2- 172.21.15.132:0/1376611686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8838004d00 0x7f8850155000 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f884000f820 tx=0x7f884000fce0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.308+0000 7f88561cb640 1 -- 172.21.15.132:0/1376611686 shutdown_connections 2023-12-20T04:43:40.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.308+0000 7f88561cb640 1 --2- 172.21.15.132:0/1376611686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f883c06a460 0x7f883c06c920 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.308+0000 7f88561cb640 1 --2- 172.21.15.132:0/1376611686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f885006a1a0 0x7f885006a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.308+0000 7f88561cb640 1 --2- 172.21.15.132:0/1376611686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8850157cb0 0x7f8850152b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.308+0000 7f88561cb640 1 --2- 172.21.15.132:0/1376611686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8838004d00 0x7f8850155000 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.308+0000 7f88561cb640 1 -- 172.21.15.132:0/1376611686 >> 172.21.15.132:0/1376611686 conn(0x7f88500cf980 msgr2=0x7f88500b6050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:40.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.308+0000 7f88561cb640 1 -- 172.21.15.132:0/1376611686 shutdown_connections 2023-12-20T04:43:40.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.308+0000 7f88561cb640 1 -- 172.21.15.132:0/1376611686 wait complete. 2023-12-20T04:43:40.321 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-osd 2023-12-20T04:43:40.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.419+0000 7f81afb9f640 1 Processor -- start 2023-12-20T04:43:40.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.419+0000 7f81afb9f640 1 -- start start 2023-12-20T04:43:40.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.420+0000 7f81afb9f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f81a815e2d0 0x7f81a80b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.420+0000 7f81afb9f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f81a80cb420 0x7f81a80ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.420+0000 7f81afb9f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f81a80ceee0 0x7f81a815ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.420+0000 7f81afb9f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a80cd740 con 0x7f81a80cb420 2023-12-20T04:43:40.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.420+0000 7f81afb9f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f81a80ce230 con 0x7f81a80ceee0 2023-12-20T04:43:40.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.420+0000 7f81afb9f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80cf310 con 0x7f81a815e2d0 2023-12-20T04:43:40.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.420+0000 7f81ad13a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f81a80cb420 0x7f81a80ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.420+0000 7f81ad13a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f81a80cb420 0x7f81a80ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35364/0 (socket says 172.21.15.132:35364) 2023-12-20T04:43:40.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.420+0000 7f81ad13a640 1 -- 172.21.15.132:0/1922953562 learned_addr learned my addr 172.21.15.132:0/1922953562 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:40.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.420+0000 7f81ad13a640 1 -- 172.21.15.132:0/1922953562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f81a815e2d0 msgr2=0x7f81a80b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:40.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.420+0000 7f81ad93b640 1 --2- 172.21.15.132:0/1922953562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f81a815e2d0 0x7f81a80b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.420+0000 7f81ad13a640 1 --2- 172.21.15.132:0/1922953562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f81a815e2d0 0x7f81a80b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.420+0000 7f81ae13c640 1 --2- 172.21.15.132:0/1922953562 >> v2:172.21.15.187:3300/0 conn(0x7f81a80ceee0 0x7f81a815ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.420+0000 7f81ad13a640 1 -- 172.21.15.132:0/1922953562 >> v2:172.21.15.187:3300/0 conn(0x7f81a80ceee0 msgr2=0x7f81a815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:40.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.421+0000 7f81ad13a640 1 --2- 172.21.15.132:0/1922953562 >> v2:172.21.15.187:3300/0 conn(0x7f81a80ceee0 0x7f81a815ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.421+0000 7f81ad13a640 1 -- 172.21.15.132:0/1922953562 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81a80cd990 con 0x7f81a80cb420 2023-12-20T04:43:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.421+0000 7f81ae13c640 1 --2- 172.21.15.132:0/1922953562 >> v2:172.21.15.187:3300/0 conn(0x7f81a80ceee0 0x7f81a815ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.421+0000 7f81ad13a640 1 --2- 172.21.15.132:0/1922953562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81a80cb420 0x7f81a80ce9a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f81a80cf960 tx=0x7f819802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f10128d5c23f1935 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.421+0000 7f81ac939640 1 -- 172.21.15.132:0/1922953562 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f81980317e0 con 0x7f81a80cb420 2023-12-20T04:43:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.421+0000 7f81ac939640 1 -- 172.21.15.132:0/1922953562 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8198031940 con 0x7f81a80cb420 2023-12-20T04:43:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.421+0000 7f81ac939640 1 -- 172.21.15.132:0/1922953562 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198031cd0 con 0x7f81a80cb420 2023-12-20T04:43:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.422+0000 7f81afb9f640 1 -- 172.21.15.132:0/1922953562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81a80cb420 msgr2=0x7f81a80ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.422+0000 7f81afb9f640 1 --2- 172.21.15.132:0/1922953562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81a80cb420 0x7f81a80ce9a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f81a80cf960 tx=0x7f819802b880 comp rx=0 tx=0).stop 2023-12-20T04:43:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.422+0000 7f81afb9f640 1 -- 172.21.15.132:0/1922953562 shutdown_connections 2023-12-20T04:43:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.422+0000 7f81afb9f640 1 --2- 172.21.15.132:0/1922953562 >> v2:172.21.15.187:3300/0 conn(0x7f81a80ceee0 0x7f81a815ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.422+0000 7f81afb9f640 1 --2- 172.21.15.132:0/1922953562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81a80cb420 0x7f81a80ce9a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.422+0000 7f81afb9f640 1 --2- 172.21.15.132:0/1922953562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f81a815e2d0 0x7f81a80b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.422+0000 7f81afb9f640 1 -- 172.21.15.132:0/1922953562 >> 172.21.15.132:0/1922953562 conn(0x7f81a806d7c0 msgr2=0x7f81a806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.422+0000 7f81afb9f640 1 -- 172.21.15.132:0/1922953562 shutdown_connections 2023-12-20T04:43:40.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.422+0000 7f81afb9f640 1 -- 172.21.15.132:0/1922953562 wait complete. 2023-12-20T04:43:40.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.423+0000 7f81afb9f640 1 Processor -- start 2023-12-20T04:43:40.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.423+0000 7f81afb9f640 1 -- start start 2023-12-20T04:43:40.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81afb9f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81a80cb420 0x7f81a815c8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81afb9f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81a80ceee0 0x7f81a806c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81afb9f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f81a815e2d0 0x7f81a806c790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81afb9f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80ca3d0 con 0x7f81a80ceee0 2023-12-20T04:43:40.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81afb9f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80ca7f0 con 0x7f81a80cb420 2023-12-20T04:43:40.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81afb9f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f81a80ca030 con 0x7f81a815e2d0 2023-12-20T04:43:40.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81ad13a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81a80ceee0 0x7f81a806c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81ad13a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81a80ceee0 0x7f81a806c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35366/0 (socket says 172.21.15.132:35366) 2023-12-20T04:43:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81ad13a640 1 -- 172.21.15.132:0/1104409697 learned_addr learned my addr 172.21.15.132:0/1104409697 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81ad93b640 1 --2- 172.21.15.132:0/1104409697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81a80cb420 0x7f81a815c8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81ae13c640 1 --2- 172.21.15.132:0/1104409697 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f81a815e2d0 0x7f81a806c790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81ad13a640 1 -- 172.21.15.132:0/1104409697 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f81a815e2d0 msgr2=0x7f81a806c790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81ad13a640 1 --2- 172.21.15.132:0/1104409697 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f81a815e2d0 0x7f81a806c790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81ad13a640 1 -- 172.21.15.132:0/1104409697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81a80cb420 msgr2=0x7f81a815c8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81ad13a640 1 --2- 172.21.15.132:0/1104409697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81a80cb420 0x7f81a815c8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81ad13a640 1 -- 172.21.15.132:0/1104409697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f81980094d0 con 0x7f81a80ceee0 2023-12-20T04:43:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81ae13c640 1 --2- 172.21.15.132:0/1104409697 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f81a815e2d0 0x7f81a806c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.424+0000 7f81ad13a640 1 --2- 172.21.15.132:0/1104409697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81a80ceee0 0x7f81a806c250 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8198000c00 tx=0x7f81980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.425+0000 7f819e7fc640 1 -- 172.21.15.132:0/1104409697 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198032900 con 0x7f81a80ceee0 2023-12-20T04:43:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.425+0000 7f819e7fc640 1 -- 172.21.15.132:0/1104409697 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8198032a60 con 0x7f81a80ceee0 2023-12-20T04:43:40.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.425+0000 7f819e7fc640 1 -- 172.21.15.132:0/1104409697 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8198032e10 con 0x7f81a80ceee0 2023-12-20T04:43:40.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.425+0000 7f81afb9f640 1 -- 172.21.15.132:0/1104409697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81a80c4a80 con 0x7f81a80ceee0 2023-12-20T04:43:40.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.425+0000 7f81afb9f640 1 -- 172.21.15.132:0/1104409697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81a806ccd0 con 0x7f81a80ceee0 2023-12-20T04:43:40.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.426+0000 7f81afb9f640 1 -- 172.21.15.132:0/1104409697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f81a804e840 con 0x7f81a80ceee0 2023-12-20T04:43:40.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.426+0000 7f819e7fc640 1 -- 172.21.15.132:0/1104409697 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f81980453f0 con 0x7f81a80ceee0 2023-12-20T04:43:40.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.426+0000 7f819e7fc640 1 --2- 172.21.15.132:0/1104409697 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f818c06a430 0x7f818c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.426+0000 7f819e7fc640 1 -- 172.21.15.132:0/1104409697 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f81980aa900 con 0x7f81a80ceee0 2023-12-20T04:43:40.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.426+0000 7f81ad93b640 1 --2- 172.21.15.132:0/1104409697 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f818c06a430 0x7f818c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.427+0000 7f81ad93b640 1 --2- 172.21.15.132:0/1104409697 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f818c06a430 0x7f818c06c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f81a400a960 tx=0x7f81a4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:40.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.431+0000 7f819e7fc640 1 -- 172.21.15.132:0/1104409697 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8198076240 con 0x7f81a80ceee0 2023-12-20T04:43:40.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.660+0000 7f81afb9f640 1 -- 172.21.15.132:0/1104409697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-osd"} v 0) v1 -- 0x7f81a80b1eb0 con 0x7f81a80ceee0 2023-12-20T04:43:40.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.663+0000 7f819e7fc640 1 -- 172.21.15.132:0/1104409697 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-osd"}]=0 v9) v1 ==== 90+0+0 (secure 0 0 0) 0x7f8198079860 con 0x7f81a80ceee0 2023-12-20T04:43:40.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.665+0000 7f81afb9f640 1 -- 172.21.15.132:0/1104409697 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f818c06a430 msgr2=0x7f818c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:40.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.665+0000 7f81afb9f640 1 --2- 172.21.15.132:0/1104409697 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f818c06a430 0x7f818c06c8f0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f81a400a960 tx=0x7f81a4008040 comp rx=0 tx=0).stop 2023-12-20T04:43:40.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.665+0000 7f81afb9f640 1 -- 172.21.15.132:0/1104409697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81a80ceee0 msgr2=0x7f81a806c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:40.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.665+0000 7f81afb9f640 1 --2- 172.21.15.132:0/1104409697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81a80ceee0 0x7f81a806c250 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f8198000c00 tx=0x7f81980046c0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.665+0000 7f81afb9f640 1 -- 172.21.15.132:0/1104409697 shutdown_connections 2023-12-20T04:43:40.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.665+0000 7f81afb9f640 1 --2- 172.21.15.132:0/1104409697 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f818c06a430 0x7f818c06c8f0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.665+0000 7f81afb9f640 1 --2- 172.21.15.132:0/1104409697 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f81a815e2d0 0x7f81a806c790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.665+0000 7f81afb9f640 1 --2- 172.21.15.132:0/1104409697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f81a80ceee0 0x7f81a806c250 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.665+0000 7f81afb9f640 1 --2- 172.21.15.132:0/1104409697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f81a80cb420 0x7f81a815c8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.665+0000 7f81afb9f640 1 -- 172.21.15.132:0/1104409697 >> 172.21.15.132:0/1104409697 conn(0x7f81a806d7c0 msgr2=0x7f81a815ed90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:40.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.665+0000 7f81afb9f640 1 -- 172.21.15.132:0/1104409697 shutdown_connections 2023-12-20T04:43:40.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.666+0000 7f81afb9f640 1 -- 172.21.15.132:0/1104409697 wait complete. 2023-12-20T04:43:40.678 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd 2023-12-20T04:43:40.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.776+0000 7fa8ab88e640 1 Processor -- start 2023-12-20T04:43:40.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.777+0000 7fa8ab88e640 1 -- start start 2023-12-20T04:43:40.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.777+0000 7fa8ab88e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8a415d110 0x7fa8a4069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa8ab88e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa8a40af210 0x7fa8a406a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa8ab88e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8a4161ce0 con 0x7fa8a415d4f0 2023-12-20T04:43:40.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa8ab88e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8a40aca50 con 0x7fa8a40af210 2023-12-20T04:43:40.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa8ab88e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a4160df0 con 0x7fa8a415d110 2023-12-20T04:43:40.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa8a8e29640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa8a415d4f0 0x7fa8a40aeb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52456/0 (socket says 172.21.15.132:52456) 2023-12-20T04:43:40.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa8a8e29640 1 -- 172.21.15.132:0/3546454402 learned_addr learned my addr 172.21.15.132:0/3546454402 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:40.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa8a9e2b640 1 --2- 172.21.15.132:0/3546454402 >> v2:172.21.15.187:3300/0 conn(0x7fa8a40af210 0x7fa8a406a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa8a962a640 1 --2- 172.21.15.132:0/3546454402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8a415d110 0x7fa8a4069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa897fff640 1 -- 172.21.15.132:0/3546454402 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311077183 0 0) 0x7fa8a4161ce0 con 0x7fa8a415d4f0 2023-12-20T04:43:40.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa897fff640 1 -- 172.21.15.132:0/3546454402 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa890003520 con 0x7fa8a415d4f0 2023-12-20T04:43:40.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa897fff640 1 -- 172.21.15.132:0/3546454402 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2478437106 0 0) 0x7fa890003520 con 0x7fa8a415d4f0 2023-12-20T04:43:40.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa897fff640 1 -- 172.21.15.132:0/3546454402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8a415d110 msgr2=0x7fa8a4069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:40.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa897fff640 1 --2- 172.21.15.132:0/3546454402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8a415d110 0x7fa8a4069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa897fff640 1 -- 172.21.15.132:0/3546454402 >> v2:172.21.15.187:3300/0 conn(0x7fa8a40af210 msgr2=0x7fa8a406a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:40.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa897fff640 1 --2- 172.21.15.132:0/3546454402 >> v2:172.21.15.187:3300/0 conn(0x7fa8a40af210 0x7fa8a406a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa897fff640 1 -- 172.21.15.132:0/3546454402 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a41610d0 con 0x7fa8a415d4f0 2023-12-20T04:43:40.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa897fff640 1 -- 172.21.15.132:0/3546454402 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fa8a0001670 con 0x7fa8a415d4f0 2023-12-20T04:43:40.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa897fff640 1 -- 172.21.15.132:0/3546454402 >> v1:172.21.15.132:6789/0 conn(0x7fa8a415d4f0 legacy=0x7fa8a40aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:40.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa897fff640 1 --2- 172.21.15.132:0/3546454402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8a415d110 0x7fa890003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa897fff640 1 --2- 172.21.15.132:0/3546454402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa890003ef0 0x7fa8900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa897fff640 1 --2- 172.21.15.132:0/3546454402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa890004d00 0x7fa890005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa897fff640 1 -- 172.21.15.132:0/3546454402 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a40aca50 con 0x7fa890004d00 2023-12-20T04:43:40.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa897fff640 1 -- 172.21.15.132:0/3546454402 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a4160df0 con 0x7fa890003ef0 2023-12-20T04:43:40.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa897fff640 1 -- 172.21.15.132:0/3546454402 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa89000b980 con 0x7fa8a415d110 2023-12-20T04:43:40.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa8a9e2b640 1 --2- 172.21.15.132:0/3546454402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa890004d00 0x7fa890005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa8a962a640 1 --2- 172.21.15.132:0/3546454402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8a415d110 0x7fa890003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.778+0000 7fa8a8e29640 1 --2- 172.21.15.132:0/3546454402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa890003ef0 0x7fa8900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.779+0000 7fa8a9e2b640 1 -- 172.21.15.132:0/3546454402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8a415d110 msgr2=0x7fa890003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:40.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.779+0000 7fa8a9e2b640 1 --2- 172.21.15.132:0/3546454402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8a415d110 0x7fa890003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.779+0000 7fa8a9e2b640 1 -- 172.21.15.132:0/3546454402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa890003ef0 msgr2=0x7fa8900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:40.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.779+0000 7fa8a9e2b640 1 --2- 172.21.15.132:0/3546454402 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa890003ef0 0x7fa8900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.779+0000 7fa8a9e2b640 1 -- 172.21.15.132:0/3546454402 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa890003520 con 0x7fa890004d00 2023-12-20T04:43:40.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.779+0000 7fa8a9e2b640 1 --2- 172.21.15.132:0/3546454402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa890004d00 0x7fa890005180 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40d0890 tx=0x7fa8900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa835af1a185f30e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:40.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.780+0000 7fa897fff640 1 -- 172.21.15.132:0/3546454402 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c02cbc0 con 0x7fa890004d00 2023-12-20T04:43:40.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.780+0000 7fa897fff640 1 -- 172.21.15.132:0/3546454402 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa89c00f040 con 0x7fa890004d00 2023-12-20T04:43:40.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.780+0000 7fa897fff640 1 -- 172.21.15.132:0/3546454402 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89c034440 con 0x7fa890004d00 2023-12-20T04:43:40.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.780+0000 7fa8ab88e640 1 -- 172.21.15.132:0/3546454402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa890004d00 msgr2=0x7fa890005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:40.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.780+0000 7fa8ab88e640 1 --2- 172.21.15.132:0/3546454402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa890004d00 0x7fa890005180 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40d0890 tx=0x7fa8900057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.780+0000 7fa8a9e2b640 1 -- 172.21.15.132:0/3546454402 reap_dead start 2023-12-20T04:43:40.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.780+0000 7fa8ab88e640 1 -- 172.21.15.132:0/3546454402 shutdown_connections 2023-12-20T04:43:40.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.780+0000 7fa8ab88e640 1 -- 172.21.15.132:0/3546454402 >> 172.21.15.132:0/3546454402 conn(0x7fa8a40cfbd0 msgr2=0x7fa8a40cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:40.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.780+0000 7fa8ab88e640 1 -- 172.21.15.132:0/3546454402 shutdown_connections 2023-12-20T04:43:40.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.780+0000 7fa8ab88e640 1 -- 172.21.15.132:0/3546454402 wait complete. 2023-12-20T04:43:40.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.781+0000 7fa8ab88e640 1 Processor -- start 2023-12-20T04:43:40.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.781+0000 7fa8ab88e640 1 -- start start 2023-12-20T04:43:40.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.782+0000 7fa8ab88e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8a41f2200 0x7fa8a415de00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.782+0000 7fa8ab88e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8a415e340 0x7fa8a40b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.782+0000 7fa8ab88e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8a40b0580 0x7fa8a41f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.782+0000 7fa8ab88e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a415e7c0 con 0x7fa8a41f2200 2023-12-20T04:43:40.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.782+0000 7fa8ab88e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a40b0d70 con 0x7fa8a40b0580 2023-12-20T04:43:40.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.782+0000 7fa8ab88e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8a40b1050 con 0x7fa8a415e340 2023-12-20T04:43:40.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.782+0000 7fa8a962a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8a41f2200 0x7fa8a415de00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.782+0000 7fa8a962a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8a41f2200 0x7fa8a415de00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35398/0 (socket says 172.21.15.132:35398) 2023-12-20T04:43:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.782+0000 7fa8a962a640 1 -- 172.21.15.132:0/3879188536 learned_addr learned my addr 172.21.15.132:0/3879188536 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.782+0000 7fa8a9e2b640 1 --2- 172.21.15.132:0/3879188536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8a40b0580 0x7fa8a41f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.782+0000 7fa8a8e29640 1 --2- 172.21.15.132:0/3879188536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8a415e340 0x7fa8a40b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.782+0000 7fa8a962a640 1 -- 172.21.15.132:0/3879188536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8a415e340 msgr2=0x7fa8a40b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.782+0000 7fa8a962a640 1 --2- 172.21.15.132:0/3879188536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8a415e340 0x7fa8a40b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.782+0000 7fa8a962a640 1 -- 172.21.15.132:0/3879188536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8a40b0580 msgr2=0x7fa8a41f5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.782+0000 7fa8a962a640 1 --2- 172.21.15.132:0/3879188536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8a40b0580 0x7fa8a41f5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.782+0000 7fa8a962a640 1 -- 172.21.15.132:0/3879188536 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8a406c670 con 0x7fa8a41f2200 2023-12-20T04:43:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.782+0000 7fa8a962a640 1 --2- 172.21.15.132:0/3879188536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8a41f2200 0x7fa8a415de00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa898011960 tx=0x7fa898011e20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.783+0000 7fa895ffb640 1 -- 172.21.15.132:0/3879188536 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa898005ba0 con 0x7fa8a41f2200 2023-12-20T04:43:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.783+0000 7fa895ffb640 1 -- 172.21.15.132:0/3879188536 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa898005d00 con 0x7fa8a41f2200 2023-12-20T04:43:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.783+0000 7fa8ab88e640 1 -- 172.21.15.132:0/3879188536 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8a406c950 con 0x7fa8a41f2200 2023-12-20T04:43:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.783+0000 7fa895ffb640 1 -- 172.21.15.132:0/3879188536 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa89800fb00 con 0x7fa8a41f2200 2023-12-20T04:43:40.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.783+0000 7fa8ab88e640 1 -- 172.21.15.132:0/3879188536 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8a40c6ca0 con 0x7fa8a41f2200 2023-12-20T04:43:40.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.784+0000 7fa8ab88e640 1 -- 172.21.15.132:0/3879188536 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8a404e840 con 0x7fa8a41f2200 2023-12-20T04:43:40.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.784+0000 7fa895ffb640 1 -- 172.21.15.132:0/3879188536 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa89800fc60 con 0x7fa8a41f2200 2023-12-20T04:43:40.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.785+0000 7fa895ffb640 1 --2- 172.21.15.132:0/3879188536 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa88806a430 0x7fa88806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:40.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.785+0000 7fa895ffb640 1 -- 172.21.15.132:0/3879188536 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa898088e20 con 0x7fa8a41f2200 2023-12-20T04:43:40.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.785+0000 7fa8a8e29640 1 --2- 172.21.15.132:0/3879188536 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa88806a430 0x7fa88806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:40.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.785+0000 7fa8a8e29640 1 --2- 172.21.15.132:0/3879188536 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa88806a430 0x7fa88806c8f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40b5fd0 tx=0x7fa8a0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:40.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:40.789+0000 7fa895ffb640 1 -- 172.21.15.132:0/3879188536 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa898054820 con 0x7fa8a41f2200 2023-12-20T04:43:41.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.016+0000 7fa8ab88e640 1 -- 172.21.15.132:0/3879188536 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd"} v 0) v1 -- 0x7fa8a40d0940 con 0x7fa8a41f2200 2023-12-20T04:43:41.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.020+0000 7fa895ffb640 1 -- 172.21.15.132:0/3879188536 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd"}]=0 v10) v1 ==== 90+0+0 (secure 0 0 0) 0x7fa898057e40 con 0x7fa8a41f2200 2023-12-20T04:43:41.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.022+0000 7fa8ab88e640 1 -- 172.21.15.132:0/3879188536 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa88806a430 msgr2=0x7fa88806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:41.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.022+0000 7fa8ab88e640 1 --2- 172.21.15.132:0/3879188536 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa88806a430 0x7fa88806c8f0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fa8a40b5fd0 tx=0x7fa8a0009040 comp rx=0 tx=0).stop 2023-12-20T04:43:41.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.022+0000 7fa8ab88e640 1 -- 172.21.15.132:0/3879188536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8a41f2200 msgr2=0x7fa8a415de00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:41.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.022+0000 7fa8ab88e640 1 --2- 172.21.15.132:0/3879188536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8a41f2200 0x7fa8a415de00 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fa898011960 tx=0x7fa898011e20 comp rx=0 tx=0).stop 2023-12-20T04:43:41.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.022+0000 7fa8ab88e640 1 -- 172.21.15.132:0/3879188536 shutdown_connections 2023-12-20T04:43:41.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.022+0000 7fa8ab88e640 1 --2- 172.21.15.132:0/3879188536 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa88806a430 0x7fa88806c8f0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.022+0000 7fa8ab88e640 1 --2- 172.21.15.132:0/3879188536 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8a40b0580 0x7fa8a41f5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.022+0000 7fa8ab88e640 1 --2- 172.21.15.132:0/3879188536 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8a415e340 0x7fa8a40b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.022+0000 7fa8ab88e640 1 --2- 172.21.15.132:0/3879188536 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8a41f2200 0x7fa8a415de00 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.022+0000 7fa8ab88e640 1 -- 172.21.15.132:0/3879188536 >> 172.21.15.132:0/3879188536 conn(0x7fa8a40cfbd0 msgr2=0x7fa8a40ca200 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:41.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.022+0000 7fa8ab88e640 1 -- 172.21.15.132:0/3879188536 shutdown_connections 2023-12-20T04:43:41.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.022+0000 7fa8ab88e640 1 -- 172.21.15.132:0/3879188536 wait complete. 2023-12-20T04:43:41.035 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rbd-mirror 2023-12-20T04:43:41.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.133+0000 7f53d29ab640 1 Processor -- start 2023-12-20T04:43:41.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.133+0000 7f53d29ab640 1 -- start start 2023-12-20T04:43:41.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.134+0000 7f53d29ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53cc1588e0 0x7f53cc069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.134+0000 7f53d29ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f53cc06a170 0x7f53cc06c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.134+0000 7f53d29ab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53cc06a5d0 con 0x7f53cc06cd30 2023-12-20T04:43:41.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.134+0000 7f53d29ab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53cc06d520 con 0x7f53cc06a170 2023-12-20T04:43:41.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.134+0000 7f53d29ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc06ea90 con 0x7f53cc1588e0 2023-12-20T04:43:41.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.134+0000 7f53cb7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f53cc06a170 0x7f53cc06c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.134+0000 7f53d0f48640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f53cc06cd30 0x7f53cc0b4bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52464/0 (socket says 172.21.15.132:52464) 2023-12-20T04:43:41.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.134+0000 7f53cb7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f53cc06a170 0x7f53cc06c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35414/0 (socket says 172.21.15.132:35414) 2023-12-20T04:43:41.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.134+0000 7f53d0f48640 1 -- 172.21.15.132:0/332790408 learned_addr learned my addr 172.21.15.132:0/332790408 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:41.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.135+0000 7f53cbfff640 1 --2- 172.21.15.132:0/332790408 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53cc1588e0 0x7f53cc069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.135+0000 7f53cb7fe640 1 -- 172.21.15.132:0/332790408 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53cc1588e0 msgr2=0x7f53cc069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:41.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.135+0000 7f53cb7fe640 1 --2- 172.21.15.132:0/332790408 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53cc1588e0 0x7f53cc069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.135+0000 7f53cb7fe640 1 -- 172.21.15.132:0/332790408 >> v1:172.21.15.132:6789/0 conn(0x7f53cc06cd30 legacy=0x7f53cc0b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:41.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.135+0000 7f53caffd640 1 -- 172.21.15.132:0/332790408 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 708327672 0 0) 0x7f53cc06a5d0 con 0x7f53cc06cd30 2023-12-20T04:43:41.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.135+0000 7f53cb7fe640 1 -- 172.21.15.132:0/332790408 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53cc06e160 con 0x7f53cc06a170 2023-12-20T04:43:41.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.135+0000 7f53cbfff640 1 --2- 172.21.15.132:0/332790408 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53cc1588e0 0x7f53cc069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:41.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.135+0000 7f53cb7fe640 1 --2- 172.21.15.132:0/332790408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53cc06a170 0x7f53cc06c7f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f53c00097a0 tx=0x7f53c002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afc76b7adba7c40d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:41.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.136+0000 7f53caffd640 1 -- 172.21.15.132:0/332790408 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0031830 con 0x7f53cc06a170 2023-12-20T04:43:41.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.136+0000 7f53caffd640 1 -- 172.21.15.132:0/332790408 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c0031990 con 0x7f53cc06a170 2023-12-20T04:43:41.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.136+0000 7f53caffd640 1 -- 172.21.15.132:0/332790408 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0031d20 con 0x7f53cc06a170 2023-12-20T04:43:41.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.136+0000 7f53d29ab640 1 -- 172.21.15.132:0/332790408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53cc06a170 msgr2=0x7f53cc06c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:41.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.136+0000 7f53d29ab640 1 --2- 172.21.15.132:0/332790408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53cc06a170 0x7f53cc06c7f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f53c00097a0 tx=0x7f53c002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.136+0000 7f53d29ab640 1 -- 172.21.15.132:0/332790408 shutdown_connections 2023-12-20T04:43:41.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.136+0000 7f53d29ab640 1 --2- 172.21.15.132:0/332790408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53cc06a170 0x7f53cc06c7f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.136+0000 7f53d29ab640 1 --2- 172.21.15.132:0/332790408 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53cc1588e0 0x7f53cc069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.136+0000 7f53d29ab640 1 -- 172.21.15.132:0/332790408 >> 172.21.15.132:0/332790408 conn(0x7f53cc0cfca0 msgr2=0x7f53cc0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:41.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.136+0000 7f53d29ab640 1 -- 172.21.15.132:0/332790408 shutdown_connections 2023-12-20T04:43:41.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.136+0000 7f53d29ab640 1 -- 172.21.15.132:0/332790408 wait complete. 2023-12-20T04:43:41.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.137+0000 7f53d29ab640 1 Processor -- start 2023-12-20T04:43:41.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.138+0000 7f53d29ab640 1 -- start start 2023-12-20T04:43:41.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.138+0000 7f53d29ab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53cc06a170 0x7f53cc0b5070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.138+0000 7f53d29ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53cc06cd30 0x7f53cc0cf400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.138+0000 7f53d29ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53cc1588e0 0x7f53cc156a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.138+0000 7f53d29ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc15e010 con 0x7f53cc06cd30 2023-12-20T04:43:41.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.138+0000 7f53d29ab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc155fc0 con 0x7f53cc06a170 2023-12-20T04:43:41.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.138+0000 7f53d29ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53cc15dd30 con 0x7f53cc1588e0 2023-12-20T04:43:41.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.138+0000 7f53cb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53cc06cd30 0x7f53cc0cf400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.138+0000 7f53cb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53cc06cd30 0x7f53cc0cf400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35430/0 (socket says 172.21.15.132:35430) 2023-12-20T04:43:41.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.138+0000 7f53cb7fe640 1 -- 172.21.15.132:0/1941761900 learned_addr learned my addr 172.21.15.132:0/1941761900 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:41.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.139+0000 7f53cbfff640 1 --2- 172.21.15.132:0/1941761900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53cc06a170 0x7f53cc0b5070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.139+0000 7f53d0f48640 1 --2- 172.21.15.132:0/1941761900 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53cc1588e0 0x7f53cc156a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.139+0000 7f53cb7fe640 1 -- 172.21.15.132:0/1941761900 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53cc1588e0 msgr2=0x7f53cc156a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:41.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.139+0000 7f53cb7fe640 1 --2- 172.21.15.132:0/1941761900 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53cc1588e0 0x7f53cc156a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.139+0000 7f53cb7fe640 1 -- 172.21.15.132:0/1941761900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53cc06a170 msgr2=0x7f53cc0b5070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:41.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.139+0000 7f53cb7fe640 1 --2- 172.21.15.132:0/1941761900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53cc06a170 0x7f53cc0b5070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.139+0000 7f53cb7fe640 1 -- 172.21.15.132:0/1941761900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53c0009400 con 0x7f53cc06cd30 2023-12-20T04:43:41.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.139+0000 7f53d0f48640 1 --2- 172.21.15.132:0/1941761900 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53cc1588e0 0x7f53cc156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:41.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.139+0000 7f53cbfff640 1 --2- 172.21.15.132:0/1941761900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53cc06a170 0x7f53cc0b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:41.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.139+0000 7f53cb7fe640 1 --2- 172.21.15.132:0/1941761900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53cc06cd30 0x7f53cc0cf400 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f53c0034040 tx=0x7f53c00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:41.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.139+0000 7f53c8ff9640 1 -- 172.21.15.132:0/1941761900 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c003aa60 con 0x7f53cc06cd30 2023-12-20T04:43:41.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.139+0000 7f53c8ff9640 1 -- 172.21.15.132:0/1941761900 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53c003abe0 con 0x7f53cc06cd30 2023-12-20T04:43:41.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.139+0000 7f53d29ab640 1 -- 172.21.15.132:0/1941761900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53cc156260 con 0x7f53cc06cd30 2023-12-20T04:43:41.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.139+0000 7f53c8ff9640 1 -- 172.21.15.132:0/1941761900 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53c0044400 con 0x7f53cc06cd30 2023-12-20T04:43:41.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.139+0000 7f53d29ab640 1 -- 172.21.15.132:0/1941761900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53cc157620 con 0x7f53cc06cd30 2023-12-20T04:43:41.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.140+0000 7f53d29ab640 1 -- 172.21.15.132:0/1941761900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53cc156780 con 0x7f53cc06cd30 2023-12-20T04:43:41.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.140+0000 7f53c8ff9640 1 -- 172.21.15.132:0/1941761900 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f53c004d440 con 0x7f53cc06cd30 2023-12-20T04:43:41.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.141+0000 7f53c8ff9640 1 --2- 172.21.15.132:0/1941761900 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f53b806a430 0x7f53b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.141+0000 7f53c8ff9640 1 -- 172.21.15.132:0/1941761900 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f53c00aa700 con 0x7f53cc06cd30 2023-12-20T04:43:41.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.141+0000 7f53cbfff640 1 --2- 172.21.15.132:0/1941761900 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f53b806a430 0x7f53b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.141+0000 7f53cbfff640 1 --2- 172.21.15.132:0/1941761900 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f53b806a430 0x7f53b806c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f53bc006fd0 tx=0x7f53bc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:41.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.145+0000 7f53c8ff9640 1 -- 172.21.15.132:0/1941761900 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f53c00760d0 con 0x7f53cc06cd30 2023-12-20T04:43:41.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.378+0000 7f53d29ab640 1 -- 172.21.15.132:0/1941761900 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"} v 0) v1 -- 0x7f53cc04e840 con 0x7f53cc06cd30 2023-12-20T04:43:41.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.382+0000 7f53c8ff9640 1 -- 172.21.15.132:0/1941761900 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rbd-mirror"}]=0 v11) v1 ==== 97+0+0 (secure 0 0 0) 0x7f53c00350a0 con 0x7f53cc06cd30 2023-12-20T04:43:41.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.384+0000 7f53d29ab640 1 -- 172.21.15.132:0/1941761900 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f53b806a430 msgr2=0x7f53b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:41.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.384+0000 7f53d29ab640 1 --2- 172.21.15.132:0/1941761900 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f53b806a430 0x7f53b806c8f0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7f53bc006fd0 tx=0x7f53bc008040 comp rx=0 tx=0).stop 2023-12-20T04:43:41.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.384+0000 7f53d29ab640 1 -- 172.21.15.132:0/1941761900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53cc06cd30 msgr2=0x7f53cc0cf400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:41.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.384+0000 7f53d29ab640 1 --2- 172.21.15.132:0/1941761900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53cc06cd30 0x7f53cc0cf400 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f53c0034040 tx=0x7f53c00046c0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.384+0000 7f53d29ab640 1 -- 172.21.15.132:0/1941761900 shutdown_connections 2023-12-20T04:43:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.384+0000 7f53d29ab640 1 --2- 172.21.15.132:0/1941761900 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f53b806a430 0x7f53b806c8f0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.384+0000 7f53d29ab640 1 --2- 172.21.15.132:0/1941761900 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53cc1588e0 0x7f53cc156a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.384+0000 7f53d29ab640 1 --2- 172.21.15.132:0/1941761900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53cc06cd30 0x7f53cc0cf400 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.384+0000 7f53d29ab640 1 --2- 172.21.15.132:0/1941761900 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53cc06a170 0x7f53cc0b5070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.384+0000 7f53d29ab640 1 -- 172.21.15.132:0/1941761900 >> 172.21.15.132:0/1941761900 conn(0x7f53cc0cfca0 msgr2=0x7f53cc0cbb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.384+0000 7f53d29ab640 1 -- 172.21.15.132:0/1941761900 shutdown_connections 2023-12-20T04:43:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.384+0000 7f53d29ab640 1 -- 172.21.15.132:0/1941761900 wait complete. 2023-12-20T04:43:41.396 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth del client.bootstrap-rgw 2023-12-20T04:43:41.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.496+0000 7f735a828640 1 Processor -- start 2023-12-20T04:43:41.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.496+0000 7f735a828640 1 -- start start 2023-12-20T04:43:41.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.496+0000 7f735a828640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f735415cef0 0x7f73540cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.496+0000 7f735a828640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f735415d2d0 0x7f73540ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.496+0000 7f735a828640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73540add30 con 0x7f73540cd1e0 2023-12-20T04:43:41.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.496+0000 7f735a828640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73540ae010 con 0x7f735415d2d0 2023-12-20T04:43:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.496+0000 7f735a828640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7354072d00 con 0x7f735415cef0 2023-12-20T04:43:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.497+0000 7f7358dc5640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f73540cd1e0 0x7f735406bd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52472/0 (socket says 172.21.15.132:52472) 2023-12-20T04:43:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.497+0000 7f7358dc5640 1 -- 172.21.15.132:0/1344109026 learned_addr learned my addr 172.21.15.132:0/1344109026 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.497+0000 7f73537fe640 1 --2- 172.21.15.132:0/1344109026 >> v2:172.21.15.187:3300/0 conn(0x7f735415d2d0 0x7f73540ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.497+0000 7f7353fff640 1 --2- 172.21.15.132:0/1344109026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f735415cef0 0x7f73540cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.497+0000 7f7352ffd640 1 -- 172.21.15.132:0/1344109026 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63561232 0 0) 0x7f73540add30 con 0x7f73540cd1e0 2023-12-20T04:43:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.497+0000 7f7352ffd640 1 -- 172.21.15.132:0/1344109026 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f733c003520 con 0x7f73540cd1e0 2023-12-20T04:43:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.497+0000 7f73537fe640 1 -- 172.21.15.132:0/1344109026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f735415cef0 msgr2=0x7f73540cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.497+0000 7f73537fe640 1 --2- 172.21.15.132:0/1344109026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f735415cef0 0x7f73540cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.497+0000 7f73537fe640 1 -- 172.21.15.132:0/1344109026 >> v1:172.21.15.132:6789/0 conn(0x7f73540cd1e0 legacy=0x7f735406bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.497+0000 7f7352ffd640 1 -- 172.21.15.132:0/1344109026 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3236927105 0 0) 0x7f733c003520 con 0x7f73540cd1e0 2023-12-20T04:43:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.497+0000 7f73537fe640 1 -- 172.21.15.132:0/1344109026 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7354072fe0 con 0x7f735415d2d0 2023-12-20T04:43:41.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.498+0000 7f73537fe640 1 --2- 172.21.15.132:0/1344109026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f735415d2d0 0x7f73540ad2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f73440097a0 tx=0x7f734402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a1c26cd63fe7aaf9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.498+0000 7f7352ffd640 1 -- 172.21.15.132:0/1344109026 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734402f050 con 0x7f735415d2d0 2023-12-20T04:43:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.498+0000 7f7352ffd640 1 -- 172.21.15.132:0/1344109026 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7344031500 con 0x7f735415d2d0 2023-12-20T04:43:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.498+0000 7f7352ffd640 1 -- 172.21.15.132:0/1344109026 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734c0019f0 con 0x7f735415d2d0 2023-12-20T04:43:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.499+0000 7f735a828640 1 -- 172.21.15.132:0/1344109026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f735415d2d0 msgr2=0x7f73540ad2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.499+0000 7f735a828640 1 --2- 172.21.15.132:0/1344109026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f735415d2d0 0x7f73540ad2f0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f73440097a0 tx=0x7f734402b820 comp rx=0 tx=0).stop 2023-12-20T04:43:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.499+0000 7f735a828640 1 -- 172.21.15.132:0/1344109026 shutdown_connections 2023-12-20T04:43:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.499+0000 7f735a828640 1 --2- 172.21.15.132:0/1344109026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f735415d2d0 0x7f73540ad2f0 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.499+0000 7f735a828640 1 --2- 172.21.15.132:0/1344109026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f735415cef0 0x7f73540cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.499+0000 7f735a828640 1 -- 172.21.15.132:0/1344109026 >> 172.21.15.132:0/1344109026 conn(0x7f73540cf330 msgr2=0x7f73540cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:41.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.499+0000 7f735a828640 1 -- 172.21.15.132:0/1344109026 shutdown_connections 2023-12-20T04:43:41.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.499+0000 7f735a828640 1 -- 172.21.15.132:0/1344109026 wait complete. 2023-12-20T04:43:41.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.500+0000 7f735a828640 1 Processor -- start 2023-12-20T04:43:41.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.500+0000 7f735a828640 1 -- start start 2023-12-20T04:43:41.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f735a828640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73540cd1e0 0x7f73540b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f735a828640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f735415cef0 0x7f735415f380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f735a828640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f735415d2d0 0x7f7354159e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f735a828640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7354159a70 con 0x7f73540cd1e0 2023-12-20T04:43:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f735a828640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7354154a40 con 0x7f735415d2d0 2023-12-20T04:43:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f735a828640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73540b2750 con 0x7f735415cef0 2023-12-20T04:43:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f7353fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73540cd1e0 0x7f73540b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f7353fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73540cd1e0 0x7f73540b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35436/0 (socket says 172.21.15.132:35436) 2023-12-20T04:43:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f7353fff640 1 -- 172.21.15.132:0/739429626 learned_addr learned my addr 172.21.15.132:0/739429626 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f7358dc5640 1 --2- 172.21.15.132:0/739429626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f735415d2d0 0x7f7354159e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f73537fe640 1 --2- 172.21.15.132:0/739429626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f735415cef0 0x7f735415f380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f7353fff640 1 -- 172.21.15.132:0/739429626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f735415cef0 msgr2=0x7f735415f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f7353fff640 1 --2- 172.21.15.132:0/739429626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f735415cef0 0x7f735415f380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f7353fff640 1 -- 172.21.15.132:0/739429626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f735415d2d0 msgr2=0x7f7354159e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f7353fff640 1 --2- 172.21.15.132:0/739429626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f735415d2d0 0x7f7354159e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f7353fff640 1 -- 172.21.15.132:0/739429626 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7344009400 con 0x7f73540cd1e0 2023-12-20T04:43:41.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f73537fe640 1 --2- 172.21.15.132:0/739429626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f735415cef0 0x7f735415f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:41.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f7358dc5640 1 --2- 172.21.15.132:0/739429626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f735415d2d0 0x7f7354159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:41.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f7353fff640 1 --2- 172.21.15.132:0/739429626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73540cd1e0 0x7f73540b2210 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f734800e9b0 tx=0x7f734800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:41.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f7350ff9640 1 -- 172.21.15.132:0/739429626 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7348009670 con 0x7f73540cd1e0 2023-12-20T04:43:41.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f7350ff9640 1 -- 172.21.15.132:0/739429626 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f734800c9a0 con 0x7f73540cd1e0 2023-12-20T04:43:41.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f735a828640 1 -- 172.21.15.132:0/739429626 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7354158df0 con 0x7f73540cd1e0 2023-12-20T04:43:41.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.501+0000 7f7350ff9640 1 -- 172.21.15.132:0/739429626 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f734800cd50 con 0x7f73540cd1e0 2023-12-20T04:43:41.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.502+0000 7f735a828640 1 -- 172.21.15.132:0/739429626 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73541593b0 con 0x7f73540cd1e0 2023-12-20T04:43:41.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.502+0000 7f735a828640 1 -- 172.21.15.132:0/739429626 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f735404e840 con 0x7f73540cd1e0 2023-12-20T04:43:41.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.503+0000 7f7350ff9640 1 -- 172.21.15.132:0/739429626 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7348013470 con 0x7f73540cd1e0 2023-12-20T04:43:41.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.503+0000 7f7350ff9640 1 --2- 172.21.15.132:0/739429626 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f734006a430 0x7f734006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.503+0000 7f7350ff9640 1 -- 172.21.15.132:0/739429626 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f7348088800 con 0x7f73540cd1e0 2023-12-20T04:43:41.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.503+0000 7f73537fe640 1 --2- 172.21.15.132:0/739429626 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f734006a430 0x7f734006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.504+0000 7f73537fe640 1 --2- 172.21.15.132:0/739429626 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f734006a430 0x7f734006c8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7344035000 tx=0x7f7344008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:41.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.507+0000 7f7350ff9640 1 -- 172.21.15.132:0/739429626 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f73480541d0 con 0x7f73540cd1e0 2023-12-20T04:43:41.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.736+0000 7f735a828640 1 -- 172.21.15.132:0/739429626 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth del", "entity": "client.bootstrap-rgw"} v 0) v1 -- 0x7f73540b52b0 con 0x7f73540cd1e0 2023-12-20T04:43:41.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.740+0000 7f7350ff9640 1 -- 172.21.15.132:0/739429626 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth del", "entity": "client.bootstrap-rgw"}]=0 v12) v1 ==== 90+0+0 (secure 0 0 0) 0x7f73480170a0 con 0x7f73540cd1e0 2023-12-20T04:43:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.742+0000 7f735a828640 1 -- 172.21.15.132:0/739429626 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f734006a430 msgr2=0x7f734006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.742+0000 7f735a828640 1 --2- 172.21.15.132:0/739429626 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f734006a430 0x7f734006c8f0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f7344035000 tx=0x7f7344008030 comp rx=0 tx=0).stop 2023-12-20T04:43:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.742+0000 7f735a828640 1 -- 172.21.15.132:0/739429626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73540cd1e0 msgr2=0x7f73540b2210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.742+0000 7f735a828640 1 --2- 172.21.15.132:0/739429626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73540cd1e0 0x7f73540b2210 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f734800e9b0 tx=0x7f734800ee70 comp rx=0 tx=0).stop 2023-12-20T04:43:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.742+0000 7f735a828640 1 -- 172.21.15.132:0/739429626 shutdown_connections 2023-12-20T04:43:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.742+0000 7f735a828640 1 --2- 172.21.15.132:0/739429626 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f734006a430 0x7f734006c8f0 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.742+0000 7f735a828640 1 --2- 172.21.15.132:0/739429626 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f735415d2d0 0x7f7354159e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.742+0000 7f735a828640 1 --2- 172.21.15.132:0/739429626 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f735415cef0 0x7f735415f380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.742+0000 7f735a828640 1 --2- 172.21.15.132:0/739429626 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73540cd1e0 0x7f73540b2210 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.742+0000 7f735a828640 1 -- 172.21.15.132:0/739429626 >> 172.21.15.132:0/739429626 conn(0x7f73540cf330 msgr2=0x7f73540afeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:41.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.742+0000 7f735a828640 1 -- 172.21.15.132:0/739429626 shutdown_connections 2023-12-20T04:43:41.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.742+0000 7f735a828640 1 -- 172.21.15.132:0/739429626 wait complete. 2023-12-20T04:43:41.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:41.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.853+0000 7f3f19939640 1 Processor -- start 2023-12-20T04:43:41.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.853+0000 7f3f19939640 1 -- start start 2023-12-20T04:43:41.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.853+0000 7f3f19939640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3f14160450 0x7f3f14160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.853+0000 7f3f19939640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f140b5090 0x7f3f140d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.853+0000 7f3f19939640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f140b5ec0 con 0x7f3f141611b0 2023-12-20T04:43:41.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.853+0000 7f3f19939640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f141617e0 con 0x7f3f140b5090 2023-12-20T04:43:41.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.853+0000 7f3f19939640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f140d0fc0 con 0x7f3f14160450 2023-12-20T04:43:41.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.853+0000 7f3f137fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f140b5090 0x7f3f140d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.853+0000 7f3f137fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f140b5090 0x7f3f140d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35438/0 (socket says 172.21.15.132:35438) 2023-12-20T04:43:41.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.853+0000 7f3f137fe640 1 -- 172.21.15.132:0/2219295983 learned_addr learned my addr 172.21.15.132:0/2219295983 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:41.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.854+0000 7f3f12ffd640 1 --2- 172.21.15.132:0/2219295983 >> v2:172.21.15.187:3300/0 conn(0x7f3f14160450 0x7f3f14160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.854+0000 7f3f137fe640 1 -- 172.21.15.132:0/2219295983 >> v2:172.21.15.187:3300/0 conn(0x7f3f14160450 msgr2=0x7f3f14160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:41.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.854+0000 7f3f137fe640 1 --2- 172.21.15.132:0/2219295983 >> v2:172.21.15.187:3300/0 conn(0x7f3f14160450 0x7f3f14160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.854+0000 7f3f137fe640 1 -- 172.21.15.132:0/2219295983 >> v1:172.21.15.187:6789/0 conn(0x7f3f141611b0 legacy=0x7f3f140b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:41.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.854+0000 7f3f137fe640 1 -- 172.21.15.132:0/2219295983 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f140d12a0 con 0x7f3f140b5090 2023-12-20T04:43:41.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.854+0000 7f3f137fe640 1 --2- 172.21.15.132:0/2219295983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140b5090 0x7f3f140d1aa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3f1408b150 tx=0x7f3f0c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223262d7ab257f2b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:41.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.855+0000 7f3f11ffb640 1 -- 172.21.15.132:0/2219295983 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c030860 con 0x7f3f140b5090 2023-12-20T04:43:41.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.855+0000 7f3f11ffb640 1 -- 172.21.15.132:0/2219295983 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0c0309c0 con 0x7f3f140b5090 2023-12-20T04:43:41.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.855+0000 7f3f11ffb640 1 -- 172.21.15.132:0/2219295983 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c030d50 con 0x7f3f140b5090 2023-12-20T04:43:41.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.855+0000 7f3f19939640 1 -- 172.21.15.132:0/2219295983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140b5090 msgr2=0x7f3f140d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:41.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.855+0000 7f3f19939640 1 --2- 172.21.15.132:0/2219295983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140b5090 0x7f3f140d1aa0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f3f1408b150 tx=0x7f3f0c02b9a0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.855+0000 7f3f19939640 1 -- 172.21.15.132:0/2219295983 shutdown_connections 2023-12-20T04:43:41.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.855+0000 7f3f19939640 1 --2- 172.21.15.132:0/2219295983 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140b5090 0x7f3f140d1aa0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.855+0000 7f3f19939640 1 --2- 172.21.15.132:0/2219295983 >> v2:172.21.15.187:3300/0 conn(0x7f3f14160450 0x7f3f14160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.855+0000 7f3f19939640 1 -- 172.21.15.132:0/2219295983 >> 172.21.15.132:0/2219295983 conn(0x7f3f140cf980 msgr2=0x7f3f140cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:41.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.855+0000 7f3f19939640 1 -- 172.21.15.132:0/2219295983 shutdown_connections 2023-12-20T04:43:41.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.855+0000 7f3f19939640 1 -- 172.21.15.132:0/2219295983 wait complete. 2023-12-20T04:43:41.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.856+0000 7f3f19939640 1 Processor -- start 2023-12-20T04:43:41.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.856+0000 7f3f19939640 1 -- start start 2023-12-20T04:43:41.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.857+0000 7f3f19939640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140b5090 0x7f3f140c9440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.857+0000 7f3f19939640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f14160450 0x7f3f1415ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.857+0000 7f3f19939640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f141611b0 0x7f3f14154d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.857+0000 7f3f19939640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1415be70 con 0x7f3f140b5090 2023-12-20T04:43:41.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.857+0000 7f3f19939640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f140ca270 con 0x7f3f141611b0 2023-12-20T04:43:41.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.857+0000 7f3f19939640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1415b3d0 con 0x7f3f14160450 2023-12-20T04:43:41.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.857+0000 7f3f12ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140b5090 0x7f3f140c9440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.857+0000 7f3f12ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140b5090 0x7f3f140c9440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35454/0 (socket says 172.21.15.132:35454) 2023-12-20T04:43:41.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.857+0000 7f3f12ffd640 1 -- 172.21.15.132:0/30155004 learned_addr learned my addr 172.21.15.132:0/30155004 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:41.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.857+0000 7f3f137fe640 1 --2- 172.21.15.132:0/30155004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f141611b0 0x7f3f14154d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.858+0000 7f3f127fc640 1 --2- 172.21.15.132:0/30155004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f14160450 0x7f3f1415ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.858+0000 7f3f12ffd640 1 -- 172.21.15.132:0/30155004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f14160450 msgr2=0x7f3f1415ae90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:41.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.858+0000 7f3f12ffd640 1 --2- 172.21.15.132:0/30155004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f14160450 0x7f3f1415ae90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.858+0000 7f3f12ffd640 1 -- 172.21.15.132:0/30155004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f141611b0 msgr2=0x7f3f14154d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:41.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.858+0000 7f3f12ffd640 1 --2- 172.21.15.132:0/30155004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f141611b0 0x7f3f14154d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:41.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.858+0000 7f3f12ffd640 1 -- 172.21.15.132:0/30155004 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c0094d0 con 0x7f3f140b5090 2023-12-20T04:43:41.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.858+0000 7f3f127fc640 1 --2- 172.21.15.132:0/30155004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f14160450 0x7f3f1415ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:41.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.858+0000 7f3f12ffd640 1 --2- 172.21.15.132:0/30155004 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140b5090 0x7f3f140c9440 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3f04007ef0 tx=0x7f3f0400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:41.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.858+0000 7f3f0bfff640 1 -- 172.21.15.132:0/30155004 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04014620 con 0x7f3f140b5090 2023-12-20T04:43:41.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.858+0000 7f3f0bfff640 1 -- 172.21.15.132:0/30155004 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f04014780 con 0x7f3f140b5090 2023-12-20T04:43:41.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.858+0000 7f3f19939640 1 -- 172.21.15.132:0/30155004 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1415b5d0 con 0x7f3f140b5090 2023-12-20T04:43:41.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.858+0000 7f3f0bfff640 1 -- 172.21.15.132:0/30155004 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04014b30 con 0x7f3f140b5090 2023-12-20T04:43:41.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.858+0000 7f3f19939640 1 -- 172.21.15.132:0/30155004 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1415bb90 con 0x7f3f140b5090 2023-12-20T04:43:41.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.859+0000 7f3f19939640 1 -- 172.21.15.132:0/30155004 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f140ca4e0 con 0x7f3f140b5090 2023-12-20T04:43:41.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.859+0000 7f3f0bfff640 1 -- 172.21.15.132:0/30155004 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3f04014c90 con 0x7f3f140b5090 2023-12-20T04:43:41.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.860+0000 7f3f0bfff640 1 --2- 172.21.15.132:0/30155004 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ef406a430 0x7f3ef406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:41.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.860+0000 7f3f0bfff640 1 -- 172.21.15.132:0/30155004 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3f04088f60 con 0x7f3f140b5090 2023-12-20T04:43:41.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.860+0000 7f3f127fc640 1 --2- 172.21.15.132:0/30155004 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ef406a430 0x7f3ef406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:41.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.860+0000 7f3f127fc640 1 --2- 172.21.15.132:0/30155004 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ef406a430 0x7f3ef406c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3f140b7900 tx=0x7f3efc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:41.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:41.864+0000 7f3f0bfff640 1 -- 172.21.15.132:0/30155004 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3f040548a0 con 0x7f3f140b5090 2023-12-20T04:43:42.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.030+0000 7f3f19939640 1 -- 172.21.15.132:0/30155004 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f140c9fb0 con 0x7f3f140b5090 2023-12-20T04:43:42.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.031+0000 7f3f0bfff640 1 -- 172.21.15.132:0/30155004 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v29) v1 ==== 74+0+12437 (secure 0 0 0) 0x7f3f04057ec0 con 0x7f3f140b5090 2023-12-20T04:43:42.033 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:42.033 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":29,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:43:39.218853+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":21,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:42.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.034+0000 7f3f19939640 1 -- 172.21.15.132:0/30155004 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ef406a430 msgr2=0x7f3ef406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:42.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.034+0000 7f3f19939640 1 --2- 172.21.15.132:0/30155004 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ef406a430 0x7f3ef406c8f0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3f140b7900 tx=0x7f3efc008040 comp rx=0 tx=0).stop 2023-12-20T04:43:42.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.034+0000 7f3f19939640 1 -- 172.21.15.132:0/30155004 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140b5090 msgr2=0x7f3f140c9440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:42.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.034+0000 7f3f19939640 1 --2- 172.21.15.132:0/30155004 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140b5090 0x7f3f140c9440 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f3f04007ef0 tx=0x7f3f0400e4b0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.034+0000 7f3f19939640 1 -- 172.21.15.132:0/30155004 shutdown_connections 2023-12-20T04:43:42.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.034+0000 7f3f19939640 1 --2- 172.21.15.132:0/30155004 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ef406a430 0x7f3ef406c8f0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.034+0000 7f3f19939640 1 --2- 172.21.15.132:0/30155004 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f141611b0 0x7f3f14154d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.034+0000 7f3f19939640 1 --2- 172.21.15.132:0/30155004 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f14160450 0x7f3f1415ae90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.034+0000 7f3f19939640 1 --2- 172.21.15.132:0/30155004 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140b5090 0x7f3f140c9440 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.035+0000 7f3f19939640 1 -- 172.21.15.132:0/30155004 >> 172.21.15.132:0/30155004 conn(0x7f3f140cf980 msgr2=0x7f3f1415c7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:42.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.035+0000 7f3f19939640 1 -- 172.21.15.132:0/30155004 shutdown_connections 2023-12-20T04:43:42.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.035+0000 7f3f19939640 1 -- 172.21.15.132:0/30155004 wait complete. 2023-12-20T04:43:42.048 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:43:42.048 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:43:42.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.149+0000 7f30cbdab640 1 Processor -- start 2023-12-20T04:43:42.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.149+0000 7f30cbdab640 1 -- start start 2023-12-20T04:43:42.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.150+0000 7f30cbdab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f30c415cf20 0x7f30c406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.150+0000 7f30cbdab640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f30c415d300 0x7f30c4161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.150+0000 7f30cbdab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c40cd4b0 0x7f30c40cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.150+0000 7f30cbdab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c40cde60 con 0x7f30c415cf20 2023-12-20T04:43:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.150+0000 7f30cbdab640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30c4161c40 con 0x7f30c415d300 2023-12-20T04:43:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.150+0000 7f30cbdab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c406cc90 con 0x7f30c40cd4b0 2023-12-20T04:43:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.150+0000 7f30c9b47640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f30c415cf20 0x7f30c406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.150+0000 7f30c9b47640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f30c415cf20 0x7f30c406c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35464/0 (socket says 172.21.15.132:35464) 2023-12-20T04:43:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.150+0000 7f30c9b47640 1 -- 172.21.15.132:0/700790383 learned_addr learned my addr 172.21.15.132:0/700790383 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.151+0000 7f30c9b47640 1 -- 172.21.15.132:0/700790383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c40cd4b0 msgr2=0x7f30c40cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.151+0000 7f30c9b47640 1 --2- 172.21.15.132:0/700790383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c40cd4b0 0x7f30c40cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.151+0000 7f30c9b47640 1 -- 172.21.15.132:0/700790383 >> v2:172.21.15.187:3300/0 conn(0x7f30c415d300 msgr2=0x7f30c4161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.151+0000 7f30c9346640 1 --2- 172.21.15.132:0/700790383 >> v2:172.21.15.187:3300/0 conn(0x7f30c415d300 0x7f30c4161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.151+0000 7f30c9b47640 1 --2- 172.21.15.132:0/700790383 >> v2:172.21.15.187:3300/0 conn(0x7f30c415d300 0x7f30c4161700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.151+0000 7f30c9b47640 1 -- 172.21.15.132:0/700790383 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c40b2f30 con 0x7f30c415cf20 2023-12-20T04:43:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.151+0000 7f30c9b47640 1 --2- 172.21.15.132:0/700790383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30c415cf20 0x7f30c406c590 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f30c4160c30 tx=0x7f30c002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7492153ef31b2107 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.151+0000 7f30c8b45640 1 -- 172.21.15.132:0/700790383 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c002ca70 con 0x7f30c415cf20 2023-12-20T04:43:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.151+0000 7f30c8b45640 1 -- 172.21.15.132:0/700790383 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30c002cbd0 con 0x7f30c415cf20 2023-12-20T04:43:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.152+0000 7f30c8b45640 1 -- 172.21.15.132:0/700790383 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30c00343f0 con 0x7f30c415cf20 2023-12-20T04:43:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.152+0000 7f30cbdab640 1 -- 172.21.15.132:0/700790383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30c415cf20 msgr2=0x7f30c406c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.152+0000 7f30cbdab640 1 --2- 172.21.15.132:0/700790383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30c415cf20 0x7f30c406c590 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f30c4160c30 tx=0x7f30c002bed0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.152+0000 7f30cbdab640 1 -- 172.21.15.132:0/700790383 shutdown_connections 2023-12-20T04:43:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.152+0000 7f30cbdab640 1 --2- 172.21.15.132:0/700790383 >> v2:172.21.15.187:3300/0 conn(0x7f30c415d300 0x7f30c4161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.152+0000 7f30cbdab640 1 --2- 172.21.15.132:0/700790383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c40cd4b0 0x7f30c40cd920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.152+0000 7f30cbdab640 1 --2- 172.21.15.132:0/700790383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30c415cf20 0x7f30c406c590 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.152+0000 7f30cbdab640 1 -- 172.21.15.132:0/700790383 >> 172.21.15.132:0/700790383 conn(0x7f30c4072c60 msgr2=0x7f30c4073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.152+0000 7f30cbdab640 1 -- 172.21.15.132:0/700790383 shutdown_connections 2023-12-20T04:43:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.152+0000 7f30cbdab640 1 -- 172.21.15.132:0/700790383 wait complete. 2023-12-20T04:43:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.153+0000 7f30cbdab640 1 Processor -- start 2023-12-20T04:43:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.153+0000 7f30cbdab640 1 -- start start 2023-12-20T04:43:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.154+0000 7f30cbdab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30c40cd4b0 0x7f30c4159310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.154+0000 7f30cbdab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c415cf20 0x7f30c40addd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.154+0000 7f30cbdab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30c415d300 0x7f30c40c5b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.154+0000 7f30cbdab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40c5970 con 0x7f30c415d300 2023-12-20T04:43:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.154+0000 7f30cbdab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30c40af0c0 con 0x7f30c40cd4b0 2023-12-20T04:43:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.154+0000 7f30cbdab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30c4159850 con 0x7f30c415cf20 2023-12-20T04:43:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.154+0000 7f30ca348640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30c415d300 0x7f30c40c5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.154+0000 7f30ca348640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30c415d300 0x7f30c40c5b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35468/0 (socket says 172.21.15.132:35468) 2023-12-20T04:43:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.154+0000 7f30ca348640 1 -- 172.21.15.132:0/1626985771 learned_addr learned my addr 172.21.15.132:0/1626985771 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:42.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.154+0000 7f30c9b47640 1 --2- 172.21.15.132:0/1626985771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30c40cd4b0 0x7f30c4159310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.154+0000 7f30c9346640 1 --2- 172.21.15.132:0/1626985771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c415cf20 0x7f30c40addd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.154+0000 7f30ca348640 1 -- 172.21.15.132:0/1626985771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c415cf20 msgr2=0x7f30c40addd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:42.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.154+0000 7f30ca348640 1 --2- 172.21.15.132:0/1626985771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c415cf20 0x7f30c40addd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.154+0000 7f30ca348640 1 -- 172.21.15.132:0/1626985771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30c40cd4b0 msgr2=0x7f30c4159310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:42.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.154+0000 7f30ca348640 1 --2- 172.21.15.132:0/1626985771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30c40cd4b0 0x7f30c4159310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.154+0000 7f30ca348640 1 -- 172.21.15.132:0/1626985771 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30c0009b30 con 0x7f30c415d300 2023-12-20T04:43:42.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.154+0000 7f30c9346640 1 --2- 172.21.15.132:0/1626985771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c415cf20 0x7f30c40addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:42.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.155+0000 7f30ca348640 1 --2- 172.21.15.132:0/1626985771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30c415d300 0x7f30c40c5b60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f30bc009fd0 tx=0x7f30bc00b8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:42.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.155+0000 7f30ba7fc640 1 -- 172.21.15.132:0/1626985771 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc011830 con 0x7f30c415d300 2023-12-20T04:43:42.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.155+0000 7f30ba7fc640 1 -- 172.21.15.132:0/1626985771 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30bc011990 con 0x7f30c415d300 2023-12-20T04:43:42.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.155+0000 7f30cbdab640 1 -- 172.21.15.132:0/1626985771 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30c40ae310 con 0x7f30c415d300 2023-12-20T04:43:42.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.155+0000 7f30ba7fc640 1 -- 172.21.15.132:0/1626985771 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f30bc011d20 con 0x7f30c415d300 2023-12-20T04:43:42.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.155+0000 7f30cbdab640 1 -- 172.21.15.132:0/1626985771 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30c40af5f0 con 0x7f30c415d300 2023-12-20T04:43:42.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.156+0000 7f30cbdab640 1 -- 172.21.15.132:0/1626985771 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30c404e840 con 0x7f30c415d300 2023-12-20T04:43:42.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.156+0000 7f30ba7fc640 1 -- 172.21.15.132:0/1626985771 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f30bc01b460 con 0x7f30c415d300 2023-12-20T04:43:42.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.156+0000 7f30ba7fc640 1 --2- 172.21.15.132:0/1626985771 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f30a806a430 0x7f30a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.157+0000 7f30ba7fc640 1 -- 172.21.15.132:0/1626985771 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f30bc088360 con 0x7f30c415d300 2023-12-20T04:43:42.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.157+0000 7f30c9b47640 1 --2- 172.21.15.132:0/1626985771 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f30a806a430 0x7f30a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.157+0000 7f30c9b47640 1 --2- 172.21.15.132:0/1626985771 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f30a806a430 0x7f30a806c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f30c0035000 tx=0x7f30c0030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:42.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.161+0000 7f30ba7fc640 1 -- 172.21.15.132:0/1626985771 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f30bc053c10 con 0x7f30c415d300 2023-12-20T04:43:42.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.325+0000 7f30cbdab640 1 -- 172.21.15.132:0/1626985771 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f30c40b2890 con 0x7f30c415d300 2023-12-20T04:43:42.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.326+0000 7f30ba7fc640 1 -- 172.21.15.132:0/1626985771 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v29) v1 ==== 93+0+10 (secure 0 0 0) 0x7f30bc057230 con 0x7f30c415d300 2023-12-20T04:43:42.328 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:43:42.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.328+0000 7f30cbdab640 1 -- 172.21.15.132:0/1626985771 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f30a806a430 msgr2=0x7f30a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:42.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.328+0000 7f30cbdab640 1 --2- 172.21.15.132:0/1626985771 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f30a806a430 0x7f30a806c8f0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f30c0035000 tx=0x7f30c0030000 comp rx=0 tx=0).stop 2023-12-20T04:43:42.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.328+0000 7f30cbdab640 1 -- 172.21.15.132:0/1626985771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30c415d300 msgr2=0x7f30c40c5b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:42.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.328+0000 7f30cbdab640 1 --2- 172.21.15.132:0/1626985771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30c415d300 0x7f30c40c5b60 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f30bc009fd0 tx=0x7f30bc00b8e0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.328+0000 7f30cbdab640 1 -- 172.21.15.132:0/1626985771 shutdown_connections 2023-12-20T04:43:42.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.328+0000 7f30cbdab640 1 --2- 172.21.15.132:0/1626985771 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f30a806a430 0x7f30a806c8f0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.328+0000 7f30cbdab640 1 --2- 172.21.15.132:0/1626985771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30c415d300 0x7f30c40c5b60 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.328+0000 7f30cbdab640 1 --2- 172.21.15.132:0/1626985771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30c415cf20 0x7f30c40addd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.328+0000 7f30cbdab640 1 --2- 172.21.15.132:0/1626985771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f30c40cd4b0 0x7f30c4159310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.328+0000 7f30cbdab640 1 -- 172.21.15.132:0/1626985771 >> 172.21.15.132:0/1626985771 conn(0x7f30c4072c60 msgr2=0x7f30c40afd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:42.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.328+0000 7f30cbdab640 1 -- 172.21.15.132:0/1626985771 shutdown_connections 2023-12-20T04:43:42.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.328+0000 7f30cbdab640 1 -- 172.21.15.132:0/1626985771 wait complete. 2023-12-20T04:43:42.341 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-20T04:43:42.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.439+0000 7fd58638b640 1 Processor -- start 2023-12-20T04:43:42.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.439+0000 7fd58638b640 1 -- start start 2023-12-20T04:43:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.440+0000 7fd58638b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd580159bb0 0x7fd58006f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.440+0000 7fd58638b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd58006bba0 0x7fd5800ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.440+0000 7fd58638b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd58006c8e0 con 0x7fd5800ad720 2023-12-20T04:43:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.440+0000 7fd58638b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd58015e420 con 0x7fd580159bb0 2023-12-20T04:43:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.440+0000 7fd58638b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd58015e700 con 0x7fd58006bba0 2023-12-20T04:43:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.440+0000 7fd57ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd580159bb0 0x7fd58006f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.440+0000 7fd57f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd5800ad720 0x7fd58006b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52486/0 (socket says 172.21.15.132:52486) 2023-12-20T04:43:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.440+0000 7fd57ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd580159bb0 0x7fd58006f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35482/0 (socket says 172.21.15.132:35482) 2023-12-20T04:43:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.440+0000 7fd57f7fe640 1 -- 172.21.15.132:0/299965075 learned_addr learned my addr 172.21.15.132:0/299965075 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.440+0000 7fd57ffff640 1 -- 172.21.15.132:0/299965075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd58006bba0 msgr2=0x7fd5800ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.440+0000 7fd584928640 1 --2- 172.21.15.132:0/299965075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd58006bba0 0x7fd5800ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.440+0000 7fd57ffff640 1 --2- 172.21.15.132:0/299965075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd58006bba0 0x7fd5800ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.440+0000 7fd57effd640 1 -- 172.21.15.132:0/299965075 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3115873709 0 0) 0x7fd58006c8e0 con 0x7fd5800ad720 2023-12-20T04:43:42.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.440+0000 7fd57ffff640 1 -- 172.21.15.132:0/299965075 >> v1:172.21.15.132:6789/0 conn(0x7fd5800ad720 legacy=0x7fd58006b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:42.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.440+0000 7fd57ffff640 1 -- 172.21.15.132:0/299965075 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5800c9d10 con 0x7fd580159bb0 2023-12-20T04:43:42.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.441+0000 7fd57ffff640 1 --2- 172.21.15.132:0/299965075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd580159bb0 0x7fd58006f3e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd5700097a0 tx=0x7fd57002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1135db7a88e17437 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:42.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.441+0000 7fd57effd640 1 -- 172.21.15.132:0/299965075 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570031830 con 0x7fd580159bb0 2023-12-20T04:43:42.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.441+0000 7fd57effd640 1 -- 172.21.15.132:0/299965075 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd570031990 con 0x7fd580159bb0 2023-12-20T04:43:42.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.441+0000 7fd57effd640 1 -- 172.21.15.132:0/299965075 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570031d20 con 0x7fd580159bb0 2023-12-20T04:43:42.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.442+0000 7fd58638b640 1 -- 172.21.15.132:0/299965075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd580159bb0 msgr2=0x7fd58006f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:42.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.442+0000 7fd58638b640 1 --2- 172.21.15.132:0/299965075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd580159bb0 0x7fd58006f3e0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd5700097a0 tx=0x7fd57002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.442+0000 7fd58638b640 1 -- 172.21.15.132:0/299965075 shutdown_connections 2023-12-20T04:43:42.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.442+0000 7fd58638b640 1 --2- 172.21.15.132:0/299965075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd58006bba0 0x7fd5800ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.442+0000 7fd58638b640 1 --2- 172.21.15.132:0/299965075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd580159bb0 0x7fd58006f3e0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.442+0000 7fd58638b640 1 -- 172.21.15.132:0/299965075 >> 172.21.15.132:0/299965075 conn(0x7fd58006a260 msgr2=0x7fd5800b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:42.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.442+0000 7fd58638b640 1 -- 172.21.15.132:0/299965075 shutdown_connections 2023-12-20T04:43:42.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.442+0000 7fd58638b640 1 -- 172.21.15.132:0/299965075 wait complete. 2023-12-20T04:43:42.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.443+0000 7fd58638b640 1 Processor -- start 2023-12-20T04:43:42.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.443+0000 7fd58638b640 1 -- start start 2023-12-20T04:43:42.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd58638b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd58006bba0 0x7fd5800b4100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd58638b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5800ad720 0x7fd580157060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd58638b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd580159bb0 0x7fd5801575a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd58638b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd580157ae0 con 0x7fd58006bba0 2023-12-20T04:43:42.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd58638b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd580157fd0 con 0x7fd5800ad720 2023-12-20T04:43:42.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd58638b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd580157cf0 con 0x7fd580159bb0 2023-12-20T04:43:42.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd57ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd58006bba0 0x7fd5800b4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd57ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd58006bba0 0x7fd5800b4100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35496/0 (socket says 172.21.15.132:35496) 2023-12-20T04:43:42.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd57ffff640 1 -- 172.21.15.132:0/2978617778 learned_addr learned my addr 172.21.15.132:0/2978617778 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:42.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd57f7fe640 1 --2- 172.21.15.132:0/2978617778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5800ad720 0x7fd580157060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd584928640 1 --2- 172.21.15.132:0/2978617778 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd580159bb0 0x7fd5801575a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd57ffff640 1 -- 172.21.15.132:0/2978617778 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd580159bb0 msgr2=0x7fd5801575a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:42.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd57ffff640 1 --2- 172.21.15.132:0/2978617778 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd580159bb0 0x7fd5801575a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd57ffff640 1 -- 172.21.15.132:0/2978617778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5800ad720 msgr2=0x7fd580157060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:42.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd57ffff640 1 --2- 172.21.15.132:0/2978617778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5800ad720 0x7fd580157060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd57ffff640 1 -- 172.21.15.132:0/2978617778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd570009400 con 0x7fd58006bba0 2023-12-20T04:43:42.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd584928640 1 --2- 172.21.15.132:0/2978617778 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd580159bb0 0x7fd5801575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:42.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd57f7fe640 1 --2- 172.21.15.132:0/2978617778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5800ad720 0x7fd580157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:42.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd57ffff640 1 --2- 172.21.15.132:0/2978617778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd58006bba0 0x7fd5800b4100 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd570000c00 tx=0x7fd5700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:42.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd57cff9640 1 -- 172.21.15.132:0/2978617778 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd570004230 con 0x7fd58006bba0 2023-12-20T04:43:42.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.444+0000 7fd57cff9640 1 -- 172.21.15.132:0/2978617778 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd570004390 con 0x7fd58006bba0 2023-12-20T04:43:42.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.445+0000 7fd58638b640 1 -- 172.21.15.132:0/2978617778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5800b17f0 con 0x7fd58006bba0 2023-12-20T04:43:42.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.445+0000 7fd57cff9640 1 -- 172.21.15.132:0/2978617778 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd57003a910 con 0x7fd58006bba0 2023-12-20T04:43:42.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.445+0000 7fd58638b640 1 -- 172.21.15.132:0/2978617778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5800b1db0 con 0x7fd58006bba0 2023-12-20T04:43:42.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.445+0000 7fd58638b640 1 -- 172.21.15.132:0/2978617778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5800b1fa0 con 0x7fd58006bba0 2023-12-20T04:43:42.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.446+0000 7fd57cff9640 1 -- 172.21.15.132:0/2978617778 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd57003aa70 con 0x7fd58006bba0 2023-12-20T04:43:42.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.446+0000 7fd57cff9640 1 --2- 172.21.15.132:0/2978617778 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd56c06a430 0x7fd56c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.446+0000 7fd57cff9640 1 -- 172.21.15.132:0/2978617778 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd5700aa830 con 0x7fd58006bba0 2023-12-20T04:43:42.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.446+0000 7fd57f7fe640 1 --2- 172.21.15.132:0/2978617778 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd56c06a430 0x7fd56c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.447+0000 7fd57f7fe640 1 --2- 172.21.15.132:0/2978617778 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd56c06a430 0x7fd56c06c8f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd5800b04c0 tx=0x7fd574007c10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:42.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.450+0000 7fd57cff9640 1 -- 172.21.15.132:0/2978617778 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd570076200 con 0x7fd58006bba0 2023-12-20T04:43:42.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.620+0000 7fd58638b640 1 -- 172.21.15.132:0/2978617778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fd58004e840 con 0x7fd58006bba0 2023-12-20T04:43:42.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.620+0000 7fd57cff9640 1 -- 172.21.15.132:0/2978617778 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v29) v1 ==== 84+0+65 (secure 0 0 0) 0x7fd570035090 con 0x7fd58006bba0 2023-12-20T04:43:42.622 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:42.623 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-12-20T04:43:42.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:42.623 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-12-20T04:43:42.623 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-12-20T04:43:42.623 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:42.623 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-12-20T04:43:42.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.622+0000 7fd58638b640 1 -- 172.21.15.132:0/2978617778 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd56c06a430 msgr2=0x7fd56c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:42.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.622+0000 7fd58638b640 1 --2- 172.21.15.132:0/2978617778 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd56c06a430 0x7fd56c06c8f0 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fd5800b04c0 tx=0x7fd574007c10 comp rx=0 tx=0).stop 2023-12-20T04:43:42.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.622+0000 7fd58638b640 1 -- 172.21.15.132:0/2978617778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd58006bba0 msgr2=0x7fd5800b4100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:42.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.622+0000 7fd58638b640 1 --2- 172.21.15.132:0/2978617778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd58006bba0 0x7fd5800b4100 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd570000c00 tx=0x7fd5700046c0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.622+0000 7fd58638b640 1 -- 172.21.15.132:0/2978617778 shutdown_connections 2023-12-20T04:43:42.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.622+0000 7fd58638b640 1 --2- 172.21.15.132:0/2978617778 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd56c06a430 0x7fd56c06c8f0 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.622+0000 7fd58638b640 1 --2- 172.21.15.132:0/2978617778 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd580159bb0 0x7fd5801575a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.622+0000 7fd58638b640 1 --2- 172.21.15.132:0/2978617778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5800ad720 0x7fd580157060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.622+0000 7fd58638b640 1 --2- 172.21.15.132:0/2978617778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd58006bba0 0x7fd5800b4100 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.622+0000 7fd58638b640 1 -- 172.21.15.132:0/2978617778 >> 172.21.15.132:0/2978617778 conn(0x7fd58006a260 msgr2=0x7fd58006f9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:42.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.622+0000 7fd58638b640 1 -- 172.21.15.132:0/2978617778 shutdown_connections 2023-12-20T04:43:42.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.622+0000 7fd58638b640 1 -- 172.21.15.132:0/2978617778 wait complete. 2023-12-20T04:43:42.635 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-20T04:43:42.635 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-20T04:43:42.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.736+0000 7f571b451640 1 Processor -- start 2023-12-20T04:43:42.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.736+0000 7f571b451640 1 -- start start 2023-12-20T04:43:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.737+0000 7f571b451640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f57140cb3a0 0x7f57140cb830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.737+0000 7f571b451640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57140cc660 0x7f57140ccaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.737+0000 7f571b451640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5714153eb0 con 0x7f5714153ad0 2023-12-20T04:43:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.737+0000 7f571b451640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5714159a00 con 0x7f57140cb3a0 2023-12-20T04:43:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.737+0000 7f571b451640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57140c9d30 con 0x7f57140cc660 2023-12-20T04:43:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.737+0000 7f57189ec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f57140cb3a0 0x7f57140cb830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.737+0000 7f57191ed640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5714153ad0 0x7f57140c9200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52498/0 (socket says 172.21.15.132:52498) 2023-12-20T04:43:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.737+0000 7f57191ed640 1 -- 172.21.15.132:0/564585144 learned_addr learned my addr 172.21.15.132:0/564585144 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.737+0000 7f57199ee640 1 --2- 172.21.15.132:0/564585144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57140cc660 0x7f57140ccaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.737+0000 7f57189ec640 1 -- 172.21.15.132:0/564585144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57140cc660 msgr2=0x7f57140ccaf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.737+0000 7f57189ec640 1 --2- 172.21.15.132:0/564585144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57140cc660 0x7f57140ccaf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.737+0000 7f57189ec640 1 -- 172.21.15.132:0/564585144 >> v1:172.21.15.132:6789/0 conn(0x7f5714153ad0 legacy=0x7f57140c9200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:42.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.737+0000 7f57189ec640 1 -- 172.21.15.132:0/564585144 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5714159cc0 con 0x7f57140cb3a0 2023-12-20T04:43:42.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.737+0000 7f570bfff640 1 -- 172.21.15.132:0/564585144 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 412250984 0 0) 0x7f5714153eb0 con 0x7f5714153ad0 2023-12-20T04:43:42.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.738+0000 7f57189ec640 1 --2- 172.21.15.132:0/564585144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57140cb3a0 0x7f57140cb830 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f57040097a0 tx=0x7f570402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f351de223a59a932 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:42.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.738+0000 7f570bfff640 1 -- 172.21.15.132:0/564585144 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704031830 con 0x7f57140cb3a0 2023-12-20T04:43:42.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.738+0000 7f570bfff640 1 -- 172.21.15.132:0/564585144 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5704031990 con 0x7f57140cb3a0 2023-12-20T04:43:42.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.738+0000 7f570bfff640 1 -- 172.21.15.132:0/564585144 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5704031d20 con 0x7f57140cb3a0 2023-12-20T04:43:42.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.739+0000 7f571b451640 1 -- 172.21.15.132:0/564585144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57140cb3a0 msgr2=0x7f57140cb830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.739+0000 7f571b451640 1 --2- 172.21.15.132:0/564585144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57140cb3a0 0x7f57140cb830 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f57040097a0 tx=0x7f570402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.739+0000 7f571b451640 1 -- 172.21.15.132:0/564585144 shutdown_connections 2023-12-20T04:43:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.739+0000 7f571b451640 1 --2- 172.21.15.132:0/564585144 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57140cc660 0x7f57140ccaf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.739+0000 7f571b451640 1 --2- 172.21.15.132:0/564585144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57140cb3a0 0x7f57140cb830 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.739+0000 7f571b451640 1 -- 172.21.15.132:0/564585144 >> 172.21.15.132:0/564585144 conn(0x7f57140b05c0 msgr2=0x7f57140b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.739+0000 7f571b451640 1 -- 172.21.15.132:0/564585144 shutdown_connections 2023-12-20T04:43:42.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.739+0000 7f571b451640 1 -- 172.21.15.132:0/564585144 wait complete. 2023-12-20T04:43:42.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.740+0000 7f571b451640 1 Processor -- start 2023-12-20T04:43:42.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.740+0000 7f571b451640 1 -- start start 2023-12-20T04:43:42.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f571b451640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57140cb3a0 0x7f5714151c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f571b451640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57140cc660 0x7f57140acea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f571b451640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5714153ad0 0x7f571415ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f571b451640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57140b2930 con 0x7f57140cb3a0 2023-12-20T04:43:42.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f571b451640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57140b2600 con 0x7f57140cc660 2023-12-20T04:43:42.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f571b451640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57140c3000 con 0x7f5714153ad0 2023-12-20T04:43:42.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f57191ed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57140cb3a0 0x7f5714151c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f57191ed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57140cb3a0 0x7f5714151c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35518/0 (socket says 172.21.15.132:35518) 2023-12-20T04:43:42.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f57191ed640 1 -- 172.21.15.132:0/702207167 learned_addr learned my addr 172.21.15.132:0/702207167 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:42.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f57191ed640 1 -- 172.21.15.132:0/702207167 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5714153ad0 msgr2=0x7f571415ade0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:42.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f57189ec640 1 --2- 172.21.15.132:0/702207167 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57140cc660 0x7f57140acea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f57199ee640 1 --2- 172.21.15.132:0/702207167 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5714153ad0 0x7f571415ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f57191ed640 1 --2- 172.21.15.132:0/702207167 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5714153ad0 0x7f571415ade0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f57191ed640 1 -- 172.21.15.132:0/702207167 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57140cc660 msgr2=0x7f57140acea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:42.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f57191ed640 1 --2- 172.21.15.132:0/702207167 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57140cc660 0x7f57140acea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:42.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f57191ed640 1 -- 172.21.15.132:0/702207167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5704009400 con 0x7f57140cb3a0 2023-12-20T04:43:42.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f57189ec640 1 --2- 172.21.15.132:0/702207167 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57140cc660 0x7f57140acea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:42.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f57199ee640 1 --2- 172.21.15.132:0/702207167 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5714153ad0 0x7f571415ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:42.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.741+0000 7f57191ed640 1 --2- 172.21.15.132:0/702207167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57140cb3a0 0x7f5714151c30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f571000c890 tx=0x7f571000cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:42.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.742+0000 7f5709ffb640 1 -- 172.21.15.132:0/702207167 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571000a640 con 0x7f57140cb3a0 2023-12-20T04:43:42.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.742+0000 7f5709ffb640 1 -- 172.21.15.132:0/702207167 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f571000a7c0 con 0x7f57140cb3a0 2023-12-20T04:43:42.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.742+0000 7f571b451640 1 -- 172.21.15.132:0/702207167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57140c32e0 con 0x7f57140cb3a0 2023-12-20T04:43:42.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.742+0000 7f5709ffb640 1 -- 172.21.15.132:0/702207167 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f571000ab70 con 0x7f57140cb3a0 2023-12-20T04:43:42.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.742+0000 7f571b451640 1 -- 172.21.15.132:0/702207167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5714152170 con 0x7f57140cb3a0 2023-12-20T04:43:42.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.743+0000 7f571b451640 1 -- 172.21.15.132:0/702207167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f571404e840 con 0x7f57140cb3a0 2023-12-20T04:43:42.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.743+0000 7f5709ffb640 1 -- 172.21.15.132:0/702207167 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f571000acd0 con 0x7f57140cb3a0 2023-12-20T04:43:42.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.743+0000 7f5709ffb640 1 --2- 172.21.15.132:0/702207167 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f56f806a430 0x7f56f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:42.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.744+0000 7f57189ec640 1 --2- 172.21.15.132:0/702207167 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f56f806a430 0x7f56f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:42.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.744+0000 7f5709ffb640 1 -- 172.21.15.132:0/702207167 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(29..29 src has 1..29) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5710087e00 con 0x7f57140cb3a0 2023-12-20T04:43:42.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.744+0000 7f57189ec640 1 --2- 172.21.15.132:0/702207167 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f56f806a430 0x7f56f806c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5704036000 tx=0x7f570403c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:42.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.748+0000 7f5709ffb640 1 -- 172.21.15.132:0/702207167 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f57100537d0 con 0x7f57140cb3a0 2023-12-20T04:43:42.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:42.913+0000 7f571b451640 1 -- 172.21.15.132:0/702207167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f57140b0d40 con 0x7f57140cb3a0 2023-12-20T04:43:43.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.043+0000 7f5709ffb640 1 -- 172.21.15.132:0/702207167 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v30) v1 ==== 138+0+0 (secure 0 0 0) 0x7f57100180b0 con 0x7f57140cb3a0 2023-12-20T04:43:43.045 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2023-12-20T04:43:43.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.046+0000 7f571b451640 1 -- 172.21.15.132:0/702207167 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f56f806a430 msgr2=0x7f56f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:43.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.047+0000 7f571b451640 1 --2- 172.21.15.132:0/702207167 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f56f806a430 0x7f56f806c8f0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5704036000 tx=0x7f570403c040 comp rx=0 tx=0).stop 2023-12-20T04:43:43.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.047+0000 7f571b451640 1 -- 172.21.15.132:0/702207167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57140cb3a0 msgr2=0x7f5714151c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:43.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.047+0000 7f571b451640 1 --2- 172.21.15.132:0/702207167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57140cb3a0 0x7f5714151c30 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f571000c890 tx=0x7f571000cd50 comp rx=0 tx=0).stop 2023-12-20T04:43:43.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.047+0000 7f571b451640 1 -- 172.21.15.132:0/702207167 shutdown_connections 2023-12-20T04:43:43.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.047+0000 7f571b451640 1 --2- 172.21.15.132:0/702207167 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f56f806a430 0x7f56f806c8f0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:43.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.047+0000 7f571b451640 1 --2- 172.21.15.132:0/702207167 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5714153ad0 0x7f571415ade0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:43.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.047+0000 7f571b451640 1 --2- 172.21.15.132:0/702207167 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57140cc660 0x7f57140acea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:43.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.047+0000 7f571b451640 1 --2- 172.21.15.132:0/702207167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57140cb3a0 0x7f5714151c30 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:43.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.047+0000 7f571b451640 1 -- 172.21.15.132:0/702207167 >> 172.21.15.132:0/702207167 conn(0x7f57140b05c0 msgr2=0x7f57141532d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:43.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.047+0000 7f571b451640 1 -- 172.21.15.132:0/702207167 shutdown_connections 2023-12-20T04:43:43.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.047+0000 7f571b451640 1 -- 172.21.15.132:0/702207167 wait complete. 2023-12-20T04:43:43.060 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-20T04:43:43.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.166+0000 7fa3b69d9640 1 Processor -- start 2023-12-20T04:43:43.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.166+0000 7fa3b69d9640 1 -- start start 2023-12-20T04:43:43.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.167+0000 7fa3b69d9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa3b015cf60 0x7fa3b0161520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:43.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.167+0000 7fa3b69d9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3b0072c60 0x7fa3b006bb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:43.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.167+0000 7fa3b69d9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3b0161a60 con 0x7fa3b006c0d0 2023-12-20T04:43:43.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.167+0000 7fa3b69d9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3b006cca0 con 0x7fa3b015cf60 2023-12-20T04:43:43.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.167+0000 7fa3b69d9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b006c540 con 0x7fa3b0072c60 2023-12-20T04:43:43.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.167+0000 7fa3affff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa3b015cf60 0x7fa3b0161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:43.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.167+0000 7fa3affff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa3b015cf60 0x7fa3b0161520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35534/0 (socket says 172.21.15.132:35534) 2023-12-20T04:43:43.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.167+0000 7fa3affff640 1 -- 172.21.15.132:0/1393062695 learned_addr learned my addr 172.21.15.132:0/1393062695 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:43.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.167+0000 7fa3af7fe640 1 --2- 172.21.15.132:0/1393062695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3b0072c60 0x7fa3b006bb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:43.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.167+0000 7fa3affff640 1 -- 172.21.15.132:0/1393062695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3b0072c60 msgr2=0x7fa3b006bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:43.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.167+0000 7fa3affff640 1 --2- 172.21.15.132:0/1393062695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3b0072c60 0x7fa3b006bb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:43.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.167+0000 7fa3affff640 1 -- 172.21.15.132:0/1393062695 >> v1:172.21.15.187:6789/0 conn(0x7fa3b006c0d0 legacy=0x7fa3b006d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:43.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.167+0000 7fa3affff640 1 -- 172.21.15.132:0/1393062695 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3b00ad8f0 con 0x7fa3b015cf60 2023-12-20T04:43:43.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.168+0000 7fa3affff640 1 --2- 172.21.15.132:0/1393062695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3b015cf60 0x7fa3b0161520 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0009870 tx=0x7fa3a002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d50b6cc06dffd29 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:43.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.168+0000 7fa3aeffd640 1 -- 172.21.15.132:0/1393062695 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0030840 con 0x7fa3b015cf60 2023-12-20T04:43:43.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.168+0000 7fa3aeffd640 1 -- 172.21.15.132:0/1393062695 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a00309a0 con 0x7fa3b015cf60 2023-12-20T04:43:43.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.168+0000 7fa3aeffd640 1 -- 172.21.15.132:0/1393062695 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a0030d30 con 0x7fa3b015cf60 2023-12-20T04:43:43.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.168+0000 7fa3b69d9640 1 -- 172.21.15.132:0/1393062695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3b015cf60 msgr2=0x7fa3b0161520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:43.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.168+0000 7fa3b69d9640 1 --2- 172.21.15.132:0/1393062695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3b015cf60 0x7fa3b0161520 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0009870 tx=0x7fa3a002b980 comp rx=0 tx=0).stop 2023-12-20T04:43:43.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.169+0000 7fa3b69d9640 1 -- 172.21.15.132:0/1393062695 shutdown_connections 2023-12-20T04:43:43.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.169+0000 7fa3b69d9640 1 --2- 172.21.15.132:0/1393062695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3b0072c60 0x7fa3b006bb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:43.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.169+0000 7fa3b69d9640 1 --2- 172.21.15.132:0/1393062695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3b015cf60 0x7fa3b0161520 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:43.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.169+0000 7fa3b69d9640 1 -- 172.21.15.132:0/1393062695 >> 172.21.15.132:0/1393062695 conn(0x7fa3b00cf2d0 msgr2=0x7fa3b00cf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:43.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.169+0000 7fa3b69d9640 1 -- 172.21.15.132:0/1393062695 shutdown_connections 2023-12-20T04:43:43.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.169+0000 7fa3b69d9640 1 -- 172.21.15.132:0/1393062695 wait complete. 2023-12-20T04:43:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.170+0000 7fa3b69d9640 1 Processor -- start 2023-12-20T04:43:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.170+0000 7fa3b69d9640 1 -- start start 2023-12-20T04:43:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3b69d9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3b006c0d0 0x7fa3b0157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3b69d9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3b0072c60 0x7fa3b00c5780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3b69d9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3b015cf60 0x7fa3b01548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3b69d9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00c5360 con 0x7fa3b015cf60 2023-12-20T04:43:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3b69d9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b0154e00 con 0x7fa3b0072c60 2023-12-20T04:43:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3b69d9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3b00c46e0 con 0x7fa3b006c0d0 2023-12-20T04:43:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3b4f76640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3b015cf60 0x7fa3b01548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3b4f76640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3b015cf60 0x7fa3b01548c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35548/0 (socket says 172.21.15.132:35548) 2023-12-20T04:43:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3b4f76640 1 -- 172.21.15.132:0/2012843049 learned_addr learned my addr 172.21.15.132:0/2012843049 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3af7fe640 1 --2- 172.21.15.132:0/2012843049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3b0072c60 0x7fa3b00c5780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3affff640 1 --2- 172.21.15.132:0/2012843049 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3b006c0d0 0x7fa3b0157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3b4f76640 1 -- 172.21.15.132:0/2012843049 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3b006c0d0 msgr2=0x7fa3b0157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:43.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3b4f76640 1 --2- 172.21.15.132:0/2012843049 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3b006c0d0 0x7fa3b0157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:43.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3b4f76640 1 -- 172.21.15.132:0/2012843049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3b0072c60 msgr2=0x7fa3b00c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:43.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3b4f76640 1 --2- 172.21.15.132:0/2012843049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3b0072c60 0x7fa3b00c5780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:43.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3b4f76640 1 -- 172.21.15.132:0/2012843049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3a00094d0 con 0x7fa3b015cf60 2023-12-20T04:43:43.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3af7fe640 1 --2- 172.21.15.132:0/2012843049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3b0072c60 0x7fa3b00c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:43.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3b4f76640 1 --2- 172.21.15.132:0/2012843049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3b015cf60 0x7fa3b01548c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800c730 tx=0x7fa3a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:43.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3acff9640 1 -- 172.21.15.132:0/2012843049 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8003b70 con 0x7fa3b015cf60 2023-12-20T04:43:43.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3acff9640 1 -- 172.21.15.132:0/2012843049 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3a8003cf0 con 0x7fa3b015cf60 2023-12-20T04:43:43.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3acff9640 1 -- 172.21.15.132:0/2012843049 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3a8003ea0 con 0x7fa3b015cf60 2023-12-20T04:43:43.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3b69d9640 1 -- 172.21.15.132:0/2012843049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3b00c49c0 con 0x7fa3b015cf60 2023-12-20T04:43:43.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.171+0000 7fa3b69d9640 1 -- 172.21.15.132:0/2012843049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3b00c4f80 con 0x7fa3b015cf60 2023-12-20T04:43:43.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.172+0000 7fa3b69d9640 1 -- 172.21.15.132:0/2012843049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3b00c54a0 con 0x7fa3b015cf60 2023-12-20T04:43:43.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.173+0000 7fa3acff9640 1 -- 172.21.15.132:0/2012843049 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa3a8005520 con 0x7fa3b015cf60 2023-12-20T04:43:43.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.173+0000 7fa3acff9640 1 --2- 172.21.15.132:0/2012843049 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa39006a430 0x7fa39006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:43.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.173+0000 7fa3acff9640 1 -- 172.21.15.132:0/2012843049 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(30..30 src has 1..30) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fa3a8088630 con 0x7fa3b015cf60 2023-12-20T04:43:43.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.173+0000 7fa3affff640 1 --2- 172.21.15.132:0/2012843049 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa39006a430 0x7fa39006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:43.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.174+0000 7fa3affff640 1 --2- 172.21.15.132:0/2012843049 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa39006a430 0x7fa39006c8f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0036000 tx=0x7fa3a0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:43.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.178+0000 7fa3acff9640 1 -- 172.21.15.132:0/2012843049 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa3b00c54a0 con 0x7fa3b015cf60 2023-12-20T04:43:43.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:43.343+0000 7fa3b69d9640 1 -- 172.21.15.132:0/2012843049 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fa3b00c54a0 con 0x7fa3b015cf60 2023-12-20T04:43:44.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.049+0000 7fa3acff9640 1 -- 172.21.15.132:0/2012843049 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v31) v1 ==== 170+0+0 (secure 0 0 0) 0x7fa3b00c54a0 con 0x7fa3b015cf60 2023-12-20T04:43:44.051 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2023-12-20T04:43:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.055+0000 7fa3b69d9640 1 -- 172.21.15.132:0/2012843049 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa39006a430 msgr2=0x7fa39006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.055+0000 7fa3b69d9640 1 --2- 172.21.15.132:0/2012843049 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa39006a430 0x7fa39006c8f0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7fa3a0036000 tx=0x7fa3a0008030 comp rx=0 tx=0).stop 2023-12-20T04:43:44.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.055+0000 7fa3b69d9640 1 -- 172.21.15.132:0/2012843049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3b015cf60 msgr2=0x7fa3b01548c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.055+0000 7fa3b69d9640 1 --2- 172.21.15.132:0/2012843049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3b015cf60 0x7fa3b01548c0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fa3a800c730 tx=0x7fa3a800cbf0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.056+0000 7fa3b69d9640 1 -- 172.21.15.132:0/2012843049 shutdown_connections 2023-12-20T04:43:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.056+0000 7fa3b69d9640 1 --2- 172.21.15.132:0/2012843049 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa39006a430 0x7fa39006c8f0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.056+0000 7fa3b69d9640 1 --2- 172.21.15.132:0/2012843049 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3b015cf60 0x7fa3b01548c0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.056+0000 7fa3b69d9640 1 --2- 172.21.15.132:0/2012843049 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3b0072c60 0x7fa3b00c5780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.056+0000 7fa3b69d9640 1 --2- 172.21.15.132:0/2012843049 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3b006c0d0 0x7fa3b0157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.056+0000 7fa3b69d9640 1 -- 172.21.15.132:0/2012843049 >> 172.21.15.132:0/2012843049 conn(0x7fa3b00cf2d0 msgr2=0x7fa3b0161280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.056+0000 7fa3b69d9640 1 -- 172.21.15.132:0/2012843049 shutdown_connections 2023-12-20T04:43:44.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.056+0000 7fa3b69d9640 1 -- 172.21.15.132:0/2012843049 wait complete. 2023-12-20T04:43:44.070 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-20T04:43:44.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.173+0000 7f9a14e0b640 1 Processor -- start 2023-12-20T04:43:44.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.174+0000 7f9a14e0b640 1 -- start start 2023-12-20T04:43:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.174+0000 7f9a14e0b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9a1015cf20 0x7f9a1006c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.174+0000 7f9a14e0b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a100cd4b0 0x7f9a100cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.174+0000 7f9a14e0b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a1006cc90 con 0x7f9a1015d300 2023-12-20T04:43:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.174+0000 7f9a14e0b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a100cde80 con 0x7f9a1015cf20 2023-12-20T04:43:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.174+0000 7f9a14e0b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100b2f30 con 0x7f9a100cd4b0 2023-12-20T04:43:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.174+0000 7f9a0e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9a1015cf20 0x7f9a1006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.175+0000 7f9a0e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9a1015cf20 0x7f9a1006c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35558/0 (socket says 172.21.15.132:35558) 2023-12-20T04:43:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.175+0000 7f9a0e59c640 1 -- 172.21.15.132:0/2682429990 learned_addr learned my addr 172.21.15.132:0/2682429990 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.175+0000 7f9a0ed9d640 1 --2- 172.21.15.132:0/2682429990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a100cd4b0 0x7f9a100cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.175+0000 7f9a0e59c640 1 -- 172.21.15.132:0/2682429990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a100cd4b0 msgr2=0x7f9a100cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.175+0000 7f9a0e59c640 1 --2- 172.21.15.132:0/2682429990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a100cd4b0 0x7f9a100cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.175+0000 7f9a0e59c640 1 -- 172.21.15.132:0/2682429990 >> v1:172.21.15.187:6789/0 conn(0x7f9a1015d300 legacy=0x7f9a10161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:44.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.175+0000 7f9a0e59c640 1 -- 172.21.15.132:0/2682429990 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a100b3210 con 0x7f9a1015cf20 2023-12-20T04:43:44.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.176+0000 7f9a0e59c640 1 --2- 172.21.15.132:0/2682429990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1015cf20 0x7f9a1006c590 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9a10071180 tx=0x7f9a0002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=560699963e81864 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:44.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.176+0000 7f9a0dd9b640 1 -- 172.21.15.132:0/2682429990 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a00031830 con 0x7f9a1015cf20 2023-12-20T04:43:44.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.176+0000 7f9a0dd9b640 1 -- 172.21.15.132:0/2682429990 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a00031990 con 0x7f9a1015cf20 2023-12-20T04:43:44.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.176+0000 7f9a0dd9b640 1 -- 172.21.15.132:0/2682429990 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a00031d20 con 0x7f9a1015cf20 2023-12-20T04:43:44.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.176+0000 7f9a14e0b640 1 -- 172.21.15.132:0/2682429990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1015cf20 msgr2=0x7f9a1006c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.176+0000 7f9a14e0b640 1 --2- 172.21.15.132:0/2682429990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1015cf20 0x7f9a1006c590 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f9a10071180 tx=0x7f9a0002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.176+0000 7f9a14e0b640 1 -- 172.21.15.132:0/2682429990 shutdown_connections 2023-12-20T04:43:44.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.176+0000 7f9a14e0b640 1 --2- 172.21.15.132:0/2682429990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a100cd4b0 0x7f9a100cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.176+0000 7f9a14e0b640 1 --2- 172.21.15.132:0/2682429990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1015cf20 0x7f9a1006c590 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.176+0000 7f9a14e0b640 1 -- 172.21.15.132:0/2682429990 >> 172.21.15.132:0/2682429990 conn(0x7f9a10072c60 msgr2=0x7f9a10073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:44.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.176+0000 7f9a14e0b640 1 -- 172.21.15.132:0/2682429990 shutdown_connections 2023-12-20T04:43:44.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.176+0000 7f9a14e0b640 1 -- 172.21.15.132:0/2682429990 wait complete. 2023-12-20T04:43:44.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.178+0000 7f9a14e0b640 1 Processor -- start 2023-12-20T04:43:44.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.178+0000 7f9a14e0b640 1 -- start start 2023-12-20T04:43:44.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.178+0000 7f9a14e0b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a100cd4b0 0x7f9a1014fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.178+0000 7f9a14e0b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1015cf20 0x7f9a100c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.178+0000 7f9a14e0b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a1015d300 0x7f9a100c5d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.178+0000 7f9a14e0b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a1015a750 con 0x7f9a1015cf20 2023-12-20T04:43:44.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.178+0000 7f9a14e0b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100af0f0 con 0x7f9a1015d300 2023-12-20T04:43:44.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.178+0000 7f9a14e0b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a100af3d0 con 0x7f9a100cd4b0 2023-12-20T04:43:44.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.178+0000 7f9a07fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1015cf20 0x7f9a100c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.178+0000 7f9a07fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1015cf20 0x7f9a100c57e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35568/0 (socket says 172.21.15.132:35568) 2023-12-20T04:43:44.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.178+0000 7f9a07fff640 1 -- 172.21.15.132:0/2847429805 learned_addr learned my addr 172.21.15.132:0/2847429805 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:44.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.179+0000 7f9a0e59c640 1 --2- 172.21.15.132:0/2847429805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a100cd4b0 0x7f9a1014fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.179+0000 7f9a0ed9d640 1 --2- 172.21.15.132:0/2847429805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a1015d300 0x7f9a100c5d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.179+0000 7f9a07fff640 1 -- 172.21.15.132:0/2847429805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a100cd4b0 msgr2=0x7f9a1014fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.179+0000 7f9a07fff640 1 --2- 172.21.15.132:0/2847429805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a100cd4b0 0x7f9a1014fe10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.179+0000 7f9a07fff640 1 -- 172.21.15.132:0/2847429805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a1015d300 msgr2=0x7f9a100c5d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.179+0000 7f9a07fff640 1 --2- 172.21.15.132:0/2847429805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a1015d300 0x7f9a100c5d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.179+0000 7f9a07fff640 1 -- 172.21.15.132:0/2847429805 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a000094d0 con 0x7f9a1015cf20 2023-12-20T04:43:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.179+0000 7f9a07fff640 1 --2- 172.21.15.132:0/2847429805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1015cf20 0x7f9a100c57e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f99f800b3f0 tx=0x7f99f800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.179+0000 7f9a06ffd640 1 -- 172.21.15.132:0/2847429805 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8011830 con 0x7f9a1015cf20 2023-12-20T04:43:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.179+0000 7f9a06ffd640 1 -- 172.21.15.132:0/2847429805 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99f8011990 con 0x7f9a1015cf20 2023-12-20T04:43:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.179+0000 7f9a14e0b640 1 -- 172.21.15.132:0/2847429805 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a100af6b0 con 0x7f9a1015cf20 2023-12-20T04:43:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.179+0000 7f9a06ffd640 1 -- 172.21.15.132:0/2847429805 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99f8011d40 con 0x7f9a1015cf20 2023-12-20T04:43:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.179+0000 7f9a14e0b640 1 -- 172.21.15.132:0/2847429805 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a100acbc0 con 0x7f9a1015cf20 2023-12-20T04:43:44.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.180+0000 7f9a14e0b640 1 -- 172.21.15.132:0/2847429805 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a100acde0 con 0x7f9a1015cf20 2023-12-20T04:43:44.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.181+0000 7f9a06ffd640 1 -- 172.21.15.132:0/2847429805 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f99f801a400 con 0x7f9a1015cf20 2023-12-20T04:43:44.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.181+0000 7f9a06ffd640 1 --2- 172.21.15.132:0/2847429805 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99f006a460 0x7f99f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.181+0000 7f9a06ffd640 1 -- 172.21.15.132:0/2847429805 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(31..31 src has 1..31) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f99f8088560 con 0x7f9a1015cf20 2023-12-20T04:43:44.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.181+0000 7f9a0e59c640 1 --2- 172.21.15.132:0/2847429805 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99f006a460 0x7f99f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.181+0000 7f9a0e59c640 1 --2- 172.21.15.132:0/2847429805 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99f006a460 0x7f99f006c920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9a00036000 tx=0x7f9a0003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:44.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.185+0000 7f9a06ffd640 1 -- 172.21.15.132:0/2847429805 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f99f8053c60 con 0x7f9a1015cf20 2023-12-20T04:43:44.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.386+0000 7f9a14e0b640 1 -- 172.21.15.132:0/2847429805 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9a1004e840 con 0x7f9a1015cf20 2023-12-20T04:43:44.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.396+0000 7f9a06ffd640 1 -- 172.21.15.132:0/2847429805 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 4 and data pool 5 v10) v1 ==== 172+0+0 (secure 0 0 0) 0x7f99f8057280 con 0x7f9a1015cf20 2023-12-20T04:43:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 4 and data pool 5 2023-12-20T04:43:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.404+0000 7f9a14e0b640 1 -- 172.21.15.132:0/2847429805 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99f006a460 msgr2=0x7f99f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.404+0000 7f9a14e0b640 1 --2- 172.21.15.132:0/2847429805 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99f006a460 0x7f99f006c920 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9a00036000 tx=0x7f9a0003c040 comp rx=0 tx=0).stop 2023-12-20T04:43:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.404+0000 7f9a14e0b640 1 -- 172.21.15.132:0/2847429805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1015cf20 msgr2=0x7f9a100c57e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.404+0000 7f9a14e0b640 1 --2- 172.21.15.132:0/2847429805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1015cf20 0x7f9a100c57e0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7f99f800b3f0 tx=0x7f99f800b8b0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.406+0000 7f9a14e0b640 1 -- 172.21.15.132:0/2847429805 shutdown_connections 2023-12-20T04:43:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.406+0000 7f9a14e0b640 1 --2- 172.21.15.132:0/2847429805 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99f006a460 0x7f99f006c920 secure :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f9a00036000 tx=0x7f9a0003c040 comp rx=0 tx=0).stop 2023-12-20T04:43:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.406+0000 7f9a14e0b640 1 --2- 172.21.15.132:0/2847429805 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a1015d300 0x7f9a100c5d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.406+0000 7f9a14e0b640 1 --2- 172.21.15.132:0/2847429805 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a1015cf20 0x7f9a100c57e0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.406+0000 7f9a14e0b640 1 --2- 172.21.15.132:0/2847429805 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a100cd4b0 0x7f9a1014fe10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.406+0000 7f9a14e0b640 1 -- 172.21.15.132:0/2847429805 >> 172.21.15.132:0/2847429805 conn(0x7f9a10072c60 msgr2=0x7f9a100ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:44.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.407+0000 7f9a14e0b640 1 -- 172.21.15.132:0/2847429805 shutdown_connections 2023-12-20T04:43:44.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.407+0000 7f9a14e0b640 1 -- 172.21.15.132:0/2847429805 wait complete. 2023-12-20T04:43:44.423 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:44.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.522+0000 7f08bdd50640 1 Processor -- start 2023-12-20T04:43:44.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.522+0000 7f08bdd50640 1 -- start start 2023-12-20T04:43:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.522+0000 7f08bdd50640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f08b80b7330 0x7f08b8168040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.522+0000 7f08bdd50640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b80d2a90 con 0x7f08b815d640 2023-12-20T04:43:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.522+0000 7f08bdd50640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f08b80d1e80 con 0x7f08b80cf910 2023-12-20T04:43:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.522+0000 7f08bdd50640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08b80d2160 con 0x7f08b80b7330 2023-12-20T04:43:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.523+0000 7f08b77fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f08b815d640 0x7f08b80d13c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52510/0 (socket says 172.21.15.132:52510) 2023-12-20T04:43:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.523+0000 7f08b77fe640 1 -- 172.21.15.132:0/2110634757 learned_addr learned my addr 172.21.15.132:0/2110634757 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.523+0000 7f08b7fff640 1 --2- 172.21.15.132:0/2110634757 >> v2:172.21.15.187:3300/0 conn(0x7f08b80b7330 0x7f08b8168040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.523+0000 7f08b6ffd640 1 -- 172.21.15.132:0/2110634757 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2302314281 0 0) 0x7f08b80d2a90 con 0x7f08b815d640 2023-12-20T04:43:44.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.523+0000 7f08b6ffd640 1 -- 172.21.15.132:0/2110634757 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f08a4003520 con 0x7f08b815d640 2023-12-20T04:43:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.523+0000 7f08b7fff640 1 -- 172.21.15.132:0/2110634757 >> v1:172.21.15.187:6789/0 conn(0x7f08b80cf910 legacy=0x7f08b80cfd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.523+0000 7f08b7fff640 1 -- 172.21.15.132:0/2110634757 >> v1:172.21.15.132:6789/0 conn(0x7f08b815d640 legacy=0x7f08b80d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.523+0000 7f08b6ffd640 1 -- 172.21.15.132:0/2110634757 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1711230900 0 0) 0x7f08a4003520 con 0x7f08b815d640 2023-12-20T04:43:44.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.523+0000 7f08b7fff640 1 -- 172.21.15.132:0/2110634757 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b80d2440 con 0x7f08b80b7330 2023-12-20T04:43:44.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.524+0000 7f08b7fff640 1 --2- 172.21.15.132:0/2110634757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b80b7330 0x7f08b8168040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009d90 tx=0x7f08b002be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d76948c7a4b0cf43 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.524+0000 7f08b6ffd640 1 -- 172.21.15.132:0/2110634757 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08a8001670 con 0x7f08b80b7330 2023-12-20T04:43:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.524+0000 7f08b6ffd640 1 -- 172.21.15.132:0/2110634757 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b002c940 con 0x7f08b80b7330 2023-12-20T04:43:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.524+0000 7f08b6ffd640 1 -- 172.21.15.132:0/2110634757 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b002ccb0 con 0x7f08b80b7330 2023-12-20T04:43:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.525+0000 7f08bdd50640 1 -- 172.21.15.132:0/2110634757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b80b7330 msgr2=0x7f08b8168040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.525+0000 7f08bdd50640 1 --2- 172.21.15.132:0/2110634757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b80b7330 0x7f08b8168040 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009d90 tx=0x7f08b002be10 comp rx=0 tx=0).stop 2023-12-20T04:43:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.525+0000 7f08bdd50640 1 -- 172.21.15.132:0/2110634757 shutdown_connections 2023-12-20T04:43:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.525+0000 7f08bdd50640 1 --2- 172.21.15.132:0/2110634757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b80b7330 0x7f08b8168040 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.525+0000 7f08bdd50640 1 -- 172.21.15.132:0/2110634757 >> 172.21.15.132:0/2110634757 conn(0x7f08b806be70 msgr2=0x7f08b806c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.525+0000 7f08bdd50640 1 -- 172.21.15.132:0/2110634757 shutdown_connections 2023-12-20T04:43:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.525+0000 7f08bdd50640 1 -- 172.21.15.132:0/2110634757 wait complete. 2023-12-20T04:43:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.526+0000 7f08bdd50640 1 Processor -- start 2023-12-20T04:43:44.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.526+0000 7f08bdd50640 1 -- start start 2023-12-20T04:43:44.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08bdd50640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b80b7330 0x7f08b8150da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08bdd50640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b80cf910 0x7f08b8151460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08bdd50640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08b815d640 0x7f08b80c8c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08bdd50640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b81519a0 con 0x7f08b815d640 2023-12-20T04:43:44.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08bdd50640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08b80c91b0 con 0x7f08b80cf910 2023-12-20T04:43:44.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08bdd50640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f08b815e4d0 con 0x7f08b80b7330 2023-12-20T04:43:44.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08b7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08b815d640 0x7f08b80c8c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08b7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08b815d640 0x7f08b80c8c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35576/0 (socket says 172.21.15.132:35576) 2023-12-20T04:43:44.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08b7fff640 1 -- 172.21.15.132:0/713404152 learned_addr learned my addr 172.21.15.132:0/713404152 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:44.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08b77fe640 1 --2- 172.21.15.132:0/713404152 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b80b7330 0x7f08b8150da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08aeffd640 1 --2- 172.21.15.132:0/713404152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b80cf910 0x7f08b8151460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08b7fff640 1 -- 172.21.15.132:0/713404152 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b80b7330 msgr2=0x7f08b8150da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08b7fff640 1 --2- 172.21.15.132:0/713404152 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b80b7330 0x7f08b8150da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08b7fff640 1 -- 172.21.15.132:0/713404152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b80cf910 msgr2=0x7f08b8151460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08b7fff640 1 --2- 172.21.15.132:0/713404152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b80cf910 0x7f08b8151460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08b7fff640 1 -- 172.21.15.132:0/713404152 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f08b0009a70 con 0x7f08b815d640 2023-12-20T04:43:44.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08b7fff640 1 --2- 172.21.15.132:0/713404152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08b815d640 0x7f08b80c8c70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009eb0 tx=0x7f08b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:44.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08b4ff9640 1 -- 172.21.15.132:0/713404152 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b0009450 con 0x7f08b815d640 2023-12-20T04:43:44.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08b4ff9640 1 -- 172.21.15.132:0/713404152 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f08b003e410 con 0x7f08b815d640 2023-12-20T04:43:44.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08bdd50640 1 -- 172.21.15.132:0/713404152 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08b815e7b0 con 0x7f08b815d640 2023-12-20T04:43:44.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08b4ff9640 1 -- 172.21.15.132:0/713404152 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f08b003e7a0 con 0x7f08b815d640 2023-12-20T04:43:44.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.527+0000 7f08bdd50640 1 -- 172.21.15.132:0/713404152 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08b815ed70 con 0x7f08b815d640 2023-12-20T04:43:44.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.528+0000 7f08bdd50640 1 -- 172.21.15.132:0/713404152 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f08b80c9320 con 0x7f08b815d640 2023-12-20T04:43:44.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.529+0000 7f08b4ff9640 1 -- 172.21.15.132:0/713404152 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f08b003b050 con 0x7f08b815d640 2023-12-20T04:43:44.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.529+0000 7f08b4ff9640 1 --2- 172.21.15.132:0/713404152 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f089806a460 0x7f089806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.529+0000 7f08b77fe640 1 --2- 172.21.15.132:0/713404152 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f089806a460 0x7f089806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.529+0000 7f08b4ff9640 1 -- 172.21.15.132:0/713404152 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f08b00aa490 con 0x7f08b815d640 2023-12-20T04:43:44.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.530+0000 7f08b77fe640 1 --2- 172.21.15.132:0/713404152 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f089806a460 0x7f089806c920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f08a8005880 tx=0x7f08a8001da0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:44.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.534+0000 7f08b4ff9640 1 -- 172.21.15.132:0/713404152 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f08b0075bc0 con 0x7f08b815d640 2023-12-20T04:43:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.701+0000 7f08bdd50640 1 -- 172.21.15.132:0/713404152 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f08b804e840 con 0x7f08b815d640 2023-12-20T04:43:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.702+0000 7f08b4ff9640 1 -- 172.21.15.132:0/713404152 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16162 (secure 0 0 0) 0x7f08b00791e0 con 0x7f08b815d640 2023-12-20T04:43:44.703 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:44.704 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":32,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:43:44.388303+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:43:42.932158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-20T04:43:43.361561+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:44.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.704+0000 7f08bdd50640 1 -- 172.21.15.132:0/713404152 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f089806a460 msgr2=0x7f089806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.704+0000 7f08bdd50640 1 --2- 172.21.15.132:0/713404152 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f089806a460 0x7f089806c920 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f08a8005880 tx=0x7f08a8001da0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.704+0000 7f08bdd50640 1 -- 172.21.15.132:0/713404152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08b815d640 msgr2=0x7f08b80c8c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.704+0000 7f08bdd50640 1 --2- 172.21.15.132:0/713404152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08b815d640 0x7f08b80c8c70 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f08b0009eb0 tx=0x7f08b0004a40 comp rx=0 tx=0).stop 2023-12-20T04:43:44.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.704+0000 7f08bdd50640 1 -- 172.21.15.132:0/713404152 shutdown_connections 2023-12-20T04:43:44.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.704+0000 7f08bdd50640 1 --2- 172.21.15.132:0/713404152 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f089806a460 0x7f089806c920 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.704+0000 7f08bdd50640 1 --2- 172.21.15.132:0/713404152 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08b815d640 0x7f08b80c8c70 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.704+0000 7f08bdd50640 1 --2- 172.21.15.132:0/713404152 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f08b80cf910 0x7f08b8151460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.704+0000 7f08bdd50640 1 --2- 172.21.15.132:0/713404152 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08b80b7330 0x7f08b8150da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.704+0000 7f08bdd50640 1 -- 172.21.15.132:0/713404152 >> 172.21.15.132:0/713404152 conn(0x7f08b806be70 msgr2=0x7f08b815bce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:44.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.704+0000 7f08bdd50640 1 -- 172.21.15.132:0/713404152 shutdown_connections 2023-12-20T04:43:44.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.704+0000 7f08bdd50640 1 -- 172.21.15.132:0/713404152 wait complete. 2023-12-20T04:43:44.717 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:44.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.818+0000 7f746c9d2640 1 Processor -- start 2023-12-20T04:43:44.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.818+0000 7f746c9d2640 1 -- start start 2023-12-20T04:43:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.818+0000 7f746c9d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7468159d00 0x7f746815da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.818+0000 7f746c9d2640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f746806cc30 0x7f746806d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.818+0000 7f746c9d2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f746815e4c0 con 0x7f746815df40 2023-12-20T04:43:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.818+0000 7f746c9d2640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f746806c220 con 0x7f746806cc30 2023-12-20T04:43:44.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.818+0000 7f746c9d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f746806d5e0 con 0x7f7468159d00 2023-12-20T04:43:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f745ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f746815df40 0x7f74680caa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52526/0 (socket says 172.21.15.132:52526) 2023-12-20T04:43:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f745ffff640 1 -- 172.21.15.132:0/1033752468 learned_addr learned my addr 172.21.15.132:0/1033752468 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f746659c640 1 --2- 172.21.15.132:0/1033752468 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7468159d00 0x7f746815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7466d9d640 1 --2- 172.21.15.132:0/1033752468 >> v2:172.21.15.187:3300/0 conn(0x7f746806cc30 0x7f746806d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7465d9b640 1 -- 172.21.15.132:0/1033752468 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 485319110 0 0) 0x7f746815e4c0 con 0x7f746815df40 2023-12-20T04:43:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7465d9b640 1 -- 172.21.15.132:0/1033752468 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7454003520 con 0x7f746815df40 2023-12-20T04:43:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7465d9b640 1 -- 172.21.15.132:0/1033752468 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3101542048 0 0) 0x7f7454003520 con 0x7f746815df40 2023-12-20T04:43:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7465d9b640 1 -- 172.21.15.132:0/1033752468 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7468159d00 msgr2=0x7f746815da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7465d9b640 1 --2- 172.21.15.132:0/1033752468 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7468159d00 0x7f746815da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7465d9b640 1 -- 172.21.15.132:0/1033752468 >> v2:172.21.15.187:3300/0 conn(0x7f746806cc30 msgr2=0x7f746806d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7465d9b640 1 --2- 172.21.15.132:0/1033752468 >> v2:172.21.15.187:3300/0 conn(0x7f746806cc30 0x7f746806d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7465d9b640 1 -- 172.21.15.132:0/1033752468 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746815e7a0 con 0x7f746815df40 2023-12-20T04:43:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7465d9b640 1 -- 172.21.15.132:0/1033752468 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f7450001670 con 0x7f746815df40 2023-12-20T04:43:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7465d9b640 1 -- 172.21.15.132:0/1033752468 >> v1:172.21.15.132:6789/0 conn(0x7f746815df40 legacy=0x7f74680caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7465d9b640 1 --2- 172.21.15.132:0/1033752468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7454003970 0x7f7454003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7465d9b640 1 --2- 172.21.15.132:0/1033752468 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7468159d00 0x7f74540047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7465d9b640 1 --2- 172.21.15.132:0/1033752468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7454004d00 0x7f7454005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7465d9b640 1 -- 172.21.15.132:0/1033752468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746806c220 con 0x7f7454003970 2023-12-20T04:43:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7465d9b640 1 -- 172.21.15.132:0/1033752468 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746806d5e0 con 0x7f7454004d00 2023-12-20T04:43:44.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7465d9b640 1 -- 172.21.15.132:0/1033752468 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745400b980 con 0x7f7468159d00 2023-12-20T04:43:44.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f746659c640 1 --2- 172.21.15.132:0/1033752468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7454003970 0x7f7454003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f7466d9d640 1 --2- 172.21.15.132:0/1033752468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7454004d00 0x7f7454005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f745ffff640 1 --2- 172.21.15.132:0/1033752468 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7468159d00 0x7f74540047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f746659c640 1 -- 172.21.15.132:0/1033752468 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7468159d00 msgr2=0x7f74540047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:44.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f746659c640 1 --2- 172.21.15.132:0/1033752468 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7468159d00 0x7f74540047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f746659c640 1 -- 172.21.15.132:0/1033752468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7454004d00 msgr2=0x7f7454005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:44.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f746659c640 1 --2- 172.21.15.132:0/1033752468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7454004d00 0x7f7454005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.819+0000 7f746659c640 1 -- 172.21.15.132:0/1033752468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7454003520 con 0x7f7454003970 2023-12-20T04:43:44.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.820+0000 7f745ffff640 1 --2- 172.21.15.132:0/1033752468 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7468159d00 0x7f74540047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:44.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.820+0000 7f746659c640 1 --2- 172.21.15.132:0/1033752468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7454003970 0x7f7454003d90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7458009ac0 tx=0x7f74540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adf086475c4026c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:44.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.820+0000 7f7465d9b640 1 -- 172.21.15.132:0/1033752468 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745802c6b0 con 0x7f7454003970 2023-12-20T04:43:44.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.820+0000 7f7465d9b640 1 -- 172.21.15.132:0/1033752468 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f745802c810 con 0x7f7454003970 2023-12-20T04:43:44.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.820+0000 7f7465d9b640 1 -- 172.21.15.132:0/1033752468 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f745802cba0 con 0x7f7454003970 2023-12-20T04:43:44.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.821+0000 7f746c9d2640 1 -- 172.21.15.132:0/1033752468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7454003970 msgr2=0x7f7454003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.821+0000 7f746c9d2640 1 --2- 172.21.15.132:0/1033752468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7454003970 0x7f7454003d90 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7f7458009ac0 tx=0x7f74540057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.821+0000 7f7466d9d640 1 -- 172.21.15.132:0/1033752468 reap_dead start 2023-12-20T04:43:44.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.821+0000 7f746c9d2640 1 -- 172.21.15.132:0/1033752468 shutdown_connections 2023-12-20T04:43:44.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.821+0000 7f746c9d2640 1 -- 172.21.15.132:0/1033752468 >> 172.21.15.132:0/1033752468 conn(0x7f74680cfca0 msgr2=0x7f74680d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:44.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.821+0000 7f746c9d2640 1 -- 172.21.15.132:0/1033752468 shutdown_connections 2023-12-20T04:43:44.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.821+0000 7f746c9d2640 1 -- 172.21.15.132:0/1033752468 wait complete. 2023-12-20T04:43:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.822+0000 7f746c9d2640 1 Processor -- start 2023-12-20T04:43:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.822+0000 7f746c9d2640 1 -- start start 2023-12-20T04:43:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f746c9d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7454003970 0x7f74680af7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f746c9d2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7468150d00 0x7f74680afcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f746c9d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f746815afb0 0x7f746815b460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f746c9d2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f746815b9a0 con 0x7f746815afb0 2023-12-20T04:43:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f746c9d2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74681f1800 con 0x7f7468150d00 2023-12-20T04:43:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f746c9d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f74680b4470 con 0x7f7454003970 2023-12-20T04:43:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f7466d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f746815afb0 0x7f746815b460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f7466d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f746815afb0 0x7f746815b460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35588/0 (socket says 172.21.15.132:35588) 2023-12-20T04:43:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f7466d9d640 1 -- 172.21.15.132:0/2832468546 learned_addr learned my addr 172.21.15.132:0/2832468546 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:44.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f746659c640 1 --2- 172.21.15.132:0/2832468546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7454003970 0x7f74680af7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f745ffff640 1 --2- 172.21.15.132:0/2832468546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7468150d00 0x7f74680afcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f7466d9d640 1 -- 172.21.15.132:0/2832468546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7454003970 msgr2=0x7f74680af7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f7466d9d640 1 --2- 172.21.15.132:0/2832468546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7454003970 0x7f74680af7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f7466d9d640 1 -- 172.21.15.132:0/2832468546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7468150d00 msgr2=0x7f74680afcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f7466d9d640 1 --2- 172.21.15.132:0/2832468546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7468150d00 0x7f74680afcf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f7466d9d640 1 -- 172.21.15.132:0/2832468546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f746815bbb0 con 0x7f746815afb0 2023-12-20T04:43:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f746659c640 1 --2- 172.21.15.132:0/2832468546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7454003970 0x7f74680af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f745ffff640 1 --2- 172.21.15.132:0/2832468546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7468150d00 0x7f74680afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:44.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.823+0000 7f7466d9d640 1 --2- 172.21.15.132:0/2832468546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f746815afb0 0x7f746815b460 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7460011bf0 tx=0x7f746000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.824+0000 7f745effd640 1 -- 172.21.15.132:0/2832468546 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f746000e040 con 0x7f746815afb0 2023-12-20T04:43:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.824+0000 7f745effd640 1 -- 172.21.15.132:0/2832468546 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f746000f040 con 0x7f746815afb0 2023-12-20T04:43:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.824+0000 7f746c9d2640 1 -- 172.21.15.132:0/2832468546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74681f0760 con 0x7f746815afb0 2023-12-20T04:43:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.824+0000 7f745effd640 1 -- 172.21.15.132:0/2832468546 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7460015430 con 0x7f746815afb0 2023-12-20T04:43:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.824+0000 7f746c9d2640 1 -- 172.21.15.132:0/2832468546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74681f0d20 con 0x7f746815afb0 2023-12-20T04:43:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.825+0000 7f746c9d2640 1 -- 172.21.15.132:0/2832468546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f746804e840 con 0x7f746815afb0 2023-12-20T04:43:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.825+0000 7f745effd640 1 -- 172.21.15.132:0/2832468546 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7460015590 con 0x7f746815afb0 2023-12-20T04:43:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.825+0000 7f745effd640 1 --2- 172.21.15.132:0/2832468546 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f744806a460 0x7f744806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.825+0000 7f746659c640 1 --2- 172.21.15.132:0/2832468546 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f744806a460 0x7f744806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.826+0000 7f745effd640 1 -- 172.21.15.132:0/2832468546 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7460088f30 con 0x7f746815afb0 2023-12-20T04:43:44.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.826+0000 7f746659c640 1 --2- 172.21.15.132:0/2832468546 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f744806a460 0x7f744806c920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7458036000 tx=0x7f7458030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:44.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.830+0000 7f745effd640 1 -- 172.21.15.132:0/2832468546 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7460054520 con 0x7f746815afb0 2023-12-20T04:43:44.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.995+0000 7f746c9d2640 1 -- 172.21.15.132:0/2832468546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f74680ce360 con 0x7f746815afb0 2023-12-20T04:43:44.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.996+0000 7f745effd640 1 -- 172.21.15.132:0/2832468546 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v32) v1 ==== 74+0+16162 (secure 0 0 0) 0x7f7460057b40 con 0x7f746815afb0 2023-12-20T04:43:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:44.998 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":32,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:43:44.388303+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:43:42.932158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-20T04:43:43.361561+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.998+0000 7f746c9d2640 1 -- 172.21.15.132:0/2832468546 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f744806a460 msgr2=0x7f744806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.998+0000 7f746c9d2640 1 --2- 172.21.15.132:0/2832468546 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f744806a460 0x7f744806c920 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f7458036000 tx=0x7f7458030000 comp rx=0 tx=0).stop 2023-12-20T04:43:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.998+0000 7f746c9d2640 1 -- 172.21.15.132:0/2832468546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f746815afb0 msgr2=0x7f746815b460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.998+0000 7f746c9d2640 1 --2- 172.21.15.132:0/2832468546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f746815afb0 0x7f746815b460 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7f7460011bf0 tx=0x7f746000f580 comp rx=0 tx=0).stop 2023-12-20T04:43:45.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.998+0000 7f746c9d2640 1 -- 172.21.15.132:0/2832468546 shutdown_connections 2023-12-20T04:43:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.998+0000 7f746c9d2640 1 --2- 172.21.15.132:0/2832468546 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f744806a460 0x7f744806c920 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.998+0000 7f746c9d2640 1 --2- 172.21.15.132:0/2832468546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f746815afb0 0x7f746815b460 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.998+0000 7f746c9d2640 1 --2- 172.21.15.132:0/2832468546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7468150d00 0x7f74680afcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.998+0000 7f746c9d2640 1 --2- 172.21.15.132:0/2832468546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7454003970 0x7f74680af7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.998+0000 7f746c9d2640 1 -- 172.21.15.132:0/2832468546 >> 172.21.15.132:0/2832468546 conn(0x7f74680cfca0 msgr2=0x7f74680711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.998+0000 7f746c9d2640 1 -- 172.21.15.132:0/2832468546 shutdown_connections 2023-12-20T04:43:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:44.999+0000 7f746c9d2640 1 -- 172.21.15.132:0/2832468546 wait complete. 2023-12-20T04:43:45.012 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-20T04:43:45.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.114+0000 7fe93e096640 1 Processor -- start 2023-12-20T04:43:45.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.114+0000 7fe93e096640 1 -- start start 2023-12-20T04:43:45.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.115+0000 7fe93e096640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9380cc940 0x7fe9380ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.115+0000 7fe93e096640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe9380cb8b0 0x7fe938159a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.115+0000 7fe93e096640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe9380cb420 con 0x7fe938159f40 2023-12-20T04:43:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.115+0000 7fe93e096640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe938153ee0 con 0x7fe9380cb8b0 2023-12-20T04:43:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.115+0000 7fe93e096640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe9380cd260 con 0x7fe9380cc940 2023-12-20T04:43:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.115+0000 7fe9377fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9380cc940 0x7fe9380ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.115+0000 7fe936ffd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe9380cb8b0 0x7fe938159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.115+0000 7fe937fff640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fe938159f40 0x7fe9380c9280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:38762/0 (socket says 172.21.15.132:38762) 2023-12-20T04:43:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.115+0000 7fe937fff640 1 -- 172.21.15.132:0/669040845 learned_addr learned my addr 172.21.15.132:0/669040845 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.116+0000 7fe9377fe640 1 -- 172.21.15.132:0/669040845 >> v2:172.21.15.187:3300/0 conn(0x7fe9380cb8b0 msgr2=0x7fe938159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.116+0000 7fe9377fe640 1 --2- 172.21.15.132:0/669040845 >> v2:172.21.15.187:3300/0 conn(0x7fe9380cb8b0 0x7fe938159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.116+0000 7fe9377fe640 1 -- 172.21.15.132:0/669040845 >> v1:172.21.15.187:6789/0 conn(0x7fe938159f40 legacy=0x7fe9380c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.116+0000 7fe9377fe640 1 -- 172.21.15.132:0/669040845 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe93815a4f0 con 0x7fe9380cc940 2023-12-20T04:43:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.116+0000 7fe9367fc640 1 -- 172.21.15.132:0/669040845 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4003607885 0 0) 0x7fe9380cb420 con 0x7fe938159f40 2023-12-20T04:43:45.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.116+0000 7fe936ffd640 1 --2- 172.21.15.132:0/669040845 >> v2:172.21.15.187:3300/0 conn(0x7fe9380cb8b0 0x7fe938159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:43:45.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.117+0000 7fe9377fe640 1 --2- 172.21.15.132:0/669040845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9380cc940 0x7fe9380ccd20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0097a0 tx=0x7fe92c02b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dff7c7320891e253 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:45.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.117+0000 7fe9367fc640 1 -- 172.21.15.132:0/669040845 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c030610 con 0x7fe9380cc940 2023-12-20T04:43:45.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.117+0000 7fe9367fc640 1 -- 172.21.15.132:0/669040845 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92c030770 con 0x7fe9380cc940 2023-12-20T04:43:45.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.117+0000 7fe9367fc640 1 -- 172.21.15.132:0/669040845 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92c030b00 con 0x7fe9380cc940 2023-12-20T04:43:45.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.117+0000 7fe93e096640 1 -- 172.21.15.132:0/669040845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9380cc940 msgr2=0x7fe9380ccd20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:45.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.117+0000 7fe93e096640 1 --2- 172.21.15.132:0/669040845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9380cc940 0x7fe9380ccd20 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe92c0097a0 tx=0x7fe92c02b960 comp rx=0 tx=0).stop 2023-12-20T04:43:45.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.117+0000 7fe93e096640 1 -- 172.21.15.132:0/669040845 shutdown_connections 2023-12-20T04:43:45.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.117+0000 7fe93e096640 1 --2- 172.21.15.132:0/669040845 >> v2:172.21.15.187:3300/0 conn(0x7fe9380cb8b0 0x7fe938159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:45.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.117+0000 7fe93e096640 1 --2- 172.21.15.132:0/669040845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9380cc940 0x7fe9380ccd20 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:45.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.117+0000 7fe93e096640 1 -- 172.21.15.132:0/669040845 >> 172.21.15.132:0/669040845 conn(0x7fe93806a260 msgr2=0x7fe9380b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:45.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.117+0000 7fe93e096640 1 -- 172.21.15.132:0/669040845 shutdown_connections 2023-12-20T04:43:45.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.117+0000 7fe93e096640 1 -- 172.21.15.132:0/669040845 wait complete. 2023-12-20T04:43:45.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.119+0000 7fe93e096640 1 Processor -- start 2023-12-20T04:43:45.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.119+0000 7fe93e096640 1 -- start start 2023-12-20T04:43:45.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.119+0000 7fe93e096640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9380cb8b0 0x7fe93815ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:45.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.119+0000 7fe93e096640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9380cc940 0x7fe93815c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:45.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.119+0000 7fe93e096640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe938159f40 0x7fe938071230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:45.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe93e096640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe938071770 con 0x7fe9380cc940 2023-12-20T04:43:45.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe93e096640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe93815b1e0 con 0x7fe938159f40 2023-12-20T04:43:45.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe93e096640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe93815b4c0 con 0x7fe9380cb8b0 2023-12-20T04:43:45.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe936ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9380cc940 0x7fe93815c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:45.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe9377fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9380cb8b0 0x7fe93815ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:45.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe937fff640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe938159f40 0x7fe938071230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:45.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe936ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9380cc940 0x7fe93815c280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35598/0 (socket says 172.21.15.132:35598) 2023-12-20T04:43:45.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe936ffd640 1 -- 172.21.15.132:0/2058631577 learned_addr learned my addr 172.21.15.132:0/2058631577 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:45.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe936ffd640 1 -- 172.21.15.132:0/2058631577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9380cb8b0 msgr2=0x7fe93815ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:45.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe936ffd640 1 --2- 172.21.15.132:0/2058631577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9380cb8b0 0x7fe93815ac00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:45.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe936ffd640 1 -- 172.21.15.132:0/2058631577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe938159f40 msgr2=0x7fe938071230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:45.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe936ffd640 1 --2- 172.21.15.132:0/2058631577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe938159f40 0x7fe938071230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:45.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe936ffd640 1 -- 172.21.15.132:0/2058631577 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe928009400 con 0x7fe9380cc940 2023-12-20T04:43:45.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe936ffd640 1 --2- 172.21.15.132:0/2058631577 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9380cc940 0x7fe93815c280 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe92800ebe0 tx=0x7fe92800c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:45.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe91ffff640 1 -- 172.21.15.132:0/2058631577 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe928009760 con 0x7fe9380cc940 2023-12-20T04:43:45.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe91ffff640 1 -- 172.21.15.132:0/2058631577 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe92800cc30 con 0x7fe9380cc940 2023-12-20T04:43:45.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe91ffff640 1 -- 172.21.15.132:0/2058631577 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe92800eee0 con 0x7fe9380cc940 2023-12-20T04:43:45.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe93e096640 1 -- 172.21.15.132:0/2058631577 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe92c009400 con 0x7fe9380cc940 2023-12-20T04:43:45.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.120+0000 7fe93e096640 1 -- 172.21.15.132:0/2058631577 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe93815ba80 con 0x7fe9380cc940 2023-12-20T04:43:45.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.121+0000 7fe93e096640 1 -- 172.21.15.132:0/2058631577 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe93804e840 con 0x7fe9380cc940 2023-12-20T04:43:45.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.122+0000 7fe91ffff640 1 -- 172.21.15.132:0/2058631577 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe928013470 con 0x7fe9380cc940 2023-12-20T04:43:45.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.122+0000 7fe91ffff640 1 --2- 172.21.15.132:0/2058631577 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe92406a460 0x7fe92406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:45.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.122+0000 7fe9377fe640 1 --2- 172.21.15.132:0/2058631577 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe92406a460 0x7fe92406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:45.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.122+0000 7fe91ffff640 1 -- 172.21.15.132:0/2058631577 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(32..32 src has 1..32) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe928088ec0 con 0x7fe9380cc940 2023-12-20T04:43:45.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.123+0000 7fe9377fe640 1 --2- 172.21.15.132:0/2058631577 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe92406a460 0x7fe92406c920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe92c036000 tx=0x7fe92c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:45.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.126+0000 7fe91ffff640 1 -- 172.21.15.132:0/2058631577 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe928054560 con 0x7fe9380cc940 2023-12-20T04:43:45.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:45.329+0000 7fe93e096640 1 -- 172.21.15.132:0/2058631577 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fe938065f80 con 0x7fe9380cc940 2023-12-20T04:43:46.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.070+0000 7fe91ffff640 1 -- 172.21.15.132:0/2058631577 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v12) v1 ==== 118+0+0 (secure 0 0 0) 0x7fe928057b80 con 0x7fe9380cc940 2023-12-20T04:43:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.072+0000 7fe93e096640 1 -- 172.21.15.132:0/2058631577 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe92406a460 msgr2=0x7fe92406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.072+0000 7fe93e096640 1 --2- 172.21.15.132:0/2058631577 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe92406a460 0x7fe92406c920 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7fe92c036000 tx=0x7fe92c008030 comp rx=0 tx=0).stop 2023-12-20T04:43:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.072+0000 7fe93e096640 1 -- 172.21.15.132:0/2058631577 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9380cc940 msgr2=0x7fe93815c280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.072+0000 7fe93e096640 1 --2- 172.21.15.132:0/2058631577 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9380cc940 0x7fe93815c280 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fe92800ebe0 tx=0x7fe92800c520 comp rx=0 tx=0).stop 2023-12-20T04:43:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.072+0000 7fe93e096640 1 -- 172.21.15.132:0/2058631577 shutdown_connections 2023-12-20T04:43:46.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.072+0000 7fe93e096640 1 --2- 172.21.15.132:0/2058631577 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe92406a460 0x7fe92406c920 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:46.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.072+0000 7fe93e096640 1 --2- 172.21.15.132:0/2058631577 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe938159f40 0x7fe938071230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:46.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.072+0000 7fe93e096640 1 --2- 172.21.15.132:0/2058631577 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe9380cc940 0x7fe93815c280 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:46.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.072+0000 7fe93e096640 1 --2- 172.21.15.132:0/2058631577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe9380cb8b0 0x7fe93815ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:46.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.072+0000 7fe93e096640 1 -- 172.21.15.132:0/2058631577 >> 172.21.15.132:0/2058631577 conn(0x7fe93806a260 msgr2=0x7fe938157570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:46.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.073+0000 7fe93e096640 1 -- 172.21.15.132:0/2058631577 shutdown_connections 2023-12-20T04:43:46.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.073+0000 7fe93e096640 1 -- 172.21.15.132:0/2058631577 wait complete. 2023-12-20T04:43:46.086 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-20T04:43:46.087 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-20T04:43:46.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.191+0000 7f4f005ec640 1 Processor -- start 2023-12-20T04:43:46.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.191+0000 7f4f005ec640 1 -- start start 2023-12-20T04:43:46.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.192+0000 7f4f005ec640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4ef815d300 0x7f4ef806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:46.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.192+0000 7f4f005ec640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ef80cd4b0 0x7f4ef80cd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:46.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.192+0000 7f4f005ec640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ef806cc90 con 0x7f4ef815cf20 2023-12-20T04:43:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.192+0000 7f4f005ec640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4ef80cdea0 con 0x7f4ef815d300 2023-12-20T04:43:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.192+0000 7f4f005ec640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80b2f30 con 0x7f4ef80cd4b0 2023-12-20T04:43:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.192+0000 7f4efdb87640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4ef815d300 0x7f4ef806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.192+0000 7f4efeb89640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ef80cd4b0 0x7f4ef80cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.192+0000 7f4efe388640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f4ef815cf20 0x7f4ef8161700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:38768/0 (socket says 172.21.15.132:38768) 2023-12-20T04:43:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.192+0000 7f4efdb87640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4ef815d300 0x7f4ef806c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:44948/0 (socket says 172.21.15.132:44948) 2023-12-20T04:43:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.192+0000 7f4efe388640 1 -- 172.21.15.132:0/693191639 learned_addr learned my addr 172.21.15.132:0/693191639 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.192+0000 7f4efeb89640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ef80cd4b0 0x7f4ef80cd960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:47800/0 (socket says 172.21.15.132:47800) 2023-12-20T04:43:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.193+0000 7f4efdb87640 1 -- 172.21.15.132:0/693191639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ef80cd4b0 msgr2=0x7f4ef80cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.193+0000 7f4efdb87640 1 --2- 172.21.15.132:0/693191639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ef80cd4b0 0x7f4ef80cd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.193+0000 7f4efdb87640 1 -- 172.21.15.132:0/693191639 >> v1:172.21.15.187:6789/0 conn(0x7f4ef815cf20 legacy=0x7f4ef8161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.193+0000 7f4efdb87640 1 -- 172.21.15.132:0/693191639 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef80b3210 con 0x7f4ef815d300 2023-12-20T04:43:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.193+0000 7f4efeb89640 1 --2- 172.21.15.132:0/693191639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ef80cd4b0 0x7f4ef80cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:43:46.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.193+0000 7f4efdb87640 1 --2- 172.21.15.132:0/693191639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ef815d300 0x7f4ef806c590 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80097a0 tx=0x7f4ee802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9e8aaf4f4bcec9a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:46.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.194+0000 7f4efd386640 1 -- 172.21.15.132:0/693191639 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8031830 con 0x7f4ef815d300 2023-12-20T04:43:46.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.194+0000 7f4efd386640 1 -- 172.21.15.132:0/693191639 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ee8031990 con 0x7f4ef815d300 2023-12-20T04:43:46.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.194+0000 7f4efd386640 1 -- 172.21.15.132:0/693191639 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ee8031d20 con 0x7f4ef815d300 2023-12-20T04:43:46.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.194+0000 7f4f005ec640 1 -- 172.21.15.132:0/693191639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ef815d300 msgr2=0x7f4ef806c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:46.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.194+0000 7f4f005ec640 1 --2- 172.21.15.132:0/693191639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ef815d300 0x7f4ef806c590 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f4ee80097a0 tx=0x7f4ee802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:46.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.194+0000 7f4f005ec640 1 -- 172.21.15.132:0/693191639 shutdown_connections 2023-12-20T04:43:46.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.194+0000 7f4f005ec640 1 --2- 172.21.15.132:0/693191639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ef80cd4b0 0x7f4ef80cd960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:46.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.194+0000 7f4f005ec640 1 --2- 172.21.15.132:0/693191639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ef815d300 0x7f4ef806c590 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:46.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.194+0000 7f4f005ec640 1 -- 172.21.15.132:0/693191639 >> 172.21.15.132:0/693191639 conn(0x7f4ef8072c60 msgr2=0x7f4ef8073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:46.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.194+0000 7f4f005ec640 1 -- 172.21.15.132:0/693191639 shutdown_connections 2023-12-20T04:43:46.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.194+0000 7f4f005ec640 1 -- 172.21.15.132:0/693191639 wait complete. 2023-12-20T04:43:46.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.195+0000 7f4f005ec640 1 Processor -- start 2023-12-20T04:43:46.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.196+0000 7f4f005ec640 1 -- start start 2023-12-20T04:43:46.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.196+0000 7f4f005ec640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ef80cd4b0 0x7f4ef80c6020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:46.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.196+0000 7f4f005ec640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ef815cf20 0x7f4ef80af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:46.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.196+0000 7f4f005ec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ef815d300 0x7f4ef806d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:46.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.196+0000 7f4f005ec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80c4790 con 0x7f4ef815d300 2023-12-20T04:43:46.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.196+0000 7f4f005ec640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80c6600 con 0x7f4ef815cf20 2023-12-20T04:43:46.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.196+0000 7f4f005ec640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ef80c68e0 con 0x7f4ef80cd4b0 2023-12-20T04:43:46.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.196+0000 7f4efeb89640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ef815d300 0x7f4ef806d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:46.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.196+0000 7f4efeb89640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ef815d300 0x7f4ef806d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35612/0 (socket says 172.21.15.132:35612) 2023-12-20T04:43:46.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.196+0000 7f4efeb89640 1 -- 172.21.15.132:0/468768877 learned_addr learned my addr 172.21.15.132:0/468768877 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:46.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.196+0000 7f4efdb87640 1 --2- 172.21.15.132:0/468768877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ef815cf20 0x7f4ef80af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:46.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.197+0000 7f4efe388640 1 --2- 172.21.15.132:0/468768877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ef80cd4b0 0x7f4ef80c6020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:46.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.197+0000 7f4efeb89640 1 -- 172.21.15.132:0/468768877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ef80cd4b0 msgr2=0x7f4ef80c6020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:46.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.197+0000 7f4efeb89640 1 --2- 172.21.15.132:0/468768877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ef80cd4b0 0x7f4ef80c6020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:46.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.197+0000 7f4efeb89640 1 -- 172.21.15.132:0/468768877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ef815cf20 msgr2=0x7f4ef80af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:46.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.197+0000 7f4efeb89640 1 --2- 172.21.15.132:0/468768877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ef815cf20 0x7f4ef80af940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:46.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.197+0000 7f4efeb89640 1 -- 172.21.15.132:0/468768877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ef0009a70 con 0x7f4ef815d300 2023-12-20T04:43:46.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.197+0000 7f4efeb89640 1 --2- 172.21.15.132:0/468768877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ef815d300 0x7f4ef806d840 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000efc0 tx=0x7f4ef0009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:46.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.197+0000 7f4eeeffd640 1 -- 172.21.15.132:0/468768877 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0009d70 con 0x7f4ef815d300 2023-12-20T04:43:46.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.197+0000 7f4eeeffd640 1 -- 172.21.15.132:0/468768877 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ef000f040 con 0x7f4ef815d300 2023-12-20T04:43:46.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.197+0000 7f4f005ec640 1 -- 172.21.15.132:0/468768877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ee8009400 con 0x7f4ef815d300 2023-12-20T04:43:46.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.197+0000 7f4eeeffd640 1 -- 172.21.15.132:0/468768877 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ef0003990 con 0x7f4ef815d300 2023-12-20T04:43:46.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.197+0000 7f4f005ec640 1 -- 172.21.15.132:0/468768877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ef80c49e0 con 0x7f4ef815d300 2023-12-20T04:43:46.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.198+0000 7f4f005ec640 1 -- 172.21.15.132:0/468768877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ef8066cd0 con 0x7f4ef815d300 2023-12-20T04:43:46.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.198+0000 7f4eeeffd640 1 -- 172.21.15.132:0/468768877 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4ef00144a0 con 0x7f4ef815d300 2023-12-20T04:43:46.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.199+0000 7f4eeeffd640 1 --2- 172.21.15.132:0/468768877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4edc06a430 0x7f4edc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:46.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.199+0000 7f4eeeffd640 1 -- 172.21.15.132:0/468768877 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4ef0089550 con 0x7f4ef815d300 2023-12-20T04:43:46.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.199+0000 7f4efe388640 1 --2- 172.21.15.132:0/468768877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4edc06a430 0x7f4edc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:46.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.199+0000 7f4efe388640 1 --2- 172.21.15.132:0/468768877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4edc06a430 0x7f4edc06c8f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4000f60 tx=0x7f4ef4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:46.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.203+0000 7f4eeeffd640 1 -- 172.21.15.132:0/468768877 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4ef0054b40 con 0x7f4ef815d300 2023-12-20T04:43:46.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:46.404+0000 7f4f005ec640 1 -- 172.21.15.132:0/468768877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f4ef815bc30 con 0x7f4ef815d300 2023-12-20T04:43:46.672 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:43:46.676 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:43:47.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.072+0000 7f4eeeffd640 1 -- 172.21.15.132:0/468768877 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v13) v1 ==== 122+0+0 (secure 0 0 0) 0x7f4ef0058160 con 0x7f4ef815d300 2023-12-20T04:43:47.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.074+0000 7f4f005ec640 1 -- 172.21.15.132:0/468768877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4edc06a430 msgr2=0x7f4edc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.074+0000 7f4f005ec640 1 --2- 172.21.15.132:0/468768877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4edc06a430 0x7f4edc06c8f0 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f4ef4000f60 tx=0x7f4ef4009040 comp rx=0 tx=0).stop 2023-12-20T04:43:47.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.074+0000 7f4f005ec640 1 -- 172.21.15.132:0/468768877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ef815d300 msgr2=0x7f4ef806d840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.074+0000 7f4f005ec640 1 --2- 172.21.15.132:0/468768877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ef815d300 0x7f4ef806d840 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f4ef000efc0 tx=0x7f4ef0009f90 comp rx=0 tx=0).stop 2023-12-20T04:43:47.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.074+0000 7f4f005ec640 1 -- 172.21.15.132:0/468768877 shutdown_connections 2023-12-20T04:43:47.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.074+0000 7f4f005ec640 1 --2- 172.21.15.132:0/468768877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4edc06a430 0x7f4edc06c8f0 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.074+0000 7f4f005ec640 1 --2- 172.21.15.132:0/468768877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ef815d300 0x7f4ef806d840 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.074+0000 7f4f005ec640 1 --2- 172.21.15.132:0/468768877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ef815cf20 0x7f4ef80af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.074+0000 7f4f005ec640 1 --2- 172.21.15.132:0/468768877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ef80cd4b0 0x7f4ef80c6020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.074+0000 7f4f005ec640 1 -- 172.21.15.132:0/468768877 >> 172.21.15.132:0/468768877 conn(0x7f4ef8072c60 msgr2=0x7f4ef815d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:47.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.074+0000 7f4f005ec640 1 -- 172.21.15.132:0/468768877 shutdown_connections 2023-12-20T04:43:47.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.074+0000 7f4f005ec640 1 -- 172.21.15.132:0/468768877 wait complete. 2023-12-20T04:43:47.088 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-20T04:43:47.088 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:43:47.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.187+0000 7f01079d5640 1 Processor -- start 2023-12-20T04:43:47.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.188+0000 7f01079d5640 1 -- start start 2023-12-20T04:43:47.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.188+0000 7f01079d5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01000c92d0 0x7f01000c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:47.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.188+0000 7f01079d5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f010015a3a0 0x7f010006c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:47.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.188+0000 7f01079d5640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f010015aa30 con 0x7f010013cce0 2023-12-20T04:43:47.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.188+0000 7f01079d5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f010015a810 con 0x7f010015a3a0 2023-12-20T04:43:47.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.188+0000 7f01079d5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01000c9bf0 con 0x7f01000c92d0 2023-12-20T04:43:47.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.189+0000 7f0105f72640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f010015a3a0 0x7f010006c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:47.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.189+0000 7f0105f72640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f010015a3a0 0x7f010006c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35618/0 (socket says 172.21.15.132:35618) 2023-12-20T04:43:47.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.189+0000 7f0105f72640 1 -- 172.21.15.132:0/1352189655 learned_addr learned my addr 172.21.15.132:0/1352189655 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:47.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.189+0000 7f0105771640 1 --2- 172.21.15.132:0/1352189655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01000c92d0 0x7f01000c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:47.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.189+0000 7f0105f72640 1 -- 172.21.15.132:0/1352189655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01000c92d0 msgr2=0x7f01000c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:47.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.189+0000 7f0105f72640 1 --2- 172.21.15.132:0/1352189655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01000c92d0 0x7f01000c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.189+0000 7f0105f72640 1 -- 172.21.15.132:0/1352189655 >> v1:172.21.15.187:6789/0 conn(0x7f010013cce0 legacy=0x7f0100159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.189+0000 7f0105f72640 1 -- 172.21.15.132:0/1352189655 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f010006b260 con 0x7f010015a3a0 2023-12-20T04:43:47.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.189+0000 7f0105771640 1 --2- 172.21.15.132:0/1352189655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01000c92d0 0x7f01000c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:47.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.190+0000 7f0105f72640 1 --2- 172.21.15.132:0/1352189655 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f010015a3a0 0x7f010006c020 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f00f8009870 tx=0x7f00f802cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32e2a28aaeb09307 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:47.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.190+0000 7f00f7fff640 1 -- 172.21.15.132:0/1352189655 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f802d9d0 con 0x7f010015a3a0 2023-12-20T04:43:47.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.190+0000 7f00f7fff640 1 -- 172.21.15.132:0/1352189655 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f802db30 con 0x7f010015a3a0 2023-12-20T04:43:47.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.190+0000 7f00f7fff640 1 -- 172.21.15.132:0/1352189655 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8035440 con 0x7f010015a3a0 2023-12-20T04:43:47.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.190+0000 7f01079d5640 1 -- 172.21.15.132:0/1352189655 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f010015a3a0 msgr2=0x7f010006c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.190+0000 7f01079d5640 1 --2- 172.21.15.132:0/1352189655 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f010015a3a0 0x7f010006c020 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f00f8009870 tx=0x7f00f802cc20 comp rx=0 tx=0).stop 2023-12-20T04:43:47.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.190+0000 7f01079d5640 1 -- 172.21.15.132:0/1352189655 shutdown_connections 2023-12-20T04:43:47.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.190+0000 7f01079d5640 1 --2- 172.21.15.132:0/1352189655 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f010015a3a0 0x7f010006c020 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.190+0000 7f01079d5640 1 --2- 172.21.15.132:0/1352189655 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01000c92d0 0x7f01000c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.190+0000 7f01079d5640 1 -- 172.21.15.132:0/1352189655 >> 172.21.15.132:0/1352189655 conn(0x7f01000ced10 msgr2=0x7f01000cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:47.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.190+0000 7f01079d5640 1 -- 172.21.15.132:0/1352189655 shutdown_connections 2023-12-20T04:43:47.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.190+0000 7f01079d5640 1 -- 172.21.15.132:0/1352189655 wait complete. 2023-12-20T04:43:47.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.192+0000 7f01079d5640 1 Processor -- start 2023-12-20T04:43:47.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.192+0000 7f01079d5640 1 -- start start 2023-12-20T04:43:47.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.192+0000 7f01079d5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01000c92d0 0x7f01001f28a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:47.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.192+0000 7f01079d5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f010013cce0 0x7f01000cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:47.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.192+0000 7f01079d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f010015a3a0 0x7f01000cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:47.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.192+0000 7f01079d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01001f6900 con 0x7f010015a3a0 2023-12-20T04:43:47.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.192+0000 7f01079d5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01001f6be0 con 0x7f01000c92d0 2023-12-20T04:43:47.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.192+0000 7f01079d5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01001f6ec0 con 0x7f010013cce0 2023-12-20T04:43:47.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.192+0000 7f0105f72640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f010015a3a0 0x7f01000cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:47.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.192+0000 7f0105f72640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f010015a3a0 0x7f01000cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35628/0 (socket says 172.21.15.132:35628) 2023-12-20T04:43:47.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.192+0000 7f0105f72640 1 -- 172.21.15.132:0/3009556374 learned_addr learned my addr 172.21.15.132:0/3009556374 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:47.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.192+0000 7f0105771640 1 --2- 172.21.15.132:0/3009556374 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01000c92d0 0x7f01001f28a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:47.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.192+0000 7f0104f70640 1 --2- 172.21.15.132:0/3009556374 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f010013cce0 0x7f01000cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:47.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.193+0000 7f0105f72640 1 -- 172.21.15.132:0/3009556374 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f010013cce0 msgr2=0x7f01000cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.193+0000 7f0105f72640 1 --2- 172.21.15.132:0/3009556374 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f010013cce0 0x7f01000cd8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.193+0000 7f0105f72640 1 -- 172.21.15.132:0/3009556374 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01000c92d0 msgr2=0x7f01001f28a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.193+0000 7f0105f72640 1 --2- 172.21.15.132:0/3009556374 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01000c92d0 0x7f01001f28a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.193+0000 7f0105f72640 1 -- 172.21.15.132:0/3009556374 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00f80094d0 con 0x7f010015a3a0 2023-12-20T04:43:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.193+0000 7f0105f72640 1 --2- 172.21.15.132:0/3009556374 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f010015a3a0 0x7f01000cdde0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f00f802cc60 tx=0x7f00f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.193+0000 7f00f5ffb640 1 -- 172.21.15.132:0/3009556374 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8040680 con 0x7f010015a3a0 2023-12-20T04:43:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.193+0000 7f00f5ffb640 1 -- 172.21.15.132:0/3009556374 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00f800c040 con 0x7f010015a3a0 2023-12-20T04:43:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.193+0000 7f01079d5640 1 -- 172.21.15.132:0/3009556374 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01001f71a0 con 0x7f010015a3a0 2023-12-20T04:43:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.193+0000 7f00f5ffb640 1 -- 172.21.15.132:0/3009556374 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00f8040a40 con 0x7f010015a3a0 2023-12-20T04:43:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.193+0000 7f01079d5640 1 -- 172.21.15.132:0/3009556374 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0100156000 con 0x7f010015a3a0 2023-12-20T04:43:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.194+0000 7f01079d5640 1 -- 172.21.15.132:0/3009556374 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010004e840 con 0x7f010015a3a0 2023-12-20T04:43:47.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.194+0000 7f00f5ffb640 1 -- 172.21.15.132:0/3009556374 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f00f8040ba0 con 0x7f010015a3a0 2023-12-20T04:43:47.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.195+0000 7f00f5ffb640 1 --2- 172.21.15.132:0/3009556374 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f00e406a460 0x7f00e406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:47.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.195+0000 7f00f5ffb640 1 -- 172.21.15.132:0/3009556374 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f00f80ab210 con 0x7f010015a3a0 2023-12-20T04:43:47.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.195+0000 7f0105771640 1 --2- 172.21.15.132:0/3009556374 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f00e406a460 0x7f00e406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:47.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.195+0000 7f0105771640 1 --2- 172.21.15.132:0/3009556374 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f00e406a460 0x7f00e406c920 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f00fc003b80 tx=0x7f00fc009890 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:47.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.199+0000 7f00f5ffb640 1 -- 172.21.15.132:0/3009556374 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f00f8076940 con 0x7f010015a3a0 2023-12-20T04:43:47.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.397+0000 7f01079d5640 1 -- 172.21.15.132:0/3009556374 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f010013eb50 con 0x7f010015a3a0 2023-12-20T04:43:47.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.398+0000 7f00f5ffb640 1 -- 172.21.15.132:0/3009556374 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f00f8079f60 con 0x7f010015a3a0 2023-12-20T04:43:47.400 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:47.400 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/703933798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":703933798},{"type":"v1","addr":"172.21.15.187:6835","nonce":703933798}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3137083608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3137083608},{"type":"v1","addr":"172.21.15.187:6833","nonce":3137083608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1340012349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1340012349},{"type":"v1","addr":"172.21.15.132:6836","nonce":1340012349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:43:44.388671+0000","modified":"2023-12-20T04:43:47.069930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/359299732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":359299732},{"type":"v1","addr":"172.21.15.132:6837","nonce":359299732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-20T04:43:47.400 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 13 2023-12-20T04:43:47.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.400+0000 7f01079d5640 1 -- 172.21.15.132:0/3009556374 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f00e406a460 msgr2=0x7f00e406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.400+0000 7f01079d5640 1 --2- 172.21.15.132:0/3009556374 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f00e406a460 0x7f00e406c920 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f00fc003b80 tx=0x7f00fc009890 comp rx=0 tx=0).stop 2023-12-20T04:43:47.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.400+0000 7f01079d5640 1 -- 172.21.15.132:0/3009556374 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f010015a3a0 msgr2=0x7f01000cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.400+0000 7f01079d5640 1 --2- 172.21.15.132:0/3009556374 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f010015a3a0 0x7f01000cdde0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f00f802cc60 tx=0x7f00f80046c0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.400+0000 7f01079d5640 1 -- 172.21.15.132:0/3009556374 shutdown_connections 2023-12-20T04:43:47.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.400+0000 7f01079d5640 1 --2- 172.21.15.132:0/3009556374 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f00e406a460 0x7f00e406c920 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.400+0000 7f01079d5640 1 --2- 172.21.15.132:0/3009556374 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f010015a3a0 0x7f01000cdde0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.400+0000 7f01079d5640 1 --2- 172.21.15.132:0/3009556374 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f010013cce0 0x7f01000cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.400+0000 7f01079d5640 1 --2- 172.21.15.132:0/3009556374 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01000c92d0 0x7f01001f28a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.400+0000 7f01079d5640 1 -- 172.21.15.132:0/3009556374 >> 172.21.15.132:0/3009556374 conn(0x7f01000ced10 msgr2=0x7f0100154170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:47.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.400+0000 7f01079d5640 1 -- 172.21.15.132:0/3009556374 shutdown_connections 2023-12-20T04:43:47.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.400+0000 7f01079d5640 1 -- 172.21.15.132:0/3009556374 wait complete. 2023-12-20T04:43:47.412 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:47.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.510+0000 7f0bc1105640 1 Processor -- start 2023-12-20T04:43:47.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.510+0000 7f0bc1105640 1 -- start start 2023-12-20T04:43:47.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.511+0000 7f0bc1105640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0bbc06c410 0x7f0bbc0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:47.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.511+0000 7f0bc1105640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bbc0add30 con 0x7f0bbc15cef0 2023-12-20T04:43:47.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.511+0000 7f0bc1105640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bbc0ae010 con 0x7f0bbc15d2d0 2023-12-20T04:43:47.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.511+0000 7f0bc1105640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bbc072d00 con 0x7f0bbc06c410 2023-12-20T04:43:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.511+0000 7f0bbb59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0bbc06c410 0x7f0bbc0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.511+0000 7f0bbad9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0bbc15cef0 0x7f0bbc0cd1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57698/0 (socket says 172.21.15.132:57698) 2023-12-20T04:43:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.511+0000 7f0bbb59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0bbc06c410 0x7f0bbc0cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35108/0 (socket says 172.21.15.132:35108) 2023-12-20T04:43:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.511+0000 7f0bbad9d640 1 -- 172.21.15.132:0/1536893740 learned_addr learned my addr 172.21.15.132:0/1536893740 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.511+0000 7f0bbb59e640 1 -- 172.21.15.132:0/1536893740 >> v1:172.21.15.187:6789/0 conn(0x7f0bbc15d2d0 legacy=0x7f0bbc06bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.511+0000 7f0bbb59e640 1 -- 172.21.15.132:0/1536893740 >> v1:172.21.15.132:6789/0 conn(0x7f0bbc15cef0 legacy=0x7f0bbc0cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.511+0000 7f0bbb59e640 1 -- 172.21.15.132:0/1536893740 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc072fe0 con 0x7f0bbc06c410 2023-12-20T04:43:47.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.511+0000 7f0bb9d9b640 1 -- 172.21.15.132:0/1536893740 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3722193651 0 0) 0x7f0bbc0add30 con 0x7f0bbc15cef0 2023-12-20T04:43:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.512+0000 7f0bbb59e640 1 --2- 172.21.15.132:0/1536893740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc06c410 0x7f0bbc0cecc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40097a0 tx=0x7f0bb402b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee098e7932aee047 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.512+0000 7f0bb9d9b640 1 -- 172.21.15.132:0/1536893740 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb402f810 con 0x7f0bbc06c410 2023-12-20T04:43:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.512+0000 7f0bb9d9b640 1 -- 172.21.15.132:0/1536893740 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb402f970 con 0x7f0bbc06c410 2023-12-20T04:43:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.512+0000 7f0bb9d9b640 1 -- 172.21.15.132:0/1536893740 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb402fd00 con 0x7f0bbc06c410 2023-12-20T04:43:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.513+0000 7f0bc1105640 1 -- 172.21.15.132:0/1536893740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc06c410 msgr2=0x7f0bbc0cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.513+0000 7f0bc1105640 1 --2- 172.21.15.132:0/1536893740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc06c410 0x7f0bbc0cecc0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40097a0 tx=0x7f0bb402b9f0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.513+0000 7f0bc1105640 1 -- 172.21.15.132:0/1536893740 shutdown_connections 2023-12-20T04:43:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.513+0000 7f0bc1105640 1 --2- 172.21.15.132:0/1536893740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc06c410 0x7f0bbc0cecc0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.513+0000 7f0bc1105640 1 -- 172.21.15.132:0/1536893740 >> 172.21.15.132:0/1536893740 conn(0x7f0bbc0cf330 msgr2=0x7f0bbc0cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.513+0000 7f0bc1105640 1 -- 172.21.15.132:0/1536893740 shutdown_connections 2023-12-20T04:43:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.513+0000 7f0bc1105640 1 -- 172.21.15.132:0/1536893740 wait complete. 2023-12-20T04:43:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.514+0000 7f0bc1105640 1 Processor -- start 2023-12-20T04:43:47.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.514+0000 7f0bc1105640 1 -- start start 2023-12-20T04:43:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.515+0000 7f0bc1105640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc06c410 0x7f0bbc1f2190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.515+0000 7f0bc1105640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bbc15cef0 0x7f0bbc0b1f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.515+0000 7f0bc1105640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc15d2d0 0x7f0bbc14bc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.515+0000 7f0bc1105640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc14d0d0 con 0x7f0bbc15d2d0 2023-12-20T04:43:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.515+0000 7f0bc1105640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0b2470 con 0x7f0bbc06c410 2023-12-20T04:43:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.515+0000 7f0bc1105640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc14c4c0 con 0x7f0bbc15cef0 2023-12-20T04:43:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.515+0000 7f0bbb59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc15d2d0 0x7f0bbc14bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.515+0000 7f0bbb59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc15d2d0 0x7f0bbc14bc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35120/0 (socket says 172.21.15.132:35120) 2023-12-20T04:43:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.515+0000 7f0bbb59e640 1 -- 172.21.15.132:0/2701856121 learned_addr learned my addr 172.21.15.132:0/2701856121 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.515+0000 7f0bbad9d640 1 --2- 172.21.15.132:0/2701856121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc06c410 0x7f0bbc1f2190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.515+0000 7f0bba59c640 1 --2- 172.21.15.132:0/2701856121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bbc15cef0 0x7f0bbc0b1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.515+0000 7f0bbb59e640 1 -- 172.21.15.132:0/2701856121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bbc15cef0 msgr2=0x7f0bbc0b1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.515+0000 7f0bbb59e640 1 --2- 172.21.15.132:0/2701856121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bbc15cef0 0x7f0bbc0b1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.515+0000 7f0bbb59e640 1 -- 172.21.15.132:0/2701856121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc06c410 msgr2=0x7f0bbc1f2190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.515+0000 7f0bbb59e640 1 --2- 172.21.15.132:0/2701856121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc06c410 0x7f0bbc1f2190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.515+0000 7f0bbb59e640 1 -- 172.21.15.132:0/2701856121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bb4009400 con 0x7f0bbc15d2d0 2023-12-20T04:43:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.515+0000 7f0bba59c640 1 --2- 172.21.15.132:0/2701856121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bbc15cef0 0x7f0bbc0b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.516+0000 7f0bbb59e640 1 --2- 172.21.15.132:0/2701856121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc15d2d0 0x7f0bbc14bc20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40098c0 tx=0x7f0bb4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.516+0000 7f0ba37fe640 1 -- 172.21.15.132:0/2701856121 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb403c040 con 0x7f0bbc15d2d0 2023-12-20T04:43:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.516+0000 7f0ba37fe640 1 -- 172.21.15.132:0/2701856121 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0bb4037910 con 0x7f0bbc15d2d0 2023-12-20T04:43:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.516+0000 7f0ba37fe640 1 -- 172.21.15.132:0/2701856121 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0bb4037cc0 con 0x7f0bbc15d2d0 2023-12-20T04:43:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.516+0000 7f0bc1105640 1 -- 172.21.15.132:0/2701856121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bbc14c7a0 con 0x7f0bbc15d2d0 2023-12-20T04:43:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.516+0000 7f0bc1105640 1 -- 172.21.15.132:0/2701856121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc14cd60 con 0x7f0bbc15d2d0 2023-12-20T04:43:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.517+0000 7f0bc1105640 1 -- 172.21.15.132:0/2701856121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bbc14d240 con 0x7f0bbc15d2d0 2023-12-20T04:43:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.517+0000 7f0ba37fe640 1 -- 172.21.15.132:0/2701856121 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0bb404b3b0 con 0x7f0bbc15d2d0 2023-12-20T04:43:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.517+0000 7f0ba37fe640 1 --2- 172.21.15.132:0/2701856121 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0ba806a430 0x7f0ba806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.518+0000 7f0ba37fe640 1 -- 172.21.15.132:0/2701856121 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0bb40aaa30 con 0x7f0bbc15d2d0 2023-12-20T04:43:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.518+0000 7f0bbad9d640 1 --2- 172.21.15.132:0/2701856121 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0ba806a430 0x7f0ba806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:47.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.518+0000 7f0bbad9d640 1 --2- 172.21.15.132:0/2701856121 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0ba806a430 0x7f0ba806c8f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0bac0012e0 tx=0x7f0bac004d40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:47.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.522+0000 7f0ba37fe640 1 -- 172.21.15.132:0/2701856121 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0bb4076160 con 0x7f0bbc15d2d0 2023-12-20T04:43:47.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.688+0000 7f0bc1105640 1 -- 172.21.15.132:0/2701856121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0bbc04e840 con 0x7f0bbc15d2d0 2023-12-20T04:43:47.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.689+0000 7f0ba37fe640 1 -- 172.21.15.132:0/2701856121 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v33) v1 ==== 74+0+16149 (secure 0 0 0) 0x7f0bb4047020 con 0x7f0bbc15d2d0 2023-12-20T04:43:47.691 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:47.691 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":33,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:43:45.391767+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:43:42.932158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-20T04:43:43.361561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:47.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.691+0000 7f0bc1105640 1 -- 172.21.15.132:0/2701856121 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0ba806a430 msgr2=0x7f0ba806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.691+0000 7f0bc1105640 1 --2- 172.21.15.132:0/2701856121 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0ba806a430 0x7f0ba806c8f0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f0bac0012e0 tx=0x7f0bac004d40 comp rx=0 tx=0).stop 2023-12-20T04:43:47.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.691+0000 7f0bc1105640 1 -- 172.21.15.132:0/2701856121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc15d2d0 msgr2=0x7f0bbc14bc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.691+0000 7f0bc1105640 1 --2- 172.21.15.132:0/2701856121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc15d2d0 0x7f0bbc14bc20 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f0bb40098c0 tx=0x7f0bb4004730 comp rx=0 tx=0).stop 2023-12-20T04:43:47.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.691+0000 7f0bc1105640 1 -- 172.21.15.132:0/2701856121 shutdown_connections 2023-12-20T04:43:47.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.691+0000 7f0bc1105640 1 --2- 172.21.15.132:0/2701856121 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0ba806a430 0x7f0ba806c8f0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.691+0000 7f0bc1105640 1 --2- 172.21.15.132:0/2701856121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc15d2d0 0x7f0bbc14bc20 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.691+0000 7f0bc1105640 1 --2- 172.21.15.132:0/2701856121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bbc15cef0 0x7f0bbc0b1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.691+0000 7f0bc1105640 1 --2- 172.21.15.132:0/2701856121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc06c410 0x7f0bbc1f2190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.691+0000 7f0bc1105640 1 -- 172.21.15.132:0/2701856121 >> 172.21.15.132:0/2701856121 conn(0x7f0bbc0cf330 msgr2=0x7f0bbc15f6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:47.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.691+0000 7f0bc1105640 1 -- 172.21.15.132:0/2701856121 shutdown_connections 2023-12-20T04:43:47.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.691+0000 7f0bc1105640 1 -- 172.21.15.132:0/2701856121 wait complete. 2023-12-20T04:43:47.704 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-20T04:43:47.704 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:43:47.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.802+0000 7f7a30e28640 1 Processor -- start 2023-12-20T04:43:47.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.802+0000 7f7a30e28640 1 -- start start 2023-12-20T04:43:47.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.803+0000 7f7a30e28640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a2c15cef0 0x7f7a2c0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:47.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.803+0000 7f7a30e28640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a2c15d2d0 0x7f7a2c0ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:47.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.803+0000 7f7a30e28640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a2c0add30 con 0x7f7a2c0cd1e0 2023-12-20T04:43:47.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.803+0000 7f7a30e28640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a2c0ae010 con 0x7f7a2c15d2d0 2023-12-20T04:43:47.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.803+0000 7f7a30e28640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c072d00 con 0x7f7a2c15cef0 2023-12-20T04:43:47.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.803+0000 7f7a29d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a2c15d2d0 0x7f7a2c0ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:47.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.803+0000 7f7a29d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7a2c15d2d0 0x7f7a2c0ad2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35136/0 (socket says 172.21.15.132:35136) 2023-12-20T04:43:47.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.803+0000 7f7a29d9b640 1 -- 172.21.15.132:0/4249259832 learned_addr learned my addr 172.21.15.132:0/4249259832 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:47.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.803+0000 7f7a2a59c640 1 --2- 172.21.15.132:0/4249259832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a2c15cef0 0x7f7a2c0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:47.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.803+0000 7f7a29d9b640 1 -- 172.21.15.132:0/4249259832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a2c15cef0 msgr2=0x7f7a2c0cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:47.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.803+0000 7f7a29d9b640 1 --2- 172.21.15.132:0/4249259832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a2c15cef0 0x7f7a2c0cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.803+0000 7f7a29d9b640 1 -- 172.21.15.132:0/4249259832 >> v1:172.21.15.187:6789/0 conn(0x7f7a2c0cd1e0 legacy=0x7f7a2c06bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.803+0000 7f7a29d9b640 1 -- 172.21.15.132:0/4249259832 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a2c072fe0 con 0x7f7a2c15d2d0 2023-12-20T04:43:47.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.803+0000 7f7a2a59c640 1 --2- 172.21.15.132:0/4249259832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a2c15cef0 0x7f7a2c0cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:47.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.804+0000 7f7a29d9b640 1 --2- 172.21.15.132:0/4249259832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2c15d2d0 0x7f7a2c0ad2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009870 tx=0x7f7a2002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=290e750d44142a2b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:47.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.804+0000 7f7a2959a640 1 -- 172.21.15.132:0/4249259832 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2002f840 con 0x7f7a2c15d2d0 2023-12-20T04:43:47.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.804+0000 7f7a2959a640 1 -- 172.21.15.132:0/4249259832 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a2002f9a0 con 0x7f7a2c15d2d0 2023-12-20T04:43:47.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.804+0000 7f7a2959a640 1 -- 172.21.15.132:0/4249259832 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a2002fd30 con 0x7f7a2c15d2d0 2023-12-20T04:43:47.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.805+0000 7f7a30e28640 1 -- 172.21.15.132:0/4249259832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2c15d2d0 msgr2=0x7f7a2c0ad2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.805+0000 7f7a30e28640 1 --2- 172.21.15.132:0/4249259832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2c15d2d0 0x7f7a2c0ad2f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f7a20009870 tx=0x7f7a2002ba20 comp rx=0 tx=0).stop 2023-12-20T04:43:47.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.805+0000 7f7a30e28640 1 -- 172.21.15.132:0/4249259832 shutdown_connections 2023-12-20T04:43:47.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.805+0000 7f7a30e28640 1 --2- 172.21.15.132:0/4249259832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2c15d2d0 0x7f7a2c0ad2f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.805+0000 7f7a30e28640 1 --2- 172.21.15.132:0/4249259832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a2c15cef0 0x7f7a2c0cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.805+0000 7f7a30e28640 1 -- 172.21.15.132:0/4249259832 >> 172.21.15.132:0/4249259832 conn(0x7f7a2c0cf330 msgr2=0x7f7a2c0cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:47.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.805+0000 7f7a30e28640 1 -- 172.21.15.132:0/4249259832 shutdown_connections 2023-12-20T04:43:47.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.805+0000 7f7a30e28640 1 -- 172.21.15.132:0/4249259832 wait complete. 2023-12-20T04:43:47.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.806+0000 7f7a30e28640 1 Processor -- start 2023-12-20T04:43:47.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.806+0000 7f7a30e28640 1 -- start start 2023-12-20T04:43:47.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.807+0000 7f7a30e28640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a2c0cd1e0 0x7f7a2c156840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:47.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.807+0000 7f7a30e28640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2c15cef0 0x7f7a2c0afb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:47.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.807+0000 7f7a30e28640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a2c15d2d0 0x7f7a2c0b0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:47.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.807+0000 7f7a30e28640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c1f3ac0 con 0x7f7a2c15cef0 2023-12-20T04:43:47.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.807+0000 7f7a30e28640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c0b2e60 con 0x7f7a2c0cd1e0 2023-12-20T04:43:47.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.807+0000 7f7a30e28640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c158d40 con 0x7f7a2c15d2d0 2023-12-20T04:43:47.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.807+0000 7f7a29d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2c15cef0 0x7f7a2c0afb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:47.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.807+0000 7f7a29d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2c15cef0 0x7f7a2c0afb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35140/0 (socket says 172.21.15.132:35140) 2023-12-20T04:43:47.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.807+0000 7f7a29d9b640 1 -- 172.21.15.132:0/3570748800 learned_addr learned my addr 172.21.15.132:0/3570748800 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:47.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.807+0000 7f7a2ad9d640 1 --2- 172.21.15.132:0/3570748800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a2c15d2d0 0x7f7a2c0b0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:47.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.807+0000 7f7a2a59c640 1 --2- 172.21.15.132:0/3570748800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a2c0cd1e0 0x7f7a2c156840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:47.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.807+0000 7f7a29d9b640 1 -- 172.21.15.132:0/3570748800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a2c15d2d0 msgr2=0x7f7a2c0b0070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.807+0000 7f7a29d9b640 1 --2- 172.21.15.132:0/3570748800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a2c15d2d0 0x7f7a2c0b0070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.807+0000 7f7a29d9b640 1 -- 172.21.15.132:0/3570748800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a2c0cd1e0 msgr2=0x7f7a2c156840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.807+0000 7f7a29d9b640 1 --2- 172.21.15.132:0/3570748800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a2c0cd1e0 0x7f7a2c156840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.807+0000 7f7a29d9b640 1 -- 172.21.15.132:0/3570748800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a200094d0 con 0x7f7a2c15cef0 2023-12-20T04:43:47.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.807+0000 7f7a29d9b640 1 --2- 172.21.15.132:0/3570748800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2c15cef0 0x7f7a2c0afb30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7a20000c00 tx=0x7f7a20004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:47.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.808+0000 7f7a1affd640 1 -- 172.21.15.132:0/3570748800 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20037c40 con 0x7f7a2c15cef0 2023-12-20T04:43:47.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.808+0000 7f7a1affd640 1 -- 172.21.15.132:0/3570748800 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a20037da0 con 0x7f7a2c15cef0 2023-12-20T04:43:47.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.808+0000 7f7a30e28640 1 -- 172.21.15.132:0/3570748800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2c159020 con 0x7f7a2c15cef0 2023-12-20T04:43:47.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.808+0000 7f7a1affd640 1 -- 172.21.15.132:0/3570748800 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a20041640 con 0x7f7a2c15cef0 2023-12-20T04:43:47.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.808+0000 7f7a30e28640 1 -- 172.21.15.132:0/3570748800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2c156d80 con 0x7f7a2c15cef0 2023-12-20T04:43:47.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.809+0000 7f7a30e28640 1 -- 172.21.15.132:0/3570748800 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2c156f10 con 0x7f7a2c15cef0 2023-12-20T04:43:47.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.809+0000 7f7a1affd640 1 -- 172.21.15.132:0/3570748800 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7a200417a0 con 0x7f7a2c15cef0 2023-12-20T04:43:47.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.809+0000 7f7a1affd640 1 --2- 172.21.15.132:0/3570748800 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a0c06a430 0x7f7a0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:47.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.809+0000 7f7a1affd640 1 -- 172.21.15.132:0/3570748800 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7a2003c070 con 0x7f7a2c15cef0 2023-12-20T04:43:47.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.810+0000 7f7a2a59c640 1 --2- 172.21.15.132:0/3570748800 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a0c06a430 0x7f7a0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:47.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.810+0000 7f7a2a59c640 1 --2- 172.21.15.132:0/3570748800 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a0c06a430 0x7f7a0c06c8f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c006e80 tx=0x7f7a1c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:47.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.814+0000 7f7a1affd640 1 -- 172.21.15.132:0/3570748800 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7a2c156f10 con 0x7f7a2c15cef0 2023-12-20T04:43:47.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.976+0000 7f7a30e28640 1 -- 172.21.15.132:0/3570748800 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7a2c0cd670 con 0x7f7a0c06a430 2023-12-20T04:43:47.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.983+0000 7f7a1affd640 1 -- 172.21.15.132:0/3570748800 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+279364 (secure 0 0 0) 0x7f7a1c004030 con 0x7f7a0c06a430 2023-12-20T04:43:47.990 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:47.992 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:43:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.986+0000 7f7a30e28640 1 -- 172.21.15.132:0/3570748800 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a0c06a430 msgr2=0x7f7a0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.986+0000 7f7a30e28640 1 --2- 172.21.15.132:0/3570748800 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a0c06a430 0x7f7a0c06c8f0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7a1c006e80 tx=0x7f7a1c008040 comp rx=0 tx=0).stop 2023-12-20T04:43:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.986+0000 7f7a30e28640 1 -- 172.21.15.132:0/3570748800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2c15cef0 msgr2=0x7f7a2c0afb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.986+0000 7f7a30e28640 1 --2- 172.21.15.132:0/3570748800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2c15cef0 0x7f7a2c0afb30 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f7a20000c00 tx=0x7f7a20004730 comp rx=0 tx=0).stop 2023-12-20T04:43:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.986+0000 7f7a30e28640 1 -- 172.21.15.132:0/3570748800 shutdown_connections 2023-12-20T04:43:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.986+0000 7f7a30e28640 1 --2- 172.21.15.132:0/3570748800 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a0c06a430 0x7f7a0c06c8f0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.986+0000 7f7a30e28640 1 --2- 172.21.15.132:0/3570748800 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a2c15d2d0 0x7f7a2c0b0070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.986+0000 7f7a30e28640 1 --2- 172.21.15.132:0/3570748800 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a2c15cef0 0x7f7a2c0afb30 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.986+0000 7f7a30e28640 1 --2- 172.21.15.132:0/3570748800 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a2c0cd1e0 0x7f7a2c156840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:47.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.986+0000 7f7a30e28640 1 -- 172.21.15.132:0/3570748800 >> 172.21.15.132:0/3570748800 conn(0x7f7a2c0cf330 msgr2=0x7f7a2c157fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:47.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.986+0000 7f7a30e28640 1 -- 172.21.15.132:0/3570748800 shutdown_connections 2023-12-20T04:43:47.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:47.986+0000 7f7a30e28640 1 -- 172.21.15.132:0/3570748800 wait complete. 2023-12-20T04:43:47.999 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":60,"stamp":"2023-12-20T04:43:46.104619+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":591954,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":188,"num_write_kb":2420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":141,"ondisk_log_size":141,"up":98,"acting":98,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":38,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2178,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560321,"statfs":{"total":1600000000,"available":1597769254,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":1586,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000690"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095706+0000","last_change":"2023-12-20T04:43:44.403283+0000","last_active":"2023-12-20T04:43:46.095706+0000","last_peered":"2023-12-20T04:43:46.095706+0000","last_clean":"2023-12-20T04:43:46.095706+0000","last_became_active":"2023-12-20T04:43:44.403071+0000","last_became_peered":"2023-12-20T04:43:44.403071+0000","last_unstale":"2023-12-20T04:43:46.095706+0000","last_undegraded":"2023-12-20T04:43:46.095706+0000","last_fullsized":"2023-12-20T04:43:46.095706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:45:51.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.405568+0000","last_change":"2023-12-20T04:43:44.405503+0000","last_active":"2023-12-20T04:43:44.405568+0000","last_peered":"2023-12-20T04:43:44.405568+0000","last_clean":"2023-12-20T04:43:44.405568+0000","last_became_active":"2023-12-20T04:43:44.405210+0000","last_became_peered":"2023-12-20T04:43:44.405210+0000","last_unstale":"2023-12-20T04:43:44.405568+0000","last_undegraded":"2023-12-20T04:43:44.405568+0000","last_fullsized":"2023-12-20T04:43:44.405568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:28:35.210138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394241+0000","last_change":"2023-12-20T04:43:44.404400+0000","last_active":"2023-12-20T04:43:45.394241+0000","last_peered":"2023-12-20T04:43:45.394241+0000","last_clean":"2023-12-20T04:43:45.394241+0000","last_became_active":"2023-12-20T04:43:44.404172+0000","last_became_peered":"2023-12-20T04:43:44.404172+0000","last_unstale":"2023-12-20T04:43:45.394241+0000","last_undegraded":"2023-12-20T04:43:45.394241+0000","last_fullsized":"2023-12-20T04:43:45.394241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:06:17.003408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095818+0000","last_change":"2023-12-20T04:43:44.400411+0000","last_active":"2023-12-20T04:43:46.095818+0000","last_peered":"2023-12-20T04:43:46.095818+0000","last_clean":"2023-12-20T04:43:46.095818+0000","last_became_active":"2023-12-20T04:43:44.400213+0000","last_became_peered":"2023-12-20T04:43:44.400213+0000","last_unstale":"2023-12-20T04:43:46.095818+0000","last_undegraded":"2023-12-20T04:43:46.095818+0000","last_fullsized":"2023-12-20T04:43:46.095818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:48.680746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.403693+0000","last_change":"2023-12-20T04:43:44.403634+0000","last_active":"2023-12-20T04:43:44.403693+0000","last_peered":"2023-12-20T04:43:44.403693+0000","last_clean":"2023-12-20T04:43:44.403693+0000","last_became_active":"2023-12-20T04:43:44.403416+0000","last_became_peered":"2023-12-20T04:43:44.403416+0000","last_unstale":"2023-12-20T04:43:44.403693+0000","last_undegraded":"2023-12-20T04:43:44.403693+0000","last_fullsized":"2023-12-20T04:43:44.403693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:43:50.362019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394147+0000","last_change":"2023-12-20T04:43:44.401708+0000","last_active":"2023-12-20T04:43:45.394147+0000","last_peered":"2023-12-20T04:43:45.394147+0000","last_clean":"2023-12-20T04:43:45.394147+0000","last_became_active":"2023-12-20T04:43:44.401241+0000","last_became_peered":"2023-12-20T04:43:44.401241+0000","last_unstale":"2023-12-20T04:43:45.394147+0000","last_undegraded":"2023-12-20T04:43:45.394147+0000","last_fullsized":"2023-12-20T04:43:45.394147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:30:17.362923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095799+0000","last_change":"2023-12-20T04:43:44.401275+0000","last_active":"2023-12-20T04:43:46.095799+0000","last_peered":"2023-12-20T04:43:46.095799+0000","last_clean":"2023-12-20T04:43:46.095799+0000","last_became_active":"2023-12-20T04:43:44.401061+0000","last_became_peered":"2023-12-20T04:43:44.401061+0000","last_unstale":"2023-12-20T04:43:46.095799+0000","last_undegraded":"2023-12-20T04:43:46.095799+0000","last_fullsized":"2023-12-20T04:43:46.095799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:43:50.362019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095721+0000","last_change":"2023-12-20T04:43:44.399860+0000","last_active":"2023-12-20T04:43:46.095721+0000","last_peered":"2023-12-20T04:43:46.095721+0000","last_clean":"2023-12-20T04:43:46.095721+0000","last_became_active":"2023-12-20T04:43:44.399653+0000","last_became_peered":"2023-12-20T04:43:44.399653+0000","last_unstale":"2023-12-20T04:43:46.095721+0000","last_undegraded":"2023-12-20T04:43:46.095721+0000","last_fullsized":"2023-12-20T04:43:46.095721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:58:32.295652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095546+0000","last_change":"2023-12-20T04:43:44.409106+0000","last_active":"2023-12-20T04:43:46.095546+0000","last_peered":"2023-12-20T04:43:46.095546+0000","last_clean":"2023-12-20T04:43:46.095546+0000","last_became_active":"2023-12-20T04:43:44.406107+0000","last_became_peered":"2023-12-20T04:43:44.406107+0000","last_unstale":"2023-12-20T04:43:46.095546+0000","last_undegraded":"2023-12-20T04:43:46.095546+0000","last_fullsized":"2023-12-20T04:43:46.095546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:06:02.247224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394319+0000","last_change":"2023-12-20T04:43:44.402288+0000","last_active":"2023-12-20T04:43:45.394319+0000","last_peered":"2023-12-20T04:43:45.394319+0000","last_clean":"2023-12-20T04:43:45.394319+0000","last_became_active":"2023-12-20T04:43:44.402089+0000","last_became_peered":"2023-12-20T04:43:44.402089+0000","last_unstale":"2023-12-20T04:43:45.394319+0000","last_undegraded":"2023-12-20T04:43:45.394319+0000","last_fullsized":"2023-12-20T04:43:45.394319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:41:43.008554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399704+0000","last_change":"2023-12-20T04:43:44.408696+0000","last_active":"2023-12-20T04:43:45.399704+0000","last_peered":"2023-12-20T04:43:45.399704+0000","last_clean":"2023-12-20T04:43:45.399704+0000","last_became_active":"2023-12-20T04:43:44.407491+0000","last_became_peered":"2023-12-20T04:43:44.407491+0000","last_unstale":"2023-12-20T04:43:45.399704+0000","last_undegraded":"2023-12-20T04:43:45.399704+0000","last_fullsized":"2023-12-20T04:43:45.399704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:32:56.957622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.404221+0000","last_change":"2023-12-20T04:43:44.404157+0000","last_active":"2023-12-20T04:43:44.404221+0000","last_peered":"2023-12-20T04:43:44.404221+0000","last_clean":"2023-12-20T04:43:44.404221+0000","last_became_active":"2023-12-20T04:43:44.403902+0000","last_became_peered":"2023-12-20T04:43:44.403902+0000","last_unstale":"2023-12-20T04:43:44.404221+0000","last_undegraded":"2023-12-20T04:43:44.404221+0000","last_fullsized":"2023-12-20T04:43:44.404221+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:10:11.259150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095918+0000","last_change":"2023-12-20T04:43:44.405950+0000","last_active":"2023-12-20T04:43:46.095918+0000","last_peered":"2023-12-20T04:43:46.095918+0000","last_clean":"2023-12-20T04:43:46.095918+0000","last_became_active":"2023-12-20T04:43:44.405687+0000","last_became_peered":"2023-12-20T04:43:44.405687+0000","last_unstale":"2023-12-20T04:43:46.095918+0000","last_undegraded":"2023-12-20T04:43:46.095918+0000","last_fullsized":"2023-12-20T04:43:46.095918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:40:37.963289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.406587+0000","last_change":"2023-12-20T04:43:44.406525+0000","last_active":"2023-12-20T04:43:44.406587+0000","last_peered":"2023-12-20T04:43:44.406587+0000","last_clean":"2023-12-20T04:43:44.406587+0000","last_became_active":"2023-12-20T04:43:44.406259+0000","last_became_peered":"2023-12-20T04:43:44.406259+0000","last_unstale":"2023-12-20T04:43:44.406587+0000","last_undegraded":"2023-12-20T04:43:44.406587+0000","last_fullsized":"2023-12-20T04:43:44.406587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:06:02.247224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399686+0000","last_change":"2023-12-20T04:43:44.409831+0000","last_active":"2023-12-20T04:43:45.399686+0000","last_peered":"2023-12-20T04:43:45.399686+0000","last_clean":"2023-12-20T04:43:45.399686+0000","last_became_active":"2023-12-20T04:43:44.409554+0000","last_became_peered":"2023-12-20T04:43:44.409554+0000","last_unstale":"2023-12-20T04:43:45.399686+0000","last_undegraded":"2023-12-20T04:43:45.399686+0000","last_fullsized":"2023-12-20T04:43:45.399686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:10.838713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:43.033909+0000","last_change":"2023-12-20T04:43:43.033909+0000","last_active":"2023-12-20T04:43:43.033909+0000","last_peered":"2023-12-20T04:43:43.033909+0000","last_clean":"2023-12-20T04:43:43.033909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:43.033909+0000","last_undegraded":"2023-12-20T04:43:43.033909+0000","last_fullsized":"2023-12-20T04:43:43.033909+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399636+0000","last_change":"2023-12-20T04:43:44.048554+0000","last_active":"2023-12-20T04:43:45.399636+0000","last_peered":"2023-12-20T04:43:45.399636+0000","last_clean":"2023-12-20T04:43:45.399636+0000","last_became_active":"2023-12-20T04:43:44.048325+0000","last_became_peered":"2023-12-20T04:43:44.048325+0000","last_unstale":"2023-12-20T04:43:45.399636+0000","last_undegraded":"2023-12-20T04:43:45.399636+0000","last_fullsized":"2023-12-20T04:43:45.399636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:46:03.258615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095906+0000","last_change":"2023-12-20T04:43:44.047771+0000","last_active":"2023-12-20T04:43:46.095906+0000","last_peered":"2023-12-20T04:43:46.095906+0000","last_clean":"2023-12-20T04:43:46.095906+0000","last_became_active":"2023-12-20T04:43:44.047583+0000","last_became_peered":"2023-12-20T04:43:44.047583+0000","last_unstale":"2023-12-20T04:43:46.095906+0000","last_undegraded":"2023-12-20T04:43:46.095906+0000","last_fullsized":"2023-12-20T04:43:46.095906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:54:10.624023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.401388+0000","last_change":"2023-12-20T04:43:44.401330+0000","last_active":"2023-12-20T04:43:44.401388+0000","last_peered":"2023-12-20T04:43:44.401388+0000","last_clean":"2023-12-20T04:43:44.401388+0000","last_became_active":"2023-12-20T04:43:44.401137+0000","last_became_peered":"2023-12-20T04:43:44.401137+0000","last_unstale":"2023-12-20T04:43:44.401388+0000","last_undegraded":"2023-12-20T04:43:44.401388+0000","last_fullsized":"2023-12-20T04:43:44.401388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:04:56.280345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394325+0000","last_change":"2023-12-20T04:43:44.051946+0000","last_active":"2023-12-20T04:43:45.394325+0000","last_peered":"2023-12-20T04:43:45.394325+0000","last_clean":"2023-12-20T04:43:45.394325+0000","last_became_active":"2023-12-20T04:43:44.051742+0000","last_became_peered":"2023-12-20T04:43:44.051742+0000","last_unstale":"2023-12-20T04:43:45.394325+0000","last_undegraded":"2023-12-20T04:43:45.394325+0000","last_fullsized":"2023-12-20T04:43:45.394325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:04:03.256460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:43.033909+0000","last_change":"2023-12-20T04:43:43.033909+0000","last_active":"2023-12-20T04:43:43.033909+0000","last_peered":"2023-12-20T04:43:43.033909+0000","last_clean":"2023-12-20T04:43:43.033909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:43.033909+0000","last_undegraded":"2023-12-20T04:43:43.033909+0000","last_fullsized":"2023-12-20T04:43:43.033909+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:43.033909+0000","last_change":"2023-12-20T04:43:43.033909+0000","last_active":"2023-12-20T04:43:43.033909+0000","last_peered":"2023-12-20T04:43:43.033909+0000","last_clean":"2023-12-20T04:43:43.033909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:43.033909+0000","last_undegraded":"2023-12-20T04:43:43.033909+0000","last_fullsized":"2023-12-20T04:43:43.033909+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095855+0000","last_change":"2023-12-20T04:43:44.051288+0000","last_active":"2023-12-20T04:43:46.095855+0000","last_peered":"2023-12-20T04:43:46.095855+0000","last_clean":"2023-12-20T04:43:46.095855+0000","last_became_active":"2023-12-20T04:43:44.051025+0000","last_became_peered":"2023-12-20T04:43:44.051025+0000","last_unstale":"2023-12-20T04:43:46.095855+0000","last_undegraded":"2023-12-20T04:43:46.095855+0000","last_fullsized":"2023-12-20T04:43:46.095855+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:59:36.557399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.406034+0000","last_change":"2023-12-20T04:43:44.405937+0000","last_active":"2023-12-20T04:43:44.406034+0000","last_peered":"2023-12-20T04:43:44.406034+0000","last_clean":"2023-12-20T04:43:44.406034+0000","last_became_active":"2023-12-20T04:43:44.405730+0000","last_became_peered":"2023-12-20T04:43:44.405730+0000","last_unstale":"2023-12-20T04:43:44.406034+0000","last_undegraded":"2023-12-20T04:43:44.406034+0000","last_fullsized":"2023-12-20T04:43:44.406034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:45:51.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:43.033909+0000","last_change":"2023-12-20T04:43:43.033909+0000","last_active":"2023-12-20T04:43:43.033909+0000","last_peered":"2023-12-20T04:43:43.033909+0000","last_clean":"2023-12-20T04:43:43.033909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:43.033909+0000","last_undegraded":"2023-12-20T04:43:43.033909+0000","last_fullsized":"2023-12-20T04:43:43.033909+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.096089+0000","last_change":"2023-12-20T04:43:44.051697+0000","last_active":"2023-12-20T04:43:46.096089+0000","last_peered":"2023-12-20T04:43:46.096089+0000","last_clean":"2023-12-20T04:43:46.096089+0000","last_became_active":"2023-12-20T04:43:44.051476+0000","last_became_peered":"2023-12-20T04:43:44.051476+0000","last_unstale":"2023-12-20T04:43:46.096089+0000","last_undegraded":"2023-12-20T04:43:46.096089+0000","last_fullsized":"2023-12-20T04:43:46.096089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:04:48.952254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.096012+0000","last_change":"2023-12-20T04:43:44.404916+0000","last_active":"2023-12-20T04:43:46.096012+0000","last_peered":"2023-12-20T04:43:46.096012+0000","last_clean":"2023-12-20T04:43:46.096012+0000","last_became_active":"2023-12-20T04:43:44.404679+0000","last_became_peered":"2023-12-20T04:43:44.404679+0000","last_unstale":"2023-12-20T04:43:46.096012+0000","last_undegraded":"2023-12-20T04:43:46.096012+0000","last_fullsized":"2023-12-20T04:43:46.096012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:30:06.553366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399819+0000","last_change":"2023-12-20T04:43:44.047453+0000","last_active":"2023-12-20T04:43:45.399819+0000","last_peered":"2023-12-20T04:43:45.399819+0000","last_clean":"2023-12-20T04:43:45.399819+0000","last_became_active":"2023-12-20T04:43:44.047231+0000","last_became_peered":"2023-12-20T04:43:44.047231+0000","last_unstale":"2023-12-20T04:43:45.399819+0000","last_undegraded":"2023-12-20T04:43:45.399819+0000","last_fullsized":"2023-12-20T04:43:45.399819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:30:16.356339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095966+0000","last_change":"2023-12-20T04:43:44.403367+0000","last_active":"2023-12-20T04:43:46.095966+0000","last_peered":"2023-12-20T04:43:46.095966+0000","last_clean":"2023-12-20T04:43:46.095966+0000","last_became_active":"2023-12-20T04:43:44.403130+0000","last_became_peered":"2023-12-20T04:43:44.403130+0000","last_unstale":"2023-12-20T04:43:46.095966+0000","last_undegraded":"2023-12-20T04:43:46.095966+0000","last_fullsized":"2023-12-20T04:43:46.095966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:02:18.978003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:43.033909+0000","last_change":"2023-12-20T04:43:43.033909+0000","last_active":"2023-12-20T04:43:43.033909+0000","last_peered":"2023-12-20T04:43:43.033909+0000","last_clean":"2023-12-20T04:43:43.033909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:43.033909+0000","last_undegraded":"2023-12-20T04:43:43.033909+0000","last_fullsized":"2023-12-20T04:43:43.033909+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095916+0000","last_change":"2023-12-20T04:43:44.050101+0000","last_active":"2023-12-20T04:43:46.095916+0000","last_peered":"2023-12-20T04:43:46.095916+0000","last_clean":"2023-12-20T04:43:46.095916+0000","last_became_active":"2023-12-20T04:43:44.049794+0000","last_became_peered":"2023-12-20T04:43:44.049794+0000","last_unstale":"2023-12-20T04:43:46.095916+0000","last_undegraded":"2023-12-20T04:43:46.095916+0000","last_fullsized":"2023-12-20T04:43:46.095916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:01:32.129360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.410806+0000","last_change":"2023-12-20T04:43:44.410651+0000","last_active":"2023-12-20T04:43:44.410806+0000","last_peered":"2023-12-20T04:43:44.410806+0000","last_clean":"2023-12-20T04:43:44.410806+0000","last_became_active":"2023-12-20T04:43:44.410296+0000","last_became_peered":"2023-12-20T04:43:44.410296+0000","last_unstale":"2023-12-20T04:43:44.410806+0000","last_undegraded":"2023-12-20T04:43:44.410806+0000","last_fullsized":"2023-12-20T04:43:44.410806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:23:37.936720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:43.033909+0000","last_change":"2023-12-20T04:43:43.033909+0000","last_active":"2023-12-20T04:43:43.033909+0000","last_peered":"2023-12-20T04:43:43.033909+0000","last_clean":"2023-12-20T04:43:43.033909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:43.033909+0000","last_undegraded":"2023-12-20T04:43:43.033909+0000","last_fullsized":"2023-12-20T04:43:43.033909+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095734+0000","last_change":"2023-12-20T04:43:44.402680+0000","last_active":"2023-12-20T04:43:46.095734+0000","last_peered":"2023-12-20T04:43:46.095734+0000","last_clean":"2023-12-20T04:43:46.095734+0000","last_became_active":"2023-12-20T04:43:44.402388+0000","last_became_peered":"2023-12-20T04:43:44.402388+0000","last_unstale":"2023-12-20T04:43:46.095734+0000","last_undegraded":"2023-12-20T04:43:46.095734+0000","last_fullsized":"2023-12-20T04:43:46.095734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:05:39.382072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.395513+0000","last_change":"2023-12-20T04:43:44.049746+0000","last_active":"2023-12-20T04:43:44.395513+0000","last_peered":"2023-12-20T04:43:44.395513+0000","last_clean":"2023-12-20T04:43:44.395513+0000","last_became_active":"2023-12-20T04:43:44.049465+0000","last_became_peered":"2023-12-20T04:43:44.049465+0000","last_unstale":"2023-12-20T04:43:44.395513+0000","last_undegraded":"2023-12-20T04:43:44.395513+0000","last_fullsized":"2023-12-20T04:43:44.395513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:23:15.554185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095855+0000","last_change":"2023-12-20T04:43:44.055091+0000","last_active":"2023-12-20T04:43:46.095855+0000","last_peered":"2023-12-20T04:43:46.095855+0000","last_clean":"2023-12-20T04:43:46.095855+0000","last_became_active":"2023-12-20T04:43:44.054873+0000","last_became_peered":"2023-12-20T04:43:44.054873+0000","last_unstale":"2023-12-20T04:43:46.095855+0000","last_undegraded":"2023-12-20T04:43:46.095855+0000","last_fullsized":"2023-12-20T04:43:46.095855+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:30:16.356339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095533+0000","last_change":"2023-12-20T04:43:44.048384+0000","last_active":"2023-12-20T04:43:46.095533+0000","last_peered":"2023-12-20T04:43:46.095533+0000","last_clean":"2023-12-20T04:43:46.095533+0000","last_became_active":"2023-12-20T04:43:44.048170+0000","last_became_peered":"2023-12-20T04:43:44.048170+0000","last_unstale":"2023-12-20T04:43:46.095533+0000","last_undegraded":"2023-12-20T04:43:46.095533+0000","last_fullsized":"2023-12-20T04:43:46.095533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:00:06.653728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.411105+0000","last_change":"2023-12-20T04:43:44.048493+0000","last_active":"2023-12-20T04:43:44.411105+0000","last_peered":"2023-12-20T04:43:44.411105+0000","last_clean":"2023-12-20T04:43:44.411105+0000","last_became_active":"2023-12-20T04:43:44.048237+0000","last_became_peered":"2023-12-20T04:43:44.048237+0000","last_unstale":"2023-12-20T04:43:44.411105+0000","last_undegraded":"2023-12-20T04:43:44.411105+0000","last_fullsized":"2023-12-20T04:43:44.411105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:30:55.170634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:43.033909+0000","last_change":"2023-12-20T04:43:43.033909+0000","last_active":"2023-12-20T04:43:43.033909+0000","last_peered":"2023-12-20T04:43:43.033909+0000","last_clean":"2023-12-20T04:43:43.033909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:43.033909+0000","last_undegraded":"2023-12-20T04:43:43.033909+0000","last_fullsized":"2023-12-20T04:43:43.033909+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.399378+0000","last_change":"2023-12-20T04:43:44.399320+0000","last_active":"2023-12-20T04:43:44.399378+0000","last_peered":"2023-12-20T04:43:44.399378+0000","last_clean":"2023-12-20T04:43:44.399378+0000","last_became_active":"2023-12-20T04:43:44.399121+0000","last_became_peered":"2023-12-20T04:43:44.399121+0000","last_unstale":"2023-12-20T04:43:44.399378+0000","last_undegraded":"2023-12-20T04:43:44.399378+0000","last_fullsized":"2023-12-20T04:43:44.399378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:02:18.978003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:43.033909+0000","last_change":"2023-12-20T04:43:43.033909+0000","last_active":"2023-12-20T04:43:43.033909+0000","last_peered":"2023-12-20T04:43:43.033909+0000","last_clean":"2023-12-20T04:43:43.033909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:43.033909+0000","last_undegraded":"2023-12-20T04:43:43.033909+0000","last_fullsized":"2023-12-20T04:43:43.033909+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394187+0000","last_change":"2023-12-20T04:43:44.404987+0000","last_active":"2023-12-20T04:43:45.394187+0000","last_peered":"2023-12-20T04:43:45.394187+0000","last_clean":"2023-12-20T04:43:45.394187+0000","last_became_active":"2023-12-20T04:43:44.404761+0000","last_became_peered":"2023-12-20T04:43:44.404761+0000","last_unstale":"2023-12-20T04:43:45.394187+0000","last_undegraded":"2023-12-20T04:43:45.394187+0000","last_fullsized":"2023-12-20T04:43:45.394187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:04:49.958839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:43.033909+0000","last_change":"2023-12-20T04:43:43.033909+0000","last_active":"2023-12-20T04:43:43.033909+0000","last_peered":"2023-12-20T04:43:43.033909+0000","last_clean":"2023-12-20T04:43:43.033909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:43.033909+0000","last_undegraded":"2023-12-20T04:43:43.033909+0000","last_fullsized":"2023-12-20T04:43:43.033909+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394147+0000","last_change":"2023-12-20T04:43:44.403404+0000","last_active":"2023-12-20T04:43:45.394147+0000","last_peered":"2023-12-20T04:43:45.394147+0000","last_clean":"2023-12-20T04:43:45.394147+0000","last_became_active":"2023-12-20T04:43:44.403053+0000","last_became_peered":"2023-12-20T04:43:44.403053+0000","last_unstale":"2023-12-20T04:43:45.394147+0000","last_undegraded":"2023-12-20T04:43:45.394147+0000","last_fullsized":"2023-12-20T04:43:45.394147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:20:05.880912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399784+0000","last_change":"2023-12-20T04:43:44.047635+0000","last_active":"2023-12-20T04:43:45.399784+0000","last_peered":"2023-12-20T04:43:45.399784+0000","last_clean":"2023-12-20T04:43:45.399784+0000","last_became_active":"2023-12-20T04:43:44.047362+0000","last_became_peered":"2023-12-20T04:43:44.047362+0000","last_unstale":"2023-12-20T04:43:45.399784+0000","last_undegraded":"2023-12-20T04:43:45.399784+0000","last_fullsized":"2023-12-20T04:43:45.399784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:20:04.874327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394238+0000","last_change":"2023-12-20T04:43:44.406176+0000","last_active":"2023-12-20T04:43:45.394238+0000","last_peered":"2023-12-20T04:43:45.394238+0000","last_clean":"2023-12-20T04:43:45.394238+0000","last_became_active":"2023-12-20T04:43:44.405949+0000","last_became_peered":"2023-12-20T04:43:44.405949+0000","last_unstale":"2023-12-20T04:43:45.394238+0000","last_undegraded":"2023-12-20T04:43:45.394238+0000","last_fullsized":"2023-12-20T04:43:45.394238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:13:48.244135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:43.033909+0000","last_change":"2023-12-20T04:43:43.033909+0000","last_active":"2023-12-20T04:43:43.033909+0000","last_peered":"2023-12-20T04:43:43.033909+0000","last_clean":"2023-12-20T04:43:43.033909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:43.033909+0000","last_undegraded":"2023-12-20T04:43:43.033909+0000","last_fullsized":"2023-12-20T04:43:43.033909+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394271+0000","last_change":"2023-12-20T04:43:44.400511+0000","last_active":"2023-12-20T04:43:45.394271+0000","last_peered":"2023-12-20T04:43:45.394271+0000","last_clean":"2023-12-20T04:43:45.394271+0000","last_became_active":"2023-12-20T04:43:44.400321+0000","last_became_peered":"2023-12-20T04:43:44.400321+0000","last_unstale":"2023-12-20T04:43:45.394271+0000","last_undegraded":"2023-12-20T04:43:45.394271+0000","last_fullsized":"2023-12-20T04:43:45.394271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:02:27.655420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:43.033909+0000","last_change":"2023-12-20T04:43:43.033909+0000","last_active":"2023-12-20T04:43:43.033909+0000","last_peered":"2023-12-20T04:43:43.033909+0000","last_clean":"2023-12-20T04:43:43.033909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:43.033909+0000","last_undegraded":"2023-12-20T04:43:43.033909+0000","last_fullsized":"2023-12-20T04:43:43.033909+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:43.033909+0000","last_change":"2023-12-20T04:43:43.033909+0000","last_active":"2023-12-20T04:43:43.033909+0000","last_peered":"2023-12-20T04:43:43.033909+0000","last_clean":"2023-12-20T04:43:43.033909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:43.033909+0000","last_undegraded":"2023-12-20T04:43:43.033909+0000","last_fullsized":"2023-12-20T04:43:43.033909+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394325+0000","last_change":"2023-12-20T04:43:44.401890+0000","last_active":"2023-12-20T04:43:45.394325+0000","last_peered":"2023-12-20T04:43:45.394325+0000","last_clean":"2023-12-20T04:43:45.394325+0000","last_became_active":"2023-12-20T04:43:44.401516+0000","last_became_peered":"2023-12-20T04:43:44.401516+0000","last_unstale":"2023-12-20T04:43:45.394325+0000","last_undegraded":"2023-12-20T04:43:45.394325+0000","last_fullsized":"2023-12-20T04:43:45.394325+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:47:27.309735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.411870+0000","last_change":"2023-12-20T04:43:44.050264+0000","last_active":"2023-12-20T04:43:44.411870+0000","last_peered":"2023-12-20T04:43:44.411870+0000","last_clean":"2023-12-20T04:43:44.411870+0000","last_became_active":"2023-12-20T04:43:44.050063+0000","last_became_peered":"2023-12-20T04:43:44.050063+0000","last_unstale":"2023-12-20T04:43:44.411870+0000","last_undegraded":"2023-12-20T04:43:44.411870+0000","last_fullsized":"2023-12-20T04:43:44.411870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:32:55.951038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399852+0000","last_change":"2023-12-20T04:43:44.046853+0000","last_active":"2023-12-20T04:43:45.399852+0000","last_peered":"2023-12-20T04:43:45.399852+0000","last_clean":"2023-12-20T04:43:45.399852+0000","last_became_active":"2023-12-20T04:43:44.046629+0000","last_became_peered":"2023-12-20T04:43:44.046629+0000","last_unstale":"2023-12-20T04:43:45.399852+0000","last_undegraded":"2023-12-20T04:43:45.399852+0000","last_fullsized":"2023-12-20T04:43:45.399852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:04:48.952254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399577+0000","last_change":"2023-12-20T04:43:44.408541+0000","last_active":"2023-12-20T04:43:45.399577+0000","last_peered":"2023-12-20T04:43:45.399577+0000","last_clean":"2023-12-20T04:43:45.399577+0000","last_became_active":"2023-12-20T04:43:44.408320+0000","last_became_peered":"2023-12-20T04:43:44.408320+0000","last_unstale":"2023-12-20T04:43:45.399577+0000","last_undegraded":"2023-12-20T04:43:45.399577+0000","last_fullsized":"2023-12-20T04:43:45.399577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:30:55.643499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.396661+0000","last_change":"2023-12-20T04:43:44.054408+0000","last_active":"2023-12-20T04:43:44.396661+0000","last_peered":"2023-12-20T04:43:44.396661+0000","last_clean":"2023-12-20T04:43:44.396661+0000","last_became_active":"2023-12-20T04:43:44.051930+0000","last_became_peered":"2023-12-20T04:43:44.051930+0000","last_unstale":"2023-12-20T04:43:44.396661+0000","last_undegraded":"2023-12-20T04:43:44.396661+0000","last_fullsized":"2023-12-20T04:43:44.396661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:09.832128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399832+0000","last_change":"2023-12-20T04:43:44.050464+0000","last_active":"2023-12-20T04:43:45.399832+0000","last_peered":"2023-12-20T04:43:45.399832+0000","last_clean":"2023-12-20T04:43:45.399832+0000","last_became_active":"2023-12-20T04:43:44.050200+0000","last_became_peered":"2023-12-20T04:43:44.050200+0000","last_unstale":"2023-12-20T04:43:45.399832+0000","last_undegraded":"2023-12-20T04:43:45.399832+0000","last_fullsized":"2023-12-20T04:43:45.399832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:06:15.996824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399704+0000","last_change":"2023-12-20T04:43:44.406976+0000","last_active":"2023-12-20T04:43:45.399704+0000","last_peered":"2023-12-20T04:43:45.399704+0000","last_clean":"2023-12-20T04:43:45.399704+0000","last_became_active":"2023-12-20T04:43:44.406771+0000","last_became_peered":"2023-12-20T04:43:44.406771+0000","last_unstale":"2023-12-20T04:43:45.399704+0000","last_undegraded":"2023-12-20T04:43:45.399704+0000","last_fullsized":"2023-12-20T04:43:45.399704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:27:51.098780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.396484+0000","last_change":"2023-12-20T04:43:44.055748+0000","last_active":"2023-12-20T04:43:44.396484+0000","last_peered":"2023-12-20T04:43:44.396484+0000","last_clean":"2023-12-20T04:43:44.396484+0000","last_became_active":"2023-12-20T04:43:44.055489+0000","last_became_peered":"2023-12-20T04:43:44.055489+0000","last_unstale":"2023-12-20T04:43:44.396484+0000","last_undegraded":"2023-12-20T04:43:44.396484+0000","last_fullsized":"2023-12-20T04:43:44.396484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:27:50.092195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095646+0000","last_change":"2023-12-20T04:43:44.409233+0000","last_active":"2023-12-20T04:43:46.095646+0000","last_peered":"2023-12-20T04:43:46.095646+0000","last_clean":"2023-12-20T04:43:46.095646+0000","last_became_active":"2023-12-20T04:43:44.406561+0000","last_became_peered":"2023-12-20T04:43:44.406561+0000","last_unstale":"2023-12-20T04:43:46.095646+0000","last_undegraded":"2023-12-20T04:43:46.095646+0000","last_fullsized":"2023-12-20T04:43:46.095646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:23:37.936720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:43.033909+0000","last_change":"2023-12-20T04:43:43.033909+0000","last_active":"2023-12-20T04:43:43.033909+0000","last_peered":"2023-12-20T04:43:43.033909+0000","last_clean":"2023-12-20T04:43:43.033909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:43.033909+0000","last_undegraded":"2023-12-20T04:43:43.033909+0000","last_fullsized":"2023-12-20T04:43:43.033909+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.096006+0000","last_change":"2023-12-20T04:43:44.056886+0000","last_active":"2023-12-20T04:43:46.096006+0000","last_peered":"2023-12-20T04:43:46.096006+0000","last_clean":"2023-12-20T04:43:46.096006+0000","last_became_active":"2023-12-20T04:43:44.056143+0000","last_became_peered":"2023-12-20T04:43:44.056143+0000","last_unstale":"2023-12-20T04:43:46.096006+0000","last_undegraded":"2023-12-20T04:43:46.096006+0000","last_fullsized":"2023-12-20T04:43:46.096006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:06:15.996824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:44.040494+0000","last_change":"2023-12-20T04:43:44.040494+0000","last_active":"2023-12-20T04:43:44.040494+0000","last_peered":"2023-12-20T04:43:44.040494+0000","last_clean":"2023-12-20T04:43:44.040494+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:44.040494+0000","last_undegraded":"2023-12-20T04:43:44.040494+0000","last_fullsized":"2023-12-20T04:43:44.040494+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:43:43.033909+0000","last_change":"2023-12-20T04:43:43.033909+0000","last_active":"2023-12-20T04:43:43.033909+0000","last_peered":"2023-12-20T04:43:43.033909+0000","last_clean":"2023-12-20T04:43:43.033909+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:43:43.033909+0000","last_undegraded":"2023-12-20T04:43:43.033909+0000","last_fullsized":"2023-12-20T04:43:43.033909+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":170,"reported_epoch":28,"state":"active+clean","last_fresh":"2023-12-20T04:43:38.610952+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:43:38.610952+0000","last_peered":"2023-12-20T04:43:38.610952+0000","last_clean":"2023-12-20T04:43:38.610952+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:43:38.610952+0000","last_undegraded":"2023-12-20T04:43:38.610952+0000","last_fullsized":"2023-12-20T04:43:38.610952+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":60,"acting":60,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":1586,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":9,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24,"ondisk_log_size":24,"up":36,"acting":36,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574863,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":694,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194618,"statfs":{"total":200000000,"available":199289003,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.62}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.64900000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46500000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.58399999999999996}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.63400000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.501},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.67400000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.53200000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195194,"statfs":{"total":200000000,"available":199879371,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.54000000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.58099999999999996}]},{"osd":2,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.5},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.627}]},{"osd":3,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.56399999999999995}]},{"osd":4,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.46200000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.67500000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.66600000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.68899999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195194,"statfs":{"total":200000000,"available":199879371,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.432},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.46300000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.44600000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.63}]},{"osd":3,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.52500000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.48799999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.51100000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.70799999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574863,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":117,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195194,"statfs":{"total":200000000,"available":199879371,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.371}]},{"osd":1,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.435}]},{"osd":2,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.45300000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.64600000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.628}]},{"osd":6,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.55100000000000005}]},{"osd":7,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.57199999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":137,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195174,"statfs":{"total":200000000,"available":199858926,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.36799999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.34399999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.41799999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48999999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.53300000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.627}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860442,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.374,"5min":0.374,"15min":0.374},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.30199999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.32300000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.34799999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.46000000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.438},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.44800000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.47099999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.49399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":137,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195174,"statfs":{"total":200000000,"available":199858926,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.193},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.26500000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.308},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.22600000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.32800000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.51700000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.52400000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.49399999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194593,"statfs":{"total":200000000,"available":199263844,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.317},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.41099999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.37}]},{"osd":3,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.38500000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.64100000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.77000000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.754},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.81399999999999995}]}]}],"pool_statfs":[]}} 2023-12-20T04:43:48.004 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:43:48.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.138+0000 7fc921b00640 1 Processor -- start 2023-12-20T04:43:48.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.139+0000 7fc921b00640 1 -- start start 2023-12-20T04:43:48.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.139+0000 7fc921b00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc91c15d100 0x7fc91c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.139+0000 7fc921b00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc91c0cdc10 0x7fc91c06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.139+0000 7fc921b00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc91c0b2f90 con 0x7fc91c0d0370 2023-12-20T04:43:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.139+0000 7fc921b00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc91c1613c0 con 0x7fc91c15d100 2023-12-20T04:43:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.139+0000 7fc921b00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c0d1b00 con 0x7fc91c0cdc10 2023-12-20T04:43:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.139+0000 7fc91b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc91c15d100 0x7fc91c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.139+0000 7fc91b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc91c15d100 0x7fc91c0b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35144/0 (socket says 172.21.15.132:35144) 2023-12-20T04:43:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.139+0000 7fc912ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc91c0d0370 0x7fc91c0cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57702/0 (socket says 172.21.15.132:57702) 2023-12-20T04:43:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.140+0000 7fc91b7fe640 1 -- 172.21.15.132:0/73150480 learned_addr learned my addr 172.21.15.132:0/73150480 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.140+0000 7fc91bfff640 1 --2- 172.21.15.132:0/73150480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc91c0cdc10 0x7fc91c06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.140+0000 7fc91b7fe640 1 -- 172.21.15.132:0/73150480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc91c0cdc10 msgr2=0x7fc91c06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.140+0000 7fc91b7fe640 1 --2- 172.21.15.132:0/73150480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc91c0cdc10 0x7fc91c06c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.140+0000 7fc91b7fe640 1 -- 172.21.15.132:0/73150480 >> v1:172.21.15.132:6789/0 conn(0x7fc91c0d0370 legacy=0x7fc91c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.140+0000 7fc91affd640 1 -- 172.21.15.132:0/73150480 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 579621043 0 0) 0x7fc904001110 con 0x7fc91c0d0370 2023-12-20T04:43:48.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.140+0000 7fc91b7fe640 1 -- 172.21.15.132:0/73150480 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc91c0d0810 con 0x7fc91c15d100 2023-12-20T04:43:48.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.140+0000 7fc91b7fe640 1 --2- 172.21.15.132:0/73150480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc91c15d100 0x7fc91c0b2a50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009870 tx=0x7fc90c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d30285ef4947aeaa server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:48.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.141+0000 7fc91affd640 1 -- 172.21.15.132:0/73150480 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c030840 con 0x7fc91c15d100 2023-12-20T04:43:48.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.141+0000 7fc91affd640 1 -- 172.21.15.132:0/73150480 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc90c0309a0 con 0x7fc91c15d100 2023-12-20T04:43:48.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.141+0000 7fc91affd640 1 -- 172.21.15.132:0/73150480 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc90c030d30 con 0x7fc91c15d100 2023-12-20T04:43:48.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.141+0000 7fc921b00640 1 -- 172.21.15.132:0/73150480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc91c15d100 msgr2=0x7fc91c0b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:48.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.141+0000 7fc921b00640 1 --2- 172.21.15.132:0/73150480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc91c15d100 0x7fc91c0b2a50 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7fc90c009870 tx=0x7fc90c02b980 comp rx=0 tx=0).stop 2023-12-20T04:43:48.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.141+0000 7fc921b00640 1 -- 172.21.15.132:0/73150480 shutdown_connections 2023-12-20T04:43:48.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.141+0000 7fc921b00640 1 --2- 172.21.15.132:0/73150480 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc91c0cdc10 0x7fc91c06c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.141+0000 7fc921b00640 1 --2- 172.21.15.132:0/73150480 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc91c15d100 0x7fc91c0b2a50 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.141+0000 7fc921b00640 1 -- 172.21.15.132:0/73150480 >> 172.21.15.132:0/73150480 conn(0x7fc91c06d7c0 msgr2=0x7fc91c06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:48.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.141+0000 7fc921b00640 1 -- 172.21.15.132:0/73150480 shutdown_connections 2023-12-20T04:43:48.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.141+0000 7fc921b00640 1 -- 172.21.15.132:0/73150480 wait complete. 2023-12-20T04:43:48.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.142+0000 7fc921b00640 1 Processor -- start 2023-12-20T04:43:48.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.143+0000 7fc921b00640 1 -- start start 2023-12-20T04:43:48.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.143+0000 7fc921b00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc91c0cdc10 0x7fc91c0c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.143+0000 7fc921b00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc91c0d0370 0x7fc91c0c9490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.143+0000 7fc921b00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc91c15d100 0x7fc91c0c99d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.143+0000 7fc921b00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c15fc00 con 0x7fc91c15d100 2023-12-20T04:43:48.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.143+0000 7fc921b00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c15e3a0 con 0x7fc91c0d0370 2023-12-20T04:43:48.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.143+0000 7fc921b00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc91c1f3170 con 0x7fc91c0cdc10 2023-12-20T04:43:48.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.143+0000 7fc91bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc91c15d100 0x7fc91c0c99d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:48.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.143+0000 7fc91bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc91c15d100 0x7fc91c0c99d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35156/0 (socket says 172.21.15.132:35156) 2023-12-20T04:43:48.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.143+0000 7fc91bfff640 1 -- 172.21.15.132:0/1069255066 learned_addr learned my addr 172.21.15.132:0/1069255066 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:48.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.143+0000 7fc91b7fe640 1 --2- 172.21.15.132:0/1069255066 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc91c0cdc10 0x7fc91c0c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:48.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.143+0000 7fc912ffd640 1 --2- 172.21.15.132:0/1069255066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc91c0d0370 0x7fc91c0c9490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:48.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.144+0000 7fc91bfff640 1 -- 172.21.15.132:0/1069255066 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc91c0cdc10 msgr2=0x7fc91c0c70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:48.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.144+0000 7fc91bfff640 1 --2- 172.21.15.132:0/1069255066 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc91c0cdc10 0x7fc91c0c70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.144+0000 7fc91bfff640 1 -- 172.21.15.132:0/1069255066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc91c0d0370 msgr2=0x7fc91c0c9490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:48.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.144+0000 7fc91bfff640 1 --2- 172.21.15.132:0/1069255066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc91c0d0370 0x7fc91c0c9490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.144+0000 7fc91bfff640 1 -- 172.21.15.132:0/1069255066 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc90c0094d0 con 0x7fc91c15d100 2023-12-20T04:43:48.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.144+0000 7fc91bfff640 1 --2- 172.21.15.132:0/1069255066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc91c15d100 0x7fc91c0c99d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc91400efc0 tx=0x7fc91400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:48.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.144+0000 7fc918ff9640 1 -- 172.21.15.132:0/1069255066 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc914009ba0 con 0x7fc91c15d100 2023-12-20T04:43:48.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.144+0000 7fc918ff9640 1 -- 172.21.15.132:0/1069255066 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc91400f040 con 0x7fc91c15d100 2023-12-20T04:43:48.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.144+0000 7fc921b00640 1 -- 172.21.15.132:0/1069255066 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc91c15e0c0 con 0x7fc91c15d100 2023-12-20T04:43:48.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.144+0000 7fc918ff9640 1 -- 172.21.15.132:0/1069255066 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9140146c0 con 0x7fc91c15d100 2023-12-20T04:43:48.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.144+0000 7fc921b00640 1 -- 172.21.15.132:0/1069255066 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc91c1f3710 con 0x7fc91c15d100 2023-12-20T04:43:48.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.145+0000 7fc921b00640 1 -- 172.21.15.132:0/1069255066 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc91c0cda30 con 0x7fc91c15d100 2023-12-20T04:43:48.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.145+0000 7fc918ff9640 1 -- 172.21.15.132:0/1069255066 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc914014820 con 0x7fc91c15d100 2023-12-20T04:43:48.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.146+0000 7fc918ff9640 1 --2- 172.21.15.132:0/1069255066 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8fc06a430 0x7fc8fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.146+0000 7fc918ff9640 1 -- 172.21.15.132:0/1069255066 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc914089220 con 0x7fc91c15d100 2023-12-20T04:43:48.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.146+0000 7fc91b7fe640 1 --2- 172.21.15.132:0/1069255066 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8fc06a430 0x7fc8fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:48.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.146+0000 7fc91b7fe640 1 --2- 172.21.15.132:0/1069255066 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8fc06a430 0x7fc8fc06c8f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc90c036000 tx=0x7fc90c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:48.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.150+0000 7fc918ff9640 1 -- 172.21.15.132:0/1069255066 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc914054950 con 0x7fc91c15d100 2023-12-20T04:43:48.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.314+0000 7fc921b00640 1 -- 172.21.15.132:0/1069255066 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc91c161050 con 0x7fc8fc06a430 2023-12-20T04:43:48.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.321+0000 7fc918ff9640 1 -- 172.21.15.132:0/1069255066 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284986 (secure 0 0 0) 0x7fc90c030b90 con 0x7fc8fc06a430 2023-12-20T04:43:48.326 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:48.327 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:43:48.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.324+0000 7fc921b00640 1 -- 172.21.15.132:0/1069255066 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8fc06a430 msgr2=0x7fc8fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:48.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.324+0000 7fc921b00640 1 --2- 172.21.15.132:0/1069255066 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8fc06a430 0x7fc8fc06c8f0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fc90c036000 tx=0x7fc90c008030 comp rx=0 tx=0).stop 2023-12-20T04:43:48.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.324+0000 7fc921b00640 1 -- 172.21.15.132:0/1069255066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc91c15d100 msgr2=0x7fc91c0c99d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:48.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.324+0000 7fc921b00640 1 --2- 172.21.15.132:0/1069255066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc91c15d100 0x7fc91c0c99d0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7fc91400efc0 tx=0x7fc91400c490 comp rx=0 tx=0).stop 2023-12-20T04:43:48.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.324+0000 7fc921b00640 1 -- 172.21.15.132:0/1069255066 shutdown_connections 2023-12-20T04:43:48.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.324+0000 7fc921b00640 1 --2- 172.21.15.132:0/1069255066 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8fc06a430 0x7fc8fc06c8f0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.324+0000 7fc921b00640 1 --2- 172.21.15.132:0/1069255066 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc91c15d100 0x7fc91c0c99d0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.324+0000 7fc921b00640 1 --2- 172.21.15.132:0/1069255066 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc91c0d0370 0x7fc91c0c9490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.324+0000 7fc921b00640 1 --2- 172.21.15.132:0/1069255066 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc91c0cdc10 0x7fc91c0c70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.324+0000 7fc921b00640 1 -- 172.21.15.132:0/1069255066 >> 172.21.15.132:0/1069255066 conn(0x7fc91c06d7c0 msgr2=0x7fc91c0b1dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:48.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.325+0000 7fc921b00640 1 -- 172.21.15.132:0/1069255066 shutdown_connections 2023-12-20T04:43:48.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.325+0000 7fc921b00640 1 -- 172.21.15.132:0/1069255066 wait complete. 2023-12-20T04:43:48.337 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":61,"stamp":"2023-12-20T04:43:48.104957+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":122,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2259,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1560240,"statfs":{"total":1600000000,"available":1597686036,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.064130"},"pg_stats":[{"pgid":"5.3f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.410366+0000","last_change":"2023-12-20T04:43:44.410304+0000","last_active":"2023-12-20T04:43:44.410366+0000","last_peered":"2023-12-20T04:43:44.410366+0000","last_clean":"2023-12-20T04:43:44.410366+0000","last_became_active":"2023-12-20T04:43:44.410072+0000","last_became_peered":"2023-12-20T04:43:44.410072+0000","last_unstale":"2023-12-20T04:43:44.410366+0000","last_undegraded":"2023-12-20T04:43:44.410366+0000","last_fullsized":"2023-12-20T04:43:44.410366+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:54:11.630607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.3e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095706+0000","last_change":"2023-12-20T04:43:44.403283+0000","last_active":"2023-12-20T04:43:46.095706+0000","last_peered":"2023-12-20T04:43:46.095706+0000","last_clean":"2023-12-20T04:43:46.095706+0000","last_became_active":"2023-12-20T04:43:44.403071+0000","last_became_peered":"2023-12-20T04:43:44.403071+0000","last_unstale":"2023-12-20T04:43:46.095706+0000","last_undegraded":"2023-12-20T04:43:46.095706+0000","last_fullsized":"2023-12-20T04:43:46.095706+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:45:51.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.3d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.403201+0000","last_change":"2023-12-20T04:43:44.403127+0000","last_active":"2023-12-20T04:43:44.403201+0000","last_peered":"2023-12-20T04:43:44.403201+0000","last_clean":"2023-12-20T04:43:44.403201+0000","last_became_active":"2023-12-20T04:43:44.402565+0000","last_became_peered":"2023-12-20T04:43:44.402565+0000","last_unstale":"2023-12-20T04:43:44.403201+0000","last_undegraded":"2023-12-20T04:43:44.403201+0000","last_fullsized":"2023-12-20T04:43:44.403201+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:48.680746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.3c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.405568+0000","last_change":"2023-12-20T04:43:44.405503+0000","last_active":"2023-12-20T04:43:44.405568+0000","last_peered":"2023-12-20T04:43:44.405568+0000","last_clean":"2023-12-20T04:43:44.405568+0000","last_became_active":"2023-12-20T04:43:44.405210+0000","last_became_peered":"2023-12-20T04:43:44.405210+0000","last_unstale":"2023-12-20T04:43:44.405568+0000","last_undegraded":"2023-12-20T04:43:44.405568+0000","last_fullsized":"2023-12-20T04:43:44.405568+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:28:35.210138+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394241+0000","last_change":"2023-12-20T04:43:44.404400+0000","last_active":"2023-12-20T04:43:45.394241+0000","last_peered":"2023-12-20T04:43:45.394241+0000","last_clean":"2023-12-20T04:43:45.394241+0000","last_became_active":"2023-12-20T04:43:44.404172+0000","last_became_peered":"2023-12-20T04:43:44.404172+0000","last_unstale":"2023-12-20T04:43:45.394241+0000","last_undegraded":"2023-12-20T04:43:45.394241+0000","last_fullsized":"2023-12-20T04:43:45.394241+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:06:17.003408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.3a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095818+0000","last_change":"2023-12-20T04:43:44.400411+0000","last_active":"2023-12-20T04:43:46.095818+0000","last_peered":"2023-12-20T04:43:46.095818+0000","last_clean":"2023-12-20T04:43:46.095818+0000","last_became_active":"2023-12-20T04:43:44.400213+0000","last_became_peered":"2023-12-20T04:43:44.400213+0000","last_unstale":"2023-12-20T04:43:46.095818+0000","last_undegraded":"2023-12-20T04:43:46.095818+0000","last_fullsized":"2023-12-20T04:43:46.095818+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:48.680746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.39","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.737474+0000","last_change":"2023-12-20T04:43:44.407513+0000","last_active":"2023-12-20T04:43:45.737474+0000","last_peered":"2023-12-20T04:43:45.737474+0000","last_clean":"2023-12-20T04:43:45.737474+0000","last_became_active":"2023-12-20T04:43:44.407280+0000","last_became_peered":"2023-12-20T04:43:44.407280+0000","last_unstale":"2023-12-20T04:43:45.737474+0000","last_undegraded":"2023-12-20T04:43:45.737474+0000","last_fullsized":"2023-12-20T04:43:45.737474+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:07:11.099910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.38","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.737464+0000","last_change":"2023-12-20T04:43:44.404655+0000","last_active":"2023-12-20T04:43:45.737464+0000","last_peered":"2023-12-20T04:43:45.737464+0000","last_clean":"2023-12-20T04:43:45.737464+0000","last_became_active":"2023-12-20T04:43:44.404443+0000","last_became_peered":"2023-12-20T04:43:44.404443+0000","last_unstale":"2023-12-20T04:43:45.737464+0000","last_undegraded":"2023-12-20T04:43:45.737464+0000","last_fullsized":"2023-12-20T04:43:45.737464+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:10:27.796498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.37","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.397569+0000","last_change":"2023-12-20T04:43:44.401925+0000","last_active":"2023-12-20T04:43:45.397569+0000","last_peered":"2023-12-20T04:43:45.397569+0000","last_clean":"2023-12-20T04:43:45.397569+0000","last_became_active":"2023-12-20T04:43:44.401689+0000","last_became_peered":"2023-12-20T04:43:44.401689+0000","last_unstale":"2023-12-20T04:43:45.397569+0000","last_undegraded":"2023-12-20T04:43:45.397569+0000","last_fullsized":"2023-12-20T04:43:45.397569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:27:51.098780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.36","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.403693+0000","last_change":"2023-12-20T04:43:44.403634+0000","last_active":"2023-12-20T04:43:44.403693+0000","last_peered":"2023-12-20T04:43:44.403693+0000","last_clean":"2023-12-20T04:43:44.403693+0000","last_became_active":"2023-12-20T04:43:44.403416+0000","last_became_peered":"2023-12-20T04:43:44.403416+0000","last_unstale":"2023-12-20T04:43:44.403693+0000","last_undegraded":"2023-12-20T04:43:44.403693+0000","last_fullsized":"2023-12-20T04:43:44.403693+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:43:50.362019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.35","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.737504+0000","last_change":"2023-12-20T04:43:44.409881+0000","last_active":"2023-12-20T04:43:45.737504+0000","last_peered":"2023-12-20T04:43:45.737504+0000","last_clean":"2023-12-20T04:43:45.737504+0000","last_became_active":"2023-12-20T04:43:44.409663+0000","last_became_peered":"2023-12-20T04:43:44.409663+0000","last_unstale":"2023-12-20T04:43:45.737504+0000","last_undegraded":"2023-12-20T04:43:45.737504+0000","last_fullsized":"2023-12-20T04:43:45.737504+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:48.680746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.34","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.405328+0000","last_change":"2023-12-20T04:43:44.405267+0000","last_active":"2023-12-20T04:43:44.405328+0000","last_peered":"2023-12-20T04:43:44.405328+0000","last_clean":"2023-12-20T04:43:44.405328+0000","last_became_active":"2023-12-20T04:43:44.404780+0000","last_became_peered":"2023-12-20T04:43:44.404780+0000","last_unstale":"2023-12-20T04:43:44.405328+0000","last_undegraded":"2023-12-20T04:43:44.405328+0000","last_fullsized":"2023-12-20T04:43:44.405328+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:10:33.759648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.33","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394147+0000","last_change":"2023-12-20T04:43:44.401708+0000","last_active":"2023-12-20T04:43:45.394147+0000","last_peered":"2023-12-20T04:43:45.394147+0000","last_clean":"2023-12-20T04:43:45.394147+0000","last_became_active":"2023-12-20T04:43:44.401241+0000","last_became_peered":"2023-12-20T04:43:44.401241+0000","last_unstale":"2023-12-20T04:43:45.394147+0000","last_undegraded":"2023-12-20T04:43:45.394147+0000","last_fullsized":"2023-12-20T04:43:45.394147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:30:17.362923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.32","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095799+0000","last_change":"2023-12-20T04:43:44.401275+0000","last_active":"2023-12-20T04:43:46.095799+0000","last_peered":"2023-12-20T04:43:46.095799+0000","last_clean":"2023-12-20T04:43:46.095799+0000","last_became_active":"2023-12-20T04:43:44.401061+0000","last_became_peered":"2023-12-20T04:43:44.401061+0000","last_unstale":"2023-12-20T04:43:46.095799+0000","last_undegraded":"2023-12-20T04:43:46.095799+0000","last_fullsized":"2023-12-20T04:43:46.095799+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:43:50.362019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.31","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.403973+0000","last_change":"2023-12-20T04:43:44.403902+0000","last_active":"2023-12-20T04:43:44.403973+0000","last_peered":"2023-12-20T04:43:44.403973+0000","last_clean":"2023-12-20T04:43:44.403973+0000","last_became_active":"2023-12-20T04:43:44.403679+0000","last_became_peered":"2023-12-20T04:43:44.403679+0000","last_unstale":"2023-12-20T04:43:44.403973+0000","last_undegraded":"2023-12-20T04:43:44.403973+0000","last_fullsized":"2023-12-20T04:43:44.403973+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:51:16.399770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.30","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.737569+0000","last_change":"2023-12-20T04:43:44.409346+0000","last_active":"2023-12-20T04:43:45.737569+0000","last_peered":"2023-12-20T04:43:45.737569+0000","last_clean":"2023-12-20T04:43:45.737569+0000","last_became_active":"2023-12-20T04:43:44.408809+0000","last_became_peered":"2023-12-20T04:43:44.408809+0000","last_unstale":"2023-12-20T04:43:45.737569+0000","last_undegraded":"2023-12-20T04:43:45.737569+0000","last_fullsized":"2023-12-20T04:43:45.737569+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:40:37.963289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2f","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.737153+0000","last_change":"2023-12-20T04:43:44.406419+0000","last_active":"2023-12-20T04:43:45.737153+0000","last_peered":"2023-12-20T04:43:45.737153+0000","last_clean":"2023-12-20T04:43:45.737153+0000","last_became_active":"2023-12-20T04:43:44.406188+0000","last_became_peered":"2023-12-20T04:43:44.406188+0000","last_unstale":"2023-12-20T04:43:45.737153+0000","last_undegraded":"2023-12-20T04:43:45.737153+0000","last_fullsized":"2023-12-20T04:43:45.737153+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:05:39.382072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095721+0000","last_change":"2023-12-20T04:43:44.399860+0000","last_active":"2023-12-20T04:43:46.095721+0000","last_peered":"2023-12-20T04:43:46.095721+0000","last_clean":"2023-12-20T04:43:46.095721+0000","last_became_active":"2023-12-20T04:43:44.399653+0000","last_became_peered":"2023-12-20T04:43:44.399653+0000","last_unstale":"2023-12-20T04:43:46.095721+0000","last_undegraded":"2023-12-20T04:43:46.095721+0000","last_fullsized":"2023-12-20T04:43:46.095721+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:58:32.295652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095546+0000","last_change":"2023-12-20T04:43:44.409106+0000","last_active":"2023-12-20T04:43:46.095546+0000","last_peered":"2023-12-20T04:43:46.095546+0000","last_clean":"2023-12-20T04:43:46.095546+0000","last_became_active":"2023-12-20T04:43:44.406107+0000","last_became_peered":"2023-12-20T04:43:44.406107+0000","last_unstale":"2023-12-20T04:43:46.095546+0000","last_undegraded":"2023-12-20T04:43:46.095546+0000","last_fullsized":"2023-12-20T04:43:46.095546+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:06:02.247224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394319+0000","last_change":"2023-12-20T04:43:44.402288+0000","last_active":"2023-12-20T04:43:45.394319+0000","last_peered":"2023-12-20T04:43:45.394319+0000","last_clean":"2023-12-20T04:43:45.394319+0000","last_became_active":"2023-12-20T04:43:44.402089+0000","last_became_peered":"2023-12-20T04:43:44.402089+0000","last_unstale":"2023-12-20T04:43:45.394319+0000","last_undegraded":"2023-12-20T04:43:45.394319+0000","last_fullsized":"2023-12-20T04:43:45.394319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:41:43.008554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.2b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.397481+0000","last_change":"2023-12-20T04:43:44.400809+0000","last_active":"2023-12-20T04:43:45.397481+0000","last_peered":"2023-12-20T04:43:45.397481+0000","last_clean":"2023-12-20T04:43:45.397481+0000","last_became_active":"2023-12-20T04:43:44.399415+0000","last_became_peered":"2023-12-20T04:43:44.399415+0000","last_unstale":"2023-12-20T04:43:45.397481+0000","last_undegraded":"2023-12-20T04:43:45.397481+0000","last_fullsized":"2023-12-20T04:43:45.397481+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:59:37.563983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.2a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.397837+0000","last_change":"2023-12-20T04:43:44.405635+0000","last_active":"2023-12-20T04:43:45.397837+0000","last_peered":"2023-12-20T04:43:45.397837+0000","last_clean":"2023-12-20T04:43:45.397837+0000","last_became_active":"2023-12-20T04:43:44.401271+0000","last_became_peered":"2023-12-20T04:43:44.401271+0000","last_unstale":"2023-12-20T04:43:45.397837+0000","last_undegraded":"2023-12-20T04:43:45.397837+0000","last_fullsized":"2023-12-20T04:43:45.397837+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:32:56.957622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.29","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399704+0000","last_change":"2023-12-20T04:43:44.408696+0000","last_active":"2023-12-20T04:43:45.399704+0000","last_peered":"2023-12-20T04:43:45.399704+0000","last_clean":"2023-12-20T04:43:45.399704+0000","last_became_active":"2023-12-20T04:43:44.407491+0000","last_became_peered":"2023-12-20T04:43:44.407491+0000","last_unstale":"2023-12-20T04:43:45.399704+0000","last_undegraded":"2023-12-20T04:43:45.399704+0000","last_fullsized":"2023-12-20T04:43:45.399704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:32:56.957622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.28","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.399110+0000","last_change":"2023-12-20T04:43:44.399035+0000","last_active":"2023-12-20T04:43:44.399110+0000","last_peered":"2023-12-20T04:43:44.399110+0000","last_clean":"2023-12-20T04:43:44.399110+0000","last_became_active":"2023-12-20T04:43:44.398775+0000","last_became_peered":"2023-12-20T04:43:44.398775+0000","last_unstale":"2023-12-20T04:43:44.399110+0000","last_undegraded":"2023-12-20T04:43:44.399110+0000","last_fullsized":"2023-12-20T04:43:44.399110+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:40:37.963289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.27","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.404221+0000","last_change":"2023-12-20T04:43:44.404157+0000","last_active":"2023-12-20T04:43:44.404221+0000","last_peered":"2023-12-20T04:43:44.404221+0000","last_clean":"2023-12-20T04:43:44.404221+0000","last_became_active":"2023-12-20T04:43:44.403902+0000","last_became_peered":"2023-12-20T04:43:44.403902+0000","last_unstale":"2023-12-20T04:43:44.404221+0000","last_undegraded":"2023-12-20T04:43:44.404221+0000","last_fullsized":"2023-12-20T04:43:44.404221+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:10:11.259150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.26","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095918+0000","last_change":"2023-12-20T04:43:44.405950+0000","last_active":"2023-12-20T04:43:46.095918+0000","last_peered":"2023-12-20T04:43:46.095918+0000","last_clean":"2023-12-20T04:43:46.095918+0000","last_became_active":"2023-12-20T04:43:44.405687+0000","last_became_peered":"2023-12-20T04:43:44.405687+0000","last_unstale":"2023-12-20T04:43:46.095918+0000","last_undegraded":"2023-12-20T04:43:46.095918+0000","last_fullsized":"2023-12-20T04:43:46.095918+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:40:37.963289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.25","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.406587+0000","last_change":"2023-12-20T04:43:44.406525+0000","last_active":"2023-12-20T04:43:44.406587+0000","last_peered":"2023-12-20T04:43:44.406587+0000","last_clean":"2023-12-20T04:43:44.406587+0000","last_became_active":"2023-12-20T04:43:44.406259+0000","last_became_peered":"2023-12-20T04:43:44.406259+0000","last_unstale":"2023-12-20T04:43:44.406587+0000","last_undegraded":"2023-12-20T04:43:44.406587+0000","last_fullsized":"2023-12-20T04:43:44.406587+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:06:02.247224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.24","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.403928+0000","last_change":"2023-12-20T04:43:44.403859+0000","last_active":"2023-12-20T04:43:44.403928+0000","last_peered":"2023-12-20T04:43:44.403928+0000","last_clean":"2023-12-20T04:43:44.403928+0000","last_became_active":"2023-12-20T04:43:44.403632+0000","last_became_peered":"2023-12-20T04:43:44.403632+0000","last_unstale":"2023-12-20T04:43:44.403928+0000","last_undegraded":"2023-12-20T04:43:44.403928+0000","last_fullsized":"2023-12-20T04:43:44.403928+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:23:16.560770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.23","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.397682+0000","last_change":"2023-12-20T04:43:44.405199+0000","last_active":"2023-12-20T04:43:45.397682+0000","last_peered":"2023-12-20T04:43:45.397682+0000","last_clean":"2023-12-20T04:43:45.397682+0000","last_became_active":"2023-12-20T04:43:44.404970+0000","last_became_peered":"2023-12-20T04:43:44.404970+0000","last_unstale":"2023-12-20T04:43:45.397682+0000","last_undegraded":"2023-12-20T04:43:45.397682+0000","last_fullsized":"2023-12-20T04:43:45.397682+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:10.838713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.22","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.737538+0000","last_change":"2023-12-20T04:43:44.408029+0000","last_active":"2023-12-20T04:43:45.737538+0000","last_peered":"2023-12-20T04:43:45.737538+0000","last_clean":"2023-12-20T04:43:45.737538+0000","last_became_active":"2023-12-20T04:43:44.407800+0000","last_became_peered":"2023-12-20T04:43:44.407800+0000","last_unstale":"2023-12-20T04:43:45.737538+0000","last_undegraded":"2023-12-20T04:43:45.737538+0000","last_fullsized":"2023-12-20T04:43:45.737538+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:30:56.177219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.21","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.404125+0000","last_change":"2023-12-20T04:43:44.403827+0000","last_active":"2023-12-20T04:43:44.404125+0000","last_peered":"2023-12-20T04:43:44.404125+0000","last_clean":"2023-12-20T04:43:44.404125+0000","last_became_active":"2023-12-20T04:43:44.402519+0000","last_became_peered":"2023-12-20T04:43:44.402519+0000","last_unstale":"2023-12-20T04:43:44.404125+0000","last_undegraded":"2023-12-20T04:43:44.404125+0000","last_fullsized":"2023-12-20T04:43:44.404125+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:58:44.078947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.20","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.737294+0000","last_change":"2023-12-20T04:43:44.408433+0000","last_active":"2023-12-20T04:43:45.737294+0000","last_peered":"2023-12-20T04:43:45.737294+0000","last_clean":"2023-12-20T04:43:45.737294+0000","last_became_active":"2023-12-20T04:43:44.408206+0000","last_became_peered":"2023-12-20T04:43:44.408206+0000","last_unstale":"2023-12-20T04:43:45.737294+0000","last_undegraded":"2023-12-20T04:43:45.737294+0000","last_fullsized":"2023-12-20T04:43:45.737294+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:23:16.560770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399686+0000","last_change":"2023-12-20T04:43:44.409831+0000","last_active":"2023-12-20T04:43:45.399686+0000","last_peered":"2023-12-20T04:43:45.399686+0000","last_clean":"2023-12-20T04:43:45.399686+0000","last_became_active":"2023-12-20T04:43:44.409554+0000","last_became_peered":"2023-12-20T04:43:44.409554+0000","last_unstale":"2023-12-20T04:43:45.399686+0000","last_undegraded":"2023-12-20T04:43:45.399686+0000","last_fullsized":"2023-12-20T04:43:45.399686+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:10.838713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"32'4","reported_seq":14,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.412594+0000","last_change":"2023-12-20T04:43:44.054994+0000","last_active":"2023-12-20T04:43:44.412594+0000","last_peered":"2023-12-20T04:43:44.412594+0000","last_clean":"2023-12-20T04:43:44.412594+0000","last_became_active":"2023-12-20T04:43:44.054765+0000","last_became_peered":"2023-12-20T04:43:44.054765+0000","last_unstale":"2023-12-20T04:43:44.412594+0000","last_undegraded":"2023-12-20T04:43:44.412594+0000","last_fullsized":"2023-12-20T04:43:44.412594+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:08:48.674957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.404105+0000","last_change":"2023-12-20T04:43:44.403773+0000","last_active":"2023-12-20T04:43:44.404105+0000","last_peered":"2023-12-20T04:43:44.404105+0000","last_clean":"2023-12-20T04:43:44.404105+0000","last_became_active":"2023-12-20T04:43:44.403069+0000","last_became_peered":"2023-12-20T04:43:44.403069+0000","last_unstale":"2023-12-20T04:43:44.404105+0000","last_undegraded":"2023-12-20T04:43:44.404105+0000","last_fullsized":"2023-12-20T04:43:44.404105+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:59:37.563983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1e","version":"32'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399636+0000","last_change":"2023-12-20T04:43:44.048554+0000","last_active":"2023-12-20T04:43:45.399636+0000","last_peered":"2023-12-20T04:43:45.399636+0000","last_clean":"2023-12-20T04:43:45.399636+0000","last_became_active":"2023-12-20T04:43:44.048325+0000","last_became_peered":"2023-12-20T04:43:44.048325+0000","last_unstale":"2023-12-20T04:43:45.399636+0000","last_undegraded":"2023-12-20T04:43:45.399636+0000","last_fullsized":"2023-12-20T04:43:45.399636+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:46:03.258615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.397597+0000","last_change":"2023-12-20T04:43:44.400958+0000","last_active":"2023-12-20T04:43:45.397597+0000","last_peered":"2023-12-20T04:43:45.397597+0000","last_clean":"2023-12-20T04:43:45.397597+0000","last_became_active":"2023-12-20T04:43:44.400573+0000","last_became_peered":"2023-12-20T04:43:44.400573+0000","last_unstale":"2023-12-20T04:43:45.397597+0000","last_undegraded":"2023-12-20T04:43:45.397597+0000","last_fullsized":"2023-12-20T04:43:45.397597+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:54:11.630607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"32'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095906+0000","last_change":"2023-12-20T04:43:44.047771+0000","last_active":"2023-12-20T04:43:46.095906+0000","last_peered":"2023-12-20T04:43:46.095906+0000","last_clean":"2023-12-20T04:43:46.095906+0000","last_became_active":"2023-12-20T04:43:44.047583+0000","last_became_peered":"2023-12-20T04:43:44.047583+0000","last_unstale":"2023-12-20T04:43:46.095906+0000","last_undegraded":"2023-12-20T04:43:46.095906+0000","last_fullsized":"2023-12-20T04:43:46.095906+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:54:10.624023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.401388+0000","last_change":"2023-12-20T04:43:44.401330+0000","last_active":"2023-12-20T04:43:44.401388+0000","last_peered":"2023-12-20T04:43:44.401388+0000","last_clean":"2023-12-20T04:43:44.401388+0000","last_became_active":"2023-12-20T04:43:44.401137+0000","last_became_peered":"2023-12-20T04:43:44.401137+0000","last_unstale":"2023-12-20T04:43:44.401388+0000","last_undegraded":"2023-12-20T04:43:44.401388+0000","last_fullsized":"2023-12-20T04:43:44.401388+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:04:56.280345+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1c","version":"32'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394325+0000","last_change":"2023-12-20T04:43:44.051946+0000","last_active":"2023-12-20T04:43:45.394325+0000","last_peered":"2023-12-20T04:43:45.394325+0000","last_clean":"2023-12-20T04:43:45.394325+0000","last_became_active":"2023-12-20T04:43:44.051742+0000","last_became_peered":"2023-12-20T04:43:44.051742+0000","last_unstale":"2023-12-20T04:43:45.394325+0000","last_undegraded":"2023-12-20T04:43:45.394325+0000","last_fullsized":"2023-12-20T04:43:45.394325+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:04:03.256460+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.737244+0000","last_change":"2023-12-20T04:43:44.406386+0000","last_active":"2023-12-20T04:43:45.737244+0000","last_peered":"2023-12-20T04:43:45.737244+0000","last_clean":"2023-12-20T04:43:45.737244+0000","last_became_active":"2023-12-20T04:43:44.406158+0000","last_became_peered":"2023-12-20T04:43:44.406158+0000","last_unstale":"2023-12-20T04:43:45.737244+0000","last_undegraded":"2023-12-20T04:43:45.737244+0000","last_fullsized":"2023-12-20T04:43:45.737244+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:12:39.580276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"32'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.397730+0000","last_change":"2023-12-20T04:43:44.052096+0000","last_active":"2023-12-20T04:43:45.397730+0000","last_peered":"2023-12-20T04:43:45.397730+0000","last_clean":"2023-12-20T04:43:45.397730+0000","last_became_active":"2023-12-20T04:43:44.050012+0000","last_became_peered":"2023-12-20T04:43:44.050012+0000","last_unstale":"2023-12-20T04:43:45.397730+0000","last_undegraded":"2023-12-20T04:43:45.397730+0000","last_fullsized":"2023-12-20T04:43:45.397730+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:13:03.918178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.403239+0000","last_change":"2023-12-20T04:43:44.403179+0000","last_active":"2023-12-20T04:43:44.403239+0000","last_peered":"2023-12-20T04:43:44.403239+0000","last_clean":"2023-12-20T04:43:44.403239+0000","last_became_active":"2023-12-20T04:43:44.402938+0000","last_became_peered":"2023-12-20T04:43:44.402938+0000","last_unstale":"2023-12-20T04:43:44.403239+0000","last_undegraded":"2023-12-20T04:43:44.403239+0000","last_fullsized":"2023-12-20T04:43:44.403239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:07:11.099910+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"32'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.397569+0000","last_change":"2023-12-20T04:43:44.048662+0000","last_active":"2023-12-20T04:43:45.397569+0000","last_peered":"2023-12-20T04:43:45.397569+0000","last_clean":"2023-12-20T04:43:45.397569+0000","last_became_active":"2023-12-20T04:43:44.048379+0000","last_became_peered":"2023-12-20T04:43:44.048379+0000","last_unstale":"2023-12-20T04:43:45.397569+0000","last_undegraded":"2023-12-20T04:43:45.397569+0000","last_fullsized":"2023-12-20T04:43:45.397569+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:02:26.648835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.397512+0000","last_change":"2023-12-20T04:43:44.403663+0000","last_active":"2023-12-20T04:43:45.397512+0000","last_peered":"2023-12-20T04:43:45.397512+0000","last_clean":"2023-12-20T04:43:45.397512+0000","last_became_active":"2023-12-20T04:43:44.403401+0000","last_became_peered":"2023-12-20T04:43:44.403401+0000","last_unstale":"2023-12-20T04:43:45.397512+0000","last_undegraded":"2023-12-20T04:43:45.397512+0000","last_fullsized":"2023-12-20T04:43:45.397512+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:30:56.177219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095855+0000","last_change":"2023-12-20T04:43:44.051288+0000","last_active":"2023-12-20T04:43:46.095855+0000","last_peered":"2023-12-20T04:43:46.095855+0000","last_clean":"2023-12-20T04:43:46.095855+0000","last_became_active":"2023-12-20T04:43:44.051025+0000","last_became_peered":"2023-12-20T04:43:44.051025+0000","last_unstale":"2023-12-20T04:43:46.095855+0000","last_undegraded":"2023-12-20T04:43:46.095855+0000","last_fullsized":"2023-12-20T04:43:46.095855+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:59:36.557399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.19","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.406034+0000","last_change":"2023-12-20T04:43:44.405937+0000","last_active":"2023-12-20T04:43:44.406034+0000","last_peered":"2023-12-20T04:43:44.406034+0000","last_clean":"2023-12-20T04:43:44.406034+0000","last_became_active":"2023-12-20T04:43:44.405730+0000","last_became_peered":"2023-12-20T04:43:44.405730+0000","last_unstale":"2023-12-20T04:43:44.406034+0000","last_undegraded":"2023-12-20T04:43:44.406034+0000","last_fullsized":"2023-12-20T04:43:44.406034+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:45:51.393959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.397787+0000","last_change":"2023-12-20T04:43:44.053212+0000","last_active":"2023-12-20T04:43:45.397787+0000","last_peered":"2023-12-20T04:43:45.397787+0000","last_clean":"2023-12-20T04:43:45.397787+0000","last_became_active":"2023-12-20T04:43:44.049800+0000","last_became_peered":"2023-12-20T04:43:44.049800+0000","last_unstale":"2023-12-20T04:43:45.397787+0000","last_undegraded":"2023-12-20T04:43:45.397787+0000","last_fullsized":"2023-12-20T04:43:45.397787+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:47:26.303150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.405190+0000","last_change":"2023-12-20T04:43:44.405127+0000","last_active":"2023-12-20T04:43:44.405190+0000","last_peered":"2023-12-20T04:43:44.405190+0000","last_clean":"2023-12-20T04:43:44.405190+0000","last_became_active":"2023-12-20T04:43:44.404258+0000","last_became_peered":"2023-12-20T04:43:44.404258+0000","last_unstale":"2023-12-20T04:43:44.405190+0000","last_undegraded":"2023-12-20T04:43:44.405190+0000","last_fullsized":"2023-12-20T04:43:44.405190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:12:39.580276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.096089+0000","last_change":"2023-12-20T04:43:44.051697+0000","last_active":"2023-12-20T04:43:46.096089+0000","last_peered":"2023-12-20T04:43:46.096089+0000","last_clean":"2023-12-20T04:43:46.096089+0000","last_became_active":"2023-12-20T04:43:44.051476+0000","last_became_peered":"2023-12-20T04:43:44.051476+0000","last_unstale":"2023-12-20T04:43:46.096089+0000","last_undegraded":"2023-12-20T04:43:46.096089+0000","last_fullsized":"2023-12-20T04:43:46.096089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:04:48.952254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.096012+0000","last_change":"2023-12-20T04:43:44.404916+0000","last_active":"2023-12-20T04:43:46.096012+0000","last_peered":"2023-12-20T04:43:46.096012+0000","last_clean":"2023-12-20T04:43:46.096012+0000","last_became_active":"2023-12-20T04:43:44.404679+0000","last_became_peered":"2023-12-20T04:43:44.404679+0000","last_unstale":"2023-12-20T04:43:46.096012+0000","last_undegraded":"2023-12-20T04:43:46.096012+0000","last_fullsized":"2023-12-20T04:43:46.096012+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:30:06.553366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399819+0000","last_change":"2023-12-20T04:43:44.047453+0000","last_active":"2023-12-20T04:43:45.399819+0000","last_peered":"2023-12-20T04:43:45.399819+0000","last_clean":"2023-12-20T04:43:45.399819+0000","last_became_active":"2023-12-20T04:43:44.047231+0000","last_became_peered":"2023-12-20T04:43:44.047231+0000","last_unstale":"2023-12-20T04:43:45.399819+0000","last_undegraded":"2023-12-20T04:43:45.399819+0000","last_fullsized":"2023-12-20T04:43:45.399819+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:30:16.356339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095966+0000","last_change":"2023-12-20T04:43:44.403367+0000","last_active":"2023-12-20T04:43:46.095966+0000","last_peered":"2023-12-20T04:43:46.095966+0000","last_clean":"2023-12-20T04:43:46.095966+0000","last_became_active":"2023-12-20T04:43:44.403130+0000","last_became_peered":"2023-12-20T04:43:44.403130+0000","last_unstale":"2023-12-20T04:43:46.095966+0000","last_undegraded":"2023-12-20T04:43:46.095966+0000","last_fullsized":"2023-12-20T04:43:46.095966+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:02:18.978003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"32'3","reported_seq":13,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.409400+0000","last_change":"2023-12-20T04:43:44.053850+0000","last_active":"2023-12-20T04:43:44.409400+0000","last_peered":"2023-12-20T04:43:44.409400+0000","last_clean":"2023-12-20T04:43:44.409400+0000","last_became_active":"2023-12-20T04:43:44.052937+0000","last_became_peered":"2023-12-20T04:43:44.052937+0000","last_unstale":"2023-12-20T04:43:44.409400+0000","last_undegraded":"2023-12-20T04:43:44.409400+0000","last_fullsized":"2023-12-20T04:43:44.409400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:04:48.952254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.403406+0000","last_change":"2023-12-20T04:43:44.403339+0000","last_active":"2023-12-20T04:43:44.403406+0000","last_peered":"2023-12-20T04:43:44.403406+0000","last_clean":"2023-12-20T04:43:44.403406+0000","last_became_active":"2023-12-20T04:43:44.402890+0000","last_became_peered":"2023-12-20T04:43:44.402890+0000","last_unstale":"2023-12-20T04:43:44.403406+0000","last_undegraded":"2023-12-20T04:43:44.403406+0000","last_fullsized":"2023-12-20T04:43:44.403406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:05:39.382072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"32'6","reported_seq":17,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095916+0000","last_change":"2023-12-20T04:43:44.050101+0000","last_active":"2023-12-20T04:43:46.095916+0000","last_peered":"2023-12-20T04:43:46.095916+0000","last_clean":"2023-12-20T04:43:46.095916+0000","last_became_active":"2023-12-20T04:43:44.049794+0000","last_became_peered":"2023-12-20T04:43:44.049794+0000","last_unstale":"2023-12-20T04:43:46.095916+0000","last_undegraded":"2023-12-20T04:43:46.095916+0000","last_fullsized":"2023-12-20T04:43:46.095916+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:01:32.129360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.410806+0000","last_change":"2023-12-20T04:43:44.410651+0000","last_active":"2023-12-20T04:43:44.410806+0000","last_peered":"2023-12-20T04:43:44.410806+0000","last_clean":"2023-12-20T04:43:44.410806+0000","last_became_active":"2023-12-20T04:43:44.410296+0000","last_became_peered":"2023-12-20T04:43:44.410296+0000","last_unstale":"2023-12-20T04:43:44.410806+0000","last_undegraded":"2023-12-20T04:43:44.410806+0000","last_fullsized":"2023-12-20T04:43:44.410806+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:23:37.936720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"32'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.397839+0000","last_change":"2023-12-20T04:43:44.053439+0000","last_active":"2023-12-20T04:43:45.397839+0000","last_peered":"2023-12-20T04:43:45.397839+0000","last_clean":"2023-12-20T04:43:45.397839+0000","last_became_active":"2023-12-20T04:43:44.050079+0000","last_became_peered":"2023-12-20T04:43:44.050079+0000","last_unstale":"2023-12-20T04:43:45.397839+0000","last_undegraded":"2023-12-20T04:43:45.397839+0000","last_fullsized":"2023-12-20T04:43:45.397839+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:08:48.674957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095734+0000","last_change":"2023-12-20T04:43:44.402680+0000","last_active":"2023-12-20T04:43:46.095734+0000","last_peered":"2023-12-20T04:43:46.095734+0000","last_clean":"2023-12-20T04:43:46.095734+0000","last_became_active":"2023-12-20T04:43:44.402388+0000","last_became_peered":"2023-12-20T04:43:44.402388+0000","last_unstale":"2023-12-20T04:43:46.095734+0000","last_undegraded":"2023-12-20T04:43:46.095734+0000","last_fullsized":"2023-12-20T04:43:46.095734+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:05:39.382072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.395513+0000","last_change":"2023-12-20T04:43:44.049746+0000","last_active":"2023-12-20T04:43:44.395513+0000","last_peered":"2023-12-20T04:43:44.395513+0000","last_clean":"2023-12-20T04:43:44.395513+0000","last_became_active":"2023-12-20T04:43:44.049465+0000","last_became_peered":"2023-12-20T04:43:44.049465+0000","last_unstale":"2023-12-20T04:43:44.395513+0000","last_undegraded":"2023-12-20T04:43:44.395513+0000","last_fullsized":"2023-12-20T04:43:44.395513+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:23:15.554185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.737348+0000","last_change":"2023-12-20T04:43:44.407480+0000","last_active":"2023-12-20T04:43:45.737348+0000","last_peered":"2023-12-20T04:43:45.737348+0000","last_clean":"2023-12-20T04:43:45.737348+0000","last_became_active":"2023-12-20T04:43:44.406779+0000","last_became_peered":"2023-12-20T04:43:44.406779+0000","last_unstale":"2023-12-20T04:43:45.737348+0000","last_undegraded":"2023-12-20T04:43:45.737348+0000","last_fullsized":"2023-12-20T04:43:45.737348+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:51:16.399770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095855+0000","last_change":"2023-12-20T04:43:44.055091+0000","last_active":"2023-12-20T04:43:46.095855+0000","last_peered":"2023-12-20T04:43:46.095855+0000","last_clean":"2023-12-20T04:43:46.095855+0000","last_became_active":"2023-12-20T04:43:44.054873+0000","last_became_peered":"2023-12-20T04:43:44.054873+0000","last_unstale":"2023-12-20T04:43:46.095855+0000","last_undegraded":"2023-12-20T04:43:46.095855+0000","last_fullsized":"2023-12-20T04:43:46.095855+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:30:16.356339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.406984+0000","last_change":"2023-12-20T04:43:44.406843+0000","last_active":"2023-12-20T04:43:44.406984+0000","last_peered":"2023-12-20T04:43:44.406984+0000","last_clean":"2023-12-20T04:43:44.406984+0000","last_became_active":"2023-12-20T04:43:44.406592+0000","last_became_peered":"2023-12-20T04:43:44.406592+0000","last_unstale":"2023-12-20T04:43:44.406984+0000","last_undegraded":"2023-12-20T04:43:44.406984+0000","last_fullsized":"2023-12-20T04:43:44.406984+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:01:33.135944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.10","version":"32'8","reported_seq":19,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095533+0000","last_change":"2023-12-20T04:43:44.048384+0000","last_active":"2023-12-20T04:43:46.095533+0000","last_peered":"2023-12-20T04:43:46.095533+0000","last_clean":"2023-12-20T04:43:46.095533+0000","last_became_active":"2023-12-20T04:43:44.048170+0000","last_became_peered":"2023-12-20T04:43:44.048170+0000","last_unstale":"2023-12-20T04:43:46.095533+0000","last_undegraded":"2023-12-20T04:43:46.095533+0000","last_fullsized":"2023-12-20T04:43:46.095533+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:00:06.653728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.397725+0000","last_change":"2023-12-20T04:43:44.398130+0000","last_active":"2023-12-20T04:43:45.397725+0000","last_peered":"2023-12-20T04:43:45.397725+0000","last_clean":"2023-12-20T04:43:45.397725+0000","last_became_active":"2023-12-20T04:43:44.397782+0000","last_became_peered":"2023-12-20T04:43:44.397782+0000","last_unstale":"2023-12-20T04:43:45.397725+0000","last_undegraded":"2023-12-20T04:43:45.397725+0000","last_fullsized":"2023-12-20T04:43:45.397725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:23:16.560770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"32'1","reported_seq":11,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.411105+0000","last_change":"2023-12-20T04:43:44.048493+0000","last_active":"2023-12-20T04:43:44.411105+0000","last_peered":"2023-12-20T04:43:44.411105+0000","last_clean":"2023-12-20T04:43:44.411105+0000","last_became_active":"2023-12-20T04:43:44.048237+0000","last_became_peered":"2023-12-20T04:43:44.048237+0000","last_unstale":"2023-12-20T04:43:44.411105+0000","last_undegraded":"2023-12-20T04:43:44.411105+0000","last_fullsized":"2023-12-20T04:43:44.411105+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:30:55.170634+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.f","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.398604+0000","last_change":"2023-12-20T04:43:44.398417+0000","last_active":"2023-12-20T04:43:44.398604+0000","last_peered":"2023-12-20T04:43:44.398604+0000","last_clean":"2023-12-20T04:43:44.398604+0000","last_became_active":"2023-12-20T04:43:44.397569+0000","last_became_peered":"2023-12-20T04:43:44.397569+0000","last_unstale":"2023-12-20T04:43:44.398604+0000","last_undegraded":"2023-12-20T04:43:44.398604+0000","last_fullsized":"2023-12-20T04:43:44.398604+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:10:27.796498+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.e","version":"32'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.397888+0000","last_change":"2023-12-20T04:43:44.054045+0000","last_active":"2023-12-20T04:43:45.397888+0000","last_peered":"2023-12-20T04:43:45.397888+0000","last_clean":"2023-12-20T04:43:45.397888+0000","last_became_active":"2023-12-20T04:43:44.052517+0000","last_became_peered":"2023-12-20T04:43:44.052517+0000","last_unstale":"2023-12-20T04:43:45.397888+0000","last_undegraded":"2023-12-20T04:43:45.397888+0000","last_fullsized":"2023-12-20T04:43:45.397888+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:48:56.464599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.399378+0000","last_change":"2023-12-20T04:43:44.399320+0000","last_active":"2023-12-20T04:43:44.399378+0000","last_peered":"2023-12-20T04:43:44.399378+0000","last_clean":"2023-12-20T04:43:44.399378+0000","last_became_active":"2023-12-20T04:43:44.399121+0000","last_became_peered":"2023-12-20T04:43:44.399121+0000","last_unstale":"2023-12-20T04:43:44.399378+0000","last_undegraded":"2023-12-20T04:43:44.399378+0000","last_fullsized":"2023-12-20T04:43:44.399378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:02:18.978003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.d","version":"32'1","reported_seq":12,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.397713+0000","last_change":"2023-12-20T04:43:44.055467+0000","last_active":"2023-12-20T04:43:45.397713+0000","last_peered":"2023-12-20T04:43:45.397713+0000","last_clean":"2023-12-20T04:43:45.397713+0000","last_became_active":"2023-12-20T04:43:44.055244+0000","last_became_peered":"2023-12-20T04:43:44.055244+0000","last_unstale":"2023-12-20T04:43:45.397713+0000","last_undegraded":"2023-12-20T04:43:45.397713+0000","last_fullsized":"2023-12-20T04:43:45.397713+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:10.205223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394187+0000","last_change":"2023-12-20T04:43:44.404987+0000","last_active":"2023-12-20T04:43:45.394187+0000","last_peered":"2023-12-20T04:43:45.394187+0000","last_clean":"2023-12-20T04:43:45.394187+0000","last_became_active":"2023-12-20T04:43:44.404761+0000","last_became_peered":"2023-12-20T04:43:44.404761+0000","last_unstale":"2023-12-20T04:43:45.394187+0000","last_undegraded":"2023-12-20T04:43:45.394187+0000","last_fullsized":"2023-12-20T04:43:45.394187+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:04:49.958839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.397920+0000","last_change":"2023-12-20T04:43:44.052331+0000","last_active":"2023-12-20T04:43:45.397920+0000","last_peered":"2023-12-20T04:43:45.397920+0000","last_clean":"2023-12-20T04:43:45.397920+0000","last_became_active":"2023-12-20T04:43:44.051856+0000","last_became_peered":"2023-12-20T04:43:44.051856+0000","last_unstale":"2023-12-20T04:43:45.397920+0000","last_undegraded":"2023-12-20T04:43:45.397920+0000","last_fullsized":"2023-12-20T04:43:45.397920+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:46:59.730497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394147+0000","last_change":"2023-12-20T04:43:44.403404+0000","last_active":"2023-12-20T04:43:45.394147+0000","last_peered":"2023-12-20T04:43:45.394147+0000","last_clean":"2023-12-20T04:43:45.394147+0000","last_became_active":"2023-12-20T04:43:44.403053+0000","last_became_peered":"2023-12-20T04:43:44.403053+0000","last_unstale":"2023-12-20T04:43:45.394147+0000","last_undegraded":"2023-12-20T04:43:45.394147+0000","last_fullsized":"2023-12-20T04:43:45.394147+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:20:05.880912+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.b","version":"32'2","reported_seq":13,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399784+0000","last_change":"2023-12-20T04:43:44.047635+0000","last_active":"2023-12-20T04:43:45.399784+0000","last_peered":"2023-12-20T04:43:45.399784+0000","last_clean":"2023-12-20T04:43:45.399784+0000","last_became_active":"2023-12-20T04:43:44.047362+0000","last_became_peered":"2023-12-20T04:43:44.047362+0000","last_unstale":"2023-12-20T04:43:45.399784+0000","last_undegraded":"2023-12-20T04:43:45.399784+0000","last_fullsized":"2023-12-20T04:43:45.399784+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:20:04.874327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394238+0000","last_change":"2023-12-20T04:43:44.406176+0000","last_active":"2023-12-20T04:43:45.394238+0000","last_peered":"2023-12-20T04:43:45.394238+0000","last_clean":"2023-12-20T04:43:45.394238+0000","last_became_active":"2023-12-20T04:43:44.405949+0000","last_became_peered":"2023-12-20T04:43:44.405949+0000","last_unstale":"2023-12-20T04:43:45.394238+0000","last_undegraded":"2023-12-20T04:43:45.394238+0000","last_fullsized":"2023-12-20T04:43:45.394238+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:13:48.244135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.398806+0000","last_change":"2023-12-20T04:43:44.051217+0000","last_active":"2023-12-20T04:43:44.398806+0000","last_peered":"2023-12-20T04:43:44.398806+0000","last_clean":"2023-12-20T04:43:44.398806+0000","last_became_active":"2023-12-20T04:43:44.050992+0000","last_became_peered":"2023-12-20T04:43:44.050992+0000","last_unstale":"2023-12-20T04:43:44.398806+0000","last_undegraded":"2023-12-20T04:43:44.398806+0000","last_fullsized":"2023-12-20T04:43:44.398806+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:47:26.303150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394271+0000","last_change":"2023-12-20T04:43:44.400511+0000","last_active":"2023-12-20T04:43:45.394271+0000","last_peered":"2023-12-20T04:43:45.394271+0000","last_clean":"2023-12-20T04:43:45.394271+0000","last_became_active":"2023-12-20T04:43:44.400321+0000","last_became_peered":"2023-12-20T04:43:44.400321+0000","last_unstale":"2023-12-20T04:43:45.394271+0000","last_undegraded":"2023-12-20T04:43:45.394271+0000","last_fullsized":"2023-12-20T04:43:45.394271+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:02:27.655420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.397935+0000","last_change":"2023-12-20T04:43:44.054402+0000","last_active":"2023-12-20T04:43:45.397935+0000","last_peered":"2023-12-20T04:43:45.397935+0000","last_clean":"2023-12-20T04:43:45.397935+0000","last_became_active":"2023-12-20T04:43:44.052981+0000","last_became_peered":"2023-12-20T04:43:44.052981+0000","last_unstale":"2023-12-20T04:43:45.397935+0000","last_undegraded":"2023-12-20T04:43:45.397935+0000","last_fullsized":"2023-12-20T04:43:45.397935+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:15:55.458525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.737349+0000","last_change":"2023-12-20T04:43:44.406950+0000","last_active":"2023-12-20T04:43:45.737349+0000","last_peered":"2023-12-20T04:43:45.737349+0000","last_clean":"2023-12-20T04:43:45.737349+0000","last_became_active":"2023-12-20T04:43:44.406725+0000","last_became_peered":"2023-12-20T04:43:44.406725+0000","last_unstale":"2023-12-20T04:43:45.737349+0000","last_undegraded":"2023-12-20T04:43:45.737349+0000","last_fullsized":"2023-12-20T04:43:45.737349+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:10:33.759648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.392761+0000","last_change":"2023-12-20T04:43:44.053772+0000","last_active":"2023-12-20T04:43:44.392761+0000","last_peered":"2023-12-20T04:43:44.392761+0000","last_clean":"2023-12-20T04:43:44.392761+0000","last_became_active":"2023-12-20T04:43:44.053403+0000","last_became_peered":"2023-12-20T04:43:44.053403+0000","last_unstale":"2023-12-20T04:43:44.392761+0000","last_undegraded":"2023-12-20T04:43:44.392761+0000","last_fullsized":"2023-12-20T04:43:44.392761+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:20:04.874327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.6","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.394325+0000","last_change":"2023-12-20T04:43:44.401890+0000","last_active":"2023-12-20T04:43:45.394325+0000","last_peered":"2023-12-20T04:43:45.394325+0000","last_clean":"2023-12-20T04:43:45.394325+0000","last_became_active":"2023-12-20T04:43:44.401516+0000","last_became_peered":"2023-12-20T04:43:44.401516+0000","last_unstale":"2023-12-20T04:43:45.394325+0000","last_undegraded":"2023-12-20T04:43:45.394325+0000","last_fullsized":"2023-12-20T04:43:45.394325+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:47:27.309735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"32'2","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.411870+0000","last_change":"2023-12-20T04:43:44.050264+0000","last_active":"2023-12-20T04:43:44.411870+0000","last_peered":"2023-12-20T04:43:44.411870+0000","last_clean":"2023-12-20T04:43:44.411870+0000","last_became_active":"2023-12-20T04:43:44.050063+0000","last_became_peered":"2023-12-20T04:43:44.050063+0000","last_unstale":"2023-12-20T04:43:44.411870+0000","last_undegraded":"2023-12-20T04:43:44.411870+0000","last_fullsized":"2023-12-20T04:43:44.411870+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:32:55.951038+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.402341+0000","last_change":"2023-12-20T04:43:44.402273+0000","last_active":"2023-12-20T04:43:44.402341+0000","last_peered":"2023-12-20T04:43:44.402341+0000","last_clean":"2023-12-20T04:43:44.402341+0000","last_became_active":"2023-12-20T04:43:44.402057+0000","last_became_peered":"2023-12-20T04:43:44.402057+0000","last_unstale":"2023-12-20T04:43:44.402341+0000","last_undegraded":"2023-12-20T04:43:44.402341+0000","last_fullsized":"2023-12-20T04:43:44.402341+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:30:06.553366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399852+0000","last_change":"2023-12-20T04:43:44.046853+0000","last_active":"2023-12-20T04:43:45.399852+0000","last_peered":"2023-12-20T04:43:45.399852+0000","last_clean":"2023-12-20T04:43:45.399852+0000","last_became_active":"2023-12-20T04:43:44.046629+0000","last_became_peered":"2023-12-20T04:43:44.046629+0000","last_unstale":"2023-12-20T04:43:45.399852+0000","last_undegraded":"2023-12-20T04:43:45.399852+0000","last_fullsized":"2023-12-20T04:43:45.399852+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:04:48.952254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399577+0000","last_change":"2023-12-20T04:43:44.408541+0000","last_active":"2023-12-20T04:43:45.399577+0000","last_peered":"2023-12-20T04:43:45.399577+0000","last_clean":"2023-12-20T04:43:45.399577+0000","last_became_active":"2023-12-20T04:43:44.408320+0000","last_became_peered":"2023-12-20T04:43:44.408320+0000","last_unstale":"2023-12-20T04:43:45.399577+0000","last_undegraded":"2023-12-20T04:43:45.399577+0000","last_fullsized":"2023-12-20T04:43:45.399577+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:30:55.643499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.396661+0000","last_change":"2023-12-20T04:43:44.054408+0000","last_active":"2023-12-20T04:43:44.396661+0000","last_peered":"2023-12-20T04:43:44.396661+0000","last_clean":"2023-12-20T04:43:44.396661+0000","last_became_active":"2023-12-20T04:43:44.051930+0000","last_became_peered":"2023-12-20T04:43:44.051930+0000","last_unstale":"2023-12-20T04:43:44.396661+0000","last_undegraded":"2023-12-20T04:43:44.396661+0000","last_fullsized":"2023-12-20T04:43:44.396661+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:09.832128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":9,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.404143+0000","last_change":"2023-12-20T04:43:44.403889+0000","last_active":"2023-12-20T04:43:44.404143+0000","last_peered":"2023-12-20T04:43:44.404143+0000","last_clean":"2023-12-20T04:43:44.404143+0000","last_became_active":"2023-12-20T04:43:44.403657+0000","last_became_peered":"2023-12-20T04:43:44.403657+0000","last_unstale":"2023-12-20T04:43:44.404143+0000","last_undegraded":"2023-12-20T04:43:44.404143+0000","last_fullsized":"2023-12-20T04:43:44.404143+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:00:07.660313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399832+0000","last_change":"2023-12-20T04:43:44.050464+0000","last_active":"2023-12-20T04:43:45.399832+0000","last_peered":"2023-12-20T04:43:45.399832+0000","last_clean":"2023-12-20T04:43:45.399832+0000","last_became_active":"2023-12-20T04:43:44.050200+0000","last_became_peered":"2023-12-20T04:43:44.050200+0000","last_unstale":"2023-12-20T04:43:45.399832+0000","last_undegraded":"2023-12-20T04:43:45.399832+0000","last_fullsized":"2023-12-20T04:43:45.399832+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:06:15.996824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.399704+0000","last_change":"2023-12-20T04:43:44.406976+0000","last_active":"2023-12-20T04:43:45.399704+0000","last_peered":"2023-12-20T04:43:45.399704+0000","last_clean":"2023-12-20T04:43:45.399704+0000","last_became_active":"2023-12-20T04:43:44.406771+0000","last_became_peered":"2023-12-20T04:43:44.406771+0000","last_unstale":"2023-12-20T04:43:45.399704+0000","last_undegraded":"2023-12-20T04:43:45.399704+0000","last_fullsized":"2023-12-20T04:43:45.399704+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:27:51.098780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.396484+0000","last_change":"2023-12-20T04:43:44.055748+0000","last_active":"2023-12-20T04:43:44.396484+0000","last_peered":"2023-12-20T04:43:44.396484+0000","last_clean":"2023-12-20T04:43:44.396484+0000","last_became_active":"2023-12-20T04:43:44.055489+0000","last_became_peered":"2023-12-20T04:43:44.055489+0000","last_unstale":"2023-12-20T04:43:44.396484+0000","last_undegraded":"2023-12-20T04:43:44.396484+0000","last_fullsized":"2023-12-20T04:43:44.396484+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:27:50.092195+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.095646+0000","last_change":"2023-12-20T04:43:44.409233+0000","last_active":"2023-12-20T04:43:46.095646+0000","last_peered":"2023-12-20T04:43:46.095646+0000","last_clean":"2023-12-20T04:43:46.095646+0000","last_became_active":"2023-12-20T04:43:44.406561+0000","last_became_peered":"2023-12-20T04:43:44.406561+0000","last_unstale":"2023-12-20T04:43:46.095646+0000","last_undegraded":"2023-12-20T04:43:46.095646+0000","last_fullsized":"2023-12-20T04:43:46.095646+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:23:37.936720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.397747+0000","last_change":"2023-12-20T04:43:44.055222+0000","last_active":"2023-12-20T04:43:45.397747+0000","last_peered":"2023-12-20T04:43:45.397747+0000","last_clean":"2023-12-20T04:43:45.397747+0000","last_became_active":"2023-12-20T04:43:44.055000+0000","last_became_peered":"2023-12-20T04:43:44.055000+0000","last_unstale":"2023-12-20T04:43:45.397747+0000","last_undegraded":"2023-12-20T04:43:45.397747+0000","last_fullsized":"2023-12-20T04:43:45.397747+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:41:37.213261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.397476+0000","last_change":"2023-12-20T04:43:44.401877+0000","last_active":"2023-12-20T04:43:45.397476+0000","last_peered":"2023-12-20T04:43:45.397476+0000","last_clean":"2023-12-20T04:43:45.397476+0000","last_became_active":"2023-12-20T04:43:44.401188+0000","last_became_peered":"2023-12-20T04:43:44.401188+0000","last_unstale":"2023-12-20T04:43:45.397476+0000","last_undegraded":"2023-12-20T04:43:45.397476+0000","last_fullsized":"2023-12-20T04:43:45.397476+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:58:44.078947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":11,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:46.096006+0000","last_change":"2023-12-20T04:43:44.056886+0000","last_active":"2023-12-20T04:43:46.096006+0000","last_peered":"2023-12-20T04:43:46.096006+0000","last_clean":"2023-12-20T04:43:46.096006+0000","last_became_active":"2023-12-20T04:43:44.056143+0000","last_became_peered":"2023-12-20T04:43:44.056143+0000","last_unstale":"2023-12-20T04:43:46.096006+0000","last_undegraded":"2023-12-20T04:43:46.096006+0000","last_fullsized":"2023-12-20T04:43:46.096006+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:06:15.996824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":10,"reported_epoch":33,"state":"active+clean","last_fresh":"2023-12-20T04:43:45.737466+0000","last_change":"2023-12-20T04:43:44.409192+0000","last_active":"2023-12-20T04:43:45.737466+0000","last_peered":"2023-12-20T04:43:45.737466+0000","last_clean":"2023-12-20T04:43:45.737466+0000","last_became_active":"2023-12-20T04:43:44.408856+0000","last_became_peered":"2023-12-20T04:43:44.408856+0000","last_unstale":"2023-12-20T04:43:45.737466+0000","last_undegraded":"2023-12-20T04:43:45.737466+0000","last_fullsized":"2023-12-20T04:43:45.737466+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:44.040494+0000","last_clean_scrub_stamp":"2023-12-20T04:43:44.040494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:30:06.553366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":10,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.399010+0000","last_change":"2023-12-20T04:43:44.051658+0000","last_active":"2023-12-20T04:43:44.399010+0000","last_peered":"2023-12-20T04:43:44.399010+0000","last_clean":"2023-12-20T04:43:44.399010+0000","last_became_active":"2023-12-20T04:43:44.051433+0000","last_became_peered":"2023-12-20T04:43:44.051433+0000","last_unstale":"2023-12-20T04:43:44.399010+0000","last_undegraded":"2023-12-20T04:43:44.399010+0000","last_fullsized":"2023-12-20T04:43:44.399010+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:43:43.033909+0000","last_clean_scrub_stamp":"2023-12-20T04:43:43.033909+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:48:56.464599+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":174,"reported_epoch":32,"state":"active+clean","last_fresh":"2023-12-20T04:43:44.402224+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:43:44.402224+0000","last_peered":"2023-12-20T04:43:44.402224+0000","last_clean":"2023-12-20T04:43:44.402224+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:43:44.402224+0000","last_undegraded":"2023-12-20T04:43:44.402224+0000","last_fullsized":"2023-12-20T04:43:44.402224+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":5,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":712,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194599,"statfs":{"total":200000000,"available":199270054,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.5},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.53300000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.70999999999999996}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.64900000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.63600000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.60599999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.74099999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.78800000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.67900000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.72599999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574865,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859896,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.65200000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.63100000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.66800000000000004}]},{"osd":3,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.72199999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.70999999999999996}]},{"osd":5,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.76000000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.69699999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.73799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195175,"statfs":{"total":200000000,"available":199859840,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.56599999999999995}]},{"osd":1,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.59099999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.436},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.44900000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42199999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.52300000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.501},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.46600000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.54300000000000004}]}]},{"osd":4,"up_from":13,"seq":55834574864,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":142,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195170,"statfs":{"total":200000000,"available":199854108,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.49299999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.41799999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.436}]},{"osd":3,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.50600000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.31},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.373}]},{"osd":6,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.36299999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.55600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574864,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":137,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195174,"statfs":{"total":200000000,"available":199858926,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.36799999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.34399999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.41799999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.48999999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.53300000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.627}]}]},{"osd":2,"up_from":13,"seq":55834574864,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":136,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195176,"statfs":{"total":200000000,"available":199860442,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.374,"5min":0.374,"15min":0.374},"last":0.28699999999999998},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.30199999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.32300000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.34799999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.46000000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.438},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.44800000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.47099999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.49399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":137,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195174,"statfs":{"total":200000000,"available":199858926,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.193},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.26500000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.308},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.22600000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.32800000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.51700000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.52400000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.49399999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.51000000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574864,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":718,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194593,"statfs":{"total":200000000,"available":199263844,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.317},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.41099999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.37}]},{"osd":3,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.38500000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.77800000000000002},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.64100000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.61199999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.77000000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.754},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.80400000000000005}]},{"osd":7,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.81399999999999995}]}]}],"pool_statfs":[]}} 2023-12-20T04:43:48.342 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-20T04:43:48.342 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-20T04:43:48.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.482+0000 7f2dfe4c4640 1 Processor -- start 2023-12-20T04:43:48.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.482+0000 7f2dfe4c4640 1 -- start start 2023-12-20T04:43:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.483+0000 7f2dfe4c4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2df815d300 0x7f2df80d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.483+0000 7f2dfe4c4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2df80cff90 0x7f2df80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.483+0000 7f2dfe4c4640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2df80d1a90 con 0x7f2df80d1550 2023-12-20T04:43:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.483+0000 7f2dfe4c4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2df80d1d70 con 0x7f2df80cff90 2023-12-20T04:43:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.483+0000 7f2dfe4c4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80d2050 con 0x7f2df815d300 2023-12-20T04:43:48.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.483+0000 7f2dfca61640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2df80cff90 0x7f2df80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:48.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.483+0000 7f2dfca61640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2df80cff90 0x7f2df80b60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35164/0 (socket says 172.21.15.132:35164) 2023-12-20T04:43:48.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.483+0000 7f2dfca61640 1 -- 172.21.15.132:0/1852776425 learned_addr learned my addr 172.21.15.132:0/1852776425 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:48.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.483+0000 7f2dfca61640 1 -- 172.21.15.132:0/1852776425 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2df815d300 msgr2=0x7f2df80d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:48.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.483+0000 7f2dfca61640 1 --2- 172.21.15.132:0/1852776425 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2df815d300 0x7f2df80d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.483+0000 7f2dfca61640 1 -- 172.21.15.132:0/1852776425 >> v1:172.21.15.187:6789/0 conn(0x7f2df80d1550 legacy=0x7f2df80cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:48.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.483+0000 7f2dfca61640 1 -- 172.21.15.132:0/1852776425 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df80d2330 con 0x7f2df80cff90 2023-12-20T04:43:48.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.484+0000 7f2dfca61640 1 --2- 172.21.15.132:0/1852776425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df80cff90 0x7f2df80b60e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2df0009e50 tx=0x7f2df002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8c91e56bca94af4e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:48.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.484+0000 7f2df6ffd640 1 -- 172.21.15.132:0/1852776425 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df002ca70 con 0x7f2df80cff90 2023-12-20T04:43:48.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.484+0000 7f2df6ffd640 1 -- 172.21.15.132:0/1852776425 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2df002cbd0 con 0x7f2df80cff90 2023-12-20T04:43:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.484+0000 7f2df6ffd640 1 -- 172.21.15.132:0/1852776425 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2df00343f0 con 0x7f2df80cff90 2023-12-20T04:43:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.484+0000 7f2dfe4c4640 1 -- 172.21.15.132:0/1852776425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df80cff90 msgr2=0x7f2df80b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.484+0000 7f2dfe4c4640 1 --2- 172.21.15.132:0/1852776425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df80cff90 0x7f2df80b60e0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f2df0009e50 tx=0x7f2df002bed0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.485+0000 7f2dfe4c4640 1 -- 172.21.15.132:0/1852776425 shutdown_connections 2023-12-20T04:43:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.485+0000 7f2dfe4c4640 1 --2- 172.21.15.132:0/1852776425 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df80cff90 0x7f2df80b60e0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.485+0000 7f2dfe4c4640 1 --2- 172.21.15.132:0/1852776425 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2df815d300 0x7f2df80d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.485+0000 7f2dfe4c4640 1 -- 172.21.15.132:0/1852776425 >> 172.21.15.132:0/1852776425 conn(0x7f2df806a3d0 msgr2=0x7f2df806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.485+0000 7f2dfe4c4640 1 -- 172.21.15.132:0/1852776425 shutdown_connections 2023-12-20T04:43:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.485+0000 7f2dfe4c4640 1 -- 172.21.15.132:0/1852776425 wait complete. 2023-12-20T04:43:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.486+0000 7f2dfe4c4640 1 Processor -- start 2023-12-20T04:43:48.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.486+0000 7f2dfe4c4640 1 -- start start 2023-12-20T04:43:48.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.486+0000 7f2dfe4c4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df80cff90 0x7f2df80ca900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.486+0000 7f2dfe4c4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2df80d1550 0x7f2df80b40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.486+0000 7f2dfe4c4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2df815d300 0x7f2df8152a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.486+0000 7f2dfe4c4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80cc810 con 0x7f2df80cff90 2023-12-20T04:43:48.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2dfe4c4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2df814c600 con 0x7f2df815d300 2023-12-20T04:43:48.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2dfe4c4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2df80cbc00 con 0x7f2df80d1550 2023-12-20T04:43:48.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2df7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df80cff90 0x7f2df80ca900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:48.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2df7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df80cff90 0x7f2df80ca900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35166/0 (socket says 172.21.15.132:35166) 2023-12-20T04:43:48.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2df7fff640 1 -- 172.21.15.132:0/66365454 learned_addr learned my addr 172.21.15.132:0/66365454 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:48.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2dfca61640 1 --2- 172.21.15.132:0/66365454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2df815d300 0x7f2df8152a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:48.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2df77fe640 1 --2- 172.21.15.132:0/66365454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2df80d1550 0x7f2df80b40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:48.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2df7fff640 1 -- 172.21.15.132:0/66365454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2df80d1550 msgr2=0x7f2df80b40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:48.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2df7fff640 1 --2- 172.21.15.132:0/66365454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2df80d1550 0x7f2df80b40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2df7fff640 1 -- 172.21.15.132:0/66365454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2df815d300 msgr2=0x7f2df8152a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:48.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2df7fff640 1 --2- 172.21.15.132:0/66365454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2df815d300 0x7f2df8152a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2df7fff640 1 -- 172.21.15.132:0/66365454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2df0009b30 con 0x7f2df80cff90 2023-12-20T04:43:48.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2df7fff640 1 --2- 172.21.15.132:0/66365454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df80cff90 0x7f2df80ca900 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00b410 tx=0x7f2dec00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:48.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2df4ff9640 1 -- 172.21.15.132:0/66365454 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec011830 con 0x7f2df80cff90 2023-12-20T04:43:48.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2df4ff9640 1 -- 172.21.15.132:0/66365454 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2dec0119b0 con 0x7f2df80cff90 2023-12-20T04:43:48.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2dfe4c4640 1 -- 172.21.15.132:0/66365454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2df80cbee0 con 0x7f2df80cff90 2023-12-20T04:43:48.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2df4ff9640 1 -- 172.21.15.132:0/66365454 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2dec011d60 con 0x7f2df80cff90 2023-12-20T04:43:48.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.487+0000 7f2dfe4c4640 1 -- 172.21.15.132:0/66365454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2df80cc4a0 con 0x7f2df80cff90 2023-12-20T04:43:48.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.488+0000 7f2dfe4c4640 1 -- 172.21.15.132:0/66365454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2df80cc660 con 0x7f2df80cff90 2023-12-20T04:43:48.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.489+0000 7f2df4ff9640 1 -- 172.21.15.132:0/66365454 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2dec01a400 con 0x7f2df80cff90 2023-12-20T04:43:48.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.489+0000 7f2df4ff9640 1 --2- 172.21.15.132:0/66365454 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2de406a430 0x7f2de406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.489+0000 7f2df4ff9640 1 -- 172.21.15.132:0/66365454 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2dec088980 con 0x7f2df80cff90 2023-12-20T04:43:48.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.489+0000 7f2df77fe640 1 --2- 172.21.15.132:0/66365454 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2de406a430 0x7f2de406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:48.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.490+0000 7f2df77fe640 1 --2- 172.21.15.132:0/66365454 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2de406a430 0x7f2de406c8f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2df80b2880 tx=0x7f2de8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:48.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.493+0000 7f2df4ff9640 1 -- 172.21.15.132:0/66365454 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2dec054020 con 0x7f2df80cff90 2023-12-20T04:43:48.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.721+0000 7f2dfe4c4640 1 -- 172.21.15.132:0/66365454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f2df804e840 con 0x7f2df80cff90 2023-12-20T04:43:48.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.725+0000 7f2df4ff9640 1 -- 172.21.15.132:0/66365454 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v13) v1 ==== 190+0+0 (secure 0 0 0) 0x7f2dec015020 con 0x7f2df80cff90 2023-12-20T04:43:48.726 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.0 2023-12-20T04:43:48.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.727+0000 7f2dfe4c4640 1 -- 172.21.15.132:0/66365454 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2de406a430 msgr2=0x7f2de406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:48.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.727+0000 7f2dfe4c4640 1 --2- 172.21.15.132:0/66365454 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2de406a430 0x7f2de406c8f0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f2df80b2880 tx=0x7f2de8009040 comp rx=0 tx=0).stop 2023-12-20T04:43:48.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.727+0000 7f2dfe4c4640 1 -- 172.21.15.132:0/66365454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df80cff90 msgr2=0x7f2df80ca900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:48.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.727+0000 7f2dfe4c4640 1 --2- 172.21.15.132:0/66365454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df80cff90 0x7f2df80ca900 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f2dec00b410 tx=0x7f2dec00b8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.727+0000 7f2dfe4c4640 1 -- 172.21.15.132:0/66365454 shutdown_connections 2023-12-20T04:43:48.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.727+0000 7f2dfe4c4640 1 --2- 172.21.15.132:0/66365454 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2de406a430 0x7f2de406c8f0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.727+0000 7f2dfe4c4640 1 --2- 172.21.15.132:0/66365454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2df815d300 0x7f2df8152a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.727+0000 7f2dfe4c4640 1 --2- 172.21.15.132:0/66365454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2df80d1550 0x7f2df80b40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.727+0000 7f2dfe4c4640 1 --2- 172.21.15.132:0/66365454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2df80cff90 0x7f2df80ca900 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.727+0000 7f2dfe4c4640 1 -- 172.21.15.132:0/66365454 >> 172.21.15.132:0/66365454 conn(0x7f2df806a3d0 msgr2=0x7f2df806a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:48.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.727+0000 7f2dfe4c4640 1 -- 172.21.15.132:0/66365454 shutdown_connections 2023-12-20T04:43:48.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.727+0000 7f2dfe4c4640 1 -- 172.21.15.132:0/66365454 wait complete. 2023-12-20T04:43:48.740 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:43:48.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.837+0000 7f48b6e2c640 1 Processor -- start 2023-12-20T04:43:48.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.837+0000 7f48b6e2c640 1 -- start start 2023-12-20T04:43:48.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.838+0000 7f48b6e2c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48b013cce0 0x7f48b0159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.838+0000 7f48b6e2c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f48b015a1d0 0x7f48b00b0800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.838+0000 7f48b6e2c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48b015aa30 con 0x7f48b00c92d0 2023-12-20T04:43:48.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.838+0000 7f48b6e2c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f48b006b260 con 0x7f48b015a1d0 2023-12-20T04:43:48.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.838+0000 7f48b6e2c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b006b540 con 0x7f48b013cce0 2023-12-20T04:43:48.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.838+0000 7f48b53c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f48b015a1d0 0x7f48b00b0800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:48.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.838+0000 7f48b4bc8640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f48b00c92d0 0x7f48b00c96b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57704/0 (socket says 172.21.15.132:57704) 2023-12-20T04:43:48.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.838+0000 7f48b4bc8640 1 -- 172.21.15.132:0/1132403676 learned_addr learned my addr 172.21.15.132:0/1132403676 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:48.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.838+0000 7f48affff640 1 --2- 172.21.15.132:0/1132403676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48b013cce0 0x7f48b0159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:48.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.838+0000 7f48af7fe640 1 -- 172.21.15.132:0/1132403676 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183391752 0 0) 0x7f48b015aa30 con 0x7f48b00c92d0 2023-12-20T04:43:48.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.838+0000 7f48af7fe640 1 -- 172.21.15.132:0/1132403676 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4898003520 con 0x7f48b00c92d0 2023-12-20T04:43:48.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.838+0000 7f48b53c9640 1 -- 172.21.15.132:0/1132403676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48b013cce0 msgr2=0x7f48b0159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:48.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.838+0000 7f48b53c9640 1 --2- 172.21.15.132:0/1132403676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48b013cce0 0x7f48b0159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.838+0000 7f48b53c9640 1 -- 172.21.15.132:0/1132403676 >> v1:172.21.15.132:6789/0 conn(0x7f48b00c92d0 legacy=0x7f48b00c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:48.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.838+0000 7f48b53c9640 1 -- 172.21.15.132:0/1132403676 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48b006b820 con 0x7f48b015a1d0 2023-12-20T04:43:48.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.839+0000 7f48b53c9640 1 --2- 172.21.15.132:0/1132403676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48b015a1d0 0x7f48b00b0800 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009d90 tx=0x7f48a802be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cb4516c51cad06e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:48.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.839+0000 7f48af7fe640 1 -- 172.21.15.132:0/1132403676 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a802cbc0 con 0x7f48b015a1d0 2023-12-20T04:43:48.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.839+0000 7f48af7fe640 1 -- 172.21.15.132:0/1132403676 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a802cd20 con 0x7f48b015a1d0 2023-12-20T04:43:48.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.839+0000 7f48af7fe640 1 -- 172.21.15.132:0/1132403676 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a8034640 con 0x7f48b015a1d0 2023-12-20T04:43:48.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.840+0000 7f48b6e2c640 1 -- 172.21.15.132:0/1132403676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48b015a1d0 msgr2=0x7f48b00b0800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:48.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.840+0000 7f48b6e2c640 1 --2- 172.21.15.132:0/1132403676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48b015a1d0 0x7f48b00b0800 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f48a8009d90 tx=0x7f48a802be10 comp rx=0 tx=0).stop 2023-12-20T04:43:48.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.840+0000 7f48b6e2c640 1 -- 172.21.15.132:0/1132403676 shutdown_connections 2023-12-20T04:43:48.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.840+0000 7f48b6e2c640 1 --2- 172.21.15.132:0/1132403676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48b015a1d0 0x7f48b00b0800 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.840+0000 7f48b6e2c640 1 --2- 172.21.15.132:0/1132403676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48b013cce0 0x7f48b0159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.840+0000 7f48b6e2c640 1 -- 172.21.15.132:0/1132403676 >> 172.21.15.132:0/1132403676 conn(0x7f48b00ced10 msgr2=0x7f48b00cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:48.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.840+0000 7f48b6e2c640 1 -- 172.21.15.132:0/1132403676 shutdown_connections 2023-12-20T04:43:48.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.840+0000 7f48b6e2c640 1 -- 172.21.15.132:0/1132403676 wait complete. 2023-12-20T04:43:48.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.841+0000 7f48b6e2c640 1 Processor -- start 2023-12-20T04:43:48.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.841+0000 7f48b6e2c640 1 -- start start 2023-12-20T04:43:48.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.842+0000 7f48b6e2c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48b00c92d0 0x7f48b00c8940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.842+0000 7f48b6e2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48b013cce0 0x7f48b01f3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.842+0000 7f48b6e2c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48b015a1d0 0x7f48b01f44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.842+0000 7f48b6e2c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00c7170 con 0x7f48b013cce0 2023-12-20T04:43:48.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.842+0000 7f48b6e2c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00c68d0 con 0x7f48b00c92d0 2023-12-20T04:43:48.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.842+0000 7f48b6e2c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48b00c6bb0 con 0x7f48b015a1d0 2023-12-20T04:43:48.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.842+0000 7f48affff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48b013cce0 0x7f48b01f3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:48.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.842+0000 7f48affff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48b013cce0 0x7f48b01f3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35192/0 (socket says 172.21.15.132:35192) 2023-12-20T04:43:48.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.842+0000 7f48affff640 1 -- 172.21.15.132:0/1890527589 learned_addr learned my addr 172.21.15.132:0/1890527589 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:48.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.842+0000 7f48affff640 1 -- 172.21.15.132:0/1890527589 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48b015a1d0 msgr2=0x7f48b01f44e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:48.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.842+0000 7f48affff640 1 --2- 172.21.15.132:0/1890527589 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48b015a1d0 0x7f48b01f44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.842+0000 7f48affff640 1 -- 172.21.15.132:0/1890527589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48b00c92d0 msgr2=0x7f48b00c8940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:48.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.842+0000 7f48affff640 1 --2- 172.21.15.132:0/1890527589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48b00c92d0 0x7f48b00c8940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:48.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.842+0000 7f48affff640 1 -- 172.21.15.132:0/1890527589 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a8009a70 con 0x7f48b013cce0 2023-12-20T04:43:48.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.842+0000 7f48affff640 1 --2- 172.21.15.132:0/1890527589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48b013cce0 0x7f48b01f3fa0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f48a400e9b0 tx=0x7f48a400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:48.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.843+0000 7f48ad7fa640 1 -- 172.21.15.132:0/1890527589 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4009670 con 0x7f48b013cce0 2023-12-20T04:43:48.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.843+0000 7f48ad7fa640 1 -- 172.21.15.132:0/1890527589 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a400c9a0 con 0x7f48b013cce0 2023-12-20T04:43:48.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.843+0000 7f48ad7fa640 1 -- 172.21.15.132:0/1890527589 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a400cd50 con 0x7f48b013cce0 2023-12-20T04:43:48.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.843+0000 7f48b6e2c640 1 -- 172.21.15.132:0/1890527589 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48b00c6e90 con 0x7f48b013cce0 2023-12-20T04:43:48.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.843+0000 7f48b6e2c640 1 -- 172.21.15.132:0/1890527589 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48b00c8e80 con 0x7f48b013cce0 2023-12-20T04:43:48.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.844+0000 7f48b6e2c640 1 -- 172.21.15.132:0/1890527589 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48b004e840 con 0x7f48b013cce0 2023-12-20T04:43:48.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.844+0000 7f48ad7fa640 1 -- 172.21.15.132:0/1890527589 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f48a4013470 con 0x7f48b013cce0 2023-12-20T04:43:48.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.844+0000 7f48ad7fa640 1 --2- 172.21.15.132:0/1890527589 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f489c06a430 0x7f489c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:48.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.844+0000 7f48ad7fa640 1 -- 172.21.15.132:0/1890527589 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48a4088b50 con 0x7f48b013cce0 2023-12-20T04:43:48.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.845+0000 7f48b4bc8640 1 --2- 172.21.15.132:0/1890527589 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f489c06a430 0x7f489c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:48.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.845+0000 7f48b4bc8640 1 --2- 172.21.15.132:0/1890527589 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f489c06a430 0x7f489c06c8f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f48a0000f60 tx=0x7f48a00078f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:48.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:48.849+0000 7f48ad7fa640 1 -- 172.21.15.132:0/1890527589 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f48a40541d0 con 0x7f48b013cce0 2023-12-20T04:43:49.033 INFO:tasks.ceph.mds.c.smithi132.stderr:2023-12-20T04:43:49.032+0000 7f75cda8a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:43:49.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.048+0000 7f48b6e2c640 1 -- 172.21.15.132:0/1890527589 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f48b013eb50 con 0x7f48b013cce0 2023-12-20T04:43:49.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.049+0000 7f48ad7fa640 1 -- 172.21.15.132:0/1890527589 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f48a4017090 con 0x7f48b013cce0 2023-12-20T04:43:49.051 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:49.051 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/703933798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":703933798},{"type":"v1","addr":"172.21.15.187:6835","nonce":703933798}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3137083608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3137083608},{"type":"v1","addr":"172.21.15.187:6833","nonce":3137083608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1340012349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1340012349},{"type":"v1","addr":"172.21.15.132:6836","nonce":1340012349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:43:44.388671+0000","modified":"2023-12-20T04:43:47.069930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/359299732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":359299732},{"type":"v1","addr":"172.21.15.132:6837","nonce":359299732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-20T04:43:49.051 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 13 2023-12-20T04:43:49.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.051+0000 7f48b6e2c640 1 -- 172.21.15.132:0/1890527589 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f489c06a430 msgr2=0x7f489c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.051+0000 7f48b6e2c640 1 --2- 172.21.15.132:0/1890527589 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f489c06a430 0x7f489c06c8f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f48a0000f60 tx=0x7f48a00078f0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.051+0000 7f48b6e2c640 1 -- 172.21.15.132:0/1890527589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48b013cce0 msgr2=0x7f48b01f3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.051+0000 7f48b6e2c640 1 --2- 172.21.15.132:0/1890527589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48b013cce0 0x7f48b01f3fa0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f48a400e9b0 tx=0x7f48a400ee70 comp rx=0 tx=0).stop 2023-12-20T04:43:49.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.051+0000 7f48b6e2c640 1 -- 172.21.15.132:0/1890527589 shutdown_connections 2023-12-20T04:43:49.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.051+0000 7f48b6e2c640 1 --2- 172.21.15.132:0/1890527589 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f489c06a430 0x7f489c06c8f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.051+0000 7f48b6e2c640 1 --2- 172.21.15.132:0/1890527589 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48b015a1d0 0x7f48b01f44e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.051+0000 7f48b6e2c640 1 --2- 172.21.15.132:0/1890527589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48b013cce0 0x7f48b01f3fa0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.051+0000 7f48b6e2c640 1 --2- 172.21.15.132:0/1890527589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48b00c92d0 0x7f48b00c8940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.051+0000 7f48b6e2c640 1 -- 172.21.15.132:0/1890527589 >> 172.21.15.132:0/1890527589 conn(0x7f48b00ced10 msgr2=0x7f48b0157d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:49.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.051+0000 7f48b6e2c640 1 -- 172.21.15.132:0/1890527589 shutdown_connections 2023-12-20T04:43:49.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.051+0000 7f48b6e2c640 1 -- 172.21.15.132:0/1890527589 wait complete. 2023-12-20T04:43:49.467 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 13, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-20T04:43:44.388671+0000', 'modified': '2023-12-20T04:43:47.069930+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5199}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5199': {'gid': 5199, 'name': 'c', 'rank': 0, 'incarnation': 10, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6837/359299732', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6835', 'nonce': 359299732}, {'type': 'v1', 'addr': '172.21.15.132:6837', 'nonce': 359299732}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [5], 'metadata_pool': 4, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-20T04:43:49.467 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-20T04:43:49.467 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-20T04:43:49.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.568+0000 7f39c1d00640 1 Processor -- start 2023-12-20T04:43:49.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.568+0000 7f39c1d00640 1 -- start start 2023-12-20T04:43:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.569+0000 7f39c1d00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39bc06b600 0x7f39bc06b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.569+0000 7f39c1d00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f39bc0ca610 0x7f39bc0caa70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.569+0000 7f39c1d00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39bc0c98e0 con 0x7f39bc0ce950 2023-12-20T04:43:49.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.569+0000 7f39c1d00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39bc0b1420 con 0x7f39bc0ca610 2023-12-20T04:43:49.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.569+0000 7f39c1d00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc0b20e0 con 0x7f39bc06b600 2023-12-20T04:43:49.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.569+0000 7f39bbfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f39bc0ca610 0x7f39bc0caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.569+0000 7f39bbfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f39bc0ca610 0x7f39bc0caa70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35200/0 (socket says 172.21.15.132:35200) 2023-12-20T04:43:49.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.569+0000 7f39bbfff640 1 -- 172.21.15.132:0/2924470969 learned_addr learned my addr 172.21.15.132:0/2924470969 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:49.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.569+0000 7f39bbfff640 1 -- 172.21.15.132:0/2924470969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39bc06b600 msgr2=0x7f39bc06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:49.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.569+0000 7f39bbfff640 1 --2- 172.21.15.132:0/2924470969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39bc06b600 0x7f39bc06b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.569+0000 7f39bbfff640 1 -- 172.21.15.132:0/2924470969 >> v1:172.21.15.132:6789/0 conn(0x7f39bc0ce950 legacy=0x7f39bc0b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.569+0000 7f39bbfff640 1 -- 172.21.15.132:0/2924470969 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39bc06bf20 con 0x7f39bc0ca610 2023-12-20T04:43:49.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.569+0000 7f39ba7fc640 1 -- 172.21.15.132:0/2924470969 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3462021056 0 0) 0x7f39bc0c98e0 con 0x7f39bc0ce950 2023-12-20T04:43:49.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.570+0000 7f39bbfff640 1 --2- 172.21.15.132:0/2924470969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39bc0ca610 0x7f39bc0caa70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009e50 tx=0x7f39b402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97073ac35b2b6d79 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:49.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.570+0000 7f39ba7fc640 1 -- 172.21.15.132:0/2924470969 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b402cb00 con 0x7f39bc0ca610 2023-12-20T04:43:49.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.570+0000 7f39ba7fc640 1 -- 172.21.15.132:0/2924470969 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b402cc60 con 0x7f39bc0ca610 2023-12-20T04:43:49.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.570+0000 7f39ba7fc640 1 -- 172.21.15.132:0/2924470969 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b40343f0 con 0x7f39bc0ca610 2023-12-20T04:43:49.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.571+0000 7f39c1d00640 1 -- 172.21.15.132:0/2924470969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39bc0ca610 msgr2=0x7f39bc0caa70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.571+0000 7f39c1d00640 1 --2- 172.21.15.132:0/2924470969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39bc0ca610 0x7f39bc0caa70 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f39b4009e50 tx=0x7f39b402bf60 comp rx=0 tx=0).stop 2023-12-20T04:43:49.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.571+0000 7f39c1d00640 1 -- 172.21.15.132:0/2924470969 shutdown_connections 2023-12-20T04:43:49.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.571+0000 7f39c1d00640 1 --2- 172.21.15.132:0/2924470969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39bc0ca610 0x7f39bc0caa70 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.571+0000 7f39c1d00640 1 --2- 172.21.15.132:0/2924470969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39bc06b600 0x7f39bc06b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.571+0000 7f39c1d00640 1 -- 172.21.15.132:0/2924470969 >> 172.21.15.132:0/2924470969 conn(0x7f39bc0cbd10 msgr2=0x7f39bc0cc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:49.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.571+0000 7f39c1d00640 1 -- 172.21.15.132:0/2924470969 shutdown_connections 2023-12-20T04:43:49.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.571+0000 7f39c1d00640 1 -- 172.21.15.132:0/2924470969 wait complete. 2023-12-20T04:43:49.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.572+0000 7f39c1d00640 1 Processor -- start 2023-12-20T04:43:49.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.572+0000 7f39c1d00640 1 -- start start 2023-12-20T04:43:49.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.573+0000 7f39c1d00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39bc06b600 0x7f39bc1f2080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.573+0000 7f39c1d00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39bc0ca610 0x7f39bc14cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.573+0000 7f39c1d00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39bc0ce950 0x7f39bc14d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.573+0000 7f39c1d00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc14da30 con 0x7f39bc06b600 2023-12-20T04:43:49.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.573+0000 7f39c1d00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc09c050 con 0x7f39bc0ca610 2023-12-20T04:43:49.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.573+0000 7f39c1d00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39bc09c330 con 0x7f39bc0ce950 2023-12-20T04:43:49.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.573+0000 7f39bb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39bc06b600 0x7f39bc1f2080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.573+0000 7f39bb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39bc06b600 0x7f39bc1f2080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35210/0 (socket says 172.21.15.132:35210) 2023-12-20T04:43:49.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.573+0000 7f39bb7fe640 1 -- 172.21.15.132:0/3777090327 learned_addr learned my addr 172.21.15.132:0/3777090327 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:49.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.573+0000 7f39bbfff640 1 --2- 172.21.15.132:0/3777090327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39bc0ce950 0x7f39bc14d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.573+0000 7f39baffd640 1 --2- 172.21.15.132:0/3777090327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39bc0ca610 0x7f39bc14cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.573+0000 7f39bb7fe640 1 -- 172.21.15.132:0/3777090327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39bc0ce950 msgr2=0x7f39bc14d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.573+0000 7f39bb7fe640 1 --2- 172.21.15.132:0/3777090327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39bc0ce950 0x7f39bc14d4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.573+0000 7f39bb7fe640 1 -- 172.21.15.132:0/3777090327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39bc0ca610 msgr2=0x7f39bc14cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.573+0000 7f39bb7fe640 1 --2- 172.21.15.132:0/3777090327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39bc0ca610 0x7f39bc14cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.573+0000 7f39bb7fe640 1 -- 172.21.15.132:0/3777090327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39b4009b30 con 0x7f39bc06b600 2023-12-20T04:43:49.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.573+0000 7f39baffd640 1 --2- 172.21.15.132:0/3777090327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39bc0ca610 0x7f39bc14cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:49.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.574+0000 7f39bb7fe640 1 --2- 172.21.15.132:0/3777090327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39bc06b600 0x7f39bc1f2080 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00b4a0 tx=0x7f39ac00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:49.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.574+0000 7f39a3fff640 1 -- 172.21.15.132:0/3777090327 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac010610 con 0x7f39bc06b600 2023-12-20T04:43:49.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.574+0000 7f39a3fff640 1 -- 172.21.15.132:0/3777090327 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac010770 con 0x7f39bc06b600 2023-12-20T04:43:49.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.574+0000 7f39c1d00640 1 -- 172.21.15.132:0/3777090327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39bc09c610 con 0x7f39bc06b600 2023-12-20T04:43:49.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.574+0000 7f39a3fff640 1 -- 172.21.15.132:0/3777090327 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac010b20 con 0x7f39bc06b600 2023-12-20T04:43:49.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.574+0000 7f39c1d00640 1 -- 172.21.15.132:0/3777090327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39bc0aebd0 con 0x7f39bc06b600 2023-12-20T04:43:49.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.575+0000 7f39a3fff640 1 -- 172.21.15.132:0/3777090327 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f39ac010c80 con 0x7f39bc06b600 2023-12-20T04:43:49.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.575+0000 7f39a3fff640 1 --2- 172.21.15.132:0/3777090327 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f39a806a430 0x7f39a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.576+0000 7f39a3fff640 1 -- 172.21.15.132:0/3777090327 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39ac0885a0 con 0x7f39bc06b600 2023-12-20T04:43:49.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.576+0000 7f39baffd640 1 --2- 172.21.15.132:0/3777090327 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f39a806a430 0x7f39a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.576+0000 7f39baffd640 1 --2- 172.21.15.132:0/3777090327 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f39a806a430 0x7f39a806c8f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0c5cf0 tx=0x7f39b0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.577+0000 7f39c4875740 1 Processor -- start 2023-12-20T04:43:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.577+0000 7f39c4875740 1 -- start start 2023-12-20T04:43:49.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39c4875740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686390 0x55d459659520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39c4875740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d459686770 0x55d459689120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39c4875740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d459659a60 0x55d459689660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39c4875740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4595c90b0 con 0x55d459686390 2023-12-20T04:43:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39c4875740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4595c6840 con 0x55d459659a60 2023-12-20T04:43:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39c4875740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d4595c2130 con 0x55d459686770 2023-12-20T04:43:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39bb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686390 0x55d459659520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39bb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686390 0x55d459659520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35214/0 (socket says 172.21.15.132:35214) 2023-12-20T04:43:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39bb7fe640 1 -- 172.21.15.132:0/833297125 learned_addr learned my addr 172.21.15.132:0/833297125 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39baffd640 1 --2- 172.21.15.132:0/833297125 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d459686770 0x55d459689120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39bbfff640 1 --2- 172.21.15.132:0/833297125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d459659a60 0x55d459689660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39bb7fe640 1 -- 172.21.15.132:0/833297125 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d459686770 msgr2=0x55d459689120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39bb7fe640 1 --2- 172.21.15.132:0/833297125 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d459686770 0x55d459689120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39bb7fe640 1 -- 172.21.15.132:0/833297125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d459659a60 msgr2=0x55d459689660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39bb7fe640 1 --2- 172.21.15.132:0/833297125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d459659a60 0x55d459689660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39bb7fe640 1 -- 172.21.15.132:0/833297125 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d45957cc40 con 0x55d459686390 2023-12-20T04:43:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39bbfff640 1 --2- 172.21.15.132:0/833297125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d459659a60 0x55d459689660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39bb7fe640 1 --2- 172.21.15.132:0/833297125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686390 0x55d459659520 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f39ac05f300 tx=0x7f39ac00bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aee70a78492770ee server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39a17fa640 1 -- 172.21.15.132:0/833297125 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac055bf0 con 0x55d459686390 2023-12-20T04:43:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39a17fa640 1 -- 172.21.15.132:0/833297125 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac053f60 con 0x55d459686390 2023-12-20T04:43:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.578+0000 7f39a17fa640 1 -- 172.21.15.132:0/833297125 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39ac05f5c0 con 0x55d459686390 2023-12-20T04:43:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.579+0000 7f39c4875740 1 -- 172.21.15.132:0/833297125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686390 msgr2=0x55d459659520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.579+0000 7f39c4875740 1 --2- 172.21.15.132:0/833297125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686390 0x55d459659520 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f39ac05f300 tx=0x7f39ac00bf90 comp rx=0 tx=0).stop 2023-12-20T04:43:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.579+0000 7f39c4875740 1 -- 172.21.15.132:0/833297125 shutdown_connections 2023-12-20T04:43:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.579+0000 7f39c4875740 1 --2- 172.21.15.132:0/833297125 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d459659a60 0x55d459689660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.579+0000 7f39c4875740 1 --2- 172.21.15.132:0/833297125 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d459686770 0x55d459689120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.579+0000 7f39c4875740 1 --2- 172.21.15.132:0/833297125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686390 0x55d459659520 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.579+0000 7f39c4875740 1 -- 172.21.15.132:0/833297125 >> 172.21.15.132:0/833297125 conn(0x55d45965b830 msgr2=0x55d4596a4120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:49.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.579+0000 7f39c4875740 1 -- 172.21.15.132:0/833297125 shutdown_connections 2023-12-20T04:43:49.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.579+0000 7f39c4875740 1 -- 172.21.15.132:0/833297125 wait complete. 2023-12-20T04:43:49.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.580+0000 7f39c4875740 1 -- start start 2023-12-20T04:43:49.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.580+0000 7f39c4875740 1 Processor -- start 2023-12-20T04:43:49.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.580+0000 7f39c4875740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d459686390 0x55d45969acd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39c4875740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d45968a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39c4875740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d45968bb40 0x55d45968ca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39c4875740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d459580840 con 0x55d459686770 2023-12-20T04:43:49.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39c4875740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4595804e0 con 0x55d45968bb40 2023-12-20T04:43:49.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39c4875740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d459546230 con 0x55d459686390 2023-12-20T04:43:49.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39c4875740 10 client.0 _ll_register_callbacks cb 0x55d4595976d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:43:49.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39baffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d45968a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39baffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d45968a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35222/0 (socket says 172.21.15.132:35222) 2023-12-20T04:43:49.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39baffd640 1 -- 172.21.15.132:0/233236566 learned_addr learned my addr 172.21.15.132:0/233236566 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:49.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39bb7fe640 1 --2- 172.21.15.132:0/233236566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d459686390 0x55d45969acd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39bbfff640 1 --2- 172.21.15.132:0/233236566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d45968bb40 0x55d45968ca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39baffd640 1 -- 172.21.15.132:0/233236566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d459686390 msgr2=0x55d45969acd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:49.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39baffd640 1 --2- 172.21.15.132:0/233236566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d459686390 0x55d45969acd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39baffd640 1 -- 172.21.15.132:0/233236566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d45968bb40 msgr2=0x55d45968ca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:49.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39baffd640 1 --2- 172.21.15.132:0/233236566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d45968bb40 0x55d45968ca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39baffd640 1 -- 172.21.15.132:0/233236566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39bc0aebd0 con 0x55d459686770 2023-12-20T04:43:49.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39baffd640 1 --2- 172.21.15.132:0/233236566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d45968a1a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f39bc151740 tx=0x7f39b0001080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc7afae309f210da server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:49.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f399a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:43:49.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f399a7fc640 1 -- 172.21.15.132:0/233236566 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0012410 con 0x55d459686770 2023-12-20T04:43:49.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f399a7fc640 1 -- 172.21.15.132:0/233236566 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39b0021aa0 con 0x55d459686770 2023-12-20T04:43:49.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39c4875740 1 -- 172.21.15.132:0/233236566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d4595eb970 con 0x55d459686770 2023-12-20T04:43:49.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f399a7fc640 1 -- 172.21.15.132:0/233236566 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39b0021c60 con 0x55d459686770 2023-12-20T04:43:49.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39c4875740 10 client.5382 fetch_fsmap learned FSMap version 13 2023-12-20T04:43:49.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.581+0000 7f39c4875740 1 -- 172.21.15.132:0/233236566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x55d4595c07b0 con 0x55d459686770 2023-12-20T04:43:49.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.582+0000 7f399a7fc640 1 -- 172.21.15.132:0/233236566 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d4595eb970 con 0x55d459686770 2023-12-20T04:43:49.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.582+0000 7f399a7fc640 1 -- 172.21.15.132:0/233236566 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 13) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f39b001f070 con 0x55d459686770 2023-12-20T04:43:49.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.582+0000 7f39c4875740 10 client.5382 fetch_fsmap finished waiting for FSMap version 13 2023-12-20T04:43:49.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.582+0000 7f39c4875740 10 client.5382 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-20T04:43:49.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.582+0000 7f39c4875740 20 client.5382 populate_metadata read hostname 'smithi132' 2023-12-20T04:43:49.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.582+0000 7f39c4875740 1 --2- 172.21.15.132:0/233236566 >> [v2:172.21.15.132:6835/359299732,v1:172.21.15.132:6837/359299732] conn(0x55d4596b4120 0x55d459687100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.582+0000 7f39c4875740 4 client.5382 mds_command: new command op to 5199 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-20T04:43:49.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.582+0000 7f39c4875740 1 -- 172.21.15.132:0/233236566 --> [v2:172.21.15.132:6835/359299732,v1:172.21.15.132:6837/359299732] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d4595b3f00 con 0x55d4596b4120 2023-12-20T04:43:49.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.582+0000 7f39bb7fe640 1 --2- 172.21.15.132:0/233236566 >> [v2:172.21.15.132:6835/359299732,v1:172.21.15.132:6837/359299732] conn(0x55d4596b4120 0x55d459687100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.582+0000 7f399a7fc640 10 client.5382 ms_handle_connect on v2:172.21.15.132:6835/359299732 2023-12-20T04:43:49.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.582+0000 7f39bb7fe640 1 --2- 172.21.15.132:0/233236566 >> [v2:172.21.15.132:6835/359299732,v1:172.21.15.132:6837/359299732] conn(0x55d4596b4120 0x55d459687100 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e6a51e4faa413033 server_cookie=d93ce43274633d6b in_seq=0 out_seq=0 2023-12-20T04:43:49.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.582+0000 7f399a7fc640 1 -- 172.21.15.132:0/233236566 <== mds.0 v2:172.21.15.132:6835/359299732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55d4595b3f00 con 0x55d4596b4120 2023-12-20T04:43:49.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.583+0000 7f399a7fc640 10 client.5382 handle_command_reply: tid=0 2023-12-20T04:43:49.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.583+0000 7f39c4875740 1 client.5382 shutdown 2023-12-20T04:43:49.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.583+0000 7f39c4875740 1 -- 172.21.15.132:0/233236566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 msgr2=0x55d45968a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.583+0000 7f39c4875740 1 --2- 172.21.15.132:0/233236566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d45968a1a0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f39bc151740 tx=0x7f39b0001080 comp rx=0 tx=0).stop 2023-12-20T04:43:49.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.583+0000 7f39c4875740 1 -- 172.21.15.132:0/233236566 shutdown_connections 2023-12-20T04:43:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.583+0000 7f39c4875740 1 --2- 172.21.15.132:0/233236566 >> [v2:172.21.15.132:6835/359299732,v1:172.21.15.132:6837/359299732] conn(0x55d4596b4120 0x55d459687100 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.583+0000 7f39c4875740 1 --2- 172.21.15.132:0/233236566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d45968bb40 0x55d45968ca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.583+0000 7f399a7fc640 0 client.5382 ms_handle_reset on v2:172.21.15.132:6835/359299732 2023-12-20T04:43:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.583+0000 7f39c4875740 1 --2- 172.21.15.132:0/233236566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d45968a1a0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.583+0000 7f39c4875740 1 --2- 172.21.15.132:0/233236566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d459686390 0x55d45969acd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.583+0000 7f39c4875740 1 -- 172.21.15.132:0/233236566 >> 172.21.15.132:0/233236566 conn(0x55d459659a60 msgr2=0x55d4596a7630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.583+0000 7f39c4875740 1 -- 172.21.15.132:0/233236566 shutdown_connections 2023-12-20T04:43:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.583+0000 7f39c4875740 1 -- 172.21.15.132:0/233236566 wait complete. 2023-12-20T04:43:49.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.583+0000 7f39c4875740 20 client.5382 trim_cache size 0 max 16384 2023-12-20T04:43:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.597+0000 7f39c4875740 1 Processor -- start 2023-12-20T04:43:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.598+0000 7f39c4875740 1 -- start start 2023-12-20T04:43:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.598+0000 7f39c4875740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d459686390 0x55d459658470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.598+0000 7f39c4875740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d4596589b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.598+0000 7f39c4875740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d45968bb40 0x55d4596a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.598+0000 7f39c4875740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d459689ce0 con 0x55d459686770 2023-12-20T04:43:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.598+0000 7f39c4875740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d45969acd0 con 0x55d459686390 2023-12-20T04:43:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.598+0000 7f39c4875740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d45968b060 con 0x55d45968bb40 2023-12-20T04:43:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.599+0000 7f39baffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d4596589b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.599+0000 7f39baffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d4596589b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35226/0 (socket says 172.21.15.132:35226) 2023-12-20T04:43:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.599+0000 7f39baffd640 1 -- 172.21.15.132:0/2193909285 learned_addr learned my addr 172.21.15.132:0/2193909285 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.599+0000 7f39bb7fe640 1 --2- 172.21.15.132:0/2193909285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d459686390 0x55d459658470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.599+0000 7f39bbfff640 1 --2- 172.21.15.132:0/2193909285 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d45968bb40 0x55d4596a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.599+0000 7f39baffd640 1 -- 172.21.15.132:0/2193909285 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d45968bb40 msgr2=0x55d4596a5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.599+0000 7f39baffd640 1 --2- 172.21.15.132:0/2193909285 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d45968bb40 0x55d4596a5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.599+0000 7f39baffd640 1 -- 172.21.15.132:0/2193909285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d459686390 msgr2=0x55d459658470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.599+0000 7f39baffd640 1 --2- 172.21.15.132:0/2193909285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d459686390 0x55d459658470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.599+0000 7f39baffd640 1 -- 172.21.15.132:0/2193909285 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d459562be0 con 0x55d459686770 2023-12-20T04:43:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.599+0000 7f39baffd640 1 --2- 172.21.15.132:0/2193909285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d4596589b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f39b000d6c0 tx=0x7f39b0019000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a12f9ebb76004594 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.599+0000 7f39a1ffb640 1 -- 172.21.15.132:0/2193909285 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0000f40 con 0x55d459686770 2023-12-20T04:43:49.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.599+0000 7f39a1ffb640 1 -- 172.21.15.132:0/2193909285 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39b0018070 con 0x55d459686770 2023-12-20T04:43:49.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.599+0000 7f39a1ffb640 1 -- 172.21.15.132:0/2193909285 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0012da0 con 0x55d459686770 2023-12-20T04:43:49.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.600+0000 7f39c4875740 1 -- 172.21.15.132:0/2193909285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 msgr2=0x55d4596589b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.600+0000 7f39c4875740 1 --2- 172.21.15.132:0/2193909285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d4596589b0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f39b000d6c0 tx=0x7f39b0019000 comp rx=0 tx=0).stop 2023-12-20T04:43:49.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.600+0000 7f39c4875740 1 -- 172.21.15.132:0/2193909285 shutdown_connections 2023-12-20T04:43:49.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.600+0000 7f39c4875740 1 --2- 172.21.15.132:0/2193909285 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d45968bb40 0x55d4596a5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.600+0000 7f39c4875740 1 --2- 172.21.15.132:0/2193909285 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d4596589b0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.600+0000 7f39c4875740 1 --2- 172.21.15.132:0/2193909285 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d459686390 0x55d459658470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.600+0000 7f39c4875740 1 -- 172.21.15.132:0/2193909285 >> 172.21.15.132:0/2193909285 conn(0x55d459659a60 msgr2=0x55d45968cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:49.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.600+0000 7f39c4875740 1 -- 172.21.15.132:0/2193909285 shutdown_connections 2023-12-20T04:43:49.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.600+0000 7f39c4875740 1 -- 172.21.15.132:0/2193909285 wait complete. 2023-12-20T04:43:49.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.600+0000 7f39c4875740 1 -- start start 2023-12-20T04:43:49.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.600+0000 7f39c4875740 1 Processor -- start 2023-12-20T04:43:49.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.601+0000 7f39c4875740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d459686390 0x55d4596bcf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.601+0000 7f39c4875740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d4596bd460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.601+0000 7f39c4875740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d45968bb40 0x55d4596a5370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.601+0000 7f39c4875740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d459674f00 con 0x55d459686770 2023-12-20T04:43:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.601+0000 7f39c4875740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d4596a63a0 con 0x55d459686390 2023-12-20T04:43:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.601+0000 7f39c4875740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d459658b40 con 0x55d45968bb40 2023-12-20T04:43:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.601+0000 7f39c4875740 10 client.0 _ll_register_callbacks cb 0x7f39ac057620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:43:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.601+0000 7f39baffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d4596bd460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.601+0000 7f39baffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d4596bd460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35238/0 (socket says 172.21.15.132:35238) 2023-12-20T04:43:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.601+0000 7f39baffd640 1 -- 172.21.15.132:0/3538815399 learned_addr learned my addr 172.21.15.132:0/3538815399 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.601+0000 7f39bb7fe640 1 --2- 172.21.15.132:0/3538815399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d459686390 0x55d4596bcf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.601+0000 7f39bbfff640 1 --2- 172.21.15.132:0/3538815399 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d45968bb40 0x55d4596a5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.601+0000 7f39baffd640 1 -- 172.21.15.132:0/3538815399 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d45968bb40 msgr2=0x55d4596a5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.601+0000 7f39baffd640 1 --2- 172.21.15.132:0/3538815399 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d45968bb40 0x55d4596a5370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.601+0000 7f39baffd640 1 -- 172.21.15.132:0/3538815399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d459686390 msgr2=0x55d4596bcf20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.601+0000 7f39baffd640 1 --2- 172.21.15.132:0/3538815399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d459686390 0x55d4596bcf20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f39baffd640 1 -- 172.21.15.132:0/3538815399 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d4595c07b0 con 0x55d459686770 2023-12-20T04:43:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f39bbfff640 1 --2- 172.21.15.132:0/3538815399 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d45968bb40 0x55d4596a5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f39baffd640 1 --2- 172.21.15.132:0/3538815399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d4596bd460 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f39b0032040 tx=0x7f39b0012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a27b7aaa2795dfa server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f399a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:43:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f399a7fc640 1 -- 172.21.15.132:0/3538815399 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f39b0012820 con 0x55d459686770 2023-12-20T04:43:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f399a7fc640 1 -- 172.21.15.132:0/3538815399 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f39b0040aa0 con 0x55d459686770 2023-12-20T04:43:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f39c4875740 1 -- 172.21.15.132:0/3538815399 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f39ac053f60 con 0x55d459686770 2023-12-20T04:43:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f399a7fc640 1 -- 172.21.15.132:0/3538815399 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=13) v2 ==== 24+0+0 (secure 0 0 0) 0x7f39b0003e50 con 0x55d459686770 2023-12-20T04:43:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f39c4875740 10 client.5388 fetch_fsmap learned FSMap version 13 2023-12-20T04:43:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f39c4875740 1 -- 172.21.15.132:0/3538815399 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=13,monmap=2+}) v3 -- 0x55d4595882f0 con 0x55d459686770 2023-12-20T04:43:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f399a7fc640 1 -- 172.21.15.132:0/3538815399 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f39ac053f60 con 0x55d459686770 2023-12-20T04:43:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f399a7fc640 1 -- 172.21.15.132:0/3538815399 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 13) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f39b0040c60 con 0x55d459686770 2023-12-20T04:43:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f39c4875740 10 client.5388 fetch_fsmap finished waiting for FSMap version 13 2023-12-20T04:43:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f39c4875740 10 client.5388 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-20T04:43:49.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f39c4875740 20 client.5388 populate_metadata read hostname 'smithi132' 2023-12-20T04:43:49.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f39c4875740 1 --2- 172.21.15.132:0/3538815399 >> [v2:172.21.15.132:6835/359299732,v1:172.21.15.132:6837/359299732] conn(0x55d4596888e0 0x55d4596a58b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f39c4875740 4 client.5388 mds_command: new command op to 5199 tid=0[{"prefix": "status"}] 2023-12-20T04:43:49.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f39c4875740 1 -- 172.21.15.132:0/3538815399 --> [v2:172.21.15.132:6835/359299732,v1:172.21.15.132:6837/359299732] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d4595bb1b0 con 0x55d4596888e0 2023-12-20T04:43:49.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.602+0000 7f39bb7fe640 1 --2- 172.21.15.132:0/3538815399 >> [v2:172.21.15.132:6835/359299732,v1:172.21.15.132:6837/359299732] conn(0x55d4596888e0 0x55d4596a58b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.603+0000 7f399a7fc640 10 client.5388 ms_handle_connect on v2:172.21.15.132:6835/359299732 2023-12-20T04:43:49.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.603+0000 7f39bb7fe640 1 --2- 172.21.15.132:0/3538815399 >> [v2:172.21.15.132:6835/359299732,v1:172.21.15.132:6837/359299732] conn(0x55d4596888e0 0x55d4596a58b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=1528d01a004c9f1 server_cookie=e5c4a2978a0e441d in_seq=0 out_seq=0 2023-12-20T04:43:49.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.603+0000 7f399a7fc640 1 -- 172.21.15.132:0/3538815399 <== mds.0 v2:172.21.15.132:6835/359299732 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55d4595bb1b0 con 0x55d4596888e0 2023-12-20T04:43:49.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.603+0000 7f399a7fc640 10 client.5388 handle_command_reply: tid=0 2023-12-20T04:43:49.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.603+0000 7f39c4875740 1 client.5388 shutdown 2023-12-20T04:43:49.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.603+0000 7f39c4875740 1 -- 172.21.15.132:0/3538815399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 msgr2=0x55d4596bd460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.603+0000 7f39c4875740 1 --2- 172.21.15.132:0/3538815399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d4596bd460 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f39b0032040 tx=0x7f39b0012000 comp rx=0 tx=0).stop 2023-12-20T04:43:49.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.603+0000 7f39c4875740 1 -- 172.21.15.132:0/3538815399 shutdown_connections 2023-12-20T04:43:49.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.603+0000 7f39c4875740 1 --2- 172.21.15.132:0/3538815399 >> [v2:172.21.15.132:6835/359299732,v1:172.21.15.132:6837/359299732] conn(0x55d4596888e0 0x55d4596a58b0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.603+0000 7f39c4875740 1 --2- 172.21.15.132:0/3538815399 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d45968bb40 0x55d4596a5370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.603+0000 7f399a7fc640 0 client.5388 ms_handle_reset on v2:172.21.15.132:6835/359299732 2023-12-20T04:43:49.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.603+0000 7f39c4875740 1 --2- 172.21.15.132:0/3538815399 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d459686770 0x55d4596bd460 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.603+0000 7f39c4875740 1 --2- 172.21.15.132:0/3538815399 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d459686390 0x55d4596bcf20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.603+0000 7f39c4875740 1 -- 172.21.15.132:0/3538815399 >> 172.21.15.132:0/3538815399 conn(0x55d459659a60 msgr2=0x55d45968cf70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:49.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.603+0000 7f39c4875740 1 -- 172.21.15.132:0/3538815399 shutdown_connections 2023-12-20T04:43:49.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.603+0000 7f39c4875740 1 -- 172.21.15.132:0/3538815399 wait complete. 2023-12-20T04:43:49.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.603+0000 7f39c4875740 20 client.5388 trim_cache size 0 max 16384 2023-12-20T04:43:49.612 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:43:49.612 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:43:49.612 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-12-20T04:43:49.612 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 5199, 2023-12-20T04:43:49.612 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-12-20T04:43:49.613 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-12-20T04:43:49.613 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-12-20T04:43:49.613 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 5.2121712069999999, 2023-12-20T04:43:49.613 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 13, 2023-12-20T04:43:49.613 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 33, 2023-12-20T04:43:49.613 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 33, 2023-12-20T04:43:49.613 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 11.428945558000001 2023-12-20T04:43:49.613 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:43:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.604+0000 7f39c1d00640 1 -- 172.21.15.132:0/3777090327 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f39a806a430 msgr2=0x7f39a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.604+0000 7f39c1d00640 1 --2- 172.21.15.132:0/3777090327 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f39a806a430 0x7f39a806c8f0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f39bc0c5cf0 tx=0x7f39b0009040 comp rx=0 tx=0).stop 2023-12-20T04:43:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.604+0000 7f39c1d00640 1 -- 172.21.15.132:0/3777090327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39bc06b600 msgr2=0x7f39bc1f2080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.604+0000 7f39c1d00640 1 --2- 172.21.15.132:0/3777090327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39bc06b600 0x7f39bc1f2080 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f39ac00b4a0 tx=0x7f39ac00b960 comp rx=0 tx=0).stop 2023-12-20T04:43:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.604+0000 7f39c1d00640 1 -- 172.21.15.132:0/3777090327 shutdown_connections 2023-12-20T04:43:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.604+0000 7f39c1d00640 1 --2- 172.21.15.132:0/3777090327 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f39a806a430 0x7f39a806c8f0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.604+0000 7f39c1d00640 1 --2- 172.21.15.132:0/3777090327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39bc0ce950 0x7f39bc14d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.604+0000 7f39c1d00640 1 --2- 172.21.15.132:0/3777090327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f39bc0ca610 0x7f39bc14cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.604+0000 7f39c1d00640 1 --2- 172.21.15.132:0/3777090327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39bc06b600 0x7f39bc1f2080 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.604+0000 7f39c1d00640 1 -- 172.21.15.132:0/3777090327 >> 172.21.15.132:0/3777090327 conn(0x7f39bc0cbd10 msgr2=0x7f39bc0cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:49.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.604+0000 7f39c1d00640 1 -- 172.21.15.132:0/3777090327 shutdown_connections 2023-12-20T04:43:49.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.604+0000 7f39c1d00640 1 -- 172.21.15.132:0/3777090327 wait complete. 2023-12-20T04:43:49.617 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:43:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.714+0000 7f32a0f99640 1 Processor -- start 2023-12-20T04:43:49.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.714+0000 7f32a0f99640 1 -- start start 2023-12-20T04:43:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.715+0000 7f32a0f99640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f329c15d110 0x7f329c069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.715+0000 7f32a0f99640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f329c15d4f0 0x7f329c06a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.715+0000 7f32a0f99640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f329c161ce0 con 0x7f329c0aeb00 2023-12-20T04:43:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.715+0000 7f32a0f99640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329c0aca50 con 0x7f329c15d4f0 2023-12-20T04:43:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.715+0000 7f32a0f99640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f329c160df0 con 0x7f329c15d110 2023-12-20T04:43:49.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.715+0000 7f3299d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f329c15d4f0 0x7f329c06a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.715+0000 7f3299d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f329c15d4f0 0x7f329c06a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35240/0 (socket says 172.21.15.132:35240) 2023-12-20T04:43:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.715+0000 7f3299d9b640 1 -- 172.21.15.132:0/3461930768 learned_addr learned my addr 172.21.15.132:0/3461930768 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.715+0000 7f329a59c640 1 --2- 172.21.15.132:0/3461930768 >> v2:172.21.15.187:3300/0 conn(0x7f329c15d110 0x7f329c069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.715+0000 7f3299d9b640 1 -- 172.21.15.132:0/3461930768 >> v2:172.21.15.187:3300/0 conn(0x7f329c15d110 msgr2=0x7f329c069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.715+0000 7f3299d9b640 1 --2- 172.21.15.132:0/3461930768 >> v2:172.21.15.187:3300/0 conn(0x7f329c15d110 0x7f329c069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.715+0000 7f3299d9b640 1 -- 172.21.15.132:0/3461930768 >> v1:172.21.15.187:6789/0 conn(0x7f329c0aeb00 legacy=0x7f329c070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.715+0000 7f3299d9b640 1 -- 172.21.15.132:0/3461930768 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f329c1610d0 con 0x7f329c15d4f0 2023-12-20T04:43:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.716+0000 7f3299d9b640 1 --2- 172.21.15.132:0/3461930768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f329c15d4f0 0x7f329c06a320 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f329c0c62b0 tx=0x7f329002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db0a99cebdc8d402 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.716+0000 7f329959a640 1 -- 172.21.15.132:0/3461930768 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3290030860 con 0x7f329c15d4f0 2023-12-20T04:43:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.716+0000 7f329959a640 1 -- 172.21.15.132:0/3461930768 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32900309c0 con 0x7f329c15d4f0 2023-12-20T04:43:49.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.716+0000 7f329959a640 1 -- 172.21.15.132:0/3461930768 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3290030d50 con 0x7f329c15d4f0 2023-12-20T04:43:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.717+0000 7f32a0f99640 1 -- 172.21.15.132:0/3461930768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f329c15d4f0 msgr2=0x7f329c06a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.717+0000 7f32a0f99640 1 --2- 172.21.15.132:0/3461930768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f329c15d4f0 0x7f329c06a320 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f329c0c62b0 tx=0x7f329002b9a0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.717+0000 7f32a0f99640 1 -- 172.21.15.132:0/3461930768 shutdown_connections 2023-12-20T04:43:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.717+0000 7f32a0f99640 1 --2- 172.21.15.132:0/3461930768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f329c15d4f0 0x7f329c06a320 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.717+0000 7f32a0f99640 1 --2- 172.21.15.132:0/3461930768 >> v2:172.21.15.187:3300/0 conn(0x7f329c15d110 0x7f329c069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.717+0000 7f32a0f99640 1 -- 172.21.15.132:0/3461930768 >> 172.21.15.132:0/3461930768 conn(0x7f329c0cfbd0 msgr2=0x7f329c0cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.717+0000 7f32a0f99640 1 -- 172.21.15.132:0/3461930768 shutdown_connections 2023-12-20T04:43:49.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.717+0000 7f32a0f99640 1 -- 172.21.15.132:0/3461930768 wait complete. 2023-12-20T04:43:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.718+0000 7f32a0f99640 1 Processor -- start 2023-12-20T04:43:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.718+0000 7f32a0f99640 1 -- start start 2023-12-20T04:43:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f32a0f99640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f329c0aeb00 0x7f329c0aef30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f32a0f99640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f329c15d110 0x7f329c0b1110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f32a0f99640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f329c15d4f0 0x7f329c155090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f32a0f99640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c0b01d0 con 0x7f329c0aeb00 2023-12-20T04:43:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f32a0f99640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f329c0b1650 con 0x7f329c15d4f0 2023-12-20T04:43:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f32a0f99640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f329c0b0660 con 0x7f329c15d110 2023-12-20T04:43:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f329a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f329c0aeb00 0x7f329c0aef30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f329a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f329c0aeb00 0x7f329c0aef30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35256/0 (socket says 172.21.15.132:35256) 2023-12-20T04:43:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f329a59c640 1 -- 172.21.15.132:0/749724212 learned_addr learned my addr 172.21.15.132:0/749724212 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f3299d9b640 1 --2- 172.21.15.132:0/749724212 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f329c15d110 0x7f329c0b1110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f329ad9d640 1 --2- 172.21.15.132:0/749724212 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f329c15d4f0 0x7f329c155090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f329a59c640 1 -- 172.21.15.132:0/749724212 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f329c15d110 msgr2=0x7f329c0b1110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f329a59c640 1 --2- 172.21.15.132:0/749724212 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f329c15d110 0x7f329c0b1110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f329a59c640 1 -- 172.21.15.132:0/749724212 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f329c15d4f0 msgr2=0x7f329c155090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f329a59c640 1 --2- 172.21.15.132:0/749724212 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f329c15d4f0 0x7f329c155090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f329a59c640 1 -- 172.21.15.132:0/749724212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32900094d0 con 0x7f329c0aeb00 2023-12-20T04:43:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f329ad9d640 1 --2- 172.21.15.132:0/749724212 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f329c15d4f0 0x7f329c155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.719+0000 7f329a59c640 1 --2- 172.21.15.132:0/749724212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f329c0aeb00 0x7f329c0aef30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f328c009e00 tx=0x7f328c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.720+0000 7f328affd640 1 -- 172.21.15.132:0/749724212 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c014680 con 0x7f329c0aeb00 2023-12-20T04:43:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.720+0000 7f328affd640 1 -- 172.21.15.132:0/749724212 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f328c00f040 con 0x7f329c0aeb00 2023-12-20T04:43:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.720+0000 7f328affd640 1 -- 172.21.15.132:0/749724212 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f328c014a00 con 0x7f329c0aeb00 2023-12-20T04:43:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.720+0000 7f32a0f99640 1 -- 172.21.15.132:0/749724212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f329c0af5c0 con 0x7f329c0aeb00 2023-12-20T04:43:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.720+0000 7f32a0f99640 1 -- 172.21.15.132:0/749724212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f329c0afb80 con 0x7f329c0aeb00 2023-12-20T04:43:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.721+0000 7f32a0f99640 1 -- 172.21.15.132:0/749724212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f329c04e840 con 0x7f329c0aeb00 2023-12-20T04:43:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.721+0000 7f328affd640 1 -- 172.21.15.132:0/749724212 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f328c014b60 con 0x7f329c0aeb00 2023-12-20T04:43:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.721+0000 7f328affd640 1 --2- 172.21.15.132:0/749724212 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f327c06a430 0x7f327c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.722+0000 7f328affd640 1 -- 172.21.15.132:0/749724212 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f328c0895a0 con 0x7f329c0aeb00 2023-12-20T04:43:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.722+0000 7f3299d9b640 1 --2- 172.21.15.132:0/749724212 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f327c06a430 0x7f327c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:49.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.722+0000 7f3299d9b640 1 --2- 172.21.15.132:0/749724212 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f327c06a430 0x7f327c06c8f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3290036000 tx=0x7f3290008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:49.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.726+0000 7f328affd640 1 -- 172.21.15.132:0/749724212 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f328c054b90 con 0x7f329c0aeb00 2023-12-20T04:43:49.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.927+0000 7f32a0f99640 1 -- 172.21.15.132:0/749724212 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f329c0d0940 con 0x7f329c0aeb00 2023-12-20T04:43:49.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.927+0000 7f328affd640 1 -- 172.21.15.132:0/749724212 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7f328c0581b0 con 0x7f329c0aeb00 2023-12-20T04:43:49.929 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:43:49.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.929+0000 7f32a0f99640 1 -- 172.21.15.132:0/749724212 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f327c06a430 msgr2=0x7f327c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.929+0000 7f32a0f99640 1 --2- 172.21.15.132:0/749724212 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f327c06a430 0x7f327c06c8f0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3290036000 tx=0x7f3290008030 comp rx=0 tx=0).stop 2023-12-20T04:43:49.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.929+0000 7f32a0f99640 1 -- 172.21.15.132:0/749724212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f329c0aeb00 msgr2=0x7f329c0aef30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:49.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.929+0000 7f32a0f99640 1 --2- 172.21.15.132:0/749724212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f329c0aeb00 0x7f329c0aef30 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f328c009e00 tx=0x7f328c00c490 comp rx=0 tx=0).stop 2023-12-20T04:43:49.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.929+0000 7f32a0f99640 1 -- 172.21.15.132:0/749724212 shutdown_connections 2023-12-20T04:43:49.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.929+0000 7f32a0f99640 1 --2- 172.21.15.132:0/749724212 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f327c06a430 0x7f327c06c8f0 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.929+0000 7f32a0f99640 1 --2- 172.21.15.132:0/749724212 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f329c15d4f0 0x7f329c155090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.929+0000 7f32a0f99640 1 --2- 172.21.15.132:0/749724212 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f329c15d110 0x7f329c0b1110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.929+0000 7f32a0f99640 1 --2- 172.21.15.132:0/749724212 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f329c0aeb00 0x7f329c0aef30 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:49.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.929+0000 7f32a0f99640 1 -- 172.21.15.132:0/749724212 >> 172.21.15.132:0/749724212 conn(0x7f329c0cfbd0 msgr2=0x7f329c0ca1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:49.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.929+0000 7f32a0f99640 1 -- 172.21.15.132:0/749724212 shutdown_connections 2023-12-20T04:43:49.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:49.929+0000 7f32a0f99640 1 -- 172.21.15.132:0/749724212 wait complete. 2023-12-20T04:43:49.942 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:43:49.942 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:43:49.942 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-12-20T04:43:49.942 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-20T04:43:49.942 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-20T04:43:49.942 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:43:49.942 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:43:49.942 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:43:49.943 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:43:49.943 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:49.943 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-12-20T04:43:49.958 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:43:49.958 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:43:49.958 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:43:49.958 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-20T04:43:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:49.959 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-12-20T04:43:49.959 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-12-20T04:43:49.959 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:49.959 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:43:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:49.959 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:43:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42644sec preferred_lft 42644sec 2023-12-20T04:43:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-12-20T04:43:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:49.960 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:43:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:43:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:49.960 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::60dd:37ff:fe28:558b/64 scope link 2023-12-20T04:43:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:49.961 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:43:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 86:13:fe:55:4c:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-20T04:43:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::8413:feff:fe55:4c04/64 scope link 2023-12-20T04:43:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:49.961 INFO:teuthology.orchestra.run.smithi132.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:43:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-20T04:43:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::839:72ff:fea7:b332/64 scope link 2023-12-20T04:43:49.961 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:49.961 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:49.962 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:43:50.025 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-20T04:43:50.026 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:50.026 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-12-20T04:43:50.082 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-12-20T04:43:50.082 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:43:50.082 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:43:50.082 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:43:50.082 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:43:50.083 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:50.083 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:43:50.083 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:43:50.083 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:43:50.083 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:43:50.083 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:43:50.083 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:43:50.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:50.178 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-20T04:43:50.193 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-20T04:43:50.193 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-20T04:43:50.193 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:43:50.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:50.193 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-12-20T04:43:50.261 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-20T04:43:50.261 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:43:50.261 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-20T04:43:50.315 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:43:50.315 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:43:50.315 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:43:50.370 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:43:50.440 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:43:50.440 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:43:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:43:50.507 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:43:50.507 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:50.507 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:43:50.562 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:43:50.563 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-20T04:43:50.605 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:43:50.632 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:43:50.632 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:43:50.691 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:2023-12-20T04:43:50.689+0000 7f6064640480 -1 init, newargv = 0x55ed0c464650 newargc=15 2023-12-20T04:43:50.691 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[94220]: starting ceph client 2023-12-20T04:43:50.694 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[94220]: starting fuse 2023-12-20T04:43:50.701 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:43:50.702 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:43:50.702 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:50.703 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:43:50.757 INFO:teuthology.orchestra.run.smithi132.stdout:41 2023-12-20T04:43:50.758 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:43:50.758 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:43:50.758 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:43:50.758 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:43:50.758 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:43:50.758 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:43:50.758 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:50.758 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:43:50.758 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:43:50.758 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:43:50.758 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:43:50.759 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:50.759 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:43:50.759 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:43:50.759 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:43:50.759 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:43:50.759 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:50.759 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:43:50.759 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:43:50.759 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:43:50.759 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:43:50.759 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:43:50.759 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:43:50.759 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:43:50.760 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:43:50.760 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:50.760 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:43:50.760 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:43:50.873 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.94220.asok 2023-12-20T04:43:51.060 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.94220.asok 2023-12-20T04:43:51.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:51.060 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.94220.asok status 2023-12-20T04:43:51.195 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:43:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:43:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:43:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:43:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:43:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:43:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:43:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "94220", 2023-12-20T04:43:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:43:51.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2023-12-20T04:43:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:43:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 5400, 2023-12-20T04:43:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:43:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:43:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:43:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 5400 2023-12-20T04:43:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:43:51.197 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:43:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:43:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 4127227377 2023-12-20T04:43:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:43:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:43:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:43:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 4127227377 2023-12-20T04:43:51.198 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.5400 192.168.0.1:0/4127227377", 2023-12-20T04:43:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/4127227377", 2023-12-20T04:43:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2023-12-20T04:43:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 13, 2023-12-20T04:43:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 33, 2023-12-20T04:43:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:43:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:43:51.199 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:43:51.199 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:43:51.204 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:51.204 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2023-12-20T04:43:51.204 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-20T04:43:51.220 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2023-12-20T04:43:51.220 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-20T04:43:51.220 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:51.220 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:43:51.288 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:43:51.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.426+0000 7fb082188640 1 Processor -- start 2023-12-20T04:43:51.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.426+0000 7fb082188640 1 -- start start 2023-12-20T04:43:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.427+0000 7fb082188640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb07c15ad70 0x7fb07c06f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.427+0000 7fb082188640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb07c06b130 0x7fb07c06b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.427+0000 7fb082188640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb07c0c9ab0 con 0x7fb07c0c92d0 2023-12-20T04:43:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.427+0000 7fb082188640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c15ea40 con 0x7fb07c15ad70 2023-12-20T04:43:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.427+0000 7fb082188640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb07c06bac0 con 0x7fb07c06b130 2023-12-20T04:43:51.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.427+0000 7fb07b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb07c15ad70 0x7fb07c06f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.427+0000 7fb07affd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb07c0c92d0 0x7fb07c15f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57724/0 (socket says 172.21.15.132:57724) 2023-12-20T04:43:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.427+0000 7fb07affd640 1 -- 172.21.15.132:0/564087072 learned_addr learned my addr 172.21.15.132:0/564087072 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.427+0000 7fb07bfff640 1 --2- 172.21.15.132:0/564087072 >> v2:172.21.15.187:3300/0 conn(0x7fb07c06b130 0x7fb07c06b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.427+0000 7fb07b7fe640 1 -- 172.21.15.132:0/564087072 >> v2:172.21.15.187:3300/0 conn(0x7fb07c06b130 msgr2=0x7fb07c06b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.427+0000 7fb07b7fe640 1 --2- 172.21.15.132:0/564087072 >> v2:172.21.15.187:3300/0 conn(0x7fb07c06b130 0x7fb07c06b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.427+0000 7fb07b7fe640 1 -- 172.21.15.132:0/564087072 >> v1:172.21.15.132:6789/0 conn(0x7fb07c0c92d0 legacy=0x7fb07c15f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.427+0000 7fb07b7fe640 1 -- 172.21.15.132:0/564087072 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb07c0c9d90 con 0x7fb07c15ad70 2023-12-20T04:43:51.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.427+0000 7fb07bfff640 1 --2- 172.21.15.132:0/564087072 >> v2:172.21.15.187:3300/0 conn(0x7fb07c06b130 0x7fb07c06b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.428+0000 7fb07b7fe640 1 --2- 172.21.15.132:0/564087072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb07c15ad70 0x7fb07c06f560 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb07c06c2f0 tx=0x7fb06c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2694984b327424 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.428+0000 7fb07a7fc640 1 -- 172.21.15.132:0/564087072 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c031830 con 0x7fb07c15ad70 2023-12-20T04:43:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.428+0000 7fb07a7fc640 1 -- 172.21.15.132:0/564087072 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb06c031990 con 0x7fb07c15ad70 2023-12-20T04:43:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.428+0000 7fb07a7fc640 1 -- 172.21.15.132:0/564087072 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb06c031d20 con 0x7fb07c15ad70 2023-12-20T04:43:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.429+0000 7fb082188640 1 -- 172.21.15.132:0/564087072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb07c15ad70 msgr2=0x7fb07c06f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.429+0000 7fb082188640 1 --2- 172.21.15.132:0/564087072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb07c15ad70 0x7fb07c06f560 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb07c06c2f0 tx=0x7fb06c02b8d0 comp rx=0 tx=0).stop 2023-12-20T04:43:51.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.429+0000 7fb082188640 1 -- 172.21.15.132:0/564087072 shutdown_connections 2023-12-20T04:43:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.429+0000 7fb082188640 1 --2- 172.21.15.132:0/564087072 >> v2:172.21.15.187:3300/0 conn(0x7fb07c06b130 0x7fb07c06b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.429+0000 7fb082188640 1 --2- 172.21.15.132:0/564087072 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb07c15ad70 0x7fb07c06f560 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.429+0000 7fb082188640 1 -- 172.21.15.132:0/564087072 >> 172.21.15.132:0/564087072 conn(0x7fb07c0ced10 msgr2=0x7fb07c0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.429+0000 7fb082188640 1 -- 172.21.15.132:0/564087072 shutdown_connections 2023-12-20T04:43:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.429+0000 7fb082188640 1 -- 172.21.15.132:0/564087072 wait complete. 2023-12-20T04:43:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.430+0000 7fb082188640 1 Processor -- start 2023-12-20T04:43:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.430+0000 7fb082188640 1 -- start start 2023-12-20T04:43:51.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.431+0000 7fb082188640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb07c06b130 0x7fb07c1f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:51.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.431+0000 7fb082188640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb07c0c92d0 0x7fb07c0b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:51.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.431+0000 7fb082188640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb07c15ad70 0x7fb07c0cda90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:51.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.431+0000 7fb082188640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c15da60 con 0x7fb07c0c92d0 2023-12-20T04:43:51.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.431+0000 7fb082188640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c1f30f0 con 0x7fb07c15ad70 2023-12-20T04:43:51.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.431+0000 7fb082188640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb07c0cc9f0 con 0x7fb07c06b130 2023-12-20T04:43:51.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.431+0000 7fb07affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb07c0c92d0 0x7fb07c0b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:51.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.431+0000 7fb07affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb07c0c92d0 0x7fb07c0b0dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35274/0 (socket says 172.21.15.132:35274) 2023-12-20T04:43:51.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.431+0000 7fb07affd640 1 -- 172.21.15.132:0/3965684396 learned_addr learned my addr 172.21.15.132:0/3965684396 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:51.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.431+0000 7fb07affd640 1 -- 172.21.15.132:0/3965684396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb07c06b130 msgr2=0x7fb07c1f2bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:51.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.431+0000 7fb07affd640 1 --2- 172.21.15.132:0/3965684396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb07c06b130 0x7fb07c1f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:51.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.431+0000 7fb07affd640 1 -- 172.21.15.132:0/3965684396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb07c15ad70 msgr2=0x7fb07c0cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:51.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.431+0000 7fb07affd640 1 --2- 172.21.15.132:0/3965684396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb07c15ad70 0x7fb07c0cda90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:51.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.431+0000 7fb07affd640 1 -- 172.21.15.132:0/3965684396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb06c009400 con 0x7fb07c0c92d0 2023-12-20T04:43:51.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.431+0000 7fb07affd640 1 --2- 172.21.15.132:0/3965684396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb07c0c92d0 0x7fb07c0b0dc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb07000c4a0 tx=0x7fb07000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:51.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.431+0000 7fb063fff640 1 -- 172.21.15.132:0/3965684396 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070005ce0 con 0x7fb07c0c92d0 2023-12-20T04:43:51.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.432+0000 7fb063fff640 1 -- 172.21.15.132:0/3965684396 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb070005e40 con 0x7fb07c0c92d0 2023-12-20T04:43:51.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.432+0000 7fb082188640 1 -- 172.21.15.132:0/3965684396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb07c0cccd0 con 0x7fb07c0c92d0 2023-12-20T04:43:51.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.432+0000 7fb063fff640 1 -- 172.21.15.132:0/3965684396 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb070007270 con 0x7fb07c0c92d0 2023-12-20T04:43:51.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.432+0000 7fb082188640 1 -- 172.21.15.132:0/3965684396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb07c0cd290 con 0x7fb07c0c92d0 2023-12-20T04:43:51.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.432+0000 7fb082188640 1 -- 172.21.15.132:0/3965684396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb07c04e840 con 0x7fb07c0c92d0 2023-12-20T04:43:51.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.433+0000 7fb063fff640 1 -- 172.21.15.132:0/3965684396 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb0700073d0 con 0x7fb07c0c92d0 2023-12-20T04:43:51.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.433+0000 7fb063fff640 1 --2- 172.21.15.132:0/3965684396 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb06806a430 0x7fb06806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:51.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.433+0000 7fb063fff640 1 -- 172.21.15.132:0/3965684396 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb070087d70 con 0x7fb07c0c92d0 2023-12-20T04:43:51.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.433+0000 7fb07b7fe640 1 --2- 172.21.15.132:0/3965684396 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb06806a430 0x7fb06806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:51.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.434+0000 7fb07b7fe640 1 --2- 172.21.15.132:0/3965684396 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb06806a430 0x7fb06806c8f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb06c036000 tx=0x7fb06c030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:51.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.438+0000 7fb063fff640 1 -- 172.21.15.132:0/3965684396 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb070053410 con 0x7fb07c0c92d0 2023-12-20T04:43:51.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.639+0000 7fb082188640 1 -- 172.21.15.132:0/3965684396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb07c06c5e0 con 0x7fb07c0c92d0 2023-12-20T04:43:51.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.640+0000 7fb063fff640 1 -- 172.21.15.132:0/3965684396 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v13) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb070017070 con 0x7fb07c0c92d0 2023-12-20T04:43:51.641 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:43:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.641+0000 7fb082188640 1 -- 172.21.15.132:0/3965684396 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb06806a430 msgr2=0x7fb06806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.641+0000 7fb082188640 1 --2- 172.21.15.132:0/3965684396 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb06806a430 0x7fb06806c8f0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb06c036000 tx=0x7fb06c030000 comp rx=0 tx=0).stop 2023-12-20T04:43:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.641+0000 7fb082188640 1 -- 172.21.15.132:0/3965684396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb07c0c92d0 msgr2=0x7fb07c0b0dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.641+0000 7fb082188640 1 --2- 172.21.15.132:0/3965684396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb07c0c92d0 0x7fb07c0b0dc0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb07000c4a0 tx=0x7fb07000c960 comp rx=0 tx=0).stop 2023-12-20T04:43:51.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.641+0000 7fb082188640 1 -- 172.21.15.132:0/3965684396 shutdown_connections 2023-12-20T04:43:51.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.641+0000 7fb082188640 1 --2- 172.21.15.132:0/3965684396 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb06806a430 0x7fb06806c8f0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:51.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.641+0000 7fb082188640 1 --2- 172.21.15.132:0/3965684396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb07c15ad70 0x7fb07c0cda90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:51.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.641+0000 7fb082188640 1 --2- 172.21.15.132:0/3965684396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb07c0c92d0 0x7fb07c0b0dc0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:51.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.641+0000 7fb082188640 1 --2- 172.21.15.132:0/3965684396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb07c06b130 0x7fb07c1f2bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:51.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.642+0000 7fb082188640 1 -- 172.21.15.132:0/3965684396 >> 172.21.15.132:0/3965684396 conn(0x7fb07c0ced10 msgr2=0x7fb07c0ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:51.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.642+0000 7fb082188640 1 -- 172.21.15.132:0/3965684396 shutdown_connections 2023-12-20T04:43:51.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:51.642+0000 7fb082188640 1 -- 172.21.15.132:0/3965684396 wait complete. 2023-12-20T04:43:51.655 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:43:51.655 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:43:51.655 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-12-20T04:43:51.655 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-20T04:43:51.655 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-20T04:43:51.656 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:43:51.656 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:43:51.656 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:43:51.656 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:43:51.656 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:51.656 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-12-20T04:43:51.676 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:43:51.676 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:43:51.677 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:43:51.677 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:51.677 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-20T04:43:51.677 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:51.677 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:51.677 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:51.677 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-12-20T04:43:51.677 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:51.677 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:51.677 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-12-20T04:43:51.677 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:43:51.677 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:51.678 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:43:51.678 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:51.678 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:43:51.678 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42654sec preferred_lft 42654sec 2023-12-20T04:43:51.678 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-12-20T04:43:51.678 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:51.678 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:43:51.678 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:43:51.678 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:43:51.678 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:51.678 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::a8bc:1cff:fe40:54ea/64 scope link 2023-12-20T04:43:51.679 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:51.679 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:43:51.679 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-20T04:43:51.679 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c8e:c0ff:fe7a:bdc/64 scope link 2023-12-20T04:43:51.679 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:51.679 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:43:51.679 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether be:98:9a:6f:62:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-20T04:43:51.679 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::bc98:9aff:fe6f:6282/64 scope link 2023-12-20T04:43:51.679 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:43:51.679 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:51.680 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:43:51.746 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-12-20T04:43:51.748 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:51.748 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-12-20T04:43:51.806 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-12-20T04:43:51.806 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:43:51.806 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:43:51.806 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:43:51.806 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:43:51.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:51.806 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:43:51.806 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:43:51.806 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:43:51.807 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:43:51.807 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:43:51.807 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:43:51.908 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:51.908 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-20T04:43:51.924 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-20T04:43:51.924 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-20T04:43:51.924 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:43:51.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:51.925 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2023-12-20T04:43:51.993 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-20T04:43:51.993 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:43:51.993 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-20T04:43:52.048 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:43:52.049 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:43:52.049 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:43:52.104 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:43:52.172 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:43:52.172 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:43:52.239 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:43:52.240 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:43:52.240 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:52.240 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:43:52.295 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:43:52.295 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-20T04:43:52.338 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:43:52.364 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:43:52.364 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:43:52.423 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:2023-12-20T04:43:52.422+0000 7f25c1242480 -1 init, newargv = 0x5598f692d870 newargc=15 2023-12-20T04:43:52.424 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[86590]: starting ceph client 2023-12-20T04:43:52.428 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[86590]: starting fuse 2023-12-20T04:43:52.434 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:43:52.435 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:43:52.435 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:52.435 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:43:52.490 INFO:teuthology.orchestra.run.smithi187.stdout:41 2023-12-20T04:43:52.490 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:43:52.491 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:43:52.491 DEBUG:teuthology.orchestra.run.smithi187:> import glob 2023-12-20T04:43:52.491 DEBUG:teuthology.orchestra.run.smithi187:> import re 2023-12-20T04:43:52.491 DEBUG:teuthology.orchestra.run.smithi187:> import os 2023-12-20T04:43:52.491 DEBUG:teuthology.orchestra.run.smithi187:> import subprocess 2023-12-20T04:43:52.491 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:43:52.491 DEBUG:teuthology.orchestra.run.smithi187:> def _find_admin_socket(client_name): 2023-12-20T04:43:52.491 DEBUG:teuthology.orchestra.run.smithi187:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-20T04:43:52.491 DEBUG:teuthology.orchestra.run.smithi187:> files = glob.glob(asok_path) 2023-12-20T04:43:52.491 DEBUG:teuthology.orchestra.run.smithi187:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-20T04:43:52.491 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:43:52.491 DEBUG:teuthology.orchestra.run.smithi187:> # Given a non-glob path, it better be there 2023-12-20T04:43:52.491 DEBUG:teuthology.orchestra.run.smithi187:> if "*" not in asok_path: 2023-12-20T04:43:52.491 DEBUG:teuthology.orchestra.run.smithi187:> assert(len(files) == 1) 2023-12-20T04:43:52.492 DEBUG:teuthology.orchestra.run.smithi187:> return files[0] 2023-12-20T04:43:52.492 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:43:52.492 DEBUG:teuthology.orchestra.run.smithi187:> for f in files: 2023-12-20T04:43:52.492 DEBUG:teuthology.orchestra.run.smithi187:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:43:52.492 DEBUG:teuthology.orchestra.run.smithi187:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:43:52.492 DEBUG:teuthology.orchestra.run.smithi187:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:43:52.492 DEBUG:teuthology.orchestra.run.smithi187:> contents = proc_f.read() 2023-12-20T04:43:52.492 DEBUG:teuthology.orchestra.run.smithi187:> if mountpoint in contents: 2023-12-20T04:43:52.492 DEBUG:teuthology.orchestra.run.smithi187:> return f 2023-12-20T04:43:52.492 DEBUG:teuthology.orchestra.run.smithi187:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:43:52.492 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:43:52.492 DEBUG:teuthology.orchestra.run.smithi187:> print(_find_admin_socket("client.1")) 2023-12-20T04:43:52.492 DEBUG:teuthology.orchestra.run.smithi187:> ' 2023-12-20T04:43:52.606 INFO:teuthology.orchestra.run.smithi187.stdout:/var/run/ceph/ceph-client.1.86590.asok 2023-12-20T04:43:52.793 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.86590.asok 2023-12-20T04:43:52.793 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:52.793 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.86590.asok status 2023-12-20T04:43:52.929 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-12-20T04:43:52.929 INFO:teuthology.orchestra.run.smithi187.stdout: "metadata": { 2023-12-20T04:43:52.929 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:43:52.929 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:43:52.929 INFO:teuthology.orchestra.run.smithi187.stdout: "entity_id": "1", 2023-12-20T04:43:52.929 INFO:teuthology.orchestra.run.smithi187.stdout: "hostname": "smithi187", 2023-12-20T04:43:52.929 INFO:teuthology.orchestra.run.smithi187.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-20T04:43:52.929 INFO:teuthology.orchestra.run.smithi187.stdout: "pid": "86590", 2023-12-20T04:43:52.929 INFO:teuthology.orchestra.run.smithi187.stdout: "root": "/" 2023-12-20T04:43:52.929 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:43:52.929 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_count": 0, 2023-12-20T04:43:52.930 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_pinned_count": 0, 2023-12-20T04:43:52.930 INFO:teuthology.orchestra.run.smithi187.stdout: "id": 4922, 2023-12-20T04:43:52.930 INFO:teuthology.orchestra.run.smithi187.stdout: "inst": { 2023-12-20T04:43:52.930 INFO:teuthology.orchestra.run.smithi187.stdout: "name": { 2023-12-20T04:43:52.930 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "client", 2023-12-20T04:43:52.930 INFO:teuthology.orchestra.run.smithi187.stdout: "num": 4922 2023-12-20T04:43:52.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:43:52.930 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:43:52.930 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:43:52.930 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:43:52.930 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 724674106 2023-12-20T04:43:52.930 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-12-20T04:43:52.930 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:43:52.930 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:43:52.930 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:43:52.931 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:43:52.931 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 724674106 2023-12-20T04:43:52.931 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:43:52.931 INFO:teuthology.orchestra.run.smithi187.stdout: "inst_str": "client.4922 192.168.0.1:0/724674106", 2023-12-20T04:43:52.931 INFO:teuthology.orchestra.run.smithi187.stdout: "addr_str": "192.168.0.1:0/724674106", 2023-12-20T04:43:52.931 INFO:teuthology.orchestra.run.smithi187.stdout: "inode_count": 1, 2023-12-20T04:43:52.931 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_epoch": 13, 2023-12-20T04:43:52.931 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch": 33, 2023-12-20T04:43:52.931 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:43:52.931 INFO:teuthology.orchestra.run.smithi187.stdout: "blocklisted": false, 2023-12-20T04:43:52.931 INFO:teuthology.orchestra.run.smithi187.stdout: "fs_name": "cephfs" 2023-12-20T04:43:52.931 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-12-20T04:43:52.937 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:52.937 DEBUG:teuthology.orchestra.run.smithi187:> stat --file-system '--printf=%T 2023-12-20T04:43:52.937 DEBUG:teuthology.orchestra.run.smithi187:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-20T04:43:52.953 INFO:teuthology.orchestra.run.smithi187.stdout:fuseblk 2023-12-20T04:43:52.953 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-20T04:43:52.953 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:52.953 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:43:53.021 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:43:53.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.130+0000 7f3e71150640 1 Processor -- start 2023-12-20T04:43:53.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.130+0000 7f3e71150640 1 -- start start 2023-12-20T04:43:53.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.131+0000 7f3e71150640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3e6c15b7d0 0x7f3e6c15bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:53.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.131+0000 7f3e71150640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e6c06f750 con 0x7f3e6c06f0e0 2023-12-20T04:43:53.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.131+0000 7f3e71150640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e6c06fa30 con 0x7f3e6c0d08c0 2023-12-20T04:43:53.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.131+0000 7f3e71150640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e6c15f060 con 0x7f3e6c15b7d0 2023-12-20T04:43:53.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.131+0000 7f3e6a59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3e6c06f0e0 0x7f3e6c15f480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57730/0 (socket says 172.21.15.132:57730) 2023-12-20T04:43:53.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.131+0000 7f3e6a59c640 1 -- 172.21.15.132:0/2550765356 learned_addr learned my addr 172.21.15.132:0/2550765356 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:53.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.131+0000 7f3e69d9b640 1 -- 172.21.15.132:0/2550765356 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 577938718 0 0) 0x7f3e6c06f750 con 0x7f3e6c06f0e0 2023-12-20T04:43:53.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e6b59e640 1 --2- 172.21.15.132:0/2550765356 >> v2:172.21.15.187:3300/0 conn(0x7f3e6c15b7d0 0x7f3e6c15bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:53.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e69d9b640 1 -- 172.21.15.132:0/2550765356 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e54003520 con 0x7f3e6c06f0e0 2023-12-20T04:43:53.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e69d9b640 1 -- 172.21.15.132:0/2550765356 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3175357822 0 0) 0x7f3e54003520 con 0x7f3e6c06f0e0 2023-12-20T04:43:53.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e69d9b640 1 -- 172.21.15.132:0/2550765356 >> v2:172.21.15.187:3300/0 conn(0x7f3e6c15b7d0 msgr2=0x7f3e6c15bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:53.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e69d9b640 1 --2- 172.21.15.132:0/2550765356 >> v2:172.21.15.187:3300/0 conn(0x7f3e6c15b7d0 0x7f3e6c15bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e69d9b640 1 -- 172.21.15.132:0/2550765356 >> v1:172.21.15.187:6789/0 conn(0x7f3e6c0d08c0 legacy=0x7f3e6c0cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:53.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e69d9b640 1 -- 172.21.15.132:0/2550765356 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c06fd10 con 0x7f3e6c06f0e0 2023-12-20T04:43:53.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e69d9b640 1 -- 172.21.15.132:0/2550765356 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f3e60001670 con 0x7f3e6c06f0e0 2023-12-20T04:43:53.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e69d9b640 1 -- 172.21.15.132:0/2550765356 >> v1:172.21.15.132:6789/0 conn(0x7f3e6c06f0e0 legacy=0x7f3e6c15f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:53.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e69d9b640 1 --2- 172.21.15.132:0/2550765356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e54003970 0x7f3e54003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:53.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e69d9b640 1 --2- 172.21.15.132:0/2550765356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e540047c0 0x7f3e54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:53.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e69d9b640 1 --2- 172.21.15.132:0/2550765356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e540052a0 0x7f3e5400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:53.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e69d9b640 1 -- 172.21.15.132:0/2550765356 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c15f060 con 0x7f3e54003970 2023-12-20T04:43:53.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e69d9b640 1 -- 172.21.15.132:0/2550765356 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5400c170 con 0x7f3e540052a0 2023-12-20T04:43:53.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e69d9b640 1 -- 172.21.15.132:0/2550765356 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e5400c330 con 0x7f3e540047c0 2023-12-20T04:43:53.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e6ad9d640 1 --2- 172.21.15.132:0/2550765356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e54003970 0x7f3e54003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:53.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e6a59c640 1 --2- 172.21.15.132:0/2550765356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e540047c0 0x7f3e54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:53.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e6b59e640 1 --2- 172.21.15.132:0/2550765356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e540052a0 0x7f3e5400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:53.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e6ad9d640 1 -- 172.21.15.132:0/2550765356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e540047c0 msgr2=0x7f3e54004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:53.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e6ad9d640 1 --2- 172.21.15.132:0/2550765356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e540047c0 0x7f3e54004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e6ad9d640 1 -- 172.21.15.132:0/2550765356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e540052a0 msgr2=0x7f3e5400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:53.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e6ad9d640 1 --2- 172.21.15.132:0/2550765356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e540052a0 0x7f3e5400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e6b59e640 1 -- 172.21.15.132:0/2550765356 reap_dead start 2023-12-20T04:43:53.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.132+0000 7f3e6ad9d640 1 -- 172.21.15.132:0/2550765356 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e54003520 con 0x7f3e54003970 2023-12-20T04:43:53.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.133+0000 7f3e6ad9d640 1 --2- 172.21.15.132:0/2550765356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e54003970 0x7f3e54003d90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c001e20 tx=0x7f3e540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ccabc5370fb8699 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:53.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.133+0000 7f3e69d9b640 1 -- 172.21.15.132:0/2550765356 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c003b70 con 0x7f3e54003970 2023-12-20T04:43:53.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.133+0000 7f3e69d9b640 1 -- 172.21.15.132:0/2550765356 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c003cd0 con 0x7f3e54003970 2023-12-20T04:43:53.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.133+0000 7f3e69d9b640 1 -- 172.21.15.132:0/2550765356 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c005310 con 0x7f3e54003970 2023-12-20T04:43:53.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.134+0000 7f3e71150640 1 -- 172.21.15.132:0/2550765356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e54003970 msgr2=0x7f3e54003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:53.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.134+0000 7f3e71150640 1 --2- 172.21.15.132:0/2550765356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e54003970 0x7f3e54003d90 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c001e20 tx=0x7f3e540057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.134+0000 7f3e71150640 1 -- 172.21.15.132:0/2550765356 shutdown_connections 2023-12-20T04:43:53.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.134+0000 7f3e71150640 1 --2- 172.21.15.132:0/2550765356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e54003970 0x7f3e54003d90 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.134+0000 7f3e71150640 1 -- 172.21.15.132:0/2550765356 >> 172.21.15.132:0/2550765356 conn(0x7f3e6c0cd7b0 msgr2=0x7f3e6c0cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:53.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.134+0000 7f3e71150640 1 -- 172.21.15.132:0/2550765356 shutdown_connections 2023-12-20T04:43:53.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.134+0000 7f3e71150640 1 -- 172.21.15.132:0/2550765356 wait complete. 2023-12-20T04:43:53.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.135+0000 7f3e71150640 1 Processor -- start 2023-12-20T04:43:53.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.135+0000 7f3e71150640 1 -- start start 2023-12-20T04:43:53.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.136+0000 7f3e71150640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e54003970 0x7f3e6c0cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:53.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.136+0000 7f3e71150640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e6c0b58c0 0x7f3e6c0c4ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:53.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.136+0000 7f3e71150640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e6c0c5420 0x7f3e6c1f2250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:53.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.136+0000 7f3e71150640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c0b4b40 con 0x7f3e54003970 2023-12-20T04:43:53.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.136+0000 7f3e71150640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c0c5930 con 0x7f3e6c0c5420 2023-12-20T04:43:53.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.136+0000 7f3e71150640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e6c0b4de0 con 0x7f3e6c0b58c0 2023-12-20T04:43:53.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.136+0000 7f3e6ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e54003970 0x7f3e6c0cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:53.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.136+0000 7f3e6ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e54003970 0x7f3e6c0cb7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35298/0 (socket says 172.21.15.132:35298) 2023-12-20T04:43:53.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.136+0000 7f3e6ad9d640 1 -- 172.21.15.132:0/184327384 learned_addr learned my addr 172.21.15.132:0/184327384 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:53.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.137+0000 7f3e6b59e640 1 --2- 172.21.15.132:0/184327384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e6c0c5420 0x7f3e6c1f2250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:53.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.137+0000 7f3e6ad9d640 1 -- 172.21.15.132:0/184327384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e6c0b58c0 msgr2=0x7f3e6c0c4ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:53.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.137+0000 7f3e6ad9d640 1 --2- 172.21.15.132:0/184327384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e6c0b58c0 0x7f3e6c0c4ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.137+0000 7f3e6ad9d640 1 -- 172.21.15.132:0/184327384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e6c0c5420 msgr2=0x7f3e6c1f2250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:53.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.137+0000 7f3e6ad9d640 1 --2- 172.21.15.132:0/184327384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e6c0c5420 0x7f3e6c1f2250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.137+0000 7f3e6ad9d640 1 -- 172.21.15.132:0/184327384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e6c0b50c0 con 0x7f3e54003970 2023-12-20T04:43:53.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.137+0000 7f3e6ad9d640 1 --2- 172.21.15.132:0/184327384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e54003970 0x7f3e6c0cb7c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c02bf50 tx=0x7f3e5c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:53.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.137+0000 7f3e537fe640 1 -- 172.21.15.132:0/184327384 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c03e070 con 0x7f3e54003970 2023-12-20T04:43:53.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.137+0000 7f3e537fe640 1 -- 172.21.15.132:0/184327384 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e5c003e40 con 0x7f3e54003970 2023-12-20T04:43:53.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.137+0000 7f3e537fe640 1 -- 172.21.15.132:0/184327384 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e5c02f830 con 0x7f3e54003970 2023-12-20T04:43:53.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.137+0000 7f3e71150640 1 -- 172.21.15.132:0/184327384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e6c0b53a0 con 0x7f3e54003970 2023-12-20T04:43:53.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.137+0000 7f3e71150640 1 -- 172.21.15.132:0/184327384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e6c0cbd00 con 0x7f3e54003970 2023-12-20T04:43:53.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.138+0000 7f3e71150640 1 -- 172.21.15.132:0/184327384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e6c0b4f20 con 0x7f3e54003970 2023-12-20T04:43:53.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.138+0000 7f3e537fe640 1 -- 172.21.15.132:0/184327384 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3e5c02f990 con 0x7f3e54003970 2023-12-20T04:43:53.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.139+0000 7f3e537fe640 1 --2- 172.21.15.132:0/184327384 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e5806a460 0x7f3e5806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:53.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.139+0000 7f3e537fe640 1 -- 172.21.15.132:0/184327384 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3e5c0a9e30 con 0x7f3e54003970 2023-12-20T04:43:53.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.139+0000 7f3e6a59c640 1 --2- 172.21.15.132:0/184327384 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e5806a460 0x7f3e5806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:53.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.139+0000 7f3e6a59c640 1 --2- 172.21.15.132:0/184327384 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e5806a460 0x7f3e5806c920 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3e60001c90 tx=0x7f3e60001bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:53.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.143+0000 7f3e537fe640 1 -- 172.21.15.132:0/184327384 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3e6c0b4f20 con 0x7f3e54003970 2023-12-20T04:43:53.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.344+0000 7f3e71150640 1 -- 172.21.15.132:0/184327384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f3e6c0b4f20 con 0x7f3e54003970 2023-12-20T04:43:53.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.345+0000 7f3e537fe640 1 -- 172.21.15.132:0/184327384 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f3e6c0b4f20 con 0x7f3e54003970 2023-12-20T04:43:53.347 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:53.347 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/703933798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":703933798},{"type":"v1","addr":"172.21.15.187:6835","nonce":703933798}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3137083608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3137083608},{"type":"v1","addr":"172.21.15.187:6833","nonce":3137083608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1340012349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1340012349},{"type":"v1","addr":"172.21.15.132:6836","nonce":1340012349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:43:44.388671+0000","modified":"2023-12-20T04:43:47.069930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/359299732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":359299732},{"type":"v1","addr":"172.21.15.132:6837","nonce":359299732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-20T04:43:53.347 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 13 2023-12-20T04:43:53.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.347+0000 7f3e71150640 1 -- 172.21.15.132:0/184327384 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e5806a460 msgr2=0x7f3e5806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:53.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.347+0000 7f3e71150640 1 --2- 172.21.15.132:0/184327384 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e5806a460 0x7f3e5806c920 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3e60001c90 tx=0x7f3e60001bc0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.347+0000 7f3e71150640 1 -- 172.21.15.132:0/184327384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e54003970 msgr2=0x7f3e6c0cb7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:53.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.347+0000 7f3e71150640 1 --2- 172.21.15.132:0/184327384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e54003970 0x7f3e6c0cb7c0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7f3e5c02bf50 tx=0x7f3e5c0014a0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.347+0000 7f3e71150640 1 -- 172.21.15.132:0/184327384 shutdown_connections 2023-12-20T04:43:53.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.347+0000 7f3e71150640 1 --2- 172.21.15.132:0/184327384 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e5806a460 0x7f3e5806c920 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.347+0000 7f3e71150640 1 --2- 172.21.15.132:0/184327384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e6c0c5420 0x7f3e6c1f2250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.347+0000 7f3e71150640 1 --2- 172.21.15.132:0/184327384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e6c0b58c0 0x7f3e6c0c4ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.347+0000 7f3e71150640 1 --2- 172.21.15.132:0/184327384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e54003970 0x7f3e6c0cb7c0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.347+0000 7f3e71150640 1 -- 172.21.15.132:0/184327384 >> 172.21.15.132:0/184327384 conn(0x7f3e6c0cd7b0 msgr2=0x7f3e6c15cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:53.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.347+0000 7f3e71150640 1 -- 172.21.15.132:0/184327384 shutdown_connections 2023-12-20T04:43:53.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.347+0000 7f3e71150640 1 -- 172.21.15.132:0/184327384 wait complete. 2023-12-20T04:43:53.360 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-20T04:43:53.475 INFO:teuthology.orchestra.run.smithi132.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":5199,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.0738128440000008,"mdsmap_epoch":13,"osdmap_epoch":33,"osdmap_epoch_barrier":33,"uptime":15.290584388999999} 2023-12-20T04:43:53.475 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 5199, "mdsmap_epoch": 13, "osdmap_epoch": 33, "osdmap_epoch_barrier": 33, "rank_uptime": 9.073812844, "state": "up:active", "uptime": 15.290584389, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:43:53.476 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph df --format=json-pretty 2023-12-20T04:43:53.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.573+0000 7f5dd9fce640 1 Processor -- start 2023-12-20T04:43:53.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.573+0000 7f5dd9fce640 1 -- start start 2023-12-20T04:43:53.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd9fce640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5dd40b4f90 0x7f5dd40b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:53.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd9fce640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd40cd660 con 0x7f5dd40b1d10 2023-12-20T04:43:53.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd9fce640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5dd40cd940 con 0x7f5dd415d110 2023-12-20T04:43:53.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd9fce640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5dd4160e60 con 0x7f5dd40b4f90 2023-12-20T04:43:53.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd3fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5dd40b1d10 0x7f5dd40d0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57742/0 (socket says 172.21.15.132:57742) 2023-12-20T04:43:53.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd3fff640 1 -- 172.21.15.132:0/248692893 learned_addr learned my addr 172.21.15.132:0/248692893 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:53.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd2ffd640 1 --2- 172.21.15.132:0/248692893 >> v2:172.21.15.187:3300/0 conn(0x7f5dd40b4f90 0x7f5dd40b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:53.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd27fc640 1 -- 172.21.15.132:0/248692893 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3726918240 0 0) 0x7f5dd40cd660 con 0x7f5dd40b1d10 2023-12-20T04:43:53.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd27fc640 1 -- 172.21.15.132:0/248692893 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dbc003520 con 0x7f5dd40b1d10 2023-12-20T04:43:53.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd27fc640 1 -- 172.21.15.132:0/248692893 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2241773120 0 0) 0x7f5dbc003520 con 0x7f5dd40b1d10 2023-12-20T04:43:53.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd27fc640 1 -- 172.21.15.132:0/248692893 >> v2:172.21.15.187:3300/0 conn(0x7f5dd40b4f90 msgr2=0x7f5dd40b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:53.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd27fc640 1 --2- 172.21.15.132:0/248692893 >> v2:172.21.15.187:3300/0 conn(0x7f5dd40b4f90 0x7f5dd40b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd27fc640 1 -- 172.21.15.132:0/248692893 >> v1:172.21.15.187:6789/0 conn(0x7f5dd415d110 legacy=0x7f5dd40b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:53.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd27fc640 1 -- 172.21.15.132:0/248692893 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd4161140 con 0x7f5dd40b1d10 2023-12-20T04:43:53.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd27fc640 1 -- 172.21.15.132:0/248692893 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f5dcc0019f0 con 0x7f5dd40b1d10 2023-12-20T04:43:53.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd27fc640 1 -- 172.21.15.132:0/248692893 >> v1:172.21.15.132:6789/0 conn(0x7f5dd40b1d10 legacy=0x7f5dd40d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:53.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd27fc640 1 --2- 172.21.15.132:0/248692893 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dbc003970 0x7f5dbc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:53.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd27fc640 1 --2- 172.21.15.132:0/248692893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dbc0047c0 0x7f5dbc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:53.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd27fc640 1 --2- 172.21.15.132:0/248692893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dbc005180 0x7f5dbc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:53.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd27fc640 1 -- 172.21.15.132:0/248692893 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd4160e60 con 0x7f5dbc005180 2023-12-20T04:43:53.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd27fc640 1 -- 172.21.15.132:0/248692893 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc00c020 con 0x7f5dbc003970 2023-12-20T04:43:53.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.574+0000 7f5dd27fc640 1 -- 172.21.15.132:0/248692893 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dbc00c1e0 con 0x7f5dbc0047c0 2023-12-20T04:43:53.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.575+0000 7f5dd3fff640 1 --2- 172.21.15.132:0/248692893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dbc005180 0x7f5dbc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:53.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.575+0000 7f5dd37fe640 1 --2- 172.21.15.132:0/248692893 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dbc003970 0x7f5dbc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:53.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.575+0000 7f5dd2ffd640 1 --2- 172.21.15.132:0/248692893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dbc0047c0 0x7f5dbc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:53.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.575+0000 7f5dd3fff640 1 -- 172.21.15.132:0/248692893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dbc0047c0 msgr2=0x7f5dbc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:53.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.575+0000 7f5dd3fff640 1 --2- 172.21.15.132:0/248692893 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dbc0047c0 0x7f5dbc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.575+0000 7f5dd3fff640 1 -- 172.21.15.132:0/248692893 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dbc003970 msgr2=0x7f5dbc003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:53.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.575+0000 7f5dd3fff640 1 --2- 172.21.15.132:0/248692893 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dbc003970 0x7f5dbc003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.575+0000 7f5dd3fff640 1 -- 172.21.15.132:0/248692893 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dbc003520 con 0x7f5dbc005180 2023-12-20T04:43:53.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.575+0000 7f5dd3fff640 1 -- 172.21.15.132:0/248692893 reap_dead start 2023-12-20T04:43:53.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.576+0000 7f5dd3fff640 1 --2- 172.21.15.132:0/248692893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dbc005180 0x7f5dbc00b980 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00a830 tx=0x7f5dbc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=705a8f45517fb615 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:53.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.576+0000 7f5dd27fc640 1 -- 172.21.15.132:0/248692893 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc0072d0 con 0x7f5dbc005180 2023-12-20T04:43:53.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.576+0000 7f5dd27fc640 1 -- 172.21.15.132:0/248692893 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dcc02f070 con 0x7f5dbc005180 2023-12-20T04:43:53.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.576+0000 7f5dd27fc640 1 -- 172.21.15.132:0/248692893 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dcc0076b0 con 0x7f5dbc005180 2023-12-20T04:43:53.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.576+0000 7f5dd9fce640 1 -- 172.21.15.132:0/248692893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dbc005180 msgr2=0x7f5dbc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:53.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.576+0000 7f5dd9fce640 1 --2- 172.21.15.132:0/248692893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dbc005180 0x7f5dbc00b980 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f5dcc00a830 tx=0x7f5dbc0057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.576+0000 7f5dd9fce640 1 -- 172.21.15.132:0/248692893 shutdown_connections 2023-12-20T04:43:53.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.576+0000 7f5dd9fce640 1 --2- 172.21.15.132:0/248692893 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dbc005180 0x7f5dbc00b980 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.576+0000 7f5dd9fce640 1 -- 172.21.15.132:0/248692893 >> 172.21.15.132:0/248692893 conn(0x7f5dd40cf880 msgr2=0x7f5dd40cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:53.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.576+0000 7f5dd9fce640 1 -- 172.21.15.132:0/248692893 shutdown_connections 2023-12-20T04:43:53.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.576+0000 7f5dd9fce640 1 -- 172.21.15.132:0/248692893 wait complete. 2023-12-20T04:43:53.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.577+0000 7f5dd9fce640 1 Processor -- start 2023-12-20T04:43:53.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.578+0000 7f5dd9fce640 1 -- start start 2023-12-20T04:43:53.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.578+0000 7f5dd9fce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dbc005180 0x7f5dd40b2460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:53.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.578+0000 7f5dd9fce640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dd4154ba0 0x7f5dd415e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:53.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.578+0000 7f5dd9fce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dd415e550 0x7f5dd41f1cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:53.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.578+0000 7f5dd9fce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd415ea00 con 0x7f5dbc005180 2023-12-20T04:43:53.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.578+0000 7f5dd9fce640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd40b2db0 con 0x7f5dd4154ba0 2023-12-20T04:43:53.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.578+0000 7f5dd9fce640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd40b3090 con 0x7f5dd415e550 2023-12-20T04:43:53.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.578+0000 7f5dd37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dbc005180 0x7f5dd40b2460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:53.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.578+0000 7f5dd37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dbc005180 0x7f5dd40b2460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35324/0 (socket says 172.21.15.132:35324) 2023-12-20T04:43:53.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.578+0000 7f5dd37fe640 1 -- 172.21.15.132:0/3838142986 learned_addr learned my addr 172.21.15.132:0/3838142986 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:53.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.578+0000 7f5dd2ffd640 1 --2- 172.21.15.132:0/3838142986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dd4154ba0 0x7f5dd415e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:53.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.579+0000 7f5dd3fff640 1 --2- 172.21.15.132:0/3838142986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dd415e550 0x7f5dd41f1cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:53.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.579+0000 7f5dd37fe640 1 -- 172.21.15.132:0/3838142986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dd415e550 msgr2=0x7f5dd41f1cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:53.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.579+0000 7f5dd37fe640 1 --2- 172.21.15.132:0/3838142986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dd415e550 0x7f5dd41f1cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.579+0000 7f5dd37fe640 1 -- 172.21.15.132:0/3838142986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dd4154ba0 msgr2=0x7f5dd415e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:53.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.579+0000 7f5dd37fe640 1 --2- 172.21.15.132:0/3838142986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dd4154ba0 0x7f5dd415e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.579+0000 7f5dd37fe640 1 -- 172.21.15.132:0/3838142986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd40b3370 con 0x7f5dbc005180 2023-12-20T04:43:53.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.579+0000 7f5dd37fe640 1 --2- 172.21.15.132:0/3838142986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dbc005180 0x7f5dd40b2460 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400f5f0 tx=0x7f5dc400f9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:53.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.579+0000 7f5dbbfff640 1 -- 172.21.15.132:0/3838142986 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc40052e0 con 0x7f5dbc005180 2023-12-20T04:43:53.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.579+0000 7f5dbbfff640 1 -- 172.21.15.132:0/3838142986 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dc4005440 con 0x7f5dbc005180 2023-12-20T04:43:53.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.579+0000 7f5dd9fce640 1 -- 172.21.15.132:0/3838142986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5dd40b3650 con 0x7f5dbc005180 2023-12-20T04:43:53.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.579+0000 7f5dbbfff640 1 -- 172.21.15.132:0/3838142986 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dc4003810 con 0x7f5dbc005180 2023-12-20T04:43:53.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.579+0000 7f5dd9fce640 1 -- 172.21.15.132:0/3838142986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5dd40b3e50 con 0x7f5dbc005180 2023-12-20T04:43:53.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.580+0000 7f5dd9fce640 1 -- 172.21.15.132:0/3838142986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5dd404e840 con 0x7f5dbc005180 2023-12-20T04:43:53.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.580+0000 7f5dbbfff640 1 -- 172.21.15.132:0/3838142986 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5dc4003970 con 0x7f5dbc005180 2023-12-20T04:43:53.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.581+0000 7f5dbbfff640 1 --2- 172.21.15.132:0/3838142986 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5dc006a460 0x7f5dc006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:53.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.581+0000 7f5dbbfff640 1 -- 172.21.15.132:0/3838142986 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5dc4088660 con 0x7f5dbc005180 2023-12-20T04:43:53.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.581+0000 7f5dd2ffd640 1 --2- 172.21.15.132:0/3838142986 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5dc006a460 0x7f5dc006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:53.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.581+0000 7f5dd2ffd640 1 --2- 172.21.15.132:0/3838142986 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5dc006a460 0x7f5dc006c920 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4160a40 tx=0x7f5dc8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:53.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.585+0000 7f5dbbfff640 1 -- 172.21.15.132:0/3838142986 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5dc4053c50 con 0x7f5dbc005180 2023-12-20T04:43:53.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.814+0000 7f5dd9fce640 1 -- 172.21.15.132:0/3838142986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "df", "format": "json-pretty"} v 0) v1 -- 0x7f5dd40d1c90 con 0x7f5dbc005180 2023-12-20T04:43:53.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.814+0000 7f5dbbfff640 1 -- 172.21.15.132:0/3838142986 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "df", "format": "json-pretty"}]=0 v0) v1 ==== 75+0+1620 (secure 0 0 0) 0x7f5dc4057270 con 0x7f5dbc005180 2023-12-20T04:43:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:53.816 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:43:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: "stats": { 2023-12-20T04:43:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: "total_bytes": 1600000000, 2023-12-20T04:43:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: "total_avail_bytes": 1597647352, 2023-12-20T04:43:53.816 INFO:teuthology.orchestra.run.smithi132.stdout: "total_used_bytes": 2352648, 2023-12-20T04:43:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "total_used_raw_bytes": 2352648, 2023-12-20T04:43:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "total_used_raw_ratio": 0.0014704050263389945, 2023-12-20T04:43:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "num_osds": 8, 2023-12-20T04:43:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "num_per_pool_osds": 0, 2023-12-20T04:43:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "num_per_pool_omap_osds": 0 2023-12-20T04:43:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "stats_by_class": { 2023-12-20T04:43:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "hdd": { 2023-12-20T04:43:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "total_bytes": 1600000000, 2023-12-20T04:43:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "total_avail_bytes": 1597647352, 2023-12-20T04:43:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "total_used_bytes": 2352648, 2023-12-20T04:43:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "total_used_raw_bytes": 2352648, 2023-12-20T04:43:53.817 INFO:teuthology.orchestra.run.smithi132.stdout: "total_used_raw_ratio": 0.0014704050263389945 2023-12-20T04:43:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:43:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "name": ".mgr", 2023-12-20T04:43:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 1, 2023-12-20T04:43:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "stats": { 2023-12-20T04:43:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "stored": 590368, 2023-12-20T04:43:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "objects": 2, 2023-12-20T04:43:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "kb_used": 577, 2023-12-20T04:43:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "bytes_used": 590368, 2023-12-20T04:43:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "percent_used": 0.00052962178597226739, 2023-12-20T04:43:53.818 INFO:teuthology.orchestra.run.smithi132.stdout: "max_avail": 557053504 2023-12-20T04:43:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "name": "cephfs_metadata", 2023-12-20T04:43:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 4, 2023-12-20T04:43:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "stats": { 2023-12-20T04:43:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "stored": 2804, 2023-12-20T04:43:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "objects": 22, 2023-12-20T04:43:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "kb_used": 3, 2023-12-20T04:43:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "bytes_used": 2804, 2023-12-20T04:43:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "percent_used": 2.5168076263071271e-06, 2023-12-20T04:43:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: "max_avail": 557053504 2023-12-20T04:43:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:53.819 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:43:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "name": "cephfs_data", 2023-12-20T04:43:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 5, 2023-12-20T04:43:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "stats": { 2023-12-20T04:43:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "stored": 0, 2023-12-20T04:43:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "objects": 0, 2023-12-20T04:43:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "kb_used": 0, 2023-12-20T04:43:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "bytes_used": 0, 2023-12-20T04:43:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "percent_used": 0, 2023-12-20T04:43:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: "max_avail": 557053504 2023-12-20T04:43:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:53.820 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:43:53.820 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:43:53.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.816+0000 7f5dd9fce640 1 -- 172.21.15.132:0/3838142986 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5dc006a460 msgr2=0x7f5dc006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:53.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.816+0000 7f5dd9fce640 1 --2- 172.21.15.132:0/3838142986 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5dc006a460 0x7f5dc006c920 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f5dd4160a40 tx=0x7f5dc8009190 comp rx=0 tx=0).stop 2023-12-20T04:43:53.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.816+0000 7f5dd9fce640 1 -- 172.21.15.132:0/3838142986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dbc005180 msgr2=0x7f5dd40b2460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:53.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.816+0000 7f5dd9fce640 1 --2- 172.21.15.132:0/3838142986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dbc005180 0x7f5dd40b2460 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f5dc400f5f0 tx=0x7f5dc400f9f0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.816+0000 7f5dd9fce640 1 -- 172.21.15.132:0/3838142986 shutdown_connections 2023-12-20T04:43:53.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.816+0000 7f5dd9fce640 1 --2- 172.21.15.132:0/3838142986 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5dc006a460 0x7f5dc006c920 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.816+0000 7f5dd9fce640 1 --2- 172.21.15.132:0/3838142986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dd415e550 0x7f5dd41f1cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.816+0000 7f5dd9fce640 1 --2- 172.21.15.132:0/3838142986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dd4154ba0 0x7f5dd415e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.816+0000 7f5dd9fce640 1 --2- 172.21.15.132:0/3838142986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dbc005180 0x7f5dd40b2460 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:53.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.816+0000 7f5dd9fce640 1 -- 172.21.15.132:0/3838142986 >> 172.21.15.132:0/3838142986 conn(0x7f5dd40cf880 msgr2=0x7f5dd40b7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:53.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.816+0000 7f5dd9fce640 1 -- 172.21.15.132:0/3838142986 shutdown_connections 2023-12-20T04:43:53.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:53.816+0000 7f5dd9fce640 1 -- 172.21.15.132:0/3838142986 wait complete. 2023-12-20T04:43:53.829 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:43:53.829 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:43:53.829 DEBUG:teuthology.orchestra.run.smithi132:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-20T04:43:53.829 DEBUG:teuthology.orchestra.run.smithi132:> os.fchmod(fd, 0O666) 2023-12-20T04:43:53.829 DEBUG:teuthology.orchestra.run.smithi132:> os.fsync(fd) 2023-12-20T04:43:53.829 DEBUG:teuthology.orchestra.run.smithi132:> os.close(fd) 2023-12-20T04:43:53.829 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:43:54.079 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:43:54.079 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:43:54.079 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:43:54.080 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:43:54.080 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:43:54.080 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:54.080 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:43:54.080 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:43:54.080 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:43:54.080 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:43:54.080 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:54.080 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:43:54.080 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:43:54.080 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:43:54.080 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:43:54.080 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:54.080 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:43:54.080 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:43:54.080 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:43:54.081 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:43:54.081 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:43:54.081 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:43:54.081 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:43:54.081 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:43:54.081 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:54.081 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:43:54.081 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:43:54.196 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.94220.asok 2023-12-20T04:43:54.382 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.94220.asok 2023-12-20T04:43:54.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:54.383 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.94220.asok status 2023-12-20T04:43:54.518 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:43:54.518 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:43:54.518 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:43:54.518 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:43:54.519 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:43:54.519 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:43:54.519 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:43:54.519 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "94220", 2023-12-20T04:43:54.519 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:43:54.519 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:54.519 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 1, 2023-12-20T04:43:54.519 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:43:54.519 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 5400, 2023-12-20T04:43:54.519 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:43:54.519 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:43:54.519 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:43:54.519 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 5400 2023-12-20T04:43:54.519 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:54.520 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:43:54.520 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:43:54.520 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:43:54.520 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 4127227377 2023-12-20T04:43:54.520 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:54.520 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:54.520 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:43:54.520 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:43:54.520 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:43:54.520 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 4127227377 2023-12-20T04:43:54.520 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:54.520 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.5400 192.168.0.1:0/4127227377", 2023-12-20T04:43:54.520 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/4127227377", 2023-12-20T04:43:54.520 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 2, 2023-12-20T04:43:54.520 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 13, 2023-12-20T04:43:54.521 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 33, 2023-12-20T04:43:54.521 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 33, 2023-12-20T04:43:54.521 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:43:54.521 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:43:54.521 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:43:54.527 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-12-20T04:43:54.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.626+0000 7f3219955640 1 Processor -- start 2023-12-20T04:43:54.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.626+0000 7f3219955640 1 -- start start 2023-12-20T04:43:54.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.627+0000 7f3219955640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32140d30a0 0x7f32140cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:54.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.627+0000 7f3219955640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f32140d0060 0x7f32140d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:54.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.627+0000 7f3219955640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32140d0cf0 con 0x7f321415d2c0 2023-12-20T04:43:54.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.627+0000 7f3219955640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32140d0550 con 0x7f32140d0060 2023-12-20T04:43:54.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.627+0000 7f3219955640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32140cddc0 con 0x7f32140d30a0 2023-12-20T04:43:54.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.627+0000 7f32137fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f32140d0060 0x7f32140d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:54.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.627+0000 7f32137fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f32140d0060 0x7f32140d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35338/0 (socket says 172.21.15.132:35338) 2023-12-20T04:43:54.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.627+0000 7f32137fe640 1 -- 172.21.15.132:0/3364871178 learned_addr learned my addr 172.21.15.132:0/3364871178 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:54.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.627+0000 7f3212ffd640 1 --2- 172.21.15.132:0/3364871178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32140d30a0 0x7f32140cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:54.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.627+0000 7f32137fe640 1 -- 172.21.15.132:0/3364871178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32140d30a0 msgr2=0x7f32140cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:54.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.627+0000 7f32137fe640 1 --2- 172.21.15.132:0/3364871178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32140d30a0 0x7f32140cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:54.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.627+0000 7f32137fe640 1 -- 172.21.15.132:0/3364871178 >> v1:172.21.15.187:6789/0 conn(0x7f321415d2c0 legacy=0x7f32140d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:54.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.627+0000 7f32137fe640 1 -- 172.21.15.132:0/3364871178 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32140ce0a0 con 0x7f32140d0060 2023-12-20T04:43:54.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.627+0000 7f3212ffd640 1 --2- 172.21.15.132:0/3364871178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32140d30a0 0x7f32140cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:54.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.628+0000 7f32137fe640 1 --2- 172.21.15.132:0/3364871178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32140d0060 0x7f32140d1180 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f320c009e50 tx=0x7f320c02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4dc99c12a725eb3c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:54.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.628+0000 7f32127fc640 1 -- 172.21.15.132:0/3364871178 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c02cb00 con 0x7f32140d0060 2023-12-20T04:43:54.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.628+0000 7f32127fc640 1 -- 172.21.15.132:0/3364871178 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f320c02cc60 con 0x7f32140d0060 2023-12-20T04:43:54.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.628+0000 7f32127fc640 1 -- 172.21.15.132:0/3364871178 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320c0343f0 con 0x7f32140d0060 2023-12-20T04:43:54.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.628+0000 7f3219955640 1 -- 172.21.15.132:0/3364871178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32140d0060 msgr2=0x7f32140d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:54.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.628+0000 7f3219955640 1 --2- 172.21.15.132:0/3364871178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32140d0060 0x7f32140d1180 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f320c009e50 tx=0x7f320c02bf60 comp rx=0 tx=0).stop 2023-12-20T04:43:54.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.628+0000 7f3219955640 1 -- 172.21.15.132:0/3364871178 shutdown_connections 2023-12-20T04:43:54.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.628+0000 7f3219955640 1 --2- 172.21.15.132:0/3364871178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32140d0060 0x7f32140d1180 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:54.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.629+0000 7f3219955640 1 --2- 172.21.15.132:0/3364871178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32140d30a0 0x7f32140cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:54.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.629+0000 7f3219955640 1 -- 172.21.15.132:0/3364871178 >> 172.21.15.132:0/3364871178 conn(0x7f3214072e40 msgr2=0x7f3214073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:54.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.629+0000 7f3219955640 1 -- 172.21.15.132:0/3364871178 shutdown_connections 2023-12-20T04:43:54.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.629+0000 7f3219955640 1 -- 172.21.15.132:0/3364871178 wait complete. 2023-12-20T04:43:54.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.630+0000 7f3219955640 1 Processor -- start 2023-12-20T04:43:54.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.630+0000 7f3219955640 1 -- start start 2023-12-20T04:43:54.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.630+0000 7f3219955640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32140d0060 0x7f3214155560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:54.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.630+0000 7f3219955640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32140d30a0 0x7f32140c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:54.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.630+0000 7f3219955640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f321415d2c0 0x7f321415b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:54.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.630+0000 7f3219955640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3214158060 con 0x7f32140d0060 2023-12-20T04:43:54.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.630+0000 7f3219955640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3214155aa0 con 0x7f32140d30a0 2023-12-20T04:43:54.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.630+0000 7f3219955640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3214157d80 con 0x7f321415d2c0 2023-12-20T04:43:54.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.630+0000 7f3212ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32140d0060 0x7f3214155560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:54.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.630+0000 7f3212ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32140d0060 0x7f3214155560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35344/0 (socket says 172.21.15.132:35344) 2023-12-20T04:43:54.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.630+0000 7f3212ffd640 1 -- 172.21.15.132:0/768121981 learned_addr learned my addr 172.21.15.132:0/768121981 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:54.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.631+0000 7f320bfff640 1 --2- 172.21.15.132:0/768121981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32140d30a0 0x7f32140c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:54.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.631+0000 7f32137fe640 1 --2- 172.21.15.132:0/768121981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f321415d2c0 0x7f321415b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:54.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.631+0000 7f3212ffd640 1 -- 172.21.15.132:0/768121981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f321415d2c0 msgr2=0x7f321415b000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:54.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.631+0000 7f3212ffd640 1 --2- 172.21.15.132:0/768121981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f321415d2c0 0x7f321415b000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:54.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.631+0000 7f3212ffd640 1 -- 172.21.15.132:0/768121981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32140d30a0 msgr2=0x7f32140c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:54.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.631+0000 7f3212ffd640 1 --2- 172.21.15.132:0/768121981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32140d30a0 0x7f32140c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:54.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.631+0000 7f3212ffd640 1 -- 172.21.15.132:0/768121981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f320c009b30 con 0x7f32140d0060 2023-12-20T04:43:54.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.631+0000 7f320bfff640 1 --2- 172.21.15.132:0/768121981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32140d30a0 0x7f32140c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:54.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.631+0000 7f3212ffd640 1 --2- 172.21.15.132:0/768121981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32140d0060 0x7f3214155560 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f320400e760 tx=0x7f320400ec20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:54.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.631+0000 7f3210ff9640 1 -- 172.21.15.132:0/768121981 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3204004230 con 0x7f32140d0060 2023-12-20T04:43:54.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.631+0000 7f3210ff9640 1 -- 172.21.15.132:0/768121981 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3204004390 con 0x7f32140d0060 2023-12-20T04:43:54.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.631+0000 7f3219955640 1 -- 172.21.15.132:0/768121981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f321415d840 con 0x7f32140d0060 2023-12-20T04:43:54.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.631+0000 7f3210ff9640 1 -- 172.21.15.132:0/768121981 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f320400c890 con 0x7f32140d0060 2023-12-20T04:43:54.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.631+0000 7f3219955640 1 -- 172.21.15.132:0/768121981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f321415de00 con 0x7f32140d0060 2023-12-20T04:43:54.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.632+0000 7f3219955640 1 -- 172.21.15.132:0/768121981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f321415d6a0 con 0x7f32140d0060 2023-12-20T04:43:54.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.632+0000 7f3210ff9640 1 -- 172.21.15.132:0/768121981 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f320400c9f0 con 0x7f32140d0060 2023-12-20T04:43:54.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.633+0000 7f3210ff9640 1 --2- 172.21.15.132:0/768121981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31f406a430 0x7f31f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:54.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.633+0000 7f3210ff9640 1 -- 172.21.15.132:0/768121981 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32040884b0 con 0x7f32140d0060 2023-12-20T04:43:54.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.633+0000 7f320bfff640 1 --2- 172.21.15.132:0/768121981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31f406a430 0x7f31f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:54.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.633+0000 7f320bfff640 1 --2- 172.21.15.132:0/768121981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31f406a430 0x7f31f406c8f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f31fc007fd0 tx=0x7f31fc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:54.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.637+0000 7f3210ff9640 1 -- 172.21.15.132:0/768121981 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f321415d6a0 con 0x7f32140d0060 2023-12-20T04:43:54.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:54.810+0000 7f3219955640 1 -- 172.21.15.132:0/768121981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7f321415d6a0 con 0x7f32140d0060 2023-12-20T04:43:55.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.807+0000 7f3210ff9640 1 -- 172.21.15.132:0/768121981 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v34) v1 ==== 93+0+0 (secure 0 0 0) 0x7f321415d6a0 con 0x7f32140d0060 2023-12-20T04:43:55.809 INFO:teuthology.orchestra.run.smithi132.stderr:pauserd,pausewr is set 2023-12-20T04:43:55.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.810+0000 7f3219955640 1 -- 172.21.15.132:0/768121981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31f406a430 msgr2=0x7f31f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:55.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.810+0000 7f3219955640 1 --2- 172.21.15.132:0/768121981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31f406a430 0x7f31f406c8f0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f31fc007fd0 tx=0x7f31fc009040 comp rx=0 tx=0).stop 2023-12-20T04:43:55.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.810+0000 7f3219955640 1 -- 172.21.15.132:0/768121981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32140d0060 msgr2=0x7f3214155560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:55.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.810+0000 7f3219955640 1 --2- 172.21.15.132:0/768121981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32140d0060 0x7f3214155560 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f320400e760 tx=0x7f320400ec20 comp rx=0 tx=0).stop 2023-12-20T04:43:55.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.810+0000 7f3219955640 1 -- 172.21.15.132:0/768121981 shutdown_connections 2023-12-20T04:43:55.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.810+0000 7f3219955640 1 --2- 172.21.15.132:0/768121981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31f406a430 0x7f31f406c8f0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:55.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.810+0000 7f3219955640 1 --2- 172.21.15.132:0/768121981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f321415d2c0 0x7f321415b000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:55.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.810+0000 7f3219955640 1 --2- 172.21.15.132:0/768121981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32140d30a0 0x7f32140c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:55.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.810+0000 7f3219955640 1 --2- 172.21.15.132:0/768121981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32140d0060 0x7f3214155560 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:55.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.810+0000 7f3219955640 1 -- 172.21.15.132:0/768121981 >> 172.21.15.132:0/768121981 conn(0x7f3214072e40 msgr2=0x7f3214073220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:55.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.810+0000 7f3219955640 1 -- 172.21.15.132:0/768121981 shutdown_connections 2023-12-20T04:43:55.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.810+0000 7f3219955640 1 -- 172.21.15.132:0/768121981 wait complete. 2023-12-20T04:43:55.825 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-12-20T04:43:55.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.930+0000 7fb697477640 1 Processor -- start 2023-12-20T04:43:55.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.930+0000 7fb697477640 1 -- start start 2023-12-20T04:43:55.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb697477640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb69015d090 0x7fb6900c60c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:55.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb697477640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb6900c6600 0x7fb690069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:55.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb697477640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb69006a170 0x7fb6900c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:55.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb697477640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb69006a600 con 0x7fb6900c6600 2023-12-20T04:43:55.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb697477640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb690161a70 con 0x7fb69015d090 2023-12-20T04:43:55.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb697477640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb690160e60 con 0x7fb69006a170 2023-12-20T04:43:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb694a12640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb6900c6600 0x7fb690069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb694a12640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb6900c6600 0x7fb690069c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35348/0 (socket says 172.21.15.132:35348) 2023-12-20T04:43:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb694a12640 1 -- 172.21.15.132:0/2008079966 learned_addr learned my addr 172.21.15.132:0/2008079966 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb695a14640 1 --2- 172.21.15.132:0/2008079966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb69006a170 0x7fb6900c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb694a12640 1 -- 172.21.15.132:0/2008079966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb69006a170 msgr2=0x7fb6900c4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb695213640 1 --2- 172.21.15.132:0/2008079966 >> v2:172.21.15.187:3300/0 conn(0x7fb69015d090 0x7fb6900c60c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb694a12640 1 --2- 172.21.15.132:0/2008079966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb69006a170 0x7fb6900c4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb694a12640 1 -- 172.21.15.132:0/2008079966 >> v2:172.21.15.187:3300/0 conn(0x7fb69015d090 msgr2=0x7fb6900c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb694a12640 1 --2- 172.21.15.132:0/2008079966 >> v2:172.21.15.187:3300/0 conn(0x7fb69015d090 0x7fb6900c60c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb694a12640 1 -- 172.21.15.132:0/2008079966 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb690161140 con 0x7fb6900c6600 2023-12-20T04:43:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb695a14640 1 --2- 172.21.15.132:0/2008079966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb69006a170 0x7fb6900c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:55.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.931+0000 7fb695213640 1 --2- 172.21.15.132:0/2008079966 >> v2:172.21.15.187:3300/0 conn(0x7fb69015d090 0x7fb6900c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:55.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.932+0000 7fb694a12640 1 --2- 172.21.15.132:0/2008079966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6900c6600 0x7fb690069c30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb69006ad10 tx=0x7fb68002b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=208fd3fc830e2130 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:55.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.932+0000 7fb687fff640 1 -- 172.21.15.132:0/2008079966 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb6800317e0 con 0x7fb6900c6600 2023-12-20T04:43:55.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.932+0000 7fb687fff640 1 -- 172.21.15.132:0/2008079966 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb680031940 con 0x7fb6900c6600 2023-12-20T04:43:55.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.932+0000 7fb687fff640 1 -- 172.21.15.132:0/2008079966 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb680031cd0 con 0x7fb6900c6600 2023-12-20T04:43:55.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.933+0000 7fb697477640 1 -- 172.21.15.132:0/2008079966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6900c6600 msgr2=0x7fb690069c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:55.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.933+0000 7fb697477640 1 --2- 172.21.15.132:0/2008079966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6900c6600 0x7fb690069c30 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7fb69006ad10 tx=0x7fb68002b880 comp rx=0 tx=0).stop 2023-12-20T04:43:55.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.933+0000 7fb697477640 1 -- 172.21.15.132:0/2008079966 shutdown_connections 2023-12-20T04:43:55.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.933+0000 7fb697477640 1 --2- 172.21.15.132:0/2008079966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb69006a170 0x7fb6900c4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:55.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.933+0000 7fb697477640 1 --2- 172.21.15.132:0/2008079966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6900c6600 0x7fb690069c30 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:55.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.933+0000 7fb697477640 1 --2- 172.21.15.132:0/2008079966 >> v2:172.21.15.187:3300/0 conn(0x7fb69015d090 0x7fb6900c60c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:55.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.933+0000 7fb697477640 1 -- 172.21.15.132:0/2008079966 >> 172.21.15.132:0/2008079966 conn(0x7fb6900cfb10 msgr2=0x7fb6900cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:55.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.933+0000 7fb697477640 1 -- 172.21.15.132:0/2008079966 shutdown_connections 2023-12-20T04:43:55.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.933+0000 7fb697477640 1 -- 172.21.15.132:0/2008079966 wait complete. 2023-12-20T04:43:55.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.934+0000 7fb697477640 1 Processor -- start 2023-12-20T04:43:55.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.934+0000 7fb697477640 1 -- start start 2023-12-20T04:43:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.935+0000 7fb697477640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb69006a170 0x7fb6900b52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:55.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.935+0000 7fb697477640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6900c6600 0x7fb69006e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.935+0000 7fb697477640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb69015d090 0x7fb69014ab30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.935+0000 7fb697477640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69006eda0 con 0x7fb69006a170 2023-12-20T04:43:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.935+0000 7fb697477640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb69006e7e0 con 0x7fb69015d090 2023-12-20T04:43:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.935+0000 7fb697477640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb69006eac0 con 0x7fb6900c6600 2023-12-20T04:43:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.935+0000 7fb695213640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb69006a170 0x7fb6900b52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.935+0000 7fb695213640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb69006a170 0x7fb6900b52d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35362/0 (socket says 172.21.15.132:35362) 2023-12-20T04:43:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.935+0000 7fb695213640 1 -- 172.21.15.132:0/2462665844 learned_addr learned my addr 172.21.15.132:0/2462665844 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.935+0000 7fb695213640 1 -- 172.21.15.132:0/2462665844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6900c6600 msgr2=0x7fb69006e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.935+0000 7fb695213640 1 --2- 172.21.15.132:0/2462665844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6900c6600 0x7fb69006e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.935+0000 7fb695213640 1 -- 172.21.15.132:0/2462665844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb69015d090 msgr2=0x7fb69014ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.935+0000 7fb695213640 1 --2- 172.21.15.132:0/2462665844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb69015d090 0x7fb69014ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.935+0000 7fb695213640 1 -- 172.21.15.132:0/2462665844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6800094d0 con 0x7fb69006a170 2023-12-20T04:43:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.935+0000 7fb695213640 1 --2- 172.21.15.132:0/2462665844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb69006a170 0x7fb6900b52d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00c7f0 tx=0x7fb68c00cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.936+0000 7fb685ffb640 1 -- 172.21.15.132:0/2462665844 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c007a30 con 0x7fb69006a170 2023-12-20T04:43:55.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.936+0000 7fb685ffb640 1 -- 172.21.15.132:0/2462665844 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb68c007b90 con 0x7fb69006a170 2023-12-20T04:43:55.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.936+0000 7fb697477640 1 -- 172.21.15.132:0/2462665844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb69015d5a0 con 0x7fb69006a170 2023-12-20T04:43:55.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.936+0000 7fb685ffb640 1 -- 172.21.15.132:0/2462665844 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb68c00ce40 con 0x7fb69006a170 2023-12-20T04:43:55.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.936+0000 7fb697477640 1 -- 172.21.15.132:0/2462665844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6900b0a60 con 0x7fb69006a170 2023-12-20T04:43:55.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.937+0000 7fb697477640 1 -- 172.21.15.132:0/2462665844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb69004e840 con 0x7fb69006a170 2023-12-20T04:43:55.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.937+0000 7fb685ffb640 1 -- 172.21.15.132:0/2462665844 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb68c0113f0 con 0x7fb69006a170 2023-12-20T04:43:55.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.937+0000 7fb685ffb640 1 --2- 172.21.15.132:0/2462665844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb67406a430 0x7fb67406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:55.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.938+0000 7fb694a12640 1 --2- 172.21.15.132:0/2462665844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb67406a430 0x7fb67406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:55.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.938+0000 7fb685ffb640 1 -- 172.21.15.132:0/2462665844 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(34..34 src has 1..34) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb68c088a90 con 0x7fb69006a170 2023-12-20T04:43:55.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.938+0000 7fb685ffb640 1 -- 172.21.15.132:0/2462665844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=35+}) v3 -- 0x7fb674071f60 con 0x7fb69006a170 2023-12-20T04:43:55.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.938+0000 7fb694a12640 1 --2- 172.21.15.132:0/2462665844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb67406a430 0x7fb67406c8f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb680036000 tx=0x7fb680030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:55.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:55.942+0000 7fb685ffb640 1 -- 172.21.15.132:0/2462665844 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb68c01f060 con 0x7fb69006a170 2023-12-20T04:43:56.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.120+0000 7fb697477640 1 -- 172.21.15.132:0/2462665844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7fb6900d06d0 con 0x7fb69006a170 2023-12-20T04:43:56.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.808+0000 7fb685ffb640 1 -- 172.21.15.132:0/2462665844 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(35..35 src has 1..35) v4 ==== 288+0+0 (secure 0 0 0) 0x7fb68c058440 con 0x7fb69006a170 2023-12-20T04:43:56.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.808+0000 7fb685ffb640 1 -- 172.21.15.132:0/2462665844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=36}) v3 -- 0x7fb674072810 con 0x7fb69006a170 2023-12-20T04:43:56.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.810+0000 7fb685ffb640 1 -- 172.21.15.132:0/2462665844 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v35) v1 ==== 97+0+0 (secure 0 0 0) 0x7fb68c01f020 con 0x7fb69006a170 2023-12-20T04:43:56.811 INFO:teuthology.orchestra.run.smithi132.stderr:pauserd,pausewr is unset 2023-12-20T04:43:56.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.812+0000 7fb697477640 1 -- 172.21.15.132:0/2462665844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb67406a430 msgr2=0x7fb67406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:56.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.812+0000 7fb697477640 1 --2- 172.21.15.132:0/2462665844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb67406a430 0x7fb67406c8f0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7fb680036000 tx=0x7fb680030000 comp rx=0 tx=0).stop 2023-12-20T04:43:56.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.812+0000 7fb697477640 1 -- 172.21.15.132:0/2462665844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb69006a170 msgr2=0x7fb6900b52d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:56.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.812+0000 7fb697477640 1 --2- 172.21.15.132:0/2462665844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb69006a170 0x7fb6900b52d0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7fb68c00c7f0 tx=0x7fb68c00cbf0 comp rx=0 tx=0).stop 2023-12-20T04:43:56.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.813+0000 7fb697477640 1 -- 172.21.15.132:0/2462665844 shutdown_connections 2023-12-20T04:43:56.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.813+0000 7fb697477640 1 --2- 172.21.15.132:0/2462665844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb67406a430 0x7fb67406c8f0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:56.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.813+0000 7fb697477640 1 --2- 172.21.15.132:0/2462665844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb69015d090 0x7fb69014ab30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:56.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.813+0000 7fb697477640 1 --2- 172.21.15.132:0/2462665844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6900c6600 0x7fb69006e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:56.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.813+0000 7fb697477640 1 --2- 172.21.15.132:0/2462665844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb69006a170 0x7fb6900b52d0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:56.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.813+0000 7fb697477640 1 -- 172.21.15.132:0/2462665844 >> 172.21.15.132:0/2462665844 conn(0x7fb6900cfb10 msgr2=0x7fb6900705f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:56.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.813+0000 7fb697477640 1 -- 172.21.15.132:0/2462665844 shutdown_connections 2023-12-20T04:43:56.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.813+0000 7fb697477640 1 -- 172.21.15.132:0/2462665844 wait complete. 2023-12-20T04:43:56.827 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:56.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.926+0000 7f7eeffab640 1 Processor -- start 2023-12-20T04:43:56.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.926+0000 7f7eeffab640 1 -- start start 2023-12-20T04:43:56.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.927+0000 7f7eeffab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ee80d0370 0x7f7ee80b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:56.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.927+0000 7f7eeffab640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7ee80cdc10 0x7f7ee806c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:56.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.927+0000 7f7eeffab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ee80b2f90 con 0x7f7ee815d100 2023-12-20T04:43:56.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.927+0000 7f7eeffab640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ee81613c0 con 0x7f7ee80cdc10 2023-12-20T04:43:56.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.927+0000 7f7eeffab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80d1b00 con 0x7f7ee80d0370 2023-12-20T04:43:56.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.927+0000 7f7eedd47640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7ee815d100 0x7f7ee80cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57744/0 (socket says 172.21.15.132:57744) 2023-12-20T04:43:56.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.927+0000 7f7eedd47640 1 -- 172.21.15.132:0/2304857982 learned_addr learned my addr 172.21.15.132:0/2304857982 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:56.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.927+0000 7f7eecd45640 1 -- 172.21.15.132:0/2304857982 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 658136896 0 0) 0x7f7ee4001490 con 0x7f7ee815d100 2023-12-20T04:43:56.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eecd45640 1 -- 172.21.15.132:0/2304857982 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ed4003520 con 0x7f7ee815d100 2023-12-20T04:43:56.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eee548640 1 --2- 172.21.15.132:0/2304857982 >> v2:172.21.15.187:3300/0 conn(0x7f7ee80cdc10 0x7f7ee806c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:56.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eed546640 1 --2- 172.21.15.132:0/2304857982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ee80d0370 0x7f7ee80b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:56.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eecd45640 1 -- 172.21.15.132:0/2304857982 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1989857716 0 0) 0x7f7ed4003520 con 0x7f7ee815d100 2023-12-20T04:43:56.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eecd45640 1 -- 172.21.15.132:0/2304857982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ee80d0370 msgr2=0x7f7ee80b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:56.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eecd45640 1 --2- 172.21.15.132:0/2304857982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ee80d0370 0x7f7ee80b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:56.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eecd45640 1 -- 172.21.15.132:0/2304857982 >> v2:172.21.15.187:3300/0 conn(0x7f7ee80cdc10 msgr2=0x7f7ee806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:56.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eecd45640 1 --2- 172.21.15.132:0/2304857982 >> v2:172.21.15.187:3300/0 conn(0x7f7ee80cdc10 0x7f7ee806c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:56.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eecd45640 1 -- 172.21.15.132:0/2304857982 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee80d0810 con 0x7f7ee815d100 2023-12-20T04:43:56.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eecd45640 1 -- 172.21.15.132:0/2304857982 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f7ee4001b80 con 0x7f7ee815d100 2023-12-20T04:43:56.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eecd45640 1 -- 172.21.15.132:0/2304857982 >> v1:172.21.15.132:6789/0 conn(0x7f7ee815d100 legacy=0x7f7ee80cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:56.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eecd45640 1 --2- 172.21.15.132:0/2304857982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ed4003970 0x7f7ed4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:56.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eecd45640 1 --2- 172.21.15.132:0/2304857982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ed40047c0 0x7f7ed4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:56.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eecd45640 1 --2- 172.21.15.132:0/2304857982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ee80d0370 0x7f7ed4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:56.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eecd45640 1 -- 172.21.15.132:0/2304857982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee81613c0 con 0x7f7ed40047c0 2023-12-20T04:43:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eecd45640 1 -- 172.21.15.132:0/2304857982 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80d1b00 con 0x7f7ed4003970 2023-12-20T04:43:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eecd45640 1 -- 172.21.15.132:0/2304857982 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ed400b9d0 con 0x7f7ee80d0370 2023-12-20T04:43:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eed546640 1 --2- 172.21.15.132:0/2304857982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ed40047c0 0x7f7ed4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eedd47640 1 --2- 172.21.15.132:0/2304857982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ed4003970 0x7f7ed4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eee548640 1 --2- 172.21.15.132:0/2304857982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ee80d0370 0x7f7ed4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eed546640 1 -- 172.21.15.132:0/2304857982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ee80d0370 msgr2=0x7f7ed4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eed546640 1 --2- 172.21.15.132:0/2304857982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ee80d0370 0x7f7ed4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eed546640 1 -- 172.21.15.132:0/2304857982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ed4003970 msgr2=0x7f7ed4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eed546640 1 --2- 172.21.15.132:0/2304857982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ed4003970 0x7f7ed4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eed546640 1 -- 172.21.15.132:0/2304857982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ed4003520 con 0x7f7ed40047c0 2023-12-20T04:43:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.928+0000 7f7eee548640 1 --2- 172.21.15.132:0/2304857982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ee80d0370 0x7f7ed4005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.929+0000 7f7eed546640 1 --2- 172.21.15.132:0/2304857982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ed40047c0 0x7f7ed4004c40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009ac0 tx=0x7f7ed40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a3d988e7b0befb server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.929+0000 7f7eecd45640 1 -- 172.21.15.132:0/2304857982 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed802c6b0 con 0x7f7ed40047c0 2023-12-20T04:43:56.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.929+0000 7f7eecd45640 1 -- 172.21.15.132:0/2304857982 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ed802c810 con 0x7f7ed40047c0 2023-12-20T04:43:56.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.929+0000 7f7eecd45640 1 -- 172.21.15.132:0/2304857982 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ed802cba0 con 0x7f7ed40047c0 2023-12-20T04:43:56.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.930+0000 7f7eeffab640 1 -- 172.21.15.132:0/2304857982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ed40047c0 msgr2=0x7f7ed4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:56.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.930+0000 7f7eeffab640 1 --2- 172.21.15.132:0/2304857982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ed40047c0 0x7f7ed4004c40 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8009ac0 tx=0x7f7ed40057f0 comp rx=0 tx=0).stop 2023-12-20T04:43:56.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.930+0000 7f7eee548640 1 -- 172.21.15.132:0/2304857982 reap_dead start 2023-12-20T04:43:56.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.930+0000 7f7eeffab640 1 -- 172.21.15.132:0/2304857982 shutdown_connections 2023-12-20T04:43:56.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.930+0000 7f7eeffab640 1 -- 172.21.15.132:0/2304857982 >> 172.21.15.132:0/2304857982 conn(0x7f7ee806d7c0 msgr2=0x7f7ee806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:56.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.930+0000 7f7eeffab640 1 -- 172.21.15.132:0/2304857982 shutdown_connections 2023-12-20T04:43:56.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.930+0000 7f7eeffab640 1 -- 172.21.15.132:0/2304857982 wait complete. 2023-12-20T04:43:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.931+0000 7f7eeffab640 1 Processor -- start 2023-12-20T04:43:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.931+0000 7f7eeffab640 1 -- start start 2023-12-20T04:43:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.931+0000 7f7eeffab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ed40047c0 0x7f7ee815bc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eeffab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ee80c4900 0x7f7ee815d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eeffab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ee8160360 0x7f7ee815dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eeffab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80b4b10 con 0x7f7ed40047c0 2023-12-20T04:43:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eeffab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee80b4830 con 0x7f7ee80c4900 2023-12-20T04:43:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eeffab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ee81e7650 con 0x7f7ee8160360 2023-12-20T04:43:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eedd47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ed40047c0 0x7f7ee815bc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eedd47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ed40047c0 0x7f7ee815bc10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35376/0 (socket says 172.21.15.132:35376) 2023-12-20T04:43:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eedd47640 1 -- 172.21.15.132:0/1651037535 learned_addr learned my addr 172.21.15.132:0/1651037535 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:56.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eee548640 1 --2- 172.21.15.132:0/1651037535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ee8160360 0x7f7ee815dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eed546640 1 --2- 172.21.15.132:0/1651037535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ee80c4900 0x7f7ee815d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eedd47640 1 -- 172.21.15.132:0/1651037535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ee8160360 msgr2=0x7f7ee815dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eedd47640 1 --2- 172.21.15.132:0/1651037535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ee8160360 0x7f7ee815dd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eedd47640 1 -- 172.21.15.132:0/1651037535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ee80c4900 msgr2=0x7f7ee815d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eedd47640 1 --2- 172.21.15.132:0/1651037535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ee80c4900 0x7f7ee815d840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eedd47640 1 -- 172.21.15.132:0/1651037535 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ee81e7930 con 0x7f7ed40047c0 2023-12-20T04:43:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eed546640 1 --2- 172.21.15.132:0/1651037535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ee80c4900 0x7f7ee815d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eedd47640 1 --2- 172.21.15.132:0/1651037535 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ed40047c0 0x7f7ee815bc10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400ab00 tx=0x7f7ee4007060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7ede7fc640 1 -- 172.21.15.132:0/1651037535 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee4007aa0 con 0x7f7ed40047c0 2023-12-20T04:43:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7ede7fc640 1 -- 172.21.15.132:0/1651037535 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ee40133f0 con 0x7f7ed40047c0 2023-12-20T04:43:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eeffab640 1 -- 172.21.15.132:0/1651037535 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ee81e7c10 con 0x7f7ed40047c0 2023-12-20T04:43:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7ede7fc640 1 -- 172.21.15.132:0/1651037535 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ee40137a0 con 0x7f7ed40047c0 2023-12-20T04:43:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.932+0000 7f7eeffab640 1 -- 172.21.15.132:0/1651037535 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ee815c1a0 con 0x7f7ed40047c0 2023-12-20T04:43:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.933+0000 7f7eeffab640 1 -- 172.21.15.132:0/1651037535 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ee81e7e50 con 0x7f7ed40047c0 2023-12-20T04:43:56.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.934+0000 7f7ede7fc640 1 -- 172.21.15.132:0/1651037535 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7ee4013900 con 0x7f7ed40047c0 2023-12-20T04:43:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.934+0000 7f7ede7fc640 1 --2- 172.21.15.132:0/1651037535 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ecc06a430 0x7f7ecc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.934+0000 7f7ede7fc640 1 -- 172.21.15.132:0/1651037535 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ee40894e0 con 0x7f7ed40047c0 2023-12-20T04:43:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.934+0000 7f7eed546640 1 --2- 172.21.15.132:0/1651037535 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ecc06a430 0x7f7ecc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.934+0000 7f7eed546640 1 --2- 172.21.15.132:0/1651037535 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ecc06a430 0x7f7ecc06c8f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8036000 tx=0x7f7ed8030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:56.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:56.938+0000 7f7ede7fc640 1 -- 172.21.15.132:0/1651037535 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7ee4054ad0 con 0x7f7ed40047c0 2023-12-20T04:43:57.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.105+0000 7f7eeffab640 1 -- 172.21.15.132:0/1651037535 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7ee80b2f90 con 0x7f7ed40047c0 2023-12-20T04:43:57.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.106+0000 7f7ede7fc640 1 -- 172.21.15.132:0/1651037535 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16149 (secure 0 0 0) 0x7f7ee80b2f90 con 0x7f7ed40047c0 2023-12-20T04:43:57.107 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:57.107 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":35,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:43:56.805688+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:43:42.932158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-20T04:43:43.361561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:57.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.107+0000 7f7eeffab640 1 -- 172.21.15.132:0/1651037535 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ecc06a430 msgr2=0x7f7ecc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:57.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.107+0000 7f7eeffab640 1 --2- 172.21.15.132:0/1651037535 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ecc06a430 0x7f7ecc06c8f0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7ed8036000 tx=0x7f7ed8030000 comp rx=0 tx=0).stop 2023-12-20T04:43:57.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.107+0000 7f7eeffab640 1 -- 172.21.15.132:0/1651037535 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ed40047c0 msgr2=0x7f7ee815bc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:57.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.107+0000 7f7eeffab640 1 --2- 172.21.15.132:0/1651037535 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ed40047c0 0x7f7ee815bc10 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f7ee400ab00 tx=0x7f7ee4007060 comp rx=0 tx=0).stop 2023-12-20T04:43:57.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.107+0000 7f7eeffab640 1 -- 172.21.15.132:0/1651037535 shutdown_connections 2023-12-20T04:43:57.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.107+0000 7f7eeffab640 1 --2- 172.21.15.132:0/1651037535 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ecc06a430 0x7f7ecc06c8f0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:57.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.107+0000 7f7eeffab640 1 --2- 172.21.15.132:0/1651037535 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ee8160360 0x7f7ee815dd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:57.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.107+0000 7f7eeffab640 1 --2- 172.21.15.132:0/1651037535 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ee80c4900 0x7f7ee815d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:57.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.107+0000 7f7eeffab640 1 --2- 172.21.15.132:0/1651037535 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ed40047c0 0x7f7ee815bc10 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:57.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.107+0000 7f7eeffab640 1 -- 172.21.15.132:0/1651037535 >> 172.21.15.132:0/1651037535 conn(0x7f7ee806d7c0 msgr2=0x7f7ee80c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:57.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.108+0000 7f7eeffab640 1 -- 172.21.15.132:0/1651037535 shutdown_connections 2023-12-20T04:43:57.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.108+0000 7f7eeffab640 1 -- 172.21.15.132:0/1651037535 wait complete. 2023-12-20T04:43:57.120 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:43:57.120 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:43:57.121 DEBUG:teuthology.orchestra.run.smithi132:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-20T04:43:57.121 DEBUG:teuthology.orchestra.run.smithi132:> os.fchmod(fd, 0O666) 2023-12-20T04:43:57.121 DEBUG:teuthology.orchestra.run.smithi132:> os.fsync(fd) 2023-12-20T04:43:57.121 DEBUG:teuthology.orchestra.run.smithi132:> os.close(fd) 2023-12-20T04:43:57.121 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:43:57.371 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:43:57.371 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:43:57.371 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:43:57.371 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:43:57.371 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:43:57.371 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:57.371 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:43:57.371 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:43:57.372 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:43:57.372 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:43:57.372 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:57.372 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:43:57.372 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:43:57.372 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:43:57.372 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:43:57.372 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:57.372 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:43:57.372 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:43:57.372 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:43:57.372 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:43:57.372 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:43:57.372 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:43:57.372 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:43:57.373 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:43:57.373 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:57.373 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:43:57.373 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:43:57.488 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.94220.asok 2023-12-20T04:43:57.675 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.94220.asok 2023-12-20T04:43:57.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:57.675 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.94220.asok status 2023-12-20T04:43:57.812 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:43:57.812 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:43:57.813 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:43:57.813 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:43:57.813 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:43:57.813 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:43:57.813 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:43:57.813 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "94220", 2023-12-20T04:43:57.813 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:43:57.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:57.813 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 1, 2023-12-20T04:43:57.813 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:43:57.813 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 5400, 2023-12-20T04:43:57.813 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:43:57.813 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:43:57.814 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:43:57.814 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 5400 2023-12-20T04:43:57.814 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:57.814 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:43:57.814 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:43:57.814 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:43:57.814 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 4127227377 2023-12-20T04:43:57.814 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:57.814 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:57.814 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:43:57.814 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:43:57.814 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:43:57.815 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 4127227377 2023-12-20T04:43:57.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:57.815 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.5400 192.168.0.1:0/4127227377", 2023-12-20T04:43:57.815 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/4127227377", 2023-12-20T04:43:57.815 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 2, 2023-12-20T04:43:57.815 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 13, 2023-12-20T04:43:57.815 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 33, 2023-12-20T04:43:57.815 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 33, 2023-12-20T04:43:57.815 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:43:57.815 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:43:57.815 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:43:57.821 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:43:57.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.919+0000 7fa167d11640 1 Processor -- start 2023-12-20T04:43:57.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.920+0000 7fa167d11640 1 -- start start 2023-12-20T04:43:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.920+0000 7fa167d11640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa160159d00 0x7fa16015da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.920+0000 7fa167d11640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa16015df40 0x7fa1600caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.920+0000 7fa167d11640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa16015e4c0 con 0x7fa1600cafd0 2023-12-20T04:43:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.920+0000 7fa167d11640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa16006c220 con 0x7fa160159d00 2023-12-20T04:43:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.920+0000 7fa167d11640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa16015e7a0 con 0x7fa16015df40 2023-12-20T04:43:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.920+0000 7fa165aad640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa160159d00 0x7fa16015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.921+0000 7fa165aad640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa160159d00 0x7fa16015da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50716/0 (socket says 172.21.15.132:50716) 2023-12-20T04:43:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.921+0000 7fa165aad640 1 -- 172.21.15.132:0/4041211686 learned_addr learned my addr 172.21.15.132:0/4041211686 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.921+0000 7fa1652ac640 1 --2- 172.21.15.132:0/4041211686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa16015df40 0x7fa1600caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.921+0000 7fa165aad640 1 -- 172.21.15.132:0/4041211686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa16015df40 msgr2=0x7fa1600caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.921+0000 7fa165aad640 1 --2- 172.21.15.132:0/4041211686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa16015df40 0x7fa1600caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.921+0000 7fa165aad640 1 -- 172.21.15.132:0/4041211686 >> v1:172.21.15.187:6789/0 conn(0x7fa1600cafd0 legacy=0x7fa16006cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:57.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.921+0000 7fa165aad640 1 -- 172.21.15.132:0/4041211686 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16006c430 con 0x7fa160159d00 2023-12-20T04:43:57.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.922+0000 7fa165aad640 1 --2- 172.21.15.132:0/4041211686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa160159d00 0x7fa16015da00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa15c00d150 tx=0x7fa15c02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b686751b90eec99 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:57.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.922+0000 7fa164aab640 1 -- 172.21.15.132:0/4041211686 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c02ea80 con 0x7fa160159d00 2023-12-20T04:43:57.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.922+0000 7fa164aab640 1 -- 172.21.15.132:0/4041211686 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa15c02ebe0 con 0x7fa160159d00 2023-12-20T04:43:57.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.922+0000 7fa164aab640 1 -- 172.21.15.132:0/4041211686 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa15c009600 con 0x7fa160159d00 2023-12-20T04:43:57.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.922+0000 7fa167d11640 1 -- 172.21.15.132:0/4041211686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa160159d00 msgr2=0x7fa16015da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:57.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.922+0000 7fa167d11640 1 --2- 172.21.15.132:0/4041211686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa160159d00 0x7fa16015da00 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7fa15c00d150 tx=0x7fa15c02e0e0 comp rx=0 tx=0).stop 2023-12-20T04:43:57.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.922+0000 7fa167d11640 1 -- 172.21.15.132:0/4041211686 shutdown_connections 2023-12-20T04:43:57.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.922+0000 7fa167d11640 1 --2- 172.21.15.132:0/4041211686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa16015df40 0x7fa1600caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:57.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.922+0000 7fa167d11640 1 --2- 172.21.15.132:0/4041211686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa160159d00 0x7fa16015da00 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:57.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.922+0000 7fa167d11640 1 -- 172.21.15.132:0/4041211686 >> 172.21.15.132:0/4041211686 conn(0x7fa1600cfca0 msgr2=0x7fa1600d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:57.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.922+0000 7fa167d11640 1 -- 172.21.15.132:0/4041211686 shutdown_connections 2023-12-20T04:43:57.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.922+0000 7fa167d11640 1 -- 172.21.15.132:0/4041211686 wait complete. 2023-12-20T04:43:57.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.923+0000 7fa167d11640 1 Processor -- start 2023-12-20T04:43:57.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.923+0000 7fa167d11640 1 -- start start 2023-12-20T04:43:57.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.924+0000 7fa167d11640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1600cafd0 0x7fa1600b08b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:57.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.924+0000 7fa167d11640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa160159d00 0x7fa1600b3390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:57.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.924+0000 7fa167d11640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa16015df40 0x7fa1600c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:57.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.924+0000 7fa167d11640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600b3d50 con 0x7fa160159d00 2023-12-20T04:43:57.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.924+0000 7fa167d11640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600b4030 con 0x7fa1600cafd0 2023-12-20T04:43:57.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.924+0000 7fa167d11640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa1600b4310 con 0x7fa16015df40 2023-12-20T04:43:57.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.924+0000 7fa1652ac640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa160159d00 0x7fa1600b3390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:57.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.924+0000 7fa1652ac640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa160159d00 0x7fa1600b3390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50720/0 (socket says 172.21.15.132:50720) 2023-12-20T04:43:57.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.924+0000 7fa1652ac640 1 -- 172.21.15.132:0/1603536587 learned_addr learned my addr 172.21.15.132:0/1603536587 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:57.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.924+0000 7fa165aad640 1 --2- 172.21.15.132:0/1603536587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1600cafd0 0x7fa1600b08b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:57.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.924+0000 7fa1662ae640 1 --2- 172.21.15.132:0/1603536587 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa16015df40 0x7fa1600c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:57.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.924+0000 7fa1652ac640 1 -- 172.21.15.132:0/1603536587 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa16015df40 msgr2=0x7fa1600c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:57.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.924+0000 7fa1652ac640 1 --2- 172.21.15.132:0/1603536587 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa16015df40 0x7fa1600c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:57.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.924+0000 7fa1652ac640 1 -- 172.21.15.132:0/1603536587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1600cafd0 msgr2=0x7fa1600b08b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:57.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.924+0000 7fa1652ac640 1 --2- 172.21.15.132:0/1603536587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1600cafd0 0x7fa1600b08b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:57.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.924+0000 7fa1652ac640 1 -- 172.21.15.132:0/1603536587 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa15c00bd40 con 0x7fa160159d00 2023-12-20T04:43:57.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.925+0000 7fa1652ac640 1 --2- 172.21.15.132:0/1603536587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa160159d00 0x7fa1600b3390 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa15000c7f0 tx=0x7fa15000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:57.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.925+0000 7fa1567fc640 1 -- 172.21.15.132:0/1603536587 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150004220 con 0x7fa160159d00 2023-12-20T04:43:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.925+0000 7fa1567fc640 1 -- 172.21.15.132:0/1603536587 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa1500043a0 con 0x7fa160159d00 2023-12-20T04:43:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.925+0000 7fa1567fc640 1 -- 172.21.15.132:0/1603536587 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa150007860 con 0x7fa160159d00 2023-12-20T04:43:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.925+0000 7fa167d11640 1 -- 172.21.15.132:0/1603536587 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1600b45f0 con 0x7fa160159d00 2023-12-20T04:43:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.925+0000 7fa167d11640 1 -- 172.21.15.132:0/1603536587 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1600b0df0 con 0x7fa160159d00 2023-12-20T04:43:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.926+0000 7fa167d11640 1 -- 172.21.15.132:0/1603536587 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa1600b0fe0 con 0x7fa160159d00 2023-12-20T04:43:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.926+0000 7fa1567fc640 1 -- 172.21.15.132:0/1603536587 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa150007bd0 con 0x7fa160159d00 2023-12-20T04:43:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.927+0000 7fa1567fc640 1 --2- 172.21.15.132:0/1603536587 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa14406a430 0x7fa14406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.927+0000 7fa165aad640 1 --2- 172.21.15.132:0/1603536587 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa14406a430 0x7fa14406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.927+0000 7fa1567fc640 1 -- 172.21.15.132:0/1603536587 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa150088840 con 0x7fa160159d00 2023-12-20T04:43:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.927+0000 7fa165aad640 1 --2- 172.21.15.132:0/1603536587 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa14406a430 0x7fa14406c8f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa15c037000 tx=0x7fa15c032000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:57.931+0000 7fa1567fc640 1 -- 172.21.15.132:0/1603536587 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa150053ec0 con 0x7fa160159d00 2023-12-20T04:43:58.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:58.130+0000 7fa167d11640 1 -- 172.21.15.132:0/1603536587 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa16004e840 con 0x7fa160159d00 2023-12-20T04:43:58.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:58.131+0000 7fa1567fc640 1 -- 172.21.15.132:0/1603536587 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fa15001e020 con 0x7fa160159d00 2023-12-20T04:43:58.133 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:58.133 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/703933798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":703933798},{"type":"v1","addr":"172.21.15.187:6835","nonce":703933798}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3137083608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3137083608},{"type":"v1","addr":"172.21.15.187:6833","nonce":3137083608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1340012349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1340012349},{"type":"v1","addr":"172.21.15.132:6836","nonce":1340012349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:43:44.388671+0000","modified":"2023-12-20T04:43:47.069930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/359299732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":359299732},{"type":"v1","addr":"172.21.15.132:6837","nonce":359299732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-20T04:43:58.133 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 13 2023-12-20T04:43:58.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:58.133+0000 7fa167d11640 1 -- 172.21.15.132:0/1603536587 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa14406a430 msgr2=0x7fa14406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:58.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:58.133+0000 7fa167d11640 1 --2- 172.21.15.132:0/1603536587 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa14406a430 0x7fa14406c8f0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fa15c037000 tx=0x7fa15c032000 comp rx=0 tx=0).stop 2023-12-20T04:43:58.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:58.133+0000 7fa167d11640 1 -- 172.21.15.132:0/1603536587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa160159d00 msgr2=0x7fa1600b3390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:58.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:58.133+0000 7fa167d11640 1 --2- 172.21.15.132:0/1603536587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa160159d00 0x7fa1600b3390 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7fa15000c7f0 tx=0x7fa15000ccb0 comp rx=0 tx=0).stop 2023-12-20T04:43:58.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:58.133+0000 7fa167d11640 1 -- 172.21.15.132:0/1603536587 shutdown_connections 2023-12-20T04:43:58.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:58.133+0000 7fa167d11640 1 --2- 172.21.15.132:0/1603536587 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa14406a430 0x7fa14406c8f0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:58.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:58.133+0000 7fa167d11640 1 --2- 172.21.15.132:0/1603536587 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa16015df40 0x7fa1600c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:58.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:58.133+0000 7fa167d11640 1 --2- 172.21.15.132:0/1603536587 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa160159d00 0x7fa1600b3390 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:58.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:58.133+0000 7fa167d11640 1 --2- 172.21.15.132:0/1603536587 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1600cafd0 0x7fa1600b08b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:58.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:58.133+0000 7fa167d11640 1 -- 172.21.15.132:0/1603536587 >> 172.21.15.132:0/1603536587 conn(0x7fa1600cfca0 msgr2=0x7fa160154b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:58.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:58.133+0000 7fa167d11640 1 -- 172.21.15.132:0/1603536587 shutdown_connections 2023-12-20T04:43:58.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:58.133+0000 7fa167d11640 1 -- 172.21.15.132:0/1603536587 wait complete. 2023-12-20T04:43:58.145 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json osdmap barrier 35 2023-12-20T04:43:58.259 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-12-20T04:43:58.260 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:43:58.260 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:43:58.260 DEBUG:teuthology.orchestra.run.smithi132:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-20T04:43:58.260 DEBUG:teuthology.orchestra.run.smithi132:> os.fchmod(fd, 0O666) 2023-12-20T04:43:58.260 DEBUG:teuthology.orchestra.run.smithi132:> os.fsync(fd) 2023-12-20T04:43:58.260 DEBUG:teuthology.orchestra.run.smithi132:> os.close(fd) 2023-12-20T04:43:58.260 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:43:58.511 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:43:58.511 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:43:58.511 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:43:58.511 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:43:58.511 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:43:58.511 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:58.511 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:43:58.511 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:43:58.511 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:43:58.511 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:43:58.511 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:58.511 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:43:58.511 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:43:58.512 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:43:58.512 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:43:58.512 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:58.512 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:43:58.512 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:43:58.512 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:43:58.512 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:43:58.512 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:43:58.512 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:43:58.512 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:43:58.512 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:43:58.512 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:58.512 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:43:58.512 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:43:58.627 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.94220.asok 2023-12-20T04:43:58.814 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.94220.asok 2023-12-20T04:43:58.815 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:58.815 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.94220.asok status 2023-12-20T04:43:58.950 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:43:58.950 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:43:58.950 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:43:58.950 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:43:58.950 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:43:58.950 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:43:58.950 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:43:58.950 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "94220", 2023-12-20T04:43:58.950 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:43:58.950 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:58.951 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 2, 2023-12-20T04:43:58.951 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:43:58.951 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 5400, 2023-12-20T04:43:58.951 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:43:58.951 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:43:58.951 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:43:58.951 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 5400 2023-12-20T04:43:58.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:58.951 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:43:58.951 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:43:58.951 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:43:58.951 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 4127227377 2023-12-20T04:43:58.951 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:58.952 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:58.952 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:43:58.952 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:43:58.952 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:43:58.952 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 4127227377 2023-12-20T04:43:58.952 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:58.952 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.5400 192.168.0.1:0/4127227377", 2023-12-20T04:43:58.952 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/4127227377", 2023-12-20T04:43:58.952 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 3, 2023-12-20T04:43:58.952 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 13, 2023-12-20T04:43:58.952 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 35, 2023-12-20T04:43:58.952 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 35, 2023-12-20T04:43:58.952 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:43:58.952 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:43:58.953 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:43:58.958 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:43:58.958 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:43:58.958 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:43:58.958 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:43:58.958 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:43:58.958 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:58.958 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:43:58.958 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:43:58.959 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:43:58.959 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:43:58.959 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:58.959 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:43:58.959 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:43:58.959 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:43:58.959 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:43:58.959 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:58.959 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:43:58.959 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:43:58.959 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:43:58.959 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:43:58.959 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:43:58.959 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:43:58.960 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:43:58.960 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:43:58.960 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:43:58.960 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:43:58.960 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:43:59.036 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.94220.asok 2023-12-20T04:43:59.222 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.94220.asok 2023-12-20T04:43:59.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:43:59.223 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.94220.asok status 2023-12-20T04:43:59.356 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:43:59.356 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:43:59.356 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:43:59.356 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:43:59.356 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:43:59.356 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:43:59.356 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:43:59.356 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "94220", 2023-12-20T04:43:59.356 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:43:59.357 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:59.357 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 2, 2023-12-20T04:43:59.357 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:43:59.357 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 5400, 2023-12-20T04:43:59.357 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:43:59.357 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:43:59.357 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:43:59.357 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 5400 2023-12-20T04:43:59.357 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:59.357 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:43:59.357 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:43:59.357 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:43:59.358 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 4127227377 2023-12-20T04:43:59.358 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:43:59.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:59.358 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:43:59.358 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:43:59.358 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:43:59.358 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 4127227377 2023-12-20T04:43:59.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:43:59.358 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.5400 192.168.0.1:0/4127227377", 2023-12-20T04:43:59.358 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/4127227377", 2023-12-20T04:43:59.358 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 3, 2023-12-20T04:43:59.358 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 13, 2023-12-20T04:43:59.358 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 35, 2023-12-20T04:43:59.358 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 35, 2023-12-20T04:43:59.358 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:43:59.359 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:43:59.359 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:43:59.364 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-20T04:43:59.364 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:43:59.364 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:43:59.408 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:43:59.458 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:43:59.458 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:43:59.458 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:43:59.474 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:43:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.612+0000 7f96d6569640 1 Processor -- start 2023-12-20T04:43:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.612+0000 7f96d6569640 1 -- start start 2023-12-20T04:43:59.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.613+0000 7f96d6569640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f96d013e690 0x7f96d0069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:59.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.613+0000 7f96d6569640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d006a5c0 con 0x7f96d013df60 2023-12-20T04:43:59.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.613+0000 7f96d6569640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96d0141660 con 0x7f96d006a170 2023-12-20T04:43:59.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.613+0000 7f96d6569640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96d0155a30 con 0x7f96d013e690 2023-12-20T04:43:59.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.613+0000 7f96cf7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f96d013e690 0x7f96d0069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:59.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.613+0000 7f96cffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f96d013df60 0x7f96d00caa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44830/0 (socket says 172.21.15.132:44830) 2023-12-20T04:43:59.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.613+0000 7f96cffff640 1 -- 172.21.15.132:0/2402331484 learned_addr learned my addr 172.21.15.132:0/2402331484 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:43:59.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.613+0000 7f96cf7fe640 1 -- 172.21.15.132:0/2402331484 >> v1:172.21.15.187:6789/0 conn(0x7f96d006a170 legacy=0x7f96d00708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:59.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.613+0000 7f96cf7fe640 1 -- 172.21.15.132:0/2402331484 >> v1:172.21.15.132:6789/0 conn(0x7f96d013df60 legacy=0x7f96d00caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:59.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.613+0000 7f96cf7fe640 1 -- 172.21.15.132:0/2402331484 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96d0140ae0 con 0x7f96d013e690 2023-12-20T04:43:59.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.613+0000 7f96ceffd640 1 -- 172.21.15.132:0/2402331484 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1957756734 0 0) 0x7f96c0001290 con 0x7f96d013df60 2023-12-20T04:43:59.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.614+0000 7f96cf7fe640 1 --2- 172.21.15.132:0/2402331484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d013e690 0x7f96d0069c30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f96c40097a0 tx=0x7f96c402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9b9a595afac1f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:59.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.614+0000 7f96ceffd640 1 -- 172.21.15.132:0/2402331484 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c402e070 con 0x7f96d013e690 2023-12-20T04:43:59.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.614+0000 7f96ceffd640 1 -- 172.21.15.132:0/2402331484 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c40315a0 con 0x7f96d013e690 2023-12-20T04:43:59.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.614+0000 7f96ceffd640 1 -- 172.21.15.132:0/2402331484 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4031930 con 0x7f96d013e690 2023-12-20T04:43:59.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.614+0000 7f96d6569640 1 -- 172.21.15.132:0/2402331484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d013e690 msgr2=0x7f96d0069c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:59.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.614+0000 7f96d6569640 1 --2- 172.21.15.132:0/2402331484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d013e690 0x7f96d0069c30 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f96c40097a0 tx=0x7f96c402b840 comp rx=0 tx=0).stop 2023-12-20T04:43:59.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.614+0000 7f96d6569640 1 -- 172.21.15.132:0/2402331484 shutdown_connections 2023-12-20T04:43:59.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.614+0000 7f96d6569640 1 --2- 172.21.15.132:0/2402331484 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d013e690 0x7f96d0069c30 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:59.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.614+0000 7f96d6569640 1 -- 172.21.15.132:0/2402331484 >> 172.21.15.132:0/2402331484 conn(0x7f96d00cfbd0 msgr2=0x7f96d00cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:59.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.614+0000 7f96d6569640 1 -- 172.21.15.132:0/2402331484 shutdown_connections 2023-12-20T04:43:59.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.614+0000 7f96d6569640 1 -- 172.21.15.132:0/2402331484 wait complete. 2023-12-20T04:43:59.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.615+0000 7f96d6569640 1 Processor -- start 2023-12-20T04:43:59.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.616+0000 7f96d6569640 1 -- start start 2023-12-20T04:43:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.616+0000 7f96d6569640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f96d006a170 0x7f96d0158540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.616+0000 7f96d6569640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d013df60 0x7f96d0134d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.616+0000 7f96d6569640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96d013e690 0x7f96d01f22b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.616+0000 7f96d6569640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d0158a80 con 0x7f96d013df60 2023-12-20T04:43:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.616+0000 7f96d6569640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96d00c4c40 con 0x7f96d013e690 2023-12-20T04:43:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.616+0000 7f96d6569640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96d00c5aa0 con 0x7f96d006a170 2023-12-20T04:43:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.616+0000 7f96cf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d013df60 0x7f96d0134d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.616+0000 7f96cf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d013df60 0x7f96d0134d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50742/0 (socket says 172.21.15.132:50742) 2023-12-20T04:43:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.616+0000 7f96cf7fe640 1 -- 172.21.15.132:0/3121282398 learned_addr learned my addr 172.21.15.132:0/3121282398 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.617+0000 7f96d4b06640 1 --2- 172.21.15.132:0/3121282398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96d013e690 0x7f96d01f22b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.617+0000 7f96cffff640 1 --2- 172.21.15.132:0/3121282398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f96d006a170 0x7f96d0158540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.617+0000 7f96cf7fe640 1 -- 172.21.15.132:0/3121282398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f96d006a170 msgr2=0x7f96d0158540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.617+0000 7f96cf7fe640 1 --2- 172.21.15.132:0/3121282398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f96d006a170 0x7f96d0158540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.617+0000 7f96cf7fe640 1 -- 172.21.15.132:0/3121282398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96d013e690 msgr2=0x7f96d01f22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.617+0000 7f96cf7fe640 1 --2- 172.21.15.132:0/3121282398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96d013e690 0x7f96d01f22b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.617+0000 7f96cf7fe640 1 -- 172.21.15.132:0/3121282398 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96c4009400 con 0x7f96d013df60 2023-12-20T04:43:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.617+0000 7f96d4b06640 1 --2- 172.21.15.132:0/3121282398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96d013e690 0x7f96d01f22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.617+0000 7f96cffff640 1 --2- 172.21.15.132:0/3121282398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f96d006a170 0x7f96d0158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:43:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.617+0000 7f96cf7fe640 1 --2- 172.21.15.132:0/3121282398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d013df60 0x7f96d0134d60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f96c40097a0 tx=0x7f96c40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.617+0000 7f96ccff9640 1 -- 172.21.15.132:0/3121282398 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4032840 con 0x7f96d013df60 2023-12-20T04:43:59.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.617+0000 7f96ccff9640 1 -- 172.21.15.132:0/3121282398 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c40329a0 con 0x7f96d013df60 2023-12-20T04:43:59.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.617+0000 7f96d6569640 1 -- 172.21.15.132:0/3121282398 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96d00c4e90 con 0x7f96d013df60 2023-12-20T04:43:59.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.617+0000 7f96ccff9640 1 -- 172.21.15.132:0/3121282398 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4032d50 con 0x7f96d013df60 2023-12-20T04:43:59.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.617+0000 7f96d6569640 1 -- 172.21.15.132:0/3121282398 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96d00c5450 con 0x7f96d013df60 2023-12-20T04:43:59.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.618+0000 7f96d6569640 1 -- 172.21.15.132:0/3121282398 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96d004e840 con 0x7f96d013df60 2023-12-20T04:43:59.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.618+0000 7f96ccff9640 1 -- 172.21.15.132:0/3121282398 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f96c403b3f0 con 0x7f96d013df60 2023-12-20T04:43:59.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.619+0000 7f96ccff9640 1 --2- 172.21.15.132:0/3121282398 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96bc06a430 0x7f96bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:59.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.619+0000 7f96cffff640 1 --2- 172.21.15.132:0/3121282398 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96bc06a430 0x7f96bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:59.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.619+0000 7f96ccff9640 1 -- 172.21.15.132:0/3121282398 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f96c40aaa90 con 0x7f96d013df60 2023-12-20T04:43:59.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.619+0000 7f96cffff640 1 --2- 172.21.15.132:0/3121282398 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96bc06a430 0x7f96bc06c8f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f96c00017b0 tx=0x7f96c0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:59.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.623+0000 7f96ccff9640 1 -- 172.21.15.132:0/3121282398 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f96c4076080 con 0x7f96d013df60 2023-12-20T04:43:59.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.791+0000 7f96d6569640 1 -- 172.21.15.132:0/3121282398 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f96d0141070 con 0x7f96d013df60 2023-12-20T04:43:59.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.792+0000 7f96ccff9640 1 -- 172.21.15.132:0/3121282398 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16149 (secure 0 0 0) 0x7f96c40796a0 con 0x7f96d013df60 2023-12-20T04:43:59.794 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:43:59.794 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":35,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:43:56.805688+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:43:42.932158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-20T04:43:43.361561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:43:59.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.794+0000 7f96d6569640 1 -- 172.21.15.132:0/3121282398 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96bc06a430 msgr2=0x7f96bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:59.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.794+0000 7f96d6569640 1 --2- 172.21.15.132:0/3121282398 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96bc06a430 0x7f96bc06c8f0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f96c00017b0 tx=0x7f96c0009040 comp rx=0 tx=0).stop 2023-12-20T04:43:59.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.794+0000 7f96d6569640 1 -- 172.21.15.132:0/3121282398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d013df60 msgr2=0x7f96d0134d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:59.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.794+0000 7f96d6569640 1 --2- 172.21.15.132:0/3121282398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d013df60 0x7f96d0134d60 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f96c40097a0 tx=0x7f96c40046c0 comp rx=0 tx=0).stop 2023-12-20T04:43:59.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.794+0000 7f96d6569640 1 -- 172.21.15.132:0/3121282398 shutdown_connections 2023-12-20T04:43:59.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.794+0000 7f96d6569640 1 --2- 172.21.15.132:0/3121282398 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96bc06a430 0x7f96bc06c8f0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:59.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.794+0000 7f96d6569640 1 --2- 172.21.15.132:0/3121282398 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96d013e690 0x7f96d01f22b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:59.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.794+0000 7f96d6569640 1 --2- 172.21.15.132:0/3121282398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96d013df60 0x7f96d0134d60 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:59.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.794+0000 7f96d6569640 1 --2- 172.21.15.132:0/3121282398 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f96d006a170 0x7f96d0158540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:59.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.794+0000 7f96d6569640 1 -- 172.21.15.132:0/3121282398 >> 172.21.15.132:0/3121282398 conn(0x7f96d00cfbd0 msgr2=0x7f96d013ea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:59.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.794+0000 7f96d6569640 1 -- 172.21.15.132:0/3121282398 shutdown_connections 2023-12-20T04:43:59.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.794+0000 7f96d6569640 1 -- 172.21.15.132:0/3121282398 wait complete. 2023-12-20T04:43:59.807 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:43:42.932158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:43:43.361561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:43:59.807 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:43:59.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.908+0000 7fd6b3c96640 1 Processor -- start 2023-12-20T04:43:59.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.908+0000 7fd6b3c96640 1 -- start start 2023-12-20T04:43:59.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.909+0000 7fd6b3c96640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6ac15cf60 0x7fd6ac161520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:59.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.909+0000 7fd6b3c96640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6ac06c2a0 0x7fd6ac0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:59.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.909+0000 7fd6b3c96640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6ac161a60 con 0x7fd6ac072c60 2023-12-20T04:43:59.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.909+0000 7fd6b3c96640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6ac06cca0 con 0x7fd6ac15cf60 2023-12-20T04:43:59.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.909+0000 7fd6b3c96640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac0731d0 con 0x7fd6ac06c2a0 2023-12-20T04:43:59.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.909+0000 7fd6b1a32640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6ac15cf60 0x7fd6ac161520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:59.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.909+0000 7fd6b1a32640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6ac15cf60 0x7fd6ac161520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50746/0 (socket says 172.21.15.132:50746) 2023-12-20T04:43:59.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.909+0000 7fd6b1a32640 1 -- 172.21.15.132:0/2394891919 learned_addr learned my addr 172.21.15.132:0/2394891919 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:59.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.909+0000 7fd6b2233640 1 --2- 172.21.15.132:0/2394891919 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6ac06c2a0 0x7fd6ac0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:59.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.910+0000 7fd6b1a32640 1 -- 172.21.15.132:0/2394891919 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6ac06c2a0 msgr2=0x7fd6ac0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:43:59.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.910+0000 7fd6b1a32640 1 --2- 172.21.15.132:0/2394891919 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6ac06c2a0 0x7fd6ac0ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:59.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.910+0000 7fd6b1a32640 1 -- 172.21.15.132:0/2394891919 >> v1:172.21.15.187:6789/0 conn(0x7fd6ac072c60 legacy=0x7fd6ac06bb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:59.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.910+0000 7fd6b1a32640 1 -- 172.21.15.132:0/2394891919 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6ac0ae4d0 con 0x7fd6ac15cf60 2023-12-20T04:43:59.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.910+0000 7fd6b2233640 1 --2- 172.21.15.132:0/2394891919 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6ac06c2a0 0x7fd6ac0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:59.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.910+0000 7fd6b1a32640 1 --2- 172.21.15.132:0/2394891919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6ac15cf60 0x7fd6ac161520 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8009e50 tx=0x7fd6a802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3cbc838805cd5ee9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:59.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.910+0000 7fd6b0a30640 1 -- 172.21.15.132:0/2394891919 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a802cb00 con 0x7fd6ac15cf60 2023-12-20T04:43:59.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.910+0000 7fd6b0a30640 1 -- 172.21.15.132:0/2394891919 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a802cc60 con 0x7fd6ac15cf60 2023-12-20T04:43:59.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.910+0000 7fd6b0a30640 1 -- 172.21.15.132:0/2394891919 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a80343f0 con 0x7fd6ac15cf60 2023-12-20T04:43:59.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.911+0000 7fd6b3c96640 1 -- 172.21.15.132:0/2394891919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6ac15cf60 msgr2=0x7fd6ac161520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:59.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.911+0000 7fd6b3c96640 1 --2- 172.21.15.132:0/2394891919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6ac15cf60 0x7fd6ac161520 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8009e50 tx=0x7fd6a802bf60 comp rx=0 tx=0).stop 2023-12-20T04:43:59.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.911+0000 7fd6b3c96640 1 -- 172.21.15.132:0/2394891919 shutdown_connections 2023-12-20T04:43:59.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.911+0000 7fd6b3c96640 1 --2- 172.21.15.132:0/2394891919 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6ac06c2a0 0x7fd6ac0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:59.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.911+0000 7fd6b3c96640 1 --2- 172.21.15.132:0/2394891919 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6ac15cf60 0x7fd6ac161520 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:59.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.911+0000 7fd6b3c96640 1 -- 172.21.15.132:0/2394891919 >> 172.21.15.132:0/2394891919 conn(0x7fd6ac0cf2d0 msgr2=0x7fd6ac0cf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:43:59.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.911+0000 7fd6b3c96640 1 -- 172.21.15.132:0/2394891919 shutdown_connections 2023-12-20T04:43:59.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.911+0000 7fd6b3c96640 1 -- 172.21.15.132:0/2394891919 wait complete. 2023-12-20T04:43:59.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.912+0000 7fd6b3c96640 1 Processor -- start 2023-12-20T04:43:59.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.912+0000 7fd6b3c96640 1 -- start start 2023-12-20T04:43:59.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.913+0000 7fd6b3c96640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6ac06c2a0 0x7fd6ac154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:59.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.913+0000 7fd6b3c96640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6ac072c60 0x7fd6ac15eed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:59.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.913+0000 7fd6b3c96640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6ac15cf60 0x7fd6ac15f410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:59.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.913+0000 7fd6b3c96640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac0c38d0 con 0x7fd6ac06c2a0 2023-12-20T04:43:59.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.913+0000 7fd6b3c96640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac156210 con 0x7fd6ac15cf60 2023-12-20T04:43:59.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.913+0000 7fd6b3c96640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6ac0c2fa0 con 0x7fd6ac072c60 2023-12-20T04:43:59.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.913+0000 7fd6b1a32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6ac06c2a0 0x7fd6ac154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:59.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.913+0000 7fd6b1a32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6ac06c2a0 0x7fd6ac154950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50752/0 (socket says 172.21.15.132:50752) 2023-12-20T04:43:59.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.913+0000 7fd6b1a32640 1 -- 172.21.15.132:0/3841932352 learned_addr learned my addr 172.21.15.132:0/3841932352 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:43:59.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.913+0000 7fd6b1231640 1 --2- 172.21.15.132:0/3841932352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6ac072c60 0x7fd6ac15eed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:59.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.913+0000 7fd6b2233640 1 --2- 172.21.15.132:0/3841932352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6ac15cf60 0x7fd6ac15f410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:59.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.913+0000 7fd6b1a32640 1 -- 172.21.15.132:0/3841932352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6ac072c60 msgr2=0x7fd6ac15eed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:59.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.913+0000 7fd6b1a32640 1 --2- 172.21.15.132:0/3841932352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6ac072c60 0x7fd6ac15eed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:59.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.913+0000 7fd6b1a32640 1 -- 172.21.15.132:0/3841932352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6ac15cf60 msgr2=0x7fd6ac15f410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:43:59.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.913+0000 7fd6b1a32640 1 --2- 172.21.15.132:0/3841932352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6ac15cf60 0x7fd6ac15f410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:43:59.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.913+0000 7fd6b1a32640 1 -- 172.21.15.132:0/3841932352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6a8009b30 con 0x7fd6ac06c2a0 2023-12-20T04:43:59.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.913+0000 7fd6b1231640 1 --2- 172.21.15.132:0/3841932352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6ac072c60 0x7fd6ac15eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:43:59.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.914+0000 7fd6b1a32640 1 --2- 172.21.15.132:0/3841932352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6ac06c2a0 0x7fd6ac154950 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8000f80 tx=0x7fd6a8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:59.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.914+0000 7fd6a27fc640 1 -- 172.21.15.132:0/3841932352 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a8009510 con 0x7fd6ac06c2a0 2023-12-20T04:43:59.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.914+0000 7fd6a27fc640 1 -- 172.21.15.132:0/3841932352 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6a803e450 con 0x7fd6ac06c2a0 2023-12-20T04:43:59.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.914+0000 7fd6b3c96640 1 -- 172.21.15.132:0/3841932352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6ac0c3280 con 0x7fd6ac06c2a0 2023-12-20T04:43:59.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.914+0000 7fd6a27fc640 1 -- 172.21.15.132:0/3841932352 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6a803e800 con 0x7fd6ac06c2a0 2023-12-20T04:43:59.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.914+0000 7fd6b3c96640 1 -- 172.21.15.132:0/3841932352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6ac0c3d60 con 0x7fd6ac06c2a0 2023-12-20T04:43:59.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.915+0000 7fd6b3c96640 1 -- 172.21.15.132:0/3841932352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6ac04e840 con 0x7fd6ac06c2a0 2023-12-20T04:43:59.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.915+0000 7fd6a27fc640 1 -- 172.21.15.132:0/3841932352 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd6a803e960 con 0x7fd6ac06c2a0 2023-12-20T04:43:59.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.916+0000 7fd6a27fc640 1 --2- 172.21.15.132:0/3841932352 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd69006a460 0x7fd69006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:43:59.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.916+0000 7fd6a27fc640 1 -- 172.21.15.132:0/3841932352 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd6a80ab640 con 0x7fd6ac06c2a0 2023-12-20T04:43:59.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.916+0000 7fd6b1231640 1 --2- 172.21.15.132:0/3841932352 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd69006a460 0x7fd69006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:43:59.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.916+0000 7fd6b1231640 1 --2- 172.21.15.132:0/3841932352 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd69006a460 0x7fd69006c920 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0c61c0 tx=0x7fd69c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:43:59.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:43:59.920+0000 7fd6a27fc640 1 -- 172.21.15.132:0/3841932352 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd6a8076de0 con 0x7fd6ac06c2a0 2023-12-20T04:44:00.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.087+0000 7fd6b3c96640 1 -- 172.21.15.132:0/3841932352 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd6ac161840 con 0x7fd6ac06c2a0 2023-12-20T04:44:00.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.088+0000 7fd6a27fc640 1 -- 172.21.15.132:0/3841932352 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd6a807a400 con 0x7fd6ac06c2a0 2023-12-20T04:44:00.090 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:44:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.090+0000 7fd6b3c96640 1 -- 172.21.15.132:0/3841932352 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd69006a460 msgr2=0x7fd69006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.090+0000 7fd6b3c96640 1 --2- 172.21.15.132:0/3841932352 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd69006a460 0x7fd69006c920 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fd6ac0c61c0 tx=0x7fd69c009040 comp rx=0 tx=0).stop 2023-12-20T04:44:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.090+0000 7fd6b3c96640 1 -- 172.21.15.132:0/3841932352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6ac06c2a0 msgr2=0x7fd6ac154950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.090+0000 7fd6b3c96640 1 --2- 172.21.15.132:0/3841932352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6ac06c2a0 0x7fd6ac154950 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fd6a8000f80 tx=0x7fd6a8004a40 comp rx=0 tx=0).stop 2023-12-20T04:44:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.090+0000 7fd6b3c96640 1 -- 172.21.15.132:0/3841932352 shutdown_connections 2023-12-20T04:44:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.090+0000 7fd6b3c96640 1 --2- 172.21.15.132:0/3841932352 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd69006a460 0x7fd69006c920 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.090+0000 7fd6b3c96640 1 --2- 172.21.15.132:0/3841932352 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6ac15cf60 0x7fd6ac15f410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.090+0000 7fd6b3c96640 1 --2- 172.21.15.132:0/3841932352 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6ac072c60 0x7fd6ac15eed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.090+0000 7fd6b3c96640 1 --2- 172.21.15.132:0/3841932352 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6ac06c2a0 0x7fd6ac154950 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.090+0000 7fd6b3c96640 1 -- 172.21.15.132:0/3841932352 >> 172.21.15.132:0/3841932352 conn(0x7fd6ac0cf2d0 msgr2=0x7fd6ac0ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.090+0000 7fd6b3c96640 1 -- 172.21.15.132:0/3841932352 shutdown_connections 2023-12-20T04:44:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.090+0000 7fd6b3c96640 1 -- 172.21.15.132:0/3841932352 wait complete. 2023-12-20T04:44:00.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:44:00.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.203+0000 7fcfca7ab640 1 Processor -- start 2023-12-20T04:44:00.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.203+0000 7fcfca7ab640 1 -- start start 2023-12-20T04:44:00.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.204+0000 7fcfca7ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcfc415d300 0x7fcfc406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:00.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.204+0000 7fcfca7ab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc406cc90 con 0x7fcfc415cf20 2023-12-20T04:44:00.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.204+0000 7fcfca7ab640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfc40b2f30 con 0x7fcfc40cd4b0 2023-12-20T04:44:00.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.204+0000 7fcfca7ab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfc40b3210 con 0x7fcfc415d300 2023-12-20T04:44:00.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.204+0000 7fcfc37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcfc415d300 0x7fcfc406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:00.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.204+0000 7fcfc37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcfc415d300 0x7fcfc406c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50754/0 (socket says 172.21.15.132:50754) 2023-12-20T04:44:00.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.204+0000 7fcfc37fe640 1 -- 172.21.15.132:0/4155653590 learned_addr learned my addr 172.21.15.132:0/4155653590 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:00.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.204+0000 7fcfc3fff640 1 --1- 172.21.15.132:0/4155653590 >> v1:172.21.15.132:6789/0 conn(0x7fcfc415cf20 0x7fcfc4161700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44840/0 (socket says 172.21.15.132:44840) 2023-12-20T04:44:00.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.204+0000 7fcfc37fe640 1 -- 172.21.15.132:0/4155653590 >> v1:172.21.15.187:6789/0 conn(0x7fcfc40cd4b0 legacy=0x7fcfc40d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.204+0000 7fcfc37fe640 1 -- 172.21.15.132:0/4155653590 >> v1:172.21.15.132:6789/0 conn(0x7fcfc415cf20 legacy=0x7fcfc4161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.204+0000 7fcfc37fe640 1 -- 172.21.15.132:0/4155653590 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc40b34f0 con 0x7fcfc415d300 2023-12-20T04:44:00.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.205+0000 7fcfc37fe640 1 --2- 172.21.15.132:0/4155653590 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc415d300 0x7fcfc406c590 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009870 tx=0x7fcfb402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=345edbb2add8921d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:00.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.205+0000 7fcfc2ffd640 1 -- 172.21.15.132:0/4155653590 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb402f840 con 0x7fcfc415d300 2023-12-20T04:44:00.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.205+0000 7fcfc2ffd640 1 -- 172.21.15.132:0/4155653590 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfb402f9a0 con 0x7fcfc415d300 2023-12-20T04:44:00.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.205+0000 7fcfc2ffd640 1 -- 172.21.15.132:0/4155653590 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfb402fd30 con 0x7fcfc415d300 2023-12-20T04:44:00.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.205+0000 7fcfca7ab640 1 -- 172.21.15.132:0/4155653590 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc415d300 msgr2=0x7fcfc406c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.205+0000 7fcfca7ab640 1 --2- 172.21.15.132:0/4155653590 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc415d300 0x7fcfc406c590 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fcfb4009870 tx=0x7fcfb402ba20 comp rx=0 tx=0).stop 2023-12-20T04:44:00.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.205+0000 7fcfca7ab640 1 -- 172.21.15.132:0/4155653590 shutdown_connections 2023-12-20T04:44:00.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.205+0000 7fcfca7ab640 1 --2- 172.21.15.132:0/4155653590 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc415d300 0x7fcfc406c590 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.205+0000 7fcfca7ab640 1 -- 172.21.15.132:0/4155653590 >> 172.21.15.132:0/4155653590 conn(0x7fcfc4072c60 msgr2=0x7fcfc4073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:00.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.205+0000 7fcfca7ab640 1 -- 172.21.15.132:0/4155653590 shutdown_connections 2023-12-20T04:44:00.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.205+0000 7fcfca7ab640 1 -- 172.21.15.132:0/4155653590 wait complete. 2023-12-20T04:44:00.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.207+0000 7fcfca7ab640 1 Processor -- start 2023-12-20T04:44:00.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.207+0000 7fcfca7ab640 1 -- start start 2023-12-20T04:44:00.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.207+0000 7fcfca7ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc40cd4b0 0x7fcfc414b1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:00.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.207+0000 7fcfca7ab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc415cf20 0x7fcfc40af200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:00.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.207+0000 7fcfca7ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc415d300 0x7fcfc414b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:00.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.207+0000 7fcfca7ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc40c5ce0 con 0x7fcfc415d300 2023-12-20T04:44:00.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.207+0000 7fcfca7ab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc40c5fc0 con 0x7fcfc415cf20 2023-12-20T04:44:00.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.207+0000 7fcfca7ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc40c62a0 con 0x7fcfc40cd4b0 2023-12-20T04:44:00.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.208+0000 7fcfc8d48640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc415d300 0x7fcfc414b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:00.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.208+0000 7fcfc8d48640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc415d300 0x7fcfc414b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50758/0 (socket says 172.21.15.132:50758) 2023-12-20T04:44:00.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.208+0000 7fcfc8d48640 1 -- 172.21.15.132:0/3727242736 learned_addr learned my addr 172.21.15.132:0/3727242736 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:00.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.208+0000 7fcfc3fff640 1 --2- 172.21.15.132:0/3727242736 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc40cd4b0 0x7fcfc414b1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:00.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.208+0000 7fcfc37fe640 1 --2- 172.21.15.132:0/3727242736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc415cf20 0x7fcfc40af200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:00.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.208+0000 7fcfc8d48640 1 -- 172.21.15.132:0/3727242736 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc40cd4b0 msgr2=0x7fcfc414b1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.208+0000 7fcfc8d48640 1 --2- 172.21.15.132:0/3727242736 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc40cd4b0 0x7fcfc414b1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.208+0000 7fcfc8d48640 1 -- 172.21.15.132:0/3727242736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc415cf20 msgr2=0x7fcfc40af200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.208+0000 7fcfc8d48640 1 --2- 172.21.15.132:0/3727242736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc415cf20 0x7fcfc40af200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.208+0000 7fcfc8d48640 1 -- 172.21.15.132:0/3727242736 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfb40094d0 con 0x7fcfc415d300 2023-12-20T04:44:00.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.208+0000 7fcfc37fe640 1 --2- 172.21.15.132:0/3727242736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc415cf20 0x7fcfc40af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:00.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.208+0000 7fcfc8d48640 1 --2- 172.21.15.132:0/3727242736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc415d300 0x7fcfc414b9d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00c7a0 tx=0x7fcfbc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:00.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.208+0000 7fcfc0ff9640 1 -- 172.21.15.132:0/3727242736 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc003b70 con 0x7fcfc415d300 2023-12-20T04:44:00.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.208+0000 7fcfc0ff9640 1 -- 172.21.15.132:0/3727242736 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfbc003cf0 con 0x7fcfc415d300 2023-12-20T04:44:00.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.208+0000 7fcfca7ab640 1 -- 172.21.15.132:0/3727242736 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfc40c6580 con 0x7fcfc415d300 2023-12-20T04:44:00.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.208+0000 7fcfc0ff9640 1 -- 172.21.15.132:0/3727242736 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfbc003ea0 con 0x7fcfc415d300 2023-12-20T04:44:00.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.208+0000 7fcfca7ab640 1 -- 172.21.15.132:0/3727242736 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfc40af740 con 0x7fcfc415d300 2023-12-20T04:44:00.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.209+0000 7fcfca7ab640 1 -- 172.21.15.132:0/3727242736 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfc40c6aa0 con 0x7fcfc415d300 2023-12-20T04:44:00.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.210+0000 7fcfc0ff9640 1 -- 172.21.15.132:0/3727242736 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcfbc00aa90 con 0x7fcfc415d300 2023-12-20T04:44:00.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.210+0000 7fcfc0ff9640 1 --2- 172.21.15.132:0/3727242736 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfb006a430 0x7fcfb006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:00.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.210+0000 7fcfc0ff9640 1 -- 172.21.15.132:0/3727242736 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfbc0887b0 con 0x7fcfc415d300 2023-12-20T04:44:00.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.210+0000 7fcfc3fff640 1 --2- 172.21.15.132:0/3727242736 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfb006a430 0x7fcfb006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:00.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.211+0000 7fcfc3fff640 1 --2- 172.21.15.132:0/3727242736 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfb006a430 0x7fcfb006c8f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8000f60 tx=0x7fcfb8007c80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:00.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.214+0000 7fcfc0ff9640 1 -- 172.21.15.132:0/3727242736 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcfc40c6aa0 con 0x7fcfc415d300 2023-12-20T04:44:00.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.379+0000 7fcfca7ab640 1 -- 172.21.15.132:0/3727242736 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcfc40c6aa0 con 0x7fcfc415d300 2023-12-20T04:44:00.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.379+0000 7fcfc0ff9640 1 -- 172.21.15.132:0/3727242736 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcfc40c6aa0 con 0x7fcfc415d300 2023-12-20T04:44:00.381 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:44:00.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.381+0000 7fcfca7ab640 1 -- 172.21.15.132:0/3727242736 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfb006a430 msgr2=0x7fcfb006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.381+0000 7fcfca7ab640 1 --2- 172.21.15.132:0/3727242736 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfb006a430 0x7fcfb006c8f0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7fcfb8000f60 tx=0x7fcfb8007c80 comp rx=0 tx=0).stop 2023-12-20T04:44:00.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.381+0000 7fcfca7ab640 1 -- 172.21.15.132:0/3727242736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc415d300 msgr2=0x7fcfc414b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.381+0000 7fcfca7ab640 1 --2- 172.21.15.132:0/3727242736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc415d300 0x7fcfc414b9d0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fcfbc00c7a0 tx=0x7fcfbc00cc60 comp rx=0 tx=0).stop 2023-12-20T04:44:00.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.381+0000 7fcfca7ab640 1 -- 172.21.15.132:0/3727242736 shutdown_connections 2023-12-20T04:44:00.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.381+0000 7fcfca7ab640 1 --2- 172.21.15.132:0/3727242736 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfb006a430 0x7fcfb006c8f0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.381+0000 7fcfca7ab640 1 --2- 172.21.15.132:0/3727242736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc415d300 0x7fcfc414b9d0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.381+0000 7fcfca7ab640 1 --2- 172.21.15.132:0/3727242736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc415cf20 0x7fcfc40af200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.381+0000 7fcfca7ab640 1 --2- 172.21.15.132:0/3727242736 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc40cd4b0 0x7fcfc414b1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.381+0000 7fcfca7ab640 1 -- 172.21.15.132:0/3727242736 >> 172.21.15.132:0/3727242736 conn(0x7fcfc4072c60 msgr2=0x7fcfc415c130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:00.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.381+0000 7fcfca7ab640 1 -- 172.21.15.132:0/3727242736 shutdown_connections 2023-12-20T04:44:00.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.381+0000 7fcfca7ab640 1 -- 172.21.15.132:0/3727242736 wait complete. 2023-12-20T04:44:00.394 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:44:00.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.495+0000 7f7f37999640 1 Processor -- start 2023-12-20T04:44:00.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.496+0000 7f7f37999640 1 -- start start 2023-12-20T04:44:00.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.496+0000 7f7f37999640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7f300cf790 0x7f7f300cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:00.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.496+0000 7f7f37999640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f300b6080 0x7f7f300b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:00.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.496+0000 7f7f37999640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f300d2920 con 0x7f7f3015d300 2023-12-20T04:44:00.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.496+0000 7f7f37999640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f300d0180 con 0x7f7f300cf790 2023-12-20T04:44:00.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.496+0000 7f7f37999640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f300d1d10 con 0x7f7f300b6080 2023-12-20T04:44:00.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.496+0000 7f7f34f34640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7f300cf790 0x7f7f300cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:00.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.496+0000 7f7f35735640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7f3015d300 0x7f7f300d1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44856/0 (socket says 172.21.15.132:44856) 2023-12-20T04:44:00.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.496+0000 7f7f35735640 1 -- 172.21.15.132:0/3938913517 learned_addr learned my addr 172.21.15.132:0/3938913517 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:00.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.497+0000 7f7f34f34640 1 -- 172.21.15.132:0/3938913517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f300b6080 msgr2=0x7f7f300b64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:00.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.497+0000 7f7f35f36640 1 --2- 172.21.15.132:0/3938913517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f300b6080 0x7f7f300b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:00.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.497+0000 7f7f34f34640 1 --2- 172.21.15.132:0/3938913517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f300b6080 0x7f7f300b64b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.497+0000 7f7f27fff640 1 -- 172.21.15.132:0/3938913517 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2259809637 0 0) 0x7f7f300d2920 con 0x7f7f3015d300 2023-12-20T04:44:00.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.497+0000 7f7f34f34640 1 -- 172.21.15.132:0/3938913517 >> v1:172.21.15.132:6789/0 conn(0x7f7f3015d300 legacy=0x7f7f300d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.497+0000 7f7f34f34640 1 -- 172.21.15.132:0/3938913517 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f300d1ff0 con 0x7f7f300cf790 2023-12-20T04:44:00.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.497+0000 7f7f34f34640 1 --2- 172.21.15.132:0/3938913517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f300cf790 0x7f7f300cfc40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7f200097a0 tx=0x7f7f2002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1329400fa5ec2c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:00.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.498+0000 7f7f27fff640 1 -- 172.21.15.132:0/3938913517 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f20031830 con 0x7f7f300cf790 2023-12-20T04:44:00.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.498+0000 7f7f27fff640 1 -- 172.21.15.132:0/3938913517 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f20031990 con 0x7f7f300cf790 2023-12-20T04:44:00.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.498+0000 7f7f27fff640 1 -- 172.21.15.132:0/3938913517 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f20031d20 con 0x7f7f300cf790 2023-12-20T04:44:00.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.498+0000 7f7f37999640 1 -- 172.21.15.132:0/3938913517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f300cf790 msgr2=0x7f7f300cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.498+0000 7f7f37999640 1 --2- 172.21.15.132:0/3938913517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f300cf790 0x7f7f300cfc40 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f7f200097a0 tx=0x7f7f2002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.498+0000 7f7f37999640 1 -- 172.21.15.132:0/3938913517 shutdown_connections 2023-12-20T04:44:00.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.498+0000 7f7f37999640 1 --2- 172.21.15.132:0/3938913517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f300b6080 0x7f7f300b64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.498+0000 7f7f37999640 1 --2- 172.21.15.132:0/3938913517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f300cf790 0x7f7f300cfc40 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.498+0000 7f7f37999640 1 -- 172.21.15.132:0/3938913517 >> 172.21.15.132:0/3938913517 conn(0x7f7f3006a3d0 msgr2=0x7f7f3006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:00.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.498+0000 7f7f37999640 1 -- 172.21.15.132:0/3938913517 shutdown_connections 2023-12-20T04:44:00.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.498+0000 7f7f37999640 1 -- 172.21.15.132:0/3938913517 wait complete. 2023-12-20T04:44:00.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.499+0000 7f7f37999640 1 Processor -- start 2023-12-20T04:44:00.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.499+0000 7f7f37999640 1 -- start start 2023-12-20T04:44:00.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.500+0000 7f7f37999640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f300b6080 0x7f7f30158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:00.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.500+0000 7f7f37999640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f300cf790 0x7f7f300c8560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:00.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.500+0000 7f7f37999640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f3015d300 0x7f7f300c8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:00.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.500+0000 7f7f37999640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f30149aa0 con 0x7f7f300cf790 2023-12-20T04:44:00.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.500+0000 7f7f37999640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f30149d80 con 0x7f7f3015d300 2023-12-20T04:44:00.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.500+0000 7f7f37999640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f3014a060 con 0x7f7f300b6080 2023-12-20T04:44:00.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.500+0000 7f7f34f34640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f300cf790 0x7f7f300c8560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:00.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.500+0000 7f7f34f34640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f300cf790 0x7f7f300c8560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50776/0 (socket says 172.21.15.132:50776) 2023-12-20T04:44:00.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.500+0000 7f7f34f34640 1 -- 172.21.15.132:0/3864392417 learned_addr learned my addr 172.21.15.132:0/3864392417 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:00.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.500+0000 7f7f35735640 1 --2- 172.21.15.132:0/3864392417 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f300b6080 0x7f7f30158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:00.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.500+0000 7f7f35f36640 1 --2- 172.21.15.132:0/3864392417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f3015d300 0x7f7f300c8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:00.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.501+0000 7f7f34f34640 1 -- 172.21.15.132:0/3864392417 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f300b6080 msgr2=0x7f7f30158460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.501+0000 7f7f34f34640 1 --2- 172.21.15.132:0/3864392417 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f300b6080 0x7f7f30158460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.501+0000 7f7f34f34640 1 -- 172.21.15.132:0/3864392417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f3015d300 msgr2=0x7f7f300c8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.501+0000 7f7f34f34640 1 --2- 172.21.15.132:0/3864392417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f3015d300 0x7f7f300c8aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.501+0000 7f7f34f34640 1 -- 172.21.15.132:0/3864392417 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f20009400 con 0x7f7f300cf790 2023-12-20T04:44:00.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.501+0000 7f7f35f36640 1 --2- 172.21.15.132:0/3864392417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f3015d300 0x7f7f300c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:00.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.501+0000 7f7f34f34640 1 --2- 172.21.15.132:0/3864392417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f300cf790 0x7f7f300c8560 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7f20000c00 tx=0x7f7f200046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:00.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.501+0000 7f7f25ffb640 1 -- 172.21.15.132:0/3864392417 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f20004230 con 0x7f7f300cf790 2023-12-20T04:44:00.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.501+0000 7f7f25ffb640 1 -- 172.21.15.132:0/3864392417 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f20004390 con 0x7f7f300cf790 2023-12-20T04:44:00.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.501+0000 7f7f25ffb640 1 -- 172.21.15.132:0/3864392417 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f2003a920 con 0x7f7f300cf790 2023-12-20T04:44:00.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.501+0000 7f7f37999640 1 -- 172.21.15.132:0/3864392417 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f3014a340 con 0x7f7f300cf790 2023-12-20T04:44:00.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.501+0000 7f7f37999640 1 -- 172.21.15.132:0/3864392417 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f30158b80 con 0x7f7f300cf790 2023-12-20T04:44:00.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.502+0000 7f7f37999640 1 -- 172.21.15.132:0/3864392417 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f3014a860 con 0x7f7f300cf790 2023-12-20T04:44:00.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.502+0000 7f7f25ffb640 1 -- 172.21.15.132:0/3864392417 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7f2003aa80 con 0x7f7f300cf790 2023-12-20T04:44:00.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.503+0000 7f7f25ffb640 1 --2- 172.21.15.132:0/3864392417 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7f1406a460 0x7f7f1406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:00.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.503+0000 7f7f25ffb640 1 -- 172.21.15.132:0/3864392417 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7f200aafe0 con 0x7f7f300cf790 2023-12-20T04:44:00.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.503+0000 7f7f35735640 1 --2- 172.21.15.132:0/3864392417 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7f1406a460 0x7f7f1406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:00.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.503+0000 7f7f35735640 1 --2- 172.21.15.132:0/3864392417 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7f1406a460 0x7f7f1406c920 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7f280012e0 tx=0x7f7f28001700 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:00.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.507+0000 7f7f25ffb640 1 -- 172.21.15.132:0/3864392417 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7f3014a860 con 0x7f7f300cf790 2023-12-20T04:44:00.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.671+0000 7f7f37999640 1 -- 172.21.15.132:0/3864392417 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7f30158b80 con 0x7f7f300cf790 2023-12-20T04:44:00.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.672+0000 7f7f25ffb640 1 -- 172.21.15.132:0/3864392417 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7f30158b80 con 0x7f7f300cf790 2023-12-20T04:44:00.674 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:44:00.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.673+0000 7f7f37999640 1 -- 172.21.15.132:0/3864392417 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7f1406a460 msgr2=0x7f7f1406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.673+0000 7f7f37999640 1 --2- 172.21.15.132:0/3864392417 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7f1406a460 0x7f7f1406c920 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f7f280012e0 tx=0x7f7f28001700 comp rx=0 tx=0).stop 2023-12-20T04:44:00.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.673+0000 7f7f37999640 1 -- 172.21.15.132:0/3864392417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f300cf790 msgr2=0x7f7f300c8560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.673+0000 7f7f37999640 1 --2- 172.21.15.132:0/3864392417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f300cf790 0x7f7f300c8560 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f7f20000c00 tx=0x7f7f200046c0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.673+0000 7f7f37999640 1 -- 172.21.15.132:0/3864392417 shutdown_connections 2023-12-20T04:44:00.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.673+0000 7f7f37999640 1 --2- 172.21.15.132:0/3864392417 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7f1406a460 0x7f7f1406c920 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.673+0000 7f7f37999640 1 --2- 172.21.15.132:0/3864392417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f3015d300 0x7f7f300c8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.673+0000 7f7f37999640 1 --2- 172.21.15.132:0/3864392417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f300cf790 0x7f7f300c8560 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.673+0000 7f7f37999640 1 --2- 172.21.15.132:0/3864392417 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f300b6080 0x7f7f30158460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.673+0000 7f7f37999640 1 -- 172.21.15.132:0/3864392417 >> 172.21.15.132:0/3864392417 conn(0x7f7f3006a3d0 msgr2=0x7f7f300b64b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:00.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.673+0000 7f7f37999640 1 -- 172.21.15.132:0/3864392417 shutdown_connections 2023-12-20T04:44:00.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.674+0000 7f7f37999640 1 -- 172.21.15.132:0/3864392417 wait complete. 2023-12-20T04:44:00.686 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:44:00.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.785+0000 7fb02393e640 1 Processor -- start 2023-12-20T04:44:00.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.785+0000 7fb02393e640 1 -- start start 2023-12-20T04:44:00.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.786+0000 7fb02393e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb01c0cbb20 0x7fb01c0cad30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:00.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.786+0000 7fb02393e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb01c0adfb0 0x7fb01c0c9100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:00.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.786+0000 7fb02393e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb01c06b490 con 0x7fb01c159410 2023-12-20T04:44:00.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.786+0000 7fb02393e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c0ae420 con 0x7fb01c0adfb0 2023-12-20T04:44:00.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.786+0000 7fb02393e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb01c0add90 con 0x7fb01c0cbb20 2023-12-20T04:44:00.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.786+0000 7fb021edb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb01c0adfb0 0x7fb01c0c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:00.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.786+0000 7fb021edb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb01c0adfb0 0x7fb01c0c9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50784/0 (socket says 172.21.15.132:50784) 2023-12-20T04:44:00.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.786+0000 7fb021edb640 1 -- 172.21.15.132:0/3097217667 learned_addr learned my addr 172.21.15.132:0/3097217667 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:00.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.786+0000 7fb020ed9640 1 --2- 172.21.15.132:0/3097217667 >> v2:172.21.15.187:3300/0 conn(0x7fb01c0cbb20 0x7fb01c0cad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:00.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.786+0000 7fb021edb640 1 -- 172.21.15.132:0/3097217667 >> v2:172.21.15.187:3300/0 conn(0x7fb01c0cbb20 msgr2=0x7fb01c0cad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:00.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.786+0000 7fb021edb640 1 --2- 172.21.15.132:0/3097217667 >> v2:172.21.15.187:3300/0 conn(0x7fb01c0cbb20 0x7fb01c0cad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.786+0000 7fb021edb640 1 -- 172.21.15.132:0/3097217667 >> v1:172.21.15.187:6789/0 conn(0x7fb01c159410 legacy=0x7fb01c0cb410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.786+0000 7fb021edb640 1 -- 172.21.15.132:0/3097217667 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb01c06b6e0 con 0x7fb01c0adfb0 2023-12-20T04:44:00.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.787+0000 7fb021edb640 1 --2- 172.21.15.132:0/3097217667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb01c0adfb0 0x7fb01c0c9100 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0ce710 tx=0x7fb01402c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=889307cab7803e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:00.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.787+0000 7fb00ffff640 1 -- 172.21.15.132:0/3097217667 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb01402cbb0 con 0x7fb01c0adfb0 2023-12-20T04:44:00.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.787+0000 7fb00ffff640 1 -- 172.21.15.132:0/3097217667 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb01402cd10 con 0x7fb01c0adfb0 2023-12-20T04:44:00.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.787+0000 7fb00ffff640 1 -- 172.21.15.132:0/3097217667 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb014034610 con 0x7fb01c0adfb0 2023-12-20T04:44:00.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.787+0000 7fb02393e640 1 -- 172.21.15.132:0/3097217667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb01c0adfb0 msgr2=0x7fb01c0c9100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.787+0000 7fb02393e640 1 --2- 172.21.15.132:0/3097217667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb01c0adfb0 0x7fb01c0c9100 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0ce710 tx=0x7fb01402c010 comp rx=0 tx=0).stop 2023-12-20T04:44:00.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.788+0000 7fb02393e640 1 -- 172.21.15.132:0/3097217667 shutdown_connections 2023-12-20T04:44:00.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.788+0000 7fb02393e640 1 --2- 172.21.15.132:0/3097217667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb01c0adfb0 0x7fb01c0c9100 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.788+0000 7fb02393e640 1 --2- 172.21.15.132:0/3097217667 >> v2:172.21.15.187:3300/0 conn(0x7fb01c0cbb20 0x7fb01c0cad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.788+0000 7fb02393e640 1 -- 172.21.15.132:0/3097217667 >> 172.21.15.132:0/3097217667 conn(0x7fb01c06a260 msgr2=0x7fb01c0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:00.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.788+0000 7fb02393e640 1 -- 172.21.15.132:0/3097217667 shutdown_connections 2023-12-20T04:44:00.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.788+0000 7fb02393e640 1 -- 172.21.15.132:0/3097217667 wait complete. 2023-12-20T04:44:00.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.789+0000 7fb02393e640 1 Processor -- start 2023-12-20T04:44:00.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.789+0000 7fb02393e640 1 -- start start 2023-12-20T04:44:00.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.789+0000 7fb02393e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb01c0adfb0 0x7fb01c06fb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:00.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.789+0000 7fb02393e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb01c0cbb20 0x7fb01c1509b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:00.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.789+0000 7fb02393e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01c159410 0x7fb01c150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:00.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.789+0000 7fb02393e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c0c69c0 con 0x7fb01c0adfb0 2023-12-20T04:44:00.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.789+0000 7fb02393e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c15bec0 con 0x7fb01c0cbb20 2023-12-20T04:44:00.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.789+0000 7fb02393e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb01c15b100 con 0x7fb01c159410 2023-12-20T04:44:00.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.790+0000 7fb0216da640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb01c0adfb0 0x7fb01c06fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:00.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.790+0000 7fb0216da640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb01c0adfb0 0x7fb01c06fb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50786/0 (socket says 172.21.15.132:50786) 2023-12-20T04:44:00.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.790+0000 7fb0216da640 1 -- 172.21.15.132:0/2393199305 learned_addr learned my addr 172.21.15.132:0/2393199305 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:00.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.790+0000 7fb020ed9640 1 --2- 172.21.15.132:0/2393199305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb01c0cbb20 0x7fb01c1509b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:00.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.790+0000 7fb021edb640 1 --2- 172.21.15.132:0/2393199305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01c159410 0x7fb01c150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:00.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.790+0000 7fb0216da640 1 -- 172.21.15.132:0/2393199305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01c159410 msgr2=0x7fb01c150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.790+0000 7fb0216da640 1 --2- 172.21.15.132:0/2393199305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01c159410 0x7fb01c150ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.790+0000 7fb0216da640 1 -- 172.21.15.132:0/2393199305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb01c0cbb20 msgr2=0x7fb01c1509b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.790+0000 7fb0216da640 1 --2- 172.21.15.132:0/2393199305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb01c0cbb20 0x7fb01c1509b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.790+0000 7fb0216da640 1 -- 172.21.15.132:0/2393199305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb014009b30 con 0x7fb01c0adfb0 2023-12-20T04:44:00.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.790+0000 7fb0216da640 1 --2- 172.21.15.132:0/2393199305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb01c0adfb0 0x7fb01c06fb40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb01800c400 tx=0x7fb01800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:00.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.790+0000 7fb00dffb640 1 -- 172.21.15.132:0/2393199305 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0180052d0 con 0x7fb01c0adfb0 2023-12-20T04:44:00.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.790+0000 7fb00dffb640 1 -- 172.21.15.132:0/2393199305 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb018005430 con 0x7fb01c0adfb0 2023-12-20T04:44:00.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.790+0000 7fb00dffb640 1 -- 172.21.15.132:0/2393199305 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb018003830 con 0x7fb01c0adfb0 2023-12-20T04:44:00.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.790+0000 7fb02393e640 1 -- 172.21.15.132:0/2393199305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb01c15b3e0 con 0x7fb01c0adfb0 2023-12-20T04:44:00.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.790+0000 7fb02393e640 1 -- 172.21.15.132:0/2393199305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb01c15b9a0 con 0x7fb01c0adfb0 2023-12-20T04:44:00.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.791+0000 7fb02393e640 1 -- 172.21.15.132:0/2393199305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb01c04e840 con 0x7fb01c0adfb0 2023-12-20T04:44:00.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.792+0000 7fb00dffb640 1 -- 172.21.15.132:0/2393199305 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb018003990 con 0x7fb01c0adfb0 2023-12-20T04:44:00.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.792+0000 7fb00dffb640 1 --2- 172.21.15.132:0/2393199305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb00006a430 0x7fb00006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:00.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.792+0000 7fb00dffb640 1 -- 172.21.15.132:0/2393199305 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb018087ec0 con 0x7fb01c0adfb0 2023-12-20T04:44:00.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.792+0000 7fb020ed9640 1 --2- 172.21.15.132:0/2393199305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb00006a430 0x7fb00006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:00.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.792+0000 7fb020ed9640 1 --2- 172.21.15.132:0/2393199305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb00006a430 0x7fb00006c8f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0c6d30 tx=0x7fb010008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:00.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.796+0000 7fb00dffb640 1 -- 172.21.15.132:0/2393199305 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb0180534b0 con 0x7fb01c0adfb0 2023-12-20T04:44:00.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.977+0000 7fb02393e640 1 -- 172.21.15.132:0/2393199305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fb01c06cb60 con 0x7fb01c0adfb0 2023-12-20T04:44:00.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.977+0000 7fb00dffb640 1 -- 172.21.15.132:0/2393199305 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7fb018056ad0 con 0x7fb01c0adfb0 2023-12-20T04:44:00.979 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:44:00.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.979+0000 7fb02393e640 1 -- 172.21.15.132:0/2393199305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb00006a430 msgr2=0x7fb00006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.979+0000 7fb02393e640 1 --2- 172.21.15.132:0/2393199305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb00006a430 0x7fb00006c8f0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fb01c0c6d30 tx=0x7fb010008040 comp rx=0 tx=0).stop 2023-12-20T04:44:00.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.979+0000 7fb02393e640 1 -- 172.21.15.132:0/2393199305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb01c0adfb0 msgr2=0x7fb01c06fb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:00.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.979+0000 7fb02393e640 1 --2- 172.21.15.132:0/2393199305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb01c0adfb0 0x7fb01c06fb40 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7fb01800c400 tx=0x7fb01800c8c0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.979+0000 7fb02393e640 1 -- 172.21.15.132:0/2393199305 shutdown_connections 2023-12-20T04:44:00.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.979+0000 7fb02393e640 1 --2- 172.21.15.132:0/2393199305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb00006a430 0x7fb00006c8f0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.979+0000 7fb02393e640 1 --2- 172.21.15.132:0/2393199305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb01c159410 0x7fb01c150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.979+0000 7fb02393e640 1 --2- 172.21.15.132:0/2393199305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb01c0cbb20 0x7fb01c1509b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.979+0000 7fb02393e640 1 --2- 172.21.15.132:0/2393199305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb01c0adfb0 0x7fb01c06fb40 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:00.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.979+0000 7fb02393e640 1 -- 172.21.15.132:0/2393199305 >> 172.21.15.132:0/2393199305 conn(0x7fb01c06a260 msgr2=0x7fb01c0c4790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:00.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.979+0000 7fb02393e640 1 -- 172.21.15.132:0/2393199305 shutdown_connections 2023-12-20T04:44:00.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:00.979+0000 7fb02393e640 1 -- 172.21.15.132:0/2393199305 wait complete. 2023-12-20T04:44:00.992 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2023-12-20T04:44:00.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:00.992 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-20T04:44:01.017 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[94220]: fuse finished with error 0 and tester_r 0 2023-12-20T04:44:01.019 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:44:01.019 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:01.019 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-20T04:44:01.091 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:44:01.092 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:44:01.110 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:44:01.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.230+0000 7f5bfd41e640 1 Processor -- start 2023-12-20T04:44:01.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.230+0000 7f5bfd41e640 1 -- start start 2023-12-20T04:44:01.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.231+0000 7f5bfd41e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5bf8160450 0x7f5bf8160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.231+0000 7f5bfd41e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5bf81611b0 0x7f5bf80b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.231+0000 7f5bfd41e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bf80b4ec0 0x7f5bf806a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.231+0000 7f5bfd41e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf80b5350 con 0x7f5bf81611b0 2023-12-20T04:44:01.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.231+0000 7f5bfd41e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5bf80b5ec0 con 0x7f5bf8160450 2023-12-20T04:44:01.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.231+0000 7f5bfd41e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf81617e0 con 0x7f5bf80b4ec0 2023-12-20T04:44:01.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.231+0000 7f5bf67fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5bf81611b0 0x7f5bf80b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.231+0000 7f5bf67fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5bf81611b0 0x7f5bf80b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50790/0 (socket says 172.21.15.132:50790) 2023-12-20T04:44:01.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.231+0000 7f5bf67fc640 1 -- 172.21.15.132:0/1316556608 learned_addr learned my addr 172.21.15.132:0/1316556608 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:01.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.231+0000 7f5bf67fc640 1 -- 172.21.15.132:0/1316556608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bf80b4ec0 msgr2=0x7f5bf806a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:01.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.231+0000 7f5bf67fc640 1 --2- 172.21.15.132:0/1316556608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bf80b4ec0 0x7f5bf806a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.231+0000 7f5bf67fc640 1 -- 172.21.15.132:0/1316556608 >> v2:172.21.15.187:3300/0 conn(0x7f5bf8160450 msgr2=0x7f5bf8160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:01.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.231+0000 7f5bf6ffd640 1 --2- 172.21.15.132:0/1316556608 >> v2:172.21.15.187:3300/0 conn(0x7f5bf8160450 0x7f5bf8160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.231+0000 7f5bf67fc640 1 --2- 172.21.15.132:0/1316556608 >> v2:172.21.15.187:3300/0 conn(0x7f5bf8160450 0x7f5bf8160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.231+0000 7f5bf67fc640 1 -- 172.21.15.132:0/1316556608 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf80d0fc0 con 0x7f5bf81611b0 2023-12-20T04:44:01.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.232+0000 7f5bf67fc640 1 --2- 172.21.15.132:0/1316556608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bf81611b0 0x7f5bf80b4980 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5bf808b150 tx=0x7f5bec02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f060e5b0918f7f39 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:01.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.232+0000 7f5bf5ffb640 1 -- 172.21.15.132:0/1316556608 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec030860 con 0x7f5bf81611b0 2023-12-20T04:44:01.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.232+0000 7f5bf5ffb640 1 -- 172.21.15.132:0/1316556608 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5bec0309c0 con 0x7f5bf81611b0 2023-12-20T04:44:01.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.232+0000 7f5bf5ffb640 1 -- 172.21.15.132:0/1316556608 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5bec030d50 con 0x7f5bf81611b0 2023-12-20T04:44:01.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.233+0000 7f5bfd41e640 1 -- 172.21.15.132:0/1316556608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bf81611b0 msgr2=0x7f5bf80b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.233+0000 7f5bfd41e640 1 --2- 172.21.15.132:0/1316556608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bf81611b0 0x7f5bf80b4980 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7f5bf808b150 tx=0x7f5bec02b9a0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.233+0000 7f5bfd41e640 1 -- 172.21.15.132:0/1316556608 shutdown_connections 2023-12-20T04:44:01.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.233+0000 7f5bfd41e640 1 --2- 172.21.15.132:0/1316556608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bf80b4ec0 0x7f5bf806a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.233+0000 7f5bfd41e640 1 --2- 172.21.15.132:0/1316556608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bf81611b0 0x7f5bf80b4980 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.233+0000 7f5bfd41e640 1 --2- 172.21.15.132:0/1316556608 >> v2:172.21.15.187:3300/0 conn(0x7f5bf8160450 0x7f5bf8160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.233+0000 7f5bfd41e640 1 -- 172.21.15.132:0/1316556608 >> 172.21.15.132:0/1316556608 conn(0x7f5bf80cf980 msgr2=0x7f5bf80cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:01.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.233+0000 7f5bfd41e640 1 -- 172.21.15.132:0/1316556608 shutdown_connections 2023-12-20T04:44:01.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.233+0000 7f5bfd41e640 1 -- 172.21.15.132:0/1316556608 wait complete. 2023-12-20T04:44:01.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.234+0000 7f5bfd41e640 1 Processor -- start 2023-12-20T04:44:01.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.234+0000 7f5bfd41e640 1 -- start start 2023-12-20T04:44:01.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bfd41e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bf80b4ec0 0x7f5bf8158bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bfd41e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bf8160450 0x7f5bf8151dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bfd41e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5bf81611b0 0x7f5bf80d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bfd41e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf8159be0 con 0x7f5bf80b4ec0 2023-12-20T04:44:01.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bfd41e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf815b7b0 con 0x7f5bf81611b0 2023-12-20T04:44:01.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bfd41e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5bf815ba50 con 0x7f5bf8160450 2023-12-20T04:44:01.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bf6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bf80b4ec0 0x7f5bf8158bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bf6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bf80b4ec0 0x7f5bf8158bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50796/0 (socket says 172.21.15.132:50796) 2023-12-20T04:44:01.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bf6ffd640 1 -- 172.21.15.132:0/3670101300 learned_addr learned my addr 172.21.15.132:0/3670101300 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:01.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bf67fc640 1 --2- 172.21.15.132:0/3670101300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bf8160450 0x7f5bf8151dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bf77fe640 1 --2- 172.21.15.132:0/3670101300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5bf81611b0 0x7f5bf80d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bf6ffd640 1 -- 172.21.15.132:0/3670101300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bf8160450 msgr2=0x7f5bf8151dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bf6ffd640 1 --2- 172.21.15.132:0/3670101300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bf8160450 0x7f5bf8151dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bf6ffd640 1 -- 172.21.15.132:0/3670101300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5bf81611b0 msgr2=0x7f5bf80d29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bf6ffd640 1 --2- 172.21.15.132:0/3670101300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5bf81611b0 0x7f5bf80d29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bf6ffd640 1 -- 172.21.15.132:0/3670101300 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bec0094d0 con 0x7f5bf80b4ec0 2023-12-20T04:44:01.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bf67fc640 1 --2- 172.21.15.132:0/3670101300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bf8160450 0x7f5bf8151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:01.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bf77fe640 1 --2- 172.21.15.132:0/3670101300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5bf81611b0 0x7f5bf80d29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:01.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.235+0000 7f5bf6ffd640 1 --2- 172.21.15.132:0/3670101300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bf80b4ec0 0x7f5bf8158bc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5be800c7f0 tx=0x7f5be800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:01.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.236+0000 7f5bdf7fe640 1 -- 172.21.15.132:0/3670101300 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8004220 con 0x7f5bf80b4ec0 2023-12-20T04:44:01.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.236+0000 7f5bdf7fe640 1 -- 172.21.15.132:0/3670101300 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5be80043a0 con 0x7f5bf80b4ec0 2023-12-20T04:44:01.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.236+0000 7f5bfd41e640 1 -- 172.21.15.132:0/3670101300 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5bf815bd30 con 0x7f5bf80b4ec0 2023-12-20T04:44:01.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.236+0000 7f5bdf7fe640 1 -- 172.21.15.132:0/3670101300 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5be8007860 con 0x7f5bf80b4ec0 2023-12-20T04:44:01.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.236+0000 7f5bfd41e640 1 -- 172.21.15.132:0/3670101300 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5bf815b470 con 0x7f5bf80b4ec0 2023-12-20T04:44:01.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.236+0000 7f5bfd41e640 1 -- 172.21.15.132:0/3670101300 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5bf804e840 con 0x7f5bf80b4ec0 2023-12-20T04:44:01.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.237+0000 7f5bdf7fe640 1 -- 172.21.15.132:0/3670101300 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5be8007bd0 con 0x7f5bf80b4ec0 2023-12-20T04:44:01.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.237+0000 7f5bdf7fe640 1 --2- 172.21.15.132:0/3670101300 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5be406a460 0x7f5be406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.237+0000 7f5bdf7fe640 1 -- 172.21.15.132:0/3670101300 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5be8088830 con 0x7f5bf80b4ec0 2023-12-20T04:44:01.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.237+0000 7f5bf67fc640 1 --2- 172.21.15.132:0/3670101300 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5be406a460 0x7f5be406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.238+0000 7f5bf67fc640 1 --2- 172.21.15.132:0/3670101300 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5be406a460 0x7f5be406c920 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5bec036000 tx=0x7f5bec03b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:01.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.242+0000 7f5bdf7fe640 1 -- 172.21.15.132:0/3670101300 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5be8053eb0 con 0x7f5bf80b4ec0 2023-12-20T04:44:01.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.406+0000 7f5bfd41e640 1 -- 172.21.15.132:0/3670101300 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5bf8159e50 con 0x7f5bf80b4ec0 2023-12-20T04:44:01.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.407+0000 7f5bdf7fe640 1 -- 172.21.15.132:0/3670101300 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16149 (secure 0 0 0) 0x7f5be801e020 con 0x7f5bf80b4ec0 2023-12-20T04:44:01.410 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:01.410 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":35,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:43:56.805688+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:43:42.932158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-20T04:43:43.361561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:44:01.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.409+0000 7f5bfd41e640 1 -- 172.21.15.132:0/3670101300 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5be406a460 msgr2=0x7f5be406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.409+0000 7f5bfd41e640 1 --2- 172.21.15.132:0/3670101300 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5be406a460 0x7f5be406c920 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f5bec036000 tx=0x7f5bec03b040 comp rx=0 tx=0).stop 2023-12-20T04:44:01.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.409+0000 7f5bfd41e640 1 -- 172.21.15.132:0/3670101300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bf80b4ec0 msgr2=0x7f5bf8158bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.409+0000 7f5bfd41e640 1 --2- 172.21.15.132:0/3670101300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bf80b4ec0 0x7f5bf8158bc0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5be800c7f0 tx=0x7f5be800ccb0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.409+0000 7f5bfd41e640 1 -- 172.21.15.132:0/3670101300 shutdown_connections 2023-12-20T04:44:01.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.409+0000 7f5bfd41e640 1 --2- 172.21.15.132:0/3670101300 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5be406a460 0x7f5be406c920 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.409+0000 7f5bfd41e640 1 --2- 172.21.15.132:0/3670101300 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5bf81611b0 0x7f5bf80d29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.409+0000 7f5bfd41e640 1 --2- 172.21.15.132:0/3670101300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5bf8160450 0x7f5bf8151dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.409+0000 7f5bfd41e640 1 --2- 172.21.15.132:0/3670101300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5bf80b4ec0 0x7f5bf8158bc0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.409+0000 7f5bfd41e640 1 -- 172.21.15.132:0/3670101300 >> 172.21.15.132:0/3670101300 conn(0x7f5bf80cf980 msgr2=0x7f5bf815f390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:01.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.409+0000 7f5bfd41e640 1 -- 172.21.15.132:0/3670101300 shutdown_connections 2023-12-20T04:44:01.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.409+0000 7f5bfd41e640 1 -- 172.21.15.132:0/3670101300 wait complete. 2023-12-20T04:44:01.422 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:43:42.932158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:43:43.361561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:44:01.423 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:44:01.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.524+0000 7f0fbdd69640 1 Processor -- start 2023-12-20T04:44:01.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.524+0000 7f0fbdd69640 1 -- start start 2023-12-20T04:44:01.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.525+0000 7f0fbdd69640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0fb806f450 0x7f0fb80cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.525+0000 7f0fbdd69640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fb806f8d0 0x7f0fb806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.525+0000 7f0fbdd69640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fb806b960 con 0x7f0fb80caee0 2023-12-20T04:44:01.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.525+0000 7f0fbdd69640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fb80c4c30 con 0x7f0fb806f450 2023-12-20T04:44:01.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.525+0000 7f0fbdd69640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb80c4390 con 0x7f0fb806f8d0 2023-12-20T04:44:01.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.525+0000 7f0fb77fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0fb80caee0 0x7f0fb80c5330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44860/0 (socket says 172.21.15.132:44860) 2023-12-20T04:44:01.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.525+0000 7f0fb77fe640 1 -- 172.21.15.132:0/3384530215 learned_addr learned my addr 172.21.15.132:0/3384530215 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:01.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.525+0000 7f0fb7fff640 1 --2- 172.21.15.132:0/3384530215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fb806f8d0 0x7f0fb806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.525+0000 7f0fb6ffd640 1 --2- 172.21.15.132:0/3384530215 >> v2:172.21.15.187:3300/0 conn(0x7f0fb806f450 0x7f0fb80cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb67fc640 1 -- 172.21.15.132:0/3384530215 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521277122 0 0) 0x7f0fb806b960 con 0x7f0fb80caee0 2023-12-20T04:44:01.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb67fc640 1 -- 172.21.15.132:0/3384530215 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fa0003520 con 0x7f0fb80caee0 2023-12-20T04:44:01.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb67fc640 1 -- 172.21.15.132:0/3384530215 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4885266 0 0) 0x7f0fa0003520 con 0x7f0fb80caee0 2023-12-20T04:44:01.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb67fc640 1 -- 172.21.15.132:0/3384530215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fb806f8d0 msgr2=0x7f0fb806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:01.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb67fc640 1 --2- 172.21.15.132:0/3384530215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fb806f8d0 0x7f0fb806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb67fc640 1 -- 172.21.15.132:0/3384530215 >> v2:172.21.15.187:3300/0 conn(0x7f0fb806f450 msgr2=0x7f0fb80cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb67fc640 1 --2- 172.21.15.132:0/3384530215 >> v2:172.21.15.187:3300/0 conn(0x7f0fb806f450 0x7f0fb80cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb67fc640 1 -- 172.21.15.132:0/3384530215 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb80c4670 con 0x7f0fb80caee0 2023-12-20T04:44:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb67fc640 1 -- 172.21.15.132:0/3384530215 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f0fa8001670 con 0x7f0fb80caee0 2023-12-20T04:44:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb67fc640 1 -- 172.21.15.132:0/3384530215 >> v1:172.21.15.132:6789/0 conn(0x7f0fb80caee0 legacy=0x7f0fb80c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb67fc640 1 --2- 172.21.15.132:0/3384530215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fa0003970 0x7f0fa0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb67fc640 1 --2- 172.21.15.132:0/3384530215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fb806f8d0 0x7f0fa00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb67fc640 1 --2- 172.21.15.132:0/3384530215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa0004d00 0x7f0fa0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb67fc640 1 -- 172.21.15.132:0/3384530215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb80c4c30 con 0x7f0fa0003970 2023-12-20T04:44:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb67fc640 1 -- 172.21.15.132:0/3384530215 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb80c4390 con 0x7f0fa0004d00 2023-12-20T04:44:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb67fc640 1 -- 172.21.15.132:0/3384530215 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa000b980 con 0x7f0fb806f8d0 2023-12-20T04:44:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb77fe640 1 --2- 172.21.15.132:0/3384530215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fa0003970 0x7f0fa0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb6ffd640 1 --2- 172.21.15.132:0/3384530215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fb806f8d0 0x7f0fa00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb7fff640 1 --2- 172.21.15.132:0/3384530215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa0004d00 0x7f0fa0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb77fe640 1 -- 172.21.15.132:0/3384530215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fb806f8d0 msgr2=0x7f0fa00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb77fe640 1 --2- 172.21.15.132:0/3384530215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fb806f8d0 0x7f0fa00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb77fe640 1 -- 172.21.15.132:0/3384530215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa0004d00 msgr2=0x7f0fa0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb77fe640 1 --2- 172.21.15.132:0/3384530215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa0004d00 0x7f0fa0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb77fe640 1 -- 172.21.15.132:0/3384530215 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa0003520 con 0x7f0fa0003970 2023-12-20T04:44:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb7fff640 1 --2- 172.21.15.132:0/3384530215 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa0004d00 0x7f0fa0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.526+0000 7f0fb6ffd640 1 --2- 172.21.15.132:0/3384530215 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fb806f8d0 0x7f0fa00047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.527+0000 7f0fb77fe640 1 --2- 172.21.15.132:0/3384530215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fa0003970 0x7f0fa0003d90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800c270 tx=0x7f0fa00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77458e3411e1799e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.527+0000 7f0fb67fc640 1 -- 172.21.15.132:0/3384530215 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa802cae0 con 0x7f0fa0003970 2023-12-20T04:44:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.527+0000 7f0fb67fc640 1 -- 172.21.15.132:0/3384530215 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fa802cc40 con 0x7f0fa0003970 2023-12-20T04:44:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.527+0000 7f0fb67fc640 1 -- 172.21.15.132:0/3384530215 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fa80058d0 con 0x7f0fa0003970 2023-12-20T04:44:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.527+0000 7f0fbdd69640 1 -- 172.21.15.132:0/3384530215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fa0003970 msgr2=0x7f0fa0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.527+0000 7f0fbdd69640 1 --2- 172.21.15.132:0/3384530215 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fa0003970 0x7f0fa0003d90 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f0fa800c270 tx=0x7f0fa00057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.528+0000 7f0fb7fff640 1 -- 172.21.15.132:0/3384530215 reap_dead start 2023-12-20T04:44:01.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.528+0000 7f0fbdd69640 1 -- 172.21.15.132:0/3384530215 shutdown_connections 2023-12-20T04:44:01.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.528+0000 7f0fbdd69640 1 -- 172.21.15.132:0/3384530215 >> 172.21.15.132:0/3384530215 conn(0x7f0fb806a260 msgr2=0x7f0fb80b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:01.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.528+0000 7f0fbdd69640 1 -- 172.21.15.132:0/3384530215 shutdown_connections 2023-12-20T04:44:01.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.528+0000 7f0fbdd69640 1 -- 172.21.15.132:0/3384530215 wait complete. 2023-12-20T04:44:01.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.529+0000 7f0fbdd69640 1 Processor -- start 2023-12-20T04:44:01.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.529+0000 7f0fbdd69640 1 -- start start 2023-12-20T04:44:01.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fbdd69640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fa0003970 0x7f0fb815ac70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fbdd69640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fb81596f0 0x7f0fb813f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fbdd69640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fb8159b70 0x7f0fb813fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fbdd69640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb81400e0 con 0x7f0fb8159b70 2023-12-20T04:44:01.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fbdd69640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb80b36b0 con 0x7f0fb81596f0 2023-12-20T04:44:01.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fbdd69640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fb80b3990 con 0x7f0fa0003970 2023-12-20T04:44:01.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fb8159b70 0x7f0fb813fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fb7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fb8159b70 0x7f0fb813fba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50814/0 (socket says 172.21.15.132:50814) 2023-12-20T04:44:01.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fb7fff640 1 -- 172.21.15.132:0/2780267248 learned_addr learned my addr 172.21.15.132:0/2780267248 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:01.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fb77fe640 1 --2- 172.21.15.132:0/2780267248 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fa0003970 0x7f0fb815ac70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fb6ffd640 1 --2- 172.21.15.132:0/2780267248 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fb81596f0 0x7f0fb813f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fb7fff640 1 -- 172.21.15.132:0/2780267248 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fa0003970 msgr2=0x7f0fb815ac70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fb7fff640 1 --2- 172.21.15.132:0/2780267248 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fa0003970 0x7f0fb815ac70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fb7fff640 1 -- 172.21.15.132:0/2780267248 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fb81596f0 msgr2=0x7f0fb813f660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fb7fff640 1 --2- 172.21.15.132:0/2780267248 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fb81596f0 0x7f0fb813f660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fb7fff640 1 -- 172.21.15.132:0/2780267248 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fb80b3c70 con 0x7f0fb8159b70 2023-12-20T04:44:01.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fb77fe640 1 --2- 172.21.15.132:0/2780267248 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fa0003970 0x7f0fb815ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:01.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fb7fff640 1 --2- 172.21.15.132:0/2780267248 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fb8159b70 0x7f0fb813fba0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0fb806d540 tx=0x7f0fb0010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:01.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0f9ffff640 1 -- 172.21.15.132:0/2780267248 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb000e050 con 0x7f0fb8159b70 2023-12-20T04:44:01.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0f9ffff640 1 -- 172.21.15.132:0/2780267248 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fb000f040 con 0x7f0fb8159b70 2023-12-20T04:44:01.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0f9ffff640 1 -- 172.21.15.132:0/2780267248 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fb0003990 con 0x7f0fb8159b70 2023-12-20T04:44:01.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fbdd69640 1 -- 172.21.15.132:0/2780267248 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0fb80b3f50 con 0x7f0fb8159b70 2023-12-20T04:44:01.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.530+0000 7f0fbdd69640 1 -- 172.21.15.132:0/2780267248 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fb815b1b0 con 0x7f0fb8159b70 2023-12-20T04:44:01.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.531+0000 7f0fbdd69640 1 -- 172.21.15.132:0/2780267248 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fb80b4470 con 0x7f0fb8159b70 2023-12-20T04:44:01.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.532+0000 7f0f9ffff640 1 -- 172.21.15.132:0/2780267248 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0fb0015440 con 0x7f0fb8159b70 2023-12-20T04:44:01.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.532+0000 7f0f9ffff640 1 --2- 172.21.15.132:0/2780267248 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fa406a430 0x7f0fa406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.532+0000 7f0f9ffff640 1 -- 172.21.15.132:0/2780267248 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fb0088e30 con 0x7f0fb8159b70 2023-12-20T04:44:01.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.532+0000 7f0fb77fe640 1 --2- 172.21.15.132:0/2780267248 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fa406a430 0x7f0fa406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.533+0000 7f0fb77fe640 1 --2- 172.21.15.132:0/2780267248 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fa406a430 0x7f0fa406c8f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8034000 tx=0x7f0fa8007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:01.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.536+0000 7f0f9ffff640 1 -- 172.21.15.132:0/2780267248 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0fb80b4470 con 0x7f0fb8159b70 2023-12-20T04:44:01.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.701+0000 7f0fbdd69640 1 -- 172.21.15.132:0/2780267248 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0fb80b4470 con 0x7f0fb8159b70 2023-12-20T04:44:01.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.701+0000 7f0f9ffff640 1 -- 172.21.15.132:0/2780267248 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0fb80b4470 con 0x7f0fb8159b70 2023-12-20T04:44:01.703 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:44:01.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.703+0000 7f0fbdd69640 1 -- 172.21.15.132:0/2780267248 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fa406a430 msgr2=0x7f0fa406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.703+0000 7f0fbdd69640 1 --2- 172.21.15.132:0/2780267248 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fa406a430 0x7f0fa406c8f0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f0fa8034000 tx=0x7f0fa8007000 comp rx=0 tx=0).stop 2023-12-20T04:44:01.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.703+0000 7f0fbdd69640 1 -- 172.21.15.132:0/2780267248 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fb8159b70 msgr2=0x7f0fb813fba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.703+0000 7f0fbdd69640 1 --2- 172.21.15.132:0/2780267248 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fb8159b70 0x7f0fb813fba0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f0fb806d540 tx=0x7f0fb0010590 comp rx=0 tx=0).stop 2023-12-20T04:44:01.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.703+0000 7f0fbdd69640 1 -- 172.21.15.132:0/2780267248 shutdown_connections 2023-12-20T04:44:01.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.703+0000 7f0fbdd69640 1 --2- 172.21.15.132:0/2780267248 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fa406a430 0x7f0fa406c8f0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.703+0000 7f0fbdd69640 1 --2- 172.21.15.132:0/2780267248 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fb8159b70 0x7f0fb813fba0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.703+0000 7f0fbdd69640 1 --2- 172.21.15.132:0/2780267248 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fb81596f0 0x7f0fb813f660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.703+0000 7f0fbdd69640 1 --2- 172.21.15.132:0/2780267248 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fa0003970 0x7f0fb815ac70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.703+0000 7f0fbdd69640 1 -- 172.21.15.132:0/2780267248 >> 172.21.15.132:0/2780267248 conn(0x7f0fb806a260 msgr2=0x7f0fb80c3980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:01.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.703+0000 7f0fbdd69640 1 -- 172.21.15.132:0/2780267248 shutdown_connections 2023-12-20T04:44:01.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.703+0000 7f0fbdd69640 1 -- 172.21.15.132:0/2780267248 wait complete. 2023-12-20T04:44:01.715 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:44:01.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.819+0000 7f1d928fb640 1 Processor -- start 2023-12-20T04:44:01.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.819+0000 7f1d928fb640 1 -- start start 2023-12-20T04:44:01.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.820+0000 7f1d928fb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1d8c0cf790 0x7f1d8c0cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.820+0000 7f1d928fb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c0d2920 con 0x7f1d8c0b6080 2023-12-20T04:44:01.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.820+0000 7f1d928fb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d8c0d1d10 con 0x7f1d8c15d300 2023-12-20T04:44:01.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.820+0000 7f1d928fb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d8c0d0180 con 0x7f1d8c0cf790 2023-12-20T04:44:01.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.820+0000 7f1d8b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1d8c0cf790 0x7f1d8c0cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.820+0000 7f1d90e98640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1d8c0b6080 0x7f1d8c0b6490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44874/0 (socket says 172.21.15.132:44874) 2023-12-20T04:44:01.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.820+0000 7f1d8b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1d8c0cf790 0x7f1d8c0cfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50828/0 (socket says 172.21.15.132:50828) 2023-12-20T04:44:01.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.820+0000 7f1d90e98640 1 -- 172.21.15.132:0/66506561 learned_addr learned my addr 172.21.15.132:0/66506561 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:01.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.820+0000 7f1d8b7fe640 1 -- 172.21.15.132:0/66506561 >> v1:172.21.15.187:6789/0 conn(0x7f1d8c15d300 legacy=0x7f1d8c0d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.820+0000 7f1d8b7fe640 1 -- 172.21.15.132:0/66506561 >> v1:172.21.15.132:6789/0 conn(0x7f1d8c0b6080 legacy=0x7f1d8c0b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.820+0000 7f1d8b7fe640 1 -- 172.21.15.132:0/66506561 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d8c0d1ff0 con 0x7f1d8c0cf790 2023-12-20T04:44:01.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.820+0000 7f1d8affd640 1 -- 172.21.15.132:0/66506561 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1607877569 0 0) 0x7f1d8c0d2920 con 0x7f1d8c0b6080 2023-12-20T04:44:01.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.821+0000 7f1d8b7fe640 1 --2- 172.21.15.132:0/66506561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d8c0cf790 0x7f1d8c0cfc40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1d800097a0 tx=0x7f1d8002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88a16b4b9892fe04 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:01.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.821+0000 7f1d8affd640 1 -- 172.21.15.132:0/66506561 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80030610 con 0x7f1d8c0cf790 2023-12-20T04:44:01.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.821+0000 7f1d8affd640 1 -- 172.21.15.132:0/66506561 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d80030770 con 0x7f1d8c0cf790 2023-12-20T04:44:01.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.821+0000 7f1d8affd640 1 -- 172.21.15.132:0/66506561 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d80030b00 con 0x7f1d8c0cf790 2023-12-20T04:44:01.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.821+0000 7f1d928fb640 1 -- 172.21.15.132:0/66506561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d8c0cf790 msgr2=0x7f1d8c0cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.821+0000 7f1d928fb640 1 --2- 172.21.15.132:0/66506561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d8c0cf790 0x7f1d8c0cfc40 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1d800097a0 tx=0x7f1d8002b960 comp rx=0 tx=0).stop 2023-12-20T04:44:01.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.821+0000 7f1d928fb640 1 -- 172.21.15.132:0/66506561 shutdown_connections 2023-12-20T04:44:01.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.821+0000 7f1d928fb640 1 --2- 172.21.15.132:0/66506561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d8c0cf790 0x7f1d8c0cfc40 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.821+0000 7f1d928fb640 1 -- 172.21.15.132:0/66506561 >> 172.21.15.132:0/66506561 conn(0x7f1d8c06a3d0 msgr2=0x7f1d8c06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:01.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.822+0000 7f1d928fb640 1 -- 172.21.15.132:0/66506561 shutdown_connections 2023-12-20T04:44:01.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.822+0000 7f1d928fb640 1 -- 172.21.15.132:0/66506561 wait complete. 2023-12-20T04:44:01.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.823+0000 7f1d928fb640 1 Processor -- start 2023-12-20T04:44:01.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.823+0000 7f1d928fb640 1 -- start start 2023-12-20T04:44:01.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d928fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d8c0b6080 0x7f1d8c153080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d928fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d8c0cf790 0x7f1d8c1529e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d928fb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d8c15d300 0x7f1d8c0c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d928fb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c152f20 con 0x7f1d8c0b6080 2023-12-20T04:44:01.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d928fb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c0ca480 con 0x7f1d8c15d300 2023-12-20T04:44:01.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d928fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d8c0ca6b0 con 0x7f1d8c0cf790 2023-12-20T04:44:01.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d8bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d8c0b6080 0x7f1d8c153080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d8bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d8c0b6080 0x7f1d8c153080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50830/0 (socket says 172.21.15.132:50830) 2023-12-20T04:44:01.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d8bfff640 1 -- 172.21.15.132:0/4072564044 learned_addr learned my addr 172.21.15.132:0/4072564044 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d90e98640 1 --2- 172.21.15.132:0/4072564044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d8c15d300 0x7f1d8c0c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d8b7fe640 1 --2- 172.21.15.132:0/4072564044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d8c0cf790 0x7f1d8c1529e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d8bfff640 1 -- 172.21.15.132:0/4072564044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d8c0cf790 msgr2=0x7f1d8c1529e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d8bfff640 1 --2- 172.21.15.132:0/4072564044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d8c0cf790 0x7f1d8c1529e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d8bfff640 1 -- 172.21.15.132:0/4072564044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d8c15d300 msgr2=0x7f1d8c0c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d8bfff640 1 --2- 172.21.15.132:0/4072564044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d8c15d300 0x7f1d8c0c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d8bfff640 1 -- 172.21.15.132:0/4072564044 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d80009400 con 0x7f1d8c0b6080 2023-12-20T04:44:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d8bfff640 1 --2- 172.21.15.132:0/4072564044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d8c0b6080 0x7f1d8c153080 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00c450 tx=0x7f1d7c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d88ff9640 1 -- 172.21.15.132:0/4072564044 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c0052d0 con 0x7f1d8c0b6080 2023-12-20T04:44:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d88ff9640 1 -- 172.21.15.132:0/4072564044 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d7c005430 con 0x7f1d8c0b6080 2023-12-20T04:44:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d928fb640 1 -- 172.21.15.132:0/4072564044 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d8c0ca990 con 0x7f1d8c0b6080 2023-12-20T04:44:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d88ff9640 1 -- 172.21.15.132:0/4072564044 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d7c012870 con 0x7f1d8c0b6080 2023-12-20T04:44:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.824+0000 7f1d928fb640 1 -- 172.21.15.132:0/4072564044 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d8c0caf50 con 0x7f1d8c0b6080 2023-12-20T04:44:01.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.825+0000 7f1d928fb640 1 -- 172.21.15.132:0/4072564044 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d8c04e840 con 0x7f1d8c0b6080 2023-12-20T04:44:01.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.826+0000 7f1d88ff9640 1 -- 172.21.15.132:0/4072564044 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1d7c0129d0 con 0x7f1d8c0b6080 2023-12-20T04:44:01.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.826+0000 7f1d88ff9640 1 --2- 172.21.15.132:0/4072564044 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d7806a430 0x7f1d7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:01.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.826+0000 7f1d88ff9640 1 -- 172.21.15.132:0/4072564044 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1d7c0883f0 con 0x7f1d8c0b6080 2023-12-20T04:44:01.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.826+0000 7f1d8b7fe640 1 --2- 172.21.15.132:0/4072564044 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d7806a430 0x7f1d7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:01.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.827+0000 7f1d8b7fe640 1 --2- 172.21.15.132:0/4072564044 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d7806a430 0x7f1d7806c8f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1d80036000 tx=0x7f1d80008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:01.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.831+0000 7f1d88ff9640 1 -- 172.21.15.132:0/4072564044 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1d7c053a70 con 0x7f1d8c0b6080 2023-12-20T04:44:01.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.995+0000 7f1d928fb640 1 -- 172.21.15.132:0/4072564044 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1d8c0c63a0 con 0x7f1d8c0b6080 2023-12-20T04:44:01.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.995+0000 7f1d88ff9640 1 -- 172.21.15.132:0/4072564044 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1d7c057090 con 0x7f1d8c0b6080 2023-12-20T04:44:01.997 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:44:01.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.997+0000 7f1d928fb640 1 -- 172.21.15.132:0/4072564044 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d7806a430 msgr2=0x7f1d7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.997+0000 7f1d928fb640 1 --2- 172.21.15.132:0/4072564044 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d7806a430 0x7f1d7806c8f0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f1d80036000 tx=0x7f1d80008030 comp rx=0 tx=0).stop 2023-12-20T04:44:01.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.997+0000 7f1d928fb640 1 -- 172.21.15.132:0/4072564044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d8c0b6080 msgr2=0x7f1d8c153080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:01.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.997+0000 7f1d928fb640 1 --2- 172.21.15.132:0/4072564044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d8c0b6080 0x7f1d8c153080 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7f1d7c00c450 tx=0x7f1d7c00c910 comp rx=0 tx=0).stop 2023-12-20T04:44:01.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.997+0000 7f1d928fb640 1 -- 172.21.15.132:0/4072564044 shutdown_connections 2023-12-20T04:44:01.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.997+0000 7f1d928fb640 1 --2- 172.21.15.132:0/4072564044 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d7806a430 0x7f1d7806c8f0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.997+0000 7f1d928fb640 1 --2- 172.21.15.132:0/4072564044 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d8c15d300 0x7f1d8c0c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.997+0000 7f1d928fb640 1 --2- 172.21.15.132:0/4072564044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d8c0cf790 0x7f1d8c1529e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.997+0000 7f1d928fb640 1 --2- 172.21.15.132:0/4072564044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d8c0b6080 0x7f1d8c153080 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.997+0000 7f1d928fb640 1 -- 172.21.15.132:0/4072564044 >> 172.21.15.132:0/4072564044 conn(0x7f1d8c06a3d0 msgr2=0x7f1d8c159f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:02.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.997+0000 7f1d928fb640 1 -- 172.21.15.132:0/4072564044 shutdown_connections 2023-12-20T04:44:02.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:01.997+0000 7f1d928fb640 1 -- 172.21.15.132:0/4072564044 wait complete. 2023-12-20T04:44:02.010 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:44:02.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.111+0000 7f3b5cd5c640 1 Processor -- start 2023-12-20T04:44:02.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.111+0000 7f3b5cd5c640 1 -- start start 2023-12-20T04:44:02.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.112+0000 7f3b5cd5c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3b580caee0 0x7f3b580c5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.112+0000 7f3b5cd5c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3b5806f8d0 0x7f3b5806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.112+0000 7f3b5cd5c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3b5806b960 con 0x7f3b5806f450 2023-12-20T04:44:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.112+0000 7f3b5cd5c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b580c4c30 con 0x7f3b580caee0 2023-12-20T04:44:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.112+0000 7f3b5cd5c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3b580c4390 con 0x7f3b5806f8d0 2023-12-20T04:44:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.113+0000 7f3b5659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3b580caee0 0x7f3b580c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.113+0000 7f3b55d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3b5806f450 0x7f3b580cb2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44888/0 (socket says 172.21.15.132:44888) 2023-12-20T04:44:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.113+0000 7f3b55d9b640 1 -- 172.21.15.132:0/340814088 learned_addr learned my addr 172.21.15.132:0/340814088 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.113+0000 7f3b56d9d640 1 --2- 172.21.15.132:0/340814088 >> v2:172.21.15.187:3300/0 conn(0x7f3b5806f8d0 0x7f3b5806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.113+0000 7f3b5659c640 1 -- 172.21.15.132:0/340814088 >> v2:172.21.15.187:3300/0 conn(0x7f3b5806f8d0 msgr2=0x7f3b5806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.113+0000 7f3b5659c640 1 --2- 172.21.15.132:0/340814088 >> v2:172.21.15.187:3300/0 conn(0x7f3b5806f8d0 0x7f3b5806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.113+0000 7f3b5659c640 1 -- 172.21.15.132:0/340814088 >> v1:172.21.15.132:6789/0 conn(0x7f3b5806f450 legacy=0x7f3b580cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:02.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.113+0000 7f3b5659c640 1 -- 172.21.15.132:0/340814088 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b580c4670 con 0x7f3b580caee0 2023-12-20T04:44:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.114+0000 7f3b5659c640 1 --2- 172.21.15.132:0/340814088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b580caee0 0x7f3b580c5330 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3b580c4f70 tx=0x7f3b5002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1d4b1473e3598c5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.114+0000 7f3b5559a640 1 -- 172.21.15.132:0/340814088 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b50031830 con 0x7f3b580caee0 2023-12-20T04:44:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.114+0000 7f3b5559a640 1 -- 172.21.15.132:0/340814088 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b50031990 con 0x7f3b580caee0 2023-12-20T04:44:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.114+0000 7f3b5559a640 1 -- 172.21.15.132:0/340814088 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b50031d20 con 0x7f3b580caee0 2023-12-20T04:44:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.114+0000 7f3b5cd5c640 1 -- 172.21.15.132:0/340814088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b580caee0 msgr2=0x7f3b580c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.114+0000 7f3b5cd5c640 1 --2- 172.21.15.132:0/340814088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b580caee0 0x7f3b580c5330 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7f3b580c4f70 tx=0x7f3b5002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.114+0000 7f3b5cd5c640 1 -- 172.21.15.132:0/340814088 shutdown_connections 2023-12-20T04:44:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.114+0000 7f3b5cd5c640 1 --2- 172.21.15.132:0/340814088 >> v2:172.21.15.187:3300/0 conn(0x7f3b5806f8d0 0x7f3b5806bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.114+0000 7f3b5cd5c640 1 --2- 172.21.15.132:0/340814088 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b580caee0 0x7f3b580c5330 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.114+0000 7f3b5cd5c640 1 -- 172.21.15.132:0/340814088 >> 172.21.15.132:0/340814088 conn(0x7f3b5806a260 msgr2=0x7f3b580b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.114+0000 7f3b5cd5c640 1 -- 172.21.15.132:0/340814088 shutdown_connections 2023-12-20T04:44:02.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.114+0000 7f3b5cd5c640 1 -- 172.21.15.132:0/340814088 wait complete. 2023-12-20T04:44:02.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.116+0000 7f3b5cd5c640 1 Processor -- start 2023-12-20T04:44:02.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.116+0000 7f3b5cd5c640 1 -- start start 2023-12-20T04:44:02.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.116+0000 7f3b5cd5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b5806f450 0x7f3b5815a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:02.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.116+0000 7f3b5cd5c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b5806f8d0 0x7f3b581407c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:02.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.116+0000 7f3b5cd5c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b580caee0 0x7f3b58070250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:02.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.116+0000 7f3b5cd5c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b5815aa30 con 0x7f3b5806f450 2023-12-20T04:44:02.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.116+0000 7f3b5cd5c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b581410f0 con 0x7f3b580caee0 2023-12-20T04:44:02.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.116+0000 7f3b5cd5c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3b581413d0 con 0x7f3b5806f8d0 2023-12-20T04:44:02.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.117+0000 7f3b5659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b5806f450 0x7f3b5815a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:02.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.117+0000 7f3b5659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b5806f450 0x7f3b5815a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50848/0 (socket says 172.21.15.132:50848) 2023-12-20T04:44:02.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.117+0000 7f3b5659c640 1 -- 172.21.15.132:0/3232028272 learned_addr learned my addr 172.21.15.132:0/3232028272 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:02.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.117+0000 7f3b55d9b640 1 --2- 172.21.15.132:0/3232028272 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b5806f8d0 0x7f3b581407c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:02.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.117+0000 7f3b56d9d640 1 --2- 172.21.15.132:0/3232028272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b580caee0 0x7f3b58070250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:02.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.117+0000 7f3b5659c640 1 -- 172.21.15.132:0/3232028272 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b5806f8d0 msgr2=0x7f3b581407c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:02.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.117+0000 7f3b5659c640 1 --2- 172.21.15.132:0/3232028272 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b5806f8d0 0x7f3b581407c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.117+0000 7f3b5659c640 1 -- 172.21.15.132:0/3232028272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b580caee0 msgr2=0x7f3b58070250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:02.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.117+0000 7f3b5659c640 1 --2- 172.21.15.132:0/3232028272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b580caee0 0x7f3b58070250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.117+0000 7f3b5659c640 1 -- 172.21.15.132:0/3232028272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b50009400 con 0x7f3b5806f450 2023-12-20T04:44:02.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.117+0000 7f3b55d9b640 1 --2- 172.21.15.132:0/3232028272 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b5806f8d0 0x7f3b581407c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:02.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.117+0000 7f3b5659c640 1 --2- 172.21.15.132:0/3232028272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b5806f450 0x7f3b5815a4f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009890 tx=0x7f3b500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:02.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.117+0000 7f3b46ffd640 1 -- 172.21.15.132:0/3232028272 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b500317d0 con 0x7f3b5806f450 2023-12-20T04:44:02.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.117+0000 7f3b46ffd640 1 -- 172.21.15.132:0/3232028272 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3b5003ba70 con 0x7f3b5806f450 2023-12-20T04:44:02.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.117+0000 7f3b5cd5c640 1 -- 172.21.15.132:0/3232028272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b581416b0 con 0x7f3b5806f450 2023-12-20T04:44:02.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.117+0000 7f3b46ffd640 1 -- 172.21.15.132:0/3232028272 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3b5003be20 con 0x7f3b5806f450 2023-12-20T04:44:02.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.117+0000 7f3b5cd5c640 1 -- 172.21.15.132:0/3232028272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b58141c70 con 0x7f3b5806f450 2023-12-20T04:44:02.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.118+0000 7f3b5cd5c640 1 -- 172.21.15.132:0/3232028272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b5804e840 con 0x7f3b5806f450 2023-12-20T04:44:02.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.119+0000 7f3b46ffd640 1 -- 172.21.15.132:0/3232028272 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3b500453f0 con 0x7f3b5806f450 2023-12-20T04:44:02.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.119+0000 7f3b46ffd640 1 --2- 172.21.15.132:0/3232028272 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3b3806a430 0x7f3b3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:02.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.119+0000 7f3b55d9b640 1 --2- 172.21.15.132:0/3232028272 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3b3806a430 0x7f3b3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:02.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.119+0000 7f3b46ffd640 1 -- 172.21.15.132:0/3232028272 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3b500aac20 con 0x7f3b5806f450 2023-12-20T04:44:02.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.120+0000 7f3b55d9b640 1 --2- 172.21.15.132:0/3232028272 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3b3806a430 0x7f3b3806c8f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3b58070df0 tx=0x7f3b4c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:02.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.123+0000 7f3b46ffd640 1 -- 172.21.15.132:0/3232028272 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3b500763c0 con 0x7f3b5806f450 2023-12-20T04:44:02.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.288+0000 7f3b5cd5c640 1 -- 172.21.15.132:0/3232028272 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f3b58141e60 con 0x7f3b5806f450 2023-12-20T04:44:02.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.288+0000 7f3b46ffd640 1 -- 172.21.15.132:0/3232028272 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f3b500799e0 con 0x7f3b5806f450 2023-12-20T04:44:02.290 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:44:02.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.290+0000 7f3b5cd5c640 1 -- 172.21.15.132:0/3232028272 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3b3806a430 msgr2=0x7f3b3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:02.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.290+0000 7f3b5cd5c640 1 --2- 172.21.15.132:0/3232028272 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3b3806a430 0x7f3b3806c8f0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3b58070df0 tx=0x7f3b4c009040 comp rx=0 tx=0).stop 2023-12-20T04:44:02.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.290+0000 7f3b5cd5c640 1 -- 172.21.15.132:0/3232028272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b5806f450 msgr2=0x7f3b5815a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:02.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.290+0000 7f3b5cd5c640 1 --2- 172.21.15.132:0/3232028272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b5806f450 0x7f3b5815a4f0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f3b50009890 tx=0x7f3b500046c0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.290+0000 7f3b5cd5c640 1 -- 172.21.15.132:0/3232028272 shutdown_connections 2023-12-20T04:44:02.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.290+0000 7f3b5cd5c640 1 --2- 172.21.15.132:0/3232028272 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3b3806a430 0x7f3b3806c8f0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.290+0000 7f3b5cd5c640 1 --2- 172.21.15.132:0/3232028272 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3b580caee0 0x7f3b58070250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.290+0000 7f3b5cd5c640 1 --2- 172.21.15.132:0/3232028272 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3b5806f8d0 0x7f3b581407c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.290+0000 7f3b5cd5c640 1 --2- 172.21.15.132:0/3232028272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3b5806f450 0x7f3b5815a4f0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.290+0000 7f3b5cd5c640 1 -- 172.21.15.132:0/3232028272 >> 172.21.15.132:0/3232028272 conn(0x7f3b5806a260 msgr2=0x7f3b580c4fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:02.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.290+0000 7f3b5cd5c640 1 -- 172.21.15.132:0/3232028272 shutdown_connections 2023-12-20T04:44:02.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.290+0000 7f3b5cd5c640 1 -- 172.21.15.132:0/3232028272 wait complete. 2023-12-20T04:44:02.305 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:44:02.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.403+0000 7f66ba35c640 1 Processor -- start 2023-12-20T04:44:02.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.403+0000 7f66ba35c640 1 -- start start 2023-12-20T04:44:02.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.404+0000 7f66ba35c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66b40cd570 0x7f66b40ca180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:02.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.404+0000 7f66ba35c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f66b40cca20 0x7f66b40ca6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:02.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.404+0000 7f66ba35c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f66b40b1950 con 0x7f66b415b170 2023-12-20T04:44:02.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.404+0000 7f66ba35c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f66b40ce5e0 con 0x7f66b40cca20 2023-12-20T04:44:02.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.404+0000 7f66ba35c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b415b550 con 0x7f66b40cd570 2023-12-20T04:44:02.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.404+0000 7f66b88f9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f66b40cca20 0x7f66b40ca6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:02.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.404+0000 7f66b3fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f66b415b170 0x7f66b40cce60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44894/0 (socket says 172.21.15.132:44894) 2023-12-20T04:44:02.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.404+0000 7f66b3fff640 1 -- 172.21.15.132:0/782589505 learned_addr learned my addr 172.21.15.132:0/782589505 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:02.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.404+0000 7f66b37fe640 1 --2- 172.21.15.132:0/782589505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66b40cd570 0x7f66b40ca180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:02.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.404+0000 7f66b88f9640 1 -- 172.21.15.132:0/782589505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66b40cd570 msgr2=0x7f66b40ca180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:02.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.404+0000 7f66b88f9640 1 --2- 172.21.15.132:0/782589505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66b40cd570 0x7f66b40ca180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.405+0000 7f66b88f9640 1 -- 172.21.15.132:0/782589505 >> v1:172.21.15.132:6789/0 conn(0x7f66b415b170 legacy=0x7f66b40cce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:02.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.405+0000 7f66b88f9640 1 -- 172.21.15.132:0/782589505 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66b40cdc40 con 0x7f66b40cca20 2023-12-20T04:44:02.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.405+0000 7f66b2ffd640 1 -- 172.21.15.132:0/782589505 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1273587516 0 0) 0x7f66b40b1950 con 0x7f66b415b170 2023-12-20T04:44:02.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.405+0000 7f66b37fe640 1 --2- 172.21.15.132:0/782589505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66b40cd570 0x7f66b40ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:02.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.405+0000 7f66b88f9640 1 --2- 172.21.15.132:0/782589505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66b40cca20 0x7f66b40ca6c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009d90 tx=0x7f66ac02be10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b81330718758df50 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:02.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.405+0000 7f66b2ffd640 1 -- 172.21.15.132:0/782589505 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac02cbc0 con 0x7f66b40cca20 2023-12-20T04:44:02.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.405+0000 7f66b2ffd640 1 -- 172.21.15.132:0/782589505 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66ac02cd20 con 0x7f66b40cca20 2023-12-20T04:44:02.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.405+0000 7f66b2ffd640 1 -- 172.21.15.132:0/782589505 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66ac034660 con 0x7f66b40cca20 2023-12-20T04:44:02.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.406+0000 7f66ba35c640 1 -- 172.21.15.132:0/782589505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66b40cca20 msgr2=0x7f66b40ca6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:02.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.406+0000 7f66ba35c640 1 --2- 172.21.15.132:0/782589505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66b40cca20 0x7f66b40ca6c0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f66ac009d90 tx=0x7f66ac02be10 comp rx=0 tx=0).stop 2023-12-20T04:44:02.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.406+0000 7f66ba35c640 1 -- 172.21.15.132:0/782589505 shutdown_connections 2023-12-20T04:44:02.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.406+0000 7f66ba35c640 1 --2- 172.21.15.132:0/782589505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66b40cca20 0x7f66b40ca6c0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.406+0000 7f66ba35c640 1 --2- 172.21.15.132:0/782589505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66b40cd570 0x7f66b40ca180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.406+0000 7f66ba35c640 1 -- 172.21.15.132:0/782589505 >> 172.21.15.132:0/782589505 conn(0x7f66b40cbd10 msgr2=0x7f66b40cc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:02.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.406+0000 7f66ba35c640 1 -- 172.21.15.132:0/782589505 shutdown_connections 2023-12-20T04:44:02.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.406+0000 7f66ba35c640 1 -- 172.21.15.132:0/782589505 wait complete. 2023-12-20T04:44:02.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.407+0000 7f66ba35c640 1 Processor -- start 2023-12-20T04:44:02.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.407+0000 7f66ba35c640 1 -- start start 2023-12-20T04:44:02.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.408+0000 7f66ba35c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66b40cca20 0x7f66b415ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:02.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.408+0000 7f66ba35c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66b40cd570 0x7f66b40cb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:02.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.408+0000 7f66ba35c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66b415b170 0x7f66b414c670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:02.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.408+0000 7f66ba35c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b415c860 con 0x7f66b40cd570 2023-12-20T04:44:02.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.408+0000 7f66ba35c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66b415bc50 con 0x7f66b40cca20 2023-12-20T04:44:02.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.408+0000 7f66ba35c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66b415bf30 con 0x7f66b415b170 2023-12-20T04:44:02.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.408+0000 7f66b37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66b40cd570 0x7f66b40cb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:02.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.408+0000 7f66b37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66b40cd570 0x7f66b40cb3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50876/0 (socket says 172.21.15.132:50876) 2023-12-20T04:44:02.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.408+0000 7f66b37fe640 1 -- 172.21.15.132:0/3255420608 learned_addr learned my addr 172.21.15.132:0/3255420608 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:02.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.408+0000 7f66b3fff640 1 --2- 172.21.15.132:0/3255420608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66b40cca20 0x7f66b415ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:02.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.408+0000 7f66b88f9640 1 --2- 172.21.15.132:0/3255420608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66b415b170 0x7f66b414c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:02.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.408+0000 7f66b37fe640 1 -- 172.21.15.132:0/3255420608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66b415b170 msgr2=0x7f66b414c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:02.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.408+0000 7f66b37fe640 1 --2- 172.21.15.132:0/3255420608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66b415b170 0x7f66b414c670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.408+0000 7f66b37fe640 1 -- 172.21.15.132:0/3255420608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66b40cca20 msgr2=0x7f66b415ccf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:02.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.408+0000 7f66b37fe640 1 --2- 172.21.15.132:0/3255420608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66b40cca20 0x7f66b415ccf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.408+0000 7f66b37fe640 1 -- 172.21.15.132:0/3255420608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66ac009a70 con 0x7f66b40cd570 2023-12-20T04:44:02.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.409+0000 7f66b37fe640 1 --2- 172.21.15.132:0/3255420608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66b40cd570 0x7f66b40cb3a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f66a800c7f0 tx=0x7f66a800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:02.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.409+0000 7f66b0ff9640 1 -- 172.21.15.132:0/3255420608 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a8007a30 con 0x7f66b40cd570 2023-12-20T04:44:02.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.409+0000 7f66b0ff9640 1 -- 172.21.15.132:0/3255420608 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66a8007b90 con 0x7f66b40cd570 2023-12-20T04:44:02.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.409+0000 7f66ba35c640 1 -- 172.21.15.132:0/3255420608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66b415c210 con 0x7f66b40cd570 2023-12-20T04:44:02.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.409+0000 7f66b0ff9640 1 -- 172.21.15.132:0/3255420608 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66a800ce40 con 0x7f66b40cd570 2023-12-20T04:44:02.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.409+0000 7f66ba35c640 1 -- 172.21.15.132:0/3255420608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66b40cb8e0 con 0x7f66b40cd570 2023-12-20T04:44:02.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.410+0000 7f66ba35c640 1 -- 172.21.15.132:0/3255420608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66b404e840 con 0x7f66b40cd570 2023-12-20T04:44:02.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.410+0000 7f66b0ff9640 1 -- 172.21.15.132:0/3255420608 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f66a80113f0 con 0x7f66b40cd570 2023-12-20T04:44:02.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.411+0000 7f66b0ff9640 1 --2- 172.21.15.132:0/3255420608 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f66a006a430 0x7f66a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:02.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.411+0000 7f66b0ff9640 1 -- 172.21.15.132:0/3255420608 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66a8088ab0 con 0x7f66b40cd570 2023-12-20T04:44:02.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.411+0000 7f66b3fff640 1 --2- 172.21.15.132:0/3255420608 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f66a006a430 0x7f66a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:02.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.411+0000 7f66b3fff640 1 --2- 172.21.15.132:0/3255420608 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f66a006a430 0x7f66a006c8f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f66a4000f60 tx=0x7f66a4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:02.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.415+0000 7f66b0ff9640 1 -- 172.21.15.132:0/3255420608 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f66a80540a0 con 0x7f66b40cd570 2023-12-20T04:44:02.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.591+0000 7f66ba35c640 1 -- 172.21.15.132:0/3255420608 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f66b40acbd0 con 0x7f66b40cd570 2023-12-20T04:44:02.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.591+0000 7f66b0ff9640 1 -- 172.21.15.132:0/3255420608 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v35) v1 ==== 80+0+0 (secure 0 0 0) 0x7f66a801f080 con 0x7f66b40cd570 2023-12-20T04:44:02.593 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:44:02.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.593+0000 7f66ba35c640 1 -- 172.21.15.132:0/3255420608 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f66a006a430 msgr2=0x7f66a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:02.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.593+0000 7f66ba35c640 1 --2- 172.21.15.132:0/3255420608 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f66a006a430 0x7f66a006c8f0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f66a4000f60 tx=0x7f66a4009040 comp rx=0 tx=0).stop 2023-12-20T04:44:02.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.593+0000 7f66ba35c640 1 -- 172.21.15.132:0/3255420608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66b40cd570 msgr2=0x7f66b40cb3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:02.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.593+0000 7f66ba35c640 1 --2- 172.21.15.132:0/3255420608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66b40cd570 0x7f66b40cb3a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f66a800c7f0 tx=0x7f66a800cbf0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.593+0000 7f66ba35c640 1 -- 172.21.15.132:0/3255420608 shutdown_connections 2023-12-20T04:44:02.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.593+0000 7f66ba35c640 1 --2- 172.21.15.132:0/3255420608 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f66a006a430 0x7f66a006c8f0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.593+0000 7f66ba35c640 1 --2- 172.21.15.132:0/3255420608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f66b415b170 0x7f66b414c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.593+0000 7f66ba35c640 1 --2- 172.21.15.132:0/3255420608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66b40cd570 0x7f66b40cb3a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.593+0000 7f66ba35c640 1 --2- 172.21.15.132:0/3255420608 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f66b40cca20 0x7f66b415ccf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:02.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.593+0000 7f66ba35c640 1 -- 172.21.15.132:0/3255420608 >> 172.21.15.132:0/3255420608 conn(0x7f66b40cbd10 msgr2=0x7f66b40aceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:02.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.593+0000 7f66ba35c640 1 -- 172.21.15.132:0/3255420608 shutdown_connections 2023-12-20T04:44:02.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:02.593+0000 7f66ba35c640 1 -- 172.21.15.132:0/3255420608 wait complete. 2023-12-20T04:44:02.606 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi187.front.sepia.ceph.com... 2023-12-20T04:44:02.606 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:02.606 DEBUG:teuthology.orchestra.run.smithi187:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-20T04:44:02.638 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[86590]: fuse finished with error 0 and tester_r 0 2023-12-20T04:44:02.639 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:44:02.639 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:02.640 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-20T04:44:02.809 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:44:02.810 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:44:02.825 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:44:02.825 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:44:02.825 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:02.825 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-20T04:44:02.880 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:44:02.880 INFO:teuthology.orchestra.run.smithi132.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-20T04:44:02.881 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:44:02.881 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:44:02.898 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:44:02.899 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:44:02.899 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:02.899 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-20T04:44:02.956 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:44:02.956 INFO:teuthology.orchestra.run.smithi187.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-20T04:44:02.957 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:44:03.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.055+0000 7fc89ae73640 1 Processor -- start 2023-12-20T04:44:03.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.055+0000 7fc89ae73640 1 -- start start 2023-12-20T04:44:03.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.056+0000 7fc89ae73640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc8940b4de0 0x7fc8940d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.056+0000 7fc89ae73640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8940b5ec0 con 0x7fc8940b4980 2023-12-20T04:44:03.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.056+0000 7fc89ae73640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8941617e0 con 0x7fc894160450 2023-12-20T04:44:03.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.056+0000 7fc89ae73640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8940d0fc0 con 0x7fc8940b4de0 2023-12-20T04:44:03.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.056+0000 7fc899410640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc8940b4de0 0x7fc8940d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.056+0000 7fc893fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc8940b4980 0x7fc8940d1aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44900/0 (socket says 172.21.15.132:44900) 2023-12-20T04:44:03.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.056+0000 7fc893fff640 1 -- 172.21.15.132:0/979592582 learned_addr learned my addr 172.21.15.132:0/979592582 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:03.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.056+0000 7fc899410640 1 -- 172.21.15.132:0/979592582 >> v1:172.21.15.187:6789/0 conn(0x7fc894160450 legacy=0x7fc894160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:03.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.056+0000 7fc8937fe640 1 -- 172.21.15.132:0/979592582 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4253588902 0 0) 0x7fc8940b5ec0 con 0x7fc8940b4980 2023-12-20T04:44:03.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.056+0000 7fc899410640 1 -- 172.21.15.132:0/979592582 >> v1:172.21.15.132:6789/0 conn(0x7fc8940b4980 legacy=0x7fc8940d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.056+0000 7fc899410640 1 -- 172.21.15.132:0/979592582 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8940d12a0 con 0x7fc8940b4de0 2023-12-20T04:44:03.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.057+0000 7fc899410640 1 --2- 172.21.15.132:0/979592582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8940b4de0 0x7fc8940d21b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009d90 tx=0x7fc88c02bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e013fc76fffb9762 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:03.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.057+0000 7fc8937fe640 1 -- 172.21.15.132:0/979592582 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c02cd80 con 0x7fc8940b4de0 2023-12-20T04:44:03.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.057+0000 7fc8937fe640 1 -- 172.21.15.132:0/979592582 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88c034440 con 0x7fc8940b4de0 2023-12-20T04:44:03.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.057+0000 7fc8937fe640 1 -- 172.21.15.132:0/979592582 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c0347d0 con 0x7fc8940b4de0 2023-12-20T04:44:03.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.058+0000 7fc89ae73640 1 -- 172.21.15.132:0/979592582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8940b4de0 msgr2=0x7fc8940d21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.058+0000 7fc89ae73640 1 --2- 172.21.15.132:0/979592582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8940b4de0 0x7fc8940d21b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fc88c009d90 tx=0x7fc88c02bfd0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.058+0000 7fc89ae73640 1 -- 172.21.15.132:0/979592582 shutdown_connections 2023-12-20T04:44:03.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.058+0000 7fc89ae73640 1 --2- 172.21.15.132:0/979592582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8940b4de0 0x7fc8940d21b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.058+0000 7fc89ae73640 1 -- 172.21.15.132:0/979592582 >> 172.21.15.132:0/979592582 conn(0x7fc8940cf980 msgr2=0x7fc8940cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:03.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.058+0000 7fc89ae73640 1 -- 172.21.15.132:0/979592582 shutdown_connections 2023-12-20T04:44:03.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.058+0000 7fc89ae73640 1 -- 172.21.15.132:0/979592582 wait complete. 2023-12-20T04:44:03.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.059+0000 7fc89ae73640 1 Processor -- start 2023-12-20T04:44:03.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.059+0000 7fc89ae73640 1 -- start start 2023-12-20T04:44:03.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc89ae73640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8940b4980 0x7fc89415dc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc89ae73640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8940b4de0 0x7fc89415e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc89ae73640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc894160450 0x7fc8940ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc89ae73640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940d22e0 con 0x7fc8940b4980 2023-12-20T04:44:03.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc89ae73640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc894143a30 con 0x7fc894160450 2023-12-20T04:44:03.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc89ae73640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc894143d10 con 0x7fc8940b4de0 2023-12-20T04:44:03.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc898c0f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8940b4980 0x7fc89415dc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc898c0f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8940b4980 0x7fc89415dc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50888/0 (socket says 172.21.15.132:50888) 2023-12-20T04:44:03.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc898c0f640 1 -- 172.21.15.132:0/1640565619 learned_addr learned my addr 172.21.15.132:0/1640565619 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:03.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc898c0f640 1 -- 172.21.15.132:0/1640565619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8940b4de0 msgr2=0x7fc89415e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc899410640 1 --2- 172.21.15.132:0/1640565619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc894160450 0x7fc8940ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc893fff640 1 --2- 172.21.15.132:0/1640565619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8940b4de0 0x7fc89415e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc898c0f640 1 --2- 172.21.15.132:0/1640565619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8940b4de0 0x7fc89415e1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc898c0f640 1 -- 172.21.15.132:0/1640565619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc894160450 msgr2=0x7fc8940ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc898c0f640 1 --2- 172.21.15.132:0/1640565619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc894160450 0x7fc8940ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc898c0f640 1 -- 172.21.15.132:0/1640565619 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc88c009a70 con 0x7fc8940b4980 2023-12-20T04:44:03.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc898c0f640 1 --2- 172.21.15.132:0/1640565619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8940b4980 0x7fc89415dc90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc88800c400 tx=0x7fc88800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:03.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc8917fa640 1 -- 172.21.15.132:0/1640565619 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8880052d0 con 0x7fc8940b4980 2023-12-20T04:44:03.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc8917fa640 1 -- 172.21.15.132:0/1640565619 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc888005430 con 0x7fc8940b4980 2023-12-20T04:44:03.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc89ae73640 1 -- 172.21.15.132:0/1640565619 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc894143ff0 con 0x7fc8940b4980 2023-12-20T04:44:03.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc8917fa640 1 -- 172.21.15.132:0/1640565619 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc888003830 con 0x7fc8940b4980 2023-12-20T04:44:03.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.060+0000 7fc89ae73640 1 -- 172.21.15.132:0/1640565619 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8941445b0 con 0x7fc8940b4980 2023-12-20T04:44:03.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.061+0000 7fc89ae73640 1 -- 172.21.15.132:0/1640565619 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8940cd3a0 con 0x7fc8940b4980 2023-12-20T04:44:03.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.062+0000 7fc8917fa640 1 -- 172.21.15.132:0/1640565619 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc888003990 con 0x7fc8940b4980 2023-12-20T04:44:03.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.062+0000 7fc8917fa640 1 --2- 172.21.15.132:0/1640565619 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc87806a430 0x7fc87806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.062+0000 7fc8917fa640 1 -- 172.21.15.132:0/1640565619 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc888087eb0 con 0x7fc8940b4980 2023-12-20T04:44:03.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.062+0000 7fc893fff640 1 --2- 172.21.15.132:0/1640565619 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc87806a430 0x7fc87806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.063+0000 7fc893fff640 1 --2- 172.21.15.132:0/1640565619 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc87806a430 0x7fc87806c8f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc880007fd0 tx=0x7fc880009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:03.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.067+0000 7fc8917fa640 1 -- 172.21.15.132:0/1640565619 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc8880534a0 con 0x7fc8940b4980 2023-12-20T04:44:03.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.265+0000 7fc89ae73640 1 -- 172.21.15.132:0/1640565619 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc89404e840 con 0x7fc8940b4980 2023-12-20T04:44:03.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.265+0000 7fc8917fa640 1 -- 172.21.15.132:0/1640565619 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4712 (secure 0 0 0) 0x7fc888056ac0 con 0x7fc8940b4980 2023-12-20T04:44:03.267 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:03.267 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/703933798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":703933798},{"type":"v1","addr":"172.21.15.187:6835","nonce":703933798}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3137083608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3137083608},{"type":"v1","addr":"172.21.15.187:6833","nonce":3137083608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1340012349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1340012349},{"type":"v1","addr":"172.21.15.132:6836","nonce":1340012349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:43:44.388671+0000","modified":"2023-12-20T04:43:47.069930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/359299732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":359299732},{"type":"v1","addr":"172.21.15.132:6837","nonce":359299732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-20T04:44:03.268 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 13 2023-12-20T04:44:03.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.267+0000 7fc89ae73640 1 -- 172.21.15.132:0/1640565619 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc87806a430 msgr2=0x7fc87806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.267+0000 7fc89ae73640 1 --2- 172.21.15.132:0/1640565619 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc87806a430 0x7fc87806c8f0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7fc880007fd0 tx=0x7fc880009040 comp rx=0 tx=0).stop 2023-12-20T04:44:03.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.267+0000 7fc89ae73640 1 -- 172.21.15.132:0/1640565619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8940b4980 msgr2=0x7fc89415dc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.267+0000 7fc89ae73640 1 --2- 172.21.15.132:0/1640565619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8940b4980 0x7fc89415dc90 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fc88800c400 tx=0x7fc88800c8c0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.267+0000 7fc89ae73640 1 -- 172.21.15.132:0/1640565619 shutdown_connections 2023-12-20T04:44:03.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.267+0000 7fc89ae73640 1 --2- 172.21.15.132:0/1640565619 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc87806a430 0x7fc87806c8f0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.267+0000 7fc89ae73640 1 --2- 172.21.15.132:0/1640565619 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc894160450 0x7fc8940ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.267+0000 7fc89ae73640 1 --2- 172.21.15.132:0/1640565619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8940b4de0 0x7fc89415e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.267+0000 7fc89ae73640 1 --2- 172.21.15.132:0/1640565619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8940b4980 0x7fc89415dc90 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.267+0000 7fc89ae73640 1 -- 172.21.15.132:0/1640565619 >> 172.21.15.132:0/1640565619 conn(0x7fc8940cf980 msgr2=0x7fc89415eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:03.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.267+0000 7fc89ae73640 1 -- 172.21.15.132:0/1640565619 shutdown_connections 2023-12-20T04:44:03.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.267+0000 7fc89ae73640 1 -- 172.21.15.132:0/1640565619 wait complete. 2023-12-20T04:44:03.280 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:44:03.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.378+0000 7fd189f99640 1 Processor -- start 2023-12-20T04:44:03.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.378+0000 7fd189f99640 1 -- start start 2023-12-20T04:44:03.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.379+0000 7fd189f99640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd184159b50 0x7fd1840c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.379+0000 7fd189f99640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd18406c240 0x7fd18406c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.379+0000 7fd189f99640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1840ccf30 con 0x7fd18415e530 2023-12-20T04:44:03.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.379+0000 7fd189f99640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd18406cc10 con 0x7fd184159b50 2023-12-20T04:44:03.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.379+0000 7fd189f99640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1840caa60 con 0x7fd18406c240 2023-12-20T04:44:03.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.379+0000 7fd1837fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd184159b50 0x7fd1840c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.379+0000 7fd182ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd18415e530 0x7fd18406fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44910/0 (socket says 172.21.15.132:44910) 2023-12-20T04:44:03.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.379+0000 7fd182ffd640 1 -- 172.21.15.132:0/3448818740 learned_addr learned my addr 172.21.15.132:0/3448818740 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:03.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.379+0000 7fd183fff640 1 --2- 172.21.15.132:0/3448818740 >> v2:172.21.15.187:3300/0 conn(0x7fd18406c240 0x7fd18406c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.379+0000 7fd1837fe640 1 -- 172.21.15.132:0/3448818740 >> v2:172.21.15.187:3300/0 conn(0x7fd18406c240 msgr2=0x7fd18406c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.379+0000 7fd1837fe640 1 --2- 172.21.15.132:0/3448818740 >> v2:172.21.15.187:3300/0 conn(0x7fd18406c240 0x7fd18406c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.379+0000 7fd1837fe640 1 -- 172.21.15.132:0/3448818740 >> v1:172.21.15.132:6789/0 conn(0x7fd18415e530 legacy=0x7fd18406fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.379+0000 7fd1827fc640 1 -- 172.21.15.132:0/3448818740 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 765577769 0 0) 0x7fd1840ccf30 con 0x7fd18415e530 2023-12-20T04:44:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.379+0000 7fd1837fe640 1 -- 172.21.15.132:0/3448818740 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1840ca1c0 con 0x7fd184159b50 2023-12-20T04:44:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.380+0000 7fd1837fe640 1 --2- 172.21.15.132:0/3448818740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd184159b50 0x7fd1840c9930 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd17400ba40 tx=0x7fd17402e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d15876ff487a8b95 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.380+0000 7fd1827fc640 1 -- 172.21.15.132:0/3448818740 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd17402ee50 con 0x7fd184159b50 2023-12-20T04:44:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.380+0000 7fd1827fc640 1 -- 172.21.15.132:0/3448818740 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd174036440 con 0x7fd184159b50 2023-12-20T04:44:03.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.380+0000 7fd1827fc640 1 -- 172.21.15.132:0/3448818740 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1740367d0 con 0x7fd184159b50 2023-12-20T04:44:03.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.381+0000 7fd189f99640 1 -- 172.21.15.132:0/3448818740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd184159b50 msgr2=0x7fd1840c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.381+0000 7fd189f99640 1 --2- 172.21.15.132:0/3448818740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd184159b50 0x7fd1840c9930 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd17400ba40 tx=0x7fd17402e0a0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.381+0000 7fd189f99640 1 -- 172.21.15.132:0/3448818740 shutdown_connections 2023-12-20T04:44:03.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.381+0000 7fd189f99640 1 --2- 172.21.15.132:0/3448818740 >> v2:172.21.15.187:3300/0 conn(0x7fd18406c240 0x7fd18406c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.381+0000 7fd189f99640 1 --2- 172.21.15.132:0/3448818740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd184159b50 0x7fd1840c9930 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.381+0000 7fd189f99640 1 -- 172.21.15.132:0/3448818740 >> 172.21.15.132:0/3448818740 conn(0x7fd1840ced10 msgr2=0x7fd1840cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:03.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.381+0000 7fd189f99640 1 -- 172.21.15.132:0/3448818740 shutdown_connections 2023-12-20T04:44:03.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.381+0000 7fd189f99640 1 -- 172.21.15.132:0/3448818740 wait complete. 2023-12-20T04:44:03.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.382+0000 7fd189f99640 1 Processor -- start 2023-12-20T04:44:03.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.382+0000 7fd189f99640 1 -- start start 2023-12-20T04:44:03.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd189f99640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd18406c240 0x7fd1840c4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd189f99640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd184159b50 0x7fd18414bbc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd189f99640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd18415e530 0x7fd1840b3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd189f99640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1840c4ed0 con 0x7fd18406c240 2023-12-20T04:44:03.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd189f99640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1841eeb40 con 0x7fd184159b50 2023-12-20T04:44:03.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd189f99640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd18415c590 con 0x7fd18415e530 2023-12-20T04:44:03.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd1837fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd18406c240 0x7fd1840c4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd1837fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd18406c240 0x7fd1840c4990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50906/0 (socket says 172.21.15.132:50906) 2023-12-20T04:44:03.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd1837fe640 1 -- 172.21.15.132:0/2496889256 learned_addr learned my addr 172.21.15.132:0/2496889256 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:03.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd183fff640 1 --2- 172.21.15.132:0/2496889256 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd18415e530 0x7fd1840b3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd182ffd640 1 --2- 172.21.15.132:0/2496889256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd184159b50 0x7fd18414bbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd1837fe640 1 -- 172.21.15.132:0/2496889256 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd18415e530 msgr2=0x7fd1840b3fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd1837fe640 1 --2- 172.21.15.132:0/2496889256 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd18415e530 0x7fd1840b3fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd1837fe640 1 -- 172.21.15.132:0/2496889256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd184159b50 msgr2=0x7fd18414bbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd1837fe640 1 --2- 172.21.15.132:0/2496889256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd184159b50 0x7fd18414bbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd1837fe640 1 -- 172.21.15.132:0/2496889256 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd17400b6a0 con 0x7fd18406c240 2023-12-20T04:44:03.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd1837fe640 1 --2- 172.21.15.132:0/2496889256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd18406c240 0x7fd1840c4990 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd174039040 tx=0x7fd1740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:03.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd16bfff640 1 -- 172.21.15.132:0/2496889256 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1740408d0 con 0x7fd18406c240 2023-12-20T04:44:03.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.383+0000 7fd16bfff640 1 -- 172.21.15.132:0/2496889256 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd174040a50 con 0x7fd18406c240 2023-12-20T04:44:03.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.384+0000 7fd189f99640 1 -- 172.21.15.132:0/2496889256 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd18415c870 con 0x7fd18406c240 2023-12-20T04:44:03.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.384+0000 7fd16bfff640 1 -- 172.21.15.132:0/2496889256 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd174040e00 con 0x7fd18406c240 2023-12-20T04:44:03.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.384+0000 7fd189f99640 1 -- 172.21.15.132:0/2496889256 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd18415ce30 con 0x7fd18406c240 2023-12-20T04:44:03.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.385+0000 7fd189f99640 1 -- 172.21.15.132:0/2496889256 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd18414d300 con 0x7fd18406c240 2023-12-20T04:44:03.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.385+0000 7fd16bfff640 1 -- 172.21.15.132:0/2496889256 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd17403f3a0 con 0x7fd18406c240 2023-12-20T04:44:03.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.385+0000 7fd16bfff640 1 --2- 172.21.15.132:0/2496889256 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd17006a430 0x7fd17006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.386+0000 7fd182ffd640 1 --2- 172.21.15.132:0/2496889256 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd17006a430 0x7fd17006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.386+0000 7fd16bfff640 1 -- 172.21.15.132:0/2496889256 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1740ad7a0 con 0x7fd18406c240 2023-12-20T04:44:03.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.386+0000 7fd182ffd640 1 --2- 172.21.15.132:0/2496889256 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd17006a430 0x7fd17006c8f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd18414ca70 tx=0x7fd178007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:03.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.390+0000 7fd16bfff640 1 -- 172.21.15.132:0/2496889256 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd174078d90 con 0x7fd18406c240 2023-12-20T04:44:03.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.558+0000 7fd189f99640 1 -- 172.21.15.132:0/2496889256 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd18404e840 con 0x7fd18406c240 2023-12-20T04:44:03.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.559+0000 7fd16bfff640 1 -- 172.21.15.132:0/2496889256 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16149 (secure 0 0 0) 0x7fd17407c3b0 con 0x7fd18406c240 2023-12-20T04:44:03.561 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:03.561 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":35,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:43:56.805688+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:43:42.932158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-20T04:43:43.361561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:44:03.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.561+0000 7fd189f99640 1 -- 172.21.15.132:0/2496889256 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd17006a430 msgr2=0x7fd17006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.561+0000 7fd189f99640 1 --2- 172.21.15.132:0/2496889256 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd17006a430 0x7fd17006c8f0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7fd18414ca70 tx=0x7fd178007b50 comp rx=0 tx=0).stop 2023-12-20T04:44:03.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.561+0000 7fd189f99640 1 -- 172.21.15.132:0/2496889256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd18406c240 msgr2=0x7fd1840c4990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.561+0000 7fd189f99640 1 --2- 172.21.15.132:0/2496889256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd18406c240 0x7fd1840c4990 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fd174039040 tx=0x7fd1740046c0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.561+0000 7fd189f99640 1 -- 172.21.15.132:0/2496889256 shutdown_connections 2023-12-20T04:44:03.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.561+0000 7fd189f99640 1 --2- 172.21.15.132:0/2496889256 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd17006a430 0x7fd17006c8f0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.561+0000 7fd189f99640 1 --2- 172.21.15.132:0/2496889256 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd18415e530 0x7fd1840b3fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.561+0000 7fd189f99640 1 --2- 172.21.15.132:0/2496889256 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd184159b50 0x7fd18414bbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.561+0000 7fd189f99640 1 --2- 172.21.15.132:0/2496889256 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd18406c240 0x7fd1840c4990 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.561+0000 7fd189f99640 1 -- 172.21.15.132:0/2496889256 >> 172.21.15.132:0/2496889256 conn(0x7fd1840ced10 msgr2=0x7fd18414cbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:03.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.561+0000 7fd189f99640 1 -- 172.21.15.132:0/2496889256 shutdown_connections 2023-12-20T04:44:03.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.561+0000 7fd189f99640 1 -- 172.21.15.132:0/2496889256 wait complete. 2023-12-20T04:44:03.574 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:43:42.932158+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.25, 'score_stable': 2.25, 'optimal_score': 1, 'raw_score_acting': 2.25, 'raw_score_stable': 2.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:43:43.361561+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '33', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:44:03.575 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:44:03.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.674+0000 7f2db1e5f640 1 Processor -- start 2023-12-20T04:44:03.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.674+0000 7f2db1e5f640 1 -- start start 2023-12-20T04:44:03.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.675+0000 7f2db1e5f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2dac0cf790 0x7f2dac0cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.675+0000 7f2db1e5f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dac0d2920 con 0x7f2dac15d300 2023-12-20T04:44:03.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.675+0000 7f2db1e5f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2dac0d1d10 con 0x7f2dac0b6080 2023-12-20T04:44:03.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.675+0000 7f2db1e5f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2dac0d0180 con 0x7f2dac0cf790 2023-12-20T04:44:03.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.675+0000 7f2dab7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2dac15d300 0x7f2dac0d1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44918/0 (socket says 172.21.15.132:44918) 2023-12-20T04:44:03.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.675+0000 7f2dab7fe640 1 -- 172.21.15.132:0/3793259500 learned_addr learned my addr 172.21.15.132:0/3793259500 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:03.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daaffd640 1 --2- 172.21.15.132:0/3793259500 >> v2:172.21.15.187:3300/0 conn(0x7f2dac0cf790 0x7f2dac0cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daa7fc640 1 -- 172.21.15.132:0/3793259500 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 808240807 0 0) 0x7f2dac0d2920 con 0x7f2dac15d300 2023-12-20T04:44:03.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daa7fc640 1 -- 172.21.15.132:0/3793259500 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2d94003520 con 0x7f2dac15d300 2023-12-20T04:44:03.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daa7fc640 1 -- 172.21.15.132:0/3793259500 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1535004324 0 0) 0x7f2d94003520 con 0x7f2dac15d300 2023-12-20T04:44:03.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daa7fc640 1 -- 172.21.15.132:0/3793259500 >> v2:172.21.15.187:3300/0 conn(0x7f2dac0cf790 msgr2=0x7f2dac0cfc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:03.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daa7fc640 1 --2- 172.21.15.132:0/3793259500 >> v2:172.21.15.187:3300/0 conn(0x7f2dac0cf790 0x7f2dac0cfc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daa7fc640 1 -- 172.21.15.132:0/3793259500 >> v1:172.21.15.187:6789/0 conn(0x7f2dac0b6080 legacy=0x7f2dac0b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daa7fc640 1 -- 172.21.15.132:0/3793259500 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac0d1ff0 con 0x7f2dac15d300 2023-12-20T04:44:03.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daa7fc640 1 -- 172.21.15.132:0/3793259500 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f2d9c0019f0 con 0x7f2dac15d300 2023-12-20T04:44:03.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daa7fc640 1 -- 172.21.15.132:0/3793259500 >> v1:172.21.15.132:6789/0 conn(0x7f2dac15d300 legacy=0x7f2dac0d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daa7fc640 1 --2- 172.21.15.132:0/3793259500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d94003970 0x7f2d94003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daa7fc640 1 --2- 172.21.15.132:0/3793259500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d940047c0 0x7f2d94004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daa7fc640 1 --2- 172.21.15.132:0/3793259500 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d94005180 0x7f2d9400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daa7fc640 1 -- 172.21.15.132:0/3793259500 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac0d0180 con 0x7f2d94005180 2023-12-20T04:44:03.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daa7fc640 1 -- 172.21.15.132:0/3793259500 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9400c020 con 0x7f2d94003970 2023-12-20T04:44:03.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daa7fc640 1 -- 172.21.15.132:0/3793259500 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d9400c1e0 con 0x7f2d940047c0 2023-12-20T04:44:03.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2dabfff640 1 --2- 172.21.15.132:0/3793259500 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d94005180 0x7f2d9400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2dab7fe640 1 --2- 172.21.15.132:0/3793259500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d94003970 0x7f2d94003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daaffd640 1 --2- 172.21.15.132:0/3793259500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d940047c0 0x7f2d94004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2dabfff640 1 -- 172.21.15.132:0/3793259500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d940047c0 msgr2=0x7f2d94004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:03.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2dabfff640 1 --2- 172.21.15.132:0/3793259500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d940047c0 0x7f2d94004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2dabfff640 1 -- 172.21.15.132:0/3793259500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d94003970 msgr2=0x7f2d94003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:03.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2dabfff640 1 --2- 172.21.15.132:0/3793259500 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d94003970 0x7f2d94003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2dabfff640 1 -- 172.21.15.132:0/3793259500 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d94003520 con 0x7f2d94005180 2023-12-20T04:44:03.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.676+0000 7f2daaffd640 1 --2- 172.21.15.132:0/3793259500 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d940047c0 0x7f2d94004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:03.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.677+0000 7f2dabfff640 1 -- 172.21.15.132:0/3793259500 reap_dead start 2023-12-20T04:44:03.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.677+0000 7f2dabfff640 1 --2- 172.21.15.132:0/3793259500 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d94005180 0x7f2d9400b980 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2da4001750 tx=0x7f2d940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59c01f3a41855912 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:03.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.677+0000 7f2daa7fc640 1 -- 172.21.15.132:0/3793259500 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da40052d0 con 0x7f2d94005180 2023-12-20T04:44:03.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.677+0000 7f2daa7fc640 1 -- 172.21.15.132:0/3793259500 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da402e050 con 0x7f2d94005180 2023-12-20T04:44:03.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.677+0000 7f2daa7fc640 1 -- 172.21.15.132:0/3793259500 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4003830 con 0x7f2d94005180 2023-12-20T04:44:03.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.678+0000 7f2db1e5f640 1 -- 172.21.15.132:0/3793259500 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d94005180 msgr2=0x7f2d9400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.678+0000 7f2db1e5f640 1 --2- 172.21.15.132:0/3793259500 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d94005180 0x7f2d9400b980 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f2da4001750 tx=0x7f2d940057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.678+0000 7f2db1e5f640 1 -- 172.21.15.132:0/3793259500 shutdown_connections 2023-12-20T04:44:03.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.678+0000 7f2db1e5f640 1 --2- 172.21.15.132:0/3793259500 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d94005180 0x7f2d9400b980 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.678+0000 7f2db1e5f640 1 -- 172.21.15.132:0/3793259500 >> 172.21.15.132:0/3793259500 conn(0x7f2dac06a3d0 msgr2=0x7f2dac06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:03.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.678+0000 7f2db1e5f640 1 -- 172.21.15.132:0/3793259500 shutdown_connections 2023-12-20T04:44:03.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.678+0000 7f2db1e5f640 1 -- 172.21.15.132:0/3793259500 wait complete. 2023-12-20T04:44:03.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.679+0000 7f2db1e5f640 1 Processor -- start 2023-12-20T04:44:03.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.679+0000 7f2db1e5f640 1 -- start start 2023-12-20T04:44:03.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.680+0000 7f2db1e5f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d94005180 0x7f2dac0c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.680+0000 7f2db1e5f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2dac15b9f0 0x7f2dac15be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.680+0000 7f2db1e5f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2dac1561f0 0x7f2dac156670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.680+0000 7f2db1e5f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac15c3b0 con 0x7f2dac1561f0 2023-12-20T04:44:03.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.680+0000 7f2db1e5f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac1f5d40 con 0x7f2d94005180 2023-12-20T04:44:03.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.680+0000 7f2db1e5f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2dac1f68c0 con 0x7f2dac15b9f0 2023-12-20T04:44:03.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.680+0000 7f2dabfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2dac1561f0 0x7f2dac156670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.680+0000 7f2dabfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2dac1561f0 0x7f2dac156670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50924/0 (socket says 172.21.15.132:50924) 2023-12-20T04:44:03.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.680+0000 7f2dabfff640 1 -- 172.21.15.132:0/1851050934 learned_addr learned my addr 172.21.15.132:0/1851050934 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:03.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.680+0000 7f2dabfff640 1 -- 172.21.15.132:0/1851050934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2dac15b9f0 msgr2=0x7f2dac15be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.680+0000 7f2dabfff640 1 --2- 172.21.15.132:0/1851050934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2dac15b9f0 0x7f2dac15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.680+0000 7f2dabfff640 1 -- 172.21.15.132:0/1851050934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d94005180 msgr2=0x7f2dac0c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.680+0000 7f2dab7fe640 1 --2- 172.21.15.132:0/1851050934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d94005180 0x7f2dac0c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.680+0000 7f2dabfff640 1 --2- 172.21.15.132:0/1851050934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d94005180 0x7f2dac0c88c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.680+0000 7f2dabfff640 1 -- 172.21.15.132:0/1851050934 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac1f5f90 con 0x7f2dac1561f0 2023-12-20T04:44:03.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.680+0000 7f2dabfff640 1 --2- 172.21.15.132:0/1851050934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2dac1561f0 0x7f2dac156670 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2da402bd00 tx=0x7f2da4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:03.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.680+0000 7f2d93fff640 1 -- 172.21.15.132:0/1851050934 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4007030 con 0x7f2dac1561f0 2023-12-20T04:44:03.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.681+0000 7f2d93fff640 1 -- 172.21.15.132:0/1851050934 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2da4007190 con 0x7f2dac1561f0 2023-12-20T04:44:03.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.681+0000 7f2db1e5f640 1 -- 172.21.15.132:0/1851050934 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dac1f6270 con 0x7f2dac1561f0 2023-12-20T04:44:03.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.681+0000 7f2d93fff640 1 -- 172.21.15.132:0/1851050934 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2da4007500 con 0x7f2dac1561f0 2023-12-20T04:44:03.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.681+0000 7f2db1e5f640 1 -- 172.21.15.132:0/1851050934 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dac0c8e00 con 0x7f2dac1561f0 2023-12-20T04:44:03.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.681+0000 7f2db1e5f640 1 -- 172.21.15.132:0/1851050934 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dac04e840 con 0x7f2dac1561f0 2023-12-20T04:44:03.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.682+0000 7f2d93fff640 1 -- 172.21.15.132:0/1851050934 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2da403a070 con 0x7f2dac1561f0 2023-12-20T04:44:03.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.682+0000 7f2d93fff640 1 --2- 172.21.15.132:0/1851050934 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d9806a460 0x7f2d9806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.682+0000 7f2d93fff640 1 -- 172.21.15.132:0/1851050934 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2da4037070 con 0x7f2dac1561f0 2023-12-20T04:44:03.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.682+0000 7f2dab7fe640 1 --2- 172.21.15.132:0/1851050934 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d9806a460 0x7f2d9806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.683+0000 7f2dab7fe640 1 --2- 172.21.15.132:0/1851050934 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d9806a460 0x7f2d9806c920 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c0013d0 tx=0x7f2d9c006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:03.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.687+0000 7f2d93fff640 1 -- 172.21.15.132:0/1851050934 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2da4074e20 con 0x7f2dac1561f0 2023-12-20T04:44:03.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.852+0000 7f2db1e5f640 1 -- 172.21.15.132:0/1851050934 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2dac15c3b0 con 0x7f2dac1561f0 2023-12-20T04:44:03.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.853+0000 7f2d93fff640 1 -- 172.21.15.132:0/1851050934 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v35) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2dac15c3b0 con 0x7f2dac1561f0 2023-12-20T04:44:03.855 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:44:03.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.855+0000 7f2db1e5f640 1 -- 172.21.15.132:0/1851050934 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d9806a460 msgr2=0x7f2d9806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.855+0000 7f2db1e5f640 1 --2- 172.21.15.132:0/1851050934 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d9806a460 0x7f2d9806c920 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f2d9c0013d0 tx=0x7f2d9c006040 comp rx=0 tx=0).stop 2023-12-20T04:44:03.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.855+0000 7f2db1e5f640 1 -- 172.21.15.132:0/1851050934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2dac1561f0 msgr2=0x7f2dac156670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.855+0000 7f2db1e5f640 1 --2- 172.21.15.132:0/1851050934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2dac1561f0 0x7f2dac156670 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f2da402bd00 tx=0x7f2da4001120 comp rx=0 tx=0).stop 2023-12-20T04:44:03.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.855+0000 7f2db1e5f640 1 -- 172.21.15.132:0/1851050934 shutdown_connections 2023-12-20T04:44:03.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.855+0000 7f2db1e5f640 1 --2- 172.21.15.132:0/1851050934 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d9806a460 0x7f2d9806c920 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.855+0000 7f2db1e5f640 1 --2- 172.21.15.132:0/1851050934 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2dac1561f0 0x7f2dac156670 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.855+0000 7f2db1e5f640 1 --2- 172.21.15.132:0/1851050934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2dac15b9f0 0x7f2dac15be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.855+0000 7f2db1e5f640 1 --2- 172.21.15.132:0/1851050934 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d94005180 0x7f2dac0c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.855+0000 7f2db1e5f640 1 -- 172.21.15.132:0/1851050934 >> 172.21.15.132:0/1851050934 conn(0x7f2dac06a3d0 msgr2=0x7f2dac153290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:03.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.855+0000 7f2db1e5f640 1 -- 172.21.15.132:0/1851050934 shutdown_connections 2023-12-20T04:44:03.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.855+0000 7f2db1e5f640 1 -- 172.21.15.132:0/1851050934 wait complete. 2023-12-20T04:44:03.867 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:44:03.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.968+0000 7f0a0bf27640 1 Processor -- start 2023-12-20T04:44:03.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.969+0000 7f0a0bf27640 1 -- start start 2023-12-20T04:44:03.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.969+0000 7f0a0bf27640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0a0415aee0 0x7f0a0415eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.969+0000 7f0a0bf27640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a040cb2b0 0x7f0a040cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.969+0000 7f0a0bf27640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0a040cdbb0 0x7f0a040ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.969+0000 7f0a0bf27640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a040ce040 con 0x7f0a0415aee0 2023-12-20T04:44:03.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.969+0000 7f0a0bf27640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0a040d0130 con 0x7f0a040cdbb0 2023-12-20T04:44:03.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.969+0000 7f0a0bf27640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a0415f370 con 0x7f0a040cb2b0 2023-12-20T04:44:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.969+0000 7f0a09cc3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0a0415aee0 0x7f0a0415eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.970+0000 7f0a09cc3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0a0415aee0 0x7f0a0415eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50938/0 (socket says 172.21.15.132:50938) 2023-12-20T04:44:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.970+0000 7f0a09cc3640 1 -- 172.21.15.132:0/3143646540 learned_addr learned my addr 172.21.15.132:0/3143646540 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.970+0000 7f0a094c2640 1 --2- 172.21.15.132:0/3143646540 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a040cb2b0 0x7f0a040cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.970+0000 7f0a09cc3640 1 -- 172.21.15.132:0/3143646540 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a040cb2b0 msgr2=0x7f0a040cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.970+0000 7f0a0a4c4640 1 --2- 172.21.15.132:0/3143646540 >> v2:172.21.15.187:3300/0 conn(0x7f0a040cdbb0 0x7f0a040ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.970+0000 7f0a09cc3640 1 --2- 172.21.15.132:0/3143646540 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a040cb2b0 0x7f0a040cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.970+0000 7f0a09cc3640 1 -- 172.21.15.132:0/3143646540 >> v2:172.21.15.187:3300/0 conn(0x7f0a040cdbb0 msgr2=0x7f0a040ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.970+0000 7f0a09cc3640 1 --2- 172.21.15.132:0/3143646540 >> v2:172.21.15.187:3300/0 conn(0x7f0a040cdbb0 0x7f0a040ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.970+0000 7f0a09cc3640 1 -- 172.21.15.132:0/3143646540 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a0415f650 con 0x7f0a0415aee0 2023-12-20T04:44:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.970+0000 7f0a094c2640 1 --2- 172.21.15.132:0/3143646540 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a040cb2b0 0x7f0a040cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.970+0000 7f0a0a4c4640 1 --2- 172.21.15.132:0/3143646540 >> v2:172.21.15.187:3300/0 conn(0x7f0a040cdbb0 0x7f0a040ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.970+0000 7f0a09cc3640 1 --2- 172.21.15.132:0/3143646540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a0415aee0 0x7f0a0415eb40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0a040b3060 tx=0x7f0a0002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2c85c4cd526181e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:03.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.971+0000 7f0a08cc1640 1 -- 172.21.15.132:0/3143646540 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a0002ca70 con 0x7f0a0415aee0 2023-12-20T04:44:03.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.971+0000 7f0a08cc1640 1 -- 172.21.15.132:0/3143646540 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0a0002cbd0 con 0x7f0a0415aee0 2023-12-20T04:44:03.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.971+0000 7f0a08cc1640 1 -- 172.21.15.132:0/3143646540 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0a000343f0 con 0x7f0a0415aee0 2023-12-20T04:44:03.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.971+0000 7f0a0bf27640 1 -- 172.21.15.132:0/3143646540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a0415aee0 msgr2=0x7f0a0415eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.971+0000 7f0a0bf27640 1 --2- 172.21.15.132:0/3143646540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a0415aee0 0x7f0a0415eb40 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f0a040b3060 tx=0x7f0a0002bed0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.971+0000 7f0a0bf27640 1 -- 172.21.15.132:0/3143646540 shutdown_connections 2023-12-20T04:44:03.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.971+0000 7f0a0bf27640 1 --2- 172.21.15.132:0/3143646540 >> v2:172.21.15.187:3300/0 conn(0x7f0a040cdbb0 0x7f0a040ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.971+0000 7f0a0bf27640 1 --2- 172.21.15.132:0/3143646540 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a040cb2b0 0x7f0a040cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.971+0000 7f0a0bf27640 1 --2- 172.21.15.132:0/3143646540 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a0415aee0 0x7f0a0415eb40 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.971+0000 7f0a0bf27640 1 -- 172.21.15.132:0/3143646540 >> 172.21.15.132:0/3143646540 conn(0x7f0a04072c60 msgr2=0x7f0a04073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:03.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.971+0000 7f0a0bf27640 1 -- 172.21.15.132:0/3143646540 shutdown_connections 2023-12-20T04:44:03.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.971+0000 7f0a0bf27640 1 -- 172.21.15.132:0/3143646540 wait complete. 2023-12-20T04:44:03.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.972+0000 7f0a0bf27640 1 Processor -- start 2023-12-20T04:44:03.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.973+0000 7f0a0bf27640 1 -- start start 2023-12-20T04:44:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.973+0000 7f0a0bf27640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a040cb2b0 0x7f0a040caa70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.973+0000 7f0a0bf27640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a040cdbb0 0x7f0a04154bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.973+0000 7f0a0bf27640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a0415aee0 0x7f0a04152520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.973+0000 7f0a0bf27640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a04153ef0 con 0x7f0a0415aee0 2023-12-20T04:44:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.973+0000 7f0a0bf27640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0a041532e0 con 0x7f0a040cdbb0 2023-12-20T04:44:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.973+0000 7f0a0bf27640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0a041535c0 con 0x7f0a040cb2b0 2023-12-20T04:44:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.973+0000 7f0a0a4c4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a0415aee0 0x7f0a04152520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.973+0000 7f0a0a4c4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a0415aee0 0x7f0a04152520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50946/0 (socket says 172.21.15.132:50946) 2023-12-20T04:44:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.973+0000 7f0a0a4c4640 1 -- 172.21.15.132:0/2984833863 learned_addr learned my addr 172.21.15.132:0/2984833863 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.973+0000 7f0a09cc3640 1 --2- 172.21.15.132:0/2984833863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a040cb2b0 0x7f0a040caa70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.974+0000 7f0a094c2640 1 --2- 172.21.15.132:0/2984833863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a040cdbb0 0x7f0a04154bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.974+0000 7f0a0a4c4640 1 -- 172.21.15.132:0/2984833863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a040cb2b0 msgr2=0x7f0a040caa70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.974+0000 7f0a0a4c4640 1 --2- 172.21.15.132:0/2984833863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a040cb2b0 0x7f0a040caa70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.974+0000 7f0a0a4c4640 1 -- 172.21.15.132:0/2984833863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a040cdbb0 msgr2=0x7f0a04154bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:03.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.974+0000 7f0a0a4c4640 1 --2- 172.21.15.132:0/2984833863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a040cdbb0 0x7f0a04154bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:03.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.974+0000 7f0a0a4c4640 1 -- 172.21.15.132:0/2984833863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0a00009b30 con 0x7f0a0415aee0 2023-12-20T04:44:03.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.974+0000 7f0a0a4c4640 1 --2- 172.21.15.132:0/2984833863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a0415aee0 0x7f0a04152520 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00c7c0 tx=0x7f09fc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:03.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.974+0000 7f09fa7fc640 1 -- 172.21.15.132:0/2984833863 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc004230 con 0x7f0a0415aee0 2023-12-20T04:44:03.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.974+0000 7f09fa7fc640 1 -- 172.21.15.132:0/2984833863 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f09fc004390 con 0x7f0a0415aee0 2023-12-20T04:44:03.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.974+0000 7f09fa7fc640 1 -- 172.21.15.132:0/2984833863 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f09fc007860 con 0x7f0a0415aee0 2023-12-20T04:44:03.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.974+0000 7f0a0bf27640 1 -- 172.21.15.132:0/2984833863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0a041538a0 con 0x7f0a0415aee0 2023-12-20T04:44:03.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.974+0000 7f0a0bf27640 1 -- 172.21.15.132:0/2984833863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0a040cafb0 con 0x7f0a0415aee0 2023-12-20T04:44:03.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.975+0000 7f0a0bf27640 1 -- 172.21.15.132:0/2984833863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0a04154060 con 0x7f0a0415aee0 2023-12-20T04:44:03.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.975+0000 7f09fa7fc640 1 -- 172.21.15.132:0/2984833863 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f09fc0079c0 con 0x7f0a0415aee0 2023-12-20T04:44:03.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.976+0000 7f09fa7fc640 1 --2- 172.21.15.132:0/2984833863 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f09e806a430 0x7f09e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:03.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.976+0000 7f09fa7fc640 1 -- 172.21.15.132:0/2984833863 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f09fc088b50 con 0x7f0a0415aee0 2023-12-20T04:44:03.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.976+0000 7f0a09cc3640 1 --2- 172.21.15.132:0/2984833863 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f09e806a430 0x7f09e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:03.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.976+0000 7f0a09cc3640 1 --2- 172.21.15.132:0/2984833863 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f09e806a430 0x7f09e806c8f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0a00035000 tx=0x7f0a00030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:03.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:03.980+0000 7f09fa7fc640 1 -- 172.21.15.132:0/2984833863 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f09fc0542b0 con 0x7f0a0415aee0 2023-12-20T04:44:04.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.147+0000 7f0a0bf27640 1 -- 172.21.15.132:0/2984833863 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f0a0404e840 con 0x7f0a0415aee0 2023-12-20T04:44:04.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.147+0000 7f09fa7fc640 1 -- 172.21.15.132:0/2984833863 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v35) v1 ==== 104+0+11 (secure 0 0 0) 0x7f09fc015020 con 0x7f0a0415aee0 2023-12-20T04:44:04.149 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:44:04.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.149+0000 7f0a0bf27640 1 -- 172.21.15.132:0/2984833863 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f09e806a430 msgr2=0x7f09e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.149+0000 7f0a0bf27640 1 --2- 172.21.15.132:0/2984833863 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f09e806a430 0x7f09e806c8f0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f0a00035000 tx=0x7f0a00030000 comp rx=0 tx=0).stop 2023-12-20T04:44:04.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.149+0000 7f0a0bf27640 1 -- 172.21.15.132:0/2984833863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a0415aee0 msgr2=0x7f0a04152520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.149+0000 7f0a0bf27640 1 --2- 172.21.15.132:0/2984833863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a0415aee0 0x7f0a04152520 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f09fc00c7c0 tx=0x7f09fc00cc80 comp rx=0 tx=0).stop 2023-12-20T04:44:04.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.149+0000 7f0a0bf27640 1 -- 172.21.15.132:0/2984833863 shutdown_connections 2023-12-20T04:44:04.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.149+0000 7f0a0bf27640 1 --2- 172.21.15.132:0/2984833863 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f09e806a430 0x7f09e806c8f0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.149+0000 7f0a0bf27640 1 --2- 172.21.15.132:0/2984833863 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0a0415aee0 0x7f0a04152520 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.149+0000 7f0a0bf27640 1 --2- 172.21.15.132:0/2984833863 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0a040cdbb0 0x7f0a04154bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.149+0000 7f0a0bf27640 1 --2- 172.21.15.132:0/2984833863 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0a040cb2b0 0x7f0a040caa70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.149+0000 7f0a0bf27640 1 -- 172.21.15.132:0/2984833863 >> 172.21.15.132:0/2984833863 conn(0x7f0a04072c60 msgr2=0x7f0a040cb690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:04.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.150+0000 7f0a0bf27640 1 -- 172.21.15.132:0/2984833863 shutdown_connections 2023-12-20T04:44:04.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.150+0000 7f0a0bf27640 1 -- 172.21.15.132:0/2984833863 wait complete. 2023-12-20T04:44:04.162 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:44:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.263+0000 7f89f9ba7640 1 Processor -- start 2023-12-20T04:44:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.263+0000 7f89f9ba7640 1 -- start start 2023-12-20T04:44:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.264+0000 7f89f9ba7640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f89f40cd690 0x7f89f4164c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.264+0000 7f89f9ba7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f40cabd0 con 0x7f89f40cb060 2023-12-20T04:44:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.264+0000 7f89f9ba7640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89f40c9fc0 con 0x7f89f4143510 2023-12-20T04:44:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.264+0000 7f89f9ba7640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89f40ca2a0 con 0x7f89f40cd690 2023-12-20T04:44:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.264+0000 7f89f2ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f89f40cb060 0x7f89f40ccf80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44934/0 (socket says 172.21.15.132:44934) 2023-12-20T04:44:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.264+0000 7f89f2ffd640 1 -- 172.21.15.132:0/4173769837 learned_addr learned my addr 172.21.15.132:0/4173769837 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.264+0000 7f89f3fff640 1 --2- 172.21.15.132:0/4173769837 >> v2:172.21.15.187:3300/0 conn(0x7f89f40cd690 0x7f89f4164c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.264+0000 7f89f27fc640 1 -- 172.21.15.132:0/4173769837 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1233691655 0 0) 0x7f89f40cabd0 con 0x7f89f40cb060 2023-12-20T04:44:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.264+0000 7f89f27fc640 1 -- 172.21.15.132:0/4173769837 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89dc003520 con 0x7f89f40cb060 2023-12-20T04:44:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.264+0000 7f89f27fc640 1 -- 172.21.15.132:0/4173769837 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1286314767 0 0) 0x7f89dc003520 con 0x7f89f40cb060 2023-12-20T04:44:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.264+0000 7f89f27fc640 1 -- 172.21.15.132:0/4173769837 >> v2:172.21.15.187:3300/0 conn(0x7f89f40cd690 msgr2=0x7f89f4164c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.264+0000 7f89f27fc640 1 --2- 172.21.15.132:0/4173769837 >> v2:172.21.15.187:3300/0 conn(0x7f89f40cd690 0x7f89f4164c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.264+0000 7f89f27fc640 1 -- 172.21.15.132:0/4173769837 >> v1:172.21.15.187:6789/0 conn(0x7f89f4143510 legacy=0x7f89f40c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.264+0000 7f89f27fc640 1 -- 172.21.15.132:0/4173769837 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f40ca580 con 0x7f89f40cb060 2023-12-20T04:44:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.264+0000 7f89f27fc640 1 -- 172.21.15.132:0/4173769837 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f89e8001670 con 0x7f89f40cb060 2023-12-20T04:44:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.265+0000 7f89f27fc640 1 -- 172.21.15.132:0/4173769837 >> v1:172.21.15.132:6789/0 conn(0x7f89f40cb060 legacy=0x7f89f40ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.265+0000 7f89f27fc640 1 --2- 172.21.15.132:0/4173769837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89dc003970 0x7f89dc003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.265+0000 7f89f27fc640 1 --2- 172.21.15.132:0/4173769837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89dc004370 0x7f89dc004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.265+0000 7f89f27fc640 1 --2- 172.21.15.132:0/4173769837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89dc005040 0x7f89dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.265+0000 7f89f27fc640 1 -- 172.21.15.132:0/4173769837 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f40ca2a0 con 0x7f89dc005040 2023-12-20T04:44:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.265+0000 7f89f27fc640 1 -- 172.21.15.132:0/4173769837 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc00bfa0 con 0x7f89dc004370 2023-12-20T04:44:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.265+0000 7f89f27fc640 1 -- 172.21.15.132:0/4173769837 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89dc00c160 con 0x7f89dc003970 2023-12-20T04:44:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.265+0000 7f89f3fff640 1 --2- 172.21.15.132:0/4173769837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89dc005040 0x7f89dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.265+0000 7f89f2ffd640 1 --2- 172.21.15.132:0/4173769837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89dc004370 0x7f89dc004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.265+0000 7f89f37fe640 1 --2- 172.21.15.132:0/4173769837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89dc003970 0x7f89dc003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.265+0000 7f89f3fff640 1 -- 172.21.15.132:0/4173769837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89dc003970 msgr2=0x7f89dc003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.265+0000 7f89f3fff640 1 --2- 172.21.15.132:0/4173769837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89dc003970 0x7f89dc003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.265+0000 7f89f3fff640 1 -- 172.21.15.132:0/4173769837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89dc004370 msgr2=0x7f89dc004840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.265+0000 7f89f3fff640 1 --2- 172.21.15.132:0/4173769837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89dc004370 0x7f89dc004840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.265+0000 7f89f3fff640 1 -- 172.21.15.132:0/4173769837 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89dc003520 con 0x7f89dc005040 2023-12-20T04:44:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.266+0000 7f89f3fff640 1 -- 172.21.15.132:0/4173769837 reap_dead start 2023-12-20T04:44:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.266+0000 7f89f3fff640 1 --2- 172.21.15.132:0/4173769837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89dc005040 0x7f89dc00b980 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009f90 tx=0x7f89dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2137523c69131eb6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.266+0000 7f89f27fc640 1 -- 172.21.15.132:0/4173769837 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec02cc20 con 0x7f89dc005040 2023-12-20T04:44:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.266+0000 7f89f27fc640 1 -- 172.21.15.132:0/4173769837 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec00f040 con 0x7f89dc005040 2023-12-20T04:44:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.266+0000 7f89f27fc640 1 -- 172.21.15.132:0/4173769837 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec003990 con 0x7f89dc005040 2023-12-20T04:44:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.266+0000 7f89f9ba7640 1 -- 172.21.15.132:0/4173769837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89dc005040 msgr2=0x7f89dc00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.266+0000 7f89f9ba7640 1 --2- 172.21.15.132:0/4173769837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89dc005040 0x7f89dc00b980 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f89ec009f90 tx=0x7f89dc0057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.266+0000 7f89f9ba7640 1 -- 172.21.15.132:0/4173769837 shutdown_connections 2023-12-20T04:44:04.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.266+0000 7f89f9ba7640 1 --2- 172.21.15.132:0/4173769837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89dc005040 0x7f89dc00b980 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.266+0000 7f89f9ba7640 1 -- 172.21.15.132:0/4173769837 >> 172.21.15.132:0/4173769837 conn(0x7f89f406a260 msgr2=0x7f89f40b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:04.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.266+0000 7f89f9ba7640 1 -- 172.21.15.132:0/4173769837 shutdown_connections 2023-12-20T04:44:04.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.266+0000 7f89f9ba7640 1 -- 172.21.15.132:0/4173769837 wait complete. 2023-12-20T04:44:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.268+0000 7f89f9ba7640 1 Processor -- start 2023-12-20T04:44:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.268+0000 7f89f9ba7640 1 -- start start 2023-12-20T04:44:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.268+0000 7f89f9ba7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89dc005040 0x7f89f41587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.268+0000 7f89f9ba7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89f4157fa0 0x7f89f40c6b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.268+0000 7f89f9ba7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89f40cbe30 0x7f89f40cc290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.268+0000 7f89f9ba7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f40cc7d0 con 0x7f89f40cbe30 2023-12-20T04:44:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.268+0000 7f89f9ba7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89f4158ed0 con 0x7f89dc005040 2023-12-20T04:44:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.268+0000 7f89f9ba7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89f41591b0 con 0x7f89f4157fa0 2023-12-20T04:44:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.269+0000 7f89f3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89f40cbe30 0x7f89f40cc290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:04.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.269+0000 7f89f3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89f40cbe30 0x7f89f40cc290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50958/0 (socket says 172.21.15.132:50958) 2023-12-20T04:44:04.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.269+0000 7f89f3fff640 1 -- 172.21.15.132:0/2405646580 learned_addr learned my addr 172.21.15.132:0/2405646580 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:04.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.269+0000 7f89f37fe640 1 --2- 172.21.15.132:0/2405646580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89dc005040 0x7f89f41587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:04.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.269+0000 7f89f2ffd640 1 --2- 172.21.15.132:0/2405646580 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89f4157fa0 0x7f89f40c6b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:04.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.269+0000 7f89f3fff640 1 -- 172.21.15.132:0/2405646580 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89f4157fa0 msgr2=0x7f89f40c6b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.269+0000 7f89f3fff640 1 --2- 172.21.15.132:0/2405646580 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89f4157fa0 0x7f89f40c6b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.269+0000 7f89f3fff640 1 -- 172.21.15.132:0/2405646580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89dc005040 msgr2=0x7f89f41587d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.269+0000 7f89f3fff640 1 --2- 172.21.15.132:0/2405646580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89dc005040 0x7f89f41587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.269+0000 7f89f3fff640 1 -- 172.21.15.132:0/2405646580 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89f4159490 con 0x7f89f40cbe30 2023-12-20T04:44:04.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.269+0000 7f89f3fff640 1 --2- 172.21.15.132:0/2405646580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89f40cbe30 0x7f89f40cc290 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f89ec02c690 tx=0x7f89ec009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:04.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.269+0000 7f89dbfff640 1 -- 172.21.15.132:0/2405646580 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec004230 con 0x7f89f40cbe30 2023-12-20T04:44:04.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.269+0000 7f89dbfff640 1 -- 172.21.15.132:0/2405646580 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ec004390 con 0x7f89f40cbe30 2023-12-20T04:44:04.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.269+0000 7f89f9ba7640 1 -- 172.21.15.132:0/2405646580 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89f4159770 con 0x7f89f40cbe30 2023-12-20T04:44:04.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.269+0000 7f89dbfff640 1 -- 172.21.15.132:0/2405646580 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ec004740 con 0x7f89f40cbe30 2023-12-20T04:44:04.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.269+0000 7f89f9ba7640 1 -- 172.21.15.132:0/2405646580 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89f40c70d0 con 0x7f89f40cbe30 2023-12-20T04:44:04.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.270+0000 7f89f9ba7640 1 -- 172.21.15.132:0/2405646580 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89f404e840 con 0x7f89f40cbe30 2023-12-20T04:44:04.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.271+0000 7f89dbfff640 1 -- 172.21.15.132:0/2405646580 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f89ec03f470 con 0x7f89f40cbe30 2023-12-20T04:44:04.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.271+0000 7f89dbfff640 1 --2- 172.21.15.132:0/2405646580 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89e006a460 0x7f89e006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.271+0000 7f89dbfff640 1 -- 172.21.15.132:0/2405646580 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f89ec0ab230 con 0x7f89f40cbe30 2023-12-20T04:44:04.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.271+0000 7f89f37fe640 1 --2- 172.21.15.132:0/2405646580 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89e006a460 0x7f89e006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:04.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.271+0000 7f89f37fe640 1 --2- 172.21.15.132:0/2405646580 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89e006a460 0x7f89e006c920 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f89e40055a0 tx=0x7f89e4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:04.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.275+0000 7f89dbfff640 1 -- 172.21.15.132:0/2405646580 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f89ec0768b0 con 0x7f89f40cbe30 2023-12-20T04:44:04.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.442+0000 7f89f9ba7640 1 -- 172.21.15.132:0/2405646580 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f89f40c3f90 con 0x7f89f40cbe30 2023-12-20T04:44:04.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.442+0000 7f89dbfff640 1 -- 172.21.15.132:0/2405646580 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v35) v1 ==== 100+0+11 (secure 0 0 0) 0x7f89ec079ed0 con 0x7f89f40cbe30 2023-12-20T04:44:04.444 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:44:04.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.444+0000 7f89f9ba7640 1 -- 172.21.15.132:0/2405646580 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89e006a460 msgr2=0x7f89e006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.444+0000 7f89f9ba7640 1 --2- 172.21.15.132:0/2405646580 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89e006a460 0x7f89e006c920 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f89e40055a0 tx=0x7f89e4009040 comp rx=0 tx=0).stop 2023-12-20T04:44:04.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.444+0000 7f89f9ba7640 1 -- 172.21.15.132:0/2405646580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89f40cbe30 msgr2=0x7f89f40cc290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.444+0000 7f89f9ba7640 1 --2- 172.21.15.132:0/2405646580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89f40cbe30 0x7f89f40cc290 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f89ec02c690 tx=0x7f89ec009750 comp rx=0 tx=0).stop 2023-12-20T04:44:04.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.444+0000 7f89f9ba7640 1 -- 172.21.15.132:0/2405646580 shutdown_connections 2023-12-20T04:44:04.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.444+0000 7f89f9ba7640 1 --2- 172.21.15.132:0/2405646580 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89e006a460 0x7f89e006c920 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.444+0000 7f89f9ba7640 1 --2- 172.21.15.132:0/2405646580 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89f40cbe30 0x7f89f40cc290 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.444+0000 7f89f9ba7640 1 --2- 172.21.15.132:0/2405646580 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89f4157fa0 0x7f89f40c6b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.444+0000 7f89f9ba7640 1 --2- 172.21.15.132:0/2405646580 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89dc005040 0x7f89f41587d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.444+0000 7f89f9ba7640 1 -- 172.21.15.132:0/2405646580 >> 172.21.15.132:0/2405646580 conn(0x7f89f406a260 msgr2=0x7f89f406c850 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:04.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.444+0000 7f89f9ba7640 1 -- 172.21.15.132:0/2405646580 shutdown_connections 2023-12-20T04:44:04.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.444+0000 7f89f9ba7640 1 -- 172.21.15.132:0/2405646580 wait complete. 2023-12-20T04:44:04.457 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:44:04.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.555+0000 7f7460a96640 1 Processor -- start 2023-12-20T04:44:04.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.555+0000 7f7460a96640 1 -- start start 2023-12-20T04:44:04.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.556+0000 7f7460a96640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f745c160450 0x7f745c160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.556+0000 7f7460a96640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f745c0b5090 0x7f745c0d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.556+0000 7f7460a96640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f745c0b5ec0 con 0x7f745c1611b0 2023-12-20T04:44:04.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.556+0000 7f7460a96640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f745c1617e0 con 0x7f745c160450 2023-12-20T04:44:04.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.556+0000 7f7460a96640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745c0d0fc0 con 0x7f745c0b5090 2023-12-20T04:44:04.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.556+0000 7f745a59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f745c160450 0x7f745c160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:04.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.556+0000 7f7453fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f745c1611b0 0x7f745c0b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44950/0 (socket says 172.21.15.132:44950) 2023-12-20T04:44:04.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.556+0000 7f745a59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f745c160450 0x7f745c160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50962/0 (socket says 172.21.15.132:50962) 2023-12-20T04:44:04.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.556+0000 7f7453fff640 1 -- 172.21.15.132:0/1709286814 learned_addr learned my addr 172.21.15.132:0/1709286814 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:04.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.556+0000 7f745a59c640 1 -- 172.21.15.132:0/1709286814 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f745c0b5090 msgr2=0x7f745c0d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:04.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.556+0000 7f745a59c640 1 --2- 172.21.15.132:0/1709286814 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f745c0b5090 0x7f745c0d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.556+0000 7f745a59c640 1 -- 172.21.15.132:0/1709286814 >> v1:172.21.15.132:6789/0 conn(0x7f745c1611b0 legacy=0x7f745c0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.556+0000 7f7459d9b640 1 -- 172.21.15.132:0/1709286814 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1731473886 0 0) 0x7f745c0b5ec0 con 0x7f745c1611b0 2023-12-20T04:44:04.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.556+0000 7f745a59c640 1 -- 172.21.15.132:0/1709286814 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f745c0d12a0 con 0x7f745c160450 2023-12-20T04:44:04.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.557+0000 7f745a59c640 1 --2- 172.21.15.132:0/1709286814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c160450 0x7f745c160c70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f744c0097a0 tx=0x7f744c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec179f9455b5331 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:04.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.557+0000 7f7459d9b640 1 -- 172.21.15.132:0/1709286814 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c030610 con 0x7f745c160450 2023-12-20T04:44:04.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.557+0000 7f7459d9b640 1 -- 172.21.15.132:0/1709286814 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f744c030770 con 0x7f745c160450 2023-12-20T04:44:04.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.557+0000 7f7459d9b640 1 -- 172.21.15.132:0/1709286814 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f744c030b00 con 0x7f745c160450 2023-12-20T04:44:04.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.557+0000 7f7460a96640 1 -- 172.21.15.132:0/1709286814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c160450 msgr2=0x7f745c160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.557+0000 7f7460a96640 1 --2- 172.21.15.132:0/1709286814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c160450 0x7f745c160c70 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f744c0097a0 tx=0x7f744c02b960 comp rx=0 tx=0).stop 2023-12-20T04:44:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.557+0000 7f7460a96640 1 -- 172.21.15.132:0/1709286814 shutdown_connections 2023-12-20T04:44:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.557+0000 7f7460a96640 1 --2- 172.21.15.132:0/1709286814 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f745c0b5090 0x7f745c0d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.557+0000 7f7460a96640 1 --2- 172.21.15.132:0/1709286814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c160450 0x7f745c160c70 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.557+0000 7f7460a96640 1 -- 172.21.15.132:0/1709286814 >> 172.21.15.132:0/1709286814 conn(0x7f745c0cf980 msgr2=0x7f745c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.557+0000 7f7460a96640 1 -- 172.21.15.132:0/1709286814 shutdown_connections 2023-12-20T04:44:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.558+0000 7f7460a96640 1 -- 172.21.15.132:0/1709286814 wait complete. 2023-12-20T04:44:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.559+0000 7f7460a96640 1 Processor -- start 2023-12-20T04:44:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.559+0000 7f7460a96640 1 -- start start 2023-12-20T04:44:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.559+0000 7f7460a96640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f745c0b5090 0x7f745c15db90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.559+0000 7f7460a96640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c160450 0x7f745c0c8530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.559+0000 7f7460a96640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f745c1611b0 0x7f745c0c8a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.559+0000 7f7460a96640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c15bdf0 con 0x7f745c160450 2023-12-20T04:44:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.559+0000 7f7460a96640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f745c159310 con 0x7f745c0b5090 2023-12-20T04:44:04.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.559+0000 7f7460a96640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f745c148c20 con 0x7f745c1611b0 2023-12-20T04:44:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.560+0000 7f7453fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c160450 0x7f745c0c8530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.560+0000 7f7453fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c160450 0x7f745c0c8530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50976/0 (socket says 172.21.15.132:50976) 2023-12-20T04:44:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.560+0000 7f7453fff640 1 -- 172.21.15.132:0/2965861780 learned_addr learned my addr 172.21.15.132:0/2965861780 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.560+0000 7f745a59c640 1 --2- 172.21.15.132:0/2965861780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f745c0b5090 0x7f745c15db90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.560+0000 7f745ad9d640 1 --2- 172.21.15.132:0/2965861780 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f745c1611b0 0x7f745c0c8a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.560+0000 7f7453fff640 1 -- 172.21.15.132:0/2965861780 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f745c1611b0 msgr2=0x7f745c0c8a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.560+0000 7f7453fff640 1 --2- 172.21.15.132:0/2965861780 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f745c1611b0 0x7f745c0c8a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.560+0000 7f7453fff640 1 -- 172.21.15.132:0/2965861780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f745c0b5090 msgr2=0x7f745c15db90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.560+0000 7f7453fff640 1 --2- 172.21.15.132:0/2965861780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f745c0b5090 0x7f745c15db90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.560+0000 7f7453fff640 1 -- 172.21.15.132:0/2965861780 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f744c009400 con 0x7f745c160450 2023-12-20T04:44:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.560+0000 7f745ad9d640 1 --2- 172.21.15.132:0/2965861780 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f745c1611b0 0x7f745c0c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.560+0000 7f7453fff640 1 --2- 172.21.15.132:0/2965861780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c160450 0x7f745c0c8530 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f744400c430 tx=0x7f744400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.560+0000 7f7452ffd640 1 -- 172.21.15.132:0/2965861780 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f74440074e0 con 0x7f745c160450 2023-12-20T04:44:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.560+0000 7f7452ffd640 1 -- 172.21.15.132:0/2965861780 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7444007660 con 0x7f745c160450 2023-12-20T04:44:04.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.560+0000 7f7460a96640 1 -- 172.21.15.132:0/2965861780 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f745c15b200 con 0x7f745c160450 2023-12-20T04:44:04.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.560+0000 7f7452ffd640 1 -- 172.21.15.132:0/2965861780 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7444004a20 con 0x7f745c160450 2023-12-20T04:44:04.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.560+0000 7f7460a96640 1 -- 172.21.15.132:0/2965861780 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f745c15b730 con 0x7f745c160450 2023-12-20T04:44:04.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.561+0000 7f7460a96640 1 -- 172.21.15.132:0/2965861780 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f745c15bf30 con 0x7f745c160450 2023-12-20T04:44:04.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.562+0000 7f7452ffd640 1 -- 172.21.15.132:0/2965861780 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7444004b80 con 0x7f745c160450 2023-12-20T04:44:04.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.562+0000 7f7452ffd640 1 --2- 172.21.15.132:0/2965861780 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f743c06a430 0x7f743c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.562+0000 7f745a59c640 1 --2- 172.21.15.132:0/2965861780 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f743c06a430 0x7f743c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:04.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.562+0000 7f7452ffd640 1 -- 172.21.15.132:0/2965861780 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7444088620 con 0x7f745c160450 2023-12-20T04:44:04.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.563+0000 7f745a59c640 1 --2- 172.21.15.132:0/2965861780 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f743c06a430 0x7f743c06c8f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f744c036000 tx=0x7f744c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:04.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.566+0000 7f7452ffd640 1 -- 172.21.15.132:0/2965861780 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f745c15bf30 con 0x7f745c160450 2023-12-20T04:44:04.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.766+0000 7f7460a96640 1 -- 172.21.15.132:0/2965861780 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f745c15bf30 con 0x7f745c160450 2023-12-20T04:44:04.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.767+0000 7f7452ffd640 1 -- 172.21.15.132:0/2965861780 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f745c15bf30 con 0x7f745c160450 2023-12-20T04:44:04.769 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:04.769 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/703933798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":703933798},{"type":"v1","addr":"172.21.15.187:6835","nonce":703933798}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3137083608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3137083608},{"type":"v1","addr":"172.21.15.187:6833","nonce":3137083608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1340012349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1340012349},{"type":"v1","addr":"172.21.15.132:6836","nonce":1340012349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:43:44.388671+0000","modified":"2023-12-20T04:43:47.069930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/359299732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":359299732},{"type":"v1","addr":"172.21.15.132:6837","nonce":359299732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-20T04:44:04.769 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 13 2023-12-20T04:44:04.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.769+0000 7f7460a96640 1 -- 172.21.15.132:0/2965861780 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f743c06a430 msgr2=0x7f743c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.769+0000 7f7460a96640 1 --2- 172.21.15.132:0/2965861780 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f743c06a430 0x7f743c06c8f0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f744c036000 tx=0x7f744c008030 comp rx=0 tx=0).stop 2023-12-20T04:44:04.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.769+0000 7f7460a96640 1 -- 172.21.15.132:0/2965861780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c160450 msgr2=0x7f745c0c8530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.769+0000 7f7460a96640 1 --2- 172.21.15.132:0/2965861780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c160450 0x7f745c0c8530 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f744400c430 tx=0x7f744400c8f0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.769+0000 7f7460a96640 1 -- 172.21.15.132:0/2965861780 shutdown_connections 2023-12-20T04:44:04.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.769+0000 7f7460a96640 1 --2- 172.21.15.132:0/2965861780 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f743c06a430 0x7f743c06c8f0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.769+0000 7f7460a96640 1 --2- 172.21.15.132:0/2965861780 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f745c1611b0 0x7f745c0c8a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.769+0000 7f7460a96640 1 --2- 172.21.15.132:0/2965861780 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f745c160450 0x7f745c0c8530 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.769+0000 7f7460a96640 1 --2- 172.21.15.132:0/2965861780 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f745c0b5090 0x7f745c15db90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.769+0000 7f7460a96640 1 -- 172.21.15.132:0/2965861780 >> 172.21.15.132:0/2965861780 conn(0x7f745c0cf980 msgr2=0x7f745c0c92d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:04.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.769+0000 7f7460a96640 1 -- 172.21.15.132:0/2965861780 shutdown_connections 2023-12-20T04:44:04.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.769+0000 7f7460a96640 1 -- 172.21.15.132:0/2965861780 wait complete. 2023-12-20T04:44:04.782 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:44:04.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.880+0000 7f1860cfb640 1 Processor -- start 2023-12-20T04:44:04.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.881+0000 7f1860cfb640 1 -- start start 2023-12-20T04:44:04.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.881+0000 7f1860cfb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f185c15d100 0x7f185c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.881+0000 7f1860cfb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f185c0d0370 0x7f185c0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.881+0000 7f1860cfb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f185c0b2f90 con 0x7f185c161850 2023-12-20T04:44:04.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.881+0000 7f1860cfb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f185c1613c0 con 0x7f185c0d0370 2023-12-20T04:44:04.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.881+0000 7f1860cfb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c0d1b00 con 0x7f185c15d100 2023-12-20T04:44:04.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.882+0000 7f1859d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f185c0d0370 0x7f185c0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:04.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.882+0000 7f1859d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f185c0d0370 0x7f185c0cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50982/0 (socket says 172.21.15.132:50982) 2023-12-20T04:44:04.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.882+0000 7f185ad9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f185c161850 0x7f185c06c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44954/0 (socket says 172.21.15.132:44954) 2023-12-20T04:44:04.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.882+0000 7f1859d9b640 1 -- 172.21.15.132:0/2406189333 learned_addr learned my addr 172.21.15.132:0/2406189333 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:04.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.882+0000 7f1859d9b640 1 -- 172.21.15.132:0/2406189333 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f185c15d100 msgr2=0x7f185c0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:04.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.882+0000 7f1859d9b640 1 --2- 172.21.15.132:0/2406189333 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f185c15d100 0x7f185c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.882+0000 7f1859d9b640 1 -- 172.21.15.132:0/2406189333 >> v1:172.21.15.132:6789/0 conn(0x7f185c161850 legacy=0x7f185c06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.882+0000 7f1859d9b640 1 -- 172.21.15.132:0/2406189333 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f185c0d0810 con 0x7f185c0d0370 2023-12-20T04:44:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.883+0000 7f1859d9b640 1 --2- 172.21.15.132:0/2406189333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f185c0d0370 0x7f185c0cd500 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1850009e50 tx=0x7f185002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868ba32a58ddfdb1 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.883+0000 7f185959a640 1 -- 172.21.15.132:0/2406189333 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f185002ca70 con 0x7f185c0d0370 2023-12-20T04:44:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.883+0000 7f185959a640 1 -- 172.21.15.132:0/2406189333 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f185002cbd0 con 0x7f185c0d0370 2023-12-20T04:44:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.883+0000 7f185959a640 1 -- 172.21.15.132:0/2406189333 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18500343f0 con 0x7f185c0d0370 2023-12-20T04:44:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.883+0000 7f1860cfb640 1 -- 172.21.15.132:0/2406189333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f185c0d0370 msgr2=0x7f185c0cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.883+0000 7f1860cfb640 1 --2- 172.21.15.132:0/2406189333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f185c0d0370 0x7f185c0cd500 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f1850009e50 tx=0x7f185002bed0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.883+0000 7f1860cfb640 1 -- 172.21.15.132:0/2406189333 shutdown_connections 2023-12-20T04:44:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.883+0000 7f1860cfb640 1 --2- 172.21.15.132:0/2406189333 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f185c0d0370 0x7f185c0cd500 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.883+0000 7f1860cfb640 1 --2- 172.21.15.132:0/2406189333 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f185c15d100 0x7f185c0b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.883+0000 7f1860cfb640 1 -- 172.21.15.132:0/2406189333 >> 172.21.15.132:0/2406189333 conn(0x7f185c06d7c0 msgr2=0x7f185c06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.883+0000 7f1860cfb640 1 -- 172.21.15.132:0/2406189333 shutdown_connections 2023-12-20T04:44:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.883+0000 7f1860cfb640 1 -- 172.21.15.132:0/2406189333 wait complete. 2023-12-20T04:44:04.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.885+0000 7f1860cfb640 1 Processor -- start 2023-12-20T04:44:04.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.885+0000 7f1860cfb640 1 -- start start 2023-12-20T04:44:04.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.885+0000 7f1860cfb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f185c0d0370 0x7f185c15dec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.885+0000 7f1860cfb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f185c15d100 0x7f185c157d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.885+0000 7f1860cfb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f185c161850 0x7f185c0c90f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.885+0000 7f1860cfb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c0cabf0 con 0x7f185c0d0370 2023-12-20T04:44:04.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.885+0000 7f1860cfb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f185c158240 con 0x7f185c161850 2023-12-20T04:44:04.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.885+0000 7f1860cfb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f185c15e4d0 con 0x7f185c15d100 2023-12-20T04:44:04.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.885+0000 7f185a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f185c0d0370 0x7f185c15dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:04.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.885+0000 7f185a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f185c0d0370 0x7f185c15dec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50996/0 (socket says 172.21.15.132:50996) 2023-12-20T04:44:04.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.885+0000 7f185a59c640 1 -- 172.21.15.132:0/3525162157 learned_addr learned my addr 172.21.15.132:0/3525162157 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:04.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.886+0000 7f185a59c640 1 -- 172.21.15.132:0/3525162157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f185c15d100 msgr2=0x7f185c157d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.886+0000 7f185a59c640 1 --2- 172.21.15.132:0/3525162157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f185c15d100 0x7f185c157d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.886+0000 7f185a59c640 1 -- 172.21.15.132:0/3525162157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f185c161850 msgr2=0x7f185c0c90f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:04.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.886+0000 7f185a59c640 1 --2- 172.21.15.132:0/3525162157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f185c161850 0x7f185c0c90f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:04.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.886+0000 7f185a59c640 1 -- 172.21.15.132:0/3525162157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1850009b30 con 0x7f185c0d0370 2023-12-20T04:44:04.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.886+0000 7f185a59c640 1 --2- 172.21.15.132:0/3525162157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f185c0d0370 0x7f185c15dec0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f185400b4a0 tx=0x7f185400b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:04.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.886+0000 7f184affd640 1 -- 172.21.15.132:0/3525162157 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854010610 con 0x7f185c0d0370 2023-12-20T04:44:04.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.886+0000 7f184affd640 1 -- 172.21.15.132:0/3525162157 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1854010770 con 0x7f185c0d0370 2023-12-20T04:44:04.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.886+0000 7f1860cfb640 1 -- 172.21.15.132:0/3525162157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f185c15e7b0 con 0x7f185c0d0370 2023-12-20T04:44:04.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.886+0000 7f184affd640 1 -- 172.21.15.132:0/3525162157 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1854010b20 con 0x7f185c0d0370 2023-12-20T04:44:04.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.886+0000 7f1860cfb640 1 -- 172.21.15.132:0/3525162157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f185c15ed70 con 0x7f185c0d0370 2023-12-20T04:44:04.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.887+0000 7f1860cfb640 1 -- 172.21.15.132:0/3525162157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f185c066480 con 0x7f185c0d0370 2023-12-20T04:44:04.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.887+0000 7f184affd640 1 -- 172.21.15.132:0/3525162157 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1854010c80 con 0x7f185c0d0370 2023-12-20T04:44:04.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.888+0000 7f184affd640 1 --2- 172.21.15.132:0/3525162157 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f183c06a430 0x7f183c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:04.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.888+0000 7f184affd640 1 -- 172.21.15.132:0/3525162157 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18540884b0 con 0x7f185c0d0370 2023-12-20T04:44:04.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.888+0000 7f1859d9b640 1 --2- 172.21.15.132:0/3525162157 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f183c06a430 0x7f183c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:04.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.888+0000 7f1859d9b640 1 --2- 172.21.15.132:0/3525162157 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f183c06a430 0x7f183c06c8f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1850035000 tx=0x7f185002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:04.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:04.892+0000 7f184affd640 1 -- 172.21.15.132:0/3525162157 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1854053b30 con 0x7f185c0d0370 2023-12-20T04:44:05.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.058+0000 7f1860cfb640 1 -- 172.21.15.132:0/3525162157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f185c04e840 con 0x7f185c0d0370 2023-12-20T04:44:05.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.059+0000 7f184affd640 1 -- 172.21.15.132:0/3525162157 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16149 (secure 0 0 0) 0x7f1854057150 con 0x7f185c0d0370 2023-12-20T04:44:05.061 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:05.061 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":35,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:43:56.805688+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:43:42.932158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-20T04:43:43.361561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:44:05.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.061+0000 7f1860cfb640 1 -- 172.21.15.132:0/3525162157 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f183c06a430 msgr2=0x7f183c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.061+0000 7f1860cfb640 1 --2- 172.21.15.132:0/3525162157 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f183c06a430 0x7f183c06c8f0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f1850035000 tx=0x7f185002e000 comp rx=0 tx=0).stop 2023-12-20T04:44:05.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.061+0000 7f1860cfb640 1 -- 172.21.15.132:0/3525162157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f185c0d0370 msgr2=0x7f185c15dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.061+0000 7f1860cfb640 1 --2- 172.21.15.132:0/3525162157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f185c0d0370 0x7f185c15dec0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f185400b4a0 tx=0x7f185400b960 comp rx=0 tx=0).stop 2023-12-20T04:44:05.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.061+0000 7f1860cfb640 1 -- 172.21.15.132:0/3525162157 shutdown_connections 2023-12-20T04:44:05.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.061+0000 7f1860cfb640 1 --2- 172.21.15.132:0/3525162157 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f183c06a430 0x7f183c06c8f0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.061+0000 7f1860cfb640 1 --2- 172.21.15.132:0/3525162157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f185c161850 0x7f185c0c90f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.061+0000 7f1860cfb640 1 --2- 172.21.15.132:0/3525162157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f185c15d100 0x7f185c157d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.061+0000 7f1860cfb640 1 --2- 172.21.15.132:0/3525162157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f185c0d0370 0x7f185c15dec0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.061+0000 7f1860cfb640 1 -- 172.21.15.132:0/3525162157 >> 172.21.15.132:0/3525162157 conn(0x7f185c06d7c0 msgr2=0x7f185c072c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:05.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.061+0000 7f1860cfb640 1 -- 172.21.15.132:0/3525162157 shutdown_connections 2023-12-20T04:44:05.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.062+0000 7f1860cfb640 1 -- 172.21.15.132:0/3525162157 wait complete. 2023-12-20T04:44:05.074 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-20T04:44:05.075 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:44:05.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.172+0000 7f9610b2e640 1 Processor -- start 2023-12-20T04:44:05.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.172+0000 7f9610b2e640 1 -- start start 2023-12-20T04:44:05.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.173+0000 7f9610b2e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c160450 0x7f960c160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.173+0000 7f9610b2e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f960c1611b0 0x7f960c0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.173+0000 7f9610b2e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f960c0b4ec0 0x7f960c06a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.173+0000 7f9610b2e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960c0b5350 con 0x7f960c0b4ec0 2023-12-20T04:44:05.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.173+0000 7f9610b2e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f960c0b5ec0 con 0x7f960c1611b0 2023-12-20T04:44:05.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.173+0000 7f9610b2e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c1617e0 con 0x7f960c160450 2023-12-20T04:44:05.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.173+0000 7f960ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f960c0b4ec0 0x7f960c06a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:05.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.173+0000 7f960ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f960c0b4ec0 0x7f960c06a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51000/0 (socket says 172.21.15.132:51000) 2023-12-20T04:44:05.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.173+0000 7f960ad9d640 1 -- 172.21.15.132:0/3862627808 learned_addr learned my addr 172.21.15.132:0/3862627808 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:05.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.174+0000 7f960a59c640 1 --2- 172.21.15.132:0/3862627808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c160450 0x7f960c160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:05.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.174+0000 7f9609d9b640 1 --2- 172.21.15.132:0/3862627808 >> v2:172.21.15.187:3300/0 conn(0x7f960c1611b0 0x7f960c0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:05.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.174+0000 7f960ad9d640 1 -- 172.21.15.132:0/3862627808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c160450 msgr2=0x7f960c160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:05.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.174+0000 7f960ad9d640 1 --2- 172.21.15.132:0/3862627808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c160450 0x7f960c160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.174+0000 7f960ad9d640 1 -- 172.21.15.132:0/3862627808 >> v2:172.21.15.187:3300/0 conn(0x7f960c1611b0 msgr2=0x7f960c0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:05.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.174+0000 7f960ad9d640 1 --2- 172.21.15.132:0/3862627808 >> v2:172.21.15.187:3300/0 conn(0x7f960c1611b0 0x7f960c0b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.174+0000 7f960ad9d640 1 -- 172.21.15.132:0/3862627808 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f960c0d0fc0 con 0x7f960c0b4ec0 2023-12-20T04:44:05.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.174+0000 7f9609d9b640 1 --2- 172.21.15.132:0/3862627808 >> v2:172.21.15.187:3300/0 conn(0x7f960c1611b0 0x7f960c0b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:05.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.174+0000 7f960ad9d640 1 --2- 172.21.15.132:0/3862627808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f960c0b4ec0 0x7f960c06a1a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f960c06b4a0 tx=0x7f960402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9760d1984d6a14c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:05.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.175+0000 7f960959a640 1 -- 172.21.15.132:0/3862627808 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604030860 con 0x7f960c0b4ec0 2023-12-20T04:44:05.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.175+0000 7f960959a640 1 -- 172.21.15.132:0/3862627808 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96040309c0 con 0x7f960c0b4ec0 2023-12-20T04:44:05.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.175+0000 7f960959a640 1 -- 172.21.15.132:0/3862627808 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9604030d50 con 0x7f960c0b4ec0 2023-12-20T04:44:05.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.175+0000 7f9610b2e640 1 -- 172.21.15.132:0/3862627808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f960c0b4ec0 msgr2=0x7f960c06a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.175+0000 7f9610b2e640 1 --2- 172.21.15.132:0/3862627808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f960c0b4ec0 0x7f960c06a1a0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f960c06b4a0 tx=0x7f960402b9a0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.175+0000 7f9610b2e640 1 -- 172.21.15.132:0/3862627808 shutdown_connections 2023-12-20T04:44:05.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.175+0000 7f9610b2e640 1 --2- 172.21.15.132:0/3862627808 >> v2:172.21.15.187:3300/0 conn(0x7f960c1611b0 0x7f960c0b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.175+0000 7f9610b2e640 1 --2- 172.21.15.132:0/3862627808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f960c0b4ec0 0x7f960c06a1a0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.175+0000 7f9610b2e640 1 --2- 172.21.15.132:0/3862627808 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c160450 0x7f960c160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.175+0000 7f9610b2e640 1 -- 172.21.15.132:0/3862627808 >> 172.21.15.132:0/3862627808 conn(0x7f960c0cf980 msgr2=0x7f960c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:05.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.175+0000 7f9610b2e640 1 -- 172.21.15.132:0/3862627808 shutdown_connections 2023-12-20T04:44:05.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.175+0000 7f9610b2e640 1 -- 172.21.15.132:0/3862627808 wait complete. 2023-12-20T04:44:05.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.176+0000 7f9610b2e640 1 Processor -- start 2023-12-20T04:44:05.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.177+0000 7f9610b2e640 1 -- start start 2023-12-20T04:44:05.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.177+0000 7f9610b2e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f960c0b4ec0 0x7f960c15b910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.177+0000 7f9610b2e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f960c160450 0x7f960c0aa2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.177+0000 7f9610b2e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c1611b0 0x7f960c14e230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.177+0000 7f9610b2e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c0aacb0 con 0x7f960c160450 2023-12-20T04:44:05.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.177+0000 7f9610b2e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f960c14e770 con 0x7f960c0b4ec0 2023-12-20T04:44:05.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.177+0000 7f9610b2e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f960c15d740 con 0x7f960c1611b0 2023-12-20T04:44:05.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.177+0000 7f9609d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f960c160450 0x7f960c0aa2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:05.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.177+0000 7f9609d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f960c160450 0x7f960c0aa2d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51014/0 (socket says 172.21.15.132:51014) 2023-12-20T04:44:05.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.177+0000 7f9609d9b640 1 -- 172.21.15.132:0/775056176 learned_addr learned my addr 172.21.15.132:0/775056176 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:05.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.178+0000 7f9609d9b640 1 -- 172.21.15.132:0/775056176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c1611b0 msgr2=0x7f960c14e230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.178+0000 7f9609d9b640 1 --2- 172.21.15.132:0/775056176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c1611b0 0x7f960c14e230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.178+0000 7f9609d9b640 1 -- 172.21.15.132:0/775056176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f960c0b4ec0 msgr2=0x7f960c15b910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.178+0000 7f9609d9b640 1 --2- 172.21.15.132:0/775056176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f960c0b4ec0 0x7f960c15b910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.178+0000 7f9609d9b640 1 -- 172.21.15.132:0/775056176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96040094d0 con 0x7f960c160450 2023-12-20T04:44:05.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.178+0000 7f9609d9b640 1 --2- 172.21.15.132:0/775056176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f960c160450 0x7f960c0aa2d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f960000c7f0 tx=0x7f960000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:05.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.178+0000 7f95faffd640 1 -- 172.21.15.132:0/775056176 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9600007a30 con 0x7f960c160450 2023-12-20T04:44:05.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.178+0000 7f95faffd640 1 -- 172.21.15.132:0/775056176 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9600007b90 con 0x7f960c160450 2023-12-20T04:44:05.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.178+0000 7f9610b2e640 1 -- 172.21.15.132:0/775056176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f960c0aa9d0 con 0x7f960c160450 2023-12-20T04:44:05.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.178+0000 7f95faffd640 1 -- 172.21.15.132:0/775056176 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f960000ce40 con 0x7f960c160450 2023-12-20T04:44:05.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.178+0000 7f9610b2e640 1 -- 172.21.15.132:0/775056176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f960c15d3d0 con 0x7f960c160450 2023-12-20T04:44:05.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.179+0000 7f9610b2e640 1 -- 172.21.15.132:0/775056176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f960c15cf50 con 0x7f960c160450 2023-12-20T04:44:05.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.179+0000 7f95faffd640 1 -- 172.21.15.132:0/775056176 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f96000113f0 con 0x7f960c160450 2023-12-20T04:44:05.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.180+0000 7f95faffd640 1 --2- 172.21.15.132:0/775056176 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f95ec06a430 0x7f95ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.180+0000 7f960a59c640 1 --2- 172.21.15.132:0/775056176 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f95ec06a430 0x7f95ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:05.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.180+0000 7f95faffd640 1 -- 172.21.15.132:0/775056176 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9600088a40 con 0x7f960c160450 2023-12-20T04:44:05.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.180+0000 7f960a59c640 1 --2- 172.21.15.132:0/775056176 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f95ec06a430 0x7f95ec06c8f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f95fc007e60 tx=0x7f95fc007390 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:05.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.184+0000 7f95faffd640 1 -- 172.21.15.132:0/775056176 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f960c15cf50 con 0x7f960c160450 2023-12-20T04:44:05.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.381+0000 7f9610b2e640 1 -- 172.21.15.132:0/775056176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f960c15cf50 con 0x7f960c160450 2023-12-20T04:44:05.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.382+0000 7f95faffd640 1 -- 172.21.15.132:0/775056176 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4712 (secure 0 0 0) 0x7f960c15cf50 con 0x7f960c160450 2023-12-20T04:44:05.384 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:05.384 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/703933798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":703933798},{"type":"v1","addr":"172.21.15.187:6835","nonce":703933798}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3137083608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3137083608},{"type":"v1","addr":"172.21.15.187:6833","nonce":3137083608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1340012349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1340012349},{"type":"v1","addr":"172.21.15.132:6836","nonce":1340012349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:43:44.388671+0000","modified":"2023-12-20T04:43:47.069930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/359299732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":359299732},{"type":"v1","addr":"172.21.15.132:6837","nonce":359299732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-20T04:44:05.384 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 13 2023-12-20T04:44:05.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.384+0000 7f9610b2e640 1 -- 172.21.15.132:0/775056176 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f95ec06a430 msgr2=0x7f95ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.384+0000 7f9610b2e640 1 --2- 172.21.15.132:0/775056176 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f95ec06a430 0x7f95ec06c8f0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f95fc007e60 tx=0x7f95fc007390 comp rx=0 tx=0).stop 2023-12-20T04:44:05.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.384+0000 7f9610b2e640 1 -- 172.21.15.132:0/775056176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f960c160450 msgr2=0x7f960c0aa2d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.384+0000 7f9610b2e640 1 --2- 172.21.15.132:0/775056176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f960c160450 0x7f960c0aa2d0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f960000c7f0 tx=0x7f960000cbf0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.384+0000 7f9610b2e640 1 -- 172.21.15.132:0/775056176 shutdown_connections 2023-12-20T04:44:05.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.384+0000 7f9610b2e640 1 --2- 172.21.15.132:0/775056176 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f95ec06a430 0x7f95ec06c8f0 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.384+0000 7f9610b2e640 1 --2- 172.21.15.132:0/775056176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f960c1611b0 0x7f960c14e230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.384+0000 7f9610b2e640 1 --2- 172.21.15.132:0/775056176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f960c160450 0x7f960c0aa2d0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.384+0000 7f9610b2e640 1 --2- 172.21.15.132:0/775056176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f960c0b4ec0 0x7f960c15b910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.384+0000 7f9610b2e640 1 -- 172.21.15.132:0/775056176 >> 172.21.15.132:0/775056176 conn(0x7f960c0cf980 msgr2=0x7f960c0c9140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:05.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.384+0000 7f9610b2e640 1 -- 172.21.15.132:0/775056176 shutdown_connections 2023-12-20T04:44:05.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.384+0000 7f9610b2e640 1 -- 172.21.15.132:0/775056176 wait complete. 2023-12-20T04:44:05.396 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:44:05.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.494+0000 7f000beab640 1 Processor -- start 2023-12-20T04:44:05.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.494+0000 7f000beab640 1 -- start start 2023-12-20T04:44:05.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.495+0000 7f000beab640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f000413e690 0x7f0004069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.495+0000 7f000beab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f000406a170 0x7f00040708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.495+0000 7f000beab640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0004141660 con 0x7f000413df60 2023-12-20T04:44:05.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.495+0000 7f000beab640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0004155a30 con 0x7f000413e690 2023-12-20T04:44:05.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.495+0000 7f000beab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f000406a600 con 0x7f000406a170 2023-12-20T04:44:05.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.495+0000 7f0009446640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f000413e690 0x7f0004069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:05.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.495+0000 7f000a448640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f000406a170 0x7f00040708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:05.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.495+0000 7f0009446640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f000413e690 0x7f0004069c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:59194/0 (socket says 172.21.15.132:59194) 2023-12-20T04:44:05.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.495+0000 7f000a448640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f000406a170 0x7f00040708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:53930/0 (socket says 172.21.15.132:53930) 2023-12-20T04:44:05.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.495+0000 7f0009446640 1 -- 172.21.15.132:0/1938934025 learned_addr learned my addr 172.21.15.132:0/1938934025 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:05.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.495+0000 7f0009c47640 1 --1- 172.21.15.132:0/1938934025 >> v1:172.21.15.187:6789/0 conn(0x7f000413df60 0x7f00040caa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:60972/0 (socket says 172.21.15.132:60972) 2023-12-20T04:44:05.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.495+0000 7f000a448640 1 -- 172.21.15.132:0/1938934025 >> v2:172.21.15.187:3300/0 conn(0x7f000413e690 msgr2=0x7f0004069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:05.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.495+0000 7f000a448640 1 --2- 172.21.15.132:0/1938934025 >> v2:172.21.15.187:3300/0 conn(0x7f000413e690 0x7f0004069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.495+0000 7f000a448640 1 -- 172.21.15.132:0/1938934025 >> v1:172.21.15.187:6789/0 conn(0x7f000413df60 legacy=0x7f00040caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.495+0000 7f000a448640 1 -- 172.21.15.132:0/1938934025 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0004140ae0 con 0x7f000406a170 2023-12-20T04:44:05.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.495+0000 7f0009446640 1 --2- 172.21.15.132:0/1938934025 >> v2:172.21.15.187:3300/0 conn(0x7f000413e690 0x7f0004069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:44:05.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.496+0000 7f000a448640 1 --2- 172.21.15.132:0/1938934025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f000406a170 0x7f00040708d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efffc009d90 tx=0x7efffc02be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a6055ea73cff88c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:05.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.496+0000 7f0008c45640 1 -- 172.21.15.132:0/1938934025 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc02cbc0 con 0x7f000406a170 2023-12-20T04:44:05.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.496+0000 7f0008c45640 1 -- 172.21.15.132:0/1938934025 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efffc02cd20 con 0x7f000406a170 2023-12-20T04:44:05.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.496+0000 7f0008c45640 1 -- 172.21.15.132:0/1938934025 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efffc034660 con 0x7f000406a170 2023-12-20T04:44:05.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.497+0000 7f000beab640 1 -- 172.21.15.132:0/1938934025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f000406a170 msgr2=0x7f00040708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.497+0000 7f000beab640 1 --2- 172.21.15.132:0/1938934025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f000406a170 0x7f00040708d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7efffc009d90 tx=0x7efffc02be10 comp rx=0 tx=0).stop 2023-12-20T04:44:05.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.497+0000 7f000beab640 1 -- 172.21.15.132:0/1938934025 shutdown_connections 2023-12-20T04:44:05.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.497+0000 7f000beab640 1 --2- 172.21.15.132:0/1938934025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f000406a170 0x7f00040708d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.497+0000 7f000beab640 1 --2- 172.21.15.132:0/1938934025 >> v2:172.21.15.187:3300/0 conn(0x7f000413e690 0x7f0004069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.497+0000 7f000beab640 1 -- 172.21.15.132:0/1938934025 >> 172.21.15.132:0/1938934025 conn(0x7f00040cfbd0 msgr2=0x7f00040cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:05.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.497+0000 7f000beab640 1 -- 172.21.15.132:0/1938934025 shutdown_connections 2023-12-20T04:44:05.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.497+0000 7f000beab640 1 -- 172.21.15.132:0/1938934025 wait complete. 2023-12-20T04:44:05.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.498+0000 7f000beab640 1 Processor -- start 2023-12-20T04:44:05.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.498+0000 7f000beab640 1 -- start start 2023-12-20T04:44:05.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.499+0000 7f000beab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f000406a170 0x7f000413c9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.499+0000 7f000beab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f000413df60 0x7f00040c9140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.499+0000 7f000beab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f000413e690 0x7f00040b4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.499+0000 7f000beab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000413d420 con 0x7f000413df60 2023-12-20T04:44:05.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.499+0000 7f000beab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f000413cf20 con 0x7f000406a170 2023-12-20T04:44:05.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.499+0000 7f000beab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00040c80a0 con 0x7f000413e690 2023-12-20T04:44:05.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.499+0000 7f0009446640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f000413df60 0x7f00040c9140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:05.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.499+0000 7f0009446640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f000413df60 0x7f00040c9140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51028/0 (socket says 172.21.15.132:51028) 2023-12-20T04:44:05.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.499+0000 7f0009446640 1 -- 172.21.15.132:0/2403000686 learned_addr learned my addr 172.21.15.132:0/2403000686 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:05.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.499+0000 7f000a448640 1 --2- 172.21.15.132:0/2403000686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f000413e690 0x7f00040b4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:05.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.499+0000 7f0009c47640 1 --2- 172.21.15.132:0/2403000686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f000406a170 0x7f000413c9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:05.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.499+0000 7f0009446640 1 -- 172.21.15.132:0/2403000686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f000413e690 msgr2=0x7f00040b4fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.499+0000 7f0009446640 1 --2- 172.21.15.132:0/2403000686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f000413e690 0x7f00040b4fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.499+0000 7f0009446640 1 -- 172.21.15.132:0/2403000686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f000406a170 msgr2=0x7f000413c9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.499+0000 7f0009446640 1 --2- 172.21.15.132:0/2403000686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f000406a170 0x7f000413c9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.499+0000 7f0009446640 1 -- 172.21.15.132:0/2403000686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efff40094d0 con 0x7f000413df60 2023-12-20T04:44:05.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.499+0000 7f0009446640 1 --2- 172.21.15.132:0/2403000686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f000413df60 0x7f00040c9140 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7efff400e9e0 tx=0x7efff400eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:05.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.500+0000 7efffa7fc640 1 -- 172.21.15.132:0/2403000686 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff400c970 con 0x7f000413df60 2023-12-20T04:44:05.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.500+0000 7efffa7fc640 1 -- 172.21.15.132:0/2403000686 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efff400cad0 con 0x7f000413df60 2023-12-20T04:44:05.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.500+0000 7f000beab640 1 -- 172.21.15.132:0/2403000686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efffc009a70 con 0x7f000413df60 2023-12-20T04:44:05.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.500+0000 7efffa7fc640 1 -- 172.21.15.132:0/2403000686 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efff400ce40 con 0x7f000413df60 2023-12-20T04:44:05.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.500+0000 7f000beab640 1 -- 172.21.15.132:0/2403000686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00040c8660 con 0x7f000413df60 2023-12-20T04:44:05.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.501+0000 7f000beab640 1 -- 172.21.15.132:0/2403000686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f000404e840 con 0x7f000413df60 2023-12-20T04:44:05.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.501+0000 7efffa7fc640 1 -- 172.21.15.132:0/2403000686 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efff4013470 con 0x7f000413df60 2023-12-20T04:44:05.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.501+0000 7efffa7fc640 1 --2- 172.21.15.132:0/2403000686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7effe806a460 0x7effe806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.502+0000 7efffa7fc640 1 -- 172.21.15.132:0/2403000686 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efff40889b0 con 0x7f000413df60 2023-12-20T04:44:05.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.502+0000 7f0009c47640 1 --2- 172.21.15.132:0/2403000686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7effe806a460 0x7effe806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:05.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.502+0000 7f0009c47640 1 --2- 172.21.15.132:0/2403000686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7effe806a460 0x7effe806c920 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0000000fb0 tx=0x7f0000007e30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:05.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.506+0000 7efffa7fc640 1 -- 172.21.15.132:0/2403000686 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7efff40540e0 con 0x7f000413df60 2023-12-20T04:44:05.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.704+0000 7f000beab640 1 -- 172.21.15.132:0/2403000686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f00040d0940 con 0x7f000413df60 2023-12-20T04:44:05.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.705+0000 7efffa7fc640 1 -- 172.21.15.132:0/2403000686 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 13 v13) v1 ==== 94+0+4712 (secure 0 0 0) 0x7efff4017090 con 0x7f000413df60 2023-12-20T04:44:05.707 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:05.707 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":13,"default_fscid":2,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/703933798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":703933798},{"type":"v1","addr":"172.21.15.187:6835","nonce":703933798}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3137083608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3137083608},{"type":"v1","addr":"172.21.15.187:6833","nonce":3137083608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1340012349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1340012349},{"type":"v1","addr":"172.21.15.132:6836","nonce":1340012349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:43:44.388671+0000","modified":"2023-12-20T04:43:47.069930+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5199},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5199":{"gid":5199,"name":"c","rank":0,"incarnation":10,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/359299732","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":359299732},{"type":"v1","addr":"172.21.15.132:6837","nonce":359299732}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[5],"metadata_pool":4,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":2}]} 2023-12-20T04:44:05.707 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 13 2023-12-20T04:44:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.707+0000 7f000beab640 1 -- 172.21.15.132:0/2403000686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7effe806a460 msgr2=0x7effe806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.707+0000 7f000beab640 1 --2- 172.21.15.132:0/2403000686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7effe806a460 0x7effe806c920 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0000000fb0 tx=0x7f0000007e30 comp rx=0 tx=0).stop 2023-12-20T04:44:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.707+0000 7f000beab640 1 -- 172.21.15.132:0/2403000686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f000413df60 msgr2=0x7f00040c9140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.707+0000 7f000beab640 1 --2- 172.21.15.132:0/2403000686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f000413df60 0x7f00040c9140 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7efff400e9e0 tx=0x7efff400eea0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.707+0000 7f000beab640 1 -- 172.21.15.132:0/2403000686 shutdown_connections 2023-12-20T04:44:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.707+0000 7f000beab640 1 --2- 172.21.15.132:0/2403000686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7effe806a460 0x7effe806c920 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.707+0000 7f000beab640 1 --2- 172.21.15.132:0/2403000686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f000413e690 0x7f00040b4fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.707+0000 7f000beab640 1 --2- 172.21.15.132:0/2403000686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f000413df60 0x7f00040c9140 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.707+0000 7f000beab640 1 --2- 172.21.15.132:0/2403000686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f000406a170 0x7f000413c9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.707+0000 7f000beab640 1 -- 172.21.15.132:0/2403000686 >> 172.21.15.132:0/2403000686 conn(0x7f00040cfbd0 msgr2=0x7f0004159440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.707+0000 7f000beab640 1 -- 172.21.15.132:0/2403000686 shutdown_connections 2023-12-20T04:44:05.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.707+0000 7f000beab640 1 -- 172.21.15.132:0/2403000686 wait complete. 2023-12-20T04:44:05.719 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:44:05.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.816+0000 7fc2e728f640 1 Processor -- start 2023-12-20T04:44:05.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.816+0000 7fc2e728f640 1 -- start start 2023-12-20T04:44:05.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.817+0000 7fc2e728f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2e015d110 0x7fc2e0069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.817+0000 7fc2e728f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc2e00af210 0x7fc2e006a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.817+0000 7fc2e728f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2e0161ce0 con 0x7fc2e015d4f0 2023-12-20T04:44:05.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.817+0000 7fc2e728f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2e00aca50 con 0x7fc2e00af210 2023-12-20T04:44:05.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.817+0000 7fc2e728f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e0160df0 con 0x7fc2e015d110 2023-12-20T04:44:05.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.817+0000 7fc2e582c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc2e00af210 0x7fc2e006a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:05.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.817+0000 7fc2e582c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc2e00af210 0x7fc2e006a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51032/0 (socket says 172.21.15.132:51032) 2023-12-20T04:44:05.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.817+0000 7fc2e582c640 1 -- 172.21.15.132:0/1341299067 learned_addr learned my addr 172.21.15.132:0/1341299067 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:05.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.817+0000 7fc2e482a640 1 --1- 172.21.15.132:0/1341299067 >> v1:172.21.15.132:6789/0 conn(0x7fc2e015d4f0 0x7fc2e00aeb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44958/0 (socket says 172.21.15.132:44958) 2023-12-20T04:44:05.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.818+0000 7fc2e582c640 1 -- 172.21.15.132:0/1341299067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2e015d110 msgr2=0x7fc2e0069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:05.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.818+0000 7fc2e502b640 1 --2- 172.21.15.132:0/1341299067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2e015d110 0x7fc2e0069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:05.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.818+0000 7fc2d7fff640 1 -- 172.21.15.132:0/1341299067 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3609642599 0 0) 0x7fc2e0161ce0 con 0x7fc2e015d4f0 2023-12-20T04:44:05.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.818+0000 7fc2e582c640 1 --2- 172.21.15.132:0/1341299067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2e015d110 0x7fc2e0069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.818+0000 7fc2e582c640 1 -- 172.21.15.132:0/1341299067 >> v1:172.21.15.132:6789/0 conn(0x7fc2e015d4f0 legacy=0x7fc2e00aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.818+0000 7fc2e582c640 1 -- 172.21.15.132:0/1341299067 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2e01610d0 con 0x7fc2e00af210 2023-12-20T04:44:05.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.818+0000 7fc2e502b640 1 --2- 172.21.15.132:0/1341299067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2e015d110 0x7fc2e0069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:05.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.818+0000 7fc2e582c640 1 --2- 172.21.15.132:0/1341299067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2e00af210 0x7fc2e006a320 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009870 tx=0x7fc2d802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=487f85f8366bf2a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:05.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.819+0000 7fc2d7fff640 1 -- 172.21.15.132:0/1341299067 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8030840 con 0x7fc2e00af210 2023-12-20T04:44:05.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.819+0000 7fc2d7fff640 1 -- 172.21.15.132:0/1341299067 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2d80309a0 con 0x7fc2e00af210 2023-12-20T04:44:05.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.819+0000 7fc2d7fff640 1 -- 172.21.15.132:0/1341299067 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2d8030d30 con 0x7fc2e00af210 2023-12-20T04:44:05.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.819+0000 7fc2e728f640 1 -- 172.21.15.132:0/1341299067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2e00af210 msgr2=0x7fc2e006a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.819+0000 7fc2e728f640 1 --2- 172.21.15.132:0/1341299067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2e00af210 0x7fc2e006a320 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fc2d8009870 tx=0x7fc2d802b980 comp rx=0 tx=0).stop 2023-12-20T04:44:05.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.819+0000 7fc2e728f640 1 -- 172.21.15.132:0/1341299067 shutdown_connections 2023-12-20T04:44:05.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.819+0000 7fc2e728f640 1 --2- 172.21.15.132:0/1341299067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2e00af210 0x7fc2e006a320 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.819+0000 7fc2e728f640 1 --2- 172.21.15.132:0/1341299067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2e015d110 0x7fc2e0069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.819+0000 7fc2e728f640 1 -- 172.21.15.132:0/1341299067 >> 172.21.15.132:0/1341299067 conn(0x7fc2e00cfbd0 msgr2=0x7fc2e00cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:05.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.819+0000 7fc2e728f640 1 -- 172.21.15.132:0/1341299067 shutdown_connections 2023-12-20T04:44:05.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.819+0000 7fc2e728f640 1 -- 172.21.15.132:0/1341299067 wait complete. 2023-12-20T04:44:05.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.820+0000 7fc2e728f640 1 Processor -- start 2023-12-20T04:44:05.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.820+0000 7fc2e728f640 1 -- start start 2023-12-20T04:44:05.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.821+0000 7fc2e728f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2e00af210 0x7fc2e01517f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.821+0000 7fc2e728f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2e015d110 0x7fc2e006d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.821+0000 7fc2e728f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc2e015d4f0 0x7fc2e00c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.821+0000 7fc2e728f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e006db40 con 0x7fc2e00af210 2023-12-20T04:44:05.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.821+0000 7fc2e728f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e006de20 con 0x7fc2e015d4f0 2023-12-20T04:44:05.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.821+0000 7fc2e728f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2e006e100 con 0x7fc2e015d110 2023-12-20T04:44:05.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.821+0000 7fc2e502b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2e00af210 0x7fc2e01517f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:05.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.821+0000 7fc2e502b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2e00af210 0x7fc2e01517f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51036/0 (socket says 172.21.15.132:51036) 2023-12-20T04:44:05.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.821+0000 7fc2e502b640 1 -- 172.21.15.132:0/267102385 learned_addr learned my addr 172.21.15.132:0/267102385 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:05.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.821+0000 7fc2e502b640 1 -- 172.21.15.132:0/267102385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2e015d110 msgr2=0x7fc2e006d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.821+0000 7fc2e482a640 1 --2- 172.21.15.132:0/267102385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2e015d110 0x7fc2e006d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:05.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.821+0000 7fc2e582c640 1 --2- 172.21.15.132:0/267102385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc2e015d4f0 0x7fc2e00c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:05.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.821+0000 7fc2e502b640 1 --2- 172.21.15.132:0/267102385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2e015d110 0x7fc2e006d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.821+0000 7fc2e502b640 1 -- 172.21.15.132:0/267102385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc2e015d4f0 msgr2=0x7fc2e00c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.821+0000 7fc2e502b640 1 --2- 172.21.15.132:0/267102385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc2e015d4f0 0x7fc2e00c7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.821+0000 7fc2e502b640 1 -- 172.21.15.132:0/267102385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2d80094d0 con 0x7fc2e00af210 2023-12-20T04:44:05.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.821+0000 7fc2e482a640 1 --2- 172.21.15.132:0/267102385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2e015d110 0x7fc2e006d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:05.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.822+0000 7fc2e502b640 1 --2- 172.21.15.132:0/267102385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2e00af210 0x7fc2e01517f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00cec0 tx=0x7fc2dc00a6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:05.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.822+0000 7fc2d5ffb640 1 -- 172.21.15.132:0/267102385 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc00e860 con 0x7fc2e00af210 2023-12-20T04:44:05.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.822+0000 7fc2d5ffb640 1 -- 172.21.15.132:0/267102385 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc2dc00e9c0 con 0x7fc2e00af210 2023-12-20T04:44:05.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.822+0000 7fc2e728f640 1 -- 172.21.15.132:0/267102385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2e006e3e0 con 0x7fc2e00af210 2023-12-20T04:44:05.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.822+0000 7fc2d5ffb640 1 -- 172.21.15.132:0/267102385 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc2dc00ed50 con 0x7fc2e00af210 2023-12-20T04:44:05.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.822+0000 7fc2e728f640 1 -- 172.21.15.132:0/267102385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2e0151d30 con 0x7fc2e00af210 2023-12-20T04:44:05.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.823+0000 7fc2e728f640 1 -- 172.21.15.132:0/267102385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2e004e840 con 0x7fc2e00af210 2023-12-20T04:44:05.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.823+0000 7fc2d5ffb640 1 -- 172.21.15.132:0/267102385 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc2dc016420 con 0x7fc2e00af210 2023-12-20T04:44:05.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.824+0000 7fc2d5ffb640 1 --2- 172.21.15.132:0/267102385 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc2c406a430 0x7fc2c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:05.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.824+0000 7fc2d5ffb640 1 -- 172.21.15.132:0/267102385 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc2dc012070 con 0x7fc2e00af210 2023-12-20T04:44:05.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.824+0000 7fc2e482a640 1 --2- 172.21.15.132:0/267102385 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc2c406a430 0x7fc2c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:05.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.824+0000 7fc2e482a640 1 --2- 172.21.15.132:0/267102385 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc2c406a430 0x7fc2c406c8f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00b1100 tx=0x7fc2d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:05.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.828+0000 7fc2d5ffb640 1 -- 172.21.15.132:0/267102385 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc2dc04fca0 con 0x7fc2e00af210 2023-12-20T04:44:05.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.993+0000 7fc2e728f640 1 -- 172.21.15.132:0/267102385 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc2e00af5f0 con 0x7fc2e00af210 2023-12-20T04:44:05.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.994+0000 7fc2d5ffb640 1 -- 172.21.15.132:0/267102385 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v35) v1 ==== 74+0+16149 (secure 0 0 0) 0x7fc2dc054be0 con 0x7fc2e00af210 2023-12-20T04:44:05.996 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:05.996 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":35,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:43:56.805688+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:43:42.932158+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.25,"score_stable":2.25,"optimal_score":1,"raw_score_acting":2.25,"raw_score_stable":2.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":"cephfs_data","create_time":"2023-12-20T04:43:43.361561+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:44:05.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.996+0000 7fc2e728f640 1 -- 172.21.15.132:0/267102385 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc2c406a430 msgr2=0x7fc2c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.996+0000 7fc2e728f640 1 --2- 172.21.15.132:0/267102385 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc2c406a430 0x7fc2c406c8f0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fc2e00b1100 tx=0x7fc2d0009040 comp rx=0 tx=0).stop 2023-12-20T04:44:05.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.996+0000 7fc2e728f640 1 -- 172.21.15.132:0/267102385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2e00af210 msgr2=0x7fc2e01517f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:05.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.996+0000 7fc2e728f640 1 --2- 172.21.15.132:0/267102385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2e00af210 0x7fc2e01517f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc2dc00cec0 tx=0x7fc2dc00a6c0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.996+0000 7fc2e728f640 1 -- 172.21.15.132:0/267102385 shutdown_connections 2023-12-20T04:44:05.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.996+0000 7fc2e728f640 1 --2- 172.21.15.132:0/267102385 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc2c406a430 0x7fc2c406c8f0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.996+0000 7fc2e728f640 1 --2- 172.21.15.132:0/267102385 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc2e015d4f0 0x7fc2e00c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.996+0000 7fc2e728f640 1 --2- 172.21.15.132:0/267102385 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2e015d110 0x7fc2e006d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.996+0000 7fc2e728f640 1 --2- 172.21.15.132:0/267102385 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2e00af210 0x7fc2e01517f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:05.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.996+0000 7fc2e728f640 1 -- 172.21.15.132:0/267102385 >> 172.21.15.132:0/267102385 conn(0x7fc2e00cfbd0 msgr2=0x7fc2e015bae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:05.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.996+0000 7fc2e728f640 1 -- 172.21.15.132:0/267102385 shutdown_connections 2023-12-20T04:44:05.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:05.996+0000 7fc2e728f640 1 -- 172.21.15.132:0/267102385 wait complete. 2023-12-20T04:44:06.009 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-20T04:44:06.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.109+0000 7f401b896640 1 Processor -- start 2023-12-20T04:44:06.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.109+0000 7f401b896640 1 -- start start 2023-12-20T04:44:06.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.110+0000 7f401b896640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f40140b1d10 0x7f40140b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:06.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.110+0000 7f401b896640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40140cd660 con 0x7f401415d110 2023-12-20T04:44:06.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.110+0000 7f401b896640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40140cd940 con 0x7f40140b4f90 2023-12-20T04:44:06.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.110+0000 7f401b896640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4014160e60 con 0x7f40140b1d10 2023-12-20T04:44:06.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.110+0000 7f4019632640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f401415d110 0x7f40140b4880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44966/0 (socket says 172.21.15.132:44966) 2023-12-20T04:44:06.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.110+0000 7f4019632640 1 -- 172.21.15.132:0/1743135324 learned_addr learned my addr 172.21.15.132:0/1743135324 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:06.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.110+0000 7f4019e33640 1 --2- 172.21.15.132:0/1743135324 >> v2:172.21.15.132:3300/0 conn(0x7f40140b1d10 0x7f40140b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:06.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.110+0000 7f4019e33640 1 -- 172.21.15.132:0/1743135324 >> v1:172.21.15.187:6789/0 conn(0x7f40140b4f90 legacy=0x7f40140d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:06.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.110+0000 7f4019e33640 1 -- 172.21.15.132:0/1743135324 >> v1:172.21.15.132:6789/0 conn(0x7f401415d110 legacy=0x7f40140b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:06.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.110+0000 7f4019e33640 1 -- 172.21.15.132:0/1743135324 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4014161140 con 0x7f40140b1d10 2023-12-20T04:44:06.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.111+0000 7f4019e33640 1 --2- 172.21.15.132:0/1743135324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40140b1d10 0x7f40140b21f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f400c009d90 tx=0x7f400c02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4e18ebdf541e7c6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:06.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.111+0000 7f400bfff640 1 -- 172.21.15.132:0/1743135324 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c02cc60 con 0x7f40140b1d10 2023-12-20T04:44:06.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.111+0000 7f400bfff640 1 -- 172.21.15.132:0/1743135324 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400c02cdc0 con 0x7f40140b1d10 2023-12-20T04:44:06.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.111+0000 7f400bfff640 1 -- 172.21.15.132:0/1743135324 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400c034660 con 0x7f40140b1d10 2023-12-20T04:44:06.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.112+0000 7f401b896640 1 -- 172.21.15.132:0/1743135324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40140b1d10 msgr2=0x7f40140b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:06.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.112+0000 7f401b896640 1 --2- 172.21.15.132:0/1743135324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40140b1d10 0x7f40140b21f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f400c009d90 tx=0x7f400c02beb0 comp rx=0 tx=0).stop 2023-12-20T04:44:06.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.112+0000 7f401b896640 1 -- 172.21.15.132:0/1743135324 shutdown_connections 2023-12-20T04:44:06.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.112+0000 7f401b896640 1 --2- 172.21.15.132:0/1743135324 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40140b1d10 0x7f40140b21f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:06.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.112+0000 7f401b896640 1 -- 172.21.15.132:0/1743135324 >> 172.21.15.132:0/1743135324 conn(0x7f40140cf880 msgr2=0x7f40140cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:06.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.112+0000 7f401b896640 1 -- 172.21.15.132:0/1743135324 shutdown_connections 2023-12-20T04:44:06.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.112+0000 7f401b896640 1 -- 172.21.15.132:0/1743135324 wait complete. 2023-12-20T04:44:06.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.113+0000 7f401b896640 1 Processor -- start 2023-12-20T04:44:06.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.113+0000 7f401b896640 1 -- start start 2023-12-20T04:44:06.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f401b896640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40140b1d10 0x7f40140c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:06.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f401b896640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40140b4f90 0x7f40141f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:06.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f401b896640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f401415d110 0x7f4014149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:06.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f401b896640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40140cb8c0 con 0x7f40140b4f90 2023-12-20T04:44:06.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f401b896640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40140cb430 con 0x7f40140b1d10 2023-12-20T04:44:06.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f401b896640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40140ca820 con 0x7f401415d110 2023-12-20T04:44:06.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f4018e31640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40140b4f90 0x7f40141f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:06.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f4018e31640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40140b4f90 0x7f40141f61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51066/0 (socket says 172.21.15.132:51066) 2023-12-20T04:44:06.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f4018e31640 1 -- 172.21.15.132:0/1731823357 learned_addr learned my addr 172.21.15.132:0/1731823357 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:06.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f4018e31640 1 -- 172.21.15.132:0/1731823357 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f401415d110 msgr2=0x7f4014149340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:06.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f4018e31640 1 --2- 172.21.15.132:0/1731823357 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f401415d110 0x7f4014149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:06.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f4018e31640 1 -- 172.21.15.132:0/1731823357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40140b1d10 msgr2=0x7f40140c9ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:06.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f4018e31640 1 --2- 172.21.15.132:0/1731823357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40140b1d10 0x7f40140c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:06.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f4018e31640 1 -- 172.21.15.132:0/1731823357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f400c009a70 con 0x7f40140b4f90 2023-12-20T04:44:06.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f4018e31640 1 --2- 172.21.15.132:0/1731823357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40140b4f90 0x7f40141f61c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f400400c430 tx=0x7f400400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:06.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f4009ffb640 1 -- 172.21.15.132:0/1731823357 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004011790 con 0x7f40140b4f90 2023-12-20T04:44:06.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f4009ffb640 1 -- 172.21.15.132:0/1731823357 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40040118f0 con 0x7f40140b4f90 2023-12-20T04:44:06.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.114+0000 7f4009ffb640 1 -- 172.21.15.132:0/1731823357 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4004011ce0 con 0x7f40140b4f90 2023-12-20T04:44:06.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.115+0000 7f401b896640 1 -- 172.21.15.132:0/1731823357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40140cab00 con 0x7f40140b4f90 2023-12-20T04:44:06.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.115+0000 7f401b896640 1 -- 172.21.15.132:0/1731823357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40140cb0c0 con 0x7f40140b4f90 2023-12-20T04:44:06.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.116+0000 7f401b896640 1 -- 172.21.15.132:0/1731823357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f401404e840 con 0x7f40140b4f90 2023-12-20T04:44:06.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.116+0000 7f4009ffb640 1 -- 172.21.15.132:0/1731823357 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f400401c460 con 0x7f40140b4f90 2023-12-20T04:44:06.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.116+0000 7f4009ffb640 1 --2- 172.21.15.132:0/1731823357 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ff806a460 0x7f3ff806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:06.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.116+0000 7f4009ffb640 1 -- 172.21.15.132:0/1731823357 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(35..35 src has 1..35) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f40040888a0 con 0x7f40140b4f90 2023-12-20T04:44:06.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.116+0000 7f4019632640 1 --2- 172.21.15.132:0/1731823357 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ff806a460 0x7f3ff806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:06.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.117+0000 7f4019632640 1 --2- 172.21.15.132:0/1731823357 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ff806a460 0x7f3ff806c920 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4010000f60 tx=0x7f4010007a80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:06.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.121+0000 7f4009ffb640 1 -- 172.21.15.132:0/1731823357 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4004053e90 con 0x7f40140b4f90 2023-12-20T04:44:06.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.320+0000 7f401b896640 1 -- 172.21.15.132:0/1731823357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f40140cb570 con 0x7f40140b4f90 2023-12-20T04:44:06.322 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:44:06.321+0000 7f1a5cbbd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-20T04:44:06.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.336+0000 7f4009ffb640 1 -- 172.21.15.132:0/1731823357 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v14) v1 ==== 161+0+0 (secure 0 0 0) 0x7f40040574b0 con 0x7f40140b4f90 2023-12-20T04:44:06.338 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-20T04:44:06.339 INFO:tasks.ceph.mds.c.smithi132.stderr: -3185> 2023-12-20T04:43:49.032+0000 7f75cda8a640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:44:06.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.338+0000 7f401b896640 1 -- 172.21.15.132:0/1731823357 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ff806a460 msgr2=0x7f3ff806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:06.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.338+0000 7f401b896640 1 --2- 172.21.15.132:0/1731823357 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ff806a460 0x7f3ff806c920 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f4010000f60 tx=0x7f4010007a80 comp rx=0 tx=0).stop 2023-12-20T04:44:06.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.338+0000 7f401b896640 1 -- 172.21.15.132:0/1731823357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40140b4f90 msgr2=0x7f40141f61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:06.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.338+0000 7f401b896640 1 --2- 172.21.15.132:0/1731823357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40140b4f90 0x7f40141f61c0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f400400c430 tx=0x7f400400c8f0 comp rx=0 tx=0).stop 2023-12-20T04:44:06.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.338+0000 7f401b896640 1 -- 172.21.15.132:0/1731823357 shutdown_connections 2023-12-20T04:44:06.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.338+0000 7f401b896640 1 --2- 172.21.15.132:0/1731823357 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ff806a460 0x7f3ff806c920 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:06.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.338+0000 7f401b896640 1 --2- 172.21.15.132:0/1731823357 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f401415d110 0x7f4014149340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:06.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.338+0000 7f401b896640 1 --2- 172.21.15.132:0/1731823357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40140b4f90 0x7f40141f61c0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:06.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.338+0000 7f401b896640 1 --2- 172.21.15.132:0/1731823357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40140b1d10 0x7f40140c9ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:06.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.338+0000 7f401b896640 1 -- 172.21.15.132:0/1731823357 >> 172.21.15.132:0/1731823357 conn(0x7f40140cf880 msgr2=0x7f40140b53b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:06.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.338+0000 7f401b896640 1 -- 172.21.15.132:0/1731823357 shutdown_connections 2023-12-20T04:44:06.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.338+0000 7f401b896640 1 -- 172.21.15.132:0/1731823357 wait complete. 2023-12-20T04:44:06.352 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-20T04:44:06.367 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-12-20T04:44:06.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.451+0000 7fe3974fb640 1 Processor -- start 2023-12-20T04:44:06.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.451+0000 7fe3974fb640 1 -- start start 2023-12-20T04:44:06.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.452+0000 7fe3974fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe3900cfc40 0x7fe3900b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:06.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.452+0000 7fe3974fb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3900d2920 con 0x7fe3900cf790 2023-12-20T04:44:06.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.452+0000 7fe3974fb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe3900d1d10 con 0x7fe39015d300 2023-12-20T04:44:06.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.452+0000 7fe3974fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3900d1ff0 con 0x7fe3900cfc40 2023-12-20T04:44:06.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.452+0000 7fe394a96640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe3900cf790 0x7fe3900b6080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44982/0 (socket says 172.21.15.132:44982) 2023-12-20T04:44:06.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.452+0000 7fe394a96640 1 -- 172.21.15.132:0/2373178145 learned_addr learned my addr 172.21.15.132:0/2373178145 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:06.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe395a98640 1 --2- 172.21.15.132:0/2373178145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe3900cfc40 0x7fe3900b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:06.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe387fff640 1 -- 172.21.15.132:0/2373178145 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2711222172 0 0) 0x7fe3900d2920 con 0x7fe3900cf790 2023-12-20T04:44:06.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe387fff640 1 -- 172.21.15.132:0/2373178145 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe37c003520 con 0x7fe3900cf790 2023-12-20T04:44:06.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe387fff640 1 -- 172.21.15.132:0/2373178145 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1847128562 0 0) 0x7fe37c003520 con 0x7fe3900cf790 2023-12-20T04:44:06.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe387fff640 1 -- 172.21.15.132:0/2373178145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe3900cfc40 msgr2=0x7fe3900b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:06.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe387fff640 1 --2- 172.21.15.132:0/2373178145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe3900cfc40 0x7fe3900b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:06.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe387fff640 1 -- 172.21.15.132:0/2373178145 >> v1:172.21.15.187:6789/0 conn(0x7fe39015d300 legacy=0x7fe3900d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:06.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe387fff640 1 -- 172.21.15.132:0/2373178145 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3900d22d0 con 0x7fe3900cf790 2023-12-20T04:44:06.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe387fff640 1 -- 172.21.15.132:0/2373178145 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fe380001670 con 0x7fe3900cf790 2023-12-20T04:44:06.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe387fff640 1 -- 172.21.15.132:0/2373178145 >> v1:172.21.15.132:6789/0 conn(0x7fe3900cf790 legacy=0x7fe3900b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:06.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe387fff640 1 --2- 172.21.15.132:0/2373178145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe3900cfc40 0x7fe37c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:06.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe387fff640 1 --2- 172.21.15.132:0/2373178145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe37c003ee0 0x7fe37c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:06.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe387fff640 1 --2- 172.21.15.132:0/2373178145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe37c004d00 0x7fe37c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:06.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe387fff640 1 -- 172.21.15.132:0/2373178145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3900d1ff0 con 0x7fe37c004d00 2023-12-20T04:44:06.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe387fff640 1 -- 172.21.15.132:0/2373178145 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c00b9e0 con 0x7fe37c003ee0 2023-12-20T04:44:06.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe387fff640 1 -- 172.21.15.132:0/2373178145 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c00bba0 con 0x7fe3900cfc40 2023-12-20T04:44:06.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe395a98640 1 --2- 172.21.15.132:0/2373178145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe37c004d00 0x7fe37c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:06.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe395297640 1 --2- 172.21.15.132:0/2373178145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe3900cfc40 0x7fe37c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:06.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe394a96640 1 --2- 172.21.15.132:0/2373178145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe37c003ee0 0x7fe37c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:06.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe395a98640 1 -- 172.21.15.132:0/2373178145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe3900cfc40 msgr2=0x7fe37c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:06.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe395a98640 1 --2- 172.21.15.132:0/2373178145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe3900cfc40 0x7fe37c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:06.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe395a98640 1 -- 172.21.15.132:0/2373178145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe37c003ee0 msgr2=0x7fe37c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:06.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe395a98640 1 --2- 172.21.15.132:0/2373178145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe37c003ee0 0x7fe37c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:06.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.453+0000 7fe395a98640 1 -- 172.21.15.132:0/2373178145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c003520 con 0x7fe37c004d00 2023-12-20T04:44:06.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.454+0000 7fe395a98640 1 --2- 172.21.15.132:0/2373178145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe37c004d00 0x7fe37c005180 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe388009ac0 tx=0x7fe37c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700afaa58170df83 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:06.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.454+0000 7fe387fff640 1 -- 172.21.15.132:0/2373178145 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38802c6b0 con 0x7fe37c004d00 2023-12-20T04:44:06.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.454+0000 7fe387fff640 1 -- 172.21.15.132:0/2373178145 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38802c810 con 0x7fe37c004d00 2023-12-20T04:44:06.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.454+0000 7fe387fff640 1 -- 172.21.15.132:0/2373178145 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38802cba0 con 0x7fe37c004d00 2023-12-20T04:44:06.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.455+0000 7fe3974fb640 1 -- 172.21.15.132:0/2373178145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe37c004d00 msgr2=0x7fe37c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:06.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.455+0000 7fe3974fb640 1 --2- 172.21.15.132:0/2373178145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe37c004d00 0x7fe37c005180 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fe388009ac0 tx=0x7fe37c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:06.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.455+0000 7fe395a98640 1 -- 172.21.15.132:0/2373178145 reap_dead start 2023-12-20T04:44:06.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.455+0000 7fe3974fb640 1 -- 172.21.15.132:0/2373178145 shutdown_connections 2023-12-20T04:44:06.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.455+0000 7fe3974fb640 1 -- 172.21.15.132:0/2373178145 >> 172.21.15.132:0/2373178145 conn(0x7fe39006a3d0 msgr2=0x7fe39006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:06.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.455+0000 7fe3974fb640 1 -- 172.21.15.132:0/2373178145 shutdown_connections 2023-12-20T04:44:06.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.455+0000 7fe3974fb640 1 -- 172.21.15.132:0/2373178145 wait complete. 2023-12-20T04:44:06.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.456+0000 7fe3974fb640 1 Processor -- start 2023-12-20T04:44:06.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.456+0000 7fe3974fb640 1 -- start start 2023-12-20T04:44:06.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe3974fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe3901f23a0 0x7fe3900b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:06.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe3974fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe390149380 0x7fe390160000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:06.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe3974fb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3900c8230 0x7fe3900c86b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:06.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe3974fb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3900c8bf0 con 0x7fe3901f23a0 2023-12-20T04:44:06.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe3974fb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe3901f2780 con 0x7fe3900c8230 2023-12-20T04:44:06.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe3974fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe3900cbc00 con 0x7fe390149380 2023-12-20T04:44:06.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe395297640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe3901f23a0 0x7fe3900b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:06.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe395297640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe3901f23a0 0x7fe3900b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:51080/0 (socket says 172.21.15.132:51080) 2023-12-20T04:44:06.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe395297640 1 -- 172.21.15.132:0/645236751 learned_addr learned my addr 172.21.15.132:0/645236751 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:06.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe395297640 1 -- 172.21.15.132:0/645236751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe390149380 msgr2=0x7fe390160000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:06.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe395297640 1 --2- 172.21.15.132:0/645236751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe390149380 0x7fe390160000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:06.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe395297640 1 -- 172.21.15.132:0/645236751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3900c8230 msgr2=0x7fe3900c86b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:06.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe395297640 1 --2- 172.21.15.132:0/645236751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3900c8230 0x7fe3900c86b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:06.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe395297640 1 -- 172.21.15.132:0/645236751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe3900caff0 con 0x7fe3901f23a0 2023-12-20T04:44:06.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe395297640 1 --2- 172.21.15.132:0/645236751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe3901f23a0 0x7fe3900b28d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00fb60 tx=0x7fe38c00d520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:06.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe385ffb640 1 -- 172.21.15.132:0/645236751 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c001b60 con 0x7fe3901f23a0 2023-12-20T04:44:06.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe385ffb640 1 -- 172.21.15.132:0/645236751 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe38c00db50 con 0x7fe3901f23a0 2023-12-20T04:44:06.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe385ffb640 1 -- 172.21.15.132:0/645236751 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe38c00dee0 con 0x7fe3901f23a0 2023-12-20T04:44:06.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.457+0000 7fe3974fb640 1 -- 172.21.15.132:0/645236751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe3900cb2d0 con 0x7fe3901f23a0 2023-12-20T04:44:06.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.458+0000 7fe3974fb640 1 -- 172.21.15.132:0/645236751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe3900cb890 con 0x7fe3901f23a0 2023-12-20T04:44:06.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.458+0000 7fe3974fb640 1 -- 172.21.15.132:0/645236751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe3900cba50 con 0x7fe3901f23a0 2023-12-20T04:44:06.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.459+0000 7fe385ffb640 1 -- 172.21.15.132:0/645236751 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe38c003970 con 0x7fe3901f23a0 2023-12-20T04:44:06.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.459+0000 7fe385ffb640 1 --2- 172.21.15.132:0/645236751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe37406a430 0x7fe37406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:06.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.459+0000 7fe385ffb640 1 -- 172.21.15.132:0/645236751 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe38c088c30 con 0x7fe3901f23a0 2023-12-20T04:44:06.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.459+0000 7fe394a96640 1 --2- 172.21.15.132:0/645236751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe37406a430 0x7fe37406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:06.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.460+0000 7fe394a96640 1 --2- 172.21.15.132:0/645236751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe37406a430 0x7fe37406c8f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe3800011e0 tx=0x7fe380001170 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:06.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.463+0000 7fe385ffb640 1 -- 172.21.15.132:0/645236751 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe38c0541c0 con 0x7fe3901f23a0 2023-12-20T04:44:06.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:06.662+0000 7fe3974fb640 1 -- 172.21.15.132:0/645236751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fe390066e70 con 0x7fe3901f23a0 2023-12-20T04:44:07.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.336+0000 7fe385ffb640 1 -- 172.21.15.132:0/645236751 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe38c0577e0 con 0x7fe3901f23a0 2023-12-20T04:44:07.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.339+0000 7fe3974fb640 1 -- 172.21.15.132:0/645236751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe37406a430 msgr2=0x7fe37406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:07.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.339+0000 7fe3974fb640 1 --2- 172.21.15.132:0/645236751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe37406a430 0x7fe37406c8f0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe3800011e0 tx=0x7fe380001170 comp rx=0 tx=0).stop 2023-12-20T04:44:07.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.339+0000 7fe3974fb640 1 -- 172.21.15.132:0/645236751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe3901f23a0 msgr2=0x7fe3900b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:07.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.339+0000 7fe3974fb640 1 --2- 172.21.15.132:0/645236751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe3901f23a0 0x7fe3900b28d0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fe38c00fb60 tx=0x7fe38c00d520 comp rx=0 tx=0).stop 2023-12-20T04:44:07.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.339+0000 7fe3974fb640 1 -- 172.21.15.132:0/645236751 shutdown_connections 2023-12-20T04:44:07.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.339+0000 7fe3974fb640 1 --2- 172.21.15.132:0/645236751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe37406a430 0x7fe37406c8f0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:07.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.339+0000 7fe3974fb640 1 --2- 172.21.15.132:0/645236751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe3900c8230 0x7fe3900c86b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:07.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.339+0000 7fe3974fb640 1 --2- 172.21.15.132:0/645236751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe390149380 0x7fe390160000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:07.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.339+0000 7fe3974fb640 1 --2- 172.21.15.132:0/645236751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe3901f23a0 0x7fe3900b28d0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:07.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.339+0000 7fe3974fb640 1 -- 172.21.15.132:0/645236751 >> 172.21.15.132:0/645236751 conn(0x7fe39006a3d0 msgr2=0x7fe3900d0e20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:07.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.339+0000 7fe3974fb640 1 -- 172.21.15.132:0/645236751 shutdown_connections 2023-12-20T04:44:07.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.339+0000 7fe3974fb640 1 -- 172.21.15.132:0/645236751 wait complete. 2023-12-20T04:44:07.353 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-20T04:44:07.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.496+0000 7fe58882c640 1 Processor -- start 2023-12-20T04:44:07.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.496+0000 7fe58882c640 1 -- start start 2023-12-20T04:44:07.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.496+0000 7fe58882c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe58415d220 0x7fe58406afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:07.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.496+0000 7fe58882c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe58406bdd0 0x7fe58406dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:07.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.496+0000 7fe58882c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe5840d1b80 con 0x7fe5840cfab0 2023-12-20T04:44:07.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.496+0000 7fe58882c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe58415d600 con 0x7fe58415d220 2023-12-20T04:44:07.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.496+0000 7fe58882c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe5840d0020 con 0x7fe58406bdd0 2023-12-20T04:44:07.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.497+0000 7fe58259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe58415d220 0x7fe58406afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:07.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.497+0000 7fe58259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe58415d220 0x7fe58406afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56062/0 (socket says 172.21.15.132:56062) 2023-12-20T04:44:07.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.497+0000 7fe58259c640 1 -- 172.21.15.132:0/1057826276 learned_addr learned my addr 172.21.15.132:0/1057826276 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:07.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.497+0000 7fe58259c640 1 -- 172.21.15.132:0/1057826276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe58406bdd0 msgr2=0x7fe58406dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:07.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.497+0000 7fe582d9d640 1 --2- 172.21.15.132:0/1057826276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe58406bdd0 0x7fe58406dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:07.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.497+0000 7fe581d9b640 1 -- 172.21.15.132:0/1057826276 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1950964353 0 0) 0x7fe5840d1b80 con 0x7fe5840cfab0 2023-12-20T04:44:07.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.497+0000 7fe58259c640 1 --2- 172.21.15.132:0/1057826276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe58406bdd0 0x7fe58406dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:07.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.497+0000 7fe58259c640 1 -- 172.21.15.132:0/1057826276 >> v1:172.21.15.132:6789/0 conn(0x7fe5840cfab0 legacy=0x7fe58406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:07.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.497+0000 7fe58259c640 1 -- 172.21.15.132:0/1057826276 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5840d0300 con 0x7fe58415d220 2023-12-20T04:44:07.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.497+0000 7fe582d9d640 1 --2- 172.21.15.132:0/1057826276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe58406bdd0 0x7fe58406dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:07.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.498+0000 7fe58259c640 1 --2- 172.21.15.132:0/1057826276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe58415d220 0x7fe58406afe0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe574009850 tx=0x7fe57402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3e50a12d486f68 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:07.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.498+0000 7fe581d9b640 1 -- 172.21.15.132:0/1057826276 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574004230 con 0x7fe58415d220 2023-12-20T04:44:07.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.498+0000 7fe581d9b640 1 -- 172.21.15.132:0/1057826276 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe574004390 con 0x7fe58415d220 2023-12-20T04:44:07.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.498+0000 7fe581d9b640 1 -- 172.21.15.132:0/1057826276 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe574031830 con 0x7fe58415d220 2023-12-20T04:44:07.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.498+0000 7fe58882c640 1 -- 172.21.15.132:0/1057826276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe58415d220 msgr2=0x7fe58406afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:07.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.498+0000 7fe58882c640 1 --2- 172.21.15.132:0/1057826276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe58415d220 0x7fe58406afe0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fe574009850 tx=0x7fe57402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:44:07.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.498+0000 7fe58882c640 1 -- 172.21.15.132:0/1057826276 shutdown_connections 2023-12-20T04:44:07.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.498+0000 7fe58882c640 1 --2- 172.21.15.132:0/1057826276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe58406bdd0 0x7fe58406dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:07.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.498+0000 7fe58882c640 1 --2- 172.21.15.132:0/1057826276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe58415d220 0x7fe58406afe0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:07.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.498+0000 7fe58882c640 1 -- 172.21.15.132:0/1057826276 >> 172.21.15.132:0/1057826276 conn(0x7fe584099fa0 msgr2=0x7fe5840d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:07.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.498+0000 7fe58882c640 1 -- 172.21.15.132:0/1057826276 shutdown_connections 2023-12-20T04:44:07.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.498+0000 7fe58882c640 1 -- 172.21.15.132:0/1057826276 wait complete. 2023-12-20T04:44:07.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.500+0000 7fe58882c640 1 Processor -- start 2023-12-20T04:44:07.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.500+0000 7fe58882c640 1 -- start start 2023-12-20T04:44:07.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.500+0000 7fe58882c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe58406bdd0 0x7fe584147d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:07.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.500+0000 7fe58882c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5840cfab0 0x7fe584145c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:07.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.500+0000 7fe58882c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe58415d220 0x7fe5841f5d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:07.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.500+0000 7fe58882c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe584155240 con 0x7fe58415d220 2023-12-20T04:44:07.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.500+0000 7fe58882c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5841461c0 con 0x7fe5840cfab0 2023-12-20T04:44:07.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.500+0000 7fe58882c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe584154910 con 0x7fe58406bdd0 2023-12-20T04:44:07.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.500+0000 7fe582d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe58415d220 0x7fe5841f5d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:07.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.500+0000 7fe582d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe58415d220 0x7fe5841f5d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56074/0 (socket says 172.21.15.132:56074) 2023-12-20T04:44:07.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.500+0000 7fe582d9d640 1 -- 172.21.15.132:0/1748298422 learned_addr learned my addr 172.21.15.132:0/1748298422 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:07.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.501+0000 7fe58259c640 1 --2- 172.21.15.132:0/1748298422 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe58406bdd0 0x7fe584147d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:07.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.501+0000 7fe57bfff640 1 --2- 172.21.15.132:0/1748298422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5840cfab0 0x7fe584145c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:07.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.501+0000 7fe582d9d640 1 -- 172.21.15.132:0/1748298422 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe58406bdd0 msgr2=0x7fe584147d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:07.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.501+0000 7fe582d9d640 1 --2- 172.21.15.132:0/1748298422 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe58406bdd0 0x7fe584147d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:07.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.501+0000 7fe582d9d640 1 -- 172.21.15.132:0/1748298422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5840cfab0 msgr2=0x7fe584145c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:07.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.501+0000 7fe582d9d640 1 --2- 172.21.15.132:0/1748298422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5840cfab0 0x7fe584145c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:07.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.501+0000 7fe582d9d640 1 -- 172.21.15.132:0/1748298422 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe574009460 con 0x7fe58415d220 2023-12-20T04:44:07.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.501+0000 7fe57bfff640 1 --2- 172.21.15.132:0/1748298422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5840cfab0 0x7fe584145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:07.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.501+0000 7fe582d9d640 1 --2- 172.21.15.132:0/1748298422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe58415d220 0x7fe5841f5d60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00ceb0 tx=0x7fe57c00a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:07.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.501+0000 7fe57affd640 1 -- 172.21.15.132:0/1748298422 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c00d840 con 0x7fe58415d220 2023-12-20T04:44:07.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.501+0000 7fe57affd640 1 -- 172.21.15.132:0/1748298422 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe57c00d9a0 con 0x7fe58415d220 2023-12-20T04:44:07.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.501+0000 7fe58882c640 1 -- 172.21.15.132:0/1748298422 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe584154bf0 con 0x7fe58415d220 2023-12-20T04:44:07.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.501+0000 7fe57affd640 1 -- 172.21.15.132:0/1748298422 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe57c00dd50 con 0x7fe58415d220 2023-12-20T04:44:07.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.501+0000 7fe58882c640 1 -- 172.21.15.132:0/1748298422 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5841545c0 con 0x7fe58415d220 2023-12-20T04:44:07.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.502+0000 7fe58882c640 1 -- 172.21.15.132:0/1748298422 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe58404e840 con 0x7fe58415d220 2023-12-20T04:44:07.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.502+0000 7fe57affd640 1 -- 172.21.15.132:0/1748298422 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe57c01e3b0 con 0x7fe58415d220 2023-12-20T04:44:07.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.503+0000 7fe57affd640 1 --2- 172.21.15.132:0/1748298422 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe56406a430 0x7fe56406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:07.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.503+0000 7fe57affd640 1 -- 172.21.15.132:0/1748298422 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(36..36 src has 1..36) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fe57c089370 con 0x7fe58415d220 2023-12-20T04:44:07.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.503+0000 7fe58259c640 1 --2- 172.21.15.132:0/1748298422 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe56406a430 0x7fe56406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:07.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.503+0000 7fe58259c640 1 --2- 172.21.15.132:0/1748298422 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe56406a430 0x7fe56406c8f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe574035000 tx=0x7fe574008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:07.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.507+0000 7fe57affd640 1 -- 172.21.15.132:0/1748298422 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe57c054990 con 0x7fe58415d220 2023-12-20T04:44:07.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:07.676+0000 7fe58882c640 1 -- 172.21.15.132:0/1748298422 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe5840ce390 con 0x7fe58415d220 2023-12-20T04:44:08.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.339+0000 7fe57affd640 1 -- 172.21.15.132:0/1748298422 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v37) v1 ==== 181+0+0 (secure 0 0 0) 0x7fe57c057fb0 con 0x7fe58415d220 2023-12-20T04:44:08.341 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2023-12-20T04:44:08.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.341+0000 7fe58882c640 1 -- 172.21.15.132:0/1748298422 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe56406a430 msgr2=0x7fe56406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:08.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.342+0000 7fe58882c640 1 --2- 172.21.15.132:0/1748298422 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe56406a430 0x7fe56406c8f0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7fe574035000 tx=0x7fe574008030 comp rx=0 tx=0).stop 2023-12-20T04:44:08.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.342+0000 7fe58882c640 1 -- 172.21.15.132:0/1748298422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe58415d220 msgr2=0x7fe5841f5d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:08.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.342+0000 7fe58882c640 1 --2- 172.21.15.132:0/1748298422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe58415d220 0x7fe5841f5d60 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fe57c00ceb0 tx=0x7fe57c00a710 comp rx=0 tx=0).stop 2023-12-20T04:44:08.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.342+0000 7fe58882c640 1 -- 172.21.15.132:0/1748298422 shutdown_connections 2023-12-20T04:44:08.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.342+0000 7fe58882c640 1 --2- 172.21.15.132:0/1748298422 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe56406a430 0x7fe56406c8f0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:08.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.342+0000 7fe58882c640 1 --2- 172.21.15.132:0/1748298422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe58415d220 0x7fe5841f5d60 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:08.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.342+0000 7fe58882c640 1 --2- 172.21.15.132:0/1748298422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe5840cfab0 0x7fe584145c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:08.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.342+0000 7fe58882c640 1 --2- 172.21.15.132:0/1748298422 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe58406bdd0 0x7fe584147d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:08.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.342+0000 7fe58882c640 1 -- 172.21.15.132:0/1748298422 >> 172.21.15.132:0/1748298422 conn(0x7fe584099fa0 msgr2=0x7fe58406ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:08.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.342+0000 7fe58882c640 1 -- 172.21.15.132:0/1748298422 shutdown_connections 2023-12-20T04:44:08.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.342+0000 7fe58882c640 1 -- 172.21.15.132:0/1748298422 wait complete. 2023-12-20T04:44:08.355 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-20T04:44:08.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.461+0000 7f55c98ce640 1 Processor -- start 2023-12-20T04:44:08.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.461+0000 7f55c98ce640 1 -- start start 2023-12-20T04:44:08.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c98ce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55c415d510 0x7f55c415d990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:08.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c98ce640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c40b27d0 con 0x7f55c415ded0 2023-12-20T04:44:08.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c98ce640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55c40d1ff0 con 0x7f55c415d130 2023-12-20T04:44:08.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c98ce640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c40b2a90 con 0x7f55c415d510 2023-12-20T04:44:08.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c37fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f55c415ded0 0x7f55c40b3570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40050/0 (socket says 172.21.15.132:40050) 2023-12-20T04:44:08.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c37fe640 1 -- 172.21.15.132:0/3421226570 learned_addr learned my addr 172.21.15.132:0/3421226570 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:08.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55bbfff640 1 --2- 172.21.15.132:0/3421226570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55c415d510 0x7f55c415d990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:08.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c27fc640 1 -- 172.21.15.132:0/3421226570 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1739921237 0 0) 0x7f55c40b27d0 con 0x7f55c415ded0 2023-12-20T04:44:08.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c27fc640 1 -- 172.21.15.132:0/3421226570 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f55b0003520 con 0x7f55c415ded0 2023-12-20T04:44:08.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c27fc640 1 -- 172.21.15.132:0/3421226570 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1259711590 0 0) 0x7f55b0003520 con 0x7f55c415ded0 2023-12-20T04:44:08.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c27fc640 1 -- 172.21.15.132:0/3421226570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55c415d510 msgr2=0x7f55c415d990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:08.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c27fc640 1 --2- 172.21.15.132:0/3421226570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55c415d510 0x7f55c415d990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:08.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c27fc640 1 -- 172.21.15.132:0/3421226570 >> v1:172.21.15.187:6789/0 conn(0x7f55c415d130 legacy=0x7f55c40d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:08.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c27fc640 1 -- 172.21.15.132:0/3421226570 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c40b2d70 con 0x7f55c415ded0 2023-12-20T04:44:08.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c27fc640 1 -- 172.21.15.132:0/3421226570 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f55bc0019f0 con 0x7f55c415ded0 2023-12-20T04:44:08.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c27fc640 1 -- 172.21.15.132:0/3421226570 >> v1:172.21.15.132:6789/0 conn(0x7f55c415ded0 legacy=0x7f55c40b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:08.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c27fc640 1 --2- 172.21.15.132:0/3421226570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55c415d510 0x7f55b00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:08.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c27fc640 1 --2- 172.21.15.132:0/3421226570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55b0003ee0 0x7f55b00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:08.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.462+0000 7f55c27fc640 1 --2- 172.21.15.132:0/3421226570 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55b0004d00 0x7f55b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.463+0000 7f55c27fc640 1 -- 172.21.15.132:0/3421226570 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c40b2a90 con 0x7f55b0003ee0 2023-12-20T04:44:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.463+0000 7f55c27fc640 1 -- 172.21.15.132:0/3421226570 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55b000ba90 con 0x7f55b0004d00 2023-12-20T04:44:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.463+0000 7f55c27fc640 1 -- 172.21.15.132:0/3421226570 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55b000bc50 con 0x7f55c415d510 2023-12-20T04:44:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.463+0000 7f55bbfff640 1 --2- 172.21.15.132:0/3421226570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55b0003ee0 0x7f55b00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.463+0000 7f55c2ffd640 1 --2- 172.21.15.132:0/3421226570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55c415d510 0x7f55b00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.463+0000 7f55c37fe640 1 --2- 172.21.15.132:0/3421226570 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55b0004d00 0x7f55b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.463+0000 7f55bbfff640 1 -- 172.21.15.132:0/3421226570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55c415d510 msgr2=0x7f55b00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.463+0000 7f55bbfff640 1 --2- 172.21.15.132:0/3421226570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55c415d510 0x7f55b00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.463+0000 7f55bbfff640 1 -- 172.21.15.132:0/3421226570 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55b0004d00 msgr2=0x7f55b0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.463+0000 7f55bbfff640 1 --2- 172.21.15.132:0/3421226570 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55b0004d00 0x7f55b0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.463+0000 7f55bbfff640 1 -- 172.21.15.132:0/3421226570 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55b0003520 con 0x7f55b0003ee0 2023-12-20T04:44:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.464+0000 7f55bbfff640 1 --2- 172.21.15.132:0/3421226570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55b0003ee0 0x7f55b00047c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009ac0 tx=0x7f55b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ee483577d447131 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.464+0000 7f55c27fc640 1 -- 172.21.15.132:0/3421226570 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac02c6b0 con 0x7f55b0003ee0 2023-12-20T04:44:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.464+0000 7f55c27fc640 1 -- 172.21.15.132:0/3421226570 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55ac02c810 con 0x7f55b0003ee0 2023-12-20T04:44:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.464+0000 7f55c27fc640 1 -- 172.21.15.132:0/3421226570 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55ac02cba0 con 0x7f55b0003ee0 2023-12-20T04:44:08.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.464+0000 7f55c98ce640 1 -- 172.21.15.132:0/3421226570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55b0003ee0 msgr2=0x7f55b00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:08.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.464+0000 7f55c98ce640 1 --2- 172.21.15.132:0/3421226570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55b0003ee0 0x7f55b00047c0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f55ac009ac0 tx=0x7f55b00057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:08.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.464+0000 7f55c37fe640 1 -- 172.21.15.132:0/3421226570 reap_dead start 2023-12-20T04:44:08.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.464+0000 7f55c98ce640 1 -- 172.21.15.132:0/3421226570 shutdown_connections 2023-12-20T04:44:08.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.464+0000 7f55c98ce640 1 -- 172.21.15.132:0/3421226570 >> 172.21.15.132:0/3421226570 conn(0x7f55c40d2eb0 msgr2=0x7f55c40d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:08.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.464+0000 7f55c98ce640 1 -- 172.21.15.132:0/3421226570 shutdown_connections 2023-12-20T04:44:08.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.464+0000 7f55c98ce640 1 -- 172.21.15.132:0/3421226570 wait complete. 2023-12-20T04:44:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.466+0000 7f55c98ce640 1 Processor -- start 2023-12-20T04:44:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.466+0000 7f55c98ce640 1 -- start start 2023-12-20T04:44:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.466+0000 7f55c98ce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55b0003ee0 0x7f55c40cf490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.466+0000 7f55c98ce640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55c40b8210 0x7f55c40cb5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.466+0000 7f55c98ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55c40b8690 0x7f55c40cbb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.466+0000 7f55c98ce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c40cc330 con 0x7f55c40b8690 2023-12-20T04:44:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.466+0000 7f55c98ce640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55c40cc610 con 0x7f55c40b8210 2023-12-20T04:44:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.466+0000 7f55c98ce640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55c40cc8f0 con 0x7f55b0003ee0 2023-12-20T04:44:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.466+0000 7f55c37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55c40b8690 0x7f55c40cbb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:08.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.466+0000 7f55c37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55c40b8690 0x7f55c40cbb10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56084/0 (socket says 172.21.15.132:56084) 2023-12-20T04:44:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.466+0000 7f55c37fe640 1 -- 172.21.15.132:0/2562863833 learned_addr learned my addr 172.21.15.132:0/2562863833 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.466+0000 7f55c2ffd640 1 --2- 172.21.15.132:0/2562863833 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55b0003ee0 0x7f55c40cf490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.466+0000 7f55bbfff640 1 --2- 172.21.15.132:0/2562863833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55c40b8210 0x7f55c40cb5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.467+0000 7f55c37fe640 1 -- 172.21.15.132:0/2562863833 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55b0003ee0 msgr2=0x7f55c40cf490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.467+0000 7f55c37fe640 1 --2- 172.21.15.132:0/2562863833 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55b0003ee0 0x7f55c40cf490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.467+0000 7f55c37fe640 1 -- 172.21.15.132:0/2562863833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55c40b8210 msgr2=0x7f55c40cb5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.467+0000 7f55c37fe640 1 --2- 172.21.15.132:0/2562863833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55c40b8210 0x7f55c40cb5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.467+0000 7f55c37fe640 1 -- 172.21.15.132:0/2562863833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55c40ccbd0 con 0x7f55c40b8690 2023-12-20T04:44:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.467+0000 7f55bbfff640 1 --2- 172.21.15.132:0/2562863833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55c40b8210 0x7f55c40cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.467+0000 7f55c2ffd640 1 --2- 172.21.15.132:0/2562863833 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55b0003ee0 0x7f55c40cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.467+0000 7f55c37fe640 1 --2- 172.21.15.132:0/2562863833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55c40b8690 0x7f55c40cbb10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f55bc001460 tx=0x7f55bc007bd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.467+0000 7f55c0ff9640 1 -- 172.21.15.132:0/2562863833 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc00ab90 con 0x7f55c40b8690 2023-12-20T04:44:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.467+0000 7f55c0ff9640 1 -- 172.21.15.132:0/2562863833 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55bc00acf0 con 0x7f55c40b8690 2023-12-20T04:44:08.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.467+0000 7f55c0ff9640 1 -- 172.21.15.132:0/2562863833 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55bc013630 con 0x7f55c40b8690 2023-12-20T04:44:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.467+0000 7f55c98ce640 1 -- 172.21.15.132:0/2562863833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55c40cc050 con 0x7f55c40b8690 2023-12-20T04:44:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.467+0000 7f55c98ce640 1 -- 172.21.15.132:0/2562863833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55c40cdcb0 con 0x7f55c40b8690 2023-12-20T04:44:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.468+0000 7f55c98ce640 1 -- 172.21.15.132:0/2562863833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55c404e840 con 0x7f55c40b8690 2023-12-20T04:44:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.468+0000 7f55c0ff9640 1 -- 172.21.15.132:0/2562863833 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f55bc013790 con 0x7f55c40b8690 2023-12-20T04:44:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.469+0000 7f55c0ff9640 1 --2- 172.21.15.132:0/2562863833 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55a406a430 0x7f55a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.469+0000 7f55c2ffd640 1 --2- 172.21.15.132:0/2562863833 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55a406a430 0x7f55a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.469+0000 7f55c0ff9640 1 -- 172.21.15.132:0/2562863833 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f55bc089150 con 0x7f55c40b8690 2023-12-20T04:44:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.469+0000 7f55c2ffd640 1 --2- 172.21.15.132:0/2562863833 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55a406a430 0x7f55a406c8f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f55b4003700 tx=0x7f55b4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:08.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.473+0000 7f55c0ff9640 1 -- 172.21.15.132:0/2562863833 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f55bc054930 con 0x7f55c40b8690 2023-12-20T04:44:08.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:08.637+0000 7f55c98ce640 1 -- 172.21.15.132:0/2562863833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f55c40ccd60 con 0x7f55c40b8690 2023-12-20T04:44:09.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.344+0000 7f55c0ff9640 1 -- 172.21.15.132:0/2562863833 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v38) v1 ==== 169+0+0 (secure 0 0 0) 0x7f55bc0170d0 con 0x7f55c40b8690 2023-12-20T04:44:09.346 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2023-12-20T04:44:09.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.347+0000 7f55c98ce640 1 -- 172.21.15.132:0/2562863833 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55a406a430 msgr2=0x7f55a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:09.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.347+0000 7f55c98ce640 1 --2- 172.21.15.132:0/2562863833 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55a406a430 0x7f55a406c8f0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f55b4003700 tx=0x7f55b4009040 comp rx=0 tx=0).stop 2023-12-20T04:44:09.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.347+0000 7f55c98ce640 1 -- 172.21.15.132:0/2562863833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55c40b8690 msgr2=0x7f55c40cbb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:09.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.347+0000 7f55c98ce640 1 --2- 172.21.15.132:0/2562863833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55c40b8690 0x7f55c40cbb10 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7f55bc001460 tx=0x7f55bc007bd0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.347+0000 7f55c98ce640 1 -- 172.21.15.132:0/2562863833 shutdown_connections 2023-12-20T04:44:09.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.347+0000 7f55c98ce640 1 --2- 172.21.15.132:0/2562863833 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55a406a430 0x7f55a406c8f0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.347+0000 7f55c98ce640 1 --2- 172.21.15.132:0/2562863833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55c40b8690 0x7f55c40cbb10 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.347+0000 7f55c98ce640 1 --2- 172.21.15.132:0/2562863833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55c40b8210 0x7f55c40cb5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.347+0000 7f55c98ce640 1 --2- 172.21.15.132:0/2562863833 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55b0003ee0 0x7f55c40cf490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.347+0000 7f55c98ce640 1 -- 172.21.15.132:0/2562863833 >> 172.21.15.132:0/2562863833 conn(0x7f55c40d2eb0 msgr2=0x7f55c40b33c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:09.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.347+0000 7f55c98ce640 1 -- 172.21.15.132:0/2562863833 shutdown_connections 2023-12-20T04:44:09.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.347+0000 7f55c98ce640 1 -- 172.21.15.132:0/2562863833 wait complete. 2023-12-20T04:44:09.361 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-20T04:44:09.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.466+0000 7ff24e939640 1 Processor -- start 2023-12-20T04:44:09.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.466+0000 7ff24e939640 1 -- start start 2023-12-20T04:44:09.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.467+0000 7ff24e939640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff24815cf20 0x7ff24806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:09.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.467+0000 7ff24e939640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff2480cd4b0 0x7ff2480cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:09.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.467+0000 7ff24e939640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff24806cc90 con 0x7ff24815d300 2023-12-20T04:44:09.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.467+0000 7ff24e939640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2480cde80 con 0x7ff2480cd4b0 2023-12-20T04:44:09.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.467+0000 7ff24e939640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2480b2f30 con 0x7ff24815cf20 2023-12-20T04:44:09.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.467+0000 7ff2477fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff24815d300 0x7ff248161700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40058/0 (socket says 172.21.15.132:40058) 2023-12-20T04:44:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.467+0000 7ff2477fe640 1 -- 172.21.15.132:0/3430143110 learned_addr learned my addr 172.21.15.132:0/3430143110 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.467+0000 7ff247fff640 1 --2- 172.21.15.132:0/3430143110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff24815cf20 0x7ff24806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.467+0000 7ff24ced6640 1 --2- 172.21.15.132:0/3430143110 >> v2:172.21.15.187:3300/0 conn(0x7ff2480cd4b0 0x7ff2480cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.467+0000 7ff246ffd640 1 -- 172.21.15.132:0/3430143110 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 399413431 0 0) 0x7ff24806cc90 con 0x7ff24815d300 2023-12-20T04:44:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.467+0000 7ff246ffd640 1 -- 172.21.15.132:0/3430143110 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff230003520 con 0x7ff24815d300 2023-12-20T04:44:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.468+0000 7ff246ffd640 1 -- 172.21.15.132:0/3430143110 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 730143325 0 0) 0x7ff230003520 con 0x7ff24815d300 2023-12-20T04:44:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.468+0000 7ff247fff640 1 -- 172.21.15.132:0/3430143110 >> v2:172.21.15.187:3300/0 conn(0x7ff2480cd4b0 msgr2=0x7ff2480cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.468+0000 7ff247fff640 1 --2- 172.21.15.132:0/3430143110 >> v2:172.21.15.187:3300/0 conn(0x7ff2480cd4b0 0x7ff2480cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.468+0000 7ff247fff640 1 -- 172.21.15.132:0/3430143110 >> v1:172.21.15.132:6789/0 conn(0x7ff24815d300 legacy=0x7ff248161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.468+0000 7ff247fff640 1 -- 172.21.15.132:0/3430143110 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2480b3210 con 0x7ff24815cf20 2023-12-20T04:44:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.468+0000 7ff24ced6640 1 --2- 172.21.15.132:0/3430143110 >> v2:172.21.15.187:3300/0 conn(0x7ff2480cd4b0 0x7ff2480cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:44:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.468+0000 7ff247fff640 1 --2- 172.21.15.132:0/3430143110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff24815cf20 0x7ff24806c590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff2380097a0 tx=0x7ff23802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4110312617d5f06 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:09.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.469+0000 7ff246ffd640 1 -- 172.21.15.132:0/3430143110 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23c001670 con 0x7ff24815cf20 2023-12-20T04:44:09.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.469+0000 7ff246ffd640 1 -- 172.21.15.132:0/3430143110 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23802e050 con 0x7ff24815cf20 2023-12-20T04:44:09.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.469+0000 7ff246ffd640 1 -- 172.21.15.132:0/3430143110 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff238030730 con 0x7ff24815cf20 2023-12-20T04:44:09.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.469+0000 7ff24e939640 1 -- 172.21.15.132:0/3430143110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff24815cf20 msgr2=0x7ff24806c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:09.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.469+0000 7ff24e939640 1 --2- 172.21.15.132:0/3430143110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff24815cf20 0x7ff24806c590 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7ff2380097a0 tx=0x7ff23802b790 comp rx=0 tx=0).stop 2023-12-20T04:44:09.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.469+0000 7ff24e939640 1 -- 172.21.15.132:0/3430143110 shutdown_connections 2023-12-20T04:44:09.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.469+0000 7ff24e939640 1 --2- 172.21.15.132:0/3430143110 >> v2:172.21.15.187:3300/0 conn(0x7ff2480cd4b0 0x7ff2480cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.469+0000 7ff24e939640 1 --2- 172.21.15.132:0/3430143110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff24815cf20 0x7ff24806c590 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.469+0000 7ff24e939640 1 -- 172.21.15.132:0/3430143110 >> 172.21.15.132:0/3430143110 conn(0x7ff248072c60 msgr2=0x7ff248073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:09.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.469+0000 7ff24e939640 1 -- 172.21.15.132:0/3430143110 shutdown_connections 2023-12-20T04:44:09.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.469+0000 7ff24e939640 1 -- 172.21.15.132:0/3430143110 wait complete. 2023-12-20T04:44:09.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.470+0000 7ff24e939640 1 Processor -- start 2023-12-20T04:44:09.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.471+0000 7ff24e939640 1 -- start start 2023-12-20T04:44:09.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.471+0000 7ff24e939640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2480cd4b0 0x7ff2480ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:09.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.471+0000 7ff24e939640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff24815cf20 0x7ff2480b5f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:09.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.471+0000 7ff24e939640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff24815d300 0x7ff24815eb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:09.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.471+0000 7ff24e939640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2481f4880 con 0x7ff2480cd4b0 2023-12-20T04:44:09.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.471+0000 7ff24e939640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2481f3c70 con 0x7ff24815cf20 2023-12-20T04:44:09.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.471+0000 7ff24e939640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2481f3f50 con 0x7ff24815d300 2023-12-20T04:44:09.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.471+0000 7ff247fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2480cd4b0 0x7ff2480ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:09.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.471+0000 7ff247fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2480cd4b0 0x7ff2480ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56090/0 (socket says 172.21.15.132:56090) 2023-12-20T04:44:09.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.471+0000 7ff247fff640 1 -- 172.21.15.132:0/3735245956 learned_addr learned my addr 172.21.15.132:0/3735245956 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:09.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.472+0000 7ff2477fe640 1 --2- 172.21.15.132:0/3735245956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff24815cf20 0x7ff2480b5f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:09.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.472+0000 7ff24ced6640 1 --2- 172.21.15.132:0/3735245956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff24815d300 0x7ff24815eb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:09.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.472+0000 7ff247fff640 1 -- 172.21.15.132:0/3735245956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff24815d300 msgr2=0x7ff24815eb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:09.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.472+0000 7ff247fff640 1 --2- 172.21.15.132:0/3735245956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff24815d300 0x7ff24815eb90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.472+0000 7ff247fff640 1 -- 172.21.15.132:0/3735245956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff24815cf20 msgr2=0x7ff2480b5f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:09.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.472+0000 7ff247fff640 1 --2- 172.21.15.132:0/3735245956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff24815cf20 0x7ff2480b5f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.472+0000 7ff247fff640 1 -- 172.21.15.132:0/3735245956 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff240009a70 con 0x7ff2480cd4b0 2023-12-20T04:44:09.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.472+0000 7ff247fff640 1 --2- 172.21.15.132:0/3735245956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2480cd4b0 0x7ff2480ac8e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff238000c00 tx=0x7ff2380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:09.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.472+0000 7ff244ff9640 1 -- 172.21.15.132:0/3735245956 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23803b810 con 0x7ff2480cd4b0 2023-12-20T04:44:09.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.472+0000 7ff244ff9640 1 -- 172.21.15.132:0/3735245956 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff23803b970 con 0x7ff2480cd4b0 2023-12-20T04:44:09.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.472+0000 7ff24e939640 1 -- 172.21.15.132:0/3735245956 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff238009400 con 0x7ff2480cd4b0 2023-12-20T04:44:09.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.472+0000 7ff244ff9640 1 -- 172.21.15.132:0/3735245956 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff23803bd20 con 0x7ff2480cd4b0 2023-12-20T04:44:09.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.472+0000 7ff24e939640 1 -- 172.21.15.132:0/3735245956 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2481f4510 con 0x7ff2480cd4b0 2023-12-20T04:44:09.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.473+0000 7ff24e939640 1 -- 172.21.15.132:0/3735245956 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff24804e840 con 0x7ff2480cd4b0 2023-12-20T04:44:09.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.473+0000 7ff244ff9640 1 -- 172.21.15.132:0/3735245956 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff238039040 con 0x7ff2480cd4b0 2023-12-20T04:44:09.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.474+0000 7ff244ff9640 1 --2- 172.21.15.132:0/3735245956 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff23406a430 0x7ff23406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:09.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.474+0000 7ff2477fe640 1 --2- 172.21.15.132:0/3735245956 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff23406a430 0x7ff23406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:09.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.474+0000 7ff244ff9640 1 -- 172.21.15.132:0/3735245956 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff2380a9bb0 con 0x7ff2480cd4b0 2023-12-20T04:44:09.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.474+0000 7ff2477fe640 1 --2- 172.21.15.132:0/3735245956 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff23406a430 0x7ff23406c8f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff24815fce0 tx=0x7ff23c001aa0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:09.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.478+0000 7ff244ff9640 1 -- 172.21.15.132:0/3735245956 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff238075670 con 0x7ff2480cd4b0 2023-12-20T04:44:09.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.643+0000 7ff24e939640 1 -- 172.21.15.132:0/3735245956 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7ff2480b2890 con 0x7ff2480cd4b0 2023-12-20T04:44:09.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.646+0000 7ff244ff9640 1 -- 172.21.15.132:0/3735245956 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v3) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff238006e10 con 0x7ff2480cd4b0 2023-12-20T04:44:09.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.649+0000 7ff24e939640 1 -- 172.21.15.132:0/3735245956 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff23406a430 msgr2=0x7ff23406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:09.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.649+0000 7ff24e939640 1 --2- 172.21.15.132:0/3735245956 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff23406a430 0x7ff23406c8f0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7ff24815fce0 tx=0x7ff23c001aa0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.649+0000 7ff24e939640 1 -- 172.21.15.132:0/3735245956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2480cd4b0 msgr2=0x7ff2480ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:09.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.649+0000 7ff24e939640 1 --2- 172.21.15.132:0/3735245956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2480cd4b0 0x7ff2480ac8e0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff238000c00 tx=0x7ff2380046c0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.649+0000 7ff24e939640 1 -- 172.21.15.132:0/3735245956 shutdown_connections 2023-12-20T04:44:09.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.649+0000 7ff24e939640 1 --2- 172.21.15.132:0/3735245956 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff23406a430 0x7ff23406c8f0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.649+0000 7ff24e939640 1 --2- 172.21.15.132:0/3735245956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff24815d300 0x7ff24815eb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.649+0000 7ff24e939640 1 --2- 172.21.15.132:0/3735245956 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff24815cf20 0x7ff2480b5f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.649+0000 7ff24e939640 1 --2- 172.21.15.132:0/3735245956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2480cd4b0 0x7ff2480ac8e0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.649+0000 7ff24e939640 1 -- 172.21.15.132:0/3735245956 >> 172.21.15.132:0/3735245956 conn(0x7ff248072c60 msgr2=0x7ff248160de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:09.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.649+0000 7ff24e939640 1 -- 172.21.15.132:0/3735245956 shutdown_connections 2023-12-20T04:44:09.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.649+0000 7ff24e939640 1 -- 172.21.15.132:0/3735245956 wait complete. 2023-12-20T04:44:09.661 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier' 2023-12-20T04:44:09.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.759+0000 7f59f6838640 1 Processor -- start 2023-12-20T04:44:09.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.759+0000 7f59f6838640 1 -- start start 2023-12-20T04:44:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.760+0000 7f59f6838640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f59f0160450 0x7f59f0160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.760+0000 7f59f6838640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f59f00b5090 0x7f59f00d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.760+0000 7f59f6838640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59f00b5ec0 con 0x7f59f01611b0 2023-12-20T04:44:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.760+0000 7f59f6838640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f01617e0 con 0x7f59f0160450 2023-12-20T04:44:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.760+0000 7f59f6838640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59f00d0fc0 con 0x7f59f00b5090 2023-12-20T04:44:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.760+0000 7f59effff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f59f0160450 0x7f59f0160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.760+0000 7f59ef7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f59f01611b0 0x7f59f00b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40060/0 (socket says 172.21.15.132:40060) 2023-12-20T04:44:09.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.760+0000 7f59ef7fe640 1 -- 172.21.15.132:0/2100381572 learned_addr learned my addr 172.21.15.132:0/2100381572 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.760+0000 7f59f4dd5640 1 --2- 172.21.15.132:0/2100381572 >> v2:172.21.15.187:3300/0 conn(0x7f59f00b5090 0x7f59f00d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.760+0000 7f59effff640 1 -- 172.21.15.132:0/2100381572 >> v2:172.21.15.187:3300/0 conn(0x7f59f00b5090 msgr2=0x7f59f00d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.760+0000 7f59effff640 1 --2- 172.21.15.132:0/2100381572 >> v2:172.21.15.187:3300/0 conn(0x7f59f00b5090 0x7f59f00d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.760+0000 7f59effff640 1 -- 172.21.15.132:0/2100381572 >> v1:172.21.15.132:6789/0 conn(0x7f59f01611b0 legacy=0x7f59f00b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.760+0000 7f59effff640 1 -- 172.21.15.132:0/2100381572 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59f00d12a0 con 0x7f59f0160450 2023-12-20T04:44:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.761+0000 7f59effff640 1 --2- 172.21.15.132:0/2100381572 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f0160450 0x7f59f0160c70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f59f0073c40 tx=0x7f59e002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=815903eef0c07ea9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.761+0000 7f59eeffd640 1 -- 172.21.15.132:0/2100381572 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0030610 con 0x7f59f0160450 2023-12-20T04:44:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.761+0000 7f59eeffd640 1 -- 172.21.15.132:0/2100381572 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e0030770 con 0x7f59f0160450 2023-12-20T04:44:09.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.761+0000 7f59eeffd640 1 -- 172.21.15.132:0/2100381572 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e0030b00 con 0x7f59f0160450 2023-12-20T04:44:09.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.762+0000 7f59f6838640 1 -- 172.21.15.132:0/2100381572 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f0160450 msgr2=0x7f59f0160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:09.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.762+0000 7f59f6838640 1 --2- 172.21.15.132:0/2100381572 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f0160450 0x7f59f0160c70 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f59f0073c40 tx=0x7f59e002b960 comp rx=0 tx=0).stop 2023-12-20T04:44:09.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.762+0000 7f59f6838640 1 -- 172.21.15.132:0/2100381572 shutdown_connections 2023-12-20T04:44:09.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.762+0000 7f59f6838640 1 --2- 172.21.15.132:0/2100381572 >> v2:172.21.15.187:3300/0 conn(0x7f59f00b5090 0x7f59f00d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.762+0000 7f59f6838640 1 --2- 172.21.15.132:0/2100381572 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f0160450 0x7f59f0160c70 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.762+0000 7f59f6838640 1 -- 172.21.15.132:0/2100381572 >> 172.21.15.132:0/2100381572 conn(0x7f59f00cf980 msgr2=0x7f59f00cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:09.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.762+0000 7f59f6838640 1 -- 172.21.15.132:0/2100381572 shutdown_connections 2023-12-20T04:44:09.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.762+0000 7f59f6838640 1 -- 172.21.15.132:0/2100381572 wait complete. 2023-12-20T04:44:09.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.763+0000 7f59f6838640 1 Processor -- start 2023-12-20T04:44:09.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.763+0000 7f59f6838640 1 -- start start 2023-12-20T04:44:09.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.764+0000 7f59f6838640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59f00b5090 0x7f59f0152d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:09.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.764+0000 7f59f6838640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f0160450 0x7f59f01f2d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:09.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.764+0000 7f59f6838640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59f01611b0 0x7f59f015b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:09.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.764+0000 7f59f6838640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f0158a90 con 0x7f59f0160450 2023-12-20T04:44:09.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.764+0000 7f59f6838640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59f0158f80 con 0x7f59f00b5090 2023-12-20T04:44:09.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.764+0000 7f59f6838640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59f0159260 con 0x7f59f01611b0 2023-12-20T04:44:09.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.764+0000 7f59ef7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f0160450 0x7f59f01f2d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:09.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.764+0000 7f59ef7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f0160450 0x7f59f01f2d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56100/0 (socket says 172.21.15.132:56100) 2023-12-20T04:44:09.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.764+0000 7f59ef7fe640 1 -- 172.21.15.132:0/379577218 learned_addr learned my addr 172.21.15.132:0/379577218 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:09.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.764+0000 7f59f4dd5640 1 --2- 172.21.15.132:0/379577218 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59f01611b0 0x7f59f015b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:09.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.764+0000 7f59ef7fe640 1 -- 172.21.15.132:0/379577218 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59f01611b0 msgr2=0x7f59f015b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:09.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.764+0000 7f59ef7fe640 1 --2- 172.21.15.132:0/379577218 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59f01611b0 0x7f59f015b620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.764+0000 7f59effff640 1 --2- 172.21.15.132:0/379577218 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59f00b5090 0x7f59f0152d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:09.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.764+0000 7f59ef7fe640 1 -- 172.21.15.132:0/379577218 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59f00b5090 msgr2=0x7f59f0152d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:09.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.764+0000 7f59ef7fe640 1 --2- 172.21.15.132:0/379577218 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59f00b5090 0x7f59f0152d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:09.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.764+0000 7f59ef7fe640 1 -- 172.21.15.132:0/379577218 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59e0009400 con 0x7f59f0160450 2023-12-20T04:44:09.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.765+0000 7f59ef7fe640 1 --2- 172.21.15.132:0/379577218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f0160450 0x7f59f01f2d80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f59e400c3c0 tx=0x7f59e400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:09.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.765+0000 7f59ecff9640 1 -- 172.21.15.132:0/379577218 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e4005ce0 con 0x7f59f0160450 2023-12-20T04:44:09.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.765+0000 7f59ecff9640 1 -- 172.21.15.132:0/379577218 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f59e4005e40 con 0x7f59f0160450 2023-12-20T04:44:09.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.765+0000 7f59f6838640 1 -- 172.21.15.132:0/379577218 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59f0159540 con 0x7f59f0160450 2023-12-20T04:44:09.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.765+0000 7f59ecff9640 1 -- 172.21.15.132:0/379577218 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f59e40072d0 con 0x7f59f0160450 2023-12-20T04:44:09.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.765+0000 7f59f6838640 1 -- 172.21.15.132:0/379577218 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59f0159b00 con 0x7f59f0160450 2023-12-20T04:44:09.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.766+0000 7f59f6838640 1 -- 172.21.15.132:0/379577218 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59f0159d20 con 0x7f59f0160450 2023-12-20T04:44:09.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.766+0000 7f59ecff9640 1 -- 172.21.15.132:0/379577218 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f59e40074f0 con 0x7f59f0160450 2023-12-20T04:44:09.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.767+0000 7f59ecff9640 1 --2- 172.21.15.132:0/379577218 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f59dc06a430 0x7f59dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:09.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.767+0000 7f59effff640 1 --2- 172.21.15.132:0/379577218 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f59dc06a430 0x7f59dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:09.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.767+0000 7f59ecff9640 1 -- 172.21.15.132:0/379577218 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f59e4087c10 con 0x7f59f0160450 2023-12-20T04:44:09.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.767+0000 7f59effff640 1 --2- 172.21.15.132:0/379577218 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f59dc06a430 0x7f59dc06c8f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f59e0036000 tx=0x7f59e003b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:09.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:09.771+0000 7f59ecff9640 1 -- 172.21.15.132:0/379577218 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f59e4053500 con 0x7f59f0160450 2023-12-20T04:44:10.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.000+0000 7f59f6838640 1 -- 172.21.15.132:0/379577218 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]} v 0) v1 -- 0x7f59f004e840 con 0x7f59f0160450 2023-12-20T04:44:10.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.344+0000 7f59ecff9640 1 -- 172.21.15.132:0/379577218 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_barrier"]}]=0 v96) v1 ==== 130+0+0 (secure 0 0 0) 0x7f59e4056b20 con 0x7f59f0160450 2023-12-20T04:44:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.346+0000 7f59f6838640 1 -- 172.21.15.132:0/379577218 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f59dc06a430 msgr2=0x7f59dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.346+0000 7f59f6838640 1 --2- 172.21.15.132:0/379577218 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f59dc06a430 0x7f59dc06c8f0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f59e0036000 tx=0x7f59e003b040 comp rx=0 tx=0).stop 2023-12-20T04:44:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.346+0000 7f59f6838640 1 -- 172.21.15.132:0/379577218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f0160450 msgr2=0x7f59f01f2d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.346+0000 7f59f6838640 1 --2- 172.21.15.132:0/379577218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f0160450 0x7f59f01f2d80 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f59e400c3c0 tx=0x7f59e400c880 comp rx=0 tx=0).stop 2023-12-20T04:44:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.346+0000 7f59f6838640 1 -- 172.21.15.132:0/379577218 shutdown_connections 2023-12-20T04:44:10.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.346+0000 7f59f6838640 1 --2- 172.21.15.132:0/379577218 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f59dc06a430 0x7f59dc06c8f0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:10.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.346+0000 7f59f6838640 1 --2- 172.21.15.132:0/379577218 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59f01611b0 0x7f59f015b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:10.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.346+0000 7f59f6838640 1 --2- 172.21.15.132:0/379577218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59f0160450 0x7f59f01f2d80 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:10.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.346+0000 7f59f6838640 1 --2- 172.21.15.132:0/379577218 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59f00b5090 0x7f59f0152d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:10.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.346+0000 7f59f6838640 1 -- 172.21.15.132:0/379577218 >> 172.21.15.132:0/379577218 conn(0x7f59f00cf980 msgr2=0x7f59f00b62d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:10.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.346+0000 7f59f6838640 1 -- 172.21.15.132:0/379577218 shutdown_connections 2023-12-20T04:44:10.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.346+0000 7f59f6838640 1 -- 172.21.15.132:0/379577218 wait complete. 2023-12-20T04:44:10.359 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-12-20T04:44:10.360 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestClusterFull) 2023-12-20T04:44:10.360 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-12-20T04:44:10.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.458+0000 7fb29dba9640 1 Processor -- start 2023-12-20T04:44:10.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.458+0000 7fb29dba9640 1 -- start start 2023-12-20T04:44:10.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.459+0000 7fb29dba9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb298159b50 0x7fb2980c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:10.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.459+0000 7fb29dba9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb29815e530 0x7fb29806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:10.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.459+0000 7fb29dba9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2980ccf30 con 0x7fb29806c240 2023-12-20T04:44:10.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.459+0000 7fb29dba9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2980caa60 con 0x7fb298159b50 2023-12-20T04:44:10.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.459+0000 7fb29dba9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2980ccc90 con 0x7fb29815e530 2023-12-20T04:44:10.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.459+0000 7fb2977fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb298159b50 0x7fb2980c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:10.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.459+0000 7fb2977fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb298159b50 0x7fb2980c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56110/0 (socket says 172.21.15.132:56110) 2023-12-20T04:44:10.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.459+0000 7fb297fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb29806c240 0x7fb2980cd3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40064/0 (socket says 172.21.15.132:40064) 2023-12-20T04:44:10.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.459+0000 7fb2977fe640 1 -- 172.21.15.132:0/523978303 learned_addr learned my addr 172.21.15.132:0/523978303 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:10.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.459+0000 7fb296ffd640 1 --2- 172.21.15.132:0/523978303 >> v2:172.21.15.187:3300/0 conn(0x7fb29815e530 0x7fb29806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:10.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.459+0000 7fb2977fe640 1 -- 172.21.15.132:0/523978303 >> v2:172.21.15.187:3300/0 conn(0x7fb29815e530 msgr2=0x7fb29806fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.459+0000 7fb2977fe640 1 --2- 172.21.15.132:0/523978303 >> v2:172.21.15.187:3300/0 conn(0x7fb29815e530 0x7fb29806fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.459+0000 7fb2977fe640 1 -- 172.21.15.132:0/523978303 >> v1:172.21.15.132:6789/0 conn(0x7fb29806c240 legacy=0x7fb2980cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.460+0000 7fb2977fe640 1 -- 172.21.15.132:0/523978303 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2980ca1c0 con 0x7fb298159b50 2023-12-20T04:44:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.459+0000 7fb2967fc640 1 -- 172.21.15.132:0/523978303 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3432126460 0 0) 0x7fb2980ccf30 con 0x7fb29806c240 2023-12-20T04:44:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.460+0000 7fb296ffd640 1 --2- 172.21.15.132:0/523978303 >> v2:172.21.15.187:3300/0 conn(0x7fb29815e530 0x7fb29806fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.460+0000 7fb2977fe640 1 --2- 172.21.15.132:0/523978303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb298159b50 0x7fb2980c9930 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb28800bb10 tx=0x7fb28802e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8664ca7a6e88fc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.460+0000 7fb2967fc640 1 -- 172.21.15.132:0/523978303 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288036440 con 0x7fb298159b50 2023-12-20T04:44:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.460+0000 7fb2967fc640 1 -- 172.21.15.132:0/523978303 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2880365a0 con 0x7fb298159b50 2023-12-20T04:44:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.460+0000 7fb2967fc640 1 -- 172.21.15.132:0/523978303 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb288036930 con 0x7fb298159b50 2023-12-20T04:44:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.461+0000 7fb29dba9640 1 -- 172.21.15.132:0/523978303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb298159b50 msgr2=0x7fb2980c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.461+0000 7fb29dba9640 1 --2- 172.21.15.132:0/523978303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb298159b50 0x7fb2980c9930 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fb28800bb10 tx=0x7fb28802e170 comp rx=0 tx=0).stop 2023-12-20T04:44:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.461+0000 7fb29dba9640 1 -- 172.21.15.132:0/523978303 shutdown_connections 2023-12-20T04:44:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.461+0000 7fb29dba9640 1 --2- 172.21.15.132:0/523978303 >> v2:172.21.15.187:3300/0 conn(0x7fb29815e530 0x7fb29806fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.461+0000 7fb29dba9640 1 --2- 172.21.15.132:0/523978303 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb298159b50 0x7fb2980c9930 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.461+0000 7fb29dba9640 1 -- 172.21.15.132:0/523978303 >> 172.21.15.132:0/523978303 conn(0x7fb2980ced10 msgr2=0x7fb2980cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.461+0000 7fb29dba9640 1 -- 172.21.15.132:0/523978303 shutdown_connections 2023-12-20T04:44:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.461+0000 7fb29dba9640 1 -- 172.21.15.132:0/523978303 wait complete. 2023-12-20T04:44:10.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.462+0000 7fb29dba9640 1 Processor -- start 2023-12-20T04:44:10.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.462+0000 7fb29dba9640 1 -- start start 2023-12-20T04:44:10.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.463+0000 7fb29dba9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb29806c240 0x7fb2980b0dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:10.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.463+0000 7fb29dba9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb298159b50 0x7fb2980c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:10.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.463+0000 7fb29dba9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb29815e530 0x7fb2981f5dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:10.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.463+0000 7fb29dba9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb298152f30 con 0x7fb29815e530 2023-12-20T04:44:10.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.463+0000 7fb29dba9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2980c8870 con 0x7fb298159b50 2023-12-20T04:44:10.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.463+0000 7fb29dba9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2980c8b50 con 0x7fb29806c240 2023-12-20T04:44:10.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.463+0000 7fb297fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb29815e530 0x7fb2981f5dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:10.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.463+0000 7fb297fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb29815e530 0x7fb2981f5dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56116/0 (socket says 172.21.15.132:56116) 2023-12-20T04:44:10.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.463+0000 7fb297fff640 1 -- 172.21.15.132:0/3567128935 learned_addr learned my addr 172.21.15.132:0/3567128935 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:10.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.463+0000 7fb2977fe640 1 --2- 172.21.15.132:0/3567128935 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb29806c240 0x7fb2980b0dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:10.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.463+0000 7fb296ffd640 1 --2- 172.21.15.132:0/3567128935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb298159b50 0x7fb2980c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:10.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.463+0000 7fb297fff640 1 -- 172.21.15.132:0/3567128935 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb29806c240 msgr2=0x7fb2980b0dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:10.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.463+0000 7fb297fff640 1 --2- 172.21.15.132:0/3567128935 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb29806c240 0x7fb2980b0dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:10.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.463+0000 7fb297fff640 1 -- 172.21.15.132:0/3567128935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb298159b50 msgr2=0x7fb2980c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:10.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.463+0000 7fb297fff640 1 --2- 172.21.15.132:0/3567128935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb298159b50 0x7fb2980c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:10.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.463+0000 7fb297fff640 1 -- 172.21.15.132:0/3567128935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb28800b770 con 0x7fb29815e530 2023-12-20T04:44:10.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.463+0000 7fb296ffd640 1 --2- 172.21.15.132:0/3567128935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb298159b50 0x7fb2980c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:10.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.464+0000 7fb297fff640 1 --2- 172.21.15.132:0/3567128935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb29815e530 0x7fb2981f5dc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb29000c780 tx=0x7fb29000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:10.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.464+0000 7fb27ffff640 1 -- 172.21.15.132:0/3567128935 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29000ce90 con 0x7fb29815e530 2023-12-20T04:44:10.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.464+0000 7fb27ffff640 1 -- 172.21.15.132:0/3567128935 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb29000a640 con 0x7fb29815e530 2023-12-20T04:44:10.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.464+0000 7fb29dba9640 1 -- 172.21.15.132:0/3567128935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2980c8e30 con 0x7fb29815e530 2023-12-20T04:44:10.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.464+0000 7fb27ffff640 1 -- 172.21.15.132:0/3567128935 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb29000a9d0 con 0x7fb29815e530 2023-12-20T04:44:10.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.464+0000 7fb29dba9640 1 -- 172.21.15.132:0/3567128935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2980c84b0 con 0x7fb29815e530 2023-12-20T04:44:10.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.465+0000 7fb29dba9640 1 -- 172.21.15.132:0/3567128935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb298153380 con 0x7fb29815e530 2023-12-20T04:44:10.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.465+0000 7fb27ffff640 1 -- 172.21.15.132:0/3567128935 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb29000ab30 con 0x7fb29815e530 2023-12-20T04:44:10.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.466+0000 7fb27ffff640 1 --2- 172.21.15.132:0/3567128935 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb28406a430 0x7fb28406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:10.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.466+0000 7fb2977fe640 1 --2- 172.21.15.132:0/3567128935 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb28406a430 0x7fb28406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:10.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.466+0000 7fb27ffff640 1 -- 172.21.15.132:0/3567128935 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb290087d20 con 0x7fb29815e530 2023-12-20T04:44:10.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.466+0000 7fb2977fe640 1 --2- 172.21.15.132:0/3567128935 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb28406a430 0x7fb28406c8f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb288038000 tx=0x7fb288008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:10.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.470+0000 7fb27ffff640 1 -- 172.21.15.132:0/3567128935 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb298153380 con 0x7fb29815e530 2023-12-20T04:44:10.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:10.700+0000 7fb29dba9640 1 -- 172.21.15.132:0/3567128935 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7fb298153380 con 0x7fb29815e530 2023-12-20T04:44:11.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.345+0000 7fb27ffff640 1 -- 172.21.15.132:0/3567128935 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v97) v1 ==== 145+0+0 (secure 0 0 0) 0x7fb298153380 con 0x7fb29815e530 2023-12-20T04:44:11.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.348+0000 7fb29dba9640 1 -- 172.21.15.132:0/3567128935 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb28406a430 msgr2=0x7fb28406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:11.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.348+0000 7fb29dba9640 1 --2- 172.21.15.132:0/3567128935 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb28406a430 0x7fb28406c8f0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fb288038000 tx=0x7fb288008040 comp rx=0 tx=0).stop 2023-12-20T04:44:11.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.348+0000 7fb29dba9640 1 -- 172.21.15.132:0/3567128935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb29815e530 msgr2=0x7fb2981f5dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:11.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.348+0000 7fb29dba9640 1 --2- 172.21.15.132:0/3567128935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb29815e530 0x7fb2981f5dc0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fb29000c780 tx=0x7fb29000cc40 comp rx=0 tx=0).stop 2023-12-20T04:44:11.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.348+0000 7fb29dba9640 1 -- 172.21.15.132:0/3567128935 shutdown_connections 2023-12-20T04:44:11.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.348+0000 7fb29dba9640 1 --2- 172.21.15.132:0/3567128935 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb28406a430 0x7fb28406c8f0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:11.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.348+0000 7fb29dba9640 1 --2- 172.21.15.132:0/3567128935 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb29815e530 0x7fb2981f5dc0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:11.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.348+0000 7fb29dba9640 1 --2- 172.21.15.132:0/3567128935 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb298159b50 0x7fb2980c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:11.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.348+0000 7fb29dba9640 1 --2- 172.21.15.132:0/3567128935 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb29806c240 0x7fb2980b0dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:11.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.348+0000 7fb29dba9640 1 -- 172.21.15.132:0/3567128935 >> 172.21.15.132:0/3567128935 conn(0x7fb2980ced10 msgr2=0x7fb2980b2b20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:11.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.348+0000 7fb29dba9640 1 -- 172.21.15.132:0/3567128935 shutdown_connections 2023-12-20T04:44:11.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.348+0000 7fb29dba9640 1 -- 172.21.15.132:0/3567128935 wait complete. 2023-12-20T04:44:11.363 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-20T04:44:11.478 INFO:teuthology.orchestra.run.smithi132.stdout:{"osd_objectstore":"memstore"} 2023-12-20T04:44:11.479 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-20T04:44:11.479 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-20T04:44:11.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.580+0000 7f3bcddea640 1 Processor -- start 2023-12-20T04:44:11.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.580+0000 7f3bcddea640 1 -- start start 2023-12-20T04:44:11.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.581+0000 7f3bcddea640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3bc8143610 0x7f3bc80caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:11.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.581+0000 7f3bcddea640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bc80c41f0 0x7f3bc80cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:11.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.581+0000 7f3bcddea640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3bc81439f0 con 0x7f3bc80cd780 2023-12-20T04:44:11.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.581+0000 7f3bcddea640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3bc80cdc30 con 0x7f3bc8143610 2023-12-20T04:44:11.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.581+0000 7f3bcddea640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80c46f0 con 0x7f3bc80c41f0 2023-12-20T04:44:11.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.581+0000 7f3bc77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3bc8143610 0x7f3bc80caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:11.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.581+0000 7f3bc7fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3bc80cd780 0x7f3bc815d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40072/0 (socket says 172.21.15.132:40072) 2023-12-20T04:44:11.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.581+0000 7f3bc7fff640 1 -- 172.21.15.132:0/1875859317 learned_addr learned my addr 172.21.15.132:0/1875859317 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:11.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.581+0000 7f3bc77fe640 1 -- 172.21.15.132:0/1875859317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bc80c41f0 msgr2=0x7f3bc80cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:11.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.581+0000 7f3bc77fe640 1 --2- 172.21.15.132:0/1875859317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bc80c41f0 0x7f3bc80cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:11.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.581+0000 7f3bc77fe640 1 -- 172.21.15.132:0/1875859317 >> v1:172.21.15.132:6789/0 conn(0x7f3bc80cd780 legacy=0x7f3bc815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:11.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.581+0000 7f3bc77fe640 1 -- 172.21.15.132:0/1875859317 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bc80c49d0 con 0x7f3bc8143610 2023-12-20T04:44:11.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.581+0000 7f3bc6ffd640 1 -- 172.21.15.132:0/1875859317 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013603059 0 0) 0x7f3bc81439f0 con 0x7f3bc80cd780 2023-12-20T04:44:11.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.582+0000 7f3bc77fe640 1 --2- 172.21.15.132:0/1875859317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc8143610 0x7f3bc80caa40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80097a0 tx=0x7f3bb802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349e30e9a8c25944 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:11.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.582+0000 7f3bc6ffd640 1 -- 172.21.15.132:0/1875859317 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8031830 con 0x7f3bc8143610 2023-12-20T04:44:11.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.582+0000 7f3bc6ffd640 1 -- 172.21.15.132:0/1875859317 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bb8031990 con 0x7f3bc8143610 2023-12-20T04:44:11.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.582+0000 7f3bc6ffd640 1 -- 172.21.15.132:0/1875859317 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bb8031d20 con 0x7f3bc8143610 2023-12-20T04:44:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.583+0000 7f3bcddea640 1 -- 172.21.15.132:0/1875859317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc8143610 msgr2=0x7f3bc80caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.583+0000 7f3bcddea640 1 --2- 172.21.15.132:0/1875859317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc8143610 0x7f3bc80caa40 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f3bb80097a0 tx=0x7f3bb802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:44:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.583+0000 7f3bcddea640 1 -- 172.21.15.132:0/1875859317 shutdown_connections 2023-12-20T04:44:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.583+0000 7f3bcddea640 1 --2- 172.21.15.132:0/1875859317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bc80c41f0 0x7f3bc80cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.583+0000 7f3bcddea640 1 --2- 172.21.15.132:0/1875859317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc8143610 0x7f3bc80caa40 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.583+0000 7f3bcddea640 1 -- 172.21.15.132:0/1875859317 >> 172.21.15.132:0/1875859317 conn(0x7f3bc806a260 msgr2=0x7f3bc80b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.583+0000 7f3bcddea640 1 -- 172.21.15.132:0/1875859317 shutdown_connections 2023-12-20T04:44:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.583+0000 7f3bcddea640 1 -- 172.21.15.132:0/1875859317 wait complete. 2023-12-20T04:44:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.584+0000 7f3bcddea640 1 Processor -- start 2023-12-20T04:44:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.584+0000 7f3bcddea640 1 -- start start 2023-12-20T04:44:11.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bcddea640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bc80c41f0 0x7f3bc8132fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:11.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bcddea640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bc80cd780 0x7f3bc81530c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:11.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bcddea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc8143610 0x7f3bc8153fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:11.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bcddea640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80b3c90 con 0x7f3bc8143610 2023-12-20T04:44:11.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bcddea640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80b3360 con 0x7f3bc80cd780 2023-12-20T04:44:11.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bcddea640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3bc80b3640 con 0x7f3bc80c41f0 2023-12-20T04:44:11.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bc7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc8143610 0x7f3bc8153fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:11.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bc7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc8143610 0x7f3bc8153fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56130/0 (socket says 172.21.15.132:56130) 2023-12-20T04:44:11.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bc7fff640 1 -- 172.21.15.132:0/2320802840 learned_addr learned my addr 172.21.15.132:0/2320802840 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:11.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bc77fe640 1 --2- 172.21.15.132:0/2320802840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bc80c41f0 0x7f3bc8132fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:11.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bbffff640 1 --2- 172.21.15.132:0/2320802840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bc80cd780 0x7f3bc81530c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:11.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bc7fff640 1 -- 172.21.15.132:0/2320802840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bc80c41f0 msgr2=0x7f3bc8132fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:11.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bc7fff640 1 --2- 172.21.15.132:0/2320802840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bc80c41f0 0x7f3bc8132fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:11.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bc7fff640 1 -- 172.21.15.132:0/2320802840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bc80cd780 msgr2=0x7f3bc81530c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:11.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bc7fff640 1 --2- 172.21.15.132:0/2320802840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bc80cd780 0x7f3bc81530c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:11.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bc7fff640 1 -- 172.21.15.132:0/2320802840 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3bb8009400 con 0x7f3bc8143610 2023-12-20T04:44:11.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bc7fff640 1 --2- 172.21.15.132:0/2320802840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc8143610 0x7f3bc8153fa0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c7e0 tx=0x7f3bc000cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:11.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bc4ff9640 1 -- 172.21.15.132:0/2320802840 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000ce30 con 0x7f3bc8143610 2023-12-20T04:44:11.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bc4ff9640 1 -- 172.21.15.132:0/2320802840 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3bc000a640 con 0x7f3bc8143610 2023-12-20T04:44:11.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bcddea640 1 -- 172.21.15.132:0/2320802840 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3bc80b3920 con 0x7f3bc8143610 2023-12-20T04:44:11.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bc4ff9640 1 -- 172.21.15.132:0/2320802840 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3bc000a9f0 con 0x7f3bc8143610 2023-12-20T04:44:11.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.585+0000 7f3bcddea640 1 -- 172.21.15.132:0/2320802840 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3bc80b4120 con 0x7f3bc8143610 2023-12-20T04:44:11.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.586+0000 7f3bcddea640 1 -- 172.21.15.132:0/2320802840 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3bc80b3e40 con 0x7f3bc8143610 2023-12-20T04:44:11.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.587+0000 7f3bc4ff9640 1 -- 172.21.15.132:0/2320802840 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3bc000ab50 con 0x7f3bc8143610 2023-12-20T04:44:11.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.587+0000 7f3bc4ff9640 1 --2- 172.21.15.132:0/2320802840 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ba806a460 0x7f3ba806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:11.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.587+0000 7f3bc4ff9640 1 -- 172.21.15.132:0/2320802840 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3bc0087970 con 0x7f3bc8143610 2023-12-20T04:44:11.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.587+0000 7f3bc77fe640 1 --2- 172.21.15.132:0/2320802840 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ba806a460 0x7f3ba806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:11.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.587+0000 7f3bc77fe640 1 --2- 172.21.15.132:0/2320802840 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ba806a460 0x7f3ba806c920 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8036000 tx=0x7f3bb803c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:11.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.591+0000 7f3bc4ff9640 1 -- 172.21.15.132:0/2320802840 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3bc80b3e40 con 0x7f3bc8143610 2023-12-20T04:44:11.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.754+0000 7f3bcddea640 1 -- 172.21.15.132:0/2320802840 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f3bc80b3ab0 con 0x7f3bc8143610 2023-12-20T04:44:11.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.758+0000 7f3bc4ff9640 1 -- 172.21.15.132:0/2320802840 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v4)=0 v4) v1 ==== 122+0+0 (secure 0 0 0) 0x7f3bc0018020 con 0x7f3bc8143610 2023-12-20T04:44:11.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.760+0000 7f3bcddea640 1 -- 172.21.15.132:0/2320802840 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ba806a460 msgr2=0x7f3ba806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:11.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.760+0000 7f3bcddea640 1 --2- 172.21.15.132:0/2320802840 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ba806a460 0x7f3ba806c920 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f3bb8036000 tx=0x7f3bb803c040 comp rx=0 tx=0).stop 2023-12-20T04:44:11.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.760+0000 7f3bcddea640 1 -- 172.21.15.132:0/2320802840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc8143610 msgr2=0x7f3bc8153fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:11.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.760+0000 7f3bcddea640 1 --2- 172.21.15.132:0/2320802840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc8143610 0x7f3bc8153fa0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f3bc000c7e0 tx=0x7f3bc000cbe0 comp rx=0 tx=0).stop 2023-12-20T04:44:11.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.760+0000 7f3bcddea640 1 -- 172.21.15.132:0/2320802840 shutdown_connections 2023-12-20T04:44:11.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.760+0000 7f3bcddea640 1 --2- 172.21.15.132:0/2320802840 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ba806a460 0x7f3ba806c920 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:11.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.760+0000 7f3bcddea640 1 --2- 172.21.15.132:0/2320802840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3bc8143610 0x7f3bc8153fa0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:11.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.760+0000 7f3bcddea640 1 --2- 172.21.15.132:0/2320802840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3bc80cd780 0x7f3bc81530c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:11.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.760+0000 7f3bcddea640 1 --2- 172.21.15.132:0/2320802840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3bc80c41f0 0x7f3bc8132fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:11.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.760+0000 7f3bcddea640 1 -- 172.21.15.132:0/2320802840 >> 172.21.15.132:0/2320802840 conn(0x7f3bc806a260 msgr2=0x7f3bc806c080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:11.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.760+0000 7f3bcddea640 1 -- 172.21.15.132:0/2320802840 shutdown_connections 2023-12-20T04:44:11.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:11.760+0000 7f3bcddea640 1 -- 172.21.15.132:0/2320802840 wait complete. 2023-12-20T04:44:11.773 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:44:11.773 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:44:11.821 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:44:11.869 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:44:11.869 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:44:11.870 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:44:11.885 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:44:11.885 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:44:11.885 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:44:11.902 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:44:11.902 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:44:11.903 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:44:11.940 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:44:11.941 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:44:11.941 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:44:11.959 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:44:11.959 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-20T04:44:11.960 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:44:12.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.079+0000 7fdb035d2640 1 Processor -- start 2023-12-20T04:44:12.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.079+0000 7fdb035d2640 1 -- start start 2023-12-20T04:44:12.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.079+0000 7fdb035d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdafc159d00 0x7fdafc15da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:12.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.079+0000 7fdb035d2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdafc15df40 0x7fdafc0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:12.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.079+0000 7fdb035d2640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdafc0cafd0 0x7fdafc06cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:12.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.079+0000 7fdb035d2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdafc06c220 con 0x7fdafc15df40 2023-12-20T04:44:12.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.079+0000 7fdb035d2640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdafc15e4c0 con 0x7fdafc0cafd0 2023-12-20T04:44:12.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.079+0000 7fdb035d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc15e7a0 con 0x7fdafc159d00 2023-12-20T04:44:12.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.079+0000 7fdb00b6d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdafc15df40 0x7fdafc0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:12.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.079+0000 7fdb00b6d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdafc15df40 0x7fdafc0caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56132/0 (socket says 172.21.15.132:56132) 2023-12-20T04:44:12.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.079+0000 7fdb00b6d640 1 -- 172.21.15.132:0/1090820408 learned_addr learned my addr 172.21.15.132:0/1090820408 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:12.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.080+0000 7fdb01b6f640 1 --2- 172.21.15.132:0/1090820408 >> v2:172.21.15.187:3300/0 conn(0x7fdafc0cafd0 0x7fdafc06cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:12.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.080+0000 7fdb0136e640 1 --2- 172.21.15.132:0/1090820408 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdafc159d00 0x7fdafc15da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:12.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.080+0000 7fdb00b6d640 1 -- 172.21.15.132:0/1090820408 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdafc159d00 msgr2=0x7fdafc15da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:12.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.080+0000 7fdb00b6d640 1 --2- 172.21.15.132:0/1090820408 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdafc159d00 0x7fdafc15da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:12.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.080+0000 7fdb00b6d640 1 -- 172.21.15.132:0/1090820408 >> v2:172.21.15.187:3300/0 conn(0x7fdafc0cafd0 msgr2=0x7fdafc06cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:12.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.080+0000 7fdb00b6d640 1 --2- 172.21.15.132:0/1090820408 >> v2:172.21.15.187:3300/0 conn(0x7fdafc0cafd0 0x7fdafc06cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:12.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.080+0000 7fdb00b6d640 1 -- 172.21.15.132:0/1090820408 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdafc06c430 con 0x7fdafc15df40 2023-12-20T04:44:12.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.080+0000 7fdb00b6d640 1 --2- 172.21.15.132:0/1090820408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdafc15df40 0x7fdafc0caa90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0cc4f0 tx=0x7fdaec02e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97019ff17b58dc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:12.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.081+0000 7fdaf3fff640 1 -- 172.21.15.132:0/1090820408 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec02ee90 con 0x7fdafc15df40 2023-12-20T04:44:12.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.081+0000 7fdaf3fff640 1 -- 172.21.15.132:0/1090820408 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaec036440 con 0x7fdafc15df40 2023-12-20T04:44:12.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.081+0000 7fdaf3fff640 1 -- 172.21.15.132:0/1090820408 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaec0367d0 con 0x7fdafc15df40 2023-12-20T04:44:12.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.081+0000 7fdb035d2640 1 -- 172.21.15.132:0/1090820408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdafc15df40 msgr2=0x7fdafc0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:12.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.081+0000 7fdb035d2640 1 --2- 172.21.15.132:0/1090820408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdafc15df40 0x7fdafc0caa90 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0cc4f0 tx=0x7fdaec02e0e0 comp rx=0 tx=0).stop 2023-12-20T04:44:12.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.081+0000 7fdb035d2640 1 -- 172.21.15.132:0/1090820408 shutdown_connections 2023-12-20T04:44:12.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.081+0000 7fdb035d2640 1 --2- 172.21.15.132:0/1090820408 >> v2:172.21.15.187:3300/0 conn(0x7fdafc0cafd0 0x7fdafc06cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:12.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.081+0000 7fdb035d2640 1 --2- 172.21.15.132:0/1090820408 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdafc15df40 0x7fdafc0caa90 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:12.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.081+0000 7fdb035d2640 1 --2- 172.21.15.132:0/1090820408 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdafc159d00 0x7fdafc15da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:12.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.081+0000 7fdb035d2640 1 -- 172.21.15.132:0/1090820408 >> 172.21.15.132:0/1090820408 conn(0x7fdafc0cfca0 msgr2=0x7fdafc0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:12.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.081+0000 7fdb035d2640 1 -- 172.21.15.132:0/1090820408 shutdown_connections 2023-12-20T04:44:12.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.081+0000 7fdb035d2640 1 -- 172.21.15.132:0/1090820408 wait complete. 2023-12-20T04:44:12.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.082+0000 7fdb035d2640 1 Processor -- start 2023-12-20T04:44:12.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.082+0000 7fdb035d2640 1 -- start start 2023-12-20T04:44:12.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.083+0000 7fdb035d2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdafc0cafd0 0x7fdafc15c3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:12.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.083+0000 7fdb035d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdafc159d00 0x7fdafc1501b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:12.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.083+0000 7fdb035d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdafc15df40 0x7fdafc0c8d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:12.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.083+0000 7fdb035d2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc0b56e0 con 0x7fdafc15df40 2023-12-20T04:44:12.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.083+0000 7fdb035d2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc15b390 con 0x7fdafc0cafd0 2023-12-20T04:44:12.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.083+0000 7fdb035d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdafc15b630 con 0x7fdafc159d00 2023-12-20T04:44:12.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.083+0000 7fdb01b6f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdafc15df40 0x7fdafc0c8d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:12.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.083+0000 7fdb01b6f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdafc15df40 0x7fdafc0c8d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56146/0 (socket says 172.21.15.132:56146) 2023-12-20T04:44:12.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.083+0000 7fdb01b6f640 1 -- 172.21.15.132:0/2110639304 learned_addr learned my addr 172.21.15.132:0/2110639304 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:12.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.083+0000 7fdb00b6d640 1 --2- 172.21.15.132:0/2110639304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdafc159d00 0x7fdafc1501b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:12.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.083+0000 7fdb0136e640 1 --2- 172.21.15.132:0/2110639304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdafc0cafd0 0x7fdafc15c3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:12.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.083+0000 7fdb01b6f640 1 -- 172.21.15.132:0/2110639304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdafc159d00 msgr2=0x7fdafc1501b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:12.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.083+0000 7fdb01b6f640 1 --2- 172.21.15.132:0/2110639304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdafc159d00 0x7fdafc1501b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:12.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.083+0000 7fdb01b6f640 1 -- 172.21.15.132:0/2110639304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdafc0cafd0 msgr2=0x7fdafc15c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.083+0000 7fdb01b6f640 1 --2- 172.21.15.132:0/2110639304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdafc0cafd0 0x7fdafc15c3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.083+0000 7fdb01b6f640 1 -- 172.21.15.132:0/2110639304 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdaec00b770 con 0x7fdafc15df40 2023-12-20T04:44:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.084+0000 7fdb01b6f640 1 --2- 172.21.15.132:0/2110639304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdafc15df40 0x7fdafc0c8d80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400d800 tx=0x7fdaf400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.084+0000 7fdaf1ffb640 1 -- 172.21.15.132:0/2110639304 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf40096c0 con 0x7fdafc15df40 2023-12-20T04:44:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.084+0000 7fdaf1ffb640 1 -- 172.21.15.132:0/2110639304 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdaf4009840 con 0x7fdafc15df40 2023-12-20T04:44:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.084+0000 7fdb035d2640 1 -- 172.21.15.132:0/2110639304 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdafc15b910 con 0x7fdafc15df40 2023-12-20T04:44:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.084+0000 7fdaf1ffb640 1 -- 172.21.15.132:0/2110639304 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdaf4009bf0 con 0x7fdafc15df40 2023-12-20T04:44:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.084+0000 7fdb035d2640 1 -- 172.21.15.132:0/2110639304 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdafc15bed0 con 0x7fdafc15df40 2023-12-20T04:44:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.085+0000 7fdb035d2640 1 -- 172.21.15.132:0/2110639304 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdafc0737d0 con 0x7fdafc15df40 2023-12-20T04:44:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.085+0000 7fdaf1ffb640 1 -- 172.21.15.132:0/2110639304 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdaf4009d50 con 0x7fdafc15df40 2023-12-20T04:44:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.086+0000 7fdaf1ffb640 1 --2- 172.21.15.132:0/2110639304 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdae006a430 0x7fdae006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.086+0000 7fdaf1ffb640 1 -- 172.21.15.132:0/2110639304 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fdaf4088a90 con 0x7fdafc15df40 2023-12-20T04:44:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.086+0000 7fdb0136e640 1 --2- 172.21.15.132:0/2110639304 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdae006a430 0x7fdae006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:12.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.086+0000 7fdb0136e640 1 --2- 172.21.15.132:0/2110639304 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdae006a430 0x7fdae006c8f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0c9a40 tx=0x7fdaf80039b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:12.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.091+0000 7fdaf1ffb640 1 -- 172.21.15.132:0/2110639304 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdafc0737d0 con 0x7fdafc15df40 2023-12-20T04:44:12.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.289+0000 7fdb035d2640 1 -- 172.21.15.132:0/2110639304 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdafc0737d0 con 0x7fdafc15df40 2023-12-20T04:44:12.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.290+0000 7fdaf1ffb640 1 -- 172.21.15.132:0/2110639304 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 15 v15) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fdaf4018de0 con 0x7fdafc15df40 2023-12-20T04:44:12.291 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:12.291 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":15,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4805,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/703933798","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":703933798},{"type":"v1","addr":"172.21.15.187:6835","nonce":703933798}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":4957,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3137083608","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3137083608},{"type":"v1","addr":"172.21.15.187:6833","nonce":3137083608}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5196,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1340012349","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1340012349},{"type":"v1","addr":"172.21.15.132:6836","nonce":1340012349}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":5613,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1308455900","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1308455900},{"type":"v1","addr":"172.21.15.132:6837","nonce":1308455900}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":15}],"filesystems":[]} 2023-12-20T04:44:12.291 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 15 2023-12-20T04:44:12.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.292+0000 7fdb035d2640 1 -- 172.21.15.132:0/2110639304 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdae006a430 msgr2=0x7fdae006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:12.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.292+0000 7fdb035d2640 1 --2- 172.21.15.132:0/2110639304 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdae006a430 0x7fdae006c8f0 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fdafc0c9a40 tx=0x7fdaf80039b0 comp rx=0 tx=0).stop 2023-12-20T04:44:12.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.292+0000 7fdb035d2640 1 -- 172.21.15.132:0/2110639304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdafc15df40 msgr2=0x7fdafc0c8d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:12.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.292+0000 7fdb035d2640 1 --2- 172.21.15.132:0/2110639304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdafc15df40 0x7fdafc0c8d80 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7fdaf400d800 tx=0x7fdaf400dcc0 comp rx=0 tx=0).stop 2023-12-20T04:44:12.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.292+0000 7fdb035d2640 1 -- 172.21.15.132:0/2110639304 shutdown_connections 2023-12-20T04:44:12.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.292+0000 7fdb035d2640 1 --2- 172.21.15.132:0/2110639304 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdae006a430 0x7fdae006c8f0 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:12.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.292+0000 7fdb035d2640 1 --2- 172.21.15.132:0/2110639304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdafc15df40 0x7fdafc0c8d80 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:12.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.292+0000 7fdb035d2640 1 --2- 172.21.15.132:0/2110639304 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdafc159d00 0x7fdafc1501b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:12.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.292+0000 7fdb035d2640 1 --2- 172.21.15.132:0/2110639304 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdafc0cafd0 0x7fdafc15c3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:12.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.292+0000 7fdb035d2640 1 -- 172.21.15.132:0/2110639304 >> 172.21.15.132:0/2110639304 conn(0x7fdafc0cfca0 msgr2=0x7fdafc152760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:12.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.292+0000 7fdb035d2640 1 -- 172.21.15.132:0/2110639304 shutdown_connections 2023-12-20T04:44:12.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.292+0000 7fdb035d2640 1 -- 172.21.15.132:0/2110639304 wait complete. 2023-12-20T04:44:12.304 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-20T04:44:12.304 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-20T04:44:12.304 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-20T04:44:12.304 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:44:12.304 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-20T04:44:12.304 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-20T04:44:12.305 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-20T04:44:12.305 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:44:12.305 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-20T04:44:12.305 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-20T04:44:12.305 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-20T04:44:12.305 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:44:12.305 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-20T04:44:12.306 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-20T04:44:12.306 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-20T04:44:12.306 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:44:12.315 INFO:tasks.ceph.mds.a:Stopped 2023-12-20T04:44:12.316 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-20T04:44:12.316 INFO:tasks.ceph.mds.c:Stopped 2023-12-20T04:44:12.317 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-20T04:44:12.318 INFO:tasks.ceph.mds.b:Stopped 2023-12-20T04:44:12.318 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-20T04:44:12.319 INFO:tasks.ceph.mds.d:Stopped 2023-12-20T04:44:12.319 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-20T04:44:12.358 INFO:tasks.ceph.mds.a:Started 2023-12-20T04:44:12.358 DEBUG:teuthology.parallel:result is None 2023-12-20T04:44:12.358 INFO:tasks.ceph.mds.c:Started 2023-12-20T04:44:12.359 DEBUG:teuthology.parallel:result is None 2023-12-20T04:44:12.361 INFO:tasks.ceph.mds.b:Started 2023-12-20T04:44:12.361 DEBUG:teuthology.parallel:result is None 2023-12-20T04:44:12.361 INFO:tasks.ceph.mds.d:Started 2023-12-20T04:44:12.362 DEBUG:teuthology.parallel:result is None 2023-12-20T04:44:12.362 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-20T04:44:12.434 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-12-20T04:44:12.434 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-12-20T04:44:12.441 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-12-20T04:44:12.442 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-12-20T04:44:12.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.468+0000 7f381dd63640 1 Processor -- start 2023-12-20T04:44:12.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.468+0000 7f381dd63640 1 -- start start 2023-12-20T04:44:12.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.469+0000 7f381dd63640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f38180d30a0 0x7f38180cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:12.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.469+0000 7f381dd63640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38180d0cf0 con 0x7f38180d0060 2023-12-20T04:44:12.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.469+0000 7f381dd63640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f38180d0550 con 0x7f381815d2c0 2023-12-20T04:44:12.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.469+0000 7f381dd63640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f38180cddc0 con 0x7f38180d30a0 2023-12-20T04:44:12.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.469+0000 7f3817fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f38180d0060 0x7f38180d1180 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40108/0 (socket says 172.21.15.132:40108) 2023-12-20T04:44:12.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.469+0000 7f3817fff640 1 -- 172.21.15.132:0/2130083778 learned_addr learned my addr 172.21.15.132:0/2130083778 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:12.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.469+0000 7f38177fe640 1 --2- 172.21.15.132:0/2130083778 >> v2:172.21.15.187:3300/0 conn(0x7f38180d30a0 0x7f38180cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:12.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.470+0000 7f38177fe640 1 -- 172.21.15.132:0/2130083778 >> v1:172.21.15.187:6789/0 conn(0x7f381815d2c0 legacy=0x7f38180d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:12.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.470+0000 7f38177fe640 1 -- 172.21.15.132:0/2130083778 >> v1:172.21.15.132:6789/0 conn(0x7f38180d0060 legacy=0x7f38180d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:12.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.470+0000 7f38177fe640 1 -- 172.21.15.132:0/2130083778 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38180ce0a0 con 0x7f38180d30a0 2023-12-20T04:44:12.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.471+0000 7f38177fe640 1 --2- 172.21.15.132:0/2130083778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38180d30a0 0x7f38180cd5c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f380c0097a0 tx=0x7f380c02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a6239daabffc8a64 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:12.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.471+0000 7f38167fc640 1 -- 172.21.15.132:0/2130083778 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c030610 con 0x7f38180d30a0 2023-12-20T04:44:12.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.472+0000 7f38167fc640 1 -- 172.21.15.132:0/2130083778 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f380c030770 con 0x7f38180d30a0 2023-12-20T04:44:12.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.472+0000 7f38167fc640 1 -- 172.21.15.132:0/2130083778 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f380c030b00 con 0x7f38180d30a0 2023-12-20T04:44:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.472+0000 7f381dd63640 1 -- 172.21.15.132:0/2130083778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38180d30a0 msgr2=0x7f38180cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.472+0000 7f381dd63640 1 --2- 172.21.15.132:0/2130083778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38180d30a0 0x7f38180cd5c0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f380c0097a0 tx=0x7f380c02b960 comp rx=0 tx=0).stop 2023-12-20T04:44:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.472+0000 7f381dd63640 1 -- 172.21.15.132:0/2130083778 shutdown_connections 2023-12-20T04:44:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.472+0000 7f381dd63640 1 --2- 172.21.15.132:0/2130083778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38180d30a0 0x7f38180cd5c0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.472+0000 7f381dd63640 1 -- 172.21.15.132:0/2130083778 >> 172.21.15.132:0/2130083778 conn(0x7f3818072e40 msgr2=0x7f3818073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.472+0000 7f381dd63640 1 -- 172.21.15.132:0/2130083778 shutdown_connections 2023-12-20T04:44:12.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.472+0000 7f381dd63640 1 -- 172.21.15.132:0/2130083778 wait complete. 2023-12-20T04:44:12.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.474+0000 7f381dd63640 1 Processor -- start 2023-12-20T04:44:12.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.474+0000 7f381dd63640 1 -- start start 2023-12-20T04:44:12.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f381dd63640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38180d0060 0x7f38180b5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:12.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f381dd63640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38180d30a0 0x7f38181523b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f381dd63640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f381815d2c0 0x7f38180ca530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f381dd63640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180b82b0 con 0x7f38180d30a0 2023-12-20T04:44:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f381dd63640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38180b6ec0 con 0x7f381815d2c0 2023-12-20T04:44:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f381dd63640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38180b6620 con 0x7f38180d0060 2023-12-20T04:44:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f3816ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38180d30a0 0x7f38181523b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f38177fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38180d0060 0x7f38180b5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f3816ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38180d30a0 0x7f38181523b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56164/0 (socket says 172.21.15.132:56164) 2023-12-20T04:44:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f3816ffd640 1 -- 172.21.15.132:0/2338322746 learned_addr learned my addr 172.21.15.132:0/2338322746 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f3817fff640 1 --2- 172.21.15.132:0/2338322746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f381815d2c0 0x7f38180ca530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:12.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f3816ffd640 1 -- 172.21.15.132:0/2338322746 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38180d0060 msgr2=0x7f38180b5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:12.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f3816ffd640 1 --2- 172.21.15.132:0/2338322746 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38180d0060 0x7f38180b5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:12.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f3816ffd640 1 -- 172.21.15.132:0/2338322746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f381815d2c0 msgr2=0x7f38180ca530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:12.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f3816ffd640 1 --2- 172.21.15.132:0/2338322746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f381815d2c0 0x7f38180ca530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:12.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f3816ffd640 1 -- 172.21.15.132:0/2338322746 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f380c009400 con 0x7f38180d30a0 2023-12-20T04:44:12.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f38177fe640 1 --2- 172.21.15.132:0/2338322746 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38180d0060 0x7f38180b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:44:12.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f3817fff640 1 --2- 172.21.15.132:0/2338322746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f381815d2c0 0x7f38180ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:44:12.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f3816ffd640 1 --2- 172.21.15.132:0/2338322746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38180d30a0 0x7f38181523b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f380800c3c0 tx=0x7f380800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:12.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f37fffff640 1 -- 172.21.15.132:0/2338322746 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38080052d0 con 0x7f38180d30a0 2023-12-20T04:44:12.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.475+0000 7f37fffff640 1 -- 172.21.15.132:0/2338322746 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3808005450 con 0x7f38180d30a0 2023-12-20T04:44:12.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.476+0000 7f381dd63640 1 -- 172.21.15.132:0/2338322746 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f38180b6900 con 0x7f38180d30a0 2023-12-20T04:44:12.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.476+0000 7f37fffff640 1 -- 172.21.15.132:0/2338322746 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3808003830 con 0x7f38180d30a0 2023-12-20T04:44:12.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.476+0000 7f381dd63640 1 -- 172.21.15.132:0/2338322746 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f381815d740 con 0x7f38180d30a0 2023-12-20T04:44:12.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.477+0000 7f381dd63640 1 -- 172.21.15.132:0/2338322746 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f381804e840 con 0x7f38180d30a0 2023-12-20T04:44:12.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.477+0000 7f37fffff640 1 -- 172.21.15.132:0/2338322746 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3808003990 con 0x7f38180d30a0 2023-12-20T04:44:12.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.477+0000 7f37fffff640 1 --2- 172.21.15.132:0/2338322746 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f380406a430 0x7f380406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:12.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.477+0000 7f37fffff640 1 -- 172.21.15.132:0/2338322746 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(42..42 src has 1..42) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f38080879f0 con 0x7f38180d30a0 2023-12-20T04:44:12.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.477+0000 7f38177fe640 1 --2- 172.21.15.132:0/2338322746 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f380406a430 0x7f380406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:12.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.478+0000 7f38177fe640 1 --2- 172.21.15.132:0/2338322746 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f380406a430 0x7f380406c8f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f380c036000 tx=0x7f380c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:12.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.482+0000 7f37fffff640 1 -- 172.21.15.132:0/2338322746 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3808053420 con 0x7f38180d30a0 2023-12-20T04:44:12.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:12.660+0000 7f381dd63640 1 -- 172.21.15.132:0/2338322746 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f38180cdba0 con 0x7f38180d30a0 2023-12-20T04:44:13.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.477+0000 7f37fffff640 1 -- 172.21.15.132:0/2338322746 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v43) v1 ==== 97+0+0 (secure 0 0 0) 0x7f3808056a40 con 0x7f38180d30a0 2023-12-20T04:44:13.478 INFO:teuthology.orchestra.run.smithi132.stderr: removed all blocklist entries 2023-12-20T04:44:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.480+0000 7f381dd63640 1 -- 172.21.15.132:0/2338322746 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f380406a430 msgr2=0x7f380406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.480+0000 7f381dd63640 1 --2- 172.21.15.132:0/2338322746 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f380406a430 0x7f380406c8f0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f380c036000 tx=0x7f380c008030 comp rx=0 tx=0).stop 2023-12-20T04:44:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.480+0000 7f381dd63640 1 -- 172.21.15.132:0/2338322746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38180d30a0 msgr2=0x7f38181523b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.480+0000 7f381dd63640 1 --2- 172.21.15.132:0/2338322746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38180d30a0 0x7f38181523b0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f380800c3c0 tx=0x7f380800c880 comp rx=0 tx=0).stop 2023-12-20T04:44:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.480+0000 7f381dd63640 1 -- 172.21.15.132:0/2338322746 shutdown_connections 2023-12-20T04:44:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.480+0000 7f381dd63640 1 --2- 172.21.15.132:0/2338322746 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f380406a430 0x7f380406c8f0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.480+0000 7f381dd63640 1 --2- 172.21.15.132:0/2338322746 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f381815d2c0 0x7f38180ca530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.480+0000 7f381dd63640 1 --2- 172.21.15.132:0/2338322746 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38180d30a0 0x7f38181523b0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.480+0000 7f381dd63640 1 --2- 172.21.15.132:0/2338322746 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38180d0060 0x7f38180b5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.480+0000 7f381dd63640 1 -- 172.21.15.132:0/2338322746 >> 172.21.15.132:0/2338322746 conn(0x7f3818072e40 msgr2=0x7f38180cf680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.480+0000 7f381dd63640 1 -- 172.21.15.132:0/2338322746 shutdown_connections 2023-12-20T04:44:13.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.480+0000 7f381dd63640 1 -- 172.21.15.132:0/2338322746 wait complete. 2023-12-20T04:44:13.494 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-20T04:44:13.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.596+0000 7fd2e3539640 1 Processor -- start 2023-12-20T04:44:13.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.596+0000 7fd2e3539640 1 -- start start 2023-12-20T04:44:13.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.597+0000 7fd2e3539640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2dc06c410 0x7fd2dc0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:13.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.597+0000 7fd2e3539640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2dc0add30 con 0x7fd2dc15cef0 2023-12-20T04:44:13.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.597+0000 7fd2e3539640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2dc0ae010 con 0x7fd2dc15d2d0 2023-12-20T04:44:13.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.597+0000 7fd2e3539640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc072d00 con 0x7fd2dc06c410 2023-12-20T04:44:13.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.597+0000 7fd2e12d5640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd2dc15cef0 0x7fd2dc0cd1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40122/0 (socket says 172.21.15.132:40122) 2023-12-20T04:44:13.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.597+0000 7fd2e12d5640 1 -- 172.21.15.132:0/2733318339 learned_addr learned my addr 172.21.15.132:0/2733318339 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:13.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.597+0000 7fd2d3fff640 1 -- 172.21.15.132:0/2733318339 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 229412437 0 0) 0x7fd2dc0add30 con 0x7fd2dc15cef0 2023-12-20T04:44:13.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.597+0000 7fd2d3fff640 1 -- 172.21.15.132:0/2733318339 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd2c8003520 con 0x7fd2dc15cef0 2023-12-20T04:44:13.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.597+0000 7fd2e1ad6640 1 --2- 172.21.15.132:0/2733318339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2dc06c410 0x7fd2dc0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:13.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2d3fff640 1 -- 172.21.15.132:0/2733318339 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4110035693 0 0) 0x7fd2c8003520 con 0x7fd2dc15cef0 2023-12-20T04:44:13.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2d3fff640 1 -- 172.21.15.132:0/2733318339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2dc06c410 msgr2=0x7fd2dc0cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:13.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2d3fff640 1 --2- 172.21.15.132:0/2733318339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2dc06c410 0x7fd2dc0cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2d3fff640 1 -- 172.21.15.132:0/2733318339 >> v1:172.21.15.187:6789/0 conn(0x7fd2dc15d2d0 legacy=0x7fd2dc06bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:13.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2d3fff640 1 -- 172.21.15.132:0/2733318339 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2dc072fe0 con 0x7fd2dc15cef0 2023-12-20T04:44:13.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2d3fff640 1 -- 172.21.15.132:0/2733318339 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fd2d8001690 con 0x7fd2dc15cef0 2023-12-20T04:44:13.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2d3fff640 1 -- 172.21.15.132:0/2733318339 >> v1:172.21.15.132:6789/0 conn(0x7fd2dc15cef0 legacy=0x7fd2dc0cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:13.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2d3fff640 1 --2- 172.21.15.132:0/2733318339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80039a0 0x7fd2c8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:13.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2d3fff640 1 --2- 172.21.15.132:0/2733318339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2c80047c0 0x7fd2c8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:13.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2d3fff640 1 --2- 172.21.15.132:0/2733318339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2dc06c410 0x7fd2c80051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:13.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2d3fff640 1 -- 172.21.15.132:0/2733318339 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc072d00 con 0x7fd2c80039a0 2023-12-20T04:44:13.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2d3fff640 1 -- 172.21.15.132:0/2733318339 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c800bb70 con 0x7fd2c80047c0 2023-12-20T04:44:13.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2d3fff640 1 -- 172.21.15.132:0/2733318339 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2c800bd30 con 0x7fd2dc06c410 2023-12-20T04:44:13.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2e12d5640 1 --2- 172.21.15.132:0/2733318339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80039a0 0x7fd2c8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:13.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2e0ad4640 1 --2- 172.21.15.132:0/2733318339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2c80047c0 0x7fd2c8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:13.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2e1ad6640 1 --2- 172.21.15.132:0/2733318339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2dc06c410 0x7fd2c80051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:13.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2e12d5640 1 -- 172.21.15.132:0/2733318339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2dc06c410 msgr2=0x7fd2c80051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:13.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2e12d5640 1 --2- 172.21.15.132:0/2733318339 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2dc06c410 0x7fd2c80051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2e12d5640 1 -- 172.21.15.132:0/2733318339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2c80047c0 msgr2=0x7fd2c8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:13.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2e12d5640 1 --2- 172.21.15.132:0/2733318339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2c80047c0 0x7fd2c8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2e12d5640 1 -- 172.21.15.132:0/2733318339 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2c8003520 con 0x7fd2c80039a0 2023-12-20T04:44:13.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.598+0000 7fd2e0ad4640 1 --2- 172.21.15.132:0/2733318339 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2c80047c0 0x7fd2c8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:13.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.599+0000 7fd2e12d5640 1 --2- 172.21.15.132:0/2733318339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80039a0 0x7fd2c8003dc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0d0210 tx=0x7fd2c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8b8f4706a8ef447 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:13.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.599+0000 7fd2d3fff640 1 -- 172.21.15.132:0/2733318339 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8005ad0 con 0x7fd2c80039a0 2023-12-20T04:44:13.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.599+0000 7fd2d3fff640 1 -- 172.21.15.132:0/2733318339 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d8005c30 con 0x7fd2c80039a0 2023-12-20T04:44:13.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.599+0000 7fd2d3fff640 1 -- 172.21.15.132:0/2733318339 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d802c890 con 0x7fd2c80039a0 2023-12-20T04:44:13.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.600+0000 7fd2e3539640 1 -- 172.21.15.132:0/2733318339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80039a0 msgr2=0x7fd2c8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:13.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.600+0000 7fd2e3539640 1 --2- 172.21.15.132:0/2733318339 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80039a0 0x7fd2c8003dc0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd2dc0d0210 tx=0x7fd2c80057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.600+0000 7fd2e1ad6640 1 -- 172.21.15.132:0/2733318339 reap_dead start 2023-12-20T04:44:13.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.600+0000 7fd2e3539640 1 -- 172.21.15.132:0/2733318339 shutdown_connections 2023-12-20T04:44:13.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.600+0000 7fd2e3539640 1 -- 172.21.15.132:0/2733318339 >> 172.21.15.132:0/2733318339 conn(0x7fd2dc0cf330 msgr2=0x7fd2dc0cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:13.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.600+0000 7fd2e3539640 1 -- 172.21.15.132:0/2733318339 shutdown_connections 2023-12-20T04:44:13.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.600+0000 7fd2e3539640 1 -- 172.21.15.132:0/2733318339 wait complete. 2023-12-20T04:44:13.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.601+0000 7fd2e3539640 1 Processor -- start 2023-12-20T04:44:13.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.601+0000 7fd2e3539640 1 -- start start 2023-12-20T04:44:13.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.601+0000 7fd2e3539640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80039a0 0x7fd2dc1f3320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:13.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.601+0000 7fd2e3539640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2dc15a780 0x7fd2dc15c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:13.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2e3539640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2dc1f2000 0x7fd2dc0aff40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:13.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2e3539640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc1f3860 con 0x7fd2c80039a0 2023-12-20T04:44:13.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2e3539640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc15af90 con 0x7fd2dc15a780 2023-12-20T04:44:13.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2e3539640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2dc15b270 con 0x7fd2dc1f2000 2023-12-20T04:44:13.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2e12d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80039a0 0x7fd2dc1f3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:13.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2e12d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80039a0 0x7fd2dc1f3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56180/0 (socket says 172.21.15.132:56180) 2023-12-20T04:44:13.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2e12d5640 1 -- 172.21.15.132:0/4155106183 learned_addr learned my addr 172.21.15.132:0/4155106183 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:13.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2e1ad6640 1 --2- 172.21.15.132:0/4155106183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2dc1f2000 0x7fd2dc0aff40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:13.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2e0ad4640 1 --2- 172.21.15.132:0/4155106183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2dc15a780 0x7fd2dc15c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:13.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2e12d5640 1 -- 172.21.15.132:0/4155106183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2dc1f2000 msgr2=0x7fd2dc0aff40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:13.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2e12d5640 1 --2- 172.21.15.132:0/4155106183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2dc1f2000 0x7fd2dc0aff40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2e12d5640 1 -- 172.21.15.132:0/4155106183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2dc15a780 msgr2=0x7fd2dc15c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:13.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2e12d5640 1 --2- 172.21.15.132:0/4155106183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2dc15a780 0x7fd2dc15c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2e12d5640 1 -- 172.21.15.132:0/4155106183 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2dc15b550 con 0x7fd2c80039a0 2023-12-20T04:44:13.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2e12d5640 1 --2- 172.21.15.132:0/4155106183 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80039a0 0x7fd2dc1f3320 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8000f60 tx=0x7fd2d8001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:13.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2d1ffb640 1 -- 172.21.15.132:0/4155106183 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8039070 con 0x7fd2c80039a0 2023-12-20T04:44:13.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2d1ffb640 1 -- 172.21.15.132:0/4155106183 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2d802cca0 con 0x7fd2c80039a0 2023-12-20T04:44:13.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2e3539640 1 -- 172.21.15.132:0/4155106183 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2dc15b830 con 0x7fd2c80039a0 2023-12-20T04:44:13.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2d1ffb640 1 -- 172.21.15.132:0/4155106183 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2d803c040 con 0x7fd2c80039a0 2023-12-20T04:44:13.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.602+0000 7fd2e3539640 1 -- 172.21.15.132:0/4155106183 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2dc15c570 con 0x7fd2c80039a0 2023-12-20T04:44:13.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.603+0000 7fd2e3539640 1 -- 172.21.15.132:0/4155106183 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2dc04e840 con 0x7fd2c80039a0 2023-12-20T04:44:13.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.604+0000 7fd2d1ffb640 1 -- 172.21.15.132:0/4155106183 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd2d8032070 con 0x7fd2c80039a0 2023-12-20T04:44:13.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.604+0000 7fd2d1ffb640 1 --2- 172.21.15.132:0/4155106183 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2c006a430 0x7fd2c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:13.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.604+0000 7fd2d1ffb640 1 -- 172.21.15.132:0/4155106183 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd2d80a98d0 con 0x7fd2c80039a0 2023-12-20T04:44:13.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.604+0000 7fd2e0ad4640 1 --2- 172.21.15.132:0/4155106183 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2c006a430 0x7fd2c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:13.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.605+0000 7fd2e0ad4640 1 --2- 172.21.15.132:0/4155106183 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2c006a430 0x7fd2c006c8f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc000c00 tx=0x7fd2cc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:13.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.608+0000 7fd2d1ffb640 1 -- 172.21.15.132:0/4155106183 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd2d80752c0 con 0x7fd2c80039a0 2023-12-20T04:44:13.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.837+0000 7fd2e3539640 1 -- 172.21.15.132:0/4155106183 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd2dc0b52b0 con 0x7fd2c80039a0 2023-12-20T04:44:13.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.838+0000 7fd2d1ffb640 1 -- 172.21.15.132:0/4155106183 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v13) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd2d80788e0 con 0x7fd2c80039a0 2023-12-20T04:44:13.839 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:13.839 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:44:13.839 INFO:teuthology.orchestra.run.smithi132.stdout: "auth_dump": [ 2023-12-20T04:44:13.839 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.839 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.a", 2023-12-20T04:44:13.839 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlbTdZOxAAUDz0Eno9DYvrYM1xg5jG/A==", 2023-12-20T04:44:13.839 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.839 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:44:13.839 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:44:13.839 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:44:13.839 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:44:13.839 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.839 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.840 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.840 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.b", 2023-12-20T04:44:13.840 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl43gVDBAA1qJwUU+Ii4BalGf3NtJnGA==", 2023-12-20T04:44:13.840 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.840 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:44:13.840 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:44:13.840 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:44:13.840 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:44:13.840 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.840 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.840 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.840 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.c", 2023-12-20T04:44:13.840 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlaSUVBxAA7HN3dSo9xfvkjvc6bwMxWg==", 2023-12-20T04:44:13.840 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.840 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:44:13.840 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:44:13.841 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:44:13.841 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:44:13.841 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.841 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.841 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.d", 2023-12-20T04:44:13.841 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl1DR4ExAANNOyGlf1Ayre/xZEb9JHYg==", 2023-12-20T04:44:13.841 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.841 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:44:13.841 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:44:13.841 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:44:13.841 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:44:13.841 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.842 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.842 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.0", 2023-12-20T04:44:13.842 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCucIJlwZfxORAAiT2g1poLu3OkmoyxNJQc8Q==", 2023-12-20T04:44:13.842 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.842 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:44:13.842 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:44:13.842 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:44:13.842 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.842 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.842 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.842 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.1", 2023-12-20T04:44:13.842 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlejHYBRAAKurKpW5gyOAQ+E4Su4xMSQ==", 2023-12-20T04:44:13.842 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.842 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:44:13.842 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:44:13.842 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:44:13.843 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.843 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.843 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.2", 2023-12-20T04:44:13.843 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlyfz8DBAA9a6tUjHF8IRIKeldwVFMcw==", 2023-12-20T04:44:13.843 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.843 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:44:13.843 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:44:13.843 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:44:13.843 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.843 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.843 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.3", 2023-12-20T04:44:13.843 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJllFEeFBAA6URrqUjQqHsrI5+qEBVs3g==", 2023-12-20T04:44:13.844 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.844 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:44:13.844 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:44:13.844 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:44:13.844 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.844 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.844 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.4", 2023-12-20T04:44:13.844 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlvGqcJhAAgn2wuSTwLT+TOHoE4iaVSg==", 2023-12-20T04:44:13.844 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.844 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:44:13.844 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:44:13.844 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:44:13.844 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.845 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.5", 2023-12-20T04:44:13.845 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlWrkTLhAA2KlpxTFPaiXLCvmURpg5rw==", 2023-12-20T04:44:13.845 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.845 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:44:13.845 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:44:13.845 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:44:13.845 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.845 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.845 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.6", 2023-12-20T04:44:13.845 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlnOQfNRAA//EVx0BZYQd7ovK2tFhgfA==", 2023-12-20T04:44:13.845 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.845 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:44:13.845 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:44:13.846 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:44:13.846 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.846 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.846 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.7", 2023-12-20T04:44:13.846 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCzcIJl4nfDABAAtBdl2qkzKcqhmzsukC7G5w==", 2023-12-20T04:44:13.846 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.846 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:44:13.846 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:44:13.846 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:44:13.846 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.847 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.0", 2023-12-20T04:44:13.847 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlm/nGFxAA6zndayizc50Il7l74BxkgQ==", 2023-12-20T04:44:13.847 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.847 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:44:13.847 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow r", 2023-12-20T04:44:13.847 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-20T04:44:13.847 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.847 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.1", 2023-12-20T04:44:13.847 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlppb6IBAArqCoSlSE5coxkj4+XjPoWg==", 2023-12-20T04:44:13.848 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.848 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:44:13.848 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:44:13.848 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:44:13.848 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:44:13.848 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.848 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.2", 2023-12-20T04:44:13.848 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlMgWUHRAAqSdmRGx+9J+3dO7ntaApdw==", 2023-12-20T04:44:13.848 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.848 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:44:13.848 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:44:13.848 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:44:13.848 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:44:13.849 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.849 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.3", 2023-12-20T04:44:13.849 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlcIe3JhAAjv9KfknxwySJURWdePN7vw==", 2023-12-20T04:44:13.849 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.849 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:44:13.849 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:44:13.849 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:44:13.849 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:44:13.849 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.849 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.admin", 2023-12-20T04:44:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJljrTdHhAAsAlaFaKctSv71GrifKs6zA==", 2023-12-20T04:44:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:44:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:44:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:44:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:44:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.x", 2023-12-20T04:44:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJl+KnxNxAAM/b3mubTMYlB9QUbfcPW8g==", 2023-12-20T04:44:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:44:13.850 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:44:13.851 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:44:13.851 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.851 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:13.851 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:13.851 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.y", 2023-12-20T04:44:13.851 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlMyAMNBAAWpoBNevgGIkZ7zKEdKn3Ag==", 2023-12-20T04:44:13.851 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:44:13.851 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:44:13.851 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:44:13.851 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:44:13.851 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.851 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:13.851 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:13.851 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:44:13.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.840+0000 7fd2e3539640 1 -- 172.21.15.132:0/4155106183 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2c006a430 msgr2=0x7fd2c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:13.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.840+0000 7fd2e3539640 1 --2- 172.21.15.132:0/4155106183 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2c006a430 0x7fd2c006c8f0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fd2cc000c00 tx=0x7fd2cc009040 comp rx=0 tx=0).stop 2023-12-20T04:44:13.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.840+0000 7fd2e3539640 1 -- 172.21.15.132:0/4155106183 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80039a0 msgr2=0x7fd2dc1f3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:13.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.840+0000 7fd2e3539640 1 --2- 172.21.15.132:0/4155106183 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80039a0 0x7fd2dc1f3320 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7fd2d8000f60 tx=0x7fd2d8001a20 comp rx=0 tx=0).stop 2023-12-20T04:44:13.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.840+0000 7fd2e3539640 1 -- 172.21.15.132:0/4155106183 shutdown_connections 2023-12-20T04:44:13.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.840+0000 7fd2e3539640 1 --2- 172.21.15.132:0/4155106183 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2c006a430 0x7fd2c006c8f0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.840+0000 7fd2e3539640 1 --2- 172.21.15.132:0/4155106183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2dc1f2000 0x7fd2dc0aff40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.840+0000 7fd2e3539640 1 --2- 172.21.15.132:0/4155106183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2dc15a780 0x7fd2dc15c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.840+0000 7fd2e3539640 1 --2- 172.21.15.132:0/4155106183 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2c80039a0 0x7fd2dc1f3320 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.840+0000 7fd2e3539640 1 -- 172.21.15.132:0/4155106183 >> 172.21.15.132:0/4155106183 conn(0x7fd2dc0cf330 msgr2=0x7fd2dc069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:13.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.840+0000 7fd2e3539640 1 -- 172.21.15.132:0/4155106183 shutdown_connections 2023-12-20T04:44:13.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.840+0000 7fd2e3539640 1 -- 172.21.15.132:0/4155106183 wait complete. 2023-12-20T04:44:13.854 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:44:13.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.952+0000 7f17bba77640 1 Processor -- start 2023-12-20T04:44:13.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.953+0000 7f17bba77640 1 -- start start 2023-12-20T04:44:13.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.953+0000 7f17bba77640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17b4160450 0x7f17b4160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:13.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.953+0000 7f17bba77640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b40b5ec0 con 0x7f17b40b5090 2023-12-20T04:44:13.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.953+0000 7f17bba77640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17b41617e0 con 0x7f17b41611b0 2023-12-20T04:44:13.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.953+0000 7f17bba77640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b40d0fc0 con 0x7f17b4160450 2023-12-20T04:44:13.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17ba014640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f17b40b5090 0x7f17b40d1aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40124/0 (socket says 172.21.15.132:40124) 2023-12-20T04:44:13.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17ba014640 1 -- 172.21.15.132:0/443257258 learned_addr learned my addr 172.21.15.132:0/443257258 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:13.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b8811640 1 -- 172.21.15.132:0/443257258 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1435910742 0 0) 0x7f17b40b5ec0 con 0x7f17b40b5090 2023-12-20T04:44:13.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b9813640 1 --2- 172.21.15.132:0/443257258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17b4160450 0x7f17b4160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:13.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b8811640 1 -- 172.21.15.132:0/443257258 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f17a0003520 con 0x7f17b40b5090 2023-12-20T04:44:13.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b8811640 1 -- 172.21.15.132:0/443257258 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 205765545 0 0) 0x7f17a0003520 con 0x7f17b40b5090 2023-12-20T04:44:13.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b8811640 1 -- 172.21.15.132:0/443257258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17b4160450 msgr2=0x7f17b4160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:13.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b8811640 1 --2- 172.21.15.132:0/443257258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17b4160450 0x7f17b4160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b8811640 1 -- 172.21.15.132:0/443257258 >> v1:172.21.15.187:6789/0 conn(0x7f17b41611b0 legacy=0x7f17b40b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:13.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b8811640 1 -- 172.21.15.132:0/443257258 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b40d12a0 con 0x7f17b40b5090 2023-12-20T04:44:13.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b8811640 1 -- 172.21.15.132:0/443257258 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f17ac0019f0 con 0x7f17b40b5090 2023-12-20T04:44:13.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b8811640 1 -- 172.21.15.132:0/443257258 >> v1:172.21.15.132:6789/0 conn(0x7f17b40b5090 legacy=0x7f17b40d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:13.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b8811640 1 --2- 172.21.15.132:0/443257258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17a00039a0 0x7f17a0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:13.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b8811640 1 --2- 172.21.15.132:0/443257258 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17a00047c0 0x7f17a0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:13.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b8811640 1 --2- 172.21.15.132:0/443257258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17b4160450 0x7f17a00051c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:13.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b8811640 1 -- 172.21.15.132:0/443257258 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b40d0fc0 con 0x7f17a00047c0 2023-12-20T04:44:13.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b8811640 1 -- 172.21.15.132:0/443257258 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17a000bb40 con 0x7f17a00039a0 2023-12-20T04:44:13.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b8811640 1 -- 172.21.15.132:0/443257258 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17a000bd00 con 0x7f17b4160450 2023-12-20T04:44:13.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b9012640 1 --2- 172.21.15.132:0/443257258 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17a00047c0 0x7f17a0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:13.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b9813640 1 --2- 172.21.15.132:0/443257258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17a00039a0 0x7f17a0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:13.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17ba014640 1 --2- 172.21.15.132:0/443257258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17b4160450 0x7f17a00051c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:13.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b9012640 1 -- 172.21.15.132:0/443257258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17b4160450 msgr2=0x7f17a00051c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:13.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b9012640 1 --2- 172.21.15.132:0/443257258 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17b4160450 0x7f17a00051c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b9012640 1 -- 172.21.15.132:0/443257258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17a00039a0 msgr2=0x7f17a0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:13.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b9012640 1 --2- 172.21.15.132:0/443257258 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17a00039a0 0x7f17a0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.954+0000 7f17b9012640 1 -- 172.21.15.132:0/443257258 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17a0003520 con 0x7f17a00047c0 2023-12-20T04:44:13.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.955+0000 7f17b9012640 1 --2- 172.21.15.132:0/443257258 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17a00047c0 0x7f17a0004c40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f17b0001750 tx=0x7f17a00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56b90ba9c276bcb2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:13.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.955+0000 7f17b8811640 1 -- 172.21.15.132:0/443257258 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b00052d0 con 0x7f17a00047c0 2023-12-20T04:44:13.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.955+0000 7f17b8811640 1 -- 172.21.15.132:0/443257258 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17b002e050 con 0x7f17a00047c0 2023-12-20T04:44:13.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.955+0000 7f17b8811640 1 -- 172.21.15.132:0/443257258 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17b00035f0 con 0x7f17a00047c0 2023-12-20T04:44:13.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.956+0000 7f17bba77640 1 -- 172.21.15.132:0/443257258 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17a00047c0 msgr2=0x7f17a0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:13.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.956+0000 7f17bba77640 1 --2- 172.21.15.132:0/443257258 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17a00047c0 0x7f17a0004c40 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f17b0001750 tx=0x7f17a00057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.956+0000 7f17ba014640 1 -- 172.21.15.132:0/443257258 reap_dead start 2023-12-20T04:44:13.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.956+0000 7f17bba77640 1 -- 172.21.15.132:0/443257258 shutdown_connections 2023-12-20T04:44:13.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.956+0000 7f17bba77640 1 -- 172.21.15.132:0/443257258 >> 172.21.15.132:0/443257258 conn(0x7f17b40cf980 msgr2=0x7f17b40cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:13.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.956+0000 7f17bba77640 1 -- 172.21.15.132:0/443257258 shutdown_connections 2023-12-20T04:44:13.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.956+0000 7f17bba77640 1 -- 172.21.15.132:0/443257258 wait complete. 2023-12-20T04:44:13.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.957+0000 7f17bba77640 1 Processor -- start 2023-12-20T04:44:13.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.957+0000 7f17bba77640 1 -- start start 2023-12-20T04:44:13.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17bba77640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17a00047c0 0x7f17b4154950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:13.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17bba77640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17b40d2ee0 0x7f17b40d3340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:13.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17bba77640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17b40c8190 0x7f17b40c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:13.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17bba77640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b40d3880 con 0x7f17b40c8190 2023-12-20T04:44:13.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17bba77640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17b4154e90 con 0x7f17b40d2ee0 2023-12-20T04:44:13.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17bba77640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17b41f6870 con 0x7f17a00047c0 2023-12-20T04:44:13.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17ba014640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17b40c8190 0x7f17b40c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:13.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17ba014640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17b40c8190 0x7f17b40c8610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56206/0 (socket says 172.21.15.132:56206) 2023-12-20T04:44:13.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17ba014640 1 -- 172.21.15.132:0/3459488183 learned_addr learned my addr 172.21.15.132:0/3459488183 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:13.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17ba014640 1 -- 172.21.15.132:0/3459488183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17a00047c0 msgr2=0x7f17b4154950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:13.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17ba014640 1 --2- 172.21.15.132:0/3459488183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17a00047c0 0x7f17b4154950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17ba014640 1 -- 172.21.15.132:0/3459488183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17b40d2ee0 msgr2=0x7f17b40d3340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:13.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17ba014640 1 --2- 172.21.15.132:0/3459488183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17b40d2ee0 0x7f17b40d3340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:13.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17ba014640 1 -- 172.21.15.132:0/3459488183 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17b4153e70 con 0x7f17b40c8190 2023-12-20T04:44:13.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17ba014640 1 --2- 172.21.15.132:0/3459488183 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17b40c8190 0x7f17b40c8610 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f17b40b5a00 tx=0x7f17ac00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:13.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17aa7fc640 1 -- 172.21.15.132:0/3459488183 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac00ec10 con 0x7f17b40c8190 2023-12-20T04:44:13.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17aa7fc640 1 -- 172.21.15.132:0/3459488183 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f17ac00ed70 con 0x7f17b40c8190 2023-12-20T04:44:13.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17bba77640 1 -- 172.21.15.132:0/3459488183 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17b4154150 con 0x7f17b40c8190 2023-12-20T04:44:13.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17aa7fc640 1 -- 172.21.15.132:0/3459488183 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17ac00eee0 con 0x7f17b40c8190 2023-12-20T04:44:13.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.958+0000 7f17bba77640 1 -- 172.21.15.132:0/3459488183 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17b40c8b50 con 0x7f17b40c8190 2023-12-20T04:44:13.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.959+0000 7f17bba77640 1 -- 172.21.15.132:0/3459488183 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17b4154670 con 0x7f17b40c8190 2023-12-20T04:44:13.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.960+0000 7f17aa7fc640 1 -- 172.21.15.132:0/3459488183 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f17ac013660 con 0x7f17b40c8190 2023-12-20T04:44:13.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.960+0000 7f17aa7fc640 1 --2- 172.21.15.132:0/3459488183 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f179806a460 0x7f179806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:13.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.960+0000 7f17b9813640 1 --2- 172.21.15.132:0/3459488183 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f179806a460 0x7f179806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:13.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.960+0000 7f17aa7fc640 1 -- 172.21.15.132:0/3459488183 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f17ac0889e0 con 0x7f17b40c8190 2023-12-20T04:44:13.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.961+0000 7f17b9813640 1 --2- 172.21.15.132:0/3459488183 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f179806a460 0x7f179806c920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f17a4006a90 tx=0x7f17a4006a20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:13.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:13.965+0000 7f17aa7fc640 1 -- 172.21.15.132:0/3459488183 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f17b4154670 con 0x7f17b40c8190 2023-12-20T04:44:14.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.132+0000 7f17bba77640 1 -- 172.21.15.132:0/3459488183 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f17b4154670 con 0x7f17b40c8190 2023-12-20T04:44:14.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.133+0000 7f17aa7fc640 1 -- 172.21.15.132:0/3459488183 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+12437 (secure 0 0 0) 0x7f17b4154670 con 0x7f17b40c8190 2023-12-20T04:44:14.134 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:14.134 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":43,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:44:13.473711+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":5,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:44:14.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.135+0000 7f17bba77640 1 -- 172.21.15.132:0/3459488183 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f179806a460 msgr2=0x7f179806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:14.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.135+0000 7f17bba77640 1 --2- 172.21.15.132:0/3459488183 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f179806a460 0x7f179806c920 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f17a4006a90 tx=0x7f17a4006a20 comp rx=0 tx=0).stop 2023-12-20T04:44:14.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.135+0000 7f17bba77640 1 -- 172.21.15.132:0/3459488183 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17b40c8190 msgr2=0x7f17b40c8610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:14.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.135+0000 7f17bba77640 1 --2- 172.21.15.132:0/3459488183 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17b40c8190 0x7f17b40c8610 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f17b40b5a00 tx=0x7f17ac00e530 comp rx=0 tx=0).stop 2023-12-20T04:44:14.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.135+0000 7f17bba77640 1 -- 172.21.15.132:0/3459488183 shutdown_connections 2023-12-20T04:44:14.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.135+0000 7f17bba77640 1 --2- 172.21.15.132:0/3459488183 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f179806a460 0x7f179806c920 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.135+0000 7f17bba77640 1 --2- 172.21.15.132:0/3459488183 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17b40c8190 0x7f17b40c8610 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.135+0000 7f17bba77640 1 --2- 172.21.15.132:0/3459488183 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17b40d2ee0 0x7f17b40d3340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.135+0000 7f17bba77640 1 --2- 172.21.15.132:0/3459488183 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17a00047c0 0x7f17b4154950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.135+0000 7f17bba77640 1 -- 172.21.15.132:0/3459488183 >> 172.21.15.132:0/3459488183 conn(0x7f17b40cf980 msgr2=0x7f17b4158630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:14.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.135+0000 7f17bba77640 1 -- 172.21.15.132:0/3459488183 shutdown_connections 2023-12-20T04:44:14.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.135+0000 7f17bba77640 1 -- 172.21.15.132:0/3459488183 wait complete. 2023-12-20T04:44:14.147 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:44:14.148 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:44:14.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.249+0000 7f3695181640 1 Processor -- start 2023-12-20T04:44:14.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.249+0000 7f3695181640 1 -- start start 2023-12-20T04:44:14.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.250+0000 7f3695181640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f36900cb2b0 0x7f36900cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.250+0000 7f3695181640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f36900cdbb0 0x7f36900d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.250+0000 7f3695181640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36900ce000 con 0x7f369015aee0 2023-12-20T04:44:14.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.250+0000 7f3695181640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36900d0130 con 0x7f36900cdbb0 2023-12-20T04:44:14.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.250+0000 7f3695181640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f369015f370 con 0x7f36900cb2b0 2023-12-20T04:44:14.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.250+0000 7f368f59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f36900cdbb0 0x7f36900d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:14.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.250+0000 7f368f59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f36900cdbb0 0x7f36900d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56218/0 (socket says 172.21.15.132:56218) 2023-12-20T04:44:14.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.250+0000 7f368f59e640 1 -- 172.21.15.132:0/2805485351 learned_addr learned my addr 172.21.15.132:0/2805485351 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:14.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.251+0000 7f368f59e640 1 -- 172.21.15.132:0/2805485351 >> v2:172.21.15.187:3300/0 conn(0x7f36900cb2b0 msgr2=0x7f36900cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:14.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.251+0000 7f368f59e640 1 --2- 172.21.15.132:0/2805485351 >> v2:172.21.15.187:3300/0 conn(0x7f36900cb2b0 0x7f36900cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.251+0000 7f368f59e640 1 -- 172.21.15.132:0/2805485351 >> v1:172.21.15.187:6789/0 conn(0x7f369015aee0 legacy=0x7f369015eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:14.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.251+0000 7f368f59e640 1 -- 172.21.15.132:0/2805485351 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f369015f650 con 0x7f36900cdbb0 2023-12-20T04:44:14.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.251+0000 7f368f59e640 1 --2- 172.21.15.132:0/2805485351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36900cdbb0 0x7f36900d08a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3688009870 tx=0x7f368802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2cebb53f9a0e6e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:14.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.251+0000 7f368dd9b640 1 -- 172.21.15.132:0/2805485351 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3688031870 con 0x7f36900cdbb0 2023-12-20T04:44:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.251+0000 7f368dd9b640 1 -- 172.21.15.132:0/2805485351 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36880319d0 con 0x7f36900cdbb0 2023-12-20T04:44:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.251+0000 7f368dd9b640 1 -- 172.21.15.132:0/2805485351 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3688031d60 con 0x7f36900cdbb0 2023-12-20T04:44:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.252+0000 7f3695181640 1 -- 172.21.15.132:0/2805485351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36900cdbb0 msgr2=0x7f36900d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.252+0000 7f3695181640 1 --2- 172.21.15.132:0/2805485351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36900cdbb0 0x7f36900d08a0 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f3688009870 tx=0x7f368802b910 comp rx=0 tx=0).stop 2023-12-20T04:44:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.252+0000 7f3695181640 1 -- 172.21.15.132:0/2805485351 shutdown_connections 2023-12-20T04:44:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.252+0000 7f3695181640 1 --2- 172.21.15.132:0/2805485351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36900cdbb0 0x7f36900d08a0 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.252+0000 7f3695181640 1 --2- 172.21.15.132:0/2805485351 >> v2:172.21.15.187:3300/0 conn(0x7f36900cb2b0 0x7f36900cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.252+0000 7f3695181640 1 -- 172.21.15.132:0/2805485351 >> 172.21.15.132:0/2805485351 conn(0x7f3690072c60 msgr2=0x7f3690073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.252+0000 7f3695181640 1 -- 172.21.15.132:0/2805485351 shutdown_connections 2023-12-20T04:44:14.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.252+0000 7f3695181640 1 -- 172.21.15.132:0/2805485351 wait complete. 2023-12-20T04:44:14.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.253+0000 7f3695181640 1 Processor -- start 2023-12-20T04:44:14.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.254+0000 7f3695181640 1 -- start start 2023-12-20T04:44:14.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.254+0000 7f3695181640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36900cb2b0 0x7f36900ca3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.254+0000 7f3695181640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36900cdbb0 0x7f369006ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.254+0000 7f3695181640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f369015aee0 0x7f369006b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.254+0000 7f3695181640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3690152a80 con 0x7f36900cdbb0 2023-12-20T04:44:14.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.254+0000 7f3695181640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36900cad00 con 0x7f369015aee0 2023-12-20T04:44:14.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.254+0000 7f3695181640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369015cb40 con 0x7f36900cb2b0 2023-12-20T04:44:14.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.254+0000 7f368e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36900cdbb0 0x7f369006ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:14.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.254+0000 7f368e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36900cdbb0 0x7f369006ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56232/0 (socket says 172.21.15.132:56232) 2023-12-20T04:44:14.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.254+0000 7f368e59c640 1 -- 172.21.15.132:0/1145423973 learned_addr learned my addr 172.21.15.132:0/1145423973 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:14.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.255+0000 7f368ed9d640 1 --2- 172.21.15.132:0/1145423973 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36900cb2b0 0x7f36900ca3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:14.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.255+0000 7f368f59e640 1 --2- 172.21.15.132:0/1145423973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f369015aee0 0x7f369006b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:14.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.255+0000 7f368e59c640 1 -- 172.21.15.132:0/1145423973 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36900cb2b0 msgr2=0x7f36900ca3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:14.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.255+0000 7f368e59c640 1 --2- 172.21.15.132:0/1145423973 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36900cb2b0 0x7f36900ca3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.255+0000 7f368e59c640 1 -- 172.21.15.132:0/1145423973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f369015aee0 msgr2=0x7f369006b280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:14.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.255+0000 7f368e59c640 1 --2- 172.21.15.132:0/1145423973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f369015aee0 0x7f369006b280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.255+0000 7f368e59c640 1 -- 172.21.15.132:0/1145423973 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36880094d0 con 0x7f36900cdbb0 2023-12-20T04:44:14.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.255+0000 7f368e59c640 1 --2- 172.21.15.132:0/1145423973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36900cdbb0 0x7f369006ad40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f368400b440 tx=0x7f368400b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:14.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.255+0000 7f36777fe640 1 -- 172.21.15.132:0/1145423973 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684011890 con 0x7f36900cdbb0 2023-12-20T04:44:14.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.255+0000 7f36777fe640 1 -- 172.21.15.132:0/1145423973 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36840119f0 con 0x7f36900cdbb0 2023-12-20T04:44:14.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.255+0000 7f3695181640 1 -- 172.21.15.132:0/1145423973 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f369015cde0 con 0x7f36900cdbb0 2023-12-20T04:44:14.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.255+0000 7f36777fe640 1 -- 172.21.15.132:0/1145423973 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684011da0 con 0x7f36900cdbb0 2023-12-20T04:44:14.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.255+0000 7f3695181640 1 -- 172.21.15.132:0/1145423973 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f369015d080 con 0x7f36900cdbb0 2023-12-20T04:44:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.256+0000 7f3695181640 1 -- 172.21.15.132:0/1145423973 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f369004e840 con 0x7f36900cdbb0 2023-12-20T04:44:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.257+0000 7f36777fe640 1 -- 172.21.15.132:0/1145423973 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f368401a400 con 0x7f36900cdbb0 2023-12-20T04:44:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.257+0000 7f36777fe640 1 --2- 172.21.15.132:0/1145423973 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f367c06a430 0x7f367c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.257+0000 7f36777fe640 1 -- 172.21.15.132:0/1145423973 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3684088750 con 0x7f36900cdbb0 2023-12-20T04:44:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.257+0000 7f368ed9d640 1 --2- 172.21.15.132:0/1145423973 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f367c06a430 0x7f367c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:14.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.257+0000 7f368ed9d640 1 --2- 172.21.15.132:0/1145423973 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f367c06a430 0x7f367c06c8f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3680009fd0 tx=0x7f368000d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:14.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.261+0000 7f36777fe640 1 -- 172.21.15.132:0/1145423973 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f36840541d0 con 0x7f36900cdbb0 2023-12-20T04:44:14.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.428+0000 7f3695181640 1 -- 172.21.15.132:0/1145423973 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36900b2890 con 0x7f36900cdbb0 2023-12-20T04:44:14.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.429+0000 7f36777fe640 1 -- 172.21.15.132:0/1145423973 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v43) v1 ==== 93+0+10 (secure 0 0 0) 0x7f36840150a0 con 0x7f36900cdbb0 2023-12-20T04:44:14.430 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:44:14.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.431+0000 7f3695181640 1 -- 172.21.15.132:0/1145423973 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f367c06a430 msgr2=0x7f367c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:14.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.431+0000 7f3695181640 1 --2- 172.21.15.132:0/1145423973 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f367c06a430 0x7f367c06c8f0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f3680009fd0 tx=0x7f368000d040 comp rx=0 tx=0).stop 2023-12-20T04:44:14.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.431+0000 7f3695181640 1 -- 172.21.15.132:0/1145423973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36900cdbb0 msgr2=0x7f369006ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:14.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.431+0000 7f3695181640 1 --2- 172.21.15.132:0/1145423973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36900cdbb0 0x7f369006ad40 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f368400b440 tx=0x7f368400b900 comp rx=0 tx=0).stop 2023-12-20T04:44:14.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.431+0000 7f3695181640 1 -- 172.21.15.132:0/1145423973 shutdown_connections 2023-12-20T04:44:14.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.431+0000 7f3695181640 1 --2- 172.21.15.132:0/1145423973 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f367c06a430 0x7f367c06c8f0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.431+0000 7f3695181640 1 --2- 172.21.15.132:0/1145423973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f369015aee0 0x7f369006b280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.431+0000 7f3695181640 1 --2- 172.21.15.132:0/1145423973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36900cdbb0 0x7f369006ad40 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.431+0000 7f3695181640 1 --2- 172.21.15.132:0/1145423973 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36900cb2b0 0x7f36900ca3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.431+0000 7f3695181640 1 -- 172.21.15.132:0/1145423973 >> 172.21.15.132:0/1145423973 conn(0x7f3690072c60 msgr2=0x7f36900d1130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:14.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.431+0000 7f3695181640 1 -- 172.21.15.132:0/1145423973 shutdown_connections 2023-12-20T04:44:14.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.431+0000 7f3695181640 1 -- 172.21.15.132:0/1145423973 wait complete. 2023-12-20T04:44:14.443 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-20T04:44:14.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.541+0000 7f06b8b3e640 1 Processor -- start 2023-12-20T04:44:14.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.541+0000 7f06b8b3e640 1 -- start start 2023-12-20T04:44:14.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.542+0000 7f06b8b3e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f06b415aec0 0x7f06b40ce100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.542+0000 7f06b8b3e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f06b40cfaa0 0x7f06b40cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.542+0000 7f06b8b3e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06b40ce640 con 0x7f06b40ccf00 2023-12-20T04:44:14.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.542+0000 7f06b8b3e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b415b2a0 con 0x7f06b40cfaa0 2023-12-20T04:44:14.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.542+0000 7f06b8b3e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06b415f610 con 0x7f06b415aec0 2023-12-20T04:44:14.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.543+0000 7f06b1d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f06b40cfaa0 0x7f06b40cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:14.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.543+0000 7f06b1d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f06b40cfaa0 0x7f06b40cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56242/0 (socket says 172.21.15.132:56242) 2023-12-20T04:44:14.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.543+0000 7f06b1d9b640 1 -- 172.21.15.132:0/561427933 learned_addr learned my addr 172.21.15.132:0/561427933 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:14.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.543+0000 7f06b1d9b640 1 -- 172.21.15.132:0/561427933 >> v2:172.21.15.187:3300/0 conn(0x7f06b415aec0 msgr2=0x7f06b40ce100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:14.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.543+0000 7f06b1d9b640 1 --2- 172.21.15.132:0/561427933 >> v2:172.21.15.187:3300/0 conn(0x7f06b415aec0 0x7f06b40ce100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.543+0000 7f06b1d9b640 1 -- 172.21.15.132:0/561427933 >> v1:172.21.15.187:6789/0 conn(0x7f06b40ccf00 legacy=0x7f06b40ce880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:14.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.543+0000 7f06b1d9b640 1 -- 172.21.15.132:0/561427933 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06b415ea00 con 0x7f06b40cfaa0 2023-12-20T04:44:14.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.544+0000 7f06b1d9b640 1 --2- 172.21.15.132:0/561427933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06b40cfaa0 0x7f06b40cc9c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f06b40d1cc0 tx=0x7f06a402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6c245b97dd980e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:14.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.544+0000 7f06b159a640 1 -- 172.21.15.132:0/561427933 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a40317e0 con 0x7f06b40cfaa0 2023-12-20T04:44:14.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.544+0000 7f06b159a640 1 -- 172.21.15.132:0/561427933 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a4031940 con 0x7f06b40cfaa0 2023-12-20T04:44:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.544+0000 7f06b159a640 1 -- 172.21.15.132:0/561427933 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a4031cd0 con 0x7f06b40cfaa0 2023-12-20T04:44:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.544+0000 7f06b8b3e640 1 -- 172.21.15.132:0/561427933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06b40cfaa0 msgr2=0x7f06b40cc9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.544+0000 7f06b8b3e640 1 --2- 172.21.15.132:0/561427933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06b40cfaa0 0x7f06b40cc9c0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f06b40d1cc0 tx=0x7f06a402b880 comp rx=0 tx=0).stop 2023-12-20T04:44:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.544+0000 7f06b8b3e640 1 -- 172.21.15.132:0/561427933 shutdown_connections 2023-12-20T04:44:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.544+0000 7f06b8b3e640 1 --2- 172.21.15.132:0/561427933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06b40cfaa0 0x7f06b40cc9c0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.544+0000 7f06b8b3e640 1 --2- 172.21.15.132:0/561427933 >> v2:172.21.15.187:3300/0 conn(0x7f06b415aec0 0x7f06b40ce100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.544+0000 7f06b8b3e640 1 -- 172.21.15.132:0/561427933 >> 172.21.15.132:0/561427933 conn(0x7f06b4072c60 msgr2=0x7f06b4073070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.544+0000 7f06b8b3e640 1 -- 172.21.15.132:0/561427933 shutdown_connections 2023-12-20T04:44:14.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.544+0000 7f06b8b3e640 1 -- 172.21.15.132:0/561427933 wait complete. 2023-12-20T04:44:14.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.546+0000 7f06b8b3e640 1 Processor -- start 2023-12-20T04:44:14.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.546+0000 7f06b8b3e640 1 -- start start 2023-12-20T04:44:14.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.546+0000 7f06b8b3e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06b40ccf00 0x7f06b40c82d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.546+0000 7f06b8b3e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06b40cfaa0 0x7f06b4155850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.546+0000 7f06b8b3e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06b415aec0 0x7f06b4155f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.546+0000 7f06b8b3e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b415c400 con 0x7f06b40cfaa0 2023-12-20T04:44:14.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.546+0000 7f06b8b3e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06b4155d90 con 0x7f06b415aec0 2023-12-20T04:44:14.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.546+0000 7f06b8b3e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06b415b780 con 0x7f06b40ccf00 2023-12-20T04:44:14.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.547+0000 7f06b1d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06b40cfaa0 0x7f06b4155850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:14.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.547+0000 7f06b1d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06b40cfaa0 0x7f06b4155850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56258/0 (socket says 172.21.15.132:56258) 2023-12-20T04:44:14.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.547+0000 7f06b1d9b640 1 -- 172.21.15.132:0/866098697 learned_addr learned my addr 172.21.15.132:0/866098697 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:14.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.547+0000 7f06b259c640 1 --2- 172.21.15.132:0/866098697 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06b40ccf00 0x7f06b40c82d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:14.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.547+0000 7f06b2d9d640 1 --2- 172.21.15.132:0/866098697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06b415aec0 0x7f06b4155f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:14.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.547+0000 7f06b1d9b640 1 -- 172.21.15.132:0/866098697 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06b40ccf00 msgr2=0x7f06b40c82d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:14.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.547+0000 7f06b1d9b640 1 --2- 172.21.15.132:0/866098697 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06b40ccf00 0x7f06b40c82d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.547+0000 7f06b1d9b640 1 -- 172.21.15.132:0/866098697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06b415aec0 msgr2=0x7f06b4155f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:14.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.547+0000 7f06b1d9b640 1 --2- 172.21.15.132:0/866098697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06b415aec0 0x7f06b4155f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.547+0000 7f06b1d9b640 1 -- 172.21.15.132:0/866098697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06a40094d0 con 0x7f06b40cfaa0 2023-12-20T04:44:14.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.547+0000 7f06b1d9b640 1 --2- 172.21.15.132:0/866098697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06b40cfaa0 0x7f06b4155850 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f06a402b8c0 tx=0x7f06a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:14.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.547+0000 7f06aaffd640 1 -- 172.21.15.132:0/866098697 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a4032940 con 0x7f06b40cfaa0 2023-12-20T04:44:14.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.547+0000 7f06aaffd640 1 -- 172.21.15.132:0/866098697 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06a4032aa0 con 0x7f06b40cfaa0 2023-12-20T04:44:14.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.547+0000 7f06b8b3e640 1 -- 172.21.15.132:0/866098697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06b415ba60 con 0x7f06b40cfaa0 2023-12-20T04:44:14.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.547+0000 7f06aaffd640 1 -- 172.21.15.132:0/866098697 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06a4032e50 con 0x7f06b40cfaa0 2023-12-20T04:44:14.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.547+0000 7f06b8b3e640 1 -- 172.21.15.132:0/866098697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06b415c020 con 0x7f06b40cfaa0 2023-12-20T04:44:14.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.548+0000 7f06b8b3e640 1 -- 172.21.15.132:0/866098697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06b404e840 con 0x7f06b40cfaa0 2023-12-20T04:44:14.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.549+0000 7f06aaffd640 1 -- 172.21.15.132:0/866098697 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f06a404e450 con 0x7f06b40cfaa0 2023-12-20T04:44:14.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.549+0000 7f06aaffd640 1 --2- 172.21.15.132:0/866098697 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f069406a460 0x7f069406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.549+0000 7f06aaffd640 1 -- 172.21.15.132:0/866098697 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f06a40aa780 con 0x7f06b40cfaa0 2023-12-20T04:44:14.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.549+0000 7f06b259c640 1 --2- 172.21.15.132:0/866098697 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f069406a460 0x7f069406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:14.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.549+0000 7f06b259c640 1 --2- 172.21.15.132:0/866098697 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f069406a460 0x7f069406c920 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f069c00b810 tx=0x7f069c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:14.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.553+0000 7f06aaffd640 1 -- 172.21.15.132:0/866098697 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f06a4076150 con 0x7f06b40cfaa0 2023-12-20T04:44:14.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.721+0000 7f06b8b3e640 1 -- 172.21.15.132:0/866098697 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f06b40b1380 con 0x7f06b40cfaa0 2023-12-20T04:44:14.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.721+0000 7f06aaffd640 1 -- 172.21.15.132:0/866098697 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v43) v1 ==== 84+0+65 (secure 0 0 0) 0x7f06a4079770 con 0x7f06b40cfaa0 2023-12-20T04:44:14.722 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:14.722 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-12-20T04:44:14.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:14.722 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-12-20T04:44:14.722 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-12-20T04:44:14.723 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:14.723 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-12-20T04:44:14.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.723+0000 7f06b8b3e640 1 -- 172.21.15.132:0/866098697 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f069406a460 msgr2=0x7f069406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:14.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.723+0000 7f06b8b3e640 1 --2- 172.21.15.132:0/866098697 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f069406a460 0x7f069406c920 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f069c00b810 tx=0x7f069c008040 comp rx=0 tx=0).stop 2023-12-20T04:44:14.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.723+0000 7f06b8b3e640 1 -- 172.21.15.132:0/866098697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06b40cfaa0 msgr2=0x7f06b4155850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:14.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.723+0000 7f06b8b3e640 1 --2- 172.21.15.132:0/866098697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06b40cfaa0 0x7f06b4155850 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f06a402b8c0 tx=0x7f06a40046c0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.723+0000 7f06b8b3e640 1 -- 172.21.15.132:0/866098697 shutdown_connections 2023-12-20T04:44:14.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.723+0000 7f06b8b3e640 1 --2- 172.21.15.132:0/866098697 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f069406a460 0x7f069406c920 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.723+0000 7f06b8b3e640 1 --2- 172.21.15.132:0/866098697 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06b415aec0 0x7f06b4155f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.723+0000 7f06b8b3e640 1 --2- 172.21.15.132:0/866098697 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06b40cfaa0 0x7f06b4155850 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.723+0000 7f06b8b3e640 1 --2- 172.21.15.132:0/866098697 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06b40ccf00 0x7f06b40c82d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.723+0000 7f06b8b3e640 1 -- 172.21.15.132:0/866098697 >> 172.21.15.132:0/866098697 conn(0x7f06b4072c60 msgr2=0x7f06b40d08f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:14.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.723+0000 7f06b8b3e640 1 -- 172.21.15.132:0/866098697 shutdown_connections 2023-12-20T04:44:14.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.723+0000 7f06b8b3e640 1 -- 172.21.15.132:0/866098697 wait complete. 2023-12-20T04:44:14.735 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-20T04:44:14.735 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-20T04:44:14.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.838+0000 7f3e15a41640 1 Processor -- start 2023-12-20T04:44:14.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.838+0000 7f3e15a41640 1 -- start start 2023-12-20T04:44:14.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.839+0000 7f3e15a41640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3e1015d510 0x7f3e1015d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.839+0000 7f3e15a41640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3e1015df00 0x7f3e100b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.839+0000 7f3e15a41640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e100b27d0 con 0x7f3e1015d130 2023-12-20T04:44:14.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.839+0000 7f3e15a41640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e100d1ff0 con 0x7f3e1015df00 2023-12-20T04:44:14.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.839+0000 7f3e15a41640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e100b2a90 con 0x7f3e1015d510 2023-12-20T04:44:14.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.839+0000 7f3e0f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3e1015df00 0x7f3e100b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:14.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.839+0000 7f3e0f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3e1015df00 0x7f3e100b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56266/0 (socket says 172.21.15.132:56266) 2023-12-20T04:44:14.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.839+0000 7f3e0effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3e1015d130 0x7f3e100d17c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40126/0 (socket says 172.21.15.132:40126) 2023-12-20T04:44:14.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.839+0000 7f3e0f7fe640 1 -- 172.21.15.132:0/3743643988 learned_addr learned my addr 172.21.15.132:0/3743643988 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:14.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.839+0000 7f3e07fff640 1 --2- 172.21.15.132:0/3743643988 >> v2:172.21.15.187:3300/0 conn(0x7f3e1015d510 0x7f3e1015d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:14.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.839+0000 7f3e0f7fe640 1 -- 172.21.15.132:0/3743643988 >> v2:172.21.15.187:3300/0 conn(0x7f3e1015d510 msgr2=0x7f3e1015d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:14.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.839+0000 7f3e0f7fe640 1 --2- 172.21.15.132:0/3743643988 >> v2:172.21.15.187:3300/0 conn(0x7f3e1015d510 0x7f3e1015d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.839+0000 7f3e0f7fe640 1 -- 172.21.15.132:0/3743643988 >> v1:172.21.15.132:6789/0 conn(0x7f3e1015d130 legacy=0x7f3e100d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:14.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.839+0000 7f3e0f7fe640 1 -- 172.21.15.132:0/3743643988 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e100b2d70 con 0x7f3e1015df00 2023-12-20T04:44:14.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.839+0000 7f3e0e7fc640 1 -- 172.21.15.132:0/3743643988 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3245919277 0 0) 0x7f3e100b27d0 con 0x7f3e1015d130 2023-12-20T04:44:14.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.839+0000 7f3e07fff640 1 --2- 172.21.15.132:0/3743643988 >> v2:172.21.15.187:3300/0 conn(0x7f3e1015d510 0x7f3e1015d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:14.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.840+0000 7f3e0f7fe640 1 --2- 172.21.15.132:0/3743643988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1015df00 0x7f3e100b3570 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3e100b5aa0 tx=0x7f3e0802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fad9be83ef72719a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:14.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.840+0000 7f3e0e7fc640 1 -- 172.21.15.132:0/3743643988 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0802ca80 con 0x7f3e1015df00 2023-12-20T04:44:14.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.840+0000 7f3e0e7fc640 1 -- 172.21.15.132:0/3743643988 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0802cbe0 con 0x7f3e1015df00 2023-12-20T04:44:14.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.840+0000 7f3e0e7fc640 1 -- 172.21.15.132:0/3743643988 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e080343f0 con 0x7f3e1015df00 2023-12-20T04:44:14.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.841+0000 7f3e15a41640 1 -- 172.21.15.132:0/3743643988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1015df00 msgr2=0x7f3e100b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:14.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.841+0000 7f3e15a41640 1 --2- 172.21.15.132:0/3743643988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1015df00 0x7f3e100b3570 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f3e100b5aa0 tx=0x7f3e0802bee0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.841+0000 7f3e15a41640 1 -- 172.21.15.132:0/3743643988 shutdown_connections 2023-12-20T04:44:14.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.841+0000 7f3e15a41640 1 --2- 172.21.15.132:0/3743643988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1015df00 0x7f3e100b3570 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.841+0000 7f3e15a41640 1 --2- 172.21.15.132:0/3743643988 >> v2:172.21.15.187:3300/0 conn(0x7f3e1015d510 0x7f3e1015d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.841+0000 7f3e15a41640 1 -- 172.21.15.132:0/3743643988 >> 172.21.15.132:0/3743643988 conn(0x7f3e100d2eb0 msgr2=0x7f3e100d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:14.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.841+0000 7f3e15a41640 1 -- 172.21.15.132:0/3743643988 shutdown_connections 2023-12-20T04:44:14.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.841+0000 7f3e15a41640 1 -- 172.21.15.132:0/3743643988 wait complete. 2023-12-20T04:44:14.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.842+0000 7f3e15a41640 1 Processor -- start 2023-12-20T04:44:14.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.842+0000 7f3e15a41640 1 -- start start 2023-12-20T04:44:14.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e15a41640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e1015d130 0x7f3e100cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e15a41640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1015d510 0x7f3e101f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e15a41640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e1015df00 0x7f3e1009cb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e15a41640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e100cb920 con 0x7f3e1015d510 2023-12-20T04:44:14.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e15a41640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e100c7ce0 con 0x7f3e1015d130 2023-12-20T04:44:14.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e15a41640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e100c7fc0 con 0x7f3e1015df00 2023-12-20T04:44:14.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e07fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1015d510 0x7f3e101f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:14.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e07fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1015d510 0x7f3e101f24a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56268/0 (socket says 172.21.15.132:56268) 2023-12-20T04:44:14.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e07fff640 1 -- 172.21.15.132:0/1436613390 learned_addr learned my addr 172.21.15.132:0/1436613390 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:14.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e0effd640 1 --2- 172.21.15.132:0/1436613390 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e1015d130 0x7f3e100cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:14.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e0f7fe640 1 --2- 172.21.15.132:0/1436613390 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e1015df00 0x7f3e1009cb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:14.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e07fff640 1 -- 172.21.15.132:0/1436613390 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e1015df00 msgr2=0x7f3e1009cb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:14.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e07fff640 1 --2- 172.21.15.132:0/1436613390 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e1015df00 0x7f3e1009cb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e07fff640 1 -- 172.21.15.132:0/1436613390 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e1015d130 msgr2=0x7f3e100cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:14.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e07fff640 1 --2- 172.21.15.132:0/1436613390 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e1015d130 0x7f3e100cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:14.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e07fff640 1 -- 172.21.15.132:0/1436613390 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e08009b30 con 0x7f3e1015d510 2023-12-20T04:44:14.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e07fff640 1 --2- 172.21.15.132:0/1436613390 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1015d510 0x7f3e101f24a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3df800d7d0 tx=0x7f3df800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:14.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e0cff9640 1 -- 172.21.15.132:0/1436613390 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8004030 con 0x7f3e1015d510 2023-12-20T04:44:14.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e0cff9640 1 -- 172.21.15.132:0/1436613390 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3df8004190 con 0x7f3e1015d510 2023-12-20T04:44:14.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e15a41640 1 -- 172.21.15.132:0/1436613390 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e100c82a0 con 0x7f3e1015d510 2023-12-20T04:44:14.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e0cff9640 1 -- 172.21.15.132:0/1436613390 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3df8004520 con 0x7f3e1015d510 2023-12-20T04:44:14.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.843+0000 7f3e15a41640 1 -- 172.21.15.132:0/1436613390 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e101f29e0 con 0x7f3e1015d510 2023-12-20T04:44:14.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.844+0000 7f3e15a41640 1 -- 172.21.15.132:0/1436613390 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1004e840 con 0x7f3e1015d510 2023-12-20T04:44:14.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.845+0000 7f3e0cff9640 1 -- 172.21.15.132:0/1436613390 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3df80096a0 con 0x7f3e1015d510 2023-12-20T04:44:14.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.845+0000 7f3e0cff9640 1 --2- 172.21.15.132:0/1436613390 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3df006a430 0x7f3df006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:14.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.845+0000 7f3e0cff9640 1 -- 172.21.15.132:0/1436613390 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f3df80886d0 con 0x7f3e1015d510 2023-12-20T04:44:14.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.845+0000 7f3e0effd640 1 --2- 172.21.15.132:0/1436613390 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3df006a430 0x7f3df006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:14.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.846+0000 7f3e0effd640 1 --2- 172.21.15.132:0/1436613390 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3df006a430 0x7f3df006c8f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3e00000f60 tx=0x7f3e00007c00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:14.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:14.850+0000 7f3e0cff9640 1 -- 172.21.15.132:0/1436613390 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3df80540a0 con 0x7f3e1015d510 2023-12-20T04:44:15.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.015+0000 7f3e15a41640 1 -- 172.21.15.132:0/1436613390 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f3e1015e9d0 con 0x7f3e1015d510 2023-12-20T04:44:15.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.807+0000 7f3e0cff9640 1 -- 172.21.15.132:0/1436613390 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v44) v1 ==== 138+0+0 (secure 0 0 0) 0x7f3df80576c0 con 0x7f3e1015d510 2023-12-20T04:44:15.808 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2023-12-20T04:44:15.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.811+0000 7f3e15a41640 1 -- 172.21.15.132:0/1436613390 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3df006a430 msgr2=0x7f3df006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:15.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.811+0000 7f3e15a41640 1 --2- 172.21.15.132:0/1436613390 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3df006a430 0x7f3df006c8f0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f3e00000f60 tx=0x7f3e00007c00 comp rx=0 tx=0).stop 2023-12-20T04:44:15.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.811+0000 7f3e15a41640 1 -- 172.21.15.132:0/1436613390 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1015d510 msgr2=0x7f3e101f24a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:15.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.811+0000 7f3e15a41640 1 --2- 172.21.15.132:0/1436613390 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1015d510 0x7f3e101f24a0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7f3df800d7d0 tx=0x7f3df800dc90 comp rx=0 tx=0).stop 2023-12-20T04:44:15.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.811+0000 7f3e15a41640 1 -- 172.21.15.132:0/1436613390 shutdown_connections 2023-12-20T04:44:15.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.811+0000 7f3e15a41640 1 --2- 172.21.15.132:0/1436613390 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3df006a430 0x7f3df006c8f0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:15.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.811+0000 7f3e15a41640 1 --2- 172.21.15.132:0/1436613390 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e1015df00 0x7f3e1009cb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:15.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.811+0000 7f3e15a41640 1 --2- 172.21.15.132:0/1436613390 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1015d510 0x7f3e101f24a0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:15.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.811+0000 7f3e15a41640 1 --2- 172.21.15.132:0/1436613390 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e1015d130 0x7f3e100cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:15.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.811+0000 7f3e15a41640 1 -- 172.21.15.132:0/1436613390 >> 172.21.15.132:0/1436613390 conn(0x7f3e100d2eb0 msgr2=0x7f3e1015fd00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:15.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.811+0000 7f3e15a41640 1 -- 172.21.15.132:0/1436613390 shutdown_connections 2023-12-20T04:44:15.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.811+0000 7f3e15a41640 1 -- 172.21.15.132:0/1436613390 wait complete. 2023-12-20T04:44:15.824 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-20T04:44:15.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.933+0000 7f925f269640 1 Processor -- start 2023-12-20T04:44:15.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.933+0000 7f925f269640 1 -- start start 2023-12-20T04:44:15.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.934+0000 7f925f269640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f925815d300 0x7f925806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:15.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.934+0000 7f925f269640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f925806cc90 con 0x7f925815cf20 2023-12-20T04:44:15.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.934+0000 7f925f269640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f92580b2f30 con 0x7f92580cd4b0 2023-12-20T04:44:15.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.934+0000 7f925f269640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92580b3210 con 0x7f925815d300 2023-12-20T04:44:15.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.934+0000 7f925d005640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f925815cf20 0x7f9258161700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40136/0 (socket says 172.21.15.132:40136) 2023-12-20T04:44:15.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.934+0000 7f925d005640 1 -- 172.21.15.132:0/1455946307 learned_addr learned my addr 172.21.15.132:0/1455946307 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:15.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.934+0000 7f925c804640 1 --2- 172.21.15.132:0/1455946307 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f925815d300 0x7f925806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:15.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.934+0000 7f924ffff640 1 -- 172.21.15.132:0/1455946307 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3191496135 0 0) 0x7f925806cc90 con 0x7f925815cf20 2023-12-20T04:44:15.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.934+0000 7f924ffff640 1 -- 172.21.15.132:0/1455946307 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9244003520 con 0x7f925815cf20 2023-12-20T04:44:15.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f924ffff640 1 -- 172.21.15.132:0/1455946307 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2288859762 0 0) 0x7f9244003520 con 0x7f925815cf20 2023-12-20T04:44:15.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f924ffff640 1 -- 172.21.15.132:0/1455946307 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f925815d300 msgr2=0x7f925806c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:15.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f924ffff640 1 --2- 172.21.15.132:0/1455946307 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f925815d300 0x7f925806c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:15.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f924ffff640 1 -- 172.21.15.132:0/1455946307 >> v1:172.21.15.187:6789/0 conn(0x7f92580cd4b0 legacy=0x7f92580d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:15.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f924ffff640 1 -- 172.21.15.132:0/1455946307 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92580b34f0 con 0x7f925815cf20 2023-12-20T04:44:15.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f924ffff640 1 -- 172.21.15.132:0/1455946307 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f9254001670 con 0x7f925815cf20 2023-12-20T04:44:15.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f924ffff640 1 -- 172.21.15.132:0/1455946307 >> v1:172.21.15.132:6789/0 conn(0x7f925815cf20 legacy=0x7f9258161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:15.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f924ffff640 1 --2- 172.21.15.132:0/1455946307 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f925815d300 0x7f92440039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:15.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f924ffff640 1 --2- 172.21.15.132:0/1455946307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9244003ee0 0x7f92440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:15.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f924ffff640 1 --2- 172.21.15.132:0/1455946307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9244004d00 0x7f9244005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:15.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f924ffff640 1 -- 172.21.15.132:0/1455946307 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92580b3210 con 0x7f9244004d00 2023-12-20T04:44:15.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f924ffff640 1 -- 172.21.15.132:0/1455946307 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924400b9e0 con 0x7f9244003ee0 2023-12-20T04:44:15.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f924ffff640 1 -- 172.21.15.132:0/1455946307 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f924400bba0 con 0x7f925815d300 2023-12-20T04:44:15.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f925d806640 1 --2- 172.21.15.132:0/1455946307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9244004d00 0x7f9244005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:15.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f925d005640 1 --2- 172.21.15.132:0/1455946307 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f925815d300 0x7f92440039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:15.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f925c804640 1 --2- 172.21.15.132:0/1455946307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9244003ee0 0x7f92440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:15.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f925d806640 1 -- 172.21.15.132:0/1455946307 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f925815d300 msgr2=0x7f92440039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:15.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f925d806640 1 --2- 172.21.15.132:0/1455946307 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f925815d300 0x7f92440039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:15.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f925d806640 1 -- 172.21.15.132:0/1455946307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9244003ee0 msgr2=0x7f92440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:15.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f925d806640 1 --2- 172.21.15.132:0/1455946307 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9244003ee0 0x7f92440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:15.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.935+0000 7f925d806640 1 -- 172.21.15.132:0/1455946307 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9244003520 con 0x7f9244004d00 2023-12-20T04:44:15.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.936+0000 7f925d806640 1 --2- 172.21.15.132:0/1455946307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9244004d00 0x7f9244005180 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9250002010 tx=0x7f92440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bac0e1efaf61ec21 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:15.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.936+0000 7f924ffff640 1 -- 172.21.15.132:0/1455946307 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925002c750 con 0x7f9244004d00 2023-12-20T04:44:15.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.936+0000 7f924ffff640 1 -- 172.21.15.132:0/1455946307 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f925002c8b0 con 0x7f9244004d00 2023-12-20T04:44:15.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.936+0000 7f924ffff640 1 -- 172.21.15.132:0/1455946307 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f925002cc80 con 0x7f9244004d00 2023-12-20T04:44:15.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.936+0000 7f925f269640 1 -- 172.21.15.132:0/1455946307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9244004d00 msgr2=0x7f9244005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:15.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.936+0000 7f925f269640 1 --2- 172.21.15.132:0/1455946307 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9244004d00 0x7f9244005180 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f9250002010 tx=0x7f92440057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:15.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.936+0000 7f925d806640 1 -- 172.21.15.132:0/1455946307 reap_dead start 2023-12-20T04:44:15.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.936+0000 7f925f269640 1 -- 172.21.15.132:0/1455946307 shutdown_connections 2023-12-20T04:44:15.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.936+0000 7f925f269640 1 -- 172.21.15.132:0/1455946307 >> 172.21.15.132:0/1455946307 conn(0x7f9258072c60 msgr2=0x7f9258073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:15.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.937+0000 7f925f269640 1 -- 172.21.15.132:0/1455946307 shutdown_connections 2023-12-20T04:44:15.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.937+0000 7f925f269640 1 -- 172.21.15.132:0/1455946307 wait complete. 2023-12-20T04:44:15.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.938+0000 7f925f269640 1 Processor -- start 2023-12-20T04:44:15.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.938+0000 7f925f269640 1 -- start start 2023-12-20T04:44:15.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.938+0000 7f925f269640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9244004d00 0x7f92580c7420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:15.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.938+0000 7f925f269640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9258156f70 0x7f92580c4790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:15.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.938+0000 7f925f269640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9258158960 0x7f9258158de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:15.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.938+0000 7f925f269640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9258159b50 con 0x7f9258156f70 2023-12-20T04:44:15.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.938+0000 7f925f269640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f92580b5fd0 con 0x7f9244004d00 2023-12-20T04:44:15.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.938+0000 7f925f269640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f92580c4cd0 con 0x7f9258158960 2023-12-20T04:44:15.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.939+0000 7f925c804640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9258156f70 0x7f92580c4790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:15.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.939+0000 7f925c804640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9258156f70 0x7f92580c4790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56274/0 (socket says 172.21.15.132:56274) 2023-12-20T04:44:15.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.939+0000 7f925c804640 1 -- 172.21.15.132:0/3910415799 learned_addr learned my addr 172.21.15.132:0/3910415799 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:15.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.939+0000 7f925d005640 1 --2- 172.21.15.132:0/3910415799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9244004d00 0x7f92580c7420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:15.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.939+0000 7f925d806640 1 --2- 172.21.15.132:0/3910415799 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9258158960 0x7f9258158de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:15.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.939+0000 7f925c804640 1 -- 172.21.15.132:0/3910415799 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9258158960 msgr2=0x7f9258158de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:15.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.939+0000 7f925c804640 1 --2- 172.21.15.132:0/3910415799 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9258158960 0x7f9258158de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:15.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.939+0000 7f925c804640 1 -- 172.21.15.132:0/3910415799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9244004d00 msgr2=0x7f92580c7420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:15.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.939+0000 7f925c804640 1 --2- 172.21.15.132:0/3910415799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9244004d00 0x7f92580c7420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:15.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.939+0000 7f925c804640 1 -- 172.21.15.132:0/3910415799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f92580b61e0 con 0x7f9258156f70 2023-12-20T04:44:15.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.939+0000 7f925d005640 1 --2- 172.21.15.132:0/3910415799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9244004d00 0x7f92580c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:15.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.939+0000 7f925c804640 1 --2- 172.21.15.132:0/3910415799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9258156f70 0x7f92580c4790 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f92480119a0 tx=0x7f9248011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:15.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.939+0000 7f924dffb640 1 -- 172.21.15.132:0/3910415799 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f924800faf0 con 0x7f9258156f70 2023-12-20T04:44:15.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.939+0000 7f924dffb640 1 -- 172.21.15.132:0/3910415799 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f924800fc50 con 0x7f9258156f70 2023-12-20T04:44:15.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.939+0000 7f925f269640 1 -- 172.21.15.132:0/3910415799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92580b64c0 con 0x7f9258156f70 2023-12-20T04:44:15.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.939+0000 7f924dffb640 1 -- 172.21.15.132:0/3910415799 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9248014440 con 0x7f9258156f70 2023-12-20T04:44:15.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.939+0000 7f925f269640 1 -- 172.21.15.132:0/3910415799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9258159320 con 0x7f9258156f70 2023-12-20T04:44:15.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.940+0000 7f925f269640 1 -- 172.21.15.132:0/3910415799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f92580c7960 con 0x7f9258156f70 2023-12-20T04:44:15.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.941+0000 7f924dffb640 1 -- 172.21.15.132:0/3910415799 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f92480145a0 con 0x7f9258156f70 2023-12-20T04:44:15.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.941+0000 7f924dffb640 1 --2- 172.21.15.132:0/3910415799 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f923c06a430 0x7f923c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:15.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.941+0000 7f924dffb640 1 -- 172.21.15.132:0/3910415799 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(44..44 src has 1..44) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f9248088f70 con 0x7f9258156f70 2023-12-20T04:44:15.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.941+0000 7f925d005640 1 --2- 172.21.15.132:0/3910415799 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f923c06a430 0x7f923c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:15.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.942+0000 7f925d005640 1 --2- 172.21.15.132:0/3910415799 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f923c06a430 0x7f923c06c8f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9254007d00 tx=0x7f9254009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:15.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:15.946+0000 7f924dffb640 1 -- 172.21.15.132:0/3910415799 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f92480bbca0 con 0x7f9258156f70 2023-12-20T04:44:16.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.111+0000 7f925f269640 1 -- 172.21.15.132:0/3910415799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f925804e840 con 0x7f9258156f70 2023-12-20T04:44:16.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.815+0000 7f924dffb640 1 -- 172.21.15.132:0/3910415799 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v45) v1 ==== 170+0+0 (secure 0 0 0) 0x7f92480547d0 con 0x7f9258156f70 2023-12-20T04:44:16.819 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2023-12-20T04:44:16.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.822+0000 7f925f269640 1 -- 172.21.15.132:0/3910415799 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f923c06a430 msgr2=0x7f923c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:16.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.822+0000 7f925f269640 1 --2- 172.21.15.132:0/3910415799 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f923c06a430 0x7f923c06c8f0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f9254007d00 tx=0x7f9254009040 comp rx=0 tx=0).stop 2023-12-20T04:44:16.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.822+0000 7f925f269640 1 -- 172.21.15.132:0/3910415799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9258156f70 msgr2=0x7f92580c4790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:16.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.822+0000 7f925f269640 1 --2- 172.21.15.132:0/3910415799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9258156f70 0x7f92580c4790 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f92480119a0 tx=0x7f9248011e60 comp rx=0 tx=0).stop 2023-12-20T04:44:16.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.823+0000 7f925f269640 1 -- 172.21.15.132:0/3910415799 shutdown_connections 2023-12-20T04:44:16.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.823+0000 7f925f269640 1 --2- 172.21.15.132:0/3910415799 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f923c06a430 0x7f923c06c8f0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:16.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.823+0000 7f925f269640 1 --2- 172.21.15.132:0/3910415799 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9258158960 0x7f9258158de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:16.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.823+0000 7f925f269640 1 --2- 172.21.15.132:0/3910415799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9258156f70 0x7f92580c4790 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:16.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.823+0000 7f925f269640 1 --2- 172.21.15.132:0/3910415799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9244004d00 0x7f92580c7420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:16.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.823+0000 7f925f269640 1 -- 172.21.15.132:0/3910415799 >> 172.21.15.132:0/3910415799 conn(0x7f9258072c60 msgr2=0x7f92580b12b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:16.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.823+0000 7f925f269640 1 -- 172.21.15.132:0/3910415799 shutdown_connections 2023-12-20T04:44:16.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.823+0000 7f925f269640 1 -- 172.21.15.132:0/3910415799 wait complete. 2023-12-20T04:44:16.827 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:44:16.829 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:44:16.836 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-20T04:44:16.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.978+0000 7fcef5bd9640 1 Processor -- start 2023-12-20T04:44:16.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.978+0000 7fcef5bd9640 1 -- start start 2023-12-20T04:44:16.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.979+0000 7fcef5bd9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcef00caee0 0x7fcef00c5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:16.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.979+0000 7fcef5bd9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef006b960 con 0x7fcef006f8d0 2023-12-20T04:44:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.979+0000 7fcef5bd9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcef00c4390 con 0x7fcef006f450 2023-12-20T04:44:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.979+0000 7fcef5bd9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcef00c4c30 con 0x7fcef00caee0 2023-12-20T04:44:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.979+0000 7fceeffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcef006f8d0 0x7fcef006bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40152/0 (socket says 172.21.15.132:40152) 2023-12-20T04:44:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.979+0000 7fceeffff640 1 -- 172.21.15.132:0/223863992 learned_addr learned my addr 172.21.15.132:0/223863992 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.979+0000 7fceef7fe640 1 --2- 172.21.15.132:0/223863992 >> v2:172.21.15.187:3300/0 conn(0x7fcef00caee0 0x7fcef00c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.979+0000 7fceee7fc640 1 -- 172.21.15.132:0/223863992 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3110101375 0 0) 0x7fcef006b960 con 0x7fcef006f8d0 2023-12-20T04:44:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.979+0000 7fceee7fc640 1 -- 172.21.15.132:0/223863992 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fced8003520 con 0x7fcef006f8d0 2023-12-20T04:44:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.979+0000 7fceee7fc640 1 -- 172.21.15.132:0/223863992 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 398465993 0 0) 0x7fced8003520 con 0x7fcef006f8d0 2023-12-20T04:44:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.979+0000 7fceee7fc640 1 -- 172.21.15.132:0/223863992 >> v2:172.21.15.187:3300/0 conn(0x7fcef00caee0 msgr2=0x7fcef00c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.979+0000 7fceee7fc640 1 --2- 172.21.15.132:0/223863992 >> v2:172.21.15.187:3300/0 conn(0x7fcef00caee0 0x7fcef00c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.979+0000 7fceee7fc640 1 -- 172.21.15.132:0/223863992 >> v1:172.21.15.187:6789/0 conn(0x7fcef006f450 legacy=0x7fcef00cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.979+0000 7fceee7fc640 1 -- 172.21.15.132:0/223863992 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef00c4670 con 0x7fcef006f8d0 2023-12-20T04:44:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.979+0000 7fceee7fc640 1 -- 172.21.15.132:0/223863992 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fcee80019f0 con 0x7fcef006f8d0 2023-12-20T04:44:16.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.980+0000 7fceee7fc640 1 -- 172.21.15.132:0/223863992 >> v1:172.21.15.132:6789/0 conn(0x7fcef006f8d0 legacy=0x7fcef006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:16.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.980+0000 7fceee7fc640 1 --2- 172.21.15.132:0/223863992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fced8003970 0x7fced8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:16.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.980+0000 7fceee7fc640 1 --2- 172.21.15.132:0/223863992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fced80047c0 0x7fced8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:16.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.980+0000 7fceee7fc640 1 --2- 172.21.15.132:0/223863992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fced8005180 0x7fced800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:16.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.980+0000 7fceee7fc640 1 -- 172.21.15.132:0/223863992 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef00c4c30 con 0x7fced8005180 2023-12-20T04:44:16.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.980+0000 7fceee7fc640 1 -- 172.21.15.132:0/223863992 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fced800c020 con 0x7fced8003970 2023-12-20T04:44:16.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.980+0000 7fceee7fc640 1 -- 172.21.15.132:0/223863992 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fced800c1e0 con 0x7fced80047c0 2023-12-20T04:44:16.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.980+0000 7fceeffff640 1 --2- 172.21.15.132:0/223863992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fced8005180 0x7fced800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:16.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.980+0000 7fceef7fe640 1 --2- 172.21.15.132:0/223863992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fced8003970 0x7fced8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:16.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.980+0000 7fceeeffd640 1 --2- 172.21.15.132:0/223863992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fced80047c0 0x7fced8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:16.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.980+0000 7fceeffff640 1 -- 172.21.15.132:0/223863992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fced80047c0 msgr2=0x7fced8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:16.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.980+0000 7fceeffff640 1 --2- 172.21.15.132:0/223863992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fced80047c0 0x7fced8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:16.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.980+0000 7fceeffff640 1 -- 172.21.15.132:0/223863992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fced8003970 msgr2=0x7fced8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:16.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.980+0000 7fceeffff640 1 --2- 172.21.15.132:0/223863992 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fced8003970 0x7fced8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:16.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.980+0000 7fceeffff640 1 -- 172.21.15.132:0/223863992 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fced8003520 con 0x7fced8005180 2023-12-20T04:44:16.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.981+0000 7fceeffff640 1 -- 172.21.15.132:0/223863992 reap_dead start 2023-12-20T04:44:16.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.981+0000 7fceeffff640 1 --2- 172.21.15.132:0/223863992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fced8005180 0x7fced800b980 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcee800a830 tx=0x7fced80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9596090f0406828 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:16.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.981+0000 7fceee7fc640 1 -- 172.21.15.132:0/223863992 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee80072d0 con 0x7fced8005180 2023-12-20T04:44:16.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.981+0000 7fceee7fc640 1 -- 172.21.15.132:0/223863992 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee802f070 con 0x7fced8005180 2023-12-20T04:44:16.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.981+0000 7fceee7fc640 1 -- 172.21.15.132:0/223863992 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee80076b0 con 0x7fced8005180 2023-12-20T04:44:16.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.981+0000 7fcef5bd9640 1 -- 172.21.15.132:0/223863992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fced8005180 msgr2=0x7fced800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:16.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.981+0000 7fcef5bd9640 1 --2- 172.21.15.132:0/223863992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fced8005180 0x7fced800b980 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fcee800a830 tx=0x7fced80057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:16.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.981+0000 7fcef5bd9640 1 -- 172.21.15.132:0/223863992 shutdown_connections 2023-12-20T04:44:16.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.981+0000 7fcef5bd9640 1 --2- 172.21.15.132:0/223863992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fced8005180 0x7fced800b980 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:16.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.981+0000 7fcef5bd9640 1 -- 172.21.15.132:0/223863992 >> 172.21.15.132:0/223863992 conn(0x7fcef006a260 msgr2=0x7fcef00b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:16.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.981+0000 7fcef5bd9640 1 -- 172.21.15.132:0/223863992 shutdown_connections 2023-12-20T04:44:16.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.981+0000 7fcef5bd9640 1 -- 172.21.15.132:0/223863992 wait complete. 2023-12-20T04:44:16.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.982+0000 7fcef5bd9640 1 Processor -- start 2023-12-20T04:44:16.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.983+0000 7fcef5bd9640 1 -- start start 2023-12-20T04:44:16.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.983+0000 7fcef5bd9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fced8005180 0x7fcef00b4120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:16.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.983+0000 7fcef5bd9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcef01e4300 0x7fcef00c6830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:16.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.983+0000 7fcef5bd9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcef01e4780 0x7fcef00c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:16.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.983+0000 7fcef5bd9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef01e2540 con 0x7fced8005180 2023-12-20T04:44:16.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.983+0000 7fcef5bd9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef01e33a0 con 0x7fcef01e4780 2023-12-20T04:44:16.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.983+0000 7fcef5bd9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcef01e2790 con 0x7fcef01e4300 2023-12-20T04:44:16.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.983+0000 7fceef7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fced8005180 0x7fcef00b4120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:16.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.983+0000 7fceef7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fced8005180 0x7fcef00b4120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56288/0 (socket says 172.21.15.132:56288) 2023-12-20T04:44:16.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.983+0000 7fceef7fe640 1 -- 172.21.15.132:0/5537173 learned_addr learned my addr 172.21.15.132:0/5537173 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:16.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.984+0000 7fceef7fe640 1 -- 172.21.15.132:0/5537173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcef01e4300 msgr2=0x7fcef00c6830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:16.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.984+0000 7fceef7fe640 1 --2- 172.21.15.132:0/5537173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcef01e4300 0x7fcef00c6830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:16.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.984+0000 7fceef7fe640 1 -- 172.21.15.132:0/5537173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcef01e4780 msgr2=0x7fcef00c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:16.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.984+0000 7fceeffff640 1 --2- 172.21.15.132:0/5537173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcef01e4780 0x7fcef00c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:16.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.984+0000 7fceef7fe640 1 --2- 172.21.15.132:0/5537173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcef01e4780 0x7fcef00c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:16.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.984+0000 7fceef7fe640 1 -- 172.21.15.132:0/5537173 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef01e2a70 con 0x7fced8005180 2023-12-20T04:44:16.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.984+0000 7fceef7fe640 1 --2- 172.21.15.132:0/5537173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fced8005180 0x7fcef00b4120 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcee0011910 tx=0x7fcee0011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:16.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.984+0000 7fced7fff640 1 -- 172.21.15.132:0/5537173 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee000fa90 con 0x7fced8005180 2023-12-20T04:44:16.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.984+0000 7fced7fff640 1 -- 172.21.15.132:0/5537173 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcee000fbf0 con 0x7fced8005180 2023-12-20T04:44:16.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.984+0000 7fced7fff640 1 -- 172.21.15.132:0/5537173 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcee0014440 con 0x7fced8005180 2023-12-20T04:44:16.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.984+0000 7fcef5bd9640 1 -- 172.21.15.132:0/5537173 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef01e2d50 con 0x7fced8005180 2023-12-20T04:44:16.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.984+0000 7fcef5bd9640 1 -- 172.21.15.132:0/5537173 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef01e3ef0 con 0x7fced8005180 2023-12-20T04:44:16.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.985+0000 7fcef5bd9640 1 -- 172.21.15.132:0/5537173 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef00c92a0 con 0x7fced8005180 2023-12-20T04:44:16.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.985+0000 7fced7fff640 1 -- 172.21.15.132:0/5537173 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcee00145a0 con 0x7fced8005180 2023-12-20T04:44:16.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.986+0000 7fced7fff640 1 --2- 172.21.15.132:0/5537173 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcedc06a430 0x7fcedc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:16.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.986+0000 7fceeeffd640 1 --2- 172.21.15.132:0/5537173 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcedc06a430 0x7fcedc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:16.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.986+0000 7fced7fff640 1 -- 172.21.15.132:0/5537173 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(45..45 src has 1..45) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fcee0088fe0 con 0x7fced8005180 2023-12-20T04:44:16.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.986+0000 7fceeeffd640 1 --2- 172.21.15.132:0/5537173 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcedc06a430 0x7fcedc06c8f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcee4000c00 tx=0x7fcee4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:16.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:16.990+0000 7fced7fff640 1 -- 172.21.15.132:0/5537173 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcee00546c0 con 0x7fced8005180 2023-12-20T04:44:17.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.195+0000 7fcef5bd9640 1 -- 172.21.15.132:0/5537173 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fcef004e840 con 0x7fced8005180 2023-12-20T04:44:17.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.208+0000 7fced7fff640 1 -- 172.21.15.132:0/5537173 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 6 and data pool 7 v17) v1 ==== 172+0+0 (secure 0 0 0) 0x7fcee0057ce0 con 0x7fced8005180 2023-12-20T04:44:17.210 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 6 and data pool 7 2023-12-20T04:44:17.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.213+0000 7fcef5bd9640 1 -- 172.21.15.132:0/5537173 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcedc06a430 msgr2=0x7fcedc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.213+0000 7fcef5bd9640 1 --2- 172.21.15.132:0/5537173 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcedc06a430 0x7fcedc06c8f0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7fcee4000c00 tx=0x7fcee4009040 comp rx=0 tx=0).stop 2023-12-20T04:44:17.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.214+0000 7fcef5bd9640 1 -- 172.21.15.132:0/5537173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fced8005180 msgr2=0x7fcef00b4120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.214+0000 7fcef5bd9640 1 --2- 172.21.15.132:0/5537173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fced8005180 0x7fcef00b4120 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fcee0011910 tx=0x7fcee0011dd0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.215+0000 7fcef5bd9640 1 -- 172.21.15.132:0/5537173 shutdown_connections 2023-12-20T04:44:17.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.215+0000 7fcef5bd9640 1 --2- 172.21.15.132:0/5537173 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcedc06a430 0x7fcedc06c8f0 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.215+0000 7fcef5bd9640 1 --2- 172.21.15.132:0/5537173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcef01e4780 0x7fcef00c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.215+0000 7fcef5bd9640 1 --2- 172.21.15.132:0/5537173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcef01e4300 0x7fcef00c6830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.215+0000 7fcef5bd9640 1 --2- 172.21.15.132:0/5537173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fced8005180 0x7fcef00b4120 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.215+0000 7fcef5bd9640 1 -- 172.21.15.132:0/5537173 >> 172.21.15.132:0/5537173 conn(0x7fcef006a260 msgr2=0x7fcef0140460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:17.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.216+0000 7fcef5bd9640 1 -- 172.21.15.132:0/5537173 shutdown_connections 2023-12-20T04:44:17.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.216+0000 7fcef5bd9640 1 -- 172.21.15.132:0/5537173 wait complete. 2023-12-20T04:44:17.230 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:44:17.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.369+0000 7f2e52c4d640 1 Processor -- start 2023-12-20T04:44:17.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.369+0000 7f2e52c4d640 1 -- start start 2023-12-20T04:44:17.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.370+0000 7f2e52c4d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e4c159b50 0x7f2e4c0c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.370+0000 7f2e52c4d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2e4c15e530 0x7f2e4c06fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.370+0000 7f2e52c4d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e4c0ccf30 con 0x7f2e4c06c240 2023-12-20T04:44:17.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.370+0000 7f2e52c4d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e4c0caa60 con 0x7f2e4c15e530 2023-12-20T04:44:17.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.370+0000 7f2e52c4d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0ccc90 con 0x7f2e4c159b50 2023-12-20T04:44:17.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.370+0000 7f2e4bfff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2e4c15e530 0x7f2e4c06fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:17.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.370+0000 7f2e509e9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e4c159b50 0x7f2e4c0c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:17.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.370+0000 7f2e4bfff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2e4c15e530 0x7f2e4c06fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:59096/0 (socket says 172.21.15.132:59096) 2023-12-20T04:44:17.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.370+0000 7f2e509e9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e4c159b50 0x7f2e4c0c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:52544/0 (socket says 172.21.15.132:52544) 2023-12-20T04:44:17.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.370+0000 7f2e4bfff640 1 -- 172.21.15.132:0/1813683558 learned_addr learned my addr 172.21.15.132:0/1813683558 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:17.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.370+0000 7f2e511ea640 1 --1- 172.21.15.132:0/1813683558 >> v1:172.21.15.187:6789/0 conn(0x7f2e4c06c240 0x7f2e4c0cd3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:42472/0 (socket says 172.21.15.132:42472) 2023-12-20T04:44:17.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.371+0000 7f2e4bfff640 1 -- 172.21.15.132:0/1813683558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e4c159b50 msgr2=0x7f2e4c0c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:17.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.371+0000 7f2e4bfff640 1 --2- 172.21.15.132:0/1813683558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e4c159b50 0x7f2e4c0c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.371+0000 7f2e4bfff640 1 -- 172.21.15.132:0/1813683558 >> v1:172.21.15.187:6789/0 conn(0x7f2e4c06c240 legacy=0x7f2e4c0cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.371+0000 7f2e4bfff640 1 -- 172.21.15.132:0/1813683558 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e4c0ca1c0 con 0x7f2e4c15e530 2023-12-20T04:44:17.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.371+0000 7f2e509e9640 1 --2- 172.21.15.132:0/1813683558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e4c159b50 0x7f2e4c0c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:44:17.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.371+0000 7f2e4bfff640 1 --2- 172.21.15.132:0/1813683558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e4c15e530 0x7f2e4c06fd70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009870 tx=0x7f2e3802b980 comp rx=0 tx=0).ready entity=mon.1 client_cookie=872ef10318e88a13 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:17.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.372+0000 7f2e4b7fe640 1 -- 172.21.15.132:0/1813683558 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38030840 con 0x7f2e4c15e530 2023-12-20T04:44:17.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.372+0000 7f2e4b7fe640 1 -- 172.21.15.132:0/1813683558 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e380309a0 con 0x7f2e4c15e530 2023-12-20T04:44:17.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.372+0000 7f2e4b7fe640 1 -- 172.21.15.132:0/1813683558 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e38030d30 con 0x7f2e4c15e530 2023-12-20T04:44:17.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.372+0000 7f2e52c4d640 1 -- 172.21.15.132:0/1813683558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e4c15e530 msgr2=0x7f2e4c06fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.372+0000 7f2e52c4d640 1 --2- 172.21.15.132:0/1813683558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e4c15e530 0x7f2e4c06fd70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f2e38009870 tx=0x7f2e3802b980 comp rx=0 tx=0).stop 2023-12-20T04:44:17.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.372+0000 7f2e52c4d640 1 -- 172.21.15.132:0/1813683558 shutdown_connections 2023-12-20T04:44:17.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.372+0000 7f2e52c4d640 1 --2- 172.21.15.132:0/1813683558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e4c15e530 0x7f2e4c06fd70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.372+0000 7f2e52c4d640 1 --2- 172.21.15.132:0/1813683558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e4c159b50 0x7f2e4c0c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.372+0000 7f2e52c4d640 1 -- 172.21.15.132:0/1813683558 >> 172.21.15.132:0/1813683558 conn(0x7f2e4c0ced10 msgr2=0x7f2e4c0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:17.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.372+0000 7f2e52c4d640 1 -- 172.21.15.132:0/1813683558 shutdown_connections 2023-12-20T04:44:17.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.372+0000 7f2e52c4d640 1 -- 172.21.15.132:0/1813683558 wait complete. 2023-12-20T04:44:17.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.373+0000 7f2e52c4d640 1 Processor -- start 2023-12-20T04:44:17.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.373+0000 7f2e52c4d640 1 -- start start 2023-12-20T04:44:17.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.374+0000 7f2e52c4d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e4c06c240 0x7f2e4c154dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.374+0000 7f2e52c4d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e4c159b50 0x7f2e4c0c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.374+0000 7f2e52c4d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e4c15e530 0x7f2e4c15c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.374+0000 7f2e52c4d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c0c4800 con 0x7f2e4c06c240 2023-12-20T04:44:17.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.374+0000 7f2e52c4d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c157960 con 0x7f2e4c15e530 2023-12-20T04:44:17.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.374+0000 7f2e52c4d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e4c1f3760 con 0x7f2e4c159b50 2023-12-20T04:44:17.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.374+0000 7f2e509e9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e4c06c240 0x7f2e4c154dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:17.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.374+0000 7f2e509e9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e4c06c240 0x7f2e4c154dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56292/0 (socket says 172.21.15.132:56292) 2023-12-20T04:44:17.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.374+0000 7f2e509e9640 1 -- 172.21.15.132:0/1438812576 learned_addr learned my addr 172.21.15.132:0/1438812576 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:17.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.375+0000 7f2e4bfff640 1 --2- 172.21.15.132:0/1438812576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e4c159b50 0x7f2e4c0c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:17.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.375+0000 7f2e511ea640 1 --2- 172.21.15.132:0/1438812576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e4c15e530 0x7f2e4c15c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:17.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.375+0000 7f2e509e9640 1 -- 172.21.15.132:0/1438812576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e4c159b50 msgr2=0x7f2e4c0c42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.375+0000 7f2e509e9640 1 --2- 172.21.15.132:0/1438812576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e4c159b50 0x7f2e4c0c42c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.375+0000 7f2e509e9640 1 -- 172.21.15.132:0/1438812576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e4c15e530 msgr2=0x7f2e4c15c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.375+0000 7f2e509e9640 1 --2- 172.21.15.132:0/1438812576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e4c15e530 0x7f2e4c15c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.375+0000 7f2e509e9640 1 -- 172.21.15.132:0/1438812576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e40009400 con 0x7f2e4c06c240 2023-12-20T04:44:17.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.375+0000 7f2e511ea640 1 --2- 172.21.15.132:0/1438812576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e4c15e530 0x7f2e4c15c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:17.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.375+0000 7f2e4bfff640 1 --2- 172.21.15.132:0/1438812576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e4c159b50 0x7f2e4c0c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:17.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.375+0000 7f2e509e9640 1 --2- 172.21.15.132:0/1438812576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e4c06c240 0x7f2e4c154dc0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2e4000ebe0 tx=0x7f2e4000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:17.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.375+0000 7f2e497fa640 1 -- 172.21.15.132:0/1438812576 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e40009760 con 0x7f2e4c06c240 2023-12-20T04:44:17.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.375+0000 7f2e497fa640 1 -- 172.21.15.132:0/1438812576 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e4000cc30 con 0x7f2e4c06c240 2023-12-20T04:44:17.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.375+0000 7f2e497fa640 1 -- 172.21.15.132:0/1438812576 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e4000eee0 con 0x7f2e4c06c240 2023-12-20T04:44:17.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.375+0000 7f2e52c4d640 1 -- 172.21.15.132:0/1438812576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e380094d0 con 0x7f2e4c06c240 2023-12-20T04:44:17.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.375+0000 7f2e52c4d640 1 -- 172.21.15.132:0/1438812576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e4c0c2f70 con 0x7f2e4c06c240 2023-12-20T04:44:17.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.376+0000 7f2e52c4d640 1 -- 172.21.15.132:0/1438812576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e4c155f80 con 0x7f2e4c06c240 2023-12-20T04:44:17.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.376+0000 7f2e497fa640 1 -- 172.21.15.132:0/1438812576 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2e40013470 con 0x7f2e4c06c240 2023-12-20T04:44:17.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.377+0000 7f2e497fa640 1 --2- 172.21.15.132:0/1438812576 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2e3006a460 0x7f2e3006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.377+0000 7f2e497fa640 1 -- 172.21.15.132:0/1438812576 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2e40088c40 con 0x7f2e4c06c240 2023-12-20T04:44:17.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.377+0000 7f2e4bfff640 1 --2- 172.21.15.132:0/1438812576 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2e3006a460 0x7f2e3006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:17.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.377+0000 7f2e4bfff640 1 --2- 172.21.15.132:0/1438812576 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2e3006a460 0x7f2e3006c920 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2e38036000 tx=0x7f2e3803b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:17.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.381+0000 7f2e497fa640 1 -- 172.21.15.132:0/1438812576 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2e400541b0 con 0x7f2e4c06c240 2023-12-20T04:44:17.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.546+0000 7f2e52c4d640 1 -- 172.21.15.132:0/1438812576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2e4c0ca480 con 0x7f2e4c06c240 2023-12-20T04:44:17.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.547+0000 7f2e497fa640 1 -- 172.21.15.132:0/1438812576 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16106 (secure 0 0 0) 0x7f2e4c0ca480 con 0x7f2e4c06c240 2023-12-20T04:44:17.549 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:17.549 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":46,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:44:17.196901+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:44:15.033177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-20T04:44:16.130594+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:44:17.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.549+0000 7f2e52c4d640 1 -- 172.21.15.132:0/1438812576 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2e3006a460 msgr2=0x7f2e3006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.549+0000 7f2e52c4d640 1 --2- 172.21.15.132:0/1438812576 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2e3006a460 0x7f2e3006c920 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f2e38036000 tx=0x7f2e3803b040 comp rx=0 tx=0).stop 2023-12-20T04:44:17.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.549+0000 7f2e52c4d640 1 -- 172.21.15.132:0/1438812576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e4c06c240 msgr2=0x7f2e4c154dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.549+0000 7f2e52c4d640 1 --2- 172.21.15.132:0/1438812576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e4c06c240 0x7f2e4c154dc0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f2e4000ebe0 tx=0x7f2e4000c520 comp rx=0 tx=0).stop 2023-12-20T04:44:17.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.549+0000 7f2e52c4d640 1 -- 172.21.15.132:0/1438812576 shutdown_connections 2023-12-20T04:44:17.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.549+0000 7f2e52c4d640 1 --2- 172.21.15.132:0/1438812576 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2e3006a460 0x7f2e3006c920 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.549+0000 7f2e52c4d640 1 --2- 172.21.15.132:0/1438812576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e4c15e530 0x7f2e4c15c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.549+0000 7f2e52c4d640 1 --2- 172.21.15.132:0/1438812576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e4c159b50 0x7f2e4c0c42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.549+0000 7f2e52c4d640 1 --2- 172.21.15.132:0/1438812576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e4c06c240 0x7f2e4c154dc0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.549+0000 7f2e52c4d640 1 -- 172.21.15.132:0/1438812576 >> 172.21.15.132:0/1438812576 conn(0x7f2e4c0ced10 msgr2=0x7f2e4c0b1930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:17.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.549+0000 7f2e52c4d640 1 -- 172.21.15.132:0/1438812576 shutdown_connections 2023-12-20T04:44:17.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.549+0000 7f2e52c4d640 1 -- 172.21.15.132:0/1438812576 wait complete. 2023-12-20T04:44:17.562 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:44:17.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.661+0000 7f4c229fb640 1 Processor -- start 2023-12-20T04:44:17.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.661+0000 7f4c229fb640 1 -- start start 2023-12-20T04:44:17.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.662+0000 7f4c229fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1c06a340 0x7f4c1c0708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.662+0000 7f4c229fb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c141660 con 0x7f4c1c13df60 2023-12-20T04:44:17.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.662+0000 7f4c229fb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c140ae0 con 0x7f4c1c13e690 2023-12-20T04:44:17.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.662+0000 7f4c229fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c155a30 con 0x7f4c1c06a340 2023-12-20T04:44:17.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.662+0000 7f4c1bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4c1c13df60 0x7f4c1c0caa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46834/0 (socket says 172.21.15.132:46834) 2023-12-20T04:44:17.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.662+0000 7f4c1bfff640 1 -- 172.21.15.132:0/526137781 learned_addr learned my addr 172.21.15.132:0/526137781 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:17.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.662+0000 7f4c20f98640 1 --2- 172.21.15.132:0/526137781 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1c06a340 0x7f4c1c0708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:17.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.662+0000 7f4c1affd640 1 -- 172.21.15.132:0/526137781 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4170900618 0 0) 0x7f4c1c141660 con 0x7f4c1c13df60 2023-12-20T04:44:17.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.662+0000 7f4c1affd640 1 -- 172.21.15.132:0/526137781 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c04003520 con 0x7f4c1c13df60 2023-12-20T04:44:17.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.662+0000 7f4c1affd640 1 -- 172.21.15.132:0/526137781 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1684570377 0 0) 0x7f4c1c140ae0 con 0x7f4c1c13e690 2023-12-20T04:44:17.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.662+0000 7f4c1affd640 1 -- 172.21.15.132:0/526137781 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c1c141660 con 0x7f4c1c13e690 2023-12-20T04:44:17.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.662+0000 7f4c1affd640 1 -- 172.21.15.132:0/526137781 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2766955472 0 0) 0x7f4c04003520 con 0x7f4c1c13df60 2023-12-20T04:44:17.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.662+0000 7f4c20f98640 1 -- 172.21.15.132:0/526137781 >> v1:172.21.15.187:6789/0 conn(0x7f4c1c13e690 legacy=0x7f4c1c069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.662+0000 7f4c20f98640 1 -- 172.21.15.132:0/526137781 >> v1:172.21.15.132:6789/0 conn(0x7f4c1c13df60 legacy=0x7f4c1c0caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.662+0000 7f4c20f98640 1 -- 172.21.15.132:0/526137781 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c140dc0 con 0x7f4c1c06a340 2023-12-20T04:44:17.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.663+0000 7f4c20f98640 1 --2- 172.21.15.132:0/526137781 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1c06a340 0x7f4c1c0708d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009dc0 tx=0x7f4c1402bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=248bb08b0bb8d1f7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:17.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.663+0000 7f4c1affd640 1 -- 172.21.15.132:0/526137781 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0017f0 con 0x7f4c1c06a340 2023-12-20T04:44:17.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.663+0000 7f4c1affd640 1 -- 172.21.15.132:0/526137781 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1402c880 con 0x7f4c1c06a340 2023-12-20T04:44:17.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.663+0000 7f4c1affd640 1 -- 172.21.15.132:0/526137781 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1402cbf0 con 0x7f4c1c06a340 2023-12-20T04:44:17.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.664+0000 7f4c229fb640 1 -- 172.21.15.132:0/526137781 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1c06a340 msgr2=0x7f4c1c0708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.664+0000 7f4c229fb640 1 --2- 172.21.15.132:0/526137781 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1c06a340 0x7f4c1c0708d0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f4c14009dc0 tx=0x7f4c1402bd50 comp rx=0 tx=0).stop 2023-12-20T04:44:17.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.664+0000 7f4c229fb640 1 -- 172.21.15.132:0/526137781 shutdown_connections 2023-12-20T04:44:17.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.664+0000 7f4c229fb640 1 --2- 172.21.15.132:0/526137781 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1c06a340 0x7f4c1c0708d0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.664+0000 7f4c229fb640 1 -- 172.21.15.132:0/526137781 >> 172.21.15.132:0/526137781 conn(0x7f4c1c0cfbd0 msgr2=0x7f4c1c0cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:17.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.664+0000 7f4c229fb640 1 -- 172.21.15.132:0/526137781 shutdown_connections 2023-12-20T04:44:17.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.664+0000 7f4c229fb640 1 -- 172.21.15.132:0/526137781 wait complete. 2023-12-20T04:44:17.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.665+0000 7f4c229fb640 1 Processor -- start 2023-12-20T04:44:17.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.665+0000 7f4c229fb640 1 -- start start 2023-12-20T04:44:17.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.666+0000 7f4c229fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c06a340 0x7f4c1c1351a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.666+0000 7f4c229fb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c1c13df60 0x7f4c1c0b5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.666+0000 7f4c229fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1c13e690 0x7f4c1c13f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.666+0000 7f4c229fb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c142860 con 0x7f4c1c06a340 2023-12-20T04:44:17.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.666+0000 7f4c229fb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c142b40 con 0x7f4c1c13df60 2023-12-20T04:44:17.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.666+0000 7f4c229fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c142e20 con 0x7f4c1c13e690 2023-12-20T04:44:17.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.666+0000 7f4c1bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c06a340 0x7f4c1c1351a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:17.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.666+0000 7f4c1bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c06a340 0x7f4c1c1351a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56818/0 (socket says 172.21.15.132:56818) 2023-12-20T04:44:17.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.666+0000 7f4c1bfff640 1 -- 172.21.15.132:0/2181852886 learned_addr learned my addr 172.21.15.132:0/2181852886 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:17.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.666+0000 7f4c1b7fe640 1 --2- 172.21.15.132:0/2181852886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c1c13df60 0x7f4c1c0b5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:17.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.666+0000 7f4c20f98640 1 --2- 172.21.15.132:0/2181852886 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1c13e690 0x7f4c1c13f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:17.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.666+0000 7f4c1bfff640 1 -- 172.21.15.132:0/2181852886 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1c13e690 msgr2=0x7f4c1c13f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.666+0000 7f4c1bfff640 1 --2- 172.21.15.132:0/2181852886 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1c13e690 0x7f4c1c13f350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.666+0000 7f4c1bfff640 1 -- 172.21.15.132:0/2181852886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c1c13df60 msgr2=0x7f4c1c0b5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.666+0000 7f4c1bfff640 1 --2- 172.21.15.132:0/2181852886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c1c13df60 0x7f4c1c0b5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.666+0000 7f4c1bfff640 1 -- 172.21.15.132:0/2181852886 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c14009a70 con 0x7f4c1c06a340 2023-12-20T04:44:17.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.667+0000 7f4c1b7fe640 1 --2- 172.21.15.132:0/2181852886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c1c13df60 0x7f4c1c0b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:17.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.667+0000 7f4c1bfff640 1 --2- 172.21.15.132:0/2181852886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c06a340 0x7f4c1c1351a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c001360 tx=0x7f4c0c00cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:17.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.667+0000 7f4c18ff9640 1 -- 172.21.15.132:0/2181852886 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c007270 con 0x7f4c1c06a340 2023-12-20T04:44:17.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.667+0000 7f4c18ff9640 1 -- 172.21.15.132:0/2181852886 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c0c0073d0 con 0x7f4c1c06a340 2023-12-20T04:44:17.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.667+0000 7f4c229fb640 1 -- 172.21.15.132:0/2181852886 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1c143100 con 0x7f4c1c06a340 2023-12-20T04:44:17.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.667+0000 7f4c18ff9640 1 -- 172.21.15.132:0/2181852886 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c0c0057a0 con 0x7f4c1c06a340 2023-12-20T04:44:17.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.667+0000 7f4c229fb640 1 -- 172.21.15.132:0/2181852886 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c1436c0 con 0x7f4c1c06a340 2023-12-20T04:44:17.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.668+0000 7f4c229fb640 1 -- 172.21.15.132:0/2181852886 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c1438b0 con 0x7f4c1c06a340 2023-12-20T04:44:17.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.668+0000 7f4c18ff9640 1 -- 172.21.15.132:0/2181852886 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4c0c005900 con 0x7f4c1c06a340 2023-12-20T04:44:17.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.669+0000 7f4c18ff9640 1 --2- 172.21.15.132:0/2181852886 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c0806a430 0x7f4c0806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.669+0000 7f4c1b7fe640 1 --2- 172.21.15.132:0/2181852886 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c0806a430 0x7f4c0806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:17.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.669+0000 7f4c18ff9640 1 -- 172.21.15.132:0/2181852886 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c0c0880b0 con 0x7f4c1c06a340 2023-12-20T04:44:17.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.669+0000 7f4c1b7fe640 1 --2- 172.21.15.132:0/2181852886 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c0806a430 0x7f4c0806c8f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0b48b0 tx=0x7f4c10009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:17.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.673+0000 7f4c18ff9640 1 -- 172.21.15.132:0/2181852886 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4c0c0536a0 con 0x7f4c1c06a340 2023-12-20T04:44:17.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.839+0000 7f4c229fb640 1 -- 172.21.15.132:0/2181852886 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c1c04e840 con 0x7f4c1c06a340 2023-12-20T04:44:17.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.840+0000 7f4c18ff9640 1 -- 172.21.15.132:0/2181852886 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v46) v1 ==== 74+0+16106 (secure 0 0 0) 0x7f4c0c017090 con 0x7f4c1c06a340 2023-12-20T04:44:17.842 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:17.842 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":46,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:44:17.196901+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:44:15.033177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-20T04:44:16.130594+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:44:17.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.842+0000 7f4c229fb640 1 -- 172.21.15.132:0/2181852886 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c0806a430 msgr2=0x7f4c0806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.842+0000 7f4c229fb640 1 --2- 172.21.15.132:0/2181852886 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c0806a430 0x7f4c0806c8f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c0b48b0 tx=0x7f4c10009040 comp rx=0 tx=0).stop 2023-12-20T04:44:17.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.842+0000 7f4c229fb640 1 -- 172.21.15.132:0/2181852886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c06a340 msgr2=0x7f4c1c1351a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.842+0000 7f4c229fb640 1 --2- 172.21.15.132:0/2181852886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c06a340 0x7f4c1c1351a0 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c001360 tx=0x7f4c0c00cbe0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.842+0000 7f4c229fb640 1 -- 172.21.15.132:0/2181852886 shutdown_connections 2023-12-20T04:44:17.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.842+0000 7f4c229fb640 1 --2- 172.21.15.132:0/2181852886 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c0806a430 0x7f4c0806c8f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.842+0000 7f4c229fb640 1 --2- 172.21.15.132:0/2181852886 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1c13e690 0x7f4c1c13f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.842+0000 7f4c229fb640 1 --2- 172.21.15.132:0/2181852886 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c1c13df60 0x7f4c1c0b5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.842+0000 7f4c229fb640 1 --2- 172.21.15.132:0/2181852886 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c06a340 0x7f4c1c1351a0 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.842+0000 7f4c229fb640 1 -- 172.21.15.132:0/2181852886 >> 172.21.15.132:0/2181852886 conn(0x7f4c1c0cfbd0 msgr2=0x7f4c1c0b0810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:17.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.842+0000 7f4c229fb640 1 -- 172.21.15.132:0/2181852886 shutdown_connections 2023-12-20T04:44:17.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.842+0000 7f4c229fb640 1 -- 172.21.15.132:0/2181852886 wait complete. 2023-12-20T04:44:17.855 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-20T04:44:17.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.956+0000 7f2bc82f7640 1 Processor -- start 2023-12-20T04:44:17.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.956+0000 7f2bc82f7640 1 -- start start 2023-12-20T04:44:17.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.957+0000 7f2bc82f7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2bc0069c30 0x7f2bc0070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.957+0000 7f2bc82f7640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2bc015d360 0x7f2bc006a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.957+0000 7f2bc82f7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc00cbde0 0x7f2bc00ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.957+0000 7f2bc82f7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc00c4f40 con 0x7f2bc0069c30 2023-12-20T04:44:17.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.957+0000 7f2bc82f7640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2bc00af5b0 con 0x7f2bc015d360 2023-12-20T04:44:17.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.957+0000 7f2bc82f7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc006a550 con 0x7f2bc00cbde0 2023-12-20T04:44:17.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.957+0000 7f2bc6093640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2bc0069c30 0x7f2bc0070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:17.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.957+0000 7f2bc6093640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2bc0069c30 0x7f2bc0070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56824/0 (socket says 172.21.15.132:56824) 2023-12-20T04:44:17.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.957+0000 7f2bc6093640 1 -- 172.21.15.132:0/1238204040 learned_addr learned my addr 172.21.15.132:0/1238204040 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:17.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.957+0000 7f2bc6093640 1 -- 172.21.15.132:0/1238204040 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc00cbde0 msgr2=0x7f2bc00ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:17.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.957+0000 7f2bc6093640 1 --2- 172.21.15.132:0/1238204040 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc00cbde0 0x7f2bc00ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.957+0000 7f2bc6093640 1 -- 172.21.15.132:0/1238204040 >> v2:172.21.15.187:3300/0 conn(0x7f2bc015d360 msgr2=0x7f2bc006a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:17.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.957+0000 7f2bc6093640 1 --2- 172.21.15.132:0/1238204040 >> v2:172.21.15.187:3300/0 conn(0x7f2bc015d360 0x7f2bc006a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.957+0000 7f2bc6093640 1 -- 172.21.15.132:0/1238204040 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bc0070a40 con 0x7f2bc0069c30 2023-12-20T04:44:17.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.958+0000 7f2bc6093640 1 --2- 172.21.15.132:0/1238204040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bc0069c30 0x7f2bc0070460 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00b5dc0 tx=0x7f2bbc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9df2af0d57bceff6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:17.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.958+0000 7f2bc5091640 1 -- 172.21.15.132:0/1238204040 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc031870 con 0x7f2bc0069c30 2023-12-20T04:44:17.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.958+0000 7f2bc5091640 1 -- 172.21.15.132:0/1238204040 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc0319d0 con 0x7f2bc0069c30 2023-12-20T04:44:17.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.958+0000 7f2bc5091640 1 -- 172.21.15.132:0/1238204040 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc031d60 con 0x7f2bc0069c30 2023-12-20T04:44:17.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.958+0000 7f2bc82f7640 1 -- 172.21.15.132:0/1238204040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bc0069c30 msgr2=0x7f2bc0070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.958+0000 7f2bc82f7640 1 --2- 172.21.15.132:0/1238204040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bc0069c30 0x7f2bc0070460 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7f2bc00b5dc0 tx=0x7f2bbc02b910 comp rx=0 tx=0).stop 2023-12-20T04:44:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.958+0000 7f2bc82f7640 1 -- 172.21.15.132:0/1238204040 shutdown_connections 2023-12-20T04:44:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.958+0000 7f2bc82f7640 1 --2- 172.21.15.132:0/1238204040 >> v2:172.21.15.187:3300/0 conn(0x7f2bc015d360 0x7f2bc006a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.958+0000 7f2bc82f7640 1 --2- 172.21.15.132:0/1238204040 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc00cbde0 0x7f2bc00ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.958+0000 7f2bc82f7640 1 --2- 172.21.15.132:0/1238204040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bc0069c30 0x7f2bc0070460 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.958+0000 7f2bc82f7640 1 -- 172.21.15.132:0/1238204040 >> 172.21.15.132:0/1238204040 conn(0x7f2bc00cc630 msgr2=0x7f2bc00cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.959+0000 7f2bc82f7640 1 -- 172.21.15.132:0/1238204040 shutdown_connections 2023-12-20T04:44:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.959+0000 7f2bc82f7640 1 -- 172.21.15.132:0/1238204040 wait complete. 2023-12-20T04:44:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.960+0000 7f2bc82f7640 1 Processor -- start 2023-12-20T04:44:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.960+0000 7f2bc82f7640 1 -- start start 2023-12-20T04:44:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.960+0000 7f2bc82f7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bc0069c30 0x7f2bc006e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.960+0000 7f2bc82f7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc00cbde0 0x7f2bc015f6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.960+0000 7f2bc82f7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc015d360 0x7f2bc015fc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.960+0000 7f2bc82f7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc0158d70 con 0x7f2bc0069c30 2023-12-20T04:44:17.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.960+0000 7f2bc82f7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc006e8b0 con 0x7f2bc015d360 2023-12-20T04:44:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.960+0000 7f2bc82f7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2bc006df40 con 0x7f2bc00cbde0 2023-12-20T04:44:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.960+0000 7f2bc6093640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bc0069c30 0x7f2bc006e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.960+0000 7f2bc6093640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bc0069c30 0x7f2bc006e370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56834/0 (socket says 172.21.15.132:56834) 2023-12-20T04:44:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.960+0000 7f2bc6093640 1 -- 172.21.15.132:0/1786247883 learned_addr learned my addr 172.21.15.132:0/1786247883 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.961+0000 7f2bc6093640 1 -- 172.21.15.132:0/1786247883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc00cbde0 msgr2=0x7f2bc015f6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.961+0000 7f2bc6093640 1 --2- 172.21.15.132:0/1786247883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc00cbde0 0x7f2bc015f6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.961+0000 7f2bc6093640 1 -- 172.21.15.132:0/1786247883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc015d360 msgr2=0x7f2bc015fc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.961+0000 7f2bc6093640 1 --2- 172.21.15.132:0/1786247883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc015d360 0x7f2bc015fc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.961+0000 7f2bc6093640 1 -- 172.21.15.132:0/1786247883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2bbc0094d0 con 0x7f2bc0069c30 2023-12-20T04:44:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.961+0000 7f2bc6093640 1 --2- 172.21.15.132:0/1786247883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bc0069c30 0x7f2bc006e370 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc000c00 tx=0x7f2bbc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.961+0000 7f2bb6ffd640 1 -- 172.21.15.132:0/1786247883 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc03ad10 con 0x7f2bc0069c30 2023-12-20T04:44:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.961+0000 7f2bb6ffd640 1 -- 172.21.15.132:0/1786247883 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2bbc03ae90 con 0x7f2bc0069c30 2023-12-20T04:44:17.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.961+0000 7f2bc82f7640 1 -- 172.21.15.132:0/1786247883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2bc006d180 con 0x7f2bc0069c30 2023-12-20T04:44:17.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.961+0000 7f2bb6ffd640 1 -- 172.21.15.132:0/1786247883 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2bbc044630 con 0x7f2bc0069c30 2023-12-20T04:44:17.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.961+0000 7f2bc82f7640 1 -- 172.21.15.132:0/1786247883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2bc006d740 con 0x7f2bc0069c30 2023-12-20T04:44:17.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.962+0000 7f2bc82f7640 1 -- 172.21.15.132:0/1786247883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2bc004e840 con 0x7f2bc0069c30 2023-12-20T04:44:17.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.962+0000 7f2bb6ffd640 1 -- 172.21.15.132:0/1786247883 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2bbc044790 con 0x7f2bc0069c30 2023-12-20T04:44:17.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.963+0000 7f2bb6ffd640 1 --2- 172.21.15.132:0/1786247883 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ba406a430 0x7f2ba406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:17.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.963+0000 7f2bc5892640 1 --2- 172.21.15.132:0/1786247883 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ba406a430 0x7f2ba406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:17.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.963+0000 7f2bb6ffd640 1 -- 172.21.15.132:0/1786247883 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(46..46 src has 1..46) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2bbc02d040 con 0x7f2bc0069c30 2023-12-20T04:44:17.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.963+0000 7f2bc5892640 1 --2- 172.21.15.132:0/1786247883 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ba406a430 0x7f2ba406c8f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2bc01f5930 tx=0x7f2bb0006bf0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:17.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:17.967+0000 7f2bb6ffd640 1 -- 172.21.15.132:0/1786247883 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2bbc076810 con 0x7f2bc0069c30 2023-12-20T04:44:18.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.167+0000 7f2bc82f7640 1 -- 172.21.15.132:0/1786247883 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f2bc006eae0 con 0x7f2bc0069c30 2023-12-20T04:44:18.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.205+0000 7f2bb6ffd640 1 -- 172.21.15.132:0/1786247883 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v18) v1 ==== 118+0+0 (secure 0 0 0) 0x7f2bbc079e30 con 0x7f2bc0069c30 2023-12-20T04:44:18.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.207+0000 7f2bc82f7640 1 -- 172.21.15.132:0/1786247883 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ba406a430 msgr2=0x7f2ba406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:18.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.207+0000 7f2bc82f7640 1 --2- 172.21.15.132:0/1786247883 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ba406a430 0x7f2ba406c8f0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f2bc01f5930 tx=0x7f2bb0006bf0 comp rx=0 tx=0).stop 2023-12-20T04:44:18.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.207+0000 7f2bc82f7640 1 -- 172.21.15.132:0/1786247883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bc0069c30 msgr2=0x7f2bc006e370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:18.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.207+0000 7f2bc82f7640 1 --2- 172.21.15.132:0/1786247883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bc0069c30 0x7f2bc006e370 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f2bbc000c00 tx=0x7f2bbc0046c0 comp rx=0 tx=0).stop 2023-12-20T04:44:18.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.207+0000 7f2bc82f7640 1 -- 172.21.15.132:0/1786247883 shutdown_connections 2023-12-20T04:44:18.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.207+0000 7f2bc82f7640 1 --2- 172.21.15.132:0/1786247883 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ba406a430 0x7f2ba406c8f0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:18.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.207+0000 7f2bc82f7640 1 --2- 172.21.15.132:0/1786247883 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2bc015d360 0x7f2bc015fc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:18.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.207+0000 7f2bc82f7640 1 --2- 172.21.15.132:0/1786247883 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2bc00cbde0 0x7f2bc015f6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:18.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.207+0000 7f2bc82f7640 1 --2- 172.21.15.132:0/1786247883 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2bc0069c30 0x7f2bc006e370 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:18.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.207+0000 7f2bc82f7640 1 -- 172.21.15.132:0/1786247883 >> 172.21.15.132:0/1786247883 conn(0x7f2bc00cc630 msgr2=0x7f2bc00b0ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:18.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.207+0000 7f2bc82f7640 1 -- 172.21.15.132:0/1786247883 shutdown_connections 2023-12-20T04:44:18.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.207+0000 7f2bc82f7640 1 -- 172.21.15.132:0/1786247883 wait complete. 2023-12-20T04:44:18.220 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-20T04:44:18.220 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-20T04:44:18.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.321+0000 7f9c85896640 1 Processor -- start 2023-12-20T04:44:18.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.321+0000 7f9c85896640 1 -- start start 2023-12-20T04:44:18.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c85896640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c800cfc40 0x7f9c800b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:18.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c85896640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c800d2920 con 0x7f9c8015d300 2023-12-20T04:44:18.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c85896640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c800d1d10 con 0x7f9c800cf790 2023-12-20T04:44:18.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c85896640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c800d1ff0 con 0x7f9c800cfc40 2023-12-20T04:44:18.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9c8015d300 0x7f9c800d1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46840/0 (socket says 172.21.15.132:46840) 2023-12-20T04:44:18.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7effd640 1 -- 172.21.15.132:0/1729922887 learned_addr learned my addr 172.21.15.132:0/1729922887 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:18.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7e7fc640 1 -- 172.21.15.132:0/1729922887 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1766296801 0 0) 0x7f9c800d2920 con 0x7f9c8015d300 2023-12-20T04:44:18.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7e7fc640 1 -- 172.21.15.132:0/1729922887 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c6c003520 con 0x7f9c8015d300 2023-12-20T04:44:18.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7f7fe640 1 --2- 172.21.15.132:0/1729922887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c800cfc40 0x7f9c800b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:18.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7e7fc640 1 -- 172.21.15.132:0/1729922887 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3979653639 0 0) 0x7f9c6c003520 con 0x7f9c8015d300 2023-12-20T04:44:18.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7e7fc640 1 -- 172.21.15.132:0/1729922887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c800cfc40 msgr2=0x7f9c800b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:18.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7e7fc640 1 --2- 172.21.15.132:0/1729922887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c800cfc40 0x7f9c800b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:18.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7e7fc640 1 -- 172.21.15.132:0/1729922887 >> v1:172.21.15.187:6789/0 conn(0x7f9c800cf790 legacy=0x7f9c800b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:18.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7e7fc640 1 -- 172.21.15.132:0/1729922887 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c800d22d0 con 0x7f9c8015d300 2023-12-20T04:44:18.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7e7fc640 1 -- 172.21.15.132:0/1729922887 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f9c70001670 con 0x7f9c8015d300 2023-12-20T04:44:18.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7e7fc640 1 -- 172.21.15.132:0/1729922887 >> v1:172.21.15.132:6789/0 conn(0x7f9c8015d300 legacy=0x7f9c800d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:18.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7e7fc640 1 --2- 172.21.15.132:0/1729922887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c6c0039a0 0x7f9c6c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:18.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7e7fc640 1 --2- 172.21.15.132:0/1729922887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c6c0047c0 0x7f9c6c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:18.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7e7fc640 1 --2- 172.21.15.132:0/1729922887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c800cfc40 0x7f9c6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:18.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7e7fc640 1 -- 172.21.15.132:0/1729922887 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c800d1ff0 con 0x7f9c6c0047c0 2023-12-20T04:44:18.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7e7fc640 1 -- 172.21.15.132:0/1729922887 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c00ba30 con 0x7f9c6c0039a0 2023-12-20T04:44:18.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.322+0000 7f9c7e7fc640 1 -- 172.21.15.132:0/1729922887 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c6c00bbf0 con 0x7f9c800cfc40 2023-12-20T04:44:18.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.323+0000 7f9c77fff640 1 --2- 172.21.15.132:0/1729922887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c6c0047c0 0x7f9c6c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:18.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.323+0000 7f9c7effd640 1 --2- 172.21.15.132:0/1729922887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c6c0039a0 0x7f9c6c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:18.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.323+0000 7f9c7f7fe640 1 --2- 172.21.15.132:0/1729922887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c800cfc40 0x7f9c6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:18.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.323+0000 7f9c77fff640 1 -- 172.21.15.132:0/1729922887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c800cfc40 msgr2=0x7f9c6c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:18.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.323+0000 7f9c77fff640 1 --2- 172.21.15.132:0/1729922887 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c800cfc40 0x7f9c6c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:18.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.323+0000 7f9c77fff640 1 -- 172.21.15.132:0/1729922887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c6c0039a0 msgr2=0x7f9c6c003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:18.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.323+0000 7f9c77fff640 1 --2- 172.21.15.132:0/1729922887 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c6c0039a0 0x7f9c6c003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:18.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.323+0000 7f9c77fff640 1 -- 172.21.15.132:0/1729922887 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c6c003520 con 0x7f9c6c0047c0 2023-12-20T04:44:18.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.324+0000 7f9c77fff640 1 --2- 172.21.15.132:0/1729922887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c6c0047c0 0x7f9c6c004c40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9c68001720 tx=0x7f9c6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c230870ef726cd5e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:18.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.324+0000 7f9c7e7fc640 1 -- 172.21.15.132:0/1729922887 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c680052d0 con 0x7f9c6c0047c0 2023-12-20T04:44:18.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.324+0000 7f9c7e7fc640 1 -- 172.21.15.132:0/1729922887 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c6802e050 con 0x7f9c6c0047c0 2023-12-20T04:44:18.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.324+0000 7f9c7e7fc640 1 -- 172.21.15.132:0/1729922887 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c680035f0 con 0x7f9c6c0047c0 2023-12-20T04:44:18.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.324+0000 7f9c85896640 1 -- 172.21.15.132:0/1729922887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c6c0047c0 msgr2=0x7f9c6c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:18.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.324+0000 7f9c85896640 1 --2- 172.21.15.132:0/1729922887 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c6c0047c0 0x7f9c6c004c40 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f9c68001720 tx=0x7f9c6c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:18.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.324+0000 7f9c7f7fe640 1 -- 172.21.15.132:0/1729922887 reap_dead start 2023-12-20T04:44:18.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.324+0000 7f9c85896640 1 -- 172.21.15.132:0/1729922887 shutdown_connections 2023-12-20T04:44:18.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.324+0000 7f9c85896640 1 -- 172.21.15.132:0/1729922887 >> 172.21.15.132:0/1729922887 conn(0x7f9c8006a3d0 msgr2=0x7f9c8006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:18.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.324+0000 7f9c85896640 1 -- 172.21.15.132:0/1729922887 shutdown_connections 2023-12-20T04:44:18.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.324+0000 7f9c85896640 1 -- 172.21.15.132:0/1729922887 wait complete. 2023-12-20T04:44:18.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.325+0000 7f9c85896640 1 Processor -- start 2023-12-20T04:44:18.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.326+0000 7f9c85896640 1 -- start start 2023-12-20T04:44:18.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.326+0000 7f9c85896640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c6c0047c0 0x7f9c80153150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:18.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.326+0000 7f9c85896640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c80155b90 0x7f9c801f3df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:18.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.326+0000 7f9c85896640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c80156010 0x7f9c801f3230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:18.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.326+0000 7f9c85896640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c801f2e10 con 0x7f9c6c0047c0 2023-12-20T04:44:18.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.326+0000 7f9c85896640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c80156500 con 0x7f9c80155b90 2023-12-20T04:44:18.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.326+0000 7f9c85896640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c801567e0 con 0x7f9c80156010 2023-12-20T04:44:18.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.326+0000 7f9c7effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c6c0047c0 0x7f9c80153150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:18.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.326+0000 7f9c7effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c6c0047c0 0x7f9c80153150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56860/0 (socket says 172.21.15.132:56860) 2023-12-20T04:44:18.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.326+0000 7f9c7effd640 1 -- 172.21.15.132:0/3395875753 learned_addr learned my addr 172.21.15.132:0/3395875753 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:18.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.327+0000 7f9c77fff640 1 --2- 172.21.15.132:0/3395875753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c80155b90 0x7f9c801f3df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:18.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.327+0000 7f9c7f7fe640 1 --2- 172.21.15.132:0/3395875753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c80156010 0x7f9c801f3230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:18.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.327+0000 7f9c7effd640 1 -- 172.21.15.132:0/3395875753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c80156010 msgr2=0x7f9c801f3230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:18.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.327+0000 7f9c7effd640 1 --2- 172.21.15.132:0/3395875753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c80156010 0x7f9c801f3230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:18.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.327+0000 7f9c7effd640 1 -- 172.21.15.132:0/3395875753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c80155b90 msgr2=0x7f9c801f3df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:18.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.327+0000 7f9c7effd640 1 --2- 172.21.15.132:0/3395875753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c80155b90 0x7f9c801f3df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:18.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.327+0000 7f9c7effd640 1 -- 172.21.15.132:0/3395875753 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c801f2a30 con 0x7f9c6c0047c0 2023-12-20T04:44:18.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.327+0000 7f9c77fff640 1 --2- 172.21.15.132:0/3395875753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c80155b90 0x7f9c801f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:18.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.327+0000 7f9c7effd640 1 --2- 172.21.15.132:0/3395875753 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c6c0047c0 0x7f9c80153150 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9c70007290 tx=0x7f9c70007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:18.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.327+0000 7f9c7cff9640 1 -- 172.21.15.132:0/3395875753 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c700016a0 con 0x7f9c6c0047c0 2023-12-20T04:44:18.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.327+0000 7f9c7cff9640 1 -- 172.21.15.132:0/3395875753 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c7000f9c0 con 0x7f9c6c0047c0 2023-12-20T04:44:18.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.327+0000 7f9c85896640 1 -- 172.21.15.132:0/3395875753 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c80156ac0 con 0x7f9c6c0047c0 2023-12-20T04:44:18.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.327+0000 7f9c7cff9640 1 -- 172.21.15.132:0/3395875753 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c7000fd70 con 0x7f9c6c0047c0 2023-12-20T04:44:18.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.327+0000 7f9c85896640 1 -- 172.21.15.132:0/3395875753 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c801f6220 con 0x7f9c6c0047c0 2023-12-20T04:44:18.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.328+0000 7f9c85896640 1 -- 172.21.15.132:0/3395875753 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8004e840 con 0x7f9c6c0047c0 2023-12-20T04:44:18.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.328+0000 7f9c7cff9640 1 -- 172.21.15.132:0/3395875753 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9c7001d460 con 0x7f9c6c0047c0 2023-12-20T04:44:18.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.329+0000 7f9c7cff9640 1 --2- 172.21.15.132:0/3395875753 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c6006a460 0x7f9c6006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:18.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.329+0000 7f9c7cff9640 1 -- 172.21.15.132:0/3395875753 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9c70088990 con 0x7f9c6c0047c0 2023-12-20T04:44:18.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.329+0000 7f9c77fff640 1 --2- 172.21.15.132:0/3395875753 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c6006a460 0x7f9c6006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:18.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.329+0000 7f9c77fff640 1 --2- 172.21.15.132:0/3395875753 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c6006a460 0x7f9c6006c920 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9c68033000 tx=0x7f9c68009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:18.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.333+0000 7f9c7cff9640 1 -- 172.21.15.132:0/3395875753 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9c70053f80 con 0x7f9c6c0047c0 2023-12-20T04:44:18.357 INFO:tasks.ceph.mds.c.smithi132.stderr:2023-12-20T04:44:18.356+0000 7f4f79201640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:44:18.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:18.536+0000 7f9c85896640 1 -- 172.21.15.132:0/3395875753 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f9c800c9c00 con 0x7f9c6c0047c0 2023-12-20T04:44:19.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.207+0000 7f9c7cff9640 1 -- 172.21.15.132:0/3395875753 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v19) v1 ==== 122+0+0 (secure 0 0 0) 0x7f9c700575a0 con 0x7f9c6c0047c0 2023-12-20T04:44:19.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.209+0000 7f9c85896640 1 -- 172.21.15.132:0/3395875753 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c6006a460 msgr2=0x7f9c6006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.209+0000 7f9c85896640 1 --2- 172.21.15.132:0/3395875753 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c6006a460 0x7f9c6006c920 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9c68033000 tx=0x7f9c68009030 comp rx=0 tx=0).stop 2023-12-20T04:44:19.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.209+0000 7f9c85896640 1 -- 172.21.15.132:0/3395875753 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c6c0047c0 msgr2=0x7f9c80153150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.209+0000 7f9c85896640 1 --2- 172.21.15.132:0/3395875753 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c6c0047c0 0x7f9c80153150 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f9c70007290 tx=0x7f9c70007750 comp rx=0 tx=0).stop 2023-12-20T04:44:19.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.209+0000 7f9c85896640 1 -- 172.21.15.132:0/3395875753 shutdown_connections 2023-12-20T04:44:19.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.209+0000 7f9c85896640 1 --2- 172.21.15.132:0/3395875753 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c6006a460 0x7f9c6006c920 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.209+0000 7f9c85896640 1 --2- 172.21.15.132:0/3395875753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c80156010 0x7f9c801f3230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.209+0000 7f9c85896640 1 --2- 172.21.15.132:0/3395875753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c80155b90 0x7f9c801f3df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.209+0000 7f9c85896640 1 --2- 172.21.15.132:0/3395875753 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c6c0047c0 0x7f9c80153150 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.209+0000 7f9c85896640 1 -- 172.21.15.132:0/3395875753 >> 172.21.15.132:0/3395875753 conn(0x7f9c8006a3d0 msgr2=0x7f9c8015be60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:19.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.209+0000 7f9c85896640 1 -- 172.21.15.132:0/3395875753 shutdown_connections 2023-12-20T04:44:19.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.209+0000 7f9c85896640 1 -- 172.21.15.132:0/3395875753 wait complete. 2023-12-20T04:44:19.223 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-20T04:44:19.224 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:44:19.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.325+0000 7f7652363640 1 Processor -- start 2023-12-20T04:44:19.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.325+0000 7f7652363640 1 -- start start 2023-12-20T04:44:19.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.326+0000 7f7652363640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f764c0b16b0 0x7f764c06c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.326+0000 7f7652363640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c15f3a0 con 0x7f764c15aed0 2023-12-20T04:44:19.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.326+0000 7f7652363640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f764c15eae0 con 0x7f764c0cb180 2023-12-20T04:44:19.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.326+0000 7f7652363640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c071c90 con 0x7f764c0b16b0 2023-12-20T04:44:19.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.326+0000 7f764bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f764c15aed0 0x7f764c0b0fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46846/0 (socket says 172.21.15.132:46846) 2023-12-20T04:44:19.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.326+0000 7f764bfff640 1 -- 172.21.15.132:0/3687787787 learned_addr learned my addr 172.21.15.132:0/3687787787 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:19.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.326+0000 7f764affd640 1 -- 172.21.15.132:0/3687787787 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1821100366 0 0) 0x7f764c15f3a0 con 0x7f764c15aed0 2023-12-20T04:44:19.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.326+0000 7f764affd640 1 -- 172.21.15.132:0/3687787787 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7634003520 con 0x7f764c15aed0 2023-12-20T04:44:19.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.326+0000 7f764b7fe640 1 --2- 172.21.15.132:0/3687787787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f764c0b16b0 0x7f764c06c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764affd640 1 -- 172.21.15.132:0/3687787787 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1213293867 0 0) 0x7f7634003520 con 0x7f764c15aed0 2023-12-20T04:44:19.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764affd640 1 -- 172.21.15.132:0/3687787787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f764c0b16b0 msgr2=0x7f764c06c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:19.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764affd640 1 --2- 172.21.15.132:0/3687787787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f764c0b16b0 0x7f764c06c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764affd640 1 -- 172.21.15.132:0/3687787787 >> v1:172.21.15.187:6789/0 conn(0x7f764c0cb180 legacy=0x7f764c0cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764affd640 1 -- 172.21.15.132:0/3687787787 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c15ed50 con 0x7f764c15aed0 2023-12-20T04:44:19.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764affd640 1 -- 172.21.15.132:0/3687787787 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f763c001670 con 0x7f764c15aed0 2023-12-20T04:44:19.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764affd640 1 -- 172.21.15.132:0/3687787787 >> v1:172.21.15.132:6789/0 conn(0x7f764c15aed0 legacy=0x7f764c0b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764affd640 1 --2- 172.21.15.132:0/3687787787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76340039a0 0x7f7634003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764affd640 1 --2- 172.21.15.132:0/3687787787 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76340047c0 0x7f7634004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764affd640 1 --2- 172.21.15.132:0/3687787787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f764c0b16b0 0x7f7634005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764affd640 1 -- 172.21.15.132:0/3687787787 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c071c90 con 0x7f76340047c0 2023-12-20T04:44:19.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764affd640 1 -- 172.21.15.132:0/3687787787 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f763400ba60 con 0x7f76340039a0 2023-12-20T04:44:19.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764affd640 1 -- 172.21.15.132:0/3687787787 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f763400bc20 con 0x7f764c0b16b0 2023-12-20T04:44:19.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764b7fe640 1 --2- 172.21.15.132:0/3687787787 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76340047c0 0x7f7634004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764bfff640 1 --2- 172.21.15.132:0/3687787787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76340039a0 0x7f7634003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f7650900640 1 --2- 172.21.15.132:0/3687787787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f764c0b16b0 0x7f7634005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764b7fe640 1 -- 172.21.15.132:0/3687787787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f764c0b16b0 msgr2=0x7f7634005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:19.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764b7fe640 1 --2- 172.21.15.132:0/3687787787 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f764c0b16b0 0x7f7634005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764b7fe640 1 -- 172.21.15.132:0/3687787787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76340039a0 msgr2=0x7f7634003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:19.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764b7fe640 1 --2- 172.21.15.132:0/3687787787 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76340039a0 0x7f7634003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.327+0000 7f764b7fe640 1 -- 172.21.15.132:0/3687787787 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7634003520 con 0x7f76340047c0 2023-12-20T04:44:19.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.328+0000 7f764b7fe640 1 --2- 172.21.15.132:0/3687787787 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76340047c0 0x7f7634004c40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7640009a90 tx=0x7f76340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e74714443b150e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:19.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.328+0000 7f764affd640 1 -- 172.21.15.132:0/3687787787 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764002c680 con 0x7f76340047c0 2023-12-20T04:44:19.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.328+0000 7f764affd640 1 -- 172.21.15.132:0/3687787787 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764002c7e0 con 0x7f76340047c0 2023-12-20T04:44:19.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.328+0000 7f764affd640 1 -- 172.21.15.132:0/3687787787 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764002cb70 con 0x7f76340047c0 2023-12-20T04:44:19.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.328+0000 7f7652363640 1 -- 172.21.15.132:0/3687787787 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76340047c0 msgr2=0x7f7634004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.328+0000 7f7652363640 1 --2- 172.21.15.132:0/3687787787 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76340047c0 0x7f7634004c40 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f7640009a90 tx=0x7f76340057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.328+0000 7f7650900640 1 -- 172.21.15.132:0/3687787787 reap_dead start 2023-12-20T04:44:19.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.328+0000 7f7652363640 1 -- 172.21.15.132:0/3687787787 shutdown_connections 2023-12-20T04:44:19.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.328+0000 7f7652363640 1 -- 172.21.15.132:0/3687787787 >> 172.21.15.132:0/3687787787 conn(0x7f764c06a050 msgr2=0x7f764c06a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:19.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.328+0000 7f7652363640 1 -- 172.21.15.132:0/3687787787 shutdown_connections 2023-12-20T04:44:19.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.328+0000 7f7652363640 1 -- 172.21.15.132:0/3687787787 wait complete. 2023-12-20T04:44:19.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.330+0000 7f7652363640 1 Processor -- start 2023-12-20T04:44:19.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.330+0000 7f7652363640 1 -- start start 2023-12-20T04:44:19.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.330+0000 7f7652363640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76340047c0 0x7f764c1539b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.330+0000 7f7652363640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f764c153ef0 0x7f764c157120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.330+0000 7f7652363640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f764c157660 0x7f764c15da50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.330+0000 7f7652363640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c157ae0 con 0x7f764c153ef0 2023-12-20T04:44:19.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.330+0000 7f7652363640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764c152e50 con 0x7f76340047c0 2023-12-20T04:44:19.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.330+0000 7f7652363640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764c15cc90 con 0x7f764c157660 2023-12-20T04:44:19.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.331+0000 7f764b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f764c153ef0 0x7f764c157120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.331+0000 7f764b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f764c153ef0 0x7f764c157120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56884/0 (socket says 172.21.15.132:56884) 2023-12-20T04:44:19.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.331+0000 7f764b7fe640 1 -- 172.21.15.132:0/3589272021 learned_addr learned my addr 172.21.15.132:0/3589272021 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:19.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.331+0000 7f764b7fe640 1 -- 172.21.15.132:0/3589272021 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f764c157660 msgr2=0x7f764c15da50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.331+0000 7f764b7fe640 1 --2- 172.21.15.132:0/3589272021 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f764c157660 0x7f764c15da50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.331+0000 7f764b7fe640 1 -- 172.21.15.132:0/3589272021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76340047c0 msgr2=0x7f764c1539b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.331+0000 7f764bfff640 1 --2- 172.21.15.132:0/3589272021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76340047c0 0x7f764c1539b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.331+0000 7f764b7fe640 1 --2- 172.21.15.132:0/3589272021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76340047c0 0x7f764c1539b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.331+0000 7f764b7fe640 1 -- 172.21.15.132:0/3589272021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f764c15cf70 con 0x7f764c153ef0 2023-12-20T04:44:19.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.331+0000 7f764b7fe640 1 --2- 172.21.15.132:0/3589272021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f764c153ef0 0x7f764c157120 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f764002c220 tx=0x7f7640004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:19.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.331+0000 7f7648ff9640 1 -- 172.21.15.132:0/3589272021 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640003810 con 0x7f764c153ef0 2023-12-20T04:44:19.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.331+0000 7f7648ff9640 1 -- 172.21.15.132:0/3589272021 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7640003970 con 0x7f764c153ef0 2023-12-20T04:44:19.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.331+0000 7f7648ff9640 1 -- 172.21.15.132:0/3589272021 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7640003ce0 con 0x7f764c153ef0 2023-12-20T04:44:19.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.331+0000 7f7652363640 1 -- 172.21.15.132:0/3589272021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764c15d250 con 0x7f764c153ef0 2023-12-20T04:44:19.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.331+0000 7f7652363640 1 -- 172.21.15.132:0/3589272021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764c154520 con 0x7f764c153ef0 2023-12-20T04:44:19.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.332+0000 7f7652363640 1 -- 172.21.15.132:0/3589272021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764c066820 con 0x7f764c153ef0 2023-12-20T04:44:19.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.333+0000 7f7648ff9640 1 -- 172.21.15.132:0/3589272021 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7640034440 con 0x7f764c153ef0 2023-12-20T04:44:19.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.333+0000 7f7648ff9640 1 --2- 172.21.15.132:0/3589272021 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f763806a460 0x7f763806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.333+0000 7f7648ff9640 1 -- 172.21.15.132:0/3589272021 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76400aa850 con 0x7f764c153ef0 2023-12-20T04:44:19.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.333+0000 7f764bfff640 1 --2- 172.21.15.132:0/3589272021 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f763806a460 0x7f763806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.333+0000 7f764bfff640 1 --2- 172.21.15.132:0/3589272021 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f763806a460 0x7f763806c920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f763c007c60 tx=0x7f763c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:19.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.337+0000 7f7648ff9640 1 -- 172.21.15.132:0/3589272021 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7640076010 con 0x7f764c153ef0 2023-12-20T04:44:19.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.543+0000 7f7652363640 1 -- 172.21.15.132:0/3589272021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f764c0caff0 con 0x7f764c153ef0 2023-12-20T04:44:19.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.543+0000 7f7648ff9640 1 -- 172.21.15.132:0/3589272021 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4721 (secure 0 0 0) 0x7f764004c090 con 0x7f764c153ef0 2023-12-20T04:44:19.545 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:19.545 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1456944733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1456944733},{"type":"v1","addr":"172.21.15.187:6834","nonce":1456944733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2114954856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2114954856},{"type":"v1","addr":"172.21.15.187:6835","nonce":2114954856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2494230497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2494230497},{"type":"v1","addr":"172.21.15.132:6837","nonce":2494230497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:44:17.197194+0000","modified":"2023-12-20T04:44:19.205156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/1024674556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1024674556},{"type":"v1","addr":"172.21.15.132:6836","nonce":1024674556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-20T04:44:19.546 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 19 2023-12-20T04:44:19.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.545+0000 7f7652363640 1 -- 172.21.15.132:0/3589272021 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f763806a460 msgr2=0x7f763806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.545+0000 7f7652363640 1 --2- 172.21.15.132:0/3589272021 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f763806a460 0x7f763806c920 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f763c007c60 tx=0x7f763c009040 comp rx=0 tx=0).stop 2023-12-20T04:44:19.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.545+0000 7f7652363640 1 -- 172.21.15.132:0/3589272021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f764c153ef0 msgr2=0x7f764c157120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.545+0000 7f7652363640 1 --2- 172.21.15.132:0/3589272021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f764c153ef0 0x7f764c157120 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f764002c220 tx=0x7f7640004730 comp rx=0 tx=0).stop 2023-12-20T04:44:19.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.545+0000 7f7652363640 1 -- 172.21.15.132:0/3589272021 shutdown_connections 2023-12-20T04:44:19.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.545+0000 7f7652363640 1 --2- 172.21.15.132:0/3589272021 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f763806a460 0x7f763806c920 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.545+0000 7f7652363640 1 --2- 172.21.15.132:0/3589272021 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f764c157660 0x7f764c15da50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.545+0000 7f7652363640 1 --2- 172.21.15.132:0/3589272021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f764c153ef0 0x7f764c157120 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.545+0000 7f7652363640 1 --2- 172.21.15.132:0/3589272021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76340047c0 0x7f764c1539b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.545+0000 7f7652363640 1 -- 172.21.15.132:0/3589272021 >> 172.21.15.132:0/3589272021 conn(0x7f764c06a050 msgr2=0x7f764c0c54f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:19.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.545+0000 7f7652363640 1 -- 172.21.15.132:0/3589272021 shutdown_connections 2023-12-20T04:44:19.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.545+0000 7f7652363640 1 -- 172.21.15.132:0/3589272021 wait complete. 2023-12-20T04:44:19.558 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:44:19.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.655+0000 7f4897a96640 1 Processor -- start 2023-12-20T04:44:19.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.656+0000 7f4897a96640 1 -- start start 2023-12-20T04:44:19.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.656+0000 7f4897a96640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f489015a3a0 0x7f489006c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.656+0000 7f4897a96640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489015aa30 con 0x7f48900c92d0 2023-12-20T04:44:19.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.656+0000 7f4897a96640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f489015a7b0 con 0x7f489013cce0 2023-12-20T04:44:19.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.656+0000 7f4897a96640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f489006b260 con 0x7f489015a3a0 2023-12-20T04:44:19.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.657+0000 7f4896033640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f489015a3a0 0x7f489006c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.657+0000 7f4895832640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f48900c92d0 0x7f48900c96b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46862/0 (socket says 172.21.15.132:46862) 2023-12-20T04:44:19.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.657+0000 7f4895832640 1 -- 172.21.15.132:0/209941144 learned_addr learned my addr 172.21.15.132:0/209941144 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:19.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.657+0000 7f4896033640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f489015a3a0 0x7f489006c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56900/0 (socket says 172.21.15.132:56900) 2023-12-20T04:44:19.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.657+0000 7f4896033640 1 -- 172.21.15.132:0/209941144 >> v1:172.21.15.187:6789/0 conn(0x7f489013cce0 legacy=0x7f4890159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:19.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.657+0000 7f4894830640 1 -- 172.21.15.132:0/209941144 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2304403035 0 0) 0x7f489015aa30 con 0x7f48900c92d0 2023-12-20T04:44:19.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.657+0000 7f4896033640 1 -- 172.21.15.132:0/209941144 >> v1:172.21.15.132:6789/0 conn(0x7f48900c92d0 legacy=0x7f48900c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.657+0000 7f4896033640 1 -- 172.21.15.132:0/209941144 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f489006b540 con 0x7f489015a3a0 2023-12-20T04:44:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.658+0000 7f4896033640 1 --2- 172.21.15.132:0/209941144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f489015a3a0 0x7f489006c020 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4888009d90 tx=0x7f488802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13ab70abea36eb8c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.658+0000 7f4894830640 1 -- 172.21.15.132:0/209941144 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488802cc60 con 0x7f489015a3a0 2023-12-20T04:44:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.658+0000 7f4894830640 1 -- 172.21.15.132:0/209941144 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488802cdc0 con 0x7f489015a3a0 2023-12-20T04:44:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.658+0000 7f4894830640 1 -- 172.21.15.132:0/209941144 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4888034660 con 0x7f489015a3a0 2023-12-20T04:44:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.658+0000 7f4897a96640 1 -- 172.21.15.132:0/209941144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f489015a3a0 msgr2=0x7f489006c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.658+0000 7f4897a96640 1 --2- 172.21.15.132:0/209941144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f489015a3a0 0x7f489006c020 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f4888009d90 tx=0x7f488802beb0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.658+0000 7f4897a96640 1 -- 172.21.15.132:0/209941144 shutdown_connections 2023-12-20T04:44:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.658+0000 7f4897a96640 1 --2- 172.21.15.132:0/209941144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f489015a3a0 0x7f489006c020 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.658+0000 7f4897a96640 1 -- 172.21.15.132:0/209941144 >> 172.21.15.132:0/209941144 conn(0x7f48900ced10 msgr2=0x7f48900cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.659+0000 7f4897a96640 1 -- 172.21.15.132:0/209941144 shutdown_connections 2023-12-20T04:44:19.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.659+0000 7f4897a96640 1 -- 172.21.15.132:0/209941144 wait complete. 2023-12-20T04:44:19.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.660+0000 7f4897a96640 1 Processor -- start 2023-12-20T04:44:19.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.660+0000 7f4897a96640 1 -- start start 2023-12-20T04:44:19.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.660+0000 7f4897a96640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48900c92d0 0x7f4890153290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.660+0000 7f4897a96640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f489013cce0 0x7f48900c7a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.660+0000 7f4897a96640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f489015a3a0 0x7f48900cd590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.660+0000 7f4897a96640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4890154190 con 0x7f489013cce0 2023-12-20T04:44:19.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.660+0000 7f4897a96640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48901537d0 con 0x7f489015a3a0 2023-12-20T04:44:19.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.660+0000 7f4897a96640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4890153eb0 con 0x7f48900c92d0 2023-12-20T04:44:19.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.660+0000 7f4895031640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f489013cce0 0x7f48900c7a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.660+0000 7f4895031640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f489013cce0 0x7f48900c7a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56904/0 (socket says 172.21.15.132:56904) 2023-12-20T04:44:19.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.660+0000 7f4895031640 1 -- 172.21.15.132:0/1046464274 learned_addr learned my addr 172.21.15.132:0/1046464274 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:19.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.661+0000 7f4896033640 1 --2- 172.21.15.132:0/1046464274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f489015a3a0 0x7f48900cd590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.661+0000 7f4895832640 1 --2- 172.21.15.132:0/1046464274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48900c92d0 0x7f4890153290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.661+0000 7f4895031640 1 -- 172.21.15.132:0/1046464274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48900c92d0 msgr2=0x7f4890153290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.661+0000 7f4895031640 1 --2- 172.21.15.132:0/1046464274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48900c92d0 0x7f4890153290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.661+0000 7f4895031640 1 -- 172.21.15.132:0/1046464274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f489015a3a0 msgr2=0x7f48900cd590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.661+0000 7f4895031640 1 --2- 172.21.15.132:0/1046464274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f489015a3a0 0x7f48900cd590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.661+0000 7f4895031640 1 -- 172.21.15.132:0/1046464274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4888009a70 con 0x7f489013cce0 2023-12-20T04:44:19.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.661+0000 7f4896033640 1 --2- 172.21.15.132:0/1046464274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f489015a3a0 0x7f48900cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:19.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.661+0000 7f4895832640 1 --2- 172.21.15.132:0/1046464274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48900c92d0 0x7f4890153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:19.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.661+0000 7f4895031640 1 --2- 172.21.15.132:0/1046464274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f489013cce0 0x7f48900c7a90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c450 tx=0x7f488c00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:19.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.661+0000 7f48867fc640 1 -- 172.21.15.132:0/1046464274 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c0052d0 con 0x7f489013cce0 2023-12-20T04:44:19.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.661+0000 7f48867fc640 1 -- 172.21.15.132:0/1046464274 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f488c005430 con 0x7f489013cce0 2023-12-20T04:44:19.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.661+0000 7f4897a96640 1 -- 172.21.15.132:0/1046464274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48900c8530 con 0x7f489013cce0 2023-12-20T04:44:19.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.661+0000 7f48867fc640 1 -- 172.21.15.132:0/1046464274 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f488c012870 con 0x7f489013cce0 2023-12-20T04:44:19.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.661+0000 7f4897a96640 1 -- 172.21.15.132:0/1046464274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48900c8af0 con 0x7f489013cce0 2023-12-20T04:44:19.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.662+0000 7f4897a96640 1 -- 172.21.15.132:0/1046464274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48900c8390 con 0x7f489013cce0 2023-12-20T04:44:19.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.663+0000 7f48867fc640 1 -- 172.21.15.132:0/1046464274 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f488c0129d0 con 0x7f489013cce0 2023-12-20T04:44:19.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.663+0000 7f48867fc640 1 --2- 172.21.15.132:0/1046464274 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f487406a430 0x7f487406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.663+0000 7f48867fc640 1 -- 172.21.15.132:0/1046464274 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f488c088380 con 0x7f489013cce0 2023-12-20T04:44:19.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.663+0000 7f4895832640 1 --2- 172.21.15.132:0/1046464274 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f487406a430 0x7f487406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.663+0000 7f4895832640 1 --2- 172.21.15.132:0/1046464274 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f487406a430 0x7f487406c8f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4880000f60 tx=0x7f4880009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:19.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.667+0000 7f48867fc640 1 -- 172.21.15.132:0/1046464274 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f48900c8390 con 0x7f489013cce0 2023-12-20T04:44:19.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.835+0000 7f4897a96640 1 -- 172.21.15.132:0/1046464274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f48900c77b0 con 0x7f489013cce0 2023-12-20T04:44:19.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.836+0000 7f48867fc640 1 -- 172.21.15.132:0/1046464274 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v47) v1 ==== 74+0+16093 (secure 0 0 0) 0x7f48900c77b0 con 0x7f489013cce0 2023-12-20T04:44:19.838 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:19.838 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":47,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:44:18.198857+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:44:15.033177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"46","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-20T04:44:16.130594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:44:19.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.838+0000 7f4897a96640 1 -- 172.21.15.132:0/1046464274 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f487406a430 msgr2=0x7f487406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.838+0000 7f4897a96640 1 --2- 172.21.15.132:0/1046464274 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f487406a430 0x7f487406c8f0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f4880000f60 tx=0x7f4880009040 comp rx=0 tx=0).stop 2023-12-20T04:44:19.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.838+0000 7f4897a96640 1 -- 172.21.15.132:0/1046464274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f489013cce0 msgr2=0x7f48900c7a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.838+0000 7f4897a96640 1 --2- 172.21.15.132:0/1046464274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f489013cce0 0x7f48900c7a90 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f488c00c450 tx=0x7f488c00c910 comp rx=0 tx=0).stop 2023-12-20T04:44:19.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.838+0000 7f4897a96640 1 -- 172.21.15.132:0/1046464274 shutdown_connections 2023-12-20T04:44:19.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.838+0000 7f4897a96640 1 --2- 172.21.15.132:0/1046464274 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f487406a430 0x7f487406c8f0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.838+0000 7f4897a96640 1 --2- 172.21.15.132:0/1046464274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f489015a3a0 0x7f48900cd590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.838+0000 7f4897a96640 1 --2- 172.21.15.132:0/1046464274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f489013cce0 0x7f48900c7a90 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.838+0000 7f4897a96640 1 --2- 172.21.15.132:0/1046464274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48900c92d0 0x7f4890153290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.838+0000 7f4897a96640 1 -- 172.21.15.132:0/1046464274 >> 172.21.15.132:0/1046464274 conn(0x7f48900ced10 msgr2=0x7f4890157770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:19.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.838+0000 7f4897a96640 1 -- 172.21.15.132:0/1046464274 shutdown_connections 2023-12-20T04:44:19.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.838+0000 7f4897a96640 1 -- 172.21.15.132:0/1046464274 wait complete. 2023-12-20T04:44:19.851 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-20T04:44:19.851 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:44:19.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.949+0000 7f0d4540b640 1 Processor -- start 2023-12-20T04:44:19.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.949+0000 7f0d4540b640 1 -- start start 2023-12-20T04:44:19.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.950+0000 7f0d4540b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d4015ab70 0x7f0d40160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.950+0000 7f0d4540b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0d4006a340 0x7f0d4015dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.950+0000 7f0d4540b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0d4006d530 con 0x7f0d400cf280 2023-12-20T04:44:19.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.950+0000 7f0d4540b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d40070540 con 0x7f0d4006a340 2023-12-20T04:44:19.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.950+0000 7f0d4540b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d40070790 con 0x7f0d4015ab70 2023-12-20T04:44:19.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.951+0000 7f0d3effd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d4015ab70 0x7f0d40160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.951+0000 7f0d3f7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0d4006a340 0x7f0d4015dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.951+0000 7f0d3effd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d4015ab70 0x7f0d40160d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:47090/0 (socket says 172.21.15.132:47090) 2023-12-20T04:44:19.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.951+0000 7f0d3effd640 1 -- 172.21.15.132:0/841686566 learned_addr learned my addr 172.21.15.132:0/841686566 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:19.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.951+0000 7f0d3e7fc640 1 --1- 172.21.15.132:0/841686566 >> v1:172.21.15.187:6789/0 conn(0x7f0d400cf280 0x7f0d40069c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:33560/0 (socket says 172.21.15.132:33560) 2023-12-20T04:44:19.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.951+0000 7f0d3effd640 1 -- 172.21.15.132:0/841686566 >> v2:172.21.15.187:3300/0 conn(0x7f0d4006a340 msgr2=0x7f0d4015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:19.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.951+0000 7f0d3effd640 1 --2- 172.21.15.132:0/841686566 >> v2:172.21.15.187:3300/0 conn(0x7f0d4006a340 0x7f0d4015dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.951+0000 7f0d3effd640 1 -- 172.21.15.132:0/841686566 >> v1:172.21.15.187:6789/0 conn(0x7f0d400cf280 legacy=0x7f0d40069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.951+0000 7f0d3effd640 1 -- 172.21.15.132:0/841686566 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d40070a70 con 0x7f0d4015ab70 2023-12-20T04:44:19.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.952+0000 7f0d3effd640 1 --2- 172.21.15.132:0/841686566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d4015ab70 0x7f0d40160d70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009e50 tx=0x7f0d3002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9b29527f7f2b820e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:19.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.952+0000 7f0d3dffb640 1 -- 172.21.15.132:0/841686566 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d3002cb00 con 0x7f0d4015ab70 2023-12-20T04:44:19.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.952+0000 7f0d3dffb640 1 -- 172.21.15.132:0/841686566 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d3002cc60 con 0x7f0d4015ab70 2023-12-20T04:44:19.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.952+0000 7f0d3dffb640 1 -- 172.21.15.132:0/841686566 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d300343f0 con 0x7f0d4015ab70 2023-12-20T04:44:19.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.952+0000 7f0d4540b640 1 -- 172.21.15.132:0/841686566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d4015ab70 msgr2=0x7f0d40160d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.952+0000 7f0d4540b640 1 --2- 172.21.15.132:0/841686566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d4015ab70 0x7f0d40160d70 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f0d30009e50 tx=0x7f0d3002bf60 comp rx=0 tx=0).stop 2023-12-20T04:44:19.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.952+0000 7f0d4540b640 1 -- 172.21.15.132:0/841686566 shutdown_connections 2023-12-20T04:44:19.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.952+0000 7f0d4540b640 1 --2- 172.21.15.132:0/841686566 >> v2:172.21.15.187:3300/0 conn(0x7f0d4006a340 0x7f0d4015dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.952+0000 7f0d4540b640 1 --2- 172.21.15.132:0/841686566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d4015ab70 0x7f0d40160d70 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.952+0000 7f0d4540b640 1 -- 172.21.15.132:0/841686566 >> 172.21.15.132:0/841686566 conn(0x7f0d400cfca0 msgr2=0x7f0d400d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:19.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.952+0000 7f0d4540b640 1 -- 172.21.15.132:0/841686566 shutdown_connections 2023-12-20T04:44:19.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.952+0000 7f0d4540b640 1 -- 172.21.15.132:0/841686566 wait complete. 2023-12-20T04:44:19.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.954+0000 7f0d4540b640 1 Processor -- start 2023-12-20T04:44:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.954+0000 7f0d4540b640 1 -- start start 2023-12-20T04:44:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.954+0000 7f0d4540b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d4006a340 0x7f0d400c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.954+0000 7f0d4540b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d400cf280 0x7f0d4014bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.954+0000 7f0d4540b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d4015ab70 0x7f0d4014c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.954+0000 7f0d4540b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d400cb890 con 0x7f0d400cf280 2023-12-20T04:44:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.954+0000 7f0d4540b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4014d720 con 0x7f0d4006a340 2023-12-20T04:44:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.954+0000 7f0d4540b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d4014da00 con 0x7f0d4015ab70 2023-12-20T04:44:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.954+0000 7f0d3e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d400cf280 0x7f0d4014bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.955+0000 7f0d3e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d400cf280 0x7f0d4014bb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56918/0 (socket says 172.21.15.132:56918) 2023-12-20T04:44:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.955+0000 7f0d3e7fc640 1 -- 172.21.15.132:0/1007644358 learned_addr learned my addr 172.21.15.132:0/1007644358 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:19.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.955+0000 7f0d3effd640 1 --2- 172.21.15.132:0/1007644358 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d4006a340 0x7f0d400c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.955+0000 7f0d3f7fe640 1 --2- 172.21.15.132:0/1007644358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d4015ab70 0x7f0d4014c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.955+0000 7f0d3e7fc640 1 -- 172.21.15.132:0/1007644358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d4015ab70 msgr2=0x7f0d4014c080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.955+0000 7f0d3e7fc640 1 --2- 172.21.15.132:0/1007644358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d4015ab70 0x7f0d4014c080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.955+0000 7f0d3e7fc640 1 -- 172.21.15.132:0/1007644358 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d4006a340 msgr2=0x7f0d400c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.955+0000 7f0d3e7fc640 1 --2- 172.21.15.132:0/1007644358 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d4006a340 0x7f0d400c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.955+0000 7f0d3e7fc640 1 -- 172.21.15.132:0/1007644358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d30009b30 con 0x7f0d400cf280 2023-12-20T04:44:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.955+0000 7f0d3e7fc640 1 --2- 172.21.15.132:0/1007644358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d400cf280 0x7f0d4014bb40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400c4d0 tx=0x7f0d3400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.955+0000 7f0d277fe640 1 -- 172.21.15.132:0/1007644358 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d34007480 con 0x7f0d400cf280 2023-12-20T04:44:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.955+0000 7f0d277fe640 1 -- 172.21.15.132:0/1007644358 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d340075e0 con 0x7f0d400cf280 2023-12-20T04:44:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.955+0000 7f0d4540b640 1 -- 172.21.15.132:0/1007644358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d4014dce0 con 0x7f0d400cf280 2023-12-20T04:44:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.955+0000 7f0d277fe640 1 -- 172.21.15.132:0/1007644358 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d340049e0 con 0x7f0d400cf280 2023-12-20T04:44:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.955+0000 7f0d4540b640 1 -- 172.21.15.132:0/1007644358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d4014e2a0 con 0x7f0d400cf280 2023-12-20T04:44:19.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.956+0000 7f0d4540b640 1 -- 172.21.15.132:0/1007644358 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d4014e4c0 con 0x7f0d400cf280 2023-12-20T04:44:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.957+0000 7f0d277fe640 1 -- 172.21.15.132:0/1007644358 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0d34004b40 con 0x7f0d400cf280 2023-12-20T04:44:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.957+0000 7f0d277fe640 1 --2- 172.21.15.132:0/1007644358 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0d2c06a430 0x7f0d2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.957+0000 7f0d277fe640 1 -- 172.21.15.132:0/1007644358 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d34087dd0 con 0x7f0d400cf280 2023-12-20T04:44:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.957+0000 7f0d3effd640 1 --2- 172.21.15.132:0/1007644358 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0d2c06a430 0x7f0d2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:19.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.957+0000 7f0d3effd640 1 --2- 172.21.15.132:0/1007644358 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0d2c06a430 0x7f0d2c06c8f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0d30035000 tx=0x7f0d30030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:19.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:19.961+0000 7f0d277fe640 1 -- 172.21.15.132:0/1007644358 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0d34053470 con 0x7f0d400cf280 2023-12-20T04:44:20.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.125+0000 7f0d4540b640 1 -- 172.21.15.132:0/1007644358 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d40071030 con 0x7f0d2c06a430 2023-12-20T04:44:20.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.132+0000 7f0d277fe640 1 -- 172.21.15.132:0/1007644358 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276088 (secure 0 0 0) 0x7f0d30009510 con 0x7f0d2c06a430 2023-12-20T04:44:20.137 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:20.138 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:44:20.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.135+0000 7f0d4540b640 1 -- 172.21.15.132:0/1007644358 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0d2c06a430 msgr2=0x7f0d2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:20.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.135+0000 7f0d4540b640 1 --2- 172.21.15.132:0/1007644358 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0d2c06a430 0x7f0d2c06c8f0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f0d30035000 tx=0x7f0d30030000 comp rx=0 tx=0).stop 2023-12-20T04:44:20.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.135+0000 7f0d4540b640 1 -- 172.21.15.132:0/1007644358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d400cf280 msgr2=0x7f0d4014bb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:20.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.135+0000 7f0d4540b640 1 --2- 172.21.15.132:0/1007644358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d400cf280 0x7f0d4014bb40 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f0d3400c4d0 tx=0x7f0d3400c990 comp rx=0 tx=0).stop 2023-12-20T04:44:20.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.135+0000 7f0d4540b640 1 -- 172.21.15.132:0/1007644358 shutdown_connections 2023-12-20T04:44:20.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.135+0000 7f0d4540b640 1 --2- 172.21.15.132:0/1007644358 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0d2c06a430 0x7f0d2c06c8f0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.135+0000 7f0d4540b640 1 --2- 172.21.15.132:0/1007644358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d4015ab70 0x7f0d4014c080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.135+0000 7f0d4540b640 1 --2- 172.21.15.132:0/1007644358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d400cf280 0x7f0d4014bb40 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.135+0000 7f0d4540b640 1 --2- 172.21.15.132:0/1007644358 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d4006a340 0x7f0d400c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.135+0000 7f0d4540b640 1 -- 172.21.15.132:0/1007644358 >> 172.21.15.132:0/1007644358 conn(0x7f0d400cfca0 msgr2=0x7f0d4015c110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:20.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.135+0000 7f0d4540b640 1 -- 172.21.15.132:0/1007644358 shutdown_connections 2023-12-20T04:44:20.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.135+0000 7f0d4540b640 1 -- 172.21.15.132:0/1007644358 wait complete. 2023-12-20T04:44:20.148 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2023-12-20T04:44:20.110810+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2734,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559765,"statfs":{"total":1600000000,"available":1597199998,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.304788"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809394+0000","last_change":"2023-12-20T04:44:15.809394+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809394+0000","last_undegraded":"2023-12-20T04:44:15.809394+0000","last_fullsized":"2023-12-20T04:44:15.809394+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:51.997296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810596+0000","last_change":"2023-12-20T04:44:15.810596+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810596+0000","last_undegraded":"2023-12-20T04:44:15.810596+0000","last_fullsized":"2023-12-20T04:44:15.810596+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:43:32.291032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808955+0000","last_change":"2023-12-20T04:44:15.808955+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808955+0000","last_undegraded":"2023-12-20T04:44:15.808955+0000","last_fullsized":"2023-12-20T04:44:15.808955+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:30:39.506732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810177+0000","last_change":"2023-12-20T04:44:15.810177+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810177+0000","last_undegraded":"2023-12-20T04:44:15.810177+0000","last_fullsized":"2023-12-20T04:44:15.810177+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809494+0000","last_change":"2023-12-20T04:44:15.809494+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809494+0000","last_undegraded":"2023-12-20T04:44:15.809494+0000","last_fullsized":"2023-12-20T04:44:15.809494+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:41:33.641196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810768+0000","last_change":"2023-12-20T04:44:15.810768+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810768+0000","last_undegraded":"2023-12-20T04:44:15.810768+0000","last_fullsized":"2023-12-20T04:44:15.810768+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:00:21.806708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809285+0000","last_change":"2023-12-20T04:44:15.809285+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809285+0000","last_undegraded":"2023-12-20T04:44:15.809285+0000","last_fullsized":"2023-12-20T04:44:15.809285+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:11:29.355282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808069+0000","last_change":"2023-12-20T04:44:15.808069+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808069+0000","last_undegraded":"2023-12-20T04:44:15.808069+0000","last_fullsized":"2023-12-20T04:44:15.808069+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:00:21.806708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810433+0000","last_change":"2023-12-20T04:44:15.810433+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810433+0000","last_undegraded":"2023-12-20T04:44:15.810433+0000","last_fullsized":"2023-12-20T04:44:15.810433+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:45:12.976332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.807738+0000","last_change":"2023-12-20T04:44:15.807738+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.807738+0000","last_undegraded":"2023-12-20T04:44:15.807738+0000","last_fullsized":"2023-12-20T04:44:15.807738+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:45:56.730088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808765+0000","last_change":"2023-12-20T04:44:15.808765+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808765+0000","last_undegraded":"2023-12-20T04:44:15.808765+0000","last_fullsized":"2023-12-20T04:44:15.808765+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:36:20.465368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.811064+0000","last_change":"2023-12-20T04:44:15.811064+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.811064+0000","last_undegraded":"2023-12-20T04:44:15.811064+0000","last_fullsized":"2023-12-20T04:44:15.811064+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:48:39.434329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808978+0000","last_change":"2023-12-20T04:44:15.808978+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808978+0000","last_undegraded":"2023-12-20T04:44:15.808978+0000","last_fullsized":"2023-12-20T04:44:15.808978+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:30:39.506732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809731+0000","last_change":"2023-12-20T04:44:15.809731+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809731+0000","last_undegraded":"2023-12-20T04:44:15.809731+0000","last_fullsized":"2023-12-20T04:44:15.809731+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:21:56.993244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809072+0000","last_change":"2023-12-20T04:44:15.809072+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809072+0000","last_undegraded":"2023-12-20T04:44:15.809072+0000","last_fullsized":"2023-12-20T04:44:15.809072+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:14:03.265816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.807799+0000","last_change":"2023-12-20T04:44:15.807799+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.807799+0000","last_undegraded":"2023-12-20T04:44:15.807799+0000","last_fullsized":"2023-12-20T04:44:15.807799+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:03.599978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810740+0000","last_change":"2023-12-20T04:44:15.810740+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810740+0000","last_undegraded":"2023-12-20T04:44:15.810740+0000","last_fullsized":"2023-12-20T04:44:15.810740+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:03:38.448781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.811378+0000","last_change":"2023-12-20T04:44:15.811378+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.811378+0000","last_undegraded":"2023-12-20T04:44:15.811378+0000","last_fullsized":"2023-12-20T04:44:15.811378+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:04:44.530883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809145+0000","last_change":"2023-12-20T04:44:15.809145+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809145+0000","last_undegraded":"2023-12-20T04:44:15.809145+0000","last_fullsized":"2023-12-20T04:44:15.809145+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:45.809267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808748+0000","last_change":"2023-12-20T04:44:15.808748+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808748+0000","last_undegraded":"2023-12-20T04:44:15.808748+0000","last_fullsized":"2023-12-20T04:44:15.808748+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:21:56.993244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808994+0000","last_change":"2023-12-20T04:44:15.808994+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808994+0000","last_undegraded":"2023-12-20T04:44:15.808994+0000","last_fullsized":"2023-12-20T04:44:15.808994+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808742+0000","last_change":"2023-12-20T04:44:15.808742+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808742+0000","last_undegraded":"2023-12-20T04:44:15.808742+0000","last_fullsized":"2023-12-20T04:44:15.808742+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:23.840378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.807732+0000","last_change":"2023-12-20T04:44:15.807732+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.807732+0000","last_undegraded":"2023-12-20T04:44:15.807732+0000","last_fullsized":"2023-12-20T04:44:15.807732+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:43:25.969506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809385+0000","last_change":"2023-12-20T04:44:15.809385+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809385+0000","last_undegraded":"2023-12-20T04:44:15.809385+0000","last_fullsized":"2023-12-20T04:44:15.809385+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:46:29.128311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808626+0000","last_change":"2023-12-20T04:44:15.808626+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808626+0000","last_undegraded":"2023-12-20T04:44:15.808626+0000","last_fullsized":"2023-12-20T04:44:15.808626+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:37:42.342927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809327+0000","last_change":"2023-12-20T04:44:15.809327+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809327+0000","last_undegraded":"2023-12-20T04:44:15.809327+0000","last_fullsized":"2023-12-20T04:44:15.809327+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:02:34.348449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808638+0000","last_change":"2023-12-20T04:44:15.808638+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808638+0000","last_undegraded":"2023-12-20T04:44:15.808638+0000","last_fullsized":"2023-12-20T04:44:15.808638+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809039+0000","last_change":"2023-12-20T04:44:15.809039+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809039+0000","last_undegraded":"2023-12-20T04:44:15.809039+0000","last_fullsized":"2023-12-20T04:44:15.809039+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:45.809267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810905+0000","last_change":"2023-12-20T04:44:15.810905+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810905+0000","last_undegraded":"2023-12-20T04:44:15.810905+0000","last_fullsized":"2023-12-20T04:44:15.810905+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:12:23.948724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808506+0000","last_change":"2023-12-20T04:44:15.808506+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808506+0000","last_undegraded":"2023-12-20T04:44:15.808506+0000","last_fullsized":"2023-12-20T04:44:15.808506+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:51.997296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.807748+0000","last_change":"2023-12-20T04:44:15.807748+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.807748+0000","last_undegraded":"2023-12-20T04:44:15.807748+0000","last_fullsized":"2023-12-20T04:44:15.807748+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:06:02.833861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808726+0000","last_change":"2023-12-20T04:44:15.808726+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808726+0000","last_undegraded":"2023-12-20T04:44:15.808726+0000","last_fullsized":"2023-12-20T04:44:15.808726+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:35:29.288461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":183,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-20T04:44:13.676958+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:44:13.676958+0000","last_peered":"2023-12-20T04:44:13.676958+0000","last_clean":"2023-12-20T04:44:13.676958+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:44:13.676958+0000","last_undegraded":"2023-12-20T04:44:13.676958+0000","last_fullsized":"2023-12-20T04:44:13.676958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":772,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194539,"statfs":{"total":200000000,"available":199208678,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.63200000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.65200000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.75},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.502},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.71299999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.73299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.53700000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.47499999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.45000000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.505},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.39400000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.60899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.59399999999999997}]},{"osd":1,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.56799999999999995}]},{"osd":2,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.60499999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.46000000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52500000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.621},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.48599999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.61899999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54000000000000004}]},{"osd":3,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.59299999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.497},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.42499999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.44800000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.22},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.27500000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.26400000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.29199999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54500000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44500000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.434}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.501},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.374,"5min":0.374,"15min":0.374},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.32600000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.313}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.34999999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.46400000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.44500000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.503},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41299999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.55800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":201,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195110,"statfs":{"total":200000000,"available":199793229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.34899999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.376}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.316}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.42999999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.53200000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.51900000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.497},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.48699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":778,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194534,"statfs":{"total":200000000,"available":199202861,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.39800000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.38},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.35099999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.41499999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.61099999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.52600000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.624},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54100000000000004}]}]}],"pool_statfs":[]}} 2023-12-20T04:44:20.154 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:44:20.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.287+0000 7f0d93ef3640 1 Processor -- start 2023-12-20T04:44:20.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.288+0000 7f0d93ef3640 1 -- start start 2023-12-20T04:44:20.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.288+0000 7f0d93ef3640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0d8c1588e0 0x7f0d8c069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.288+0000 7f0d93ef3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0d8c06a170 0x7f0d8c06c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.288+0000 7f0d93ef3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d8c06cd30 0x7f0d8c0b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.288+0000 7f0d93ef3640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8c06d520 con 0x7f0d8c06a170 2023-12-20T04:44:20.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.288+0000 7f0d93ef3640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0d8c06a600 con 0x7f0d8c1588e0 2023-12-20T04:44:20.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.288+0000 7f0d93ef3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c06ea90 con 0x7f0d8c06cd30 2023-12-20T04:44:20.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.289+0000 7f0d9148e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0d8c06a170 0x7f0d8c06c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.289+0000 7f0d9148e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0d8c06a170 0x7f0d8c06c7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56926/0 (socket says 172.21.15.132:56926) 2023-12-20T04:44:20.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.289+0000 7f0d9148e640 1 -- 172.21.15.132:0/514258139 learned_addr learned my addr 172.21.15.132:0/514258139 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:20.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.289+0000 7f0d92490640 1 --2- 172.21.15.132:0/514258139 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d8c06cd30 0x7f0d8c0b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.289+0000 7f0d91c8f640 1 --2- 172.21.15.132:0/514258139 >> v2:172.21.15.187:3300/0 conn(0x7f0d8c1588e0 0x7f0d8c069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.289+0000 7f0d9148e640 1 -- 172.21.15.132:0/514258139 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d8c06cd30 msgr2=0x7f0d8c0b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:20.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.289+0000 7f0d9148e640 1 --2- 172.21.15.132:0/514258139 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d8c06cd30 0x7f0d8c0b4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.289+0000 7f0d9148e640 1 -- 172.21.15.132:0/514258139 >> v2:172.21.15.187:3300/0 conn(0x7f0d8c1588e0 msgr2=0x7f0d8c069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:20.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.289+0000 7f0d9148e640 1 --2- 172.21.15.132:0/514258139 >> v2:172.21.15.187:3300/0 conn(0x7f0d8c1588e0 0x7f0d8c069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.289+0000 7f0d9148e640 1 -- 172.21.15.132:0/514258139 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d8c06e160 con 0x7f0d8c06a170 2023-12-20T04:44:20.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.289+0000 7f0d92490640 1 --2- 172.21.15.132:0/514258139 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d8c06cd30 0x7f0d8c0b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:20.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.289+0000 7f0d9148e640 1 --2- 172.21.15.132:0/514258139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d8c06a170 0x7f0d8c06c7f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c067740 tx=0x7f0d7c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de8681dea75a1c35 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:20.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.290+0000 7f0d90c8d640 1 -- 172.21.15.132:0/514258139 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c031870 con 0x7f0d8c06a170 2023-12-20T04:44:20.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.290+0000 7f0d90c8d640 1 -- 172.21.15.132:0/514258139 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d7c0319d0 con 0x7f0d8c06a170 2023-12-20T04:44:20.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.290+0000 7f0d90c8d640 1 -- 172.21.15.132:0/514258139 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d7c031d60 con 0x7f0d8c06a170 2023-12-20T04:44:20.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.290+0000 7f0d93ef3640 1 -- 172.21.15.132:0/514258139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d8c06a170 msgr2=0x7f0d8c06c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:20.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.290+0000 7f0d93ef3640 1 --2- 172.21.15.132:0/514258139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d8c06a170 0x7f0d8c06c7f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c067740 tx=0x7f0d7c02b910 comp rx=0 tx=0).stop 2023-12-20T04:44:20.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.290+0000 7f0d93ef3640 1 -- 172.21.15.132:0/514258139 shutdown_connections 2023-12-20T04:44:20.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.290+0000 7f0d93ef3640 1 --2- 172.21.15.132:0/514258139 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d8c06cd30 0x7f0d8c0b4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.290+0000 7f0d93ef3640 1 --2- 172.21.15.132:0/514258139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d8c06a170 0x7f0d8c06c7f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.290+0000 7f0d93ef3640 1 --2- 172.21.15.132:0/514258139 >> v2:172.21.15.187:3300/0 conn(0x7f0d8c1588e0 0x7f0d8c069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.290+0000 7f0d93ef3640 1 -- 172.21.15.132:0/514258139 >> 172.21.15.132:0/514258139 conn(0x7f0d8c0cfca0 msgr2=0x7f0d8c0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.290+0000 7f0d93ef3640 1 -- 172.21.15.132:0/514258139 shutdown_connections 2023-12-20T04:44:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.290+0000 7f0d93ef3640 1 -- 172.21.15.132:0/514258139 wait complete. 2023-12-20T04:44:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.291+0000 7f0d93ef3640 1 Processor -- start 2023-12-20T04:44:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.291+0000 7f0d93ef3640 1 -- start start 2023-12-20T04:44:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.292+0000 7f0d93ef3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d8c06a170 0x7f0d8c1463c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.292+0000 7f0d93ef3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d8c06cd30 0x7f0d8c1f3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.292+0000 7f0d93ef3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d8c1588e0 0x7f0d8c1f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.292+0000 7f0d93ef3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c15b810 con 0x7f0d8c1588e0 2023-12-20T04:44:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.292+0000 7f0d93ef3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c1f1b10 con 0x7f0d8c06a170 2023-12-20T04:44:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.292+0000 7f0d93ef3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8c0c9830 con 0x7f0d8c06cd30 2023-12-20T04:44:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.292+0000 7f0d92490640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d8c1588e0 0x7f0d8c1f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.292+0000 7f0d92490640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d8c1588e0 0x7f0d8c1f44a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56936/0 (socket says 172.21.15.132:56936) 2023-12-20T04:44:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.292+0000 7f0d92490640 1 -- 172.21.15.132:0/594597957 learned_addr learned my addr 172.21.15.132:0/594597957 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.292+0000 7f0d9148e640 1 --2- 172.21.15.132:0/594597957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d8c06cd30 0x7f0d8c1f3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.292+0000 7f0d91c8f640 1 --2- 172.21.15.132:0/594597957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d8c06a170 0x7f0d8c1463c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.292+0000 7f0d92490640 1 -- 172.21.15.132:0/594597957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d8c06cd30 msgr2=0x7f0d8c1f3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.292+0000 7f0d92490640 1 --2- 172.21.15.132:0/594597957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d8c06cd30 0x7f0d8c1f3f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.293+0000 7f0d92490640 1 -- 172.21.15.132:0/594597957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d8c06a170 msgr2=0x7f0d8c1463c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.293+0000 7f0d92490640 1 --2- 172.21.15.132:0/594597957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d8c06a170 0x7f0d8c1463c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.293+0000 7f0d92490640 1 -- 172.21.15.132:0/594597957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d7c0094d0 con 0x7f0d8c1588e0 2023-12-20T04:44:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.293+0000 7f0d91c8f640 1 --2- 172.21.15.132:0/594597957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d8c06a170 0x7f0d8c1463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.293+0000 7f0d92490640 1 --2- 172.21.15.132:0/594597957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d8c1588e0 0x7f0d8c1f44a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400c820 tx=0x7f0d8400cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.293+0000 7f0d827fc640 1 -- 172.21.15.132:0/594597957 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d84007a30 con 0x7f0d8c1588e0 2023-12-20T04:44:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.293+0000 7f0d827fc640 1 -- 172.21.15.132:0/594597957 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0d84007b90 con 0x7f0d8c1588e0 2023-12-20T04:44:20.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.293+0000 7f0d827fc640 1 -- 172.21.15.132:0/594597957 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0d8400ce10 con 0x7f0d8c1588e0 2023-12-20T04:44:20.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.293+0000 7f0d93ef3640 1 -- 172.21.15.132:0/594597957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8c15c350 con 0x7f0d8c1588e0 2023-12-20T04:44:20.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.293+0000 7f0d93ef3640 1 -- 172.21.15.132:0/594597957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8c15bd00 con 0x7f0d8c1588e0 2023-12-20T04:44:20.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.294+0000 7f0d93ef3640 1 -- 172.21.15.132:0/594597957 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d8c15c4e0 con 0x7f0d8c1588e0 2023-12-20T04:44:20.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.294+0000 7f0d827fc640 1 -- 172.21.15.132:0/594597957 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0d840113f0 con 0x7f0d8c1588e0 2023-12-20T04:44:20.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.294+0000 7f0d827fc640 1 --2- 172.21.15.132:0/594597957 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0d7006a430 0x7f0d7006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.295+0000 7f0d827fc640 1 -- 172.21.15.132:0/594597957 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0d840889a0 con 0x7f0d8c1588e0 2023-12-20T04:44:20.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.295+0000 7f0d91c8f640 1 --2- 172.21.15.132:0/594597957 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0d7006a430 0x7f0d7006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.295+0000 7f0d91c8f640 1 --2- 172.21.15.132:0/594597957 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0d7006a430 0x7f0d7006c8f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c1578a0 tx=0x7f0d8800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:20.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.299+0000 7f0d827fc640 1 -- 172.21.15.132:0/594597957 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0d840540e0 con 0x7f0d8c1588e0 2023-12-20T04:44:20.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.460+0000 7f0d93ef3640 1 -- 172.21.15.132:0/594597957 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0d8c06e720 con 0x7f0d7006a430 2023-12-20T04:44:20.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.467+0000 7f0d827fc640 1 -- 172.21.15.132:0/594597957 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276088 (secure 0 0 0) 0x7f0d880143d0 con 0x7f0d7006a430 2023-12-20T04:44:20.471 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:20.473 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:44:20.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.470+0000 7f0d93ef3640 1 -- 172.21.15.132:0/594597957 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0d7006a430 msgr2=0x7f0d7006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:20.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.470+0000 7f0d93ef3640 1 --2- 172.21.15.132:0/594597957 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0d7006a430 0x7f0d7006c8f0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f0d8c1578a0 tx=0x7f0d8800b040 comp rx=0 tx=0).stop 2023-12-20T04:44:20.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.470+0000 7f0d93ef3640 1 -- 172.21.15.132:0/594597957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d8c1588e0 msgr2=0x7f0d8c1f44a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:20.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.470+0000 7f0d93ef3640 1 --2- 172.21.15.132:0/594597957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d8c1588e0 0x7f0d8c1f44a0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0d8400c820 tx=0x7f0d8400cce0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.470+0000 7f0d93ef3640 1 -- 172.21.15.132:0/594597957 shutdown_connections 2023-12-20T04:44:20.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.470+0000 7f0d93ef3640 1 --2- 172.21.15.132:0/594597957 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0d7006a430 0x7f0d7006c8f0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.470+0000 7f0d93ef3640 1 --2- 172.21.15.132:0/594597957 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0d8c1588e0 0x7f0d8c1f44a0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.470+0000 7f0d93ef3640 1 --2- 172.21.15.132:0/594597957 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0d8c06cd30 0x7f0d8c1f3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.470+0000 7f0d93ef3640 1 --2- 172.21.15.132:0/594597957 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0d8c06a170 0x7f0d8c1463c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.470+0000 7f0d93ef3640 1 -- 172.21.15.132:0/594597957 >> 172.21.15.132:0/594597957 conn(0x7f0d8c0cfca0 msgr2=0x7f0d8c0b0680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:20.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.470+0000 7f0d93ef3640 1 -- 172.21.15.132:0/594597957 shutdown_connections 2023-12-20T04:44:20.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.470+0000 7f0d93ef3640 1 -- 172.21.15.132:0/594597957 wait complete. 2023-12-20T04:44:20.483 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2023-12-20T04:44:20.110810+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2734,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559765,"statfs":{"total":1600000000,"available":1597199998,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.304788"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809394+0000","last_change":"2023-12-20T04:44:15.809394+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809394+0000","last_undegraded":"2023-12-20T04:44:15.809394+0000","last_fullsized":"2023-12-20T04:44:15.809394+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:51.997296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810596+0000","last_change":"2023-12-20T04:44:15.810596+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810596+0000","last_undegraded":"2023-12-20T04:44:15.810596+0000","last_fullsized":"2023-12-20T04:44:15.810596+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:43:32.291032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808955+0000","last_change":"2023-12-20T04:44:15.808955+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808955+0000","last_undegraded":"2023-12-20T04:44:15.808955+0000","last_fullsized":"2023-12-20T04:44:15.808955+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:30:39.506732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810177+0000","last_change":"2023-12-20T04:44:15.810177+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810177+0000","last_undegraded":"2023-12-20T04:44:15.810177+0000","last_fullsized":"2023-12-20T04:44:15.810177+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809494+0000","last_change":"2023-12-20T04:44:15.809494+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809494+0000","last_undegraded":"2023-12-20T04:44:15.809494+0000","last_fullsized":"2023-12-20T04:44:15.809494+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:41:33.641196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810768+0000","last_change":"2023-12-20T04:44:15.810768+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810768+0000","last_undegraded":"2023-12-20T04:44:15.810768+0000","last_fullsized":"2023-12-20T04:44:15.810768+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:00:21.806708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809285+0000","last_change":"2023-12-20T04:44:15.809285+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809285+0000","last_undegraded":"2023-12-20T04:44:15.809285+0000","last_fullsized":"2023-12-20T04:44:15.809285+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:11:29.355282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808069+0000","last_change":"2023-12-20T04:44:15.808069+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808069+0000","last_undegraded":"2023-12-20T04:44:15.808069+0000","last_fullsized":"2023-12-20T04:44:15.808069+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:00:21.806708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810433+0000","last_change":"2023-12-20T04:44:15.810433+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810433+0000","last_undegraded":"2023-12-20T04:44:15.810433+0000","last_fullsized":"2023-12-20T04:44:15.810433+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:45:12.976332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.807738+0000","last_change":"2023-12-20T04:44:15.807738+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.807738+0000","last_undegraded":"2023-12-20T04:44:15.807738+0000","last_fullsized":"2023-12-20T04:44:15.807738+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:45:56.730088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808765+0000","last_change":"2023-12-20T04:44:15.808765+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808765+0000","last_undegraded":"2023-12-20T04:44:15.808765+0000","last_fullsized":"2023-12-20T04:44:15.808765+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:36:20.465368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.811064+0000","last_change":"2023-12-20T04:44:15.811064+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.811064+0000","last_undegraded":"2023-12-20T04:44:15.811064+0000","last_fullsized":"2023-12-20T04:44:15.811064+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:48:39.434329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808978+0000","last_change":"2023-12-20T04:44:15.808978+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808978+0000","last_undegraded":"2023-12-20T04:44:15.808978+0000","last_fullsized":"2023-12-20T04:44:15.808978+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:30:39.506732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809731+0000","last_change":"2023-12-20T04:44:15.809731+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809731+0000","last_undegraded":"2023-12-20T04:44:15.809731+0000","last_fullsized":"2023-12-20T04:44:15.809731+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:21:56.993244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809072+0000","last_change":"2023-12-20T04:44:15.809072+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809072+0000","last_undegraded":"2023-12-20T04:44:15.809072+0000","last_fullsized":"2023-12-20T04:44:15.809072+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:14:03.265816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.807799+0000","last_change":"2023-12-20T04:44:15.807799+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.807799+0000","last_undegraded":"2023-12-20T04:44:15.807799+0000","last_fullsized":"2023-12-20T04:44:15.807799+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:03.599978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810740+0000","last_change":"2023-12-20T04:44:15.810740+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810740+0000","last_undegraded":"2023-12-20T04:44:15.810740+0000","last_fullsized":"2023-12-20T04:44:15.810740+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:03:38.448781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.811378+0000","last_change":"2023-12-20T04:44:15.811378+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.811378+0000","last_undegraded":"2023-12-20T04:44:15.811378+0000","last_fullsized":"2023-12-20T04:44:15.811378+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:04:44.530883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809145+0000","last_change":"2023-12-20T04:44:15.809145+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809145+0000","last_undegraded":"2023-12-20T04:44:15.809145+0000","last_fullsized":"2023-12-20T04:44:15.809145+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:45.809267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808748+0000","last_change":"2023-12-20T04:44:15.808748+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808748+0000","last_undegraded":"2023-12-20T04:44:15.808748+0000","last_fullsized":"2023-12-20T04:44:15.808748+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:21:56.993244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808994+0000","last_change":"2023-12-20T04:44:15.808994+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808994+0000","last_undegraded":"2023-12-20T04:44:15.808994+0000","last_fullsized":"2023-12-20T04:44:15.808994+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808742+0000","last_change":"2023-12-20T04:44:15.808742+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808742+0000","last_undegraded":"2023-12-20T04:44:15.808742+0000","last_fullsized":"2023-12-20T04:44:15.808742+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:23.840378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.807732+0000","last_change":"2023-12-20T04:44:15.807732+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.807732+0000","last_undegraded":"2023-12-20T04:44:15.807732+0000","last_fullsized":"2023-12-20T04:44:15.807732+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:43:25.969506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809385+0000","last_change":"2023-12-20T04:44:15.809385+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809385+0000","last_undegraded":"2023-12-20T04:44:15.809385+0000","last_fullsized":"2023-12-20T04:44:15.809385+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:46:29.128311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808626+0000","last_change":"2023-12-20T04:44:15.808626+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808626+0000","last_undegraded":"2023-12-20T04:44:15.808626+0000","last_fullsized":"2023-12-20T04:44:15.808626+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:37:42.342927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809327+0000","last_change":"2023-12-20T04:44:15.809327+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809327+0000","last_undegraded":"2023-12-20T04:44:15.809327+0000","last_fullsized":"2023-12-20T04:44:15.809327+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:02:34.348449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808638+0000","last_change":"2023-12-20T04:44:15.808638+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808638+0000","last_undegraded":"2023-12-20T04:44:15.808638+0000","last_fullsized":"2023-12-20T04:44:15.808638+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809039+0000","last_change":"2023-12-20T04:44:15.809039+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809039+0000","last_undegraded":"2023-12-20T04:44:15.809039+0000","last_fullsized":"2023-12-20T04:44:15.809039+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:45.809267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810905+0000","last_change":"2023-12-20T04:44:15.810905+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810905+0000","last_undegraded":"2023-12-20T04:44:15.810905+0000","last_fullsized":"2023-12-20T04:44:15.810905+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:12:23.948724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808506+0000","last_change":"2023-12-20T04:44:15.808506+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808506+0000","last_undegraded":"2023-12-20T04:44:15.808506+0000","last_fullsized":"2023-12-20T04:44:15.808506+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:51.997296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.807748+0000","last_change":"2023-12-20T04:44:15.807748+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.807748+0000","last_undegraded":"2023-12-20T04:44:15.807748+0000","last_fullsized":"2023-12-20T04:44:15.807748+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:06:02.833861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808726+0000","last_change":"2023-12-20T04:44:15.808726+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808726+0000","last_undegraded":"2023-12-20T04:44:15.808726+0000","last_fullsized":"2023-12-20T04:44:15.808726+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:35:29.288461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":183,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-20T04:44:13.676958+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:44:13.676958+0000","last_peered":"2023-12-20T04:44:13.676958+0000","last_clean":"2023-12-20T04:44:13.676958+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:44:13.676958+0000","last_undegraded":"2023-12-20T04:44:13.676958+0000","last_fullsized":"2023-12-20T04:44:13.676958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":772,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194539,"statfs":{"total":200000000,"available":199208678,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.63200000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.65200000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.75},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.502},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.71299999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.73299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.53700000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.47499999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.45000000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.505},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.39400000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.60899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.59399999999999997}]},{"osd":1,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.56799999999999995}]},{"osd":2,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.60499999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.46000000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52500000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.621},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.48599999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.61899999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54000000000000004}]},{"osd":3,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.59299999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.497},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.42499999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.44800000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.22},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.27500000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.26400000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.29199999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54500000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44500000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.434}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.501},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.374,"5min":0.374,"15min":0.374},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.32600000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.313}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.34999999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.46400000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.44500000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.503},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41299999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.55800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":201,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195110,"statfs":{"total":200000000,"available":199793229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.34899999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.376}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.316}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.42999999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.53200000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.51900000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.497},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.48699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":778,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194534,"statfs":{"total":200000000,"available":199202861,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.39800000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.38},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.35099999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.41499999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.61099999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.52600000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.624},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54100000000000004}]}]}],"pool_statfs":[]}} 2023-12-20T04:44:20.490 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:44:20.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.624+0000 7fdd55d92640 1 Processor -- start 2023-12-20T04:44:20.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.624+0000 7fdd55d92640 1 -- start start 2023-12-20T04:44:20.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.625+0000 7fdd55d92640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5015d100 0x7fdd500b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.625+0000 7fdd55d92640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd500d0370 0x7fdd500cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.625+0000 7fdd55d92640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd500b2f90 con 0x7fdd50161850 2023-12-20T04:44:20.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.625+0000 7fdd55d92640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd501613c0 con 0x7fdd500d0370 2023-12-20T04:44:20.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.625+0000 7fdd55d92640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500d1b00 con 0x7fdd5015d100 2023-12-20T04:44:20.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.625+0000 7fdd4effd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd500d0370 0x7fdd500cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.625+0000 7fdd4ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdd50161850 0x7fdd5006c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46874/0 (socket says 172.21.15.132:46874) 2023-12-20T04:44:20.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.625+0000 7fdd4ffff640 1 -- 172.21.15.132:0/3611104581 learned_addr learned my addr 172.21.15.132:0/3611104581 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:20.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.625+0000 7fdd4f7fe640 1 --2- 172.21.15.132:0/3611104581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5015d100 0x7fdd500b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.625+0000 7fdd4effd640 1 -- 172.21.15.132:0/3611104581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5015d100 msgr2=0x7fdd500b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:20.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.625+0000 7fdd4effd640 1 --2- 172.21.15.132:0/3611104581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5015d100 0x7fdd500b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.625+0000 7fdd4effd640 1 -- 172.21.15.132:0/3611104581 >> v1:172.21.15.132:6789/0 conn(0x7fdd50161850 legacy=0x7fdd5006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:20.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.625+0000 7fdd4e7fc640 1 -- 172.21.15.132:0/3611104581 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2984460289 0 0) 0x7fdd48001490 con 0x7fdd50161850 2023-12-20T04:44:20.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.625+0000 7fdd4effd640 1 -- 172.21.15.132:0/3611104581 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd500d0810 con 0x7fdd500d0370 2023-12-20T04:44:20.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.626+0000 7fdd4effd640 1 --2- 172.21.15.132:0/3611104581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd500d0370 0x7fdd500cd500 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fdd440097a0 tx=0x7fdd4402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbd3dfb056b95c16 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:20.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.626+0000 7fdd4e7fc640 1 -- 172.21.15.132:0/3611104581 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4402e070 con 0x7fdd500d0370 2023-12-20T04:44:20.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.626+0000 7fdd4e7fc640 1 -- 172.21.15.132:0/3611104581 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd440315a0 con 0x7fdd500d0370 2023-12-20T04:44:20.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.626+0000 7fdd4e7fc640 1 -- 172.21.15.132:0/3611104581 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd44031930 con 0x7fdd500d0370 2023-12-20T04:44:20.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.626+0000 7fdd55d92640 1 -- 172.21.15.132:0/3611104581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd500d0370 msgr2=0x7fdd500cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:20.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.626+0000 7fdd55d92640 1 --2- 172.21.15.132:0/3611104581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd500d0370 0x7fdd500cd500 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fdd440097a0 tx=0x7fdd4402b840 comp rx=0 tx=0).stop 2023-12-20T04:44:20.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.626+0000 7fdd55d92640 1 -- 172.21.15.132:0/3611104581 shutdown_connections 2023-12-20T04:44:20.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.626+0000 7fdd55d92640 1 --2- 172.21.15.132:0/3611104581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd500d0370 0x7fdd500cd500 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.626+0000 7fdd55d92640 1 --2- 172.21.15.132:0/3611104581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5015d100 0x7fdd500b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.626+0000 7fdd55d92640 1 -- 172.21.15.132:0/3611104581 >> 172.21.15.132:0/3611104581 conn(0x7fdd5006d7c0 msgr2=0x7fdd5006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:20.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.626+0000 7fdd55d92640 1 -- 172.21.15.132:0/3611104581 shutdown_connections 2023-12-20T04:44:20.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.627+0000 7fdd55d92640 1 -- 172.21.15.132:0/3611104581 wait complete. 2023-12-20T04:44:20.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.628+0000 7fdd55d92640 1 Processor -- start 2023-12-20T04:44:20.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.628+0000 7fdd55d92640 1 -- start start 2023-12-20T04:44:20.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.628+0000 7fdd55d92640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd500d0370 0x7fdd5006c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.628+0000 7fdd55d92640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd5015d100 0x7fdd5014fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.628+0000 7fdd55d92640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd50161850 0x7fdd50150400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd55d92640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd50150940 con 0x7fdd500d0370 2023-12-20T04:44:20.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd55d92640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500c99b0 con 0x7fdd5015d100 2023-12-20T04:44:20.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd55d92640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd500c9c30 con 0x7fdd50161850 2023-12-20T04:44:20.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd4f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd500d0370 0x7fdd5006c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd4f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd500d0370 0x7fdd5006c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56954/0 (socket says 172.21.15.132:56954) 2023-12-20T04:44:20.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd4f7fe640 1 -- 172.21.15.132:0/2302930605 learned_addr learned my addr 172.21.15.132:0/2302930605 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:20.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd4ffff640 1 --2- 172.21.15.132:0/2302930605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd50161850 0x7fdd50150400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd4effd640 1 --2- 172.21.15.132:0/2302930605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd5015d100 0x7fdd5014fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd4f7fe640 1 -- 172.21.15.132:0/2302930605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd50161850 msgr2=0x7fdd50150400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:20.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd4f7fe640 1 --2- 172.21.15.132:0/2302930605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd50161850 0x7fdd50150400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd4f7fe640 1 -- 172.21.15.132:0/2302930605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd5015d100 msgr2=0x7fdd5014fec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:20.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd4f7fe640 1 --2- 172.21.15.132:0/2302930605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd5015d100 0x7fdd5014fec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd4f7fe640 1 -- 172.21.15.132:0/2302930605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd44009400 con 0x7fdd500d0370 2023-12-20T04:44:20.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd4effd640 1 --2- 172.21.15.132:0/2302930605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd5015d100 0x7fdd5014fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:20.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd4f7fe640 1 --2- 172.21.15.132:0/2302930605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd500d0370 0x7fdd5006c000 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000d800 tx=0x7fdd4000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:20.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd37fff640 1 -- 172.21.15.132:0/2302930605 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4000b6c0 con 0x7fdd500d0370 2023-12-20T04:44:20.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd37fff640 1 -- 172.21.15.132:0/2302930605 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4000b820 con 0x7fdd500d0370 2023-12-20T04:44:20.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd37fff640 1 -- 172.21.15.132:0/2302930605 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4000bbb0 con 0x7fdd500d0370 2023-12-20T04:44:20.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd55d92640 1 -- 172.21.15.132:0/2302930605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd500c9f10 con 0x7fdd500d0370 2023-12-20T04:44:20.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.629+0000 7fdd55d92640 1 -- 172.21.15.132:0/2302930605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd500ca4d0 con 0x7fdd500d0370 2023-12-20T04:44:20.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.630+0000 7fdd55d92640 1 -- 172.21.15.132:0/2302930605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd50066480 con 0x7fdd500d0370 2023-12-20T04:44:20.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.631+0000 7fdd37fff640 1 -- 172.21.15.132:0/2302930605 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdd4000bd10 con 0x7fdd500d0370 2023-12-20T04:44:20.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.631+0000 7fdd37fff640 1 --2- 172.21.15.132:0/2302930605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd3c06a430 0x7fdd3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.631+0000 7fdd37fff640 1 -- 172.21.15.132:0/2302930605 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd40088da0 con 0x7fdd500d0370 2023-12-20T04:44:20.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.631+0000 7fdd4effd640 1 --2- 172.21.15.132:0/2302930605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd3c06a430 0x7fdd3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.632+0000 7fdd4effd640 1 --2- 172.21.15.132:0/2302930605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd3c06a430 0x7fdd3c06c8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdd44036000 tx=0x7fdd4403d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:20.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.635+0000 7fdd37fff640 1 -- 172.21.15.132:0/2302930605 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdd40054390 con 0x7fdd500d0370 2023-12-20T04:44:20.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.799+0000 7fdd55d92640 1 -- 172.21.15.132:0/2302930605 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdd50160d70 con 0x7fdd3c06a430 2023-12-20T04:44:20.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.805+0000 7fdd37fff640 1 -- 172.21.15.132:0/2302930605 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276088 (secure 0 0 0) 0x7fdd44031a90 con 0x7fdd3c06a430 2023-12-20T04:44:20.810 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:20.812 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:44:20.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.808+0000 7fdd55d92640 1 -- 172.21.15.132:0/2302930605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd3c06a430 msgr2=0x7fdd3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:20.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.808+0000 7fdd55d92640 1 --2- 172.21.15.132:0/2302930605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd3c06a430 0x7fdd3c06c8f0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7fdd44036000 tx=0x7fdd4403d040 comp rx=0 tx=0).stop 2023-12-20T04:44:20.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.808+0000 7fdd55d92640 1 -- 172.21.15.132:0/2302930605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd500d0370 msgr2=0x7fdd5006c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:20.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.808+0000 7fdd55d92640 1 --2- 172.21.15.132:0/2302930605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd500d0370 0x7fdd5006c000 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fdd4000d800 tx=0x7fdd4000dcc0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.809+0000 7fdd55d92640 1 -- 172.21.15.132:0/2302930605 shutdown_connections 2023-12-20T04:44:20.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.809+0000 7fdd55d92640 1 --2- 172.21.15.132:0/2302930605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd3c06a430 0x7fdd3c06c8f0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.809+0000 7fdd55d92640 1 --2- 172.21.15.132:0/2302930605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd50161850 0x7fdd50150400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.809+0000 7fdd55d92640 1 --2- 172.21.15.132:0/2302930605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd5015d100 0x7fdd5014fec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.809+0000 7fdd55d92640 1 --2- 172.21.15.132:0/2302930605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd500d0370 0x7fdd5006c000 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.809+0000 7fdd55d92640 1 -- 172.21.15.132:0/2302930605 >> 172.21.15.132:0/2302930605 conn(0x7fdd5006d7c0 msgr2=0x7fdd500cb0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:20.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.809+0000 7fdd55d92640 1 -- 172.21.15.132:0/2302930605 shutdown_connections 2023-12-20T04:44:20.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.809+0000 7fdd55d92640 1 -- 172.21.15.132:0/2302930605 wait complete. 2023-12-20T04:44:20.822 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2023-12-20T04:44:20.110810+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2734,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559765,"statfs":{"total":1600000000,"available":1597199998,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.304788"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809394+0000","last_change":"2023-12-20T04:44:15.809394+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809394+0000","last_undegraded":"2023-12-20T04:44:15.809394+0000","last_fullsized":"2023-12-20T04:44:15.809394+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:51.997296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810596+0000","last_change":"2023-12-20T04:44:15.810596+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810596+0000","last_undegraded":"2023-12-20T04:44:15.810596+0000","last_fullsized":"2023-12-20T04:44:15.810596+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:43:32.291032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808955+0000","last_change":"2023-12-20T04:44:15.808955+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808955+0000","last_undegraded":"2023-12-20T04:44:15.808955+0000","last_fullsized":"2023-12-20T04:44:15.808955+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:30:39.506732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810177+0000","last_change":"2023-12-20T04:44:15.810177+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810177+0000","last_undegraded":"2023-12-20T04:44:15.810177+0000","last_fullsized":"2023-12-20T04:44:15.810177+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809494+0000","last_change":"2023-12-20T04:44:15.809494+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809494+0000","last_undegraded":"2023-12-20T04:44:15.809494+0000","last_fullsized":"2023-12-20T04:44:15.809494+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:41:33.641196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810768+0000","last_change":"2023-12-20T04:44:15.810768+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810768+0000","last_undegraded":"2023-12-20T04:44:15.810768+0000","last_fullsized":"2023-12-20T04:44:15.810768+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:00:21.806708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809285+0000","last_change":"2023-12-20T04:44:15.809285+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809285+0000","last_undegraded":"2023-12-20T04:44:15.809285+0000","last_fullsized":"2023-12-20T04:44:15.809285+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:11:29.355282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808069+0000","last_change":"2023-12-20T04:44:15.808069+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808069+0000","last_undegraded":"2023-12-20T04:44:15.808069+0000","last_fullsized":"2023-12-20T04:44:15.808069+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:00:21.806708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810433+0000","last_change":"2023-12-20T04:44:15.810433+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810433+0000","last_undegraded":"2023-12-20T04:44:15.810433+0000","last_fullsized":"2023-12-20T04:44:15.810433+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:45:12.976332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.807738+0000","last_change":"2023-12-20T04:44:15.807738+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.807738+0000","last_undegraded":"2023-12-20T04:44:15.807738+0000","last_fullsized":"2023-12-20T04:44:15.807738+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:45:56.730088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808765+0000","last_change":"2023-12-20T04:44:15.808765+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808765+0000","last_undegraded":"2023-12-20T04:44:15.808765+0000","last_fullsized":"2023-12-20T04:44:15.808765+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:36:20.465368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.811064+0000","last_change":"2023-12-20T04:44:15.811064+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.811064+0000","last_undegraded":"2023-12-20T04:44:15.811064+0000","last_fullsized":"2023-12-20T04:44:15.811064+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:48:39.434329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808978+0000","last_change":"2023-12-20T04:44:15.808978+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808978+0000","last_undegraded":"2023-12-20T04:44:15.808978+0000","last_fullsized":"2023-12-20T04:44:15.808978+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:30:39.506732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809731+0000","last_change":"2023-12-20T04:44:15.809731+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809731+0000","last_undegraded":"2023-12-20T04:44:15.809731+0000","last_fullsized":"2023-12-20T04:44:15.809731+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:21:56.993244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809072+0000","last_change":"2023-12-20T04:44:15.809072+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809072+0000","last_undegraded":"2023-12-20T04:44:15.809072+0000","last_fullsized":"2023-12-20T04:44:15.809072+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:14:03.265816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.807799+0000","last_change":"2023-12-20T04:44:15.807799+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.807799+0000","last_undegraded":"2023-12-20T04:44:15.807799+0000","last_fullsized":"2023-12-20T04:44:15.807799+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:03.599978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810740+0000","last_change":"2023-12-20T04:44:15.810740+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810740+0000","last_undegraded":"2023-12-20T04:44:15.810740+0000","last_fullsized":"2023-12-20T04:44:15.810740+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:03:38.448781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.811378+0000","last_change":"2023-12-20T04:44:15.811378+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.811378+0000","last_undegraded":"2023-12-20T04:44:15.811378+0000","last_fullsized":"2023-12-20T04:44:15.811378+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:04:44.530883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809145+0000","last_change":"2023-12-20T04:44:15.809145+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809145+0000","last_undegraded":"2023-12-20T04:44:15.809145+0000","last_fullsized":"2023-12-20T04:44:15.809145+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:45.809267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808748+0000","last_change":"2023-12-20T04:44:15.808748+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808748+0000","last_undegraded":"2023-12-20T04:44:15.808748+0000","last_fullsized":"2023-12-20T04:44:15.808748+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:21:56.993244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808994+0000","last_change":"2023-12-20T04:44:15.808994+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808994+0000","last_undegraded":"2023-12-20T04:44:15.808994+0000","last_fullsized":"2023-12-20T04:44:15.808994+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808742+0000","last_change":"2023-12-20T04:44:15.808742+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808742+0000","last_undegraded":"2023-12-20T04:44:15.808742+0000","last_fullsized":"2023-12-20T04:44:15.808742+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:23.840378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.807732+0000","last_change":"2023-12-20T04:44:15.807732+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.807732+0000","last_undegraded":"2023-12-20T04:44:15.807732+0000","last_fullsized":"2023-12-20T04:44:15.807732+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:43:25.969506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809385+0000","last_change":"2023-12-20T04:44:15.809385+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809385+0000","last_undegraded":"2023-12-20T04:44:15.809385+0000","last_fullsized":"2023-12-20T04:44:15.809385+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:46:29.128311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808626+0000","last_change":"2023-12-20T04:44:15.808626+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808626+0000","last_undegraded":"2023-12-20T04:44:15.808626+0000","last_fullsized":"2023-12-20T04:44:15.808626+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:37:42.342927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809327+0000","last_change":"2023-12-20T04:44:15.809327+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809327+0000","last_undegraded":"2023-12-20T04:44:15.809327+0000","last_fullsized":"2023-12-20T04:44:15.809327+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:02:34.348449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808638+0000","last_change":"2023-12-20T04:44:15.808638+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808638+0000","last_undegraded":"2023-12-20T04:44:15.808638+0000","last_fullsized":"2023-12-20T04:44:15.808638+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809039+0000","last_change":"2023-12-20T04:44:15.809039+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809039+0000","last_undegraded":"2023-12-20T04:44:15.809039+0000","last_fullsized":"2023-12-20T04:44:15.809039+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:45.809267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810905+0000","last_change":"2023-12-20T04:44:15.810905+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810905+0000","last_undegraded":"2023-12-20T04:44:15.810905+0000","last_fullsized":"2023-12-20T04:44:15.810905+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:12:23.948724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808506+0000","last_change":"2023-12-20T04:44:15.808506+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808506+0000","last_undegraded":"2023-12-20T04:44:15.808506+0000","last_fullsized":"2023-12-20T04:44:15.808506+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:51.997296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.807748+0000","last_change":"2023-12-20T04:44:15.807748+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.807748+0000","last_undegraded":"2023-12-20T04:44:15.807748+0000","last_fullsized":"2023-12-20T04:44:15.807748+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:06:02.833861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808726+0000","last_change":"2023-12-20T04:44:15.808726+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808726+0000","last_undegraded":"2023-12-20T04:44:15.808726+0000","last_fullsized":"2023-12-20T04:44:15.808726+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:35:29.288461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":183,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-20T04:44:13.676958+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:44:13.676958+0000","last_peered":"2023-12-20T04:44:13.676958+0000","last_clean":"2023-12-20T04:44:13.676958+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:44:13.676958+0000","last_undegraded":"2023-12-20T04:44:13.676958+0000","last_fullsized":"2023-12-20T04:44:13.676958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":772,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194539,"statfs":{"total":200000000,"available":199208678,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.63200000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.65200000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.75},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.502},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.71299999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.73299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.53700000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.47499999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.45000000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.505},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.39400000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.60899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.59399999999999997}]},{"osd":1,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.56799999999999995}]},{"osd":2,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.60499999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.46000000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52500000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.621},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.48599999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.61899999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54000000000000004}]},{"osd":3,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.59299999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.497},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.42499999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.44800000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.22},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.27500000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.26400000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.29199999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54500000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44500000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.434}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.501},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.374,"5min":0.374,"15min":0.374},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.32600000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.313}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.34999999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.46400000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.44500000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.503},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41299999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.55800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":201,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195110,"statfs":{"total":200000000,"available":199793229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.34899999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.376}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.316}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.42999999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.53200000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.51900000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.497},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.48699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":778,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194534,"statfs":{"total":200000000,"available":199202861,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.39800000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.38},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.35099999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.41499999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.61099999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.52600000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.624},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54100000000000004}]}]}],"pool_statfs":[]}} 2023-12-20T04:44:20.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3f is not active+clean 2023-12-20T04:44:20.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3e is not active+clean 2023-12-20T04:44:20.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3d is not active+clean 2023-12-20T04:44:20.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3c is not active+clean 2023-12-20T04:44:20.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3b is not active+clean 2023-12-20T04:44:20.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3a is not active+clean 2023-12-20T04:44:20.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.39 is not active+clean 2023-12-20T04:44:20.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.38 is not active+clean 2023-12-20T04:44:20.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.37 is not active+clean 2023-12-20T04:44:20.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.36 is not active+clean 2023-12-20T04:44:20.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.35 is not active+clean 2023-12-20T04:44:20.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.34 is not active+clean 2023-12-20T04:44:20.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.33 is not active+clean 2023-12-20T04:44:20.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.32 is not active+clean 2023-12-20T04:44:20.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.31 is not active+clean 2023-12-20T04:44:20.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.30 is not active+clean 2023-12-20T04:44:20.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2f is not active+clean 2023-12-20T04:44:20.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2e is not active+clean 2023-12-20T04:44:20.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.830 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2d is not active+clean 2023-12-20T04:44:20.830 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2c is not active+clean 2023-12-20T04:44:20.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2b is not active+clean 2023-12-20T04:44:20.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2a is not active+clean 2023-12-20T04:44:20.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.29 is not active+clean 2023-12-20T04:44:20.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.28 is not active+clean 2023-12-20T04:44:20.831 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.831 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.27 is not active+clean 2023-12-20T04:44:20.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.26 is not active+clean 2023-12-20T04:44:20.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.25 is not active+clean 2023-12-20T04:44:20.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.24 is not active+clean 2023-12-20T04:44:20.832 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.832 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.23 is not active+clean 2023-12-20T04:44:20.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.22 is not active+clean 2023-12-20T04:44:20.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.21 is not active+clean 2023-12-20T04:44:20.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.20 is not active+clean 2023-12-20T04:44:20.833 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.833 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1e is not active+clean 2023-12-20T04:44:20.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1f is not active+clean 2023-12-20T04:44:20.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.809394+0000', 'last_change': '2023-12-20T04:44:15.809394+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.809394+0000', 'last_undegraded': '2023-12-20T04:44:15.809394+0000', 'last_fullsized': '2023-12-20T04:44:15.809394+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T11:48:51.997296+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:44:20.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1f is not active+clean 2023-12-20T04:44:20.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1e is not active+clean 2023-12-20T04:44:20.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.810596+0000', 'last_change': '2023-12-20T04:44:15.810596+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.810596+0000', 'last_undegraded': '2023-12-20T04:44:15.810596+0000', 'last_fullsized': '2023-12-20T04:44:15.810596+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T12:43:32.291032+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:44:20.834 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1c is not active+clean 2023-12-20T04:44:20.834 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1d is not active+clean 2023-12-20T04:44:20.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.808955+0000', 'last_change': '2023-12-20T04:44:15.808955+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.808955+0000', 'last_undegraded': '2023-12-20T04:44:15.808955+0000', 'last_fullsized': '2023-12-20T04:44:15.808955+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T05:30:39.506732+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:44:20.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1d is not active+clean 2023-12-20T04:44:20.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1c is not active+clean 2023-12-20T04:44:20.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.810177+0000', 'last_change': '2023-12-20T04:44:15.810177+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.810177+0000', 'last_undegraded': '2023-12-20T04:44:15.810177+0000', 'last_fullsized': '2023-12-20T04:44:15.810177+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:44:20.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1a is not active+clean 2023-12-20T04:44:20.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.835 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1b is not active+clean 2023-12-20T04:44:20.835 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.809494+0000', 'last_change': '2023-12-20T04:44:15.809494+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.809494+0000', 'last_undegraded': '2023-12-20T04:44:15.809494+0000', 'last_fullsized': '2023-12-20T04:44:15.809494+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T16:41:33.641196+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:44:20.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1b is not active+clean 2023-12-20T04:44:20.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1a is not active+clean 2023-12-20T04:44:20.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.810768+0000', 'last_change': '2023-12-20T04:44:15.810768+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.810768+0000', 'last_undegraded': '2023-12-20T04:44:15.810768+0000', 'last_fullsized': '2023-12-20T04:44:15.810768+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T14:00:21.806708+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 5], 'acting': [4, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:44:20.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.18 is not active+clean 2023-12-20T04:44:20.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.19 is not active+clean 2023-12-20T04:44:20.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.809285+0000', 'last_change': '2023-12-20T04:44:15.809285+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.809285+0000', 'last_undegraded': '2023-12-20T04:44:15.809285+0000', 'last_fullsized': '2023-12-20T04:44:15.809285+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T13:11:29.355282+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:44:20.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.19 is not active+clean 2023-12-20T04:44:20.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.836 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.18 is not active+clean 2023-12-20T04:44:20.836 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.808069+0000', 'last_change': '2023-12-20T04:44:15.808069+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.808069+0000', 'last_undegraded': '2023-12-20T04:44:15.808069+0000', 'last_fullsized': '2023-12-20T04:44:15.808069+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T14:00:21.806708+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:44:20.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.16 is not active+clean 2023-12-20T04:44:20.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.17 is not active+clean 2023-12-20T04:44:20.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.810433+0000', 'last_change': '2023-12-20T04:44:15.810433+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.810433+0000', 'last_undegraded': '2023-12-20T04:44:15.810433+0000', 'last_fullsized': '2023-12-20T04:44:15.810433+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T13:45:12.976332+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 2], 'acting': [4, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:44:20.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.17 is not active+clean 2023-12-20T04:44:20.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.16 is not active+clean 2023-12-20T04:44:20.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.807738+0000', 'last_change': '2023-12-20T04:44:15.807738+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.807738+0000', 'last_undegraded': '2023-12-20T04:44:15.807738+0000', 'last_fullsized': '2023-12-20T04:44:15.807738+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T13:45:56.730088+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:44:20.837 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.14 is not active+clean 2023-12-20T04:44:20.837 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.15 is not active+clean 2023-12-20T04:44:20.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.808765+0000', 'last_change': '2023-12-20T04:44:15.808765+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.808765+0000', 'last_undegraded': '2023-12-20T04:44:15.808765+0000', 'last_fullsized': '2023-12-20T04:44:15.808765+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T14:36:20.465368+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:44:20.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.15 is not active+clean 2023-12-20T04:44:20.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.14 is not active+clean 2023-12-20T04:44:20.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.811064+0000', 'last_change': '2023-12-20T04:44:15.811064+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.811064+0000', 'last_undegraded': '2023-12-20T04:44:15.811064+0000', 'last_fullsized': '2023-12-20T04:44:15.811064+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T05:48:39.434329+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:44:20.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.12 is not active+clean 2023-12-20T04:44:20.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.838 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.13 is not active+clean 2023-12-20T04:44:20.838 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.808978+0000', 'last_change': '2023-12-20T04:44:15.808978+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.808978+0000', 'last_undegraded': '2023-12-20T04:44:15.808978+0000', 'last_fullsized': '2023-12-20T04:44:15.808978+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T05:30:39.506732+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:44:20.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.13 is not active+clean 2023-12-20T04:44:20.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.12 is not active+clean 2023-12-20T04:44:20.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.809731+0000', 'last_change': '2023-12-20T04:44:15.809731+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.809731+0000', 'last_undegraded': '2023-12-20T04:44:15.809731+0000', 'last_fullsized': '2023-12-20T04:44:15.809731+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:21:56.993244+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:44:20.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.10 is not active+clean 2023-12-20T04:44:20.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.11 is not active+clean 2023-12-20T04:44:20.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.809072+0000', 'last_change': '2023-12-20T04:44:15.809072+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.809072+0000', 'last_undegraded': '2023-12-20T04:44:15.809072+0000', 'last_fullsized': '2023-12-20T04:44:15.809072+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T11:14:03.265816+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:44:20.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.11 is not active+clean 2023-12-20T04:44:20.839 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.839 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.10 is not active+clean 2023-12-20T04:44:20.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.807799+0000', 'last_change': '2023-12-20T04:44:15.807799+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.807799+0000', 'last_undegraded': '2023-12-20T04:44:15.807799+0000', 'last_fullsized': '2023-12-20T04:44:15.807799+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T05:38:03.599978+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:44:20.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.e is not active+clean 2023-12-20T04:44:20.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.f is not active+clean 2023-12-20T04:44:20.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.810740+0000', 'last_change': '2023-12-20T04:44:15.810740+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.810740+0000', 'last_undegraded': '2023-12-20T04:44:15.810740+0000', 'last_fullsized': '2023-12-20T04:44:15.810740+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T08:03:38.448781+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 3], 'acting': [2, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:44:20.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.f is not active+clean 2023-12-20T04:44:20.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.e is not active+clean 2023-12-20T04:44:20.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.811378+0000', 'last_change': '2023-12-20T04:44:15.811378+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.811378+0000', 'last_undegraded': '2023-12-20T04:44:15.811378+0000', 'last_fullsized': '2023-12-20T04:44:15.811378+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T13:04:44.530883+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:44:20.840 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.c is not active+clean 2023-12-20T04:44:20.840 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.d is not active+clean 2023-12-20T04:44:20.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.809145+0000', 'last_change': '2023-12-20T04:44:15.809145+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.809145+0000', 'last_undegraded': '2023-12-20T04:44:15.809145+0000', 'last_fullsized': '2023-12-20T04:44:15.809145+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T07:25:45.809267+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:44:20.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.d is not active+clean 2023-12-20T04:44:20.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.c is not active+clean 2023-12-20T04:44:20.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.808748+0000', 'last_change': '2023-12-20T04:44:15.808748+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.808748+0000', 'last_undegraded': '2023-12-20T04:44:15.808748+0000', 'last_fullsized': '2023-12-20T04:44:15.808748+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:21:56.993244+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:44:20.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.a is not active+clean 2023-12-20T04:44:20.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.841 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.b is not active+clean 2023-12-20T04:44:20.841 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.808994+0000', 'last_change': '2023-12-20T04:44:15.808994+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.808994+0000', 'last_undegraded': '2023-12-20T04:44:15.808994+0000', 'last_fullsized': '2023-12-20T04:44:15.808994+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:44:20.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.b is not active+clean 2023-12-20T04:44:20.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.a is not active+clean 2023-12-20T04:44:20.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.808742+0000', 'last_change': '2023-12-20T04:44:15.808742+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.808742+0000', 'last_undegraded': '2023-12-20T04:44:15.808742+0000', 'last_fullsized': '2023-12-20T04:44:15.808742+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T13:30:23.840378+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:44:20.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.8 is not active+clean 2023-12-20T04:44:20.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.842 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.9 is not active+clean 2023-12-20T04:44:20.842 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.807732+0000', 'last_change': '2023-12-20T04:44:15.807732+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.807732+0000', 'last_undegraded': '2023-12-20T04:44:15.807732+0000', 'last_fullsized': '2023-12-20T04:44:15.807732+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:43:25.969506+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:44:20.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.9 is not active+clean 2023-12-20T04:44:20.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.8 is not active+clean 2023-12-20T04:44:20.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.809385+0000', 'last_change': '2023-12-20T04:44:15.809385+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.809385+0000', 'last_undegraded': '2023-12-20T04:44:15.809385+0000', 'last_fullsized': '2023-12-20T04:44:15.809385+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T14:46:29.128311+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 2], 'acting': [7, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:44:20.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.7 is not active+clean 2023-12-20T04:44:20.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.6 is not active+clean 2023-12-20T04:44:20.843 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.808626+0000', 'last_change': '2023-12-20T04:44:15.808626+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.808626+0000', 'last_undegraded': '2023-12-20T04:44:15.808626+0000', 'last_fullsized': '2023-12-20T04:44:15.808626+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T08:37:42.342927+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:44:20.843 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.4 is not active+clean 2023-12-20T04:44:20.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.5 is not active+clean 2023-12-20T04:44:20.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.809327+0000', 'last_change': '2023-12-20T04:44:15.809327+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.809327+0000', 'last_undegraded': '2023-12-20T04:44:15.809327+0000', 'last_fullsized': '2023-12-20T04:44:15.809327+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T06:02:34.348449+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:44:20.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.5 is not active+clean 2023-12-20T04:44:20.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.4 is not active+clean 2023-12-20T04:44:20.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.808638+0000', 'last_change': '2023-12-20T04:44:15.808638+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.808638+0000', 'last_undegraded': '2023-12-20T04:44:15.808638+0000', 'last_fullsized': '2023-12-20T04:44:15.808638+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 5], 'acting': [1, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:44:20.844 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.2 is not active+clean 2023-12-20T04:44:20.844 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.3 is not active+clean 2023-12-20T04:44:20.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.809039+0000', 'last_change': '2023-12-20T04:44:15.809039+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.809039+0000', 'last_undegraded': '2023-12-20T04:44:15.809039+0000', 'last_fullsized': '2023-12-20T04:44:15.809039+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T07:25:45.809267+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:44:20.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.3 is not active+clean 2023-12-20T04:44:20.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.2 is not active+clean 2023-12-20T04:44:20.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.810905+0000', 'last_change': '2023-12-20T04:44:15.810905+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.810905+0000', 'last_undegraded': '2023-12-20T04:44:15.810905+0000', 'last_fullsized': '2023-12-20T04:44:15.810905+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:12:23.948724+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:44:20.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.0 is not active+clean 2023-12-20T04:44:20.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.1 is not active+clean 2023-12-20T04:44:20.845 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.808506+0000', 'last_change': '2023-12-20T04:44:15.808506+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.808506+0000', 'last_undegraded': '2023-12-20T04:44:15.808506+0000', 'last_fullsized': '2023-12-20T04:44:15.808506+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T11:48:51.997296+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 6], 'acting': [1, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:44:20.845 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.1 is not active+clean 2023-12-20T04:44:20.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.0 is not active+clean 2023-12-20T04:44:20.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.807748+0000', 'last_change': '2023-12-20T04:44:15.807748+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.807748+0000', 'last_undegraded': '2023-12-20T04:44:15.807748+0000', 'last_fullsized': '2023-12-20T04:44:15.807748+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T11:06:02.833861+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:44:20.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 7.6 is not active+clean 2023-12-20T04:44:20.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '7.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:44:16.806167+0000', 'last_change': '2023-12-20T04:44:16.806167+0000', 'last_active': '2023-12-20T04:44:16.806167+0000', 'last_peered': '2023-12-20T04:44:16.806167+0000', 'last_clean': '2023-12-20T04:44:16.806167+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:16.806167+0000', 'last_undegraded': '2023-12-20T04:44:16.806167+0000', 'last_fullsized': '2023-12-20T04:44:16.806167+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:16.806167+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:44:20.846 INFO:tasks.cephfs.filesystem.ceph_manager:PG 6.7 is not active+clean 2023-12-20T04:44:20.846 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '6.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 44, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:44:15.808726+0000', 'last_change': '2023-12-20T04:44:15.808726+0000', 'last_active': '2023-12-20T04:44:15.803986+0000', 'last_peered': '2023-12-20T04:44:15.803986+0000', 'last_clean': '2023-12-20T04:44:15.803986+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:44:15.808726+0000', 'last_undegraded': '2023-12-20T04:44:15.808726+0000', 'last_fullsized': '2023-12-20T04:44:15.808726+0000', 'mapping_epoch': 44, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 44, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'last_clean_scrub_stamp': '2023-12-20T04:44:15.803986+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T12:35:29.288461+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:44:20.847 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-20T04:44:20.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.959+0000 7f9861900640 1 Processor -- start 2023-12-20T04:44:20.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.959+0000 7f9861900640 1 -- start start 2023-12-20T04:44:20.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.960+0000 7f9861900640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985c0b4f90 0x7f985c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.960+0000 7f9861900640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f985c0b1d10 0x7f985c0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.960+0000 7f9861900640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f985c0cd660 con 0x7f985c15d110 2023-12-20T04:44:20.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.960+0000 7f9861900640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f985c0cd940 con 0x7f985c0b1d10 2023-12-20T04:44:20.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.960+0000 7f9861900640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c160e60 con 0x7f985c0b4f90 2023-12-20T04:44:20.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.960+0000 7f985b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f985c0b1d10 0x7f985c0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.960+0000 7f985affd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f985c15d110 0x7f985c0b4880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46886/0 (socket says 172.21.15.132:46886) 2023-12-20T04:44:20.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.960+0000 7f985affd640 1 -- 172.21.15.132:0/159237592 learned_addr learned my addr 172.21.15.132:0/159237592 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:20.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.960+0000 7f9853fff640 1 --2- 172.21.15.132:0/159237592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985c0b4f90 0x7f985c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.961+0000 7f985b7fe640 1 -- 172.21.15.132:0/159237592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985c0b4f90 msgr2=0x7f985c0b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:20.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.961+0000 7f985b7fe640 1 --2- 172.21.15.132:0/159237592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985c0b4f90 0x7f985c0b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.961+0000 7f985b7fe640 1 -- 172.21.15.132:0/159237592 >> v1:172.21.15.132:6789/0 conn(0x7f985c15d110 legacy=0x7f985c0b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:20.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.961+0000 7f985b7fe640 1 -- 172.21.15.132:0/159237592 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f985c161140 con 0x7f985c0b1d10 2023-12-20T04:44:20.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.961+0000 7f985a7fc640 1 -- 172.21.15.132:0/159237592 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2022711123 0 0) 0x7f985c0cd660 con 0x7f985c15d110 2023-12-20T04:44:20.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.961+0000 7f985b7fe640 1 --2- 172.21.15.132:0/159237592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985c0b1d10 0x7f985c0d0f60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9854009d90 tx=0x7f985402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=21a46176576433ea server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:20.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.961+0000 7f985a7fc640 1 -- 172.21.15.132:0/159237592 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f985402cc50 con 0x7f985c0b1d10 2023-12-20T04:44:20.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.961+0000 7f985a7fc640 1 -- 172.21.15.132:0/159237592 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f985402cdb0 con 0x7f985c0b1d10 2023-12-20T04:44:20.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.962+0000 7f985a7fc640 1 -- 172.21.15.132:0/159237592 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9854034660 con 0x7f985c0b1d10 2023-12-20T04:44:20.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.962+0000 7f9861900640 1 -- 172.21.15.132:0/159237592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985c0b1d10 msgr2=0x7f985c0d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:20.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.962+0000 7f9861900640 1 --2- 172.21.15.132:0/159237592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985c0b1d10 0x7f985c0d0f60 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f9854009d90 tx=0x7f985402bea0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.962+0000 7f9861900640 1 -- 172.21.15.132:0/159237592 shutdown_connections 2023-12-20T04:44:20.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.962+0000 7f9861900640 1 --2- 172.21.15.132:0/159237592 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985c0b1d10 0x7f985c0d0f60 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.962+0000 7f9861900640 1 --2- 172.21.15.132:0/159237592 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985c0b4f90 0x7f985c0b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.962+0000 7f9861900640 1 -- 172.21.15.132:0/159237592 >> 172.21.15.132:0/159237592 conn(0x7f985c0cf880 msgr2=0x7f985c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:20.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.962+0000 7f9861900640 1 -- 172.21.15.132:0/159237592 shutdown_connections 2023-12-20T04:44:20.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.962+0000 7f9861900640 1 -- 172.21.15.132:0/159237592 wait complete. 2023-12-20T04:44:20.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.963+0000 7f9861900640 1 Processor -- start 2023-12-20T04:44:20.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.963+0000 7f9861900640 1 -- start start 2023-12-20T04:44:20.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.964+0000 7f9861900640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985c0b1d10 0x7f985c0c9ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.964+0000 7f9861900640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985c0b4f90 0x7f985c150fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.964+0000 7f9861900640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f985c15d110 0x7f985c1547c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.964+0000 7f9861900640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c1530a0 con 0x7f985c0b1d10 2023-12-20T04:44:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.964+0000 7f9861900640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985c15e0b0 con 0x7f985c15d110 2023-12-20T04:44:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.964+0000 7f9861900640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f985c15e390 con 0x7f985c0b4f90 2023-12-20T04:44:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.964+0000 7f985affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985c0b1d10 0x7f985c0c9ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.964+0000 7f985affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985c0b1d10 0x7f985c0c9ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56962/0 (socket says 172.21.15.132:56962) 2023-12-20T04:44:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.964+0000 7f985affd640 1 -- 172.21.15.132:0/3119580835 learned_addr learned my addr 172.21.15.132:0/3119580835 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.964+0000 7f9853fff640 1 --2- 172.21.15.132:0/3119580835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985c0b4f90 0x7f985c150fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.964+0000 7f985affd640 1 -- 172.21.15.132:0/3119580835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985c0b4f90 msgr2=0x7f985c150fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.964+0000 7f985affd640 1 --2- 172.21.15.132:0/3119580835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985c0b4f90 0x7f985c150fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.964+0000 7f985affd640 1 -- 172.21.15.132:0/3119580835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f985c15d110 msgr2=0x7f985c1547c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.964+0000 7f985affd640 1 --2- 172.21.15.132:0/3119580835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f985c15d110 0x7f985c1547c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:20.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.964+0000 7f985affd640 1 -- 172.21.15.132:0/3119580835 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9854009a70 con 0x7f985c0b1d10 2023-12-20T04:44:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.964+0000 7f9853fff640 1 --2- 172.21.15.132:0/3119580835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985c0b4f90 0x7f985c150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.964+0000 7f985affd640 1 --2- 172.21.15.132:0/3119580835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985c0b1d10 0x7f985c0c9ed0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f984c00c430 tx=0x7f984c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.965+0000 7f9858ff9640 1 -- 172.21.15.132:0/3119580835 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c0074e0 con 0x7f985c0b1d10 2023-12-20T04:44:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.965+0000 7f9858ff9640 1 -- 172.21.15.132:0/3119580835 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984c007660 con 0x7f985c0b1d10 2023-12-20T04:44:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.965+0000 7f9861900640 1 -- 172.21.15.132:0/3119580835 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f985c15e670 con 0x7f985c0b1d10 2023-12-20T04:44:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.965+0000 7f9858ff9640 1 -- 172.21.15.132:0/3119580835 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c004a20 con 0x7f985c0b1d10 2023-12-20T04:44:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.965+0000 7f9861900640 1 -- 172.21.15.132:0/3119580835 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f985c151520 con 0x7f985c0b1d10 2023-12-20T04:44:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.966+0000 7f9861900640 1 -- 172.21.15.132:0/3119580835 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985c04e840 con 0x7f985c0b1d10 2023-12-20T04:44:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.966+0000 7f9858ff9640 1 -- 172.21.15.132:0/3119580835 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f984c004b80 con 0x7f985c0b1d10 2023-12-20T04:44:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.966+0000 7f9858ff9640 1 --2- 172.21.15.132:0/3119580835 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f983c06a460 0x7f983c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.966+0000 7f9858ff9640 1 -- 172.21.15.132:0/3119580835 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f984c088760 con 0x7f985c0b1d10 2023-12-20T04:44:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.967+0000 7f9853fff640 1 --2- 172.21.15.132:0/3119580835 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f983c06a460 0x7f983c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:20.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.967+0000 7f9853fff640 1 --2- 172.21.15.132:0/3119580835 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f983c06a460 0x7f983c06c920 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f985c154540 tx=0x7f9844008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:20.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:20.971+0000 7f9858ff9640 1 -- 172.21.15.132:0/3119580835 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f984c053d50 con 0x7f985c0b1d10 2023-12-20T04:44:21.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.200+0000 7f9861900640 1 -- 172.21.15.132:0/3119580835 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f985c0d0b10 con 0x7f985c0b1d10 2023-12-20T04:44:21.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.200+0000 7f9858ff9640 1 -- 172.21.15.132:0/3119580835 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1650 (secure 0 0 0) 0x7f984c057370 con 0x7f985c0b1d10 2023-12-20T04:44:21.202 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:21.203 INFO:teuthology.orchestra.run.smithi132.stdout:{"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":111,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":47,"num_osds":8,"num_up_osds":8,"osd_up_since":1703047355,"num_in_osds":8,"osd_in_since":1703047352,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":2800002,"bytes_avail":1597199998,"bytes_total":1600000000,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":19,"id":3,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":3,"rank":0,"name":"c","status":"up:active","gid":5685}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":2,"modified":"2023-12-20T04:43:36.103133+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-20T04:44:21.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.202+0000 7f9861900640 1 -- 172.21.15.132:0/3119580835 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f983c06a460 msgr2=0x7f983c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:21.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.202+0000 7f9861900640 1 --2- 172.21.15.132:0/3119580835 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f983c06a460 0x7f983c06c920 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f985c154540 tx=0x7f9844008040 comp rx=0 tx=0).stop 2023-12-20T04:44:21.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.202+0000 7f9861900640 1 -- 172.21.15.132:0/3119580835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985c0b1d10 msgr2=0x7f985c0c9ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:21.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.202+0000 7f9861900640 1 --2- 172.21.15.132:0/3119580835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985c0b1d10 0x7f985c0c9ed0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f984c00c430 tx=0x7f984c00c8f0 comp rx=0 tx=0).stop 2023-12-20T04:44:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.202+0000 7f9861900640 1 -- 172.21.15.132:0/3119580835 shutdown_connections 2023-12-20T04:44:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.202+0000 7f9861900640 1 --2- 172.21.15.132:0/3119580835 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f983c06a460 0x7f983c06c920 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.202+0000 7f9861900640 1 --2- 172.21.15.132:0/3119580835 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f985c15d110 0x7f985c1547c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.202+0000 7f9861900640 1 --2- 172.21.15.132:0/3119580835 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985c0b4f90 0x7f985c150fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.202+0000 7f9861900640 1 --2- 172.21.15.132:0/3119580835 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985c0b1d10 0x7f985c0c9ed0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.202+0000 7f9861900640 1 -- 172.21.15.132:0/3119580835 >> 172.21.15.132:0/3119580835 conn(0x7f985c0cf880 msgr2=0x7f985c0b67a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.202+0000 7f9861900640 1 -- 172.21.15.132:0/3119580835 shutdown_connections 2023-12-20T04:44:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.202+0000 7f9861900640 1 -- 172.21.15.132:0/3119580835 wait complete. 2023-12-20T04:44:21.215 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-20T04:44:21.215 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:44:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.313+0000 7f45307cb640 1 Processor -- start 2023-12-20T04:44:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.313+0000 7f45307cb640 1 -- start start 2023-12-20T04:44:21.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.314+0000 7f45307cb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f452815cef0 0x7f45280cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:21.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.314+0000 7f45307cb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45280ad760 con 0x7f452815d2d0 2023-12-20T04:44:21.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.314+0000 7f45307cb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45280add30 con 0x7f45280ad2f0 2023-12-20T04:44:21.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.314+0000 7f45307cb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45280ae010 con 0x7f452815cef0 2023-12-20T04:44:21.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.314+0000 7f452e567640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f452815cef0 0x7f45280cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:21.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.314+0000 7f452dd66640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f452815d2d0 0x7f45280cd1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46888/0 (socket says 172.21.15.132:46888) 2023-12-20T04:44:21.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.314+0000 7f452e567640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f452815cef0 0x7f45280cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56968/0 (socket says 172.21.15.132:56968) 2023-12-20T04:44:21.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.314+0000 7f452dd66640 1 -- 172.21.15.132:0/2339196481 learned_addr learned my addr 172.21.15.132:0/2339196481 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:21.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.314+0000 7f452e567640 1 -- 172.21.15.132:0/2339196481 >> v1:172.21.15.187:6789/0 conn(0x7f45280ad2f0 legacy=0x7f452806bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:21.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.314+0000 7f452e567640 1 -- 172.21.15.132:0/2339196481 >> v1:172.21.15.132:6789/0 conn(0x7f452815d2d0 legacy=0x7f45280cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:21.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.314+0000 7f452e567640 1 -- 172.21.15.132:0/2339196481 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4528072d00 con 0x7f452815cef0 2023-12-20T04:44:21.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.314+0000 7f452d565640 1 -- 172.21.15.132:0/2339196481 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3082651244 0 0) 0x7f45280ad760 con 0x7f452815d2d0 2023-12-20T04:44:21.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.315+0000 7f452e567640 1 --2- 172.21.15.132:0/2339196481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452815cef0 0x7f45280cecc0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4524009d90 tx=0x7f452402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf00059c38e3444 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:21.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.315+0000 7f452d565640 1 -- 172.21.15.132:0/2339196481 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f452402cd00 con 0x7f452815cef0 2023-12-20T04:44:21.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.315+0000 7f452d565640 1 -- 172.21.15.132:0/2339196481 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f452402ce60 con 0x7f452815cef0 2023-12-20T04:44:21.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.315+0000 7f452d565640 1 -- 172.21.15.132:0/2339196481 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4524034660 con 0x7f452815cef0 2023-12-20T04:44:21.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.316+0000 7f45307cb640 1 -- 172.21.15.132:0/2339196481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452815cef0 msgr2=0x7f45280cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:21.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.316+0000 7f45307cb640 1 --2- 172.21.15.132:0/2339196481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452815cef0 0x7f45280cecc0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f4524009d90 tx=0x7f452402bf50 comp rx=0 tx=0).stop 2023-12-20T04:44:21.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.316+0000 7f45307cb640 1 -- 172.21.15.132:0/2339196481 shutdown_connections 2023-12-20T04:44:21.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.316+0000 7f45307cb640 1 --2- 172.21.15.132:0/2339196481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452815cef0 0x7f45280cecc0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:21.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.316+0000 7f45307cb640 1 -- 172.21.15.132:0/2339196481 >> 172.21.15.132:0/2339196481 conn(0x7f45280cf330 msgr2=0x7f45280cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:21.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.316+0000 7f45307cb640 1 -- 172.21.15.132:0/2339196481 shutdown_connections 2023-12-20T04:44:21.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.316+0000 7f45307cb640 1 -- 172.21.15.132:0/2339196481 wait complete. 2023-12-20T04:44:21.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.317+0000 7f45307cb640 1 Processor -- start 2023-12-20T04:44:21.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.317+0000 7f45307cb640 1 -- start start 2023-12-20T04:44:21.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f45307cb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45280ad2f0 0x7f452815fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:21.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f45307cb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f452815cef0 0x7f45281f6160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:21.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f45307cb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452815d2d0 0x7f45281f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:21.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f45307cb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45281f6dd0 con 0x7f452815d2d0 2023-12-20T04:44:21.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f45307cb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f452815e730 con 0x7f45280ad2f0 2023-12-20T04:44:21.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f45307cb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f452815ea10 con 0x7f452815cef0 2023-12-20T04:44:21.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f452ed68640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452815d2d0 0x7f45281f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:21.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f452ed68640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452815d2d0 0x7f45281f2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56978/0 (socket says 172.21.15.132:56978) 2023-12-20T04:44:21.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f452ed68640 1 -- 172.21.15.132:0/2332592823 learned_addr learned my addr 172.21.15.132:0/2332592823 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:21.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f452dd66640 1 --2- 172.21.15.132:0/2332592823 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f452815cef0 0x7f45281f6160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:21.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f452e567640 1 --2- 172.21.15.132:0/2332592823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45280ad2f0 0x7f452815fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:21.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f452ed68640 1 -- 172.21.15.132:0/2332592823 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f452815cef0 msgr2=0x7f45281f6160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:21.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f452ed68640 1 --2- 172.21.15.132:0/2332592823 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f452815cef0 0x7f45281f6160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:21.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f452ed68640 1 -- 172.21.15.132:0/2332592823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45280ad2f0 msgr2=0x7f452815fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:21.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f452ed68640 1 --2- 172.21.15.132:0/2332592823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45280ad2f0 0x7f452815fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:21.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f452ed68640 1 -- 172.21.15.132:0/2332592823 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4524009a70 con 0x7f452815d2d0 2023-12-20T04:44:21.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f452e567640 1 --2- 172.21.15.132:0/2332592823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45280ad2f0 0x7f452815fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:21.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f452ed68640 1 --2- 172.21.15.132:0/2332592823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452815d2d0 0x7f45281f2e30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f452000c390 tx=0x7f452000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:21.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f451effd640 1 -- 172.21.15.132:0/2332592823 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45200035f0 con 0x7f452815d2d0 2023-12-20T04:44:21.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f451effd640 1 -- 172.21.15.132:0/2332592823 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4520003750 con 0x7f452815d2d0 2023-12-20T04:44:21.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f45307cb640 1 -- 172.21.15.132:0/2332592823 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f452815ecf0 con 0x7f452815d2d0 2023-12-20T04:44:21.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.318+0000 7f451effd640 1 -- 172.21.15.132:0/2332592823 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4520003b00 con 0x7f452815d2d0 2023-12-20T04:44:21.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.319+0000 7f45307cb640 1 -- 172.21.15.132:0/2332592823 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f452815f2b0 con 0x7f452815d2d0 2023-12-20T04:44:21.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.319+0000 7f45307cb640 1 -- 172.21.15.132:0/2332592823 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f452804e840 con 0x7f452815d2d0 2023-12-20T04:44:21.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.320+0000 7f451effd640 1 -- 172.21.15.132:0/2332592823 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4520003c60 con 0x7f452815d2d0 2023-12-20T04:44:21.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.320+0000 7f451effd640 1 --2- 172.21.15.132:0/2332592823 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f450c06a430 0x7f450c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:21.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.320+0000 7f451effd640 1 -- 172.21.15.132:0/2332592823 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4520087f70 con 0x7f452815d2d0 2023-12-20T04:44:21.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.320+0000 7f452e567640 1 --2- 172.21.15.132:0/2332592823 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f450c06a430 0x7f450c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:21.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.321+0000 7f452e567640 1 --2- 172.21.15.132:0/2332592823 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f450c06a430 0x7f450c06c8f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4524036000 tx=0x7f4524030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:21.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.325+0000 7f451effd640 1 -- 172.21.15.132:0/2332592823 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f45200baca0 con 0x7f452815d2d0 2023-12-20T04:44:21.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.486+0000 7f45307cb640 1 -- 172.21.15.132:0/2332592823 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4528072fe0 con 0x7f450c06a430 2023-12-20T04:44:21.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.492+0000 7f451effd640 1 -- 172.21.15.132:0/2332592823 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276088 (secure 0 0 0) 0x7f4524042070 con 0x7f450c06a430 2023-12-20T04:44:21.497 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:21.498 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:44:21.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.495+0000 7f45307cb640 1 -- 172.21.15.132:0/2332592823 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f450c06a430 msgr2=0x7f450c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:21.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.495+0000 7f45307cb640 1 --2- 172.21.15.132:0/2332592823 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f450c06a430 0x7f450c06c8f0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f4524036000 tx=0x7f4524030000 comp rx=0 tx=0).stop 2023-12-20T04:44:21.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.495+0000 7f45307cb640 1 -- 172.21.15.132:0/2332592823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452815d2d0 msgr2=0x7f45281f2e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:21.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.495+0000 7f45307cb640 1 --2- 172.21.15.132:0/2332592823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452815d2d0 0x7f45281f2e30 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f452000c390 tx=0x7f452000c850 comp rx=0 tx=0).stop 2023-12-20T04:44:21.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.496+0000 7f45307cb640 1 -- 172.21.15.132:0/2332592823 shutdown_connections 2023-12-20T04:44:21.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.496+0000 7f45307cb640 1 --2- 172.21.15.132:0/2332592823 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f450c06a430 0x7f450c06c8f0 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:21.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.496+0000 7f45307cb640 1 --2- 172.21.15.132:0/2332592823 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f452815d2d0 0x7f45281f2e30 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:21.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.496+0000 7f45307cb640 1 --2- 172.21.15.132:0/2332592823 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f452815cef0 0x7f45281f6160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:21.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.496+0000 7f45307cb640 1 --2- 172.21.15.132:0/2332592823 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45280ad2f0 0x7f452815fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:21.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.496+0000 7f45307cb640 1 -- 172.21.15.132:0/2332592823 >> 172.21.15.132:0/2332592823 conn(0x7f45280cf330 msgr2=0x7f45280ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:21.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.496+0000 7f45307cb640 1 -- 172.21.15.132:0/2332592823 shutdown_connections 2023-12-20T04:44:21.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:21.496+0000 7f45307cb640 1 -- 172.21.15.132:0/2332592823 wait complete. 2023-12-20T04:44:21.508 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":91,"stamp":"2023-12-20T04:44:20.110810+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":7,"num_osds":8,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2734,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559765,"statfs":{"total":1600000000,"available":1597199998,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.304788"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809394+0000","last_change":"2023-12-20T04:44:15.809394+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809394+0000","last_undegraded":"2023-12-20T04:44:15.809394+0000","last_fullsized":"2023-12-20T04:44:15.809394+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:51.997296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810596+0000","last_change":"2023-12-20T04:44:15.810596+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810596+0000","last_undegraded":"2023-12-20T04:44:15.810596+0000","last_fullsized":"2023-12-20T04:44:15.810596+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:43:32.291032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808955+0000","last_change":"2023-12-20T04:44:15.808955+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808955+0000","last_undegraded":"2023-12-20T04:44:15.808955+0000","last_fullsized":"2023-12-20T04:44:15.808955+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:30:39.506732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810177+0000","last_change":"2023-12-20T04:44:15.810177+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810177+0000","last_undegraded":"2023-12-20T04:44:15.810177+0000","last_fullsized":"2023-12-20T04:44:15.810177+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809494+0000","last_change":"2023-12-20T04:44:15.809494+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809494+0000","last_undegraded":"2023-12-20T04:44:15.809494+0000","last_fullsized":"2023-12-20T04:44:15.809494+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:41:33.641196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810768+0000","last_change":"2023-12-20T04:44:15.810768+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810768+0000","last_undegraded":"2023-12-20T04:44:15.810768+0000","last_fullsized":"2023-12-20T04:44:15.810768+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:00:21.806708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809285+0000","last_change":"2023-12-20T04:44:15.809285+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809285+0000","last_undegraded":"2023-12-20T04:44:15.809285+0000","last_fullsized":"2023-12-20T04:44:15.809285+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:11:29.355282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808069+0000","last_change":"2023-12-20T04:44:15.808069+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808069+0000","last_undegraded":"2023-12-20T04:44:15.808069+0000","last_fullsized":"2023-12-20T04:44:15.808069+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:00:21.806708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810433+0000","last_change":"2023-12-20T04:44:15.810433+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810433+0000","last_undegraded":"2023-12-20T04:44:15.810433+0000","last_fullsized":"2023-12-20T04:44:15.810433+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:45:12.976332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.807738+0000","last_change":"2023-12-20T04:44:15.807738+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.807738+0000","last_undegraded":"2023-12-20T04:44:15.807738+0000","last_fullsized":"2023-12-20T04:44:15.807738+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:45:56.730088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.15","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808765+0000","last_change":"2023-12-20T04:44:15.808765+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808765+0000","last_undegraded":"2023-12-20T04:44:15.808765+0000","last_fullsized":"2023-12-20T04:44:15.808765+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:36:20.465368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.14","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.811064+0000","last_change":"2023-12-20T04:44:15.811064+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.811064+0000","last_undegraded":"2023-12-20T04:44:15.811064+0000","last_fullsized":"2023-12-20T04:44:15.811064+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:48:39.434329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.13","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808978+0000","last_change":"2023-12-20T04:44:15.808978+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808978+0000","last_undegraded":"2023-12-20T04:44:15.808978+0000","last_fullsized":"2023-12-20T04:44:15.808978+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:30:39.506732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809731+0000","last_change":"2023-12-20T04:44:15.809731+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809731+0000","last_undegraded":"2023-12-20T04:44:15.809731+0000","last_fullsized":"2023-12-20T04:44:15.809731+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:21:56.993244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809072+0000","last_change":"2023-12-20T04:44:15.809072+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809072+0000","last_undegraded":"2023-12-20T04:44:15.809072+0000","last_fullsized":"2023-12-20T04:44:15.809072+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:14:03.265816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.10","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.807799+0000","last_change":"2023-12-20T04:44:15.807799+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.807799+0000","last_undegraded":"2023-12-20T04:44:15.807799+0000","last_fullsized":"2023-12-20T04:44:15.807799+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:03.599978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.f","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810740+0000","last_change":"2023-12-20T04:44:15.810740+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810740+0000","last_undegraded":"2023-12-20T04:44:15.810740+0000","last_fullsized":"2023-12-20T04:44:15.810740+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:03:38.448781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.e","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.811378+0000","last_change":"2023-12-20T04:44:15.811378+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.811378+0000","last_undegraded":"2023-12-20T04:44:15.811378+0000","last_fullsized":"2023-12-20T04:44:15.811378+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:04:44.530883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.d","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809145+0000","last_change":"2023-12-20T04:44:15.809145+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809145+0000","last_undegraded":"2023-12-20T04:44:15.809145+0000","last_fullsized":"2023-12-20T04:44:15.809145+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:45.809267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808748+0000","last_change":"2023-12-20T04:44:15.808748+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808748+0000","last_undegraded":"2023-12-20T04:44:15.808748+0000","last_fullsized":"2023-12-20T04:44:15.808748+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:21:56.993244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.b","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808994+0000","last_change":"2023-12-20T04:44:15.808994+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808994+0000","last_undegraded":"2023-12-20T04:44:15.808994+0000","last_fullsized":"2023-12-20T04:44:15.808994+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808742+0000","last_change":"2023-12-20T04:44:15.808742+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808742+0000","last_undegraded":"2023-12-20T04:44:15.808742+0000","last_fullsized":"2023-12-20T04:44:15.808742+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:23.840378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.807732+0000","last_change":"2023-12-20T04:44:15.807732+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.807732+0000","last_undegraded":"2023-12-20T04:44:15.807732+0000","last_fullsized":"2023-12-20T04:44:15.807732+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:43:25.969506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809385+0000","last_change":"2023-12-20T04:44:15.809385+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809385+0000","last_undegraded":"2023-12-20T04:44:15.809385+0000","last_fullsized":"2023-12-20T04:44:15.809385+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:46:29.128311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808626+0000","last_change":"2023-12-20T04:44:15.808626+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808626+0000","last_undegraded":"2023-12-20T04:44:15.808626+0000","last_fullsized":"2023-12-20T04:44:15.808626+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:37:42.342927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809327+0000","last_change":"2023-12-20T04:44:15.809327+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809327+0000","last_undegraded":"2023-12-20T04:44:15.809327+0000","last_fullsized":"2023-12-20T04:44:15.809327+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:02:34.348449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808638+0000","last_change":"2023-12-20T04:44:15.808638+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808638+0000","last_undegraded":"2023-12-20T04:44:15.808638+0000","last_fullsized":"2023-12-20T04:44:15.808638+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.809039+0000","last_change":"2023-12-20T04:44:15.809039+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.809039+0000","last_undegraded":"2023-12-20T04:44:15.809039+0000","last_fullsized":"2023-12-20T04:44:15.809039+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:45.809267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.810905+0000","last_change":"2023-12-20T04:44:15.810905+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.810905+0000","last_undegraded":"2023-12-20T04:44:15.810905+0000","last_fullsized":"2023-12-20T04:44:15.810905+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:12:23.948724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808506+0000","last_change":"2023-12-20T04:44:15.808506+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808506+0000","last_undegraded":"2023-12-20T04:44:15.808506+0000","last_fullsized":"2023-12-20T04:44:15.808506+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:51.997296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.807748+0000","last_change":"2023-12-20T04:44:15.807748+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.807748+0000","last_undegraded":"2023-12-20T04:44:15.807748+0000","last_fullsized":"2023-12-20T04:44:15.807748+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:06:02.833861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:44:16.806167+0000","last_change":"2023-12-20T04:44:16.806167+0000","last_active":"2023-12-20T04:44:16.806167+0000","last_peered":"2023-12-20T04:44:16.806167+0000","last_clean":"2023-12-20T04:44:16.806167+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:16.806167+0000","last_undegraded":"2023-12-20T04:44:16.806167+0000","last_fullsized":"2023-12-20T04:44:16.806167+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"6.7","version":"0'0","reported_seq":1,"reported_epoch":44,"state":"creating+peering","last_fresh":"2023-12-20T04:44:15.808726+0000","last_change":"2023-12-20T04:44:15.808726+0000","last_active":"2023-12-20T04:44:15.803986+0000","last_peered":"2023-12-20T04:44:15.803986+0000","last_clean":"2023-12-20T04:44:15.803986+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:44:15.808726+0000","last_undegraded":"2023-12-20T04:44:15.808726+0000","last_fullsized":"2023-12-20T04:44:15.808726+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:35:29.288461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":183,"reported_epoch":43,"state":"active+clean","last_fresh":"2023-12-20T04:44:13.676958+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:44:13.676958+0000","last_peered":"2023-12-20T04:44:13.676958+0000","last_clean":"2023-12-20T04:44:13.676958+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:44:13.676958+0000","last_undegraded":"2023-12-20T04:44:13.676958+0000","last_fullsized":"2023-12-20T04:44:13.676958+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574870,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":772,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194539,"statfs":{"total":200000000,"available":199208678,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.47199999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.55300000000000005}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.63200000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.65200000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.75},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.502},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.71299999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.73299999999999998}]}]},{"osd":6,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.53700000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.47499999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.45000000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.505},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.39400000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.55000000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.60899999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.59399999999999997}]},{"osd":1,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.56799999999999995}]},{"osd":2,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.60499999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.63300000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.46000000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52500000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.621},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.64100000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.48599999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.61899999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54000000000000004}]},{"osd":3,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.59299999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.497},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.42499999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.44800000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.46300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.22},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.27500000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.30199999999999999},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.26400000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.29199999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54500000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.44500000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.434}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.501},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60499999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574870,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":196,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195116,"statfs":{"total":200000000,"available":199799046,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.374,"5min":0.374,"15min":0.374},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.32600000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"last":0.25600000000000001},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.313}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.34999999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.42099999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.46400000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.44500000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.503},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.41299999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.55800000000000005}]}]},{"osd":1,"up_from":13,"seq":55834574871,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":201,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195110,"statfs":{"total":200000000,"available":199793229,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.34899999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.376}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.316}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.42999999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.53200000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.51900000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.497},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.48699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574870,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":778,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194534,"statfs":{"total":200000000,"available":199202861,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.32400000000000001},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.39800000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.38},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.35099999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.41499999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.61099999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.52600000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.66000000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.624},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54100000000000004}]}]}],"pool_statfs":[]}} 2023-12-20T04:44:24.514 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:44:24.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.623+0000 7fa313bab640 1 Processor -- start 2023-12-20T04:44:24.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.623+0000 7fa313bab640 1 -- start start 2023-12-20T04:44:24.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.624+0000 7fa313bab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa30c0af210 0x7fa30c168120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:24.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.624+0000 7fa313bab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30c161ce0 con 0x7fa30c15d110 2023-12-20T04:44:24.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.624+0000 7fa313bab640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa30c0aca50 con 0x7fa30c15d4f0 2023-12-20T04:44:24.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.624+0000 7fa313bab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa30c160df0 con 0x7fa30c0af210 2023-12-20T04:44:24.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.624+0000 7fa312148640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa30c0af210 0x7fa30c168120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:24.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.624+0000 7fa311947640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa30c15d110 0x7fa30c069de0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46900/0 (socket says 172.21.15.132:46900) 2023-12-20T04:44:24.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.624+0000 7fa312148640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa30c0af210 0x7fa30c168120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56982/0 (socket says 172.21.15.132:56982) 2023-12-20T04:44:24.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.624+0000 7fa311947640 1 -- 172.21.15.132:0/3793692243 learned_addr learned my addr 172.21.15.132:0/3793692243 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:24.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.625+0000 7fa312148640 1 -- 172.21.15.132:0/3793692243 >> v1:172.21.15.187:6789/0 conn(0x7fa30c15d4f0 legacy=0x7fa30c0aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:24.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.625+0000 7fa312148640 1 -- 172.21.15.132:0/3793692243 >> v1:172.21.15.132:6789/0 conn(0x7fa30c15d110 legacy=0x7fa30c069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:24.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.625+0000 7fa312148640 1 -- 172.21.15.132:0/3793692243 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa30c1610d0 con 0x7fa30c0af210 2023-12-20T04:44:24.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.625+0000 7fa310945640 1 -- 172.21.15.132:0/3793692243 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2540840934 0 0) 0x7fa30c161ce0 con 0x7fa30c15d110 2023-12-20T04:44:24.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.625+0000 7fa312148640 1 --2- 172.21.15.132:0/3793692243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa30c0af210 0x7fa30c168120 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa304009d90 tx=0x7fa30402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fbf3f53aab0bce9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:24.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.626+0000 7fa310945640 1 -- 172.21.15.132:0/3793692243 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30402cc60 con 0x7fa30c0af210 2023-12-20T04:44:24.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.626+0000 7fa310945640 1 -- 172.21.15.132:0/3793692243 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30402cdc0 con 0x7fa30c0af210 2023-12-20T04:44:24.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.626+0000 7fa310945640 1 -- 172.21.15.132:0/3793692243 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa304034660 con 0x7fa30c0af210 2023-12-20T04:44:24.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.626+0000 7fa313bab640 1 -- 172.21.15.132:0/3793692243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa30c0af210 msgr2=0x7fa30c168120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:24.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.626+0000 7fa313bab640 1 --2- 172.21.15.132:0/3793692243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa30c0af210 0x7fa30c168120 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7fa304009d90 tx=0x7fa30402beb0 comp rx=0 tx=0).stop 2023-12-20T04:44:24.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.626+0000 7fa313bab640 1 -- 172.21.15.132:0/3793692243 shutdown_connections 2023-12-20T04:44:24.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.626+0000 7fa313bab640 1 --2- 172.21.15.132:0/3793692243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa30c0af210 0x7fa30c168120 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:24.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.626+0000 7fa313bab640 1 -- 172.21.15.132:0/3793692243 >> 172.21.15.132:0/3793692243 conn(0x7fa30c0cfbd0 msgr2=0x7fa30c0cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:24.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.626+0000 7fa313bab640 1 -- 172.21.15.132:0/3793692243 shutdown_connections 2023-12-20T04:44:24.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.626+0000 7fa313bab640 1 -- 172.21.15.132:0/3793692243 wait complete. 2023-12-20T04:44:24.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.627+0000 7fa313bab640 1 Processor -- start 2023-12-20T04:44:24.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.628+0000 7fa313bab640 1 -- start start 2023-12-20T04:44:24.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.628+0000 7fa313bab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa30c0af210 0x7fa30c1512c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:24.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.628+0000 7fa313bab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa30c15d110 0x7fa30c0c7690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:24.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.628+0000 7fa313bab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa30c15d4f0 0x7fa30c0c7bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:24.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.628+0000 7fa313bab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c06eeb0 con 0x7fa30c15d4f0 2023-12-20T04:44:24.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.628+0000 7fa313bab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c1607b0 con 0x7fa30c15d110 2023-12-20T04:44:24.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.628+0000 7fa313bab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa30c0c8510 con 0x7fa30c0af210 2023-12-20T04:44:24.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.628+0000 7fa312148640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa30c15d4f0 0x7fa30c0c7bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:24.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.628+0000 7fa312148640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa30c15d4f0 0x7fa30c0c7bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56998/0 (socket says 172.21.15.132:56998) 2023-12-20T04:44:24.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.628+0000 7fa312148640 1 -- 172.21.15.132:0/674304113 learned_addr learned my addr 172.21.15.132:0/674304113 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:24.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.629+0000 7fa311146640 1 --2- 172.21.15.132:0/674304113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa30c15d110 0x7fa30c0c7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:24.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.629+0000 7fa311947640 1 --2- 172.21.15.132:0/674304113 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa30c0af210 0x7fa30c1512c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:24.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.629+0000 7fa312148640 1 -- 172.21.15.132:0/674304113 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa30c0af210 msgr2=0x7fa30c1512c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:24.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.629+0000 7fa312148640 1 --2- 172.21.15.132:0/674304113 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa30c0af210 0x7fa30c1512c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:24.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.629+0000 7fa312148640 1 -- 172.21.15.132:0/674304113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa30c15d110 msgr2=0x7fa30c0c7690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:24.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.629+0000 7fa312148640 1 --2- 172.21.15.132:0/674304113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa30c15d110 0x7fa30c0c7690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:24.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.629+0000 7fa312148640 1 -- 172.21.15.132:0/674304113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa304009a70 con 0x7fa30c15d4f0 2023-12-20T04:44:24.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.629+0000 7fa312148640 1 --2- 172.21.15.132:0/674304113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa30c15d4f0 0x7fa30c0c7bd0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa304009eb0 tx=0x7fa304004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:24.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.629+0000 7fa3027fc640 1 -- 172.21.15.132:0/674304113 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30403f420 con 0x7fa30c15d4f0 2023-12-20T04:44:24.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.629+0000 7fa3027fc640 1 -- 172.21.15.132:0/674304113 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa30403f580 con 0x7fa30c15d4f0 2023-12-20T04:44:24.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.629+0000 7fa313bab640 1 -- 172.21.15.132:0/674304113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa30c06ea20 con 0x7fa30c15d4f0 2023-12-20T04:44:24.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.629+0000 7fa3027fc640 1 -- 172.21.15.132:0/674304113 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa30403f910 con 0x7fa30c15d4f0 2023-12-20T04:44:24.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.629+0000 7fa313bab640 1 -- 172.21.15.132:0/674304113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa30c06de10 con 0x7fa30c15d4f0 2023-12-20T04:44:24.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.630+0000 7fa313bab640 1 -- 172.21.15.132:0/674304113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa30c06ebb0 con 0x7fa30c15d4f0 2023-12-20T04:44:24.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.630+0000 7fa3027fc640 1 -- 172.21.15.132:0/674304113 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa30403fa70 con 0x7fa30c15d4f0 2023-12-20T04:44:24.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.631+0000 7fa3027fc640 1 --2- 172.21.15.132:0/674304113 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2f006a460 0x7fa2f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:24.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.631+0000 7fa3027fc640 1 -- 172.21.15.132:0/674304113 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3040ab270 con 0x7fa30c15d4f0 2023-12-20T04:44:24.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.631+0000 7fa311947640 1 --2- 172.21.15.132:0/674304113 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2f006a460 0x7fa2f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:24.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.631+0000 7fa311947640 1 --2- 172.21.15.132:0/674304113 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2f006a460 0x7fa2f006c920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa3080010e0 tx=0x7fa308009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:24.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.635+0000 7fa3027fc640 1 -- 172.21.15.132:0/674304113 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa304076a10 con 0x7fa30c15d4f0 2023-12-20T04:44:24.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.799+0000 7fa313bab640 1 -- 172.21.15.132:0/674304113 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa30c161690 con 0x7fa2f006a460 2023-12-20T04:44:24.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.806+0000 7fa3027fc640 1 -- 172.21.15.132:0/674304113 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284955 (secure 0 0 0) 0x7fa3080070d0 con 0x7fa2f006a460 2023-12-20T04:44:24.811 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:24.812 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:44:24.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.809+0000 7fa313bab640 1 -- 172.21.15.132:0/674304113 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2f006a460 msgr2=0x7fa2f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:24.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.809+0000 7fa313bab640 1 --2- 172.21.15.132:0/674304113 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2f006a460 0x7fa2f006c920 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fa3080010e0 tx=0x7fa308009040 comp rx=0 tx=0).stop 2023-12-20T04:44:24.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.809+0000 7fa313bab640 1 -- 172.21.15.132:0/674304113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa30c15d4f0 msgr2=0x7fa30c0c7bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:24.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.809+0000 7fa313bab640 1 --2- 172.21.15.132:0/674304113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa30c15d4f0 0x7fa30c0c7bd0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7fa304009eb0 tx=0x7fa304004a40 comp rx=0 tx=0).stop 2023-12-20T04:44:24.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.809+0000 7fa313bab640 1 -- 172.21.15.132:0/674304113 shutdown_connections 2023-12-20T04:44:24.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.809+0000 7fa313bab640 1 --2- 172.21.15.132:0/674304113 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2f006a460 0x7fa2f006c920 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:24.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.809+0000 7fa313bab640 1 --2- 172.21.15.132:0/674304113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa30c15d4f0 0x7fa30c0c7bd0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:24.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.809+0000 7fa313bab640 1 --2- 172.21.15.132:0/674304113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa30c15d110 0x7fa30c0c7690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:24.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.809+0000 7fa313bab640 1 --2- 172.21.15.132:0/674304113 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa30c0af210 0x7fa30c1512c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:24.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.809+0000 7fa313bab640 1 -- 172.21.15.132:0/674304113 >> 172.21.15.132:0/674304113 conn(0x7fa30c0cfbd0 msgr2=0x7fa30c0ca330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:24.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.810+0000 7fa313bab640 1 -- 172.21.15.132:0/674304113 shutdown_connections 2023-12-20T04:44:24.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.810+0000 7fa313bab640 1 -- 172.21.15.132:0/674304113 wait complete. 2023-12-20T04:44:24.822 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":93,"stamp":"2023-12-20T04:44:24.111744+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":2924,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1559575,"statfs":{"total":1600000000,"available":1597005636,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.300328"},"pg_stats":[{"pgid":"7.3f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202537+0000","last_change":"2023-12-20T04:44:17.211788+0000","last_active":"2023-12-20T04:44:18.202537+0000","last_peered":"2023-12-20T04:44:18.202537+0000","last_clean":"2023-12-20T04:44:18.202537+0000","last_became_active":"2023-12-20T04:44:17.211454+0000","last_became_peered":"2023-12-20T04:44:17.211454+0000","last_unstale":"2023-12-20T04:44:18.202537+0000","last_undegraded":"2023-12-20T04:44:18.202537+0000","last_fullsized":"2023-12-20T04:44:18.202537+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:11:15.969312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.781130+0000","last_change":"2023-12-20T04:44:17.202872+0000","last_active":"2023-12-20T04:44:18.781130+0000","last_peered":"2023-12-20T04:44:18.781130+0000","last_clean":"2023-12-20T04:44:18.781130+0000","last_became_active":"2023-12-20T04:44:17.202578+0000","last_became_peered":"2023-12-20T04:44:17.202578+0000","last_unstale":"2023-12-20T04:44:18.781130+0000","last_undegraded":"2023-12-20T04:44:18.781130+0000","last_fullsized":"2023-12-20T04:44:18.781130+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:14:04.267997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780813+0000","last_change":"2023-12-20T04:44:17.211980+0000","last_active":"2023-12-20T04:44:18.780813+0000","last_peered":"2023-12-20T04:44:18.780813+0000","last_clean":"2023-12-20T04:44:18.780813+0000","last_became_active":"2023-12-20T04:44:17.211660+0000","last_became_peered":"2023-12-20T04:44:17.211660+0000","last_unstale":"2023-12-20T04:44:18.780813+0000","last_undegraded":"2023-12-20T04:44:18.780813+0000","last_fullsized":"2023-12-20T04:44:18.780813+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:46:30.130492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202261+0000","last_change":"2023-12-20T04:44:17.206823+0000","last_active":"2023-12-20T04:44:18.202261+0000","last_peered":"2023-12-20T04:44:18.202261+0000","last_clean":"2023-12-20T04:44:18.202261+0000","last_became_active":"2023-12-20T04:44:17.206606+0000","last_became_peered":"2023-12-20T04:44:17.206606+0000","last_unstale":"2023-12-20T04:44:18.202261+0000","last_undegraded":"2023-12-20T04:44:18.202261+0000","last_fullsized":"2023-12-20T04:44:18.202261+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:12:01.374032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.3b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780800+0000","last_change":"2023-12-20T04:44:17.207042+0000","last_active":"2023-12-20T04:44:18.780800+0000","last_peered":"2023-12-20T04:44:18.780800+0000","last_clean":"2023-12-20T04:44:18.780800+0000","last_became_active":"2023-12-20T04:44:17.206762+0000","last_became_peered":"2023-12-20T04:44:17.206762+0000","last_unstale":"2023-12-20T04:44:18.780800+0000","last_undegraded":"2023-12-20T04:44:18.780800+0000","last_fullsized":"2023-12-20T04:44:18.780800+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:12:56.203631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.3a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.201851+0000","last_change":"2023-12-20T04:44:17.215237+0000","last_active":"2023-12-20T04:44:18.201851+0000","last_peered":"2023-12-20T04:44:18.201851+0000","last_clean":"2023-12-20T04:44:18.201851+0000","last_became_active":"2023-12-20T04:44:17.214806+0000","last_became_peered":"2023-12-20T04:44:17.214806+0000","last_unstale":"2023-12-20T04:44:18.201851+0000","last_undegraded":"2023-12-20T04:44:18.201851+0000","last_fullsized":"2023-12-20T04:44:18.201851+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:14:23.971696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.39","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202229+0000","last_change":"2023-12-20T04:44:17.209112+0000","last_active":"2023-12-20T04:44:18.202229+0000","last_peered":"2023-12-20T04:44:18.202229+0000","last_clean":"2023-12-20T04:44:18.202229+0000","last_became_active":"2023-12-20T04:44:17.208899+0000","last_became_peered":"2023-12-20T04:44:17.208899+0000","last_unstale":"2023-12-20T04:44:18.202229+0000","last_undegraded":"2023-12-20T04:44:18.202229+0000","last_fullsized":"2023-12-20T04:44:18.202229+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:06:43.999623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.38","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202280+0000","last_change":"2023-12-20T04:44:17.213242+0000","last_active":"2023-12-20T04:44:18.202280+0000","last_peered":"2023-12-20T04:44:18.202280+0000","last_clean":"2023-12-20T04:44:18.202280+0000","last_became_active":"2023-12-20T04:44:17.207150+0000","last_became_peered":"2023-12-20T04:44:17.207150+0000","last_unstale":"2023-12-20T04:44:18.202280+0000","last_undegraded":"2023-12-20T04:44:18.202280+0000","last_fullsized":"2023-12-20T04:44:18.202280+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:10:20.447949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.37","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202347+0000","last_change":"2023-12-20T04:44:17.215690+0000","last_active":"2023-12-20T04:44:18.202347+0000","last_peered":"2023-12-20T04:44:18.202347+0000","last_clean":"2023-12-20T04:44:18.202347+0000","last_became_active":"2023-12-20T04:44:17.212571+0000","last_became_peered":"2023-12-20T04:44:17.212571+0000","last_unstale":"2023-12-20T04:44:18.202347+0000","last_undegraded":"2023-12-20T04:44:18.202347+0000","last_fullsized":"2023-12-20T04:44:18.202347+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:40:45.097892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.36","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202636+0000","last_change":"2023-12-20T04:44:17.205303+0000","last_active":"2023-12-20T04:44:18.202636+0000","last_peered":"2023-12-20T04:44:18.202636+0000","last_clean":"2023-12-20T04:44:18.202636+0000","last_became_active":"2023-12-20T04:44:17.205018+0000","last_became_peered":"2023-12-20T04:44:17.205018+0000","last_unstale":"2023-12-20T04:44:18.202636+0000","last_undegraded":"2023-12-20T04:44:18.202636+0000","last_fullsized":"2023-12-20T04:44:18.202636+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:10:26.134813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.35","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202491+0000","last_change":"2023-12-20T04:44:17.206732+0000","last_active":"2023-12-20T04:44:18.202491+0000","last_peered":"2023-12-20T04:44:18.202491+0000","last_clean":"2023-12-20T04:44:18.202491+0000","last_became_active":"2023-12-20T04:44:17.206450+0000","last_became_peered":"2023-12-20T04:44:17.206450+0000","last_unstale":"2023-12-20T04:44:18.202491+0000","last_undegraded":"2023-12-20T04:44:18.202491+0000","last_fullsized":"2023-12-20T04:44:18.202491+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:02:35.350630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.34","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.781203+0000","last_change":"2023-12-20T04:44:17.204709+0000","last_active":"2023-12-20T04:44:18.781203+0000","last_peered":"2023-12-20T04:44:18.781203+0000","last_clean":"2023-12-20T04:44:18.781203+0000","last_became_active":"2023-12-20T04:44:17.204489+0000","last_became_peered":"2023-12-20T04:44:17.204489+0000","last_unstale":"2023-12-20T04:44:18.781203+0000","last_undegraded":"2023-12-20T04:44:18.781203+0000","last_fullsized":"2023-12-20T04:44:18.781203+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:41:34.643377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.33","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780626+0000","last_change":"2023-12-20T04:44:17.210948+0000","last_active":"2023-12-20T04:44:18.780626+0000","last_peered":"2023-12-20T04:44:18.780626+0000","last_clean":"2023-12-20T04:44:18.780626+0000","last_became_active":"2023-12-20T04:44:17.210715+0000","last_became_peered":"2023-12-20T04:44:17.210715+0000","last_unstale":"2023-12-20T04:44:18.780626+0000","last_undegraded":"2023-12-20T04:44:18.780626+0000","last_fullsized":"2023-12-20T04:44:18.780626+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:41:19.618222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.32","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202600+0000","last_change":"2023-12-20T04:44:17.214439+0000","last_active":"2023-12-20T04:44:18.202600+0000","last_peered":"2023-12-20T04:44:18.202600+0000","last_clean":"2023-12-20T04:44:18.202600+0000","last_became_active":"2023-12-20T04:44:17.212324+0000","last_became_peered":"2023-12-20T04:44:17.212324+0000","last_unstale":"2023-12-20T04:44:18.202600+0000","last_undegraded":"2023-12-20T04:44:18.202600+0000","last_fullsized":"2023-12-20T04:44:18.202600+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:46:30.130492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.31","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.201769+0000","last_change":"2023-12-20T04:44:17.213204+0000","last_active":"2023-12-20T04:44:18.201769+0000","last_peered":"2023-12-20T04:44:18.201769+0000","last_clean":"2023-12-20T04:44:18.201769+0000","last_became_active":"2023-12-20T04:44:17.212988+0000","last_became_peered":"2023-12-20T04:44:17.212988+0000","last_unstale":"2023-12-20T04:44:18.201769+0000","last_undegraded":"2023-12-20T04:44:18.201769+0000","last_fullsized":"2023-12-20T04:44:18.201769+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:11:55.741347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.30","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.222430+0000","last_change":"2023-12-20T04:44:17.211711+0000","last_active":"2023-12-20T04:44:18.222430+0000","last_peered":"2023-12-20T04:44:18.222430+0000","last_clean":"2023-12-20T04:44:18.222430+0000","last_became_active":"2023-12-20T04:44:17.210864+0000","last_became_peered":"2023-12-20T04:44:17.210864+0000","last_unstale":"2023-12-20T04:44:18.222430+0000","last_undegraded":"2023-12-20T04:44:18.222430+0000","last_fullsized":"2023-12-20T04:44:18.222430+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:35:52.164505+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780581+0000","last_change":"2023-12-20T04:44:17.209588+0000","last_active":"2023-12-20T04:44:18.780581+0000","last_peered":"2023-12-20T04:44:18.780581+0000","last_clean":"2023-12-20T04:44:18.780581+0000","last_became_active":"2023-12-20T04:44:17.209252+0000","last_became_peered":"2023-12-20T04:44:17.209252+0000","last_unstale":"2023-12-20T04:44:18.780581+0000","last_undegraded":"2023-12-20T04:44:18.780581+0000","last_fullsized":"2023-12-20T04:44:18.780581+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:52.999477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.781028+0000","last_change":"2023-12-20T04:44:17.216355+0000","last_active":"2023-12-20T04:44:18.781028+0000","last_peered":"2023-12-20T04:44:18.781028+0000","last_clean":"2023-12-20T04:44:18.781028+0000","last_became_active":"2023-12-20T04:44:17.215450+0000","last_became_peered":"2023-12-20T04:44:17.215450+0000","last_unstale":"2023-12-20T04:44:18.781028+0000","last_undegraded":"2023-12-20T04:44:18.781028+0000","last_fullsized":"2023-12-20T04:44:18.781028+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:40:45.097892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.2d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.222715+0000","last_change":"2023-12-20T04:44:17.212192+0000","last_active":"2023-12-20T04:44:18.222715+0000","last_peered":"2023-12-20T04:44:18.222715+0000","last_clean":"2023-12-20T04:44:18.222715+0000","last_became_active":"2023-12-20T04:44:17.211045+0000","last_became_peered":"2023-12-20T04:44:17.211045+0000","last_unstale":"2023-12-20T04:44:18.222715+0000","last_undegraded":"2023-12-20T04:44:18.222715+0000","last_fullsized":"2023-12-20T04:44:18.222715+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:42:21.392755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780725+0000","last_change":"2023-12-20T04:44:17.208693+0000","last_active":"2023-12-20T04:44:18.780725+0000","last_peered":"2023-12-20T04:44:18.780725+0000","last_clean":"2023-12-20T04:44:18.780725+0000","last_became_active":"2023-12-20T04:44:17.208224+0000","last_became_peered":"2023-12-20T04:44:17.208224+0000","last_unstale":"2023-12-20T04:44:18.780725+0000","last_undegraded":"2023-12-20T04:44:18.780725+0000","last_fullsized":"2023-12-20T04:44:18.780725+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:04.602159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.201936+0000","last_change":"2023-12-20T04:44:17.215095+0000","last_active":"2023-12-20T04:44:18.201936+0000","last_peered":"2023-12-20T04:44:18.201936+0000","last_clean":"2023-12-20T04:44:18.201936+0000","last_became_active":"2023-12-20T04:44:17.214338+0000","last_became_peered":"2023-12-20T04:44:17.214338+0000","last_unstale":"2023-12-20T04:44:18.201936+0000","last_undegraded":"2023-12-20T04:44:18.201936+0000","last_fullsized":"2023-12-20T04:44:18.201936+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:03:09.225803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.2a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202510+0000","last_change":"2023-12-20T04:44:17.209366+0000","last_active":"2023-12-20T04:44:18.202510+0000","last_peered":"2023-12-20T04:44:18.202510+0000","last_clean":"2023-12-20T04:44:18.202510+0000","last_became_active":"2023-12-20T04:44:17.205988+0000","last_became_peered":"2023-12-20T04:44:17.205988+0000","last_unstale":"2023-12-20T04:44:18.202510+0000","last_undegraded":"2023-12-20T04:44:18.202510+0000","last_fullsized":"2023-12-20T04:44:18.202510+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:11:15.969312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.29","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.222529+0000","last_change":"2023-12-20T04:44:17.210344+0000","last_active":"2023-12-20T04:44:18.222529+0000","last_peered":"2023-12-20T04:44:18.222529+0000","last_clean":"2023-12-20T04:44:18.222529+0000","last_became_active":"2023-12-20T04:44:17.209745+0000","last_became_peered":"2023-12-20T04:44:17.209745+0000","last_unstale":"2023-12-20T04:44:18.222529+0000","last_undegraded":"2023-12-20T04:44:18.222529+0000","last_fullsized":"2023-12-20T04:44:18.222529+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:46.811448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.28","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.222251+0000","last_change":"2023-12-20T04:44:17.212484+0000","last_active":"2023-12-20T04:44:18.222251+0000","last_peered":"2023-12-20T04:44:18.222251+0000","last_clean":"2023-12-20T04:44:18.222251+0000","last_became_active":"2023-12-20T04:44:17.211967+0000","last_became_peered":"2023-12-20T04:44:17.211967+0000","last_unstale":"2023-12-20T04:44:18.222251+0000","last_undegraded":"2023-12-20T04:44:18.222251+0000","last_fullsized":"2023-12-20T04:44:18.222251+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:15:14.009980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.27","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.222521+0000","last_change":"2023-12-20T04:44:17.211513+0000","last_active":"2023-12-20T04:44:18.222521+0000","last_peered":"2023-12-20T04:44:18.222521+0000","last_clean":"2023-12-20T04:44:18.222521+0000","last_became_active":"2023-12-20T04:44:17.210941+0000","last_became_peered":"2023-12-20T04:44:17.210941+0000","last_unstale":"2023-12-20T04:44:18.222521+0000","last_undegraded":"2023-12-20T04:44:18.222521+0000","last_fullsized":"2023-12-20T04:44:18.222521+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:02:35.350630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.26","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780801+0000","last_change":"2023-12-20T04:44:17.211956+0000","last_active":"2023-12-20T04:44:18.780801+0000","last_peered":"2023-12-20T04:44:18.780801+0000","last_clean":"2023-12-20T04:44:18.780801+0000","last_became_active":"2023-12-20T04:44:17.211756+0000","last_became_peered":"2023-12-20T04:44:17.211756+0000","last_unstale":"2023-12-20T04:44:18.780801+0000","last_undegraded":"2023-12-20T04:44:18.780801+0000","last_fullsized":"2023-12-20T04:44:18.780801+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:43:26.971687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.25","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780689+0000","last_change":"2023-12-20T04:44:17.209463+0000","last_active":"2023-12-20T04:44:18.780689+0000","last_peered":"2023-12-20T04:44:18.780689+0000","last_clean":"2023-12-20T04:44:18.780689+0000","last_became_active":"2023-12-20T04:44:17.208965+0000","last_became_peered":"2023-12-20T04:44:17.208965+0000","last_unstale":"2023-12-20T04:44:18.780689+0000","last_undegraded":"2023-12-20T04:44:18.780689+0000","last_fullsized":"2023-12-20T04:44:18.780689+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:41:34.643377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.24","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.781215+0000","last_change":"2023-12-20T04:44:17.206588+0000","last_active":"2023-12-20T04:44:18.781215+0000","last_peered":"2023-12-20T04:44:18.781215+0000","last_clean":"2023-12-20T04:44:18.781215+0000","last_became_active":"2023-12-20T04:44:17.205708+0000","last_became_peered":"2023-12-20T04:44:17.205708+0000","last_unstale":"2023-12-20T04:44:18.781215+0000","last_undegraded":"2023-12-20T04:44:18.781215+0000","last_fullsized":"2023-12-20T04:44:18.781215+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:37:43.345108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.23","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.222369+0000","last_change":"2023-12-20T04:44:17.211743+0000","last_active":"2023-12-20T04:44:18.222369+0000","last_peered":"2023-12-20T04:44:18.222369+0000","last_clean":"2023-12-20T04:44:18.222369+0000","last_became_active":"2023-12-20T04:44:17.210514+0000","last_became_peered":"2023-12-20T04:44:17.210514+0000","last_unstale":"2023-12-20T04:44:18.222369+0000","last_undegraded":"2023-12-20T04:44:18.222369+0000","last_fullsized":"2023-12-20T04:44:18.222369+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:04:45.533064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.22","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780968+0000","last_change":"2023-12-20T04:44:17.213484+0000","last_active":"2023-12-20T04:44:18.780968+0000","last_peered":"2023-12-20T04:44:18.780968+0000","last_clean":"2023-12-20T04:44:18.780968+0000","last_became_active":"2023-12-20T04:44:17.213167+0000","last_became_peered":"2023-12-20T04:44:17.213167+0000","last_unstale":"2023-12-20T04:44:18.780968+0000","last_undegraded":"2023-12-20T04:44:18.780968+0000","last_fullsized":"2023-12-20T04:44:18.780968+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:36:21.467549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.21","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202017+0000","last_change":"2023-12-20T04:44:17.211800+0000","last_active":"2023-12-20T04:44:18.202017+0000","last_peered":"2023-12-20T04:44:18.202017+0000","last_clean":"2023-12-20T04:44:18.202017+0000","last_became_active":"2023-12-20T04:44:17.211296+0000","last_became_peered":"2023-12-20T04:44:17.211296+0000","last_unstale":"2023-12-20T04:44:18.202017+0000","last_undegraded":"2023-12-20T04:44:18.202017+0000","last_fullsized":"2023-12-20T04:44:18.202017+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:40:09.518750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.20","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780505+0000","last_change":"2023-12-20T04:44:17.207954+0000","last_active":"2023-12-20T04:44:18.780505+0000","last_peered":"2023-12-20T04:44:18.780505+0000","last_clean":"2023-12-20T04:44:18.780505+0000","last_became_active":"2023-12-20T04:44:17.207726+0000","last_became_peered":"2023-12-20T04:44:17.207726+0000","last_unstale":"2023-12-20T04:44:18.780505+0000","last_undegraded":"2023-12-20T04:44:18.780505+0000","last_fullsized":"2023-12-20T04:44:18.780505+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:44:25.695427+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780588+0000","last_change":"2023-12-20T04:44:17.212203+0000","last_active":"2023-12-20T04:44:18.780588+0000","last_peered":"2023-12-20T04:44:18.780588+0000","last_clean":"2023-12-20T04:44:18.780588+0000","last_became_active":"2023-12-20T04:44:17.211995+0000","last_became_peered":"2023-12-20T04:44:17.211995+0000","last_unstale":"2023-12-20T04:44:18.780588+0000","last_undegraded":"2023-12-20T04:44:18.780588+0000","last_fullsized":"2023-12-20T04:44:18.780588+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:12:56.203631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1f","version":"46'4","reported_seq":15,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.218897+0000","last_change":"2023-12-20T04:44:16.822749+0000","last_active":"2023-12-20T04:44:17.218897+0000","last_peered":"2023-12-20T04:44:17.218897+0000","last_clean":"2023-12-20T04:44:17.218897+0000","last_became_active":"2023-12-20T04:44:16.822517+0000","last_became_peered":"2023-12-20T04:44:16.822517+0000","last_unstale":"2023-12-20T04:44:17.218897+0000","last_undegraded":"2023-12-20T04:44:17.218897+0000","last_fullsized":"2023-12-20T04:44:17.218897+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:51.997296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.222439+0000","last_change":"2023-12-20T04:44:17.210876+0000","last_active":"2023-12-20T04:44:18.222439+0000","last_peered":"2023-12-20T04:44:18.222439+0000","last_clean":"2023-12-20T04:44:18.222439+0000","last_became_active":"2023-12-20T04:44:17.210582+0000","last_became_peered":"2023-12-20T04:44:17.210582+0000","last_unstale":"2023-12-20T04:44:18.222439+0000","last_undegraded":"2023-12-20T04:44:18.222439+0000","last_fullsized":"2023-12-20T04:44:18.222439+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:24.842559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1e","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.216791+0000","last_change":"2023-12-20T04:44:16.821728+0000","last_active":"2023-12-20T04:44:17.216791+0000","last_peered":"2023-12-20T04:44:17.216791+0000","last_clean":"2023-12-20T04:44:17.216791+0000","last_became_active":"2023-12-20T04:44:16.820554+0000","last_became_peered":"2023-12-20T04:44:16.820554+0000","last_unstale":"2023-12-20T04:44:17.216791+0000","last_undegraded":"2023-12-20T04:44:17.216791+0000","last_fullsized":"2023-12-20T04:44:17.216791+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:43:32.291032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780849+0000","last_change":"2023-12-20T04:44:17.211959+0000","last_active":"2023-12-20T04:44:18.780849+0000","last_peered":"2023-12-20T04:44:18.780849+0000","last_clean":"2023-12-20T04:44:18.780849+0000","last_became_active":"2023-12-20T04:44:17.211623+0000","last_became_peered":"2023-12-20T04:44:17.211623+0000","last_unstale":"2023-12-20T04:44:18.780849+0000","last_undegraded":"2023-12-20T04:44:18.780849+0000","last_fullsized":"2023-12-20T04:44:18.780849+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:13.157257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1d","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.216480+0000","last_change":"2023-12-20T04:44:16.821128+0000","last_active":"2023-12-20T04:44:17.216480+0000","last_peered":"2023-12-20T04:44:17.216480+0000","last_clean":"2023-12-20T04:44:17.216480+0000","last_became_active":"2023-12-20T04:44:16.820739+0000","last_became_peered":"2023-12-20T04:44:16.820739+0000","last_unstale":"2023-12-20T04:44:17.216480+0000","last_undegraded":"2023-12-20T04:44:17.216480+0000","last_fullsized":"2023-12-20T04:44:17.216480+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:30:39.506732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780765+0000","last_change":"2023-12-20T04:44:17.207851+0000","last_active":"2023-12-20T04:44:18.780765+0000","last_peered":"2023-12-20T04:44:18.780765+0000","last_clean":"2023-12-20T04:44:18.780765+0000","last_became_active":"2023-12-20T04:44:17.207459+0000","last_became_peered":"2023-12-20T04:44:17.207459+0000","last_unstale":"2023-12-20T04:44:18.780765+0000","last_undegraded":"2023-12-20T04:44:18.780765+0000","last_fullsized":"2023-12-20T04:44:18.780765+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:11:15.969312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1c","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.214765+0000","last_change":"2023-12-20T04:44:16.821670+0000","last_active":"2023-12-20T04:44:17.214765+0000","last_peered":"2023-12-20T04:44:17.214765+0000","last_clean":"2023-12-20T04:44:17.214765+0000","last_became_active":"2023-12-20T04:44:16.821362+0000","last_became_peered":"2023-12-20T04:44:16.821362+0000","last_unstale":"2023-12-20T04:44:17.214765+0000","last_undegraded":"2023-12-20T04:44:17.214765+0000","last_fullsized":"2023-12-20T04:44:17.214765+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780718+0000","last_change":"2023-12-20T04:44:17.215240+0000","last_active":"2023-12-20T04:44:18.780718+0000","last_peered":"2023-12-20T04:44:18.780718+0000","last_clean":"2023-12-20T04:44:18.780718+0000","last_became_active":"2023-12-20T04:44:17.214500+0000","last_became_peered":"2023-12-20T04:44:17.214500+0000","last_unstale":"2023-12-20T04:44:18.780718+0000","last_undegraded":"2023-12-20T04:44:18.780718+0000","last_fullsized":"2023-12-20T04:44:18.780718+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:14:04.267997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.218328+0000","last_change":"2023-12-20T04:44:16.820591+0000","last_active":"2023-12-20T04:44:17.218328+0000","last_peered":"2023-12-20T04:44:17.218328+0000","last_clean":"2023-12-20T04:44:17.218328+0000","last_became_active":"2023-12-20T04:44:16.820393+0000","last_became_peered":"2023-12-20T04:44:16.820393+0000","last_unstale":"2023-12-20T04:44:17.218328+0000","last_undegraded":"2023-12-20T04:44:17.218328+0000","last_fullsized":"2023-12-20T04:44:17.218328+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:41:33.641196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202586+0000","last_change":"2023-12-20T04:44:17.206242+0000","last_active":"2023-12-20T04:44:18.202586+0000","last_peered":"2023-12-20T04:44:18.202586+0000","last_clean":"2023-12-20T04:44:18.202586+0000","last_became_active":"2023-12-20T04:44:17.205306+0000","last_became_peered":"2023-12-20T04:44:17.205306+0000","last_unstale":"2023-12-20T04:44:18.202586+0000","last_undegraded":"2023-12-20T04:44:18.202586+0000","last_fullsized":"2023-12-20T04:44:18.202586+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:21:57.995425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1a","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.217412+0000","last_change":"2023-12-20T04:44:16.821834+0000","last_active":"2023-12-20T04:44:17.217412+0000","last_peered":"2023-12-20T04:44:17.217412+0000","last_clean":"2023-12-20T04:44:17.217412+0000","last_became_active":"2023-12-20T04:44:16.821616+0000","last_became_peered":"2023-12-20T04:44:16.821616+0000","last_unstale":"2023-12-20T04:44:17.217412+0000","last_undegraded":"2023-12-20T04:44:17.217412+0000","last_fullsized":"2023-12-20T04:44:17.217412+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:00:21.806708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202698+0000","last_change":"2023-12-20T04:44:17.206589+0000","last_active":"2023-12-20T04:44:18.202698+0000","last_peered":"2023-12-20T04:44:18.202698+0000","last_clean":"2023-12-20T04:44:18.202698+0000","last_became_active":"2023-12-20T04:44:17.205829+0000","last_became_peered":"2023-12-20T04:44:17.205829+0000","last_unstale":"2023-12-20T04:44:18.202698+0000","last_undegraded":"2023-12-20T04:44:18.202698+0000","last_fullsized":"2023-12-20T04:44:18.202698+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:06:43.999623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.19","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.201085+0000","last_change":"2023-12-20T04:44:16.822709+0000","last_active":"2023-12-20T04:44:17.201085+0000","last_peered":"2023-12-20T04:44:17.201085+0000","last_clean":"2023-12-20T04:44:17.201085+0000","last_became_active":"2023-12-20T04:44:16.822499+0000","last_became_peered":"2023-12-20T04:44:16.822499+0000","last_unstale":"2023-12-20T04:44:17.201085+0000","last_undegraded":"2023-12-20T04:44:17.201085+0000","last_fullsized":"2023-12-20T04:44:17.201085+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:11:29.355282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.222485+0000","last_change":"2023-12-20T04:44:17.212361+0000","last_active":"2023-12-20T04:44:18.222485+0000","last_peered":"2023-12-20T04:44:18.222485+0000","last_clean":"2023-12-20T04:44:18.222485+0000","last_became_active":"2023-12-20T04:44:17.211535+0000","last_became_peered":"2023-12-20T04:44:17.211535+0000","last_unstale":"2023-12-20T04:44:18.222485+0000","last_undegraded":"2023-12-20T04:44:18.222485+0000","last_fullsized":"2023-12-20T04:44:18.222485+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:00:22.808889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.18","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.202492+0000","last_change":"2023-12-20T04:44:16.816576+0000","last_active":"2023-12-20T04:44:17.202492+0000","last_peered":"2023-12-20T04:44:17.202492+0000","last_clean":"2023-12-20T04:44:17.202492+0000","last_became_active":"2023-12-20T04:44:16.816219+0000","last_became_peered":"2023-12-20T04:44:16.816219+0000","last_unstale":"2023-12-20T04:44:17.202492+0000","last_undegraded":"2023-12-20T04:44:17.202492+0000","last_fullsized":"2023-12-20T04:44:17.202492+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:00:21.806708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780791+0000","last_change":"2023-12-20T04:44:17.215935+0000","last_active":"2023-12-20T04:44:18.780791+0000","last_peered":"2023-12-20T04:44:18.780791+0000","last_clean":"2023-12-20T04:44:18.780791+0000","last_became_active":"2023-12-20T04:44:17.214926+0000","last_became_peered":"2023-12-20T04:44:17.214926+0000","last_unstale":"2023-12-20T04:44:18.780791+0000","last_undegraded":"2023-12-20T04:44:18.780791+0000","last_fullsized":"2023-12-20T04:44:18.780791+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:30:40.508913+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.17","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.204174+0000","last_change":"2023-12-20T04:44:16.815189+0000","last_active":"2023-12-20T04:44:17.204174+0000","last_peered":"2023-12-20T04:44:17.204174+0000","last_clean":"2023-12-20T04:44:17.204174+0000","last_became_active":"2023-12-20T04:44:16.814961+0000","last_became_peered":"2023-12-20T04:44:16.814961+0000","last_unstale":"2023-12-20T04:44:17.204174+0000","last_undegraded":"2023-12-20T04:44:17.204174+0000","last_fullsized":"2023-12-20T04:44:17.204174+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:45:12.976332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202637+0000","last_change":"2023-12-20T04:44:17.211665+0000","last_active":"2023-12-20T04:44:18.202637+0000","last_peered":"2023-12-20T04:44:18.202637+0000","last_clean":"2023-12-20T04:44:18.202637+0000","last_became_active":"2023-12-20T04:44:17.208993+0000","last_became_peered":"2023-12-20T04:44:17.208993+0000","last_unstale":"2023-12-20T04:44:18.202637+0000","last_undegraded":"2023-12-20T04:44:18.202637+0000","last_fullsized":"2023-12-20T04:44:18.202637+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:12:01.374032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.16","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.201389+0000","last_change":"2023-12-20T04:44:16.818253+0000","last_active":"2023-12-20T04:44:17.201389+0000","last_peered":"2023-12-20T04:44:17.201389+0000","last_clean":"2023-12-20T04:44:17.201389+0000","last_became_active":"2023-12-20T04:44:16.818050+0000","last_became_peered":"2023-12-20T04:44:16.818050+0000","last_unstale":"2023-12-20T04:44:17.201389+0000","last_undegraded":"2023-12-20T04:44:17.201389+0000","last_fullsized":"2023-12-20T04:44:17.201389+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:45:56.730088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.14","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.201831+0000","last_change":"2023-12-20T04:44:17.212235+0000","last_active":"2023-12-20T04:44:18.201831+0000","last_peered":"2023-12-20T04:44:18.201831+0000","last_clean":"2023-12-20T04:44:18.201831+0000","last_became_active":"2023-12-20T04:44:17.211671+0000","last_became_peered":"2023-12-20T04:44:17.211671+0000","last_unstale":"2023-12-20T04:44:18.201831+0000","last_undegraded":"2023-12-20T04:44:18.201831+0000","last_fullsized":"2023-12-20T04:44:18.201831+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:02:42.080900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"46'3","reported_seq":14,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.216033+0000","last_change":"2023-12-20T04:44:16.822289+0000","last_active":"2023-12-20T04:44:17.216033+0000","last_peered":"2023-12-20T04:44:17.216033+0000","last_clean":"2023-12-20T04:44:17.216033+0000","last_became_active":"2023-12-20T04:44:16.821953+0000","last_became_peered":"2023-12-20T04:44:16.821953+0000","last_unstale":"2023-12-20T04:44:17.216033+0000","last_undegraded":"2023-12-20T04:44:17.216033+0000","last_fullsized":"2023-12-20T04:44:17.216033+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:36:20.465368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.15","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202491+0000","last_change":"2023-12-20T04:44:17.209913+0000","last_active":"2023-12-20T04:44:18.202491+0000","last_peered":"2023-12-20T04:44:18.202491+0000","last_clean":"2023-12-20T04:44:18.202491+0000","last_became_active":"2023-12-20T04:44:17.209658+0000","last_became_peered":"2023-12-20T04:44:17.209658+0000","last_unstale":"2023-12-20T04:44:18.202491+0000","last_undegraded":"2023-12-20T04:44:18.202491+0000","last_fullsized":"2023-12-20T04:44:18.202491+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:13.157257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.14","version":"46'6","reported_seq":17,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.220404+0000","last_change":"2023-12-20T04:44:16.816279+0000","last_active":"2023-12-20T04:44:17.220404+0000","last_peered":"2023-12-20T04:44:17.220404+0000","last_clean":"2023-12-20T04:44:17.220404+0000","last_became_active":"2023-12-20T04:44:16.815763+0000","last_became_peered":"2023-12-20T04:44:16.815763+0000","last_unstale":"2023-12-20T04:44:17.220404+0000","last_undegraded":"2023-12-20T04:44:17.220404+0000","last_fullsized":"2023-12-20T04:44:17.220404+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:48:39.434329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.222560+0000","last_change":"2023-12-20T04:44:17.206984+0000","last_active":"2023-12-20T04:44:18.222560+0000","last_peered":"2023-12-20T04:44:18.222560+0000","last_clean":"2023-12-20T04:44:18.222560+0000","last_became_active":"2023-12-20T04:44:17.206217+0000","last_became_peered":"2023-12-20T04:44:17.206217+0000","last_unstale":"2023-12-20T04:44:18.222560+0000","last_undegraded":"2023-12-20T04:44:18.222560+0000","last_fullsized":"2023-12-20T04:44:18.222560+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:32:25.372823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.13","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.217842+0000","last_change":"2023-12-20T04:44:16.817669+0000","last_active":"2023-12-20T04:44:17.217842+0000","last_peered":"2023-12-20T04:44:17.217842+0000","last_clean":"2023-12-20T04:44:17.217842+0000","last_became_active":"2023-12-20T04:44:16.817462+0000","last_became_peered":"2023-12-20T04:44:16.817462+0000","last_unstale":"2023-12-20T04:44:17.217842+0000","last_undegraded":"2023-12-20T04:44:17.217842+0000","last_fullsized":"2023-12-20T04:44:17.217842+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:30:39.506732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202740+0000","last_change":"2023-12-20T04:44:17.211886+0000","last_active":"2023-12-20T04:44:18.202740+0000","last_peered":"2023-12-20T04:44:18.202740+0000","last_clean":"2023-12-20T04:44:18.202740+0000","last_became_active":"2023-12-20T04:44:17.211383+0000","last_became_peered":"2023-12-20T04:44:17.211383+0000","last_unstale":"2023-12-20T04:44:18.202740+0000","last_undegraded":"2023-12-20T04:44:18.202740+0000","last_fullsized":"2023-12-20T04:44:18.202740+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:12:56.203631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.12","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.204993+0000","last_change":"2023-12-20T04:44:16.823661+0000","last_active":"2023-12-20T04:44:17.204993+0000","last_peered":"2023-12-20T04:44:17.204993+0000","last_clean":"2023-12-20T04:44:17.204993+0000","last_became_active":"2023-12-20T04:44:16.822646+0000","last_became_peered":"2023-12-20T04:44:16.822646+0000","last_unstale":"2023-12-20T04:44:17.204993+0000","last_undegraded":"2023-12-20T04:44:17.204993+0000","last_fullsized":"2023-12-20T04:44:17.204993+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:21:56.993244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.201681+0000","last_change":"2023-12-20T04:44:17.213703+0000","last_active":"2023-12-20T04:44:18.201681+0000","last_peered":"2023-12-20T04:44:18.201681+0000","last_clean":"2023-12-20T04:44:18.201681+0000","last_became_active":"2023-12-20T04:44:17.212770+0000","last_became_peered":"2023-12-20T04:44:17.212770+0000","last_unstale":"2023-12-20T04:44:18.201681+0000","last_undegraded":"2023-12-20T04:44:18.201681+0000","last_fullsized":"2023-12-20T04:44:18.201681+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:30:11.348756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.11","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.209318+0000","last_change":"2023-12-20T04:44:16.818926+0000","last_active":"2023-12-20T04:44:17.209318+0000","last_peered":"2023-12-20T04:44:17.209318+0000","last_clean":"2023-12-20T04:44:17.209318+0000","last_became_active":"2023-12-20T04:44:16.818326+0000","last_became_peered":"2023-12-20T04:44:16.818326+0000","last_unstale":"2023-12-20T04:44:17.209318+0000","last_undegraded":"2023-12-20T04:44:17.209318+0000","last_fullsized":"2023-12-20T04:44:17.209318+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:14:03.265816+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202336+0000","last_change":"2023-12-20T04:44:17.212735+0000","last_active":"2023-12-20T04:44:18.202336+0000","last_peered":"2023-12-20T04:44:18.202336+0000","last_clean":"2023-12-20T04:44:18.202336+0000","last_became_active":"2023-12-20T04:44:17.212508+0000","last_became_peered":"2023-12-20T04:44:17.212508+0000","last_unstale":"2023-12-20T04:44:18.202336+0000","last_undegraded":"2023-12-20T04:44:18.202336+0000","last_fullsized":"2023-12-20T04:44:18.202336+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:10:26.134813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.10","version":"46'8","reported_seq":19,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.219143+0000","last_change":"2023-12-20T04:44:16.817787+0000","last_active":"2023-12-20T04:44:17.219143+0000","last_peered":"2023-12-20T04:44:17.219143+0000","last_clean":"2023-12-20T04:44:17.219143+0000","last_became_active":"2023-12-20T04:44:16.817547+0000","last_became_peered":"2023-12-20T04:44:16.817547+0000","last_unstale":"2023-12-20T04:44:17.219143+0000","last_undegraded":"2023-12-20T04:44:17.219143+0000","last_fullsized":"2023-12-20T04:44:17.219143+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:38:03.599978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.e","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780788+0000","last_change":"2023-12-20T04:44:17.208529+0000","last_active":"2023-12-20T04:44:18.780788+0000","last_peered":"2023-12-20T04:44:18.780788+0000","last_clean":"2023-12-20T04:44:18.780788+0000","last_became_active":"2023-12-20T04:44:17.207944+0000","last_became_peered":"2023-12-20T04:44:17.207944+0000","last_unstale":"2023-12-20T04:44:18.780788+0000","last_undegraded":"2023-12-20T04:44:18.780788+0000","last_fullsized":"2023-12-20T04:44:18.780788+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:06:03.836042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.f","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.219563+0000","last_change":"2023-12-20T04:44:16.816476+0000","last_active":"2023-12-20T04:44:17.219563+0000","last_peered":"2023-12-20T04:44:17.219563+0000","last_clean":"2023-12-20T04:44:17.219563+0000","last_became_active":"2023-12-20T04:44:16.816054+0000","last_became_peered":"2023-12-20T04:44:16.816054+0000","last_unstale":"2023-12-20T04:44:17.219563+0000","last_undegraded":"2023-12-20T04:44:17.219563+0000","last_fullsized":"2023-12-20T04:44:17.219563+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:03:38.448781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202431+0000","last_change":"2023-12-20T04:44:17.215805+0000","last_active":"2023-12-20T04:44:18.202431+0000","last_peered":"2023-12-20T04:44:18.202431+0000","last_clean":"2023-12-20T04:44:18.202431+0000","last_became_active":"2023-12-20T04:44:17.212821+0000","last_became_peered":"2023-12-20T04:44:17.212821+0000","last_unstale":"2023-12-20T04:44:18.202431+0000","last_undegraded":"2023-12-20T04:44:18.202431+0000","last_fullsized":"2023-12-20T04:44:18.202431+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:37:43.345108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.e","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.216236+0000","last_change":"2023-12-20T04:44:16.816260+0000","last_active":"2023-12-20T04:44:17.216236+0000","last_peered":"2023-12-20T04:44:17.216236+0000","last_clean":"2023-12-20T04:44:17.216236+0000","last_became_active":"2023-12-20T04:44:16.815871+0000","last_became_peered":"2023-12-20T04:44:16.815871+0000","last_unstale":"2023-12-20T04:44:17.216236+0000","last_undegraded":"2023-12-20T04:44:17.216236+0000","last_fullsized":"2023-12-20T04:44:17.216236+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:04:44.530883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.222464+0000","last_change":"2023-12-20T04:44:17.213377+0000","last_active":"2023-12-20T04:44:18.222464+0000","last_peered":"2023-12-20T04:44:18.222464+0000","last_clean":"2023-12-20T04:44:18.222464+0000","last_became_active":"2023-12-20T04:44:17.213142+0000","last_became_peered":"2023-12-20T04:44:17.213142+0000","last_unstale":"2023-12-20T04:44:18.222464+0000","last_undegraded":"2023-12-20T04:44:18.222464+0000","last_fullsized":"2023-12-20T04:44:18.222464+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:35:30.290642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.d","version":"46'1","reported_seq":12,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.212358+0000","last_change":"2023-12-20T04:44:16.822934+0000","last_active":"2023-12-20T04:44:17.212358+0000","last_peered":"2023-12-20T04:44:17.212358+0000","last_clean":"2023-12-20T04:44:17.212358+0000","last_became_active":"2023-12-20T04:44:16.822306+0000","last_became_peered":"2023-12-20T04:44:16.822306+0000","last_unstale":"2023-12-20T04:44:17.212358+0000","last_undegraded":"2023-12-20T04:44:17.212358+0000","last_fullsized":"2023-12-20T04:44:17.212358+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:45.809267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.d","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.222660+0000","last_change":"2023-12-20T04:44:17.207179+0000","last_active":"2023-12-20T04:44:18.222660+0000","last_peered":"2023-12-20T04:44:18.222660+0000","last_clean":"2023-12-20T04:44:18.222660+0000","last_became_active":"2023-12-20T04:44:17.206595+0000","last_became_peered":"2023-12-20T04:44:17.206595+0000","last_unstale":"2023-12-20T04:44:18.222660+0000","last_undegraded":"2023-12-20T04:44:18.222660+0000","last_fullsized":"2023-12-20T04:44:18.222660+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:45:13.978513+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.c","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.209748+0000","last_change":"2023-12-20T04:44:16.822604+0000","last_active":"2023-12-20T04:44:17.209748+0000","last_peered":"2023-12-20T04:44:17.209748+0000","last_clean":"2023-12-20T04:44:17.209748+0000","last_became_active":"2023-12-20T04:44:16.822369+0000","last_became_peered":"2023-12-20T04:44:16.822369+0000","last_unstale":"2023-12-20T04:44:17.209748+0000","last_undegraded":"2023-12-20T04:44:17.209748+0000","last_fullsized":"2023-12-20T04:44:17.209748+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:21:56.993244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.201628+0000","last_change":"2023-12-20T04:44:17.211891+0000","last_active":"2023-12-20T04:44:18.201628+0000","last_peered":"2023-12-20T04:44:18.201628+0000","last_clean":"2023-12-20T04:44:18.201628+0000","last_became_active":"2023-12-20T04:44:17.211385+0000","last_became_peered":"2023-12-20T04:44:17.211385+0000","last_unstale":"2023-12-20T04:44:18.201628+0000","last_undegraded":"2023-12-20T04:44:18.201628+0000","last_fullsized":"2023-12-20T04:44:18.201628+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:11:06.722583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.b","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.218990+0000","last_change":"2023-12-20T04:44:16.819510+0000","last_active":"2023-12-20T04:44:17.218990+0000","last_peered":"2023-12-20T04:44:17.218990+0000","last_clean":"2023-12-20T04:44:17.218990+0000","last_became_active":"2023-12-20T04:44:16.819286+0000","last_became_peered":"2023-12-20T04:44:16.819286+0000","last_unstale":"2023-12-20T04:44:17.218990+0000","last_undegraded":"2023-12-20T04:44:17.218990+0000","last_fullsized":"2023-12-20T04:44:17.218990+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780461+0000","last_change":"2023-12-20T04:44:17.207651+0000","last_active":"2023-12-20T04:44:18.780461+0000","last_peered":"2023-12-20T04:44:18.780461+0000","last_clean":"2023-12-20T04:44:18.780461+0000","last_became_active":"2023-12-20T04:44:17.207421+0000","last_became_peered":"2023-12-20T04:44:17.207421+0000","last_unstale":"2023-12-20T04:44:18.780461+0000","last_undegraded":"2023-12-20T04:44:18.780461+0000","last_fullsized":"2023-12-20T04:44:18.780461+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:48:33.418074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.201198+0000","last_change":"2023-12-20T04:44:16.823739+0000","last_active":"2023-12-20T04:44:17.201198+0000","last_peered":"2023-12-20T04:44:17.201198+0000","last_clean":"2023-12-20T04:44:17.201198+0000","last_became_active":"2023-12-20T04:44:16.823528+0000","last_became_peered":"2023-12-20T04:44:16.823528+0000","last_unstale":"2023-12-20T04:44:17.201198+0000","last_undegraded":"2023-12-20T04:44:17.201198+0000","last_fullsized":"2023-12-20T04:44:17.201198+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:23.840378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780881+0000","last_change":"2023-12-20T04:44:17.214381+0000","last_active":"2023-12-20T04:44:18.780881+0000","last_peered":"2023-12-20T04:44:18.780881+0000","last_clean":"2023-12-20T04:44:18.780881+0000","last_became_active":"2023-12-20T04:44:17.214156+0000","last_became_peered":"2023-12-20T04:44:17.214156+0000","last_unstale":"2023-12-20T04:44:18.780881+0000","last_undegraded":"2023-12-20T04:44:18.780881+0000","last_fullsized":"2023-12-20T04:44:18.780881+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:45:57.732269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.202572+0000","last_change":"2023-12-20T04:44:16.819646+0000","last_active":"2023-12-20T04:44:17.202572+0000","last_peered":"2023-12-20T04:44:17.202572+0000","last_clean":"2023-12-20T04:44:17.202572+0000","last_became_active":"2023-12-20T04:44:16.818503+0000","last_became_peered":"2023-12-20T04:44:16.818503+0000","last_unstale":"2023-12-20T04:44:17.202572+0000","last_undegraded":"2023-12-20T04:44:17.202572+0000","last_fullsized":"2023-12-20T04:44:17.202572+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:43:25.969506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.9","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202780+0000","last_change":"2023-12-20T04:44:17.206712+0000","last_active":"2023-12-20T04:44:18.202780+0000","last_peered":"2023-12-20T04:44:18.202780+0000","last_clean":"2023-12-20T04:44:18.202780+0000","last_became_active":"2023-12-20T04:44:17.206129+0000","last_became_peered":"2023-12-20T04:44:17.206129+0000","last_unstale":"2023-12-20T04:44:18.202780+0000","last_undegraded":"2023-12-20T04:44:18.202780+0000","last_fullsized":"2023-12-20T04:44:18.202780+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:48:33.418074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.205082+0000","last_change":"2023-12-20T04:44:16.823832+0000","last_active":"2023-12-20T04:44:17.205082+0000","last_peered":"2023-12-20T04:44:17.205082+0000","last_clean":"2023-12-20T04:44:17.205082+0000","last_became_active":"2023-12-20T04:44:16.822938+0000","last_became_peered":"2023-12-20T04:44:16.822938+0000","last_unstale":"2023-12-20T04:44:17.205082+0000","last_undegraded":"2023-12-20T04:44:17.205082+0000","last_fullsized":"2023-12-20T04:44:17.205082+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:46:29.128311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.222590+0000","last_change":"2023-12-20T04:44:17.207292+0000","last_active":"2023-12-20T04:44:18.222590+0000","last_peered":"2023-12-20T04:44:18.222590+0000","last_clean":"2023-12-20T04:44:18.222590+0000","last_became_active":"2023-12-20T04:44:17.206628+0000","last_became_peered":"2023-12-20T04:44:17.206628+0000","last_unstale":"2023-12-20T04:44:18.222590+0000","last_undegraded":"2023-12-20T04:44:18.222590+0000","last_fullsized":"2023-12-20T04:44:18.222590+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:11:30.357463+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.6","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.208888+0000","last_change":"2023-12-20T04:44:16.822048+0000","last_active":"2023-12-20T04:44:17.208888+0000","last_peered":"2023-12-20T04:44:17.208888+0000","last_clean":"2023-12-20T04:44:17.208888+0000","last_became_active":"2023-12-20T04:44:16.821803+0000","last_became_peered":"2023-12-20T04:44:16.821803+0000","last_unstale":"2023-12-20T04:44:17.208888+0000","last_undegraded":"2023-12-20T04:44:17.208888+0000","last_fullsized":"2023-12-20T04:44:17.208888+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:37:42.342927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202820+0000","last_change":"2023-12-20T04:44:17.211179+0000","last_active":"2023-12-20T04:44:18.202820+0000","last_peered":"2023-12-20T04:44:18.202820+0000","last_clean":"2023-12-20T04:44:18.202820+0000","last_became_active":"2023-12-20T04:44:17.206396+0000","last_became_peered":"2023-12-20T04:44:17.206396+0000","last_unstale":"2023-12-20T04:44:18.202820+0000","last_undegraded":"2023-12-20T04:44:18.202820+0000","last_fullsized":"2023-12-20T04:44:18.202820+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:41:34.643377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.5","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.206067+0000","last_change":"2023-12-20T04:44:16.822333+0000","last_active":"2023-12-20T04:44:17.206067+0000","last_peered":"2023-12-20T04:44:17.206067+0000","last_clean":"2023-12-20T04:44:17.206067+0000","last_became_active":"2023-12-20T04:44:16.820950+0000","last_became_peered":"2023-12-20T04:44:16.820950+0000","last_unstale":"2023-12-20T04:44:17.206067+0000","last_undegraded":"2023-12-20T04:44:17.206067+0000","last_fullsized":"2023-12-20T04:44:17.206067+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:02:34.348449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202411+0000","last_change":"2023-12-20T04:44:17.210903+0000","last_active":"2023-12-20T04:44:18.202411+0000","last_peered":"2023-12-20T04:44:18.202411+0000","last_clean":"2023-12-20T04:44:18.202411+0000","last_became_active":"2023-12-20T04:44:17.210689+0000","last_became_peered":"2023-12-20T04:44:17.210689+0000","last_unstale":"2023-12-20T04:44:18.202411+0000","last_undegraded":"2023-12-20T04:44:18.202411+0000","last_fullsized":"2023-12-20T04:44:18.202411+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:10:20.447949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.4","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.203766+0000","last_change":"2023-12-20T04:44:16.820994+0000","last_active":"2023-12-20T04:44:17.203766+0000","last_peered":"2023-12-20T04:44:17.203766+0000","last_clean":"2023-12-20T04:44:17.203766+0000","last_became_active":"2023-12-20T04:44:16.820434+0000","last_became_peered":"2023-12-20T04:44:16.820434+0000","last_unstale":"2023-12-20T04:44:17.203766+0000","last_undegraded":"2023-12-20T04:44:17.203766+0000","last_fullsized":"2023-12-20T04:44:17.203766+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:40:44.095711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.201787+0000","last_change":"2023-12-20T04:44:17.212107+0000","last_active":"2023-12-20T04:44:18.201787+0000","last_peered":"2023-12-20T04:44:18.201787+0000","last_clean":"2023-12-20T04:44:18.201787+0000","last_became_active":"2023-12-20T04:44:17.211667+0000","last_became_peered":"2023-12-20T04:44:17.211667+0000","last_unstale":"2023-12-20T04:44:18.201787+0000","last_undegraded":"2023-12-20T04:44:18.201787+0000","last_fullsized":"2023-12-20T04:44:18.201787+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:23:47.174671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.205167+0000","last_change":"2023-12-20T04:44:16.824007+0000","last_active":"2023-12-20T04:44:17.205167+0000","last_peered":"2023-12-20T04:44:17.205167+0000","last_clean":"2023-12-20T04:44:17.205167+0000","last_became_active":"2023-12-20T04:44:16.823442+0000","last_became_peered":"2023-12-20T04:44:16.823442+0000","last_unstale":"2023-12-20T04:44:17.205167+0000","last_undegraded":"2023-12-20T04:44:17.205167+0000","last_fullsized":"2023-12-20T04:44:17.205167+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:45.809267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.3","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202095+0000","last_change":"2023-12-20T04:44:17.211936+0000","last_active":"2023-12-20T04:44:18.202095+0000","last_peered":"2023-12-20T04:44:18.202095+0000","last_clean":"2023-12-20T04:44:18.202095+0000","last_became_active":"2023-12-20T04:44:17.211587+0000","last_became_peered":"2023-12-20T04:44:17.211587+0000","last_unstale":"2023-12-20T04:44:18.202095+0000","last_undegraded":"2023-12-20T04:44:18.202095+0000","last_fullsized":"2023-12-20T04:44:18.202095+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:28:15.935324+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.205185+0000","last_change":"2023-12-20T04:44:16.818639+0000","last_active":"2023-12-20T04:44:17.205185+0000","last_peered":"2023-12-20T04:44:17.205185+0000","last_clean":"2023-12-20T04:44:17.205185+0000","last_became_active":"2023-12-20T04:44:16.818428+0000","last_became_peered":"2023-12-20T04:44:16.818428+0000","last_unstale":"2023-12-20T04:44:17.205185+0000","last_undegraded":"2023-12-20T04:44:17.205185+0000","last_fullsized":"2023-12-20T04:44:17.205185+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:12:23.948724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.0","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780564+0000","last_change":"2023-12-20T04:44:17.207481+0000","last_active":"2023-12-20T04:44:18.780564+0000","last_peered":"2023-12-20T04:44:18.780564+0000","last_clean":"2023-12-20T04:44:18.780564+0000","last_became_active":"2023-12-20T04:44:17.207241+0000","last_became_peered":"2023-12-20T04:44:17.207241+0000","last_unstale":"2023-12-20T04:44:18.780564+0000","last_undegraded":"2023-12-20T04:44:18.780564+0000","last_fullsized":"2023-12-20T04:44:18.780564+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:48:33.418074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.1","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.203867+0000","last_change":"2023-12-20T04:44:16.820681+0000","last_active":"2023-12-20T04:44:17.203867+0000","last_peered":"2023-12-20T04:44:17.203867+0000","last_clean":"2023-12-20T04:44:17.203867+0000","last_became_active":"2023-12-20T04:44:16.820463+0000","last_became_peered":"2023-12-20T04:44:16.820463+0000","last_unstale":"2023-12-20T04:44:17.203867+0000","last_undegraded":"2023-12-20T04:44:17.203867+0000","last_fullsized":"2023-12-20T04:44:17.203867+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:51.997296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.780914+0000","last_change":"2023-12-20T04:44:17.210807+0000","last_active":"2023-12-20T04:44:18.780914+0000","last_peered":"2023-12-20T04:44:18.780914+0000","last_clean":"2023-12-20T04:44:18.780914+0000","last_became_active":"2023-12-20T04:44:17.210597+0000","last_became_peered":"2023-12-20T04:44:17.210597+0000","last_unstale":"2023-12-20T04:44:18.780914+0000","last_undegraded":"2023-12-20T04:44:18.780914+0000","last_fullsized":"2023-12-20T04:44:18.780914+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:21:57.995425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.0","version":"0'0","reported_seq":11,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.201810+0000","last_change":"2023-12-20T04:44:16.816428+0000","last_active":"2023-12-20T04:44:17.201810+0000","last_peered":"2023-12-20T04:44:17.201810+0000","last_clean":"2023-12-20T04:44:17.201810+0000","last_became_active":"2023-12-20T04:44:16.816206+0000","last_became_peered":"2023-12-20T04:44:16.816206+0000","last_unstale":"2023-12-20T04:44:17.201810+0000","last_undegraded":"2023-12-20T04:44:17.201810+0000","last_fullsized":"2023-12-20T04:44:17.201810+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:06:02.833861+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":10,"reported_epoch":47,"state":"active+clean","last_fresh":"2023-12-20T04:44:18.202355+0000","last_change":"2023-12-20T04:44:17.213935+0000","last_active":"2023-12-20T04:44:18.202355+0000","last_peered":"2023-12-20T04:44:18.202355+0000","last_clean":"2023-12-20T04:44:18.202355+0000","last_became_active":"2023-12-20T04:44:17.213712+0000","last_became_peered":"2023-12-20T04:44:17.213712+0000","last_unstale":"2023-12-20T04:44:18.202355+0000","last_undegraded":"2023-12-20T04:44:18.202355+0000","last_fullsized":"2023-12-20T04:44:18.202355+0000","mapping_epoch":45,"log_start":"0'0","ondisk_log_start":"0'0","created":45,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:16.806167+0000","last_clean_scrub_stamp":"2023-12-20T04:44:16.806167+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:13.157257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.7","version":"46'2","reported_seq":13,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.212354+0000","last_change":"2023-12-20T04:44:16.820519+0000","last_active":"2023-12-20T04:44:17.212354+0000","last_peered":"2023-12-20T04:44:17.212354+0000","last_clean":"2023-12-20T04:44:17.212354+0000","last_became_active":"2023-12-20T04:44:16.820319+0000","last_became_peered":"2023-12-20T04:44:16.820319+0000","last_unstale":"2023-12-20T04:44:17.212354+0000","last_undegraded":"2023-12-20T04:44:17.212354+0000","last_fullsized":"2023-12-20T04:44:17.212354+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":44,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:44:15.803986+0000","last_clean_scrub_stamp":"2023-12-20T04:44:15.803986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:35:29.288461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":186,"reported_epoch":46,"state":"active+clean","last_fresh":"2023-12-20T04:44:17.206283+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:44:17.206283+0000","last_peered":"2023-12-20T04:44:17.206283+0000","last_clean":"2023-12-20T04:44:17.206283+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:44:17.206283+0000","last_undegraded":"2023-12-20T04:44:17.206283+0000","last_fullsized":"2023-12-20T04:44:17.206283+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":7,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574871,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":797,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194515,"statfs":{"total":200000000,"available":199183429,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.68799999999999994}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.98799999999999999,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0269999999999999,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.72799999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":1.0069999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.70199999999999996}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.71299999999999997},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.47199999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.59599999999999997}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.33100000000000002,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"last":0.442}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.46200000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.56000000000000005,"15min":0.56000000000000005},"min":{"1min":0.35399999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.5}]}]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":221,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199773215,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60399999999999998,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.64000000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"min":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.59899999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.502,"15min":0.502},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.69799999999999995,"5min":0.69799999999999995,"15min":0.69799999999999995},"last":0.54800000000000004}]},{"osd":3,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.56499999999999995}]},{"osd":4,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73999999999999999,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.44600000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.72199999999999998,"5min":0.72199999999999998,"15min":0.72199999999999998},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74299999999999999,"5min":0.74299999999999999,"15min":0.74299999999999999},"last":0.34100000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"last":0.58199999999999996}]}]},{"osd":5,"up_from":13,"seq":55834574871,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":220,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199773817,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.745,"5min":0.745,"15min":0.745},"last":0.55800000000000005},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.437,"5min":0.437,"15min":0.437},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.60799999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.82099999999999995,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.53200000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"min":{"1min":0.32100000000000001,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.436},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.58399999999999996}]},{"osd":3,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.38400000000000001,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.80900000000000005,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.53900000000000003,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.70499999999999996,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.65000000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32900000000000001,"5min":0.32900000000000001,"15min":0.32900000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.629}]},{"osd":6,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.70199999999999996}]},{"osd":7,"last update":"Wed Dec 20 04:43:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.748},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.98599999999999999,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.78100000000000003}]}]},{"osd":4,"up_from":13,"seq":55834574871,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195090,"statfs":{"total":200000000,"available":199772323,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.71499999999999997,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.38400000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.505,"5min":0.505,"15min":0.505},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.498}]},{"osd":2,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"min":{"1min":0.435,"5min":0.435,"15min":0.435},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.373}]},{"osd":3,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71299999999999997},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"min":{"1min":0.46200000000000002,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":0.91000000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.58299999999999996}]},{"osd":5,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.40400000000000003},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76700000000000002,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.52200000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.82399999999999995,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.54100000000000004,"15min":0.54100000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.47999999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:43:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68500000000000005,"5min":0.68500000000000005,"15min":0.68500000000000005},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.60599999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574871,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":221,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199773249,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"last":0.308}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.315,"5min":0.315,"15min":0.315},"min":{"1min":0.219,"5min":0.219,"15min":0.219},"max":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"min":{"1min":0.217,"5min":0.217,"15min":0.217},"max":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"last":0.32000000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.248,"5min":0.248,"15min":0.248},"max":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"last":0.39300000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.71299999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.73399999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.75}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.81399999999999995},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"min":{"1min":0.441,"5min":0.441,"15min":0.441},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.66700000000000004}]}]},{"osd":2,"up_from":13,"seq":55834574871,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":222,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195090,"statfs":{"total":200000000,"available":199772301,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.374,"5min":0.374,"15min":0.374},"last":0.255},{"interface":"front","average":{"1min":0.32200000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"min":{"1min":0.17699999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.436,"5min":0.436,"15min":0.436},"last":0.315}]},{"osd":1,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"min":{"1min":0.17999999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"min":{"1min":0.245,"5min":0.245,"15min":0.245},"max":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"last":0.34300000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"min":{"1min":0.216,"5min":0.216,"15min":0.216},"max":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.499,"5min":0.499,"15min":0.499},"last":0.38400000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.503},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55900000000000005},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.53900000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.47399999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.755,"5min":0.755,"15min":0.755},"last":0.46400000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.434,"5min":0.434,"15min":0.434},"max":{"1min":0.70899999999999996,"5min":0.70899999999999996,"15min":0.70899999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"last":0.52600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574872,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":220,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":195091,"statfs":{"total":200000000,"available":199773817,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"min":{"1min":0.187,"5min":0.187,"15min":0.187},"max":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"last":0.25},{"interface":"front","average":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"min":{"1min":0.22700000000000001,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.44,"5min":0.44,"15min":0.44},"last":0.33300000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"min":{"1min":0.20599999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"last":0.316}]},{"osd":3,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"min":{"1min":0.191,"5min":0.191,"15min":0.191},"max":{"1min":0.45000000000000001,"5min":0.45000000000000001,"15min":0.45000000000000001},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"last":0.37}]},{"osd":4,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.41599999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.45900000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.441},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.45000000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:43:38 2023","interfaces":[{"interface":"back","average":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.42199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61499999999999999,"15min":0.61499999999999999},"min":{"1min":0.45700000000000002,"5min":0.45700000000000002,"15min":0.45700000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.40999999999999998}]}]},{"osd":0,"up_from":13,"seq":55834574871,"num_pgs":31,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":797,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194515,"statfs":{"total":200000000,"available":199183485,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"min":{"1min":0.184,"5min":0.184,"15min":0.184},"max":{"1min":0.441,"5min":0.441,"15min":0.441},"last":0.26400000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.35299999999999998,"15min":0.35299999999999998},"min":{"1min":0.218,"5min":0.218,"15min":0.218},"max":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.36399999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.314,"5min":0.314,"15min":0.314},"min":{"1min":0.23899999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.5,"5min":0.5,"15min":0.5},"last":0.30399999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.44700000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.50900000000000001,"15min":0.50900000000000001},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.432}]},{"osd":5,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.81200000000000006,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.74399999999999999,"5min":0.74399999999999999,"15min":0.74399999999999999},"last":0.48999999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.53500000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:43:36 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46500000000000002}]}]}],"pool_statfs":[]}} 2023-12-20T04:44:24.827 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-20T04:44:24.827 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-20T04:44:24.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.967+0000 7f3cf15cb640 1 Processor -- start 2023-12-20T04:44:24.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.967+0000 7f3cf15cb640 1 -- start start 2023-12-20T04:44:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.968+0000 7f3cf15cb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3cec0cf1d0 0x7f3cec15e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.968+0000 7f3cf15cb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3cec0ce7e0 0x7f3cec0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.968+0000 7f3cf15cb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cec15e740 con 0x7f3cec070460 2023-12-20T04:44:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.968+0000 7f3cf15cb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cec070e30 con 0x7f3cec0ce7e0 2023-12-20T04:44:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.968+0000 7f3cf15cb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cec0cb6b0 con 0x7f3cec0cf1d0 2023-12-20T04:44:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.968+0000 7f3ceb7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3cec0ce7e0 0x7f3cec0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.968+0000 7f3ceb7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3cec0ce7e0 0x7f3cec0708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57014/0 (socket says 172.21.15.132:57014) 2023-12-20T04:44:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.968+0000 7f3ceb7fe640 1 -- 172.21.15.132:0/1778688910 learned_addr learned my addr 172.21.15.132:0/1778688910 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.968+0000 7f3ceaffd640 1 --2- 172.21.15.132:0/1778688910 >> v2:172.21.15.187:3300/0 conn(0x7f3cec0cf1d0 0x7f3cec15e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.968+0000 7f3ceb7fe640 1 -- 172.21.15.132:0/1778688910 >> v2:172.21.15.187:3300/0 conn(0x7f3cec0cf1d0 msgr2=0x7f3cec15e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.968+0000 7f3ceb7fe640 1 --2- 172.21.15.132:0/1778688910 >> v2:172.21.15.187:3300/0 conn(0x7f3cec0cf1d0 0x7f3cec15e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.968+0000 7f3ceb7fe640 1 -- 172.21.15.132:0/1778688910 >> v1:172.21.15.187:6789/0 conn(0x7f3cec070460 legacy=0x7f3cec0c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.968+0000 7f3ceb7fe640 1 -- 172.21.15.132:0/1778688910 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cec0cb990 con 0x7f3cec0ce7e0 2023-12-20T04:44:24.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.969+0000 7f3ceb7fe640 1 --2- 172.21.15.132:0/1778688910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cec0ce7e0 0x7f3cec0708f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3cec073ad0 tx=0x7f3ce402e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d823e682d9591910 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:24.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.969+0000 7f3ce9ffb640 1 -- 172.21.15.132:0/1778688910 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce402ee90 con 0x7f3cec0ce7e0 2023-12-20T04:44:24.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.969+0000 7f3ce9ffb640 1 -- 172.21.15.132:0/1778688910 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce4036440 con 0x7f3cec0ce7e0 2023-12-20T04:44:24.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.969+0000 7f3ce9ffb640 1 -- 172.21.15.132:0/1778688910 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce40367d0 con 0x7f3cec0ce7e0 2023-12-20T04:44:24.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.970+0000 7f3cf15cb640 1 -- 172.21.15.132:0/1778688910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cec0ce7e0 msgr2=0x7f3cec0708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:24.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.970+0000 7f3cf15cb640 1 --2- 172.21.15.132:0/1778688910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cec0ce7e0 0x7f3cec0708f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f3cec073ad0 tx=0x7f3ce402e0e0 comp rx=0 tx=0).stop 2023-12-20T04:44:24.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.970+0000 7f3cf15cb640 1 -- 172.21.15.132:0/1778688910 shutdown_connections 2023-12-20T04:44:24.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.970+0000 7f3cf15cb640 1 --2- 172.21.15.132:0/1778688910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cec0ce7e0 0x7f3cec0708f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:24.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.970+0000 7f3cf15cb640 1 --2- 172.21.15.132:0/1778688910 >> v2:172.21.15.187:3300/0 conn(0x7f3cec0cf1d0 0x7f3cec15e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:24.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.970+0000 7f3cf15cb640 1 -- 172.21.15.132:0/1778688910 >> 172.21.15.132:0/1778688910 conn(0x7f3cec0cc630 msgr2=0x7f3cec0cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:24.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.970+0000 7f3cf15cb640 1 -- 172.21.15.132:0/1778688910 shutdown_connections 2023-12-20T04:44:24.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.970+0000 7f3cf15cb640 1 -- 172.21.15.132:0/1778688910 wait complete. 2023-12-20T04:44:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.971+0000 7f3cf15cb640 1 Processor -- start 2023-12-20T04:44:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.971+0000 7f3cf15cb640 1 -- start start 2023-12-20T04:44:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3cf15cb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cec070460 0x7f3cec159220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3cf15cb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cec0ce7e0 0x7f3cec1f1600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3cf15cb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cec0cf1d0 0x7f3cec1f1b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3cf15cb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec0c6bf0 con 0x7f3cec0cf1d0 2023-12-20T04:44:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3cf15cb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec15ad30 con 0x7f3cec0ce7e0 2023-12-20T04:44:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3cf15cb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cec15b010 con 0x7f3cec070460 2023-12-20T04:44:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3ceb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cec0cf1d0 0x7f3cec1f1b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3ceb7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cec0cf1d0 0x7f3cec1f1b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57024/0 (socket says 172.21.15.132:57024) 2023-12-20T04:44:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3ceb7fe640 1 -- 172.21.15.132:0/3879644694 learned_addr learned my addr 172.21.15.132:0/3879644694 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3cea7fc640 1 --2- 172.21.15.132:0/3879644694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cec0ce7e0 0x7f3cec1f1600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3ceaffd640 1 --2- 172.21.15.132:0/3879644694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cec070460 0x7f3cec159220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:24.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3ceb7fe640 1 -- 172.21.15.132:0/3879644694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cec070460 msgr2=0x7f3cec159220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:24.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3ceb7fe640 1 --2- 172.21.15.132:0/3879644694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cec070460 0x7f3cec159220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:24.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3ceb7fe640 1 -- 172.21.15.132:0/3879644694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cec0ce7e0 msgr2=0x7f3cec1f1600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:24.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3ceb7fe640 1 --2- 172.21.15.132:0/3879644694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cec0ce7e0 0x7f3cec1f1600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:24.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3ceb7fe640 1 -- 172.21.15.132:0/3879644694 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ce400b770 con 0x7f3cec0cf1d0 2023-12-20T04:44:24.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3cea7fc640 1 --2- 172.21.15.132:0/3879644694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cec0ce7e0 0x7f3cec1f1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:24.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.972+0000 7f3ceb7fe640 1 --2- 172.21.15.132:0/3879644694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cec0cf1d0 0x7f3cec1f1b40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400b2c0 tx=0x7f3ce40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:24.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.973+0000 7f3cd37fe640 1 -- 172.21.15.132:0/3879644694 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4034850 con 0x7f3cec0cf1d0 2023-12-20T04:44:24.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.973+0000 7f3cd37fe640 1 -- 172.21.15.132:0/3879644694 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ce40349d0 con 0x7f3cec0cf1d0 2023-12-20T04:44:24.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.973+0000 7f3cf15cb640 1 -- 172.21.15.132:0/3879644694 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cec15b2f0 con 0x7f3cec0cf1d0 2023-12-20T04:44:24.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.973+0000 7f3cd37fe640 1 -- 172.21.15.132:0/3879644694 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ce4034d80 con 0x7f3cec0cf1d0 2023-12-20T04:44:24.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.973+0000 7f3cf15cb640 1 -- 172.21.15.132:0/3879644694 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cec159760 con 0x7f3cec0cf1d0 2023-12-20T04:44:24.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.974+0000 7f3cf15cb640 1 -- 172.21.15.132:0/3879644694 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cec0c6da0 con 0x7f3cec0cf1d0 2023-12-20T04:44:24.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.974+0000 7f3cd37fe640 1 -- 172.21.15.132:0/3879644694 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3ce403d040 con 0x7f3cec0cf1d0 2023-12-20T04:44:24.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.974+0000 7f3cd37fe640 1 --2- 172.21.15.132:0/3879644694 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cd806a430 0x7f3cd806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:24.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.974+0000 7f3ceaffd640 1 --2- 172.21.15.132:0/3879644694 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cd806a430 0x7f3cd806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:24.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.974+0000 7f3cd37fe640 1 -- 172.21.15.132:0/3879644694 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ce40ad6d0 con 0x7f3cec0cf1d0 2023-12-20T04:44:24.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.975+0000 7f3ceaffd640 1 --2- 172.21.15.132:0/3879644694 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cd806a430 0x7f3cd806c8f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0ce260 tx=0x7f3cdc00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:24.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:24.979+0000 7f3cd37fe640 1 -- 172.21.15.132:0/3879644694 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3ce4078d60 con 0x7f3cec0cf1d0 2023-12-20T04:44:25.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.207+0000 7f3cf15cb640 1 -- 172.21.15.132:0/3879644694 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3cec04e840 con 0x7f3cec0cf1d0 2023-12-20T04:44:25.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.211+0000 7f3cd37fe640 1 -- 172.21.15.132:0/3879644694 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v14) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3ce407c380 con 0x7f3cec0cf1d0 2023-12-20T04:44:25.213 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.0 2023-12-20T04:44:25.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.213+0000 7f3cf15cb640 1 -- 172.21.15.132:0/3879644694 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cd806a430 msgr2=0x7f3cd806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:25.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.213+0000 7f3cf15cb640 1 --2- 172.21.15.132:0/3879644694 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cd806a430 0x7f3cd806c8f0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f3cec0ce260 tx=0x7f3cdc00b040 comp rx=0 tx=0).stop 2023-12-20T04:44:25.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.214+0000 7f3cf15cb640 1 -- 172.21.15.132:0/3879644694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cec0cf1d0 msgr2=0x7f3cec1f1b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:25.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.214+0000 7f3cf15cb640 1 --2- 172.21.15.132:0/3879644694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cec0cf1d0 0x7f3cec1f1b40 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f3ce400b2c0 tx=0x7f3ce40046c0 comp rx=0 tx=0).stop 2023-12-20T04:44:25.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.214+0000 7f3cf15cb640 1 -- 172.21.15.132:0/3879644694 shutdown_connections 2023-12-20T04:44:25.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.214+0000 7f3cf15cb640 1 --2- 172.21.15.132:0/3879644694 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cd806a430 0x7f3cd806c8f0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:25.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.214+0000 7f3cf15cb640 1 --2- 172.21.15.132:0/3879644694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cec0cf1d0 0x7f3cec1f1b40 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:25.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.214+0000 7f3cf15cb640 1 --2- 172.21.15.132:0/3879644694 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cec0ce7e0 0x7f3cec1f1600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:25.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.214+0000 7f3cf15cb640 1 --2- 172.21.15.132:0/3879644694 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cec070460 0x7f3cec159220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:25.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.214+0000 7f3cf15cb640 1 -- 172.21.15.132:0/3879644694 >> 172.21.15.132:0/3879644694 conn(0x7f3cec0cc630 msgr2=0x7f3cec06c6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:25.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.214+0000 7f3cf15cb640 1 -- 172.21.15.132:0/3879644694 shutdown_connections 2023-12-20T04:44:25.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.214+0000 7f3cf15cb640 1 -- 172.21.15.132:0/3879644694 wait complete. 2023-12-20T04:44:25.226 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:44:25.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.325+0000 7f93ac8c4640 1 Processor -- start 2023-12-20T04:44:25.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.325+0000 7f93ac8c4640 1 -- start start 2023-12-20T04:44:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.326+0000 7f93ac8c4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f93a815e2d0 0x7f93a80b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.326+0000 7f93ac8c4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a80cd740 con 0x7f93a80cb420 2023-12-20T04:44:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.326+0000 7f93ac8c4640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93a80ce230 con 0x7f93a80cf0b0 2023-12-20T04:44:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.326+0000 7f93ac8c4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93a80cd990 con 0x7f93a815e2d0 2023-12-20T04:44:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.326+0000 7f93a659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f93a815e2d0 0x7f93a80b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.326+0000 7f93a659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f93a815e2d0 0x7f93a80b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57038/0 (socket says 172.21.15.132:57038) 2023-12-20T04:44:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.326+0000 7f93a659c640 1 -- 172.21.15.132:0/2078605391 learned_addr learned my addr 172.21.15.132:0/2078605391 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.326+0000 7f939ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f93a80cb420 0x7f93a80ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46906/0 (socket says 172.21.15.132:46906) 2023-12-20T04:44:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.326+0000 7f93a659c640 1 -- 172.21.15.132:0/2078605391 >> v1:172.21.15.187:6789/0 conn(0x7f93a80cf0b0 legacy=0x7f93a80d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:25.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.326+0000 7f93a659c640 1 -- 172.21.15.132:0/2078605391 >> v1:172.21.15.132:6789/0 conn(0x7f93a80cb420 legacy=0x7f93a80ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:25.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.326+0000 7f93a659c640 1 -- 172.21.15.132:0/2078605391 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93a80cdc70 con 0x7f93a815e2d0 2023-12-20T04:44:25.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.327+0000 7f93a659c640 1 --2- 172.21.15.132:0/2078605391 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a815e2d0 0x7f93a80b3330 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9398009870 tx=0x7f939802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=864cdc6227002fa1 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:25.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.327+0000 7f93a5d9b640 1 -- 172.21.15.132:0/2078605391 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398031870 con 0x7f93a815e2d0 2023-12-20T04:44:25.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.327+0000 7f93a5d9b640 1 -- 172.21.15.132:0/2078605391 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93980319d0 con 0x7f93a815e2d0 2023-12-20T04:44:25.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.327+0000 7f93a5d9b640 1 -- 172.21.15.132:0/2078605391 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9398031d60 con 0x7f93a815e2d0 2023-12-20T04:44:25.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.327+0000 7f93ac8c4640 1 -- 172.21.15.132:0/2078605391 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a815e2d0 msgr2=0x7f93a80b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:25.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.327+0000 7f93ac8c4640 1 --2- 172.21.15.132:0/2078605391 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a815e2d0 0x7f93a80b3330 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f9398009870 tx=0x7f939802b910 comp rx=0 tx=0).stop 2023-12-20T04:44:25.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.327+0000 7f93ac8c4640 1 -- 172.21.15.132:0/2078605391 shutdown_connections 2023-12-20T04:44:25.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.327+0000 7f93ac8c4640 1 --2- 172.21.15.132:0/2078605391 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a815e2d0 0x7f93a80b3330 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:25.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.327+0000 7f93ac8c4640 1 -- 172.21.15.132:0/2078605391 >> 172.21.15.132:0/2078605391 conn(0x7f93a806d7c0 msgr2=0x7f93a806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:25.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.327+0000 7f93ac8c4640 1 -- 172.21.15.132:0/2078605391 shutdown_connections 2023-12-20T04:44:25.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.327+0000 7f93ac8c4640 1 -- 172.21.15.132:0/2078605391 wait complete. 2023-12-20T04:44:25.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.329+0000 7f93ac8c4640 1 Processor -- start 2023-12-20T04:44:25.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.329+0000 7f93ac8c4640 1 -- start start 2023-12-20T04:44:25.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.329+0000 7f93ac8c4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93a80cb420 0x7f93a814fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:25.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.329+0000 7f93ac8c4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93a80cf0b0 0x7f93a815e920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:25.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.329+0000 7f93ac8c4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a815e2d0 0x7f93a815ee60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:25.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.329+0000 7f93ac8c4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a80c9ab0 con 0x7f93a815e2d0 2023-12-20T04:44:25.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.329+0000 7f93ac8c4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93a80c8a30 con 0x7f93a80cb420 2023-12-20T04:44:25.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.329+0000 7f93ac8c4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93a80c8cf0 con 0x7f93a80cf0b0 2023-12-20T04:44:25.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.330+0000 7f93a6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a815e2d0 0x7f93a815ee60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:25.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.330+0000 7f93a6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a815e2d0 0x7f93a815ee60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57042/0 (socket says 172.21.15.132:57042) 2023-12-20T04:44:25.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.330+0000 7f93a6d9d640 1 -- 172.21.15.132:0/3970285359 learned_addr learned my addr 172.21.15.132:0/3970285359 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:25.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.330+0000 7f93a659c640 1 --2- 172.21.15.132:0/3970285359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93a80cb420 0x7f93a814fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:25.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.330+0000 7f939ffff640 1 --2- 172.21.15.132:0/3970285359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93a80cf0b0 0x7f93a815e920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:25.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.330+0000 7f93a6d9d640 1 -- 172.21.15.132:0/3970285359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93a80cf0b0 msgr2=0x7f93a815e920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:25.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.330+0000 7f93a6d9d640 1 --2- 172.21.15.132:0/3970285359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93a80cf0b0 0x7f93a815e920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:25.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.330+0000 7f93a6d9d640 1 -- 172.21.15.132:0/3970285359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93a80cb420 msgr2=0x7f93a814fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:25.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.330+0000 7f93a6d9d640 1 --2- 172.21.15.132:0/3970285359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93a80cb420 0x7f93a814fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:25.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.330+0000 7f93a6d9d640 1 -- 172.21.15.132:0/3970285359 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93980094d0 con 0x7f93a815e2d0 2023-12-20T04:44:25.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.330+0000 7f939ffff640 1 --2- 172.21.15.132:0/3970285359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93a80cf0b0 0x7f93a815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:25.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.330+0000 7f93a6d9d640 1 --2- 172.21.15.132:0/3970285359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a815e2d0 0x7f93a815ee60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f93a000c780 tx=0x7f93a000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:25.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.330+0000 7f939effd640 1 -- 172.21.15.132:0/3970285359 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a0003d80 con 0x7f93a815e2d0 2023-12-20T04:44:25.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.330+0000 7f939effd640 1 -- 172.21.15.132:0/3970285359 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93a000ce90 con 0x7f93a815e2d0 2023-12-20T04:44:25.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.330+0000 7f93ac8c4640 1 -- 172.21.15.132:0/3970285359 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93a80c8fd0 con 0x7f93a815e2d0 2023-12-20T04:44:25.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.330+0000 7f939effd640 1 -- 172.21.15.132:0/3970285359 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93a00052b0 con 0x7f93a815e2d0 2023-12-20T04:44:25.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.330+0000 7f93ac8c4640 1 -- 172.21.15.132:0/3970285359 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93a80c9590 con 0x7f93a815e2d0 2023-12-20T04:44:25.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.331+0000 7f93ac8c4640 1 -- 172.21.15.132:0/3970285359 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93a8066480 con 0x7f93a815e2d0 2023-12-20T04:44:25.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.332+0000 7f939effd640 1 -- 172.21.15.132:0/3970285359 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f93a0005410 con 0x7f93a815e2d0 2023-12-20T04:44:25.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.332+0000 7f939effd640 1 --2- 172.21.15.132:0/3970285359 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f938806a430 0x7f938806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:25.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.332+0000 7f939effd640 1 -- 172.21.15.132:0/3970285359 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93a0088030 con 0x7f93a815e2d0 2023-12-20T04:44:25.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.332+0000 7f93a659c640 1 --2- 172.21.15.132:0/3970285359 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f938806a430 0x7f938806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:25.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.333+0000 7f93a659c640 1 --2- 172.21.15.132:0/3970285359 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f938806a430 0x7f938806c8f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9398036000 tx=0x7f939803c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:25.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.336+0000 7f939effd640 1 -- 172.21.15.132:0/3970285359 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f93a0053760 con 0x7f93a815e2d0 2023-12-20T04:44:25.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.533+0000 7f93ac8c4640 1 -- 172.21.15.132:0/3970285359 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f93a80c97b0 con 0x7f93a815e2d0 2023-12-20T04:44:25.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.533+0000 7f939effd640 1 -- 172.21.15.132:0/3970285359 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4721 (secure 0 0 0) 0x7f93a0017090 con 0x7f93a815e2d0 2023-12-20T04:44:25.535 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:25.535 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1456944733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1456944733},{"type":"v1","addr":"172.21.15.187:6834","nonce":1456944733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2114954856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2114954856},{"type":"v1","addr":"172.21.15.187:6835","nonce":2114954856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2494230497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2494230497},{"type":"v1","addr":"172.21.15.132:6837","nonce":2494230497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:44:17.197194+0000","modified":"2023-12-20T04:44:19.205156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/1024674556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1024674556},{"type":"v1","addr":"172.21.15.132:6836","nonce":1024674556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-20T04:44:25.536 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 19 2023-12-20T04:44:25.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.535+0000 7f93ac8c4640 1 -- 172.21.15.132:0/3970285359 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f938806a430 msgr2=0x7f938806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:25.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.535+0000 7f93ac8c4640 1 --2- 172.21.15.132:0/3970285359 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f938806a430 0x7f938806c8f0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f9398036000 tx=0x7f939803c040 comp rx=0 tx=0).stop 2023-12-20T04:44:25.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.535+0000 7f93ac8c4640 1 -- 172.21.15.132:0/3970285359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a815e2d0 msgr2=0x7f93a815ee60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:25.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.535+0000 7f93ac8c4640 1 --2- 172.21.15.132:0/3970285359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a815e2d0 0x7f93a815ee60 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f93a000c780 tx=0x7f93a000cc40 comp rx=0 tx=0).stop 2023-12-20T04:44:25.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.535+0000 7f93ac8c4640 1 -- 172.21.15.132:0/3970285359 shutdown_connections 2023-12-20T04:44:25.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.535+0000 7f93ac8c4640 1 --2- 172.21.15.132:0/3970285359 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f938806a430 0x7f938806c8f0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:25.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.535+0000 7f93ac8c4640 1 --2- 172.21.15.132:0/3970285359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93a815e2d0 0x7f93a815ee60 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:25.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.535+0000 7f93ac8c4640 1 --2- 172.21.15.132:0/3970285359 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93a80cf0b0 0x7f93a815e920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:25.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.535+0000 7f93ac8c4640 1 --2- 172.21.15.132:0/3970285359 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93a80cb420 0x7f93a814fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:25.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.535+0000 7f93ac8c4640 1 -- 172.21.15.132:0/3970285359 >> 172.21.15.132:0/3970285359 conn(0x7f93a806d7c0 msgr2=0x7f93a80ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:25.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.535+0000 7f93ac8c4640 1 -- 172.21.15.132:0/3970285359 shutdown_connections 2023-12-20T04:44:25.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:25.535+0000 7f93ac8c4640 1 -- 172.21.15.132:0/3970285359 wait complete. 2023-12-20T04:44:25.950 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-20T04:44:17.197194+0000', 'modified': '2023-12-20T04:44:19.205156+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 5685}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_5685': {'gid': 5685, 'name': 'c', 'rank': 0, 'incarnation': 17, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6836/1024674556', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6834', 'nonce': 1024674556}, {'type': 'v1', 'addr': '172.21.15.132:6836', 'nonce': 1024674556}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [7], 'metadata_pool': 6, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-20T04:44:25.950 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-20T04:44:25.950 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2023-12-20T04:44:26.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.051+0000 7ff51fd8b640 1 Processor -- start 2023-12-20T04:44:26.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.051+0000 7ff51fd8b640 1 -- start start 2023-12-20T04:44:26.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.052+0000 7ff51fd8b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff51806bba0 0x7ff51806f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.052+0000 7ff51fd8b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51806c8e0 con 0x7ff518159bb0 2023-12-20T04:44:26.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.052+0000 7ff51fd8b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff51815e420 con 0x7ff5180ad720 2023-12-20T04:44:26.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.052+0000 7ff51fd8b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff51815e700 con 0x7ff51806bba0 2023-12-20T04:44:26.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.052+0000 7ff51db27640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff518159bb0 0x7ff51806b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46910/0 (socket says 172.21.15.132:46910) 2023-12-20T04:44:26.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.052+0000 7ff51db27640 1 -- 172.21.15.132:0/3922325690 learned_addr learned my addr 172.21.15.132:0/3922325690 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:26.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.052+0000 7ff51cb25640 1 -- 172.21.15.132:0/3922325690 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2822226294 0 0) 0x7ff51806c8e0 con 0x7ff518159bb0 2023-12-20T04:44:26.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.052+0000 7ff51cb25640 1 -- 172.21.15.132:0/3922325690 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff504003520 con 0x7ff518159bb0 2023-12-20T04:44:26.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.052+0000 7ff51d326640 1 --2- 172.21.15.132:0/3922325690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff51806bba0 0x7ff51806f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.052+0000 7ff51cb25640 1 -- 172.21.15.132:0/3922325690 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2982785890 0 0) 0x7ff504003520 con 0x7ff518159bb0 2023-12-20T04:44:26.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.052+0000 7ff51cb25640 1 -- 172.21.15.132:0/3922325690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff51806bba0 msgr2=0x7ff51806f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:26.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.052+0000 7ff51cb25640 1 --2- 172.21.15.132:0/3922325690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff51806bba0 0x7ff51806f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.052+0000 7ff51cb25640 1 -- 172.21.15.132:0/3922325690 >> v1:172.21.15.187:6789/0 conn(0x7ff5180ad720 legacy=0x7ff5180ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:26.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.052+0000 7ff51cb25640 1 -- 172.21.15.132:0/3922325690 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5180c9d10 con 0x7ff518159bb0 2023-12-20T04:44:26.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.052+0000 7ff51cb25640 1 -- 172.21.15.132:0/3922325690 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7ff514001670 con 0x7ff518159bb0 2023-12-20T04:44:26.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.052+0000 7ff51cb25640 1 -- 172.21.15.132:0/3922325690 >> v1:172.21.15.132:6789/0 conn(0x7ff518159bb0 legacy=0x7ff51806b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:26.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.053+0000 7ff51cb25640 1 --2- 172.21.15.132:0/3922325690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5040039a0 0x7ff504003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.053+0000 7ff51cb25640 1 --2- 172.21.15.132:0/3922325690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff51806bba0 0x7ff5040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.053+0000 7ff51cb25640 1 --2- 172.21.15.132:0/3922325690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff504004d00 0x7ff504005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.053+0000 7ff51cb25640 1 -- 172.21.15.132:0/3922325690 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff51815e700 con 0x7ff504004d00 2023-12-20T04:44:26.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.053+0000 7ff51cb25640 1 -- 172.21.15.132:0/3922325690 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff50400bb10 con 0x7ff5040039a0 2023-12-20T04:44:26.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.053+0000 7ff51cb25640 1 -- 172.21.15.132:0/3922325690 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff50400bca0 con 0x7ff51806bba0 2023-12-20T04:44:26.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.053+0000 7ff51e328640 1 --2- 172.21.15.132:0/3922325690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff504004d00 0x7ff504005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.053+0000 7ff51d326640 1 --2- 172.21.15.132:0/3922325690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff51806bba0 0x7ff5040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.053+0000 7ff51db27640 1 --2- 172.21.15.132:0/3922325690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5040039a0 0x7ff504003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.053+0000 7ff51e328640 1 -- 172.21.15.132:0/3922325690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff51806bba0 msgr2=0x7ff5040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:26.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.053+0000 7ff51e328640 1 --2- 172.21.15.132:0/3922325690 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff51806bba0 0x7ff5040047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.053+0000 7ff51e328640 1 -- 172.21.15.132:0/3922325690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5040039a0 msgr2=0x7ff504003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:26.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.053+0000 7ff51e328640 1 --2- 172.21.15.132:0/3922325690 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5040039a0 0x7ff504003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.053+0000 7ff51e328640 1 -- 172.21.15.132:0/3922325690 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff504003520 con 0x7ff504004d00 2023-12-20T04:44:26.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.054+0000 7ff51e328640 1 --2- 172.21.15.132:0/3922325690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff504004d00 0x7ff504005180 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff510001e80 tx=0x7ff5040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f911cd729b4acc37 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:26.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.054+0000 7ff51cb25640 1 -- 172.21.15.132:0/3922325690 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff510003b70 con 0x7ff504004d00 2023-12-20T04:44:26.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.054+0000 7ff51cb25640 1 -- 172.21.15.132:0/3922325690 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff510003cd0 con 0x7ff504004d00 2023-12-20T04:44:26.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.054+0000 7ff51cb25640 1 -- 172.21.15.132:0/3922325690 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff510005310 con 0x7ff504004d00 2023-12-20T04:44:26.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.054+0000 7ff51fd8b640 1 -- 172.21.15.132:0/3922325690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff504004d00 msgr2=0x7ff504005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:26.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.054+0000 7ff51fd8b640 1 --2- 172.21.15.132:0/3922325690 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff504004d00 0x7ff504005180 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff510001e80 tx=0x7ff5040057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.054+0000 7ff51e328640 1 -- 172.21.15.132:0/3922325690 reap_dead start 2023-12-20T04:44:26.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.054+0000 7ff51fd8b640 1 -- 172.21.15.132:0/3922325690 shutdown_connections 2023-12-20T04:44:26.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.054+0000 7ff51fd8b640 1 -- 172.21.15.132:0/3922325690 >> 172.21.15.132:0/3922325690 conn(0x7ff51806a260 msgr2=0x7ff5180b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:26.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.054+0000 7ff51fd8b640 1 -- 172.21.15.132:0/3922325690 shutdown_connections 2023-12-20T04:44:26.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.054+0000 7ff51fd8b640 1 -- 172.21.15.132:0/3922325690 wait complete. 2023-12-20T04:44:26.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.056+0000 7ff51fd8b640 1 Processor -- start 2023-12-20T04:44:26.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.056+0000 7ff51fd8b640 1 -- start start 2023-12-20T04:44:26.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.056+0000 7ff51fd8b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5181f01c0 0x7ff5181f05a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.056+0000 7ff51fd8b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5181f0ae0 0x7ff5181f18a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.056+0000 7ff51fd8b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5181f1de0 0x7ff5180ae300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.056+0000 7ff51fd8b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5180adb90 con 0x7ff5181f1de0 2023-12-20T04:44:26.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.056+0000 7ff51fd8b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5181f0f70 con 0x7ff5181f0ae0 2023-12-20T04:44:26.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.056+0000 7ff51fd8b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5181f1250 con 0x7ff5181f01c0 2023-12-20T04:44:26.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.056+0000 7ff51e328640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5181f1de0 0x7ff5180ae300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.056+0000 7ff51e328640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5181f1de0 0x7ff5180ae300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57064/0 (socket says 172.21.15.132:57064) 2023-12-20T04:44:26.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.056+0000 7ff51e328640 1 -- 172.21.15.132:0/3032732644 learned_addr learned my addr 172.21.15.132:0/3032732644 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:26.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.057+0000 7ff51e328640 1 -- 172.21.15.132:0/3032732644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5181f01c0 msgr2=0x7ff5181f05a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:26.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.057+0000 7ff51e328640 1 --2- 172.21.15.132:0/3032732644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5181f01c0 0x7ff5181f05a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.057+0000 7ff51e328640 1 -- 172.21.15.132:0/3032732644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5181f0ae0 msgr2=0x7ff5181f18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:26.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.057+0000 7ff51e328640 1 --2- 172.21.15.132:0/3032732644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5181f0ae0 0x7ff5181f18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.057+0000 7ff51e328640 1 -- 172.21.15.132:0/3032732644 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5181f1530 con 0x7ff5181f1de0 2023-12-20T04:44:26.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.057+0000 7ff51e328640 1 --2- 172.21.15.132:0/3032732644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5181f1de0 0x7ff5180ae300 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff510005040 tx=0x7ff5100014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:26.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.057+0000 7ff50e7fc640 1 -- 172.21.15.132:0/3032732644 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff51003e070 con 0x7ff5181f1de0 2023-12-20T04:44:26.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.057+0000 7ff50e7fc640 1 -- 172.21.15.132:0/3032732644 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff510003e40 con 0x7ff5181f1de0 2023-12-20T04:44:26.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.057+0000 7ff51fd8b640 1 -- 172.21.15.132:0/3032732644 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5180adde0 con 0x7ff5181f1de0 2023-12-20T04:44:26.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.057+0000 7ff50e7fc640 1 -- 172.21.15.132:0/3032732644 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff510006d70 con 0x7ff5181f1de0 2023-12-20T04:44:26.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.057+0000 7ff51fd8b640 1 -- 172.21.15.132:0/3032732644 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5180c4a70 con 0x7ff5181f1de0 2023-12-20T04:44:26.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.059+0000 7ff50e7fc640 1 -- 172.21.15.132:0/3032732644 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff510007030 con 0x7ff5181f1de0 2023-12-20T04:44:26.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.059+0000 7ff50e7fc640 1 --2- 172.21.15.132:0/3032732644 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4fc06a460 0x7ff4fc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.059+0000 7ff51db27640 1 --2- 172.21.15.132:0/3032732644 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4fc06a460 0x7ff4fc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.059+0000 7ff50e7fc640 1 -- 172.21.15.132:0/3032732644 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5100a9ec0 con 0x7ff5181f1de0 2023-12-20T04:44:26.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.059+0000 7ff51db27640 1 --2- 172.21.15.132:0/3032732644 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4fc06a460 0x7ff4fc06c920 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff514001c90 tx=0x7ff514001b20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:26.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.060+0000 7ff5229d8740 1 Processor -- start 2023-12-20T04:44:26.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.060+0000 7ff5229d8740 1 -- start start 2023-12-20T04:44:26.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff5229d8740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faaff10 0x55af9faadad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff5229d8740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9fa8f750 0x55af9fa67440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff5229d8740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9fa67980 0x55af9fa92120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff5229d8740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9f9d20b0 con 0x55af9faaff10 2023-12-20T04:44:26.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff5229d8740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9f9cf840 con 0x55af9fa67980 2023-12-20T04:44:26.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff5229d8740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af9f9cb130 con 0x55af9fa8f750 2023-12-20T04:44:26.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff51db27640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faaff10 0x55af9faadad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff51db27640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faaff10 0x55af9faadad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57070/0 (socket says 172.21.15.132:57070) 2023-12-20T04:44:26.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff51db27640 1 -- 172.21.15.132:0/1446255976 learned_addr learned my addr 172.21.15.132:0/1446255976 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:26.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff51e328640 1 --2- 172.21.15.132:0/1446255976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9fa67980 0x55af9fa92120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff51d326640 1 --2- 172.21.15.132:0/1446255976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9fa8f750 0x55af9fa67440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff51db27640 1 -- 172.21.15.132:0/1446255976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9fa8f750 msgr2=0x55af9fa67440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:26.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff51db27640 1 --2- 172.21.15.132:0/1446255976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9fa8f750 0x55af9fa67440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff51db27640 1 -- 172.21.15.132:0/1446255976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9fa67980 msgr2=0x55af9fa92120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:26.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff51db27640 1 --2- 172.21.15.132:0/1446255976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9fa67980 0x55af9fa92120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff51db27640 1 -- 172.21.15.132:0/1446255976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af9f985c40 con 0x55af9faaff10 2023-12-20T04:44:26.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff51e328640 1 --2- 172.21.15.132:0/1446255976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9fa67980 0x55af9fa92120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:26.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff51d326640 1 --2- 172.21.15.132:0/1446255976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9fa8f750 0x55af9fa67440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:26.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff51db27640 1 --2- 172.21.15.132:0/1446255976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faaff10 0x55af9faadad0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff5140076e0 tx=0x7ff514013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c61974b6ca187bf1 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:26.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff4fb7fe640 1 -- 172.21.15.132:0/1446255976 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff514007c80 con 0x55af9faaff10 2023-12-20T04:44:26.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff4fb7fe640 1 -- 172.21.15.132:0/1446255976 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff514007de0 con 0x55af9faaff10 2023-12-20T04:44:26.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.061+0000 7ff4fb7fe640 1 -- 172.21.15.132:0/1446255976 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff514012550 con 0x55af9faaff10 2023-12-20T04:44:26.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.062+0000 7ff5229d8740 1 -- 172.21.15.132:0/1446255976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faaff10 msgr2=0x55af9faadad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:26.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.062+0000 7ff5229d8740 1 --2- 172.21.15.132:0/1446255976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faaff10 0x55af9faadad0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7ff5140076e0 tx=0x7ff514013000 comp rx=0 tx=0).stop 2023-12-20T04:44:26.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.062+0000 7ff5229d8740 1 -- 172.21.15.132:0/1446255976 shutdown_connections 2023-12-20T04:44:26.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.062+0000 7ff5229d8740 1 --2- 172.21.15.132:0/1446255976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9fa67980 0x55af9fa92120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.062+0000 7ff5229d8740 1 --2- 172.21.15.132:0/1446255976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9fa8f750 0x55af9fa67440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.062+0000 7ff5229d8740 1 --2- 172.21.15.132:0/1446255976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faaff10 0x55af9faadad0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.062+0000 7ff5229d8740 1 -- 172.21.15.132:0/1446255976 >> 172.21.15.132:0/1446255976 conn(0x55af9fa64830 msgr2=0x55af9faad120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:26.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.062+0000 7ff5229d8740 1 -- 172.21.15.132:0/1446255976 shutdown_connections 2023-12-20T04:44:26.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.062+0000 7ff5229d8740 1 -- 172.21.15.132:0/1446255976 wait complete. 2023-12-20T04:44:26.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.063+0000 7ff5229d8740 1 -- start start 2023-12-20T04:44:26.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.063+0000 7ff5229d8740 1 Processor -- start 2023-12-20T04:44:26.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff5229d8740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9fa8f750 0x55af9fa8f010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff5229d8740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faaff10 0x55af9faa61e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff5229d8740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9faa6720 0x55af9fa8d090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff5229d8740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9f989840 con 0x55af9faaff10 2023-12-20T04:44:26.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff5229d8740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9f9894e0 con 0x55af9fa8f750 2023-12-20T04:44:26.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff5229d8740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af9f94f230 con 0x55af9faa6720 2023-12-20T04:44:26.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff5229d8740 10 client.0 _ll_register_callbacks cb 0x55af9f9a06d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:44:26.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff51d326640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faaff10 0x55af9faa61e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff51d326640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faaff10 0x55af9faa61e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57078/0 (socket says 172.21.15.132:57078) 2023-12-20T04:44:26.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff51d326640 1 -- 172.21.15.132:0/20432766 learned_addr learned my addr 172.21.15.132:0/20432766 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:26.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff51db27640 1 --2- 172.21.15.132:0/20432766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9fa8f750 0x55af9fa8f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff51e328640 1 --2- 172.21.15.132:0/20432766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9faa6720 0x55af9fa8d090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff51d326640 1 -- 172.21.15.132:0/20432766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9faa6720 msgr2=0x55af9fa8d090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:26.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff51d326640 1 --2- 172.21.15.132:0/20432766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9faa6720 0x55af9fa8d090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff51d326640 1 -- 172.21.15.132:0/20432766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9fa8f750 msgr2=0x55af9fa8f010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:26.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff51d326640 1 --2- 172.21.15.132:0/20432766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9fa8f750 0x55af9fa8f010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff51d326640 1 -- 172.21.15.132:0/20432766 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5180c9d10 con 0x55af9faaff10 2023-12-20T04:44:26.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff51d326640 1 --2- 172.21.15.132:0/20432766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faaff10 0x55af9faa61e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff5181f3c30 tx=0x7ff50800b4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3a68ac6c72b0a0e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:26.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff4f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:44:26.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff4f8ff9640 1 -- 172.21.15.132:0/20432766 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50800bd70 con 0x55af9faaff10 2023-12-20T04:44:26.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff4f8ff9640 1 -- 172.21.15.132:0/20432766 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff508015480 con 0x55af9faaff10 2023-12-20T04:44:26.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff5229d8740 1 -- 172.21.15.132:0/20432766 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55af9f9f4970 con 0x55af9faaff10 2023-12-20T04:44:26.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff4f8ff9640 1 -- 172.21.15.132:0/20432766 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff508015640 con 0x55af9faaff10 2023-12-20T04:44:26.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff5229d8740 10 client.5853 fetch_fsmap learned FSMap version 19 2023-12-20T04:44:26.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.064+0000 7ff5229d8740 1 -- 172.21.15.132:0/20432766 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55af9f9c97b0 con 0x55af9faaff10 2023-12-20T04:44:26.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.065+0000 7ff4f8ff9640 1 -- 172.21.15.132:0/20432766 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55af9f9f4970 con 0x55af9faaff10 2023-12-20T04:44:26.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.065+0000 7ff4f8ff9640 1 -- 172.21.15.132:0/20432766 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 19) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff5080157a0 con 0x55af9faaff10 2023-12-20T04:44:26.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.065+0000 7ff5229d8740 10 client.5853 fetch_fsmap finished waiting for FSMap version 19 2023-12-20T04:44:26.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.065+0000 7ff5229d8740 10 client.5853 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-20T04:44:26.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.065+0000 7ff5229d8740 20 client.5853 populate_metadata read hostname 'smithi132' 2023-12-20T04:44:26.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.065+0000 7ff5229d8740 1 --2- 172.21.15.132:0/20432766 >> [v2:172.21.15.132:6834/1024674556,v1:172.21.15.132:6836/1024674556] conn(0x55af9faab980 0x55af9faabd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.065+0000 7ff5229d8740 4 client.5853 mds_command: new command op to 5685 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-20T04:44:26.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.065+0000 7ff5229d8740 1 -- 172.21.15.132:0/20432766 --> [v2:172.21.15.132:6834/1024674556,v1:172.21.15.132:6836/1024674556] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55af9f9bcf00 con 0x55af9faab980 2023-12-20T04:44:26.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.065+0000 7ff51db27640 1 --2- 172.21.15.132:0/20432766 >> [v2:172.21.15.132:6834/1024674556,v1:172.21.15.132:6836/1024674556] conn(0x55af9faab980 0x55af9faabd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.065+0000 7ff4f8ff9640 10 client.5853 ms_handle_connect on v2:172.21.15.132:6834/1024674556 2023-12-20T04:44:26.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.065+0000 7ff51db27640 1 --2- 172.21.15.132:0/20432766 >> [v2:172.21.15.132:6834/1024674556,v1:172.21.15.132:6836/1024674556] conn(0x55af9faab980 0x55af9faabd60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ddb9c85d293f3774 server_cookie=496b31e91387fa42 in_seq=0 out_seq=0 2023-12-20T04:44:26.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.066+0000 7ff4f8ff9640 1 -- 172.21.15.132:0/20432766 <== mds.0 v2:172.21.15.132:6834/1024674556 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55af9f9bcf00 con 0x55af9faab980 2023-12-20T04:44:26.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.066+0000 7ff4f8ff9640 10 client.5853 handle_command_reply: tid=0 2023-12-20T04:44:26.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.066+0000 7ff5229d8740 1 client.5853 shutdown 2023-12-20T04:44:26.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.066+0000 7ff5229d8740 1 -- 172.21.15.132:0/20432766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faaff10 msgr2=0x55af9faa61e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:26.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.066+0000 7ff5229d8740 1 --2- 172.21.15.132:0/20432766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faaff10 0x55af9faa61e0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7ff5181f3c30 tx=0x7ff50800b4a0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.066+0000 7ff5229d8740 1 -- 172.21.15.132:0/20432766 shutdown_connections 2023-12-20T04:44:26.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.066+0000 7ff5229d8740 1 --2- 172.21.15.132:0/20432766 >> [v2:172.21.15.132:6834/1024674556,v1:172.21.15.132:6836/1024674556] conn(0x55af9faab980 0x55af9faabd60 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.066+0000 7ff5229d8740 1 --2- 172.21.15.132:0/20432766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9faa6720 0x55af9fa8d090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.066+0000 7ff5229d8740 1 --2- 172.21.15.132:0/20432766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faaff10 0x55af9faa61e0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.066+0000 7ff4f8ff9640 0 client.5853 ms_handle_reset on v2:172.21.15.132:6834/1024674556 2023-12-20T04:44:26.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.066+0000 7ff5229d8740 1 --2- 172.21.15.132:0/20432766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9fa8f750 0x55af9fa8f010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.066+0000 7ff5229d8740 1 -- 172.21.15.132:0/20432766 >> 172.21.15.132:0/20432766 conn(0x55af9fa67980 msgr2=0x55af9faad040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:26.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.066+0000 7ff5229d8740 1 -- 172.21.15.132:0/20432766 shutdown_connections 2023-12-20T04:44:26.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.066+0000 7ff5229d8740 1 -- 172.21.15.132:0/20432766 wait complete. 2023-12-20T04:44:26.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.066+0000 7ff5229d8740 20 client.5853 trim_cache size 0 max 16384 2023-12-20T04:44:26.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.081+0000 7ff5229d8740 1 Processor -- start 2023-12-20T04:44:26.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.081+0000 7ff5229d8740 1 -- start start 2023-12-20T04:44:26.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.081+0000 7ff5229d8740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9fa8f750 0x55af9fa67000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.082+0000 7ff5229d8740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faa6720 0x55af9faa9360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.082+0000 7ff5229d8740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9faaff10 0x55af9faa98a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.082+0000 7ff5229d8740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9faa9de0 con 0x55af9faa6720 2023-12-20T04:44:26.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.082+0000 7ff5229d8740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9faac4e0 con 0x55af9fa8f750 2023-12-20T04:44:26.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.082+0000 7ff5229d8740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af9fa8e0f0 con 0x55af9faaff10 2023-12-20T04:44:26.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.082+0000 7ff51d326640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faa6720 0x55af9faa9360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.082+0000 7ff51d326640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faa6720 0x55af9faa9360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57088/0 (socket says 172.21.15.132:57088) 2023-12-20T04:44:26.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.082+0000 7ff51d326640 1 -- 172.21.15.132:0/4158210862 learned_addr learned my addr 172.21.15.132:0/4158210862 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:26.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.082+0000 7ff51d326640 1 -- 172.21.15.132:0/4158210862 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9faaff10 msgr2=0x55af9faa98a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:26.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.082+0000 7ff51d326640 1 --2- 172.21.15.132:0/4158210862 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9faaff10 0x55af9faa98a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.082+0000 7ff51d326640 1 -- 172.21.15.132:0/4158210862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9fa8f750 msgr2=0x55af9fa67000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.082+0000 7ff51d326640 1 --2- 172.21.15.132:0/4158210862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9fa8f750 0x55af9fa67000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.082+0000 7ff51d326640 1 -- 172.21.15.132:0/4158210862 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55af9f96bbe0 con 0x55af9faa6720 2023-12-20T04:44:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.082+0000 7ff51d326640 1 --2- 172.21.15.132:0/4158210862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faa6720 0x55af9faa9360 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff508006a90 tx=0x7ff50800f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9e9a28a0bb909e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.082+0000 7ff4fbfff640 1 -- 172.21.15.132:0/4158210862 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff508006d90 con 0x55af9faa6720 2023-12-20T04:44:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.082+0000 7ff4fbfff640 1 -- 172.21.15.132:0/4158210862 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff50800bd70 con 0x55af9faa6720 2023-12-20T04:44:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.082+0000 7ff4fbfff640 1 -- 172.21.15.132:0/4158210862 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff50800bee0 con 0x55af9faa6720 2023-12-20T04:44:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.083+0000 7ff5229d8740 1 -- 172.21.15.132:0/4158210862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faa6720 msgr2=0x55af9faa9360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.083+0000 7ff5229d8740 1 --2- 172.21.15.132:0/4158210862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faa6720 0x55af9faa9360 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7ff508006a90 tx=0x7ff50800f000 comp rx=0 tx=0).stop 2023-12-20T04:44:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.083+0000 7ff5229d8740 1 -- 172.21.15.132:0/4158210862 shutdown_connections 2023-12-20T04:44:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.083+0000 7ff5229d8740 1 --2- 172.21.15.132:0/4158210862 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9faaff10 0x55af9faa98a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.083+0000 7ff5229d8740 1 --2- 172.21.15.132:0/4158210862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9faa6720 0x55af9faa9360 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.083+0000 7ff5229d8740 1 --2- 172.21.15.132:0/4158210862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9fa8f750 0x55af9fa67000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.083+0000 7ff5229d8740 1 -- 172.21.15.132:0/4158210862 >> 172.21.15.132:0/4158210862 conn(0x55af9fa67980 msgr2=0x55af9faa84f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:26.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.083+0000 7ff5229d8740 1 -- 172.21.15.132:0/4158210862 shutdown_connections 2023-12-20T04:44:26.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.083+0000 7ff5229d8740 1 -- 172.21.15.132:0/4158210862 wait complete. 2023-12-20T04:44:26.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.083+0000 7ff5229d8740 1 -- start start 2023-12-20T04:44:26.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.083+0000 7ff5229d8740 1 Processor -- start 2023-12-20T04:44:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.084+0000 7ff5229d8740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9fa8f750 0x55af9fb15500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.084+0000 7ff5229d8740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9faa6720 0x55af9fa630f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.084+0000 7ff5229d8740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9faaff10 0x55af9fa8c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.084+0000 7ff5229d8740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9fb1a080 con 0x55af9fa8f750 2023-12-20T04:44:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.084+0000 7ff5229d8740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55af9fa68770 con 0x55af9faaff10 2023-12-20T04:44:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.084+0000 7ff5229d8740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55af9fa68550 con 0x55af9faa6720 2023-12-20T04:44:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.084+0000 7ff5229d8740 10 client.0 _ll_register_callbacks cb 0x7ff514004eb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:44:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.084+0000 7ff51db27640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9fa8f750 0x55af9fb15500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.084+0000 7ff51db27640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9fa8f750 0x55af9fb15500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57102/0 (socket says 172.21.15.132:57102) 2023-12-20T04:44:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.084+0000 7ff51db27640 1 -- 172.21.15.132:0/3966745021 learned_addr learned my addr 172.21.15.132:0/3966745021 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.084+0000 7ff51db27640 1 -- 172.21.15.132:0/3966745021 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9faa6720 msgr2=0x55af9fa630f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:26.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.084+0000 7ff51d326640 1 --2- 172.21.15.132:0/3966745021 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9faa6720 0x55af9fa630f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.084+0000 7ff51e328640 1 --2- 172.21.15.132:0/3966745021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9faaff10 0x55af9fa8c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff51db27640 1 --2- 172.21.15.132:0/3966745021 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9faa6720 0x55af9fa630f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff51db27640 1 -- 172.21.15.132:0/3966745021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9faaff10 msgr2=0x55af9fa8c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:26.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff51db27640 1 --2- 172.21.15.132:0/3966745021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9faaff10 0x55af9fa8c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff51db27640 1 -- 172.21.15.132:0/3966745021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55af9f9c97b0 con 0x55af9fa8f750 2023-12-20T04:44:26.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff51e328640 1 --2- 172.21.15.132:0/3966745021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9faaff10 0x55af9fa8c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:26.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff51db27640 1 --2- 172.21.15.132:0/3966745021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9fa8f750 0x55af9fb15500 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff51401f000 tx=0x7ff514001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96a3f1756ff55287 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:26.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff4f8ff9640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:44:26.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff4f8ff9640 1 -- 172.21.15.132:0/3966745021 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff514033070 con 0x55af9fa8f750 2023-12-20T04:44:26.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff4f8ff9640 1 -- 172.21.15.132:0/3966745021 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff51401b050 con 0x55af9fa8f750 2023-12-20T04:44:26.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff5229d8740 1 -- 172.21.15.132:0/3966745021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7ff514007de0 con 0x55af9fa8f750 2023-12-20T04:44:26.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff4f8ff9640 1 -- 172.21.15.132:0/3966745021 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) v2 ==== 24+0+0 (secure 0 0 0) 0x7ff514020790 con 0x55af9fa8f750 2023-12-20T04:44:26.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff5229d8740 10 client.5859 fetch_fsmap learned FSMap version 19 2023-12-20T04:44:26.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff5229d8740 1 -- 172.21.15.132:0/3966745021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) v3 -- 0x55af9f9912f0 con 0x55af9fa8f750 2023-12-20T04:44:26.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff4f8ff9640 1 -- 172.21.15.132:0/3966745021 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff514007de0 con 0x55af9fa8f750 2023-12-20T04:44:26.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff4f8ff9640 1 -- 172.21.15.132:0/3966745021 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 19) v1 ==== 3114+0+0 (secure 0 0 0) 0x7ff514012070 con 0x55af9fa8f750 2023-12-20T04:44:26.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff5229d8740 10 client.5859 fetch_fsmap finished waiting for FSMap version 19 2023-12-20T04:44:26.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff5229d8740 10 client.5859 resolve_mds: resolved name 'c' to daemon mds.c 2023-12-20T04:44:26.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff5229d8740 20 client.5859 populate_metadata read hostname 'smithi132' 2023-12-20T04:44:26.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff5229d8740 1 --2- 172.21.15.132:0/3966745021 >> [v2:172.21.15.132:6834/1024674556,v1:172.21.15.132:6836/1024674556] conn(0x55af9fb19190 0x55af9fb19570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff5229d8740 4 client.5859 mds_command: new command op to 5685 tid=0[{"prefix": "status"}] 2023-12-20T04:44:26.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff5229d8740 1 -- 172.21.15.132:0/3966745021 --> [v2:172.21.15.132:6834/1024674556,v1:172.21.15.132:6836/1024674556] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55af9f9c41b0 con 0x55af9fb19190 2023-12-20T04:44:26.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.085+0000 7ff51d326640 1 --2- 172.21.15.132:0/3966745021 >> [v2:172.21.15.132:6834/1024674556,v1:172.21.15.132:6836/1024674556] conn(0x55af9fb19190 0x55af9fb19570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.086+0000 7ff4f8ff9640 10 client.5859 ms_handle_connect on v2:172.21.15.132:6834/1024674556 2023-12-20T04:44:26.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.086+0000 7ff51d326640 1 --2- 172.21.15.132:0/3966745021 >> [v2:172.21.15.132:6834/1024674556,v1:172.21.15.132:6836/1024674556] conn(0x55af9fb19190 0x55af9fb19570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2923cb6c3571beb7 server_cookie=87ddf4055a096f5a in_seq=0 out_seq=0 2023-12-20T04:44:26.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.086+0000 7ff4f8ff9640 1 -- 172.21.15.132:0/3966745021 <== mds.0 v2:172.21.15.132:6834/1024674556 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+331 (crc 0 0 0) 0x55af9f9c41b0 con 0x55af9fb19190 2023-12-20T04:44:26.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.086+0000 7ff4f8ff9640 10 client.5859 handle_command_reply: tid=0 2023-12-20T04:44:26.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.086+0000 7ff5229d8740 1 client.5859 shutdown 2023-12-20T04:44:26.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.086+0000 7ff5229d8740 1 -- 172.21.15.132:0/3966745021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9fa8f750 msgr2=0x55af9fb15500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:26.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.086+0000 7ff5229d8740 1 --2- 172.21.15.132:0/3966745021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9fa8f750 0x55af9fb15500 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7ff51401f000 tx=0x7ff514001e70 comp rx=0 tx=0).stop 2023-12-20T04:44:26.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.086+0000 7ff5229d8740 1 -- 172.21.15.132:0/3966745021 shutdown_connections 2023-12-20T04:44:26.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.086+0000 7ff5229d8740 1 --2- 172.21.15.132:0/3966745021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55af9faaff10 0x55af9fa8c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.086+0000 7ff5229d8740 1 --2- 172.21.15.132:0/3966745021 >> [v2:172.21.15.132:6834/1024674556,v1:172.21.15.132:6836/1024674556] conn(0x55af9fb19190 0x55af9fb19570 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.086+0000 7ff5229d8740 1 --2- 172.21.15.132:0/3966745021 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55af9faa6720 0x55af9fa630f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.086+0000 7ff4f8ff9640 0 client.5859 ms_handle_reset on v2:172.21.15.132:6834/1024674556 2023-12-20T04:44:26.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.086+0000 7ff5229d8740 1 --2- 172.21.15.132:0/3966745021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55af9fa8f750 0x55af9fb15500 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.086+0000 7ff5229d8740 1 -- 172.21.15.132:0/3966745021 >> 172.21.15.132:0/3966745021 conn(0x55af9fa67980 msgr2=0x55af9fa67000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:26.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.086+0000 7ff5229d8740 1 -- 172.21.15.132:0/3966745021 shutdown_connections 2023-12-20T04:44:26.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.086+0000 7ff5229d8740 1 -- 172.21.15.132:0/3966745021 wait complete. 2023-12-20T04:44:26.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.086+0000 7ff5229d8740 20 client.5859 trim_cache size 0 max 16384 2023-12-20T04:44:26.095 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:44:26.095 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:44:26.095 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-12-20T04:44:26.095 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 5685, 2023-12-20T04:44:26.095 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-12-20T04:44:26.095 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-12-20T04:44:26.095 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-12-20T04:44:26.095 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 8.8881524519999999, 2023-12-20T04:44:26.095 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 19, 2023-12-20T04:44:26.095 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 47, 2023-12-20T04:44:26.095 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 47, 2023-12-20T04:44:26.096 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 13.651843077000001 2023-12-20T04:44:26.096 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:44:26.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.087+0000 7ff51fd8b640 1 -- 172.21.15.132:0/3032732644 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4fc06a460 msgr2=0x7ff4fc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:26.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.087+0000 7ff51fd8b640 1 --2- 172.21.15.132:0/3032732644 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4fc06a460 0x7ff4fc06c920 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7ff514001c90 tx=0x7ff514001b20 comp rx=0 tx=0).stop 2023-12-20T04:44:26.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.087+0000 7ff51fd8b640 1 -- 172.21.15.132:0/3032732644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5181f1de0 msgr2=0x7ff5180ae300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:26.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.087+0000 7ff51fd8b640 1 --2- 172.21.15.132:0/3032732644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5181f1de0 0x7ff5180ae300 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7ff510005040 tx=0x7ff5100014a0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.087+0000 7ff51fd8b640 1 -- 172.21.15.132:0/3032732644 shutdown_connections 2023-12-20T04:44:26.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.087+0000 7ff51fd8b640 1 --2- 172.21.15.132:0/3032732644 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4fc06a460 0x7ff4fc06c920 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.087+0000 7ff51fd8b640 1 --2- 172.21.15.132:0/3032732644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5181f1de0 0x7ff5180ae300 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.087+0000 7ff51fd8b640 1 --2- 172.21.15.132:0/3032732644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5181f0ae0 0x7ff5181f18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.087+0000 7ff51fd8b640 1 --2- 172.21.15.132:0/3032732644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5181f01c0 0x7ff5181f05a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.087+0000 7ff51fd8b640 1 -- 172.21.15.132:0/3032732644 >> 172.21.15.132:0/3032732644 conn(0x7ff51806a260 msgr2=0x7ff518156270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:26.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.087+0000 7ff51fd8b640 1 -- 172.21.15.132:0/3032732644 shutdown_connections 2023-12-20T04:44:26.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.087+0000 7ff51fd8b640 1 -- 172.21.15.132:0/3032732644 wait complete. 2023-12-20T04:44:26.099 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:44:26.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.197+0000 7f80c19b1640 1 Processor -- start 2023-12-20T04:44:26.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.197+0000 7f80c19b1640 1 -- start start 2023-12-20T04:44:26.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.198+0000 7f80c19b1640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f80bc0c92d0 0x7f80bc0c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.198+0000 7f80c19b1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80bc13cce0 0x7f80bc159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.198+0000 7f80c19b1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f80bc15a1d0 0x7f80bc06c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.198+0000 7f80c19b1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc15aa30 con 0x7f80bc15a1d0 2023-12-20T04:44:26.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.198+0000 7f80c19b1640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80bc0c9bf0 con 0x7f80bc0c92d0 2023-12-20T04:44:26.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.198+0000 7f80c19b1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc06b260 con 0x7f80bc13cce0 2023-12-20T04:44:26.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.198+0000 7f80bb7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f80bc15a1d0 0x7f80bc06c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.198+0000 7f80bb7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f80bc15a1d0 0x7f80bc06c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57110/0 (socket says 172.21.15.132:57110) 2023-12-20T04:44:26.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.198+0000 7f80bb7fe640 1 -- 172.21.15.132:0/3585974636 learned_addr learned my addr 172.21.15.132:0/3585974636 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:26.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.198+0000 7f80baffd640 1 --2- 172.21.15.132:0/3585974636 >> v2:172.21.15.187:3300/0 conn(0x7f80bc0c92d0 0x7f80bc0c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.198+0000 7f80ba7fc640 1 --2- 172.21.15.132:0/3585974636 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80bc13cce0 0x7f80bc159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.199+0000 7f80bb7fe640 1 -- 172.21.15.132:0/3585974636 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80bc13cce0 msgr2=0x7f80bc159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:26.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.199+0000 7f80bb7fe640 1 --2- 172.21.15.132:0/3585974636 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80bc13cce0 0x7f80bc159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.199+0000 7f80bb7fe640 1 -- 172.21.15.132:0/3585974636 >> v2:172.21.15.187:3300/0 conn(0x7f80bc0c92d0 msgr2=0x7f80bc0c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:26.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.199+0000 7f80bb7fe640 1 --2- 172.21.15.132:0/3585974636 >> v2:172.21.15.187:3300/0 conn(0x7f80bc0c92d0 0x7f80bc0c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.199+0000 7f80bb7fe640 1 -- 172.21.15.132:0/3585974636 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80bc06b540 con 0x7f80bc15a1d0 2023-12-20T04:44:26.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.199+0000 7f80baffd640 1 --2- 172.21.15.132:0/3585974636 >> v2:172.21.15.187:3300/0 conn(0x7f80bc0c92d0 0x7f80bc0c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:26.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.199+0000 7f80bb7fe640 1 --2- 172.21.15.132:0/3585974636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80bc15a1d0 0x7f80bc06c020 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f80bc06ceb0 tx=0x7f80b402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d498a77991fdb92 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:26.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.199+0000 7f80b9ffb640 1 -- 172.21.15.132:0/3585974636 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b40317e0 con 0x7f80bc15a1d0 2023-12-20T04:44:26.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.200+0000 7f80b9ffb640 1 -- 172.21.15.132:0/3585974636 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b4031940 con 0x7f80bc15a1d0 2023-12-20T04:44:26.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.200+0000 7f80b9ffb640 1 -- 172.21.15.132:0/3585974636 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b4031cd0 con 0x7f80bc15a1d0 2023-12-20T04:44:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.200+0000 7f80c19b1640 1 -- 172.21.15.132:0/3585974636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80bc15a1d0 msgr2=0x7f80bc06c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.200+0000 7f80c19b1640 1 --2- 172.21.15.132:0/3585974636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80bc15a1d0 0x7f80bc06c020 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f80bc06ceb0 tx=0x7f80b402b880 comp rx=0 tx=0).stop 2023-12-20T04:44:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.200+0000 7f80c19b1640 1 -- 172.21.15.132:0/3585974636 shutdown_connections 2023-12-20T04:44:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.200+0000 7f80c19b1640 1 --2- 172.21.15.132:0/3585974636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80bc15a1d0 0x7f80bc06c020 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.200+0000 7f80c19b1640 1 --2- 172.21.15.132:0/3585974636 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80bc13cce0 0x7f80bc159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.200+0000 7f80c19b1640 1 --2- 172.21.15.132:0/3585974636 >> v2:172.21.15.187:3300/0 conn(0x7f80bc0c92d0 0x7f80bc0c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.200+0000 7f80c19b1640 1 -- 172.21.15.132:0/3585974636 >> 172.21.15.132:0/3585974636 conn(0x7f80bc0ced10 msgr2=0x7f80bc0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.200+0000 7f80c19b1640 1 -- 172.21.15.132:0/3585974636 shutdown_connections 2023-12-20T04:44:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.200+0000 7f80c19b1640 1 -- 172.21.15.132:0/3585974636 wait complete. 2023-12-20T04:44:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.201+0000 7f80c19b1640 1 Processor -- start 2023-12-20T04:44:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.201+0000 7f80c19b1640 1 -- start start 2023-12-20T04:44:26.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.202+0000 7f80c19b1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80bc0c92d0 0x7f80bc0c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.202+0000 7f80c19b1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80bc13cce0 0x7f80bc0cd8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.202+0000 7f80c19b1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80bc15a1d0 0x7f80bc0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.202+0000 7f80c19b1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc070310 con 0x7f80bc0c92d0 2023-12-20T04:44:26.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.202+0000 7f80c19b1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc06f700 con 0x7f80bc13cce0 2023-12-20T04:44:26.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.202+0000 7f80c19b1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80bc06f9e0 con 0x7f80bc15a1d0 2023-12-20T04:44:26.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.202+0000 7f80baffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80bc0c92d0 0x7f80bc0c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.202+0000 7f80baffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80bc0c92d0 0x7f80bc0c4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57124/0 (socket says 172.21.15.132:57124) 2023-12-20T04:44:26.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.202+0000 7f80baffd640 1 -- 172.21.15.132:0/2519329940 learned_addr learned my addr 172.21.15.132:0/2519329940 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:26.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.202+0000 7f80baffd640 1 -- 172.21.15.132:0/2519329940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80bc15a1d0 msgr2=0x7f80bc0cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:26.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.202+0000 7f80baffd640 1 --2- 172.21.15.132:0/2519329940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80bc15a1d0 0x7f80bc0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.202+0000 7f80baffd640 1 -- 172.21.15.132:0/2519329940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80bc13cce0 msgr2=0x7f80bc0cd8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:26.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.202+0000 7f80baffd640 1 --2- 172.21.15.132:0/2519329940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80bc13cce0 0x7f80bc0cd8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.202+0000 7f80baffd640 1 -- 172.21.15.132:0/2519329940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b40094d0 con 0x7f80bc0c92d0 2023-12-20T04:44:26.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.203+0000 7f80baffd640 1 --2- 172.21.15.132:0/2519329940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80bc0c92d0 0x7f80bc0c4bb0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f80ac008e50 tx=0x7f80ac00e4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:26.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.203+0000 7f80b3fff640 1 -- 172.21.15.132:0/2519329940 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac003990 con 0x7f80bc0c92d0 2023-12-20T04:44:26.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.203+0000 7f80b3fff640 1 -- 172.21.15.132:0/2519329940 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac010040 con 0x7f80bc0c92d0 2023-12-20T04:44:26.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.203+0000 7f80c19b1640 1 -- 172.21.15.132:0/2519329940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80bc06fcc0 con 0x7f80bc0c92d0 2023-12-20T04:44:26.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.203+0000 7f80b3fff640 1 -- 172.21.15.132:0/2519329940 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac003d10 con 0x7f80bc0c92d0 2023-12-20T04:44:26.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.203+0000 7f80c19b1640 1 -- 172.21.15.132:0/2519329940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80bc070b20 con 0x7f80bc0c92d0 2023-12-20T04:44:26.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.204+0000 7f80c19b1640 1 -- 172.21.15.132:0/2519329940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80bc04e840 con 0x7f80bc0c92d0 2023-12-20T04:44:26.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.204+0000 7f80b3fff640 1 -- 172.21.15.132:0/2519329940 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f80ac004030 con 0x7f80bc0c92d0 2023-12-20T04:44:26.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.204+0000 7f80b3fff640 1 --2- 172.21.15.132:0/2519329940 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f809c06a430 0x7f809c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:26.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.205+0000 7f80b3fff640 1 -- 172.21.15.132:0/2519329940 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f80ac089d20 con 0x7f80bc0c92d0 2023-12-20T04:44:26.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.205+0000 7f80ba7fc640 1 --2- 172.21.15.132:0/2519329940 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f809c06a430 0x7f809c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:26.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.205+0000 7f80ba7fc640 1 --2- 172.21.15.132:0/2519329940 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f809c06a430 0x7f809c06c8f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f80bc156bc0 tx=0x7f80a4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:26.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.209+0000 7f80b3fff640 1 -- 172.21.15.132:0/2519329940 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f80ac0553c0 con 0x7f80bc0c92d0 2023-12-20T04:44:26.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.412+0000 7f80c19b1640 1 -- 172.21.15.132:0/2519329940 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f80bc06b7f0 con 0x7f80bc0c92d0 2023-12-20T04:44:26.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.413+0000 7f80b3fff640 1 -- 172.21.15.132:0/2519329940 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+73 (secure 0 0 0) 0x7f80ac01b020 con 0x7f80bc0c92d0 2023-12-20T04:44:26.415 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:44:26.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.415+0000 7f80c19b1640 1 -- 172.21.15.132:0/2519329940 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f809c06a430 msgr2=0x7f809c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:26.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.415+0000 7f80c19b1640 1 --2- 172.21.15.132:0/2519329940 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f809c06a430 0x7f809c06c8f0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f80bc156bc0 tx=0x7f80a4008040 comp rx=0 tx=0).stop 2023-12-20T04:44:26.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.415+0000 7f80c19b1640 1 -- 172.21.15.132:0/2519329940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80bc0c92d0 msgr2=0x7f80bc0c4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:26.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.415+0000 7f80c19b1640 1 --2- 172.21.15.132:0/2519329940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80bc0c92d0 0x7f80bc0c4bb0 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f80ac008e50 tx=0x7f80ac00e4a0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.415+0000 7f80c19b1640 1 -- 172.21.15.132:0/2519329940 shutdown_connections 2023-12-20T04:44:26.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.415+0000 7f80c19b1640 1 --2- 172.21.15.132:0/2519329940 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f809c06a430 0x7f809c06c8f0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.415+0000 7f80c19b1640 1 --2- 172.21.15.132:0/2519329940 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80bc15a1d0 0x7f80bc0cdde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.415+0000 7f80c19b1640 1 --2- 172.21.15.132:0/2519329940 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80bc13cce0 0x7f80bc0cd8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.415+0000 7f80c19b1640 1 --2- 172.21.15.132:0/2519329940 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80bc0c92d0 0x7f80bc0c4bb0 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:26.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.415+0000 7f80c19b1640 1 -- 172.21.15.132:0/2519329940 >> 172.21.15.132:0/2519329940 conn(0x7f80bc0ced10 msgr2=0x7f80bc152580 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:26.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.415+0000 7f80c19b1640 1 -- 172.21.15.132:0/2519329940 shutdown_connections 2023-12-20T04:44:26.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:26.415+0000 7f80c19b1640 1 -- 172.21.15.132:0/2519329940 wait complete. 2023-12-20T04:44:26.427 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:44:26.427 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:44:26.427 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-12-20T04:44:26.428 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-20T04:44:26.428 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-20T04:44:26.428 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:44:26.428 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:44:26.428 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:44:26.428 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:44:26.428 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:26.428 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-12-20T04:44:26.443 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:44:26.443 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:44:26.443 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:44:26.444 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:44:26.444 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-20T04:44:26.444 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:44:26.444 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:44:26.444 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:44:26.444 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-12-20T04:44:26.444 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:44:26.444 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-12-20T04:44:26.444 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-12-20T04:44:26.444 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:44:26.444 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-12-20T04:44:26.444 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:44:26.444 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-12-20T04:44:26.444 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:44:26.444 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42608sec preferred_lft 42608sec 2023-12-20T04:44:26.445 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-12-20T04:44:26.445 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:44:26.445 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:44:26.445 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:44:26.445 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:44:26.445 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:44:26.445 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::60dd:37ff:fe28:558b/64 scope link 2023-12-20T04:44:26.445 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:44:26.445 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:44:26.445 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 86:13:fe:55:4c:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-20T04:44:26.445 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::8413:feff:fe55:4c04/64 scope link 2023-12-20T04:44:26.445 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:44:26.445 INFO:teuthology.orchestra.run.smithi132.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:44:26.445 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-20T04:44:26.446 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::839:72ff:fea7:b332/64 scope link 2023-12-20T04:44:26.446 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:44:26.446 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:26.446 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:44:26.509 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-20T04:44:26.510 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:26.510 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-12-20T04:44:26.566 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-12-20T04:44:26.566 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:44:26.566 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:44:26.566 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:44:26.566 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:44:26.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:26.567 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:44:26.567 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:44:26.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:44:26.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:44:26.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:44:26.567 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:44:26.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:26.661 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-20T04:44:26.675 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-20T04:44:26.675 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-20T04:44:26.676 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:44:26.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:26.676 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-12-20T04:44:26.742 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-20T04:44:26.742 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:44:26.742 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-20T04:44:26.797 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:44:26.797 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:44:26.798 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:44:26.852 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:44:26.919 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:44:26.920 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:44:26.985 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:44:26.986 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:44:26.986 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:26.986 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:44:27.042 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:44:27.042 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-20T04:44:27.084 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:44:27.110 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:44:27.110 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:44:27.168 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:2023-12-20T04:44:27.167+0000 7f5793647480 -1 init, newargv = 0x55b0ded1e280 newargc=15 2023-12-20T04:44:27.169 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[97693]: starting ceph client 2023-12-20T04:44:27.172 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[97693]: starting fuse 2023-12-20T04:44:27.177 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:44:27.179 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:44:27.179 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:27.179 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:44:27.235 INFO:teuthology.orchestra.run.smithi132.stdout:41 2023-12-20T04:44:27.235 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:44:27.235 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:44:27.235 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:44:27.235 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:44:27.236 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:44:27.236 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:44:27.236 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:44:27.236 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:44:27.236 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:44:27.236 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:44:27.236 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:44:27.236 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:44:27.236 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:44:27.236 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:44:27.236 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:44:27.236 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:44:27.236 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:44:27.237 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:44:27.237 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:44:27.237 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:44:27.237 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:44:27.237 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:44:27.237 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:44:27.237 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:44:27.237 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:44:27.237 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:44:27.237 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:44:27.237 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:44:27.352 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.97693.asok 2023-12-20T04:44:27.539 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.97693.asok 2023-12-20T04:44:27.539 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:27.539 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.97693.asok status 2023-12-20T04:44:27.674 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:44:27.675 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:44:27.675 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:44:27.675 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:44:27.675 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:44:27.675 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:44:27.675 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:44:27.675 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "97693", 2023-12-20T04:44:27.675 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:44:27.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:27.675 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2023-12-20T04:44:27.675 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:44:27.675 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 5874, 2023-12-20T04:44:27.675 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:44:27.675 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:44:27.675 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:44:27.676 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 5874 2023-12-20T04:44:27.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:27.676 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:44:27.676 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:27.676 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:44:27.676 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 2649532664 2023-12-20T04:44:27.676 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:27.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:27.676 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:44:27.676 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:27.676 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:44:27.676 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 2649532664 2023-12-20T04:44:27.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:27.676 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.5874 192.168.0.1:0/2649532664", 2023-12-20T04:44:27.676 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/2649532664", 2023-12-20T04:44:27.677 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2023-12-20T04:44:27.677 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 19, 2023-12-20T04:44:27.677 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 47, 2023-12-20T04:44:27.677 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:44:27.677 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:44:27.677 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:44:27.677 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:44:27.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:27.684 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2023-12-20T04:44:27.684 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-20T04:44:27.699 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2023-12-20T04:44:27.699 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-20T04:44:27.699 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:27.699 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:44:27.767 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:44:27.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.905+0000 7fa7e79ab640 1 Processor -- start 2023-12-20T04:44:27.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.906+0000 7fa7e79ab640 1 -- start start 2023-12-20T04:44:27.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.906+0000 7fa7e79ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa7e015e530 0x7fa7e006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:27.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.906+0000 7fa7e79ab640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa7e006c240 0x7fa7e006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:27.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.906+0000 7fa7e79ab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa7e00ccf30 con 0x7fa7e0159b50 2023-12-20T04:44:27.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.906+0000 7fa7e79ab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e006cc10 con 0x7fa7e015e530 2023-12-20T04:44:27.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.906+0000 7fa7e79ab640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7e00caa60 con 0x7fa7e006c240 2023-12-20T04:44:27.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.907+0000 7fa7e4f46640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa7e015e530 0x7fa7e006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:27.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.907+0000 7fa7e5747640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa7e0159b50 0x7fa7e00c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47774/0 (socket says 172.21.15.132:47774) 2023-12-20T04:44:27.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.907+0000 7fa7e5747640 1 -- 172.21.15.132:0/1602579330 learned_addr learned my addr 172.21.15.132:0/1602579330 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:27.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.907+0000 7fa7e5f48640 1 --2- 172.21.15.132:0/1602579330 >> v2:172.21.15.187:3300/0 conn(0x7fa7e006c240 0x7fa7e006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:27.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.907+0000 7fa7e4f46640 1 -- 172.21.15.132:0/1602579330 >> v2:172.21.15.187:3300/0 conn(0x7fa7e006c240 msgr2=0x7fa7e006c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:27.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.907+0000 7fa7e4f46640 1 --2- 172.21.15.132:0/1602579330 >> v2:172.21.15.187:3300/0 conn(0x7fa7e006c240 0x7fa7e006c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:27.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.907+0000 7fa7e4f46640 1 -- 172.21.15.132:0/1602579330 >> v1:172.21.15.132:6789/0 conn(0x7fa7e0159b50 legacy=0x7fa7e00c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:27.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.907+0000 7fa7e4f46640 1 -- 172.21.15.132:0/1602579330 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7e00ca1c0 con 0x7fa7e015e530 2023-12-20T04:44:27.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.907+0000 7fa7dffff640 1 -- 172.21.15.132:0/1602579330 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1799784575 0 0) 0x7fa7e00ccf30 con 0x7fa7e0159b50 2023-12-20T04:44:27.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.908+0000 7fa7e4f46640 1 --2- 172.21.15.132:0/1602579330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7e015e530 0x7fa7e006fd70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40097a0 tx=0x7fa7d402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6304ff96ae3d92d1 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:27.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.908+0000 7fa7dffff640 1 -- 172.21.15.132:0/1602579330 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4031830 con 0x7fa7e015e530 2023-12-20T04:44:27.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.908+0000 7fa7dffff640 1 -- 172.21.15.132:0/1602579330 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d4031990 con 0x7fa7e015e530 2023-12-20T04:44:27.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.908+0000 7fa7dffff640 1 -- 172.21.15.132:0/1602579330 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d4031d20 con 0x7fa7e015e530 2023-12-20T04:44:27.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.908+0000 7fa7e79ab640 1 -- 172.21.15.132:0/1602579330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7e015e530 msgr2=0x7fa7e006fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:27.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.908+0000 7fa7e79ab640 1 --2- 172.21.15.132:0/1602579330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7e015e530 0x7fa7e006fd70 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40097a0 tx=0x7fa7d402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:44:27.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.908+0000 7fa7e79ab640 1 -- 172.21.15.132:0/1602579330 shutdown_connections 2023-12-20T04:44:27.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.908+0000 7fa7e79ab640 1 --2- 172.21.15.132:0/1602579330 >> v2:172.21.15.187:3300/0 conn(0x7fa7e006c240 0x7fa7e006c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:27.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.908+0000 7fa7e79ab640 1 --2- 172.21.15.132:0/1602579330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7e015e530 0x7fa7e006fd70 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:27.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.908+0000 7fa7e79ab640 1 -- 172.21.15.132:0/1602579330 >> 172.21.15.132:0/1602579330 conn(0x7fa7e00ced10 msgr2=0x7fa7e00cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:27.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.908+0000 7fa7e79ab640 1 -- 172.21.15.132:0/1602579330 shutdown_connections 2023-12-20T04:44:27.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.908+0000 7fa7e79ab640 1 -- 172.21.15.132:0/1602579330 wait complete. 2023-12-20T04:44:27.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.910+0000 7fa7e79ab640 1 Processor -- start 2023-12-20T04:44:27.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.910+0000 7fa7e79ab640 1 -- start start 2023-12-20T04:44:27.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.910+0000 7fa7e79ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7e006c240 0x7fa7e00c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:27.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.910+0000 7fa7e79ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7e0159b50 0x7fa7e0158970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:27.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.910+0000 7fa7e79ab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7e015e530 0x7fa7e0158eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:27.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.910+0000 7fa7e79ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e0147bf0 con 0x7fa7e0159b50 2023-12-20T04:44:27.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.910+0000 7fa7e79ab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e01f1690 con 0x7fa7e015e530 2023-12-20T04:44:27.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.910+0000 7fa7e79ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7e01f08d0 con 0x7fa7e006c240 2023-12-20T04:44:27.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.910+0000 7fa7e4f46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7e0159b50 0x7fa7e0158970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:27.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.910+0000 7fa7e4f46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7e0159b50 0x7fa7e0158970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43146/0 (socket says 172.21.15.132:43146) 2023-12-20T04:44:27.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.910+0000 7fa7e4f46640 1 -- 172.21.15.132:0/670896675 learned_addr learned my addr 172.21.15.132:0/670896675 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:27.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.911+0000 7fa7e5f48640 1 --2- 172.21.15.132:0/670896675 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7e015e530 0x7fa7e0158eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:27.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.911+0000 7fa7e5747640 1 --2- 172.21.15.132:0/670896675 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7e006c240 0x7fa7e00c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:27.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.911+0000 7fa7e4f46640 1 -- 172.21.15.132:0/670896675 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7e006c240 msgr2=0x7fa7e00c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:27.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.911+0000 7fa7e4f46640 1 --2- 172.21.15.132:0/670896675 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7e006c240 0x7fa7e00c4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:27.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.911+0000 7fa7e4f46640 1 -- 172.21.15.132:0/670896675 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7e015e530 msgr2=0x7fa7e0158eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:27.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.911+0000 7fa7e4f46640 1 --2- 172.21.15.132:0/670896675 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7e015e530 0x7fa7e0158eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:27.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.911+0000 7fa7e4f46640 1 -- 172.21.15.132:0/670896675 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d4009400 con 0x7fa7e0159b50 2023-12-20T04:44:27.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.911+0000 7fa7e5f48640 1 --2- 172.21.15.132:0/670896675 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7e015e530 0x7fa7e0158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:27.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.911+0000 7fa7e4f46640 1 --2- 172.21.15.132:0/670896675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7e0159b50 0x7fa7e0158970 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40098c0 tx=0x7fa7d40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:27.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.911+0000 7fa7ddffb640 1 -- 172.21.15.132:0/670896675 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d40317d0 con 0x7fa7e0159b50 2023-12-20T04:44:27.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.911+0000 7fa7ddffb640 1 -- 172.21.15.132:0/670896675 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7d403ba70 con 0x7fa7e0159b50 2023-12-20T04:44:27.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.911+0000 7fa7e79ab640 1 -- 172.21.15.132:0/670896675 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7e01f0bb0 con 0x7fa7e0159b50 2023-12-20T04:44:27.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.911+0000 7fa7ddffb640 1 -- 172.21.15.132:0/670896675 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa7d403be20 con 0x7fa7e0159b50 2023-12-20T04:44:27.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.911+0000 7fa7e79ab640 1 -- 172.21.15.132:0/670896675 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7e01f1170 con 0x7fa7e0159b50 2023-12-20T04:44:27.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.912+0000 7fa7e79ab640 1 -- 172.21.15.132:0/670896675 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7e015e3a0 con 0x7fa7e0159b50 2023-12-20T04:44:27.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.913+0000 7fa7ddffb640 1 -- 172.21.15.132:0/670896675 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa7d404e450 con 0x7fa7e0159b50 2023-12-20T04:44:27.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.913+0000 7fa7ddffb640 1 --2- 172.21.15.132:0/670896675 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa7cc06a430 0x7fa7cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:27.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.913+0000 7fa7ddffb640 1 -- 172.21.15.132:0/670896675 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa7d40aac20 con 0x7fa7e0159b50 2023-12-20T04:44:27.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.913+0000 7fa7e5747640 1 --2- 172.21.15.132:0/670896675 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa7cc06a430 0x7fa7cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:27.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.914+0000 7fa7e5747640 1 --2- 172.21.15.132:0/670896675 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa7cc06a430 0x7fa7cc06c8f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80012e0 tx=0x7fa7d8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:27.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:27.917+0000 7fa7ddffb640 1 -- 172.21.15.132:0/670896675 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa7d4076330 con 0x7fa7e0159b50 2023-12-20T04:44:28.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:28.116+0000 7fa7e79ab640 1 -- 172.21.15.132:0/670896675 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa7e004e840 con 0x7fa7e0159b50 2023-12-20T04:44:28.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:28.116+0000 7fa7ddffb640 1 -- 172.21.15.132:0/670896675 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa7d4035020 con 0x7fa7e0159b50 2023-12-20T04:44:28.118 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:44:28.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:28.118+0000 7fa7e79ab640 1 -- 172.21.15.132:0/670896675 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa7cc06a430 msgr2=0x7fa7cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:28.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:28.118+0000 7fa7e79ab640 1 --2- 172.21.15.132:0/670896675 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa7cc06a430 0x7fa7cc06c8f0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7fa7d80012e0 tx=0x7fa7d8009040 comp rx=0 tx=0).stop 2023-12-20T04:44:28.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:28.118+0000 7fa7e79ab640 1 -- 172.21.15.132:0/670896675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7e0159b50 msgr2=0x7fa7e0158970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:28.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:28.118+0000 7fa7e79ab640 1 --2- 172.21.15.132:0/670896675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7e0159b50 0x7fa7e0158970 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fa7d40098c0 tx=0x7fa7d40046c0 comp rx=0 tx=0).stop 2023-12-20T04:44:28.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:28.118+0000 7fa7e79ab640 1 -- 172.21.15.132:0/670896675 shutdown_connections 2023-12-20T04:44:28.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:28.118+0000 7fa7e79ab640 1 --2- 172.21.15.132:0/670896675 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa7cc06a430 0x7fa7cc06c8f0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:28.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:28.118+0000 7fa7e79ab640 1 --2- 172.21.15.132:0/670896675 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7e015e530 0x7fa7e0158eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:28.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:28.118+0000 7fa7e79ab640 1 --2- 172.21.15.132:0/670896675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa7e0159b50 0x7fa7e0158970 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:28.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:28.118+0000 7fa7e79ab640 1 --2- 172.21.15.132:0/670896675 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa7e006c240 0x7fa7e00c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:28.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:28.118+0000 7fa7e79ab640 1 -- 172.21.15.132:0/670896675 >> 172.21.15.132:0/670896675 conn(0x7fa7e00ced10 msgr2=0x7fa7e015a1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:28.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:28.118+0000 7fa7e79ab640 1 -- 172.21.15.132:0/670896675 shutdown_connections 2023-12-20T04:44:28.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:28.118+0000 7fa7e79ab640 1 -- 172.21.15.132:0/670896675 wait complete. 2023-12-20T04:44:28.131 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:44:28.131 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:44:28.131 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-12-20T04:44:28.131 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-20T04:44:28.131 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-20T04:44:28.131 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:44:28.131 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:44:28.131 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:44:28.131 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:44:28.131 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:28.131 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-12-20T04:44:28.150 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:44:28.150 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:44:28.150 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:44:28.150 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:44:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-20T04:44:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:44:28.151 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:44:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:44:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-12-20T04:44:28.151 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:44:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:44:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-12-20T04:44:28.151 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:44:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:44:28.151 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:44:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:44:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:44:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42617sec preferred_lft 42617sec 2023-12-20T04:44:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-12-20T04:44:28.151 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:44:28.152 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:44:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:44:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:44:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:44:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::a8bc:1cff:fe40:54ea/64 scope link 2023-12-20T04:44:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:44:28.152 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:44:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-20T04:44:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c8e:c0ff:fe7a:bdc/64 scope link 2023-12-20T04:44:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:44:28.152 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:44:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether be:98:9a:6f:62:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-20T04:44:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::bc98:9aff:fe6f:6282/64 scope link 2023-12-20T04:44:28.152 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:44:28.153 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:28.153 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:44:28.220 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-12-20T04:44:28.222 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:28.222 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-12-20T04:44:28.280 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-12-20T04:44:28.281 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:44:28.281 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:44:28.281 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:44:28.281 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:44:28.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:28.281 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:44:28.281 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:44:28.281 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:44:28.281 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:44:28.282 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:44:28.282 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:44:28.381 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:28.381 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-20T04:44:28.396 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-20T04:44:28.396 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-20T04:44:28.397 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:44:28.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:28.397 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2023-12-20T04:44:28.464 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-20T04:44:28.464 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:44:28.464 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-20T04:44:28.520 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:44:28.520 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:44:28.520 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:44:28.575 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:44:28.643 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:44:28.643 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:44:28.710 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:44:28.711 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:44:28.711 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:28.711 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:44:28.766 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:44:28.766 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-20T04:44:28.809 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:44:28.836 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:44:28.836 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:44:28.894 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:2023-12-20T04:44:28.893+0000 7f5f32a38480 -1 init, newargv = 0x561ec27e9650 newargc=15 2023-12-20T04:44:28.894 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[87220]: starting ceph client 2023-12-20T04:44:28.898 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[87220]: starting fuse 2023-12-20T04:44:28.904 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:44:28.905 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:44:28.905 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:28.906 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:44:28.960 INFO:teuthology.orchestra.run.smithi187.stdout:41 2023-12-20T04:44:28.961 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:44:28.961 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:44:28.961 DEBUG:teuthology.orchestra.run.smithi187:> import glob 2023-12-20T04:44:28.961 DEBUG:teuthology.orchestra.run.smithi187:> import re 2023-12-20T04:44:28.962 DEBUG:teuthology.orchestra.run.smithi187:> import os 2023-12-20T04:44:28.962 DEBUG:teuthology.orchestra.run.smithi187:> import subprocess 2023-12-20T04:44:28.962 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:44:28.962 DEBUG:teuthology.orchestra.run.smithi187:> def _find_admin_socket(client_name): 2023-12-20T04:44:28.962 DEBUG:teuthology.orchestra.run.smithi187:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-20T04:44:28.962 DEBUG:teuthology.orchestra.run.smithi187:> files = glob.glob(asok_path) 2023-12-20T04:44:28.963 DEBUG:teuthology.orchestra.run.smithi187:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-20T04:44:28.963 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:44:28.963 DEBUG:teuthology.orchestra.run.smithi187:> # Given a non-glob path, it better be there 2023-12-20T04:44:28.963 DEBUG:teuthology.orchestra.run.smithi187:> if "*" not in asok_path: 2023-12-20T04:44:28.963 DEBUG:teuthology.orchestra.run.smithi187:> assert(len(files) == 1) 2023-12-20T04:44:28.963 DEBUG:teuthology.orchestra.run.smithi187:> return files[0] 2023-12-20T04:44:28.963 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:44:28.964 DEBUG:teuthology.orchestra.run.smithi187:> for f in files: 2023-12-20T04:44:28.964 DEBUG:teuthology.orchestra.run.smithi187:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:44:28.964 DEBUG:teuthology.orchestra.run.smithi187:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:44:28.964 DEBUG:teuthology.orchestra.run.smithi187:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:44:28.964 DEBUG:teuthology.orchestra.run.smithi187:> contents = proc_f.read() 2023-12-20T04:44:28.964 DEBUG:teuthology.orchestra.run.smithi187:> if mountpoint in contents: 2023-12-20T04:44:28.965 DEBUG:teuthology.orchestra.run.smithi187:> return f 2023-12-20T04:44:28.965 DEBUG:teuthology.orchestra.run.smithi187:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:44:28.965 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:44:28.965 DEBUG:teuthology.orchestra.run.smithi187:> print(_find_admin_socket("client.1")) 2023-12-20T04:44:28.965 DEBUG:teuthology.orchestra.run.smithi187:> ' 2023-12-20T04:44:29.076 INFO:teuthology.orchestra.run.smithi187.stdout:/var/run/ceph/ceph-client.1.87220.asok 2023-12-20T04:44:29.263 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.87220.asok 2023-12-20T04:44:29.263 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:29.263 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.87220.asok status 2023-12-20T04:44:29.398 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-12-20T04:44:29.398 INFO:teuthology.orchestra.run.smithi187.stdout: "metadata": { 2023-12-20T04:44:29.398 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:44:29.398 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:44:29.399 INFO:teuthology.orchestra.run.smithi187.stdout: "entity_id": "1", 2023-12-20T04:44:29.399 INFO:teuthology.orchestra.run.smithi187.stdout: "hostname": "smithi187", 2023-12-20T04:44:29.399 INFO:teuthology.orchestra.run.smithi187.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-20T04:44:29.399 INFO:teuthology.orchestra.run.smithi187.stdout: "pid": "87220", 2023-12-20T04:44:29.399 INFO:teuthology.orchestra.run.smithi187.stdout: "root": "/" 2023-12-20T04:44:29.399 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:44:29.399 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_count": 0, 2023-12-20T04:44:29.399 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_pinned_count": 0, 2023-12-20T04:44:29.399 INFO:teuthology.orchestra.run.smithi187.stdout: "id": 5383, 2023-12-20T04:44:29.399 INFO:teuthology.orchestra.run.smithi187.stdout: "inst": { 2023-12-20T04:44:29.399 INFO:teuthology.orchestra.run.smithi187.stdout: "name": { 2023-12-20T04:44:29.399 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "client", 2023-12-20T04:44:29.399 INFO:teuthology.orchestra.run.smithi187.stdout: "num": 5383 2023-12-20T04:44:29.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:44:29.400 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:44:29.400 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:44:29.400 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:44:29.400 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 4209076426 2023-12-20T04:44:29.400 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-12-20T04:44:29.400 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:44:29.400 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:44:29.400 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:44:29.400 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:44:29.401 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 4209076426 2023-12-20T04:44:29.401 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:44:29.401 INFO:teuthology.orchestra.run.smithi187.stdout: "inst_str": "client.5383 192.168.0.1:0/4209076426", 2023-12-20T04:44:29.401 INFO:teuthology.orchestra.run.smithi187.stdout: "addr_str": "192.168.0.1:0/4209076426", 2023-12-20T04:44:29.401 INFO:teuthology.orchestra.run.smithi187.stdout: "inode_count": 1, 2023-12-20T04:44:29.401 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_epoch": 19, 2023-12-20T04:44:29.401 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch": 47, 2023-12-20T04:44:29.401 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:44:29.401 INFO:teuthology.orchestra.run.smithi187.stdout: "blocklisted": false, 2023-12-20T04:44:29.401 INFO:teuthology.orchestra.run.smithi187.stdout: "fs_name": "cephfs" 2023-12-20T04:44:29.401 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-12-20T04:44:29.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:29.407 DEBUG:teuthology.orchestra.run.smithi187:> stat --file-system '--printf=%T 2023-12-20T04:44:29.407 DEBUG:teuthology.orchestra.run.smithi187:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-20T04:44:29.421 INFO:teuthology.orchestra.run.smithi187.stdout:fuseblk 2023-12-20T04:44:29.422 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-20T04:44:29.422 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:29.422 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:44:29.488 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:44:29.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.598+0000 7fb4f49fb640 1 Processor -- start 2023-12-20T04:44:29.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.598+0000 7fb4f49fb640 1 -- start start 2023-12-20T04:44:29.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4f49fb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb4f015e2d0 0x7fb4f00b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:29.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4f49fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4f00cb420 0x7fb4f00ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:29.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4f49fb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4f00ceee0 0x7fb4f015ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:29.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4f49fb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f00cd740 con 0x7fb4f00ceee0 2023-12-20T04:44:29.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4f49fb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb4f00ce230 con 0x7fb4f015e2d0 2023-12-20T04:44:29.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4f49fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00cf310 con 0x7fb4f00cb420 2023-12-20T04:44:29.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4eed9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4f00ceee0 0x7fb4f015ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:29.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4eed9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb4f00ceee0 0x7fb4f015ea00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43150/0 (socket says 172.21.15.132:43150) 2023-12-20T04:44:29.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4eed9d640 1 -- 172.21.15.132:0/1494398785 learned_addr learned my addr 172.21.15.132:0/1494398785 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:29.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4ee59c640 1 --2- 172.21.15.132:0/1494398785 >> v2:172.21.15.187:3300/0 conn(0x7fb4f015e2d0 0x7fb4f00b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:29.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/1494398785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4f00cb420 0x7fb4f00ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:29.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4eed9d640 1 -- 172.21.15.132:0/1494398785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4f00cb420 msgr2=0x7fb4f00ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:29.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4eed9d640 1 --2- 172.21.15.132:0/1494398785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4f00cb420 0x7fb4f00ce9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:29.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4eed9d640 1 -- 172.21.15.132:0/1494398785 >> v2:172.21.15.187:3300/0 conn(0x7fb4f015e2d0 msgr2=0x7fb4f00b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:29.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4eed9d640 1 --2- 172.21.15.132:0/1494398785 >> v2:172.21.15.187:3300/0 conn(0x7fb4f015e2d0 0x7fb4f00b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:29.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4eed9d640 1 -- 172.21.15.132:0/1494398785 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4f00cd990 con 0x7fb4f00ceee0 2023-12-20T04:44:29.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4ee59c640 1 --2- 172.21.15.132:0/1494398785 >> v2:172.21.15.187:3300/0 conn(0x7fb4f015e2d0 0x7fb4f00b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:29.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.599+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/1494398785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4f00cb420 0x7fb4f00ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:29.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.600+0000 7fb4eed9d640 1 --2- 172.21.15.132:0/1494398785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f00ceee0 0x7fb4f015ea00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb4f006d070 tx=0x7fb4e802be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd061c4dc443ee39 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:29.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.600+0000 7fb4edd9b640 1 -- 172.21.15.132:0/1494398785 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e802c9e0 con 0x7fb4f00ceee0 2023-12-20T04:44:29.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.600+0000 7fb4edd9b640 1 -- 172.21.15.132:0/1494398785 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e802cb40 con 0x7fb4f00ceee0 2023-12-20T04:44:29.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.600+0000 7fb4edd9b640 1 -- 172.21.15.132:0/1494398785 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e80343f0 con 0x7fb4f00ceee0 2023-12-20T04:44:29.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.601+0000 7fb4f49fb640 1 -- 172.21.15.132:0/1494398785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f00ceee0 msgr2=0x7fb4f015ea00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:29.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.601+0000 7fb4f49fb640 1 --2- 172.21.15.132:0/1494398785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f00ceee0 0x7fb4f015ea00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7fb4f006d070 tx=0x7fb4e802be40 comp rx=0 tx=0).stop 2023-12-20T04:44:29.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.601+0000 7fb4f49fb640 1 -- 172.21.15.132:0/1494398785 shutdown_connections 2023-12-20T04:44:29.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.601+0000 7fb4f49fb640 1 --2- 172.21.15.132:0/1494398785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f00ceee0 0x7fb4f015ea00 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:29.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.601+0000 7fb4f49fb640 1 --2- 172.21.15.132:0/1494398785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4f00cb420 0x7fb4f00ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:29.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.601+0000 7fb4f49fb640 1 --2- 172.21.15.132:0/1494398785 >> v2:172.21.15.187:3300/0 conn(0x7fb4f015e2d0 0x7fb4f00b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:29.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.601+0000 7fb4f49fb640 1 -- 172.21.15.132:0/1494398785 >> 172.21.15.132:0/1494398785 conn(0x7fb4f006d7c0 msgr2=0x7fb4f006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:29.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.601+0000 7fb4f49fb640 1 -- 172.21.15.132:0/1494398785 shutdown_connections 2023-12-20T04:44:29.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.601+0000 7fb4f49fb640 1 -- 172.21.15.132:0/1494398785 wait complete. 2023-12-20T04:44:29.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.602+0000 7fb4f49fb640 1 Processor -- start 2023-12-20T04:44:29.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.602+0000 7fb4f49fb640 1 -- start start 2023-12-20T04:44:29.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4f49fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f00cb420 0x7fb4f00c8fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:29.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4f49fb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4f00ceee0 0x7fb4f0156100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:29.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4f49fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4f015e2d0 0x7fb4f00c9b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:29.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4f49fb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00c7f40 con 0x7fb4f00cb420 2023-12-20T04:44:29.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4f49fb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00c8220 con 0x7fb4f00ceee0 2023-12-20T04:44:29.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4f49fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4f00c8500 con 0x7fb4f015e2d0 2023-12-20T04:44:29.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4ee59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f00cb420 0x7fb4f00c8fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:29.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4ee59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f00cb420 0x7fb4f00c8fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43152/0 (socket says 172.21.15.132:43152) 2023-12-20T04:44:29.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4ee59c640 1 -- 172.21.15.132:0/1872043041 learned_addr learned my addr 172.21.15.132:0/1872043041 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:29.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/1872043041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4f00ceee0 0x7fb4f0156100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:29.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4eed9d640 1 --2- 172.21.15.132:0/1872043041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4f015e2d0 0x7fb4f00c9b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:29.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4ee59c640 1 -- 172.21.15.132:0/1872043041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4f015e2d0 msgr2=0x7fb4f00c9b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:29.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4ee59c640 1 --2- 172.21.15.132:0/1872043041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4f015e2d0 0x7fb4f00c9b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:29.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4ee59c640 1 -- 172.21.15.132:0/1872043041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4f00ceee0 msgr2=0x7fb4f0156100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:29.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4ee59c640 1 --2- 172.21.15.132:0/1872043041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4f00ceee0 0x7fb4f0156100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:29.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4ee59c640 1 -- 172.21.15.132:0/1872043041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4e8009b30 con 0x7fb4f00cb420 2023-12-20T04:44:29.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/1872043041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4f00ceee0 0x7fb4f0156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:29.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.603+0000 7fb4ee59c640 1 --2- 172.21.15.132:0/1872043041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f00cb420 0x7fb4f00c8fe0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000e7e0 tx=0x7fb4e000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:29.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.604+0000 7fb4e6ffd640 1 -- 172.21.15.132:0/1872043041 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0004030 con 0x7fb4f00cb420 2023-12-20T04:44:29.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.604+0000 7fb4e6ffd640 1 -- 172.21.15.132:0/1872043041 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb4e0004190 con 0x7fb4f00cb420 2023-12-20T04:44:29.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.604+0000 7fb4f49fb640 1 -- 172.21.15.132:0/1872043041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4f00c87e0 con 0x7fb4f00cb420 2023-12-20T04:44:29.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.604+0000 7fb4e6ffd640 1 -- 172.21.15.132:0/1872043041 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb4e0004520 con 0x7fb4f00cb420 2023-12-20T04:44:29.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.604+0000 7fb4f49fb640 1 -- 172.21.15.132:0/1872043041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4f0156850 con 0x7fb4f00cb420 2023-12-20T04:44:29.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.605+0000 7fb4f49fb640 1 -- 172.21.15.132:0/1872043041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb4f0066480 con 0x7fb4f00cb420 2023-12-20T04:44:29.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.605+0000 7fb4e6ffd640 1 -- 172.21.15.132:0/1872043041 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb4e000c6d0 con 0x7fb4f00cb420 2023-12-20T04:44:29.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.605+0000 7fb4e6ffd640 1 --2- 172.21.15.132:0/1872043041 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb4d006a430 0x7fb4d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:29.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.606+0000 7fb4e6ffd640 1 -- 172.21.15.132:0/1872043041 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb4e0088500 con 0x7fb4f00cb420 2023-12-20T04:44:29.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.606+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/1872043041 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb4d006a430 0x7fb4d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:29.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.606+0000 7fb4e7fff640 1 --2- 172.21.15.132:0/1872043041 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb4d006a430 0x7fb4d006c8f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0156e50 tx=0x7fb4d8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:29.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.610+0000 7fb4e6ffd640 1 -- 172.21.15.132:0/1872043041 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb4e0053ba0 con 0x7fb4f00cb420 2023-12-20T04:44:29.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.811+0000 7fb4f49fb640 1 -- 172.21.15.132:0/1872043041 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb4f0156a70 con 0x7fb4f00cb420 2023-12-20T04:44:29.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.811+0000 7fb4e6ffd640 1 -- 172.21.15.132:0/1872043041 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4721 (secure 0 0 0) 0x7fb4e00571c0 con 0x7fb4f00cb420 2023-12-20T04:44:29.813 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:29.813 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1456944733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1456944733},{"type":"v1","addr":"172.21.15.187:6834","nonce":1456944733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2114954856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2114954856},{"type":"v1","addr":"172.21.15.187:6835","nonce":2114954856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2494230497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2494230497},{"type":"v1","addr":"172.21.15.132:6837","nonce":2494230497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:44:17.197194+0000","modified":"2023-12-20T04:44:19.205156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/1024674556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1024674556},{"type":"v1","addr":"172.21.15.132:6836","nonce":1024674556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-20T04:44:29.813 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 19 2023-12-20T04:44:29.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.813+0000 7fb4f49fb640 1 -- 172.21.15.132:0/1872043041 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb4d006a430 msgr2=0x7fb4d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:29.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.813+0000 7fb4f49fb640 1 --2- 172.21.15.132:0/1872043041 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb4d006a430 0x7fb4d006c8f0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7fb4f0156e50 tx=0x7fb4d8008040 comp rx=0 tx=0).stop 2023-12-20T04:44:29.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.813+0000 7fb4f49fb640 1 -- 172.21.15.132:0/1872043041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f00cb420 msgr2=0x7fb4f00c8fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:29.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.813+0000 7fb4f49fb640 1 --2- 172.21.15.132:0/1872043041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f00cb420 0x7fb4f00c8fe0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7fb4e000e7e0 tx=0x7fb4e000eca0 comp rx=0 tx=0).stop 2023-12-20T04:44:29.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.813+0000 7fb4f49fb640 1 -- 172.21.15.132:0/1872043041 shutdown_connections 2023-12-20T04:44:29.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.813+0000 7fb4f49fb640 1 --2- 172.21.15.132:0/1872043041 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb4d006a430 0x7fb4d006c8f0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:29.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.813+0000 7fb4f49fb640 1 --2- 172.21.15.132:0/1872043041 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4f015e2d0 0x7fb4f00c9b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:29.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.813+0000 7fb4f49fb640 1 --2- 172.21.15.132:0/1872043041 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4f00ceee0 0x7fb4f0156100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:29.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.813+0000 7fb4f49fb640 1 --2- 172.21.15.132:0/1872043041 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb4f00cb420 0x7fb4f00c8fe0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:29.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.813+0000 7fb4f49fb640 1 -- 172.21.15.132:0/1872043041 >> 172.21.15.132:0/1872043041 conn(0x7fb4f006d7c0 msgr2=0x7fb4f006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:29.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.813+0000 7fb4f49fb640 1 -- 172.21.15.132:0/1872043041 shutdown_connections 2023-12-20T04:44:29.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:29.813+0000 7fb4f49fb640 1 -- 172.21.15.132:0/1872043041 wait complete. 2023-12-20T04:44:29.826 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-20T04:44:29.941 INFO:teuthology.orchestra.run.smithi132.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":5685,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":12.732468872,"mdsmap_epoch":19,"osdmap_epoch":47,"osdmap_epoch_barrier":47,"uptime":17.496159823999999} 2023-12-20T04:44:29.941 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 5685, "mdsmap_epoch": 19, "osdmap_epoch": 47, "osdmap_epoch_barrier": 47, "rank_uptime": 12.732468872, "state": "up:active", "uptime": 17.496159824, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:44:29.942 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-20T04:44:30.052 INFO:teuthology.orchestra.run.smithi132.stdout:{"osd_mon_report_interval":"5"} 2023-12-20T04:44:30.053 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-20T04:44:30.053 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-12-20T04:44:30.053 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:44:30.053 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:44:30.069 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:30.069 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-12-20T04:44:31.198 INFO:teuthology.orchestra.run.smithi132.stderr:265+0 records in 2023-12-20T04:44:31.198 INFO:teuthology.orchestra.run.smithi132.stderr:265+0 records out 2023-12-20T04:44:31.198 INFO:teuthology.orchestra.run.smithi132.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.06999 s, 260 MB/s 2023-12-20T04:44:31.199 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:44:31.199 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:44:31.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:31.214 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-12-20T04:44:32.384 INFO:teuthology.orchestra.run.smithi132.stderr:292+0 records in 2023-12-20T04:44:32.384 INFO:teuthology.orchestra.run.smithi132.stderr:292+0 records out 2023-12-20T04:44:32.384 INFO:teuthology.orchestra.run.smithi132.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.11224 s, 275 MB/s 2023-12-20T04:44:32.384 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-20T04:44:32.385 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:44:32.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.483+0000 7fe8ffa28640 1 Processor -- start 2023-12-20T04:44:32.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.483+0000 7fe8ffa28640 1 -- start start 2023-12-20T04:44:32.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.484+0000 7fe8ffa28640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8f815e2d0 0x7fe8f80b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:32.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.484+0000 7fe8ffa28640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe8f80cf0b0 0x7fe8f80d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:32.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.484+0000 7fe8ffa28640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe8f80cd740 con 0x7fe8f80cb420 2023-12-20T04:44:32.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.484+0000 7fe8ffa28640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8f80ce230 con 0x7fe8f80cf0b0 2023-12-20T04:44:32.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.484+0000 7fe8ffa28640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f80cd990 con 0x7fe8f815e2d0 2023-12-20T04:44:32.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.484+0000 7fe8fdfc5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe8f80cf0b0 0x7fe8f80d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:32.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.484+0000 7fe8fdfc5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe8f80cf0b0 0x7fe8f80d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43166/0 (socket says 172.21.15.132:43166) 2023-12-20T04:44:32.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.484+0000 7fe8fdfc5640 1 -- 172.21.15.132:0/3687436709 learned_addr learned my addr 172.21.15.132:0/3687436709 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:32.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.484+0000 7fe8fd7c4640 1 --2- 172.21.15.132:0/3687436709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8f815e2d0 0x7fe8f80b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:32.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.484+0000 7fe8fdfc5640 1 -- 172.21.15.132:0/3687436709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8f815e2d0 msgr2=0x7fe8f80b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:32.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.484+0000 7fe8fdfc5640 1 --2- 172.21.15.132:0/3687436709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8f815e2d0 0x7fe8f80b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:32.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.484+0000 7fe8fdfc5640 1 -- 172.21.15.132:0/3687436709 >> v1:172.21.15.187:6789/0 conn(0x7fe8f80cb420 legacy=0x7fe8f80ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:32.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.484+0000 7fe8fdfc5640 1 -- 172.21.15.132:0/3687436709 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f80cdc70 con 0x7fe8f80cf0b0 2023-12-20T04:44:32.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.485+0000 7fe8fdfc5640 1 --2- 172.21.15.132:0/3687436709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8f80cf0b0 0x7fe8f80d07f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009e50 tx=0x7fe8f002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e434742ccea01694 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:32.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.485+0000 7fe8effff640 1 -- 172.21.15.132:0/3687436709 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f002ca70 con 0x7fe8f80cf0b0 2023-12-20T04:44:32.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.485+0000 7fe8effff640 1 -- 172.21.15.132:0/3687436709 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f002cbd0 con 0x7fe8f80cf0b0 2023-12-20T04:44:32.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.485+0000 7fe8effff640 1 -- 172.21.15.132:0/3687436709 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f00343f0 con 0x7fe8f80cf0b0 2023-12-20T04:44:32.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.486+0000 7fe8ffa28640 1 -- 172.21.15.132:0/3687436709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8f80cf0b0 msgr2=0x7fe8f80d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:32.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.486+0000 7fe8ffa28640 1 --2- 172.21.15.132:0/3687436709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8f80cf0b0 0x7fe8f80d07f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009e50 tx=0x7fe8f002bed0 comp rx=0 tx=0).stop 2023-12-20T04:44:32.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.486+0000 7fe8ffa28640 1 -- 172.21.15.132:0/3687436709 shutdown_connections 2023-12-20T04:44:32.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.486+0000 7fe8ffa28640 1 --2- 172.21.15.132:0/3687436709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8f80cf0b0 0x7fe8f80d07f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:32.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.486+0000 7fe8ffa28640 1 --2- 172.21.15.132:0/3687436709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8f815e2d0 0x7fe8f80b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:32.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.486+0000 7fe8ffa28640 1 -- 172.21.15.132:0/3687436709 >> 172.21.15.132:0/3687436709 conn(0x7fe8f806d7c0 msgr2=0x7fe8f806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:32.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.486+0000 7fe8ffa28640 1 -- 172.21.15.132:0/3687436709 shutdown_connections 2023-12-20T04:44:32.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.486+0000 7fe8ffa28640 1 -- 172.21.15.132:0/3687436709 wait complete. 2023-12-20T04:44:32.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.487+0000 7fe8ffa28640 1 Processor -- start 2023-12-20T04:44:32.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.487+0000 7fe8ffa28640 1 -- start start 2023-12-20T04:44:32.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8ffa28640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8f80cb420 0x7fe8f80ca220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:32.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8ffa28640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8f80cf0b0 0x7fe8f80b4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:32.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8ffa28640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8f815e2d0 0x7fe8f80c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:32.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8ffa28640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f80ca760 con 0x7fe8f815e2d0 2023-12-20T04:44:32.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8ffa28640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f80b3b60 con 0x7fe8f80cb420 2023-12-20T04:44:32.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8ffa28640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8f81f1040 con 0x7fe8f80cf0b0 2023-12-20T04:44:32.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8fdfc5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8f815e2d0 0x7fe8f80c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:32.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8fdfc5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8f815e2d0 0x7fe8f80c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43178/0 (socket says 172.21.15.132:43178) 2023-12-20T04:44:32.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8fdfc5640 1 -- 172.21.15.132:0/3195569112 learned_addr learned my addr 172.21.15.132:0/3195569112 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:32.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8fd7c4640 1 --2- 172.21.15.132:0/3195569112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8f80cb420 0x7fe8f80ca220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:32.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8fcfc3640 1 --2- 172.21.15.132:0/3195569112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8f80cf0b0 0x7fe8f80b4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:32.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8fdfc5640 1 -- 172.21.15.132:0/3195569112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8f80cf0b0 msgr2=0x7fe8f80b4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:32.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8fdfc5640 1 --2- 172.21.15.132:0/3195569112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8f80cf0b0 0x7fe8f80b4340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:32.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8fdfc5640 1 -- 172.21.15.132:0/3195569112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8f80cb420 msgr2=0x7fe8f80ca220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:32.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8fdfc5640 1 --2- 172.21.15.132:0/3195569112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8f80cb420 0x7fe8f80ca220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:32.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8fdfc5640 1 -- 172.21.15.132:0/3195569112 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8f0009b30 con 0x7fe8f815e2d0 2023-12-20T04:44:32.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8fdfc5640 1 --2- 172.21.15.132:0/3195569112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8f815e2d0 0x7fe8f80c7ea0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009e50 tx=0x7fe8f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:32.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8edffb640 1 -- 172.21.15.132:0/3195569112 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f0009510 con 0x7fe8f815e2d0 2023-12-20T04:44:32.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8edffb640 1 -- 172.21.15.132:0/3195569112 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe8f003e450 con 0x7fe8f815e2d0 2023-12-20T04:44:32.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8edffb640 1 -- 172.21.15.132:0/3195569112 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe8f003e800 con 0x7fe8f815e2d0 2023-12-20T04:44:32.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.488+0000 7fe8ffa28640 1 -- 172.21.15.132:0/3195569112 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8f81f1320 con 0x7fe8f815e2d0 2023-12-20T04:44:32.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.489+0000 7fe8ffa28640 1 -- 172.21.15.132:0/3195569112 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8f80b3e20 con 0x7fe8f815e2d0 2023-12-20T04:44:32.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.490+0000 7fe8ffa28640 1 -- 172.21.15.132:0/3195569112 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8f804e840 con 0x7fe8f815e2d0 2023-12-20T04:44:32.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.490+0000 7fe8edffb640 1 -- 172.21.15.132:0/3195569112 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe8f003e960 con 0x7fe8f815e2d0 2023-12-20T04:44:32.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.490+0000 7fe8edffb640 1 --2- 172.21.15.132:0/3195569112 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe8dc06a430 0x7fe8dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:32.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.491+0000 7fe8fd7c4640 1 --2- 172.21.15.132:0/3195569112 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe8dc06a430 0x7fe8dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:32.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.491+0000 7fe8edffb640 1 -- 172.21.15.132:0/3195569112 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe8f00ab4a0 con 0x7fe8f815e2d0 2023-12-20T04:44:32.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.491+0000 7fe8fd7c4640 1 --2- 172.21.15.132:0/3195569112 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe8dc06a430 0x7fe8dc06c8f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4009aa0 tx=0x7fe8f4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:32.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.495+0000 7fe8edffb640 1 -- 172.21.15.132:0/3195569112 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe8f0076bd0 con 0x7fe8f815e2d0 2023-12-20T04:44:32.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.663+0000 7fe8ffa28640 1 -- 172.21.15.132:0/3195569112 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fe8f80ce480 con 0x7fe8f815e2d0 2023-12-20T04:44:32.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.664+0000 7fe8edffb640 1 -- 172.21.15.132:0/3195569112 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v47) v1 ==== 81+0+33528 (secure 0 0 0) 0x7fe8f007a1f0 con 0x7fe8f815e2d0 2023-12-20T04:44:32.666 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:32.666 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:44:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 47, 2023-12-20T04:44:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:44:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:44:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:44:18.198857+0000", 2023-12-20T04:44:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:44:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:44:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:44:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:44:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:44:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:44:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:44:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:44:32.667 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:44:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:44:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:44:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:44:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:44:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:44:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 7, 2023-12-20T04:44:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:44:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:44:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:44:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:44:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:44:32.668 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:44:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:44:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:44:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:44:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:44:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:44:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:32.669 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:44:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:44:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:44:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:44:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:44:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:32.670 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "16", 2023-12-20T04:44:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:32.671 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:32.672 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:32.673 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:44:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:44:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:44:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:44:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:44:32.674 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:44:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:44:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:44:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 6, 2023-12-20T04:44:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:44:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:44:15.033177+0000", 2023-12-20T04:44:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:44:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:44:32.675 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:44:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:44:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:44:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:44:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:44:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:32.676 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "46", 2023-12-20T04:44:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:32.677 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:32.678 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:32.679 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:44:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:44:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:44:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:44:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:44:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:44:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:44:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:44:32.680 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:44:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:44:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 7, 2023-12-20T04:44:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:44:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:44:16.130594+0000", 2023-12-20T04:44:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:44:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:44:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:32.681 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:44:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:44:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:44:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:44:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:44:32.682 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "47", 2023-12-20T04:44:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:32.683 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:32.684 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:32.685 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:44:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:44:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:44:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:44:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:44:32.686 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:44:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:44:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:44:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:44:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:44:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:44:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:32.687 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:44:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:32.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:44:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:44:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:44:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:44:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.690 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:44:32.691 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:32.691 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.691 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.691 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:32.691 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.691 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.691 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:44:32.691 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:32.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.692 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.692 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:44:32.692 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:32.692 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.692 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.692 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:44:32.692 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:44:32.692 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:44:32.692 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:44:32.692 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:32.692 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:32.692 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:32.692 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.693 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:44:32.693 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:32.693 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:32.693 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:32.693 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:32.693 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:32.693 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:32.693 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:32.693 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:32.693 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:32.693 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:32.693 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:32.694 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:32.694 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.694 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.694 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:44:32.694 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:32.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.694 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.694 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:44:32.694 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:32.694 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.695 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.695 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:32.695 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.695 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.695 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:44:32.695 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:32.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.695 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.695 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:44:32.695 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:32.695 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.695 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.696 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:32.696 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.696 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.696 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:44:32.696 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:32.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.696 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.696 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:44:32.696 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:32.696 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.697 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.697 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:32.697 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.697 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.697 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:44:32.697 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:32.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.697 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.697 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:44:32.697 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:32.697 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.698 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.698 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:44:32.698 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:44:32.698 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:44:32.698 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:44:32.698 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:32.698 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:32.698 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:32.698 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.698 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:44:32.698 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:32.699 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:32.699 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:32.699 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:32.699 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:32.699 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:32.699 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:32.699 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:32.699 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:32.699 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:32.699 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:32.699 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:32.699 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.699 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.700 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:44:32.700 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:32.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.700 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.700 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:44:32.700 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:32.700 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.700 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.700 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:32.700 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.701 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.701 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:44:32.701 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:32.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.701 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.701 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:44:32.701 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:32.701 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.701 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.701 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:32.701 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.702 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.702 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:44:32.702 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:32.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.702 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.702 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:44:32.702 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:32.702 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.702 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.702 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:32.702 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.703 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.703 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:44:32.703 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:32.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.703 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.703 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:44:32.703 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:32.703 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.703 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.703 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:44:32.704 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:44:32.704 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:44:32.704 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:44:32.704 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:32.704 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:32.704 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:32.704 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.704 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:44:32.704 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:32.704 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:32.704 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:32.704 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:32.704 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:32.705 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:32.705 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:32.705 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:32.705 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:32.705 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:32.705 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:32.705 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:32.705 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.705 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.705 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:44:32.705 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:32.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.706 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.706 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:44:32.706 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:32.706 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.706 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.706 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:32.706 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.706 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.706 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:44:32.706 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:32.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.707 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.707 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:44:32.707 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:32.707 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.707 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.707 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:32.707 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.707 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.707 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:44:32.708 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:32.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.708 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.708 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:44:32.708 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:32.708 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.708 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.708 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:32.708 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.708 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.708 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:44:32.708 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:32.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.709 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.709 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:44:32.709 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:32.709 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.709 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.709 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:44:32.709 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:44:32.709 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:44:32.709 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:44:32.709 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:32.710 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:32.710 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:32.710 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.710 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:44:32.710 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:32.710 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:32.710 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:32.710 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:32.710 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:32.710 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:32.710 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:32.710 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:32.711 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:32.711 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:32.711 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:32.711 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:32.711 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.711 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.711 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:44:32.711 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:32.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.711 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.712 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:44:32.712 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:32.712 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.712 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.712 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:32.712 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.712 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.712 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:44:32.712 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:32.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.712 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.713 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:44:32.713 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:32.713 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.713 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.713 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:32.713 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.713 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.713 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:44:32.713 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:32.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.713 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.714 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:44:32.714 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:32.714 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.714 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.714 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:32.714 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.714 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.714 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:44:32.714 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:32.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.714 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.714 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:44:32.715 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:32.715 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.715 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.715 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:44:32.715 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:44:32.715 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:44:32.715 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:44:32.715 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:32.715 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:32.715 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:32.715 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.715 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:44:32.716 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:32.716 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:32.716 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:32.716 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:32.716 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:32.716 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:32.716 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:32.716 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:32.716 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:32.716 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:32.716 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:32.716 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:32.716 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.717 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.717 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:44:32.717 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:32.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.717 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.717 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:44:32.717 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:32.717 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.717 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.717 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:32.717 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.718 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.718 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:44:32.718 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:32.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.718 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.718 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:44:32.718 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:32.718 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.718 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.718 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:32.718 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.719 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.719 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:44:32.719 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:32.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.719 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.719 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:44:32.719 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:32.719 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.719 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.719 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:32.719 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.719 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.719 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:44:32.720 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:32.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.720 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.720 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.720 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:44:32.720 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:32.720 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.720 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.720 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:44:32.720 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:44:32.720 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:44:32.720 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:44:32.720 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:32.721 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:32.721 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:32.721 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.721 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:44:32.721 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:32.721 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:32.721 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:32.721 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:32.721 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:32.721 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:32.722 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:32.722 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:32.722 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:32.722 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:32.722 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:32.722 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:32.722 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.722 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.722 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:44:32.722 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:32.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.723 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.723 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:44:32.723 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:32.723 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.723 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.723 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:32.723 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.723 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.723 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:44:32.723 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:32.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.724 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.724 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:44:32.724 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:32.724 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.724 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.724 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:32.724 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.724 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.724 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:44:32.724 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:32.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.725 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.725 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:44:32.725 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:32.725 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.725 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.725 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.725 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:32.725 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.725 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.725 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:44:32.725 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:32.725 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.726 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.726 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:44:32.726 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:32.726 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.726 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.726 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.726 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:44:32.726 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:44:32.726 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:44:32.726 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:44:32.726 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:32.726 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:32.726 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:32.727 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.727 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.727 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.727 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:44:32.727 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:32.727 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:32.727 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:32.727 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:32.727 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:32.727 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:32.727 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:32.727 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:32.727 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:32.727 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:32.728 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:32.728 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:32.728 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.728 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.728 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:44:32.728 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:32.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.728 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.728 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:44:32.728 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:32.728 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.728 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.728 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:32.729 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.729 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.729 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:44:32.729 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:32.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.729 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.729 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:44:32.729 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:32.729 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.729 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.729 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:32.729 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.730 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.730 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:44:32.730 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:32.730 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.730 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.730 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:44:32.730 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:32.730 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.730 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.730 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.730 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:32.731 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:32.731 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.731 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:32.731 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:44:32.731 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:32.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.731 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.731 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:32.731 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:44:32.731 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:32.731 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.731 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.731 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:44:32.732 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:44:32.732 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:44:32.732 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:44:32.732 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:32.732 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:32.732 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:32.732 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:32.732 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.732 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:32.732 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:44:32.732 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.732 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:44:32.732 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:32.732 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:32.733 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:32.733 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:32.733 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:32.733 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:44:32.733 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:32.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.733 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.733 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:44:32.733 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:32.733 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:32.733 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:32.733 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:32.733 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:32.733 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:44:32.734 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:32.734 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.734 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:44:32.734 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:32.734 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:32.734 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:32.734 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:32.734 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:32.734 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:44:32.734 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:32.734 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.735 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:44:32.735 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:32.735 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:32.735 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:32.735 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:32.735 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:32.735 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:44:32.735 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:32.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.735 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.735 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:44:32.735 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:32.736 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:32.736 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:32.736 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:32.736 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:32.736 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:44:32.736 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:32.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.736 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.736 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:44:32.736 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:32.736 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:32.736 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:32.736 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:32.736 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:32.737 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:44:32.737 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:32.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.737 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:44:32.737 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:32.737 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:32.737 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:32.737 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:32.737 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:32.737 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:44:32.737 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:32.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.738 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:32.738 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:44:32.738 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:32.738 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:32.738 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:32.738 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:32.738 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:32.738 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:44:32.738 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:32.738 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.738 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:32.738 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:44:32.738 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:44:32.738 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:44:32.739 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:44:32.739 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:44:32.739 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:44:32.739 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:44:32.739 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:44:32.739 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:44:32.739 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:44:32.739 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:44:32.739 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:44:32.739 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:44:32.739 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:44:32.739 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:32.740 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:44:32.740 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:44:32.740 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:44:32.740 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:44:32.740 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:44:32.740 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:44:32.740 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:44:32.740 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:44:32.740 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:44:32.740 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:44:32.740 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:44:32.740 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:32.741 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:44:32.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.666+0000 7fe8ffa28640 1 -- 172.21.15.132:0/3195569112 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe8dc06a430 msgr2=0x7fe8dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:32.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.666+0000 7fe8ffa28640 1 --2- 172.21.15.132:0/3195569112 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe8dc06a430 0x7fe8dc06c8f0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fe8f4009aa0 tx=0x7fe8f4009190 comp rx=0 tx=0).stop 2023-12-20T04:44:32.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.666+0000 7fe8ffa28640 1 -- 172.21.15.132:0/3195569112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8f815e2d0 msgr2=0x7fe8f80c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:32.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.666+0000 7fe8ffa28640 1 --2- 172.21.15.132:0/3195569112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8f815e2d0 0x7fe8f80c7ea0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7fe8f0009e50 tx=0x7fe8f0004a40 comp rx=0 tx=0).stop 2023-12-20T04:44:32.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.666+0000 7fe8ffa28640 1 -- 172.21.15.132:0/3195569112 shutdown_connections 2023-12-20T04:44:32.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.666+0000 7fe8ffa28640 1 --2- 172.21.15.132:0/3195569112 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe8dc06a430 0x7fe8dc06c8f0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:32.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.666+0000 7fe8ffa28640 1 --2- 172.21.15.132:0/3195569112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8f815e2d0 0x7fe8f80c7ea0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:32.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.666+0000 7fe8ffa28640 1 --2- 172.21.15.132:0/3195569112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe8f80cf0b0 0x7fe8f80b4340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:32.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.666+0000 7fe8ffa28640 1 --2- 172.21.15.132:0/3195569112 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe8f80cb420 0x7fe8f80ca220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:32.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.666+0000 7fe8ffa28640 1 -- 172.21.15.132:0/3195569112 >> 172.21.15.132:0/3195569112 conn(0x7fe8f806d7c0 msgr2=0x7fe8f815d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:32.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.666+0000 7fe8ffa28640 1 -- 172.21.15.132:0/3195569112 shutdown_connections 2023-12-20T04:44:32.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:32.666+0000 7fe8ffa28640 1 -- 172.21.15.132:0/3195569112 wait complete. 2023-12-20T04:44:32.745 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-20T04:44:34.851 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:44:34.850+0000 7f1a5f3c2640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-12-20T04:44:36.862 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:44:36.860+0000 7f1a5f3c2640 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 2 pgs recovery_toofull (PG_RECOVERY_FULL) 2023-12-20T04:44:37.746 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:44:37.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.855+0000 7f3e36896640 1 Processor -- start 2023-12-20T04:44:37.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.855+0000 7f3e36896640 1 -- start start 2023-12-20T04:44:37.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.856+0000 7f3e36896640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3e3006fd60 0x7f3e300cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:37.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.856+0000 7f3e36896640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e300ca8e0 0x7f3e300b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:37.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.856+0000 7f3e36896640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e300cbba0 con 0x7f3e300718e0 2023-12-20T04:44:37.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.856+0000 7f3e36896640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e3015b3f0 con 0x7f3e3006fd60 2023-12-20T04:44:37.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.856+0000 7f3e36896640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e3006cde0 con 0x7f3e300ca8e0 2023-12-20T04:44:37.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.856+0000 7f3e2f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3e3006fd60 0x7f3e300cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:37.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.856+0000 7f3e2ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3e300718e0 0x7f3e30071cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46960/0 (socket says 172.21.15.132:46960) 2023-12-20T04:44:37.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.856+0000 7f3e2ffff640 1 -- 172.21.15.132:0/2587414619 learned_addr learned my addr 172.21.15.132:0/2587414619 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:37.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.856+0000 7f3e34e33640 1 --2- 172.21.15.132:0/2587414619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e300ca8e0 0x7f3e300b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:37.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.856+0000 7f3e2f7fe640 1 -- 172.21.15.132:0/2587414619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e300ca8e0 msgr2=0x7f3e300b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:37.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.856+0000 7f3e2f7fe640 1 --2- 172.21.15.132:0/2587414619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e300ca8e0 0x7f3e300b2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:37.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.856+0000 7f3e2f7fe640 1 -- 172.21.15.132:0/2587414619 >> v1:172.21.15.132:6789/0 conn(0x7f3e300718e0 legacy=0x7f3e30071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:37.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.856+0000 7f3e2f7fe640 1 -- 172.21.15.132:0/2587414619 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e300c9b20 con 0x7f3e3006fd60 2023-12-20T04:44:37.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.856+0000 7f3e2effd640 1 -- 172.21.15.132:0/2587414619 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 532007495 0 0) 0x7f3e20001110 con 0x7f3e300718e0 2023-12-20T04:44:37.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.857+0000 7f3e2f7fe640 1 --2- 172.21.15.132:0/2587414619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e3006fd60 0x7f3e300cb4a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3e240097a0 tx=0x7f3e2402b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8fb7014830ca48b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:37.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.857+0000 7f3e2effd640 1 -- 172.21.15.132:0/2587414619 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e2402e070 con 0x7f3e3006fd60 2023-12-20T04:44:37.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.857+0000 7f3e2effd640 1 -- 172.21.15.132:0/2587414619 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e240315a0 con 0x7f3e3006fd60 2023-12-20T04:44:37.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.857+0000 7f3e2effd640 1 -- 172.21.15.132:0/2587414619 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e24031930 con 0x7f3e3006fd60 2023-12-20T04:44:37.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.858+0000 7f3e36896640 1 -- 172.21.15.132:0/2587414619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e3006fd60 msgr2=0x7f3e300cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:37.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.858+0000 7f3e36896640 1 --2- 172.21.15.132:0/2587414619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e3006fd60 0x7f3e300cb4a0 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f3e240097a0 tx=0x7f3e2402b840 comp rx=0 tx=0).stop 2023-12-20T04:44:37.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.858+0000 7f3e36896640 1 -- 172.21.15.132:0/2587414619 shutdown_connections 2023-12-20T04:44:37.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.858+0000 7f3e36896640 1 --2- 172.21.15.132:0/2587414619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e300ca8e0 0x7f3e300b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:37.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.858+0000 7f3e36896640 1 --2- 172.21.15.132:0/2587414619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e3006fd60 0x7f3e300cb4a0 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:37.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.858+0000 7f3e36896640 1 -- 172.21.15.132:0/2587414619 >> 172.21.15.132:0/2587414619 conn(0x7f3e300cf330 msgr2=0x7f3e300cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:37.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.858+0000 7f3e36896640 1 -- 172.21.15.132:0/2587414619 shutdown_connections 2023-12-20T04:44:37.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.858+0000 7f3e36896640 1 -- 172.21.15.132:0/2587414619 wait complete. 2023-12-20T04:44:37.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.859+0000 7f3e36896640 1 Processor -- start 2023-12-20T04:44:37.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.859+0000 7f3e36896640 1 -- start start 2023-12-20T04:44:37.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.860+0000 7f3e36896640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e3006fd60 0x7f3e3015dbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:37.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.860+0000 7f3e36896640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e300718e0 0x7f3e3015c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:37.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.860+0000 7f3e36896640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e300ca8e0 0x7f3e3015cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:37.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.860+0000 7f3e36896640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300c4720 con 0x7f3e300ca8e0 2023-12-20T04:44:37.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.860+0000 7f3e36896640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e301f0c50 con 0x7f3e3006fd60 2023-12-20T04:44:37.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.860+0000 7f3e36896640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e300c49c0 con 0x7f3e300718e0 2023-12-20T04:44:37.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.860+0000 7f3e34e33640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e300ca8e0 0x7f3e3015cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:37.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.860+0000 7f3e34e33640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e300ca8e0 0x7f3e3015cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42248/0 (socket says 172.21.15.132:42248) 2023-12-20T04:44:37.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.860+0000 7f3e34e33640 1 -- 172.21.15.132:0/1234412643 learned_addr learned my addr 172.21.15.132:0/1234412643 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:37.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.860+0000 7f3e2f7fe640 1 --2- 172.21.15.132:0/1234412643 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e300718e0 0x7f3e3015c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:37.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.860+0000 7f3e2ffff640 1 --2- 172.21.15.132:0/1234412643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e3006fd60 0x7f3e3015dbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:37.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.860+0000 7f3e34e33640 1 -- 172.21.15.132:0/1234412643 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e300718e0 msgr2=0x7f3e3015c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:37.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.860+0000 7f3e34e33640 1 --2- 172.21.15.132:0/1234412643 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e300718e0 0x7f3e3015c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:37.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.860+0000 7f3e34e33640 1 -- 172.21.15.132:0/1234412643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e3006fd60 msgr2=0x7f3e3015dbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:37.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.860+0000 7f3e34e33640 1 --2- 172.21.15.132:0/1234412643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e3006fd60 0x7f3e3015dbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:37.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.860+0000 7f3e34e33640 1 -- 172.21.15.132:0/1234412643 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e24009400 con 0x7f3e300ca8e0 2023-12-20T04:44:37.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.860+0000 7f3e2f7fe640 1 --2- 172.21.15.132:0/1234412643 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e300718e0 0x7f3e3015c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:37.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.861+0000 7f3e2ffff640 1 --2- 172.21.15.132:0/1234412643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e3006fd60 0x7f3e3015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:37.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.861+0000 7f3e34e33640 1 --2- 172.21.15.132:0/1234412643 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e300ca8e0 0x7f3e3015cac0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800cd70 tx=0x7f3e2800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:37.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.861+0000 7f3e2cff9640 1 -- 172.21.15.132:0/1234412643 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28003b90 con 0x7f3e300ca8e0 2023-12-20T04:44:37.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.861+0000 7f3e2cff9640 1 -- 172.21.15.132:0/1234412643 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e28003cf0 con 0x7f3e300ca8e0 2023-12-20T04:44:37.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.861+0000 7f3e36896640 1 -- 172.21.15.132:0/1234412643 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e300c4ca0 con 0x7f3e300ca8e0 2023-12-20T04:44:37.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.861+0000 7f3e2cff9640 1 -- 172.21.15.132:0/1234412643 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e28004240 con 0x7f3e300ca8e0 2023-12-20T04:44:37.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.861+0000 7f3e36896640 1 -- 172.21.15.132:0/1234412643 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e301f08b0 con 0x7f3e300ca8e0 2023-12-20T04:44:37.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.862+0000 7f3e36896640 1 -- 172.21.15.132:0/1234412643 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e300c51c0 con 0x7f3e300ca8e0 2023-12-20T04:44:37.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.862+0000 7f3e2cff9640 1 -- 172.21.15.132:0/1234412643 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3e280043a0 con 0x7f3e300ca8e0 2023-12-20T04:44:37.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.863+0000 7f3e2cff9640 1 --2- 172.21.15.132:0/1234412643 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e1c06a430 0x7f3e1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:37.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.863+0000 7f3e2cff9640 1 -- 172.21.15.132:0/1234412643 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3e28012070 con 0x7f3e300ca8e0 2023-12-20T04:44:37.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.863+0000 7f3e2ffff640 1 --2- 172.21.15.132:0/1234412643 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e1c06a430 0x7f3e1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:37.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.863+0000 7f3e2cff9640 1 -- 172.21.15.132:0/1234412643 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7f3e1c072020 con 0x7f3e300ca8e0 2023-12-20T04:44:37.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.863+0000 7f3e2ffff640 1 --2- 172.21.15.132:0/1234412643 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e1c06a430 0x7f3e1c06c8f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3e20000f60 tx=0x7f3e20009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:37.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:37.867+0000 7f3e2cff9640 1 -- 172.21.15.132:0/1234412643 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3e28054920 con 0x7f3e300ca8e0 2023-12-20T04:44:38.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.032+0000 7f3e36896640 1 -- 172.21.15.132:0/1234412643 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3e3004e840 con 0x7f3e300ca8e0 2023-12-20T04:44:38.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.033+0000 7f3e2cff9640 1 -- 172.21.15.132:0/1234412643 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v49) v1 ==== 81+0+34045 (secure 0 0 0) 0x7f3e28057f40 con 0x7f3e300ca8e0 2023-12-20T04:44:38.036 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:38.036 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:44:38.036 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 49, 2023-12-20T04:44:38.036 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:44:38.037 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:44:38.037 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:44:35.854703+0000", 2023-12-20T04:44:38.037 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:44:38.037 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:44:38.037 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:44:38.037 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:44:38.037 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:44:38.037 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:44:38.038 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:44:38.038 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:44:38.038 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:44:38.038 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:38.038 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:44:38.038 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:44:38.038 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:44:38.038 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:44:38.038 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:44:38.039 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 7, 2023-12-20T04:44:38.039 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:44:38.039 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:44:38.039 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "luminous", 2023-12-20T04:44:38.039 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:44:38.039 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:44:38.040 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:44:38.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.040 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:44:38.040 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:44:38.040 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:44:38.040 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:44:38.040 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:44:38.041 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:38.041 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:38.041 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:38.041 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:38.041 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:38.041 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:38.042 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:38.042 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:38.042 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:38.042 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:38.042 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:44:38.042 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:44:38.043 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:44:38.043 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:44:38.043 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:44:38.043 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:38.043 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:38.043 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:38.043 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:38.044 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:38.044 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:38.044 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:38.044 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.044 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "48", 2023-12-20T04:44:38.044 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:38.045 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:38.045 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:38.045 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:38.045 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:38.045 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:38.045 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:38.045 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:38.046 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:38.046 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:38.046 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:38.046 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:38.046 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:38.046 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:38.046 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:38.046 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:38.046 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:38.046 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:38.046 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:38.047 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:38.047 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:38.047 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:38.047 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:38.047 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:38.047 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:38.047 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:38.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.047 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:38.047 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:38.047 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:38.047 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:38.047 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:38.047 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:38.047 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:38.048 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:38.048 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:38.048 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:38.048 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:38.048 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:38.048 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:44:38.048 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:44:38.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.048 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:38.048 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:44:38.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.048 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:38.048 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:44:38.048 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:44:38.049 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:44:38.049 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:44:38.049 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:44:38.049 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:38.049 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:38.049 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:38.049 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.049 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.049 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.049 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 6, 2023-12-20T04:44:38.049 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:44:38.050 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:44:15.033177+0000", 2023-12-20T04:44:38.050 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:44:38.050 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:44:38.050 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:38.050 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:38.050 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:38.050 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:38.050 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:38.050 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:38.050 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:38.050 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:38.050 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:38.050 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:38.050 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:44:38.051 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:44:38.051 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:44:38.051 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:44:38.051 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:44:38.051 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:38.051 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:38.051 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:38.051 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:38.051 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:38.051 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:38.051 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:38.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.052 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "48", 2023-12-20T04:44:38.052 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:38.052 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:38.052 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:38.052 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:38.052 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:38.052 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:38.052 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:38.052 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:38.052 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:38.052 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:38.052 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:38.053 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:38.053 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:38.053 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:38.053 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:38.053 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:38.053 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:38.053 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:38.053 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:38.053 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:38.053 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:38.053 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:38.053 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:38.053 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:38.054 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:38.054 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:38.054 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.054 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:38.054 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:38.054 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:38.054 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:38.054 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:38.054 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:38.054 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:38.054 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:38.054 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:38.054 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:38.054 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:44:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:44:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:44:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:44:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:44:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:44:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:44:38.055 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:44:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:44:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:44:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 7, 2023-12-20T04:44:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:44:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:44:16.130594+0000", 2023-12-20T04:44:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:44:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:44:38.056 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:38.057 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:38.057 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:38.057 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:38.057 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:38.057 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:38.057 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:38.057 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:38.057 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:38.057 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:38.057 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:44:38.057 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:44:38.057 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:44:38.058 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:44:38.058 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:44:38.058 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:38.058 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:38.058 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:38.058 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:38.058 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:38.058 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:38.058 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:38.058 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.058 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "48", 2023-12-20T04:44:38.058 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:38.058 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:38.058 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:38.059 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:38.059 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:38.059 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:38.059 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:38.059 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:38.059 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:38.059 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:38.059 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:38.059 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:38.059 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:38.059 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:38.059 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:38.059 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:38.060 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:38.060 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:38.060 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:38.060 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:38.060 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:38.060 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:38.060 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:38.060 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:38.060 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:38.060 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:38.060 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.060 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:38.060 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:38.061 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:38.061 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:38.061 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:38.061 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:38.061 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:38.061 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:38.061 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:38.061 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:38.061 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:38.061 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:38.061 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:44:38.061 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:44:38.061 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.061 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:38.062 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:44:38.062 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:44:38.062 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.062 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.062 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:38.062 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:44:38.062 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:44:38.062 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:44:38.062 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:44:38.062 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:44:38.062 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:38.062 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:38.062 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:38.063 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.063 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.063 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:38.063 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:44:38.063 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.063 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:44:38.063 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:38.063 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:38.063 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:38.063 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:38.063 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:38.063 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:38.063 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:38.063 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:38.064 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:38.064 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:38.064 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:38.064 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:38.064 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.064 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.064 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.064 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:44:38.064 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:38.064 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.064 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.064 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.064 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:44:38.064 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:38.065 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.065 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.065 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.065 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:38.065 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.065 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.065 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.065 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:44:38.065 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:38.066 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.066 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.066 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.066 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:44:38.066 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:38.066 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.066 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.066 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.066 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:38.066 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.066 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.066 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.066 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:44:38.066 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:38.067 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.067 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.067 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.067 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:44:38.067 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:38.067 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.067 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.067 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.067 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:38.067 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.067 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.068 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.068 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:44:38.068 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:38.068 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.068 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.068 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.068 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:44:38.068 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:38.068 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.068 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.068 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.068 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:44:38.068 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:44:38.068 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:44:38.069 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:44:38.069 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:38.069 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:38.069 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:44:38.069 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:38.069 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.069 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.069 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.069 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:44:38.069 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:38.069 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:38.070 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:38.070 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:38.070 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:38.070 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:38.070 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:38.070 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:38.070 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:38.070 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:38.070 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:38.070 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:38.070 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.070 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.071 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.071 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:44:38.071 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:38.071 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.071 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.071 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.071 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:44:38.071 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:38.071 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.071 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.071 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.071 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:38.071 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.071 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.072 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.072 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:44:38.072 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:38.072 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.072 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.072 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.072 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:44:38.072 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:38.072 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.072 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.072 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.072 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:38.072 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.072 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.073 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.073 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:44:38.073 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:38.073 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.073 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.073 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.073 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:44:38.073 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:38.073 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.073 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.073 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.073 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:38.073 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.074 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.074 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.074 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:44:38.074 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:38.074 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.074 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.074 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.074 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:44:38.074 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:38.074 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.074 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.074 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.074 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:44:38.075 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:44:38.075 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:44:38.075 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:44:38.075 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:38.075 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:38.075 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:38.075 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.075 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.075 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.075 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:44:38.075 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:38.075 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:38.075 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:38.075 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:38.076 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:38.076 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:38.076 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:38.076 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:38.076 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:38.076 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:38.076 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:38.076 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:38.076 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.076 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.076 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.076 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:44:38.077 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:38.077 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.077 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.077 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.077 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:44:38.077 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:38.077 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.077 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.077 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.077 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:38.077 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.077 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.077 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.078 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:44:38.078 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:38.078 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.078 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.078 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.078 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:44:38.078 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:38.078 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.078 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.078 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.078 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:38.078 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.078 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.078 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.079 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:44:38.079 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:38.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.079 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.079 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.079 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:44:38.079 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:38.079 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.079 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.079 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:38.079 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.079 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.079 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.080 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:44:38.080 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:38.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.080 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.080 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.080 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:44:38.080 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:38.080 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.080 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.080 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:44:38.080 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:44:38.080 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:44:38.081 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:44:38.081 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:38.081 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:38.081 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:44:38.081 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:38.081 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.081 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.081 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.081 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:44:38.081 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:38.081 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:38.081 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:38.081 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:38.082 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:38.082 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:38.082 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:38.082 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:38.082 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:38.082 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:38.082 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:38.082 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:38.082 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.082 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.082 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.082 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:44:38.082 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:38.082 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.083 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.083 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.083 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:44:38.083 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:38.083 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.083 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.083 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.083 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:38.083 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.083 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.083 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.083 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:44:38.083 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:38.083 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.084 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.084 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.084 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:44:38.084 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:38.084 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.084 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.084 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.084 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:38.084 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.084 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.084 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.084 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:44:38.084 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:38.084 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.084 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.085 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.085 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:44:38.085 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:38.085 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.085 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.085 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.085 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:38.085 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.086 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.086 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.086 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:44:38.086 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:38.086 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.086 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.086 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.086 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:44:38.086 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:38.086 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.086 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.086 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.086 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:44:38.086 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:44:38.087 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:44:38.087 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:44:38.087 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:38.087 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull", 2023-12-20T04:44:38.087 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:38.087 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:38.087 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.087 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.087 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.087 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:44:38.087 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:38.087 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:38.087 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:38.087 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:38.088 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:38.088 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:38.088 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:38.088 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:38.088 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:38.088 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:38.088 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:38.088 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:38.088 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.088 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.088 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.089 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:44:38.089 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:38.089 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.089 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.089 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.089 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:44:38.089 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:38.089 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.089 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.090 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.090 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:38.090 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.090 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.090 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.090 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:44:38.090 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:38.090 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.090 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.090 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.090 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:44:38.090 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:38.091 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.091 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.091 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.091 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:38.091 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.091 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.091 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.091 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:44:38.091 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:38.091 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.091 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.091 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.091 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:44:38.091 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:38.092 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.092 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.092 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.092 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:38.092 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.092 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.092 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.092 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:44:38.092 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:38.092 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.092 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.092 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.092 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:44:38.092 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:38.093 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.093 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.093 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.093 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:44:38.093 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:44:38.093 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:44:38.093 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:44:38.093 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:38.093 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:38.093 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:38.093 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.093 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.093 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.094 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:44:38.094 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:38.094 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:38.094 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:38.094 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:38.094 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:38.094 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:38.094 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:38.094 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:38.094 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:38.094 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:38.094 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:38.094 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:38.094 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.094 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.095 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.095 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:44:38.095 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:38.095 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.095 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.095 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.095 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:44:38.095 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:38.095 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.095 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.095 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.095 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:38.095 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.096 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.096 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.096 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:44:38.096 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:38.096 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.096 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.096 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.096 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:44:38.096 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:38.096 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.096 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.096 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.096 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:38.096 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.096 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.097 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.097 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:44:38.097 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:38.097 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.097 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.097 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.097 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:44:38.097 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:38.097 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.097 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.097 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.097 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:38.097 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.097 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.098 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.098 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:44:38.098 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:38.098 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.098 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.098 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.098 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:44:38.098 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:38.098 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.098 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.098 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.098 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:44:38.098 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:44:38.098 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:44:38.099 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:44:38.099 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:38.099 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:38.099 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:38.099 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.099 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.099 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.099 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:44:38.099 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:38.099 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:38.099 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:38.099 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:38.099 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:38.100 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:38.100 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:38.100 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:38.100 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 48, 2023-12-20T04:44:38.100 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:38.100 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:38.100 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:38.100 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.100 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.100 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.100 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:44:38.100 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:38.101 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.101 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.101 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.101 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:44:38.101 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:38.101 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.101 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.101 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.101 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:38.101 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.101 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.101 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.101 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:44:38.102 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:38.102 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.102 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.102 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.102 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:44:38.102 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:38.102 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.102 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.102 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.102 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:38.102 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.102 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.102 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.102 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:44:38.102 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:38.103 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.103 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.103 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.103 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:44:38.103 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:38.103 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.103 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.103 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.103 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:38.103 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.103 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.103 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.104 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:44:38.104 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:38.104 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.104 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.104 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.104 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:44:38.104 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:38.104 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.104 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.105 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.105 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:44:38.105 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:44:38.105 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:44:38.105 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:44:38.105 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:38.105 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:38.105 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:44:38.105 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:38.105 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.105 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.105 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.105 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:44:38.105 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:38.106 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:38.106 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:38.106 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:38.106 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:38.106 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:38.106 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:38.106 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:38.106 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:38.106 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:38.106 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:38.106 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:38.106 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.106 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.106 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.107 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:44:38.107 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:38.107 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.107 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.107 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.107 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:44:38.107 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:38.107 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.107 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.107 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.108 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:38.108 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.108 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.108 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.108 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:44:38.108 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:38.108 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.108 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.108 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.108 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:44:38.108 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:38.108 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.108 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.108 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.109 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:38.109 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.109 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.109 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.109 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:44:38.109 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:38.109 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.109 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.109 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.109 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:44:38.109 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:38.109 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.109 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.110 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.110 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:38.110 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.110 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.110 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.110 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:44:38.110 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:38.110 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.110 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.110 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.110 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:44:38.110 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:38.110 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.111 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.111 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.111 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:44:38.111 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:44:38.111 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:44:38.111 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:44:38.111 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:38.111 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:38.111 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:44:38.111 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:38.111 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.112 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.112 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:38.112 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:44:38.112 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.112 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:44:38.112 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:38.112 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:38.112 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:38.112 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:38.112 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:38.112 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:44:38.112 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:38.112 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.112 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.113 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:44:38.113 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:38.113 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:38.113 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:38.113 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:38.113 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:38.113 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:44:38.113 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:38.113 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.113 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.113 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:44:38.113 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:38.114 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:38.114 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:38.114 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:38.114 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:38.114 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:44:38.114 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:38.114 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.114 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.114 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:44:38.114 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:38.115 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:38.115 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:38.115 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:38.115 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:38.115 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:44:38.115 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:38.115 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.115 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.115 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:44:38.115 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:38.115 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:38.116 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:38.116 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:38.116 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:38.116 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:44:38.116 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:38.116 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.116 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.116 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:44:38.116 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:38.116 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:38.116 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:38.116 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:38.117 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:38.117 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:44:38.117 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:38.117 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.117 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.117 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:44:38.117 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:38.117 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:38.117 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:38.117 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:38.117 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:38.118 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:44:38.118 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:38.118 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.118 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.118 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:44:38.118 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:38.118 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:38.118 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:38.118 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:38.118 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:38.118 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:44:38.118 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:38.119 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.119 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:38.119 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:44:38.119 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [ 2023-12-20T04:44:38.119 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.119 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "7.7", 2023-12-20T04:44:38.119 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:44:38.119 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.119 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 0, 2023-12-20T04:44:38.119 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 4 2023-12-20T04:44:38.119 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.119 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.119 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.120 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.120 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "7.30", 2023-12-20T04:44:38.120 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:44:38.120 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.120 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 0, 2023-12-20T04:44:38.120 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 5 2023-12-20T04:44:38.120 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.120 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.120 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.120 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:38.120 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:44:38.120 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:44:38.120 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:44:38.121 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:44:38.121 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:44:38.121 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:44:38.121 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:44:38.121 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:44:38.121 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:44:38.121 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:44:38.121 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:44:38.121 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:44:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:44:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:44:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:44:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:44:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:44:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:44:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:44:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:44:38.123 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:44:38.123 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:44:38.123 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:44:38.123 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.123 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:44:38.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.035+0000 7f3e36896640 1 -- 172.21.15.132:0/1234412643 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e1c06a430 msgr2=0x7f3e1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:38.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.035+0000 7f3e36896640 1 --2- 172.21.15.132:0/1234412643 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e1c06a430 0x7f3e1c06c8f0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f3e20000f60 tx=0x7f3e20009040 comp rx=0 tx=0).stop 2023-12-20T04:44:38.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.035+0000 7f3e36896640 1 -- 172.21.15.132:0/1234412643 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e300ca8e0 msgr2=0x7f3e3015cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:38.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.035+0000 7f3e36896640 1 --2- 172.21.15.132:0/1234412643 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e300ca8e0 0x7f3e3015cac0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f3e2800cd70 tx=0x7f3e2800a660 comp rx=0 tx=0).stop 2023-12-20T04:44:38.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.035+0000 7f3e36896640 1 -- 172.21.15.132:0/1234412643 shutdown_connections 2023-12-20T04:44:38.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.035+0000 7f3e36896640 1 --2- 172.21.15.132:0/1234412643 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3e1c06a430 0x7f3e1c06c8f0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.035+0000 7f3e36896640 1 --2- 172.21.15.132:0/1234412643 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e300ca8e0 0x7f3e3015cac0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.035+0000 7f3e36896640 1 --2- 172.21.15.132:0/1234412643 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e300718e0 0x7f3e3015c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.035+0000 7f3e36896640 1 --2- 172.21.15.132:0/1234412643 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e3006fd60 0x7f3e3015dbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.035+0000 7f3e36896640 1 -- 172.21.15.132:0/1234412643 >> 172.21.15.132:0/1234412643 conn(0x7f3e300cf330 msgr2=0x7f3e300b1f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:38.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.036+0000 7f3e36896640 1 -- 172.21.15.132:0/1234412643 shutdown_connections 2023-12-20T04:44:38.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.036+0000 7f3e36896640 1 -- 172.21.15.132:0/1234412643 wait complete. 2023-12-20T04:44:38.127 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-20T04:44:38.127 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:44:38.127 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:44:38.143 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:38.143 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-12-20T04:44:38.260 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:44:38.260 INFO:teuthology.orchestra.run.smithi132.stderr:dd: error writing 'large_file_b': No space left on device 2023-12-20T04:44:38.260 INFO:teuthology.orchestra.run.smithi132.stderr:dd: closing output file 'large_file_b': No space left on device 2023-12-20T04:44:38.261 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:44:38.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.359+0000 7f2edd555640 1 Processor -- start 2023-12-20T04:44:38.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.359+0000 7f2edd555640 1 -- start start 2023-12-20T04:44:38.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.360+0000 7f2edd555640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ed815d470 0x7f2ed80d0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:38.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.360+0000 7f2edd555640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2ed806fae0 0x7f2ed8161940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:38.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.360+0000 7f2edd555640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2ed806c430 con 0x7f2ed80cd670 2023-12-20T04:44:38.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.360+0000 7f2edd555640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2ed806c6f0 con 0x7f2ed806fae0 2023-12-20T04:44:38.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.360+0000 7f2edd555640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed806c9d0 con 0x7f2ed815d470 2023-12-20T04:44:38.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.360+0000 7f2ed67fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2ed806fae0 0x7f2ed8161940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:38.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.360+0000 7f2ed77fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2ed80cd670 0x7f2ed80cda90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46962/0 (socket says 172.21.15.132:46962) 2023-12-20T04:44:38.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.360+0000 7f2ed77fe640 1 -- 172.21.15.132:0/3837374438 learned_addr learned my addr 172.21.15.132:0/3837374438 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:38.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.360+0000 7f2ed6ffd640 1 --2- 172.21.15.132:0/3837374438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ed815d470 0x7f2ed80d0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:38.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.361+0000 7f2ed67fc640 1 -- 172.21.15.132:0/3837374438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ed815d470 msgr2=0x7f2ed80d0580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:38.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.361+0000 7f2ed67fc640 1 --2- 172.21.15.132:0/3837374438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ed815d470 0x7f2ed80d0580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.361+0000 7f2ed67fc640 1 -- 172.21.15.132:0/3837374438 >> v1:172.21.15.132:6789/0 conn(0x7f2ed80cd670 legacy=0x7f2ed80cda90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:38.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.361+0000 7f2ed5ffb640 1 -- 172.21.15.132:0/3837374438 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2013065445 0 0) 0x7f2ed806c430 con 0x7f2ed80cd670 2023-12-20T04:44:38.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.361+0000 7f2ed67fc640 1 -- 172.21.15.132:0/3837374438 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ed806ccb0 con 0x7f2ed806fae0 2023-12-20T04:44:38.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.361+0000 7f2ed6ffd640 1 --2- 172.21.15.132:0/3837374438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ed815d470 0x7f2ed80d0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:38.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.361+0000 7f2ed67fc640 1 --2- 172.21.15.132:0/3837374438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed806fae0 0x7f2ed8161940 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0097a0 tx=0x7f2ecc02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e725ce7929a566b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:38.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.361+0000 7f2ed5ffb640 1 -- 172.21.15.132:0/3837374438 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc031830 con 0x7f2ed806fae0 2023-12-20T04:44:38.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.361+0000 7f2ed5ffb640 1 -- 172.21.15.132:0/3837374438 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ecc031990 con 0x7f2ed806fae0 2023-12-20T04:44:38.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.361+0000 7f2ed5ffb640 1 -- 172.21.15.132:0/3837374438 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ecc031d20 con 0x7f2ed806fae0 2023-12-20T04:44:38.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.362+0000 7f2edd555640 1 -- 172.21.15.132:0/3837374438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed806fae0 msgr2=0x7f2ed8161940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:38.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.362+0000 7f2edd555640 1 --2- 172.21.15.132:0/3837374438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed806fae0 0x7f2ed8161940 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc0097a0 tx=0x7f2ecc02b8d0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.362+0000 7f2edd555640 1 -- 172.21.15.132:0/3837374438 shutdown_connections 2023-12-20T04:44:38.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.362+0000 7f2edd555640 1 --2- 172.21.15.132:0/3837374438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed806fae0 0x7f2ed8161940 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.362+0000 7f2edd555640 1 --2- 172.21.15.132:0/3837374438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ed815d470 0x7f2ed80d0580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.362+0000 7f2edd555640 1 -- 172.21.15.132:0/3837374438 >> 172.21.15.132:0/3837374438 conn(0x7f2ed806d710 msgr2=0x7f2ed806daf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:38.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.362+0000 7f2edd555640 1 -- 172.21.15.132:0/3837374438 shutdown_connections 2023-12-20T04:44:38.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.362+0000 7f2edd555640 1 -- 172.21.15.132:0/3837374438 wait complete. 2023-12-20T04:44:38.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.363+0000 7f2edd555640 1 Processor -- start 2023-12-20T04:44:38.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.363+0000 7f2edd555640 1 -- start start 2023-12-20T04:44:38.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.364+0000 7f2edd555640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed806fae0 0x7f2ed80afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:38.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.364+0000 7f2edd555640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ed80cd670 0x7f2ed8151490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:38.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.364+0000 7f2edd555640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ed815d470 0x7f2ed81e8b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:38.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.364+0000 7f2edd555640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed81525a0 con 0x7f2ed806fae0 2023-12-20T04:44:38.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.364+0000 7f2edd555640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed81e75c0 con 0x7f2ed815d470 2023-12-20T04:44:38.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.364+0000 7f2edd555640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed81e7000 con 0x7f2ed80cd670 2023-12-20T04:44:38.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.364+0000 7f2ed6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed806fae0 0x7f2ed80afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:38.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.364+0000 7f2ed6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed806fae0 0x7f2ed80afdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42274/0 (socket says 172.21.15.132:42274) 2023-12-20T04:44:38.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.364+0000 7f2ed6ffd640 1 -- 172.21.15.132:0/2258983875 learned_addr learned my addr 172.21.15.132:0/2258983875 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:38.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.364+0000 7f2ed6ffd640 1 -- 172.21.15.132:0/2258983875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ed80cd670 msgr2=0x7f2ed8151490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:38.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.364+0000 7f2ed6ffd640 1 --2- 172.21.15.132:0/2258983875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ed80cd670 0x7f2ed8151490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.364+0000 7f2ed6ffd640 1 -- 172.21.15.132:0/2258983875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ed815d470 msgr2=0x7f2ed81e8b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:38.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.364+0000 7f2ed6ffd640 1 --2- 172.21.15.132:0/2258983875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ed815d470 0x7f2ed81e8b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.364+0000 7f2ed6ffd640 1 -- 172.21.15.132:0/2258983875 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ecc009400 con 0x7f2ed806fae0 2023-12-20T04:44:38.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.365+0000 7f2ed6ffd640 1 --2- 172.21.15.132:0/2258983875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed806fae0 0x7f2ed80afdb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8009fa0 tx=0x7f2ec800d560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:38.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.365+0000 7f2ebf7fe640 1 -- 172.21.15.132:0/2258983875 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8003b90 con 0x7f2ed806fae0 2023-12-20T04:44:38.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.365+0000 7f2ebf7fe640 1 -- 172.21.15.132:0/2258983875 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2ec800f040 con 0x7f2ed806fae0 2023-12-20T04:44:38.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.365+0000 7f2edd555640 1 -- 172.21.15.132:0/2258983875 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed81e72e0 con 0x7f2ed806fae0 2023-12-20T04:44:38.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.365+0000 7f2ebf7fe640 1 -- 172.21.15.132:0/2258983875 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2ec8004030 con 0x7f2ed806fae0 2023-12-20T04:44:38.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.365+0000 7f2edd555640 1 -- 172.21.15.132:0/2258983875 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed80b1720 con 0x7f2ed806fae0 2023-12-20T04:44:38.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.366+0000 7f2edd555640 1 -- 172.21.15.132:0/2258983875 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed804e840 con 0x7f2ed806fae0 2023-12-20T04:44:38.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.366+0000 7f2ebf7fe640 1 -- 172.21.15.132:0/2258983875 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2ec8004190 con 0x7f2ed806fae0 2023-12-20T04:44:38.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.366+0000 7f2ebf7fe640 1 --2- 172.21.15.132:0/2258983875 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ec406a460 0x7f2ec406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:38.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.367+0000 7f2ebf7fe640 1 -- 172.21.15.132:0/2258983875 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2ec8088ad0 con 0x7f2ed806fae0 2023-12-20T04:44:38.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.367+0000 7f2ed67fc640 1 --2- 172.21.15.132:0/2258983875 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ec406a460 0x7f2ec406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:38.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.367+0000 7f2ebf7fe640 1 -- 172.21.15.132:0/2258983875 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7f2ec4072050 con 0x7f2ed806fae0 2023-12-20T04:44:38.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.367+0000 7f2ed67fc640 1 --2- 172.21.15.132:0/2258983875 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ec406a460 0x7f2ec406c920 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc036000 tx=0x7f2ecc030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:38.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.371+0000 7f2ebf7fe640 1 -- 172.21.15.132:0/2258983875 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2ec801a060 con 0x7f2ed806fae0 2023-12-20T04:44:38.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.536+0000 7f2edd555640 1 -- 172.21.15.132:0/2258983875 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f2ed806f8c0 con 0x7f2ed806fae0 2023-12-20T04:44:38.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.537+0000 7f2ebf7fe640 1 -- 172.21.15.132:0/2258983875 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v49) v1 ==== 81+0+34045 (secure 0 0 0) 0x7f2ec80541c0 con 0x7f2ed806fae0 2023-12-20T04:44:38.540 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:38.540 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:44:38.540 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 49, 2023-12-20T04:44:38.540 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:44:38.540 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:44:38.540 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:44:35.854703+0000", 2023-12-20T04:44:38.540 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:44:38.540 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:44:38.541 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:44:38.541 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:44:38.541 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:44:38.541 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:44:38.541 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:44:38.541 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:44:38.541 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:44:38.541 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:38.541 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:44:38.541 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:44:38.541 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:44:38.541 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:44:38.541 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:44:38.542 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 7, 2023-12-20T04:44:38.542 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:44:38.542 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:44:38.542 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "luminous", 2023-12-20T04:44:38.542 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:44:38.542 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:44:38.542 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:44:38.542 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.542 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:44:38.542 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:44:38.542 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:44:38.542 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:44:38.542 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:44:38.542 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:38.543 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:38.543 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:38.543 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:38.543 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:38.543 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:38.543 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:38.543 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:38.543 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:38.543 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:38.543 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:44:38.543 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:44:38.543 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:44:38.543 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:44:38.543 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:44:38.543 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:38.544 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:38.544 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:38.544 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:38.544 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:38.544 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:38.544 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:38.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.544 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "48", 2023-12-20T04:44:38.544 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:38.544 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:38.544 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:38.544 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:38.544 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:38.544 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:38.544 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:38.545 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:38.545 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:38.545 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:38.545 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:38.545 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:38.545 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:38.545 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:38.545 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:38.545 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:38.545 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:38.545 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:38.545 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:38.545 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:38.546 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:38.546 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:38.546 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:38.546 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:38.546 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:38.546 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:38.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.546 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:38.546 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:38.546 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:38.546 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:38.546 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:38.546 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:38.546 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:38.546 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:38.546 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:38.547 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:38.547 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:38.547 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:38.547 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:44:38.547 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:44:38.547 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.547 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:38.547 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:44:38.547 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.547 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:38.547 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:44:38.547 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:44:38.547 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:44:38.547 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:44:38.547 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:44:38.548 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:38.548 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:38.548 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:38.548 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.548 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.548 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.548 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 6, 2023-12-20T04:44:38.548 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:44:38.548 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:44:15.033177+0000", 2023-12-20T04:44:38.548 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:44:38.548 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:44:38.548 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:38.548 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:38.548 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:38.549 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:38.549 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:38.549 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:38.549 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:38.549 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:38.549 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:38.549 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:38.549 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:44:38.549 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:44:38.549 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:44:38.549 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:44:38.549 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:44:38.550 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:38.550 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:38.550 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:38.550 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:38.550 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:38.550 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:38.550 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:38.551 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.551 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "48", 2023-12-20T04:44:38.551 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:38.551 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:38.551 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:38.551 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:38.552 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:38.552 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:38.552 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:38.552 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:38.552 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:38.552 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:38.552 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:38.552 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:38.553 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:38.553 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:38.553 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:38.553 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:38.553 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:38.553 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:38.553 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:38.553 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:38.553 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:38.554 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:38.554 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:38.554 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:38.554 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:38.554 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:38.554 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.554 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:38.554 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:38.554 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:38.554 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:38.554 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:38.554 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:38.554 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:38.554 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:38.555 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:38.555 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:38.555 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:38.555 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:38.555 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:44:38.555 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:44:38.555 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:44:38.555 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.555 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:38.555 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:44:38.555 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:44:38.555 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.555 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.555 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:38.555 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:44:38.556 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:44:38.556 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:44:38.556 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:44:38.556 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:44:38.556 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:38.556 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:38.556 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:38.556 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.556 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.556 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.556 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 7, 2023-12-20T04:44:38.556 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:44:38.556 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:44:16.130594+0000", 2023-12-20T04:44:38.556 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:44:38.556 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:44:38.557 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:38.557 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:38.557 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:38.557 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:38.557 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:38.557 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:38.557 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:38.557 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:38.557 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:38.557 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:38.557 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:44:38.557 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:44:38.557 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:44:38.558 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:44:38.558 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:44:38.558 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:38.558 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:38.558 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:38.558 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:38.558 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:38.558 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:38.558 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:38.558 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.558 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "48", 2023-12-20T04:44:38.558 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:38.558 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:38.558 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:38.559 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:38.559 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:38.559 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:38.559 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:38.559 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:38.559 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:38.559 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:38.559 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:38.559 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:38.559 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:38.559 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:38.559 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:38.559 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:38.559 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:38.559 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:38.560 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:38.560 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:38.560 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:38.560 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:38.560 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:38.560 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:38.560 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:38.560 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:38.560 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.560 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:38.560 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:38.560 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:38.560 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:38.560 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:38.560 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:38.561 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:38.561 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:38.561 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:38.561 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:38.561 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:38.561 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:38.561 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:44:38.561 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:44:38.561 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.561 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:38.561 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:44:38.561 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:44:38.561 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.562 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.562 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:38.562 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:44:38.562 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:44:38.562 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:44:38.562 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:44:38.562 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:44:38.562 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:38.562 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:38.562 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:38.562 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.562 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.562 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:38.562 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:44:38.563 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.563 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:44:38.563 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:38.563 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:38.563 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:38.563 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:38.563 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:38.563 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:38.563 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:38.563 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:38.563 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:38.563 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:38.563 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:38.564 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:38.564 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.564 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.564 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.564 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:44:38.564 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:38.564 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.564 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.564 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.564 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:44:38.564 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:38.565 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.565 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.565 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.565 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:38.565 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.565 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.565 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.565 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:44:38.565 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:38.565 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.566 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.566 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.566 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:44:38.566 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:38.566 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.566 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.566 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.566 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:38.566 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.566 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.566 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.566 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:44:38.566 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:38.566 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.566 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:44:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:44:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.567 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:44:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:44:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:44:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:44:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:44:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:38.568 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:44:38.569 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:38.569 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.569 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.569 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.569 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:44:38.569 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:38.569 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:38.569 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:38.569 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:38.569 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:38.569 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:38.570 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:38.570 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:38.570 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:38.570 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:38.570 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:38.570 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:38.570 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.570 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.570 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.570 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:44:38.571 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:38.571 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.571 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.571 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.571 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:44:38.571 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:38.573 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.573 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.573 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.573 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:38.573 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.573 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.573 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.574 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:44:38.574 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:38.574 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.574 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.574 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.574 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:44:38.574 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:38.574 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.574 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.574 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.574 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:38.574 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.574 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.574 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.574 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:44:38.575 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:38.575 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.575 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.575 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.575 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:44:38.575 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:38.575 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.575 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.575 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.575 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:38.575 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.575 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.575 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.575 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:44:38.575 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:38.575 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.576 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.576 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.576 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:44:38.576 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:38.576 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.576 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.576 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.576 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:44:38.576 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:44:38.576 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:44:38.576 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:44:38.576 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:38.576 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:38.576 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:38.576 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.577 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.577 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.577 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:44:38.577 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:38.577 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:38.577 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:38.577 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:38.577 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:38.578 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:38.578 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:38.578 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:38.578 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:38.578 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:38.578 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:38.578 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:38.578 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.579 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.579 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:44:38.579 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:38.579 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.579 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.579 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:44:38.579 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:38.579 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.579 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.579 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.579 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:38.579 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.579 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.580 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.580 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:44:38.580 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:38.580 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.580 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.580 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.580 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:44:38.580 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:38.580 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.580 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.580 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.580 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:38.580 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.580 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.581 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.581 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:44:38.581 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:38.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.581 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.581 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.581 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:44:38.581 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:38.581 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.581 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.581 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.581 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:38.582 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.582 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.582 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.582 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:44:38.582 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:38.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.582 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.582 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.582 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:44:38.582 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:38.582 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.582 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.582 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.582 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:44:38.582 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:44:38.582 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:44:38.583 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:44:38.583 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:38.583 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:38.583 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:44:38.583 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:38.583 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.583 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.583 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.583 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:44:38.583 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:38.583 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:38.583 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:38.583 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:38.583 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:38.583 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:38.584 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:38.584 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:38.584 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:38.584 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:38.584 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:38.584 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:38.584 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.584 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.584 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:44:38.584 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:38.584 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.584 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.584 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.584 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:44:38.585 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:38.585 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.585 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.585 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.585 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:38.585 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.585 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.585 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.585 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:44:38.585 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:38.585 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.585 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.585 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.585 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:44:38.586 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:38.586 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.586 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.586 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:38.586 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.586 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.586 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:44:38.586 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:38.586 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.586 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.586 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.586 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:44:38.587 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:38.587 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.587 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.587 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:38.587 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.587 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.587 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:44:38.587 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:38.587 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.587 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.587 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.587 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:44:38.587 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:38.588 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.588 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.588 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:44:38.588 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:44:38.588 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:44:38.588 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:44:38.588 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:38.588 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull", 2023-12-20T04:44:38.588 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:38.588 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:38.588 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.588 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.588 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.588 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:44:38.589 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:38.589 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:38.589 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:38.589 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:38.589 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:38.589 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:38.589 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:38.589 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:38.589 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:38.589 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:38.589 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:38.589 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:38.589 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.590 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.590 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:44:38.590 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:38.590 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.590 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.590 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:44:38.590 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:38.590 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.591 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.591 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:38.591 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.591 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.591 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.591 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:44:38.591 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:38.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.591 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.591 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.591 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:44:38.591 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:38.591 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.592 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.592 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.592 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:38.592 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.592 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.592 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:44:38.592 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:38.592 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.592 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.592 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.592 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:44:38.592 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:38.592 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.592 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.593 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:38.593 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.593 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.593 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.593 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:44:38.593 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:38.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.593 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.593 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.593 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:44:38.593 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:38.593 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.593 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.594 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:44:38.594 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:44:38.594 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:44:38.594 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:44:38.594 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:38.594 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:38.594 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:38.594 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.594 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.594 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:44:38.594 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:38.594 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:38.595 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:38.595 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:38.595 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:38.595 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:38.595 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:38.595 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:38.595 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:38.595 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:38.595 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:38.595 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:38.595 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.595 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.595 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:44:38.595 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:38.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.596 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.596 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:44:38.596 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:38.596 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.596 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.596 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.596 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:38.596 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.596 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.596 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.596 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:44:38.596 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:38.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.597 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.597 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:44:38.597 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:38.597 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.597 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.597 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:38.597 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.597 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.597 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.597 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:44:38.597 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:38.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.598 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.598 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:44:38.598 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:38.598 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.598 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.598 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.598 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:38.598 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.598 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.598 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.598 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:44:38.598 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:38.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.599 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.599 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.599 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:44:38.599 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:38.599 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.599 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.599 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.599 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:44:38.599 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:44:38.599 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:44:38.599 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:44:38.599 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:38.600 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:38.600 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:38.600 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.600 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.600 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.600 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:44:38.600 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:38.600 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:38.600 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:38.600 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:38.600 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:38.600 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:38.600 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:38.600 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:38.600 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 48, 2023-12-20T04:44:38.601 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:38.601 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:38.601 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:38.601 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.601 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.601 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:44:38.601 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:38.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.601 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.601 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.601 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:44:38.601 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:38.602 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.602 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.602 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:38.602 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.602 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.602 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.602 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:44:38.602 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:38.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.602 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.602 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.602 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:44:38.602 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:38.603 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.603 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.603 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:38.603 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.603 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.603 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:44:38.603 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:38.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.603 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.603 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:44:38.603 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:38.603 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.604 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.604 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:38.604 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.604 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.604 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:44:38.604 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:38.604 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.604 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.604 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.604 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:44:38.604 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:38.604 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.605 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.605 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:44:38.605 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:44:38.605 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:44:38.605 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:44:38.605 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:38.605 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:38.605 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:44:38.605 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:38.605 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.605 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.606 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:44:38.606 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:38.606 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:38.606 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:38.606 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:38.606 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:38.606 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:38.606 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:38.606 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:38.606 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:38.606 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:38.607 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:38.607 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:38.607 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.607 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.607 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:44:38.607 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:38.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.607 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.607 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.607 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:44:38.607 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:38.607 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.608 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.608 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:38.608 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.608 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.608 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.608 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:44:38.608 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:38.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.608 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.608 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.608 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:44:38.608 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:38.608 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.609 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.609 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.609 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:38.609 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.609 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.609 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:44:38.609 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:38.609 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.609 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.609 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:44:38.609 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:38.609 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.610 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.610 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:38.610 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:38.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.610 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:38.610 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:44:38.610 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:38.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.610 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:38.610 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:44:38.610 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:38.610 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.611 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.611 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:44:38.611 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:44:38.611 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:44:38.611 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:44:38.611 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:38.611 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:38.611 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:44:38.611 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:38.611 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.611 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.611 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:38.611 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:44:38.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.612 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:44:38.612 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:38.612 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:38.612 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:38.612 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:38.612 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:38.612 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:44:38.612 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:38.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.612 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:44:38.612 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:38.612 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:38.612 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:38.613 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:38.613 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:38.613 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:44:38.613 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:38.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.613 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:44:38.613 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:38.613 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:38.613 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:38.613 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:38.613 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:38.613 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:44:38.613 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:38.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.614 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:44:38.614 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:38.614 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:38.614 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:38.614 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:38.614 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:38.614 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:44:38.614 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:38.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.614 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.614 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:44:38.614 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:38.615 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:38.615 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:38.615 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:38.615 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:38.615 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:44:38.615 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:38.615 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.615 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:44:38.615 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:38.615 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:38.615 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:38.615 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:38.615 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:38.615 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:44:38.616 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:38.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.616 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:44:38.616 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:38.616 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:38.616 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:38.616 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:38.616 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:38.616 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:44:38.616 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:38.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.616 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:44:38.616 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:38.617 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:38.617 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:38.617 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:38.617 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:38.617 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:44:38.617 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:38.617 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.617 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:38.617 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:44:38.617 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [ 2023-12-20T04:44:38.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.617 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "7.7", 2023-12-20T04:44:38.617 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:44:38.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.618 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 0, 2023-12-20T04:44:38.618 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 4 2023-12-20T04:44:38.618 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.618 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.618 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "7.30", 2023-12-20T04:44:38.618 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:44:38.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:38.618 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 0, 2023-12-20T04:44:38.618 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 5 2023-12-20T04:44:38.618 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.618 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:38.618 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.618 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:38.619 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:44:38.619 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:44:38.619 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:44:38.619 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:44:38.619 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:44:38.619 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:44:38.619 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:44:38.619 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:44:38.619 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:44:38.619 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:44:38.619 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:44:38.619 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:44:38.619 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:38.620 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:44:38.620 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:44:38.620 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:44:38.620 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:44:38.620 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:44:38.620 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:44:38.620 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:44:38.620 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:44:38.620 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:44:38.620 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:44:38.620 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:44:38.620 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:38.620 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:44:38.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.539+0000 7f2edd555640 1 -- 172.21.15.132:0/2258983875 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ec406a460 msgr2=0x7f2ec406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:38.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.539+0000 7f2edd555640 1 --2- 172.21.15.132:0/2258983875 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ec406a460 0x7f2ec406c920 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7f2ecc036000 tx=0x7f2ecc030000 comp rx=0 tx=0).stop 2023-12-20T04:44:38.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.539+0000 7f2edd555640 1 -- 172.21.15.132:0/2258983875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed806fae0 msgr2=0x7f2ed80afdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:38.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.539+0000 7f2edd555640 1 --2- 172.21.15.132:0/2258983875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed806fae0 0x7f2ed80afdb0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7f2ec8009fa0 tx=0x7f2ec800d560 comp rx=0 tx=0).stop 2023-12-20T04:44:38.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.539+0000 7f2edd555640 1 -- 172.21.15.132:0/2258983875 shutdown_connections 2023-12-20T04:44:38.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.539+0000 7f2edd555640 1 --2- 172.21.15.132:0/2258983875 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ec406a460 0x7f2ec406c920 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.539+0000 7f2edd555640 1 --2- 172.21.15.132:0/2258983875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2ed815d470 0x7f2ed81e8b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.539+0000 7f2edd555640 1 --2- 172.21.15.132:0/2258983875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2ed80cd670 0x7f2ed8151490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.539+0000 7f2edd555640 1 --2- 172.21.15.132:0/2258983875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2ed806fae0 0x7f2ed80afdb0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.539+0000 7f2edd555640 1 -- 172.21.15.132:0/2258983875 >> 172.21.15.132:0/2258983875 conn(0x7f2ed806d710 msgr2=0x7f2ed815aa60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:38.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.539+0000 7f2edd555640 1 -- 172.21.15.132:0/2258983875 shutdown_connections 2023-12-20T04:44:38.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.539+0000 7f2edd555640 1 -- 172.21.15.132:0/2258983875 wait complete. 2023-12-20T04:44:38.623 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:44:38.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.722+0000 7f33dd64d640 1 Processor -- start 2023-12-20T04:44:38.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.722+0000 7f33dd64d640 1 -- start start 2023-12-20T04:44:38.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.722+0000 7f33dd64d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33d8160ba0 0x7f33d80cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:38.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.722+0000 7f33dd64d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d8161ff0 con 0x7f33d80ce2a0 2023-12-20T04:44:38.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.722+0000 7f33dd64d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33d806ff00 con 0x7f33d80d0010 2023-12-20T04:44:38.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.722+0000 7f33dd64d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33d80cca40 con 0x7f33d8160ba0 2023-12-20T04:44:38.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.723+0000 7f33d6ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33d8160ba0 0x7f33d80cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:38.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.723+0000 7f33cffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f33d80ce2a0 0x7f33d806f0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46976/0 (socket says 172.21.15.132:46976) 2023-12-20T04:44:38.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.723+0000 7f33cffff640 1 -- 172.21.15.132:0/651771146 learned_addr learned my addr 172.21.15.132:0/651771146 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:38.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.723+0000 7f33d6ffd640 1 -- 172.21.15.132:0/651771146 >> v1:172.21.15.187:6789/0 conn(0x7f33d80d0010 legacy=0x7f33d806f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:38.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.723+0000 7f33d6ffd640 1 -- 172.21.15.132:0/651771146 >> v1:172.21.15.132:6789/0 conn(0x7f33d80ce2a0 legacy=0x7f33d806f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:38.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.723+0000 7f33d67fc640 1 -- 172.21.15.132:0/651771146 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2310849825 0 0) 0x7f33d8161ff0 con 0x7f33d80ce2a0 2023-12-20T04:44:38.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.723+0000 7f33d6ffd640 1 -- 172.21.15.132:0/651771146 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d81613e0 con 0x7f33d8160ba0 2023-12-20T04:44:38.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.724+0000 7f33d6ffd640 1 --2- 172.21.15.132:0/651771146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33d8160ba0 0x7f33d80cb380 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f33c80097a0 tx=0x7f33c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4223f20e8342ae22 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:38.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.724+0000 7f33d67fc640 1 -- 172.21.15.132:0/651771146 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c8031830 con 0x7f33d8160ba0 2023-12-20T04:44:38.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.724+0000 7f33d67fc640 1 -- 172.21.15.132:0/651771146 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c8031990 con 0x7f33d8160ba0 2023-12-20T04:44:38.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.724+0000 7f33d67fc640 1 -- 172.21.15.132:0/651771146 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c8031d20 con 0x7f33d8160ba0 2023-12-20T04:44:38.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.724+0000 7f33dd64d640 1 -- 172.21.15.132:0/651771146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33d8160ba0 msgr2=0x7f33d80cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:38.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.724+0000 7f33dd64d640 1 --2- 172.21.15.132:0/651771146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33d8160ba0 0x7f33d80cb380 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f33c80097a0 tx=0x7f33c802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.724+0000 7f33dd64d640 1 -- 172.21.15.132:0/651771146 shutdown_connections 2023-12-20T04:44:38.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.724+0000 7f33dd64d640 1 --2- 172.21.15.132:0/651771146 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33d8160ba0 0x7f33d80cb380 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.724+0000 7f33dd64d640 1 -- 172.21.15.132:0/651771146 >> 172.21.15.132:0/651771146 conn(0x7f33d80cd7b0 msgr2=0x7f33d80cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:38.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.724+0000 7f33dd64d640 1 -- 172.21.15.132:0/651771146 shutdown_connections 2023-12-20T04:44:38.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.724+0000 7f33dd64d640 1 -- 172.21.15.132:0/651771146 wait complete. 2023-12-20T04:44:38.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.726+0000 7f33dd64d640 1 Processor -- start 2023-12-20T04:44:38.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.726+0000 7f33dd64d640 1 -- start start 2023-12-20T04:44:38.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.726+0000 7f33dd64d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33d80ce2a0 0x7f33d8156290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:38.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.726+0000 7f33dd64d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33d80d0010 0x7f33d80b26d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:38.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.726+0000 7f33dd64d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33d8160ba0 0x7f33d80b2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:38.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.726+0000 7f33dd64d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d80ad930 con 0x7f33d80ce2a0 2023-12-20T04:44:38.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.726+0000 7f33dd64d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d81567d0 con 0x7f33d80d0010 2023-12-20T04:44:38.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.726+0000 7f33dd64d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d815ca90 con 0x7f33d8160ba0 2023-12-20T04:44:38.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.726+0000 7f33d6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33d80ce2a0 0x7f33d8156290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:38.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.726+0000 7f33d6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33d80ce2a0 0x7f33d8156290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42296/0 (socket says 172.21.15.132:42296) 2023-12-20T04:44:38.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.726+0000 7f33d6ffd640 1 -- 172.21.15.132:0/181416137 learned_addr learned my addr 172.21.15.132:0/181416137 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:38.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.727+0000 7f33d6ffd640 1 -- 172.21.15.132:0/181416137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33d8160ba0 msgr2=0x7f33d80b2c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:38.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.727+0000 7f33d6ffd640 1 --2- 172.21.15.132:0/181416137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33d8160ba0 0x7f33d80b2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.727+0000 7f33d6ffd640 1 -- 172.21.15.132:0/181416137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33d80d0010 msgr2=0x7f33d80b26d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:38.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.727+0000 7f33d6ffd640 1 --2- 172.21.15.132:0/181416137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33d80d0010 0x7f33d80b26d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.727+0000 7f33d6ffd640 1 -- 172.21.15.132:0/181416137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33c8009400 con 0x7f33d80ce2a0 2023-12-20T04:44:38.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.727+0000 7f33d6ffd640 1 --2- 172.21.15.132:0/181416137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33d80ce2a0 0x7f33d8156290 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f33c8000c00 tx=0x7f33c80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:38.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.727+0000 7f33cf7fe640 1 -- 172.21.15.132:0/181416137 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c803aa60 con 0x7f33d80ce2a0 2023-12-20T04:44:38.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.727+0000 7f33cf7fe640 1 -- 172.21.15.132:0/181416137 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33c803abc0 con 0x7f33d80ce2a0 2023-12-20T04:44:38.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.727+0000 7f33dd64d640 1 -- 172.21.15.132:0/181416137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33d815cd70 con 0x7f33d80ce2a0 2023-12-20T04:44:38.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.727+0000 7f33cf7fe640 1 -- 172.21.15.132:0/181416137 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33c80443f0 con 0x7f33d80ce2a0 2023-12-20T04:44:38.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.727+0000 7f33dd64d640 1 -- 172.21.15.132:0/181416137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33d815d330 con 0x7f33d80ce2a0 2023-12-20T04:44:38.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.728+0000 7f33dd64d640 1 -- 172.21.15.132:0/181416137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33d80adaa0 con 0x7f33d80ce2a0 2023-12-20T04:44:38.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.728+0000 7f33cf7fe640 1 -- 172.21.15.132:0/181416137 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f33c804d450 con 0x7f33d80ce2a0 2023-12-20T04:44:38.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.729+0000 7f33cf7fe640 1 --2- 172.21.15.132:0/181416137 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33b806a430 0x7f33b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:38.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.729+0000 7f33cf7fe640 1 -- 172.21.15.132:0/181416137 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f33c80aaaa0 con 0x7f33d80ce2a0 2023-12-20T04:44:38.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.729+0000 7f33cffff640 1 --2- 172.21.15.132:0/181416137 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33b806a430 0x7f33b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:38.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.729+0000 7f33cf7fe640 1 -- 172.21.15.132:0/181416137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7f33b8072020 con 0x7f33d80ce2a0 2023-12-20T04:44:38.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.729+0000 7f33cffff640 1 --2- 172.21.15.132:0/181416137 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33b806a430 0x7f33b806c8f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f33c0000c00 tx=0x7f33c00079c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:38.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.733+0000 7f33cf7fe640 1 -- 172.21.15.132:0/181416137 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f33c8035020 con 0x7f33d80ce2a0 2023-12-20T04:44:38.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.933+0000 7f33dd64d640 1 -- 172.21.15.132:0/181416137 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f33d804e840 con 0x7f33d80ce2a0 2023-12-20T04:44:38.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.934+0000 7f33cf7fe640 1 -- 172.21.15.132:0/181416137 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4721 (secure 0 0 0) 0x7f33c8076200 con 0x7f33d80ce2a0 2023-12-20T04:44:38.936 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:38.936 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1456944733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1456944733},{"type":"v1","addr":"172.21.15.187:6834","nonce":1456944733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2114954856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2114954856},{"type":"v1","addr":"172.21.15.187:6835","nonce":2114954856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2494230497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2494230497},{"type":"v1","addr":"172.21.15.132:6837","nonce":2494230497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:44:17.197194+0000","modified":"2023-12-20T04:44:19.205156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/1024674556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1024674556},{"type":"v1","addr":"172.21.15.132:6836","nonce":1024674556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-20T04:44:38.937 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 19 2023-12-20T04:44:38.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.936+0000 7f33dd64d640 1 -- 172.21.15.132:0/181416137 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33b806a430 msgr2=0x7f33b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:38.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.936+0000 7f33dd64d640 1 --2- 172.21.15.132:0/181416137 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33b806a430 0x7f33b806c8f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7f33c0000c00 tx=0x7f33c00079c0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.936+0000 7f33dd64d640 1 -- 172.21.15.132:0/181416137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33d80ce2a0 msgr2=0x7f33d8156290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:38.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.936+0000 7f33dd64d640 1 --2- 172.21.15.132:0/181416137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33d80ce2a0 0x7f33d8156290 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f33c8000c00 tx=0x7f33c80046c0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.936+0000 7f33dd64d640 1 -- 172.21.15.132:0/181416137 shutdown_connections 2023-12-20T04:44:38.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.936+0000 7f33dd64d640 1 --2- 172.21.15.132:0/181416137 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33b806a430 0x7f33b806c8f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.936+0000 7f33dd64d640 1 --2- 172.21.15.132:0/181416137 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33d8160ba0 0x7f33d80b2c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.936+0000 7f33dd64d640 1 --2- 172.21.15.132:0/181416137 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33d80d0010 0x7f33d80b26d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.936+0000 7f33dd64d640 1 --2- 172.21.15.132:0/181416137 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33d80ce2a0 0x7f33d8156290 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:38.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.936+0000 7f33dd64d640 1 -- 172.21.15.132:0/181416137 >> 172.21.15.132:0/181416137 conn(0x7f33d80cd7b0 msgr2=0x7f33d806c4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:38.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.936+0000 7f33dd64d640 1 -- 172.21.15.132:0/181416137 shutdown_connections 2023-12-20T04:44:38.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:38.936+0000 7f33dd64d640 1 -- 172.21.15.132:0/181416137 wait complete. 2023-12-20T04:44:38.949 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-20T04:44:39.063 INFO:teuthology.orchestra.run.smithi132.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":5685,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":21.85465507,"mdsmap_epoch":19,"osdmap_epoch":49,"osdmap_epoch_barrier":47,"uptime":26.618346003999999} 2023-12-20T04:44:39.063 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 5685, "mdsmap_epoch": 19, "osdmap_epoch": 49, "osdmap_epoch_barrier": 47, "rank_uptime": 21.85465507, "state": "up:active", "uptime": 26.618346004, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:44:39.063 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-20T04:44:39.063 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:44:39.063 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:44:39.079 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:39.079 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-12-20T04:44:39.135 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:2023-12-20T04:44:39.133+0000 7f577cff9640 -1 client.5874 handle_client_reply no pending request on tid 14 safe is:1 2023-12-20T04:44:39.135 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:44:39.136 INFO:teuthology.orchestra.run.smithi132.stderr:dd: failed to open 'small_file_1': Permission denied 2023-12-20T04:44:39.136 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:39.136 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-20T04:44:39.208 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:39.209 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-20T04:44:39.268 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:44:39.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.407+0000 7fa6c6a84640 1 Processor -- start 2023-12-20T04:44:39.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.407+0000 7fa6c6a84640 1 -- start start 2023-12-20T04:44:39.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.408+0000 7fa6c6a84640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa6c00caa90 0x7fa6c00caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:39.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.408+0000 7fa6c6a84640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c015e4c0 con 0x7fa6c006cc30 2023-12-20T04:44:39.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.408+0000 7fa6c6a84640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6c015e7a0 con 0x7fa6c0159d00 2023-12-20T04:44:39.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.408+0000 7fa6c6a84640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6c006c220 con 0x7fa6c00caa90 2023-12-20T04:44:39.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.408+0000 7fa6bffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa6c00caa90 0x7fa6c00caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:39.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.408+0000 7fa6c5021640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa6c006cc30 0x7fa6c006dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46992/0 (socket says 172.21.15.132:46992) 2023-12-20T04:44:39.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.408+0000 7fa6c5021640 1 -- 172.21.15.132:0/218859014 learned_addr learned my addr 172.21.15.132:0/218859014 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:39.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.408+0000 7fa6bffff640 1 -- 172.21.15.132:0/218859014 >> v1:172.21.15.187:6789/0 conn(0x7fa6c0159d00 legacy=0x7fa6c015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:39.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.408+0000 7fa6bffff640 1 -- 172.21.15.132:0/218859014 >> v1:172.21.15.132:6789/0 conn(0x7fa6c006cc30 legacy=0x7fa6c006dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:39.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.408+0000 7fa6bffff640 1 -- 172.21.15.132:0/218859014 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6c006c430 con 0x7fa6c00caa90 2023-12-20T04:44:39.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.409+0000 7fa6bffff640 1 --2- 172.21.15.132:0/218859014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6c00caa90 0x7fa6c00caf20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac0097a0 tx=0x7fa6ac02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44170e0bfadb7fe9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:39.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.409+0000 7fa6bf7fe640 1 -- 172.21.15.132:0/218859014 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac031830 con 0x7fa6c00caa90 2023-12-20T04:44:39.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.409+0000 7fa6bf7fe640 1 -- 172.21.15.132:0/218859014 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ac031990 con 0x7fa6c00caa90 2023-12-20T04:44:39.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.409+0000 7fa6bf7fe640 1 -- 172.21.15.132:0/218859014 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac031d20 con 0x7fa6c00caa90 2023-12-20T04:44:39.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.410+0000 7fa6c6a84640 1 -- 172.21.15.132:0/218859014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6c00caa90 msgr2=0x7fa6c00caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:39.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.410+0000 7fa6c6a84640 1 --2- 172.21.15.132:0/218859014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6c00caa90 0x7fa6c00caf20 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac0097a0 tx=0x7fa6ac02b8d0 comp rx=0 tx=0).stop 2023-12-20T04:44:39.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.410+0000 7fa6c6a84640 1 -- 172.21.15.132:0/218859014 shutdown_connections 2023-12-20T04:44:39.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.410+0000 7fa6c6a84640 1 --2- 172.21.15.132:0/218859014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6c00caa90 0x7fa6c00caf20 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:39.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.410+0000 7fa6c6a84640 1 -- 172.21.15.132:0/218859014 >> 172.21.15.132:0/218859014 conn(0x7fa6c00cfca0 msgr2=0x7fa6c00d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:39.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.410+0000 7fa6c6a84640 1 -- 172.21.15.132:0/218859014 shutdown_connections 2023-12-20T04:44:39.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.410+0000 7fa6c6a84640 1 -- 172.21.15.132:0/218859014 wait complete. 2023-12-20T04:44:39.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.411+0000 7fa6c6a84640 1 Processor -- start 2023-12-20T04:44:39.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.411+0000 7fa6c6a84640 1 -- start start 2023-12-20T04:44:39.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6c6a84640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6c006cc30 0x7fa6c0155d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:39.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6c6a84640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6c00caa90 0x7fa6c01562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:39.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6c6a84640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6c0159d00 0x7fa6c00b4780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:39.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6c6a84640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c01572f0 con 0x7fa6c00caa90 2023-12-20T04:44:39.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6c6a84640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c01578b0 con 0x7fa6c006cc30 2023-12-20T04:44:39.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6c6a84640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa6c00b5570 con 0x7fa6c0159d00 2023-12-20T04:44:39.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6bffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6c00caa90 0x7fa6c01562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:39.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6bffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6c00caa90 0x7fa6c01562c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42314/0 (socket says 172.21.15.132:42314) 2023-12-20T04:44:39.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6bffff640 1 -- 172.21.15.132:0/71193314 learned_addr learned my addr 172.21.15.132:0/71193314 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:39.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6c4820640 1 --2- 172.21.15.132:0/71193314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6c006cc30 0x7fa6c0155d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:39.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6c5021640 1 --2- 172.21.15.132:0/71193314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6c0159d00 0x7fa6c00b4780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:39.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6bffff640 1 -- 172.21.15.132:0/71193314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6c0159d00 msgr2=0x7fa6c00b4780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:39.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6bffff640 1 --2- 172.21.15.132:0/71193314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6c0159d00 0x7fa6c00b4780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:39.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6bffff640 1 -- 172.21.15.132:0/71193314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6c006cc30 msgr2=0x7fa6c0155d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:39.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6bffff640 1 --2- 172.21.15.132:0/71193314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6c006cc30 0x7fa6c0155d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:39.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6bffff640 1 -- 172.21.15.132:0/71193314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6ac009400 con 0x7fa6c00caa90 2023-12-20T04:44:39.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6bffff640 1 --2- 172.21.15.132:0/71193314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6c00caa90 0x7fa6c01562c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac02bee0 tx=0x7fa6ac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:39.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.412+0000 7fa6bd7fa640 1 -- 172.21.15.132:0/71193314 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac03ba70 con 0x7fa6c00caa90 2023-12-20T04:44:39.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.413+0000 7fa6bd7fa640 1 -- 172.21.15.132:0/71193314 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6ac03bbf0 con 0x7fa6c00caa90 2023-12-20T04:44:39.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.413+0000 7fa6c6a84640 1 -- 172.21.15.132:0/71193314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6c00b5850 con 0x7fa6c00caa90 2023-12-20T04:44:39.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.413+0000 7fa6bd7fa640 1 -- 172.21.15.132:0/71193314 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa6ac0433f0 con 0x7fa6c00caa90 2023-12-20T04:44:39.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.413+0000 7fa6c6a84640 1 -- 172.21.15.132:0/71193314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6c014f880 con 0x7fa6c00caa90 2023-12-20T04:44:39.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.414+0000 7fa6c6a84640 1 -- 172.21.15.132:0/71193314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa6c004e840 con 0x7fa6c00caa90 2023-12-20T04:44:39.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.414+0000 7fa6bd7fa640 1 -- 172.21.15.132:0/71193314 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa6ac04c3b0 con 0x7fa6c00caa90 2023-12-20T04:44:39.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.414+0000 7fa6bd7fa640 1 --2- 172.21.15.132:0/71193314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa6a406a460 0x7fa6a406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:39.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.415+0000 7fa6c4820640 1 --2- 172.21.15.132:0/71193314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa6a406a460 0x7fa6a406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:39.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.415+0000 7fa6bd7fa640 1 -- 172.21.15.132:0/71193314 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fa6ac0aa860 con 0x7fa6c00caa90 2023-12-20T04:44:39.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.415+0000 7fa6bd7fa640 1 -- 172.21.15.132:0/71193314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=50}) v3 -- 0x7fa6a4072050 con 0x7fa6c00caa90 2023-12-20T04:44:39.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.415+0000 7fa6c4820640 1 --2- 172.21.15.132:0/71193314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa6a406a460 0x7fa6a406c920 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400a750 tx=0x7fa6b4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:39.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.419+0000 7fa6bd7fa640 1 -- 172.21.15.132:0/71193314 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa6ac035060 con 0x7fa6c00caa90 2023-12-20T04:44:39.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.584+0000 7fa6c6a84640 1 -- 172.21.15.132:0/71193314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa6c015d3c0 con 0x7fa6c00caa90 2023-12-20T04:44:39.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.585+0000 7fa6bd7fa640 1 -- 172.21.15.132:0/71193314 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v49) v1 ==== 81+0+34045 (secure 0 0 0) 0x7fa6ac048030 con 0x7fa6c00caa90 2023-12-20T04:44:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:39.588 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:44:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 49, 2023-12-20T04:44:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:44:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:44:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:44:35.854703+0000", 2023-12-20T04:44:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:44:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:44:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:44:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:44:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:44:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:44:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:44:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:44:39.588 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:44:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:44:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:44:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:44:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:44:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:44:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 7, 2023-12-20T04:44:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:44:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:44:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "luminous", 2023-12-20T04:44:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:44:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:44:39.589 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:44:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:44:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:44:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:44:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:44:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:44:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:39.590 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:44:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:44:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:44:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:44:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:44:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:39.591 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.592 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "48", 2023-12-20T04:44:39.592 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:39.592 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:39.592 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:39.592 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:39.592 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:39.592 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:39.592 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:39.592 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:39.592 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:39.592 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:39.592 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:39.592 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:39.592 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:39.592 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:39.593 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:39.593 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:39.593 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:39.593 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:39.593 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:39.593 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:39.593 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:39.593 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:39.593 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:39.593 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:39.593 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:39.593 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:39.593 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.593 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:39.594 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:39.594 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:39.594 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:39.594 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:39.594 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:39.594 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:39.594 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:39.594 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:39.594 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:39.594 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:39.594 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:39.594 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:44:39.594 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:44:39.594 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.594 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:39.595 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:44:39.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.595 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:39.595 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:44:39.595 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:44:39.595 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:44:39.595 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:44:39.595 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:44:39.595 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:39.595 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:39.595 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:39.595 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.595 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.595 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.595 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 6, 2023-12-20T04:44:39.596 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:44:39.596 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:44:15.033177+0000", 2023-12-20T04:44:39.596 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:44:39.596 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:44:39.596 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:39.596 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:39.596 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:39.596 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:39.596 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:39.596 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:39.596 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:39.596 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:39.596 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:39.596 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:39.597 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:44:39.597 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:44:39.597 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:44:39.597 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:44:39.597 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:44:39.597 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:39.597 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:39.597 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:39.597 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:39.597 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:39.597 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:39.597 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:39.597 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.597 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "48", 2023-12-20T04:44:39.597 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:39.598 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:39.598 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:39.598 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:39.598 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:39.598 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:39.598 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:39.598 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:39.598 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:39.598 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:39.598 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:39.598 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:39.598 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:39.598 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:39.598 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:39.598 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:39.599 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:39.599 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:39.600 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:39.600 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:39.600 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:39.600 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:39.600 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:39.601 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:39.601 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:39.601 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:39.601 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.601 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:39.601 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:39.601 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:39.601 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:39.601 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:39.601 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:39.601 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:39.601 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:39.601 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:39.601 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:39.602 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:39.602 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:39.602 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:44:39.602 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:44:39.602 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:44:39.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.602 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:39.602 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:44:39.602 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:44:39.602 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.602 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.602 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:39.602 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:44:39.602 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:44:39.602 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:44:39.603 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:44:39.603 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:44:39.603 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:39.603 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:39.603 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:39.603 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.603 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.603 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.603 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 7, 2023-12-20T04:44:39.603 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:44:39.603 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:44:16.130594+0000", 2023-12-20T04:44:39.603 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:44:39.603 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:44:39.603 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:39.603 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:39.604 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:39.604 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:39.604 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:39.604 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:39.604 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:39.604 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:39.604 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:39.604 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:39.604 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:44:39.604 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:44:39.604 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:44:39.604 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:44:39.604 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:44:39.604 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:39.605 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:39.605 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:39.605 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:39.605 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:39.605 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:39.605 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:39.605 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.605 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "48", 2023-12-20T04:44:39.605 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:39.605 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:39.605 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:39.605 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:39.605 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:39.606 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:39.606 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:39.606 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:39.606 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:39.606 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:39.606 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:39.606 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:39.606 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:39.606 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:39.606 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:39.606 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:39.606 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:39.606 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:39.606 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:39.606 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:39.606 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:39.607 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:39.607 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:39.607 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:39.607 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:39.607 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:39.607 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.607 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:39.607 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:39.607 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:39.607 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:39.607 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:39.607 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:39.607 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:39.607 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:39.607 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:39.608 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:39.608 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:39.608 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:39.608 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:44:39.608 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:44:39.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.608 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:39.608 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:44:39.608 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:44:39.608 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.608 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.608 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:39.608 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:44:39.608 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:44:39.608 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:44:39.609 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:44:39.609 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:44:39.609 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:39.609 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:39.609 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:39.609 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.609 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.609 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:39.609 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:44:39.609 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.609 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:44:39.609 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:39.609 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:39.609 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:39.609 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:39.610 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:39.610 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:39.610 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:39.610 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:39.610 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:39.610 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:39.610 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:39.610 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:39.610 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.610 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.610 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:44:39.610 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:39.610 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.610 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.611 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.611 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:44:39.611 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:39.611 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.611 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.611 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:39.611 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.611 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.611 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:44:39.611 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:39.611 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.611 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.611 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.612 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:44:39.612 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:39.612 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.612 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.612 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:39.612 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.612 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.612 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:44:39.612 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:39.612 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.612 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.612 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.612 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:44:39.613 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:39.613 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.613 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.613 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:39.613 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.613 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.613 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:44:39.613 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:39.613 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.613 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.613 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.613 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:44:39.614 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:39.614 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.614 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.614 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:44:39.614 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:44:39.614 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:44:39.614 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:44:39.614 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:39.614 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:39.614 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:44:39.614 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:39.614 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.614 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.615 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.615 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:44:39.615 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:39.615 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:39.615 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:39.615 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:39.615 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:39.615 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:39.615 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:39.615 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:39.615 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:39.615 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:39.615 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:39.615 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:39.615 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.616 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.616 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:44:39.616 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:39.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.616 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.616 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:44:39.616 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:39.616 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.616 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.616 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.616 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:39.616 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.616 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.617 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.617 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:44:39.617 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:39.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.617 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.617 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:44:39.617 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:39.617 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.617 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.617 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.617 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:39.617 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.617 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.618 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.618 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:44:39.618 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:39.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.618 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.618 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:44:39.618 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:39.618 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.618 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.618 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.618 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:39.618 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.618 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.618 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.619 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:44:39.619 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:39.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.619 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.619 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.619 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:44:39.619 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:39.619 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.619 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.619 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.619 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:44:39.619 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:44:39.619 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:44:39.620 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:44:39.620 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:39.620 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:39.620 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:39.620 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.620 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.620 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.620 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:44:39.620 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:39.620 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:39.620 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:39.620 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:39.620 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:39.620 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:39.621 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:39.621 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:39.621 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:39.621 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:39.621 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:39.621 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:39.621 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.621 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.621 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:44:39.621 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:39.621 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.621 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.621 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.622 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:44:39.622 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:39.622 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.622 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.622 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:39.622 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.622 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.622 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:44:39.622 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:39.622 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.622 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.622 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.622 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:44:39.622 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:39.623 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.623 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.623 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:39.623 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.623 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.623 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:44:39.623 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:39.623 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.623 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.623 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.623 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:44:39.623 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:39.623 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.624 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.624 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:39.624 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.624 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.624 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:44:39.624 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:39.624 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.624 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.624 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.624 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:44:39.624 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:39.624 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.624 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.625 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:44:39.625 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:44:39.625 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:44:39.625 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:44:39.625 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:39.625 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:39.625 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:44:39.625 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:39.625 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.625 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.625 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.625 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:44:39.625 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:39.626 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:39.626 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:39.626 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:39.626 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:39.626 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:39.626 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:39.626 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:39.626 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:39.626 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:39.626 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:39.626 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:39.626 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.626 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.626 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.627 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:44:39.627 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:39.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.627 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.627 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:44:39.627 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:39.627 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.627 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.627 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.627 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:39.627 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.627 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.627 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.627 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:44:39.628 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:39.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.628 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.628 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:44:39.628 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:39.628 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.628 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.628 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:39.628 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.628 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.628 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.628 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:44:39.628 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:39.628 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.629 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.629 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:44:39.629 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:39.629 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.629 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.629 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:39.629 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.629 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.629 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.629 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:44:39.629 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:39.629 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.630 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.630 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.630 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:44:39.630 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:39.630 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.630 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.630 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.630 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:44:39.630 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:44:39.630 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:44:39.630 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:44:39.630 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:39.630 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull", 2023-12-20T04:44:39.630 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:39.630 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:39.631 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.631 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.631 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.631 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:44:39.631 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:39.631 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:39.631 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:39.631 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:39.631 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:39.631 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:39.631 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:39.631 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:39.631 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:39.631 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:39.632 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:39.632 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:39.632 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.632 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.632 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:44:39.632 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:39.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.632 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.632 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.632 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:44:39.632 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:39.632 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.632 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.633 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:39.633 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.633 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.633 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:44:39.633 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:39.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.633 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.633 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.633 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:44:39.633 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:39.633 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.634 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.634 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:39.634 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.634 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.634 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:44:39.634 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:39.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.634 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.634 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.634 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:44:39.634 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:39.634 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.634 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.635 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:39.635 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.635 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.635 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:44:39.635 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:39.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.635 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.635 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.635 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:44:39.635 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:39.635 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.635 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.636 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:44:39.636 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:44:39.636 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:44:39.636 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:44:39.636 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:39.636 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:39.636 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:39.636 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.636 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.636 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:44:39.636 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:39.636 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:39.636 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:39.637 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:39.637 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:39.637 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:39.637 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:39.637 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:39.637 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:39.637 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:39.637 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:39.637 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:39.637 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.637 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.637 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.637 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:44:39.637 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:39.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.638 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.638 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:44:39.638 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:39.638 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.638 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.638 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:39.638 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.638 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.638 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.638 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:44:39.638 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:39.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.639 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.639 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:44:39.639 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:39.639 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.639 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.639 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.639 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:39.639 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.639 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.639 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.639 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:44:39.640 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:39.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.640 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.640 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:44:39.640 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:39.640 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.640 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.640 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:39.640 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.640 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.640 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.640 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:44:39.641 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:39.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.641 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.641 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.641 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:44:39.641 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:39.641 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.641 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.641 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:44:39.641 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:44:39.641 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:44:39.641 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:44:39.641 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:39.641 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:39.642 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:39.642 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.642 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:44:39.642 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:39.642 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:39.642 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:39.642 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:39.642 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:39.642 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:39.642 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:39.642 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:39.642 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 48, 2023-12-20T04:44:39.642 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:39.643 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:39.643 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:39.643 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.643 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.643 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:44:39.643 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:39.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.643 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.643 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.643 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:44:39.643 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:39.643 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.643 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.643 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.644 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:39.644 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.644 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.644 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:44:39.644 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:39.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.644 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.644 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.644 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:44:39.644 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:39.644 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.644 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.644 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:39.645 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.645 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.645 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:44:39.645 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:39.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.645 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.645 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:44:39.645 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:39.645 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.645 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.645 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.645 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:39.645 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.646 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.646 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:44:39.646 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:39.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.646 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.646 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.646 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:44:39.646 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:39.646 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.646 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.646 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:44:39.646 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:44:39.646 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:44:39.647 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:44:39.647 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:39.647 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:39.647 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:44:39.647 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:39.647 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.647 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.647 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:44:39.647 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:39.647 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:39.647 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:39.647 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:39.647 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:39.647 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:39.648 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:39.648 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:39.648 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:39.648 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:39.648 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:39.648 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:39.648 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.648 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.648 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:44:39.648 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:39.648 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.648 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.648 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:44:39.649 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:39.649 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.649 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.649 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:39.649 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.649 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.649 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:44:39.649 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:39.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.649 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.649 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:44:39.649 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:39.650 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.650 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.650 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:39.650 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.650 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.650 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:44:39.650 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:39.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.650 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.650 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:44:39.650 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:39.650 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.651 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.651 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:39.651 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:39.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.651 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:39.651 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:44:39.651 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:39.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.651 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:39.651 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:44:39.651 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:39.651 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.652 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.652 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:44:39.652 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:44:39.652 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:44:39.652 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:44:39.652 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:39.652 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:39.652 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:44:39.652 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:39.652 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.652 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.652 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:39.652 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:44:39.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.653 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:44:39.653 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:39.653 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:39.653 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:39.653 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:39.653 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:39.653 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:44:39.653 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:39.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.653 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.653 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:44:39.653 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:39.653 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:39.653 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:39.653 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:39.654 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:39.654 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:44:39.654 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:39.654 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.654 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.654 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:44:39.654 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:39.654 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:39.654 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:39.654 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:39.654 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:39.654 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:44:39.654 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:39.654 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.655 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:44:39.655 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:39.655 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:39.655 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:39.655 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:39.655 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:39.655 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:44:39.655 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:39.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.655 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:44:39.655 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:39.655 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:39.656 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:39.656 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:39.656 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:39.656 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:44:39.656 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:39.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.656 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:44:39.656 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:39.656 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:39.656 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:39.656 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:39.656 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:39.656 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:44:39.657 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:39.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.657 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:44:39.657 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:39.657 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:39.657 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:39.657 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:39.657 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:39.657 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:44:39.657 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:39.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.658 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:44:39.658 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:39.658 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:39.658 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:39.658 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:39.658 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:39.658 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:44:39.658 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:39.658 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.658 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:39.658 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:44:39.658 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [ 2023-12-20T04:44:39.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.658 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "7.7", 2023-12-20T04:44:39.658 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:44:39.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.659 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 0, 2023-12-20T04:44:39.659 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 4 2023-12-20T04:44:39.659 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.659 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.659 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "7.30", 2023-12-20T04:44:39.659 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:44:39.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:39.659 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 0, 2023-12-20T04:44:39.659 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 5 2023-12-20T04:44:39.659 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.659 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:39.660 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.660 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:39.660 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:44:39.660 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:44:39.660 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:44:39.660 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:44:39.660 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:44:39.660 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:44:39.660 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:44:39.660 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:44:39.660 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:44:39.660 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:44:39.660 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:44:39.660 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:44:39.660 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.661 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:39.661 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:44:39.661 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:44:39.661 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:44:39.661 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:44:39.661 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:44:39.661 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:44:39.661 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:44:39.661 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:44:39.661 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:44:39.661 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:44:39.661 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:44:39.661 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:39.661 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:44:39.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.587+0000 7fa6c6a84640 1 -- 172.21.15.132:0/71193314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa6a406a460 msgr2=0x7fa6a406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:39.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.587+0000 7fa6c6a84640 1 --2- 172.21.15.132:0/71193314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa6a406a460 0x7fa6a406c920 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa6b400a750 tx=0x7fa6b4008040 comp rx=0 tx=0).stop 2023-12-20T04:44:39.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.587+0000 7fa6c6a84640 1 -- 172.21.15.132:0/71193314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6c00caa90 msgr2=0x7fa6c01562c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:39.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.587+0000 7fa6c6a84640 1 --2- 172.21.15.132:0/71193314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6c00caa90 0x7fa6c01562c0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fa6ac02bee0 tx=0x7fa6ac0046c0 comp rx=0 tx=0).stop 2023-12-20T04:44:39.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.588+0000 7fa6c6a84640 1 -- 172.21.15.132:0/71193314 shutdown_connections 2023-12-20T04:44:39.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.588+0000 7fa6c6a84640 1 --2- 172.21.15.132:0/71193314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa6a406a460 0x7fa6a406c920 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:39.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.588+0000 7fa6c6a84640 1 --2- 172.21.15.132:0/71193314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa6c0159d00 0x7fa6c00b4780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:39.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.588+0000 7fa6c6a84640 1 --2- 172.21.15.132:0/71193314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6c00caa90 0x7fa6c01562c0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:39.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.588+0000 7fa6c6a84640 1 --2- 172.21.15.132:0/71193314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6c006cc30 0x7fa6c0155d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:39.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.588+0000 7fa6c6a84640 1 -- 172.21.15.132:0/71193314 >> 172.21.15.132:0/71193314 conn(0x7fa6c00cfca0 msgr2=0x7fa6c00d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:39.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.588+0000 7fa6c6a84640 1 -- 172.21.15.132:0/71193314 shutdown_connections 2023-12-20T04:44:39.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:39.588+0000 7fa6c6a84640 1 -- 172.21.15.132:0/71193314 wait complete. 2023-12-20T04:44:39.665 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-20T04:44:42.880 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:44:42.878+0000 7f1a5f3c2640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-12-20T04:44:44.666 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:44:44.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.775+0000 7f905297e640 1 Processor -- start 2023-12-20T04:44:44.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.775+0000 7f905297e640 1 -- start start 2023-12-20T04:44:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.776+0000 7f905297e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f904c0d0370 0x7f904c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.776+0000 7f905297e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f904c0cdc10 0x7f904c06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.776+0000 7f905297e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f904c0b2f90 con 0x7f904c15d100 2023-12-20T04:44:44.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.776+0000 7f905297e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904c1613c0 con 0x7f904c0d0370 2023-12-20T04:44:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.776+0000 7f905297e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f904c0d1b00 con 0x7f904c0cdc10 2023-12-20T04:44:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.776+0000 7f904b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f904c0d0370 0x7f904c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.776+0000 7f904bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f904c15d100 0x7f904c0cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46994/0 (socket says 172.21.15.132:46994) 2023-12-20T04:44:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.776+0000 7f904bfff640 1 -- 172.21.15.132:0/1435171130 learned_addr learned my addr 172.21.15.132:0/1435171130 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.776+0000 7f9050f1b640 1 --2- 172.21.15.132:0/1435171130 >> v2:172.21.15.187:3300/0 conn(0x7f904c0cdc10 0x7f904c06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.776+0000 7f904b7fe640 1 -- 172.21.15.132:0/1435171130 >> v2:172.21.15.187:3300/0 conn(0x7f904c0cdc10 msgr2=0x7f904c06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.776+0000 7f904b7fe640 1 --2- 172.21.15.132:0/1435171130 >> v2:172.21.15.187:3300/0 conn(0x7f904c0cdc10 0x7f904c06c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.776+0000 7f904b7fe640 1 -- 172.21.15.132:0/1435171130 >> v1:172.21.15.132:6789/0 conn(0x7f904c15d100 legacy=0x7f904c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.776+0000 7f904b7fe640 1 -- 172.21.15.132:0/1435171130 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f904c0d0810 con 0x7f904c0d0370 2023-12-20T04:44:44.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.776+0000 7f904affd640 1 -- 172.21.15.132:0/1435171130 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2671501005 0 0) 0x7f903c001110 con 0x7f904c15d100 2023-12-20T04:44:44.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.777+0000 7f904b7fe640 1 --2- 172.21.15.132:0/1435171130 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f904c0d0370 0x7f904c0b2a50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f904c161330 tx=0x7f904002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40a094e4dacf41f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:44.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.777+0000 7f904affd640 1 -- 172.21.15.132:0/1435171130 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040031830 con 0x7f904c0d0370 2023-12-20T04:44:44.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.777+0000 7f904affd640 1 -- 172.21.15.132:0/1435171130 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9040031990 con 0x7f904c0d0370 2023-12-20T04:44:44.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.777+0000 7f904affd640 1 -- 172.21.15.132:0/1435171130 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9040031d20 con 0x7f904c0d0370 2023-12-20T04:44:44.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.778+0000 7f905297e640 1 -- 172.21.15.132:0/1435171130 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f904c0d0370 msgr2=0x7f904c0b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:44.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.778+0000 7f905297e640 1 --2- 172.21.15.132:0/1435171130 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f904c0d0370 0x7f904c0b2a50 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f904c161330 tx=0x7f904002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:44:44.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.778+0000 7f905297e640 1 -- 172.21.15.132:0/1435171130 shutdown_connections 2023-12-20T04:44:44.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.778+0000 7f905297e640 1 --2- 172.21.15.132:0/1435171130 >> v2:172.21.15.187:3300/0 conn(0x7f904c0cdc10 0x7f904c06c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:44.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.778+0000 7f905297e640 1 --2- 172.21.15.132:0/1435171130 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f904c0d0370 0x7f904c0b2a50 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:44.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.778+0000 7f905297e640 1 -- 172.21.15.132:0/1435171130 >> 172.21.15.132:0/1435171130 conn(0x7f904c06d7c0 msgr2=0x7f904c06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:44.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.778+0000 7f905297e640 1 -- 172.21.15.132:0/1435171130 shutdown_connections 2023-12-20T04:44:44.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.778+0000 7f905297e640 1 -- 172.21.15.132:0/1435171130 wait complete. 2023-12-20T04:44:44.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.779+0000 7f905297e640 1 Processor -- start 2023-12-20T04:44:44.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.779+0000 7f905297e640 1 -- start start 2023-12-20T04:44:44.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.780+0000 7f905297e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f904c0cdc10 0x7f904c15feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:44.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.780+0000 7f905297e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f904c0d0370 0x7f904c0c7320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:44.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.780+0000 7f905297e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f904c15d100 0x7f904c0c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:44.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.780+0000 7f905297e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0ca1a0 con 0x7f904c0cdc10 2023-12-20T04:44:44.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.780+0000 7f905297e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0c98d0 con 0x7f904c0d0370 2023-12-20T04:44:44.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.780+0000 7f905297e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f904c0c7860 con 0x7f904c15d100 2023-12-20T04:44:44.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.780+0000 7f904bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f904c0cdc10 0x7f904c15feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:44.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.780+0000 7f904bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f904c0cdc10 0x7f904c15feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42320/0 (socket says 172.21.15.132:42320) 2023-12-20T04:44:44.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.780+0000 7f904bfff640 1 -- 172.21.15.132:0/2766414253 learned_addr learned my addr 172.21.15.132:0/2766414253 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:44.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.780+0000 7f9050f1b640 1 --2- 172.21.15.132:0/2766414253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f904c15d100 0x7f904c0c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:44.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.780+0000 7f904b7fe640 1 --2- 172.21.15.132:0/2766414253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f904c0d0370 0x7f904c0c7320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:44.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.780+0000 7f904bfff640 1 -- 172.21.15.132:0/2766414253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f904c15d100 msgr2=0x7f904c0c4b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:44.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.780+0000 7f904bfff640 1 --2- 172.21.15.132:0/2766414253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f904c15d100 0x7f904c0c4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:44.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.780+0000 7f904bfff640 1 -- 172.21.15.132:0/2766414253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f904c0d0370 msgr2=0x7f904c0c7320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:44.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.780+0000 7f904bfff640 1 --2- 172.21.15.132:0/2766414253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f904c0d0370 0x7f904c0c7320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:44.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.780+0000 7f904bfff640 1 -- 172.21.15.132:0/2766414253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9040009400 con 0x7f904c0cdc10 2023-12-20T04:44:44.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.780+0000 7f904b7fe640 1 --2- 172.21.15.132:0/2766414253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f904c0d0370 0x7f904c0c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:44.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.781+0000 7f904bfff640 1 --2- 172.21.15.132:0/2766414253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f904c0cdc10 0x7f904c15feb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f903c00c780 tx=0x7f903c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:44.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.781+0000 7f9048ff9640 1 -- 172.21.15.132:0/2766414253 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c0072d0 con 0x7f904c0cdc10 2023-12-20T04:44:44.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.781+0000 7f9048ff9640 1 -- 172.21.15.132:0/2766414253 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f903c007450 con 0x7f904c0cdc10 2023-12-20T04:44:44.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.781+0000 7f905297e640 1 -- 172.21.15.132:0/2766414253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f904c0b5da0 con 0x7f904c0cdc10 2023-12-20T04:44:44.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.781+0000 7f9048ff9640 1 -- 172.21.15.132:0/2766414253 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f903c0047e0 con 0x7f904c0cdc10 2023-12-20T04:44:44.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.781+0000 7f905297e640 1 -- 172.21.15.132:0/2766414253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f904c0c9dc0 con 0x7f904c0cdc10 2023-12-20T04:44:44.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.782+0000 7f905297e640 1 -- 172.21.15.132:0/2766414253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f904c0ca2e0 con 0x7f904c0cdc10 2023-12-20T04:44:44.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.782+0000 7f9048ff9640 1 -- 172.21.15.132:0/2766414253 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f903c004960 con 0x7f904c0cdc10 2023-12-20T04:44:44.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.783+0000 7f9048ff9640 1 --2- 172.21.15.132:0/2766414253 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f903806a430 0x7f903806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:44.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.783+0000 7f904b7fe640 1 --2- 172.21.15.132:0/2766414253 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f903806a430 0x7f903806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:44.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.783+0000 7f9048ff9640 1 -- 172.21.15.132:0/2766414253 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f903c087dd0 con 0x7f904c0cdc10 2023-12-20T04:44:44.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.783+0000 7f9048ff9640 1 -- 172.21.15.132:0/2766414253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=52}) v3 -- 0x7f9038072020 con 0x7f904c0cdc10 2023-12-20T04:44:44.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.783+0000 7f904b7fe640 1 --2- 172.21.15.132:0/2766414253 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f903806a430 0x7f903806c8f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9040036000 tx=0x7f9040008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:44.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.787+0000 7f9048ff9640 1 -- 172.21.15.132:0/2766414253 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f903c018060 con 0x7f904c0cdc10 2023-12-20T04:44:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.941+0000 7f9048ff9640 1 -- 172.21.15.132:0/2766414253 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(52..52 src has 1..52) v4 ==== 296+0+0 (secure 0 0 0) 0x7f903c057740 con 0x7f904c0cdc10 2023-12-20T04:44:44.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.941+0000 7f9048ff9640 1 -- 172.21.15.132:0/2766414253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=53}) v3 -- 0x7f90380728d0 con 0x7f904c0cdc10 2023-12-20T04:44:44.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.957+0000 7f905297e640 1 -- 172.21.15.132:0/2766414253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f904c0b2f90 con 0x7f904c0cdc10 2023-12-20T04:44:44.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.958+0000 7f9048ff9640 1 -- 172.21.15.132:0/2766414253 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v52) v1 ==== 81+0+33941 (secure 0 0 0) 0x7f904c0b2f90 con 0x7f904c0cdc10 2023-12-20T04:44:44.960 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:44.960 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:44:44.960 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 52, 2023-12-20T04:44:44.960 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:44:44.960 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:44:44.960 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:44:44.938128+0000", 2023-12-20T04:44:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:44:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:44:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:44:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:44:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:44:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:44:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:44:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:44:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:44:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:44:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:44:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:44:44.961 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:44:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:44:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 7, 2023-12-20T04:44:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:44:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:44:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "luminous", 2023-12-20T04:44:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:44:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:44:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:44:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:44:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:44:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:44:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:44:44.962 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:44:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:44:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:44:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:44:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:44:44.963 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:44:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "48", 2023-12-20T04:44:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:44.964 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:44.965 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:44.966 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:44.967 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:44:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:44:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:44:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:44:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:44:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:44:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:44:44.968 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:44:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 6, 2023-12-20T04:44:44.969 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:44:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:44:15.033177+0000", 2023-12-20T04:44:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:44:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:44:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:44:44.970 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:44:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:44:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:44:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:44:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "48", 2023-12-20T04:44:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:44.971 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:44.972 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:44.973 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:44:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:44:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:44:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:44:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:44:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.974 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:44:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:44:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:44:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:44:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:44:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 7, 2023-12-20T04:44:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:44:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:44:16.130594+0000", 2023-12-20T04:44:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:44:44.975 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:44:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:44:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:44:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:44:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:44:44.976 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:44:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "48", 2023-12-20T04:44:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:44.977 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:44.978 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:44.979 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:44:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:44:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:44:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:44:44.980 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:44:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:44:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:44:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:44:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:44:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.981 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:44:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:44:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:44.982 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:44:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:44:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:44.983 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:44:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:44:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:44.984 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:44:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:44:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:44.985 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:44:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:44:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:44:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:44:44.986 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:44:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:44:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:44.987 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:44:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:44.988 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:44:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.989 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:44:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:44:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.990 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:44:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:44:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:44.991 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:44:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:44:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:44:44.992 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:44:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:44:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:44:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:44:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.993 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:44:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:44.994 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:44:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:44:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:44.995 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:44:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:44:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:44.996 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:44:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:44:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:44.997 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:44:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:44:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:44:44.998 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:44:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:44:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:44:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:44:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:44.999 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:44:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.000 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:44:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:44:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:45.001 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:44:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:44:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.002 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:44:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:44:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.003 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:44:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:44:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:44:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:44:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:44:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:44:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:45.005 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:44:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:44:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.006 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.007 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:45.007 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.007 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.007 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:44:45.007 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:45.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.007 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.007 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.007 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:44:45.007 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:45.007 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.007 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.008 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:45.008 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.008 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.008 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.008 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:44:45.008 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:45.008 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.008 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.008 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.008 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:44:45.008 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:45.008 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.008 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.008 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.009 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:45.009 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.009 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.009 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.009 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:44:45.009 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:45.009 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.009 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.009 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.009 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:44:45.009 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:45.009 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.009 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.009 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.010 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:44:45.010 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:44:45.010 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:44:45.010 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:44:45.010 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:45.010 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:45.010 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:45.010 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.010 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.010 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.010 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:44:45.010 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:45.010 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:45.010 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:45.011 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:45.011 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:45.011 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:45.011 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:45.011 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:45.011 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:45.011 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:45.011 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:45.011 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:45.011 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.011 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.011 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.011 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:44:45.011 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:45.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.012 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.012 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:44:45.012 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:45.012 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.012 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.012 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.012 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:45.012 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.012 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.012 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.012 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:44:45.012 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:45.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.013 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.013 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:44:45.013 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:45.013 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.013 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.013 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:45.013 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.013 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.013 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.013 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:44:45.013 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:45.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.014 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.014 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.014 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:44:45.014 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:45.014 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.014 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.014 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:45.014 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.014 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.014 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.014 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:44:45.014 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:45.014 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.015 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.015 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.015 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:44:45.015 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:45.015 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.015 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.015 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.015 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:44:45.015 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:44:45.015 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:44:45.015 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:44:45.015 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:45.015 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:45.015 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:45.016 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.016 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.016 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.016 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:44:45.016 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:45.016 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:45.016 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:45.016 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:45.016 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:45.016 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:45.016 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:45.016 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:45.016 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 48, 2023-12-20T04:44:45.016 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:45.017 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:45.017 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:45.017 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.017 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.017 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:44:45.017 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:45.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.017 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.017 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:44:45.017 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:45.017 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.017 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.017 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.018 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:45.018 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.018 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.018 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:44:45.018 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:45.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.018 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.018 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:44:45.018 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:45.018 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.018 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.019 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:45.019 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.019 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.019 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.019 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:44:45.019 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:45.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.019 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.019 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.019 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:44:45.019 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:45.019 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.019 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.020 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:45.020 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.020 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.020 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:44:45.020 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:45.020 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.020 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.020 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:44:45.020 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:45.020 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.020 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.020 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.020 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:44:45.021 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:44:45.021 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:44:45.021 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:44:45.021 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:45.021 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:45.021 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:44:45.021 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:45.021 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.021 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.021 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.021 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:44:45.021 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:45.021 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:45.021 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:45.022 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:45.022 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:45.022 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:45.022 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:45.022 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:45.022 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:45.022 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:45.022 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:45.022 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:45.022 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.022 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.022 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.022 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:44:45.022 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:45.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.023 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.023 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:44:45.023 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:45.023 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.023 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.023 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:45.023 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.023 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.023 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:44:45.023 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:45.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.024 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.024 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.024 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:44:45.024 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:45.024 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.024 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.024 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:45.024 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.024 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.024 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.024 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:44:45.024 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:45.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.025 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.025 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:44:45.025 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:45.025 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.025 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.025 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:45.025 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:45.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.025 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:45.025 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:44:45.025 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:45.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.026 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:45.026 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:44:45.026 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:45.026 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.026 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.026 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.026 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:44:45.026 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:44:45.026 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:44:45.026 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:44:45.026 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:45.026 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:45.026 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:45.026 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.026 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.027 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:45.027 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:44:45.027 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.027 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:44:45.027 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:45.027 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:45.027 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:45.027 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:45.027 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:45.027 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:44:45.027 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:45.027 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.027 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.027 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:44:45.027 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:45.028 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:45.028 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:45.028 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:45.028 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:45.028 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:44:45.028 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:45.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.028 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.028 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:44:45.028 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:45.028 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:45.028 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:45.028 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:45.028 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:45.028 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:44:45.029 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:45.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.029 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:44:45.029 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:45.029 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:45.029 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:45.029 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:45.029 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:45.029 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:44:45.029 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:45.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.029 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:44:45.030 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:45.030 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:45.030 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:45.030 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:45.030 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:45.030 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:44:45.030 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:45.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.030 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.030 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:44:45.030 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:45.030 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:45.030 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:45.030 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:45.030 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:45.031 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:44:45.031 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:45.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.031 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.031 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:44:45.031 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:45.031 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:45.031 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:45.031 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:45.031 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:45.031 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:44:45.031 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:45.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.031 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.031 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:44:45.032 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:45.032 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:45.032 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:45.032 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:45.032 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:45.032 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:44:45.032 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:45.032 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.032 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:45.032 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:44:45.032 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [ 2023-12-20T04:44:45.032 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.032 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "7.7", 2023-12-20T04:44:45.032 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:44:45.032 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.033 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 0, 2023-12-20T04:44:45.033 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 4 2023-12-20T04:44:45.033 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.033 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.033 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.033 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.033 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "7.30", 2023-12-20T04:44:45.033 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:44:45.033 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:45.033 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 0, 2023-12-20T04:44:45.033 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 5 2023-12-20T04:44:45.033 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.033 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:45.033 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:44:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:44:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:44:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:44:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:44:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:44:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:44:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:44:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:44:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:44:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:44:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:44:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.034 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:45.035 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:44:45.035 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:44:45.035 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:44:45.035 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:44:45.035 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:44:45.035 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:44:45.035 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:44:45.035 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:44:45.035 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:44:45.035 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:44:45.035 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:44:45.035 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:45.035 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:44:45.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.960+0000 7f905297e640 1 -- 172.21.15.132:0/2766414253 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f903806a430 msgr2=0x7f903806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:45.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.960+0000 7f905297e640 1 --2- 172.21.15.132:0/2766414253 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f903806a430 0x7f903806c8f0 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f9040036000 tx=0x7f9040008030 comp rx=0 tx=0).stop 2023-12-20T04:44:45.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.960+0000 7f905297e640 1 -- 172.21.15.132:0/2766414253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f904c0cdc10 msgr2=0x7f904c15feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:45.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.960+0000 7f905297e640 1 --2- 172.21.15.132:0/2766414253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f904c0cdc10 0x7f904c15feb0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f903c00c780 tx=0x7f903c00cc40 comp rx=0 tx=0).stop 2023-12-20T04:44:45.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.960+0000 7f905297e640 1 -- 172.21.15.132:0/2766414253 shutdown_connections 2023-12-20T04:44:45.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.960+0000 7f905297e640 1 --2- 172.21.15.132:0/2766414253 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f903806a430 0x7f903806c8f0 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:45.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.960+0000 7f905297e640 1 --2- 172.21.15.132:0/2766414253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f904c15d100 0x7f904c0c4b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:45.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.960+0000 7f905297e640 1 --2- 172.21.15.132:0/2766414253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f904c0d0370 0x7f904c0c7320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:45.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.960+0000 7f905297e640 1 --2- 172.21.15.132:0/2766414253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f904c0cdc10 0x7f904c15feb0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:45.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.960+0000 7f905297e640 1 -- 172.21.15.132:0/2766414253 >> 172.21.15.132:0/2766414253 conn(0x7f904c06d7c0 msgr2=0x7f904c0cc0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:45.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.960+0000 7f905297e640 1 -- 172.21.15.132:0/2766414253 shutdown_connections 2023-12-20T04:44:45.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:44.960+0000 7f905297e640 1 -- 172.21.15.132:0/2766414253 wait complete. 2023-12-20T04:44:45.038 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-20T04:44:46.954 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:44:46.957 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:44:50.039 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:44:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.150+0000 7fab15ec4640 1 Processor -- start 2023-12-20T04:44:50.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.150+0000 7fab15ec4640 1 -- start start 2023-12-20T04:44:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.151+0000 7fab15ec4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab100cf0b0 0x7fab100b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.151+0000 7fab15ec4640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fab100cb420 0x7fab100d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.151+0000 7fab15ec4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab100cd740 con 0x7fab1015e2d0 2023-12-20T04:44:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.151+0000 7fab15ec4640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab100ce230 con 0x7fab100cb420 2023-12-20T04:44:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.151+0000 7fab15ec4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab100cd990 con 0x7fab100cf0b0 2023-12-20T04:44:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.151+0000 7fab0f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fab1015e2d0 0x7fab100ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40256/0 (socket says 172.21.15.132:40256) 2023-12-20T04:44:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.151+0000 7fab0f7fe640 1 -- 172.21.15.132:0/647813872 learned_addr learned my addr 172.21.15.132:0/647813872 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.151+0000 7fab0e7fc640 1 -- 172.21.15.132:0/647813872 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1152612683 0 0) 0x7fab100cd740 con 0x7fab1015e2d0 2023-12-20T04:44:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.151+0000 7fab0e7fc640 1 -- 172.21.15.132:0/647813872 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faaf8003520 con 0x7fab1015e2d0 2023-12-20T04:44:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.151+0000 7fab0ffff640 1 --2- 172.21.15.132:0/647813872 >> v2:172.21.15.187:3300/0 conn(0x7fab100cb420 0x7fab100d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.151+0000 7fab0effd640 1 --2- 172.21.15.132:0/647813872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab100cf0b0 0x7fab100b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.151+0000 7fab0e7fc640 1 -- 172.21.15.132:0/647813872 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3262108261 0 0) 0x7faaf8003520 con 0x7fab1015e2d0 2023-12-20T04:44:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0e7fc640 1 -- 172.21.15.132:0/647813872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab100cf0b0 msgr2=0x7fab100b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0e7fc640 1 --2- 172.21.15.132:0/647813872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab100cf0b0 0x7fab100b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0e7fc640 1 -- 172.21.15.132:0/647813872 >> v2:172.21.15.187:3300/0 conn(0x7fab100cb420 msgr2=0x7fab100d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0e7fc640 1 --2- 172.21.15.132:0/647813872 >> v2:172.21.15.187:3300/0 conn(0x7fab100cb420 0x7fab100d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0e7fc640 1 -- 172.21.15.132:0/647813872 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab100cdc70 con 0x7fab1015e2d0 2023-12-20T04:44:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0e7fc640 1 -- 172.21.15.132:0/647813872 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fab00001670 con 0x7fab1015e2d0 2023-12-20T04:44:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0e7fc640 1 -- 172.21.15.132:0/647813872 >> v1:172.21.15.132:6789/0 conn(0x7fab1015e2d0 legacy=0x7fab100ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0e7fc640 1 --2- 172.21.15.132:0/647813872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaf8003970 0x7faaf8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0e7fc640 1 --2- 172.21.15.132:0/647813872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab100cf0b0 0x7faaf80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0e7fc640 1 --2- 172.21.15.132:0/647813872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaf8004d00 0x7faaf8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0e7fc640 1 -- 172.21.15.132:0/647813872 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab100ce230 con 0x7faaf8003970 2023-12-20T04:44:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0e7fc640 1 -- 172.21.15.132:0/647813872 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab100cd990 con 0x7faaf8004d00 2023-12-20T04:44:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0e7fc640 1 -- 172.21.15.132:0/647813872 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaf800b980 con 0x7fab100cf0b0 2023-12-20T04:44:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0f7fe640 1 --2- 172.21.15.132:0/647813872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaf8003970 0x7faaf8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0effd640 1 --2- 172.21.15.132:0/647813872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab100cf0b0 0x7faaf80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0ffff640 1 --2- 172.21.15.132:0/647813872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaf8004d00 0x7faaf8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0f7fe640 1 -- 172.21.15.132:0/647813872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab100cf0b0 msgr2=0x7faaf80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:50.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0f7fe640 1 --2- 172.21.15.132:0/647813872 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab100cf0b0 0x7faaf80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0f7fe640 1 -- 172.21.15.132:0/647813872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaf8004d00 msgr2=0x7faaf8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:50.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0f7fe640 1 --2- 172.21.15.132:0/647813872 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaf8004d00 0x7faaf8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.152+0000 7fab0f7fe640 1 -- 172.21.15.132:0/647813872 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaf8003520 con 0x7faaf8003970 2023-12-20T04:44:50.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.153+0000 7fab0f7fe640 1 --2- 172.21.15.132:0/647813872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaf8003970 0x7faaf8003d90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fab0000c290 tx=0x7faaf80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e0aff59e7d90d3ed server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:50.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.153+0000 7fab0e7fc640 1 -- 172.21.15.132:0/647813872 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab00005ad0 con 0x7faaf8003970 2023-12-20T04:44:50.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.153+0000 7fab0e7fc640 1 -- 172.21.15.132:0/647813872 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab00005c30 con 0x7faaf8003970 2023-12-20T04:44:50.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.153+0000 7fab0e7fc640 1 -- 172.21.15.132:0/647813872 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0002c8d0 con 0x7faaf8003970 2023-12-20T04:44:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.153+0000 7fab15ec4640 1 -- 172.21.15.132:0/647813872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaf8003970 msgr2=0x7faaf8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.153+0000 7fab15ec4640 1 --2- 172.21.15.132:0/647813872 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaf8003970 0x7faaf8003d90 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fab0000c290 tx=0x7faaf80057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.153+0000 7fab0ffff640 1 -- 172.21.15.132:0/647813872 reap_dead start 2023-12-20T04:44:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.154+0000 7fab15ec4640 1 -- 172.21.15.132:0/647813872 shutdown_connections 2023-12-20T04:44:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.154+0000 7fab15ec4640 1 -- 172.21.15.132:0/647813872 >> 172.21.15.132:0/647813872 conn(0x7fab1006d7c0 msgr2=0x7fab1006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.154+0000 7fab15ec4640 1 -- 172.21.15.132:0/647813872 shutdown_connections 2023-12-20T04:44:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.154+0000 7fab15ec4640 1 -- 172.21.15.132:0/647813872 wait complete. 2023-12-20T04:44:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.155+0000 7fab15ec4640 1 Processor -- start 2023-12-20T04:44:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.155+0000 7fab15ec4640 1 -- start start 2023-12-20T04:44:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab15ec4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100b0070 0x7fab100c7020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab15ec4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab100c9ef0 0x7fab100ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab15ec4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab101f3c20 0x7fab101f40a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab15ec4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab100ca8b0 con 0x7fab100b0070 2023-12-20T04:44:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab15ec4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab100c97a0 con 0x7fab101f3c20 2023-12-20T04:44:50.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab15ec4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab100b0450 con 0x7fab100c9ef0 2023-12-20T04:44:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab0f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100b0070 0x7fab100c7020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab0f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100b0070 0x7fab100c7020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36310/0 (socket says 172.21.15.132:36310) 2023-12-20T04:44:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab0f7fe640 1 -- 172.21.15.132:0/2498196663 learned_addr learned my addr 172.21.15.132:0/2498196663 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab0effd640 1 --2- 172.21.15.132:0/2498196663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab100c9ef0 0x7fab100ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab0ffff640 1 --2- 172.21.15.132:0/2498196663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab101f3c20 0x7fab101f40a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab0f7fe640 1 -- 172.21.15.132:0/2498196663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab100c9ef0 msgr2=0x7fab100ca370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab0f7fe640 1 --2- 172.21.15.132:0/2498196663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab100c9ef0 0x7fab100ca370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab0f7fe640 1 -- 172.21.15.132:0/2498196663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab101f3c20 msgr2=0x7fab101f40a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab0f7fe640 1 --2- 172.21.15.132:0/2498196663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab101f3c20 0x7fab101f40a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab0f7fe640 1 -- 172.21.15.132:0/2498196663 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab100c7560 con 0x7fab100b0070 2023-12-20T04:44:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab0effd640 1 --2- 172.21.15.132:0/2498196663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab100c9ef0 0x7fab100ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab0f7fe640 1 --2- 172.21.15.132:0/2498196663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100b0070 0x7fab100c7020 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fab00004840 tx=0x7fab00001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7faaf7fff640 1 -- 172.21.15.132:0/2498196663 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab0003c040 con 0x7fab100b0070 2023-12-20T04:44:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7faaf7fff640 1 -- 172.21.15.132:0/2498196663 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab0002cde0 con 0x7fab100b0070 2023-12-20T04:44:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7faaf7fff640 1 -- 172.21.15.132:0/2498196663 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab000072b0 con 0x7fab100b0070 2023-12-20T04:44:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab15ec4640 1 -- 172.21.15.132:0/2498196663 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab100c8c20 con 0x7fab100b0070 2023-12-20T04:44:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.156+0000 7fab15ec4640 1 -- 172.21.15.132:0/2498196663 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab100c91e0 con 0x7fab100b0070 2023-12-20T04:44:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.158+0000 7fab15ec4640 1 -- 172.21.15.132:0/2498196663 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab1004e840 con 0x7fab100b0070 2023-12-20T04:44:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.158+0000 7faaf7fff640 1 -- 172.21.15.132:0/2498196663 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fab00032070 con 0x7fab100b0070 2023-12-20T04:44:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.158+0000 7faaf7fff640 1 --2- 172.21.15.132:0/2498196663 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faafc06a430 0x7faafc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.158+0000 7faaf7fff640 1 -- 172.21.15.132:0/2498196663 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fab000a9c60 con 0x7fab100b0070 2023-12-20T04:44:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.158+0000 7fab0effd640 1 --2- 172.21.15.132:0/2498196663 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faafc06a430 0x7faafc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.159+0000 7fab0effd640 1 --2- 172.21.15.132:0/2498196663 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faafc06a430 0x7faafc06c8f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fab100c9b50 tx=0x7fab04008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:50.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.163+0000 7faaf7fff640 1 -- 172.21.15.132:0/2498196663 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fab000752a0 con 0x7fab100b0070 2023-12-20T04:44:50.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.329+0000 7fab15ec4640 1 -- 172.21.15.132:0/2498196663 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fab100c4730 con 0x7fab100b0070 2023-12-20T04:44:50.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.330+0000 7faaf7fff640 1 -- 172.21.15.132:0/2498196663 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+33902 (secure 0 0 0) 0x7fab000788c0 con 0x7fab100b0070 2023-12-20T04:44:50.332 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:50.332 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:44:50.332 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 53, 2023-12-20T04:44:50.332 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:44:50.332 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:44:50.332 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:44:45.942314+0000", 2023-12-20T04:44:50.332 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:44:50.333 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:44:50.333 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:44:50.333 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:44:50.333 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:44:50.333 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:44:50.333 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:44:50.333 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:44:50.333 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:44:50.333 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:50.333 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:44:50.333 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:44:50.333 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:44:50.333 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:44:50.333 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:44:50.334 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 7, 2023-12-20T04:44:50.334 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:44:50.334 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:44:50.334 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "luminous", 2023-12-20T04:44:50.334 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:44:50.334 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:44:50.334 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:44:50.334 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.334 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:44:50.334 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:44:50.334 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:44:50.334 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:44:50.334 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:44:50.334 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:50.335 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:50.335 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:50.335 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:50.335 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:50.335 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:50.335 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:50.335 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:50.335 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:50.335 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:50.335 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:44:50.335 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:44:50.335 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:44:50.335 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:44:50.336 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:44:50.336 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:50.336 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:50.336 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:50.336 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:50.336 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:50.336 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:50.336 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:50.336 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.336 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "53", 2023-12-20T04:44:50.336 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:50.336 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:50.336 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:50.336 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:50.337 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:50.337 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:50.337 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:50.337 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:50.337 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:50.337 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:50.337 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:50.337 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:50.337 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:50.337 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:50.337 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:50.337 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:50.337 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:50.337 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:50.338 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:50.338 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:50.338 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:50.338 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:50.338 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:50.338 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:50.338 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:50.338 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:50.338 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.338 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:50.338 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:50.338 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:50.338 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:50.338 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:50.339 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:50.339 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:50.339 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:50.339 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:50.339 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:50.339 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:50.339 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:50.339 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:44:50.339 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:44:50.339 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.339 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:50.339 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:44:50.339 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.339 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:50.340 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:44:50.340 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:44:50.340 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:44:50.340 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:44:50.340 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:44:50.340 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:50.340 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:50.340 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:50.340 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.340 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.340 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.340 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 6, 2023-12-20T04:44:50.340 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:44:50.340 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:44:15.033177+0000", 2023-12-20T04:44:50.340 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:44:50.341 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:44:50.341 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:50.341 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:50.341 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:50.341 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:50.341 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:50.341 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:50.341 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:50.341 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:50.341 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:50.341 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:50.341 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:44:50.341 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:44:50.342 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:44:50.342 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:44:50.342 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:44:50.342 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:50.342 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:50.342 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:50.342 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:50.342 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:50.342 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:50.342 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:50.342 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.342 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "53", 2023-12-20T04:44:50.342 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:50.342 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:50.342 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:50.343 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:50.343 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:50.343 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:50.343 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:50.343 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:50.343 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:50.343 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:50.343 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:50.343 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:50.343 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:50.343 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:50.343 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:50.343 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:50.344 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:50.344 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:50.344 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:50.344 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:50.344 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:50.344 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:50.344 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:50.344 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:50.344 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:50.344 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:50.344 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.344 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:50.344 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:50.344 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:50.345 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:50.345 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:50.345 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:50.345 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:50.345 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:50.345 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:50.345 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:50.345 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:50.345 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:50.345 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:44:50.345 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:44:50.345 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:44:50.345 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.345 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:50.346 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:44:50.346 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:44:50.346 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.346 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.346 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:50.346 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:44:50.346 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:44:50.346 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:44:50.346 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:44:50.346 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:44:50.346 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:50.346 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:50.346 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:50.346 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.347 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.347 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.347 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 7, 2023-12-20T04:44:50.347 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:44:50.347 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:44:16.130594+0000", 2023-12-20T04:44:50.347 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:44:50.347 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:44:50.347 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:50.347 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:50.347 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:50.347 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:50.347 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:50.347 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:50.347 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:50.347 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:50.348 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:50.348 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:50.348 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:44:50.348 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:44:50.348 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:44:50.348 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:44:50.348 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:44:50.348 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:50.348 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:50.348 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:50.348 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:50.348 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:50.348 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:50.348 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:50.349 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.349 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "53", 2023-12-20T04:44:50.349 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:50.349 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:50.349 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:50.349 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:50.349 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:50.349 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:50.349 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:50.349 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:50.349 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:50.349 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:50.349 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:50.350 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:50.350 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:50.350 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:50.350 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:50.350 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:50.350 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:50.350 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:50.350 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:50.350 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:50.350 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:50.350 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:50.350 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:50.350 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:50.350 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:50.351 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:50.351 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.351 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:50.351 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:50.351 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:50.351 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:50.351 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:50.351 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:50.351 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:50.351 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:50.351 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:50.351 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:50.351 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:50.351 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:50.351 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:44:50.352 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:44:50.352 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.352 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:50.352 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:44:50.352 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:44:50.352 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.352 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.352 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:50.352 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:44:50.352 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:44:50.352 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:44:50.352 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:44:50.352 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:44:50.352 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:50.353 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:50.353 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:50.353 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.353 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.353 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:50.353 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:44:50.353 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.353 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:44:50.353 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:50.353 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:50.353 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:50.353 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:50.353 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:50.353 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:50.353 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:50.354 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:50.354 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:50.354 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:50.354 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:50.354 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:50.354 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.354 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.354 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.354 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:44:50.354 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:50.354 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.354 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.354 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.354 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:44:50.354 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:50.355 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.355 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.355 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.355 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:50.355 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.355 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.355 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.355 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:44:50.355 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:50.355 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.355 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.355 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.355 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:44:50.355 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:50.356 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.356 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.356 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.356 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:50.356 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.356 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.356 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.356 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:44:50.356 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:50.356 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.356 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.356 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.356 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:44:50.356 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:50.356 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.357 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.357 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.357 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:50.357 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.357 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.357 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.357 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:44:50.357 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:50.357 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.357 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.357 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.357 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:44:50.357 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:50.357 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.358 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.358 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:44:50.358 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:44:50.358 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:44:50.358 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:44:50.358 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:50.358 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:50.358 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:50.358 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.358 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.358 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.358 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:44:50.358 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:50.358 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:50.359 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:50.359 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:50.359 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:50.359 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:50.359 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:50.359 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:50.359 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:50.359 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:50.359 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:50.359 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:50.359 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.359 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.359 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.359 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:44:50.360 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:50.360 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.360 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.360 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.360 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:44:50.360 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:50.360 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.360 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.360 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.360 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:50.360 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.360 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.360 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.360 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:44:50.361 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:50.361 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.361 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.361 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:44:50.361 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:50.361 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.361 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.361 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.361 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:50.361 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.361 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.361 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.361 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:44:50.362 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:50.362 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.362 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.362 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.362 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:44:50.362 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:50.362 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.362 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.362 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.362 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:50.362 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.362 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.362 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.362 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:44:50.362 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:50.363 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.363 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.363 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.363 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:44:50.363 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:50.363 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.363 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.363 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.363 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:44:50.363 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:44:50.363 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:44:50.363 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:44:50.363 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:50.363 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:50.364 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:50.364 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.364 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.364 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.364 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:44:50.364 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:50.364 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:50.364 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:50.364 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:50.364 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:50.364 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:50.364 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:50.364 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:50.364 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:50.365 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:50.365 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:50.365 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:50.365 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.365 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.365 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:44:50.365 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:50.365 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.365 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.365 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.365 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:44:50.365 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:50.365 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.366 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.366 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.366 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:50.366 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.366 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.366 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.366 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:44:50.366 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:50.366 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.366 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.366 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.366 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:44:50.366 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:50.366 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.367 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.367 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:50.367 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.367 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.367 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:44:50.367 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:50.367 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.367 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.367 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:44:50.367 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:50.367 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.368 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.368 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.368 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:50.368 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.368 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.368 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.368 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:44:50.368 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:50.368 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.368 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.368 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.368 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:44:50.368 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:50.368 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.368 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.369 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:44:50.369 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:44:50.369 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:44:50.369 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:44:50.369 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:50.369 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:50.369 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:50.369 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.369 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.369 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:44:50.369 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:50.369 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:50.370 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:50.370 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:50.370 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:50.370 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:50.370 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:50.370 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:50.370 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:50.370 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:50.370 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:50.370 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:50.370 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.370 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.370 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.370 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:44:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:44:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:44:50.371 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:50.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.372 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.372 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.372 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:44:50.372 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:50.372 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.372 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.372 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:50.372 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.372 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.372 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.372 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:44:50.372 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:50.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.373 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.373 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:44:50.373 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:50.373 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.373 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.373 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:50.373 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.373 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.373 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:44:50.373 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:50.374 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.374 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.374 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.374 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:44:50.374 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:50.374 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.374 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.374 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.374 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:44:50.374 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:44:50.374 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:44:50.374 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:44:50.374 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:50.374 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:50.375 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:50.375 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.375 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.375 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:44:50.375 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:50.375 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:50.375 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:50.375 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:50.375 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:50.375 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:50.375 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:50.375 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:50.376 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:50.376 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:50.376 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:50.376 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:50.376 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.376 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.376 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:44:50.376 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:50.376 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.376 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.376 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.376 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:44:50.376 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:50.376 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.377 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.377 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:50.377 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.377 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.377 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.377 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:44:50.377 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:50.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.377 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.377 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.377 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:44:50.377 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:50.377 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.378 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.378 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:50.378 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.378 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.378 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.378 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:44:50.378 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:50.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.378 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.378 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.378 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:44:50.378 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:50.378 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.378 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.379 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.379 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:50.379 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.379 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.379 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.379 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:44:50.379 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:50.379 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.379 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.379 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.379 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:44:50.379 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:50.379 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.379 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.380 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:44:50.380 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:44:50.380 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:44:50.380 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:44:50.380 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:50.380 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:50.380 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:50.380 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.380 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.380 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:44:50.380 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:50.380 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:50.380 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:50.381 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:50.381 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:50.381 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:50.381 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:50.381 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:50.381 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:50.381 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:50.381 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:50.381 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:50.381 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.381 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.381 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.381 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:44:50.381 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:50.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.382 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.382 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:44:50.382 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:50.382 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.382 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.382 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:50.382 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.382 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.382 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.382 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:44:50.382 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:50.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.383 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.383 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:44:50.383 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:50.383 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.383 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.383 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:50.383 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.383 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.383 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.383 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:44:50.383 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:50.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.384 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.384 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:44:50.384 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:50.384 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.384 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.384 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:50.384 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.384 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.384 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:44:50.384 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:50.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.385 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.385 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:44:50.385 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:50.385 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.385 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.385 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.385 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:44:50.385 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:44:50.385 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:44:50.385 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:44:50.385 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:50.385 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:50.385 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:50.386 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.386 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:44:50.386 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:50.386 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:50.386 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:50.386 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:50.386 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:50.386 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:50.386 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:50.386 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:50.386 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 48, 2023-12-20T04:44:50.387 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:50.387 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:50.387 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:50.387 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.387 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.387 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:44:50.387 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:50.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.387 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.387 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:44:50.387 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:50.387 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.388 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.388 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:50.388 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.388 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.388 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:44:50.388 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:50.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.388 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.388 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:44:50.388 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:50.388 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.388 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.389 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:50.389 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.389 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.389 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:44:50.389 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:50.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.389 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.389 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.389 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:44:50.389 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:50.389 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.389 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.390 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.390 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:50.390 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.390 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.390 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.390 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:44:50.390 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:50.390 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.390 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.390 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.390 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:44:50.390 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:50.390 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.390 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.391 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.391 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:44:50.391 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:44:50.391 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:44:50.391 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:44:50.391 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:50.391 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:50.391 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:50.391 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.391 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.391 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:44:50.391 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:50.391 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:50.391 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:50.392 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:50.392 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:50.392 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:50.392 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:50.392 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:50.392 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:50.392 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:50.392 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:50.392 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:50.392 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.392 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.392 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:44:50.392 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:50.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.393 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.393 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:44:50.393 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:50.393 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.393 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.393 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:50.393 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.393 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.393 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:44:50.393 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:50.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.394 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.394 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:44:50.394 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:50.394 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.394 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.394 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:50.394 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.394 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.394 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:44:50.394 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:50.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.395 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.395 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:44:50.395 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:50.395 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.395 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.395 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:50.395 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.395 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.395 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:44:50.395 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:50.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.396 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.396 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:44:50.396 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:50.396 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.396 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.396 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.396 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:44:50.396 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:44:50.396 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:44:50.396 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:44:50.396 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:50.396 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:50.396 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:50.396 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.397 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.397 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:50.397 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:44:50.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.397 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:44:50.397 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:50.397 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:50.397 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:50.397 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:50.397 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:50.397 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:44:50.397 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:50.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.398 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:44:50.398 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:50.398 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:50.398 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:50.398 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:50.398 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:50.398 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:44:50.398 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:50.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.398 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:44:50.398 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:50.398 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:50.398 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:50.398 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:50.399 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:50.399 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:44:50.399 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:50.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.399 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.399 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:44:50.399 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:50.399 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:50.399 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:50.399 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:50.399 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:50.399 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:44:50.399 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:50.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.400 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:44:50.400 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:50.400 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:50.400 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:50.400 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:50.400 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:50.400 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:44:50.400 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:50.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.400 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:44:50.400 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:50.400 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:50.401 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:50.401 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:50.401 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:50.401 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:44:50.401 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:50.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.401 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.401 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:44:50.401 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:50.401 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:50.401 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:50.401 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:50.401 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:50.401 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:44:50.402 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:50.402 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.402 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:44:50.402 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:50.402 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:50.402 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:50.402 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:50.402 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:50.402 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:44:50.402 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:50.402 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.402 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:50.403 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:44:50.403 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [ 2023-12-20T04:44:50.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.403 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "7.7", 2023-12-20T04:44:50.403 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:44:50.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.403 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 0, 2023-12-20T04:44:50.403 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 4 2023-12-20T04:44:50.403 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.403 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.403 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "7.30", 2023-12-20T04:44:50.403 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:44:50.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.403 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 0, 2023-12-20T04:44:50.404 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 5 2023-12-20T04:44:50.404 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.404 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.404 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.404 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:50.404 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:44:50.404 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:44:50.404 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:44:50.404 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:44:50.404 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:44:50.404 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:44:50.404 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:44:50.404 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:44:50.404 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:44:50.404 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:44:50.405 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:44:50.405 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:44:50.405 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.405 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:44:50.405 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:44:50.405 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:44:50.405 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:44:50.405 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:44:50.405 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:44:50.405 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:44:50.405 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:44:50.405 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:44:50.405 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:44:50.406 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:44:50.406 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.406 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:44:50.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.332+0000 7fab15ec4640 1 -- 172.21.15.132:0/2498196663 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faafc06a430 msgr2=0x7faafc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.332+0000 7fab15ec4640 1 --2- 172.21.15.132:0/2498196663 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faafc06a430 0x7faafc06c8f0 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fab100c9b50 tx=0x7fab04008040 comp rx=0 tx=0).stop 2023-12-20T04:44:50.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.332+0000 7fab15ec4640 1 -- 172.21.15.132:0/2498196663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100b0070 msgr2=0x7fab100c7020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.332+0000 7fab15ec4640 1 --2- 172.21.15.132:0/2498196663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100b0070 0x7fab100c7020 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fab00004840 tx=0x7fab00001a00 comp rx=0 tx=0).stop 2023-12-20T04:44:50.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.332+0000 7fab15ec4640 1 -- 172.21.15.132:0/2498196663 shutdown_connections 2023-12-20T04:44:50.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.332+0000 7fab15ec4640 1 --2- 172.21.15.132:0/2498196663 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faafc06a430 0x7faafc06c8f0 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.332+0000 7fab15ec4640 1 --2- 172.21.15.132:0/2498196663 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab101f3c20 0x7fab101f40a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.332+0000 7fab15ec4640 1 --2- 172.21.15.132:0/2498196663 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab100c9ef0 0x7fab100ca370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.332+0000 7fab15ec4640 1 --2- 172.21.15.132:0/2498196663 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100b0070 0x7fab100c7020 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.332+0000 7fab15ec4640 1 -- 172.21.15.132:0/2498196663 >> 172.21.15.132:0/2498196663 conn(0x7fab1006d7c0 msgr2=0x7fab100d1270 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:50.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.332+0000 7fab15ec4640 1 -- 172.21.15.132:0/2498196663 shutdown_connections 2023-12-20T04:44:50.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.332+0000 7fab15ec4640 1 -- 172.21.15.132:0/2498196663 wait complete. 2023-12-20T04:44:50.409 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-20T04:44:50.409 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:44:50.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.507+0000 7ff2ec44d640 1 Processor -- start 2023-12-20T04:44:50.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.507+0000 7ff2ec44d640 1 -- start start 2023-12-20T04:44:50.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.508+0000 7ff2ec44d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff2e40ce2a0 0x7ff2e40cf710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.508+0000 7ff2ec44d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e4161ff0 con 0x7ff2e4160ba0 2023-12-20T04:44:50.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.508+0000 7ff2ec44d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2e41613e0 con 0x7ff2e40cba90 2023-12-20T04:44:50.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.508+0000 7ff2ec44d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2e40cca40 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.508+0000 7ff2ea9ea640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff2e40ce2a0 0x7ff2e40cf710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.508+0000 7ff2ea1e9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff2e4160ba0 0x7ff2e40cb380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40258/0 (socket says 172.21.15.132:40258) 2023-12-20T04:44:50.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.508+0000 7ff2ea1e9640 1 -- 172.21.15.132:0/2298694366 learned_addr learned my addr 172.21.15.132:0/2298694366 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:50.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.509+0000 7ff2ea9ea640 1 -- 172.21.15.132:0/2298694366 >> v1:172.21.15.187:6789/0 conn(0x7ff2e40cba90 legacy=0x7ff2e40cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.509+0000 7ff2ea9ea640 1 -- 172.21.15.132:0/2298694366 >> v1:172.21.15.132:6789/0 conn(0x7ff2e4160ba0 legacy=0x7ff2e40cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.509+0000 7ff2ea9ea640 1 -- 172.21.15.132:0/2298694366 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2e41616c0 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.509+0000 7ff2ea9ea640 1 --2- 172.21.15.132:0/2298694366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40ce2a0 0x7ff2e40cf710 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009d90 tx=0x7ff2dc02beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=481bfda32ae30aae server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:50.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.510+0000 7ff2e91e7640 1 -- 172.21.15.132:0/2298694366 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc02cc60 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.510+0000 7ff2e91e7640 1 -- 172.21.15.132:0/2298694366 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2dc02cdc0 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.510+0000 7ff2e91e7640 1 -- 172.21.15.132:0/2298694366 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2dc034660 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.510+0000 7ff2ec44d640 1 -- 172.21.15.132:0/2298694366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40ce2a0 msgr2=0x7ff2e40cf710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.510+0000 7ff2ec44d640 1 --2- 172.21.15.132:0/2298694366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40ce2a0 0x7ff2e40cf710 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7ff2dc009d90 tx=0x7ff2dc02beb0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.510+0000 7ff2ec44d640 1 -- 172.21.15.132:0/2298694366 shutdown_connections 2023-12-20T04:44:50.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.510+0000 7ff2ec44d640 1 --2- 172.21.15.132:0/2298694366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40ce2a0 0x7ff2e40cf710 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.510+0000 7ff2ec44d640 1 -- 172.21.15.132:0/2298694366 >> 172.21.15.132:0/2298694366 conn(0x7ff2e40cd7b0 msgr2=0x7ff2e40cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:50.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.510+0000 7ff2ec44d640 1 -- 172.21.15.132:0/2298694366 shutdown_connections 2023-12-20T04:44:50.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.510+0000 7ff2ec44d640 1 -- 172.21.15.132:0/2298694366 wait complete. 2023-12-20T04:44:50.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.511+0000 7ff2ec44d640 1 Processor -- start 2023-12-20T04:44:50.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.512+0000 7ff2ec44d640 1 -- start start 2023-12-20T04:44:50.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.512+0000 7ff2ec44d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2e40cba90 0x7ff2e40b5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.512+0000 7ff2ec44d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40ce2a0 0x7ff2e40aec10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.512+0000 7ff2ec44d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2e4160ba0 0x7ff2e4150ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.512+0000 7ff2ec44d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e40b3130 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.512+0000 7ff2ec44d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e40b1e80 con 0x7ff2e4160ba0 2023-12-20T04:44:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.512+0000 7ff2ec44d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2e40b2160 con 0x7ff2e40cba90 2023-12-20T04:44:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.512+0000 7ff2e99e8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40ce2a0 0x7ff2e40aec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.512+0000 7ff2e99e8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40ce2a0 0x7ff2e40aec10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36334/0 (socket says 172.21.15.132:36334) 2023-12-20T04:44:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.512+0000 7ff2e99e8640 1 -- 172.21.15.132:0/3827936135 learned_addr learned my addr 172.21.15.132:0/3827936135 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.512+0000 7ff2ea1e9640 1 --2- 172.21.15.132:0/3827936135 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2e40cba90 0x7ff2e40b5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.513+0000 7ff2ea9ea640 1 --2- 172.21.15.132:0/3827936135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2e4160ba0 0x7ff2e4150ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.513+0000 7ff2e99e8640 1 -- 172.21.15.132:0/3827936135 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2e40cba90 msgr2=0x7ff2e40b5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.513+0000 7ff2e99e8640 1 --2- 172.21.15.132:0/3827936135 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2e40cba90 0x7ff2e40b5f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.513+0000 7ff2e99e8640 1 -- 172.21.15.132:0/3827936135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2e4160ba0 msgr2=0x7ff2e4150ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.513+0000 7ff2e99e8640 1 --2- 172.21.15.132:0/3827936135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2e4160ba0 0x7ff2e4150ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.513+0000 7ff2e99e8640 1 -- 172.21.15.132:0/3827936135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2dc009a70 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.513+0000 7ff2e99e8640 1 --2- 172.21.15.132:0/3827936135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40ce2a0 0x7ff2e40aec10 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400c3c0 tx=0x7ff2d400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:50.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.513+0000 7ff2daffd640 1 -- 172.21.15.132:0/3827936135 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d40052d0 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.513+0000 7ff2daffd640 1 -- 172.21.15.132:0/3827936135 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2d4005450 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.513+0000 7ff2daffd640 1 -- 172.21.15.132:0/3827936135 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2d4003830 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.513+0000 7ff2ec44d640 1 -- 172.21.15.132:0/3827936135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2e40b2440 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.513+0000 7ff2ec44d640 1 -- 172.21.15.132:0/3827936135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2e40b2960 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.514+0000 7ff2ec44d640 1 -- 172.21.15.132:0/3827936135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2e40b2630 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.514+0000 7ff2daffd640 1 -- 172.21.15.132:0/3827936135 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff2d4003990 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.515+0000 7ff2daffd640 1 --2- 172.21.15.132:0/3827936135 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff2c806a430 0x7ff2c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.515+0000 7ff2ea1e9640 1 --2- 172.21.15.132:0/3827936135 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff2c806a430 0x7ff2c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.515+0000 7ff2daffd640 1 -- 172.21.15.132:0/3827936135 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff2d4087e40 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.515+0000 7ff2ea1e9640 1 --2- 172.21.15.132:0/3827936135 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff2c806a430 0x7ff2c806c8f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0005880 tx=0x7ff2e0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:50.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.520+0000 7ff2daffd640 1 -- 172.21.15.132:0/3827936135 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff2d40533f0 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.684+0000 7ff2ec44d640 1 -- 172.21.15.132:0/3827936135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff2e404e840 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.685+0000 7ff2daffd640 1 -- 172.21.15.132:0/3827936135 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v53) v1 ==== 81+0+33902 (secure 0 0 0) 0x7ff2d4056a10 con 0x7ff2e40ce2a0 2023-12-20T04:44:50.687 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:50.687 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:44:50.688 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 53, 2023-12-20T04:44:50.688 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:44:50.688 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:44:50.688 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:44:45.942314+0000", 2023-12-20T04:44:50.688 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:44:50.688 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:44:50.688 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:44:50.688 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:44:50.688 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:44:50.688 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:44:50.688 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:44:50.688 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:44:50.688 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:44:50.689 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:50.689 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:44:50.689 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:44:50.689 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:44:50.689 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:44:50.689 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:44:50.689 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 7, 2023-12-20T04:44:50.689 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:44:50.689 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:44:50.689 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "luminous", 2023-12-20T04:44:50.689 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:44:50.689 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:44:50.689 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:44:50.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.690 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:44:50.690 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:44:50.690 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:44:50.692 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:44:50.692 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:44:50.692 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:50.692 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:50.692 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:50.692 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:50.693 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:50.693 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:50.693 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:50.693 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:50.693 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:50.693 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:50.693 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:44:50.693 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:44:50.693 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:44:50.693 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:44:50.693 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:44:50.693 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:50.693 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:50.693 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:50.694 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:50.694 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:50.694 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:50.694 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:50.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.694 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "53", 2023-12-20T04:44:50.694 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:50.694 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:50.694 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:50.694 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:50.694 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:50.694 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:50.694 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:50.694 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:50.694 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:50.695 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:50.695 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:50.695 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:50.695 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:50.695 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:50.695 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:50.695 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:50.695 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:50.695 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:50.695 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:50.695 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:50.695 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:50.695 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:50.695 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:50.695 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:50.696 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:50.696 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:50.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.696 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:50.696 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:50.696 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:50.696 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:50.696 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:50.696 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:50.696 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:50.696 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:50.696 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:50.696 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:50.696 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:50.696 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:50.696 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:44:50.697 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:44:50.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.697 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:50.697 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:44:50.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.697 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:50.697 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:44:50.697 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:44:50.697 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:44:50.697 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:44:50.697 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:44:50.697 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:50.697 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:50.697 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:50.698 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.698 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 6, 2023-12-20T04:44:50.698 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:44:50.698 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:44:15.033177+0000", 2023-12-20T04:44:50.698 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:44:50.698 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:44:50.698 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:50.698 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:50.698 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:50.698 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:50.698 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:50.698 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:50.699 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:50.699 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:50.699 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:50.699 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:50.699 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:44:50.699 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:44:50.699 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:44:50.699 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:44:50.699 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:44:50.699 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:50.699 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:50.699 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:50.700 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:50.700 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:50.700 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:50.700 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:50.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.700 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "53", 2023-12-20T04:44:50.700 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:50.700 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:50.700 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:50.700 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:50.700 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:50.700 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:50.700 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:50.700 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:50.701 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:50.701 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:50.701 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:50.701 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:50.701 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:50.701 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:50.701 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:50.701 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:50.701 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:50.701 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:50.701 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:50.701 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:50.701 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:50.701 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:50.701 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:50.702 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:50.702 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:50.702 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:50.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.702 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:50.702 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:50.702 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:50.702 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:50.702 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:50.702 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:50.702 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:50.702 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:50.702 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:50.702 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:50.702 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:50.703 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:50.703 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:44:50.703 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:44:50.703 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:44:50.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.703 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:50.703 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:44:50.703 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:44:50.703 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.703 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:50.703 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:44:50.703 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:44:50.703 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:44:50.703 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:44:50.704 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:44:50.704 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:50.704 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:50.704 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:50.704 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.704 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 7, 2023-12-20T04:44:50.704 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:44:50.704 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:44:16.130594+0000", 2023-12-20T04:44:50.704 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:44:50.704 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:44:50.704 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:44:50.704 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:44:50.704 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:44:50.705 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:44:50.705 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:44:50.705 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:44:50.705 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:44:50.705 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:44:50.705 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:44:50.705 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:44:50.705 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:44:50.705 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:44:50.705 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:44:50.705 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:44:50.705 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:44:50.705 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:44:50.705 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:44:50.706 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:44:50.706 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:44:50.706 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:44:50.706 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:44:50.706 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:44:50.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.706 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "53", 2023-12-20T04:44:50.706 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:44:50.706 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:44:50.706 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:44:50.706 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:44:50.706 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:44:50.706 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:44:50.706 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:44:50.706 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:44:50.707 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:44:50.707 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:44:50.707 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:44:50.707 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:44:50.707 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:44:50.707 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:44:50.707 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:44:50.707 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:44:50.707 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:44:50.707 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:44:50.707 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:44:50.707 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:44:50.707 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:44:50.707 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:44:50.708 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:44:50.708 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:44:50.708 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:44:50.708 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:44:50.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.708 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:44:50.708 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:44:50.708 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:44:50.708 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:44:50.708 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:44:50.708 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:44:50.708 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:44:50.708 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:44:50.708 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:44:50.708 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:44:50.709 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:44:50.709 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:44:50.709 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:44:50.709 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:44:50.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.709 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:44:50.709 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:44:50.709 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:44:50.709 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.709 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:44:50.709 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:44:50.709 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:44:50.709 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:44:50.709 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:44:50.710 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:44:50.710 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:44:50.710 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:44:50.710 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:44:50.710 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.710 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.710 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:50.710 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:44:50.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.710 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:44:50.710 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:50.711 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:50.711 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:50.711 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:50.711 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:50.711 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:50.711 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:50.711 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:50.711 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:50.711 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:50.711 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:50.711 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:50.711 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.711 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.711 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:44:50.712 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:50.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.712 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.712 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:44:50.712 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:50.712 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.712 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.712 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.712 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:50.712 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.712 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.712 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:44:50.713 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:50.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.713 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.713 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:44:50.713 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:50.713 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.713 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.713 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:50.713 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.713 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.713 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:44:50.713 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:50.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.714 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.714 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:44:50.714 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:50.714 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.714 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.714 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:50.714 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.714 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.714 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:44:50.714 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:50.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.715 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.715 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:44:50.715 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:44:50.715 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.715 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.715 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:44:50.715 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:44:50.715 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:44:50.715 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:44:50.715 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:50.715 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:50.715 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:50.716 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.716 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:44:50.716 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:50.716 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:50.716 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:50.716 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:50.716 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:50.716 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:50.716 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:50.716 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:50.716 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:50.716 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:50.716 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:50.716 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:50.717 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.717 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.717 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:44:50.717 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:50.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.717 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.717 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:44:50.717 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:50.717 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.717 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.717 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:50.718 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.718 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.718 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:44:50.718 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:50.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.718 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.718 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:44:50.718 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:50.718 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.718 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.718 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:50.718 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.719 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.719 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:44:50.719 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:50.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.719 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.719 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:44:50.719 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:50.719 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.719 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.719 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:50.719 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.719 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.720 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:44:50.720 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:50.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.720 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.720 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.720 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:44:50.720 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:44:50.720 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.720 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.720 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:44:50.720 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:44:50.720 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:44:50.720 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:44:50.721 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:50.721 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:50.721 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:50.721 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.721 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:44:50.721 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:50.721 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:50.721 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:50.721 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:50.721 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:50.721 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:50.721 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:50.722 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:50.722 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:50.722 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:50.722 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:50.722 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:50.722 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.722 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.722 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:44:50.722 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:50.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.722 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.722 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:44:50.722 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:50.722 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.723 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.723 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:50.723 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.723 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.723 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:44:50.723 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:50.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.723 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.723 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:44:50.723 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:50.723 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.723 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.724 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:50.724 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.724 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.724 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:44:50.724 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:50.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.724 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.724 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:44:50.724 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:50.724 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.724 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.725 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.725 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:50.725 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.725 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.725 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:44:50.725 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:50.725 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.725 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.725 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:44:50.725 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:44:50.725 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.726 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.726 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.726 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:44:50.726 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:44:50.726 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:44:50.726 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:44:50.726 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:50.726 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:50.726 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:50.726 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.726 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.726 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.726 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:44:50.726 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:50.726 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:50.727 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:50.727 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:50.727 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:50.727 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:50.727 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:50.727 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:50.727 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:50.727 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:50.727 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:50.727 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:50.727 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.727 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.727 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.727 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:44:50.727 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:50.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.728 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.728 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:44:50.728 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:50.728 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.728 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.728 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:50.728 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.728 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.728 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:44:50.728 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:50.728 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.729 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.729 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:44:50.729 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:50.729 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.729 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.729 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:50.729 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.729 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.729 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:44:50.729 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:50.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.730 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.730 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:44:50.730 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:50.730 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.730 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.730 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.730 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:50.730 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.730 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.730 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:44:50.730 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:50.730 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.730 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.731 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:44:50.731 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:44:50.731 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.731 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.731 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:44:50.731 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:44:50.731 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:44:50.731 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:44:50.731 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:50.731 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:50.731 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:50.731 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:44:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.732 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.733 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.733 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:44:50.733 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:50.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.733 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.733 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.733 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:44:50.733 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:50.733 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.733 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.733 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:50.733 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.733 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.734 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.734 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:44:50.734 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:50.734 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.734 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.734 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:44:50.734 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:50.734 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.734 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.734 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.734 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:50.734 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.734 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.734 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:44:50.735 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:50.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.735 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.735 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.735 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:44:50.735 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:50.735 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.735 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.735 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:50.735 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.735 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.735 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.735 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:44:50.735 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:50.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.736 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.736 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.736 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:44:50.736 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:44:50.736 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.736 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.736 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:44:50.736 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:44:50.736 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:44:50.736 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:44:50.736 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:50.736 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:50.736 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:50.737 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.737 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:44:50.737 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:50.737 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:50.737 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:50.737 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:50.737 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:50.737 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:50.737 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:50.737 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:50.737 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:50.737 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:50.738 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:50.738 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:50.738 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.738 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.738 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.738 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:44:50.738 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:50.738 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.738 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.738 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.738 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:44:50.738 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:50.738 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.738 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.738 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.738 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:50.739 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.739 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.739 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:44:50.739 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:50.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.739 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.739 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:44:50.739 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:50.739 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.739 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.739 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:50.740 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.740 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.740 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.740 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:44:50.740 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:50.740 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.740 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.740 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.740 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:44:50.740 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:50.740 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.740 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.740 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.740 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:50.740 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.741 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.741 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:44:50.741 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:50.741 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.741 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.741 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:44:50.741 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:44:50.741 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.741 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.741 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.741 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:44:50.742 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:44:50.742 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:44:50.742 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:44:50.742 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:50.742 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:50.742 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:50.742 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.742 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.742 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.742 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:44:50.742 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:50.742 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:50.742 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:50.742 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:50.743 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:50.743 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:50.743 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:50.743 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:50.743 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 48, 2023-12-20T04:44:50.743 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:50.743 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:50.743 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:50.743 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.743 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.743 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.743 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:44:50.743 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:50.743 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.743 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.744 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.744 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:44:50.744 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:50.744 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.744 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.744 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:50.744 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.744 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.744 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.744 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:44:50.744 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:50.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.744 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.744 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.745 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:44:50.745 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:50.745 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.745 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.745 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:50.745 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.745 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.745 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.745 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:44:50.745 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:50.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.745 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.745 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.745 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:44:50.746 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:50.746 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.746 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.746 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:50.746 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.746 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.746 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.746 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:44:50.746 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:50.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.746 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.746 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.746 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:44:50.747 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:44:50.747 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.747 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.747 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:44:50.747 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:44:50.747 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:44:50.747 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:44:50.747 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:50.747 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:50.747 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:50.747 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.747 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:44:50.748 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:44:50.748 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:44:50.748 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:44:50.748 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:44:50.748 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:44:50.748 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:44:50.748 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:44:50.748 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:44:50.748 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 45, 2023-12-20T04:44:50.748 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:44:50.748 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:44:50.748 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:44:50.748 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.748 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.749 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.749 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:44:50.749 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:50.749 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.749 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.749 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.749 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:44:50.749 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:50.749 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.749 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.749 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.749 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:44:50.749 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.750 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.750 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.750 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:44:50.750 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:50.750 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.750 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.750 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.750 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:44:50.750 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:50.750 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.750 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.750 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.750 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:44:50.750 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.750 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.750 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.751 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:44:50.751 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:50.751 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.751 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.751 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.751 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:44:50.751 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:50.751 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.751 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.751 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.751 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:44:50.751 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:44:50.751 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.751 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:44:50.752 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:44:50.752 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:50.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.752 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.752 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:44:50.752 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:44:50.752 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:44:50.752 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.752 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.752 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.752 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:44:50.752 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:44:50.752 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:44:50.752 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:44:50.753 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:44:50.753 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:44:50.753 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:44:50.753 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.753 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.753 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:50.753 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:44:50.753 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.753 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:44:50.753 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:50.753 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:50.753 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:50.753 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:50.753 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:50.754 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:44:50.754 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:50.754 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.754 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.754 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:44:50.754 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:50.754 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:50.754 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:50.754 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:50.754 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:50.754 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:44:50.754 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:50.754 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.754 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.754 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:44:50.755 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:50.755 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:50.755 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:50.755 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:50.755 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:50.755 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:44:50.755 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:50.755 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.755 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.755 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:44:50.755 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:50.755 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:50.755 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:50.755 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:50.755 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:50.756 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:44:50.756 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:50.756 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.756 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.756 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:44:50.756 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:50.756 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:50.756 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:50.756 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:50.756 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:50.756 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:44:50.756 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:50.756 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.756 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.756 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:44:50.757 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:50.757 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:50.757 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:50.757 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:50.757 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:50.757 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:44:50.757 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:50.757 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.757 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.757 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:44:50.757 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:50.757 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:50.757 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:50.757 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:50.758 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:50.758 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:44:50.758 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:50.758 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.758 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.758 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:44:50.758 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:44:50.758 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:44:50.758 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:44:50.758 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:44:50.758 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:44:50.758 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:44:50.758 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:44:50.758 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.758 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:50.759 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:44:50.759 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [ 2023-12-20T04:44:50.759 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.759 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "7.7", 2023-12-20T04:44:50.759 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:44:50.759 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.759 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 0, 2023-12-20T04:44:50.759 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 4 2023-12-20T04:44:50.759 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.759 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.759 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.759 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.759 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "7.30", 2023-12-20T04:44:50.759 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:44:50.759 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:44:50.760 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 0, 2023-12-20T04:44:50.760 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 5 2023-12-20T04:44:50.760 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.760 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:44:50.760 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.760 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:44:50.760 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:44:50.760 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:44:50.760 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:44:50.760 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:44:50.760 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:44:50.760 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:44:50.760 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:44:50.760 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:44:50.761 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:44:50.761 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:44:50.761 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:44:50.761 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:44:50.761 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.761 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:44:50.761 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:44:50.761 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:44:50.761 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:44:50.761 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:44:50.761 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:44:50.761 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:44:50.761 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:44:50.761 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:44:50.761 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:44:50.761 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:44:50.762 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:44:50.762 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:44:50.762 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:44:50.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.687+0000 7ff2ec44d640 1 -- 172.21.15.132:0/3827936135 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff2c806a430 msgr2=0x7ff2c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.687+0000 7ff2ec44d640 1 --2- 172.21.15.132:0/3827936135 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff2c806a430 0x7ff2c806c8f0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff2e0005880 tx=0x7ff2e0009040 comp rx=0 tx=0).stop 2023-12-20T04:44:50.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.687+0000 7ff2ec44d640 1 -- 172.21.15.132:0/3827936135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40ce2a0 msgr2=0x7ff2e40aec10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.687+0000 7ff2ec44d640 1 --2- 172.21.15.132:0/3827936135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40ce2a0 0x7ff2e40aec10 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7ff2d400c3c0 tx=0x7ff2d400c880 comp rx=0 tx=0).stop 2023-12-20T04:44:50.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.687+0000 7ff2ec44d640 1 -- 172.21.15.132:0/3827936135 shutdown_connections 2023-12-20T04:44:50.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.687+0000 7ff2ec44d640 1 --2- 172.21.15.132:0/3827936135 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff2c806a430 0x7ff2c806c8f0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.687+0000 7ff2ec44d640 1 --2- 172.21.15.132:0/3827936135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2e4160ba0 0x7ff2e4150ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.687+0000 7ff2ec44d640 1 --2- 172.21.15.132:0/3827936135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2e40ce2a0 0x7ff2e40aec10 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.687+0000 7ff2ec44d640 1 --2- 172.21.15.132:0/3827936135 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2e40cba90 0x7ff2e40b5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.687+0000 7ff2ec44d640 1 -- 172.21.15.132:0/3827936135 >> 172.21.15.132:0/3827936135 conn(0x7ff2e40cd7b0 msgr2=0x7ff2e406b160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:50.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.687+0000 7ff2ec44d640 1 -- 172.21.15.132:0/3827936135 shutdown_connections 2023-12-20T04:44:50.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.687+0000 7ff2ec44d640 1 -- 172.21.15.132:0/3827936135 wait complete. 2023-12-20T04:44:50.765 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:44:50.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.863+0000 7f974fc51640 1 Processor -- start 2023-12-20T04:44:50.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.863+0000 7f974fc51640 1 -- start start 2023-12-20T04:44:50.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974fc51640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97480d0370 0x7f97480b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974fc51640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97480b2f90 con 0x7f974815d100 2023-12-20T04:44:50.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974fc51640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f97481613c0 con 0x7f97480cdc10 2023-12-20T04:44:50.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974fc51640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97480d1b00 con 0x7f97480d0370 2023-12-20T04:44:50.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974d9ed640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f974815d100 0x7f97480cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40266/0 (socket says 172.21.15.132:40266) 2023-12-20T04:44:50.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974d9ed640 1 -- 172.21.15.132:0/1298326630 learned_addr learned my addr 172.21.15.132:0/1298326630 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:50.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974d1ec640 1 --2- 172.21.15.132:0/1298326630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97480d0370 0x7f97480b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974c9eb640 1 -- 172.21.15.132:0/1298326630 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2721926232 0 0) 0x7f973c001110 con 0x7f974815d100 2023-12-20T04:44:50.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974c9eb640 1 -- 172.21.15.132:0/1298326630 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9734003520 con 0x7f974815d100 2023-12-20T04:44:50.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974c9eb640 1 -- 172.21.15.132:0/1298326630 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1278198280 0 0) 0x7f97481613c0 con 0x7f97480cdc10 2023-12-20T04:44:50.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974c9eb640 1 -- 172.21.15.132:0/1298326630 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f973c001110 con 0x7f97480cdc10 2023-12-20T04:44:50.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974c9eb640 1 -- 172.21.15.132:0/1298326630 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2917499761 0 0) 0x7f9734003520 con 0x7f974815d100 2023-12-20T04:44:50.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974c9eb640 1 -- 172.21.15.132:0/1298326630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97480d0370 msgr2=0x7f97480b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:50.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974c9eb640 1 --2- 172.21.15.132:0/1298326630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97480d0370 0x7f97480b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974c9eb640 1 -- 172.21.15.132:0/1298326630 >> v1:172.21.15.187:6789/0 conn(0x7f97480cdc10 legacy=0x7f974806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974c9eb640 1 -- 172.21.15.132:0/1298326630 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97480d0810 con 0x7f974815d100 2023-12-20T04:44:50.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974c9eb640 1 -- 172.21.15.132:0/1298326630 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f973c001780 con 0x7f974815d100 2023-12-20T04:44:50.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974c9eb640 1 -- 172.21.15.132:0/1298326630 >> v1:172.21.15.132:6789/0 conn(0x7f974815d100 legacy=0x7f97480cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974c9eb640 1 --2- 172.21.15.132:0/1298326630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9734003b30 0x7f9734003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974c9eb640 1 --2- 172.21.15.132:0/1298326630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97480d0370 0x7f97340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974c9eb640 1 --2- 172.21.15.132:0/1298326630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9734004d00 0x7f9734005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974c9eb640 1 -- 172.21.15.132:0/1298326630 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97480d1b00 con 0x7f9734003b30 2023-12-20T04:44:50.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974c9eb640 1 -- 172.21.15.132:0/1298326630 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f973400bb40 con 0x7f9734004d00 2023-12-20T04:44:50.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974c9eb640 1 -- 172.21.15.132:0/1298326630 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f973400bd00 con 0x7f97480d0370 2023-12-20T04:44:50.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.864+0000 7f974d9ed640 1 --2- 172.21.15.132:0/1298326630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9734003b30 0x7f9734003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.865+0000 7f974d1ec640 1 --2- 172.21.15.132:0/1298326630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97480d0370 0x7f97340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.865+0000 7f974e1ee640 1 --2- 172.21.15.132:0/1298326630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9734004d00 0x7f9734005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.865+0000 7f974d9ed640 1 -- 172.21.15.132:0/1298326630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97480d0370 msgr2=0x7f97340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:50.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.865+0000 7f974d9ed640 1 --2- 172.21.15.132:0/1298326630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97480d0370 0x7f97340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.865+0000 7f974d9ed640 1 -- 172.21.15.132:0/1298326630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9734004d00 msgr2=0x7f9734005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:50.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.865+0000 7f974d9ed640 1 --2- 172.21.15.132:0/1298326630 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9734004d00 0x7f9734005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.865+0000 7f974d9ed640 1 -- 172.21.15.132:0/1298326630 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9734003520 con 0x7f9734003b30 2023-12-20T04:44:50.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.865+0000 7f974d9ed640 1 --2- 172.21.15.132:0/1298326630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9734003b30 0x7f9734003f30 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f973c007f20 tx=0x7f97340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a0a2fdf3d76f42 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:50.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.865+0000 7f974c9eb640 1 -- 172.21.15.132:0/1298326630 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c005ad0 con 0x7f9734003b30 2023-12-20T04:44:50.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.865+0000 7f974c9eb640 1 -- 172.21.15.132:0/1298326630 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c005c30 con 0x7f9734003b30 2023-12-20T04:44:50.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.865+0000 7f974c9eb640 1 -- 172.21.15.132:0/1298326630 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c007070 con 0x7f9734003b30 2023-12-20T04:44:50.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.866+0000 7f974fc51640 1 -- 172.21.15.132:0/1298326630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9734003b30 msgr2=0x7f9734003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.866+0000 7f974fc51640 1 --2- 172.21.15.132:0/1298326630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9734003b30 0x7f9734003f30 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f973c007f20 tx=0x7f97340057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.866+0000 7f974e1ee640 1 -- 172.21.15.132:0/1298326630 reap_dead start 2023-12-20T04:44:50.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.866+0000 7f974fc51640 1 -- 172.21.15.132:0/1298326630 shutdown_connections 2023-12-20T04:44:50.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.866+0000 7f974fc51640 1 -- 172.21.15.132:0/1298326630 >> 172.21.15.132:0/1298326630 conn(0x7f974806d7c0 msgr2=0x7f974806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:50.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.866+0000 7f974fc51640 1 -- 172.21.15.132:0/1298326630 shutdown_connections 2023-12-20T04:44:50.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.866+0000 7f974fc51640 1 -- 172.21.15.132:0/1298326630 wait complete. 2023-12-20T04:44:50.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.867+0000 7f974fc51640 1 Processor -- start 2023-12-20T04:44:50.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.867+0000 7f974fc51640 1 -- start start 2023-12-20T04:44:50.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974fc51640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9734003b30 0x7f97480b5fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974fc51640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97480b4a40 0x7f97481f2260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974fc51640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f974815ffa0 0x7f974815d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974fc51640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97480b5bc0 con 0x7f9734003b30 2023-12-20T04:44:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974fc51640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97480b4f40 con 0x7f974815ffa0 2023-12-20T04:44:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974fc51640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97480b5220 con 0x7f97480b4a40 2023-12-20T04:44:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974d9ed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9734003b30 0x7f97480b5fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974d9ed640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9734003b30 0x7f97480b5fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36362/0 (socket says 172.21.15.132:36362) 2023-12-20T04:44:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974d9ed640 1 -- 172.21.15.132:0/566684751 learned_addr learned my addr 172.21.15.132:0/566684751 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974d1ec640 1 --2- 172.21.15.132:0/566684751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97480b4a40 0x7f97481f2260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974e1ee640 1 --2- 172.21.15.132:0/566684751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f974815ffa0 0x7f974815d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974d9ed640 1 -- 172.21.15.132:0/566684751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97480b4a40 msgr2=0x7f97481f2260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974d9ed640 1 --2- 172.21.15.132:0/566684751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97480b4a40 0x7f97481f2260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974d9ed640 1 -- 172.21.15.132:0/566684751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f974815ffa0 msgr2=0x7f974815d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974d9ed640 1 --2- 172.21.15.132:0/566684751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f974815ffa0 0x7f974815d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:50.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974d9ed640 1 -- 172.21.15.132:0/566684751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97480b5500 con 0x7f9734003b30 2023-12-20T04:44:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974d1ec640 1 --2- 172.21.15.132:0/566684751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97480b4a40 0x7f97481f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.868+0000 7f974e1ee640 1 --2- 172.21.15.132:0/566684751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f974815ffa0 0x7f974815d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.869+0000 7f974d9ed640 1 --2- 172.21.15.132:0/566684751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9734003b30 0x7f97480b5fe0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f973c007f20 tx=0x7f973c001a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.869+0000 7f973a7fc640 1 -- 172.21.15.132:0/566684751 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c03c040 con 0x7f9734003b30 2023-12-20T04:44:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.869+0000 7f973a7fc640 1 -- 172.21.15.132:0/566684751 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f973c007500 con 0x7f9734003b30 2023-12-20T04:44:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.869+0000 7f974fc51640 1 -- 172.21.15.132:0/566684751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97480b57e0 con 0x7f9734003b30 2023-12-20T04:44:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.869+0000 7f973a7fc640 1 -- 172.21.15.132:0/566684751 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f973c02c700 con 0x7f9734003b30 2023-12-20T04:44:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.869+0000 7f974fc51640 1 -- 172.21.15.132:0/566684751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9748160410 con 0x7f9734003b30 2023-12-20T04:44:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.870+0000 7f974fc51640 1 -- 172.21.15.132:0/566684751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97480b5e30 con 0x7f9734003b30 2023-12-20T04:44:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.870+0000 7f973a7fc640 1 -- 172.21.15.132:0/566684751 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f973c032070 con 0x7f9734003b30 2023-12-20T04:44:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.870+0000 7f973a7fc640 1 --2- 172.21.15.132:0/566684751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f972c06a430 0x7f972c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.871+0000 7f973a7fc640 1 -- 172.21.15.132:0/566684751 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f973c0a9e30 con 0x7f9734003b30 2023-12-20T04:44:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.871+0000 7f974d1ec640 1 --2- 172.21.15.132:0/566684751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f972c06a430 0x7f972c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:50.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.871+0000 7f974d1ec640 1 --2- 172.21.15.132:0/566684751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f972c06a430 0x7f972c06c8f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f974806e0c0 tx=0x7f9744008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:50.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:50.875+0000 7f973a7fc640 1 -- 172.21.15.132:0/566684751 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f973c0753e0 con 0x7f9734003b30 2023-12-20T04:44:51.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.079+0000 7f974fc51640 1 -- 172.21.15.132:0/566684751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f97480b5360 con 0x7f9734003b30 2023-12-20T04:44:51.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.080+0000 7f973a7fc640 1 -- 172.21.15.132:0/566684751 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4721 (secure 0 0 0) 0x7f97480b5360 con 0x7f9734003b30 2023-12-20T04:44:51.082 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:51.082 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1456944733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1456944733},{"type":"v1","addr":"172.21.15.187:6834","nonce":1456944733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2114954856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2114954856},{"type":"v1","addr":"172.21.15.187:6835","nonce":2114954856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2494230497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2494230497},{"type":"v1","addr":"172.21.15.132:6837","nonce":2494230497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:44:17.197194+0000","modified":"2023-12-20T04:44:19.205156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/1024674556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1024674556},{"type":"v1","addr":"172.21.15.132:6836","nonce":1024674556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-20T04:44:51.082 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 19 2023-12-20T04:44:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.081+0000 7f974fc51640 1 -- 172.21.15.132:0/566684751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f972c06a430 msgr2=0x7f972c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.082+0000 7f974fc51640 1 --2- 172.21.15.132:0/566684751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f972c06a430 0x7f972c06c8f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7f974806e0c0 tx=0x7f9744008040 comp rx=0 tx=0).stop 2023-12-20T04:44:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.082+0000 7f974fc51640 1 -- 172.21.15.132:0/566684751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9734003b30 msgr2=0x7f97480b5fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.082+0000 7f974fc51640 1 --2- 172.21.15.132:0/566684751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9734003b30 0x7f97480b5fe0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f973c007f20 tx=0x7f973c001a40 comp rx=0 tx=0).stop 2023-12-20T04:44:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.082+0000 7f974fc51640 1 -- 172.21.15.132:0/566684751 shutdown_connections 2023-12-20T04:44:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.082+0000 7f974fc51640 1 --2- 172.21.15.132:0/566684751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f972c06a430 0x7f972c06c8f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.082+0000 7f974fc51640 1 --2- 172.21.15.132:0/566684751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f974815ffa0 0x7f974815d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.082+0000 7f974fc51640 1 --2- 172.21.15.132:0/566684751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97480b4a40 0x7f97481f2260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.082+0000 7f974fc51640 1 --2- 172.21.15.132:0/566684751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9734003b30 0x7f97480b5fe0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.082+0000 7f974fc51640 1 -- 172.21.15.132:0/566684751 >> 172.21.15.132:0/566684751 conn(0x7f974806d7c0 msgr2=0x7f97480b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.082+0000 7f974fc51640 1 -- 172.21.15.132:0/566684751 shutdown_connections 2023-12-20T04:44:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.082+0000 7f974fc51640 1 -- 172.21.15.132:0/566684751 wait complete. 2023-12-20T04:44:51.094 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.c.asok --format=json status 2023-12-20T04:44:51.210 INFO:teuthology.orchestra.run.smithi132.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":5685,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":34.001583134999997,"mdsmap_epoch":19,"osdmap_epoch":53,"osdmap_epoch_barrier":49,"uptime":38.765275705000001} 2023-12-20T04:44:51.210 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 5685, "mdsmap_epoch": 19, "osdmap_epoch": 53, "osdmap_epoch_barrier": 49, "rank_uptime": 34.001583135, "state": "up:active", "uptime": 38.765275705, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:44:51.210 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-20T04:44:51.210 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:44:51.210 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:44:51.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:51.226 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-20T04:44:51.485 INFO:teuthology.orchestra.run.smithi132.stderr:50+0 records in 2023-12-20T04:44:51.485 INFO:teuthology.orchestra.run.smithi132.stderr:50+0 records out 2023-12-20T04:44:51.485 INFO:teuthology.orchestra.run.smithi132.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.203257 s, 258 MB/s 2023-12-20T04:44:51.486 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:44:51.486 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:44:51.528 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:44:51.572 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:44:51.572 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:44:51.572 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:44:51.588 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:44:51.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.727+0000 7fda530e0640 1 Processor -- start 2023-12-20T04:44:51.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.727+0000 7fda530e0640 1 -- start start 2023-12-20T04:44:51.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda530e0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda4c15d110 0x7fda4c069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:51.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda530e0640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fda4c0af210 0x7fda4c06a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:51.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda530e0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fda4c161ce0 con 0x7fda4c15d4f0 2023-12-20T04:44:51.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda530e0640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fda4c0aca50 con 0x7fda4c0af210 2023-12-20T04:44:51.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda530e0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c160df0 con 0x7fda4c15d110 2023-12-20T04:44:51.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fda4c15d4f0 0x7fda4c0aeb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40272/0 (socket says 172.21.15.132:40272) 2023-12-20T04:44:51.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4bfff640 1 -- 172.21.15.132:0/2025450642 learned_addr learned my addr 172.21.15.132:0/2025450642 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:51.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda5167d640 1 --2- 172.21.15.132:0/2025450642 >> v2:172.21.15.187:3300/0 conn(0x7fda4c0af210 0x7fda4c06a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:51.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda50e7c640 1 --2- 172.21.15.132:0/2025450642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda4c15d110 0x7fda4c069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:51.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4b7fe640 1 -- 172.21.15.132:0/2025450642 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736713674 0 0) 0x7fda4c161ce0 con 0x7fda4c15d4f0 2023-12-20T04:44:51.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4b7fe640 1 -- 172.21.15.132:0/2025450642 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fda3c003520 con 0x7fda4c15d4f0 2023-12-20T04:44:51.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4b7fe640 1 -- 172.21.15.132:0/2025450642 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3495823693 0 0) 0x7fda3c003520 con 0x7fda4c15d4f0 2023-12-20T04:44:51.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4b7fe640 1 -- 172.21.15.132:0/2025450642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda4c15d110 msgr2=0x7fda4c069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:51.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4b7fe640 1 --2- 172.21.15.132:0/2025450642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda4c15d110 0x7fda4c069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:51.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4b7fe640 1 -- 172.21.15.132:0/2025450642 >> v2:172.21.15.187:3300/0 conn(0x7fda4c0af210 msgr2=0x7fda4c06a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:51.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4b7fe640 1 --2- 172.21.15.132:0/2025450642 >> v2:172.21.15.187:3300/0 conn(0x7fda4c0af210 0x7fda4c06a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:51.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4b7fe640 1 -- 172.21.15.132:0/2025450642 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c1610d0 con 0x7fda4c15d4f0 2023-12-20T04:44:51.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4b7fe640 1 -- 172.21.15.132:0/2025450642 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fda38001670 con 0x7fda4c15d4f0 2023-12-20T04:44:51.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4b7fe640 1 -- 172.21.15.132:0/2025450642 >> v1:172.21.15.132:6789/0 conn(0x7fda4c15d4f0 legacy=0x7fda4c0aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:51.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4b7fe640 1 --2- 172.21.15.132:0/2025450642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda3c003970 0x7fda3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:51.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4b7fe640 1 --2- 172.21.15.132:0/2025450642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3c0047c0 0x7fda3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:51.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4b7fe640 1 --2- 172.21.15.132:0/2025450642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda4c15d110 0x7fda3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:51.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4b7fe640 1 -- 172.21.15.132:0/2025450642 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c0aca50 con 0x7fda3c003970 2023-12-20T04:44:51.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4b7fe640 1 -- 172.21.15.132:0/2025450642 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c160df0 con 0x7fda3c0047c0 2023-12-20T04:44:51.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda4b7fe640 1 -- 172.21.15.132:0/2025450642 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda3c00b980 con 0x7fda4c15d110 2023-12-20T04:44:51.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.728+0000 7fda50e7c640 1 --2- 172.21.15.132:0/2025450642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda3c003970 0x7fda3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:51.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.729+0000 7fda5167d640 1 --2- 172.21.15.132:0/2025450642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda4c15d110 0x7fda3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:51.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.729+0000 7fda4bfff640 1 --2- 172.21.15.132:0/2025450642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3c0047c0 0x7fda3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:51.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.729+0000 7fda50e7c640 1 -- 172.21.15.132:0/2025450642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda4c15d110 msgr2=0x7fda3c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:51.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.729+0000 7fda50e7c640 1 --2- 172.21.15.132:0/2025450642 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda4c15d110 0x7fda3c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:51.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.729+0000 7fda50e7c640 1 -- 172.21.15.132:0/2025450642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3c0047c0 msgr2=0x7fda3c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:51.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.729+0000 7fda50e7c640 1 --2- 172.21.15.132:0/2025450642 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda3c0047c0 0x7fda3c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:51.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.729+0000 7fda50e7c640 1 -- 172.21.15.132:0/2025450642 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda3c003520 con 0x7fda3c003970 2023-12-20T04:44:51.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.729+0000 7fda50e7c640 1 --2- 172.21.15.132:0/2025450642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda3c003970 0x7fda3c003d90 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fda40009ab0 tx=0x7fda3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6343391417dd92e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:51.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.730+0000 7fda4b7fe640 1 -- 172.21.15.132:0/2025450642 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40005990 con 0x7fda3c003970 2023-12-20T04:44:51.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.730+0000 7fda4b7fe640 1 -- 172.21.15.132:0/2025450642 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda40005af0 con 0x7fda3c003970 2023-12-20T04:44:51.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.730+0000 7fda4b7fe640 1 -- 172.21.15.132:0/2025450642 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda40005ea0 con 0x7fda3c003970 2023-12-20T04:44:51.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.730+0000 7fda530e0640 1 -- 172.21.15.132:0/2025450642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda3c003970 msgr2=0x7fda3c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:51.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.730+0000 7fda530e0640 1 --2- 172.21.15.132:0/2025450642 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda3c003970 0x7fda3c003d90 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fda40009ab0 tx=0x7fda3c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:51.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.730+0000 7fda5167d640 1 -- 172.21.15.132:0/2025450642 reap_dead start 2023-12-20T04:44:51.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.730+0000 7fda530e0640 1 -- 172.21.15.132:0/2025450642 shutdown_connections 2023-12-20T04:44:51.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.730+0000 7fda530e0640 1 -- 172.21.15.132:0/2025450642 >> 172.21.15.132:0/2025450642 conn(0x7fda4c0cfbd0 msgr2=0x7fda4c0cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:51.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.730+0000 7fda530e0640 1 -- 172.21.15.132:0/2025450642 shutdown_connections 2023-12-20T04:44:51.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.730+0000 7fda530e0640 1 -- 172.21.15.132:0/2025450642 wait complete. 2023-12-20T04:44:51.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.731+0000 7fda530e0640 1 Processor -- start 2023-12-20T04:44:51.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.731+0000 7fda530e0640 1 -- start start 2023-12-20T04:44:51.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.732+0000 7fda530e0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda3c003970 0x7fda4c1f6cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:51.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.732+0000 7fda530e0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda4c06e950 0x7fda4c151880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:51.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.732+0000 7fda530e0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda4c0c7ce0 0x7fda4c0c8160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:51.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.732+0000 7fda530e0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c15d8d0 con 0x7fda4c0c7ce0 2023-12-20T04:44:51.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.732+0000 7fda530e0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c0c86a0 con 0x7fda4c06e950 2023-12-20T04:44:51.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.732+0000 7fda530e0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fda4c1597a0 con 0x7fda3c003970 2023-12-20T04:44:51.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.732+0000 7fda5167d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda4c0c7ce0 0x7fda4c0c8160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:51.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.732+0000 7fda5167d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda4c0c7ce0 0x7fda4c0c8160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36370/0 (socket says 172.21.15.132:36370) 2023-12-20T04:44:51.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.732+0000 7fda5167d640 1 -- 172.21.15.132:0/1442531195 learned_addr learned my addr 172.21.15.132:0/1442531195 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:51.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.732+0000 7fda5167d640 1 -- 172.21.15.132:0/1442531195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda3c003970 msgr2=0x7fda4c1f6cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:51.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.732+0000 7fda5167d640 1 --2- 172.21.15.132:0/1442531195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda3c003970 0x7fda4c1f6cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:51.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.732+0000 7fda5167d640 1 -- 172.21.15.132:0/1442531195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda4c06e950 msgr2=0x7fda4c151880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:51.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.732+0000 7fda5167d640 1 --2- 172.21.15.132:0/1442531195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda4c06e950 0x7fda4c151880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:51.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.732+0000 7fda5167d640 1 -- 172.21.15.132:0/1442531195 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fda4c1f7210 con 0x7fda4c0c7ce0 2023-12-20T04:44:51.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.733+0000 7fda5167d640 1 --2- 172.21.15.132:0/1442531195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda4c0c7ce0 0x7fda4c0c8160 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0d0c10 tx=0x7fda4400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:51.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.733+0000 7fda497fa640 1 -- 172.21.15.132:0/1442531195 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda4400e040 con 0x7fda4c0c7ce0 2023-12-20T04:44:51.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.733+0000 7fda497fa640 1 -- 172.21.15.132:0/1442531195 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fda4400f040 con 0x7fda4c0c7ce0 2023-12-20T04:44:51.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.733+0000 7fda530e0640 1 -- 172.21.15.132:0/1442531195 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fda4c06d8c0 con 0x7fda4c0c7ce0 2023-12-20T04:44:51.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.733+0000 7fda497fa640 1 -- 172.21.15.132:0/1442531195 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fda44015670 con 0x7fda4c0c7ce0 2023-12-20T04:44:51.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.733+0000 7fda530e0640 1 -- 172.21.15.132:0/1442531195 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fda4c06de80 con 0x7fda4c0c7ce0 2023-12-20T04:44:51.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.734+0000 7fda530e0640 1 -- 172.21.15.132:0/1442531195 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fda4c04e840 con 0x7fda4c0c7ce0 2023-12-20T04:44:51.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.734+0000 7fda497fa640 1 -- 172.21.15.132:0/1442531195 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fda440157d0 con 0x7fda4c0c7ce0 2023-12-20T04:44:51.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.735+0000 7fda497fa640 1 --2- 172.21.15.132:0/1442531195 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fda3006a430 0x7fda3006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:51.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.735+0000 7fda497fa640 1 -- 172.21.15.132:0/1442531195 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fda44089370 con 0x7fda4c0c7ce0 2023-12-20T04:44:51.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.735+0000 7fda50e7c640 1 --2- 172.21.15.132:0/1442531195 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fda3006a430 0x7fda3006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:51.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.735+0000 7fda50e7c640 1 --2- 172.21.15.132:0/1442531195 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fda3006a430 0x7fda3006c8f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fda40035000 tx=0x7fda4002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:51.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.739+0000 7fda497fa640 1 -- 172.21.15.132:0/1442531195 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fda440549b0 con 0x7fda4c0c7ce0 2023-12-20T04:44:51.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.906+0000 7fda530e0640 1 -- 172.21.15.132:0/1442531195 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fda4c160b30 con 0x7fda4c0c7ce0 2023-12-20T04:44:51.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.907+0000 7fda497fa640 1 -- 172.21.15.132:0/1442531195 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16188 (secure 0 0 0) 0x7fda44057fd0 con 0x7fda4c0c7ce0 2023-12-20T04:44:51.908 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:51.908 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":53,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:44:45.942314+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:44:15.033177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-20T04:44:16.130594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.30","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:44:51.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.909+0000 7fda530e0640 1 -- 172.21.15.132:0/1442531195 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fda3006a430 msgr2=0x7fda3006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:51.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.909+0000 7fda530e0640 1 --2- 172.21.15.132:0/1442531195 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fda3006a430 0x7fda3006c8f0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7fda40035000 tx=0x7fda4002e000 comp rx=0 tx=0).stop 2023-12-20T04:44:51.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.910+0000 7fda530e0640 1 -- 172.21.15.132:0/1442531195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda4c0c7ce0 msgr2=0x7fda4c0c8160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:51.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.910+0000 7fda530e0640 1 --2- 172.21.15.132:0/1442531195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda4c0c7ce0 0x7fda4c0c8160 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fda4c0d0c10 tx=0x7fda4400f580 comp rx=0 tx=0).stop 2023-12-20T04:44:51.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.910+0000 7fda530e0640 1 -- 172.21.15.132:0/1442531195 shutdown_connections 2023-12-20T04:44:51.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.910+0000 7fda530e0640 1 --2- 172.21.15.132:0/1442531195 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fda3006a430 0x7fda3006c8f0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:51.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.910+0000 7fda530e0640 1 --2- 172.21.15.132:0/1442531195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fda4c0c7ce0 0x7fda4c0c8160 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:51.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.910+0000 7fda530e0640 1 --2- 172.21.15.132:0/1442531195 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fda4c06e950 0x7fda4c151880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:51.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.910+0000 7fda530e0640 1 --2- 172.21.15.132:0/1442531195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fda3c003970 0x7fda4c1f6cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:51.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.910+0000 7fda530e0640 1 -- 172.21.15.132:0/1442531195 >> 172.21.15.132:0/1442531195 conn(0x7fda4c0cfbd0 msgr2=0x7fda4c0ca290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:51.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.910+0000 7fda530e0640 1 -- 172.21.15.132:0/1442531195 shutdown_connections 2023-12-20T04:44:51.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:51.910+0000 7fda530e0640 1 -- 172.21.15.132:0/1442531195 wait complete. 2023-12-20T04:44:51.922 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:44:15.033177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:44:16.130594+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:44:51.922 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:44:52.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.025+0000 7f3f20dab640 1 Processor -- start 2023-12-20T04:44:52.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.025+0000 7f3f20dab640 1 -- start start 2023-12-20T04:44:52.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.026+0000 7f3f20dab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f1c0c41f0 0x7f3f1c0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.026+0000 7f3f20dab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f1c1439f0 con 0x7f3f1c143610 2023-12-20T04:44:52.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.026+0000 7f3f20dab640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f1c0c46f0 con 0x7f3f1c0cd950 2023-12-20T04:44:52.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.026+0000 7f3f20dab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1c0c49d0 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.026+0000 7f3f1ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f1c0c41f0 0x7f3f1c0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.026+0000 7f3f1a59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3f1c143610 0x7f3f1c0cd240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40274/0 (socket says 172.21.15.132:40274) 2023-12-20T04:44:52.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.026+0000 7f3f1a59c640 1 -- 172.21.15.132:0/4111856181 learned_addr learned my addr 172.21.15.132:0/4111856181 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:52.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.026+0000 7f3f1ad9d640 1 -- 172.21.15.132:0/4111856181 >> v1:172.21.15.187:6789/0 conn(0x7f3f1c0cd950 legacy=0x7f3f1c06b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:52.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.026+0000 7f3f1ad9d640 1 -- 172.21.15.132:0/4111856181 >> v1:172.21.15.132:6789/0 conn(0x7f3f1c143610 legacy=0x7f3f1c0cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.027+0000 7f3f1ad9d640 1 -- 172.21.15.132:0/4111856181 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f1c0c4cb0 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.027+0000 7f3f1ad9d640 1 --2- 172.21.15.132:0/4111856181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f1c0c41f0 0x7f3f1c0caa40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3f140097a0 tx=0x7f3f1402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfd05ea212ab546b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:52.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.027+0000 7f3f1959a640 1 -- 172.21.15.132:0/4111856181 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f14031830 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.027+0000 7f3f1959a640 1 -- 172.21.15.132:0/4111856181 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f14031990 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.027+0000 7f3f1959a640 1 -- 172.21.15.132:0/4111856181 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f14031d20 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.028+0000 7f3f20dab640 1 -- 172.21.15.132:0/4111856181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f1c0c41f0 msgr2=0x7f3f1c0caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.028+0000 7f3f20dab640 1 --2- 172.21.15.132:0/4111856181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f1c0c41f0 0x7f3f1c0caa40 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f3f140097a0 tx=0x7f3f1402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.028+0000 7f3f20dab640 1 -- 172.21.15.132:0/4111856181 shutdown_connections 2023-12-20T04:44:52.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.028+0000 7f3f20dab640 1 --2- 172.21.15.132:0/4111856181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f1c0c41f0 0x7f3f1c0caa40 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.028+0000 7f3f20dab640 1 -- 172.21.15.132:0/4111856181 >> 172.21.15.132:0/4111856181 conn(0x7f3f1c06a260 msgr2=0x7f3f1c0b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:52.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.028+0000 7f3f20dab640 1 -- 172.21.15.132:0/4111856181 shutdown_connections 2023-12-20T04:44:52.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.028+0000 7f3f20dab640 1 -- 172.21.15.132:0/4111856181 wait complete. 2023-12-20T04:44:52.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.029+0000 7f3f20dab640 1 Processor -- start 2023-12-20T04:44:52.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.029+0000 7f3f20dab640 1 -- start start 2023-12-20T04:44:52.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.030+0000 7f3f20dab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f1c0c41f0 0x7f3f1c141780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.030+0000 7f3f20dab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f1c0cd950 0x7f3f1c1592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.030+0000 7f3f20dab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1c143610 0x7f3f1c1597f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.030+0000 7f3f20dab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c159d30 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.030+0000 7f3f20dab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c1f1610 con 0x7f3f1c143610 2023-12-20T04:44:52.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.030+0000 7f3f20dab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1c0b46b0 con 0x7f3f1c0cd950 2023-12-20T04:44:52.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.030+0000 7f3f1a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f1c0c41f0 0x7f3f1c141780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.030+0000 7f3f1a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f1c0c41f0 0x7f3f1c141780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36390/0 (socket says 172.21.15.132:36390) 2023-12-20T04:44:52.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.030+0000 7f3f1a59c640 1 -- 172.21.15.132:0/804143953 learned_addr learned my addr 172.21.15.132:0/804143953 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:52.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.030+0000 7f3f19d9b640 1 --2- 172.21.15.132:0/804143953 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f1c0cd950 0x7f3f1c1592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.030+0000 7f3f1ad9d640 1 --2- 172.21.15.132:0/804143953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1c143610 0x7f3f1c1597f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.030+0000 7f3f1a59c640 1 -- 172.21.15.132:0/804143953 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f1c0cd950 msgr2=0x7f3f1c1592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.030+0000 7f3f1a59c640 1 --2- 172.21.15.132:0/804143953 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f1c0cd950 0x7f3f1c1592b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.030+0000 7f3f1a59c640 1 -- 172.21.15.132:0/804143953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1c143610 msgr2=0x7f3f1c1597f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.030+0000 7f3f1a59c640 1 --2- 172.21.15.132:0/804143953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1c143610 0x7f3f1c1597f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.030+0000 7f3f1a59c640 1 -- 172.21.15.132:0/804143953 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f14009400 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.031+0000 7f3f1a59c640 1 --2- 172.21.15.132:0/804143953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f1c0c41f0 0x7f3f1c141780 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00cac0 tx=0x7f3f0c00cf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:52.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.031+0000 7f3f0affd640 1 -- 172.21.15.132:0/804143953 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c00ac30 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.031+0000 7f3f0affd640 1 -- 172.21.15.132:0/804143953 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0c00ad90 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.031+0000 7f3f20dab640 1 -- 172.21.15.132:0/804143953 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f1c1f1820 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.031+0000 7f3f0affd640 1 -- 172.21.15.132:0/804143953 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c012620 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.031+0000 7f3f20dab640 1 -- 172.21.15.132:0/804143953 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f1c1f1de0 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.032+0000 7f3f20dab640 1 -- 172.21.15.132:0/804143953 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1c04e840 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.032+0000 7f3f0affd640 1 -- 172.21.15.132:0/804143953 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3f0c007070 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.032+0000 7f3f0affd640 1 --2- 172.21.15.132:0/804143953 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3efc06a460 0x7f3efc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.033+0000 7f3f19d9b640 1 --2- 172.21.15.132:0/804143953 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3efc06a460 0x7f3efc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.033+0000 7f3f0affd640 1 -- 172.21.15.132:0/804143953 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3f0c088890 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.033+0000 7f3f19d9b640 1 --2- 172.21.15.132:0/804143953 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3efc06a460 0x7f3efc06c920 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c139250 tx=0x7f3f10009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:52.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.037+0000 7f3f0affd640 1 -- 172.21.15.132:0/804143953 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3f0c053e40 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.202+0000 7f3f20dab640 1 -- 172.21.15.132:0/804143953 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f3f1c0c3fd0 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.202+0000 7f3f0affd640 1 -- 172.21.15.132:0/804143953 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f3f0c017020 con 0x7f3f1c0c41f0 2023-12-20T04:44:52.203 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:44:52.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.204+0000 7f3f20dab640 1 -- 172.21.15.132:0/804143953 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3efc06a460 msgr2=0x7f3efc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.204+0000 7f3f20dab640 1 --2- 172.21.15.132:0/804143953 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3efc06a460 0x7f3efc06c920 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f3f1c139250 tx=0x7f3f10009040 comp rx=0 tx=0).stop 2023-12-20T04:44:52.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.204+0000 7f3f20dab640 1 -- 172.21.15.132:0/804143953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f1c0c41f0 msgr2=0x7f3f1c141780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.204+0000 7f3f20dab640 1 --2- 172.21.15.132:0/804143953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f1c0c41f0 0x7f3f1c141780 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c00cac0 tx=0x7f3f0c00cf80 comp rx=0 tx=0).stop 2023-12-20T04:44:52.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.204+0000 7f3f20dab640 1 -- 172.21.15.132:0/804143953 shutdown_connections 2023-12-20T04:44:52.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.204+0000 7f3f20dab640 1 --2- 172.21.15.132:0/804143953 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3efc06a460 0x7f3efc06c920 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.204+0000 7f3f20dab640 1 --2- 172.21.15.132:0/804143953 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1c143610 0x7f3f1c1597f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.204+0000 7f3f20dab640 1 --2- 172.21.15.132:0/804143953 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f1c0cd950 0x7f3f1c1592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.204+0000 7f3f20dab640 1 --2- 172.21.15.132:0/804143953 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f1c0c41f0 0x7f3f1c141780 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.204+0000 7f3f20dab640 1 -- 172.21.15.132:0/804143953 >> 172.21.15.132:0/804143953 conn(0x7f3f1c06a260 msgr2=0x7f3f1c0cd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:52.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.204+0000 7f3f20dab640 1 -- 172.21.15.132:0/804143953 shutdown_connections 2023-12-20T04:44:52.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.204+0000 7f3f20dab640 1 -- 172.21.15.132:0/804143953 wait complete. 2023-12-20T04:44:52.217 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:44:52.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.318+0000 7f4e4853c640 1 Processor -- start 2023-12-20T04:44:52.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.318+0000 7f4e4853c640 1 -- start start 2023-12-20T04:44:52.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.319+0000 7f4e4853c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4e400cd950 0x7f4e400caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.319+0000 7f4e4853c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e400c41f0 0x7f4e4006b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.319+0000 7f4e4853c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e401439f0 con 0x7f4e40143610 2023-12-20T04:44:52.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.319+0000 7f4e4853c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e400c46f0 con 0x7f4e400cd950 2023-12-20T04:44:52.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.319+0000 7f4e4853c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e400c49d0 con 0x7f4e400c41f0 2023-12-20T04:44:52.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.319+0000 7f4e45ad7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4e400cd950 0x7f4e400caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.319+0000 7f4e462d8640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4e40143610 0x7f4e400cd240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40276/0 (socket says 172.21.15.132:40276) 2023-12-20T04:44:52.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.319+0000 7f4e462d8640 1 -- 172.21.15.132:0/1041259987 learned_addr learned my addr 172.21.15.132:0/1041259987 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:52.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.319+0000 7f4e45ad7640 1 -- 172.21.15.132:0/1041259987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e400c41f0 msgr2=0x7f4e4006b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:52.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.319+0000 7f4e45ad7640 1 --2- 172.21.15.132:0/1041259987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e400c41f0 0x7f4e4006b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.319+0000 7f4e45ad7640 1 -- 172.21.15.132:0/1041259987 >> v1:172.21.15.132:6789/0 conn(0x7f4e40143610 legacy=0x7f4e400cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.319+0000 7f4e452d6640 1 -- 172.21.15.132:0/1041259987 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1637773306 0 0) 0x7f4e401439f0 con 0x7f4e40143610 2023-12-20T04:44:52.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.319+0000 7f4e45ad7640 1 -- 172.21.15.132:0/1041259987 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e400c4cb0 con 0x7f4e400cd950 2023-12-20T04:44:52.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.320+0000 7f4e45ad7640 1 --2- 172.21.15.132:0/1041259987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e400cd950 0x7f4e400caa40 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000ba40 tx=0x7f4e3002e0a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=61deb91cc31cc45f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:52.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.320+0000 7f4e452d6640 1 -- 172.21.15.132:0/1041259987 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3002ee50 con 0x7f4e400cd950 2023-12-20T04:44:52.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.320+0000 7f4e452d6640 1 -- 172.21.15.132:0/1041259987 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e30036440 con 0x7f4e400cd950 2023-12-20T04:44:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.320+0000 7f4e452d6640 1 -- 172.21.15.132:0/1041259987 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e300367d0 con 0x7f4e400cd950 2023-12-20T04:44:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.321+0000 7f4e4853c640 1 -- 172.21.15.132:0/1041259987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e400cd950 msgr2=0x7f4e400caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.321+0000 7f4e4853c640 1 --2- 172.21.15.132:0/1041259987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e400cd950 0x7f4e400caa40 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f4e3000ba40 tx=0x7f4e3002e0a0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.321+0000 7f4e4853c640 1 -- 172.21.15.132:0/1041259987 shutdown_connections 2023-12-20T04:44:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.321+0000 7f4e4853c640 1 --2- 172.21.15.132:0/1041259987 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e400c41f0 0x7f4e4006b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.321+0000 7f4e4853c640 1 --2- 172.21.15.132:0/1041259987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e400cd950 0x7f4e400caa40 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.321+0000 7f4e4853c640 1 -- 172.21.15.132:0/1041259987 >> 172.21.15.132:0/1041259987 conn(0x7f4e4006a260 msgr2=0x7f4e400b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.321+0000 7f4e4853c640 1 -- 172.21.15.132:0/1041259987 shutdown_connections 2023-12-20T04:44:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.321+0000 7f4e4853c640 1 -- 172.21.15.132:0/1041259987 wait complete. 2023-12-20T04:44:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.322+0000 7f4e4853c640 1 Processor -- start 2023-12-20T04:44:52.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.322+0000 7f4e4853c640 1 -- start start 2023-12-20T04:44:52.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e4853c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e400c41f0 0x7f4e400b2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e4853c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e400cd950 0x7f4e4015db20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e4853c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e40143610 0x7f4e40141320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e4853c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e400b2750 con 0x7f4e40143610 2023-12-20T04:44:52.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e4853c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e400b34f0 con 0x7f4e400c41f0 2023-12-20T04:44:52.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e4853c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e400b37d0 con 0x7f4e400cd950 2023-12-20T04:44:52.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e46ad9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e40143610 0x7f4e40141320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e46ad9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e40143610 0x7f4e40141320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36410/0 (socket says 172.21.15.132:36410) 2023-12-20T04:44:52.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e46ad9640 1 -- 172.21.15.132:0/355372496 learned_addr learned my addr 172.21.15.132:0/355372496 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:52.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e45ad7640 1 --2- 172.21.15.132:0/355372496 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e400cd950 0x7f4e4015db20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e462d8640 1 --2- 172.21.15.132:0/355372496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e400c41f0 0x7f4e400b2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e46ad9640 1 -- 172.21.15.132:0/355372496 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e400cd950 msgr2=0x7f4e4015db20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e46ad9640 1 --2- 172.21.15.132:0/355372496 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e400cd950 0x7f4e4015db20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e46ad9640 1 -- 172.21.15.132:0/355372496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e400c41f0 msgr2=0x7f4e400b2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e46ad9640 1 --2- 172.21.15.132:0/355372496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e400c41f0 0x7f4e400b2210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e46ad9640 1 -- 172.21.15.132:0/355372496 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3000b6a0 con 0x7f4e40143610 2023-12-20T04:44:52.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e45ad7640 1 --2- 172.21.15.132:0/355372496 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e400cd950 0x7f4e4015db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e46ad9640 1 --2- 172.21.15.132:0/355372496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e40143610 0x7f4e40141320 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800b9e0 tx=0x7f4e3800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e36ffd640 1 -- 172.21.15.132:0/355372496 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e3800cb20 con 0x7f4e40143610 2023-12-20T04:44:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e36ffd640 1 -- 172.21.15.132:0/355372496 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e3800cca0 con 0x7f4e40143610 2023-12-20T04:44:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e4853c640 1 -- 172.21.15.132:0/355372496 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e400b3ab0 con 0x7f4e40143610 2023-12-20T04:44:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e36ffd640 1 -- 172.21.15.132:0/355372496 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e38014680 con 0x7f4e40143610 2023-12-20T04:44:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.323+0000 7f4e4853c640 1 -- 172.21.15.132:0/355372496 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e400b4070 con 0x7f4e40143610 2023-12-20T04:44:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.324+0000 7f4e4853c640 1 -- 172.21.15.132:0/355372496 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e400b4260 con 0x7f4e40143610 2023-12-20T04:44:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.325+0000 7f4e36ffd640 1 -- 172.21.15.132:0/355372496 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4e3801d3b0 con 0x7f4e40143610 2023-12-20T04:44:52.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.325+0000 7f4e36ffd640 1 --2- 172.21.15.132:0/355372496 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e2406a460 0x7f4e2406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.325+0000 7f4e36ffd640 1 -- 172.21.15.132:0/355372496 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4e380887d0 con 0x7f4e40143610 2023-12-20T04:44:52.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.325+0000 7f4e462d8640 1 --2- 172.21.15.132:0/355372496 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e2406a460 0x7f4e2406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.326+0000 7f4e462d8640 1 --2- 172.21.15.132:0/355372496 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e2406a460 0x7f4e2406c920 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c000f60 tx=0x7f4e3c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:52.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.329+0000 7f4e36ffd640 1 -- 172.21.15.132:0/355372496 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4e38053d80 con 0x7f4e40143610 2023-12-20T04:44:52.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.495+0000 7f4e4853c640 1 -- 172.21.15.132:0/355372496 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4e4004e840 con 0x7f4e40143610 2023-12-20T04:44:52.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.495+0000 7f4e36ffd640 1 -- 172.21.15.132:0/355372496 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4e380190a0 con 0x7f4e40143610 2023-12-20T04:44:52.496 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:44:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.497+0000 7f4e4853c640 1 -- 172.21.15.132:0/355372496 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e2406a460 msgr2=0x7f4e2406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.497+0000 7f4e4853c640 1 --2- 172.21.15.132:0/355372496 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e2406a460 0x7f4e2406c920 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f4e3c000f60 tx=0x7f4e3c009040 comp rx=0 tx=0).stop 2023-12-20T04:44:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.497+0000 7f4e4853c640 1 -- 172.21.15.132:0/355372496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e40143610 msgr2=0x7f4e40141320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.497+0000 7f4e4853c640 1 --2- 172.21.15.132:0/355372496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e40143610 0x7f4e40141320 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f4e3800b9e0 tx=0x7f4e3800bea0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.497+0000 7f4e4853c640 1 -- 172.21.15.132:0/355372496 shutdown_connections 2023-12-20T04:44:52.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.497+0000 7f4e4853c640 1 --2- 172.21.15.132:0/355372496 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e2406a460 0x7f4e2406c920 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.497+0000 7f4e4853c640 1 --2- 172.21.15.132:0/355372496 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e40143610 0x7f4e40141320 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.497+0000 7f4e4853c640 1 --2- 172.21.15.132:0/355372496 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e400cd950 0x7f4e4015db20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.497+0000 7f4e4853c640 1 --2- 172.21.15.132:0/355372496 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e400c41f0 0x7f4e400b2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.497+0000 7f4e4853c640 1 -- 172.21.15.132:0/355372496 >> 172.21.15.132:0/355372496 conn(0x7f4e4006a260 msgr2=0x7f4e4006c320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.497+0000 7f4e4853c640 1 -- 172.21.15.132:0/355372496 shutdown_connections 2023-12-20T04:44:52.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.497+0000 7f4e4853c640 1 -- 172.21.15.132:0/355372496 wait complete. 2023-12-20T04:44:52.509 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:44:52.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.610+0000 7fcf68cd5640 1 Processor -- start 2023-12-20T04:44:52.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.610+0000 7fcf68cd5640 1 -- start start 2023-12-20T04:44:52.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.611+0000 7fcf68cd5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf6415ef90 0x7fcf6415f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.611+0000 7fcf68cd5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf640c9fc0 0x7fcf640ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.611+0000 7fcf68cd5640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6415f8b0 con 0x7fcf64071460 2023-12-20T04:44:52.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.611+0000 7fcf68cd5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6415b300 con 0x7fcf6415ef90 2023-12-20T04:44:52.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.611+0000 7fcf68cd5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6406bfc0 con 0x7fcf640c9fc0 2023-12-20T04:44:52.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.611+0000 7fcf6259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf6415ef90 0x7fcf6415f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.611+0000 7fcf6259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf6415ef90 0x7fcf6415f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36416/0 (socket says 172.21.15.132:36416) 2023-12-20T04:44:52.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.611+0000 7fcf6259c640 1 -- 172.21.15.132:0/3734493764 learned_addr learned my addr 172.21.15.132:0/3734493764 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:52.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.611+0000 7fcf6259c640 1 -- 172.21.15.132:0/3734493764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf640c9fc0 msgr2=0x7fcf640ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:52.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.611+0000 7fcf6259c640 1 --2- 172.21.15.132:0/3734493764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf640c9fc0 0x7fcf640ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.611+0000 7fcf6259c640 1 -- 172.21.15.132:0/3734493764 >> v1:172.21.15.187:6789/0 conn(0x7fcf64071460 legacy=0x7fcf640718a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:52.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.611+0000 7fcf6259c640 1 -- 172.21.15.132:0/3734493764 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6406c2a0 con 0x7fcf6415ef90 2023-12-20T04:44:52.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.612+0000 7fcf6259c640 1 --2- 172.21.15.132:0/3734493764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6415ef90 0x7fcf6415f370 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009e50 tx=0x7fcf5402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d197a7b530cf67a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:52.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.612+0000 7fcf6159a640 1 -- 172.21.15.132:0/3734493764 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5402ca70 con 0x7fcf6415ef90 2023-12-20T04:44:52.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.612+0000 7fcf6159a640 1 -- 172.21.15.132:0/3734493764 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5402cbd0 con 0x7fcf6415ef90 2023-12-20T04:44:52.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.612+0000 7fcf6159a640 1 -- 172.21.15.132:0/3734493764 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf540343f0 con 0x7fcf6415ef90 2023-12-20T04:44:52.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.613+0000 7fcf68cd5640 1 -- 172.21.15.132:0/3734493764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6415ef90 msgr2=0x7fcf6415f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.613+0000 7fcf68cd5640 1 --2- 172.21.15.132:0/3734493764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6415ef90 0x7fcf6415f370 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fcf54009e50 tx=0x7fcf5402bed0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.613+0000 7fcf68cd5640 1 -- 172.21.15.132:0/3734493764 shutdown_connections 2023-12-20T04:44:52.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.613+0000 7fcf68cd5640 1 --2- 172.21.15.132:0/3734493764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf640c9fc0 0x7fcf640ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.613+0000 7fcf68cd5640 1 --2- 172.21.15.132:0/3734493764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6415ef90 0x7fcf6415f370 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.613+0000 7fcf68cd5640 1 -- 172.21.15.132:0/3734493764 >> 172.21.15.132:0/3734493764 conn(0x7fcf640cf2d0 msgr2=0x7fcf640cf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:52.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.613+0000 7fcf68cd5640 1 -- 172.21.15.132:0/3734493764 shutdown_connections 2023-12-20T04:44:52.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.613+0000 7fcf68cd5640 1 -- 172.21.15.132:0/3734493764 wait complete. 2023-12-20T04:44:52.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.614+0000 7fcf68cd5640 1 Processor -- start 2023-12-20T04:44:52.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.614+0000 7fcf68cd5640 1 -- start start 2023-12-20T04:44:52.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.615+0000 7fcf68cd5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf64071460 0x7fcf64159860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.615+0000 7fcf68cd5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf640c9fc0 0x7fcf640c4af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.615+0000 7fcf68cd5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf6415ef90 0x7fcf6415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.615+0000 7fcf68cd5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640c6040 con 0x7fcf640c9fc0 2023-12-20T04:44:52.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.615+0000 7fcf68cd5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf64159da0 con 0x7fcf64071460 2023-12-20T04:44:52.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.615+0000 7fcf68cd5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf640c5430 con 0x7fcf6415ef90 2023-12-20T04:44:52.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.615+0000 7fcf61d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf640c9fc0 0x7fcf640c4af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.615+0000 7fcf61d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf640c9fc0 0x7fcf640c4af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36430/0 (socket says 172.21.15.132:36430) 2023-12-20T04:44:52.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.615+0000 7fcf61d9b640 1 -- 172.21.15.132:0/4120621348 learned_addr learned my addr 172.21.15.132:0/4120621348 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:52.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.615+0000 7fcf6259c640 1 --2- 172.21.15.132:0/4120621348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf64071460 0x7fcf64159860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.615+0000 7fcf62d9d640 1 --2- 172.21.15.132:0/4120621348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf6415ef90 0x7fcf6415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.615+0000 7fcf61d9b640 1 -- 172.21.15.132:0/4120621348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf6415ef90 msgr2=0x7fcf6415cc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.615+0000 7fcf61d9b640 1 --2- 172.21.15.132:0/4120621348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf6415ef90 0x7fcf6415cc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.615+0000 7fcf61d9b640 1 -- 172.21.15.132:0/4120621348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf64071460 msgr2=0x7fcf64159860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.615+0000 7fcf61d9b640 1 --2- 172.21.15.132:0/4120621348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf64071460 0x7fcf64159860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.615+0000 7fcf61d9b640 1 -- 172.21.15.132:0/4120621348 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf54009b30 con 0x7fcf640c9fc0 2023-12-20T04:44:52.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.616+0000 7fcf61d9b640 1 --2- 172.21.15.132:0/4120621348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf640c9fc0 0x7fcf640c4af0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800c440 tx=0x7fcf5800c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:52.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.616+0000 7fcf52ffd640 1 -- 172.21.15.132:0/4120621348 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf58005480 con 0x7fcf640c9fc0 2023-12-20T04:44:52.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.616+0000 7fcf52ffd640 1 -- 172.21.15.132:0/4120621348 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf580035f0 con 0x7fcf640c9fc0 2023-12-20T04:44:52.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.616+0000 7fcf68cd5640 1 -- 172.21.15.132:0/4120621348 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf640c5710 con 0x7fcf640c9fc0 2023-12-20T04:44:52.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.616+0000 7fcf52ffd640 1 -- 172.21.15.132:0/4120621348 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf580039c0 con 0x7fcf640c9fc0 2023-12-20T04:44:52.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.616+0000 7fcf68cd5640 1 -- 172.21.15.132:0/4120621348 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf640c5cd0 con 0x7fcf640c9fc0 2023-12-20T04:44:52.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.617+0000 7fcf68cd5640 1 -- 172.21.15.132:0/4120621348 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf64073360 con 0x7fcf640c9fc0 2023-12-20T04:44:52.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.617+0000 7fcf52ffd640 1 -- 172.21.15.132:0/4120621348 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcf58003b20 con 0x7fcf640c9fc0 2023-12-20T04:44:52.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.617+0000 7fcf52ffd640 1 --2- 172.21.15.132:0/4120621348 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf4406a460 0x7fcf4406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.617+0000 7fcf52ffd640 1 -- 172.21.15.132:0/4120621348 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcf580879a0 con 0x7fcf640c9fc0 2023-12-20T04:44:52.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.617+0000 7fcf6259c640 1 --2- 172.21.15.132:0/4120621348 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf4406a460 0x7fcf4406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.618+0000 7fcf6259c640 1 --2- 172.21.15.132:0/4120621348 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf4406a460 0x7fcf4406c920 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcf54035000 tx=0x7fcf54030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:52.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.622+0000 7fcf52ffd640 1 -- 172.21.15.132:0/4120621348 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcf58052f60 con 0x7fcf640c9fc0 2023-12-20T04:44:52.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.786+0000 7fcf68cd5640 1 -- 172.21.15.132:0/4120621348 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcf64070b30 con 0x7fcf640c9fc0 2023-12-20T04:44:52.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.787+0000 7fcf52ffd640 1 -- 172.21.15.132:0/4120621348 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcf58073e60 con 0x7fcf640c9fc0 2023-12-20T04:44:52.788 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:44:52.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.789+0000 7fcf68cd5640 1 -- 172.21.15.132:0/4120621348 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf4406a460 msgr2=0x7fcf4406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.789+0000 7fcf68cd5640 1 --2- 172.21.15.132:0/4120621348 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf4406a460 0x7fcf4406c920 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7fcf54035000 tx=0x7fcf54030000 comp rx=0 tx=0).stop 2023-12-20T04:44:52.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.789+0000 7fcf68cd5640 1 -- 172.21.15.132:0/4120621348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf640c9fc0 msgr2=0x7fcf640c4af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.789+0000 7fcf68cd5640 1 --2- 172.21.15.132:0/4120621348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf640c9fc0 0x7fcf640c4af0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7fcf5800c440 tx=0x7fcf5800c900 comp rx=0 tx=0).stop 2023-12-20T04:44:52.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.789+0000 7fcf68cd5640 1 -- 172.21.15.132:0/4120621348 shutdown_connections 2023-12-20T04:44:52.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.789+0000 7fcf68cd5640 1 --2- 172.21.15.132:0/4120621348 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf4406a460 0x7fcf4406c920 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.789+0000 7fcf68cd5640 1 --2- 172.21.15.132:0/4120621348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf6415ef90 0x7fcf6415cc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.789+0000 7fcf68cd5640 1 --2- 172.21.15.132:0/4120621348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf640c9fc0 0x7fcf640c4af0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.789+0000 7fcf68cd5640 1 --2- 172.21.15.132:0/4120621348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf64071460 0x7fcf64159860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.789+0000 7fcf68cd5640 1 -- 172.21.15.132:0/4120621348 >> 172.21.15.132:0/4120621348 conn(0x7fcf640cf2d0 msgr2=0x7fcf640cddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:52.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.789+0000 7fcf68cd5640 1 -- 172.21.15.132:0/4120621348 shutdown_connections 2023-12-20T04:44:52.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.789+0000 7fcf68cd5640 1 -- 172.21.15.132:0/4120621348 wait complete. 2023-12-20T04:44:52.801 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:44:52.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.901+0000 7fdeee6f3640 1 Processor -- start 2023-12-20T04:44:52.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.901+0000 7fdeee6f3640 1 -- start start 2023-12-20T04:44:52.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.902+0000 7fdeee6f3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdee8070c00 0x7fdee815dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.902+0000 7fdeee6f3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdee815dff0 0x7fdee80cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.902+0000 7fdeee6f3640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdee8143ae0 con 0x7fdee8143700 2023-12-20T04:44:52.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.902+0000 7fdeee6f3640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdee815e7e0 con 0x7fdee8070c00 2023-12-20T04:44:52.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.902+0000 7fdeee6f3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee80c4a30 con 0x7fdee815dff0 2023-12-20T04:44:52.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.902+0000 7fdee77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdee8070c00 0x7fdee815dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.902+0000 7fdee77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdee8070c00 0x7fdee815dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36444/0 (socket says 172.21.15.132:36444) 2023-12-20T04:44:52.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.902+0000 7fdee77fe640 1 -- 172.21.15.132:0/3215251991 learned_addr learned my addr 172.21.15.132:0/3215251991 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:52.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.903+0000 7fdeecc90640 1 --2- 172.21.15.132:0/3215251991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdee815dff0 0x7fdee80cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.903+0000 7fdee77fe640 1 -- 172.21.15.132:0/3215251991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdee815dff0 msgr2=0x7fdee80cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:52.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.903+0000 7fdee77fe640 1 --2- 172.21.15.132:0/3215251991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdee815dff0 0x7fdee80cb000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.903+0000 7fdee77fe640 1 -- 172.21.15.132:0/3215251991 >> v1:172.21.15.187:6789/0 conn(0x7fdee8143700 legacy=0x7fdee80704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:52.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.903+0000 7fdee77fe640 1 -- 172.21.15.132:0/3215251991 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdee80c4d10 con 0x7fdee8070c00 2023-12-20T04:44:52.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.903+0000 7fdeecc90640 1 --2- 172.21.15.132:0/3215251991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdee815dff0 0x7fdee80cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:52.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.903+0000 7fdee77fe640 1 --2- 172.21.15.132:0/3215251991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8070c00 0x7fdee815dab0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009870 tx=0x7fdedc02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abbc622b8ab3606c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:52.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.903+0000 7fdee6ffd640 1 -- 172.21.15.132:0/3215251991 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc031640 con 0x7fdee8070c00 2023-12-20T04:44:52.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.904+0000 7fdee6ffd640 1 -- 172.21.15.132:0/3215251991 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc0317a0 con 0x7fdee8070c00 2023-12-20T04:44:52.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.904+0000 7fdee6ffd640 1 -- 172.21.15.132:0/3215251991 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc031b30 con 0x7fdee8070c00 2023-12-20T04:44:52.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.904+0000 7fdeee6f3640 1 -- 172.21.15.132:0/3215251991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8070c00 msgr2=0x7fdee815dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.904+0000 7fdeee6f3640 1 --2- 172.21.15.132:0/3215251991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8070c00 0x7fdee815dab0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009870 tx=0x7fdedc02b8f0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.904+0000 7fdeee6f3640 1 -- 172.21.15.132:0/3215251991 shutdown_connections 2023-12-20T04:44:52.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.904+0000 7fdeee6f3640 1 --2- 172.21.15.132:0/3215251991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdee815dff0 0x7fdee80cb000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.904+0000 7fdeee6f3640 1 --2- 172.21.15.132:0/3215251991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8070c00 0x7fdee815dab0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.904+0000 7fdeee6f3640 1 -- 172.21.15.132:0/3215251991 >> 172.21.15.132:0/3215251991 conn(0x7fdee80cfb10 msgr2=0x7fdee80cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:52.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.904+0000 7fdeee6f3640 1 -- 172.21.15.132:0/3215251991 shutdown_connections 2023-12-20T04:44:52.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.904+0000 7fdeee6f3640 1 -- 172.21.15.132:0/3215251991 wait complete. 2023-12-20T04:44:52.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.905+0000 7fdeee6f3640 1 Processor -- start 2023-12-20T04:44:52.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.905+0000 7fdeee6f3640 1 -- start start 2023-12-20T04:44:52.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.906+0000 7fdeee6f3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdee8070c00 0x7fdee806d0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.906+0000 7fdeee6f3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8143700 0x7fdee80cde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.906+0000 7fdeee6f3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdee815dff0 0x7fdee80ce340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.906+0000 7fdeee6f3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee81ef0f0 con 0x7fdee8143700 2023-12-20T04:44:52.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.906+0000 7fdeee6f3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdee815baa0 con 0x7fdee815dff0 2023-12-20T04:44:52.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.906+0000 7fdeee6f3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdee815bd80 con 0x7fdee8070c00 2023-12-20T04:44:52.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.906+0000 7fdee77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8143700 0x7fdee80cde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.906+0000 7fdee77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8143700 0x7fdee80cde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36448/0 (socket says 172.21.15.132:36448) 2023-12-20T04:44:52.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.906+0000 7fdee77fe640 1 -- 172.21.15.132:0/41451948 learned_addr learned my addr 172.21.15.132:0/41451948 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:52.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.906+0000 7fdee7fff640 1 --2- 172.21.15.132:0/41451948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdee8070c00 0x7fdee806d0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.906+0000 7fdeecc90640 1 --2- 172.21.15.132:0/41451948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdee815dff0 0x7fdee80ce340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.906+0000 7fdee77fe640 1 -- 172.21.15.132:0/41451948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdee8070c00 msgr2=0x7fdee806d0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.907+0000 7fdee77fe640 1 --2- 172.21.15.132:0/41451948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdee8070c00 0x7fdee806d0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.907+0000 7fdee77fe640 1 -- 172.21.15.132:0/41451948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdee815dff0 msgr2=0x7fdee80ce340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:52.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.907+0000 7fdee77fe640 1 --2- 172.21.15.132:0/41451948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdee815dff0 0x7fdee80ce340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:52.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.907+0000 7fdee77fe640 1 -- 172.21.15.132:0/41451948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdedc0094d0 con 0x7fdee8143700 2023-12-20T04:44:52.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.907+0000 7fdeecc90640 1 --2- 172.21.15.132:0/41451948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdee815dff0 0x7fdee80ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:52.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.907+0000 7fdee7fff640 1 --2- 172.21.15.132:0/41451948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdee8070c00 0x7fdee806d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:52.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.907+0000 7fdee77fe640 1 --2- 172.21.15.132:0/41451948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8143700 0x7fdee80cde00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009870 tx=0x7fdedc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:52.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.907+0000 7fdee4ff9640 1 -- 172.21.15.132:0/41451948 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc03ac60 con 0x7fdee8143700 2023-12-20T04:44:52.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.907+0000 7fdee4ff9640 1 -- 172.21.15.132:0/41451948 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdedc03ade0 con 0x7fdee8143700 2023-12-20T04:44:52.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.907+0000 7fdee4ff9640 1 -- 172.21.15.132:0/41451948 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdedc044630 con 0x7fdee8143700 2023-12-20T04:44:52.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.907+0000 7fdeee6f3640 1 -- 172.21.15.132:0/41451948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdee815c060 con 0x7fdee8143700 2023-12-20T04:44:52.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.907+0000 7fdeee6f3640 1 -- 172.21.15.132:0/41451948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdee815c620 con 0x7fdee8143700 2023-12-20T04:44:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.908+0000 7fdeee6f3640 1 -- 172.21.15.132:0/41451948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdee815bec0 con 0x7fdee8143700 2023-12-20T04:44:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.908+0000 7fdee4ff9640 1 -- 172.21.15.132:0/41451948 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdedc02f050 con 0x7fdee8143700 2023-12-20T04:44:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.909+0000 7fdee4ff9640 1 --2- 172.21.15.132:0/41451948 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fded406a430 0x7fded406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.909+0000 7fdee4ff9640 1 -- 172.21.15.132:0/41451948 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fdedc0aa9e0 con 0x7fdee8143700 2023-12-20T04:44:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.909+0000 7fdee7fff640 1 --2- 172.21.15.132:0/41451948 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fded406a430 0x7fded406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.909+0000 7fdee7fff640 1 --2- 172.21.15.132:0/41451948 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fded406a430 0x7fded406c8f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fded8003eb0 tx=0x7fded8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:52.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:52.913+0000 7fdee4ff9640 1 -- 172.21.15.132:0/41451948 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdee815bec0 con 0x7fdee8143700 2023-12-20T04:44:53.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.091+0000 7fdeee6f3640 1 -- 172.21.15.132:0/41451948 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fdee815bec0 con 0x7fdee8143700 2023-12-20T04:44:53.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.091+0000 7fdee4ff9640 1 -- 172.21.15.132:0/41451948 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) v1 ==== 80+0+0 (secure 0 0 0) 0x7fdee815bec0 con 0x7fdee8143700 2023-12-20T04:44:53.092 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:44:53.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.093+0000 7fdeee6f3640 1 -- 172.21.15.132:0/41451948 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fded406a430 msgr2=0x7fded406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.093+0000 7fdeee6f3640 1 --2- 172.21.15.132:0/41451948 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fded406a430 0x7fded406c8f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7fded8003eb0 tx=0x7fded8009040 comp rx=0 tx=0).stop 2023-12-20T04:44:53.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.093+0000 7fdeee6f3640 1 -- 172.21.15.132:0/41451948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8143700 msgr2=0x7fdee80cde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.093+0000 7fdeee6f3640 1 --2- 172.21.15.132:0/41451948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8143700 0x7fdee80cde00 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7fdedc009870 tx=0x7fdedc0046c0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.093+0000 7fdeee6f3640 1 -- 172.21.15.132:0/41451948 shutdown_connections 2023-12-20T04:44:53.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.093+0000 7fdeee6f3640 1 --2- 172.21.15.132:0/41451948 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fded406a430 0x7fded406c8f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.093+0000 7fdeee6f3640 1 --2- 172.21.15.132:0/41451948 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdee815dff0 0x7fdee80ce340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.093+0000 7fdeee6f3640 1 --2- 172.21.15.132:0/41451948 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdee8143700 0x7fdee80cde00 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.093+0000 7fdeee6f3640 1 --2- 172.21.15.132:0/41451948 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdee8070c00 0x7fdee806d0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.093+0000 7fdeee6f3640 1 -- 172.21.15.132:0/41451948 >> 172.21.15.132:0/41451948 conn(0x7fdee80cfb10 msgr2=0x7fdee80af690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:53.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.093+0000 7fdeee6f3640 1 -- 172.21.15.132:0/41451948 shutdown_connections 2023-12-20T04:44:53.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.093+0000 7fdeee6f3640 1 -- 172.21.15.132:0/41451948 wait complete. 2023-12-20T04:44:53.105 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2023-12-20T04:44:53.105 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:53.105 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-20T04:44:53.133 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[97693]: fuse finished with error 0 and tester_r 0 2023-12-20T04:44:53.136 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:44:53.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:53.137 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-20T04:44:53.193 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:44:53.193 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:44:53.210 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:44:53.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.332+0000 7f8033389640 1 Processor -- start 2023-12-20T04:44:53.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.332+0000 7f8033389640 1 -- start start 2023-12-20T04:44:53.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.333+0000 7f8033389640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c160450 0x7f802c160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.333+0000 7f8033389640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f802c0b5090 0x7f802c0d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.333+0000 7f8033389640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f802c0b5ec0 con 0x7f802c1611b0 2023-12-20T04:44:53.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.333+0000 7f8033389640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f802c1617e0 con 0x7f802c0b5090 2023-12-20T04:44:53.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.333+0000 7f8033389640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c0d0fc0 con 0x7f802c160450 2023-12-20T04:44:53.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.334+0000 7f8031125640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c160450 0x7f802c160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.334+0000 7f8030924640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f802c1611b0 0x7f802c0b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:46146/0 (socket says 172.21.15.132:46146) 2023-12-20T04:44:53.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.334+0000 7f8030924640 1 -- 172.21.15.132:0/4195611306 learned_addr learned my addr 172.21.15.132:0/4195611306 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:53.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.334+0000 7f8031926640 1 --2- 172.21.15.132:0/4195611306 >> v2:172.21.15.187:3300/0 conn(0x7f802c0b5090 0x7f802c0d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.334+0000 7f8031125640 1 -- 172.21.15.132:0/4195611306 >> v2:172.21.15.187:3300/0 conn(0x7f802c0b5090 msgr2=0x7f802c0d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.334+0000 7f8031125640 1 --2- 172.21.15.132:0/4195611306 >> v2:172.21.15.187:3300/0 conn(0x7f802c0b5090 0x7f802c0d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.334+0000 7f8031125640 1 -- 172.21.15.132:0/4195611306 >> v1:172.21.15.187:6789/0 conn(0x7f802c1611b0 legacy=0x7f802c0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.334+0000 7f8031125640 1 -- 172.21.15.132:0/4195611306 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f802c0d12a0 con 0x7f802c160450 2023-12-20T04:44:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.334+0000 7f8023fff640 1 -- 172.21.15.132:0/4195611306 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2110588461 0 0) 0x7f802c0b5ec0 con 0x7f802c1611b0 2023-12-20T04:44:53.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.334+0000 7f8031926640 1 --2- 172.21.15.132:0/4195611306 >> v2:172.21.15.187:3300/0 conn(0x7f802c0b5090 0x7f802c0d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:44:53.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.335+0000 7f8031125640 1 --2- 172.21.15.132:0/4195611306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c160450 0x7f802c160c70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f80280097a0 tx=0x7f802802b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5fa4732b4c79f5c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:53.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.335+0000 7f8023fff640 1 -- 172.21.15.132:0/4195611306 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028030610 con 0x7f802c160450 2023-12-20T04:44:53.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.335+0000 7f8023fff640 1 -- 172.21.15.132:0/4195611306 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8028030770 con 0x7f802c160450 2023-12-20T04:44:53.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.335+0000 7f8023fff640 1 -- 172.21.15.132:0/4195611306 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028030b00 con 0x7f802c160450 2023-12-20T04:44:53.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.335+0000 7f8033389640 1 -- 172.21.15.132:0/4195611306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c160450 msgr2=0x7f802c160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.335+0000 7f8033389640 1 --2- 172.21.15.132:0/4195611306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c160450 0x7f802c160c70 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f80280097a0 tx=0x7f802802b960 comp rx=0 tx=0).stop 2023-12-20T04:44:53.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.335+0000 7f8033389640 1 -- 172.21.15.132:0/4195611306 shutdown_connections 2023-12-20T04:44:53.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.335+0000 7f8033389640 1 --2- 172.21.15.132:0/4195611306 >> v2:172.21.15.187:3300/0 conn(0x7f802c0b5090 0x7f802c0d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.335+0000 7f8033389640 1 --2- 172.21.15.132:0/4195611306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c160450 0x7f802c160c70 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.336+0000 7f8033389640 1 -- 172.21.15.132:0/4195611306 >> 172.21.15.132:0/4195611306 conn(0x7f802c0cf980 msgr2=0x7f802c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:53.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.336+0000 7f8033389640 1 -- 172.21.15.132:0/4195611306 shutdown_connections 2023-12-20T04:44:53.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.336+0000 7f8033389640 1 -- 172.21.15.132:0/4195611306 wait complete. 2023-12-20T04:44:53.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.337+0000 7f8033389640 1 Processor -- start 2023-12-20T04:44:53.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.337+0000 7f8033389640 1 -- start start 2023-12-20T04:44:53.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.337+0000 7f8033389640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0b5090 0x7f802c0c9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.337+0000 7f8033389640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f802c160450 0x7f802c147420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.337+0000 7f8033389640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c1611b0 0x7f802c145490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.337+0000 7f8033389640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c1443f0 con 0x7f802c0b5090 2023-12-20T04:44:53.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.337+0000 7f8033389640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f802c1446d0 con 0x7f802c160450 2023-12-20T04:44:53.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.337+0000 7f8033389640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f802c1449b0 con 0x7f802c1611b0 2023-12-20T04:44:53.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.337+0000 7f8031125640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0b5090 0x7f802c0c9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.338+0000 7f8031125640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0b5090 0x7f802c0c9460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36460/0 (socket says 172.21.15.132:36460) 2023-12-20T04:44:53.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.338+0000 7f8031125640 1 -- 172.21.15.132:0/3453132831 learned_addr learned my addr 172.21.15.132:0/3453132831 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:53.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.338+0000 7f8031926640 1 --2- 172.21.15.132:0/3453132831 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c1611b0 0x7f802c145490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.338+0000 7f8030924640 1 --2- 172.21.15.132:0/3453132831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f802c160450 0x7f802c147420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.338+0000 7f8031125640 1 -- 172.21.15.132:0/3453132831 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c1611b0 msgr2=0x7f802c145490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.338+0000 7f8031125640 1 --2- 172.21.15.132:0/3453132831 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c1611b0 0x7f802c145490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.338+0000 7f8031125640 1 -- 172.21.15.132:0/3453132831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f802c160450 msgr2=0x7f802c147420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.338+0000 7f8031125640 1 --2- 172.21.15.132:0/3453132831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f802c160450 0x7f802c147420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.338+0000 7f8031125640 1 -- 172.21.15.132:0/3453132831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8024009a70 con 0x7f802c0b5090 2023-12-20T04:44:53.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.338+0000 7f8031125640 1 --2- 172.21.15.132:0/3453132831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0b5090 0x7f802c0c9460 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f80280098c0 tx=0x7f8028004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:53.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.338+0000 7f8021ffb640 1 -- 172.21.15.132:0/3453132831 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f802803e040 con 0x7f802c0b5090 2023-12-20T04:44:53.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.338+0000 7f8021ffb640 1 -- 172.21.15.132:0/3453132831 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8028039cb0 con 0x7f802c0b5090 2023-12-20T04:44:53.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.338+0000 7f8033389640 1 -- 172.21.15.132:0/3453132831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8028009400 con 0x7f802c0b5090 2023-12-20T04:44:53.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.338+0000 7f8021ffb640 1 -- 172.21.15.132:0/3453132831 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8028044630 con 0x7f802c0b5090 2023-12-20T04:44:53.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.338+0000 7f8033389640 1 -- 172.21.15.132:0/3453132831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f802c144f70 con 0x7f802c0b5090 2023-12-20T04:44:53.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.339+0000 7f8033389640 1 -- 172.21.15.132:0/3453132831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f802c04e840 con 0x7f802c0b5090 2023-12-20T04:44:53.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.340+0000 7f8021ffb640 1 -- 172.21.15.132:0/3453132831 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f802804d3b0 con 0x7f802c0b5090 2023-12-20T04:44:53.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.340+0000 7f8021ffb640 1 --2- 172.21.15.132:0/3453132831 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f801006a430 0x7f801006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.340+0000 7f8021ffb640 1 -- 172.21.15.132:0/3453132831 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f80280aac90 con 0x7f802c0b5090 2023-12-20T04:44:53.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.340+0000 7f8030924640 1 --2- 172.21.15.132:0/3453132831 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f801006a430 0x7f801006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.341+0000 7f8030924640 1 --2- 172.21.15.132:0/3453132831 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f801006a430 0x7f801006c8f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f802c0cb5d0 tx=0x7f801c007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:53.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.344+0000 7f8021ffb640 1 -- 172.21.15.132:0/3453132831 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f80280762f0 con 0x7f802c0b5090 2023-12-20T04:44:53.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.511+0000 7f8033389640 1 -- 172.21.15.132:0/3453132831 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f802c145160 con 0x7f802c0b5090 2023-12-20T04:44:53.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.512+0000 7f8021ffb640 1 -- 172.21.15.132:0/3453132831 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16188 (secure 0 0 0) 0x7f8028006e10 con 0x7f802c0b5090 2023-12-20T04:44:53.514 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:53.514 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":53,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:44:45.942314+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:44:15.033177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-20T04:44:16.130594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.30","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:44:53.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.514+0000 7f8033389640 1 -- 172.21.15.132:0/3453132831 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f801006a430 msgr2=0x7f801006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.514+0000 7f8033389640 1 --2- 172.21.15.132:0/3453132831 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f801006a430 0x7f801006c8f0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f802c0cb5d0 tx=0x7f801c007de0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.514+0000 7f8033389640 1 -- 172.21.15.132:0/3453132831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0b5090 msgr2=0x7f802c0c9460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.514+0000 7f8033389640 1 --2- 172.21.15.132:0/3453132831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0b5090 0x7f802c0c9460 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f80280098c0 tx=0x7f8028004730 comp rx=0 tx=0).stop 2023-12-20T04:44:53.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.514+0000 7f8033389640 1 -- 172.21.15.132:0/3453132831 shutdown_connections 2023-12-20T04:44:53.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.514+0000 7f8033389640 1 --2- 172.21.15.132:0/3453132831 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f801006a430 0x7f801006c8f0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.514+0000 7f8033389640 1 --2- 172.21.15.132:0/3453132831 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f802c1611b0 0x7f802c145490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.514+0000 7f8033389640 1 --2- 172.21.15.132:0/3453132831 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f802c160450 0x7f802c147420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.514+0000 7f8033389640 1 --2- 172.21.15.132:0/3453132831 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f802c0b5090 0x7f802c0c9460 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.514+0000 7f8033389640 1 -- 172.21.15.132:0/3453132831 >> 172.21.15.132:0/3453132831 conn(0x7f802c0cf980 msgr2=0x7f802c0d3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:53.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.514+0000 7f8033389640 1 -- 172.21.15.132:0/3453132831 shutdown_connections 2023-12-20T04:44:53.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.514+0000 7f8033389640 1 -- 172.21.15.132:0/3453132831 wait complete. 2023-12-20T04:44:53.526 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:44:15.033177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:44:16.130594+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:44:53.527 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:44:53.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.629+0000 7f4c5960b640 1 Processor -- start 2023-12-20T04:44:53.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.629+0000 7f4c5960b640 1 -- start start 2023-12-20T04:44:53.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.630+0000 7f4c5960b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c5415aee0 0x7f4c5415eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.630+0000 7f4c5960b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c540d0130 con 0x7f4c540cdd80 2023-12-20T04:44:53.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.630+0000 7f4c5960b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c5415f370 con 0x7f4c540cb2b0 2023-12-20T04:44:53.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.630+0000 7f4c5960b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5415f650 con 0x7f4c5415aee0 2023-12-20T04:44:53.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.630+0000 7f4c537fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4c540cdd80 0x7f4c540d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40288/0 (socket says 172.21.15.132:40288) 2023-12-20T04:44:53.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.630+0000 7f4c537fe640 1 -- 172.21.15.132:0/1985941005 learned_addr learned my addr 172.21.15.132:0/1985941005 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:53.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c52ffd640 1 --2- 172.21.15.132:0/1985941005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c5415aee0 0x7f4c5415eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c51ffb640 1 -- 172.21.15.132:0/1985941005 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3501427205 0 0) 0x7f4c540d0130 con 0x7f4c540cdd80 2023-12-20T04:44:53.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c51ffb640 1 -- 172.21.15.132:0/1985941005 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c3c003520 con 0x7f4c540cdd80 2023-12-20T04:44:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c51ffb640 1 -- 172.21.15.132:0/1985941005 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1126403850 0 0) 0x7f4c5415f370 con 0x7f4c540cb2b0 2023-12-20T04:44:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c51ffb640 1 -- 172.21.15.132:0/1985941005 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4c540d0130 con 0x7f4c540cb2b0 2023-12-20T04:44:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c51ffb640 1 -- 172.21.15.132:0/1985941005 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1391464453 0 0) 0x7f4c3c003520 con 0x7f4c540cdd80 2023-12-20T04:44:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c51ffb640 1 -- 172.21.15.132:0/1985941005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c5415aee0 msgr2=0x7f4c5415eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c51ffb640 1 --2- 172.21.15.132:0/1985941005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c5415aee0 0x7f4c5415eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c51ffb640 1 -- 172.21.15.132:0/1985941005 >> v1:172.21.15.187:6789/0 conn(0x7f4c540cb2b0 legacy=0x7f4c540cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c51ffb640 1 -- 172.21.15.132:0/1985941005 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5415f930 con 0x7f4c540cdd80 2023-12-20T04:44:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c51ffb640 1 -- 172.21.15.132:0/1985941005 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f4c4c001670 con 0x7f4c540cdd80 2023-12-20T04:44:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c52ffd640 1 --2- 172.21.15.132:0/1985941005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c5415aee0 0x7f4c5415eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:44:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c51ffb640 1 -- 172.21.15.132:0/1985941005 >> v1:172.21.15.132:6789/0 conn(0x7f4c540cdd80 legacy=0x7f4c540d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c51ffb640 1 --2- 172.21.15.132:0/1985941005 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c003b30 0x7f4c3c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c51ffb640 1 --2- 172.21.15.132:0/1985941005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c3c0047c0 0x7f4c3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c51ffb640 1 --2- 172.21.15.132:0/1985941005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c5415aee0 0x7f4c3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c51ffb640 1 -- 172.21.15.132:0/1985941005 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5415f650 con 0x7f4c3c003b30 2023-12-20T04:44:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c51ffb640 1 -- 172.21.15.132:0/1985941005 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c00b9b0 con 0x7f4c3c0047c0 2023-12-20T04:44:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c51ffb640 1 -- 172.21.15.132:0/1985941005 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c3c00bb70 con 0x7f4c5415aee0 2023-12-20T04:44:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c52ffd640 1 --2- 172.21.15.132:0/1985941005 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c003b30 0x7f4c3c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c537fe640 1 --2- 172.21.15.132:0/1985941005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c5415aee0 0x7f4c3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c527fc640 1 --2- 172.21.15.132:0/1985941005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c3c0047c0 0x7f4c3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c52ffd640 1 -- 172.21.15.132:0/1985941005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c5415aee0 msgr2=0x7f4c3c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c52ffd640 1 --2- 172.21.15.132:0/1985941005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c5415aee0 0x7f4c3c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c52ffd640 1 -- 172.21.15.132:0/1985941005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c3c0047c0 msgr2=0x7f4c3c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c52ffd640 1 --2- 172.21.15.132:0/1985941005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c3c0047c0 0x7f4c3c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.631+0000 7f4c52ffd640 1 -- 172.21.15.132:0/1985941005 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c44009a70 con 0x7f4c3c003b30 2023-12-20T04:44:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.632+0000 7f4c52ffd640 1 --2- 172.21.15.132:0/1985941005 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c003b30 0x7f4c3c003f30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400e320 tx=0x7f4c3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ddde2f16d45f111 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.632+0000 7f4c51ffb640 1 -- 172.21.15.132:0/1985941005 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4402cd30 con 0x7f4c3c003b30 2023-12-20T04:44:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.632+0000 7f4c51ffb640 1 -- 172.21.15.132:0/1985941005 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4400f040 con 0x7f4c3c003b30 2023-12-20T04:44:53.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.632+0000 7f4c51ffb640 1 -- 172.21.15.132:0/1985941005 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c44034640 con 0x7f4c3c003b30 2023-12-20T04:44:53.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.633+0000 7f4c5960b640 1 -- 172.21.15.132:0/1985941005 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c003b30 msgr2=0x7f4c3c003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.633+0000 7f4c5960b640 1 --2- 172.21.15.132:0/1985941005 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c003b30 0x7f4c3c003f30 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f4c4400e320 tx=0x7f4c3c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.633+0000 7f4c537fe640 1 -- 172.21.15.132:0/1985941005 reap_dead start 2023-12-20T04:44:53.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.633+0000 7f4c5960b640 1 -- 172.21.15.132:0/1985941005 shutdown_connections 2023-12-20T04:44:53.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.633+0000 7f4c5960b640 1 -- 172.21.15.132:0/1985941005 >> 172.21.15.132:0/1985941005 conn(0x7f4c54072c60 msgr2=0x7f4c54073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:53.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.633+0000 7f4c5960b640 1 -- 172.21.15.132:0/1985941005 shutdown_connections 2023-12-20T04:44:53.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.633+0000 7f4c5960b640 1 -- 172.21.15.132:0/1985941005 wait complete. 2023-12-20T04:44:53.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.634+0000 7f4c5960b640 1 Processor -- start 2023-12-20T04:44:53.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.634+0000 7f4c5960b640 1 -- start start 2023-12-20T04:44:53.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c5960b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c003b30 0x7f4c540a8d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c5960b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c541f34b0 0x7f4c5415c140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c5960b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c541f0650 0x7f4c540c9320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c5960b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5415c680 con 0x7f4c3c003b30 2023-12-20T04:44:53.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c5960b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c541f3910 con 0x7f4c541f0650 2023-12-20T04:44:53.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c5960b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c5415cb40 con 0x7f4c541f34b0 2023-12-20T04:44:53.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c52ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c003b30 0x7f4c540a8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c52ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c003b30 0x7f4c540a8d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36468/0 (socket says 172.21.15.132:36468) 2023-12-20T04:44:53.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c52ffd640 1 -- 172.21.15.132:0/1404703067 learned_addr learned my addr 172.21.15.132:0/1404703067 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:53.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c527fc640 1 --2- 172.21.15.132:0/1404703067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c541f34b0 0x7f4c5415c140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c52ffd640 1 -- 172.21.15.132:0/1404703067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c541f34b0 msgr2=0x7f4c5415c140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c52ffd640 1 --2- 172.21.15.132:0/1404703067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c541f34b0 0x7f4c5415c140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c537fe640 1 --2- 172.21.15.132:0/1404703067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c541f0650 0x7f4c540c9320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c52ffd640 1 -- 172.21.15.132:0/1404703067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c541f0650 msgr2=0x7f4c540c9320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c52ffd640 1 --2- 172.21.15.132:0/1404703067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c541f0650 0x7f4c540c9320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c52ffd640 1 -- 172.21.15.132:0/1404703067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c5415cde0 con 0x7f4c3c003b30 2023-12-20T04:44:53.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c52ffd640 1 --2- 172.21.15.132:0/1404703067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c003b30 0x7f4c540a8d50 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4c4402c6d0 tx=0x7f4c44009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:53.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c3b7fe640 1 -- 172.21.15.132:0/1404703067 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4403e400 con 0x7f4c3c003b30 2023-12-20T04:44:53.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c3b7fe640 1 -- 172.21.15.132:0/1404703067 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c4403e5a0 con 0x7f4c3c003b30 2023-12-20T04:44:53.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c5960b640 1 -- 172.21.15.132:0/1404703067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c5415c680 con 0x7f4c3c003b30 2023-12-20T04:44:53.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c3b7fe640 1 -- 172.21.15.132:0/1404703067 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c4403e950 con 0x7f4c3c003b30 2023-12-20T04:44:53.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.635+0000 7f4c5960b640 1 -- 172.21.15.132:0/1404703067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c5415d3a0 con 0x7f4c3c003b30 2023-12-20T04:44:53.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.636+0000 7f4c5960b640 1 -- 172.21.15.132:0/1404703067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c5404e840 con 0x7f4c3c003b30 2023-12-20T04:44:53.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.637+0000 7f4c3b7fe640 1 -- 172.21.15.132:0/1404703067 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4c4403eab0 con 0x7f4c3c003b30 2023-12-20T04:44:53.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.637+0000 7f4c3b7fe640 1 --2- 172.21.15.132:0/1404703067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c4006a430 0x7f4c4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.637+0000 7f4c527fc640 1 --2- 172.21.15.132:0/1404703067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c4006a430 0x7f4c4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.637+0000 7f4c3b7fe640 1 -- 172.21.15.132:0/1404703067 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4c440ab0f0 con 0x7f4c3c003b30 2023-12-20T04:44:53.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.638+0000 7f4c527fc640 1 --2- 172.21.15.132:0/1404703067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c4006a430 0x7f4c4006c8f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4c48007fd0 tx=0x7f4c48009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:53.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.641+0000 7f4c3b7fe640 1 -- 172.21.15.132:0/1404703067 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4c44076900 con 0x7f4c3c003b30 2023-12-20T04:44:53.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.806+0000 7f4c5960b640 1 -- 172.21.15.132:0/1404703067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f4c5415c880 con 0x7f4c3c003b30 2023-12-20T04:44:53.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.806+0000 7f4c3b7fe640 1 -- 172.21.15.132:0/1404703067 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7f4c44009de0 con 0x7f4c3c003b30 2023-12-20T04:44:53.808 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:44:53.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.808+0000 7f4c5960b640 1 -- 172.21.15.132:0/1404703067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c4006a430 msgr2=0x7f4c4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.808+0000 7f4c5960b640 1 --2- 172.21.15.132:0/1404703067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c4006a430 0x7f4c4006c8f0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f4c48007fd0 tx=0x7f4c48009040 comp rx=0 tx=0).stop 2023-12-20T04:44:53.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.808+0000 7f4c5960b640 1 -- 172.21.15.132:0/1404703067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c003b30 msgr2=0x7f4c540a8d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.808+0000 7f4c5960b640 1 --2- 172.21.15.132:0/1404703067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c003b30 0x7f4c540a8d50 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f4c4402c6d0 tx=0x7f4c44009750 comp rx=0 tx=0).stop 2023-12-20T04:44:53.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.808+0000 7f4c5960b640 1 -- 172.21.15.132:0/1404703067 shutdown_connections 2023-12-20T04:44:53.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.808+0000 7f4c5960b640 1 --2- 172.21.15.132:0/1404703067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c4006a430 0x7f4c4006c8f0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.808+0000 7f4c5960b640 1 --2- 172.21.15.132:0/1404703067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c541f0650 0x7f4c540c9320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.808+0000 7f4c5960b640 1 --2- 172.21.15.132:0/1404703067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c541f34b0 0x7f4c5415c140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.808+0000 7f4c5960b640 1 --2- 172.21.15.132:0/1404703067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c3c003b30 0x7f4c540a8d50 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.808+0000 7f4c5960b640 1 -- 172.21.15.132:0/1404703067 >> 172.21.15.132:0/1404703067 conn(0x7f4c54072c60 msgr2=0x7f4c5415edf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:53.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.808+0000 7f4c5960b640 1 -- 172.21.15.132:0/1404703067 shutdown_connections 2023-12-20T04:44:53.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.808+0000 7f4c5960b640 1 -- 172.21.15.132:0/1404703067 wait complete. 2023-12-20T04:44:53.821 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:44:53.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.921+0000 7f28a7e17640 1 Processor -- start 2023-12-20T04:44:53.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.921+0000 7f28a7e17640 1 -- start start 2023-12-20T04:44:53.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.922+0000 7f28a7e17640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f28a015aee0 0x7f28a015eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.922+0000 7f28a7e17640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28a00cb2b0 0x7f28a00cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.922+0000 7f28a7e17640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28a00d0130 con 0x7f28a00cdbb0 2023-12-20T04:44:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.922+0000 7f28a7e17640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28a00ce040 con 0x7f28a015aee0 2023-12-20T04:44:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.922+0000 7f28a7e17640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a015f370 con 0x7f28a00cb2b0 2023-12-20T04:44:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.922+0000 7f28a63b4640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f28a00cdbb0 0x7f28a00ceb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40298/0 (socket says 172.21.15.132:40298) 2023-12-20T04:44:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.922+0000 7f28a63b4640 1 -- 172.21.15.132:0/2683955257 learned_addr learned my addr 172.21.15.132:0/2683955257 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a53b2640 1 --2- 172.21.15.132:0/2683955257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28a00cb2b0 0x7f28a00cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a5bb3640 1 --2- 172.21.15.132:0/2683955257 >> v2:172.21.15.187:3300/0 conn(0x7f28a015aee0 0x7f28a015eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a4bb1640 1 -- 172.21.15.132:0/2683955257 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 479766976 0 0) 0x7f28a00d0130 con 0x7f28a00cdbb0 2023-12-20T04:44:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a4bb1640 1 -- 172.21.15.132:0/2683955257 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2888003520 con 0x7f28a00cdbb0 2023-12-20T04:44:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a4bb1640 1 -- 172.21.15.132:0/2683955257 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1376790171 0 0) 0x7f2888003520 con 0x7f28a00cdbb0 2023-12-20T04:44:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a4bb1640 1 -- 172.21.15.132:0/2683955257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28a00cb2b0 msgr2=0x7f28a00cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a4bb1640 1 --2- 172.21.15.132:0/2683955257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28a00cb2b0 0x7f28a00cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a4bb1640 1 -- 172.21.15.132:0/2683955257 >> v2:172.21.15.187:3300/0 conn(0x7f28a015aee0 msgr2=0x7f28a015eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a4bb1640 1 --2- 172.21.15.132:0/2683955257 >> v2:172.21.15.187:3300/0 conn(0x7f28a015aee0 0x7f28a015eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a4bb1640 1 -- 172.21.15.132:0/2683955257 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a015f650 con 0x7f28a00cdbb0 2023-12-20T04:44:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a5bb3640 1 --2- 172.21.15.132:0/2683955257 >> v2:172.21.15.187:3300/0 conn(0x7f28a015aee0 0x7f28a015eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:44:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a4bb1640 1 -- 172.21.15.132:0/2683955257 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f28980019f0 con 0x7f28a00cdbb0 2023-12-20T04:44:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a4bb1640 1 -- 172.21.15.132:0/2683955257 >> v1:172.21.15.132:6789/0 conn(0x7f28a00cdbb0 legacy=0x7f28a00ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a4bb1640 1 --2- 172.21.15.132:0/2683955257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2888003970 0x7f2888003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a4bb1640 1 --2- 172.21.15.132:0/2683955257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28880047c0 0x7f2888004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a4bb1640 1 --2- 172.21.15.132:0/2683955257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28a00cb2b0 0x7f2888005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a4bb1640 1 -- 172.21.15.132:0/2683955257 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a00ce040 con 0x7f2888003970 2023-12-20T04:44:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a4bb1640 1 -- 172.21.15.132:0/2683955257 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a015f370 con 0x7f28880047c0 2023-12-20T04:44:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a4bb1640 1 -- 172.21.15.132:0/2683955257 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f288800b980 con 0x7f28a00cb2b0 2023-12-20T04:44:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a5bb3640 1 --2- 172.21.15.132:0/2683955257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2888003970 0x7f2888003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a53b2640 1 --2- 172.21.15.132:0/2683955257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28880047c0 0x7f2888004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a63b4640 1 --2- 172.21.15.132:0/2683955257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28a00cb2b0 0x7f2888005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a5bb3640 1 -- 172.21.15.132:0/2683955257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28a00cb2b0 msgr2=0x7f2888005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a5bb3640 1 --2- 172.21.15.132:0/2683955257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28a00cb2b0 0x7f2888005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a5bb3640 1 -- 172.21.15.132:0/2683955257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28880047c0 msgr2=0x7f2888004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:53.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a5bb3640 1 --2- 172.21.15.132:0/2683955257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28880047c0 0x7f2888004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a5bb3640 1 -- 172.21.15.132:0/2683955257 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2888003520 con 0x7f2888003970 2023-12-20T04:44:53.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.923+0000 7f28a53b2640 1 --2- 172.21.15.132:0/2683955257 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28880047c0 0x7f2888004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:53.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.924+0000 7f28a5bb3640 1 --2- 172.21.15.132:0/2683955257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2888003970 0x7f2888003d90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2890009c90 tx=0x7f28880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=868864e22f0f24de server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:53.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.924+0000 7f28a4bb1640 1 -- 172.21.15.132:0/2683955257 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289002c980 con 0x7f2888003970 2023-12-20T04:44:53.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.924+0000 7f28a4bb1640 1 -- 172.21.15.132:0/2683955257 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289002cae0 con 0x7f2888003970 2023-12-20T04:44:53.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.924+0000 7f28a4bb1640 1 -- 172.21.15.132:0/2683955257 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289002ce50 con 0x7f2888003970 2023-12-20T04:44:53.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.925+0000 7f28a7e17640 1 -- 172.21.15.132:0/2683955257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2888003970 msgr2=0x7f2888003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.925+0000 7f28a7e17640 1 --2- 172.21.15.132:0/2683955257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2888003970 0x7f2888003d90 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7f2890009c90 tx=0x7f28880057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.925+0000 7f28a63b4640 1 -- 172.21.15.132:0/2683955257 reap_dead start 2023-12-20T04:44:53.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.925+0000 7f28a7e17640 1 -- 172.21.15.132:0/2683955257 shutdown_connections 2023-12-20T04:44:53.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.925+0000 7f28a7e17640 1 -- 172.21.15.132:0/2683955257 >> 172.21.15.132:0/2683955257 conn(0x7f28a0072c60 msgr2=0x7f28a0073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:53.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.925+0000 7f28a7e17640 1 -- 172.21.15.132:0/2683955257 shutdown_connections 2023-12-20T04:44:53.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.925+0000 7f28a7e17640 1 -- 172.21.15.132:0/2683955257 wait complete. 2023-12-20T04:44:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.926+0000 7f28a7e17640 1 Processor -- start 2023-12-20T04:44:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.926+0000 7f28a7e17640 1 -- start start 2023-12-20T04:44:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a7e17640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2888003970 0x7f28a013ea20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a7e17640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28a0141760 0x7f28a01ee040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a7e17640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28a01f0a90 0x7f28a00b3e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a7e17640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a01f1390 con 0x7f28a0141760 2023-12-20T04:44:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a7e17640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28a01f1670 con 0x7f28a01f0a90 2023-12-20T04:44:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a7e17640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28a01f1950 con 0x7f2888003970 2023-12-20T04:44:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a53b2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28a0141760 0x7f28a01ee040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a53b2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28a0141760 0x7f28a01ee040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36490/0 (socket says 172.21.15.132:36490) 2023-12-20T04:44:53.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a53b2640 1 -- 172.21.15.132:0/2553156788 learned_addr learned my addr 172.21.15.132:0/2553156788 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:53.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a5bb3640 1 --2- 172.21.15.132:0/2553156788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2888003970 0x7f28a013ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a63b4640 1 --2- 172.21.15.132:0/2553156788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28a01f0a90 0x7f28a00b3e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a53b2640 1 -- 172.21.15.132:0/2553156788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2888003970 msgr2=0x7f28a013ea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a53b2640 1 --2- 172.21.15.132:0/2553156788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2888003970 0x7f28a013ea20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a53b2640 1 -- 172.21.15.132:0/2553156788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28a01f0a90 msgr2=0x7f28a00b3e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:53.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a53b2640 1 --2- 172.21.15.132:0/2553156788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28a01f0a90 0x7f28a00b3e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:53.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a53b2640 1 -- 172.21.15.132:0/2553156788 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28a01517d0 con 0x7f28a0141760 2023-12-20T04:44:53.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a5bb3640 1 --2- 172.21.15.132:0/2553156788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2888003970 0x7f28a013ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:53.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a63b4640 1 --2- 172.21.15.132:0/2553156788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28a01f0a90 0x7f28a00b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:53.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a53b2640 1 --2- 172.21.15.132:0/2553156788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28a0141760 0x7f28a01ee040 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f28940116d0 tx=0x7f2894011b90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:53.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f289e7fc640 1 -- 172.21.15.132:0/2553156788 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289400f9c0 con 0x7f28a0141760 2023-12-20T04:44:53.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f289e7fc640 1 -- 172.21.15.132:0/2553156788 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f289400fb20 con 0x7f28a0141760 2023-12-20T04:44:53.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a7e17640 1 -- 172.21.15.132:0/2553156788 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28a0151ab0 con 0x7f28a0141760 2023-12-20T04:44:53.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f289e7fc640 1 -- 172.21.15.132:0/2553156788 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f289400fed0 con 0x7f28a0141760 2023-12-20T04:44:53.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.927+0000 7f28a7e17640 1 -- 172.21.15.132:0/2553156788 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28a01f1120 con 0x7f28a0141760 2023-12-20T04:44:53.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.928+0000 7f28a7e17640 1 -- 172.21.15.132:0/2553156788 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28a0151630 con 0x7f28a0141760 2023-12-20T04:44:53.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.929+0000 7f289e7fc640 1 -- 172.21.15.132:0/2553156788 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2894015460 con 0x7f28a0141760 2023-12-20T04:44:53.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.929+0000 7f289e7fc640 1 --2- 172.21.15.132:0/2553156788 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f288c06a430 0x7f288c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:53.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.930+0000 7f289e7fc640 1 -- 172.21.15.132:0/2553156788 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2894089290 con 0x7f28a0141760 2023-12-20T04:44:53.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.930+0000 7f28a5bb3640 1 --2- 172.21.15.132:0/2553156788 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f288c06a430 0x7f288c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:53.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.930+0000 7f28a5bb3640 1 --2- 172.21.15.132:0/2553156788 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f288c06a430 0x7f288c06c8f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2890036000 tx=0x7f2890030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:53.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:53.934+0000 7f289e7fc640 1 -- 172.21.15.132:0/2553156788 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f28a0151630 con 0x7f28a0141760 2023-12-20T04:44:54.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.099+0000 7f28a7e17640 1 -- 172.21.15.132:0/2553156788 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f28a0151630 con 0x7f28a0141760 2023-12-20T04:44:54.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.100+0000 7f289e7fc640 1 -- 172.21.15.132:0/2553156788 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f28a0151630 con 0x7f28a0141760 2023-12-20T04:44:54.101 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:44:54.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.102+0000 7f28a7e17640 1 -- 172.21.15.132:0/2553156788 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f288c06a430 msgr2=0x7f288c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:54.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.102+0000 7f28a7e17640 1 --2- 172.21.15.132:0/2553156788 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f288c06a430 0x7f288c06c8f0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f2890036000 tx=0x7f2890030000 comp rx=0 tx=0).stop 2023-12-20T04:44:54.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.102+0000 7f28a7e17640 1 -- 172.21.15.132:0/2553156788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28a0141760 msgr2=0x7f28a01ee040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:54.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.102+0000 7f28a7e17640 1 --2- 172.21.15.132:0/2553156788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28a0141760 0x7f28a01ee040 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7f28940116d0 tx=0x7f2894011b90 comp rx=0 tx=0).stop 2023-12-20T04:44:54.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.102+0000 7f28a7e17640 1 -- 172.21.15.132:0/2553156788 shutdown_connections 2023-12-20T04:44:54.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.102+0000 7f28a7e17640 1 --2- 172.21.15.132:0/2553156788 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f288c06a430 0x7f288c06c8f0 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.102+0000 7f28a7e17640 1 --2- 172.21.15.132:0/2553156788 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28a01f0a90 0x7f28a00b3e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.102+0000 7f28a7e17640 1 --2- 172.21.15.132:0/2553156788 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28a0141760 0x7f28a01ee040 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.102+0000 7f28a7e17640 1 --2- 172.21.15.132:0/2553156788 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2888003970 0x7f28a013ea20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.102+0000 7f28a7e17640 1 -- 172.21.15.132:0/2553156788 >> 172.21.15.132:0/2553156788 conn(0x7f28a0072c60 msgr2=0x7f28a01588e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:54.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.102+0000 7f28a7e17640 1 -- 172.21.15.132:0/2553156788 shutdown_connections 2023-12-20T04:44:54.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.102+0000 7f28a7e17640 1 -- 172.21.15.132:0/2553156788 wait complete. 2023-12-20T04:44:54.114 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:44:54.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.215+0000 7ff27dcab640 1 Processor -- start 2023-12-20T04:44:54.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.215+0000 7ff27dcab640 1 -- start start 2023-12-20T04:44:54.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.216+0000 7ff27dcab640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff2780cb780 0x7ff2780cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:54.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.216+0000 7ff27dcab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff27815e0c0 0x7ff2780b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:54.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.216+0000 7ff27dcab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2780cf750 con 0x7ff2780cbb60 2023-12-20T04:44:54.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.216+0000 7ff27dcab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2780cf9e0 con 0x7ff27815e0c0 2023-12-20T04:44:54.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.216+0000 7ff27dcab640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2780cfcc0 con 0x7ff2780cb780 2023-12-20T04:44:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.216+0000 7ff277fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff27815e0c0 0x7ff2780b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.216+0000 7ff277fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff27815e0c0 0x7ff2780b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36498/0 (socket says 172.21.15.132:36498) 2023-12-20T04:44:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.216+0000 7ff26effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff2780cbb60 0x7ff2780cf040 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40304/0 (socket says 172.21.15.132:40304) 2023-12-20T04:44:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.216+0000 7ff277fff640 1 -- 172.21.15.132:0/3083827771 learned_addr learned my addr 172.21.15.132:0/3083827771 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.217+0000 7ff2777fe640 1 --2- 172.21.15.132:0/3083827771 >> v2:172.21.15.187:3300/0 conn(0x7ff2780cb780 0x7ff2780cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.217+0000 7ff277fff640 1 -- 172.21.15.132:0/3083827771 >> v2:172.21.15.187:3300/0 conn(0x7ff2780cb780 msgr2=0x7ff2780cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.217+0000 7ff277fff640 1 --2- 172.21.15.132:0/3083827771 >> v2:172.21.15.187:3300/0 conn(0x7ff2780cb780 0x7ff2780cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.217+0000 7ff277fff640 1 -- 172.21.15.132:0/3083827771 >> v1:172.21.15.132:6789/0 conn(0x7ff2780cbb60 legacy=0x7ff2780cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.217+0000 7ff277fff640 1 -- 172.21.15.132:0/3083827771 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2780cffa0 con 0x7ff27815e0c0 2023-12-20T04:44:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.217+0000 7ff276ffd640 1 -- 172.21.15.132:0/3083827771 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1507893364 0 0) 0x7ff2780cf750 con 0x7ff2780cbb60 2023-12-20T04:44:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.217+0000 7ff2777fe640 1 --2- 172.21.15.132:0/3083827771 >> v2:172.21.15.187:3300/0 conn(0x7ff2780cb780 0x7ff2780cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.217+0000 7ff277fff640 1 --2- 172.21.15.132:0/3083827771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff27815e0c0 0x7ff2780b1280 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff278072fe0 tx=0x7ff27002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b484f540b7f1ee26 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.218+0000 7ff276ffd640 1 -- 172.21.15.132:0/3083827771 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27002ca80 con 0x7ff27815e0c0 2023-12-20T04:44:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.218+0000 7ff276ffd640 1 -- 172.21.15.132:0/3083827771 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27002cbe0 con 0x7ff27815e0c0 2023-12-20T04:44:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.218+0000 7ff276ffd640 1 -- 172.21.15.132:0/3083827771 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2700343f0 con 0x7ff27815e0c0 2023-12-20T04:44:54.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.218+0000 7ff27dcab640 1 -- 172.21.15.132:0/3083827771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff27815e0c0 msgr2=0x7ff2780b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:54.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.218+0000 7ff27dcab640 1 --2- 172.21.15.132:0/3083827771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff27815e0c0 0x7ff2780b1280 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7ff278072fe0 tx=0x7ff27002bee0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.218+0000 7ff27dcab640 1 -- 172.21.15.132:0/3083827771 shutdown_connections 2023-12-20T04:44:54.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.218+0000 7ff27dcab640 1 --2- 172.21.15.132:0/3083827771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff27815e0c0 0x7ff2780b1280 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.218+0000 7ff27dcab640 1 --2- 172.21.15.132:0/3083827771 >> v2:172.21.15.187:3300/0 conn(0x7ff2780cb780 0x7ff2780cd3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.218+0000 7ff27dcab640 1 -- 172.21.15.132:0/3083827771 >> 172.21.15.132:0/3083827771 conn(0x7ff27806bfc0 msgr2=0x7ff27806c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:54.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.218+0000 7ff27dcab640 1 -- 172.21.15.132:0/3083827771 shutdown_connections 2023-12-20T04:44:54.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.218+0000 7ff27dcab640 1 -- 172.21.15.132:0/3083827771 wait complete. 2023-12-20T04:44:54.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.219+0000 7ff27dcab640 1 Processor -- start 2023-12-20T04:44:54.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.220+0000 7ff27dcab640 1 -- start start 2023-12-20T04:44:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.220+0000 7ff27dcab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2780cb780 0x7ff278144cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.220+0000 7ff27dcab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2780cbb60 0x7ff278145720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.220+0000 7ff27dcab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff27815e0c0 0x7ff2780b2fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.220+0000 7ff27dcab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780b3b70 con 0x7ff27815e0c0 2023-12-20T04:44:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.220+0000 7ff27dcab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2780b53a0 con 0x7ff2780cbb60 2023-12-20T04:44:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.220+0000 7ff27dcab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff27815fc80 con 0x7ff2780cb780 2023-12-20T04:44:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.220+0000 7ff277fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff27815e0c0 0x7ff2780b2fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.220+0000 7ff277fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff27815e0c0 0x7ff2780b2fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36502/0 (socket says 172.21.15.132:36502) 2023-12-20T04:44:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.220+0000 7ff277fff640 1 -- 172.21.15.132:0/1614599105 learned_addr learned my addr 172.21.15.132:0/1614599105 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.221+0000 7ff26effd640 1 --2- 172.21.15.132:0/1614599105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2780cbb60 0x7ff278145720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.221+0000 7ff2777fe640 1 --2- 172.21.15.132:0/1614599105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2780cb780 0x7ff278144cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.221+0000 7ff277fff640 1 -- 172.21.15.132:0/1614599105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2780cb780 msgr2=0x7ff278144cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.221+0000 7ff277fff640 1 --2- 172.21.15.132:0/1614599105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2780cb780 0x7ff278144cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.221+0000 7ff277fff640 1 -- 172.21.15.132:0/1614599105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2780cbb60 msgr2=0x7ff278145720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.221+0000 7ff277fff640 1 --2- 172.21.15.132:0/1614599105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2780cbb60 0x7ff278145720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.221+0000 7ff277fff640 1 -- 172.21.15.132:0/1614599105 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff270009b30 con 0x7ff27815e0c0 2023-12-20T04:44:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.221+0000 7ff277fff640 1 --2- 172.21.15.132:0/1614599105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff27815e0c0 0x7ff2780b2fb0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff270009f40 tx=0x7ff270004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.221+0000 7ff274ff9640 1 -- 172.21.15.132:0/1614599105 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff270009510 con 0x7ff27815e0c0 2023-12-20T04:44:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.221+0000 7ff274ff9640 1 -- 172.21.15.132:0/1614599105 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff27003e450 con 0x7ff27815e0c0 2023-12-20T04:44:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.221+0000 7ff27dcab640 1 -- 172.21.15.132:0/1614599105 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff27815ff60 con 0x7ff27815e0c0 2023-12-20T04:44:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.221+0000 7ff274ff9640 1 -- 172.21.15.132:0/1614599105 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff27003e800 con 0x7ff27815e0c0 2023-12-20T04:44:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.221+0000 7ff27dcab640 1 -- 172.21.15.132:0/1614599105 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff278160520 con 0x7ff27815e0c0 2023-12-20T04:44:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.222+0000 7ff27dcab640 1 -- 172.21.15.132:0/1614599105 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff278160740 con 0x7ff27815e0c0 2023-12-20T04:44:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.222+0000 7ff274ff9640 1 -- 172.21.15.132:0/1614599105 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff27002cd50 con 0x7ff27815e0c0 2023-12-20T04:44:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.223+0000 7ff274ff9640 1 --2- 172.21.15.132:0/1614599105 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff25806a460 0x7ff25806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.223+0000 7ff274ff9640 1 -- 172.21.15.132:0/1614599105 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff2700ab6f0 con 0x7ff27815e0c0 2023-12-20T04:44:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.223+0000 7ff2777fe640 1 --2- 172.21.15.132:0/1614599105 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff25806a460 0x7ff25806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:54.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.223+0000 7ff2777fe640 1 --2- 172.21.15.132:0/1614599105 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff25806a460 0x7ff25806c920 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff268006fd0 tx=0x7ff268008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:54.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.227+0000 7ff274ff9640 1 -- 172.21.15.132:0/1614599105 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff270076ca0 con 0x7ff27815e0c0 2023-12-20T04:44:54.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.395+0000 7ff27dcab640 1 -- 172.21.15.132:0/1614599105 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff2780ccb90 con 0x7ff27815e0c0 2023-12-20T04:44:54.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.395+0000 7ff274ff9640 1 -- 172.21.15.132:0/1614599105 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff270033e80 con 0x7ff27815e0c0 2023-12-20T04:44:54.396 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:44:54.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.397+0000 7ff27dcab640 1 -- 172.21.15.132:0/1614599105 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff25806a460 msgr2=0x7ff25806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:54.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.397+0000 7ff27dcab640 1 --2- 172.21.15.132:0/1614599105 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff25806a460 0x7ff25806c920 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7ff268006fd0 tx=0x7ff268008040 comp rx=0 tx=0).stop 2023-12-20T04:44:54.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.397+0000 7ff27dcab640 1 -- 172.21.15.132:0/1614599105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff27815e0c0 msgr2=0x7ff2780b2fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:54.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.397+0000 7ff27dcab640 1 --2- 172.21.15.132:0/1614599105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff27815e0c0 0x7ff2780b2fb0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff270009f40 tx=0x7ff270004a40 comp rx=0 tx=0).stop 2023-12-20T04:44:54.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.397+0000 7ff27dcab640 1 -- 172.21.15.132:0/1614599105 shutdown_connections 2023-12-20T04:44:54.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.397+0000 7ff27dcab640 1 --2- 172.21.15.132:0/1614599105 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff25806a460 0x7ff25806c920 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.397+0000 7ff27dcab640 1 --2- 172.21.15.132:0/1614599105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff27815e0c0 0x7ff2780b2fb0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.397+0000 7ff27dcab640 1 --2- 172.21.15.132:0/1614599105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2780cbb60 0x7ff278145720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.397+0000 7ff27dcab640 1 --2- 172.21.15.132:0/1614599105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2780cb780 0x7ff278144cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.397+0000 7ff27dcab640 1 -- 172.21.15.132:0/1614599105 >> 172.21.15.132:0/1614599105 conn(0x7ff27806bfc0 msgr2=0x7ff27806c3a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:54.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.397+0000 7ff27dcab640 1 -- 172.21.15.132:0/1614599105 shutdown_connections 2023-12-20T04:44:54.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.397+0000 7ff27dcab640 1 -- 172.21.15.132:0/1614599105 wait complete. 2023-12-20T04:44:54.409 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:44:54.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.509+0000 7fbc384d5640 1 Processor -- start 2023-12-20T04:44:54.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.509+0000 7fbc384d5640 1 -- start start 2023-12-20T04:44:54.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.510+0000 7fbc384d5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc300d0520 0x7fbc3015e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:54.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.510+0000 7fbc384d5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbc3015e570 0x7fbc3006ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:54.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.510+0000 7fbc384d5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc300d0980 con 0x7fbc3015af00 2023-12-20T04:44:54.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.510+0000 7fbc384d5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc3015dc10 con 0x7fbc3015e570 2023-12-20T04:44:54.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.510+0000 7fbc384d5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc3015b2e0 con 0x7fbc300d0520 2023-12-20T04:44:54.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.510+0000 7fbc36a72640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbc3015e570 0x7fbc3006ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:54.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.510+0000 7fbc36a72640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbc3015e570 0x7fbc3006ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36512/0 (socket says 172.21.15.132:36512) 2023-12-20T04:44:54.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.510+0000 7fbc36a72640 1 -- 172.21.15.132:0/3857865340 learned_addr learned my addr 172.21.15.132:0/3857865340 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:54.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.510+0000 7fbc36271640 1 --1- 172.21.15.132:0/3857865340 >> v1:172.21.15.132:6789/0 conn(0x7fbc3015af00 0x7fbc30160e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40306/0 (socket says 172.21.15.132:40306) 2023-12-20T04:44:54.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.510+0000 7fbc35a70640 1 --2- 172.21.15.132:0/3857865340 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc300d0520 0x7fbc3015e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:54.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.510+0000 7fbc36a72640 1 -- 172.21.15.132:0/3857865340 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc300d0520 msgr2=0x7fbc3015e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:54.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.510+0000 7fbc36a72640 1 --2- 172.21.15.132:0/3857865340 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc300d0520 0x7fbc3015e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.510+0000 7fbc36a72640 1 -- 172.21.15.132:0/3857865340 >> v1:172.21.15.132:6789/0 conn(0x7fbc3015af00 legacy=0x7fbc30160e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:54.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.510+0000 7fbc3526f640 1 -- 172.21.15.132:0/3857865340 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2015324746 0 0) 0x7fbc300d0980 con 0x7fbc3015af00 2023-12-20T04:44:54.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.510+0000 7fbc36a72640 1 -- 172.21.15.132:0/3857865340 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc30161660 con 0x7fbc3015e570 2023-12-20T04:44:54.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.510+0000 7fbc35a70640 1 --2- 172.21.15.132:0/3857865340 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc300d0520 0x7fbc3015e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:54.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.511+0000 7fbc36a72640 1 --2- 172.21.15.132:0/3857865340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc3015e570 0x7fbc3006ad40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009870 tx=0x7fbc2802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e508f7fdcba5886 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:54.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.511+0000 7fbc3526f640 1 -- 172.21.15.132:0/3857865340 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28031640 con 0x7fbc3015e570 2023-12-20T04:44:54.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.511+0000 7fbc3526f640 1 -- 172.21.15.132:0/3857865340 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc280317a0 con 0x7fbc3015e570 2023-12-20T04:44:54.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.511+0000 7fbc3526f640 1 -- 172.21.15.132:0/3857865340 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28031b30 con 0x7fbc3015e570 2023-12-20T04:44:54.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.512+0000 7fbc384d5640 1 -- 172.21.15.132:0/3857865340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc3015e570 msgr2=0x7fbc3006ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:54.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.512+0000 7fbc384d5640 1 --2- 172.21.15.132:0/3857865340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc3015e570 0x7fbc3006ad40 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7fbc28009870 tx=0x7fbc2802b8f0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.512+0000 7fbc384d5640 1 -- 172.21.15.132:0/3857865340 shutdown_connections 2023-12-20T04:44:54.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.512+0000 7fbc384d5640 1 --2- 172.21.15.132:0/3857865340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc3015e570 0x7fbc3006ad40 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.512+0000 7fbc384d5640 1 --2- 172.21.15.132:0/3857865340 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc300d0520 0x7fbc3015e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.512+0000 7fbc384d5640 1 -- 172.21.15.132:0/3857865340 >> 172.21.15.132:0/3857865340 conn(0x7fbc3006d640 msgr2=0x7fbc3006da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.512+0000 7fbc384d5640 1 -- 172.21.15.132:0/3857865340 shutdown_connections 2023-12-20T04:44:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.512+0000 7fbc384d5640 1 -- 172.21.15.132:0/3857865340 wait complete. 2023-12-20T04:44:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.513+0000 7fbc384d5640 1 Processor -- start 2023-12-20T04:44:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.513+0000 7fbc384d5640 1 -- start start 2023-12-20T04:44:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.514+0000 7fbc384d5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc300d0520 0x7fbc30151ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.514+0000 7fbc384d5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc3015af00 0x7fbc30156ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.514+0000 7fbc384d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc3015e570 0x7fbc3015bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.514+0000 7fbc384d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc301f27f0 con 0x7fbc3015e570 2023-12-20T04:44:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.514+0000 7fbc384d5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300b1490 con 0x7fbc3015af00 2023-12-20T04:44:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.514+0000 7fbc384d5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc300b1770 con 0x7fbc300d0520 2023-12-20T04:44:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.514+0000 7fbc36a72640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc3015e570 0x7fbc3015bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:54.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.514+0000 7fbc36a72640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc3015e570 0x7fbc3015bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36526/0 (socket says 172.21.15.132:36526) 2023-12-20T04:44:54.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.514+0000 7fbc36a72640 1 -- 172.21.15.132:0/1091888862 learned_addr learned my addr 172.21.15.132:0/1091888862 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:54.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.514+0000 7fbc35a70640 1 --2- 172.21.15.132:0/1091888862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc3015af00 0x7fbc30156ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:54.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.514+0000 7fbc36271640 1 --2- 172.21.15.132:0/1091888862 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc300d0520 0x7fbc30151ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:54.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.514+0000 7fbc36a72640 1 -- 172.21.15.132:0/1091888862 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc300d0520 msgr2=0x7fbc30151ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:54.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.514+0000 7fbc36a72640 1 --2- 172.21.15.132:0/1091888862 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc300d0520 0x7fbc30151ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.514+0000 7fbc36a72640 1 -- 172.21.15.132:0/1091888862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc3015af00 msgr2=0x7fbc30156ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:54.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.514+0000 7fbc36a72640 1 --2- 172.21.15.132:0/1091888862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc3015af00 0x7fbc30156ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.514+0000 7fbc36a72640 1 -- 172.21.15.132:0/1091888862 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc280094d0 con 0x7fbc3015e570 2023-12-20T04:44:54.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.514+0000 7fbc36a72640 1 --2- 172.21.15.132:0/1091888862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc3015e570 0x7fbc3015bdd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbc2802b930 tx=0x7fbc280046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:54.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.515+0000 7fbc26ffd640 1 -- 172.21.15.132:0/1091888862 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc2803ac60 con 0x7fbc3015e570 2023-12-20T04:44:54.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.515+0000 7fbc26ffd640 1 -- 172.21.15.132:0/1091888862 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc2803adc0 con 0x7fbc3015e570 2023-12-20T04:44:54.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.515+0000 7fbc26ffd640 1 -- 172.21.15.132:0/1091888862 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc28044630 con 0x7fbc3015e570 2023-12-20T04:44:54.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.515+0000 7fbc384d5640 1 -- 172.21.15.132:0/1091888862 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc300b1a50 con 0x7fbc3015e570 2023-12-20T04:44:54.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.515+0000 7fbc384d5640 1 -- 172.21.15.132:0/1091888862 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc300b2010 con 0x7fbc3015e570 2023-12-20T04:44:54.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.516+0000 7fbc384d5640 1 -- 172.21.15.132:0/1091888862 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc300b2200 con 0x7fbc3015e570 2023-12-20T04:44:54.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.516+0000 7fbc26ffd640 1 -- 172.21.15.132:0/1091888862 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbc2802f050 con 0x7fbc3015e570 2023-12-20T04:44:54.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.516+0000 7fbc26ffd640 1 --2- 172.21.15.132:0/1091888862 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc1406a460 0x7fbc1406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:54.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.516+0000 7fbc26ffd640 1 -- 172.21.15.132:0/1091888862 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbc280aa7e0 con 0x7fbc3015e570 2023-12-20T04:44:54.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.516+0000 7fbc36271640 1 --2- 172.21.15.132:0/1091888862 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc1406a460 0x7fbc1406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:54.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.517+0000 7fbc36271640 1 --2- 172.21.15.132:0/1091888862 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc1406a460 0x7fbc1406c920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0012e0 tx=0x7fbc2c001700 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:54.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.521+0000 7fbc26ffd640 1 -- 172.21.15.132:0/1091888862 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbc28075e40 con 0x7fbc3015e570 2023-12-20T04:44:54.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.700+0000 7fbc384d5640 1 -- 172.21.15.132:0/1091888862 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fbc3004e840 con 0x7fbc3015e570 2023-12-20T04:44:54.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.700+0000 7fbc26ffd640 1 -- 172.21.15.132:0/1091888862 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v53) v1 ==== 80+0+0 (secure 0 0 0) 0x7fbc28079460 con 0x7fbc3015e570 2023-12-20T04:44:54.701 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:44:54.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.702+0000 7fbc384d5640 1 -- 172.21.15.132:0/1091888862 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc1406a460 msgr2=0x7fbc1406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:54.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.702+0000 7fbc384d5640 1 --2- 172.21.15.132:0/1091888862 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc1406a460 0x7fbc1406c920 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fbc2c0012e0 tx=0x7fbc2c001700 comp rx=0 tx=0).stop 2023-12-20T04:44:54.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.702+0000 7fbc384d5640 1 -- 172.21.15.132:0/1091888862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc3015e570 msgr2=0x7fbc3015bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:54.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.702+0000 7fbc384d5640 1 --2- 172.21.15.132:0/1091888862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc3015e570 0x7fbc3015bdd0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7fbc2802b930 tx=0x7fbc280046c0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.702+0000 7fbc384d5640 1 -- 172.21.15.132:0/1091888862 shutdown_connections 2023-12-20T04:44:54.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.702+0000 7fbc384d5640 1 --2- 172.21.15.132:0/1091888862 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc1406a460 0x7fbc1406c920 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.702+0000 7fbc384d5640 1 --2- 172.21.15.132:0/1091888862 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc3015e570 0x7fbc3015bdd0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.702+0000 7fbc384d5640 1 --2- 172.21.15.132:0/1091888862 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc3015af00 0x7fbc30156ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.702+0000 7fbc384d5640 1 --2- 172.21.15.132:0/1091888862 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc300d0520 0x7fbc30151ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:54.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.702+0000 7fbc384d5640 1 -- 172.21.15.132:0/1091888862 >> 172.21.15.132:0/1091888862 conn(0x7fbc3006d640 msgr2=0x7fbc3015cd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:54.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.702+0000 7fbc384d5640 1 -- 172.21.15.132:0/1091888862 shutdown_connections 2023-12-20T04:44:54.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:54.702+0000 7fbc384d5640 1 -- 172.21.15.132:0/1091888862 wait complete. 2023-12-20T04:44:54.714 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi187.front.sepia.ceph.com... 2023-12-20T04:44:54.714 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:54.714 DEBUG:teuthology.orchestra.run.smithi187:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-20T04:44:54.744 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[87220]: fuse finished with error 0 and tester_r 0 2023-12-20T04:44:54.746 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:44:54.746 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:54.746 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-20T04:44:54.917 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:44:54.917 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:44:54.933 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:44:54.933 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:44:54.933 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:54.933 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-20T04:44:54.988 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:44:54.989 INFO:teuthology.orchestra.run.smithi132.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-20T04:44:54.989 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:44:54.989 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:44:55.007 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:44:55.007 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:44:55.007 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:44:55.008 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-20T04:44:55.064 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:44:55.065 INFO:teuthology.orchestra.run.smithi187.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-20T04:44:55.065 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:44:55.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.164+0000 7fcd74d18640 1 Processor -- start 2023-12-20T04:44:55.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.164+0000 7fcd74d18640 1 -- start start 2023-12-20T04:44:55.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.164+0000 7fcd74d18640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcd7015e530 0x7fcd7006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.164+0000 7fcd74d18640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd700ccf30 con 0x7fcd70159b50 2023-12-20T04:44:55.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.164+0000 7fcd74d18640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd700ca1c0 con 0x7fcd7006c240 2023-12-20T04:44:55.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.164+0000 7fcd74d18640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd700caa60 con 0x7fcd7015e530 2023-12-20T04:44:55.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6e59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcd70159b50 0x7fcd700c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40310/0 (socket says 172.21.15.132:40310) 2023-12-20T04:44:55.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6e59c640 1 -- 172.21.15.132:0/1894386449 learned_addr learned my addr 172.21.15.132:0/1894386449 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6dd9b640 1 -- 172.21.15.132:0/1894386449 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653155216 0 0) 0x7fcd700ccf30 con 0x7fcd70159b50 2023-12-20T04:44:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6dd9b640 1 -- 172.21.15.132:0/1894386449 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcd5c003520 con 0x7fcd70159b50 2023-12-20T04:44:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd67fff640 1 --2- 172.21.15.132:0/1894386449 >> v2:172.21.15.187:3300/0 conn(0x7fcd7015e530 0x7fcd7006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6dd9b640 1 -- 172.21.15.132:0/1894386449 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2402604949 0 0) 0x7fcd5c003520 con 0x7fcd70159b50 2023-12-20T04:44:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6dd9b640 1 -- 172.21.15.132:0/1894386449 >> v2:172.21.15.187:3300/0 conn(0x7fcd7015e530 msgr2=0x7fcd7006fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6dd9b640 1 --2- 172.21.15.132:0/1894386449 >> v2:172.21.15.187:3300/0 conn(0x7fcd7015e530 0x7fcd7006fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6dd9b640 1 -- 172.21.15.132:0/1894386449 >> v1:172.21.15.187:6789/0 conn(0x7fcd7006c240 legacy=0x7fcd700cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6dd9b640 1 -- 172.21.15.132:0/1894386449 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd700ca4a0 con 0x7fcd70159b50 2023-12-20T04:44:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6dd9b640 1 -- 172.21.15.132:0/1894386449 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fcd60001670 con 0x7fcd70159b50 2023-12-20T04:44:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6dd9b640 1 -- 172.21.15.132:0/1894386449 >> v1:172.21.15.132:6789/0 conn(0x7fcd70159b50 legacy=0x7fcd700c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6dd9b640 1 --2- 172.21.15.132:0/1894386449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd5c003970 0x7fcd5c003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6dd9b640 1 --2- 172.21.15.132:0/1894386449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd5c0047c0 0x7fcd5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6dd9b640 1 --2- 172.21.15.132:0/1894386449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd5c005180 0x7fcd5c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6dd9b640 1 -- 172.21.15.132:0/1894386449 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd700caa60 con 0x7fcd5c0047c0 2023-12-20T04:44:55.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6dd9b640 1 -- 172.21.15.132:0/1894386449 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c00c0b0 con 0x7fcd5c005180 2023-12-20T04:44:55.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6dd9b640 1 -- 172.21.15.132:0/1894386449 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd5c00c270 con 0x7fcd5c003970 2023-12-20T04:44:55.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd67fff640 1 --2- 172.21.15.132:0/1894386449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd5c0047c0 0x7fcd5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6e59c640 1 --2- 172.21.15.132:0/1894386449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd5c003970 0x7fcd5c003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6ed9d640 1 --2- 172.21.15.132:0/1894386449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd5c005180 0x7fcd5c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd67fff640 1 -- 172.21.15.132:0/1894386449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd5c003970 msgr2=0x7fcd5c003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:55.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd67fff640 1 --2- 172.21.15.132:0/1894386449 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd5c003970 0x7fcd5c003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd67fff640 1 -- 172.21.15.132:0/1894386449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd5c005180 msgr2=0x7fcd5c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:55.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd67fff640 1 --2- 172.21.15.132:0/1894386449 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd5c005180 0x7fcd5c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd6ed9d640 1 -- 172.21.15.132:0/1894386449 reap_dead start 2023-12-20T04:44:55.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.165+0000 7fcd67fff640 1 -- 172.21.15.132:0/1894386449 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd5c003520 con 0x7fcd5c0047c0 2023-12-20T04:44:55.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.166+0000 7fcd67fff640 1 --2- 172.21.15.132:0/1894386449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd5c0047c0 0x7fcd5c004c40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800ba00 tx=0x7fcd5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b72a0d8f797063 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:55.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.166+0000 7fcd6dd9b640 1 -- 172.21.15.132:0/1894386449 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58032620 con 0x7fcd5c0047c0 2023-12-20T04:44:55.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.166+0000 7fcd6dd9b640 1 -- 172.21.15.132:0/1894386449 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd58032780 con 0x7fcd5c0047c0 2023-12-20T04:44:55.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.166+0000 7fcd6dd9b640 1 -- 172.21.15.132:0/1894386449 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd58032b10 con 0x7fcd5c0047c0 2023-12-20T04:44:55.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.167+0000 7fcd74d18640 1 -- 172.21.15.132:0/1894386449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd5c0047c0 msgr2=0x7fcd5c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.167+0000 7fcd74d18640 1 --2- 172.21.15.132:0/1894386449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd5c0047c0 0x7fcd5c004c40 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7fcd5800ba00 tx=0x7fcd5c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.167+0000 7fcd74d18640 1 -- 172.21.15.132:0/1894386449 shutdown_connections 2023-12-20T04:44:55.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.167+0000 7fcd74d18640 1 --2- 172.21.15.132:0/1894386449 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd5c0047c0 0x7fcd5c004c40 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.167+0000 7fcd74d18640 1 -- 172.21.15.132:0/1894386449 >> 172.21.15.132:0/1894386449 conn(0x7fcd700ced10 msgr2=0x7fcd700cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:55.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.167+0000 7fcd74d18640 1 -- 172.21.15.132:0/1894386449 shutdown_connections 2023-12-20T04:44:55.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.167+0000 7fcd74d18640 1 -- 172.21.15.132:0/1894386449 wait complete. 2023-12-20T04:44:55.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.168+0000 7fcd74d18640 1 Processor -- start 2023-12-20T04:44:55.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.168+0000 7fcd74d18640 1 -- start start 2023-12-20T04:44:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.169+0000 7fcd74d18640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd5c0047c0 0x7fcd700b1250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.169+0000 7fcd74d18640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd700c27b0 0x7fcd701f2d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.169+0000 7fcd74d18640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd701532f0 0x7fcd70153cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.169+0000 7fcd74d18640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd700c2c30 con 0x7fcd701532f0 2023-12-20T04:44:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.169+0000 7fcd74d18640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd701f35b0 con 0x7fcd5c0047c0 2023-12-20T04:44:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.169+0000 7fcd74d18640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd701f3890 con 0x7fcd700c27b0 2023-12-20T04:44:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.169+0000 7fcd6ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd701532f0 0x7fcd70153cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.169+0000 7fcd6ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd701532f0 0x7fcd70153cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36548/0 (socket says 172.21.15.132:36548) 2023-12-20T04:44:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.169+0000 7fcd6ed9d640 1 -- 172.21.15.132:0/1293851729 learned_addr learned my addr 172.21.15.132:0/1293851729 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.169+0000 7fcd67fff640 1 --2- 172.21.15.132:0/1293851729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd700c27b0 0x7fcd701f2d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.169+0000 7fcd6e59c640 1 --2- 172.21.15.132:0/1293851729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd5c0047c0 0x7fcd700b1250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.169+0000 7fcd6ed9d640 1 -- 172.21.15.132:0/1293851729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd700c27b0 msgr2=0x7fcd701f2d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.169+0000 7fcd6ed9d640 1 --2- 172.21.15.132:0/1293851729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd700c27b0 0x7fcd701f2d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.169+0000 7fcd6ed9d640 1 -- 172.21.15.132:0/1293851729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd5c0047c0 msgr2=0x7fcd700b1250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.169+0000 7fcd6ed9d640 1 --2- 172.21.15.132:0/1293851729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd5c0047c0 0x7fcd700b1250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.169+0000 7fcd6ed9d640 1 -- 172.21.15.132:0/1293851729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd701f3b70 con 0x7fcd701532f0 2023-12-20T04:44:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.169+0000 7fcd6ed9d640 1 --2- 172.21.15.132:0/1293851729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd701532f0 0x7fcd70153cd0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fcd7006fb00 tx=0x7fcd6800e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.170+0000 7fcd66ffd640 1 -- 172.21.15.132:0/1293851729 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd68006d60 con 0x7fcd701532f0 2023-12-20T04:44:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.170+0000 7fcd66ffd640 1 -- 172.21.15.132:0/1293851729 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd68007030 con 0x7fcd701532f0 2023-12-20T04:44:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.170+0000 7fcd74d18640 1 -- 172.21.15.132:0/1293851729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd70155fa0 con 0x7fcd701532f0 2023-12-20T04:44:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.170+0000 7fcd66ffd640 1 -- 172.21.15.132:0/1293851729 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd680073e0 con 0x7fcd701532f0 2023-12-20T04:44:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.170+0000 7fcd74d18640 1 -- 172.21.15.132:0/1293851729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd701f3280 con 0x7fcd701532f0 2023-12-20T04:44:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.171+0000 7fcd74d18640 1 -- 172.21.15.132:0/1293851729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd701564c0 con 0x7fcd701532f0 2023-12-20T04:44:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.171+0000 7fcd66ffd640 1 -- 172.21.15.132:0/1293851729 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcd68007540 con 0x7fcd701532f0 2023-12-20T04:44:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.171+0000 7fcd66ffd640 1 --2- 172.21.15.132:0/1293851729 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcd5006a430 0x7fcd5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.171+0000 7fcd66ffd640 1 -- 172.21.15.132:0/1293851729 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fcd680885f0 con 0x7fcd701532f0 2023-12-20T04:44:55.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.171+0000 7fcd6e59c640 1 --2- 172.21.15.132:0/1293851729 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcd5006a430 0x7fcd5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.172+0000 7fcd6e59c640 1 --2- 172.21.15.132:0/1293851729 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcd5006a430 0x7fcd5006c8f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcd60001cb0 tx=0x7fcd60009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:55.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.176+0000 7fcd66ffd640 1 -- 172.21.15.132:0/1293851729 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcd701564c0 con 0x7fcd701532f0 2023-12-20T04:44:55.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.373+0000 7fcd74d18640 1 -- 172.21.15.132:0/1293851729 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcd701564c0 con 0x7fcd701532f0 2023-12-20T04:44:55.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.374+0000 7fcd66ffd640 1 -- 172.21.15.132:0/1293851729 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4721 (secure 0 0 0) 0x7fcd701564c0 con 0x7fcd701532f0 2023-12-20T04:44:55.376 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:55.376 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1456944733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1456944733},{"type":"v1","addr":"172.21.15.187:6834","nonce":1456944733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2114954856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2114954856},{"type":"v1","addr":"172.21.15.187:6835","nonce":2114954856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2494230497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2494230497},{"type":"v1","addr":"172.21.15.132:6837","nonce":2494230497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:44:17.197194+0000","modified":"2023-12-20T04:44:19.205156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/1024674556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1024674556},{"type":"v1","addr":"172.21.15.132:6836","nonce":1024674556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-20T04:44:55.376 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 19 2023-12-20T04:44:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.376+0000 7fcd74d18640 1 -- 172.21.15.132:0/1293851729 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcd5006a430 msgr2=0x7fcd5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.376+0000 7fcd74d18640 1 --2- 172.21.15.132:0/1293851729 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcd5006a430 0x7fcd5006c8f0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fcd60001cb0 tx=0x7fcd60009040 comp rx=0 tx=0).stop 2023-12-20T04:44:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.376+0000 7fcd74d18640 1 -- 172.21.15.132:0/1293851729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd701532f0 msgr2=0x7fcd70153cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.376+0000 7fcd74d18640 1 --2- 172.21.15.132:0/1293851729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd701532f0 0x7fcd70153cd0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7fcd7006fb00 tx=0x7fcd6800e9e0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.376+0000 7fcd74d18640 1 -- 172.21.15.132:0/1293851729 shutdown_connections 2023-12-20T04:44:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.376+0000 7fcd74d18640 1 --2- 172.21.15.132:0/1293851729 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcd5006a430 0x7fcd5006c8f0 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.376+0000 7fcd74d18640 1 --2- 172.21.15.132:0/1293851729 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd701532f0 0x7fcd70153cd0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.376+0000 7fcd74d18640 1 --2- 172.21.15.132:0/1293851729 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd700c27b0 0x7fcd701f2d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.376+0000 7fcd74d18640 1 --2- 172.21.15.132:0/1293851729 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd5c0047c0 0x7fcd700b1250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.376+0000 7fcd74d18640 1 -- 172.21.15.132:0/1293851729 >> 172.21.15.132:0/1293851729 conn(0x7fcd700ced10 msgr2=0x7fcd700b29e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.376+0000 7fcd74d18640 1 -- 172.21.15.132:0/1293851729 shutdown_connections 2023-12-20T04:44:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.376+0000 7fcd74d18640 1 -- 172.21.15.132:0/1293851729 wait complete. 2023-12-20T04:44:55.389 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:44:55.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.487+0000 7f8ce9843640 1 Processor -- start 2023-12-20T04:44:55.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.487+0000 7f8ce9843640 1 -- start start 2023-12-20T04:44:55.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce9843640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ce40b4de0 0x7f8ce40d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce9843640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce40b5ec0 con 0x7f8ce40b4980 2023-12-20T04:44:55.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce9843640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ce41617e0 con 0x7f8ce4160450 2023-12-20T04:44:55.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce9843640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce40d0fc0 con 0x7f8ce40b4de0 2023-12-20T04:44:55.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8cdbfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8ce40b4980 0x7f8ce40d1aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40312/0 (socket says 172.21.15.132:40312) 2023-12-20T04:44:55.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8cdbfff640 1 -- 172.21.15.132:0/2969371866 learned_addr learned my addr 172.21.15.132:0/2969371866 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:55.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce37fe640 1 --2- 172.21.15.132:0/2969371866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ce40b4de0 0x7f8ce40d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce27fc640 1 -- 172.21.15.132:0/2969371866 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1313602255 0 0) 0x7f8ce40b5ec0 con 0x7f8ce40b4980 2023-12-20T04:44:55.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce27fc640 1 -- 172.21.15.132:0/2969371866 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cd0003520 con 0x7f8ce40b4980 2023-12-20T04:44:55.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce27fc640 1 -- 172.21.15.132:0/2969371866 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1319933904 0 0) 0x7f8ce41617e0 con 0x7f8ce4160450 2023-12-20T04:44:55.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce27fc640 1 -- 172.21.15.132:0/2969371866 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8ce40b5ec0 con 0x7f8ce4160450 2023-12-20T04:44:55.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce27fc640 1 -- 172.21.15.132:0/2969371866 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3132262344 0 0) 0x7f8cd0003520 con 0x7f8ce40b4980 2023-12-20T04:44:55.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce27fc640 1 -- 172.21.15.132:0/2969371866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ce40b4de0 msgr2=0x7f8ce40d21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:55.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce27fc640 1 --2- 172.21.15.132:0/2969371866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ce40b4de0 0x7f8ce40d21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce27fc640 1 -- 172.21.15.132:0/2969371866 >> v1:172.21.15.187:6789/0 conn(0x7f8ce4160450 legacy=0x7f8ce4160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce27fc640 1 -- 172.21.15.132:0/2969371866 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce40d12a0 con 0x7f8ce40b4980 2023-12-20T04:44:55.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce27fc640 1 -- 172.21.15.132:0/2969371866 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f8ccc001690 con 0x7f8ce40b4980 2023-12-20T04:44:55.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce27fc640 1 -- 172.21.15.132:0/2969371866 >> v1:172.21.15.132:6789/0 conn(0x7f8ce40b4980 legacy=0x7f8ce40d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce27fc640 1 --2- 172.21.15.132:0/2969371866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd0003b30 0x7f8cd0003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce27fc640 1 --2- 172.21.15.132:0/2969371866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ce40b4de0 0x7f8cd00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce27fc640 1 --2- 172.21.15.132:0/2969371866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cd0004d00 0x7f8cd0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce27fc640 1 -- 172.21.15.132:0/2969371866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce40d0fc0 con 0x7f8cd0004d00 2023-12-20T04:44:55.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce27fc640 1 -- 172.21.15.132:0/2969371866 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd0014240 con 0x7f8cd0003b30 2023-12-20T04:44:55.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce27fc640 1 -- 172.21.15.132:0/2969371866 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd00143b0 con 0x7f8ce40b4de0 2023-12-20T04:44:55.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce37fe640 1 --2- 172.21.15.132:0/2969371866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cd0004d00 0x7f8cd0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.488+0000 7f8ce2ffd640 1 --2- 172.21.15.132:0/2969371866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd0003b30 0x7f8cd0003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.489+0000 7f8cdbfff640 1 --2- 172.21.15.132:0/2969371866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ce40b4de0 0x7f8cd00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.489+0000 7f8ce37fe640 1 -- 172.21.15.132:0/2969371866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ce40b4de0 msgr2=0x7f8cd00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:55.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.489+0000 7f8ce37fe640 1 --2- 172.21.15.132:0/2969371866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ce40b4de0 0x7f8cd00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.489+0000 7f8ce37fe640 1 -- 172.21.15.132:0/2969371866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd0003b30 msgr2=0x7f8cd0003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:55.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.489+0000 7f8ce37fe640 1 --2- 172.21.15.132:0/2969371866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cd0003b30 0x7f8cd0003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.489+0000 7f8ce37fe640 1 -- 172.21.15.132:0/2969371866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd0003520 con 0x7f8cd0004d00 2023-12-20T04:44:55.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.489+0000 7f8ce37fe640 1 --2- 172.21.15.132:0/2969371866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cd0004d00 0x7f8cd0005180 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc009fc0 tx=0x7f8cd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ff3730fd041dba5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:55.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.490+0000 7f8ce27fc640 1 -- 172.21.15.132:0/2969371866 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc02cc20 con 0x7f8cd0004d00 2023-12-20T04:44:55.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.490+0000 7f8ce27fc640 1 -- 172.21.15.132:0/2969371866 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc00f040 con 0x7f8cd0004d00 2023-12-20T04:44:55.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.490+0000 7f8ce27fc640 1 -- 172.21.15.132:0/2969371866 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc034440 con 0x7f8cd0004d00 2023-12-20T04:44:55.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.490+0000 7f8ce9843640 1 -- 172.21.15.132:0/2969371866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cd0004d00 msgr2=0x7f8cd0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.490+0000 7f8ce9843640 1 --2- 172.21.15.132:0/2969371866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cd0004d00 0x7f8cd0005180 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc009fc0 tx=0x7f8cd00057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.490+0000 7f8ce37fe640 1 -- 172.21.15.132:0/2969371866 reap_dead start 2023-12-20T04:44:55.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.490+0000 7f8ce9843640 1 -- 172.21.15.132:0/2969371866 shutdown_connections 2023-12-20T04:44:55.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.490+0000 7f8ce9843640 1 -- 172.21.15.132:0/2969371866 >> 172.21.15.132:0/2969371866 conn(0x7f8ce40cf980 msgr2=0x7f8ce40cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:55.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.490+0000 7f8ce9843640 1 -- 172.21.15.132:0/2969371866 shutdown_connections 2023-12-20T04:44:55.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.490+0000 7f8ce9843640 1 -- 172.21.15.132:0/2969371866 wait complete. 2023-12-20T04:44:55.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.491+0000 7f8ce9843640 1 Processor -- start 2023-12-20T04:44:55.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.491+0000 7f8ce9843640 1 -- start start 2023-12-20T04:44:55.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.492+0000 7f8ce9843640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd0004d00 0x7f8ce40cc250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.492+0000 7f8ce9843640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ce4150de0 0x7f8ce414b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.492+0000 7f8ce9843640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ce41530d0 0x7f8ce4153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.492+0000 7f8ce9843640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce4153f60 con 0x7f8ce41530d0 2023-12-20T04:44:55.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.492+0000 7f8ce9843640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce40ca390 con 0x7f8ce4150de0 2023-12-20T04:44:55.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.492+0000 7f8ce9843640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ce4153a90 con 0x7f8cd0004d00 2023-12-20T04:44:55.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.492+0000 7f8ce37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ce41530d0 0x7f8ce4153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.492+0000 7f8ce37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ce41530d0 0x7f8ce4153550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36566/0 (socket says 172.21.15.132:36566) 2023-12-20T04:44:55.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.492+0000 7f8ce37fe640 1 -- 172.21.15.132:0/459858897 learned_addr learned my addr 172.21.15.132:0/459858897 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:55.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.492+0000 7f8ce2ffd640 1 --2- 172.21.15.132:0/459858897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd0004d00 0x7f8ce40cc250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.492+0000 7f8cdbfff640 1 --2- 172.21.15.132:0/459858897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ce4150de0 0x7f8ce414b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.492+0000 7f8ce37fe640 1 -- 172.21.15.132:0/459858897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd0004d00 msgr2=0x7f8ce40cc250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.492+0000 7f8ce37fe640 1 --2- 172.21.15.132:0/459858897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd0004d00 0x7f8ce40cc250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.492+0000 7f8ce37fe640 1 -- 172.21.15.132:0/459858897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ce4150de0 msgr2=0x7f8ce414b290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.492+0000 7f8ce37fe640 1 --2- 172.21.15.132:0/459858897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ce4150de0 0x7f8ce414b290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.492+0000 7f8ce37fe640 1 -- 172.21.15.132:0/459858897 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce40cc790 con 0x7f8ce41530d0 2023-12-20T04:44:55.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.493+0000 7f8ce2ffd640 1 --2- 172.21.15.132:0/459858897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd0004d00 0x7f8ce40cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:55.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.493+0000 7f8ce37fe640 1 --2- 172.21.15.132:0/459858897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ce41530d0 0x7f8ce4153550 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc002230 tx=0x7f8cdc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:55.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.493+0000 7f8ce0ff9640 1 -- 172.21.15.132:0/459858897 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc034ad0 con 0x7f8ce41530d0 2023-12-20T04:44:55.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.493+0000 7f8ce0ff9640 1 -- 172.21.15.132:0/459858897 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cdc034c30 con 0x7f8ce41530d0 2023-12-20T04:44:55.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.493+0000 7f8ce9843640 1 -- 172.21.15.132:0/459858897 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ce40cca00 con 0x7f8ce41530d0 2023-12-20T04:44:55.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.493+0000 7f8ce0ff9640 1 -- 172.21.15.132:0/459858897 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cdc003990 con 0x7f8ce41530d0 2023-12-20T04:44:55.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.493+0000 7f8ce9843640 1 -- 172.21.15.132:0/459858897 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ce40ccfc0 con 0x7f8ce41530d0 2023-12-20T04:44:55.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.494+0000 7f8ce9843640 1 -- 172.21.15.132:0/459858897 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ce404e840 con 0x7f8ce41530d0 2023-12-20T04:44:55.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.494+0000 7f8ce0ff9640 1 -- 172.21.15.132:0/459858897 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8cdc03e440 con 0x7f8ce41530d0 2023-12-20T04:44:55.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.495+0000 7f8ce0ff9640 1 --2- 172.21.15.132:0/459858897 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cc406a460 0x7f8cc406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.495+0000 7f8ce0ff9640 1 -- 172.21.15.132:0/459858897 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8cdc0aab90 con 0x7f8ce41530d0 2023-12-20T04:44:55.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.495+0000 7f8ce2ffd640 1 --2- 172.21.15.132:0/459858897 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cc406a460 0x7f8cc406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.495+0000 7f8ce2ffd640 1 --2- 172.21.15.132:0/459858897 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cc406a460 0x7f8cc406c920 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40035f0 tx=0x7f8cd4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:55.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.499+0000 7f8ce0ff9640 1 -- 172.21.15.132:0/459858897 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8cdc0761d0 con 0x7f8ce41530d0 2023-12-20T04:44:55.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.664+0000 7f8ce9843640 1 -- 172.21.15.132:0/459858897 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8ce4071140 con 0x7f8ce41530d0 2023-12-20T04:44:55.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.665+0000 7f8ce0ff9640 1 -- 172.21.15.132:0/459858897 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16188 (secure 0 0 0) 0x7f8cdc0797f0 con 0x7f8ce41530d0 2023-12-20T04:44:55.666 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:55.667 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":53,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:44:45.942314+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:44:15.033177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-20T04:44:16.130594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.30","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:44:55.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.667+0000 7f8ce9843640 1 -- 172.21.15.132:0/459858897 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cc406a460 msgr2=0x7f8cc406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.667+0000 7f8ce9843640 1 --2- 172.21.15.132:0/459858897 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cc406a460 0x7f8cc406c920 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f8cd40035f0 tx=0x7f8cd4009040 comp rx=0 tx=0).stop 2023-12-20T04:44:55.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.667+0000 7f8ce9843640 1 -- 172.21.15.132:0/459858897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ce41530d0 msgr2=0x7f8ce4153550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.667+0000 7f8ce9843640 1 --2- 172.21.15.132:0/459858897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ce41530d0 0x7f8ce4153550 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f8cdc002230 tx=0x7f8cdc009750 comp rx=0 tx=0).stop 2023-12-20T04:44:55.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.667+0000 7f8ce9843640 1 -- 172.21.15.132:0/459858897 shutdown_connections 2023-12-20T04:44:55.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.667+0000 7f8ce9843640 1 --2- 172.21.15.132:0/459858897 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cc406a460 0x7f8cc406c920 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.667+0000 7f8ce9843640 1 --2- 172.21.15.132:0/459858897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ce41530d0 0x7f8ce4153550 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.667+0000 7f8ce9843640 1 --2- 172.21.15.132:0/459858897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ce4150de0 0x7f8ce414b290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.667+0000 7f8ce9843640 1 --2- 172.21.15.132:0/459858897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd0004d00 0x7f8ce40cc250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.667+0000 7f8ce9843640 1 -- 172.21.15.132:0/459858897 >> 172.21.15.132:0/459858897 conn(0x7f8ce40cf980 msgr2=0x7f8ce414cc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:55.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.667+0000 7f8ce9843640 1 -- 172.21.15.132:0/459858897 shutdown_connections 2023-12-20T04:44:55.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.667+0000 7f8ce9843640 1 -- 172.21.15.132:0/459858897 wait complete. 2023-12-20T04:44:55.680 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:44:15.033177+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:44:16.130594+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:44:55.680 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:44:55.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.781+0000 7fd8f83fd640 1 Processor -- start 2023-12-20T04:44:55.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.781+0000 7fd8f83fd640 1 -- start start 2023-12-20T04:44:55.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.782+0000 7fd8f83fd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd8f0069c30 0x7fd8f0070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.782+0000 7fd8f83fd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd8f015d360 0x7fd8f006a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.782+0000 7fd8f83fd640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8f00c4f40 con 0x7fd8f00cbde0 2023-12-20T04:44:55.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.782+0000 7fd8f83fd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f00af5b0 con 0x7fd8f015d360 2023-12-20T04:44:55.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.782+0000 7fd8f83fd640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8f006a550 con 0x7fd8f0069c30 2023-12-20T04:44:55.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.782+0000 7fd8f5998640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd8f015d360 0x7fd8f006a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.782+0000 7fd8f5998640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd8f015d360 0x7fd8f006a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36570/0 (socket says 172.21.15.132:36570) 2023-12-20T04:44:55.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.782+0000 7fd8f5998640 1 -- 172.21.15.132:0/2893454630 learned_addr learned my addr 172.21.15.132:0/2893454630 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:55.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.782+0000 7fd8f5998640 1 -- 172.21.15.132:0/2893454630 >> v2:172.21.15.187:3300/0 conn(0x7fd8f0069c30 msgr2=0x7fd8f0070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:55.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.782+0000 7fd8f6199640 1 --2- 172.21.15.132:0/2893454630 >> v2:172.21.15.187:3300/0 conn(0x7fd8f0069c30 0x7fd8f0070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.782+0000 7fd8f5998640 1 --2- 172.21.15.132:0/2893454630 >> v2:172.21.15.187:3300/0 conn(0x7fd8f0069c30 0x7fd8f0070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.782+0000 7fd8f5998640 1 -- 172.21.15.132:0/2893454630 >> v1:172.21.15.187:6789/0 conn(0x7fd8f00cbde0 legacy=0x7fd8f00ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:55.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.782+0000 7fd8f5998640 1 -- 172.21.15.132:0/2893454630 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8f0070a40 con 0x7fd8f015d360 2023-12-20T04:44:55.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.783+0000 7fd8f5998640 1 --2- 172.21.15.132:0/2893454630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8f015d360 0x7fd8f006a010 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0071870 tx=0x7fd8e002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46fb088579ee167f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:55.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.783+0000 7fd8f5197640 1 -- 172.21.15.132:0/2893454630 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0031870 con 0x7fd8f015d360 2023-12-20T04:44:55.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.783+0000 7fd8f5197640 1 -- 172.21.15.132:0/2893454630 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8e00319d0 con 0x7fd8f015d360 2023-12-20T04:44:55.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.783+0000 7fd8f5197640 1 -- 172.21.15.132:0/2893454630 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8e0031d60 con 0x7fd8f015d360 2023-12-20T04:44:55.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.784+0000 7fd8f83fd640 1 -- 172.21.15.132:0/2893454630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8f015d360 msgr2=0x7fd8f006a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.784+0000 7fd8f83fd640 1 --2- 172.21.15.132:0/2893454630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8f015d360 0x7fd8f006a010 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd8f0071870 tx=0x7fd8e002b910 comp rx=0 tx=0).stop 2023-12-20T04:44:55.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.784+0000 7fd8f83fd640 1 -- 172.21.15.132:0/2893454630 shutdown_connections 2023-12-20T04:44:55.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.784+0000 7fd8f83fd640 1 --2- 172.21.15.132:0/2893454630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8f015d360 0x7fd8f006a010 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.784+0000 7fd8f83fd640 1 --2- 172.21.15.132:0/2893454630 >> v2:172.21.15.187:3300/0 conn(0x7fd8f0069c30 0x7fd8f0070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.784+0000 7fd8f83fd640 1 -- 172.21.15.132:0/2893454630 >> 172.21.15.132:0/2893454630 conn(0x7fd8f00cc630 msgr2=0x7fd8f00cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:55.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.784+0000 7fd8f83fd640 1 -- 172.21.15.132:0/2893454630 shutdown_connections 2023-12-20T04:44:55.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.784+0000 7fd8f83fd640 1 -- 172.21.15.132:0/2893454630 wait complete. 2023-12-20T04:44:55.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.785+0000 7fd8f83fd640 1 Processor -- start 2023-12-20T04:44:55.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.785+0000 7fd8f83fd640 1 -- start start 2023-12-20T04:44:55.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f83fd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8f0069c30 0x7fd8f01f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f83fd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f00cbde0 0x7fd8f006da90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f83fd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f015d360 0x7fd8f015e1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f83fd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f015a8d0 con 0x7fd8f0069c30 2023-12-20T04:44:55.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f83fd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f0159c50 con 0x7fd8f00cbde0 2023-12-20T04:44:55.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f83fd640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8f0159f30 con 0x7fd8f015d360 2023-12-20T04:44:55.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f6199640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8f0069c30 0x7fd8f01f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f6199640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8f0069c30 0x7fd8f01f2420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36576/0 (socket says 172.21.15.132:36576) 2023-12-20T04:44:55.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f6199640 1 -- 172.21.15.132:0/1387708477 learned_addr learned my addr 172.21.15.132:0/1387708477 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:55.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f5998640 1 --2- 172.21.15.132:0/1387708477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f00cbde0 0x7fd8f006da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f699a640 1 --2- 172.21.15.132:0/1387708477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f015d360 0x7fd8f015e1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f6199640 1 -- 172.21.15.132:0/1387708477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f015d360 msgr2=0x7fd8f015e1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f6199640 1 --2- 172.21.15.132:0/1387708477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f015d360 0x7fd8f015e1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f6199640 1 -- 172.21.15.132:0/1387708477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f00cbde0 msgr2=0x7fd8f006da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f6199640 1 --2- 172.21.15.132:0/1387708477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f00cbde0 0x7fd8f006da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f6199640 1 -- 172.21.15.132:0/1387708477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8e00094d0 con 0x7fd8f0069c30 2023-12-20T04:44:55.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f6199640 1 --2- 172.21.15.132:0/1387708477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8f0069c30 0x7fd8f01f2420 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00c7f0 tx=0x7fd8ec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:55.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8e6ffd640 1 -- 172.21.15.132:0/1387708477 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec004220 con 0x7fd8f0069c30 2023-12-20T04:44:55.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8e6ffd640 1 -- 172.21.15.132:0/1387708477 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8ec0043a0 con 0x7fd8f0069c30 2023-12-20T04:44:55.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f83fd640 1 -- 172.21.15.132:0/1387708477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8f015a210 con 0x7fd8f0069c30 2023-12-20T04:44:55.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8e6ffd640 1 -- 172.21.15.132:0/1387708477 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8ec007860 con 0x7fd8f0069c30 2023-12-20T04:44:55.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.786+0000 7fd8f83fd640 1 -- 172.21.15.132:0/1387708477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8f0159900 con 0x7fd8f0069c30 2023-12-20T04:44:55.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.787+0000 7fd8f83fd640 1 -- 172.21.15.132:0/1387708477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8f004e840 con 0x7fd8f0069c30 2023-12-20T04:44:55.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.788+0000 7fd8e6ffd640 1 -- 172.21.15.132:0/1387708477 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd8ec007bd0 con 0x7fd8f0069c30 2023-12-20T04:44:55.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.788+0000 7fd8e6ffd640 1 --2- 172.21.15.132:0/1387708477 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8d406a430 0x7fd8d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:55.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.788+0000 7fd8e6ffd640 1 -- 172.21.15.132:0/1387708477 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd8ec0889d0 con 0x7fd8f0069c30 2023-12-20T04:44:55.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.788+0000 7fd8f5998640 1 --2- 172.21.15.132:0/1387708477 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8d406a430 0x7fd8d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:55.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.788+0000 7fd8f5998640 1 --2- 172.21.15.132:0/1387708477 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8d406a430 0x7fd8d406c8f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0036000 tx=0x7fd8e003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:55.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.792+0000 7fd8e6ffd640 1 -- 172.21.15.132:0/1387708477 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd8ec053ef0 con 0x7fd8f0069c30 2023-12-20T04:44:55.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.955+0000 7fd8f83fd640 1 -- 172.21.15.132:0/1387708477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fd8f006a9a0 con 0x7fd8f0069c30 2023-12-20T04:44:55.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.956+0000 7fd8e6ffd640 1 -- 172.21.15.132:0/1387708477 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v53) v1 ==== 93+0+10 (secure 0 0 0) 0x7fd8ec01e070 con 0x7fd8f0069c30 2023-12-20T04:44:55.958 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:44:55.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.957+0000 7fd8f83fd640 1 -- 172.21.15.132:0/1387708477 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8d406a430 msgr2=0x7fd8d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.957+0000 7fd8f83fd640 1 --2- 172.21.15.132:0/1387708477 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8d406a430 0x7fd8d406c8f0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fd8e0036000 tx=0x7fd8e003c040 comp rx=0 tx=0).stop 2023-12-20T04:44:55.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.957+0000 7fd8f83fd640 1 -- 172.21.15.132:0/1387708477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8f0069c30 msgr2=0x7fd8f01f2420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.957+0000 7fd8f83fd640 1 --2- 172.21.15.132:0/1387708477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8f0069c30 0x7fd8f01f2420 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd8ec00c7f0 tx=0x7fd8ec00ccb0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.958+0000 7fd8f83fd640 1 -- 172.21.15.132:0/1387708477 shutdown_connections 2023-12-20T04:44:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.958+0000 7fd8f83fd640 1 --2- 172.21.15.132:0/1387708477 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8d406a430 0x7fd8d406c8f0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.958+0000 7fd8f83fd640 1 --2- 172.21.15.132:0/1387708477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8f015d360 0x7fd8f015e1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.958+0000 7fd8f83fd640 1 --2- 172.21.15.132:0/1387708477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8f00cbde0 0x7fd8f006da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.958+0000 7fd8f83fd640 1 --2- 172.21.15.132:0/1387708477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8f0069c30 0x7fd8f01f2420 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.958+0000 7fd8f83fd640 1 -- 172.21.15.132:0/1387708477 >> 172.21.15.132:0/1387708477 conn(0x7fd8f00cc630 msgr2=0x7fd8f00c5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.958+0000 7fd8f83fd640 1 -- 172.21.15.132:0/1387708477 shutdown_connections 2023-12-20T04:44:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:55.958+0000 7fd8f83fd640 1 -- 172.21.15.132:0/1387708477 wait complete. 2023-12-20T04:44:55.970 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:44:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.070+0000 7f62880ce640 1 Processor -- start 2023-12-20T04:44:56.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.070+0000 7f62880ce640 1 -- start start 2023-12-20T04:44:56.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.071+0000 7f62880ce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f628015cf20 0x7f628006c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.071+0000 7f62880ce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f62800cd4b0 0x7f62800cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.071+0000 7f62880ce640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f628006cc90 con 0x7f628015d300 2023-12-20T04:44:56.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.071+0000 7f62880ce640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62800cde80 con 0x7f62800cd4b0 2023-12-20T04:44:56.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.071+0000 7f62880ce640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62800b2f30 con 0x7f628015cf20 2023-12-20T04:44:56.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.071+0000 7f628666b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f62800cd4b0 0x7f62800cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.071+0000 7f628666b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f62800cd4b0 0x7f62800cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36586/0 (socket says 172.21.15.132:36586) 2023-12-20T04:44:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.071+0000 7f628666b640 1 -- 172.21.15.132:0/3868871964 learned_addr learned my addr 172.21.15.132:0/3868871964 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.071+0000 7f6285e6a640 1 --2- 172.21.15.132:0/3868871964 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f628015cf20 0x7f628006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.071+0000 7f628666b640 1 -- 172.21.15.132:0/3868871964 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f628015cf20 msgr2=0x7f628006c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.071+0000 7f628666b640 1 --2- 172.21.15.132:0/3868871964 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f628015cf20 0x7f628006c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.072+0000 7f628666b640 1 -- 172.21.15.132:0/3868871964 >> v1:172.21.15.187:6789/0 conn(0x7f628015d300 legacy=0x7f6280161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.072+0000 7f628666b640 1 -- 172.21.15.132:0/3868871964 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62800b3210 con 0x7f62800cd4b0 2023-12-20T04:44:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.072+0000 7f628666b640 1 --2- 172.21.15.132:0/3868871964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62800cd4b0 0x7f62800cd940 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6278009e50 tx=0x7f627802bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cee40c92807f134 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.072+0000 7f6284e68640 1 -- 172.21.15.132:0/3868871964 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627802cb00 con 0x7f62800cd4b0 2023-12-20T04:44:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.072+0000 7f6284e68640 1 -- 172.21.15.132:0/3868871964 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627802cc60 con 0x7f62800cd4b0 2023-12-20T04:44:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.072+0000 7f6284e68640 1 -- 172.21.15.132:0/3868871964 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62780343f0 con 0x7f62800cd4b0 2023-12-20T04:44:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.073+0000 7f62880ce640 1 -- 172.21.15.132:0/3868871964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62800cd4b0 msgr2=0x7f62800cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.073+0000 7f62880ce640 1 --2- 172.21.15.132:0/3868871964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62800cd4b0 0x7f62800cd940 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f6278009e50 tx=0x7f627802bf60 comp rx=0 tx=0).stop 2023-12-20T04:44:56.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.073+0000 7f62880ce640 1 -- 172.21.15.132:0/3868871964 shutdown_connections 2023-12-20T04:44:56.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.073+0000 7f62880ce640 1 --2- 172.21.15.132:0/3868871964 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62800cd4b0 0x7f62800cd940 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.073+0000 7f62880ce640 1 --2- 172.21.15.132:0/3868871964 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f628015cf20 0x7f628006c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.073+0000 7f62880ce640 1 -- 172.21.15.132:0/3868871964 >> 172.21.15.132:0/3868871964 conn(0x7f6280072c60 msgr2=0x7f6280073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:56.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.073+0000 7f62880ce640 1 -- 172.21.15.132:0/3868871964 shutdown_connections 2023-12-20T04:44:56.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.073+0000 7f62880ce640 1 -- 172.21.15.132:0/3868871964 wait complete. 2023-12-20T04:44:56.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.074+0000 7f62880ce640 1 Processor -- start 2023-12-20T04:44:56.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.074+0000 7f62880ce640 1 -- start start 2023-12-20T04:44:56.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f62880ce640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62800cd4b0 0x7f62800c53c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f62880ce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f628015cf20 0x7f62800aea30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f62880ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f628015d300 0x7f62800ad2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f62880ce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62800add70 con 0x7f628015d300 2023-12-20T04:44:56.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f62880ce640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62800ae050 con 0x7f62800cd4b0 2023-12-20T04:44:56.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f62880ce640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62800b4820 con 0x7f628015cf20 2023-12-20T04:44:56.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f628666b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f628015d300 0x7f62800ad2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f628666b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f628015d300 0x7f62800ad2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36600/0 (socket says 172.21.15.132:36600) 2023-12-20T04:44:56.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f628666b640 1 -- 172.21.15.132:0/1192865242 learned_addr learned my addr 172.21.15.132:0/1192865242 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:56.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f6285e6a640 1 --2- 172.21.15.132:0/1192865242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62800cd4b0 0x7f62800c53c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f6285669640 1 --2- 172.21.15.132:0/1192865242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f628015cf20 0x7f62800aea30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f628666b640 1 -- 172.21.15.132:0/1192865242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f628015cf20 msgr2=0x7f62800aea30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f628666b640 1 --2- 172.21.15.132:0/1192865242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f628015cf20 0x7f62800aea30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f628666b640 1 -- 172.21.15.132:0/1192865242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62800cd4b0 msgr2=0x7f62800c53c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f628666b640 1 --2- 172.21.15.132:0/1192865242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62800cd4b0 0x7f62800c53c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f628666b640 1 -- 172.21.15.132:0/1192865242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6278009b30 con 0x7f628015d300 2023-12-20T04:44:56.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f6285e6a640 1 --2- 172.21.15.132:0/1192865242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62800cd4b0 0x7f62800c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:56.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.075+0000 7f6285669640 1 --2- 172.21.15.132:0/1192865242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f628015cf20 0x7f62800aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:56.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.076+0000 7f628666b640 1 --2- 172.21.15.132:0/1192865242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f628015d300 0x7f62800ad2b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6278009e50 tx=0x7f6278004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:56.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.076+0000 7f62767fc640 1 -- 172.21.15.132:0/1192865242 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6278009510 con 0x7f628015d300 2023-12-20T04:44:56.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.076+0000 7f62767fc640 1 -- 172.21.15.132:0/1192865242 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f627803e450 con 0x7f628015d300 2023-12-20T04:44:56.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.076+0000 7f62880ce640 1 -- 172.21.15.132:0/1192865242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62800b4b00 con 0x7f628015d300 2023-12-20T04:44:56.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.076+0000 7f62767fc640 1 -- 172.21.15.132:0/1192865242 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f627803e800 con 0x7f628015d300 2023-12-20T04:44:56.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.076+0000 7f62880ce640 1 -- 172.21.15.132:0/1192865242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f628015b4e0 con 0x7f628015d300 2023-12-20T04:44:56.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.077+0000 7f62880ce640 1 -- 172.21.15.132:0/1192865242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f628004e840 con 0x7f628015d300 2023-12-20T04:44:56.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.077+0000 7f62767fc640 1 -- 172.21.15.132:0/1192865242 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f627803e960 con 0x7f628015d300 2023-12-20T04:44:56.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.077+0000 7f62767fc640 1 --2- 172.21.15.132:0/1192865242 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f626406a430 0x7f626406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.078+0000 7f62767fc640 1 -- 172.21.15.132:0/1192865242 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f62780ab670 con 0x7f628015d300 2023-12-20T04:44:56.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.078+0000 7f6285e6a640 1 --2- 172.21.15.132:0/1192865242 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f626406a430 0x7f626406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.078+0000 7f6285e6a640 1 --2- 172.21.15.132:0/1192865242 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f626406a430 0x7f626406c8f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f627c006fd0 tx=0x7f627c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:56.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.082+0000 7f62767fc640 1 -- 172.21.15.132:0/1192865242 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6278076cb0 con 0x7f628015d300 2023-12-20T04:44:56.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.246+0000 7f62880ce640 1 -- 172.21.15.132:0/1192865242 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f62800b2890 con 0x7f628015d300 2023-12-20T04:44:56.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.247+0000 7f62767fc640 1 -- 172.21.15.132:0/1192865242 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v53) v1 ==== 104+0+11 (secure 0 0 0) 0x7f627807a2d0 con 0x7f628015d300 2023-12-20T04:44:56.249 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:44:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.249+0000 7f62880ce640 1 -- 172.21.15.132:0/1192865242 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f626406a430 msgr2=0x7f626406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.249+0000 7f62880ce640 1 --2- 172.21.15.132:0/1192865242 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f626406a430 0x7f626406c8f0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f627c006fd0 tx=0x7f627c008040 comp rx=0 tx=0).stop 2023-12-20T04:44:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.249+0000 7f62880ce640 1 -- 172.21.15.132:0/1192865242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f628015d300 msgr2=0x7f62800ad2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.249+0000 7f62880ce640 1 --2- 172.21.15.132:0/1192865242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f628015d300 0x7f62800ad2b0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f6278009e50 tx=0x7f6278004a40 comp rx=0 tx=0).stop 2023-12-20T04:44:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.249+0000 7f62880ce640 1 -- 172.21.15.132:0/1192865242 shutdown_connections 2023-12-20T04:44:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.249+0000 7f62880ce640 1 --2- 172.21.15.132:0/1192865242 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f626406a430 0x7f626406c8f0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.249+0000 7f62880ce640 1 --2- 172.21.15.132:0/1192865242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f628015d300 0x7f62800ad2b0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.249+0000 7f62880ce640 1 --2- 172.21.15.132:0/1192865242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f628015cf20 0x7f62800aea30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.249+0000 7f62880ce640 1 --2- 172.21.15.132:0/1192865242 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62800cd4b0 0x7f62800c53c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.249+0000 7f62880ce640 1 -- 172.21.15.132:0/1192865242 >> 172.21.15.132:0/1192865242 conn(0x7f6280072c60 msgr2=0x7f6280160eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.249+0000 7f62880ce640 1 -- 172.21.15.132:0/1192865242 shutdown_connections 2023-12-20T04:44:56.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.249+0000 7f62880ce640 1 -- 172.21.15.132:0/1192865242 wait complete. 2023-12-20T04:44:56.262 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:44:56.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.362+0000 7f97ead2e640 1 Processor -- start 2023-12-20T04:44:56.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.362+0000 7f97ead2e640 1 -- start start 2023-12-20T04:44:56.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.363+0000 7f97ead2e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97e415d300 0x7f97e40d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.363+0000 7f97ead2e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f97e40d1550 0x7f97e40cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.363+0000 7f97ead2e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f97e40cfdc0 0x7f97e40b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.363+0000 7f97ead2e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e40d0230 con 0x7f97e40cfdc0 2023-12-20T04:44:56.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.363+0000 7f97ead2e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f97e40d1a90 con 0x7f97e40d1550 2023-12-20T04:44:56.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.363+0000 7f97ead2e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e40d1d70 con 0x7f97e415d300 2023-12-20T04:44:56.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.363+0000 7f97e92cb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f97e40cfdc0 0x7f97e40b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.363+0000 7f97e92cb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f97e40cfdc0 0x7f97e40b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36606/0 (socket says 172.21.15.132:36606) 2023-12-20T04:44:56.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.363+0000 7f97e92cb640 1 -- 172.21.15.132:0/2697767865 learned_addr learned my addr 172.21.15.132:0/2697767865 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:56.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.363+0000 7f97e3fff640 1 --2- 172.21.15.132:0/2697767865 >> v2:172.21.15.187:3300/0 conn(0x7f97e40d1550 0x7f97e40cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.363+0000 7f97e8aca640 1 --2- 172.21.15.132:0/2697767865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97e415d300 0x7f97e40d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.363+0000 7f97e92cb640 1 -- 172.21.15.132:0/2697767865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97e415d300 msgr2=0x7f97e40d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:56.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.363+0000 7f97e92cb640 1 --2- 172.21.15.132:0/2697767865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97e415d300 0x7f97e40d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.363+0000 7f97e92cb640 1 -- 172.21.15.132:0/2697767865 >> v2:172.21.15.187:3300/0 conn(0x7f97e40d1550 msgr2=0x7f97e40cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:56.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.363+0000 7f97e92cb640 1 --2- 172.21.15.132:0/2697767865 >> v2:172.21.15.187:3300/0 conn(0x7f97e40d1550 0x7f97e40cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.363+0000 7f97e92cb640 1 -- 172.21.15.132:0/2697767865 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97e40d2050 con 0x7f97e40cfdc0 2023-12-20T04:44:56.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.363+0000 7f97e3fff640 1 --2- 172.21.15.132:0/2697767865 >> v2:172.21.15.187:3300/0 conn(0x7f97e40d1550 0x7f97e40cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:56.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.364+0000 7f97e92cb640 1 --2- 172.21.15.132:0/2697767865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e40cfdc0 0x7f97e40b48f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f97e40b59f0 tx=0x7f97dc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54b770b25bb5143 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:56.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.364+0000 7f97e37fe640 1 -- 172.21.15.132:0/2697767865 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc02ca70 con 0x7f97e40cfdc0 2023-12-20T04:44:56.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.364+0000 7f97e37fe640 1 -- 172.21.15.132:0/2697767865 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc02cbd0 con 0x7f97e40cfdc0 2023-12-20T04:44:56.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.364+0000 7f97e37fe640 1 -- 172.21.15.132:0/2697767865 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc0343f0 con 0x7f97e40cfdc0 2023-12-20T04:44:56.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.365+0000 7f97ead2e640 1 -- 172.21.15.132:0/2697767865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e40cfdc0 msgr2=0x7f97e40b48f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.365+0000 7f97ead2e640 1 --2- 172.21.15.132:0/2697767865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e40cfdc0 0x7f97e40b48f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f97e40b59f0 tx=0x7f97dc02bed0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.365+0000 7f97ead2e640 1 -- 172.21.15.132:0/2697767865 shutdown_connections 2023-12-20T04:44:56.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.365+0000 7f97ead2e640 1 --2- 172.21.15.132:0/2697767865 >> v2:172.21.15.187:3300/0 conn(0x7f97e40d1550 0x7f97e40cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.365+0000 7f97ead2e640 1 --2- 172.21.15.132:0/2697767865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e40cfdc0 0x7f97e40b48f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.365+0000 7f97ead2e640 1 --2- 172.21.15.132:0/2697767865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97e415d300 0x7f97e40d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.365+0000 7f97ead2e640 1 -- 172.21.15.132:0/2697767865 >> 172.21.15.132:0/2697767865 conn(0x7f97e406a3d0 msgr2=0x7f97e406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:56.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.365+0000 7f97ead2e640 1 -- 172.21.15.132:0/2697767865 shutdown_connections 2023-12-20T04:44:56.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.365+0000 7f97ead2e640 1 -- 172.21.15.132:0/2697767865 wait complete. 2023-12-20T04:44:56.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.366+0000 7f97ead2e640 1 Processor -- start 2023-12-20T04:44:56.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.366+0000 7f97ead2e640 1 -- start start 2023-12-20T04:44:56.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97ead2e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97e40cfdc0 0x7f97e414ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97ead2e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97e40d1550 0x7f97e40cc240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97ead2e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e415d300 0x7f97e40c7c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97ead2e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e40b39a0 con 0x7f97e415d300 2023-12-20T04:44:56.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97ead2e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97e40b2d90 con 0x7f97e40d1550 2023-12-20T04:44:56.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97ead2e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97e40b3070 con 0x7f97e40cfdc0 2023-12-20T04:44:56.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97e92cb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e415d300 0x7f97e40c7c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97e92cb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e415d300 0x7f97e40c7c40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36612/0 (socket says 172.21.15.132:36612) 2023-12-20T04:44:56.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97e92cb640 1 -- 172.21.15.132:0/1232475091 learned_addr learned my addr 172.21.15.132:0/1232475091 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:56.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97e8aca640 1 --2- 172.21.15.132:0/1232475091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97e40cfdc0 0x7f97e414ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97e3fff640 1 --2- 172.21.15.132:0/1232475091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97e40d1550 0x7f97e40cc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97e92cb640 1 -- 172.21.15.132:0/1232475091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97e40cfdc0 msgr2=0x7f97e414ca10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97e92cb640 1 --2- 172.21.15.132:0/1232475091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97e40cfdc0 0x7f97e414ca10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97e92cb640 1 -- 172.21.15.132:0/1232475091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97e40d1550 msgr2=0x7f97e40cc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97e92cb640 1 --2- 172.21.15.132:0/1232475091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97e40d1550 0x7f97e40cc240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97e92cb640 1 -- 172.21.15.132:0/1232475091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97dc009b30 con 0x7f97e415d300 2023-12-20T04:44:56.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97e3fff640 1 --2- 172.21.15.132:0/1232475091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97e40d1550 0x7f97e40cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:56.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97e92cb640 1 --2- 172.21.15.132:0/1232475091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e415d300 0x7f97e40c7c40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f97dc036040 tx=0x7f97dc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:56.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97e17fa640 1 -- 172.21.15.132:0/1232475091 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc009510 con 0x7f97e415d300 2023-12-20T04:44:56.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97e17fa640 1 -- 172.21.15.132:0/1232475091 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97dc03e450 con 0x7f97e415d300 2023-12-20T04:44:56.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97e17fa640 1 -- 172.21.15.132:0/1232475091 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97dc03e800 con 0x7f97e415d300 2023-12-20T04:44:56.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.367+0000 7f97ead2e640 1 -- 172.21.15.132:0/1232475091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f97e40b3350 con 0x7f97e415d300 2023-12-20T04:44:56.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.368+0000 7f97ead2e640 1 -- 172.21.15.132:0/1232475091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f97e414cf50 con 0x7f97e415d300 2023-12-20T04:44:56.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.369+0000 7f97ead2e640 1 -- 172.21.15.132:0/1232475091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f97e40b3b10 con 0x7f97e415d300 2023-12-20T04:44:56.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.369+0000 7f97e17fa640 1 -- 172.21.15.132:0/1232475091 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f97dc03e960 con 0x7f97e415d300 2023-12-20T04:44:56.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.369+0000 7f97e17fa640 1 --2- 172.21.15.132:0/1232475091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f97c806a430 0x7f97c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.369+0000 7f97e8aca640 1 --2- 172.21.15.132:0/1232475091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f97c806a430 0x7f97c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.369+0000 7f97e17fa640 1 -- 172.21.15.132:0/1232475091 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f97dc0ab5a0 con 0x7f97e415d300 2023-12-20T04:44:56.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.370+0000 7f97e8aca640 1 --2- 172.21.15.132:0/1232475091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f97c806a430 0x7f97c806c8f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f97d8006fd0 tx=0x7f97d8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:56.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.374+0000 7f97e17fa640 1 -- 172.21.15.132:0/1232475091 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f97dc076be0 con 0x7f97e415d300 2023-12-20T04:44:56.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.540+0000 7f97ead2e640 1 -- 172.21.15.132:0/1232475091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f97e404e840 con 0x7f97e415d300 2023-12-20T04:44:56.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.540+0000 7f97e17fa640 1 -- 172.21.15.132:0/1232475091 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v53) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97dc07a200 con 0x7f97e415d300 2023-12-20T04:44:56.543 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:44:56.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.542+0000 7f97ead2e640 1 -- 172.21.15.132:0/1232475091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f97c806a430 msgr2=0x7f97c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.542+0000 7f97ead2e640 1 --2- 172.21.15.132:0/1232475091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f97c806a430 0x7f97c806c8f0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f97d8006fd0 tx=0x7f97d8008040 comp rx=0 tx=0).stop 2023-12-20T04:44:56.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.542+0000 7f97ead2e640 1 -- 172.21.15.132:0/1232475091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e415d300 msgr2=0x7f97e40c7c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.542+0000 7f97ead2e640 1 --2- 172.21.15.132:0/1232475091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e415d300 0x7f97e40c7c40 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7f97dc036040 tx=0x7f97dc004a40 comp rx=0 tx=0).stop 2023-12-20T04:44:56.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.542+0000 7f97ead2e640 1 -- 172.21.15.132:0/1232475091 shutdown_connections 2023-12-20T04:44:56.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.542+0000 7f97ead2e640 1 --2- 172.21.15.132:0/1232475091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f97c806a430 0x7f97c806c8f0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.542+0000 7f97ead2e640 1 --2- 172.21.15.132:0/1232475091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97e415d300 0x7f97e40c7c40 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.542+0000 7f97ead2e640 1 --2- 172.21.15.132:0/1232475091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f97e40d1550 0x7f97e40cc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.542+0000 7f97ead2e640 1 --2- 172.21.15.132:0/1232475091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97e40cfdc0 0x7f97e414ca10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.542+0000 7f97ead2e640 1 -- 172.21.15.132:0/1232475091 >> 172.21.15.132:0/1232475091 conn(0x7f97e406a3d0 msgr2=0x7f97e415bac0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:56.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.542+0000 7f97ead2e640 1 -- 172.21.15.132:0/1232475091 shutdown_connections 2023-12-20T04:44:56.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.542+0000 7f97ead2e640 1 -- 172.21.15.132:0/1232475091 wait complete. 2023-12-20T04:44:56.555 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:44:56.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.652+0000 7f285d116640 1 Processor -- start 2023-12-20T04:44:56.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.652+0000 7f285d116640 1 -- start start 2023-12-20T04:44:56.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.653+0000 7f285d116640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f285813e690 0x7f2858069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.653+0000 7f285d116640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f285806a170 0x7f28580708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.653+0000 7f285d116640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2858141660 con 0x7f285813df60 2023-12-20T04:44:56.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.653+0000 7f285d116640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2858155a30 con 0x7f285806a170 2023-12-20T04:44:56.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.653+0000 7f285d116640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f285806a600 con 0x7f285813e690 2023-12-20T04:44:56.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.653+0000 7f285759e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f285806a170 0x7f28580708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.653+0000 7f285759e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f285806a170 0x7f28580708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36620/0 (socket says 172.21.15.132:36620) 2023-12-20T04:44:56.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.653+0000 7f285759e640 1 -- 172.21.15.132:0/4181078554 learned_addr learned my addr 172.21.15.132:0/4181078554 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:56.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.653+0000 7f285659c640 1 --2- 172.21.15.132:0/4181078554 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f285813e690 0x7f2858069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.653+0000 7f285759e640 1 -- 172.21.15.132:0/4181078554 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f285813e690 msgr2=0x7f2858069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:56.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.653+0000 7f285759e640 1 --2- 172.21.15.132:0/4181078554 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f285813e690 0x7f2858069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.653+0000 7f285759e640 1 -- 172.21.15.132:0/4181078554 >> v1:172.21.15.187:6789/0 conn(0x7f285813df60 legacy=0x7f28580caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:56.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.653+0000 7f285759e640 1 -- 172.21.15.132:0/4181078554 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2858140ae0 con 0x7f285806a170 2023-12-20T04:44:56.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.653+0000 7f285659c640 1 --2- 172.21.15.132:0/4181078554 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f285813e690 0x7f2858069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:56.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.654+0000 7f285759e640 1 --2- 172.21.15.132:0/4181078554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f285806a170 0x7f28580708d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2850009e50 tx=0x7f285002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2daf1dd050e101ee server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:56.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.654+0000 7f2855d9b640 1 -- 172.21.15.132:0/4181078554 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f285002c9e0 con 0x7f285806a170 2023-12-20T04:44:56.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.654+0000 7f2855d9b640 1 -- 172.21.15.132:0/4181078554 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f285002cb40 con 0x7f285806a170 2023-12-20T04:44:56.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.654+0000 7f2855d9b640 1 -- 172.21.15.132:0/4181078554 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f28500343f0 con 0x7f285806a170 2023-12-20T04:44:56.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.655+0000 7f285d116640 1 -- 172.21.15.132:0/4181078554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f285806a170 msgr2=0x7f28580708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.655+0000 7f285d116640 1 --2- 172.21.15.132:0/4181078554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f285806a170 0x7f28580708d0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f2850009e50 tx=0x7f285002be40 comp rx=0 tx=0).stop 2023-12-20T04:44:56.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.655+0000 7f285d116640 1 -- 172.21.15.132:0/4181078554 shutdown_connections 2023-12-20T04:44:56.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.655+0000 7f285d116640 1 --2- 172.21.15.132:0/4181078554 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f285806a170 0x7f28580708d0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.655+0000 7f285d116640 1 --2- 172.21.15.132:0/4181078554 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f285813e690 0x7f2858069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.655+0000 7f285d116640 1 -- 172.21.15.132:0/4181078554 >> 172.21.15.132:0/4181078554 conn(0x7f28580cfbd0 msgr2=0x7f28580cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:56.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.655+0000 7f285d116640 1 -- 172.21.15.132:0/4181078554 shutdown_connections 2023-12-20T04:44:56.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.655+0000 7f285d116640 1 -- 172.21.15.132:0/4181078554 wait complete. 2023-12-20T04:44:56.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.656+0000 7f285d116640 1 Processor -- start 2023-12-20T04:44:56.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.656+0000 7f285d116640 1 -- start start 2023-12-20T04:44:56.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.657+0000 7f285d116640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f285806a170 0x7f2858142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.657+0000 7f285d116640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f285813df60 0x7f28580b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.657+0000 7f285d116640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f285813e690 0x7f2858143b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.657+0000 7f285d116640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2858141bf0 con 0x7f285806a170 2023-12-20T04:44:56.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.657+0000 7f285d116640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2858141ed0 con 0x7f285813e690 2023-12-20T04:44:56.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.657+0000 7f285d116640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28581421b0 con 0x7f285813df60 2023-12-20T04:44:56.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.657+0000 7f2856d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f285806a170 0x7f2858142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.657+0000 7f2856d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f285806a170 0x7f2858142c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36634/0 (socket says 172.21.15.132:36634) 2023-12-20T04:44:56.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.657+0000 7f2856d9d640 1 -- 172.21.15.132:0/4055472458 learned_addr learned my addr 172.21.15.132:0/4055472458 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:56.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.657+0000 7f2856d9d640 1 -- 172.21.15.132:0/4055472458 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f285813df60 msgr2=0x7f28580b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.657+0000 7f2856d9d640 1 --2- 172.21.15.132:0/4055472458 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f285813df60 0x7f28580b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.657+0000 7f2856d9d640 1 -- 172.21.15.132:0/4055472458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f285813e690 msgr2=0x7f2858143b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.657+0000 7f2856d9d640 1 --2- 172.21.15.132:0/4055472458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f285813e690 0x7f2858143b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.657+0000 7f2856d9d640 1 -- 172.21.15.132:0/4055472458 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2850009b30 con 0x7f285806a170 2023-12-20T04:44:56.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.657+0000 7f2856d9d640 1 --2- 172.21.15.132:0/4055472458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f285806a170 0x7f2858142c90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2848004640 tx=0x7f284800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:56.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.658+0000 7f283f7fe640 1 -- 172.21.15.132:0/4055472458 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848011790 con 0x7f285806a170 2023-12-20T04:44:56.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.658+0000 7f283f7fe640 1 -- 172.21.15.132:0/4055472458 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f28480118f0 con 0x7f285806a170 2023-12-20T04:44:56.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.658+0000 7f285d116640 1 -- 172.21.15.132:0/4055472458 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2858142490 con 0x7f285806a170 2023-12-20T04:44:56.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.658+0000 7f283f7fe640 1 -- 172.21.15.132:0/4055472458 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2848011ce0 con 0x7f285806a170 2023-12-20T04:44:56.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.658+0000 7f285d116640 1 -- 172.21.15.132:0/4055472458 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28581431d0 con 0x7f285806a170 2023-12-20T04:44:56.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.659+0000 7f285d116640 1 -- 172.21.15.132:0/4055472458 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f28581429b0 con 0x7f285806a170 2023-12-20T04:44:56.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.659+0000 7f283f7fe640 1 -- 172.21.15.132:0/4055472458 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2848012420 con 0x7f285806a170 2023-12-20T04:44:56.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.659+0000 7f283f7fe640 1 --2- 172.21.15.132:0/4055472458 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f284406a430 0x7f284406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.659+0000 7f283f7fe640 1 -- 172.21.15.132:0/4055472458 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f28480885a0 con 0x7f285806a170 2023-12-20T04:44:56.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.659+0000 7f285659c640 1 --2- 172.21.15.132:0/4055472458 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f284406a430 0x7f284406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.660+0000 7f285659c640 1 --2- 172.21.15.132:0/4055472458 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f284406a430 0x7f284406c8f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f284c006fd0 tx=0x7f284c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:56.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.664+0000 7f283f7fe640 1 -- 172.21.15.132:0/4055472458 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f28581429b0 con 0x7f285806a170 2023-12-20T04:44:56.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.865+0000 7f285d116640 1 -- 172.21.15.132:0/4055472458 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f28581429b0 con 0x7f285806a170 2023-12-20T04:44:56.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.866+0000 7f283f7fe640 1 -- 172.21.15.132:0/4055472458 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4721 (secure 0 0 0) 0x7f2848053b50 con 0x7f285806a170 2023-12-20T04:44:56.868 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:56.868 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1456944733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1456944733},{"type":"v1","addr":"172.21.15.187:6834","nonce":1456944733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2114954856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2114954856},{"type":"v1","addr":"172.21.15.187:6835","nonce":2114954856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2494230497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2494230497},{"type":"v1","addr":"172.21.15.132:6837","nonce":2494230497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:44:17.197194+0000","modified":"2023-12-20T04:44:19.205156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/1024674556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1024674556},{"type":"v1","addr":"172.21.15.132:6836","nonce":1024674556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-20T04:44:56.870 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 19 2023-12-20T04:44:56.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.868+0000 7f285d116640 1 -- 172.21.15.132:0/4055472458 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f284406a430 msgr2=0x7f284406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.868+0000 7f285d116640 1 --2- 172.21.15.132:0/4055472458 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f284406a430 0x7f284406c8f0 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f284c006fd0 tx=0x7f284c008040 comp rx=0 tx=0).stop 2023-12-20T04:44:56.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.868+0000 7f285d116640 1 -- 172.21.15.132:0/4055472458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f285806a170 msgr2=0x7f2858142c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.868+0000 7f285d116640 1 --2- 172.21.15.132:0/4055472458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f285806a170 0x7f2858142c90 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f2848004640 tx=0x7f284800c8e0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.868+0000 7f285d116640 1 -- 172.21.15.132:0/4055472458 shutdown_connections 2023-12-20T04:44:56.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.868+0000 7f285d116640 1 --2- 172.21.15.132:0/4055472458 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f284406a430 0x7f284406c8f0 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.868+0000 7f285d116640 1 --2- 172.21.15.132:0/4055472458 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f285813e690 0x7f2858143b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.868+0000 7f285d116640 1 --2- 172.21.15.132:0/4055472458 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f285813df60 0x7f28580b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.868+0000 7f285d116640 1 --2- 172.21.15.132:0/4055472458 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f285806a170 0x7f2858142c90 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.868+0000 7f285d116640 1 -- 172.21.15.132:0/4055472458 >> 172.21.15.132:0/4055472458 conn(0x7f28580cfbd0 msgr2=0x7f2858159530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:56.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.868+0000 7f285d116640 1 -- 172.21.15.132:0/4055472458 shutdown_connections 2023-12-20T04:44:56.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.868+0000 7f285d116640 1 -- 172.21.15.132:0/4055472458 wait complete. 2023-12-20T04:44:56.881 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:44:56.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.979+0000 7fc773070640 1 Processor -- start 2023-12-20T04:44:56.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.979+0000 7fc773070640 1 -- start start 2023-12-20T04:44:56.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.979+0000 7fc773070640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc76c160ba0 0x7fc76c0cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.979+0000 7fc773070640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc76c0d0010 0x7fc76c0cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.979+0000 7fc773070640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc76c161ff0 con 0x7fc76c0ce2a0 2023-12-20T04:44:56.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.979+0000 7fc773070640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76c0cca40 con 0x7fc76c0d0010 2023-12-20T04:44:56.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.979+0000 7fc773070640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc76c1613e0 con 0x7fc76c160ba0 2023-12-20T04:44:56.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.980+0000 7fc77160d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc76c0d0010 0x7fc76c0cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.980+0000 7fc76bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc76c0ce2a0 0x7fc76c06f0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40326/0 (socket says 172.21.15.132:40326) 2023-12-20T04:44:56.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.980+0000 7fc77160d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc76c0d0010 0x7fc76c0cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36646/0 (socket says 172.21.15.132:36646) 2023-12-20T04:44:56.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.980+0000 7fc76bfff640 1 -- 172.21.15.132:0/2679285538 learned_addr learned my addr 172.21.15.132:0/2679285538 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:56.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.980+0000 7fc770e0c640 1 --2- 172.21.15.132:0/2679285538 >> v2:172.21.15.187:3300/0 conn(0x7fc76c160ba0 0x7fc76c0cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.980+0000 7fc77160d640 1 -- 172.21.15.132:0/2679285538 >> v2:172.21.15.187:3300/0 conn(0x7fc76c160ba0 msgr2=0x7fc76c0cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:56.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.980+0000 7fc77160d640 1 --2- 172.21.15.132:0/2679285538 >> v2:172.21.15.187:3300/0 conn(0x7fc76c160ba0 0x7fc76c0cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.980+0000 7fc77160d640 1 -- 172.21.15.132:0/2679285538 >> v1:172.21.15.132:6789/0 conn(0x7fc76c0ce2a0 legacy=0x7fc76c06f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.980+0000 7fc77160d640 1 -- 172.21.15.132:0/2679285538 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc76c1616c0 con 0x7fc76c0d0010 2023-12-20T04:44:56.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.980+0000 7fc76b7fe640 1 -- 172.21.15.132:0/2679285538 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3193981111 0 0) 0x7fc76c161ff0 con 0x7fc76c0ce2a0 2023-12-20T04:44:56.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.981+0000 7fc77160d640 1 --2- 172.21.15.132:0/2679285538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc76c0d0010 0x7fc76c0cb8c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0cc6f0 tx=0x7fc76402be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ffe206bca0e0c48 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:56.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.981+0000 7fc76b7fe640 1 -- 172.21.15.132:0/2679285538 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76402cbf0 con 0x7fc76c0d0010 2023-12-20T04:44:56.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.981+0000 7fc76b7fe640 1 -- 172.21.15.132:0/2679285538 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76402cd50 con 0x7fc76c0d0010 2023-12-20T04:44:56.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.981+0000 7fc76b7fe640 1 -- 172.21.15.132:0/2679285538 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc764034660 con 0x7fc76c0d0010 2023-12-20T04:44:56.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.981+0000 7fc773070640 1 -- 172.21.15.132:0/2679285538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc76c0d0010 msgr2=0x7fc76c0cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.981+0000 7fc773070640 1 --2- 172.21.15.132:0/2679285538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc76c0d0010 0x7fc76c0cb8c0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7fc76c0cc6f0 tx=0x7fc76402be40 comp rx=0 tx=0).stop 2023-12-20T04:44:56.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.981+0000 7fc773070640 1 -- 172.21.15.132:0/2679285538 shutdown_connections 2023-12-20T04:44:56.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.981+0000 7fc773070640 1 --2- 172.21.15.132:0/2679285538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc76c0d0010 0x7fc76c0cb8c0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.981+0000 7fc773070640 1 --2- 172.21.15.132:0/2679285538 >> v2:172.21.15.187:3300/0 conn(0x7fc76c160ba0 0x7fc76c0cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.981+0000 7fc773070640 1 -- 172.21.15.132:0/2679285538 >> 172.21.15.132:0/2679285538 conn(0x7fc76c0cd7b0 msgr2=0x7fc76c0cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:56.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.981+0000 7fc773070640 1 -- 172.21.15.132:0/2679285538 shutdown_connections 2023-12-20T04:44:56.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.981+0000 7fc773070640 1 -- 172.21.15.132:0/2679285538 wait complete. 2023-12-20T04:44:56.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.982+0000 7fc773070640 1 Processor -- start 2023-12-20T04:44:56.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.983+0000 7fc773070640 1 -- start start 2023-12-20T04:44:56.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.983+0000 7fc773070640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc76c0ce2a0 0x7fc76c0adc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.983+0000 7fc773070640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc76c0d0010 0x7fc76c0b03d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.983+0000 7fc773070640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc76c160ba0 0x7fc76c14c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.983+0000 7fc773070640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c0b1a20 con 0x7fc76c160ba0 2023-12-20T04:44:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.983+0000 7fc773070640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c0b0910 con 0x7fc76c0d0010 2023-12-20T04:44:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.983+0000 7fc773070640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc76c0ae1e0 con 0x7fc76c0ce2a0 2023-12-20T04:44:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.984+0000 7fc77160d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc76c160ba0 0x7fc76c14c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.984+0000 7fc77160d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc76c160ba0 0x7fc76c14c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36654/0 (socket says 172.21.15.132:36654) 2023-12-20T04:44:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.984+0000 7fc77160d640 1 -- 172.21.15.132:0/1464094868 learned_addr learned my addr 172.21.15.132:0/1464094868 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.984+0000 7fc770e0c640 1 --2- 172.21.15.132:0/1464094868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc76c0ce2a0 0x7fc76c0adc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.984+0000 7fc76bfff640 1 --2- 172.21.15.132:0/1464094868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc76c0d0010 0x7fc76c0b03d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.984+0000 7fc77160d640 1 -- 172.21.15.132:0/1464094868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc76c0ce2a0 msgr2=0x7fc76c0adc00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.984+0000 7fc77160d640 1 --2- 172.21.15.132:0/1464094868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc76c0ce2a0 0x7fc76c0adc00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.984+0000 7fc77160d640 1 -- 172.21.15.132:0/1464094868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc76c0d0010 msgr2=0x7fc76c0b03d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:56.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.984+0000 7fc77160d640 1 --2- 172.21.15.132:0/1464094868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc76c0d0010 0x7fc76c0b03d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:56.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.984+0000 7fc77160d640 1 -- 172.21.15.132:0/1464094868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc764009a70 con 0x7fc76c160ba0 2023-12-20T04:44:56.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.984+0000 7fc77160d640 1 --2- 172.21.15.132:0/1464094868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc76c160ba0 0x7fc76c14c110 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc764009e80 tx=0x7fc764004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:56.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.984+0000 7fc7697fa640 1 -- 172.21.15.132:0/1464094868 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76403e610 con 0x7fc76c160ba0 2023-12-20T04:44:56.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.984+0000 7fc7697fa640 1 -- 172.21.15.132:0/1464094868 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc76403e770 con 0x7fc76c160ba0 2023-12-20T04:44:56.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.984+0000 7fc7697fa640 1 -- 172.21.15.132:0/1464094868 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc76403eb60 con 0x7fc76c160ba0 2023-12-20T04:44:56.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.984+0000 7fc773070640 1 -- 172.21.15.132:0/1464094868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc76c0ae4c0 con 0x7fc76c160ba0 2023-12-20T04:44:56.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.984+0000 7fc773070640 1 -- 172.21.15.132:0/1464094868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc76c0aea80 con 0x7fc76c160ba0 2023-12-20T04:44:56.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.985+0000 7fc773070640 1 -- 172.21.15.132:0/1464094868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc76c0cac50 con 0x7fc76c160ba0 2023-12-20T04:44:56.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.986+0000 7fc7697fa640 1 -- 172.21.15.132:0/1464094868 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc76403b050 con 0x7fc76c160ba0 2023-12-20T04:44:56.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.986+0000 7fc7697fa640 1 --2- 172.21.15.132:0/1464094868 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc75006a430 0x7fc75006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:56.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.986+0000 7fc7697fa640 1 -- 172.21.15.132:0/1464094868 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc7640ab2f0 con 0x7fc76c160ba0 2023-12-20T04:44:56.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.986+0000 7fc770e0c640 1 --2- 172.21.15.132:0/1464094868 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc75006a430 0x7fc75006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:56.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.986+0000 7fc770e0c640 1 --2- 172.21.15.132:0/1464094868 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc75006a430 0x7fc75006c8f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc760009aa0 tx=0x7fc760009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:56.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:56.990+0000 7fc7697fa640 1 -- 172.21.15.132:0/1464094868 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc764076a70 con 0x7fc76c160ba0 2023-12-20T04:44:57.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.156+0000 7fc773070640 1 -- 172.21.15.132:0/1464094868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc76c0cc2e0 con 0x7fc76c160ba0 2023-12-20T04:44:57.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.157+0000 7fc7697fa640 1 -- 172.21.15.132:0/1464094868 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16188 (secure 0 0 0) 0x7fc764009450 con 0x7fc76c160ba0 2023-12-20T04:44:57.159 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:57.159 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":53,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:44:45.942314+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:44:15.033177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-20T04:44:16.130594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.30","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:44:57.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.159+0000 7fc773070640 1 -- 172.21.15.132:0/1464094868 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc75006a430 msgr2=0x7fc75006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.159+0000 7fc773070640 1 --2- 172.21.15.132:0/1464094868 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc75006a430 0x7fc75006c8f0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fc760009aa0 tx=0x7fc760009190 comp rx=0 tx=0).stop 2023-12-20T04:44:57.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.159+0000 7fc773070640 1 -- 172.21.15.132:0/1464094868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc76c160ba0 msgr2=0x7fc76c14c110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.159+0000 7fc773070640 1 --2- 172.21.15.132:0/1464094868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc76c160ba0 0x7fc76c14c110 secure :-1 s=READY pgs=675 cs=0 l=1 rev1=1 crypto rx=0x7fc764009e80 tx=0x7fc764004a40 comp rx=0 tx=0).stop 2023-12-20T04:44:57.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.159+0000 7fc773070640 1 -- 172.21.15.132:0/1464094868 shutdown_connections 2023-12-20T04:44:57.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.159+0000 7fc773070640 1 --2- 172.21.15.132:0/1464094868 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc75006a430 0x7fc75006c8f0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.159+0000 7fc773070640 1 --2- 172.21.15.132:0/1464094868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc76c160ba0 0x7fc76c14c110 unknown :-1 s=CLOSED pgs=675 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.159+0000 7fc773070640 1 --2- 172.21.15.132:0/1464094868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc76c0d0010 0x7fc76c0b03d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.159+0000 7fc773070640 1 --2- 172.21.15.132:0/1464094868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc76c0ce2a0 0x7fc76c0adc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.159+0000 7fc773070640 1 -- 172.21.15.132:0/1464094868 >> 172.21.15.132:0/1464094868 conn(0x7fc76c0cd7b0 msgr2=0x7fc76c0ca540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:57.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.159+0000 7fc773070640 1 -- 172.21.15.132:0/1464094868 shutdown_connections 2023-12-20T04:44:57.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.159+0000 7fc773070640 1 -- 172.21.15.132:0/1464094868 wait complete. 2023-12-20T04:44:57.173 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-20T04:44:57.173 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:44:57.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.273+0000 7fbbfd8bd640 1 Processor -- start 2023-12-20T04:44:57.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.273+0000 7fbbfd8bd640 1 -- start start 2023-12-20T04:44:57.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.274+0000 7fbbfd8bd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbbf80b4de0 0x7fbbf80d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.274+0000 7fbbfd8bd640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf80b5ec0 con 0x7fbbf8160450 2023-12-20T04:44:57.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.274+0000 7fbbfd8bd640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbf81617e0 con 0x7fbbf80b4980 2023-12-20T04:44:57.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.274+0000 7fbbfd8bd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbf80d0fc0 con 0x7fbbf80b4de0 2023-12-20T04:44:57.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.274+0000 7fbbf6ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbbf8160450 0x7fbbf8160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40342/0 (socket says 172.21.15.132:40342) 2023-12-20T04:44:57.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.274+0000 7fbbf6ffd640 1 -- 172.21.15.132:0/3333946652 learned_addr learned my addr 172.21.15.132:0/3333946652 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:57.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.274+0000 7fbbf77fe640 1 --2- 172.21.15.132:0/3333946652 >> v2:172.21.15.132:3300/0 conn(0x7fbbf80b4de0 0x7fbbf80d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.274+0000 7fbbf77fe640 1 -- 172.21.15.132:0/3333946652 >> v1:172.21.15.187:6789/0 conn(0x7fbbf80b4980 legacy=0x7fbbf80d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.274+0000 7fbbf77fe640 1 -- 172.21.15.132:0/3333946652 >> v1:172.21.15.132:6789/0 conn(0x7fbbf8160450 legacy=0x7fbbf8160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.274+0000 7fbbf77fe640 1 -- 172.21.15.132:0/3333946652 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf80d12a0 con 0x7fbbf80b4de0 2023-12-20T04:44:57.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.274+0000 7fbbf67fc640 1 -- 172.21.15.132:0/3333946652 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1383540953 0 0) 0x7fbbf80b5ec0 con 0x7fbbf8160450 2023-12-20T04:44:57.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.275+0000 7fbbf77fe640 1 --2- 172.21.15.132:0/3333946652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbf80b4de0 0x7fbbf80d21b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0009d90 tx=0x7fbbf002bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39b935f4765e1a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:57.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.275+0000 7fbbf67fc640 1 -- 172.21.15.132:0/3333946652 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf002cd80 con 0x7fbbf80b4de0 2023-12-20T04:44:57.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.275+0000 7fbbf67fc640 1 -- 172.21.15.132:0/3333946652 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbf0034440 con 0x7fbbf80b4de0 2023-12-20T04:44:57.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.275+0000 7fbbf67fc640 1 -- 172.21.15.132:0/3333946652 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbf00347d0 con 0x7fbbf80b4de0 2023-12-20T04:44:57.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.276+0000 7fbbfd8bd640 1 -- 172.21.15.132:0/3333946652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbf80b4de0 msgr2=0x7fbbf80d21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.276+0000 7fbbfd8bd640 1 --2- 172.21.15.132:0/3333946652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbf80b4de0 0x7fbbf80d21b0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7fbbf0009d90 tx=0x7fbbf002bfd0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.276+0000 7fbbfd8bd640 1 -- 172.21.15.132:0/3333946652 shutdown_connections 2023-12-20T04:44:57.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.276+0000 7fbbfd8bd640 1 --2- 172.21.15.132:0/3333946652 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbf80b4de0 0x7fbbf80d21b0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.276+0000 7fbbfd8bd640 1 -- 172.21.15.132:0/3333946652 >> 172.21.15.132:0/3333946652 conn(0x7fbbf80cf980 msgr2=0x7fbbf80cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:57.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.276+0000 7fbbfd8bd640 1 -- 172.21.15.132:0/3333946652 shutdown_connections 2023-12-20T04:44:57.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.276+0000 7fbbfd8bd640 1 -- 172.21.15.132:0/3333946652 wait complete. 2023-12-20T04:44:57.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.277+0000 7fbbfd8bd640 1 Processor -- start 2023-12-20T04:44:57.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.277+0000 7fbbfd8bd640 1 -- start start 2023-12-20T04:44:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.277+0000 7fbbfd8bd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbf80b4980 0x7fbbf814c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.277+0000 7fbbfd8bd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbf80b4de0 0x7fbbf814b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.277+0000 7fbbfd8bd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbf8160450 0x7fbbf80cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.277+0000 7fbbfd8bd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf814c5d0 con 0x7fbbf80b4de0 2023-12-20T04:44:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbfd8bd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf815c730 con 0x7fbbf8160450 2023-12-20T04:44:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbfd8bd640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbf80d1ab0 con 0x7fbbf80b4980 2023-12-20T04:44:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbeffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbf80b4de0 0x7fbbf814b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbeffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbf80b4de0 0x7fbbf814b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36668/0 (socket says 172.21.15.132:36668) 2023-12-20T04:44:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbeffff640 1 -- 172.21.15.132:0/1833637021 learned_addr learned my addr 172.21.15.132:0/1833637021 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbf77fe640 1 --2- 172.21.15.132:0/1833637021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbf8160450 0x7fbbf80cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbf6ffd640 1 --2- 172.21.15.132:0/1833637021 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbf80b4980 0x7fbbf814c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbeffff640 1 -- 172.21.15.132:0/1833637021 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbf80b4980 msgr2=0x7fbbf814c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbeffff640 1 --2- 172.21.15.132:0/1833637021 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbf80b4980 0x7fbbf814c090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbeffff640 1 -- 172.21.15.132:0/1833637021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbf8160450 msgr2=0x7fbbf80cadc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbeffff640 1 --2- 172.21.15.132:0/1833637021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbf8160450 0x7fbbf80cadc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbeffff640 1 -- 172.21.15.132:0/1833637021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbf0009a70 con 0x7fbbf80b4de0 2023-12-20T04:44:57.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbeffff640 1 --2- 172.21.15.132:0/1833637021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbf80b4de0 0x7fbbf814b540 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000c450 tx=0x7fbbe000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:57.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbf4ff9640 1 -- 172.21.15.132:0/1833637021 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe00052d0 con 0x7fbbf80b4de0 2023-12-20T04:44:57.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbf4ff9640 1 -- 172.21.15.132:0/1833637021 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe0005430 con 0x7fbbf80b4de0 2023-12-20T04:44:57.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbf4ff9640 1 -- 172.21.15.132:0/1833637021 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe0012870 con 0x7fbbf80b4de0 2023-12-20T04:44:57.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbfd8bd640 1 -- 172.21.15.132:0/1833637021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbf80d1d90 con 0x7fbbf80b4de0 2023-12-20T04:44:57.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.278+0000 7fbbfd8bd640 1 -- 172.21.15.132:0/1833637021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbf80d2350 con 0x7fbbf80b4de0 2023-12-20T04:44:57.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.279+0000 7fbbfd8bd640 1 -- 172.21.15.132:0/1833637021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbf804e840 con 0x7fbbf80b4de0 2023-12-20T04:44:57.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.280+0000 7fbbf4ff9640 1 -- 172.21.15.132:0/1833637021 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbbe00129d0 con 0x7fbbf80b4de0 2023-12-20T04:44:57.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.280+0000 7fbbf4ff9640 1 --2- 172.21.15.132:0/1833637021 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbbd806a430 0x7fbbd806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.280+0000 7fbbf6ffd640 1 --2- 172.21.15.132:0/1833637021 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbbd806a430 0x7fbbd806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.280+0000 7fbbf4ff9640 1 -- 172.21.15.132:0/1833637021 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fbbe00884c0 con 0x7fbbf80b4de0 2023-12-20T04:44:57.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.281+0000 7fbbf6ffd640 1 --2- 172.21.15.132:0/1833637021 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbbd806a430 0x7fbbd806c8f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8000f60 tx=0x7fbbe8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:57.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.285+0000 7fbbf4ff9640 1 -- 172.21.15.132:0/1833637021 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbbe0053a70 con 0x7fbbf80b4de0 2023-12-20T04:44:57.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.485+0000 7fbbfd8bd640 1 -- 172.21.15.132:0/1833637021 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fbbf80d0ad0 con 0x7fbbf80b4de0 2023-12-20T04:44:57.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.485+0000 7fbbf4ff9640 1 -- 172.21.15.132:0/1833637021 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4721 (secure 0 0 0) 0x7fbbe0057090 con 0x7fbbf80b4de0 2023-12-20T04:44:57.487 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:57.488 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1456944733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1456944733},{"type":"v1","addr":"172.21.15.187:6834","nonce":1456944733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2114954856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2114954856},{"type":"v1","addr":"172.21.15.187:6835","nonce":2114954856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2494230497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2494230497},{"type":"v1","addr":"172.21.15.132:6837","nonce":2494230497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:44:17.197194+0000","modified":"2023-12-20T04:44:19.205156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/1024674556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1024674556},{"type":"v1","addr":"172.21.15.132:6836","nonce":1024674556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-20T04:44:57.488 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 19 2023-12-20T04:44:57.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.487+0000 7fbbfd8bd640 1 -- 172.21.15.132:0/1833637021 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbbd806a430 msgr2=0x7fbbd806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.487+0000 7fbbfd8bd640 1 --2- 172.21.15.132:0/1833637021 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbbd806a430 0x7fbbd806c8f0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8000f60 tx=0x7fbbe8009040 comp rx=0 tx=0).stop 2023-12-20T04:44:57.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.487+0000 7fbbfd8bd640 1 -- 172.21.15.132:0/1833637021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbf80b4de0 msgr2=0x7fbbf814b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.487+0000 7fbbfd8bd640 1 --2- 172.21.15.132:0/1833637021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbf80b4de0 0x7fbbf814b540 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7fbbe000c450 tx=0x7fbbe000c910 comp rx=0 tx=0).stop 2023-12-20T04:44:57.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.487+0000 7fbbfd8bd640 1 -- 172.21.15.132:0/1833637021 shutdown_connections 2023-12-20T04:44:57.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.487+0000 7fbbfd8bd640 1 --2- 172.21.15.132:0/1833637021 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbbd806a430 0x7fbbd806c8f0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.487+0000 7fbbfd8bd640 1 --2- 172.21.15.132:0/1833637021 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbf8160450 0x7fbbf80cadc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.487+0000 7fbbfd8bd640 1 --2- 172.21.15.132:0/1833637021 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbf80b4de0 0x7fbbf814b540 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.487+0000 7fbbfd8bd640 1 --2- 172.21.15.132:0/1833637021 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbf80b4980 0x7fbbf814c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.487+0000 7fbbfd8bd640 1 -- 172.21.15.132:0/1833637021 >> 172.21.15.132:0/1833637021 conn(0x7fbbf80cf980 msgr2=0x7fbbf815cdd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:57.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.487+0000 7fbbfd8bd640 1 -- 172.21.15.132:0/1833637021 shutdown_connections 2023-12-20T04:44:57.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.488+0000 7fbbfd8bd640 1 -- 172.21.15.132:0/1833637021 wait complete. 2023-12-20T04:44:57.500 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:44:57.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.598+0000 7f5df66e0640 1 Processor -- start 2023-12-20T04:44:57.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.598+0000 7f5df66e0640 1 -- start start 2023-12-20T04:44:57.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.599+0000 7f5df66e0640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5df015d100 0x7f5df00b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.599+0000 7f5df66e0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df00b2f90 con 0x7f5df00d0370 2023-12-20T04:44:57.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.599+0000 7f5df66e0640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5df01613c0 con 0x7f5df00cdc10 2023-12-20T04:44:57.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.599+0000 7f5df66e0640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5df00d1b00 con 0x7f5df015d100 2023-12-20T04:44:57.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.599+0000 7f5def7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5df00d0370 0x7f5df00cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52452/0 (socket says 172.21.15.132:52452) 2023-12-20T04:44:57.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.599+0000 7f5def7fe640 1 -- 172.21.15.132:0/3350816295 learned_addr learned my addr 172.21.15.132:0/3350816295 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:57.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5deeffd640 1 -- 172.21.15.132:0/3350816295 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2736973368 0 0) 0x7f5de4001110 con 0x7f5df00d0370 2023-12-20T04:44:57.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5deffff640 1 --2- 172.21.15.132:0/3350816295 >> v2:172.21.15.187:3300/0 conn(0x7f5df015d100 0x7f5df00b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5deeffd640 1 -- 172.21.15.132:0/3350816295 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5dd8003520 con 0x7f5df00d0370 2023-12-20T04:44:57.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5deeffd640 1 -- 172.21.15.132:0/3350816295 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1311407134 0 0) 0x7f5dd8003520 con 0x7f5df00d0370 2023-12-20T04:44:57.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5deeffd640 1 -- 172.21.15.132:0/3350816295 >> v2:172.21.15.187:3300/0 conn(0x7f5df015d100 msgr2=0x7f5df00b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:57.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5deeffd640 1 --2- 172.21.15.132:0/3350816295 >> v2:172.21.15.187:3300/0 conn(0x7f5df015d100 0x7f5df00b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5deeffd640 1 -- 172.21.15.132:0/3350816295 >> v1:172.21.15.187:6789/0 conn(0x7f5df00cdc10 legacy=0x7f5df006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5deeffd640 1 -- 172.21.15.132:0/3350816295 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00d0810 con 0x7f5df00d0370 2023-12-20T04:44:57.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5deeffd640 1 -- 172.21.15.132:0/3350816295 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f5de4001800 con 0x7f5df00d0370 2023-12-20T04:44:57.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5deeffd640 1 -- 172.21.15.132:0/3350816295 >> v1:172.21.15.132:6789/0 conn(0x7f5df00d0370 legacy=0x7f5df00cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5deeffd640 1 --2- 172.21.15.132:0/3350816295 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dd8003970 0x7f5dd8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5deeffd640 1 --2- 172.21.15.132:0/3350816295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dd80047c0 0x7f5dd8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5deeffd640 1 --2- 172.21.15.132:0/3350816295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd8005180 0x7f5dd800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5deeffd640 1 -- 172.21.15.132:0/3350816295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00d1b00 con 0x7f5dd8005180 2023-12-20T04:44:57.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5deeffd640 1 -- 172.21.15.132:0/3350816295 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd800c020 con 0x7f5dd80047c0 2023-12-20T04:44:57.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5deeffd640 1 -- 172.21.15.132:0/3350816295 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5dd800c1e0 con 0x7f5dd8003970 2023-12-20T04:44:57.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5df4c7d640 1 --2- 172.21.15.132:0/3350816295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd8005180 0x7f5dd800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5deffff640 1 --2- 172.21.15.132:0/3350816295 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dd8003970 0x7f5dd8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5def7fe640 1 --2- 172.21.15.132:0/3350816295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dd80047c0 0x7f5dd8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5df4c7d640 1 -- 172.21.15.132:0/3350816295 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dd8003970 msgr2=0x7f5dd8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:57.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5df4c7d640 1 --2- 172.21.15.132:0/3350816295 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dd8003970 0x7f5dd8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5df4c7d640 1 -- 172.21.15.132:0/3350816295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dd80047c0 msgr2=0x7f5dd8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:57.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5df4c7d640 1 --2- 172.21.15.132:0/3350816295 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5dd80047c0 0x7f5dd8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.600+0000 7f5df4c7d640 1 -- 172.21.15.132:0/3350816295 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd8003520 con 0x7f5dd8005180 2023-12-20T04:44:57.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.601+0000 7f5df4c7d640 1 -- 172.21.15.132:0/3350816295 reap_dead start 2023-12-20T04:44:57.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.601+0000 7f5df4c7d640 1 --2- 172.21.15.132:0/3350816295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd8005180 0x7f5dd800b980 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5de8001e50 tx=0x7f5dd80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95c88cb1ebfa26a3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:57.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.601+0000 7f5deeffd640 1 -- 172.21.15.132:0/3350816295 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8003b70 con 0x7f5dd8005180 2023-12-20T04:44:57.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.601+0000 7f5deeffd640 1 -- 172.21.15.132:0/3350816295 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de8003d10 con 0x7f5dd8005180 2023-12-20T04:44:57.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.601+0000 7f5deeffd640 1 -- 172.21.15.132:0/3350816295 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de8005310 con 0x7f5dd8005180 2023-12-20T04:44:57.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.602+0000 7f5df66e0640 1 -- 172.21.15.132:0/3350816295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd8005180 msgr2=0x7f5dd800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.602+0000 7f5df66e0640 1 --2- 172.21.15.132:0/3350816295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd8005180 0x7f5dd800b980 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f5de8001e50 tx=0x7f5dd80057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.602+0000 7f5df66e0640 1 -- 172.21.15.132:0/3350816295 shutdown_connections 2023-12-20T04:44:57.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.602+0000 7f5df66e0640 1 --2- 172.21.15.132:0/3350816295 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5dd8005180 0x7f5dd800b980 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.602+0000 7f5df66e0640 1 -- 172.21.15.132:0/3350816295 >> 172.21.15.132:0/3350816295 conn(0x7f5df006d7c0 msgr2=0x7f5df006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:57.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.602+0000 7f5df66e0640 1 -- 172.21.15.132:0/3350816295 shutdown_connections 2023-12-20T04:44:57.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.602+0000 7f5df66e0640 1 -- 172.21.15.132:0/3350816295 wait complete. 2023-12-20T04:44:57.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.603+0000 7f5df66e0640 1 Processor -- start 2023-12-20T04:44:57.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.603+0000 7f5df66e0640 1 -- start start 2023-12-20T04:44:57.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5df66e0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dd8005180 0x7f5df01f6460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5df66e0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5df01f69a0 0x7f5df00b5160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5df66e0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5df00b56a0 0x7f5df01549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5df66e0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00c9090 con 0x7f5df01f69a0 2023-12-20T04:44:57.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5df66e0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5df01f6e20 con 0x7f5df00b56a0 2023-12-20T04:44:57.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5df66e0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5df00b5ee0 con 0x7f5dd8005180 2023-12-20T04:44:57.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5def7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5df01f69a0 0x7f5df00b5160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5def7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5df01f69a0 0x7f5df00b5160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48496/0 (socket says 172.21.15.132:48496) 2023-12-20T04:44:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5def7fe640 1 -- 172.21.15.132:0/4006694844 learned_addr learned my addr 172.21.15.132:0/4006694844 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5df4c7d640 1 --2- 172.21.15.132:0/4006694844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5df00b56a0 0x7f5df01549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5deffff640 1 --2- 172.21.15.132:0/4006694844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dd8005180 0x7f5df01f6460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5def7fe640 1 -- 172.21.15.132:0/4006694844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dd8005180 msgr2=0x7f5df01f6460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5def7fe640 1 --2- 172.21.15.132:0/4006694844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dd8005180 0x7f5df01f6460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5def7fe640 1 -- 172.21.15.132:0/4006694844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5df00b56a0 msgr2=0x7f5df01549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5def7fe640 1 --2- 172.21.15.132:0/4006694844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5df00b56a0 0x7f5df01549c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5def7fe640 1 -- 172.21.15.132:0/4006694844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5df00b61c0 con 0x7f5df01f69a0 2023-12-20T04:44:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5deffff640 1 --2- 172.21.15.132:0/4006694844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dd8005180 0x7f5df01f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5df4c7d640 1 --2- 172.21.15.132:0/4006694844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5df00b56a0 0x7f5df01549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5def7fe640 1 --2- 172.21.15.132:0/4006694844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5df01f69a0 0x7f5df00b5160 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5de4004fb0 tx=0x7f5de40074f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5decff9640 1 -- 172.21.15.132:0/4006694844 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de4007740 con 0x7f5df01f69a0 2023-12-20T04:44:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.604+0000 7f5decff9640 1 -- 172.21.15.132:0/4006694844 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5de400f960 con 0x7f5df01f69a0 2023-12-20T04:44:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.605+0000 7f5df66e0640 1 -- 172.21.15.132:0/4006694844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5df00b64a0 con 0x7f5df01f69a0 2023-12-20T04:44:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.605+0000 7f5decff9640 1 -- 172.21.15.132:0/4006694844 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5de400fd10 con 0x7f5df01f69a0 2023-12-20T04:44:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.605+0000 7f5df66e0640 1 -- 172.21.15.132:0/4006694844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5df00b5b20 con 0x7f5df01f69a0 2023-12-20T04:44:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.605+0000 7f5df66e0640 1 -- 172.21.15.132:0/4006694844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5df004e840 con 0x7f5df01f69a0 2023-12-20T04:44:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.606+0000 7f5decff9640 1 -- 172.21.15.132:0/4006694844 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5de401d460 con 0x7f5df01f69a0 2023-12-20T04:44:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.606+0000 7f5decff9640 1 --2- 172.21.15.132:0/4006694844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5ddc06a430 0x7f5ddc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.606+0000 7f5decff9640 1 -- 172.21.15.132:0/4006694844 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5de4088880 con 0x7f5df01f69a0 2023-12-20T04:44:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.606+0000 7f5deffff640 1 --2- 172.21.15.132:0/4006694844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5ddc06a430 0x7f5ddc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.607+0000 7f5deffff640 1 --2- 172.21.15.132:0/4006694844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5ddc06a430 0x7f5ddc06c8f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5df01f3fa0 tx=0x7f5de0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.610+0000 7f5decff9640 1 -- 172.21.15.132:0/4006694844 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5de4053e30 con 0x7f5df01f69a0 2023-12-20T04:44:57.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.812+0000 7f5df66e0640 1 -- 172.21.15.132:0/4006694844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5df00b2f90 con 0x7f5df01f69a0 2023-12-20T04:44:57.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.813+0000 7f5decff9640 1 -- 172.21.15.132:0/4006694844 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) v1 ==== 94+0+4721 (secure 0 0 0) 0x7f5df00b2f90 con 0x7f5df01f69a0 2023-12-20T04:44:57.815 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:57.815 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":19,"default_fscid":3,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1456944733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1456944733},{"type":"v1","addr":"172.21.15.187:6834","nonce":1456944733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2114954856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2114954856},{"type":"v1","addr":"172.21.15.187:6835","nonce":2114954856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2494230497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2494230497},{"type":"v1","addr":"172.21.15.132:6837","nonce":2494230497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:44:17.197194+0000","modified":"2023-12-20T04:44:19.205156+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":5685},"failed":[],"damaged":[],"stopped":[],"info":{"gid_5685":{"gid":5685,"name":"c","rank":0,"incarnation":17,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/1024674556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1024674556},{"type":"v1","addr":"172.21.15.132:6836","nonce":1024674556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[7],"metadata_pool":6,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":3}]} 2023-12-20T04:44:57.815 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 19 2023-12-20T04:44:57.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.815+0000 7f5df66e0640 1 -- 172.21.15.132:0/4006694844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5ddc06a430 msgr2=0x7f5ddc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.815+0000 7f5df66e0640 1 --2- 172.21.15.132:0/4006694844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5ddc06a430 0x7f5ddc06c8f0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f5df01f3fa0 tx=0x7f5de0008040 comp rx=0 tx=0).stop 2023-12-20T04:44:57.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.815+0000 7f5df66e0640 1 -- 172.21.15.132:0/4006694844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5df01f69a0 msgr2=0x7f5df00b5160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.815+0000 7f5df66e0640 1 --2- 172.21.15.132:0/4006694844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5df01f69a0 0x7f5df00b5160 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f5de4004fb0 tx=0x7f5de40074f0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.815+0000 7f5df66e0640 1 -- 172.21.15.132:0/4006694844 shutdown_connections 2023-12-20T04:44:57.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.815+0000 7f5df66e0640 1 --2- 172.21.15.132:0/4006694844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5ddc06a430 0x7f5ddc06c8f0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.815+0000 7f5df66e0640 1 --2- 172.21.15.132:0/4006694844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5df00b56a0 0x7f5df01549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.815+0000 7f5df66e0640 1 --2- 172.21.15.132:0/4006694844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5df01f69a0 0x7f5df00b5160 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.815+0000 7f5df66e0640 1 --2- 172.21.15.132:0/4006694844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5dd8005180 0x7f5df01f6460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.815+0000 7f5df66e0640 1 -- 172.21.15.132:0/4006694844 >> 172.21.15.132:0/4006694844 conn(0x7f5df006d7c0 msgr2=0x7f5df0072c60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:57.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.815+0000 7f5df66e0640 1 -- 172.21.15.132:0/4006694844 shutdown_connections 2023-12-20T04:44:57.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.815+0000 7f5df66e0640 1 -- 172.21.15.132:0/4006694844 wait complete. 2023-12-20T04:44:57.828 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:44:57.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.925+0000 7f47e7539640 1 Processor -- start 2023-12-20T04:44:57.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.925+0000 7f47e7539640 1 -- start start 2023-12-20T04:44:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47e7539640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f47e0160450 0x7f47e0160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47e7539640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e00b5ec0 con 0x7f47e00b5090 2023-12-20T04:44:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47e7539640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f47e01617e0 con 0x7f47e01611b0 2023-12-20T04:44:57.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47e7539640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f47e00d0fc0 con 0x7f47e0160450 2023-12-20T04:44:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47e5ad6640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f47e00b5090 0x7f47e00d1aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52454/0 (socket says 172.21.15.132:52454) 2023-12-20T04:44:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47e5ad6640 1 -- 172.21.15.132:0/1701643477 learned_addr learned my addr 172.21.15.132:0/1701643477 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47d7fff640 1 -- 172.21.15.132:0/1701643477 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2297221790 0 0) 0x7f47e00b5ec0 con 0x7f47e00b5090 2023-12-20T04:44:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47e52d5640 1 --2- 172.21.15.132:0/1701643477 >> v2:172.21.15.187:3300/0 conn(0x7f47e0160450 0x7f47e0160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47d7fff640 1 -- 172.21.15.132:0/1701643477 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f47cc003520 con 0x7f47e00b5090 2023-12-20T04:44:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47d7fff640 1 -- 172.21.15.132:0/1701643477 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3651510737 0 0) 0x7f47cc003520 con 0x7f47e00b5090 2023-12-20T04:44:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47d7fff640 1 -- 172.21.15.132:0/1701643477 >> v2:172.21.15.187:3300/0 conn(0x7f47e0160450 msgr2=0x7f47e0160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47d7fff640 1 --2- 172.21.15.132:0/1701643477 >> v2:172.21.15.187:3300/0 conn(0x7f47e0160450 0x7f47e0160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47d7fff640 1 -- 172.21.15.132:0/1701643477 >> v1:172.21.15.187:6789/0 conn(0x7f47e01611b0 legacy=0x7f47e00b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47d7fff640 1 -- 172.21.15.132:0/1701643477 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e00d12a0 con 0x7f47e00b5090 2023-12-20T04:44:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47d7fff640 1 -- 172.21.15.132:0/1701643477 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f47d80019f0 con 0x7f47e00b5090 2023-12-20T04:44:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47d7fff640 1 -- 172.21.15.132:0/1701643477 >> v1:172.21.15.132:6789/0 conn(0x7f47e00b5090 legacy=0x7f47e00d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47d7fff640 1 --2- 172.21.15.132:0/1701643477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47cc003970 0x7f47cc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47d7fff640 1 --2- 172.21.15.132:0/1701643477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47cc0047c0 0x7f47cc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.926+0000 7f47d7fff640 1 --2- 172.21.15.132:0/1701643477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47cc005180 0x7f47cc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.927+0000 7f47d7fff640 1 -- 172.21.15.132:0/1701643477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00d0fc0 con 0x7f47cc003970 2023-12-20T04:44:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.927+0000 7f47d7fff640 1 -- 172.21.15.132:0/1701643477 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc00c030 con 0x7f47cc0047c0 2023-12-20T04:44:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.927+0000 7f47d7fff640 1 -- 172.21.15.132:0/1701643477 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47cc00c1f0 con 0x7f47cc005180 2023-12-20T04:44:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.927+0000 7f47e52d5640 1 --2- 172.21.15.132:0/1701643477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47cc003970 0x7f47cc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.927+0000 7f47e4ad4640 1 --2- 172.21.15.132:0/1701643477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47cc0047c0 0x7f47cc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.927+0000 7f47e5ad6640 1 --2- 172.21.15.132:0/1701643477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47cc005180 0x7f47cc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.927+0000 7f47e52d5640 1 -- 172.21.15.132:0/1701643477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47cc005180 msgr2=0x7f47cc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.927+0000 7f47e52d5640 1 --2- 172.21.15.132:0/1701643477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47cc005180 0x7f47cc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.927+0000 7f47e52d5640 1 -- 172.21.15.132:0/1701643477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47cc0047c0 msgr2=0x7f47cc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.927+0000 7f47e52d5640 1 --2- 172.21.15.132:0/1701643477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47cc0047c0 0x7f47cc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.927+0000 7f47e52d5640 1 -- 172.21.15.132:0/1701643477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47cc003520 con 0x7f47cc003970 2023-12-20T04:44:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.927+0000 7f47e5ad6640 1 -- 172.21.15.132:0/1701643477 reap_dead start 2023-12-20T04:44:57.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.927+0000 7f47e4ad4640 1 --2- 172.21.15.132:0/1701643477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47cc0047c0 0x7f47cc004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:57.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.928+0000 7f47e52d5640 1 --2- 172.21.15.132:0/1701643477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47cc003970 0x7f47cc003d90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009ac0 tx=0x7f47cc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7bfe77cb0f058bf server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:57.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.928+0000 7f47d7fff640 1 -- 172.21.15.132:0/1701643477 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc02c6b0 con 0x7f47cc003970 2023-12-20T04:44:57.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.928+0000 7f47d7fff640 1 -- 172.21.15.132:0/1701643477 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47dc02c810 con 0x7f47cc003970 2023-12-20T04:44:57.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.928+0000 7f47d7fff640 1 -- 172.21.15.132:0/1701643477 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc02cba0 con 0x7f47cc003970 2023-12-20T04:44:57.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.928+0000 7f47e7539640 1 -- 172.21.15.132:0/1701643477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47cc003970 msgr2=0x7f47cc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.928+0000 7f47e7539640 1 --2- 172.21.15.132:0/1701643477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47cc003970 0x7f47cc003d90 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f47dc009ac0 tx=0x7f47cc0057f0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.928+0000 7f47e7539640 1 -- 172.21.15.132:0/1701643477 shutdown_connections 2023-12-20T04:44:57.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.928+0000 7f47e7539640 1 --2- 172.21.15.132:0/1701643477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47cc003970 0x7f47cc003d90 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.928+0000 7f47e7539640 1 -- 172.21.15.132:0/1701643477 >> 172.21.15.132:0/1701643477 conn(0x7f47e00cf980 msgr2=0x7f47e00cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:57.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.928+0000 7f47e7539640 1 -- 172.21.15.132:0/1701643477 shutdown_connections 2023-12-20T04:44:57.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.928+0000 7f47e7539640 1 -- 172.21.15.132:0/1701643477 wait complete. 2023-12-20T04:44:57.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.929+0000 7f47e7539640 1 Processor -- start 2023-12-20T04:44:57.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.930+0000 7f47e7539640 1 -- start start 2023-12-20T04:44:57.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.930+0000 7f47e7539640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47cc003970 0x7f47e0155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.930+0000 7f47e7539640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e00cb9b0 0x7f47e00cbe30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.930+0000 7f47e7539640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e01f2370 0x7f47e01f27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.930+0000 7f47e7539640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e01561e0 con 0x7f47cc003970 2023-12-20T04:44:57.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.930+0000 7f47e7539640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f47e00cc370 con 0x7f47e01f2370 2023-12-20T04:44:57.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.930+0000 7f47e7539640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f47e01f3140 con 0x7f47e00cb9b0 2023-12-20T04:44:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.930+0000 7f47e52d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47cc003970 0x7f47e0155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.930+0000 7f47e52d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47cc003970 0x7f47e0155be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48508/0 (socket says 172.21.15.132:48508) 2023-12-20T04:44:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.930+0000 7f47e52d5640 1 -- 172.21.15.132:0/404695383 learned_addr learned my addr 172.21.15.132:0/404695383 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.931+0000 7f47e5ad6640 1 --2- 172.21.15.132:0/404695383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e01f2370 0x7f47e01f27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.931+0000 7f47e4ad4640 1 --2- 172.21.15.132:0/404695383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e00cb9b0 0x7f47e00cbe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.931+0000 7f47e52d5640 1 -- 172.21.15.132:0/404695383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e00cb9b0 msgr2=0x7f47e00cbe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.931+0000 7f47e52d5640 1 --2- 172.21.15.132:0/404695383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e00cb9b0 0x7f47e00cbe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.931+0000 7f47e52d5640 1 -- 172.21.15.132:0/404695383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e01f2370 msgr2=0x7f47e01f27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.931+0000 7f47e52d5640 1 --2- 172.21.15.132:0/404695383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e01f2370 0x7f47e01f27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.931+0000 7f47e52d5640 1 -- 172.21.15.132:0/404695383 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f47e01f3420 con 0x7f47cc003970 2023-12-20T04:44:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.931+0000 7f47e4ad4640 1 --2- 172.21.15.132:0/404695383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e00cb9b0 0x7f47e00cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.931+0000 7f47e5ad6640 1 --2- 172.21.15.132:0/404695383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e01f2370 0x7f47e01f27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:57.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.931+0000 7f47e52d5640 1 --2- 172.21.15.132:0/404695383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47cc003970 0x7f47e0155be0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f47dc02c250 tx=0x7f47dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:57.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.931+0000 7f47d5ffb640 1 -- 172.21.15.132:0/404695383 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc003810 con 0x7f47cc003970 2023-12-20T04:44:57.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.931+0000 7f47d5ffb640 1 -- 172.21.15.132:0/404695383 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f47dc003970 con 0x7f47cc003970 2023-12-20T04:44:57.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.931+0000 7f47e7539640 1 -- 172.21.15.132:0/404695383 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f47e01f3700 con 0x7f47cc003970 2023-12-20T04:44:57.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.931+0000 7f47d5ffb640 1 -- 172.21.15.132:0/404695383 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f47dc003d00 con 0x7f47cc003970 2023-12-20T04:44:57.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.931+0000 7f47e7539640 1 -- 172.21.15.132:0/404695383 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f47e01f2d30 con 0x7f47cc003970 2023-12-20T04:44:57.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.932+0000 7f47e7539640 1 -- 172.21.15.132:0/404695383 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f47e004e840 con 0x7f47cc003970 2023-12-20T04:44:57.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.933+0000 7f47d5ffb640 1 -- 172.21.15.132:0/404695383 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f47dc047450 con 0x7f47cc003970 2023-12-20T04:44:57.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.933+0000 7f47d5ffb640 1 --2- 172.21.15.132:0/404695383 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f47c406a430 0x7f47c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:57.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.933+0000 7f47d5ffb640 1 -- 172.21.15.132:0/404695383 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f47dc0aabc0 con 0x7f47cc003970 2023-12-20T04:44:57.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.933+0000 7f47e4ad4640 1 --2- 172.21.15.132:0/404695383 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f47c406a430 0x7f47c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:57.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.934+0000 7f47e4ad4640 1 --2- 172.21.15.132:0/404695383 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f47c406a430 0x7f47c406c8f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f47d0000c00 tx=0x7f47d0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:57.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:57.937+0000 7f47d5ffb640 1 -- 172.21.15.132:0/404695383 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f47dc076220 con 0x7f47cc003970 2023-12-20T04:44:58.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.104+0000 7f47e7539640 1 -- 172.21.15.132:0/404695383 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f47e00d0ad0 con 0x7f47cc003970 2023-12-20T04:44:58.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.105+0000 7f47d5ffb640 1 -- 172.21.15.132:0/404695383 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v53) v1 ==== 74+0+16188 (secure 0 0 0) 0x7f47dc003e60 con 0x7f47cc003970 2023-12-20T04:44:58.107 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:44:58.107 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":53,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:44:45.942314+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:44:15.033177+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"cephfs_data","create_time":"2023-12-20T04:44:16.130594+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"7.7","mappings":[{"from":0,"to":4}]},{"pgid":"7.30","mappings":[{"from":0,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:44:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.107+0000 7f47e7539640 1 -- 172.21.15.132:0/404695383 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f47c406a430 msgr2=0x7f47c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.107+0000 7f47e7539640 1 --2- 172.21.15.132:0/404695383 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f47c406a430 0x7f47c406c8f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f47d0000c00 tx=0x7f47d0009040 comp rx=0 tx=0).stop 2023-12-20T04:44:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.107+0000 7f47e7539640 1 -- 172.21.15.132:0/404695383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47cc003970 msgr2=0x7f47e0155be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.107+0000 7f47e7539640 1 --2- 172.21.15.132:0/404695383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47cc003970 0x7f47e0155be0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f47dc02c250 tx=0x7f47dc004730 comp rx=0 tx=0).stop 2023-12-20T04:44:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.107+0000 7f47e7539640 1 -- 172.21.15.132:0/404695383 shutdown_connections 2023-12-20T04:44:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.107+0000 7f47e7539640 1 --2- 172.21.15.132:0/404695383 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f47c406a430 0x7f47c406c8f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.107+0000 7f47e7539640 1 --2- 172.21.15.132:0/404695383 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f47e01f2370 0x7f47e01f27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.107+0000 7f47e7539640 1 --2- 172.21.15.132:0/404695383 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f47e00cb9b0 0x7f47e00cbe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.107+0000 7f47e7539640 1 --2- 172.21.15.132:0/404695383 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f47cc003970 0x7f47e0155be0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.107+0000 7f47e7539640 1 -- 172.21.15.132:0/404695383 >> 172.21.15.132:0/404695383 conn(0x7f47e00cf980 msgr2=0x7f47e00c9340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:58.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.107+0000 7f47e7539640 1 -- 172.21.15.132:0/404695383 shutdown_connections 2023-12-20T04:44:58.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.107+0000 7f47e7539640 1 -- 172.21.15.132:0/404695383 wait complete. 2023-12-20T04:44:58.120 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-20T04:44:58.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.219+0000 7f62beaab640 1 Processor -- start 2023-12-20T04:44:58.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.219+0000 7f62beaab640 1 -- start start 2023-12-20T04:44:58.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.220+0000 7f62beaab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f62b815ae50 0x7f62b80b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:58.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.220+0000 7f62beaab640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f62b80ade90 0x7f62b80caa20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:58.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.220+0000 7f62beaab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62b80ccfb0 0x7f62b80cd440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:58.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.220+0000 7f62beaab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b80ce010 con 0x7f62b815ae50 2023-12-20T04:44:58.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.220+0000 7f62beaab640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62b815b230 con 0x7f62b80ade90 2023-12-20T04:44:58.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.220+0000 7f62beaab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b80c9050 con 0x7f62b80ccfb0 2023-12-20T04:44:58.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.220+0000 7f62bc847640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f62b815ae50 0x7f62b80b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:58.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.220+0000 7f62bc847640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f62b815ae50 0x7f62b80b0d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48510/0 (socket says 172.21.15.132:48510) 2023-12-20T04:44:58.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.220+0000 7f62bc847640 1 -- 172.21.15.132:0/1436649036 learned_addr learned my addr 172.21.15.132:0/1436649036 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:58.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.221+0000 7f62bc847640 1 -- 172.21.15.132:0/1436649036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62b80ccfb0 msgr2=0x7f62b80cd440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:58.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.221+0000 7f62bc847640 1 --2- 172.21.15.132:0/1436649036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62b80ccfb0 0x7f62b80cd440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.221+0000 7f62bc847640 1 -- 172.21.15.132:0/1436649036 >> v2:172.21.15.187:3300/0 conn(0x7f62b80ade90 msgr2=0x7f62b80caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:58.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.221+0000 7f62bc847640 1 --2- 172.21.15.132:0/1436649036 >> v2:172.21.15.187:3300/0 conn(0x7f62b80ade90 0x7f62b80caa20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.221+0000 7f62bc847640 1 -- 172.21.15.132:0/1436649036 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62b815f700 con 0x7f62b815ae50 2023-12-20T04:44:58.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.221+0000 7f62bc847640 1 --2- 172.21.15.132:0/1436649036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62b815ae50 0x7f62b80b0d40 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f62a80098a0 tx=0x7f62a802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2e823060109fd08 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:58.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.221+0000 7f62b77fe640 1 -- 172.21.15.132:0/1436649036 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8031640 con 0x7f62b815ae50 2023-12-20T04:44:58.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.221+0000 7f62b77fe640 1 -- 172.21.15.132:0/1436649036 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a80317a0 con 0x7f62b815ae50 2023-12-20T04:44:58.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.221+0000 7f62b77fe640 1 -- 172.21.15.132:0/1436649036 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a8031b30 con 0x7f62b815ae50 2023-12-20T04:44:58.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.222+0000 7f62beaab640 1 -- 172.21.15.132:0/1436649036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62b815ae50 msgr2=0x7f62b80b0d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:58.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.222+0000 7f62beaab640 1 --2- 172.21.15.132:0/1436649036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62b815ae50 0x7f62b80b0d40 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x7f62a80098a0 tx=0x7f62a802b8f0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.222+0000 7f62beaab640 1 -- 172.21.15.132:0/1436649036 shutdown_connections 2023-12-20T04:44:58.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.222+0000 7f62beaab640 1 --2- 172.21.15.132:0/1436649036 >> v2:172.21.15.187:3300/0 conn(0x7f62b80ade90 0x7f62b80caa20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.222+0000 7f62beaab640 1 --2- 172.21.15.132:0/1436649036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62b80ccfb0 0x7f62b80cd440 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.222+0000 7f62beaab640 1 --2- 172.21.15.132:0/1436649036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62b815ae50 0x7f62b80b0d40 unknown :-1 s=CLOSED pgs=685 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.222+0000 7f62beaab640 1 -- 172.21.15.132:0/1436649036 >> 172.21.15.132:0/1436649036 conn(0x7f62b806a260 msgr2=0x7f62b80b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:58.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.222+0000 7f62beaab640 1 -- 172.21.15.132:0/1436649036 shutdown_connections 2023-12-20T04:44:58.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.222+0000 7f62beaab640 1 -- 172.21.15.132:0/1436649036 wait complete. 2023-12-20T04:44:58.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.223+0000 7f62beaab640 1 Processor -- start 2023-12-20T04:44:58.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.223+0000 7f62beaab640 1 -- start start 2023-12-20T04:44:58.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.224+0000 7f62beaab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62b80ade90 0x7f62b815d740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:58.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.224+0000 7f62beaab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62b80ccfb0 0x7f62b80c7170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:58.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.224+0000 7f62beaab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62b815ae50 0x7f62b80b3de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:58.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.224+0000 7f62beaab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b815dc80 con 0x7f62b815ae50 2023-12-20T04:44:58.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.224+0000 7f62beaab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62b815d2b0 con 0x7f62b80ade90 2023-12-20T04:44:58.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.224+0000 7f62beaab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62b815c6a0 con 0x7f62b80ccfb0 2023-12-20T04:44:58.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.224+0000 7f62bd048640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62b815ae50 0x7f62b80b3de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:58.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.224+0000 7f62bd048640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62b815ae50 0x7f62b80b3de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48514/0 (socket says 172.21.15.132:48514) 2023-12-20T04:44:58.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.224+0000 7f62bd048640 1 -- 172.21.15.132:0/2516658998 learned_addr learned my addr 172.21.15.132:0/2516658998 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:58.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.224+0000 7f62b7fff640 1 --2- 172.21.15.132:0/2516658998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62b80ccfb0 0x7f62b80c7170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:58.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.224+0000 7f62bc847640 1 --2- 172.21.15.132:0/2516658998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62b80ade90 0x7f62b815d740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:58.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.224+0000 7f62bd048640 1 -- 172.21.15.132:0/2516658998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62b80ccfb0 msgr2=0x7f62b80c7170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:58.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.224+0000 7f62bd048640 1 --2- 172.21.15.132:0/2516658998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62b80ccfb0 0x7f62b80c7170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.225+0000 7f62bd048640 1 -- 172.21.15.132:0/2516658998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62b80ade90 msgr2=0x7f62b815d740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:58.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.225+0000 7f62bd048640 1 --2- 172.21.15.132:0/2516658998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62b80ade90 0x7f62b815d740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.225+0000 7f62bd048640 1 -- 172.21.15.132:0/2516658998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a80094d0 con 0x7f62b815ae50 2023-12-20T04:44:58.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.225+0000 7f62bd048640 1 --2- 172.21.15.132:0/2516658998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62b815ae50 0x7f62b80b3de0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f62b000b970 tx=0x7f62b000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:58.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.225+0000 7f62b57fa640 1 -- 172.21.15.132:0/2516658998 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b000cb40 con 0x7f62b815ae50 2023-12-20T04:44:58.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.225+0000 7f62b57fa640 1 -- 172.21.15.132:0/2516658998 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62b000ccc0 con 0x7f62b815ae50 2023-12-20T04:44:58.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.225+0000 7f62beaab640 1 -- 172.21.15.132:0/2516658998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62b815c980 con 0x7f62b815ae50 2023-12-20T04:44:58.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.225+0000 7f62b57fa640 1 -- 172.21.15.132:0/2516658998 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62b0014680 con 0x7f62b815ae50 2023-12-20T04:44:58.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.225+0000 7f62beaab640 1 -- 172.21.15.132:0/2516658998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62b815cf40 con 0x7f62b815ae50 2023-12-20T04:44:58.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.226+0000 7f62beaab640 1 -- 172.21.15.132:0/2516658998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62b804e840 con 0x7f62b815ae50 2023-12-20T04:44:58.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.226+0000 7f62b57fa640 1 -- 172.21.15.132:0/2516658998 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f62b001d3b0 con 0x7f62b815ae50 2023-12-20T04:44:58.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.226+0000 7f62b57fa640 1 --2- 172.21.15.132:0/2516658998 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62a406a430 0x7f62a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:58.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.227+0000 7f62b57fa640 1 -- 172.21.15.132:0/2516658998 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(53..53 src has 1..53) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f62b00888a0 con 0x7f62b815ae50 2023-12-20T04:44:58.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.227+0000 7f62bc847640 1 --2- 172.21.15.132:0/2516658998 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62a406a430 0x7f62a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:58.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.227+0000 7f62bc847640 1 --2- 172.21.15.132:0/2516658998 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62a406a430 0x7f62a406c8f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f62a8036000 tx=0x7f62a803c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:58.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.231+0000 7f62b57fa640 1 -- 172.21.15.132:0/2516658998 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f62b0053e50 con 0x7f62b815ae50 2023-12-20T04:44:58.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.430+0000 7f62beaab640 1 -- 172.21.15.132:0/2516658998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f62b806c420 con 0x7f62b815ae50 2023-12-20T04:44:58.432 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:44:58.431+0000 7f1a5cbbd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-20T04:44:58.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.445+0000 7f62b57fa640 1 -- 172.21.15.132:0/2516658998 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) v1 ==== 161+0+0 (secure 0 0 0) 0x7f62b0019020 con 0x7f62b815ae50 2023-12-20T04:44:58.447 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-20T04:44:58.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.447+0000 7f62beaab640 1 -- 172.21.15.132:0/2516658998 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62a406a430 msgr2=0x7f62a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:58.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.447+0000 7f62beaab640 1 --2- 172.21.15.132:0/2516658998 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62a406a430 0x7f62a406c8f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f62a8036000 tx=0x7f62a803c040 comp rx=0 tx=0).stop 2023-12-20T04:44:58.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.447+0000 7f62beaab640 1 -- 172.21.15.132:0/2516658998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62b815ae50 msgr2=0x7f62b80b3de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:58.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.447+0000 7f62beaab640 1 --2- 172.21.15.132:0/2516658998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62b815ae50 0x7f62b80b3de0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f62b000b970 tx=0x7f62b000be30 comp rx=0 tx=0).stop 2023-12-20T04:44:58.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.448+0000 7f62beaab640 1 -- 172.21.15.132:0/2516658998 shutdown_connections 2023-12-20T04:44:58.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.448+0000 7f62beaab640 1 --2- 172.21.15.132:0/2516658998 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62a406a430 0x7f62a406c8f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.448+0000 7f62beaab640 1 --2- 172.21.15.132:0/2516658998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62b815ae50 0x7f62b80b3de0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.448+0000 7f62beaab640 1 --2- 172.21.15.132:0/2516658998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62b80ccfb0 0x7f62b80c7170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.448+0000 7f62beaab640 1 --2- 172.21.15.132:0/2516658998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62b80ade90 0x7f62b815d740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.448+0000 7f62beaab640 1 -- 172.21.15.132:0/2516658998 >> 172.21.15.132:0/2516658998 conn(0x7f62b806a260 msgr2=0x7f62b80708c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:58.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.448+0000 7f62beaab640 1 -- 172.21.15.132:0/2516658998 shutdown_connections 2023-12-20T04:44:58.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.448+0000 7f62beaab640 1 -- 172.21.15.132:0/2516658998 wait complete. 2023-12-20T04:44:58.451 INFO:tasks.ceph.mds.c.smithi132.stderr: -9611> 2023-12-20T04:44:18.356+0000 7f4f79201640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:44:58.461 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-20T04:44:58.483 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-12-20T04:44:58.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.562+0000 7ff111989640 1 Processor -- start 2023-12-20T04:44:58.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.562+0000 7ff111989640 1 -- start start 2023-12-20T04:44:58.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.563+0000 7ff111989640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff10c15d300 0x7ff10c0d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:58.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.563+0000 7ff111989640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff10c0cfea0 0x7ff10c0b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:58.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.563+0000 7ff111989640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff10c0d2920 con 0x7ff10c0d17d0 2023-12-20T04:44:58.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.563+0000 7ff111989640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10c0d1d10 con 0x7ff10c0cfea0 2023-12-20T04:44:58.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.563+0000 7ff111989640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff10c0d1ff0 con 0x7ff10c15d300 2023-12-20T04:44:58.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.563+0000 7ff10b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff10c0cfea0 0x7ff10c0b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:58.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.563+0000 7ff103fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff10c0d17d0 0x7ff10c0cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52480/0 (socket says 172.21.15.132:52480) 2023-12-20T04:44:58.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.563+0000 7ff103fff640 1 -- 172.21.15.132:0/2679873034 learned_addr learned my addr 172.21.15.132:0/2679873034 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:58.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.563+0000 7ff10affd640 1 --2- 172.21.15.132:0/2679873034 >> v2:172.21.15.187:3300/0 conn(0x7ff10c15d300 0x7ff10c0d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:58.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.563+0000 7ff10b7fe640 1 -- 172.21.15.132:0/2679873034 >> v2:172.21.15.187:3300/0 conn(0x7ff10c15d300 msgr2=0x7ff10c0d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:58.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.563+0000 7ff10a7fc640 1 -- 172.21.15.132:0/2679873034 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2874268244 0 0) 0x7ff10c0d2920 con 0x7ff10c0d17d0 2023-12-20T04:44:58.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.563+0000 7ff10b7fe640 1 --2- 172.21.15.132:0/2679873034 >> v2:172.21.15.187:3300/0 conn(0x7ff10c15d300 0x7ff10c0d1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.563+0000 7ff10b7fe640 1 -- 172.21.15.132:0/2679873034 >> v1:172.21.15.132:6789/0 conn(0x7ff10c0d17d0 legacy=0x7ff10c0cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:58.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.563+0000 7ff10b7fe640 1 -- 172.21.15.132:0/2679873034 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff10c0d22d0 con 0x7ff10c0cfea0 2023-12-20T04:44:58.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.563+0000 7ff10affd640 1 --2- 172.21.15.132:0/2679873034 >> v2:172.21.15.187:3300/0 conn(0x7ff10c15d300 0x7ff10c0d1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:44:58.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.564+0000 7ff10b7fe640 1 --2- 172.21.15.132:0/2679873034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0cfea0 0x7ff10c0b6080 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff10c06b160 tx=0x7ff10402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4348f1384686adcd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:58.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.564+0000 7ff10a7fc640 1 -- 172.21.15.132:0/2679873034 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff10402cc80 con 0x7ff10c0cfea0 2023-12-20T04:44:58.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.564+0000 7ff10a7fc640 1 -- 172.21.15.132:0/2679873034 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff10402cde0 con 0x7ff10c0cfea0 2023-12-20T04:44:58.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.564+0000 7ff10a7fc640 1 -- 172.21.15.132:0/2679873034 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff104034660 con 0x7ff10c0cfea0 2023-12-20T04:44:58.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.564+0000 7ff111989640 1 -- 172.21.15.132:0/2679873034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0cfea0 msgr2=0x7ff10c0b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:58.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.564+0000 7ff111989640 1 --2- 172.21.15.132:0/2679873034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0cfea0 0x7ff10c0b6080 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7ff10c06b160 tx=0x7ff10402bed0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.564+0000 7ff111989640 1 -- 172.21.15.132:0/2679873034 shutdown_connections 2023-12-20T04:44:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.564+0000 7ff111989640 1 --2- 172.21.15.132:0/2679873034 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0cfea0 0x7ff10c0b6080 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.564+0000 7ff111989640 1 --2- 172.21.15.132:0/2679873034 >> v2:172.21.15.187:3300/0 conn(0x7ff10c15d300 0x7ff10c0d1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.564+0000 7ff111989640 1 -- 172.21.15.132:0/2679873034 >> 172.21.15.132:0/2679873034 conn(0x7ff10c06a3d0 msgr2=0x7ff10c06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.565+0000 7ff111989640 1 -- 172.21.15.132:0/2679873034 shutdown_connections 2023-12-20T04:44:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.565+0000 7ff111989640 1 -- 172.21.15.132:0/2679873034 wait complete. 2023-12-20T04:44:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.566+0000 7ff111989640 1 Processor -- start 2023-12-20T04:44:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.566+0000 7ff111989640 1 -- start start 2023-12-20T04:44:58.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.566+0000 7ff111989640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff10c0cfea0 0x7ff10c147b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:58.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.566+0000 7ff111989640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0d17d0 0x7ff10c148430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:58.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.566+0000 7ff111989640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff10c15d300 0x7ff10c0c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:58.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.566+0000 7ff111989640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c0c8a40 con 0x7ff10c0d17d0 2023-12-20T04:44:58.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.566+0000 7ff111989640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c157820 con 0x7ff10c15d300 2023-12-20T04:44:58.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.566+0000 7ff111989640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff10c0c7e50 con 0x7ff10c0cfea0 2023-12-20T04:44:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.566+0000 7ff103fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0d17d0 0x7ff10c148430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.567+0000 7ff103fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0d17d0 0x7ff10c148430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48554/0 (socket says 172.21.15.132:48554) 2023-12-20T04:44:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.567+0000 7ff103fff640 1 -- 172.21.15.132:0/1640074721 learned_addr learned my addr 172.21.15.132:0/1640074721 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.567+0000 7ff10affd640 1 --2- 172.21.15.132:0/1640074721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff10c0cfea0 0x7ff10c147b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.567+0000 7ff10b7fe640 1 --2- 172.21.15.132:0/1640074721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff10c15d300 0x7ff10c0c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.567+0000 7ff103fff640 1 -- 172.21.15.132:0/1640074721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff10c0cfea0 msgr2=0x7ff10c147b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.567+0000 7ff103fff640 1 --2- 172.21.15.132:0/1640074721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff10c0cfea0 0x7ff10c147b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.567+0000 7ff103fff640 1 -- 172.21.15.132:0/1640074721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff10c15d300 msgr2=0x7ff10c0c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.567+0000 7ff103fff640 1 --2- 172.21.15.132:0/1640074721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff10c15d300 0x7ff10c0c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.567+0000 7ff103fff640 1 -- 172.21.15.132:0/1640074721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff104009a70 con 0x7ff10c0d17d0 2023-12-20T04:44:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.567+0000 7ff10affd640 1 --2- 172.21.15.132:0/1640074721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff10c0cfea0 0x7ff10c147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.567+0000 7ff103fff640 1 --2- 172.21.15.132:0/1640074721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0d17d0 0x7ff10c148430 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400c4e0 tx=0x7ff0f400c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.567+0000 7ff108ff9640 1 -- 172.21.15.132:0/1640074721 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f40074e0 con 0x7ff10c0d17d0 2023-12-20T04:44:58.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.567+0000 7ff108ff9640 1 -- 172.21.15.132:0/1640074721 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0f4007660 con 0x7ff10c0d17d0 2023-12-20T04:44:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.567+0000 7ff108ff9640 1 -- 172.21.15.132:0/1640074721 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0f4004a20 con 0x7ff10c0d17d0 2023-12-20T04:44:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.567+0000 7ff111989640 1 -- 172.21.15.132:0/1640074721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff10c0c8110 con 0x7ff10c0d17d0 2023-12-20T04:44:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.567+0000 7ff111989640 1 -- 172.21.15.132:0/1640074721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff10c0c86d0 con 0x7ff10c0d17d0 2023-12-20T04:44:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.568+0000 7ff111989640 1 -- 172.21.15.132:0/1640074721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff10c04e840 con 0x7ff10c0d17d0 2023-12-20T04:44:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.569+0000 7ff108ff9640 1 -- 172.21.15.132:0/1640074721 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff0f4004b80 con 0x7ff10c0d17d0 2023-12-20T04:44:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.569+0000 7ff108ff9640 1 --2- 172.21.15.132:0/1640074721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0ec06a460 0x7ff0ec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:58.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.569+0000 7ff108ff9640 1 -- 172.21.15.132:0/1640074721 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5853+0+0 (secure 0 0 0) 0x7ff0f4087b70 con 0x7ff10c0d17d0 2023-12-20T04:44:58.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.569+0000 7ff10affd640 1 --2- 172.21.15.132:0/1640074721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0ec06a460 0x7ff0ec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:58.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.570+0000 7ff10affd640 1 --2- 172.21.15.132:0/1640074721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0ec06a460 0x7ff0ec06c920 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00a990 tx=0x7ff0fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:58.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.574+0000 7ff108ff9640 1 -- 172.21.15.132:0/1640074721 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff0f4053240 con 0x7ff10c0d17d0 2023-12-20T04:44:58.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:58.775+0000 7ff111989640 1 -- 172.21.15.132:0/1640074721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7ff10c15c5a0 con 0x7ff10c0d17d0 2023-12-20T04:44:59.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.446+0000 7ff108ff9640 1 -- 172.21.15.132:0/1640074721 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7ff0f4018020 con 0x7ff10c0d17d0 2023-12-20T04:44:59.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.449+0000 7ff111989640 1 -- 172.21.15.132:0/1640074721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0ec06a460 msgr2=0x7ff0ec06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:59.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.449+0000 7ff111989640 1 --2- 172.21.15.132:0/1640074721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0ec06a460 0x7ff0ec06c920 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7ff0fc00a990 tx=0x7ff0fc008040 comp rx=0 tx=0).stop 2023-12-20T04:44:59.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.449+0000 7ff111989640 1 -- 172.21.15.132:0/1640074721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0d17d0 msgr2=0x7ff10c148430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:59.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.449+0000 7ff111989640 1 --2- 172.21.15.132:0/1640074721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0d17d0 0x7ff10c148430 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7ff0f400c4e0 tx=0x7ff0f400c9a0 comp rx=0 tx=0).stop 2023-12-20T04:44:59.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.449+0000 7ff111989640 1 -- 172.21.15.132:0/1640074721 shutdown_connections 2023-12-20T04:44:59.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.449+0000 7ff111989640 1 --2- 172.21.15.132:0/1640074721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0ec06a460 0x7ff0ec06c920 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:59.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.449+0000 7ff111989640 1 --2- 172.21.15.132:0/1640074721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff10c15d300 0x7ff10c0c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:59.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.449+0000 7ff111989640 1 --2- 172.21.15.132:0/1640074721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff10c0d17d0 0x7ff10c148430 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:59.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.449+0000 7ff111989640 1 --2- 172.21.15.132:0/1640074721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff10c0cfea0 0x7ff10c147b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:59.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.449+0000 7ff111989640 1 -- 172.21.15.132:0/1640074721 >> 172.21.15.132:0/1640074721 conn(0x7ff10c06a3d0 msgr2=0x7ff10c0cdb70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:59.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.449+0000 7ff111989640 1 -- 172.21.15.132:0/1640074721 shutdown_connections 2023-12-20T04:44:59.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.449+0000 7ff111989640 1 -- 172.21.15.132:0/1640074721 wait complete. 2023-12-20T04:44:59.463 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-20T04:44:59.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.609+0000 7fbd23963640 1 Processor -- start 2023-12-20T04:44:59.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.610+0000 7fbd23963640 1 -- start start 2023-12-20T04:44:59.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.610+0000 7fbd23963640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbd1c15d220 0x7fbd1c06afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:59.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.610+0000 7fbd23963640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd1c06bdd0 0x7fbd1c06dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:59.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.610+0000 7fbd23963640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd1c0d1b80 con 0x7fbd1c0cfab0 2023-12-20T04:44:59.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.610+0000 7fbd23963640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd1c15d600 con 0x7fbd1c15d220 2023-12-20T04:44:59.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.610+0000 7fbd23963640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0d0020 con 0x7fbd1c06bdd0 2023-12-20T04:44:59.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.611+0000 7fbd216ff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbd1c15d220 0x7fbd1c06afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:59.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.611+0000 7fbd20efe640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fbd1c0cfab0 0x7fbd1c06b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:35786/0 (socket says 172.21.15.132:35786) 2023-12-20T04:44:59.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.611+0000 7fbd21f00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd1c06bdd0 0x7fbd1c06dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:59.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.611+0000 7fbd20efe640 1 -- 172.21.15.132:0/3512860311 learned_addr learned my addr 172.21.15.132:0/3512860311 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:44:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.611+0000 7fbd13fff640 1 -- 172.21.15.132:0/3512860311 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586250277 0 0) 0x7fbd1c0d1b80 con 0x7fbd1c0cfab0 2023-12-20T04:44:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.611+0000 7fbd13fff640 1 -- 172.21.15.132:0/3512860311 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd08003520 con 0x7fbd1c0cfab0 2023-12-20T04:44:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.611+0000 7fbd216ff640 1 -- 172.21.15.132:0/3512860311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd1c06bdd0 msgr2=0x7fbd1c06dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:44:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.611+0000 7fbd216ff640 1 --2- 172.21.15.132:0/3512860311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd1c06bdd0 0x7fbd1c06dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.611+0000 7fbd216ff640 1 -- 172.21.15.132:0/3512860311 >> v1:172.21.15.187:6789/0 conn(0x7fbd1c0cfab0 legacy=0x7fbd1c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.611+0000 7fbd216ff640 1 -- 172.21.15.132:0/3512860311 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd1c0d0300 con 0x7fbd1c15d220 2023-12-20T04:44:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.611+0000 7fbd21f00640 1 --2- 172.21.15.132:0/3512860311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd1c06bdd0 0x7fbd1c06dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:44:59.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.612+0000 7fbd216ff640 1 --2- 172.21.15.132:0/3512860311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd1c15d220 0x7fbd1c06afe0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009790 tx=0x7fbd1802b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a7f1a89bb52508e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:59.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.612+0000 7fbd13fff640 1 -- 172.21.15.132:0/3512860311 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18031770 con 0x7fbd1c15d220 2023-12-20T04:44:59.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.612+0000 7fbd13fff640 1 -- 172.21.15.132:0/3512860311 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd180318d0 con 0x7fbd1c15d220 2023-12-20T04:44:59.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.612+0000 7fbd13fff640 1 -- 172.21.15.132:0/3512860311 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18031c60 con 0x7fbd1c15d220 2023-12-20T04:44:59.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.613+0000 7fbd23963640 1 -- 172.21.15.132:0/3512860311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd1c15d220 msgr2=0x7fbd1c06afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:59.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.613+0000 7fbd23963640 1 --2- 172.21.15.132:0/3512860311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd1c15d220 0x7fbd1c06afe0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fbd18009790 tx=0x7fbd1802b810 comp rx=0 tx=0).stop 2023-12-20T04:44:59.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.613+0000 7fbd23963640 1 -- 172.21.15.132:0/3512860311 shutdown_connections 2023-12-20T04:44:59.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.613+0000 7fbd23963640 1 --2- 172.21.15.132:0/3512860311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd1c06bdd0 0x7fbd1c06dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:59.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.613+0000 7fbd23963640 1 --2- 172.21.15.132:0/3512860311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd1c15d220 0x7fbd1c06afe0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:59.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.613+0000 7fbd23963640 1 -- 172.21.15.132:0/3512860311 >> 172.21.15.132:0/3512860311 conn(0x7fbd1c099fa0 msgr2=0x7fbd1c0d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:44:59.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.613+0000 7fbd23963640 1 -- 172.21.15.132:0/3512860311 shutdown_connections 2023-12-20T04:44:59.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.613+0000 7fbd23963640 1 -- 172.21.15.132:0/3512860311 wait complete. 2023-12-20T04:44:59.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.614+0000 7fbd23963640 1 Processor -- start 2023-12-20T04:44:59.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.614+0000 7fbd23963640 1 -- start start 2023-12-20T04:44:59.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd23963640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd1c06bdd0 0x7fbd1c0cda60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:59.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd23963640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd1c0cfab0 0x7fbd1c1f2090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd23963640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd1c15d220 0x7fbd1c06ad20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd23963640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c1f5e40 con 0x7fbd1c06bdd0 2023-12-20T04:44:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd23963640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c1f66e0 con 0x7fbd1c0cfab0 2023-12-20T04:44:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd23963640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd1c0cdfa0 con 0x7fbd1c15d220 2023-12-20T04:44:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd216ff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd1c06bdd0 0x7fbd1c0cda60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd216ff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd1c06bdd0 0x7fbd1c0cda60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48568/0 (socket says 172.21.15.132:48568) 2023-12-20T04:44:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd216ff640 1 -- 172.21.15.132:0/3930029026 learned_addr learned my addr 172.21.15.132:0/3930029026 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:44:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd20efe640 1 --2- 172.21.15.132:0/3930029026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd1c0cfab0 0x7fbd1c1f2090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd21f00640 1 --2- 172.21.15.132:0/3930029026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd1c15d220 0x7fbd1c06ad20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd216ff640 1 -- 172.21.15.132:0/3930029026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd1c15d220 msgr2=0x7fbd1c06ad20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd216ff640 1 --2- 172.21.15.132:0/3930029026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd1c15d220 0x7fbd1c06ad20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd216ff640 1 -- 172.21.15.132:0/3930029026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd1c0cfab0 msgr2=0x7fbd1c1f2090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:44:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd216ff640 1 --2- 172.21.15.132:0/3930029026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd1c0cfab0 0x7fbd1c1f2090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:44:59.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd216ff640 1 -- 172.21.15.132:0/3930029026 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd14009a70 con 0x7fbd1c06bdd0 2023-12-20T04:44:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd20efe640 1 --2- 172.21.15.132:0/3930029026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd1c0cfab0 0x7fbd1c1f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:44:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd216ff640 1 --2- 172.21.15.132:0/3930029026 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd1c06bdd0 0x7fbd1c0cda60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fbd180098b0 tx=0x7fbd180046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd11ffb640 1 -- 172.21.15.132:0/3930029026 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18032610 con 0x7fbd1c06bdd0 2023-12-20T04:44:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd11ffb640 1 -- 172.21.15.132:0/3930029026 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd18032770 con 0x7fbd1c06bdd0 2023-12-20T04:44:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd23963640 1 -- 172.21.15.132:0/3930029026 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd180093a0 con 0x7fbd1c06bdd0 2023-12-20T04:44:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.615+0000 7fbd11ffb640 1 -- 172.21.15.132:0/3930029026 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd18032b00 con 0x7fbd1c06bdd0 2023-12-20T04:44:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.616+0000 7fbd23963640 1 -- 172.21.15.132:0/3930029026 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd1c1f6090 con 0x7fbd1c06bdd0 2023-12-20T04:44:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.616+0000 7fbd23963640 1 -- 172.21.15.132:0/3930029026 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd1c04e840 con 0x7fbd1c06bdd0 2023-12-20T04:44:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.617+0000 7fbd11ffb640 1 -- 172.21.15.132:0/3930029026 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbd18032c60 con 0x7fbd1c06bdd0 2023-12-20T04:44:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.617+0000 7fbd11ffb640 1 --2- 172.21.15.132:0/3930029026 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd0006a430 0x7fbd0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:44:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.617+0000 7fbd20efe640 1 --2- 172.21.15.132:0/3930029026 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd0006a430 0x7fbd0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:44:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.617+0000 7fbd11ffb640 1 -- 172.21.15.132:0/3930029026 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(54..54 src has 1..54) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fbd180aa9a0 con 0x7fbd1c06bdd0 2023-12-20T04:44:59.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.618+0000 7fbd20efe640 1 --2- 172.21.15.132:0/3930029026 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd0006a430 0x7fbd0006c8f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0ccae0 tx=0x7fbd0c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:44:59.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.622+0000 7fbd11ffb640 1 -- 172.21.15.132:0/3930029026 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbd180760b0 con 0x7fbd1c06bdd0 2023-12-20T04:44:59.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:44:59.788+0000 7fbd23963640 1 -- 172.21.15.132:0/3930029026 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fbd1c0ce390 con 0x7fbd1c06bdd0 2023-12-20T04:45:00.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.451+0000 7fbd11ffb640 1 -- 172.21.15.132:0/3930029026 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v55) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbd180796d0 con 0x7fbd1c06bdd0 2023-12-20T04:45:00.453 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2023-12-20T04:45:00.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.453+0000 7fbd23963640 1 -- 172.21.15.132:0/3930029026 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd0006a430 msgr2=0x7fbd0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:00.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.453+0000 7fbd23963640 1 --2- 172.21.15.132:0/3930029026 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd0006a430 0x7fbd0006c8f0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fbd1c0ccae0 tx=0x7fbd0c009040 comp rx=0 tx=0).stop 2023-12-20T04:45:00.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.453+0000 7fbd23963640 1 -- 172.21.15.132:0/3930029026 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd1c06bdd0 msgr2=0x7fbd1c0cda60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:00.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.453+0000 7fbd23963640 1 --2- 172.21.15.132:0/3930029026 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd1c06bdd0 0x7fbd1c0cda60 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7fbd180098b0 tx=0x7fbd180046c0 comp rx=0 tx=0).stop 2023-12-20T04:45:00.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.454+0000 7fbd23963640 1 -- 172.21.15.132:0/3930029026 shutdown_connections 2023-12-20T04:45:00.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.454+0000 7fbd23963640 1 --2- 172.21.15.132:0/3930029026 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd0006a430 0x7fbd0006c8f0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:00.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.454+0000 7fbd23963640 1 --2- 172.21.15.132:0/3930029026 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd1c15d220 0x7fbd1c06ad20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:00.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.454+0000 7fbd23963640 1 --2- 172.21.15.132:0/3930029026 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd1c0cfab0 0x7fbd1c1f2090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:00.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.454+0000 7fbd23963640 1 --2- 172.21.15.132:0/3930029026 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd1c06bdd0 0x7fbd1c0cda60 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:00.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.454+0000 7fbd23963640 1 -- 172.21.15.132:0/3930029026 >> 172.21.15.132:0/3930029026 conn(0x7fbd1c099fa0 msgr2=0x7fbd1c0af810 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:00.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.454+0000 7fbd23963640 1 -- 172.21.15.132:0/3930029026 shutdown_connections 2023-12-20T04:45:00.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.454+0000 7fbd23963640 1 -- 172.21.15.132:0/3930029026 wait complete. 2023-12-20T04:45:00.468 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-20T04:45:00.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.574+0000 7fe0ca442640 1 Processor -- start 2023-12-20T04:45:00.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.574+0000 7fe0ca442640 1 -- start start 2023-12-20T04:45:00.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0ca442640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0c406eba0 0x7fe0c40cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:00.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0ca442640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe0c40cea10 0x7fe0c40cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:00.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0ca442640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0c40d1b80 con 0x7fe0c40cf630 2023-12-20T04:45:00.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0ca442640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0c40cc660 con 0x7fe0c40cea10 2023-12-20T04:45:00.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0ca442640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c40cfaa0 con 0x7fe0c406eba0 2023-12-20T04:45:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0c89df640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe0c40cf630 0x7fe0c415a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52488/0 (socket says 172.21.15.132:52488) 2023-12-20T04:45:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0c89df640 1 -- 172.21.15.132:0/1699806793 learned_addr learned my addr 172.21.15.132:0/1699806793 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:45:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0c3fff640 1 --2- 172.21.15.132:0/1699806793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0c406eba0 0x7fe0c40cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0c37fe640 1 --2- 172.21.15.132:0/1699806793 >> v2:172.21.15.187:3300/0 conn(0x7fe0c40cea10 0x7fe0c40cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0c2ffd640 1 -- 172.21.15.132:0/1699806793 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1829840856 0 0) 0x7fe0c40d1b80 con 0x7fe0c40cf630 2023-12-20T04:45:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0c2ffd640 1 -- 172.21.15.132:0/1699806793 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe0b0003520 con 0x7fe0c40cf630 2023-12-20T04:45:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0c2ffd640 1 -- 172.21.15.132:0/1699806793 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2621433640 0 0) 0x7fe0b0003520 con 0x7fe0c40cf630 2023-12-20T04:45:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0c2ffd640 1 -- 172.21.15.132:0/1699806793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0c406eba0 msgr2=0x7fe0c40cdde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0c2ffd640 1 --2- 172.21.15.132:0/1699806793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0c406eba0 0x7fe0c40cdde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0c2ffd640 1 -- 172.21.15.132:0/1699806793 >> v2:172.21.15.187:3300/0 conn(0x7fe0c40cea10 msgr2=0x7fe0c40cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0c2ffd640 1 --2- 172.21.15.132:0/1699806793 >> v2:172.21.15.187:3300/0 conn(0x7fe0c40cea10 0x7fe0c40cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:00.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0c2ffd640 1 -- 172.21.15.132:0/1699806793 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c406e230 con 0x7fe0c40cf630 2023-12-20T04:45:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0c2ffd640 1 -- 172.21.15.132:0/1699806793 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fe0bc0019f0 con 0x7fe0c40cf630 2023-12-20T04:45:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.575+0000 7fe0c37fe640 1 --2- 172.21.15.132:0/1699806793 >> v2:172.21.15.187:3300/0 conn(0x7fe0c40cea10 0x7fe0c40cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:45:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.576+0000 7fe0c2ffd640 1 -- 172.21.15.132:0/1699806793 >> v1:172.21.15.132:6789/0 conn(0x7fe0c40cf630 legacy=0x7fe0c415a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.576+0000 7fe0c2ffd640 1 --2- 172.21.15.132:0/1699806793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0b00039a0 0x7fe0b0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.576+0000 7fe0c2ffd640 1 --2- 172.21.15.132:0/1699806793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0b00047c0 0x7fe0b0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.576+0000 7fe0c2ffd640 1 --2- 172.21.15.132:0/1699806793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0c406eba0 0x7fe0b0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.576+0000 7fe0c2ffd640 1 -- 172.21.15.132:0/1699806793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c40cc660 con 0x7fe0b00039a0 2023-12-20T04:45:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.576+0000 7fe0c2ffd640 1 -- 172.21.15.132:0/1699806793 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c40cfaa0 con 0x7fe0b00047c0 2023-12-20T04:45:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.576+0000 7fe0c2ffd640 1 -- 172.21.15.132:0/1699806793 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0b000fdc0 con 0x7fe0c406eba0 2023-12-20T04:45:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.576+0000 7fe0c3fff640 1 --2- 172.21.15.132:0/1699806793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0b00039a0 0x7fe0b0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:00.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.576+0000 7fe0c37fe640 1 --2- 172.21.15.132:0/1699806793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0b00047c0 0x7fe0b0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.576+0000 7fe0c89df640 1 --2- 172.21.15.132:0/1699806793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0c406eba0 0x7fe0b0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.576+0000 7fe0c3fff640 1 -- 172.21.15.132:0/1699806793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0c406eba0 msgr2=0x7fe0b0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.576+0000 7fe0c3fff640 1 --2- 172.21.15.132:0/1699806793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0c406eba0 0x7fe0b0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.576+0000 7fe0c3fff640 1 -- 172.21.15.132:0/1699806793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0b00047c0 msgr2=0x7fe0b0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.576+0000 7fe0c3fff640 1 --2- 172.21.15.132:0/1699806793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0b00047c0 0x7fe0b0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.576+0000 7fe0c3fff640 1 -- 172.21.15.132:0/1699806793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0b0003520 con 0x7fe0b00039a0 2023-12-20T04:45:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.576+0000 7fe0c89df640 1 --2- 172.21.15.132:0/1699806793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0c406eba0 0x7fe0b0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:45:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.577+0000 7fe0c3fff640 1 --2- 172.21.15.132:0/1699806793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0b00039a0 0x7fe0b0003dc0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4009ab0 tx=0x7fe0b00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bafed61475549cd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.577+0000 7fe0c2ffd640 1 -- 172.21.15.132:0/1699806793 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4005990 con 0x7fe0b00039a0 2023-12-20T04:45:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.577+0000 7fe0c2ffd640 1 -- 172.21.15.132:0/1699806793 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0b4005af0 con 0x7fe0b00039a0 2023-12-20T04:45:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.577+0000 7fe0c2ffd640 1 -- 172.21.15.132:0/1699806793 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0b4005ea0 con 0x7fe0b00039a0 2023-12-20T04:45:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.577+0000 7fe0ca442640 1 -- 172.21.15.132:0/1699806793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0b00039a0 msgr2=0x7fe0b0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:00.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.577+0000 7fe0ca442640 1 --2- 172.21.15.132:0/1699806793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0b00039a0 0x7fe0b0003dc0 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4009ab0 tx=0x7fe0b00057f0 comp rx=0 tx=0).stop 2023-12-20T04:45:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.577+0000 7fe0c89df640 1 -- 172.21.15.132:0/1699806793 reap_dead start 2023-12-20T04:45:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.577+0000 7fe0ca442640 1 -- 172.21.15.132:0/1699806793 shutdown_connections 2023-12-20T04:45:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.577+0000 7fe0ca442640 1 -- 172.21.15.132:0/1699806793 >> 172.21.15.132:0/1699806793 conn(0x7fe0c4099fa0 msgr2=0x7fe0c40d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.577+0000 7fe0ca442640 1 -- 172.21.15.132:0/1699806793 shutdown_connections 2023-12-20T04:45:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.577+0000 7fe0ca442640 1 -- 172.21.15.132:0/1699806793 wait complete. 2023-12-20T04:45:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.578+0000 7fe0ca442640 1 Processor -- start 2023-12-20T04:45:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.579+0000 7fe0ca442640 1 -- start start 2023-12-20T04:45:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.579+0000 7fe0ca442640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0b00039a0 0x7fe0c414d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.579+0000 7fe0ca442640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0c415dd00 0x7fe0c415e180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.579+0000 7fe0ca442640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c40c6c00 0x7fe0c40c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:00.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.579+0000 7fe0ca442640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c415e6c0 con 0x7fe0c40c6c00 2023-12-20T04:45:00.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.579+0000 7fe0ca442640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c40b12c0 con 0x7fe0b00039a0 2023-12-20T04:45:00.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.579+0000 7fe0ca442640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0c40b0220 con 0x7fe0c415dd00 2023-12-20T04:45:00.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.579+0000 7fe0c89df640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c40c6c00 0x7fe0c40c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:00.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.579+0000 7fe0c89df640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c40c6c00 0x7fe0c40c7080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48576/0 (socket says 172.21.15.132:48576) 2023-12-20T04:45:00.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.579+0000 7fe0c89df640 1 -- 172.21.15.132:0/4161861825 learned_addr learned my addr 172.21.15.132:0/4161861825 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:00.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.580+0000 7fe0c3fff640 1 --2- 172.21.15.132:0/4161861825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0b00039a0 0x7fe0c414d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:00.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.580+0000 7fe0c37fe640 1 --2- 172.21.15.132:0/4161861825 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0c415dd00 0x7fe0c415e180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:00.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.580+0000 7fe0c89df640 1 -- 172.21.15.132:0/4161861825 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0c415dd00 msgr2=0x7fe0c415e180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:00.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.580+0000 7fe0c89df640 1 --2- 172.21.15.132:0/4161861825 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0c415dd00 0x7fe0c415e180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:00.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.580+0000 7fe0c89df640 1 -- 172.21.15.132:0/4161861825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0b00039a0 msgr2=0x7fe0c414d000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:00.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.580+0000 7fe0c89df640 1 --2- 172.21.15.132:0/4161861825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0b00039a0 0x7fe0c414d000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:00.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.580+0000 7fe0c89df640 1 -- 172.21.15.132:0/4161861825 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0c40b0500 con 0x7fe0c40c6c00 2023-12-20T04:45:00.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.580+0000 7fe0c89df640 1 --2- 172.21.15.132:0/4161861825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c40c6c00 0x7fe0c40c7080 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc001ec0 tx=0x7fe0bc00e530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:00.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.580+0000 7fe0c0ff9640 1 -- 172.21.15.132:0/4161861825 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc007ae0 con 0x7fe0c40c6c00 2023-12-20T04:45:00.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.580+0000 7fe0c0ff9640 1 -- 172.21.15.132:0/4161861825 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0bc00eda0 con 0x7fe0c40c6c00 2023-12-20T04:45:00.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.580+0000 7fe0ca442640 1 -- 172.21.15.132:0/4161861825 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0c40b07e0 con 0x7fe0c40c6c00 2023-12-20T04:45:00.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.580+0000 7fe0c0ff9640 1 -- 172.21.15.132:0/4161861825 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe0bc013680 con 0x7fe0c40c6c00 2023-12-20T04:45:00.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.580+0000 7fe0ca442640 1 -- 172.21.15.132:0/4161861825 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0c40b0da0 con 0x7fe0c40c6c00 2023-12-20T04:45:00.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.581+0000 7fe0ca442640 1 -- 172.21.15.132:0/4161861825 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0c40b0fc0 con 0x7fe0c40c6c00 2023-12-20T04:45:00.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.582+0000 7fe0c0ff9640 1 -- 172.21.15.132:0/4161861825 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe0bc0137e0 con 0x7fe0c40c6c00 2023-12-20T04:45:00.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.582+0000 7fe0c0ff9640 1 --2- 172.21.15.132:0/4161861825 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe0a406a430 0x7fe0a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:00.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.582+0000 7fe0c3fff640 1 --2- 172.21.15.132:0/4161861825 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe0a406a430 0x7fe0a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:00.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.582+0000 7fe0c0ff9640 1 -- 172.21.15.132:0/4161861825 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(55..55 src has 1..55) v4 ==== 5415+0+0 (secure 0 0 0) 0x7fe0bc088a50 con 0x7fe0c40c6c00 2023-12-20T04:45:00.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.583+0000 7fe0c3fff640 1 --2- 172.21.15.132:0/4161861825 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe0a406a430 0x7fe0a406c8f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4035000 tx=0x7fe0b4030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:00.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.587+0000 7fe0c0ff9640 1 -- 172.21.15.132:0/4161861825 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe0bc0542a0 con 0x7fe0c40c6c00 2023-12-20T04:45:00.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:00.750+0000 7fe0ca442640 1 -- 172.21.15.132:0/4161861825 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fe0c40b0fc0 con 0x7fe0c40c6c00 2023-12-20T04:45:01.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.456+0000 7fe0c0ff9640 1 -- 172.21.15.132:0/4161861825 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v56) v1 ==== 169+0+0 (secure 0 0 0) 0x7fe0bc0578c0 con 0x7fe0c40c6c00 2023-12-20T04:45:01.458 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2023-12-20T04:45:01.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.460+0000 7fe0ca442640 1 -- 172.21.15.132:0/4161861825 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe0a406a430 msgr2=0x7fe0a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:01.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.460+0000 7fe0ca442640 1 --2- 172.21.15.132:0/4161861825 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe0a406a430 0x7fe0a406c8f0 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fe0b4035000 tx=0x7fe0b4030000 comp rx=0 tx=0).stop 2023-12-20T04:45:01.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.460+0000 7fe0ca442640 1 -- 172.21.15.132:0/4161861825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c40c6c00 msgr2=0x7fe0c40c7080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:01.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.460+0000 7fe0ca442640 1 --2- 172.21.15.132:0/4161861825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c40c6c00 0x7fe0c40c7080 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7fe0bc001ec0 tx=0x7fe0bc00e530 comp rx=0 tx=0).stop 2023-12-20T04:45:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.460+0000 7fe0ca442640 1 -- 172.21.15.132:0/4161861825 shutdown_connections 2023-12-20T04:45:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.460+0000 7fe0ca442640 1 --2- 172.21.15.132:0/4161861825 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe0a406a430 0x7fe0a406c8f0 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.460+0000 7fe0ca442640 1 --2- 172.21.15.132:0/4161861825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0c40c6c00 0x7fe0c40c7080 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.460+0000 7fe0ca442640 1 --2- 172.21.15.132:0/4161861825 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0c415dd00 0x7fe0c415e180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.460+0000 7fe0ca442640 1 --2- 172.21.15.132:0/4161861825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0b00039a0 0x7fe0c414d000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.460+0000 7fe0ca442640 1 -- 172.21.15.132:0/4161861825 >> 172.21.15.132:0/4161861825 conn(0x7fe0c4099fa0 msgr2=0x7fe0c40c9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.461+0000 7fe0ca442640 1 -- 172.21.15.132:0/4161861825 shutdown_connections 2023-12-20T04:45:01.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.461+0000 7fe0ca442640 1 -- 172.21.15.132:0/4161861825 wait complete. 2023-12-20T04:45:01.475 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-20T04:45:01.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.576+0000 7fb103d55640 1 Processor -- start 2023-12-20T04:45:01.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.577+0000 7fb103d55640 1 -- start start 2023-12-20T04:45:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.577+0000 7fb103d55640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0fc0cf880 0x7fb0fc0cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.577+0000 7fb103d55640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0fc0d0220 con 0x7fb0fc15d300 2023-12-20T04:45:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.577+0000 7fb103d55640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb0fc0d1a90 con 0x7fb0fc0b60e0 2023-12-20T04:45:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.577+0000 7fb103d55640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0d1d70 con 0x7fb0fc0cf880 2023-12-20T04:45:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb101af1640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb0fc15d300 0x7fb0fc0d1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52490/0 (socket says 172.21.15.132:52490) 2023-12-20T04:45:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb101af1640 1 -- 172.21.15.132:0/1252100573 learned_addr learned my addr 172.21.15.132:0/1252100573 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:45:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb100aef640 1 -- 172.21.15.132:0/1252100573 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4000725559 0 0) 0x7fb0fc0d0220 con 0x7fb0fc15d300 2023-12-20T04:45:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb1012f0640 1 --2- 172.21.15.132:0/1252100573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0fc0cf880 0x7fb0fc0cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb100aef640 1 -- 172.21.15.132:0/1252100573 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb0e8003520 con 0x7fb0fc15d300 2023-12-20T04:45:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb100aef640 1 -- 172.21.15.132:0/1252100573 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2357232842 0 0) 0x7fb0e8003520 con 0x7fb0fc15d300 2023-12-20T04:45:01.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb100aef640 1 -- 172.21.15.132:0/1252100573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0fc0cf880 msgr2=0x7fb0fc0cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb100aef640 1 --2- 172.21.15.132:0/1252100573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0fc0cf880 0x7fb0fc0cfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb100aef640 1 -- 172.21.15.132:0/1252100573 >> v1:172.21.15.187:6789/0 conn(0x7fb0fc0b60e0 legacy=0x7fb0fc0b6530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb100aef640 1 -- 172.21.15.132:0/1252100573 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc0d2050 con 0x7fb0fc15d300 2023-12-20T04:45:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb100aef640 1 -- 172.21.15.132:0/1252100573 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fb0f8001670 con 0x7fb0fc15d300 2023-12-20T04:45:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb100aef640 1 -- 172.21.15.132:0/1252100573 >> v1:172.21.15.132:6789/0 conn(0x7fb0fc15d300 legacy=0x7fb0fc0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb100aef640 1 --2- 172.21.15.132:0/1252100573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0e80039a0 0x7fb0e8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb100aef640 1 --2- 172.21.15.132:0/1252100573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0fc0cf880 0x7fb0e80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb100aef640 1 --2- 172.21.15.132:0/1252100573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0e8004d00 0x7fb0e8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb100aef640 1 -- 172.21.15.132:0/1252100573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0d1d70 con 0x7fb0e8004d00 2023-12-20T04:45:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb100aef640 1 -- 172.21.15.132:0/1252100573 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e800ba60 con 0x7fb0e80039a0 2023-12-20T04:45:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb100aef640 1 -- 172.21.15.132:0/1252100573 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0e800bc20 con 0x7fb0fc0cf880 2023-12-20T04:45:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb1022f2640 1 --2- 172.21.15.132:0/1252100573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0e8004d00 0x7fb0e8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb101af1640 1 --2- 172.21.15.132:0/1252100573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0e80039a0 0x7fb0e8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.578+0000 7fb1012f0640 1 --2- 172.21.15.132:0/1252100573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0fc0cf880 0x7fb0e80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.579+0000 7fb1022f2640 1 -- 172.21.15.132:0/1252100573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0fc0cf880 msgr2=0x7fb0e80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.579+0000 7fb1022f2640 1 --2- 172.21.15.132:0/1252100573 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0fc0cf880 0x7fb0e80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.579+0000 7fb1022f2640 1 -- 172.21.15.132:0/1252100573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0e80039a0 msgr2=0x7fb0e8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.579+0000 7fb1022f2640 1 --2- 172.21.15.132:0/1252100573 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0e80039a0 0x7fb0e8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.579+0000 7fb1022f2640 1 -- 172.21.15.132:0/1252100573 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0e8003520 con 0x7fb0e8004d00 2023-12-20T04:45:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.579+0000 7fb1022f2640 1 --2- 172.21.15.132:0/1252100573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0e8004d00 0x7fb0e8005180 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4001e20 tx=0x7fb0e80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56952c4e5ccc599a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.579+0000 7fb100aef640 1 -- 172.21.15.132:0/1252100573 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4003b70 con 0x7fb0e8004d00 2023-12-20T04:45:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.579+0000 7fb100aef640 1 -- 172.21.15.132:0/1252100573 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f4003cd0 con 0x7fb0e8004d00 2023-12-20T04:45:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.579+0000 7fb100aef640 1 -- 172.21.15.132:0/1252100573 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4005310 con 0x7fb0e8004d00 2023-12-20T04:45:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.580+0000 7fb103d55640 1 -- 172.21.15.132:0/1252100573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0e8004d00 msgr2=0x7fb0e8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.580+0000 7fb103d55640 1 --2- 172.21.15.132:0/1252100573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0e8004d00 0x7fb0e8005180 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4001e20 tx=0x7fb0e80057f0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.580+0000 7fb1022f2640 1 -- 172.21.15.132:0/1252100573 reap_dead start 2023-12-20T04:45:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.580+0000 7fb103d55640 1 -- 172.21.15.132:0/1252100573 shutdown_connections 2023-12-20T04:45:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.580+0000 7fb103d55640 1 -- 172.21.15.132:0/1252100573 >> 172.21.15.132:0/1252100573 conn(0x7fb0fc06a3d0 msgr2=0x7fb0fc06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.580+0000 7fb103d55640 1 -- 172.21.15.132:0/1252100573 shutdown_connections 2023-12-20T04:45:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.580+0000 7fb103d55640 1 -- 172.21.15.132:0/1252100573 wait complete. 2023-12-20T04:45:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.581+0000 7fb103d55640 1 Processor -- start 2023-12-20T04:45:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.581+0000 7fb103d55640 1 -- start start 2023-12-20T04:45:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb103d55640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0e8004d00 0x7fb0fc15d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb103d55640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0fc0b4fd0 0x7fb0fc0c79f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb103d55640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0fc0b5410 0x7fb0fc0c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb103d55640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0cb510 con 0x7fb0fc0b5410 2023-12-20T04:45:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb103d55640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0cb7b0 con 0x7fb0e8004d00 2023-12-20T04:45:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb103d55640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb0fc0cba90 con 0x7fb0fc0b4fd0 2023-12-20T04:45:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb1022f2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0fc0b5410 0x7fb0fc0c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb1022f2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0fc0b5410 0x7fb0fc0c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48594/0 (socket says 172.21.15.132:48594) 2023-12-20T04:45:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb1022f2640 1 -- 172.21.15.132:0/2799838102 learned_addr learned my addr 172.21.15.132:0/2799838102 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb101af1640 1 --2- 172.21.15.132:0/2799838102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0e8004d00 0x7fb0fc15d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb1012f0640 1 --2- 172.21.15.132:0/2799838102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0fc0b4fd0 0x7fb0fc0c79f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb1022f2640 1 -- 172.21.15.132:0/2799838102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0fc0b4fd0 msgr2=0x7fb0fc0c79f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb1022f2640 1 --2- 172.21.15.132:0/2799838102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0fc0b4fd0 0x7fb0fc0c79f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb1022f2640 1 -- 172.21.15.132:0/2799838102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0e8004d00 msgr2=0x7fb0fc15d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb1022f2640 1 --2- 172.21.15.132:0/2799838102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0e8004d00 0x7fb0fc15d6e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb1022f2640 1 -- 172.21.15.132:0/2799838102 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0fc0cbd70 con 0x7fb0fc0b5410 2023-12-20T04:45:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb1022f2640 1 --2- 172.21.15.132:0/2799838102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0fc0b5410 0x7fb0fc0c7f30 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4005040 tx=0x7fb0f40014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.582+0000 7fb0f27fc640 1 -- 172.21.15.132:0/2799838102 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f403e070 con 0x7fb0fc0b5410 2023-12-20T04:45:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.583+0000 7fb0f27fc640 1 -- 172.21.15.132:0/2799838102 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb0f4003e40 con 0x7fb0fc0b5410 2023-12-20T04:45:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.583+0000 7fb0f27fc640 1 -- 172.21.15.132:0/2799838102 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb0f4006d50 con 0x7fb0fc0b5410 2023-12-20T04:45:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.583+0000 7fb103d55640 1 -- 172.21.15.132:0/2799838102 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb0fc0cb510 con 0x7fb0fc0b5410 2023-12-20T04:45:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.583+0000 7fb103d55640 1 -- 172.21.15.132:0/2799838102 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0fc15dc20 con 0x7fb0fc0b5410 2023-12-20T04:45:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.584+0000 7fb103d55640 1 -- 172.21.15.132:0/2799838102 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb0fc0cbf60 con 0x7fb0fc0b5410 2023-12-20T04:45:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.584+0000 7fb0f27fc640 1 -- 172.21.15.132:0/2799838102 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb0f4007030 con 0x7fb0fc0b5410 2023-12-20T04:45:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.584+0000 7fb0f27fc640 1 --2- 172.21.15.132:0/2799838102 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb0e006a430 0x7fb0e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.585+0000 7fb101af1640 1 --2- 172.21.15.132:0/2799838102 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb0e006a430 0x7fb0e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.585+0000 7fb0f27fc640 1 -- 172.21.15.132:0/2799838102 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb0f40a9bf0 con 0x7fb0fc0b5410 2023-12-20T04:45:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.585+0000 7fb101af1640 1 --2- 172.21.15.132:0/2799838102 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb0e006a430 0x7fb0e006c8f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8007c60 tx=0x7fb0f8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.589+0000 7fb0f27fc640 1 -- 172.21.15.132:0/2799838102 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb0f40754e0 con 0x7fb0fc0b5410 2023-12-20T04:45:01.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.754+0000 7fb103d55640 1 -- 172.21.15.132:0/2799838102 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fb0fc04e840 con 0x7fb0fc0b5410 2023-12-20T04:45:01.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.757+0000 7fb0f27fc640 1 -- 172.21.15.132:0/2799838102 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v5) v1 ==== 104+0+0 (secure 0 0 0) 0x7fb0f4078b00 con 0x7fb0fc0b5410 2023-12-20T04:45:01.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.759+0000 7fb103d55640 1 -- 172.21.15.132:0/2799838102 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb0e006a430 msgr2=0x7fb0e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:01.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.759+0000 7fb103d55640 1 --2- 172.21.15.132:0/2799838102 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb0e006a430 0x7fb0e006c8f0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8007c60 tx=0x7fb0f8009040 comp rx=0 tx=0).stop 2023-12-20T04:45:01.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.759+0000 7fb103d55640 1 -- 172.21.15.132:0/2799838102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0fc0b5410 msgr2=0x7fb0fc0c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:01.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.759+0000 7fb103d55640 1 --2- 172.21.15.132:0/2799838102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0fc0b5410 0x7fb0fc0c7f30 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7fb0f4005040 tx=0x7fb0f40014a0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.759+0000 7fb103d55640 1 -- 172.21.15.132:0/2799838102 shutdown_connections 2023-12-20T04:45:01.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.759+0000 7fb103d55640 1 --2- 172.21.15.132:0/2799838102 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb0e006a430 0x7fb0e006c8f0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.759+0000 7fb103d55640 1 --2- 172.21.15.132:0/2799838102 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb0fc0b5410 0x7fb0fc0c7f30 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.759+0000 7fb103d55640 1 --2- 172.21.15.132:0/2799838102 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb0fc0b4fd0 0x7fb0fc0c79f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.759+0000 7fb103d55640 1 --2- 172.21.15.132:0/2799838102 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb0e8004d00 0x7fb0fc15d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.759+0000 7fb103d55640 1 -- 172.21.15.132:0/2799838102 >> 172.21.15.132:0/2799838102 conn(0x7fb0fc06a3d0 msgr2=0x7fb0fc154560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:01.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.760+0000 7fb103d55640 1 -- 172.21.15.132:0/2799838102 shutdown_connections 2023-12-20T04:45:01.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.760+0000 7fb103d55640 1 -- 172.21.15.132:0/2799838102 wait complete. 2023-12-20T04:45:01.772 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file' 2023-12-20T04:45:01.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.872+0000 7efde90ce640 1 Processor -- start 2023-12-20T04:45:01.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.872+0000 7efde90ce640 1 -- start start 2023-12-20T04:45:01.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.873+0000 7efde90ce640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7efde41544f0 0x7efde40c4a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:01.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.873+0000 7efde90ce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efde40cf1b0 0x7efde4070560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:01.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.873+0000 7efde90ce640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efde415b2a0 con 0x7efde4070aa0 2023-12-20T04:45:01.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.873+0000 7efde90ce640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde4070ed0 con 0x7efde40cf1b0 2023-12-20T04:45:01.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.873+0000 7efde90ce640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efde40cb220 con 0x7efde41544f0 2023-12-20T04:45:01.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.873+0000 7efddbfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efde40cf1b0 0x7efde4070560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:01.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.873+0000 7efddbfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efde40cf1b0 0x7efde4070560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48604/0 (socket says 172.21.15.132:48604) 2023-12-20T04:45:01.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.873+0000 7efddbfff640 1 -- 172.21.15.132:0/2949494885 learned_addr learned my addr 172.21.15.132:0/2949494885 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:01.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.873+0000 7efddbfff640 1 -- 172.21.15.132:0/2949494885 >> v2:172.21.15.187:3300/0 conn(0x7efde41544f0 msgr2=0x7efde40c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:01.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.873+0000 7efddbfff640 1 --2- 172.21.15.132:0/2949494885 >> v2:172.21.15.187:3300/0 conn(0x7efde41544f0 0x7efde40c4a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.873+0000 7efddbfff640 1 -- 172.21.15.132:0/2949494885 >> v1:172.21.15.187:6789/0 conn(0x7efde4070aa0 legacy=0x7efde40cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:01.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.873+0000 7efddbfff640 1 -- 172.21.15.132:0/2949494885 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efde415a720 con 0x7efde40cf1b0 2023-12-20T04:45:01.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.874+0000 7efddbfff640 1 --2- 172.21.15.132:0/2949494885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efde40cf1b0 0x7efde4070560 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7efde4074140 tx=0x7efdcc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=508cc77252c297d2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:01.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.874+0000 7efde259c640 1 -- 172.21.15.132:0/2949494885 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc031870 con 0x7efde40cf1b0 2023-12-20T04:45:01.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.874+0000 7efde259c640 1 -- 172.21.15.132:0/2949494885 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efdcc0319d0 con 0x7efde40cf1b0 2023-12-20T04:45:01.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.874+0000 7efde259c640 1 -- 172.21.15.132:0/2949494885 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efdcc031d60 con 0x7efde40cf1b0 2023-12-20T04:45:01.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.874+0000 7efde90ce640 1 -- 172.21.15.132:0/2949494885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efde40cf1b0 msgr2=0x7efde4070560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:01.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.874+0000 7efde90ce640 1 --2- 172.21.15.132:0/2949494885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efde40cf1b0 0x7efde4070560 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7efde4074140 tx=0x7efdcc02b910 comp rx=0 tx=0).stop 2023-12-20T04:45:01.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.875+0000 7efde90ce640 1 -- 172.21.15.132:0/2949494885 shutdown_connections 2023-12-20T04:45:01.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.875+0000 7efde90ce640 1 --2- 172.21.15.132:0/2949494885 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efde40cf1b0 0x7efde4070560 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.875+0000 7efde90ce640 1 --2- 172.21.15.132:0/2949494885 >> v2:172.21.15.187:3300/0 conn(0x7efde41544f0 0x7efde40c4a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.875+0000 7efde90ce640 1 -- 172.21.15.132:0/2949494885 >> 172.21.15.132:0/2949494885 conn(0x7efde40cfbd0 msgr2=0x7efde40cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:01.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.875+0000 7efde90ce640 1 -- 172.21.15.132:0/2949494885 shutdown_connections 2023-12-20T04:45:01.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.875+0000 7efde90ce640 1 -- 172.21.15.132:0/2949494885 wait complete. 2023-12-20T04:45:01.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.876+0000 7efde90ce640 1 Processor -- start 2023-12-20T04:45:01.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.876+0000 7efde90ce640 1 -- start start 2023-12-20T04:45:01.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde90ce640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efde4070aa0 0x7efde413c390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:01.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde90ce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efde40cf1b0 0x7efde40af770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:01.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde90ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efde41544f0 0x7efde40afcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:01.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde90ce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde4153260 con 0x7efde41544f0 2023-12-20T04:45:01.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde90ce640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efde4152620 con 0x7efde4070aa0 2023-12-20T04:45:01.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde90ce640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efde41528c0 con 0x7efde40cf1b0 2023-12-20T04:45:01.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde359e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efde41544f0 0x7efde40afcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:01.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde359e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efde41544f0 0x7efde40afcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48616/0 (socket says 172.21.15.132:48616) 2023-12-20T04:45:01.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde359e640 1 -- 172.21.15.132:0/1869612556 learned_addr learned my addr 172.21.15.132:0/1869612556 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:01.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde2d9d640 1 --2- 172.21.15.132:0/1869612556 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efde4070aa0 0x7efde413c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:01.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efddbfff640 1 --2- 172.21.15.132:0/1869612556 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efde40cf1b0 0x7efde40af770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:01.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde359e640 1 -- 172.21.15.132:0/1869612556 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efde40cf1b0 msgr2=0x7efde40af770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:01.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde359e640 1 --2- 172.21.15.132:0/1869612556 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efde40cf1b0 0x7efde40af770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde359e640 1 -- 172.21.15.132:0/1869612556 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efde4070aa0 msgr2=0x7efde413c390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:01.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde359e640 1 --2- 172.21.15.132:0/1869612556 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efde4070aa0 0x7efde413c390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:01.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde359e640 1 -- 172.21.15.132:0/1869612556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efdcc0094d0 con 0x7efde41544f0 2023-12-20T04:45:01.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efddbfff640 1 --2- 172.21.15.132:0/1869612556 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efde40cf1b0 0x7efde40af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:45:01.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde359e640 1 --2- 172.21.15.132:0/1869612556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efde41544f0 0x7efde40afcb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7efddc00c780 tx=0x7efddc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:01.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efddb7fe640 1 -- 172.21.15.132:0/1869612556 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc003d80 con 0x7efde41544f0 2023-12-20T04:45:01.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efddb7fe640 1 -- 172.21.15.132:0/1869612556 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efddc00ce90 con 0x7efde41544f0 2023-12-20T04:45:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde90ce640 1 -- 172.21.15.132:0/1869612556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efde4152ba0 con 0x7efde41544f0 2023-12-20T04:45:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efddb7fe640 1 -- 172.21.15.132:0/1869612556 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efddc0052b0 con 0x7efde41544f0 2023-12-20T04:45:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.877+0000 7efde90ce640 1 -- 172.21.15.132:0/1869612556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efde413c8d0 con 0x7efde41544f0 2023-12-20T04:45:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.878+0000 7efde90ce640 1 -- 172.21.15.132:0/1869612556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efde404e840 con 0x7efde41544f0 2023-12-20T04:45:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.879+0000 7efddb7fe640 1 -- 172.21.15.132:0/1869612556 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efddc005410 con 0x7efde41544f0 2023-12-20T04:45:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.879+0000 7efddb7fe640 1 --2- 172.21.15.132:0/1869612556 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efdc406a430 0x7efdc406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.879+0000 7efddb7fe640 1 -- 172.21.15.132:0/1869612556 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7efddc087df0 con 0x7efde41544f0 2023-12-20T04:45:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.879+0000 7efde2d9d640 1 --2- 172.21.15.132:0/1869612556 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efdc406a430 0x7efdc406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.880+0000 7efde2d9d640 1 --2- 172.21.15.132:0/1869612556 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efdc406a430 0x7efdc406c8f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efdd4006fd0 tx=0x7efdd4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:01.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:01.883+0000 7efddb7fe640 1 -- 172.21.15.132:0/1869612556 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7efddc053770 con 0x7efde41544f0 2023-12-20T04:45:02.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.112+0000 7efde90ce640 1 -- 172.21.15.132:0/1869612556 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]} v 0) v1 -- 0x7efde40716f0 con 0x7efde41544f0 2023-12-20T04:45:02.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.458+0000 7efddb7fe640 1 -- 172.21.15.132:0/1869612556 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_different_file"]}]=0 v143) v1 ==== 142+0+0 (secure 0 0 0) 0x7efddc056d90 con 0x7efde41544f0 2023-12-20T04:45:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.460+0000 7efde90ce640 1 -- 172.21.15.132:0/1869612556 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efdc406a430 msgr2=0x7efdc406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:02.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.460+0000 7efde90ce640 1 --2- 172.21.15.132:0/1869612556 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efdc406a430 0x7efdc406c8f0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7efdd4006fd0 tx=0x7efdd4008040 comp rx=0 tx=0).stop 2023-12-20T04:45:02.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.460+0000 7efde90ce640 1 -- 172.21.15.132:0/1869612556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efde41544f0 msgr2=0x7efde40afcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:02.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.460+0000 7efde90ce640 1 --2- 172.21.15.132:0/1869612556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efde41544f0 0x7efde40afcb0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7efddc00c780 tx=0x7efddc00cc40 comp rx=0 tx=0).stop 2023-12-20T04:45:02.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.460+0000 7efde90ce640 1 -- 172.21.15.132:0/1869612556 shutdown_connections 2023-12-20T04:45:02.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.460+0000 7efde90ce640 1 --2- 172.21.15.132:0/1869612556 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efdc406a430 0x7efdc406c8f0 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:02.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.460+0000 7efde90ce640 1 --2- 172.21.15.132:0/1869612556 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efde41544f0 0x7efde40afcb0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:02.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.460+0000 7efde90ce640 1 --2- 172.21.15.132:0/1869612556 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efde40cf1b0 0x7efde40af770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:02.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.460+0000 7efde90ce640 1 --2- 172.21.15.132:0/1869612556 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efde4070aa0 0x7efde413c390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:02.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.460+0000 7efde90ce640 1 -- 172.21.15.132:0/1869612556 >> 172.21.15.132:0/1869612556 conn(0x7efde40cfbd0 msgr2=0x7efde40ce1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:02.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.461+0000 7efde90ce640 1 -- 172.21.15.132:0/1869612556 shutdown_connections 2023-12-20T04:45:02.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.461+0000 7efde90ce640 1 -- 172.21.15.132:0/1869612556 wait complete. 2023-12-20T04:45:02.474 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-12-20T04:45:02.474 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestClusterFull) 2023-12-20T04:45:02.475 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-12-20T04:45:02.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.573+0000 7fcdeb54e640 1 Processor -- start 2023-12-20T04:45:02.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.573+0000 7fcdeb54e640 1 -- start start 2023-12-20T04:45:02.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.574+0000 7fcdeb54e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde4160450 0x7fcde4160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:02.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.574+0000 7fcdeb54e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcde41611b0 0x7fcde40b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:02.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.574+0000 7fcdeb54e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcde40b4ec0 0x7fcde406a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:02.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.574+0000 7fcdeb54e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde40b5350 con 0x7fcde41611b0 2023-12-20T04:45:02.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.574+0000 7fcdeb54e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcde40b5ec0 con 0x7fcde40b4ec0 2023-12-20T04:45:02.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.574+0000 7fcdeb54e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde41617e0 con 0x7fcde4160450 2023-12-20T04:45:02.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.574+0000 7fcde8ae9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcde41611b0 0x7fcde40b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:02.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.574+0000 7fcde8ae9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcde41611b0 0x7fcde40b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48618/0 (socket says 172.21.15.132:48618) 2023-12-20T04:45:02.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.574+0000 7fcde8ae9640 1 -- 172.21.15.132:0/2153789242 learned_addr learned my addr 172.21.15.132:0/2153789242 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:02.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.574+0000 7fcde9aeb640 1 --2- 172.21.15.132:0/2153789242 >> v2:172.21.15.187:3300/0 conn(0x7fcde40b4ec0 0x7fcde406a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:02.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.574+0000 7fcde8ae9640 1 -- 172.21.15.132:0/2153789242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde4160450 msgr2=0x7fcde4160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:02.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.574+0000 7fcde92ea640 1 --2- 172.21.15.132:0/2153789242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde4160450 0x7fcde4160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:02.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.574+0000 7fcde8ae9640 1 --2- 172.21.15.132:0/2153789242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde4160450 0x7fcde4160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:02.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.574+0000 7fcde8ae9640 1 -- 172.21.15.132:0/2153789242 >> v2:172.21.15.187:3300/0 conn(0x7fcde40b4ec0 msgr2=0x7fcde406a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:02.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.574+0000 7fcde8ae9640 1 --2- 172.21.15.132:0/2153789242 >> v2:172.21.15.187:3300/0 conn(0x7fcde40b4ec0 0x7fcde406a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:02.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.574+0000 7fcde8ae9640 1 -- 172.21.15.132:0/2153789242 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcde40d0fc0 con 0x7fcde41611b0 2023-12-20T04:45:02.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.575+0000 7fcde8ae9640 1 --2- 172.21.15.132:0/2153789242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde41611b0 0x7fcde40b4980 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fcde40b59d0 tx=0x7fcdd402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ffa866b3135a918 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:02.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.575+0000 7fcddbfff640 1 -- 172.21.15.132:0/2153789242 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4030860 con 0x7fcde41611b0 2023-12-20T04:45:02.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.575+0000 7fcddbfff640 1 -- 172.21.15.132:0/2153789242 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcdd40309c0 con 0x7fcde41611b0 2023-12-20T04:45:02.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.575+0000 7fcddbfff640 1 -- 172.21.15.132:0/2153789242 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcdd4030d50 con 0x7fcde41611b0 2023-12-20T04:45:02.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.576+0000 7fcdeb54e640 1 -- 172.21.15.132:0/2153789242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde41611b0 msgr2=0x7fcde40b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:02.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.576+0000 7fcdeb54e640 1 --2- 172.21.15.132:0/2153789242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde41611b0 0x7fcde40b4980 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7fcde40b59d0 tx=0x7fcdd402b9a0 comp rx=0 tx=0).stop 2023-12-20T04:45:02.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.576+0000 7fcdeb54e640 1 -- 172.21.15.132:0/2153789242 shutdown_connections 2023-12-20T04:45:02.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.576+0000 7fcdeb54e640 1 --2- 172.21.15.132:0/2153789242 >> v2:172.21.15.187:3300/0 conn(0x7fcde40b4ec0 0x7fcde406a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:02.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.576+0000 7fcdeb54e640 1 --2- 172.21.15.132:0/2153789242 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde41611b0 0x7fcde40b4980 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:02.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.576+0000 7fcdeb54e640 1 --2- 172.21.15.132:0/2153789242 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde4160450 0x7fcde4160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:02.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.576+0000 7fcdeb54e640 1 -- 172.21.15.132:0/2153789242 >> 172.21.15.132:0/2153789242 conn(0x7fcde40cf980 msgr2=0x7fcde40cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:02.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.576+0000 7fcdeb54e640 1 -- 172.21.15.132:0/2153789242 shutdown_connections 2023-12-20T04:45:02.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.576+0000 7fcdeb54e640 1 -- 172.21.15.132:0/2153789242 wait complete. 2023-12-20T04:45:02.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.577+0000 7fcdeb54e640 1 Processor -- start 2023-12-20T04:45:02.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.577+0000 7fcdeb54e640 1 -- start start 2023-12-20T04:45:02.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.578+0000 7fcdeb54e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde40b4ec0 0x7fcde415c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:02.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.578+0000 7fcdeb54e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde4160450 0x7fcde41588d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:02.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.578+0000 7fcdeb54e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcde41611b0 0x7fcde40ab340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:02.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.578+0000 7fcdeb54e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde415c790 con 0x7fcde40b4ec0 2023-12-20T04:45:02.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.578+0000 7fcdeb54e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcde40a9a40 con 0x7fcde41611b0 2023-12-20T04:45:02.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.578+0000 7fcdeb54e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcde41f3450 con 0x7fcde4160450 2023-12-20T04:45:02.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.578+0000 7fcde92ea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde40b4ec0 0x7fcde415c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:02.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.578+0000 7fcde92ea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde40b4ec0 0x7fcde415c250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48626/0 (socket says 172.21.15.132:48626) 2023-12-20T04:45:02.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.578+0000 7fcde92ea640 1 -- 172.21.15.132:0/1257465857 learned_addr learned my addr 172.21.15.132:0/1257465857 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:02.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.578+0000 7fcde92ea640 1 -- 172.21.15.132:0/1257465857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde4160450 msgr2=0x7fcde41588d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:02.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.578+0000 7fcde92ea640 1 --2- 172.21.15.132:0/1257465857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde4160450 0x7fcde41588d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:02.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.578+0000 7fcde92ea640 1 -- 172.21.15.132:0/1257465857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcde41611b0 msgr2=0x7fcde40ab340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:02.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.578+0000 7fcde92ea640 1 --2- 172.21.15.132:0/1257465857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcde41611b0 0x7fcde40ab340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:02.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.578+0000 7fcde92ea640 1 -- 172.21.15.132:0/1257465857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcdd40094d0 con 0x7fcde40b4ec0 2023-12-20T04:45:02.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.578+0000 7fcde92ea640 1 --2- 172.21.15.132:0/1257465857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde40b4ec0 0x7fcde415c250 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fcde000c7f0 tx=0x7fcde000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:02.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.579+0000 7fcdd9ffb640 1 -- 172.21.15.132:0/1257465857 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0004220 con 0x7fcde40b4ec0 2023-12-20T04:45:02.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.579+0000 7fcdd9ffb640 1 -- 172.21.15.132:0/1257465857 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcde00043a0 con 0x7fcde40b4ec0 2023-12-20T04:45:02.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.579+0000 7fcdd9ffb640 1 -- 172.21.15.132:0/1257465857 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcde0007860 con 0x7fcde40b4ec0 2023-12-20T04:45:02.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.579+0000 7fcdeb54e640 1 -- 172.21.15.132:0/1257465857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcde40a9d00 con 0x7fcde40b4ec0 2023-12-20T04:45:02.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.579+0000 7fcdeb54e640 1 -- 172.21.15.132:0/1257465857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcde4158e10 con 0x7fcde40b4ec0 2023-12-20T04:45:02.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.580+0000 7fcdeb54e640 1 -- 172.21.15.132:0/1257465857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcde40aa220 con 0x7fcde40b4ec0 2023-12-20T04:45:02.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.580+0000 7fcdd9ffb640 1 -- 172.21.15.132:0/1257465857 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcde0007bd0 con 0x7fcde40b4ec0 2023-12-20T04:45:02.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.580+0000 7fcdd9ffb640 1 --2- 172.21.15.132:0/1257465857 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcdc806a460 0x7fcdc806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:02.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.580+0000 7fcdd9ffb640 1 -- 172.21.15.132:0/1257465857 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fcde00884c0 con 0x7fcde40b4ec0 2023-12-20T04:45:02.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.580+0000 7fcde8ae9640 1 --2- 172.21.15.132:0/1257465857 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcdc806a460 0x7fcdc806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:02.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.581+0000 7fcde8ae9640 1 --2- 172.21.15.132:0/1257465857 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcdc806a460 0x7fcdc806c920 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4036000 tx=0x7fcdd403b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:02.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.585+0000 7fcdd9ffb640 1 -- 172.21.15.132:0/1257465857 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcde40aa220 con 0x7fcde40b4ec0 2023-12-20T04:45:02.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:02.820+0000 7fcdeb54e640 1 -- 172.21.15.132:0/1257465857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7fcde40aa220 con 0x7fcde40b4ec0 2023-12-20T04:45:03.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.459+0000 7fcdd9ffb640 1 -- 172.21.15.132:0/1257465857 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v144) v1 ==== 137+0+0 (secure 0 0 0) 0x7fcde001e0d0 con 0x7fcde40b4ec0 2023-12-20T04:45:03.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.461+0000 7fcdeb54e640 1 -- 172.21.15.132:0/1257465857 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcdc806a460 msgr2=0x7fcdc806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:03.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.461+0000 7fcdeb54e640 1 --2- 172.21.15.132:0/1257465857 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcdc806a460 0x7fcdc806c920 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fcdd4036000 tx=0x7fcdd403b040 comp rx=0 tx=0).stop 2023-12-20T04:45:03.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.461+0000 7fcdeb54e640 1 -- 172.21.15.132:0/1257465857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde40b4ec0 msgr2=0x7fcde415c250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:03.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.461+0000 7fcdeb54e640 1 --2- 172.21.15.132:0/1257465857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde40b4ec0 0x7fcde415c250 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7fcde000c7f0 tx=0x7fcde000ccb0 comp rx=0 tx=0).stop 2023-12-20T04:45:03.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.461+0000 7fcdeb54e640 1 -- 172.21.15.132:0/1257465857 shutdown_connections 2023-12-20T04:45:03.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.461+0000 7fcdeb54e640 1 --2- 172.21.15.132:0/1257465857 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcdc806a460 0x7fcdc806c920 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:03.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.461+0000 7fcdeb54e640 1 --2- 172.21.15.132:0/1257465857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcde41611b0 0x7fcde40ab340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:03.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.461+0000 7fcdeb54e640 1 --2- 172.21.15.132:0/1257465857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcde4160450 0x7fcde41588d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:03.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.461+0000 7fcdeb54e640 1 --2- 172.21.15.132:0/1257465857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcde40b4ec0 0x7fcde415c250 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:03.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.461+0000 7fcdeb54e640 1 -- 172.21.15.132:0/1257465857 >> 172.21.15.132:0/1257465857 conn(0x7fcde40cf980 msgr2=0x7fcde4159d40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:03.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.461+0000 7fcdeb54e640 1 -- 172.21.15.132:0/1257465857 shutdown_connections 2023-12-20T04:45:03.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.461+0000 7fcdeb54e640 1 -- 172.21.15.132:0/1257465857 wait complete. 2023-12-20T04:45:03.475 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-20T04:45:03.589 INFO:teuthology.orchestra.run.smithi132.stdout:{"osd_objectstore":"memstore"} 2023-12-20T04:45:03.589 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-20T04:45:03.589 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-20T04:45:03.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.691+0000 7f6b243b1640 1 Processor -- start 2023-12-20T04:45:03.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.691+0000 7f6b243b1640 1 -- start start 2023-12-20T04:45:03.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.692+0000 7f6b243b1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b1c0cd950 0x7f6b1c0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:03.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.692+0000 7f6b243b1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b1c0c41f0 0x7f6b1c06b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:03.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.692+0000 7f6b243b1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b1c1439f0 con 0x7f6b1c143610 2023-12-20T04:45:03.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.692+0000 7f6b243b1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b1c0c46f0 con 0x7f6b1c0cd950 2023-12-20T04:45:03.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.692+0000 7f6b243b1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c0c49d0 con 0x7f6b1c0c41f0 2023-12-20T04:45:03.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.692+0000 7f6b2194c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b1c0cd950 0x7f6b1c0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:03.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.692+0000 7f6b2194c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b1c0cd950 0x7f6b1c0caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48638/0 (socket says 172.21.15.132:48638) 2023-12-20T04:45:03.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.692+0000 7f6b2214d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6b1c143610 0x7f6b1c0cd240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52500/0 (socket says 172.21.15.132:52500) 2023-12-20T04:45:03.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.692+0000 7f6b2194c640 1 -- 172.21.15.132:0/4263572797 learned_addr learned my addr 172.21.15.132:0/4263572797 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:03.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.692+0000 7f6b2294e640 1 --2- 172.21.15.132:0/4263572797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b1c0c41f0 0x7f6b1c06b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:03.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.692+0000 7f6b2194c640 1 -- 172.21.15.132:0/4263572797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b1c0c41f0 msgr2=0x7f6b1c06b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:03.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.692+0000 7f6b2194c640 1 --2- 172.21.15.132:0/4263572797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b1c0c41f0 0x7f6b1c06b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:03.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.692+0000 7f6b2194c640 1 -- 172.21.15.132:0/4263572797 >> v1:172.21.15.132:6789/0 conn(0x7f6b1c143610 legacy=0x7f6b1c0cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:03.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.692+0000 7f6b2194c640 1 -- 172.21.15.132:0/4263572797 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b1c0c4cb0 con 0x7f6b1c0cd950 2023-12-20T04:45:03.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.693+0000 7f6b2194c640 1 --2- 172.21.15.132:0/4263572797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1c0cd950 0x7f6b1c0caa40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c009870 tx=0x7f6b0c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356004ae90275ffd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:03.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.693+0000 7f6b2114b640 1 -- 172.21.15.132:0/4263572797 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c030840 con 0x7f6b1c0cd950 2023-12-20T04:45:03.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.693+0000 7f6b2114b640 1 -- 172.21.15.132:0/4263572797 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c0309a0 con 0x7f6b1c0cd950 2023-12-20T04:45:03.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.693+0000 7f6b2114b640 1 -- 172.21.15.132:0/4263572797 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c030d30 con 0x7f6b1c0cd950 2023-12-20T04:45:03.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.694+0000 7f6b243b1640 1 -- 172.21.15.132:0/4263572797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1c0cd950 msgr2=0x7f6b1c0caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:03.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.694+0000 7f6b243b1640 1 --2- 172.21.15.132:0/4263572797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1c0cd950 0x7f6b1c0caa40 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c009870 tx=0x7f6b0c02b980 comp rx=0 tx=0).stop 2023-12-20T04:45:03.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.694+0000 7f6b243b1640 1 -- 172.21.15.132:0/4263572797 shutdown_connections 2023-12-20T04:45:03.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.694+0000 7f6b243b1640 1 --2- 172.21.15.132:0/4263572797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b1c0c41f0 0x7f6b1c06b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:03.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.694+0000 7f6b243b1640 1 --2- 172.21.15.132:0/4263572797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1c0cd950 0x7f6b1c0caa40 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:03.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.694+0000 7f6b243b1640 1 -- 172.21.15.132:0/4263572797 >> 172.21.15.132:0/4263572797 conn(0x7f6b1c06a260 msgr2=0x7f6b1c0b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:03.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.694+0000 7f6b243b1640 1 -- 172.21.15.132:0/4263572797 shutdown_connections 2023-12-20T04:45:03.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.694+0000 7f6b243b1640 1 -- 172.21.15.132:0/4263572797 wait complete. 2023-12-20T04:45:03.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.695+0000 7f6b243b1640 1 Processor -- start 2023-12-20T04:45:03.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.695+0000 7f6b243b1640 1 -- start start 2023-12-20T04:45:03.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.695+0000 7f6b243b1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b1c0c41f0 0x7f6b1c13bbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:03.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b243b1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1c0cd950 0x7f6b1c1effb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:03.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b243b1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b1c143610 0x7f6b1c1f45d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:03.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b243b1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c13c0f0 con 0x7f6b1c0cd950 2023-12-20T04:45:03.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b243b1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c0b2180 con 0x7f6b1c0c41f0 2023-12-20T04:45:03.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b243b1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b1c1f4140 con 0x7f6b1c143610 2023-12-20T04:45:03.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b2194c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1c0cd950 0x7f6b1c1effb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:03.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b2194c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1c0cd950 0x7f6b1c1effb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48642/0 (socket says 172.21.15.132:48642) 2023-12-20T04:45:03.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b2194c640 1 -- 172.21.15.132:0/4153923617 learned_addr learned my addr 172.21.15.132:0/4153923617 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:03.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b2214d640 1 --2- 172.21.15.132:0/4153923617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b1c0c41f0 0x7f6b1c13bbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:03.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b2294e640 1 --2- 172.21.15.132:0/4153923617 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b1c143610 0x7f6b1c1f45d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:03.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b2194c640 1 -- 172.21.15.132:0/4153923617 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b1c143610 msgr2=0x7f6b1c1f45d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:03.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b2194c640 1 --2- 172.21.15.132:0/4153923617 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b1c143610 0x7f6b1c1f45d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:03.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b2194c640 1 -- 172.21.15.132:0/4153923617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b1c0c41f0 msgr2=0x7f6b1c13bbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:03.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b2194c640 1 --2- 172.21.15.132:0/4153923617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b1c0c41f0 0x7f6b1c13bbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:03.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b2194c640 1 -- 172.21.15.132:0/4153923617 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b0c0094d0 con 0x7f6b1c0cd950 2023-12-20T04:45:03.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b2194c640 1 --2- 172.21.15.132:0/4153923617 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1c0cd950 0x7f6b1c1effb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c02b9c0 tx=0x7f6b0c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:03.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b12ffd640 1 -- 172.21.15.132:0/4153923617 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c039c90 con 0x7f6b1c0cd950 2023-12-20T04:45:03.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b12ffd640 1 -- 172.21.15.132:0/4153923617 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b0c039df0 con 0x7f6b1c0cd950 2023-12-20T04:45:03.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b243b1640 1 -- 172.21.15.132:0/4153923617 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b1c0b23d0 con 0x7f6b1c0cd950 2023-12-20T04:45:03.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b12ffd640 1 -- 172.21.15.132:0/4153923617 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b0c0446c0 con 0x7f6b1c0cd950 2023-12-20T04:45:03.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.696+0000 7f6b243b1640 1 -- 172.21.15.132:0/4153923617 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b1c1f3dd0 con 0x7f6b1c0cd950 2023-12-20T04:45:03.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.697+0000 7f6b243b1640 1 -- 172.21.15.132:0/4153923617 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b1c0b28f0 con 0x7f6b1c0cd950 2023-12-20T04:45:03.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.698+0000 7f6b12ffd640 1 -- 172.21.15.132:0/4153923617 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6b0c04d3b0 con 0x7f6b1c0cd950 2023-12-20T04:45:03.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.698+0000 7f6b12ffd640 1 --2- 172.21.15.132:0/4153923617 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b0006a430 0x7f6b0006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:03.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.698+0000 7f6b12ffd640 1 -- 172.21.15.132:0/4153923617 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6b0c03e070 con 0x7f6b1c0cd950 2023-12-20T04:45:03.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.698+0000 7f6b2214d640 1 --2- 172.21.15.132:0/4153923617 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b0006a430 0x7f6b0006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:03.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.698+0000 7f6b2214d640 1 --2- 172.21.15.132:0/4153923617 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b0006a430 0x7f6b0006c8f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6b18007fd0 tx=0x7f6b18007c40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:03.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.702+0000 7f6b12ffd640 1 -- 172.21.15.132:0/4153923617 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6b1c0b28f0 con 0x7f6b1c0cd950 2023-12-20T04:45:03.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.866+0000 7f6b243b1640 1 -- 172.21.15.132:0/4153923617 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f6b1c1f3c30 con 0x7f6b1c0cd950 2023-12-20T04:45:03.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.870+0000 7f6b12ffd640 1 -- 172.21.15.132:0/4153923617 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v6)=0 v6) v1 ==== 122+0+0 (secure 0 0 0) 0x7f6b1c1f3c30 con 0x7f6b1c0cd950 2023-12-20T04:45:03.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.872+0000 7f6b243b1640 1 -- 172.21.15.132:0/4153923617 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b0006a430 msgr2=0x7f6b0006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:03.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.872+0000 7f6b243b1640 1 --2- 172.21.15.132:0/4153923617 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b0006a430 0x7f6b0006c8f0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f6b18007fd0 tx=0x7f6b18007c40 comp rx=0 tx=0).stop 2023-12-20T04:45:03.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.872+0000 7f6b243b1640 1 -- 172.21.15.132:0/4153923617 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1c0cd950 msgr2=0x7f6b1c1effb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:03.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.872+0000 7f6b243b1640 1 --2- 172.21.15.132:0/4153923617 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1c0cd950 0x7f6b1c1effb0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7f6b0c02b9c0 tx=0x7f6b0c004730 comp rx=0 tx=0).stop 2023-12-20T04:45:03.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.872+0000 7f6b243b1640 1 -- 172.21.15.132:0/4153923617 shutdown_connections 2023-12-20T04:45:03.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.872+0000 7f6b243b1640 1 --2- 172.21.15.132:0/4153923617 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b0006a430 0x7f6b0006c8f0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:03.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.872+0000 7f6b243b1640 1 --2- 172.21.15.132:0/4153923617 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b1c143610 0x7f6b1c1f45d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:03.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.872+0000 7f6b243b1640 1 --2- 172.21.15.132:0/4153923617 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b1c0cd950 0x7f6b1c1effb0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:03.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.872+0000 7f6b243b1640 1 --2- 172.21.15.132:0/4153923617 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b1c0c41f0 0x7f6b1c13bbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:03.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.872+0000 7f6b243b1640 1 -- 172.21.15.132:0/4153923617 >> 172.21.15.132:0/4153923617 conn(0x7f6b1c06a260 msgr2=0x7f6b1c0cd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:03.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.872+0000 7f6b243b1640 1 -- 172.21.15.132:0/4153923617 shutdown_connections 2023-12-20T04:45:03.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:03.872+0000 7f6b243b1640 1 -- 172.21.15.132:0/4153923617 wait complete. 2023-12-20T04:45:03.885 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:45:03.885 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:45:03.932 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:45:03.981 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:45:03.981 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:45:03.982 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:45:03.996 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:45:03.997 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:45:03.997 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:45:04.013 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:45:04.014 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:45:04.014 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:45:04.051 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:45:04.052 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:45:04.052 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:45:04.070 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:45:04.070 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-20T04:45:04.071 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:45:04.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.190+0000 7f71d74e5640 1 Processor -- start 2023-12-20T04:45:04.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.190+0000 7f71d74e5640 1 -- start start 2023-12-20T04:45:04.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.191+0000 7f71d74e5640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f71d00b4de0 0x7f71d00d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:04.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.191+0000 7f71d74e5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d00b5ec0 con 0x7f71d0160450 2023-12-20T04:45:04.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.191+0000 7f71d74e5640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f71d01617e0 con 0x7f71d00b4980 2023-12-20T04:45:04.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.191+0000 7f71d74e5640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f71d00d0fc0 con 0x7f71d00b4de0 2023-12-20T04:45:04.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.191+0000 7f71d5281640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f71d0160450 0x7f71d0160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52512/0 (socket says 172.21.15.132:52512) 2023-12-20T04:45:04.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.191+0000 7f71d5281640 1 -- 172.21.15.132:0/153885679 learned_addr learned my addr 172.21.15.132:0/153885679 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:45:04.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.191+0000 7f71d5a82640 1 --2- 172.21.15.132:0/153885679 >> v2:172.21.15.187:3300/0 conn(0x7f71d00b4de0 0x7f71d00d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:04.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.191+0000 7f71c7fff640 1 -- 172.21.15.132:0/153885679 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3828408718 0 0) 0x7f71d00b5ec0 con 0x7f71d0160450 2023-12-20T04:45:04.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.191+0000 7f71c7fff640 1 -- 172.21.15.132:0/153885679 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f71bc003520 con 0x7f71d0160450 2023-12-20T04:45:04.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.192+0000 7f71c7fff640 1 -- 172.21.15.132:0/153885679 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2730879570 0 0) 0x7f71bc003520 con 0x7f71d0160450 2023-12-20T04:45:04.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.192+0000 7f71d5a82640 1 -- 172.21.15.132:0/153885679 >> v1:172.21.15.187:6789/0 conn(0x7f71d00b4980 legacy=0x7f71d00d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:04.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.192+0000 7f71d5a82640 1 -- 172.21.15.132:0/153885679 >> v1:172.21.15.132:6789/0 conn(0x7f71d0160450 legacy=0x7f71d0160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:04.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.192+0000 7f71d5a82640 1 -- 172.21.15.132:0/153885679 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71d00d12a0 con 0x7f71d00b4de0 2023-12-20T04:45:04.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.192+0000 7f71d5a82640 1 --2- 172.21.15.132:0/153885679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d00b4de0 0x7f71d00d21b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f71c8009d90 tx=0x7f71c802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c1e9ac2a20a89989 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:04.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.193+0000 7f71c7fff640 1 -- 172.21.15.132:0/153885679 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71cc001670 con 0x7f71d00b4de0 2023-12-20T04:45:04.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.193+0000 7f71c7fff640 1 -- 172.21.15.132:0/153885679 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c802c9d0 con 0x7f71d00b4de0 2023-12-20T04:45:04.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.193+0000 7f71c7fff640 1 -- 172.21.15.132:0/153885679 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c802cd60 con 0x7f71d00b4de0 2023-12-20T04:45:04.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.193+0000 7f71d74e5640 1 -- 172.21.15.132:0/153885679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d00b4de0 msgr2=0x7f71d00d21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:04.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.193+0000 7f71d74e5640 1 --2- 172.21.15.132:0/153885679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d00b4de0 0x7f71d00d21b0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f71c8009d90 tx=0x7f71c802bea0 comp rx=0 tx=0).stop 2023-12-20T04:45:04.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.193+0000 7f71d74e5640 1 -- 172.21.15.132:0/153885679 shutdown_connections 2023-12-20T04:45:04.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.193+0000 7f71d74e5640 1 --2- 172.21.15.132:0/153885679 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d00b4de0 0x7f71d00d21b0 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:04.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.193+0000 7f71d74e5640 1 -- 172.21.15.132:0/153885679 >> 172.21.15.132:0/153885679 conn(0x7f71d00cf980 msgr2=0x7f71d00cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:04.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.193+0000 7f71d74e5640 1 -- 172.21.15.132:0/153885679 shutdown_connections 2023-12-20T04:45:04.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.193+0000 7f71d74e5640 1 -- 172.21.15.132:0/153885679 wait complete. 2023-12-20T04:45:04.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.194+0000 7f71d74e5640 1 Processor -- start 2023-12-20T04:45:04.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.194+0000 7f71d74e5640 1 -- start start 2023-12-20T04:45:04.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.195+0000 7f71d74e5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71d00b4980 0x7f71d00d3040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:04.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.195+0000 7f71d74e5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d00b4de0 0x7f71d00c8b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:04.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.195+0000 7f71d74e5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0160450 0x7f71d00c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:04.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.195+0000 7f71d74e5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00d2c20 con 0x7f71d0160450 2023-12-20T04:45:04.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.195+0000 7f71d74e5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00d1fa0 con 0x7f71d00b4de0 2023-12-20T04:45:04.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.195+0000 7f71d74e5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f71d00d2280 con 0x7f71d00b4980 2023-12-20T04:45:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.195+0000 7f71d5a82640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0160450 0x7f71d00c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.195+0000 7f71d5a82640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0160450 0x7f71d00c9fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48644/0 (socket says 172.21.15.132:48644) 2023-12-20T04:45:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.195+0000 7f71d5a82640 1 -- 172.21.15.132:0/609820618 learned_addr learned my addr 172.21.15.132:0/609820618 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.195+0000 7f71d4a80640 1 --2- 172.21.15.132:0/609820618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d00b4de0 0x7f71d00c8b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.195+0000 7f71d5281640 1 --2- 172.21.15.132:0/609820618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71d00b4980 0x7f71d00d3040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.195+0000 7f71d5a82640 1 -- 172.21.15.132:0/609820618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71d00b4980 msgr2=0x7f71d00d3040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.195+0000 7f71d5a82640 1 --2- 172.21.15.132:0/609820618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71d00b4980 0x7f71d00d3040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.195+0000 7f71d5a82640 1 -- 172.21.15.132:0/609820618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d00b4de0 msgr2=0x7f71d00c8b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.195+0000 7f71d5a82640 1 --2- 172.21.15.132:0/609820618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d00b4de0 0x7f71d00c8b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.195+0000 7f71d5a82640 1 -- 172.21.15.132:0/609820618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f71c8009a70 con 0x7f71d0160450 2023-12-20T04:45:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.196+0000 7f71d5a82640 1 --2- 172.21.15.132:0/609820618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0160450 0x7f71d00c9fd0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f71c8009d90 tx=0x7f71c8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.196+0000 7f71c5ffb640 1 -- 172.21.15.132:0/609820618 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8009450 con 0x7f71d0160450 2023-12-20T04:45:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.196+0000 7f71c5ffb640 1 -- 172.21.15.132:0/609820618 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71c8003990 con 0x7f71d0160450 2023-12-20T04:45:04.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.196+0000 7f71c5ffb640 1 -- 172.21.15.132:0/609820618 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f71c8003d40 con 0x7f71d0160450 2023-12-20T04:45:04.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.196+0000 7f71d74e5640 1 -- 172.21.15.132:0/609820618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f71d00d2560 con 0x7f71d0160450 2023-12-20T04:45:04.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.196+0000 7f71d74e5640 1 -- 172.21.15.132:0/609820618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f71d014b560 con 0x7f71d0160450 2023-12-20T04:45:04.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.197+0000 7f71d74e5640 1 -- 172.21.15.132:0/609820618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f71d014b6f0 con 0x7f71d0160450 2023-12-20T04:45:04.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.197+0000 7f71c5ffb640 1 -- 172.21.15.132:0/609820618 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f71c803b050 con 0x7f71d0160450 2023-12-20T04:45:04.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.198+0000 7f71c5ffb640 1 --2- 172.21.15.132:0/609820618 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71b406a460 0x7f71b406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:04.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.198+0000 7f71c5ffb640 1 -- 172.21.15.132:0/609820618 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f71c80aa900 con 0x7f71d0160450 2023-12-20T04:45:04.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.198+0000 7f71d5281640 1 --2- 172.21.15.132:0/609820618 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71b406a460 0x7f71b406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:04.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.198+0000 7f71d5281640 1 --2- 172.21.15.132:0/609820618 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71b406a460 0x7f71b406c920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f71cc000f60 tx=0x7f71cc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:04.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.202+0000 7f71c5ffb640 1 -- 172.21.15.132:0/609820618 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f71c8076280 con 0x7f71d0160450 2023-12-20T04:45:04.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.400+0000 7f71d74e5640 1 -- 172.21.15.132:0/609820618 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f71d00d2d60 con 0x7f71d0160450 2023-12-20T04:45:04.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.401+0000 7f71c5ffb640 1 -- 172.21.15.132:0/609820618 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 21 v21) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f71d00d2d60 con 0x7f71d0160450 2023-12-20T04:45:04.403 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:45:04.403 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":21,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5033,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1456944733","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1456944733},{"type":"v1","addr":"172.21.15.187:6834","nonce":1456944733}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5278,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2114954856","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2114954856},{"type":"v1","addr":"172.21.15.187:6835","nonce":2114954856}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":5682,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2494230497","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2494230497},{"type":"v1","addr":"172.21.15.132:6837","nonce":2494230497}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":16},{"gid":6111,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/57029289","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":57029289},{"type":"v1","addr":"172.21.15.132:6836","nonce":57029289}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":21}],"filesystems":[]} 2023-12-20T04:45:04.403 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 21 2023-12-20T04:45:04.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.402+0000 7f71d74e5640 1 -- 172.21.15.132:0/609820618 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71b406a460 msgr2=0x7f71b406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:04.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.402+0000 7f71d74e5640 1 --2- 172.21.15.132:0/609820618 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71b406a460 0x7f71b406c920 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f71cc000f60 tx=0x7f71cc009040 comp rx=0 tx=0).stop 2023-12-20T04:45:04.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.402+0000 7f71d74e5640 1 -- 172.21.15.132:0/609820618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0160450 msgr2=0x7f71d00c9fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:04.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.402+0000 7f71d74e5640 1 --2- 172.21.15.132:0/609820618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0160450 0x7f71d00c9fd0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f71c8009d90 tx=0x7f71c8004a40 comp rx=0 tx=0).stop 2023-12-20T04:45:04.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.402+0000 7f71d74e5640 1 -- 172.21.15.132:0/609820618 shutdown_connections 2023-12-20T04:45:04.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.402+0000 7f71d74e5640 1 --2- 172.21.15.132:0/609820618 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f71b406a460 0x7f71b406c920 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:04.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.402+0000 7f71d74e5640 1 --2- 172.21.15.132:0/609820618 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f71d0160450 0x7f71d00c9fd0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:04.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.402+0000 7f71d74e5640 1 --2- 172.21.15.132:0/609820618 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f71d00b4de0 0x7f71d00c8b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:04.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.402+0000 7f71d74e5640 1 --2- 172.21.15.132:0/609820618 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71d00b4980 0x7f71d00d3040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:04.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.402+0000 7f71d74e5640 1 -- 172.21.15.132:0/609820618 >> 172.21.15.132:0/609820618 conn(0x7f71d00cf980 msgr2=0x7f71d006a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:04.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.403+0000 7f71d74e5640 1 -- 172.21.15.132:0/609820618 shutdown_connections 2023-12-20T04:45:04.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.403+0000 7f71d74e5640 1 -- 172.21.15.132:0/609820618 wait complete. 2023-12-20T04:45:04.416 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-20T04:45:04.416 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-20T04:45:04.416 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-20T04:45:04.416 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:45:04.416 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-20T04:45:04.416 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-20T04:45:04.416 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-20T04:45:04.417 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:45:04.417 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-20T04:45:04.417 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-20T04:45:04.417 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-20T04:45:04.417 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:45:04.417 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-20T04:45:04.417 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-20T04:45:04.418 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-20T04:45:04.418 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:45:04.426 INFO:tasks.ceph.mds.a:Stopped 2023-12-20T04:45:04.426 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-20T04:45:04.428 INFO:tasks.ceph.mds.c:Stopped 2023-12-20T04:45:04.428 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-20T04:45:04.429 INFO:tasks.ceph.mds.d:Stopped 2023-12-20T04:45:04.429 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-20T04:45:04.430 INFO:tasks.ceph.mds.b:Stopped 2023-12-20T04:45:04.431 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-20T04:45:04.468 INFO:tasks.ceph.mds.a:Started 2023-12-20T04:45:04.468 DEBUG:teuthology.parallel:result is None 2023-12-20T04:45:04.469 INFO:tasks.ceph.mds.c:Started 2023-12-20T04:45:04.469 DEBUG:teuthology.parallel:result is None 2023-12-20T04:45:04.472 INFO:tasks.ceph.mds.d:Started 2023-12-20T04:45:04.472 DEBUG:teuthology.parallel:result is None 2023-12-20T04:45:04.473 INFO:tasks.ceph.mds.b:Started 2023-12-20T04:45:04.473 DEBUG:teuthology.parallel:result is None 2023-12-20T04:45:04.473 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-20T04:45:04.544 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-12-20T04:45:04.545 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-12-20T04:45:04.556 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-12-20T04:45:04.557 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-12-20T04:45:04.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.580+0000 7f86698a0640 1 Processor -- start 2023-12-20T04:45:04.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.580+0000 7f86698a0640 1 -- start start 2023-12-20T04:45:04.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.581+0000 7f86698a0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8664143700 0x7f86640704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:04.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.581+0000 7f86698a0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8664070a30 0x7f866415dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:04.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.581+0000 7f86698a0640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8664143ae0 con 0x7f866415dff0 2023-12-20T04:45:04.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.581+0000 7f86698a0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8664070eb0 con 0x7f8664070a30 2023-12-20T04:45:04.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.581+0000 7f86698a0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f866415e7e0 con 0x7f8664143700 2023-12-20T04:45:04.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.581+0000 7f865a7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8664070a30 0x7f866415dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:04.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.581+0000 7f865a7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8664070a30 0x7f866415dab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48684/0 (socket says 172.21.15.132:48684) 2023-12-20T04:45:04.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.581+0000 7f865a7fc640 1 -- 172.21.15.132:0/2109931918 learned_addr learned my addr 172.21.15.132:0/2109931918 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:04.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.581+0000 7f8662ffd640 1 --2- 172.21.15.132:0/2109931918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8664143700 0x7f86640704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:04.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.581+0000 7f865a7fc640 1 -- 172.21.15.132:0/2109931918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8664143700 msgr2=0x7f86640704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:04.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.581+0000 7f865a7fc640 1 --2- 172.21.15.132:0/2109931918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8664143700 0x7f86640704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:04.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.581+0000 7f865a7fc640 1 -- 172.21.15.132:0/2109931918 >> v1:172.21.15.187:6789/0 conn(0x7f866415dff0 legacy=0x7f86640cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:04.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.581+0000 7f865a7fc640 1 -- 172.21.15.132:0/2109931918 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86640c4a30 con 0x7f8664070a30 2023-12-20T04:45:04.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.582+0000 7f865a7fc640 1 --2- 172.21.15.132:0/2109931918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8664070a30 0x7f866415dab0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f864c009870 tx=0x7f864c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9db6e7a62f6b96f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:04.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.582+0000 7f86627fc640 1 -- 172.21.15.132:0/2109931918 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c030840 con 0x7f8664070a30 2023-12-20T04:45:04.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.582+0000 7f86627fc640 1 -- 172.21.15.132:0/2109931918 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f864c0309a0 con 0x7f8664070a30 2023-12-20T04:45:04.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.582+0000 7f86627fc640 1 -- 172.21.15.132:0/2109931918 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f864c030d30 con 0x7f8664070a30 2023-12-20T04:45:04.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.583+0000 7f86698a0640 1 -- 172.21.15.132:0/2109931918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8664070a30 msgr2=0x7f866415dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:04.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.583+0000 7f86698a0640 1 --2- 172.21.15.132:0/2109931918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8664070a30 0x7f866415dab0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f864c009870 tx=0x7f864c02b980 comp rx=0 tx=0).stop 2023-12-20T04:45:04.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.583+0000 7f86698a0640 1 -- 172.21.15.132:0/2109931918 shutdown_connections 2023-12-20T04:45:04.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.583+0000 7f86698a0640 1 --2- 172.21.15.132:0/2109931918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8664070a30 0x7f866415dab0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:04.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.583+0000 7f86698a0640 1 --2- 172.21.15.132:0/2109931918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8664143700 0x7f86640704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:04.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.583+0000 7f86698a0640 1 -- 172.21.15.132:0/2109931918 >> 172.21.15.132:0/2109931918 conn(0x7f86640cfb10 msgr2=0x7f86640cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:04.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.583+0000 7f86698a0640 1 -- 172.21.15.132:0/2109931918 shutdown_connections 2023-12-20T04:45:04.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.583+0000 7f86698a0640 1 -- 172.21.15.132:0/2109931918 wait complete. 2023-12-20T04:45:04.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.584+0000 7f86698a0640 1 Processor -- start 2023-12-20T04:45:04.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.584+0000 7f86698a0640 1 -- start start 2023-12-20T04:45:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f86698a0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8664070a30 0x7f8664132a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f86698a0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8664143700 0x7f86641efdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f86698a0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866415dff0 0x7f86640c6be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f8662ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8664070a30 0x7f8664132a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f86698a0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86640c9a90 con 0x7f8664070a30 2023-12-20T04:45:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f86698a0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8664132f50 con 0x7f8664143700 2023-12-20T04:45:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f86698a0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86640c8e80 con 0x7f866415dff0 2023-12-20T04:45:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f8662ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8664070a30 0x7f8664132a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48698/0 (socket says 172.21.15.132:48698) 2023-12-20T04:45:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f8662ffd640 1 -- 172.21.15.132:0/282393930 learned_addr learned my addr 172.21.15.132:0/282393930 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f865a7fc640 1 --2- 172.21.15.132:0/282393930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8664143700 0x7f86641efdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f86637fe640 1 --2- 172.21.15.132:0/282393930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866415dff0 0x7f86640c6be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f8662ffd640 1 -- 172.21.15.132:0/282393930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866415dff0 msgr2=0x7f86640c6be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:04.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f8662ffd640 1 --2- 172.21.15.132:0/282393930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866415dff0 0x7f86640c6be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f8662ffd640 1 -- 172.21.15.132:0/282393930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8664143700 msgr2=0x7f86641efdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f8662ffd640 1 --2- 172.21.15.132:0/282393930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8664143700 0x7f86641efdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f8662ffd640 1 -- 172.21.15.132:0/282393930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f864c0094d0 con 0x7f8664070a30 2023-12-20T04:45:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f865a7fc640 1 --2- 172.21.15.132:0/282393930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8664143700 0x7f86641efdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:45:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f86637fe640 1 --2- 172.21.15.132:0/282393930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866415dff0 0x7f86640c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:45:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f8662ffd640 1 --2- 172.21.15.132:0/282393930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8664070a30 0x7f8664132a10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f865400e9b0 tx=0x7f865400ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f8660ff9640 1 -- 172.21.15.132:0/282393930 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8654009670 con 0x7f8664070a30 2023-12-20T04:45:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.585+0000 7f8660ff9640 1 -- 172.21.15.132:0/282393930 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865400c9a0 con 0x7f8664070a30 2023-12-20T04:45:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.586+0000 7f86698a0640 1 -- 172.21.15.132:0/282393930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86640c9160 con 0x7f8664070a30 2023-12-20T04:45:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.586+0000 7f8660ff9640 1 -- 172.21.15.132:0/282393930 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865400cd50 con 0x7f8664070a30 2023-12-20T04:45:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.586+0000 7f86698a0640 1 -- 172.21.15.132:0/282393930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86640c9720 con 0x7f8664070a30 2023-12-20T04:45:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.587+0000 7f86698a0640 1 -- 172.21.15.132:0/282393930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86640c98b0 con 0x7f8664070a30 2023-12-20T04:45:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.587+0000 7f8660ff9640 1 -- 172.21.15.132:0/282393930 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8654013470 con 0x7f8664070a30 2023-12-20T04:45:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.587+0000 7f8660ff9640 1 --2- 172.21.15.132:0/282393930 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f864406a430 0x7f864406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:04.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.587+0000 7f8660ff9640 1 -- 172.21.15.132:0/282393930 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(60..60 src has 1..60) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f86540888e0 con 0x7f8664070a30 2023-12-20T04:45:04.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.588+0000 7f865a7fc640 1 --2- 172.21.15.132:0/282393930 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f864406a430 0x7f864406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:04.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.588+0000 7f865a7fc640 1 --2- 172.21.15.132:0/282393930 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f864406a430 0x7f864406c8f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f864c036000 tx=0x7f864c03b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.592+0000 7f8660ff9640 1 -- 172.21.15.132:0/282393930 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f86540541d0 con 0x7f8664070a30 2023-12-20T04:45:04.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:04.772+0000 7f86698a0640 1 -- 172.21.15.132:0/282393930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f866404e840 con 0x7f8664070a30 2023-12-20T04:45:05.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.585+0000 7f8660ff9640 1 -- 172.21.15.132:0/282393930 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v61) v1 ==== 97+0+0 (secure 0 0 0) 0x7f8654017080 con 0x7f8664070a30 2023-12-20T04:45:05.587 INFO:teuthology.orchestra.run.smithi132.stderr: removed all blocklist entries 2023-12-20T04:45:05.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.587+0000 7f86698a0640 1 -- 172.21.15.132:0/282393930 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f864406a430 msgr2=0x7f864406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:05.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.587+0000 7f86698a0640 1 --2- 172.21.15.132:0/282393930 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f864406a430 0x7f864406c8f0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f864c036000 tx=0x7f864c03b040 comp rx=0 tx=0).stop 2023-12-20T04:45:05.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.587+0000 7f86698a0640 1 -- 172.21.15.132:0/282393930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8664070a30 msgr2=0x7f8664132a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:05.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.587+0000 7f86698a0640 1 --2- 172.21.15.132:0/282393930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8664070a30 0x7f8664132a10 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f865400e9b0 tx=0x7f865400ee70 comp rx=0 tx=0).stop 2023-12-20T04:45:05.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.587+0000 7f86698a0640 1 -- 172.21.15.132:0/282393930 shutdown_connections 2023-12-20T04:45:05.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.587+0000 7f86698a0640 1 --2- 172.21.15.132:0/282393930 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f864406a430 0x7f864406c8f0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:05.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.587+0000 7f86698a0640 1 --2- 172.21.15.132:0/282393930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866415dff0 0x7f86640c6be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:05.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.587+0000 7f86698a0640 1 --2- 172.21.15.132:0/282393930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8664143700 0x7f86641efdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:05.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.587+0000 7f86698a0640 1 --2- 172.21.15.132:0/282393930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8664070a30 0x7f8664132a10 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:05.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.587+0000 7f86698a0640 1 -- 172.21.15.132:0/282393930 >> 172.21.15.132:0/282393930 conn(0x7f86640cfb10 msgr2=0x7f8664140cf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:05.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.587+0000 7f86698a0640 1 -- 172.21.15.132:0/282393930 shutdown_connections 2023-12-20T04:45:05.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.587+0000 7f86698a0640 1 -- 172.21.15.132:0/282393930 wait complete. 2023-12-20T04:45:05.602 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-20T04:45:05.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.702+0000 7f29b3947640 1 Processor -- start 2023-12-20T04:45:05.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.703+0000 7f29b3947640 1 -- start start 2023-12-20T04:45:05.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.703+0000 7f29b3947640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f29ac0b4980 0x7f29ac0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:05.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.703+0000 7f29b3947640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ac0b5320 con 0x7f29ac160450 2023-12-20T04:45:05.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.703+0000 7f29b3947640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f29ac0b5ec0 con 0x7f29ac0d1aa0 2023-12-20T04:45:05.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.703+0000 7f29b3947640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f29ac1617e0 con 0x7f29ac0b4980 2023-12-20T04:45:05.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.703+0000 7f29b0ee2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f29ac0b4980 0x7f29ac0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:05.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.703+0000 7f29b0ee2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f29ac0b4980 0x7f29ac0b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48700/0 (socket says 172.21.15.132:48700) 2023-12-20T04:45:05.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.703+0000 7f29b16e3640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f29ac160450 0x7f29ac160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52526/0 (socket says 172.21.15.132:52526) 2023-12-20T04:45:05.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.703+0000 7f29b0ee2640 1 -- 172.21.15.132:0/3496216381 learned_addr learned my addr 172.21.15.132:0/3496216381 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:05.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.704+0000 7f29b0ee2640 1 -- 172.21.15.132:0/3496216381 >> v1:172.21.15.187:6789/0 conn(0x7f29ac0d1aa0 legacy=0x7f29ac0d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:05.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.704+0000 7f29b0ee2640 1 -- 172.21.15.132:0/3496216381 >> v1:172.21.15.132:6789/0 conn(0x7f29ac160450 legacy=0x7f29ac160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:05.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.704+0000 7f29b0ee2640 1 -- 172.21.15.132:0/3496216381 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f29ac0d0fc0 con 0x7f29ac0b4980 2023-12-20T04:45:05.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.704+0000 7f29b0ee2640 1 --2- 172.21.15.132:0/3496216381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29ac0b4980 0x7f29ac0b4de0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f299c009870 tx=0x7f299c02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9409e03bd89c2a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:05.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.705+0000 7f29a3fff640 1 -- 172.21.15.132:0/3496216381 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c02f840 con 0x7f29ac0b4980 2023-12-20T04:45:05.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.705+0000 7f29a3fff640 1 -- 172.21.15.132:0/3496216381 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f299c02f9a0 con 0x7f29ac0b4980 2023-12-20T04:45:05.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.705+0000 7f29a3fff640 1 -- 172.21.15.132:0/3496216381 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f299c02fd30 con 0x7f29ac0b4980 2023-12-20T04:45:05.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.705+0000 7f29b3947640 1 -- 172.21.15.132:0/3496216381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29ac0b4980 msgr2=0x7f29ac0b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:05.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.705+0000 7f29b3947640 1 --2- 172.21.15.132:0/3496216381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29ac0b4980 0x7f29ac0b4de0 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f299c009870 tx=0x7f299c02ba20 comp rx=0 tx=0).stop 2023-12-20T04:45:05.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.705+0000 7f29b3947640 1 -- 172.21.15.132:0/3496216381 shutdown_connections 2023-12-20T04:45:05.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.705+0000 7f29b3947640 1 --2- 172.21.15.132:0/3496216381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29ac0b4980 0x7f29ac0b4de0 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:05.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.705+0000 7f29b3947640 1 -- 172.21.15.132:0/3496216381 >> 172.21.15.132:0/3496216381 conn(0x7f29ac0cf980 msgr2=0x7f29ac0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:05.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.705+0000 7f29b3947640 1 -- 172.21.15.132:0/3496216381 shutdown_connections 2023-12-20T04:45:05.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.705+0000 7f29b3947640 1 -- 172.21.15.132:0/3496216381 wait complete. 2023-12-20T04:45:05.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.706+0000 7f29b3947640 1 Processor -- start 2023-12-20T04:45:05.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.706+0000 7f29b3947640 1 -- start start 2023-12-20T04:45:05.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.707+0000 7f29b3947640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac0b4980 0x7f29ac152260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:05.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.707+0000 7f29b3947640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ac0d1aa0 0x7f29ac1f5f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:05.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.707+0000 7f29b3947640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29ac160450 0x7f29ac1f6440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:05.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.707+0000 7f29b3947640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac0c9fd0 con 0x7f29ac160450 2023-12-20T04:45:05.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.707+0000 7f29b3947640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac15e950 con 0x7f29ac0d1aa0 2023-12-20T04:45:05.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.707+0000 7f29b3947640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f29ac15ec30 con 0x7f29ac0b4980 2023-12-20T04:45:05.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.707+0000 7f29b1ee4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29ac160450 0x7f29ac1f6440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:05.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.707+0000 7f29b1ee4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29ac160450 0x7f29ac1f6440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48704/0 (socket says 172.21.15.132:48704) 2023-12-20T04:45:05.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.707+0000 7f29b1ee4640 1 -- 172.21.15.132:0/1492454357 learned_addr learned my addr 172.21.15.132:0/1492454357 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:05.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.708+0000 7f29b0ee2640 1 --2- 172.21.15.132:0/1492454357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ac0d1aa0 0x7f29ac1f5f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:05.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.708+0000 7f29b1ee4640 1 -- 172.21.15.132:0/1492454357 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac0b4980 msgr2=0x7f29ac152260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:05.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.708+0000 7f29b1ee4640 1 --2- 172.21.15.132:0/1492454357 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac0b4980 0x7f29ac152260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:05.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.708+0000 7f29b1ee4640 1 -- 172.21.15.132:0/1492454357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ac0d1aa0 msgr2=0x7f29ac1f5f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:05.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.708+0000 7f29b1ee4640 1 --2- 172.21.15.132:0/1492454357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ac0d1aa0 0x7f29ac1f5f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:05.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.708+0000 7f29b1ee4640 1 -- 172.21.15.132:0/1492454357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f299c0094d0 con 0x7f29ac160450 2023-12-20T04:45:05.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.708+0000 7f29b1ee4640 1 --2- 172.21.15.132:0/1492454357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29ac160450 0x7f29ac1f6440 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f29a400c410 tx=0x7f29a400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:05.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.708+0000 7f29a1ffb640 1 -- 172.21.15.132:0/1492454357 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a4011790 con 0x7f29ac160450 2023-12-20T04:45:05.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.708+0000 7f29a1ffb640 1 -- 172.21.15.132:0/1492454357 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f29a40118f0 con 0x7f29ac160450 2023-12-20T04:45:05.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.708+0000 7f29a1ffb640 1 -- 172.21.15.132:0/1492454357 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f29a4011ce0 con 0x7f29ac160450 2023-12-20T04:45:05.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.708+0000 7f29b3947640 1 -- 172.21.15.132:0/1492454357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29ac15ef10 con 0x7f29ac160450 2023-12-20T04:45:05.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.708+0000 7f29b3947640 1 -- 172.21.15.132:0/1492454357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29ac1527a0 con 0x7f29ac160450 2023-12-20T04:45:05.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.709+0000 7f29b3947640 1 -- 172.21.15.132:0/1492454357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29ac152960 con 0x7f29ac160450 2023-12-20T04:45:05.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.710+0000 7f29a1ffb640 1 -- 172.21.15.132:0/1492454357 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f29a401c460 con 0x7f29ac160450 2023-12-20T04:45:05.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.710+0000 7f29a1ffb640 1 --2- 172.21.15.132:0/1492454357 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f299006a430 0x7f299006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:05.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.710+0000 7f29a1ffb640 1 -- 172.21.15.132:0/1492454357 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f29a4088280 con 0x7f29ac160450 2023-12-20T04:45:05.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.710+0000 7f29b16e3640 1 --2- 172.21.15.132:0/1492454357 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f299006a430 0x7f299006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:05.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.710+0000 7f29b16e3640 1 --2- 172.21.15.132:0/1492454357 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f299006a430 0x7f299006c8f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f29a8007fd0 tx=0x7f29a8007d40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:05.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.714+0000 7f29a1ffb640 1 -- 172.21.15.132:0/1492454357 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f29ac152960 con 0x7f29ac160450 2023-12-20T04:45:05.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.941+0000 7f29b3947640 1 -- 172.21.15.132:0/1492454357 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f29ac152960 con 0x7f29ac160450 2023-12-20T04:45:05.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.941+0000 7f29a1ffb640 1 -- 172.21.15.132:0/1492454357 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v14) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f29ac152960 con 0x7f29ac160450 2023-12-20T04:45:05.943 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:45:05.943 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:45:05.943 INFO:teuthology.orchestra.run.smithi132.stdout: "auth_dump": [ 2023-12-20T04:45:05.943 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.944 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.a", 2023-12-20T04:45:05.944 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlbTdZOxAAUDz0Eno9DYvrYM1xg5jG/A==", 2023-12-20T04:45:05.944 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.944 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:45:05.944 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:45:05.944 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:45:05.944 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:45:05.944 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.944 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.944 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.944 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.b", 2023-12-20T04:45:05.944 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl43gVDBAA1qJwUU+Ii4BalGf3NtJnGA==", 2023-12-20T04:45:05.944 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.944 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:45:05.944 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:45:05.945 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:45:05.945 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:45:05.945 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.945 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.945 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.945 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.c", 2023-12-20T04:45:05.945 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlaSUVBxAA7HN3dSo9xfvkjvc6bwMxWg==", 2023-12-20T04:45:05.945 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.945 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:45:05.945 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:45:05.945 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:45:05.945 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:45:05.945 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.946 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.946 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.d", 2023-12-20T04:45:05.946 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl1DR4ExAANNOyGlf1Ayre/xZEb9JHYg==", 2023-12-20T04:45:05.946 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.946 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:45:05.946 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:45:05.946 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:45:05.946 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:45:05.946 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.946 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.946 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.0", 2023-12-20T04:45:05.946 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCucIJlwZfxORAAiT2g1poLu3OkmoyxNJQc8Q==", 2023-12-20T04:45:05.947 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.947 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:45:05.947 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:45:05.947 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:45:05.947 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.947 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.947 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.947 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.1", 2023-12-20T04:45:05.947 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlejHYBRAAKurKpW5gyOAQ+E4Su4xMSQ==", 2023-12-20T04:45:05.947 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.947 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:45:05.947 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:45:05.947 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:45:05.947 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.948 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.948 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.948 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.2", 2023-12-20T04:45:05.948 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlyfz8DBAA9a6tUjHF8IRIKeldwVFMcw==", 2023-12-20T04:45:05.948 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.948 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:45:05.948 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:45:05.948 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:45:05.948 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.948 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.948 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.948 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.3", 2023-12-20T04:45:05.948 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJllFEeFBAA6URrqUjQqHsrI5+qEBVs3g==", 2023-12-20T04:45:05.948 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.948 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:45:05.949 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:45:05.949 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:45:05.949 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.949 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.949 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.949 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.4", 2023-12-20T04:45:05.949 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlvGqcJhAAgn2wuSTwLT+TOHoE4iaVSg==", 2023-12-20T04:45:05.949 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.949 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:45:05.949 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:45:05.949 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:45:05.949 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.949 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.950 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.950 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.5", 2023-12-20T04:45:05.950 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlWrkTLhAA2KlpxTFPaiXLCvmURpg5rw==", 2023-12-20T04:45:05.950 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.950 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:45:05.950 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:45:05.950 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:45:05.950 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.950 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.950 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.950 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.6", 2023-12-20T04:45:05.950 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlnOQfNRAA//EVx0BZYQd7ovK2tFhgfA==", 2023-12-20T04:45:05.950 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.950 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:45:05.951 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:45:05.951 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:45:05.951 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.951 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.951 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.7", 2023-12-20T04:45:05.951 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCzcIJl4nfDABAAtBdl2qkzKcqhmzsukC7G5w==", 2023-12-20T04:45:05.951 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.951 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:45:05.951 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:45:05.951 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:45:05.951 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.951 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.951 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.952 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.0", 2023-12-20T04:45:05.952 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlm/nGFxAA6zndayizc50Il7l74BxkgQ==", 2023-12-20T04:45:05.952 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.952 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:45:05.952 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow r", 2023-12-20T04:45:05.952 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-20T04:45:05.952 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.952 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.952 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.952 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.1", 2023-12-20T04:45:05.952 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlppb6IBAArqCoSlSE5coxkj4+XjPoWg==", 2023-12-20T04:45:05.952 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.952 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:45:05.952 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:45:05.953 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:45:05.953 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:45:05.953 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.953 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.953 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.953 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.2", 2023-12-20T04:45:05.953 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlMgWUHRAAqSdmRGx+9J+3dO7ntaApdw==", 2023-12-20T04:45:05.953 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.953 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:45:05.953 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:45:05.953 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:45:05.953 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:45:05.954 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.954 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.954 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.954 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.3", 2023-12-20T04:45:05.954 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlcIe3JhAAjv9KfknxwySJURWdePN7vw==", 2023-12-20T04:45:05.954 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.954 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:45:05.954 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:45:05.954 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:45:05.954 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:45:05.954 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.954 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.954 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.954 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.admin", 2023-12-20T04:45:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJljrTdHhAAsAlaFaKctSv71GrifKs6zA==", 2023-12-20T04:45:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:45:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:45:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:45:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:45:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.x", 2023-12-20T04:45:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJl+KnxNxAAM/b3mubTMYlB9QUbfcPW8g==", 2023-12-20T04:45:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:45:05.955 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:45:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:45:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.y", 2023-12-20T04:45:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlMyAMNBAAWpoBNevgGIkZ7zKEdKn3Ag==", 2023-12-20T04:45:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:45:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:45:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:45:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:45:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:05.956 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:45:05.956 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:45:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.943+0000 7f29b3947640 1 -- 172.21.15.132:0/1492454357 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f299006a430 msgr2=0x7f299006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.943+0000 7f29b3947640 1 --2- 172.21.15.132:0/1492454357 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f299006a430 0x7f299006c8f0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f29a8007fd0 tx=0x7f29a8007d40 comp rx=0 tx=0).stop 2023-12-20T04:45:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.943+0000 7f29b3947640 1 -- 172.21.15.132:0/1492454357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29ac160450 msgr2=0x7f29ac1f6440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.943+0000 7f29b3947640 1 --2- 172.21.15.132:0/1492454357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29ac160450 0x7f29ac1f6440 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f29a400c410 tx=0x7f29a400c8d0 comp rx=0 tx=0).stop 2023-12-20T04:45:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.943+0000 7f29b3947640 1 -- 172.21.15.132:0/1492454357 shutdown_connections 2023-12-20T04:45:05.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.943+0000 7f29b3947640 1 --2- 172.21.15.132:0/1492454357 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f299006a430 0x7f299006c8f0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:05.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.943+0000 7f29b3947640 1 --2- 172.21.15.132:0/1492454357 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f29ac160450 0x7f29ac1f6440 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:05.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.943+0000 7f29b3947640 1 --2- 172.21.15.132:0/1492454357 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f29ac0d1aa0 0x7f29ac1f5f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:05.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.943+0000 7f29b3947640 1 --2- 172.21.15.132:0/1492454357 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f29ac0b4980 0x7f29ac152260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:05.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.943+0000 7f29b3947640 1 -- 172.21.15.132:0/1492454357 >> 172.21.15.132:0/1492454357 conn(0x7f29ac0cf980 msgr2=0x7f29ac0cdb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:05.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.943+0000 7f29b3947640 1 -- 172.21.15.132:0/1492454357 shutdown_connections 2023-12-20T04:45:05.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:05.943+0000 7f29b3947640 1 -- 172.21.15.132:0/1492454357 wait complete. 2023-12-20T04:45:05.959 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:45:06.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.057+0000 7faab1f1b640 1 Processor -- start 2023-12-20T04:45:06.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.057+0000 7faab1f1b640 1 -- start start 2023-12-20T04:45:06.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.058+0000 7faab1f1b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaac13cce0 0x7faaac159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.058+0000 7faab1f1b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faaac15a1d0 0x7faaac06c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.058+0000 7faab1f1b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faaac15aa30 con 0x7faaac0c92d0 2023-12-20T04:45:06.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.058+0000 7faab1f1b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faaac06b260 con 0x7faaac15a1d0 2023-12-20T04:45:06.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.058+0000 7faab1f1b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac06b540 con 0x7faaac13cce0 2023-12-20T04:45:06.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.058+0000 7faaaaffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaac13cce0 0x7faaac159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.058+0000 7faaabfff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faaac15a1d0 0x7faaac06c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.058+0000 7faaaaffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaac13cce0 0x7faaac159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:48878/0 (socket says 172.21.15.132:48878) 2023-12-20T04:45:06.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.058+0000 7faaab7fe640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7faaac0c92d0 0x7faaac0c96b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:35872/0 (socket says 172.21.15.132:35872) 2023-12-20T04:45:06.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.058+0000 7faaabfff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faaac15a1d0 0x7faaac06c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:38146/0 (socket says 172.21.15.132:38146) 2023-12-20T04:45:06.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.058+0000 7faaaaffd640 1 -- 172.21.15.132:0/363628761 learned_addr learned my addr 172.21.15.132:0/363628761 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:06.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.059+0000 7faaabfff640 1 -- 172.21.15.132:0/363628761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaac13cce0 msgr2=0x7faaac159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:06.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.059+0000 7faaabfff640 1 --2- 172.21.15.132:0/363628761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaac13cce0 0x7faaac159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.059+0000 7faaabfff640 1 -- 172.21.15.132:0/363628761 >> v1:172.21.15.187:6789/0 conn(0x7faaac0c92d0 legacy=0x7faaac0c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.059+0000 7faaabfff640 1 -- 172.21.15.132:0/363628761 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaac06b820 con 0x7faaac15a1d0 2023-12-20T04:45:06.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.059+0000 7faaaaffd640 1 --2- 172.21.15.132:0/363628761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaac13cce0 0x7faaac159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:45:06.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.059+0000 7faaabfff640 1 --2- 172.21.15.132:0/363628761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaac15a1d0 0x7faaac06c020 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faaa4009d90 tx=0x7faaa402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=396475737f24cc0e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:06.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.060+0000 7faaaa7fc640 1 -- 172.21.15.132:0/363628761 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa402cbc0 con 0x7faaac15a1d0 2023-12-20T04:45:06.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.060+0000 7faaaa7fc640 1 -- 172.21.15.132:0/363628761 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa402cd20 con 0x7faaac15a1d0 2023-12-20T04:45:06.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.060+0000 7faaaa7fc640 1 -- 172.21.15.132:0/363628761 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa4034660 con 0x7faaac15a1d0 2023-12-20T04:45:06.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.060+0000 7faab1f1b640 1 -- 172.21.15.132:0/363628761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaac15a1d0 msgr2=0x7faaac06c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.060+0000 7faab1f1b640 1 --2- 172.21.15.132:0/363628761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaac15a1d0 0x7faaac06c020 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7faaa4009d90 tx=0x7faaa402be10 comp rx=0 tx=0).stop 2023-12-20T04:45:06.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.060+0000 7faab1f1b640 1 -- 172.21.15.132:0/363628761 shutdown_connections 2023-12-20T04:45:06.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.060+0000 7faab1f1b640 1 --2- 172.21.15.132:0/363628761 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaac15a1d0 0x7faaac06c020 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.060+0000 7faab1f1b640 1 --2- 172.21.15.132:0/363628761 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaac13cce0 0x7faaac159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.060+0000 7faab1f1b640 1 -- 172.21.15.132:0/363628761 >> 172.21.15.132:0/363628761 conn(0x7faaac0ced10 msgr2=0x7faaac0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:06.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.060+0000 7faab1f1b640 1 -- 172.21.15.132:0/363628761 shutdown_connections 2023-12-20T04:45:06.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.060+0000 7faab1f1b640 1 -- 172.21.15.132:0/363628761 wait complete. 2023-12-20T04:45:06.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.061+0000 7faab1f1b640 1 Processor -- start 2023-12-20T04:45:06.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.062+0000 7faab1f1b640 1 -- start start 2023-12-20T04:45:06.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.062+0000 7faab1f1b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaac0c92d0 0x7faaac1539a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.062+0000 7faab1f1b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaac13cce0 0x7faaac0b0650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.062+0000 7faab1f1b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaac15a1d0 0x7faaac157960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.062+0000 7faab1f1b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac0c6b70 con 0x7faaac15a1d0 2023-12-20T04:45:06.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.062+0000 7faab1f1b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faaac0c5ef0 con 0x7faaac0c92d0 2023-12-20T04:45:06.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.062+0000 7faab1f1b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faaac0c61d0 con 0x7faaac13cce0 2023-12-20T04:45:06.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.062+0000 7faaabfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaac15a1d0 0x7faaac157960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.062+0000 7faaabfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaac15a1d0 0x7faaac157960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48712/0 (socket says 172.21.15.132:48712) 2023-12-20T04:45:06.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.062+0000 7faaabfff640 1 -- 172.21.15.132:0/3395501931 learned_addr learned my addr 172.21.15.132:0/3395501931 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:06.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.063+0000 7faaab7fe640 1 --2- 172.21.15.132:0/3395501931 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaac0c92d0 0x7faaac1539a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.063+0000 7faaaaffd640 1 --2- 172.21.15.132:0/3395501931 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaac13cce0 0x7faaac0b0650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.063+0000 7faaabfff640 1 -- 172.21.15.132:0/3395501931 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaac13cce0 msgr2=0x7faaac0b0650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.063+0000 7faaabfff640 1 --2- 172.21.15.132:0/3395501931 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaac13cce0 0x7faaac0b0650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.063+0000 7faaabfff640 1 -- 172.21.15.132:0/3395501931 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaac0c92d0 msgr2=0x7faaac1539a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.063+0000 7faaabfff640 1 --2- 172.21.15.132:0/3395501931 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaac0c92d0 0x7faaac1539a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.063+0000 7faaabfff640 1 -- 172.21.15.132:0/3395501931 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faaa00094d0 con 0x7faaac15a1d0 2023-12-20T04:45:06.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.063+0000 7faaab7fe640 1 --2- 172.21.15.132:0/3395501931 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaac0c92d0 0x7faaac1539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:45:06.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.063+0000 7faaaaffd640 1 --2- 172.21.15.132:0/3395501931 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaac13cce0 0x7faaac0b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:45:06.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.063+0000 7faaabfff640 1 --2- 172.21.15.132:0/3395501931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaac15a1d0 0x7faaac157960 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7faaa4009d90 tx=0x7faaa4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:06.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.063+0000 7faa93fff640 1 -- 172.21.15.132:0/3395501931 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa403e610 con 0x7faaac15a1d0 2023-12-20T04:45:06.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.063+0000 7faa93fff640 1 -- 172.21.15.132:0/3395501931 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faaa402ce90 con 0x7faaac15a1d0 2023-12-20T04:45:06.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.063+0000 7faab1f1b640 1 -- 172.21.15.132:0/3395501931 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faaa4009a70 con 0x7faaac15a1d0 2023-12-20T04:45:06.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.063+0000 7faa93fff640 1 -- 172.21.15.132:0/3395501931 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faaa403e9b0 con 0x7faaac15a1d0 2023-12-20T04:45:06.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.063+0000 7faab1f1b640 1 -- 172.21.15.132:0/3395501931 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faaac0c6790 con 0x7faaac15a1d0 2023-12-20T04:45:06.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.064+0000 7faab1f1b640 1 -- 172.21.15.132:0/3395501931 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faaac0b31a0 con 0x7faaac15a1d0 2023-12-20T04:45:06.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.065+0000 7faa93fff640 1 -- 172.21.15.132:0/3395501931 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faaa403b050 con 0x7faaac15a1d0 2023-12-20T04:45:06.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.065+0000 7faa93fff640 1 --2- 172.21.15.132:0/3395501931 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa9806a430 0x7faa9806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.065+0000 7faa93fff640 1 -- 172.21.15.132:0/3395501931 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4857+0+0 (secure 0 0 0) 0x7faaa40aac70 con 0x7faaac15a1d0 2023-12-20T04:45:06.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.065+0000 7faaab7fe640 1 --2- 172.21.15.132:0/3395501931 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa9806a430 0x7faa9806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.066+0000 7faaab7fe640 1 --2- 172.21.15.132:0/3395501931 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa9806a430 0x7faa9806c8f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faa9c000f60 tx=0x7faa9c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:06.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.069+0000 7faa93fff640 1 -- 172.21.15.132:0/3395501931 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7faaac0b31a0 con 0x7faaac15a1d0 2023-12-20T04:45:06.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.238+0000 7faab1f1b640 1 -- 172.21.15.132:0/3395501931 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faaac0b31a0 con 0x7faaac15a1d0 2023-12-20T04:45:06.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.239+0000 7faa93fff640 1 -- 172.21.15.132:0/3395501931 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v61) v1 ==== 74+0+12437 (secure 0 0 0) 0x7faaac0b31a0 con 0x7faaac15a1d0 2023-12-20T04:45:06.241 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:45:06.241 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":61,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:45:05.579940+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":7,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":48,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:45:06.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.241+0000 7faab1f1b640 1 -- 172.21.15.132:0/3395501931 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa9806a430 msgr2=0x7faa9806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.241+0000 7faab1f1b640 1 --2- 172.21.15.132:0/3395501931 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa9806a430 0x7faa9806c8f0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7faa9c000f60 tx=0x7faa9c009040 comp rx=0 tx=0).stop 2023-12-20T04:45:06.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.241+0000 7faab1f1b640 1 -- 172.21.15.132:0/3395501931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaac15a1d0 msgr2=0x7faaac157960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.241+0000 7faab1f1b640 1 --2- 172.21.15.132:0/3395501931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaac15a1d0 0x7faaac157960 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7faaa4009d90 tx=0x7faaa4004a40 comp rx=0 tx=0).stop 2023-12-20T04:45:06.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.241+0000 7faab1f1b640 1 -- 172.21.15.132:0/3395501931 shutdown_connections 2023-12-20T04:45:06.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.241+0000 7faab1f1b640 1 --2- 172.21.15.132:0/3395501931 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa9806a430 0x7faa9806c8f0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.241+0000 7faab1f1b640 1 --2- 172.21.15.132:0/3395501931 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faaac15a1d0 0x7faaac157960 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.241+0000 7faab1f1b640 1 --2- 172.21.15.132:0/3395501931 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faaac13cce0 0x7faaac0b0650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.241+0000 7faab1f1b640 1 --2- 172.21.15.132:0/3395501931 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faaac0c92d0 0x7faaac1539a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.241+0000 7faab1f1b640 1 -- 172.21.15.132:0/3395501931 >> 172.21.15.132:0/3395501931 conn(0x7faaac0ced10 msgr2=0x7faaac15cff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:06.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.241+0000 7faab1f1b640 1 -- 172.21.15.132:0/3395501931 shutdown_connections 2023-12-20T04:45:06.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.241+0000 7faab1f1b640 1 -- 172.21.15.132:0/3395501931 wait complete. 2023-12-20T04:45:06.254 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '53', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:45:06.255 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:45:06.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.355+0000 7fae392b6640 1 Processor -- start 2023-12-20T04:45:06.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.355+0000 7fae392b6640 1 -- start start 2023-12-20T04:45:06.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.356+0000 7fae392b6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fae3406a340 0x7fae340ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.356+0000 7fae392b6640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae340c4f40 con 0x7fae341447b0 2023-12-20T04:45:06.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.356+0000 7fae392b6640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fae34144b90 con 0x7fae340ca170 2023-12-20T04:45:06.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.356+0000 7fae392b6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fae340c6380 con 0x7fae3406a340 2023-12-20T04:45:06.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.356+0000 7fae337fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fae3406a340 0x7fae340ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.356+0000 7fae32ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fae341447b0 0x7fae340c5c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52540/0 (socket says 172.21.15.132:52540) 2023-12-20T04:45:06.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.356+0000 7fae337fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fae3406a340 0x7fae340ca5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48720/0 (socket says 172.21.15.132:48720) 2023-12-20T04:45:06.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.356+0000 7fae32ffd640 1 -- 172.21.15.132:0/2629262988 learned_addr learned my addr 172.21.15.132:0/2629262988 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:45:06.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.357+0000 7fae337fe640 1 -- 172.21.15.132:0/2629262988 >> v1:172.21.15.187:6789/0 conn(0x7fae340ca170 legacy=0x7fae34069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:06.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.357+0000 7fae337fe640 1 -- 172.21.15.132:0/2629262988 >> v1:172.21.15.132:6789/0 conn(0x7fae341447b0 legacy=0x7fae340c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.357+0000 7fae31ffb640 1 -- 172.21.15.132:0/2629262988 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 44982706 0 0) 0x7fae340c4f40 con 0x7fae341447b0 2023-12-20T04:45:06.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.357+0000 7fae337fe640 1 -- 172.21.15.132:0/2629262988 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae340cac30 con 0x7fae3406a340 2023-12-20T04:45:06.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.357+0000 7fae337fe640 1 --2- 172.21.15.132:0/2629262988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3406a340 0x7fae340ca5d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0097a0 tx=0x7fae2c02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7082cacb751519 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:06.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.357+0000 7fae31ffb640 1 -- 172.21.15.132:0/2629262988 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c02e070 con 0x7fae3406a340 2023-12-20T04:45:06.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.357+0000 7fae31ffb640 1 -- 172.21.15.132:0/2629262988 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2c0315a0 con 0x7fae3406a340 2023-12-20T04:45:06.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.357+0000 7fae31ffb640 1 -- 172.21.15.132:0/2629262988 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2c031930 con 0x7fae3406a340 2023-12-20T04:45:06.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.358+0000 7fae392b6640 1 -- 172.21.15.132:0/2629262988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3406a340 msgr2=0x7fae340ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.358+0000 7fae392b6640 1 --2- 172.21.15.132:0/2629262988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3406a340 0x7fae340ca5d0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7fae2c0097a0 tx=0x7fae2c02b840 comp rx=0 tx=0).stop 2023-12-20T04:45:06.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.358+0000 7fae392b6640 1 -- 172.21.15.132:0/2629262988 shutdown_connections 2023-12-20T04:45:06.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.358+0000 7fae392b6640 1 --2- 172.21.15.132:0/2629262988 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3406a340 0x7fae340ca5d0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.358+0000 7fae392b6640 1 -- 172.21.15.132:0/2629262988 >> 172.21.15.132:0/2629262988 conn(0x7fae340cc630 msgr2=0x7fae340cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:06.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.358+0000 7fae392b6640 1 -- 172.21.15.132:0/2629262988 shutdown_connections 2023-12-20T04:45:06.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.358+0000 7fae392b6640 1 -- 172.21.15.132:0/2629262988 wait complete. 2023-12-20T04:45:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.359+0000 7fae392b6640 1 Processor -- start 2023-12-20T04:45:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.359+0000 7fae392b6640 1 -- start start 2023-12-20T04:45:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.360+0000 7fae392b6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3406a340 0x7fae3415c000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.360+0000 7fae392b6640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae340ca170 0x7fae340706d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.360+0000 7fae392b6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae341447b0 0x7fae3413f1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.360+0000 7fae392b6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3415d0f0 con 0x7fae3406a340 2023-12-20T04:45:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.360+0000 7fae392b6640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae3415c850 con 0x7fae340ca170 2023-12-20T04:45:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.360+0000 7fae392b6640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fae3415cb30 con 0x7fae341447b0 2023-12-20T04:45:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.360+0000 7fae32ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3406a340 0x7fae3415c000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.360+0000 7fae32ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3406a340 0x7fae3415c000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48722/0 (socket says 172.21.15.132:48722) 2023-12-20T04:45:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.360+0000 7fae32ffd640 1 -- 172.21.15.132:0/4019138565 learned_addr learned my addr 172.21.15.132:0/4019138565 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.360+0000 7fae32ffd640 1 -- 172.21.15.132:0/4019138565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae341447b0 msgr2=0x7fae3413f1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.360+0000 7fae32ffd640 1 --2- 172.21.15.132:0/4019138565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae341447b0 0x7fae3413f1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.360+0000 7fae32ffd640 1 -- 172.21.15.132:0/4019138565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae340ca170 msgr2=0x7fae340706d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.360+0000 7fae32ffd640 1 --2- 172.21.15.132:0/4019138565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae340ca170 0x7fae340706d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.360+0000 7fae32ffd640 1 -- 172.21.15.132:0/4019138565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae2c009400 con 0x7fae3406a340 2023-12-20T04:45:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.361+0000 7fae32ffd640 1 --2- 172.21.15.132:0/4019138565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3406a340 0x7fae3415c000 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fae2400c890 tx=0x7fae2400cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.361+0000 7fae1b7fe640 1 -- 172.21.15.132:0/4019138565 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2400a640 con 0x7fae3406a340 2023-12-20T04:45:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.361+0000 7fae1b7fe640 1 -- 172.21.15.132:0/4019138565 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fae2400a7c0 con 0x7fae3406a340 2023-12-20T04:45:06.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.361+0000 7fae1b7fe640 1 -- 172.21.15.132:0/4019138565 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fae2400ab70 con 0x7fae3406a340 2023-12-20T04:45:06.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.361+0000 7fae392b6640 1 -- 172.21.15.132:0/4019138565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae3415ce10 con 0x7fae3406a340 2023-12-20T04:45:06.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.361+0000 7fae392b6640 1 -- 172.21.15.132:0/4019138565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae3415c540 con 0x7fae3406a340 2023-12-20T04:45:06.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.362+0000 7fae392b6640 1 -- 172.21.15.132:0/4019138565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae340b3f10 con 0x7fae3406a340 2023-12-20T04:45:06.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.362+0000 7fae1b7fe640 1 -- 172.21.15.132:0/4019138565 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fae2400acd0 con 0x7fae3406a340 2023-12-20T04:45:06.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.362+0000 7fae1b7fe640 1 --2- 172.21.15.132:0/4019138565 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fae2006a430 0x7fae2006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.363+0000 7fae1b7fe640 1 -- 172.21.15.132:0/4019138565 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fae24087af0 con 0x7fae3406a340 2023-12-20T04:45:06.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.363+0000 7fae327fc640 1 --2- 172.21.15.132:0/4019138565 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fae2006a430 0x7fae2006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.363+0000 7fae327fc640 1 --2- 172.21.15.132:0/4019138565 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fae2006a430 0x7fae2006c8f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fae340c9bb0 tx=0x7fae28006ba0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:06.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.367+0000 7fae1b7fe640 1 -- 172.21.15.132:0/4019138565 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fae340b3f10 con 0x7fae3406a340 2023-12-20T04:45:06.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.531+0000 7fae392b6640 1 -- 172.21.15.132:0/4019138565 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fae340b3f10 con 0x7fae3406a340 2023-12-20T04:45:06.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.532+0000 7fae1b7fe640 1 -- 172.21.15.132:0/4019138565 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v61) v1 ==== 93+0+10 (secure 0 0 0) 0x7fae340b3f10 con 0x7fae3406a340 2023-12-20T04:45:06.534 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:45:06.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.534+0000 7fae392b6640 1 -- 172.21.15.132:0/4019138565 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fae2006a430 msgr2=0x7fae2006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.534+0000 7fae392b6640 1 --2- 172.21.15.132:0/4019138565 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fae2006a430 0x7fae2006c8f0 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fae340c9bb0 tx=0x7fae28006ba0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.534+0000 7fae392b6640 1 -- 172.21.15.132:0/4019138565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3406a340 msgr2=0x7fae3415c000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.534+0000 7fae392b6640 1 --2- 172.21.15.132:0/4019138565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3406a340 0x7fae3415c000 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7fae2400c890 tx=0x7fae2400cd50 comp rx=0 tx=0).stop 2023-12-20T04:45:06.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.534+0000 7fae392b6640 1 -- 172.21.15.132:0/4019138565 shutdown_connections 2023-12-20T04:45:06.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.534+0000 7fae392b6640 1 --2- 172.21.15.132:0/4019138565 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fae2006a430 0x7fae2006c8f0 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.534+0000 7fae392b6640 1 --2- 172.21.15.132:0/4019138565 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fae341447b0 0x7fae3413f1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.534+0000 7fae392b6640 1 --2- 172.21.15.132:0/4019138565 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fae340ca170 0x7fae340706d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.534+0000 7fae392b6640 1 --2- 172.21.15.132:0/4019138565 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fae3406a340 0x7fae3415c000 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.534+0000 7fae392b6640 1 -- 172.21.15.132:0/4019138565 >> 172.21.15.132:0/4019138565 conn(0x7fae340cc630 msgr2=0x7fae34069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:06.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.534+0000 7fae392b6640 1 -- 172.21.15.132:0/4019138565 shutdown_connections 2023-12-20T04:45:06.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.534+0000 7fae392b6640 1 -- 172.21.15.132:0/4019138565 wait complete. 2023-12-20T04:45:06.547 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-20T04:45:06.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.644+0000 7fc8f3882640 1 Processor -- start 2023-12-20T04:45:06.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.644+0000 7fc8f3882640 1 -- start start 2023-12-20T04:45:06.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.645+0000 7fc8f3882640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8ec15ad80 0x7fc8ec0b0960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.645+0000 7fc8f3882640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc8ec0b0ea0 0x7fc8ec070ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.645+0000 7fc8f3882640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8ec0b1300 con 0x7fc8ec071410 2023-12-20T04:45:06.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.645+0000 7fc8f3882640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8ec0cd7b0 con 0x7fc8ec0b0ea0 2023-12-20T04:45:06.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.645+0000 7fc8f3882640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0ca540 con 0x7fc8ec15ad80 2023-12-20T04:45:06.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.645+0000 7fc8f1e1f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc8ec071410 0x7fc8ec15ea40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52550/0 (socket says 172.21.15.132:52550) 2023-12-20T04:45:06.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.645+0000 7fc8f1e1f640 1 -- 172.21.15.132:0/2884037672 learned_addr learned my addr 172.21.15.132:0/2884037672 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:45:06.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8f0e1d640 1 --2- 172.21.15.132:0/2884037672 >> v2:172.21.15.187:3300/0 conn(0x7fc8ec0b0ea0 0x7fc8ec070ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8e3fff640 1 -- 172.21.15.132:0/2884037672 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3940367811 0 0) 0x7fc8ec0b1300 con 0x7fc8ec071410 2023-12-20T04:45:06.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8f161e640 1 --2- 172.21.15.132:0/2884037672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8ec15ad80 0x7fc8ec0b0960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8e3fff640 1 -- 172.21.15.132:0/2884037672 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc8d8003520 con 0x7fc8ec071410 2023-12-20T04:45:06.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8e3fff640 1 -- 172.21.15.132:0/2884037672 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4102883007 0 0) 0x7fc8d8003520 con 0x7fc8ec071410 2023-12-20T04:45:06.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8e3fff640 1 -- 172.21.15.132:0/2884037672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8ec15ad80 msgr2=0x7fc8ec0b0960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:06.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8e3fff640 1 --2- 172.21.15.132:0/2884037672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8ec15ad80 0x7fc8ec0b0960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8e3fff640 1 -- 172.21.15.132:0/2884037672 >> v2:172.21.15.187:3300/0 conn(0x7fc8ec0b0ea0 msgr2=0x7fc8ec070ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:06.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8e3fff640 1 --2- 172.21.15.132:0/2884037672 >> v2:172.21.15.187:3300/0 conn(0x7fc8ec0b0ea0 0x7fc8ec070ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8e3fff640 1 -- 172.21.15.132:0/2884037672 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec0cb670 con 0x7fc8ec071410 2023-12-20T04:45:06.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8e3fff640 1 -- 172.21.15.132:0/2884037672 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fc8e4001670 con 0x7fc8ec071410 2023-12-20T04:45:06.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8e3fff640 1 -- 172.21.15.132:0/2884037672 >> v1:172.21.15.132:6789/0 conn(0x7fc8ec071410 legacy=0x7fc8ec15ea40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8e3fff640 1 --2- 172.21.15.132:0/2884037672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8d8003970 0x7fc8d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8e3fff640 1 --2- 172.21.15.132:0/2884037672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8ec15ad80 0x7fc8d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8e3fff640 1 --2- 172.21.15.132:0/2884037672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8d8004d00 0x7fc8d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8e3fff640 1 -- 172.21.15.132:0/2884037672 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0cd7b0 con 0x7fc8d8004d00 2023-12-20T04:45:06.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8e3fff640 1 -- 172.21.15.132:0/2884037672 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0ca540 con 0x7fc8d8003970 2023-12-20T04:45:06.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8e3fff640 1 -- 172.21.15.132:0/2884037672 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8d800b980 con 0x7fc8ec15ad80 2023-12-20T04:45:06.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8f1e1f640 1 --2- 172.21.15.132:0/2884037672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8d8004d00 0x7fc8d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8f0e1d640 1 --2- 172.21.15.132:0/2884037672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8ec15ad80 0x7fc8d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8f161e640 1 --2- 172.21.15.132:0/2884037672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8d8003970 0x7fc8d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8f1e1f640 1 -- 172.21.15.132:0/2884037672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8ec15ad80 msgr2=0x7fc8d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:06.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8f1e1f640 1 --2- 172.21.15.132:0/2884037672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8ec15ad80 0x7fc8d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8f1e1f640 1 -- 172.21.15.132:0/2884037672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8d8003970 msgr2=0x7fc8d8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:06.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8f1e1f640 1 --2- 172.21.15.132:0/2884037672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8d8003970 0x7fc8d8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.646+0000 7fc8f1e1f640 1 -- 172.21.15.132:0/2884037672 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8d8003520 con 0x7fc8d8004d00 2023-12-20T04:45:06.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.647+0000 7fc8f1e1f640 1 --2- 172.21.15.132:0/2884037672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8d8004d00 0x7fc8d8005180 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400c210 tx=0x7fc8d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9595f86ffb7d855b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:06.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.647+0000 7fc8e3fff640 1 -- 172.21.15.132:0/2884037672 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e402cae0 con 0x7fc8d8004d00 2023-12-20T04:45:06.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.647+0000 7fc8e3fff640 1 -- 172.21.15.132:0/2884037672 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8e402cc40 con 0x7fc8d8004d00 2023-12-20T04:45:06.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.647+0000 7fc8e3fff640 1 -- 172.21.15.132:0/2884037672 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8e40058d0 con 0x7fc8d8004d00 2023-12-20T04:45:06.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.648+0000 7fc8f3882640 1 -- 172.21.15.132:0/2884037672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8d8004d00 msgr2=0x7fc8d8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.648+0000 7fc8f3882640 1 --2- 172.21.15.132:0/2884037672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8d8004d00 0x7fc8d8005180 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fc8e400c210 tx=0x7fc8d80057f0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.648+0000 7fc8f1e1f640 1 -- 172.21.15.132:0/2884037672 reap_dead start 2023-12-20T04:45:06.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.648+0000 7fc8f3882640 1 -- 172.21.15.132:0/2884037672 shutdown_connections 2023-12-20T04:45:06.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.648+0000 7fc8f3882640 1 -- 172.21.15.132:0/2884037672 >> 172.21.15.132:0/2884037672 conn(0x7fc8ec0cb960 msgr2=0x7fc8ec0cbd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:06.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.648+0000 7fc8f3882640 1 -- 172.21.15.132:0/2884037672 shutdown_connections 2023-12-20T04:45:06.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.648+0000 7fc8f3882640 1 -- 172.21.15.132:0/2884037672 wait complete. 2023-12-20T04:45:06.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.649+0000 7fc8f3882640 1 Processor -- start 2023-12-20T04:45:06.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.649+0000 7fc8f3882640 1 -- start start 2023-12-20T04:45:06.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f3882640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8d8004d00 0x7fc8ec09cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f3882640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8ec157950 0x7fc8ec157dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f3882640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8ec0abd90 0x7fc8ec0ac240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f3882640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec0ac780 con 0x7fc8ec157950 2023-12-20T04:45:06.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f3882640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec1586b0 con 0x7fc8d8004d00 2023-12-20T04:45:06.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f3882640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8ec09ab10 con 0x7fc8ec0abd90 2023-12-20T04:45:06.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f0e1d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8ec157950 0x7fc8ec157dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f0e1d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8ec157950 0x7fc8ec157dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48728/0 (socket says 172.21.15.132:48728) 2023-12-20T04:45:06.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f0e1d640 1 -- 172.21.15.132:0/4000682404 learned_addr learned my addr 172.21.15.132:0/4000682404 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:06.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f161e640 1 --2- 172.21.15.132:0/4000682404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8d8004d00 0x7fc8ec09cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f1e1f640 1 --2- 172.21.15.132:0/4000682404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8ec0abd90 0x7fc8ec0ac240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f0e1d640 1 -- 172.21.15.132:0/4000682404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8ec0abd90 msgr2=0x7fc8ec0ac240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f0e1d640 1 --2- 172.21.15.132:0/4000682404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8ec0abd90 0x7fc8ec0ac240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f0e1d640 1 -- 172.21.15.132:0/4000682404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8d8004d00 msgr2=0x7fc8ec09cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f0e1d640 1 --2- 172.21.15.132:0/4000682404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8d8004d00 0x7fc8ec09cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f0e1d640 1 -- 172.21.15.132:0/4000682404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8ec1ea500 con 0x7fc8ec157950 2023-12-20T04:45:06.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f161e640 1 --2- 172.21.15.132:0/4000682404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8d8004d00 0x7fc8ec09cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:45:06.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f0e1d640 1 --2- 172.21.15.132:0/4000682404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8ec157950 0x7fc8ec157dd0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc011a70 tx=0x7fc8dc011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:06.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8e1ffb640 1 -- 172.21.15.132:0/4000682404 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc009680 con 0x7fc8ec157950 2023-12-20T04:45:06.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8e1ffb640 1 -- 172.21.15.132:0/4000682404 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8dc00fb50 con 0x7fc8ec157950 2023-12-20T04:45:06.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8f3882640 1 -- 172.21.15.132:0/4000682404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8ec099be0 con 0x7fc8ec157950 2023-12-20T04:45:06.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.650+0000 7fc8e1ffb640 1 -- 172.21.15.132:0/4000682404 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8dc00fee0 con 0x7fc8ec157950 2023-12-20T04:45:06.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.651+0000 7fc8f3882640 1 -- 172.21.15.132:0/4000682404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8ec158cc0 con 0x7fc8ec157950 2023-12-20T04:45:06.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.651+0000 7fc8f3882640 1 -- 172.21.15.132:0/4000682404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8ec099e00 con 0x7fc8ec157950 2023-12-20T04:45:06.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.652+0000 7fc8e1ffb640 1 -- 172.21.15.132:0/4000682404 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc8dc014440 con 0x7fc8ec157950 2023-12-20T04:45:06.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.652+0000 7fc8e1ffb640 1 --2- 172.21.15.132:0/4000682404 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8d006a460 0x7fc8d006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.652+0000 7fc8e1ffb640 1 -- 172.21.15.132:0/4000682404 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc8dc088e70 con 0x7fc8ec157950 2023-12-20T04:45:06.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.652+0000 7fc8f161e640 1 --2- 172.21.15.132:0/4000682404 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8d006a460 0x7fc8d006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.653+0000 7fc8f161e640 1 --2- 172.21.15.132:0/4000682404 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8d006a460 0x7fc8d006c920 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec09bda0 tx=0x7fc8e800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:06.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.656+0000 7fc8e1ffb640 1 -- 172.21.15.132:0/4000682404 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc8dc0547b0 con 0x7fc8ec157950 2023-12-20T04:45:06.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.823+0000 7fc8f3882640 1 -- 172.21.15.132:0/4000682404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc8ec04e840 con 0x7fc8ec157950 2023-12-20T04:45:06.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.823+0000 7fc8e1ffb640 1 -- 172.21.15.132:0/4000682404 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v61) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc8dc022090 con 0x7fc8ec157950 2023-12-20T04:45:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:45:06.825 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-12-20T04:45:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:45:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-12-20T04:45:06.825 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-12-20T04:45:06.826 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:06.826 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-12-20T04:45:06.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.825+0000 7fc8f3882640 1 -- 172.21.15.132:0/4000682404 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8d006a460 msgr2=0x7fc8d006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.825+0000 7fc8f3882640 1 --2- 172.21.15.132:0/4000682404 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8d006a460 0x7fc8d006c920 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fc8ec09bda0 tx=0x7fc8e800b040 comp rx=0 tx=0).stop 2023-12-20T04:45:06.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.825+0000 7fc8f3882640 1 -- 172.21.15.132:0/4000682404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8ec157950 msgr2=0x7fc8ec157dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.825+0000 7fc8f3882640 1 --2- 172.21.15.132:0/4000682404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8ec157950 0x7fc8ec157dd0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fc8dc011a70 tx=0x7fc8dc011f30 comp rx=0 tx=0).stop 2023-12-20T04:45:06.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.825+0000 7fc8f3882640 1 -- 172.21.15.132:0/4000682404 shutdown_connections 2023-12-20T04:45:06.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.825+0000 7fc8f3882640 1 --2- 172.21.15.132:0/4000682404 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8d006a460 0x7fc8d006c920 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.825+0000 7fc8f3882640 1 --2- 172.21.15.132:0/4000682404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8ec0abd90 0x7fc8ec0ac240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.825+0000 7fc8f3882640 1 --2- 172.21.15.132:0/4000682404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8ec157950 0x7fc8ec157dd0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.825+0000 7fc8f3882640 1 --2- 172.21.15.132:0/4000682404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8d8004d00 0x7fc8ec09cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.825+0000 7fc8f3882640 1 -- 172.21.15.132:0/4000682404 >> 172.21.15.132:0/4000682404 conn(0x7fc8ec0cb960 msgr2=0x7fc8ec15a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:06.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.825+0000 7fc8f3882640 1 -- 172.21.15.132:0/4000682404 shutdown_connections 2023-12-20T04:45:06.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.825+0000 7fc8f3882640 1 -- 172.21.15.132:0/4000682404 wait complete. 2023-12-20T04:45:06.838 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-20T04:45:06.838 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-20T04:45:06.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.940+0000 7fa35eb00640 1 Processor -- start 2023-12-20T04:45:06.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.940+0000 7fa35eb00640 1 -- start start 2023-12-20T04:45:06.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa35eb00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa358071510 0x7fa3580cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa35eb00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3580cdcb0 con 0x7fa358069ea0 2023-12-20T04:45:06.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa35eb00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3580aed40 con 0x7fa358070890 2023-12-20T04:45:06.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa35eb00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa35806e8b0 con 0x7fa358071510 2023-12-20T04:45:06.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa35c89c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa358069ea0 0x7fa35806c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:52556/0 (socket says 172.21.15.132:52556) 2023-12-20T04:45:06.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa35c89c640 1 -- 172.21.15.132:0/3187529377 learned_addr learned my addr 172.21.15.132:0/3187529377 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:45:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa3577fe640 1 -- 172.21.15.132:0/3187529377 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3960289584 0 0) 0x7fa34c001110 con 0x7fa358069ea0 2023-12-20T04:45:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa3577fe640 1 -- 172.21.15.132:0/3187529377 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa348003520 con 0x7fa358069ea0 2023-12-20T04:45:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa357fff640 1 --2- 172.21.15.132:0/3187529377 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa358071510 0x7fa3580cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa3577fe640 1 -- 172.21.15.132:0/3187529377 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3997116606 0 0) 0x7fa348003520 con 0x7fa358069ea0 2023-12-20T04:45:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa3577fe640 1 -- 172.21.15.132:0/3187529377 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa358071510 msgr2=0x7fa3580cd770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa3577fe640 1 --2- 172.21.15.132:0/3187529377 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa358071510 0x7fa3580cd770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa3577fe640 1 -- 172.21.15.132:0/3187529377 >> v1:172.21.15.187:6789/0 conn(0x7fa358070890 legacy=0x7fa3580cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa3577fe640 1 -- 172.21.15.132:0/3187529377 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3580af020 con 0x7fa358069ea0 2023-12-20T04:45:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa3577fe640 1 -- 172.21.15.132:0/3187529377 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fa34c001800 con 0x7fa358069ea0 2023-12-20T04:45:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa357fff640 1 --2- 172.21.15.132:0/3187529377 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa358071510 0x7fa3580cd770 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:45:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa3577fe640 1 -- 172.21.15.132:0/3187529377 >> v1:172.21.15.132:6789/0 conn(0x7fa358069ea0 legacy=0x7fa35806c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa3577fe640 1 --2- 172.21.15.132:0/3187529377 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa358071510 0x7fa3480039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa3577fe640 1 --2- 172.21.15.132:0/3187529377 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa348003f90 0x7fa3480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa3577fe640 1 --2- 172.21.15.132:0/3187529377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa348004d00 0x7fa348005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa3577fe640 1 -- 172.21.15.132:0/3187529377 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa35806e8b0 con 0x7fa348004d00 2023-12-20T04:45:06.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa3577fe640 1 -- 172.21.15.132:0/3187529377 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa34800bae0 con 0x7fa348003f90 2023-12-20T04:45:06.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.941+0000 7fa3577fe640 1 -- 172.21.15.132:0/3187529377 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa34800bca0 con 0x7fa358071510 2023-12-20T04:45:06.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.942+0000 7fa35d09d640 1 --2- 172.21.15.132:0/3187529377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa348004d00 0x7fa348005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.942+0000 7fa35c89c640 1 --2- 172.21.15.132:0/3187529377 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa358071510 0x7fa3480039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.942+0000 7fa357fff640 1 --2- 172.21.15.132:0/3187529377 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa348003f90 0x7fa3480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.942+0000 7fa35d09d640 1 -- 172.21.15.132:0/3187529377 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa358071510 msgr2=0x7fa3480039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:06.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.942+0000 7fa35d09d640 1 --2- 172.21.15.132:0/3187529377 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa358071510 0x7fa3480039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.942+0000 7fa35d09d640 1 -- 172.21.15.132:0/3187529377 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa348003f90 msgr2=0x7fa3480047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:06.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.942+0000 7fa35d09d640 1 --2- 172.21.15.132:0/3187529377 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa348003f90 0x7fa3480047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.942+0000 7fa35d09d640 1 -- 172.21.15.132:0/3187529377 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa348003520 con 0x7fa348004d00 2023-12-20T04:45:06.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.942+0000 7fa357fff640 1 --2- 172.21.15.132:0/3187529377 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa348003f90 0x7fa3480047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:45:06.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.942+0000 7fa35d09d640 1 --2- 172.21.15.132:0/3187529377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa348004d00 0x7fa348005180 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa350001e50 tx=0x7fa3480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2924279ce4b977e2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:06.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.943+0000 7fa3577fe640 1 -- 172.21.15.132:0/3187529377 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa350003b70 con 0x7fa348004d00 2023-12-20T04:45:06.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.943+0000 7fa3577fe640 1 -- 172.21.15.132:0/3187529377 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa350003cd0 con 0x7fa348004d00 2023-12-20T04:45:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.943+0000 7fa3577fe640 1 -- 172.21.15.132:0/3187529377 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa350005310 con 0x7fa348004d00 2023-12-20T04:45:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.943+0000 7fa35eb00640 1 -- 172.21.15.132:0/3187529377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa348004d00 msgr2=0x7fa348005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.943+0000 7fa35eb00640 1 --2- 172.21.15.132:0/3187529377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa348004d00 0x7fa348005180 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7fa350001e50 tx=0x7fa3480057f0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.943+0000 7fa35d09d640 1 -- 172.21.15.132:0/3187529377 reap_dead start 2023-12-20T04:45:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.943+0000 7fa35eb00640 1 -- 172.21.15.132:0/3187529377 shutdown_connections 2023-12-20T04:45:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.943+0000 7fa35eb00640 1 -- 172.21.15.132:0/3187529377 >> 172.21.15.132:0/3187529377 conn(0x7fa3580b16b0 msgr2=0x7fa3580b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.943+0000 7fa35eb00640 1 -- 172.21.15.132:0/3187529377 shutdown_connections 2023-12-20T04:45:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.943+0000 7fa35eb00640 1 -- 172.21.15.132:0/3187529377 wait complete. 2023-12-20T04:45:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.944+0000 7fa35eb00640 1 Processor -- start 2023-12-20T04:45:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.944+0000 7fa35eb00640 1 -- start start 2023-12-20T04:45:06.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.945+0000 7fa35eb00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa35815a390 0x7fa3580b2710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.945+0000 7fa35eb00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35815a770 0x7fa35815ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.945+0000 7fa35eb00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3580b53e0 0x7fa3581604e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.945+0000 7fa35eb00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3581f27a0 con 0x7fa35815a770 2023-12-20T04:45:06.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.945+0000 7fa35eb00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3580b3b00 con 0x7fa35815a390 2023-12-20T04:45:06.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.945+0000 7fa35eb00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3580b2c50 con 0x7fa3580b53e0 2023-12-20T04:45:06.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.945+0000 7fa357fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35815a770 0x7fa35815ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.945+0000 7fa357fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35815a770 0x7fa35815ffa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48754/0 (socket says 172.21.15.132:48754) 2023-12-20T04:45:06.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.945+0000 7fa357fff640 1 -- 172.21.15.132:0/1293987742 learned_addr learned my addr 172.21.15.132:0/1293987742 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.945+0000 7fa35c89c640 1 --2- 172.21.15.132:0/1293987742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa35815a390 0x7fa3580b2710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.945+0000 7fa357fff640 1 -- 172.21.15.132:0/1293987742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3580b53e0 msgr2=0x7fa3581604e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.945+0000 7fa357fff640 1 --2- 172.21.15.132:0/1293987742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3580b53e0 0x7fa3581604e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.946+0000 7fa357fff640 1 -- 172.21.15.132:0/1293987742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa35815a390 msgr2=0x7fa3580b2710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.946+0000 7fa357fff640 1 --2- 172.21.15.132:0/1293987742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa35815a390 0x7fa3580b2710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.946+0000 7fa357fff640 1 -- 172.21.15.132:0/1293987742 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3580b2ef0 con 0x7fa35815a770 2023-12-20T04:45:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.946+0000 7fa357fff640 1 --2- 172.21.15.132:0/1293987742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35815a770 0x7fa35815ffa0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa344006c00 tx=0x7fa344010c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.946+0000 7fa3557fa640 1 -- 172.21.15.132:0/1293987742 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34400e950 con 0x7fa35815a770 2023-12-20T04:45:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.946+0000 7fa3557fa640 1 -- 172.21.15.132:0/1293987742 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34400c050 con 0x7fa35815a770 2023-12-20T04:45:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.946+0000 7fa3557fa640 1 -- 172.21.15.132:0/1293987742 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34400ecb0 con 0x7fa35815a770 2023-12-20T04:45:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.946+0000 7fa35eb00640 1 -- 172.21.15.132:0/1293987742 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3580b31d0 con 0x7fa35815a770 2023-12-20T04:45:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.946+0000 7fa35eb00640 1 -- 172.21.15.132:0/1293987742 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3580b3790 con 0x7fa35815a770 2023-12-20T04:45:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.947+0000 7fa35eb00640 1 -- 172.21.15.132:0/1293987742 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3580b3c90 con 0x7fa35815a770 2023-12-20T04:45:06.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.947+0000 7fa3557fa640 1 -- 172.21.15.132:0/1293987742 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa344015470 con 0x7fa35815a770 2023-12-20T04:45:06.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.948+0000 7fa3557fa640 1 --2- 172.21.15.132:0/1293987742 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa33c06a430 0x7fa33c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:06.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.948+0000 7fa3557fa640 1 -- 172.21.15.132:0/1293987742 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa344088e70 con 0x7fa35815a770 2023-12-20T04:45:06.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.948+0000 7fa35c89c640 1 --2- 172.21.15.132:0/1293987742 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa33c06a430 0x7fa33c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:06.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.948+0000 7fa35c89c640 1 --2- 172.21.15.132:0/1293987742 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa33c06a430 0x7fa33c06c8f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa34c001050 tx=0x7fa34c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:06.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:06.952+0000 7fa3557fa640 1 -- 172.21.15.132:0/1293987742 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa3440547b0 con 0x7fa35815a770 2023-12-20T04:45:07.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.118+0000 7fa35eb00640 1 -- 172.21.15.132:0/1293987742 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fa35804e840 con 0x7fa35815a770 2023-12-20T04:45:07.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.589+0000 7fa3557fa640 1 -- 172.21.15.132:0/1293987742 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v62) v1 ==== 138+0+0 (secure 0 0 0) 0x7fa344057dd0 con 0x7fa35815a770 2023-12-20T04:45:07.591 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2023-12-20T04:45:07.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.593+0000 7fa35eb00640 1 -- 172.21.15.132:0/1293987742 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa33c06a430 msgr2=0x7fa33c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:07.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.593+0000 7fa35eb00640 1 --2- 172.21.15.132:0/1293987742 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa33c06a430 0x7fa33c06c8f0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7fa34c001050 tx=0x7fa34c009040 comp rx=0 tx=0).stop 2023-12-20T04:45:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.593+0000 7fa35eb00640 1 -- 172.21.15.132:0/1293987742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35815a770 msgr2=0x7fa35815ffa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.593+0000 7fa35eb00640 1 --2- 172.21.15.132:0/1293987742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35815a770 0x7fa35815ffa0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fa344006c00 tx=0x7fa344010c70 comp rx=0 tx=0).stop 2023-12-20T04:45:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.593+0000 7fa35eb00640 1 -- 172.21.15.132:0/1293987742 shutdown_connections 2023-12-20T04:45:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.593+0000 7fa35eb00640 1 --2- 172.21.15.132:0/1293987742 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa33c06a430 0x7fa33c06c8f0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.593+0000 7fa35eb00640 1 --2- 172.21.15.132:0/1293987742 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3580b53e0 0x7fa3581604e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.593+0000 7fa35eb00640 1 --2- 172.21.15.132:0/1293987742 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35815a770 0x7fa35815ffa0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.593+0000 7fa35eb00640 1 --2- 172.21.15.132:0/1293987742 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa35815a390 0x7fa3580b2710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.593+0000 7fa35eb00640 1 -- 172.21.15.132:0/1293987742 >> 172.21.15.132:0/1293987742 conn(0x7fa3580b16b0 msgr2=0x7fa3580b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.593+0000 7fa35eb00640 1 -- 172.21.15.132:0/1293987742 shutdown_connections 2023-12-20T04:45:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.593+0000 7fa35eb00640 1 -- 172.21.15.132:0/1293987742 wait complete. 2023-12-20T04:45:07.606 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-20T04:45:07.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.712+0000 7ff7c3f3e640 1 Processor -- start 2023-12-20T04:45:07.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.712+0000 7ff7c3f3e640 1 -- start start 2023-12-20T04:45:07.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c3f3e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7bc0cb2b0 0x7ff7bc0cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c3f3e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc0d0130 con 0x7ff7bc0cdbb0 2023-12-20T04:45:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c3f3e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff7bc15f370 con 0x7ff7bc15aee0 2023-12-20T04:45:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c3f3e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0ce040 con 0x7ff7bc0cb2b0 2023-12-20T04:45:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c24db640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff7bc0cdbb0 0x7ff7bc0d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40918/0 (socket says 172.21.15.132:40918) 2023-12-20T04:45:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c24db640 1 -- 172.21.15.132:0/2983073169 learned_addr learned my addr 172.21.15.132:0/2983073169 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:45:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c0cd8640 1 -- 172.21.15.132:0/2983073169 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3333162150 0 0) 0x7ff7bc0d0130 con 0x7ff7bc0cdbb0 2023-12-20T04:45:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c14d9640 1 --2- 172.21.15.132:0/2983073169 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7bc0cb2b0 0x7ff7bc0cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c0cd8640 1 -- 172.21.15.132:0/2983073169 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff7a8003520 con 0x7ff7bc0cdbb0 2023-12-20T04:45:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c0cd8640 1 -- 172.21.15.132:0/2983073169 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2581890715 0 0) 0x7ff7a8003520 con 0x7ff7bc0cdbb0 2023-12-20T04:45:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c0cd8640 1 -- 172.21.15.132:0/2983073169 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7bc0cb2b0 msgr2=0x7ff7bc0cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c0cd8640 1 --2- 172.21.15.132:0/2983073169 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7bc0cb2b0 0x7ff7bc0cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c0cd8640 1 -- 172.21.15.132:0/2983073169 >> v1:172.21.15.187:6789/0 conn(0x7ff7bc15aee0 legacy=0x7ff7bc15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:07.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c0cd8640 1 -- 172.21.15.132:0/2983073169 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc15f650 con 0x7ff7bc0cdbb0 2023-12-20T04:45:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c0cd8640 1 -- 172.21.15.132:0/2983073169 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7ff7b40019f0 con 0x7ff7bc0cdbb0 2023-12-20T04:45:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c0cd8640 1 -- 172.21.15.132:0/2983073169 >> v1:172.21.15.132:6789/0 conn(0x7ff7bc0cdbb0 legacy=0x7ff7bc0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c0cd8640 1 --2- 172.21.15.132:0/2983073169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7a80039a0 0x7ff7a8003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.713+0000 7ff7c0cd8640 1 --2- 172.21.15.132:0/2983073169 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7bc0cb2b0 0x7ff7a80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.714+0000 7ff7c0cd8640 1 --2- 172.21.15.132:0/2983073169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7a8004d00 0x7ff7a8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.714+0000 7ff7c0cd8640 1 -- 172.21.15.132:0/2983073169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc0ce040 con 0x7ff7a80039a0 2023-12-20T04:45:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.714+0000 7ff7c0cd8640 1 -- 172.21.15.132:0/2983073169 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a800b9b0 con 0x7ff7a8004d00 2023-12-20T04:45:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.714+0000 7ff7c0cd8640 1 -- 172.21.15.132:0/2983073169 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7a800bb70 con 0x7ff7bc0cb2b0 2023-12-20T04:45:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.714+0000 7ff7c1cda640 1 --2- 172.21.15.132:0/2983073169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7a80039a0 0x7ff7a8003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.714+0000 7ff7c14d9640 1 --2- 172.21.15.132:0/2983073169 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7bc0cb2b0 0x7ff7a80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.714+0000 7ff7c24db640 1 --2- 172.21.15.132:0/2983073169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7a8004d00 0x7ff7a8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.714+0000 7ff7c1cda640 1 -- 172.21.15.132:0/2983073169 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7bc0cb2b0 msgr2=0x7ff7a80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.714+0000 7ff7c1cda640 1 --2- 172.21.15.132:0/2983073169 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7bc0cb2b0 0x7ff7a80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:07.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.714+0000 7ff7c1cda640 1 -- 172.21.15.132:0/2983073169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7a8004d00 msgr2=0x7ff7a8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:07.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.714+0000 7ff7c1cda640 1 --2- 172.21.15.132:0/2983073169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7a8004d00 0x7ff7a8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:07.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.714+0000 7ff7c1cda640 1 -- 172.21.15.132:0/2983073169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7a8003520 con 0x7ff7a80039a0 2023-12-20T04:45:07.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.714+0000 7ff7c24db640 1 --2- 172.21.15.132:0/2983073169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7a8004d00 0x7ff7a8005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:45:07.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.715+0000 7ff7c1cda640 1 --2- 172.21.15.132:0/2983073169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7a80039a0 0x7ff7a8003d80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8001910 tx=0x7ff7a80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ec6cacdff54a9d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:07.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.715+0000 7ff7c0cd8640 1 -- 172.21.15.132:0/2983073169 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b802f050 con 0x7ff7a80039a0 2023-12-20T04:45:07.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.715+0000 7ff7c0cd8640 1 -- 172.21.15.132:0/2983073169 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b80335f0 con 0x7ff7a80039a0 2023-12-20T04:45:07.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.715+0000 7ff7c0cd8640 1 -- 172.21.15.132:0/2983073169 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8033980 con 0x7ff7a80039a0 2023-12-20T04:45:07.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.715+0000 7ff7c3f3e640 1 -- 172.21.15.132:0/2983073169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7a80039a0 msgr2=0x7ff7a8003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:07.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.715+0000 7ff7c3f3e640 1 --2- 172.21.15.132:0/2983073169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7a80039a0 0x7ff7a8003d80 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8001910 tx=0x7ff7a80057f0 comp rx=0 tx=0).stop 2023-12-20T04:45:07.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.715+0000 7ff7c24db640 1 -- 172.21.15.132:0/2983073169 reap_dead start 2023-12-20T04:45:07.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.715+0000 7ff7c3f3e640 1 -- 172.21.15.132:0/2983073169 shutdown_connections 2023-12-20T04:45:07.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.715+0000 7ff7c3f3e640 1 -- 172.21.15.132:0/2983073169 >> 172.21.15.132:0/2983073169 conn(0x7ff7bc072c60 msgr2=0x7ff7bc073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:07.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.715+0000 7ff7c3f3e640 1 -- 172.21.15.132:0/2983073169 shutdown_connections 2023-12-20T04:45:07.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.715+0000 7ff7c3f3e640 1 -- 172.21.15.132:0/2983073169 wait complete. 2023-12-20T04:45:07.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.716+0000 7ff7c3f3e640 1 Processor -- start 2023-12-20T04:45:07.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.716+0000 7ff7c3f3e640 1 -- start start 2023-12-20T04:45:07.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.717+0000 7ff7c3f3e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7a80039a0 0x7ff7bc0b20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:07.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.717+0000 7ff7c3f3e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7bc0c5240 0x7ff7bc1f6b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:07.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.717+0000 7ff7c3f3e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7bc0c56c0 0x7ff7bc151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:07.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.717+0000 7ff7c3f3e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc1f66c0 con 0x7ff7a80039a0 2023-12-20T04:45:07.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.717+0000 7ff7c3f3e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc1f63c0 con 0x7ff7bc0c56c0 2023-12-20T04:45:07.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.717+0000 7ff7c3f3e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff7bc15c2f0 con 0x7ff7bc0c5240 2023-12-20T04:45:07.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.717+0000 7ff7c1cda640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7a80039a0 0x7ff7bc0b20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:07.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.717+0000 7ff7c1cda640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7a80039a0 0x7ff7bc0b20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35848/0 (socket says 172.21.15.132:35848) 2023-12-20T04:45:07.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.717+0000 7ff7c1cda640 1 -- 172.21.15.132:0/3135265731 learned_addr learned my addr 172.21.15.132:0/3135265731 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:07.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.717+0000 7ff7c24db640 1 --2- 172.21.15.132:0/3135265731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7bc0c56c0 0x7ff7bc151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:07.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.717+0000 7ff7c14d9640 1 --2- 172.21.15.132:0/3135265731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7bc0c5240 0x7ff7bc1f6b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:07.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.718+0000 7ff7c1cda640 1 -- 172.21.15.132:0/3135265731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7bc0c5240 msgr2=0x7ff7bc1f6b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:07.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.718+0000 7ff7c1cda640 1 --2- 172.21.15.132:0/3135265731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7bc0c5240 0x7ff7bc1f6b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:07.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.718+0000 7ff7c1cda640 1 -- 172.21.15.132:0/3135265731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7bc0c56c0 msgr2=0x7ff7bc151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:07.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.718+0000 7ff7c1cda640 1 --2- 172.21.15.132:0/3135265731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7bc0c56c0 0x7ff7bc151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:07.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.718+0000 7ff7c1cda640 1 -- 172.21.15.132:0/3135265731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff7bc15c5d0 con 0x7ff7a80039a0 2023-12-20T04:45:07.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.718+0000 7ff7c14d9640 1 --2- 172.21.15.132:0/3135265731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7bc0c5240 0x7ff7bc1f6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:45:07.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.718+0000 7ff7c1cda640 1 --2- 172.21.15.132:0/3135265731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7a80039a0 0x7ff7bc0b20a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8036040 tx=0x7ff7b80012b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:07.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.718+0000 7ff7b27fc640 1 -- 172.21.15.132:0/3135265731 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8006ea0 con 0x7ff7a80039a0 2023-12-20T04:45:07.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.718+0000 7ff7b27fc640 1 -- 172.21.15.132:0/3135265731 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff7b8005070 con 0x7ff7a80039a0 2023-12-20T04:45:07.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.718+0000 7ff7c3f3e640 1 -- 172.21.15.132:0/3135265731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7bc1f66c0 con 0x7ff7a80039a0 2023-12-20T04:45:07.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.718+0000 7ff7b27fc640 1 -- 172.21.15.132:0/3135265731 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff7b8005220 con 0x7ff7a80039a0 2023-12-20T04:45:07.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.718+0000 7ff7c3f3e640 1 -- 172.21.15.132:0/3135265731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7bc15c8b0 con 0x7ff7a80039a0 2023-12-20T04:45:07.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.719+0000 7ff7c3f3e640 1 -- 172.21.15.132:0/3135265731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7bc04e840 con 0x7ff7a80039a0 2023-12-20T04:45:07.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.719+0000 7ff7b27fc640 1 -- 172.21.15.132:0/3135265731 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff7b803a050 con 0x7ff7a80039a0 2023-12-20T04:45:07.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.720+0000 7ff7b27fc640 1 --2- 172.21.15.132:0/3135265731 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff7a006a430 0x7ff7a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:07.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.720+0000 7ff7b27fc640 1 -- 172.21.15.132:0/3135265731 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(62..62 src has 1..62) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ff7b80a9d10 con 0x7ff7a80039a0 2023-12-20T04:45:07.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.720+0000 7ff7c14d9640 1 --2- 172.21.15.132:0/3135265731 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff7a006a430 0x7ff7a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:07.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.720+0000 7ff7c14d9640 1 --2- 172.21.15.132:0/3135265731 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff7a006a430 0x7ff7a006c8f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc15ea00 tx=0x7ff7ac008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:07.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.724+0000 7ff7b27fc640 1 -- 172.21.15.132:0/3135265731 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff7b80754e0 con 0x7ff7a80039a0 2023-12-20T04:45:07.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:07.888+0000 7ff7c3f3e640 1 -- 172.21.15.132:0/3135265731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff7bc0b3620 con 0x7ff7a80039a0 2023-12-20T04:45:08.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.600+0000 7ff7b27fc640 1 -- 172.21.15.132:0/3135265731 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v63) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff7b8078b00 con 0x7ff7a80039a0 2023-12-20T04:45:08.603 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2023-12-20T04:45:08.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.606+0000 7ff7c3f3e640 1 -- 172.21.15.132:0/3135265731 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff7a006a430 msgr2=0x7ff7a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:08.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.606+0000 7ff7c3f3e640 1 --2- 172.21.15.132:0/3135265731 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff7a006a430 0x7ff7a006c8f0 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7ff7bc15ea00 tx=0x7ff7ac008040 comp rx=0 tx=0).stop 2023-12-20T04:45:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.606+0000 7ff7c3f3e640 1 -- 172.21.15.132:0/3135265731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7a80039a0 msgr2=0x7ff7bc0b20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.606+0000 7ff7c3f3e640 1 --2- 172.21.15.132:0/3135265731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7a80039a0 0x7ff7bc0b20a0 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7ff7b8036040 tx=0x7ff7b80012b0 comp rx=0 tx=0).stop 2023-12-20T04:45:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.606+0000 7ff7c3f3e640 1 -- 172.21.15.132:0/3135265731 shutdown_connections 2023-12-20T04:45:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.606+0000 7ff7c3f3e640 1 --2- 172.21.15.132:0/3135265731 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff7a006a430 0x7ff7a006c8f0 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.606+0000 7ff7c3f3e640 1 --2- 172.21.15.132:0/3135265731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff7bc0c56c0 0x7ff7bc151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.606+0000 7ff7c3f3e640 1 --2- 172.21.15.132:0/3135265731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff7bc0c5240 0x7ff7bc1f6b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.606+0000 7ff7c3f3e640 1 --2- 172.21.15.132:0/3135265731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff7a80039a0 0x7ff7bc0b20a0 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.606+0000 7ff7c3f3e640 1 -- 172.21.15.132:0/3135265731 >> 172.21.15.132:0/3135265731 conn(0x7ff7bc072c60 msgr2=0x7ff7bc0d0f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.607+0000 7ff7c3f3e640 1 -- 172.21.15.132:0/3135265731 shutdown_connections 2023-12-20T04:45:08.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.607+0000 7ff7c3f3e640 1 -- 172.21.15.132:0/3135265731 wait complete. 2023-12-20T04:45:08.621 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-20T04:45:08.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.725+0000 7f885e500640 1 Processor -- start 2023-12-20T04:45:08.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.725+0000 7f885e500640 1 -- start start 2023-12-20T04:45:08.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f885e500640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88580c9280 0x7f88580c9710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:08.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f885e500640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88580cb420 con 0x7f88580cc940 2023-12-20T04:45:08.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f885e500640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f885815a4f0 con 0x7f88580cb8b0 2023-12-20T04:45:08.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f885e500640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8858153ee0 con 0x7f88580c9280 2023-12-20T04:45:08.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8857fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f88580cc940 0x7f88580ccd20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40920/0 (socket says 172.21.15.132:40920) 2023-12-20T04:45:08.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8857fff640 1 -- 172.21.15.132:0/3421184197 learned_addr learned my addr 172.21.15.132:0/3421184197 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:45:08.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f885ca9d640 1 --2- 172.21.15.132:0/3421184197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88580c9280 0x7f88580c9710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:08.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8856ffd640 1 -- 172.21.15.132:0/3421184197 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2982228099 0 0) 0x7f88580cb420 con 0x7f88580cc940 2023-12-20T04:45:08.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8856ffd640 1 -- 172.21.15.132:0/3421184197 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8840003520 con 0x7f88580cc940 2023-12-20T04:45:08.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8856ffd640 1 -- 172.21.15.132:0/3421184197 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4251197189 0 0) 0x7f885815a4f0 con 0x7f88580cb8b0 2023-12-20T04:45:08.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8856ffd640 1 -- 172.21.15.132:0/3421184197 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88580cb420 con 0x7f88580cb8b0 2023-12-20T04:45:08.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8856ffd640 1 -- 172.21.15.132:0/3421184197 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1092775127 0 0) 0x7f8840003520 con 0x7f88580cc940 2023-12-20T04:45:08.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8856ffd640 1 -- 172.21.15.132:0/3421184197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88580c9280 msgr2=0x7f88580c9710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:08.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8856ffd640 1 --2- 172.21.15.132:0/3421184197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88580c9280 0x7f88580c9710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:08.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8856ffd640 1 -- 172.21.15.132:0/3421184197 >> v1:172.21.15.187:6789/0 conn(0x7f88580cb8b0 legacy=0x7f8858159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:08.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8856ffd640 1 -- 172.21.15.132:0/3421184197 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f885815a7d0 con 0x7f88580cc940 2023-12-20T04:45:08.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8856ffd640 1 -- 172.21.15.132:0/3421184197 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f8848001670 con 0x7f88580cc940 2023-12-20T04:45:08.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8856ffd640 1 -- 172.21.15.132:0/3421184197 >> v1:172.21.15.132:6789/0 conn(0x7f88580cc940 legacy=0x7f88580ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:08.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8856ffd640 1 --2- 172.21.15.132:0/3421184197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88580c9280 0x7f8840003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:08.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8856ffd640 1 --2- 172.21.15.132:0/3421184197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88400040e0 0x7f88400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:08.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8856ffd640 1 --2- 172.21.15.132:0/3421184197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8840004d00 0x7f8840005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:08.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8856ffd640 1 -- 172.21.15.132:0/3421184197 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884000cba0 con 0x7f8840004d00 2023-12-20T04:45:08.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8856ffd640 1 -- 172.21.15.132:0/3421184197 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f884000cd10 con 0x7f88400040e0 2023-12-20T04:45:08.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f8856ffd640 1 -- 172.21.15.132:0/3421184197 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f884000ced0 con 0x7f88580c9280 2023-12-20T04:45:08.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.726+0000 7f885ca9d640 1 --2- 172.21.15.132:0/3421184197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8840004d00 0x7f8840005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:08.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.727+0000 7f88577fe640 1 --2- 172.21.15.132:0/3421184197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88400040e0 0x7f88400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:08.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.727+0000 7f8857fff640 1 --2- 172.21.15.132:0/3421184197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88580c9280 0x7f8840003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:08.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.727+0000 7f885ca9d640 1 -- 172.21.15.132:0/3421184197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88580c9280 msgr2=0x7f8840003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:08.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.727+0000 7f885ca9d640 1 --2- 172.21.15.132:0/3421184197 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88580c9280 0x7f8840003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:08.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.727+0000 7f885ca9d640 1 -- 172.21.15.132:0/3421184197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88400040e0 msgr2=0x7f88400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:08.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.727+0000 7f885ca9d640 1 --2- 172.21.15.132:0/3421184197 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88400040e0 0x7f88400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:08.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.727+0000 7f885ca9d640 1 -- 172.21.15.132:0/3421184197 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8840003520 con 0x7f8840004d00 2023-12-20T04:45:08.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.727+0000 7f885ca9d640 1 --2- 172.21.15.132:0/3421184197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8840004d00 0x7f8840005180 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8850009fc0 tx=0x7f88400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32fb911677f72b99 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:08.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.728+0000 7f8856ffd640 1 -- 172.21.15.132:0/3421184197 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f885002cc20 con 0x7f8840004d00 2023-12-20T04:45:08.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.728+0000 7f8856ffd640 1 -- 172.21.15.132:0/3421184197 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885000f040 con 0x7f8840004d00 2023-12-20T04:45:08.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.728+0000 7f8856ffd640 1 -- 172.21.15.132:0/3421184197 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850034440 con 0x7f8840004d00 2023-12-20T04:45:08.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.728+0000 7f885e500640 1 -- 172.21.15.132:0/3421184197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8840004d00 msgr2=0x7f8840005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:08.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.728+0000 7f885e500640 1 --2- 172.21.15.132:0/3421184197 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8840004d00 0x7f8840005180 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f8850009fc0 tx=0x7f88400057f0 comp rx=0 tx=0).stop 2023-12-20T04:45:08.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.728+0000 7f885ca9d640 1 -- 172.21.15.132:0/3421184197 reap_dead start 2023-12-20T04:45:08.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.728+0000 7f885e500640 1 -- 172.21.15.132:0/3421184197 shutdown_connections 2023-12-20T04:45:08.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.728+0000 7f885e500640 1 -- 172.21.15.132:0/3421184197 >> 172.21.15.132:0/3421184197 conn(0x7f885806a260 msgr2=0x7f88580b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:08.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.728+0000 7f885e500640 1 -- 172.21.15.132:0/3421184197 shutdown_connections 2023-12-20T04:45:08.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.728+0000 7f885e500640 1 -- 172.21.15.132:0/3421184197 wait complete. 2023-12-20T04:45:08.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.729+0000 7f885e500640 1 Processor -- start 2023-12-20T04:45:08.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.730+0000 7f885e500640 1 -- start start 2023-12-20T04:45:08.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.730+0000 7f885e500640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8858148880 0x7f885814dde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:08.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.730+0000 7f885e500640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8858148c60 0x7f885814e320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:08.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.730+0000 7f885e500640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8858150d10 0x7f8858151190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:08.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.730+0000 7f885e500640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8858151a80 con 0x7f8858150d10 2023-12-20T04:45:08.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.730+0000 7f885e500640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8858151d60 con 0x7f8858148880 2023-12-20T04:45:08.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.730+0000 7f885e500640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8858152040 con 0x7f8858148c60 2023-12-20T04:45:08.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.730+0000 7f885ca9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8858150d10 0x7f8858151190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:08.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.730+0000 7f885ca9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8858150d10 0x7f8858151190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35860/0 (socket says 172.21.15.132:35860) 2023-12-20T04:45:08.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.730+0000 7f885ca9d640 1 -- 172.21.15.132:0/3843103917 learned_addr learned my addr 172.21.15.132:0/3843103917 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:08.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.730+0000 7f8857fff640 1 --2- 172.21.15.132:0/3843103917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8858148880 0x7f885814dde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:08.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.730+0000 7f88577fe640 1 --2- 172.21.15.132:0/3843103917 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8858148c60 0x7f885814e320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:08.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.731+0000 7f885ca9d640 1 -- 172.21.15.132:0/3843103917 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8858148c60 msgr2=0x7f885814e320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:08.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.731+0000 7f885ca9d640 1 --2- 172.21.15.132:0/3843103917 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8858148c60 0x7f885814e320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:08.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.731+0000 7f885ca9d640 1 -- 172.21.15.132:0/3843103917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8858148880 msgr2=0x7f885814dde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:08.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.731+0000 7f885ca9d640 1 --2- 172.21.15.132:0/3843103917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8858148880 0x7f885814dde0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:08.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.731+0000 7f885ca9d640 1 -- 172.21.15.132:0/3843103917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8858152320 con 0x7f8858150d10 2023-12-20T04:45:08.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.731+0000 7f885ca9d640 1 --2- 172.21.15.132:0/3843103917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8858150d10 0x7f8858151190 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8850002230 tx=0x7f8850009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:08.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.731+0000 7f8854ff9640 1 -- 172.21.15.132:0/3843103917 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850043070 con 0x7f8858150d10 2023-12-20T04:45:08.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.731+0000 7f8854ff9640 1 -- 172.21.15.132:0/3843103917 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f885002de00 con 0x7f8858150d10 2023-12-20T04:45:08.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.731+0000 7f885e500640 1 -- 172.21.15.132:0/3843103917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8858152600 con 0x7f8858150d10 2023-12-20T04:45:08.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.731+0000 7f8854ff9640 1 -- 172.21.15.132:0/3843103917 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8850034d10 con 0x7f8858150d10 2023-12-20T04:45:08.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.731+0000 7f885e500640 1 -- 172.21.15.132:0/3843103917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88581516d0 con 0x7f8858150d10 2023-12-20T04:45:08.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.732+0000 7f885e500640 1 -- 172.21.15.132:0/3843103917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88581527f0 con 0x7f8858150d10 2023-12-20T04:45:08.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.733+0000 7f8854ff9640 1 -- 172.21.15.132:0/3843103917 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f885003e440 con 0x7f8858150d10 2023-12-20T04:45:08.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.733+0000 7f8854ff9640 1 --2- 172.21.15.132:0/3843103917 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f884406a460 0x7f884406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:08.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.733+0000 7f8854ff9640 1 -- 172.21.15.132:0/3843103917 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(63..63 src has 1..63) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f88500aa310 con 0x7f8858150d10 2023-12-20T04:45:08.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.733+0000 7f8857fff640 1 --2- 172.21.15.132:0/3843103917 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f884406a460 0x7f884406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:08.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.733+0000 7f8857fff640 1 --2- 172.21.15.132:0/3843103917 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f884406a460 0x7f884406c920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8848001050 tx=0x7f8848000f80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:08.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.738+0000 7f8854ff9640 1 -- 172.21.15.132:0/3843103917 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8850075aa0 con 0x7f8858150d10 2023-12-20T04:45:08.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.939+0000 7f885e500640 1 -- 172.21.15.132:0/3843103917 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f885804e840 con 0x7f8858150d10 2023-12-20T04:45:08.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.945+0000 7f8854ff9640 1 -- 172.21.15.132:0/3843103917 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 8 and data pool 9 v23) v1 ==== 172+0+0 (secure 0 0 0) 0x7f88500790c0 con 0x7f8858150d10 2023-12-20T04:45:08.947 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 8 and data pool 9 2023-12-20T04:45:08.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.951+0000 7f885e500640 1 -- 172.21.15.132:0/3843103917 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f884406a460 msgr2=0x7f884406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:08.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.951+0000 7f885e500640 1 --2- 172.21.15.132:0/3843103917 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f884406a460 0x7f884406c920 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f8848001050 tx=0x7f8848000f80 comp rx=0 tx=0).stop 2023-12-20T04:45:08.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.951+0000 7f885e500640 1 -- 172.21.15.132:0/3843103917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8858150d10 msgr2=0x7f8858151190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:08.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.951+0000 7f885e500640 1 --2- 172.21.15.132:0/3843103917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8858150d10 0x7f8858151190 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x7f8850002230 tx=0x7f8850009750 comp rx=0 tx=0).stop 2023-12-20T04:45:08.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.953+0000 7f885e500640 1 -- 172.21.15.132:0/3843103917 shutdown_connections 2023-12-20T04:45:08.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.953+0000 7f885e500640 1 --2- 172.21.15.132:0/3843103917 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f884406a460 0x7f884406c920 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:08.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.954+0000 7f885e500640 1 --2- 172.21.15.132:0/3843103917 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8858150d10 0x7f8858151190 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:08.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.954+0000 7f885e500640 1 --2- 172.21.15.132:0/3843103917 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8858148c60 0x7f885814e320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:08.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.954+0000 7f885e500640 1 --2- 172.21.15.132:0/3843103917 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8858148880 0x7f885814dde0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:08.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.954+0000 7f885e500640 1 -- 172.21.15.132:0/3843103917 >> 172.21.15.132:0/3843103917 conn(0x7f885806a260 msgr2=0x7f88581597e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:08.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.955+0000 7f885e500640 1 -- 172.21.15.132:0/3843103917 shutdown_connections 2023-12-20T04:45:08.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:08.955+0000 7f885e500640 1 -- 172.21.15.132:0/3843103917 wait complete. 2023-12-20T04:45:08.971 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:45:09.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.068+0000 7f23973ec640 1 Processor -- start 2023-12-20T04:45:09.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.069+0000 7f23973ec640 1 -- start start 2023-12-20T04:45:09.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.069+0000 7f23973ec640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f239015d100 0x7f23900b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.069+0000 7f23973ec640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23900d0370 0x7f23900cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.069+0000 7f23973ec640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23900b2f90 con 0x7f2390161850 2023-12-20T04:45:09.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.069+0000 7f23973ec640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23901613c0 con 0x7f239015d100 2023-12-20T04:45:09.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.069+0000 7f23973ec640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23900d1b00 con 0x7f23900d0370 2023-12-20T04:45:09.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.070+0000 7f2394987640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23900d0370 0x7f23900cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:09.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.070+0000 7f2395188640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f239015d100 0x7f23900b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:09.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.070+0000 7f2395188640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f239015d100 0x7f23900b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:54130/0 (socket says 172.21.15.132:54130) 2023-12-20T04:45:09.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.070+0000 7f2394987640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23900d0370 0x7f23900cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:54040/0 (socket says 172.21.15.132:54040) 2023-12-20T04:45:09.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.070+0000 7f2395188640 1 -- 172.21.15.132:0/4223971278 learned_addr learned my addr 172.21.15.132:0/4223971278 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:09.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.070+0000 7f2395989640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f2390161850 0x7f239006c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:51200/0 (socket says 172.21.15.132:51200) 2023-12-20T04:45:09.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.070+0000 7f2394987640 1 -- 172.21.15.132:0/4223971278 >> v2:172.21.15.187:3300/0 conn(0x7f239015d100 msgr2=0x7f23900b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:09.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.070+0000 7f2394987640 1 --2- 172.21.15.132:0/4223971278 >> v2:172.21.15.187:3300/0 conn(0x7f239015d100 0x7f23900b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.070+0000 7f2394987640 1 -- 172.21.15.132:0/4223971278 >> v1:172.21.15.187:6789/0 conn(0x7f2390161850 legacy=0x7f239006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:09.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.070+0000 7f2394987640 1 -- 172.21.15.132:0/4223971278 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23900d0810 con 0x7f23900d0370 2023-12-20T04:45:09.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.070+0000 7f2395188640 1 --2- 172.21.15.132:0/4223971278 >> v2:172.21.15.187:3300/0 conn(0x7f239015d100 0x7f23900b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:45:09.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.071+0000 7f2394987640 1 --2- 172.21.15.132:0/4223971278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23900d0370 0x7f23900cd500 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23800097a0 tx=0x7f238002b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=656d7fedda1f336f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:09.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.071+0000 7f2387fff640 1 -- 172.21.15.132:0/4223971278 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238002e070 con 0x7f23900d0370 2023-12-20T04:45:09.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.071+0000 7f2387fff640 1 -- 172.21.15.132:0/4223971278 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23800315a0 con 0x7f23900d0370 2023-12-20T04:45:09.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.071+0000 7f2387fff640 1 -- 172.21.15.132:0/4223971278 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2380031930 con 0x7f23900d0370 2023-12-20T04:45:09.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.072+0000 7f23973ec640 1 -- 172.21.15.132:0/4223971278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23900d0370 msgr2=0x7f23900cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:09.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.072+0000 7f23973ec640 1 --2- 172.21.15.132:0/4223971278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23900d0370 0x7f23900cd500 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f23800097a0 tx=0x7f238002b840 comp rx=0 tx=0).stop 2023-12-20T04:45:09.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.072+0000 7f23973ec640 1 -- 172.21.15.132:0/4223971278 shutdown_connections 2023-12-20T04:45:09.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.072+0000 7f23973ec640 1 --2- 172.21.15.132:0/4223971278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23900d0370 0x7f23900cd500 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.072+0000 7f23973ec640 1 --2- 172.21.15.132:0/4223971278 >> v2:172.21.15.187:3300/0 conn(0x7f239015d100 0x7f23900b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.072+0000 7f23973ec640 1 -- 172.21.15.132:0/4223971278 >> 172.21.15.132:0/4223971278 conn(0x7f239006d7c0 msgr2=0x7f239006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:09.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.072+0000 7f23973ec640 1 -- 172.21.15.132:0/4223971278 shutdown_connections 2023-12-20T04:45:09.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.072+0000 7f23973ec640 1 -- 172.21.15.132:0/4223971278 wait complete. 2023-12-20T04:45:09.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.073+0000 7f23973ec640 1 Processor -- start 2023-12-20T04:45:09.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.073+0000 7f23973ec640 1 -- start start 2023-12-20T04:45:09.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f23973ec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23900d0370 0x7f23900b4e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f23973ec640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f239015d100 0x7f23901f6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f23973ec640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2390161850 0x7f23900c4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f23973ec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23900c7c90 con 0x7f23900d0370 2023-12-20T04:45:09.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f23973ec640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23900b46c0 con 0x7f2390161850 2023-12-20T04:45:09.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f23973ec640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23900c76d0 con 0x7f239015d100 2023-12-20T04:45:09.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f2395188640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23900d0370 0x7f23900b4e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:09.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f2395188640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23900d0370 0x7f23900b4e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35872/0 (socket says 172.21.15.132:35872) 2023-12-20T04:45:09.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f2395188640 1 -- 172.21.15.132:0/405746213 learned_addr learned my addr 172.21.15.132:0/405746213 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:09.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f2395989640 1 --2- 172.21.15.132:0/405746213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2390161850 0x7f23900c4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:09.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f2394987640 1 --2- 172.21.15.132:0/405746213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f239015d100 0x7f23901f6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:09.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f2395188640 1 -- 172.21.15.132:0/405746213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f239015d100 msgr2=0x7f23901f6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:09.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f2395188640 1 --2- 172.21.15.132:0/405746213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f239015d100 0x7f23901f6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f2395188640 1 -- 172.21.15.132:0/405746213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2390161850 msgr2=0x7f23900c4900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:09.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f2395188640 1 --2- 172.21.15.132:0/405746213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2390161850 0x7f23900c4900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f2395188640 1 -- 172.21.15.132:0/405746213 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f238c0094d0 con 0x7f23900d0370 2023-12-20T04:45:09.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f2394987640 1 --2- 172.21.15.132:0/405746213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f239015d100 0x7f23901f6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:45:09.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f2395188640 1 --2- 172.21.15.132:0/405746213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23900d0370 0x7f23900b4e80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f238c00e9d0 tx=0x7f238c00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:09.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f2385ffb640 1 -- 172.21.15.132:0/405746213 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c00ca60 con 0x7f23900d0370 2023-12-20T04:45:09.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f2385ffb640 1 -- 172.21.15.132:0/405746213 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f238c00cbc0 con 0x7f23900d0370 2023-12-20T04:45:09.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f23973ec640 1 -- 172.21.15.132:0/405746213 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2380009400 con 0x7f23900d0370 2023-12-20T04:45:09.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.074+0000 7f2385ffb640 1 -- 172.21.15.132:0/405746213 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f238c013470 con 0x7f23900d0370 2023-12-20T04:45:09.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.075+0000 7f23973ec640 1 -- 172.21.15.132:0/405746213 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23900b4960 con 0x7f23900d0370 2023-12-20T04:45:09.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.076+0000 7f23973ec640 1 -- 172.21.15.132:0/405746213 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f239004e840 con 0x7f23900d0370 2023-12-20T04:45:09.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.076+0000 7f2385ffb640 1 -- 172.21.15.132:0/405746213 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f238c0135d0 con 0x7f23900d0370 2023-12-20T04:45:09.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.077+0000 7f2385ffb640 1 --2- 172.21.15.132:0/405746213 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f237406a430 0x7f237406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.077+0000 7f2385ffb640 1 -- 172.21.15.132:0/405746213 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f238c088b30 con 0x7f23900d0370 2023-12-20T04:45:09.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.077+0000 7f2394987640 1 --2- 172.21.15.132:0/405746213 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f237406a430 0x7f237406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:09.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.077+0000 7f2394987640 1 --2- 172.21.15.132:0/405746213 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f237406a430 0x7f237406c8f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2380036000 tx=0x7f238003d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:09.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.081+0000 7f2385ffb640 1 -- 172.21.15.132:0/405746213 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f238c054260 con 0x7f23900d0370 2023-12-20T04:45:09.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.248+0000 7f23973ec640 1 -- 172.21.15.132:0/405746213 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f23900b6d50 con 0x7f23900d0370 2023-12-20T04:45:09.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.249+0000 7f2385ffb640 1 -- 172.21.15.132:0/405746213 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16158 (secure 0 0 0) 0x7f238c017090 con 0x7f23900d0370 2023-12-20T04:45:09.251 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:45:09.251 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":64,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:45:08.941013+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:45:07.136819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-20T04:45:07.907185+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:45:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.251+0000 7f23973ec640 1 -- 172.21.15.132:0/405746213 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f237406a430 msgr2=0x7f237406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.251+0000 7f23973ec640 1 --2- 172.21.15.132:0/405746213 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f237406a430 0x7f237406c8f0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7f2380036000 tx=0x7f238003d040 comp rx=0 tx=0).stop 2023-12-20T04:45:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.251+0000 7f23973ec640 1 -- 172.21.15.132:0/405746213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23900d0370 msgr2=0x7f23900b4e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.251+0000 7f23973ec640 1 --2- 172.21.15.132:0/405746213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23900d0370 0x7f23900b4e80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f238c00e9d0 tx=0x7f238c00ee90 comp rx=0 tx=0).stop 2023-12-20T04:45:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.251+0000 7f23973ec640 1 -- 172.21.15.132:0/405746213 shutdown_connections 2023-12-20T04:45:09.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.251+0000 7f23973ec640 1 --2- 172.21.15.132:0/405746213 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f237406a430 0x7f237406c8f0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.251+0000 7f23973ec640 1 --2- 172.21.15.132:0/405746213 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2390161850 0x7f23900c4900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.251+0000 7f23973ec640 1 --2- 172.21.15.132:0/405746213 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f239015d100 0x7f23901f6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.251+0000 7f23973ec640 1 --2- 172.21.15.132:0/405746213 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23900d0370 0x7f23900b4e80 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.251+0000 7f23973ec640 1 -- 172.21.15.132:0/405746213 >> 172.21.15.132:0/405746213 conn(0x7f239006d7c0 msgr2=0x7f23900cb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:09.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.251+0000 7f23973ec640 1 -- 172.21.15.132:0/405746213 shutdown_connections 2023-12-20T04:45:09.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.251+0000 7f23973ec640 1 -- 172.21.15.132:0/405746213 wait complete. 2023-12-20T04:45:09.264 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:45:09.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.363+0000 7f4aac7d5640 1 Processor -- start 2023-12-20T04:45:09.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.363+0000 7f4aac7d5640 1 -- start start 2023-12-20T04:45:09.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.364+0000 7f4aac7d5640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4aa4160450 0x7f4aa4160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.364+0000 7f4aac7d5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4aa40b5090 0x7f4aa40d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.364+0000 7f4aac7d5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4aa40b5ec0 con 0x7f4aa41611b0 2023-12-20T04:45:09.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.364+0000 7f4aac7d5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa41617e0 con 0x7f4aa40b5090 2023-12-20T04:45:09.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.364+0000 7f4aac7d5640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4aa40d0fc0 con 0x7f4aa4160450 2023-12-20T04:45:09.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.364+0000 7f4aaad72640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4aa40b5090 0x7f4aa40d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:09.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.364+0000 7f4aaad72640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4aa40b5090 0x7f4aa40d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35874/0 (socket says 172.21.15.132:35874) 2023-12-20T04:45:09.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.364+0000 7f4aaad72640 1 -- 172.21.15.132:0/2702129725 learned_addr learned my addr 172.21.15.132:0/2702129725 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:09.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.364+0000 7f4aaa571640 1 --2- 172.21.15.132:0/2702129725 >> v2:172.21.15.187:3300/0 conn(0x7f4aa4160450 0x7f4aa4160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:09.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.364+0000 7f4aaad72640 1 -- 172.21.15.132:0/2702129725 >> v2:172.21.15.187:3300/0 conn(0x7f4aa4160450 msgr2=0x7f4aa4160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:09.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.364+0000 7f4aaad72640 1 --2- 172.21.15.132:0/2702129725 >> v2:172.21.15.187:3300/0 conn(0x7f4aa4160450 0x7f4aa4160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.364+0000 7f4aaad72640 1 -- 172.21.15.132:0/2702129725 >> v1:172.21.15.132:6789/0 conn(0x7f4aa41611b0 legacy=0x7f4aa40b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:09.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.364+0000 7f4aaad72640 1 -- 172.21.15.132:0/2702129725 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4aa40d12a0 con 0x7f4aa40b5090 2023-12-20T04:45:09.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.365+0000 7f4aaad72640 1 --2- 172.21.15.132:0/2702129725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4aa40b5090 0x7f4aa40d1aa0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4aa408b150 tx=0x7f4a9c02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88b0725bcd8838b3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:09.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.365+0000 7f4aa956f640 1 -- 172.21.15.132:0/2702129725 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c02cbb0 con 0x7f4aa40b5090 2023-12-20T04:45:09.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.365+0000 7f4aa956f640 1 -- 172.21.15.132:0/2702129725 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9c02cd10 con 0x7f4aa40b5090 2023-12-20T04:45:09.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.365+0000 7f4aa956f640 1 -- 172.21.15.132:0/2702129725 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9c034610 con 0x7f4aa40b5090 2023-12-20T04:45:09.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.366+0000 7f4aac7d5640 1 -- 172.21.15.132:0/2702129725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4aa40b5090 msgr2=0x7f4aa40d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:09.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.366+0000 7f4aac7d5640 1 --2- 172.21.15.132:0/2702129725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4aa40b5090 0x7f4aa40d1aa0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f4aa408b150 tx=0x7f4a9c02c010 comp rx=0 tx=0).stop 2023-12-20T04:45:09.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.366+0000 7f4aac7d5640 1 -- 172.21.15.132:0/2702129725 shutdown_connections 2023-12-20T04:45:09.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.366+0000 7f4aac7d5640 1 --2- 172.21.15.132:0/2702129725 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4aa40b5090 0x7f4aa40d1aa0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.366+0000 7f4aac7d5640 1 --2- 172.21.15.132:0/2702129725 >> v2:172.21.15.187:3300/0 conn(0x7f4aa4160450 0x7f4aa4160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.366+0000 7f4aac7d5640 1 -- 172.21.15.132:0/2702129725 >> 172.21.15.132:0/2702129725 conn(0x7f4aa40cf980 msgr2=0x7f4aa40cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:09.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.366+0000 7f4aac7d5640 1 -- 172.21.15.132:0/2702129725 shutdown_connections 2023-12-20T04:45:09.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.366+0000 7f4aac7d5640 1 -- 172.21.15.132:0/2702129725 wait complete. 2023-12-20T04:45:09.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.367+0000 7f4aac7d5640 1 Processor -- start 2023-12-20T04:45:09.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.367+0000 7f4aac7d5640 1 -- start start 2023-12-20T04:45:09.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.368+0000 7f4aac7d5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4aa40b5090 0x7f4aa4157620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.368+0000 7f4aac7d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4aa4160450 0x7f4aa40d2940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.368+0000 7f4aac7d5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4aa41611b0 0x7f4aa40d2e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.368+0000 7f4aac7d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa4152bd0 con 0x7f4aa4160450 2023-12-20T04:45:09.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.368+0000 7f4aac7d5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa41539f0 con 0x7f4aa40b5090 2023-12-20T04:45:09.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.368+0000 7f4aac7d5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4aa4152de0 con 0x7f4aa41611b0 2023-12-20T04:45:09.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.368+0000 7f4aa9d70640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4aa4160450 0x7f4aa40d2940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:09.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.368+0000 7f4aa9d70640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4aa4160450 0x7f4aa40d2940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35878/0 (socket says 172.21.15.132:35878) 2023-12-20T04:45:09.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.368+0000 7f4aa9d70640 1 -- 172.21.15.132:0/1965695531 learned_addr learned my addr 172.21.15.132:0/1965695531 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:09.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.368+0000 7f4aaa571640 1 --2- 172.21.15.132:0/1965695531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4aa40b5090 0x7f4aa4157620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:09.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.368+0000 7f4aaad72640 1 --2- 172.21.15.132:0/1965695531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4aa41611b0 0x7f4aa40d2e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:09.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.368+0000 7f4aa9d70640 1 -- 172.21.15.132:0/1965695531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4aa41611b0 msgr2=0x7f4aa40d2e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:09.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.368+0000 7f4aa9d70640 1 --2- 172.21.15.132:0/1965695531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4aa41611b0 0x7f4aa40d2e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.368+0000 7f4aa9d70640 1 -- 172.21.15.132:0/1965695531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4aa40b5090 msgr2=0x7f4aa4157620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:09.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.368+0000 7f4aa9d70640 1 --2- 172.21.15.132:0/1965695531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4aa40b5090 0x7f4aa4157620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.368+0000 7f4aa9d70640 1 -- 172.21.15.132:0/1965695531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a9c009b30 con 0x7f4aa4160450 2023-12-20T04:45:09.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.368+0000 7f4aa9d70640 1 --2- 172.21.15.132:0/1965695531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4aa4160450 0x7f4aa40d2940 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400c400 tx=0x7f4a9400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:09.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.369+0000 7f4a9affd640 1 -- 172.21.15.132:0/1965695531 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a940052d0 con 0x7f4aa4160450 2023-12-20T04:45:09.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.369+0000 7f4a9affd640 1 -- 172.21.15.132:0/1965695531 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a94005430 con 0x7f4aa4160450 2023-12-20T04:45:09.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.369+0000 7f4a9affd640 1 -- 172.21.15.132:0/1965695531 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a94003830 con 0x7f4aa4160450 2023-12-20T04:45:09.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.369+0000 7f4aac7d5640 1 -- 172.21.15.132:0/1965695531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4aa41530c0 con 0x7f4aa4160450 2023-12-20T04:45:09.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.369+0000 7f4aac7d5640 1 -- 172.21.15.132:0/1965695531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4aa4153680 con 0x7f4aa4160450 2023-12-20T04:45:09.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.369+0000 7f4aac7d5640 1 -- 172.21.15.132:0/1965695531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4aa4153b30 con 0x7f4aa4160450 2023-12-20T04:45:09.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.370+0000 7f4a9affd640 1 -- 172.21.15.132:0/1965695531 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4a94003990 con 0x7f4aa4160450 2023-12-20T04:45:09.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.370+0000 7f4a9affd640 1 --2- 172.21.15.132:0/1965695531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a8806a460 0x7f4a8806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.370+0000 7f4a9affd640 1 -- 172.21.15.132:0/1965695531 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a94087d70 con 0x7f4aa4160450 2023-12-20T04:45:09.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.370+0000 7f4aaa571640 1 --2- 172.21.15.132:0/1965695531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a8806a460 0x7f4a8806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:09.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.371+0000 7f4aaa571640 1 --2- 172.21.15.132:0/1965695531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a8806a460 0x7f4a8806c920 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0006fd0 tx=0x7f4aa0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:09.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.375+0000 7f4a9affd640 1 -- 172.21.15.132:0/1965695531 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4aa4153b30 con 0x7f4aa4160450 2023-12-20T04:45:09.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.541+0000 7f4aac7d5640 1 -- 172.21.15.132:0/1965695531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4aa4153b30 con 0x7f4aa4160450 2023-12-20T04:45:09.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.542+0000 7f4a9affd640 1 -- 172.21.15.132:0/1965695531 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v64) v1 ==== 74+0+16158 (secure 0 0 0) 0x7f4aa4153b30 con 0x7f4aa4160450 2023-12-20T04:45:09.544 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:45:09.544 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":64,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:45:08.941013+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:45:07.136819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-20T04:45:07.907185+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:45:09.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.544+0000 7f4aac7d5640 1 -- 172.21.15.132:0/1965695531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a8806a460 msgr2=0x7f4a8806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:09.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.544+0000 7f4aac7d5640 1 --2- 172.21.15.132:0/1965695531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a8806a460 0x7f4a8806c920 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7f4aa0006fd0 tx=0x7f4aa0008040 comp rx=0 tx=0).stop 2023-12-20T04:45:09.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.544+0000 7f4aac7d5640 1 -- 172.21.15.132:0/1965695531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4aa4160450 msgr2=0x7f4aa40d2940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:09.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.544+0000 7f4aac7d5640 1 --2- 172.21.15.132:0/1965695531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4aa4160450 0x7f4aa40d2940 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f4a9400c400 tx=0x7f4a9400c8c0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.544+0000 7f4aac7d5640 1 -- 172.21.15.132:0/1965695531 shutdown_connections 2023-12-20T04:45:09.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.544+0000 7f4aac7d5640 1 --2- 172.21.15.132:0/1965695531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a8806a460 0x7f4a8806c920 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.544+0000 7f4aac7d5640 1 --2- 172.21.15.132:0/1965695531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4aa41611b0 0x7f4aa40d2e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.544+0000 7f4aac7d5640 1 --2- 172.21.15.132:0/1965695531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4aa4160450 0x7f4aa40d2940 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.544+0000 7f4aac7d5640 1 --2- 172.21.15.132:0/1965695531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4aa40b5090 0x7f4aa4157620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.544+0000 7f4aac7d5640 1 -- 172.21.15.132:0/1965695531 >> 172.21.15.132:0/1965695531 conn(0x7f4aa40cf980 msgr2=0x7f4aa415f670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:09.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.544+0000 7f4aac7d5640 1 -- 172.21.15.132:0/1965695531 shutdown_connections 2023-12-20T04:45:09.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.544+0000 7f4aac7d5640 1 -- 172.21.15.132:0/1965695531 wait complete. 2023-12-20T04:45:09.558 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-20T04:45:09.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.660+0000 7ff047f5c640 1 Processor -- start 2023-12-20T04:45:09.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.660+0000 7ff047f5c640 1 -- start start 2023-12-20T04:45:09.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.661+0000 7ff047f5c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff04015aee0 0x7ff04015eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.661+0000 7ff047f5c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0400cdd80 0x7ff0400d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.661+0000 7ff047f5c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0400d0130 con 0x7ff0400cb2b0 2023-12-20T04:45:09.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.661+0000 7ff047f5c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff04015f370 con 0x7ff0400cdd80 2023-12-20T04:45:09.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.661+0000 7ff047f5c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04015f650 con 0x7ff04015aee0 2023-12-20T04:45:09.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.661+0000 7ff0464f9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0400cdd80 0x7ff0400d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:09.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.661+0000 7ff0454f7640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff0400cb2b0 0x7ff0400cd670 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40938/0 (socket says 172.21.15.132:40938) 2023-12-20T04:45:09.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.661+0000 7ff0454f7640 1 -- 172.21.15.132:0/3357199870 learned_addr learned my addr 172.21.15.132:0/3357199870 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:45:09.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.661+0000 7ff0464f9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0400cdd80 0x7ff0400d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35892/0 (socket says 172.21.15.132:35892) 2023-12-20T04:45:09.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.662+0000 7ff045cf8640 1 --2- 172.21.15.132:0/3357199870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff04015aee0 0x7ff04015eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:09.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.662+0000 7ff0464f9640 1 -- 172.21.15.132:0/3357199870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff04015aee0 msgr2=0x7ff04015eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:09.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.662+0000 7ff0464f9640 1 --2- 172.21.15.132:0/3357199870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff04015aee0 0x7ff04015eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.662+0000 7ff0464f9640 1 -- 172.21.15.132:0/3357199870 >> v1:172.21.15.132:6789/0 conn(0x7ff0400cb2b0 legacy=0x7ff0400cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:09.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.662+0000 7ff044cf6640 1 -- 172.21.15.132:0/3357199870 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1092032567 0 0) 0x7ff0400d0130 con 0x7ff0400cb2b0 2023-12-20T04:45:09.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.662+0000 7ff0464f9640 1 -- 172.21.15.132:0/3357199870 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff04015f930 con 0x7ff0400cdd80 2023-12-20T04:45:09.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.662+0000 7ff045cf8640 1 --2- 172.21.15.132:0/3357199870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff04015aee0 0x7ff04015eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:45:09.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.662+0000 7ff0464f9640 1 --2- 172.21.15.132:0/3357199870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0400cdd80 0x7ff0400d08a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff0380097a0 tx=0x7ff03802b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc4fb11276d5768 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:09.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.662+0000 7ff044cf6640 1 -- 172.21.15.132:0/3357199870 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03802d040 con 0x7ff0400cdd80 2023-12-20T04:45:09.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.663+0000 7ff044cf6640 1 -- 172.21.15.132:0/3357199870 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff038031810 con 0x7ff0400cdd80 2023-12-20T04:45:09.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.663+0000 7ff044cf6640 1 -- 172.21.15.132:0/3357199870 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff038031ba0 con 0x7ff0400cdd80 2023-12-20T04:45:09.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.663+0000 7ff047f5c640 1 -- 172.21.15.132:0/3357199870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0400cdd80 msgr2=0x7ff0400d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:09.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.663+0000 7ff047f5c640 1 --2- 172.21.15.132:0/3357199870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0400cdd80 0x7ff0400d08a0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff0380097a0 tx=0x7ff03802b8b0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.663+0000 7ff047f5c640 1 -- 172.21.15.132:0/3357199870 shutdown_connections 2023-12-20T04:45:09.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.663+0000 7ff047f5c640 1 --2- 172.21.15.132:0/3357199870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0400cdd80 0x7ff0400d08a0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.663+0000 7ff047f5c640 1 --2- 172.21.15.132:0/3357199870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff04015aee0 0x7ff04015eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.663+0000 7ff047f5c640 1 -- 172.21.15.132:0/3357199870 >> 172.21.15.132:0/3357199870 conn(0x7ff040072c60 msgr2=0x7ff040073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:09.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.663+0000 7ff047f5c640 1 -- 172.21.15.132:0/3357199870 shutdown_connections 2023-12-20T04:45:09.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.663+0000 7ff047f5c640 1 -- 172.21.15.132:0/3357199870 wait complete. 2023-12-20T04:45:09.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.664+0000 7ff047f5c640 1 Processor -- start 2023-12-20T04:45:09.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.664+0000 7ff047f5c640 1 -- start start 2023-12-20T04:45:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.665+0000 7ff047f5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0400cb2b0 0x7ff040159280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.665+0000 7ff047f5c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0400cdd80 0x7ff04015be20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.665+0000 7ff047f5c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff04015aee0 0x7ff04015c360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.665+0000 7ff047f5c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04015ba00 con 0x7ff0400cb2b0 2023-12-20T04:45:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.665+0000 7ff047f5c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0400b1990 con 0x7ff04015aee0 2023-12-20T04:45:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.665+0000 7ff047f5c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04015b660 con 0x7ff0400cdd80 2023-12-20T04:45:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.665+0000 7ff045cf8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0400cb2b0 0x7ff040159280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.665+0000 7ff045cf8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0400cb2b0 0x7ff040159280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35896/0 (socket says 172.21.15.132:35896) 2023-12-20T04:45:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.665+0000 7ff045cf8640 1 -- 172.21.15.132:0/2432701961 learned_addr learned my addr 172.21.15.132:0/2432701961 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.665+0000 7ff045cf8640 1 -- 172.21.15.132:0/2432701961 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0400cdd80 msgr2=0x7ff04015be20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.665+0000 7ff0464f9640 1 --2- 172.21.15.132:0/2432701961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff04015aee0 0x7ff04015c360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.665+0000 7ff045cf8640 1 --2- 172.21.15.132:0/2432701961 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0400cdd80 0x7ff04015be20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.665+0000 7ff045cf8640 1 -- 172.21.15.132:0/2432701961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff04015aee0 msgr2=0x7ff04015c360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.665+0000 7ff045cf8640 1 --2- 172.21.15.132:0/2432701961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff04015aee0 0x7ff04015c360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.665+0000 7ff045cf8640 1 -- 172.21.15.132:0/2432701961 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff038009400 con 0x7ff0400cb2b0 2023-12-20T04:45:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.666+0000 7ff045cf8640 1 --2- 172.21.15.132:0/2432701961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0400cb2b0 0x7ff040159280 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00ce00 tx=0x7ff03c00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.666+0000 7ff0367fc640 1 -- 172.21.15.132:0/2432701961 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c00f890 con 0x7ff0400cb2b0 2023-12-20T04:45:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.666+0000 7ff0367fc640 1 -- 172.21.15.132:0/2432701961 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c00f9f0 con 0x7ff0400cb2b0 2023-12-20T04:45:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.666+0000 7ff0367fc640 1 -- 172.21.15.132:0/2432701961 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c00fdc0 con 0x7ff0400cb2b0 2023-12-20T04:45:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.666+0000 7ff047f5c640 1 -- 172.21.15.132:0/2432701961 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0400c88e0 con 0x7ff0400cb2b0 2023-12-20T04:45:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.666+0000 7ff047f5c640 1 -- 172.21.15.132:0/2432701961 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0401597c0 con 0x7ff0400cb2b0 2023-12-20T04:45:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.667+0000 7ff047f5c640 1 -- 172.21.15.132:0/2432701961 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff04004e840 con 0x7ff0400cb2b0 2023-12-20T04:45:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.667+0000 7ff0367fc640 1 -- 172.21.15.132:0/2432701961 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff03c00b040 con 0x7ff0400cb2b0 2023-12-20T04:45:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.667+0000 7ff0367fc640 1 --2- 172.21.15.132:0/2432701961 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff02406a430 0x7ff02406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.668+0000 7ff0367fc640 1 -- 172.21.15.132:0/2432701961 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(64..64 src has 1..64) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff03c0892c0 con 0x7ff0400cb2b0 2023-12-20T04:45:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.668+0000 7ff0454f7640 1 --2- 172.21.15.132:0/2432701961 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff02406a430 0x7ff02406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.668+0000 7ff0454f7640 1 --2- 172.21.15.132:0/2432701961 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff02406a430 0x7ff02406c8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff030007fd0 tx=0x7ff030007960 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:09.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.672+0000 7ff0367fc640 1 -- 172.21.15.132:0/2432701961 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff03c054940 con 0x7ff0400cb2b0 2023-12-20T04:45:09.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:09.873+0000 7ff047f5c640 1 -- 172.21.15.132:0/2432701961 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7ff0400b2890 con 0x7ff0400cb2b0 2023-12-20T04:45:10.471 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-12-20T04:45:10.469+0000 7ffa6f01c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:45:10.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.820+0000 7ff0367fc640 1 -- 172.21.15.132:0/2432701961 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v25) v1 ==== 118+0+0 (secure 0 0 0) 0x7ff03c05e030 con 0x7ff0400cb2b0 2023-12-20T04:45:10.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.823+0000 7ff047f5c640 1 -- 172.21.15.132:0/2432701961 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff02406a430 msgr2=0x7ff02406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:10.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.823+0000 7ff047f5c640 1 --2- 172.21.15.132:0/2432701961 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff02406a430 0x7ff02406c8f0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7ff030007fd0 tx=0x7ff030007960 comp rx=0 tx=0).stop 2023-12-20T04:45:10.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.823+0000 7ff047f5c640 1 -- 172.21.15.132:0/2432701961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0400cb2b0 msgr2=0x7ff040159280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:10.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.823+0000 7ff047f5c640 1 --2- 172.21.15.132:0/2432701961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0400cb2b0 0x7ff040159280 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff03c00ce00 tx=0x7ff03c00a650 comp rx=0 tx=0).stop 2023-12-20T04:45:10.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.823+0000 7ff047f5c640 1 -- 172.21.15.132:0/2432701961 shutdown_connections 2023-12-20T04:45:10.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.823+0000 7ff047f5c640 1 --2- 172.21.15.132:0/2432701961 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff02406a430 0x7ff02406c8f0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:10.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.823+0000 7ff047f5c640 1 --2- 172.21.15.132:0/2432701961 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff04015aee0 0x7ff04015c360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:10.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.823+0000 7ff047f5c640 1 --2- 172.21.15.132:0/2432701961 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0400cdd80 0x7ff04015be20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:10.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.823+0000 7ff047f5c640 1 --2- 172.21.15.132:0/2432701961 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0400cb2b0 0x7ff040159280 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:10.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.823+0000 7ff047f5c640 1 -- 172.21.15.132:0/2432701961 >> 172.21.15.132:0/2432701961 conn(0x7ff040072c60 msgr2=0x7ff0400cd670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:10.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.823+0000 7ff047f5c640 1 -- 172.21.15.132:0/2432701961 shutdown_connections 2023-12-20T04:45:10.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.823+0000 7ff047f5c640 1 -- 172.21.15.132:0/2432701961 wait complete. 2023-12-20T04:45:10.836 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-20T04:45:10.837 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-20T04:45:10.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.938+0000 7fa135f8b640 1 Processor -- start 2023-12-20T04:45:10.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.938+0000 7fa135f8b640 1 -- start start 2023-12-20T04:45:10.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.939+0000 7fa135f8b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa1300cb8b0 0x7fa130159a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:10.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.939+0000 7fa135f8b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa1300cb420 con 0x7fa130159f40 2023-12-20T04:45:10.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.939+0000 7fa135f8b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa13015a4f0 con 0x7fa1300cc940 2023-12-20T04:45:10.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.939+0000 7fa135f8b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa130153ee0 con 0x7fa1300cb8b0 2023-12-20T04:45:10.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.939+0000 7fa12ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa130159f40 0x7fa1300c9280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40952/0 (socket says 172.21.15.132:40952) 2023-12-20T04:45:10.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.939+0000 7fa12ffff640 1 -- 172.21.15.132:0/961929114 learned_addr learned my addr 172.21.15.132:0/961929114 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:45:10.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.939+0000 7fa12e7fc640 1 -- 172.21.15.132:0/961929114 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293740127 0 0) 0x7fa1300cb420 con 0x7fa130159f40 2023-12-20T04:45:10.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.939+0000 7fa12e7fc640 1 -- 172.21.15.132:0/961929114 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa118003520 con 0x7fa130159f40 2023-12-20T04:45:10.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.939+0000 7fa12effd640 1 --2- 172.21.15.132:0/961929114 >> v2:172.21.15.187:3300/0 conn(0x7fa1300cb8b0 0x7fa130159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:10.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12e7fc640 1 -- 172.21.15.132:0/961929114 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 798424740 0 0) 0x7fa118003520 con 0x7fa130159f40 2023-12-20T04:45:10.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12e7fc640 1 -- 172.21.15.132:0/961929114 >> v2:172.21.15.187:3300/0 conn(0x7fa1300cb8b0 msgr2=0x7fa130159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:10.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12e7fc640 1 --2- 172.21.15.132:0/961929114 >> v2:172.21.15.187:3300/0 conn(0x7fa1300cb8b0 0x7fa130159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:10.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12e7fc640 1 -- 172.21.15.132:0/961929114 >> v1:172.21.15.187:6789/0 conn(0x7fa1300cc940 legacy=0x7fa1300ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:10.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12e7fc640 1 -- 172.21.15.132:0/961929114 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa13015a7d0 con 0x7fa130159f40 2023-12-20T04:45:10.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12e7fc640 1 -- 172.21.15.132:0/961929114 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fa1280019f0 con 0x7fa130159f40 2023-12-20T04:45:10.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12e7fc640 1 -- 172.21.15.132:0/961929114 >> v1:172.21.15.132:6789/0 conn(0x7fa130159f40 legacy=0x7fa1300c9280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:10.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12e7fc640 1 --2- 172.21.15.132:0/961929114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa118003970 0x7fa118003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:10.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12e7fc640 1 --2- 172.21.15.132:0/961929114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1180047c0 0x7fa118004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:10.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12e7fc640 1 --2- 172.21.15.132:0/961929114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa118005180 0x7fa11800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:10.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12e7fc640 1 -- 172.21.15.132:0/961929114 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11800c060 con 0x7fa118005180 2023-12-20T04:45:10.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12e7fc640 1 -- 172.21.15.132:0/961929114 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa11800c1d0 con 0x7fa118003970 2023-12-20T04:45:10.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12e7fc640 1 -- 172.21.15.132:0/961929114 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa11800c390 con 0x7fa1180047c0 2023-12-20T04:45:10.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12ffff640 1 --2- 172.21.15.132:0/961929114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa118005180 0x7fa11800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:10.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12f7fe640 1 --2- 172.21.15.132:0/961929114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa118003970 0x7fa118003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:10.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12effd640 1 --2- 172.21.15.132:0/961929114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1180047c0 0x7fa118004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:10.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12ffff640 1 -- 172.21.15.132:0/961929114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1180047c0 msgr2=0x7fa118004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:10.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12ffff640 1 --2- 172.21.15.132:0/961929114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1180047c0 0x7fa118004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:10.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12ffff640 1 -- 172.21.15.132:0/961929114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa118003970 msgr2=0x7fa118003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:10.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12ffff640 1 --2- 172.21.15.132:0/961929114 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa118003970 0x7fa118003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:10.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12ffff640 1 -- 172.21.15.132:0/961929114 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa118003520 con 0x7fa118005180 2023-12-20T04:45:10.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.940+0000 7fa12effd640 1 --2- 172.21.15.132:0/961929114 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa1180047c0 0x7fa118004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:45:10.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.941+0000 7fa12ffff640 1 -- 172.21.15.132:0/961929114 reap_dead start 2023-12-20T04:45:10.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.941+0000 7fa12ffff640 1 --2- 172.21.15.132:0/961929114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa118005180 0x7fa11800b980 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa12800b830 tx=0x7fa1180057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dad80522cd15d616 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:10.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.941+0000 7fa12e7fc640 1 -- 172.21.15.132:0/961929114 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa128036070 con 0x7fa118005180 2023-12-20T04:45:10.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.941+0000 7fa12e7fc640 1 -- 172.21.15.132:0/961929114 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa128032420 con 0x7fa118005180 2023-12-20T04:45:10.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.941+0000 7fa12e7fc640 1 -- 172.21.15.132:0/961929114 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa1280325f0 con 0x7fa118005180 2023-12-20T04:45:10.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.941+0000 7fa135f8b640 1 -- 172.21.15.132:0/961929114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa118005180 msgr2=0x7fa11800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:10.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.941+0000 7fa135f8b640 1 --2- 172.21.15.132:0/961929114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa118005180 0x7fa11800b980 secure :-1 s=READY pgs=745 cs=0 l=1 rev1=1 crypto rx=0x7fa12800b830 tx=0x7fa1180057f0 comp rx=0 tx=0).stop 2023-12-20T04:45:10.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.941+0000 7fa135f8b640 1 -- 172.21.15.132:0/961929114 shutdown_connections 2023-12-20T04:45:10.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.941+0000 7fa135f8b640 1 --2- 172.21.15.132:0/961929114 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa118005180 0x7fa11800b980 unknown :-1 s=CLOSED pgs=745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:10.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.941+0000 7fa135f8b640 1 -- 172.21.15.132:0/961929114 >> 172.21.15.132:0/961929114 conn(0x7fa13006a260 msgr2=0x7fa1300b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:10.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.941+0000 7fa135f8b640 1 -- 172.21.15.132:0/961929114 shutdown_connections 2023-12-20T04:45:10.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.941+0000 7fa135f8b640 1 -- 172.21.15.132:0/961929114 wait complete. 2023-12-20T04:45:10.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.943+0000 7fa135f8b640 1 Processor -- start 2023-12-20T04:45:10.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.943+0000 7fa135f8b640 1 -- start start 2023-12-20T04:45:10.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.944+0000 7fa135f8b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa118005180 0x7fa130146410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:10.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.944+0000 7fa135f8b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa130152790 0x7fa130152c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:10.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.944+0000 7fa135f8b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1300b22b0 0x7fa1300b2730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:10.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.944+0000 7fa135f8b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa130153150 con 0x7fa130152790 2023-12-20T04:45:10.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.944+0000 7fa135f8b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa130146950 con 0x7fa1300b22b0 2023-12-20T04:45:10.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.944+0000 7fa135f8b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa130151bd0 con 0x7fa118005180 2023-12-20T04:45:10.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.944+0000 7fa12effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa130152790 0x7fa130152c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:10.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.944+0000 7fa12effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa130152790 0x7fa130152c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35916/0 (socket says 172.21.15.132:35916) 2023-12-20T04:45:10.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.944+0000 7fa12effd640 1 -- 172.21.15.132:0/3342986996 learned_addr learned my addr 172.21.15.132:0/3342986996 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:10.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.944+0000 7fa12f7fe640 1 --2- 172.21.15.132:0/3342986996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa118005180 0x7fa130146410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:10.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.944+0000 7fa12ffff640 1 --2- 172.21.15.132:0/3342986996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1300b22b0 0x7fa1300b2730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:10.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.944+0000 7fa12effd640 1 -- 172.21.15.132:0/3342986996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa118005180 msgr2=0x7fa130146410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:10.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.944+0000 7fa12effd640 1 --2- 172.21.15.132:0/3342986996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa118005180 0x7fa130146410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:10.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.944+0000 7fa12effd640 1 -- 172.21.15.132:0/3342986996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1300b22b0 msgr2=0x7fa1300b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:10.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.944+0000 7fa12effd640 1 --2- 172.21.15.132:0/3342986996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1300b22b0 0x7fa1300b2730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:10.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.944+0000 7fa12effd640 1 -- 172.21.15.132:0/3342986996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa1300c5ea0 con 0x7fa130152790 2023-12-20T04:45:10.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.944+0000 7fa12effd640 1 --2- 172.21.15.132:0/3342986996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa130152790 0x7fa130152c10 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa124011bd0 tx=0x7fa12400b510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:10.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.946+0000 7fa117fff640 1 -- 172.21.15.132:0/3342986996 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12401a440 con 0x7fa130152790 2023-12-20T04:45:10.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.946+0000 7fa117fff640 1 -- 172.21.15.132:0/3342986996 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa12401a5a0 con 0x7fa130152790 2023-12-20T04:45:10.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.946+0000 7fa135f8b640 1 -- 172.21.15.132:0/3342986996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa1300c6180 con 0x7fa130152790 2023-12-20T04:45:10.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.946+0000 7fa117fff640 1 -- 172.21.15.132:0/3342986996 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa12401a910 con 0x7fa130152790 2023-12-20T04:45:10.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.946+0000 7fa135f8b640 1 -- 172.21.15.132:0/3342986996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa1300b1ab0 con 0x7fa130152790 2023-12-20T04:45:10.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.947+0000 7fa135f8b640 1 -- 172.21.15.132:0/3342986996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa13004e840 con 0x7fa130152790 2023-12-20T04:45:10.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.947+0000 7fa117fff640 1 -- 172.21.15.132:0/3342986996 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa124023440 con 0x7fa130152790 2023-12-20T04:45:10.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.948+0000 7fa117fff640 1 --2- 172.21.15.132:0/3342986996 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa11c06a430 0x7fa11c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:10.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.948+0000 7fa117fff640 1 -- 172.21.15.132:0/3342986996 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa12408aea0 con 0x7fa130152790 2023-12-20T04:45:10.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.948+0000 7fa12f7fe640 1 --2- 172.21.15.132:0/3342986996 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa11c06a430 0x7fa11c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:10.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.948+0000 7fa12f7fe640 1 --2- 172.21.15.132:0/3342986996 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa11c06a430 0x7fa11c06c8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa120004f70 tx=0x7fa120007cc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:10.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:10.952+0000 7fa117fff640 1 -- 172.21.15.132:0/3342986996 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa1240565d0 con 0x7fa130152790 2023-12-20T04:45:11.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:11.157+0000 7fa135f8b640 1 -- 172.21.15.132:0/3342986996 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fa130152270 con 0x7fa130152790 2023-12-20T04:45:11.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:11.947+0000 7fa117fff640 1 -- 172.21.15.132:0/3342986996 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v26) v1 ==== 122+0+0 (secure 0 0 0) 0x7fa124059bf0 con 0x7fa130152790 2023-12-20T04:45:11.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:11.950+0000 7fa135f8b640 1 -- 172.21.15.132:0/3342986996 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa11c06a430 msgr2=0x7fa11c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:11.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:11.950+0000 7fa135f8b640 1 --2- 172.21.15.132:0/3342986996 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa11c06a430 0x7fa11c06c8f0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7fa120004f70 tx=0x7fa120007cc0 comp rx=0 tx=0).stop 2023-12-20T04:45:11.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:11.950+0000 7fa135f8b640 1 -- 172.21.15.132:0/3342986996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa130152790 msgr2=0x7fa130152c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:11.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:11.950+0000 7fa135f8b640 1 --2- 172.21.15.132:0/3342986996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa130152790 0x7fa130152c10 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7fa124011bd0 tx=0x7fa12400b510 comp rx=0 tx=0).stop 2023-12-20T04:45:11.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:11.950+0000 7fa135f8b640 1 -- 172.21.15.132:0/3342986996 shutdown_connections 2023-12-20T04:45:11.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:11.950+0000 7fa135f8b640 1 --2- 172.21.15.132:0/3342986996 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa11c06a430 0x7fa11c06c8f0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:11.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:11.950+0000 7fa135f8b640 1 --2- 172.21.15.132:0/3342986996 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa1300b22b0 0x7fa1300b2730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:11.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:11.950+0000 7fa135f8b640 1 --2- 172.21.15.132:0/3342986996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa130152790 0x7fa130152c10 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:11.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:11.950+0000 7fa135f8b640 1 --2- 172.21.15.132:0/3342986996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa118005180 0x7fa130146410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:11.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:11.950+0000 7fa135f8b640 1 -- 172.21.15.132:0/3342986996 >> 172.21.15.132:0/3342986996 conn(0x7fa13006a260 msgr2=0x7fa130070320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:11.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:11.950+0000 7fa135f8b640 1 -- 172.21.15.132:0/3342986996 shutdown_connections 2023-12-20T04:45:11.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:11.950+0000 7fa135f8b640 1 -- 172.21.15.132:0/3342986996 wait complete. 2023-12-20T04:45:11.965 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-20T04:45:11.965 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:45:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.069+0000 7f1356dc9640 1 Processor -- start 2023-12-20T04:45:12.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.069+0000 7f1356dc9640 1 -- start start 2023-12-20T04:45:12.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f1356dc9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f135015e2d0 0x7f13500b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f1356dc9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13500cd740 con 0x7f13500cf0b0 2023-12-20T04:45:12.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f1356dc9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13500ce230 con 0x7f13500cb420 2023-12-20T04:45:12.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f1356dc9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13500cd990 con 0x7f135015e2d0 2023-12-20T04:45:12.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f1355366640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f13500cf0b0 0x7f13500d07f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40968/0 (socket says 172.21.15.132:40968) 2023-12-20T04:45:12.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f1355366640 1 -- 172.21.15.132:0/3695421734 learned_addr learned my addr 172.21.15.132:0/3695421734 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:45:12.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f1354b65640 1 --2- 172.21.15.132:0/3695421734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f135015e2d0 0x7f13500b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f134f7fe640 1 -- 172.21.15.132:0/3695421734 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3714063288 0 0) 0x7f13500cd740 con 0x7f13500cf0b0 2023-12-20T04:45:12.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f134f7fe640 1 -- 172.21.15.132:0/3695421734 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f133c003520 con 0x7f13500cf0b0 2023-12-20T04:45:12.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f134f7fe640 1 -- 172.21.15.132:0/3695421734 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 93572371 0 0) 0x7f133c003520 con 0x7f13500cf0b0 2023-12-20T04:45:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f134f7fe640 1 -- 172.21.15.132:0/3695421734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f135015e2d0 msgr2=0x7f13500b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f134f7fe640 1 --2- 172.21.15.132:0/3695421734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f135015e2d0 0x7f13500b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f134f7fe640 1 -- 172.21.15.132:0/3695421734 >> v1:172.21.15.187:6789/0 conn(0x7f13500cb420 legacy=0x7f13500ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f134f7fe640 1 -- 172.21.15.132:0/3695421734 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13500cdc70 con 0x7f13500cf0b0 2023-12-20T04:45:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f134f7fe640 1 -- 172.21.15.132:0/3695421734 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f1340001670 con 0x7f13500cf0b0 2023-12-20T04:45:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f134f7fe640 1 -- 172.21.15.132:0/3695421734 >> v1:172.21.15.132:6789/0 conn(0x7f13500cf0b0 legacy=0x7f13500d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f134f7fe640 1 --2- 172.21.15.132:0/3695421734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f135015e2d0 0x7f133c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f134f7fe640 1 --2- 172.21.15.132:0/3695421734 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c003ee0 0x7f133c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f134f7fe640 1 --2- 172.21.15.132:0/3695421734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c004d00 0x7f133c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f134f7fe640 1 -- 172.21.15.132:0/3695421734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13500cd990 con 0x7f133c004d00 2023-12-20T04:45:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f134f7fe640 1 -- 172.21.15.132:0/3695421734 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133c00ba90 con 0x7f133c003ee0 2023-12-20T04:45:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f134f7fe640 1 -- 172.21.15.132:0/3695421734 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f133c00bc50 con 0x7f135015e2d0 2023-12-20T04:45:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.070+0000 7f1355366640 1 --2- 172.21.15.132:0/3695421734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c004d00 0x7f133c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.071+0000 7f134ffff640 1 --2- 172.21.15.132:0/3695421734 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c003ee0 0x7f133c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.071+0000 7f1354b65640 1 --2- 172.21.15.132:0/3695421734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f135015e2d0 0x7f133c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.071+0000 7f1355366640 1 -- 172.21.15.132:0/3695421734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f135015e2d0 msgr2=0x7f133c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.071+0000 7f1355366640 1 --2- 172.21.15.132:0/3695421734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f135015e2d0 0x7f133c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.071+0000 7f1355366640 1 -- 172.21.15.132:0/3695421734 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c003ee0 msgr2=0x7f133c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.071+0000 7f1355366640 1 --2- 172.21.15.132:0/3695421734 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f133c003ee0 0x7f133c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.071+0000 7f1355366640 1 -- 172.21.15.132:0/3695421734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f133c003520 con 0x7f133c004d00 2023-12-20T04:45:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.071+0000 7f1355366640 1 --2- 172.21.15.132:0/3695421734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c004d00 0x7f133c005180 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f134000c210 tx=0x7f133c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dbf55c0c230a733a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.072+0000 7f134f7fe640 1 -- 172.21.15.132:0/3695421734 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1340005ad0 con 0x7f133c004d00 2023-12-20T04:45:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.072+0000 7f134f7fe640 1 -- 172.21.15.132:0/3695421734 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1340005c50 con 0x7f133c004d00 2023-12-20T04:45:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.072+0000 7f134f7fe640 1 -- 172.21.15.132:0/3695421734 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134002c8d0 con 0x7f133c004d00 2023-12-20T04:45:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.072+0000 7f1356dc9640 1 -- 172.21.15.132:0/3695421734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c004d00 msgr2=0x7f133c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.072+0000 7f1356dc9640 1 --2- 172.21.15.132:0/3695421734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c004d00 0x7f133c005180 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f134000c210 tx=0x7f133c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.072+0000 7f1355366640 1 -- 172.21.15.132:0/3695421734 reap_dead start 2023-12-20T04:45:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.072+0000 7f1356dc9640 1 -- 172.21.15.132:0/3695421734 shutdown_connections 2023-12-20T04:45:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.072+0000 7f1356dc9640 1 -- 172.21.15.132:0/3695421734 >> 172.21.15.132:0/3695421734 conn(0x7f135006d7c0 msgr2=0x7f135006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.072+0000 7f1356dc9640 1 -- 172.21.15.132:0/3695421734 shutdown_connections 2023-12-20T04:45:12.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.072+0000 7f1356dc9640 1 -- 172.21.15.132:0/3695421734 wait complete. 2023-12-20T04:45:12.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.073+0000 7f1356dc9640 1 Processor -- start 2023-12-20T04:45:12.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.073+0000 7f1356dc9640 1 -- start start 2023-12-20T04:45:12.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.074+0000 7f1356dc9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c004d00 0x7f135015bf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.074+0000 7f1356dc9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13501560d0 0x7f135015c470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.074+0000 7f1356dc9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13501f5130 0x7f13501445f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.074+0000 7f1356dc9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13500c4030 con 0x7f133c004d00 2023-12-20T04:45:12.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.074+0000 7f1356dc9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13501f4ca0 con 0x7f13501560d0 2023-12-20T04:45:12.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.074+0000 7f1356dc9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1350152550 con 0x7f13501f5130 2023-12-20T04:45:12.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.074+0000 7f1354b65640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c004d00 0x7f135015bf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.074+0000 7f1354b65640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c004d00 0x7f135015bf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35922/0 (socket says 172.21.15.132:35922) 2023-12-20T04:45:12.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.074+0000 7f1354b65640 1 -- 172.21.15.132:0/975790231 learned_addr learned my addr 172.21.15.132:0/975790231 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:12.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.075+0000 7f134ffff640 1 --2- 172.21.15.132:0/975790231 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13501560d0 0x7f135015c470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.075+0000 7f1355366640 1 --2- 172.21.15.132:0/975790231 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13501f5130 0x7f13501445f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.075+0000 7f1354b65640 1 -- 172.21.15.132:0/975790231 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13501f5130 msgr2=0x7f13501445f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.075+0000 7f1354b65640 1 --2- 172.21.15.132:0/975790231 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13501f5130 0x7f13501445f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.075+0000 7f1354b65640 1 -- 172.21.15.132:0/975790231 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13501560d0 msgr2=0x7f135015c470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.075+0000 7f1354b65640 1 --2- 172.21.15.132:0/975790231 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13501560d0 0x7f135015c470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.075+0000 7f1354b65640 1 -- 172.21.15.132:0/975790231 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13501565d0 con 0x7f133c004d00 2023-12-20T04:45:12.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.075+0000 7f1354b65640 1 --2- 172.21.15.132:0/975790231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c004d00 0x7f135015bf30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1348011e30 tx=0x7f134800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:12.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.075+0000 7f134d7fa640 1 -- 172.21.15.132:0/975790231 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f134800e040 con 0x7f133c004d00 2023-12-20T04:45:12.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.075+0000 7f134d7fa640 1 -- 172.21.15.132:0/975790231 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f134800f040 con 0x7f133c004d00 2023-12-20T04:45:12.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.075+0000 7f134d7fa640 1 -- 172.21.15.132:0/975790231 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1348009c00 con 0x7f133c004d00 2023-12-20T04:45:12.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.075+0000 7f1356dc9640 1 -- 172.21.15.132:0/975790231 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13501f4650 con 0x7f133c004d00 2023-12-20T04:45:12.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.075+0000 7f1356dc9640 1 -- 172.21.15.132:0/975790231 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1350144b30 con 0x7f133c004d00 2023-12-20T04:45:12.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.076+0000 7f1356dc9640 1 -- 172.21.15.132:0/975790231 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13501f44b0 con 0x7f133c004d00 2023-12-20T04:45:12.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.076+0000 7f134d7fa640 1 -- 172.21.15.132:0/975790231 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1348015850 con 0x7f133c004d00 2023-12-20T04:45:12.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.077+0000 7f134d7fa640 1 --2- 172.21.15.132:0/975790231 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f133006a460 0x7f133006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.077+0000 7f134ffff640 1 --2- 172.21.15.132:0/975790231 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f133006a460 0x7f133006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.077+0000 7f134d7fa640 1 -- 172.21.15.132:0/975790231 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13480896b0 con 0x7f133c004d00 2023-12-20T04:45:12.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.077+0000 7f134ffff640 1 --2- 172.21.15.132:0/975790231 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f133006a460 0x7f133006c920 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f13500cb3f0 tx=0x7f1338009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:12.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.081+0000 7f134d7fa640 1 -- 172.21.15.132:0/975790231 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f13501f44b0 con 0x7f133c004d00 2023-12-20T04:45:12.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.281+0000 7f1356dc9640 1 -- 172.21.15.132:0/975790231 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f13501f44b0 con 0x7f133c004d00 2023-12-20T04:45:12.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.281+0000 7f134d7fa640 1 -- 172.21.15.132:0/975790231 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4721 (secure 0 0 0) 0x7f13501f44b0 con 0x7f133c004d00 2023-12-20T04:45:12.283 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:45:12.284 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3967216203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":3967216203},{"type":"v1","addr":"172.21.15.132:6837","nonce":3967216203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2592935145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2592935145},{"type":"v1","addr":"172.21.15.187:6833","nonce":2592935145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2061740954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2061740954},{"type":"v1","addr":"172.21.15.132:6835","nonce":2061740954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:45:08.941383+0000","modified":"2023-12-20T04:45:11.945725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6183":{"gid":6183,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/3119150547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3119150547},{"type":"v1","addr":"172.21.15.187:6835","nonce":3119150547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-20T04:45:12.284 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 26 2023-12-20T04:45:12.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.283+0000 7f1356dc9640 1 -- 172.21.15.132:0/975790231 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f133006a460 msgr2=0x7f133006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.283+0000 7f1356dc9640 1 --2- 172.21.15.132:0/975790231 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f133006a460 0x7f133006c920 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f13500cb3f0 tx=0x7f1338009040 comp rx=0 tx=0).stop 2023-12-20T04:45:12.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.283+0000 7f1356dc9640 1 -- 172.21.15.132:0/975790231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c004d00 msgr2=0x7f135015bf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.283+0000 7f1356dc9640 1 --2- 172.21.15.132:0/975790231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c004d00 0x7f135015bf30 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f1348011e30 tx=0x7f134800f580 comp rx=0 tx=0).stop 2023-12-20T04:45:12.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.283+0000 7f1356dc9640 1 -- 172.21.15.132:0/975790231 shutdown_connections 2023-12-20T04:45:12.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.283+0000 7f1356dc9640 1 --2- 172.21.15.132:0/975790231 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f133006a460 0x7f133006c920 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.283+0000 7f1356dc9640 1 --2- 172.21.15.132:0/975790231 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13501f5130 0x7f13501445f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.283+0000 7f1356dc9640 1 --2- 172.21.15.132:0/975790231 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13501560d0 0x7f135015c470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.283+0000 7f1356dc9640 1 --2- 172.21.15.132:0/975790231 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f133c004d00 0x7f135015bf30 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.283+0000 7f1356dc9640 1 -- 172.21.15.132:0/975790231 >> 172.21.15.132:0/975790231 conn(0x7f135006d7c0 msgr2=0x7f13500d10f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:12.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.283+0000 7f1356dc9640 1 -- 172.21.15.132:0/975790231 shutdown_connections 2023-12-20T04:45:12.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.283+0000 7f1356dc9640 1 -- 172.21.15.132:0/975790231 wait complete. 2023-12-20T04:45:12.296 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:45:12.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.393+0000 7f19ed199640 1 Processor -- start 2023-12-20T04:45:12.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.393+0000 7f19ed199640 1 -- start start 2023-12-20T04:45:12.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.394+0000 7f19ed199640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f19e8160450 0x7f19e8160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.394+0000 7f19ed199640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19e81611b0 0x7f19e80b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.394+0000 7f19ed199640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f19e80b4ec0 0x7f19e806a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.394+0000 7f19ed199640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e80b5350 con 0x7f19e8160450 2023-12-20T04:45:12.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.394+0000 7f19ed199640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19e80b5ec0 con 0x7f19e80b4ec0 2023-12-20T04:45:12.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.394+0000 7f19ed199640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e81617e0 con 0x7f19e81611b0 2023-12-20T04:45:12.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.394+0000 7f19e6d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f19e8160450 0x7f19e8160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.394+0000 7f19e6d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f19e8160450 0x7f19e8160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35926/0 (socket says 172.21.15.132:35926) 2023-12-20T04:45:12.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.394+0000 7f19e6d9d640 1 -- 172.21.15.132:0/3420856807 learned_addr learned my addr 172.21.15.132:0/3420856807 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:12.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.395+0000 7f19e759e640 1 --2- 172.21.15.132:0/3420856807 >> v2:172.21.15.187:3300/0 conn(0x7f19e80b4ec0 0x7f19e806a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.395+0000 7f19e659c640 1 --2- 172.21.15.132:0/3420856807 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19e81611b0 0x7f19e80b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.395+0000 7f19e6d9d640 1 -- 172.21.15.132:0/3420856807 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19e81611b0 msgr2=0x7f19e80b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:12.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.395+0000 7f19e6d9d640 1 --2- 172.21.15.132:0/3420856807 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19e81611b0 0x7f19e80b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.395+0000 7f19e6d9d640 1 -- 172.21.15.132:0/3420856807 >> v2:172.21.15.187:3300/0 conn(0x7f19e80b4ec0 msgr2=0x7f19e806a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:12.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.395+0000 7f19e6d9d640 1 --2- 172.21.15.132:0/3420856807 >> v2:172.21.15.187:3300/0 conn(0x7f19e80b4ec0 0x7f19e806a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.395+0000 7f19e6d9d640 1 -- 172.21.15.132:0/3420856807 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19e80d0fc0 con 0x7f19e8160450 2023-12-20T04:45:12.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.395+0000 7f19e759e640 1 --2- 172.21.15.132:0/3420856807 >> v2:172.21.15.187:3300/0 conn(0x7f19e80b4ec0 0x7f19e806a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:45:12.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.395+0000 7f19e6d9d640 1 --2- 172.21.15.132:0/3420856807 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19e8160450 0x7f19e8160c70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f19e80b59d0 tx=0x7f19d802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9fc6986c4f6a044c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:12.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.395+0000 7f19e5d9b640 1 -- 172.21.15.132:0/3420856807 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8030860 con 0x7f19e8160450 2023-12-20T04:45:12.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.396+0000 7f19e5d9b640 1 -- 172.21.15.132:0/3420856807 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d80309c0 con 0x7f19e8160450 2023-12-20T04:45:12.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.396+0000 7f19e5d9b640 1 -- 172.21.15.132:0/3420856807 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8030d50 con 0x7f19e8160450 2023-12-20T04:45:12.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.396+0000 7f19ed199640 1 -- 172.21.15.132:0/3420856807 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19e8160450 msgr2=0x7f19e8160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.396+0000 7f19ed199640 1 --2- 172.21.15.132:0/3420856807 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19e8160450 0x7f19e8160c70 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f19e80b59d0 tx=0x7f19d802b9a0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.396+0000 7f19ed199640 1 -- 172.21.15.132:0/3420856807 shutdown_connections 2023-12-20T04:45:12.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.396+0000 7f19ed199640 1 --2- 172.21.15.132:0/3420856807 >> v2:172.21.15.187:3300/0 conn(0x7f19e80b4ec0 0x7f19e806a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.396+0000 7f19ed199640 1 --2- 172.21.15.132:0/3420856807 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19e81611b0 0x7f19e80b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.396+0000 7f19ed199640 1 --2- 172.21.15.132:0/3420856807 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19e8160450 0x7f19e8160c70 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.396+0000 7f19ed199640 1 -- 172.21.15.132:0/3420856807 >> 172.21.15.132:0/3420856807 conn(0x7f19e80cf980 msgr2=0x7f19e80cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:12.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.396+0000 7f19ed199640 1 -- 172.21.15.132:0/3420856807 shutdown_connections 2023-12-20T04:45:12.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.396+0000 7f19ed199640 1 -- 172.21.15.132:0/3420856807 wait complete. 2023-12-20T04:45:12.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.398+0000 7f19ed199640 1 Processor -- start 2023-12-20T04:45:12.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.398+0000 7f19ed199640 1 -- start start 2023-12-20T04:45:12.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.398+0000 7f19ed199640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19e80b4ec0 0x7f19e8154380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.398+0000 7f19ed199640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19e8160450 0x7f19e80b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.398+0000 7f19ed199640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19e81611b0 0x7f19e80b7880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.398+0000 7f19ed199640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80b8370 con 0x7f19e80b4ec0 2023-12-20T04:45:12.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.398+0000 7f19ed199640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80b7dc0 con 0x7f19e8160450 2023-12-20T04:45:12.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.398+0000 7f19ed199640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19e80b8090 con 0x7f19e81611b0 2023-12-20T04:45:12.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.398+0000 7f19e6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19e80b4ec0 0x7f19e8154380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.398+0000 7f19e6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19e80b4ec0 0x7f19e8154380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35936/0 (socket says 172.21.15.132:35936) 2023-12-20T04:45:12.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.398+0000 7f19e6d9d640 1 -- 172.21.15.132:0/1126675276 learned_addr learned my addr 172.21.15.132:0/1126675276 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:12.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.399+0000 7f19e659c640 1 --2- 172.21.15.132:0/1126675276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19e8160450 0x7f19e80b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.399+0000 7f19e6d9d640 1 -- 172.21.15.132:0/1126675276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19e81611b0 msgr2=0x7f19e80b7880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.399+0000 7f19e759e640 1 --2- 172.21.15.132:0/1126675276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19e81611b0 0x7f19e80b7880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.399+0000 7f19e6d9d640 1 --2- 172.21.15.132:0/1126675276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19e81611b0 0x7f19e80b7880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.399+0000 7f19e6d9d640 1 -- 172.21.15.132:0/1126675276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19e8160450 msgr2=0x7f19e80b7340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.399+0000 7f19e6d9d640 1 --2- 172.21.15.132:0/1126675276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19e8160450 0x7f19e80b7340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.399+0000 7f19e6d9d640 1 -- 172.21.15.132:0/1126675276 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d80094d0 con 0x7f19e80b4ec0 2023-12-20T04:45:12.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.399+0000 7f19e659c640 1 --2- 172.21.15.132:0/1126675276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19e8160450 0x7f19e80b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:45:12.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.399+0000 7f19e759e640 1 --2- 172.21.15.132:0/1126675276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19e81611b0 0x7f19e80b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:45:12.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.399+0000 7f19e6d9d640 1 --2- 172.21.15.132:0/1126675276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19e80b4ec0 0x7f19e8154380 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f19d802b9e0 tx=0x7f19d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:12.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.399+0000 7f19cf7fe640 1 -- 172.21.15.132:0/1126675276 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d8030850 con 0x7f19e80b4ec0 2023-12-20T04:45:12.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.399+0000 7f19cf7fe640 1 -- 172.21.15.132:0/1126675276 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f19d8043400 con 0x7f19e80b4ec0 2023-12-20T04:45:12.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.399+0000 7f19ed199640 1 -- 172.21.15.132:0/1126675276 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e8144fc0 con 0x7f19e80b4ec0 2023-12-20T04:45:12.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.399+0000 7f19cf7fe640 1 -- 172.21.15.132:0/1126675276 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19d80437b0 con 0x7f19e80b4ec0 2023-12-20T04:45:12.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.399+0000 7f19ed199640 1 -- 172.21.15.132:0/1126675276 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e8145580 con 0x7f19e80b4ec0 2023-12-20T04:45:12.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.400+0000 7f19ed199640 1 -- 172.21.15.132:0/1126675276 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e804e840 con 0x7f19e80b4ec0 2023-12-20T04:45:12.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.401+0000 7f19cf7fe640 1 -- 172.21.15.132:0/1126675276 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f19d8043910 con 0x7f19e80b4ec0 2023-12-20T04:45:12.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.401+0000 7f19cf7fe640 1 --2- 172.21.15.132:0/1126675276 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f19d406a430 0x7f19d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.401+0000 7f19cf7fe640 1 -- 172.21.15.132:0/1126675276 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f19d803e070 con 0x7f19e80b4ec0 2023-12-20T04:45:12.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.401+0000 7f19e659c640 1 --2- 172.21.15.132:0/1126675276 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f19d406a430 0x7f19d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.401+0000 7f19e659c640 1 --2- 172.21.15.132:0/1126675276 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f19d406a430 0x7f19d406c8f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f19e8153400 tx=0x7f19dc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:12.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.405+0000 7f19cf7fe640 1 -- 172.21.15.132:0/1126675276 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f19d8077230 con 0x7f19e80b4ec0 2023-12-20T04:45:12.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.571+0000 7f19ed199640 1 -- 172.21.15.132:0/1126675276 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19e80d0ad0 con 0x7f19e80b4ec0 2023-12-20T04:45:12.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.572+0000 7f19cf7fe640 1 -- 172.21.15.132:0/1126675276 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v65) v1 ==== 74+0+16145 (secure 0 0 0) 0x7f19d8034090 con 0x7f19e80b4ec0 2023-12-20T04:45:12.574 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:45:12.574 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":65,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:45:09.943092+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"53","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:45:07.136819+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"64","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-20T04:45:07.907185+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"65","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:45:12.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.574+0000 7f19ed199640 1 -- 172.21.15.132:0/1126675276 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f19d406a430 msgr2=0x7f19d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.574+0000 7f19ed199640 1 --2- 172.21.15.132:0/1126675276 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f19d406a430 0x7f19d406c8f0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f19e8153400 tx=0x7f19dc008040 comp rx=0 tx=0).stop 2023-12-20T04:45:12.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.574+0000 7f19ed199640 1 -- 172.21.15.132:0/1126675276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19e80b4ec0 msgr2=0x7f19e8154380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.574+0000 7f19ed199640 1 --2- 172.21.15.132:0/1126675276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19e80b4ec0 0x7f19e8154380 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f19d802b9e0 tx=0x7f19d8004730 comp rx=0 tx=0).stop 2023-12-20T04:45:12.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.574+0000 7f19ed199640 1 -- 172.21.15.132:0/1126675276 shutdown_connections 2023-12-20T04:45:12.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.574+0000 7f19ed199640 1 --2- 172.21.15.132:0/1126675276 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f19d406a430 0x7f19d406c8f0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.574+0000 7f19ed199640 1 --2- 172.21.15.132:0/1126675276 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19e81611b0 0x7f19e80b7880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.574+0000 7f19ed199640 1 --2- 172.21.15.132:0/1126675276 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19e8160450 0x7f19e80b7340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.574+0000 7f19ed199640 1 --2- 172.21.15.132:0/1126675276 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19e80b4ec0 0x7f19e8154380 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.574+0000 7f19ed199640 1 -- 172.21.15.132:0/1126675276 >> 172.21.15.132:0/1126675276 conn(0x7f19e80cf980 msgr2=0x7f19e80cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:12.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.575+0000 7f19ed199640 1 -- 172.21.15.132:0/1126675276 shutdown_connections 2023-12-20T04:45:12.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.575+0000 7f19ed199640 1 -- 172.21.15.132:0/1126675276 wait complete. 2023-12-20T04:45:12.588 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-20T04:45:12.588 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:45:12.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.685+0000 7f8cf6f55640 1 Processor -- start 2023-12-20T04:45:12.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.685+0000 7f8cf6f55640 1 -- start start 2023-12-20T04:45:12.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.686+0000 7f8cf6f55640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8cf0160450 0x7f8cf0160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.686+0000 7f8cf6f55640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf00b5ec0 con 0x7f8cf01611b0 2023-12-20T04:45:12.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.686+0000 7f8cf6f55640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cf01617e0 con 0x7f8cf00b5090 2023-12-20T04:45:12.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.686+0000 7f8cf6f55640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8cf00d0fc0 con 0x7f8cf0160450 2023-12-20T04:45:12.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.686+0000 7f8cf4cf1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8cf0160450 0x7f8cf0160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.686+0000 7f8ceffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8cf01611b0 0x7f8cf00b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40982/0 (socket says 172.21.15.132:40982) 2023-12-20T04:45:12.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.686+0000 7f8cf4cf1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8cf0160450 0x7f8cf0160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35950/0 (socket says 172.21.15.132:35950) 2023-12-20T04:45:12.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.686+0000 7f8ceffff640 1 -- 172.21.15.132:0/1584038273 learned_addr learned my addr 172.21.15.132:0/1584038273 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:45:12.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.687+0000 7f8cf4cf1640 1 -- 172.21.15.132:0/1584038273 >> v1:172.21.15.187:6789/0 conn(0x7f8cf00b5090 legacy=0x7f8cf00d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.687+0000 7f8cf4cf1640 1 -- 172.21.15.132:0/1584038273 >> v1:172.21.15.132:6789/0 conn(0x7f8cf01611b0 legacy=0x7f8cf00b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.687+0000 7f8cef7fe640 1 -- 172.21.15.132:0/1584038273 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1158327342 0 0) 0x7f8cf00b5ec0 con 0x7f8cf01611b0 2023-12-20T04:45:12.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.687+0000 7f8cf4cf1640 1 -- 172.21.15.132:0/1584038273 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cf00d12a0 con 0x7f8cf0160450 2023-12-20T04:45:12.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.687+0000 7f8cf4cf1640 1 --2- 172.21.15.132:0/1584038273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cf0160450 0x7f8cf0160c70 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00097a0 tx=0x7f8ce002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73be81207126b3dd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:12.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.687+0000 7f8cef7fe640 1 -- 172.21.15.132:0/1584038273 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce002f810 con 0x7f8cf0160450 2023-12-20T04:45:12.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.688+0000 7f8cef7fe640 1 -- 172.21.15.132:0/1584038273 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce002f970 con 0x7f8cf0160450 2023-12-20T04:45:12.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.688+0000 7f8cef7fe640 1 -- 172.21.15.132:0/1584038273 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce002fd00 con 0x7f8cf0160450 2023-12-20T04:45:12.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.688+0000 7f8cf6f55640 1 -- 172.21.15.132:0/1584038273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cf0160450 msgr2=0x7f8cf0160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.688+0000 7f8cf6f55640 1 --2- 172.21.15.132:0/1584038273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cf0160450 0x7f8cf0160c70 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f8ce00097a0 tx=0x7f8ce002b9f0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.688+0000 7f8cf6f55640 1 -- 172.21.15.132:0/1584038273 shutdown_connections 2023-12-20T04:45:12.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.688+0000 7f8cf6f55640 1 --2- 172.21.15.132:0/1584038273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cf0160450 0x7f8cf0160c70 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.688+0000 7f8cf6f55640 1 -- 172.21.15.132:0/1584038273 >> 172.21.15.132:0/1584038273 conn(0x7f8cf00cf980 msgr2=0x7f8cf00cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:12.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.688+0000 7f8cf6f55640 1 -- 172.21.15.132:0/1584038273 shutdown_connections 2023-12-20T04:45:12.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.688+0000 7f8cf6f55640 1 -- 172.21.15.132:0/1584038273 wait complete. 2023-12-20T04:45:12.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.689+0000 7f8cf6f55640 1 Processor -- start 2023-12-20T04:45:12.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.689+0000 7f8cf6f55640 1 -- start start 2023-12-20T04:45:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.690+0000 7f8cf6f55640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cf00b5090 0x7f8cf00d2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.690+0000 7f8cf6f55640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cf0160450 0x7f8cf00d2ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.690+0000 7f8cf6f55640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cf01611b0 0x7f8cf01f1d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.690+0000 7f8cf6f55640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf0148a80 con 0x7f8cf01611b0 2023-12-20T04:45:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.690+0000 7f8cf6f55640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf0148ef0 con 0x7f8cf00b5090 2023-12-20T04:45:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.690+0000 7f8cf6f55640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cf01487a0 con 0x7f8cf0160450 2023-12-20T04:45:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.690+0000 7f8cf54f2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cf01611b0 0x7f8cf01f1d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.690+0000 7f8cf54f2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cf01611b0 0x7f8cf01f1d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35958/0 (socket says 172.21.15.132:35958) 2023-12-20T04:45:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.690+0000 7f8cf54f2640 1 -- 172.21.15.132:0/1849847551 learned_addr learned my addr 172.21.15.132:0/1849847551 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.690+0000 7f8cf4cf1640 1 --2- 172.21.15.132:0/1849847551 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cf00b5090 0x7f8cf00d2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.690+0000 7f8ceffff640 1 --2- 172.21.15.132:0/1849847551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cf0160450 0x7f8cf00d2ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.690+0000 7f8cf54f2640 1 -- 172.21.15.132:0/1849847551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cf0160450 msgr2=0x7f8cf00d2ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.690+0000 7f8cf54f2640 1 --2- 172.21.15.132:0/1849847551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cf0160450 0x7f8cf00d2ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.691+0000 7f8cf54f2640 1 -- 172.21.15.132:0/1849847551 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cf00b5090 msgr2=0x7f8cf00d2760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.691+0000 7f8cf54f2640 1 --2- 172.21.15.132:0/1849847551 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cf00b5090 0x7f8cf00d2760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.691+0000 7f8cf54f2640 1 -- 172.21.15.132:0/1849847551 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ce0009400 con 0x7f8cf01611b0 2023-12-20T04:45:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.691+0000 7f8ceffff640 1 --2- 172.21.15.132:0/1849847551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cf0160450 0x7f8cf00d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:45:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.691+0000 7f8cf54f2640 1 --2- 172.21.15.132:0/1849847551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cf01611b0 0x7f8cf01f1d50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c7d0 tx=0x7f8ce800cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.691+0000 7f8ced7fa640 1 -- 172.21.15.132:0/1849847551 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce8003b70 con 0x7f8cf01611b0 2023-12-20T04:45:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.691+0000 7f8ced7fa640 1 -- 172.21.15.132:0/1849847551 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ce8003cf0 con 0x7f8cf01611b0 2023-12-20T04:45:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.691+0000 7f8cf6f55640 1 -- 172.21.15.132:0/1849847551 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cf0145ba0 con 0x7f8cf01611b0 2023-12-20T04:45:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.691+0000 7f8ced7fa640 1 -- 172.21.15.132:0/1849847551 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ce800aa90 con 0x7f8cf01611b0 2023-12-20T04:45:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.691+0000 7f8cf6f55640 1 -- 172.21.15.132:0/1849847551 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cf0146160 con 0x7f8cf01611b0 2023-12-20T04:45:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.692+0000 7f8cf6f55640 1 -- 172.21.15.132:0/1849847551 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cf0146320 con 0x7f8cf01611b0 2023-12-20T04:45:12.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.692+0000 7f8ced7fa640 1 -- 172.21.15.132:0/1849847551 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8ce800abf0 con 0x7f8cf01611b0 2023-12-20T04:45:12.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.693+0000 7f8ced7fa640 1 --2- 172.21.15.132:0/1849847551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cdc06a430 0x7f8cdc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:12.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.693+0000 7f8ced7fa640 1 -- 172.21.15.132:0/1849847551 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8ce80887d0 con 0x7f8cf01611b0 2023-12-20T04:45:12.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.693+0000 7f8cf4cf1640 1 --2- 172.21.15.132:0/1849847551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cdc06a430 0x7f8cdc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:12.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.693+0000 7f8cf4cf1640 1 --2- 172.21.15.132:0/1849847551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cdc06a430 0x7f8cdc06c8f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0036000 tx=0x7f8ce0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:12.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.697+0000 7f8ced7fa640 1 -- 172.21.15.132:0/1849847551 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8ce8053d30 con 0x7f8cf01611b0 2023-12-20T04:45:12.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.859+0000 7f8cf6f55640 1 -- 172.21.15.132:0/1849847551 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f8cf00b89d0 con 0x7f8cdc06a430 2023-12-20T04:45:12.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.866+0000 7f8ced7fa640 1 -- 172.21.15.132:0/1849847551 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284952 (secure 0 0 0) 0x7f8ce002fbe0 con 0x7f8cdc06a430 2023-12-20T04:45:12.871 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:45:12.873 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:45:12.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.869+0000 7f8cf6f55640 1 -- 172.21.15.132:0/1849847551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cdc06a430 msgr2=0x7f8cdc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.869+0000 7f8cf6f55640 1 --2- 172.21.15.132:0/1849847551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cdc06a430 0x7f8cdc06c8f0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f8ce0036000 tx=0x7f8ce0008030 comp rx=0 tx=0).stop 2023-12-20T04:45:12.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.869+0000 7f8cf6f55640 1 -- 172.21.15.132:0/1849847551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cf01611b0 msgr2=0x7f8cf01f1d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:12.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.869+0000 7f8cf6f55640 1 --2- 172.21.15.132:0/1849847551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cf01611b0 0x7f8cf01f1d50 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f8ce800c7d0 tx=0x7f8ce800cc90 comp rx=0 tx=0).stop 2023-12-20T04:45:12.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.870+0000 7f8cf6f55640 1 -- 172.21.15.132:0/1849847551 shutdown_connections 2023-12-20T04:45:12.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.870+0000 7f8cf6f55640 1 --2- 172.21.15.132:0/1849847551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cdc06a430 0x7f8cdc06c8f0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.870+0000 7f8cf6f55640 1 --2- 172.21.15.132:0/1849847551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cf01611b0 0x7f8cf01f1d50 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.870+0000 7f8cf6f55640 1 --2- 172.21.15.132:0/1849847551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cf0160450 0x7f8cf00d2ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.870+0000 7f8cf6f55640 1 --2- 172.21.15.132:0/1849847551 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cf00b5090 0x7f8cf00d2760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:12.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.870+0000 7f8cf6f55640 1 -- 172.21.15.132:0/1849847551 >> 172.21.15.132:0/1849847551 conn(0x7f8cf00cf980 msgr2=0x7f8cf00d3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:12.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.870+0000 7f8cf6f55640 1 -- 172.21.15.132:0/1849847551 shutdown_connections 2023-12-20T04:45:12.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:12.870+0000 7f8cf6f55640 1 -- 172.21.15.132:0/1849847551 wait complete. 2023-12-20T04:45:12.882 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2023-12-20T04:45:12.122234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3759,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558740,"statfs":{"total":1600000000,"available":1596150044,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.533600"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.945396+0000","last_change":"2023-12-20T04:45:08.949561+0000","last_active":"2023-12-20T04:45:09.945396+0000","last_peered":"2023-12-20T04:45:09.945396+0000","last_clean":"2023-12-20T04:45:09.945396+0000","last_became_active":"2023-12-20T04:45:08.949332+0000","last_became_peered":"2023-12-20T04:45:08.949332+0000","last_unstale":"2023-12-20T04:45:09.945396+0000","last_undegraded":"2023-12-20T04:45:09.945396+0000","last_fullsized":"2023-12-20T04:45:09.945396+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:26:05.035224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085735+0000","last_change":"2023-12-20T04:45:08.958277+0000","last_active":"2023-12-20T04:45:10.085735+0000","last_peered":"2023-12-20T04:45:10.085735+0000","last_clean":"2023-12-20T04:45:10.085735+0000","last_became_active":"2023-12-20T04:45:08.957279+0000","last_became_peered":"2023-12-20T04:45:08.957279+0000","last_unstale":"2023-12-20T04:45:10.085735+0000","last_undegraded":"2023-12-20T04:45:10.085735+0000","last_fullsized":"2023-12-20T04:45:10.085735+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:32:42.019112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086043+0000","last_change":"2023-12-20T04:45:08.961873+0000","last_active":"2023-12-20T04:45:10.086043+0000","last_peered":"2023-12-20T04:45:10.086043+0000","last_clean":"2023-12-20T04:45:10.086043+0000","last_became_active":"2023-12-20T04:45:08.961328+0000","last_became_peered":"2023-12-20T04:45:08.961328+0000","last_unstale":"2023-12-20T04:45:10.086043+0000","last_undegraded":"2023-12-20T04:45:10.086043+0000","last_fullsized":"2023-12-20T04:45:10.086043+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:22:22.417135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085844+0000","last_change":"2023-12-20T04:45:08.954783+0000","last_active":"2023-12-20T04:45:10.085844+0000","last_peered":"2023-12-20T04:45:10.085844+0000","last_clean":"2023-12-20T04:45:10.085844+0000","last_became_active":"2023-12-20T04:45:08.954486+0000","last_became_peered":"2023-12-20T04:45:08.954486+0000","last_unstale":"2023-12-20T04:45:10.085844+0000","last_undegraded":"2023-12-20T04:45:10.085844+0000","last_fullsized":"2023-12-20T04:45:10.085844+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:27:37.318171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.945395+0000","last_change":"2023-12-20T04:45:08.951887+0000","last_active":"2023-12-20T04:45:09.945395+0000","last_peered":"2023-12-20T04:45:09.945395+0000","last_clean":"2023-12-20T04:45:09.945395+0000","last_became_active":"2023-12-20T04:45:08.951405+0000","last_became_peered":"2023-12-20T04:45:08.951405+0000","last_unstale":"2023-12-20T04:45:09.945395+0000","last_undegraded":"2023-12-20T04:45:09.945395+0000","last_fullsized":"2023-12-20T04:45:09.945395+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:52:11.934454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950444+0000","last_change":"2023-12-20T04:45:08.948975+0000","last_active":"2023-12-20T04:45:09.950444+0000","last_peered":"2023-12-20T04:45:09.950444+0000","last_clean":"2023-12-20T04:45:09.950444+0000","last_became_active":"2023-12-20T04:45:08.948431+0000","last_became_peered":"2023-12-20T04:45:08.948431+0000","last_unstale":"2023-12-20T04:45:09.950444+0000","last_undegraded":"2023-12-20T04:45:09.950444+0000","last_fullsized":"2023-12-20T04:45:09.950444+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:19:43.758722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950425+0000","last_change":"2023-12-20T04:45:08.950767+0000","last_active":"2023-12-20T04:45:09.950425+0000","last_peered":"2023-12-20T04:45:09.950425+0000","last_clean":"2023-12-20T04:45:09.950425+0000","last_became_active":"2023-12-20T04:45:08.949915+0000","last_became_peered":"2023-12-20T04:45:08.949915+0000","last_unstale":"2023-12-20T04:45:09.950425+0000","last_undegraded":"2023-12-20T04:45:09.950425+0000","last_fullsized":"2023-12-20T04:45:09.950425+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:27:37.318171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086067+0000","last_change":"2023-12-20T04:45:08.950956+0000","last_active":"2023-12-20T04:45:10.086067+0000","last_peered":"2023-12-20T04:45:10.086067+0000","last_clean":"2023-12-20T04:45:10.086067+0000","last_became_active":"2023-12-20T04:45:08.950506+0000","last_became_peered":"2023-12-20T04:45:08.950506+0000","last_unstale":"2023-12-20T04:45:10.086067+0000","last_undegraded":"2023-12-20T04:45:10.086067+0000","last_fullsized":"2023-12-20T04:45:10.086067+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:10:49.409127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950346+0000","last_change":"2023-12-20T04:45:08.952072+0000","last_active":"2023-12-20T04:45:09.950346+0000","last_peered":"2023-12-20T04:45:09.950346+0000","last_clean":"2023-12-20T04:45:09.950346+0000","last_became_active":"2023-12-20T04:45:08.951759+0000","last_became_peered":"2023-12-20T04:45:08.951759+0000","last_unstale":"2023-12-20T04:45:09.950346+0000","last_undegraded":"2023-12-20T04:45:09.950346+0000","last_fullsized":"2023-12-20T04:45:09.950346+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:47:54.809615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085833+0000","last_change":"2023-12-20T04:45:08.955881+0000","last_active":"2023-12-20T04:45:10.085833+0000","last_peered":"2023-12-20T04:45:10.085833+0000","last_clean":"2023-12-20T04:45:10.085833+0000","last_became_active":"2023-12-20T04:45:08.955679+0000","last_became_peered":"2023-12-20T04:45:08.955679+0000","last_unstale":"2023-12-20T04:45:10.085833+0000","last_undegraded":"2023-12-20T04:45:10.085833+0000","last_fullsized":"2023-12-20T04:45:10.085833+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:47:38.945963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086199+0000","last_change":"2023-12-20T04:45:08.953887+0000","last_active":"2023-12-20T04:45:10.086199+0000","last_peered":"2023-12-20T04:45:10.086199+0000","last_clean":"2023-12-20T04:45:10.086199+0000","last_became_active":"2023-12-20T04:45:08.952888+0000","last_became_peered":"2023-12-20T04:45:08.952888+0000","last_unstale":"2023-12-20T04:45:10.086199+0000","last_undegraded":"2023-12-20T04:45:10.086199+0000","last_fullsized":"2023-12-20T04:45:10.086199+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:38:00.630473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086331+0000","last_change":"2023-12-20T04:45:08.958507+0000","last_active":"2023-12-20T04:45:10.086331+0000","last_peered":"2023-12-20T04:45:10.086331+0000","last_clean":"2023-12-20T04:45:10.086331+0000","last_became_active":"2023-12-20T04:45:08.958155+0000","last_became_peered":"2023-12-20T04:45:08.958155+0000","last_unstale":"2023-12-20T04:45:10.086331+0000","last_undegraded":"2023-12-20T04:45:10.086331+0000","last_fullsized":"2023-12-20T04:45:10.086331+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:38:45.340767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086705+0000","last_change":"2023-12-20T04:45:08.956399+0000","last_active":"2023-12-20T04:45:10.086705+0000","last_peered":"2023-12-20T04:45:10.086705+0000","last_clean":"2023-12-20T04:45:10.086705+0000","last_became_active":"2023-12-20T04:45:08.956067+0000","last_became_peered":"2023-12-20T04:45:08.956067+0000","last_unstale":"2023-12-20T04:45:10.086705+0000","last_undegraded":"2023-12-20T04:45:10.086705+0000","last_fullsized":"2023-12-20T04:45:10.086705+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:59:55.016890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950459+0000","last_change":"2023-12-20T04:45:08.949663+0000","last_active":"2023-12-20T04:45:09.950459+0000","last_peered":"2023-12-20T04:45:09.950459+0000","last_clean":"2023-12-20T04:45:09.950459+0000","last_became_active":"2023-12-20T04:45:08.949450+0000","last_became_peered":"2023-12-20T04:45:08.949450+0000","last_unstale":"2023-12-20T04:45:09.950459+0000","last_undegraded":"2023-12-20T04:45:09.950459+0000","last_fullsized":"2023-12-20T04:45:09.950459+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:10:43.052927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950613+0000","last_change":"2023-12-20T04:45:08.951239+0000","last_active":"2023-12-20T04:45:09.950613+0000","last_peered":"2023-12-20T04:45:09.950613+0000","last_clean":"2023-12-20T04:45:09.950613+0000","last_became_active":"2023-12-20T04:45:08.950895+0000","last_became_peered":"2023-12-20T04:45:08.950895+0000","last_unstale":"2023-12-20T04:45:09.950613+0000","last_undegraded":"2023-12-20T04:45:09.950613+0000","last_fullsized":"2023-12-20T04:45:09.950613+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:37:46.400818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950584+0000","last_change":"2023-12-20T04:45:08.953275+0000","last_active":"2023-12-20T04:45:09.950584+0000","last_peered":"2023-12-20T04:45:09.950584+0000","last_clean":"2023-12-20T04:45:09.950584+0000","last_became_active":"2023-12-20T04:45:08.953056+0000","last_became_peered":"2023-12-20T04:45:08.953056+0000","last_unstale":"2023-12-20T04:45:09.950584+0000","last_undegraded":"2023-12-20T04:45:09.950584+0000","last_fullsized":"2023-12-20T04:45:09.950584+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:36:14.478464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085822+0000","last_change":"2023-12-20T04:45:08.956679+0000","last_active":"2023-12-20T04:45:10.085822+0000","last_peered":"2023-12-20T04:45:10.085822+0000","last_clean":"2023-12-20T04:45:10.085822+0000","last_became_active":"2023-12-20T04:45:08.955165+0000","last_became_peered":"2023-12-20T04:45:08.955165+0000","last_unstale":"2023-12-20T04:45:10.085822+0000","last_undegraded":"2023-12-20T04:45:10.085822+0000","last_fullsized":"2023-12-20T04:45:10.085822+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:41:43.919950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086154+0000","last_change":"2023-12-20T04:45:08.960107+0000","last_active":"2023-12-20T04:45:10.086154+0000","last_peered":"2023-12-20T04:45:10.086154+0000","last_clean":"2023-12-20T04:45:10.086154+0000","last_became_active":"2023-12-20T04:45:08.959559+0000","last_became_peered":"2023-12-20T04:45:08.959559+0000","last_unstale":"2023-12-20T04:45:10.086154+0000","last_undegraded":"2023-12-20T04:45:10.086154+0000","last_fullsized":"2023-12-20T04:45:10.086154+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:40:39.035859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.945399+0000","last_change":"2023-12-20T04:45:08.951801+0000","last_active":"2023-12-20T04:45:09.945399+0000","last_peered":"2023-12-20T04:45:09.945399+0000","last_clean":"2023-12-20T04:45:09.945399+0000","last_became_active":"2023-12-20T04:45:08.951591+0000","last_became_peered":"2023-12-20T04:45:08.951591+0000","last_unstale":"2023-12-20T04:45:09.945399+0000","last_undegraded":"2023-12-20T04:45:09.945399+0000","last_fullsized":"2023-12-20T04:45:09.945399+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:56:57.356485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085791+0000","last_change":"2023-12-20T04:45:08.953497+0000","last_active":"2023-12-20T04:45:10.085791+0000","last_peered":"2023-12-20T04:45:10.085791+0000","last_clean":"2023-12-20T04:45:10.085791+0000","last_became_active":"2023-12-20T04:45:08.953277+0000","last_became_peered":"2023-12-20T04:45:08.953277+0000","last_unstale":"2023-12-20T04:45:10.085791+0000","last_undegraded":"2023-12-20T04:45:10.085791+0000","last_fullsized":"2023-12-20T04:45:10.085791+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:03:27.221488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086076+0000","last_change":"2023-12-20T04:45:08.960974+0000","last_active":"2023-12-20T04:45:10.086076+0000","last_peered":"2023-12-20T04:45:10.086076+0000","last_clean":"2023-12-20T04:45:10.086076+0000","last_became_active":"2023-12-20T04:45:08.960379+0000","last_became_peered":"2023-12-20T04:45:08.960379+0000","last_unstale":"2023-12-20T04:45:10.086076+0000","last_undegraded":"2023-12-20T04:45:10.086076+0000","last_fullsized":"2023-12-20T04:45:10.086076+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:36:14.478464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085906+0000","last_change":"2023-12-20T04:45:08.956353+0000","last_active":"2023-12-20T04:45:10.085906+0000","last_peered":"2023-12-20T04:45:10.085906+0000","last_clean":"2023-12-20T04:45:10.085906+0000","last_became_active":"2023-12-20T04:45:08.954858+0000","last_became_peered":"2023-12-20T04:45:08.954858+0000","last_unstale":"2023-12-20T04:45:10.085906+0000","last_undegraded":"2023-12-20T04:45:10.085906+0000","last_fullsized":"2023-12-20T04:45:10.085906+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:07:48.603965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086260+0000","last_change":"2023-12-20T04:45:08.958131+0000","last_active":"2023-12-20T04:45:10.086260+0000","last_peered":"2023-12-20T04:45:10.086260+0000","last_clean":"2023-12-20T04:45:10.086260+0000","last_became_active":"2023-12-20T04:45:08.957904+0000","last_became_peered":"2023-12-20T04:45:08.957904+0000","last_unstale":"2023-12-20T04:45:10.086260+0000","last_undegraded":"2023-12-20T04:45:10.086260+0000","last_fullsized":"2023-12-20T04:45:10.086260+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:25:41.248153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086915+0000","last_change":"2023-12-20T04:45:08.955453+0000","last_active":"2023-12-20T04:45:10.086915+0000","last_peered":"2023-12-20T04:45:10.086915+0000","last_clean":"2023-12-20T04:45:10.086915+0000","last_became_active":"2023-12-20T04:45:08.955189+0000","last_became_peered":"2023-12-20T04:45:08.955189+0000","last_unstale":"2023-12-20T04:45:10.086915+0000","last_undegraded":"2023-12-20T04:45:10.086915+0000","last_fullsized":"2023-12-20T04:45:10.086915+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:43:08.979669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.945480+0000","last_change":"2023-12-20T04:45:08.952020+0000","last_active":"2023-12-20T04:45:09.945480+0000","last_peered":"2023-12-20T04:45:09.945480+0000","last_clean":"2023-12-20T04:45:09.945480+0000","last_became_active":"2023-12-20T04:45:08.951687+0000","last_became_peered":"2023-12-20T04:45:08.951687+0000","last_unstale":"2023-12-20T04:45:09.945480+0000","last_undegraded":"2023-12-20T04:45:09.945480+0000","last_fullsized":"2023-12-20T04:45:09.945480+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:07:57.904496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086500+0000","last_change":"2023-12-20T04:45:08.949730+0000","last_active":"2023-12-20T04:45:10.086500+0000","last_peered":"2023-12-20T04:45:10.086500+0000","last_clean":"2023-12-20T04:45:10.086500+0000","last_became_active":"2023-12-20T04:45:08.949489+0000","last_became_peered":"2023-12-20T04:45:08.949489+0000","last_unstale":"2023-12-20T04:45:10.086500+0000","last_undegraded":"2023-12-20T04:45:10.086500+0000","last_fullsized":"2023-12-20T04:45:10.086500+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:25:41.248153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950445+0000","last_change":"2023-12-20T04:45:08.954528+0000","last_active":"2023-12-20T04:45:09.950445+0000","last_peered":"2023-12-20T04:45:09.950445+0000","last_clean":"2023-12-20T04:45:09.950445+0000","last_became_active":"2023-12-20T04:45:08.954277+0000","last_became_peered":"2023-12-20T04:45:08.954277+0000","last_unstale":"2023-12-20T04:45:09.950445+0000","last_undegraded":"2023-12-20T04:45:09.950445+0000","last_fullsized":"2023-12-20T04:45:09.950445+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:56.613612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.945453+0000","last_change":"2023-12-20T04:45:08.951070+0000","last_active":"2023-12-20T04:45:09.945453+0000","last_peered":"2023-12-20T04:45:09.945453+0000","last_clean":"2023-12-20T04:45:09.945453+0000","last_became_active":"2023-12-20T04:45:08.950397+0000","last_became_peered":"2023-12-20T04:45:08.950397+0000","last_unstale":"2023-12-20T04:45:09.945453+0000","last_undegraded":"2023-12-20T04:45:09.945453+0000","last_fullsized":"2023-12-20T04:45:09.945453+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:08:12.695461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085641+0000","last_change":"2023-12-20T04:45:08.952327+0000","last_active":"2023-12-20T04:45:10.085641+0000","last_peered":"2023-12-20T04:45:10.085641+0000","last_clean":"2023-12-20T04:45:10.085641+0000","last_became_active":"2023-12-20T04:45:08.951961+0000","last_became_peered":"2023-12-20T04:45:08.951961+0000","last_unstale":"2023-12-20T04:45:10.085641+0000","last_undegraded":"2023-12-20T04:45:10.085641+0000","last_fullsized":"2023-12-20T04:45:10.085641+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:47:00.489617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086150+0000","last_change":"2023-12-20T04:45:08.959584+0000","last_active":"2023-12-20T04:45:10.086150+0000","last_peered":"2023-12-20T04:45:10.086150+0000","last_clean":"2023-12-20T04:45:10.086150+0000","last_became_active":"2023-12-20T04:45:08.959125+0000","last_became_peered":"2023-12-20T04:45:08.959125+0000","last_unstale":"2023-12-20T04:45:10.086150+0000","last_undegraded":"2023-12-20T04:45:10.086150+0000","last_fullsized":"2023-12-20T04:45:10.086150+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:38:45.340767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.945497+0000","last_change":"2023-12-20T04:45:08.955105+0000","last_active":"2023-12-20T04:45:09.945497+0000","last_peered":"2023-12-20T04:45:09.945497+0000","last_clean":"2023-12-20T04:45:09.945497+0000","last_became_active":"2023-12-20T04:45:08.954890+0000","last_became_peered":"2023-12-20T04:45:08.954890+0000","last_unstale":"2023-12-20T04:45:09.945497+0000","last_undegraded":"2023-12-20T04:45:09.945497+0000","last_fullsized":"2023-12-20T04:45:09.945497+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:34:00.916344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950534+0000","last_change":"2023-12-20T04:45:08.955764+0000","last_active":"2023-12-20T04:45:09.950534+0000","last_peered":"2023-12-20T04:45:09.950534+0000","last_clean":"2023-12-20T04:45:09.950534+0000","last_became_active":"2023-12-20T04:45:08.955478+0000","last_became_peered":"2023-12-20T04:45:08.955478+0000","last_unstale":"2023-12-20T04:45:09.950534+0000","last_undegraded":"2023-12-20T04:45:09.950534+0000","last_fullsized":"2023-12-20T04:45:09.950534+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:26:37.368468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950470+0000","last_change":"2023-12-20T04:45:08.956949+0000","last_active":"2023-12-20T04:45:09.950470+0000","last_peered":"2023-12-20T04:45:09.950470+0000","last_clean":"2023-12-20T04:45:09.950470+0000","last_became_active":"2023-12-20T04:45:08.956743+0000","last_became_peered":"2023-12-20T04:45:08.956743+0000","last_unstale":"2023-12-20T04:45:09.950470+0000","last_undegraded":"2023-12-20T04:45:09.950470+0000","last_fullsized":"2023-12-20T04:45:09.950470+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:49:38.193749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"64'4","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950544+0000","last_change":"2023-12-20T04:45:08.598268+0000","last_active":"2023-12-20T04:45:09.950544+0000","last_peered":"2023-12-20T04:45:09.950544+0000","last_clean":"2023-12-20T04:45:09.950544+0000","last_became_active":"2023-12-20T04:45:08.597589+0000","last_became_peered":"2023-12-20T04:45:08.597589+0000","last_unstale":"2023-12-20T04:45:09.950544+0000","last_undegraded":"2023-12-20T04:45:09.950544+0000","last_fullsized":"2023-12-20T04:45:09.950544+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:03:21.542554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085758+0000","last_change":"2023-12-20T04:45:08.958522+0000","last_active":"2023-12-20T04:45:10.085758+0000","last_peered":"2023-12-20T04:45:10.085758+0000","last_clean":"2023-12-20T04:45:10.085758+0000","last_became_active":"2023-12-20T04:45:08.958271+0000","last_became_peered":"2023-12-20T04:45:08.958271+0000","last_unstale":"2023-12-20T04:45:10.085758+0000","last_undegraded":"2023-12-20T04:45:10.085758+0000","last_fullsized":"2023-12-20T04:45:10.085758+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:25:41.248153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"64'1","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085794+0000","last_change":"2023-12-20T04:45:08.606384+0000","last_active":"2023-12-20T04:45:10.085794+0000","last_peered":"2023-12-20T04:45:10.085794+0000","last_clean":"2023-12-20T04:45:10.085794+0000","last_became_active":"2023-12-20T04:45:08.605666+0000","last_became_peered":"2023-12-20T04:45:08.605666+0000","last_unstale":"2023-12-20T04:45:10.085794+0000","last_undegraded":"2023-12-20T04:45:10.085794+0000","last_fullsized":"2023-12-20T04:45:10.085794+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:22:21.413222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950670+0000","last_change":"2023-12-20T04:45:08.946328+0000","last_active":"2023-12-20T04:45:09.950670+0000","last_peered":"2023-12-20T04:45:09.950670+0000","last_clean":"2023-12-20T04:45:09.950670+0000","last_became_active":"2023-12-20T04:45:08.946126+0000","last_became_peered":"2023-12-20T04:45:08.946126+0000","last_unstale":"2023-12-20T04:45:09.950670+0000","last_undegraded":"2023-12-20T04:45:09.950670+0000","last_fullsized":"2023-12-20T04:45:09.950670+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:30:04.146950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950649+0000","last_change":"2023-12-20T04:45:08.598116+0000","last_active":"2023-12-20T04:45:09.950649+0000","last_peered":"2023-12-20T04:45:09.950649+0000","last_clean":"2023-12-20T04:45:09.950649+0000","last_became_active":"2023-12-20T04:45:08.597711+0000","last_became_peered":"2023-12-20T04:45:08.597711+0000","last_unstale":"2023-12-20T04:45:09.950649+0000","last_undegraded":"2023-12-20T04:45:09.950649+0000","last_fullsized":"2023-12-20T04:45:09.950649+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:26:10.858573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950470+0000","last_change":"2023-12-20T04:45:08.953040+0000","last_active":"2023-12-20T04:45:09.950470+0000","last_peered":"2023-12-20T04:45:09.950470+0000","last_clean":"2023-12-20T04:45:09.950470+0000","last_became_active":"2023-12-20T04:45:08.952835+0000","last_became_peered":"2023-12-20T04:45:08.952835+0000","last_unstale":"2023-12-20T04:45:09.950470+0000","last_undegraded":"2023-12-20T04:45:09.950470+0000","last_fullsized":"2023-12-20T04:45:09.950470+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:09:36.814759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086751+0000","last_change":"2023-12-20T04:45:08.605938+0000","last_active":"2023-12-20T04:45:10.086751+0000","last_peered":"2023-12-20T04:45:10.086751+0000","last_clean":"2023-12-20T04:45:10.086751+0000","last_became_active":"2023-12-20T04:45:08.605375+0000","last_became_peered":"2023-12-20T04:45:08.605375+0000","last_unstale":"2023-12-20T04:45:10.086751+0000","last_undegraded":"2023-12-20T04:45:10.086751+0000","last_fullsized":"2023-12-20T04:45:10.086751+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:43:07.975757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086274+0000","last_change":"2023-12-20T04:45:08.954292+0000","last_active":"2023-12-20T04:45:10.086274+0000","last_peered":"2023-12-20T04:45:10.086274+0000","last_clean":"2023-12-20T04:45:10.086274+0000","last_became_active":"2023-12-20T04:45:08.954053+0000","last_became_peered":"2023-12-20T04:45:08.954053+0000","last_unstale":"2023-12-20T04:45:10.086274+0000","last_undegraded":"2023-12-20T04:45:10.086274+0000","last_fullsized":"2023-12-20T04:45:10.086274+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:13:25.005512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"64'1","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950691+0000","last_change":"2023-12-20T04:45:08.605720+0000","last_active":"2023-12-20T04:45:09.950691+0000","last_peered":"2023-12-20T04:45:09.950691+0000","last_clean":"2023-12-20T04:45:09.950691+0000","last_became_active":"2023-12-20T04:45:08.604763+0000","last_became_peered":"2023-12-20T04:45:08.604763+0000","last_unstale":"2023-12-20T04:45:09.950691+0000","last_undegraded":"2023-12-20T04:45:09.950691+0000","last_fullsized":"2023-12-20T04:45:09.950691+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:07:23.276222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085986+0000","last_change":"2023-12-20T04:45:08.955801+0000","last_active":"2023-12-20T04:45:10.085986+0000","last_peered":"2023-12-20T04:45:10.085986+0000","last_clean":"2023-12-20T04:45:10.085986+0000","last_became_active":"2023-12-20T04:45:08.954581+0000","last_became_peered":"2023-12-20T04:45:08.954581+0000","last_unstale":"2023-12-20T04:45:10.085986+0000","last_undegraded":"2023-12-20T04:45:10.085986+0000","last_fullsized":"2023-12-20T04:45:10.085986+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:06:27.829962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"64'1","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950629+0000","last_change":"2023-12-20T04:45:08.601706+0000","last_active":"2023-12-20T04:45:09.950629+0000","last_peered":"2023-12-20T04:45:09.950629+0000","last_clean":"2023-12-20T04:45:09.950629+0000","last_became_active":"2023-12-20T04:45:08.600376+0000","last_became_peered":"2023-12-20T04:45:08.600376+0000","last_unstale":"2023-12-20T04:45:09.950629+0000","last_undegraded":"2023-12-20T04:45:09.950629+0000","last_fullsized":"2023-12-20T04:45:09.950629+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:47:37.942050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086951+0000","last_change":"2023-12-20T04:45:08.958829+0000","last_active":"2023-12-20T04:45:10.086951+0000","last_peered":"2023-12-20T04:45:10.086951+0000","last_clean":"2023-12-20T04:45:10.086951+0000","last_became_active":"2023-12-20T04:45:08.958528+0000","last_became_peered":"2023-12-20T04:45:08.958528+0000","last_unstale":"2023-12-20T04:45:10.086951+0000","last_undegraded":"2023-12-20T04:45:10.086951+0000","last_fullsized":"2023-12-20T04:45:10.086951+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:58:46.618096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086880+0000","last_change":"2023-12-20T04:45:08.602633+0000","last_active":"2023-12-20T04:45:10.086880+0000","last_peered":"2023-12-20T04:45:10.086880+0000","last_clean":"2023-12-20T04:45:10.086880+0000","last_became_active":"2023-12-20T04:45:08.602385+0000","last_became_peered":"2023-12-20T04:45:08.602385+0000","last_unstale":"2023-12-20T04:45:10.086880+0000","last_undegraded":"2023-12-20T04:45:10.086880+0000","last_fullsized":"2023-12-20T04:45:10.086880+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:23:16.833856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085722+0000","last_change":"2023-12-20T04:45:08.955332+0000","last_active":"2023-12-20T04:45:10.085722+0000","last_peered":"2023-12-20T04:45:10.085722+0000","last_clean":"2023-12-20T04:45:10.085722+0000","last_became_active":"2023-12-20T04:45:08.955122+0000","last_became_peered":"2023-12-20T04:45:08.955122+0000","last_unstale":"2023-12-20T04:45:10.085722+0000","last_undegraded":"2023-12-20T04:45:10.085722+0000","last_fullsized":"2023-12-20T04:45:10.085722+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:45:14.944677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950746+0000","last_change":"2023-12-20T04:45:08.607180+0000","last_active":"2023-12-20T04:45:09.950746+0000","last_peered":"2023-12-20T04:45:09.950746+0000","last_clean":"2023-12-20T04:45:09.950746+0000","last_became_active":"2023-12-20T04:45:08.606947+0000","last_became_peered":"2023-12-20T04:45:08.606947+0000","last_unstale":"2023-12-20T04:45:09.950746+0000","last_undegraded":"2023-12-20T04:45:09.950746+0000","last_fullsized":"2023-12-20T04:45:09.950746+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:47:36.773729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950604+0000","last_change":"2023-12-20T04:45:08.950477+0000","last_active":"2023-12-20T04:45:09.950604+0000","last_peered":"2023-12-20T04:45:09.950604+0000","last_clean":"2023-12-20T04:45:09.950604+0000","last_became_active":"2023-12-20T04:45:08.949412+0000","last_became_peered":"2023-12-20T04:45:08.949412+0000","last_unstale":"2023-12-20T04:45:09.950604+0000","last_undegraded":"2023-12-20T04:45:09.950604+0000","last_fullsized":"2023-12-20T04:45:09.950604+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:36:06.687639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086656+0000","last_change":"2023-12-20T04:45:08.607996+0000","last_active":"2023-12-20T04:45:10.086656+0000","last_peered":"2023-12-20T04:45:10.086656+0000","last_clean":"2023-12-20T04:45:10.086656+0000","last_became_active":"2023-12-20T04:45:08.607516+0000","last_became_peered":"2023-12-20T04:45:08.607516+0000","last_unstale":"2023-12-20T04:45:10.086656+0000","last_undegraded":"2023-12-20T04:45:10.086656+0000","last_fullsized":"2023-12-20T04:45:10.086656+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:22:06.759303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086177+0000","last_change":"2023-12-20T04:45:08.961795+0000","last_active":"2023-12-20T04:45:10.086177+0000","last_peered":"2023-12-20T04:45:10.086177+0000","last_clean":"2023-12-20T04:45:10.086177+0000","last_became_active":"2023-12-20T04:45:08.961208+0000","last_became_peered":"2023-12-20T04:45:08.961208+0000","last_unstale":"2023-12-20T04:45:10.086177+0000","last_undegraded":"2023-12-20T04:45:10.086177+0000","last_fullsized":"2023-12-20T04:45:10.086177+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:19:43.758722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086385+0000","last_change":"2023-12-20T04:45:08.603602+0000","last_active":"2023-12-20T04:45:10.086385+0000","last_peered":"2023-12-20T04:45:10.086385+0000","last_clean":"2023-12-20T04:45:10.086385+0000","last_became_active":"2023-12-20T04:45:08.601446+0000","last_became_peered":"2023-12-20T04:45:08.601446+0000","last_unstale":"2023-12-20T04:45:10.086385+0000","last_undegraded":"2023-12-20T04:45:10.086385+0000","last_fullsized":"2023-12-20T04:45:10.086385+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:27:36.314259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085699+0000","last_change":"2023-12-20T04:45:08.948767+0000","last_active":"2023-12-20T04:45:10.085699+0000","last_peered":"2023-12-20T04:45:10.085699+0000","last_clean":"2023-12-20T04:45:10.085699+0000","last_became_active":"2023-12-20T04:45:08.948547+0000","last_became_peered":"2023-12-20T04:45:08.948547+0000","last_unstale":"2023-12-20T04:45:10.085699+0000","last_undegraded":"2023-12-20T04:45:10.085699+0000","last_fullsized":"2023-12-20T04:45:10.085699+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:47:54.809615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"64'3","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086459+0000","last_change":"2023-12-20T04:45:08.605661+0000","last_active":"2023-12-20T04:45:10.086459+0000","last_peered":"2023-12-20T04:45:10.086459+0000","last_clean":"2023-12-20T04:45:10.086459+0000","last_became_active":"2023-12-20T04:45:08.605443+0000","last_became_peered":"2023-12-20T04:45:08.605443+0000","last_unstale":"2023-12-20T04:45:10.086459+0000","last_undegraded":"2023-12-20T04:45:10.086459+0000","last_fullsized":"2023-12-20T04:45:10.086459+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:07:23.276222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086361+0000","last_change":"2023-12-20T04:45:08.959818+0000","last_active":"2023-12-20T04:45:10.086361+0000","last_peered":"2023-12-20T04:45:10.086361+0000","last_clean":"2023-12-20T04:45:10.086361+0000","last_became_active":"2023-12-20T04:45:08.959052+0000","last_became_peered":"2023-12-20T04:45:08.959052+0000","last_unstale":"2023-12-20T04:45:10.086361+0000","last_undegraded":"2023-12-20T04:45:10.086361+0000","last_fullsized":"2023-12-20T04:45:10.086361+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:32:23.738520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"64'6","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950636+0000","last_change":"2023-12-20T04:45:08.605526+0000","last_active":"2023-12-20T04:45:09.950636+0000","last_peered":"2023-12-20T04:45:09.950636+0000","last_clean":"2023-12-20T04:45:09.950636+0000","last_became_active":"2023-12-20T04:45:08.605118+0000","last_became_peered":"2023-12-20T04:45:08.605118+0000","last_unstale":"2023-12-20T04:45:09.950636+0000","last_undegraded":"2023-12-20T04:45:09.950636+0000","last_fullsized":"2023-12-20T04:45:09.950636+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:23:16.833856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086592+0000","last_change":"2023-12-20T04:45:08.955311+0000","last_active":"2023-12-20T04:45:10.086592+0000","last_peered":"2023-12-20T04:45:10.086592+0000","last_clean":"2023-12-20T04:45:10.086592+0000","last_became_active":"2023-12-20T04:45:08.954873+0000","last_became_peered":"2023-12-20T04:45:08.954873+0000","last_unstale":"2023-12-20T04:45:10.086592+0000","last_undegraded":"2023-12-20T04:45:10.086592+0000","last_fullsized":"2023-12-20T04:45:10.086592+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:24:46.645891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085877+0000","last_change":"2023-12-20T04:45:08.600304+0000","last_active":"2023-12-20T04:45:10.085877+0000","last_peered":"2023-12-20T04:45:10.085877+0000","last_clean":"2023-12-20T04:45:10.085877+0000","last_became_active":"2023-12-20T04:45:08.600087+0000","last_became_peered":"2023-12-20T04:45:08.600087+0000","last_unstale":"2023-12-20T04:45:10.085877+0000","last_undegraded":"2023-12-20T04:45:10.085877+0000","last_fullsized":"2023-12-20T04:45:10.085877+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:37:45.396905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086338+0000","last_change":"2023-12-20T04:45:08.961256+0000","last_active":"2023-12-20T04:45:10.086338+0000","last_peered":"2023-12-20T04:45:10.086338+0000","last_clean":"2023-12-20T04:45:10.086338+0000","last_became_active":"2023-12-20T04:45:08.961022+0000","last_became_peered":"2023-12-20T04:45:08.961022+0000","last_unstale":"2023-12-20T04:45:10.086338+0000","last_undegraded":"2023-12-20T04:45:10.086338+0000","last_fullsized":"2023-12-20T04:45:10.086338+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:38:00.630473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086624+0000","last_change":"2023-12-20T04:45:08.603757+0000","last_active":"2023-12-20T04:45:10.086624+0000","last_peered":"2023-12-20T04:45:10.086624+0000","last_clean":"2023-12-20T04:45:10.086624+0000","last_became_active":"2023-12-20T04:45:08.603517+0000","last_became_peered":"2023-12-20T04:45:08.603517+0000","last_unstale":"2023-12-20T04:45:10.086624+0000","last_undegraded":"2023-12-20T04:45:10.086624+0000","last_fullsized":"2023-12-20T04:45:10.086624+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:22:18.111612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950426+0000","last_change":"2023-12-20T04:45:08.961275+0000","last_active":"2023-12-20T04:45:09.950426+0000","last_peered":"2023-12-20T04:45:09.950426+0000","last_clean":"2023-12-20T04:45:09.950426+0000","last_became_active":"2023-12-20T04:45:08.961058+0000","last_became_peered":"2023-12-20T04:45:08.961058+0000","last_unstale":"2023-12-20T04:45:09.950426+0000","last_undegraded":"2023-12-20T04:45:09.950426+0000","last_fullsized":"2023-12-20T04:45:09.950426+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:25:41.248153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086914+0000","last_change":"2023-12-20T04:45:08.603058+0000","last_active":"2023-12-20T04:45:10.086914+0000","last_peered":"2023-12-20T04:45:10.086914+0000","last_clean":"2023-12-20T04:45:10.086914+0000","last_became_active":"2023-12-20T04:45:08.602774+0000","last_became_peered":"2023-12-20T04:45:08.602774+0000","last_unstale":"2023-12-20T04:45:10.086914+0000","last_undegraded":"2023-12-20T04:45:10.086914+0000","last_fullsized":"2023-12-20T04:45:10.086914+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:44:59.705016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086093+0000","last_change":"2023-12-20T04:45:08.960772+0000","last_active":"2023-12-20T04:45:10.086093+0000","last_peered":"2023-12-20T04:45:10.086093+0000","last_clean":"2023-12-20T04:45:10.086093+0000","last_became_active":"2023-12-20T04:45:08.960517+0000","last_became_peered":"2023-12-20T04:45:08.960517+0000","last_unstale":"2023-12-20T04:45:10.086093+0000","last_undegraded":"2023-12-20T04:45:10.086093+0000","last_fullsized":"2023-12-20T04:45:10.086093+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:10:43.052927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"64'8","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086554+0000","last_change":"2023-12-20T04:45:08.606700+0000","last_active":"2023-12-20T04:45:10.086554+0000","last_peered":"2023-12-20T04:45:10.086554+0000","last_clean":"2023-12-20T04:45:10.086554+0000","last_became_active":"2023-12-20T04:45:08.606449+0000","last_became_peered":"2023-12-20T04:45:08.606449+0000","last_unstale":"2023-12-20T04:45:10.086554+0000","last_undegraded":"2023-12-20T04:45:10.086554+0000","last_fullsized":"2023-12-20T04:45:10.086554+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:23:16.833856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086436+0000","last_change":"2023-12-20T04:45:08.960382+0000","last_active":"2023-12-20T04:45:10.086436+0000","last_peered":"2023-12-20T04:45:10.086436+0000","last_clean":"2023-12-20T04:45:10.086436+0000","last_became_active":"2023-12-20T04:45:08.960137+0000","last_became_peered":"2023-12-20T04:45:08.960137+0000","last_unstale":"2023-12-20T04:45:10.086436+0000","last_undegraded":"2023-12-20T04:45:10.086436+0000","last_fullsized":"2023-12-20T04:45:10.086436+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:30:04.146950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"64'1","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085942+0000","last_change":"2023-12-20T04:45:08.606260+0000","last_active":"2023-12-20T04:45:10.085942+0000","last_peered":"2023-12-20T04:45:10.085942+0000","last_clean":"2023-12-20T04:45:10.085942+0000","last_became_active":"2023-12-20T04:45:08.605358+0000","last_became_peered":"2023-12-20T04:45:08.605358+0000","last_unstale":"2023-12-20T04:45:10.085942+0000","last_undegraded":"2023-12-20T04:45:10.085942+0000","last_fullsized":"2023-12-20T04:45:10.085942+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:36:05.683727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086502+0000","last_change":"2023-12-20T04:45:08.953524+0000","last_active":"2023-12-20T04:45:10.086502+0000","last_peered":"2023-12-20T04:45:10.086502+0000","last_clean":"2023-12-20T04:45:10.086502+0000","last_became_active":"2023-12-20T04:45:08.953194+0000","last_became_peered":"2023-12-20T04:45:08.953194+0000","last_unstale":"2023-12-20T04:45:10.086502+0000","last_undegraded":"2023-12-20T04:45:10.086502+0000","last_fullsized":"2023-12-20T04:45:10.086502+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:40:39.035859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950701+0000","last_change":"2023-12-20T04:45:08.599091+0000","last_active":"2023-12-20T04:45:09.950701+0000","last_peered":"2023-12-20T04:45:09.950701+0000","last_clean":"2023-12-20T04:45:09.950701+0000","last_became_active":"2023-12-20T04:45:08.598869+0000","last_became_peered":"2023-12-20T04:45:08.598869+0000","last_unstale":"2023-12-20T04:45:09.950701+0000","last_undegraded":"2023-12-20T04:45:09.950701+0000","last_fullsized":"2023-12-20T04:45:09.950701+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:40:50.459725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086072+0000","last_change":"2023-12-20T04:45:08.959720+0000","last_active":"2023-12-20T04:45:10.086072+0000","last_peered":"2023-12-20T04:45:10.086072+0000","last_clean":"2023-12-20T04:45:10.086072+0000","last_became_active":"2023-12-20T04:45:08.958074+0000","last_became_peered":"2023-12-20T04:45:08.958074+0000","last_unstale":"2023-12-20T04:45:10.086072+0000","last_undegraded":"2023-12-20T04:45:10.086072+0000","last_fullsized":"2023-12-20T04:45:10.086072+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:03:41.608824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"64'1","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086848+0000","last_change":"2023-12-20T04:45:08.605612+0000","last_active":"2023-12-20T04:45:10.086848+0000","last_peered":"2023-12-20T04:45:10.086848+0000","last_clean":"2023-12-20T04:45:10.086848+0000","last_became_active":"2023-12-20T04:45:08.604526+0000","last_became_peered":"2023-12-20T04:45:08.604526+0000","last_unstale":"2023-12-20T04:45:10.086848+0000","last_undegraded":"2023-12-20T04:45:10.086848+0000","last_fullsized":"2023-12-20T04:45:10.086848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:22:06.759303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086282+0000","last_change":"2023-12-20T04:45:08.961932+0000","last_active":"2023-12-20T04:45:10.086282+0000","last_peered":"2023-12-20T04:45:10.086282+0000","last_clean":"2023-12-20T04:45:10.086282+0000","last_became_active":"2023-12-20T04:45:08.961548+0000","last_became_peered":"2023-12-20T04:45:08.961548+0000","last_unstale":"2023-12-20T04:45:10.086282+0000","last_undegraded":"2023-12-20T04:45:10.086282+0000","last_fullsized":"2023-12-20T04:45:10.086282+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:09:36.814759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950626+0000","last_change":"2023-12-20T04:45:08.603261+0000","last_active":"2023-12-20T04:45:09.950626+0000","last_peered":"2023-12-20T04:45:09.950626+0000","last_clean":"2023-12-20T04:45:09.950626+0000","last_became_active":"2023-12-20T04:45:08.602644+0000","last_became_peered":"2023-12-20T04:45:08.602644+0000","last_unstale":"2023-12-20T04:45:09.950626+0000","last_undegraded":"2023-12-20T04:45:09.950626+0000","last_fullsized":"2023-12-20T04:45:09.950626+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:58:45.614184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086664+0000","last_change":"2023-12-20T04:45:08.954027+0000","last_active":"2023-12-20T04:45:10.086664+0000","last_peered":"2023-12-20T04:45:10.086664+0000","last_clean":"2023-12-20T04:45:10.086664+0000","last_became_active":"2023-12-20T04:45:08.953822+0000","last_became_peered":"2023-12-20T04:45:08.953822+0000","last_unstale":"2023-12-20T04:45:10.086664+0000","last_undegraded":"2023-12-20T04:45:10.086664+0000","last_fullsized":"2023-12-20T04:45:10.086664+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:22:22.417135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086349+0000","last_change":"2023-12-20T04:45:08.604733+0000","last_active":"2023-12-20T04:45:10.086349+0000","last_peered":"2023-12-20T04:45:10.086349+0000","last_clean":"2023-12-20T04:45:10.086349+0000","last_became_active":"2023-12-20T04:45:08.604492+0000","last_became_peered":"2023-12-20T04:45:08.604492+0000","last_unstale":"2023-12-20T04:45:10.086349+0000","last_undegraded":"2023-12-20T04:45:10.086349+0000","last_fullsized":"2023-12-20T04:45:10.086349+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:24:45.641978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950461+0000","last_change":"2023-12-20T04:45:08.957557+0000","last_active":"2023-12-20T04:45:09.950461+0000","last_peered":"2023-12-20T04:45:09.950461+0000","last_clean":"2023-12-20T04:45:09.950461+0000","last_became_active":"2023-12-20T04:45:08.957243+0000","last_became_peered":"2023-12-20T04:45:08.957243+0000","last_unstale":"2023-12-20T04:45:09.950461+0000","last_undegraded":"2023-12-20T04:45:09.950461+0000","last_fullsized":"2023-12-20T04:45:09.950461+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:31:04.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085850+0000","last_change":"2023-12-20T04:45:08.603112+0000","last_active":"2023-12-20T04:45:10.085850+0000","last_peered":"2023-12-20T04:45:10.085850+0000","last_clean":"2023-12-20T04:45:10.085850+0000","last_became_active":"2023-12-20T04:45:08.602227+0000","last_became_peered":"2023-12-20T04:45:08.602227+0000","last_unstale":"2023-12-20T04:45:10.085850+0000","last_undegraded":"2023-12-20T04:45:10.085850+0000","last_fullsized":"2023-12-20T04:45:10.085850+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:22:06.759303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950560+0000","last_change":"2023-12-20T04:45:08.956991+0000","last_active":"2023-12-20T04:45:09.950560+0000","last_peered":"2023-12-20T04:45:09.950560+0000","last_clean":"2023-12-20T04:45:09.950560+0000","last_became_active":"2023-12-20T04:45:08.956722+0000","last_became_peered":"2023-12-20T04:45:08.956722+0000","last_unstale":"2023-12-20T04:45:09.950560+0000","last_undegraded":"2023-12-20T04:45:09.950560+0000","last_fullsized":"2023-12-20T04:45:09.950560+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:13:25.005512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086938+0000","last_change":"2023-12-20T04:45:08.603254+0000","last_active":"2023-12-20T04:45:10.086938+0000","last_peered":"2023-12-20T04:45:10.086938+0000","last_clean":"2023-12-20T04:45:10.086938+0000","last_became_active":"2023-12-20T04:45:08.601771+0000","last_became_peered":"2023-12-20T04:45:08.601771+0000","last_unstale":"2023-12-20T04:45:10.086938+0000","last_undegraded":"2023-12-20T04:45:10.086938+0000","last_fullsized":"2023-12-20T04:45:10.086938+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:47:36.773729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086110+0000","last_change":"2023-12-20T04:45:08.949159+0000","last_active":"2023-12-20T04:45:10.086110+0000","last_peered":"2023-12-20T04:45:10.086110+0000","last_clean":"2023-12-20T04:45:10.086110+0000","last_became_active":"2023-12-20T04:45:08.948922+0000","last_became_peered":"2023-12-20T04:45:08.948922+0000","last_unstale":"2023-12-20T04:45:10.086110+0000","last_undegraded":"2023-12-20T04:45:10.086110+0000","last_fullsized":"2023-12-20T04:45:10.086110+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:36:06.687639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085822+0000","last_change":"2023-12-20T04:45:08.602804+0000","last_active":"2023-12-20T04:45:10.085822+0000","last_peered":"2023-12-20T04:45:10.085822+0000","last_clean":"2023-12-20T04:45:10.085822+0000","last_became_active":"2023-12-20T04:45:08.602561+0000","last_became_peered":"2023-12-20T04:45:08.602561+0000","last_unstale":"2023-12-20T04:45:10.085822+0000","last_undegraded":"2023-12-20T04:45:10.085822+0000","last_fullsized":"2023-12-20T04:45:10.085822+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:44:59.705016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086808+0000","last_change":"2023-12-20T04:45:08.958371+0000","last_active":"2023-12-20T04:45:10.086808+0000","last_peered":"2023-12-20T04:45:10.086808+0000","last_clean":"2023-12-20T04:45:10.086808+0000","last_became_active":"2023-12-20T04:45:08.957787+0000","last_became_peered":"2023-12-20T04:45:08.957787+0000","last_unstale":"2023-12-20T04:45:10.086808+0000","last_undegraded":"2023-12-20T04:45:10.086808+0000","last_fullsized":"2023-12-20T04:45:10.086808+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:37:46.400818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950681+0000","last_change":"2023-12-20T04:45:08.601972+0000","last_active":"2023-12-20T04:45:09.950681+0000","last_peered":"2023-12-20T04:45:09.950681+0000","last_clean":"2023-12-20T04:45:09.950681+0000","last_became_active":"2023-12-20T04:45:08.601155+0000","last_became_peered":"2023-12-20T04:45:08.601155+0000","last_unstale":"2023-12-20T04:45:09.950681+0000","last_undegraded":"2023-12-20T04:45:09.950681+0000","last_fullsized":"2023-12-20T04:45:09.950681+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:59:54.012978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086166+0000","last_change":"2023-12-20T04:45:08.950353+0000","last_active":"2023-12-20T04:45:10.086166+0000","last_peered":"2023-12-20T04:45:10.086166+0000","last_clean":"2023-12-20T04:45:10.086166+0000","last_became_active":"2023-12-20T04:45:08.949651+0000","last_became_peered":"2023-12-20T04:45:08.949651+0000","last_unstale":"2023-12-20T04:45:10.086166+0000","last_undegraded":"2023-12-20T04:45:10.086166+0000","last_fullsized":"2023-12-20T04:45:10.086166+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:10:43.052927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086990+0000","last_change":"2023-12-20T04:45:08.604456+0000","last_active":"2023-12-20T04:45:10.086990+0000","last_peered":"2023-12-20T04:45:10.086990+0000","last_clean":"2023-12-20T04:45:10.086990+0000","last_became_active":"2023-12-20T04:45:08.604188+0000","last_became_peered":"2023-12-20T04:45:08.604188+0000","last_unstale":"2023-12-20T04:45:10.086990+0000","last_undegraded":"2023-12-20T04:45:10.086990+0000","last_fullsized":"2023-12-20T04:45:10.086990+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:44:59.705016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950563+0000","last_change":"2023-12-20T04:45:08.954163+0000","last_active":"2023-12-20T04:45:09.950563+0000","last_peered":"2023-12-20T04:45:09.950563+0000","last_clean":"2023-12-20T04:45:09.950563+0000","last_became_active":"2023-12-20T04:45:08.953260+0000","last_became_peered":"2023-12-20T04:45:08.953260+0000","last_unstale":"2023-12-20T04:45:09.950563+0000","last_undegraded":"2023-12-20T04:45:09.950563+0000","last_fullsized":"2023-12-20T04:45:09.950563+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:32:23.738520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086419+0000","last_change":"2023-12-20T04:45:08.603556+0000","last_active":"2023-12-20T04:45:10.086419+0000","last_peered":"2023-12-20T04:45:10.086419+0000","last_clean":"2023-12-20T04:45:10.086419+0000","last_became_active":"2023-12-20T04:45:08.603317+0000","last_became_peered":"2023-12-20T04:45:08.603317+0000","last_unstale":"2023-12-20T04:45:10.086419+0000","last_undegraded":"2023-12-20T04:45:10.086419+0000","last_fullsized":"2023-12-20T04:45:10.086419+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:07:23.276222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086221+0000","last_change":"2023-12-20T04:45:08.959587+0000","last_active":"2023-12-20T04:45:10.086221+0000","last_peered":"2023-12-20T04:45:10.086221+0000","last_clean":"2023-12-20T04:45:10.086221+0000","last_became_active":"2023-12-20T04:45:08.957583+0000","last_became_peered":"2023-12-20T04:45:08.957583+0000","last_unstale":"2023-12-20T04:45:10.086221+0000","last_undegraded":"2023-12-20T04:45:10.086221+0000","last_fullsized":"2023-12-20T04:45:10.086221+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:29:06.557612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086269+0000","last_change":"2023-12-20T04:45:08.599111+0000","last_active":"2023-12-20T04:45:10.086269+0000","last_peered":"2023-12-20T04:45:10.086269+0000","last_clean":"2023-12-20T04:45:10.086269+0000","last_became_active":"2023-12-20T04:45:08.598893+0000","last_became_peered":"2023-12-20T04:45:08.598893+0000","last_unstale":"2023-12-20T04:45:10.086269+0000","last_undegraded":"2023-12-20T04:45:10.086269+0000","last_fullsized":"2023-12-20T04:45:10.086269+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:23:16.833856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086379+0000","last_change":"2023-12-20T04:45:08.959751+0000","last_active":"2023-12-20T04:45:10.086379+0000","last_peered":"2023-12-20T04:45:10.086379+0000","last_clean":"2023-12-20T04:45:10.086379+0000","last_became_active":"2023-12-20T04:45:08.958617+0000","last_became_peered":"2023-12-20T04:45:08.958617+0000","last_unstale":"2023-12-20T04:45:10.086379+0000","last_undegraded":"2023-12-20T04:45:10.086379+0000","last_fullsized":"2023-12-20T04:45:10.086379+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:31:04.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950764+0000","last_change":"2023-12-20T04:45:08.606046+0000","last_active":"2023-12-20T04:45:09.950764+0000","last_peered":"2023-12-20T04:45:09.950764+0000","last_clean":"2023-12-20T04:45:09.950764+0000","last_became_active":"2023-12-20T04:45:08.605436+0000","last_became_peered":"2023-12-20T04:45:08.605436+0000","last_unstale":"2023-12-20T04:45:09.950764+0000","last_undegraded":"2023-12-20T04:45:09.950764+0000","last_fullsized":"2023-12-20T04:45:09.950764+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:22:06.759303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085779+0000","last_change":"2023-12-20T04:45:08.955695+0000","last_active":"2023-12-20T04:45:10.085779+0000","last_peered":"2023-12-20T04:45:10.085779+0000","last_clean":"2023-12-20T04:45:10.085779+0000","last_became_active":"2023-12-20T04:45:08.955250+0000","last_became_peered":"2023-12-20T04:45:08.955250+0000","last_unstale":"2023-12-20T04:45:10.085779+0000","last_undegraded":"2023-12-20T04:45:10.085779+0000","last_fullsized":"2023-12-20T04:45:10.085779+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:26:11.862486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085829+0000","last_change":"2023-12-20T04:45:08.598960+0000","last_active":"2023-12-20T04:45:10.085829+0000","last_peered":"2023-12-20T04:45:10.085829+0000","last_clean":"2023-12-20T04:45:10.085829+0000","last_became_active":"2023-12-20T04:45:08.598704+0000","last_became_peered":"2023-12-20T04:45:08.598704+0000","last_unstale":"2023-12-20T04:45:10.085829+0000","last_undegraded":"2023-12-20T04:45:10.085829+0000","last_fullsized":"2023-12-20T04:45:10.085829+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:22:18.111612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086145+0000","last_change":"2023-12-20T04:45:08.957138+0000","last_active":"2023-12-20T04:45:10.086145+0000","last_peered":"2023-12-20T04:45:10.086145+0000","last_clean":"2023-12-20T04:45:10.086145+0000","last_became_active":"2023-12-20T04:45:08.956923+0000","last_became_peered":"2023-12-20T04:45:08.956923+0000","last_unstale":"2023-12-20T04:45:10.086145+0000","last_undegraded":"2023-12-20T04:45:10.086145+0000","last_fullsized":"2023-12-20T04:45:10.086145+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:48:51.877954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086011+0000","last_change":"2023-12-20T04:45:08.606529+0000","last_active":"2023-12-20T04:45:10.086011+0000","last_peered":"2023-12-20T04:45:10.086011+0000","last_clean":"2023-12-20T04:45:10.086011+0000","last_became_active":"2023-12-20T04:45:08.605997+0000","last_became_peered":"2023-12-20T04:45:08.605997+0000","last_unstale":"2023-12-20T04:45:10.086011+0000","last_undegraded":"2023-12-20T04:45:10.086011+0000","last_fullsized":"2023-12-20T04:45:10.086011+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:38:44.336854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086066+0000","last_change":"2023-12-20T04:45:08.951251+0000","last_active":"2023-12-20T04:45:10.086066+0000","last_peered":"2023-12-20T04:45:10.086066+0000","last_clean":"2023-12-20T04:45:10.086066+0000","last_became_active":"2023-12-20T04:45:08.950959+0000","last_became_peered":"2023-12-20T04:45:08.950959+0000","last_unstale":"2023-12-20T04:45:10.086066+0000","last_undegraded":"2023-12-20T04:45:10.086066+0000","last_fullsized":"2023-12-20T04:45:10.086066+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:42:44.587211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.087013+0000","last_change":"2023-12-20T04:45:08.597941+0000","last_active":"2023-12-20T04:45:10.087013+0000","last_peered":"2023-12-20T04:45:10.087013+0000","last_clean":"2023-12-20T04:45:10.087013+0000","last_became_active":"2023-12-20T04:45:08.597673+0000","last_became_peered":"2023-12-20T04:45:08.597673+0000","last_unstale":"2023-12-20T04:45:10.087013+0000","last_undegraded":"2023-12-20T04:45:10.087013+0000","last_fullsized":"2023-12-20T04:45:10.087013+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:15:02.019592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":203,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-20T04:45:08.953505+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:45:08.953505+0000","last_peered":"2023-12-20T04:45:08.953505+0000","last_clean":"2023-12-20T04:45:08.953505+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:45:08.953505+0000","last_undegraded":"2023-12-20T04:45:08.953505+0000","last_fullsized":"2023-12-20T04:45:08.953505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":901,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194410,"statfs":{"total":200000000,"available":199076410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.37,"5min":0.315,"15min":0.315},"max":{"1min":0.73099999999999998,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.40500000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.752,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79700000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.51200000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.41499999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.74299999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.70199999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48899999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.71999999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47599999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.498,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.628}]},{"osd":5,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.498,"15min":0.496},"min":{"1min":0.33900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.64900000000000002,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.36899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69199999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.66300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194987,"statfs":{"total":200000000,"available":199666938,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48899999999999999,"15min":0.48999999999999999},"min":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.59699999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.498},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.627}]},{"osd":2,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.505,"15min":0.503},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53200000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.42399999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.64900000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.36699999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.64900000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38700000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.66400000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.42799999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.68500000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194986,"statfs":{"total":200000000,"available":199666286,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:44:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.504,"15min":0.501},"min":{"1min":0.29999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67200000000000004,"5min":0.745,"15min":0.745},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.66900000000000004,"5min":0.749,"15min":0.749},"last":0.52600000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:44:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.627,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.69799999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.49199999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:44:43 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.505,"15min":0.50700000000000001},"min":{"1min":0.33200000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64000000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51300000000000001,"15min":0.51200000000000001},"min":{"1min":0.41099999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.65600000000000003,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:44:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67000000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.441},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.42199999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42399999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:44:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47999999999999998,"15min":0.48199999999999998},"min":{"1min":0.29499999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.629,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.318}]},{"osd":6,"last update":"Wed Dec 20 04:44:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.50800000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72199999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.71299999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.379}]},{"osd":7,"last update":"Wed Dec 20 04:44:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.34599999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.748,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78100000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":326,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194985,"statfs":{"total":200000000,"available":199665374,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.496,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.629,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.497}]},{"osd":1,"last update":"Wed Dec 20 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.50900000000000001,"15min":0.50600000000000001},"min":{"1min":0.35399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67200000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.499,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72899999999999998,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.622}]},{"osd":2,"last update":"Wed Dec 20 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.56000000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70899999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.628,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54500000000000004}]},{"osd":3,"last update":"Wed Dec 20 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.40600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.58499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71299999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.59299999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.47599999999999998,"15min":0.48199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63300000000000001,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50600000000000001,"15min":0.51000000000000001},"min":{"1min":0.311,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.64100000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.72099999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67400000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.51700000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.39600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68000000000000005,"5min":0.753,"15min":0.753},"last":0.55600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194987,"statfs":{"total":200000000,"available":199666882,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.33400000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.505,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34799999999999998},"min":{"1min":0.27500000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.35699999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.317,"15min":0.315},"min":{"1min":0.24199999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.32900000000000001,"15min":0.32700000000000001},"min":{"1min":0.247,"5min":0.217,"15min":0.217},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.36799999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34399999999999997,"15min":0.34300000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53800000000000003,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.372,"15min":0.36899999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.33700000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70899999999999996,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72899999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.64100000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80000000000000004,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.436,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.746,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.434,"5min":0.372,"15min":0.372},"max":{"1min":0.75,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.621}]},{"osd":7,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.41299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71199999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194987,"statfs":{"total":200000000,"available":199666882,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.29399999999999998,"15min":0.28699999999999998},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.35499999999999998,"15min":0.33300000000000002},"min":{"1min":0.29899999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.29999999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.32400000000000001,"15min":0.32000000000000001},"min":{"1min":0.24099999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.317},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34200000000000003},"min":{"1min":0.29499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.34799999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.35399999999999998,"15min":0.34499999999999997},"min":{"1min":0.30499999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.37,"15min":0.36299999999999999},"min":{"1min":0.315,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.32700000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70499999999999996,"5min":0.746,"15min":0.746},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.42099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":0.46999999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.40999999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72599999999999998,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68600000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45400000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.58399999999999996,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.40899999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.46100000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.57999999999999996,"15min":0.56499999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.432,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194987,"statfs":{"total":200000000,"available":199666848,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.28399999999999997,"15min":0.28000000000000003},"min":{"1min":0.193,"5min":0.187,"15min":0.187},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.246},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.25,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.29299999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.29999999999999999,"15min":0.29599999999999999},"min":{"1min":0.23799999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.223},{"interface":"front","average":{"1min":0.371,"5min":0.34399999999999997,"15min":0.34000000000000002},"min":{"1min":0.22600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.308}]},{"osd":3,"last update":"Wed Dec 20 04:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.35099999999999998,"15min":0.34599999999999997},"min":{"1min":0.28000000000000003,"5min":0.191,"15min":0.191},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.34799999999999998},"min":{"1min":0.254,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.32500000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.432},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53400000000000003},"min":{"1min":0.45600000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.41899999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76700000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.498}]},{"osd":7,"last update":"Wed Dec 20 04:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.49199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.48999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194408,"statfs":{"total":200000000,"available":199074424,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.30499999999999999,"15min":0.30399999999999999},"min":{"1min":0.23499999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.39200000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.308,"15min":0.30399999999999999},"min":{"1min":0.217,"5min":0.184,"15min":0.184},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.26500000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35099999999999998,"15min":0.35199999999999998},"min":{"1min":0.25800000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.34100000000000003,"15min":0.34200000000000003},"min":{"1min":0.26900000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.46300000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.34899999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.315},"min":{"1min":0.27900000000000003,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.497,"5min":0.5,"15min":0.5},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.36299999999999999,"15min":0.36099999999999999},"min":{"1min":0.29199999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.48499999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.36299999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.33900000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.54600000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73099999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.48999999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57599999999999996},"min":{"1min":0.46899999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.754,"5min":0.873,"15min":0.873},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80400000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.55900000000000005}]},{"osd":7,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54300000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61299999999999999}]}]}],"pool_statfs":[]}} 2023-12-20T04:45:12.888 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:45:13.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.022+0000 7fa267147640 1 Processor -- start 2023-12-20T04:45:13.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.022+0000 7fa267147640 1 -- start start 2023-12-20T04:45:13.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.023+0000 7fa267147640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa26006c240 0x7fa26006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.023+0000 7fa267147640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2600ccf30 con 0x7fa26015e530 2023-12-20T04:45:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.023+0000 7fa267147640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2600ca1c0 con 0x7fa260159b50 2023-12-20T04:45:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.023+0000 7fa267147640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa26006cc10 con 0x7fa26006c240 2023-12-20T04:45:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.023+0000 7fa25ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa26015e530 0x7fa26006fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40996/0 (socket says 172.21.15.132:40996) 2023-12-20T04:45:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.023+0000 7fa25ffff640 1 -- 172.21.15.132:0/702698678 learned_addr learned my addr 172.21.15.132:0/702698678 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:45:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.023+0000 7fa2656e4640 1 --2- 172.21.15.132:0/702698678 >> v2:172.21.15.187:3300/0 conn(0x7fa26006c240 0x7fa26006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.023+0000 7fa25f7fe640 1 -- 172.21.15.132:0/702698678 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578706604 0 0) 0x7fa2600ccf30 con 0x7fa26015e530 2023-12-20T04:45:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.023+0000 7fa25f7fe640 1 -- 172.21.15.132:0/702698678 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa248003520 con 0x7fa26015e530 2023-12-20T04:45:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.024+0000 7fa25f7fe640 1 -- 172.21.15.132:0/702698678 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 683426474 0 0) 0x7fa248003520 con 0x7fa26015e530 2023-12-20T04:45:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.024+0000 7fa2656e4640 1 -- 172.21.15.132:0/702698678 >> v1:172.21.15.187:6789/0 conn(0x7fa260159b50 legacy=0x7fa2600c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.024+0000 7fa2656e4640 1 -- 172.21.15.132:0/702698678 >> v1:172.21.15.132:6789/0 conn(0x7fa26015e530 legacy=0x7fa26006fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.024+0000 7fa2656e4640 1 -- 172.21.15.132:0/702698678 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2600ca4a0 con 0x7fa26006c240 2023-12-20T04:45:13.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.024+0000 7fa2656e4640 1 --2- 172.21.15.132:0/702698678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa26006c240 0x7fa26006c6d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa258009dc0 tx=0x7fa25802be00 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ab95d64145f5eefb server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:13.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.025+0000 7fa25f7fe640 1 -- 172.21.15.132:0/702698678 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa254001670 con 0x7fa26006c240 2023-12-20T04:45:13.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.025+0000 7fa25f7fe640 1 -- 172.21.15.132:0/702698678 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa25802c930 con 0x7fa26006c240 2023-12-20T04:45:13.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.025+0000 7fa25f7fe640 1 -- 172.21.15.132:0/702698678 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa25802ccc0 con 0x7fa26006c240 2023-12-20T04:45:13.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.025+0000 7fa267147640 1 -- 172.21.15.132:0/702698678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa26006c240 msgr2=0x7fa26006c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.025+0000 7fa267147640 1 --2- 172.21.15.132:0/702698678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa26006c240 0x7fa26006c6d0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fa258009dc0 tx=0x7fa25802be00 comp rx=0 tx=0).stop 2023-12-20T04:45:13.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.025+0000 7fa267147640 1 -- 172.21.15.132:0/702698678 shutdown_connections 2023-12-20T04:45:13.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.025+0000 7fa267147640 1 --2- 172.21.15.132:0/702698678 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa26006c240 0x7fa26006c6d0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.025+0000 7fa267147640 1 -- 172.21.15.132:0/702698678 >> 172.21.15.132:0/702698678 conn(0x7fa2600ced10 msgr2=0x7fa2600cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:13.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.025+0000 7fa267147640 1 -- 172.21.15.132:0/702698678 shutdown_connections 2023-12-20T04:45:13.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.025+0000 7fa267147640 1 -- 172.21.15.132:0/702698678 wait complete. 2023-12-20T04:45:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.026+0000 7fa267147640 1 Processor -- start 2023-12-20T04:45:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.026+0000 7fa267147640 1 -- start start 2023-12-20T04:45:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.027+0000 7fa267147640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa26006c240 0x7fa2600c4920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.027+0000 7fa267147640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa260159b50 0x7fa260151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.027+0000 7fa267147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa26015e530 0x7fa260152360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.027+0000 7fa267147640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2600c4e60 con 0x7fa26015e530 2023-12-20T04:45:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.027+0000 7fa267147640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa260151180 con 0x7fa26006c240 2023-12-20T04:45:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.027+0000 7fa267147640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2601505b0 con 0x7fa260159b50 2023-12-20T04:45:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.027+0000 7fa2656e4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa26015e530 0x7fa260152360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.027+0000 7fa2656e4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa26015e530 0x7fa260152360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35968/0 (socket says 172.21.15.132:35968) 2023-12-20T04:45:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.027+0000 7fa2656e4640 1 -- 172.21.15.132:0/2519738605 learned_addr learned my addr 172.21.15.132:0/2519738605 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.027+0000 7fa264ee3640 1 --2- 172.21.15.132:0/2519738605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa26006c240 0x7fa2600c4920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.027+0000 7fa25ffff640 1 --2- 172.21.15.132:0/2519738605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa260159b50 0x7fa260151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.028+0000 7fa2656e4640 1 -- 172.21.15.132:0/2519738605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa260159b50 msgr2=0x7fa260151610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.028+0000 7fa2656e4640 1 --2- 172.21.15.132:0/2519738605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa260159b50 0x7fa260151610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.028+0000 7fa2656e4640 1 -- 172.21.15.132:0/2519738605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa26006c240 msgr2=0x7fa2600c4920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.028+0000 7fa2656e4640 1 --2- 172.21.15.132:0/2519738605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa26006c240 0x7fa2600c4920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.028+0000 7fa2656e4640 1 -- 172.21.15.132:0/2519738605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa258009a70 con 0x7fa26015e530 2023-12-20T04:45:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.028+0000 7fa264ee3640 1 --2- 172.21.15.132:0/2519738605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa26006c240 0x7fa2600c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:45:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.028+0000 7fa2656e4640 1 --2- 172.21.15.132:0/2519738605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa26015e530 0x7fa260152360 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa258009ee0 tx=0x7fa258004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.028+0000 7fa25d7fa640 1 -- 172.21.15.132:0/2519738605 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258009450 con 0x7fa26015e530 2023-12-20T04:45:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.028+0000 7fa25d7fa640 1 -- 172.21.15.132:0/2519738605 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa258040450 con 0x7fa26015e530 2023-12-20T04:45:13.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.028+0000 7fa267147640 1 -- 172.21.15.132:0/2519738605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa260150850 con 0x7fa26015e530 2023-12-20T04:45:13.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.028+0000 7fa25d7fa640 1 -- 172.21.15.132:0/2519738605 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa258040800 con 0x7fa26015e530 2023-12-20T04:45:13.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.028+0000 7fa267147640 1 -- 172.21.15.132:0/2519738605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa260150e10 con 0x7fa26015e530 2023-12-20T04:45:13.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.029+0000 7fa267147640 1 -- 172.21.15.132:0/2519738605 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa260151310 con 0x7fa26015e530 2023-12-20T04:45:13.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.029+0000 7fa25d7fa640 1 -- 172.21.15.132:0/2519738605 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa258040960 con 0x7fa26015e530 2023-12-20T04:45:13.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.030+0000 7fa25d7fa640 1 --2- 172.21.15.132:0/2519738605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa24c06a460 0x7fa24c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.030+0000 7fa264ee3640 1 --2- 172.21.15.132:0/2519738605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa24c06a460 0x7fa24c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.030+0000 7fa25d7fa640 1 -- 172.21.15.132:0/2519738605 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2580ab400 con 0x7fa26015e530 2023-12-20T04:45:13.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.030+0000 7fa264ee3640 1 --2- 172.21.15.132:0/2519738605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa24c06a460 0x7fa24c06c920 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa250007fd0 tx=0x7fa250009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:13.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.034+0000 7fa25d7fa640 1 -- 172.21.15.132:0/2519738605 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa258076a80 con 0x7fa26015e530 2023-12-20T04:45:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.196+0000 7fa267147640 1 -- 172.21.15.132:0/2519738605 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa2600ca780 con 0x7fa24c06a460 2023-12-20T04:45:13.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.203+0000 7fa25d7fa640 1 -- 172.21.15.132:0/2519738605 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+284952 (secure 0 0 0) 0x7fa2500013e0 con 0x7fa24c06a460 2023-12-20T04:45:13.208 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:45:13.210 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:45:13.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.206+0000 7fa267147640 1 -- 172.21.15.132:0/2519738605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa24c06a460 msgr2=0x7fa24c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.206+0000 7fa267147640 1 --2- 172.21.15.132:0/2519738605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa24c06a460 0x7fa24c06c920 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7fa250007fd0 tx=0x7fa250009040 comp rx=0 tx=0).stop 2023-12-20T04:45:13.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.206+0000 7fa267147640 1 -- 172.21.15.132:0/2519738605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa26015e530 msgr2=0x7fa260152360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.206+0000 7fa267147640 1 --2- 172.21.15.132:0/2519738605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa26015e530 0x7fa260152360 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fa258009ee0 tx=0x7fa258004a40 comp rx=0 tx=0).stop 2023-12-20T04:45:13.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.207+0000 7fa267147640 1 -- 172.21.15.132:0/2519738605 shutdown_connections 2023-12-20T04:45:13.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.207+0000 7fa267147640 1 --2- 172.21.15.132:0/2519738605 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa24c06a460 0x7fa24c06c920 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.207+0000 7fa267147640 1 --2- 172.21.15.132:0/2519738605 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa26015e530 0x7fa260152360 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.207+0000 7fa267147640 1 --2- 172.21.15.132:0/2519738605 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa260159b50 0x7fa260151610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.207+0000 7fa267147640 1 --2- 172.21.15.132:0/2519738605 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa26006c240 0x7fa2600c4920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.207+0000 7fa267147640 1 -- 172.21.15.132:0/2519738605 >> 172.21.15.132:0/2519738605 conn(0x7fa2600ced10 msgr2=0x7fa26015a5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:13.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.207+0000 7fa267147640 1 -- 172.21.15.132:0/2519738605 shutdown_connections 2023-12-20T04:45:13.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.207+0000 7fa267147640 1 -- 172.21.15.132:0/2519738605 wait complete. 2023-12-20T04:45:13.220 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":135,"stamp":"2023-12-20T04:45:12.122234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":170,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":3759,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558740,"statfs":{"total":1600000000,"available":1596150044,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.533600"},"pg_stats":[{"pgid":"9.3f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.945396+0000","last_change":"2023-12-20T04:45:08.949561+0000","last_active":"2023-12-20T04:45:09.945396+0000","last_peered":"2023-12-20T04:45:09.945396+0000","last_clean":"2023-12-20T04:45:09.945396+0000","last_became_active":"2023-12-20T04:45:08.949332+0000","last_became_peered":"2023-12-20T04:45:08.949332+0000","last_unstale":"2023-12-20T04:45:09.945396+0000","last_undegraded":"2023-12-20T04:45:09.945396+0000","last_fullsized":"2023-12-20T04:45:09.945396+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:26:05.035224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085735+0000","last_change":"2023-12-20T04:45:08.958277+0000","last_active":"2023-12-20T04:45:10.085735+0000","last_peered":"2023-12-20T04:45:10.085735+0000","last_clean":"2023-12-20T04:45:10.085735+0000","last_became_active":"2023-12-20T04:45:08.957279+0000","last_became_peered":"2023-12-20T04:45:08.957279+0000","last_unstale":"2023-12-20T04:45:10.085735+0000","last_undegraded":"2023-12-20T04:45:10.085735+0000","last_fullsized":"2023-12-20T04:45:10.085735+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:32:42.019112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.3d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086043+0000","last_change":"2023-12-20T04:45:08.961873+0000","last_active":"2023-12-20T04:45:10.086043+0000","last_peered":"2023-12-20T04:45:10.086043+0000","last_clean":"2023-12-20T04:45:10.086043+0000","last_became_active":"2023-12-20T04:45:08.961328+0000","last_became_peered":"2023-12-20T04:45:08.961328+0000","last_unstale":"2023-12-20T04:45:10.086043+0000","last_undegraded":"2023-12-20T04:45:10.086043+0000","last_fullsized":"2023-12-20T04:45:10.086043+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:22:22.417135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.3c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085844+0000","last_change":"2023-12-20T04:45:08.954783+0000","last_active":"2023-12-20T04:45:10.085844+0000","last_peered":"2023-12-20T04:45:10.085844+0000","last_clean":"2023-12-20T04:45:10.085844+0000","last_became_active":"2023-12-20T04:45:08.954486+0000","last_became_peered":"2023-12-20T04:45:08.954486+0000","last_unstale":"2023-12-20T04:45:10.085844+0000","last_undegraded":"2023-12-20T04:45:10.085844+0000","last_fullsized":"2023-12-20T04:45:10.085844+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:27:37.318171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.3b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.945395+0000","last_change":"2023-12-20T04:45:08.951887+0000","last_active":"2023-12-20T04:45:09.945395+0000","last_peered":"2023-12-20T04:45:09.945395+0000","last_clean":"2023-12-20T04:45:09.945395+0000","last_became_active":"2023-12-20T04:45:08.951405+0000","last_became_peered":"2023-12-20T04:45:08.951405+0000","last_unstale":"2023-12-20T04:45:09.945395+0000","last_undegraded":"2023-12-20T04:45:09.945395+0000","last_fullsized":"2023-12-20T04:45:09.945395+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:52:11.934454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.3a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950444+0000","last_change":"2023-12-20T04:45:08.948975+0000","last_active":"2023-12-20T04:45:09.950444+0000","last_peered":"2023-12-20T04:45:09.950444+0000","last_clean":"2023-12-20T04:45:09.950444+0000","last_became_active":"2023-12-20T04:45:08.948431+0000","last_became_peered":"2023-12-20T04:45:08.948431+0000","last_unstale":"2023-12-20T04:45:09.950444+0000","last_undegraded":"2023-12-20T04:45:09.950444+0000","last_fullsized":"2023-12-20T04:45:09.950444+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:19:43.758722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.39","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950425+0000","last_change":"2023-12-20T04:45:08.950767+0000","last_active":"2023-12-20T04:45:09.950425+0000","last_peered":"2023-12-20T04:45:09.950425+0000","last_clean":"2023-12-20T04:45:09.950425+0000","last_became_active":"2023-12-20T04:45:08.949915+0000","last_became_peered":"2023-12-20T04:45:08.949915+0000","last_unstale":"2023-12-20T04:45:09.950425+0000","last_undegraded":"2023-12-20T04:45:09.950425+0000","last_fullsized":"2023-12-20T04:45:09.950425+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:27:37.318171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.38","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086067+0000","last_change":"2023-12-20T04:45:08.950956+0000","last_active":"2023-12-20T04:45:10.086067+0000","last_peered":"2023-12-20T04:45:10.086067+0000","last_clean":"2023-12-20T04:45:10.086067+0000","last_became_active":"2023-12-20T04:45:08.950506+0000","last_became_peered":"2023-12-20T04:45:08.950506+0000","last_unstale":"2023-12-20T04:45:10.086067+0000","last_undegraded":"2023-12-20T04:45:10.086067+0000","last_fullsized":"2023-12-20T04:45:10.086067+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:10:49.409127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.37","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950346+0000","last_change":"2023-12-20T04:45:08.952072+0000","last_active":"2023-12-20T04:45:09.950346+0000","last_peered":"2023-12-20T04:45:09.950346+0000","last_clean":"2023-12-20T04:45:09.950346+0000","last_became_active":"2023-12-20T04:45:08.951759+0000","last_became_peered":"2023-12-20T04:45:08.951759+0000","last_unstale":"2023-12-20T04:45:09.950346+0000","last_undegraded":"2023-12-20T04:45:09.950346+0000","last_fullsized":"2023-12-20T04:45:09.950346+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:47:54.809615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.36","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085833+0000","last_change":"2023-12-20T04:45:08.955881+0000","last_active":"2023-12-20T04:45:10.085833+0000","last_peered":"2023-12-20T04:45:10.085833+0000","last_clean":"2023-12-20T04:45:10.085833+0000","last_became_active":"2023-12-20T04:45:08.955679+0000","last_became_peered":"2023-12-20T04:45:08.955679+0000","last_unstale":"2023-12-20T04:45:10.085833+0000","last_undegraded":"2023-12-20T04:45:10.085833+0000","last_fullsized":"2023-12-20T04:45:10.085833+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:47:38.945963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.35","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086199+0000","last_change":"2023-12-20T04:45:08.953887+0000","last_active":"2023-12-20T04:45:10.086199+0000","last_peered":"2023-12-20T04:45:10.086199+0000","last_clean":"2023-12-20T04:45:10.086199+0000","last_became_active":"2023-12-20T04:45:08.952888+0000","last_became_peered":"2023-12-20T04:45:08.952888+0000","last_unstale":"2023-12-20T04:45:10.086199+0000","last_undegraded":"2023-12-20T04:45:10.086199+0000","last_fullsized":"2023-12-20T04:45:10.086199+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:38:00.630473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.34","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086331+0000","last_change":"2023-12-20T04:45:08.958507+0000","last_active":"2023-12-20T04:45:10.086331+0000","last_peered":"2023-12-20T04:45:10.086331+0000","last_clean":"2023-12-20T04:45:10.086331+0000","last_became_active":"2023-12-20T04:45:08.958155+0000","last_became_peered":"2023-12-20T04:45:08.958155+0000","last_unstale":"2023-12-20T04:45:10.086331+0000","last_undegraded":"2023-12-20T04:45:10.086331+0000","last_fullsized":"2023-12-20T04:45:10.086331+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:38:45.340767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.33","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086705+0000","last_change":"2023-12-20T04:45:08.956399+0000","last_active":"2023-12-20T04:45:10.086705+0000","last_peered":"2023-12-20T04:45:10.086705+0000","last_clean":"2023-12-20T04:45:10.086705+0000","last_became_active":"2023-12-20T04:45:08.956067+0000","last_became_peered":"2023-12-20T04:45:08.956067+0000","last_unstale":"2023-12-20T04:45:10.086705+0000","last_undegraded":"2023-12-20T04:45:10.086705+0000","last_fullsized":"2023-12-20T04:45:10.086705+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:59:55.016890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.32","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950459+0000","last_change":"2023-12-20T04:45:08.949663+0000","last_active":"2023-12-20T04:45:09.950459+0000","last_peered":"2023-12-20T04:45:09.950459+0000","last_clean":"2023-12-20T04:45:09.950459+0000","last_became_active":"2023-12-20T04:45:08.949450+0000","last_became_peered":"2023-12-20T04:45:08.949450+0000","last_unstale":"2023-12-20T04:45:09.950459+0000","last_undegraded":"2023-12-20T04:45:09.950459+0000","last_fullsized":"2023-12-20T04:45:09.950459+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:10:43.052927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.31","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950613+0000","last_change":"2023-12-20T04:45:08.951239+0000","last_active":"2023-12-20T04:45:09.950613+0000","last_peered":"2023-12-20T04:45:09.950613+0000","last_clean":"2023-12-20T04:45:09.950613+0000","last_became_active":"2023-12-20T04:45:08.950895+0000","last_became_peered":"2023-12-20T04:45:08.950895+0000","last_unstale":"2023-12-20T04:45:09.950613+0000","last_undegraded":"2023-12-20T04:45:09.950613+0000","last_fullsized":"2023-12-20T04:45:09.950613+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:37:46.400818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.30","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950584+0000","last_change":"2023-12-20T04:45:08.953275+0000","last_active":"2023-12-20T04:45:09.950584+0000","last_peered":"2023-12-20T04:45:09.950584+0000","last_clean":"2023-12-20T04:45:09.950584+0000","last_became_active":"2023-12-20T04:45:08.953056+0000","last_became_peered":"2023-12-20T04:45:08.953056+0000","last_unstale":"2023-12-20T04:45:09.950584+0000","last_undegraded":"2023-12-20T04:45:09.950584+0000","last_fullsized":"2023-12-20T04:45:09.950584+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:36:14.478464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.2f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085822+0000","last_change":"2023-12-20T04:45:08.956679+0000","last_active":"2023-12-20T04:45:10.085822+0000","last_peered":"2023-12-20T04:45:10.085822+0000","last_clean":"2023-12-20T04:45:10.085822+0000","last_became_active":"2023-12-20T04:45:08.955165+0000","last_became_peered":"2023-12-20T04:45:08.955165+0000","last_unstale":"2023-12-20T04:45:10.085822+0000","last_undegraded":"2023-12-20T04:45:10.085822+0000","last_fullsized":"2023-12-20T04:45:10.085822+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:41:43.919950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086154+0000","last_change":"2023-12-20T04:45:08.960107+0000","last_active":"2023-12-20T04:45:10.086154+0000","last_peered":"2023-12-20T04:45:10.086154+0000","last_clean":"2023-12-20T04:45:10.086154+0000","last_became_active":"2023-12-20T04:45:08.959559+0000","last_became_peered":"2023-12-20T04:45:08.959559+0000","last_unstale":"2023-12-20T04:45:10.086154+0000","last_undegraded":"2023-12-20T04:45:10.086154+0000","last_fullsized":"2023-12-20T04:45:10.086154+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:40:39.035859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.945399+0000","last_change":"2023-12-20T04:45:08.951801+0000","last_active":"2023-12-20T04:45:09.945399+0000","last_peered":"2023-12-20T04:45:09.945399+0000","last_clean":"2023-12-20T04:45:09.945399+0000","last_became_active":"2023-12-20T04:45:08.951591+0000","last_became_peered":"2023-12-20T04:45:08.951591+0000","last_unstale":"2023-12-20T04:45:09.945399+0000","last_undegraded":"2023-12-20T04:45:09.945399+0000","last_fullsized":"2023-12-20T04:45:09.945399+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:56:57.356485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.2c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085791+0000","last_change":"2023-12-20T04:45:08.953497+0000","last_active":"2023-12-20T04:45:10.085791+0000","last_peered":"2023-12-20T04:45:10.085791+0000","last_clean":"2023-12-20T04:45:10.085791+0000","last_became_active":"2023-12-20T04:45:08.953277+0000","last_became_peered":"2023-12-20T04:45:08.953277+0000","last_unstale":"2023-12-20T04:45:10.085791+0000","last_undegraded":"2023-12-20T04:45:10.085791+0000","last_fullsized":"2023-12-20T04:45:10.085791+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:03:27.221488+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.2b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086076+0000","last_change":"2023-12-20T04:45:08.960974+0000","last_active":"2023-12-20T04:45:10.086076+0000","last_peered":"2023-12-20T04:45:10.086076+0000","last_clean":"2023-12-20T04:45:10.086076+0000","last_became_active":"2023-12-20T04:45:08.960379+0000","last_became_peered":"2023-12-20T04:45:08.960379+0000","last_unstale":"2023-12-20T04:45:10.086076+0000","last_undegraded":"2023-12-20T04:45:10.086076+0000","last_fullsized":"2023-12-20T04:45:10.086076+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:36:14.478464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.2a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085906+0000","last_change":"2023-12-20T04:45:08.956353+0000","last_active":"2023-12-20T04:45:10.085906+0000","last_peered":"2023-12-20T04:45:10.085906+0000","last_clean":"2023-12-20T04:45:10.085906+0000","last_became_active":"2023-12-20T04:45:08.954858+0000","last_became_peered":"2023-12-20T04:45:08.954858+0000","last_unstale":"2023-12-20T04:45:10.085906+0000","last_undegraded":"2023-12-20T04:45:10.085906+0000","last_fullsized":"2023-12-20T04:45:10.085906+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:07:48.603965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.29","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086260+0000","last_change":"2023-12-20T04:45:08.958131+0000","last_active":"2023-12-20T04:45:10.086260+0000","last_peered":"2023-12-20T04:45:10.086260+0000","last_clean":"2023-12-20T04:45:10.086260+0000","last_became_active":"2023-12-20T04:45:08.957904+0000","last_became_peered":"2023-12-20T04:45:08.957904+0000","last_unstale":"2023-12-20T04:45:10.086260+0000","last_undegraded":"2023-12-20T04:45:10.086260+0000","last_fullsized":"2023-12-20T04:45:10.086260+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:25:41.248153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.28","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086915+0000","last_change":"2023-12-20T04:45:08.955453+0000","last_active":"2023-12-20T04:45:10.086915+0000","last_peered":"2023-12-20T04:45:10.086915+0000","last_clean":"2023-12-20T04:45:10.086915+0000","last_became_active":"2023-12-20T04:45:08.955189+0000","last_became_peered":"2023-12-20T04:45:08.955189+0000","last_unstale":"2023-12-20T04:45:10.086915+0000","last_undegraded":"2023-12-20T04:45:10.086915+0000","last_fullsized":"2023-12-20T04:45:10.086915+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:43:08.979669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.27","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.945480+0000","last_change":"2023-12-20T04:45:08.952020+0000","last_active":"2023-12-20T04:45:09.945480+0000","last_peered":"2023-12-20T04:45:09.945480+0000","last_clean":"2023-12-20T04:45:09.945480+0000","last_became_active":"2023-12-20T04:45:08.951687+0000","last_became_peered":"2023-12-20T04:45:08.951687+0000","last_unstale":"2023-12-20T04:45:09.945480+0000","last_undegraded":"2023-12-20T04:45:09.945480+0000","last_fullsized":"2023-12-20T04:45:09.945480+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:07:57.904496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.26","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086500+0000","last_change":"2023-12-20T04:45:08.949730+0000","last_active":"2023-12-20T04:45:10.086500+0000","last_peered":"2023-12-20T04:45:10.086500+0000","last_clean":"2023-12-20T04:45:10.086500+0000","last_became_active":"2023-12-20T04:45:08.949489+0000","last_became_peered":"2023-12-20T04:45:08.949489+0000","last_unstale":"2023-12-20T04:45:10.086500+0000","last_undegraded":"2023-12-20T04:45:10.086500+0000","last_fullsized":"2023-12-20T04:45:10.086500+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:25:41.248153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.25","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950445+0000","last_change":"2023-12-20T04:45:08.954528+0000","last_active":"2023-12-20T04:45:09.950445+0000","last_peered":"2023-12-20T04:45:09.950445+0000","last_clean":"2023-12-20T04:45:09.950445+0000","last_became_active":"2023-12-20T04:45:08.954277+0000","last_became_peered":"2023-12-20T04:45:08.954277+0000","last_unstale":"2023-12-20T04:45:09.950445+0000","last_undegraded":"2023-12-20T04:45:09.950445+0000","last_fullsized":"2023-12-20T04:45:09.950445+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:30:56.613612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.24","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.945453+0000","last_change":"2023-12-20T04:45:08.951070+0000","last_active":"2023-12-20T04:45:09.945453+0000","last_peered":"2023-12-20T04:45:09.945453+0000","last_clean":"2023-12-20T04:45:09.945453+0000","last_became_active":"2023-12-20T04:45:08.950397+0000","last_became_peered":"2023-12-20T04:45:08.950397+0000","last_unstale":"2023-12-20T04:45:09.945453+0000","last_undegraded":"2023-12-20T04:45:09.945453+0000","last_fullsized":"2023-12-20T04:45:09.945453+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:08:12.695461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.23","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085641+0000","last_change":"2023-12-20T04:45:08.952327+0000","last_active":"2023-12-20T04:45:10.085641+0000","last_peered":"2023-12-20T04:45:10.085641+0000","last_clean":"2023-12-20T04:45:10.085641+0000","last_became_active":"2023-12-20T04:45:08.951961+0000","last_became_peered":"2023-12-20T04:45:08.951961+0000","last_unstale":"2023-12-20T04:45:10.085641+0000","last_undegraded":"2023-12-20T04:45:10.085641+0000","last_fullsized":"2023-12-20T04:45:10.085641+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:47:00.489617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.22","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086150+0000","last_change":"2023-12-20T04:45:08.959584+0000","last_active":"2023-12-20T04:45:10.086150+0000","last_peered":"2023-12-20T04:45:10.086150+0000","last_clean":"2023-12-20T04:45:10.086150+0000","last_became_active":"2023-12-20T04:45:08.959125+0000","last_became_peered":"2023-12-20T04:45:08.959125+0000","last_unstale":"2023-12-20T04:45:10.086150+0000","last_undegraded":"2023-12-20T04:45:10.086150+0000","last_fullsized":"2023-12-20T04:45:10.086150+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:38:45.340767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.21","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.945497+0000","last_change":"2023-12-20T04:45:08.955105+0000","last_active":"2023-12-20T04:45:09.945497+0000","last_peered":"2023-12-20T04:45:09.945497+0000","last_clean":"2023-12-20T04:45:09.945497+0000","last_became_active":"2023-12-20T04:45:08.954890+0000","last_became_peered":"2023-12-20T04:45:08.954890+0000","last_unstale":"2023-12-20T04:45:09.945497+0000","last_undegraded":"2023-12-20T04:45:09.945497+0000","last_fullsized":"2023-12-20T04:45:09.945497+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:34:00.916344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"9.20","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950534+0000","last_change":"2023-12-20T04:45:08.955764+0000","last_active":"2023-12-20T04:45:09.950534+0000","last_peered":"2023-12-20T04:45:09.950534+0000","last_clean":"2023-12-20T04:45:09.950534+0000","last_became_active":"2023-12-20T04:45:08.955478+0000","last_became_peered":"2023-12-20T04:45:08.955478+0000","last_unstale":"2023-12-20T04:45:09.950534+0000","last_undegraded":"2023-12-20T04:45:09.950534+0000","last_fullsized":"2023-12-20T04:45:09.950534+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:26:37.368468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950470+0000","last_change":"2023-12-20T04:45:08.956949+0000","last_active":"2023-12-20T04:45:09.950470+0000","last_peered":"2023-12-20T04:45:09.950470+0000","last_clean":"2023-12-20T04:45:09.950470+0000","last_became_active":"2023-12-20T04:45:08.956743+0000","last_became_peered":"2023-12-20T04:45:08.956743+0000","last_unstale":"2023-12-20T04:45:09.950470+0000","last_undegraded":"2023-12-20T04:45:09.950470+0000","last_fullsized":"2023-12-20T04:45:09.950470+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:49:38.193749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1f","version":"64'4","reported_seq":15,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950544+0000","last_change":"2023-12-20T04:45:08.598268+0000","last_active":"2023-12-20T04:45:09.950544+0000","last_peered":"2023-12-20T04:45:09.950544+0000","last_clean":"2023-12-20T04:45:09.950544+0000","last_became_active":"2023-12-20T04:45:08.597589+0000","last_became_peered":"2023-12-20T04:45:08.597589+0000","last_unstale":"2023-12-20T04:45:09.950544+0000","last_undegraded":"2023-12-20T04:45:09.950544+0000","last_fullsized":"2023-12-20T04:45:09.950544+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:03:21.542554+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085758+0000","last_change":"2023-12-20T04:45:08.958522+0000","last_active":"2023-12-20T04:45:10.085758+0000","last_peered":"2023-12-20T04:45:10.085758+0000","last_clean":"2023-12-20T04:45:10.085758+0000","last_became_active":"2023-12-20T04:45:08.958271+0000","last_became_peered":"2023-12-20T04:45:08.958271+0000","last_unstale":"2023-12-20T04:45:10.085758+0000","last_undegraded":"2023-12-20T04:45:10.085758+0000","last_fullsized":"2023-12-20T04:45:10.085758+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:25:41.248153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1e","version":"64'1","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085794+0000","last_change":"2023-12-20T04:45:08.606384+0000","last_active":"2023-12-20T04:45:10.085794+0000","last_peered":"2023-12-20T04:45:10.085794+0000","last_clean":"2023-12-20T04:45:10.085794+0000","last_became_active":"2023-12-20T04:45:08.605666+0000","last_became_peered":"2023-12-20T04:45:08.605666+0000","last_unstale":"2023-12-20T04:45:10.085794+0000","last_undegraded":"2023-12-20T04:45:10.085794+0000","last_fullsized":"2023-12-20T04:45:10.085794+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:22:21.413222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.1c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950670+0000","last_change":"2023-12-20T04:45:08.946328+0000","last_active":"2023-12-20T04:45:09.950670+0000","last_peered":"2023-12-20T04:45:09.950670+0000","last_clean":"2023-12-20T04:45:09.950670+0000","last_became_active":"2023-12-20T04:45:08.946126+0000","last_became_peered":"2023-12-20T04:45:08.946126+0000","last_unstale":"2023-12-20T04:45:09.950670+0000","last_undegraded":"2023-12-20T04:45:09.950670+0000","last_fullsized":"2023-12-20T04:45:09.950670+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:30:04.146950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1d","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950649+0000","last_change":"2023-12-20T04:45:08.598116+0000","last_active":"2023-12-20T04:45:09.950649+0000","last_peered":"2023-12-20T04:45:09.950649+0000","last_clean":"2023-12-20T04:45:09.950649+0000","last_became_active":"2023-12-20T04:45:08.597711+0000","last_became_peered":"2023-12-20T04:45:08.597711+0000","last_unstale":"2023-12-20T04:45:09.950649+0000","last_undegraded":"2023-12-20T04:45:09.950649+0000","last_fullsized":"2023-12-20T04:45:09.950649+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:26:10.858573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.1d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950470+0000","last_change":"2023-12-20T04:45:08.953040+0000","last_active":"2023-12-20T04:45:09.950470+0000","last_peered":"2023-12-20T04:45:09.950470+0000","last_clean":"2023-12-20T04:45:09.950470+0000","last_became_active":"2023-12-20T04:45:08.952835+0000","last_became_peered":"2023-12-20T04:45:08.952835+0000","last_unstale":"2023-12-20T04:45:09.950470+0000","last_undegraded":"2023-12-20T04:45:09.950470+0000","last_fullsized":"2023-12-20T04:45:09.950470+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:09:36.814759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.1c","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086751+0000","last_change":"2023-12-20T04:45:08.605938+0000","last_active":"2023-12-20T04:45:10.086751+0000","last_peered":"2023-12-20T04:45:10.086751+0000","last_clean":"2023-12-20T04:45:10.086751+0000","last_became_active":"2023-12-20T04:45:08.605375+0000","last_became_peered":"2023-12-20T04:45:08.605375+0000","last_unstale":"2023-12-20T04:45:10.086751+0000","last_undegraded":"2023-12-20T04:45:10.086751+0000","last_fullsized":"2023-12-20T04:45:10.086751+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:43:07.975757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.1a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086274+0000","last_change":"2023-12-20T04:45:08.954292+0000","last_active":"2023-12-20T04:45:10.086274+0000","last_peered":"2023-12-20T04:45:10.086274+0000","last_clean":"2023-12-20T04:45:10.086274+0000","last_became_active":"2023-12-20T04:45:08.954053+0000","last_became_peered":"2023-12-20T04:45:08.954053+0000","last_unstale":"2023-12-20T04:45:10.086274+0000","last_undegraded":"2023-12-20T04:45:10.086274+0000","last_fullsized":"2023-12-20T04:45:10.086274+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:13:25.005512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"64'1","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950691+0000","last_change":"2023-12-20T04:45:08.605720+0000","last_active":"2023-12-20T04:45:09.950691+0000","last_peered":"2023-12-20T04:45:09.950691+0000","last_clean":"2023-12-20T04:45:09.950691+0000","last_became_active":"2023-12-20T04:45:08.604763+0000","last_became_peered":"2023-12-20T04:45:08.604763+0000","last_unstale":"2023-12-20T04:45:09.950691+0000","last_undegraded":"2023-12-20T04:45:09.950691+0000","last_fullsized":"2023-12-20T04:45:09.950691+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:07:23.276222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.1b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085986+0000","last_change":"2023-12-20T04:45:08.955801+0000","last_active":"2023-12-20T04:45:10.085986+0000","last_peered":"2023-12-20T04:45:10.085986+0000","last_clean":"2023-12-20T04:45:10.085986+0000","last_became_active":"2023-12-20T04:45:08.954581+0000","last_became_peered":"2023-12-20T04:45:08.954581+0000","last_unstale":"2023-12-20T04:45:10.085986+0000","last_undegraded":"2023-12-20T04:45:10.085986+0000","last_fullsized":"2023-12-20T04:45:10.085986+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:06:27.829962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1a","version":"64'1","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950629+0000","last_change":"2023-12-20T04:45:08.601706+0000","last_active":"2023-12-20T04:45:09.950629+0000","last_peered":"2023-12-20T04:45:09.950629+0000","last_clean":"2023-12-20T04:45:09.950629+0000","last_became_active":"2023-12-20T04:45:08.600376+0000","last_became_peered":"2023-12-20T04:45:08.600376+0000","last_unstale":"2023-12-20T04:45:09.950629+0000","last_undegraded":"2023-12-20T04:45:09.950629+0000","last_fullsized":"2023-12-20T04:45:09.950629+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:47:37.942050+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.18","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086951+0000","last_change":"2023-12-20T04:45:08.958829+0000","last_active":"2023-12-20T04:45:10.086951+0000","last_peered":"2023-12-20T04:45:10.086951+0000","last_clean":"2023-12-20T04:45:10.086951+0000","last_became_active":"2023-12-20T04:45:08.958528+0000","last_became_peered":"2023-12-20T04:45:08.958528+0000","last_unstale":"2023-12-20T04:45:10.086951+0000","last_undegraded":"2023-12-20T04:45:10.086951+0000","last_fullsized":"2023-12-20T04:45:10.086951+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:58:46.618096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086880+0000","last_change":"2023-12-20T04:45:08.602633+0000","last_active":"2023-12-20T04:45:10.086880+0000","last_peered":"2023-12-20T04:45:10.086880+0000","last_clean":"2023-12-20T04:45:10.086880+0000","last_became_active":"2023-12-20T04:45:08.602385+0000","last_became_peered":"2023-12-20T04:45:08.602385+0000","last_unstale":"2023-12-20T04:45:10.086880+0000","last_undegraded":"2023-12-20T04:45:10.086880+0000","last_fullsized":"2023-12-20T04:45:10.086880+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:23:16.833856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.19","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085722+0000","last_change":"2023-12-20T04:45:08.955332+0000","last_active":"2023-12-20T04:45:10.085722+0000","last_peered":"2023-12-20T04:45:10.085722+0000","last_clean":"2023-12-20T04:45:10.085722+0000","last_became_active":"2023-12-20T04:45:08.955122+0000","last_became_peered":"2023-12-20T04:45:08.955122+0000","last_unstale":"2023-12-20T04:45:10.085722+0000","last_undegraded":"2023-12-20T04:45:10.085722+0000","last_fullsized":"2023-12-20T04:45:10.085722+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:45:14.944677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950746+0000","last_change":"2023-12-20T04:45:08.607180+0000","last_active":"2023-12-20T04:45:09.950746+0000","last_peered":"2023-12-20T04:45:09.950746+0000","last_clean":"2023-12-20T04:45:09.950746+0000","last_became_active":"2023-12-20T04:45:08.606947+0000","last_became_peered":"2023-12-20T04:45:08.606947+0000","last_unstale":"2023-12-20T04:45:09.950746+0000","last_undegraded":"2023-12-20T04:45:09.950746+0000","last_fullsized":"2023-12-20T04:45:09.950746+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:47:36.773729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.16","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950604+0000","last_change":"2023-12-20T04:45:08.950477+0000","last_active":"2023-12-20T04:45:09.950604+0000","last_peered":"2023-12-20T04:45:09.950604+0000","last_clean":"2023-12-20T04:45:09.950604+0000","last_became_active":"2023-12-20T04:45:08.949412+0000","last_became_peered":"2023-12-20T04:45:08.949412+0000","last_unstale":"2023-12-20T04:45:09.950604+0000","last_undegraded":"2023-12-20T04:45:09.950604+0000","last_fullsized":"2023-12-20T04:45:09.950604+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:36:06.687639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086656+0000","last_change":"2023-12-20T04:45:08.607996+0000","last_active":"2023-12-20T04:45:10.086656+0000","last_peered":"2023-12-20T04:45:10.086656+0000","last_clean":"2023-12-20T04:45:10.086656+0000","last_became_active":"2023-12-20T04:45:08.607516+0000","last_became_peered":"2023-12-20T04:45:08.607516+0000","last_unstale":"2023-12-20T04:45:10.086656+0000","last_undegraded":"2023-12-20T04:45:10.086656+0000","last_fullsized":"2023-12-20T04:45:10.086656+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:22:06.759303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.17","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086177+0000","last_change":"2023-12-20T04:45:08.961795+0000","last_active":"2023-12-20T04:45:10.086177+0000","last_peered":"2023-12-20T04:45:10.086177+0000","last_clean":"2023-12-20T04:45:10.086177+0000","last_became_active":"2023-12-20T04:45:08.961208+0000","last_became_peered":"2023-12-20T04:45:08.961208+0000","last_unstale":"2023-12-20T04:45:10.086177+0000","last_undegraded":"2023-12-20T04:45:10.086177+0000","last_fullsized":"2023-12-20T04:45:10.086177+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:19:43.758722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086385+0000","last_change":"2023-12-20T04:45:08.603602+0000","last_active":"2023-12-20T04:45:10.086385+0000","last_peered":"2023-12-20T04:45:10.086385+0000","last_clean":"2023-12-20T04:45:10.086385+0000","last_became_active":"2023-12-20T04:45:08.601446+0000","last_became_peered":"2023-12-20T04:45:08.601446+0000","last_unstale":"2023-12-20T04:45:10.086385+0000","last_undegraded":"2023-12-20T04:45:10.086385+0000","last_fullsized":"2023-12-20T04:45:10.086385+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:27:36.314259+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.14","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085699+0000","last_change":"2023-12-20T04:45:08.948767+0000","last_active":"2023-12-20T04:45:10.085699+0000","last_peered":"2023-12-20T04:45:10.085699+0000","last_clean":"2023-12-20T04:45:10.085699+0000","last_became_active":"2023-12-20T04:45:08.948547+0000","last_became_peered":"2023-12-20T04:45:08.948547+0000","last_unstale":"2023-12-20T04:45:10.085699+0000","last_undegraded":"2023-12-20T04:45:10.085699+0000","last_fullsized":"2023-12-20T04:45:10.085699+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:47:54.809615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.15","version":"64'3","reported_seq":14,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086459+0000","last_change":"2023-12-20T04:45:08.605661+0000","last_active":"2023-12-20T04:45:10.086459+0000","last_peered":"2023-12-20T04:45:10.086459+0000","last_clean":"2023-12-20T04:45:10.086459+0000","last_became_active":"2023-12-20T04:45:08.605443+0000","last_became_peered":"2023-12-20T04:45:08.605443+0000","last_unstale":"2023-12-20T04:45:10.086459+0000","last_undegraded":"2023-12-20T04:45:10.086459+0000","last_fullsized":"2023-12-20T04:45:10.086459+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:07:23.276222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.15","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086361+0000","last_change":"2023-12-20T04:45:08.959818+0000","last_active":"2023-12-20T04:45:10.086361+0000","last_peered":"2023-12-20T04:45:10.086361+0000","last_clean":"2023-12-20T04:45:10.086361+0000","last_became_active":"2023-12-20T04:45:08.959052+0000","last_became_peered":"2023-12-20T04:45:08.959052+0000","last_unstale":"2023-12-20T04:45:10.086361+0000","last_undegraded":"2023-12-20T04:45:10.086361+0000","last_fullsized":"2023-12-20T04:45:10.086361+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:32:23.738520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.14","version":"64'6","reported_seq":17,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950636+0000","last_change":"2023-12-20T04:45:08.605526+0000","last_active":"2023-12-20T04:45:09.950636+0000","last_peered":"2023-12-20T04:45:09.950636+0000","last_clean":"2023-12-20T04:45:09.950636+0000","last_became_active":"2023-12-20T04:45:08.605118+0000","last_became_peered":"2023-12-20T04:45:08.605118+0000","last_unstale":"2023-12-20T04:45:09.950636+0000","last_undegraded":"2023-12-20T04:45:09.950636+0000","last_fullsized":"2023-12-20T04:45:09.950636+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:23:16.833856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.12","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086592+0000","last_change":"2023-12-20T04:45:08.955311+0000","last_active":"2023-12-20T04:45:10.086592+0000","last_peered":"2023-12-20T04:45:10.086592+0000","last_clean":"2023-12-20T04:45:10.086592+0000","last_became_active":"2023-12-20T04:45:08.954873+0000","last_became_peered":"2023-12-20T04:45:08.954873+0000","last_unstale":"2023-12-20T04:45:10.086592+0000","last_undegraded":"2023-12-20T04:45:10.086592+0000","last_fullsized":"2023-12-20T04:45:10.086592+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:24:46.645891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085877+0000","last_change":"2023-12-20T04:45:08.600304+0000","last_active":"2023-12-20T04:45:10.085877+0000","last_peered":"2023-12-20T04:45:10.085877+0000","last_clean":"2023-12-20T04:45:10.085877+0000","last_became_active":"2023-12-20T04:45:08.600087+0000","last_became_peered":"2023-12-20T04:45:08.600087+0000","last_unstale":"2023-12-20T04:45:10.085877+0000","last_undegraded":"2023-12-20T04:45:10.085877+0000","last_fullsized":"2023-12-20T04:45:10.085877+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:37:45.396905+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.13","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086338+0000","last_change":"2023-12-20T04:45:08.961256+0000","last_active":"2023-12-20T04:45:10.086338+0000","last_peered":"2023-12-20T04:45:10.086338+0000","last_clean":"2023-12-20T04:45:10.086338+0000","last_became_active":"2023-12-20T04:45:08.961022+0000","last_became_peered":"2023-12-20T04:45:08.961022+0000","last_unstale":"2023-12-20T04:45:10.086338+0000","last_undegraded":"2023-12-20T04:45:10.086338+0000","last_fullsized":"2023-12-20T04:45:10.086338+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:38:00.630473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086624+0000","last_change":"2023-12-20T04:45:08.603757+0000","last_active":"2023-12-20T04:45:10.086624+0000","last_peered":"2023-12-20T04:45:10.086624+0000","last_clean":"2023-12-20T04:45:10.086624+0000","last_became_active":"2023-12-20T04:45:08.603517+0000","last_became_peered":"2023-12-20T04:45:08.603517+0000","last_unstale":"2023-12-20T04:45:10.086624+0000","last_undegraded":"2023-12-20T04:45:10.086624+0000","last_fullsized":"2023-12-20T04:45:10.086624+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:22:18.111612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.10","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950426+0000","last_change":"2023-12-20T04:45:08.961275+0000","last_active":"2023-12-20T04:45:09.950426+0000","last_peered":"2023-12-20T04:45:09.950426+0000","last_clean":"2023-12-20T04:45:09.950426+0000","last_became_active":"2023-12-20T04:45:08.961058+0000","last_became_peered":"2023-12-20T04:45:08.961058+0000","last_unstale":"2023-12-20T04:45:09.950426+0000","last_undegraded":"2023-12-20T04:45:09.950426+0000","last_fullsized":"2023-12-20T04:45:09.950426+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:25:41.248153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086914+0000","last_change":"2023-12-20T04:45:08.603058+0000","last_active":"2023-12-20T04:45:10.086914+0000","last_peered":"2023-12-20T04:45:10.086914+0000","last_clean":"2023-12-20T04:45:10.086914+0000","last_became_active":"2023-12-20T04:45:08.602774+0000","last_became_peered":"2023-12-20T04:45:08.602774+0000","last_unstale":"2023-12-20T04:45:10.086914+0000","last_undegraded":"2023-12-20T04:45:10.086914+0000","last_fullsized":"2023-12-20T04:45:10.086914+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:44:59.705016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.11","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086093+0000","last_change":"2023-12-20T04:45:08.960772+0000","last_active":"2023-12-20T04:45:10.086093+0000","last_peered":"2023-12-20T04:45:10.086093+0000","last_clean":"2023-12-20T04:45:10.086093+0000","last_became_active":"2023-12-20T04:45:08.960517+0000","last_became_peered":"2023-12-20T04:45:08.960517+0000","last_unstale":"2023-12-20T04:45:10.086093+0000","last_undegraded":"2023-12-20T04:45:10.086093+0000","last_fullsized":"2023-12-20T04:45:10.086093+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:10:43.052927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.10","version":"64'8","reported_seq":19,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086554+0000","last_change":"2023-12-20T04:45:08.606700+0000","last_active":"2023-12-20T04:45:10.086554+0000","last_peered":"2023-12-20T04:45:10.086554+0000","last_clean":"2023-12-20T04:45:10.086554+0000","last_became_active":"2023-12-20T04:45:08.606449+0000","last_became_peered":"2023-12-20T04:45:08.606449+0000","last_unstale":"2023-12-20T04:45:10.086554+0000","last_undegraded":"2023-12-20T04:45:10.086554+0000","last_fullsized":"2023-12-20T04:45:10.086554+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:23:16.833856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"9.e","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086436+0000","last_change":"2023-12-20T04:45:08.960382+0000","last_active":"2023-12-20T04:45:10.086436+0000","last_peered":"2023-12-20T04:45:10.086436+0000","last_clean":"2023-12-20T04:45:10.086436+0000","last_became_active":"2023-12-20T04:45:08.960137+0000","last_became_peered":"2023-12-20T04:45:08.960137+0000","last_unstale":"2023-12-20T04:45:10.086436+0000","last_undegraded":"2023-12-20T04:45:10.086436+0000","last_fullsized":"2023-12-20T04:45:10.086436+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:30:04.146950+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.f","version":"64'1","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085942+0000","last_change":"2023-12-20T04:45:08.606260+0000","last_active":"2023-12-20T04:45:10.085942+0000","last_peered":"2023-12-20T04:45:10.085942+0000","last_clean":"2023-12-20T04:45:10.085942+0000","last_became_active":"2023-12-20T04:45:08.605358+0000","last_became_peered":"2023-12-20T04:45:08.605358+0000","last_unstale":"2023-12-20T04:45:10.085942+0000","last_undegraded":"2023-12-20T04:45:10.085942+0000","last_fullsized":"2023-12-20T04:45:10.085942+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:36:05.683727+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.f","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086502+0000","last_change":"2023-12-20T04:45:08.953524+0000","last_active":"2023-12-20T04:45:10.086502+0000","last_peered":"2023-12-20T04:45:10.086502+0000","last_clean":"2023-12-20T04:45:10.086502+0000","last_became_active":"2023-12-20T04:45:08.953194+0000","last_became_peered":"2023-12-20T04:45:08.953194+0000","last_unstale":"2023-12-20T04:45:10.086502+0000","last_undegraded":"2023-12-20T04:45:10.086502+0000","last_fullsized":"2023-12-20T04:45:10.086502+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:40:39.035859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.e","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950701+0000","last_change":"2023-12-20T04:45:08.599091+0000","last_active":"2023-12-20T04:45:09.950701+0000","last_peered":"2023-12-20T04:45:09.950701+0000","last_clean":"2023-12-20T04:45:09.950701+0000","last_became_active":"2023-12-20T04:45:08.598869+0000","last_became_peered":"2023-12-20T04:45:08.598869+0000","last_unstale":"2023-12-20T04:45:09.950701+0000","last_undegraded":"2023-12-20T04:45:09.950701+0000","last_fullsized":"2023-12-20T04:45:09.950701+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:40:50.459725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.c","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086072+0000","last_change":"2023-12-20T04:45:08.959720+0000","last_active":"2023-12-20T04:45:10.086072+0000","last_peered":"2023-12-20T04:45:10.086072+0000","last_clean":"2023-12-20T04:45:10.086072+0000","last_became_active":"2023-12-20T04:45:08.958074+0000","last_became_peered":"2023-12-20T04:45:08.958074+0000","last_unstale":"2023-12-20T04:45:10.086072+0000","last_undegraded":"2023-12-20T04:45:10.086072+0000","last_fullsized":"2023-12-20T04:45:10.086072+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:03:41.608824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"64'1","reported_seq":12,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086848+0000","last_change":"2023-12-20T04:45:08.605612+0000","last_active":"2023-12-20T04:45:10.086848+0000","last_peered":"2023-12-20T04:45:10.086848+0000","last_clean":"2023-12-20T04:45:10.086848+0000","last_became_active":"2023-12-20T04:45:08.604526+0000","last_became_peered":"2023-12-20T04:45:08.604526+0000","last_unstale":"2023-12-20T04:45:10.086848+0000","last_undegraded":"2023-12-20T04:45:10.086848+0000","last_fullsized":"2023-12-20T04:45:10.086848+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:22:06.759303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.d","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086282+0000","last_change":"2023-12-20T04:45:08.961932+0000","last_active":"2023-12-20T04:45:10.086282+0000","last_peered":"2023-12-20T04:45:10.086282+0000","last_clean":"2023-12-20T04:45:10.086282+0000","last_became_active":"2023-12-20T04:45:08.961548+0000","last_became_peered":"2023-12-20T04:45:08.961548+0000","last_unstale":"2023-12-20T04:45:10.086282+0000","last_undegraded":"2023-12-20T04:45:10.086282+0000","last_fullsized":"2023-12-20T04:45:10.086282+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:09:36.814759+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950626+0000","last_change":"2023-12-20T04:45:08.603261+0000","last_active":"2023-12-20T04:45:09.950626+0000","last_peered":"2023-12-20T04:45:09.950626+0000","last_clean":"2023-12-20T04:45:09.950626+0000","last_became_active":"2023-12-20T04:45:08.602644+0000","last_became_peered":"2023-12-20T04:45:08.602644+0000","last_unstale":"2023-12-20T04:45:09.950626+0000","last_undegraded":"2023-12-20T04:45:09.950626+0000","last_fullsized":"2023-12-20T04:45:09.950626+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:58:45.614184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.a","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086664+0000","last_change":"2023-12-20T04:45:08.954027+0000","last_active":"2023-12-20T04:45:10.086664+0000","last_peered":"2023-12-20T04:45:10.086664+0000","last_clean":"2023-12-20T04:45:10.086664+0000","last_became_active":"2023-12-20T04:45:08.953822+0000","last_became_peered":"2023-12-20T04:45:08.953822+0000","last_unstale":"2023-12-20T04:45:10.086664+0000","last_undegraded":"2023-12-20T04:45:10.086664+0000","last_fullsized":"2023-12-20T04:45:10.086664+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:22:22.417135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.b","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086349+0000","last_change":"2023-12-20T04:45:08.604733+0000","last_active":"2023-12-20T04:45:10.086349+0000","last_peered":"2023-12-20T04:45:10.086349+0000","last_clean":"2023-12-20T04:45:10.086349+0000","last_became_active":"2023-12-20T04:45:08.604492+0000","last_became_peered":"2023-12-20T04:45:08.604492+0000","last_unstale":"2023-12-20T04:45:10.086349+0000","last_undegraded":"2023-12-20T04:45:10.086349+0000","last_fullsized":"2023-12-20T04:45:10.086349+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:24:45.641978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.b","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950461+0000","last_change":"2023-12-20T04:45:08.957557+0000","last_active":"2023-12-20T04:45:09.950461+0000","last_peered":"2023-12-20T04:45:09.950461+0000","last_clean":"2023-12-20T04:45:09.950461+0000","last_became_active":"2023-12-20T04:45:08.957243+0000","last_became_peered":"2023-12-20T04:45:08.957243+0000","last_unstale":"2023-12-20T04:45:09.950461+0000","last_undegraded":"2023-12-20T04:45:09.950461+0000","last_fullsized":"2023-12-20T04:45:09.950461+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:31:04.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085850+0000","last_change":"2023-12-20T04:45:08.603112+0000","last_active":"2023-12-20T04:45:10.085850+0000","last_peered":"2023-12-20T04:45:10.085850+0000","last_clean":"2023-12-20T04:45:10.085850+0000","last_became_active":"2023-12-20T04:45:08.602227+0000","last_became_peered":"2023-12-20T04:45:08.602227+0000","last_unstale":"2023-12-20T04:45:10.085850+0000","last_undegraded":"2023-12-20T04:45:10.085850+0000","last_fullsized":"2023-12-20T04:45:10.085850+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:22:06.759303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.9","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950560+0000","last_change":"2023-12-20T04:45:08.956991+0000","last_active":"2023-12-20T04:45:09.950560+0000","last_peered":"2023-12-20T04:45:09.950560+0000","last_clean":"2023-12-20T04:45:09.950560+0000","last_became_active":"2023-12-20T04:45:08.956722+0000","last_became_peered":"2023-12-20T04:45:08.956722+0000","last_unstale":"2023-12-20T04:45:09.950560+0000","last_undegraded":"2023-12-20T04:45:09.950560+0000","last_fullsized":"2023-12-20T04:45:09.950560+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:13:25.005512+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086938+0000","last_change":"2023-12-20T04:45:08.603254+0000","last_active":"2023-12-20T04:45:10.086938+0000","last_peered":"2023-12-20T04:45:10.086938+0000","last_clean":"2023-12-20T04:45:10.086938+0000","last_became_active":"2023-12-20T04:45:08.601771+0000","last_became_peered":"2023-12-20T04:45:08.601771+0000","last_unstale":"2023-12-20T04:45:10.086938+0000","last_undegraded":"2023-12-20T04:45:10.086938+0000","last_fullsized":"2023-12-20T04:45:10.086938+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:47:36.773729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.6","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086110+0000","last_change":"2023-12-20T04:45:08.949159+0000","last_active":"2023-12-20T04:45:10.086110+0000","last_peered":"2023-12-20T04:45:10.086110+0000","last_clean":"2023-12-20T04:45:10.086110+0000","last_became_active":"2023-12-20T04:45:08.948922+0000","last_became_peered":"2023-12-20T04:45:08.948922+0000","last_unstale":"2023-12-20T04:45:10.086110+0000","last_undegraded":"2023-12-20T04:45:10.086110+0000","last_fullsized":"2023-12-20T04:45:10.086110+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:36:06.687639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.7","version":"64'2","reported_seq":13,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085822+0000","last_change":"2023-12-20T04:45:08.602804+0000","last_active":"2023-12-20T04:45:10.085822+0000","last_peered":"2023-12-20T04:45:10.085822+0000","last_clean":"2023-12-20T04:45:10.085822+0000","last_became_active":"2023-12-20T04:45:08.602561+0000","last_became_peered":"2023-12-20T04:45:08.602561+0000","last_unstale":"2023-12-20T04:45:10.085822+0000","last_undegraded":"2023-12-20T04:45:10.085822+0000","last_fullsized":"2023-12-20T04:45:10.085822+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:44:59.705016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.7","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086808+0000","last_change":"2023-12-20T04:45:08.958371+0000","last_active":"2023-12-20T04:45:10.086808+0000","last_peered":"2023-12-20T04:45:10.086808+0000","last_clean":"2023-12-20T04:45:10.086808+0000","last_became_active":"2023-12-20T04:45:08.957787+0000","last_became_peered":"2023-12-20T04:45:08.957787+0000","last_unstale":"2023-12-20T04:45:10.086808+0000","last_undegraded":"2023-12-20T04:45:10.086808+0000","last_fullsized":"2023-12-20T04:45:10.086808+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:37:46.400818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950681+0000","last_change":"2023-12-20T04:45:08.601972+0000","last_active":"2023-12-20T04:45:09.950681+0000","last_peered":"2023-12-20T04:45:09.950681+0000","last_clean":"2023-12-20T04:45:09.950681+0000","last_became_active":"2023-12-20T04:45:08.601155+0000","last_became_peered":"2023-12-20T04:45:08.601155+0000","last_unstale":"2023-12-20T04:45:09.950681+0000","last_undegraded":"2023-12-20T04:45:09.950681+0000","last_fullsized":"2023-12-20T04:45:09.950681+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:59:54.012978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"9.4","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086166+0000","last_change":"2023-12-20T04:45:08.950353+0000","last_active":"2023-12-20T04:45:10.086166+0000","last_peered":"2023-12-20T04:45:10.086166+0000","last_clean":"2023-12-20T04:45:10.086166+0000","last_became_active":"2023-12-20T04:45:08.949651+0000","last_became_peered":"2023-12-20T04:45:08.949651+0000","last_unstale":"2023-12-20T04:45:10.086166+0000","last_undegraded":"2023-12-20T04:45:10.086166+0000","last_fullsized":"2023-12-20T04:45:10.086166+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:10:43.052927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086990+0000","last_change":"2023-12-20T04:45:08.604456+0000","last_active":"2023-12-20T04:45:10.086990+0000","last_peered":"2023-12-20T04:45:10.086990+0000","last_clean":"2023-12-20T04:45:10.086990+0000","last_became_active":"2023-12-20T04:45:08.604188+0000","last_became_peered":"2023-12-20T04:45:08.604188+0000","last_unstale":"2023-12-20T04:45:10.086990+0000","last_undegraded":"2023-12-20T04:45:10.086990+0000","last_fullsized":"2023-12-20T04:45:10.086990+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:44:59.705016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"9.5","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950563+0000","last_change":"2023-12-20T04:45:08.954163+0000","last_active":"2023-12-20T04:45:09.950563+0000","last_peered":"2023-12-20T04:45:09.950563+0000","last_clean":"2023-12-20T04:45:09.950563+0000","last_became_active":"2023-12-20T04:45:08.953260+0000","last_became_peered":"2023-12-20T04:45:08.953260+0000","last_unstale":"2023-12-20T04:45:09.950563+0000","last_undegraded":"2023-12-20T04:45:09.950563+0000","last_fullsized":"2023-12-20T04:45:09.950563+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:32:23.738520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086419+0000","last_change":"2023-12-20T04:45:08.603556+0000","last_active":"2023-12-20T04:45:10.086419+0000","last_peered":"2023-12-20T04:45:10.086419+0000","last_clean":"2023-12-20T04:45:10.086419+0000","last_became_active":"2023-12-20T04:45:08.603317+0000","last_became_peered":"2023-12-20T04:45:08.603317+0000","last_unstale":"2023-12-20T04:45:10.086419+0000","last_undegraded":"2023-12-20T04:45:10.086419+0000","last_fullsized":"2023-12-20T04:45:10.086419+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:07:23.276222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"9.2","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086221+0000","last_change":"2023-12-20T04:45:08.959587+0000","last_active":"2023-12-20T04:45:10.086221+0000","last_peered":"2023-12-20T04:45:10.086221+0000","last_clean":"2023-12-20T04:45:10.086221+0000","last_became_active":"2023-12-20T04:45:08.957583+0000","last_became_peered":"2023-12-20T04:45:08.957583+0000","last_unstale":"2023-12-20T04:45:10.086221+0000","last_undegraded":"2023-12-20T04:45:10.086221+0000","last_fullsized":"2023-12-20T04:45:10.086221+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:29:06.557612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086269+0000","last_change":"2023-12-20T04:45:08.599111+0000","last_active":"2023-12-20T04:45:10.086269+0000","last_peered":"2023-12-20T04:45:10.086269+0000","last_clean":"2023-12-20T04:45:10.086269+0000","last_became_active":"2023-12-20T04:45:08.598893+0000","last_became_peered":"2023-12-20T04:45:08.598893+0000","last_unstale":"2023-12-20T04:45:10.086269+0000","last_undegraded":"2023-12-20T04:45:10.086269+0000","last_fullsized":"2023-12-20T04:45:10.086269+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:23:16.833856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.3","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086379+0000","last_change":"2023-12-20T04:45:08.959751+0000","last_active":"2023-12-20T04:45:10.086379+0000","last_peered":"2023-12-20T04:45:10.086379+0000","last_clean":"2023-12-20T04:45:10.086379+0000","last_became_active":"2023-12-20T04:45:08.958617+0000","last_became_peered":"2023-12-20T04:45:08.958617+0000","last_unstale":"2023-12-20T04:45:10.086379+0000","last_undegraded":"2023-12-20T04:45:10.086379+0000","last_fullsized":"2023-12-20T04:45:10.086379+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:31:04.493141+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:09.950764+0000","last_change":"2023-12-20T04:45:08.606046+0000","last_active":"2023-12-20T04:45:09.950764+0000","last_peered":"2023-12-20T04:45:09.950764+0000","last_clean":"2023-12-20T04:45:09.950764+0000","last_became_active":"2023-12-20T04:45:08.605436+0000","last_became_peered":"2023-12-20T04:45:08.605436+0000","last_unstale":"2023-12-20T04:45:09.950764+0000","last_undegraded":"2023-12-20T04:45:09.950764+0000","last_fullsized":"2023-12-20T04:45:09.950764+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:22:06.759303+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"9.0","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085779+0000","last_change":"2023-12-20T04:45:08.955695+0000","last_active":"2023-12-20T04:45:10.085779+0000","last_peered":"2023-12-20T04:45:10.085779+0000","last_clean":"2023-12-20T04:45:10.085779+0000","last_became_active":"2023-12-20T04:45:08.955250+0000","last_became_peered":"2023-12-20T04:45:08.955250+0000","last_unstale":"2023-12-20T04:45:10.085779+0000","last_undegraded":"2023-12-20T04:45:10.085779+0000","last_fullsized":"2023-12-20T04:45:10.085779+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:26:11.862486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.085829+0000","last_change":"2023-12-20T04:45:08.598960+0000","last_active":"2023-12-20T04:45:10.085829+0000","last_peered":"2023-12-20T04:45:10.085829+0000","last_clean":"2023-12-20T04:45:10.085829+0000","last_became_active":"2023-12-20T04:45:08.598704+0000","last_became_peered":"2023-12-20T04:45:08.598704+0000","last_unstale":"2023-12-20T04:45:10.085829+0000","last_undegraded":"2023-12-20T04:45:10.085829+0000","last_fullsized":"2023-12-20T04:45:10.085829+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:22:18.111612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"9.1","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086145+0000","last_change":"2023-12-20T04:45:08.957138+0000","last_active":"2023-12-20T04:45:10.086145+0000","last_peered":"2023-12-20T04:45:10.086145+0000","last_clean":"2023-12-20T04:45:10.086145+0000","last_became_active":"2023-12-20T04:45:08.956923+0000","last_became_peered":"2023-12-20T04:45:08.956923+0000","last_unstale":"2023-12-20T04:45:10.086145+0000","last_undegraded":"2023-12-20T04:45:10.086145+0000","last_fullsized":"2023-12-20T04:45:10.086145+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:48:51.877954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086011+0000","last_change":"2023-12-20T04:45:08.606529+0000","last_active":"2023-12-20T04:45:10.086011+0000","last_peered":"2023-12-20T04:45:10.086011+0000","last_clean":"2023-12-20T04:45:10.086011+0000","last_became_active":"2023-12-20T04:45:08.605997+0000","last_became_peered":"2023-12-20T04:45:08.605997+0000","last_unstale":"2023-12-20T04:45:10.086011+0000","last_undegraded":"2023-12-20T04:45:10.086011+0000","last_fullsized":"2023-12-20T04:45:10.086011+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:38:44.336854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"9.8","version":"0'0","reported_seq":10,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.086066+0000","last_change":"2023-12-20T04:45:08.951251+0000","last_active":"2023-12-20T04:45:10.086066+0000","last_peered":"2023-12-20T04:45:10.086066+0000","last_clean":"2023-12-20T04:45:10.086066+0000","last_became_active":"2023-12-20T04:45:08.950959+0000","last_became_peered":"2023-12-20T04:45:08.950959+0000","last_unstale":"2023-12-20T04:45:10.086066+0000","last_undegraded":"2023-12-20T04:45:10.086066+0000","last_fullsized":"2023-12-20T04:45:10.086066+0000","mapping_epoch":63,"log_start":"0'0","ondisk_log_start":"0'0","created":63,"last_epoch_clean":64,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:08.588477+0000","last_clean_scrub_stamp":"2023-12-20T04:45:08.588477+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:42:44.587211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":11,"reported_epoch":65,"state":"active+clean","last_fresh":"2023-12-20T04:45:10.087013+0000","last_change":"2023-12-20T04:45:08.597941+0000","last_active":"2023-12-20T04:45:10.087013+0000","last_peered":"2023-12-20T04:45:10.087013+0000","last_clean":"2023-12-20T04:45:10.087013+0000","last_became_active":"2023-12-20T04:45:08.597673+0000","last_became_peered":"2023-12-20T04:45:08.597673+0000","last_unstale":"2023-12-20T04:45:10.087013+0000","last_undegraded":"2023-12-20T04:45:10.087013+0000","last_fullsized":"2023-12-20T04:45:10.087013+0000","mapping_epoch":62,"log_start":"0'0","ondisk_log_start":"0'0","created":62,"last_epoch_clean":63,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:45:07.584564+0000","last_clean_scrub_stamp":"2023-12-20T04:45:07.584564+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:15:02.019592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":203,"reported_epoch":64,"state":"active+clean","last_fresh":"2023-12-20T04:45:08.953505+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:45:08.953505+0000","last_peered":"2023-12-20T04:45:08.953505+0000","last_clean":"2023-12-20T04:45:08.953505+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:45:08.953505+0000","last_undegraded":"2023-12-20T04:45:08.953505+0000","last_fullsized":"2023-12-20T04:45:08.953505+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":9,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":901,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194410,"statfs":{"total":200000000,"available":199076410,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.37,"5min":0.315,"15min":0.315},"max":{"1min":0.73099999999999998,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.40500000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54900000000000004,"15min":0.54700000000000004},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":0.752,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.47699999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.79700000000000004,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.51200000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.53600000000000003,"15min":0.52800000000000002},"min":{"1min":0.41499999999999998,"5min":0.374,"15min":0.374},"max":{"1min":0.74299999999999999,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54600000000000004,"15min":0.54600000000000004},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.70199999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48899999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.42799999999999999,"5min":0.42799999999999999,"15min":0.42799999999999999},"max":{"1min":0.71999999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.56599999999999995,"15min":0.56200000000000006},"min":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47599999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.498,"15min":0.48999999999999999},"min":{"1min":0.33600000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.628}]},{"osd":5,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.498,"15min":0.496},"min":{"1min":0.33900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.64900000000000002,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.55000000000000004,"15min":0.55000000000000004},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55600000000000005,"15min":0.55800000000000005},"min":{"1min":0.36899999999999999,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.69199999999999995,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54500000000000004,"15min":0.54000000000000004},"min":{"1min":0.35299999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.66300000000000003}]}]},{"osd":6,"up_from":13,"seq":55834574882,"num_pgs":17,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194987,"statfs":{"total":200000000,"available":199666938,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48899999999999999,"15min":0.48999999999999999},"min":{"1min":0.35099999999999998,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":0.78600000000000003,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.59699999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52500000000000002,"15min":0.52200000000000002},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.498},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.627}]},{"osd":2,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52000000000000002,"5min":0.505,"15min":0.503},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.67000000000000004},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.53200000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.496,"15min":0.48799999999999999},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.70399999999999996,"5min":0.70399999999999996,"15min":0.70399999999999996},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.377,"5min":0.377,"15min":0.377},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.42399999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.504,"5min":0.51500000000000001,"15min":0.51700000000000002},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.64900000000000002,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.496,"15min":0.49199999999999999},"min":{"1min":0.36699999999999999,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.64900000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.38700000000000001,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.66400000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55000000000000004,"15min":0.55100000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.71099999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.42799999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.68500000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574881,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194986,"statfs":{"total":200000000,"available":199666286,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:44:43 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.504,"15min":0.501},"min":{"1min":0.29999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67200000000000004,"5min":0.745,"15min":0.745},"last":0.40600000000000003},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.66900000000000004,"5min":0.749,"15min":0.749},"last":0.52600000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:44:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.627,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.69799999999999995,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.49199999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:44:43 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.505,"15min":0.50700000000000001},"min":{"1min":0.33200000000000002,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.64000000000000001,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.51300000000000001,"15min":0.51200000000000001},"min":{"1min":0.41099999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.65600000000000003,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:44:43 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.67000000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.441},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.54100000000000004,"15min":0.53900000000000003},"min":{"1min":0.42199999999999999,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.69399999999999995,"5min":0.70499999999999996,"15min":0.70499999999999996},"last":0.42399999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:44:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.50600000000000001,"15min":0.51200000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.47999999999999998,"15min":0.48199999999999998},"min":{"1min":0.29499999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.629,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.318}]},{"osd":6,"last update":"Wed Dec 20 04:44:43 2023","interfaces":[{"interface":"back","average":{"1min":0.46899999999999997,"5min":0.50800000000000001,"15min":0.51400000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.72199999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.50600000000000001,"5min":0.54100000000000004,"15min":0.54700000000000004},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.71299999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.379}]},{"osd":7,"last update":"Wed Dec 20 04:44:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.53100000000000003,"15min":0.53300000000000003},"min":{"1min":0.34599999999999997,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.748,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.60899999999999999,"15min":0.61499999999999999},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.78100000000000003,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55200000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574881,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":326,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194985,"statfs":{"total":200000000,"available":199665374,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.19700000000000001,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.496,"5min":0.51200000000000001,"15min":0.51400000000000001},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.629,"5min":0.71499999999999997,"15min":0.71499999999999997},"last":0.497}]},{"osd":1,"last update":"Wed Dec 20 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.50900000000000001,"15min":0.50600000000000001},"min":{"1min":0.35399999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.67200000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.499,"5min":0.51900000000000002,"15min":0.52300000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72899999999999998,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.622}]},{"osd":2,"last update":"Wed Dec 20 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.55300000000000005,"15min":0.56000000000000005},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.70899999999999996,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.54500000000000004,"15min":0.55300000000000005},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.628,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.54500000000000004}]},{"osd":3,"last update":"Wed Dec 20 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54800000000000004,"15min":0.54900000000000004},"min":{"1min":0.40600000000000003,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.77700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58399999999999996,"15min":0.58499999999999996},"min":{"1min":0.41499999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.71299999999999997,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.59299999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.439,"5min":0.47599999999999998,"15min":0.48199999999999998},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.63300000000000001,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.50600000000000001,"15min":0.51000000000000001},"min":{"1min":0.311,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.70199999999999996,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.64100000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.50700000000000001,"15min":0.50900000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.72099999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52900000000000003,"15min":0.53700000000000003},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.67400000000000004,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.51700000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:44:37 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.51100000000000001,"15min":0.51300000000000001},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.54600000000000004,"15min":0.54800000000000004},"min":{"1min":0.39600000000000002,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.68000000000000005,"5min":0.753,"15min":0.753},"last":0.55600000000000005}]}]},{"osd":3,"up_from":13,"seq":55834574881,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194987,"statfs":{"total":200000000,"available":199666882,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33500000000000002,"15min":0.33400000000000002},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":0.505,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.36599999999999999,"5min":0.34999999999999998,"15min":0.34799999999999998},"min":{"1min":0.27500000000000002,"5min":0.246,"15min":0.246},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.35699999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.317,"15min":0.315},"min":{"1min":0.24199999999999999,"5min":0.219,"15min":0.219},"max":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.32900000000000001,"15min":0.32700000000000001},"min":{"1min":0.247,"5min":0.217,"15min":0.217},"max":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.36799999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34999999999999998,"5min":0.34399999999999997,"15min":0.34300000000000003},"min":{"1min":0.21199999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.53800000000000003,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.372,"15min":0.36899999999999999},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"last":0.33700000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.53300000000000003,"15min":0.53500000000000003},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70899999999999996,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.36299999999999999,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.72899999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.64100000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.55500000000000005,"15min":0.55300000000000005},"min":{"1min":0.31,"5min":0.31,"15min":0.31},"max":{"1min":0.80000000000000004,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.56599999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.436,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.77200000000000002,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.69499999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.57599999999999996,"15min":0.57999999999999996},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.746,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.55100000000000005},"min":{"1min":0.434,"5min":0.372,"15min":0.372},"max":{"1min":0.75,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.621}]},{"osd":7,"last update":"Wed Dec 20 04:44:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.41299999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56999999999999995,"15min":0.57199999999999995},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.71199999999999997,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574881,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194987,"statfs":{"total":200000000,"available":199666882,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.33500000000000002,"5min":0.29399999999999998,"15min":0.28699999999999998},"min":{"1min":0.23999999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.495,"5min":0.495,"15min":0.495},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.48699999999999999,"5min":0.35499999999999998,"15min":0.33300000000000002},"min":{"1min":0.29899999999999999,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":2.0539999999999998,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.29999999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.32400000000000001,"15min":0.32000000000000001},"min":{"1min":0.24099999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.317},{"interface":"front","average":{"1min":0.39300000000000002,"5min":0.34899999999999998,"15min":0.34200000000000003},"min":{"1min":0.29499999999999998,"5min":0.245,"15min":0.245},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.34799999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.35399999999999998,"15min":0.34499999999999997},"min":{"1min":0.30499999999999999,"5min":0.216,"15min":0.216},"max":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.37,"15min":0.36299999999999999},"min":{"1min":0.315,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.627,"5min":0.627,"15min":0.627},"last":0.32700000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.38800000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.70499999999999996,"5min":0.746,"15min":0.746},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.67500000000000004,"5min":0.58199999999999996,"15min":0.56599999999999995},"min":{"1min":0.42099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":2.347,"5min":2.347,"15min":2.347},"last":0.46999999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.57099999999999995,"15min":0.57699999999999996},"min":{"1min":0.40999999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.72599999999999998,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68600000000000005,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.45400000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.65500000000000003,"5min":0.58399999999999996,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.274,"5min":2.274,"15min":2.274},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.56599999999999995,"15min":0.56799999999999995},"min":{"1min":0.40899999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"last":0.46100000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.67200000000000004,"5min":0.57999999999999996,"15min":0.56499999999999995},"min":{"1min":0.42299999999999999,"5min":0.42299999999999999,"15min":0.42299999999999999},"max":{"1min":2.3090000000000002,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"min":{"1min":0.432,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.47999999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574882,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":325,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194987,"statfs":{"total":200000000,"available":199666848,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.28399999999999997,"15min":0.28000000000000003},"min":{"1min":0.193,"5min":0.187,"15min":0.187},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.246},{"interface":"front","average":{"1min":0.34799999999999998,"5min":0.32500000000000001,"15min":0.32100000000000001},"min":{"1min":0.25,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.53000000000000003,"5min":0.53000000000000003,"15min":0.53000000000000003},"last":0.29299999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.29999999999999999,"15min":0.29599999999999999},"min":{"1min":0.23799999999999999,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.223},{"interface":"front","average":{"1min":0.371,"5min":0.34399999999999997,"15min":0.34000000000000002},"min":{"1min":0.22600000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.308}]},{"osd":3,"last update":"Wed Dec 20 04:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.35099999999999998,"15min":0.34599999999999997},"min":{"1min":0.28000000000000003,"5min":0.191,"15min":0.191},"max":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.34999999999999998,"15min":0.34799999999999998},"min":{"1min":0.254,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.32500000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.56699999999999995,"15min":0.56699999999999995},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.873,"5min":0.873,"15min":0.873},"last":0.432},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54300000000000004,"15min":0.54100000000000004},"min":{"1min":0.41599999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55600000000000005,"15min":0.55400000000000005},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.53700000000000003,"15min":0.53400000000000003},"min":{"1min":0.45600000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.85599999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.41899999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76700000000000002,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.56000000000000005,"15min":0.55800000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.498}]},{"osd":7,"last update":"Wed Dec 20 04:44:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.49199999999999999,"5min":0.42199999999999999,"15min":0.42199999999999999},"max":{"1min":0.88900000000000001,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60799999999999998,"15min":0.61199999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.85199999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.48999999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574881,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194408,"statfs":{"total":200000000,"available":199074424,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.311,"5min":0.30499999999999999,"15min":0.30399999999999999},"min":{"1min":0.23499999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.39200000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.33200000000000002,"5min":0.308,"15min":0.30399999999999999},"min":{"1min":0.217,"5min":0.184,"15min":0.184},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.26500000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.35099999999999998,"15min":0.35199999999999998},"min":{"1min":0.25800000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.33600000000000002,"5min":0.34100000000000003,"15min":0.34200000000000003},"min":{"1min":0.26900000000000002,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.46300000000000002,"5min":0.56899999999999995,"15min":0.56899999999999995},"last":0.34899999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.31900000000000001,"15min":0.315},"min":{"1min":0.27900000000000003,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.497,"5min":0.5,"15min":0.5},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.36299999999999999,"15min":0.36099999999999999},"min":{"1min":0.29199999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.48499999999999999,"5min":0.52400000000000002,"15min":0.52400000000000002},"last":0.36299999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.52500000000000002,"5min":0.51200000000000001,"15min":0.51000000000000001},"min":{"1min":0.38,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.46100000000000002},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53000000000000003,"15min":0.52800000000000002},"min":{"1min":0.33900000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.70099999999999996},"last":0.54600000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51200000000000001,"15min":0.50800000000000001},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73099999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53600000000000003,"15min":0.53500000000000003},"min":{"1min":0.39900000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.48999999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57699999999999996,"15min":0.57599999999999996},"min":{"1min":0.46899999999999997,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.754,"5min":0.873,"15min":0.873},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"min":{"1min":0.42899999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.80400000000000005,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.55900000000000005}]},{"osd":7,"last update":"Wed Dec 20 04:44:39 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.54200000000000004,"15min":0.54300000000000004},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76200000000000001,"5min":0.77600000000000002,"15min":0.77600000000000002},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.56799999999999995,"15min":0.56999999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.61299999999999999}]}]}],"pool_statfs":[]}} 2023-12-20T04:45:13.224 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-20T04:45:13.225 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-20T04:45:13.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.365+0000 7fe665ebd640 1 Processor -- start 2023-12-20T04:45:13.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.365+0000 7fe665ebd640 1 -- start start 2023-12-20T04:45:13.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.366+0000 7fe665ebd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe66015d1e0 0x7fe660161750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.366+0000 7fe665ebd640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6600ced40 con 0x7fe6600b1120 2023-12-20T04:45:13.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.366+0000 7fe665ebd640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6600cb320 con 0x7fe6600ce8e0 2023-12-20T04:45:13.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.366+0000 7fe665ebd640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600cb600 con 0x7fe66015d1e0 2023-12-20T04:45:13.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.366+0000 7fe65ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe6600b1120 0x7fe66006feb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41000/0 (socket says 172.21.15.132:41000) 2023-12-20T04:45:13.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.366+0000 7fe65ffff640 1 -- 172.21.15.132:0/1635971320 learned_addr learned my addr 172.21.15.132:0/1635971320 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:45:13.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.366+0000 7fe65e7fc640 1 -- 172.21.15.132:0/1635971320 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2511905470 0 0) 0x7fe6600ced40 con 0x7fe6600b1120 2023-12-20T04:45:13.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65e7fc640 1 -- 172.21.15.132:0/1635971320 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe648003520 con 0x7fe6600b1120 2023-12-20T04:45:13.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65f7fe640 1 --2- 172.21.15.132:0/1635971320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe66015d1e0 0x7fe660161750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65e7fc640 1 -- 172.21.15.132:0/1635971320 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3041670045 0 0) 0x7fe648003520 con 0x7fe6600b1120 2023-12-20T04:45:13.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65e7fc640 1 -- 172.21.15.132:0/1635971320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe66015d1e0 msgr2=0x7fe660161750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:13.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65e7fc640 1 --2- 172.21.15.132:0/1635971320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe66015d1e0 0x7fe660161750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65e7fc640 1 -- 172.21.15.132:0/1635971320 >> v1:172.21.15.187:6789/0 conn(0x7fe6600ce8e0 legacy=0x7fe6600b0a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65e7fc640 1 -- 172.21.15.132:0/1635971320 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe66006f990 con 0x7fe6600b1120 2023-12-20T04:45:13.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65e7fc640 1 -- 172.21.15.132:0/1635971320 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fe6580019f0 con 0x7fe6600b1120 2023-12-20T04:45:13.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65e7fc640 1 -- 172.21.15.132:0/1635971320 >> v1:172.21.15.132:6789/0 conn(0x7fe6600b1120 legacy=0x7fe66006feb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65e7fc640 1 --2- 172.21.15.132:0/1635971320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6480039a0 0x7fe648003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65e7fc640 1 --2- 172.21.15.132:0/1635971320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe66015d1e0 0x7fe6480047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65e7fc640 1 --2- 172.21.15.132:0/1635971320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe648004d00 0x7fe648005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65e7fc640 1 -- 172.21.15.132:0/1635971320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600cb600 con 0x7fe6480039a0 2023-12-20T04:45:13.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65e7fc640 1 -- 172.21.15.132:0/1635971320 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe64800b980 con 0x7fe648004d00 2023-12-20T04:45:13.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65e7fc640 1 -- 172.21.15.132:0/1635971320 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe64800bb40 con 0x7fe66015d1e0 2023-12-20T04:45:13.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65f7fe640 1 --2- 172.21.15.132:0/1635971320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6480039a0 0x7fe648003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65effd640 1 --2- 172.21.15.132:0/1635971320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe66015d1e0 0x7fe6480047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65ffff640 1 --2- 172.21.15.132:0/1635971320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe648004d00 0x7fe648005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65f7fe640 1 -- 172.21.15.132:0/1635971320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe66015d1e0 msgr2=0x7fe6480047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:13.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65f7fe640 1 --2- 172.21.15.132:0/1635971320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe66015d1e0 0x7fe6480047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65f7fe640 1 -- 172.21.15.132:0/1635971320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe648004d00 msgr2=0x7fe648005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:13.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65f7fe640 1 --2- 172.21.15.132:0/1635971320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe648004d00 0x7fe648005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.367+0000 7fe65f7fe640 1 -- 172.21.15.132:0/1635971320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe648003520 con 0x7fe6480039a0 2023-12-20T04:45:13.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.368+0000 7fe65f7fe640 1 --2- 172.21.15.132:0/1635971320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6480039a0 0x7fe648003d80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fe650009ab0 tx=0x7fe6480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fff292831d2b637 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:13.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.368+0000 7fe65e7fc640 1 -- 172.21.15.132:0/1635971320 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650005990 con 0x7fe6480039a0 2023-12-20T04:45:13.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.368+0000 7fe65e7fc640 1 -- 172.21.15.132:0/1635971320 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe650005af0 con 0x7fe6480039a0 2023-12-20T04:45:13.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.368+0000 7fe65e7fc640 1 -- 172.21.15.132:0/1635971320 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe650005ea0 con 0x7fe6480039a0 2023-12-20T04:45:13.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.369+0000 7fe665ebd640 1 -- 172.21.15.132:0/1635971320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6480039a0 msgr2=0x7fe648003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.369+0000 7fe665ebd640 1 --2- 172.21.15.132:0/1635971320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe6480039a0 0x7fe648003d80 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fe650009ab0 tx=0x7fe6480057f0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.369+0000 7fe65ffff640 1 -- 172.21.15.132:0/1635971320 reap_dead start 2023-12-20T04:45:13.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.369+0000 7fe665ebd640 1 -- 172.21.15.132:0/1635971320 shutdown_connections 2023-12-20T04:45:13.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.369+0000 7fe665ebd640 1 -- 172.21.15.132:0/1635971320 >> 172.21.15.132:0/1635971320 conn(0x7fe6600cef90 msgr2=0x7fe6600cf370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:13.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.369+0000 7fe665ebd640 1 -- 172.21.15.132:0/1635971320 shutdown_connections 2023-12-20T04:45:13.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.369+0000 7fe665ebd640 1 -- 172.21.15.132:0/1635971320 wait complete. 2023-12-20T04:45:13.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.370+0000 7fe665ebd640 1 Processor -- start 2023-12-20T04:45:13.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.370+0000 7fe665ebd640 1 -- start start 2023-12-20T04:45:13.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe665ebd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6480039a0 0x7fe6601596f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe665ebd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe66009a1c0 0x7fe6600b30d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe665ebd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe660070aa0 0x7fe660070f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe665ebd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6600b4510 con 0x7fe66009a1c0 2023-12-20T04:45:13.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe665ebd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe660071460 con 0x7fe6480039a0 2023-12-20T04:45:13.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe665ebd640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe66009b360 con 0x7fe660070aa0 2023-12-20T04:45:13.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe65effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe66009a1c0 0x7fe6600b30d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe65effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe66009a1c0 0x7fe6600b30d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35998/0 (socket says 172.21.15.132:35998) 2023-12-20T04:45:13.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe65effd640 1 -- 172.21.15.132:0/3345766551 learned_addr learned my addr 172.21.15.132:0/3345766551 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:13.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe65f7fe640 1 --2- 172.21.15.132:0/3345766551 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6480039a0 0x7fe6601596f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe65ffff640 1 --2- 172.21.15.132:0/3345766551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe660070aa0 0x7fe660070f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe65effd640 1 -- 172.21.15.132:0/3345766551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe660070aa0 msgr2=0x7fe660070f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe65effd640 1 --2- 172.21.15.132:0/3345766551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe660070aa0 0x7fe660070f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe65effd640 1 -- 172.21.15.132:0/3345766551 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6480039a0 msgr2=0x7fe6601596f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe65effd640 1 --2- 172.21.15.132:0/3345766551 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6480039a0 0x7fe6601596f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe65effd640 1 -- 172.21.15.132:0/3345766551 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6600b3610 con 0x7fe66009a1c0 2023-12-20T04:45:13.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe65ffff640 1 --2- 172.21.15.132:0/3345766551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe660070aa0 0x7fe660070f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:45:13.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe65effd640 1 --2- 172.21.15.132:0/3345766551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe66009a1c0 0x7fe6600b30d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe65400e800 tx=0x7fe65400ecc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:13.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe647fff640 1 -- 172.21.15.132:0/3345766551 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6540050d0 con 0x7fe66009a1c0 2023-12-20T04:45:13.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe647fff640 1 -- 172.21.15.132:0/3345766551 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe654005250 con 0x7fe66009a1c0 2023-12-20T04:45:13.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe665ebd640 1 -- 172.21.15.132:0/3345766551 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6600b3890 con 0x7fe66009a1c0 2023-12-20T04:45:13.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe647fff640 1 -- 172.21.15.132:0/3345766551 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe65400c6c0 con 0x7fe66009a1c0 2023-12-20T04:45:13.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.371+0000 7fe665ebd640 1 -- 172.21.15.132:0/3345766551 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6600b3e50 con 0x7fe66009a1c0 2023-12-20T04:45:13.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.372+0000 7fe665ebd640 1 -- 172.21.15.132:0/3345766551 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6600b4650 con 0x7fe66009a1c0 2023-12-20T04:45:13.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.373+0000 7fe647fff640 1 -- 172.21.15.132:0/3345766551 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe65400c820 con 0x7fe66009a1c0 2023-12-20T04:45:13.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.373+0000 7fe647fff640 1 --2- 172.21.15.132:0/3345766551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe64c06a460 0x7fe64c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.373+0000 7fe647fff640 1 -- 172.21.15.132:0/3345766551 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe654088640 con 0x7fe66009a1c0 2023-12-20T04:45:13.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.373+0000 7fe65f7fe640 1 --2- 172.21.15.132:0/3345766551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe64c06a460 0x7fe64c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.374+0000 7fe65f7fe640 1 --2- 172.21.15.132:0/3345766551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe64c06a460 0x7fe64c06c920 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe650035000 tx=0x7fe650030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:13.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.377+0000 7fe647fff640 1 -- 172.21.15.132:0/3345766551 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe6600b4650 con 0x7fe66009a1c0 2023-12-20T04:45:13.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.605+0000 7fe665ebd640 1 -- 172.21.15.132:0/3345766551 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7fe6600b4650 con 0x7fe66009a1c0 2023-12-20T04:45:13.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.609+0000 7fe647fff640 1 -- 172.21.15.132:0/3345766551 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v15) v1 ==== 190+0+0 (secure 0 0 0) 0x7fe6600b4650 con 0x7fe66009a1c0 2023-12-20T04:45:13.611 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.0 2023-12-20T04:45:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.611+0000 7fe665ebd640 1 -- 172.21.15.132:0/3345766551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe64c06a460 msgr2=0x7fe64c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.611+0000 7fe665ebd640 1 --2- 172.21.15.132:0/3345766551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe64c06a460 0x7fe64c06c920 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe650035000 tx=0x7fe650030000 comp rx=0 tx=0).stop 2023-12-20T04:45:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.611+0000 7fe665ebd640 1 -- 172.21.15.132:0/3345766551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe66009a1c0 msgr2=0x7fe6600b30d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.611+0000 7fe665ebd640 1 --2- 172.21.15.132:0/3345766551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe66009a1c0 0x7fe6600b30d0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7fe65400e800 tx=0x7fe65400ecc0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.611+0000 7fe665ebd640 1 -- 172.21.15.132:0/3345766551 shutdown_connections 2023-12-20T04:45:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.611+0000 7fe665ebd640 1 --2- 172.21.15.132:0/3345766551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe64c06a460 0x7fe64c06c920 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.611+0000 7fe665ebd640 1 --2- 172.21.15.132:0/3345766551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe660070aa0 0x7fe660070f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.611+0000 7fe665ebd640 1 --2- 172.21.15.132:0/3345766551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe66009a1c0 0x7fe6600b30d0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.611+0000 7fe665ebd640 1 --2- 172.21.15.132:0/3345766551 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe6480039a0 0x7fe6601596f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.611+0000 7fe665ebd640 1 -- 172.21.15.132:0/3345766551 >> 172.21.15.132:0/3345766551 conn(0x7fe6600cef90 msgr2=0x7fe66006fd70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:13.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.611+0000 7fe665ebd640 1 -- 172.21.15.132:0/3345766551 shutdown_connections 2023-12-20T04:45:13.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.611+0000 7fe665ebd640 1 -- 172.21.15.132:0/3345766551 wait complete. 2023-12-20T04:45:13.624 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:45:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.722+0000 7ff83a35c640 1 Processor -- start 2023-12-20T04:45:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.722+0000 7ff83a35c640 1 -- start start 2023-12-20T04:45:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.723+0000 7ff83a35c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff83415e2d0 0x7ff8340b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.723+0000 7ff83a35c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff8340cb420 0x7ff8340ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.723+0000 7ff83a35c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8340cd740 con 0x7ff8340ceee0 2023-12-20T04:45:13.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.723+0000 7ff83a35c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8340ce230 con 0x7ff83415e2d0 2023-12-20T04:45:13.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.723+0000 7ff83a35c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8340cf2f0 con 0x7ff8340cb420 2023-12-20T04:45:13.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.723+0000 7ff833fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff83415e2d0 0x7ff8340b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.723+0000 7ff833fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff83415e2d0 0x7ff8340b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36000/0 (socket says 172.21.15.132:36000) 2023-12-20T04:45:13.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.723+0000 7ff8388f9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff8340ceee0 0x7ff83415ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41002/0 (socket says 172.21.15.132:41002) 2023-12-20T04:45:13.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.723+0000 7ff833fff640 1 -- 172.21.15.132:0/2126582217 learned_addr learned my addr 172.21.15.132:0/2126582217 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:13.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.723+0000 7ff8337fe640 1 --2- 172.21.15.132:0/2126582217 >> v2:172.21.15.187:3300/0 conn(0x7ff8340cb420 0x7ff8340ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.723+0000 7ff833fff640 1 -- 172.21.15.132:0/2126582217 >> v2:172.21.15.187:3300/0 conn(0x7ff8340cb420 msgr2=0x7ff8340ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:13.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.723+0000 7ff833fff640 1 --2- 172.21.15.132:0/2126582217 >> v2:172.21.15.187:3300/0 conn(0x7ff8340cb420 0x7ff8340ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.723+0000 7ff833fff640 1 -- 172.21.15.132:0/2126582217 >> v1:172.21.15.132:6789/0 conn(0x7ff8340ceee0 legacy=0x7ff83415ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.723+0000 7ff833fff640 1 -- 172.21.15.132:0/2126582217 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8340cd990 con 0x7ff83415e2d0 2023-12-20T04:45:13.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.723+0000 7ff832ffd640 1 -- 172.21.15.132:0/2126582217 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3355752970 0 0) 0x7ff8340cd740 con 0x7ff8340ceee0 2023-12-20T04:45:13.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.724+0000 7ff833fff640 1 --2- 172.21.15.132:0/2126582217 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff83415e2d0 0x7ff8340b3330 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff8340cb8b0 tx=0x7ff82402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1ba3bf83c8564629 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:13.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.724+0000 7ff832ffd640 1 -- 172.21.15.132:0/2126582217 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824031870 con 0x7ff83415e2d0 2023-12-20T04:45:13.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.724+0000 7ff832ffd640 1 -- 172.21.15.132:0/2126582217 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8240319d0 con 0x7ff83415e2d0 2023-12-20T04:45:13.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.724+0000 7ff832ffd640 1 -- 172.21.15.132:0/2126582217 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824031d60 con 0x7ff83415e2d0 2023-12-20T04:45:13.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.725+0000 7ff83a35c640 1 -- 172.21.15.132:0/2126582217 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff83415e2d0 msgr2=0x7ff8340b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.725+0000 7ff83a35c640 1 --2- 172.21.15.132:0/2126582217 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff83415e2d0 0x7ff8340b3330 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7ff8340cb8b0 tx=0x7ff82402b910 comp rx=0 tx=0).stop 2023-12-20T04:45:13.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.725+0000 7ff83a35c640 1 -- 172.21.15.132:0/2126582217 shutdown_connections 2023-12-20T04:45:13.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.725+0000 7ff83a35c640 1 --2- 172.21.15.132:0/2126582217 >> v2:172.21.15.187:3300/0 conn(0x7ff8340cb420 0x7ff8340ce9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.725+0000 7ff83a35c640 1 --2- 172.21.15.132:0/2126582217 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff83415e2d0 0x7ff8340b3330 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.725+0000 7ff83a35c640 1 -- 172.21.15.132:0/2126582217 >> 172.21.15.132:0/2126582217 conn(0x7ff83406d7c0 msgr2=0x7ff83406dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:13.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.725+0000 7ff83a35c640 1 -- 172.21.15.132:0/2126582217 shutdown_connections 2023-12-20T04:45:13.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.725+0000 7ff83a35c640 1 -- 172.21.15.132:0/2126582217 wait complete. 2023-12-20T04:45:13.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.726+0000 7ff83a35c640 1 Processor -- start 2023-12-20T04:45:13.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.726+0000 7ff83a35c640 1 -- start start 2023-12-20T04:45:13.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff83a35c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8340cb420 0x7ff8341f0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff83a35c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8340ceee0 0x7ff8340c73f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff83a35c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff83415e2d0 0x7ff8340ca040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff83a35c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8341f0ab0 con 0x7ff8340cb420 2023-12-20T04:45:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff83a35c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340c4b70 con 0x7ff8340ceee0 2023-12-20T04:45:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff83a35c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8340c4e50 con 0x7ff83415e2d0 2023-12-20T04:45:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff833fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8340cb420 0x7ff8341f0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff833fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8340cb420 0x7ff8341f0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36016/0 (socket says 172.21.15.132:36016) 2023-12-20T04:45:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff833fff640 1 -- 172.21.15.132:0/3054140164 learned_addr learned my addr 172.21.15.132:0/3054140164 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff8337fe640 1 --2- 172.21.15.132:0/3054140164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8340ceee0 0x7ff8340c73f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff8388f9640 1 --2- 172.21.15.132:0/3054140164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff83415e2d0 0x7ff8340ca040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff833fff640 1 -- 172.21.15.132:0/3054140164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff83415e2d0 msgr2=0x7ff8340ca040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff833fff640 1 --2- 172.21.15.132:0/3054140164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff83415e2d0 0x7ff8340ca040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff833fff640 1 -- 172.21.15.132:0/3054140164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8340ceee0 msgr2=0x7ff8340c73f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff833fff640 1 --2- 172.21.15.132:0/3054140164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8340ceee0 0x7ff8340c73f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff833fff640 1 -- 172.21.15.132:0/3054140164 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8240094d0 con 0x7ff8340cb420 2023-12-20T04:45:13.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff8337fe640 1 --2- 172.21.15.132:0/3054140164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8340ceee0 0x7ff8340c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:45:13.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.727+0000 7ff833fff640 1 --2- 172.21.15.132:0/3054140164 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8340cb420 0x7ff8341f0570 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff82402b950 tx=0x7ff8240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:13.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.728+0000 7ff830ff9640 1 -- 172.21.15.132:0/3054140164 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff824031860 con 0x7ff8340cb420 2023-12-20T04:45:13.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.728+0000 7ff830ff9640 1 -- 172.21.15.132:0/3054140164 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff8240443f0 con 0x7ff8340cb420 2023-12-20T04:45:13.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.728+0000 7ff83a35c640 1 -- 172.21.15.132:0/3054140164 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8340c5130 con 0x7ff8340cb420 2023-12-20T04:45:13.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.728+0000 7ff830ff9640 1 -- 172.21.15.132:0/3054140164 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff8240447a0 con 0x7ff8340cb420 2023-12-20T04:45:13.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.728+0000 7ff83a35c640 1 -- 172.21.15.132:0/3054140164 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8340c56f0 con 0x7ff8340cb420 2023-12-20T04:45:13.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.729+0000 7ff83a35c640 1 -- 172.21.15.132:0/3054140164 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8340c58e0 con 0x7ff8340cb420 2023-12-20T04:45:13.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.729+0000 7ff830ff9640 1 -- 172.21.15.132:0/3054140164 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff82404d450 con 0x7ff8340cb420 2023-12-20T04:45:13.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.729+0000 7ff830ff9640 1 --2- 172.21.15.132:0/3054140164 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff82006a430 0x7ff82006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:13.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.730+0000 7ff830ff9640 1 -- 172.21.15.132:0/3054140164 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff82402d040 con 0x7ff8340cb420 2023-12-20T04:45:13.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.730+0000 7ff8337fe640 1 --2- 172.21.15.132:0/3054140164 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff82006a430 0x7ff82006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:13.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.730+0000 7ff8337fe640 1 --2- 172.21.15.132:0/3054140164 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff82006a430 0x7ff82006c8f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff828008890 tx=0x7ff828008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:13.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.734+0000 7ff830ff9640 1 -- 172.21.15.132:0/3054140164 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff8240766f0 con 0x7ff8340cb420 2023-12-20T04:45:13.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.935+0000 7ff83a35c640 1 -- 172.21.15.132:0/3054140164 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff83404e840 con 0x7ff8340cb420 2023-12-20T04:45:13.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.935+0000 7ff830ff9640 1 -- 172.21.15.132:0/3054140164 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4721 (secure 0 0 0) 0x7ff824035090 con 0x7ff8340cb420 2023-12-20T04:45:13.937 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:45:13.937 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3967216203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":3967216203},{"type":"v1","addr":"172.21.15.132:6837","nonce":3967216203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2592935145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2592935145},{"type":"v1","addr":"172.21.15.187:6833","nonce":2592935145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2061740954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2061740954},{"type":"v1","addr":"172.21.15.132:6835","nonce":2061740954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:45:08.941383+0000","modified":"2023-12-20T04:45:11.945725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6183":{"gid":6183,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/3119150547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3119150547},{"type":"v1","addr":"172.21.15.187:6835","nonce":3119150547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-20T04:45:13.937 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 26 2023-12-20T04:45:13.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.937+0000 7ff83a35c640 1 -- 172.21.15.132:0/3054140164 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff82006a430 msgr2=0x7ff82006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.937+0000 7ff83a35c640 1 --2- 172.21.15.132:0/3054140164 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff82006a430 0x7ff82006c8f0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7ff828008890 tx=0x7ff828008040 comp rx=0 tx=0).stop 2023-12-20T04:45:13.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.937+0000 7ff83a35c640 1 -- 172.21.15.132:0/3054140164 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8340cb420 msgr2=0x7ff8341f0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:13.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.937+0000 7ff83a35c640 1 --2- 172.21.15.132:0/3054140164 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8340cb420 0x7ff8341f0570 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7ff82402b950 tx=0x7ff8240046c0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.937+0000 7ff83a35c640 1 -- 172.21.15.132:0/3054140164 shutdown_connections 2023-12-20T04:45:13.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.937+0000 7ff83a35c640 1 --2- 172.21.15.132:0/3054140164 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff82006a430 0x7ff82006c8f0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.937+0000 7ff83a35c640 1 --2- 172.21.15.132:0/3054140164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff83415e2d0 0x7ff8340ca040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.937+0000 7ff83a35c640 1 --2- 172.21.15.132:0/3054140164 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8340ceee0 0x7ff8340c73f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.937+0000 7ff83a35c640 1 --2- 172.21.15.132:0/3054140164 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff8340cb420 0x7ff8341f0570 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:13.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.937+0000 7ff83a35c640 1 -- 172.21.15.132:0/3054140164 >> 172.21.15.132:0/3054140164 conn(0x7ff83406d7c0 msgr2=0x7ff83415d4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:13.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.937+0000 7ff83a35c640 1 -- 172.21.15.132:0/3054140164 shutdown_connections 2023-12-20T04:45:13.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:13.937+0000 7ff83a35c640 1 -- 172.21.15.132:0/3054140164 wait complete. 2023-12-20T04:45:14.353 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 26, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-20T04:45:08.941383+0000', 'modified': '2023-12-20T04:45:11.945725+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6183}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6183': {'gid': 6183, 'name': 'd', 'rank': 0, 'incarnation': 23, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.187:6835/3119150547', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6834', 'nonce': 3119150547}, {'type': 'v1', 'addr': '172.21.15.187:6835', 'nonce': 3119150547}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [9], 'metadata_pool': 8, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-20T04:45:14.353 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-20T04:45:14.353 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-20T04:45:14.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.452+0000 7f369b988640 1 Processor -- start 2023-12-20T04:45:14.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.452+0000 7f369b988640 1 -- start start 2023-12-20T04:45:14.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.453+0000 7f369b988640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3694159bb0 0x7f369406f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.453+0000 7f369b988640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36940ad720 0x7f369406b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.453+0000 7f369b988640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f369406c8e0 con 0x7f36940ade00 2023-12-20T04:45:14.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.453+0000 7f369b988640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f369415e420 con 0x7f3694159bb0 2023-12-20T04:45:14.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.453+0000 7f369b988640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369415e700 con 0x7f36940ad720 2023-12-20T04:45:14.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.453+0000 7f3698f23640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36940ad720 0x7f369406b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.453+0000 7f3699724640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3694159bb0 0x7f369406f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.453+0000 7f3698f23640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36940ad720 0x7f369406b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:54216/0 (socket says 172.21.15.132:54216) 2023-12-20T04:45:14.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.453+0000 7f3698f23640 1 -- 172.21.15.132:0/2721186096 learned_addr learned my addr 172.21.15.132:0/2721186096 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:14.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.453+0000 7f3699f25640 1 --1- 172.21.15.132:0/2721186096 >> v1:172.21.15.187:6789/0 conn(0x7f36940ade00 0x7f36940ca510 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:51262/0 (socket says 172.21.15.132:51262) 2023-12-20T04:45:14.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.454+0000 7f3698f23640 1 -- 172.21.15.132:0/2721186096 >> v2:172.21.15.187:3300/0 conn(0x7f3694159bb0 msgr2=0x7f369406f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:14.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.454+0000 7f3698f23640 1 --2- 172.21.15.132:0/2721186096 >> v2:172.21.15.187:3300/0 conn(0x7f3694159bb0 0x7f369406f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.454+0000 7f3698f23640 1 -- 172.21.15.132:0/2721186096 >> v1:172.21.15.187:6789/0 conn(0x7f36940ade00 legacy=0x7f36940ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:14.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.454+0000 7f3698f23640 1 -- 172.21.15.132:0/2721186096 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36940c9d10 con 0x7f36940ad720 2023-12-20T04:45:14.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.454+0000 7f3699724640 1 --2- 172.21.15.132:0/2721186096 >> v2:172.21.15.187:3300/0 conn(0x7f3694159bb0 0x7f369406f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:45:14.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.454+0000 7f3698f23640 1 --2- 172.21.15.132:0/2721186096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36940ad720 0x7f369406b490 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3684009870 tx=0x7f368402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=549afc1fc3d29ea2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:14.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.455+0000 7f368bfff640 1 -- 172.21.15.132:0/2721186096 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684030840 con 0x7f36940ad720 2023-12-20T04:45:14.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.455+0000 7f368bfff640 1 -- 172.21.15.132:0/2721186096 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36840309a0 con 0x7f36940ad720 2023-12-20T04:45:14.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.455+0000 7f368bfff640 1 -- 172.21.15.132:0/2721186096 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684030d30 con 0x7f36940ad720 2023-12-20T04:45:14.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.455+0000 7f369b988640 1 -- 172.21.15.132:0/2721186096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36940ad720 msgr2=0x7f369406b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:14.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.455+0000 7f369b988640 1 --2- 172.21.15.132:0/2721186096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36940ad720 0x7f369406b490 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f3684009870 tx=0x7f368402b980 comp rx=0 tx=0).stop 2023-12-20T04:45:14.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.455+0000 7f369b988640 1 -- 172.21.15.132:0/2721186096 shutdown_connections 2023-12-20T04:45:14.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.455+0000 7f369b988640 1 --2- 172.21.15.132:0/2721186096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36940ad720 0x7f369406b490 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.455+0000 7f369b988640 1 --2- 172.21.15.132:0/2721186096 >> v2:172.21.15.187:3300/0 conn(0x7f3694159bb0 0x7f369406f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.455+0000 7f369b988640 1 -- 172.21.15.132:0/2721186096 >> 172.21.15.132:0/2721186096 conn(0x7f369406a260 msgr2=0x7f36940b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:14.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.455+0000 7f369b988640 1 -- 172.21.15.132:0/2721186096 shutdown_connections 2023-12-20T04:45:14.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.455+0000 7f369b988640 1 -- 172.21.15.132:0/2721186096 wait complete. 2023-12-20T04:45:14.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.456+0000 7f369b988640 1 Processor -- start 2023-12-20T04:45:14.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.457+0000 7f369b988640 1 -- start start 2023-12-20T04:45:14.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.457+0000 7f369b988640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36940ad720 0x7f36941500f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.457+0000 7f369b988640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36940ade00 0x7f36941527e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.457+0000 7f369b988640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3694159bb0 0x7f3694150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.457+0000 7f369b988640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3694150630 con 0x7f36940ad720 2023-12-20T04:45:14.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.457+0000 7f369b988640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3694151740 con 0x7f36940ade00 2023-12-20T04:45:14.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.457+0000 7f369b988640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3694151a20 con 0x7f3694159bb0 2023-12-20T04:45:14.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.457+0000 7f3699724640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36940ad720 0x7f36941500f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.457+0000 7f3699724640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36940ad720 0x7f36941500f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36030/0 (socket says 172.21.15.132:36030) 2023-12-20T04:45:14.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.457+0000 7f3699724640 1 -- 172.21.15.132:0/568377509 learned_addr learned my addr 172.21.15.132:0/568377509 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:14.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.457+0000 7f3698f23640 1 --2- 172.21.15.132:0/568377509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36940ade00 0x7f36941527e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.457+0000 7f3699f25640 1 --2- 172.21.15.132:0/568377509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3694159bb0 0x7f3694150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.458+0000 7f3699724640 1 -- 172.21.15.132:0/568377509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3694159bb0 msgr2=0x7f3694150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:14.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.458+0000 7f3699724640 1 --2- 172.21.15.132:0/568377509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3694159bb0 0x7f3694150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.458+0000 7f3699724640 1 -- 172.21.15.132:0/568377509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36940ade00 msgr2=0x7f36941527e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:14.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.458+0000 7f3699724640 1 --2- 172.21.15.132:0/568377509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36940ade00 0x7f36941527e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.458+0000 7f3699724640 1 -- 172.21.15.132:0/568377509 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3690009a70 con 0x7f36940ad720 2023-12-20T04:45:14.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.458+0000 7f3699724640 1 --2- 172.21.15.132:0/568377509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36940ad720 0x7f36941500f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f369000efc0 tx=0x7f369000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:14.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.458+0000 7f3689ffb640 1 -- 172.21.15.132:0/568377509 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690014680 con 0x7f36940ad720 2023-12-20T04:45:14.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.458+0000 7f3689ffb640 1 -- 172.21.15.132:0/568377509 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f369000f040 con 0x7f36940ad720 2023-12-20T04:45:14.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.458+0000 7f3689ffb640 1 -- 172.21.15.132:0/568377509 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690014a00 con 0x7f36940ad720 2023-12-20T04:45:14.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.458+0000 7f369b988640 1 -- 172.21.15.132:0/568377509 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36840094d0 con 0x7f36940ad720 2023-12-20T04:45:14.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.458+0000 7f369b988640 1 -- 172.21.15.132:0/568377509 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3694151fe0 con 0x7f36940ad720 2023-12-20T04:45:14.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.460+0000 7f3689ffb640 1 -- 172.21.15.132:0/568377509 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3690014b60 con 0x7f36940ad720 2023-12-20T04:45:14.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.460+0000 7f3689ffb640 1 --2- 172.21.15.132:0/568377509 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f367806a430 0x7f367806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.460+0000 7f3689ffb640 1 -- 172.21.15.132:0/568377509 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3690089700 con 0x7f36940ad720 2023-12-20T04:45:14.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.460+0000 7f3698f23640 1 --2- 172.21.15.132:0/568377509 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f367806a430 0x7f367806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.461+0000 7f3698f23640 1 --2- 172.21.15.132:0/568377509 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f367806a430 0x7f367806c8f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3684036000 tx=0x7f3684008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:14.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.461+0000 7f369e5ce740 1 Processor -- start 2023-12-20T04:45:14.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.461+0000 7f369e5ce740 1 -- start start 2023-12-20T04:45:14.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.462+0000 7f369e5ce740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c5390 0x55daaa898520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.462+0000 7f369e5ce740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5770 0x55daaa8c8120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.462+0000 7f369e5ce740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa898a60 0x55daaa8c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.462+0000 7f369e5ce740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daaa8080b0 con 0x55daaa8c5770 2023-12-20T04:45:14.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.462+0000 7f369e5ce740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daaa805840 con 0x55daaa8c5390 2023-12-20T04:45:14.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.462+0000 7f369e5ce740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55daaa801130 con 0x55daaa898a60 2023-12-20T04:45:14.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.462+0000 7f3698f23640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5770 0x55daaa8c8120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.462+0000 7f3698f23640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5770 0x55daaa8c8120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36038/0 (socket says 172.21.15.132:36038) 2023-12-20T04:45:14.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.462+0000 7f3698f23640 1 -- 172.21.15.132:0/1007123611 learned_addr learned my addr 172.21.15.132:0/1007123611 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:14.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.462+0000 7f3699f25640 1 --2- 172.21.15.132:0/1007123611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa898a60 0x55daaa8c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.462+0000 7f3699724640 1 --2- 172.21.15.132:0/1007123611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c5390 0x55daaa898520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.462+0000 7f3698f23640 1 -- 172.21.15.132:0/1007123611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa898a60 msgr2=0x55daaa8c8660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:14.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.462+0000 7f3698f23640 1 --2- 172.21.15.132:0/1007123611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa898a60 0x55daaa8c8660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.462+0000 7f3698f23640 1 -- 172.21.15.132:0/1007123611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c5390 msgr2=0x55daaa898520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:14.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.462+0000 7f3698f23640 1 --2- 172.21.15.132:0/1007123611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c5390 0x55daaa898520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.462+0000 7f3698f23640 1 -- 172.21.15.132:0/1007123611 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daaa7bbc40 con 0x55daaa8c5770 2023-12-20T04:45:14.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.462+0000 7f3698f23640 1 --2- 172.21.15.132:0/1007123611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5770 0x55daaa8c8120 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f3684009960 tx=0x7f3684030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f182834b98ecdcf server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:14.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.463+0000 7f3676ffd640 1 -- 172.21.15.132:0/1007123611 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684049070 con 0x55daaa8c5770 2023-12-20T04:45:14.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.463+0000 7f3676ffd640 1 -- 172.21.15.132:0/1007123611 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3684030d90 con 0x55daaa8c5770 2023-12-20T04:45:14.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.463+0000 7f3676ffd640 1 -- 172.21.15.132:0/1007123611 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684039b50 con 0x55daaa8c5770 2023-12-20T04:45:14.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.463+0000 7f369e5ce740 1 -- 172.21.15.132:0/1007123611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5770 msgr2=0x55daaa8c8120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:14.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.463+0000 7f369e5ce740 1 --2- 172.21.15.132:0/1007123611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5770 0x55daaa8c8120 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f3684009960 tx=0x7f3684030000 comp rx=0 tx=0).stop 2023-12-20T04:45:14.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.463+0000 7f369e5ce740 1 -- 172.21.15.132:0/1007123611 shutdown_connections 2023-12-20T04:45:14.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.463+0000 7f369e5ce740 1 --2- 172.21.15.132:0/1007123611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa898a60 0x55daaa8c8660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.463+0000 7f369e5ce740 1 --2- 172.21.15.132:0/1007123611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5770 0x55daaa8c8120 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.463+0000 7f369e5ce740 1 --2- 172.21.15.132:0/1007123611 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c5390 0x55daaa898520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.463+0000 7f369e5ce740 1 -- 172.21.15.132:0/1007123611 >> 172.21.15.132:0/1007123611 conn(0x55daaa89a830 msgr2=0x55daaa8e3120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:14.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.463+0000 7f369e5ce740 1 -- 172.21.15.132:0/1007123611 shutdown_connections 2023-12-20T04:45:14.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.463+0000 7f369e5ce740 1 -- 172.21.15.132:0/1007123611 wait complete. 2023-12-20T04:45:14.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.464+0000 7f369e5ce740 1 -- start start 2023-12-20T04:45:14.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.464+0000 7f369e5ce740 1 Processor -- start 2023-12-20T04:45:14.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f369e5ce740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5390 0x55daaa8c3a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f369e5ce740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa8c5770 0x55daaa8dc2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f369e5ce740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c4700 0x55daaa8dc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f369e5ce740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daaa7bf840 con 0x55daaa8c5390 2023-12-20T04:45:14.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f369e5ce740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daaa7bf4e0 con 0x55daaa8c4700 2023-12-20T04:45:14.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f369e5ce740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55daaa785230 con 0x55daaa8c5770 2023-12-20T04:45:14.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f3699724640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5390 0x55daaa8c3a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f369e5ce740 10 client.0 _ll_register_callbacks cb 0x55daaa7d66d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:45:14.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f3699724640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5390 0x55daaa8c3a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36046/0 (socket says 172.21.15.132:36046) 2023-12-20T04:45:14.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f3699724640 1 -- 172.21.15.132:0/2150502581 learned_addr learned my addr 172.21.15.132:0/2150502581 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:14.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f3699f25640 1 --2- 172.21.15.132:0/2150502581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c4700 0x55daaa8dc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f3698f23640 1 --2- 172.21.15.132:0/2150502581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa8c5770 0x55daaa8dc2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f3699724640 1 -- 172.21.15.132:0/2150502581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa8c5770 msgr2=0x55daaa8dc2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:14.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f3699724640 1 --2- 172.21.15.132:0/2150502581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa8c5770 0x55daaa8dc2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f3699724640 1 -- 172.21.15.132:0/2150502581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c4700 msgr2=0x55daaa8dc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:14.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f3699724640 1 --2- 172.21.15.132:0/2150502581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c4700 0x55daaa8dc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f3699724640 1 -- 172.21.15.132:0/2150502581 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36940c9d10 con 0x55daaa8c5390 2023-12-20T04:45:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f3699f25640 1 --2- 172.21.15.132:0/2150502581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c4700 0x55daaa8dc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:45:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f3698f23640 1 --2- 172.21.15.132:0/2150502581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa8c5770 0x55daaa8dc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:45:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f3699724640 1 --2- 172.21.15.132:0/2150502581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5390 0x55daaa8c3a90 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3690054ff0 tx=0x7f3690058bb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bb98cd636b53a11 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f366ffff640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:45:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.465+0000 7f366ffff640 1 -- 172.21.15.132:0/2150502581 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3690060590 con 0x55daaa8c5390 2023-12-20T04:45:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.466+0000 7f366ffff640 1 -- 172.21.15.132:0/2150502581 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36900606f0 con 0x55daaa8c5390 2023-12-20T04:45:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.466+0000 7f369e5ce740 1 -- 172.21.15.132:0/2150502581 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55daaa82a970 con 0x55daaa8c5390 2023-12-20T04:45:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.466+0000 7f366ffff640 1 -- 172.21.15.132:0/2150502581 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f36900548e0 con 0x55daaa8c5390 2023-12-20T04:45:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.466+0000 7f369e5ce740 10 client.6312 fetch_fsmap learned FSMap version 26 2023-12-20T04:45:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.466+0000 7f369e5ce740 1 -- 172.21.15.132:0/2150502581 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55daaa7ff7b0 con 0x55daaa8c5390 2023-12-20T04:45:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.466+0000 7f366ffff640 1 -- 172.21.15.132:0/2150502581 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55daaa82a970 con 0x55daaa8c5390 2023-12-20T04:45:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.466+0000 7f366ffff640 1 -- 172.21.15.132:0/2150502581 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 26) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f3690024020 con 0x55daaa8c5390 2023-12-20T04:45:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.466+0000 7f369e5ce740 10 client.6312 fetch_fsmap finished waiting for FSMap version 26 2023-12-20T04:45:14.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.466+0000 7f369e5ce740 10 client.6312 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-20T04:45:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.466+0000 7f369e5ce740 20 client.6312 populate_metadata read hostname 'smithi132' 2023-12-20T04:45:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.466+0000 7f369e5ce740 1 --2- 172.21.15.132:0/2150502581 >> [v2:172.21.15.187:6834/3119150547,v1:172.21.15.187:6835/3119150547] conn(0x55daaa8fe0d0 0x55daaa9004c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.466+0000 7f369e5ce740 4 client.6312 mds_command: new command op to 6183 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-20T04:45:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.466+0000 7f369e5ce740 1 -- 172.21.15.132:0/2150502581 --> [v2:172.21.15.187:6834/3119150547,v1:172.21.15.187:6835/3119150547] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55daaa7f2f00 con 0x55daaa8fe0d0 2023-12-20T04:45:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.466+0000 7f3698f23640 1 --2- 172.21.15.132:0/2150502581 >> [v2:172.21.15.187:6834/3119150547,v1:172.21.15.187:6835/3119150547] conn(0x55daaa8fe0d0 0x55daaa9004c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.467+0000 7f366ffff640 10 client.6312 ms_handle_connect on v2:172.21.15.187:6834/3119150547 2023-12-20T04:45:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.467+0000 7f3698f23640 1 --2- 172.21.15.132:0/2150502581 >> [v2:172.21.15.187:6834/3119150547,v1:172.21.15.187:6835/3119150547] conn(0x55daaa8fe0d0 0x55daaa9004c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=afc877fae55ae10e server_cookie=4f5f440b315ca431 in_seq=0 out_seq=0 2023-12-20T04:45:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.467+0000 7f366ffff640 1 -- 172.21.15.132:0/2150502581 <== mds.0 v2:172.21.15.187:6834/3119150547 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55daaa7f2f00 con 0x55daaa8fe0d0 2023-12-20T04:45:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.467+0000 7f366ffff640 10 client.6312 handle_command_reply: tid=0 2023-12-20T04:45:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.467+0000 7f369e5ce740 1 client.6312 shutdown 2023-12-20T04:45:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.467+0000 7f369e5ce740 1 -- 172.21.15.132:0/2150502581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5390 msgr2=0x55daaa8c3a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.467+0000 7f369e5ce740 1 --2- 172.21.15.132:0/2150502581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5390 0x55daaa8c3a90 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f3690054ff0 tx=0x7f3690058bb0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.467+0000 7f369e5ce740 1 -- 172.21.15.132:0/2150502581 shutdown_connections 2023-12-20T04:45:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.467+0000 7f369e5ce740 1 --2- 172.21.15.132:0/2150502581 >> [v2:172.21.15.187:6834/3119150547,v1:172.21.15.187:6835/3119150547] conn(0x55daaa8fe0d0 0x55daaa9004c0 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.467+0000 7f369e5ce740 1 --2- 172.21.15.132:0/2150502581 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c4700 0x55daaa8dc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.467+0000 7f366ffff640 0 client.6312 ms_handle_reset on v2:172.21.15.187:6834/3119150547 2023-12-20T04:45:14.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.467+0000 7f369e5ce740 1 --2- 172.21.15.132:0/2150502581 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa8c5770 0x55daaa8dc2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.467+0000 7f369e5ce740 1 --2- 172.21.15.132:0/2150502581 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5390 0x55daaa8c3a90 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.467+0000 7f369e5ce740 1 -- 172.21.15.132:0/2150502581 >> 172.21.15.132:0/2150502581 conn(0x55daaa898a60 msgr2=0x55daaa8e6630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:14.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.468+0000 7f369e5ce740 1 -- 172.21.15.132:0/2150502581 shutdown_connections 2023-12-20T04:45:14.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.468+0000 7f369e5ce740 1 -- 172.21.15.132:0/2150502581 wait complete. 2023-12-20T04:45:14.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.468+0000 7f369e5ce740 20 client.6312 trim_cache size 0 max 16384 2023-12-20T04:45:14.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.482+0000 7f369e5ce740 1 Processor -- start 2023-12-20T04:45:14.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.482+0000 7f369e5ce740 1 -- start start 2023-12-20T04:45:14.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.483+0000 7f369e5ce740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c4700 0x55daaa8cb800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.483+0000 7f369e5ce740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5390 0x55daaa89be90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.483+0000 7f369e5ce740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa8c5770 0x55daaa89c3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.483+0000 7f369e5ce740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daaa89ea50 con 0x55daaa8c5390 2023-12-20T04:45:14.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.483+0000 7f369e5ce740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daaa8e6e70 con 0x55daaa8c4700 2023-12-20T04:45:14.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.483+0000 7f369e5ce740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55daaa8de530 con 0x55daaa8c5770 2023-12-20T04:45:14.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.483+0000 7f3698f23640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5390 0x55daaa89be90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.483+0000 7f3698f23640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5390 0x55daaa89be90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36048/0 (socket says 172.21.15.132:36048) 2023-12-20T04:45:14.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.483+0000 7f3698f23640 1 -- 172.21.15.132:0/710687325 learned_addr learned my addr 172.21.15.132:0/710687325 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:14.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.483+0000 7f3699724640 1 --2- 172.21.15.132:0/710687325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c4700 0x55daaa8cb800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.483+0000 7f3699f25640 1 --2- 172.21.15.132:0/710687325 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa8c5770 0x55daaa89c3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.483+0000 7f3698f23640 1 -- 172.21.15.132:0/710687325 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa8c5770 msgr2=0x55daaa89c3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:14.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.483+0000 7f3698f23640 1 --2- 172.21.15.132:0/710687325 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa8c5770 0x55daaa89c3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.483+0000 7f3698f23640 1 -- 172.21.15.132:0/710687325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c4700 msgr2=0x55daaa8cb800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:14.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.483+0000 7f3698f23640 1 --2- 172.21.15.132:0/710687325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c4700 0x55daaa8cb800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.483+0000 7f3698f23640 1 -- 172.21.15.132:0/710687325 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55daaa7a1be0 con 0x55daaa8c5390 2023-12-20T04:45:14.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.483+0000 7f3699724640 1 --2- 172.21.15.132:0/710687325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c4700 0x55daaa8cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:45:14.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.484+0000 7f3698f23640 1 --2- 172.21.15.132:0/710687325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5390 0x55daaa89be90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f36840090b0 tx=0x7f368403b040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad8f40fc79acbdb5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:14.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.484+0000 7f36777fe640 1 -- 172.21.15.132:0/710687325 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684049040 con 0x55daaa8c5390 2023-12-20T04:45:14.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.484+0000 7f36777fe640 1 -- 172.21.15.132:0/710687325 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36840597f0 con 0x55daaa8c5390 2023-12-20T04:45:14.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.484+0000 7f36777fe640 1 -- 172.21.15.132:0/710687325 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3684059b80 con 0x55daaa8c5390 2023-12-20T04:45:14.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.484+0000 7f369e5ce740 1 -- 172.21.15.132:0/710687325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5390 msgr2=0x55daaa89be90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:14.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.484+0000 7f369e5ce740 1 --2- 172.21.15.132:0/710687325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5390 0x55daaa89be90 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7f36840090b0 tx=0x7f368403b040 comp rx=0 tx=0).stop 2023-12-20T04:45:14.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.484+0000 7f369e5ce740 1 -- 172.21.15.132:0/710687325 shutdown_connections 2023-12-20T04:45:14.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.484+0000 7f369e5ce740 1 --2- 172.21.15.132:0/710687325 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa8c5770 0x55daaa89c3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.484+0000 7f369e5ce740 1 --2- 172.21.15.132:0/710687325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5390 0x55daaa89be90 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.484+0000 7f369e5ce740 1 --2- 172.21.15.132:0/710687325 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c4700 0x55daaa8cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.484+0000 7f369e5ce740 1 -- 172.21.15.132:0/710687325 >> 172.21.15.132:0/710687325 conn(0x55daaa898a60 msgr2=0x55daaa893880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:14.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.484+0000 7f369e5ce740 1 -- 172.21.15.132:0/710687325 shutdown_connections 2023-12-20T04:45:14.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.484+0000 7f369e5ce740 1 -- 172.21.15.132:0/710687325 wait complete. 2023-12-20T04:45:14.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.485+0000 7f369e5ce740 1 -- start start 2023-12-20T04:45:14.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.485+0000 7f369e5ce740 1 Processor -- start 2023-12-20T04:45:14.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f369e5ce740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c4700 0x55daaa8e3000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f369e5ce740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa8c5390 0x55daaa8e3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f369e5ce740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5770 0x55daaa8c2200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f369e5ce740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daaa8cbbe0 con 0x55daaa8c5770 2023-12-20T04:45:14.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f369e5ce740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55daaa8caa80 con 0x55daaa8c4700 2023-12-20T04:45:14.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f369e5ce740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55daaa8c3050 con 0x55daaa8c5390 2023-12-20T04:45:14.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f369e5ce740 10 client.0 _ll_register_callbacks cb 0x7f36840096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:45:14.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f3699f25640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5770 0x55daaa8c2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f3699f25640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5770 0x55daaa8c2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36058/0 (socket says 172.21.15.132:36058) 2023-12-20T04:45:14.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f3699f25640 1 -- 172.21.15.132:0/1450283005 learned_addr learned my addr 172.21.15.132:0/1450283005 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:14.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f3699724640 1 --2- 172.21.15.132:0/1450283005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c4700 0x55daaa8e3000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f3698f23640 1 --2- 172.21.15.132:0/1450283005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa8c5390 0x55daaa8e3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f3699f25640 1 -- 172.21.15.132:0/1450283005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa8c5390 msgr2=0x55daaa8e3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:14.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f3699f25640 1 --2- 172.21.15.132:0/1450283005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa8c5390 0x55daaa8e3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f3699f25640 1 -- 172.21.15.132:0/1450283005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c4700 msgr2=0x55daaa8e3000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:14.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f3699f25640 1 --2- 172.21.15.132:0/1450283005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c4700 0x55daaa8e3000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f3699f25640 1 -- 172.21.15.132:0/1450283005 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55daaa7bbc40 con 0x55daaa8c5770 2023-12-20T04:45:14.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f3698f23640 1 --2- 172.21.15.132:0/1450283005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa8c5390 0x55daaa8e3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:45:14.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f3699f25640 1 --2- 172.21.15.132:0/1450283005 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5770 0x55daaa8c2200 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f368c009fd0 tx=0x7f368c0064e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf2406bacfdf0805 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:14.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.486+0000 7f366ffff640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:45:14.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.487+0000 7f366ffff640 1 -- 172.21.15.132:0/1450283005 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f368c009510 con 0x55daaa8c5770 2023-12-20T04:45:14.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.487+0000 7f366ffff640 1 -- 172.21.15.132:0/1450283005 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f368c009670 con 0x55daaa8c5770 2023-12-20T04:45:14.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.487+0000 7f369e5ce740 1 -- 172.21.15.132:0/1450283005 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f3684030d90 con 0x55daaa8c5770 2023-12-20T04:45:14.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.487+0000 7f366ffff640 1 -- 172.21.15.132:0/1450283005 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=26) v2 ==== 24+0+0 (secure 0 0 0) 0x7f368c009830 con 0x55daaa8c5770 2023-12-20T04:45:14.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.487+0000 7f369e5ce740 10 client.6318 fetch_fsmap learned FSMap version 26 2023-12-20T04:45:14.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.487+0000 7f369e5ce740 1 -- 172.21.15.132:0/1450283005 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=26,monmap=2+}) v3 -- 0x55daaa7c72f0 con 0x55daaa8c5770 2023-12-20T04:45:14.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.487+0000 7f366ffff640 1 -- 172.21.15.132:0/1450283005 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3684030d90 con 0x55daaa8c5770 2023-12-20T04:45:14.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.487+0000 7f366ffff640 1 -- 172.21.15.132:0/1450283005 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 26) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f368c014070 con 0x55daaa8c5770 2023-12-20T04:45:14.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.487+0000 7f369e5ce740 10 client.6318 fetch_fsmap finished waiting for FSMap version 26 2023-12-20T04:45:14.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.487+0000 7f369e5ce740 10 client.6318 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-20T04:45:14.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.487+0000 7f369e5ce740 20 client.6318 populate_metadata read hostname 'smithi132' 2023-12-20T04:45:14.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.487+0000 7f369e5ce740 1 --2- 172.21.15.132:0/1450283005 >> [v2:172.21.15.187:6834/3119150547,v1:172.21.15.187:6835/3119150547] conn(0x55daaa8c2950 0x55daaa8f1840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.487+0000 7f369e5ce740 4 client.6318 mds_command: new command op to 6183 tid=0[{"prefix": "status"}] 2023-12-20T04:45:14.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.487+0000 7f369e5ce740 1 -- 172.21.15.132:0/1450283005 --> [v2:172.21.15.187:6834/3119150547,v1:172.21.15.187:6835/3119150547] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55daaa7fa1b0 con 0x55daaa8c2950 2023-12-20T04:45:14.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.487+0000 7f3699724640 1 --2- 172.21.15.132:0/1450283005 >> [v2:172.21.15.187:6834/3119150547,v1:172.21.15.187:6835/3119150547] conn(0x55daaa8c2950 0x55daaa8f1840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.488+0000 7f366ffff640 10 client.6318 ms_handle_connect on v2:172.21.15.187:6834/3119150547 2023-12-20T04:45:14.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.488+0000 7f3699724640 1 --2- 172.21.15.132:0/1450283005 >> [v2:172.21.15.187:6834/3119150547,v1:172.21.15.187:6835/3119150547] conn(0x55daaa8c2950 0x55daaa8f1840 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=925e5a8d179eb570 server_cookie=abdc370b5dd5cb0 in_seq=0 out_seq=0 2023-12-20T04:45:14.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.488+0000 7f366ffff640 1 -- 172.21.15.132:0/1450283005 <== mds.0 v2:172.21.15.187:6834/3119150547 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+324 (crc 0 0 0) 0x55daaa7fa1b0 con 0x55daaa8c2950 2023-12-20T04:45:14.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.488+0000 7f366ffff640 10 client.6318 handle_command_reply: tid=0 2023-12-20T04:45:14.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.488+0000 7f369e5ce740 1 client.6318 shutdown 2023-12-20T04:45:14.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.488+0000 7f369e5ce740 1 -- 172.21.15.132:0/1450283005 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5770 msgr2=0x55daaa8c2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:14.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.488+0000 7f369e5ce740 1 --2- 172.21.15.132:0/1450283005 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5770 0x55daaa8c2200 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f368c009fd0 tx=0x7f368c0064e0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.488+0000 7f369e5ce740 1 -- 172.21.15.132:0/1450283005 shutdown_connections 2023-12-20T04:45:14.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.488+0000 7f369e5ce740 1 --2- 172.21.15.132:0/1450283005 >> [v2:172.21.15.187:6834/3119150547,v1:172.21.15.187:6835/3119150547] conn(0x55daaa8c2950 0x55daaa8f1840 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.488+0000 7f369e5ce740 1 --2- 172.21.15.132:0/1450283005 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55daaa8c5770 0x55daaa8c2200 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.488+0000 7f366ffff640 0 client.6318 ms_handle_reset on v2:172.21.15.187:6834/3119150547 2023-12-20T04:45:14.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.488+0000 7f369e5ce740 1 --2- 172.21.15.132:0/1450283005 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55daaa8c5390 0x55daaa8e3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.488+0000 7f369e5ce740 1 --2- 172.21.15.132:0/1450283005 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55daaa8c4700 0x55daaa8e3000 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.488+0000 7f369e5ce740 1 -- 172.21.15.132:0/1450283005 >> 172.21.15.132:0/1450283005 conn(0x55daaa898a60 msgr2=0x55daaa897470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:14.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.488+0000 7f369e5ce740 1 -- 172.21.15.132:0/1450283005 shutdown_connections 2023-12-20T04:45:14.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.488+0000 7f369e5ce740 1 -- 172.21.15.132:0/1450283005 wait complete. 2023-12-20T04:45:14.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.488+0000 7f369e5ce740 20 client.6318 trim_cache size 0 max 16384 2023-12-20T04:45:14.496 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:45:14.496 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:45:14.496 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-12-20T04:45:14.496 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 6183, 2023-12-20T04:45:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-12-20T04:45:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-12-20T04:45:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-12-20T04:45:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 5.545643385, 2023-12-20T04:45:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 26, 2023-12-20T04:45:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 65, 2023-12-20T04:45:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 65, 2023-12-20T04:45:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 9.9303972060000003 2023-12-20T04:45:14.497 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:45:14.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.489+0000 7f369b988640 1 -- 172.21.15.132:0/568377509 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f367806a430 msgr2=0x7f367806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:14.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.489+0000 7f369b988640 1 --2- 172.21.15.132:0/568377509 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f367806a430 0x7f367806c8f0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f3684036000 tx=0x7f3684008030 comp rx=0 tx=0).stop 2023-12-20T04:45:14.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.489+0000 7f369b988640 1 -- 172.21.15.132:0/568377509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36940ad720 msgr2=0x7f36941500f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:14.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.489+0000 7f369b988640 1 --2- 172.21.15.132:0/568377509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36940ad720 0x7f36941500f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f369000efc0 tx=0x7f369000c490 comp rx=0 tx=0).stop 2023-12-20T04:45:14.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.489+0000 7f369b988640 1 -- 172.21.15.132:0/568377509 shutdown_connections 2023-12-20T04:45:14.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.489+0000 7f369b988640 1 --2- 172.21.15.132:0/568377509 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f367806a430 0x7f367806c8f0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.489+0000 7f369b988640 1 --2- 172.21.15.132:0/568377509 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3694159bb0 0x7f3694150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.489+0000 7f369b988640 1 --2- 172.21.15.132:0/568377509 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36940ade00 0x7f36941527e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.489+0000 7f369b988640 1 --2- 172.21.15.132:0/568377509 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36940ad720 0x7f36941500f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.489+0000 7f369b988640 1 -- 172.21.15.132:0/568377509 >> 172.21.15.132:0/568377509 conn(0x7f369406a260 msgr2=0x7f36941532f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:14.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.489+0000 7f369b988640 1 -- 172.21.15.132:0/568377509 shutdown_connections 2023-12-20T04:45:14.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.489+0000 7f369b988640 1 -- 172.21.15.132:0/568377509 wait complete. 2023-12-20T04:45:14.501 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:45:14.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.600+0000 7fd830654640 1 Processor -- start 2023-12-20T04:45:14.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.600+0000 7fd830654640 1 -- start start 2023-12-20T04:45:14.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.601+0000 7fd830654640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd82815ad70 0x7fd82806f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.601+0000 7fd830654640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8280c9ab0 con 0x7fd82806b130 2023-12-20T04:45:14.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.601+0000 7fd830654640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8280c9d90 con 0x7fd8280c92d0 2023-12-20T04:45:14.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.601+0000 7fd830654640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd82815ea40 con 0x7fd82815ad70 2023-12-20T04:45:14.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.601+0000 7fd82e3f0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd82815ad70 0x7fd82806f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.601+0000 7fd82e3f0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd82815ad70 0x7fd82806f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36062/0 (socket says 172.21.15.132:36062) 2023-12-20T04:45:14.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.601+0000 7fd82e3f0640 1 -- 172.21.15.132:0/2840988900 learned_addr learned my addr 172.21.15.132:0/2840988900 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:14.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.601+0000 7fd82e3f0640 1 -- 172.21.15.132:0/2840988900 >> v1:172.21.15.187:6789/0 conn(0x7fd8280c92d0 legacy=0x7fd82815f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:14.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.601+0000 7fd82e3f0640 1 -- 172.21.15.132:0/2840988900 >> v1:172.21.15.132:6789/0 conn(0x7fd82806b130 legacy=0x7fd828070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:14.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.601+0000 7fd82e3f0640 1 -- 172.21.15.132:0/2840988900 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8280ca070 con 0x7fd82815ad70 2023-12-20T04:45:14.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.601+0000 7fd82d3ee640 1 -- 172.21.15.132:0/2840988900 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2152319703 0 0) 0x7fd8280c9ab0 con 0x7fd82806b130 2023-12-20T04:45:14.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.602+0000 7fd82e3f0640 1 --2- 172.21.15.132:0/2840988900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd82815ad70 0x7fd82806f560 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd824009870 tx=0x7fd82402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=562d2d500740681e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:14.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.602+0000 7fd82d3ee640 1 -- 172.21.15.132:0/2840988900 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82402f840 con 0x7fd82815ad70 2023-12-20T04:45:14.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.602+0000 7fd82d3ee640 1 -- 172.21.15.132:0/2840988900 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd82402f9a0 con 0x7fd82815ad70 2023-12-20T04:45:14.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.602+0000 7fd82d3ee640 1 -- 172.21.15.132:0/2840988900 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd82402fd30 con 0x7fd82815ad70 2023-12-20T04:45:14.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.603+0000 7fd830654640 1 -- 172.21.15.132:0/2840988900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd82815ad70 msgr2=0x7fd82806f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:14.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.603+0000 7fd830654640 1 --2- 172.21.15.132:0/2840988900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd82815ad70 0x7fd82806f560 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fd824009870 tx=0x7fd82402ba20 comp rx=0 tx=0).stop 2023-12-20T04:45:14.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.603+0000 7fd830654640 1 -- 172.21.15.132:0/2840988900 shutdown_connections 2023-12-20T04:45:14.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.603+0000 7fd830654640 1 --2- 172.21.15.132:0/2840988900 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd82815ad70 0x7fd82806f560 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.603+0000 7fd830654640 1 -- 172.21.15.132:0/2840988900 >> 172.21.15.132:0/2840988900 conn(0x7fd8280ced10 msgr2=0x7fd8280cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:14.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.603+0000 7fd830654640 1 -- 172.21.15.132:0/2840988900 shutdown_connections 2023-12-20T04:45:14.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.603+0000 7fd830654640 1 -- 172.21.15.132:0/2840988900 wait complete. 2023-12-20T04:45:14.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.604+0000 7fd830654640 1 Processor -- start 2023-12-20T04:45:14.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.604+0000 7fd830654640 1 -- start start 2023-12-20T04:45:14.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.604+0000 7fd830654640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd82806b130 0x7fd828147000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.604+0000 7fd830654640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8280c92d0 0x7fd8281f4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.604+0000 7fd830654640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd82815ad70 0x7fd8281f4a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd830654640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd828157a00 con 0x7fd82815ad70 2023-12-20T04:45:14.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd830654640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd82815dae0 con 0x7fd8280c92d0 2023-12-20T04:45:14.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd830654640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8281570d0 con 0x7fd82806b130 2023-12-20T04:45:14.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd82ebf1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd82815ad70 0x7fd8281f4a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd82ebf1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd82815ad70 0x7fd8281f4a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36064/0 (socket says 172.21.15.132:36064) 2023-12-20T04:45:14.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd82ebf1640 1 -- 172.21.15.132:0/1247601706 learned_addr learned my addr 172.21.15.132:0/1247601706 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:14.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd82dbef640 1 --2- 172.21.15.132:0/1247601706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8280c92d0 0x7fd8281f4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd82ebf1640 1 -- 172.21.15.132:0/1247601706 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd82806b130 msgr2=0x7fd828147000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:14.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd82ebf1640 1 --2- 172.21.15.132:0/1247601706 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd82806b130 0x7fd828147000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd82ebf1640 1 -- 172.21.15.132:0/1247601706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8280c92d0 msgr2=0x7fd8281f4520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:14.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd82ebf1640 1 --2- 172.21.15.132:0/1247601706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8280c92d0 0x7fd8281f4520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd82ebf1640 1 -- 172.21.15.132:0/1247601706 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8240094d0 con 0x7fd82815ad70 2023-12-20T04:45:14.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd82ebf1640 1 --2- 172.21.15.132:0/1247601706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd82815ad70 0x7fd8281f4a60 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd820001560 tx=0x7fd82000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:14.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd81effd640 1 -- 172.21.15.132:0/1247601706 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820003da0 con 0x7fd82815ad70 2023-12-20T04:45:14.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd81effd640 1 -- 172.21.15.132:0/1247601706 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd820005070 con 0x7fd82815ad70 2023-12-20T04:45:14.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd830654640 1 -- 172.21.15.132:0/1247601706 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8281573b0 con 0x7fd82815ad70 2023-12-20T04:45:14.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd81effd640 1 -- 172.21.15.132:0/1247601706 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd820005420 con 0x7fd82815ad70 2023-12-20T04:45:14.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.605+0000 7fd830654640 1 -- 172.21.15.132:0/1247601706 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd828147540 con 0x7fd82815ad70 2023-12-20T04:45:14.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.606+0000 7fd830654640 1 -- 172.21.15.132:0/1247601706 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd82804e840 con 0x7fd82815ad70 2023-12-20T04:45:14.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.607+0000 7fd81effd640 1 -- 172.21.15.132:0/1247601706 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd820005580 con 0x7fd82815ad70 2023-12-20T04:45:14.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.607+0000 7fd81effd640 1 --2- 172.21.15.132:0/1247601706 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd80c06a430 0x7fd80c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:14.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.607+0000 7fd81effd640 1 -- 172.21.15.132:0/1247601706 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd820088130 con 0x7fd82815ad70 2023-12-20T04:45:14.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.607+0000 7fd82e3f0640 1 --2- 172.21.15.132:0/1247601706 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd80c06a430 0x7fd80c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:14.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.607+0000 7fd82e3f0640 1 --2- 172.21.15.132:0/1247601706 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd80c06a430 0x7fd80c06c8f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd824036000 tx=0x7fd824039040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:14.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.611+0000 7fd81effd640 1 -- 172.21.15.132:0/1247601706 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd8200537b0 con 0x7fd82815ad70 2023-12-20T04:45:14.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.811+0000 7fd830654640 1 -- 172.21.15.132:0/1247601706 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd828157b40 con 0x7fd82815ad70 2023-12-20T04:45:14.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.812+0000 7fd81effd640 1 -- 172.21.15.132:0/1247601706 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd820056dd0 con 0x7fd82815ad70 2023-12-20T04:45:14.814 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:45:14.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.814+0000 7fd830654640 1 -- 172.21.15.132:0/1247601706 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd80c06a430 msgr2=0x7fd80c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:14.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.814+0000 7fd830654640 1 --2- 172.21.15.132:0/1247601706 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd80c06a430 0x7fd80c06c8f0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7fd824036000 tx=0x7fd824039040 comp rx=0 tx=0).stop 2023-12-20T04:45:14.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.814+0000 7fd830654640 1 -- 172.21.15.132:0/1247601706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd82815ad70 msgr2=0x7fd8281f4a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:14.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.814+0000 7fd830654640 1 --2- 172.21.15.132:0/1247601706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd82815ad70 0x7fd8281f4a60 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7fd820001560 tx=0x7fd82000cc70 comp rx=0 tx=0).stop 2023-12-20T04:45:14.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.814+0000 7fd830654640 1 -- 172.21.15.132:0/1247601706 shutdown_connections 2023-12-20T04:45:14.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.814+0000 7fd830654640 1 --2- 172.21.15.132:0/1247601706 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd80c06a430 0x7fd80c06c8f0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.814+0000 7fd830654640 1 --2- 172.21.15.132:0/1247601706 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd82815ad70 0x7fd8281f4a60 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.814+0000 7fd830654640 1 --2- 172.21.15.132:0/1247601706 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8280c92d0 0x7fd8281f4520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.814+0000 7fd830654640 1 --2- 172.21.15.132:0/1247601706 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd82806b130 0x7fd828147000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:14.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.814+0000 7fd830654640 1 -- 172.21.15.132:0/1247601706 >> 172.21.15.132:0/1247601706 conn(0x7fd8280ced10 msgr2=0x7fd8280cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:14.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.814+0000 7fd830654640 1 -- 172.21.15.132:0/1247601706 shutdown_connections 2023-12-20T04:45:14.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:14.814+0000 7fd830654640 1 -- 172.21.15.132:0/1247601706 wait complete. 2023-12-20T04:45:14.827 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:45:14.827 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:45:14.827 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-12-20T04:45:14.827 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-20T04:45:14.827 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-20T04:45:14.827 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:45:14.827 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:45:14.827 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:45:14.827 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:45:14.827 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:14.828 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-12-20T04:45:14.843 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:45:14.843 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:45:14.843 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:45:14.843 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:45:14.843 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-20T04:45:14.843 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:45:14.843 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:45:14.843 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:45:14.843 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-12-20T04:45:14.843 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:45:14.844 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-12-20T04:45:14.844 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-12-20T04:45:14.844 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:45:14.844 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-12-20T04:45:14.844 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:45:14.844 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-12-20T04:45:14.844 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:45:14.844 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42559sec preferred_lft 42559sec 2023-12-20T04:45:14.844 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-12-20T04:45:14.844 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:45:14.844 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:45:14.844 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:45:14.844 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:45:14.844 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:45:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::60dd:37ff:fe28:558b/64 scope link 2023-12-20T04:45:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:45:14.845 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:45:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 86:13:fe:55:4c:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-20T04:45:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::8413:feff:fe55:4c04/64 scope link 2023-12-20T04:45:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:45:14.845 INFO:teuthology.orchestra.run.smithi132.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:45:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-20T04:45:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::839:72ff:fea7:b332/64 scope link 2023-12-20T04:45:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:45:14.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:14.846 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:45:14.909 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-20T04:45:14.910 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:14.910 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-12-20T04:45:14.966 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-12-20T04:45:14.966 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:45:14.966 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:45:14.966 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:45:14.966 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:45:14.966 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:14.966 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:45:14.966 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:45:14.966 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:45:14.967 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:45:14.967 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:45:14.967 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:45:15.061 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:15.061 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-20T04:45:15.076 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-20T04:45:15.076 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-20T04:45:15.076 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:45:15.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:15.077 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-12-20T04:45:15.144 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-20T04:45:15.144 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:45:15.145 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-20T04:45:15.199 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:45:15.200 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:45:15.200 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:45:15.254 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:45:15.322 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:45:15.322 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:45:15.389 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:45:15.390 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:45:15.390 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:15.391 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:45:15.445 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:45:15.445 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-20T04:45:15.488 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:45:15.514 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:45:15.514 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:45:15.573 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:2023-12-20T04:45:15.572+0000 7fa5a2a10480 -1 init, newargv = 0x5626f9eaf4f0 newargc=15 2023-12-20T04:45:15.573 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[101190]: starting ceph client 2023-12-20T04:45:15.577 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[101190]: starting fuse 2023-12-20T04:45:15.583 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:45:15.584 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:45:15.585 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:15.585 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:45:15.641 INFO:teuthology.orchestra.run.smithi132.stdout:41 2023-12-20T04:45:15.641 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:45:15.641 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:45:15.641 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:45:15.642 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:45:15.642 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:45:15.642 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:45:15.642 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:45:15.642 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:45:15.642 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:45:15.642 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:45:15.642 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:45:15.642 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:45:15.642 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:45:15.642 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:45:15.642 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:45:15.642 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:45:15.642 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:45:15.642 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:45:15.642 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:45:15.643 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:45:15.643 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:45:15.643 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:45:15.643 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:45:15.643 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:45:15.643 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:45:15.643 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:45:15.643 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:45:15.643 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:45:15.757 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.101190.asok 2023-12-20T04:45:15.943 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.101190.asok 2023-12-20T04:45:15.944 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:15.944 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.101190.asok status 2023-12-20T04:45:16.078 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:45:16.079 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:45:16.079 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:45:16.079 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:45:16.079 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:45:16.079 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:45:16.079 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:45:16.079 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "101190", 2023-12-20T04:45:16.079 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:45:16.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:16.079 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2023-12-20T04:45:16.079 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:45:16.080 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 6333, 2023-12-20T04:45:16.080 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:45:16.080 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:45:16.080 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:45:16.080 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 6333 2023-12-20T04:45:16.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:16.080 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:45:16.081 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:45:16.081 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:45:16.081 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 2956094714 2023-12-20T04:45:16.081 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:45:16.081 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:16.081 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:45:16.082 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:45:16.082 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:45:16.082 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 2956094714 2023-12-20T04:45:16.082 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:45:16.082 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.6333 192.168.0.1:0/2956094714", 2023-12-20T04:45:16.082 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/2956094714", 2023-12-20T04:45:16.083 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2023-12-20T04:45:16.083 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 26, 2023-12-20T04:45:16.083 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 65, 2023-12-20T04:45:16.084 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:45:16.084 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:45:16.084 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:45:16.084 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:45:16.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:16.087 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2023-12-20T04:45:16.087 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-20T04:45:16.102 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2023-12-20T04:45:16.102 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-20T04:45:16.103 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:16.103 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:45:16.171 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:45:16.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.310+0000 7f3d1d9ce640 1 Processor -- start 2023-12-20T04:45:16.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.310+0000 7f3d1d9ce640 1 -- start start 2023-12-20T04:45:16.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.311+0000 7f3d1d9ce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d18160450 0x7f3d18160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:16.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.311+0000 7f3d1d9ce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3d181611b0 0x7f3d180b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:16.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.311+0000 7f3d1d9ce640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d180b5ec0 con 0x7f3d180b4ec0 2023-12-20T04:45:16.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.311+0000 7f3d1d9ce640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d180b5350 con 0x7f3d181611b0 2023-12-20T04:45:16.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.311+0000 7f3d1d9ce640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d181617e0 con 0x7f3d18160450 2023-12-20T04:45:16.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.311+0000 7f3d0ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3d181611b0 0x7f3d180b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:16.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.311+0000 7f3d0ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3d181611b0 0x7f3d180b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36068/0 (socket says 172.21.15.132:36068) 2023-12-20T04:45:16.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.311+0000 7f3d177fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3d180b4ec0 0x7f3d1806a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:41020/0 (socket says 172.21.15.132:41020) 2023-12-20T04:45:16.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.311+0000 7f3d0ffff640 1 -- 172.21.15.132:0/3813413517 learned_addr learned my addr 172.21.15.132:0/3813413517 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:16.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.311+0000 7f3d16ffd640 1 --2- 172.21.15.132:0/3813413517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d18160450 0x7f3d18160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:16.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.311+0000 7f3d0ffff640 1 -- 172.21.15.132:0/3813413517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d18160450 msgr2=0x7f3d18160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:16.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.311+0000 7f3d0ffff640 1 --2- 172.21.15.132:0/3813413517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d18160450 0x7f3d18160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:16.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.311+0000 7f3d0ffff640 1 -- 172.21.15.132:0/3813413517 >> v1:172.21.15.132:6789/0 conn(0x7f3d180b4ec0 legacy=0x7f3d1806a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:16.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.311+0000 7f3d0ffff640 1 -- 172.21.15.132:0/3813413517 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d180d0fc0 con 0x7f3d181611b0 2023-12-20T04:45:16.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.311+0000 7f3d167fc640 1 -- 172.21.15.132:0/3813413517 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 600252709 0 0) 0x7f3d180b5ec0 con 0x7f3d180b4ec0 2023-12-20T04:45:16.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.312+0000 7f3d0ffff640 1 --2- 172.21.15.132:0/3813413517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d181611b0 0x7f3d180b4980 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009870 tx=0x7f3d0002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a85b901c8538f79f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:16.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.312+0000 7f3d167fc640 1 -- 172.21.15.132:0/3813413517 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0002f840 con 0x7f3d181611b0 2023-12-20T04:45:16.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.312+0000 7f3d167fc640 1 -- 172.21.15.132:0/3813413517 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d0002f9a0 con 0x7f3d181611b0 2023-12-20T04:45:16.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.312+0000 7f3d167fc640 1 -- 172.21.15.132:0/3813413517 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d0002fd30 con 0x7f3d181611b0 2023-12-20T04:45:16.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.313+0000 7f3d1d9ce640 1 -- 172.21.15.132:0/3813413517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d181611b0 msgr2=0x7f3d180b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:16.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.313+0000 7f3d1d9ce640 1 --2- 172.21.15.132:0/3813413517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d181611b0 0x7f3d180b4980 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f3d00009870 tx=0x7f3d0002ba20 comp rx=0 tx=0).stop 2023-12-20T04:45:16.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.313+0000 7f3d1d9ce640 1 -- 172.21.15.132:0/3813413517 shutdown_connections 2023-12-20T04:45:16.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.313+0000 7f3d1d9ce640 1 --2- 172.21.15.132:0/3813413517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d181611b0 0x7f3d180b4980 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:16.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.313+0000 7f3d1d9ce640 1 --2- 172.21.15.132:0/3813413517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d18160450 0x7f3d18160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:16.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.313+0000 7f3d1d9ce640 1 -- 172.21.15.132:0/3813413517 >> 172.21.15.132:0/3813413517 conn(0x7f3d180cf980 msgr2=0x7f3d180cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:16.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.313+0000 7f3d1d9ce640 1 -- 172.21.15.132:0/3813413517 shutdown_connections 2023-12-20T04:45:16.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.313+0000 7f3d1d9ce640 1 -- 172.21.15.132:0/3813413517 wait complete. 2023-12-20T04:45:16.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.314+0000 7f3d1d9ce640 1 Processor -- start 2023-12-20T04:45:16.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.314+0000 7f3d1d9ce640 1 -- start start 2023-12-20T04:45:16.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d1d9ce640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d180b4ec0 0x7f3d18156d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:16.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d1d9ce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d18160450 0x7f3d180b7310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:16.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d1d9ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d181611b0 0x7f3d18156160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:16.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d1d9ce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d180ca420 con 0x7f3d181611b0 2023-12-20T04:45:16.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d1d9ce640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d181575f0 con 0x7f3d180b4ec0 2023-12-20T04:45:16.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d1d9ce640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d181578d0 con 0x7f3d18160450 2023-12-20T04:45:16.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d177fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d181611b0 0x7f3d18156160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:16.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d177fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d181611b0 0x7f3d18156160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:36078/0 (socket says 172.21.15.132:36078) 2023-12-20T04:45:16.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d177fe640 1 -- 172.21.15.132:0/1807322217 learned_addr learned my addr 172.21.15.132:0/1807322217 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:16.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d16ffd640 1 --2- 172.21.15.132:0/1807322217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d180b4ec0 0x7f3d18156d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:16.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d0ffff640 1 --2- 172.21.15.132:0/1807322217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d18160450 0x7f3d180b7310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d177fe640 1 -- 172.21.15.132:0/1807322217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d18160450 msgr2=0x7f3d180b7310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d177fe640 1 --2- 172.21.15.132:0/1807322217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d18160450 0x7f3d180b7310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d177fe640 1 -- 172.21.15.132:0/1807322217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d180b4ec0 msgr2=0x7f3d18156d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d177fe640 1 --2- 172.21.15.132:0/1807322217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d180b4ec0 0x7f3d18156d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d177fe640 1 -- 172.21.15.132:0/1807322217 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d000094d0 con 0x7f3d181611b0 2023-12-20T04:45:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d16ffd640 1 --2- 172.21.15.132:0/1807322217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d180b4ec0 0x7f3d18156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:45:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d177fe640 1 --2- 172.21.15.132:0/1807322217 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d181611b0 0x7f3d18156160 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000c7e0 tx=0x7f3d1000cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.315+0000 7f3d14ff9640 1 -- 172.21.15.132:0/1807322217 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1000a640 con 0x7f3d181611b0 2023-12-20T04:45:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.316+0000 7f3d14ff9640 1 -- 172.21.15.132:0/1807322217 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d1000a7c0 con 0x7f3d181611b0 2023-12-20T04:45:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.316+0000 7f3d14ff9640 1 -- 172.21.15.132:0/1807322217 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d1000ab70 con 0x7f3d181611b0 2023-12-20T04:45:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.316+0000 7f3d1d9ce640 1 -- 172.21.15.132:0/1807322217 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d18157bb0 con 0x7f3d181611b0 2023-12-20T04:45:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.316+0000 7f3d1d9ce640 1 -- 172.21.15.132:0/1807322217 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d18157250 con 0x7f3d181611b0 2023-12-20T04:45:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.317+0000 7f3d1d9ce640 1 -- 172.21.15.132:0/1807322217 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d180ca560 con 0x7f3d181611b0 2023-12-20T04:45:16.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.317+0000 7f3d14ff9640 1 -- 172.21.15.132:0/1807322217 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3d1000acd0 con 0x7f3d181611b0 2023-12-20T04:45:16.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.317+0000 7f3d14ff9640 1 --2- 172.21.15.132:0/1807322217 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cf806a430 0x7f3cf806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:16.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.317+0000 7f3d14ff9640 1 -- 172.21.15.132:0/1807322217 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d10087d90 con 0x7f3d181611b0 2023-12-20T04:45:16.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.317+0000 7f3d16ffd640 1 --2- 172.21.15.132:0/1807322217 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cf806a430 0x7f3cf806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:16.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.318+0000 7f3d16ffd640 1 --2- 172.21.15.132:0/1807322217 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cf806a430 0x7f3cf806c8f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800a9d0 tx=0x7f3d08008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:16.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.322+0000 7f3d14ff9640 1 -- 172.21.15.132:0/1807322217 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3d100534c0 con 0x7f3d181611b0 2023-12-20T04:45:16.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.522+0000 7f3d1d9ce640 1 -- 172.21.15.132:0/1807322217 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3d1804e840 con 0x7f3d181611b0 2023-12-20T04:45:16.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.522+0000 7f3d14ff9640 1 -- 172.21.15.132:0/1807322217 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v26) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3d10018020 con 0x7f3d181611b0 2023-12-20T04:45:16.524 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:45:16.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.524+0000 7f3d1d9ce640 1 -- 172.21.15.132:0/1807322217 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cf806a430 msgr2=0x7f3cf806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:16.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.524+0000 7f3d1d9ce640 1 --2- 172.21.15.132:0/1807322217 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cf806a430 0x7f3cf806c8f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f3d0800a9d0 tx=0x7f3d08008040 comp rx=0 tx=0).stop 2023-12-20T04:45:16.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.524+0000 7f3d1d9ce640 1 -- 172.21.15.132:0/1807322217 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d181611b0 msgr2=0x7f3d18156160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:16.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.524+0000 7f3d1d9ce640 1 --2- 172.21.15.132:0/1807322217 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d181611b0 0x7f3d18156160 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f3d1000c7e0 tx=0x7f3d1000cca0 comp rx=0 tx=0).stop 2023-12-20T04:45:16.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.524+0000 7f3d1d9ce640 1 -- 172.21.15.132:0/1807322217 shutdown_connections 2023-12-20T04:45:16.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.524+0000 7f3d1d9ce640 1 --2- 172.21.15.132:0/1807322217 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cf806a430 0x7f3cf806c8f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:16.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.524+0000 7f3d1d9ce640 1 --2- 172.21.15.132:0/1807322217 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d181611b0 0x7f3d18156160 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:16.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.524+0000 7f3d1d9ce640 1 --2- 172.21.15.132:0/1807322217 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d18160450 0x7f3d180b7310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:16.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.524+0000 7f3d1d9ce640 1 --2- 172.21.15.132:0/1807322217 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d180b4ec0 0x7f3d18156d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:16.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.524+0000 7f3d1d9ce640 1 -- 172.21.15.132:0/1807322217 >> 172.21.15.132:0/1807322217 conn(0x7f3d180cf980 msgr2=0x7f3d18159b70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:16.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.524+0000 7f3d1d9ce640 1 -- 172.21.15.132:0/1807322217 shutdown_connections 2023-12-20T04:45:16.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:16.524+0000 7f3d1d9ce640 1 -- 172.21.15.132:0/1807322217 wait complete. 2023-12-20T04:45:16.537 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:45:16.537 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:45:16.537 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-12-20T04:45:16.537 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-20T04:45:16.538 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-20T04:45:16.538 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:45:16.538 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:45:16.538 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:45:16.538 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:45:16.538 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:16.539 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-12-20T04:45:16.557 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:45:16.558 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:45:16.558 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:45:16.558 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:45:16.558 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-20T04:45:16.558 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:45:16.558 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:45:16.558 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:45:16.558 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-12-20T04:45:16.558 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:45:16.558 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:45:16.558 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-12-20T04:45:16.559 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:45:16.559 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:45:16.559 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:45:16.559 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:45:16.559 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:45:16.559 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42569sec preferred_lft 42569sec 2023-12-20T04:45:16.559 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-12-20T04:45:16.559 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:45:16.559 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:45:16.559 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:45:16.559 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:45:16.559 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:45:16.559 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::a8bc:1cff:fe40:54ea/64 scope link 2023-12-20T04:45:16.559 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:45:16.559 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:45:16.560 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-20T04:45:16.560 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c8e:c0ff:fe7a:bdc/64 scope link 2023-12-20T04:45:16.560 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:45:16.560 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:45:16.560 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether be:98:9a:6f:62:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-20T04:45:16.560 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::bc98:9aff:fe6f:6282/64 scope link 2023-12-20T04:45:16.560 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:45:16.560 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:16.560 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:45:16.628 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-12-20T04:45:16.630 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:16.630 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-12-20T04:45:16.688 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-12-20T04:45:16.688 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:45:16.688 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:45:16.688 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:45:16.688 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:45:16.688 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:16.688 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:45:16.688 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:45:16.689 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:45:16.689 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:45:16.689 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:45:16.689 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:45:16.788 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:16.788 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-20T04:45:16.803 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-20T04:45:16.803 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-20T04:45:16.804 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:45:16.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:16.804 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2023-12-20T04:45:16.871 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-20T04:45:16.871 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:45:16.871 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-20T04:45:16.927 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:45:16.927 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:45:16.927 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:45:16.982 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:45:17.050 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:45:17.050 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:45:17.116 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:45:17.117 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:45:17.118 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:17.118 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:45:17.173 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:45:17.173 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-20T04:45:17.204 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:45:17.207 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:45:17.216 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:45:17.242 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:45:17.242 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:45:17.300 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:2023-12-20T04:45:17.299+0000 7fc20ce40480 -1 init, newargv = 0x55f97e0be570 newargc=15 2023-12-20T04:45:17.301 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[87878]: starting ceph client 2023-12-20T04:45:17.304 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[87878]: starting fuse 2023-12-20T04:45:17.325 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:45:17.326 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:45:17.327 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:17.327 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:45:17.382 INFO:teuthology.orchestra.run.smithi187.stdout:41 2023-12-20T04:45:17.382 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:45:17.382 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:45:17.382 DEBUG:teuthology.orchestra.run.smithi187:> import glob 2023-12-20T04:45:17.382 DEBUG:teuthology.orchestra.run.smithi187:> import re 2023-12-20T04:45:17.382 DEBUG:teuthology.orchestra.run.smithi187:> import os 2023-12-20T04:45:17.383 DEBUG:teuthology.orchestra.run.smithi187:> import subprocess 2023-12-20T04:45:17.383 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:45:17.383 DEBUG:teuthology.orchestra.run.smithi187:> def _find_admin_socket(client_name): 2023-12-20T04:45:17.383 DEBUG:teuthology.orchestra.run.smithi187:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-20T04:45:17.383 DEBUG:teuthology.orchestra.run.smithi187:> files = glob.glob(asok_path) 2023-12-20T04:45:17.383 DEBUG:teuthology.orchestra.run.smithi187:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-20T04:45:17.383 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:45:17.383 DEBUG:teuthology.orchestra.run.smithi187:> # Given a non-glob path, it better be there 2023-12-20T04:45:17.383 DEBUG:teuthology.orchestra.run.smithi187:> if "*" not in asok_path: 2023-12-20T04:45:17.383 DEBUG:teuthology.orchestra.run.smithi187:> assert(len(files) == 1) 2023-12-20T04:45:17.383 DEBUG:teuthology.orchestra.run.smithi187:> return files[0] 2023-12-20T04:45:17.383 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:45:17.383 DEBUG:teuthology.orchestra.run.smithi187:> for f in files: 2023-12-20T04:45:17.383 DEBUG:teuthology.orchestra.run.smithi187:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:45:17.384 DEBUG:teuthology.orchestra.run.smithi187:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:45:17.384 DEBUG:teuthology.orchestra.run.smithi187:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:45:17.384 DEBUG:teuthology.orchestra.run.smithi187:> contents = proc_f.read() 2023-12-20T04:45:17.384 DEBUG:teuthology.orchestra.run.smithi187:> if mountpoint in contents: 2023-12-20T04:45:17.384 DEBUG:teuthology.orchestra.run.smithi187:> return f 2023-12-20T04:45:17.384 DEBUG:teuthology.orchestra.run.smithi187:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:45:17.384 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:45:17.384 DEBUG:teuthology.orchestra.run.smithi187:> print(_find_admin_socket("client.1")) 2023-12-20T04:45:17.384 DEBUG:teuthology.orchestra.run.smithi187:> ' 2023-12-20T04:45:17.498 INFO:teuthology.orchestra.run.smithi187.stdout:/var/run/ceph/ceph-client.1.87878.asok 2023-12-20T04:45:17.685 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.87878.asok 2023-12-20T04:45:17.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:17.685 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.87878.asok status 2023-12-20T04:45:17.820 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-12-20T04:45:17.820 INFO:teuthology.orchestra.run.smithi187.stdout: "metadata": { 2023-12-20T04:45:17.820 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:45:17.820 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:45:17.820 INFO:teuthology.orchestra.run.smithi187.stdout: "entity_id": "1", 2023-12-20T04:45:17.821 INFO:teuthology.orchestra.run.smithi187.stdout: "hostname": "smithi187", 2023-12-20T04:45:17.821 INFO:teuthology.orchestra.run.smithi187.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-20T04:45:17.821 INFO:teuthology.orchestra.run.smithi187.stdout: "pid": "87878", 2023-12-20T04:45:17.821 INFO:teuthology.orchestra.run.smithi187.stdout: "root": "/" 2023-12-20T04:45:17.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:45:17.821 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_count": 0, 2023-12-20T04:45:17.821 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_pinned_count": 0, 2023-12-20T04:45:17.821 INFO:teuthology.orchestra.run.smithi187.stdout: "id": 5674, 2023-12-20T04:45:17.821 INFO:teuthology.orchestra.run.smithi187.stdout: "inst": { 2023-12-20T04:45:17.821 INFO:teuthology.orchestra.run.smithi187.stdout: "name": { 2023-12-20T04:45:17.821 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "client", 2023-12-20T04:45:17.821 INFO:teuthology.orchestra.run.smithi187.stdout: "num": 5674 2023-12-20T04:45:17.821 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:45:17.822 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:45:17.822 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:45:17.822 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:45:17.822 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 2065202320 2023-12-20T04:45:17.822 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-12-20T04:45:17.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:45:17.822 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:45:17.822 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:45:17.822 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:45:17.822 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 2065202320 2023-12-20T04:45:17.822 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:45:17.822 INFO:teuthology.orchestra.run.smithi187.stdout: "inst_str": "client.5674 192.168.0.1:0/2065202320", 2023-12-20T04:45:17.822 INFO:teuthology.orchestra.run.smithi187.stdout: "addr_str": "192.168.0.1:0/2065202320", 2023-12-20T04:45:17.823 INFO:teuthology.orchestra.run.smithi187.stdout: "inode_count": 1, 2023-12-20T04:45:17.823 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_epoch": 26, 2023-12-20T04:45:17.823 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch": 65, 2023-12-20T04:45:17.823 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:45:17.823 INFO:teuthology.orchestra.run.smithi187.stdout: "blocklisted": false, 2023-12-20T04:45:17.823 INFO:teuthology.orchestra.run.smithi187.stdout: "fs_name": "cephfs" 2023-12-20T04:45:17.823 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-12-20T04:45:17.828 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:17.828 DEBUG:teuthology.orchestra.run.smithi187:> stat --file-system '--printf=%T 2023-12-20T04:45:17.828 DEBUG:teuthology.orchestra.run.smithi187:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-20T04:45:17.843 INFO:teuthology.orchestra.run.smithi187.stdout:fuseblk 2023-12-20T04:45:17.844 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-20T04:45:17.845 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:45:17.845 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:45:17.910 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:45:18.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.020+0000 7f9acad55640 1 Processor -- start 2023-12-20T04:45:18.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.021+0000 7f9acad55640 1 -- start start 2023-12-20T04:45:18.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.021+0000 7f9acad55640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9ac4160450 0x7f9ac4160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:18.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.021+0000 7f9acad55640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ac40b5090 0x7f9ac40d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:18.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.021+0000 7f9acad55640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ac40b5ec0 con 0x7f9ac41611b0 2023-12-20T04:45:18.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.021+0000 7f9acad55640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ac41617e0 con 0x7f9ac4160450 2023-12-20T04:45:18.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.021+0000 7f9acad55640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac40d0fc0 con 0x7f9ac40b5090 2023-12-20T04:45:18.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.021+0000 7f9ac8af1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9ac4160450 0x7f9ac4160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:18.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.021+0000 7f9ac3fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9ac41611b0 0x7f9ac40b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43064/0 (socket says 172.21.15.132:43064) 2023-12-20T04:45:18.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.021+0000 7f9ac8af1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9ac4160450 0x7f9ac4160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57806/0 (socket says 172.21.15.132:57806) 2023-12-20T04:45:18.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.021+0000 7f9ac3fff640 1 -- 172.21.15.132:0/3363215756 learned_addr learned my addr 172.21.15.132:0/3363215756 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:45:18.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.022+0000 7f9ac92f2640 1 --2- 172.21.15.132:0/3363215756 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ac40b5090 0x7f9ac40d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:18.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.022+0000 7f9ac8af1640 1 -- 172.21.15.132:0/3363215756 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ac40b5090 msgr2=0x7f9ac40d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:45:18.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.022+0000 7f9ac8af1640 1 --2- 172.21.15.132:0/3363215756 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ac40b5090 0x7f9ac40d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:18.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.022+0000 7f9ac8af1640 1 -- 172.21.15.132:0/3363215756 >> v1:172.21.15.132:6789/0 conn(0x7f9ac41611b0 legacy=0x7f9ac40b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:18.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.022+0000 7f9ac37fe640 1 -- 172.21.15.132:0/3363215756 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2232844971 0 0) 0x7f9ac40b5ec0 con 0x7f9ac41611b0 2023-12-20T04:45:18.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.022+0000 7f9ac8af1640 1 -- 172.21.15.132:0/3363215756 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ac40d12a0 con 0x7f9ac4160450 2023-12-20T04:45:18.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.023+0000 7f9ac8af1640 1 --2- 172.21.15.132:0/3363215756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ac4160450 0x7f9ac4160c70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009d90 tx=0x7f9abc02bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38bee516166937dd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:18.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.023+0000 7f9ac37fe640 1 -- 172.21.15.132:0/3363215756 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc02cce0 con 0x7f9ac4160450 2023-12-20T04:45:18.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.023+0000 7f9ac37fe640 1 -- 172.21.15.132:0/3363215756 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc02ce40 con 0x7f9ac4160450 2023-12-20T04:45:18.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.023+0000 7f9ac37fe640 1 -- 172.21.15.132:0/3363215756 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc034660 con 0x7f9ac4160450 2023-12-20T04:45:18.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.023+0000 7f9acad55640 1 -- 172.21.15.132:0/3363215756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ac4160450 msgr2=0x7f9ac4160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:18.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.023+0000 7f9acad55640 1 --2- 172.21.15.132:0/3363215756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ac4160450 0x7f9ac4160c70 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f9abc009d90 tx=0x7f9abc02bf30 comp rx=0 tx=0).stop 2023-12-20T04:45:18.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.023+0000 7f9acad55640 1 -- 172.21.15.132:0/3363215756 shutdown_connections 2023-12-20T04:45:18.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.023+0000 7f9acad55640 1 --2- 172.21.15.132:0/3363215756 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ac40b5090 0x7f9ac40d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:18.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.023+0000 7f9acad55640 1 --2- 172.21.15.132:0/3363215756 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ac4160450 0x7f9ac4160c70 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:18.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.023+0000 7f9acad55640 1 -- 172.21.15.132:0/3363215756 >> 172.21.15.132:0/3363215756 conn(0x7f9ac40cf980 msgr2=0x7f9ac40cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:18.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.023+0000 7f9acad55640 1 -- 172.21.15.132:0/3363215756 shutdown_connections 2023-12-20T04:45:18.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.023+0000 7f9acad55640 1 -- 172.21.15.132:0/3363215756 wait complete. 2023-12-20T04:45:18.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.024+0000 7f9acad55640 1 Processor -- start 2023-12-20T04:45:18.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.025+0000 7f9acad55640 1 -- start start 2023-12-20T04:45:18.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.025+0000 7f9acad55640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ac40b5090 0x7f9ac4159b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:18.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.025+0000 7f9acad55640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ac4160450 0x7f9ac415da10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:18.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.025+0000 7f9acad55640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ac41611b0 0x7f9ac415df50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:18.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.025+0000 7f9acad55640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac41f3c80 con 0x7f9ac40b5090 2023-12-20T04:45:18.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.025+0000 7f9acad55640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac415acc0 con 0x7f9ac4160450 2023-12-20T04:45:18.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.025+0000 7f9acad55640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ac415a420 con 0x7f9ac41611b0 2023-12-20T04:45:18.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.025+0000 7f9ac8af1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ac40b5090 0x7f9ac4159b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:18.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.026+0000 7f9ac8af1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ac40b5090 0x7f9ac4159b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57820/0 (socket says 172.21.15.132:57820) 2023-12-20T04:45:18.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.026+0000 7f9ac8af1640 1 -- 172.21.15.132:0/3510180143 learned_addr learned my addr 172.21.15.132:0/3510180143 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:45:18.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.026+0000 7f9ac3fff640 1 --2- 172.21.15.132:0/3510180143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ac4160450 0x7f9ac415da10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:18.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.026+0000 7f9ac92f2640 1 --2- 172.21.15.132:0/3510180143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ac41611b0 0x7f9ac415df50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:18.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.026+0000 7f9ac8af1640 1 -- 172.21.15.132:0/3510180143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ac41611b0 msgr2=0x7f9ac415df50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:18.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.026+0000 7f9ac8af1640 1 --2- 172.21.15.132:0/3510180143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ac41611b0 0x7f9ac415df50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:18.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.026+0000 7f9ac8af1640 1 -- 172.21.15.132:0/3510180143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ac4160450 msgr2=0x7f9ac415da10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:18.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.026+0000 7f9ac8af1640 1 --2- 172.21.15.132:0/3510180143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ac4160450 0x7f9ac415da10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:18.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.026+0000 7f9ac8af1640 1 -- 172.21.15.132:0/3510180143 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9abc009a70 con 0x7f9ac40b5090 2023-12-20T04:45:18.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.026+0000 7f9ac8af1640 1 --2- 172.21.15.132:0/3510180143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ac40b5090 0x7f9ac4159b20 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9abc037040 tx=0x7f9abc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:18.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.026+0000 7f9ac17fa640 1 -- 172.21.15.132:0/3510180143 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc03d600 con 0x7f9ac40b5090 2023-12-20T04:45:18.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.026+0000 7f9ac17fa640 1 -- 172.21.15.132:0/3510180143 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9abc03d760 con 0x7f9ac40b5090 2023-12-20T04:45:18.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.026+0000 7f9acad55640 1 -- 172.21.15.132:0/3510180143 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ac415a700 con 0x7f9ac40b5090 2023-12-20T04:45:18.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.026+0000 7f9ac17fa640 1 -- 172.21.15.132:0/3510180143 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9abc03db10 con 0x7f9ac40b5090 2023-12-20T04:45:18.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.026+0000 7f9acad55640 1 -- 172.21.15.132:0/3510180143 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ac415a060 con 0x7f9ac40b5090 2023-12-20T04:45:18.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.027+0000 7f9acad55640 1 -- 172.21.15.132:0/3510180143 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ac415a1f0 con 0x7f9ac40b5090 2023-12-20T04:45:18.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.028+0000 7f9ac17fa640 1 -- 172.21.15.132:0/3510180143 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9abc03b040 con 0x7f9ac40b5090 2023-12-20T04:45:18.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.028+0000 7f9ac17fa640 1 --2- 172.21.15.132:0/3510180143 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9aa406a460 0x7f9aa406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:45:18.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.028+0000 7f9ac17fa640 1 -- 172.21.15.132:0/3510180143 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(65..65 src has 1..65) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9abc0aa670 con 0x7f9ac40b5090 2023-12-20T04:45:18.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.028+0000 7f9ac3fff640 1 --2- 172.21.15.132:0/3510180143 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9aa406a460 0x7f9aa406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:45:18.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.028+0000 7f9ac3fff640 1 --2- 172.21.15.132:0/3510180143 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9aa406a460 0x7f9aa406c920 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9ac41f5e50 tx=0x7f9ab4007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:45:18.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.032+0000 7f9ac17fa640 1 -- 172.21.15.132:0/3510180143 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9abc075da0 con 0x7f9ac40b5090 2023-12-20T04:45:18.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.232+0000 7f9acad55640 1 -- 172.21.15.132:0/3510180143 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9ac4160830 con 0x7f9ac40b5090 2023-12-20T04:45:18.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.232+0000 7f9ac17fa640 1 -- 172.21.15.132:0/3510180143 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4721 (secure 0 0 0) 0x7f9abc03dc70 con 0x7f9ac40b5090 2023-12-20T04:45:18.234 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:45:18.234 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3967216203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":3967216203},{"type":"v1","addr":"172.21.15.132:6837","nonce":3967216203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2592935145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2592935145},{"type":"v1","addr":"172.21.15.187:6833","nonce":2592935145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2061740954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2061740954},{"type":"v1","addr":"172.21.15.132:6835","nonce":2061740954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:45:08.941383+0000","modified":"2023-12-20T04:45:11.945725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6183":{"gid":6183,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/3119150547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3119150547},{"type":"v1","addr":"172.21.15.187:6835","nonce":3119150547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-20T04:45:18.235 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 26 2023-12-20T04:45:18.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.234+0000 7f9acad55640 1 -- 172.21.15.132:0/3510180143 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9aa406a460 msgr2=0x7f9aa406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:18.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.234+0000 7f9acad55640 1 --2- 172.21.15.132:0/3510180143 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9aa406a460 0x7f9aa406c920 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f9ac41f5e50 tx=0x7f9ab4007de0 comp rx=0 tx=0).stop 2023-12-20T04:45:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.234+0000 7f9acad55640 1 -- 172.21.15.132:0/3510180143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ac40b5090 msgr2=0x7f9ac4159b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:45:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.234+0000 7f9acad55640 1 --2- 172.21.15.132:0/3510180143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ac40b5090 0x7f9ac4159b20 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f9abc037040 tx=0x7f9abc004a40 comp rx=0 tx=0).stop 2023-12-20T04:45:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.235+0000 7f9acad55640 1 -- 172.21.15.132:0/3510180143 shutdown_connections 2023-12-20T04:45:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.235+0000 7f9acad55640 1 --2- 172.21.15.132:0/3510180143 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9aa406a460 0x7f9aa406c920 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.235+0000 7f9acad55640 1 --2- 172.21.15.132:0/3510180143 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ac41611b0 0x7f9ac415df50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.235+0000 7f9acad55640 1 --2- 172.21.15.132:0/3510180143 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ac4160450 0x7f9ac415da10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.235+0000 7f9acad55640 1 --2- 172.21.15.132:0/3510180143 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ac40b5090 0x7f9ac4159b20 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:45:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.235+0000 7f9acad55640 1 -- 172.21.15.132:0/3510180143 >> 172.21.15.132:0/3510180143 conn(0x7f9ac40cf980 msgr2=0x7f9ac40c91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:45:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.235+0000 7f9acad55640 1 -- 172.21.15.132:0/3510180143 shutdown_connections 2023-12-20T04:45:18.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:45:18.235+0000 7f9acad55640 1 -- 172.21.15.132:0/3510180143 wait complete. 2023-12-20T04:45:18.248 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-20T04:45:18.363 INFO:teuthology.orchestra.run.smithi187.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":6183,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.4102764830000005,"mdsmap_epoch":26,"osdmap_epoch":65,"osdmap_epoch_barrier":65,"uptime":13.795034643999999} 2023-12-20T04:45:18.363 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 6183, "mdsmap_epoch": 26, "osdmap_epoch": 65, "osdmap_epoch_barrier": 65, "rank_uptime": 9.410276483, "state": "up:active", "uptime": 13.795034644, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:45:18.364 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-20T04:45:18.476 INFO:teuthology.orchestra.run.smithi132.stdout:{"osd_mon_report_interval":"5"} 2023-12-20T04:45:18.476 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-20T04:45:18.476 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-20T04:45:18.582 INFO:teuthology.orchestra.run.smithi132.stdout:{"mon_tick_interval":"5"} 2023-12-20T04:45:18.582 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-20T04:45:18.582 INFO:tasks.cephfs.test_full:pool capacity 557053504, 531MB should be enough to fill it 2023-12-20T04:45:18.583 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:45:18.583 DEBUG:teuthology.orchestra.run.smithi132:> import time 2023-12-20T04:45:18.583 DEBUG:teuthology.orchestra.run.smithi132:> import datetime 2023-12-20T04:45:18.583 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:45:18.583 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:45:18.583 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:45:18.583 DEBUG:teuthology.orchestra.run.smithi132:> # Write some buffered data through before going full, all should be well 2023-12-20T04:45:18.583 DEBUG:teuthology.orchestra.run.smithi132:> print("writing some data through which we expect to succeed") 2023-12-20T04:45:18.583 DEBUG:teuthology.orchestra.run.smithi132:> bytes = 0 2023-12-20T04:45:18.583 DEBUG:teuthology.orchestra.run.smithi132:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-20T04:45:18.583 DEBUG:teuthology.orchestra.run.smithi132:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-20T04:45:18.583 DEBUG:teuthology.orchestra.run.smithi132:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-12-20T04:45:18.584 DEBUG:teuthology.orchestra.run.smithi132:> os.fsync(f) 2023-12-20T04:45:18.584 DEBUG:teuthology.orchestra.run.smithi132:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-20T04:45:18.584 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:45:18.584 DEBUG:teuthology.orchestra.run.smithi132:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-20T04:45:18.584 DEBUG:teuthology.orchestra.run.smithi132:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-20T04:45:18.584 DEBUG:teuthology.orchestra.run.smithi132:> # buffered IO, the error should always only appear from fsync and not 2023-12-20T04:45:18.584 DEBUG:teuthology.orchestra.run.smithi132:> # from write 2023-12-20T04:45:18.584 DEBUG:teuthology.orchestra.run.smithi132:> full = False 2023-12-20T04:45:18.584 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:45:18.584 DEBUG:teuthology.orchestra.run.smithi132:> for n in range(0, int(531 * 0.9)): 2023-12-20T04:45:18.584 DEBUG:teuthology.orchestra.run.smithi132:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-20T04:45:18.584 DEBUG:teuthology.orchestra.run.smithi132:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-12-20T04:45:18.584 DEBUG:teuthology.orchestra.run.smithi132:> print("done writing {0} bytes".format(bytes)) 2023-12-20T04:45:18.584 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:45:18.585 DEBUG:teuthology.orchestra.run.smithi132:> # OK, now we should sneak in under the full condition 2023-12-20T04:45:18.585 DEBUG:teuthology.orchestra.run.smithi132:> # due to the time it takes the OSDs to report to the 2023-12-20T04:45:18.585 DEBUG:teuthology.orchestra.run.smithi132:> # mons, and get a successful fsync on our full-making data 2023-12-20T04:45:18.585 DEBUG:teuthology.orchestra.run.smithi132:> os.fsync(f) 2023-12-20T04:45:18.585 DEBUG:teuthology.orchestra.run.smithi132:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-12-20T04:45:18.585 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:45:18.585 DEBUG:teuthology.orchestra.run.smithi132:> # buffered write, add more dirty data to the buffer 2023-12-20T04:45:18.585 DEBUG:teuthology.orchestra.run.smithi132:> print("starting buffered write") 2023-12-20T04:45:18.585 DEBUG:teuthology.orchestra.run.smithi132:> try: 2023-12-20T04:45:18.585 DEBUG:teuthology.orchestra.run.smithi132:> for n in range(0, int(531 * 0.2)): 2023-12-20T04:45:18.585 DEBUG:teuthology.orchestra.run.smithi132:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-20T04:45:18.585 DEBUG:teuthology.orchestra.run.smithi132:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-20T04:45:18.585 DEBUG:teuthology.orchestra.run.smithi132:> time.sleep(15.0) 2023-12-20T04:45:18.585 DEBUG:teuthology.orchestra.run.smithi132:> except OSError: 2023-12-20T04:45:18.586 DEBUG:teuthology.orchestra.run.smithi132:> pass; 2023-12-20T04:45:18.586 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:45:18.586 DEBUG:teuthology.orchestra.run.smithi132:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-12-20T04:45:18.586 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:45:18.586 DEBUG:teuthology.orchestra.run.smithi132:> # Wait long enough for a background flush that should fail 2023-12-20T04:45:18.586 DEBUG:teuthology.orchestra.run.smithi132:> time.sleep(30) 2023-12-20T04:45:18.586 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:45:18.586 DEBUG:teuthology.orchestra.run.smithi132:> if True: 2023-12-20T04:45:18.586 DEBUG:teuthology.orchestra.run.smithi132:> # ...and check that the failed background flush is reflected in fclose 2023-12-20T04:45:18.586 DEBUG:teuthology.orchestra.run.smithi132:> try: 2023-12-20T04:45:18.586 DEBUG:teuthology.orchestra.run.smithi132:> os.close(f) 2023-12-20T04:45:18.586 DEBUG:teuthology.orchestra.run.smithi132:> except OSError: 2023-12-20T04:45:18.586 DEBUG:teuthology.orchestra.run.smithi132:> print("close() returned an error as expected") 2023-12-20T04:45:18.586 DEBUG:teuthology.orchestra.run.smithi132:> else: 2023-12-20T04:45:18.586 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("close() failed to raise error") 2023-12-20T04:45:18.587 DEBUG:teuthology.orchestra.run.smithi132:> else: 2023-12-20T04:45:18.587 DEBUG:teuthology.orchestra.run.smithi132:> # The kernel cephfs client does not raise errors on fclose 2023-12-20T04:45:18.587 DEBUG:teuthology.orchestra.run.smithi132:> os.close(f) 2023-12-20T04:45:18.587 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:45:18.587 DEBUG:teuthology.orchestra.run.smithi132:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-20T04:45:18.587 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:45:19.846 INFO:teuthology.orchestra.run.smithi132.stdout:writing some data through which we expect to succeed 2023-12-20T04:45:19.846 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-20T04:45:19.846 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-12-20T04:45:19.846 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-12-20T04:45:19.846 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-12-20T04:45:19.847 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-12-20T04:45:19.847 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-12-20T04:45:19.847 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-12-20T04:45:19.847 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-12-20T04:45:19.847 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-12-20T04:45:19.847 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-12-20T04:45:19.847 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-12-20T04:45:19.847 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-12-20T04:45:19.847 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-12-20T04:45:19.847 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-12-20T04:45:19.847 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-12-20T04:45:19.847 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-12-20T04:45:19.847 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-12-20T04:45:19.847 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-12-20T04:45:19.847 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-12-20T04:45:19.848 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-12-20T04:45:19.848 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-12-20T04:45:19.848 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-12-20T04:45:19.848 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-12-20T04:45:19.848 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-12-20T04:45:19.848 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-12-20T04:45:19.848 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-12-20T04:45:19.848 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-12-20T04:45:19.848 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-12-20T04:45:19.848 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-12-20T04:45:19.848 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 30932992 bytes via buffered write, may repeat 2023-12-20T04:45:19.848 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 31981568 bytes via buffered write, may repeat 2023-12-20T04:45:19.848 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 33030144 bytes via buffered write, may repeat 2023-12-20T04:45:19.848 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 34078720 bytes via buffered write, may repeat 2023-12-20T04:45:19.848 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 35127296 bytes via buffered write, may repeat 2023-12-20T04:45:19.849 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 36175872 bytes via buffered write, may repeat 2023-12-20T04:45:19.849 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 37224448 bytes via buffered write, may repeat 2023-12-20T04:45:19.849 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 38273024 bytes via buffered write, may repeat 2023-12-20T04:45:19.849 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 39321600 bytes via buffered write, may repeat 2023-12-20T04:45:19.849 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 40370176 bytes via buffered write, may repeat 2023-12-20T04:45:19.849 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 41418752 bytes via buffered write, may repeat 2023-12-20T04:45:19.849 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 42467328 bytes via buffered write, may repeat 2023-12-20T04:45:19.849 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 43515904 bytes via buffered write, may repeat 2023-12-20T04:45:19.849 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 44564480 bytes via buffered write, may repeat 2023-12-20T04:45:19.849 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 45613056 bytes via buffered write, may repeat 2023-12-20T04:45:19.849 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 46661632 bytes via buffered write, may repeat 2023-12-20T04:45:19.849 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 47710208 bytes via buffered write, may repeat 2023-12-20T04:45:19.849 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 48758784 bytes via buffered write, may repeat 2023-12-20T04:45:19.849 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 49807360 bytes via buffered write, may repeat 2023-12-20T04:45:19.850 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 50855936 bytes via buffered write, may repeat 2023-12-20T04:45:19.850 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 51904512 bytes via buffered write, may repeat 2023-12-20T04:45:19.850 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 52953088 bytes via buffered write, may repeat 2023-12-20T04:45:19.850 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 54001664 bytes via buffered write, may repeat 2023-12-20T04:45:19.850 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 55050240 bytes via buffered write, may repeat 2023-12-20T04:45:19.850 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 56098816 bytes via buffered write, may repeat 2023-12-20T04:45:19.850 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 57147392 bytes via buffered write, may repeat 2023-12-20T04:45:19.850 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 58195968 bytes via buffered write, may repeat 2023-12-20T04:45:19.850 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 59244544 bytes via buffered write, may repeat 2023-12-20T04:45:19.850 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 60293120 bytes via buffered write, may repeat 2023-12-20T04:45:19.850 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 61341696 bytes via buffered write, may repeat 2023-12-20T04:45:19.850 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 62390272 bytes via buffered write, may repeat 2023-12-20T04:45:19.850 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 63438848 bytes via buffered write, may repeat 2023-12-20T04:45:19.850 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 64487424 bytes via buffered write, may repeat 2023-12-20T04:45:19.850 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 65536000 bytes via buffered write, may repeat 2023-12-20T04:45:19.851 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 66584576 bytes via buffered write, may repeat 2023-12-20T04:45:19.851 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 67633152 bytes via buffered write, may repeat 2023-12-20T04:45:19.851 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 68681728 bytes via buffered write, may repeat 2023-12-20T04:45:19.851 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 69730304 bytes via buffered write, may repeat 2023-12-20T04:45:19.851 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 70778880 bytes via buffered write, may repeat 2023-12-20T04:45:19.851 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 71827456 bytes via buffered write, may repeat 2023-12-20T04:45:19.851 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 72876032 bytes via buffered write, may repeat 2023-12-20T04:45:19.851 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 73924608 bytes via buffered write, may repeat 2023-12-20T04:45:19.851 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 74973184 bytes via buffered write, may repeat 2023-12-20T04:45:19.851 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 76021760 bytes via buffered write, may repeat 2023-12-20T04:45:19.851 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 77070336 bytes via buffered write, may repeat 2023-12-20T04:45:19.851 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 78118912 bytes via buffered write, may repeat 2023-12-20T04:45:19.851 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 79167488 bytes via buffered write, may repeat 2023-12-20T04:45:19.851 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 80216064 bytes via buffered write, may repeat 2023-12-20T04:45:19.851 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 81264640 bytes via buffered write, may repeat 2023-12-20T04:45:19.851 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 82313216 bytes via buffered write, may repeat 2023-12-20T04:45:19.852 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 83361792 bytes via buffered write, may repeat 2023-12-20T04:45:19.852 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 84410368 bytes via buffered write, may repeat 2023-12-20T04:45:19.852 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 85458944 bytes via buffered write, may repeat 2023-12-20T04:45:19.852 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 86507520 bytes via buffered write, may repeat 2023-12-20T04:45:19.852 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 87556096 bytes via buffered write, may repeat 2023-12-20T04:45:19.852 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 88604672 bytes via buffered write, may repeat 2023-12-20T04:45:19.852 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 89653248 bytes via buffered write, may repeat 2023-12-20T04:45:19.852 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 90701824 bytes via buffered write, may repeat 2023-12-20T04:45:19.852 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 91750400 bytes via buffered write, may repeat 2023-12-20T04:45:19.852 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 92798976 bytes via buffered write, may repeat 2023-12-20T04:45:19.852 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 93847552 bytes via buffered write, may repeat 2023-12-20T04:45:19.852 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 94896128 bytes via buffered write, may repeat 2023-12-20T04:45:19.852 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 95944704 bytes via buffered write, may repeat 2023-12-20T04:45:19.852 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 96993280 bytes via buffered write, may repeat 2023-12-20T04:45:19.852 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 98041856 bytes via buffered write, may repeat 2023-12-20T04:45:19.853 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 99090432 bytes via buffered write, may repeat 2023-12-20T04:45:19.853 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 100139008 bytes via buffered write, may repeat 2023-12-20T04:45:19.853 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 101187584 bytes via buffered write, may repeat 2023-12-20T04:45:19.853 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 102236160 bytes via buffered write, may repeat 2023-12-20T04:45:19.853 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 103284736 bytes via buffered write, may repeat 2023-12-20T04:45:19.853 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 104333312 bytes via buffered write, may repeat 2023-12-20T04:45:19.853 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 105381888 bytes via buffered write, may repeat 2023-12-20T04:45:19.853 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 106430464 bytes via buffered write, may repeat 2023-12-20T04:45:19.853 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 107479040 bytes via buffered write, may repeat 2023-12-20T04:45:19.853 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 108527616 bytes via buffered write, may repeat 2023-12-20T04:45:19.853 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 109576192 bytes via buffered write, may repeat 2023-12-20T04:45:19.853 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 110624768 bytes via buffered write, may repeat 2023-12-20T04:45:19.853 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 111673344 bytes via buffered write, may repeat 2023-12-20T04:45:19.853 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 112721920 bytes via buffered write, may repeat 2023-12-20T04:45:19.853 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 113770496 bytes via buffered write, may repeat 2023-12-20T04:45:19.854 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 114819072 bytes via buffered write, may repeat 2023-12-20T04:45:19.854 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 115867648 bytes via buffered write, may repeat 2023-12-20T04:45:19.854 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 116916224 bytes via buffered write, may repeat 2023-12-20T04:45:19.854 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 117964800 bytes via buffered write, may repeat 2023-12-20T04:45:19.854 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 119013376 bytes via buffered write, may repeat 2023-12-20T04:45:19.854 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 120061952 bytes via buffered write, may repeat 2023-12-20T04:45:19.854 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 121110528 bytes via buffered write, may repeat 2023-12-20T04:45:19.854 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 122159104 bytes via buffered write, may repeat 2023-12-20T04:45:19.854 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 123207680 bytes via buffered write, may repeat 2023-12-20T04:45:19.854 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 124256256 bytes via buffered write, may repeat 2023-12-20T04:45:19.854 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 125304832 bytes via buffered write, may repeat 2023-12-20T04:45:19.854 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 126353408 bytes via buffered write, may repeat 2023-12-20T04:45:19.854 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 127401984 bytes via buffered write, may repeat 2023-12-20T04:45:19.854 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 128450560 bytes via buffered write, may repeat 2023-12-20T04:45:19.854 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 129499136 bytes via buffered write, may repeat 2023-12-20T04:45:19.855 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 130547712 bytes via buffered write, may repeat 2023-12-20T04:45:19.855 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 131596288 bytes via buffered write, may repeat 2023-12-20T04:45:19.855 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 132644864 bytes via buffered write, may repeat 2023-12-20T04:45:19.855 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 133693440 bytes via buffered write, may repeat 2023-12-20T04:45:19.855 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 134742016 bytes via buffered write, may repeat 2023-12-20T04:45:19.855 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 135790592 bytes via buffered write, may repeat 2023-12-20T04:45:19.855 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 136839168 bytes via buffered write, may repeat 2023-12-20T04:45:19.855 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 137887744 bytes via buffered write, may repeat 2023-12-20T04:45:19.855 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 138936320 bytes via buffered write, may repeat 2023-12-20T04:45:19.855 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 139984896 bytes via buffered write, may repeat 2023-12-20T04:45:19.855 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 141033472 bytes via buffered write, may repeat 2023-12-20T04:45:19.855 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 142082048 bytes via buffered write, may repeat 2023-12-20T04:45:19.855 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 143130624 bytes via buffered write, may repeat 2023-12-20T04:45:19.855 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 144179200 bytes via buffered write, may repeat 2023-12-20T04:45:19.855 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 145227776 bytes via buffered write, may repeat 2023-12-20T04:45:19.855 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 146276352 bytes via buffered write, may repeat 2023-12-20T04:45:19.856 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 147324928 bytes via buffered write, may repeat 2023-12-20T04:45:19.856 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 148373504 bytes via buffered write, may repeat 2023-12-20T04:45:19.856 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 149422080 bytes via buffered write, may repeat 2023-12-20T04:45:19.856 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 150470656 bytes via buffered write, may repeat 2023-12-20T04:45:19.856 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 151519232 bytes via buffered write, may repeat 2023-12-20T04:45:19.856 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 152567808 bytes via buffered write, may repeat 2023-12-20T04:45:19.856 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 153616384 bytes via buffered write, may repeat 2023-12-20T04:45:19.856 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 154664960 bytes via buffered write, may repeat 2023-12-20T04:45:19.856 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 155713536 bytes via buffered write, may repeat 2023-12-20T04:45:19.856 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 156762112 bytes via buffered write, may repeat 2023-12-20T04:45:19.856 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 157810688 bytes via buffered write, may repeat 2023-12-20T04:45:19.856 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 158859264 bytes via buffered write, may repeat 2023-12-20T04:45:19.856 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 159907840 bytes via buffered write, may repeat 2023-12-20T04:45:19.856 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 160956416 bytes via buffered write, may repeat 2023-12-20T04:45:19.856 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 162004992 bytes via buffered write, may repeat 2023-12-20T04:45:20.099 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 163053568 bytes via buffered write, may repeat 2023-12-20T04:45:20.100 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 164102144 bytes via buffered write, may repeat 2023-12-20T04:45:20.100 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 165150720 bytes via buffered write, may repeat 2023-12-20T04:45:20.100 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 166199296 bytes via buffered write, may repeat 2023-12-20T04:45:20.100 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 167247872 bytes via buffered write, may repeat 2023-12-20T04:45:20.100 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 168296448 bytes via buffered write, may repeat 2023-12-20T04:45:20.100 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 169345024 bytes via buffered write, may repeat 2023-12-20T04:45:20.100 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 170393600 bytes via buffered write, may repeat 2023-12-20T04:45:20.100 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 171442176 bytes via buffered write, may repeat 2023-12-20T04:45:20.100 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 172490752 bytes via buffered write, may repeat 2023-12-20T04:45:20.100 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 173539328 bytes via buffered write, may repeat 2023-12-20T04:45:20.100 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 174587904 bytes via buffered write, may repeat 2023-12-20T04:45:20.100 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 175636480 bytes via buffered write, may repeat 2023-12-20T04:45:20.101 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 176685056 bytes via buffered write, may repeat 2023-12-20T04:45:20.101 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 177733632 bytes via buffered write, may repeat 2023-12-20T04:45:20.101 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 178782208 bytes via buffered write, may repeat 2023-12-20T04:45:20.101 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 179830784 bytes via buffered write, may repeat 2023-12-20T04:45:20.101 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 180879360 bytes via buffered write, may repeat 2023-12-20T04:45:20.101 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 181927936 bytes via buffered write, may repeat 2023-12-20T04:45:20.101 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 182976512 bytes via buffered write, may repeat 2023-12-20T04:45:20.101 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 184025088 bytes via buffered write, may repeat 2023-12-20T04:45:20.101 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 185073664 bytes via buffered write, may repeat 2023-12-20T04:45:20.101 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 186122240 bytes via buffered write, may repeat 2023-12-20T04:45:20.101 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 187170816 bytes via buffered write, may repeat 2023-12-20T04:45:20.101 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 188219392 bytes via buffered write, may repeat 2023-12-20T04:45:20.101 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 189267968 bytes via buffered write, may repeat 2023-12-20T04:45:20.101 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 190316544 bytes via buffered write, may repeat 2023-12-20T04:45:20.102 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 191365120 bytes via buffered write, may repeat 2023-12-20T04:45:20.102 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 192413696 bytes via buffered write, may repeat 2023-12-20T04:45:20.102 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 193462272 bytes via buffered write, may repeat 2023-12-20T04:45:20.102 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 194510848 bytes via buffered write, may repeat 2023-12-20T04:45:20.102 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 195559424 bytes via buffered write, may repeat 2023-12-20T04:45:20.102 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 196608000 bytes via buffered write, may repeat 2023-12-20T04:45:20.102 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 197656576 bytes via buffered write, may repeat 2023-12-20T04:45:20.102 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 198705152 bytes via buffered write, may repeat 2023-12-20T04:45:20.102 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 199753728 bytes via buffered write, may repeat 2023-12-20T04:45:20.102 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 200802304 bytes via buffered write, may repeat 2023-12-20T04:45:20.102 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 201850880 bytes via buffered write, may repeat 2023-12-20T04:45:20.102 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 202899456 bytes via buffered write, may repeat 2023-12-20T04:45:20.102 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 203948032 bytes via buffered write, may repeat 2023-12-20T04:45:20.103 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 204996608 bytes via buffered write, may repeat 2023-12-20T04:45:20.103 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 206045184 bytes via buffered write, may repeat 2023-12-20T04:45:20.103 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 207093760 bytes via buffered write, may repeat 2023-12-20T04:45:20.103 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 208142336 bytes via buffered write, may repeat 2023-12-20T04:45:20.103 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 209190912 bytes via buffered write, may repeat 2023-12-20T04:45:20.103 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 210239488 bytes via buffered write, may repeat 2023-12-20T04:45:20.103 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 211288064 bytes via buffered write, may repeat 2023-12-20T04:45:20.103 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 212336640 bytes via buffered write, may repeat 2023-12-20T04:45:20.103 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 213385216 bytes via buffered write, may repeat 2023-12-20T04:45:20.103 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 214433792 bytes via buffered write, may repeat 2023-12-20T04:45:20.103 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 215482368 bytes via buffered write, may repeat 2023-12-20T04:45:20.103 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 216530944 bytes via buffered write, may repeat 2023-12-20T04:45:20.104 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 217579520 bytes via buffered write, may repeat 2023-12-20T04:45:20.104 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 218628096 bytes via buffered write, may repeat 2023-12-20T04:45:20.104 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 219676672 bytes via buffered write, may repeat 2023-12-20T04:45:20.104 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 220725248 bytes via buffered write, may repeat 2023-12-20T04:45:20.104 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 221773824 bytes via buffered write, may repeat 2023-12-20T04:45:20.104 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 222822400 bytes via buffered write, may repeat 2023-12-20T04:45:20.104 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 223870976 bytes via buffered write, may repeat 2023-12-20T04:45:20.104 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 224919552 bytes via buffered write, may repeat 2023-12-20T04:45:20.104 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 225968128 bytes via buffered write, may repeat 2023-12-20T04:45:20.104 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 227016704 bytes via buffered write, may repeat 2023-12-20T04:45:20.104 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 228065280 bytes via buffered write, may repeat 2023-12-20T04:45:20.104 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 229113856 bytes via buffered write, may repeat 2023-12-20T04:45:20.104 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 230162432 bytes via buffered write, may repeat 2023-12-20T04:45:20.104 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 231211008 bytes via buffered write, may repeat 2023-12-20T04:45:20.105 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 232259584 bytes via buffered write, may repeat 2023-12-20T04:45:20.105 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 233308160 bytes via buffered write, may repeat 2023-12-20T04:45:20.105 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 234356736 bytes via buffered write, may repeat 2023-12-20T04:45:20.105 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 235405312 bytes via buffered write, may repeat 2023-12-20T04:45:20.105 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 236453888 bytes via buffered write, may repeat 2023-12-20T04:45:20.105 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 237502464 bytes via buffered write, may repeat 2023-12-20T04:45:20.105 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 238551040 bytes via buffered write, may repeat 2023-12-20T04:45:20.105 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 239599616 bytes via buffered write, may repeat 2023-12-20T04:45:20.105 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 240648192 bytes via buffered write, may repeat 2023-12-20T04:45:20.105 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 241696768 bytes via buffered write, may repeat 2023-12-20T04:45:20.105 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 242745344 bytes via buffered write, may repeat 2023-12-20T04:45:20.105 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 243793920 bytes via buffered write, may repeat 2023-12-20T04:45:20.105 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 244842496 bytes via buffered write, may repeat 2023-12-20T04:45:20.106 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 245891072 bytes via buffered write, may repeat 2023-12-20T04:45:20.106 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 246939648 bytes via buffered write, may repeat 2023-12-20T04:45:20.106 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 247988224 bytes via buffered write, may repeat 2023-12-20T04:45:20.106 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 249036800 bytes via buffered write, may repeat 2023-12-20T04:45:20.106 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 250085376 bytes via buffered write, may repeat 2023-12-20T04:45:20.106 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 251133952 bytes via buffered write, may repeat 2023-12-20T04:45:20.106 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 252182528 bytes via buffered write, may repeat 2023-12-20T04:45:20.106 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 253231104 bytes via buffered write, may repeat 2023-12-20T04:45:20.106 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 254279680 bytes via buffered write, may repeat 2023-12-20T04:45:20.106 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 255328256 bytes via buffered write, may repeat 2023-12-20T04:45:20.106 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 256376832 bytes via buffered write, may repeat 2023-12-20T04:45:20.106 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 257425408 bytes via buffered write, may repeat 2023-12-20T04:45:20.106 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 258473984 bytes via buffered write, may repeat 2023-12-20T04:45:20.106 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 259522560 bytes via buffered write, may repeat 2023-12-20T04:45:20.106 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 260571136 bytes via buffered write, may repeat 2023-12-20T04:45:20.107 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 261619712 bytes via buffered write, may repeat 2023-12-20T04:45:20.107 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 262668288 bytes via buffered write, may repeat 2023-12-20T04:45:20.107 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 263716864 bytes via buffered write, may repeat 2023-12-20T04:45:20.107 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 264765440 bytes via buffered write, may repeat 2023-12-20T04:45:20.107 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 265814016 bytes via buffered write, may repeat 2023-12-20T04:45:20.107 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 266862592 bytes via buffered write, may repeat 2023-12-20T04:45:20.107 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 267911168 bytes via buffered write, may repeat 2023-12-20T04:45:20.107 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 268959744 bytes via buffered write, may repeat 2023-12-20T04:45:20.107 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 270008320 bytes via buffered write, may repeat 2023-12-20T04:45:20.107 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 271056896 bytes via buffered write, may repeat 2023-12-20T04:45:20.107 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 272105472 bytes via buffered write, may repeat 2023-12-20T04:45:20.107 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 273154048 bytes via buffered write, may repeat 2023-12-20T04:45:20.107 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 274202624 bytes via buffered write, may repeat 2023-12-20T04:45:20.107 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 275251200 bytes via buffered write, may repeat 2023-12-20T04:45:20.108 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 276299776 bytes via buffered write, may repeat 2023-12-20T04:45:20.108 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 277348352 bytes via buffered write, may repeat 2023-12-20T04:45:20.108 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 278396928 bytes via buffered write, may repeat 2023-12-20T04:45:20.108 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 279445504 bytes via buffered write, may repeat 2023-12-20T04:45:20.108 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 280494080 bytes via buffered write, may repeat 2023-12-20T04:45:20.108 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 281542656 bytes via buffered write, may repeat 2023-12-20T04:45:20.108 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 282591232 bytes via buffered write, may repeat 2023-12-20T04:45:20.108 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 283639808 bytes via buffered write, may repeat 2023-12-20T04:45:20.108 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 284688384 bytes via buffered write, may repeat 2023-12-20T04:45:20.108 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 285736960 bytes via buffered write, may repeat 2023-12-20T04:45:20.108 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 286785536 bytes via buffered write, may repeat 2023-12-20T04:45:20.108 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 287834112 bytes via buffered write, may repeat 2023-12-20T04:45:20.108 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 288882688 bytes via buffered write, may repeat 2023-12-20T04:45:20.109 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 289931264 bytes via buffered write, may repeat 2023-12-20T04:45:20.109 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 290979840 bytes via buffered write, may repeat 2023-12-20T04:45:20.109 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 292028416 bytes via buffered write, may repeat 2023-12-20T04:45:20.109 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 293076992 bytes via buffered write, may repeat 2023-12-20T04:45:20.109 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 294125568 bytes via buffered write, may repeat 2023-12-20T04:45:20.109 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 295174144 bytes via buffered write, may repeat 2023-12-20T04:45:20.109 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 296222720 bytes via buffered write, may repeat 2023-12-20T04:45:20.109 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 297271296 bytes via buffered write, may repeat 2023-12-20T04:45:20.109 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 298319872 bytes via buffered write, may repeat 2023-12-20T04:45:20.109 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 299368448 bytes via buffered write, may repeat 2023-12-20T04:45:20.109 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 300417024 bytes via buffered write, may repeat 2023-12-20T04:45:20.109 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 301465600 bytes via buffered write, may repeat 2023-12-20T04:45:20.109 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 302514176 bytes via buffered write, may repeat 2023-12-20T04:45:20.109 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 303562752 bytes via buffered write, may repeat 2023-12-20T04:45:20.110 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 304611328 bytes via buffered write, may repeat 2023-12-20T04:45:20.110 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 305659904 bytes via buffered write, may repeat 2023-12-20T04:45:20.110 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 306708480 bytes via buffered write, may repeat 2023-12-20T04:45:20.110 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 307757056 bytes via buffered write, may repeat 2023-12-20T04:45:20.110 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 308805632 bytes via buffered write, may repeat 2023-12-20T04:45:20.110 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 309854208 bytes via buffered write, may repeat 2023-12-20T04:45:20.110 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 310902784 bytes via buffered write, may repeat 2023-12-20T04:45:20.110 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 311951360 bytes via buffered write, may repeat 2023-12-20T04:45:20.110 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 312999936 bytes via buffered write, may repeat 2023-12-20T04:45:20.110 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 314048512 bytes via buffered write, may repeat 2023-12-20T04:45:20.110 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 315097088 bytes via buffered write, may repeat 2023-12-20T04:45:20.110 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 316145664 bytes via buffered write, may repeat 2023-12-20T04:45:20.110 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 317194240 bytes via buffered write, may repeat 2023-12-20T04:45:20.110 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 318242816 bytes via buffered write, may repeat 2023-12-20T04:45:20.111 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 319291392 bytes via buffered write, may repeat 2023-12-20T04:45:20.111 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 320339968 bytes via buffered write, may repeat 2023-12-20T04:45:20.111 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 321388544 bytes via buffered write, may repeat 2023-12-20T04:45:20.111 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 322437120 bytes via buffered write, may repeat 2023-12-20T04:45:20.111 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 323485696 bytes via buffered write, may repeat 2023-12-20T04:45:20.331 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 324534272 bytes via buffered write, may repeat 2023-12-20T04:45:20.331 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 325582848 bytes via buffered write, may repeat 2023-12-20T04:45:20.331 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 326631424 bytes via buffered write, may repeat 2023-12-20T04:45:20.331 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 327680000 bytes via buffered write, may repeat 2023-12-20T04:45:20.332 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 328728576 bytes via buffered write, may repeat 2023-12-20T04:45:20.332 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 329777152 bytes via buffered write, may repeat 2023-12-20T04:45:20.332 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 330825728 bytes via buffered write, may repeat 2023-12-20T04:45:20.332 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 331874304 bytes via buffered write, may repeat 2023-12-20T04:45:20.332 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 332922880 bytes via buffered write, may repeat 2023-12-20T04:45:20.332 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 333971456 bytes via buffered write, may repeat 2023-12-20T04:45:20.332 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 335020032 bytes via buffered write, may repeat 2023-12-20T04:45:20.332 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 336068608 bytes via buffered write, may repeat 2023-12-20T04:45:20.332 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 337117184 bytes via buffered write, may repeat 2023-12-20T04:45:20.332 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 338165760 bytes via buffered write, may repeat 2023-12-20T04:45:20.332 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 339214336 bytes via buffered write, may repeat 2023-12-20T04:45:20.332 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 340262912 bytes via buffered write, may repeat 2023-12-20T04:45:20.332 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 341311488 bytes via buffered write, may repeat 2023-12-20T04:45:20.332 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 342360064 bytes via buffered write, may repeat 2023-12-20T04:45:20.333 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 343408640 bytes via buffered write, may repeat 2023-12-20T04:45:20.333 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 344457216 bytes via buffered write, may repeat 2023-12-20T04:45:20.333 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 345505792 bytes via buffered write, may repeat 2023-12-20T04:45:20.333 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 346554368 bytes via buffered write, may repeat 2023-12-20T04:45:20.333 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 347602944 bytes via buffered write, may repeat 2023-12-20T04:45:20.333 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 348651520 bytes via buffered write, may repeat 2023-12-20T04:45:20.333 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 349700096 bytes via buffered write, may repeat 2023-12-20T04:45:20.333 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 350748672 bytes via buffered write, may repeat 2023-12-20T04:45:20.333 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 351797248 bytes via buffered write, may repeat 2023-12-20T04:45:20.333 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 352845824 bytes via buffered write, may repeat 2023-12-20T04:45:20.333 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 353894400 bytes via buffered write, may repeat 2023-12-20T04:45:20.333 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 354942976 bytes via buffered write, may repeat 2023-12-20T04:45:20.333 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 355991552 bytes via buffered write, may repeat 2023-12-20T04:45:20.334 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 357040128 bytes via buffered write, may repeat 2023-12-20T04:45:20.334 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 358088704 bytes via buffered write, may repeat 2023-12-20T04:45:20.334 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 359137280 bytes via buffered write, may repeat 2023-12-20T04:45:20.334 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 360185856 bytes via buffered write, may repeat 2023-12-20T04:45:20.334 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 361234432 bytes via buffered write, may repeat 2023-12-20T04:45:20.334 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 362283008 bytes via buffered write, may repeat 2023-12-20T04:45:20.334 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 363331584 bytes via buffered write, may repeat 2023-12-20T04:45:20.334 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 364380160 bytes via buffered write, may repeat 2023-12-20T04:45:20.334 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 365428736 bytes via buffered write, may repeat 2023-12-20T04:45:20.334 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 366477312 bytes via buffered write, may repeat 2023-12-20T04:45:20.334 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 367525888 bytes via buffered write, may repeat 2023-12-20T04:45:20.334 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 368574464 bytes via buffered write, may repeat 2023-12-20T04:45:20.334 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 369623040 bytes via buffered write, may repeat 2023-12-20T04:45:20.334 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 370671616 bytes via buffered write, may repeat 2023-12-20T04:45:20.334 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 371720192 bytes via buffered write, may repeat 2023-12-20T04:45:20.335 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 372768768 bytes via buffered write, may repeat 2023-12-20T04:45:20.335 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 373817344 bytes via buffered write, may repeat 2023-12-20T04:45:20.335 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 374865920 bytes via buffered write, may repeat 2023-12-20T04:45:20.335 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 375914496 bytes via buffered write, may repeat 2023-12-20T04:45:20.335 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 376963072 bytes via buffered write, may repeat 2023-12-20T04:45:20.335 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 378011648 bytes via buffered write, may repeat 2023-12-20T04:45:20.335 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 379060224 bytes via buffered write, may repeat 2023-12-20T04:45:20.335 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 380108800 bytes via buffered write, may repeat 2023-12-20T04:45:20.335 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 381157376 bytes via buffered write, may repeat 2023-12-20T04:45:20.335 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 382205952 bytes via buffered write, may repeat 2023-12-20T04:45:20.335 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 383254528 bytes via buffered write, may repeat 2023-12-20T04:45:20.335 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 384303104 bytes via buffered write, may repeat 2023-12-20T04:45:20.335 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 385351680 bytes via buffered write, may repeat 2023-12-20T04:45:20.335 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 386400256 bytes via buffered write, may repeat 2023-12-20T04:45:20.336 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 387448832 bytes via buffered write, may repeat 2023-12-20T04:45:20.336 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 388497408 bytes via buffered write, may repeat 2023-12-20T04:45:20.336 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 389545984 bytes via buffered write, may repeat 2023-12-20T04:45:20.336 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 390594560 bytes via buffered write, may repeat 2023-12-20T04:45:20.336 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 391643136 bytes via buffered write, may repeat 2023-12-20T04:45:20.336 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 392691712 bytes via buffered write, may repeat 2023-12-20T04:45:20.336 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 393740288 bytes via buffered write, may repeat 2023-12-20T04:45:20.336 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 394788864 bytes via buffered write, may repeat 2023-12-20T04:45:20.336 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 395837440 bytes via buffered write, may repeat 2023-12-20T04:45:20.336 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 396886016 bytes via buffered write, may repeat 2023-12-20T04:45:20.336 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 397934592 bytes via buffered write, may repeat 2023-12-20T04:45:20.336 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 398983168 bytes via buffered write, may repeat 2023-12-20T04:45:20.336 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 400031744 bytes via buffered write, may repeat 2023-12-20T04:45:20.336 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 401080320 bytes via buffered write, may repeat 2023-12-20T04:45:20.336 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 402128896 bytes via buffered write, may repeat 2023-12-20T04:45:20.337 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 403177472 bytes via buffered write, may repeat 2023-12-20T04:45:20.337 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 404226048 bytes via buffered write, may repeat 2023-12-20T04:45:20.337 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 405274624 bytes via buffered write, may repeat 2023-12-20T04:45:20.337 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 406323200 bytes via buffered write, may repeat 2023-12-20T04:45:20.337 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 407371776 bytes via buffered write, may repeat 2023-12-20T04:45:20.337 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 408420352 bytes via buffered write, may repeat 2023-12-20T04:45:20.337 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 409468928 bytes via buffered write, may repeat 2023-12-20T04:45:20.337 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 410517504 bytes via buffered write, may repeat 2023-12-20T04:45:20.337 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 411566080 bytes via buffered write, may repeat 2023-12-20T04:45:20.337 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 412614656 bytes via buffered write, may repeat 2023-12-20T04:45:20.337 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 413663232 bytes via buffered write, may repeat 2023-12-20T04:45:20.337 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 414711808 bytes via buffered write, may repeat 2023-12-20T04:45:20.337 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 415760384 bytes via buffered write, may repeat 2023-12-20T04:45:20.337 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 416808960 bytes via buffered write, may repeat 2023-12-20T04:45:20.337 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 417857536 bytes via buffered write, may repeat 2023-12-20T04:45:20.338 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 418906112 bytes via buffered write, may repeat 2023-12-20T04:45:20.338 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 419954688 bytes via buffered write, may repeat 2023-12-20T04:45:20.338 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 421003264 bytes via buffered write, may repeat 2023-12-20T04:45:20.338 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 422051840 bytes via buffered write, may repeat 2023-12-20T04:45:20.338 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 423100416 bytes via buffered write, may repeat 2023-12-20T04:45:20.338 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 424148992 bytes via buffered write, may repeat 2023-12-20T04:45:20.338 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 425197568 bytes via buffered write, may repeat 2023-12-20T04:45:20.338 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 426246144 bytes via buffered write, may repeat 2023-12-20T04:45:20.338 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 427294720 bytes via buffered write, may repeat 2023-12-20T04:45:20.338 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 428343296 bytes via buffered write, may repeat 2023-12-20T04:45:20.338 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 429391872 bytes via buffered write, may repeat 2023-12-20T04:45:20.338 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 430440448 bytes via buffered write, may repeat 2023-12-20T04:45:20.338 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 431489024 bytes via buffered write, may repeat 2023-12-20T04:45:20.338 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 432537600 bytes via buffered write, may repeat 2023-12-20T04:45:20.339 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 433586176 bytes via buffered write, may repeat 2023-12-20T04:45:20.339 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 434634752 bytes via buffered write, may repeat 2023-12-20T04:45:20.339 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 435683328 bytes via buffered write, may repeat 2023-12-20T04:45:20.339 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 436731904 bytes via buffered write, may repeat 2023-12-20T04:45:20.339 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 437780480 bytes via buffered write, may repeat 2023-12-20T04:45:20.339 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 438829056 bytes via buffered write, may repeat 2023-12-20T04:45:20.339 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 439877632 bytes via buffered write, may repeat 2023-12-20T04:45:20.339 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 440926208 bytes via buffered write, may repeat 2023-12-20T04:45:20.339 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 441974784 bytes via buffered write, may repeat 2023-12-20T04:45:20.339 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 443023360 bytes via buffered write, may repeat 2023-12-20T04:45:20.339 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 444071936 bytes via buffered write, may repeat 2023-12-20T04:45:20.339 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 445120512 bytes via buffered write, may repeat 2023-12-20T04:45:20.339 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 446169088 bytes via buffered write, may repeat 2023-12-20T04:45:20.339 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 447217664 bytes via buffered write, may repeat 2023-12-20T04:45:20.339 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 448266240 bytes via buffered write, may repeat 2023-12-20T04:45:20.340 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 449314816 bytes via buffered write, may repeat 2023-12-20T04:45:20.340 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 450363392 bytes via buffered write, may repeat 2023-12-20T04:45:20.340 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 451411968 bytes via buffered write, may repeat 2023-12-20T04:45:20.340 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 452460544 bytes via buffered write, may repeat 2023-12-20T04:45:20.340 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 453509120 bytes via buffered write, may repeat 2023-12-20T04:45:20.340 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 454557696 bytes via buffered write, may repeat 2023-12-20T04:45:20.340 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 455606272 bytes via buffered write, may repeat 2023-12-20T04:45:20.340 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 456654848 bytes via buffered write, may repeat 2023-12-20T04:45:20.340 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 457703424 bytes via buffered write, may repeat 2023-12-20T04:45:20.340 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 458752000 bytes via buffered write, may repeat 2023-12-20T04:45:20.340 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 459800576 bytes via buffered write, may repeat 2023-12-20T04:45:20.340 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 460849152 bytes via buffered write, may repeat 2023-12-20T04:45:20.340 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 461897728 bytes via buffered write, may repeat 2023-12-20T04:45:20.340 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 462946304 bytes via buffered write, may repeat 2023-12-20T04:45:20.341 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 463994880 bytes via buffered write, may repeat 2023-12-20T04:45:20.341 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 465043456 bytes via buffered write, may repeat 2023-12-20T04:45:20.341 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 466092032 bytes via buffered write, may repeat 2023-12-20T04:45:20.341 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 467140608 bytes via buffered write, may repeat 2023-12-20T04:45:20.341 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 468189184 bytes via buffered write, may repeat 2023-12-20T04:45:20.341 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 469237760 bytes via buffered write, may repeat 2023-12-20T04:45:20.341 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 470286336 bytes via buffered write, may repeat 2023-12-20T04:45:20.341 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 471334912 bytes via buffered write, may repeat 2023-12-20T04:45:20.341 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 472383488 bytes via buffered write, may repeat 2023-12-20T04:45:20.341 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 473432064 bytes via buffered write, may repeat 2023-12-20T04:45:20.341 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 474480640 bytes via buffered write, may repeat 2023-12-20T04:45:20.341 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 475529216 bytes via buffered write, may repeat 2023-12-20T04:45:20.341 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 476577792 bytes via buffered write, may repeat 2023-12-20T04:45:20.341 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 477626368 bytes via buffered write, may repeat 2023-12-20T04:45:20.341 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 478674944 bytes via buffered write, may repeat 2023-12-20T04:45:20.342 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 479723520 bytes via buffered write, may repeat 2023-12-20T04:45:20.342 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 480772096 bytes via buffered write, may repeat 2023-12-20T04:45:20.342 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 481820672 bytes via buffered write, may repeat 2023-12-20T04:45:20.342 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 482869248 bytes via buffered write, may repeat 2023-12-20T04:45:20.342 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 483917824 bytes via buffered write, may repeat 2023-12-20T04:45:20.342 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 484966400 bytes via buffered write, may repeat 2023-12-20T04:45:21.972 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:45:21.970+0000 7f1a5f3c2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-12-20T04:45:29.816 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:45:29.815+0000 7f1a5f3c2640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-12-20T04:45:47.277 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:45:47.280 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:46:05.439 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 486014976 bytes via buffered write, may repeat 2023-12-20T04:46:05.439 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 487063552 bytes via buffered write, may repeat 2023-12-20T04:46:05.439 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 488112128 bytes via buffered write, may repeat 2023-12-20T04:46:05.439 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 489160704 bytes via buffered write, may repeat 2023-12-20T04:46:05.439 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 490209280 bytes via buffered write, may repeat 2023-12-20T04:46:05.440 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 491257856 bytes via buffered write, may repeat 2023-12-20T04:46:05.440 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 492306432 bytes via buffered write, may repeat 2023-12-20T04:46:05.440 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 493355008 bytes via buffered write, may repeat 2023-12-20T04:46:05.440 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 494403584 bytes via buffered write, may repeat 2023-12-20T04:46:05.440 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 495452160 bytes via buffered write, may repeat 2023-12-20T04:46:05.440 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 496500736 bytes via buffered write, may repeat 2023-12-20T04:46:05.440 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 497549312 bytes via buffered write, may repeat 2023-12-20T04:46:05.440 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 498597888 bytes via buffered write, may repeat 2023-12-20T04:46:05.440 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 499646464 bytes via buffered write, may repeat 2023-12-20T04:46:05.440 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 500695040 bytes via buffered write, may repeat 2023-12-20T04:46:05.440 INFO:teuthology.orchestra.run.smithi132.stdout:done writing 500695040 bytes 2023-12-20T04:46:05.440 INFO:teuthology.orchestra.run.smithi132.stdout:successfully fsync'ed prior to getting full state reported 2023-12-20T04:46:05.440 INFO:teuthology.orchestra.run.smithi132.stdout:starting buffered write 2023-12-20T04:46:05.440 INFO:teuthology.orchestra.run.smithi132.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-20T04:46:05.440 INFO:teuthology.orchestra.run.smithi132.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-12-20T04:46:05.441 INFO:teuthology.orchestra.run.smithi132.stdout:close() returned an error as expected 2023-12-20T04:46:05.507 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:46:05.507 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:46:05.548 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:46:05.606 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:46:05.606 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:46:05.607 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:46:05.624 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:46:05.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.766+0000 7fb979617640 1 Processor -- start 2023-12-20T04:46:05.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.766+0000 7fb979617640 1 -- start start 2023-12-20T04:46:05.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.767+0000 7fb979617640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb97415ab70 0x7fb974160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:05.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.767+0000 7fb979617640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9740cf280 0x7fb974069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:05.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.767+0000 7fb979617640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb97406d530 con 0x7fb9740cf730 2023-12-20T04:46:05.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.767+0000 7fb979617640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb974070540 con 0x7fb97415ab70 2023-12-20T04:46:05.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.767+0000 7fb979617640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb974070790 con 0x7fb9740cf280 2023-12-20T04:46:05.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.768+0000 7fb972ffd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb97415ab70 0x7fb974160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:05.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.768+0000 7fb9727fc640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9740cf280 0x7fb974069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:05.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.768+0000 7fb9737fe640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fb9740cf730 0x7fb97415dad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:54362/0 (socket says 172.21.15.132:54362) 2023-12-20T04:46:05.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.768+0000 7fb972ffd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb97415ab70 0x7fb974160d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:34074/0 (socket says 172.21.15.132:34074) 2023-12-20T04:46:05.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.768+0000 7fb9737fe640 1 -- 172.21.15.132:0/3379473171 learned_addr learned my addr 172.21.15.132:0/3379473171 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:05.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.768+0000 7fb9727fc640 1 -- 172.21.15.132:0/3379473171 >> v2:172.21.15.187:3300/0 conn(0x7fb97415ab70 msgr2=0x7fb974160d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:05.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.768+0000 7fb9727fc640 1 --2- 172.21.15.132:0/3379473171 >> v2:172.21.15.187:3300/0 conn(0x7fb97415ab70 0x7fb974160d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:05.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.768+0000 7fb9727fc640 1 -- 172.21.15.132:0/3379473171 >> v1:172.21.15.187:6789/0 conn(0x7fb9740cf730 legacy=0x7fb97415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:05.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.768+0000 7fb9727fc640 1 -- 172.21.15.132:0/3379473171 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb974070a70 con 0x7fb9740cf280 2023-12-20T04:46:05.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.768+0000 7fb972ffd640 1 --2- 172.21.15.132:0/3379473171 >> v2:172.21.15.187:3300/0 conn(0x7fb97415ab70 0x7fb974160d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:46:05.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.769+0000 7fb9727fc640 1 --2- 172.21.15.132:0/3379473171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9740cf280 0x7fb974069c30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb9680097a0 tx=0x7fb96802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f6b486f4b1423104 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:05.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.769+0000 7fb971ffb640 1 -- 172.21.15.132:0/3379473171 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb968031830 con 0x7fb9740cf280 2023-12-20T04:46:05.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.769+0000 7fb971ffb640 1 -- 172.21.15.132:0/3379473171 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb968031990 con 0x7fb9740cf280 2023-12-20T04:46:05.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.769+0000 7fb971ffb640 1 -- 172.21.15.132:0/3379473171 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb968031d20 con 0x7fb9740cf280 2023-12-20T04:46:05.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.770+0000 7fb979617640 1 -- 172.21.15.132:0/3379473171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9740cf280 msgr2=0x7fb974069c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:05.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.770+0000 7fb979617640 1 --2- 172.21.15.132:0/3379473171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9740cf280 0x7fb974069c30 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fb9680097a0 tx=0x7fb96802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:46:05.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.770+0000 7fb979617640 1 -- 172.21.15.132:0/3379473171 shutdown_connections 2023-12-20T04:46:05.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.770+0000 7fb979617640 1 --2- 172.21.15.132:0/3379473171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9740cf280 0x7fb974069c30 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:05.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.770+0000 7fb979617640 1 --2- 172.21.15.132:0/3379473171 >> v2:172.21.15.187:3300/0 conn(0x7fb97415ab70 0x7fb974160d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:05.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.770+0000 7fb979617640 1 -- 172.21.15.132:0/3379473171 >> 172.21.15.132:0/3379473171 conn(0x7fb9740cfca0 msgr2=0x7fb9740d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:05.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.770+0000 7fb979617640 1 -- 172.21.15.132:0/3379473171 shutdown_connections 2023-12-20T04:46:05.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.770+0000 7fb979617640 1 -- 172.21.15.132:0/3379473171 wait complete. 2023-12-20T04:46:05.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.771+0000 7fb979617640 1 Processor -- start 2023-12-20T04:46:05.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.771+0000 7fb979617640 1 -- start start 2023-12-20T04:46:05.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.772+0000 7fb979617640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9740cf280 0x7fb974157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:05.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.772+0000 7fb979617640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9740cf730 0x7fb9740ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:05.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.772+0000 7fb979617640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb97415ab70 0x7fb974160a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:05.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.772+0000 7fb979617640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9740b0300 con 0x7fb9740cf730 2023-12-20T04:46:05.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.772+0000 7fb979617640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb974158080 con 0x7fb9740cf280 2023-12-20T04:46:05.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.772+0000 7fb979617640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9740af680 con 0x7fb97415ab70 2023-12-20T04:46:05.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.772+0000 7fb9727fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9740cf730 0x7fb9740ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:05.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.772+0000 7fb9727fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9740cf730 0x7fb9740ad2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33878/0 (socket says 172.21.15.132:33878) 2023-12-20T04:46:05.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.772+0000 7fb9727fc640 1 -- 172.21.15.132:0/3502928523 learned_addr learned my addr 172.21.15.132:0/3502928523 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:05.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.772+0000 7fb972ffd640 1 --2- 172.21.15.132:0/3502928523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9740cf280 0x7fb974157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:05.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.772+0000 7fb9737fe640 1 --2- 172.21.15.132:0/3502928523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb97415ab70 0x7fb974160a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:05.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.772+0000 7fb9727fc640 1 -- 172.21.15.132:0/3502928523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb97415ab70 msgr2=0x7fb974160a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:05.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.772+0000 7fb9727fc640 1 --2- 172.21.15.132:0/3502928523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb97415ab70 0x7fb974160a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:05.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.772+0000 7fb9727fc640 1 -- 172.21.15.132:0/3502928523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9740cf280 msgr2=0x7fb974157b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:05.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.772+0000 7fb9727fc640 1 --2- 172.21.15.132:0/3502928523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9740cf280 0x7fb974157b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:05.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.772+0000 7fb9727fc640 1 -- 172.21.15.132:0/3502928523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb964009a70 con 0x7fb9740cf730 2023-12-20T04:46:05.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.772+0000 7fb9727fc640 1 --2- 172.21.15.132:0/3502928523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9740cf730 0x7fb9740ad2f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb96802bee0 tx=0x7fb9680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:05.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.773+0000 7fb95b7fe640 1 -- 172.21.15.132:0/3502928523 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96803a6f0 con 0x7fb9740cf730 2023-12-20T04:46:05.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.773+0000 7fb95b7fe640 1 -- 172.21.15.132:0/3502928523 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb96803a870 con 0x7fb9740cf730 2023-12-20T04:46:05.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.773+0000 7fb979617640 1 -- 172.21.15.132:0/3502928523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb968009400 con 0x7fb9740cf730 2023-12-20T04:46:05.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.773+0000 7fb95b7fe640 1 -- 172.21.15.132:0/3502928523 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb96803ac20 con 0x7fb9740cf730 2023-12-20T04:46:05.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.773+0000 7fb979617640 1 -- 172.21.15.132:0/3502928523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9740afc40 con 0x7fb9740cf730 2023-12-20T04:46:05.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.774+0000 7fb979617640 1 -- 172.21.15.132:0/3502928523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9740b0440 con 0x7fb9740cf730 2023-12-20T04:46:05.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.774+0000 7fb95b7fe640 1 -- 172.21.15.132:0/3502928523 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb96804c3b0 con 0x7fb9740cf730 2023-12-20T04:46:05.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.774+0000 7fb95b7fe640 1 --2- 172.21.15.132:0/3502928523 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb96006a430 0x7fb96006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:05.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.774+0000 7fb95b7fe640 1 -- 172.21.15.132:0/3502928523 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9680aa4c0 con 0x7fb9740cf730 2023-12-20T04:46:05.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.774+0000 7fb972ffd640 1 --2- 172.21.15.132:0/3502928523 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb96006a430 0x7fb96006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:05.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.775+0000 7fb95b7fe640 1 -- 172.21.15.132:0/3502928523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7fb960071f60 con 0x7fb9740cf730 2023-12-20T04:46:05.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.775+0000 7fb972ffd640 1 --2- 172.21.15.132:0/3502928523 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb96006a430 0x7fb96006c8f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb9640114e0 tx=0x7fb96400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:05.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.779+0000 7fb95b7fe640 1 -- 172.21.15.132:0/3502928523 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb9740b0440 con 0x7fb9740cf730 2023-12-20T04:46:05.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.947+0000 7fb979617640 1 -- 172.21.15.132:0/3502928523 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb9740b0440 con 0x7fb9740cf730 2023-12-20T04:46:05.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.948+0000 7fb95b7fe640 1 -- 172.21.15.132:0/3502928523 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16203 (secure 0 0 0) 0x7fb9740b0440 con 0x7fb9740cf730 2023-12-20T04:46:05.950 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:05.950 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":69,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:45:24.984901+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:45:07.136819+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-20T04:45:07.907185+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:46:05.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.950+0000 7fb979617640 1 -- 172.21.15.132:0/3502928523 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb96006a430 msgr2=0x7fb96006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:05.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.950+0000 7fb979617640 1 --2- 172.21.15.132:0/3502928523 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb96006a430 0x7fb96006c8f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fb9640114e0 tx=0x7fb96400b040 comp rx=0 tx=0).stop 2023-12-20T04:46:05.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.950+0000 7fb979617640 1 -- 172.21.15.132:0/3502928523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9740cf730 msgr2=0x7fb9740ad2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:05.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.950+0000 7fb979617640 1 --2- 172.21.15.132:0/3502928523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9740cf730 0x7fb9740ad2f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fb96802bee0 tx=0x7fb9680046c0 comp rx=0 tx=0).stop 2023-12-20T04:46:05.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.950+0000 7fb979617640 1 -- 172.21.15.132:0/3502928523 shutdown_connections 2023-12-20T04:46:05.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.950+0000 7fb979617640 1 --2- 172.21.15.132:0/3502928523 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb96006a430 0x7fb96006c8f0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:05.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.950+0000 7fb979617640 1 --2- 172.21.15.132:0/3502928523 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb97415ab70 0x7fb974160a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:05.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.950+0000 7fb979617640 1 --2- 172.21.15.132:0/3502928523 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9740cf730 0x7fb9740ad2f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:05.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.950+0000 7fb979617640 1 --2- 172.21.15.132:0/3502928523 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9740cf280 0x7fb974157b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:05.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.950+0000 7fb979617640 1 -- 172.21.15.132:0/3502928523 >> 172.21.15.132:0/3502928523 conn(0x7fb9740cfca0 msgr2=0x7fb9741589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:05.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.950+0000 7fb979617640 1 -- 172.21.15.132:0/3502928523 shutdown_connections 2023-12-20T04:46:05.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:05.950+0000 7fb979617640 1 -- 172.21.15.132:0/3502928523 wait complete. 2023-12-20T04:46:05.963 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:45:07.136819+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:45:07.907185+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:46:05.964 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:46:06.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.065+0000 7f6b77484640 1 Processor -- start 2023-12-20T04:46:06.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.065+0000 7f6b77484640 1 -- start start 2023-12-20T04:46:06.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.066+0000 7f6b77484640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6b700cc940 0x7f6b700ccd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.066+0000 7f6b77484640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b700cb420 con 0x7f6b700cb8b0 2023-12-20T04:46:06.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.066+0000 7f6b77484640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b700cd260 con 0x7f6b700c9280 2023-12-20T04:46:06.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.066+0000 7f6b77484640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b70153ee0 con 0x7f6b700cc940 2023-12-20T04:46:06.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.066+0000 7f6b74a1f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6b700cb8b0 0x7f6b70159a00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57066/0 (socket says 172.21.15.132:57066) 2023-12-20T04:46:06.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.066+0000 7f6b74a1f640 1 -- 172.21.15.132:0/1246951100 learned_addr learned my addr 172.21.15.132:0/1246951100 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:06.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b67fff640 1 -- 172.21.15.132:0/1246951100 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1472627282 0 0) 0x7f6b700cb420 con 0x7f6b700cb8b0 2023-12-20T04:46:06.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b67fff640 1 -- 172.21.15.132:0/1246951100 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6b5c003520 con 0x7f6b700cb8b0 2023-12-20T04:46:06.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b75220640 1 --2- 172.21.15.132:0/1246951100 >> v2:172.21.15.187:3300/0 conn(0x7f6b700cc940 0x7f6b700ccd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b67fff640 1 -- 172.21.15.132:0/1246951100 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1208094985 0 0) 0x7f6b5c003520 con 0x7f6b700cb8b0 2023-12-20T04:46:06.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b67fff640 1 -- 172.21.15.132:0/1246951100 >> v2:172.21.15.187:3300/0 conn(0x7f6b700cc940 msgr2=0x7f6b700ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:06.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b67fff640 1 --2- 172.21.15.132:0/1246951100 >> v2:172.21.15.187:3300/0 conn(0x7f6b700cc940 0x7f6b700ccd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b67fff640 1 -- 172.21.15.132:0/1246951100 >> v1:172.21.15.187:6789/0 conn(0x7f6b700c9280 legacy=0x7f6b700c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b67fff640 1 -- 172.21.15.132:0/1246951100 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b700c9dc0 con 0x7f6b700cb8b0 2023-12-20T04:46:06.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b67fff640 1 -- 172.21.15.132:0/1246951100 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f6b60001670 con 0x7f6b700cb8b0 2023-12-20T04:46:06.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b67fff640 1 -- 172.21.15.132:0/1246951100 >> v1:172.21.15.132:6789/0 conn(0x7f6b700cb8b0 legacy=0x7f6b70159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b67fff640 1 --2- 172.21.15.132:0/1246951100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b5c003970 0x7f6b5c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b67fff640 1 --2- 172.21.15.132:0/1246951100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b5c0047c0 0x7f6b5c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b67fff640 1 --2- 172.21.15.132:0/1246951100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b5c005180 0x7f6b5c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b67fff640 1 -- 172.21.15.132:0/1246951100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c00c080 con 0x7f6b5c0047c0 2023-12-20T04:46:06.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b67fff640 1 -- 172.21.15.132:0/1246951100 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c00c1f0 con 0x7f6b5c003970 2023-12-20T04:46:06.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b67fff640 1 -- 172.21.15.132:0/1246951100 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b5c00c3b0 con 0x7f6b5c005180 2023-12-20T04:46:06.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b74a1f640 1 --2- 172.21.15.132:0/1246951100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b5c0047c0 0x7f6b5c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b75220640 1 --2- 172.21.15.132:0/1246951100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b5c003970 0x7f6b5c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b75a21640 1 --2- 172.21.15.132:0/1246951100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b5c005180 0x7f6b5c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b74a1f640 1 -- 172.21.15.132:0/1246951100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b5c005180 msgr2=0x7f6b5c00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:06.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b74a1f640 1 --2- 172.21.15.132:0/1246951100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b5c005180 0x7f6b5c00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b74a1f640 1 -- 172.21.15.132:0/1246951100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b5c003970 msgr2=0x7f6b5c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:06.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b74a1f640 1 --2- 172.21.15.132:0/1246951100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b5c003970 0x7f6b5c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b75a21640 1 -- 172.21.15.132:0/1246951100 reap_dead start 2023-12-20T04:46:06.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.067+0000 7f6b74a1f640 1 -- 172.21.15.132:0/1246951100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b5c003520 con 0x7f6b5c0047c0 2023-12-20T04:46:06.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.068+0000 7f6b74a1f640 1 --2- 172.21.15.132:0/1246951100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b5c0047c0 0x7f6b5c004c40 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000c240 tx=0x7f6b5c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74bc4c1c19621414 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:06.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.068+0000 7f6b67fff640 1 -- 172.21.15.132:0/1246951100 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60005ad0 con 0x7f6b5c0047c0 2023-12-20T04:46:06.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.068+0000 7f6b67fff640 1 -- 172.21.15.132:0/1246951100 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b60005c30 con 0x7f6b5c0047c0 2023-12-20T04:46:06.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.068+0000 7f6b67fff640 1 -- 172.21.15.132:0/1246951100 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6002cab0 con 0x7f6b5c0047c0 2023-12-20T04:46:06.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.069+0000 7f6b77484640 1 -- 172.21.15.132:0/1246951100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b5c0047c0 msgr2=0x7f6b5c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.069+0000 7f6b77484640 1 --2- 172.21.15.132:0/1246951100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b5c0047c0 0x7f6b5c004c40 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f6b6000c240 tx=0x7f6b5c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.069+0000 7f6b77484640 1 -- 172.21.15.132:0/1246951100 shutdown_connections 2023-12-20T04:46:06.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.069+0000 7f6b77484640 1 --2- 172.21.15.132:0/1246951100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b5c0047c0 0x7f6b5c004c40 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.069+0000 7f6b77484640 1 -- 172.21.15.132:0/1246951100 >> 172.21.15.132:0/1246951100 conn(0x7f6b7006a260 msgr2=0x7f6b700b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:06.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.069+0000 7f6b77484640 1 -- 172.21.15.132:0/1246951100 shutdown_connections 2023-12-20T04:46:06.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.069+0000 7f6b77484640 1 -- 172.21.15.132:0/1246951100 wait complete. 2023-12-20T04:46:06.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.070+0000 7f6b77484640 1 Processor -- start 2023-12-20T04:46:06.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.070+0000 7f6b77484640 1 -- start start 2023-12-20T04:46:06.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b77484640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b5c0047c0 0x7f6b700b2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b77484640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b701506f0 0x7f6b70152830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b77484640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b70146f90 0x7f6b70147410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b77484640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700b2880 con 0x7f6b701506f0 2023-12-20T04:46:06.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b77484640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700b2b60 con 0x7f6b5c0047c0 2023-12-20T04:46:06.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b77484640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b700af6d0 con 0x7f6b70146f90 2023-12-20T04:46:06.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b74a1f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b701506f0 0x7f6b70152830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b74a1f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b701506f0 0x7f6b70152830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33892/0 (socket says 172.21.15.132:33892) 2023-12-20T04:46:06.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b74a1f640 1 -- 172.21.15.132:0/2503408566 learned_addr learned my addr 172.21.15.132:0/2503408566 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:06.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b74a1f640 1 -- 172.21.15.132:0/2503408566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b70146f90 msgr2=0x7f6b70147410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b74a1f640 1 --2- 172.21.15.132:0/2503408566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b70146f90 0x7f6b70147410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b74a1f640 1 -- 172.21.15.132:0/2503408566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b5c0047c0 msgr2=0x7f6b700b2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b74a1f640 1 --2- 172.21.15.132:0/2503408566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b5c0047c0 0x7f6b700b2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b74a1f640 1 -- 172.21.15.132:0/2503408566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b700af9b0 con 0x7f6b701506f0 2023-12-20T04:46:06.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b74a1f640 1 --2- 172.21.15.132:0/2503408566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b701506f0 0x7f6b70152830 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6b60001930 tx=0x7f6b6002e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:06.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b65ffb640 1 -- 172.21.15.132:0/2503408566 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b6003c040 con 0x7f6b701506f0 2023-12-20T04:46:06.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b65ffb640 1 -- 172.21.15.132:0/2503408566 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b6002cc80 con 0x7f6b701506f0 2023-12-20T04:46:06.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b77484640 1 -- 172.21.15.132:0/2503408566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b700afc90 con 0x7f6b701506f0 2023-12-20T04:46:06.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.071+0000 7f6b65ffb640 1 -- 172.21.15.132:0/2503408566 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b60007070 con 0x7f6b701506f0 2023-12-20T04:46:06.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.072+0000 7f6b77484640 1 -- 172.21.15.132:0/2503408566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b700b2590 con 0x7f6b701506f0 2023-12-20T04:46:06.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.073+0000 7f6b77484640 1 -- 172.21.15.132:0/2503408566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b7004e840 con 0x7f6b701506f0 2023-12-20T04:46:06.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.073+0000 7f6b65ffb640 1 -- 172.21.15.132:0/2503408566 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6b60032070 con 0x7f6b701506f0 2023-12-20T04:46:06.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.073+0000 7f6b65ffb640 1 --2- 172.21.15.132:0/2503408566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b5406a460 0x7f6b5406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.074+0000 7f6b65ffb640 1 -- 172.21.15.132:0/2503408566 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6b600a9d40 con 0x7f6b701506f0 2023-12-20T04:46:06.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.074+0000 7f6b75220640 1 --2- 172.21.15.132:0/2503408566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b5406a460 0x7f6b5406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.074+0000 7f6b65ffb640 1 -- 172.21.15.132:0/2503408566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f6b54071f90 con 0x7f6b701506f0 2023-12-20T04:46:06.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.074+0000 7f6b75220640 1 --2- 172.21.15.132:0/2503408566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b5406a460 0x7f6b5406c920 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00a450 tx=0x7f6b6c00c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:06.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.078+0000 7f6b65ffb640 1 -- 172.21.15.132:0/2503408566 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6b600752a0 con 0x7f6b701506f0 2023-12-20T04:46:06.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.243+0000 7f6b77484640 1 -- 172.21.15.132:0/2503408566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6b700c48d0 con 0x7f6b701506f0 2023-12-20T04:46:06.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.244+0000 7f6b65ffb640 1 -- 172.21.15.132:0/2503408566 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6b600788c0 con 0x7f6b701506f0 2023-12-20T04:46:06.246 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:46:06.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.246+0000 7f6b77484640 1 -- 172.21.15.132:0/2503408566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b5406a460 msgr2=0x7f6b5406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.246+0000 7f6b77484640 1 --2- 172.21.15.132:0/2503408566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b5406a460 0x7f6b5406c920 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f6b6c00a450 tx=0x7f6b6c00c040 comp rx=0 tx=0).stop 2023-12-20T04:46:06.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.246+0000 7f6b77484640 1 -- 172.21.15.132:0/2503408566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b701506f0 msgr2=0x7f6b70152830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.246+0000 7f6b77484640 1 --2- 172.21.15.132:0/2503408566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b701506f0 0x7f6b70152830 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f6b60001930 tx=0x7f6b6002e070 comp rx=0 tx=0).stop 2023-12-20T04:46:06.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.246+0000 7f6b77484640 1 -- 172.21.15.132:0/2503408566 shutdown_connections 2023-12-20T04:46:06.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.246+0000 7f6b77484640 1 --2- 172.21.15.132:0/2503408566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b5406a460 0x7f6b5406c920 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.246+0000 7f6b77484640 1 --2- 172.21.15.132:0/2503408566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b70146f90 0x7f6b70147410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.246+0000 7f6b77484640 1 --2- 172.21.15.132:0/2503408566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b701506f0 0x7f6b70152830 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.246+0000 7f6b77484640 1 --2- 172.21.15.132:0/2503408566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b5c0047c0 0x7f6b700b2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.246+0000 7f6b77484640 1 -- 172.21.15.132:0/2503408566 >> 172.21.15.132:0/2503408566 conn(0x7f6b7006a260 msgr2=0x7f6b7006f350 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:06.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.246+0000 7f6b77484640 1 -- 172.21.15.132:0/2503408566 shutdown_connections 2023-12-20T04:46:06.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.246+0000 7f6b77484640 1 -- 172.21.15.132:0/2503408566 wait complete. 2023-12-20T04:46:06.259 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:46:06.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.359+0000 7f1032927640 1 Processor -- start 2023-12-20T04:46:06.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.359+0000 7f1032927640 1 -- start start 2023-12-20T04:46:06.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.360+0000 7f1032927640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f102c15d300 0x7f102c0d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.360+0000 7f1032927640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f102c0d1550 0x7f102c0cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.360+0000 7f1032927640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f102c0d01d0 con 0x7f102c0cfdc0 2023-12-20T04:46:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.360+0000 7f1032927640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f102c0d1a90 con 0x7f102c15d300 2023-12-20T04:46:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.360+0000 7f1032927640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f102c0d1d70 con 0x7f102c0d1550 2023-12-20T04:46:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.360+0000 7f102bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f102c15d300 0x7f102c0d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.360+0000 7f102bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f102c15d300 0x7f102c0d1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33898/0 (socket says 172.21.15.132:33898) 2023-12-20T04:46:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.360+0000 7f102bfff640 1 -- 172.21.15.132:0/1612470515 learned_addr learned my addr 172.21.15.132:0/1612470515 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.360+0000 7f102b7fe640 1 --2- 172.21.15.132:0/1612470515 >> v2:172.21.15.187:3300/0 conn(0x7f102c0d1550 0x7f102c0cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.360+0000 7f102bfff640 1 -- 172.21.15.132:0/1612470515 >> v2:172.21.15.187:3300/0 conn(0x7f102c0d1550 msgr2=0x7f102c0cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.360+0000 7f102bfff640 1 --2- 172.21.15.132:0/1612470515 >> v2:172.21.15.187:3300/0 conn(0x7f102c0d1550 0x7f102c0cf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.360+0000 7f102bfff640 1 -- 172.21.15.132:0/1612470515 >> v1:172.21.15.187:6789/0 conn(0x7f102c0cfdc0 legacy=0x7f102c0b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:06.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.360+0000 7f102bfff640 1 -- 172.21.15.132:0/1612470515 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f102c0d2050 con 0x7f102c15d300 2023-12-20T04:46:06.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.361+0000 7f102bfff640 1 --2- 172.21.15.132:0/1612470515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f102c15d300 0x7f102c0d1010 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f102c0d0560 tx=0x7f101c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ba71583de6667d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:06.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.361+0000 7f102affd640 1 -- 172.21.15.132:0/1612470515 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c031870 con 0x7f102c15d300 2023-12-20T04:46:06.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.361+0000 7f102affd640 1 -- 172.21.15.132:0/1612470515 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c0319d0 con 0x7f102c15d300 2023-12-20T04:46:06.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.361+0000 7f102affd640 1 -- 172.21.15.132:0/1612470515 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c031d60 con 0x7f102c15d300 2023-12-20T04:46:06.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.362+0000 7f1032927640 1 -- 172.21.15.132:0/1612470515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f102c15d300 msgr2=0x7f102c0d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.362+0000 7f1032927640 1 --2- 172.21.15.132:0/1612470515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f102c15d300 0x7f102c0d1010 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f102c0d0560 tx=0x7f101c02b910 comp rx=0 tx=0).stop 2023-12-20T04:46:06.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.362+0000 7f1032927640 1 -- 172.21.15.132:0/1612470515 shutdown_connections 2023-12-20T04:46:06.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.362+0000 7f1032927640 1 --2- 172.21.15.132:0/1612470515 >> v2:172.21.15.187:3300/0 conn(0x7f102c0d1550 0x7f102c0cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.362+0000 7f1032927640 1 --2- 172.21.15.132:0/1612470515 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f102c15d300 0x7f102c0d1010 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.362+0000 7f1032927640 1 -- 172.21.15.132:0/1612470515 >> 172.21.15.132:0/1612470515 conn(0x7f102c06a3d0 msgr2=0x7f102c06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:06.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.362+0000 7f1032927640 1 -- 172.21.15.132:0/1612470515 shutdown_connections 2023-12-20T04:46:06.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.362+0000 7f1032927640 1 -- 172.21.15.132:0/1612470515 wait complete. 2023-12-20T04:46:06.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.363+0000 7f1032927640 1 Processor -- start 2023-12-20T04:46:06.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.363+0000 7f1032927640 1 -- start start 2023-12-20T04:46:06.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f1032927640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f102c0cfdc0 0x7f102c0cc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f1032927640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f102c0d1550 0x7f102c0b5180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f1032927640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f102c15d300 0x7f102c0ca290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f1032927640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c0cc940 con 0x7f102c0cfdc0 2023-12-20T04:46:06.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f1032927640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f102c15db80 con 0x7f102c0d1550 2023-12-20T04:46:06.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f1032927640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f102c15de60 con 0x7f102c15d300 2023-12-20T04:46:06.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f102bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f102c0cfdc0 0x7f102c0cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f102bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f102c0cfdc0 0x7f102c0cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33906/0 (socket says 172.21.15.132:33906) 2023-12-20T04:46:06.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f102bfff640 1 -- 172.21.15.132:0/940794651 learned_addr learned my addr 172.21.15.132:0/940794651 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:06.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f1030ec4640 1 --2- 172.21.15.132:0/940794651 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f102c15d300 0x7f102c0ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f102b7fe640 1 --2- 172.21.15.132:0/940794651 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f102c0d1550 0x7f102c0b5180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f102bfff640 1 -- 172.21.15.132:0/940794651 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f102c15d300 msgr2=0x7f102c0ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f102bfff640 1 --2- 172.21.15.132:0/940794651 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f102c15d300 0x7f102c0ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f102bfff640 1 -- 172.21.15.132:0/940794651 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f102c0d1550 msgr2=0x7f102c0b5180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f102bfff640 1 --2- 172.21.15.132:0/940794651 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f102c0d1550 0x7f102c0b5180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f102bfff640 1 -- 172.21.15.132:0/940794651 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f101c0094d0 con 0x7f102c0cfdc0 2023-12-20T04:46:06.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f102bfff640 1 --2- 172.21.15.132:0/940794651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f102c0cfdc0 0x7f102c0cc400 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f101c000c00 tx=0x7f101c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:06.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f1028ff9640 1 -- 172.21.15.132:0/940794651 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c031840 con 0x7f102c0cfdc0 2023-12-20T04:46:06.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f1028ff9640 1 -- 172.21.15.132:0/940794651 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f101c0443f0 con 0x7f102c0cfdc0 2023-12-20T04:46:06.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f1032927640 1 -- 172.21.15.132:0/940794651 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f102c15e140 con 0x7f102c0cfdc0 2023-12-20T04:46:06.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.364+0000 7f1028ff9640 1 -- 172.21.15.132:0/940794651 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f101c0447a0 con 0x7f102c0cfdc0 2023-12-20T04:46:06.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.365+0000 7f1032927640 1 -- 172.21.15.132:0/940794651 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f102c15e700 con 0x7f102c0cfdc0 2023-12-20T04:46:06.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.365+0000 7f1032927640 1 -- 172.21.15.132:0/940794651 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f102c04e840 con 0x7f102c0cfdc0 2023-12-20T04:46:06.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.366+0000 7f1028ff9640 1 -- 172.21.15.132:0/940794651 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f101c04d450 con 0x7f102c0cfdc0 2023-12-20T04:46:06.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.366+0000 7f1028ff9640 1 --2- 172.21.15.132:0/940794651 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f100c06a430 0x7f100c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.366+0000 7f102b7fe640 1 --2- 172.21.15.132:0/940794651 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f100c06a430 0x7f100c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.366+0000 7f1028ff9640 1 -- 172.21.15.132:0/940794651 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f101c02d040 con 0x7f102c0cfdc0 2023-12-20T04:46:06.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.367+0000 7f1028ff9640 1 -- 172.21.15.132:0/940794651 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f100c071f60 con 0x7f102c0cfdc0 2023-12-20T04:46:06.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.367+0000 7f102b7fe640 1 --2- 172.21.15.132:0/940794651 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f100c06a430 0x7f100c06c8f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f102c15be10 tx=0x7f1014008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:06.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.371+0000 7f1028ff9640 1 -- 172.21.15.132:0/940794651 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f101c035070 con 0x7f102c0cfdc0 2023-12-20T04:46:06.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.534+0000 7f1032927640 1 -- 172.21.15.132:0/940794651 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f102c0d0420 con 0x7f102c0cfdc0 2023-12-20T04:46:06.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.534+0000 7f1028ff9640 1 -- 172.21.15.132:0/940794651 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f101c076640 con 0x7f102c0cfdc0 2023-12-20T04:46:06.536 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:46:06.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.536+0000 7f1032927640 1 -- 172.21.15.132:0/940794651 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f100c06a430 msgr2=0x7f100c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.536+0000 7f1032927640 1 --2- 172.21.15.132:0/940794651 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f100c06a430 0x7f100c06c8f0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f102c15be10 tx=0x7f1014008040 comp rx=0 tx=0).stop 2023-12-20T04:46:06.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.536+0000 7f1032927640 1 -- 172.21.15.132:0/940794651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f102c0cfdc0 msgr2=0x7f102c0cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.536+0000 7f1032927640 1 --2- 172.21.15.132:0/940794651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f102c0cfdc0 0x7f102c0cc400 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f101c000c00 tx=0x7f101c0046c0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.536+0000 7f1032927640 1 -- 172.21.15.132:0/940794651 shutdown_connections 2023-12-20T04:46:06.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.536+0000 7f1032927640 1 --2- 172.21.15.132:0/940794651 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f100c06a430 0x7f100c06c8f0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.536+0000 7f1032927640 1 --2- 172.21.15.132:0/940794651 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f102c15d300 0x7f102c0ca290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.536+0000 7f1032927640 1 --2- 172.21.15.132:0/940794651 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f102c0d1550 0x7f102c0b5180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.536+0000 7f1032927640 1 --2- 172.21.15.132:0/940794651 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f102c0cfdc0 0x7f102c0cc400 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.536+0000 7f1032927640 1 -- 172.21.15.132:0/940794651 >> 172.21.15.132:0/940794651 conn(0x7f102c06a3d0 msgr2=0x7f102c0b7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:06.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.536+0000 7f1032927640 1 -- 172.21.15.132:0/940794651 shutdown_connections 2023-12-20T04:46:06.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.536+0000 7f1032927640 1 -- 172.21.15.132:0/940794651 wait complete. 2023-12-20T04:46:06.549 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:46:06.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.650+0000 7f7fcc096640 1 Processor -- start 2023-12-20T04:46:06.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.650+0000 7f7fcc096640 1 -- start start 2023-12-20T04:46:06.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.651+0000 7f7fcc096640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7fc415d300 0x7f7fc40d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.651+0000 7f7fcc096640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7fc40d1550 0x7f7fc40cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.651+0000 7f7fcc096640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc40cfdc0 0x7f7fc40b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.651+0000 7f7fcc096640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc40d01f0 con 0x7f7fc40d1550 2023-12-20T04:46:06.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.651+0000 7f7fcc096640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7fc40d1a90 con 0x7f7fc415d300 2023-12-20T04:46:06.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.651+0000 7f7fcc096640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc40d1d70 con 0x7f7fc40cfdc0 2023-12-20T04:46:06.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.651+0000 7f7fc9631640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7fc40d1550 0x7f7fc40cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.651+0000 7f7fc9631640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7fc40d1550 0x7f7fc40cf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33914/0 (socket says 172.21.15.132:33914) 2023-12-20T04:46:06.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.651+0000 7f7fc9631640 1 -- 172.21.15.132:0/1567816782 learned_addr learned my addr 172.21.15.132:0/1567816782 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:06.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.651+0000 7f7fc9631640 1 -- 172.21.15.132:0/1567816782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc40cfdc0 msgr2=0x7f7fc40b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:06.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.651+0000 7f7fca633640 1 --2- 172.21.15.132:0/1567816782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc40cfdc0 0x7f7fc40b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.651+0000 7f7fc9e32640 1 --2- 172.21.15.132:0/1567816782 >> v2:172.21.15.187:3300/0 conn(0x7f7fc415d300 0x7f7fc40d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.651+0000 7f7fc9631640 1 --2- 172.21.15.132:0/1567816782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc40cfdc0 0x7f7fc40b48f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.651+0000 7f7fc9631640 1 -- 172.21.15.132:0/1567816782 >> v2:172.21.15.187:3300/0 conn(0x7f7fc415d300 msgr2=0x7f7fc40d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:06.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.651+0000 7f7fc9631640 1 --2- 172.21.15.132:0/1567816782 >> v2:172.21.15.187:3300/0 conn(0x7f7fc415d300 0x7f7fc40d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.651+0000 7f7fc9631640 1 -- 172.21.15.132:0/1567816782 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc40d2050 con 0x7f7fc40d1550 2023-12-20T04:46:06.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.651+0000 7f7fc9e32640 1 --2- 172.21.15.132:0/1567816782 >> v2:172.21.15.187:3300/0 conn(0x7f7fc415d300 0x7f7fc40d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:06.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.652+0000 7f7fc9631640 1 --2- 172.21.15.132:0/1567816782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc40d1550 0x7f7fc40cf880 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40cf850 tx=0x7f7fb402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5659f637ff01335c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:06.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.652+0000 7f7fc8e30640 1 -- 172.21.15.132:0/1567816782 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4004230 con 0x7f7fc40d1550 2023-12-20T04:46:06.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.652+0000 7f7fc8e30640 1 -- 172.21.15.132:0/1567816782 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fb4004390 con 0x7f7fc40d1550 2023-12-20T04:46:06.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.652+0000 7f7fc8e30640 1 -- 172.21.15.132:0/1567816782 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fb4003810 con 0x7f7fc40d1550 2023-12-20T04:46:06.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.653+0000 7f7fcc096640 1 -- 172.21.15.132:0/1567816782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc40d1550 msgr2=0x7f7fc40cf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.653+0000 7f7fcc096640 1 --2- 172.21.15.132:0/1567816782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc40d1550 0x7f7fc40cf880 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f7fc40cf850 tx=0x7f7fb402b8f0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.653+0000 7f7fcc096640 1 -- 172.21.15.132:0/1567816782 shutdown_connections 2023-12-20T04:46:06.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.653+0000 7f7fcc096640 1 --2- 172.21.15.132:0/1567816782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc40cfdc0 0x7f7fc40b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.653+0000 7f7fcc096640 1 --2- 172.21.15.132:0/1567816782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc40d1550 0x7f7fc40cf880 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.653+0000 7f7fcc096640 1 --2- 172.21.15.132:0/1567816782 >> v2:172.21.15.187:3300/0 conn(0x7f7fc415d300 0x7f7fc40d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.653+0000 7f7fcc096640 1 -- 172.21.15.132:0/1567816782 >> 172.21.15.132:0/1567816782 conn(0x7f7fc406a3d0 msgr2=0x7f7fc406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:06.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.653+0000 7f7fcc096640 1 -- 172.21.15.132:0/1567816782 shutdown_connections 2023-12-20T04:46:06.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.653+0000 7f7fcc096640 1 -- 172.21.15.132:0/1567816782 wait complete. 2023-12-20T04:46:06.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.654+0000 7f7fcc096640 1 Processor -- start 2023-12-20T04:46:06.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.654+0000 7f7fcc096640 1 -- start start 2023-12-20T04:46:06.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fcc096640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fc40cfdc0 0x7f7fc40b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fcc096640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc40d1550 0x7f7fc40d2da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fcc096640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc415d300 0x7f7fc40c8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fcc096640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc40c9440 con 0x7f7fc415d300 2023-12-20T04:46:06.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fcc096640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc40b2940 con 0x7f7fc40cfdc0 2023-12-20T04:46:06.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fcc096640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc40b2c20 con 0x7f7fc40d1550 2023-12-20T04:46:06.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fca633640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc415d300 0x7f7fc40c8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fca633640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc415d300 0x7f7fc40c8ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33918/0 (socket says 172.21.15.132:33918) 2023-12-20T04:46:06.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fca633640 1 -- 172.21.15.132:0/942904688 learned_addr learned my addr 172.21.15.132:0/942904688 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:06.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fc9631640 1 --2- 172.21.15.132:0/942904688 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc40d1550 0x7f7fc40d2da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fc9e32640 1 --2- 172.21.15.132:0/942904688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fc40cfdc0 0x7f7fc40b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fca633640 1 -- 172.21.15.132:0/942904688 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc40d1550 msgr2=0x7f7fc40d2da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fca633640 1 --2- 172.21.15.132:0/942904688 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc40d1550 0x7f7fc40d2da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fca633640 1 -- 172.21.15.132:0/942904688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fc40cfdc0 msgr2=0x7f7fc40b3420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fca633640 1 --2- 172.21.15.132:0/942904688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fc40cfdc0 0x7f7fc40b3420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fca633640 1 -- 172.21.15.132:0/942904688 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fb4009460 con 0x7f7fc415d300 2023-12-20T04:46:06.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fc9631640 1 --2- 172.21.15.132:0/942904688 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc40d1550 0x7f7fc40d2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:06.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fc9e32640 1 --2- 172.21.15.132:0/942904688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fc40cfdc0 0x7f7fc40b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:06.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fca633640 1 --2- 172.21.15.132:0/942904688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc415d300 0x7f7fc40c8ad0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00cc30 tx=0x7f7fbc00a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:06.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fba7fc640 1 -- 172.21.15.132:0/942904688 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc00ce40 con 0x7f7fc415d300 2023-12-20T04:46:06.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fba7fc640 1 -- 172.21.15.132:0/942904688 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7fbc003990 con 0x7f7fc415d300 2023-12-20T04:46:06.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fba7fc640 1 -- 172.21.15.132:0/942904688 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7fbc003d20 con 0x7f7fc415d300 2023-12-20T04:46:06.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fcc096640 1 -- 172.21.15.132:0/942904688 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc40b2f00 con 0x7f7fc415d300 2023-12-20T04:46:06.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.655+0000 7f7fcc096640 1 -- 172.21.15.132:0/942904688 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc40d32e0 con 0x7f7fc415d300 2023-12-20T04:46:06.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.656+0000 7f7fcc096640 1 -- 172.21.15.132:0/942904688 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc404e840 con 0x7f7fc415d300 2023-12-20T04:46:06.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.657+0000 7f7fba7fc640 1 -- 172.21.15.132:0/942904688 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7fbc003e80 con 0x7f7fc415d300 2023-12-20T04:46:06.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.657+0000 7f7fba7fc640 1 --2- 172.21.15.132:0/942904688 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7fa806a430 0x7f7fa806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.657+0000 7f7fc9e32640 1 --2- 172.21.15.132:0/942904688 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7fa806a430 0x7f7fa806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.657+0000 7f7fba7fc640 1 -- 172.21.15.132:0/942904688 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7fbc088cf0 con 0x7f7fc415d300 2023-12-20T04:46:06.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.658+0000 7f7fba7fc640 1 -- 172.21.15.132:0/942904688 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f7fa8071f60 con 0x7f7fc415d300 2023-12-20T04:46:06.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.658+0000 7f7fc9e32640 1 --2- 172.21.15.132:0/942904688 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7fa806a430 0x7f7fa806c8f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000a9b0 tx=0x7f7fc0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:06.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.662+0000 7f7fba7fc640 1 -- 172.21.15.132:0/942904688 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7fbc01d020 con 0x7f7fc415d300 2023-12-20T04:46:06.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.830+0000 7f7fcc096640 1 -- 172.21.15.132:0/942904688 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f7fc4154a30 con 0x7f7fc415d300 2023-12-20T04:46:06.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.830+0000 7f7fba7fc640 1 -- 172.21.15.132:0/942904688 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7f7fbc08d070 con 0x7f7fc415d300 2023-12-20T04:46:06.832 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:46:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.832+0000 7f7fcc096640 1 -- 172.21.15.132:0/942904688 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7fa806a430 msgr2=0x7f7fa806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.832+0000 7f7fcc096640 1 --2- 172.21.15.132:0/942904688 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7fa806a430 0x7f7fa806c8f0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f7fc000a9b0 tx=0x7f7fc0008040 comp rx=0 tx=0).stop 2023-12-20T04:46:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.832+0000 7f7fcc096640 1 -- 172.21.15.132:0/942904688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc415d300 msgr2=0x7f7fc40c8ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.832+0000 7f7fcc096640 1 --2- 172.21.15.132:0/942904688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc415d300 0x7f7fc40c8ad0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f7fbc00cc30 tx=0x7f7fbc00a5c0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.832+0000 7f7fcc096640 1 -- 172.21.15.132:0/942904688 shutdown_connections 2023-12-20T04:46:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.832+0000 7f7fcc096640 1 --2- 172.21.15.132:0/942904688 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7fa806a430 0x7f7fa806c8f0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.832+0000 7f7fcc096640 1 --2- 172.21.15.132:0/942904688 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7fc415d300 0x7f7fc40c8ad0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.832+0000 7f7fcc096640 1 --2- 172.21.15.132:0/942904688 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7fc40d1550 0x7f7fc40d2da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.832+0000 7f7fcc096640 1 --2- 172.21.15.132:0/942904688 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7fc40cfdc0 0x7f7fc40b3420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.832+0000 7f7fcc096640 1 -- 172.21.15.132:0/942904688 >> 172.21.15.132:0/942904688 conn(0x7f7fc406a3d0 msgr2=0x7f7fc4158ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:06.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.832+0000 7f7fcc096640 1 -- 172.21.15.132:0/942904688 shutdown_connections 2023-12-20T04:46:06.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.832+0000 7f7fcc096640 1 -- 172.21.15.132:0/942904688 wait complete. 2023-12-20T04:46:06.845 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:46:06.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.943+0000 7f5de9f9f640 1 Processor -- start 2023-12-20T04:46:06.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.943+0000 7f5de9f9f640 1 -- start start 2023-12-20T04:46:06.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.944+0000 7f5de9f9f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5de415af00 0x7f5de40d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.944+0000 7f5de9f9f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5de4160e80 0x7f5de415e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.944+0000 7f5de9f9f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5de415b2e0 con 0x7f5de415e570 2023-12-20T04:46:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.944+0000 7f5de9f9f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5de415dc10 con 0x7f5de4160e80 2023-12-20T04:46:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.944+0000 7f5de9f9f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de4161660 con 0x7f5de415af00 2023-12-20T04:46:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.944+0000 7f5de2ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5de4160e80 0x7f5de415e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.944+0000 7f5de2ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5de4160e80 0x7f5de415e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33920/0 (socket says 172.21.15.132:33920) 2023-12-20T04:46:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.944+0000 7f5de2ffd640 1 -- 172.21.15.132:0/731765048 learned_addr learned my addr 172.21.15.132:0/731765048 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.944+0000 7f5de37fe640 1 --2- 172.21.15.132:0/731765048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5de415af00 0x7f5de40d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.944+0000 7f5de2ffd640 1 -- 172.21.15.132:0/731765048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5de415af00 msgr2=0x7f5de40d0520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.944+0000 7f5de2ffd640 1 --2- 172.21.15.132:0/731765048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5de415af00 0x7f5de40d0520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.944+0000 7f5de2ffd640 1 -- 172.21.15.132:0/731765048 >> v1:172.21.15.187:6789/0 conn(0x7f5de415e570 legacy=0x7f5de406ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.944+0000 7f5de2ffd640 1 -- 172.21.15.132:0/731765048 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5de4161940 con 0x7f5de4160e80 2023-12-20T04:46:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.944+0000 7f5de37fe640 1 --2- 172.21.15.132:0/731765048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5de415af00 0x7f5de40d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.945+0000 7f5de2ffd640 1 --2- 172.21.15.132:0/731765048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5de4160e80 0x7f5de415e030 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8009870 tx=0x7f5dd802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0fe915a0e2c285 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:06.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.945+0000 7f5de27fc640 1 -- 172.21.15.132:0/731765048 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd80317c0 con 0x7f5de4160e80 2023-12-20T04:46:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.945+0000 7f5de27fc640 1 -- 172.21.15.132:0/731765048 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd8031920 con 0x7f5de4160e80 2023-12-20T04:46:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.945+0000 7f5de27fc640 1 -- 172.21.15.132:0/731765048 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8031cb0 con 0x7f5de4160e80 2023-12-20T04:46:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.945+0000 7f5de9f9f640 1 -- 172.21.15.132:0/731765048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5de4160e80 msgr2=0x7f5de415e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.945+0000 7f5de9f9f640 1 --2- 172.21.15.132:0/731765048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5de4160e80 0x7f5de415e030 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f5dd8009870 tx=0x7f5dd802b860 comp rx=0 tx=0).stop 2023-12-20T04:46:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.946+0000 7f5de9f9f640 1 -- 172.21.15.132:0/731765048 shutdown_connections 2023-12-20T04:46:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.946+0000 7f5de9f9f640 1 --2- 172.21.15.132:0/731765048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5de4160e80 0x7f5de415e030 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.946+0000 7f5de9f9f640 1 --2- 172.21.15.132:0/731765048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5de415af00 0x7f5de40d0520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.946+0000 7f5de9f9f640 1 -- 172.21.15.132:0/731765048 >> 172.21.15.132:0/731765048 conn(0x7f5de406d640 msgr2=0x7f5de406da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.946+0000 7f5de9f9f640 1 -- 172.21.15.132:0/731765048 shutdown_connections 2023-12-20T04:46:06.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.946+0000 7f5de9f9f640 1 -- 172.21.15.132:0/731765048 wait complete. 2023-12-20T04:46:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.947+0000 7f5de9f9f640 1 Processor -- start 2023-12-20T04:46:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.947+0000 7f5de9f9f640 1 -- start start 2023-12-20T04:46:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.947+0000 7f5de9f9f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5de415af00 0x7f5de41478c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.947+0000 7f5de9f9f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5de415e570 0x7f5de4144e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de9f9f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5de4160e80 0x7f5de4158c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de9f9f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de41594b0 con 0x7f5de415e570 2023-12-20T04:46:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de9f9f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5de4147e00 con 0x7f5de4160e80 2023-12-20T04:46:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de9f9f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5de4159750 con 0x7f5de415af00 2023-12-20T04:46:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5de415e570 0x7f5de4144e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5de415e570 0x7f5de4144e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33922/0 (socket says 172.21.15.132:33922) 2023-12-20T04:46:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de2ffd640 1 -- 172.21.15.132:0/2907463750 learned_addr learned my addr 172.21.15.132:0/2907463750 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de37fe640 1 --2- 172.21.15.132:0/2907463750 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5de415af00 0x7f5de41478c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de3fff640 1 --2- 172.21.15.132:0/2907463750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5de4160e80 0x7f5de4158c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de2ffd640 1 -- 172.21.15.132:0/2907463750 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5de415af00 msgr2=0x7f5de41478c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de2ffd640 1 --2- 172.21.15.132:0/2907463750 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5de415af00 0x7f5de41478c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de2ffd640 1 -- 172.21.15.132:0/2907463750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5de4160e80 msgr2=0x7f5de4158c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:06.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de2ffd640 1 --2- 172.21.15.132:0/2907463750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5de4160e80 0x7f5de4158c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de2ffd640 1 -- 172.21.15.132:0/2907463750 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5dd80094d0 con 0x7f5de415e570 2023-12-20T04:46:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de3fff640 1 --2- 172.21.15.132:0/2907463750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5de4160e80 0x7f5de4158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de2ffd640 1 --2- 172.21.15.132:0/2907463750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5de415e570 0x7f5de4144e50 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5dd802b8a0 tx=0x7f5dd80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5dcbfff640 1 -- 172.21.15.132:0/2907463750 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd80328e0 con 0x7f5de415e570 2023-12-20T04:46:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5dcbfff640 1 -- 172.21.15.132:0/2907463750 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5dd8032a80 con 0x7f5de415e570 2023-12-20T04:46:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de9f9f640 1 -- 172.21.15.132:0/2907463750 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5de4159a30 con 0x7f5de415e570 2023-12-20T04:46:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5dcbfff640 1 -- 172.21.15.132:0/2907463750 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5dd8032e30 con 0x7f5de415e570 2023-12-20T04:46:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.948+0000 7f5de9f9f640 1 -- 172.21.15.132:0/2907463750 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5de40ae7f0 con 0x7f5de415e570 2023-12-20T04:46:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.949+0000 7f5de9f9f640 1 -- 172.21.15.132:0/2907463750 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5de40ae9e0 con 0x7f5de415e570 2023-12-20T04:46:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.950+0000 7f5dcbfff640 1 -- 172.21.15.132:0/2907463750 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5dd804d3f0 con 0x7f5de415e570 2023-12-20T04:46:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.950+0000 7f5dcbfff640 1 --2- 172.21.15.132:0/2907463750 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5dd006a430 0x7f5dd006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.950+0000 7f5dcbfff640 1 -- 172.21.15.132:0/2907463750 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5dd80aa860 con 0x7f5de415e570 2023-12-20T04:46:06.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.950+0000 7f5de37fe640 1 --2- 172.21.15.132:0/2907463750 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5dd006a430 0x7f5dd006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:06.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.950+0000 7f5dcbfff640 1 -- 172.21.15.132:0/2907463750 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f5dd0071f60 con 0x7f5de415e570 2023-12-20T04:46:06.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.950+0000 7f5de37fe640 1 --2- 172.21.15.132:0/2907463750 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5dd006a430 0x7f5dd006c8f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400a950 tx=0x7f5dd4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:06.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:06.954+0000 7f5dcbfff640 1 -- 172.21.15.132:0/2907463750 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5dd8075ee0 con 0x7f5de415e570 2023-12-20T04:46:07.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.133+0000 7f5de9f9f640 1 -- 172.21.15.132:0/2907463750 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5de415d7e0 con 0x7f5de415e570 2023-12-20T04:46:07.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.134+0000 7f5dcbfff640 1 -- 172.21.15.132:0/2907463750 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) v1 ==== 80+0+0 (secure 0 0 0) 0x7f5dd8079500 con 0x7f5de415e570 2023-12-20T04:46:07.136 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:46:07.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.136+0000 7f5de9f9f640 1 -- 172.21.15.132:0/2907463750 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5dd006a430 msgr2=0x7f5dd006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:07.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.136+0000 7f5de9f9f640 1 --2- 172.21.15.132:0/2907463750 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5dd006a430 0x7f5dd006c8f0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x7f5dd400a950 tx=0x7f5dd4008040 comp rx=0 tx=0).stop 2023-12-20T04:46:07.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.136+0000 7f5de9f9f640 1 -- 172.21.15.132:0/2907463750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5de415e570 msgr2=0x7f5de4144e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:07.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.136+0000 7f5de9f9f640 1 --2- 172.21.15.132:0/2907463750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5de415e570 0x7f5de4144e50 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f5dd802b8a0 tx=0x7f5dd80046c0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.136+0000 7f5de9f9f640 1 -- 172.21.15.132:0/2907463750 shutdown_connections 2023-12-20T04:46:07.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.136+0000 7f5de9f9f640 1 --2- 172.21.15.132:0/2907463750 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5dd006a430 0x7f5dd006c8f0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.136+0000 7f5de9f9f640 1 --2- 172.21.15.132:0/2907463750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5de4160e80 0x7f5de4158c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.136+0000 7f5de9f9f640 1 --2- 172.21.15.132:0/2907463750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5de415e570 0x7f5de4144e50 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.136+0000 7f5de9f9f640 1 --2- 172.21.15.132:0/2907463750 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5de415af00 0x7f5de41478c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.136+0000 7f5de9f9f640 1 -- 172.21.15.132:0/2907463750 >> 172.21.15.132:0/2907463750 conn(0x7f5de406d640 msgr2=0x7f5de40afed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.136+0000 7f5de9f9f640 1 -- 172.21.15.132:0/2907463750 shutdown_connections 2023-12-20T04:46:07.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.136+0000 7f5de9f9f640 1 -- 172.21.15.132:0/2907463750 wait complete. 2023-12-20T04:46:07.149 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2023-12-20T04:46:07.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:07.149 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-20T04:46:07.174 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[101190]: fuse finished with error 0 and tester_r 0 2023-12-20T04:46:07.176 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:46:07.176 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:07.177 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-20T04:46:07.234 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:46:07.234 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:46:07.253 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:46:07.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.373+0000 7f331e751640 1 Processor -- start 2023-12-20T04:46:07.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.373+0000 7f331e751640 1 -- start start 2023-12-20T04:46:07.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.373+0000 7f331e751640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3318159d00 0x7f331815da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.373+0000 7f331e751640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331815df40 0x7f33180caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.373+0000 7f331e751640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33180cafd0 0x7f331806cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.373+0000 7f331e751640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f331806c220 con 0x7f33180cafd0 2023-12-20T04:46:07.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.373+0000 7f331e751640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f331815e4c0 con 0x7f3318159d00 2023-12-20T04:46:07.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.373+0000 7f331e751640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f331815e7a0 con 0x7f331815df40 2023-12-20T04:46:07.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.374+0000 7f331ccee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33180cafd0 0x7f331806cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.374+0000 7f331ccee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f33180cafd0 0x7f331806cc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33926/0 (socket says 172.21.15.132:33926) 2023-12-20T04:46:07.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.374+0000 7f331ccee640 1 -- 172.21.15.132:0/3111685106 learned_addr learned my addr 172.21.15.132:0/3111685106 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:07.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.374+0000 7f33177fe640 1 --2- 172.21.15.132:0/3111685106 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331815df40 0x7f33180caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.374+0000 7f3317fff640 1 --2- 172.21.15.132:0/3111685106 >> v2:172.21.15.187:3300/0 conn(0x7f3318159d00 0x7f331815da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.374+0000 7f331ccee640 1 -- 172.21.15.132:0/3111685106 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331815df40 msgr2=0x7f33180caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:07.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.374+0000 7f331ccee640 1 --2- 172.21.15.132:0/3111685106 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331815df40 0x7f33180caa90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.374+0000 7f331ccee640 1 -- 172.21.15.132:0/3111685106 >> v2:172.21.15.187:3300/0 conn(0x7f3318159d00 msgr2=0x7f331815da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:07.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.374+0000 7f331ccee640 1 --2- 172.21.15.132:0/3111685106 >> v2:172.21.15.187:3300/0 conn(0x7f3318159d00 0x7f331815da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.374+0000 7f331ccee640 1 -- 172.21.15.132:0/3111685106 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f331806c430 con 0x7f33180cafd0 2023-12-20T04:46:07.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.375+0000 7f331ccee640 1 --2- 172.21.15.132:0/3111685106 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33180cafd0 0x7f331806cc30 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f331806be10 tx=0x7f331002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c47b191f497379fd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:07.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.375+0000 7f3316ffd640 1 -- 172.21.15.132:0/3111685106 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331002ca70 con 0x7f33180cafd0 2023-12-20T04:46:07.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.375+0000 7f3316ffd640 1 -- 172.21.15.132:0/3111685106 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331002cbd0 con 0x7f33180cafd0 2023-12-20T04:46:07.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.375+0000 7f3316ffd640 1 -- 172.21.15.132:0/3111685106 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33100343f0 con 0x7f33180cafd0 2023-12-20T04:46:07.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.375+0000 7f331e751640 1 -- 172.21.15.132:0/3111685106 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33180cafd0 msgr2=0x7f331806cc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:07.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.375+0000 7f331e751640 1 --2- 172.21.15.132:0/3111685106 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33180cafd0 0x7f331806cc30 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f331806be10 tx=0x7f331002bed0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.375+0000 7f331e751640 1 -- 172.21.15.132:0/3111685106 shutdown_connections 2023-12-20T04:46:07.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.375+0000 7f331e751640 1 --2- 172.21.15.132:0/3111685106 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33180cafd0 0x7f331806cc30 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.375+0000 7f331e751640 1 --2- 172.21.15.132:0/3111685106 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f331815df40 0x7f33180caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.375+0000 7f331e751640 1 --2- 172.21.15.132:0/3111685106 >> v2:172.21.15.187:3300/0 conn(0x7f3318159d00 0x7f331815da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.375+0000 7f331e751640 1 -- 172.21.15.132:0/3111685106 >> 172.21.15.132:0/3111685106 conn(0x7f33180cfca0 msgr2=0x7f33180d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:07.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.375+0000 7f331e751640 1 -- 172.21.15.132:0/3111685106 shutdown_connections 2023-12-20T04:46:07.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.375+0000 7f331e751640 1 -- 172.21.15.132:0/3111685106 wait complete. 2023-12-20T04:46:07.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.376+0000 7f331e751640 1 Processor -- start 2023-12-20T04:46:07.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.377+0000 7f331e751640 1 -- start start 2023-12-20T04:46:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.377+0000 7f331e751640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33180cafd0 0x7f331814fac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.377+0000 7f331e751640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3318159d00 0x7f331815a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.377+0000 7f331e751640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f331815df40 0x7f33180b2f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.377+0000 7f331e751640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33181f2760 con 0x7f331815df40 2023-12-20T04:46:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.377+0000 7f331e751640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33180b3a30 con 0x7f33180cafd0 2023-12-20T04:46:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.377+0000 7f331e751640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33180adbd0 con 0x7f3318159d00 2023-12-20T04:46:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.377+0000 7f331ccee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f331815df40 0x7f33180b2f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.377+0000 7f331ccee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f331815df40 0x7f33180b2f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33934/0 (socket says 172.21.15.132:33934) 2023-12-20T04:46:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.377+0000 7f331ccee640 1 -- 172.21.15.132:0/1095520766 learned_addr learned my addr 172.21.15.132:0/1095520766 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.378+0000 7f3317fff640 1 --2- 172.21.15.132:0/1095520766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33180cafd0 0x7f331814fac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.378+0000 7f33177fe640 1 --2- 172.21.15.132:0/1095520766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3318159d00 0x7f331815a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.378+0000 7f331ccee640 1 -- 172.21.15.132:0/1095520766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3318159d00 msgr2=0x7f331815a460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.378+0000 7f331ccee640 1 --2- 172.21.15.132:0/1095520766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3318159d00 0x7f331815a460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.378+0000 7f331ccee640 1 -- 172.21.15.132:0/1095520766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33180cafd0 msgr2=0x7f331814fac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.378+0000 7f331ccee640 1 --2- 172.21.15.132:0/1095520766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33180cafd0 0x7f331814fac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.378+0000 7f331ccee640 1 -- 172.21.15.132:0/1095520766 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3310009b30 con 0x7f331815df40 2023-12-20T04:46:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.378+0000 7f331ccee640 1 --2- 172.21.15.132:0/1095520766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f331815df40 0x7f33180b2f70 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3310036040 tx=0x7f3310004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.378+0000 7f3314ff9640 1 -- 172.21.15.132:0/1095520766 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3310009510 con 0x7f331815df40 2023-12-20T04:46:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.378+0000 7f3314ff9640 1 -- 172.21.15.132:0/1095520766 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f331003e450 con 0x7f331815df40 2023-12-20T04:46:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.378+0000 7f331e751640 1 -- 172.21.15.132:0/1095520766 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33180adeb0 con 0x7f331815df40 2023-12-20T04:46:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.378+0000 7f3314ff9640 1 -- 172.21.15.132:0/1095520766 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f331003e800 con 0x7f331815df40 2023-12-20T04:46:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.378+0000 7f331e751640 1 -- 172.21.15.132:0/1095520766 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33180716a0 con 0x7f331815df40 2023-12-20T04:46:07.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.379+0000 7f331e751640 1 -- 172.21.15.132:0/1095520766 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33180ae370 con 0x7f331815df40 2023-12-20T04:46:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.379+0000 7f3314ff9640 1 -- 172.21.15.132:0/1095520766 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f331003e960 con 0x7f331815df40 2023-12-20T04:46:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.380+0000 7f3314ff9640 1 --2- 172.21.15.132:0/1095520766 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f330406a430 0x7f330406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.380+0000 7f3314ff9640 1 -- 172.21.15.132:0/1095520766 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33100ab690 con 0x7f331815df40 2023-12-20T04:46:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.380+0000 7f3317fff640 1 --2- 172.21.15.132:0/1095520766 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f330406a430 0x7f330406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.380+0000 7f3314ff9640 1 -- 172.21.15.132:0/1095520766 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f3304071f60 con 0x7f331815df40 2023-12-20T04:46:07.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.380+0000 7f3317fff640 1 --2- 172.21.15.132:0/1095520766 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f330406a430 0x7f330406c8f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3308006fd0 tx=0x7f3308008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:07.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.384+0000 7f3314ff9640 1 -- 172.21.15.132:0/1095520766 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3310076c80 con 0x7f331815df40 2023-12-20T04:46:07.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.555+0000 7f331e751640 1 -- 172.21.15.132:0/1095520766 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f331804e840 con 0x7f331815df40 2023-12-20T04:46:07.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.556+0000 7f3314ff9640 1 -- 172.21.15.132:0/1095520766 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16203 (secure 0 0 0) 0x7f3310043070 con 0x7f331815df40 2023-12-20T04:46:07.558 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:07.558 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":69,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:45:24.984901+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:45:07.136819+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-20T04:45:07.907185+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:46:07.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.558+0000 7f331e751640 1 -- 172.21.15.132:0/1095520766 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f330406a430 msgr2=0x7f330406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:07.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.558+0000 7f331e751640 1 --2- 172.21.15.132:0/1095520766 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f330406a430 0x7f330406c8f0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f3308006fd0 tx=0x7f3308008040 comp rx=0 tx=0).stop 2023-12-20T04:46:07.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.558+0000 7f331e751640 1 -- 172.21.15.132:0/1095520766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f331815df40 msgr2=0x7f33180b2f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:07.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.558+0000 7f331e751640 1 --2- 172.21.15.132:0/1095520766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f331815df40 0x7f33180b2f70 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f3310036040 tx=0x7f3310004a40 comp rx=0 tx=0).stop 2023-12-20T04:46:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.558+0000 7f331e751640 1 -- 172.21.15.132:0/1095520766 shutdown_connections 2023-12-20T04:46:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.558+0000 7f331e751640 1 --2- 172.21.15.132:0/1095520766 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f330406a430 0x7f330406c8f0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.558+0000 7f331e751640 1 --2- 172.21.15.132:0/1095520766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f331815df40 0x7f33180b2f70 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.558+0000 7f331e751640 1 --2- 172.21.15.132:0/1095520766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3318159d00 0x7f331815a460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.558+0000 7f331e751640 1 --2- 172.21.15.132:0/1095520766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33180cafd0 0x7f331814fac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.558+0000 7f331e751640 1 -- 172.21.15.132:0/1095520766 >> 172.21.15.132:0/1095520766 conn(0x7f33180cfca0 msgr2=0x7f331806cea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.558+0000 7f331e751640 1 -- 172.21.15.132:0/1095520766 shutdown_connections 2023-12-20T04:46:07.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.558+0000 7f331e751640 1 -- 172.21.15.132:0/1095520766 wait complete. 2023-12-20T04:46:07.571 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:45:07.136819+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:45:07.907185+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:46:07.572 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:46:07.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.672+0000 7fe0a87ea640 1 Processor -- start 2023-12-20T04:46:07.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.672+0000 7fe0a87ea640 1 -- start start 2023-12-20T04:46:07.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.673+0000 7fe0a87ea640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0a015aee0 0x7fe0a015eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.673+0000 7fe0a87ea640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe0a00cb2b0 0x7fe0a00cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.673+0000 7fe0a87ea640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0a00cdbb0 0x7fe0a00ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.673+0000 7fe0a87ea640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a00ce040 con 0x7fe0a015aee0 2023-12-20T04:46:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.673+0000 7fe0a87ea640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0a00d0130 con 0x7fe0a00cb2b0 2023-12-20T04:46:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.673+0000 7fe0a87ea640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a015f370 con 0x7fe0a00cdbb0 2023-12-20T04:46:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.673+0000 7fe0a6586640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0a015aee0 0x7fe0a015eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.673+0000 7fe0a6586640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0a015aee0 0x7fe0a015eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34294/0 (socket says 172.21.15.132:34294) 2023-12-20T04:46:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.673+0000 7fe0a6586640 1 -- 172.21.15.132:0/1270648505 learned_addr learned my addr 172.21.15.132:0/1270648505 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.673+0000 7fe0a6d87640 1 --2- 172.21.15.132:0/1270648505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0a00cdbb0 0x7fe0a00ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.673+0000 7fe0a5d85640 1 --2- 172.21.15.132:0/1270648505 >> v2:172.21.15.187:3300/0 conn(0x7fe0a00cb2b0 0x7fe0a00cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.673+0000 7fe0a6586640 1 -- 172.21.15.132:0/1270648505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0a00cdbb0 msgr2=0x7fe0a00ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.673+0000 7fe0a6586640 1 --2- 172.21.15.132:0/1270648505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0a00cdbb0 0x7fe0a00ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.673+0000 7fe0a6586640 1 -- 172.21.15.132:0/1270648505 >> v2:172.21.15.187:3300/0 conn(0x7fe0a00cb2b0 msgr2=0x7fe0a00cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:07.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.673+0000 7fe0a6586640 1 --2- 172.21.15.132:0/1270648505 >> v2:172.21.15.187:3300/0 conn(0x7fe0a00cb2b0 0x7fe0a00cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.674+0000 7fe0a6586640 1 -- 172.21.15.132:0/1270648505 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0a015f650 con 0x7fe0a015aee0 2023-12-20T04:46:07.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.674+0000 7fe0a6586640 1 --2- 172.21.15.132:0/1270648505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0a015aee0 0x7fe0a015eb40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe09c009870 tx=0x7fe09c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c63c917ecbf925e5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:07.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.674+0000 7fe0a5584640 1 -- 172.21.15.132:0/1270648505 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c031640 con 0x7fe0a015aee0 2023-12-20T04:46:07.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.674+0000 7fe0a5584640 1 -- 172.21.15.132:0/1270648505 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c0317a0 con 0x7fe0a015aee0 2023-12-20T04:46:07.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.674+0000 7fe0a5584640 1 -- 172.21.15.132:0/1270648505 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c031b30 con 0x7fe0a015aee0 2023-12-20T04:46:07.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.675+0000 7fe0a87ea640 1 -- 172.21.15.132:0/1270648505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0a015aee0 msgr2=0x7fe0a015eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.675+0000 7fe0a87ea640 1 --2- 172.21.15.132:0/1270648505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0a015aee0 0x7fe0a015eb40 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7fe09c009870 tx=0x7fe09c02b8f0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.675+0000 7fe0a87ea640 1 -- 172.21.15.132:0/1270648505 shutdown_connections 2023-12-20T04:46:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.675+0000 7fe0a87ea640 1 --2- 172.21.15.132:0/1270648505 >> v2:172.21.15.187:3300/0 conn(0x7fe0a00cb2b0 0x7fe0a00cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.675+0000 7fe0a87ea640 1 --2- 172.21.15.132:0/1270648505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0a00cdbb0 0x7fe0a00ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.675+0000 7fe0a87ea640 1 --2- 172.21.15.132:0/1270648505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0a015aee0 0x7fe0a015eb40 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.675+0000 7fe0a87ea640 1 -- 172.21.15.132:0/1270648505 >> 172.21.15.132:0/1270648505 conn(0x7fe0a0072c60 msgr2=0x7fe0a0073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.675+0000 7fe0a87ea640 1 -- 172.21.15.132:0/1270648505 shutdown_connections 2023-12-20T04:46:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.675+0000 7fe0a87ea640 1 -- 172.21.15.132:0/1270648505 wait complete. 2023-12-20T04:46:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.676+0000 7fe0a87ea640 1 Processor -- start 2023-12-20T04:46:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.676+0000 7fe0a87ea640 1 -- start start 2023-12-20T04:46:07.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.677+0000 7fe0a87ea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0a00cb2b0 0x7fe0a015e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.677+0000 7fe0a87ea640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0a00cdbb0 0x7fe0a014fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.677+0000 7fe0a87ea640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0a015aee0 0x7fe0a01f0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.677+0000 7fe0a87ea640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a0150d60 con 0x7fe0a00cb2b0 2023-12-20T04:46:07.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.677+0000 7fe0a87ea640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a0150a80 con 0x7fe0a015aee0 2023-12-20T04:46:07.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.677+0000 7fe0a87ea640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0a015d590 con 0x7fe0a00cdbb0 2023-12-20T04:46:07.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.677+0000 7fe0a6586640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0a00cb2b0 0x7fe0a015e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.677+0000 7fe0a6586640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0a00cb2b0 0x7fe0a015e070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34310/0 (socket says 172.21.15.132:34310) 2023-12-20T04:46:07.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.677+0000 7fe0a6586640 1 -- 172.21.15.132:0/942074830 learned_addr learned my addr 172.21.15.132:0/942074830 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:07.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.677+0000 7fe0a5d85640 1 --2- 172.21.15.132:0/942074830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0a00cdbb0 0x7fe0a014fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.677+0000 7fe0a6d87640 1 --2- 172.21.15.132:0/942074830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0a015aee0 0x7fe0a01f0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.677+0000 7fe0a6586640 1 -- 172.21.15.132:0/942074830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0a00cdbb0 msgr2=0x7fe0a014fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:07.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.677+0000 7fe0a6586640 1 --2- 172.21.15.132:0/942074830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0a00cdbb0 0x7fe0a014fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.677+0000 7fe0a6586640 1 -- 172.21.15.132:0/942074830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0a015aee0 msgr2=0x7fe0a01f0fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:07.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.677+0000 7fe0a6586640 1 --2- 172.21.15.132:0/942074830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0a015aee0 0x7fe0a01f0fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.677+0000 7fe0a6586640 1 -- 172.21.15.132:0/942074830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe09c0094d0 con 0x7fe0a00cb2b0 2023-12-20T04:46:07.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.677+0000 7fe0a6d87640 1 --2- 172.21.15.132:0/942074830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0a015aee0 0x7fe0a01f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:07.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.678+0000 7fe0a6586640 1 --2- 172.21.15.132:0/942074830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0a00cb2b0 0x7fe0a015e070 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe09c000c00 tx=0x7fe09c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:07.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.678+0000 7fe096ffd640 1 -- 172.21.15.132:0/942074830 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c03ac60 con 0x7fe0a00cb2b0 2023-12-20T04:46:07.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.678+0000 7fe096ffd640 1 -- 172.21.15.132:0/942074830 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe09c03adc0 con 0x7fe0a00cb2b0 2023-12-20T04:46:07.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.678+0000 7fe0a87ea640 1 -- 172.21.15.132:0/942074830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0a015d870 con 0x7fe0a00cb2b0 2023-12-20T04:46:07.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.678+0000 7fe096ffd640 1 -- 172.21.15.132:0/942074830 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe09c044630 con 0x7fe0a00cb2b0 2023-12-20T04:46:07.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.678+0000 7fe0a87ea640 1 -- 172.21.15.132:0/942074830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0a0150120 con 0x7fe0a00cb2b0 2023-12-20T04:46:07.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.679+0000 7fe0a87ea640 1 -- 172.21.15.132:0/942074830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0a015dd90 con 0x7fe0a00cb2b0 2023-12-20T04:46:07.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.679+0000 7fe096ffd640 1 -- 172.21.15.132:0/942074830 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe09c02f050 con 0x7fe0a00cb2b0 2023-12-20T04:46:07.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.679+0000 7fe096ffd640 1 --2- 172.21.15.132:0/942074830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe08406a430 0x7fe08406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.679+0000 7fe096ffd640 1 -- 172.21.15.132:0/942074830 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe09c0aa740 con 0x7fe0a00cb2b0 2023-12-20T04:46:07.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.680+0000 7fe0a5d85640 1 --2- 172.21.15.132:0/942074830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe08406a430 0x7fe08406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.680+0000 7fe096ffd640 1 -- 172.21.15.132:0/942074830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7fe084071f60 con 0x7fe0a00cb2b0 2023-12-20T04:46:07.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.680+0000 7fe0a5d85640 1 --2- 172.21.15.132:0/942074830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe08406a430 0x7fe08406c8f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe090006fd0 tx=0x7fe090008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:07.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.684+0000 7fe096ffd640 1 -- 172.21.15.132:0/942074830 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe09c035060 con 0x7fe0a00cb2b0 2023-12-20T04:46:07.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.849+0000 7fe0a87ea640 1 -- 172.21.15.132:0/942074830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe0a004e840 con 0x7fe0a00cb2b0 2023-12-20T04:46:07.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.849+0000 7fe096ffd640 1 -- 172.21.15.132:0/942074830 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe09c035070 con 0x7fe0a00cb2b0 2023-12-20T04:46:07.851 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:46:07.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.851+0000 7fe0a87ea640 1 -- 172.21.15.132:0/942074830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe08406a430 msgr2=0x7fe08406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:07.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.851+0000 7fe0a87ea640 1 --2- 172.21.15.132:0/942074830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe08406a430 0x7fe08406c8f0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7fe090006fd0 tx=0x7fe090008040 comp rx=0 tx=0).stop 2023-12-20T04:46:07.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.851+0000 7fe0a87ea640 1 -- 172.21.15.132:0/942074830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0a00cb2b0 msgr2=0x7fe0a015e070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:07.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.851+0000 7fe0a87ea640 1 --2- 172.21.15.132:0/942074830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0a00cb2b0 0x7fe0a015e070 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7fe09c000c00 tx=0x7fe09c0046c0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.851+0000 7fe0a87ea640 1 -- 172.21.15.132:0/942074830 shutdown_connections 2023-12-20T04:46:07.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.851+0000 7fe0a87ea640 1 --2- 172.21.15.132:0/942074830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe08406a430 0x7fe08406c8f0 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.851+0000 7fe0a87ea640 1 --2- 172.21.15.132:0/942074830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe0a015aee0 0x7fe0a01f0fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.851+0000 7fe0a87ea640 1 --2- 172.21.15.132:0/942074830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0a00cdbb0 0x7fe0a014fbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.851+0000 7fe0a87ea640 1 --2- 172.21.15.132:0/942074830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0a00cb2b0 0x7fe0a015e070 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.851+0000 7fe0a87ea640 1 -- 172.21.15.132:0/942074830 >> 172.21.15.132:0/942074830 conn(0x7fe0a0072c60 msgr2=0x7fe0a00b45e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:07.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.851+0000 7fe0a87ea640 1 -- 172.21.15.132:0/942074830 shutdown_connections 2023-12-20T04:46:07.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.851+0000 7fe0a87ea640 1 -- 172.21.15.132:0/942074830 wait complete. 2023-12-20T04:46:07.864 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:46:07.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.965+0000 7f7ae2f89640 1 Processor -- start 2023-12-20T04:46:07.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.965+0000 7f7ae2f89640 1 -- start start 2023-12-20T04:46:07.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.966+0000 7f7ae2f89640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7adc1447b0 0x7f7adc0c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.966+0000 7f7ae2f89640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7adc06a340 0x7f7adc0ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.966+0000 7f7ae2f89640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7adc0c4f40 con 0x7f7adc0ca170 2023-12-20T04:46:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.966+0000 7f7ae2f89640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7adc144b90 con 0x7f7adc1447b0 2023-12-20T04:46:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.966+0000 7f7ae2f89640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0cac30 con 0x7f7adc06a340 2023-12-20T04:46:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.966+0000 7f7ae1526640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7adc06a340 0x7f7adc0ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.966+0000 7f7ae0d25640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7adc1447b0 0x7f7adc0c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.966+0000 7f7ae0d25640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7adc1447b0 0x7f7adc0c5c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:49682/0 (socket says 172.21.15.132:49682) 2023-12-20T04:46:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.966+0000 7f7ae0d25640 1 -- 172.21.15.132:0/3606330392 learned_addr learned my addr 172.21.15.132:0/3606330392 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.967+0000 7f7ae1526640 1 -- 172.21.15.132:0/3606330392 >> v2:172.21.15.187:3300/0 conn(0x7f7adc1447b0 msgr2=0x7f7adc0c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.967+0000 7f7ae1526640 1 --2- 172.21.15.132:0/3606330392 >> v2:172.21.15.187:3300/0 conn(0x7f7adc1447b0 0x7f7adc0c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.967+0000 7f7ae1526640 1 -- 172.21.15.132:0/3606330392 >> v1:172.21.15.187:6789/0 conn(0x7f7adc0ca170 legacy=0x7f7adc069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:07.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.967+0000 7f7ae1526640 1 -- 172.21.15.132:0/3606330392 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7adc0c5190 con 0x7f7adc06a340 2023-12-20T04:46:07.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.967+0000 7f7adb7fe640 1 -- 172.21.15.132:0/3606330392 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3699113074 0 0) 0x7f7adc0c4f40 con 0x7f7adc0ca170 2023-12-20T04:46:07.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.967+0000 7f7ae0d25640 1 --2- 172.21.15.132:0/3606330392 >> v2:172.21.15.187:3300/0 conn(0x7f7adc1447b0 0x7f7adc0c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:46:07.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.968+0000 7f7ae1526640 1 --2- 172.21.15.132:0/3606330392 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7adc06a340 0x7f7adc0ca5d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009d90 tx=0x7f7ad402be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d31f73099ef8864b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:07.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.968+0000 7f7adb7fe640 1 -- 172.21.15.132:0/3606330392 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad402cbc0 con 0x7f7adc06a340 2023-12-20T04:46:07.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.968+0000 7f7adb7fe640 1 -- 172.21.15.132:0/3606330392 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ad402cd20 con 0x7f7adc06a340 2023-12-20T04:46:07.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.968+0000 7f7adb7fe640 1 -- 172.21.15.132:0/3606330392 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ad4034660 con 0x7f7adc06a340 2023-12-20T04:46:07.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.968+0000 7f7ae2f89640 1 -- 172.21.15.132:0/3606330392 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7adc06a340 msgr2=0x7f7adc0ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.968+0000 7f7ae2f89640 1 --2- 172.21.15.132:0/3606330392 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7adc06a340 0x7f7adc0ca5d0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4009d90 tx=0x7f7ad402be10 comp rx=0 tx=0).stop 2023-12-20T04:46:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.968+0000 7f7ae2f89640 1 -- 172.21.15.132:0/3606330392 shutdown_connections 2023-12-20T04:46:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.968+0000 7f7ae2f89640 1 --2- 172.21.15.132:0/3606330392 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7adc06a340 0x7f7adc0ca5d0 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.968+0000 7f7ae2f89640 1 --2- 172.21.15.132:0/3606330392 >> v2:172.21.15.187:3300/0 conn(0x7f7adc1447b0 0x7f7adc0c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.968+0000 7f7ae2f89640 1 -- 172.21.15.132:0/3606330392 >> 172.21.15.132:0/3606330392 conn(0x7f7adc0cc630 msgr2=0x7f7adc0cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.968+0000 7f7ae2f89640 1 -- 172.21.15.132:0/3606330392 shutdown_connections 2023-12-20T04:46:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.968+0000 7f7ae2f89640 1 -- 172.21.15.132:0/3606330392 wait complete. 2023-12-20T04:46:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.969+0000 7f7ae2f89640 1 Processor -- start 2023-12-20T04:46:07.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.969+0000 7f7ae2f89640 1 -- start start 2023-12-20T04:46:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.970+0000 7f7ae2f89640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc06a340 0x7f7adc15a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.970+0000 7f7ae2f89640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7adc0ca170 0x7f7adc0b4c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.970+0000 7f7ae2f89640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7adc1447b0 0x7f7adc0b51b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.970+0000 7f7ae2f89640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0c6fc0 con 0x7f7adc06a340 2023-12-20T04:46:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.970+0000 7f7ae2f89640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0c6c90 con 0x7f7adc0ca170 2023-12-20T04:46:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.970+0000 7f7ae2f89640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7adc0b57c0 con 0x7f7adc1447b0 2023-12-20T04:46:07.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.970+0000 7f7ae0d25640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc06a340 0x7f7adc15a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.971+0000 7f7ae0d25640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc06a340 0x7f7adc15a940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34312/0 (socket says 172.21.15.132:34312) 2023-12-20T04:46:07.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.971+0000 7f7ae0d25640 1 -- 172.21.15.132:0/2647519329 learned_addr learned my addr 172.21.15.132:0/2647519329 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:07.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.971+0000 7f7adbfff640 1 --2- 172.21.15.132:0/2647519329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7adc0ca170 0x7f7adc0b4c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.971+0000 7f7ae1526640 1 --2- 172.21.15.132:0/2647519329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7adc1447b0 0x7f7adc0b51b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.971+0000 7f7ae0d25640 1 -- 172.21.15.132:0/2647519329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7adc1447b0 msgr2=0x7f7adc0b51b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:07.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.971+0000 7f7ae0d25640 1 --2- 172.21.15.132:0/2647519329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7adc1447b0 0x7f7adc0b51b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.971+0000 7f7ae0d25640 1 -- 172.21.15.132:0/2647519329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7adc0ca170 msgr2=0x7f7adc0b4c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:07.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.971+0000 7f7ae0d25640 1 --2- 172.21.15.132:0/2647519329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7adc0ca170 0x7f7adc0b4c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:07.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.971+0000 7f7ae0d25640 1 -- 172.21.15.132:0/2647519329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7acc0094d0 con 0x7f7adc06a340 2023-12-20T04:46:07.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.971+0000 7f7ae1526640 1 --2- 172.21.15.132:0/2647519329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7adc1447b0 0x7f7adc0b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:07.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.971+0000 7f7ae0d25640 1 --2- 172.21.15.132:0/2647519329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc06a340 0x7f7adc15a940 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00e9d0 tx=0x7f7acc00ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:07.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.971+0000 7f7ad97fa640 1 -- 172.21.15.132:0/2647519329 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00ca60 con 0x7f7adc06a340 2023-12-20T04:46:07.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.971+0000 7f7ad97fa640 1 -- 172.21.15.132:0/2647519329 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7acc00cbc0 con 0x7f7adc06a340 2023-12-20T04:46:07.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.971+0000 7f7ad97fa640 1 -- 172.21.15.132:0/2647519329 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7acc013470 con 0x7f7adc06a340 2023-12-20T04:46:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.971+0000 7f7ae2f89640 1 -- 172.21.15.132:0/2647519329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ad4009a70 con 0x7f7adc06a340 2023-12-20T04:46:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.971+0000 7f7ae2f89640 1 -- 172.21.15.132:0/2647519329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7adc0b5d80 con 0x7f7adc06a340 2023-12-20T04:46:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.972+0000 7f7ae2f89640 1 -- 172.21.15.132:0/2647519329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7adc141ba0 con 0x7f7adc06a340 2023-12-20T04:46:07.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.972+0000 7f7ad97fa640 1 -- 172.21.15.132:0/2647519329 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7acc0135d0 con 0x7f7adc06a340 2023-12-20T04:46:07.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.973+0000 7f7ad97fa640 1 --2- 172.21.15.132:0/2647519329 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ac806a430 0x7f7ac806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:07.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.973+0000 7f7ad97fa640 1 -- 172.21.15.132:0/2647519329 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7acc088fc0 con 0x7f7adc06a340 2023-12-20T04:46:07.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.973+0000 7f7adbfff640 1 --2- 172.21.15.132:0/2647519329 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ac806a430 0x7f7ac806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:07.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.973+0000 7f7ad97fa640 1 -- 172.21.15.132:0/2647519329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f7ac8071f60 con 0x7f7adc06a340 2023-12-20T04:46:07.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.973+0000 7f7adbfff640 1 --2- 172.21.15.132:0/2647519329 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ac806a430 0x7f7ac806c8f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7adc140b40 tx=0x7f7ad0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:07.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:07.977+0000 7f7ad97fa640 1 -- 172.21.15.132:0/2647519329 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7acc0bbca0 con 0x7f7adc06a340 2023-12-20T04:46:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.175+0000 7f7ae2f89640 1 -- 172.21.15.132:0/2647519329 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f7adc04e840 con 0x7f7adc06a340 2023-12-20T04:46:08.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.175+0000 7f7ad97fa640 1 -- 172.21.15.132:0/2647519329 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v69) v1 ==== 104+0+11 (secure 0 0 0) 0x7f7acc021020 con 0x7f7adc06a340 2023-12-20T04:46:08.177 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:46:08.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.177+0000 7f7ae2f89640 1 -- 172.21.15.132:0/2647519329 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ac806a430 msgr2=0x7f7ac806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:08.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.177+0000 7f7ae2f89640 1 --2- 172.21.15.132:0/2647519329 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ac806a430 0x7f7ac806c8f0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f7adc140b40 tx=0x7f7ad0009040 comp rx=0 tx=0).stop 2023-12-20T04:46:08.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.177+0000 7f7ae2f89640 1 -- 172.21.15.132:0/2647519329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc06a340 msgr2=0x7f7adc15a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:08.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.177+0000 7f7ae2f89640 1 --2- 172.21.15.132:0/2647519329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc06a340 0x7f7adc15a940 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f7acc00e9d0 tx=0x7f7acc00ee90 comp rx=0 tx=0).stop 2023-12-20T04:46:08.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.177+0000 7f7ae2f89640 1 -- 172.21.15.132:0/2647519329 shutdown_connections 2023-12-20T04:46:08.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.177+0000 7f7ae2f89640 1 --2- 172.21.15.132:0/2647519329 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ac806a430 0x7f7ac806c8f0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.177+0000 7f7ae2f89640 1 --2- 172.21.15.132:0/2647519329 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7adc1447b0 0x7f7adc0b51b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.177+0000 7f7ae2f89640 1 --2- 172.21.15.132:0/2647519329 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7adc0ca170 0x7f7adc0b4c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.177+0000 7f7ae2f89640 1 --2- 172.21.15.132:0/2647519329 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7adc06a340 0x7f7adc15a940 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.177+0000 7f7ae2f89640 1 -- 172.21.15.132:0/2647519329 >> 172.21.15.132:0/2647519329 conn(0x7f7adc0cc630 msgr2=0x7f7adc0b1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:08.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.177+0000 7f7ae2f89640 1 -- 172.21.15.132:0/2647519329 shutdown_connections 2023-12-20T04:46:08.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.177+0000 7f7ae2f89640 1 -- 172.21.15.132:0/2647519329 wait complete. 2023-12-20T04:46:08.190 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:46:08.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.290+0000 7f1c22dce640 1 Processor -- start 2023-12-20T04:46:08.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.290+0000 7f1c22dce640 1 -- start start 2023-12-20T04:46:08.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.291+0000 7f1c22dce640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1c1c0caee0 0x7f1c1c0c5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:08.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.291+0000 7f1c22dce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c1c06f8d0 0x7f1c1c06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:08.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.291+0000 7f1c22dce640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c1c06b960 con 0x7f1c1c06f450 2023-12-20T04:46:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.291+0000 7f1c22dce640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c0c4c30 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.291+0000 7f1c22dce640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c1c0c4390 con 0x7f1c1c0caee0 2023-12-20T04:46:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.291+0000 7f1c2136b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c1c06f8d0 0x7f1c1c06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.291+0000 7f1c2136b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c1c06f8d0 0x7f1c1c06bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34322/0 (socket says 172.21.15.132:34322) 2023-12-20T04:46:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.291+0000 7f1c2136b640 1 -- 172.21.15.132:0/2871157930 learned_addr learned my addr 172.21.15.132:0/2871157930 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.292+0000 7f1c20b6a640 1 --2- 172.21.15.132:0/2871157930 >> v2:172.21.15.187:3300/0 conn(0x7f1c1c0caee0 0x7f1c1c0c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.292+0000 7f1c2136b640 1 -- 172.21.15.132:0/2871157930 >> v2:172.21.15.187:3300/0 conn(0x7f1c1c0caee0 msgr2=0x7f1c1c0c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.292+0000 7f1c2136b640 1 --2- 172.21.15.132:0/2871157930 >> v2:172.21.15.187:3300/0 conn(0x7f1c1c0caee0 0x7f1c1c0c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.292+0000 7f1c2136b640 1 -- 172.21.15.132:0/2871157930 >> v1:172.21.15.187:6789/0 conn(0x7f1c1c06f450 legacy=0x7f1c1c0cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.292+0000 7f1c2136b640 1 -- 172.21.15.132:0/2871157930 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c1c0c4670 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.292+0000 7f1c2136b640 1 --2- 172.21.15.132:0/2871157930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c1c06f8d0 0x7f1c1c06bdf0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0c90a0 tx=0x7f1c1402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c816a76b6e3bc54e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.293+0000 7f1c1b7fe640 1 -- 172.21.15.132:0/2871157930 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c1402cb20 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.293+0000 7f1c1b7fe640 1 -- 172.21.15.132:0/2871157930 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c1402cc80 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.293+0000 7f1c1b7fe640 1 -- 172.21.15.132:0/2871157930 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c140343f0 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.293+0000 7f1c22dce640 1 -- 172.21.15.132:0/2871157930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c1c06f8d0 msgr2=0x7f1c1c06bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:08.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.293+0000 7f1c22dce640 1 --2- 172.21.15.132:0/2871157930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c1c06f8d0 0x7f1c1c06bdf0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f1c1c0c90a0 tx=0x7f1c1402bf80 comp rx=0 tx=0).stop 2023-12-20T04:46:08.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.293+0000 7f1c22dce640 1 -- 172.21.15.132:0/2871157930 shutdown_connections 2023-12-20T04:46:08.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.293+0000 7f1c22dce640 1 --2- 172.21.15.132:0/2871157930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c1c06f8d0 0x7f1c1c06bdf0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.293+0000 7f1c22dce640 1 --2- 172.21.15.132:0/2871157930 >> v2:172.21.15.187:3300/0 conn(0x7f1c1c0caee0 0x7f1c1c0c5330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.293+0000 7f1c22dce640 1 -- 172.21.15.132:0/2871157930 >> 172.21.15.132:0/2871157930 conn(0x7f1c1c06a260 msgr2=0x7f1c1c0b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:08.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.293+0000 7f1c22dce640 1 -- 172.21.15.132:0/2871157930 shutdown_connections 2023-12-20T04:46:08.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.293+0000 7f1c22dce640 1 -- 172.21.15.132:0/2871157930 wait complete. 2023-12-20T04:46:08.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.294+0000 7f1c22dce640 1 Processor -- start 2023-12-20T04:46:08.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.294+0000 7f1c22dce640 1 -- start start 2023-12-20T04:46:08.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.295+0000 7f1c22dce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c1c06f450 0x7f1c1c0ad2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:08.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.295+0000 7f1c22dce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c1c06f8d0 0x7f1c1c0c7df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:08.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.295+0000 7f1c22dce640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c1c0caee0 0x7f1c1c1f1ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:08.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.295+0000 7f1c22dce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c142330 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.295+0000 7f1c22dce640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0ad820 con 0x7f1c1c0caee0 2023-12-20T04:46:08.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.295+0000 7f1c22dce640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c1c0cc670 con 0x7f1c1c06f450 2023-12-20T04:46:08.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.295+0000 7f1c1bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c1c06f8d0 0x7f1c1c0c7df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:08.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.295+0000 7f1c1bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c1c06f8d0 0x7f1c1c0c7df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34328/0 (socket says 172.21.15.132:34328) 2023-12-20T04:46:08.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.295+0000 7f1c1bfff640 1 -- 172.21.15.132:0/460466534 learned_addr learned my addr 172.21.15.132:0/460466534 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:08.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.296+0000 7f1c20b6a640 1 --2- 172.21.15.132:0/460466534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c1c06f450 0x7f1c1c0ad2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:08.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.296+0000 7f1c2136b640 1 --2- 172.21.15.132:0/460466534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c1c0caee0 0x7f1c1c1f1ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:08.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.296+0000 7f1c1bfff640 1 -- 172.21.15.132:0/460466534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c1c06f450 msgr2=0x7f1c1c0ad2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:08.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.296+0000 7f1c1bfff640 1 --2- 172.21.15.132:0/460466534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c1c06f450 0x7f1c1c0ad2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.296+0000 7f1c1bfff640 1 -- 172.21.15.132:0/460466534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c1c0caee0 msgr2=0x7f1c1c1f1ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:08.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.296+0000 7f1c1bfff640 1 --2- 172.21.15.132:0/460466534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c1c0caee0 0x7f1c1c1f1ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.296+0000 7f1c1bfff640 1 -- 172.21.15.132:0/460466534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c14009b30 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.296+0000 7f1c20b6a640 1 --2- 172.21.15.132:0/460466534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c1c06f450 0x7f1c1c0ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:08.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.296+0000 7f1c1bfff640 1 --2- 172.21.15.132:0/460466534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c1c06f8d0 0x7f1c1c0c7df0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000c400 tx=0x7f1c1000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:08.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.296+0000 7f1c197fa640 1 -- 172.21.15.132:0/460466534 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c100052d0 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.296+0000 7f1c197fa640 1 -- 172.21.15.132:0/460466534 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c10005430 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.296+0000 7f1c22dce640 1 -- 172.21.15.132:0/460466534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c1c0cc950 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.296+0000 7f1c197fa640 1 -- 172.21.15.132:0/460466534 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c10003830 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.296+0000 7f1c22dce640 1 -- 172.21.15.132:0/460466534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c1c0ccf10 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.297+0000 7f1c22dce640 1 -- 172.21.15.132:0/460466534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c1c1424a0 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.298+0000 7f1c197fa640 1 -- 172.21.15.132:0/460466534 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1c10003990 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.298+0000 7f1c197fa640 1 --2- 172.21.15.132:0/460466534 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c0806a430 0x7f1c0806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:08.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.298+0000 7f1c197fa640 1 -- 172.21.15.132:0/460466534 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1c10087e10 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.298+0000 7f1c20b6a640 1 --2- 172.21.15.132:0/460466534 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c0806a430 0x7f1c0806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:08.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.298+0000 7f1c197fa640 1 -- 172.21.15.132:0/460466534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f1c08071f60 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.298+0000 7f1c20b6a640 1 --2- 172.21.15.132:0/460466534 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c0806a430 0x7f1c0806c8f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009b90 tx=0x7f1c0c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:08.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.302+0000 7f1c197fa640 1 -- 172.21.15.132:0/460466534 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1c100534b0 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.465+0000 7f1c22dce640 1 -- 172.21.15.132:0/460466534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f1c1c04e840 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.466+0000 7f1c197fa640 1 -- 172.21.15.132:0/460466534 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v69) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1c10017020 con 0x7f1c1c06f8d0 2023-12-20T04:46:08.468 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:46:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.468+0000 7f1c22dce640 1 -- 172.21.15.132:0/460466534 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c0806a430 msgr2=0x7f1c0806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.468+0000 7f1c22dce640 1 --2- 172.21.15.132:0/460466534 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c0806a430 0x7f1c0806c8f0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f1c0c009b90 tx=0x7f1c0c008040 comp rx=0 tx=0).stop 2023-12-20T04:46:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.468+0000 7f1c22dce640 1 -- 172.21.15.132:0/460466534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c1c06f8d0 msgr2=0x7f1c1c0c7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.468+0000 7f1c22dce640 1 --2- 172.21.15.132:0/460466534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c1c06f8d0 0x7f1c1c0c7df0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f1c1000c400 tx=0x7f1c1000c8c0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.468+0000 7f1c22dce640 1 -- 172.21.15.132:0/460466534 shutdown_connections 2023-12-20T04:46:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.468+0000 7f1c22dce640 1 --2- 172.21.15.132:0/460466534 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c0806a430 0x7f1c0806c8f0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.468+0000 7f1c22dce640 1 --2- 172.21.15.132:0/460466534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c1c0caee0 0x7f1c1c1f1ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.468+0000 7f1c22dce640 1 --2- 172.21.15.132:0/460466534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c1c06f8d0 0x7f1c1c0c7df0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.468+0000 7f1c22dce640 1 --2- 172.21.15.132:0/460466534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c1c06f450 0x7f1c1c0ad2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.468+0000 7f1c22dce640 1 -- 172.21.15.132:0/460466534 >> 172.21.15.132:0/460466534 conn(0x7f1c1c06a260 msgr2=0x7f1c1c0c4d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:08.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.468+0000 7f1c22dce640 1 -- 172.21.15.132:0/460466534 shutdown_connections 2023-12-20T04:46:08.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.468+0000 7f1c22dce640 1 -- 172.21.15.132:0/460466534 wait complete. 2023-12-20T04:46:08.481 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:46:08.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.579+0000 7fd48082c640 1 Processor -- start 2023-12-20T04:46:08.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.579+0000 7fd48082c640 1 -- start start 2023-12-20T04:46:08.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.580+0000 7fd48082c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd47c159bb0 0x7fd47c06f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:08.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.580+0000 7fd48082c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd47c06bba0 0x7fd47c0ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:08.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.580+0000 7fd48082c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd47c06c8e0 con 0x7fd47c0ad720 2023-12-20T04:46:08.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.580+0000 7fd48082c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd47c15e420 con 0x7fd47c06bba0 2023-12-20T04:46:08.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.580+0000 7fd48082c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c15e700 con 0x7fd47c159bb0 2023-12-20T04:46:08.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.580+0000 7fd47ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd47c06bba0 0x7fd47c0ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:08.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.580+0000 7fd47ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd47c06bba0 0x7fd47c0ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34332/0 (socket says 172.21.15.132:34332) 2023-12-20T04:46:08.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.580+0000 7fd47ad9d640 1 -- 172.21.15.132:0/3966042858 learned_addr learned my addr 172.21.15.132:0/3966042858 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:08.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.580+0000 7fd47a59c640 1 --2- 172.21.15.132:0/3966042858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd47c159bb0 0x7fd47c06f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:08.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.581+0000 7fd47ad9d640 1 -- 172.21.15.132:0/3966042858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd47c159bb0 msgr2=0x7fd47c06f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:08.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.581+0000 7fd47ad9d640 1 --2- 172.21.15.132:0/3966042858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd47c159bb0 0x7fd47c06f3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.581+0000 7fd47ad9d640 1 -- 172.21.15.132:0/3966042858 >> v1:172.21.15.187:6789/0 conn(0x7fd47c0ad720 legacy=0x7fd47c06b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:08.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.581+0000 7fd47ad9d640 1 -- 172.21.15.132:0/3966042858 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd47c0c9d10 con 0x7fd47c06bba0 2023-12-20T04:46:08.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.581+0000 7fd47ad9d640 1 --2- 172.21.15.132:0/3966042858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd47c06bba0 0x7fd47c0ca510 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd4740098a0 tx=0x7fd47402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=585abd3ef9135270 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:08.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.581+0000 7fd47959a640 1 -- 172.21.15.132:0/3966042858 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474031640 con 0x7fd47c06bba0 2023-12-20T04:46:08.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.581+0000 7fd47959a640 1 -- 172.21.15.132:0/3966042858 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd4740317a0 con 0x7fd47c06bba0 2023-12-20T04:46:08.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.581+0000 7fd47959a640 1 -- 172.21.15.132:0/3966042858 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd474031b30 con 0x7fd47c06bba0 2023-12-20T04:46:08.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.582+0000 7fd48082c640 1 -- 172.21.15.132:0/3966042858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd47c06bba0 msgr2=0x7fd47c0ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:08.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.582+0000 7fd48082c640 1 --2- 172.21.15.132:0/3966042858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd47c06bba0 0x7fd47c0ca510 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7fd4740098a0 tx=0x7fd47402b8f0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.582+0000 7fd48082c640 1 -- 172.21.15.132:0/3966042858 shutdown_connections 2023-12-20T04:46:08.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.582+0000 7fd48082c640 1 --2- 172.21.15.132:0/3966042858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd47c06bba0 0x7fd47c0ca510 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.582+0000 7fd48082c640 1 --2- 172.21.15.132:0/3966042858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd47c159bb0 0x7fd47c06f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.582+0000 7fd48082c640 1 -- 172.21.15.132:0/3966042858 >> 172.21.15.132:0/3966042858 conn(0x7fd47c06a260 msgr2=0x7fd47c0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:08.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.582+0000 7fd48082c640 1 -- 172.21.15.132:0/3966042858 shutdown_connections 2023-12-20T04:46:08.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.582+0000 7fd48082c640 1 -- 172.21.15.132:0/3966042858 wait complete. 2023-12-20T04:46:08.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.583+0000 7fd48082c640 1 Processor -- start 2023-12-20T04:46:08.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.583+0000 7fd48082c640 1 -- start start 2023-12-20T04:46:08.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.584+0000 7fd48082c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd47c06bba0 0x7fd47c0c83e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:08.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.584+0000 7fd48082c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd47c0ad720 0x7fd47c1f06c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:08.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.584+0000 7fd48082c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd47c159bb0 0x7fd47c15a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:08.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.584+0000 7fd48082c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c1f1880 con 0x7fd47c159bb0 2023-12-20T04:46:08.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.584+0000 7fd48082c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c1f0f80 con 0x7fd47c0ad720 2023-12-20T04:46:08.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.584+0000 7fd48082c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd47c1f1260 con 0x7fd47c06bba0 2023-12-20T04:46:08.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.584+0000 7fd47ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd47c159bb0 0x7fd47c15a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:08.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.584+0000 7fd47ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd47c159bb0 0x7fd47c15a140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34334/0 (socket says 172.21.15.132:34334) 2023-12-20T04:46:08.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.584+0000 7fd47ad9d640 1 -- 172.21.15.132:0/578023482 learned_addr learned my addr 172.21.15.132:0/578023482 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:08.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.584+0000 7fd47a59c640 1 --2- 172.21.15.132:0/578023482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd47c06bba0 0x7fd47c0c83e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:08.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.584+0000 7fd479d9b640 1 --2- 172.21.15.132:0/578023482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd47c0ad720 0x7fd47c1f06c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:08.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.584+0000 7fd47ad9d640 1 -- 172.21.15.132:0/578023482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd47c06bba0 msgr2=0x7fd47c0c83e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:08.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.584+0000 7fd47ad9d640 1 --2- 172.21.15.132:0/578023482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd47c06bba0 0x7fd47c0c83e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.584+0000 7fd47ad9d640 1 -- 172.21.15.132:0/578023482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd47c0ad720 msgr2=0x7fd47c1f06c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:08.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.584+0000 7fd47ad9d640 1 --2- 172.21.15.132:0/578023482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd47c0ad720 0x7fd47c1f06c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.584+0000 7fd47ad9d640 1 -- 172.21.15.132:0/578023482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4740094d0 con 0x7fd47c159bb0 2023-12-20T04:46:08.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.585+0000 7fd47ad9d640 1 --2- 172.21.15.132:0/578023482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd47c159bb0 0x7fd47c15a140 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd4740099c0 tx=0x7fd4740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:08.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.585+0000 7fd46affd640 1 -- 172.21.15.132:0/578023482 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd47403ac60 con 0x7fd47c159bb0 2023-12-20T04:46:08.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.585+0000 7fd46affd640 1 -- 172.21.15.132:0/578023482 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd47403adc0 con 0x7fd47c159bb0 2023-12-20T04:46:08.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.585+0000 7fd48082c640 1 -- 172.21.15.132:0/578023482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd47c1f1540 con 0x7fd47c159bb0 2023-12-20T04:46:08.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.585+0000 7fd46affd640 1 -- 172.21.15.132:0/578023482 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd4740445f0 con 0x7fd47c159bb0 2023-12-20T04:46:08.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.585+0000 7fd48082c640 1 -- 172.21.15.132:0/578023482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd47c1f0c00 con 0x7fd47c159bb0 2023-12-20T04:46:08.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.586+0000 7fd48082c640 1 -- 172.21.15.132:0/578023482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd47c04e840 con 0x7fd47c159bb0 2023-12-20T04:46:08.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.586+0000 7fd46affd640 1 -- 172.21.15.132:0/578023482 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd47402f050 con 0x7fd47c159bb0 2023-12-20T04:46:08.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.587+0000 7fd46affd640 1 --2- 172.21.15.132:0/578023482 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd45c06a430 0x7fd45c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:08.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.587+0000 7fd46affd640 1 -- 172.21.15.132:0/578023482 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd4740aa900 con 0x7fd47c159bb0 2023-12-20T04:46:08.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.587+0000 7fd47a59c640 1 --2- 172.21.15.132:0/578023482 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd45c06a430 0x7fd45c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:08.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.587+0000 7fd46affd640 1 -- 172.21.15.132:0/578023482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7fd45c071f60 con 0x7fd47c159bb0 2023-12-20T04:46:08.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.587+0000 7fd47a59c640 1 --2- 172.21.15.132:0/578023482 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd45c06a430 0x7fd45c06c8f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00f360 tx=0x7fd46c007710 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:08.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.591+0000 7fd46affd640 1 -- 172.21.15.132:0/578023482 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd474075fa0 con 0x7fd47c159bb0 2023-12-20T04:46:08.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.771+0000 7fd48082c640 1 -- 172.21.15.132:0/578023482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd47c06c450 con 0x7fd47c159bb0 2023-12-20T04:46:08.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.771+0000 7fd46affd640 1 -- 172.21.15.132:0/578023482 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v69) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd474035030 con 0x7fd47c159bb0 2023-12-20T04:46:08.773 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:46:08.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.773+0000 7fd48082c640 1 -- 172.21.15.132:0/578023482 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd45c06a430 msgr2=0x7fd45c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:08.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.773+0000 7fd48082c640 1 --2- 172.21.15.132:0/578023482 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd45c06a430 0x7fd45c06c8f0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7fd46c00f360 tx=0x7fd46c007710 comp rx=0 tx=0).stop 2023-12-20T04:46:08.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.773+0000 7fd48082c640 1 -- 172.21.15.132:0/578023482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd47c159bb0 msgr2=0x7fd47c15a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:08.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.773+0000 7fd48082c640 1 --2- 172.21.15.132:0/578023482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd47c159bb0 0x7fd47c15a140 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7fd4740099c0 tx=0x7fd4740046c0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.773+0000 7fd48082c640 1 -- 172.21.15.132:0/578023482 shutdown_connections 2023-12-20T04:46:08.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.773+0000 7fd48082c640 1 --2- 172.21.15.132:0/578023482 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd45c06a430 0x7fd45c06c8f0 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.773+0000 7fd48082c640 1 --2- 172.21.15.132:0/578023482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd47c159bb0 0x7fd47c15a140 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.773+0000 7fd48082c640 1 --2- 172.21.15.132:0/578023482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd47c0ad720 0x7fd47c1f06c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.773+0000 7fd48082c640 1 --2- 172.21.15.132:0/578023482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd47c06bba0 0x7fd47c0c83e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:08.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.773+0000 7fd48082c640 1 -- 172.21.15.132:0/578023482 >> 172.21.15.132:0/578023482 conn(0x7fd47c06a260 msgr2=0x7fd47c070710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:08.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.773+0000 7fd48082c640 1 -- 172.21.15.132:0/578023482 shutdown_connections 2023-12-20T04:46:08.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:08.773+0000 7fd48082c640 1 -- 172.21.15.132:0/578023482 wait complete. 2023-12-20T04:46:08.786 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi187.front.sepia.ceph.com... 2023-12-20T04:46:08.786 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:08.787 DEBUG:teuthology.orchestra.run.smithi187:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-20T04:46:08.818 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[87878]: fuse finished with error 0 and tester_r 0 2023-12-20T04:46:08.820 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:46:08.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:08.820 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-20T04:46:08.962 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:46:08.963 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:46:08.978 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:46:08.978 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:46:08.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:08.978 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-20T04:46:09.034 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:46:09.035 INFO:teuthology.orchestra.run.smithi132.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-20T04:46:09.035 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:46:09.035 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:46:09.054 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:46:09.054 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:46:09.054 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:09.054 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-20T04:46:09.110 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:46:09.111 INFO:teuthology.orchestra.run.smithi187.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-20T04:46:09.111 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:46:09.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.209+0000 7fb3d1ac4640 1 Processor -- start 2023-12-20T04:46:09.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.209+0000 7fb3d1ac4640 1 -- start start 2023-12-20T04:46:09.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.210+0000 7fb3d1ac4640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb3cc15cef0 0x7fb3cc0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.210+0000 7fb3d1ac4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb3cc0ad2f0 0x7fb3cc06bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.210+0000 7fb3d1ac4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3cc0ad760 con 0x7fb3cc15d2d0 2023-12-20T04:46:09.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.210+0000 7fb3d1ac4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3cc0add30 con 0x7fb3cc0ad2f0 2023-12-20T04:46:09.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.210+0000 7fb3d1ac4640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb3cc0ae010 con 0x7fb3cc15cef0 2023-12-20T04:46:09.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.210+0000 7fb3cbfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb3cc0ad2f0 0x7fb3cc06bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.210+0000 7fb3caffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb3cc15d2d0 0x7fb3cc0cd1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57920/0 (socket says 172.21.15.132:57920) 2023-12-20T04:46:09.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.210+0000 7fb3cbfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb3cc0ad2f0 0x7fb3cc06bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34342/0 (socket says 172.21.15.132:34342) 2023-12-20T04:46:09.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.210+0000 7fb3caffd640 1 -- 172.21.15.132:0/1702232179 learned_addr learned my addr 172.21.15.132:0/1702232179 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:09.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.210+0000 7fb3cb7fe640 1 --2- 172.21.15.132:0/1702232179 >> v2:172.21.15.187:3300/0 conn(0x7fb3cc15cef0 0x7fb3cc0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.210+0000 7fb3cbfff640 1 -- 172.21.15.132:0/1702232179 >> v2:172.21.15.187:3300/0 conn(0x7fb3cc15cef0 msgr2=0x7fb3cc0cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:09.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.210+0000 7fb3cbfff640 1 --2- 172.21.15.132:0/1702232179 >> v2:172.21.15.187:3300/0 conn(0x7fb3cc15cef0 0x7fb3cc0cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.210+0000 7fb3cbfff640 1 -- 172.21.15.132:0/1702232179 >> v1:172.21.15.132:6789/0 conn(0x7fb3cc15d2d0 legacy=0x7fb3cc0cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:09.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.210+0000 7fb3cbfff640 1 -- 172.21.15.132:0/1702232179 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3cc072d00 con 0x7fb3cc0ad2f0 2023-12-20T04:46:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.211+0000 7fb3cbfff640 1 --2- 172.21.15.132:0/1702232179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3cc0ad2f0 0x7fb3cc06bd00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0d0120 tx=0x7fb3c402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77073c0c9bd38373 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.211+0000 7fb3ca7fc640 1 -- 172.21.15.132:0/1702232179 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c402cd00 con 0x7fb3cc0ad2f0 2023-12-20T04:46:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.211+0000 7fb3ca7fc640 1 -- 172.21.15.132:0/1702232179 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c402ce60 con 0x7fb3cc0ad2f0 2023-12-20T04:46:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.211+0000 7fb3ca7fc640 1 -- 172.21.15.132:0/1702232179 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c4034660 con 0x7fb3cc0ad2f0 2023-12-20T04:46:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.212+0000 7fb3d1ac4640 1 -- 172.21.15.132:0/1702232179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3cc0ad2f0 msgr2=0x7fb3cc06bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.212+0000 7fb3d1ac4640 1 --2- 172.21.15.132:0/1702232179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3cc0ad2f0 0x7fb3cc06bd00 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7fb3cc0d0120 tx=0x7fb3c402bf50 comp rx=0 tx=0).stop 2023-12-20T04:46:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.212+0000 7fb3d1ac4640 1 -- 172.21.15.132:0/1702232179 shutdown_connections 2023-12-20T04:46:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.212+0000 7fb3d1ac4640 1 --2- 172.21.15.132:0/1702232179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3cc0ad2f0 0x7fb3cc06bd00 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.212+0000 7fb3d1ac4640 1 --2- 172.21.15.132:0/1702232179 >> v2:172.21.15.187:3300/0 conn(0x7fb3cc15cef0 0x7fb3cc0cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.212+0000 7fb3d1ac4640 1 -- 172.21.15.132:0/1702232179 >> 172.21.15.132:0/1702232179 conn(0x7fb3cc0cf330 msgr2=0x7fb3cc0cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.212+0000 7fb3d1ac4640 1 -- 172.21.15.132:0/1702232179 shutdown_connections 2023-12-20T04:46:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.212+0000 7fb3d1ac4640 1 -- 172.21.15.132:0/1702232179 wait complete. 2023-12-20T04:46:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.213+0000 7fb3d1ac4640 1 Processor -- start 2023-12-20T04:46:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.213+0000 7fb3d1ac4640 1 -- start start 2023-12-20T04:46:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3d1ac4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3cc0ad2f0 0x7fb3cc15d720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3d1ac4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3cc15cef0 0x7fb3cc15eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3d1ac4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3cc15d2d0 0x7fb3cc1600e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3d1ac4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc159540 con 0x7fb3cc15d2d0 2023-12-20T04:46:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3d1ac4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc1560e0 con 0x7fb3cc0ad2f0 2023-12-20T04:46:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3d1ac4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc160620 con 0x7fb3cc15cef0 2023-12-20T04:46:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3cbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3cc15d2d0 0x7fb3cc1600e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3cbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3cc15d2d0 0x7fb3cc1600e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34356/0 (socket says 172.21.15.132:34356) 2023-12-20T04:46:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3cbfff640 1 -- 172.21.15.132:0/1090911505 learned_addr learned my addr 172.21.15.132:0/1090911505 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3cb7fe640 1 --2- 172.21.15.132:0/1090911505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3cc0ad2f0 0x7fb3cc15d720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3caffd640 1 --2- 172.21.15.132:0/1090911505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3cc15cef0 0x7fb3cc15eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3cbfff640 1 -- 172.21.15.132:0/1090911505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3cc15cef0 msgr2=0x7fb3cc15eda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3cbfff640 1 --2- 172.21.15.132:0/1090911505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3cc15cef0 0x7fb3cc15eda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3cbfff640 1 -- 172.21.15.132:0/1090911505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3cc0ad2f0 msgr2=0x7fb3cc15d720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3cbfff640 1 --2- 172.21.15.132:0/1090911505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3cc0ad2f0 0x7fb3cc15d720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3cbfff640 1 -- 172.21.15.132:0/1090911505 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c4009a70 con 0x7fb3cc15d2d0 2023-12-20T04:46:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3caffd640 1 --2- 172.21.15.132:0/1090911505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3cc15cef0 0x7fb3cc15eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3cbfff640 1 --2- 172.21.15.132:0/1090911505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3cc15d2d0 0x7fb3cc1600e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009e80 tx=0x7fb3c4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3b3fff640 1 -- 172.21.15.132:0/1090911505 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c403d600 con 0x7fb3cc15d2d0 2023-12-20T04:46:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3b3fff640 1 -- 172.21.15.132:0/1090911505 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb3c403d780 con 0x7fb3cc15d2d0 2023-12-20T04:46:09.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3d1ac4640 1 -- 172.21.15.132:0/1090911505 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3cc15dd60 con 0x7fb3cc15d2d0 2023-12-20T04:46:09.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3b3fff640 1 -- 172.21.15.132:0/1090911505 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3c403db30 con 0x7fb3cc15d2d0 2023-12-20T04:46:09.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.214+0000 7fb3d1ac4640 1 -- 172.21.15.132:0/1090911505 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3cc15e5a0 con 0x7fb3cc15d2d0 2023-12-20T04:46:09.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.215+0000 7fb3d1ac4640 1 -- 172.21.15.132:0/1090911505 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3cc04e840 con 0x7fb3cc15d2d0 2023-12-20T04:46:09.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.216+0000 7fb3b3fff640 1 -- 172.21.15.132:0/1090911505 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb3c403b040 con 0x7fb3cc15d2d0 2023-12-20T04:46:09.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.216+0000 7fb3b3fff640 1 --2- 172.21.15.132:0/1090911505 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb3b806a430 0x7fb3b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.216+0000 7fb3cb7fe640 1 --2- 172.21.15.132:0/1090911505 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb3b806a430 0x7fb3b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.216+0000 7fb3b3fff640 1 -- 172.21.15.132:0/1090911505 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb3c40aaef0 con 0x7fb3cc15d2d0 2023-12-20T04:46:09.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.216+0000 7fb3b3fff640 1 -- 172.21.15.132:0/1090911505 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7fb3b8071f60 con 0x7fb3cc15d2d0 2023-12-20T04:46:09.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.217+0000 7fb3cb7fe640 1 --2- 172.21.15.132:0/1090911505 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb3b806a430 0x7fb3b806c8f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc006fd0 tx=0x7fb3bc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:09.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.221+0000 7fb3b3fff640 1 -- 172.21.15.132:0/1090911505 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb3c4039060 con 0x7fb3cc15d2d0 2023-12-20T04:46:09.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.420+0000 7fb3d1ac4640 1 -- 172.21.15.132:0/1090911505 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb3cc0b52b0 con 0x7fb3cc15d2d0 2023-12-20T04:46:09.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.421+0000 7fb3b3fff640 1 -- 172.21.15.132:0/1090911505 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4721 (secure 0 0 0) 0x7fb3c404e020 con 0x7fb3cc15d2d0 2023-12-20T04:46:09.423 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:09.423 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3967216203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":3967216203},{"type":"v1","addr":"172.21.15.132:6837","nonce":3967216203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2592935145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2592935145},{"type":"v1","addr":"172.21.15.187:6833","nonce":2592935145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2061740954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2061740954},{"type":"v1","addr":"172.21.15.132:6835","nonce":2061740954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:45:08.941383+0000","modified":"2023-12-20T04:45:11.945725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6183":{"gid":6183,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/3119150547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3119150547},{"type":"v1","addr":"172.21.15.187:6835","nonce":3119150547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-20T04:46:09.423 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 26 2023-12-20T04:46:09.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.422+0000 7fb3d1ac4640 1 -- 172.21.15.132:0/1090911505 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb3b806a430 msgr2=0x7fb3b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:09.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.422+0000 7fb3d1ac4640 1 --2- 172.21.15.132:0/1090911505 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb3b806a430 0x7fb3b806c8f0 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7fb3bc006fd0 tx=0x7fb3bc008040 comp rx=0 tx=0).stop 2023-12-20T04:46:09.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.422+0000 7fb3d1ac4640 1 -- 172.21.15.132:0/1090911505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3cc15d2d0 msgr2=0x7fb3cc1600e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:09.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.422+0000 7fb3d1ac4640 1 --2- 172.21.15.132:0/1090911505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3cc15d2d0 0x7fb3cc1600e0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7fb3c4009e80 tx=0x7fb3c4004a40 comp rx=0 tx=0).stop 2023-12-20T04:46:09.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.422+0000 7fb3d1ac4640 1 -- 172.21.15.132:0/1090911505 shutdown_connections 2023-12-20T04:46:09.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.422+0000 7fb3d1ac4640 1 --2- 172.21.15.132:0/1090911505 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb3b806a430 0x7fb3b806c8f0 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.422+0000 7fb3d1ac4640 1 --2- 172.21.15.132:0/1090911505 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb3cc15d2d0 0x7fb3cc1600e0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.422+0000 7fb3d1ac4640 1 --2- 172.21.15.132:0/1090911505 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3cc15cef0 0x7fb3cc15eda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.422+0000 7fb3d1ac4640 1 --2- 172.21.15.132:0/1090911505 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3cc0ad2f0 0x7fb3cc15d720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.422+0000 7fb3d1ac4640 1 -- 172.21.15.132:0/1090911505 >> 172.21.15.132:0/1090911505 conn(0x7fb3cc0cf330 msgr2=0x7fb3cc069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:09.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.423+0000 7fb3d1ac4640 1 -- 172.21.15.132:0/1090911505 shutdown_connections 2023-12-20T04:46:09.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.423+0000 7fb3d1ac4640 1 -- 172.21.15.132:0/1090911505 wait complete. 2023-12-20T04:46:09.436 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:46:09.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.533+0000 7f0b0d39f640 1 Processor -- start 2023-12-20T04:46:09.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.533+0000 7f0b0d39f640 1 -- start start 2023-12-20T04:46:09.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.534+0000 7f0b0d39f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0b0815ab70 0x7f0b08160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.534+0000 7f0b0d39f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b080cf280 0x7f0b08069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.534+0000 7f0b0d39f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0b080cf730 0x7f0b0806a170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.534+0000 7f0b0d39f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b0806d530 con 0x7f0b0815ab70 2023-12-20T04:46:09.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.534+0000 7f0b0d39f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b08070540 con 0x7f0b080cf730 2023-12-20T04:46:09.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.534+0000 7f0b0d39f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b08070790 con 0x7f0b080cf280 2023-12-20T04:46:09.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.534+0000 7f0b06ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0b0815ab70 0x7f0b08160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.534+0000 7f0b06ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0b0815ab70 0x7f0b08160d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34372/0 (socket says 172.21.15.132:34372) 2023-12-20T04:46:09.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.534+0000 7f0b06ffd640 1 -- 172.21.15.132:0/1127655845 learned_addr learned my addr 172.21.15.132:0/1127655845 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:09.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.534+0000 7f0b077fe640 1 --2- 172.21.15.132:0/1127655845 >> v2:172.21.15.187:3300/0 conn(0x7f0b080cf730 0x7f0b0806a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.534+0000 7f0b067fc640 1 --2- 172.21.15.132:0/1127655845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b080cf280 0x7f0b08069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.534+0000 7f0b06ffd640 1 -- 172.21.15.132:0/1127655845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b080cf280 msgr2=0x7f0b08069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:09.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.534+0000 7f0b06ffd640 1 --2- 172.21.15.132:0/1127655845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b080cf280 0x7f0b08069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.535+0000 7f0b06ffd640 1 -- 172.21.15.132:0/1127655845 >> v2:172.21.15.187:3300/0 conn(0x7f0b080cf730 msgr2=0x7f0b0806a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:09.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.535+0000 7f0b06ffd640 1 --2- 172.21.15.132:0/1127655845 >> v2:172.21.15.187:3300/0 conn(0x7f0b080cf730 0x7f0b0806a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.535+0000 7f0b06ffd640 1 -- 172.21.15.132:0/1127655845 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b08070a70 con 0x7f0b0815ab70 2023-12-20T04:46:09.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.535+0000 7f0b06ffd640 1 --2- 172.21.15.132:0/1127655845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b0815ab70 0x7f0b08160d70 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0b08070390 tx=0x7f0af802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=714cbd9f0538e96c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:09.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.535+0000 7f0b05ffb640 1 -- 172.21.15.132:0/1127655845 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8031870 con 0x7f0b0815ab70 2023-12-20T04:46:09.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.535+0000 7f0b05ffb640 1 -- 172.21.15.132:0/1127655845 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0af80319d0 con 0x7f0b0815ab70 2023-12-20T04:46:09.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.535+0000 7f0b05ffb640 1 -- 172.21.15.132:0/1127655845 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0af8031d60 con 0x7f0b0815ab70 2023-12-20T04:46:09.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.536+0000 7f0b0d39f640 1 -- 172.21.15.132:0/1127655845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b0815ab70 msgr2=0x7f0b08160d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:09.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.536+0000 7f0b0d39f640 1 --2- 172.21.15.132:0/1127655845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b0815ab70 0x7f0b08160d70 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7f0b08070390 tx=0x7f0af802b910 comp rx=0 tx=0).stop 2023-12-20T04:46:09.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.536+0000 7f0b0d39f640 1 -- 172.21.15.132:0/1127655845 shutdown_connections 2023-12-20T04:46:09.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.536+0000 7f0b0d39f640 1 --2- 172.21.15.132:0/1127655845 >> v2:172.21.15.187:3300/0 conn(0x7f0b080cf730 0x7f0b0806a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.536+0000 7f0b0d39f640 1 --2- 172.21.15.132:0/1127655845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b080cf280 0x7f0b08069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.536+0000 7f0b0d39f640 1 --2- 172.21.15.132:0/1127655845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b0815ab70 0x7f0b08160d70 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.536+0000 7f0b0d39f640 1 -- 172.21.15.132:0/1127655845 >> 172.21.15.132:0/1127655845 conn(0x7f0b080cfca0 msgr2=0x7f0b080d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:09.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.536+0000 7f0b0d39f640 1 -- 172.21.15.132:0/1127655845 shutdown_connections 2023-12-20T04:46:09.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.536+0000 7f0b0d39f640 1 -- 172.21.15.132:0/1127655845 wait complete. 2023-12-20T04:46:09.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.537+0000 7f0b0d39f640 1 Processor -- start 2023-12-20T04:46:09.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.537+0000 7f0b0d39f640 1 -- start start 2023-12-20T04:46:09.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.538+0000 7f0b0d39f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b080cf280 0x7f0b0814c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.538+0000 7f0b0d39f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b080cf730 0x7f0b080af940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.538+0000 7f0b0d39f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b0815ab70 0x7f0b080afe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.538+0000 7f0b0d39f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0814cb90 con 0x7f0b0815ab70 2023-12-20T04:46:09.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.538+0000 7f0b0d39f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0814cde0 con 0x7f0b080cf730 2023-12-20T04:46:09.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.538+0000 7f0b0d39f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b0814fc80 con 0x7f0b080cf280 2023-12-20T04:46:09.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.538+0000 7f0b077fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b0815ab70 0x7f0b080afe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.538+0000 7f0b077fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b0815ab70 0x7f0b080afe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34374/0 (socket says 172.21.15.132:34374) 2023-12-20T04:46:09.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.538+0000 7f0b077fe640 1 -- 172.21.15.132:0/3238111012 learned_addr learned my addr 172.21.15.132:0/3238111012 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:09.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.538+0000 7f0b06ffd640 1 --2- 172.21.15.132:0/3238111012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b080cf280 0x7f0b0814c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.538+0000 7f0b077fe640 1 -- 172.21.15.132:0/3238111012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b080cf280 msgr2=0x7f0b0814c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:09.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.538+0000 7f0b077fe640 1 --2- 172.21.15.132:0/3238111012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b080cf280 0x7f0b0814c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.538+0000 7f0b067fc640 1 --2- 172.21.15.132:0/3238111012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b080cf730 0x7f0b080af940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.538+0000 7f0b077fe640 1 -- 172.21.15.132:0/3238111012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b080cf730 msgr2=0x7f0b080af940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:09.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.538+0000 7f0b077fe640 1 --2- 172.21.15.132:0/3238111012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b080cf730 0x7f0b080af940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.538+0000 7f0b077fe640 1 -- 172.21.15.132:0/3238111012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0af80094d0 con 0x7f0b0815ab70 2023-12-20T04:46:09.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.539+0000 7f0b077fe640 1 --2- 172.21.15.132:0/3238111012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b0815ab70 0x7f0b080afe80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0b00007e40 tx=0x7f0b0000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:09.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.539+0000 7f0aef7fe640 1 -- 172.21.15.132:0/3238111012 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b00014620 con 0x7f0b0815ab70 2023-12-20T04:46:09.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.539+0000 7f0aef7fe640 1 -- 172.21.15.132:0/3238111012 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b0000ee90 con 0x7f0b0815ab70 2023-12-20T04:46:09.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.539+0000 7f0b0d39f640 1 -- 172.21.15.132:0/3238111012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b0814d080 con 0x7f0b0815ab70 2023-12-20T04:46:09.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.539+0000 7f0aef7fe640 1 -- 172.21.15.132:0/3238111012 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b000149e0 con 0x7f0b0815ab70 2023-12-20T04:46:09.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.539+0000 7f0b0d39f640 1 -- 172.21.15.132:0/3238111012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b0814d640 con 0x7f0b0815ab70 2023-12-20T04:46:09.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.540+0000 7f0b0d39f640 1 -- 172.21.15.132:0/3238111012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b0804e840 con 0x7f0b0815ab70 2023-12-20T04:46:09.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.540+0000 7f0aef7fe640 1 -- 172.21.15.132:0/3238111012 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0b00014b40 con 0x7f0b0815ab70 2023-12-20T04:46:09.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.540+0000 7f0aef7fe640 1 --2- 172.21.15.132:0/3238111012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0af406a430 0x7f0af406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.541+0000 7f0aef7fe640 1 -- 172.21.15.132:0/3238111012 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b00089330 con 0x7f0b0815ab70 2023-12-20T04:46:09.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.541+0000 7f0b06ffd640 1 --2- 172.21.15.132:0/3238111012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0af406a430 0x7f0af406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.541+0000 7f0aef7fe640 1 -- 172.21.15.132:0/3238111012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7f0af4071f60 con 0x7f0b0815ab70 2023-12-20T04:46:09.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.541+0000 7f0b06ffd640 1 --2- 172.21.15.132:0/3238111012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0af406a430 0x7f0af406c8f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0af8036000 tx=0x7f0af803c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:09.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.545+0000 7f0aef7fe640 1 -- 172.21.15.132:0/3238111012 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0b000548a0 con 0x7f0b0815ab70 2023-12-20T04:46:09.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.712+0000 7f0b0d39f640 1 -- 172.21.15.132:0/3238111012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0b08070d20 con 0x7f0b0815ab70 2023-12-20T04:46:09.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.713+0000 7f0aef7fe640 1 -- 172.21.15.132:0/3238111012 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v69) v1 ==== 74+0+16203 (secure 0 0 0) 0x7f0b00057ec0 con 0x7f0b0815ab70 2023-12-20T04:46:09.714 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:09.714 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":69,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:45:24.984901+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:45:07.136819+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-20T04:45:07.907185+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:46:09.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.715+0000 7f0b0d39f640 1 -- 172.21.15.132:0/3238111012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0af406a430 msgr2=0x7f0af406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:09.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.715+0000 7f0b0d39f640 1 --2- 172.21.15.132:0/3238111012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0af406a430 0x7f0af406c8f0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f0af8036000 tx=0x7f0af803c040 comp rx=0 tx=0).stop 2023-12-20T04:46:09.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.715+0000 7f0b0d39f640 1 -- 172.21.15.132:0/3238111012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b0815ab70 msgr2=0x7f0b080afe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:09.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.715+0000 7f0b0d39f640 1 --2- 172.21.15.132:0/3238111012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b0815ab70 0x7f0b080afe80 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f0b00007e40 tx=0x7f0b0000e4b0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.715+0000 7f0b0d39f640 1 -- 172.21.15.132:0/3238111012 shutdown_connections 2023-12-20T04:46:09.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.715+0000 7f0b0d39f640 1 --2- 172.21.15.132:0/3238111012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0af406a430 0x7f0af406c8f0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.715+0000 7f0b0d39f640 1 --2- 172.21.15.132:0/3238111012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b0815ab70 0x7f0b080afe80 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.715+0000 7f0b0d39f640 1 --2- 172.21.15.132:0/3238111012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b080cf730 0x7f0b080af940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.715+0000 7f0b0d39f640 1 --2- 172.21.15.132:0/3238111012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b080cf280 0x7f0b0814c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.715+0000 7f0b0d39f640 1 -- 172.21.15.132:0/3238111012 >> 172.21.15.132:0/3238111012 conn(0x7f0b080cfca0 msgr2=0x7f0b0806dcc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:09.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.715+0000 7f0b0d39f640 1 -- 172.21.15.132:0/3238111012 shutdown_connections 2023-12-20T04:46:09.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.715+0000 7f0b0d39f640 1 -- 172.21.15.132:0/3238111012 wait complete. 2023-12-20T04:46:09.727 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:45:07.136819+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 9, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:45:07.907185+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '66', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.6299999952316284, 'score_stable': 1.6299999952316284, 'optimal_score': 1, 'raw_score_acting': 1.6299999952316284, 'raw_score_stable': 1.6299999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:46:09.728 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:46:09.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.830+0000 7faa61b20640 1 Processor -- start 2023-12-20T04:46:09.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.830+0000 7faa61b20640 1 -- start start 2023-12-20T04:46:09.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.830+0000 7faa61b20640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faa5c15aee0 0x7faa5c15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.830+0000 7faa61b20640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa5c0cb2b0 0x7faa5c0cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.831+0000 7faa61b20640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa5c0d0130 con 0x7faa5c0cdbb0 2023-12-20T04:46:09.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.831+0000 7faa61b20640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa5c0ce040 con 0x7faa5c15aee0 2023-12-20T04:46:09.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.831+0000 7faa61b20640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c15f370 con 0x7faa5c0cb2b0 2023-12-20T04:46:09.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.831+0000 7faa5b7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faa5c15aee0 0x7faa5c15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.831+0000 7faa5affd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa5c0cb2b0 0x7faa5c0cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.831+0000 7faa5bfff640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7faa5c0cdbb0 0x7faa5c0ceb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:49878/0 (socket says 172.21.15.132:49878) 2023-12-20T04:46:09.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.831+0000 7faa5b7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faa5c15aee0 0x7faa5c15eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:49746/0 (socket says 172.21.15.132:49746) 2023-12-20T04:46:09.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.831+0000 7faa5bfff640 1 -- 172.21.15.132:0/2420880521 learned_addr learned my addr 172.21.15.132:0/2420880521 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:09.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.831+0000 7faa5affd640 1 -- 172.21.15.132:0/2420880521 >> v2:172.21.15.187:3300/0 conn(0x7faa5c15aee0 msgr2=0x7faa5c15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:09.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.831+0000 7faa5affd640 1 --2- 172.21.15.132:0/2420880521 >> v2:172.21.15.187:3300/0 conn(0x7faa5c15aee0 0x7faa5c15eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.831+0000 7faa5affd640 1 -- 172.21.15.132:0/2420880521 >> v1:172.21.15.187:6789/0 conn(0x7faa5c0cdbb0 legacy=0x7faa5c0ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:09.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.831+0000 7faa5affd640 1 -- 172.21.15.132:0/2420880521 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa5c15f650 con 0x7faa5c0cb2b0 2023-12-20T04:46:09.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.831+0000 7faa5b7fe640 1 --2- 172.21.15.132:0/2420880521 >> v2:172.21.15.187:3300/0 conn(0x7faa5c15aee0 0x7faa5c15eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:46:09.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.832+0000 7faa5affd640 1 --2- 172.21.15.132:0/2420880521 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa5c0cb2b0 0x7faa5c0cd670 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faa500097a0 tx=0x7faa5002b710 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad16efedc56aa1e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:09.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.832+0000 7faa5a7fc640 1 -- 172.21.15.132:0/2420880521 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50030710 con 0x7faa5c0cb2b0 2023-12-20T04:46:09.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.832+0000 7faa5a7fc640 1 -- 172.21.15.132:0/2420880521 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5002e050 con 0x7faa5c0cb2b0 2023-12-20T04:46:09.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.832+0000 7faa5a7fc640 1 -- 172.21.15.132:0/2420880521 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa50030a90 con 0x7faa5c0cb2b0 2023-12-20T04:46:09.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.833+0000 7faa61b20640 1 -- 172.21.15.132:0/2420880521 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa5c0cb2b0 msgr2=0x7faa5c0cd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:09.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.833+0000 7faa61b20640 1 --2- 172.21.15.132:0/2420880521 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa5c0cb2b0 0x7faa5c0cd670 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7faa500097a0 tx=0x7faa5002b710 comp rx=0 tx=0).stop 2023-12-20T04:46:09.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.833+0000 7faa61b20640 1 -- 172.21.15.132:0/2420880521 shutdown_connections 2023-12-20T04:46:09.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.833+0000 7faa61b20640 1 --2- 172.21.15.132:0/2420880521 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa5c0cb2b0 0x7faa5c0cd670 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.833+0000 7faa61b20640 1 --2- 172.21.15.132:0/2420880521 >> v2:172.21.15.187:3300/0 conn(0x7faa5c15aee0 0x7faa5c15eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.833+0000 7faa61b20640 1 -- 172.21.15.132:0/2420880521 >> 172.21.15.132:0/2420880521 conn(0x7faa5c072c60 msgr2=0x7faa5c073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:09.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.833+0000 7faa61b20640 1 -- 172.21.15.132:0/2420880521 shutdown_connections 2023-12-20T04:46:09.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.833+0000 7faa61b20640 1 -- 172.21.15.132:0/2420880521 wait complete. 2023-12-20T04:46:09.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.834+0000 7faa61b20640 1 Processor -- start 2023-12-20T04:46:09.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.834+0000 7faa61b20640 1 -- start start 2023-12-20T04:46:09.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa61b20640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa5c0cb2b0 0x7faa5c0c9940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa61b20640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa5c0cdbb0 0x7faa5c157d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa61b20640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa5c15aee0 0x7faa5c0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa61b20640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c0caf70 con 0x7faa5c0cdbb0 2023-12-20T04:46:09.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa61b20640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c0c9e80 con 0x7faa5c0cb2b0 2023-12-20T04:46:09.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa61b20640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa5c0c9180 con 0x7faa5c15aee0 2023-12-20T04:46:09.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa5affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa5c0cdbb0 0x7faa5c157d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa5affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa5c0cdbb0 0x7faa5c157d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34384/0 (socket says 172.21.15.132:34384) 2023-12-20T04:46:09.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa5affd640 1 -- 172.21.15.132:0/1900299837 learned_addr learned my addr 172.21.15.132:0/1900299837 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:09.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa5b7fe640 1 --2- 172.21.15.132:0/1900299837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa5c0cb2b0 0x7faa5c0c9940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa5bfff640 1 --2- 172.21.15.132:0/1900299837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa5c15aee0 0x7faa5c0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa5affd640 1 -- 172.21.15.132:0/1900299837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa5c15aee0 msgr2=0x7faa5c0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:09.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa5affd640 1 --2- 172.21.15.132:0/1900299837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa5c15aee0 0x7faa5c0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa5affd640 1 -- 172.21.15.132:0/1900299837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa5c0cb2b0 msgr2=0x7faa5c0c9940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:09.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa5affd640 1 --2- 172.21.15.132:0/1900299837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa5c0cb2b0 0x7faa5c0c9940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:09.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa5affd640 1 -- 172.21.15.132:0/1900299837 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa4c009400 con 0x7faa5c0cdbb0 2023-12-20T04:46:09.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa5b7fe640 1 --2- 172.21.15.132:0/1900299837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa5c0cb2b0 0x7faa5c0c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:09.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.835+0000 7faa5bfff640 1 --2- 172.21.15.132:0/1900299837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa5c15aee0 0x7faa5c0c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:09.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.836+0000 7faa5affd640 1 --2- 172.21.15.132:0/1900299837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa5c0cdbb0 0x7faa5c157d20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7faa50035040 tx=0x7faa500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:09.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.836+0000 7faa43fff640 1 -- 172.21.15.132:0/1900299837 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5003b8d0 con 0x7faa5c0cdbb0 2023-12-20T04:46:09.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.836+0000 7faa43fff640 1 -- 172.21.15.132:0/1900299837 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa5003ba50 con 0x7faa5c0cdbb0 2023-12-20T04:46:09.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.836+0000 7faa43fff640 1 -- 172.21.15.132:0/1900299837 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa5003be00 con 0x7faa5c0cdbb0 2023-12-20T04:46:09.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.836+0000 7faa61b20640 1 -- 172.21.15.132:0/1900299837 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa50009400 con 0x7faa5c0cdbb0 2023-12-20T04:46:09.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.836+0000 7faa61b20640 1 -- 172.21.15.132:0/1900299837 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa5c0ca0e0 con 0x7faa5c0cdbb0 2023-12-20T04:46:09.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.837+0000 7faa61b20640 1 -- 172.21.15.132:0/1900299837 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa5c04e840 con 0x7faa5c0cdbb0 2023-12-20T04:46:09.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.837+0000 7faa43fff640 1 -- 172.21.15.132:0/1900299837 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faa50039040 con 0x7faa5c0cdbb0 2023-12-20T04:46:09.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.838+0000 7faa43fff640 1 --2- 172.21.15.132:0/1900299837 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa4806a430 0x7faa4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:09.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.838+0000 7faa43fff640 1 -- 172.21.15.132:0/1900299837 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa500aa110 con 0x7faa5c0cdbb0 2023-12-20T04:46:09.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.838+0000 7faa5b7fe640 1 --2- 172.21.15.132:0/1900299837 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa4806a430 0x7faa4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:09.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.838+0000 7faa43fff640 1 -- 172.21.15.132:0/1900299837 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=70}) v3 -- 0x7faa48071f60 con 0x7faa5c0cdbb0 2023-12-20T04:46:09.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.838+0000 7faa5b7fe640 1 --2- 172.21.15.132:0/1900299837 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa4806a430 0x7faa4806c8f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0b2330 tx=0x7faa4c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:09.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:09.842+0000 7faa43fff640 1 -- 172.21.15.132:0/1900299837 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7faa50037060 con 0x7faa5c0cdbb0 2023-12-20T04:46:10.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.005+0000 7faa61b20640 1 -- 172.21.15.132:0/1900299837 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7faa5c0b2890 con 0x7faa5c0cdbb0 2023-12-20T04:46:10.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.006+0000 7faa43fff640 1 -- 172.21.15.132:0/1900299837 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v69) v1 ==== 93+0+10 (secure 0 0 0) 0x7faa5004a020 con 0x7faa5c0cdbb0 2023-12-20T04:46:10.007 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:46:10.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.007+0000 7faa61b20640 1 -- 172.21.15.132:0/1900299837 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa4806a430 msgr2=0x7faa4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.007+0000 7faa61b20640 1 --2- 172.21.15.132:0/1900299837 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa4806a430 0x7faa4806c8f0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7faa5c0b2330 tx=0x7faa4c008040 comp rx=0 tx=0).stop 2023-12-20T04:46:10.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.007+0000 7faa61b20640 1 -- 172.21.15.132:0/1900299837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa5c0cdbb0 msgr2=0x7faa5c157d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.007+0000 7faa61b20640 1 --2- 172.21.15.132:0/1900299837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa5c0cdbb0 0x7faa5c157d20 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7faa50035040 tx=0x7faa500046c0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.007+0000 7faa61b20640 1 -- 172.21.15.132:0/1900299837 shutdown_connections 2023-12-20T04:46:10.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.007+0000 7faa61b20640 1 --2- 172.21.15.132:0/1900299837 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa4806a430 0x7faa4806c8f0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.007+0000 7faa61b20640 1 --2- 172.21.15.132:0/1900299837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa5c15aee0 0x7faa5c0c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.007+0000 7faa61b20640 1 --2- 172.21.15.132:0/1900299837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa5c0cdbb0 0x7faa5c157d20 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.007+0000 7faa61b20640 1 --2- 172.21.15.132:0/1900299837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa5c0cb2b0 0x7faa5c0c9940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.007+0000 7faa61b20640 1 -- 172.21.15.132:0/1900299837 >> 172.21.15.132:0/1900299837 conn(0x7faa5c072c60 msgr2=0x7faa5c0d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:10.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.008+0000 7faa61b20640 1 -- 172.21.15.132:0/1900299837 shutdown_connections 2023-12-20T04:46:10.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.008+0000 7faa61b20640 1 -- 172.21.15.132:0/1900299837 wait complete. 2023-12-20T04:46:10.020 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:46:10.063 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:46:10.063+0000 7f1a5f3c2640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-12-20T04:46:10.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.122+0000 7faba3947640 1 Processor -- start 2023-12-20T04:46:10.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.123+0000 7faba3947640 1 -- start start 2023-12-20T04:46:10.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.123+0000 7faba3947640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fab9c15cf20 0x7fab9c06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.123+0000 7faba3947640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab9c0cd4b0 0x7fab9c0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.123+0000 7faba3947640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab9c06cc90 con 0x7fab9c15d300 2023-12-20T04:46:10.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.123+0000 7faba3947640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab9c0cde80 con 0x7fab9c15cf20 2023-12-20T04:46:10.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.123+0000 7faba3947640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c0b2f30 con 0x7fab9c0cd4b0 2023-12-20T04:46:10.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.123+0000 7faba0ee2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fab9c15d300 0x7fab9c161700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57924/0 (socket says 172.21.15.132:57924) 2023-12-20T04:46:10.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.123+0000 7faba0ee2640 1 -- 172.21.15.132:0/3316638389 learned_addr learned my addr 172.21.15.132:0/3316638389 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:10.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7fab93fff640 1 -- 172.21.15.132:0/3316638389 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 427791032 0 0) 0x7fab9c06cc90 con 0x7fab9c15d300 2023-12-20T04:46:10.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7fab93fff640 1 -- 172.21.15.132:0/3316638389 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab88003520 con 0x7fab9c15d300 2023-12-20T04:46:10.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7faba16e3640 1 --2- 172.21.15.132:0/3316638389 >> v2:172.21.15.187:3300/0 conn(0x7fab9c15cf20 0x7fab9c06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7faba1ee4640 1 --2- 172.21.15.132:0/3316638389 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab9c0cd4b0 0x7fab9c0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7fab93fff640 1 -- 172.21.15.132:0/3316638389 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2554908 0 0) 0x7fab88003520 con 0x7fab9c15d300 2023-12-20T04:46:10.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7fab93fff640 1 -- 172.21.15.132:0/3316638389 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab9c0cd4b0 msgr2=0x7fab9c0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:10.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7fab93fff640 1 --2- 172.21.15.132:0/3316638389 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab9c0cd4b0 0x7fab9c0cd940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7fab93fff640 1 -- 172.21.15.132:0/3316638389 >> v2:172.21.15.187:3300/0 conn(0x7fab9c15cf20 msgr2=0x7fab9c06c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:10.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7fab93fff640 1 --2- 172.21.15.132:0/3316638389 >> v2:172.21.15.187:3300/0 conn(0x7fab9c15cf20 0x7fab9c06c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7fab93fff640 1 -- 172.21.15.132:0/3316638389 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c0b3210 con 0x7fab9c15d300 2023-12-20T04:46:10.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7fab93fff640 1 -- 172.21.15.132:0/3316638389 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fab8c001690 con 0x7fab9c15d300 2023-12-20T04:46:10.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7faba16e3640 1 --2- 172.21.15.132:0/3316638389 >> v2:172.21.15.187:3300/0 conn(0x7fab9c15cf20 0x7fab9c06c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:10.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7fab93fff640 1 -- 172.21.15.132:0/3316638389 >> v1:172.21.15.132:6789/0 conn(0x7fab9c15d300 legacy=0x7fab9c161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7fab93fff640 1 --2- 172.21.15.132:0/3316638389 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab88003970 0x7fab88003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7fab93fff640 1 --2- 172.21.15.132:0/3316638389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab880047c0 0x7fab88004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7fab93fff640 1 --2- 172.21.15.132:0/3316638389 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab9c0cd4b0 0x7fab88005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7fab93fff640 1 -- 172.21.15.132:0/3316638389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c0cde80 con 0x7fab880047c0 2023-12-20T04:46:10.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7fab93fff640 1 -- 172.21.15.132:0/3316638389 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c0b2f30 con 0x7fab88003970 2023-12-20T04:46:10.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7fab93fff640 1 -- 172.21.15.132:0/3316638389 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab8800b980 con 0x7fab9c0cd4b0 2023-12-20T04:46:10.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7faba0ee2640 1 --2- 172.21.15.132:0/3316638389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab880047c0 0x7fab88004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7faba16e3640 1 --2- 172.21.15.132:0/3316638389 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab88003970 0x7fab88003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7faba1ee4640 1 --2- 172.21.15.132:0/3316638389 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab9c0cd4b0 0x7fab88005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7faba0ee2640 1 -- 172.21.15.132:0/3316638389 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab9c0cd4b0 msgr2=0x7fab88005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:10.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7faba0ee2640 1 --2- 172.21.15.132:0/3316638389 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab9c0cd4b0 0x7fab88005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7faba0ee2640 1 -- 172.21.15.132:0/3316638389 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab88003970 msgr2=0x7fab88003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:10.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7faba0ee2640 1 --2- 172.21.15.132:0/3316638389 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab88003970 0x7fab88003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.124+0000 7faba0ee2640 1 -- 172.21.15.132:0/3316638389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab88003520 con 0x7fab880047c0 2023-12-20T04:46:10.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.125+0000 7faba0ee2640 1 --2- 172.21.15.132:0/3316638389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab880047c0 0x7fab88004c40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fab8c00c210 tx=0x7fab880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd07f3c7b638ad4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:10.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.125+0000 7fab93fff640 1 -- 172.21.15.132:0/3316638389 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c005ad0 con 0x7fab880047c0 2023-12-20T04:46:10.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.125+0000 7fab93fff640 1 -- 172.21.15.132:0/3316638389 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab8c005c50 con 0x7fab880047c0 2023-12-20T04:46:10.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.125+0000 7fab93fff640 1 -- 172.21.15.132:0/3316638389 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab8c02c8b0 con 0x7fab880047c0 2023-12-20T04:46:10.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.126+0000 7faba3947640 1 -- 172.21.15.132:0/3316638389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab880047c0 msgr2=0x7fab88004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.126+0000 7faba3947640 1 --2- 172.21.15.132:0/3316638389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab880047c0 0x7fab88004c40 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7fab8c00c210 tx=0x7fab880057f0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.126+0000 7faba1ee4640 1 -- 172.21.15.132:0/3316638389 reap_dead start 2023-12-20T04:46:10.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.126+0000 7faba3947640 1 -- 172.21.15.132:0/3316638389 shutdown_connections 2023-12-20T04:46:10.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.126+0000 7faba3947640 1 -- 172.21.15.132:0/3316638389 >> 172.21.15.132:0/3316638389 conn(0x7fab9c072c60 msgr2=0x7fab9c073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:10.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.126+0000 7faba3947640 1 -- 172.21.15.132:0/3316638389 shutdown_connections 2023-12-20T04:46:10.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.126+0000 7faba3947640 1 -- 172.21.15.132:0/3316638389 wait complete. 2023-12-20T04:46:10.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.127+0000 7faba3947640 1 Processor -- start 2023-12-20T04:46:10.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.127+0000 7faba3947640 1 -- start start 2023-12-20T04:46:10.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.128+0000 7faba3947640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab880047c0 0x7fab9c15af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.128+0000 7faba3947640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab9c0af3d0 0x7fab9c0d0840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.128+0000 7faba3947640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab9c0d0d80 0x7fab9c0c8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.128+0000 7faba3947640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c0d1200 con 0x7fab9c0d0d80 2023-12-20T04:46:10.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.128+0000 7faba3947640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c15b440 con 0x7fab880047c0 2023-12-20T04:46:10.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.128+0000 7faba3947640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab9c0ae0e0 con 0x7fab9c0af3d0 2023-12-20T04:46:10.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.128+0000 7faba1ee4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab9c0d0d80 0x7fab9c0c8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.128+0000 7faba1ee4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab9c0d0d80 0x7fab9c0c8d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34396/0 (socket says 172.21.15.132:34396) 2023-12-20T04:46:10.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.128+0000 7faba1ee4640 1 -- 172.21.15.132:0/3178100508 learned_addr learned my addr 172.21.15.132:0/3178100508 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:10.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.128+0000 7faba16e3640 1 --2- 172.21.15.132:0/3178100508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab880047c0 0x7fab9c15af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.128+0000 7faba0ee2640 1 --2- 172.21.15.132:0/3178100508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab9c0af3d0 0x7fab9c0d0840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.128+0000 7faba1ee4640 1 -- 172.21.15.132:0/3178100508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab9c0af3d0 msgr2=0x7fab9c0d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.128+0000 7faba1ee4640 1 --2- 172.21.15.132:0/3178100508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab9c0af3d0 0x7fab9c0d0840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.128+0000 7faba1ee4640 1 -- 172.21.15.132:0/3178100508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab880047c0 msgr2=0x7fab9c15af00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.128+0000 7faba1ee4640 1 --2- 172.21.15.132:0/3178100508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab880047c0 0x7fab9c15af00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.128+0000 7faba1ee4640 1 -- 172.21.15.132:0/3178100508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab9c0ae330 con 0x7fab9c0d0d80 2023-12-20T04:46:10.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.128+0000 7faba1ee4640 1 --2- 172.21.15.132:0/3178100508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab9c0d0d80 0x7fab9c0c8d70 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fab9c15d6e0 tx=0x7fab9400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:10.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.129+0000 7fab91ffb640 1 -- 172.21.15.132:0/3178100508 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab9400e040 con 0x7fab9c0d0d80 2023-12-20T04:46:10.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.129+0000 7fab91ffb640 1 -- 172.21.15.132:0/3178100508 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab9400f040 con 0x7fab9c0d0d80 2023-12-20T04:46:10.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.129+0000 7faba3947640 1 -- 172.21.15.132:0/3178100508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab9c0ae610 con 0x7fab9c0d0d80 2023-12-20T04:46:10.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.129+0000 7fab91ffb640 1 -- 172.21.15.132:0/3178100508 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab94015430 con 0x7fab9c0d0d80 2023-12-20T04:46:10.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.129+0000 7faba3947640 1 -- 172.21.15.132:0/3178100508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab9c0aebd0 con 0x7fab9c0d0d80 2023-12-20T04:46:10.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.130+0000 7faba3947640 1 -- 172.21.15.132:0/3178100508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab9c04e840 con 0x7fab9c0d0d80 2023-12-20T04:46:10.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.130+0000 7fab91ffb640 1 -- 172.21.15.132:0/3178100508 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fab94015590 con 0x7fab9c0d0d80 2023-12-20T04:46:10.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.131+0000 7fab91ffb640 1 --2- 172.21.15.132:0/3178100508 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab8006a430 0x7fab8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.131+0000 7faba16e3640 1 --2- 172.21.15.132:0/3178100508 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab8006a430 0x7fab8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.131+0000 7fab91ffb640 1 -- 172.21.15.132:0/3178100508 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fab94088e30 con 0x7fab9c0d0d80 2023-12-20T04:46:10.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.131+0000 7fab91ffb640 1 -- 172.21.15.132:0/3178100508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7fab80071f60 con 0x7fab9c0d0d80 2023-12-20T04:46:10.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.131+0000 7faba16e3640 1 --2- 172.21.15.132:0/3178100508 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab8006a430 0x7fab8006c8f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fab98006fd0 tx=0x7fab98008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:10.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.135+0000 7fab91ffb640 1 -- 172.21.15.132:0/3178100508 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fab940544d0 con 0x7fab9c0d0d80 2023-12-20T04:46:10.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.301+0000 7faba3947640 1 -- 172.21.15.132:0/3178100508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fab9c0b2890 con 0x7fab9c0d0d80 2023-12-20T04:46:10.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.301+0000 7fab91ffb640 1 -- 172.21.15.132:0/3178100508 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v70) v1 ==== 104+0+11 (secure 0 0 0) 0x7fab94057af0 con 0x7fab9c0d0d80 2023-12-20T04:46:10.302 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:46:10.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.303+0000 7faba3947640 1 -- 172.21.15.132:0/3178100508 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab8006a430 msgr2=0x7fab8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.303+0000 7faba3947640 1 --2- 172.21.15.132:0/3178100508 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab8006a430 0x7fab8006c8f0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7fab98006fd0 tx=0x7fab98008040 comp rx=0 tx=0).stop 2023-12-20T04:46:10.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.303+0000 7faba3947640 1 -- 172.21.15.132:0/3178100508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab9c0d0d80 msgr2=0x7fab9c0c8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.303+0000 7faba3947640 1 --2- 172.21.15.132:0/3178100508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab9c0d0d80 0x7fab9c0c8d70 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7fab9c15d6e0 tx=0x7fab9400f580 comp rx=0 tx=0).stop 2023-12-20T04:46:10.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.303+0000 7faba3947640 1 -- 172.21.15.132:0/3178100508 shutdown_connections 2023-12-20T04:46:10.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.303+0000 7faba3947640 1 --2- 172.21.15.132:0/3178100508 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab8006a430 0x7fab8006c8f0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.303+0000 7faba3947640 1 --2- 172.21.15.132:0/3178100508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab9c0d0d80 0x7fab9c0c8d70 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.303+0000 7faba3947640 1 --2- 172.21.15.132:0/3178100508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab9c0af3d0 0x7fab9c0d0840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.303+0000 7faba3947640 1 --2- 172.21.15.132:0/3178100508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab880047c0 0x7fab9c15af00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.303+0000 7faba3947640 1 -- 172.21.15.132:0/3178100508 >> 172.21.15.132:0/3178100508 conn(0x7fab9c072c60 msgr2=0x7fab9c0b1b30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:10.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.303+0000 7faba3947640 1 -- 172.21.15.132:0/3178100508 shutdown_connections 2023-12-20T04:46:10.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.303+0000 7faba3947640 1 -- 172.21.15.132:0/3178100508 wait complete. 2023-12-20T04:46:10.315 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:46:10.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.458+0000 7fcfdae2c640 1 Processor -- start 2023-12-20T04:46:10.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.458+0000 7fcfdae2c640 1 -- start start 2023-12-20T04:46:10.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.458+0000 7fcfdae2c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcfd40cf880 0x7fcfd40cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfdae2c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd40d1a90 con 0x7fcfd40b60e0 2023-12-20T04:46:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfdae2c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcfd40d1d70 con 0x7fcfd415d300 2023-12-20T04:46:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfdae2c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcfd40d0250 con 0x7fcfd40cf880 2023-12-20T04:46:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd93c9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcfd40b60e0 0x7fcfd40b64f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57940/0 (socket says 172.21.15.132:57940) 2023-12-20T04:46:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd93c9640 1 -- 172.21.15.132:0/2459910320 learned_addr learned my addr 172.21.15.132:0/2459910320 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd3fff640 1 --2- 172.21.15.132:0/2459910320 >> v2:172.21.15.187:3300/0 conn(0x7fcfd40cf880 0x7fcfd40cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd37fe640 1 -- 172.21.15.132:0/2459910320 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2332646755 0 0) 0x7fcfd40d1a90 con 0x7fcfd40b60e0 2023-12-20T04:46:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd37fe640 1 -- 172.21.15.132:0/2459910320 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcfc4003520 con 0x7fcfd40b60e0 2023-12-20T04:46:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd37fe640 1 -- 172.21.15.132:0/2459910320 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3189330575 0 0) 0x7fcfc4003520 con 0x7fcfd40b60e0 2023-12-20T04:46:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd37fe640 1 -- 172.21.15.132:0/2459910320 >> v2:172.21.15.187:3300/0 conn(0x7fcfd40cf880 msgr2=0x7fcfd40cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd37fe640 1 --2- 172.21.15.132:0/2459910320 >> v2:172.21.15.187:3300/0 conn(0x7fcfd40cf880 0x7fcfd40cfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd37fe640 1 -- 172.21.15.132:0/2459910320 >> v1:172.21.15.187:6789/0 conn(0x7fcfd415d300 legacy=0x7fcfd40d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd37fe640 1 -- 172.21.15.132:0/2459910320 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd40d2050 con 0x7fcfd40b60e0 2023-12-20T04:46:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd37fe640 1 -- 172.21.15.132:0/2459910320 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fcfcc0019f0 con 0x7fcfd40b60e0 2023-12-20T04:46:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd37fe640 1 -- 172.21.15.132:0/2459910320 >> v1:172.21.15.132:6789/0 conn(0x7fcfd40b60e0 legacy=0x7fcfd40b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd37fe640 1 --2- 172.21.15.132:0/2459910320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc4003970 0x7fcfc4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd37fe640 1 --2- 172.21.15.132:0/2459910320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc40047c0 0x7fcfc4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd37fe640 1 --2- 172.21.15.132:0/2459910320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc4005180 0x7fcfc400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd37fe640 1 -- 172.21.15.132:0/2459910320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd40d0250 con 0x7fcfc4005180 2023-12-20T04:46:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd37fe640 1 -- 172.21.15.132:0/2459910320 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc400c020 con 0x7fcfc40047c0 2023-12-20T04:46:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd37fe640 1 -- 172.21.15.132:0/2459910320 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfc400c1e0 con 0x7fcfc4003970 2023-12-20T04:46:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd93c9640 1 --2- 172.21.15.132:0/2459910320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc4005180 0x7fcfc400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd3fff640 1 --2- 172.21.15.132:0/2459910320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc40047c0 0x7fcfc4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.459+0000 7fcfd8bc8640 1 --2- 172.21.15.132:0/2459910320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc4003970 0x7fcfc4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.460+0000 7fcfd93c9640 1 -- 172.21.15.132:0/2459910320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc4003970 msgr2=0x7fcfc4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.460+0000 7fcfd93c9640 1 --2- 172.21.15.132:0/2459910320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfc4003970 0x7fcfc4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.460+0000 7fcfd93c9640 1 -- 172.21.15.132:0/2459910320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc40047c0 msgr2=0x7fcfc4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.460+0000 7fcfd93c9640 1 --2- 172.21.15.132:0/2459910320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc40047c0 0x7fcfc4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.460+0000 7fcfd93c9640 1 -- 172.21.15.132:0/2459910320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfc4003520 con 0x7fcfc4005180 2023-12-20T04:46:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.460+0000 7fcfd93c9640 1 -- 172.21.15.132:0/2459910320 reap_dead start 2023-12-20T04:46:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.460+0000 7fcfd93c9640 1 --2- 172.21.15.132:0/2459910320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc4005180 0x7fcfc400b980 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc00a830 tx=0x7fcfc40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1dbd69a685d11dc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.460+0000 7fcfd37fe640 1 -- 172.21.15.132:0/2459910320 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc0072d0 con 0x7fcfc4005180 2023-12-20T04:46:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.461+0000 7fcfd37fe640 1 -- 172.21.15.132:0/2459910320 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc02f070 con 0x7fcfc4005180 2023-12-20T04:46:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.461+0000 7fcfd37fe640 1 -- 172.21.15.132:0/2459910320 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc0076b0 con 0x7fcfc4005180 2023-12-20T04:46:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.461+0000 7fcfdae2c640 1 -- 172.21.15.132:0/2459910320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc4005180 msgr2=0x7fcfc400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.461+0000 7fcfdae2c640 1 --2- 172.21.15.132:0/2459910320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc4005180 0x7fcfc400b980 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc00a830 tx=0x7fcfc40057f0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.461+0000 7fcfdae2c640 1 -- 172.21.15.132:0/2459910320 shutdown_connections 2023-12-20T04:46:10.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.461+0000 7fcfdae2c640 1 --2- 172.21.15.132:0/2459910320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfc4005180 0x7fcfc400b980 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.461+0000 7fcfdae2c640 1 -- 172.21.15.132:0/2459910320 >> 172.21.15.132:0/2459910320 conn(0x7fcfd406a3d0 msgr2=0x7fcfd406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:10.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.461+0000 7fcfdae2c640 1 -- 172.21.15.132:0/2459910320 shutdown_connections 2023-12-20T04:46:10.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.461+0000 7fcfdae2c640 1 -- 172.21.15.132:0/2459910320 wait complete. 2023-12-20T04:46:10.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.462+0000 7fcfdae2c640 1 Processor -- start 2023-12-20T04:46:10.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.462+0000 7fcfdae2c640 1 -- start start 2023-12-20T04:46:10.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.463+0000 7fcfdae2c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc4005180 0x7fcfd40ca9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.463+0000 7fcfdae2c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfd40c8940 0x7fcfd4152fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.463+0000 7fcfdae2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfd41534e0 0x7fcfd414d290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.463+0000 7fcfdae2c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd41f5e20 con 0x7fcfd41534e0 2023-12-20T04:46:10.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.463+0000 7fcfdae2c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd4153960 con 0x7fcfc4005180 2023-12-20T04:46:10.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.463+0000 7fcfdae2c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcfd41f6000 con 0x7fcfd40c8940 2023-12-20T04:46:10.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.463+0000 7fcfd93c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfd41534e0 0x7fcfd414d290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.463+0000 7fcfd93c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfd41534e0 0x7fcfd414d290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34408/0 (socket says 172.21.15.132:34408) 2023-12-20T04:46:10.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.463+0000 7fcfd93c9640 1 -- 172.21.15.132:0/3442048519 learned_addr learned my addr 172.21.15.132:0/3442048519 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:10.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.463+0000 7fcfd8bc8640 1 --2- 172.21.15.132:0/3442048519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc4005180 0x7fcfd40ca9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.464+0000 7fcfd3fff640 1 --2- 172.21.15.132:0/3442048519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfd40c8940 0x7fcfd4152fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.464+0000 7fcfd93c9640 1 -- 172.21.15.132:0/3442048519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfd40c8940 msgr2=0x7fcfd4152fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.464+0000 7fcfd93c9640 1 --2- 172.21.15.132:0/3442048519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfd40c8940 0x7fcfd4152fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.464+0000 7fcfd93c9640 1 -- 172.21.15.132:0/3442048519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc4005180 msgr2=0x7fcfd40ca9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.464+0000 7fcfd93c9640 1 --2- 172.21.15.132:0/3442048519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc4005180 0x7fcfd40ca9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.464+0000 7fcfd93c9640 1 -- 172.21.15.132:0/3442048519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcfd41f62e0 con 0x7fcfd41534e0 2023-12-20T04:46:10.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.464+0000 7fcfd93c9640 1 --2- 172.21.15.132:0/3442048519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfd41534e0 0x7fcfd414d290 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc000f80 tx=0x7fcfcc001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:10.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.464+0000 7fcfd17fa640 1 -- 172.21.15.132:0/3442048519 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc0019f0 con 0x7fcfd41534e0 2023-12-20T04:46:10.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.464+0000 7fcfd17fa640 1 -- 172.21.15.132:0/3442048519 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcfcc004b60 con 0x7fcfd41534e0 2023-12-20T04:46:10.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.464+0000 7fcfd17fa640 1 -- 172.21.15.132:0/3442048519 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcfcc007400 con 0x7fcfd41534e0 2023-12-20T04:46:10.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.464+0000 7fcfdae2c640 1 -- 172.21.15.132:0/3442048519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcfd41f65c0 con 0x7fcfd41534e0 2023-12-20T04:46:10.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.464+0000 7fcfdae2c640 1 -- 172.21.15.132:0/3442048519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcfd41f6b80 con 0x7fcfd41534e0 2023-12-20T04:46:10.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.465+0000 7fcfdae2c640 1 -- 172.21.15.132:0/3442048519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcfd404e840 con 0x7fcfd41534e0 2023-12-20T04:46:10.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.465+0000 7fcfd17fa640 1 -- 172.21.15.132:0/3442048519 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcfcc031030 con 0x7fcfd41534e0 2023-12-20T04:46:10.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.466+0000 7fcfd17fa640 1 --2- 172.21.15.132:0/3442048519 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfb806a460 0x7fcfb806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.466+0000 7fcfd8bc8640 1 --2- 172.21.15.132:0/3442048519 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfb806a460 0x7fcfb806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.466+0000 7fcfd17fa640 1 -- 172.21.15.132:0/3442048519 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcfcc0aa430 con 0x7fcfd41534e0 2023-12-20T04:46:10.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.466+0000 7fcfd17fa640 1 -- 172.21.15.132:0/3442048519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7fcfb8071f90 con 0x7fcfd41534e0 2023-12-20T04:46:10.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.466+0000 7fcfd8bc8640 1 --2- 172.21.15.132:0/3442048519 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfb806a460 0x7fcfb806c920 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8000c00 tx=0x7fcfc8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:10.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.470+0000 7fcfd17fa640 1 -- 172.21.15.132:0/3442048519 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcfcc075ab0 con 0x7fcfd41534e0 2023-12-20T04:46:10.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.635+0000 7fcfdae2c640 1 -- 172.21.15.132:0/3442048519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fcfd404e840 con 0x7fcfd41534e0 2023-12-20T04:46:10.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.636+0000 7fcfd17fa640 1 -- 172.21.15.132:0/3442048519 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v70) v1 ==== 100+0+11 (secure 0 0 0) 0x7fcfcc0790d0 con 0x7fcfd41534e0 2023-12-20T04:46:10.637 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:46:10.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.638+0000 7fcfdae2c640 1 -- 172.21.15.132:0/3442048519 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfb806a460 msgr2=0x7fcfb806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.638+0000 7fcfdae2c640 1 --2- 172.21.15.132:0/3442048519 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfb806a460 0x7fcfb806c920 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fcfc8000c00 tx=0x7fcfc8009040 comp rx=0 tx=0).stop 2023-12-20T04:46:10.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.638+0000 7fcfdae2c640 1 -- 172.21.15.132:0/3442048519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfd41534e0 msgr2=0x7fcfd414d290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.638+0000 7fcfdae2c640 1 --2- 172.21.15.132:0/3442048519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfd41534e0 0x7fcfd414d290 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fcfcc000f80 tx=0x7fcfcc001d80 comp rx=0 tx=0).stop 2023-12-20T04:46:10.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.638+0000 7fcfdae2c640 1 -- 172.21.15.132:0/3442048519 shutdown_connections 2023-12-20T04:46:10.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.638+0000 7fcfdae2c640 1 --2- 172.21.15.132:0/3442048519 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcfb806a460 0x7fcfb806c920 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.638+0000 7fcfdae2c640 1 --2- 172.21.15.132:0/3442048519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcfd41534e0 0x7fcfd414d290 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.638+0000 7fcfdae2c640 1 --2- 172.21.15.132:0/3442048519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcfd40c8940 0x7fcfd4152fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.638+0000 7fcfdae2c640 1 --2- 172.21.15.132:0/3442048519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcfc4005180 0x7fcfd40ca9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.638+0000 7fcfdae2c640 1 -- 172.21.15.132:0/3442048519 >> 172.21.15.132:0/3442048519 conn(0x7fcfd406a3d0 msgr2=0x7fcfd415c320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:10.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.638+0000 7fcfdae2c640 1 -- 172.21.15.132:0/3442048519 shutdown_connections 2023-12-20T04:46:10.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.638+0000 7fcfdae2c640 1 -- 172.21.15.132:0/3442048519 wait complete. 2023-12-20T04:46:10.650 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:46:10.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.748+0000 7f620580b640 1 Processor -- start 2023-12-20T04:46:10.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.748+0000 7f620580b640 1 -- start start 2023-12-20T04:46:10.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.749+0000 7f620580b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f620006a340 0x7f620006c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.749+0000 7f620580b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f620006ea90 con 0x7f62001588e0 2023-12-20T04:46:10.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.749+0000 7f620580b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f620006e160 con 0x7f620006cd30 2023-12-20T04:46:10.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.749+0000 7f620580b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f620006d520 con 0x7f620006a340 2023-12-20T04:46:10.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.749+0000 7f61fe7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f620006a340 0x7f620006c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.749+0000 7f61feffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f62001588e0 0x7f6200069c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57952/0 (socket says 172.21.15.132:57952) 2023-12-20T04:46:10.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.749+0000 7f61feffd640 1 -- 172.21.15.132:0/2693698628 learned_addr learned my addr 172.21.15.132:0/2693698628 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:10.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.749+0000 7f61fe7fc640 1 -- 172.21.15.132:0/2693698628 >> v1:172.21.15.187:6789/0 conn(0x7f620006cd30 legacy=0x7f62000b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.749+0000 7f61fe7fc640 1 -- 172.21.15.132:0/2693698628 >> v1:172.21.15.132:6789/0 conn(0x7f62001588e0 legacy=0x7f6200069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.749+0000 7f61fe7fc640 1 -- 172.21.15.132:0/2693698628 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f620006e440 con 0x7f620006a340 2023-12-20T04:46:10.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.750+0000 7f61fe7fc640 1 --2- 172.21.15.132:0/2693698628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f620006a340 0x7f620006c7f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f61f40097a0 tx=0x7f61f402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40a5b03bf914ac9b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:10.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.750+0000 7f61fdffb640 1 -- 172.21.15.132:0/2693698628 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f4030610 con 0x7f620006a340 2023-12-20T04:46:10.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.750+0000 7f61fdffb640 1 -- 172.21.15.132:0/2693698628 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f4030770 con 0x7f620006a340 2023-12-20T04:46:10.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.750+0000 7f61fdffb640 1 -- 172.21.15.132:0/2693698628 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f4030b00 con 0x7f620006a340 2023-12-20T04:46:10.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.751+0000 7f620580b640 1 -- 172.21.15.132:0/2693698628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f620006a340 msgr2=0x7f620006c7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.751+0000 7f620580b640 1 --2- 172.21.15.132:0/2693698628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f620006a340 0x7f620006c7f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f61f40097a0 tx=0x7f61f402b960 comp rx=0 tx=0).stop 2023-12-20T04:46:10.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.751+0000 7f620580b640 1 -- 172.21.15.132:0/2693698628 shutdown_connections 2023-12-20T04:46:10.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.751+0000 7f620580b640 1 --2- 172.21.15.132:0/2693698628 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f620006a340 0x7f620006c7f0 unknown :-1 s=CLOSED pgs=811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.751+0000 7f620580b640 1 -- 172.21.15.132:0/2693698628 >> 172.21.15.132:0/2693698628 conn(0x7f62000cfca0 msgr2=0x7f62000d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:10.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.751+0000 7f620580b640 1 -- 172.21.15.132:0/2693698628 shutdown_connections 2023-12-20T04:46:10.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.751+0000 7f620580b640 1 -- 172.21.15.132:0/2693698628 wait complete. 2023-12-20T04:46:10.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.752+0000 7f620580b640 1 Processor -- start 2023-12-20T04:46:10.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.752+0000 7f620580b640 1 -- start start 2023-12-20T04:46:10.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.753+0000 7f620580b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f620006a340 0x7f6200158200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.753+0000 7f620580b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f620006cd30 0x7f6200157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.753+0000 7f620580b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62001588e0 0x7f62000c4950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.753+0000 7f620580b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6200158080 con 0x7f620006cd30 2023-12-20T04:46:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.753+0000 7f620580b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62000c3c60 con 0x7f62001588e0 2023-12-20T04:46:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.753+0000 7f620580b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62000b5840 con 0x7f620006a340 2023-12-20T04:46:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.753+0000 7f61fe7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f620006cd30 0x7f6200157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.753+0000 7f61fe7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f620006cd30 0x7f6200157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34436/0 (socket says 172.21.15.132:34436) 2023-12-20T04:46:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.753+0000 7f61fe7fc640 1 -- 172.21.15.132:0/274415012 learned_addr learned my addr 172.21.15.132:0/274415012 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.753+0000 7f61feffd640 1 --2- 172.21.15.132:0/274415012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f620006a340 0x7f6200158200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.753+0000 7f61ff7fe640 1 --2- 172.21.15.132:0/274415012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62001588e0 0x7f62000c4950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.753+0000 7f61fe7fc640 1 -- 172.21.15.132:0/274415012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f620006a340 msgr2=0x7f6200158200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.753+0000 7f61fe7fc640 1 --2- 172.21.15.132:0/274415012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f620006a340 0x7f6200158200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.753+0000 7f61fe7fc640 1 -- 172.21.15.132:0/274415012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62001588e0 msgr2=0x7f62000c4950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.753+0000 7f61fe7fc640 1 --2- 172.21.15.132:0/274415012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62001588e0 0x7f62000c4950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.753+0000 7f61fe7fc640 1 -- 172.21.15.132:0/274415012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61f4009400 con 0x7f620006cd30 2023-12-20T04:46:10.756 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.754+0000 7f61fe7fc640 1 --2- 172.21.15.132:0/274415012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f620006cd30 0x7f6200157b40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f61f402bf70 tx=0x7f61f40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:10.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.754+0000 7f61e7fff640 1 -- 172.21.15.132:0/274415012 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f403e070 con 0x7f620006cd30 2023-12-20T04:46:10.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.754+0000 7f61e7fff640 1 -- 172.21.15.132:0/274415012 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61f4039a10 con 0x7f620006cd30 2023-12-20T04:46:10.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.754+0000 7f620580b640 1 -- 172.21.15.132:0/274415012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62000c3e70 con 0x7f620006cd30 2023-12-20T04:46:10.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.754+0000 7f61e7fff640 1 -- 172.21.15.132:0/274415012 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61f4039da0 con 0x7f620006cd30 2023-12-20T04:46:10.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.754+0000 7f620580b640 1 -- 172.21.15.132:0/274415012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62000c4430 con 0x7f620006cd30 2023-12-20T04:46:10.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.755+0000 7f620580b640 1 -- 172.21.15.132:0/274415012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f620004e840 con 0x7f620006cd30 2023-12-20T04:46:10.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.755+0000 7f61e7fff640 1 -- 172.21.15.132:0/274415012 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f61f404b400 con 0x7f620006cd30 2023-12-20T04:46:10.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.755+0000 7f61e7fff640 1 --2- 172.21.15.132:0/274415012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f61ec06a430 0x7f61ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:10.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.755+0000 7f61e7fff640 1 -- 172.21.15.132:0/274415012 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f61f40aae10 con 0x7f620006cd30 2023-12-20T04:46:10.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.756+0000 7f61feffd640 1 --2- 172.21.15.132:0/274415012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f61ec06a430 0x7f61ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:10.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.756+0000 7f61e7fff640 1 -- 172.21.15.132:0/274415012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7f61ec071f60 con 0x7f620006cd30 2023-12-20T04:46:10.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.756+0000 7f61feffd640 1 --2- 172.21.15.132:0/274415012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f61ec06a430 0x7f61ec06c8f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f61f0005c00 tx=0x7f61f0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:10.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.760+0000 7f61e7fff640 1 -- 172.21.15.132:0/274415012 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f61f4076400 con 0x7f620006cd30 2023-12-20T04:46:10.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.961+0000 7f620580b640 1 -- 172.21.15.132:0/274415012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f62000c35b0 con 0x7f620006cd30 2023-12-20T04:46:10.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.962+0000 7f61e7fff640 1 -- 172.21.15.132:0/274415012 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4721 (secure 0 0 0) 0x7f61f4034030 con 0x7f620006cd30 2023-12-20T04:46:10.962 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:10.963 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3967216203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":3967216203},{"type":"v1","addr":"172.21.15.132:6837","nonce":3967216203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2592935145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2592935145},{"type":"v1","addr":"172.21.15.187:6833","nonce":2592935145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2061740954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2061740954},{"type":"v1","addr":"172.21.15.132:6835","nonce":2061740954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:45:08.941383+0000","modified":"2023-12-20T04:45:11.945725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6183":{"gid":6183,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/3119150547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3119150547},{"type":"v1","addr":"172.21.15.187:6835","nonce":3119150547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-20T04:46:10.963 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 26 2023-12-20T04:46:10.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.963+0000 7f620580b640 1 -- 172.21.15.132:0/274415012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f61ec06a430 msgr2=0x7f61ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.963+0000 7f620580b640 1 --2- 172.21.15.132:0/274415012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f61ec06a430 0x7f61ec06c8f0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f61f0005c00 tx=0x7f61f0009040 comp rx=0 tx=0).stop 2023-12-20T04:46:10.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.963+0000 7f620580b640 1 -- 172.21.15.132:0/274415012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f620006cd30 msgr2=0x7f6200157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:10.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.963+0000 7f620580b640 1 --2- 172.21.15.132:0/274415012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f620006cd30 0x7f6200157b40 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f61f402bf70 tx=0x7f61f40046c0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.963+0000 7f620580b640 1 -- 172.21.15.132:0/274415012 shutdown_connections 2023-12-20T04:46:10.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.963+0000 7f620580b640 1 --2- 172.21.15.132:0/274415012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f61ec06a430 0x7f61ec06c8f0 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.963+0000 7f620580b640 1 --2- 172.21.15.132:0/274415012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62001588e0 0x7f62000c4950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.963+0000 7f620580b640 1 --2- 172.21.15.132:0/274415012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f620006cd30 0x7f6200157b40 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.963+0000 7f620580b640 1 --2- 172.21.15.132:0/274415012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f620006a340 0x7f6200158200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:10.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.963+0000 7f620580b640 1 -- 172.21.15.132:0/274415012 >> 172.21.15.132:0/274415012 conn(0x7f62000cfca0 msgr2=0x7f62000cbbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:10.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.964+0000 7f620580b640 1 -- 172.21.15.132:0/274415012 shutdown_connections 2023-12-20T04:46:10.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:10.964+0000 7f620580b640 1 -- 172.21.15.132:0/274415012 wait complete. 2023-12-20T04:46:10.976 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:46:11.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.075+0000 7f8d7ab18640 1 Processor -- start 2023-12-20T04:46:11.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.075+0000 7f8d7ab18640 1 -- start start 2023-12-20T04:46:11.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.076+0000 7f8d7ab18640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8d74159d00 0x7f8d7415da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.076+0000 7f8d7ab18640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d7406cc30 0x7f8d7406d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.076+0000 7f8d7ab18640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d7415e4c0 con 0x7f8d7415df40 2023-12-20T04:46:11.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.076+0000 7f8d7ab18640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d7406c220 con 0x7f8d74159d00 2023-12-20T04:46:11.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.076+0000 7f8d7ab18640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d7406d5e0 con 0x7f8d7406cc30 2023-12-20T04:46:11.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.076+0000 7f8d790b5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d7406cc30 0x7f8d7406d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.076+0000 7f8d790b5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d7406cc30 0x7f8d7406d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:53208/0 (socket says 172.21.15.132:53208) 2023-12-20T04:46:11.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.076+0000 7f8d790b5640 1 -- 172.21.15.132:0/2314847692 learned_addr learned my addr 172.21.15.132:0/2314847692 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:11.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.076+0000 7f8d788b4640 1 --2- 172.21.15.132:0/2314847692 >> v2:172.21.15.187:3300/0 conn(0x7f8d74159d00 0x7f8d7415da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.076+0000 7f8d790b5640 1 -- 172.21.15.132:0/2314847692 >> v2:172.21.15.187:3300/0 conn(0x7f8d74159d00 msgr2=0x7f8d7415da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:11.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.076+0000 7f8d790b5640 1 --2- 172.21.15.132:0/2314847692 >> v2:172.21.15.187:3300/0 conn(0x7f8d74159d00 0x7f8d7415da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.076+0000 7f8d790b5640 1 -- 172.21.15.132:0/2314847692 >> v1:172.21.15.187:6789/0 conn(0x7f8d7415df40 legacy=0x7f8d740caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.076+0000 7f8d790b5640 1 -- 172.21.15.132:0/2314847692 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d7415e7a0 con 0x7f8d7406cc30 2023-12-20T04:46:11.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.077+0000 7f8d790b5640 1 --2- 172.21.15.132:0/2314847692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d7406cc30 0x7f8d7406d0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00d150 tx=0x7f8d6c02e160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=152d2254379f0b4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:11.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.078+0000 7f8d737fe640 1 -- 172.21.15.132:0/2314847692 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c00b0d0 con 0x7f8d7406cc30 2023-12-20T04:46:11.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.078+0000 7f8d737fe640 1 -- 172.21.15.132:0/2314847692 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c00b230 con 0x7f8d7406cc30 2023-12-20T04:46:11.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.078+0000 7f8d737fe640 1 -- 172.21.15.132:0/2314847692 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c009600 con 0x7f8d7406cc30 2023-12-20T04:46:11.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.079+0000 7f8d7ab18640 1 -- 172.21.15.132:0/2314847692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d7406cc30 msgr2=0x7f8d7406d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.079+0000 7f8d7ab18640 1 --2- 172.21.15.132:0/2314847692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d7406cc30 0x7f8d7406d0a0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c00d150 tx=0x7f8d6c02e160 comp rx=0 tx=0).stop 2023-12-20T04:46:11.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.079+0000 7f8d7ab18640 1 -- 172.21.15.132:0/2314847692 shutdown_connections 2023-12-20T04:46:11.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.079+0000 7f8d7ab18640 1 --2- 172.21.15.132:0/2314847692 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d7406cc30 0x7f8d7406d0a0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.079+0000 7f8d7ab18640 1 --2- 172.21.15.132:0/2314847692 >> v2:172.21.15.187:3300/0 conn(0x7f8d74159d00 0x7f8d7415da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.079+0000 7f8d7ab18640 1 -- 172.21.15.132:0/2314847692 >> 172.21.15.132:0/2314847692 conn(0x7f8d740cfca0 msgr2=0x7f8d740d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:11.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.079+0000 7f8d7ab18640 1 -- 172.21.15.132:0/2314847692 shutdown_connections 2023-12-20T04:46:11.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.079+0000 7f8d7ab18640 1 -- 172.21.15.132:0/2314847692 wait complete. 2023-12-20T04:46:11.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.080+0000 7f8d7ab18640 1 Processor -- start 2023-12-20T04:46:11.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.080+0000 7f8d7ab18640 1 -- start start 2023-12-20T04:46:11.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.081+0000 7f8d7ab18640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d7406cc30 0x7f8d740c9690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.081+0000 7f8d7ab18640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d74159d00 0x7f8d740af9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.081+0000 7f8d7ab18640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d7415df40 0x7f8d740aff00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.081+0000 7f8d7ab18640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d74156af0 con 0x7f8d7415df40 2023-12-20T04:46:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.081+0000 7f8d7ab18640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d740c9bd0 con 0x7f8d74159d00 2023-12-20T04:46:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.081+0000 7f8d7ab18640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d740ae210 con 0x7f8d7406cc30 2023-12-20T04:46:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.081+0000 7f8d790b5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d7415df40 0x7f8d740aff00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.081+0000 7f8d790b5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d7415df40 0x7f8d740aff00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34448/0 (socket says 172.21.15.132:34448) 2023-12-20T04:46:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.081+0000 7f8d790b5640 1 -- 172.21.15.132:0/786053175 learned_addr learned my addr 172.21.15.132:0/786053175 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.081+0000 7f8d788b4640 1 --2- 172.21.15.132:0/786053175 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d7406cc30 0x7f8d740c9690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.081+0000 7f8d73fff640 1 --2- 172.21.15.132:0/786053175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d74159d00 0x7f8d740af9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.081+0000 7f8d790b5640 1 -- 172.21.15.132:0/786053175 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d7406cc30 msgr2=0x7f8d740c9690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.081+0000 7f8d790b5640 1 --2- 172.21.15.132:0/786053175 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d7406cc30 0x7f8d740c9690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.081+0000 7f8d790b5640 1 -- 172.21.15.132:0/786053175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d74159d00 msgr2=0x7f8d740af9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.081+0000 7f8d790b5640 1 --2- 172.21.15.132:0/786053175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d74159d00 0x7f8d740af9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.081+0000 7f8d790b5640 1 -- 172.21.15.132:0/786053175 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d6c00bd40 con 0x7f8d7415df40 2023-12-20T04:46:11.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.081+0000 7f8d73fff640 1 --2- 172.21.15.132:0/786053175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d74159d00 0x7f8d740af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:11.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.082+0000 7f8d790b5640 1 --2- 172.21.15.132:0/786053175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d7415df40 0x7f8d740aff00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c038040 tx=0x7f8d6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:11.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.082+0000 7f8d717fa640 1 -- 172.21.15.132:0/786053175 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c036800 con 0x7f8d7415df40 2023-12-20T04:46:11.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.082+0000 7f8d717fa640 1 -- 172.21.15.132:0/786053175 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d6c036980 con 0x7f8d7415df40 2023-12-20T04:46:11.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.082+0000 7f8d717fa640 1 -- 172.21.15.132:0/786053175 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d6c036d30 con 0x7f8d7415df40 2023-12-20T04:46:11.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.082+0000 7f8d7ab18640 1 -- 172.21.15.132:0/786053175 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d740ae4f0 con 0x7f8d7415df40 2023-12-20T04:46:11.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.082+0000 7f8d7ab18640 1 -- 172.21.15.132:0/786053175 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d740aeab0 con 0x7f8d7415df40 2023-12-20T04:46:11.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.083+0000 7f8d7ab18640 1 -- 172.21.15.132:0/786053175 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d7404e840 con 0x7f8d7415df40 2023-12-20T04:46:11.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.083+0000 7f8d717fa640 1 -- 172.21.15.132:0/786053175 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8d6c04a460 con 0x7f8d7415df40 2023-12-20T04:46:11.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.083+0000 7f8d717fa640 1 --2- 172.21.15.132:0/786053175 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8d5806a430 0x7f8d5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.084+0000 7f8d717fa640 1 -- 172.21.15.132:0/786053175 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8d6c0abb30 con 0x7f8d7415df40 2023-12-20T04:46:11.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.084+0000 7f8d788b4640 1 --2- 172.21.15.132:0/786053175 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8d5806a430 0x7f8d5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.084+0000 7f8d717fa640 1 -- 172.21.15.132:0/786053175 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7f8d58071f60 con 0x7f8d7415df40 2023-12-20T04:46:11.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.084+0000 7f8d788b4640 1 --2- 172.21.15.132:0/786053175 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8d5806a430 0x7f8d5806c8f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009b40 tx=0x7f8d68009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:11.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.088+0000 7f8d717fa640 1 -- 172.21.15.132:0/786053175 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8d6c077240 con 0x7f8d7415df40 2023-12-20T04:46:11.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.256+0000 7f8d7ab18640 1 -- 172.21.15.132:0/786053175 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8d7406d370 con 0x7f8d7415df40 2023-12-20T04:46:11.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.257+0000 7f8d717fa640 1 -- 172.21.15.132:0/786053175 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+16196 (secure 0 0 0) 0x7f8d6c00b720 con 0x7f8d7415df40 2023-12-20T04:46:11.258 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:11.258 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":70,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:46:10.063359+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:45:07.136819+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-20T04:45:07.907185+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:46:11.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.259+0000 7f8d7ab18640 1 -- 172.21.15.132:0/786053175 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8d5806a430 msgr2=0x7f8d5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.259+0000 7f8d7ab18640 1 --2- 172.21.15.132:0/786053175 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8d5806a430 0x7f8d5806c8f0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f8d68009b40 tx=0x7f8d68009190 comp rx=0 tx=0).stop 2023-12-20T04:46:11.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.259+0000 7f8d7ab18640 1 -- 172.21.15.132:0/786053175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d7415df40 msgr2=0x7f8d740aff00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.259+0000 7f8d7ab18640 1 --2- 172.21.15.132:0/786053175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d7415df40 0x7f8d740aff00 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f8d6c038040 tx=0x7f8d6c004a40 comp rx=0 tx=0).stop 2023-12-20T04:46:11.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.259+0000 7f8d7ab18640 1 -- 172.21.15.132:0/786053175 shutdown_connections 2023-12-20T04:46:11.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.259+0000 7f8d7ab18640 1 --2- 172.21.15.132:0/786053175 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8d5806a430 0x7f8d5806c8f0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.259+0000 7f8d7ab18640 1 --2- 172.21.15.132:0/786053175 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d7415df40 0x7f8d740aff00 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.259+0000 7f8d7ab18640 1 --2- 172.21.15.132:0/786053175 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d74159d00 0x7f8d740af9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.259+0000 7f8d7ab18640 1 --2- 172.21.15.132:0/786053175 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d7406cc30 0x7f8d740c9690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.259+0000 7f8d7ab18640 1 -- 172.21.15.132:0/786053175 >> 172.21.15.132:0/786053175 conn(0x7f8d740cfca0 msgr2=0x7f8d740c6540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:11.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.259+0000 7f8d7ab18640 1 -- 172.21.15.132:0/786053175 shutdown_connections 2023-12-20T04:46:11.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.259+0000 7f8d7ab18640 1 -- 172.21.15.132:0/786053175 wait complete. 2023-12-20T04:46:11.271 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-20T04:46:11.272 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:46:11.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.371+0000 7f00a3947640 1 Processor -- start 2023-12-20T04:46:11.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.371+0000 7f00a3947640 1 -- start start 2023-12-20T04:46:11.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.372+0000 7f00a3947640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f009c160450 0x7f009c160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.372+0000 7f00a3947640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f009c0b5090 0x7f009c0d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.372+0000 7f00a3947640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f009c0b5ec0 con 0x7f009c1611b0 2023-12-20T04:46:11.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.372+0000 7f00a3947640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f009c1617e0 con 0x7f009c0b5090 2023-12-20T04:46:11.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.372+0000 7f00a3947640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009c0d0fc0 con 0x7f009c160450 2023-12-20T04:46:11.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.372+0000 7f00a1ee4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f009c0b5090 0x7f009c0d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.372+0000 7f00a0ee2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f009c1611b0 0x7f009c0b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57958/0 (socket says 172.21.15.132:57958) 2023-12-20T04:46:11.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.372+0000 7f00a1ee4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f009c0b5090 0x7f009c0d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34450/0 (socket says 172.21.15.132:34450) 2023-12-20T04:46:11.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.372+0000 7f00a0ee2640 1 -- 172.21.15.132:0/897330846 learned_addr learned my addr 172.21.15.132:0/897330846 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:11.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.373+0000 7f00a16e3640 1 --2- 172.21.15.132:0/897330846 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f009c160450 0x7f009c160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.373+0000 7f00a1ee4640 1 -- 172.21.15.132:0/897330846 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f009c160450 msgr2=0x7f009c160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:11.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.373+0000 7f00a1ee4640 1 --2- 172.21.15.132:0/897330846 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f009c160450 0x7f009c160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.373+0000 7f00a1ee4640 1 -- 172.21.15.132:0/897330846 >> v1:172.21.15.132:6789/0 conn(0x7f009c1611b0 legacy=0x7f009c0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.373+0000 7f00a1ee4640 1 -- 172.21.15.132:0/897330846 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f009c0d12a0 con 0x7f009c0b5090 2023-12-20T04:46:11.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.373+0000 7f0093fff640 1 -- 172.21.15.132:0/897330846 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2586787073 0 0) 0x7f009c0b5ec0 con 0x7f009c1611b0 2023-12-20T04:46:11.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.373+0000 7f00a16e3640 1 --2- 172.21.15.132:0/897330846 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f009c160450 0x7f009c160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:11.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.373+0000 7f00a1ee4640 1 --2- 172.21.15.132:0/897330846 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f009c0b5090 0x7f009c0d1aa0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0094009d90 tx=0x7f009402bf30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e01391e2c952caf4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:11.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.374+0000 7f0093fff640 1 -- 172.21.15.132:0/897330846 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f009402cce0 con 0x7f009c0b5090 2023-12-20T04:46:11.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.374+0000 7f0093fff640 1 -- 172.21.15.132:0/897330846 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f009402ce40 con 0x7f009c0b5090 2023-12-20T04:46:11.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.374+0000 7f0093fff640 1 -- 172.21.15.132:0/897330846 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0094034660 con 0x7f009c0b5090 2023-12-20T04:46:11.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.374+0000 7f00a3947640 1 -- 172.21.15.132:0/897330846 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f009c0b5090 msgr2=0x7f009c0d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.374+0000 7f00a3947640 1 --2- 172.21.15.132:0/897330846 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f009c0b5090 0x7f009c0d1aa0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7f0094009d90 tx=0x7f009402bf30 comp rx=0 tx=0).stop 2023-12-20T04:46:11.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.374+0000 7f00a3947640 1 -- 172.21.15.132:0/897330846 shutdown_connections 2023-12-20T04:46:11.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.374+0000 7f00a3947640 1 --2- 172.21.15.132:0/897330846 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f009c0b5090 0x7f009c0d1aa0 unknown :-1 s=CLOSED pgs=815 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.374+0000 7f00a3947640 1 --2- 172.21.15.132:0/897330846 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f009c160450 0x7f009c160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.374+0000 7f00a3947640 1 -- 172.21.15.132:0/897330846 >> 172.21.15.132:0/897330846 conn(0x7f009c0cf980 msgr2=0x7f009c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:11.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.374+0000 7f00a3947640 1 -- 172.21.15.132:0/897330846 shutdown_connections 2023-12-20T04:46:11.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.374+0000 7f00a3947640 1 -- 172.21.15.132:0/897330846 wait complete. 2023-12-20T04:46:11.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.375+0000 7f00a3947640 1 Processor -- start 2023-12-20T04:46:11.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.375+0000 7f00a3947640 1 -- start start 2023-12-20T04:46:11.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.376+0000 7f00a3947640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f009c0b5090 0x7f009c149e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.376+0000 7f00a3947640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f009c160450 0x7f009c0c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.376+0000 7f00a3947640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f009c1611b0 0x7f009c15c690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.376+0000 7f00a3947640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c1f2800 con 0x7f009c160450 2023-12-20T04:46:11.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.376+0000 7f00a3947640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f009c159f80 con 0x7f009c0b5090 2023-12-20T04:46:11.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.376+0000 7f00a3947640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f009c0c8dc0 con 0x7f009c1611b0 2023-12-20T04:46:11.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.376+0000 7f00a0ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f009c160450 0x7f009c0c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.376+0000 7f00a0ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f009c160450 0x7f009c0c8880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34456/0 (socket says 172.21.15.132:34456) 2023-12-20T04:46:11.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.376+0000 7f00a0ee2640 1 -- 172.21.15.132:0/2867701176 learned_addr learned my addr 172.21.15.132:0/2867701176 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:11.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.377+0000 7f00a1ee4640 1 --2- 172.21.15.132:0/2867701176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f009c1611b0 0x7f009c15c690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.377+0000 7f00a16e3640 1 --2- 172.21.15.132:0/2867701176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f009c0b5090 0x7f009c149e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.377+0000 7f00a0ee2640 1 -- 172.21.15.132:0/2867701176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f009c1611b0 msgr2=0x7f009c15c690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.377+0000 7f00a0ee2640 1 --2- 172.21.15.132:0/2867701176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f009c1611b0 0x7f009c15c690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.377+0000 7f00a0ee2640 1 -- 172.21.15.132:0/2867701176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f009c0b5090 msgr2=0x7f009c149e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.377+0000 7f00a0ee2640 1 --2- 172.21.15.132:0/2867701176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f009c0b5090 0x7f009c149e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.377+0000 7f00a0ee2640 1 -- 172.21.15.132:0/2867701176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0094009a70 con 0x7f009c160450 2023-12-20T04:46:11.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.377+0000 7f00a0ee2640 1 --2- 172.21.15.132:0/2867701176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f009c160450 0x7f009c0c8880 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c430 tx=0x7f008c00c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:11.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.377+0000 7f0091ffb640 1 -- 172.21.15.132:0/2867701176 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c0074e0 con 0x7f009c160450 2023-12-20T04:46:11.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.377+0000 7f0091ffb640 1 -- 172.21.15.132:0/2867701176 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f008c007660 con 0x7f009c160450 2023-12-20T04:46:11.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.377+0000 7f00a3947640 1 -- 172.21.15.132:0/2867701176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f009c159370 con 0x7f009c160450 2023-12-20T04:46:11.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.377+0000 7f0091ffb640 1 -- 172.21.15.132:0/2867701176 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f008c004a20 con 0x7f009c160450 2023-12-20T04:46:11.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.377+0000 7f00a3947640 1 -- 172.21.15.132:0/2867701176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f009c159930 con 0x7f009c160450 2023-12-20T04:46:11.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.378+0000 7f00a3947640 1 -- 172.21.15.132:0/2867701176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f009c04e840 con 0x7f009c160450 2023-12-20T04:46:11.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.379+0000 7f0091ffb640 1 -- 172.21.15.132:0/2867701176 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f008c004b80 con 0x7f009c160450 2023-12-20T04:46:11.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.379+0000 7f0091ffb640 1 --2- 172.21.15.132:0/2867701176 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f008006a430 0x7f008006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.379+0000 7f00a16e3640 1 --2- 172.21.15.132:0/2867701176 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f008006a430 0x7f008006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.379+0000 7f0091ffb640 1 -- 172.21.15.132:0/2867701176 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f008c088730 con 0x7f009c160450 2023-12-20T04:46:11.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.379+0000 7f0091ffb640 1 -- 172.21.15.132:0/2867701176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7f0080071f60 con 0x7f009c160450 2023-12-20T04:46:11.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.379+0000 7f00a16e3640 1 --2- 172.21.15.132:0/2867701176 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f008006a430 0x7f008006c8f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f009c14a920 tx=0x7f0098008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:11.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.383+0000 7f0091ffb640 1 -- 172.21.15.132:0/2867701176 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f008c053db0 con 0x7f009c160450 2023-12-20T04:46:11.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.582+0000 7f00a3947640 1 -- 172.21.15.132:0/2867701176 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f009c15a0c0 con 0x7f009c160450 2023-12-20T04:46:11.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.583+0000 7f0091ffb640 1 -- 172.21.15.132:0/2867701176 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4721 (secure 0 0 0) 0x7f009c15a0c0 con 0x7f009c160450 2023-12-20T04:46:11.584 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:11.584 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3967216203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":3967216203},{"type":"v1","addr":"172.21.15.132:6837","nonce":3967216203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2592935145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2592935145},{"type":"v1","addr":"172.21.15.187:6833","nonce":2592935145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2061740954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2061740954},{"type":"v1","addr":"172.21.15.132:6835","nonce":2061740954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:45:08.941383+0000","modified":"2023-12-20T04:45:11.945725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6183":{"gid":6183,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/3119150547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3119150547},{"type":"v1","addr":"172.21.15.187:6835","nonce":3119150547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-20T04:46:11.584 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 26 2023-12-20T04:46:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.585+0000 7f00a3947640 1 -- 172.21.15.132:0/2867701176 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f008006a430 msgr2=0x7f008006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.585+0000 7f00a3947640 1 --2- 172.21.15.132:0/2867701176 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f008006a430 0x7f008006c8f0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f009c14a920 tx=0x7f0098008040 comp rx=0 tx=0).stop 2023-12-20T04:46:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.585+0000 7f00a3947640 1 -- 172.21.15.132:0/2867701176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f009c160450 msgr2=0x7f009c0c8880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.585+0000 7f00a3947640 1 --2- 172.21.15.132:0/2867701176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f009c160450 0x7f009c0c8880 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f008c00c430 tx=0x7f008c00c8f0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.585+0000 7f00a3947640 1 -- 172.21.15.132:0/2867701176 shutdown_connections 2023-12-20T04:46:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.585+0000 7f00a3947640 1 --2- 172.21.15.132:0/2867701176 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f008006a430 0x7f008006c8f0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.585+0000 7f00a3947640 1 --2- 172.21.15.132:0/2867701176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f009c1611b0 0x7f009c15c690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.585+0000 7f00a3947640 1 --2- 172.21.15.132:0/2867701176 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f009c160450 0x7f009c0c8880 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.585+0000 7f00a3947640 1 --2- 172.21.15.132:0/2867701176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f009c0b5090 0x7f009c149e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.585+0000 7f00a3947640 1 -- 172.21.15.132:0/2867701176 >> 172.21.15.132:0/2867701176 conn(0x7f009c0cf980 msgr2=0x7f009c156380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.585+0000 7f00a3947640 1 -- 172.21.15.132:0/2867701176 shutdown_connections 2023-12-20T04:46:11.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.585+0000 7f00a3947640 1 -- 172.21.15.132:0/2867701176 wait complete. 2023-12-20T04:46:11.597 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:46:11.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.694+0000 7fd54b6b6640 1 Processor -- start 2023-12-20T04:46:11.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.695+0000 7fd54b6b6640 1 -- start start 2023-12-20T04:46:11.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.695+0000 7fd54b6b6640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd5440d08c0 0x7fd54406f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.695+0000 7fd54b6b6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd54415b7d0 0x7fd54415bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.695+0000 7fd54b6b6640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd54406f750 con 0x7fd5440cd030 2023-12-20T04:46:11.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.695+0000 7fd54b6b6640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd54415f060 con 0x7fd5440d08c0 2023-12-20T04:46:11.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.695+0000 7fd54b6b6640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd54406fff0 con 0x7fd54415b7d0 2023-12-20T04:46:11.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.696+0000 7fd549c53640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd54415b7d0 0x7fd54415bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.696+0000 7fd549452640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd5440d08c0 0x7fd54406f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.696+0000 7fd549c53640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd54415b7d0 0x7fd54415bc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:53234/0 (socket says 172.21.15.132:53234) 2023-12-20T04:46:11.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.696+0000 7fd548c51640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fd5440cd030 0x7fd54415f480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:49918/0 (socket says 172.21.15.132:49918) 2023-12-20T04:46:11.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.696+0000 7fd549c53640 1 -- 172.21.15.132:0/4284907350 learned_addr learned my addr 172.21.15.132:0/4284907350 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:11.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.696+0000 7fd549c53640 1 -- 172.21.15.132:0/4284907350 >> v2:172.21.15.187:3300/0 conn(0x7fd5440d08c0 msgr2=0x7fd54406f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:11.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.696+0000 7fd549c53640 1 --2- 172.21.15.132:0/4284907350 >> v2:172.21.15.187:3300/0 conn(0x7fd5440d08c0 0x7fd54406f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.696+0000 7fd549c53640 1 -- 172.21.15.132:0/4284907350 >> v1:172.21.15.187:6789/0 conn(0x7fd5440cd030 legacy=0x7fd54415f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.696+0000 7fd549c53640 1 -- 172.21.15.132:0/4284907350 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd54406fa30 con 0x7fd54415b7d0 2023-12-20T04:46:11.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.697+0000 7fd549c53640 1 --2- 172.21.15.132:0/4284907350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd54415b7d0 0x7fd54415bc60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd53c009e50 tx=0x7fd53c02be40 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5d51d7f5db6312f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:11.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.697+0000 7fd53bfff640 1 -- 172.21.15.132:0/4284907350 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c02c9e0 con 0x7fd54415b7d0 2023-12-20T04:46:11.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.697+0000 7fd53bfff640 1 -- 172.21.15.132:0/4284907350 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd53c02cb40 con 0x7fd54415b7d0 2023-12-20T04:46:11.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.697+0000 7fd53bfff640 1 -- 172.21.15.132:0/4284907350 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd53c0343f0 con 0x7fd54415b7d0 2023-12-20T04:46:11.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.698+0000 7fd54b6b6640 1 -- 172.21.15.132:0/4284907350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd54415b7d0 msgr2=0x7fd54415bc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.698+0000 7fd54b6b6640 1 --2- 172.21.15.132:0/4284907350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd54415b7d0 0x7fd54415bc60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fd53c009e50 tx=0x7fd53c02be40 comp rx=0 tx=0).stop 2023-12-20T04:46:11.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.698+0000 7fd54b6b6640 1 -- 172.21.15.132:0/4284907350 shutdown_connections 2023-12-20T04:46:11.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.698+0000 7fd54b6b6640 1 --2- 172.21.15.132:0/4284907350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd54415b7d0 0x7fd54415bc60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.698+0000 7fd54b6b6640 1 --2- 172.21.15.132:0/4284907350 >> v2:172.21.15.187:3300/0 conn(0x7fd5440d08c0 0x7fd54406f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.698+0000 7fd54b6b6640 1 -- 172.21.15.132:0/4284907350 >> 172.21.15.132:0/4284907350 conn(0x7fd5440cd7b0 msgr2=0x7fd5440cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:11.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.698+0000 7fd54b6b6640 1 -- 172.21.15.132:0/4284907350 shutdown_connections 2023-12-20T04:46:11.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.698+0000 7fd54b6b6640 1 -- 172.21.15.132:0/4284907350 wait complete. 2023-12-20T04:46:11.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.699+0000 7fd54b6b6640 1 Processor -- start 2023-12-20T04:46:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.699+0000 7fd54b6b6640 1 -- start start 2023-12-20T04:46:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd54b6b6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5440cd030 0x7fd544152a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd54b6b6640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5440d08c0 0x7fd5441e4980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd54b6b6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd54415b7d0 0x7fd5440c6a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd54b6b6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd544154c30 con 0x7fd5440cd030 2023-12-20T04:46:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd54b6b6640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd544154e80 con 0x7fd5440d08c0 2023-12-20T04:46:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd54b6b6640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd544155160 con 0x7fd54415b7d0 2023-12-20T04:46:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd549452640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5440cd030 0x7fd544152a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd549452640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5440cd030 0x7fd544152a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34466/0 (socket says 172.21.15.132:34466) 2023-12-20T04:46:11.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd549452640 1 -- 172.21.15.132:0/3363301417 learned_addr learned my addr 172.21.15.132:0/3363301417 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd548c51640 1 --2- 172.21.15.132:0/3363301417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5440d08c0 0x7fd5441e4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd549c53640 1 --2- 172.21.15.132:0/3363301417 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd54415b7d0 0x7fd5440c6a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd549452640 1 -- 172.21.15.132:0/3363301417 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd54415b7d0 msgr2=0x7fd5440c6a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd549452640 1 --2- 172.21.15.132:0/3363301417 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd54415b7d0 0x7fd5440c6a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd549452640 1 -- 172.21.15.132:0/3363301417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5440d08c0 msgr2=0x7fd5441e4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd549452640 1 --2- 172.21.15.132:0/3363301417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5440d08c0 0x7fd5441e4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd549452640 1 -- 172.21.15.132:0/3363301417 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd53c009b30 con 0x7fd5440cd030 2023-12-20T04:46:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd549452640 1 --2- 172.21.15.132:0/3363301417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5440cd030 0x7fd544152a50 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd54000e870 tx=0x7fd54000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd539ffb640 1 -- 172.21.15.132:0/3363301417 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5400094f0 con 0x7fd5440cd030 2023-12-20T04:46:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd539ffb640 1 -- 172.21.15.132:0/3363301417 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd54000c940 con 0x7fd5440cd030 2023-12-20T04:46:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd54b6b6640 1 -- 172.21.15.132:0/3363301417 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd544155440 con 0x7fd5440cd030 2023-12-20T04:46:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.700+0000 7fd539ffb640 1 -- 172.21.15.132:0/3363301417 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd54000ccf0 con 0x7fd5440cd030 2023-12-20T04:46:11.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.701+0000 7fd54b6b6640 1 -- 172.21.15.132:0/3363301417 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd544152f90 con 0x7fd5440cd030 2023-12-20T04:46:11.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.702+0000 7fd54b6b6640 1 -- 172.21.15.132:0/3363301417 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd54404e840 con 0x7fd5440cd030 2023-12-20T04:46:11.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.702+0000 7fd539ffb640 1 -- 172.21.15.132:0/3363301417 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd540013470 con 0x7fd5440cd030 2023-12-20T04:46:11.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.703+0000 7fd539ffb640 1 --2- 172.21.15.132:0/3363301417 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd52806a460 0x7fd52806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:11.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.703+0000 7fd548c51640 1 --2- 172.21.15.132:0/3363301417 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd52806a460 0x7fd52806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:11.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.703+0000 7fd539ffb640 1 -- 172.21.15.132:0/3363301417 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd540088880 con 0x7fd5440cd030 2023-12-20T04:46:11.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.703+0000 7fd539ffb640 1 -- 172.21.15.132:0/3363301417 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7fd528071f90 con 0x7fd5440cd030 2023-12-20T04:46:11.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.703+0000 7fd548c51640 1 --2- 172.21.15.132:0/3363301417 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd52806a460 0x7fd52806c920 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd5441e6370 tx=0x7fd534000ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:11.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.707+0000 7fd539ffb640 1 -- 172.21.15.132:0/3363301417 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd540017060 con 0x7fd5440cd030 2023-12-20T04:46:11.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.907+0000 7fd54b6b6640 1 -- 172.21.15.132:0/3363301417 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd54415df30 con 0x7fd5440cd030 2023-12-20T04:46:11.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.907+0000 7fd539ffb640 1 -- 172.21.15.132:0/3363301417 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 26 v26) v1 ==== 94+0+4721 (secure 0 0 0) 0x7fd540021070 con 0x7fd5440cd030 2023-12-20T04:46:11.909 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:11.909 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":26,"default_fscid":4,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3967216203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":3967216203},{"type":"v1","addr":"172.21.15.132:6837","nonce":3967216203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2592935145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2592935145},{"type":"v1","addr":"172.21.15.187:6833","nonce":2592935145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2061740954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2061740954},{"type":"v1","addr":"172.21.15.132:6835","nonce":2061740954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":26,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:45:08.941383+0000","modified":"2023-12-20T04:45:11.945725+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6183},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6183":{"gid":6183,"name":"d","rank":0,"incarnation":23,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/3119150547","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3119150547},{"type":"v1","addr":"172.21.15.187:6835","nonce":3119150547}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[9],"metadata_pool":8,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":4}]} 2023-12-20T04:46:11.909 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 26 2023-12-20T04:46:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.909+0000 7fd54b6b6640 1 -- 172.21.15.132:0/3363301417 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd52806a460 msgr2=0x7fd52806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.909+0000 7fd54b6b6640 1 --2- 172.21.15.132:0/3363301417 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd52806a460 0x7fd52806c920 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fd5441e6370 tx=0x7fd534000ed0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.909+0000 7fd54b6b6640 1 -- 172.21.15.132:0/3363301417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5440cd030 msgr2=0x7fd544152a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.909+0000 7fd54b6b6640 1 --2- 172.21.15.132:0/3363301417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5440cd030 0x7fd544152a50 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fd54000e870 tx=0x7fd54000ed30 comp rx=0 tx=0).stop 2023-12-20T04:46:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.909+0000 7fd54b6b6640 1 -- 172.21.15.132:0/3363301417 shutdown_connections 2023-12-20T04:46:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.909+0000 7fd54b6b6640 1 --2- 172.21.15.132:0/3363301417 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd52806a460 0x7fd52806c920 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.909+0000 7fd54b6b6640 1 --2- 172.21.15.132:0/3363301417 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd54415b7d0 0x7fd5440c6a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.909+0000 7fd54b6b6640 1 --2- 172.21.15.132:0/3363301417 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5440d08c0 0x7fd5441e4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.909+0000 7fd54b6b6640 1 --2- 172.21.15.132:0/3363301417 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5440cd030 0x7fd544152a50 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:11.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.909+0000 7fd54b6b6640 1 -- 172.21.15.132:0/3363301417 >> 172.21.15.132:0/3363301417 conn(0x7fd5440cd7b0 msgr2=0x7fd5440cf0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:11.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.909+0000 7fd54b6b6640 1 -- 172.21.15.132:0/3363301417 shutdown_connections 2023-12-20T04:46:11.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:11.909+0000 7fd54b6b6640 1 -- 172.21.15.132:0/3363301417 wait complete. 2023-12-20T04:46:11.921 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:46:12.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.019+0000 7f8b87c0b640 1 Processor -- start 2023-12-20T04:46:12.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.020+0000 7f8b87c0b640 1 -- start start 2023-12-20T04:46:12.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.020+0000 7f8b87c0b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b8015ad70 0x7f8b8006f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.020+0000 7f8b87c0b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b800c9ab0 con 0x7f8b8006b130 2023-12-20T04:46:12.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.020+0000 7f8b87c0b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8b800c9d90 con 0x7f8b800c92d0 2023-12-20T04:46:12.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.020+0000 7f8b87c0b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8015ea40 con 0x7f8b8015ad70 2023-12-20T04:46:12.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b861a8640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8b8006b130 0x7f8b80070e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57972/0 (socket says 172.21.15.132:57972) 2023-12-20T04:46:12.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b861a8640 1 -- 172.21.15.132:0/2286384814 learned_addr learned my addr 172.21.15.132:0/2286384814 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:12.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b849a5640 1 -- 172.21.15.132:0/2286384814 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3210143797 0 0) 0x7f8b800c9ab0 con 0x7f8b8006b130 2023-12-20T04:46:12.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b859a7640 1 --2- 172.21.15.132:0/2286384814 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b8015ad70 0x7f8b8006f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b849a5640 1 -- 172.21.15.132:0/2286384814 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8b6c003520 con 0x7f8b8006b130 2023-12-20T04:46:12.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b849a5640 1 -- 172.21.15.132:0/2286384814 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 599620733 0 0) 0x7f8b6c003520 con 0x7f8b8006b130 2023-12-20T04:46:12.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b849a5640 1 -- 172.21.15.132:0/2286384814 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b8015ad70 msgr2=0x7f8b8006f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:12.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b849a5640 1 --2- 172.21.15.132:0/2286384814 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b8015ad70 0x7f8b8006f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b849a5640 1 -- 172.21.15.132:0/2286384814 >> v1:172.21.15.187:6789/0 conn(0x7f8b800c92d0 legacy=0x7f8b8015f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b849a5640 1 -- 172.21.15.132:0/2286384814 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b800ca070 con 0x7f8b8006b130 2023-12-20T04:46:12.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b849a5640 1 -- 172.21.15.132:0/2286384814 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f8b7c001670 con 0x7f8b8006b130 2023-12-20T04:46:12.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b849a5640 1 -- 172.21.15.132:0/2286384814 >> v1:172.21.15.132:6789/0 conn(0x7f8b8006b130 legacy=0x7f8b80070e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b849a5640 1 --2- 172.21.15.132:0/2286384814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b6c0039a0 0x7f8b6c003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b849a5640 1 --2- 172.21.15.132:0/2286384814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b6c004350 0x7f8b6c004820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b849a5640 1 --2- 172.21.15.132:0/2286384814 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b8015ad70 0x7f8b6c005080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b849a5640 1 -- 172.21.15.132:0/2286384814 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8015ea40 con 0x7f8b6c0039a0 2023-12-20T04:46:12.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b849a5640 1 -- 172.21.15.132:0/2286384814 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c00b980 con 0x7f8b6c004350 2023-12-20T04:46:12.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b849a5640 1 -- 172.21.15.132:0/2286384814 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b6c00bb40 con 0x7f8b8015ad70 2023-12-20T04:46:12.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b859a7640 1 --2- 172.21.15.132:0/2286384814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b6c0039a0 0x7f8b6c003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b861a8640 1 --2- 172.21.15.132:0/2286384814 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b8015ad70 0x7f8b6c005080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b851a6640 1 --2- 172.21.15.132:0/2286384814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b6c004350 0x7f8b6c004820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b859a7640 1 -- 172.21.15.132:0/2286384814 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b8015ad70 msgr2=0x7f8b6c005080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:12.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b859a7640 1 --2- 172.21.15.132:0/2286384814 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b8015ad70 0x7f8b6c005080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b859a7640 1 -- 172.21.15.132:0/2286384814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b6c004350 msgr2=0x7f8b6c004820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:12.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b859a7640 1 --2- 172.21.15.132:0/2286384814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b6c004350 0x7f8b6c004820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.021+0000 7f8b859a7640 1 -- 172.21.15.132:0/2286384814 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b6c003520 con 0x7f8b6c0039a0 2023-12-20T04:46:12.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.022+0000 7f8b859a7640 1 --2- 172.21.15.132:0/2286384814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b6c0039a0 0x7f8b6c003d80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8b78009fc0 tx=0x7f8b6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68ebc0fef81e8c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:12.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.022+0000 7f8b849a5640 1 -- 172.21.15.132:0/2286384814 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7802cc20 con 0x7f8b6c0039a0 2023-12-20T04:46:12.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.022+0000 7f8b849a5640 1 -- 172.21.15.132:0/2286384814 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b7800f040 con 0x7f8b6c0039a0 2023-12-20T04:46:12.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.022+0000 7f8b849a5640 1 -- 172.21.15.132:0/2286384814 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b78034440 con 0x7f8b6c0039a0 2023-12-20T04:46:12.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.023+0000 7f8b87c0b640 1 -- 172.21.15.132:0/2286384814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b6c0039a0 msgr2=0x7f8b6c003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.023+0000 7f8b87c0b640 1 --2- 172.21.15.132:0/2286384814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b6c0039a0 0x7f8b6c003d80 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8b78009fc0 tx=0x7f8b6c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.023+0000 7f8b861a8640 1 -- 172.21.15.132:0/2286384814 reap_dead start 2023-12-20T04:46:12.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.023+0000 7f8b87c0b640 1 -- 172.21.15.132:0/2286384814 shutdown_connections 2023-12-20T04:46:12.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.023+0000 7f8b87c0b640 1 -- 172.21.15.132:0/2286384814 >> 172.21.15.132:0/2286384814 conn(0x7f8b800ced10 msgr2=0x7f8b800cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:12.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.023+0000 7f8b87c0b640 1 -- 172.21.15.132:0/2286384814 shutdown_connections 2023-12-20T04:46:12.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.023+0000 7f8b87c0b640 1 -- 172.21.15.132:0/2286384814 wait complete. 2023-12-20T04:46:12.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.024+0000 7f8b87c0b640 1 Processor -- start 2023-12-20T04:46:12.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.024+0000 7f8b87c0b640 1 -- start start 2023-12-20T04:46:12.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b87c0b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b80151f00 0x7f8b8015ca70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b87c0b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b801522e0 0x7f8b800ce490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b87c0b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b80157310 0x7f8b80157790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b87c0b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8015b150 con 0x7f8b80151f00 2023-12-20T04:46:12.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b87c0b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b800cdf60 con 0x7f8b801522e0 2023-12-20T04:46:12.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b87c0b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8b8015d090 con 0x7f8b80157310 2023-12-20T04:46:12.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b859a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b80151f00 0x7f8b8015ca70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b859a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b80151f00 0x7f8b8015ca70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34478/0 (socket says 172.21.15.132:34478) 2023-12-20T04:46:12.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b859a7640 1 -- 172.21.15.132:0/1236453376 learned_addr learned my addr 172.21.15.132:0/1236453376 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:12.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b861a8640 1 --2- 172.21.15.132:0/1236453376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b80157310 0x7f8b80157790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b859a7640 1 -- 172.21.15.132:0/1236453376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b80157310 msgr2=0x7f8b80157790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b859a7640 1 --2- 172.21.15.132:0/1236453376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b80157310 0x7f8b80157790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b859a7640 1 -- 172.21.15.132:0/1236453376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b801522e0 msgr2=0x7f8b800ce490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b851a6640 1 --2- 172.21.15.132:0/1236453376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b801522e0 0x7f8b800ce490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b859a7640 1 --2- 172.21.15.132:0/1236453376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b801522e0 0x7f8b800ce490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b859a7640 1 -- 172.21.15.132:0/1236453376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b8015d370 con 0x7f8b80151f00 2023-12-20T04:46:12.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b859a7640 1 --2- 172.21.15.132:0/1236453376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b80151f00 0x7f8b8015ca70 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8b7802c690 tx=0x7f8b78009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:12.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.025+0000 7f8b767fc640 1 -- 172.21.15.132:0/1236453376 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b7802cea0 con 0x7f8b80151f00 2023-12-20T04:46:12.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.026+0000 7f8b767fc640 1 -- 172.21.15.132:0/1236453376 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8b78034c50 con 0x7f8b80151f00 2023-12-20T04:46:12.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.026+0000 7f8b87c0b640 1 -- 172.21.15.132:0/1236453376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b8015d650 con 0x7f8b80151f00 2023-12-20T04:46:12.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.026+0000 7f8b767fc640 1 -- 172.21.15.132:0/1236453376 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8b78003990 con 0x7f8b80151f00 2023-12-20T04:46:12.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.026+0000 7f8b87c0b640 1 -- 172.21.15.132:0/1236453376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b800b0b30 con 0x7f8b80151f00 2023-12-20T04:46:12.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.027+0000 7f8b87c0b640 1 -- 172.21.15.132:0/1236453376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b8004e840 con 0x7f8b80151f00 2023-12-20T04:46:12.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.027+0000 7f8b767fc640 1 -- 172.21.15.132:0/1236453376 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8b78040450 con 0x7f8b80151f00 2023-12-20T04:46:12.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.027+0000 7f8b767fc640 1 --2- 172.21.15.132:0/1236453376 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8b6406a460 0x7f8b6406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.027+0000 7f8b767fc640 1 -- 172.21.15.132:0/1236453376 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8b780aaef0 con 0x7f8b80151f00 2023-12-20T04:46:12.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.027+0000 7f8b851a6640 1 --2- 172.21.15.132:0/1236453376 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8b6406a460 0x7f8b6406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.027+0000 7f8b767fc640 1 -- 172.21.15.132:0/1236453376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7f8b64071f90 con 0x7f8b80151f00 2023-12-20T04:46:12.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.028+0000 7f8b851a6640 1 --2- 172.21.15.132:0/1236453376 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8b6406a460 0x7f8b6406c920 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8b800c8920 tx=0x7f8b70007b70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:12.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.032+0000 7f8b767fc640 1 -- 172.21.15.132:0/1236453376 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8b78076690 con 0x7f8b80151f00 2023-12-20T04:46:12.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.200+0000 7f8b87c0b640 1 -- 172.21.15.132:0/1236453376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8b8006c5e0 con 0x7f8b80151f00 2023-12-20T04:46:12.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.201+0000 7f8b767fc640 1 -- 172.21.15.132:0/1236453376 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v70) v1 ==== 74+0+16196 (secure 0 0 0) 0x7f8b78044090 con 0x7f8b80151f00 2023-12-20T04:46:12.202 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:12.202 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":70,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:46:10.063359+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:45:07.136819+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":9,"pool_name":"cephfs_data","create_time":"2023-12-20T04:45:07.907185+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"66","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","full","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","full","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["backfillfull","exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:46:12.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.203+0000 7f8b87c0b640 1 -- 172.21.15.132:0/1236453376 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8b6406a460 msgr2=0x7f8b6406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.203+0000 7f8b87c0b640 1 --2- 172.21.15.132:0/1236453376 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8b6406a460 0x7f8b6406c920 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7f8b800c8920 tx=0x7f8b70007b70 comp rx=0 tx=0).stop 2023-12-20T04:46:12.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.203+0000 7f8b87c0b640 1 -- 172.21.15.132:0/1236453376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b80151f00 msgr2=0x7f8b8015ca70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.203+0000 7f8b87c0b640 1 --2- 172.21.15.132:0/1236453376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b80151f00 0x7f8b8015ca70 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8b7802c690 tx=0x7f8b78009750 comp rx=0 tx=0).stop 2023-12-20T04:46:12.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.203+0000 7f8b87c0b640 1 -- 172.21.15.132:0/1236453376 shutdown_connections 2023-12-20T04:46:12.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.203+0000 7f8b87c0b640 1 --2- 172.21.15.132:0/1236453376 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8b6406a460 0x7f8b6406c920 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.203+0000 7f8b87c0b640 1 --2- 172.21.15.132:0/1236453376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8b80157310 0x7f8b80157790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.203+0000 7f8b87c0b640 1 --2- 172.21.15.132:0/1236453376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8b801522e0 0x7f8b800ce490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.203+0000 7f8b87c0b640 1 --2- 172.21.15.132:0/1236453376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8b80151f00 0x7f8b8015ca70 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.203+0000 7f8b87c0b640 1 -- 172.21.15.132:0/1236453376 >> 172.21.15.132:0/1236453376 conn(0x7f8b800ced10 msgr2=0x7f8b80070de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:12.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.203+0000 7f8b87c0b640 1 -- 172.21.15.132:0/1236453376 shutdown_connections 2023-12-20T04:46:12.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.203+0000 7f8b87c0b640 1 -- 172.21.15.132:0/1236453376 wait complete. 2023-12-20T04:46:12.215 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-20T04:46:12.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.314+0000 7fe2eb38b640 1 Processor -- start 2023-12-20T04:46:12.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.314+0000 7fe2eb38b640 1 -- start start 2023-12-20T04:46:12.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.315+0000 7fe2eb38b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2e406b600 0x7fe2e406b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.315+0000 7fe2eb38b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e40c98e0 con 0x7fe2e40ca610 2023-12-20T04:46:12.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.315+0000 7fe2eb38b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe2e40b20e0 con 0x7fe2e40ce950 2023-12-20T04:46:12.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.315+0000 7fe2eb38b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe2e40b1420 con 0x7fe2e406b600 2023-12-20T04:46:12.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.315+0000 7fe2e9127640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2e406b600 0x7fe2e406b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.315+0000 7fe2e9127640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe2e406b600 0x7fe2e406b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34486/0 (socket says 172.21.15.132:34486) 2023-12-20T04:46:12.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.315+0000 7fe2e9127640 1 -- 172.21.15.132:0/920229809 learned_addr learned my addr 172.21.15.132:0/920229809 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:12.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.315+0000 7fe2e9928640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe2e40ca610 0x7fe2e40caaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57978/0 (socket says 172.21.15.132:57978) 2023-12-20T04:46:12.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.315+0000 7fe2e9127640 1 -- 172.21.15.132:0/920229809 >> v1:172.21.15.187:6789/0 conn(0x7fe2e40ce950 legacy=0x7fe2e40b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.315+0000 7fe2e9127640 1 -- 172.21.15.132:0/920229809 >> v1:172.21.15.132:6789/0 conn(0x7fe2e40ca610 legacy=0x7fe2e40caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.315+0000 7fe2dbfff640 1 -- 172.21.15.132:0/920229809 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3525063965 0 0) 0x7fe2e40c98e0 con 0x7fe2e40ca610 2023-12-20T04:46:12.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.315+0000 7fe2e9127640 1 -- 172.21.15.132:0/920229809 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e406bf20 con 0x7fe2e406b600 2023-12-20T04:46:12.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.316+0000 7fe2e9127640 1 --2- 172.21.15.132:0/920229809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2e406b600 0x7fe2e406b9e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00098a0 tx=0x7fe2e002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecec79717e8477d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:12.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.316+0000 7fe2dbfff640 1 -- 172.21.15.132:0/920229809 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e002f840 con 0x7fe2e406b600 2023-12-20T04:46:12.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.316+0000 7fe2dbfff640 1 -- 172.21.15.132:0/920229809 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2e002f9a0 con 0x7fe2e406b600 2023-12-20T04:46:12.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.316+0000 7fe2dbfff640 1 -- 172.21.15.132:0/920229809 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2e002fd30 con 0x7fe2e406b600 2023-12-20T04:46:12.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.317+0000 7fe2eb38b640 1 -- 172.21.15.132:0/920229809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2e406b600 msgr2=0x7fe2e406b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.317+0000 7fe2eb38b640 1 --2- 172.21.15.132:0/920229809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2e406b600 0x7fe2e406b9e0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7fe2e00098a0 tx=0x7fe2e002ba20 comp rx=0 tx=0).stop 2023-12-20T04:46:12.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.317+0000 7fe2eb38b640 1 -- 172.21.15.132:0/920229809 shutdown_connections 2023-12-20T04:46:12.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.317+0000 7fe2eb38b640 1 --2- 172.21.15.132:0/920229809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2e406b600 0x7fe2e406b9e0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.317+0000 7fe2eb38b640 1 -- 172.21.15.132:0/920229809 >> 172.21.15.132:0/920229809 conn(0x7fe2e40cbd10 msgr2=0x7fe2e40cc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:12.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.317+0000 7fe2eb38b640 1 -- 172.21.15.132:0/920229809 shutdown_connections 2023-12-20T04:46:12.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.317+0000 7fe2eb38b640 1 -- 172.21.15.132:0/920229809 wait complete. 2023-12-20T04:46:12.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.318+0000 7fe2eb38b640 1 Processor -- start 2023-12-20T04:46:12.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.318+0000 7fe2eb38b640 1 -- start start 2023-12-20T04:46:12.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.319+0000 7fe2eb38b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2e406b600 0x7fe2e40709b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.319+0000 7fe2eb38b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2e40ca610 0x7fe2e4070ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.319+0000 7fe2eb38b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2e40ce950 0x7fe2e40c3b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.319+0000 7fe2eb38b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e41f21a0 con 0x7fe2e40ce950 2023-12-20T04:46:12.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.319+0000 7fe2eb38b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e409b190 con 0x7fe2e406b600 2023-12-20T04:46:12.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.319+0000 7fe2eb38b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe2e41f2390 con 0x7fe2e40ca610 2023-12-20T04:46:12.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.319+0000 7fe2e9928640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2e40ce950 0x7fe2e40c3b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.319+0000 7fe2e9928640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2e40ce950 0x7fe2e40c3b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34496/0 (socket says 172.21.15.132:34496) 2023-12-20T04:46:12.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.319+0000 7fe2e9928640 1 -- 172.21.15.132:0/3890613832 learned_addr learned my addr 172.21.15.132:0/3890613832 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:12.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.319+0000 7fe2e9127640 1 --2- 172.21.15.132:0/3890613832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2e406b600 0x7fe2e40709b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.319+0000 7fe2e9928640 1 -- 172.21.15.132:0/3890613832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2e40ca610 msgr2=0x7fe2e4070ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.319+0000 7fe2e9928640 1 --2- 172.21.15.132:0/3890613832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2e40ca610 0x7fe2e4070ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.319+0000 7fe2e9928640 1 -- 172.21.15.132:0/3890613832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2e406b600 msgr2=0x7fe2e40709b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.319+0000 7fe2e9928640 1 --2- 172.21.15.132:0/3890613832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2e406b600 0x7fe2e40709b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.319+0000 7fe2e9928640 1 -- 172.21.15.132:0/3890613832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2e00094d0 con 0x7fe2e40ce950 2023-12-20T04:46:12.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.319+0000 7fe2e9127640 1 --2- 172.21.15.132:0/3890613832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2e406b600 0x7fe2e40709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:12.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.319+0000 7fe2e9928640 1 --2- 172.21.15.132:0/3890613832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2e40ce950 0x7fe2e40c3b10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00c7e0 tx=0x7fe2dc00cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:12.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.320+0000 7fe2d9ffb640 1 -- 172.21.15.132:0/3890613832 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc00a640 con 0x7fe2e40ce950 2023-12-20T04:46:12.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.320+0000 7fe2d9ffb640 1 -- 172.21.15.132:0/3890613832 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2dc00a7c0 con 0x7fe2e40ce950 2023-12-20T04:46:12.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.320+0000 7fe2eb38b640 1 -- 172.21.15.132:0/3890613832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe2e41f3110 con 0x7fe2e40ce950 2023-12-20T04:46:12.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.320+0000 7fe2d9ffb640 1 -- 172.21.15.132:0/3890613832 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe2dc00ab70 con 0x7fe2e40ce950 2023-12-20T04:46:12.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.320+0000 7fe2eb38b640 1 -- 172.21.15.132:0/3890613832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe2e41f2910 con 0x7fe2e40ce950 2023-12-20T04:46:12.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.321+0000 7fe2eb38b640 1 -- 172.21.15.132:0/3890613832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe2e4071b90 con 0x7fe2e40ce950 2023-12-20T04:46:12.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.321+0000 7fe2d9ffb640 1 -- 172.21.15.132:0/3890613832 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe2dc00acd0 con 0x7fe2e40ce950 2023-12-20T04:46:12.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.321+0000 7fe2d9ffb640 1 --2- 172.21.15.132:0/3890613832 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe2c806a430 0x7fe2c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.322+0000 7fe2d9ffb640 1 -- 172.21.15.132:0/3890613832 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe2dc0881b0 con 0x7fe2e40ce950 2023-12-20T04:46:12.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.322+0000 7fe2e9127640 1 --2- 172.21.15.132:0/3890613832 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe2c806a430 0x7fe2c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.322+0000 7fe2d9ffb640 1 -- 172.21.15.132:0/3890613832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=71}) v3 -- 0x7fe2c8071f60 con 0x7fe2e40ce950 2023-12-20T04:46:12.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.322+0000 7fe2e9127640 1 --2- 172.21.15.132:0/3890613832 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe2c806a430 0x7fe2c806c8f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0036000 tx=0x7fe2e0039040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:12.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.326+0000 7fe2d9ffb640 1 -- 172.21.15.132:0/3890613832 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe2dc053700 con 0x7fe2e40ce950 2023-12-20T04:46:12.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.524+0000 7fe2eb38b640 1 -- 172.21.15.132:0/3890613832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe2e404e840 con 0x7fe2e40ce950 2023-12-20T04:46:12.526 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:46:12.525+0000 7f1a5cbbd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-20T04:46:12.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.527+0000 7fe2d9ffb640 1 -- 172.21.15.132:0/3890613832 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(71..71 src has 1..71) v4 ==== 374+0+0 (secure 0 0 0) 0x7fe2dc0573c0 con 0x7fe2e40ce950 2023-12-20T04:46:12.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.527+0000 7fe2d9ffb640 1 -- 172.21.15.132:0/3890613832 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7fe2c8072810 con 0x7fe2e40ce950 2023-12-20T04:46:12.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.532+0000 7fe2d9ffb640 1 -- 172.21.15.132:0/3890613832 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v27) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe2dc018030 con 0x7fe2e40ce950 2023-12-20T04:46:12.533 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-20T04:46:12.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.534+0000 7fe2eb38b640 1 -- 172.21.15.132:0/3890613832 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe2c806a430 msgr2=0x7fe2c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.534+0000 7fe2eb38b640 1 --2- 172.21.15.132:0/3890613832 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe2c806a430 0x7fe2c806c8f0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe2e0036000 tx=0x7fe2e0039040 comp rx=0 tx=0).stop 2023-12-20T04:46:12.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.534+0000 7fe2eb38b640 1 -- 172.21.15.132:0/3890613832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2e40ce950 msgr2=0x7fe2e40c3b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.534+0000 7fe2eb38b640 1 --2- 172.21.15.132:0/3890613832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2e40ce950 0x7fe2e40c3b10 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7fe2dc00c7e0 tx=0x7fe2dc00cca0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.534+0000 7fe2eb38b640 1 -- 172.21.15.132:0/3890613832 shutdown_connections 2023-12-20T04:46:12.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.534+0000 7fe2eb38b640 1 --2- 172.21.15.132:0/3890613832 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe2c806a430 0x7fe2c806c8f0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.534+0000 7fe2eb38b640 1 --2- 172.21.15.132:0/3890613832 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe2e40ce950 0x7fe2e40c3b10 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.535+0000 7fe2eb38b640 1 --2- 172.21.15.132:0/3890613832 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe2e40ca610 0x7fe2e4070ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.535+0000 7fe2eb38b640 1 --2- 172.21.15.132:0/3890613832 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe2e406b600 0x7fe2e40709b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.535+0000 7fe2eb38b640 1 -- 172.21.15.132:0/3890613832 >> 172.21.15.132:0/3890613832 conn(0x7fe2e40cbd10 msgr2=0x7fe2e40cf020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:12.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.535+0000 7fe2eb38b640 1 -- 172.21.15.132:0/3890613832 shutdown_connections 2023-12-20T04:46:12.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.535+0000 7fe2eb38b640 1 -- 172.21.15.132:0/3890613832 wait complete. 2023-12-20T04:46:12.537 INFO:tasks.ceph.mds.d.smithi187.stderr: -7150> 2023-12-20T04:45:10.469+0000 7ffa6f01c640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:46:12.546 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-20T04:46:12.569 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-12-20T04:46:12.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.649+0000 7f87ab9ab640 1 Processor -- start 2023-12-20T04:46:12.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.649+0000 7f87ab9ab640 1 -- start start 2023-12-20T04:46:12.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.650+0000 7f87ab9ab640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f87a40cf880 0x7f87a40cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.650+0000 7f87ab9ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f87a40b60e0 0x7f87a40b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.650+0000 7f87ab9ab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87a40d1a90 con 0x7f87a415d300 2023-12-20T04:46:12.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.650+0000 7f87ab9ab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a40d0250 con 0x7f87a40b60e0 2023-12-20T04:46:12.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.650+0000 7f87ab9ab640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87a40d1d70 con 0x7f87a40cf880 2023-12-20T04:46:12.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.650+0000 7f87a9f48640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f87a40b60e0 0x7f87a40b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.650+0000 7f87a9747640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f87a415d300 0x7f87a40d1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57984/0 (socket says 172.21.15.132:57984) 2023-12-20T04:46:12.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.650+0000 7f87a9747640 1 -- 172.21.15.132:0/1213029666 learned_addr learned my addr 172.21.15.132:0/1213029666 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:12.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.650+0000 7f87a8f46640 1 --2- 172.21.15.132:0/1213029666 >> v2:172.21.15.187:3300/0 conn(0x7f87a40cf880 0x7f87a40cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.650+0000 7f87a9f48640 1 -- 172.21.15.132:0/1213029666 >> v2:172.21.15.187:3300/0 conn(0x7f87a40cf880 msgr2=0x7f87a40cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:12.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.650+0000 7f87a9f48640 1 --2- 172.21.15.132:0/1213029666 >> v2:172.21.15.187:3300/0 conn(0x7f87a40cf880 0x7f87a40cfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.650+0000 7f87a9f48640 1 -- 172.21.15.132:0/1213029666 >> v1:172.21.15.132:6789/0 conn(0x7f87a415d300 legacy=0x7f87a40d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.650+0000 7f879bfff640 1 -- 172.21.15.132:0/1213029666 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4144920499 0 0) 0x7f87a40d1a90 con 0x7f87a415d300 2023-12-20T04:46:12.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.650+0000 7f87a9f48640 1 -- 172.21.15.132:0/1213029666 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87a40d2050 con 0x7f87a40b60e0 2023-12-20T04:46:12.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.650+0000 7f87a8f46640 1 --2- 172.21.15.132:0/1213029666 >> v2:172.21.15.187:3300/0 conn(0x7f87a40cf880 0x7f87a40cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:12.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.651+0000 7f87a9f48640 1 --2- 172.21.15.132:0/1213029666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87a40b60e0 0x7f87a40b64f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f87a40d0560 tx=0x7f879c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=313d2462854ba1c7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:12.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.651+0000 7f879bfff640 1 -- 172.21.15.132:0/1213029666 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c02cc80 con 0x7f87a40b60e0 2023-12-20T04:46:12.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.651+0000 7f879bfff640 1 -- 172.21.15.132:0/1213029666 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c02cde0 con 0x7f87a40b60e0 2023-12-20T04:46:12.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.651+0000 7f879bfff640 1 -- 172.21.15.132:0/1213029666 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c034660 con 0x7f87a40b60e0 2023-12-20T04:46:12.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.652+0000 7f87ab9ab640 1 -- 172.21.15.132:0/1213029666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87a40b60e0 msgr2=0x7f87a40b64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.652+0000 7f87ab9ab640 1 --2- 172.21.15.132:0/1213029666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87a40b60e0 0x7f87a40b64f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f87a40d0560 tx=0x7f879c02bed0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.652+0000 7f87ab9ab640 1 -- 172.21.15.132:0/1213029666 shutdown_connections 2023-12-20T04:46:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.652+0000 7f87ab9ab640 1 --2- 172.21.15.132:0/1213029666 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87a40b60e0 0x7f87a40b64f0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.652+0000 7f87ab9ab640 1 --2- 172.21.15.132:0/1213029666 >> v2:172.21.15.187:3300/0 conn(0x7f87a40cf880 0x7f87a40cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.652+0000 7f87ab9ab640 1 -- 172.21.15.132:0/1213029666 >> 172.21.15.132:0/1213029666 conn(0x7f87a406a3d0 msgr2=0x7f87a406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.652+0000 7f87ab9ab640 1 -- 172.21.15.132:0/1213029666 shutdown_connections 2023-12-20T04:46:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.652+0000 7f87ab9ab640 1 -- 172.21.15.132:0/1213029666 wait complete. 2023-12-20T04:46:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.653+0000 7f87ab9ab640 1 Processor -- start 2023-12-20T04:46:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.653+0000 7f87ab9ab640 1 -- start start 2023-12-20T04:46:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87ab9ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87a40b60e0 0x7f87a40b5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87ab9ab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87a40cf880 0x7f87a414efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87ab9ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87a415d300 0x7f87a40b44e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87ab9ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a414ee30 con 0x7f87a415d300 2023-12-20T04:46:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87ab9ab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87a40b4a20 con 0x7f87a40cf880 2023-12-20T04:46:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87ab9ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87a4150240 con 0x7f87a40b60e0 2023-12-20T04:46:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87a9f48640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87a415d300 0x7f87a40b44e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87a9f48640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87a415d300 0x7f87a40b44e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34504/0 (socket says 172.21.15.132:34504) 2023-12-20T04:46:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87a9f48640 1 -- 172.21.15.132:0/115986293 learned_addr learned my addr 172.21.15.132:0/115986293 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87a8f46640 1 --2- 172.21.15.132:0/115986293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87a40cf880 0x7f87a414efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87a9747640 1 --2- 172.21.15.132:0/115986293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87a40b60e0 0x7f87a40b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87a9f48640 1 -- 172.21.15.132:0/115986293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87a40b60e0 msgr2=0x7f87a40b5450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87a9f48640 1 --2- 172.21.15.132:0/115986293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87a40b60e0 0x7f87a40b5450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87a9f48640 1 -- 172.21.15.132:0/115986293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87a40cf880 msgr2=0x7f87a414efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:12.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87a9f48640 1 --2- 172.21.15.132:0/115986293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87a40cf880 0x7f87a414efc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:12.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87a9f48640 1 -- 172.21.15.132:0/115986293 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f879c009a70 con 0x7f87a415d300 2023-12-20T04:46:12.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87a9f48640 1 --2- 172.21.15.132:0/115986293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87a415d300 0x7f87a40b44e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f879c009e80 tx=0x7f879c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:12.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f8799ffb640 1 -- 172.21.15.132:0/115986293 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c040650 con 0x7f87a415d300 2023-12-20T04:46:12.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f8799ffb640 1 -- 172.21.15.132:0/115986293 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f879c0407b0 con 0x7f87a415d300 2023-12-20T04:46:12.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f8799ffb640 1 -- 172.21.15.132:0/115986293 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f879c040b60 con 0x7f87a415d300 2023-12-20T04:46:12.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.654+0000 7f87ab9ab640 1 -- 172.21.15.132:0/115986293 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87a414f630 con 0x7f87a415d300 2023-12-20T04:46:12.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.655+0000 7f87ab9ab640 1 -- 172.21.15.132:0/115986293 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87a414fbf0 con 0x7f87a415d300 2023-12-20T04:46:12.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.655+0000 7f87ab9ab640 1 -- 172.21.15.132:0/115986293 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87a404e840 con 0x7f87a415d300 2023-12-20T04:46:12.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.656+0000 7f8799ffb640 1 -- 172.21.15.132:0/115986293 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f879c040cc0 con 0x7f87a415d300 2023-12-20T04:46:12.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.656+0000 7f8799ffb640 1 --2- 172.21.15.132:0/115986293 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f878806a430 0x7f878806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:12.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.656+0000 7f8799ffb640 1 -- 172.21.15.132:0/115986293 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f879c0ab6e0 con 0x7f87a415d300 2023-12-20T04:46:12.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.657+0000 7f87a9747640 1 --2- 172.21.15.132:0/115986293 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f878806a430 0x7f878806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:12.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.657+0000 7f8799ffb640 1 -- 172.21.15.132:0/115986293 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7f8788072070 con 0x7f87a415d300 2023-12-20T04:46:12.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.657+0000 7f87a9747640 1 --2- 172.21.15.132:0/115986293 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f878806a430 0x7f878806c8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f87a0000f60 tx=0x7f87a0007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:12.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.661+0000 7f8799ffb640 1 -- 172.21.15.132:0/115986293 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f879c076d00 con 0x7f87a415d300 2023-12-20T04:46:12.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:12.861+0000 7f87ab9ab640 1 -- 172.21.15.132:0/115986293 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f87a40b6a40 con 0x7f87a415d300 2023-12-20T04:46:13.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.533+0000 7f8799ffb640 1 -- 172.21.15.132:0/115986293 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v28) v1 ==== 104+0+0 (secure 0 0 0) 0x7f879c009450 con 0x7f87a415d300 2023-12-20T04:46:13.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.535+0000 7f87ab9ab640 1 -- 172.21.15.132:0/115986293 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f878806a430 msgr2=0x7f878806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:13.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.535+0000 7f87ab9ab640 1 --2- 172.21.15.132:0/115986293 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f878806a430 0x7f878806c8f0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7f87a0000f60 tx=0x7f87a0007b50 comp rx=0 tx=0).stop 2023-12-20T04:46:13.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.535+0000 7f87ab9ab640 1 -- 172.21.15.132:0/115986293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87a415d300 msgr2=0x7f87a40b44e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:13.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.535+0000 7f87ab9ab640 1 --2- 172.21.15.132:0/115986293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87a415d300 0x7f87a40b44e0 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f879c009e80 tx=0x7f879c004a40 comp rx=0 tx=0).stop 2023-12-20T04:46:13.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.536+0000 7f87ab9ab640 1 -- 172.21.15.132:0/115986293 shutdown_connections 2023-12-20T04:46:13.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.536+0000 7f87ab9ab640 1 --2- 172.21.15.132:0/115986293 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f878806a430 0x7f878806c8f0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:13.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.536+0000 7f87ab9ab640 1 --2- 172.21.15.132:0/115986293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87a415d300 0x7f87a40b44e0 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:13.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.536+0000 7f87ab9ab640 1 --2- 172.21.15.132:0/115986293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87a40cf880 0x7f87a414efc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:13.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.536+0000 7f87ab9ab640 1 --2- 172.21.15.132:0/115986293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87a40b60e0 0x7f87a40b5450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:13.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.536+0000 7f87ab9ab640 1 -- 172.21.15.132:0/115986293 >> 172.21.15.132:0/115986293 conn(0x7f87a406a3d0 msgr2=0x7f87a40b7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:13.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.536+0000 7f87ab9ab640 1 -- 172.21.15.132:0/115986293 shutdown_connections 2023-12-20T04:46:13.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.536+0000 7f87ab9ab640 1 -- 172.21.15.132:0/115986293 wait complete. 2023-12-20T04:46:13.550 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-20T04:46:13.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.655+0000 7faf44e8f640 1 Processor -- start 2023-12-20T04:46:13.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.655+0000 7faf44e8f640 1 -- start start 2023-12-20T04:46:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.656+0000 7faf44e8f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faf4015d190 0x7faf40160b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.656+0000 7faf44e8f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf400ce1f0 0x7faf400d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.656+0000 7faf44e8f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faf40161a70 con 0x7faf400b87a0 2023-12-20T04:46:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.656+0000 7faf44e8f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faf400b5fb0 con 0x7faf4015d190 2023-12-20T04:46:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.656+0000 7faf44e8f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf401611d0 con 0x7faf400ce1f0 2023-12-20T04:46:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.656+0000 7faf3e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7faf4015d190 0x7faf40160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.656+0000 7faf3dd9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7faf400b87a0 0x7faf400cdae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58000/0 (socket says 172.21.15.132:58000) 2023-12-20T04:46:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.656+0000 7faf3dd9b640 1 -- 172.21.15.132:0/3932736358 learned_addr learned my addr 172.21.15.132:0/3932736358 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.656+0000 7faf3e59c640 1 -- 172.21.15.132:0/3932736358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf400ce1f0 msgr2=0x7faf400d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.656+0000 7faf3e59c640 1 --2- 172.21.15.132:0/3932736358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf400ce1f0 0x7faf400d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.656+0000 7faf3e59c640 1 -- 172.21.15.132:0/3932736358 >> v1:172.21.15.132:6789/0 conn(0x7faf400b87a0 legacy=0x7faf400cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.657+0000 7faf3e59c640 1 -- 172.21.15.132:0/3932736358 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf401614b0 con 0x7faf4015d190 2023-12-20T04:46:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.656+0000 7faf3d59a640 1 -- 172.21.15.132:0/3932736358 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3696861638 0 0) 0x7faf40161a70 con 0x7faf400b87a0 2023-12-20T04:46:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.657+0000 7faf3e59c640 1 --2- 172.21.15.132:0/3932736358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf4015d190 0x7faf40160b80 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7faf300097a0 tx=0x7faf3002b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248a0a1e3314ef73 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.657+0000 7faf3d59a640 1 -- 172.21.15.132:0/3932736358 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30031710 con 0x7faf4015d190 2023-12-20T04:46:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.657+0000 7faf3d59a640 1 -- 172.21.15.132:0/3932736358 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf3002f050 con 0x7faf4015d190 2023-12-20T04:46:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.657+0000 7faf3d59a640 1 -- 172.21.15.132:0/3932736358 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30031a90 con 0x7faf4015d190 2023-12-20T04:46:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.658+0000 7faf44e8f640 1 -- 172.21.15.132:0/3932736358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf4015d190 msgr2=0x7faf40160b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:13.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.658+0000 7faf44e8f640 1 --2- 172.21.15.132:0/3932736358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf4015d190 0x7faf40160b80 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7faf300097a0 tx=0x7faf3002b7b0 comp rx=0 tx=0).stop 2023-12-20T04:46:13.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.658+0000 7faf44e8f640 1 -- 172.21.15.132:0/3932736358 shutdown_connections 2023-12-20T04:46:13.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.658+0000 7faf44e8f640 1 --2- 172.21.15.132:0/3932736358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf400ce1f0 0x7faf400d18a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:13.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.658+0000 7faf44e8f640 1 --2- 172.21.15.132:0/3932736358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf4015d190 0x7faf40160b80 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:13.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.658+0000 7faf44e8f640 1 -- 172.21.15.132:0/3932736358 >> 172.21.15.132:0/3932736358 conn(0x7faf4006a290 msgr2=0x7faf4006a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:13.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.658+0000 7faf44e8f640 1 -- 172.21.15.132:0/3932736358 shutdown_connections 2023-12-20T04:46:13.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.658+0000 7faf44e8f640 1 -- 172.21.15.132:0/3932736358 wait complete. 2023-12-20T04:46:13.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.659+0000 7faf44e8f640 1 Processor -- start 2023-12-20T04:46:13.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.659+0000 7faf44e8f640 1 -- start start 2023-12-20T04:46:13.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.660+0000 7faf44e8f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf400b87a0 0x7faf400b7340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:13.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.660+0000 7faf44e8f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf400ce1f0 0x7faf400c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:13.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.660+0000 7faf44e8f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf4015d190 0x7faf401523d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:13.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.660+0000 7faf44e8f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf400c6bc0 con 0x7faf400b87a0 2023-12-20T04:46:13.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.660+0000 7faf44e8f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faf400c6ea0 con 0x7faf4015d190 2023-12-20T04:46:13.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.660+0000 7faf44e8f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faf400c7180 con 0x7faf400ce1f0 2023-12-20T04:46:13.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.660+0000 7faf3e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf400b87a0 0x7faf400b7340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:13.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.660+0000 7faf3e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf400b87a0 0x7faf400b7340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34518/0 (socket says 172.21.15.132:34518) 2023-12-20T04:46:13.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.660+0000 7faf3e59c640 1 -- 172.21.15.132:0/2790448965 learned_addr learned my addr 172.21.15.132:0/2790448965 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:13.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.660+0000 7faf3e59c640 1 -- 172.21.15.132:0/2790448965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf400ce1f0 msgr2=0x7faf400c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:13.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.660+0000 7faf3e59c640 1 --2- 172.21.15.132:0/2790448965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf400ce1f0 0x7faf400c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:13.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.660+0000 7faf3e59c640 1 -- 172.21.15.132:0/2790448965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf4015d190 msgr2=0x7faf401523d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:13.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.660+0000 7faf3e59c640 1 --2- 172.21.15.132:0/2790448965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf4015d190 0x7faf401523d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:13.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.660+0000 7faf3e59c640 1 -- 172.21.15.132:0/2790448965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faf30009400 con 0x7faf400b87a0 2023-12-20T04:46:13.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.661+0000 7faf3e59c640 1 --2- 172.21.15.132:0/2790448965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf400b87a0 0x7faf400b7340 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7faf30000c00 tx=0x7faf300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:13.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.661+0000 7faf2effd640 1 -- 172.21.15.132:0/2790448965 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30033910 con 0x7faf400b87a0 2023-12-20T04:46:13.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.661+0000 7faf2effd640 1 -- 172.21.15.132:0/2790448965 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faf30033a90 con 0x7faf400b87a0 2023-12-20T04:46:13.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.661+0000 7faf44e8f640 1 -- 172.21.15.132:0/2790448965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faf400c7460 con 0x7faf400b87a0 2023-12-20T04:46:13.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.661+0000 7faf2effd640 1 -- 172.21.15.132:0/2790448965 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faf30033e40 con 0x7faf400b87a0 2023-12-20T04:46:13.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.661+0000 7faf44e8f640 1 -- 172.21.15.132:0/2790448965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faf400c57b0 con 0x7faf400b87a0 2023-12-20T04:46:13.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.662+0000 7faf44e8f640 1 -- 172.21.15.132:0/2790448965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faf400c7980 con 0x7faf400b87a0 2023-12-20T04:46:13.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.662+0000 7faf2effd640 1 -- 172.21.15.132:0/2790448965 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faf3003a040 con 0x7faf400b87a0 2023-12-20T04:46:13.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.662+0000 7faf2effd640 1 --2- 172.21.15.132:0/2790448965 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faf2006a430 0x7faf2006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:13.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.663+0000 7faf2effd640 1 -- 172.21.15.132:0/2790448965 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 5795+0+0 (secure 0 0 0) 0x7faf300aa7e0 con 0x7faf400b87a0 2023-12-20T04:46:13.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.663+0000 7faf3dd9b640 1 --2- 172.21.15.132:0/2790448965 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faf2006a430 0x7faf2006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:13.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.663+0000 7faf2effd640 1 -- 172.21.15.132:0/2790448965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=72}) v3 -- 0x7faf20072070 con 0x7faf400b87a0 2023-12-20T04:46:13.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.663+0000 7faf3dd9b640 1 --2- 172.21.15.132:0/2790448965 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faf2006a430 0x7faf2006c8f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7faf340011e0 tx=0x7faf34007940 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:13.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.667+0000 7faf2effd640 1 -- 172.21.15.132:0/2790448965 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7faf30038020 con 0x7faf400b87a0 2023-12-20T04:46:13.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:13.830+0000 7faf44e8f640 1 -- 172.21.15.132:0/2790448965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7faf4004e840 con 0x7faf400b87a0 2023-12-20T04:46:14.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.087+0000 7faf2effd640 1 -- 172.21.15.132:0/2790448965 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(72..72 src has 1..72) v4 ==== 1089+0+0 (secure 0 0 0) 0x7faf3007a250 con 0x7faf400b87a0 2023-12-20T04:46:14.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.087+0000 7faf2effd640 1 -- 172.21.15.132:0/2790448965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=73}) v3 -- 0x7faf200704a0 con 0x7faf400b87a0 2023-12-20T04:46:14.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.090+0000 7faf2effd640 1 -- 172.21.15.132:0/2790448965 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v72) v1 ==== 181+0+0 (secure 0 0 0) 0x7faf400c7980 con 0x7faf400b87a0 2023-12-20T04:46:14.094 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2023-12-20T04:46:14.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.094+0000 7faf44e8f640 1 -- 172.21.15.132:0/2790448965 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faf2006a430 msgr2=0x7faf2006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:14.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.094+0000 7faf44e8f640 1 --2- 172.21.15.132:0/2790448965 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faf2006a430 0x7faf2006c8f0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7faf340011e0 tx=0x7faf34007940 comp rx=0 tx=0).stop 2023-12-20T04:46:14.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.094+0000 7faf44e8f640 1 -- 172.21.15.132:0/2790448965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf400b87a0 msgr2=0x7faf400b7340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:14.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.094+0000 7faf44e8f640 1 --2- 172.21.15.132:0/2790448965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf400b87a0 0x7faf400b7340 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7faf30000c00 tx=0x7faf300046c0 comp rx=0 tx=0).stop 2023-12-20T04:46:14.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.095+0000 7faf44e8f640 1 -- 172.21.15.132:0/2790448965 shutdown_connections 2023-12-20T04:46:14.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.095+0000 7faf44e8f640 1 --2- 172.21.15.132:0/2790448965 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faf2006a430 0x7faf2006c8f0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:14.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.095+0000 7faf44e8f640 1 --2- 172.21.15.132:0/2790448965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faf4015d190 0x7faf401523d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:14.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.095+0000 7faf44e8f640 1 --2- 172.21.15.132:0/2790448965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faf400ce1f0 0x7faf400c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:14.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.095+0000 7faf44e8f640 1 --2- 172.21.15.132:0/2790448965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faf400b87a0 0x7faf400b7340 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:14.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.095+0000 7faf44e8f640 1 -- 172.21.15.132:0/2790448965 >> 172.21.15.132:0/2790448965 conn(0x7faf4006a290 msgr2=0x7faf40153490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:14.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.095+0000 7faf44e8f640 1 -- 172.21.15.132:0/2790448965 shutdown_connections 2023-12-20T04:46:14.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.095+0000 7faf44e8f640 1 -- 172.21.15.132:0/2790448965 wait complete. 2023-12-20T04:46:14.108 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-20T04:46:14.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.210+0000 7f1d3e8bd640 1 Processor -- start 2023-12-20T04:46:14.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.210+0000 7f1d3e8bd640 1 -- start start 2023-12-20T04:46:14.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.210+0000 7f1d3e8bd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1d380cb2b0 0x7f1d380cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:14.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.210+0000 7f1d3e8bd640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d380ce000 con 0x7f1d3815aee0 2023-12-20T04:46:14.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.210+0000 7f1d3e8bd640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1d380d0130 con 0x7f1d380cdbb0 2023-12-20T04:46:14.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.210+0000 7f1d3e8bd640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1d3815f370 con 0x7f1d380cb2b0 2023-12-20T04:46:14.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d37fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1d3815aee0 0x7f1d3815eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58016/0 (socket says 172.21.15.132:58016) 2023-12-20T04:46:14.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d37fff640 1 -- 172.21.15.132:0/2633789677 learned_addr learned my addr 172.21.15.132:0/2633789677 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:14.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d377fe640 1 --2- 172.21.15.132:0/2633789677 >> v2:172.21.15.187:3300/0 conn(0x7f1d380cb2b0 0x7f1d380cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:14.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d36ffd640 1 -- 172.21.15.132:0/2633789677 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 401863607 0 0) 0x7f1d28001110 con 0x7f1d3815aee0 2023-12-20T04:46:14.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d36ffd640 1 -- 172.21.15.132:0/2633789677 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1d20003520 con 0x7f1d3815aee0 2023-12-20T04:46:14.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d36ffd640 1 -- 172.21.15.132:0/2633789677 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2556876706 0 0) 0x7f1d20003520 con 0x7f1d3815aee0 2023-12-20T04:46:14.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d36ffd640 1 -- 172.21.15.132:0/2633789677 >> v2:172.21.15.187:3300/0 conn(0x7f1d380cb2b0 msgr2=0x7f1d380cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:14.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d36ffd640 1 --2- 172.21.15.132:0/2633789677 >> v2:172.21.15.187:3300/0 conn(0x7f1d380cb2b0 0x7f1d380cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:14.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d36ffd640 1 -- 172.21.15.132:0/2633789677 >> v1:172.21.15.187:6789/0 conn(0x7f1d380cdbb0 legacy=0x7f1d380d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:14.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d36ffd640 1 -- 172.21.15.132:0/2633789677 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d3815f650 con 0x7f1d3815aee0 2023-12-20T04:46:14.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d36ffd640 1 -- 172.21.15.132:0/2633789677 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f1d28001800 con 0x7f1d3815aee0 2023-12-20T04:46:14.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d36ffd640 1 -- 172.21.15.132:0/2633789677 >> v1:172.21.15.132:6789/0 conn(0x7f1d3815aee0 legacy=0x7f1d3815eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:14.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d36ffd640 1 --2- 172.21.15.132:0/2633789677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d200039a0 0x7f1d20003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:14.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d36ffd640 1 --2- 172.21.15.132:0/2633789677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d200047c0 0x7f1d20004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:14.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d36ffd640 1 --2- 172.21.15.132:0/2633789677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d20005180 0x7f1d2000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:14.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d36ffd640 1 -- 172.21.15.132:0/2633789677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d3815f370 con 0x7f1d200047c0 2023-12-20T04:46:14.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d36ffd640 1 -- 172.21.15.132:0/2633789677 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2000c050 con 0x7f1d200039a0 2023-12-20T04:46:14.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d36ffd640 1 -- 172.21.15.132:0/2633789677 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2000c210 con 0x7f1d20005180 2023-12-20T04:46:14.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d377fe640 1 --2- 172.21.15.132:0/2633789677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d200047c0 0x7f1d20004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:14.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d37fff640 1 --2- 172.21.15.132:0/2633789677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d200039a0 0x7f1d20003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:14.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d3ce5a640 1 --2- 172.21.15.132:0/2633789677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d20005180 0x7f1d2000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:14.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d377fe640 1 -- 172.21.15.132:0/2633789677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d20005180 msgr2=0x7f1d2000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:14.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d377fe640 1 --2- 172.21.15.132:0/2633789677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d20005180 0x7f1d2000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:14.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d377fe640 1 -- 172.21.15.132:0/2633789677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d200039a0 msgr2=0x7f1d20003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:14.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d377fe640 1 --2- 172.21.15.132:0/2633789677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d200039a0 0x7f1d20003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:14.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d377fe640 1 -- 172.21.15.132:0/2633789677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d20003520 con 0x7f1d200047c0 2023-12-20T04:46:14.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.211+0000 7f1d3ce5a640 1 -- 172.21.15.132:0/2633789677 reap_dead start 2023-12-20T04:46:14.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.212+0000 7f1d377fe640 1 --2- 172.21.15.132:0/2633789677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d200047c0 0x7f1d20004c40 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009ac0 tx=0x7f1d200057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb29fd9d16eebbcc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:14.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.212+0000 7f1d36ffd640 1 -- 172.21.15.132:0/2633789677 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c02c6b0 con 0x7f1d200047c0 2023-12-20T04:46:14.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.212+0000 7f1d36ffd640 1 -- 172.21.15.132:0/2633789677 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c02c810 con 0x7f1d200047c0 2023-12-20T04:46:14.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.212+0000 7f1d36ffd640 1 -- 172.21.15.132:0/2633789677 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c02cba0 con 0x7f1d200047c0 2023-12-20T04:46:14.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.213+0000 7f1d3e8bd640 1 -- 172.21.15.132:0/2633789677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d200047c0 msgr2=0x7f1d20004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:14.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.213+0000 7f1d3e8bd640 1 --2- 172.21.15.132:0/2633789677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d200047c0 0x7f1d20004c40 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c009ac0 tx=0x7f1d200057f0 comp rx=0 tx=0).stop 2023-12-20T04:46:14.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.213+0000 7f1d3e8bd640 1 -- 172.21.15.132:0/2633789677 shutdown_connections 2023-12-20T04:46:14.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.213+0000 7f1d3e8bd640 1 --2- 172.21.15.132:0/2633789677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d200047c0 0x7f1d20004c40 unknown :-1 s=CLOSED pgs=832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:14.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.213+0000 7f1d3e8bd640 1 -- 172.21.15.132:0/2633789677 >> 172.21.15.132:0/2633789677 conn(0x7f1d38072c60 msgr2=0x7f1d38073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:14.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.213+0000 7f1d3e8bd640 1 -- 172.21.15.132:0/2633789677 shutdown_connections 2023-12-20T04:46:14.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.213+0000 7f1d3e8bd640 1 -- 172.21.15.132:0/2633789677 wait complete. 2023-12-20T04:46:14.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.214+0000 7f1d3e8bd640 1 Processor -- start 2023-12-20T04:46:14.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.214+0000 7f1d3e8bd640 1 -- start start 2023-12-20T04:46:14.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.215+0000 7f1d3e8bd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d200047c0 0x7f1d38155150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:14.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.215+0000 7f1d3e8bd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d380b6550 0x7f1d38154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:14.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.215+0000 7f1d3e8bd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d380d07a0 0x7f1d380d0c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:14.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.215+0000 7f1d3e8bd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380d1190 con 0x7f1d380b6550 2023-12-20T04:46:14.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.215+0000 7f1d3e8bd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380b69d0 con 0x7f1d200047c0 2023-12-20T04:46:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.215+0000 7f1d3e8bd640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1d380ca850 con 0x7f1d380d07a0 2023-12-20T04:46:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.215+0000 7f1d377fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d380b6550 0x7f1d38154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.215+0000 7f1d377fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d380b6550 0x7f1d38154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34538/0 (socket says 172.21.15.132:34538) 2023-12-20T04:46:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.215+0000 7f1d377fe640 1 -- 172.21.15.132:0/990239522 learned_addr learned my addr 172.21.15.132:0/990239522 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.215+0000 7f1d377fe640 1 -- 172.21.15.132:0/990239522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d380d07a0 msgr2=0x7f1d380d0c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.215+0000 7f1d377fe640 1 --2- 172.21.15.132:0/990239522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d380d07a0 0x7f1d380d0c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.215+0000 7f1d377fe640 1 -- 172.21.15.132:0/990239522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d200047c0 msgr2=0x7f1d38155150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.215+0000 7f1d377fe640 1 --2- 172.21.15.132:0/990239522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d200047c0 0x7f1d38155150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.215+0000 7f1d377fe640 1 -- 172.21.15.132:0/990239522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d38155730 con 0x7f1d380b6550 2023-12-20T04:46:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.215+0000 7f1d377fe640 1 --2- 172.21.15.132:0/990239522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d380b6550 0x7f1d38154850 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c02c250 tx=0x7f1d2c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.216+0000 7f1d34ff9640 1 -- 172.21.15.132:0/990239522 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c003810 con 0x7f1d380b6550 2023-12-20T04:46:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.216+0000 7f1d34ff9640 1 -- 172.21.15.132:0/990239522 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1d2c003970 con 0x7f1d380b6550 2023-12-20T04:46:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.216+0000 7f1d34ff9640 1 -- 172.21.15.132:0/990239522 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1d2c003d00 con 0x7f1d380b6550 2023-12-20T04:46:14.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.216+0000 7f1d3e8bd640 1 -- 172.21.15.132:0/990239522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d38155a10 con 0x7f1d380b6550 2023-12-20T04:46:14.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.216+0000 7f1d3e8bd640 1 -- 172.21.15.132:0/990239522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d38155fd0 con 0x7f1d380b6550 2023-12-20T04:46:14.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.216+0000 7f1d3e8bd640 1 -- 172.21.15.132:0/990239522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d3804e840 con 0x7f1d380b6550 2023-12-20T04:46:14.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.217+0000 7f1d34ff9640 1 -- 172.21.15.132:0/990239522 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1d2c034440 con 0x7f1d380b6550 2023-12-20T04:46:14.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.217+0000 7f1d34ff9640 1 --2- 172.21.15.132:0/990239522 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d2406a430 0x7f1d2406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:14.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.217+0000 7f1d34ff9640 1 -- 172.21.15.132:0/990239522 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(72..72 src has 1..72) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f1d2c0aaad0 con 0x7f1d380b6550 2023-12-20T04:46:14.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.217+0000 7f1d37fff640 1 --2- 172.21.15.132:0/990239522 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d2406a430 0x7f1d2406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:14.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.218+0000 7f1d37fff640 1 --2- 172.21.15.132:0/990239522 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d2406a430 0x7f1d2406c8f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1d28001e20 tx=0x7f1d28001cb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:14.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.222+0000 7f1d34ff9640 1 -- 172.21.15.132:0/990239522 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1d2c0762d0 con 0x7f1d380b6550 2023-12-20T04:46:14.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:14.386+0000 7f1d3e8bd640 1 -- 172.21.15.132:0/990239522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f1d380cff10 con 0x7f1d380b6550 2023-12-20T04:46:15.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.097+0000 7f1d34ff9640 1 -- 172.21.15.132:0/990239522 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v73) v1 ==== 169+0+0 (secure 0 0 0) 0x7f1d2c04c0d0 con 0x7f1d380b6550 2023-12-20T04:46:15.101 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2023-12-20T04:46:15.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.103+0000 7f1d3e8bd640 1 -- 172.21.15.132:0/990239522 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d2406a430 msgr2=0x7f1d2406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:15.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.103+0000 7f1d3e8bd640 1 --2- 172.21.15.132:0/990239522 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d2406a430 0x7f1d2406c8f0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f1d28001e20 tx=0x7f1d28001cb0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.103+0000 7f1d3e8bd640 1 -- 172.21.15.132:0/990239522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d380b6550 msgr2=0x7f1d38154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:15.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.103+0000 7f1d3e8bd640 1 --2- 172.21.15.132:0/990239522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d380b6550 0x7f1d38154850 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c02c250 tx=0x7f1d2c004730 comp rx=0 tx=0).stop 2023-12-20T04:46:15.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.103+0000 7f1d3e8bd640 1 -- 172.21.15.132:0/990239522 shutdown_connections 2023-12-20T04:46:15.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.103+0000 7f1d3e8bd640 1 --2- 172.21.15.132:0/990239522 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1d2406a430 0x7f1d2406c8f0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.103+0000 7f1d3e8bd640 1 --2- 172.21.15.132:0/990239522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1d380d07a0 0x7f1d380d0c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.103+0000 7f1d3e8bd640 1 --2- 172.21.15.132:0/990239522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1d380b6550 0x7f1d38154850 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.103+0000 7f1d3e8bd640 1 --2- 172.21.15.132:0/990239522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1d200047c0 0x7f1d38155150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.103+0000 7f1d3e8bd640 1 -- 172.21.15.132:0/990239522 >> 172.21.15.132:0/990239522 conn(0x7f1d38072c60 msgr2=0x7f1d380c5870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:15.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.103+0000 7f1d3e8bd640 1 -- 172.21.15.132:0/990239522 shutdown_connections 2023-12-20T04:46:15.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.103+0000 7f1d3e8bd640 1 -- 172.21.15.132:0/990239522 wait complete. 2023-12-20T04:46:15.119 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-20T04:46:15.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.224+0000 7f5d9c0c4640 1 Processor -- start 2023-12-20T04:46:15.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.224+0000 7f5d9c0c4640 1 -- start start 2023-12-20T04:46:15.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.225+0000 7f5d9c0c4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d9415d300 0x7f5d940d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:15.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.225+0000 7f5d9c0c4640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5d940cff90 0x7f5d940b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:15.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.225+0000 7f5d9c0c4640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5d940d1a90 con 0x7f5d940d1550 2023-12-20T04:46:15.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.225+0000 7f5d9c0c4640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5d940d1d70 con 0x7f5d940cff90 2023-12-20T04:46:15.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.225+0000 7f5d9c0c4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d940d2050 con 0x7f5d9415d300 2023-12-20T04:46:15.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.226+0000 7f5d99e60640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d9415d300 0x7f5d940d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:15.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.226+0000 7f5d9a661640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5d940cff90 0x7f5d940b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:15.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.226+0000 7f5d9965f640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f5d940d1550 0x7f5d940cf880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:49974/0 (socket says 172.21.15.132:49974) 2023-12-20T04:46:15.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.226+0000 7f5d99e60640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d9415d300 0x7f5d940d1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:53340/0 (socket says 172.21.15.132:53340) 2023-12-20T04:46:15.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.226+0000 7f5d9a661640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5d940cff90 0x7f5d940b60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:49918/0 (socket says 172.21.15.132:49918) 2023-12-20T04:46:15.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.226+0000 7f5d9965f640 1 -- 172.21.15.132:0/541789992 learned_addr learned my addr 172.21.15.132:0/541789992 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:15.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.226+0000 7f5d99e60640 1 -- 172.21.15.132:0/541789992 >> v2:172.21.15.187:3300/0 conn(0x7f5d940cff90 msgr2=0x7f5d940b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:15.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.226+0000 7f5d99e60640 1 --2- 172.21.15.132:0/541789992 >> v2:172.21.15.187:3300/0 conn(0x7f5d940cff90 0x7f5d940b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.226+0000 7f5d99e60640 1 -- 172.21.15.132:0/541789992 >> v1:172.21.15.187:6789/0 conn(0x7f5d940d1550 legacy=0x7f5d940cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:15.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.226+0000 7f5d99e60640 1 -- 172.21.15.132:0/541789992 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d940d2330 con 0x7f5d9415d300 2023-12-20T04:46:15.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.226+0000 7f5d9a661640 1 --2- 172.21.15.132:0/541789992 >> v2:172.21.15.187:3300/0 conn(0x7f5d940cff90 0x7f5d940b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:46:15.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.227+0000 7f5d99e60640 1 --2- 172.21.15.132:0/541789992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d9415d300 0x7f5d940d1010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5d900097a0 tx=0x7f5d9002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c626d1a72486784 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:15.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.227+0000 7f5d98e5e640 1 -- 172.21.15.132:0/541789992 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d90031830 con 0x7f5d9415d300 2023-12-20T04:46:15.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.227+0000 7f5d98e5e640 1 -- 172.21.15.132:0/541789992 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d90031990 con 0x7f5d9415d300 2023-12-20T04:46:15.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.227+0000 7f5d98e5e640 1 -- 172.21.15.132:0/541789992 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d90031d20 con 0x7f5d9415d300 2023-12-20T04:46:15.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.227+0000 7f5d9c0c4640 1 -- 172.21.15.132:0/541789992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d9415d300 msgr2=0x7f5d940d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:15.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.227+0000 7f5d9c0c4640 1 --2- 172.21.15.132:0/541789992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d9415d300 0x7f5d940d1010 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f5d900097a0 tx=0x7f5d9002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.227+0000 7f5d9c0c4640 1 -- 172.21.15.132:0/541789992 shutdown_connections 2023-12-20T04:46:15.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.227+0000 7f5d9c0c4640 1 --2- 172.21.15.132:0/541789992 >> v2:172.21.15.187:3300/0 conn(0x7f5d940cff90 0x7f5d940b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.227+0000 7f5d9c0c4640 1 --2- 172.21.15.132:0/541789992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d9415d300 0x7f5d940d1010 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.227+0000 7f5d9c0c4640 1 -- 172.21.15.132:0/541789992 >> 172.21.15.132:0/541789992 conn(0x7f5d9406a3d0 msgr2=0x7f5d9406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:15.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.228+0000 7f5d9c0c4640 1 -- 172.21.15.132:0/541789992 shutdown_connections 2023-12-20T04:46:15.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.228+0000 7f5d9c0c4640 1 -- 172.21.15.132:0/541789992 wait complete. 2023-12-20T04:46:15.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.229+0000 7f5d9c0c4640 1 Processor -- start 2023-12-20T04:46:15.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.229+0000 7f5d9c0c4640 1 -- start start 2023-12-20T04:46:15.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.229+0000 7f5d9c0c4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d940cff90 0x7f5d941f5c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:15.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.229+0000 7f5d9c0c4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d940d1550 0x7f5d941600b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:15.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.229+0000 7f5d9c0c4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d9415d300 0x7f5d94153480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:15.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.229+0000 7f5d9c0c4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d941f6ab0 con 0x7f5d940d1550 2023-12-20T04:46:15.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.229+0000 7f5d9c0c4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d9415bf40 con 0x7f5d9415d300 2023-12-20T04:46:15.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.229+0000 7f5d9c0c4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5d941539c0 con 0x7f5d940cff90 2023-12-20T04:46:15.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.229+0000 7f5d9965f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d940d1550 0x7f5d941600b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:15.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.230+0000 7f5d9965f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d940d1550 0x7f5d941600b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34542/0 (socket says 172.21.15.132:34542) 2023-12-20T04:46:15.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.230+0000 7f5d9965f640 1 -- 172.21.15.132:0/1956682418 learned_addr learned my addr 172.21.15.132:0/1956682418 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:15.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.230+0000 7f5d99e60640 1 --2- 172.21.15.132:0/1956682418 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d940cff90 0x7f5d941f5c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:15.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.230+0000 7f5d9a661640 1 --2- 172.21.15.132:0/1956682418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d9415d300 0x7f5d94153480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:15.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.230+0000 7f5d9965f640 1 -- 172.21.15.132:0/1956682418 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d940cff90 msgr2=0x7f5d941f5c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:15.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.230+0000 7f5d9965f640 1 --2- 172.21.15.132:0/1956682418 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d940cff90 0x7f5d941f5c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.230+0000 7f5d9965f640 1 -- 172.21.15.132:0/1956682418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d9415d300 msgr2=0x7f5d94153480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:15.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.230+0000 7f5d9965f640 1 --2- 172.21.15.132:0/1956682418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d9415d300 0x7f5d94153480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.230+0000 7f5d9965f640 1 -- 172.21.15.132:0/1956682418 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c009a70 con 0x7f5d940d1550 2023-12-20T04:46:15.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.230+0000 7f5d9965f640 1 --2- 172.21.15.132:0/1956682418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d940d1550 0x7f5d941600b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400c480 tx=0x7f5d8400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:15.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.230+0000 7f5d8a7fc640 1 -- 172.21.15.132:0/1956682418 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84005d30 con 0x7f5d940d1550 2023-12-20T04:46:15.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.230+0000 7f5d8a7fc640 1 -- 172.21.15.132:0/1956682418 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5d84005e90 con 0x7f5d940d1550 2023-12-20T04:46:15.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.230+0000 7f5d9c0c4640 1 -- 172.21.15.132:0/1956682418 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d90009400 con 0x7f5d940d1550 2023-12-20T04:46:15.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.230+0000 7f5d8a7fc640 1 -- 172.21.15.132:0/1956682418 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5d84007270 con 0x7f5d940d1550 2023-12-20T04:46:15.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.230+0000 7f5d9c0c4640 1 -- 172.21.15.132:0/1956682418 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d941f64f0 con 0x7f5d940d1550 2023-12-20T04:46:15.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.231+0000 7f5d9c0c4640 1 -- 172.21.15.132:0/1956682418 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d9404e840 con 0x7f5d940d1550 2023-12-20T04:46:15.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.232+0000 7f5d8a7fc640 1 -- 172.21.15.132:0/1956682418 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5d840073d0 con 0x7f5d940d1550 2023-12-20T04:46:15.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.232+0000 7f5d8a7fc640 1 --2- 172.21.15.132:0/1956682418 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5d7806a460 0x7f5d7806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:15.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.232+0000 7f5d8a7fc640 1 -- 172.21.15.132:0/1956682418 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5d84087af0 con 0x7f5d940d1550 2023-12-20T04:46:15.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.232+0000 7f5d99e60640 1 --2- 172.21.15.132:0/1956682418 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5d7806a460 0x7f5d7806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:15.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.232+0000 7f5d99e60640 1 --2- 172.21.15.132:0/1956682418 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5d7806a460 0x7f5d7806c920 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5d90036000 tx=0x7f5d9003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:15.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.236+0000 7f5d8a7fc640 1 -- 172.21.15.132:0/1956682418 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5d84053520 con 0x7f5d940d1550 2023-12-20T04:46:15.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.404+0000 7f5d9c0c4640 1 -- 172.21.15.132:0/1956682418 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f5d940d1200 con 0x7f5d940d1550 2023-12-20T04:46:15.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.408+0000 7f5d8a7fc640 1 -- 172.21.15.132:0/1956682418 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v7) v1 ==== 104+0+0 (secure 0 0 0) 0x7f5d84056b40 con 0x7f5d940d1550 2023-12-20T04:46:15.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.410+0000 7f5d9c0c4640 1 -- 172.21.15.132:0/1956682418 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5d7806a460 msgr2=0x7f5d7806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:15.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.410+0000 7f5d9c0c4640 1 --2- 172.21.15.132:0/1956682418 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5d7806a460 0x7f5d7806c920 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f5d90036000 tx=0x7f5d9003c040 comp rx=0 tx=0).stop 2023-12-20T04:46:15.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.410+0000 7f5d9c0c4640 1 -- 172.21.15.132:0/1956682418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d940d1550 msgr2=0x7f5d941600b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:15.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.410+0000 7f5d9c0c4640 1 --2- 172.21.15.132:0/1956682418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d940d1550 0x7f5d941600b0 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7f5d8400c480 tx=0x7f5d8400c940 comp rx=0 tx=0).stop 2023-12-20T04:46:15.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.410+0000 7f5d9c0c4640 1 -- 172.21.15.132:0/1956682418 shutdown_connections 2023-12-20T04:46:15.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.410+0000 7f5d9c0c4640 1 --2- 172.21.15.132:0/1956682418 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5d7806a460 0x7f5d7806c920 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.410+0000 7f5d9c0c4640 1 --2- 172.21.15.132:0/1956682418 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5d9415d300 0x7f5d94153480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.410+0000 7f5d9c0c4640 1 --2- 172.21.15.132:0/1956682418 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5d940d1550 0x7f5d941600b0 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.410+0000 7f5d9c0c4640 1 --2- 172.21.15.132:0/1956682418 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5d940cff90 0x7f5d941f5c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.410+0000 7f5d9c0c4640 1 -- 172.21.15.132:0/1956682418 >> 172.21.15.132:0/1956682418 conn(0x7f5d9406a3d0 msgr2=0x7f5d940b8230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:15.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.410+0000 7f5d9c0c4640 1 -- 172.21.15.132:0/1956682418 shutdown_connections 2023-12-20T04:46:15.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.410+0000 7f5d9c0c4640 1 -- 172.21.15.132:0/1956682418 wait complete. 2023-12-20T04:46:15.423 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose' 2023-12-20T04:46:15.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.521+0000 7fb36ce66640 1 Processor -- start 2023-12-20T04:46:15.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.521+0000 7fb36ce66640 1 -- start start 2023-12-20T04:46:15.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.522+0000 7fb36ce66640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb36815ad70 0x7fb36806f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:15.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.522+0000 7fb36ce66640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb36806b130 0x7fb36806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:15.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.522+0000 7fb36ce66640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb3680c9ab0 con 0x7fb3680c92d0 2023-12-20T04:46:15.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.522+0000 7fb36ce66640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb36815ea40 con 0x7fb36806b130 2023-12-20T04:46:15.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.522+0000 7fb36ce66640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680c9d90 con 0x7fb36815ad70 2023-12-20T04:46:15.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.522+0000 7fb366d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb36806b130 0x7fb36806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:15.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.522+0000 7fb366d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb36806b130 0x7fb36806b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34556/0 (socket says 172.21.15.132:34556) 2023-12-20T04:46:15.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.522+0000 7fb366d9d640 1 -- 172.21.15.132:0/1725903009 learned_addr learned my addr 172.21.15.132:0/1725903009 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:15.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.522+0000 7fb36659c640 1 --2- 172.21.15.132:0/1725903009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb36815ad70 0x7fb36806f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:15.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.522+0000 7fb366d9d640 1 -- 172.21.15.132:0/1725903009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb36815ad70 msgr2=0x7fb36806f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:15.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.522+0000 7fb366d9d640 1 --2- 172.21.15.132:0/1725903009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb36815ad70 0x7fb36806f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.522+0000 7fb366d9d640 1 -- 172.21.15.132:0/1725903009 >> v1:172.21.15.187:6789/0 conn(0x7fb3680c92d0 legacy=0x7fb36815f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:15.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.522+0000 7fb366d9d640 1 -- 172.21.15.132:0/1725903009 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3680ca070 con 0x7fb36806b130 2023-12-20T04:46:15.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.523+0000 7fb366d9d640 1 --2- 172.21.15.132:0/1725903009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb36806b130 0x7fb36806b5c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb360009e50 tx=0x7fb36002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13880554400da79 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:15.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.523+0000 7fb365d9b640 1 -- 172.21.15.132:0/1725903009 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36002cb00 con 0x7fb36806b130 2023-12-20T04:46:15.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.523+0000 7fb365d9b640 1 -- 172.21.15.132:0/1725903009 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36002cc60 con 0x7fb36806b130 2023-12-20T04:46:15.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.523+0000 7fb365d9b640 1 -- 172.21.15.132:0/1725903009 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3600343f0 con 0x7fb36806b130 2023-12-20T04:46:15.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.524+0000 7fb36ce66640 1 -- 172.21.15.132:0/1725903009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb36806b130 msgr2=0x7fb36806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:15.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.524+0000 7fb36ce66640 1 --2- 172.21.15.132:0/1725903009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb36806b130 0x7fb36806b5c0 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fb360009e50 tx=0x7fb36002bf60 comp rx=0 tx=0).stop 2023-12-20T04:46:15.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.524+0000 7fb36ce66640 1 -- 172.21.15.132:0/1725903009 shutdown_connections 2023-12-20T04:46:15.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.524+0000 7fb36ce66640 1 --2- 172.21.15.132:0/1725903009 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb36806b130 0x7fb36806b5c0 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.524+0000 7fb36ce66640 1 --2- 172.21.15.132:0/1725903009 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb36815ad70 0x7fb36806f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.524+0000 7fb36ce66640 1 -- 172.21.15.132:0/1725903009 >> 172.21.15.132:0/1725903009 conn(0x7fb3680ced10 msgr2=0x7fb3680cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:15.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.524+0000 7fb36ce66640 1 -- 172.21.15.132:0/1725903009 shutdown_connections 2023-12-20T04:46:15.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.524+0000 7fb36ce66640 1 -- 172.21.15.132:0/1725903009 wait complete. 2023-12-20T04:46:15.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.525+0000 7fb36ce66640 1 Processor -- start 2023-12-20T04:46:15.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.525+0000 7fb36ce66640 1 -- start start 2023-12-20T04:46:15.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb36ce66640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb36806b130 0x7fb36814fe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb36ce66640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3680c92d0 0x7fb368154de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb36ce66640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb36815ad70 0x7fb3681f05d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb36ce66640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680c5d50 con 0x7fb36815ad70 2023-12-20T04:46:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb36ce66640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3680c62d0 con 0x7fb3680c92d0 2023-12-20T04:46:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb36ce66640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3681f1150 con 0x7fb36806b130 2023-12-20T04:46:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb366d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb36815ad70 0x7fb3681f05d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb366d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb36815ad70 0x7fb3681f05d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34570/0 (socket says 172.21.15.132:34570) 2023-12-20T04:46:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb366d9d640 1 -- 172.21.15.132:0/1463749966 learned_addr learned my addr 172.21.15.132:0/1463749966 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb36659c640 1 --2- 172.21.15.132:0/1463749966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb36806b130 0x7fb36814fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb35ffff640 1 --2- 172.21.15.132:0/1463749966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3680c92d0 0x7fb368154de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb366d9d640 1 -- 172.21.15.132:0/1463749966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb36806b130 msgr2=0x7fb36814fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb366d9d640 1 --2- 172.21.15.132:0/1463749966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb36806b130 0x7fb36814fe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb366d9d640 1 -- 172.21.15.132:0/1463749966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3680c92d0 msgr2=0x7fb368154de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb366d9d640 1 --2- 172.21.15.132:0/1463749966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3680c92d0 0x7fb368154de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:15.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb366d9d640 1 -- 172.21.15.132:0/1463749966 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb360009b30 con 0x7fb36815ad70 2023-12-20T04:46:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb366d9d640 1 --2- 172.21.15.132:0/1463749966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb36815ad70 0x7fb3681f05d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb360036040 tx=0x7fb360004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb35effd640 1 -- 172.21.15.132:0/1463749966 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb360009510 con 0x7fb36815ad70 2023-12-20T04:46:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb35effd640 1 -- 172.21.15.132:0/1463749966 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb36003e450 con 0x7fb36815ad70 2023-12-20T04:46:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb36ce66640 1 -- 172.21.15.132:0/1463749966 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3681f1430 con 0x7fb36815ad70 2023-12-20T04:46:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb35effd640 1 -- 172.21.15.132:0/1463749966 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb36003e800 con 0x7fb36815ad70 2023-12-20T04:46:15.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.526+0000 7fb36ce66640 1 -- 172.21.15.132:0/1463749966 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3680b38b0 con 0x7fb36815ad70 2023-12-20T04:46:15.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.528+0000 7fb36ce66640 1 -- 172.21.15.132:0/1463749966 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3681f15c0 con 0x7fb36815ad70 2023-12-20T04:46:15.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.528+0000 7fb35effd640 1 -- 172.21.15.132:0/1463749966 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb36003e960 con 0x7fb36815ad70 2023-12-20T04:46:15.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.528+0000 7fb35effd640 1 --2- 172.21.15.132:0/1463749966 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb34806a430 0x7fb34806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:15.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.528+0000 7fb35effd640 1 -- 172.21.15.132:0/1463749966 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb3600ab390 con 0x7fb36815ad70 2023-12-20T04:46:15.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.528+0000 7fb36659c640 1 --2- 172.21.15.132:0/1463749966 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb34806a430 0x7fb34806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:15.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.529+0000 7fb36659c640 1 --2- 172.21.15.132:0/1463749966 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb34806a430 0x7fb34806c8f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb358006fd0 tx=0x7fb358008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:15.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.533+0000 7fb35effd640 1 -- 172.21.15.132:0/1463749966 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb360076c80 con 0x7fb36815ad70 2023-12-20T04:46:15.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:15.766+0000 7fb36ce66640 1 -- 172.21.15.132:0/1463749966 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]} v 0) v1 -- 0x7fb36815ec50 con 0x7fb36815ad70 2023-12-20T04:46:16.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.094+0000 7fb35effd640 1 -- 172.21.15.132:0/1463749966 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fclose"]}]=0 v195) v1 ==== 134+0+0 (secure 0 0 0) 0x7fb36007a2a0 con 0x7fb36815ad70 2023-12-20T04:46:16.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.096+0000 7fb36ce66640 1 -- 172.21.15.132:0/1463749966 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb34806a430 msgr2=0x7fb34806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:16.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.096+0000 7fb36ce66640 1 --2- 172.21.15.132:0/1463749966 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb34806a430 0x7fb34806c8f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fb358006fd0 tx=0x7fb358008040 comp rx=0 tx=0).stop 2023-12-20T04:46:16.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.096+0000 7fb36ce66640 1 -- 172.21.15.132:0/1463749966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb36815ad70 msgr2=0x7fb3681f05d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:16.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.096+0000 7fb36ce66640 1 --2- 172.21.15.132:0/1463749966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb36815ad70 0x7fb3681f05d0 secure :-1 s=READY pgs=836 cs=0 l=1 rev1=1 crypto rx=0x7fb360036040 tx=0x7fb360004a40 comp rx=0 tx=0).stop 2023-12-20T04:46:16.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.096+0000 7fb36ce66640 1 -- 172.21.15.132:0/1463749966 shutdown_connections 2023-12-20T04:46:16.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.096+0000 7fb36ce66640 1 --2- 172.21.15.132:0/1463749966 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb34806a430 0x7fb34806c8f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:16.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.096+0000 7fb36ce66640 1 --2- 172.21.15.132:0/1463749966 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb36815ad70 0x7fb3681f05d0 unknown :-1 s=CLOSED pgs=836 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:16.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.096+0000 7fb36ce66640 1 --2- 172.21.15.132:0/1463749966 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb3680c92d0 0x7fb368154de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:16.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.096+0000 7fb36ce66640 1 --2- 172.21.15.132:0/1463749966 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb36806b130 0x7fb36814fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:16.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.096+0000 7fb36ce66640 1 -- 172.21.15.132:0/1463749966 >> 172.21.15.132:0/1463749966 conn(0x7fb3680ced10 msgr2=0x7fb3680ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:16.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.096+0000 7fb36ce66640 1 -- 172.21.15.132:0/1463749966 shutdown_connections 2023-12-20T04:46:16.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.096+0000 7fb36ce66640 1 -- 172.21.15.132:0/1463749966 wait complete. 2023-12-20T04:46:16.109 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-12-20T04:46:16.109 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestClusterFull) That when the full flag is encountered during asynchronous 2023-12-20T04:46:16.109 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestClusterFull) 2023-12-20T04:46:16.109 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-12-20T04:46:16.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.208+0000 7f1206b9c640 1 Processor -- start 2023-12-20T04:46:16.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.208+0000 7f1206b9c640 1 -- start start 2023-12-20T04:46:16.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f1206b9c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f120015d100 0x7f12000b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:16.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f1206b9c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12000d0370 0x7f12000cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:16.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f1206b9c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12000b2f90 con 0x7f1200161850 2023-12-20T04:46:16.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f1206b9c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12001613c0 con 0x7f120015d100 2023-12-20T04:46:16.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f1206b9c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12000d1b00 con 0x7f12000d0370 2023-12-20T04:46:16.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f1205139640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1200161850 0x7f120006c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58020/0 (socket says 172.21.15.132:58020) 2023-12-20T04:46:16.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f1205139640 1 -- 172.21.15.132:0/3568679465 learned_addr learned my addr 172.21.15.132:0/3568679465 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:16.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11fffff640 1 --2- 172.21.15.132:0/3568679465 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12000d0370 0x7f12000cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:16.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f1204938640 1 --2- 172.21.15.132:0/3568679465 >> v2:172.21.15.187:3300/0 conn(0x7f120015d100 0x7f12000b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:16.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11ff7fe640 1 -- 172.21.15.132:0/3568679465 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3357101199 0 0) 0x7f11f8001490 con 0x7f1200161850 2023-12-20T04:46:16.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11ff7fe640 1 -- 172.21.15.132:0/3568679465 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f11f0003520 con 0x7f1200161850 2023-12-20T04:46:16.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11ff7fe640 1 -- 172.21.15.132:0/3568679465 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2433418104 0 0) 0x7f11f0003520 con 0x7f1200161850 2023-12-20T04:46:16.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11ff7fe640 1 -- 172.21.15.132:0/3568679465 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12000d0370 msgr2=0x7f12000cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:16.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11ff7fe640 1 --2- 172.21.15.132:0/3568679465 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12000d0370 0x7f12000cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:16.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11ff7fe640 1 -- 172.21.15.132:0/3568679465 >> v2:172.21.15.187:3300/0 conn(0x7f120015d100 msgr2=0x7f12000b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:16.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11ff7fe640 1 --2- 172.21.15.132:0/3568679465 >> v2:172.21.15.187:3300/0 conn(0x7f120015d100 0x7f12000b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:16.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11ff7fe640 1 -- 172.21.15.132:0/3568679465 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12000d0810 con 0x7f1200161850 2023-12-20T04:46:16.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11ff7fe640 1 -- 172.21.15.132:0/3568679465 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f11f8001b80 con 0x7f1200161850 2023-12-20T04:46:16.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11ff7fe640 1 -- 172.21.15.132:0/3568679465 >> v1:172.21.15.132:6789/0 conn(0x7f1200161850 legacy=0x7f120006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:16.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11ff7fe640 1 --2- 172.21.15.132:0/3568679465 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11f0003970 0x7f11f0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:16.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11ff7fe640 1 --2- 172.21.15.132:0/3568679465 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11f00047c0 0x7f11f0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:16.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11ff7fe640 1 --2- 172.21.15.132:0/3568679465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11f0005180 0x7f11f000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:16.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11ff7fe640 1 -- 172.21.15.132:0/3568679465 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12001613c0 con 0x7f11f0005180 2023-12-20T04:46:16.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11ff7fe640 1 -- 172.21.15.132:0/3568679465 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12000d1b00 con 0x7f11f0003970 2023-12-20T04:46:16.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11ff7fe640 1 -- 172.21.15.132:0/3568679465 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f11f000bf10 con 0x7f11f00047c0 2023-12-20T04:46:16.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f1204938640 1 --2- 172.21.15.132:0/3568679465 >> v2:172.21.15.187:3300/0 conn(0x7f120015d100 0x7f12000b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:46:16.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.209+0000 7f11fffff640 1 --2- 172.21.15.132:0/3568679465 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12000d0370 0x7f12000cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:46:16.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.210+0000 7f1205139640 1 --2- 172.21.15.132:0/3568679465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11f0005180 0x7f11f000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:16.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.210+0000 7f1204938640 1 --2- 172.21.15.132:0/3568679465 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11f0003970 0x7f11f0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:16.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.210+0000 7f11fffff640 1 --2- 172.21.15.132:0/3568679465 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11f00047c0 0x7f11f0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:16.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.210+0000 7f1205139640 1 -- 172.21.15.132:0/3568679465 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11f00047c0 msgr2=0x7f11f0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:16.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.210+0000 7f1205139640 1 --2- 172.21.15.132:0/3568679465 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f11f00047c0 0x7f11f0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:16.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.210+0000 7f1205139640 1 -- 172.21.15.132:0/3568679465 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11f0003970 msgr2=0x7f11f0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:16.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.210+0000 7f1205139640 1 --2- 172.21.15.132:0/3568679465 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f11f0003970 0x7f11f0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:16.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.210+0000 7f1205139640 1 -- 172.21.15.132:0/3568679465 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f11f0003520 con 0x7f11f0005180 2023-12-20T04:46:16.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.211+0000 7f1205139640 1 --2- 172.21.15.132:0/3568679465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11f0005180 0x7f11f000b980 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f11f800a860 tx=0x7f11f00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3078132174bb9e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:16.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.211+0000 7f11ff7fe640 1 -- 172.21.15.132:0/3568679465 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8034630 con 0x7f11f0005180 2023-12-20T04:46:16.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.211+0000 7f11ff7fe640 1 -- 172.21.15.132:0/3568679465 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f802f070 con 0x7f11f0005180 2023-12-20T04:46:16.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.211+0000 7f11ff7fe640 1 -- 172.21.15.132:0/3568679465 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f80349f0 con 0x7f11f0005180 2023-12-20T04:46:16.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.211+0000 7f1206b9c640 1 -- 172.21.15.132:0/3568679465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11f0005180 msgr2=0x7f11f000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:16.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.211+0000 7f1206b9c640 1 --2- 172.21.15.132:0/3568679465 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f11f0005180 0x7f11f000b980 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7f11f800a860 tx=0x7f11f00057f0 comp rx=0 tx=0).stop 2023-12-20T04:46:16.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.211+0000 7f1205139640 1 -- 172.21.15.132:0/3568679465 reap_dead start 2023-12-20T04:46:16.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.211+0000 7f1206b9c640 1 -- 172.21.15.132:0/3568679465 shutdown_connections 2023-12-20T04:46:16.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.211+0000 7f1206b9c640 1 -- 172.21.15.132:0/3568679465 >> 172.21.15.132:0/3568679465 conn(0x7f120006d7c0 msgr2=0x7f120006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:16.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.211+0000 7f1206b9c640 1 -- 172.21.15.132:0/3568679465 shutdown_connections 2023-12-20T04:46:16.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.211+0000 7f1206b9c640 1 -- 172.21.15.132:0/3568679465 wait complete. 2023-12-20T04:46:16.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.212+0000 7f1206b9c640 1 Processor -- start 2023-12-20T04:46:16.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.212+0000 7f1206b9c640 1 -- start start 2023-12-20T04:46:16.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.213+0000 7f1206b9c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1200150bf0 0x7f12000c9c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:16.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.213+0000 7f1206b9c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12000c8a40 0x7f12000c50a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:16.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.213+0000 7f1206b9c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12000c55e0 0x7f12000cd5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:16.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.213+0000 7f1206b9c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12000ade50 con 0x7f12000c55e0 2023-12-20T04:46:16.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.213+0000 7f1206b9c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12000c5a60 con 0x7f12000c8a40 2023-12-20T04:46:16.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.213+0000 7f1206b9c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12000adb00 con 0x7f1200150bf0 2023-12-20T04:46:16.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.213+0000 7f1205139640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12000c55e0 0x7f12000cd5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:16.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.213+0000 7f1205139640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12000c55e0 0x7f12000cd5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34594/0 (socket says 172.21.15.132:34594) 2023-12-20T04:46:16.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.213+0000 7f1205139640 1 -- 172.21.15.132:0/4165479444 learned_addr learned my addr 172.21.15.132:0/4165479444 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:16.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.214+0000 7f1204938640 1 --2- 172.21.15.132:0/4165479444 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1200150bf0 0x7f12000c9c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:16.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.214+0000 7f11fffff640 1 --2- 172.21.15.132:0/4165479444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12000c8a40 0x7f12000c50a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:16.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.214+0000 7f1205139640 1 -- 172.21.15.132:0/4165479444 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1200150bf0 msgr2=0x7f12000c9c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:16.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.214+0000 7f1205139640 1 --2- 172.21.15.132:0/4165479444 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1200150bf0 0x7f12000c9c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:16.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.214+0000 7f1205139640 1 -- 172.21.15.132:0/4165479444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12000c8a40 msgr2=0x7f12000c50a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:16.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.214+0000 7f1205139640 1 --2- 172.21.15.132:0/4165479444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12000c8a40 0x7f12000c50a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:16.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.214+0000 7f1205139640 1 -- 172.21.15.132:0/4165479444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12000ca580 con 0x7f12000c55e0 2023-12-20T04:46:16.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.214+0000 7f1205139640 1 --2- 172.21.15.132:0/4165479444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12000c55e0 0x7f12000cd5a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f11f800a860 tx=0x7f11f8001f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:16.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.214+0000 7f11fd7fa640 1 -- 172.21.15.132:0/4165479444 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8034630 con 0x7f12000c55e0 2023-12-20T04:46:16.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.214+0000 7f11fd7fa640 1 -- 172.21.15.132:0/4165479444 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f11f8034790 con 0x7f12000c55e0 2023-12-20T04:46:16.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.214+0000 7f1206b9c640 1 -- 172.21.15.132:0/4165479444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12000ca860 con 0x7f12000c55e0 2023-12-20T04:46:16.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.214+0000 7f11fd7fa640 1 -- 172.21.15.132:0/4165479444 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f11f8034b00 con 0x7f12000c55e0 2023-12-20T04:46:16.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.214+0000 7f1206b9c640 1 -- 172.21.15.132:0/4165479444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12000ca1c0 con 0x7f12000c55e0 2023-12-20T04:46:16.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.215+0000 7f1206b9c640 1 -- 172.21.15.132:0/4165479444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12000adf90 con 0x7f12000c55e0 2023-12-20T04:46:16.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.216+0000 7f11fd7fa640 1 -- 172.21.15.132:0/4165479444 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f11f8031030 con 0x7f12000c55e0 2023-12-20T04:46:16.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.216+0000 7f11fd7fa640 1 --2- 172.21.15.132:0/4165479444 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f11e406a460 0x7f11e406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:16.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.216+0000 7f11fd7fa640 1 -- 172.21.15.132:0/4165479444 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f11f80aa1e0 con 0x7f12000c55e0 2023-12-20T04:46:16.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.216+0000 7f1204938640 1 --2- 172.21.15.132:0/4165479444 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f11e406a460 0x7f11e406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:16.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.217+0000 7f1204938640 1 --2- 172.21.15.132:0/4165479444 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f11e406a460 0x7f11e406c920 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009ba0 tx=0x7f11f4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:16.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.220+0000 7f11fd7fa640 1 -- 172.21.15.132:0/4165479444 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f12000adf90 con 0x7f12000c55e0 2023-12-20T04:46:16.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:16.448+0000 7f1206b9c640 1 -- 172.21.15.132:0/4165479444 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f12000b2f90 con 0x7f12000c55e0 2023-12-20T04:46:17.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.098+0000 7f11fd7fa640 1 -- 172.21.15.132:0/4165479444 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v196) v1 ==== 136+0+0 (secure 0 0 0) 0x7f12000b2f90 con 0x7f12000c55e0 2023-12-20T04:46:17.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.101+0000 7f1206b9c640 1 -- 172.21.15.132:0/4165479444 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f11e406a460 msgr2=0x7f11e406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:17.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.101+0000 7f1206b9c640 1 --2- 172.21.15.132:0/4165479444 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f11e406a460 0x7f11e406c920 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f11f4009ba0 tx=0x7f11f4008040 comp rx=0 tx=0).stop 2023-12-20T04:46:17.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.101+0000 7f1206b9c640 1 -- 172.21.15.132:0/4165479444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12000c55e0 msgr2=0x7f12000cd5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:17.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.101+0000 7f1206b9c640 1 --2- 172.21.15.132:0/4165479444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12000c55e0 0x7f12000cd5a0 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7f11f800a860 tx=0x7f11f8001f10 comp rx=0 tx=0).stop 2023-12-20T04:46:17.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.101+0000 7f1206b9c640 1 -- 172.21.15.132:0/4165479444 shutdown_connections 2023-12-20T04:46:17.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.101+0000 7f1206b9c640 1 --2- 172.21.15.132:0/4165479444 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f11e406a460 0x7f11e406c920 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.101+0000 7f1206b9c640 1 --2- 172.21.15.132:0/4165479444 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12000c55e0 0x7f12000cd5a0 unknown :-1 s=CLOSED pgs=839 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.101+0000 7f1206b9c640 1 --2- 172.21.15.132:0/4165479444 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12000c8a40 0x7f12000c50a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.101+0000 7f1206b9c640 1 --2- 172.21.15.132:0/4165479444 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1200150bf0 0x7f12000c9c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.101+0000 7f1206b9c640 1 -- 172.21.15.132:0/4165479444 >> 172.21.15.132:0/4165479444 conn(0x7f120006d7c0 msgr2=0x7f120015afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:17.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.101+0000 7f1206b9c640 1 -- 172.21.15.132:0/4165479444 shutdown_connections 2023-12-20T04:46:17.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.101+0000 7f1206b9c640 1 -- 172.21.15.132:0/4165479444 wait complete. 2023-12-20T04:46:17.115 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-20T04:46:17.230 INFO:teuthology.orchestra.run.smithi132.stdout:{"osd_objectstore":"memstore"} 2023-12-20T04:46:17.230 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-20T04:46:17.230 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-20T04:46:17.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.331+0000 7fd8cbcfb640 1 Processor -- start 2023-12-20T04:46:17.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.331+0000 7fd8cbcfb640 1 -- start start 2023-12-20T04:46:17.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.332+0000 7fd8cbcfb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd8c415d300 0x7fd8c40d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.332+0000 7fd8cbcfb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40d1550 0x7fd8c40cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.332+0000 7fd8cbcfb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c40d1a90 con 0x7fd8c40cfdc0 2023-12-20T04:46:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.332+0000 7fd8cbcfb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c40d0230 con 0x7fd8c415d300 2023-12-20T04:46:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.332+0000 7fd8cbcfb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c40d1d70 con 0x7fd8c40d1550 2023-12-20T04:46:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.332+0000 7fd8c9a97640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd8c415d300 0x7fd8c40d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.332+0000 7fd8c9a97640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd8c415d300 0x7fd8c40d1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34608/0 (socket says 172.21.15.132:34608) 2023-12-20T04:46:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.332+0000 7fd8c9a97640 1 -- 172.21.15.132:0/3353043200 learned_addr learned my addr 172.21.15.132:0/3353043200 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.332+0000 7fd8c9296640 1 --2- 172.21.15.132:0/3353043200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40d1550 0x7fd8c40cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.333+0000 7fd8c9a97640 1 -- 172.21.15.132:0/3353043200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40d1550 msgr2=0x7fd8c40cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.333+0000 7fd8c9a97640 1 --2- 172.21.15.132:0/3353043200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40d1550 0x7fd8c40cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.333+0000 7fd8c9a97640 1 -- 172.21.15.132:0/3353043200 >> v1:172.21.15.187:6789/0 conn(0x7fd8c40cfdc0 legacy=0x7fd8c40b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:17.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.333+0000 7fd8c9a97640 1 -- 172.21.15.132:0/3353043200 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c40d2050 con 0x7fd8c415d300 2023-12-20T04:46:17.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.333+0000 7fd8c9a97640 1 --2- 172.21.15.132:0/3353043200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415d300 0x7fd8c40d1010 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009e50 tx=0x7fd8c002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ec7907b44a0c07d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:17.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.333+0000 7fd8c8a95640 1 -- 172.21.15.132:0/3353043200 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c002ca70 con 0x7fd8c415d300 2023-12-20T04:46:17.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.334+0000 7fd8c8a95640 1 -- 172.21.15.132:0/3353043200 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8c002cbd0 con 0x7fd8c415d300 2023-12-20T04:46:17.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.334+0000 7fd8c8a95640 1 -- 172.21.15.132:0/3353043200 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8c00343f0 con 0x7fd8c415d300 2023-12-20T04:46:17.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.334+0000 7fd8cbcfb640 1 -- 172.21.15.132:0/3353043200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415d300 msgr2=0x7fd8c40d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:17.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.334+0000 7fd8cbcfb640 1 --2- 172.21.15.132:0/3353043200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415d300 0x7fd8c40d1010 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0009e50 tx=0x7fd8c002bed0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.334+0000 7fd8cbcfb640 1 -- 172.21.15.132:0/3353043200 shutdown_connections 2023-12-20T04:46:17.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.334+0000 7fd8cbcfb640 1 --2- 172.21.15.132:0/3353043200 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40d1550 0x7fd8c40cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.334+0000 7fd8cbcfb640 1 --2- 172.21.15.132:0/3353043200 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415d300 0x7fd8c40d1010 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.334+0000 7fd8cbcfb640 1 -- 172.21.15.132:0/3353043200 >> 172.21.15.132:0/3353043200 conn(0x7fd8c406a3d0 msgr2=0x7fd8c406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:17.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.334+0000 7fd8cbcfb640 1 -- 172.21.15.132:0/3353043200 shutdown_connections 2023-12-20T04:46:17.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.334+0000 7fd8cbcfb640 1 -- 172.21.15.132:0/3353043200 wait complete. 2023-12-20T04:46:17.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.335+0000 7fd8cbcfb640 1 Processor -- start 2023-12-20T04:46:17.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.335+0000 7fd8cbcfb640 1 -- start start 2023-12-20T04:46:17.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.336+0000 7fd8cbcfb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40cfdc0 0x7fd8c40b51e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:17.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.336+0000 7fd8cbcfb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8c40d1550 0x7fd8c4151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:17.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.336+0000 7fd8cbcfb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415d300 0x7fd8c41522b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:17.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.336+0000 7fd8cbcfb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c41f3570 con 0x7fd8c415d300 2023-12-20T04:46:17.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.336+0000 7fd8cbcfb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c41f2960 con 0x7fd8c40d1550 2023-12-20T04:46:17.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.336+0000 7fd8cbcfb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c41f2c40 con 0x7fd8c40cfdc0 2023-12-20T04:46:17.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.336+0000 7fd8ca298640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415d300 0x7fd8c41522b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:17.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.336+0000 7fd8ca298640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415d300 0x7fd8c41522b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34614/0 (socket says 172.21.15.132:34614) 2023-12-20T04:46:17.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.336+0000 7fd8ca298640 1 -- 172.21.15.132:0/417584113 learned_addr learned my addr 172.21.15.132:0/417584113 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:17.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.336+0000 7fd8c9a97640 1 --2- 172.21.15.132:0/417584113 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40cfdc0 0x7fd8c40b51e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:17.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.336+0000 7fd8c9296640 1 --2- 172.21.15.132:0/417584113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8c40d1550 0x7fd8c4151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:17.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.336+0000 7fd8ca298640 1 -- 172.21.15.132:0/417584113 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40cfdc0 msgr2=0x7fd8c40b51e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:17.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.336+0000 7fd8ca298640 1 --2- 172.21.15.132:0/417584113 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40cfdc0 0x7fd8c40b51e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.336+0000 7fd8ca298640 1 -- 172.21.15.132:0/417584113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8c40d1550 msgr2=0x7fd8c4151d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:17.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.336+0000 7fd8ca298640 1 --2- 172.21.15.132:0/417584113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8c40d1550 0x7fd8c4151d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.336+0000 7fd8ca298640 1 -- 172.21.15.132:0/417584113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c0009b30 con 0x7fd8c415d300 2023-12-20T04:46:17.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.336+0000 7fd8ca298640 1 --2- 172.21.15.132:0/417584113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415d300 0x7fd8c41522b0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00c410 tx=0x7fd8bc00c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:17.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.337+0000 7fd8ba7fc640 1 -- 172.21.15.132:0/417584113 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc011790 con 0x7fd8c415d300 2023-12-20T04:46:17.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.337+0000 7fd8ba7fc640 1 -- 172.21.15.132:0/417584113 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc0118f0 con 0x7fd8c415d300 2023-12-20T04:46:17.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.337+0000 7fd8ba7fc640 1 -- 172.21.15.132:0/417584113 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc011ca0 con 0x7fd8c415d300 2023-12-20T04:46:17.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.337+0000 7fd8cbcfb640 1 -- 172.21.15.132:0/417584113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c41f2f20 con 0x7fd8c415d300 2023-12-20T04:46:17.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.337+0000 7fd8cbcfb640 1 -- 172.21.15.132:0/417584113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c41f25c0 con 0x7fd8c415d300 2023-12-20T04:46:17.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.338+0000 7fd8cbcfb640 1 -- 172.21.15.132:0/417584113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c404e840 con 0x7fd8c415d300 2023-12-20T04:46:17.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.338+0000 7fd8ba7fc640 1 -- 172.21.15.132:0/417584113 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd8bc005080 con 0x7fd8c415d300 2023-12-20T04:46:17.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.338+0000 7fd8ba7fc640 1 --2- 172.21.15.132:0/417584113 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8a806a460 0x7fd8a806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:17.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.338+0000 7fd8ba7fc640 1 -- 172.21.15.132:0/417584113 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd8bc087e10 con 0x7fd8c415d300 2023-12-20T04:46:17.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.338+0000 7fd8c9a97640 1 --2- 172.21.15.132:0/417584113 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8a806a460 0x7fd8a806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:17.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.339+0000 7fd8c9a97640 1 --2- 172.21.15.132:0/417584113 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8a806a460 0x7fd8a806c920 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0035000 tx=0x7fd8c0030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:17.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.343+0000 7fd8ba7fc640 1 -- 172.21.15.132:0/417584113 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd8bc053840 con 0x7fd8c415d300 2023-12-20T04:46:17.432 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:46:17.434 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:46:17.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.514+0000 7fd8cbcfb640 1 -- 172.21.15.132:0/417584113 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fd8c40ccf70 con 0x7fd8c415d300 2023-12-20T04:46:17.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.518+0000 7fd8ba7fc640 1 -- 172.21.15.132:0/417584113 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v8)=0 v8) v1 ==== 122+0+0 (secure 0 0 0) 0x7fd8bc056e60 con 0x7fd8c415d300 2023-12-20T04:46:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.519+0000 7fd8cbcfb640 1 -- 172.21.15.132:0/417584113 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8a806a460 msgr2=0x7fd8a806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.519+0000 7fd8cbcfb640 1 --2- 172.21.15.132:0/417584113 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8a806a460 0x7fd8a806c920 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7fd8c0035000 tx=0x7fd8c0030000 comp rx=0 tx=0).stop 2023-12-20T04:46:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.519+0000 7fd8cbcfb640 1 -- 172.21.15.132:0/417584113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415d300 msgr2=0x7fd8c41522b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.519+0000 7fd8cbcfb640 1 --2- 172.21.15.132:0/417584113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415d300 0x7fd8c41522b0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00c410 tx=0x7fd8bc00c8d0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.520+0000 7fd8cbcfb640 1 -- 172.21.15.132:0/417584113 shutdown_connections 2023-12-20T04:46:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.520+0000 7fd8cbcfb640 1 --2- 172.21.15.132:0/417584113 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8a806a460 0x7fd8a806c920 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.520+0000 7fd8cbcfb640 1 --2- 172.21.15.132:0/417584113 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415d300 0x7fd8c41522b0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.520+0000 7fd8cbcfb640 1 --2- 172.21.15.132:0/417584113 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8c40d1550 0x7fd8c4151d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.520+0000 7fd8cbcfb640 1 --2- 172.21.15.132:0/417584113 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40cfdc0 0x7fd8c40b51e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.520+0000 7fd8cbcfb640 1 -- 172.21.15.132:0/417584113 >> 172.21.15.132:0/417584113 conn(0x7fd8c406a3d0 msgr2=0x7fd8c415c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.520+0000 7fd8cbcfb640 1 -- 172.21.15.132:0/417584113 shutdown_connections 2023-12-20T04:46:17.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.520+0000 7fd8cbcfb640 1 -- 172.21.15.132:0/417584113 wait complete. 2023-12-20T04:46:17.532 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:46:17.532 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:46:17.619 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:46:17.675 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:46:17.675 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:46:17.675 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:46:17.690 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:46:17.691 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:46:17.691 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:46:17.707 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:46:17.708 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:46:17.708 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:46:17.745 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:46:17.746 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:46:17.746 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:46:17.764 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:46:17.764 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-20T04:46:17.764 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:46:17.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.883+0000 7f0653d51640 1 Processor -- start 2023-12-20T04:46:17.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.884+0000 7f0653d51640 1 -- start start 2023-12-20T04:46:17.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.884+0000 7f0653d51640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c160450 0x7f064c160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:17.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.884+0000 7f0653d51640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f064c0b5090 0x7f064c0d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:17.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.884+0000 7f0653d51640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f064c0b5ec0 con 0x7f064c1611b0 2023-12-20T04:46:17.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.884+0000 7f0653d51640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064c1617e0 con 0x7f064c0b5090 2023-12-20T04:46:17.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.884+0000 7f0653d51640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0d0fc0 con 0x7f064c160450 2023-12-20T04:46:17.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f06512ec640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f064c1611b0 0x7f064c0b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43610/0 (socket says 172.21.15.132:43610) 2023-12-20T04:46:17.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f06512ec640 1 -- 172.21.15.132:0/1357482625 learned_addr learned my addr 172.21.15.132:0/1357482625 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:17.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0650aeb640 1 -- 172.21.15.132:0/1357482625 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2094715583 0 0) 0x7f064c0b5ec0 con 0x7f064c1611b0 2023-12-20T04:46:17.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f06522ee640 1 --2- 172.21.15.132:0/1357482625 >> v2:172.21.15.187:3300/0 conn(0x7f064c0b5090 0x7f064c0d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:17.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0650aeb640 1 -- 172.21.15.132:0/1357482625 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0638003520 con 0x7f064c1611b0 2023-12-20T04:46:17.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0651aed640 1 --2- 172.21.15.132:0/1357482625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c160450 0x7f064c160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:17.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0650aeb640 1 -- 172.21.15.132:0/1357482625 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2746049857 0 0) 0x7f0638003520 con 0x7f064c1611b0 2023-12-20T04:46:17.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0650aeb640 1 -- 172.21.15.132:0/1357482625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c160450 msgr2=0x7f064c160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:17.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0650aeb640 1 --2- 172.21.15.132:0/1357482625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c160450 0x7f064c160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0650aeb640 1 -- 172.21.15.132:0/1357482625 >> v2:172.21.15.187:3300/0 conn(0x7f064c0b5090 msgr2=0x7f064c0d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:17.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0650aeb640 1 --2- 172.21.15.132:0/1357482625 >> v2:172.21.15.187:3300/0 conn(0x7f064c0b5090 0x7f064c0d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0650aeb640 1 -- 172.21.15.132:0/1357482625 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c0d12a0 con 0x7f064c1611b0 2023-12-20T04:46:17.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0650aeb640 1 -- 172.21.15.132:0/1357482625 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f063c001670 con 0x7f064c1611b0 2023-12-20T04:46:17.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0650aeb640 1 -- 172.21.15.132:0/1357482625 >> v1:172.21.15.132:6789/0 conn(0x7f064c1611b0 legacy=0x7f064c0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:17.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0650aeb640 1 --2- 172.21.15.132:0/1357482625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0638003970 0x7f0638003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:17.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0650aeb640 1 --2- 172.21.15.132:0/1357482625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c160450 0x7f06380047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:17.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0650aeb640 1 --2- 172.21.15.132:0/1357482625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0638004d00 0x7f0638005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:17.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0650aeb640 1 -- 172.21.15.132:0/1357482625 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c1617e0 con 0x7f0638004d00 2023-12-20T04:46:17.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0650aeb640 1 -- 172.21.15.132:0/1357482625 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0d0fc0 con 0x7f0638003970 2023-12-20T04:46:17.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0650aeb640 1 -- 172.21.15.132:0/1357482625 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f063800ba40 con 0x7f064c160450 2023-12-20T04:46:17.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f06522ee640 1 --2- 172.21.15.132:0/1357482625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0638004d00 0x7f0638005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:17.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f0651aed640 1 --2- 172.21.15.132:0/1357482625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0638003970 0x7f0638003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:17.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.885+0000 7f06512ec640 1 --2- 172.21.15.132:0/1357482625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c160450 0x7f06380047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:17.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.886+0000 7f06522ee640 1 -- 172.21.15.132:0/1357482625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c160450 msgr2=0x7f06380047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:17.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.886+0000 7f06522ee640 1 --2- 172.21.15.132:0/1357482625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c160450 0x7f06380047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.886+0000 7f06522ee640 1 -- 172.21.15.132:0/1357482625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0638003970 msgr2=0x7f0638003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:17.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.886+0000 7f06522ee640 1 --2- 172.21.15.132:0/1357482625 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0638003970 0x7f0638003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.886+0000 7f06522ee640 1 -- 172.21.15.132:0/1357482625 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0638003520 con 0x7f0638004d00 2023-12-20T04:46:17.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.886+0000 7f06522ee640 1 --2- 172.21.15.132:0/1357482625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0638004d00 0x7f0638005180 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0644009f90 tx=0x7f06380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4ee50fb8057448 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:17.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.886+0000 7f0650aeb640 1 -- 172.21.15.132:0/1357482625 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f064402cc20 con 0x7f0638004d00 2023-12-20T04:46:17.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.886+0000 7f0650aeb640 1 -- 172.21.15.132:0/1357482625 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f064400f040 con 0x7f0638004d00 2023-12-20T04:46:17.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.886+0000 7f0650aeb640 1 -- 172.21.15.132:0/1357482625 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644034440 con 0x7f0638004d00 2023-12-20T04:46:17.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.887+0000 7f0653d51640 1 -- 172.21.15.132:0/1357482625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0638004d00 msgr2=0x7f0638005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:17.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.887+0000 7f0653d51640 1 --2- 172.21.15.132:0/1357482625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0638004d00 0x7f0638005180 secure :-1 s=READY pgs=843 cs=0 l=1 rev1=1 crypto rx=0x7f0644009f90 tx=0x7f06380057f0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.887+0000 7f06522ee640 1 -- 172.21.15.132:0/1357482625 reap_dead start 2023-12-20T04:46:17.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.887+0000 7f0653d51640 1 -- 172.21.15.132:0/1357482625 shutdown_connections 2023-12-20T04:46:17.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.887+0000 7f0653d51640 1 -- 172.21.15.132:0/1357482625 >> 172.21.15.132:0/1357482625 conn(0x7f064c0cf980 msgr2=0x7f064c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:17.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.887+0000 7f0653d51640 1 -- 172.21.15.132:0/1357482625 shutdown_connections 2023-12-20T04:46:17.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.887+0000 7f0653d51640 1 -- 172.21.15.132:0/1357482625 wait complete. 2023-12-20T04:46:17.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.888+0000 7f0653d51640 1 Processor -- start 2023-12-20T04:46:17.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.888+0000 7f0653d51640 1 -- start start 2023-12-20T04:46:17.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f0653d51640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f064c1506f0 0x7f064c0aa2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:17.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f0653d51640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c0aaac0 0x7f064c0cd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:17.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f0653d51640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064c150ad0 0x7f064c0cda70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:17.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f0653d51640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0ad700 con 0x7f064c150ad0 2023-12-20T04:46:17.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f0653d51640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0aaf50 con 0x7f064c1506f0 2023-12-20T04:46:17.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f0653d51640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f064c0ab230 con 0x7f064c0aaac0 2023-12-20T04:46:17.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f06522ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064c150ad0 0x7f064c0cda70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:17.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f06522ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064c150ad0 0x7f064c0cda70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37054/0 (socket says 172.21.15.132:37054) 2023-12-20T04:46:17.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f06522ee640 1 -- 172.21.15.132:0/3658565968 learned_addr learned my addr 172.21.15.132:0/3658565968 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:17.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f0651aed640 1 --2- 172.21.15.132:0/3658565968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f064c1506f0 0x7f064c0aa2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:17.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f06512ec640 1 --2- 172.21.15.132:0/3658565968 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c0aaac0 0x7f064c0cd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:17.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f06522ee640 1 -- 172.21.15.132:0/3658565968 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c0aaac0 msgr2=0x7f064c0cd530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:17.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f06522ee640 1 --2- 172.21.15.132:0/3658565968 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c0aaac0 0x7f064c0cd530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f06522ee640 1 -- 172.21.15.132:0/3658565968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f064c1506f0 msgr2=0x7f064c0aa2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:17.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f06522ee640 1 --2- 172.21.15.132:0/3658565968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f064c1506f0 0x7f064c0aa2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:17.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f06522ee640 1 -- 172.21.15.132:0/3658565968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f064c0ab510 con 0x7f064c150ad0 2023-12-20T04:46:17.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f0651aed640 1 --2- 172.21.15.132:0/3658565968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f064c1506f0 0x7f064c0aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:17.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.889+0000 7f06522ee640 1 --2- 172.21.15.132:0/3658565968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064c150ad0 0x7f064c0cda70 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f0644037040 tx=0x7f0644009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:17.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.890+0000 7f06427fc640 1 -- 172.21.15.132:0/3658565968 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644034d50 con 0x7f064c150ad0 2023-12-20T04:46:17.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.890+0000 7f06427fc640 1 -- 172.21.15.132:0/3658565968 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0644003990 con 0x7f064c150ad0 2023-12-20T04:46:17.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.890+0000 7f0653d51640 1 -- 172.21.15.132:0/3658565968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f064c0ab7f0 con 0x7f064c150ad0 2023-12-20T04:46:17.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.890+0000 7f06427fc640 1 -- 172.21.15.132:0/3658565968 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0644003d20 con 0x7f064c150ad0 2023-12-20T04:46:17.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.890+0000 7f0653d51640 1 -- 172.21.15.132:0/3658565968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f064c14de20 con 0x7f064c150ad0 2023-12-20T04:46:17.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.891+0000 7f0653d51640 1 -- 172.21.15.132:0/3658565968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f064c0abd10 con 0x7f064c150ad0 2023-12-20T04:46:17.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.891+0000 7f06427fc640 1 -- 172.21.15.132:0/3658565968 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0644004030 con 0x7f064c150ad0 2023-12-20T04:46:17.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.891+0000 7f06427fc640 1 --2- 172.21.15.132:0/3658565968 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f063006a430 0x7f063006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:17.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.891+0000 7f0651aed640 1 --2- 172.21.15.132:0/3658565968 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f063006a430 0x7f063006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:17.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.891+0000 7f06427fc640 1 -- 172.21.15.132:0/3658565968 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(73..73 src has 1..73) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f06440a9c50 con 0x7f064c150ad0 2023-12-20T04:46:17.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.892+0000 7f0651aed640 1 --2- 172.21.15.132:0/3658565968 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f063006a430 0x7f063006c8f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0648006fd0 tx=0x7f0648008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:17.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:17.896+0000 7f06427fc640 1 -- 172.21.15.132:0/3658565968 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f064c0abd10 con 0x7f064c150ad0 2023-12-20T04:46:18.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.096+0000 7f0653d51640 1 -- 172.21.15.132:0/3658565968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f064c0abd10 con 0x7f064c150ad0 2023-12-20T04:46:18.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.096+0000 7f06427fc640 1 -- 172.21.15.132:0/3658565968 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 28 v28) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f064c0abd10 con 0x7f064c150ad0 2023-12-20T04:46:18.098 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:18.098 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":28,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5249,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/3967216203","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6836","nonce":3967216203},{"type":"v1","addr":"172.21.15.132:6837","nonce":3967216203}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5255,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2592935145","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2592935145},{"type":"v1","addr":"172.21.15.187:6833","nonce":2592935145}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":5800,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/3580510007","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":3580510007},{"type":"v1","addr":"172.21.15.187:6835","nonce":3580510007}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":28},{"gid":6171,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6835/2061740954","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2061740954},{"type":"v1","addr":"172.21.15.132:6835","nonce":2061740954}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[]} 2023-12-20T04:46:18.099 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 28 2023-12-20T04:46:18.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.098+0000 7f0653d51640 1 -- 172.21.15.132:0/3658565968 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f063006a430 msgr2=0x7f063006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:18.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.098+0000 7f0653d51640 1 --2- 172.21.15.132:0/3658565968 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f063006a430 0x7f063006c8f0 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f0648006fd0 tx=0x7f0648008040 comp rx=0 tx=0).stop 2023-12-20T04:46:18.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.098+0000 7f0653d51640 1 -- 172.21.15.132:0/3658565968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064c150ad0 msgr2=0x7f064c0cda70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:18.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.098+0000 7f0653d51640 1 --2- 172.21.15.132:0/3658565968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064c150ad0 0x7f064c0cda70 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7f0644037040 tx=0x7f0644009750 comp rx=0 tx=0).stop 2023-12-20T04:46:18.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.098+0000 7f0653d51640 1 -- 172.21.15.132:0/3658565968 shutdown_connections 2023-12-20T04:46:18.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.098+0000 7f0653d51640 1 --2- 172.21.15.132:0/3658565968 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f063006a430 0x7f063006c8f0 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:18.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.098+0000 7f0653d51640 1 --2- 172.21.15.132:0/3658565968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064c150ad0 0x7f064c0cda70 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:18.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.098+0000 7f0653d51640 1 --2- 172.21.15.132:0/3658565968 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064c0aaac0 0x7f064c0cd530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:18.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.098+0000 7f0653d51640 1 --2- 172.21.15.132:0/3658565968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f064c1506f0 0x7f064c0aa2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:18.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.098+0000 7f0653d51640 1 -- 172.21.15.132:0/3658565968 >> 172.21.15.132:0/3658565968 conn(0x7f064c0cf980 msgr2=0x7f064c0d30c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:18.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.098+0000 7f0653d51640 1 -- 172.21.15.132:0/3658565968 shutdown_connections 2023-12-20T04:46:18.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.098+0000 7f0653d51640 1 -- 172.21.15.132:0/3658565968 wait complete. 2023-12-20T04:46:18.111 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-20T04:46:18.112 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-20T04:46:18.112 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-20T04:46:18.112 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:46:18.112 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-20T04:46:18.112 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-20T04:46:18.112 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-20T04:46:18.112 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:46:18.113 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-20T04:46:18.113 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-20T04:46:18.113 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-20T04:46:18.113 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:46:18.113 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-20T04:46:18.113 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-20T04:46:18.113 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-20T04:46:18.113 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:46:18.121 INFO:tasks.ceph.mds.a:Stopped 2023-12-20T04:46:18.121 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-20T04:46:18.122 INFO:tasks.ceph.mds.c:Stopped 2023-12-20T04:46:18.122 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-20T04:46:18.125 INFO:tasks.ceph.mds.d:Stopped 2023-12-20T04:46:18.125 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-20T04:46:18.126 INFO:tasks.ceph.mds.b:Stopped 2023-12-20T04:46:18.126 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-20T04:46:18.164 INFO:tasks.ceph.mds.a:Started 2023-12-20T04:46:18.164 DEBUG:teuthology.parallel:result is None 2023-12-20T04:46:18.165 INFO:tasks.ceph.mds.c:Started 2023-12-20T04:46:18.165 DEBUG:teuthology.parallel:result is None 2023-12-20T04:46:18.168 INFO:tasks.ceph.mds.d:Started 2023-12-20T04:46:18.168 DEBUG:teuthology.parallel:result is None 2023-12-20T04:46:18.169 INFO:tasks.ceph.mds.b:Started 2023-12-20T04:46:18.169 DEBUG:teuthology.parallel:result is None 2023-12-20T04:46:18.169 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-20T04:46:18.240 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-12-20T04:46:18.240 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-12-20T04:46:18.251 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-12-20T04:46:18.254 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-12-20T04:46:18.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.278+0000 7f89b6c4a640 1 Processor -- start 2023-12-20T04:46:18.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.278+0000 7f89b6c4a640 1 -- start start 2023-12-20T04:46:18.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.279+0000 7f89b6c4a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f89b00cf960 0x7f89b006c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:18.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.279+0000 7f89b6c4a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f89b00cbc80 0x7f89b00cd730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:18.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.279+0000 7f89b6c4a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89b0071f30 con 0x7f89b015abe0 2023-12-20T04:46:18.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.279+0000 7f89b6c4a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b00cdc70 con 0x7f89b00cf960 2023-12-20T04:46:18.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.279+0000 7f89b6c4a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f89b0072c60 con 0x7f89b00cbc80 2023-12-20T04:46:18.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.279+0000 7f89a7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f89b00cf960 0x7f89b006c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:18.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.279+0000 7f89b49e6640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f89b015abe0 0x7f89b00cf250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43614/0 (socket says 172.21.15.132:43614) 2023-12-20T04:46:18.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.279+0000 7f89b49e6640 1 -- 172.21.15.132:0/1072614123 learned_addr learned my addr 172.21.15.132:0/1072614123 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:18.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.279+0000 7f89b51e7640 1 --2- 172.21.15.132:0/1072614123 >> v2:172.21.15.187:3300/0 conn(0x7f89b00cbc80 0x7f89b00cd730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:18.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.279+0000 7f89a7fff640 1 -- 172.21.15.132:0/1072614123 >> v2:172.21.15.187:3300/0 conn(0x7f89b00cbc80 msgr2=0x7f89b00cd730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:18.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.279+0000 7f89a7fff640 1 --2- 172.21.15.132:0/1072614123 >> v2:172.21.15.187:3300/0 conn(0x7f89b00cbc80 0x7f89b00cd730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:18.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.279+0000 7f89a7fff640 1 -- 172.21.15.132:0/1072614123 >> v1:172.21.15.132:6789/0 conn(0x7f89b015abe0 legacy=0x7f89b00cf250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:18.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.279+0000 7f89a77fe640 1 -- 172.21.15.132:0/1072614123 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2272418723 0 0) 0x7f89b0071f30 con 0x7f89b015abe0 2023-12-20T04:46:18.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.279+0000 7f89a7fff640 1 -- 172.21.15.132:0/1072614123 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89b0072f40 con 0x7f89b00cf960 2023-12-20T04:46:18.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.280+0000 7f89a7fff640 1 --2- 172.21.15.132:0/1072614123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89b00cf960 0x7f89b006c650 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f89b00717d0 tx=0x7f89a002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d24abc0f07d97188 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:18.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.285+0000 7f89a77fe640 1 -- 172.21.15.132:0/1072614123 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a002e070 con 0x7f89b00cf960 2023-12-20T04:46:18.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.285+0000 7f89a77fe640 1 -- 172.21.15.132:0/1072614123 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89a00315a0 con 0x7f89b00cf960 2023-12-20T04:46:18.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.285+0000 7f89a77fe640 1 -- 172.21.15.132:0/1072614123 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89a0031930 con 0x7f89b00cf960 2023-12-20T04:46:18.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.286+0000 7f89b6c4a640 1 -- 172.21.15.132:0/1072614123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89b00cf960 msgr2=0x7f89b006c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:18.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.286+0000 7f89b6c4a640 1 --2- 172.21.15.132:0/1072614123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89b00cf960 0x7f89b006c650 secure :-1 s=READY pgs=853 cs=0 l=1 rev1=1 crypto rx=0x7f89b00717d0 tx=0x7f89a002b840 comp rx=0 tx=0).stop 2023-12-20T04:46:18.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.286+0000 7f89b6c4a640 1 -- 172.21.15.132:0/1072614123 shutdown_connections 2023-12-20T04:46:18.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.286+0000 7f89b6c4a640 1 --2- 172.21.15.132:0/1072614123 >> v2:172.21.15.187:3300/0 conn(0x7f89b00cbc80 0x7f89b00cd730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:18.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.286+0000 7f89b6c4a640 1 --2- 172.21.15.132:0/1072614123 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89b00cf960 0x7f89b006c650 unknown :-1 s=CLOSED pgs=853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:18.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.286+0000 7f89b6c4a640 1 -- 172.21.15.132:0/1072614123 >> 172.21.15.132:0/1072614123 conn(0x7f89b0069c30 msgr2=0x7f89b006a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:18.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.286+0000 7f89b6c4a640 1 -- 172.21.15.132:0/1072614123 shutdown_connections 2023-12-20T04:46:18.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.286+0000 7f89b6c4a640 1 -- 172.21.15.132:0/1072614123 wait complete. 2023-12-20T04:46:18.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.287+0000 7f89b6c4a640 1 Processor -- start 2023-12-20T04:46:18.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.287+0000 7f89b6c4a640 1 -- start start 2023-12-20T04:46:18.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.288+0000 7f89b6c4a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89b00cbc80 0x7f89b0150bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.288+0000 7f89b6c4a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89b00cf960 0x7f89b0158aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.288+0000 7f89b6c4a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89b015abe0 0x7f89b00ae2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.288+0000 7f89b6c4a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b0151110 con 0x7f89b00cbc80 2023-12-20T04:46:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.288+0000 7f89b6c4a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b0157a00 con 0x7f89b00cf960 2023-12-20T04:46:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.288+0000 7f89b6c4a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89b0157ce0 con 0x7f89b015abe0 2023-12-20T04:46:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.289+0000 7f89b49e6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89b00cbc80 0x7f89b0150bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.289+0000 7f89b49e6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89b00cbc80 0x7f89b0150bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37122/0 (socket says 172.21.15.132:37122) 2023-12-20T04:46:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.289+0000 7f89b49e6640 1 -- 172.21.15.132:0/1575269532 learned_addr learned my addr 172.21.15.132:0/1575269532 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.289+0000 7f89a7fff640 1 --2- 172.21.15.132:0/1575269532 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89b00cf960 0x7f89b0158aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.289+0000 7f89b51e7640 1 --2- 172.21.15.132:0/1575269532 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89b015abe0 0x7f89b00ae2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.289+0000 7f89b49e6640 1 -- 172.21.15.132:0/1575269532 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89b015abe0 msgr2=0x7f89b00ae2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.289+0000 7f89b49e6640 1 --2- 172.21.15.132:0/1575269532 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89b015abe0 0x7f89b00ae2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.289+0000 7f89b49e6640 1 -- 172.21.15.132:0/1575269532 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89b00cf960 msgr2=0x7f89b0158aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:18.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.289+0000 7f89b49e6640 1 --2- 172.21.15.132:0/1575269532 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89b00cf960 0x7f89b0158aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:18.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.289+0000 7f89b49e6640 1 -- 172.21.15.132:0/1575269532 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a0009400 con 0x7f89b00cbc80 2023-12-20T04:46:18.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.289+0000 7f89b49e6640 1 --2- 172.21.15.132:0/1575269532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89b00cbc80 0x7f89b0150bd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00c4d0 tx=0x7f89ac00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:18.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.290+0000 7f89a57fa640 1 -- 172.21.15.132:0/1575269532 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac0074e0 con 0x7f89b00cbc80 2023-12-20T04:46:18.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.290+0000 7f89a57fa640 1 -- 172.21.15.132:0/1575269532 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89ac007660 con 0x7f89b00cbc80 2023-12-20T04:46:18.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.290+0000 7f89a57fa640 1 -- 172.21.15.132:0/1575269532 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89ac004a20 con 0x7f89b00cbc80 2023-12-20T04:46:18.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.290+0000 7f89b6c4a640 1 -- 172.21.15.132:0/1575269532 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b0157fc0 con 0x7f89b00cbc80 2023-12-20T04:46:18.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.290+0000 7f89b6c4a640 1 -- 172.21.15.132:0/1575269532 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b0158580 con 0x7f89b00cbc80 2023-12-20T04:46:18.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.291+0000 7f89b6c4a640 1 -- 172.21.15.132:0/1575269532 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b004e840 con 0x7f89b00cbc80 2023-12-20T04:46:18.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.291+0000 7f89a57fa640 1 -- 172.21.15.132:0/1575269532 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f89ac004b80 con 0x7f89b00cbc80 2023-12-20T04:46:18.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.291+0000 7f89a57fa640 1 --2- 172.21.15.132:0/1575269532 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f899c06a430 0x7f899c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:18.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.291+0000 7f89a57fa640 1 -- 172.21.15.132:0/1575269532 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(77..77 src has 1..77) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f89ac087710 con 0x7f89b00cbc80 2023-12-20T04:46:18.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.291+0000 7f89a7fff640 1 --2- 172.21.15.132:0/1575269532 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f899c06a430 0x7f899c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:18.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.292+0000 7f89a7fff640 1 --2- 172.21.15.132:0/1575269532 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f899c06a430 0x7f899c06c8f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f89a0036000 tx=0x7f89a003e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:18.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.296+0000 7f89a57fa640 1 -- 172.21.15.132:0/1575269532 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f89ac0530b0 con 0x7f89b00cbc80 2023-12-20T04:46:18.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:18.471+0000 7f89b6c4a640 1 -- 172.21.15.132:0/1575269532 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f89b00cf030 con 0x7f89b00cbc80 2023-12-20T04:46:19.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.292+0000 7f89a57fa640 1 -- 172.21.15.132:0/1575269532 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v78) v1 ==== 97+0+0 (secure 0 0 0) 0x7f89ac018080 con 0x7f89b00cbc80 2023-12-20T04:46:19.294 INFO:teuthology.orchestra.run.smithi132.stderr: removed all blocklist entries 2023-12-20T04:46:19.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.294+0000 7f89b6c4a640 1 -- 172.21.15.132:0/1575269532 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f899c06a430 msgr2=0x7f899c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:19.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.294+0000 7f89b6c4a640 1 --2- 172.21.15.132:0/1575269532 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f899c06a430 0x7f899c06c8f0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f89a0036000 tx=0x7f89a003e040 comp rx=0 tx=0).stop 2023-12-20T04:46:19.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.294+0000 7f89b6c4a640 1 -- 172.21.15.132:0/1575269532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89b00cbc80 msgr2=0x7f89b0150bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:19.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.294+0000 7f89b6c4a640 1 --2- 172.21.15.132:0/1575269532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89b00cbc80 0x7f89b0150bd0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f89ac00c4d0 tx=0x7f89ac00c990 comp rx=0 tx=0).stop 2023-12-20T04:46:19.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.294+0000 7f89b6c4a640 1 -- 172.21.15.132:0/1575269532 shutdown_connections 2023-12-20T04:46:19.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.294+0000 7f89b6c4a640 1 --2- 172.21.15.132:0/1575269532 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f899c06a430 0x7f899c06c8f0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.294+0000 7f89b6c4a640 1 --2- 172.21.15.132:0/1575269532 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89b015abe0 0x7f89b00ae2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.294+0000 7f89b6c4a640 1 --2- 172.21.15.132:0/1575269532 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89b00cf960 0x7f89b0158aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.294+0000 7f89b6c4a640 1 --2- 172.21.15.132:0/1575269532 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89b00cbc80 0x7f89b0150bd0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.294+0000 7f89b6c4a640 1 -- 172.21.15.132:0/1575269532 >> 172.21.15.132:0/1575269532 conn(0x7f89b0069c30 msgr2=0x7f89b0152fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:19.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.295+0000 7f89b6c4a640 1 -- 172.21.15.132:0/1575269532 shutdown_connections 2023-12-20T04:46:19.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.295+0000 7f89b6c4a640 1 -- 172.21.15.132:0/1575269532 wait complete. 2023-12-20T04:46:19.310 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-20T04:46:19.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.414+0000 7f258a069640 1 Processor -- start 2023-12-20T04:46:19.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.414+0000 7f258a069640 1 -- start start 2023-12-20T04:46:19.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.415+0000 7f258a069640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f25840b4980 0x7f25840b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:19.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.415+0000 7f258a069640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25840b5320 con 0x7f25840d1aa0 2023-12-20T04:46:19.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.415+0000 7f258a069640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f25840b5ec0 con 0x7f2584160450 2023-12-20T04:46:19.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.415+0000 7f258a069640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f25841617e0 con 0x7f25840b4980 2023-12-20T04:46:19.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.415+0000 7f2582ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f25840b4980 0x7f25840b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:19.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.415+0000 7f2583fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f25840d1aa0 0x7f25840d1ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43622/0 (socket says 172.21.15.132:43622) 2023-12-20T04:46:19.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.415+0000 7f2583fff640 1 -- 172.21.15.132:0/2643840144 learned_addr learned my addr 172.21.15.132:0/2643840144 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:19.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.415+0000 7f2582ffd640 1 -- 172.21.15.132:0/2643840144 >> v1:172.21.15.187:6789/0 conn(0x7f2584160450 legacy=0x7f2584160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:19.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.415+0000 7f2582ffd640 1 -- 172.21.15.132:0/2643840144 >> v1:172.21.15.132:6789/0 conn(0x7f25840d1aa0 legacy=0x7f25840d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:19.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.415+0000 7f25827fc640 1 -- 172.21.15.132:0/2643840144 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 81440565 0 0) 0x7f25840b5320 con 0x7f25840d1aa0 2023-12-20T04:46:19.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.415+0000 7f2582ffd640 1 -- 172.21.15.132:0/2643840144 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f25840d0fc0 con 0x7f25840b4980 2023-12-20T04:46:19.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.416+0000 7f2582ffd640 1 --2- 172.21.15.132:0/2643840144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25840b4980 0x7f25840b4de0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f25780097a0 tx=0x7f257802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd6d65f07cccfca3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:19.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.416+0000 7f25827fc640 1 -- 172.21.15.132:0/2643840144 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2578030610 con 0x7f25840b4980 2023-12-20T04:46:19.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.416+0000 7f25827fc640 1 -- 172.21.15.132:0/2643840144 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2578030770 con 0x7f25840b4980 2023-12-20T04:46:19.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.416+0000 7f25827fc640 1 -- 172.21.15.132:0/2643840144 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2578030b00 con 0x7f25840b4980 2023-12-20T04:46:19.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.417+0000 7f258a069640 1 -- 172.21.15.132:0/2643840144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25840b4980 msgr2=0x7f25840b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:19.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.417+0000 7f258a069640 1 --2- 172.21.15.132:0/2643840144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25840b4980 0x7f25840b4de0 secure :-1 s=READY pgs=856 cs=0 l=1 rev1=1 crypto rx=0x7f25780097a0 tx=0x7f257802b960 comp rx=0 tx=0).stop 2023-12-20T04:46:19.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.417+0000 7f258a069640 1 -- 172.21.15.132:0/2643840144 shutdown_connections 2023-12-20T04:46:19.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.417+0000 7f258a069640 1 --2- 172.21.15.132:0/2643840144 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25840b4980 0x7f25840b4de0 unknown :-1 s=CLOSED pgs=856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.417+0000 7f258a069640 1 -- 172.21.15.132:0/2643840144 >> 172.21.15.132:0/2643840144 conn(0x7f25840cf980 msgr2=0x7f25840cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:19.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.417+0000 7f258a069640 1 -- 172.21.15.132:0/2643840144 shutdown_connections 2023-12-20T04:46:19.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.417+0000 7f258a069640 1 -- 172.21.15.132:0/2643840144 wait complete. 2023-12-20T04:46:19.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.418+0000 7f258a069640 1 Processor -- start 2023-12-20T04:46:19.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.418+0000 7f258a069640 1 -- start start 2023-12-20T04:46:19.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f258a069640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f25840b4980 0x7f25841520d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:19.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f258a069640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25840d1aa0 0x7f2584158d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:19.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f258a069640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2584160450 0x7f25840cb1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:19.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f258a069640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2584157ca0 con 0x7f25840d1aa0 2023-12-20T04:46:19.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f258a069640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2584157f80 con 0x7f2584160450 2023-12-20T04:46:19.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f258a069640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2584158260 con 0x7f25840b4980 2023-12-20T04:46:19.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f2582ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25840d1aa0 0x7f2584158d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:19.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f2582ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25840d1aa0 0x7f2584158d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37126/0 (socket says 172.21.15.132:37126) 2023-12-20T04:46:19.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f2582ffd640 1 -- 172.21.15.132:0/2037749378 learned_addr learned my addr 172.21.15.132:0/2037749378 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:19.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f2583fff640 1 --2- 172.21.15.132:0/2037749378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2584160450 0x7f25840cb1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:19.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f25837fe640 1 --2- 172.21.15.132:0/2037749378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f25840b4980 0x7f25841520d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:19.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f2582ffd640 1 -- 172.21.15.132:0/2037749378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f25840b4980 msgr2=0x7f25841520d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:19.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f2582ffd640 1 --2- 172.21.15.132:0/2037749378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f25840b4980 0x7f25841520d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f2582ffd640 1 -- 172.21.15.132:0/2037749378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2584160450 msgr2=0x7f25840cb1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:19.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f2582ffd640 1 --2- 172.21.15.132:0/2037749378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2584160450 0x7f25840cb1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f2582ffd640 1 -- 172.21.15.132:0/2037749378 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2578009400 con 0x7f25840d1aa0 2023-12-20T04:46:19.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f2582ffd640 1 --2- 172.21.15.132:0/2037749378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25840d1aa0 0x7f2584158d40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f25780098c0 tx=0x7f2578004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:19.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f256bfff640 1 -- 172.21.15.132:0/2037749378 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f257803e040 con 0x7f25840d1aa0 2023-12-20T04:46:19.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f256bfff640 1 -- 172.21.15.132:0/2037749378 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2578039c90 con 0x7f25840d1aa0 2023-12-20T04:46:19.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f258a069640 1 -- 172.21.15.132:0/2037749378 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2584158540 con 0x7f25840d1aa0 2023-12-20T04:46:19.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.419+0000 7f256bfff640 1 -- 172.21.15.132:0/2037749378 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f25780443f0 con 0x7f25840d1aa0 2023-12-20T04:46:19.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.420+0000 7f258a069640 1 -- 172.21.15.132:0/2037749378 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2584152610 con 0x7f25840d1aa0 2023-12-20T04:46:19.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.420+0000 7f258a069640 1 -- 172.21.15.132:0/2037749378 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f25840d0890 con 0x7f25840d1aa0 2023-12-20T04:46:19.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.421+0000 7f256bfff640 1 -- 172.21.15.132:0/2037749378 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f257804d3b0 con 0x7f25840d1aa0 2023-12-20T04:46:19.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.421+0000 7f256bfff640 1 --2- 172.21.15.132:0/2037749378 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f257006a430 0x7f257006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:19.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.421+0000 7f25837fe640 1 --2- 172.21.15.132:0/2037749378 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f257006a430 0x7f257006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:19.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.421+0000 7f256bfff640 1 -- 172.21.15.132:0/2037749378 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f25780aaba0 con 0x7f25840d1aa0 2023-12-20T04:46:19.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.422+0000 7f25837fe640 1 --2- 172.21.15.132:0/2037749378 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f257006a430 0x7f257006c8f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2574006fd0 tx=0x7f2574008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:19.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.426+0000 7f256bfff640 1 -- 172.21.15.132:0/2037749378 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2578076570 con 0x7f25840d1aa0 2023-12-20T04:46:19.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.653+0000 7f258a069640 1 -- 172.21.15.132:0/2037749378 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f258404e840 con 0x7f25840d1aa0 2023-12-20T04:46:19.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.653+0000 7f256bfff640 1 -- 172.21.15.132:0/2037749378 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v15) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f2578079b90 con 0x7f25840d1aa0 2023-12-20T04:46:19.655 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:19.655 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:46:19.656 INFO:teuthology.orchestra.run.smithi132.stdout: "auth_dump": [ 2023-12-20T04:46:19.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.656 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.a", 2023-12-20T04:46:19.656 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlbTdZOxAAUDz0Eno9DYvrYM1xg5jG/A==", 2023-12-20T04:46:19.656 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.656 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:46:19.656 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:46:19.656 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:46:19.656 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:46:19.656 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.656 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.b", 2023-12-20T04:46:19.656 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl43gVDBAA1qJwUU+Ii4BalGf3NtJnGA==", 2023-12-20T04:46:19.657 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.657 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:46:19.657 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:46:19.657 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:46:19.657 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:46:19.657 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.657 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.c", 2023-12-20T04:46:19.657 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlaSUVBxAA7HN3dSo9xfvkjvc6bwMxWg==", 2023-12-20T04:46:19.657 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.657 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:46:19.657 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:46:19.657 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:46:19.657 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:46:19.658 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.658 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.d", 2023-12-20T04:46:19.658 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl1DR4ExAANNOyGlf1Ayre/xZEb9JHYg==", 2023-12-20T04:46:19.658 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.658 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:46:19.658 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:46:19.658 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:46:19.658 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:46:19.658 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.658 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.0", 2023-12-20T04:46:19.658 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCucIJlwZfxORAAiT2g1poLu3OkmoyxNJQc8Q==", 2023-12-20T04:46:19.659 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.659 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:46:19.659 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:46:19.659 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:46:19.659 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.659 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.1", 2023-12-20T04:46:19.659 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlejHYBRAAKurKpW5gyOAQ+E4Su4xMSQ==", 2023-12-20T04:46:19.659 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.659 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:46:19.659 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:46:19.659 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:46:19.659 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.660 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.660 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.2", 2023-12-20T04:46:19.660 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlyfz8DBAA9a6tUjHF8IRIKeldwVFMcw==", 2023-12-20T04:46:19.660 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.660 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:46:19.660 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:46:19.660 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:46:19.660 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.660 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.660 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.660 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.3", 2023-12-20T04:46:19.660 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJllFEeFBAA6URrqUjQqHsrI5+qEBVs3g==", 2023-12-20T04:46:19.660 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.661 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:46:19.661 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:46:19.661 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:46:19.661 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.661 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.662 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.4", 2023-12-20T04:46:19.662 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlvGqcJhAAgn2wuSTwLT+TOHoE4iaVSg==", 2023-12-20T04:46:19.662 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.662 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:46:19.662 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:46:19.662 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:46:19.662 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.662 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.5", 2023-12-20T04:46:19.662 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlWrkTLhAA2KlpxTFPaiXLCvmURpg5rw==", 2023-12-20T04:46:19.662 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.662 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:46:19.662 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:46:19.662 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:46:19.663 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.663 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.6", 2023-12-20T04:46:19.663 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlnOQfNRAA//EVx0BZYQd7ovK2tFhgfA==", 2023-12-20T04:46:19.663 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.663 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:46:19.663 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:46:19.663 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:46:19.663 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.663 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.7", 2023-12-20T04:46:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCzcIJl4nfDABAAtBdl2qkzKcqhmzsukC7G5w==", 2023-12-20T04:46:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:46:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:46:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:46:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.0", 2023-12-20T04:46:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlm/nGFxAA6zndayizc50Il7l74BxkgQ==", 2023-12-20T04:46:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:46:19.664 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow r", 2023-12-20T04:46:19.665 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-20T04:46:19.665 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.665 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.1", 2023-12-20T04:46:19.665 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlppb6IBAArqCoSlSE5coxkj4+XjPoWg==", 2023-12-20T04:46:19.665 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.665 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:46:19.665 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:46:19.665 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:46:19.665 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:46:19.665 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.666 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.666 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.666 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.2", 2023-12-20T04:46:19.666 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlMgWUHRAAqSdmRGx+9J+3dO7ntaApdw==", 2023-12-20T04:46:19.666 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.666 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:46:19.666 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:46:19.666 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:46:19.666 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:46:19.666 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.666 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.666 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.666 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.3", 2023-12-20T04:46:19.666 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlcIe3JhAAjv9KfknxwySJURWdePN7vw==", 2023-12-20T04:46:19.667 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.667 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:46:19.667 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:46:19.667 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:46:19.667 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:46:19.667 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.667 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.admin", 2023-12-20T04:46:19.667 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJljrTdHhAAsAlaFaKctSv71GrifKs6zA==", 2023-12-20T04:46:19.667 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.667 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:46:19.667 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:46:19.668 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:46:19.668 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:46:19.668 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.668 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.x", 2023-12-20T04:46:19.668 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJl+KnxNxAAM/b3mubTMYlB9QUbfcPW8g==", 2023-12-20T04:46:19.668 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.668 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:46:19.668 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:46:19.668 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:46:19.668 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:19.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:19.669 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.y", 2023-12-20T04:46:19.669 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlMyAMNBAAWpoBNevgGIkZ7zKEdKn3Ag==", 2023-12-20T04:46:19.669 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:46:19.669 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:46:19.669 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:46:19.669 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:46:19.669 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.669 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:19.669 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:46:19.669 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:46:19.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.655+0000 7f258a069640 1 -- 172.21.15.132:0/2037749378 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f257006a430 msgr2=0x7f257006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:19.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.655+0000 7f258a069640 1 --2- 172.21.15.132:0/2037749378 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f257006a430 0x7f257006c8f0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f2574006fd0 tx=0x7f2574008040 comp rx=0 tx=0).stop 2023-12-20T04:46:19.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.655+0000 7f258a069640 1 -- 172.21.15.132:0/2037749378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25840d1aa0 msgr2=0x7f2584158d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:19.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.655+0000 7f258a069640 1 --2- 172.21.15.132:0/2037749378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25840d1aa0 0x7f2584158d40 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f25780098c0 tx=0x7f2578004730 comp rx=0 tx=0).stop 2023-12-20T04:46:19.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.655+0000 7f258a069640 1 -- 172.21.15.132:0/2037749378 shutdown_connections 2023-12-20T04:46:19.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.655+0000 7f258a069640 1 --2- 172.21.15.132:0/2037749378 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f257006a430 0x7f257006c8f0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.655+0000 7f258a069640 1 --2- 172.21.15.132:0/2037749378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2584160450 0x7f25840cb1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.655+0000 7f258a069640 1 --2- 172.21.15.132:0/2037749378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f25840d1aa0 0x7f2584158d40 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.655+0000 7f258a069640 1 --2- 172.21.15.132:0/2037749378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f25840b4980 0x7f25841520d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.655+0000 7f258a069640 1 -- 172.21.15.132:0/2037749378 >> 172.21.15.132:0/2037749378 conn(0x7f25840cf980 msgr2=0x7f258406a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:19.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.655+0000 7f258a069640 1 -- 172.21.15.132:0/2037749378 shutdown_connections 2023-12-20T04:46:19.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.655+0000 7f258a069640 1 -- 172.21.15.132:0/2037749378 wait complete. 2023-12-20T04:46:19.673 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:46:19.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.771+0000 7f91eb25c640 1 Processor -- start 2023-12-20T04:46:19.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.771+0000 7f91eb25c640 1 -- start start 2023-12-20T04:46:19.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.771+0000 7f91eb25c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f91e415d640 0x7f91e40d13c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.771+0000 7f91eb25c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91e40d0020 0x7f91e40b6320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.771+0000 7f91eb25c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f91e40d2a90 con 0x7f91e40d1900 2023-12-20T04:46:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.771+0000 7f91eb25c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f91e40d1e80 con 0x7f91e415d640 2023-12-20T04:46:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.771+0000 7f91eb25c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e40d2160 con 0x7f91e40d0020 2023-12-20T04:46:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.772+0000 7f91e97f9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91e40d0020 0x7f91e40b6320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.772+0000 7f91e8ff8640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f91e415d640 0x7f91e40d13c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.772+0000 7f91e97f9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91e40d0020 0x7f91e40b6320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:55962/0 (socket says 172.21.15.132:55962) 2023-12-20T04:46:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.772+0000 7f91e97f9640 1 -- 172.21.15.132:0/464757819 learned_addr learned my addr 172.21.15.132:0/464757819 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.772+0000 7f91e3fff640 1 --1- 172.21.15.132:0/464757819 >> v1:172.21.15.187:6789/0 conn(0x7f91e40d1900 0x7f91e40cf910 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:45812/0 (socket says 172.21.15.132:45812) 2023-12-20T04:46:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.772+0000 7f91e97f9640 1 -- 172.21.15.132:0/464757819 >> v2:172.21.15.187:3300/0 conn(0x7f91e415d640 msgr2=0x7f91e40d13c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.772+0000 7f91e97f9640 1 --2- 172.21.15.132:0/464757819 >> v2:172.21.15.187:3300/0 conn(0x7f91e415d640 0x7f91e40d13c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.772+0000 7f91e97f9640 1 -- 172.21.15.132:0/464757819 >> v1:172.21.15.187:6789/0 conn(0x7f91e40d1900 legacy=0x7f91e40cf910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.772+0000 7f91e97f9640 1 -- 172.21.15.132:0/464757819 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91e40d2440 con 0x7f91e40d0020 2023-12-20T04:46:19.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.772+0000 7f91e8ff8640 1 --2- 172.21.15.132:0/464757819 >> v2:172.21.15.187:3300/0 conn(0x7f91e415d640 0x7f91e40d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:46:19.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.773+0000 7f91e97f9640 1 --2- 172.21.15.132:0/464757819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91e40d0020 0x7f91e40b6320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009870 tx=0x7f91d402b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e524b1ec83ab310b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:19.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.773+0000 7f91e37fe640 1 -- 172.21.15.132:0/464757819 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4030840 con 0x7f91e40d0020 2023-12-20T04:46:19.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.773+0000 7f91e37fe640 1 -- 172.21.15.132:0/464757819 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91d40309a0 con 0x7f91e40d0020 2023-12-20T04:46:19.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.773+0000 7f91e37fe640 1 -- 172.21.15.132:0/464757819 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91d4030d30 con 0x7f91e40d0020 2023-12-20T04:46:19.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.774+0000 7f91eb25c640 1 -- 172.21.15.132:0/464757819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91e40d0020 msgr2=0x7f91e40b6320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:19.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.774+0000 7f91eb25c640 1 --2- 172.21.15.132:0/464757819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91e40d0020 0x7f91e40b6320 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f91d4009870 tx=0x7f91d402b980 comp rx=0 tx=0).stop 2023-12-20T04:46:19.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.774+0000 7f91eb25c640 1 -- 172.21.15.132:0/464757819 shutdown_connections 2023-12-20T04:46:19.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.774+0000 7f91eb25c640 1 --2- 172.21.15.132:0/464757819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91e40d0020 0x7f91e40b6320 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.774+0000 7f91eb25c640 1 --2- 172.21.15.132:0/464757819 >> v2:172.21.15.187:3300/0 conn(0x7f91e415d640 0x7f91e40d13c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.774+0000 7f91eb25c640 1 -- 172.21.15.132:0/464757819 >> 172.21.15.132:0/464757819 conn(0x7f91e406be70 msgr2=0x7f91e406c250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:19.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.774+0000 7f91eb25c640 1 -- 172.21.15.132:0/464757819 shutdown_connections 2023-12-20T04:46:19.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.774+0000 7f91eb25c640 1 -- 172.21.15.132:0/464757819 wait complete. 2023-12-20T04:46:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.775+0000 7f91eb25c640 1 Processor -- start 2023-12-20T04:46:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.775+0000 7f91eb25c640 1 -- start start 2023-12-20T04:46:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91eb25c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91e40d0020 0x7f91e40c8e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91eb25c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91e40d1900 0x7f91e415f790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91eb25c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91e415d640 0x7f91e41f59f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91eb25c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e4154ce0 con 0x7f91e40d1900 2023-12-20T04:46:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91eb25c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91e41546f0 con 0x7f91e40d0020 2023-12-20T04:46:19.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91eb25c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f91e4160120 con 0x7f91e415d640 2023-12-20T04:46:19.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91e3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91e40d1900 0x7f91e415f790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:19.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91e3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91e40d1900 0x7f91e415f790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37136/0 (socket says 172.21.15.132:37136) 2023-12-20T04:46:19.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91e3fff640 1 -- 172.21.15.132:0/3747974750 learned_addr learned my addr 172.21.15.132:0/3747974750 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:19.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91e97f9640 1 --2- 172.21.15.132:0/3747974750 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91e415d640 0x7f91e41f59f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:19.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91e8ff8640 1 --2- 172.21.15.132:0/3747974750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91e40d0020 0x7f91e40c8e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:19.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91e3fff640 1 -- 172.21.15.132:0/3747974750 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91e415d640 msgr2=0x7f91e41f59f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:19.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91e3fff640 1 --2- 172.21.15.132:0/3747974750 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91e415d640 0x7f91e41f59f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91e3fff640 1 -- 172.21.15.132:0/3747974750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91e40d0020 msgr2=0x7f91e40c8e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:19.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91e3fff640 1 --2- 172.21.15.132:0/3747974750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91e40d0020 0x7f91e40c8e20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91e3fff640 1 -- 172.21.15.132:0/3747974750 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91dc009a70 con 0x7f91e40d1900 2023-12-20T04:46:19.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91e3fff640 1 --2- 172.21.15.132:0/3747974750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91e40d1900 0x7f91e415f790 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00c3c0 tx=0x7f91cc00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:19.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91e17fa640 1 -- 172.21.15.132:0/3747974750 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc0074e0 con 0x7f91e40d1900 2023-12-20T04:46:19.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91e17fa640 1 -- 172.21.15.132:0/3747974750 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f91cc007640 con 0x7f91e40d1900 2023-12-20T04:46:19.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.776+0000 7f91eb25c640 1 -- 172.21.15.132:0/3747974750 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91d40094d0 con 0x7f91e40d1900 2023-12-20T04:46:19.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.777+0000 7f91e17fa640 1 -- 172.21.15.132:0/3747974750 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f91cc004a00 con 0x7f91e40d1900 2023-12-20T04:46:19.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.777+0000 7f91eb25c640 1 -- 172.21.15.132:0/3747974750 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91e4160650 con 0x7f91e40d1900 2023-12-20T04:46:19.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.777+0000 7f91eb25c640 1 -- 172.21.15.132:0/3747974750 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f91e4154e20 con 0x7f91e40d1900 2023-12-20T04:46:19.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.778+0000 7f91e17fa640 1 -- 172.21.15.132:0/3747974750 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f91cc004b60 con 0x7f91e40d1900 2023-12-20T04:46:19.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.778+0000 7f91e17fa640 1 --2- 172.21.15.132:0/3747974750 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f91c406a460 0x7f91c406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:19.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.778+0000 7f91e17fa640 1 -- 172.21.15.132:0/3747974750 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f91cc087dd0 con 0x7f91e40d1900 2023-12-20T04:46:19.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.778+0000 7f91e8ff8640 1 --2- 172.21.15.132:0/3747974750 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f91c406a460 0x7f91c406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:19.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.779+0000 7f91e8ff8640 1 --2- 172.21.15.132:0/3747974750 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f91c406a460 0x7f91c406c920 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009fd0 tx=0x7f91dc00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:19.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.783+0000 7f91e17fa640 1 -- 172.21.15.132:0/3747974750 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f91e4154e20 con 0x7f91e40d1900 2023-12-20T04:46:19.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.951+0000 7f91eb25c640 1 -- 172.21.15.132:0/3747974750 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f91e4154e20 con 0x7f91e40d1900 2023-12-20T04:46:19.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.952+0000 7f91e17fa640 1 -- 172.21.15.132:0/3747974750 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v78) v1 ==== 74+0+12437 (secure 0 0 0) 0x7f91e4154e20 con 0x7f91e40d1900 2023-12-20T04:46:19.954 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:19.954 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":78,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:46:19.289524+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":9,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":63,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:46:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.954+0000 7f91eb25c640 1 -- 172.21.15.132:0/3747974750 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f91c406a460 msgr2=0x7f91c406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.954+0000 7f91eb25c640 1 --2- 172.21.15.132:0/3747974750 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f91c406a460 0x7f91c406c920 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f91dc009fd0 tx=0x7f91dc00b040 comp rx=0 tx=0).stop 2023-12-20T04:46:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.954+0000 7f91eb25c640 1 -- 172.21.15.132:0/3747974750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91e40d1900 msgr2=0x7f91e415f790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.954+0000 7f91eb25c640 1 --2- 172.21.15.132:0/3747974750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91e40d1900 0x7f91e415f790 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f91cc00c3c0 tx=0x7f91cc00c880 comp rx=0 tx=0).stop 2023-12-20T04:46:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.954+0000 7f91eb25c640 1 -- 172.21.15.132:0/3747974750 shutdown_connections 2023-12-20T04:46:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.954+0000 7f91eb25c640 1 --2- 172.21.15.132:0/3747974750 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f91c406a460 0x7f91c406c920 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.954+0000 7f91eb25c640 1 --2- 172.21.15.132:0/3747974750 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f91e415d640 0x7f91e41f59f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.954+0000 7f91eb25c640 1 --2- 172.21.15.132:0/3747974750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f91e40d1900 0x7f91e415f790 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.954+0000 7f91eb25c640 1 --2- 172.21.15.132:0/3747974750 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f91e40d0020 0x7f91e40c8e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:19.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.954+0000 7f91eb25c640 1 -- 172.21.15.132:0/3747974750 >> 172.21.15.132:0/3747974750 conn(0x7f91e406be70 msgr2=0x7f91e415c4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:19.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.954+0000 7f91eb25c640 1 -- 172.21.15.132:0/3747974750 shutdown_connections 2023-12-20T04:46:19.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:19.954+0000 7f91eb25c640 1 -- 172.21.15.132:0/3747974750 wait complete. 2023-12-20T04:46:19.967 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '72', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:46:19.967 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:46:20.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.068+0000 7f73c5541640 1 Processor -- start 2023-12-20T04:46:20.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.068+0000 7f73c5541640 1 -- start start 2023-12-20T04:46:20.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.069+0000 7f73c5541640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f73c00cb2b0 0x7f73c00cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.069+0000 7f73c5541640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c00ce000 con 0x7f73c015aee0 2023-12-20T04:46:20.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.069+0000 7f73c5541640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f73c00d0130 con 0x7f73c00cdbb0 2023-12-20T04:46:20.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.069+0000 7f73c5541640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f73c015f370 con 0x7f73c00cb2b0 2023-12-20T04:46:20.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.069+0000 7f73beffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f73c015aee0 0x7f73c015eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43636/0 (socket says 172.21.15.132:43636) 2023-12-20T04:46:20.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.069+0000 7f73beffd640 1 -- 172.21.15.132:0/3475172909 learned_addr learned my addr 172.21.15.132:0/3475172909 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:20.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.069+0000 7f73be7fc640 1 --2- 172.21.15.132:0/3475172909 >> v2:172.21.15.187:3300/0 conn(0x7f73c00cb2b0 0x7f73c00cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.069+0000 7f73bdffb640 1 -- 172.21.15.132:0/3475172909 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4214376394 0 0) 0x7f73b0001490 con 0x7f73c015aee0 2023-12-20T04:46:20.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.069+0000 7f73bdffb640 1 -- 172.21.15.132:0/3475172909 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f73a8003520 con 0x7f73c015aee0 2023-12-20T04:46:20.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.070+0000 7f73be7fc640 1 -- 172.21.15.132:0/3475172909 >> v1:172.21.15.187:6789/0 conn(0x7f73c00cdbb0 legacy=0x7f73c00d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:20.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.070+0000 7f73bdffb640 1 -- 172.21.15.132:0/3475172909 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1982124916 0 0) 0x7f73a8003520 con 0x7f73c015aee0 2023-12-20T04:46:20.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.070+0000 7f73be7fc640 1 -- 172.21.15.132:0/3475172909 >> v1:172.21.15.132:6789/0 conn(0x7f73c015aee0 legacy=0x7f73c015eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:20.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.070+0000 7f73be7fc640 1 -- 172.21.15.132:0/3475172909 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73c015f650 con 0x7f73c00cb2b0 2023-12-20T04:46:20.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.070+0000 7f73be7fc640 1 --2- 172.21.15.132:0/3475172909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73c00cb2b0 0x7f73c00cd670 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f73b40097d0 tx=0x7f73b402b820 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e08d330329ef0056 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:20.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.071+0000 7f73bdffb640 1 -- 172.21.15.132:0/3475172909 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b402f050 con 0x7f73c00cb2b0 2023-12-20T04:46:20.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.071+0000 7f73bdffb640 1 -- 172.21.15.132:0/3475172909 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b4031500 con 0x7f73c00cb2b0 2023-12-20T04:46:20.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.071+0000 7f73bdffb640 1 -- 172.21.15.132:0/3475172909 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b0001b80 con 0x7f73c00cb2b0 2023-12-20T04:46:20.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.071+0000 7f73c5541640 1 -- 172.21.15.132:0/3475172909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73c00cb2b0 msgr2=0x7f73c00cd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:20.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.071+0000 7f73c5541640 1 --2- 172.21.15.132:0/3475172909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73c00cb2b0 0x7f73c00cd670 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7f73b40097d0 tx=0x7f73b402b820 comp rx=0 tx=0).stop 2023-12-20T04:46:20.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.071+0000 7f73c5541640 1 -- 172.21.15.132:0/3475172909 shutdown_connections 2023-12-20T04:46:20.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.071+0000 7f73c5541640 1 --2- 172.21.15.132:0/3475172909 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73c00cb2b0 0x7f73c00cd670 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.071+0000 7f73c5541640 1 -- 172.21.15.132:0/3475172909 >> 172.21.15.132:0/3475172909 conn(0x7f73c0072c60 msgr2=0x7f73c0073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:20.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.071+0000 7f73c5541640 1 -- 172.21.15.132:0/3475172909 shutdown_connections 2023-12-20T04:46:20.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.071+0000 7f73c5541640 1 -- 172.21.15.132:0/3475172909 wait complete. 2023-12-20T04:46:20.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.072+0000 7f73c5541640 1 Processor -- start 2023-12-20T04:46:20.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.072+0000 7f73c5541640 1 -- start start 2023-12-20T04:46:20.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.073+0000 7f73c5541640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73c00cb2b0 0x7f73c01f0d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.073+0000 7f73c5541640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73c00cdbb0 0x7f73c01f3b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.073+0000 7f73c5541640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73c015aee0 0x7f73c00a8700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.073+0000 7f73c5541640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c00a9c10 con 0x7f73c00cdbb0 2023-12-20T04:46:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.073+0000 7f73c5541640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73c01f4060 con 0x7f73c015aee0 2023-12-20T04:46:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.073+0000 7f73c5541640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f73c00a9000 con 0x7f73c00cb2b0 2023-12-20T04:46:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.073+0000 7f73be7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73c00cdbb0 0x7f73c01f3b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.073+0000 7f73be7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73c00cdbb0 0x7f73c01f3b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37140/0 (socket says 172.21.15.132:37140) 2023-12-20T04:46:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.073+0000 7f73be7fc640 1 -- 172.21.15.132:0/3000253994 learned_addr learned my addr 172.21.15.132:0/3000253994 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.073+0000 7f73be7fc640 1 -- 172.21.15.132:0/3000253994 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73c00cb2b0 msgr2=0x7f73c01f0d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.073+0000 7f73be7fc640 1 --2- 172.21.15.132:0/3000253994 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73c00cb2b0 0x7f73c01f0d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.073+0000 7f73be7fc640 1 -- 172.21.15.132:0/3000253994 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73c015aee0 msgr2=0x7f73c00a8700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.073+0000 7f73be7fc640 1 --2- 172.21.15.132:0/3000253994 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73c015aee0 0x7f73c00a8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.074+0000 7f73be7fc640 1 -- 172.21.15.132:0/3000253994 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73b4009400 con 0x7f73c00cdbb0 2023-12-20T04:46:20.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.074+0000 7f73be7fc640 1 --2- 172.21.15.132:0/3000253994 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73c00cdbb0 0x7f73c01f3b20 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f73b4000c00 tx=0x7f73b40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:20.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.074+0000 7f73a77fe640 1 -- 172.21.15.132:0/3000253994 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b4033980 con 0x7f73c00cdbb0 2023-12-20T04:46:20.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.074+0000 7f73a77fe640 1 -- 172.21.15.132:0/3000253994 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f73b4033b00 con 0x7f73c00cdbb0 2023-12-20T04:46:20.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.074+0000 7f73c5541640 1 -- 172.21.15.132:0/3000253994 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73c00a92e0 con 0x7f73c00cdbb0 2023-12-20T04:46:20.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.074+0000 7f73a77fe640 1 -- 172.21.15.132:0/3000253994 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f73b403d410 con 0x7f73c00cdbb0 2023-12-20T04:46:20.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.074+0000 7f73c5541640 1 -- 172.21.15.132:0/3000253994 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73c00a98a0 con 0x7f73c00cdbb0 2023-12-20T04:46:20.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.075+0000 7f73c5541640 1 -- 172.21.15.132:0/3000253994 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73c004e840 con 0x7f73c00cdbb0 2023-12-20T04:46:20.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.075+0000 7f73a77fe640 1 -- 172.21.15.132:0/3000253994 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f73b403a050 con 0x7f73c00cdbb0 2023-12-20T04:46:20.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.075+0000 7f73a77fe640 1 --2- 172.21.15.132:0/3000253994 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73ac06a430 0x7f73ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.076+0000 7f73a77fe640 1 -- 172.21.15.132:0/3000253994 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f73b40aa210 con 0x7f73c00cdbb0 2023-12-20T04:46:20.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.076+0000 7f73beffd640 1 --2- 172.21.15.132:0/3000253994 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73ac06a430 0x7f73ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.076+0000 7f73beffd640 1 --2- 172.21.15.132:0/3000253994 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73ac06a430 0x7f73ac06c8f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f73b0002230 tx=0x7f73b0002140 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:20.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.080+0000 7f73a77fe640 1 -- 172.21.15.132:0/3000253994 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f73b4075ac0 con 0x7f73c00cdbb0 2023-12-20T04:46:20.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.246+0000 7f73c5541640 1 -- 172.21.15.132:0/3000253994 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f73c00cd2c0 con 0x7f73c00cdbb0 2023-12-20T04:46:20.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.246+0000 7f73a77fe640 1 -- 172.21.15.132:0/3000253994 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v78) v1 ==== 93+0+10 (secure 0 0 0) 0x7f73b4038020 con 0x7f73c00cdbb0 2023-12-20T04:46:20.248 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:46:20.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.248+0000 7f73c5541640 1 -- 172.21.15.132:0/3000253994 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73ac06a430 msgr2=0x7f73ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:20.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.248+0000 7f73c5541640 1 --2- 172.21.15.132:0/3000253994 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73ac06a430 0x7f73ac06c8f0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f73b0002230 tx=0x7f73b0002140 comp rx=0 tx=0).stop 2023-12-20T04:46:20.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.248+0000 7f73c5541640 1 -- 172.21.15.132:0/3000253994 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73c00cdbb0 msgr2=0x7f73c01f3b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:20.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.248+0000 7f73c5541640 1 --2- 172.21.15.132:0/3000253994 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73c00cdbb0 0x7f73c01f3b20 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7f73b4000c00 tx=0x7f73b40046c0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.248+0000 7f73c5541640 1 -- 172.21.15.132:0/3000253994 shutdown_connections 2023-12-20T04:46:20.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.248+0000 7f73c5541640 1 --2- 172.21.15.132:0/3000253994 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f73ac06a430 0x7f73ac06c8f0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.248+0000 7f73c5541640 1 --2- 172.21.15.132:0/3000253994 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f73c015aee0 0x7f73c00a8700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.248+0000 7f73c5541640 1 --2- 172.21.15.132:0/3000253994 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f73c00cdbb0 0x7f73c01f3b20 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.248+0000 7f73c5541640 1 --2- 172.21.15.132:0/3000253994 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f73c00cb2b0 0x7f73c01f0d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.248+0000 7f73c5541640 1 -- 172.21.15.132:0/3000253994 >> 172.21.15.132:0/3000253994 conn(0x7f73c0072c60 msgr2=0x7f73c015d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:20.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.248+0000 7f73c5541640 1 -- 172.21.15.132:0/3000253994 shutdown_connections 2023-12-20T04:46:20.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.248+0000 7f73c5541640 1 -- 172.21.15.132:0/3000253994 wait complete. 2023-12-20T04:46:20.261 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-20T04:46:20.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.359+0000 7f78c184a640 1 Processor -- start 2023-12-20T04:46:20.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.359+0000 7f78c184a640 1 -- start start 2023-12-20T04:46:20.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.359+0000 7f78c184a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f78bc0d30a0 0x7f78bc0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.359+0000 7f78c184a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f78bc0d0060 0x7f78bc0d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.360+0000 7f78c184a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78bc0d0cf0 con 0x7f78bc15d2c0 2023-12-20T04:46:20.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.360+0000 7f78c184a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc0d0550 con 0x7f78bc0d30a0 2023-12-20T04:46:20.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.360+0000 7f78c184a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78bc0cddc0 con 0x7f78bc0d0060 2023-12-20T04:46:20.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.360+0000 7f78baffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f78bc0d30a0 0x7f78bc0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.360+0000 7f78baffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f78bc0d30a0 0x7f78bc0cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37142/0 (socket says 172.21.15.132:37142) 2023-12-20T04:46:20.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.360+0000 7f78baffd640 1 -- 172.21.15.132:0/3552952595 learned_addr learned my addr 172.21.15.132:0/3552952595 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:20.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.360+0000 7f78bb7fe640 1 --2- 172.21.15.132:0/3552952595 >> v2:172.21.15.187:3300/0 conn(0x7f78bc0d0060 0x7f78bc0d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.360+0000 7f78baffd640 1 -- 172.21.15.132:0/3552952595 >> v2:172.21.15.187:3300/0 conn(0x7f78bc0d0060 msgr2=0x7f78bc0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:20.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.360+0000 7f78baffd640 1 --2- 172.21.15.132:0/3552952595 >> v2:172.21.15.187:3300/0 conn(0x7f78bc0d0060 0x7f78bc0d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.360+0000 7f78baffd640 1 -- 172.21.15.132:0/3552952595 >> v1:172.21.15.187:6789/0 conn(0x7f78bc15d2c0 legacy=0x7f78bc0d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:20.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.360+0000 7f78baffd640 1 -- 172.21.15.132:0/3552952595 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78bc0ce0a0 con 0x7f78bc0d30a0 2023-12-20T04:46:20.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.361+0000 7f78baffd640 1 --2- 172.21.15.132:0/3552952595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0d30a0 0x7f78bc0cd5c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0b87e0 tx=0x7f78ac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cedbd9d84c1cdf2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:20.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.361+0000 7f78b9ffb640 1 -- 172.21.15.132:0/3552952595 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac031870 con 0x7f78bc0d30a0 2023-12-20T04:46:20.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.361+0000 7f78b9ffb640 1 -- 172.21.15.132:0/3552952595 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78ac0319d0 con 0x7f78bc0d30a0 2023-12-20T04:46:20.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.361+0000 7f78b9ffb640 1 -- 172.21.15.132:0/3552952595 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78ac031d60 con 0x7f78bc0d30a0 2023-12-20T04:46:20.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.361+0000 7f78c184a640 1 -- 172.21.15.132:0/3552952595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0d30a0 msgr2=0x7f78bc0cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:20.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.361+0000 7f78c184a640 1 --2- 172.21.15.132:0/3552952595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0d30a0 0x7f78bc0cd5c0 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7f78bc0b87e0 tx=0x7f78ac02b910 comp rx=0 tx=0).stop 2023-12-20T04:46:20.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.361+0000 7f78c184a640 1 -- 172.21.15.132:0/3552952595 shutdown_connections 2023-12-20T04:46:20.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.361+0000 7f78c184a640 1 --2- 172.21.15.132:0/3552952595 >> v2:172.21.15.187:3300/0 conn(0x7f78bc0d0060 0x7f78bc0d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.362+0000 7f78c184a640 1 --2- 172.21.15.132:0/3552952595 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0d30a0 0x7f78bc0cd5c0 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.362+0000 7f78c184a640 1 -- 172.21.15.132:0/3552952595 >> 172.21.15.132:0/3552952595 conn(0x7f78bc072e40 msgr2=0x7f78bc073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:20.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.362+0000 7f78c184a640 1 -- 172.21.15.132:0/3552952595 shutdown_connections 2023-12-20T04:46:20.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.362+0000 7f78c184a640 1 -- 172.21.15.132:0/3552952595 wait complete. 2023-12-20T04:46:20.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.363+0000 7f78c184a640 1 Processor -- start 2023-12-20T04:46:20.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.363+0000 7f78c184a640 1 -- start start 2023-12-20T04:46:20.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.363+0000 7f78c184a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78bc0d0060 0x7f78bc154410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.363+0000 7f78c184a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0d30a0 0x7f78bc15df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.363+0000 7f78c184a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78bc15d2c0 0x7f78bc0b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.363+0000 7f78c184a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0cae00 con 0x7f78bc0d30a0 2023-12-20T04:46:20.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.363+0000 7f78c184a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0ca1f0 con 0x7f78bc15d2c0 2023-12-20T04:46:20.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.363+0000 7f78c184a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78bc0ca4d0 con 0x7f78bc0d0060 2023-12-20T04:46:20.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.364+0000 7f78ba7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0d30a0 0x7f78bc15df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.364+0000 7f78ba7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0d30a0 0x7f78bc15df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37158/0 (socket says 172.21.15.132:37158) 2023-12-20T04:46:20.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.364+0000 7f78ba7fc640 1 -- 172.21.15.132:0/1669547768 learned_addr learned my addr 172.21.15.132:0/1669547768 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:20.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.364+0000 7f78bb7fe640 1 --2- 172.21.15.132:0/1669547768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78bc15d2c0 0x7f78bc0b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.364+0000 7f78baffd640 1 --2- 172.21.15.132:0/1669547768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78bc0d0060 0x7f78bc154410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.364+0000 7f78ba7fc640 1 -- 172.21.15.132:0/1669547768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78bc0d0060 msgr2=0x7f78bc154410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:20.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.364+0000 7f78ba7fc640 1 --2- 172.21.15.132:0/1669547768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78bc0d0060 0x7f78bc154410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.364+0000 7f78ba7fc640 1 -- 172.21.15.132:0/1669547768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78bc15d2c0 msgr2=0x7f78bc0b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:20.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.364+0000 7f78ba7fc640 1 --2- 172.21.15.132:0/1669547768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78bc15d2c0 0x7f78bc0b6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.364+0000 7f78ba7fc640 1 -- 172.21.15.132:0/1669547768 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78ac0094d0 con 0x7f78bc0d30a0 2023-12-20T04:46:20.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.364+0000 7f78ba7fc640 1 --2- 172.21.15.132:0/1669547768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0d30a0 0x7f78bc15df20 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f78b000b3c0 tx=0x7f78b000b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:20.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.364+0000 7f78a3fff640 1 -- 172.21.15.132:0/1669547768 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0011830 con 0x7f78bc0d30a0 2023-12-20T04:46:20.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.364+0000 7f78a3fff640 1 -- 172.21.15.132:0/1669547768 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78b0011990 con 0x7f78bc0d30a0 2023-12-20T04:46:20.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.364+0000 7f78a3fff640 1 -- 172.21.15.132:0/1669547768 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78b0011d80 con 0x7f78bc0d30a0 2023-12-20T04:46:20.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.364+0000 7f78c184a640 1 -- 172.21.15.132:0/1669547768 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78bc0ca7b0 con 0x7f78bc0d30a0 2023-12-20T04:46:20.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.364+0000 7f78c184a640 1 -- 172.21.15.132:0/1669547768 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78bc154950 con 0x7f78bc0d30a0 2023-12-20T04:46:20.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.365+0000 7f78c184a640 1 -- 172.21.15.132:0/1669547768 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78bc0cafb0 con 0x7f78bc0d30a0 2023-12-20T04:46:20.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.366+0000 7f78a3fff640 1 -- 172.21.15.132:0/1669547768 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f78b001b460 con 0x7f78bc0d30a0 2023-12-20T04:46:20.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.366+0000 7f78a3fff640 1 --2- 172.21.15.132:0/1669547768 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f78a806a430 0x7f78a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.366+0000 7f78a3fff640 1 -- 172.21.15.132:0/1669547768 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f78b0088180 con 0x7f78bc0d30a0 2023-12-20T04:46:20.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.366+0000 7f78baffd640 1 --2- 172.21.15.132:0/1669547768 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f78a806a430 0x7f78a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.367+0000 7f78baffd640 1 --2- 172.21.15.132:0/1669547768 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f78a806a430 0x7f78a806c8f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f78ac036000 tx=0x7f78ac03c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:20.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.370+0000 7f78a3fff640 1 -- 172.21.15.132:0/1669547768 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f78bc0cafb0 con 0x7f78bc0d30a0 2023-12-20T04:46:20.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.538+0000 7f78c184a640 1 -- 172.21.15.132:0/1669547768 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f78bc04e840 con 0x7f78bc0d30a0 2023-12-20T04:46:20.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.538+0000 7f78a3fff640 1 -- 172.21.15.132:0/1669547768 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v78) v1 ==== 84+0+65 (secure 0 0 0) 0x7f78b0053ac0 con 0x7f78bc0d30a0 2023-12-20T04:46:20.540 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:20.541 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-12-20T04:46:20.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:46:20.541 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-12-20T04:46:20.541 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-12-20T04:46:20.541 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:20.541 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-12-20T04:46:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.541+0000 7f78c184a640 1 -- 172.21.15.132:0/1669547768 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f78a806a430 msgr2=0x7f78a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.541+0000 7f78c184a640 1 --2- 172.21.15.132:0/1669547768 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f78a806a430 0x7f78a806c8f0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f78ac036000 tx=0x7f78ac03c040 comp rx=0 tx=0).stop 2023-12-20T04:46:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.541+0000 7f78c184a640 1 -- 172.21.15.132:0/1669547768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0d30a0 msgr2=0x7f78bc15df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.541+0000 7f78c184a640 1 --2- 172.21.15.132:0/1669547768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0d30a0 0x7f78bc15df20 secure :-1 s=READY pgs=862 cs=0 l=1 rev1=1 crypto rx=0x7f78b000b3c0 tx=0x7f78b000b880 comp rx=0 tx=0).stop 2023-12-20T04:46:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.541+0000 7f78c184a640 1 -- 172.21.15.132:0/1669547768 shutdown_connections 2023-12-20T04:46:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.541+0000 7f78c184a640 1 --2- 172.21.15.132:0/1669547768 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f78a806a430 0x7f78a806c8f0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.541+0000 7f78c184a640 1 --2- 172.21.15.132:0/1669547768 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78bc15d2c0 0x7f78bc0b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.541+0000 7f78c184a640 1 --2- 172.21.15.132:0/1669547768 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78bc0d30a0 0x7f78bc15df20 unknown :-1 s=CLOSED pgs=862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.541+0000 7f78c184a640 1 --2- 172.21.15.132:0/1669547768 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78bc0d0060 0x7f78bc154410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.541+0000 7f78c184a640 1 -- 172.21.15.132:0/1669547768 >> 172.21.15.132:0/1669547768 conn(0x7f78bc072e40 msgr2=0x7f78bc073220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.541+0000 7f78c184a640 1 -- 172.21.15.132:0/1669547768 shutdown_connections 2023-12-20T04:46:20.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.541+0000 7f78c184a640 1 -- 172.21.15.132:0/1669547768 wait complete. 2023-12-20T04:46:20.553 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-20T04:46:20.554 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-20T04:46:20.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.655+0000 7fc899421640 1 Processor -- start 2023-12-20T04:46:20.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.655+0000 7fc899421640 1 -- start start 2023-12-20T04:46:20.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.656+0000 7fc899421640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc89415d190 0x7fc894160b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.656+0000 7fc899421640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8940ce1f0 0x7fc8940d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.656+0000 7fc899421640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc894161a70 con 0x7fc8940b87a0 2023-12-20T04:46:20.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.656+0000 7fc899421640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8940b5fb0 con 0x7fc89415d190 2023-12-20T04:46:20.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.656+0000 7fc899421640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8941611d0 con 0x7fc8940ce1f0 2023-12-20T04:46:20.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.656+0000 7fc8927fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc8940b87a0 0x7fc8940cdae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43650/0 (socket says 172.21.15.132:43650) 2023-12-20T04:46:20.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.656+0000 7fc8927fc640 1 -- 172.21.15.132:0/4145866234 learned_addr learned my addr 172.21.15.132:0/4145866234 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:20.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.656+0000 7fc891ffb640 1 -- 172.21.15.132:0/4145866234 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1650869145 0 0) 0x7fc894161a70 con 0x7fc8940b87a0 2023-12-20T04:46:20.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.656+0000 7fc892ffd640 1 --2- 172.21.15.132:0/4145866234 >> v2:172.21.15.187:3300/0 conn(0x7fc89415d190 0x7fc894160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.656+0000 7fc891ffb640 1 -- 172.21.15.132:0/4145866234 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc87c003520 con 0x7fc8940b87a0 2023-12-20T04:46:20.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.656+0000 7fc8937fe640 1 --2- 172.21.15.132:0/4145866234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8940ce1f0 0x7fc8940d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc891ffb640 1 -- 172.21.15.132:0/4145866234 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 116532331 0 0) 0x7fc87c003520 con 0x7fc8940b87a0 2023-12-20T04:46:20.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc891ffb640 1 -- 172.21.15.132:0/4145866234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8940ce1f0 msgr2=0x7fc8940d18a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:20.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc891ffb640 1 --2- 172.21.15.132:0/4145866234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8940ce1f0 0x7fc8940d18a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc891ffb640 1 -- 172.21.15.132:0/4145866234 >> v2:172.21.15.187:3300/0 conn(0x7fc89415d190 msgr2=0x7fc894160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:20.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc891ffb640 1 --2- 172.21.15.132:0/4145866234 >> v2:172.21.15.187:3300/0 conn(0x7fc89415d190 0x7fc894160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc891ffb640 1 -- 172.21.15.132:0/4145866234 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8941614b0 con 0x7fc8940b87a0 2023-12-20T04:46:20.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc891ffb640 1 -- 172.21.15.132:0/4145866234 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fc888001670 con 0x7fc8940b87a0 2023-12-20T04:46:20.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc891ffb640 1 -- 172.21.15.132:0/4145866234 >> v1:172.21.15.132:6789/0 conn(0x7fc8940b87a0 legacy=0x7fc8940cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:20.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc891ffb640 1 --2- 172.21.15.132:0/4145866234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc87c003970 0x7fc87c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc891ffb640 1 --2- 172.21.15.132:0/4145866234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8940ce1f0 0x7fc87c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc891ffb640 1 --2- 172.21.15.132:0/4145866234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc87c004d00 0x7fc87c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc891ffb640 1 -- 172.21.15.132:0/4145866234 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940b5fb0 con 0x7fc87c003970 2023-12-20T04:46:20.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc891ffb640 1 -- 172.21.15.132:0/4145866234 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8941611d0 con 0x7fc87c004d00 2023-12-20T04:46:20.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc891ffb640 1 -- 172.21.15.132:0/4145866234 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc87c00bbc0 con 0x7fc8940ce1f0 2023-12-20T04:46:20.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc892ffd640 1 --2- 172.21.15.132:0/4145866234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc87c003970 0x7fc87c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc8927fc640 1 --2- 172.21.15.132:0/4145866234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8940ce1f0 0x7fc87c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc8937fe640 1 --2- 172.21.15.132:0/4145866234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc87c004d00 0x7fc87c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc892ffd640 1 -- 172.21.15.132:0/4145866234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8940ce1f0 msgr2=0x7fc87c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:20.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc892ffd640 1 --2- 172.21.15.132:0/4145866234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8940ce1f0 0x7fc87c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc892ffd640 1 -- 172.21.15.132:0/4145866234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc87c004d00 msgr2=0x7fc87c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:20.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc892ffd640 1 --2- 172.21.15.132:0/4145866234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc87c004d00 0x7fc87c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.657+0000 7fc892ffd640 1 -- 172.21.15.132:0/4145866234 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc87c003520 con 0x7fc87c003970 2023-12-20T04:46:20.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.658+0000 7fc892ffd640 1 --2- 172.21.15.132:0/4145866234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc87c003970 0x7fc87c003d90 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc884007360 tx=0x7fc87c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df6cdf3a4bb6ec14 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:20.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.658+0000 7fc891ffb640 1 -- 172.21.15.132:0/4145866234 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88402ccf0 con 0x7fc87c003970 2023-12-20T04:46:20.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.658+0000 7fc891ffb640 1 -- 172.21.15.132:0/4145866234 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88402ce50 con 0x7fc87c003970 2023-12-20T04:46:20.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.658+0000 7fc891ffb640 1 -- 172.21.15.132:0/4145866234 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc884034660 con 0x7fc87c003970 2023-12-20T04:46:20.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.659+0000 7fc899421640 1 -- 172.21.15.132:0/4145866234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc87c003970 msgr2=0x7fc87c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:20.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.659+0000 7fc899421640 1 --2- 172.21.15.132:0/4145866234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc87c003970 0x7fc87c003d90 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7fc884007360 tx=0x7fc87c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.659+0000 7fc8937fe640 1 -- 172.21.15.132:0/4145866234 reap_dead start 2023-12-20T04:46:20.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.659+0000 7fc899421640 1 -- 172.21.15.132:0/4145866234 shutdown_connections 2023-12-20T04:46:20.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.659+0000 7fc899421640 1 -- 172.21.15.132:0/4145866234 >> 172.21.15.132:0/4145866234 conn(0x7fc89406a290 msgr2=0x7fc89406a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:20.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.659+0000 7fc899421640 1 -- 172.21.15.132:0/4145866234 shutdown_connections 2023-12-20T04:46:20.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.659+0000 7fc899421640 1 -- 172.21.15.132:0/4145866234 wait complete. 2023-12-20T04:46:20.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.660+0000 7fc899421640 1 Processor -- start 2023-12-20T04:46:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.660+0000 7fc899421640 1 -- start start 2023-12-20T04:46:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc899421640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc87c003970 0x7fc894151300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc899421640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc894158dc0 0x7fc89415b0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc899421640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc89415a5b0 0x7fc89415b5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc899421640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc89415af30 con 0x7fc89415a5b0 2023-12-20T04:46:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc899421640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8940c9820 con 0x7fc87c003970 2023-12-20T04:46:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc899421640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc894153db0 con 0x7fc894158dc0 2023-12-20T04:46:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc8937fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc89415a5b0 0x7fc89415b5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc8937fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc89415a5b0 0x7fc89415b5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37184/0 (socket says 172.21.15.132:37184) 2023-12-20T04:46:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc8937fe640 1 -- 172.21.15.132:0/2164380855 learned_addr learned my addr 172.21.15.132:0/2164380855 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc892ffd640 1 --2- 172.21.15.132:0/2164380855 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc87c003970 0x7fc894151300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc8927fc640 1 --2- 172.21.15.132:0/2164380855 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc894158dc0 0x7fc89415b0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc8937fe640 1 -- 172.21.15.132:0/2164380855 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc894158dc0 msgr2=0x7fc89415b0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:20.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc8937fe640 1 --2- 172.21.15.132:0/2164380855 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc894158dc0 0x7fc89415b0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc8937fe640 1 -- 172.21.15.132:0/2164380855 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc87c003970 msgr2=0x7fc894151300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:20.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc8937fe640 1 --2- 172.21.15.132:0/2164380855 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc87c003970 0x7fc894151300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:20.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc8937fe640 1 -- 172.21.15.132:0/2164380855 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc894151840 con 0x7fc89415a5b0 2023-12-20T04:46:20.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc8937fe640 1 --2- 172.21.15.132:0/2164380855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc89415a5b0 0x7fc89415b5e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc89408c2a0 tx=0x7fc88c003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:20.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc87b7fe640 1 -- 172.21.15.132:0/2164380855 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c014740 con 0x7fc89415a5b0 2023-12-20T04:46:20.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc87b7fe640 1 -- 172.21.15.132:0/2164380855 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc88c0148a0 con 0x7fc89415a5b0 2023-12-20T04:46:20.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc87b7fe640 1 -- 172.21.15.132:0/2164380855 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc88c014c50 con 0x7fc89415a5b0 2023-12-20T04:46:20.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.661+0000 7fc899421640 1 -- 172.21.15.132:0/2164380855 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8940c9540 con 0x7fc89415a5b0 2023-12-20T04:46:20.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.662+0000 7fc899421640 1 -- 172.21.15.132:0/2164380855 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc89415ab50 con 0x7fc89415a5b0 2023-12-20T04:46:20.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.662+0000 7fc899421640 1 -- 172.21.15.132:0/2164380855 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8941538a0 con 0x7fc89415a5b0 2023-12-20T04:46:20.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.663+0000 7fc87b7fe640 1 -- 172.21.15.132:0/2164380855 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc88c01f460 con 0x7fc89415a5b0 2023-12-20T04:46:20.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.663+0000 7fc87b7fe640 1 --2- 172.21.15.132:0/2164380855 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc88006a430 0x7fc88006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:20.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.663+0000 7fc892ffd640 1 --2- 172.21.15.132:0/2164380855 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc88006a430 0x7fc88006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:20.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.663+0000 7fc87b7fe640 1 -- 172.21.15.132:0/2164380855 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(78..78 src has 1..78) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc88c0887b0 con 0x7fc89415a5b0 2023-12-20T04:46:20.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.664+0000 7fc892ffd640 1 --2- 172.21.15.132:0/2164380855 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc88006a430 0x7fc88006c8f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc884036000 tx=0x7fc884030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:20.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.668+0000 7fc87b7fe640 1 -- 172.21.15.132:0/2164380855 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc8941538a0 con 0x7fc89415a5b0 2023-12-20T04:46:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:20.833+0000 7fc899421640 1 -- 172.21.15.132:0/2164380855 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc8941538a0 con 0x7fc89415a5b0 2023-12-20T04:46:21.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.111+0000 7fc87b7fe640 1 -- 172.21.15.132:0/2164380855 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v79) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc8941538a0 con 0x7fc89415a5b0 2023-12-20T04:46:21.113 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2023-12-20T04:46:21.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.114+0000 7fc899421640 1 -- 172.21.15.132:0/2164380855 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc88006a430 msgr2=0x7fc88006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:21.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.114+0000 7fc899421640 1 --2- 172.21.15.132:0/2164380855 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc88006a430 0x7fc88006c8f0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fc884036000 tx=0x7fc884030000 comp rx=0 tx=0).stop 2023-12-20T04:46:21.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.114+0000 7fc899421640 1 -- 172.21.15.132:0/2164380855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc89415a5b0 msgr2=0x7fc89415b5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:21.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.114+0000 7fc899421640 1 --2- 172.21.15.132:0/2164380855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc89415a5b0 0x7fc89415b5e0 secure :-1 s=READY pgs=865 cs=0 l=1 rev1=1 crypto rx=0x7fc89408c2a0 tx=0x7fc88c003f90 comp rx=0 tx=0).stop 2023-12-20T04:46:21.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.114+0000 7fc899421640 1 -- 172.21.15.132:0/2164380855 shutdown_connections 2023-12-20T04:46:21.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.114+0000 7fc899421640 1 --2- 172.21.15.132:0/2164380855 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc88006a430 0x7fc88006c8f0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:21.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.114+0000 7fc899421640 1 --2- 172.21.15.132:0/2164380855 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc89415a5b0 0x7fc89415b5e0 unknown :-1 s=CLOSED pgs=865 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:21.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.114+0000 7fc899421640 1 --2- 172.21.15.132:0/2164380855 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc894158dc0 0x7fc89415b0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:21.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.114+0000 7fc899421640 1 --2- 172.21.15.132:0/2164380855 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc87c003970 0x7fc894151300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:21.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.114+0000 7fc899421640 1 -- 172.21.15.132:0/2164380855 >> 172.21.15.132:0/2164380855 conn(0x7fc89406a290 msgr2=0x7fc89415e070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:21.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.114+0000 7fc899421640 1 -- 172.21.15.132:0/2164380855 shutdown_connections 2023-12-20T04:46:21.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.114+0000 7fc899421640 1 -- 172.21.15.132:0/2164380855 wait complete. 2023-12-20T04:46:21.128 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-20T04:46:21.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.233+0000 7f46e4d63640 1 Processor -- start 2023-12-20T04:46:21.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.233+0000 7f46e4d63640 1 -- start start 2023-12-20T04:46:21.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.234+0000 7f46e4d63640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46e015cf20 0x7f46e006c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:21.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.234+0000 7f46e4d63640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f46e015d300 0x7f46e0161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:21.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.234+0000 7f46e4d63640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f46e00cd4b0 0x7f46e00cd900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:21.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.234+0000 7f46e4d63640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e00cde40 con 0x7f46e00cd4b0 2023-12-20T04:46:21.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.234+0000 7f46e4d63640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f46e0161c40 con 0x7f46e015d300 2023-12-20T04:46:21.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.234+0000 7f46e4d63640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e006cc90 con 0x7f46e015cf20 2023-12-20T04:46:21.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.234+0000 7f46ded9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f46e00cd4b0 0x7f46e00cd900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:21.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.234+0000 7f46ded9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f46e00cd4b0 0x7f46e00cd900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37196/0 (socket says 172.21.15.132:37196) 2023-12-20T04:46:21.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.234+0000 7f46ded9d640 1 -- 172.21.15.132:0/4208461660 learned_addr learned my addr 172.21.15.132:0/4208461660 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:21.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.234+0000 7f46ddd9b640 1 --2- 172.21.15.132:0/4208461660 >> v2:172.21.15.187:3300/0 conn(0x7f46e015d300 0x7f46e0161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:21.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.234+0000 7f46ded9d640 1 -- 172.21.15.132:0/4208461660 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46e015cf20 msgr2=0x7f46e006c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:21.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.234+0000 7f46de59c640 1 --2- 172.21.15.132:0/4208461660 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46e015cf20 0x7f46e006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:21.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.235+0000 7f46ded9d640 1 --2- 172.21.15.132:0/4208461660 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46e015cf20 0x7f46e006c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:21.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.235+0000 7f46ded9d640 1 -- 172.21.15.132:0/4208461660 >> v2:172.21.15.187:3300/0 conn(0x7f46e015d300 msgr2=0x7f46e0161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:21.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.235+0000 7f46ded9d640 1 --2- 172.21.15.132:0/4208461660 >> v2:172.21.15.187:3300/0 conn(0x7f46e015d300 0x7f46e0161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:21.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.235+0000 7f46ded9d640 1 -- 172.21.15.132:0/4208461660 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46e00b2f30 con 0x7f46e00cd4b0 2023-12-20T04:46:21.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.235+0000 7f46ddd9b640 1 --2- 172.21.15.132:0/4208461660 >> v2:172.21.15.187:3300/0 conn(0x7f46e015d300 0x7f46e0161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:21.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.235+0000 7f46de59c640 1 --2- 172.21.15.132:0/4208461660 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46e015cf20 0x7f46e006c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:21.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.235+0000 7f46ded9d640 1 --2- 172.21.15.132:0/4208461660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e00cd4b0 0x7f46e00cd900 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f46e00ce7e0 tx=0x7f46d802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2c6b98d3e677dea server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:21.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.235+0000 7f46dd59a640 1 -- 172.21.15.132:0/4208461660 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d802ca70 con 0x7f46e00cd4b0 2023-12-20T04:46:21.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.235+0000 7f46dd59a640 1 -- 172.21.15.132:0/4208461660 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d802cbd0 con 0x7f46e00cd4b0 2023-12-20T04:46:21.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.235+0000 7f46dd59a640 1 -- 172.21.15.132:0/4208461660 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d80343f0 con 0x7f46e00cd4b0 2023-12-20T04:46:21.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.236+0000 7f46e4d63640 1 -- 172.21.15.132:0/4208461660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e00cd4b0 msgr2=0x7f46e00cd900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:21.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.236+0000 7f46e4d63640 1 --2- 172.21.15.132:0/4208461660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e00cd4b0 0x7f46e00cd900 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7f46e00ce7e0 tx=0x7f46d802bed0 comp rx=0 tx=0).stop 2023-12-20T04:46:21.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.236+0000 7f46e4d63640 1 -- 172.21.15.132:0/4208461660 shutdown_connections 2023-12-20T04:46:21.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.236+0000 7f46e4d63640 1 --2- 172.21.15.132:0/4208461660 >> v2:172.21.15.187:3300/0 conn(0x7f46e015d300 0x7f46e0161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:21.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.236+0000 7f46e4d63640 1 --2- 172.21.15.132:0/4208461660 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e00cd4b0 0x7f46e00cd900 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:21.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.236+0000 7f46e4d63640 1 --2- 172.21.15.132:0/4208461660 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46e015cf20 0x7f46e006c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:21.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.236+0000 7f46e4d63640 1 -- 172.21.15.132:0/4208461660 >> 172.21.15.132:0/4208461660 conn(0x7f46e0072c60 msgr2=0x7f46e0073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:21.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.236+0000 7f46e4d63640 1 -- 172.21.15.132:0/4208461660 shutdown_connections 2023-12-20T04:46:21.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.236+0000 7f46e4d63640 1 -- 172.21.15.132:0/4208461660 wait complete. 2023-12-20T04:46:21.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.237+0000 7f46e4d63640 1 Processor -- start 2023-12-20T04:46:21.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.237+0000 7f46e4d63640 1 -- start start 2023-12-20T04:46:21.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.238+0000 7f46e4d63640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46e00cd4b0 0x7f46e01f6870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:21.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.238+0000 7f46e4d63640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46e015cf20 0x7f46e00c3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:21.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.238+0000 7f46e4d63640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e015d300 0x7f46e015afe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:21.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.238+0000 7f46e4d63640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e00c4470 con 0x7f46e015d300 2023-12-20T04:46:21.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.238+0000 7f46e4d63640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46e015d780 con 0x7f46e015cf20 2023-12-20T04:46:21.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.238+0000 7f46e4d63640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46e015da40 con 0x7f46e00cd4b0 2023-12-20T04:46:21.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.238+0000 7f46ded9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e015d300 0x7f46e015afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:21.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.238+0000 7f46ded9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e015d300 0x7f46e015afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37212/0 (socket says 172.21.15.132:37212) 2023-12-20T04:46:21.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.238+0000 7f46ded9d640 1 -- 172.21.15.132:0/463136100 learned_addr learned my addr 172.21.15.132:0/463136100 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:21.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.238+0000 7f46ddd9b640 1 --2- 172.21.15.132:0/463136100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46e015cf20 0x7f46e00c3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:21.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.238+0000 7f46de59c640 1 --2- 172.21.15.132:0/463136100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46e00cd4b0 0x7f46e01f6870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:21.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.239+0000 7f46ded9d640 1 -- 172.21.15.132:0/463136100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46e00cd4b0 msgr2=0x7f46e01f6870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:21.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.239+0000 7f46ded9d640 1 --2- 172.21.15.132:0/463136100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46e00cd4b0 0x7f46e01f6870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:21.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.239+0000 7f46ded9d640 1 -- 172.21.15.132:0/463136100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46e015cf20 msgr2=0x7f46e00c3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:21.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.239+0000 7f46ded9d640 1 --2- 172.21.15.132:0/463136100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46e015cf20 0x7f46e00c3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:21.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.239+0000 7f46ded9d640 1 -- 172.21.15.132:0/463136100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f46d8009b30 con 0x7f46e015d300 2023-12-20T04:46:21.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.239+0000 7f46ddd9b640 1 --2- 172.21.15.132:0/463136100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46e015cf20 0x7f46e00c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:21.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.239+0000 7f46de59c640 1 --2- 172.21.15.132:0/463136100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46e00cd4b0 0x7f46e01f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:21.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.239+0000 7f46ded9d640 1 --2- 172.21.15.132:0/463136100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e015d300 0x7f46e015afe0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f46d8036040 tx=0x7f46d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:21.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.239+0000 7f46ceffd640 1 -- 172.21.15.132:0/463136100 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d8009510 con 0x7f46e015d300 2023-12-20T04:46:21.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.239+0000 7f46ceffd640 1 -- 172.21.15.132:0/463136100 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f46d803e450 con 0x7f46e015d300 2023-12-20T04:46:21.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.239+0000 7f46e4d63640 1 -- 172.21.15.132:0/463136100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f46e015dd20 con 0x7f46e015d300 2023-12-20T04:46:21.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.239+0000 7f46ceffd640 1 -- 172.21.15.132:0/463136100 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46d803e800 con 0x7f46e015d300 2023-12-20T04:46:21.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.239+0000 7f46e4d63640 1 -- 172.21.15.132:0/463136100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46e015e2e0 con 0x7f46e015d300 2023-12-20T04:46:21.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.240+0000 7f46e4d63640 1 -- 172.21.15.132:0/463136100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f46e004e840 con 0x7f46e015d300 2023-12-20T04:46:21.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.240+0000 7f46ceffd640 1 -- 172.21.15.132:0/463136100 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f46d803e960 con 0x7f46e015d300 2023-12-20T04:46:21.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.241+0000 7f46ceffd640 1 --2- 172.21.15.132:0/463136100 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f46c006a460 0x7f46c006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:21.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.241+0000 7f46ceffd640 1 -- 172.21.15.132:0/463136100 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(79..79 src has 1..79) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f46d80ab580 con 0x7f46e015d300 2023-12-20T04:46:21.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.241+0000 7f46de59c640 1 --2- 172.21.15.132:0/463136100 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f46c006a460 0x7f46c006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:21.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.241+0000 7f46de59c640 1 --2- 172.21.15.132:0/463136100 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f46c006a460 0x7f46c006c920 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f46d0006fd0 tx=0x7f46d0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:21.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.245+0000 7f46ceffd640 1 -- 172.21.15.132:0/463136100 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f46d8076e00 con 0x7f46e015d300 2023-12-20T04:46:21.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:21.412+0000 7f46e4d63640 1 -- 172.21.15.132:0/463136100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f46e00b2890 con 0x7f46e015d300 2023-12-20T04:46:22.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.119+0000 7f46ceffd640 1 -- 172.21.15.132:0/463136100 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v80) v1 ==== 170+0+0 (secure 0 0 0) 0x7f46d807a420 con 0x7f46e015d300 2023-12-20T04:46:22.125 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2023-12-20T04:46:22.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.126+0000 7f46e4d63640 1 -- 172.21.15.132:0/463136100 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f46c006a460 msgr2=0x7f46c006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.126+0000 7f46e4d63640 1 --2- 172.21.15.132:0/463136100 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f46c006a460 0x7f46c006c920 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f46d0006fd0 tx=0x7f46d0008040 comp rx=0 tx=0).stop 2023-12-20T04:46:22.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.126+0000 7f46e4d63640 1 -- 172.21.15.132:0/463136100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e015d300 msgr2=0x7f46e015afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.126+0000 7f46e4d63640 1 --2- 172.21.15.132:0/463136100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e015d300 0x7f46e015afe0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7f46d8036040 tx=0x7f46d8004a40 comp rx=0 tx=0).stop 2023-12-20T04:46:22.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.127+0000 7f46e4d63640 1 -- 172.21.15.132:0/463136100 shutdown_connections 2023-12-20T04:46:22.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.127+0000 7f46e4d63640 1 --2- 172.21.15.132:0/463136100 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f46c006a460 0x7f46c006c920 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.127+0000 7f46e4d63640 1 --2- 172.21.15.132:0/463136100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46e015d300 0x7f46e015afe0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.127+0000 7f46e4d63640 1 --2- 172.21.15.132:0/463136100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f46e015cf20 0x7f46e00c3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.127+0000 7f46e4d63640 1 --2- 172.21.15.132:0/463136100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46e00cd4b0 0x7f46e01f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.127+0000 7f46e4d63640 1 -- 172.21.15.132:0/463136100 >> 172.21.15.132:0/463136100 conn(0x7f46e0072c60 msgr2=0x7f46e015f4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:22.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.127+0000 7f46e4d63640 1 -- 172.21.15.132:0/463136100 shutdown_connections 2023-12-20T04:46:22.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.127+0000 7f46e4d63640 1 -- 172.21.15.132:0/463136100 wait complete. 2023-12-20T04:46:22.142 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-20T04:46:22.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.244+0000 7f3469b99640 1 Processor -- start 2023-12-20T04:46:22.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.244+0000 7f3469b99640 1 -- start start 2023-12-20T04:46:22.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.245+0000 7f3469b99640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f346415d300 0x7f34640d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:22.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.245+0000 7f3469b99640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34640d1a90 con 0x7f34640cff90 2023-12-20T04:46:22.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.245+0000 7f3469b99640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34640d1d70 con 0x7f34640d1550 2023-12-20T04:46:22.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.245+0000 7f3469b99640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34640d2050 con 0x7f346415d300 2023-12-20T04:46:22.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.245+0000 7f34637fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f346415d300 0x7f34640d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:22.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.245+0000 7f3463fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f34640cff90 0x7f34640b60e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43660/0 (socket says 172.21.15.132:43660) 2023-12-20T04:46:22.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.245+0000 7f34637fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f346415d300 0x7f34640d1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37222/0 (socket says 172.21.15.132:37222) 2023-12-20T04:46:22.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.245+0000 7f3463fff640 1 -- 172.21.15.132:0/2949439795 learned_addr learned my addr 172.21.15.132:0/2949439795 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:22.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.246+0000 7f34637fe640 1 -- 172.21.15.132:0/2949439795 >> v1:172.21.15.187:6789/0 conn(0x7f34640d1550 legacy=0x7f34640cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:22.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.246+0000 7f34627fc640 1 -- 172.21.15.132:0/2949439795 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4077683906 0 0) 0x7f34640d1a90 con 0x7f34640cff90 2023-12-20T04:46:22.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.246+0000 7f34637fe640 1 -- 172.21.15.132:0/2949439795 >> v1:172.21.15.132:6789/0 conn(0x7f34640cff90 legacy=0x7f34640b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.246+0000 7f34637fe640 1 -- 172.21.15.132:0/2949439795 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34640d2330 con 0x7f346415d300 2023-12-20T04:46:22.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.246+0000 7f34637fe640 1 --2- 172.21.15.132:0/2949439795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f346415d300 0x7f34640d1010 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f34580097a0 tx=0x7f345802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34a1f53c974f9246 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:22.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.246+0000 7f34627fc640 1 -- 172.21.15.132:0/2949439795 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3458030610 con 0x7f346415d300 2023-12-20T04:46:22.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.247+0000 7f34627fc640 1 -- 172.21.15.132:0/2949439795 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3458030770 con 0x7f346415d300 2023-12-20T04:46:22.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.247+0000 7f34627fc640 1 -- 172.21.15.132:0/2949439795 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3458030b00 con 0x7f346415d300 2023-12-20T04:46:22.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.247+0000 7f3469b99640 1 -- 172.21.15.132:0/2949439795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f346415d300 msgr2=0x7f34640d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.247+0000 7f3469b99640 1 --2- 172.21.15.132:0/2949439795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f346415d300 0x7f34640d1010 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f34580097a0 tx=0x7f345802b960 comp rx=0 tx=0).stop 2023-12-20T04:46:22.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.247+0000 7f3469b99640 1 -- 172.21.15.132:0/2949439795 shutdown_connections 2023-12-20T04:46:22.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.247+0000 7f3469b99640 1 --2- 172.21.15.132:0/2949439795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f346415d300 0x7f34640d1010 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.247+0000 7f3469b99640 1 -- 172.21.15.132:0/2949439795 >> 172.21.15.132:0/2949439795 conn(0x7f346406a3d0 msgr2=0x7f346406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:22.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.247+0000 7f3469b99640 1 -- 172.21.15.132:0/2949439795 shutdown_connections 2023-12-20T04:46:22.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.247+0000 7f3469b99640 1 -- 172.21.15.132:0/2949439795 wait complete. 2023-12-20T04:46:22.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.248+0000 7f3469b99640 1 Processor -- start 2023-12-20T04:46:22.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.248+0000 7f3469b99640 1 -- start start 2023-12-20T04:46:22.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.249+0000 7f3469b99640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34640cff90 0x7f346414a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:22.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.249+0000 7f3469b99640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34640d1550 0x7f34640cc950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:22.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.249+0000 7f3469b99640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f346415d300 0x7f34640c8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:22.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.249+0000 7f3469b99640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f346414e740 con 0x7f34640d1550 2023-12-20T04:46:22.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.249+0000 7f3469b99640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34640d33d0 con 0x7f34640cff90 2023-12-20T04:46:22.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.249+0000 7f3469b99640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34640d36b0 con 0x7f346415d300 2023-12-20T04:46:22.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.249+0000 7f3462ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34640d1550 0x7f34640cc950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:22.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.249+0000 7f3462ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34640d1550 0x7f34640cc950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37234/0 (socket says 172.21.15.132:37234) 2023-12-20T04:46:22.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.249+0000 7f3462ffd640 1 -- 172.21.15.132:0/85415157 learned_addr learned my addr 172.21.15.132:0/85415157 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:22.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.249+0000 7f34637fe640 1 --2- 172.21.15.132:0/85415157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34640cff90 0x7f346414a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:22.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.249+0000 7f3463fff640 1 --2- 172.21.15.132:0/85415157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f346415d300 0x7f34640c8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:22.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.249+0000 7f3462ffd640 1 -- 172.21.15.132:0/85415157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f346415d300 msgr2=0x7f34640c8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.249+0000 7f3462ffd640 1 --2- 172.21.15.132:0/85415157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f346415d300 0x7f34640c8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.250+0000 7f3462ffd640 1 -- 172.21.15.132:0/85415157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34640cff90 msgr2=0x7f346414a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.250+0000 7f3462ffd640 1 --2- 172.21.15.132:0/85415157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34640cff90 0x7f346414a210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.250+0000 7f3462ffd640 1 -- 172.21.15.132:0/85415157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3458009400 con 0x7f34640d1550 2023-12-20T04:46:22.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.250+0000 7f3462ffd640 1 --2- 172.21.15.132:0/85415157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34640d1550 0x7f34640cc950 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f345400c420 tx=0x7f345400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:22.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.250+0000 7f344bfff640 1 -- 172.21.15.132:0/85415157 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34540052d0 con 0x7f34640d1550 2023-12-20T04:46:22.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.250+0000 7f344bfff640 1 -- 172.21.15.132:0/85415157 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3454005430 con 0x7f34640d1550 2023-12-20T04:46:22.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.250+0000 7f344bfff640 1 -- 172.21.15.132:0/85415157 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3454003880 con 0x7f34640d1550 2023-12-20T04:46:22.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.250+0000 7f3469b99640 1 -- 172.21.15.132:0/85415157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34640d3990 con 0x7f34640d1550 2023-12-20T04:46:22.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.250+0000 7f3469b99640 1 -- 172.21.15.132:0/85415157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f346414a750 con 0x7f34640d1550 2023-12-20T04:46:22.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.251+0000 7f3469b99640 1 -- 172.21.15.132:0/85415157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34640ca300 con 0x7f34640d1550 2023-12-20T04:46:22.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.251+0000 7f344bfff640 1 -- 172.21.15.132:0/85415157 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f34540039e0 con 0x7f34640d1550 2023-12-20T04:46:22.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.252+0000 7f344bfff640 1 --2- 172.21.15.132:0/85415157 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f345006a430 0x7f345006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:22.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.252+0000 7f344bfff640 1 -- 172.21.15.132:0/85415157 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(80..80 src has 1..80) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f3454087ee0 con 0x7f34640d1550 2023-12-20T04:46:22.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.252+0000 7f34637fe640 1 --2- 172.21.15.132:0/85415157 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f345006a430 0x7f345006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:22.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.252+0000 7f34637fe640 1 --2- 172.21.15.132:0/85415157 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f345006a430 0x7f345006c8f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3458036000 tx=0x7f345803b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:22.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.256+0000 7f344bfff640 1 -- 172.21.15.132:0/85415157 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f34540534a0 con 0x7f34640d1550 2023-12-20T04:46:22.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.458+0000 7f3469b99640 1 -- 172.21.15.132:0/85415157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f346404e840 con 0x7f34640d1550 2023-12-20T04:46:22.465 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 10 and data pool 11 2023-12-20T04:46:22.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.462+0000 7f344bfff640 1 -- 172.21.15.132:0/85415157 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 10 and data pool 11 v30) v1 ==== 174+0+0 (secure 0 0 0) 0x7f3454017020 con 0x7f34640d1550 2023-12-20T04:46:22.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.470+0000 7f3469b99640 1 -- 172.21.15.132:0/85415157 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f345006a430 msgr2=0x7f345006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.470+0000 7f3469b99640 1 --2- 172.21.15.132:0/85415157 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f345006a430 0x7f345006c8f0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f3458036000 tx=0x7f345803b040 comp rx=0 tx=0).stop 2023-12-20T04:46:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.470+0000 7f3469b99640 1 -- 172.21.15.132:0/85415157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34640d1550 msgr2=0x7f34640cc950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.470+0000 7f3469b99640 1 --2- 172.21.15.132:0/85415157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34640d1550 0x7f34640cc950 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f345400c420 tx=0x7f345400c8e0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.471+0000 7f3469b99640 1 -- 172.21.15.132:0/85415157 shutdown_connections 2023-12-20T04:46:22.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.471+0000 7f3469b99640 1 --2- 172.21.15.132:0/85415157 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f345006a430 0x7f345006c8f0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.471+0000 7f3469b99640 1 --2- 172.21.15.132:0/85415157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f346415d300 0x7f34640c8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.471+0000 7f3469b99640 1 --2- 172.21.15.132:0/85415157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34640d1550 0x7f34640cc950 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.471+0000 7f3469b99640 1 --2- 172.21.15.132:0/85415157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34640cff90 0x7f346414a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.471+0000 7f3469b99640 1 -- 172.21.15.132:0/85415157 >> 172.21.15.132:0/85415157 conn(0x7f346406a3d0 msgr2=0x7f34640b60e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:22.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.472+0000 7f3469b99640 1 -- 172.21.15.132:0/85415157 shutdown_connections 2023-12-20T04:46:22.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.473+0000 7f3469b99640 1 -- 172.21.15.132:0/85415157 wait complete. 2023-12-20T04:46:22.489 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:46:22.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.586+0000 7f3f2037d640 1 Processor -- start 2023-12-20T04:46:22.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.586+0000 7f3f2037d640 1 -- start start 2023-12-20T04:46:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.587+0000 7f3f2037d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3f180cf0b0 0x7f3f180b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.587+0000 7f3f2037d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f180cb420 0x7f3f180d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.587+0000 7f3f2037d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f180cd740 con 0x7f3f1815e2d0 2023-12-20T04:46:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.587+0000 7f3f2037d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f180ce230 con 0x7f3f180cf0b0 2023-12-20T04:46:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.587+0000 7f3f2037d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f180cd990 con 0x7f3f180cb420 2023-12-20T04:46:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.587+0000 7f3f1d918640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3f180cf0b0 0x7f3f180b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.587+0000 7f3f1e91a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f180cb420 0x7f3f180d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.587+0000 7f3f1e119640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f3f1815e2d0 0x7f3f180ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:45864/0 (socket says 172.21.15.132:45864) 2023-12-20T04:46:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.587+0000 7f3f1e119640 1 -- 172.21.15.132:0/2923740356 learned_addr learned my addr 172.21.15.132:0/2923740356 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.587+0000 7f3f1e91a640 1 -- 172.21.15.132:0/2923740356 >> v2:172.21.15.187:3300/0 conn(0x7f3f180cf0b0 msgr2=0x7f3f180b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.587+0000 7f3f1e91a640 1 --2- 172.21.15.132:0/2923740356 >> v2:172.21.15.187:3300/0 conn(0x7f3f180cf0b0 0x7f3f180b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.587+0000 7f3f1e91a640 1 -- 172.21.15.132:0/2923740356 >> v1:172.21.15.187:6789/0 conn(0x7f3f1815e2d0 legacy=0x7f3f180ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.587+0000 7f3f1e91a640 1 -- 172.21.15.132:0/2923740356 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f180cdc70 con 0x7f3f180cb420 2023-12-20T04:46:22.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.587+0000 7f3f1d918640 1 --2- 172.21.15.132:0/2923740356 >> v2:172.21.15.187:3300/0 conn(0x7f3f180cf0b0 0x7f3f180b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:46:22.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.588+0000 7f3f1e91a640 1 --2- 172.21.15.132:0/2923740356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f180cb420 0x7f3f180d07f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3f10009d90 tx=0x7f3f1002be10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f77976d630efed7d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.588+0000 7f3f1d117640 1 -- 172.21.15.132:0/2923740356 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f1002cbc0 con 0x7f3f180cb420 2023-12-20T04:46:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.588+0000 7f3f1d117640 1 -- 172.21.15.132:0/2923740356 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f1002cd20 con 0x7f3f180cb420 2023-12-20T04:46:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.588+0000 7f3f1d117640 1 -- 172.21.15.132:0/2923740356 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f10034660 con 0x7f3f180cb420 2023-12-20T04:46:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.589+0000 7f3f2037d640 1 -- 172.21.15.132:0/2923740356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f180cb420 msgr2=0x7f3f180d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.589+0000 7f3f2037d640 1 --2- 172.21.15.132:0/2923740356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f180cb420 0x7f3f180d07f0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f3f10009d90 tx=0x7f3f1002be10 comp rx=0 tx=0).stop 2023-12-20T04:46:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.589+0000 7f3f2037d640 1 -- 172.21.15.132:0/2923740356 shutdown_connections 2023-12-20T04:46:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.589+0000 7f3f2037d640 1 --2- 172.21.15.132:0/2923740356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f180cb420 0x7f3f180d07f0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.589+0000 7f3f2037d640 1 --2- 172.21.15.132:0/2923740356 >> v2:172.21.15.187:3300/0 conn(0x7f3f180cf0b0 0x7f3f180b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.589+0000 7f3f2037d640 1 -- 172.21.15.132:0/2923740356 >> 172.21.15.132:0/2923740356 conn(0x7f3f1806d7c0 msgr2=0x7f3f1806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.589+0000 7f3f2037d640 1 -- 172.21.15.132:0/2923740356 shutdown_connections 2023-12-20T04:46:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.589+0000 7f3f2037d640 1 -- 172.21.15.132:0/2923740356 wait complete. 2023-12-20T04:46:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.590+0000 7f3f2037d640 1 Processor -- start 2023-12-20T04:46:22.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.590+0000 7f3f2037d640 1 -- start start 2023-12-20T04:46:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f2037d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f180cb420 0x7f3f181569c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f2037d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f180cf0b0 0x7f3f1814b210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f2037d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1815e2d0 0x7f3f180c61b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f2037d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f181565a0 con 0x7f3f180cb420 2023-12-20T04:46:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f2037d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f18158d80 con 0x7f3f1815e2d0 2023-12-20T04:46:22.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f2037d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f180c6de0 con 0x7f3f180cf0b0 2023-12-20T04:46:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f1e119640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f180cb420 0x7f3f181569c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f1e119640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f180cb420 0x7f3f181569c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37246/0 (socket says 172.21.15.132:37246) 2023-12-20T04:46:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f1e119640 1 -- 172.21.15.132:0/3527751463 learned_addr learned my addr 172.21.15.132:0/3527751463 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f1e91a640 1 --2- 172.21.15.132:0/3527751463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1815e2d0 0x7f3f180c61b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f1d918640 1 --2- 172.21.15.132:0/3527751463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f180cf0b0 0x7f3f1814b210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f1e119640 1 -- 172.21.15.132:0/3527751463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f180cf0b0 msgr2=0x7f3f1814b210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f1e119640 1 --2- 172.21.15.132:0/3527751463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f180cf0b0 0x7f3f1814b210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f1e119640 1 -- 172.21.15.132:0/3527751463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1815e2d0 msgr2=0x7f3f180c61b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f1e119640 1 --2- 172.21.15.132:0/3527751463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1815e2d0 0x7f3f180c61b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f1e119640 1 -- 172.21.15.132:0/3527751463 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f08009400 con 0x7f3f180cb420 2023-12-20T04:46:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f1d918640 1 --2- 172.21.15.132:0/3527751463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f180cf0b0 0x7f3f1814b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f1e91a640 1 --2- 172.21.15.132:0/3527751463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1815e2d0 0x7f3f180c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:22.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.591+0000 7f3f1e119640 1 --2- 172.21.15.132:0/3527751463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f180cb420 0x7f3f181569c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400c400 tx=0x7f3f1400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:22.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.592+0000 7f3f0effd640 1 -- 172.21.15.132:0/3527751463 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f14005ce0 con 0x7f3f180cb420 2023-12-20T04:46:22.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.592+0000 7f3f0effd640 1 -- 172.21.15.132:0/3527751463 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f14005e40 con 0x7f3f180cb420 2023-12-20T04:46:22.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.592+0000 7f3f0effd640 1 -- 172.21.15.132:0/3527751463 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f140072d0 con 0x7f3f180cb420 2023-12-20T04:46:22.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.592+0000 7f3f2037d640 1 -- 172.21.15.132:0/3527751463 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f10009a70 con 0x7f3f180cb420 2023-12-20T04:46:22.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.592+0000 7f3f2037d640 1 -- 172.21.15.132:0/3527751463 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f18155ee0 con 0x7f3f180cb420 2023-12-20T04:46:22.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.593+0000 7f3f2037d640 1 -- 172.21.15.132:0/3527751463 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f18066480 con 0x7f3f180cb420 2023-12-20T04:46:22.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.593+0000 7f3f0effd640 1 -- 172.21.15.132:0/3527751463 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3f140074f0 con 0x7f3f180cb420 2023-12-20T04:46:22.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.593+0000 7f3f0effd640 1 --2- 172.21.15.132:0/3527751463 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3efc06a430 0x7f3efc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:22.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.594+0000 7f3f0effd640 1 -- 172.21.15.132:0/3527751463 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f14087e90 con 0x7f3f180cb420 2023-12-20T04:46:22.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.594+0000 7f3f1d918640 1 --2- 172.21.15.132:0/3527751463 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3efc06a430 0x7f3efc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:22.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.594+0000 7f3f1d918640 1 --2- 172.21.15.132:0/3527751463 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3efc06a430 0x7f3efc06c8f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3f180cb3f0 tx=0x7f3f08008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:22.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.598+0000 7f3f0effd640 1 -- 172.21.15.132:0/3527751463 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3f14053510 con 0x7f3f180cb420 2023-12-20T04:46:22.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.762+0000 7f3f2037d640 1 -- 172.21.15.132:0/3527751463 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3f18156810 con 0x7f3f180cb420 2023-12-20T04:46:22.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.763+0000 7f3f0effd640 1 -- 172.21.15.132:0/3527751463 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16161 (secure 0 0 0) 0x7f3f14017090 con 0x7f3f180cb420 2023-12-20T04:46:22.765 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:22.766 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":81,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:46:22.459517+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:46:20.852337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-20T04:46:21.431144+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:46:22.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.766+0000 7f3f2037d640 1 -- 172.21.15.132:0/3527751463 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3efc06a430 msgr2=0x7f3efc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.766+0000 7f3f2037d640 1 --2- 172.21.15.132:0/3527751463 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3efc06a430 0x7f3efc06c8f0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7f3f180cb3f0 tx=0x7f3f08008040 comp rx=0 tx=0).stop 2023-12-20T04:46:22.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.766+0000 7f3f2037d640 1 -- 172.21.15.132:0/3527751463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f180cb420 msgr2=0x7f3f181569c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.766+0000 7f3f2037d640 1 --2- 172.21.15.132:0/3527751463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f180cb420 0x7f3f181569c0 secure :-1 s=READY pgs=871 cs=0 l=1 rev1=1 crypto rx=0x7f3f1400c400 tx=0x7f3f1400c8c0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.766+0000 7f3f2037d640 1 -- 172.21.15.132:0/3527751463 shutdown_connections 2023-12-20T04:46:22.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.766+0000 7f3f2037d640 1 --2- 172.21.15.132:0/3527751463 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3efc06a430 0x7f3efc06c8f0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.766+0000 7f3f2037d640 1 --2- 172.21.15.132:0/3527751463 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f1815e2d0 0x7f3f180c61b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.766+0000 7f3f2037d640 1 --2- 172.21.15.132:0/3527751463 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f180cf0b0 0x7f3f1814b210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.766+0000 7f3f2037d640 1 --2- 172.21.15.132:0/3527751463 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f180cb420 0x7f3f181569c0 unknown :-1 s=CLOSED pgs=871 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.766+0000 7f3f2037d640 1 -- 172.21.15.132:0/3527751463 >> 172.21.15.132:0/3527751463 conn(0x7f3f1806d7c0 msgr2=0x7f3f1806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:22.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.766+0000 7f3f2037d640 1 -- 172.21.15.132:0/3527751463 shutdown_connections 2023-12-20T04:46:22.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.766+0000 7f3f2037d640 1 -- 172.21.15.132:0/3527751463 wait complete. 2023-12-20T04:46:22.779 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:46:22.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.877+0000 7fca4c5ea640 1 Processor -- start 2023-12-20T04:46:22.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.877+0000 7fca4c5ea640 1 -- start start 2023-12-20T04:46:22.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.878+0000 7fca4c5ea640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4406f560 0x7fca4415f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:22.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.878+0000 7fca4c5ea640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fca4415f6b0 0x7fca4406b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:22.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.878+0000 7fca4c5ea640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fca440c9ab0 con 0x7fca4415ad70 2023-12-20T04:46:22.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.878+0000 7fca4c5ea640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca4415ea40 con 0x7fca4415f6b0 2023-12-20T04:46:22.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.878+0000 7fca4c5ea640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca440c9d90 con 0x7fca4406f560 2023-12-20T04:46:22.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.878+0000 7fca4ab87640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fca4415f6b0 0x7fca4406b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:22.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.878+0000 7fca4a386640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fca4415ad70 0x7fca440c92d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43676/0 (socket says 172.21.15.132:43676) 2023-12-20T04:46:22.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.878+0000 7fca4a386640 1 -- 172.21.15.132:0/2649776105 learned_addr learned my addr 172.21.15.132:0/2649776105 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:22.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.878+0000 7fca49b85640 1 --2- 172.21.15.132:0/2649776105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4406f560 0x7fca4415f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:22.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.878+0000 7fca4ab87640 1 -- 172.21.15.132:0/2649776105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4406f560 msgr2=0x7fca4415f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:22.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.878+0000 7fca4ab87640 1 --2- 172.21.15.132:0/2649776105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4406f560 0x7fca4415f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.878+0000 7fca4ab87640 1 -- 172.21.15.132:0/2649776105 >> v1:172.21.15.132:6789/0 conn(0x7fca4415ad70 legacy=0x7fca440c92d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.878+0000 7fca4ab87640 1 -- 172.21.15.132:0/2649776105 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca440ca070 con 0x7fca4415f6b0 2023-12-20T04:46:22.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.879+0000 7fca4ab87640 1 --2- 172.21.15.132:0/2649776105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4415f6b0 0x7fca4406b130 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009d90 tx=0x7fca3c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cb1f6cf3cbfa0b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:22.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.879+0000 7fca49384640 1 -- 172.21.15.132:0/2649776105 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c02cc50 con 0x7fca4415f6b0 2023-12-20T04:46:22.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.879+0000 7fca49384640 1 -- 172.21.15.132:0/2649776105 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca3c02cdb0 con 0x7fca4415f6b0 2023-12-20T04:46:22.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.879+0000 7fca49384640 1 -- 172.21.15.132:0/2649776105 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca3c034660 con 0x7fca4415f6b0 2023-12-20T04:46:22.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.879+0000 7fca4c5ea640 1 -- 172.21.15.132:0/2649776105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4415f6b0 msgr2=0x7fca4406b130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.879+0000 7fca4c5ea640 1 --2- 172.21.15.132:0/2649776105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4415f6b0 0x7fca4406b130 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7fca3c009d90 tx=0x7fca3c02bea0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.879+0000 7fca4c5ea640 1 -- 172.21.15.132:0/2649776105 shutdown_connections 2023-12-20T04:46:22.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.879+0000 7fca4c5ea640 1 --2- 172.21.15.132:0/2649776105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4415f6b0 0x7fca4406b130 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.879+0000 7fca4c5ea640 1 --2- 172.21.15.132:0/2649776105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4406f560 0x7fca4415f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.880+0000 7fca4c5ea640 1 -- 172.21.15.132:0/2649776105 >> 172.21.15.132:0/2649776105 conn(0x7fca440ced10 msgr2=0x7fca440cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:22.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.880+0000 7fca4c5ea640 1 -- 172.21.15.132:0/2649776105 shutdown_connections 2023-12-20T04:46:22.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.880+0000 7fca4c5ea640 1 -- 172.21.15.132:0/2649776105 wait complete. 2023-12-20T04:46:22.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.881+0000 7fca4c5ea640 1 Processor -- start 2023-12-20T04:46:22.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.881+0000 7fca4c5ea640 1 -- start start 2023-12-20T04:46:22.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.881+0000 7fca4c5ea640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4406f560 0x7fca441f1440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:22.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.881+0000 7fca4c5ea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4415ad70 0x7fca440c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:22.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.881+0000 7fca4c5ea640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca4415f6b0 0x7fca441f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:22.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.881+0000 7fca4c5ea640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca441f0a50 con 0x7fca4415ad70 2023-12-20T04:46:22.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.881+0000 7fca4c5ea640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca441f0fb0 con 0x7fca4415f6b0 2023-12-20T04:46:22.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.881+0000 7fca4c5ea640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca441f4a90 con 0x7fca4406f560 2023-12-20T04:46:22.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.881+0000 7fca49b85640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4415ad70 0x7fca440c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:22.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.881+0000 7fca49b85640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4415ad70 0x7fca440c75b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37266/0 (socket says 172.21.15.132:37266) 2023-12-20T04:46:22.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.881+0000 7fca49b85640 1 -- 172.21.15.132:0/2639569567 learned_addr learned my addr 172.21.15.132:0/2639569567 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:22.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.882+0000 7fca4a386640 1 --2- 172.21.15.132:0/2639569567 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4406f560 0x7fca441f1440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:22.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.882+0000 7fca4ab87640 1 --2- 172.21.15.132:0/2639569567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca4415f6b0 0x7fca441f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:22.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.882+0000 7fca49b85640 1 -- 172.21.15.132:0/2639569567 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4406f560 msgr2=0x7fca441f1440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.882+0000 7fca49b85640 1 --2- 172.21.15.132:0/2639569567 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4406f560 0x7fca441f1440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.882+0000 7fca49b85640 1 -- 172.21.15.132:0/2639569567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca4415f6b0 msgr2=0x7fca441f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:22.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.882+0000 7fca49b85640 1 --2- 172.21.15.132:0/2639569567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca4415f6b0 0x7fca441f4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:22.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.882+0000 7fca49b85640 1 -- 172.21.15.132:0/2639569567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca3c009a70 con 0x7fca4415ad70 2023-12-20T04:46:22.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.882+0000 7fca4ab87640 1 --2- 172.21.15.132:0/2639569567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca4415f6b0 0x7fca441f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:22.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.882+0000 7fca49b85640 1 --2- 172.21.15.132:0/2639569567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4415ad70 0x7fca440c75b0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fca3400d5f0 tx=0x7fca3400dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:22.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.882+0000 7fca3affd640 1 -- 172.21.15.132:0/2639569567 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca340125f0 con 0x7fca4415ad70 2023-12-20T04:46:22.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.882+0000 7fca3affd640 1 -- 172.21.15.132:0/2639569567 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca34012750 con 0x7fca4415ad70 2023-12-20T04:46:22.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.882+0000 7fca4c5ea640 1 -- 172.21.15.132:0/2639569567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca441f4d70 con 0x7fca4415ad70 2023-12-20T04:46:22.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.882+0000 7fca3affd640 1 -- 172.21.15.132:0/2639569567 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca34012b00 con 0x7fca4415ad70 2023-12-20T04:46:22.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.882+0000 7fca4c5ea640 1 -- 172.21.15.132:0/2639569567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca441f1980 con 0x7fca4415ad70 2023-12-20T04:46:22.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.883+0000 7fca4c5ea640 1 -- 172.21.15.132:0/2639569567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca441f1120 con 0x7fca4415ad70 2023-12-20T04:46:22.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.883+0000 7fca3affd640 1 -- 172.21.15.132:0/2639569567 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fca34012c60 con 0x7fca4415ad70 2023-12-20T04:46:22.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.884+0000 7fca3affd640 1 --2- 172.21.15.132:0/2639569567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca2806a430 0x7fca2806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:22.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.884+0000 7fca3affd640 1 -- 172.21.15.132:0/2639569567 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca34088d10 con 0x7fca4415ad70 2023-12-20T04:46:22.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.884+0000 7fca4a386640 1 --2- 172.21.15.132:0/2639569567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca2806a430 0x7fca2806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:22.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.884+0000 7fca4a386640 1 --2- 172.21.15.132:0/2639569567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca2806a430 0x7fca2806c8f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fca40005880 tx=0x7fca40009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:22.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:22.888+0000 7fca3affd640 1 -- 172.21.15.132:0/2639569567 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fca34054390 con 0x7fca4415ad70 2023-12-20T04:46:23.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.054+0000 7fca4c5ea640 1 -- 172.21.15.132:0/2639569567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fca4404e840 con 0x7fca4415ad70 2023-12-20T04:46:23.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.055+0000 7fca3affd640 1 -- 172.21.15.132:0/2639569567 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v81) v1 ==== 74+0+16161 (secure 0 0 0) 0x7fca340579b0 con 0x7fca4415ad70 2023-12-20T04:46:23.057 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:23.057 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":81,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:46:22.459517+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:46:20.852337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-20T04:46:21.431144+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:46:23.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.057+0000 7fca4c5ea640 1 -- 172.21.15.132:0/2639569567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca2806a430 msgr2=0x7fca2806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:23.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.057+0000 7fca4c5ea640 1 --2- 172.21.15.132:0/2639569567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca2806a430 0x7fca2806c8f0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7fca40005880 tx=0x7fca40009040 comp rx=0 tx=0).stop 2023-12-20T04:46:23.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.057+0000 7fca4c5ea640 1 -- 172.21.15.132:0/2639569567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4415ad70 msgr2=0x7fca440c75b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:23.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.057+0000 7fca4c5ea640 1 --2- 172.21.15.132:0/2639569567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4415ad70 0x7fca440c75b0 secure :-1 s=READY pgs=874 cs=0 l=1 rev1=1 crypto rx=0x7fca3400d5f0 tx=0x7fca3400dab0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.057+0000 7fca4c5ea640 1 -- 172.21.15.132:0/2639569567 shutdown_connections 2023-12-20T04:46:23.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.057+0000 7fca4c5ea640 1 --2- 172.21.15.132:0/2639569567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca2806a430 0x7fca2806c8f0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.057+0000 7fca4c5ea640 1 --2- 172.21.15.132:0/2639569567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca4415f6b0 0x7fca441f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.057+0000 7fca4c5ea640 1 --2- 172.21.15.132:0/2639569567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca4415ad70 0x7fca440c75b0 unknown :-1 s=CLOSED pgs=874 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.057+0000 7fca4c5ea640 1 --2- 172.21.15.132:0/2639569567 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca4406f560 0x7fca441f1440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.057+0000 7fca4c5ea640 1 -- 172.21.15.132:0/2639569567 >> 172.21.15.132:0/2639569567 conn(0x7fca440ced10 msgr2=0x7fca4406b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:23.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.057+0000 7fca4c5ea640 1 -- 172.21.15.132:0/2639569567 shutdown_connections 2023-12-20T04:46:23.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.057+0000 7fca4c5ea640 1 -- 172.21.15.132:0/2639569567 wait complete. 2023-12-20T04:46:23.070 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-20T04:46:23.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.172+0000 7fbffc1d2640 1 Processor -- start 2023-12-20T04:46:23.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.172+0000 7fbffc1d2640 1 -- start start 2023-12-20T04:46:23.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.173+0000 7fbffc1d2640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbff415d300 0x7fbff40d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:23.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.173+0000 7fbffc1d2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbff40d1550 0x7fbff40cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:23.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.173+0000 7fbffc1d2640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbff40d01d0 con 0x7fbff40cfdc0 2023-12-20T04:46:23.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.173+0000 7fbffc1d2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff40d1a90 con 0x7fbff40d1550 2023-12-20T04:46:23.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.173+0000 7fbffc1d2640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbff40d1d70 con 0x7fbff415d300 2023-12-20T04:46:23.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.173+0000 7fbff976d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbff40d1550 0x7fbff40cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:23.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.173+0000 7fbff976d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbff40d1550 0x7fbff40cf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37276/0 (socket says 172.21.15.132:37276) 2023-12-20T04:46:23.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.173+0000 7fbff976d640 1 -- 172.21.15.132:0/3733969414 learned_addr learned my addr 172.21.15.132:0/3733969414 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:23.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.173+0000 7fbff9f6e640 1 --2- 172.21.15.132:0/3733969414 >> v2:172.21.15.187:3300/0 conn(0x7fbff415d300 0x7fbff40d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:23.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.173+0000 7fbff976d640 1 -- 172.21.15.132:0/3733969414 >> v2:172.21.15.187:3300/0 conn(0x7fbff415d300 msgr2=0x7fbff40d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:23.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.173+0000 7fbff976d640 1 --2- 172.21.15.132:0/3733969414 >> v2:172.21.15.187:3300/0 conn(0x7fbff415d300 0x7fbff40d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.173+0000 7fbff976d640 1 -- 172.21.15.132:0/3733969414 >> v1:172.21.15.187:6789/0 conn(0x7fbff40cfdc0 legacy=0x7fbff40b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:23.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.173+0000 7fbff976d640 1 -- 172.21.15.132:0/3733969414 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbff40d2050 con 0x7fbff40d1550 2023-12-20T04:46:23.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.174+0000 7fbff976d640 1 --2- 172.21.15.132:0/3733969414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbff40d1550 0x7fbff40cf880 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fbff40cf850 tx=0x7fbfe402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6cd0dc6a5564dc2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:23.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.174+0000 7fbff8f6c640 1 -- 172.21.15.132:0/3733969414 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4004230 con 0x7fbff40d1550 2023-12-20T04:46:23.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.174+0000 7fbff8f6c640 1 -- 172.21.15.132:0/3733969414 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfe4004390 con 0x7fbff40d1550 2023-12-20T04:46:23.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.174+0000 7fbff8f6c640 1 -- 172.21.15.132:0/3733969414 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfe4003810 con 0x7fbff40d1550 2023-12-20T04:46:23.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.175+0000 7fbffc1d2640 1 -- 172.21.15.132:0/3733969414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbff40d1550 msgr2=0x7fbff40cf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:23.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.175+0000 7fbffc1d2640 1 --2- 172.21.15.132:0/3733969414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbff40d1550 0x7fbff40cf880 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fbff40cf850 tx=0x7fbfe402b8f0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.175+0000 7fbffc1d2640 1 -- 172.21.15.132:0/3733969414 shutdown_connections 2023-12-20T04:46:23.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.175+0000 7fbffc1d2640 1 --2- 172.21.15.132:0/3733969414 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbff40d1550 0x7fbff40cf880 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.175+0000 7fbffc1d2640 1 --2- 172.21.15.132:0/3733969414 >> v2:172.21.15.187:3300/0 conn(0x7fbff415d300 0x7fbff40d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.175+0000 7fbffc1d2640 1 -- 172.21.15.132:0/3733969414 >> 172.21.15.132:0/3733969414 conn(0x7fbff406a3d0 msgr2=0x7fbff406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:23.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.175+0000 7fbffc1d2640 1 -- 172.21.15.132:0/3733969414 shutdown_connections 2023-12-20T04:46:23.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.175+0000 7fbffc1d2640 1 -- 172.21.15.132:0/3733969414 wait complete. 2023-12-20T04:46:23.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.176+0000 7fbffc1d2640 1 Processor -- start 2023-12-20T04:46:23.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.176+0000 7fbffc1d2640 1 -- start start 2023-12-20T04:46:23.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbffc1d2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbff40cfdc0 0x7fbff40c9400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:23.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbffc1d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbff40d1550 0x7fbff414a210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:23.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbffc1d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbff415d300 0x7fbff40b4c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:23.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbffc1d2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff40b2970 con 0x7fbff415d300 2023-12-20T04:46:23.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbffc1d2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff4156c90 con 0x7fbff40cfdc0 2023-12-20T04:46:23.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbffc1d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbff4156f10 con 0x7fbff40d1550 2023-12-20T04:46:23.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbffa76f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbff415d300 0x7fbff40b4c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:23.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbffa76f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbff415d300 0x7fbff40b4c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37288/0 (socket says 172.21.15.132:37288) 2023-12-20T04:46:23.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbffa76f640 1 -- 172.21.15.132:0/714232487 learned_addr learned my addr 172.21.15.132:0/714232487 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:23.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbff976d640 1 --2- 172.21.15.132:0/714232487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbff40d1550 0x7fbff414a210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:23.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbff9f6e640 1 --2- 172.21.15.132:0/714232487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbff40cfdc0 0x7fbff40c9400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:23.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbffa76f640 1 -- 172.21.15.132:0/714232487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbff40d1550 msgr2=0x7fbff414a210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:23.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbffa76f640 1 --2- 172.21.15.132:0/714232487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbff40d1550 0x7fbff414a210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbffa76f640 1 -- 172.21.15.132:0/714232487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbff40cfdc0 msgr2=0x7fbff40c9400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:23.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbffa76f640 1 --2- 172.21.15.132:0/714232487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbff40cfdc0 0x7fbff40c9400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbffa76f640 1 -- 172.21.15.132:0/714232487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfe4009460 con 0x7fbff415d300 2023-12-20T04:46:23.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbffa76f640 1 --2- 172.21.15.132:0/714232487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbff415d300 0x7fbff40b4c20 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00b970 tx=0x7fbfec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:23.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbfea7fc640 1 -- 172.21.15.132:0/714232487 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec00cb40 con 0x7fbff415d300 2023-12-20T04:46:23.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.177+0000 7fbfea7fc640 1 -- 172.21.15.132:0/714232487 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbfec00cca0 con 0x7fbff415d300 2023-12-20T04:46:23.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.178+0000 7fbfea7fc640 1 -- 172.21.15.132:0/714232487 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbfec014680 con 0x7fbff415d300 2023-12-20T04:46:23.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.178+0000 7fbffc1d2640 1 -- 172.21.15.132:0/714232487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff41571f0 con 0x7fbff415d300 2023-12-20T04:46:23.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.178+0000 7fbffc1d2640 1 -- 172.21.15.132:0/714232487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff41574d0 con 0x7fbff415d300 2023-12-20T04:46:23.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.179+0000 7fbffc1d2640 1 -- 172.21.15.132:0/714232487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff40cede0 con 0x7fbff415d300 2023-12-20T04:46:23.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.179+0000 7fbfea7fc640 1 -- 172.21.15.132:0/714232487 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbfec01d3b0 con 0x7fbff415d300 2023-12-20T04:46:23.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.179+0000 7fbfea7fc640 1 --2- 172.21.15.132:0/714232487 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbfd806a430 0x7fbfd806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:23.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.179+0000 7fbfea7fc640 1 -- 172.21.15.132:0/714232487 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(81..81 src has 1..81) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbfec0887c0 con 0x7fbff415d300 2023-12-20T04:46:23.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.179+0000 7fbff9f6e640 1 --2- 172.21.15.132:0/714232487 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbfd806a430 0x7fbfd806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:23.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.180+0000 7fbff9f6e640 1 --2- 172.21.15.132:0/714232487 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbfd806a430 0x7fbfd806c8f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbff0006fd0 tx=0x7fbff0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:23.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.184+0000 7fbfea7fc640 1 -- 172.21.15.132:0/714232487 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbfec053db0 con 0x7fbff415d300 2023-12-20T04:46:23.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.384+0000 7fbffc1d2640 1 -- 172.21.15.132:0/714232487 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fbff404e840 con 0x7fbff415d300 2023-12-20T04:46:23.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.471+0000 7fbfea7fc640 1 -- 172.21.15.132:0/714232487 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v31) v1 ==== 118+0+0 (secure 0 0 0) 0x7fbfec0573d0 con 0x7fbff415d300 2023-12-20T04:46:23.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.473+0000 7fbffc1d2640 1 -- 172.21.15.132:0/714232487 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbfd806a430 msgr2=0x7fbfd806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:23.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.473+0000 7fbffc1d2640 1 --2- 172.21.15.132:0/714232487 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbfd806a430 0x7fbfd806c8f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7fbff0006fd0 tx=0x7fbff0008040 comp rx=0 tx=0).stop 2023-12-20T04:46:23.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.473+0000 7fbffc1d2640 1 -- 172.21.15.132:0/714232487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbff415d300 msgr2=0x7fbff40b4c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:23.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.473+0000 7fbffc1d2640 1 --2- 172.21.15.132:0/714232487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbff415d300 0x7fbff40b4c20 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fbfec00b970 tx=0x7fbfec00be30 comp rx=0 tx=0).stop 2023-12-20T04:46:23.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.473+0000 7fbffc1d2640 1 -- 172.21.15.132:0/714232487 shutdown_connections 2023-12-20T04:46:23.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.473+0000 7fbffc1d2640 1 --2- 172.21.15.132:0/714232487 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbfd806a430 0x7fbfd806c8f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.473+0000 7fbffc1d2640 1 --2- 172.21.15.132:0/714232487 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbff415d300 0x7fbff40b4c20 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.473+0000 7fbffc1d2640 1 --2- 172.21.15.132:0/714232487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbff40d1550 0x7fbff414a210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.473+0000 7fbffc1d2640 1 --2- 172.21.15.132:0/714232487 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbff40cfdc0 0x7fbff40c9400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.473+0000 7fbffc1d2640 1 -- 172.21.15.132:0/714232487 >> 172.21.15.132:0/714232487 conn(0x7fbff406a3d0 msgr2=0x7fbff40b75d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:23.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.473+0000 7fbffc1d2640 1 -- 172.21.15.132:0/714232487 shutdown_connections 2023-12-20T04:46:23.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.473+0000 7fbffc1d2640 1 -- 172.21.15.132:0/714232487 wait complete. 2023-12-20T04:46:23.486 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-20T04:46:23.486 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-20T04:46:23.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.586+0000 7fe8866cf640 1 Processor -- start 2023-12-20T04:46:23.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.586+0000 7fe8866cf640 1 -- start start 2023-12-20T04:46:23.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.587+0000 7fe8866cf640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe88015d300 0x7fe88006c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:23.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.587+0000 7fe8866cf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe8800cd4b0 0x7fe8800cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:23.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.587+0000 7fe8866cf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe88006cc90 con 0x7fe88015cf20 2023-12-20T04:46:23.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.587+0000 7fe8866cf640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8800cde60 con 0x7fe8800cd4b0 2023-12-20T04:46:23.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.587+0000 7fe8866cf640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe8800b2f30 con 0x7fe88015d300 2023-12-20T04:46:23.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.587+0000 7fe884c6c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe8800cd4b0 0x7fe8800cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:23.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.587+0000 7fe87ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe88015cf20 0x7fe880161700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43684/0 (socket says 172.21.15.132:43684) 2023-12-20T04:46:23.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.587+0000 7fe87ffff640 1 -- 172.21.15.132:0/174248376 learned_addr learned my addr 172.21.15.132:0/174248376 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:23.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.587+0000 7fe884c6c640 1 --2- 172.21.15.132:0/174248376 >> v2:172.21.15.132:3300/0 conn(0x7fe8800cd4b0 0x7fe8800cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37290/0 (socket says 172.21.15.132:37290) 2023-12-20T04:46:23.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.587+0000 7fe87f7fe640 1 --2- 172.21.15.132:0/174248376 >> v2:172.21.15.187:3300/0 conn(0x7fe88015d300 0x7fe88006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:23.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.587+0000 7fe884c6c640 1 -- 172.21.15.132:0/174248376 >> v2:172.21.15.187:3300/0 conn(0x7fe88015d300 msgr2=0x7fe88006c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:23.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.587+0000 7fe884c6c640 1 --2- 172.21.15.132:0/174248376 >> v2:172.21.15.187:3300/0 conn(0x7fe88015d300 0x7fe88006c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.587+0000 7fe884c6c640 1 -- 172.21.15.132:0/174248376 >> v1:172.21.15.132:6789/0 conn(0x7fe88015cf20 legacy=0x7fe880161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:23.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.587+0000 7fe884c6c640 1 -- 172.21.15.132:0/174248376 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe8800b3210 con 0x7fe8800cd4b0 2023-12-20T04:46:23.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.587+0000 7fe87f7fe640 1 --2- 172.21.15.132:0/174248376 >> v2:172.21.15.187:3300/0 conn(0x7fe88015d300 0x7fe88006c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:23.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.588+0000 7fe884c6c640 1 --2- 172.21.15.132:0/174248376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8800cd4b0 0x7fe8800cd920 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe88006bd40 tx=0x7fe87802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2236fece09b86e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:23.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.588+0000 7fe87effd640 1 -- 172.21.15.132:0/174248376 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe87802cc80 con 0x7fe8800cd4b0 2023-12-20T04:46:23.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.588+0000 7fe87effd640 1 -- 172.21.15.132:0/174248376 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe87802cde0 con 0x7fe8800cd4b0 2023-12-20T04:46:23.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.588+0000 7fe87effd640 1 -- 172.21.15.132:0/174248376 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe878034660 con 0x7fe8800cd4b0 2023-12-20T04:46:23.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.589+0000 7fe8866cf640 1 -- 172.21.15.132:0/174248376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8800cd4b0 msgr2=0x7fe8800cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:23.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.589+0000 7fe8866cf640 1 --2- 172.21.15.132:0/174248376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8800cd4b0 0x7fe8800cd920 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fe88006bd40 tx=0x7fe87802bed0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.589+0000 7fe8866cf640 1 -- 172.21.15.132:0/174248376 shutdown_connections 2023-12-20T04:46:23.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.589+0000 7fe8866cf640 1 --2- 172.21.15.132:0/174248376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8800cd4b0 0x7fe8800cd920 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.589+0000 7fe8866cf640 1 --2- 172.21.15.132:0/174248376 >> v2:172.21.15.187:3300/0 conn(0x7fe88015d300 0x7fe88006c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.589+0000 7fe8866cf640 1 -- 172.21.15.132:0/174248376 >> 172.21.15.132:0/174248376 conn(0x7fe880072c60 msgr2=0x7fe880073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:23.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.589+0000 7fe8866cf640 1 -- 172.21.15.132:0/174248376 shutdown_connections 2023-12-20T04:46:23.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.589+0000 7fe8866cf640 1 -- 172.21.15.132:0/174248376 wait complete. 2023-12-20T04:46:23.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.590+0000 7fe8866cf640 1 Processor -- start 2023-12-20T04:46:23.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.590+0000 7fe8866cf640 1 -- start start 2023-12-20T04:46:23.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe8866cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8800cd4b0 0x7fe8800c5ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:23.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe8866cf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe88015cf20 0x7fe8800af390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:23.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe8866cf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe88015d300 0x7fe88015a790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:23.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe8866cf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800c5710 con 0x7fe8800cd4b0 2023-12-20T04:46:23.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe8866cf640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800c4b00 con 0x7fe88015d300 2023-12-20T04:46:23.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe8866cf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe8800c4de0 con 0x7fe88015cf20 2023-12-20T04:46:23.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe87ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8800cd4b0 0x7fe8800c5ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:23.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe87ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8800cd4b0 0x7fe8800c5ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37292/0 (socket says 172.21.15.132:37292) 2023-12-20T04:46:23.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe87ffff640 1 -- 172.21.15.132:0/3818721255 learned_addr learned my addr 172.21.15.132:0/3818721255 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:23.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe884c6c640 1 --2- 172.21.15.132:0/3818721255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe88015d300 0x7fe88015a790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:23.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe87ffff640 1 -- 172.21.15.132:0/3818721255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe88015cf20 msgr2=0x7fe8800af390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:23.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe87f7fe640 1 --2- 172.21.15.132:0/3818721255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe88015cf20 0x7fe8800af390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:23.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe87ffff640 1 --2- 172.21.15.132:0/3818721255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe88015cf20 0x7fe8800af390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe87ffff640 1 -- 172.21.15.132:0/3818721255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe88015d300 msgr2=0x7fe88015a790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:23.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe87ffff640 1 --2- 172.21.15.132:0/3818721255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe88015d300 0x7fe88015a790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:23.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe87ffff640 1 -- 172.21.15.132:0/3818721255 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe878009a70 con 0x7fe8800cd4b0 2023-12-20T04:46:23.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe87ffff640 1 --2- 172.21.15.132:0/3818721255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8800cd4b0 0x7fe8800c5ba0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe87000c4a0 tx=0x7fe87000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:23.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe87cff9640 1 -- 172.21.15.132:0/3818721255 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe870005ce0 con 0x7fe8800cd4b0 2023-12-20T04:46:23.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe87cff9640 1 -- 172.21.15.132:0/3818721255 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe870005e40 con 0x7fe8800cd4b0 2023-12-20T04:46:23.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe8866cf640 1 -- 172.21.15.132:0/3818721255 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe8800c50c0 con 0x7fe8800cd4b0 2023-12-20T04:46:23.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe87cff9640 1 -- 172.21.15.132:0/3818721255 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe870007270 con 0x7fe8800cd4b0 2023-12-20T04:46:23.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.591+0000 7fe8866cf640 1 -- 172.21.15.132:0/3818721255 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe8800c4790 con 0x7fe8800cd4b0 2023-12-20T04:46:23.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.592+0000 7fe8866cf640 1 -- 172.21.15.132:0/3818721255 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe88004e840 con 0x7fe8800cd4b0 2023-12-20T04:46:23.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.593+0000 7fe87cff9640 1 -- 172.21.15.132:0/3818721255 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe870007490 con 0x7fe8800cd4b0 2023-12-20T04:46:23.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.593+0000 7fe87cff9640 1 --2- 172.21.15.132:0/3818721255 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe86c06a430 0x7fe86c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:23.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.593+0000 7fe87cff9640 1 -- 172.21.15.132:0/3818721255 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe870087d40 con 0x7fe8800cd4b0 2023-12-20T04:46:23.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.593+0000 7fe87f7fe640 1 --2- 172.21.15.132:0/3818721255 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe86c06a430 0x7fe86c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:23.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.594+0000 7fe87f7fe640 1 --2- 172.21.15.132:0/3818721255 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe86c06a430 0x7fe86c06c8f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe8800c7cc0 tx=0x7fe874008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:23.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.598+0000 7fe87cff9640 1 -- 172.21.15.132:0/3818721255 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe8700533e0 con 0x7fe8800cd4b0 2023-12-20T04:46:23.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:23.797+0000 7fe8866cf640 1 -- 172.21.15.132:0/3818721255 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fe8800b2890 con 0x7fe8800cd4b0 2023-12-20T04:46:24.111 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-12-20T04:46:24.110+0000 7fab1ebd3640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:46:24.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.473+0000 7fe87cff9640 1 -- 172.21.15.132:0/3818721255 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v32) v1 ==== 122+0+0 (secure 0 0 0) 0x7fe8700170c0 con 0x7fe8800cd4b0 2023-12-20T04:46:24.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.475+0000 7fe8866cf640 1 -- 172.21.15.132:0/3818721255 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe86c06a430 msgr2=0x7fe86c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:24.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.475+0000 7fe8866cf640 1 --2- 172.21.15.132:0/3818721255 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe86c06a430 0x7fe86c06c8f0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7fe8800c7cc0 tx=0x7fe874008040 comp rx=0 tx=0).stop 2023-12-20T04:46:24.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.475+0000 7fe8866cf640 1 -- 172.21.15.132:0/3818721255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8800cd4b0 msgr2=0x7fe8800c5ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:24.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.475+0000 7fe8866cf640 1 --2- 172.21.15.132:0/3818721255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8800cd4b0 0x7fe8800c5ba0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fe87000c4a0 tx=0x7fe87000c960 comp rx=0 tx=0).stop 2023-12-20T04:46:24.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.475+0000 7fe8866cf640 1 -- 172.21.15.132:0/3818721255 shutdown_connections 2023-12-20T04:46:24.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.475+0000 7fe8866cf640 1 --2- 172.21.15.132:0/3818721255 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe86c06a430 0x7fe86c06c8f0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.475+0000 7fe8866cf640 1 --2- 172.21.15.132:0/3818721255 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe88015d300 0x7fe88015a790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.475+0000 7fe8866cf640 1 --2- 172.21.15.132:0/3818721255 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe88015cf20 0x7fe8800af390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.475+0000 7fe8866cf640 1 --2- 172.21.15.132:0/3818721255 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe8800cd4b0 0x7fe8800c5ba0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.475+0000 7fe8866cf640 1 -- 172.21.15.132:0/3818721255 >> 172.21.15.132:0/3818721255 conn(0x7fe880072c60 msgr2=0x7fe88015bd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:24.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.475+0000 7fe8866cf640 1 -- 172.21.15.132:0/3818721255 shutdown_connections 2023-12-20T04:46:24.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.475+0000 7fe8866cf640 1 -- 172.21.15.132:0/3818721255 wait complete. 2023-12-20T04:46:24.490 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-20T04:46:24.490 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:46:24.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.589+0000 7f032039f640 1 Processor -- start 2023-12-20T04:46:24.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.589+0000 7f032039f640 1 -- start start 2023-12-20T04:46:24.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.590+0000 7f032039f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0318159b50 0x7f03180c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:24.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.590+0000 7f032039f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03180ccf30 con 0x7f031806c240 2023-12-20T04:46:24.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.590+0000 7f032039f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03180ca1c0 con 0x7f031815e530 2023-12-20T04:46:24.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.590+0000 7f032039f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03180caa60 con 0x7f0318159b50 2023-12-20T04:46:24.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.590+0000 7f031e93c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f031806c240 0x7f03180cd3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43700/0 (socket says 172.21.15.132:43700) 2023-12-20T04:46:24.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.590+0000 7f031e93c640 1 -- 172.21.15.132:0/1194226171 learned_addr learned my addr 172.21.15.132:0/1194226171 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:24.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.590+0000 7f031d139640 1 -- 172.21.15.132:0/1194226171 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 755837676 0 0) 0x7f03180ccf30 con 0x7f031806c240 2023-12-20T04:46:24.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.590+0000 7f031d139640 1 -- 172.21.15.132:0/1194226171 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0304003520 con 0x7f031806c240 2023-12-20T04:46:24.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.590+0000 7f031e13b640 1 --2- 172.21.15.132:0/1194226171 >> v2:172.21.15.187:3300/0 conn(0x7f0318159b50 0x7f03180c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:24.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031d139640 1 -- 172.21.15.132:0/1194226171 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1159282719 0 0) 0x7f0304003520 con 0x7f031806c240 2023-12-20T04:46:24.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031d139640 1 -- 172.21.15.132:0/1194226171 >> v2:172.21.15.187:3300/0 conn(0x7f0318159b50 msgr2=0x7f03180c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:24.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031d139640 1 --2- 172.21.15.132:0/1194226171 >> v2:172.21.15.187:3300/0 conn(0x7f0318159b50 0x7f03180c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031d139640 1 -- 172.21.15.132:0/1194226171 >> v1:172.21.15.187:6789/0 conn(0x7f031815e530 legacy=0x7f031806fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:24.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031d139640 1 -- 172.21.15.132:0/1194226171 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03180ca4a0 con 0x7f031806c240 2023-12-20T04:46:24.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031d139640 1 -- 172.21.15.132:0/1194226171 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f03100019f0 con 0x7f031806c240 2023-12-20T04:46:24.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031d139640 1 -- 172.21.15.132:0/1194226171 >> v1:172.21.15.132:6789/0 conn(0x7f031806c240 legacy=0x7f03180cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:24.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031d139640 1 --2- 172.21.15.132:0/1194226171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0304003970 0x7f0304003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:24.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031d139640 1 --2- 172.21.15.132:0/1194226171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03040047c0 0x7f0304004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:24.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031d139640 1 --2- 172.21.15.132:0/1194226171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0304005180 0x7f030400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:24.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031d139640 1 -- 172.21.15.132:0/1194226171 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03180caa60 con 0x7f0304003970 2023-12-20T04:46:24.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031d139640 1 -- 172.21.15.132:0/1194226171 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f030400c020 con 0x7f0304005180 2023-12-20T04:46:24.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031d139640 1 -- 172.21.15.132:0/1194226171 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f030400c1e0 con 0x7f03040047c0 2023-12-20T04:46:24.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031e13b640 1 --2- 172.21.15.132:0/1194226171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0304003970 0x7f0304003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:24.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031e93c640 1 --2- 172.21.15.132:0/1194226171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0304005180 0x7f030400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:24.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031d93a640 1 --2- 172.21.15.132:0/1194226171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03040047c0 0x7f0304004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:24.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031e13b640 1 -- 172.21.15.132:0/1194226171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03040047c0 msgr2=0x7f0304004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:24.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031e13b640 1 --2- 172.21.15.132:0/1194226171 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03040047c0 0x7f0304004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031e13b640 1 -- 172.21.15.132:0/1194226171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0304005180 msgr2=0x7f030400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:24.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031e13b640 1 --2- 172.21.15.132:0/1194226171 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0304005180 0x7f030400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031e13b640 1 -- 172.21.15.132:0/1194226171 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0304003520 con 0x7f0304003970 2023-12-20T04:46:24.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.591+0000 7f031e93c640 1 -- 172.21.15.132:0/1194226171 reap_dead start 2023-12-20T04:46:24.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.592+0000 7f031e13b640 1 --2- 172.21.15.132:0/1194226171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0304003970 0x7f0304003d90 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0314009ac0 tx=0x7f03040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f47f8d65f2519d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:24.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.592+0000 7f031d139640 1 -- 172.21.15.132:0/1194226171 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031402c6b0 con 0x7f0304003970 2023-12-20T04:46:24.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.592+0000 7f031d139640 1 -- 172.21.15.132:0/1194226171 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f031402c810 con 0x7f0304003970 2023-12-20T04:46:24.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.592+0000 7f031d139640 1 -- 172.21.15.132:0/1194226171 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f031402cba0 con 0x7f0304003970 2023-12-20T04:46:24.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.593+0000 7f032039f640 1 -- 172.21.15.132:0/1194226171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0304003970 msgr2=0x7f0304003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:24.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.593+0000 7f032039f640 1 --2- 172.21.15.132:0/1194226171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0304003970 0x7f0304003d90 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7f0314009ac0 tx=0x7f03040057f0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.593+0000 7f032039f640 1 -- 172.21.15.132:0/1194226171 shutdown_connections 2023-12-20T04:46:24.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.593+0000 7f032039f640 1 --2- 172.21.15.132:0/1194226171 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0304003970 0x7f0304003d90 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.593+0000 7f032039f640 1 -- 172.21.15.132:0/1194226171 >> 172.21.15.132:0/1194226171 conn(0x7f03180ced10 msgr2=0x7f03180cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:24.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.593+0000 7f032039f640 1 -- 172.21.15.132:0/1194226171 shutdown_connections 2023-12-20T04:46:24.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.593+0000 7f032039f640 1 -- 172.21.15.132:0/1194226171 wait complete. 2023-12-20T04:46:24.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.594+0000 7f032039f640 1 Processor -- start 2023-12-20T04:46:24.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.594+0000 7f032039f640 1 -- start start 2023-12-20T04:46:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f032039f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0304003970 0x7f031815db40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f032039f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03180b1220 0x7f03180c9620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f032039f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03181f5dd0 0x7f031806fd30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f032039f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03180c8bf0 con 0x7f0304003970 2023-12-20T04:46:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f032039f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f031815e080 con 0x7f03180b1220 2023-12-20T04:46:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f032039f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f03181f6d00 con 0x7f03181f5dd0 2023-12-20T04:46:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f031e13b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0304003970 0x7f031815db40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f031e13b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0304003970 0x7f031815db40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37322/0 (socket says 172.21.15.132:37322) 2023-12-20T04:46:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f031e13b640 1 -- 172.21.15.132:0/92360504 learned_addr learned my addr 172.21.15.132:0/92360504 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f031d93a640 1 --2- 172.21.15.132:0/92360504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03180b1220 0x7f03180c9620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f031e93c640 1 --2- 172.21.15.132:0/92360504 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03181f5dd0 0x7f031806fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f031e13b640 1 -- 172.21.15.132:0/92360504 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03181f5dd0 msgr2=0x7f031806fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f031e13b640 1 --2- 172.21.15.132:0/92360504 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03181f5dd0 0x7f031806fd30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f031e13b640 1 -- 172.21.15.132:0/92360504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03180b1220 msgr2=0x7f03180c9620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f031e13b640 1 --2- 172.21.15.132:0/92360504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03180b1220 0x7f03180c9620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f031e13b640 1 -- 172.21.15.132:0/92360504 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03180c9190 con 0x7f0304003970 2023-12-20T04:46:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f031d93a640 1 --2- 172.21.15.132:0/92360504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03180b1220 0x7f03180c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f031e93c640 1 --2- 172.21.15.132:0/92360504 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03181f5dd0 0x7f031806fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f031e13b640 1 --2- 172.21.15.132:0/92360504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0304003970 0x7f031815db40 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f031402c250 tx=0x7f0314004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f030effd640 1 -- 172.21.15.132:0/92360504 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314003810 con 0x7f0304003970 2023-12-20T04:46:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f030effd640 1 -- 172.21.15.132:0/92360504 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0314003970 con 0x7f0304003970 2023-12-20T04:46:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f032039f640 1 -- 172.21.15.132:0/92360504 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03181f6740 con 0x7f0304003970 2023-12-20T04:46:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f030effd640 1 -- 172.21.15.132:0/92360504 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0314003d00 con 0x7f0304003970 2023-12-20T04:46:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.595+0000 7f032039f640 1 -- 172.21.15.132:0/92360504 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03180c8e20 con 0x7f0304003970 2023-12-20T04:46:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.596+0000 7f032039f640 1 -- 172.21.15.132:0/92360504 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03180c8fb0 con 0x7f0304003970 2023-12-20T04:46:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.597+0000 7f030effd640 1 -- 172.21.15.132:0/92360504 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0314034440 con 0x7f0304003970 2023-12-20T04:46:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.597+0000 7f030effd640 1 --2- 172.21.15.132:0/92360504 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f02fc06a430 0x7f02fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:24.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.597+0000 7f030effd640 1 -- 172.21.15.132:0/92360504 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f03140aab60 con 0x7f0304003970 2023-12-20T04:46:24.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.597+0000 7f031d93a640 1 --2- 172.21.15.132:0/92360504 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f02fc06a430 0x7f02fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:24.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.597+0000 7f031d93a640 1 --2- 172.21.15.132:0/92360504 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f02fc06a430 0x7f02fc06c8f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f03180c6070 tx=0x7f0308009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:24.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.601+0000 7f030effd640 1 -- 172.21.15.132:0/92360504 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0314076200 con 0x7f0304003970 2023-12-20T04:46:24.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.801+0000 7f032039f640 1 -- 172.21.15.132:0/92360504 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f031804e840 con 0x7f0304003970 2023-12-20T04:46:24.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.801+0000 7f030effd640 1 -- 172.21.15.132:0/92360504 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f031404c090 con 0x7f0304003970 2023-12-20T04:46:24.804 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:24.804 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":32,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2337953767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2337953767},{"type":"v1","addr":"172.21.15.187:6835","nonce":2337953767}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6540,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/41640576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":41640576},{"type":"v1","addr":"172.21.15.132:6836","nonce":41640576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6543,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2936157584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2936157584},{"type":"v1","addr":"172.21.15.132:6837","nonce":2936157584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:46:22.459815+0000","modified":"2023-12-20T04:46:24.470923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6552":{"gid":6552,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6833/3732620607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3732620607},{"type":"v1","addr":"172.21.15.187:6833","nonce":3732620607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-20T04:46:24.804 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 32 2023-12-20T04:46:24.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.803+0000 7f032039f640 1 -- 172.21.15.132:0/92360504 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f02fc06a430 msgr2=0x7f02fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:24.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.803+0000 7f032039f640 1 --2- 172.21.15.132:0/92360504 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f02fc06a430 0x7f02fc06c8f0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f03180c6070 tx=0x7f0308009040 comp rx=0 tx=0).stop 2023-12-20T04:46:24.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.803+0000 7f032039f640 1 -- 172.21.15.132:0/92360504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0304003970 msgr2=0x7f031815db40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:24.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.803+0000 7f032039f640 1 --2- 172.21.15.132:0/92360504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0304003970 0x7f031815db40 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7f031402c250 tx=0x7f0314004730 comp rx=0 tx=0).stop 2023-12-20T04:46:24.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.803+0000 7f032039f640 1 -- 172.21.15.132:0/92360504 shutdown_connections 2023-12-20T04:46:24.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.803+0000 7f032039f640 1 --2- 172.21.15.132:0/92360504 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f02fc06a430 0x7f02fc06c8f0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.803+0000 7f032039f640 1 --2- 172.21.15.132:0/92360504 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f03181f5dd0 0x7f031806fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.803+0000 7f032039f640 1 --2- 172.21.15.132:0/92360504 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03180b1220 0x7f03180c9620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.803+0000 7f032039f640 1 --2- 172.21.15.132:0/92360504 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0304003970 0x7f031815db40 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.803+0000 7f032039f640 1 -- 172.21.15.132:0/92360504 >> 172.21.15.132:0/92360504 conn(0x7f03180ced10 msgr2=0x7f03180b1960 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:24.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.803+0000 7f032039f640 1 -- 172.21.15.132:0/92360504 shutdown_connections 2023-12-20T04:46:24.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.803+0000 7f032039f640 1 -- 172.21.15.132:0/92360504 wait complete. 2023-12-20T04:46:24.816 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:46:24.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.914+0000 7f4c22ece640 1 Processor -- start 2023-12-20T04:46:24.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.914+0000 7f4c22ece640 1 -- start start 2023-12-20T04:46:24.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.915+0000 7f4c22ece640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4c1c15d100 0x7f4c1c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:24.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.915+0000 7f4c22ece640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4c1c0cdc10 0x7f4c1c06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:24.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.915+0000 7f4c22ece640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c1c0b2f90 con 0x7f4c1c0d0370 2023-12-20T04:46:24.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.915+0000 7f4c22ece640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c1613c0 con 0x7f4c1c0cdc10 2023-12-20T04:46:24.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.915+0000 7f4c22ece640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c1c0d1b00 con 0x7f4c1c15d100 2023-12-20T04:46:24.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.915+0000 7f4c2146b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4c1c0cdc10 0x7f4c1c06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:24.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.915+0000 7f4c2146b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4c1c0cdc10 0x7f4c1c06c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37330/0 (socket says 172.21.15.132:37330) 2023-12-20T04:46:24.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.915+0000 7f4c2146b640 1 -- 172.21.15.132:0/1191639918 learned_addr learned my addr 172.21.15.132:0/1191639918 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:24.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.916+0000 7f4c2146b640 1 -- 172.21.15.132:0/1191639918 >> v2:172.21.15.187:3300/0 conn(0x7f4c1c15d100 msgr2=0x7f4c1c0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:24.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.916+0000 7f4c2146b640 1 --2- 172.21.15.132:0/1191639918 >> v2:172.21.15.187:3300/0 conn(0x7f4c1c15d100 0x7f4c1c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.916+0000 7f4c2146b640 1 -- 172.21.15.132:0/1191639918 >> v1:172.21.15.187:6789/0 conn(0x7f4c1c0d0370 legacy=0x7f4c1c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:24.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.916+0000 7f4c2146b640 1 -- 172.21.15.132:0/1191639918 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c1c0d0810 con 0x7f4c1c0cdc10 2023-12-20T04:46:24.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.916+0000 7f4c2146b640 1 --2- 172.21.15.132:0/1191639918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c0cdc10 0x7f4c1c06c190 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c06e5e0 tx=0x7f4c1402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14fc91c34f998431 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:24.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.916+0000 7f4c1b7fe640 1 -- 172.21.15.132:0/1191639918 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c1402ca80 con 0x7f4c1c0cdc10 2023-12-20T04:46:24.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.916+0000 7f4c1b7fe640 1 -- 172.21.15.132:0/1191639918 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c1402cbe0 con 0x7f4c1c0cdc10 2023-12-20T04:46:24.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.916+0000 7f4c1b7fe640 1 -- 172.21.15.132:0/1191639918 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c140343f0 con 0x7f4c1c0cdc10 2023-12-20T04:46:24.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.917+0000 7f4c22ece640 1 -- 172.21.15.132:0/1191639918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c0cdc10 msgr2=0x7f4c1c06c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:24.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.917+0000 7f4c22ece640 1 --2- 172.21.15.132:0/1191639918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c0cdc10 0x7f4c1c06c190 secure :-1 s=READY pgs=883 cs=0 l=1 rev1=1 crypto rx=0x7f4c1c06e5e0 tx=0x7f4c1402bee0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.917+0000 7f4c22ece640 1 -- 172.21.15.132:0/1191639918 shutdown_connections 2023-12-20T04:46:24.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.917+0000 7f4c22ece640 1 --2- 172.21.15.132:0/1191639918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c0cdc10 0x7f4c1c06c190 unknown :-1 s=CLOSED pgs=883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.917+0000 7f4c22ece640 1 --2- 172.21.15.132:0/1191639918 >> v2:172.21.15.187:3300/0 conn(0x7f4c1c15d100 0x7f4c1c0b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.917+0000 7f4c22ece640 1 -- 172.21.15.132:0/1191639918 >> 172.21.15.132:0/1191639918 conn(0x7f4c1c06d7c0 msgr2=0x7f4c1c06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:24.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.917+0000 7f4c22ece640 1 -- 172.21.15.132:0/1191639918 shutdown_connections 2023-12-20T04:46:24.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.917+0000 7f4c22ece640 1 -- 172.21.15.132:0/1191639918 wait complete. 2023-12-20T04:46:24.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.918+0000 7f4c22ece640 1 Processor -- start 2023-12-20T04:46:24.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.918+0000 7f4c22ece640 1 -- start start 2023-12-20T04:46:24.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.919+0000 7f4c22ece640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1c0cdc10 0x7f4c1c1f5e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:24.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.919+0000 7f4c22ece640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c0d0370 0x7f4c1c0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:24.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.919+0000 7f4c22ece640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c1c15d100 0x7f4c1c0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:24.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.919+0000 7f4c22ece640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0c8820 con 0x7f4c1c0d0370 2023-12-20T04:46:24.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.919+0000 7f4c22ece640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c1f6350 con 0x7f4c1c15d100 2023-12-20T04:46:24.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.919+0000 7f4c22ece640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1c0c7ea0 con 0x7f4c1c0cdc10 2023-12-20T04:46:24.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.919+0000 7f4c1bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c0d0370 0x7f4c1c0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:24.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.919+0000 7f4c1bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c0d0370 0x7f4c1c0b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37340/0 (socket says 172.21.15.132:37340) 2023-12-20T04:46:24.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.919+0000 7f4c1bfff640 1 -- 172.21.15.132:0/4110363190 learned_addr learned my addr 172.21.15.132:0/4110363190 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:24.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.919+0000 7f4c2146b640 1 --2- 172.21.15.132:0/4110363190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c1c15d100 0x7f4c1c0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:24.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.919+0000 7f4c20c6a640 1 --2- 172.21.15.132:0/4110363190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1c0cdc10 0x7f4c1c1f5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:24.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.920+0000 7f4c1bfff640 1 -- 172.21.15.132:0/4110363190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1c0cdc10 msgr2=0x7f4c1c1f5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:24.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.920+0000 7f4c1bfff640 1 --2- 172.21.15.132:0/4110363190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1c0cdc10 0x7f4c1c1f5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.920+0000 7f4c1bfff640 1 -- 172.21.15.132:0/4110363190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c1c15d100 msgr2=0x7f4c1c0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:24.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.920+0000 7f4c1bfff640 1 --2- 172.21.15.132:0/4110363190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c1c15d100 0x7f4c1c0b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:24.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.920+0000 7f4c1bfff640 1 -- 172.21.15.132:0/4110363190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c14009b30 con 0x7f4c1c0d0370 2023-12-20T04:46:24.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.920+0000 7f4c1bfff640 1 --2- 172.21.15.132:0/4110363190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c0d0370 0x7f4c1c0b39f0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000c410 tx=0x7f4c1000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:24.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.920+0000 7f4c197fa640 1 -- 172.21.15.132:0/4110363190 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c100035f0 con 0x7f4c1c0d0370 2023-12-20T04:46:24.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.920+0000 7f4c197fa640 1 -- 172.21.15.132:0/4110363190 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c10003750 con 0x7f4c1c0d0370 2023-12-20T04:46:24.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.920+0000 7f4c22ece640 1 -- 172.21.15.132:0/4110363190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c1c15fdf0 con 0x7f4c1c0d0370 2023-12-20T04:46:24.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.920+0000 7f4c197fa640 1 -- 172.21.15.132:0/4110363190 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c10003b40 con 0x7f4c1c0d0370 2023-12-20T04:46:24.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.920+0000 7f4c22ece640 1 -- 172.21.15.132:0/4110363190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c1c0c8440 con 0x7f4c1c0d0370 2023-12-20T04:46:24.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.921+0000 7f4c22ece640 1 -- 172.21.15.132:0/4110363190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c1c04e840 con 0x7f4c1c0d0370 2023-12-20T04:46:24.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.921+0000 7f4c197fa640 1 -- 172.21.15.132:0/4110363190 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4c10003ca0 con 0x7f4c1c0d0370 2023-12-20T04:46:24.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.922+0000 7f4c197fa640 1 --2- 172.21.15.132:0/4110363190 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c0806a430 0x7f4c0806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:24.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.922+0000 7f4c197fa640 1 -- 172.21.15.132:0/4110363190 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c10087e20 con 0x7f4c1c0d0370 2023-12-20T04:46:24.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.922+0000 7f4c20c6a640 1 --2- 172.21.15.132:0/4110363190 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c0806a430 0x7f4c0806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:24.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.922+0000 7f4c20c6a640 1 --2- 172.21.15.132:0/4110363190 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c0806a430 0x7f4c0806c8f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0098e0 tx=0x7f4c0c009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:24.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:24.926+0000 7f4c197fa640 1 -- 172.21.15.132:0/4110363190 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4c10053550 con 0x7f4c1c0d0370 2023-12-20T04:46:25.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.095+0000 7f4c22ece640 1 -- 172.21.15.132:0/4110363190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c1c0b6a20 con 0x7f4c1c0d0370 2023-12-20T04:46:25.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.096+0000 7f4c197fa640 1 -- 172.21.15.132:0/4110363190 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v82) v1 ==== 74+0+16148 (secure 0 0 0) 0x7f4c10017090 con 0x7f4c1c0d0370 2023-12-20T04:46:25.099 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:25.099 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":82,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:46:23.461249+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"72","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:46:20.852337+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"81","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-20T04:46:21.431144+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"82","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:46:25.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.099+0000 7f4c22ece640 1 -- 172.21.15.132:0/4110363190 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c0806a430 msgr2=0x7f4c0806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.099+0000 7f4c22ece640 1 --2- 172.21.15.132:0/4110363190 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c0806a430 0x7f4c0806c8f0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f4c0c0098e0 tx=0x7f4c0c009060 comp rx=0 tx=0).stop 2023-12-20T04:46:25.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.099+0000 7f4c22ece640 1 -- 172.21.15.132:0/4110363190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c0d0370 msgr2=0x7f4c1c0b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.099+0000 7f4c22ece640 1 --2- 172.21.15.132:0/4110363190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c0d0370 0x7f4c1c0b39f0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f4c1000c410 tx=0x7f4c1000c8d0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.099+0000 7f4c22ece640 1 -- 172.21.15.132:0/4110363190 shutdown_connections 2023-12-20T04:46:25.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.099+0000 7f4c22ece640 1 --2- 172.21.15.132:0/4110363190 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c0806a430 0x7f4c0806c8f0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.099+0000 7f4c22ece640 1 --2- 172.21.15.132:0/4110363190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c1c15d100 0x7f4c1c0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.099+0000 7f4c22ece640 1 --2- 172.21.15.132:0/4110363190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1c0d0370 0x7f4c1c0b39f0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.099+0000 7f4c22ece640 1 --2- 172.21.15.132:0/4110363190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1c0cdc10 0x7f4c1c1f5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.099+0000 7f4c22ece640 1 -- 172.21.15.132:0/4110363190 >> 172.21.15.132:0/4110363190 conn(0x7f4c1c06d7c0 msgr2=0x7f4c1c06ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:25.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.099+0000 7f4c22ece640 1 -- 172.21.15.132:0/4110363190 shutdown_connections 2023-12-20T04:46:25.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.099+0000 7f4c22ece640 1 -- 172.21.15.132:0/4110363190 wait complete. 2023-12-20T04:46:25.112 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-20T04:46:25.112 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:46:25.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.210+0000 7f93d3496640 1 Processor -- start 2023-12-20T04:46:25.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.211+0000 7f93d3496640 1 -- start start 2023-12-20T04:46:25.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93d3496640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f93cc0af210 0x7f93cc168120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93d3496640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93cc161ce0 con 0x7f93cc15d4f0 2023-12-20T04:46:25.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93d3496640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f93cc0aca50 con 0x7f93cc15d110 2023-12-20T04:46:25.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93d3496640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f93cc160df0 con 0x7f93cc0af210 2023-12-20T04:46:25.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93d0a31640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f93cc15d4f0 0x7f93cc0aeb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43708/0 (socket says 172.21.15.132:43708) 2023-12-20T04:46:25.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93d0a31640 1 -- 172.21.15.132:0/128810733 learned_addr learned my addr 172.21.15.132:0/128810733 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:25.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93c3fff640 1 -- 172.21.15.132:0/128810733 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4270936744 0 0) 0x7f93cc161ce0 con 0x7f93cc15d4f0 2023-12-20T04:46:25.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93c3fff640 1 -- 172.21.15.132:0/128810733 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f93b8003520 con 0x7f93cc15d4f0 2023-12-20T04:46:25.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93d1a33640 1 --2- 172.21.15.132:0/128810733 >> v2:172.21.15.187:3300/0 conn(0x7f93cc0af210 0x7f93cc168120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93c3fff640 1 -- 172.21.15.132:0/128810733 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1618393821 0 0) 0x7f93b8003520 con 0x7f93cc15d4f0 2023-12-20T04:46:25.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93c3fff640 1 -- 172.21.15.132:0/128810733 >> v2:172.21.15.187:3300/0 conn(0x7f93cc0af210 msgr2=0x7f93cc168120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:25.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93c3fff640 1 --2- 172.21.15.132:0/128810733 >> v2:172.21.15.187:3300/0 conn(0x7f93cc0af210 0x7f93cc168120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93c3fff640 1 -- 172.21.15.132:0/128810733 >> v1:172.21.15.187:6789/0 conn(0x7f93cc15d110 legacy=0x7f93cc069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93c3fff640 1 -- 172.21.15.132:0/128810733 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc1610d0 con 0x7f93cc15d4f0 2023-12-20T04:46:25.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93c3fff640 1 -- 172.21.15.132:0/128810733 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f93c8001670 con 0x7f93cc15d4f0 2023-12-20T04:46:25.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93c3fff640 1 -- 172.21.15.132:0/128810733 >> v1:172.21.15.132:6789/0 conn(0x7f93cc15d4f0 legacy=0x7f93cc0aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93c3fff640 1 --2- 172.21.15.132:0/128810733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93b8003970 0x7f93b8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93c3fff640 1 --2- 172.21.15.132:0/128810733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b80047c0 0x7f93b8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93c3fff640 1 --2- 172.21.15.132:0/128810733 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93b8005180 0x7f93b800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93c3fff640 1 -- 172.21.15.132:0/128810733 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc160df0 con 0x7f93b8003970 2023-12-20T04:46:25.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93c3fff640 1 -- 172.21.15.132:0/128810733 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93b800c020 con 0x7f93b80047c0 2023-12-20T04:46:25.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93c3fff640 1 -- 172.21.15.132:0/128810733 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93b800c1e0 con 0x7f93b8005180 2023-12-20T04:46:25.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93d1232640 1 --2- 172.21.15.132:0/128810733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93b8003970 0x7f93b8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.212+0000 7f93d0a31640 1 --2- 172.21.15.132:0/128810733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b80047c0 0x7f93b8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.213+0000 7f93d1a33640 1 --2- 172.21.15.132:0/128810733 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93b8005180 0x7f93b800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.213+0000 7f93d1232640 1 -- 172.21.15.132:0/128810733 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93b8005180 msgr2=0x7f93b800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:25.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.213+0000 7f93d1232640 1 --2- 172.21.15.132:0/128810733 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93b8005180 0x7f93b800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.213+0000 7f93d1232640 1 -- 172.21.15.132:0/128810733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b80047c0 msgr2=0x7f93b8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:25.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.213+0000 7f93d1232640 1 --2- 172.21.15.132:0/128810733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b80047c0 0x7f93b8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.213+0000 7f93d1232640 1 -- 172.21.15.132:0/128810733 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93b8003520 con 0x7f93b8003970 2023-12-20T04:46:25.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.213+0000 7f93d1a33640 1 -- 172.21.15.132:0/128810733 reap_dead start 2023-12-20T04:46:25.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.213+0000 7f93d1232640 1 --2- 172.21.15.132:0/128810733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93b8003970 0x7f93b8003d90 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f93bc001770 tx=0x7f93b80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e54ff2c232592f6e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:25.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.214+0000 7f93c3fff640 1 -- 172.21.15.132:0/128810733 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc0052d0 con 0x7f93b8003970 2023-12-20T04:46:25.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.214+0000 7f93c3fff640 1 -- 172.21.15.132:0/128810733 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93bc02e050 con 0x7f93b8003970 2023-12-20T04:46:25.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.214+0000 7f93c3fff640 1 -- 172.21.15.132:0/128810733 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93bc003640 con 0x7f93b8003970 2023-12-20T04:46:25.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.214+0000 7f93d3496640 1 -- 172.21.15.132:0/128810733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93b8003970 msgr2=0x7f93b8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.214+0000 7f93d3496640 1 --2- 172.21.15.132:0/128810733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93b8003970 0x7f93b8003d90 secure :-1 s=READY pgs=886 cs=0 l=1 rev1=1 crypto rx=0x7f93bc001770 tx=0x7f93b80057f0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.214+0000 7f93d3496640 1 -- 172.21.15.132:0/128810733 shutdown_connections 2023-12-20T04:46:25.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.214+0000 7f93d3496640 1 --2- 172.21.15.132:0/128810733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93b8003970 0x7f93b8003d90 unknown :-1 s=CLOSED pgs=886 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.214+0000 7f93d3496640 1 -- 172.21.15.132:0/128810733 >> 172.21.15.132:0/128810733 conn(0x7f93cc0cfbd0 msgr2=0x7f93cc0cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:25.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.214+0000 7f93d3496640 1 -- 172.21.15.132:0/128810733 shutdown_connections 2023-12-20T04:46:25.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.214+0000 7f93d3496640 1 -- 172.21.15.132:0/128810733 wait complete. 2023-12-20T04:46:25.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.215+0000 7f93d3496640 1 Processor -- start 2023-12-20T04:46:25.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.215+0000 7f93d3496640 1 -- start start 2023-12-20T04:46:25.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.216+0000 7f93d3496640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b8003970 0x7f93cc0cb860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.216+0000 7f93d3496640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93cc151170 0x7f93cc1515d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.216+0000 7f93d3496640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93cc06cca0 0x7f93cc06d150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.216+0000 7f93d3496640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc151b10 con 0x7f93cc151170 2023-12-20T04:46:25.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.216+0000 7f93d3496640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc06d9d0 con 0x7f93b8003970 2023-12-20T04:46:25.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.216+0000 7f93d3496640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f93cc06dcb0 con 0x7f93cc06cca0 2023-12-20T04:46:25.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.216+0000 7f93d0a31640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93cc151170 0x7f93cc1515d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.216+0000 7f93d0a31640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93cc151170 0x7f93cc1515d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37360/0 (socket says 172.21.15.132:37360) 2023-12-20T04:46:25.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.216+0000 7f93d0a31640 1 -- 172.21.15.132:0/1406683569 learned_addr learned my addr 172.21.15.132:0/1406683569 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:25.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.216+0000 7f93d1232640 1 --2- 172.21.15.132:0/1406683569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b8003970 0x7f93cc0cb860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.216+0000 7f93d1a33640 1 --2- 172.21.15.132:0/1406683569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93cc06cca0 0x7f93cc06d150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.216+0000 7f93d0a31640 1 -- 172.21.15.132:0/1406683569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93cc06cca0 msgr2=0x7f93cc06d150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.217+0000 7f93d0a31640 1 --2- 172.21.15.132:0/1406683569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93cc06cca0 0x7f93cc06d150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.217+0000 7f93d0a31640 1 -- 172.21.15.132:0/1406683569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b8003970 msgr2=0x7f93cc0cb860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.217+0000 7f93d0a31640 1 --2- 172.21.15.132:0/1406683569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b8003970 0x7f93cc0cb860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.217+0000 7f93d0a31640 1 -- 172.21.15.132:0/1406683569 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f93cc06df90 con 0x7f93cc151170 2023-12-20T04:46:25.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.217+0000 7f93d1a33640 1 --2- 172.21.15.132:0/1406683569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93cc06cca0 0x7f93cc06d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:25.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.217+0000 7f93d0a31640 1 --2- 172.21.15.132:0/1406683569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93cc151170 0x7f93cc1515d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f93c8007290 tx=0x7f93c8007750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:25.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.217+0000 7f93c1ffb640 1 -- 172.21.15.132:0/1406683569 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c8001650 con 0x7f93cc151170 2023-12-20T04:46:25.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.217+0000 7f93c1ffb640 1 -- 172.21.15.132:0/1406683569 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f93c800f9c0 con 0x7f93cc151170 2023-12-20T04:46:25.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.217+0000 7f93d3496640 1 -- 172.21.15.132:0/1406683569 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f93cc06e270 con 0x7f93cc151170 2023-12-20T04:46:25.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.217+0000 7f93c1ffb640 1 -- 172.21.15.132:0/1406683569 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f93c800fd50 con 0x7f93cc151170 2023-12-20T04:46:25.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.217+0000 7f93d3496640 1 -- 172.21.15.132:0/1406683569 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f93cc06d690 con 0x7f93cc151170 2023-12-20T04:46:25.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.218+0000 7f93d3496640 1 -- 172.21.15.132:0/1406683569 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f93cc04e840 con 0x7f93cc151170 2023-12-20T04:46:25.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.218+0000 7f93c1ffb640 1 -- 172.21.15.132:0/1406683569 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f93c801d460 con 0x7f93cc151170 2023-12-20T04:46:25.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.219+0000 7f93c1ffb640 1 --2- 172.21.15.132:0/1406683569 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f93b006a430 0x7f93b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.219+0000 7f93c1ffb640 1 -- 172.21.15.132:0/1406683569 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f93c80889a0 con 0x7f93cc151170 2023-12-20T04:46:25.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.219+0000 7f93d1232640 1 --2- 172.21.15.132:0/1406683569 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f93b006a430 0x7f93b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.219+0000 7f93d1232640 1 --2- 172.21.15.132:0/1406683569 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f93b006a430 0x7f93b006c8f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f93bc033000 tx=0x7f93bc009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:25.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.223+0000 7f93c1ffb640 1 -- 172.21.15.132:0/1406683569 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f93c8053f90 con 0x7f93cc151170 2023-12-20T04:46:25.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.385+0000 7f93d3496640 1 -- 172.21.15.132:0/1406683569 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f93cc161690 con 0x7f93b006a430 2023-12-20T04:46:25.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.392+0000 7f93c1ffb640 1 -- 172.21.15.132:0/1406683569 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275569 (secure 0 0 0) 0x7f93bc0054a0 con 0x7f93b006a430 2023-12-20T04:46:25.397 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:25.399 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:46:25.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.395+0000 7f93d3496640 1 -- 172.21.15.132:0/1406683569 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f93b006a430 msgr2=0x7f93b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.395+0000 7f93d3496640 1 --2- 172.21.15.132:0/1406683569 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f93b006a430 0x7f93b006c8f0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f93bc033000 tx=0x7f93bc009030 comp rx=0 tx=0).stop 2023-12-20T04:46:25.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.395+0000 7f93d3496640 1 -- 172.21.15.132:0/1406683569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93cc151170 msgr2=0x7f93cc1515d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.395+0000 7f93d3496640 1 --2- 172.21.15.132:0/1406683569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93cc151170 0x7f93cc1515d0 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7f93c8007290 tx=0x7f93c8007750 comp rx=0 tx=0).stop 2023-12-20T04:46:25.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.395+0000 7f93d3496640 1 -- 172.21.15.132:0/1406683569 shutdown_connections 2023-12-20T04:46:25.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.395+0000 7f93d3496640 1 --2- 172.21.15.132:0/1406683569 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f93b006a430 0x7f93b006c8f0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.395+0000 7f93d3496640 1 --2- 172.21.15.132:0/1406683569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f93cc06cca0 0x7f93cc06d150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.395+0000 7f93d3496640 1 --2- 172.21.15.132:0/1406683569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f93cc151170 0x7f93cc1515d0 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.395+0000 7f93d3496640 1 --2- 172.21.15.132:0/1406683569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f93b8003970 0x7f93cc0cb860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.395+0000 7f93d3496640 1 -- 172.21.15.132:0/1406683569 >> 172.21.15.132:0/1406683569 conn(0x7f93cc0cfbd0 msgr2=0x7f93cc15c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:25.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.395+0000 7f93d3496640 1 -- 172.21.15.132:0/1406683569 shutdown_connections 2023-12-20T04:46:25.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.395+0000 7f93d3496640 1 -- 172.21.15.132:0/1406683569 wait complete. 2023-12-20T04:46:25.408 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2023-12-20T04:46:24.138474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":46,"acting":46,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":2,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4340,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558159,"statfs":{"total":1600000000,"available":1595555520,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000674"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117677+0000","last_change":"2023-12-20T04:46:21.117677+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117677+0000","last_undegraded":"2023-12-20T04:46:21.117677+0000","last_fullsized":"2023-12-20T04:46:21.117677+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:45:34.103863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118081+0000","last_change":"2023-12-20T04:46:21.118081+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118081+0000","last_undegraded":"2023-12-20T04:46:21.118081+0000","last_fullsized":"2023-12-20T04:46:21.118081+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:31:16.073200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.119301+0000","last_change":"2023-12-20T04:46:21.119301+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.119301+0000","last_undegraded":"2023-12-20T04:46:21.119301+0000","last_fullsized":"2023-12-20T04:46:21.119301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:57:59.044568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.113570+0000","last_change":"2023-12-20T04:46:21.113570+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.113570+0000","last_undegraded":"2023-12-20T04:46:21.113570+0000","last_fullsized":"2023-12-20T04:46:21.113570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:24:36.303161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.119130+0000","last_change":"2023-12-20T04:46:21.119130+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.119130+0000","last_undegraded":"2023-12-20T04:46:21.119130+0000","last_fullsized":"2023-12-20T04:46:21.119130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:49:26.182419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117812+0000","last_change":"2023-12-20T04:46:21.117812+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117812+0000","last_undegraded":"2023-12-20T04:46:21.117812+0000","last_fullsized":"2023-12-20T04:46:21.117812+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:59:16.940603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118469+0000","last_change":"2023-12-20T04:46:21.118469+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118469+0000","last_undegraded":"2023-12-20T04:46:21.118469+0000","last_fullsized":"2023-12-20T04:46:21.118469+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:51:05.802721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.113622+0000","last_change":"2023-12-20T04:46:21.113622+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.113622+0000","last_undegraded":"2023-12-20T04:46:21.113622+0000","last_fullsized":"2023-12-20T04:46:21.113622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:26:04.269978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118924+0000","last_change":"2023-12-20T04:46:21.118924+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118924+0000","last_undegraded":"2023-12-20T04:46:21.118924+0000","last_fullsized":"2023-12-20T04:46:21.118924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:59:41.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.114516+0000","last_change":"2023-12-20T04:46:21.114516+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.114516+0000","last_undegraded":"2023-12-20T04:46:21.114516+0000","last_fullsized":"2023-12-20T04:46:21.114516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:59:16.940603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117922+0000","last_change":"2023-12-20T04:46:21.117922+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117922+0000","last_undegraded":"2023-12-20T04:46:21.117922+0000","last_fullsized":"2023-12-20T04:46:21.117922+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:14:24.821694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.119421+0000","last_change":"2023-12-20T04:46:21.119421+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.119421+0000","last_undegraded":"2023-12-20T04:46:21.119421+0000","last_fullsized":"2023-12-20T04:46:21.119421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:07:59.913149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117060+0000","last_change":"2023-12-20T04:46:21.117060+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117060+0000","last_undegraded":"2023-12-20T04:46:21.117060+0000","last_fullsized":"2023-12-20T04:46:21.117060+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:06:05.221249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118565+0000","last_change":"2023-12-20T04:46:21.118565+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118565+0000","last_undegraded":"2023-12-20T04:46:21.118565+0000","last_fullsized":"2023-12-20T04:46:21.118565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:43:40.481954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117212+0000","last_change":"2023-12-20T04:46:21.117212+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117212+0000","last_undegraded":"2023-12-20T04:46:21.117212+0000","last_fullsized":"2023-12-20T04:46:21.117212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:05:01.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117912+0000","last_change":"2023-12-20T04:46:21.117912+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117912+0000","last_undegraded":"2023-12-20T04:46:21.117912+0000","last_fullsized":"2023-12-20T04:46:21.117912+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:36:43.142500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.114529+0000","last_change":"2023-12-20T04:46:21.114529+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.114529+0000","last_undegraded":"2023-12-20T04:46:21.114529+0000","last_fullsized":"2023-12-20T04:46:21.114529+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:32:07.943631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118127+0000","last_change":"2023-12-20T04:46:21.118127+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118127+0000","last_undegraded":"2023-12-20T04:46:21.118127+0000","last_fullsized":"2023-12-20T04:46:21.118127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:14:46.240010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.114462+0000","last_change":"2023-12-20T04:46:21.114462+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.114462+0000","last_undegraded":"2023-12-20T04:46:21.114462+0000","last_fullsized":"2023-12-20T04:46:21.114462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:06:59.201562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117397+0000","last_change":"2023-12-20T04:46:21.117397+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117397+0000","last_undegraded":"2023-12-20T04:46:21.117397+0000","last_fullsized":"2023-12-20T04:46:21.117397+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:32:07.943631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118335+0000","last_change":"2023-12-20T04:46:21.118335+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118335+0000","last_undegraded":"2023-12-20T04:46:21.118335+0000","last_fullsized":"2023-12-20T04:46:21.118335+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:51:07.255012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118723+0000","last_change":"2023-12-20T04:46:21.118723+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118723+0000","last_undegraded":"2023-12-20T04:46:21.118723+0000","last_fullsized":"2023-12-20T04:46:21.118723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:08:23.337153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":215,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-20T04:46:19.529434+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:46:19.529434+0000","last_peered":"2023-12-20T04:46:19.529434+0000","last_clean":"2023-12-20T04:46:19.529434+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:46:19.529434+0000","last_undegraded":"2023-12-20T04:46:19.529434+0000","last_fullsized":"2023-12-20T04:46:19.529434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":974,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194337,"statfs":{"total":200000000,"available":199001664,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.45200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.747,"5min":0.754,"15min":0.754},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.37,"5min":0.315,"15min":0.315},"max":{"1min":0.67500000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55000000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68500000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.44500000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76600000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58399999999999996}]},{"osd":2,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.751,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71599999999999997,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.47699999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71899999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.72999999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60799999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.48699999999999999,"15min":0.48599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.61299999999999999,"5min":0.753,"15min":0.753},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.59699999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.61299999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68500000000000005,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.64100000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.53900000000000003,"15min":0.55300000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64400000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66300000000000003,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.623}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48899999999999999,"15min":0.48999999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.61299999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.314,"15min":0.314},"max":{"1min":0.63700000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.52400000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71499999999999997,"5min":0.751,"15min":0.751},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57099999999999995,"15min":0.57799999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.61199999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.34399999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.55400000000000005}]},{"osd":3,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.50800000000000001,"15min":0.49199999999999999},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.377},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.42399999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.46300000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.502,"15min":0.51200000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.67500000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.5,"15min":0.49299999999999999},"min":{"1min":0.38700000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.52700000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70899999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.35699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72499999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.45200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.42399999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.56799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.505},"min":{"1min":0.40600000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69999999999999996,"5min":0.745,"15min":0.745},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.498,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.65300000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.41899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68700000000000006,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53900000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.41599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.499},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52200000000000002,"15min":0.51500000000000001},"min":{"1min":0.441,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.376}]},{"osd":3,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.67300000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.41599999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.48399999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.32900000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.74399999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.314},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47899999999999998,"15min":0.48199999999999998},"min":{"1min":0.318,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69399999999999995,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.34100000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.33200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.75700000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.318,"5min":0.31,"15min":0.31},"max":{"1min":0.81200000000000006,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.36399999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52200000000000002,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73399999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60199999999999998,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80000000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.68400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.40600000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.50800000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.40400000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.435},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.52900000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69699999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.55300000000000005},"min":{"1min":0.39000000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.48699999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.47699999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.74299999999999999,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.71199999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57899999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.67100000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.497,"15min":0.50600000000000001},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.625,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68300000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.63500000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50900000000000001,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.66700000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.33500000000000002},"min":{"1min":0.26100000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.44900000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.315},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.254,"5min":0.246,"15min":0.246},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.30499999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.316},"min":{"1min":0.23300000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.30599999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.51700000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.29499999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.248,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.498,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.378,"15min":0.371},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.25}]},{"osd":4,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.80500000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81499999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.46600000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.40200000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.433},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.437,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.752,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40999999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.41099999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.749,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.55200000000000005},"min":{"1min":0.45100000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.37}]},{"osd":7,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.41199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76000000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.30399999999999999,"15min":0.28999999999999998},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.437},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.37,"15min":0.33800000000000002},"min":{"1min":0.23200000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":1.135,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.33700000000000002,"15min":0.32500000000000001},"min":{"1min":0.23300000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.35599999999999998,"15min":0.34399999999999997},"min":{"1min":0.253,"5min":0.245,"15min":0.245},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.48399999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.372,"15min":0.35099999999999998},"min":{"1min":0.29399999999999998,"5min":0.216,"15min":0.216},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.496},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.376,"15min":0.36499999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.39900000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58399999999999996,"15min":0.56699999999999995},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.79300000000000004,"5min":2.347,"15min":2.347},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.41999999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.432,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60799999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.57299999999999995},"min":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76000000000000001,"5min":2.274,"15min":2.274},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.46000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1659999999999999,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.62}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.29699999999999999,"15min":0.28399999999999997},"min":{"1min":0.221,"5min":0.187,"15min":0.187},"max":{"1min":0.48299999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32500000000000001},"min":{"1min":0.28999999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.38100000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.312,"15min":0.29999999999999999},"min":{"1min":0.223,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51400000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.34300000000000003},"min":{"1min":0.307,"5min":0.224,"15min":0.224},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.40500000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.191,"15min":0.191},"max":{"1min":0.52300000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.434},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.35099999999999998},"min":{"1min":0.30199999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.29099999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72699999999999998,"5min":0.873,"15min":0.873},"last":0.624},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.58999999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71399999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.68400000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.41399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78100000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64200000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82399999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.46100000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76500000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":974,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194337,"statfs":{"total":200000000,"available":199001664,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.311,"15min":0.30599999999999999},"min":{"1min":0.23100000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.46500000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.31900000000000001,"15min":0.307},"min":{"1min":0.24199999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.38900000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.35599999999999998,"15min":0.35399999999999998},"min":{"1min":0.24199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.53600000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.318},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.28799999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.29299999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.31900000000000001},"min":{"1min":0.245,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.373,"15min":0.36399999999999999},"min":{"1min":0.33500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.40500000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74399999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.40799999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.497}]},{"osd":5,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.52600000000000002,"15min":0.51300000000000001},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78700000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.40100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.50600000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82799999999999996,"5min":0.873,"15min":0.873},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84699999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.44800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53200000000000003}]}]}],"pool_statfs":[]}} 2023-12-20T04:46:25.413 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:46:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.547+0000 7f7ba898e640 1 Processor -- start 2023-12-20T04:46:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.547+0000 7f7ba898e640 1 -- start start 2023-12-20T04:46:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba898e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ba415e2d0 0x7f7ba40b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba898e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7ba40cf0b0 0x7f7ba40d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba898e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7ba40cd740 con 0x7f7ba40cb420 2023-12-20T04:46:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba898e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7ba40ce230 con 0x7f7ba40cf0b0 2023-12-20T04:46:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba898e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40cd990 con 0x7f7ba415e2d0 2023-12-20T04:46:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7b9bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7ba40cb420 0x7f7ba40ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43720/0 (socket says 172.21.15.132:43720) 2023-12-20T04:46:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7b9bfff640 1 -- 172.21.15.132:0/2122859111 learned_addr learned my addr 172.21.15.132:0/2122859111 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:25.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba1d9b640 1 -- 172.21.15.132:0/2122859111 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3469068827 0 0) 0x7f7ba40cd740 con 0x7f7ba40cb420 2023-12-20T04:46:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba259c640 1 --2- 172.21.15.132:0/2122859111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ba415e2d0 0x7f7ba40b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba1d9b640 1 -- 172.21.15.132:0/2122859111 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b90003520 con 0x7f7ba40cb420 2023-12-20T04:46:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba2d9d640 1 --2- 172.21.15.132:0/2122859111 >> v2:172.21.15.187:3300/0 conn(0x7f7ba40cf0b0 0x7f7ba40d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba1d9b640 1 -- 172.21.15.132:0/2122859111 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4076078719 0 0) 0x7f7b90003520 con 0x7f7ba40cb420 2023-12-20T04:46:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba1d9b640 1 -- 172.21.15.132:0/2122859111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ba415e2d0 msgr2=0x7f7ba40b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba1d9b640 1 --2- 172.21.15.132:0/2122859111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ba415e2d0 0x7f7ba40b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba1d9b640 1 -- 172.21.15.132:0/2122859111 >> v2:172.21.15.187:3300/0 conn(0x7f7ba40cf0b0 msgr2=0x7f7ba40d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba1d9b640 1 --2- 172.21.15.132:0/2122859111 >> v2:172.21.15.187:3300/0 conn(0x7f7ba40cf0b0 0x7f7ba40d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba1d9b640 1 -- 172.21.15.132:0/2122859111 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba40cdc70 con 0x7f7ba40cb420 2023-12-20T04:46:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba1d9b640 1 -- 172.21.15.132:0/2122859111 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f7b8c001670 con 0x7f7ba40cb420 2023-12-20T04:46:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba1d9b640 1 -- 172.21.15.132:0/2122859111 >> v1:172.21.15.132:6789/0 conn(0x7f7ba40cb420 legacy=0x7f7ba40ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba1d9b640 1 --2- 172.21.15.132:0/2122859111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b90003970 0x7f7b90003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba1d9b640 1 --2- 172.21.15.132:0/2122859111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ba415e2d0 0x7f7b900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba1d9b640 1 --2- 172.21.15.132:0/2122859111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b90004d00 0x7f7b90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba1d9b640 1 -- 172.21.15.132:0/2122859111 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40ce230 con 0x7f7b90004d00 2023-12-20T04:46:25.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba1d9b640 1 -- 172.21.15.132:0/2122859111 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba40cd990 con 0x7f7b90003970 2023-12-20T04:46:25.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba1d9b640 1 -- 172.21.15.132:0/2122859111 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b9000b980 con 0x7f7ba415e2d0 2023-12-20T04:46:25.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.548+0000 7f7ba2d9d640 1 --2- 172.21.15.132:0/2122859111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b90004d00 0x7f7b90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.549+0000 7f7ba259c640 1 --2- 172.21.15.132:0/2122859111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b90003970 0x7f7b90003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.549+0000 7f7b9bfff640 1 --2- 172.21.15.132:0/2122859111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ba415e2d0 0x7f7b900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.549+0000 7f7ba2d9d640 1 -- 172.21.15.132:0/2122859111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ba415e2d0 msgr2=0x7f7b900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:25.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.549+0000 7f7ba2d9d640 1 --2- 172.21.15.132:0/2122859111 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ba415e2d0 0x7f7b900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.549+0000 7f7ba2d9d640 1 -- 172.21.15.132:0/2122859111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b90003970 msgr2=0x7f7b90003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:25.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.549+0000 7f7ba2d9d640 1 --2- 172.21.15.132:0/2122859111 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b90003970 0x7f7b90003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.549+0000 7f7ba2d9d640 1 -- 172.21.15.132:0/2122859111 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b90003520 con 0x7f7b90004d00 2023-12-20T04:46:25.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.549+0000 7f7ba2d9d640 1 --2- 172.21.15.132:0/2122859111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b90004d00 0x7f7b90005180 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009fc0 tx=0x7f7b900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b276a8204e6b3ad server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:25.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.550+0000 7f7ba1d9b640 1 -- 172.21.15.132:0/2122859111 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c02cc60 con 0x7f7b90004d00 2023-12-20T04:46:25.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.550+0000 7f7ba1d9b640 1 -- 172.21.15.132:0/2122859111 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9c00f040 con 0x7f7b90004d00 2023-12-20T04:46:25.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.550+0000 7f7ba1d9b640 1 -- 172.21.15.132:0/2122859111 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9c034440 con 0x7f7b90004d00 2023-12-20T04:46:25.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.550+0000 7f7ba898e640 1 -- 172.21.15.132:0/2122859111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b90004d00 msgr2=0x7f7b90005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.550+0000 7f7ba898e640 1 --2- 172.21.15.132:0/2122859111 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b90004d00 0x7f7b90005180 secure :-1 s=READY pgs=889 cs=0 l=1 rev1=1 crypto rx=0x7f7b9c009fc0 tx=0x7f7b900057f0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.550+0000 7f7ba2d9d640 1 -- 172.21.15.132:0/2122859111 reap_dead start 2023-12-20T04:46:25.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.550+0000 7f7ba898e640 1 -- 172.21.15.132:0/2122859111 shutdown_connections 2023-12-20T04:46:25.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.550+0000 7f7ba898e640 1 -- 172.21.15.132:0/2122859111 >> 172.21.15.132:0/2122859111 conn(0x7f7ba406d7c0 msgr2=0x7f7ba406dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:25.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.550+0000 7f7ba898e640 1 -- 172.21.15.132:0/2122859111 shutdown_connections 2023-12-20T04:46:25.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.550+0000 7f7ba898e640 1 -- 172.21.15.132:0/2122859111 wait complete. 2023-12-20T04:46:25.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.551+0000 7f7ba898e640 1 Processor -- start 2023-12-20T04:46:25.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.552+0000 7f7ba898e640 1 -- start start 2023-12-20T04:46:25.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.552+0000 7f7ba898e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b90004d00 0x7f7ba41521d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.552+0000 7f7ba898e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ba4156590 0x7f7ba4153350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.552+0000 7f7ba898e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ba41556b0 0x7f7ba4155b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.552+0000 7f7ba898e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba4156080 con 0x7f7b90004d00 2023-12-20T04:46:25.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.552+0000 7f7ba898e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba41548d0 con 0x7f7ba41556b0 2023-12-20T04:46:25.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.552+0000 7f7ba898e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ba4153cc0 con 0x7f7ba4156590 2023-12-20T04:46:25.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.552+0000 7f7ba259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b90004d00 0x7f7ba41521d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.552+0000 7f7ba259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b90004d00 0x7f7ba41521d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37374/0 (socket says 172.21.15.132:37374) 2023-12-20T04:46:25.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.552+0000 7f7ba259c640 1 -- 172.21.15.132:0/2165060528 learned_addr learned my addr 172.21.15.132:0/2165060528 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:25.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.552+0000 7f7ba2d9d640 1 --2- 172.21.15.132:0/2165060528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ba41556b0 0x7f7ba4155b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.552+0000 7f7b9bfff640 1 --2- 172.21.15.132:0/2165060528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ba4156590 0x7f7ba4153350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.553+0000 7f7ba259c640 1 -- 172.21.15.132:0/2165060528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ba4156590 msgr2=0x7f7ba4153350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.553+0000 7f7ba259c640 1 --2- 172.21.15.132:0/2165060528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ba4156590 0x7f7ba4153350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.553+0000 7f7ba259c640 1 -- 172.21.15.132:0/2165060528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ba41556b0 msgr2=0x7f7ba4155b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.553+0000 7f7ba259c640 1 --2- 172.21.15.132:0/2165060528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ba41556b0 0x7f7ba4155b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.553+0000 7f7ba259c640 1 -- 172.21.15.132:0/2165060528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ba4153fa0 con 0x7f7b90004d00 2023-12-20T04:46:25.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.553+0000 7f7ba259c640 1 --2- 172.21.15.132:0/2165060528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b90004d00 0x7f7ba41521d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f7b940118e0 tx=0x7f7b94011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:25.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.553+0000 7f7b9affd640 1 -- 172.21.15.132:0/2165060528 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b9400faf0 con 0x7f7b90004d00 2023-12-20T04:46:25.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.553+0000 7f7b9affd640 1 -- 172.21.15.132:0/2165060528 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b9400fc50 con 0x7f7b90004d00 2023-12-20T04:46:25.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.553+0000 7f7ba898e640 1 -- 172.21.15.132:0/2165060528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ba4154280 con 0x7f7b90004d00 2023-12-20T04:46:25.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.553+0000 7f7b9affd640 1 -- 172.21.15.132:0/2165060528 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b94014440 con 0x7f7b90004d00 2023-12-20T04:46:25.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.553+0000 7f7ba898e640 1 -- 172.21.15.132:0/2165060528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ba4152710 con 0x7f7b90004d00 2023-12-20T04:46:25.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.554+0000 7f7ba898e640 1 -- 172.21.15.132:0/2165060528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ba404e840 con 0x7f7b90004d00 2023-12-20T04:46:25.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.554+0000 7f7b9affd640 1 -- 172.21.15.132:0/2165060528 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7b940145a0 con 0x7f7b90004d00 2023-12-20T04:46:25.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.555+0000 7f7b9affd640 1 --2- 172.21.15.132:0/2165060528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7b8406a430 0x7f7b8406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.555+0000 7f7b9affd640 1 -- 172.21.15.132:0/2165060528 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b94089260 con 0x7f7b90004d00 2023-12-20T04:46:25.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.555+0000 7f7b9bfff640 1 --2- 172.21.15.132:0/2165060528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7b8406a430 0x7f7b8406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.555+0000 7f7b9bfff640 1 --2- 172.21.15.132:0/2165060528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7b8406a430 0x7f7b8406c8f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7ba41ee240 tx=0x7f7b8c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:25.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.559+0000 7f7b9affd640 1 -- 172.21.15.132:0/2165060528 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7b94054850 con 0x7f7b90004d00 2023-12-20T04:46:25.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.721+0000 7f7ba898e640 1 -- 172.21.15.132:0/2165060528 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7ba40d02d0 con 0x7f7b8406a430 2023-12-20T04:46:25.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.728+0000 7f7b9affd640 1 -- 172.21.15.132:0/2165060528 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275569 (secure 0 0 0) 0x7f7b8c001590 con 0x7f7b8406a430 2023-12-20T04:46:25.732 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:25.734 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:46:25.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.731+0000 7f7ba898e640 1 -- 172.21.15.132:0/2165060528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7b8406a430 msgr2=0x7f7b8406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.731+0000 7f7ba898e640 1 --2- 172.21.15.132:0/2165060528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7b8406a430 0x7f7b8406c8f0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f7ba41ee240 tx=0x7f7b8c009040 comp rx=0 tx=0).stop 2023-12-20T04:46:25.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.731+0000 7f7ba898e640 1 -- 172.21.15.132:0/2165060528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b90004d00 msgr2=0x7f7ba41521d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.731+0000 7f7ba898e640 1 --2- 172.21.15.132:0/2165060528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b90004d00 0x7f7ba41521d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f7b940118e0 tx=0x7f7b94011da0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.731+0000 7f7ba898e640 1 -- 172.21.15.132:0/2165060528 shutdown_connections 2023-12-20T04:46:25.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.731+0000 7f7ba898e640 1 --2- 172.21.15.132:0/2165060528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7b8406a430 0x7f7b8406c8f0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.731+0000 7f7ba898e640 1 --2- 172.21.15.132:0/2165060528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ba41556b0 0x7f7ba4155b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.731+0000 7f7ba898e640 1 --2- 172.21.15.132:0/2165060528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ba4156590 0x7f7ba4153350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.731+0000 7f7ba898e640 1 --2- 172.21.15.132:0/2165060528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b90004d00 0x7f7ba41521d0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.731+0000 7f7ba898e640 1 -- 172.21.15.132:0/2165060528 >> 172.21.15.132:0/2165060528 conn(0x7f7ba406d7c0 msgr2=0x7f7ba40ccc70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:25.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.731+0000 7f7ba898e640 1 -- 172.21.15.132:0/2165060528 shutdown_connections 2023-12-20T04:46:25.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.731+0000 7f7ba898e640 1 -- 172.21.15.132:0/2165060528 wait complete. 2023-12-20T04:46:25.744 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2023-12-20T04:46:24.138474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":46,"acting":46,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":2,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4340,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558159,"statfs":{"total":1600000000,"available":1595555520,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000674"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117677+0000","last_change":"2023-12-20T04:46:21.117677+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117677+0000","last_undegraded":"2023-12-20T04:46:21.117677+0000","last_fullsized":"2023-12-20T04:46:21.117677+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:45:34.103863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118081+0000","last_change":"2023-12-20T04:46:21.118081+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118081+0000","last_undegraded":"2023-12-20T04:46:21.118081+0000","last_fullsized":"2023-12-20T04:46:21.118081+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:31:16.073200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.119301+0000","last_change":"2023-12-20T04:46:21.119301+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.119301+0000","last_undegraded":"2023-12-20T04:46:21.119301+0000","last_fullsized":"2023-12-20T04:46:21.119301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:57:59.044568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.113570+0000","last_change":"2023-12-20T04:46:21.113570+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.113570+0000","last_undegraded":"2023-12-20T04:46:21.113570+0000","last_fullsized":"2023-12-20T04:46:21.113570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:24:36.303161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.119130+0000","last_change":"2023-12-20T04:46:21.119130+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.119130+0000","last_undegraded":"2023-12-20T04:46:21.119130+0000","last_fullsized":"2023-12-20T04:46:21.119130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:49:26.182419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117812+0000","last_change":"2023-12-20T04:46:21.117812+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117812+0000","last_undegraded":"2023-12-20T04:46:21.117812+0000","last_fullsized":"2023-12-20T04:46:21.117812+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:59:16.940603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118469+0000","last_change":"2023-12-20T04:46:21.118469+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118469+0000","last_undegraded":"2023-12-20T04:46:21.118469+0000","last_fullsized":"2023-12-20T04:46:21.118469+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:51:05.802721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.113622+0000","last_change":"2023-12-20T04:46:21.113622+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.113622+0000","last_undegraded":"2023-12-20T04:46:21.113622+0000","last_fullsized":"2023-12-20T04:46:21.113622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:26:04.269978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118924+0000","last_change":"2023-12-20T04:46:21.118924+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118924+0000","last_undegraded":"2023-12-20T04:46:21.118924+0000","last_fullsized":"2023-12-20T04:46:21.118924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:59:41.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.114516+0000","last_change":"2023-12-20T04:46:21.114516+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.114516+0000","last_undegraded":"2023-12-20T04:46:21.114516+0000","last_fullsized":"2023-12-20T04:46:21.114516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:59:16.940603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117922+0000","last_change":"2023-12-20T04:46:21.117922+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117922+0000","last_undegraded":"2023-12-20T04:46:21.117922+0000","last_fullsized":"2023-12-20T04:46:21.117922+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:14:24.821694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.119421+0000","last_change":"2023-12-20T04:46:21.119421+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.119421+0000","last_undegraded":"2023-12-20T04:46:21.119421+0000","last_fullsized":"2023-12-20T04:46:21.119421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:07:59.913149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117060+0000","last_change":"2023-12-20T04:46:21.117060+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117060+0000","last_undegraded":"2023-12-20T04:46:21.117060+0000","last_fullsized":"2023-12-20T04:46:21.117060+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:06:05.221249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118565+0000","last_change":"2023-12-20T04:46:21.118565+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118565+0000","last_undegraded":"2023-12-20T04:46:21.118565+0000","last_fullsized":"2023-12-20T04:46:21.118565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:43:40.481954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117212+0000","last_change":"2023-12-20T04:46:21.117212+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117212+0000","last_undegraded":"2023-12-20T04:46:21.117212+0000","last_fullsized":"2023-12-20T04:46:21.117212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:05:01.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117912+0000","last_change":"2023-12-20T04:46:21.117912+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117912+0000","last_undegraded":"2023-12-20T04:46:21.117912+0000","last_fullsized":"2023-12-20T04:46:21.117912+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:36:43.142500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.114529+0000","last_change":"2023-12-20T04:46:21.114529+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.114529+0000","last_undegraded":"2023-12-20T04:46:21.114529+0000","last_fullsized":"2023-12-20T04:46:21.114529+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:32:07.943631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118127+0000","last_change":"2023-12-20T04:46:21.118127+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118127+0000","last_undegraded":"2023-12-20T04:46:21.118127+0000","last_fullsized":"2023-12-20T04:46:21.118127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:14:46.240010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.114462+0000","last_change":"2023-12-20T04:46:21.114462+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.114462+0000","last_undegraded":"2023-12-20T04:46:21.114462+0000","last_fullsized":"2023-12-20T04:46:21.114462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:06:59.201562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117397+0000","last_change":"2023-12-20T04:46:21.117397+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117397+0000","last_undegraded":"2023-12-20T04:46:21.117397+0000","last_fullsized":"2023-12-20T04:46:21.117397+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:32:07.943631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118335+0000","last_change":"2023-12-20T04:46:21.118335+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118335+0000","last_undegraded":"2023-12-20T04:46:21.118335+0000","last_fullsized":"2023-12-20T04:46:21.118335+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:51:07.255012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118723+0000","last_change":"2023-12-20T04:46:21.118723+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118723+0000","last_undegraded":"2023-12-20T04:46:21.118723+0000","last_fullsized":"2023-12-20T04:46:21.118723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:08:23.337153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":215,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-20T04:46:19.529434+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:46:19.529434+0000","last_peered":"2023-12-20T04:46:19.529434+0000","last_clean":"2023-12-20T04:46:19.529434+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:46:19.529434+0000","last_undegraded":"2023-12-20T04:46:19.529434+0000","last_fullsized":"2023-12-20T04:46:19.529434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":974,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194337,"statfs":{"total":200000000,"available":199001664,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.45200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.747,"5min":0.754,"15min":0.754},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.37,"5min":0.315,"15min":0.315},"max":{"1min":0.67500000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55000000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68500000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.44500000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76600000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58399999999999996}]},{"osd":2,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.751,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71599999999999997,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.47699999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71899999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.72999999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60799999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.48699999999999999,"15min":0.48599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.61299999999999999,"5min":0.753,"15min":0.753},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.59699999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.61299999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68500000000000005,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.64100000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.53900000000000003,"15min":0.55300000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64400000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66300000000000003,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.623}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48899999999999999,"15min":0.48999999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.61299999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.314,"15min":0.314},"max":{"1min":0.63700000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.52400000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71499999999999997,"5min":0.751,"15min":0.751},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57099999999999995,"15min":0.57799999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.61199999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.34399999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.55400000000000005}]},{"osd":3,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.50800000000000001,"15min":0.49199999999999999},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.377},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.42399999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.46300000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.502,"15min":0.51200000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.67500000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.5,"15min":0.49299999999999999},"min":{"1min":0.38700000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.52700000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70899999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.35699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72499999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.45200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.42399999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.56799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.505},"min":{"1min":0.40600000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69999999999999996,"5min":0.745,"15min":0.745},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.498,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.65300000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.41899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68700000000000006,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53900000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.41599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.499},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52200000000000002,"15min":0.51500000000000001},"min":{"1min":0.441,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.376}]},{"osd":3,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.67300000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.41599999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.48399999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.32900000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.74399999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.314},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47899999999999998,"15min":0.48199999999999998},"min":{"1min":0.318,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69399999999999995,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.34100000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.33200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.75700000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.318,"5min":0.31,"15min":0.31},"max":{"1min":0.81200000000000006,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.36399999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52200000000000002,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73399999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60199999999999998,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80000000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.68400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.40600000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.50800000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.40400000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.435},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.52900000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69699999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.55300000000000005},"min":{"1min":0.39000000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.48699999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.47699999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.74299999999999999,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.71199999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57899999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.67100000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.497,"15min":0.50600000000000001},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.625,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68300000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.63500000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50900000000000001,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.66700000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.33500000000000002},"min":{"1min":0.26100000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.44900000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.315},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.254,"5min":0.246,"15min":0.246},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.30499999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.316},"min":{"1min":0.23300000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.30599999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.51700000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.29499999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.248,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.498,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.378,"15min":0.371},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.25}]},{"osd":4,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.80500000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81499999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.46600000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.40200000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.433},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.437,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.752,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40999999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.41099999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.749,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.55200000000000005},"min":{"1min":0.45100000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.37}]},{"osd":7,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.41199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76000000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.30399999999999999,"15min":0.28999999999999998},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.437},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.37,"15min":0.33800000000000002},"min":{"1min":0.23200000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":1.135,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.33700000000000002,"15min":0.32500000000000001},"min":{"1min":0.23300000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.35599999999999998,"15min":0.34399999999999997},"min":{"1min":0.253,"5min":0.245,"15min":0.245},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.48399999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.372,"15min":0.35099999999999998},"min":{"1min":0.29399999999999998,"5min":0.216,"15min":0.216},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.496},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.376,"15min":0.36499999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.39900000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58399999999999996,"15min":0.56699999999999995},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.79300000000000004,"5min":2.347,"15min":2.347},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.41999999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.432,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60799999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.57299999999999995},"min":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76000000000000001,"5min":2.274,"15min":2.274},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.46000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1659999999999999,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.62}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.29699999999999999,"15min":0.28399999999999997},"min":{"1min":0.221,"5min":0.187,"15min":0.187},"max":{"1min":0.48299999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32500000000000001},"min":{"1min":0.28999999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.38100000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.312,"15min":0.29999999999999999},"min":{"1min":0.223,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51400000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.34300000000000003},"min":{"1min":0.307,"5min":0.224,"15min":0.224},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.40500000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.191,"15min":0.191},"max":{"1min":0.52300000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.434},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.35099999999999998},"min":{"1min":0.30199999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.29099999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72699999999999998,"5min":0.873,"15min":0.873},"last":0.624},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.58999999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71399999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.68400000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.41399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78100000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64200000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82399999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.46100000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76500000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":974,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194337,"statfs":{"total":200000000,"available":199001664,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.311,"15min":0.30599999999999999},"min":{"1min":0.23100000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.46500000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.31900000000000001,"15min":0.307},"min":{"1min":0.24199999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.38900000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.35599999999999998,"15min":0.35399999999999998},"min":{"1min":0.24199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.53600000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.318},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.28799999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.29299999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.31900000000000001},"min":{"1min":0.245,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.373,"15min":0.36399999999999999},"min":{"1min":0.33500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.40500000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74399999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.40799999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.497}]},{"osd":5,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.52600000000000002,"15min":0.51300000000000001},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78700000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.40100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.50600000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82799999999999996,"5min":0.873,"15min":0.873},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84699999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.44800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53200000000000003}]}]}],"pool_statfs":[]}} 2023-12-20T04:46:25.751 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:46:25.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.883+0000 7f0bc1a5f640 1 Processor -- start 2023-12-20T04:46:25.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.883+0000 7f0bc1a5f640 1 -- start start 2023-12-20T04:46:25.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.884+0000 7f0bc1a5f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bbc160450 0x7f0bbc160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.884+0000 7f0bc1a5f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0bbc1611b0 0x7f0bbc0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.884+0000 7f0bc1a5f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0bbc0b5ec0 con 0x7f0bbc0b4ec0 2023-12-20T04:46:25.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.884+0000 7f0bc1a5f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0bbc0b5350 con 0x7f0bbc1611b0 2023-12-20T04:46:25.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.884+0000 7f0bc1a5f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc1617e0 con 0x7f0bbc160450 2023-12-20T04:46:25.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.884+0000 7f0bb3fff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0bbc1611b0 0x7f0bbc0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.884+0000 7f0bbaffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bbc160450 0x7f0bbc160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.884+0000 7f0bbb7fe640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f0bbc0b4ec0 0x7f0bbc06a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:45902/0 (socket says 172.21.15.132:45902) 2023-12-20T04:46:25.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.884+0000 7f0bbb7fe640 1 -- 172.21.15.132:0/2225141162 learned_addr learned my addr 172.21.15.132:0/2225141162 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:25.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.884+0000 7f0bb3fff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0bbc1611b0 0x7f0bbc0b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:57052/0 (socket says 172.21.15.132:57052) 2023-12-20T04:46:25.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.884+0000 7f0bb3fff640 1 -- 172.21.15.132:0/2225141162 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bbc160450 msgr2=0x7f0bbc160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:25.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.884+0000 7f0bb3fff640 1 --2- 172.21.15.132:0/2225141162 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bbc160450 0x7f0bbc160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.884+0000 7f0bb3fff640 1 -- 172.21.15.132:0/2225141162 >> v1:172.21.15.187:6789/0 conn(0x7f0bbc0b4ec0 legacy=0x7f0bbc06a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.884+0000 7f0bb3fff640 1 -- 172.21.15.132:0/2225141162 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0bbc0d0fc0 con 0x7f0bbc1611b0 2023-12-20T04:46:25.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.885+0000 7f0bb3fff640 1 --2- 172.21.15.132:0/2225141162 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc1611b0 0x7f0bbc0b4980 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40097a0 tx=0x7f0ba402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c6de9cf866afe5d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:25.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.885+0000 7f0bba7fc640 1 -- 172.21.15.132:0/2225141162 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4030610 con 0x7f0bbc1611b0 2023-12-20T04:46:25.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.885+0000 7f0bba7fc640 1 -- 172.21.15.132:0/2225141162 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba4030770 con 0x7f0bbc1611b0 2023-12-20T04:46:25.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.885+0000 7f0bba7fc640 1 -- 172.21.15.132:0/2225141162 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4030b00 con 0x7f0bbc1611b0 2023-12-20T04:46:25.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.886+0000 7f0bc1a5f640 1 -- 172.21.15.132:0/2225141162 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc1611b0 msgr2=0x7f0bbc0b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.886+0000 7f0bc1a5f640 1 --2- 172.21.15.132:0/2225141162 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc1611b0 0x7f0bbc0b4980 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f0ba40097a0 tx=0x7f0ba402b960 comp rx=0 tx=0).stop 2023-12-20T04:46:25.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.886+0000 7f0bc1a5f640 1 -- 172.21.15.132:0/2225141162 shutdown_connections 2023-12-20T04:46:25.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.886+0000 7f0bc1a5f640 1 --2- 172.21.15.132:0/2225141162 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc1611b0 0x7f0bbc0b4980 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.886+0000 7f0bc1a5f640 1 --2- 172.21.15.132:0/2225141162 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bbc160450 0x7f0bbc160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.886+0000 7f0bc1a5f640 1 -- 172.21.15.132:0/2225141162 >> 172.21.15.132:0/2225141162 conn(0x7f0bbc0cf980 msgr2=0x7f0bbc0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:25.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.886+0000 7f0bc1a5f640 1 -- 172.21.15.132:0/2225141162 shutdown_connections 2023-12-20T04:46:25.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.886+0000 7f0bc1a5f640 1 -- 172.21.15.132:0/2225141162 wait complete. 2023-12-20T04:46:25.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.887+0000 7f0bc1a5f640 1 Processor -- start 2023-12-20T04:46:25.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.887+0000 7f0bc1a5f640 1 -- start start 2023-12-20T04:46:25.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.888+0000 7f0bc1a5f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bbc0b4ec0 0x7f0bbc0c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.888+0000 7f0bc1a5f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc160450 0x7f0bbc0c8810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.888+0000 7f0bc1a5f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc1611b0 0x7f0bbc0d3710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.888+0000 7f0bc1a5f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0cb1c0 con 0x7f0bbc160450 2023-12-20T04:46:25.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.888+0000 7f0bc1a5f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0c8d50 con 0x7f0bbc1611b0 2023-12-20T04:46:25.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.888+0000 7f0bc1a5f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0bbc0d3c50 con 0x7f0bbc0b4ec0 2023-12-20T04:46:25.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.888+0000 7f0bb3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc160450 0x7f0bbc0c8810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.888+0000 7f0bb3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc160450 0x7f0bbc0c8810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37390/0 (socket says 172.21.15.132:37390) 2023-12-20T04:46:25.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.888+0000 7f0bb3fff640 1 -- 172.21.15.132:0/2284849837 learned_addr learned my addr 172.21.15.132:0/2284849837 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:25.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.888+0000 7f0bbb7fe640 1 --2- 172.21.15.132:0/2284849837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc1611b0 0x7f0bbc0d3710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.888+0000 7f0bbaffd640 1 --2- 172.21.15.132:0/2284849837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bbc0b4ec0 0x7f0bbc0c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.888+0000 7f0bb3fff640 1 -- 172.21.15.132:0/2284849837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bbc0b4ec0 msgr2=0x7f0bbc0c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.888+0000 7f0bb3fff640 1 --2- 172.21.15.132:0/2284849837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bbc0b4ec0 0x7f0bbc0c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.888+0000 7f0bb3fff640 1 -- 172.21.15.132:0/2284849837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc1611b0 msgr2=0x7f0bbc0d3710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:25.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.888+0000 7f0bb3fff640 1 --2- 172.21.15.132:0/2284849837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc1611b0 0x7f0bbc0d3710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:25.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.888+0000 7f0bb3fff640 1 -- 172.21.15.132:0/2284849837 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ba4009400 con 0x7f0bbc160450 2023-12-20T04:46:25.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.888+0000 7f0bb3fff640 1 --2- 172.21.15.132:0/2284849837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc160450 0x7f0bbc0c8810 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009890 tx=0x7f0ba40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:25.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.889+0000 7f0bb8ff9640 1 -- 172.21.15.132:0/2284849837 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba403e070 con 0x7f0bbc160450 2023-12-20T04:46:25.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.889+0000 7f0bb8ff9640 1 -- 172.21.15.132:0/2284849837 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0ba4030e10 con 0x7f0bbc160450 2023-12-20T04:46:25.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.889+0000 7f0bc1a5f640 1 -- 172.21.15.132:0/2284849837 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0bbc0ca5b0 con 0x7f0bbc160450 2023-12-20T04:46:25.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.889+0000 7f0bb8ff9640 1 -- 172.21.15.132:0/2284849837 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0ba4039c60 con 0x7f0bbc160450 2023-12-20T04:46:25.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.889+0000 7f0bc1a5f640 1 -- 172.21.15.132:0/2284849837 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0bbc0cab70 con 0x7f0bbc160450 2023-12-20T04:46:25.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.890+0000 7f0bc1a5f640 1 -- 172.21.15.132:0/2284849837 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0bbc0cb370 con 0x7f0bbc160450 2023-12-20T04:46:25.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.890+0000 7f0bb8ff9640 1 -- 172.21.15.132:0/2284849837 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0ba40423f0 con 0x7f0bbc160450 2023-12-20T04:46:25.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.890+0000 7f0bb8ff9640 1 --2- 172.21.15.132:0/2284849837 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b9c06a430 0x7f0b9c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:25.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.890+0000 7f0bbaffd640 1 --2- 172.21.15.132:0/2284849837 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b9c06a430 0x7f0b9c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:25.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.890+0000 7f0bb8ff9640 1 -- 172.21.15.132:0/2284849837 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0ba40aa3a0 con 0x7f0bbc160450 2023-12-20T04:46:25.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.891+0000 7f0bbaffd640 1 --2- 172.21.15.132:0/2284849837 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b9c06a430 0x7f0b9c06c8f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009b40 tx=0x7f0bac009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:25.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:25.895+0000 7f0bb8ff9640 1 -- 172.21.15.132:0/2284849837 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0ba4075a40 con 0x7f0bbc160450 2023-12-20T04:46:26.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.058+0000 7f0bc1a5f640 1 -- 172.21.15.132:0/2284849837 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0bbc0d1580 con 0x7f0b9c06a430 2023-12-20T04:46:26.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.065+0000 7f0bb8ff9640 1 -- 172.21.15.132:0/2284849837 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+275569 (secure 0 0 0) 0x7f0bac011a60 con 0x7f0b9c06a430 2023-12-20T04:46:26.070 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:26.072 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:46:26.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.068+0000 7f0bc1a5f640 1 -- 172.21.15.132:0/2284849837 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b9c06a430 msgr2=0x7f0b9c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:26.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.068+0000 7f0bc1a5f640 1 --2- 172.21.15.132:0/2284849837 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b9c06a430 0x7f0b9c06c8f0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f0bac009b40 tx=0x7f0bac009190 comp rx=0 tx=0).stop 2023-12-20T04:46:26.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.068+0000 7f0bc1a5f640 1 -- 172.21.15.132:0/2284849837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc160450 msgr2=0x7f0bbc0c8810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:26.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.068+0000 7f0bc1a5f640 1 --2- 172.21.15.132:0/2284849837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc160450 0x7f0bbc0c8810 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f0ba4009890 tx=0x7f0ba40046c0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.069+0000 7f0bc1a5f640 1 -- 172.21.15.132:0/2284849837 shutdown_connections 2023-12-20T04:46:26.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.069+0000 7f0bc1a5f640 1 --2- 172.21.15.132:0/2284849837 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b9c06a430 0x7f0b9c06c8f0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.069+0000 7f0bc1a5f640 1 --2- 172.21.15.132:0/2284849837 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0bbc1611b0 0x7f0bbc0d3710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.069+0000 7f0bc1a5f640 1 --2- 172.21.15.132:0/2284849837 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0bbc160450 0x7f0bbc0c8810 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.069+0000 7f0bc1a5f640 1 --2- 172.21.15.132:0/2284849837 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0bbc0b4ec0 0x7f0bbc0c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.069+0000 7f0bc1a5f640 1 -- 172.21.15.132:0/2284849837 >> 172.21.15.132:0/2284849837 conn(0x7f0bbc0cf980 msgr2=0x7f0bbc15bb50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:26.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.069+0000 7f0bc1a5f640 1 -- 172.21.15.132:0/2284849837 shutdown_connections 2023-12-20T04:46:26.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.069+0000 7f0bc1a5f640 1 -- 172.21.15.132:0/2284849837 wait complete. 2023-12-20T04:46:26.082 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2023-12-20T04:46:24.138474+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":46,"acting":46,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":2,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4340,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1558159,"statfs":{"total":1600000000,"available":1595555520,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000674"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117677+0000","last_change":"2023-12-20T04:46:21.117677+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117677+0000","last_undegraded":"2023-12-20T04:46:21.117677+0000","last_fullsized":"2023-12-20T04:46:21.117677+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:45:34.103863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118081+0000","last_change":"2023-12-20T04:46:21.118081+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118081+0000","last_undegraded":"2023-12-20T04:46:21.118081+0000","last_fullsized":"2023-12-20T04:46:21.118081+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:31:16.073200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.119301+0000","last_change":"2023-12-20T04:46:21.119301+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.119301+0000","last_undegraded":"2023-12-20T04:46:21.119301+0000","last_fullsized":"2023-12-20T04:46:21.119301+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:57:59.044568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.113570+0000","last_change":"2023-12-20T04:46:21.113570+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.113570+0000","last_undegraded":"2023-12-20T04:46:21.113570+0000","last_fullsized":"2023-12-20T04:46:21.113570+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:24:36.303161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.119130+0000","last_change":"2023-12-20T04:46:21.119130+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.119130+0000","last_undegraded":"2023-12-20T04:46:21.119130+0000","last_fullsized":"2023-12-20T04:46:21.119130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:49:26.182419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117812+0000","last_change":"2023-12-20T04:46:21.117812+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117812+0000","last_undegraded":"2023-12-20T04:46:21.117812+0000","last_fullsized":"2023-12-20T04:46:21.117812+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:59:16.940603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118469+0000","last_change":"2023-12-20T04:46:21.118469+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118469+0000","last_undegraded":"2023-12-20T04:46:21.118469+0000","last_fullsized":"2023-12-20T04:46:21.118469+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:51:05.802721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.15","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.113622+0000","last_change":"2023-12-20T04:46:21.113622+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.113622+0000","last_undegraded":"2023-12-20T04:46:21.113622+0000","last_fullsized":"2023-12-20T04:46:21.113622+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:26:04.269978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[5],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118924+0000","last_change":"2023-12-20T04:46:21.118924+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118924+0000","last_undegraded":"2023-12-20T04:46:21.118924+0000","last_fullsized":"2023-12-20T04:46:21.118924+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:59:41.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.114516+0000","last_change":"2023-12-20T04:46:21.114516+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.114516+0000","last_undegraded":"2023-12-20T04:46:21.114516+0000","last_fullsized":"2023-12-20T04:46:21.114516+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:59:16.940603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.10","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117922+0000","last_change":"2023-12-20T04:46:21.117922+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117922+0000","last_undegraded":"2023-12-20T04:46:21.117922+0000","last_fullsized":"2023-12-20T04:46:21.117922+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:14:24.821694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.f","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.119421+0000","last_change":"2023-12-20T04:46:21.119421+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.119421+0000","last_undegraded":"2023-12-20T04:46:21.119421+0000","last_fullsized":"2023-12-20T04:46:21.119421+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:07:59.913149+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[3],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.e","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117060+0000","last_change":"2023-12-20T04:46:21.117060+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117060+0000","last_undegraded":"2023-12-20T04:46:21.117060+0000","last_fullsized":"2023-12-20T04:46:21.117060+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:06:05.221249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.d","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118565+0000","last_change":"2023-12-20T04:46:21.118565+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118565+0000","last_undegraded":"2023-12-20T04:46:21.118565+0000","last_fullsized":"2023-12-20T04:46:21.118565+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:43:40.481954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117212+0000","last_change":"2023-12-20T04:46:21.117212+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117212+0000","last_undegraded":"2023-12-20T04:46:21.117212+0000","last_fullsized":"2023-12-20T04:46:21.117212+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:05:01.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117912+0000","last_change":"2023-12-20T04:46:21.117912+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117912+0000","last_undegraded":"2023-12-20T04:46:21.117912+0000","last_fullsized":"2023-12-20T04:46:21.117912+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:36:43.142500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.114529+0000","last_change":"2023-12-20T04:46:21.114529+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.114529+0000","last_undegraded":"2023-12-20T04:46:21.114529+0000","last_fullsized":"2023-12-20T04:46:21.114529+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:32:07.943631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.7","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118127+0000","last_change":"2023-12-20T04:46:21.118127+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118127+0000","last_undegraded":"2023-12-20T04:46:21.118127+0000","last_fullsized":"2023-12-20T04:46:21.118127+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:14:46.240010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.114462+0000","last_change":"2023-12-20T04:46:21.114462+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.114462+0000","last_undegraded":"2023-12-20T04:46:21.114462+0000","last_fullsized":"2023-12-20T04:46:21.114462+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:06:59.201562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:21.106383+0000","last_change":"2023-12-20T04:46:21.106383+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.106383+0000","last_undegraded":"2023-12-20T04:46:21.106383+0000","last_fullsized":"2023-12-20T04:46:21.106383+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.117397+0000","last_change":"2023-12-20T04:46:21.117397+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.117397+0000","last_undegraded":"2023-12-20T04:46:21.117397+0000","last_fullsized":"2023-12-20T04:46:21.117397+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:32:07.943631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118335+0000","last_change":"2023-12-20T04:46:21.118335+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118335+0000","last_undegraded":"2023-12-20T04:46:21.118335+0000","last_fullsized":"2023-12-20T04:46:21.118335+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:51:07.255012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:46:22.111604+0000","last_change":"2023-12-20T04:46:22.111604+0000","last_active":"2023-12-20T04:46:22.111604+0000","last_peered":"2023-12-20T04:46:22.111604+0000","last_clean":"2023-12-20T04:46:22.111604+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:22.111604+0000","last_undegraded":"2023-12-20T04:46:22.111604+0000","last_fullsized":"2023-12-20T04:46:22.111604+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"10.b","version":"0'0","reported_seq":1,"reported_epoch":79,"state":"creating+peering","last_fresh":"2023-12-20T04:46:21.118723+0000","last_change":"2023-12-20T04:46:21.118723+0000","last_active":"2023-12-20T04:46:21.106383+0000","last_peered":"2023-12-20T04:46:21.106383+0000","last_clean":"2023-12-20T04:46:21.106383+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:46:21.118723+0000","last_undegraded":"2023-12-20T04:46:21.118723+0000","last_fullsized":"2023-12-20T04:46:21.118723+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:08:23.337153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[1],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":215,"reported_epoch":78,"state":"active+clean","last_fresh":"2023-12-20T04:46:19.529434+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:46:19.529434+0000","last_peered":"2023-12-20T04:46:19.529434+0000","last_clean":"2023-12-20T04:46:19.529434+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:46:19.529434+0000","last_undegraded":"2023-12-20T04:46:19.529434+0000","last_fullsized":"2023-12-20T04:46:19.529434+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":44,"acting":44,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":974,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194337,"statfs":{"total":200000000,"available":199001664,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.45200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.747,"5min":0.754,"15min":0.754},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.37,"5min":0.315,"15min":0.315},"max":{"1min":0.67500000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55000000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68500000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.44500000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76600000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.58399999999999996}]},{"osd":2,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.751,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71599999999999997,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.47699999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71899999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.72999999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.60799999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.48699999999999999,"15min":0.48599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.61299999999999999,"5min":0.753,"15min":0.753},"last":0.69299999999999995},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.59699999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.61299999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68500000000000005,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.64100000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.53900000000000003,"15min":0.55300000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64400000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66300000000000003,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.623}]}]},{"osd":6,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48899999999999999,"15min":0.48999999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.61299999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.314,"15min":0.314},"max":{"1min":0.63700000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.52400000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71499999999999997,"5min":0.751,"15min":0.751},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57099999999999995,"15min":0.57799999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.61199999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.34399999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.55400000000000005}]},{"osd":3,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.50800000000000001,"15min":0.49199999999999999},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.377},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.42399999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.46300000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.502,"15min":0.51200000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.67500000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.5,"15min":0.49299999999999999},"min":{"1min":0.38700000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.52700000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70899999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.35699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72499999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.45200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.42399999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.56799999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.505},"min":{"1min":0.40600000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69999999999999996,"5min":0.745,"15min":0.745},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.498,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.65300000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.41899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68700000000000006,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.53900000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.41599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.499},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52200000000000002,"15min":0.51500000000000001},"min":{"1min":0.441,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.376}]},{"osd":3,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.67300000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.41599999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.48399999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.32900000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.74399999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.314},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47899999999999998,"15min":0.48199999999999998},"min":{"1min":0.318,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69399999999999995,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.34100000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.33200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.75700000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.318,"5min":0.31,"15min":0.31},"max":{"1min":0.81200000000000006,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.36399999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52200000000000002,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73399999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60199999999999998,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80000000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.68400000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.40600000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.50800000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.40400000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.435},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.52900000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69699999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.55300000000000005},"min":{"1min":0.39000000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.48699999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.47699999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.74299999999999999,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.71199999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57899999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.67100000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.497,"15min":0.50600000000000001},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.625,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68300000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.63500000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50900000000000001,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.66700000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.65500000000000003}]}]},{"osd":3,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.33500000000000002},"min":{"1min":0.26100000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.44900000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.315},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.254,"5min":0.246,"15min":0.246},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.30499999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.316},"min":{"1min":0.23300000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.28499999999999998},{"interface":"front","average":{"1min":0.379,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.30599999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.51700000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.29499999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.248,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.498,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.378,"15min":0.371},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.25}]},{"osd":4,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.80500000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81499999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.46600000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.40200000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.433},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.437,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.752,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40999999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.41099999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.749,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.55200000000000005},"min":{"1min":0.45100000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.37}]},{"osd":7,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.41199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76000000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.41899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.30399999999999999,"15min":0.28999999999999998},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.437},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.37,"15min":0.33800000000000002},"min":{"1min":0.23200000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":1.135,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.33700000000000002,"15min":0.32500000000000001},"min":{"1min":0.23300000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.35599999999999998,"15min":0.34399999999999997},"min":{"1min":0.253,"5min":0.245,"15min":0.245},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.48399999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.372,"15min":0.35099999999999998},"min":{"1min":0.29399999999999998,"5min":0.216,"15min":0.216},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.496},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.376,"15min":0.36499999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.39900000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58399999999999996,"15min":0.56699999999999995},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.79300000000000004,"5min":2.347,"15min":2.347},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.41999999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.432,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60799999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.57299999999999995},"min":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76000000000000001,"5min":2.274,"15min":2.274},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.46000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1659999999999999,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.62}]}]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":398,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194914,"statfs":{"total":200000000,"available":199592032,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.29699999999999999,"15min":0.28399999999999997},"min":{"1min":0.221,"5min":0.187,"15min":0.187},"max":{"1min":0.48299999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32500000000000001},"min":{"1min":0.28999999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.38100000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.312,"15min":0.29999999999999999},"min":{"1min":0.223,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51400000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.34300000000000003},"min":{"1min":0.307,"5min":0.224,"15min":0.224},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.40500000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.191,"15min":0.191},"max":{"1min":0.52300000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.434},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.35099999999999998},"min":{"1min":0.30199999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.29099999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72699999999999998,"5min":0.873,"15min":0.873},"last":0.624},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.58999999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71399999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.57199999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.68400000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.67900000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.41399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78100000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.64200000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82399999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.46100000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76500000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.66400000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":974,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194337,"statfs":{"total":200000000,"available":199001664,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.311,"15min":0.30599999999999999},"min":{"1min":0.23100000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.46500000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.21099999999999999},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.31900000000000001,"15min":0.307},"min":{"1min":0.24199999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.38900000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.35599999999999998,"15min":0.35399999999999998},"min":{"1min":0.24199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.53600000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.318},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.28799999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.29299999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.31900000000000001},"min":{"1min":0.245,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.373,"15min":0.36399999999999999},"min":{"1min":0.33500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.40500000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74399999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.40799999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.497}]},{"osd":5,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.52600000000000002,"15min":0.51300000000000001},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78700000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.40100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.50600000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82799999999999996,"5min":0.873,"15min":0.873},"last":0.56200000000000006},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84699999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.44800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53200000000000003}]}]}],"pool_statfs":[]}} 2023-12-20T04:46:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3f is not active+clean 2023-12-20T04:46:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3e is not active+clean 2023-12-20T04:46:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3d is not active+clean 2023-12-20T04:46:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3c is not active+clean 2023-12-20T04:46:26.087 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3b is not active+clean 2023-12-20T04:46:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3a is not active+clean 2023-12-20T04:46:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.39 is not active+clean 2023-12-20T04:46:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.38 is not active+clean 2023-12-20T04:46:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.37 is not active+clean 2023-12-20T04:46:26.088 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.36 is not active+clean 2023-12-20T04:46:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.35 is not active+clean 2023-12-20T04:46:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.34 is not active+clean 2023-12-20T04:46:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.33 is not active+clean 2023-12-20T04:46:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.32 is not active+clean 2023-12-20T04:46:26.089 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.31 is not active+clean 2023-12-20T04:46:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.30 is not active+clean 2023-12-20T04:46:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2f is not active+clean 2023-12-20T04:46:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2e is not active+clean 2023-12-20T04:46:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2d is not active+clean 2023-12-20T04:46:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.090 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2c is not active+clean 2023-12-20T04:46:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2b is not active+clean 2023-12-20T04:46:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2a is not active+clean 2023-12-20T04:46:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.29 is not active+clean 2023-12-20T04:46:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.28 is not active+clean 2023-12-20T04:46:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.27 is not active+clean 2023-12-20T04:46:26.091 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.26 is not active+clean 2023-12-20T04:46:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.25 is not active+clean 2023-12-20T04:46:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.24 is not active+clean 2023-12-20T04:46:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.23 is not active+clean 2023-12-20T04:46:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.22 is not active+clean 2023-12-20T04:46:26.092 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.21 is not active+clean 2023-12-20T04:46:26.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.20 is not active+clean 2023-12-20T04:46:26.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1e is not active+clean 2023-12-20T04:46:26.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1f is not active+clean 2023-12-20T04:46:26.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.117677+0000', 'last_change': '2023-12-20T04:46:21.117677+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.117677+0000', 'last_undegraded': '2023-12-20T04:46:21.117677+0000', 'last_fullsized': '2023-12-20T04:46:21.117677+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:45:34.103863+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:46:26.093 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1f is not active+clean 2023-12-20T04:46:26.093 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1e is not active+clean 2023-12-20T04:46:26.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:21.106383+0000', 'last_change': '2023-12-20T04:46:21.106383+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.106383+0000', 'last_undegraded': '2023-12-20T04:46:21.106383+0000', 'last_fullsized': '2023-12-20T04:46:21.106383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1c is not active+clean 2023-12-20T04:46:26.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1d is not active+clean 2023-12-20T04:46:26.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.118081+0000', 'last_change': '2023-12-20T04:46:21.118081+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.118081+0000', 'last_undegraded': '2023-12-20T04:46:21.118081+0000', 'last_fullsized': '2023-12-20T04:46:21.118081+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:31:16.073200+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:46:26.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1d is not active+clean 2023-12-20T04:46:26.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1c is not active+clean 2023-12-20T04:46:26.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.119301+0000', 'last_change': '2023-12-20T04:46:21.119301+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.119301+0000', 'last_undegraded': '2023-12-20T04:46:21.119301+0000', 'last_fullsized': '2023-12-20T04:46:21.119301+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T12:57:59.044568+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:46:26.094 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1a is not active+clean 2023-12-20T04:46:26.094 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1b is not active+clean 2023-12-20T04:46:26.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.113570+0000', 'last_change': '2023-12-20T04:46:21.113570+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.113570+0000', 'last_undegraded': '2023-12-20T04:46:21.113570+0000', 'last_fullsized': '2023-12-20T04:46:21.113570+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:24:36.303161+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 4], 'acting': [3, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [4], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:46:26.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1b is not active+clean 2023-12-20T04:46:26.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1a is not active+clean 2023-12-20T04:46:26.095 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.119130+0000', 'last_change': '2023-12-20T04:46:21.119130+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.119130+0000', 'last_undegraded': '2023-12-20T04:46:21.119130+0000', 'last_fullsized': '2023-12-20T04:46:21.119130+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T08:49:26.182419+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:46:26.095 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.18 is not active+clean 2023-12-20T04:46:26.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.19 is not active+clean 2023-12-20T04:46:26.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:21.106383+0000', 'last_change': '2023-12-20T04:46:21.106383+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.106383+0000', 'last_undegraded': '2023-12-20T04:46:21.106383+0000', 'last_fullsized': '2023-12-20T04:46:21.106383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.19 is not active+clean 2023-12-20T04:46:26.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.18 is not active+clean 2023-12-20T04:46:26.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:21.106383+0000', 'last_change': '2023-12-20T04:46:21.106383+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.106383+0000', 'last_undegraded': '2023-12-20T04:46:21.106383+0000', 'last_fullsized': '2023-12-20T04:46:21.106383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.16 is not active+clean 2023-12-20T04:46:26.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.096 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.17 is not active+clean 2023-12-20T04:46:26.096 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.117812+0000', 'last_change': '2023-12-20T04:46:21.117812+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.117812+0000', 'last_undegraded': '2023-12-20T04:46:21.117812+0000', 'last_fullsized': '2023-12-20T04:46:21.117812+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T07:59:16.940603+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:46:26.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.17 is not active+clean 2023-12-20T04:46:26.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.16 is not active+clean 2023-12-20T04:46:26.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.118469+0000', 'last_change': '2023-12-20T04:46:21.118469+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.118469+0000', 'last_undegraded': '2023-12-20T04:46:21.118469+0000', 'last_fullsized': '2023-12-20T04:46:21.118469+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T13:51:05.802721+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:46:26.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.14 is not active+clean 2023-12-20T04:46:26.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.15 is not active+clean 2023-12-20T04:46:26.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.113622+0000', 'last_change': '2023-12-20T04:46:21.113622+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.113622+0000', 'last_undegraded': '2023-12-20T04:46:21.113622+0000', 'last_fullsized': '2023-12-20T04:46:21.113622+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T07:26:04.269978+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 5], 'acting': [3, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [5], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:46:26.097 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.15 is not active+clean 2023-12-20T04:46:26.097 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.14 is not active+clean 2023-12-20T04:46:26.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:21.106383+0000', 'last_change': '2023-12-20T04:46:21.106383+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.106383+0000', 'last_undegraded': '2023-12-20T04:46:21.106383+0000', 'last_fullsized': '2023-12-20T04:46:21.106383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.12 is not active+clean 2023-12-20T04:46:26.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.13 is not active+clean 2023-12-20T04:46:26.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:21.106383+0000', 'last_change': '2023-12-20T04:46:21.106383+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.106383+0000', 'last_undegraded': '2023-12-20T04:46:21.106383+0000', 'last_fullsized': '2023-12-20T04:46:21.106383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.13 is not active+clean 2023-12-20T04:46:26.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.12 is not active+clean 2023-12-20T04:46:26.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.118924+0000', 'last_change': '2023-12-20T04:46:21.118924+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.118924+0000', 'last_undegraded': '2023-12-20T04:46:21.118924+0000', 'last_fullsized': '2023-12-20T04:46:21.118924+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T13:59:41.947397+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:46:26.098 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.10 is not active+clean 2023-12-20T04:46:26.098 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.11 is not active+clean 2023-12-20T04:46:26.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.114516+0000', 'last_change': '2023-12-20T04:46:21.114516+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.114516+0000', 'last_undegraded': '2023-12-20T04:46:21.114516+0000', 'last_fullsized': '2023-12-20T04:46:21.114516+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T07:59:16.940603+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:46:26.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.11 is not active+clean 2023-12-20T04:46:26.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.10 is not active+clean 2023-12-20T04:46:26.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.117922+0000', 'last_change': '2023-12-20T04:46:21.117922+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.117922+0000', 'last_undegraded': '2023-12-20T04:46:21.117922+0000', 'last_fullsized': '2023-12-20T04:46:21.117922+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:14:24.821694+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:46:26.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.e is not active+clean 2023-12-20T04:46:26.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.099 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.f is not active+clean 2023-12-20T04:46:26.099 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.119421+0000', 'last_change': '2023-12-20T04:46:21.119421+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.119421+0000', 'last_undegraded': '2023-12-20T04:46:21.119421+0000', 'last_fullsized': '2023-12-20T04:46:21.119421+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T11:07:59.913149+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [3], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:46:26.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.f is not active+clean 2023-12-20T04:46:26.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.e is not active+clean 2023-12-20T04:46:26.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.117060+0000', 'last_change': '2023-12-20T04:46:21.117060+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.117060+0000', 'last_undegraded': '2023-12-20T04:46:21.117060+0000', 'last_fullsized': '2023-12-20T04:46:21.117060+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T08:06:05.221249+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:46:26.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.c is not active+clean 2023-12-20T04:46:26.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.d is not active+clean 2023-12-20T04:46:26.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.118565+0000', 'last_change': '2023-12-20T04:46:21.118565+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.118565+0000', 'last_undegraded': '2023-12-20T04:46:21.118565+0000', 'last_fullsized': '2023-12-20T04:46:21.118565+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T12:43:40.481954+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:46:26.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.d is not active+clean 2023-12-20T04:46:26.100 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.100 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.c is not active+clean 2023-12-20T04:46:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.117212+0000', 'last_change': '2023-12-20T04:46:21.117212+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.117212+0000', 'last_undegraded': '2023-12-20T04:46:21.117212+0000', 'last_fullsized': '2023-12-20T04:46:21.117212+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:05:01.785633+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 4], 'acting': [7, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:46:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.b is not active+clean 2023-12-20T04:46:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.a is not active+clean 2023-12-20T04:46:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.117912+0000', 'last_change': '2023-12-20T04:46:21.117912+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.117912+0000', 'last_undegraded': '2023-12-20T04:46:21.117912+0000', 'last_fullsized': '2023-12-20T04:46:21.117912+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:36:43.142500+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [0], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:46:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.8 is not active+clean 2023-12-20T04:46:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.9 is not active+clean 2023-12-20T04:46:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.114529+0000', 'last_change': '2023-12-20T04:46:21.114529+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.114529+0000', 'last_undegraded': '2023-12-20T04:46:21.114529+0000', 'last_fullsized': '2023-12-20T04:46:21.114529+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:32:07.943631+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 2], 'acting': [5, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:46:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.9 is not active+clean 2023-12-20T04:46:26.101 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.8 is not active+clean 2023-12-20T04:46:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:21.106383+0000', 'last_change': '2023-12-20T04:46:21.106383+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.106383+0000', 'last_undegraded': '2023-12-20T04:46:21.106383+0000', 'last_fullsized': '2023-12-20T04:46:21.106383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.6 is not active+clean 2023-12-20T04:46:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.7 is not active+clean 2023-12-20T04:46:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.118127+0000', 'last_change': '2023-12-20T04:46:21.118127+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.118127+0000', 'last_undegraded': '2023-12-20T04:46:21.118127+0000', 'last_fullsized': '2023-12-20T04:46:21.118127+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T13:14:46.240010+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:46:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.7 is not active+clean 2023-12-20T04:46:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.6 is not active+clean 2023-12-20T04:46:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.114462+0000', 'last_change': '2023-12-20T04:46:21.114462+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.114462+0000', 'last_undegraded': '2023-12-20T04:46:21.114462+0000', 'last_fullsized': '2023-12-20T04:46:21.114462+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:06:59.201562+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:46:26.102 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.4 is not active+clean 2023-12-20T04:46:26.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.5 is not active+clean 2023-12-20T04:46:26.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:21.106383+0000', 'last_change': '2023-12-20T04:46:21.106383+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.106383+0000', 'last_undegraded': '2023-12-20T04:46:21.106383+0000', 'last_fullsized': '2023-12-20T04:46:21.106383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.5 is not active+clean 2023-12-20T04:46:26.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.4 is not active+clean 2023-12-20T04:46:26.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:21.106383+0000', 'last_change': '2023-12-20T04:46:21.106383+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.106383+0000', 'last_undegraded': '2023-12-20T04:46:21.106383+0000', 'last_fullsized': '2023-12-20T04:46:21.106383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.2 is not active+clean 2023-12-20T04:46:26.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.103 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.3 is not active+clean 2023-12-20T04:46:26.103 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:21.106383+0000', 'last_change': '2023-12-20T04:46:21.106383+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.106383+0000', 'last_undegraded': '2023-12-20T04:46:21.106383+0000', 'last_fullsized': '2023-12-20T04:46:21.106383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.3 is not active+clean 2023-12-20T04:46:26.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.2 is not active+clean 2023-12-20T04:46:26.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:21.106383+0000', 'last_change': '2023-12-20T04:46:21.106383+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.106383+0000', 'last_undegraded': '2023-12-20T04:46:21.106383+0000', 'last_fullsized': '2023-12-20T04:46:21.106383+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.0 is not active+clean 2023-12-20T04:46:26.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.1 is not active+clean 2023-12-20T04:46:26.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.117397+0000', 'last_change': '2023-12-20T04:46:21.117397+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.117397+0000', 'last_undegraded': '2023-12-20T04:46:21.117397+0000', 'last_fullsized': '2023-12-20T04:46:21.117397+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:32:07.943631+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:46:26.104 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.1 is not active+clean 2023-12-20T04:46:26.104 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.0 is not active+clean 2023-12-20T04:46:26.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.118335+0000', 'last_change': '2023-12-20T04:46:21.118335+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.118335+0000', 'last_undegraded': '2023-12-20T04:46:21.118335+0000', 'last_fullsized': '2023-12-20T04:46:21.118335+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:51:07.255012+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:46:26.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 11.a is not active+clean 2023-12-20T04:46:26.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '11.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:46:22.111604+0000', 'last_change': '2023-12-20T04:46:22.111604+0000', 'last_active': '2023-12-20T04:46:22.111604+0000', 'last_peered': '2023-12-20T04:46:22.111604+0000', 'last_clean': '2023-12-20T04:46:22.111604+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:22.111604+0000', 'last_undegraded': '2023-12-20T04:46:22.111604+0000', 'last_fullsized': '2023-12-20T04:46:22.111604+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:22.111604+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:46:26.105 INFO:tasks.cephfs.filesystem.ceph_manager:PG 10.b is not active+clean 2023-12-20T04:46:26.105 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '10.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 79, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:46:21.118723+0000', 'last_change': '2023-12-20T04:46:21.118723+0000', 'last_active': '2023-12-20T04:46:21.106383+0000', 'last_peered': '2023-12-20T04:46:21.106383+0000', 'last_clean': '2023-12-20T04:46:21.106383+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:46:21.118723+0000', 'last_undegraded': '2023-12-20T04:46:21.118723+0000', 'last_fullsized': '2023-12-20T04:46:21.118723+0000', 'mapping_epoch': 79, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 79, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'last_clean_scrub_stamp': '2023-12-20T04:46:21.106383+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:08:23.337153+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [1], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:46:26.106 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-20T04:46:26.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.219+0000 7fbcee9b1640 1 Processor -- start 2023-12-20T04:46:26.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.219+0000 7fbcee9b1640 1 -- start start 2023-12-20T04:46:26.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.220+0000 7fbcee9b1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbce80b1d10 0x7fbce80b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:26.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.220+0000 7fbcee9b1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce80cd660 con 0x7fbce80b4f90 2023-12-20T04:46:26.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.220+0000 7fbcee9b1640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbce80cd940 con 0x7fbce815d110 2023-12-20T04:46:26.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.220+0000 7fbcee9b1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbce8160e60 con 0x7fbce80b1d10 2023-12-20T04:46:26.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.220+0000 7fbcecf4e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbce80b1d10 0x7fbce80b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:26.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.220+0000 7fbce77fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbce80b4f90 0x7fbce80d0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43734/0 (socket says 172.21.15.132:43734) 2023-12-20T04:46:26.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.220+0000 7fbcecf4e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbce80b1d10 0x7fbce80b21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37396/0 (socket says 172.21.15.132:37396) 2023-12-20T04:46:26.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.220+0000 7fbce77fe640 1 -- 172.21.15.132:0/3097903283 learned_addr learned my addr 172.21.15.132:0/3097903283 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:26.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.220+0000 7fbcecf4e640 1 -- 172.21.15.132:0/3097903283 >> v1:172.21.15.187:6789/0 conn(0x7fbce815d110 legacy=0x7fbce80b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:26.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.220+0000 7fbcecf4e640 1 -- 172.21.15.132:0/3097903283 >> v1:172.21.15.132:6789/0 conn(0x7fbce80b4f90 legacy=0x7fbce80d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:26.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.220+0000 7fbcecf4e640 1 -- 172.21.15.132:0/3097903283 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce8161140 con 0x7fbce80b1d10 2023-12-20T04:46:26.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.220+0000 7fbce6ffd640 1 -- 172.21.15.132:0/3097903283 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2483672787 0 0) 0x7fbce80cd660 con 0x7fbce80b4f90 2023-12-20T04:46:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.221+0000 7fbcecf4e640 1 --2- 172.21.15.132:0/3097903283 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbce80b1d10 0x7fbce80b21f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009d90 tx=0x7fbce002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8573225e7e1c1db server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.221+0000 7fbce6ffd640 1 -- 172.21.15.132:0/3097903283 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce002cd00 con 0x7fbce80b1d10 2023-12-20T04:46:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.221+0000 7fbce6ffd640 1 -- 172.21.15.132:0/3097903283 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbce002ce60 con 0x7fbce80b1d10 2023-12-20T04:46:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.221+0000 7fbce6ffd640 1 -- 172.21.15.132:0/3097903283 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbce0034660 con 0x7fbce80b1d10 2023-12-20T04:46:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.222+0000 7fbcee9b1640 1 -- 172.21.15.132:0/3097903283 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbce80b1d10 msgr2=0x7fbce80b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.222+0000 7fbcee9b1640 1 --2- 172.21.15.132:0/3097903283 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbce80b1d10 0x7fbce80b21f0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7fbce0009d90 tx=0x7fbce002bf50 comp rx=0 tx=0).stop 2023-12-20T04:46:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.222+0000 7fbcee9b1640 1 -- 172.21.15.132:0/3097903283 shutdown_connections 2023-12-20T04:46:26.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.222+0000 7fbcee9b1640 1 --2- 172.21.15.132:0/3097903283 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbce80b1d10 0x7fbce80b21f0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.222+0000 7fbcee9b1640 1 -- 172.21.15.132:0/3097903283 >> 172.21.15.132:0/3097903283 conn(0x7fbce80cf880 msgr2=0x7fbce80cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:26.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.222+0000 7fbcee9b1640 1 -- 172.21.15.132:0/3097903283 shutdown_connections 2023-12-20T04:46:26.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.222+0000 7fbcee9b1640 1 -- 172.21.15.132:0/3097903283 wait complete. 2023-12-20T04:46:26.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.223+0000 7fbcee9b1640 1 Processor -- start 2023-12-20T04:46:26.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.223+0000 7fbcee9b1640 1 -- start start 2023-12-20T04:46:26.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbcee9b1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbce80b1d10 0x7fbce8157730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:26.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbcee9b1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbce80b4f90 0x7fbce81581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:26.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbcee9b1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbce815d110 0x7fbce81546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:26.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbcee9b1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce8158700 con 0x7fbce80b1d10 2023-12-20T04:46:26.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbcee9b1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce80b31a0 con 0x7fbce80b4f90 2023-12-20T04:46:26.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbcee9b1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbce80b3480 con 0x7fbce815d110 2023-12-20T04:46:26.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbce7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbce80b1d10 0x7fbce8157730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:26.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbce7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbce80b1d10 0x7fbce8157730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37410/0 (socket says 172.21.15.132:37410) 2023-12-20T04:46:26.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbce7fff640 1 -- 172.21.15.132:0/2604902687 learned_addr learned my addr 172.21.15.132:0/2604902687 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:26.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbce77fe640 1 --2- 172.21.15.132:0/2604902687 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbce80b4f90 0x7fbce81581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:26.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbce7fff640 1 -- 172.21.15.132:0/2604902687 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbce815d110 msgr2=0x7fbce81546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:26.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbce7fff640 1 --2- 172.21.15.132:0/2604902687 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbce815d110 0x7fbce81546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbce7fff640 1 -- 172.21.15.132:0/2604902687 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbce80b4f90 msgr2=0x7fbce81581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:26.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbce7fff640 1 --2- 172.21.15.132:0/2604902687 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbce80b4f90 0x7fbce81581c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbce7fff640 1 -- 172.21.15.132:0/2604902687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce0009a70 con 0x7fbce80b1d10 2023-12-20T04:46:26.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbce7fff640 1 --2- 172.21.15.132:0/2604902687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbce80b1d10 0x7fbce8157730 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800c400 tx=0x7fbcd800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:26.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbce4ff9640 1 -- 172.21.15.132:0/2604902687 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd80052d0 con 0x7fbce80b1d10 2023-12-20T04:46:26.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbce4ff9640 1 -- 172.21.15.132:0/2604902687 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcd8005430 con 0x7fbce80b1d10 2023-12-20T04:46:26.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbcee9b1640 1 -- 172.21.15.132:0/2604902687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce80b3760 con 0x7fbce80b1d10 2023-12-20T04:46:26.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbce4ff9640 1 -- 172.21.15.132:0/2604902687 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcd8003830 con 0x7fbce80b1d10 2023-12-20T04:46:26.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.224+0000 7fbcee9b1640 1 -- 172.21.15.132:0/2604902687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce80b3d20 con 0x7fbce80b1d10 2023-12-20T04:46:26.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.225+0000 7fbcee9b1640 1 -- 172.21.15.132:0/2604902687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce804e840 con 0x7fbce80b1d10 2023-12-20T04:46:26.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.226+0000 7fbce4ff9640 1 -- 172.21.15.132:0/2604902687 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbcd8003990 con 0x7fbce80b1d10 2023-12-20T04:46:26.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.226+0000 7fbce4ff9640 1 --2- 172.21.15.132:0/2604902687 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbcd406a430 0x7fbcd406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:26.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.226+0000 7fbce4ff9640 1 -- 172.21.15.132:0/2604902687 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbcd8087e30 con 0x7fbce80b1d10 2023-12-20T04:46:26.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.226+0000 7fbce77fe640 1 --2- 172.21.15.132:0/2604902687 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbcd406a430 0x7fbcd406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:26.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.227+0000 7fbce77fe640 1 --2- 172.21.15.132:0/2604902687 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbcd406a430 0x7fbcd406c8f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc007fd0 tx=0x7fbcdc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:26.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.231+0000 7fbce4ff9640 1 -- 172.21.15.132:0/2604902687 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbcd80534b0 con 0x7fbce80b1d10 2023-12-20T04:46:26.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.460+0000 7fbcee9b1640 1 -- 172.21.15.132:0/2604902687 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fbce80cfe70 con 0x7fbce80b1d10 2023-12-20T04:46:26.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.460+0000 7fbce4ff9640 1 -- 172.21.15.132:0/2604902687 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1263 (secure 0 0 0) 0x7fbcd8056ad0 con 0x7fbce80b1d10 2023-12-20T04:46:26.462 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:26.462 INFO:teuthology.orchestra.run.smithi132.stdout:{"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":236,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":82,"num_osds":8,"num_up_osds":8,"osd_up_since":1703047355,"num_in_osds":8,"osd_in_since":1703047352,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":74},{"state_name":"creating+peering","count":22},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":4444480,"bytes_avail":1595555520,"bytes_total":1600000000,"unknown_pgs_ratio":0.76288658380508423,"inactive_pgs_ratio":0.22680412232875824},"fsmap":{"epoch":32,"id":5,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":5,"rank":0,"name":"d","status":"up:active","gid":6552}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":3,"modified":"2023-12-20T04:46:06.135473+0000","services":{"mds":{"daemons":{"summary":"","d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-20T04:46:26.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.462+0000 7fbcee9b1640 1 -- 172.21.15.132:0/2604902687 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbcd406a430 msgr2=0x7fbcd406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:26.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.462+0000 7fbcee9b1640 1 --2- 172.21.15.132:0/2604902687 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbcd406a430 0x7fbcd406c8f0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fbcdc007fd0 tx=0x7fbcdc009040 comp rx=0 tx=0).stop 2023-12-20T04:46:26.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.462+0000 7fbcee9b1640 1 -- 172.21.15.132:0/2604902687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbce80b1d10 msgr2=0x7fbce8157730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:26.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.462+0000 7fbcee9b1640 1 --2- 172.21.15.132:0/2604902687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbce80b1d10 0x7fbce8157730 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7fbcd800c400 tx=0x7fbcd800c8c0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.462+0000 7fbcee9b1640 1 -- 172.21.15.132:0/2604902687 shutdown_connections 2023-12-20T04:46:26.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.462+0000 7fbcee9b1640 1 --2- 172.21.15.132:0/2604902687 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbcd406a430 0x7fbcd406c8f0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.462+0000 7fbcee9b1640 1 --2- 172.21.15.132:0/2604902687 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbce815d110 0x7fbce81546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.462+0000 7fbcee9b1640 1 --2- 172.21.15.132:0/2604902687 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbce80b4f90 0x7fbce81581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.462+0000 7fbcee9b1640 1 --2- 172.21.15.132:0/2604902687 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbce80b1d10 0x7fbce8157730 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.462+0000 7fbcee9b1640 1 -- 172.21.15.132:0/2604902687 >> 172.21.15.132:0/2604902687 conn(0x7fbce80cf880 msgr2=0x7fbce80b8060 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:26.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.462+0000 7fbcee9b1640 1 -- 172.21.15.132:0/2604902687 shutdown_connections 2023-12-20T04:46:26.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.462+0000 7fbcee9b1640 1 -- 172.21.15.132:0/2604902687 wait complete. 2023-12-20T04:46:26.475 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-20T04:46:26.475 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:46:26.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.572+0000 7f2486466640 1 Processor -- start 2023-12-20T04:46:26.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.572+0000 7f2486466640 1 -- start start 2023-12-20T04:46:26.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.573+0000 7f2486466640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f248006c410 0x7f24800cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:26.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.573+0000 7f2486466640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24800add30 con 0x7f248015cef0 2023-12-20T04:46:26.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.573+0000 7f2486466640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f24800ae010 con 0x7f248015d2d0 2023-12-20T04:46:26.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.573+0000 7f2486466640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2480072d00 con 0x7f248006c410 2023-12-20T04:46:26.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.573+0000 7f247ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f248015cef0 0x7f24800cd1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43750/0 (socket says 172.21.15.132:43750) 2023-12-20T04:46:26.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.573+0000 7f247ffff640 1 -- 172.21.15.132:0/1875506479 learned_addr learned my addr 172.21.15.132:0/1875506479 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:26.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.573+0000 7f2484a03640 1 --2- 172.21.15.132:0/1875506479 >> v2:172.21.15.132:3300/0 conn(0x7f248006c410 0x7f24800cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:26.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.574+0000 7f247effd640 1 -- 172.21.15.132:0/1875506479 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2514352670 0 0) 0x7f24800add30 con 0x7f248015cef0 2023-12-20T04:46:26.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.574+0000 7f247effd640 1 -- 172.21.15.132:0/1875506479 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2468003520 con 0x7f248015cef0 2023-12-20T04:46:26.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.574+0000 7f2484a03640 1 -- 172.21.15.132:0/1875506479 >> v1:172.21.15.187:6789/0 conn(0x7f248015d2d0 legacy=0x7f248006bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:26.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.574+0000 7f2484a03640 1 -- 172.21.15.132:0/1875506479 >> v1:172.21.15.132:6789/0 conn(0x7f248015cef0 legacy=0x7f24800cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:26.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.574+0000 7f2484a03640 1 -- 172.21.15.132:0/1875506479 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2480072fe0 con 0x7f248006c410 2023-12-20T04:46:26.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.574+0000 7f2484a03640 1 --2- 172.21.15.132:0/1875506479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f248006c410 0x7f24800cecc0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2478009d90 tx=0x7f247802bfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e09928a94c1dda5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:26.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.575+0000 7f247effd640 1 -- 172.21.15.132:0/1875506479 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f247802cd80 con 0x7f248006c410 2023-12-20T04:46:26.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.575+0000 7f247effd640 1 -- 172.21.15.132:0/1875506479 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2478034440 con 0x7f248006c410 2023-12-20T04:46:26.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.575+0000 7f247effd640 1 -- 172.21.15.132:0/1875506479 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f24780347d0 con 0x7f248006c410 2023-12-20T04:46:26.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.575+0000 7f2486466640 1 -- 172.21.15.132:0/1875506479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f248006c410 msgr2=0x7f24800cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:26.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.575+0000 7f2486466640 1 --2- 172.21.15.132:0/1875506479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f248006c410 0x7f24800cecc0 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f2478009d90 tx=0x7f247802bfd0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.575+0000 7f2486466640 1 -- 172.21.15.132:0/1875506479 shutdown_connections 2023-12-20T04:46:26.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.575+0000 7f2486466640 1 --2- 172.21.15.132:0/1875506479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f248006c410 0x7f24800cecc0 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.575+0000 7f2486466640 1 -- 172.21.15.132:0/1875506479 >> 172.21.15.132:0/1875506479 conn(0x7f24800cf330 msgr2=0x7f24800cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:26.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.575+0000 7f2486466640 1 -- 172.21.15.132:0/1875506479 shutdown_connections 2023-12-20T04:46:26.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.575+0000 7f2486466640 1 -- 172.21.15.132:0/1875506479 wait complete. 2023-12-20T04:46:26.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.576+0000 7f2486466640 1 Processor -- start 2023-12-20T04:46:26.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.577+0000 7f2486466640 1 -- start start 2023-12-20T04:46:26.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.577+0000 7f2486466640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f248006c410 0x7f248014b810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:26.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.577+0000 7f2486466640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f248015cef0 0x7f248014a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:26.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.577+0000 7f2486466640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f248015d2d0 0x7f24800b40c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:26.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.577+0000 7f2486466640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f248014bd50 con 0x7f248006c410 2023-12-20T04:46:26.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.577+0000 7f2486466640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24800c5da0 con 0x7f248015cef0 2023-12-20T04:46:26.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.577+0000 7f2486466640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f24800b3c30 con 0x7f248015d2d0 2023-12-20T04:46:26.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.577+0000 7f247ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f248006c410 0x7f248014b810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:26.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.577+0000 7f247ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f248006c410 0x7f248014b810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37420/0 (socket says 172.21.15.132:37420) 2023-12-20T04:46:26.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.577+0000 7f247ffff640 1 -- 172.21.15.132:0/20588980 learned_addr learned my addr 172.21.15.132:0/20588980 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:26.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.578+0000 7f247ffff640 1 -- 172.21.15.132:0/20588980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f248015d2d0 msgr2=0x7f24800b40c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:26.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.578+0000 7f247ffff640 1 --2- 172.21.15.132:0/20588980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f248015d2d0 0x7f24800b40c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.578+0000 7f247ffff640 1 -- 172.21.15.132:0/20588980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f248015cef0 msgr2=0x7f248014a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:26.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.578+0000 7f247ffff640 1 --2- 172.21.15.132:0/20588980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f248015cef0 0x7f248014a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.578+0000 7f247ffff640 1 -- 172.21.15.132:0/20588980 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2478009a70 con 0x7f248006c410 2023-12-20T04:46:26.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.578+0000 7f247ffff640 1 --2- 172.21.15.132:0/20588980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f248006c410 0x7f248014b810 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f247000c500 tx=0x7f247000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:26.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.578+0000 7f247cff9640 1 -- 172.21.15.132:0/20588980 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470005ce0 con 0x7f248006c410 2023-12-20T04:46:26.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.578+0000 7f247cff9640 1 -- 172.21.15.132:0/20588980 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2470005e40 con 0x7f248006c410 2023-12-20T04:46:26.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.578+0000 7f247cff9640 1 -- 172.21.15.132:0/20588980 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2470007330 con 0x7f248006c410 2023-12-20T04:46:26.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.578+0000 7f2486466640 1 -- 172.21.15.132:0/20588980 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24800b3020 con 0x7f248006c410 2023-12-20T04:46:26.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.578+0000 7f2486466640 1 -- 172.21.15.132:0/20588980 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24800b35e0 con 0x7f248006c410 2023-12-20T04:46:26.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.579+0000 7f2486466640 1 -- 172.21.15.132:0/20588980 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f248004e840 con 0x7f248006c410 2023-12-20T04:46:26.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.579+0000 7f247cff9640 1 -- 172.21.15.132:0/20588980 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2470007490 con 0x7f248006c410 2023-12-20T04:46:26.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.580+0000 7f247cff9640 1 --2- 172.21.15.132:0/20588980 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f246c06a430 0x7f246c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:26.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.580+0000 7f247cff9640 1 -- 172.21.15.132:0/20588980 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2470087f20 con 0x7f248006c410 2023-12-20T04:46:26.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.580+0000 7f247f7fe640 1 --2- 172.21.15.132:0/20588980 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f246c06a430 0x7f246c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:26.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.580+0000 7f247f7fe640 1 --2- 172.21.15.132:0/20588980 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f246c06a430 0x7f246c06c8f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2474000f60 tx=0x7f24740079b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:26.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.584+0000 7f247cff9640 1 -- 172.21.15.132:0/20588980 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f24700535a0 con 0x7f248006c410 2023-12-20T04:46:26.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.745+0000 7f2486466640 1 -- 172.21.15.132:0/20588980 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f24800b52b0 con 0x7f246c06a430 2023-12-20T04:46:26.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.752+0000 7f247cff9640 1 -- 172.21.15.132:0/20588980 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285164 (secure 0 0 0) 0x7f24800b52b0 con 0x7f246c06a430 2023-12-20T04:46:26.757 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:26.759 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:46:26.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.755+0000 7f2486466640 1 -- 172.21.15.132:0/20588980 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f246c06a430 msgr2=0x7f246c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:26.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.755+0000 7f2486466640 1 --2- 172.21.15.132:0/20588980 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f246c06a430 0x7f246c06c8f0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f2474000f60 tx=0x7f24740079b0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.755+0000 7f2486466640 1 -- 172.21.15.132:0/20588980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f248006c410 msgr2=0x7f248014b810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:26.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.755+0000 7f2486466640 1 --2- 172.21.15.132:0/20588980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f248006c410 0x7f248014b810 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f247000c500 tx=0x7f247000c9c0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.755+0000 7f2486466640 1 -- 172.21.15.132:0/20588980 shutdown_connections 2023-12-20T04:46:26.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.755+0000 7f2486466640 1 --2- 172.21.15.132:0/20588980 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f246c06a430 0x7f246c06c8f0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.755+0000 7f2486466640 1 --2- 172.21.15.132:0/20588980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f248015d2d0 0x7f24800b40c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.755+0000 7f2486466640 1 --2- 172.21.15.132:0/20588980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f248015cef0 0x7f248014a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.755+0000 7f2486466640 1 --2- 172.21.15.132:0/20588980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f248006c410 0x7f248014b810 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:26.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.755+0000 7f2486466640 1 -- 172.21.15.132:0/20588980 >> 172.21.15.132:0/20588980 conn(0x7f24800cf330 msgr2=0x7f2480069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:26.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.755+0000 7f2486466640 1 -- 172.21.15.132:0/20588980 shutdown_connections 2023-12-20T04:46:26.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:26.755+0000 7f2486466640 1 -- 172.21.15.132:0/20588980 wait complete. 2023-12-20T04:46:26.768 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":189,"stamp":"2023-12-20T04:46:26.138768+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4541,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557958,"statfs":{"total":1600000000,"available":1595349460,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.027429"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.956790+0000","last_change":"2023-12-20T04:46:22.477539+0000","last_active":"2023-12-20T04:46:23.956790+0000","last_peered":"2023-12-20T04:46:23.956790+0000","last_clean":"2023-12-20T04:46:23.956790+0000","last_became_active":"2023-12-20T04:46:22.475369+0000","last_became_peered":"2023-12-20T04:46:22.475369+0000","last_unstale":"2023-12-20T04:46:23.956790+0000","last_undegraded":"2023-12-20T04:46:23.956790+0000","last_fullsized":"2023-12-20T04:46:23.956790+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:23:21.068943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457344+0000","last_change":"2023-12-20T04:46:22.480708+0000","last_active":"2023-12-20T04:46:24.457344+0000","last_peered":"2023-12-20T04:46:24.457344+0000","last_clean":"2023-12-20T04:46:24.457344+0000","last_became_active":"2023-12-20T04:46:22.480446+0000","last_became_peered":"2023-12-20T04:46:22.480446+0000","last_unstale":"2023-12-20T04:46:24.457344+0000","last_undegraded":"2023-12-20T04:46:24.457344+0000","last_fullsized":"2023-12-20T04:46:24.457344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:14:27.337034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957520+0000","last_change":"2023-12-20T04:46:22.474047+0000","last_active":"2023-12-20T04:46:23.957520+0000","last_peered":"2023-12-20T04:46:23.957520+0000","last_clean":"2023-12-20T04:46:23.957520+0000","last_became_active":"2023-12-20T04:46:22.473834+0000","last_became_peered":"2023-12-20T04:46:22.473834+0000","last_unstale":"2023-12-20T04:46:23.957520+0000","last_undegraded":"2023-12-20T04:46:23.957520+0000","last_fullsized":"2023-12-20T04:46:23.957520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:36:49.722629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463654+0000","last_change":"2023-12-20T04:46:22.473600+0000","last_active":"2023-12-20T04:46:23.463654+0000","last_peered":"2023-12-20T04:46:23.463654+0000","last_clean":"2023-12-20T04:46:23.463654+0000","last_became_active":"2023-12-20T04:46:22.473259+0000","last_became_peered":"2023-12-20T04:46:22.473259+0000","last_unstale":"2023-12-20T04:46:23.463654+0000","last_undegraded":"2023-12-20T04:46:23.463654+0000","last_fullsized":"2023-12-20T04:46:23.463654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:05:02.790854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957624+0000","last_change":"2023-12-20T04:46:22.475548+0000","last_active":"2023-12-20T04:46:23.957624+0000","last_peered":"2023-12-20T04:46:23.957624+0000","last_clean":"2023-12-20T04:46:23.957624+0000","last_became_active":"2023-12-20T04:46:22.475354+0000","last_became_peered":"2023-12-20T04:46:22.475354+0000","last_unstale":"2023-12-20T04:46:23.957624+0000","last_undegraded":"2023-12-20T04:46:23.957624+0000","last_fullsized":"2023-12-20T04:46:23.957624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:00:55.120248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457652+0000","last_change":"2023-12-20T04:46:22.476832+0000","last_active":"2023-12-20T04:46:24.457652+0000","last_peered":"2023-12-20T04:46:24.457652+0000","last_clean":"2023-12-20T04:46:24.457652+0000","last_became_active":"2023-12-20T04:46:22.476537+0000","last_became_peered":"2023-12-20T04:46:22.476537+0000","last_unstale":"2023-12-20T04:46:24.457652+0000","last_undegraded":"2023-12-20T04:46:24.457652+0000","last_fullsized":"2023-12-20T04:46:24.457652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:25.106264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457182+0000","last_change":"2023-12-20T04:46:22.466789+0000","last_active":"2023-12-20T04:46:24.457182+0000","last_peered":"2023-12-20T04:46:24.457182+0000","last_clean":"2023-12-20T04:46:24.457182+0000","last_became_active":"2023-12-20T04:46:22.466169+0000","last_became_peered":"2023-12-20T04:46:22.466169+0000","last_unstale":"2023-12-20T04:46:24.457182+0000","last_undegraded":"2023-12-20T04:46:24.457182+0000","last_fullsized":"2023-12-20T04:46:24.457182+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:45:31.915190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457355+0000","last_change":"2023-12-20T04:46:22.479379+0000","last_active":"2023-12-20T04:46:24.457355+0000","last_peered":"2023-12-20T04:46:24.457355+0000","last_clean":"2023-12-20T04:46:24.457355+0000","last_became_active":"2023-12-20T04:46:22.477380+0000","last_became_peered":"2023-12-20T04:46:22.477380+0000","last_unstale":"2023-12-20T04:46:24.457355+0000","last_undegraded":"2023-12-20T04:46:24.457355+0000","last_fullsized":"2023-12-20T04:46:24.457355+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:01:42.262177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957034+0000","last_change":"2023-12-20T04:46:22.468885+0000","last_active":"2023-12-20T04:46:23.957034+0000","last_peered":"2023-12-20T04:46:23.957034+0000","last_clean":"2023-12-20T04:46:23.957034+0000","last_became_active":"2023-12-20T04:46:22.468557+0000","last_became_peered":"2023-12-20T04:46:22.468557+0000","last_unstale":"2023-12-20T04:46:23.957034+0000","last_undegraded":"2023-12-20T04:46:23.957034+0000","last_fullsized":"2023-12-20T04:46:23.957034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:09:07.425954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.469062+0000","last_change":"2023-12-20T04:46:22.473348+0000","last_active":"2023-12-20T04:46:23.469062+0000","last_peered":"2023-12-20T04:46:23.469062+0000","last_clean":"2023-12-20T04:46:23.469062+0000","last_became_active":"2023-12-20T04:46:22.472808+0000","last_became_peered":"2023-12-20T04:46:22.472808+0000","last_unstale":"2023-12-20T04:46:23.469062+0000","last_undegraded":"2023-12-20T04:46:23.469062+0000","last_fullsized":"2023-12-20T04:46:23.469062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:40:40.099897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957002+0000","last_change":"2023-12-20T04:46:22.478918+0000","last_active":"2023-12-20T04:46:23.957002+0000","last_peered":"2023-12-20T04:46:23.957002+0000","last_clean":"2023-12-20T04:46:23.957002+0000","last_became_active":"2023-12-20T04:46:22.478063+0000","last_became_peered":"2023-12-20T04:46:22.478063+0000","last_unstale":"2023-12-20T04:46:23.957002+0000","last_undegraded":"2023-12-20T04:46:23.957002+0000","last_fullsized":"2023-12-20T04:46:23.957002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:01:42.262177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463708+0000","last_change":"2023-12-20T04:46:22.469642+0000","last_active":"2023-12-20T04:46:23.463708+0000","last_peered":"2023-12-20T04:46:23.463708+0000","last_clean":"2023-12-20T04:46:23.463708+0000","last_became_active":"2023-12-20T04:46:22.469424+0000","last_became_peered":"2023-12-20T04:46:22.469424+0000","last_unstale":"2023-12-20T04:46:23.463708+0000","last_undegraded":"2023-12-20T04:46:23.463708+0000","last_fullsized":"2023-12-20T04:46:23.463708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:29.435770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468633+0000","last_change":"2023-12-20T04:46:22.482649+0000","last_active":"2023-12-20T04:46:23.468633+0000","last_peered":"2023-12-20T04:46:23.468633+0000","last_clean":"2023-12-20T04:46:23.468633+0000","last_became_active":"2023-12-20T04:46:22.481959+0000","last_became_peered":"2023-12-20T04:46:22.481959+0000","last_unstale":"2023-12-20T04:46:23.468633+0000","last_undegraded":"2023-12-20T04:46:23.468633+0000","last_fullsized":"2023-12-20T04:46:23.468633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:07:10.979646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957132+0000","last_change":"2023-12-20T04:46:22.470520+0000","last_active":"2023-12-20T04:46:23.957132+0000","last_peered":"2023-12-20T04:46:23.957132+0000","last_clean":"2023-12-20T04:46:23.957132+0000","last_became_active":"2023-12-20T04:46:22.470218+0000","last_became_peered":"2023-12-20T04:46:22.470218+0000","last_unstale":"2023-12-20T04:46:23.957132+0000","last_undegraded":"2023-12-20T04:46:23.957132+0000","last_fullsized":"2023-12-20T04:46:23.957132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:06:22.065575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468606+0000","last_change":"2023-12-20T04:46:22.471898+0000","last_active":"2023-12-20T04:46:23.468606+0000","last_peered":"2023-12-20T04:46:23.468606+0000","last_clean":"2023-12-20T04:46:23.468606+0000","last_became_active":"2023-12-20T04:46:22.471688+0000","last_became_peered":"2023-12-20T04:46:22.471688+0000","last_unstale":"2023-12-20T04:46:23.468606+0000","last_undegraded":"2023-12-20T04:46:23.468606+0000","last_fullsized":"2023-12-20T04:46:23.468606+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:23:21.068943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468897+0000","last_change":"2023-12-20T04:46:22.475410+0000","last_active":"2023-12-20T04:46:23.468897+0000","last_peered":"2023-12-20T04:46:23.468897+0000","last_clean":"2023-12-20T04:46:23.468897+0000","last_became_active":"2023-12-20T04:46:22.475010+0000","last_became_peered":"2023-12-20T04:46:22.475010+0000","last_unstale":"2023-12-20T04:46:23.468897+0000","last_undegraded":"2023-12-20T04:46:23.468897+0000","last_fullsized":"2023-12-20T04:46:23.468897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:14:27.337034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957420+0000","last_change":"2023-12-20T04:46:22.470078+0000","last_active":"2023-12-20T04:46:23.957420+0000","last_peered":"2023-12-20T04:46:23.957420+0000","last_clean":"2023-12-20T04:46:23.957420+0000","last_became_active":"2023-12-20T04:46:22.469295+0000","last_became_peered":"2023-12-20T04:46:22.469295+0000","last_unstale":"2023-12-20T04:46:23.957420+0000","last_undegraded":"2023-12-20T04:46:23.957420+0000","last_fullsized":"2023-12-20T04:46:23.957420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:59:11.464398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463836+0000","last_change":"2023-12-20T04:46:22.475767+0000","last_active":"2023-12-20T04:46:23.463836+0000","last_peered":"2023-12-20T04:46:23.463836+0000","last_clean":"2023-12-20T04:46:23.463836+0000","last_became_active":"2023-12-20T04:46:22.475559+0000","last_became_peered":"2023-12-20T04:46:22.475559+0000","last_unstale":"2023-12-20T04:46:23.463836+0000","last_undegraded":"2023-12-20T04:46:23.463836+0000","last_fullsized":"2023-12-20T04:46:23.463836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:48:14.750120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457528+0000","last_change":"2023-12-20T04:46:22.481025+0000","last_active":"2023-12-20T04:46:24.457528+0000","last_peered":"2023-12-20T04:46:24.457528+0000","last_clean":"2023-12-20T04:46:24.457528+0000","last_became_active":"2023-12-20T04:46:22.480671+0000","last_became_peered":"2023-12-20T04:46:22.480671+0000","last_unstale":"2023-12-20T04:46:24.457528+0000","last_undegraded":"2023-12-20T04:46:24.457528+0000","last_fullsized":"2023-12-20T04:46:24.457528+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:24:37.308383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468665+0000","last_change":"2023-12-20T04:46:22.472601+0000","last_active":"2023-12-20T04:46:23.468665+0000","last_peered":"2023-12-20T04:46:23.468665+0000","last_clean":"2023-12-20T04:46:23.468665+0000","last_became_active":"2023-12-20T04:46:22.472368+0000","last_became_peered":"2023-12-20T04:46:22.472368+0000","last_unstale":"2023-12-20T04:46:23.468665+0000","last_undegraded":"2023-12-20T04:46:23.468665+0000","last_fullsized":"2023-12-20T04:46:23.468665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:09:00.588012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.469073+0000","last_change":"2023-12-20T04:46:22.472558+0000","last_active":"2023-12-20T04:46:23.469073+0000","last_peered":"2023-12-20T04:46:23.469073+0000","last_clean":"2023-12-20T04:46:23.469073+0000","last_became_active":"2023-12-20T04:46:22.472319+0000","last_became_peered":"2023-12-20T04:46:22.472319+0000","last_unstale":"2023-12-20T04:46:23.469073+0000","last_undegraded":"2023-12-20T04:46:23.469073+0000","last_fullsized":"2023-12-20T04:46:23.469073+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:35:53.951288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468984+0000","last_change":"2023-12-20T04:46:22.472687+0000","last_active":"2023-12-20T04:46:23.468984+0000","last_peered":"2023-12-20T04:46:23.468984+0000","last_clean":"2023-12-20T04:46:23.468984+0000","last_became_active":"2023-12-20T04:46:22.472444+0000","last_became_peered":"2023-12-20T04:46:22.472444+0000","last_unstale":"2023-12-20T04:46:23.468984+0000","last_undegraded":"2023-12-20T04:46:23.468984+0000","last_fullsized":"2023-12-20T04:46:23.468984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:16:47.536028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.956801+0000","last_change":"2023-12-20T04:46:22.479919+0000","last_active":"2023-12-20T04:46:23.956801+0000","last_peered":"2023-12-20T04:46:23.956801+0000","last_clean":"2023-12-20T04:46:23.956801+0000","last_became_active":"2023-12-20T04:46:22.479678+0000","last_became_peered":"2023-12-20T04:46:22.479678+0000","last_unstale":"2023-12-20T04:46:23.956801+0000","last_undegraded":"2023-12-20T04:46:23.956801+0000","last_fullsized":"2023-12-20T04:46:23.956801+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:26:05.275199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.956657+0000","last_change":"2023-12-20T04:46:22.483173+0000","last_active":"2023-12-20T04:46:23.956657+0000","last_peered":"2023-12-20T04:46:23.956657+0000","last_clean":"2023-12-20T04:46:23.956657+0000","last_became_active":"2023-12-20T04:46:22.482660+0000","last_became_peered":"2023-12-20T04:46:22.482660+0000","last_unstale":"2023-12-20T04:46:23.956657+0000","last_undegraded":"2023-12-20T04:46:23.956657+0000","last_fullsized":"2023-12-20T04:46:23.956657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:22:01.603881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.469156+0000","last_change":"2023-12-20T04:46:22.479120+0000","last_active":"2023-12-20T04:46:23.469156+0000","last_peered":"2023-12-20T04:46:23.469156+0000","last_clean":"2023-12-20T04:46:23.469156+0000","last_became_active":"2023-12-20T04:46:22.478760+0000","last_became_peered":"2023-12-20T04:46:22.478760+0000","last_unstale":"2023-12-20T04:46:23.469156+0000","last_undegraded":"2023-12-20T04:46:23.469156+0000","last_fullsized":"2023-12-20T04:46:23.469156+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:24:37.308383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457564+0000","last_change":"2023-12-20T04:46:22.474070+0000","last_active":"2023-12-20T04:46:24.457564+0000","last_peered":"2023-12-20T04:46:24.457564+0000","last_clean":"2023-12-20T04:46:24.457564+0000","last_became_active":"2023-12-20T04:46:22.473819+0000","last_became_peered":"2023-12-20T04:46:22.473819+0000","last_unstale":"2023-12-20T04:46:24.457564+0000","last_undegraded":"2023-12-20T04:46:24.457564+0000","last_fullsized":"2023-12-20T04:46:24.457564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:35:53.951288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957563+0000","last_change":"2023-12-20T04:46:22.472651+0000","last_active":"2023-12-20T04:46:23.957563+0000","last_peered":"2023-12-20T04:46:23.957563+0000","last_clean":"2023-12-20T04:46:23.957563+0000","last_became_active":"2023-12-20T04:46:22.472452+0000","last_became_peered":"2023-12-20T04:46:22.472452+0000","last_unstale":"2023-12-20T04:46:23.957563+0000","last_undegraded":"2023-12-20T04:46:23.957563+0000","last_fullsized":"2023-12-20T04:46:23.957563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:43.407906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468684+0000","last_change":"2023-12-20T04:46:22.471298+0000","last_active":"2023-12-20T04:46:23.468684+0000","last_peered":"2023-12-20T04:46:23.468684+0000","last_clean":"2023-12-20T04:46:23.468684+0000","last_became_active":"2023-12-20T04:46:22.471029+0000","last_became_peered":"2023-12-20T04:46:22.471029+0000","last_unstale":"2023-12-20T04:46:23.468684+0000","last_undegraded":"2023-12-20T04:46:23.468684+0000","last_fullsized":"2023-12-20T04:46:23.468684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:25.106264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957259+0000","last_change":"2023-12-20T04:46:22.469563+0000","last_active":"2023-12-20T04:46:23.957259+0000","last_peered":"2023-12-20T04:46:23.957259+0000","last_clean":"2023-12-20T04:46:23.957259+0000","last_became_active":"2023-12-20T04:46:22.468952+0000","last_became_peered":"2023-12-20T04:46:22.468952+0000","last_unstale":"2023-12-20T04:46:23.957259+0000","last_undegraded":"2023-12-20T04:46:23.957259+0000","last_fullsized":"2023-12-20T04:46:23.957259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:29.733464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457315+0000","last_change":"2023-12-20T04:46:22.476472+0000","last_active":"2023-12-20T04:46:24.457315+0000","last_peered":"2023-12-20T04:46:24.457315+0000","last_clean":"2023-12-20T04:46:24.457315+0000","last_became_active":"2023-12-20T04:46:22.476251+0000","last_became_peered":"2023-12-20T04:46:22.476251+0000","last_unstale":"2023-12-20T04:46:24.457315+0000","last_undegraded":"2023-12-20T04:46:24.457315+0000","last_fullsized":"2023-12-20T04:46:24.457315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:32:25.152313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457650+0000","last_change":"2023-12-20T04:46:22.465663+0000","last_active":"2023-12-20T04:46:24.457650+0000","last_peered":"2023-12-20T04:46:24.457650+0000","last_clean":"2023-12-20T04:46:24.457650+0000","last_became_active":"2023-12-20T04:46:22.465435+0000","last_became_peered":"2023-12-20T04:46:22.465435+0000","last_unstale":"2023-12-20T04:46:24.457650+0000","last_undegraded":"2023-12-20T04:46:24.457650+0000","last_fullsized":"2023-12-20T04:46:24.457650+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:25.106264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457458+0000","last_change":"2023-12-20T04:46:22.474933+0000","last_active":"2023-12-20T04:46:24.457458+0000","last_peered":"2023-12-20T04:46:24.457458+0000","last_clean":"2023-12-20T04:46:24.457458+0000","last_became_active":"2023-12-20T04:46:22.474710+0000","last_became_peered":"2023-12-20T04:46:22.474710+0000","last_unstale":"2023-12-20T04:46:24.457458+0000","last_undegraded":"2023-12-20T04:46:24.457458+0000","last_fullsized":"2023-12-20T04:46:24.457458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:40:40.099897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.956758+0000","last_change":"2023-12-20T04:46:22.483314+0000","last_active":"2023-12-20T04:46:23.956758+0000","last_peered":"2023-12-20T04:46:23.956758+0000","last_clean":"2023-12-20T04:46:23.956758+0000","last_became_active":"2023-12-20T04:46:22.482937+0000","last_became_peered":"2023-12-20T04:46:22.482937+0000","last_unstale":"2023-12-20T04:46:23.956758+0000","last_undegraded":"2023-12-20T04:46:23.956758+0000","last_fullsized":"2023-12-20T04:46:23.956758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:07:10.979646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"81'4","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.485317+0000","last_change":"2023-12-20T04:46:22.127222+0000","last_active":"2023-12-20T04:46:22.485317+0000","last_peered":"2023-12-20T04:46:22.485317+0000","last_clean":"2023-12-20T04:46:22.485317+0000","last_became_active":"2023-12-20T04:46:22.126920+0000","last_became_peered":"2023-12-20T04:46:22.126920+0000","last_unstale":"2023-12-20T04:46:22.485317+0000","last_undegraded":"2023-12-20T04:46:22.485317+0000","last_fullsized":"2023-12-20T04:46:22.485317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:45:34.103863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957209+0000","last_change":"2023-12-20T04:46:22.468748+0000","last_active":"2023-12-20T04:46:23.957209+0000","last_peered":"2023-12-20T04:46:23.957209+0000","last_clean":"2023-12-20T04:46:23.957209+0000","last_became_active":"2023-12-20T04:46:22.468502+0000","last_became_peered":"2023-12-20T04:46:22.468502+0000","last_unstale":"2023-12-20T04:46:23.957209+0000","last_undegraded":"2023-12-20T04:46:23.957209+0000","last_fullsized":"2023-12-20T04:46:23.957209+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:11:05.061236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"81'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468696+0000","last_change":"2023-12-20T04:46:22.122779+0000","last_active":"2023-12-20T04:46:23.468696+0000","last_peered":"2023-12-20T04:46:23.468696+0000","last_clean":"2023-12-20T04:46:23.468696+0000","last_became_active":"2023-12-20T04:46:22.122541+0000","last_became_peered":"2023-12-20T04:46:22.122541+0000","last_unstale":"2023-12-20T04:46:23.468696+0000","last_undegraded":"2023-12-20T04:46:23.468696+0000","last_fullsized":"2023-12-20T04:46:23.468696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:32:24.147092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457766+0000","last_change":"2023-12-20T04:46:22.480693+0000","last_active":"2023-12-20T04:46:24.457766+0000","last_peered":"2023-12-20T04:46:24.457766+0000","last_clean":"2023-12-20T04:46:24.457766+0000","last_became_active":"2023-12-20T04:46:22.480079+0000","last_became_peered":"2023-12-20T04:46:22.480079+0000","last_unstale":"2023-12-20T04:46:24.457766+0000","last_undegraded":"2023-12-20T04:46:24.457766+0000","last_fullsized":"2023-12-20T04:46:24.457766+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:16:47.536028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.482029+0000","last_change":"2023-12-20T04:46:22.130927+0000","last_active":"2023-12-20T04:46:22.482029+0000","last_peered":"2023-12-20T04:46:22.482029+0000","last_clean":"2023-12-20T04:46:22.482029+0000","last_became_active":"2023-12-20T04:46:22.130205+0000","last_became_peered":"2023-12-20T04:46:22.130205+0000","last_unstale":"2023-12-20T04:46:22.482029+0000","last_undegraded":"2023-12-20T04:46:22.482029+0000","last_fullsized":"2023-12-20T04:46:22.482029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:31:16.073200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.956854+0000","last_change":"2023-12-20T04:46:22.474290+0000","last_active":"2023-12-20T04:46:23.956854+0000","last_peered":"2023-12-20T04:46:23.956854+0000","last_clean":"2023-12-20T04:46:23.956854+0000","last_became_active":"2023-12-20T04:46:22.474068+0000","last_became_peered":"2023-12-20T04:46:22.474068+0000","last_unstale":"2023-12-20T04:46:23.956854+0000","last_undegraded":"2023-12-20T04:46:23.956854+0000","last_fullsized":"2023-12-20T04:46:23.956854+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:29:38.683171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.483403+0000","last_change":"2023-12-20T04:46:22.125033+0000","last_active":"2023-12-20T04:46:22.483403+0000","last_peered":"2023-12-20T04:46:22.483403+0000","last_clean":"2023-12-20T04:46:22.483403+0000","last_became_active":"2023-12-20T04:46:22.124696+0000","last_became_peered":"2023-12-20T04:46:22.124696+0000","last_unstale":"2023-12-20T04:46:22.483403+0000","last_undegraded":"2023-12-20T04:46:22.483403+0000","last_fullsized":"2023-12-20T04:46:22.483403+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:06:59.201562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457190+0000","last_change":"2023-12-20T04:46:22.468235+0000","last_active":"2023-12-20T04:46:24.457190+0000","last_peered":"2023-12-20T04:46:24.457190+0000","last_clean":"2023-12-20T04:46:24.457190+0000","last_became_active":"2023-12-20T04:46:22.467990+0000","last_became_peered":"2023-12-20T04:46:22.467990+0000","last_unstale":"2023-12-20T04:46:24.457190+0000","last_undegraded":"2023-12-20T04:46:24.457190+0000","last_fullsized":"2023-12-20T04:46:24.457190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:40:40.099897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.478793+0000","last_change":"2023-12-20T04:46:22.128170+0000","last_active":"2023-12-20T04:46:22.478793+0000","last_peered":"2023-12-20T04:46:22.478793+0000","last_clean":"2023-12-20T04:46:22.478793+0000","last_became_active":"2023-12-20T04:46:22.127864+0000","last_became_peered":"2023-12-20T04:46:22.127864+0000","last_unstale":"2023-12-20T04:46:22.478793+0000","last_undegraded":"2023-12-20T04:46:22.478793+0000","last_fullsized":"2023-12-20T04:46:22.478793+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:23:20.063722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.469049+0000","last_change":"2023-12-20T04:46:22.475710+0000","last_active":"2023-12-20T04:46:23.469049+0000","last_peered":"2023-12-20T04:46:23.469049+0000","last_clean":"2023-12-20T04:46:23.469049+0000","last_became_active":"2023-12-20T04:46:22.475410+0000","last_became_peered":"2023-12-20T04:46:22.475410+0000","last_unstale":"2023-12-20T04:46:23.469049+0000","last_undegraded":"2023-12-20T04:46:23.469049+0000","last_fullsized":"2023-12-20T04:46:23.469049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:01:42.262177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.483693+0000","last_change":"2023-12-20T04:46:22.129104+0000","last_active":"2023-12-20T04:46:22.483693+0000","last_peered":"2023-12-20T04:46:22.483693+0000","last_clean":"2023-12-20T04:46:22.483693+0000","last_became_active":"2023-12-20T04:46:22.128661+0000","last_became_peered":"2023-12-20T04:46:22.128661+0000","last_unstale":"2023-12-20T04:46:22.483693+0000","last_undegraded":"2023-12-20T04:46:22.483693+0000","last_fullsized":"2023-12-20T04:46:22.483693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:01:11.730597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957766+0000","last_change":"2023-12-20T04:46:22.473580+0000","last_active":"2023-12-20T04:46:23.957766+0000","last_peered":"2023-12-20T04:46:23.957766+0000","last_clean":"2023-12-20T04:46:23.957766+0000","last_became_active":"2023-12-20T04:46:22.473292+0000","last_became_peered":"2023-12-20T04:46:22.473292+0000","last_unstale":"2023-12-20T04:46:23.957766+0000","last_undegraded":"2023-12-20T04:46:23.957766+0000","last_fullsized":"2023-12-20T04:46:23.957766+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:56:44.135198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463812+0000","last_change":"2023-12-20T04:46:22.126449+0000","last_active":"2023-12-20T04:46:23.463812+0000","last_peered":"2023-12-20T04:46:23.463812+0000","last_clean":"2023-12-20T04:46:23.463812+0000","last_became_active":"2023-12-20T04:46:22.124465+0000","last_became_peered":"2023-12-20T04:46:22.124465+0000","last_unstale":"2023-12-20T04:46:23.463812+0000","last_undegraded":"2023-12-20T04:46:23.463812+0000","last_fullsized":"2023-12-20T04:46:23.463812+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:17:23.544998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468626+0000","last_change":"2023-12-20T04:46:22.474490+0000","last_active":"2023-12-20T04:46:23.468626+0000","last_peered":"2023-12-20T04:46:23.468626+0000","last_clean":"2023-12-20T04:46:23.468626+0000","last_became_active":"2023-12-20T04:46:22.474233+0000","last_became_peered":"2023-12-20T04:46:22.474233+0000","last_unstale":"2023-12-20T04:46:23.468626+0000","last_undegraded":"2023-12-20T04:46:23.468626+0000","last_fullsized":"2023-12-20T04:46:23.468626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:37:58.149377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957836+0000","last_change":"2023-12-20T04:46:22.123990+0000","last_active":"2023-12-20T04:46:23.957836+0000","last_peered":"2023-12-20T04:46:23.957836+0000","last_clean":"2023-12-20T04:46:23.957836+0000","last_became_active":"2023-12-20T04:46:22.121120+0000","last_became_peered":"2023-12-20T04:46:22.121120+0000","last_unstale":"2023-12-20T04:46:23.957836+0000","last_undegraded":"2023-12-20T04:46:23.957836+0000","last_fullsized":"2023-12-20T04:46:23.957836+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:32.210360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457271+0000","last_change":"2023-12-20T04:46:22.471096+0000","last_active":"2023-12-20T04:46:24.457271+0000","last_peered":"2023-12-20T04:46:24.457271+0000","last_clean":"2023-12-20T04:46:24.457271+0000","last_became_active":"2023-12-20T04:46:22.470871+0000","last_became_peered":"2023-12-20T04:46:22.470871+0000","last_unstale":"2023-12-20T04:46:24.457271+0000","last_undegraded":"2023-12-20T04:46:24.457271+0000","last_fullsized":"2023-12-20T04:46:24.457271+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:16:47.536028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.466566+0000","last_change":"2023-12-20T04:46:22.124551+0000","last_active":"2023-12-20T04:46:22.466566+0000","last_peered":"2023-12-20T04:46:22.466566+0000","last_clean":"2023-12-20T04:46:22.466566+0000","last_became_active":"2023-12-20T04:46:22.121966+0000","last_became_peered":"2023-12-20T04:46:22.121966+0000","last_unstale":"2023-12-20T04:46:22.466566+0000","last_undegraded":"2023-12-20T04:46:22.466566+0000","last_fullsized":"2023-12-20T04:46:22.466566+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:59:16.940603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957064+0000","last_change":"2023-12-20T04:46:22.479201+0000","last_active":"2023-12-20T04:46:23.957064+0000","last_peered":"2023-12-20T04:46:23.957064+0000","last_clean":"2023-12-20T04:46:23.957064+0000","last_became_active":"2023-12-20T04:46:22.478702+0000","last_became_peered":"2023-12-20T04:46:22.478702+0000","last_unstale":"2023-12-20T04:46:23.957064+0000","last_undegraded":"2023-12-20T04:46:23.957064+0000","last_fullsized":"2023-12-20T04:46:23.957064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:09:00.588012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.469491+0000","last_change":"2023-12-20T04:46:22.131297+0000","last_active":"2023-12-20T04:46:22.469491+0000","last_peered":"2023-12-20T04:46:22.469491+0000","last_clean":"2023-12-20T04:46:22.469491+0000","last_became_active":"2023-12-20T04:46:22.130412+0000","last_became_peered":"2023-12-20T04:46:22.130412+0000","last_unstale":"2023-12-20T04:46:22.469491+0000","last_undegraded":"2023-12-20T04:46:22.469491+0000","last_fullsized":"2023-12-20T04:46:22.469491+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:17:23.544998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457645+0000","last_change":"2023-12-20T04:46:22.482400+0000","last_active":"2023-12-20T04:46:24.457645+0000","last_peered":"2023-12-20T04:46:24.457645+0000","last_clean":"2023-12-20T04:46:24.457645+0000","last_became_active":"2023-12-20T04:46:22.481705+0000","last_became_peered":"2023-12-20T04:46:22.481705+0000","last_unstale":"2023-12-20T04:46:24.457645+0000","last_undegraded":"2023-12-20T04:46:24.457645+0000","last_fullsized":"2023-12-20T04:46:24.457645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:21:32.232346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"81'3","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.478989+0000","last_change":"2023-12-20T04:46:22.125270+0000","last_active":"2023-12-20T04:46:22.478989+0000","last_peered":"2023-12-20T04:46:22.478989+0000","last_clean":"2023-12-20T04:46:22.478989+0000","last_became_active":"2023-12-20T04:46:22.125054+0000","last_became_peered":"2023-12-20T04:46:22.125054+0000","last_unstale":"2023-12-20T04:46:22.478989+0000","last_undegraded":"2023-12-20T04:46:22.478989+0000","last_fullsized":"2023-12-20T04:46:22.478989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:37:57.144156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957296+0000","last_change":"2023-12-20T04:46:22.466798+0000","last_active":"2023-12-20T04:46:23.957296+0000","last_peered":"2023-12-20T04:46:23.957296+0000","last_clean":"2023-12-20T04:46:23.957296+0000","last_became_active":"2023-12-20T04:46:22.466583+0000","last_became_peered":"2023-12-20T04:46:22.466583+0000","last_unstale":"2023-12-20T04:46:23.957296+0000","last_undegraded":"2023-12-20T04:46:23.957296+0000","last_fullsized":"2023-12-20T04:46:23.957296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:43:39.276674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"81'6","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463907+0000","last_change":"2023-12-20T04:46:22.126145+0000","last_active":"2023-12-20T04:46:23.463907+0000","last_peered":"2023-12-20T04:46:23.463907+0000","last_clean":"2023-12-20T04:46:23.463907+0000","last_became_active":"2023-12-20T04:46:22.124149+0000","last_became_peered":"2023-12-20T04:46:22.124149+0000","last_unstale":"2023-12-20T04:46:23.463907+0000","last_undegraded":"2023-12-20T04:46:23.463907+0000","last_fullsized":"2023-12-20T04:46:23.463907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:14:46.240010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957111+0000","last_change":"2023-12-20T04:46:22.479058+0000","last_active":"2023-12-20T04:46:23.957111+0000","last_peered":"2023-12-20T04:46:23.957111+0000","last_clean":"2023-12-20T04:46:23.957111+0000","last_became_active":"2023-12-20T04:46:22.478400+0000","last_became_peered":"2023-12-20T04:46:22.478400+0000","last_unstale":"2023-12-20T04:46:23.957111+0000","last_undegraded":"2023-12-20T04:46:23.957111+0000","last_fullsized":"2023-12-20T04:46:23.957111+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:24:37.308383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"81'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463727+0000","last_change":"2023-12-20T04:46:22.125321+0000","last_active":"2023-12-20T04:46:23.463727+0000","last_peered":"2023-12-20T04:46:23.463727+0000","last_clean":"2023-12-20T04:46:23.463727+0000","last_became_active":"2023-12-20T04:46:22.125114+0000","last_became_peered":"2023-12-20T04:46:22.125114+0000","last_unstale":"2023-12-20T04:46:23.463727+0000","last_undegraded":"2023-12-20T04:46:23.463727+0000","last_fullsized":"2023-12-20T04:46:23.463727+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:43:40.481954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457414+0000","last_change":"2023-12-20T04:46:22.469203+0000","last_active":"2023-12-20T04:46:24.457414+0000","last_peered":"2023-12-20T04:46:24.457414+0000","last_clean":"2023-12-20T04:46:24.457414+0000","last_became_active":"2023-12-20T04:46:22.468959+0000","last_became_peered":"2023-12-20T04:46:22.468959+0000","last_unstale":"2023-12-20T04:46:24.457414+0000","last_undegraded":"2023-12-20T04:46:24.457414+0000","last_fullsized":"2023-12-20T04:46:24.457414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:21:32.232346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.472668+0000","last_change":"2023-12-20T04:46:22.128187+0000","last_active":"2023-12-20T04:46:22.472668+0000","last_peered":"2023-12-20T04:46:22.472668+0000","last_clean":"2023-12-20T04:46:22.472668+0000","last_became_active":"2023-12-20T04:46:22.127868+0000","last_became_peered":"2023-12-20T04:46:22.127868+0000","last_unstale":"2023-12-20T04:46:22.472668+0000","last_undegraded":"2023-12-20T04:46:22.472668+0000","last_fullsized":"2023-12-20T04:46:22.472668+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:59:41.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468684+0000","last_change":"2023-12-20T04:46:22.482819+0000","last_active":"2023-12-20T04:46:23.468684+0000","last_peered":"2023-12-20T04:46:23.468684+0000","last_clean":"2023-12-20T04:46:23.468684+0000","last_became_active":"2023-12-20T04:46:22.482287+0000","last_became_peered":"2023-12-20T04:46:22.482287+0000","last_unstale":"2023-12-20T04:46:23.468684+0000","last_undegraded":"2023-12-20T04:46:23.468684+0000","last_fullsized":"2023-12-20T04:46:23.468684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:54:30.408847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.463482+0000","last_change":"2023-12-20T04:46:22.126477+0000","last_active":"2023-12-20T04:46:22.463482+0000","last_peered":"2023-12-20T04:46:22.463482+0000","last_clean":"2023-12-20T04:46:22.463482+0000","last_became_active":"2023-12-20T04:46:22.125537+0000","last_became_peered":"2023-12-20T04:46:22.125537+0000","last_unstale":"2023-12-20T04:46:22.463482+0000","last_undegraded":"2023-12-20T04:46:22.463482+0000","last_fullsized":"2023-12-20T04:46:22.463482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:59:16.940603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957508+0000","last_change":"2023-12-20T04:46:22.470217+0000","last_active":"2023-12-20T04:46:23.957508+0000","last_peered":"2023-12-20T04:46:23.957508+0000","last_clean":"2023-12-20T04:46:23.957508+0000","last_became_active":"2023-12-20T04:46:22.469582+0000","last_became_peered":"2023-12-20T04:46:22.469582+0000","last_unstale":"2023-12-20T04:46:23.957508+0000","last_undegraded":"2023-12-20T04:46:23.957508+0000","last_fullsized":"2023-12-20T04:46:23.957508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:20:07.824057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"81'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.483610+0000","last_change":"2023-12-20T04:46:22.127836+0000","last_active":"2023-12-20T04:46:22.483610+0000","last_peered":"2023-12-20T04:46:22.483610+0000","last_clean":"2023-12-20T04:46:22.483610+0000","last_became_active":"2023-12-20T04:46:22.127301+0000","last_became_peered":"2023-12-20T04:46:22.127301+0000","last_unstale":"2023-12-20T04:46:22.483610+0000","last_undegraded":"2023-12-20T04:46:22.483610+0000","last_fullsized":"2023-12-20T04:46:22.483610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:14:24.821694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.469247+0000","last_change":"2023-12-20T04:46:22.473483+0000","last_active":"2023-12-20T04:46:23.469247+0000","last_peered":"2023-12-20T04:46:23.469247+0000","last_clean":"2023-12-20T04:46:23.469247+0000","last_became_active":"2023-12-20T04:46:22.473119+0000","last_became_peered":"2023-12-20T04:46:22.473119+0000","last_unstale":"2023-12-20T04:46:23.469247+0000","last_undegraded":"2023-12-20T04:46:23.469247+0000","last_fullsized":"2023-12-20T04:46:23.469247+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:21:32.232346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.483130+0000","last_change":"2023-12-20T04:46:22.128462+0000","last_active":"2023-12-20T04:46:22.483130+0000","last_peered":"2023-12-20T04:46:22.483130+0000","last_clean":"2023-12-20T04:46:22.483130+0000","last_became_active":"2023-12-20T04:46:22.128192+0000","last_became_peered":"2023-12-20T04:46:22.128192+0000","last_unstale":"2023-12-20T04:46:22.483130+0000","last_undegraded":"2023-12-20T04:46:22.483130+0000","last_fullsized":"2023-12-20T04:46:22.483130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:14:24.821694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.956843+0000","last_change":"2023-12-20T04:46:22.474280+0000","last_active":"2023-12-20T04:46:23.956843+0000","last_peered":"2023-12-20T04:46:23.956843+0000","last_clean":"2023-12-20T04:46:23.956843+0000","last_became_active":"2023-12-20T04:46:22.474023+0000","last_became_peered":"2023-12-20T04:46:22.474023+0000","last_unstale":"2023-12-20T04:46:23.956843+0000","last_undegraded":"2023-12-20T04:46:23.956843+0000","last_fullsized":"2023-12-20T04:46:23.956843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:54:30.408847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.483208+0000","last_change":"2023-12-20T04:46:22.131086+0000","last_active":"2023-12-20T04:46:22.483208+0000","last_peered":"2023-12-20T04:46:22.483208+0000","last_clean":"2023-12-20T04:46:22.483208+0000","last_became_active":"2023-12-20T04:46:22.130538+0000","last_became_peered":"2023-12-20T04:46:22.130538+0000","last_unstale":"2023-12-20T04:46:22.483208+0000","last_undegraded":"2023-12-20T04:46:22.483208+0000","last_fullsized":"2023-12-20T04:46:22.483208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:06:05.221249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463792+0000","last_change":"2023-12-20T04:46:22.470147+0000","last_active":"2023-12-20T04:46:23.463792+0000","last_peered":"2023-12-20T04:46:23.463792+0000","last_clean":"2023-12-20T04:46:23.463792+0000","last_became_active":"2023-12-20T04:46:22.469901+0000","last_became_peered":"2023-12-20T04:46:22.469901+0000","last_unstale":"2023-12-20T04:46:23.463792+0000","last_undegraded":"2023-12-20T04:46:23.463792+0000","last_fullsized":"2023-12-20T04:46:23.463792+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:31:17.078421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.484278+0000","last_change":"2023-12-20T04:46:22.126279+0000","last_active":"2023-12-20T04:46:22.484278+0000","last_peered":"2023-12-20T04:46:22.484278+0000","last_clean":"2023-12-20T04:46:22.484278+0000","last_became_active":"2023-12-20T04:46:22.126006+0000","last_became_peered":"2023-12-20T04:46:22.126006+0000","last_unstale":"2023-12-20T04:46:22.484278+0000","last_undegraded":"2023-12-20T04:46:22.484278+0000","last_fullsized":"2023-12-20T04:46:22.484278+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:43:40.481954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957693+0000","last_change":"2023-12-20T04:46:22.471470+0000","last_active":"2023-12-20T04:46:23.957693+0000","last_peered":"2023-12-20T04:46:23.957693+0000","last_clean":"2023-12-20T04:46:23.957693+0000","last_became_active":"2023-12-20T04:46:22.471249+0000","last_became_peered":"2023-12-20T04:46:22.471249+0000","last_unstale":"2023-12-20T04:46:23.957693+0000","last_undegraded":"2023-12-20T04:46:23.957693+0000","last_fullsized":"2023-12-20T04:46:23.957693+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:36:44.147722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.469893+0000","last_change":"2023-12-20T04:46:22.130288+0000","last_active":"2023-12-20T04:46:22.469893+0000","last_peered":"2023-12-20T04:46:22.469893+0000","last_clean":"2023-12-20T04:46:22.469893+0000","last_became_active":"2023-12-20T04:46:22.130057+0000","last_became_peered":"2023-12-20T04:46:22.130057+0000","last_unstale":"2023-12-20T04:46:22.469893+0000","last_undegraded":"2023-12-20T04:46:22.469893+0000","last_fullsized":"2023-12-20T04:46:22.469893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:05:01.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957599+0000","last_change":"2023-12-20T04:46:22.467953+0000","last_active":"2023-12-20T04:46:23.957599+0000","last_peered":"2023-12-20T04:46:23.957599+0000","last_clean":"2023-12-20T04:46:23.957599+0000","last_became_active":"2023-12-20T04:46:22.467744+0000","last_became_peered":"2023-12-20T04:46:22.467744+0000","last_unstale":"2023-12-20T04:46:23.957599+0000","last_undegraded":"2023-12-20T04:46:23.957599+0000","last_fullsized":"2023-12-20T04:46:23.957599+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:07:48.441109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.470347+0000","last_change":"2023-12-20T04:46:22.131099+0000","last_active":"2023-12-20T04:46:22.470347+0000","last_peered":"2023-12-20T04:46:22.470347+0000","last_clean":"2023-12-20T04:46:22.470347+0000","last_became_active":"2023-12-20T04:46:22.129550+0000","last_became_peered":"2023-12-20T04:46:22.129550+0000","last_unstale":"2023-12-20T04:46:22.470347+0000","last_undegraded":"2023-12-20T04:46:22.470347+0000","last_fullsized":"2023-12-20T04:46:22.470347+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:59:16.940603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957229+0000","last_change":"2023-12-20T04:46:22.475341+0000","last_active":"2023-12-20T04:46:23.957229+0000","last_peered":"2023-12-20T04:46:23.957229+0000","last_clean":"2023-12-20T04:46:23.957229+0000","last_became_active":"2023-12-20T04:46:22.474388+0000","last_became_peered":"2023-12-20T04:46:22.474388+0000","last_unstale":"2023-12-20T04:46:23.957229+0000","last_undegraded":"2023-12-20T04:46:23.957229+0000","last_fullsized":"2023-12-20T04:46:23.957229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:23:42.730944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.463154+0000","last_change":"2023-12-20T04:46:22.128872+0000","last_active":"2023-12-20T04:46:22.463154+0000","last_peered":"2023-12-20T04:46:22.463154+0000","last_clean":"2023-12-20T04:46:22.463154+0000","last_became_active":"2023-12-20T04:46:22.128629+0000","last_became_peered":"2023-12-20T04:46:22.128629+0000","last_unstale":"2023-12-20T04:46:22.463154+0000","last_undegraded":"2023-12-20T04:46:22.463154+0000","last_fullsized":"2023-12-20T04:46:22.463154+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:32:07.943631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957200+0000","last_change":"2023-12-20T04:46:22.474025+0000","last_active":"2023-12-20T04:46:23.957200+0000","last_peered":"2023-12-20T04:46:23.957200+0000","last_clean":"2023-12-20T04:46:23.957200+0000","last_became_active":"2023-12-20T04:46:22.473811+0000","last_became_peered":"2023-12-20T04:46:22.473811+0000","last_unstale":"2023-12-20T04:46:23.957200+0000","last_undegraded":"2023-12-20T04:46:23.957200+0000","last_fullsized":"2023-12-20T04:46:23.957200+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:38:42.361145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468620+0000","last_change":"2023-12-20T04:46:22.121829+0000","last_active":"2023-12-20T04:46:23.468620+0000","last_peered":"2023-12-20T04:46:23.468620+0000","last_clean":"2023-12-20T04:46:23.468620+0000","last_became_active":"2023-12-20T04:46:22.121618+0000","last_became_peered":"2023-12-20T04:46:22.121618+0000","last_unstale":"2023-12-20T04:46:23.468620+0000","last_undegraded":"2023-12-20T04:46:23.468620+0000","last_fullsized":"2023-12-20T04:46:23.468620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:52:03.581175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468735+0000","last_change":"2023-12-20T04:46:22.473823+0000","last_active":"2023-12-20T04:46:23.468735+0000","last_peered":"2023-12-20T04:46:23.468735+0000","last_clean":"2023-12-20T04:46:23.468735+0000","last_became_active":"2023-12-20T04:46:22.473550+0000","last_became_peered":"2023-12-20T04:46:22.473550+0000","last_unstale":"2023-12-20T04:46:23.468735+0000","last_undegraded":"2023-12-20T04:46:23.468735+0000","last_fullsized":"2023-12-20T04:46:23.468735+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:26:05.275199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.483105+0000","last_change":"2023-12-20T04:46:22.131114+0000","last_active":"2023-12-20T04:46:22.483105+0000","last_peered":"2023-12-20T04:46:22.483105+0000","last_clean":"2023-12-20T04:46:22.483105+0000","last_became_active":"2023-12-20T04:46:22.130124+0000","last_became_peered":"2023-12-20T04:46:22.130124+0000","last_unstale":"2023-12-20T04:46:22.483105+0000","last_undegraded":"2023-12-20T04:46:22.483105+0000","last_fullsized":"2023-12-20T04:46:22.483105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:14:46.240010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457367+0000","last_change":"2023-12-20T04:46:22.466948+0000","last_active":"2023-12-20T04:46:24.457367+0000","last_peered":"2023-12-20T04:46:24.457367+0000","last_clean":"2023-12-20T04:46:24.457367+0000","last_became_active":"2023-12-20T04:46:22.466517+0000","last_became_peered":"2023-12-20T04:46:22.466517+0000","last_unstale":"2023-12-20T04:46:24.457367+0000","last_undegraded":"2023-12-20T04:46:24.457367+0000","last_fullsized":"2023-12-20T04:46:24.457367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:17:52.143648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.462905+0000","last_change":"2023-12-20T04:46:22.127625+0000","last_active":"2023-12-20T04:46:22.462905+0000","last_peered":"2023-12-20T04:46:22.462905+0000","last_clean":"2023-12-20T04:46:22.462905+0000","last_became_active":"2023-12-20T04:46:22.125335+0000","last_became_peered":"2023-12-20T04:46:22.125335+0000","last_unstale":"2023-12-20T04:46:22.462905+0000","last_undegraded":"2023-12-20T04:46:22.462905+0000","last_fullsized":"2023-12-20T04:46:22.462905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:06:59.201562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.956930+0000","last_change":"2023-12-20T04:46:22.478942+0000","last_active":"2023-12-20T04:46:23.956930+0000","last_peered":"2023-12-20T04:46:23.956930+0000","last_clean":"2023-12-20T04:46:23.956930+0000","last_became_active":"2023-12-20T04:46:22.478750+0000","last_became_peered":"2023-12-20T04:46:22.478750+0000","last_unstale":"2023-12-20T04:46:23.956930+0000","last_undegraded":"2023-12-20T04:46:23.956930+0000","last_fullsized":"2023-12-20T04:46:23.956930+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:51:49.784398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957323+0000","last_change":"2023-12-20T04:46:22.125233+0000","last_active":"2023-12-20T04:46:23.957323+0000","last_peered":"2023-12-20T04:46:23.957323+0000","last_clean":"2023-12-20T04:46:23.957323+0000","last_became_active":"2023-12-20T04:46:22.124866+0000","last_became_peered":"2023-12-20T04:46:22.124866+0000","last_unstale":"2023-12-20T04:46:23.957323+0000","last_undegraded":"2023-12-20T04:46:23.957323+0000","last_fullsized":"2023-12-20T04:46:23.957323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:56:36.871361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.956924+0000","last_change":"2023-12-20T04:46:22.479959+0000","last_active":"2023-12-20T04:46:23.956924+0000","last_peered":"2023-12-20T04:46:23.956924+0000","last_clean":"2023-12-20T04:46:23.956924+0000","last_became_active":"2023-12-20T04:46:22.479724+0000","last_became_peered":"2023-12-20T04:46:22.479724+0000","last_unstale":"2023-12-20T04:46:23.956924+0000","last_undegraded":"2023-12-20T04:46:23.956924+0000","last_fullsized":"2023-12-20T04:46:23.956924+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:37:58.149377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468712+0000","last_change":"2023-12-20T04:46:22.128326+0000","last_active":"2023-12-20T04:46:23.468712+0000","last_peered":"2023-12-20T04:46:23.468712+0000","last_clean":"2023-12-20T04:46:23.468712+0000","last_became_active":"2023-12-20T04:46:22.127948+0000","last_became_peered":"2023-12-20T04:46:22.127948+0000","last_unstale":"2023-12-20T04:46:23.468712+0000","last_undegraded":"2023-12-20T04:46:23.468712+0000","last_fullsized":"2023-12-20T04:46:23.468712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:35:52.946067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957594+0000","last_change":"2023-12-20T04:46:22.470421+0000","last_active":"2023-12-20T04:46:23.957594+0000","last_peered":"2023-12-20T04:46:23.957594+0000","last_clean":"2023-12-20T04:46:23.957594+0000","last_became_active":"2023-12-20T04:46:22.469847+0000","last_became_peered":"2023-12-20T04:46:22.469847+0000","last_unstale":"2023-12-20T04:46:23.957594+0000","last_undegraded":"2023-12-20T04:46:23.957594+0000","last_fullsized":"2023-12-20T04:46:23.957594+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:25:50.994218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957787+0000","last_change":"2023-12-20T04:46:22.127429+0000","last_active":"2023-12-20T04:46:23.957787+0000","last_peered":"2023-12-20T04:46:23.957787+0000","last_clean":"2023-12-20T04:46:23.957787+0000","last_became_active":"2023-12-20T04:46:22.126824+0000","last_became_peered":"2023-12-20T04:46:22.126824+0000","last_unstale":"2023-12-20T04:46:23.957787+0000","last_undegraded":"2023-12-20T04:46:23.957787+0000","last_fullsized":"2023-12-20T04:46:23.957787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:03:08.301825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457868+0000","last_change":"2023-12-20T04:46:22.480432+0000","last_active":"2023-12-20T04:46:24.457868+0000","last_peered":"2023-12-20T04:46:24.457868+0000","last_clean":"2023-12-20T04:46:24.457868+0000","last_became_active":"2023-12-20T04:46:22.479765+0000","last_became_peered":"2023-12-20T04:46:22.479765+0000","last_unstale":"2023-12-20T04:46:24.457868+0000","last_undegraded":"2023-12-20T04:46:24.457868+0000","last_fullsized":"2023-12-20T04:46:24.457868+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:32:25.152313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463868+0000","last_change":"2023-12-20T04:46:22.124845+0000","last_active":"2023-12-20T04:46:23.463868+0000","last_peered":"2023-12-20T04:46:23.463868+0000","last_clean":"2023-12-20T04:46:23.463868+0000","last_became_active":"2023-12-20T04:46:22.124634+0000","last_became_peered":"2023-12-20T04:46:22.124634+0000","last_unstale":"2023-12-20T04:46:23.463868+0000","last_undegraded":"2023-12-20T04:46:23.463868+0000","last_fullsized":"2023-12-20T04:46:23.463868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:30:11.017106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463740+0000","last_change":"2023-12-20T04:46:22.470696+0000","last_active":"2023-12-20T04:46:23.463740+0000","last_peered":"2023-12-20T04:46:23.463740+0000","last_clean":"2023-12-20T04:46:23.463740+0000","last_became_active":"2023-12-20T04:46:22.470478+0000","last_became_peered":"2023-12-20T04:46:22.470478+0000","last_unstale":"2023-12-20T04:46:23.463740+0000","last_undegraded":"2023-12-20T04:46:23.463740+0000","last_fullsized":"2023-12-20T04:46:23.463740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:45:35.109084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.465855+0000","last_change":"2023-12-20T04:46:22.128947+0000","last_active":"2023-12-20T04:46:22.465855+0000","last_peered":"2023-12-20T04:46:22.465855+0000","last_clean":"2023-12-20T04:46:22.465855+0000","last_became_active":"2023-12-20T04:46:22.127610+0000","last_became_peered":"2023-12-20T04:46:22.127610+0000","last_unstale":"2023-12-20T04:46:22.465855+0000","last_undegraded":"2023-12-20T04:46:22.465855+0000","last_fullsized":"2023-12-20T04:46:22.465855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:32:07.943631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457578+0000","last_change":"2023-12-20T04:46:22.479028+0000","last_active":"2023-12-20T04:46:24.457578+0000","last_peered":"2023-12-20T04:46:24.457578+0000","last_clean":"2023-12-20T04:46:24.457578+0000","last_became_active":"2023-12-20T04:46:22.475448+0000","last_became_peered":"2023-12-20T04:46:22.475448+0000","last_unstale":"2023-12-20T04:46:24.457578+0000","last_undegraded":"2023-12-20T04:46:24.457578+0000","last_fullsized":"2023-12-20T04:46:24.457578+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:35:53.951288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.470258+0000","last_change":"2023-12-20T04:46:22.131875+0000","last_active":"2023-12-20T04:46:22.470258+0000","last_peered":"2023-12-20T04:46:22.470258+0000","last_clean":"2023-12-20T04:46:22.470258+0000","last_became_active":"2023-12-20T04:46:22.131698+0000","last_became_peered":"2023-12-20T04:46:22.131698+0000","last_unstale":"2023-12-20T04:46:22.470258+0000","last_undegraded":"2023-12-20T04:46:22.470258+0000","last_fullsized":"2023-12-20T04:46:22.470258+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:30:11.017106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957347+0000","last_change":"2023-12-20T04:46:22.482490+0000","last_active":"2023-12-20T04:46:23.957347+0000","last_peered":"2023-12-20T04:46:23.957347+0000","last_clean":"2023-12-20T04:46:23.957347+0000","last_became_active":"2023-12-20T04:46:22.481910+0000","last_became_peered":"2023-12-20T04:46:22.481910+0000","last_unstale":"2023-12-20T04:46:23.957347+0000","last_undegraded":"2023-12-20T04:46:23.957347+0000","last_fullsized":"2023-12-20T04:46:23.957347+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:11:24.087157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.483596+0000","last_change":"2023-12-20T04:46:22.131734+0000","last_active":"2023-12-20T04:46:22.483596+0000","last_peered":"2023-12-20T04:46:22.483596+0000","last_clean":"2023-12-20T04:46:22.483596+0000","last_became_active":"2023-12-20T04:46:22.130730+0000","last_became_peered":"2023-12-20T04:46:22.130730+0000","last_unstale":"2023-12-20T04:46:22.483596+0000","last_undegraded":"2023-12-20T04:46:22.483596+0000","last_fullsized":"2023-12-20T04:46:22.483596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:32:07.943631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":218,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.470712+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:46:22.470712+0000","last_peered":"2023-12-20T04:46:22.470712+0000","last_clean":"2023-12-20T04:46:22.470712+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:46:22.470712+0000","last_undegraded":"2023-12-20T04:46:22.470712+0000","last_fullsized":"2023-12-20T04:46:22.470712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1000,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194312,"statfs":{"total":200000000,"available":198975881,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.45200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.747,"5min":0.754,"15min":0.754},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.37,"5min":0.315,"15min":0.315},"max":{"1min":0.67500000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68500000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.44500000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76600000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.621}]},{"osd":2,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.751,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71599999999999997,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.501}]},{"osd":3,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71899999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.72999999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.57199999999999995}]},{"osd":4,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.48699999999999999,"15min":0.48599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.61299999999999999,"5min":0.753,"15min":0.753},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.61299999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68500000000000005,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.60299999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.53900000000000003,"15min":0.55300000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64400000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66300000000000003,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.54500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":423,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194889,"statfs":{"total":200000000,"available":199566773,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48899999999999999,"15min":0.48999999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.61299999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.314,"15min":0.314},"max":{"1min":0.63700000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.51900000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.52400000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71499999999999997,"5min":0.751,"15min":0.751},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57099999999999995,"15min":0.57799999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.503}]},{"osd":2,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.34399999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.58899999999999997}]},{"osd":3,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.50800000000000001,"15min":0.49199999999999999},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.42399999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54100000000000004}]},{"osd":4,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.502,"15min":0.51200000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.67500000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.5,"15min":0.49299999999999999},"min":{"1min":0.38700000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70899999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.35699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72499999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.625}]},{"osd":7,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.45200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.42399999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":423,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194889,"statfs":{"total":200000000,"available":199566775,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.505},"min":{"1min":0.40600000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69999999999999996,"5min":0.745,"15min":0.745},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.498,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.434}]},{"osd":1,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.41899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68700000000000006,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.39100000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.41599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52200000000000002,"15min":0.51500000000000001},"min":{"1min":0.441,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.371}]},{"osd":3,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.67300000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.41599999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.45400000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.32900000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.74399999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47899999999999998,"15min":0.48199999999999998},"min":{"1min":0.318,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69399999999999995,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.65800000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.33200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.75700000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.318,"5min":0.31,"15min":0.31},"max":{"1min":0.81200000000000006,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54100000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52200000000000002,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73399999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60199999999999998,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80000000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":423,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194889,"statfs":{"total":200000000,"available":199566795,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.40600000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.63300000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.40400000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51600000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69699999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.55300000000000005},"min":{"1min":0.39000000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.48999999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.47699999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.74299999999999999,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.57399999999999995}]},{"osd":5,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57899999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.44},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.66100000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.497,"15min":0.50600000000000001},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.625,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68300000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.56000000000000005}]},{"osd":7,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50900000000000001,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.66700000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":423,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194889,"statfs":{"total":200000000,"available":199566753,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.33500000000000002},"min":{"1min":0.26100000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.44900000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.254,"5min":0.246,"15min":0.246},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.311}]},{"osd":1,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.316},"min":{"1min":0.23300000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.30599999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.51700000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.255}]},{"osd":2,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.248,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.498,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.378,"15min":0.371},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.32300000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.80500000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.441},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81499999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.433}]},{"osd":5,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.40200000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.437,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.752,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40500000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.41099999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.749,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.55200000000000005},"min":{"1min":0.45100000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47599999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.41199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76000000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":424,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194887,"statfs":{"total":200000000,"available":199565301,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.30399999999999999,"15min":0.28999999999999998},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.437},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.37,"15min":0.33800000000000002},"min":{"1min":0.23200000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":1.135,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.33700000000000002,"15min":0.32500000000000001},"min":{"1min":0.23300000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.35599999999999998,"15min":0.34399999999999997},"min":{"1min":0.253,"5min":0.245,"15min":0.245},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.48399999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.372,"15min":0.35099999999999998},"min":{"1min":0.29399999999999998,"5min":0.216,"15min":0.216},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.496},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.376,"15min":0.36499999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.39900000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58399999999999996,"15min":0.56699999999999995},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.79300000000000004,"5min":2.347,"15min":2.347},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.41999999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.432,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60799999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.57299999999999995},"min":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76000000000000001,"5min":2.274,"15min":2.274},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.46000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1659999999999999,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.62}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":425,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194887,"statfs":{"total":200000000,"available":199564685,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.29699999999999999,"15min":0.28399999999999997},"min":{"1min":0.221,"5min":0.187,"15min":0.187},"max":{"1min":0.48299999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32500000000000001},"min":{"1min":0.28999999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.28799999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.312,"15min":0.29999999999999999},"min":{"1min":0.223,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51400000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.34300000000000003},"min":{"1min":0.307,"5min":0.224,"15min":0.224},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.309}]},{"osd":3,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.191,"15min":0.191},"max":{"1min":0.52300000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.35099999999999998},"min":{"1min":0.30199999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.32300000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72699999999999998,"5min":0.873,"15min":0.873},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.497}]},{"osd":5,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71399999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.48399999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.41399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78100000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47399999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82399999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.46100000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76500000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":999,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194312,"statfs":{"total":200000000,"available":198976497,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.311,"15min":0.30599999999999999},"min":{"1min":0.23100000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.46500000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.31900000000000001,"15min":0.307},"min":{"1min":0.24199999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.309}]},{"osd":2,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.35599999999999998,"15min":0.35399999999999998},"min":{"1min":0.24199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.53600000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.28799999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.33600000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.31900000000000001},"min":{"1min":0.245,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.373,"15min":0.36399999999999999},"min":{"1min":0.33500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.373}]},{"osd":4,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74399999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.40799999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.76000000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.52600000000000002,"15min":0.51300000000000001},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78700000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.40100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.65000000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82799999999999996,"5min":0.873,"15min":0.873},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84699999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.58299999999999996}]},{"osd":7,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.44800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68100000000000005}]}]}],"pool_statfs":[]}} 2023-12-20T04:46:29.775 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:46:29.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.885+0000 7ff33d573640 1 Processor -- start 2023-12-20T04:46:29.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.885+0000 7ff33d573640 1 -- start start 2023-12-20T04:46:29.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.886+0000 7ff33d573640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff338160450 0x7ff338160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:29.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.886+0000 7ff33d573640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3381611b0 0x7ff3380b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:29.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.886+0000 7ff33d573640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff3380b4ec0 0x7ff33806a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:29.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.886+0000 7ff33d573640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3380b5350 con 0x7ff3380b4ec0 2023-12-20T04:46:29.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.886+0000 7ff33d573640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff3380b5ec0 con 0x7ff338160450 2023-12-20T04:46:29.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.886+0000 7ff33d573640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff3381617e0 con 0x7ff3381611b0 2023-12-20T04:46:29.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.886+0000 7ff3377fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff3380b4ec0 0x7ff33806a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:29.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.886+0000 7ff3377fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff3380b4ec0 0x7ff33806a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59532/0 (socket says 172.21.15.132:59532) 2023-12-20T04:46:29.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.886+0000 7ff3377fe640 1 -- 172.21.15.132:0/3525487956 learned_addr learned my addr 172.21.15.132:0/3525487956 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:29.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.886+0000 7ff3377fe640 1 -- 172.21.15.132:0/3525487956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3381611b0 msgr2=0x7ff3380b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:29.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.886+0000 7ff3377fe640 1 --2- 172.21.15.132:0/3525487956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3381611b0 0x7ff3380b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:29.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.886+0000 7ff3377fe640 1 -- 172.21.15.132:0/3525487956 >> v2:172.21.15.187:3300/0 conn(0x7ff338160450 msgr2=0x7ff338160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:29.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.886+0000 7ff336ffd640 1 --2- 172.21.15.132:0/3525487956 >> v2:172.21.15.187:3300/0 conn(0x7ff338160450 0x7ff338160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:29.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.886+0000 7ff3377fe640 1 --2- 172.21.15.132:0/3525487956 >> v2:172.21.15.187:3300/0 conn(0x7ff338160450 0x7ff338160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:29.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.886+0000 7ff3377fe640 1 -- 172.21.15.132:0/3525487956 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff3380d0fc0 con 0x7ff3380b4ec0 2023-12-20T04:46:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.887+0000 7ff3377fe640 1 --2- 172.21.15.132:0/3525487956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3380b4ec0 0x7ff33806a1a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff33808b150 tx=0x7ff33002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e525a83001f6eb0f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.887+0000 7ff3367fc640 1 -- 172.21.15.132:0/3525487956 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff33002cb00 con 0x7ff3380b4ec0 2023-12-20T04:46:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.887+0000 7ff3367fc640 1 -- 172.21.15.132:0/3525487956 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff33002cc60 con 0x7ff3380b4ec0 2023-12-20T04:46:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.887+0000 7ff3367fc640 1 -- 172.21.15.132:0/3525487956 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff3300343f0 con 0x7ff3380b4ec0 2023-12-20T04:46:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.888+0000 7ff33d573640 1 -- 172.21.15.132:0/3525487956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3380b4ec0 msgr2=0x7ff33806a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.888+0000 7ff33d573640 1 --2- 172.21.15.132:0/3525487956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3380b4ec0 0x7ff33806a1a0 secure :-1 s=READY pgs=898 cs=0 l=1 rev1=1 crypto rx=0x7ff33808b150 tx=0x7ff33002bf60 comp rx=0 tx=0).stop 2023-12-20T04:46:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.888+0000 7ff33d573640 1 -- 172.21.15.132:0/3525487956 shutdown_connections 2023-12-20T04:46:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.888+0000 7ff33d573640 1 --2- 172.21.15.132:0/3525487956 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff3380b4ec0 0x7ff33806a1a0 unknown :-1 s=CLOSED pgs=898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.888+0000 7ff33d573640 1 --2- 172.21.15.132:0/3525487956 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3381611b0 0x7ff3380b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.888+0000 7ff33d573640 1 --2- 172.21.15.132:0/3525487956 >> v2:172.21.15.187:3300/0 conn(0x7ff338160450 0x7ff338160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.888+0000 7ff33d573640 1 -- 172.21.15.132:0/3525487956 >> 172.21.15.132:0/3525487956 conn(0x7ff3380cf980 msgr2=0x7ff3380cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.888+0000 7ff33d573640 1 -- 172.21.15.132:0/3525487956 shutdown_connections 2023-12-20T04:46:29.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.888+0000 7ff33d573640 1 -- 172.21.15.132:0/3525487956 wait complete. 2023-12-20T04:46:29.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.889+0000 7ff33d573640 1 Processor -- start 2023-12-20T04:46:29.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.889+0000 7ff33d573640 1 -- start start 2023-12-20T04:46:29.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff33d573640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3380b4ec0 0x7ff338151aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:29.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff33d573640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff338160450 0x7ff338157150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:29.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff33d573640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3381611b0 0x7ff3380d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:29.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff33d573640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff33815add0 con 0x7ff338160450 2023-12-20T04:46:29.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff33d573640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff338151fe0 con 0x7ff3381611b0 2023-12-20T04:46:29.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff33d573640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff33815a4c0 con 0x7ff3380b4ec0 2023-12-20T04:46:29.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff32ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff338160450 0x7ff338157150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:29.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff32ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff338160450 0x7ff338157150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59534/0 (socket says 172.21.15.132:59534) 2023-12-20T04:46:29.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff32ffff640 1 -- 172.21.15.132:0/1286024607 learned_addr learned my addr 172.21.15.132:0/1286024607 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:29.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff3377fe640 1 --2- 172.21.15.132:0/1286024607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3381611b0 0x7ff3380d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:29.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff336ffd640 1 --2- 172.21.15.132:0/1286024607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3380b4ec0 0x7ff338151aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:29.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff32ffff640 1 -- 172.21.15.132:0/1286024607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3380b4ec0 msgr2=0x7ff338151aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:29.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff32ffff640 1 --2- 172.21.15.132:0/1286024607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3380b4ec0 0x7ff338151aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:29.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff32ffff640 1 -- 172.21.15.132:0/1286024607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3381611b0 msgr2=0x7ff3380d29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:29.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff32ffff640 1 --2- 172.21.15.132:0/1286024607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3381611b0 0x7ff3380d29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:29.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff32ffff640 1 -- 172.21.15.132:0/1286024607 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff330009b30 con 0x7ff338160450 2023-12-20T04:46:29.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff336ffd640 1 --2- 172.21.15.132:0/1286024607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3380b4ec0 0x7ff338151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:29.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff32ffff640 1 --2- 172.21.15.132:0/1286024607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff338160450 0x7ff338157150 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff32000b410 tx=0x7ff32000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:29.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff32f7fe640 1 -- 172.21.15.132:0/1286024607 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff320011830 con 0x7ff338160450 2023-12-20T04:46:29.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff32f7fe640 1 -- 172.21.15.132:0/1286024607 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff3200119b0 con 0x7ff338160450 2023-12-20T04:46:29.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff32f7fe640 1 -- 172.21.15.132:0/1286024607 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff320011d60 con 0x7ff338160450 2023-12-20T04:46:29.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff33d573640 1 -- 172.21.15.132:0/1286024607 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff338157b40 con 0x7ff338160450 2023-12-20T04:46:29.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.890+0000 7ff33d573640 1 -- 172.21.15.132:0/1286024607 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff33815aa60 con 0x7ff338160450 2023-12-20T04:46:29.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.891+0000 7ff33d573640 1 -- 172.21.15.132:0/1286024607 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff33815af40 con 0x7ff338160450 2023-12-20T04:46:29.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.892+0000 7ff32f7fe640 1 -- 172.21.15.132:0/1286024607 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff32001a400 con 0x7ff338160450 2023-12-20T04:46:29.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.892+0000 7ff32f7fe640 1 --2- 172.21.15.132:0/1286024607 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff31806a430 0x7ff31806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:29.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.892+0000 7ff336ffd640 1 --2- 172.21.15.132:0/1286024607 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff31806a430 0x7ff31806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:29.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.892+0000 7ff32f7fe640 1 -- 172.21.15.132:0/1286024607 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff320088930 con 0x7ff338160450 2023-12-20T04:46:29.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.893+0000 7ff336ffd640 1 --2- 172.21.15.132:0/1286024607 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff31806a430 0x7ff31806c8f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff32800a9d0 tx=0x7ff328008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:29.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:29.897+0000 7ff32f7fe640 1 -- 172.21.15.132:0/1286024607 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff320053fb0 con 0x7ff338160450 2023-12-20T04:46:30.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.060+0000 7ff33d573640 1 -- 172.21.15.132:0/1286024607 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff3380d1580 con 0x7ff31806a430 2023-12-20T04:46:30.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.067+0000 7ff32f7fe640 1 -- 172.21.15.132:0/1286024607 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285164 (secure 0 0 0) 0x7ff32800a750 con 0x7ff31806a430 2023-12-20T04:46:30.073 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:30.075 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:46:30.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.070+0000 7ff33d573640 1 -- 172.21.15.132:0/1286024607 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff31806a430 msgr2=0x7ff31806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:30.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.070+0000 7ff33d573640 1 --2- 172.21.15.132:0/1286024607 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff31806a430 0x7ff31806c8f0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7ff32800a9d0 tx=0x7ff328008040 comp rx=0 tx=0).stop 2023-12-20T04:46:30.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.070+0000 7ff33d573640 1 -- 172.21.15.132:0/1286024607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff338160450 msgr2=0x7ff338157150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:30.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.070+0000 7ff33d573640 1 --2- 172.21.15.132:0/1286024607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff338160450 0x7ff338157150 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7ff32000b410 tx=0x7ff32000b8d0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.070+0000 7ff33d573640 1 -- 172.21.15.132:0/1286024607 shutdown_connections 2023-12-20T04:46:30.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.070+0000 7ff33d573640 1 --2- 172.21.15.132:0/1286024607 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff31806a430 0x7ff31806c8f0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.070+0000 7ff33d573640 1 --2- 172.21.15.132:0/1286024607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff3381611b0 0x7ff3380d29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.070+0000 7ff33d573640 1 --2- 172.21.15.132:0/1286024607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff338160450 0x7ff338157150 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.070+0000 7ff33d573640 1 --2- 172.21.15.132:0/1286024607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff3380b4ec0 0x7ff338151aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.070+0000 7ff33d573640 1 -- 172.21.15.132:0/1286024607 >> 172.21.15.132:0/1286024607 conn(0x7ff3380cf980 msgr2=0x7ff3380b79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:30.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.070+0000 7ff33d573640 1 -- 172.21.15.132:0/1286024607 shutdown_connections 2023-12-20T04:46:30.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.070+0000 7ff33d573640 1 -- 172.21.15.132:0/1286024607 wait complete. 2023-12-20T04:46:30.083 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":190,"stamp":"2023-12-20T04:46:28.139243+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":153,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":4541,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557958,"statfs":{"total":1600000000,"available":1595349460,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.021652"},"pg_stats":[{"pgid":"11.3f","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.956790+0000","last_change":"2023-12-20T04:46:22.477539+0000","last_active":"2023-12-20T04:46:23.956790+0000","last_peered":"2023-12-20T04:46:23.956790+0000","last_clean":"2023-12-20T04:46:23.956790+0000","last_became_active":"2023-12-20T04:46:22.475369+0000","last_became_peered":"2023-12-20T04:46:22.475369+0000","last_unstale":"2023-12-20T04:46:23.956790+0000","last_undegraded":"2023-12-20T04:46:23.956790+0000","last_fullsized":"2023-12-20T04:46:23.956790+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:23:21.068943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.3e","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457344+0000","last_change":"2023-12-20T04:46:22.480708+0000","last_active":"2023-12-20T04:46:24.457344+0000","last_peered":"2023-12-20T04:46:24.457344+0000","last_clean":"2023-12-20T04:46:24.457344+0000","last_became_active":"2023-12-20T04:46:22.480446+0000","last_became_peered":"2023-12-20T04:46:22.480446+0000","last_unstale":"2023-12-20T04:46:24.457344+0000","last_undegraded":"2023-12-20T04:46:24.457344+0000","last_fullsized":"2023-12-20T04:46:24.457344+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:14:27.337034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.3d","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957520+0000","last_change":"2023-12-20T04:46:22.474047+0000","last_active":"2023-12-20T04:46:23.957520+0000","last_peered":"2023-12-20T04:46:23.957520+0000","last_clean":"2023-12-20T04:46:23.957520+0000","last_became_active":"2023-12-20T04:46:22.473834+0000","last_became_peered":"2023-12-20T04:46:22.473834+0000","last_unstale":"2023-12-20T04:46:23.957520+0000","last_undegraded":"2023-12-20T04:46:23.957520+0000","last_fullsized":"2023-12-20T04:46:23.957520+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:36:49.722629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.3c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463654+0000","last_change":"2023-12-20T04:46:22.473600+0000","last_active":"2023-12-20T04:46:23.463654+0000","last_peered":"2023-12-20T04:46:23.463654+0000","last_clean":"2023-12-20T04:46:23.463654+0000","last_became_active":"2023-12-20T04:46:22.473259+0000","last_became_peered":"2023-12-20T04:46:22.473259+0000","last_unstale":"2023-12-20T04:46:23.463654+0000","last_undegraded":"2023-12-20T04:46:23.463654+0000","last_fullsized":"2023-12-20T04:46:23.463654+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:05:02.790854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.3b","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957624+0000","last_change":"2023-12-20T04:46:22.475548+0000","last_active":"2023-12-20T04:46:23.957624+0000","last_peered":"2023-12-20T04:46:23.957624+0000","last_clean":"2023-12-20T04:46:23.957624+0000","last_became_active":"2023-12-20T04:46:22.475354+0000","last_became_peered":"2023-12-20T04:46:22.475354+0000","last_unstale":"2023-12-20T04:46:23.957624+0000","last_undegraded":"2023-12-20T04:46:23.957624+0000","last_fullsized":"2023-12-20T04:46:23.957624+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:00:55.120248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457652+0000","last_change":"2023-12-20T04:46:22.476832+0000","last_active":"2023-12-20T04:46:24.457652+0000","last_peered":"2023-12-20T04:46:24.457652+0000","last_clean":"2023-12-20T04:46:24.457652+0000","last_became_active":"2023-12-20T04:46:22.476537+0000","last_became_peered":"2023-12-20T04:46:22.476537+0000","last_unstale":"2023-12-20T04:46:24.457652+0000","last_undegraded":"2023-12-20T04:46:24.457652+0000","last_fullsized":"2023-12-20T04:46:24.457652+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:25.106264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.39","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457182+0000","last_change":"2023-12-20T04:46:22.466789+0000","last_active":"2023-12-20T04:46:24.457182+0000","last_peered":"2023-12-20T04:46:24.457182+0000","last_clean":"2023-12-20T04:46:24.457182+0000","last_became_active":"2023-12-20T04:46:22.466169+0000","last_became_peered":"2023-12-20T04:46:22.466169+0000","last_unstale":"2023-12-20T04:46:24.457182+0000","last_undegraded":"2023-12-20T04:46:24.457182+0000","last_fullsized":"2023-12-20T04:46:24.457182+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:45:31.915190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.38","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457355+0000","last_change":"2023-12-20T04:46:22.479379+0000","last_active":"2023-12-20T04:46:24.457355+0000","last_peered":"2023-12-20T04:46:24.457355+0000","last_clean":"2023-12-20T04:46:24.457355+0000","last_became_active":"2023-12-20T04:46:22.477380+0000","last_became_peered":"2023-12-20T04:46:22.477380+0000","last_unstale":"2023-12-20T04:46:24.457355+0000","last_undegraded":"2023-12-20T04:46:24.457355+0000","last_fullsized":"2023-12-20T04:46:24.457355+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:01:42.262177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.37","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957034+0000","last_change":"2023-12-20T04:46:22.468885+0000","last_active":"2023-12-20T04:46:23.957034+0000","last_peered":"2023-12-20T04:46:23.957034+0000","last_clean":"2023-12-20T04:46:23.957034+0000","last_became_active":"2023-12-20T04:46:22.468557+0000","last_became_peered":"2023-12-20T04:46:22.468557+0000","last_unstale":"2023-12-20T04:46:23.957034+0000","last_undegraded":"2023-12-20T04:46:23.957034+0000","last_fullsized":"2023-12-20T04:46:23.957034+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:09:07.425954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.36","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.469062+0000","last_change":"2023-12-20T04:46:22.473348+0000","last_active":"2023-12-20T04:46:23.469062+0000","last_peered":"2023-12-20T04:46:23.469062+0000","last_clean":"2023-12-20T04:46:23.469062+0000","last_became_active":"2023-12-20T04:46:22.472808+0000","last_became_peered":"2023-12-20T04:46:22.472808+0000","last_unstale":"2023-12-20T04:46:23.469062+0000","last_undegraded":"2023-12-20T04:46:23.469062+0000","last_fullsized":"2023-12-20T04:46:23.469062+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:40:40.099897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.35","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957002+0000","last_change":"2023-12-20T04:46:22.478918+0000","last_active":"2023-12-20T04:46:23.957002+0000","last_peered":"2023-12-20T04:46:23.957002+0000","last_clean":"2023-12-20T04:46:23.957002+0000","last_became_active":"2023-12-20T04:46:22.478063+0000","last_became_peered":"2023-12-20T04:46:22.478063+0000","last_unstale":"2023-12-20T04:46:23.957002+0000","last_undegraded":"2023-12-20T04:46:23.957002+0000","last_fullsized":"2023-12-20T04:46:23.957002+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:01:42.262177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.34","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463708+0000","last_change":"2023-12-20T04:46:22.469642+0000","last_active":"2023-12-20T04:46:23.463708+0000","last_peered":"2023-12-20T04:46:23.463708+0000","last_clean":"2023-12-20T04:46:23.463708+0000","last_became_active":"2023-12-20T04:46:22.469424+0000","last_became_peered":"2023-12-20T04:46:22.469424+0000","last_unstale":"2023-12-20T04:46:23.463708+0000","last_undegraded":"2023-12-20T04:46:23.463708+0000","last_fullsized":"2023-12-20T04:46:23.463708+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:29.435770+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.33","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468633+0000","last_change":"2023-12-20T04:46:22.482649+0000","last_active":"2023-12-20T04:46:23.468633+0000","last_peered":"2023-12-20T04:46:23.468633+0000","last_clean":"2023-12-20T04:46:23.468633+0000","last_became_active":"2023-12-20T04:46:22.481959+0000","last_became_peered":"2023-12-20T04:46:22.481959+0000","last_unstale":"2023-12-20T04:46:23.468633+0000","last_undegraded":"2023-12-20T04:46:23.468633+0000","last_fullsized":"2023-12-20T04:46:23.468633+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:07:10.979646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.32","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957132+0000","last_change":"2023-12-20T04:46:22.470520+0000","last_active":"2023-12-20T04:46:23.957132+0000","last_peered":"2023-12-20T04:46:23.957132+0000","last_clean":"2023-12-20T04:46:23.957132+0000","last_became_active":"2023-12-20T04:46:22.470218+0000","last_became_peered":"2023-12-20T04:46:22.470218+0000","last_unstale":"2023-12-20T04:46:23.957132+0000","last_undegraded":"2023-12-20T04:46:23.957132+0000","last_fullsized":"2023-12-20T04:46:23.957132+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:06:22.065575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.31","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468606+0000","last_change":"2023-12-20T04:46:22.471898+0000","last_active":"2023-12-20T04:46:23.468606+0000","last_peered":"2023-12-20T04:46:23.468606+0000","last_clean":"2023-12-20T04:46:23.468606+0000","last_became_active":"2023-12-20T04:46:22.471688+0000","last_became_peered":"2023-12-20T04:46:22.471688+0000","last_unstale":"2023-12-20T04:46:23.468606+0000","last_undegraded":"2023-12-20T04:46:23.468606+0000","last_fullsized":"2023-12-20T04:46:23.468606+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:23:21.068943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.30","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468897+0000","last_change":"2023-12-20T04:46:22.475410+0000","last_active":"2023-12-20T04:46:23.468897+0000","last_peered":"2023-12-20T04:46:23.468897+0000","last_clean":"2023-12-20T04:46:23.468897+0000","last_became_active":"2023-12-20T04:46:22.475010+0000","last_became_peered":"2023-12-20T04:46:22.475010+0000","last_unstale":"2023-12-20T04:46:23.468897+0000","last_undegraded":"2023-12-20T04:46:23.468897+0000","last_fullsized":"2023-12-20T04:46:23.468897+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:14:27.337034+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2f","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957420+0000","last_change":"2023-12-20T04:46:22.470078+0000","last_active":"2023-12-20T04:46:23.957420+0000","last_peered":"2023-12-20T04:46:23.957420+0000","last_clean":"2023-12-20T04:46:23.957420+0000","last_became_active":"2023-12-20T04:46:22.469295+0000","last_became_peered":"2023-12-20T04:46:22.469295+0000","last_unstale":"2023-12-20T04:46:23.957420+0000","last_undegraded":"2023-12-20T04:46:23.957420+0000","last_fullsized":"2023-12-20T04:46:23.957420+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:59:11.464398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.2e","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463836+0000","last_change":"2023-12-20T04:46:22.475767+0000","last_active":"2023-12-20T04:46:23.463836+0000","last_peered":"2023-12-20T04:46:23.463836+0000","last_clean":"2023-12-20T04:46:23.463836+0000","last_became_active":"2023-12-20T04:46:22.475559+0000","last_became_peered":"2023-12-20T04:46:22.475559+0000","last_unstale":"2023-12-20T04:46:23.463836+0000","last_undegraded":"2023-12-20T04:46:23.463836+0000","last_fullsized":"2023-12-20T04:46:23.463836+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:48:14.750120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.2d","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457528+0000","last_change":"2023-12-20T04:46:22.481025+0000","last_active":"2023-12-20T04:46:24.457528+0000","last_peered":"2023-12-20T04:46:24.457528+0000","last_clean":"2023-12-20T04:46:24.457528+0000","last_became_active":"2023-12-20T04:46:22.480671+0000","last_became_peered":"2023-12-20T04:46:22.480671+0000","last_unstale":"2023-12-20T04:46:24.457528+0000","last_undegraded":"2023-12-20T04:46:24.457528+0000","last_fullsized":"2023-12-20T04:46:24.457528+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:24:37.308383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.2c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468665+0000","last_change":"2023-12-20T04:46:22.472601+0000","last_active":"2023-12-20T04:46:23.468665+0000","last_peered":"2023-12-20T04:46:23.468665+0000","last_clean":"2023-12-20T04:46:23.468665+0000","last_became_active":"2023-12-20T04:46:22.472368+0000","last_became_peered":"2023-12-20T04:46:22.472368+0000","last_unstale":"2023-12-20T04:46:23.468665+0000","last_undegraded":"2023-12-20T04:46:23.468665+0000","last_fullsized":"2023-12-20T04:46:23.468665+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:09:00.588012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2b","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.469073+0000","last_change":"2023-12-20T04:46:22.472558+0000","last_active":"2023-12-20T04:46:23.469073+0000","last_peered":"2023-12-20T04:46:23.469073+0000","last_clean":"2023-12-20T04:46:23.469073+0000","last_became_active":"2023-12-20T04:46:22.472319+0000","last_became_peered":"2023-12-20T04:46:22.472319+0000","last_unstale":"2023-12-20T04:46:23.469073+0000","last_undegraded":"2023-12-20T04:46:23.469073+0000","last_fullsized":"2023-12-20T04:46:23.469073+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:35:53.951288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.2a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468984+0000","last_change":"2023-12-20T04:46:22.472687+0000","last_active":"2023-12-20T04:46:23.468984+0000","last_peered":"2023-12-20T04:46:23.468984+0000","last_clean":"2023-12-20T04:46:23.468984+0000","last_became_active":"2023-12-20T04:46:22.472444+0000","last_became_peered":"2023-12-20T04:46:22.472444+0000","last_unstale":"2023-12-20T04:46:23.468984+0000","last_undegraded":"2023-12-20T04:46:23.468984+0000","last_fullsized":"2023-12-20T04:46:23.468984+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:16:47.536028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.29","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.956801+0000","last_change":"2023-12-20T04:46:22.479919+0000","last_active":"2023-12-20T04:46:23.956801+0000","last_peered":"2023-12-20T04:46:23.956801+0000","last_clean":"2023-12-20T04:46:23.956801+0000","last_became_active":"2023-12-20T04:46:22.479678+0000","last_became_peered":"2023-12-20T04:46:22.479678+0000","last_unstale":"2023-12-20T04:46:23.956801+0000","last_undegraded":"2023-12-20T04:46:23.956801+0000","last_fullsized":"2023-12-20T04:46:23.956801+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:26:05.275199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.28","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.956657+0000","last_change":"2023-12-20T04:46:22.483173+0000","last_active":"2023-12-20T04:46:23.956657+0000","last_peered":"2023-12-20T04:46:23.956657+0000","last_clean":"2023-12-20T04:46:23.956657+0000","last_became_active":"2023-12-20T04:46:22.482660+0000","last_became_peered":"2023-12-20T04:46:22.482660+0000","last_unstale":"2023-12-20T04:46:23.956657+0000","last_undegraded":"2023-12-20T04:46:23.956657+0000","last_fullsized":"2023-12-20T04:46:23.956657+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:22:01.603881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.27","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.469156+0000","last_change":"2023-12-20T04:46:22.479120+0000","last_active":"2023-12-20T04:46:23.469156+0000","last_peered":"2023-12-20T04:46:23.469156+0000","last_clean":"2023-12-20T04:46:23.469156+0000","last_became_active":"2023-12-20T04:46:22.478760+0000","last_became_peered":"2023-12-20T04:46:22.478760+0000","last_unstale":"2023-12-20T04:46:23.469156+0000","last_undegraded":"2023-12-20T04:46:23.469156+0000","last_fullsized":"2023-12-20T04:46:23.469156+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:24:37.308383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.26","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457564+0000","last_change":"2023-12-20T04:46:22.474070+0000","last_active":"2023-12-20T04:46:24.457564+0000","last_peered":"2023-12-20T04:46:24.457564+0000","last_clean":"2023-12-20T04:46:24.457564+0000","last_became_active":"2023-12-20T04:46:22.473819+0000","last_became_peered":"2023-12-20T04:46:22.473819+0000","last_unstale":"2023-12-20T04:46:24.457564+0000","last_undegraded":"2023-12-20T04:46:24.457564+0000","last_fullsized":"2023-12-20T04:46:24.457564+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:35:53.951288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.25","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957563+0000","last_change":"2023-12-20T04:46:22.472651+0000","last_active":"2023-12-20T04:46:23.957563+0000","last_peered":"2023-12-20T04:46:23.957563+0000","last_clean":"2023-12-20T04:46:23.957563+0000","last_became_active":"2023-12-20T04:46:22.472452+0000","last_became_peered":"2023-12-20T04:46:22.472452+0000","last_unstale":"2023-12-20T04:46:23.957563+0000","last_undegraded":"2023-12-20T04:46:23.957563+0000","last_fullsized":"2023-12-20T04:46:23.957563+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:52:43.407906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.24","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468684+0000","last_change":"2023-12-20T04:46:22.471298+0000","last_active":"2023-12-20T04:46:23.468684+0000","last_peered":"2023-12-20T04:46:23.468684+0000","last_clean":"2023-12-20T04:46:23.468684+0000","last_became_active":"2023-12-20T04:46:22.471029+0000","last_became_peered":"2023-12-20T04:46:22.471029+0000","last_unstale":"2023-12-20T04:46:23.468684+0000","last_undegraded":"2023-12-20T04:46:23.468684+0000","last_fullsized":"2023-12-20T04:46:23.468684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:25.106264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.23","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957259+0000","last_change":"2023-12-20T04:46:22.469563+0000","last_active":"2023-12-20T04:46:23.957259+0000","last_peered":"2023-12-20T04:46:23.957259+0000","last_clean":"2023-12-20T04:46:23.957259+0000","last_became_active":"2023-12-20T04:46:22.468952+0000","last_became_peered":"2023-12-20T04:46:22.468952+0000","last_unstale":"2023-12-20T04:46:23.957259+0000","last_undegraded":"2023-12-20T04:46:23.957259+0000","last_fullsized":"2023-12-20T04:46:23.957259+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:24:29.733464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.22","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457315+0000","last_change":"2023-12-20T04:46:22.476472+0000","last_active":"2023-12-20T04:46:24.457315+0000","last_peered":"2023-12-20T04:46:24.457315+0000","last_clean":"2023-12-20T04:46:24.457315+0000","last_became_active":"2023-12-20T04:46:22.476251+0000","last_became_peered":"2023-12-20T04:46:22.476251+0000","last_unstale":"2023-12-20T04:46:24.457315+0000","last_undegraded":"2023-12-20T04:46:24.457315+0000","last_fullsized":"2023-12-20T04:46:24.457315+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:32:25.152313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.21","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457650+0000","last_change":"2023-12-20T04:46:22.465663+0000","last_active":"2023-12-20T04:46:24.457650+0000","last_peered":"2023-12-20T04:46:24.457650+0000","last_clean":"2023-12-20T04:46:24.457650+0000","last_became_active":"2023-12-20T04:46:22.465435+0000","last_became_peered":"2023-12-20T04:46:22.465435+0000","last_unstale":"2023-12-20T04:46:24.457650+0000","last_undegraded":"2023-12-20T04:46:24.457650+0000","last_fullsized":"2023-12-20T04:46:24.457650+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:25.106264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.20","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457458+0000","last_change":"2023-12-20T04:46:22.474933+0000","last_active":"2023-12-20T04:46:24.457458+0000","last_peered":"2023-12-20T04:46:24.457458+0000","last_clean":"2023-12-20T04:46:24.457458+0000","last_became_active":"2023-12-20T04:46:22.474710+0000","last_became_peered":"2023-12-20T04:46:22.474710+0000","last_unstale":"2023-12-20T04:46:24.457458+0000","last_undegraded":"2023-12-20T04:46:24.457458+0000","last_fullsized":"2023-12-20T04:46:24.457458+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:40:40.099897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1e","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.956758+0000","last_change":"2023-12-20T04:46:22.483314+0000","last_active":"2023-12-20T04:46:23.956758+0000","last_peered":"2023-12-20T04:46:23.956758+0000","last_clean":"2023-12-20T04:46:23.956758+0000","last_became_active":"2023-12-20T04:46:22.482937+0000","last_became_peered":"2023-12-20T04:46:22.482937+0000","last_unstale":"2023-12-20T04:46:23.956758+0000","last_undegraded":"2023-12-20T04:46:23.956758+0000","last_fullsized":"2023-12-20T04:46:23.956758+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:07:10.979646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1f","version":"81'4","reported_seq":15,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.485317+0000","last_change":"2023-12-20T04:46:22.127222+0000","last_active":"2023-12-20T04:46:22.485317+0000","last_peered":"2023-12-20T04:46:22.485317+0000","last_clean":"2023-12-20T04:46:22.485317+0000","last_became_active":"2023-12-20T04:46:22.126920+0000","last_became_peered":"2023-12-20T04:46:22.126920+0000","last_unstale":"2023-12-20T04:46:22.485317+0000","last_undegraded":"2023-12-20T04:46:22.485317+0000","last_fullsized":"2023-12-20T04:46:22.485317+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:45:34.103863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.1f","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957209+0000","last_change":"2023-12-20T04:46:22.468748+0000","last_active":"2023-12-20T04:46:23.957209+0000","last_peered":"2023-12-20T04:46:23.957209+0000","last_clean":"2023-12-20T04:46:23.957209+0000","last_became_active":"2023-12-20T04:46:22.468502+0000","last_became_peered":"2023-12-20T04:46:22.468502+0000","last_unstale":"2023-12-20T04:46:23.957209+0000","last_undegraded":"2023-12-20T04:46:23.957209+0000","last_fullsized":"2023-12-20T04:46:23.957209+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:11:05.061236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.1e","version":"81'1","reported_seq":12,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468696+0000","last_change":"2023-12-20T04:46:22.122779+0000","last_active":"2023-12-20T04:46:23.468696+0000","last_peered":"2023-12-20T04:46:23.468696+0000","last_clean":"2023-12-20T04:46:23.468696+0000","last_became_active":"2023-12-20T04:46:22.122541+0000","last_became_peered":"2023-12-20T04:46:22.122541+0000","last_unstale":"2023-12-20T04:46:23.468696+0000","last_undegraded":"2023-12-20T04:46:23.468696+0000","last_fullsized":"2023-12-20T04:46:23.468696+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:32:24.147092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.1c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457766+0000","last_change":"2023-12-20T04:46:22.480693+0000","last_active":"2023-12-20T04:46:24.457766+0000","last_peered":"2023-12-20T04:46:24.457766+0000","last_clean":"2023-12-20T04:46:24.457766+0000","last_became_active":"2023-12-20T04:46:22.480079+0000","last_became_peered":"2023-12-20T04:46:22.480079+0000","last_unstale":"2023-12-20T04:46:24.457766+0000","last_undegraded":"2023-12-20T04:46:24.457766+0000","last_fullsized":"2023-12-20T04:46:24.457766+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:16:47.536028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.1d","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.482029+0000","last_change":"2023-12-20T04:46:22.130927+0000","last_active":"2023-12-20T04:46:22.482029+0000","last_peered":"2023-12-20T04:46:22.482029+0000","last_clean":"2023-12-20T04:46:22.482029+0000","last_became_active":"2023-12-20T04:46:22.130205+0000","last_became_peered":"2023-12-20T04:46:22.130205+0000","last_unstale":"2023-12-20T04:46:22.482029+0000","last_undegraded":"2023-12-20T04:46:22.482029+0000","last_fullsized":"2023-12-20T04:46:22.482029+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:31:16.073200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1d","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.956854+0000","last_change":"2023-12-20T04:46:22.474290+0000","last_active":"2023-12-20T04:46:23.956854+0000","last_peered":"2023-12-20T04:46:23.956854+0000","last_clean":"2023-12-20T04:46:23.956854+0000","last_became_active":"2023-12-20T04:46:22.474068+0000","last_became_peered":"2023-12-20T04:46:22.474068+0000","last_unstale":"2023-12-20T04:46:23.956854+0000","last_undegraded":"2023-12-20T04:46:23.956854+0000","last_fullsized":"2023-12-20T04:46:23.956854+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:29:38.683171+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.1c","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.483403+0000","last_change":"2023-12-20T04:46:22.125033+0000","last_active":"2023-12-20T04:46:22.483403+0000","last_peered":"2023-12-20T04:46:22.483403+0000","last_clean":"2023-12-20T04:46:22.483403+0000","last_became_active":"2023-12-20T04:46:22.124696+0000","last_became_peered":"2023-12-20T04:46:22.124696+0000","last_unstale":"2023-12-20T04:46:22.483403+0000","last_undegraded":"2023-12-20T04:46:22.483403+0000","last_fullsized":"2023-12-20T04:46:22.483403+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:06:59.201562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.1a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457190+0000","last_change":"2023-12-20T04:46:22.468235+0000","last_active":"2023-12-20T04:46:24.457190+0000","last_peered":"2023-12-20T04:46:24.457190+0000","last_clean":"2023-12-20T04:46:24.457190+0000","last_became_active":"2023-12-20T04:46:22.467990+0000","last_became_peered":"2023-12-20T04:46:22.467990+0000","last_unstale":"2023-12-20T04:46:24.457190+0000","last_undegraded":"2023-12-20T04:46:24.457190+0000","last_fullsized":"2023-12-20T04:46:24.457190+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:40:40.099897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.1b","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.478793+0000","last_change":"2023-12-20T04:46:22.128170+0000","last_active":"2023-12-20T04:46:22.478793+0000","last_peered":"2023-12-20T04:46:22.478793+0000","last_clean":"2023-12-20T04:46:22.478793+0000","last_became_active":"2023-12-20T04:46:22.127864+0000","last_became_peered":"2023-12-20T04:46:22.127864+0000","last_unstale":"2023-12-20T04:46:22.478793+0000","last_undegraded":"2023-12-20T04:46:22.478793+0000","last_fullsized":"2023-12-20T04:46:22.478793+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:23:20.063722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.1b","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.469049+0000","last_change":"2023-12-20T04:46:22.475710+0000","last_active":"2023-12-20T04:46:23.469049+0000","last_peered":"2023-12-20T04:46:23.469049+0000","last_clean":"2023-12-20T04:46:23.469049+0000","last_became_active":"2023-12-20T04:46:22.475410+0000","last_became_peered":"2023-12-20T04:46:22.475410+0000","last_unstale":"2023-12-20T04:46:23.469049+0000","last_undegraded":"2023-12-20T04:46:23.469049+0000","last_fullsized":"2023-12-20T04:46:23.469049+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:01:42.262177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.1a","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.483693+0000","last_change":"2023-12-20T04:46:22.129104+0000","last_active":"2023-12-20T04:46:22.483693+0000","last_peered":"2023-12-20T04:46:22.483693+0000","last_clean":"2023-12-20T04:46:22.483693+0000","last_became_active":"2023-12-20T04:46:22.128661+0000","last_became_peered":"2023-12-20T04:46:22.128661+0000","last_unstale":"2023-12-20T04:46:22.483693+0000","last_undegraded":"2023-12-20T04:46:22.483693+0000","last_fullsized":"2023-12-20T04:46:22.483693+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:01:11.730597+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.18","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957766+0000","last_change":"2023-12-20T04:46:22.473580+0000","last_active":"2023-12-20T04:46:23.957766+0000","last_peered":"2023-12-20T04:46:23.957766+0000","last_clean":"2023-12-20T04:46:23.957766+0000","last_became_active":"2023-12-20T04:46:22.473292+0000","last_became_peered":"2023-12-20T04:46:22.473292+0000","last_unstale":"2023-12-20T04:46:23.957766+0000","last_undegraded":"2023-12-20T04:46:23.957766+0000","last_fullsized":"2023-12-20T04:46:23.957766+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:56:44.135198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.19","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463812+0000","last_change":"2023-12-20T04:46:22.126449+0000","last_active":"2023-12-20T04:46:23.463812+0000","last_peered":"2023-12-20T04:46:23.463812+0000","last_clean":"2023-12-20T04:46:23.463812+0000","last_became_active":"2023-12-20T04:46:22.124465+0000","last_became_peered":"2023-12-20T04:46:22.124465+0000","last_unstale":"2023-12-20T04:46:23.463812+0000","last_undegraded":"2023-12-20T04:46:23.463812+0000","last_fullsized":"2023-12-20T04:46:23.463812+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:17:23.544998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.19","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468626+0000","last_change":"2023-12-20T04:46:22.474490+0000","last_active":"2023-12-20T04:46:23.468626+0000","last_peered":"2023-12-20T04:46:23.468626+0000","last_clean":"2023-12-20T04:46:23.468626+0000","last_became_active":"2023-12-20T04:46:22.474233+0000","last_became_peered":"2023-12-20T04:46:22.474233+0000","last_unstale":"2023-12-20T04:46:23.468626+0000","last_undegraded":"2023-12-20T04:46:23.468626+0000","last_fullsized":"2023-12-20T04:46:23.468626+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:37:58.149377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.18","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957836+0000","last_change":"2023-12-20T04:46:22.123990+0000","last_active":"2023-12-20T04:46:23.957836+0000","last_peered":"2023-12-20T04:46:23.957836+0000","last_clean":"2023-12-20T04:46:23.957836+0000","last_became_active":"2023-12-20T04:46:22.121120+0000","last_became_peered":"2023-12-20T04:46:22.121120+0000","last_unstale":"2023-12-20T04:46:23.957836+0000","last_undegraded":"2023-12-20T04:46:23.957836+0000","last_fullsized":"2023-12-20T04:46:23.957836+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:08:32.210360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.16","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457271+0000","last_change":"2023-12-20T04:46:22.471096+0000","last_active":"2023-12-20T04:46:24.457271+0000","last_peered":"2023-12-20T04:46:24.457271+0000","last_clean":"2023-12-20T04:46:24.457271+0000","last_became_active":"2023-12-20T04:46:22.470871+0000","last_became_peered":"2023-12-20T04:46:22.470871+0000","last_unstale":"2023-12-20T04:46:24.457271+0000","last_undegraded":"2023-12-20T04:46:24.457271+0000","last_fullsized":"2023-12-20T04:46:24.457271+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:16:47.536028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.17","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.466566+0000","last_change":"2023-12-20T04:46:22.124551+0000","last_active":"2023-12-20T04:46:22.466566+0000","last_peered":"2023-12-20T04:46:22.466566+0000","last_clean":"2023-12-20T04:46:22.466566+0000","last_became_active":"2023-12-20T04:46:22.121966+0000","last_became_peered":"2023-12-20T04:46:22.121966+0000","last_unstale":"2023-12-20T04:46:22.466566+0000","last_undegraded":"2023-12-20T04:46:22.466566+0000","last_fullsized":"2023-12-20T04:46:22.466566+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:59:16.940603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.17","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957064+0000","last_change":"2023-12-20T04:46:22.479201+0000","last_active":"2023-12-20T04:46:23.957064+0000","last_peered":"2023-12-20T04:46:23.957064+0000","last_clean":"2023-12-20T04:46:23.957064+0000","last_became_active":"2023-12-20T04:46:22.478702+0000","last_became_peered":"2023-12-20T04:46:22.478702+0000","last_unstale":"2023-12-20T04:46:23.957064+0000","last_undegraded":"2023-12-20T04:46:23.957064+0000","last_fullsized":"2023-12-20T04:46:23.957064+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:09:00.588012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.16","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.469491+0000","last_change":"2023-12-20T04:46:22.131297+0000","last_active":"2023-12-20T04:46:22.469491+0000","last_peered":"2023-12-20T04:46:22.469491+0000","last_clean":"2023-12-20T04:46:22.469491+0000","last_became_active":"2023-12-20T04:46:22.130412+0000","last_became_peered":"2023-12-20T04:46:22.130412+0000","last_unstale":"2023-12-20T04:46:22.469491+0000","last_undegraded":"2023-12-20T04:46:22.469491+0000","last_fullsized":"2023-12-20T04:46:22.469491+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:17:23.544998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.14","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457645+0000","last_change":"2023-12-20T04:46:22.482400+0000","last_active":"2023-12-20T04:46:24.457645+0000","last_peered":"2023-12-20T04:46:24.457645+0000","last_clean":"2023-12-20T04:46:24.457645+0000","last_became_active":"2023-12-20T04:46:22.481705+0000","last_became_peered":"2023-12-20T04:46:22.481705+0000","last_unstale":"2023-12-20T04:46:24.457645+0000","last_undegraded":"2023-12-20T04:46:24.457645+0000","last_fullsized":"2023-12-20T04:46:24.457645+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:21:32.232346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.15","version":"81'3","reported_seq":14,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.478989+0000","last_change":"2023-12-20T04:46:22.125270+0000","last_active":"2023-12-20T04:46:22.478989+0000","last_peered":"2023-12-20T04:46:22.478989+0000","last_clean":"2023-12-20T04:46:22.478989+0000","last_became_active":"2023-12-20T04:46:22.125054+0000","last_became_peered":"2023-12-20T04:46:22.125054+0000","last_unstale":"2023-12-20T04:46:22.478989+0000","last_undegraded":"2023-12-20T04:46:22.478989+0000","last_fullsized":"2023-12-20T04:46:22.478989+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:37:57.144156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"11.15","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957296+0000","last_change":"2023-12-20T04:46:22.466798+0000","last_active":"2023-12-20T04:46:23.957296+0000","last_peered":"2023-12-20T04:46:23.957296+0000","last_clean":"2023-12-20T04:46:23.957296+0000","last_became_active":"2023-12-20T04:46:22.466583+0000","last_became_peered":"2023-12-20T04:46:22.466583+0000","last_unstale":"2023-12-20T04:46:23.957296+0000","last_undegraded":"2023-12-20T04:46:23.957296+0000","last_fullsized":"2023-12-20T04:46:23.957296+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:43:39.276674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.14","version":"81'6","reported_seq":17,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463907+0000","last_change":"2023-12-20T04:46:22.126145+0000","last_active":"2023-12-20T04:46:23.463907+0000","last_peered":"2023-12-20T04:46:23.463907+0000","last_clean":"2023-12-20T04:46:23.463907+0000","last_became_active":"2023-12-20T04:46:22.124149+0000","last_became_peered":"2023-12-20T04:46:22.124149+0000","last_unstale":"2023-12-20T04:46:23.463907+0000","last_undegraded":"2023-12-20T04:46:23.463907+0000","last_fullsized":"2023-12-20T04:46:23.463907+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:14:46.240010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.12","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957111+0000","last_change":"2023-12-20T04:46:22.479058+0000","last_active":"2023-12-20T04:46:23.957111+0000","last_peered":"2023-12-20T04:46:23.957111+0000","last_clean":"2023-12-20T04:46:23.957111+0000","last_became_active":"2023-12-20T04:46:22.478400+0000","last_became_peered":"2023-12-20T04:46:22.478400+0000","last_unstale":"2023-12-20T04:46:23.957111+0000","last_undegraded":"2023-12-20T04:46:23.957111+0000","last_fullsized":"2023-12-20T04:46:23.957111+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:24:37.308383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.13","version":"81'2","reported_seq":13,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463727+0000","last_change":"2023-12-20T04:46:22.125321+0000","last_active":"2023-12-20T04:46:23.463727+0000","last_peered":"2023-12-20T04:46:23.463727+0000","last_clean":"2023-12-20T04:46:23.463727+0000","last_became_active":"2023-12-20T04:46:22.125114+0000","last_became_peered":"2023-12-20T04:46:22.125114+0000","last_unstale":"2023-12-20T04:46:23.463727+0000","last_undegraded":"2023-12-20T04:46:23.463727+0000","last_fullsized":"2023-12-20T04:46:23.463727+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:43:40.481954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.13","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457414+0000","last_change":"2023-12-20T04:46:22.469203+0000","last_active":"2023-12-20T04:46:24.457414+0000","last_peered":"2023-12-20T04:46:24.457414+0000","last_clean":"2023-12-20T04:46:24.457414+0000","last_became_active":"2023-12-20T04:46:22.468959+0000","last_became_peered":"2023-12-20T04:46:22.468959+0000","last_unstale":"2023-12-20T04:46:24.457414+0000","last_undegraded":"2023-12-20T04:46:24.457414+0000","last_fullsized":"2023-12-20T04:46:24.457414+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:21:32.232346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.12","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.472668+0000","last_change":"2023-12-20T04:46:22.128187+0000","last_active":"2023-12-20T04:46:22.472668+0000","last_peered":"2023-12-20T04:46:22.472668+0000","last_clean":"2023-12-20T04:46:22.472668+0000","last_became_active":"2023-12-20T04:46:22.127868+0000","last_became_peered":"2023-12-20T04:46:22.127868+0000","last_unstale":"2023-12-20T04:46:22.472668+0000","last_undegraded":"2023-12-20T04:46:22.472668+0000","last_fullsized":"2023-12-20T04:46:22.472668+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:59:41.947397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.10","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468684+0000","last_change":"2023-12-20T04:46:22.482819+0000","last_active":"2023-12-20T04:46:23.468684+0000","last_peered":"2023-12-20T04:46:23.468684+0000","last_clean":"2023-12-20T04:46:23.468684+0000","last_became_active":"2023-12-20T04:46:22.482287+0000","last_became_peered":"2023-12-20T04:46:22.482287+0000","last_unstale":"2023-12-20T04:46:23.468684+0000","last_undegraded":"2023-12-20T04:46:23.468684+0000","last_fullsized":"2023-12-20T04:46:23.468684+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:54:30.408847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.11","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.463482+0000","last_change":"2023-12-20T04:46:22.126477+0000","last_active":"2023-12-20T04:46:22.463482+0000","last_peered":"2023-12-20T04:46:22.463482+0000","last_clean":"2023-12-20T04:46:22.463482+0000","last_became_active":"2023-12-20T04:46:22.125537+0000","last_became_peered":"2023-12-20T04:46:22.125537+0000","last_unstale":"2023-12-20T04:46:22.463482+0000","last_undegraded":"2023-12-20T04:46:22.463482+0000","last_fullsized":"2023-12-20T04:46:22.463482+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:59:16.940603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.11","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957508+0000","last_change":"2023-12-20T04:46:22.470217+0000","last_active":"2023-12-20T04:46:23.957508+0000","last_peered":"2023-12-20T04:46:23.957508+0000","last_clean":"2023-12-20T04:46:23.957508+0000","last_became_active":"2023-12-20T04:46:22.469582+0000","last_became_peered":"2023-12-20T04:46:22.469582+0000","last_unstale":"2023-12-20T04:46:23.957508+0000","last_undegraded":"2023-12-20T04:46:23.957508+0000","last_fullsized":"2023-12-20T04:46:23.957508+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:20:07.824057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.10","version":"81'8","reported_seq":19,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.483610+0000","last_change":"2023-12-20T04:46:22.127836+0000","last_active":"2023-12-20T04:46:22.483610+0000","last_peered":"2023-12-20T04:46:22.483610+0000","last_clean":"2023-12-20T04:46:22.483610+0000","last_became_active":"2023-12-20T04:46:22.127301+0000","last_became_peered":"2023-12-20T04:46:22.127301+0000","last_unstale":"2023-12-20T04:46:22.483610+0000","last_undegraded":"2023-12-20T04:46:22.483610+0000","last_fullsized":"2023-12-20T04:46:22.483610+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:14:24.821694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.e","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.469247+0000","last_change":"2023-12-20T04:46:22.473483+0000","last_active":"2023-12-20T04:46:23.469247+0000","last_peered":"2023-12-20T04:46:23.469247+0000","last_clean":"2023-12-20T04:46:23.469247+0000","last_became_active":"2023-12-20T04:46:22.473119+0000","last_became_peered":"2023-12-20T04:46:22.473119+0000","last_unstale":"2023-12-20T04:46:23.469247+0000","last_undegraded":"2023-12-20T04:46:23.469247+0000","last_fullsized":"2023-12-20T04:46:23.469247+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:21:32.232346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"10.f","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.483130+0000","last_change":"2023-12-20T04:46:22.128462+0000","last_active":"2023-12-20T04:46:22.483130+0000","last_peered":"2023-12-20T04:46:22.483130+0000","last_clean":"2023-12-20T04:46:22.483130+0000","last_became_active":"2023-12-20T04:46:22.128192+0000","last_became_peered":"2023-12-20T04:46:22.128192+0000","last_unstale":"2023-12-20T04:46:22.483130+0000","last_undegraded":"2023-12-20T04:46:22.483130+0000","last_fullsized":"2023-12-20T04:46:22.483130+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:14:24.821694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.f","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.956843+0000","last_change":"2023-12-20T04:46:22.474280+0000","last_active":"2023-12-20T04:46:23.956843+0000","last_peered":"2023-12-20T04:46:23.956843+0000","last_clean":"2023-12-20T04:46:23.956843+0000","last_became_active":"2023-12-20T04:46:22.474023+0000","last_became_peered":"2023-12-20T04:46:22.474023+0000","last_unstale":"2023-12-20T04:46:23.956843+0000","last_undegraded":"2023-12-20T04:46:23.956843+0000","last_fullsized":"2023-12-20T04:46:23.956843+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:54:30.408847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.e","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.483208+0000","last_change":"2023-12-20T04:46:22.131086+0000","last_active":"2023-12-20T04:46:22.483208+0000","last_peered":"2023-12-20T04:46:22.483208+0000","last_clean":"2023-12-20T04:46:22.483208+0000","last_became_active":"2023-12-20T04:46:22.130538+0000","last_became_peered":"2023-12-20T04:46:22.130538+0000","last_unstale":"2023-12-20T04:46:22.483208+0000","last_undegraded":"2023-12-20T04:46:22.483208+0000","last_fullsized":"2023-12-20T04:46:22.483208+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:06:05.221249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.c","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463792+0000","last_change":"2023-12-20T04:46:22.470147+0000","last_active":"2023-12-20T04:46:23.463792+0000","last_peered":"2023-12-20T04:46:23.463792+0000","last_clean":"2023-12-20T04:46:23.463792+0000","last_became_active":"2023-12-20T04:46:22.469901+0000","last_became_peered":"2023-12-20T04:46:22.469901+0000","last_unstale":"2023-12-20T04:46:23.463792+0000","last_undegraded":"2023-12-20T04:46:23.463792+0000","last_fullsized":"2023-12-20T04:46:23.463792+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:31:17.078421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.d","version":"81'1","reported_seq":12,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.484278+0000","last_change":"2023-12-20T04:46:22.126279+0000","last_active":"2023-12-20T04:46:22.484278+0000","last_peered":"2023-12-20T04:46:22.484278+0000","last_clean":"2023-12-20T04:46:22.484278+0000","last_became_active":"2023-12-20T04:46:22.126006+0000","last_became_peered":"2023-12-20T04:46:22.126006+0000","last_unstale":"2023-12-20T04:46:22.484278+0000","last_undegraded":"2023-12-20T04:46:22.484278+0000","last_fullsized":"2023-12-20T04:46:22.484278+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:43:40.481954+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.d","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957693+0000","last_change":"2023-12-20T04:46:22.471470+0000","last_active":"2023-12-20T04:46:23.957693+0000","last_peered":"2023-12-20T04:46:23.957693+0000","last_clean":"2023-12-20T04:46:23.957693+0000","last_became_active":"2023-12-20T04:46:22.471249+0000","last_became_peered":"2023-12-20T04:46:22.471249+0000","last_unstale":"2023-12-20T04:46:23.957693+0000","last_undegraded":"2023-12-20T04:46:23.957693+0000","last_fullsized":"2023-12-20T04:46:23.957693+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:36:44.147722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.c","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.469893+0000","last_change":"2023-12-20T04:46:22.130288+0000","last_active":"2023-12-20T04:46:22.469893+0000","last_peered":"2023-12-20T04:46:22.469893+0000","last_clean":"2023-12-20T04:46:22.469893+0000","last_became_active":"2023-12-20T04:46:22.130057+0000","last_became_peered":"2023-12-20T04:46:22.130057+0000","last_unstale":"2023-12-20T04:46:22.469893+0000","last_undegraded":"2023-12-20T04:46:22.469893+0000","last_fullsized":"2023-12-20T04:46:22.469893+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:05:01.785633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"11.b","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957599+0000","last_change":"2023-12-20T04:46:22.467953+0000","last_active":"2023-12-20T04:46:23.957599+0000","last_peered":"2023-12-20T04:46:23.957599+0000","last_clean":"2023-12-20T04:46:23.957599+0000","last_became_active":"2023-12-20T04:46:22.467744+0000","last_became_peered":"2023-12-20T04:46:22.467744+0000","last_unstale":"2023-12-20T04:46:23.957599+0000","last_undegraded":"2023-12-20T04:46:23.957599+0000","last_fullsized":"2023-12-20T04:46:23.957599+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:07:48.441109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.a","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.470347+0000","last_change":"2023-12-20T04:46:22.131099+0000","last_active":"2023-12-20T04:46:22.470347+0000","last_peered":"2023-12-20T04:46:22.470347+0000","last_clean":"2023-12-20T04:46:22.470347+0000","last_became_active":"2023-12-20T04:46:22.129550+0000","last_became_peered":"2023-12-20T04:46:22.129550+0000","last_unstale":"2023-12-20T04:46:22.470347+0000","last_undegraded":"2023-12-20T04:46:22.470347+0000","last_fullsized":"2023-12-20T04:46:22.470347+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:59:16.940603+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.8","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957229+0000","last_change":"2023-12-20T04:46:22.475341+0000","last_active":"2023-12-20T04:46:23.957229+0000","last_peered":"2023-12-20T04:46:23.957229+0000","last_clean":"2023-12-20T04:46:23.957229+0000","last_became_active":"2023-12-20T04:46:22.474388+0000","last_became_peered":"2023-12-20T04:46:22.474388+0000","last_unstale":"2023-12-20T04:46:23.957229+0000","last_undegraded":"2023-12-20T04:46:23.957229+0000","last_fullsized":"2023-12-20T04:46:23.957229+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:23:42.730944+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.9","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.463154+0000","last_change":"2023-12-20T04:46:22.128872+0000","last_active":"2023-12-20T04:46:22.463154+0000","last_peered":"2023-12-20T04:46:22.463154+0000","last_clean":"2023-12-20T04:46:22.463154+0000","last_became_active":"2023-12-20T04:46:22.128629+0000","last_became_peered":"2023-12-20T04:46:22.128629+0000","last_unstale":"2023-12-20T04:46:22.463154+0000","last_undegraded":"2023-12-20T04:46:22.463154+0000","last_fullsized":"2023-12-20T04:46:22.463154+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:32:07.943631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.9","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957200+0000","last_change":"2023-12-20T04:46:22.474025+0000","last_active":"2023-12-20T04:46:23.957200+0000","last_peered":"2023-12-20T04:46:23.957200+0000","last_clean":"2023-12-20T04:46:23.957200+0000","last_became_active":"2023-12-20T04:46:22.473811+0000","last_became_peered":"2023-12-20T04:46:22.473811+0000","last_unstale":"2023-12-20T04:46:23.957200+0000","last_undegraded":"2023-12-20T04:46:23.957200+0000","last_fullsized":"2023-12-20T04:46:23.957200+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:38:42.361145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.8","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468620+0000","last_change":"2023-12-20T04:46:22.121829+0000","last_active":"2023-12-20T04:46:23.468620+0000","last_peered":"2023-12-20T04:46:23.468620+0000","last_clean":"2023-12-20T04:46:23.468620+0000","last_became_active":"2023-12-20T04:46:22.121618+0000","last_became_peered":"2023-12-20T04:46:22.121618+0000","last_unstale":"2023-12-20T04:46:23.468620+0000","last_undegraded":"2023-12-20T04:46:23.468620+0000","last_fullsized":"2023-12-20T04:46:23.468620+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:52:03.581175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.6","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468735+0000","last_change":"2023-12-20T04:46:22.473823+0000","last_active":"2023-12-20T04:46:23.468735+0000","last_peered":"2023-12-20T04:46:23.468735+0000","last_clean":"2023-12-20T04:46:23.468735+0000","last_became_active":"2023-12-20T04:46:22.473550+0000","last_became_peered":"2023-12-20T04:46:22.473550+0000","last_unstale":"2023-12-20T04:46:23.468735+0000","last_undegraded":"2023-12-20T04:46:23.468735+0000","last_fullsized":"2023-12-20T04:46:23.468735+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:26:05.275199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"10.7","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.483105+0000","last_change":"2023-12-20T04:46:22.131114+0000","last_active":"2023-12-20T04:46:22.483105+0000","last_peered":"2023-12-20T04:46:22.483105+0000","last_clean":"2023-12-20T04:46:22.483105+0000","last_became_active":"2023-12-20T04:46:22.130124+0000","last_became_peered":"2023-12-20T04:46:22.130124+0000","last_unstale":"2023-12-20T04:46:22.483105+0000","last_undegraded":"2023-12-20T04:46:22.483105+0000","last_fullsized":"2023-12-20T04:46:22.483105+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:14:46.240010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.7","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457367+0000","last_change":"2023-12-20T04:46:22.466948+0000","last_active":"2023-12-20T04:46:24.457367+0000","last_peered":"2023-12-20T04:46:24.457367+0000","last_clean":"2023-12-20T04:46:24.457367+0000","last_became_active":"2023-12-20T04:46:22.466517+0000","last_became_peered":"2023-12-20T04:46:22.466517+0000","last_unstale":"2023-12-20T04:46:24.457367+0000","last_undegraded":"2023-12-20T04:46:24.457367+0000","last_fullsized":"2023-12-20T04:46:24.457367+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:17:52.143648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"10.6","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.462905+0000","last_change":"2023-12-20T04:46:22.127625+0000","last_active":"2023-12-20T04:46:22.462905+0000","last_peered":"2023-12-20T04:46:22.462905+0000","last_clean":"2023-12-20T04:46:22.462905+0000","last_became_active":"2023-12-20T04:46:22.125335+0000","last_became_peered":"2023-12-20T04:46:22.125335+0000","last_unstale":"2023-12-20T04:46:22.462905+0000","last_undegraded":"2023-12-20T04:46:22.462905+0000","last_fullsized":"2023-12-20T04:46:22.462905+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:06:59.201562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"11.4","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.956930+0000","last_change":"2023-12-20T04:46:22.478942+0000","last_active":"2023-12-20T04:46:23.956930+0000","last_peered":"2023-12-20T04:46:23.956930+0000","last_clean":"2023-12-20T04:46:23.956930+0000","last_became_active":"2023-12-20T04:46:22.478750+0000","last_became_peered":"2023-12-20T04:46:22.478750+0000","last_unstale":"2023-12-20T04:46:23.956930+0000","last_undegraded":"2023-12-20T04:46:23.956930+0000","last_fullsized":"2023-12-20T04:46:23.956930+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:51:49.784398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.5","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957323+0000","last_change":"2023-12-20T04:46:22.125233+0000","last_active":"2023-12-20T04:46:23.957323+0000","last_peered":"2023-12-20T04:46:23.957323+0000","last_clean":"2023-12-20T04:46:23.957323+0000","last_became_active":"2023-12-20T04:46:22.124866+0000","last_became_peered":"2023-12-20T04:46:22.124866+0000","last_unstale":"2023-12-20T04:46:23.957323+0000","last_undegraded":"2023-12-20T04:46:23.957323+0000","last_fullsized":"2023-12-20T04:46:23.957323+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:56:36.871361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.5","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.956924+0000","last_change":"2023-12-20T04:46:22.479959+0000","last_active":"2023-12-20T04:46:23.956924+0000","last_peered":"2023-12-20T04:46:23.956924+0000","last_clean":"2023-12-20T04:46:23.956924+0000","last_became_active":"2023-12-20T04:46:22.479724+0000","last_became_peered":"2023-12-20T04:46:22.479724+0000","last_unstale":"2023-12-20T04:46:23.956924+0000","last_undegraded":"2023-12-20T04:46:23.956924+0000","last_fullsized":"2023-12-20T04:46:23.956924+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:37:58.149377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"10.4","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.468712+0000","last_change":"2023-12-20T04:46:22.128326+0000","last_active":"2023-12-20T04:46:23.468712+0000","last_peered":"2023-12-20T04:46:23.468712+0000","last_clean":"2023-12-20T04:46:23.468712+0000","last_became_active":"2023-12-20T04:46:22.127948+0000","last_became_peered":"2023-12-20T04:46:22.127948+0000","last_unstale":"2023-12-20T04:46:23.468712+0000","last_undegraded":"2023-12-20T04:46:23.468712+0000","last_fullsized":"2023-12-20T04:46:23.468712+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:35:52.946067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"11.2","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957594+0000","last_change":"2023-12-20T04:46:22.470421+0000","last_active":"2023-12-20T04:46:23.957594+0000","last_peered":"2023-12-20T04:46:23.957594+0000","last_clean":"2023-12-20T04:46:23.957594+0000","last_became_active":"2023-12-20T04:46:22.469847+0000","last_became_peered":"2023-12-20T04:46:22.469847+0000","last_unstale":"2023-12-20T04:46:23.957594+0000","last_undegraded":"2023-12-20T04:46:23.957594+0000","last_fullsized":"2023-12-20T04:46:23.957594+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:25:50.994218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"10.3","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957787+0000","last_change":"2023-12-20T04:46:22.127429+0000","last_active":"2023-12-20T04:46:23.957787+0000","last_peered":"2023-12-20T04:46:23.957787+0000","last_clean":"2023-12-20T04:46:23.957787+0000","last_became_active":"2023-12-20T04:46:22.126824+0000","last_became_peered":"2023-12-20T04:46:22.126824+0000","last_unstale":"2023-12-20T04:46:23.957787+0000","last_undegraded":"2023-12-20T04:46:23.957787+0000","last_fullsized":"2023-12-20T04:46:23.957787+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:03:08.301825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"11.3","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457868+0000","last_change":"2023-12-20T04:46:22.480432+0000","last_active":"2023-12-20T04:46:24.457868+0000","last_peered":"2023-12-20T04:46:24.457868+0000","last_clean":"2023-12-20T04:46:24.457868+0000","last_became_active":"2023-12-20T04:46:22.479765+0000","last_became_peered":"2023-12-20T04:46:22.479765+0000","last_unstale":"2023-12-20T04:46:24.457868+0000","last_undegraded":"2023-12-20T04:46:24.457868+0000","last_fullsized":"2023-12-20T04:46:24.457868+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:32:25.152313+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.2","version":"0'0","reported_seq":11,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463868+0000","last_change":"2023-12-20T04:46:22.124845+0000","last_active":"2023-12-20T04:46:23.463868+0000","last_peered":"2023-12-20T04:46:23.463868+0000","last_clean":"2023-12-20T04:46:23.463868+0000","last_became_active":"2023-12-20T04:46:22.124634+0000","last_became_peered":"2023-12-20T04:46:22.124634+0000","last_unstale":"2023-12-20T04:46:23.463868+0000","last_undegraded":"2023-12-20T04:46:23.463868+0000","last_fullsized":"2023-12-20T04:46:23.463868+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:30:11.017106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"11.0","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.463740+0000","last_change":"2023-12-20T04:46:22.470696+0000","last_active":"2023-12-20T04:46:23.463740+0000","last_peered":"2023-12-20T04:46:23.463740+0000","last_clean":"2023-12-20T04:46:23.463740+0000","last_became_active":"2023-12-20T04:46:22.470478+0000","last_became_peered":"2023-12-20T04:46:22.470478+0000","last_unstale":"2023-12-20T04:46:23.463740+0000","last_undegraded":"2023-12-20T04:46:23.463740+0000","last_fullsized":"2023-12-20T04:46:23.463740+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:45:35.109084+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"10.1","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.465855+0000","last_change":"2023-12-20T04:46:22.128947+0000","last_active":"2023-12-20T04:46:22.465855+0000","last_peered":"2023-12-20T04:46:22.465855+0000","last_clean":"2023-12-20T04:46:22.465855+0000","last_became_active":"2023-12-20T04:46:22.127610+0000","last_became_peered":"2023-12-20T04:46:22.127610+0000","last_unstale":"2023-12-20T04:46:22.465855+0000","last_undegraded":"2023-12-20T04:46:22.465855+0000","last_fullsized":"2023-12-20T04:46:22.465855+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:32:07.943631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"11.1","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:24.457578+0000","last_change":"2023-12-20T04:46:22.479028+0000","last_active":"2023-12-20T04:46:24.457578+0000","last_peered":"2023-12-20T04:46:24.457578+0000","last_clean":"2023-12-20T04:46:24.457578+0000","last_became_active":"2023-12-20T04:46:22.475448+0000","last_became_peered":"2023-12-20T04:46:22.475448+0000","last_unstale":"2023-12-20T04:46:24.457578+0000","last_undegraded":"2023-12-20T04:46:24.457578+0000","last_fullsized":"2023-12-20T04:46:24.457578+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:35:53.951288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"10.0","version":"0'0","reported_seq":11,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.470258+0000","last_change":"2023-12-20T04:46:22.131875+0000","last_active":"2023-12-20T04:46:22.470258+0000","last_peered":"2023-12-20T04:46:22.470258+0000","last_clean":"2023-12-20T04:46:22.470258+0000","last_became_active":"2023-12-20T04:46:22.131698+0000","last_became_peered":"2023-12-20T04:46:22.131698+0000","last_unstale":"2023-12-20T04:46:22.470258+0000","last_undegraded":"2023-12-20T04:46:22.470258+0000","last_fullsized":"2023-12-20T04:46:22.470258+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:30:11.017106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"11.a","version":"0'0","reported_seq":10,"reported_epoch":82,"state":"active+clean","last_fresh":"2023-12-20T04:46:23.957347+0000","last_change":"2023-12-20T04:46:22.482490+0000","last_active":"2023-12-20T04:46:23.957347+0000","last_peered":"2023-12-20T04:46:23.957347+0000","last_clean":"2023-12-20T04:46:23.957347+0000","last_became_active":"2023-12-20T04:46:22.481910+0000","last_became_peered":"2023-12-20T04:46:22.481910+0000","last_unstale":"2023-12-20T04:46:23.957347+0000","last_undegraded":"2023-12-20T04:46:23.957347+0000","last_fullsized":"2023-12-20T04:46:23.957347+0000","mapping_epoch":80,"log_start":"0'0","ondisk_log_start":"0'0","created":80,"last_epoch_clean":81,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:22.111604+0000","last_clean_scrub_stamp":"2023-12-20T04:46:22.111604+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:11:24.087157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"10.b","version":"81'2","reported_seq":13,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.483596+0000","last_change":"2023-12-20T04:46:22.131734+0000","last_active":"2023-12-20T04:46:22.483596+0000","last_peered":"2023-12-20T04:46:22.483596+0000","last_clean":"2023-12-20T04:46:22.483596+0000","last_became_active":"2023-12-20T04:46:22.130730+0000","last_became_peered":"2023-12-20T04:46:22.130730+0000","last_unstale":"2023-12-20T04:46:22.483596+0000","last_undegraded":"2023-12-20T04:46:22.483596+0000","last_fullsized":"2023-12-20T04:46:22.483596+0000","mapping_epoch":79,"log_start":"0'0","ondisk_log_start":"0'0","created":79,"last_epoch_clean":80,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:46:21.106383+0000","last_clean_scrub_stamp":"2023-12-20T04:46:21.106383+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:32:07.943631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":218,"reported_epoch":81,"state":"active+clean","last_fresh":"2023-12-20T04:46:22.470712+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:46:22.470712+0000","last_peered":"2023-12-20T04:46:22.470712+0000","last_clean":"2023-12-20T04:46:22.470712+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:46:22.470712+0000","last_undegraded":"2023-12-20T04:46:22.470712+0000","last_fullsized":"2023-12-20T04:46:22.470712+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":11,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":10,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1000,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194312,"statfs":{"total":200000000,"available":198975881,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.53800000000000003,"15min":0.52900000000000003},"min":{"1min":0.45200000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.747,"5min":0.754,"15min":0.754},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.52400000000000002,"15min":0.51900000000000002},"min":{"1min":0.37,"5min":0.315,"15min":0.315},"max":{"1min":0.67500000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.52600000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55200000000000005,"15min":0.54800000000000004},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68500000000000005,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.40200000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.57199999999999995},"min":{"1min":0.44500000000000001,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.76600000000000001,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.621}]},{"osd":2,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.54000000000000004,"15min":0.53000000000000003},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.751,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.41599999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.71599999999999997,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.501}]},{"osd":3,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.39200000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.71899999999999997,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.56499999999999995,"15min":0.56200000000000006},"min":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":0.72999999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.57199999999999995}]},{"osd":4,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.433,"5min":0.48699999999999999,"15min":0.48599999999999999},"min":{"1min":0.33800000000000002,"5min":0.33600000000000002,"15min":0.33600000000000002},"max":{"1min":0.61299999999999999,"5min":0.753,"15min":0.753},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.45300000000000001,"5min":0.49099999999999999,"15min":0.48999999999999999},"min":{"1min":0.30499999999999999,"5min":0.30499999999999999,"15min":0.30499999999999999},"max":{"1min":0.71999999999999997,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48999999999999999,"15min":0.49299999999999999},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.61299999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.68500000000000005,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.60299999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.47499999999999998,"5min":0.53900000000000003,"15min":0.55300000000000005},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.64400000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66300000000000003,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.54500000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574897,"num_pgs":35,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":423,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194889,"statfs":{"total":200000000,"available":199566773,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.48899999999999999,"15min":0.48999999999999999},"min":{"1min":0.309,"5min":0.309,"15min":0.309},"max":{"1min":0.61299999999999999,"5min":0.63400000000000001,"15min":0.63400000000000001},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.53000000000000003,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.374,"5min":0.314,"15min":0.314},"max":{"1min":0.63700000000000001,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.51900000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.53100000000000003,"15min":0.52400000000000002},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.71499999999999997,"5min":0.751,"15min":0.751},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.57099999999999995,"15min":0.57799999999999996},"min":{"1min":0.39600000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.503}]},{"osd":2,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.51000000000000001,"15min":0.504},"min":{"1min":0.34399999999999997,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.34100000000000003,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.58899999999999997}]},{"osd":3,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.50800000000000001,"15min":0.49199999999999999},"min":{"1min":0.40000000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.42399999999999999,"5min":0.377,"15min":0.377},"max":{"1min":0.70599999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.54100000000000004}]},{"osd":4,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.502,"15min":0.51200000000000001},"min":{"1min":0.311,"5min":0.311,"15min":0.311},"max":{"1min":0.67500000000000004,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.5,"15min":0.49299999999999999},"min":{"1min":0.38700000000000001,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.73899999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.61399999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52000000000000002,"15min":0.52000000000000002},"min":{"1min":0.35599999999999998,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70899999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.55900000000000005,"15min":0.56100000000000005},"min":{"1min":0.35699999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72499999999999998,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.625}]},{"osd":7,"last update":"Wed Dec 20 04:45:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55100000000000005,"15min":0.55100000000000005},"min":{"1min":0.45200000000000001,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.64000000000000001},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.58799999999999997,"15min":0.58099999999999996},"min":{"1min":0.42399999999999999,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.65900000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574896,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":423,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194889,"statfs":{"total":200000000,"available":199566775,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.51600000000000001,"15min":0.505},"min":{"1min":0.40600000000000003,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.69999999999999996,"5min":0.745,"15min":0.745},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56499999999999995,"15min":0.55800000000000005},"min":{"1min":0.498,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.434}]},{"osd":1,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.41899999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.68700000000000006,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.41499999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.49099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.39100000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.51600000000000001,"15min":0.51000000000000001},"min":{"1min":0.41599999999999998,"5min":0.32100000000000001,"15min":0.32100000000000001},"max":{"1min":0.70499999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.61899999999999999},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.52200000000000002,"15min":0.51500000000000001},"min":{"1min":0.441,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.371}]},{"osd":3,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.53100000000000003,"15min":0.52900000000000003},"min":{"1min":0.441,"5min":0.374,"15min":0.374},"max":{"1min":0.67300000000000004,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.54600000000000004,"15min":0.54100000000000004},"min":{"1min":0.41599999999999998,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.72899999999999998,"5min":0.72899999999999998,"15min":0.72899999999999998},"last":0.45400000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.501,"15min":0.51100000000000001},"min":{"1min":0.32900000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.74399999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.47899999999999998,"15min":0.48199999999999998},"min":{"1min":0.318,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.69399999999999995,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.65800000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.5,"15min":0.51200000000000001},"min":{"1min":0.33200000000000002,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.75700000000000001,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.54000000000000004,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.318,"5min":0.31,"15min":0.31},"max":{"1min":0.81200000000000006,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54100000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:45:46 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.52200000000000002,"15min":0.53000000000000003},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73399999999999999,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.79800000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.60199999999999998,"15min":0.61299999999999999},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.80000000000000004,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.51800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574896,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":423,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194889,"statfs":{"total":200000000,"available":199566795,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.52500000000000002,"15min":0.52300000000000002},"min":{"1min":0.374,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.71099999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.51700000000000002,"15min":0.51600000000000001},"min":{"1min":0.40600000000000003,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.63300000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52400000000000002,"15min":0.51100000000000001},"min":{"1min":0.40400000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.51600000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55000000000000004,"15min":0.55900000000000005},"min":{"1min":0.36799999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.69699999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54400000000000004,"15min":0.55300000000000005},"min":{"1min":0.39000000000000001,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.48999999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.46500000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.754,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.47699999999999998,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":0.74299999999999999,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.57399999999999995}]},{"osd":5,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.46300000000000002,"15min":0.47799999999999998},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.57899999999999996,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.44},{"interface":"front","average":{"1min":0.47599999999999998,"5min":0.499,"15min":0.50700000000000001},"min":{"1min":0.29699999999999999,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.64100000000000001,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.66100000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.497,"15min":0.50600000000000001},"min":{"1min":0.34000000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.625,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.51800000000000002,"15min":0.53300000000000003},"min":{"1min":0.34799999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.68300000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.56000000000000005}]},{"osd":7,"last update":"Wed Dec 20 04:45:38 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50900000000000001,"15min":0.51300000000000001},"min":{"1min":0.36799999999999999,"5min":0.316,"15min":0.316},"max":{"1min":0.66700000000000004,"5min":0.70299999999999996,"15min":0.70299999999999996},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.53500000000000003,"5min":0.54300000000000004,"15min":0.54700000000000004},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.78000000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.61799999999999999}]}]},{"osd":3,"up_from":13,"seq":55834574896,"num_pgs":12,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":423,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194889,"statfs":{"total":200000000,"available":199566753,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.34499999999999997,"5min":0.33700000000000002,"15min":0.33500000000000002},"min":{"1min":0.26100000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.44900000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.254,"5min":0.246,"15min":0.246},"max":{"1min":0.61299999999999999,"5min":0.61299999999999999,"15min":0.61299999999999999},"last":0.311}]},{"osd":1,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.32300000000000001,"5min":0.31900000000000001,"15min":0.316},"min":{"1min":0.23300000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.379,"5min":0.33900000000000002,"15min":0.33000000000000002},"min":{"1min":0.30599999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.51700000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"last":0.255}]},{"osd":2,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.34599999999999997,"15min":0.34399999999999997},"min":{"1min":0.248,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.498,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.27100000000000002},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.378,"15min":0.371},"min":{"1min":0.26100000000000001,"5min":0.26100000000000001,"15min":0.26100000000000001},"max":{"1min":0.54900000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"last":0.32300000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.54200000000000004,"15min":0.53800000000000003},"min":{"1min":0.40799999999999997,"5min":0.373,"15min":0.373},"max":{"1min":0.80500000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.441},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.443,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.81499999999999995,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.433}]},{"osd":5,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.40200000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.79300000000000004,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56000000000000005,"15min":0.55300000000000005},"min":{"1min":0.437,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":0.752,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40500000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.41099999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.749,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.39600000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.55800000000000005,"15min":0.55200000000000005},"min":{"1min":0.45100000000000001,"5min":0.372,"15min":0.372},"max":{"1min":0.74399999999999999,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47599999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:45:40 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.438,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77700000000000002,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57199999999999995,"15min":0.57199999999999995},"min":{"1min":0.41199999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76000000000000001,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46600000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574896,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":424,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194887,"statfs":{"total":200000000,"available":199565301,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.33300000000000002,"5min":0.30399999999999999,"15min":0.28999999999999998},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.437},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.37,"15min":0.33800000000000002},"min":{"1min":0.23200000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":1.135,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.46700000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38600000000000001,"5min":0.33700000000000002,"15min":0.32500000000000001},"min":{"1min":0.23300000000000001,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.373,"5min":0.35599999999999998,"15min":0.34399999999999997},"min":{"1min":0.253,"5min":0.245,"15min":0.245},"max":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.48399999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.372,"15min":0.35099999999999998},"min":{"1min":0.29399999999999998,"5min":0.216,"15min":0.216},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.496},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.376,"15min":0.36499999999999999},"min":{"1min":0.26600000000000001,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.76600000000000001,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.39900000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57299999999999995,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.41099999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58399999999999996,"15min":0.56699999999999995},"min":{"1min":0.43099999999999999,"5min":0.379,"15min":0.379},"max":{"1min":0.79300000000000004,"5min":2.347,"15min":2.347},"last":0.55200000000000005}]},{"osd":5,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57299999999999995,"15min":0.57799999999999996},"min":{"1min":0.41999999999999998,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.86399999999999999,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.55000000000000004,"15min":0.54700000000000004},"min":{"1min":0.432,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.82999999999999996,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60799999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.58699999999999997,"15min":0.57299999999999995},"min":{"1min":0.45300000000000001,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.76000000000000001,"5min":2.274,"15min":2.274},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.57499999999999996,"15min":0.57099999999999995},"min":{"1min":0.46000000000000002,"5min":0.373,"15min":0.373},"max":{"1min":1.0289999999999999,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.59099999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:45:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58599999999999997,"15min":0.56699999999999995},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":1.1659999999999999,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.60099999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.57699999999999996},"min":{"1min":0.42999999999999999,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.0549999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.62}]}]},{"osd":1,"up_from":13,"seq":55834574897,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":425,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194887,"statfs":{"total":200000000,"available":199564685,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.34000000000000002,"5min":0.29699999999999999,"15min":0.28399999999999997},"min":{"1min":0.221,"5min":0.187,"15min":0.187},"max":{"1min":0.48299999999999998,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.37,"5min":0.33500000000000002,"15min":0.32500000000000001},"min":{"1min":0.28999999999999998,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.28799999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.312,"15min":0.29999999999999999},"min":{"1min":0.223,"5min":0.20599999999999999,"15min":0.20599999999999999},"max":{"1min":0.51400000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35399999999999998,"15min":0.34300000000000003},"min":{"1min":0.307,"5min":0.224,"15min":0.224},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.309}]},{"osd":3,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34899999999999998},"min":{"1min":0.255,"5min":0.191,"15min":0.191},"max":{"1min":0.52300000000000002,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.35699999999999998,"15min":0.35099999999999998},"min":{"1min":0.30199999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.32300000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.56499999999999995,"15min":0.56699999999999995},"min":{"1min":0.38800000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.72699999999999998,"5min":0.873,"15min":0.873},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.55600000000000005,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.497}]},{"osd":5,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.55400000000000005},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.71399999999999997,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.54500000000000004,"15min":0.53700000000000003},"min":{"1min":0.40000000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.84299999999999997,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.48399999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.56200000000000006,"15min":0.55700000000000005},"min":{"1min":0.379,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":1.038,"5min":1.038,"15min":1.038},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56699999999999995,"15min":0.56100000000000005},"min":{"1min":0.41399999999999998,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.78100000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.47399999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:45:42 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.59399999999999997,"15min":0.59199999999999997},"min":{"1min":0.36899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.82399999999999995,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.60399999999999998,"15min":0.61099999999999999},"min":{"1min":0.46100000000000002,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.76500000000000001,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.55600000000000005}]}]},{"osd":0,"up_from":13,"seq":55834574896,"num_pgs":15,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":999,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194312,"statfs":{"total":200000000,"available":198976497,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.33400000000000002,"5min":0.311,"15min":0.30599999999999999},"min":{"1min":0.23100000000000001,"5min":0.184,"15min":0.184},"max":{"1min":0.46500000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.26300000000000001},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.31900000000000001,"15min":0.307},"min":{"1min":0.24199999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.309}]},{"osd":2,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.35599999999999998,"15min":0.35399999999999998},"min":{"1min":0.24199999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.53600000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.38300000000000001,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.28799999999999998,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.622,"5min":0.622,"15min":0.622},"last":0.33600000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.33000000000000002,"15min":0.31900000000000001},"min":{"1min":0.245,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.40999999999999998,"5min":0.373,"15min":0.36399999999999999},"min":{"1min":0.33500000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.373}]},{"osd":4,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55900000000000005,"5min":0.52200000000000002,"15min":0.51300000000000001},"min":{"1min":0.36899999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.74399999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.64100000000000001},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53700000000000003,"15min":0.53000000000000003},"min":{"1min":0.40799999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.76000000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.52600000000000002,"15min":0.51300000000000001},"min":{"1min":0.36599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78700000000000003,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.55600000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.54600000000000004,"15min":0.53800000000000003},"min":{"1min":0.40100000000000002,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.65000000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.58599999999999997,"15min":0.57899999999999996},"min":{"1min":0.42999999999999999,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.82799999999999996,"5min":0.873,"15min":0.873},"last":0.72399999999999998},{"interface":"front","average":{"1min":0.63100000000000001,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.42999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.84699999999999998,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.58299999999999996}]},{"osd":7,"last update":"Wed Dec 20 04:45:41 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55300000000000005,"15min":0.54700000000000004},"min":{"1min":0.44800000000000001,"5min":0.375,"15min":0.375},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.39200000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.84499999999999997,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.68100000000000005}]}]}],"pool_statfs":[]}} 2023-12-20T04:46:30.088 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-20T04:46:30.089 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-20T04:46:30.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.228+0000 7f75b67d5640 1 Processor -- start 2023-12-20T04:46:30.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.228+0000 7f75b67d5640 1 -- start start 2023-12-20T04:46:30.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.229+0000 7f75b67d5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75b00cb2b0 0x7f75b00cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:30.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.229+0000 7f75b67d5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b00d0130 con 0x7f75b015aee0 2023-12-20T04:46:30.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.229+0000 7f75b67d5640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75b015f370 con 0x7f75b00cdbb0 2023-12-20T04:46:30.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.229+0000 7f75b67d5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b00ce040 con 0x7f75b00cb2b0 2023-12-20T04:46:30.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.229+0000 7f75affff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f75b015aee0 0x7f75b015eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46202/0 (socket says 172.21.15.132:46202) 2023-12-20T04:46:30.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.229+0000 7f75affff640 1 -- 172.21.15.132:0/1394128845 learned_addr learned my addr 172.21.15.132:0/1394128845 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:30.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.229+0000 7f75af7fe640 1 --2- 172.21.15.132:0/1394128845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75b00cb2b0 0x7f75b00cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:30.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.229+0000 7f75aeffd640 1 -- 172.21.15.132:0/1394128845 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 991759221 0 0) 0x7f75b00d0130 con 0x7f75b015aee0 2023-12-20T04:46:30.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.229+0000 7f75aeffd640 1 -- 172.21.15.132:0/1394128845 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7598003520 con 0x7f75b015aee0 2023-12-20T04:46:30.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.229+0000 7f75aeffd640 1 -- 172.21.15.132:0/1394128845 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3339300540 0 0) 0x7f75b015f370 con 0x7f75b00cdbb0 2023-12-20T04:46:30.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75aeffd640 1 -- 172.21.15.132:0/1394128845 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f75b00d0130 con 0x7f75b00cdbb0 2023-12-20T04:46:30.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75aeffd640 1 -- 172.21.15.132:0/1394128845 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1877304334 0 0) 0x7f7598003520 con 0x7f75b015aee0 2023-12-20T04:46:30.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75aeffd640 1 -- 172.21.15.132:0/1394128845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75b00cb2b0 msgr2=0x7f75b00cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:30.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75aeffd640 1 --2- 172.21.15.132:0/1394128845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75b00cb2b0 0x7f75b00cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75aeffd640 1 -- 172.21.15.132:0/1394128845 >> v1:172.21.15.187:6789/0 conn(0x7f75b00cdbb0 legacy=0x7f75b00d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:30.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75aeffd640 1 -- 172.21.15.132:0/1394128845 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b015f650 con 0x7f75b015aee0 2023-12-20T04:46:30.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75aeffd640 1 -- 172.21.15.132:0/1394128845 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f75a0001670 con 0x7f75b015aee0 2023-12-20T04:46:30.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75af7fe640 1 --2- 172.21.15.132:0/1394128845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75b00cb2b0 0x7f75b00cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:46:30.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75aeffd640 1 -- 172.21.15.132:0/1394128845 >> v1:172.21.15.132:6789/0 conn(0x7f75b015aee0 legacy=0x7f75b015eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:30.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75aeffd640 1 --2- 172.21.15.132:0/1394128845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75b00cb2b0 0x7f7598003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:30.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75aeffd640 1 --2- 172.21.15.132:0/1394128845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7598004070 0x7f75980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:30.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75aeffd640 1 --2- 172.21.15.132:0/1394128845 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7598004d00 0x7f7598005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:30.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75aeffd640 1 -- 172.21.15.132:0/1394128845 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b00ce040 con 0x7f7598004070 2023-12-20T04:46:30.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75aeffd640 1 -- 172.21.15.132:0/1394128845 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f759800ba30 con 0x7f7598004d00 2023-12-20T04:46:30.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75aeffd640 1 -- 172.21.15.132:0/1394128845 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f759800bbf0 con 0x7f75b00cb2b0 2023-12-20T04:46:30.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75af7fe640 1 --2- 172.21.15.132:0/1394128845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7598004070 0x7f75980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:30.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75affff640 1 --2- 172.21.15.132:0/1394128845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75b00cb2b0 0x7f7598003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:30.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75b4d72640 1 --2- 172.21.15.132:0/1394128845 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7598004d00 0x7f7598005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:30.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75af7fe640 1 -- 172.21.15.132:0/1394128845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75b00cb2b0 msgr2=0x7f7598003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:30.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75af7fe640 1 --2- 172.21.15.132:0/1394128845 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75b00cb2b0 0x7f7598003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75af7fe640 1 -- 172.21.15.132:0/1394128845 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7598004d00 msgr2=0x7f7598005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:30.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75af7fe640 1 --2- 172.21.15.132:0/1394128845 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7598004d00 0x7f7598005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.230+0000 7f75af7fe640 1 -- 172.21.15.132:0/1394128845 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75a4009400 con 0x7f7598004070 2023-12-20T04:46:30.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.231+0000 7f75af7fe640 1 --2- 172.21.15.132:0/1394128845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7598004070 0x7f75980047c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009c70 tx=0x7f75980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c75112ea9a20d439 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:30.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.231+0000 7f75aeffd640 1 -- 172.21.15.132:0/1394128845 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a402c910 con 0x7f7598004070 2023-12-20T04:46:30.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.231+0000 7f75aeffd640 1 -- 172.21.15.132:0/1394128845 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a402ca70 con 0x7f7598004070 2023-12-20T04:46:30.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.231+0000 7f75aeffd640 1 -- 172.21.15.132:0/1394128845 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a402cde0 con 0x7f7598004070 2023-12-20T04:46:30.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.231+0000 7f75b67d5640 1 -- 172.21.15.132:0/1394128845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7598004070 msgr2=0x7f75980047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:30.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.231+0000 7f75b67d5640 1 --2- 172.21.15.132:0/1394128845 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7598004070 0x7f75980047c0 secure :-1 s=READY pgs=901 cs=0 l=1 rev1=1 crypto rx=0x7f75a4009c70 tx=0x7f75980057f0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.231+0000 7f75b4d72640 1 -- 172.21.15.132:0/1394128845 reap_dead start 2023-12-20T04:46:30.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.232+0000 7f75b67d5640 1 -- 172.21.15.132:0/1394128845 shutdown_connections 2023-12-20T04:46:30.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.232+0000 7f75b67d5640 1 -- 172.21.15.132:0/1394128845 >> 172.21.15.132:0/1394128845 conn(0x7f75b0072c60 msgr2=0x7f75b0073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:30.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.232+0000 7f75b67d5640 1 -- 172.21.15.132:0/1394128845 shutdown_connections 2023-12-20T04:46:30.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.232+0000 7f75b67d5640 1 -- 172.21.15.132:0/1394128845 wait complete. 2023-12-20T04:46:30.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.233+0000 7f75b67d5640 1 Processor -- start 2023-12-20T04:46:30.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.233+0000 7f75b67d5640 1 -- start start 2023-12-20T04:46:30.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75b67d5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7598004070 0x7f75b015b560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:30.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75b67d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75b015e340 0x7f75b01560e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:30.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75b67d5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75b01f0800 0x7f75b00b5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:30.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75b67d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b0156620 con 0x7f75b015e340 2023-12-20T04:46:30.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75b67d5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75b00c8f70 con 0x7f7598004070 2023-12-20T04:46:30.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75b67d5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75b015c3e0 con 0x7f75b01f0800 2023-12-20T04:46:30.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75af7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75b015e340 0x7f75b01560e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:30.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75af7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75b015e340 0x7f75b01560e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59548/0 (socket says 172.21.15.132:59548) 2023-12-20T04:46:30.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75af7fe640 1 -- 172.21.15.132:0/3428251271 learned_addr learned my addr 172.21.15.132:0/3428251271 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:30.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75affff640 1 --2- 172.21.15.132:0/3428251271 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7598004070 0x7f75b015b560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:30.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75b4d72640 1 --2- 172.21.15.132:0/3428251271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75b01f0800 0x7f75b00b5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:30.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75af7fe640 1 -- 172.21.15.132:0/3428251271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75b01f0800 msgr2=0x7f75b00b5410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:30.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75af7fe640 1 --2- 172.21.15.132:0/3428251271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75b01f0800 0x7f75b00b5410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75af7fe640 1 -- 172.21.15.132:0/3428251271 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7598004070 msgr2=0x7f75b015b560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:30.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75af7fe640 1 --2- 172.21.15.132:0/3428251271 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7598004070 0x7f75b015b560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75af7fe640 1 -- 172.21.15.132:0/3428251271 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75b015bb40 con 0x7f75b015e340 2023-12-20T04:46:30.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75af7fe640 1 --2- 172.21.15.132:0/3428251271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75b015e340 0x7f75b01560e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f75a4037040 tx=0x7f75a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:30.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75acff9640 1 -- 172.21.15.132:0/3428251271 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a4034d40 con 0x7f75b015e340 2023-12-20T04:46:30.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75acff9640 1 -- 172.21.15.132:0/3428251271 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f75a403e400 con 0x7f75b015e340 2023-12-20T04:46:30.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75b67d5640 1 -- 172.21.15.132:0/3428251271 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f75b015be20 con 0x7f75b015e340 2023-12-20T04:46:30.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75acff9640 1 -- 172.21.15.132:0/3428251271 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f75a4034ea0 con 0x7f75b015e340 2023-12-20T04:46:30.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.234+0000 7f75b67d5640 1 -- 172.21.15.132:0/3428251271 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75b01f0c80 con 0x7f75b015e340 2023-12-20T04:46:30.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.235+0000 7f75b67d5640 1 -- 172.21.15.132:0/3428251271 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f75b004e840 con 0x7f75b015e340 2023-12-20T04:46:30.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.236+0000 7f75acff9640 1 -- 172.21.15.132:0/3428251271 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f75a403e7b0 con 0x7f75b015e340 2023-12-20T04:46:30.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.236+0000 7f75acff9640 1 --2- 172.21.15.132:0/3428251271 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f759c06a430 0x7f759c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:30.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.236+0000 7f75acff9640 1 -- 172.21.15.132:0/3428251271 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f75a40aae50 con 0x7f75b015e340 2023-12-20T04:46:30.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.236+0000 7f75affff640 1 --2- 172.21.15.132:0/3428251271 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f759c06a430 0x7f759c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:30.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.237+0000 7f75affff640 1 --2- 172.21.15.132:0/3428251271 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f759c06a430 0x7f759c06c8f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f75a0001050 tx=0x7f75a0001e20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:30.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.240+0000 7f75acff9640 1 -- 172.21.15.132:0/3428251271 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f75a40764f0 con 0x7f75b015e340 2023-12-20T04:46:30.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.468+0000 7f75b67d5640 1 -- 172.21.15.132:0/3428251271 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f75b00c90b0 con 0x7f75b015e340 2023-12-20T04:46:30.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.474+0000 7f75acff9640 1 -- 172.21.15.132:0/3428251271 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v16) v1 ==== 190+0+0 (secure 0 0 0) 0x7f75a404c0e0 con 0x7f75b015e340 2023-12-20T04:46:30.476 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.0 2023-12-20T04:46:30.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.476+0000 7f75b67d5640 1 -- 172.21.15.132:0/3428251271 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f759c06a430 msgr2=0x7f759c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:30.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.476+0000 7f75b67d5640 1 --2- 172.21.15.132:0/3428251271 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f759c06a430 0x7f759c06c8f0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7f75a0001050 tx=0x7f75a0001e20 comp rx=0 tx=0).stop 2023-12-20T04:46:30.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.476+0000 7f75b67d5640 1 -- 172.21.15.132:0/3428251271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75b015e340 msgr2=0x7f75b01560e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:30.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.476+0000 7f75b67d5640 1 --2- 172.21.15.132:0/3428251271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75b015e340 0x7f75b01560e0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f75a4037040 tx=0x7f75a4004730 comp rx=0 tx=0).stop 2023-12-20T04:46:30.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.476+0000 7f75b67d5640 1 -- 172.21.15.132:0/3428251271 shutdown_connections 2023-12-20T04:46:30.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.476+0000 7f75b67d5640 1 --2- 172.21.15.132:0/3428251271 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f759c06a430 0x7f759c06c8f0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.476+0000 7f75b67d5640 1 --2- 172.21.15.132:0/3428251271 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75b01f0800 0x7f75b00b5410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.476+0000 7f75b67d5640 1 --2- 172.21.15.132:0/3428251271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75b015e340 0x7f75b01560e0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.476+0000 7f75b67d5640 1 --2- 172.21.15.132:0/3428251271 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7598004070 0x7f75b015b560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.476+0000 7f75b67d5640 1 -- 172.21.15.132:0/3428251271 >> 172.21.15.132:0/3428251271 conn(0x7f75b0072c60 msgr2=0x7f75b00d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:30.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.476+0000 7f75b67d5640 1 -- 172.21.15.132:0/3428251271 shutdown_connections 2023-12-20T04:46:30.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.476+0000 7f75b67d5640 1 -- 172.21.15.132:0/3428251271 wait complete. 2023-12-20T04:46:30.489 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:46:30.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.587+0000 7f90d80d5640 1 Processor -- start 2023-12-20T04:46:30.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.588+0000 7f90d80d5640 1 -- start start 2023-12-20T04:46:30.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.588+0000 7f90d80d5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f90d0159b50 0x7f90d00c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:30.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.588+0000 7f90d80d5640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f90d006c240 0x7f90d006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:30.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.588+0000 7f90d80d5640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90d00ccf30 con 0x7f90d015e530 2023-12-20T04:46:30.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.589+0000 7f90d80d5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d006cc10 con 0x7f90d0159b50 2023-12-20T04:46:30.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.589+0000 7f90d80d5640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90d00caa60 con 0x7f90d006c240 2023-12-20T04:46:30.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.589+0000 7f90d5e71640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f90d0159b50 0x7f90d00c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:30.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.589+0000 7f90d5e71640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f90d0159b50 0x7f90d00c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59552/0 (socket says 172.21.15.132:59552) 2023-12-20T04:46:30.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.589+0000 7f90d5e71640 1 -- 172.21.15.132:0/3889101194 learned_addr learned my addr 172.21.15.132:0/3889101194 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:30.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.589+0000 7f90d6672640 1 --2- 172.21.15.132:0/3889101194 >> v2:172.21.15.187:3300/0 conn(0x7f90d006c240 0x7f90d006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:30.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.589+0000 7f90d5e71640 1 -- 172.21.15.132:0/3889101194 >> v2:172.21.15.187:3300/0 conn(0x7f90d006c240 msgr2=0x7f90d006c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:30.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.589+0000 7f90d5e71640 1 --2- 172.21.15.132:0/3889101194 >> v2:172.21.15.187:3300/0 conn(0x7f90d006c240 0x7f90d006c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.589+0000 7f90d5e71640 1 -- 172.21.15.132:0/3889101194 >> v1:172.21.15.187:6789/0 conn(0x7f90d015e530 legacy=0x7f90d006fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:30.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.589+0000 7f90d5e71640 1 -- 172.21.15.132:0/3889101194 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90d00ca1c0 con 0x7f90d0159b50 2023-12-20T04:46:30.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.590+0000 7f90d5e71640 1 --2- 172.21.15.132:0/3889101194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d0159b50 0x7f90d00c9930 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00bb10 tx=0x7f90cc02e170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddf431831df00eac server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:30.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.590+0000 7f90d4e6f640 1 -- 172.21.15.132:0/3889101194 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc036440 con 0x7f90d0159b50 2023-12-20T04:46:30.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.590+0000 7f90d4e6f640 1 -- 172.21.15.132:0/3889101194 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90cc0365a0 con 0x7f90d0159b50 2023-12-20T04:46:30.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.590+0000 7f90d4e6f640 1 -- 172.21.15.132:0/3889101194 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90cc036930 con 0x7f90d0159b50 2023-12-20T04:46:30.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.590+0000 7f90d80d5640 1 -- 172.21.15.132:0/3889101194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d0159b50 msgr2=0x7f90d00c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.590+0000 7f90d80d5640 1 --2- 172.21.15.132:0/3889101194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d0159b50 0x7f90d00c9930 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f90cc00bb10 tx=0x7f90cc02e170 comp rx=0 tx=0).stop 2023-12-20T04:46:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.590+0000 7f90d80d5640 1 -- 172.21.15.132:0/3889101194 shutdown_connections 2023-12-20T04:46:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.590+0000 7f90d80d5640 1 --2- 172.21.15.132:0/3889101194 >> v2:172.21.15.187:3300/0 conn(0x7f90d006c240 0x7f90d006c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.590+0000 7f90d80d5640 1 --2- 172.21.15.132:0/3889101194 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d0159b50 0x7f90d00c9930 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.590+0000 7f90d80d5640 1 -- 172.21.15.132:0/3889101194 >> 172.21.15.132:0/3889101194 conn(0x7f90d00ced10 msgr2=0x7f90d00cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.591+0000 7f90d80d5640 1 -- 172.21.15.132:0/3889101194 shutdown_connections 2023-12-20T04:46:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.591+0000 7f90d80d5640 1 -- 172.21.15.132:0/3889101194 wait complete. 2023-12-20T04:46:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.592+0000 7f90d80d5640 1 Processor -- start 2023-12-20T04:46:30.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.592+0000 7f90d80d5640 1 -- start start 2023-12-20T04:46:30.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.592+0000 7f90d80d5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90d006c240 0x7f90d015c820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.592+0000 7f90d80d5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90d0159b50 0x7f90d014bf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.592+0000 7f90d80d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d015e530 0x7f90d0148b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.592+0000 7f90d80d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d015b930 con 0x7f90d015e530 2023-12-20T04:46:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.592+0000 7f90d80d5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90d015acb0 con 0x7f90d006c240 2023-12-20T04:46:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.592+0000 7f90d80d5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90d015af90 con 0x7f90d0159b50 2023-12-20T04:46:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.592+0000 7f90d6672640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d015e530 0x7f90d0148b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.592+0000 7f90d6672640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d015e530 0x7f90d0148b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59566/0 (socket says 172.21.15.132:59566) 2023-12-20T04:46:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.592+0000 7f90d6672640 1 -- 172.21.15.132:0/1447821799 learned_addr learned my addr 172.21.15.132:0/1447821799 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.593+0000 7f90d5e71640 1 --2- 172.21.15.132:0/1447821799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90d006c240 0x7f90d015c820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:30.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.593+0000 7f90d5670640 1 --2- 172.21.15.132:0/1447821799 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90d0159b50 0x7f90d014bf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.593+0000 7f90d6672640 1 -- 172.21.15.132:0/1447821799 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90d0159b50 msgr2=0x7f90d014bf70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.593+0000 7f90d6672640 1 --2- 172.21.15.132:0/1447821799 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90d0159b50 0x7f90d014bf70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.593+0000 7f90d6672640 1 -- 172.21.15.132:0/1447821799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90d006c240 msgr2=0x7f90d015c820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.593+0000 7f90d6672640 1 --2- 172.21.15.132:0/1447821799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90d006c240 0x7f90d015c820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.593+0000 7f90d6672640 1 -- 172.21.15.132:0/1447821799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90cc00b770 con 0x7f90d015e530 2023-12-20T04:46:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.593+0000 7f90d5670640 1 --2- 172.21.15.132:0/1447821799 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90d0159b50 0x7f90d014bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.593+0000 7f90d6672640 1 --2- 172.21.15.132:0/1447821799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d015e530 0x7f90d0148b20 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f90c800efc0 tx=0x7f90c800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.593+0000 7f90c27fc640 1 -- 172.21.15.132:0/1447821799 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c8009ba0 con 0x7f90d015e530 2023-12-20T04:46:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.593+0000 7f90c27fc640 1 -- 172.21.15.132:0/1447821799 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90c800f040 con 0x7f90d015e530 2023-12-20T04:46:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.593+0000 7f90d80d5640 1 -- 172.21.15.132:0/1447821799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90d015b270 con 0x7f90d015e530 2023-12-20T04:46:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.593+0000 7f90c27fc640 1 -- 172.21.15.132:0/1447821799 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90c80146c0 con 0x7f90d015e530 2023-12-20T04:46:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.593+0000 7f90d80d5640 1 -- 172.21.15.132:0/1447821799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90d015a940 con 0x7f90d015e530 2023-12-20T04:46:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.594+0000 7f90d80d5640 1 -- 172.21.15.132:0/1447821799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90d004e840 con 0x7f90d015e530 2023-12-20T04:46:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.594+0000 7f90c27fc640 1 -- 172.21.15.132:0/1447821799 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f90c8014820 con 0x7f90d015e530 2023-12-20T04:46:30.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.595+0000 7f90c27fc640 1 --2- 172.21.15.132:0/1447821799 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90b406a430 0x7f90b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:30.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.595+0000 7f90c27fc640 1 -- 172.21.15.132:0/1447821799 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90c8089420 con 0x7f90d015e530 2023-12-20T04:46:30.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.595+0000 7f90d5e71640 1 --2- 172.21.15.132:0/1447821799 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90b406a430 0x7f90b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:30.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.595+0000 7f90d5e71640 1 --2- 172.21.15.132:0/1447821799 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90b406a430 0x7f90b406c8f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f90cc038000 tx=0x7f90cc032000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:30.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.599+0000 7f90c27fc640 1 -- 172.21.15.132:0/1447821799 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f90c8054a80 con 0x7f90d015e530 2023-12-20T04:46:30.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.797+0000 7f90d80d5640 1 -- 172.21.15.132:0/1447821799 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90d00b4c90 con 0x7f90d015e530 2023-12-20T04:46:30.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.798+0000 7f90c27fc640 1 -- 172.21.15.132:0/1447821799 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f90c80580a0 con 0x7f90d015e530 2023-12-20T04:46:30.800 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:30.800 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":32,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2337953767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2337953767},{"type":"v1","addr":"172.21.15.187:6835","nonce":2337953767}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6540,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/41640576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":41640576},{"type":"v1","addr":"172.21.15.132:6836","nonce":41640576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6543,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2936157584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2936157584},{"type":"v1","addr":"172.21.15.132:6837","nonce":2936157584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:46:22.459815+0000","modified":"2023-12-20T04:46:24.470923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6552":{"gid":6552,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6833/3732620607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3732620607},{"type":"v1","addr":"172.21.15.187:6833","nonce":3732620607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-20T04:46:30.800 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 32 2023-12-20T04:46:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.800+0000 7f90d80d5640 1 -- 172.21.15.132:0/1447821799 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90b406a430 msgr2=0x7f90b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.800+0000 7f90d80d5640 1 --2- 172.21.15.132:0/1447821799 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90b406a430 0x7f90b406c8f0 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f90cc038000 tx=0x7f90cc032000 comp rx=0 tx=0).stop 2023-12-20T04:46:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.800+0000 7f90d80d5640 1 -- 172.21.15.132:0/1447821799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d015e530 msgr2=0x7f90d0148b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.800+0000 7f90d80d5640 1 --2- 172.21.15.132:0/1447821799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d015e530 0x7f90d0148b20 secure :-1 s=READY pgs=904 cs=0 l=1 rev1=1 crypto rx=0x7f90c800efc0 tx=0x7f90c800c490 comp rx=0 tx=0).stop 2023-12-20T04:46:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.800+0000 7f90d80d5640 1 -- 172.21.15.132:0/1447821799 shutdown_connections 2023-12-20T04:46:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.800+0000 7f90d80d5640 1 --2- 172.21.15.132:0/1447821799 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90b406a430 0x7f90b406c8f0 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.800+0000 7f90d80d5640 1 --2- 172.21.15.132:0/1447821799 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90d015e530 0x7f90d0148b20 unknown :-1 s=CLOSED pgs=904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.800+0000 7f90d80d5640 1 --2- 172.21.15.132:0/1447821799 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90d0159b50 0x7f90d014bf70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.800+0000 7f90d80d5640 1 --2- 172.21.15.132:0/1447821799 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90d006c240 0x7f90d015c820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.800+0000 7f90d80d5640 1 -- 172.21.15.132:0/1447821799 >> 172.21.15.132:0/1447821799 conn(0x7f90d00ced10 msgr2=0x7f90d0153160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:30.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.800+0000 7f90d80d5640 1 -- 172.21.15.132:0/1447821799 shutdown_connections 2023-12-20T04:46:30.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:30.800+0000 7f90d80d5640 1 -- 172.21.15.132:0/1447821799 wait complete. 2023-12-20T04:46:31.216 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 32, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-20T04:46:22.459815+0000', 'modified': '2023-12-20T04:46:24.470923+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6552}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6552': {'gid': 6552, 'name': 'd', 'rank': 0, 'incarnation': 30, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.187:6833/3732620607', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6832', 'nonce': 3732620607}, {'type': 'v1', 'addr': '172.21.15.187:6833', 'nonce': 3732620607}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [11], 'metadata_pool': 10, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-20T04:46:31.216 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-20T04:46:31.216 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-20T04:46:31.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.316+0000 7f04c9e4d640 1 Processor -- start 2023-12-20T04:46:31.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.316+0000 7f04c9e4d640 1 -- start start 2023-12-20T04:46:31.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.317+0000 7f04c9e4d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f04c40d30a0 0x7f04c40cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.317+0000 7f04c9e4d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f04c40d0060 0x7f04c40d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.317+0000 7f04c9e4d640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f04c40d0cf0 con 0x7f04c415d2c0 2023-12-20T04:46:31.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.317+0000 7f04c9e4d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c40d0550 con 0x7f04c40d30a0 2023-12-20T04:46:31.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.317+0000 7f04c9e4d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f04c40cddc0 con 0x7f04c40d0060 2023-12-20T04:46:31.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.317+0000 7f04c37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f04c40d30a0 0x7f04c40cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.317+0000 7f04c2ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f04c415d2c0 0x7f04c40d3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46208/0 (socket says 172.21.15.132:46208) 2023-12-20T04:46:31.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.317+0000 7f04c2ffd640 1 -- 172.21.15.132:0/583523949 learned_addr learned my addr 172.21.15.132:0/583523949 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:31.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.318+0000 7f04c3fff640 1 --2- 172.21.15.132:0/583523949 >> v2:172.21.15.187:3300/0 conn(0x7f04c40d0060 0x7f04c40d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.318+0000 7f04c37fe640 1 -- 172.21.15.132:0/583523949 >> v2:172.21.15.187:3300/0 conn(0x7f04c40d0060 msgr2=0x7f04c40d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:31.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.318+0000 7f04c37fe640 1 --2- 172.21.15.132:0/583523949 >> v2:172.21.15.187:3300/0 conn(0x7f04c40d0060 0x7f04c40d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.318+0000 7f04c37fe640 1 -- 172.21.15.132:0/583523949 >> v1:172.21.15.132:6789/0 conn(0x7f04c415d2c0 legacy=0x7f04c40d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:31.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.318+0000 7f04c27fc640 1 -- 172.21.15.132:0/583523949 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2124165228 0 0) 0x7f04c40d0cf0 con 0x7f04c415d2c0 2023-12-20T04:46:31.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.318+0000 7f04c37fe640 1 -- 172.21.15.132:0/583523949 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04c40ce0a0 con 0x7f04c40d30a0 2023-12-20T04:46:31.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.318+0000 7f04c37fe640 1 --2- 172.21.15.132:0/583523949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04c40d30a0 0x7f04c40cd5c0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f04c40b87e0 tx=0x7f04b402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0e1a5f5d92a41dc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:31.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.319+0000 7f04c27fc640 1 -- 172.21.15.132:0/583523949 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4031830 con 0x7f04c40d30a0 2023-12-20T04:46:31.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.319+0000 7f04c27fc640 1 -- 172.21.15.132:0/583523949 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b4031990 con 0x7f04c40d30a0 2023-12-20T04:46:31.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.319+0000 7f04c27fc640 1 -- 172.21.15.132:0/583523949 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4031d20 con 0x7f04c40d30a0 2023-12-20T04:46:31.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.319+0000 7f04c9e4d640 1 -- 172.21.15.132:0/583523949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04c40d30a0 msgr2=0x7f04c40cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:31.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.319+0000 7f04c9e4d640 1 --2- 172.21.15.132:0/583523949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04c40d30a0 0x7f04c40cd5c0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f04c40b87e0 tx=0x7f04b402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.319+0000 7f04c9e4d640 1 -- 172.21.15.132:0/583523949 shutdown_connections 2023-12-20T04:46:31.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.319+0000 7f04c9e4d640 1 --2- 172.21.15.132:0/583523949 >> v2:172.21.15.187:3300/0 conn(0x7f04c40d0060 0x7f04c40d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.319+0000 7f04c9e4d640 1 --2- 172.21.15.132:0/583523949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04c40d30a0 0x7f04c40cd5c0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.319+0000 7f04c9e4d640 1 -- 172.21.15.132:0/583523949 >> 172.21.15.132:0/583523949 conn(0x7f04c4072e40 msgr2=0x7f04c4073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:31.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.319+0000 7f04c9e4d640 1 -- 172.21.15.132:0/583523949 shutdown_connections 2023-12-20T04:46:31.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.319+0000 7f04c9e4d640 1 -- 172.21.15.132:0/583523949 wait complete. 2023-12-20T04:46:31.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.320+0000 7f04c9e4d640 1 Processor -- start 2023-12-20T04:46:31.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.320+0000 7f04c9e4d640 1 -- start start 2023-12-20T04:46:31.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.321+0000 7f04c9e4d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04c40d0060 0x7f04c4148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.321+0000 7f04c9e4d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04c40d30a0 0x7f04c4148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.321+0000 7f04c9e4d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04c415d2c0 0x7f04c41f1b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.321+0000 7f04c9e4d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c4160540 con 0x7f04c415d2c0 2023-12-20T04:46:31.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.321+0000 7f04c9e4d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04c40c9210 con 0x7f04c40d30a0 2023-12-20T04:46:31.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.321+0000 7f04c9e4d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f04c4149380 con 0x7f04c40d0060 2023-12-20T04:46:31.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.321+0000 7f04c3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04c415d2c0 0x7f04c41f1b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.321+0000 7f04c3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04c415d2c0 0x7f04c41f1b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59582/0 (socket says 172.21.15.132:59582) 2023-12-20T04:46:31.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.321+0000 7f04c3fff640 1 -- 172.21.15.132:0/1582819614 learned_addr learned my addr 172.21.15.132:0/1582819614 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:31.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.322+0000 7f04c2ffd640 1 --2- 172.21.15.132:0/1582819614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04c40d30a0 0x7f04c4148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.322+0000 7f04c3fff640 1 -- 172.21.15.132:0/1582819614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04c40d0060 msgr2=0x7f04c4148900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:31.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.322+0000 7f04c37fe640 1 --2- 172.21.15.132:0/1582819614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04c40d0060 0x7f04c4148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.322+0000 7f04c3fff640 1 --2- 172.21.15.132:0/1582819614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04c40d0060 0x7f04c4148900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.322+0000 7f04c3fff640 1 -- 172.21.15.132:0/1582819614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04c40d30a0 msgr2=0x7f04c4148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:31.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.322+0000 7f04c3fff640 1 --2- 172.21.15.132:0/1582819614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04c40d30a0 0x7f04c4148e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.322+0000 7f04c3fff640 1 -- 172.21.15.132:0/1582819614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f04b4009400 con 0x7f04c415d2c0 2023-12-20T04:46:31.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.322+0000 7f04c3fff640 1 --2- 172.21.15.132:0/1582819614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04c415d2c0 0x7f04c41f1b10 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00cd70 tx=0x7f04bc00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:31.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.322+0000 7f04abfff640 1 -- 172.21.15.132:0/1582819614 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc003b90 con 0x7f04c415d2c0 2023-12-20T04:46:31.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.322+0000 7f04abfff640 1 -- 172.21.15.132:0/1582819614 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc003cf0 con 0x7f04c415d2c0 2023-12-20T04:46:31.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.322+0000 7f04c9e4d640 1 -- 172.21.15.132:0/1582819614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f04c4160260 con 0x7f04c415d2c0 2023-12-20T04:46:31.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.322+0000 7f04abfff640 1 -- 172.21.15.132:0/1582819614 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc004240 con 0x7f04c415d2c0 2023-12-20T04:46:31.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.322+0000 7f04c9e4d640 1 -- 172.21.15.132:0/1582819614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c40c8ea0 con 0x7f04c415d2c0 2023-12-20T04:46:31.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.323+0000 7f04abfff640 1 -- 172.21.15.132:0/1582819614 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f04bc0043a0 con 0x7f04c415d2c0 2023-12-20T04:46:31.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.324+0000 7f04abfff640 1 --2- 172.21.15.132:0/1582819614 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f04b006a430 0x7f04b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.324+0000 7f04c37fe640 1 --2- 172.21.15.132:0/1582819614 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f04b006a430 0x7f04b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.324+0000 7f04abfff640 1 -- 172.21.15.132:0/1582819614 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04bc012070 con 0x7f04c415d2c0 2023-12-20T04:46:31.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.324+0000 7f04c37fe640 1 --2- 172.21.15.132:0/1582819614 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f04b006a430 0x7f04b006c8f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f04b4036000 tx=0x7f04b4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:31.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.325+0000 7f04cc9b6740 1 Processor -- start 2023-12-20T04:46:31.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.325+0000 7f04cc9b6740 1 -- start start 2023-12-20T04:46:31.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04cc9b6740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff48b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04cc9b6740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b8770 0x5570ff4bb120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04cc9b6740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff48ba60 0x5570ff4bb660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04cc9b6740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570ff3fb0b0 con 0x5570ff4b8390 2023-12-20T04:46:31.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04cc9b6740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570ff3f8840 con 0x5570ff4b8770 2023-12-20T04:46:31.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04cc9b6740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5570ff3f4130 con 0x5570ff48ba60 2023-12-20T04:46:31.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04c37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff48b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04c37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff48b520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59592/0 (socket says 172.21.15.132:59592) 2023-12-20T04:46:31.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04c37fe640 1 -- 172.21.15.132:0/3967570308 learned_addr learned my addr 172.21.15.132:0/3967570308 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:31.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04c2ffd640 1 --2- 172.21.15.132:0/3967570308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b8770 0x5570ff4bb120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04c3fff640 1 --2- 172.21.15.132:0/3967570308 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff48ba60 0x5570ff4bb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04c37fe640 1 -- 172.21.15.132:0/3967570308 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff48ba60 msgr2=0x5570ff4bb660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04c37fe640 1 --2- 172.21.15.132:0/3967570308 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff48ba60 0x5570ff4bb660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04c37fe640 1 -- 172.21.15.132:0/3967570308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b8770 msgr2=0x5570ff4bb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04c37fe640 1 --2- 172.21.15.132:0/3967570308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b8770 0x5570ff4bb120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04c37fe640 1 -- 172.21.15.132:0/3967570308 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570ff3aec40 con 0x5570ff4b8390 2023-12-20T04:46:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04c3fff640 1 --2- 172.21.15.132:0/3967570308 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff48ba60 0x5570ff4bb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.326+0000 7f04c2ffd640 1 --2- 172.21.15.132:0/3967570308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b8770 0x5570ff4bb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.327+0000 7f04c37fe640 1 --2- 172.21.15.132:0/3967570308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff48b520 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f04b4009860 tx=0x7f04b4030000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d3ff600af5ffef2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.327+0000 7f04a97fa640 1 -- 172.21.15.132:0/3967570308 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4040070 con 0x5570ff4b8390 2023-12-20T04:46:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.327+0000 7f04a97fa640 1 -- 172.21.15.132:0/3967570308 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b4031d50 con 0x5570ff4b8390 2023-12-20T04:46:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.327+0000 7f04a97fa640 1 -- 172.21.15.132:0/3967570308 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b40526c0 con 0x5570ff4b8390 2023-12-20T04:46:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.327+0000 7f04cc9b6740 1 -- 172.21.15.132:0/3967570308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 msgr2=0x5570ff48b520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:31.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.327+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/3967570308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff48b520 secure :-1 s=READY pgs=908 cs=0 l=1 rev1=1 crypto rx=0x7f04b4009860 tx=0x7f04b4030000 comp rx=0 tx=0).stop 2023-12-20T04:46:31.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.327+0000 7f04cc9b6740 1 -- 172.21.15.132:0/3967570308 shutdown_connections 2023-12-20T04:46:31.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.327+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/3967570308 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff48ba60 0x5570ff4bb660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.327+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/3967570308 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b8770 0x5570ff4bb120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.327+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/3967570308 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff48b520 unknown :-1 s=CLOSED pgs=908 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.327+0000 7f04cc9b6740 1 -- 172.21.15.132:0/3967570308 >> 172.21.15.132:0/3967570308 conn(0x5570ff48d830 msgr2=0x5570ff4d6120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:31.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.327+0000 7f04cc9b6740 1 -- 172.21.15.132:0/3967570308 shutdown_connections 2023-12-20T04:46:31.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.327+0000 7f04cc9b6740 1 -- 172.21.15.132:0/3967570308 wait complete. 2023-12-20T04:46:31.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.328+0000 7f04cc9b6740 1 -- start start 2023-12-20T04:46:31.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.328+0000 7f04cc9b6740 1 Processor -- start 2023-12-20T04:46:31.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04cc9b6740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff4be410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04cc9b6740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b8770 0x5570ff4ce020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04cc9b6740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff4b79d0 0x5570ff4ce560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04cc9b6740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570ff3b2840 con 0x5570ff4b8390 2023-12-20T04:46:31.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04cc9b6740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570ff3b24e0 con 0x5570ff4b8770 2023-12-20T04:46:31.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04cc9b6740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5570ff378230 con 0x5570ff4b79d0 2023-12-20T04:46:31.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04cc9b6740 10 client.0 _ll_register_callbacks cb 0x5570ff3c96d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:46:31.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04c37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff4be410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04c37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff4be410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59598/0 (socket says 172.21.15.132:59598) 2023-12-20T04:46:31.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04c37fe640 1 -- 172.21.15.132:0/1805010161 learned_addr learned my addr 172.21.15.132:0/1805010161 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:31.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04c37fe640 1 -- 172.21.15.132:0/1805010161 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff4b79d0 msgr2=0x5570ff4ce560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:31.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04c2ffd640 1 --2- 172.21.15.132:0/1805010161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b8770 0x5570ff4ce020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04c37fe640 1 --2- 172.21.15.132:0/1805010161 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff4b79d0 0x5570ff4ce560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04c37fe640 1 -- 172.21.15.132:0/1805010161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b8770 msgr2=0x5570ff4ce020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:31.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04c37fe640 1 --2- 172.21.15.132:0/1805010161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b8770 0x5570ff4ce020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04c37fe640 1 -- 172.21.15.132:0/1805010161 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c40ce0a0 con 0x5570ff4b8390 2023-12-20T04:46:31.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04c2ffd640 1 --2- 172.21.15.132:0/1805010161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b8770 0x5570ff4ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:31.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04c37fe640 1 --2- 172.21.15.132:0/1805010161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff4be410 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f04b4004230 tx=0x7f04b4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85e606f5ea103a00 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:31.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:46:31.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.329+0000 7f04a27fc640 1 -- 172.21.15.132:0/1805010161 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b4003a20 con 0x5570ff4b8390 2023-12-20T04:46:31.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.330+0000 7f04a27fc640 1 -- 172.21.15.132:0/1805010161 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04b4003b80 con 0x5570ff4b8390 2023-12-20T04:46:31.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.330+0000 7f04cc9b6740 1 -- 172.21.15.132:0/1805010161 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5570ff41d970 con 0x5570ff4b8390 2023-12-20T04:46:31.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.330+0000 7f04a27fc640 1 -- 172.21.15.132:0/1805010161 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04b40044d0 con 0x5570ff4b8390 2023-12-20T04:46:31.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.330+0000 7f04cc9b6740 10 client.6714 fetch_fsmap learned FSMap version 32 2023-12-20T04:46:31.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.330+0000 7f04cc9b6740 1 -- 172.21.15.132:0/1805010161 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5570ff3f27b0 con 0x5570ff4b8390 2023-12-20T04:46:31.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.330+0000 7f04a27fc640 1 -- 172.21.15.132:0/1805010161 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5570ff41d970 con 0x5570ff4b8390 2023-12-20T04:46:31.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.330+0000 7f04a27fc640 1 -- 172.21.15.132:0/1805010161 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f04b4052480 con 0x5570ff4b8390 2023-12-20T04:46:31.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.330+0000 7f04cc9b6740 10 client.6714 fetch_fsmap finished waiting for FSMap version 32 2023-12-20T04:46:31.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.330+0000 7f04cc9b6740 10 client.6714 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-20T04:46:31.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.330+0000 7f04cc9b6740 20 client.6714 populate_metadata read hostname 'smithi132' 2023-12-20T04:46:31.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.330+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/1805010161 >> [v2:172.21.15.187:6832/3732620607,v1:172.21.15.187:6833/3732620607] conn(0x5570ff4cffb0 0x5570ff4f3050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.330+0000 7f04cc9b6740 4 client.6714 mds_command: new command op to 6552 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-20T04:46:31.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.330+0000 7f04cc9b6740 1 -- 172.21.15.132:0/1805010161 --> [v2:172.21.15.187:6832/3732620607,v1:172.21.15.187:6833/3732620607] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5570ff3e5f00 con 0x5570ff4cffb0 2023-12-20T04:46:31.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.330+0000 7f04c2ffd640 1 --2- 172.21.15.132:0/1805010161 >> [v2:172.21.15.187:6832/3732620607,v1:172.21.15.187:6833/3732620607] conn(0x5570ff4cffb0 0x5570ff4f3050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.331+0000 7f04a27fc640 10 client.6714 ms_handle_connect on v2:172.21.15.187:6832/3732620607 2023-12-20T04:46:31.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.331+0000 7f04c2ffd640 1 --2- 172.21.15.132:0/1805010161 >> [v2:172.21.15.187:6832/3732620607,v1:172.21.15.187:6833/3732620607] conn(0x5570ff4cffb0 0x5570ff4f3050 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=67db9d10e6dcccb1 server_cookie=fb22f8587d34e6d2 in_seq=0 out_seq=0 2023-12-20T04:46:31.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.331+0000 7f04a27fc640 1 -- 172.21.15.132:0/1805010161 <== mds.0 v2:172.21.15.187:6832/3732620607 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5570ff3e5f00 con 0x5570ff4cffb0 2023-12-20T04:46:31.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.331+0000 7f04a27fc640 10 client.6714 handle_command_reply: tid=0 2023-12-20T04:46:31.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.331+0000 7f04cc9b6740 1 client.6714 shutdown 2023-12-20T04:46:31.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.331+0000 7f04cc9b6740 1 -- 172.21.15.132:0/1805010161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 msgr2=0x5570ff4be410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:31.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.331+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/1805010161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff4be410 secure :-1 s=READY pgs=909 cs=0 l=1 rev1=1 crypto rx=0x7f04b4004230 tx=0x7f04b4004730 comp rx=0 tx=0).stop 2023-12-20T04:46:31.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.331+0000 7f04cc9b6740 1 -- 172.21.15.132:0/1805010161 shutdown_connections 2023-12-20T04:46:31.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.332+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/1805010161 >> [v2:172.21.15.187:6832/3732620607,v1:172.21.15.187:6833/3732620607] conn(0x5570ff4cffb0 0x5570ff4f3050 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.332+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/1805010161 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff4b79d0 0x5570ff4ce560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.332+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/1805010161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b8770 0x5570ff4ce020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.332+0000 7f04a27fc640 0 client.6714 ms_handle_reset on v2:172.21.15.187:6832/3732620607 2023-12-20T04:46:31.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.332+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/1805010161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff4be410 unknown :-1 s=CLOSED pgs=909 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.332+0000 7f04cc9b6740 1 -- 172.21.15.132:0/1805010161 >> 172.21.15.132:0/1805010161 conn(0x5570ff48ba60 msgr2=0x5570ff48f210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:31.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.332+0000 7f04cc9b6740 1 -- 172.21.15.132:0/1805010161 shutdown_connections 2023-12-20T04:46:31.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.332+0000 7f04cc9b6740 1 -- 172.21.15.132:0/1805010161 wait complete. 2023-12-20T04:46:31.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.332+0000 7f04cc9b6740 20 client.6714 trim_cache size 0 max 16384 2023-12-20T04:46:31.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.346+0000 7f04cc9b6740 1 Processor -- start 2023-12-20T04:46:31.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.346+0000 7f04cc9b6740 1 -- start start 2023-12-20T04:46:31.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.347+0000 7f04cc9b6740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b79d0 0x5570ff4d8ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.347+0000 7f04cc9b6740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff4b8390 0x5570ff492490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.347+0000 7f04cc9b6740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8770 0x5570ff48f290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.347+0000 7f04cc9b6740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570ff48f7d0 con 0x5570ff4b8770 2023-12-20T04:46:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.347+0000 7f04cc9b6740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570ff491680 con 0x5570ff4b79d0 2023-12-20T04:46:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.347+0000 7f04cc9b6740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5570ff486ae0 con 0x5570ff4b8390 2023-12-20T04:46:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.347+0000 7f04c3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8770 0x5570ff48f290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.347+0000 7f04c3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8770 0x5570ff48f290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59612/0 (socket says 172.21.15.132:59612) 2023-12-20T04:46:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.347+0000 7f04c3fff640 1 -- 172.21.15.132:0/3675763100 learned_addr learned my addr 172.21.15.132:0/3675763100 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.348+0000 7f04c3fff640 1 -- 172.21.15.132:0/3675763100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff4b8390 msgr2=0x5570ff492490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.348+0000 7f04c3fff640 1 --2- 172.21.15.132:0/3675763100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff4b8390 0x5570ff492490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.348+0000 7f04c3fff640 1 -- 172.21.15.132:0/3675763100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b79d0 msgr2=0x5570ff4d8ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.348+0000 7f04c3fff640 1 --2- 172.21.15.132:0/3675763100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b79d0 0x5570ff4d8ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.348+0000 7f04c3fff640 1 -- 172.21.15.132:0/3675763100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5570ff394be0 con 0x5570ff4b8770 2023-12-20T04:46:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.348+0000 7f04c3fff640 1 --2- 172.21.15.132:0/3675763100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8770 0x5570ff48f290 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f04bc058290 tx=0x7f04bc058d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0c54919ad728418 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.348+0000 7f04a9ffb640 1 -- 172.21.15.132:0/3675763100 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc05c3c0 con 0x5570ff4b8770 2023-12-20T04:46:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.348+0000 7f04a9ffb640 1 -- 172.21.15.132:0/3675763100 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04bc060570 con 0x5570ff4b8770 2023-12-20T04:46:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.348+0000 7f04a9ffb640 1 -- 172.21.15.132:0/3675763100 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04bc056930 con 0x5570ff4b8770 2023-12-20T04:46:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.348+0000 7f04cc9b6740 1 -- 172.21.15.132:0/3675763100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8770 msgr2=0x5570ff48f290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.348+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/3675763100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8770 0x5570ff48f290 secure :-1 s=READY pgs=910 cs=0 l=1 rev1=1 crypto rx=0x7f04bc058290 tx=0x7f04bc058d50 comp rx=0 tx=0).stop 2023-12-20T04:46:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.348+0000 7f04cc9b6740 1 -- 172.21.15.132:0/3675763100 shutdown_connections 2023-12-20T04:46:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.348+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/3675763100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8770 0x5570ff48f290 unknown :-1 s=CLOSED pgs=910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.348+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/3675763100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff4b8390 0x5570ff492490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.348+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/3675763100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b79d0 0x5570ff4d8ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.348+0000 7f04cc9b6740 1 -- 172.21.15.132:0/3675763100 >> 172.21.15.132:0/3675763100 conn(0x5570ff48ba60 msgr2=0x5570ff4b7240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.349+0000 7f04cc9b6740 1 -- 172.21.15.132:0/3675763100 shutdown_connections 2023-12-20T04:46:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.349+0000 7f04cc9b6740 1 -- 172.21.15.132:0/3675763100 wait complete. 2023-12-20T04:46:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.349+0000 7f04cc9b6740 1 -- start start 2023-12-20T04:46:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.349+0000 7f04cc9b6740 1 Processor -- start 2023-12-20T04:46:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04cc9b6740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b79d0 0x5570ff53e9b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04cc9b6740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff4acc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04cc9b6740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff4b8770 0x5570ff4ad180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04cc9b6740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570ff4d2fb0 con 0x5570ff4b8390 2023-12-20T04:46:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04cc9b6740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5570ff4d3910 con 0x5570ff4b79d0 2023-12-20T04:46:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04cc9b6740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5570ff4e8770 con 0x5570ff4b8770 2023-12-20T04:46:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04cc9b6740 10 client.0 _ll_register_callbacks cb 0x7f04b4009620 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:46:31.358 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04c2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff4acc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04c2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff4acc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59618/0 (socket says 172.21.15.132:59618) 2023-12-20T04:46:31.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04c2ffd640 1 -- 172.21.15.132:0/221312452 learned_addr learned my addr 172.21.15.132:0/221312452 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:31.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04c37fe640 1 --2- 172.21.15.132:0/221312452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b79d0 0x5570ff53e9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04c3fff640 1 --2- 172.21.15.132:0/221312452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff4b8770 0x5570ff4ad180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04c2ffd640 1 -- 172.21.15.132:0/221312452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff4b8770 msgr2=0x5570ff4ad180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:31.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04c2ffd640 1 --2- 172.21.15.132:0/221312452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff4b8770 0x5570ff4ad180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04c2ffd640 1 -- 172.21.15.132:0/221312452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b79d0 msgr2=0x5570ff53e9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:31.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04c2ffd640 1 --2- 172.21.15.132:0/221312452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b79d0 0x5570ff53e9b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04c2ffd640 1 -- 172.21.15.132:0/221312452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04c40c8ea0 con 0x5570ff4b8390 2023-12-20T04:46:31.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04c37fe640 1 --2- 172.21.15.132:0/221312452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b79d0 0x5570ff53e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:31.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04c3fff640 1 --2- 172.21.15.132:0/221312452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff4b8770 0x5570ff4ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:31.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04c2ffd640 1 --2- 172.21.15.132:0/221312452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff4acc40 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f04b8000f60 tx=0x7f04b8017c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce87ec61c1439d05 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:31.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04a27fc640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:46:31.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04a27fc640 1 -- 172.21.15.132:0/221312452 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f04b8007710 con 0x5570ff4b8390 2023-12-20T04:46:31.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04a27fc640 1 -- 172.21.15.132:0/221312452 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f04b8021af0 con 0x5570ff4b8390 2023-12-20T04:46:31.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.350+0000 7f04cc9b6740 1 -- 172.21.15.132:0/221312452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f04b4031d50 con 0x5570ff4b8390 2023-12-20T04:46:31.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.351+0000 7f04a27fc640 1 -- 172.21.15.132:0/221312452 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=32) v2 ==== 24+0+0 (secure 0 0 0) 0x7f04b8017e60 con 0x5570ff4b8390 2023-12-20T04:46:31.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.351+0000 7f04cc9b6740 10 client.6720 fetch_fsmap learned FSMap version 32 2023-12-20T04:46:31.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.351+0000 7f04cc9b6740 1 -- 172.21.15.132:0/221312452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=32,monmap=2+}) v3 -- 0x5570ff3ba2f0 con 0x5570ff4b8390 2023-12-20T04:46:31.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.351+0000 7f04a27fc640 1 -- 172.21.15.132:0/221312452 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f04b4031d50 con 0x5570ff4b8390 2023-12-20T04:46:31.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.351+0000 7f04a27fc640 1 -- 172.21.15.132:0/221312452 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 32) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f04b8021cb0 con 0x5570ff4b8390 2023-12-20T04:46:31.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.351+0000 7f04cc9b6740 10 client.6720 fetch_fsmap finished waiting for FSMap version 32 2023-12-20T04:46:31.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.351+0000 7f04cc9b6740 10 client.6720 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-20T04:46:31.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.351+0000 7f04cc9b6740 20 client.6720 populate_metadata read hostname 'smithi132' 2023-12-20T04:46:31.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.351+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/221312452 >> [v2:172.21.15.187:6832/3732620607,v1:172.21.15.187:6833/3732620607] conn(0x5570ff53f7d0 0x5570ff4903c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.351+0000 7f04cc9b6740 4 client.6720 mds_command: new command op to 6552 tid=0[{"prefix": "status"}] 2023-12-20T04:46:31.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.351+0000 7f04cc9b6740 1 -- 172.21.15.132:0/221312452 --> [v2:172.21.15.187:6832/3732620607,v1:172.21.15.187:6833/3732620607] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5570ff3ed1b0 con 0x5570ff53f7d0 2023-12-20T04:46:31.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.351+0000 7f04c37fe640 1 --2- 172.21.15.132:0/221312452 >> [v2:172.21.15.187:6832/3732620607,v1:172.21.15.187:6833/3732620607] conn(0x5570ff53f7d0 0x5570ff4903c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.351+0000 7f04a27fc640 10 client.6720 ms_handle_connect on v2:172.21.15.187:6832/3732620607 2023-12-20T04:46:31.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.351+0000 7f04c37fe640 1 --2- 172.21.15.132:0/221312452 >> [v2:172.21.15.187:6832/3732620607,v1:172.21.15.187:6833/3732620607] conn(0x5570ff53f7d0 0x5570ff4903c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fe32b45fecf91aa1 server_cookie=cf1771165ba898eb in_seq=0 out_seq=0 2023-12-20T04:46:31.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04a27fc640 1 -- 172.21.15.132:0/221312452 <== mds.0 v2:172.21.15.187:6832/3732620607 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+325 (crc 0 0 0) 0x5570ff3ed1b0 con 0x5570ff53f7d0 2023-12-20T04:46:31.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04a27fc640 10 client.6720 handle_command_reply: tid=0 2023-12-20T04:46:31.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04cc9b6740 1 client.6720 shutdown 2023-12-20T04:46:31.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04cc9b6740 1 -- 172.21.15.132:0/221312452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 msgr2=0x5570ff4acc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:31.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/221312452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff4acc40 secure :-1 s=READY pgs=911 cs=0 l=1 rev1=1 crypto rx=0x7f04b8000f60 tx=0x7f04b8017c70 comp rx=0 tx=0).stop 2023-12-20T04:46:31.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04cc9b6740 1 -- 172.21.15.132:0/221312452 shutdown_connections 2023-12-20T04:46:31.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/221312452 >> [v2:172.21.15.187:6832/3732620607,v1:172.21.15.187:6833/3732620607] conn(0x5570ff53f7d0 0x5570ff4903c0 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/221312452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5570ff4b8770 0x5570ff4ad180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04a27fc640 0 client.6720 ms_handle_reset on v2:172.21.15.187:6832/3732620607 2023-12-20T04:46:31.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/221312452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5570ff4b8390 0x5570ff4acc40 unknown :-1 s=CLOSED pgs=911 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04cc9b6740 1 --2- 172.21.15.132:0/221312452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5570ff4b79d0 0x5570ff53e9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04cc9b6740 1 -- 172.21.15.132:0/221312452 >> 172.21.15.132:0/221312452 conn(0x5570ff48ba60 msgr2=0x5570ff4ce7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:31.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04cc9b6740 1 -- 172.21.15.132:0/221312452 shutdown_connections 2023-12-20T04:46:31.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04cc9b6740 1 -- 172.21.15.132:0/221312452 wait complete. 2023-12-20T04:46:31.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04cc9b6740 20 client.6720 trim_cache size 0 max 16384 2023-12-20T04:46:31.362 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:46:31.363 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:46:31.363 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-12-20T04:46:31.363 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 6552, 2023-12-20T04:46:31.363 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-12-20T04:46:31.363 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-12-20T04:46:31.363 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-12-20T04:46:31.363 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 8.8913451370000001, 2023-12-20T04:46:31.363 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 32, 2023-12-20T04:46:31.363 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 82, 2023-12-20T04:46:31.363 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 82, 2023-12-20T04:46:31.363 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 13.101020905 2023-12-20T04:46:31.363 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:46:31.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04c9e4d640 1 -- 172.21.15.132:0/1582819614 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f04b006a430 msgr2=0x7f04b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:31.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04c9e4d640 1 --2- 172.21.15.132:0/1582819614 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f04b006a430 0x7f04b006c8f0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f04b4036000 tx=0x7f04b4008030 comp rx=0 tx=0).stop 2023-12-20T04:46:31.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04c9e4d640 1 -- 172.21.15.132:0/1582819614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04c415d2c0 msgr2=0x7f04c41f1b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:31.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04c9e4d640 1 --2- 172.21.15.132:0/1582819614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04c415d2c0 0x7f04c41f1b10 secure :-1 s=READY pgs=907 cs=0 l=1 rev1=1 crypto rx=0x7f04bc00cd70 tx=0x7f04bc00a660 comp rx=0 tx=0).stop 2023-12-20T04:46:31.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04c9e4d640 1 -- 172.21.15.132:0/1582819614 shutdown_connections 2023-12-20T04:46:31.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04c9e4d640 1 --2- 172.21.15.132:0/1582819614 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f04b006a430 0x7f04b006c8f0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.352+0000 7f04c9e4d640 1 --2- 172.21.15.132:0/1582819614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f04c415d2c0 0x7f04c41f1b10 unknown :-1 s=CLOSED pgs=907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.353+0000 7f04c9e4d640 1 --2- 172.21.15.132:0/1582819614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f04c40d30a0 0x7f04c4148e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.353+0000 7f04c9e4d640 1 --2- 172.21.15.132:0/1582819614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f04c40d0060 0x7f04c4148900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.353+0000 7f04c9e4d640 1 -- 172.21.15.132:0/1582819614 >> 172.21.15.132:0/1582819614 conn(0x7f04c4072e40 msgr2=0x7f04c40b40b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:31.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.353+0000 7f04c9e4d640 1 -- 172.21.15.132:0/1582819614 shutdown_connections 2023-12-20T04:46:31.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.353+0000 7f04c9e4d640 1 -- 172.21.15.132:0/1582819614 wait complete. 2023-12-20T04:46:31.369 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:46:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.467+0000 7fd05a369640 1 Processor -- start 2023-12-20T04:46:31.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.467+0000 7fd05a369640 1 -- start start 2023-12-20T04:46:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.468+0000 7fd05a369640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd0540b4980 0x7fd0540b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.468+0000 7fd05a369640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0540d1aa0 0x7fd0540d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.468+0000 7fd05a369640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd0540b5320 con 0x7fd054160450 2023-12-20T04:46:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.468+0000 7fd05a369640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd0540b5ec0 con 0x7fd0540b4980 2023-12-20T04:46:31.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.468+0000 7fd05a369640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0541617e0 con 0x7fd0540d1aa0 2023-12-20T04:46:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.468+0000 7fd058906640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0540d1aa0 0x7fd0540d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.468+0000 7fd0537fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd0540b4980 0x7fd0540b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.468+0000 7fd058906640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0540d1aa0 0x7fd0540d1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:44828/0 (socket says 172.21.15.132:44828) 2023-12-20T04:46:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.468+0000 7fd058906640 1 -- 172.21.15.132:0/3050907048 learned_addr learned my addr 172.21.15.132:0/3050907048 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.468+0000 7fd053fff640 1 --1- 172.21.15.132:0/3050907048 >> v1:172.21.15.187:6789/0 conn(0x7fd054160450 0x7fd054160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:35902/0 (socket says 172.21.15.132:35902) 2023-12-20T04:46:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.468+0000 7fd0537fe640 1 -- 172.21.15.132:0/3050907048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0540d1aa0 msgr2=0x7fd0540d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.468+0000 7fd0537fe640 1 --2- 172.21.15.132:0/3050907048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0540d1aa0 0x7fd0540d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.468+0000 7fd0537fe640 1 -- 172.21.15.132:0/3050907048 >> v1:172.21.15.187:6789/0 conn(0x7fd054160450 legacy=0x7fd054160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.468+0000 7fd0537fe640 1 -- 172.21.15.132:0/3050907048 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0540d0fc0 con 0x7fd0540b4980 2023-12-20T04:46:31.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.468+0000 7fd058906640 1 --2- 172.21.15.132:0/3050907048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0540d1aa0 0x7fd0540d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:46:31.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.469+0000 7fd0537fe640 1 --2- 172.21.15.132:0/3050907048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0540b4980 0x7fd0540b4de0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd0480097a0 tx=0x7fd04802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e8cb33f3c6565fcf server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:31.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.469+0000 7fd052ffd640 1 -- 172.21.15.132:0/3050907048 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd048030610 con 0x7fd0540b4980 2023-12-20T04:46:31.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.469+0000 7fd052ffd640 1 -- 172.21.15.132:0/3050907048 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd048030770 con 0x7fd0540b4980 2023-12-20T04:46:31.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.469+0000 7fd052ffd640 1 -- 172.21.15.132:0/3050907048 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd048030b00 con 0x7fd0540b4980 2023-12-20T04:46:31.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.470+0000 7fd05a369640 1 -- 172.21.15.132:0/3050907048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0540b4980 msgr2=0x7fd0540b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:31.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.470+0000 7fd05a369640 1 --2- 172.21.15.132:0/3050907048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0540b4980 0x7fd0540b4de0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fd0480097a0 tx=0x7fd04802b960 comp rx=0 tx=0).stop 2023-12-20T04:46:31.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.470+0000 7fd05a369640 1 -- 172.21.15.132:0/3050907048 shutdown_connections 2023-12-20T04:46:31.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.470+0000 7fd05a369640 1 --2- 172.21.15.132:0/3050907048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0540d1aa0 0x7fd0540d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.470+0000 7fd05a369640 1 --2- 172.21.15.132:0/3050907048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0540b4980 0x7fd0540b4de0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.470+0000 7fd05a369640 1 -- 172.21.15.132:0/3050907048 >> 172.21.15.132:0/3050907048 conn(0x7fd0540cf980 msgr2=0x7fd0540cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:31.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.470+0000 7fd05a369640 1 -- 172.21.15.132:0/3050907048 shutdown_connections 2023-12-20T04:46:31.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.470+0000 7fd05a369640 1 -- 172.21.15.132:0/3050907048 wait complete. 2023-12-20T04:46:31.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.471+0000 7fd05a369640 1 Processor -- start 2023-12-20T04:46:31.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.471+0000 7fd05a369640 1 -- start start 2023-12-20T04:46:31.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.472+0000 7fd05a369640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0540b4980 0x7fd0540c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.472+0000 7fd05a369640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0540d1aa0 0x7fd054152320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.472+0000 7fd05a369640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd054160450 0x7fd054158980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.472+0000 7fd05a369640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0540cd280 con 0x7fd054160450 2023-12-20T04:46:31.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.472+0000 7fd05a369640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd0540ca660 con 0x7fd0540d1aa0 2023-12-20T04:46:31.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.472+0000 7fd05a369640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0540ca940 con 0x7fd0540b4980 2023-12-20T04:46:31.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.472+0000 7fd058906640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd054160450 0x7fd054158980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.472+0000 7fd058906640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd054160450 0x7fd054158980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59624/0 (socket says 172.21.15.132:59624) 2023-12-20T04:46:31.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.472+0000 7fd058906640 1 -- 172.21.15.132:0/934336819 learned_addr learned my addr 172.21.15.132:0/934336819 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:31.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.472+0000 7fd053fff640 1 --2- 172.21.15.132:0/934336819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0540b4980 0x7fd0540c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.472+0000 7fd0537fe640 1 --2- 172.21.15.132:0/934336819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0540d1aa0 0x7fd054152320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.472+0000 7fd058906640 1 -- 172.21.15.132:0/934336819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0540b4980 msgr2=0x7fd0540c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:31.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.472+0000 7fd058906640 1 --2- 172.21.15.132:0/934336819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0540b4980 0x7fd0540c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.472+0000 7fd058906640 1 -- 172.21.15.132:0/934336819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0540d1aa0 msgr2=0x7fd054152320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:31.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.472+0000 7fd058906640 1 --2- 172.21.15.132:0/934336819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0540d1aa0 0x7fd054152320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.472+0000 7fd058906640 1 -- 172.21.15.132:0/934336819 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c009b30 con 0x7fd054160450 2023-12-20T04:46:31.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.473+0000 7fd058906640 1 --2- 172.21.15.132:0/934336819 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd054160450 0x7fd054158980 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00efc0 tx=0x7fd04c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:31.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.473+0000 7fd050ff9640 1 -- 172.21.15.132:0/934336819 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c018070 con 0x7fd054160450 2023-12-20T04:46:31.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.473+0000 7fd050ff9640 1 -- 172.21.15.132:0/934336819 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04c00f040 con 0x7fd054160450 2023-12-20T04:46:31.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.473+0000 7fd050ff9640 1 -- 172.21.15.132:0/934336819 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04c00ce00 con 0x7fd054160450 2023-12-20T04:46:31.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.473+0000 7fd05a369640 1 -- 172.21.15.132:0/934336819 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd048009400 con 0x7fd054160450 2023-12-20T04:46:31.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.473+0000 7fd05a369640 1 -- 172.21.15.132:0/934336819 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0540caf00 con 0x7fd054160450 2023-12-20T04:46:31.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.474+0000 7fd05a369640 1 -- 172.21.15.132:0/934336819 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd05404e840 con 0x7fd054160450 2023-12-20T04:46:31.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.474+0000 7fd050ff9640 1 -- 172.21.15.132:0/934336819 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd04c014480 con 0x7fd054160450 2023-12-20T04:46:31.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.475+0000 7fd050ff9640 1 --2- 172.21.15.132:0/934336819 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd04006a460 0x7fd04006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:31.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.475+0000 7fd053fff640 1 --2- 172.21.15.132:0/934336819 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd04006a460 0x7fd04006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:31.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.475+0000 7fd050ff9640 1 -- 172.21.15.132:0/934336819 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd04c088be0 con 0x7fd054160450 2023-12-20T04:46:31.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.475+0000 7fd053fff640 1 --2- 172.21.15.132:0/934336819 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd04006a460 0x7fd04006c920 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd044000f60 tx=0x7fd044007c20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:31.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.479+0000 7fd050ff9640 1 -- 172.21.15.132:0/934336819 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd04c054260 con 0x7fd054160450 2023-12-20T04:46:31.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.681+0000 7fd05a369640 1 -- 172.21.15.132:0/934336819 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd0540d0ad0 con 0x7fd054160450 2023-12-20T04:46:31.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.681+0000 7fd050ff9640 1 -- 172.21.15.132:0/934336819 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd04c057880 con 0x7fd054160450 2023-12-20T04:46:31.683 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:46:31.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.683+0000 7fd05a369640 1 -- 172.21.15.132:0/934336819 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd04006a460 msgr2=0x7fd04006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:31.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.683+0000 7fd05a369640 1 --2- 172.21.15.132:0/934336819 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd04006a460 0x7fd04006c920 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7fd044000f60 tx=0x7fd044007c20 comp rx=0 tx=0).stop 2023-12-20T04:46:31.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.683+0000 7fd05a369640 1 -- 172.21.15.132:0/934336819 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd054160450 msgr2=0x7fd054158980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:31.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.683+0000 7fd05a369640 1 --2- 172.21.15.132:0/934336819 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd054160450 0x7fd054158980 secure :-1 s=READY pgs=912 cs=0 l=1 rev1=1 crypto rx=0x7fd04c00efc0 tx=0x7fd04c00c490 comp rx=0 tx=0).stop 2023-12-20T04:46:31.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.684+0000 7fd05a369640 1 -- 172.21.15.132:0/934336819 shutdown_connections 2023-12-20T04:46:31.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.684+0000 7fd05a369640 1 --2- 172.21.15.132:0/934336819 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd04006a460 0x7fd04006c920 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.684+0000 7fd05a369640 1 --2- 172.21.15.132:0/934336819 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd054160450 0x7fd054158980 unknown :-1 s=CLOSED pgs=912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.684+0000 7fd05a369640 1 --2- 172.21.15.132:0/934336819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd0540d1aa0 0x7fd054152320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.684+0000 7fd05a369640 1 --2- 172.21.15.132:0/934336819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0540b4980 0x7fd0540c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:31.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.684+0000 7fd05a369640 1 -- 172.21.15.132:0/934336819 >> 172.21.15.132:0/934336819 conn(0x7fd0540cf980 msgr2=0x7fd0540b79e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:31.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.684+0000 7fd05a369640 1 -- 172.21.15.132:0/934336819 shutdown_connections 2023-12-20T04:46:31.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:31.684+0000 7fd05a369640 1 -- 172.21.15.132:0/934336819 wait complete. 2023-12-20T04:46:31.696 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:46:31.696 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:46:31.696 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-12-20T04:46:31.696 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-20T04:46:31.697 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-20T04:46:31.697 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:46:31.697 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:46:31.697 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:46:31.697 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:46:31.697 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:31.697 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-12-20T04:46:31.712 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:46:31.712 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:46:31.713 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:46:31.713 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:46:31.713 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-20T04:46:31.713 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:46:31.713 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:46:31.713 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:46:31.713 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-12-20T04:46:31.713 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:46:31.713 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-12-20T04:46:31.713 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-12-20T04:46:31.713 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:46:31.713 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-12-20T04:46:31.713 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:46:31.714 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-12-20T04:46:31.714 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:46:31.714 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42482sec preferred_lft 42482sec 2023-12-20T04:46:31.714 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-12-20T04:46:31.714 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:46:31.714 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:46:31.714 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:46:31.714 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:46:31.714 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:46:31.714 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::60dd:37ff:fe28:558b/64 scope link 2023-12-20T04:46:31.714 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:46:31.714 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:46:31.714 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 86:13:fe:55:4c:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-20T04:46:31.714 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::8413:feff:fe55:4c04/64 scope link 2023-12-20T04:46:31.715 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:46:31.715 INFO:teuthology.orchestra.run.smithi132.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:46:31.715 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-20T04:46:31.715 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::839:72ff:fea7:b332/64 scope link 2023-12-20T04:46:31.715 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:46:31.715 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:31.715 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:46:31.777 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-20T04:46:31.779 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:31.779 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-12-20T04:46:31.835 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-12-20T04:46:31.835 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:46:31.835 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:46:31.835 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:46:31.835 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:46:31.835 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:31.836 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:46:31.836 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:46:31.836 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:46:31.836 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:46:31.836 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:46:31.836 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:46:31.931 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:31.931 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-20T04:46:31.945 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-20T04:46:31.945 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-20T04:46:31.946 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:46:31.946 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:31.946 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-12-20T04:46:32.013 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-20T04:46:32.013 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:46:32.014 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-20T04:46:32.068 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:46:32.069 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:46:32.069 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:46:32.123 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:46:32.191 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:46:32.191 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:46:32.256 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:46:32.257 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:46:32.258 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:32.258 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:46:32.312 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:46:32.312 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-20T04:46:32.355 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:46:32.381 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:46:32.382 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:46:32.440 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:2023-12-20T04:46:32.439+0000 7f95414b7480 -1 init, newargv = 0x55a0701599a0 newargc=15 2023-12-20T04:46:32.440 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[104273]: starting ceph client 2023-12-20T04:46:32.444 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[104273]: starting fuse 2023-12-20T04:46:32.449 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:46:32.451 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:46:32.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:32.451 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:46:32.506 INFO:teuthology.orchestra.run.smithi132.stdout:41 2023-12-20T04:46:32.507 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:46:32.507 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:46:32.507 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:46:32.507 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:46:32.507 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:46:32.507 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:46:32.507 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:46:32.507 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:46:32.507 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:46:32.507 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:46:32.507 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:46:32.507 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:46:32.508 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:46:32.508 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:46:32.508 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:46:32.508 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:46:32.508 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:46:32.508 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:46:32.508 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:46:32.508 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:46:32.508 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:46:32.508 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:46:32.508 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:46:32.508 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:46:32.508 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:46:32.508 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:46:32.508 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:46:32.508 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:46:32.621 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.104273.asok 2023-12-20T04:46:32.808 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.104273.asok 2023-12-20T04:46:32.808 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:32.809 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.104273.asok status 2023-12-20T04:46:32.944 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:46:32.944 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:46:32.944 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:46:32.944 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:46:32.944 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:46:32.945 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:46:32.945 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:46:32.945 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "104273", 2023-12-20T04:46:32.945 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:46:32.945 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:32.945 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2023-12-20T04:46:32.945 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:46:32.945 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 6729, 2023-12-20T04:46:32.945 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:46:32.945 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:46:32.945 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:46:32.945 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 6729 2023-12-20T04:46:32.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:32.946 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:46:32.946 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:46:32.946 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:46:32.946 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3868438039 2023-12-20T04:46:32.946 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:46:32.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:32.946 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:46:32.946 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:46:32.946 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:46:32.946 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3868438039 2023-12-20T04:46:32.946 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:46:32.946 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.6729 192.168.0.1:0/3868438039", 2023-12-20T04:46:32.946 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/3868438039", 2023-12-20T04:46:32.946 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2023-12-20T04:46:32.947 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 32, 2023-12-20T04:46:32.947 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 82, 2023-12-20T04:46:32.947 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:46:32.947 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:46:32.947 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:46:32.947 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:46:32.952 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:32.952 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2023-12-20T04:46:32.953 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-20T04:46:32.967 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2023-12-20T04:46:32.968 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-20T04:46:32.968 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:32.968 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:46:33.036 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:46:33.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.173+0000 7f670cb11640 1 Processor -- start 2023-12-20T04:46:33.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.173+0000 7f670cb11640 1 -- start start 2023-12-20T04:46:33.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.173+0000 7f670cb11640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f670806fd60 0x7f67080cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:33.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.173+0000 7f670cb11640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f67080ca8e0 0x7f67080b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:33.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.173+0000 7f670cb11640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f67080cbba0 con 0x7f67080718e0 2023-12-20T04:46:33.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.173+0000 7f670cb11640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670815b3f0 con 0x7f67080ca8e0 2023-12-20T04:46:33.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.173+0000 7f670cb11640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f670806cde0 con 0x7f670806fd60 2023-12-20T04:46:33.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.174+0000 7f6706d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f67080ca8e0 0x7f67080b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:33.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.174+0000 7f670659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f67080718e0 0x7f6708071cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46222/0 (socket says 172.21.15.132:46222) 2023-12-20T04:46:33.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.174+0000 7f670659c640 1 -- 172.21.15.132:0/1947103785 learned_addr learned my addr 172.21.15.132:0/1947103785 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:33.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.174+0000 7f6705d9b640 1 --2- 172.21.15.132:0/1947103785 >> v2:172.21.15.187:3300/0 conn(0x7f670806fd60 0x7f67080cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:33.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.174+0000 7f6706d9d640 1 -- 172.21.15.132:0/1947103785 >> v2:172.21.15.187:3300/0 conn(0x7f670806fd60 msgr2=0x7f67080cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:33.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.174+0000 7f6706d9d640 1 --2- 172.21.15.132:0/1947103785 >> v2:172.21.15.187:3300/0 conn(0x7f670806fd60 0x7f67080cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:33.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.174+0000 7f6706d9d640 1 -- 172.21.15.132:0/1947103785 >> v1:172.21.15.132:6789/0 conn(0x7f67080718e0 legacy=0x7f6708071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:33.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.174+0000 7f670559a640 1 -- 172.21.15.132:0/1947103785 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1958766183 0 0) 0x7f66f8001490 con 0x7f67080718e0 2023-12-20T04:46:33.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.174+0000 7f6706d9d640 1 -- 172.21.15.132:0/1947103785 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67080c9b20 con 0x7f67080ca8e0 2023-12-20T04:46:33.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.175+0000 7f6706d9d640 1 --2- 172.21.15.132:0/1947103785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67080ca8e0 0x7f67080b2180 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f67080b0db0 tx=0x7f670002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd34642440671371 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:33.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.175+0000 7f670559a640 1 -- 172.21.15.132:0/1947103785 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f670002e070 con 0x7f67080ca8e0 2023-12-20T04:46:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.175+0000 7f670559a640 1 -- 172.21.15.132:0/1947103785 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f67000315a0 con 0x7f67080ca8e0 2023-12-20T04:46:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.175+0000 7f670559a640 1 -- 172.21.15.132:0/1947103785 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6700031930 con 0x7f67080ca8e0 2023-12-20T04:46:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.175+0000 7f670cb11640 1 -- 172.21.15.132:0/1947103785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67080ca8e0 msgr2=0x7f67080b2180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.175+0000 7f670cb11640 1 --2- 172.21.15.132:0/1947103785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67080ca8e0 0x7f67080b2180 secure :-1 s=READY pgs=917 cs=0 l=1 rev1=1 crypto rx=0x7f67080b0db0 tx=0x7f670002b840 comp rx=0 tx=0).stop 2023-12-20T04:46:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.175+0000 7f670cb11640 1 -- 172.21.15.132:0/1947103785 shutdown_connections 2023-12-20T04:46:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.175+0000 7f670cb11640 1 --2- 172.21.15.132:0/1947103785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f67080ca8e0 0x7f67080b2180 unknown :-1 s=CLOSED pgs=917 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.175+0000 7f670cb11640 1 --2- 172.21.15.132:0/1947103785 >> v2:172.21.15.187:3300/0 conn(0x7f670806fd60 0x7f67080cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.175+0000 7f670cb11640 1 -- 172.21.15.132:0/1947103785 >> 172.21.15.132:0/1947103785 conn(0x7f67080cf330 msgr2=0x7f67080cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.175+0000 7f670cb11640 1 -- 172.21.15.132:0/1947103785 shutdown_connections 2023-12-20T04:46:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.175+0000 7f670cb11640 1 -- 172.21.15.132:0/1947103785 wait complete. 2023-12-20T04:46:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.177+0000 7f670cb11640 1 Processor -- start 2023-12-20T04:46:33.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.177+0000 7f670cb11640 1 -- start start 2023-12-20T04:46:33.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.177+0000 7f670cb11640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f670806fd60 0x7f67081f3aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:33.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.177+0000 7f670cb11640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67080718e0 0x7f6708154ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:33.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.177+0000 7f670cb11640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67080ca8e0 0x7f6708158af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:33.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.177+0000 7f670cb11640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67081f12d0 con 0x7f670806fd60 2023-12-20T04:46:33.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.177+0000 7f670cb11640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67081f0650 con 0x7f67080718e0 2023-12-20T04:46:33.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.177+0000 7f670cb11640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f67081f0930 con 0x7f67080ca8e0 2023-12-20T04:46:33.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.178+0000 7f670659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f670806fd60 0x7f67081f3aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:33.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.178+0000 7f670659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f670806fd60 0x7f67081f3aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59642/0 (socket says 172.21.15.132:59642) 2023-12-20T04:46:33.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.178+0000 7f670659c640 1 -- 172.21.15.132:0/1170975027 learned_addr learned my addr 172.21.15.132:0/1170975027 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:33.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.178+0000 7f6705d9b640 1 --2- 172.21.15.132:0/1170975027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67080718e0 0x7f6708154ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:33.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.178+0000 7f6706d9d640 1 --2- 172.21.15.132:0/1170975027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67080ca8e0 0x7f6708158af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:33.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.178+0000 7f670659c640 1 -- 172.21.15.132:0/1170975027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67080ca8e0 msgr2=0x7f6708158af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:33.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.178+0000 7f670659c640 1 --2- 172.21.15.132:0/1170975027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67080ca8e0 0x7f6708158af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:33.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.178+0000 7f670659c640 1 -- 172.21.15.132:0/1170975027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67080718e0 msgr2=0x7f6708154ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:33.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.178+0000 7f670659c640 1 --2- 172.21.15.132:0/1170975027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67080718e0 0x7f6708154ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:33.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.178+0000 7f670659c640 1 -- 172.21.15.132:0/1170975027 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6700009400 con 0x7f670806fd60 2023-12-20T04:46:33.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.178+0000 7f6706d9d640 1 --2- 172.21.15.132:0/1170975027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67080ca8e0 0x7f6708158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:33.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.178+0000 7f670659c640 1 --2- 172.21.15.132:0/1170975027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f670806fd60 0x7f67081f3aa0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f66f800c890 tx=0x7f66f800cd50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:33.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.178+0000 7f66f6ffd640 1 -- 172.21.15.132:0/1170975027 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f800a640 con 0x7f670806fd60 2023-12-20T04:46:33.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.178+0000 7f66f6ffd640 1 -- 172.21.15.132:0/1170975027 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f66f800a7a0 con 0x7f670806fd60 2023-12-20T04:46:33.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.178+0000 7f670cb11640 1 -- 172.21.15.132:0/1170975027 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67081f0c10 con 0x7f670806fd60 2023-12-20T04:46:33.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.178+0000 7f66f6ffd640 1 -- 172.21.15.132:0/1170975027 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f66f800ab30 con 0x7f670806fd60 2023-12-20T04:46:33.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.178+0000 7f670cb11640 1 -- 172.21.15.132:0/1170975027 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6708159030 con 0x7f670806fd60 2023-12-20T04:46:33.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.179+0000 7f670cb11640 1 -- 172.21.15.132:0/1170975027 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f670804e840 con 0x7f670806fd60 2023-12-20T04:46:33.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.180+0000 7f66f6ffd640 1 -- 172.21.15.132:0/1170975027 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f66f800ac90 con 0x7f670806fd60 2023-12-20T04:46:33.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.180+0000 7f66f6ffd640 1 --2- 172.21.15.132:0/1170975027 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f66e806a430 0x7f66e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:33.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.180+0000 7f66f6ffd640 1 -- 172.21.15.132:0/1170975027 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66f8087f70 con 0x7f670806fd60 2023-12-20T04:46:33.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.180+0000 7f6705d9b640 1 --2- 172.21.15.132:0/1170975027 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f66e806a430 0x7f66e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:33.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.181+0000 7f6705d9b640 1 --2- 172.21.15.132:0/1170975027 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f66e806a430 0x7f66e806c8f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f67080b3b70 tx=0x7f66fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:33.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.184+0000 7f66f6ffd640 1 -- 172.21.15.132:0/1170975027 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f66f80baca0 con 0x7f670806fd60 2023-12-20T04:46:33.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.388+0000 7f670cb11640 1 -- 172.21.15.132:0/1170975027 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f67080cbba0 con 0x7f670806fd60 2023-12-20T04:46:33.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.389+0000 7f66f6ffd640 1 -- 172.21.15.132:0/1170975027 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v32) v1 ==== 53+0+73 (secure 0 0 0) 0x7f67080cbba0 con 0x7f670806fd60 2023-12-20T04:46:33.391 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:46:33.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.391+0000 7f670cb11640 1 -- 172.21.15.132:0/1170975027 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f66e806a430 msgr2=0x7f66e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:33.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.391+0000 7f670cb11640 1 --2- 172.21.15.132:0/1170975027 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f66e806a430 0x7f66e806c8f0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f67080b3b70 tx=0x7f66fc008040 comp rx=0 tx=0).stop 2023-12-20T04:46:33.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.391+0000 7f670cb11640 1 -- 172.21.15.132:0/1170975027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f670806fd60 msgr2=0x7f67081f3aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:33.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.391+0000 7f670cb11640 1 --2- 172.21.15.132:0/1170975027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f670806fd60 0x7f67081f3aa0 secure :-1 s=READY pgs=918 cs=0 l=1 rev1=1 crypto rx=0x7f66f800c890 tx=0x7f66f800cd50 comp rx=0 tx=0).stop 2023-12-20T04:46:33.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.391+0000 7f670cb11640 1 -- 172.21.15.132:0/1170975027 shutdown_connections 2023-12-20T04:46:33.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.391+0000 7f670cb11640 1 --2- 172.21.15.132:0/1170975027 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f66e806a430 0x7f66e806c8f0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:33.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.391+0000 7f670cb11640 1 --2- 172.21.15.132:0/1170975027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f67080ca8e0 0x7f6708158af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:33.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.391+0000 7f670cb11640 1 --2- 172.21.15.132:0/1170975027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f67080718e0 0x7f6708154ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:33.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.391+0000 7f670cb11640 1 --2- 172.21.15.132:0/1170975027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f670806fd60 0x7f67081f3aa0 unknown :-1 s=CLOSED pgs=918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:33.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.391+0000 7f670cb11640 1 -- 172.21.15.132:0/1170975027 >> 172.21.15.132:0/1170975027 conn(0x7f67080cf330 msgr2=0x7f67080cacf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:33.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.391+0000 7f670cb11640 1 -- 172.21.15.132:0/1170975027 shutdown_connections 2023-12-20T04:46:33.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:33.391+0000 7f670cb11640 1 -- 172.21.15.132:0/1170975027 wait complete. 2023-12-20T04:46:33.403 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:46:33.403 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:46:33.403 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-12-20T04:46:33.404 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-20T04:46:33.404 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-20T04:46:33.404 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:46:33.404 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:46:33.404 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:46:33.404 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:46:33.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:33.404 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-12-20T04:46:33.423 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:46:33.423 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:46:33.423 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:46:33.424 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:46:33.424 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-20T04:46:33.424 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:46:33.424 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:46:33.424 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:46:33.424 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-12-20T04:46:33.424 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:46:33.424 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:46:33.424 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-12-20T04:46:33.424 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:46:33.424 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:46:33.425 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:46:33.425 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:46:33.425 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:46:33.425 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42492sec preferred_lft 42492sec 2023-12-20T04:46:33.425 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-12-20T04:46:33.425 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:46:33.425 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:46:33.425 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:46:33.425 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:46:33.425 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:46:33.425 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::a8bc:1cff:fe40:54ea/64 scope link 2023-12-20T04:46:33.426 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:46:33.426 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:46:33.426 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-20T04:46:33.426 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c8e:c0ff:fe7a:bdc/64 scope link 2023-12-20T04:46:33.426 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:46:33.426 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:46:33.426 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether be:98:9a:6f:62:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-20T04:46:33.426 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::bc98:9aff:fe6f:6282/64 scope link 2023-12-20T04:46:33.426 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:46:33.427 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:33.427 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:46:33.494 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-12-20T04:46:33.495 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:33.495 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-12-20T04:46:33.553 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-12-20T04:46:33.553 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:46:33.553 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:46:33.553 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:46:33.553 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:46:33.554 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:33.554 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:46:33.554 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:46:33.554 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:46:33.554 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:46:33.554 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:46:33.554 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:46:33.653 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:33.653 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-20T04:46:33.668 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-20T04:46:33.668 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-20T04:46:33.669 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:46:33.669 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:33.669 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2023-12-20T04:46:33.736 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-20T04:46:33.736 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:46:33.736 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-20T04:46:33.791 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:46:33.792 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:46:33.792 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:46:33.846 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:46:33.913 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:46:33.914 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:46:33.979 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:46:33.980 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:46:33.981 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:33.981 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:46:34.036 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:46:34.036 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-20T04:46:34.079 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:46:34.105 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:46:34.105 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:46:34.163 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:2023-12-20T04:46:34.161+0000 7f542083f480 -1 init, newargv = 0x55eae1eb1940 newargc=15 2023-12-20T04:46:34.163 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[88575]: starting ceph client 2023-12-20T04:46:34.167 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[88575]: starting fuse 2023-12-20T04:46:34.173 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:46:34.174 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:46:34.175 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:34.175 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:46:34.230 INFO:teuthology.orchestra.run.smithi187.stdout:41 2023-12-20T04:46:34.230 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:46:34.230 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:46:34.231 DEBUG:teuthology.orchestra.run.smithi187:> import glob 2023-12-20T04:46:34.231 DEBUG:teuthology.orchestra.run.smithi187:> import re 2023-12-20T04:46:34.231 DEBUG:teuthology.orchestra.run.smithi187:> import os 2023-12-20T04:46:34.231 DEBUG:teuthology.orchestra.run.smithi187:> import subprocess 2023-12-20T04:46:34.231 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:46:34.231 DEBUG:teuthology.orchestra.run.smithi187:> def _find_admin_socket(client_name): 2023-12-20T04:46:34.231 DEBUG:teuthology.orchestra.run.smithi187:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-20T04:46:34.231 DEBUG:teuthology.orchestra.run.smithi187:> files = glob.glob(asok_path) 2023-12-20T04:46:34.231 DEBUG:teuthology.orchestra.run.smithi187:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-20T04:46:34.231 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:46:34.231 DEBUG:teuthology.orchestra.run.smithi187:> # Given a non-glob path, it better be there 2023-12-20T04:46:34.231 DEBUG:teuthology.orchestra.run.smithi187:> if "*" not in asok_path: 2023-12-20T04:46:34.231 DEBUG:teuthology.orchestra.run.smithi187:> assert(len(files) == 1) 2023-12-20T04:46:34.231 DEBUG:teuthology.orchestra.run.smithi187:> return files[0] 2023-12-20T04:46:34.231 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:46:34.232 DEBUG:teuthology.orchestra.run.smithi187:> for f in files: 2023-12-20T04:46:34.232 DEBUG:teuthology.orchestra.run.smithi187:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:46:34.232 DEBUG:teuthology.orchestra.run.smithi187:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:46:34.232 DEBUG:teuthology.orchestra.run.smithi187:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:46:34.232 DEBUG:teuthology.orchestra.run.smithi187:> contents = proc_f.read() 2023-12-20T04:46:34.232 DEBUG:teuthology.orchestra.run.smithi187:> if mountpoint in contents: 2023-12-20T04:46:34.232 DEBUG:teuthology.orchestra.run.smithi187:> return f 2023-12-20T04:46:34.232 DEBUG:teuthology.orchestra.run.smithi187:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:46:34.232 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:46:34.232 DEBUG:teuthology.orchestra.run.smithi187:> print(_find_admin_socket("client.1")) 2023-12-20T04:46:34.232 DEBUG:teuthology.orchestra.run.smithi187:> ' 2023-12-20T04:46:34.346 INFO:teuthology.orchestra.run.smithi187.stdout:/var/run/ceph/ceph-client.1.88575.asok 2023-12-20T04:46:34.533 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.88575.asok 2023-12-20T04:46:34.533 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:34.533 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.88575.asok status 2023-12-20T04:46:34.668 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-12-20T04:46:34.668 INFO:teuthology.orchestra.run.smithi187.stdout: "metadata": { 2023-12-20T04:46:34.668 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:46:34.668 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:46:34.668 INFO:teuthology.orchestra.run.smithi187.stdout: "entity_id": "1", 2023-12-20T04:46:34.668 INFO:teuthology.orchestra.run.smithi187.stdout: "hostname": "smithi187", 2023-12-20T04:46:34.668 INFO:teuthology.orchestra.run.smithi187.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-20T04:46:34.668 INFO:teuthology.orchestra.run.smithi187.stdout: "pid": "88575", 2023-12-20T04:46:34.668 INFO:teuthology.orchestra.run.smithi187.stdout: "root": "/" 2023-12-20T04:46:34.668 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:46:34.669 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_count": 0, 2023-12-20T04:46:34.669 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_pinned_count": 0, 2023-12-20T04:46:34.669 INFO:teuthology.orchestra.run.smithi187.stdout: "id": 6004, 2023-12-20T04:46:34.669 INFO:teuthology.orchestra.run.smithi187.stdout: "inst": { 2023-12-20T04:46:34.669 INFO:teuthology.orchestra.run.smithi187.stdout: "name": { 2023-12-20T04:46:34.669 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "client", 2023-12-20T04:46:34.669 INFO:teuthology.orchestra.run.smithi187.stdout: "num": 6004 2023-12-20T04:46:34.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:46:34.669 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:46:34.669 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:46:34.669 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:46:34.669 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 1092692931 2023-12-20T04:46:34.669 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-12-20T04:46:34.669 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:46:34.669 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:46:34.670 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:46:34.670 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:46:34.670 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 1092692931 2023-12-20T04:46:34.670 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:46:34.670 INFO:teuthology.orchestra.run.smithi187.stdout: "inst_str": "client.6004 192.168.0.1:0/1092692931", 2023-12-20T04:46:34.670 INFO:teuthology.orchestra.run.smithi187.stdout: "addr_str": "192.168.0.1:0/1092692931", 2023-12-20T04:46:34.670 INFO:teuthology.orchestra.run.smithi187.stdout: "inode_count": 1, 2023-12-20T04:46:34.670 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_epoch": 32, 2023-12-20T04:46:34.670 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch": 82, 2023-12-20T04:46:34.670 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:46:34.670 INFO:teuthology.orchestra.run.smithi187.stdout: "blocklisted": false, 2023-12-20T04:46:34.670 INFO:teuthology.orchestra.run.smithi187.stdout: "fs_name": "cephfs" 2023-12-20T04:46:34.670 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-12-20T04:46:34.676 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:34.676 DEBUG:teuthology.orchestra.run.smithi187:> stat --file-system '--printf=%T 2023-12-20T04:46:34.676 DEBUG:teuthology.orchestra.run.smithi187:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-20T04:46:34.691 INFO:teuthology.orchestra.run.smithi187.stdout:fuseblk 2023-12-20T04:46:34.692 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-20T04:46:34.692 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:34.692 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:46:34.758 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:46:34.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.869+0000 7ff5e702c640 1 Processor -- start 2023-12-20T04:46:34.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.870+0000 7ff5e702c640 1 -- start start 2023-12-20T04:46:34.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.870+0000 7ff5e702c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff5e0160450 0x7ff5e0160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:34.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.870+0000 7ff5e702c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff5e00b5090 0x7ff5e00d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:34.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.870+0000 7ff5e702c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff5e00b5ec0 con 0x7ff5e01611b0 2023-12-20T04:46:34.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.870+0000 7ff5e702c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e01617e0 con 0x7ff5e00b5090 2023-12-20T04:46:34.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.870+0000 7ff5e702c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff5e00d0fc0 con 0x7ff5e0160450 2023-12-20T04:46:34.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.870+0000 7ff5e55c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff5e00b5090 0x7ff5e00d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:34.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.870+0000 7ff5e55c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff5e00b5090 0x7ff5e00d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59654/0 (socket says 172.21.15.132:59654) 2023-12-20T04:46:34.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.870+0000 7ff5e55c9640 1 -- 172.21.15.132:0/128388403 learned_addr learned my addr 172.21.15.132:0/128388403 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:34.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.871+0000 7ff5e4dc8640 1 --2- 172.21.15.132:0/128388403 >> v2:172.21.15.187:3300/0 conn(0x7ff5e0160450 0x7ff5e0160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:34.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.871+0000 7ff5e55c9640 1 -- 172.21.15.132:0/128388403 >> v2:172.21.15.187:3300/0 conn(0x7ff5e0160450 msgr2=0x7ff5e0160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:34.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.871+0000 7ff5e55c9640 1 --2- 172.21.15.132:0/128388403 >> v2:172.21.15.187:3300/0 conn(0x7ff5e0160450 0x7ff5e0160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:34.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.871+0000 7ff5e55c9640 1 -- 172.21.15.132:0/128388403 >> v1:172.21.15.187:6789/0 conn(0x7ff5e01611b0 legacy=0x7ff5e00b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:34.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.871+0000 7ff5e55c9640 1 -- 172.21.15.132:0/128388403 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5e00d12a0 con 0x7ff5e00b5090 2023-12-20T04:46:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.872+0000 7ff5e55c9640 1 --2- 172.21.15.132:0/128388403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5e00b5090 0x7ff5e00d1aa0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7ff5e008b150 tx=0x7ff5d802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ebb9d099b9789ccd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.872+0000 7ff5df7fe640 1 -- 172.21.15.132:0/128388403 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d802cbb0 con 0x7ff5e00b5090 2023-12-20T04:46:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.872+0000 7ff5df7fe640 1 -- 172.21.15.132:0/128388403 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d802cd10 con 0x7ff5e00b5090 2023-12-20T04:46:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.872+0000 7ff5df7fe640 1 -- 172.21.15.132:0/128388403 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d8034610 con 0x7ff5e00b5090 2023-12-20T04:46:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.872+0000 7ff5e702c640 1 -- 172.21.15.132:0/128388403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5e00b5090 msgr2=0x7ff5e00d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.872+0000 7ff5e702c640 1 --2- 172.21.15.132:0/128388403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5e00b5090 0x7ff5e00d1aa0 secure :-1 s=READY pgs=919 cs=0 l=1 rev1=1 crypto rx=0x7ff5e008b150 tx=0x7ff5d802c010 comp rx=0 tx=0).stop 2023-12-20T04:46:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.872+0000 7ff5e702c640 1 -- 172.21.15.132:0/128388403 shutdown_connections 2023-12-20T04:46:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.872+0000 7ff5e702c640 1 --2- 172.21.15.132:0/128388403 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5e00b5090 0x7ff5e00d1aa0 unknown :-1 s=CLOSED pgs=919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.872+0000 7ff5e702c640 1 --2- 172.21.15.132:0/128388403 >> v2:172.21.15.187:3300/0 conn(0x7ff5e0160450 0x7ff5e0160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.872+0000 7ff5e702c640 1 -- 172.21.15.132:0/128388403 >> 172.21.15.132:0/128388403 conn(0x7ff5e00cf980 msgr2=0x7ff5e00cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.872+0000 7ff5e702c640 1 -- 172.21.15.132:0/128388403 shutdown_connections 2023-12-20T04:46:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.872+0000 7ff5e702c640 1 -- 172.21.15.132:0/128388403 wait complete. 2023-12-20T04:46:34.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.873+0000 7ff5e702c640 1 Processor -- start 2023-12-20T04:46:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.874+0000 7ff5e702c640 1 -- start start 2023-12-20T04:46:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.874+0000 7ff5e702c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5e00b5090 0x7ff5e01571e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.874+0000 7ff5e702c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5e0160450 0x7ff5e01f63d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.874+0000 7ff5e702c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5e01611b0 0x7ff5e0151ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.874+0000 7ff5e702c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e01582d0 con 0x7ff5e0160450 2023-12-20T04:46:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.874+0000 7ff5e702c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0157a30 con 0x7ff5e00b5090 2023-12-20T04:46:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.874+0000 7ff5e702c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff5e0157d10 con 0x7ff5e01611b0 2023-12-20T04:46:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.875+0000 7ff5dffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5e0160450 0x7ff5e01f63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.875+0000 7ff5e4dc8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5e00b5090 0x7ff5e01571e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.875+0000 7ff5dffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5e0160450 0x7ff5e01f63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59656/0 (socket says 172.21.15.132:59656) 2023-12-20T04:46:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.875+0000 7ff5dffff640 1 -- 172.21.15.132:0/3992849531 learned_addr learned my addr 172.21.15.132:0/3992849531 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.875+0000 7ff5e4dc8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5e00b5090 0x7ff5e01571e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:56130/0 (socket says 172.21.15.132:56130) 2023-12-20T04:46:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.875+0000 7ff5e55c9640 1 --2- 172.21.15.132:0/3992849531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5e01611b0 0x7ff5e0151ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.875+0000 7ff5dffff640 1 -- 172.21.15.132:0/3992849531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5e01611b0 msgr2=0x7ff5e0151ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.875+0000 7ff5dffff640 1 --2- 172.21.15.132:0/3992849531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5e01611b0 0x7ff5e0151ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.875+0000 7ff5dffff640 1 -- 172.21.15.132:0/3992849531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5e00b5090 msgr2=0x7ff5e01571e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.875+0000 7ff5dffff640 1 --2- 172.21.15.132:0/3992849531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5e00b5090 0x7ff5e01571e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.875+0000 7ff5dffff640 1 -- 172.21.15.132:0/3992849531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff5d8009b30 con 0x7ff5e0160450 2023-12-20T04:46:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.875+0000 7ff5dffff640 1 --2- 172.21.15.132:0/3992849531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5e0160450 0x7ff5e01f63d0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400c400 tx=0x7ff5d400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.875+0000 7ff5dd7fa640 1 -- 172.21.15.132:0/3992849531 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d40052d0 con 0x7ff5e0160450 2023-12-20T04:46:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.875+0000 7ff5dd7fa640 1 -- 172.21.15.132:0/3992849531 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff5d4005430 con 0x7ff5e0160450 2023-12-20T04:46:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.875+0000 7ff5e702c640 1 -- 172.21.15.132:0/3992849531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff5e0157ff0 con 0x7ff5e0160450 2023-12-20T04:46:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.875+0000 7ff5dd7fa640 1 -- 172.21.15.132:0/3992849531 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff5d4003830 con 0x7ff5e0160450 2023-12-20T04:46:34.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.875+0000 7ff5e702c640 1 -- 172.21.15.132:0/3992849531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff5e0157720 con 0x7ff5e0160450 2023-12-20T04:46:34.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.876+0000 7ff5e702c640 1 -- 172.21.15.132:0/3992849531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff5e00ca340 con 0x7ff5e0160450 2023-12-20T04:46:34.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.877+0000 7ff5dd7fa640 1 -- 172.21.15.132:0/3992849531 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff5d4003990 con 0x7ff5e0160450 2023-12-20T04:46:34.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.877+0000 7ff5dd7fa640 1 --2- 172.21.15.132:0/3992849531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff5cc06a430 0x7ff5cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:34.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.877+0000 7ff5dd7fa640 1 -- 172.21.15.132:0/3992849531 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff5d4087d80 con 0x7ff5e0160450 2023-12-20T04:46:34.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.877+0000 7ff5e4dc8640 1 --2- 172.21.15.132:0/3992849531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff5cc06a430 0x7ff5cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:34.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.878+0000 7ff5e4dc8640 1 --2- 172.21.15.132:0/3992849531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff5cc06a430 0x7ff5cc06c8f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0006fd0 tx=0x7ff5d0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:34.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:34.882+0000 7ff5dd7fa640 1 -- 172.21.15.132:0/3992849531 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff5e00ca340 con 0x7ff5e0160450 2023-12-20T04:46:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:35.083+0000 7ff5e702c640 1 -- 172.21.15.132:0/3992849531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff5e00ca340 con 0x7ff5e0160450 2023-12-20T04:46:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:35.084+0000 7ff5dd7fa640 1 -- 172.21.15.132:0/3992849531 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4717 (secure 0 0 0) 0x7ff5e00ca340 con 0x7ff5e0160450 2023-12-20T04:46:35.086 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:35.086 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":32,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2337953767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2337953767},{"type":"v1","addr":"172.21.15.187:6835","nonce":2337953767}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6540,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/41640576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":41640576},{"type":"v1","addr":"172.21.15.132:6836","nonce":41640576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6543,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2936157584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2936157584},{"type":"v1","addr":"172.21.15.132:6837","nonce":2936157584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:46:22.459815+0000","modified":"2023-12-20T04:46:24.470923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6552":{"gid":6552,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6833/3732620607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3732620607},{"type":"v1","addr":"172.21.15.187:6833","nonce":3732620607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-20T04:46:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 32 2023-12-20T04:46:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:35.086+0000 7ff5e702c640 1 -- 172.21.15.132:0/3992849531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff5cc06a430 msgr2=0x7ff5cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:35.086+0000 7ff5e702c640 1 --2- 172.21.15.132:0/3992849531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff5cc06a430 0x7ff5cc06c8f0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7ff5d0006fd0 tx=0x7ff5d0008040 comp rx=0 tx=0).stop 2023-12-20T04:46:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:35.086+0000 7ff5e702c640 1 -- 172.21.15.132:0/3992849531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5e0160450 msgr2=0x7ff5e01f63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:35.086+0000 7ff5e702c640 1 --2- 172.21.15.132:0/3992849531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5e0160450 0x7ff5e01f63d0 secure :-1 s=READY pgs=920 cs=0 l=1 rev1=1 crypto rx=0x7ff5d400c400 tx=0x7ff5d400c8c0 comp rx=0 tx=0).stop 2023-12-20T04:46:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:35.086+0000 7ff5e702c640 1 -- 172.21.15.132:0/3992849531 shutdown_connections 2023-12-20T04:46:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:35.086+0000 7ff5e702c640 1 --2- 172.21.15.132:0/3992849531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff5cc06a430 0x7ff5cc06c8f0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:35.086+0000 7ff5e702c640 1 --2- 172.21.15.132:0/3992849531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff5e01611b0 0x7ff5e0151ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:35.086+0000 7ff5e702c640 1 --2- 172.21.15.132:0/3992849531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff5e0160450 0x7ff5e01f63d0 unknown :-1 s=CLOSED pgs=920 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:35.086+0000 7ff5e702c640 1 --2- 172.21.15.132:0/3992849531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff5e00b5090 0x7ff5e01571e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:35.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:35.086+0000 7ff5e702c640 1 -- 172.21.15.132:0/3992849531 >> 172.21.15.132:0/3992849531 conn(0x7ff5e00cf980 msgr2=0x7ff5e015cfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:35.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:35.086+0000 7ff5e702c640 1 -- 172.21.15.132:0/3992849531 shutdown_connections 2023-12-20T04:46:35.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:35.086+0000 7ff5e702c640 1 -- 172.21.15.132:0/3992849531 wait complete. 2023-12-20T04:46:35.099 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-20T04:46:35.215 INFO:teuthology.orchestra.run.smithi187.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":6552,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":12.744027895,"mdsmap_epoch":32,"osdmap_epoch":82,"osdmap_epoch_barrier":82,"uptime":16.953705852999999} 2023-12-20T04:46:35.215 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 6552, "mdsmap_epoch": 32, "osdmap_epoch": 82, "osdmap_epoch_barrier": 82, "rank_uptime": 12.744027895, "state": "up:active", "uptime": 16.953705853, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:46:35.216 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-20T04:46:35.328 INFO:teuthology.orchestra.run.smithi132.stdout:{"osd_mon_report_interval":"5"} 2023-12-20T04:46:35.329 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-20T04:46:35.329 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-20T04:46:35.434 INFO:teuthology.orchestra.run.smithi132.stdout:{"mon_tick_interval":"5"} 2023-12-20T04:46:35.435 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-20T04:46:35.435 INFO:tasks.cephfs.test_full:pool capacity 557053504, 531MB should be enough to fill it 2023-12-20T04:46:35.435 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:46:35.435 DEBUG:teuthology.orchestra.run.smithi132:> import time 2023-12-20T04:46:35.435 DEBUG:teuthology.orchestra.run.smithi132:> import datetime 2023-12-20T04:46:35.435 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:46:35.435 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:46:35.435 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:46:35.435 DEBUG:teuthology.orchestra.run.smithi132:> # Write some buffered data through before going full, all should be well 2023-12-20T04:46:35.436 DEBUG:teuthology.orchestra.run.smithi132:> print("writing some data through which we expect to succeed") 2023-12-20T04:46:35.436 DEBUG:teuthology.orchestra.run.smithi132:> bytes = 0 2023-12-20T04:46:35.436 DEBUG:teuthology.orchestra.run.smithi132:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-20T04:46:35.436 DEBUG:teuthology.orchestra.run.smithi132:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-20T04:46:35.436 DEBUG:teuthology.orchestra.run.smithi132:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-12-20T04:46:35.436 DEBUG:teuthology.orchestra.run.smithi132:> os.fsync(f) 2023-12-20T04:46:35.436 DEBUG:teuthology.orchestra.run.smithi132:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-20T04:46:35.436 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:46:35.436 DEBUG:teuthology.orchestra.run.smithi132:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-20T04:46:35.436 DEBUG:teuthology.orchestra.run.smithi132:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-20T04:46:35.436 DEBUG:teuthology.orchestra.run.smithi132:> # buffered IO, the error should always only appear from fsync and not 2023-12-20T04:46:35.436 DEBUG:teuthology.orchestra.run.smithi132:> # from write 2023-12-20T04:46:35.436 DEBUG:teuthology.orchestra.run.smithi132:> full = False 2023-12-20T04:46:35.436 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:46:35.436 DEBUG:teuthology.orchestra.run.smithi132:> for n in range(0, int(531 * 1.1)): 2023-12-20T04:46:35.436 DEBUG:teuthology.orchestra.run.smithi132:> try: 2023-12-20T04:46:35.437 DEBUG:teuthology.orchestra.run.smithi132:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-20T04:46:35.437 DEBUG:teuthology.orchestra.run.smithi132:> print("wrote bytes via buffered write, moving on to fsync") 2023-12-20T04:46:35.437 DEBUG:teuthology.orchestra.run.smithi132:> except OSError as e: 2023-12-20T04:46:35.437 DEBUG:teuthology.orchestra.run.smithi132:> if True: 2023-12-20T04:46:35.437 DEBUG:teuthology.orchestra.run.smithi132:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-12-20T04:46:35.437 DEBUG:teuthology.orchestra.run.smithi132:> raise 2023-12-20T04:46:35.437 DEBUG:teuthology.orchestra.run.smithi132:> else: 2023-12-20T04:46:35.437 DEBUG:teuthology.orchestra.run.smithi132:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-20T04:46:35.437 DEBUG:teuthology.orchestra.run.smithi132:> full = True 2023-12-20T04:46:35.437 DEBUG:teuthology.orchestra.run.smithi132:> break 2023-12-20T04:46:35.437 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:46:35.437 DEBUG:teuthology.orchestra.run.smithi132:> try: 2023-12-20T04:46:35.437 DEBUG:teuthology.orchestra.run.smithi132:> os.fsync(f) 2023-12-20T04:46:35.437 DEBUG:teuthology.orchestra.run.smithi132:> print("fsync'"'"'ed successfully") 2023-12-20T04:46:35.437 DEBUG:teuthology.orchestra.run.smithi132:> except OSError as e: 2023-12-20T04:46:35.438 DEBUG:teuthology.orchestra.run.smithi132:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-20T04:46:35.438 DEBUG:teuthology.orchestra.run.smithi132:> full = True 2023-12-20T04:46:35.438 DEBUG:teuthology.orchestra.run.smithi132:> break 2023-12-20T04:46:35.438 DEBUG:teuthology.orchestra.run.smithi132:> else: 2023-12-20T04:46:35.438 DEBUG:teuthology.orchestra.run.smithi132:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-20T04:46:35.438 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:46:35.438 DEBUG:teuthology.orchestra.run.smithi132:> if n > 531 * 0.9: 2023-12-20T04:46:35.438 DEBUG:teuthology.orchestra.run.smithi132:> # Be cautious in the last region where we expect to hit 2023-12-20T04:46:35.438 DEBUG:teuthology.orchestra.run.smithi132:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-12-20T04:46:35.438 DEBUG:teuthology.orchestra.run.smithi132:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-20T04:46:35.438 DEBUG:teuthology.orchestra.run.smithi132:> time.sleep(15.0) 2023-12-20T04:46:35.438 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:46:35.438 DEBUG:teuthology.orchestra.run.smithi132:> if not full: 2023-12-20T04:46:35.438 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-12-20T04:46:35.438 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:46:35.439 DEBUG:teuthology.orchestra.run.smithi132:> # close() should not raise an error because we already caught it in 2023-12-20T04:46:35.439 DEBUG:teuthology.orchestra.run.smithi132:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-12-20T04:46:35.439 DEBUG:teuthology.orchestra.run.smithi132:> # since then because all IOs got cancelled on the full flag. 2023-12-20T04:46:35.439 DEBUG:teuthology.orchestra.run.smithi132:> print("calling close") 2023-12-20T04:46:35.439 DEBUG:teuthology.orchestra.run.smithi132:> os.close(f) 2023-12-20T04:46:35.439 DEBUG:teuthology.orchestra.run.smithi132:> print("close() did not raise error") 2023-12-20T04:46:35.439 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:46:35.439 DEBUG:teuthology.orchestra.run.smithi132:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-20T04:46:35.439 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:46:38.591 INFO:teuthology.orchestra.run.smithi132.stdout:writing some data through which we expect to succeed 2023-12-20T04:46:38.591 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-20T04:46:38.591 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.591 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.591 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 1.00 MB 2023-12-20T04:46:38.592 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.592 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.592 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 2.00 MB 2023-12-20T04:46:38.592 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.592 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.592 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 3.00 MB 2023-12-20T04:46:38.592 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.592 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.592 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 4.00 MB 2023-12-20T04:46:38.592 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.592 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.592 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 5.00 MB 2023-12-20T04:46:38.592 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.592 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.593 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 6.00 MB 2023-12-20T04:46:38.593 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.593 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.593 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 7.00 MB 2023-12-20T04:46:38.593 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.593 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.593 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 8.00 MB 2023-12-20T04:46:38.593 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.593 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.593 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 9.00 MB 2023-12-20T04:46:38.593 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.593 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.594 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 10.00 MB 2023-12-20T04:46:38.594 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.594 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.594 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 11.00 MB 2023-12-20T04:46:38.594 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.594 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.594 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 12.00 MB 2023-12-20T04:46:38.594 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.594 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.594 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 13.00 MB 2023-12-20T04:46:38.594 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.594 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.594 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 14.00 MB 2023-12-20T04:46:38.594 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.594 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.595 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 15.00 MB 2023-12-20T04:46:38.595 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.595 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.595 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 16.00 MB 2023-12-20T04:46:38.595 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.595 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.595 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 17.00 MB 2023-12-20T04:46:38.595 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.595 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.595 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 18.00 MB 2023-12-20T04:46:38.595 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.595 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.595 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 19.00 MB 2023-12-20T04:46:38.595 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.596 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.596 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 20.00 MB 2023-12-20T04:46:38.596 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.596 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.596 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 21.00 MB 2023-12-20T04:46:38.596 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.596 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.596 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 22.00 MB 2023-12-20T04:46:38.596 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.596 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.596 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 23.00 MB 2023-12-20T04:46:38.596 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.596 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.596 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 24.00 MB 2023-12-20T04:46:38.596 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.597 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.597 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 25.00 MB 2023-12-20T04:46:38.597 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.597 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.597 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 26.00 MB 2023-12-20T04:46:38.597 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.597 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.597 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 27.00 MB 2023-12-20T04:46:38.597 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.597 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.598 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 28.00 MB 2023-12-20T04:46:38.598 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.598 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.598 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 29.00 MB 2023-12-20T04:46:38.598 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.598 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.598 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 30.00 MB 2023-12-20T04:46:38.598 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.598 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.598 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 31.00 MB 2023-12-20T04:46:38.599 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.599 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.599 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 32.00 MB 2023-12-20T04:46:38.599 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.599 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.599 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 33.00 MB 2023-12-20T04:46:38.599 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.599 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.599 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 34.00 MB 2023-12-20T04:46:38.599 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.599 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.599 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 35.00 MB 2023-12-20T04:46:38.599 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.600 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.600 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 36.00 MB 2023-12-20T04:46:38.600 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.600 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.600 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 37.00 MB 2023-12-20T04:46:38.600 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.600 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.600 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 38.00 MB 2023-12-20T04:46:38.600 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.600 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.600 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 39.00 MB 2023-12-20T04:46:38.600 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.600 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.601 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 40.00 MB 2023-12-20T04:46:38.601 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.601 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.601 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 41.00 MB 2023-12-20T04:46:38.601 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.601 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.601 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 42.00 MB 2023-12-20T04:46:38.601 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.601 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.601 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 43.00 MB 2023-12-20T04:46:38.601 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.601 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.601 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 44.00 MB 2023-12-20T04:46:38.602 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.602 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.602 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 45.00 MB 2023-12-20T04:46:38.602 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.602 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.602 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 46.00 MB 2023-12-20T04:46:38.602 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.602 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.602 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 47.00 MB 2023-12-20T04:46:38.602 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.602 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.602 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 48.00 MB 2023-12-20T04:46:38.603 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.603 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.603 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 49.00 MB 2023-12-20T04:46:38.603 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.603 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.603 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 50.00 MB 2023-12-20T04:46:38.603 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.603 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.603 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 51.00 MB 2023-12-20T04:46:38.603 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.603 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.603 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 52.00 MB 2023-12-20T04:46:38.603 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.603 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.604 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 53.00 MB 2023-12-20T04:46:38.604 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.604 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.604 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 54.00 MB 2023-12-20T04:46:38.604 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.604 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.604 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 55.00 MB 2023-12-20T04:46:38.604 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.604 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.604 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 56.00 MB 2023-12-20T04:46:38.604 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.604 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.604 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 57.00 MB 2023-12-20T04:46:38.604 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.604 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.605 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 58.00 MB 2023-12-20T04:46:38.605 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.605 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.605 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 59.00 MB 2023-12-20T04:46:38.605 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.605 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.605 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 60.00 MB 2023-12-20T04:46:38.605 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.605 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.605 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 61.00 MB 2023-12-20T04:46:38.605 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.605 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.605 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 62.00 MB 2023-12-20T04:46:38.606 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.606 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.606 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 63.00 MB 2023-12-20T04:46:38.606 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.606 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.606 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 64.00 MB 2023-12-20T04:46:38.606 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.606 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.606 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 65.00 MB 2023-12-20T04:46:38.606 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.606 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.606 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 66.00 MB 2023-12-20T04:46:38.606 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.606 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.607 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 67.00 MB 2023-12-20T04:46:38.607 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.607 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.607 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 68.00 MB 2023-12-20T04:46:38.607 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.607 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.607 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 69.00 MB 2023-12-20T04:46:38.607 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.607 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.607 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 70.00 MB 2023-12-20T04:46:38.607 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.608 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.608 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 71.00 MB 2023-12-20T04:46:38.608 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.608 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.608 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 72.00 MB 2023-12-20T04:46:38.608 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.608 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.608 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 73.00 MB 2023-12-20T04:46:38.608 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.609 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.609 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 74.00 MB 2023-12-20T04:46:38.609 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.609 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.609 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 75.00 MB 2023-12-20T04:46:38.609 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.610 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.610 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 76.00 MB 2023-12-20T04:46:38.610 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.610 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.610 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 77.00 MB 2023-12-20T04:46:38.610 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.610 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.611 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 78.00 MB 2023-12-20T04:46:38.611 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.611 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.611 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 79.00 MB 2023-12-20T04:46:38.611 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.611 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.611 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 80.00 MB 2023-12-20T04:46:38.896 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.896 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.896 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 81.00 MB 2023-12-20T04:46:38.896 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.896 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.896 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 82.00 MB 2023-12-20T04:46:38.896 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.897 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.897 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 83.00 MB 2023-12-20T04:46:38.897 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.897 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.897 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 84.00 MB 2023-12-20T04:46:38.897 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.897 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.897 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 85.00 MB 2023-12-20T04:46:38.897 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.897 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.897 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 86.00 MB 2023-12-20T04:46:38.897 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.897 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.897 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 87.00 MB 2023-12-20T04:46:38.897 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.898 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.898 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 88.00 MB 2023-12-20T04:46:38.898 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.898 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.898 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 89.00 MB 2023-12-20T04:46:38.898 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.898 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.898 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 90.00 MB 2023-12-20T04:46:38.898 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.898 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.898 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 91.00 MB 2023-12-20T04:46:38.898 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.898 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.898 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 92.00 MB 2023-12-20T04:46:38.899 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.899 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.899 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 93.00 MB 2023-12-20T04:46:38.899 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.899 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.899 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 94.00 MB 2023-12-20T04:46:38.899 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.899 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.899 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 95.00 MB 2023-12-20T04:46:38.899 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.899 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.899 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 96.00 MB 2023-12-20T04:46:38.899 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.900 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.900 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 97.00 MB 2023-12-20T04:46:38.900 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.900 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.900 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 98.00 MB 2023-12-20T04:46:38.900 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.900 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.900 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 99.00 MB 2023-12-20T04:46:38.900 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.900 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.900 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 100.00 MB 2023-12-20T04:46:38.900 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.900 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.900 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 101.00 MB 2023-12-20T04:46:38.901 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.901 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.901 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 102.00 MB 2023-12-20T04:46:38.901 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.901 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.901 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 103.00 MB 2023-12-20T04:46:38.901 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.901 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.901 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 104.00 MB 2023-12-20T04:46:38.902 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.902 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.902 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 105.00 MB 2023-12-20T04:46:38.902 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.902 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.902 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 106.00 MB 2023-12-20T04:46:38.902 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.902 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.902 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 107.00 MB 2023-12-20T04:46:38.902 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.902 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.902 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 108.00 MB 2023-12-20T04:46:38.902 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.903 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.903 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 109.00 MB 2023-12-20T04:46:38.903 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.903 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.903 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 110.00 MB 2023-12-20T04:46:38.903 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.903 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.903 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 111.00 MB 2023-12-20T04:46:38.903 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.903 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.903 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 112.00 MB 2023-12-20T04:46:38.903 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.903 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.903 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 113.00 MB 2023-12-20T04:46:38.903 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.904 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.904 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 114.00 MB 2023-12-20T04:46:38.904 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.904 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.904 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 115.00 MB 2023-12-20T04:46:38.904 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.904 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.904 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 116.00 MB 2023-12-20T04:46:38.904 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.904 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.904 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 117.00 MB 2023-12-20T04:46:38.904 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.904 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.904 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 118.00 MB 2023-12-20T04:46:38.905 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.905 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.905 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 119.00 MB 2023-12-20T04:46:38.905 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.905 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.905 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 120.00 MB 2023-12-20T04:46:38.905 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.905 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.905 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 121.00 MB 2023-12-20T04:46:38.905 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.905 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.905 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 122.00 MB 2023-12-20T04:46:38.905 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.906 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.906 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 123.00 MB 2023-12-20T04:46:38.906 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.906 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.906 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 124.00 MB 2023-12-20T04:46:38.906 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.906 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.906 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 125.00 MB 2023-12-20T04:46:38.906 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.906 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.906 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 126.00 MB 2023-12-20T04:46:38.906 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.906 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.906 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 127.00 MB 2023-12-20T04:46:38.907 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.907 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.907 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 128.00 MB 2023-12-20T04:46:38.907 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.907 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.907 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 129.00 MB 2023-12-20T04:46:38.907 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.907 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.907 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 130.00 MB 2023-12-20T04:46:38.907 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.907 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.907 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 131.00 MB 2023-12-20T04:46:38.907 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.907 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.907 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 132.00 MB 2023-12-20T04:46:38.908 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.908 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.908 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 133.00 MB 2023-12-20T04:46:38.908 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.908 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.908 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 134.00 MB 2023-12-20T04:46:38.908 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.908 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.908 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 135.00 MB 2023-12-20T04:46:38.908 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.908 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.908 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 136.00 MB 2023-12-20T04:46:38.908 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.908 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.908 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 137.00 MB 2023-12-20T04:46:38.909 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.909 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.909 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 138.00 MB 2023-12-20T04:46:38.909 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.909 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.909 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 139.00 MB 2023-12-20T04:46:38.909 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.909 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.909 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 140.00 MB 2023-12-20T04:46:38.909 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.909 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.909 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 141.00 MB 2023-12-20T04:46:38.909 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.909 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.910 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 142.00 MB 2023-12-20T04:46:38.910 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.910 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.910 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 143.00 MB 2023-12-20T04:46:38.910 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.910 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.910 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 144.00 MB 2023-12-20T04:46:38.910 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.910 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.910 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 145.00 MB 2023-12-20T04:46:38.910 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.910 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.910 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 146.00 MB 2023-12-20T04:46:38.910 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.911 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.911 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 147.00 MB 2023-12-20T04:46:38.911 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.911 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.911 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 148.00 MB 2023-12-20T04:46:38.911 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.911 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.911 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 149.00 MB 2023-12-20T04:46:38.911 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.911 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.911 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 150.00 MB 2023-12-20T04:46:38.911 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.912 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.912 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 151.00 MB 2023-12-20T04:46:38.912 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.912 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.912 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 152.00 MB 2023-12-20T04:46:38.912 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.912 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.912 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 153.00 MB 2023-12-20T04:46:38.912 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.912 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.912 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 154.00 MB 2023-12-20T04:46:38.912 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.912 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.913 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 155.00 MB 2023-12-20T04:46:38.913 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.913 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.913 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 156.00 MB 2023-12-20T04:46:38.913 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.913 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.913 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 157.00 MB 2023-12-20T04:46:38.913 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.913 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.913 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 158.00 MB 2023-12-20T04:46:38.913 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.913 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.913 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 159.00 MB 2023-12-20T04:46:38.913 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:38.913 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:38.914 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 160.00 MB 2023-12-20T04:46:38.914 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.188 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.188 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 161.00 MB 2023-12-20T04:46:39.188 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.188 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.188 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 162.00 MB 2023-12-20T04:46:39.188 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.188 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.188 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 163.00 MB 2023-12-20T04:46:39.188 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.188 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.188 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 164.00 MB 2023-12-20T04:46:39.188 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.188 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.189 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 165.00 MB 2023-12-20T04:46:39.189 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.189 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.189 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 166.00 MB 2023-12-20T04:46:39.189 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.189 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.189 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 167.00 MB 2023-12-20T04:46:39.189 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.189 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.189 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 168.00 MB 2023-12-20T04:46:39.189 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.189 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.189 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 169.00 MB 2023-12-20T04:46:39.189 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.190 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.190 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 170.00 MB 2023-12-20T04:46:39.190 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.190 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.190 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 171.00 MB 2023-12-20T04:46:39.190 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.190 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.190 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 172.00 MB 2023-12-20T04:46:39.190 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.190 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.190 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 173.00 MB 2023-12-20T04:46:39.190 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.190 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.190 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 174.00 MB 2023-12-20T04:46:39.191 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.191 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.191 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 175.00 MB 2023-12-20T04:46:39.191 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.191 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.191 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 176.00 MB 2023-12-20T04:46:39.191 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.191 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.191 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 177.00 MB 2023-12-20T04:46:39.191 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.191 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.191 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 178.00 MB 2023-12-20T04:46:39.191 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.191 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.191 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 179.00 MB 2023-12-20T04:46:39.192 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.192 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.192 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 180.00 MB 2023-12-20T04:46:39.192 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.192 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.192 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 181.00 MB 2023-12-20T04:46:39.192 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.192 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.192 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 182.00 MB 2023-12-20T04:46:39.192 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.192 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.192 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 183.00 MB 2023-12-20T04:46:39.192 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.192 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.192 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 184.00 MB 2023-12-20T04:46:39.193 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.193 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.193 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 185.00 MB 2023-12-20T04:46:39.193 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.193 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.193 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 186.00 MB 2023-12-20T04:46:39.193 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.193 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.193 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 187.00 MB 2023-12-20T04:46:39.193 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.193 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.193 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 188.00 MB 2023-12-20T04:46:39.193 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.193 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.194 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 189.00 MB 2023-12-20T04:46:39.194 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.194 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.194 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 190.00 MB 2023-12-20T04:46:39.194 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.194 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.194 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 191.00 MB 2023-12-20T04:46:39.194 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.194 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.194 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 192.00 MB 2023-12-20T04:46:39.194 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.194 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.194 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 193.00 MB 2023-12-20T04:46:39.194 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.195 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.195 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 194.00 MB 2023-12-20T04:46:39.195 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.195 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.195 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 195.00 MB 2023-12-20T04:46:39.195 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.195 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.195 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 196.00 MB 2023-12-20T04:46:39.195 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.195 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.195 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 197.00 MB 2023-12-20T04:46:39.195 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.195 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.195 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 198.00 MB 2023-12-20T04:46:39.195 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.196 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.196 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 199.00 MB 2023-12-20T04:46:39.196 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.196 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.196 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 200.00 MB 2023-12-20T04:46:39.196 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.196 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.196 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 201.00 MB 2023-12-20T04:46:39.196 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.196 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.196 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 202.00 MB 2023-12-20T04:46:39.196 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.196 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.196 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 203.00 MB 2023-12-20T04:46:39.197 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.197 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.197 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 204.00 MB 2023-12-20T04:46:39.197 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.197 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.197 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 205.00 MB 2023-12-20T04:46:39.197 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.197 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.197 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 206.00 MB 2023-12-20T04:46:39.197 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.197 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.197 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 207.00 MB 2023-12-20T04:46:39.197 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.197 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.197 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 208.00 MB 2023-12-20T04:46:39.198 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.198 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.198 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 209.00 MB 2023-12-20T04:46:39.198 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.198 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.198 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 210.00 MB 2023-12-20T04:46:39.198 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.198 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.198 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 211.00 MB 2023-12-20T04:46:39.198 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.198 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.198 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 212.00 MB 2023-12-20T04:46:39.198 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.198 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.199 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 213.00 MB 2023-12-20T04:46:39.199 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.199 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.199 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 214.00 MB 2023-12-20T04:46:39.199 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.199 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.199 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 215.00 MB 2023-12-20T04:46:39.199 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.199 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.199 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 216.00 MB 2023-12-20T04:46:39.199 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.199 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.199 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 217.00 MB 2023-12-20T04:46:39.199 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.200 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.200 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 218.00 MB 2023-12-20T04:46:39.200 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.200 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.200 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 219.00 MB 2023-12-20T04:46:39.200 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.200 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.200 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 220.00 MB 2023-12-20T04:46:39.200 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.200 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.200 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 221.00 MB 2023-12-20T04:46:39.200 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.200 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.200 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 222.00 MB 2023-12-20T04:46:39.201 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.201 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.201 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 223.00 MB 2023-12-20T04:46:39.201 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.201 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.201 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 224.00 MB 2023-12-20T04:46:39.201 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.201 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.201 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 225.00 MB 2023-12-20T04:46:39.201 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.201 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.201 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 226.00 MB 2023-12-20T04:46:39.201 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.202 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.202 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 227.00 MB 2023-12-20T04:46:39.202 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.202 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.202 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 228.00 MB 2023-12-20T04:46:39.202 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.202 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.202 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 229.00 MB 2023-12-20T04:46:39.202 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.202 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.202 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 230.00 MB 2023-12-20T04:46:39.202 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.202 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.202 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 231.00 MB 2023-12-20T04:46:39.202 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.203 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.203 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 232.00 MB 2023-12-20T04:46:39.203 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.203 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.203 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 233.00 MB 2023-12-20T04:46:39.203 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.203 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.203 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 234.00 MB 2023-12-20T04:46:39.203 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.203 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.203 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 235.00 MB 2023-12-20T04:46:39.203 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.203 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.203 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 236.00 MB 2023-12-20T04:46:39.203 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.204 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.204 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 237.00 MB 2023-12-20T04:46:39.204 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.204 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.204 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 238.00 MB 2023-12-20T04:46:39.204 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.204 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.204 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 239.00 MB 2023-12-20T04:46:39.204 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.204 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.204 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 240.00 MB 2023-12-20T04:46:39.204 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.204 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.462 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 241.00 MB 2023-12-20T04:46:39.462 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.462 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.462 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 242.00 MB 2023-12-20T04:46:39.462 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.462 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.462 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 243.00 MB 2023-12-20T04:46:39.462 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.462 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.462 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 244.00 MB 2023-12-20T04:46:39.462 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.462 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.463 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 245.00 MB 2023-12-20T04:46:39.463 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.463 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.463 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 246.00 MB 2023-12-20T04:46:39.463 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.463 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.463 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 247.00 MB 2023-12-20T04:46:39.463 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.463 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.463 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 248.00 MB 2023-12-20T04:46:39.463 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.463 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.463 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 249.00 MB 2023-12-20T04:46:39.464 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.464 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.464 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 250.00 MB 2023-12-20T04:46:39.464 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.464 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.464 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 251.00 MB 2023-12-20T04:46:39.464 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.464 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.464 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 252.00 MB 2023-12-20T04:46:39.464 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.464 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.464 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 253.00 MB 2023-12-20T04:46:39.464 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.464 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.465 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 254.00 MB 2023-12-20T04:46:39.465 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.465 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.465 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 255.00 MB 2023-12-20T04:46:39.465 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.465 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.465 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 256.00 MB 2023-12-20T04:46:39.465 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.465 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.465 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 257.00 MB 2023-12-20T04:46:39.465 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.465 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.465 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 258.00 MB 2023-12-20T04:46:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 259.00 MB 2023-12-20T04:46:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 260.00 MB 2023-12-20T04:46:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 261.00 MB 2023-12-20T04:46:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 262.00 MB 2023-12-20T04:46:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.466 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.467 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 263.00 MB 2023-12-20T04:46:39.467 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.467 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.467 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 264.00 MB 2023-12-20T04:46:39.467 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.467 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.467 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 265.00 MB 2023-12-20T04:46:39.467 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.467 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.467 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 266.00 MB 2023-12-20T04:46:39.467 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.467 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.467 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 267.00 MB 2023-12-20T04:46:39.467 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.467 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.468 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 268.00 MB 2023-12-20T04:46:39.468 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.468 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.468 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 269.00 MB 2023-12-20T04:46:39.468 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.468 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.468 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 270.00 MB 2023-12-20T04:46:39.468 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.468 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.468 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 271.00 MB 2023-12-20T04:46:39.468 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.468 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.468 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 272.00 MB 2023-12-20T04:46:39.468 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.468 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.469 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 273.00 MB 2023-12-20T04:46:39.469 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.469 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.469 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 274.00 MB 2023-12-20T04:46:39.469 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.469 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.469 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 275.00 MB 2023-12-20T04:46:39.469 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.469 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.469 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 276.00 MB 2023-12-20T04:46:39.469 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.469 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.469 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 277.00 MB 2023-12-20T04:46:39.470 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.470 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.470 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 278.00 MB 2023-12-20T04:46:39.470 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.470 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.470 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 279.00 MB 2023-12-20T04:46:39.470 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.470 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.470 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 280.00 MB 2023-12-20T04:46:39.470 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.470 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.470 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 281.00 MB 2023-12-20T04:46:39.470 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.470 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 282.00 MB 2023-12-20T04:46:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 283.00 MB 2023-12-20T04:46:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 284.00 MB 2023-12-20T04:46:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 285.00 MB 2023-12-20T04:46:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 286.00 MB 2023-12-20T04:46:39.471 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 287.00 MB 2023-12-20T04:46:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 288.00 MB 2023-12-20T04:46:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 289.00 MB 2023-12-20T04:46:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 290.00 MB 2023-12-20T04:46:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 291.00 MB 2023-12-20T04:46:39.472 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 292.00 MB 2023-12-20T04:46:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 293.00 MB 2023-12-20T04:46:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 294.00 MB 2023-12-20T04:46:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 295.00 MB 2023-12-20T04:46:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.473 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 296.00 MB 2023-12-20T04:46:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 297.00 MB 2023-12-20T04:46:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 298.00 MB 2023-12-20T04:46:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 299.00 MB 2023-12-20T04:46:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 300.00 MB 2023-12-20T04:46:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.474 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.475 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 301.00 MB 2023-12-20T04:46:39.475 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.475 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.475 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 302.00 MB 2023-12-20T04:46:39.475 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.475 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.475 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 303.00 MB 2023-12-20T04:46:39.475 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.475 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.475 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 304.00 MB 2023-12-20T04:46:39.475 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.475 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.475 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 305.00 MB 2023-12-20T04:46:39.476 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.476 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.476 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 306.00 MB 2023-12-20T04:46:39.476 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.476 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.476 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 307.00 MB 2023-12-20T04:46:39.476 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.476 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.476 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 308.00 MB 2023-12-20T04:46:39.476 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.476 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.476 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 309.00 MB 2023-12-20T04:46:39.476 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.476 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.476 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 310.00 MB 2023-12-20T04:46:39.477 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.477 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.477 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 311.00 MB 2023-12-20T04:46:39.477 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.477 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.477 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 312.00 MB 2023-12-20T04:46:39.477 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.477 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.477 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 313.00 MB 2023-12-20T04:46:39.477 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.477 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.477 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 314.00 MB 2023-12-20T04:46:39.477 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.478 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.478 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 315.00 MB 2023-12-20T04:46:39.478 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.478 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.478 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 316.00 MB 2023-12-20T04:46:39.478 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.478 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.478 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 317.00 MB 2023-12-20T04:46:39.478 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.478 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.478 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 318.00 MB 2023-12-20T04:46:39.478 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.478 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.479 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 319.00 MB 2023-12-20T04:46:39.479 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.479 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.479 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 320.00 MB 2023-12-20T04:46:39.479 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.479 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.479 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 321.00 MB 2023-12-20T04:46:39.741 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.741 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.741 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 322.00 MB 2023-12-20T04:46:39.741 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.741 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.741 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 323.00 MB 2023-12-20T04:46:39.742 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.742 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.742 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 324.00 MB 2023-12-20T04:46:39.742 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.742 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.742 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 325.00 MB 2023-12-20T04:46:39.742 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.742 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.742 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 326.00 MB 2023-12-20T04:46:39.742 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.742 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.742 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 327.00 MB 2023-12-20T04:46:39.742 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.742 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.743 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 328.00 MB 2023-12-20T04:46:39.743 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.743 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.743 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 329.00 MB 2023-12-20T04:46:39.743 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.743 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.743 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 330.00 MB 2023-12-20T04:46:39.743 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.743 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.743 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 331.00 MB 2023-12-20T04:46:39.743 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.743 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.743 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 332.00 MB 2023-12-20T04:46:39.743 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.743 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.744 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 333.00 MB 2023-12-20T04:46:39.744 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.744 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.744 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 334.00 MB 2023-12-20T04:46:39.744 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.744 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.744 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 335.00 MB 2023-12-20T04:46:39.744 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.744 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.744 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 336.00 MB 2023-12-20T04:46:39.744 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.744 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.744 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 337.00 MB 2023-12-20T04:46:39.744 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.744 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.745 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 338.00 MB 2023-12-20T04:46:39.745 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.745 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.745 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 339.00 MB 2023-12-20T04:46:39.745 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.745 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.745 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 340.00 MB 2023-12-20T04:46:39.745 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.745 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.745 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 341.00 MB 2023-12-20T04:46:39.745 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.746 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.746 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 342.00 MB 2023-12-20T04:46:39.746 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.746 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.746 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 343.00 MB 2023-12-20T04:46:39.746 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.746 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.746 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 344.00 MB 2023-12-20T04:46:39.746 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.746 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.746 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 345.00 MB 2023-12-20T04:46:39.746 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.746 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.746 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 346.00 MB 2023-12-20T04:46:39.746 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.747 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.747 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 347.00 MB 2023-12-20T04:46:39.747 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.747 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.747 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 348.00 MB 2023-12-20T04:46:39.747 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.747 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.747 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 349.00 MB 2023-12-20T04:46:39.747 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.747 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.747 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 350.00 MB 2023-12-20T04:46:39.747 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.747 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.747 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 351.00 MB 2023-12-20T04:46:39.747 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.748 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.748 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 352.00 MB 2023-12-20T04:46:39.748 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.748 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.748 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 353.00 MB 2023-12-20T04:46:39.748 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.748 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.748 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 354.00 MB 2023-12-20T04:46:39.748 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.748 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.748 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 355.00 MB 2023-12-20T04:46:39.748 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.748 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.748 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 356.00 MB 2023-12-20T04:46:39.749 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.749 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.749 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 357.00 MB 2023-12-20T04:46:39.749 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.749 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.749 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 358.00 MB 2023-12-20T04:46:39.749 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.749 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.749 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 359.00 MB 2023-12-20T04:46:39.749 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.749 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.749 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 360.00 MB 2023-12-20T04:46:39.749 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.749 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.750 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 361.00 MB 2023-12-20T04:46:39.750 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.750 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.750 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 362.00 MB 2023-12-20T04:46:39.750 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.750 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.750 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 363.00 MB 2023-12-20T04:46:39.750 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.750 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.750 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 364.00 MB 2023-12-20T04:46:39.750 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.750 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.750 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 365.00 MB 2023-12-20T04:46:39.750 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.750 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.751 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 366.00 MB 2023-12-20T04:46:39.751 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.751 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.751 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 367.00 MB 2023-12-20T04:46:39.751 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.751 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.751 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 368.00 MB 2023-12-20T04:46:39.751 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.751 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.751 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 369.00 MB 2023-12-20T04:46:39.751 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.752 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.752 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 370.00 MB 2023-12-20T04:46:39.752 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.752 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.752 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 371.00 MB 2023-12-20T04:46:39.752 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.752 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.752 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 372.00 MB 2023-12-20T04:46:39.752 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.752 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.752 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 373.00 MB 2023-12-20T04:46:39.752 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.752 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.752 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 374.00 MB 2023-12-20T04:46:39.753 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.753 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.753 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 375.00 MB 2023-12-20T04:46:39.753 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.753 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.753 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 376.00 MB 2023-12-20T04:46:39.753 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.753 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.753 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 377.00 MB 2023-12-20T04:46:39.753 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.753 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.753 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 378.00 MB 2023-12-20T04:46:39.753 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.753 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.754 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 379.00 MB 2023-12-20T04:46:39.754 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.754 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.754 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 380.00 MB 2023-12-20T04:46:39.754 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.754 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.754 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 381.00 MB 2023-12-20T04:46:39.754 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.754 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.754 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 382.00 MB 2023-12-20T04:46:39.754 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.754 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.754 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 383.00 MB 2023-12-20T04:46:39.754 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.754 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.755 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 384.00 MB 2023-12-20T04:46:39.755 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.755 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.755 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 385.00 MB 2023-12-20T04:46:39.755 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.755 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.755 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 386.00 MB 2023-12-20T04:46:39.755 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.755 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.755 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 387.00 MB 2023-12-20T04:46:39.755 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.755 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.755 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 388.00 MB 2023-12-20T04:46:39.755 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.755 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.756 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 389.00 MB 2023-12-20T04:46:39.756 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.756 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.756 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 390.00 MB 2023-12-20T04:46:39.756 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.756 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.756 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 391.00 MB 2023-12-20T04:46:39.756 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.757 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.757 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 392.00 MB 2023-12-20T04:46:39.757 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.757 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.757 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 393.00 MB 2023-12-20T04:46:39.757 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.757 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.757 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 394.00 MB 2023-12-20T04:46:39.757 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.757 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.757 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 395.00 MB 2023-12-20T04:46:39.757 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.757 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.757 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 396.00 MB 2023-12-20T04:46:39.758 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.758 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.758 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 397.00 MB 2023-12-20T04:46:39.758 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.758 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.758 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 398.00 MB 2023-12-20T04:46:39.758 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.758 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.758 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 399.00 MB 2023-12-20T04:46:39.758 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.758 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.758 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 400.00 MB 2023-12-20T04:46:39.758 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:39.758 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:39.758 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 401.00 MB 2023-12-20T04:46:41.865 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:46:41.864+0000 7f1a5f3c2640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 full osd(s) (OSD_FULL) 2023-12-20T04:46:47.578 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:46:47.581 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:46:49.830 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:46:49.829+0000 7f1a5f3c2640 -1 log_channel(cluster) log [ERR] : Health check update: 4 full osd(s) (OSD_FULL) 2023-12-20T04:46:55.068 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.069 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.069 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 402.00 MB 2023-12-20T04:46:55.069 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.069 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.069 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 403.00 MB 2023-12-20T04:46:55.069 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.069 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.069 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 404.00 MB 2023-12-20T04:46:55.069 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.069 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.069 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 405.00 MB 2023-12-20T04:46:55.070 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.070 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.070 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 406.00 MB 2023-12-20T04:46:55.070 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.070 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.070 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 407.00 MB 2023-12-20T04:46:55.070 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.070 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.070 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 408.00 MB 2023-12-20T04:46:55.070 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.071 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.071 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 409.00 MB 2023-12-20T04:46:55.071 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.071 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.071 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 410.00 MB 2023-12-20T04:46:55.071 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.071 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.071 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 411.00 MB 2023-12-20T04:46:55.071 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.071 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.071 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 412.00 MB 2023-12-20T04:46:55.071 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.071 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.071 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 413.00 MB 2023-12-20T04:46:55.071 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.072 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.072 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 414.00 MB 2023-12-20T04:46:55.072 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.072 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.072 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 415.00 MB 2023-12-20T04:46:55.072 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.072 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.072 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 416.00 MB 2023-12-20T04:46:55.072 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.072 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.072 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 417.00 MB 2023-12-20T04:46:55.072 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.072 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.072 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 418.00 MB 2023-12-20T04:46:55.072 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.073 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.073 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 419.00 MB 2023-12-20T04:46:55.073 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.073 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.073 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 420.00 MB 2023-12-20T04:46:55.073 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.073 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.073 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 421.00 MB 2023-12-20T04:46:55.073 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.073 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.073 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 422.00 MB 2023-12-20T04:46:55.073 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.073 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.073 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 423.00 MB 2023-12-20T04:46:55.074 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.074 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.074 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 424.00 MB 2023-12-20T04:46:55.074 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.074 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.074 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 425.00 MB 2023-12-20T04:46:55.074 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.074 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.074 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 426.00 MB 2023-12-20T04:46:55.074 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.074 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.074 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 427.00 MB 2023-12-20T04:46:55.074 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.074 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.074 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 428.00 MB 2023-12-20T04:46:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 429.00 MB 2023-12-20T04:46:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 430.00 MB 2023-12-20T04:46:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 431.00 MB 2023-12-20T04:46:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 432.00 MB 2023-12-20T04:46:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.075 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 433.00 MB 2023-12-20T04:46:55.076 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.076 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.076 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 434.00 MB 2023-12-20T04:46:55.076 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.076 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.076 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 435.00 MB 2023-12-20T04:46:55.076 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.076 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.076 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 436.00 MB 2023-12-20T04:46:55.076 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.076 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.076 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 437.00 MB 2023-12-20T04:46:55.076 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.076 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.076 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 438.00 MB 2023-12-20T04:46:55.077 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.077 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.077 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 439.00 MB 2023-12-20T04:46:55.077 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.077 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.077 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 440.00 MB 2023-12-20T04:46:55.077 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.077 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.077 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 441.00 MB 2023-12-20T04:46:55.077 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.077 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.077 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 442.00 MB 2023-12-20T04:46:55.077 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.077 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.078 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 443.00 MB 2023-12-20T04:46:55.078 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.078 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.078 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 444.00 MB 2023-12-20T04:46:55.078 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.078 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.078 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 445.00 MB 2023-12-20T04:46:55.078 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.078 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.078 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 446.00 MB 2023-12-20T04:46:55.078 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.078 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.078 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 447.00 MB 2023-12-20T04:46:55.078 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.078 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.079 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 448.00 MB 2023-12-20T04:46:55.079 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.079 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.079 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 449.00 MB 2023-12-20T04:46:55.079 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.079 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.079 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 450.00 MB 2023-12-20T04:46:55.079 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.079 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.079 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 451.00 MB 2023-12-20T04:46:55.079 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.079 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.079 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 452.00 MB 2023-12-20T04:46:55.079 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.079 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.079 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 453.00 MB 2023-12-20T04:46:55.080 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.080 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.080 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 454.00 MB 2023-12-20T04:46:55.080 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.080 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.080 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 455.00 MB 2023-12-20T04:46:55.080 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.080 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.080 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 456.00 MB 2023-12-20T04:46:55.080 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.080 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.080 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 457.00 MB 2023-12-20T04:46:55.080 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.080 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.080 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 458.00 MB 2023-12-20T04:46:55.081 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.081 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.081 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 459.00 MB 2023-12-20T04:46:55.081 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.081 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.081 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 460.00 MB 2023-12-20T04:46:55.081 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.081 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.081 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 461.00 MB 2023-12-20T04:46:55.081 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.081 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.081 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 462.00 MB 2023-12-20T04:46:55.081 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.081 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.081 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 463.00 MB 2023-12-20T04:46:55.082 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.082 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.082 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 464.00 MB 2023-12-20T04:46:55.082 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.082 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.082 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 465.00 MB 2023-12-20T04:46:55.082 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.082 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.082 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 466.00 MB 2023-12-20T04:46:55.082 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.082 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.082 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 467.00 MB 2023-12-20T04:46:55.082 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.082 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.082 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 468.00 MB 2023-12-20T04:46:55.083 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.083 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.083 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 469.00 MB 2023-12-20T04:46:55.083 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.083 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.083 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 470.00 MB 2023-12-20T04:46:55.083 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.083 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.083 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 471.00 MB 2023-12-20T04:46:55.083 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.083 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.083 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 472.00 MB 2023-12-20T04:46:55.083 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.083 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.083 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 473.00 MB 2023-12-20T04:46:55.084 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.084 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.084 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 474.00 MB 2023-12-20T04:46:55.084 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.084 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.084 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 475.00 MB 2023-12-20T04:46:55.084 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.084 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.084 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 476.00 MB 2023-12-20T04:46:55.084 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.084 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.084 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 477.00 MB 2023-12-20T04:46:55.084 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.084 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.084 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 478.00 MB 2023-12-20T04:46:55.085 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.085 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:46:55.085 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 479.00 MB 2023-12-20T04:46:55.085 INFO:teuthology.orchestra.run.smithi132.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-20T04:46:55.085 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:46:55.085 INFO:teuthology.orchestra.run.smithi132.stdout:Reached fullness after 480.00 MB 2023-12-20T04:46:55.085 INFO:teuthology.orchestra.run.smithi132.stdout:calling close 2023-12-20T04:46:55.085 INFO:teuthology.orchestra.run.smithi132.stdout:close() did not raise error 2023-12-20T04:46:55.118 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:46:55.118 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:46:55.162 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:46:55.204 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:46:55.204 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:46:55.204 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:46:55.222 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:46:55.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.366+0000 7f5ef0db1640 1 Processor -- start 2023-12-20T04:46:55.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.366+0000 7f5ef0db1640 1 -- start start 2023-12-20T04:46:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.366+0000 7f5ef0db1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5eec15d110 0x7f5eec069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.366+0000 7f5ef0db1640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5eec15d4f0 0x7f5eec06a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.366+0000 7f5ef0db1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5eec161ce0 con 0x7f5eec0aeb00 2023-12-20T04:46:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.366+0000 7f5ef0db1640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5eec0aca50 con 0x7f5eec15d4f0 2023-12-20T04:46:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.366+0000 7f5ef0db1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec160df0 con 0x7f5eec15d110 2023-12-20T04:46:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5eead9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5eec0aeb00 0x7f5eec070560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46574/0 (socket says 172.21.15.132:46574) 2023-12-20T04:46:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5eead9d640 1 -- 172.21.15.132:0/3899992840 learned_addr learned my addr 172.21.15.132:0/3899992840 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee9d9b640 1 -- 172.21.15.132:0/3899992840 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 902520631 0 0) 0x7f5eec161ce0 con 0x7f5eec0aeb00 2023-12-20T04:46:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee9d9b640 1 -- 172.21.15.132:0/3899992840 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5ed8003520 con 0x7f5eec0aeb00 2023-12-20T04:46:55.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5eea59c640 1 --2- 172.21.15.132:0/3899992840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5eec15d110 0x7f5eec069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee3fff640 1 --2- 172.21.15.132:0/3899992840 >> v2:172.21.15.187:3300/0 conn(0x7f5eec15d4f0 0x7f5eec06a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee9d9b640 1 -- 172.21.15.132:0/3899992840 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4017266030 0 0) 0x7f5ed8003520 con 0x7f5eec0aeb00 2023-12-20T04:46:55.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee9d9b640 1 -- 172.21.15.132:0/3899992840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5eec15d110 msgr2=0x7f5eec069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:55.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee9d9b640 1 --2- 172.21.15.132:0/3899992840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5eec15d110 0x7f5eec069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee9d9b640 1 -- 172.21.15.132:0/3899992840 >> v2:172.21.15.187:3300/0 conn(0x7f5eec15d4f0 msgr2=0x7f5eec06a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:55.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee9d9b640 1 --2- 172.21.15.132:0/3899992840 >> v2:172.21.15.187:3300/0 conn(0x7f5eec15d4f0 0x7f5eec06a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee9d9b640 1 -- 172.21.15.132:0/3899992840 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec1610d0 con 0x7f5eec0aeb00 2023-12-20T04:46:55.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee9d9b640 1 -- 172.21.15.132:0/3899992840 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f5ee40019f0 con 0x7f5eec0aeb00 2023-12-20T04:46:55.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee9d9b640 1 -- 172.21.15.132:0/3899992840 >> v1:172.21.15.132:6789/0 conn(0x7f5eec0aeb00 legacy=0x7f5eec070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:55.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee9d9b640 1 --2- 172.21.15.132:0/3899992840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ed8003970 0x7f5ed8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee9d9b640 1 --2- 172.21.15.132:0/3899992840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ed80047c0 0x7f5ed8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee9d9b640 1 --2- 172.21.15.132:0/3899992840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5eec15d110 0x7f5ed8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee9d9b640 1 -- 172.21.15.132:0/3899992840 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec0aca50 con 0x7f5ed80047c0 2023-12-20T04:46:55.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee9d9b640 1 -- 172.21.15.132:0/3899992840 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec160df0 con 0x7f5ed8003970 2023-12-20T04:46:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee9d9b640 1 -- 172.21.15.132:0/3899992840 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5ed800ba30 con 0x7f5eec15d110 2023-12-20T04:46:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5ee3fff640 1 --2- 172.21.15.132:0/3899992840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ed80047c0 0x7f5ed8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5eea59c640 1 --2- 172.21.15.132:0/3899992840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ed8003970 0x7f5ed8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.367+0000 7f5eead9d640 1 --2- 172.21.15.132:0/3899992840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5eec15d110 0x7f5ed8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.368+0000 7f5ee3fff640 1 -- 172.21.15.132:0/3899992840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5eec15d110 msgr2=0x7f5ed8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.368+0000 7f5ee3fff640 1 --2- 172.21.15.132:0/3899992840 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5eec15d110 0x7f5ed8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.368+0000 7f5ee3fff640 1 -- 172.21.15.132:0/3899992840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ed8003970 msgr2=0x7f5ed8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.368+0000 7f5ee3fff640 1 --2- 172.21.15.132:0/3899992840 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5ed8003970 0x7f5ed8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.368+0000 7f5ee3fff640 1 -- 172.21.15.132:0/3899992840 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ed8003520 con 0x7f5ed80047c0 2023-12-20T04:46:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.368+0000 7f5ee3fff640 1 --2- 172.21.15.132:0/3899992840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ed80047c0 0x7f5ed8004c40 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f5ed400ba00 tx=0x7f5ed80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d241bf246be3fad server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.368+0000 7f5ee9d9b640 1 -- 172.21.15.132:0/3899992840 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4032630 con 0x7f5ed80047c0 2023-12-20T04:46:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.368+0000 7f5ee9d9b640 1 -- 172.21.15.132:0/3899992840 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed4032790 con 0x7f5ed80047c0 2023-12-20T04:46:55.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.368+0000 7f5ee9d9b640 1 -- 172.21.15.132:0/3899992840 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4032b20 con 0x7f5ed80047c0 2023-12-20T04:46:55.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.369+0000 7f5ef0db1640 1 -- 172.21.15.132:0/3899992840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ed80047c0 msgr2=0x7f5ed8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:55.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.369+0000 7f5ef0db1640 1 --2- 172.21.15.132:0/3899992840 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5ed80047c0 0x7f5ed8004c40 secure :-1 s=READY pgs=922 cs=0 l=1 rev1=1 crypto rx=0x7f5ed400ba00 tx=0x7f5ed80057f0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.369+0000 7f5eead9d640 1 -- 172.21.15.132:0/3899992840 reap_dead start 2023-12-20T04:46:55.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.369+0000 7f5ef0db1640 1 -- 172.21.15.132:0/3899992840 shutdown_connections 2023-12-20T04:46:55.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.369+0000 7f5ef0db1640 1 -- 172.21.15.132:0/3899992840 >> 172.21.15.132:0/3899992840 conn(0x7f5eec0cfbd0 msgr2=0x7f5eec0cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:55.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.369+0000 7f5ef0db1640 1 -- 172.21.15.132:0/3899992840 shutdown_connections 2023-12-20T04:46:55.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.369+0000 7f5ef0db1640 1 -- 172.21.15.132:0/3899992840 wait complete. 2023-12-20T04:46:55.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.370+0000 7f5ef0db1640 1 Processor -- start 2023-12-20T04:46:55.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.370+0000 7f5ef0db1640 1 -- start start 2023-12-20T04:46:55.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.371+0000 7f5ef0db1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5eec151090 0x7f5eec06d760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.371+0000 7f5ef0db1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eec06dca0 0x7f5eec0afad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.371+0000 7f5ef0db1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5eec0b0010 0x7f5eec0c7d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.371+0000 7f5ef0db1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec06c700 con 0x7f5eec06dca0 2023-12-20T04:46:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.371+0000 7f5ef0db1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec06c9a0 con 0x7f5eec0b0010 2023-12-20T04:46:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.371+0000 7f5ef0db1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5eec06cc80 con 0x7f5eec151090 2023-12-20T04:46:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.371+0000 7f5ee3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eec06dca0 0x7f5eec0afad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.371+0000 7f5ee3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eec06dca0 0x7f5eec0afad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56304/0 (socket says 172.21.15.132:56304) 2023-12-20T04:46:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.371+0000 7f5ee3fff640 1 -- 172.21.15.132:0/2497461518 learned_addr learned my addr 172.21.15.132:0/2497461518 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.371+0000 7f5eea59c640 1 --2- 172.21.15.132:0/2497461518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5eec151090 0x7f5eec06d760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.371+0000 7f5eead9d640 1 --2- 172.21.15.132:0/2497461518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5eec0b0010 0x7f5eec0c7d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.371+0000 7f5ee3fff640 1 -- 172.21.15.132:0/2497461518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5eec151090 msgr2=0x7f5eec06d760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.371+0000 7f5ee3fff640 1 --2- 172.21.15.132:0/2497461518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5eec151090 0x7f5eec06d760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.371+0000 7f5ee3fff640 1 -- 172.21.15.132:0/2497461518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5eec0b0010 msgr2=0x7f5eec0c7d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.371+0000 7f5ee3fff640 1 --2- 172.21.15.132:0/2497461518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5eec0b0010 0x7f5eec0c7d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.371+0000 7f5ee3fff640 1 -- 172.21.15.132:0/2497461518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5eec06cf60 con 0x7f5eec06dca0 2023-12-20T04:46:55.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.371+0000 7f5eead9d640 1 --2- 172.21.15.132:0/2497461518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5eec0b0010 0x7f5eec0c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.372+0000 7f5ee3fff640 1 --2- 172.21.15.132:0/2497461518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eec06dca0 0x7f5eec0afad0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5ed402beb0 tx=0x7f5ed4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.372+0000 7f5ee2ffd640 1 -- 172.21.15.132:0/2497461518 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed403ca40 con 0x7f5eec06dca0 2023-12-20T04:46:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.372+0000 7f5ee2ffd640 1 -- 172.21.15.132:0/2497461518 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5ed403cbc0 con 0x7f5eec06dca0 2023-12-20T04:46:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.372+0000 7f5ef0db1640 1 -- 172.21.15.132:0/2497461518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5eec06d240 con 0x7f5eec06dca0 2023-12-20T04:46:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.372+0000 7f5ee2ffd640 1 -- 172.21.15.132:0/2497461518 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5ed4030400 con 0x7f5eec06dca0 2023-12-20T04:46:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.372+0000 7f5ef0db1640 1 -- 172.21.15.132:0/2497461518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5eec151470 con 0x7f5eec06dca0 2023-12-20T04:46:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.373+0000 7f5ef0db1640 1 -- 172.21.15.132:0/2497461518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5eec06d3d0 con 0x7f5eec06dca0 2023-12-20T04:46:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.373+0000 7f5ee2ffd640 1 -- 172.21.15.132:0/2497461518 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5ed4030560 con 0x7f5eec06dca0 2023-12-20T04:46:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.374+0000 7f5ee2ffd640 1 --2- 172.21.15.132:0/2497461518 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5ecc06a430 0x7f5ecc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.374+0000 7f5ee2ffd640 1 -- 172.21.15.132:0/2497461518 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f5ed40ab100 con 0x7f5eec06dca0 2023-12-20T04:46:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.374+0000 7f5eea59c640 1 --2- 172.21.15.132:0/2497461518 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5ecc06a430 0x7f5ecc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.374+0000 7f5ee2ffd640 1 -- 172.21.15.132:0/2497461518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7f5ecc072020 con 0x7f5eec06dca0 2023-12-20T04:46:55.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.374+0000 7f5eea59c640 1 --2- 172.21.15.132:0/2497461518 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5ecc06a430 0x7f5ecc06c8f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5edc005f40 tx=0x7f5edc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:55.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.378+0000 7f5ee2ffd640 1 -- 172.21.15.132:0/2497461518 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5ed4076740 con 0x7f5eec06dca0 2023-12-20T04:46:55.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.546+0000 7f5ef0db1640 1 -- 172.21.15.132:0/2497461518 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5eec04e840 con 0x7f5eec06dca0 2023-12-20T04:46:55.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.548+0000 7f5ee2ffd640 1 -- 172.21.15.132:0/2497461518 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16288 (secure 0 0 0) 0x7f5ed4036020 con 0x7f5eec06dca0 2023-12-20T04:46:55.550 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:55.550 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":86,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:46:42.871118+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:46:20.852337+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-20T04:46:21.431144+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:46:55.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.549+0000 7f5ef0db1640 1 -- 172.21.15.132:0/2497461518 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5ecc06a430 msgr2=0x7f5ecc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:55.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.549+0000 7f5ef0db1640 1 --2- 172.21.15.132:0/2497461518 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5ecc06a430 0x7f5ecc06c8f0 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7f5edc005f40 tx=0x7f5edc008040 comp rx=0 tx=0).stop 2023-12-20T04:46:55.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.550+0000 7f5ef0db1640 1 -- 172.21.15.132:0/2497461518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eec06dca0 msgr2=0x7f5eec0afad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:55.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.550+0000 7f5ef0db1640 1 --2- 172.21.15.132:0/2497461518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eec06dca0 0x7f5eec0afad0 secure :-1 s=READY pgs=923 cs=0 l=1 rev1=1 crypto rx=0x7f5ed402beb0 tx=0x7f5ed4004730 comp rx=0 tx=0).stop 2023-12-20T04:46:55.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.550+0000 7f5ef0db1640 1 -- 172.21.15.132:0/2497461518 shutdown_connections 2023-12-20T04:46:55.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.550+0000 7f5ef0db1640 1 --2- 172.21.15.132:0/2497461518 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5ecc06a430 0x7f5ecc06c8f0 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.550+0000 7f5ef0db1640 1 --2- 172.21.15.132:0/2497461518 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5eec0b0010 0x7f5eec0c7d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.550+0000 7f5ef0db1640 1 --2- 172.21.15.132:0/2497461518 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5eec06dca0 0x7f5eec0afad0 unknown :-1 s=CLOSED pgs=923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.550+0000 7f5ef0db1640 1 --2- 172.21.15.132:0/2497461518 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5eec151090 0x7f5eec06d760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.550+0000 7f5ef0db1640 1 -- 172.21.15.132:0/2497461518 >> 172.21.15.132:0/2497461518 conn(0x7f5eec0cfbd0 msgr2=0x7f5eec15c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:55.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.550+0000 7f5ef0db1640 1 -- 172.21.15.132:0/2497461518 shutdown_connections 2023-12-20T04:46:55.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.550+0000 7f5ef0db1640 1 -- 172.21.15.132:0/2497461518 wait complete. 2023-12-20T04:46:55.563 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:46:20.852337+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:46:21.431144+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:46:55.564 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:46:55.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.664+0000 7f95bcf00640 1 Processor -- start 2023-12-20T04:46:55.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.664+0000 7f95bcf00640 1 -- start start 2023-12-20T04:46:55.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.665+0000 7f95bcf00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f95b80cf790 0x7f95b80cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.665+0000 7f95bcf00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f95b80b6080 0x7f95b80b6490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.665+0000 7f95bcf00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f95b80d2920 con 0x7f95b815d300 2023-12-20T04:46:55.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.665+0000 7f95bcf00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b80d0180 con 0x7f95b80cf790 2023-12-20T04:46:55.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.665+0000 7f95bcf00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f95b80d1d10 con 0x7f95b80b6080 2023-12-20T04:46:55.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.665+0000 7f95b5d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f95b80cf790 0x7f95b80cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.665+0000 7f95b5d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f95b80cf790 0x7f95b80cfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56308/0 (socket says 172.21.15.132:56308) 2023-12-20T04:46:55.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.666+0000 7f95b5d9b640 1 -- 172.21.15.132:0/2557172455 learned_addr learned my addr 172.21.15.132:0/2557172455 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:55.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.666+0000 7f95b6d9d640 1 --2- 172.21.15.132:0/2557172455 >> v2:172.21.15.187:3300/0 conn(0x7f95b80b6080 0x7f95b80b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.666+0000 7f95b5d9b640 1 -- 172.21.15.132:0/2557172455 >> v2:172.21.15.187:3300/0 conn(0x7f95b80b6080 msgr2=0x7f95b80b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:55.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.666+0000 7f95b5d9b640 1 --2- 172.21.15.132:0/2557172455 >> v2:172.21.15.187:3300/0 conn(0x7f95b80b6080 0x7f95b80b6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.666+0000 7f95b5d9b640 1 -- 172.21.15.132:0/2557172455 >> v1:172.21.15.187:6789/0 conn(0x7f95b815d300 legacy=0x7f95b80d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:55.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.666+0000 7f95b5d9b640 1 -- 172.21.15.132:0/2557172455 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95b80d1ff0 con 0x7f95b80cf790 2023-12-20T04:46:55.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.666+0000 7f95b5d9b640 1 --2- 172.21.15.132:0/2557172455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95b80cf790 0x7f95b80cfc40 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f95b80d0540 tx=0x7f95ac02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e4eb546e98fd7b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:55.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.667+0000 7f95b559a640 1 -- 172.21.15.132:0/2557172455 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac030860 con 0x7f95b80cf790 2023-12-20T04:46:55.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.667+0000 7f95b559a640 1 -- 172.21.15.132:0/2557172455 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac0309c0 con 0x7f95b80cf790 2023-12-20T04:46:55.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.667+0000 7f95b559a640 1 -- 172.21.15.132:0/2557172455 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac030d50 con 0x7f95b80cf790 2023-12-20T04:46:55.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.667+0000 7f95bcf00640 1 -- 172.21.15.132:0/2557172455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95b80cf790 msgr2=0x7f95b80cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:55.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.667+0000 7f95bcf00640 1 --2- 172.21.15.132:0/2557172455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95b80cf790 0x7f95b80cfc40 secure :-1 s=READY pgs=924 cs=0 l=1 rev1=1 crypto rx=0x7f95b80d0540 tx=0x7f95ac02b9a0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.667+0000 7f95bcf00640 1 -- 172.21.15.132:0/2557172455 shutdown_connections 2023-12-20T04:46:55.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.667+0000 7f95bcf00640 1 --2- 172.21.15.132:0/2557172455 >> v2:172.21.15.187:3300/0 conn(0x7f95b80b6080 0x7f95b80b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.667+0000 7f95bcf00640 1 --2- 172.21.15.132:0/2557172455 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95b80cf790 0x7f95b80cfc40 unknown :-1 s=CLOSED pgs=924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.667+0000 7f95bcf00640 1 -- 172.21.15.132:0/2557172455 >> 172.21.15.132:0/2557172455 conn(0x7f95b806a3d0 msgr2=0x7f95b806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:55.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.667+0000 7f95bcf00640 1 -- 172.21.15.132:0/2557172455 shutdown_connections 2023-12-20T04:46:55.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.667+0000 7f95bcf00640 1 -- 172.21.15.132:0/2557172455 wait complete. 2023-12-20T04:46:55.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.669+0000 7f95bcf00640 1 Processor -- start 2023-12-20T04:46:55.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.669+0000 7f95bcf00640 1 -- start start 2023-12-20T04:46:55.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.669+0000 7f95bcf00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95b80b6080 0x7f95b81f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.669+0000 7f95bcf00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95b80cf790 0x7f95b80c76c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.669+0000 7f95bcf00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95b815d300 0x7f95b80cc1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.669+0000 7f95bcf00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b81f3200 con 0x7f95b80cf790 2023-12-20T04:46:55.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.669+0000 7f95bcf00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95b80c8f80 con 0x7f95b815d300 2023-12-20T04:46:55.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.669+0000 7f95bcf00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95b80ccce0 con 0x7f95b80b6080 2023-12-20T04:46:55.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.669+0000 7f95b5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95b80cf790 0x7f95b80c76c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.669+0000 7f95b5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95b80cf790 0x7f95b80c76c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56310/0 (socket says 172.21.15.132:56310) 2023-12-20T04:46:55.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.670+0000 7f95b5d9b640 1 -- 172.21.15.132:0/3080477836 learned_addr learned my addr 172.21.15.132:0/3080477836 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:55.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.670+0000 7f95b6d9d640 1 --2- 172.21.15.132:0/3080477836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95b815d300 0x7f95b80cc1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.670+0000 7f95b659c640 1 --2- 172.21.15.132:0/3080477836 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95b80b6080 0x7f95b81f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.670+0000 7f95b5d9b640 1 -- 172.21.15.132:0/3080477836 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95b80b6080 msgr2=0x7f95b81f2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:55.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.670+0000 7f95b5d9b640 1 --2- 172.21.15.132:0/3080477836 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95b80b6080 0x7f95b81f2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.670+0000 7f95b5d9b640 1 -- 172.21.15.132:0/3080477836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95b815d300 msgr2=0x7f95b80cc1b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:55.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.670+0000 7f95b5d9b640 1 --2- 172.21.15.132:0/3080477836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95b815d300 0x7f95b80cc1b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.670+0000 7f95b5d9b640 1 -- 172.21.15.132:0/3080477836 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95ac0094d0 con 0x7f95b80cf790 2023-12-20T04:46:55.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.670+0000 7f95b659c640 1 --2- 172.21.15.132:0/3080477836 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95b80b6080 0x7f95b81f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:55.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.670+0000 7f95b5d9b640 1 --2- 172.21.15.132:0/3080477836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95b80cf790 0x7f95b80c76c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f95ac02b9e0 tx=0x7f95ac004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:55.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.670+0000 7f95a6ffd640 1 -- 172.21.15.132:0/3080477836 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac039d60 con 0x7f95b80cf790 2023-12-20T04:46:55.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.670+0000 7f95a6ffd640 1 -- 172.21.15.132:0/3080477836 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f95ac043400 con 0x7f95b80cf790 2023-12-20T04:46:55.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.670+0000 7f95a6ffd640 1 -- 172.21.15.132:0/3080477836 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95ac0437b0 con 0x7f95b80cf790 2023-12-20T04:46:55.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.670+0000 7f95bcf00640 1 -- 172.21.15.132:0/3080477836 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95b80c6900 con 0x7f95b80cf790 2023-12-20T04:46:55.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.670+0000 7f95bcf00640 1 -- 172.21.15.132:0/3080477836 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95b80c6ec0 con 0x7f95b80cf790 2023-12-20T04:46:55.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.671+0000 7f95bcf00640 1 -- 172.21.15.132:0/3080477836 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95b804e840 con 0x7f95b80cf790 2023-12-20T04:46:55.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.672+0000 7f95a6ffd640 1 -- 172.21.15.132:0/3080477836 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f95ac043910 con 0x7f95b80cf790 2023-12-20T04:46:55.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.672+0000 7f95a6ffd640 1 --2- 172.21.15.132:0/3080477836 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f959806a430 0x7f959806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.672+0000 7f95a6ffd640 1 -- 172.21.15.132:0/3080477836 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f95ac03e070 con 0x7f95b80cf790 2023-12-20T04:46:55.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.672+0000 7f95b659c640 1 --2- 172.21.15.132:0/3080477836 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f959806a430 0x7f959806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.672+0000 7f95a6ffd640 1 -- 172.21.15.132:0/3080477836 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7f9598072020 con 0x7f95b80cf790 2023-12-20T04:46:55.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.672+0000 7f95b659c640 1 --2- 172.21.15.132:0/3080477836 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f959806a430 0x7f959806c8f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f95a80012e0 tx=0x7f95a8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:55.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.676+0000 7f95a6ffd640 1 -- 172.21.15.132:0/3080477836 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f95ac034060 con 0x7f95b80cf790 2023-12-20T04:46:55.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.841+0000 7f95bcf00640 1 -- 172.21.15.132:0/3080477836 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f95b815b940 con 0x7f95b80cf790 2023-12-20T04:46:55.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.841+0000 7f95a6ffd640 1 -- 172.21.15.132:0/3080477836 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f95ac034030 con 0x7f95b80cf790 2023-12-20T04:46:55.843 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:46:55.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.843+0000 7f95bcf00640 1 -- 172.21.15.132:0/3080477836 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f959806a430 msgr2=0x7f959806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:55.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.843+0000 7f95bcf00640 1 --2- 172.21.15.132:0/3080477836 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f959806a430 0x7f959806c8f0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7f95a80012e0 tx=0x7f95a8009040 comp rx=0 tx=0).stop 2023-12-20T04:46:55.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.843+0000 7f95bcf00640 1 -- 172.21.15.132:0/3080477836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95b80cf790 msgr2=0x7f95b80c76c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:55.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.843+0000 7f95bcf00640 1 --2- 172.21.15.132:0/3080477836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95b80cf790 0x7f95b80c76c0 secure :-1 s=READY pgs=925 cs=0 l=1 rev1=1 crypto rx=0x7f95ac02b9e0 tx=0x7f95ac004730 comp rx=0 tx=0).stop 2023-12-20T04:46:55.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.843+0000 7f95bcf00640 1 -- 172.21.15.132:0/3080477836 shutdown_connections 2023-12-20T04:46:55.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.843+0000 7f95bcf00640 1 --2- 172.21.15.132:0/3080477836 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f959806a430 0x7f959806c8f0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.843+0000 7f95bcf00640 1 --2- 172.21.15.132:0/3080477836 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f95b815d300 0x7f95b80cc1b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.843+0000 7f95bcf00640 1 --2- 172.21.15.132:0/3080477836 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f95b80cf790 0x7f95b80c76c0 unknown :-1 s=CLOSED pgs=925 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.843+0000 7f95bcf00640 1 --2- 172.21.15.132:0/3080477836 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f95b80b6080 0x7f95b81f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.843+0000 7f95bcf00640 1 -- 172.21.15.132:0/3080477836 >> 172.21.15.132:0/3080477836 conn(0x7f95b806a3d0 msgr2=0x7f95b815bb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:55.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.843+0000 7f95bcf00640 1 -- 172.21.15.132:0/3080477836 shutdown_connections 2023-12-20T04:46:55.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.843+0000 7f95bcf00640 1 -- 172.21.15.132:0/3080477836 wait complete. 2023-12-20T04:46:55.856 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:46:55.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.955+0000 7f8a0c84a640 1 Processor -- start 2023-12-20T04:46:55.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.956+0000 7f8a0c84a640 1 -- start start 2023-12-20T04:46:55.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.956+0000 7f8a0c84a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8a0815cf20 0x7f8a0806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.956+0000 7f8a0c84a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a080cd4b0 0x7f8a080cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.956+0000 7f8a0c84a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a0806cc90 con 0x7f8a0815d300 2023-12-20T04:46:55.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.956+0000 7f8a0c84a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a080cde80 con 0x7f8a0815cf20 2023-12-20T04:46:55.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.956+0000 7f8a0c84a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080b2f30 con 0x7f8a080cd4b0 2023-12-20T04:46:55.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.957+0000 7f8a0659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8a0815cf20 0x7f8a0806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.957+0000 7f8a0659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8a0815cf20 0x7f8a0806c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56324/0 (socket says 172.21.15.132:56324) 2023-12-20T04:46:55.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.957+0000 7f8a0659c640 1 -- 172.21.15.132:0/418956936 learned_addr learned my addr 172.21.15.132:0/418956936 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:55.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.957+0000 7f8a0659c640 1 -- 172.21.15.132:0/418956936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a080cd4b0 msgr2=0x7f8a080cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:55.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.957+0000 7f8a0659c640 1 --2- 172.21.15.132:0/418956936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a080cd4b0 0x7f8a080cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.957+0000 7f8a0659c640 1 -- 172.21.15.132:0/418956936 >> v1:172.21.15.187:6789/0 conn(0x7f8a0815d300 legacy=0x7f8a08161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:55.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.957+0000 7f8a0659c640 1 -- 172.21.15.132:0/418956936 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a080b3210 con 0x7f8a0815cf20 2023-12-20T04:46:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.958+0000 7f8a0659c640 1 --2- 172.21.15.132:0/418956936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a0815cf20 0x7f8a0806c590 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8a08071180 tx=0x7f8a0002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a319c3cf54a83b53 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.958+0000 7f8a0559a640 1 -- 172.21.15.132:0/418956936 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a00031640 con 0x7f8a0815cf20 2023-12-20T04:46:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.958+0000 7f8a0559a640 1 -- 172.21.15.132:0/418956936 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a000317a0 con 0x7f8a0815cf20 2023-12-20T04:46:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.958+0000 7f8a0559a640 1 -- 172.21.15.132:0/418956936 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a00031b30 con 0x7f8a0815cf20 2023-12-20T04:46:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.958+0000 7f8a0c84a640 1 -- 172.21.15.132:0/418956936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a0815cf20 msgr2=0x7f8a0806c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.958+0000 7f8a0c84a640 1 --2- 172.21.15.132:0/418956936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a0815cf20 0x7f8a0806c590 secure :-1 s=READY pgs=926 cs=0 l=1 rev1=1 crypto rx=0x7f8a08071180 tx=0x7f8a0002b8f0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.958+0000 7f8a0c84a640 1 -- 172.21.15.132:0/418956936 shutdown_connections 2023-12-20T04:46:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.958+0000 7f8a0c84a640 1 --2- 172.21.15.132:0/418956936 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a080cd4b0 0x7f8a080cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.958+0000 7f8a0c84a640 1 --2- 172.21.15.132:0/418956936 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a0815cf20 0x7f8a0806c590 unknown :-1 s=CLOSED pgs=926 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.958+0000 7f8a0c84a640 1 -- 172.21.15.132:0/418956936 >> 172.21.15.132:0/418956936 conn(0x7f8a08072c60 msgr2=0x7f8a08073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:55.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.958+0000 7f8a0c84a640 1 -- 172.21.15.132:0/418956936 shutdown_connections 2023-12-20T04:46:55.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.958+0000 7f8a0c84a640 1 -- 172.21.15.132:0/418956936 wait complete. 2023-12-20T04:46:55.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.960+0000 7f8a0c84a640 1 Processor -- start 2023-12-20T04:46:55.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.960+0000 7f8a0c84a640 1 -- start start 2023-12-20T04:46:55.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.960+0000 7f8a0c84a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a080cd4b0 0x7f8a08158520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.960+0000 7f8a0c84a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a0815cf20 0x7f8a0815eeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.960+0000 7f8a0c84a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a0815d300 0x7f8a0815f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.960+0000 7f8a0c84a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080ac8e0 con 0x7f8a080cd4b0 2023-12-20T04:46:55.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.960+0000 7f8a0c84a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080c6fe0 con 0x7f8a0815cf20 2023-12-20T04:46:55.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.960+0000 7f8a0c84a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a080c72c0 con 0x7f8a0815d300 2023-12-20T04:46:55.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f8a0659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a080cd4b0 0x7f8a08158520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f8a0659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a080cd4b0 0x7f8a08158520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56328/0 (socket says 172.21.15.132:56328) 2023-12-20T04:46:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f8a0659c640 1 -- 172.21.15.132:0/1791210335 learned_addr learned my addr 172.21.15.132:0/1791210335 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f8a05d9b640 1 --2- 172.21.15.132:0/1791210335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a0815cf20 0x7f8a0815eeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f8a06d9d640 1 --2- 172.21.15.132:0/1791210335 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a0815d300 0x7f8a0815f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f8a0659c640 1 -- 172.21.15.132:0/1791210335 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a0815d300 msgr2=0x7f8a0815f3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f8a0659c640 1 --2- 172.21.15.132:0/1791210335 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a0815d300 0x7f8a0815f3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f8a0659c640 1 -- 172.21.15.132:0/1791210335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a0815cf20 msgr2=0x7f8a0815eeb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f8a0659c640 1 --2- 172.21.15.132:0/1791210335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a0815cf20 0x7f8a0815eeb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f8a0659c640 1 -- 172.21.15.132:0/1791210335 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a000094d0 con 0x7f8a080cd4b0 2023-12-20T04:46:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f8a05d9b640 1 --2- 172.21.15.132:0/1791210335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a0815cf20 0x7f8a0815eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f8a06d9d640 1 --2- 172.21.15.132:0/1791210335 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a0815d300 0x7f8a0815f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f8a0659c640 1 --2- 172.21.15.132:0/1791210335 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a080cd4b0 0x7f8a08158520 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f8a00000c00 tx=0x7f8a000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f89f6ffd640 1 -- 172.21.15.132:0/1791210335 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a0003ac40 con 0x7f8a080cd4b0 2023-12-20T04:46:55.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f89f6ffd640 1 -- 172.21.15.132:0/1791210335 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a0003adc0 con 0x7f8a080cd4b0 2023-12-20T04:46:55.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f8a0c84a640 1 -- 172.21.15.132:0/1791210335 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a080c75a0 con 0x7f8a080cd4b0 2023-12-20T04:46:55.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f89f6ffd640 1 -- 172.21.15.132:0/1791210335 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a00044630 con 0x7f8a080cd4b0 2023-12-20T04:46:55.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.961+0000 7f8a0c84a640 1 -- 172.21.15.132:0/1791210335 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a080c6270 con 0x7f8a080cd4b0 2023-12-20T04:46:55.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.962+0000 7f8a0c84a640 1 -- 172.21.15.132:0/1791210335 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a0804e840 con 0x7f8a080cd4b0 2023-12-20T04:46:55.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.963+0000 7f89f6ffd640 1 -- 172.21.15.132:0/1791210335 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8a0002f050 con 0x7f8a080cd4b0 2023-12-20T04:46:55.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.963+0000 7f89f6ffd640 1 --2- 172.21.15.132:0/1791210335 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89e806a430 0x7f89e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:55.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.963+0000 7f89f6ffd640 1 -- 172.21.15.132:0/1791210335 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8a000aaa50 con 0x7f8a080cd4b0 2023-12-20T04:46:55.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.963+0000 7f8a05d9b640 1 --2- 172.21.15.132:0/1791210335 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89e806a430 0x7f89e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:55.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.963+0000 7f89f6ffd640 1 -- 172.21.15.132:0/1791210335 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7f89e8072020 con 0x7f8a080cd4b0 2023-12-20T04:46:55.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.964+0000 7f8a05d9b640 1 --2- 172.21.15.132:0/1791210335 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89e806a430 0x7f89e806c8f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8a080c6190 tx=0x7f89fc009570 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:55.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:55.968+0000 7f89f6ffd640 1 -- 172.21.15.132:0/1791210335 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8a00075f60 con 0x7f8a080cd4b0 2023-12-20T04:46:56.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.132+0000 7f8a0c84a640 1 -- 172.21.15.132:0/1791210335 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8a080b2890 con 0x7f8a080cd4b0 2023-12-20T04:46:56.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.132+0000 7f89f6ffd640 1 -- 172.21.15.132:0/1791210335 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8a00031e60 con 0x7f8a080cd4b0 2023-12-20T04:46:56.134 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:46:56.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.134+0000 7f8a0c84a640 1 -- 172.21.15.132:0/1791210335 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89e806a430 msgr2=0x7f89e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:56.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.134+0000 7f8a0c84a640 1 --2- 172.21.15.132:0/1791210335 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89e806a430 0x7f89e806c8f0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7f8a080c6190 tx=0x7f89fc009570 comp rx=0 tx=0).stop 2023-12-20T04:46:56.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.134+0000 7f8a0c84a640 1 -- 172.21.15.132:0/1791210335 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a080cd4b0 msgr2=0x7f8a08158520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:56.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.134+0000 7f8a0c84a640 1 --2- 172.21.15.132:0/1791210335 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a080cd4b0 0x7f8a08158520 secure :-1 s=READY pgs=927 cs=0 l=1 rev1=1 crypto rx=0x7f8a00000c00 tx=0x7f8a000046c0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.134+0000 7f8a0c84a640 1 -- 172.21.15.132:0/1791210335 shutdown_connections 2023-12-20T04:46:56.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.134+0000 7f8a0c84a640 1 --2- 172.21.15.132:0/1791210335 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89e806a430 0x7f89e806c8f0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.134+0000 7f8a0c84a640 1 --2- 172.21.15.132:0/1791210335 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a0815d300 0x7f8a0815f3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.134+0000 7f8a0c84a640 1 --2- 172.21.15.132:0/1791210335 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a0815cf20 0x7f8a0815eeb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.134+0000 7f8a0c84a640 1 --2- 172.21.15.132:0/1791210335 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a080cd4b0 0x7f8a08158520 unknown :-1 s=CLOSED pgs=927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.134+0000 7f8a0c84a640 1 -- 172.21.15.132:0/1791210335 >> 172.21.15.132:0/1791210335 conn(0x7f8a08072c60 msgr2=0x7f8a081611d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:56.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.134+0000 7f8a0c84a640 1 -- 172.21.15.132:0/1791210335 shutdown_connections 2023-12-20T04:46:56.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.134+0000 7f8a0c84a640 1 -- 172.21.15.132:0/1791210335 wait complete. 2023-12-20T04:46:56.147 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:46:56.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.247+0000 7fc111f11640 1 Processor -- start 2023-12-20T04:46:56.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.247+0000 7fc111f11640 1 -- start start 2023-12-20T04:46:56.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc111f11640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc10c0ca170 0x7fc10c0ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:56.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc111f11640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c069c30 0x7fc10c06a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:56.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc111f11640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc10c0c4f40 con 0x7fc10c1447b0 2023-12-20T04:46:56.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc111f11640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc10c06a600 con 0x7fc10c0ca170 2023-12-20T04:46:56.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc111f11640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c0c6380 con 0x7fc10c069c30 2023-12-20T04:46:56.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10b7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc10c1447b0 0x7fc10c0c5c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46584/0 (socket says 172.21.15.132:46584) 2023-12-20T04:46:56.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10b7fe640 1 -- 172.21.15.132:0/971931538 learned_addr learned my addr 172.21.15.132:0/971931538 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:56.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10a7fc640 1 -- 172.21.15.132:0/971931538 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2814832104 0 0) 0x7fc10c0c4f40 con 0x7fc10c1447b0 2023-12-20T04:46:56.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10bfff640 1 --2- 172.21.15.132:0/971931538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c069c30 0x7fc10c06a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:56.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10affd640 1 --2- 172.21.15.132:0/971931538 >> v2:172.21.15.187:3300/0 conn(0x7fc10c0ca170 0x7fc10c0ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:56.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10a7fc640 1 -- 172.21.15.132:0/971931538 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc0f4003520 con 0x7fc10c1447b0 2023-12-20T04:46:56.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10a7fc640 1 -- 172.21.15.132:0/971931538 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 460935015 0 0) 0x7fc0f4003520 con 0x7fc10c1447b0 2023-12-20T04:46:56.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10a7fc640 1 -- 172.21.15.132:0/971931538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c069c30 msgr2=0x7fc10c06a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:56.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10a7fc640 1 --2- 172.21.15.132:0/971931538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c069c30 0x7fc10c06a0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10a7fc640 1 -- 172.21.15.132:0/971931538 >> v2:172.21.15.187:3300/0 conn(0x7fc10c0ca170 msgr2=0x7fc10c0ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:56.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10a7fc640 1 --2- 172.21.15.132:0/971931538 >> v2:172.21.15.187:3300/0 conn(0x7fc10c0ca170 0x7fc10c0ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10a7fc640 1 -- 172.21.15.132:0/971931538 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c144b90 con 0x7fc10c1447b0 2023-12-20T04:46:56.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10a7fc640 1 -- 172.21.15.132:0/971931538 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fc0fc001670 con 0x7fc10c1447b0 2023-12-20T04:46:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10a7fc640 1 -- 172.21.15.132:0/971931538 >> v1:172.21.15.132:6789/0 conn(0x7fc10c1447b0 legacy=0x7fc10c0c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10a7fc640 1 --2- 172.21.15.132:0/971931538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0f40039a0 0x7fc0f4003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10a7fc640 1 --2- 172.21.15.132:0/971931538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c069c30 0x7fc0f40047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10a7fc640 1 --2- 172.21.15.132:0/971931538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f4004d00 0x7fc0f4005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10a7fc640 1 -- 172.21.15.132:0/971931538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c06a600 con 0x7fc0f40039a0 2023-12-20T04:46:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10a7fc640 1 -- 172.21.15.132:0/971931538 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c0c6380 con 0x7fc0f4004d00 2023-12-20T04:46:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.248+0000 7fc10a7fc640 1 -- 172.21.15.132:0/971931538 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0f400b9b0 con 0x7fc10c069c30 2023-12-20T04:46:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.249+0000 7fc10b7fe640 1 --2- 172.21.15.132:0/971931538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0f40039a0 0x7fc0f4003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.249+0000 7fc10affd640 1 --2- 172.21.15.132:0/971931538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c069c30 0x7fc0f40047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.249+0000 7fc10bfff640 1 --2- 172.21.15.132:0/971931538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f4004d00 0x7fc0f4005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.249+0000 7fc10b7fe640 1 -- 172.21.15.132:0/971931538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c069c30 msgr2=0x7fc0f40047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.249+0000 7fc10b7fe640 1 --2- 172.21.15.132:0/971931538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c069c30 0x7fc0f40047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.249+0000 7fc10b7fe640 1 -- 172.21.15.132:0/971931538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f4004d00 msgr2=0x7fc0f4005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:56.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.249+0000 7fc10b7fe640 1 --2- 172.21.15.132:0/971931538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f4004d00 0x7fc0f4005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.249+0000 7fc10b7fe640 1 -- 172.21.15.132:0/971931538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0f4003520 con 0x7fc0f40039a0 2023-12-20T04:46:56.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.249+0000 7fc10b7fe640 1 --2- 172.21.15.132:0/971931538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0f40039a0 0x7fc0f4003dc0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00c160 tx=0x7fc0f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876d772da9a3121c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:56.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.250+0000 7fc10a7fc640 1 -- 172.21.15.132:0/971931538 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc005ad0 con 0x7fc0f40039a0 2023-12-20T04:46:56.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.250+0000 7fc10a7fc640 1 -- 172.21.15.132:0/971931538 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0fc005c50 con 0x7fc0f40039a0 2023-12-20T04:46:56.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.250+0000 7fc10a7fc640 1 -- 172.21.15.132:0/971931538 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0fc02c870 con 0x7fc0f40039a0 2023-12-20T04:46:56.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.250+0000 7fc111f11640 1 -- 172.21.15.132:0/971931538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0f40039a0 msgr2=0x7fc0f4003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:56.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.250+0000 7fc111f11640 1 --2- 172.21.15.132:0/971931538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0f40039a0 0x7fc0f4003dc0 secure :-1 s=READY pgs=929 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc00c160 tx=0x7fc0f40057f0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.250+0000 7fc10bfff640 1 -- 172.21.15.132:0/971931538 reap_dead start 2023-12-20T04:46:56.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.250+0000 7fc111f11640 1 -- 172.21.15.132:0/971931538 shutdown_connections 2023-12-20T04:46:56.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.250+0000 7fc111f11640 1 -- 172.21.15.132:0/971931538 >> 172.21.15.132:0/971931538 conn(0x7fc10c0cc630 msgr2=0x7fc10c0cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:56.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.250+0000 7fc111f11640 1 -- 172.21.15.132:0/971931538 shutdown_connections 2023-12-20T04:46:56.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.250+0000 7fc111f11640 1 -- 172.21.15.132:0/971931538 wait complete. 2023-12-20T04:46:56.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.251+0000 7fc111f11640 1 Processor -- start 2023-12-20T04:46:56.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.252+0000 7fc111f11640 1 -- start start 2023-12-20T04:46:56.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.252+0000 7fc111f11640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f40039a0 0x7fc10c0c80d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:56.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.252+0000 7fc111f11640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c15adf0 0x7fc10c15a6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:56.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.252+0000 7fc111f11640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc10c141cd0 0x7fc10c0b3eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:56.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.252+0000 7fc111f11640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c142180 con 0x7fc10c141cd0 2023-12-20T04:46:56.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.252+0000 7fc111f11640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c1f5cf0 con 0x7fc0f40039a0 2023-12-20T04:46:56.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.252+0000 7fc111f11640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc10c1f5fd0 con 0x7fc10c15adf0 2023-12-20T04:46:56.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.252+0000 7fc10bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc10c141cd0 0x7fc10c0b3eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.252+0000 7fc10bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc10c141cd0 0x7fc10c0b3eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56336/0 (socket says 172.21.15.132:56336) 2023-12-20T04:46:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.252+0000 7fc10bfff640 1 -- 172.21.15.132:0/1310707282 learned_addr learned my addr 172.21.15.132:0/1310707282 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.252+0000 7fc10affd640 1 --2- 172.21.15.132:0/1310707282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c15adf0 0x7fc10c15a6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.252+0000 7fc10b7fe640 1 --2- 172.21.15.132:0/1310707282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f40039a0 0x7fc10c0c80d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.253+0000 7fc10bfff640 1 -- 172.21.15.132:0/1310707282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c15adf0 msgr2=0x7fc10c15a6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.253+0000 7fc10bfff640 1 --2- 172.21.15.132:0/1310707282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c15adf0 0x7fc10c15a6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.253+0000 7fc10bfff640 1 -- 172.21.15.132:0/1310707282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f40039a0 msgr2=0x7fc10c0c80d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.253+0000 7fc10bfff640 1 --2- 172.21.15.132:0/1310707282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f40039a0 0x7fc10c0c80d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.253+0000 7fc10bfff640 1 -- 172.21.15.132:0/1310707282 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc10c1f62b0 con 0x7fc10c141cd0 2023-12-20T04:46:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.253+0000 7fc10b7fe640 1 --2- 172.21.15.132:0/1310707282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f40039a0 0x7fc10c0c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.253+0000 7fc10bfff640 1 --2- 172.21.15.132:0/1310707282 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc10c141cd0 0x7fc10c0b3eb0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc10c144df0 tx=0x7fc10400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.253+0000 7fc0f3fff640 1 -- 172.21.15.132:0/1310707282 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc10400e040 con 0x7fc10c141cd0 2023-12-20T04:46:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.253+0000 7fc0f3fff640 1 -- 172.21.15.132:0/1310707282 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc10400f040 con 0x7fc10c141cd0 2023-12-20T04:46:56.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.253+0000 7fc0f3fff640 1 -- 172.21.15.132:0/1310707282 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc104015430 con 0x7fc10c141cd0 2023-12-20T04:46:56.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.253+0000 7fc111f11640 1 -- 172.21.15.132:0/1310707282 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc10c1f6590 con 0x7fc10c141cd0 2023-12-20T04:46:56.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.253+0000 7fc111f11640 1 -- 172.21.15.132:0/1310707282 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc10c1f6b50 con 0x7fc10c141cd0 2023-12-20T04:46:56.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.254+0000 7fc111f11640 1 -- 172.21.15.132:0/1310707282 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc10c04e840 con 0x7fc10c141cd0 2023-12-20T04:46:56.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.254+0000 7fc0f3fff640 1 -- 172.21.15.132:0/1310707282 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc104015590 con 0x7fc10c141cd0 2023-12-20T04:46:56.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.255+0000 7fc0f3fff640 1 --2- 172.21.15.132:0/1310707282 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc0f806a460 0x7fc0f806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:56.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.255+0000 7fc0f3fff640 1 -- 172.21.15.132:0/1310707282 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc1040890a0 con 0x7fc10c141cd0 2023-12-20T04:46:56.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.255+0000 7fc10b7fe640 1 --2- 172.21.15.132:0/1310707282 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc0f806a460 0x7fc0f806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:56.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.255+0000 7fc0f3fff640 1 -- 172.21.15.132:0/1310707282 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7fc0f8072050 con 0x7fc10c141cd0 2023-12-20T04:46:56.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.255+0000 7fc10b7fe640 1 --2- 172.21.15.132:0/1310707282 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc0f806a460 0x7fc0f806c920 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc034000 tx=0x7fc0fc007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:56.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.259+0000 7fc0f3fff640 1 -- 172.21.15.132:0/1310707282 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc104054650 con 0x7fc10c141cd0 2023-12-20T04:46:56.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.423+0000 7fc111f11640 1 -- 172.21.15.132:0/1310707282 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc10c0c7eb0 con 0x7fc10c141cd0 2023-12-20T04:46:56.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.424+0000 7fc0f3fff640 1 -- 172.21.15.132:0/1310707282 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc104057c70 con 0x7fc10c141cd0 2023-12-20T04:46:56.426 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:46:56.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.426+0000 7fc111f11640 1 -- 172.21.15.132:0/1310707282 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc0f806a460 msgr2=0x7fc0f806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:56.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.426+0000 7fc111f11640 1 --2- 172.21.15.132:0/1310707282 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc0f806a460 0x7fc0f806c920 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fc0fc034000 tx=0x7fc0fc007000 comp rx=0 tx=0).stop 2023-12-20T04:46:56.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.426+0000 7fc111f11640 1 -- 172.21.15.132:0/1310707282 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc10c141cd0 msgr2=0x7fc10c0b3eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:56.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.426+0000 7fc111f11640 1 --2- 172.21.15.132:0/1310707282 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc10c141cd0 0x7fc10c0b3eb0 secure :-1 s=READY pgs=930 cs=0 l=1 rev1=1 crypto rx=0x7fc10c144df0 tx=0x7fc10400f580 comp rx=0 tx=0).stop 2023-12-20T04:46:56.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.426+0000 7fc111f11640 1 -- 172.21.15.132:0/1310707282 shutdown_connections 2023-12-20T04:46:56.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.426+0000 7fc111f11640 1 --2- 172.21.15.132:0/1310707282 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc0f806a460 0x7fc0f806c920 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.426+0000 7fc111f11640 1 --2- 172.21.15.132:0/1310707282 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc10c141cd0 0x7fc10c0b3eb0 unknown :-1 s=CLOSED pgs=930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.426+0000 7fc111f11640 1 --2- 172.21.15.132:0/1310707282 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc10c15adf0 0x7fc10c15a6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.426+0000 7fc111f11640 1 --2- 172.21.15.132:0/1310707282 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0f40039a0 0x7fc10c0c80d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.426+0000 7fc111f11640 1 -- 172.21.15.132:0/1310707282 >> 172.21.15.132:0/1310707282 conn(0x7fc10c0cc630 msgr2=0x7fc10c0cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:56.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.426+0000 7fc111f11640 1 -- 172.21.15.132:0/1310707282 shutdown_connections 2023-12-20T04:46:56.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.426+0000 7fc111f11640 1 -- 172.21.15.132:0/1310707282 wait complete. 2023-12-20T04:46:56.439 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:46:56.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.539+0000 7fd6e7fd2640 1 Processor -- start 2023-12-20T04:46:56.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.539+0000 7fd6e7fd2640 1 -- start start 2023-12-20T04:46:56.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.540+0000 7fd6e7fd2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e0159bb0 0x7fd6e006f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:56.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.540+0000 7fd6e7fd2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6e00ad720 0x7fd6e006b490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:56.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.540+0000 7fd6e7fd2640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6e006c8e0 con 0x7fd6e00ade00 2023-12-20T04:46:56.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.540+0000 7fd6e7fd2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6e015e420 con 0x7fd6e00ad720 2023-12-20T04:46:56.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.540+0000 7fd6e7fd2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e015e700 con 0x7fd6e0159bb0 2023-12-20T04:46:56.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.540+0000 7fd6e556d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6e00ad720 0x7fd6e006b490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:56.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.540+0000 7fd6e556d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6e00ad720 0x7fd6e006b490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56340/0 (socket says 172.21.15.132:56340) 2023-12-20T04:46:56.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.540+0000 7fd6e556d640 1 -- 172.21.15.132:0/182517841 learned_addr learned my addr 172.21.15.132:0/182517841 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:56.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.540+0000 7fd6e5d6e640 1 --2- 172.21.15.132:0/182517841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e0159bb0 0x7fd6e006f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:56.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.540+0000 7fd6e556d640 1 -- 172.21.15.132:0/182517841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e0159bb0 msgr2=0x7fd6e006f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:56.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.540+0000 7fd6e556d640 1 --2- 172.21.15.132:0/182517841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e0159bb0 0x7fd6e006f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.540+0000 7fd6e556d640 1 -- 172.21.15.132:0/182517841 >> v1:172.21.15.187:6789/0 conn(0x7fd6e00ade00 legacy=0x7fd6e00ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:56.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.540+0000 7fd6e556d640 1 -- 172.21.15.132:0/182517841 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6e00c9d10 con 0x7fd6e00ad720 2023-12-20T04:46:56.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.541+0000 7fd6e556d640 1 --2- 172.21.15.132:0/182517841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e00ad720 0x7fd6e006b490 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009870 tx=0x7fd6d002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd4cb4e278bf0056 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:56.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.541+0000 7fd6e4d6c640 1 -- 172.21.15.132:0/182517841 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0030840 con 0x7fd6e00ad720 2023-12-20T04:46:56.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.541+0000 7fd6e4d6c640 1 -- 172.21.15.132:0/182517841 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6d00309a0 con 0x7fd6e00ad720 2023-12-20T04:46:56.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.541+0000 7fd6e4d6c640 1 -- 172.21.15.132:0/182517841 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6d0030d30 con 0x7fd6e00ad720 2023-12-20T04:46:56.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.542+0000 7fd6e7fd2640 1 -- 172.21.15.132:0/182517841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e00ad720 msgr2=0x7fd6e006b490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:56.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.542+0000 7fd6e7fd2640 1 --2- 172.21.15.132:0/182517841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e00ad720 0x7fd6e006b490 secure :-1 s=READY pgs=931 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0009870 tx=0x7fd6d002b980 comp rx=0 tx=0).stop 2023-12-20T04:46:56.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.542+0000 7fd6e7fd2640 1 -- 172.21.15.132:0/182517841 shutdown_connections 2023-12-20T04:46:56.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.542+0000 7fd6e7fd2640 1 --2- 172.21.15.132:0/182517841 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e00ad720 0x7fd6e006b490 unknown :-1 s=CLOSED pgs=931 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.542+0000 7fd6e7fd2640 1 --2- 172.21.15.132:0/182517841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e0159bb0 0x7fd6e006f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.542+0000 7fd6e7fd2640 1 -- 172.21.15.132:0/182517841 >> 172.21.15.132:0/182517841 conn(0x7fd6e006a260 msgr2=0x7fd6e00b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:56.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.542+0000 7fd6e7fd2640 1 -- 172.21.15.132:0/182517841 shutdown_connections 2023-12-20T04:46:56.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.542+0000 7fd6e7fd2640 1 -- 172.21.15.132:0/182517841 wait complete. 2023-12-20T04:46:56.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.543+0000 7fd6e7fd2640 1 Processor -- start 2023-12-20T04:46:56.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.543+0000 7fd6e7fd2640 1 -- start start 2023-12-20T04:46:56.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.543+0000 7fd6e7fd2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e00ad720 0x7fd6e00cb8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:56.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.543+0000 7fd6e7fd2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e00ade00 0x7fd6e00caed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:56.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.543+0000 7fd6e7fd2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e0159bb0 0x7fd6e00af790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:56.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6e7fd2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e00caab0 con 0x7fd6e00ad720 2023-12-20T04:46:56.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6e7fd2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e00affe0 con 0x7fd6e0159bb0 2023-12-20T04:46:56.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6e7fd2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6e00b02c0 con 0x7fd6e00ade00 2023-12-20T04:46:56.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6e5d6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e00ad720 0x7fd6e00cb8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:56.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6e5d6e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e00ad720 0x7fd6e00cb8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56346/0 (socket says 172.21.15.132:56346) 2023-12-20T04:46:56.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6e5d6e640 1 -- 172.21.15.132:0/643260524 learned_addr learned my addr 172.21.15.132:0/643260524 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:56.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6e556d640 1 --2- 172.21.15.132:0/643260524 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e00ade00 0x7fd6e00caed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:56.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6e656f640 1 --2- 172.21.15.132:0/643260524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e0159bb0 0x7fd6e00af790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:56.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6e5d6e640 1 -- 172.21.15.132:0/643260524 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e00ade00 msgr2=0x7fd6e00caed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:56.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6e5d6e640 1 --2- 172.21.15.132:0/643260524 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e00ade00 0x7fd6e00caed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6e5d6e640 1 -- 172.21.15.132:0/643260524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e0159bb0 msgr2=0x7fd6e00af790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:56.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6e5d6e640 1 --2- 172.21.15.132:0/643260524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e0159bb0 0x7fd6e00af790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6e5d6e640 1 -- 172.21.15.132:0/643260524 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6d00094d0 con 0x7fd6e00ad720 2023-12-20T04:46:56.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6e5d6e640 1 --2- 172.21.15.132:0/643260524 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e00ad720 0x7fd6e00cb8e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00d5f0 tx=0x7fd6dc00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:56.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6d67fc640 1 -- 172.21.15.132:0/643260524 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc0125f0 con 0x7fd6e00ad720 2023-12-20T04:46:56.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6d67fc640 1 -- 172.21.15.132:0/643260524 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6dc012750 con 0x7fd6e00ad720 2023-12-20T04:46:56.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6e7fd2640 1 -- 172.21.15.132:0/643260524 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6e00ca3f0 con 0x7fd6e00ad720 2023-12-20T04:46:56.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6d67fc640 1 -- 172.21.15.132:0/643260524 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6dc012b00 con 0x7fd6e00ad720 2023-12-20T04:46:56.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.544+0000 7fd6e7fd2640 1 -- 172.21.15.132:0/643260524 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6e00afcd0 con 0x7fd6e00ad720 2023-12-20T04:46:56.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.545+0000 7fd6e7fd2640 1 -- 172.21.15.132:0/643260524 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6e004e840 con 0x7fd6e00ad720 2023-12-20T04:46:56.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.546+0000 7fd6d67fc640 1 -- 172.21.15.132:0/643260524 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd6dc012c60 con 0x7fd6e00ad720 2023-12-20T04:46:56.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.546+0000 7fd6d67fc640 1 --2- 172.21.15.132:0/643260524 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6c406a430 0x7fd6c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:56.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.546+0000 7fd6e556d640 1 --2- 172.21.15.132:0/643260524 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6c406a430 0x7fd6c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:56.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.546+0000 7fd6d67fc640 1 -- 172.21.15.132:0/643260524 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd6dc088d90 con 0x7fd6e00ad720 2023-12-20T04:46:56.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.546+0000 7fd6d67fc640 1 -- 172.21.15.132:0/643260524 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7fd6c4072020 con 0x7fd6e00ad720 2023-12-20T04:46:56.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.546+0000 7fd6e556d640 1 --2- 172.21.15.132:0/643260524 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6c406a430 0x7fd6c406c8f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0036000 tx=0x7fd6d0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:56.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.550+0000 7fd6d67fc640 1 -- 172.21.15.132:0/643260524 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd6dc0543d0 con 0x7fd6e00ad720 2023-12-20T04:46:56.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.728+0000 7fd6e7fd2640 1 -- 172.21.15.132:0/643260524 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd6e00cad20 con 0x7fd6e00ad720 2023-12-20T04:46:56.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.728+0000 7fd6d67fc640 1 -- 172.21.15.132:0/643260524 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v86) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd6dc0579f0 con 0x7fd6e00ad720 2023-12-20T04:46:56.730 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:46:56.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.730+0000 7fd6e7fd2640 1 -- 172.21.15.132:0/643260524 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6c406a430 msgr2=0x7fd6c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:56.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.730+0000 7fd6e7fd2640 1 --2- 172.21.15.132:0/643260524 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6c406a430 0x7fd6c406c8f0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fd6d0036000 tx=0x7fd6d0008030 comp rx=0 tx=0).stop 2023-12-20T04:46:56.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.730+0000 7fd6e7fd2640 1 -- 172.21.15.132:0/643260524 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e00ad720 msgr2=0x7fd6e00cb8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:56.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.730+0000 7fd6e7fd2640 1 --2- 172.21.15.132:0/643260524 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e00ad720 0x7fd6e00cb8e0 secure :-1 s=READY pgs=932 cs=0 l=1 rev1=1 crypto rx=0x7fd6dc00d5f0 tx=0x7fd6dc00dab0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.730+0000 7fd6e7fd2640 1 -- 172.21.15.132:0/643260524 shutdown_connections 2023-12-20T04:46:56.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.730+0000 7fd6e7fd2640 1 --2- 172.21.15.132:0/643260524 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6c406a430 0x7fd6c406c8f0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.730+0000 7fd6e7fd2640 1 --2- 172.21.15.132:0/643260524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6e0159bb0 0x7fd6e00af790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.730+0000 7fd6e7fd2640 1 --2- 172.21.15.132:0/643260524 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6e00ade00 0x7fd6e00caed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.730+0000 7fd6e7fd2640 1 --2- 172.21.15.132:0/643260524 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6e00ad720 0x7fd6e00cb8e0 unknown :-1 s=CLOSED pgs=932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:56.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.730+0000 7fd6e7fd2640 1 -- 172.21.15.132:0/643260524 >> 172.21.15.132:0/643260524 conn(0x7fd6e006a260 msgr2=0x7fd6e00c4590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:56.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.730+0000 7fd6e7fd2640 1 -- 172.21.15.132:0/643260524 shutdown_connections 2023-12-20T04:46:56.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.730+0000 7fd6e7fd2640 1 -- 172.21.15.132:0/643260524 wait complete. 2023-12-20T04:46:56.743 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2023-12-20T04:46:56.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:56.743 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-20T04:46:56.768 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[104273]: fuse finished with error 0 and tester_r 0 2023-12-20T04:46:56.774 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:46:56.774 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:56.775 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-20T04:46:56.861 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:46:56.861 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:46:56.880 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:46:57.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.998+0000 7f3ae6f4e640 1 Processor -- start 2023-12-20T04:46:57.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.998+0000 7f3ae6f4e640 1 -- start start 2023-12-20T04:46:57.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.999+0000 7f3ae6f4e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae015d100 0x7f3ae00b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.999+0000 7f3ae6f4e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae00b2f90 con 0x7f3ae00d0370 2023-12-20T04:46:57.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.999+0000 7f3ae6f4e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ae01613c0 con 0x7f3ae00cdc10 2023-12-20T04:46:57.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.999+0000 7f3ae6f4e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00d1b00 con 0x7f3ae015d100 2023-12-20T04:46:57.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.999+0000 7f3adffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3ae00d0370 0x7f3ae00cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46590/0 (socket says 172.21.15.132:46590) 2023-12-20T04:46:57.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.999+0000 7f3adffff640 1 -- 172.21.15.132:0/3602195745 learned_addr learned my addr 172.21.15.132:0/3602195745 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:57.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:56.999+0000 7f3ae4cea640 1 --2- 172.21.15.132:0/3602195745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae015d100 0x7f3ae00b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adf7fe640 1 -- 172.21.15.132:0/3602195745 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 72275477 0 0) 0x7f3ad4001110 con 0x7f3ae00d0370 2023-12-20T04:46:57.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adf7fe640 1 -- 172.21.15.132:0/3602195745 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ac8003520 con 0x7f3ae00d0370 2023-12-20T04:46:57.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adf7fe640 1 -- 172.21.15.132:0/3602195745 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749131251 0 0) 0x7f3ae01613c0 con 0x7f3ae00cdc10 2023-12-20T04:46:57.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adf7fe640 1 -- 172.21.15.132:0/3602195745 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ad4001110 con 0x7f3ae00cdc10 2023-12-20T04:46:57.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adf7fe640 1 -- 172.21.15.132:0/3602195745 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 874772759 0 0) 0x7f3ac8003520 con 0x7f3ae00d0370 2023-12-20T04:46:57.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adf7fe640 1 -- 172.21.15.132:0/3602195745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae015d100 msgr2=0x7f3ae00b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:57.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adf7fe640 1 --2- 172.21.15.132:0/3602195745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae015d100 0x7f3ae00b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adf7fe640 1 -- 172.21.15.132:0/3602195745 >> v1:172.21.15.187:6789/0 conn(0x7f3ae00cdc10 legacy=0x7f3ae006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adf7fe640 1 -- 172.21.15.132:0/3602195745 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae00d0810 con 0x7f3ae00d0370 2023-12-20T04:46:57.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adf7fe640 1 -- 172.21.15.132:0/3602195745 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f3ad4001800 con 0x7f3ae00d0370 2023-12-20T04:46:57.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adf7fe640 1 -- 172.21.15.132:0/3602195745 >> v1:172.21.15.132:6789/0 conn(0x7f3ae00d0370 legacy=0x7f3ae00cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adf7fe640 1 --2- 172.21.15.132:0/3602195745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae015d100 0x7f3ac8003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adf7fe640 1 --2- 172.21.15.132:0/3602195745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ac80040e0 0x7f3ac80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adf7fe640 1 --2- 172.21.15.132:0/3602195745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ac8004d00 0x7f3ac8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adf7fe640 1 -- 172.21.15.132:0/3602195745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00d1b00 con 0x7f3ac8004d00 2023-12-20T04:46:57.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adf7fe640 1 -- 172.21.15.132:0/3602195745 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac800bb40 con 0x7f3ac80040e0 2023-12-20T04:46:57.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adf7fe640 1 -- 172.21.15.132:0/3602195745 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ac800bd00 con 0x7f3ae015d100 2023-12-20T04:46:57.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3ae54eb640 1 --2- 172.21.15.132:0/3602195745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ac8004d00 0x7f3ac8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3ae4cea640 1 --2- 172.21.15.132:0/3602195745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae015d100 0x7f3ac8003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3adffff640 1 --2- 172.21.15.132:0/3602195745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ac80040e0 0x7f3ac80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3ae54eb640 1 -- 172.21.15.132:0/3602195745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae015d100 msgr2=0x7f3ac8003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:57.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3ae54eb640 1 --2- 172.21.15.132:0/3602195745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae015d100 0x7f3ac8003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3ae54eb640 1 -- 172.21.15.132:0/3602195745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ac80040e0 msgr2=0x7f3ac80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:57.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3ae54eb640 1 --2- 172.21.15.132:0/3602195745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ac80040e0 0x7f3ac80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.000+0000 7f3ae54eb640 1 -- 172.21.15.132:0/3602195745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ac8003520 con 0x7f3ac8004d00 2023-12-20T04:46:57.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.001+0000 7f3ae54eb640 1 --2- 172.21.15.132:0/3602195745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ac8004d00 0x7f3ac8005180 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8001fa0 tx=0x7f3ac80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ad652774e280ec2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:57.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.001+0000 7f3adf7fe640 1 -- 172.21.15.132:0/3602195745 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8003b70 con 0x7f3ac8004d00 2023-12-20T04:46:57.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.001+0000 7f3adf7fe640 1 -- 172.21.15.132:0/3602195745 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad8003cd0 con 0x7f3ac8004d00 2023-12-20T04:46:57.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.001+0000 7f3adf7fe640 1 -- 172.21.15.132:0/3602195745 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad80052f0 con 0x7f3ac8004d00 2023-12-20T04:46:57.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.002+0000 7f3ae6f4e640 1 -- 172.21.15.132:0/3602195745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ac8004d00 msgr2=0x7f3ac8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.002+0000 7f3ae6f4e640 1 --2- 172.21.15.132:0/3602195745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ac8004d00 0x7f3ac8005180 secure :-1 s=READY pgs=934 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8001fa0 tx=0x7f3ac80057f0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.002+0000 7f3ae54eb640 1 -- 172.21.15.132:0/3602195745 reap_dead start 2023-12-20T04:46:57.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.002+0000 7f3ae6f4e640 1 -- 172.21.15.132:0/3602195745 shutdown_connections 2023-12-20T04:46:57.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.002+0000 7f3ae6f4e640 1 -- 172.21.15.132:0/3602195745 >> 172.21.15.132:0/3602195745 conn(0x7f3ae006d7c0 msgr2=0x7f3ae006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:57.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.002+0000 7f3ae6f4e640 1 -- 172.21.15.132:0/3602195745 shutdown_connections 2023-12-20T04:46:57.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.002+0000 7f3ae6f4e640 1 -- 172.21.15.132:0/3602195745 wait complete. 2023-12-20T04:46:57.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.003+0000 7f3ae6f4e640 1 Processor -- start 2023-12-20T04:46:57.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.003+0000 7f3ae6f4e640 1 -- start start 2023-12-20T04:46:57.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae6f4e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ac8004d00 0x7f3ae00c93e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae6f4e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae014b9c0 0x7f3ae00adc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae6f4e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae00ae1d0 0x7f3ae01e8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae6f4e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00af810 con 0x7f3ae00ae1d0 2023-12-20T04:46:57.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae6f4e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00af380 con 0x7f3ac8004d00 2023-12-20T04:46:57.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae6f4e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae00c9920 con 0x7f3ae014b9c0 2023-12-20T04:46:57.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae54eb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae00ae1d0 0x7f3ae01e8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae54eb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae00ae1d0 0x7f3ae01e8a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56376/0 (socket says 172.21.15.132:56376) 2023-12-20T04:46:57.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae54eb640 1 -- 172.21.15.132:0/2766633109 learned_addr learned my addr 172.21.15.132:0/2766633109 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:57.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae4cea640 1 --2- 172.21.15.132:0/2766633109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ac8004d00 0x7f3ae00c93e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3adffff640 1 --2- 172.21.15.132:0/2766633109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae014b9c0 0x7f3ae00adc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae54eb640 1 -- 172.21.15.132:0/2766633109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae014b9c0 msgr2=0x7f3ae00adc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae54eb640 1 --2- 172.21.15.132:0/2766633109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae014b9c0 0x7f3ae00adc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae54eb640 1 -- 172.21.15.132:0/2766633109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ac8004d00 msgr2=0x7f3ae00c93e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae54eb640 1 --2- 172.21.15.132:0/2766633109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ac8004d00 0x7f3ae00c93e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae54eb640 1 -- 172.21.15.132:0/2766633109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ae00ae770 con 0x7f3ae00ae1d0 2023-12-20T04:46:57.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae4cea640 1 --2- 172.21.15.132:0/2766633109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ac8004d00 0x7f3ae00c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:57.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae54eb640 1 --2- 172.21.15.132:0/2766633109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae00ae1d0 0x7f3ae01e8a40 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8001fa0 tx=0x7f3ad8001650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:57.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3add7fa640 1 -- 172.21.15.132:0/2766633109 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad8005600 con 0x7f3ae00ae1d0 2023-12-20T04:46:57.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3add7fa640 1 -- 172.21.15.132:0/2766633109 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ad8005760 con 0x7f3ae00ae1d0 2023-12-20T04:46:57.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3ae6f4e640 1 -- 172.21.15.132:0/2766633109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae00aea50 con 0x7f3ae00ae1d0 2023-12-20T04:46:57.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.004+0000 7f3add7fa640 1 -- 172.21.15.132:0/2766633109 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ad802c740 con 0x7f3ae00ae1d0 2023-12-20T04:46:57.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.005+0000 7f3ae6f4e640 1 -- 172.21.15.132:0/2766633109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae00af010 con 0x7f3ae00ae1d0 2023-12-20T04:46:57.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.005+0000 7f3ae6f4e640 1 -- 172.21.15.132:0/2766633109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae0160d50 con 0x7f3ae00ae1d0 2023-12-20T04:46:57.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.006+0000 7f3add7fa640 1 -- 172.21.15.132:0/2766633109 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3ad802c8a0 con 0x7f3ae00ae1d0 2023-12-20T04:46:57.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.006+0000 7f3add7fa640 1 --2- 172.21.15.132:0/2766633109 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3acc06a430 0x7f3acc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.006+0000 7f3add7fa640 1 -- 172.21.15.132:0/2766633109 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3ad80a9820 con 0x7f3ae00ae1d0 2023-12-20T04:46:57.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.006+0000 7f3ae4cea640 1 --2- 172.21.15.132:0/2766633109 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3acc06a430 0x7f3acc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.006+0000 7f3add7fa640 1 -- 172.21.15.132:0/2766633109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7f3acc072020 con 0x7f3ae00ae1d0 2023-12-20T04:46:57.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.007+0000 7f3ae4cea640 1 --2- 172.21.15.132:0/2766633109 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3acc06a430 0x7f3acc06c8f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00ca2e0 tx=0x7f3ad0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:57.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.011+0000 7f3add7fa640 1 -- 172.21.15.132:0/2766633109 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3ae0160d50 con 0x7f3ae00ae1d0 2023-12-20T04:46:57.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.178+0000 7f3ae6f4e640 1 -- 172.21.15.132:0/2766633109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3ae0160d50 con 0x7f3ae00ae1d0 2023-12-20T04:46:57.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.179+0000 7f3add7fa640 1 -- 172.21.15.132:0/2766633109 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16288 (secure 0 0 0) 0x7f3ae0160d50 con 0x7f3ae00ae1d0 2023-12-20T04:46:57.181 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:57.182 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":86,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:46:42.871118+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:46:20.852337+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-20T04:46:21.431144+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:46:57.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.181+0000 7f3ae6f4e640 1 -- 172.21.15.132:0/2766633109 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3acc06a430 msgr2=0x7f3acc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.181+0000 7f3ae6f4e640 1 --2- 172.21.15.132:0/2766633109 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3acc06a430 0x7f3acc06c8f0 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7f3ae00ca2e0 tx=0x7f3ad0008040 comp rx=0 tx=0).stop 2023-12-20T04:46:57.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.181+0000 7f3ae6f4e640 1 -- 172.21.15.132:0/2766633109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae00ae1d0 msgr2=0x7f3ae01e8a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.181+0000 7f3ae6f4e640 1 --2- 172.21.15.132:0/2766633109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae00ae1d0 0x7f3ae01e8a40 secure :-1 s=READY pgs=935 cs=0 l=1 rev1=1 crypto rx=0x7f3ad8001fa0 tx=0x7f3ad8001650 comp rx=0 tx=0).stop 2023-12-20T04:46:57.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.181+0000 7f3ae6f4e640 1 -- 172.21.15.132:0/2766633109 shutdown_connections 2023-12-20T04:46:57.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.181+0000 7f3ae6f4e640 1 --2- 172.21.15.132:0/2766633109 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3acc06a430 0x7f3acc06c8f0 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.181+0000 7f3ae6f4e640 1 --2- 172.21.15.132:0/2766633109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ae00ae1d0 0x7f3ae01e8a40 unknown :-1 s=CLOSED pgs=935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.181+0000 7f3ae6f4e640 1 --2- 172.21.15.132:0/2766633109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ae014b9c0 0x7f3ae00adc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.181+0000 7f3ae6f4e640 1 --2- 172.21.15.132:0/2766633109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ac8004d00 0x7f3ae00c93e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.181+0000 7f3ae6f4e640 1 -- 172.21.15.132:0/2766633109 >> 172.21.15.132:0/2766633109 conn(0x7f3ae006d7c0 msgr2=0x7f3ae00b1bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:57.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.181+0000 7f3ae6f4e640 1 -- 172.21.15.132:0/2766633109 shutdown_connections 2023-12-20T04:46:57.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.181+0000 7f3ae6f4e640 1 -- 172.21.15.132:0/2766633109 wait complete. 2023-12-20T04:46:57.194 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:46:20.852337+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:46:21.431144+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:46:57.195 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:46:57.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.296+0000 7f36af07a640 1 Processor -- start 2023-12-20T04:46:57.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.296+0000 7f36af07a640 1 -- start start 2023-12-20T04:46:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36af07a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36a8143610 0x7f36a80caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36af07a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f36a80cd950 0x7f36a806b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36af07a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36a81439f0 con 0x7f36a80c41f0 2023-12-20T04:46:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36af07a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f36a80c46f0 con 0x7f36a80cd950 2023-12-20T04:46:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36af07a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80c49d0 con 0x7f36a8143610 2023-12-20T04:46:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36a7fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f36a80c41f0 0x7f36a80cd240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:46598/0 (socket says 172.21.15.132:46598) 2023-12-20T04:46:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36a7fff640 1 -- 172.21.15.132:0/389439273 learned_addr learned my addr 172.21.15.132:0/389439273 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36a77fe640 1 -- 172.21.15.132:0/389439273 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1606671970 0 0) 0x7f36a81439f0 con 0x7f36a80c41f0 2023-12-20T04:46:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36a77fe640 1 -- 172.21.15.132:0/389439273 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3698003520 con 0x7f36a80c41f0 2023-12-20T04:46:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36ace16640 1 --2- 172.21.15.132:0/389439273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36a8143610 0x7f36a80caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36ad617640 1 --2- 172.21.15.132:0/389439273 >> v2:172.21.15.187:3300/0 conn(0x7f36a80cd950 0x7f36a806b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36a77fe640 1 -- 172.21.15.132:0/389439273 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2030651607 0 0) 0x7f3698003520 con 0x7f36a80c41f0 2023-12-20T04:46:57.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36a77fe640 1 -- 172.21.15.132:0/389439273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36a8143610 msgr2=0x7f36a80caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36a77fe640 1 --2- 172.21.15.132:0/389439273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36a8143610 0x7f36a80caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36a77fe640 1 -- 172.21.15.132:0/389439273 >> v2:172.21.15.187:3300/0 conn(0x7f36a80cd950 msgr2=0x7f36a806b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36a77fe640 1 --2- 172.21.15.132:0/389439273 >> v2:172.21.15.187:3300/0 conn(0x7f36a80cd950 0x7f36a806b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36a77fe640 1 -- 172.21.15.132:0/389439273 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a80c4cb0 con 0x7f36a80c41f0 2023-12-20T04:46:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36a77fe640 1 -- 172.21.15.132:0/389439273 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f3694001690 con 0x7f36a80c41f0 2023-12-20T04:46:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36a77fe640 1 -- 172.21.15.132:0/389439273 >> v1:172.21.15.132:6789/0 conn(0x7f36a80c41f0 legacy=0x7f36a80cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36a77fe640 1 --2- 172.21.15.132:0/389439273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36a8143610 0x7f3698003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36a77fe640 1 --2- 172.21.15.132:0/389439273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3698003ef0 0x7f36980047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.297+0000 7f36a77fe640 1 --2- 172.21.15.132:0/389439273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3698004d00 0x7f3698005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.298+0000 7f36a77fe640 1 -- 172.21.15.132:0/389439273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80c46f0 con 0x7f3698003ef0 2023-12-20T04:46:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.298+0000 7f36a77fe640 1 -- 172.21.15.132:0/389439273 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a80c49d0 con 0x7f3698004d00 2023-12-20T04:46:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.298+0000 7f36a77fe640 1 -- 172.21.15.132:0/389439273 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f369800b980 con 0x7f36a8143610 2023-12-20T04:46:57.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.298+0000 7f36a7fff640 1 --2- 172.21.15.132:0/389439273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3698003ef0 0x7f36980047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.298+0000 7f36ace16640 1 --2- 172.21.15.132:0/389439273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36a8143610 0x7f3698003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.298+0000 7f36ad617640 1 --2- 172.21.15.132:0/389439273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3698004d00 0x7f3698005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.298+0000 7f36a7fff640 1 -- 172.21.15.132:0/389439273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36a8143610 msgr2=0x7f3698003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:57.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.298+0000 7f36a7fff640 1 --2- 172.21.15.132:0/389439273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f36a8143610 0x7f3698003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.298+0000 7f36a7fff640 1 -- 172.21.15.132:0/389439273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3698004d00 msgr2=0x7f3698005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:57.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.298+0000 7f36a7fff640 1 --2- 172.21.15.132:0/389439273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3698004d00 0x7f3698005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.298+0000 7f36a7fff640 1 -- 172.21.15.132:0/389439273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3698003520 con 0x7f3698003ef0 2023-12-20T04:46:57.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.299+0000 7f36a7fff640 1 --2- 172.21.15.132:0/389439273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3698003ef0 0x7f36980047c0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f369400c210 tx=0x7f36980057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d2fa83932dd213f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:57.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.299+0000 7f36a77fe640 1 -- 172.21.15.132:0/389439273 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3694005ad0 con 0x7f3698003ef0 2023-12-20T04:46:57.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.299+0000 7f36a77fe640 1 -- 172.21.15.132:0/389439273 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3694005c50 con 0x7f3698003ef0 2023-12-20T04:46:57.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.299+0000 7f36a77fe640 1 -- 172.21.15.132:0/389439273 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f369402c8a0 con 0x7f3698003ef0 2023-12-20T04:46:57.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.299+0000 7f36af07a640 1 -- 172.21.15.132:0/389439273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3698003ef0 msgr2=0x7f36980047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.299+0000 7f36af07a640 1 --2- 172.21.15.132:0/389439273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3698003ef0 0x7f36980047c0 secure :-1 s=READY pgs=937 cs=0 l=1 rev1=1 crypto rx=0x7f369400c210 tx=0x7f36980057f0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.299+0000 7f36ad617640 1 -- 172.21.15.132:0/389439273 reap_dead start 2023-12-20T04:46:57.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.299+0000 7f36af07a640 1 -- 172.21.15.132:0/389439273 shutdown_connections 2023-12-20T04:46:57.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.299+0000 7f36af07a640 1 -- 172.21.15.132:0/389439273 >> 172.21.15.132:0/389439273 conn(0x7f36a806a260 msgr2=0x7f36a80b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:57.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.299+0000 7f36af07a640 1 -- 172.21.15.132:0/389439273 shutdown_connections 2023-12-20T04:46:57.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.299+0000 7f36af07a640 1 -- 172.21.15.132:0/389439273 wait complete. 2023-12-20T04:46:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.300+0000 7f36af07a640 1 Processor -- start 2023-12-20T04:46:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.300+0000 7f36af07a640 1 -- start start 2023-12-20T04:46:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.301+0000 7f36af07a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3698003ef0 0x7f36a806f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.301+0000 7f36af07a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36a81f3420 0x7f36a8137a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.301+0000 7f36af07a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36a81f38a0 0x7f36a8137f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.301+0000 7f36af07a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a8070740 con 0x7f36a81f38a0 2023-12-20T04:46:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.301+0000 7f36af07a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36a8156f80 con 0x7f36a81f3420 2023-12-20T04:46:57.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.301+0000 7f36af07a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36a806f890 con 0x7f3698003ef0 2023-12-20T04:46:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.301+0000 7f36ad617640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36a81f38a0 0x7f36a8137f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.301+0000 7f36ad617640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36a81f38a0 0x7f36a8137f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56388/0 (socket says 172.21.15.132:56388) 2023-12-20T04:46:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.301+0000 7f36ad617640 1 -- 172.21.15.132:0/3901832991 learned_addr learned my addr 172.21.15.132:0/3901832991 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.302+0000 7f36a7fff640 1 --2- 172.21.15.132:0/3901832991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36a81f3420 0x7f36a8137a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.302+0000 7f36ace16640 1 --2- 172.21.15.132:0/3901832991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3698003ef0 0x7f36a806f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.302+0000 7f36ad617640 1 -- 172.21.15.132:0/3901832991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3698003ef0 msgr2=0x7f36a806f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.302+0000 7f36ad617640 1 --2- 172.21.15.132:0/3901832991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3698003ef0 0x7f36a806f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.302+0000 7f36ad617640 1 -- 172.21.15.132:0/3901832991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36a81f3420 msgr2=0x7f36a8137a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.302+0000 7f36ad617640 1 --2- 172.21.15.132:0/3901832991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36a81f3420 0x7f36a8137a20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.302+0000 7f36ad617640 1 -- 172.21.15.132:0/3901832991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36a806fac0 con 0x7f36a81f38a0 2023-12-20T04:46:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.302+0000 7f36a7fff640 1 --2- 172.21.15.132:0/3901832991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36a81f3420 0x7f36a8137a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.302+0000 7f36ad617640 1 --2- 172.21.15.132:0/3901832991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36a81f38a0 0x7f36a8137f60 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009fd0 tx=0x7f36a000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:57.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.302+0000 7f36a57fa640 1 -- 172.21.15.132:0/3901832991 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a000e040 con 0x7f36a81f38a0 2023-12-20T04:46:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.302+0000 7f36a57fa640 1 -- 172.21.15.132:0/3901832991 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f36a000f040 con 0x7f36a81f38a0 2023-12-20T04:46:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.302+0000 7f36af07a640 1 -- 172.21.15.132:0/3901832991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f36a806fda0 con 0x7f36a81f38a0 2023-12-20T04:46:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.302+0000 7f36a57fa640 1 -- 172.21.15.132:0/3901832991 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36a0003bb0 con 0x7f36a81f38a0 2023-12-20T04:46:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.302+0000 7f36af07a640 1 -- 172.21.15.132:0/3901832991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f36a8070360 con 0x7f36a81f38a0 2023-12-20T04:46:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.303+0000 7f36af07a640 1 -- 172.21.15.132:0/3901832991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f36a804e840 con 0x7f36a81f38a0 2023-12-20T04:46:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.303+0000 7f36a57fa640 1 -- 172.21.15.132:0/3901832991 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f36a0003d10 con 0x7f36a81f38a0 2023-12-20T04:46:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.304+0000 7f36a57fa640 1 --2- 172.21.15.132:0/3901832991 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f368c06a460 0x7f368c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.304+0000 7f36a57fa640 1 -- 172.21.15.132:0/3901832991 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f36a0089060 con 0x7f36a81f38a0 2023-12-20T04:46:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.304+0000 7f36ace16640 1 --2- 172.21.15.132:0/3901832991 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f368c06a460 0x7f368c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.304+0000 7f36a57fa640 1 -- 172.21.15.132:0/3901832991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7f368c072050 con 0x7f36a81f38a0 2023-12-20T04:46:57.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.304+0000 7f36ace16640 1 --2- 172.21.15.132:0/3901832991 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f368c06a460 0x7f368c06c920 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f369c009a20 tx=0x7f369c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:57.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.308+0000 7f36a57fa640 1 -- 172.21.15.132:0/3901832991 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f36a0054610 con 0x7f36a81f38a0 2023-12-20T04:46:57.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.474+0000 7f36af07a640 1 -- 172.21.15.132:0/3901832991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36a80b4730 con 0x7f36a81f38a0 2023-12-20T04:46:57.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.475+0000 7f36a57fa640 1 -- 172.21.15.132:0/3901832991 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f36a0057c30 con 0x7f36a81f38a0 2023-12-20T04:46:57.477 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:46:57.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.476+0000 7f36af07a640 1 -- 172.21.15.132:0/3901832991 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f368c06a460 msgr2=0x7f368c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.476+0000 7f36af07a640 1 --2- 172.21.15.132:0/3901832991 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f368c06a460 0x7f368c06c920 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f369c009a20 tx=0x7f369c008040 comp rx=0 tx=0).stop 2023-12-20T04:46:57.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.477+0000 7f36af07a640 1 -- 172.21.15.132:0/3901832991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36a81f38a0 msgr2=0x7f36a8137f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.477+0000 7f36af07a640 1 --2- 172.21.15.132:0/3901832991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36a81f38a0 0x7f36a8137f60 secure :-1 s=READY pgs=938 cs=0 l=1 rev1=1 crypto rx=0x7f36a0009fd0 tx=0x7f36a000f580 comp rx=0 tx=0).stop 2023-12-20T04:46:57.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.477+0000 7f36af07a640 1 -- 172.21.15.132:0/3901832991 shutdown_connections 2023-12-20T04:46:57.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.477+0000 7f36af07a640 1 --2- 172.21.15.132:0/3901832991 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f368c06a460 0x7f368c06c920 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.477+0000 7f36af07a640 1 --2- 172.21.15.132:0/3901832991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f36a81f38a0 0x7f36a8137f60 unknown :-1 s=CLOSED pgs=938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.477+0000 7f36af07a640 1 --2- 172.21.15.132:0/3901832991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f36a81f3420 0x7f36a8137a20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.477+0000 7f36af07a640 1 --2- 172.21.15.132:0/3901832991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3698003ef0 0x7f36a806f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.477+0000 7f36af07a640 1 -- 172.21.15.132:0/3901832991 >> 172.21.15.132:0/3901832991 conn(0x7f36a806a260 msgr2=0x7f36a80cd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:57.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.477+0000 7f36af07a640 1 -- 172.21.15.132:0/3901832991 shutdown_connections 2023-12-20T04:46:57.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.477+0000 7f36af07a640 1 -- 172.21.15.132:0/3901832991 wait complete. 2023-12-20T04:46:57.490 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:46:57.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.608+0000 7feeff35c640 1 Processor -- start 2023-12-20T04:46:57.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.608+0000 7feeff35c640 1 -- start start 2023-12-20T04:46:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.609+0000 7feeff35c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7feef8069c30 0x7feef8070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.609+0000 7feeff35c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feef80cbde0 0x7feef80ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.609+0000 7feeff35c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feef80c4f40 con 0x7feef815d360 2023-12-20T04:46:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.609+0000 7feeff35c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef80af5b0 con 0x7feef80cbde0 2023-12-20T04:46:57.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.609+0000 7feeff35c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7feef8070a40 con 0x7feef8069c30 2023-12-20T04:46:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.609+0000 7feefd8f9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feef80cbde0 0x7feef80ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.609+0000 7feefd8f9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7feef80cbde0 0x7feef80ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57420/0 (socket says 172.21.15.132:57420) 2023-12-20T04:46:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.609+0000 7feefd8f9640 1 -- 172.21.15.132:0/346679573 learned_addr learned my addr 172.21.15.132:0/346679573 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.609+0000 7feefd0f8640 1 --2- 172.21.15.132:0/346679573 >> v2:172.21.15.187:3300/0 conn(0x7feef8069c30 0x7feef8070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.609+0000 7feefd8f9640 1 -- 172.21.15.132:0/346679573 >> v2:172.21.15.187:3300/0 conn(0x7feef8069c30 msgr2=0x7feef8070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.609+0000 7feefd8f9640 1 --2- 172.21.15.132:0/346679573 >> v2:172.21.15.187:3300/0 conn(0x7feef8069c30 0x7feef8070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.609+0000 7feefd8f9640 1 -- 172.21.15.132:0/346679573 >> v1:172.21.15.187:6789/0 conn(0x7feef815d360 legacy=0x7feef806a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:57.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.609+0000 7feefd8f9640 1 -- 172.21.15.132:0/346679573 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef8070d20 con 0x7feef80cbde0 2023-12-20T04:46:57.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.610+0000 7feefd8f9640 1 --2- 172.21.15.132:0/346679573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feef80cbde0 0x7feef80ca170 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7feef8071870 tx=0x7feef002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2aa1cb0b1dd60f9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:57.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.610+0000 7feeeffff640 1 -- 172.21.15.132:0/346679573 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef002cb20 con 0x7feef80cbde0 2023-12-20T04:46:57.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.610+0000 7feeeffff640 1 -- 172.21.15.132:0/346679573 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef002cc80 con 0x7feef80cbde0 2023-12-20T04:46:57.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.610+0000 7feeeffff640 1 -- 172.21.15.132:0/346679573 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef00343f0 con 0x7feef80cbde0 2023-12-20T04:46:57.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.611+0000 7feeff35c640 1 -- 172.21.15.132:0/346679573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feef80cbde0 msgr2=0x7feef80ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.611+0000 7feeff35c640 1 --2- 172.21.15.132:0/346679573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feef80cbde0 0x7feef80ca170 secure :-1 s=READY pgs=939 cs=0 l=1 rev1=1 crypto rx=0x7feef8071870 tx=0x7feef002bf80 comp rx=0 tx=0).stop 2023-12-20T04:46:57.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.611+0000 7feeff35c640 1 -- 172.21.15.132:0/346679573 shutdown_connections 2023-12-20T04:46:57.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.611+0000 7feeff35c640 1 --2- 172.21.15.132:0/346679573 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feef80cbde0 0x7feef80ca170 unknown :-1 s=CLOSED pgs=939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.611+0000 7feeff35c640 1 --2- 172.21.15.132:0/346679573 >> v2:172.21.15.187:3300/0 conn(0x7feef8069c30 0x7feef8070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.611+0000 7feeff35c640 1 -- 172.21.15.132:0/346679573 >> 172.21.15.132:0/346679573 conn(0x7feef80cc630 msgr2=0x7feef80cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:57.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.611+0000 7feeff35c640 1 -- 172.21.15.132:0/346679573 shutdown_connections 2023-12-20T04:46:57.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.611+0000 7feeff35c640 1 -- 172.21.15.132:0/346679573 wait complete. 2023-12-20T04:46:57.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.612+0000 7feeff35c640 1 Processor -- start 2023-12-20T04:46:57.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.612+0000 7feeff35c640 1 -- start start 2023-12-20T04:46:57.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feeff35c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feef8069c30 0x7feef80b5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feeff35c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feef80cbde0 0x7feef815ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feeff35c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feef815d360 0x7feef8158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feeff35c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef815b040 con 0x7feef815d360 2023-12-20T04:46:57.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feeff35c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feef80c6360 con 0x7feef8069c30 2023-12-20T04:46:57.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feeff35c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feef8159a60 con 0x7feef80cbde0 2023-12-20T04:46:57.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feefd8f9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feef815d360 0x7feef8158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feefd8f9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feef815d360 0x7feef8158f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57422/0 (socket says 172.21.15.132:57422) 2023-12-20T04:46:57.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feefd8f9640 1 -- 172.21.15.132:0/3649640355 learned_addr learned my addr 172.21.15.132:0/3649640355 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:57.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feefd0f8640 1 --2- 172.21.15.132:0/3649640355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feef8069c30 0x7feef80b5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feefc8f7640 1 --2- 172.21.15.132:0/3649640355 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feef80cbde0 0x7feef815ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feefd8f9640 1 -- 172.21.15.132:0/3649640355 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feef80cbde0 msgr2=0x7feef815ab00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feefd8f9640 1 --2- 172.21.15.132:0/3649640355 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feef80cbde0 0x7feef815ab00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feefd8f9640 1 -- 172.21.15.132:0/3649640355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feef8069c30 msgr2=0x7feef80b5090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feefd8f9640 1 --2- 172.21.15.132:0/3649640355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feef8069c30 0x7feef80b5090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feefd8f9640 1 -- 172.21.15.132:0/3649640355 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feef0009b30 con 0x7feef815d360 2023-12-20T04:46:57.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feefc8f7640 1 --2- 172.21.15.132:0/3649640355 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feef80cbde0 0x7feef815ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:57.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feefd8f9640 1 --2- 172.21.15.132:0/3649640355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feef815d360 0x7feef8158f10 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7feef0036040 tx=0x7feef0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:57.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feeedffb640 1 -- 172.21.15.132:0/3649640355 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef0007e70 con 0x7feef815d360 2023-12-20T04:46:57.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feeedffb640 1 -- 172.21.15.132:0/3649640355 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feef0009510 con 0x7feef815d360 2023-12-20T04:46:57.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feeff35c640 1 -- 172.21.15.132:0/3649640355 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feef8159d40 con 0x7feef815d360 2023-12-20T04:46:57.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.613+0000 7feeedffb640 1 -- 172.21.15.132:0/3649640355 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feef003e690 con 0x7feef815d360 2023-12-20T04:46:57.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.614+0000 7feeff35c640 1 -- 172.21.15.132:0/3649640355 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feef815a300 con 0x7feef815d360 2023-12-20T04:46:57.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.614+0000 7feeff35c640 1 -- 172.21.15.132:0/3649640355 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feef804e840 con 0x7feef815d360 2023-12-20T04:46:57.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.615+0000 7feeedffb640 1 -- 172.21.15.132:0/3649640355 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feef003e7f0 con 0x7feef815d360 2023-12-20T04:46:57.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.615+0000 7feeedffb640 1 --2- 172.21.15.132:0/3649640355 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feedc06a430 0x7feedc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.615+0000 7feeedffb640 1 -- 172.21.15.132:0/3649640355 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5767+0+0 (secure 0 0 0) 0x7feef00ab650 con 0x7feef815d360 2023-12-20T04:46:57.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.615+0000 7feefd0f8640 1 --2- 172.21.15.132:0/3649640355 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feedc06a430 0x7feedc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.615+0000 7feeedffb640 1 -- 172.21.15.132:0/3649640355 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7feedc072020 con 0x7feef815d360 2023-12-20T04:46:57.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.616+0000 7feefd0f8640 1 --2- 172.21.15.132:0/3649640355 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feedc06a430 0x7feedc06c8f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7feef4006fd0 tx=0x7feef4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:57.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.619+0000 7feeedffb640 1 -- 172.21.15.132:0/3649640355 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7feef0076db0 con 0x7feef815d360 2023-12-20T04:46:57.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.784+0000 7feeff35c640 1 -- 172.21.15.132:0/3649640355 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7feef806a9a0 con 0x7feef815d360 2023-12-20T04:46:57.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.785+0000 7feeedffb640 1 -- 172.21.15.132:0/3649640355 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v86) v1 ==== 104+0+11 (secure 0 0 0) 0x7feef0043020 con 0x7feef815d360 2023-12-20T04:46:57.787 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:46:57.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.787+0000 7feeff35c640 1 -- 172.21.15.132:0/3649640355 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feedc06a430 msgr2=0x7feedc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.787+0000 7feeff35c640 1 --2- 172.21.15.132:0/3649640355 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feedc06a430 0x7feedc06c8f0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7feef4006fd0 tx=0x7feef4008040 comp rx=0 tx=0).stop 2023-12-20T04:46:57.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.787+0000 7feeff35c640 1 -- 172.21.15.132:0/3649640355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feef815d360 msgr2=0x7feef8158f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.787+0000 7feeff35c640 1 --2- 172.21.15.132:0/3649640355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feef815d360 0x7feef8158f10 secure :-1 s=READY pgs=940 cs=0 l=1 rev1=1 crypto rx=0x7feef0036040 tx=0x7feef0004a40 comp rx=0 tx=0).stop 2023-12-20T04:46:57.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.787+0000 7feeff35c640 1 -- 172.21.15.132:0/3649640355 shutdown_connections 2023-12-20T04:46:57.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.787+0000 7feeff35c640 1 --2- 172.21.15.132:0/3649640355 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feedc06a430 0x7feedc06c8f0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.787+0000 7feeff35c640 1 --2- 172.21.15.132:0/3649640355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feef815d360 0x7feef8158f10 unknown :-1 s=CLOSED pgs=940 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.787+0000 7feeff35c640 1 --2- 172.21.15.132:0/3649640355 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feef80cbde0 0x7feef815ab00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.787+0000 7feeff35c640 1 --2- 172.21.15.132:0/3649640355 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feef8069c30 0x7feef80b5090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.787+0000 7feeff35c640 1 -- 172.21.15.132:0/3649640355 >> 172.21.15.132:0/3649640355 conn(0x7feef80cc630 msgr2=0x7feef815c9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:57.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.787+0000 7feeff35c640 1 -- 172.21.15.132:0/3649640355 shutdown_connections 2023-12-20T04:46:57.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.787+0000 7feeff35c640 1 -- 172.21.15.132:0/3649640355 wait complete. 2023-12-20T04:46:57.800 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:46:57.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.900+0000 7f9777e43640 1 Processor -- start 2023-12-20T04:46:57.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.900+0000 7f9777e43640 1 -- start start 2023-12-20T04:46:57.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.901+0000 7f9777e43640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9770071b70 0x7f977015f370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.901+0000 7f9777e43640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97700c9fc0 0x7f97700ca450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.901+0000 7f9777e43640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f977015f8b0 con 0x7f977015ef90 2023-12-20T04:46:57.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.901+0000 7f9777e43640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f977015b300 con 0x7f9770071b70 2023-12-20T04:46:57.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.901+0000 7f9777e43640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f977006bfc0 con 0x7f97700c9fc0 2023-12-20T04:46:57.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.901+0000 7f97753de640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9770071b70 0x7f977015f370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.901+0000 7f97763e0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97700c9fc0 0x7f97700ca450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.901+0000 7f9775bdf640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f977015ef90 0x7f9770071460 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:39178/0 (socket says 172.21.15.132:39178) 2023-12-20T04:46:57.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.901+0000 7f97753de640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9770071b70 0x7f977015f370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:45566/0 (socket says 172.21.15.132:45566) 2023-12-20T04:46:57.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.901+0000 7f9775bdf640 1 -- 172.21.15.132:0/1944267849 learned_addr learned my addr 172.21.15.132:0/1944267849 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:57.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.902+0000 7f97753de640 1 -- 172.21.15.132:0/1944267849 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97700c9fc0 msgr2=0x7f97700ca450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:57.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.902+0000 7f97753de640 1 --2- 172.21.15.132:0/1944267849 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97700c9fc0 0x7f97700ca450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.902+0000 7f97753de640 1 -- 172.21.15.132:0/1944267849 >> v1:172.21.15.187:6789/0 conn(0x7f977015ef90 legacy=0x7f9770071460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.902+0000 7f97753de640 1 -- 172.21.15.132:0/1944267849 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f977006c2a0 con 0x7f9770071b70 2023-12-20T04:46:57.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.902+0000 7f97763e0640 1 --2- 172.21.15.132:0/1944267849 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97700c9fc0 0x7f97700ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:46:57.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.903+0000 7f97753de640 1 --2- 172.21.15.132:0/1944267849 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9770071b70 0x7f977015f370 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f97600097a0 tx=0x7f976002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=361c9e06c923fdd4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:57.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.905+0000 7f9774bdd640 1 -- 172.21.15.132:0/1944267849 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760031830 con 0x7f9770071b70 2023-12-20T04:46:57.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.905+0000 7f9774bdd640 1 -- 172.21.15.132:0/1944267849 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9760031990 con 0x7f9770071b70 2023-12-20T04:46:57.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.905+0000 7f9774bdd640 1 -- 172.21.15.132:0/1944267849 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9760031d20 con 0x7f9770071b70 2023-12-20T04:46:57.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.906+0000 7f9777e43640 1 -- 172.21.15.132:0/1944267849 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9770071b70 msgr2=0x7f977015f370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.906+0000 7f9777e43640 1 --2- 172.21.15.132:0/1944267849 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9770071b70 0x7f977015f370 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f97600097a0 tx=0x7f976002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.906+0000 7f9777e43640 1 -- 172.21.15.132:0/1944267849 shutdown_connections 2023-12-20T04:46:57.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.906+0000 7f9777e43640 1 --2- 172.21.15.132:0/1944267849 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f97700c9fc0 0x7f97700ca450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.906+0000 7f9777e43640 1 --2- 172.21.15.132:0/1944267849 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9770071b70 0x7f977015f370 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.906+0000 7f9777e43640 1 -- 172.21.15.132:0/1944267849 >> 172.21.15.132:0/1944267849 conn(0x7f97700cf2d0 msgr2=0x7f97700cf6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:57.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.906+0000 7f9777e43640 1 -- 172.21.15.132:0/1944267849 shutdown_connections 2023-12-20T04:46:57.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.906+0000 7f9777e43640 1 -- 172.21.15.132:0/1944267849 wait complete. 2023-12-20T04:46:57.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.907+0000 7f9777e43640 1 Processor -- start 2023-12-20T04:46:57.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.907+0000 7f9777e43640 1 -- start start 2023-12-20T04:46:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.908+0000 7f9777e43640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9770071b70 0x7f97701f42e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.908+0000 7f9777e43640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97700c9fc0 0x7f97700b1890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.908+0000 7f9777e43640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f977015ef90 0x7f97700af840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.908+0000 7f9777e43640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97700afd80 con 0x7f97700c9fc0 2023-12-20T04:46:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.908+0000 7f9777e43640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f97700b0020 con 0x7f9770071b70 2023-12-20T04:46:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.908+0000 7f9777e43640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f97700b0300 con 0x7f977015ef90 2023-12-20T04:46:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.908+0000 7f97753de640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97700c9fc0 0x7f97700b1890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.908+0000 7f97753de640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97700c9fc0 0x7f97700b1890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57434/0 (socket says 172.21.15.132:57434) 2023-12-20T04:46:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.908+0000 7f97753de640 1 -- 172.21.15.132:0/2074208434 learned_addr learned my addr 172.21.15.132:0/2074208434 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.908+0000 7f97753de640 1 -- 172.21.15.132:0/2074208434 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f977015ef90 msgr2=0x7f97700af840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.908+0000 7f97753de640 1 --2- 172.21.15.132:0/2074208434 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f977015ef90 0x7f97700af840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.908+0000 7f97753de640 1 -- 172.21.15.132:0/2074208434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9770071b70 msgr2=0x7f97701f42e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:57.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.908+0000 7f97753de640 1 --2- 172.21.15.132:0/2074208434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9770071b70 0x7f97701f42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:57.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.908+0000 7f97753de640 1 -- 172.21.15.132:0/2074208434 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9768009400 con 0x7f97700c9fc0 2023-12-20T04:46:57.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.908+0000 7f97753de640 1 --2- 172.21.15.132:0/2074208434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97700c9fc0 0x7f97700b1890 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f976002bee0 tx=0x7f97600046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:57.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.908+0000 7f97667fc640 1 -- 172.21.15.132:0/2074208434 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976003a6f0 con 0x7f97700c9fc0 2023-12-20T04:46:57.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.909+0000 7f97667fc640 1 -- 172.21.15.132:0/2074208434 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f976003a870 con 0x7f97700c9fc0 2023-12-20T04:46:57.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.909+0000 7f9777e43640 1 -- 172.21.15.132:0/2074208434 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9760009400 con 0x7f97700c9fc0 2023-12-20T04:46:57.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.909+0000 7f97667fc640 1 -- 172.21.15.132:0/2074208434 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f976003ac20 con 0x7f97700c9fc0 2023-12-20T04:46:57.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.909+0000 7f9777e43640 1 -- 172.21.15.132:0/2074208434 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f977015ce00 con 0x7f97700c9fc0 2023-12-20T04:46:57.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.910+0000 7f9777e43640 1 -- 172.21.15.132:0/2074208434 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9770073360 con 0x7f97700c9fc0 2023-12-20T04:46:57.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.910+0000 7f97667fc640 1 -- 172.21.15.132:0/2074208434 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f976004c3b0 con 0x7f97700c9fc0 2023-12-20T04:46:57.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.910+0000 7f97667fc640 1 --2- 172.21.15.132:0/2074208434 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f975406a430 0x7f975406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:57.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.911+0000 7f9775bdf640 1 --2- 172.21.15.132:0/2074208434 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f975406a430 0x7f975406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:57.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.911+0000 7f97667fc640 1 -- 172.21.15.132:0/2074208434 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f97600aa4f0 con 0x7f97700c9fc0 2023-12-20T04:46:57.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.911+0000 7f97667fc640 1 -- 172.21.15.132:0/2074208434 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7f9754072020 con 0x7f97700c9fc0 2023-12-20T04:46:57.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.911+0000 7f9775bdf640 1 --2- 172.21.15.132:0/2074208434 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f975406a430 0x7f975406c8f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9770070810 tx=0x7f976c0015c0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:57.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:57.915+0000 7f97667fc640 1 -- 172.21.15.132:0/2074208434 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9760075b30 con 0x7f97700c9fc0 2023-12-20T04:46:58.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.082+0000 7f9777e43640 1 -- 172.21.15.132:0/2074208434 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f977004e840 con 0x7f97700c9fc0 2023-12-20T04:46:58.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.082+0000 7f97667fc640 1 -- 172.21.15.132:0/2074208434 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v86) v1 ==== 100+0+11 (secure 0 0 0) 0x7f97600480a0 con 0x7f97700c9fc0 2023-12-20T04:46:58.084 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:46:58.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.084+0000 7f9777e43640 1 -- 172.21.15.132:0/2074208434 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f975406a430 msgr2=0x7f975406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:58.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.084+0000 7f9777e43640 1 --2- 172.21.15.132:0/2074208434 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f975406a430 0x7f975406c8f0 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7f9770070810 tx=0x7f976c0015c0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.084+0000 7f9777e43640 1 -- 172.21.15.132:0/2074208434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97700c9fc0 msgr2=0x7f97700b1890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:58.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.084+0000 7f9777e43640 1 --2- 172.21.15.132:0/2074208434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97700c9fc0 0x7f97700b1890 secure :-1 s=READY pgs=941 cs=0 l=1 rev1=1 crypto rx=0x7f976002bee0 tx=0x7f97600046c0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.084+0000 7f9777e43640 1 -- 172.21.15.132:0/2074208434 shutdown_connections 2023-12-20T04:46:58.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.084+0000 7f9777e43640 1 --2- 172.21.15.132:0/2074208434 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f975406a430 0x7f975406c8f0 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.084+0000 7f9777e43640 1 --2- 172.21.15.132:0/2074208434 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f977015ef90 0x7f97700af840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.084+0000 7f9777e43640 1 --2- 172.21.15.132:0/2074208434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f97700c9fc0 0x7f97700b1890 unknown :-1 s=CLOSED pgs=941 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.084+0000 7f9777e43640 1 --2- 172.21.15.132:0/2074208434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9770071b70 0x7f97701f42e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.084+0000 7f9777e43640 1 -- 172.21.15.132:0/2074208434 >> 172.21.15.132:0/2074208434 conn(0x7f97700cf2d0 msgr2=0x7f977015a680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:58.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.084+0000 7f9777e43640 1 -- 172.21.15.132:0/2074208434 shutdown_connections 2023-12-20T04:46:58.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.084+0000 7f9777e43640 1 -- 172.21.15.132:0/2074208434 wait complete. 2023-12-20T04:46:58.097 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:46:58.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.196+0000 7fd7f6918640 1 Processor -- start 2023-12-20T04:46:58.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.196+0000 7fd7f6918640 1 -- start start 2023-12-20T04:46:58.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.197+0000 7fd7f6918640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7f006bba0 0x7fd7f006f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:58.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.197+0000 7fd7f6918640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f006c8e0 con 0x7fd7f0159bb0 2023-12-20T04:46:58.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.197+0000 7fd7f6918640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd7f015e420 con 0x7fd7f00ad720 2023-12-20T04:46:58.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.197+0000 7fd7f6918640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f015e700 con 0x7fd7f006bba0 2023-12-20T04:46:58.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.197+0000 7fd7effff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd7f0159bb0 0x7fd7f006b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45458/0 (socket says 172.21.15.132:45458) 2023-12-20T04:46:58.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.197+0000 7fd7effff640 1 -- 172.21.15.132:0/245119616 learned_addr learned my addr 172.21.15.132:0/245119616 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:58.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.197+0000 7fd7eeffd640 1 -- 172.21.15.132:0/245119616 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 845623095 0 0) 0x7fd7f006c8e0 con 0x7fd7f0159bb0 2023-12-20T04:46:58.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.197+0000 7fd7ef7fe640 1 --2- 172.21.15.132:0/245119616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7f006bba0 0x7fd7f006f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:58.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.197+0000 7fd7eeffd640 1 -- 172.21.15.132:0/245119616 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd7d8005730 con 0x7fd7f0159bb0 2023-12-20T04:46:58.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7eeffd640 1 -- 172.21.15.132:0/245119616 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4167628533 0 0) 0x7fd7d8005730 con 0x7fd7f0159bb0 2023-12-20T04:46:58.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7eeffd640 1 -- 172.21.15.132:0/245119616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7f006bba0 msgr2=0x7fd7f006f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:58.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7eeffd640 1 --2- 172.21.15.132:0/245119616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7f006bba0 0x7fd7f006f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7eeffd640 1 -- 172.21.15.132:0/245119616 >> v1:172.21.15.187:6789/0 conn(0x7fd7f00ad720 legacy=0x7fd7f00ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:58.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7eeffd640 1 -- 172.21.15.132:0/245119616 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f00c9d10 con 0x7fd7f0159bb0 2023-12-20T04:46:58.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7eeffd640 1 -- 172.21.15.132:0/245119616 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fd7e0001670 con 0x7fd7f0159bb0 2023-12-20T04:46:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7eeffd640 1 -- 172.21.15.132:0/245119616 >> v1:172.21.15.132:6789/0 conn(0x7fd7f0159bb0 legacy=0x7fd7f006b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7eeffd640 1 --2- 172.21.15.132:0/245119616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7f006bba0 0x7fd7d8005bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7eeffd640 1 --2- 172.21.15.132:0/245119616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d8006130 0x7fd7d80069d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7eeffd640 1 --2- 172.21.15.132:0/245119616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7d8006f10 0x7fd7d8007390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7eeffd640 1 -- 172.21.15.132:0/245119616 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f015e700 con 0x7fd7d8006f10 2023-12-20T04:46:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7eeffd640 1 -- 172.21.15.132:0/245119616 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d800dc70 con 0x7fd7d8006130 2023-12-20T04:46:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7eeffd640 1 -- 172.21.15.132:0/245119616 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7d800de30 con 0x7fd7f006bba0 2023-12-20T04:46:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7f4eb5640 1 --2- 172.21.15.132:0/245119616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7d8006f10 0x7fd7d8007390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7effff640 1 --2- 172.21.15.132:0/245119616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7f006bba0 0x7fd7d8005bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7ef7fe640 1 --2- 172.21.15.132:0/245119616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d8006130 0x7fd7d80069d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7f4eb5640 1 -- 172.21.15.132:0/245119616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7f006bba0 msgr2=0x7fd7d8005bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7f4eb5640 1 --2- 172.21.15.132:0/245119616 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7f006bba0 0x7fd7d8005bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7f4eb5640 1 -- 172.21.15.132:0/245119616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d8006130 msgr2=0x7fd7d80069d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7f4eb5640 1 --2- 172.21.15.132:0/245119616 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7d8006130 0x7fd7d80069d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.198+0000 7fd7f4eb5640 1 -- 172.21.15.132:0/245119616 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7d8005730 con 0x7fd7d8006f10 2023-12-20T04:46:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.199+0000 7fd7f4eb5640 1 --2- 172.21.15.132:0/245119616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7d8006f10 0x7fd7d8007390 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8001e50 tx=0x7fd7d8007a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf97140650f0d1b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.199+0000 7fd7eeffd640 1 -- 172.21.15.132:0/245119616 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8003b70 con 0x7fd7d8006f10 2023-12-20T04:46:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.199+0000 7fd7eeffd640 1 -- 172.21.15.132:0/245119616 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e8003cd0 con 0x7fd7d8006f10 2023-12-20T04:46:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.199+0000 7fd7eeffd640 1 -- 172.21.15.132:0/245119616 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e8005310 con 0x7fd7d8006f10 2023-12-20T04:46:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.199+0000 7fd7f6918640 1 -- 172.21.15.132:0/245119616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7d8006f10 msgr2=0x7fd7d8007390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.199+0000 7fd7f6918640 1 --2- 172.21.15.132:0/245119616 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7d8006f10 0x7fd7d8007390 secure :-1 s=READY pgs=943 cs=0 l=1 rev1=1 crypto rx=0x7fd7e8001e50 tx=0x7fd7d8007a00 comp rx=0 tx=0).stop 2023-12-20T04:46:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.199+0000 7fd7f4eb5640 1 -- 172.21.15.132:0/245119616 reap_dead start 2023-12-20T04:46:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.199+0000 7fd7f6918640 1 -- 172.21.15.132:0/245119616 shutdown_connections 2023-12-20T04:46:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.199+0000 7fd7f6918640 1 -- 172.21.15.132:0/245119616 >> 172.21.15.132:0/245119616 conn(0x7fd7f006a260 msgr2=0x7fd7f00b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.199+0000 7fd7f6918640 1 -- 172.21.15.132:0/245119616 shutdown_connections 2023-12-20T04:46:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.199+0000 7fd7f6918640 1 -- 172.21.15.132:0/245119616 wait complete. 2023-12-20T04:46:58.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.201+0000 7fd7f6918640 1 Processor -- start 2023-12-20T04:46:58.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.201+0000 7fd7f6918640 1 -- start start 2023-12-20T04:46:58.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.201+0000 7fd7f6918640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7f014f910 0x7fd7f0149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:58.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.201+0000 7fd7f6918640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7f00b03b0 0x7fd7f014ea00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:58.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.201+0000 7fd7f6918640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7f014fcf0 0x7fd7f014ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:58.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7f6918640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00c7d70 con 0x7fd7f014f910 2023-12-20T04:46:58.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7f6918640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00adb90 con 0x7fd7f00b03b0 2023-12-20T04:46:58.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7f6918640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd7f00ae430 con 0x7fd7f014fcf0 2023-12-20T04:46:58.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7effff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7f014f910 0x7fd7f0149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:58.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7effff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7f014f910 0x7fd7f0149300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57450/0 (socket says 172.21.15.132:57450) 2023-12-20T04:46:58.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7effff640 1 -- 172.21.15.132:0/1960206277 learned_addr learned my addr 172.21.15.132:0/1960206277 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:58.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7ef7fe640 1 --2- 172.21.15.132:0/1960206277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7f00b03b0 0x7fd7f014ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:58.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7f4eb5640 1 --2- 172.21.15.132:0/1960206277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7f014fcf0 0x7fd7f014ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:58.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7effff640 1 -- 172.21.15.132:0/1960206277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7f014fcf0 msgr2=0x7fd7f014ef40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:58.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7effff640 1 --2- 172.21.15.132:0/1960206277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7f014fcf0 0x7fd7f014ef40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7effff640 1 -- 172.21.15.132:0/1960206277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7f00b03b0 msgr2=0x7fd7f014ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:58.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7effff640 1 --2- 172.21.15.132:0/1960206277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7f00b03b0 0x7fd7f014ea00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7effff640 1 -- 172.21.15.132:0/1960206277 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd7f0149840 con 0x7fd7f014f910 2023-12-20T04:46:58.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7f4eb5640 1 --2- 172.21.15.132:0/1960206277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7f014fcf0 0x7fd7f014ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:58.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7ef7fe640 1 --2- 172.21.15.132:0/1960206277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7f00b03b0 0x7fd7f014ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:58.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7effff640 1 --2- 172.21.15.132:0/1960206277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7f014f910 0x7fd7f0149300 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0000fb0 tx=0x7fd7e0007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:58.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7ecff9640 1 -- 172.21.15.132:0/1960206277 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e000fa00 con 0x7fd7f014f910 2023-12-20T04:46:58.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7ecff9640 1 -- 172.21.15.132:0/1960206277 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd7e000fb80 con 0x7fd7f014f910 2023-12-20T04:46:58.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7f6918640 1 -- 172.21.15.132:0/1960206277 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd7f01451b0 con 0x7fd7f014f910 2023-12-20T04:46:58.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7ecff9640 1 -- 172.21.15.132:0/1960206277 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd7e00133f0 con 0x7fd7f014f910 2023-12-20T04:46:58.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.202+0000 7fd7f6918640 1 -- 172.21.15.132:0/1960206277 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd7f0149aa0 con 0x7fd7f014f910 2023-12-20T04:46:58.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.203+0000 7fd7f6918640 1 -- 172.21.15.132:0/1960206277 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd7f004e840 con 0x7fd7f014f910 2023-12-20T04:46:58.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.203+0000 7fd7ecff9640 1 -- 172.21.15.132:0/1960206277 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd7e0013550 con 0x7fd7f014f910 2023-12-20T04:46:58.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.204+0000 7fd7ecff9640 1 --2- 172.21.15.132:0/1960206277 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd7dc06a430 0x7fd7dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:58.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.204+0000 7fd7ef7fe640 1 --2- 172.21.15.132:0/1960206277 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd7dc06a430 0x7fd7dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:58.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.204+0000 7fd7ecff9640 1 -- 172.21.15.132:0/1960206277 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd7e0088cc0 con 0x7fd7f014f910 2023-12-20T04:46:58.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.204+0000 7fd7ecff9640 1 -- 172.21.15.132:0/1960206277 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7fd7dc072020 con 0x7fd7f014f910 2023-12-20T04:46:58.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.204+0000 7fd7ef7fe640 1 --2- 172.21.15.132:0/1960206277 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd7dc06a430 0x7fd7dc06c8f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0150810 tx=0x7fd7e4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:58.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.208+0000 7fd7ecff9640 1 -- 172.21.15.132:0/1960206277 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd7e0054270 con 0x7fd7f014f910 2023-12-20T04:46:58.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.387+0000 7fd7f6918640 1 -- 172.21.15.132:0/1960206277 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fd7f006c450 con 0x7fd7f014f910 2023-12-20T04:46:58.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.387+0000 7fd7ecff9640 1 -- 172.21.15.132:0/1960206277 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v86) v1 ==== 80+0+0 (secure 0 0 0) 0x7fd7e0057890 con 0x7fd7f014f910 2023-12-20T04:46:58.389 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:46:58.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.389+0000 7fd7f6918640 1 -- 172.21.15.132:0/1960206277 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd7dc06a430 msgr2=0x7fd7dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:58.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.389+0000 7fd7f6918640 1 --2- 172.21.15.132:0/1960206277 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd7dc06a430 0x7fd7dc06c8f0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fd7f0150810 tx=0x7fd7e4008040 comp rx=0 tx=0).stop 2023-12-20T04:46:58.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.389+0000 7fd7f6918640 1 -- 172.21.15.132:0/1960206277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7f014f910 msgr2=0x7fd7f0149300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:58.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.389+0000 7fd7f6918640 1 --2- 172.21.15.132:0/1960206277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7f014f910 0x7fd7f0149300 secure :-1 s=READY pgs=944 cs=0 l=1 rev1=1 crypto rx=0x7fd7e0000fb0 tx=0x7fd7e0007720 comp rx=0 tx=0).stop 2023-12-20T04:46:58.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.389+0000 7fd7f6918640 1 -- 172.21.15.132:0/1960206277 shutdown_connections 2023-12-20T04:46:58.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.389+0000 7fd7f6918640 1 --2- 172.21.15.132:0/1960206277 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd7dc06a430 0x7fd7dc06c8f0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.389+0000 7fd7f6918640 1 --2- 172.21.15.132:0/1960206277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd7f014fcf0 0x7fd7f014ef40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.389+0000 7fd7f6918640 1 --2- 172.21.15.132:0/1960206277 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd7f00b03b0 0x7fd7f014ea00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.389+0000 7fd7f6918640 1 --2- 172.21.15.132:0/1960206277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd7f014f910 0x7fd7f0149300 unknown :-1 s=CLOSED pgs=944 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.389+0000 7fd7f6918640 1 -- 172.21.15.132:0/1960206277 >> 172.21.15.132:0/1960206277 conn(0x7fd7f006a260 msgr2=0x7fd7f00c3e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:58.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.389+0000 7fd7f6918640 1 -- 172.21.15.132:0/1960206277 shutdown_connections 2023-12-20T04:46:58.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.389+0000 7fd7f6918640 1 -- 172.21.15.132:0/1960206277 wait complete. 2023-12-20T04:46:58.402 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi187.front.sepia.ceph.com... 2023-12-20T04:46:58.402 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:58.402 DEBUG:teuthology.orchestra.run.smithi187:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-20T04:46:58.432 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[88575]: fuse finished with error 0 and tester_r 0 2023-12-20T04:46:58.434 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:46:58.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:58.434 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-20T04:46:58.587 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:46:58.587 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:46:58.602 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:46:58.602 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:46:58.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:58.603 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-20T04:46:58.657 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:46:58.657 INFO:teuthology.orchestra.run.smithi132.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-20T04:46:58.657 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:46:58.658 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:46:58.675 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:46:58.675 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:46:58.675 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:46:58.675 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-20T04:46:58.731 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:46:58.731 INFO:teuthology.orchestra.run.smithi187.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-20T04:46:58.732 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:46:58.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.830+0000 7fe17e421640 1 Processor -- start 2023-12-20T04:46:58.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.830+0000 7fe17e421640 1 -- start start 2023-12-20T04:46:58.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.831+0000 7fe17e421640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe17815d0f0 0x7fe178161620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:58.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.831+0000 7fe17e421640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1780acd10 0x7fe1780b0790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:58.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.831+0000 7fe17e421640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe178161b60 con 0x7fe1780ac8e0 2023-12-20T04:46:58.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.831+0000 7fe17e421640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1780ad1c0 con 0x7fe17815d0f0 2023-12-20T04:46:58.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.831+0000 7fe17e421640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780ce920 con 0x7fe1780acd10 2023-12-20T04:46:58.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.831+0000 7fe177fff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe17815d0f0 0x7fe178161620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:58.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.831+0000 7fe17c9be640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1780acd10 0x7fe1780b0790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:58.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.831+0000 7fe1777fe640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fe1780ac8e0 0x7fe17815dce0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:39202/0 (socket says 172.21.15.132:39202) 2023-12-20T04:46:58.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.831+0000 7fe1777fe640 1 -- 172.21.15.132:0/1485619950 learned_addr learned my addr 172.21.15.132:0/1485619950 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:58.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.831+0000 7fe177fff640 1 -- 172.21.15.132:0/1485619950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1780acd10 msgr2=0x7fe1780b0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:58.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.831+0000 7fe177fff640 1 --2- 172.21.15.132:0/1485619950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1780acd10 0x7fe1780b0790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.831+0000 7fe177fff640 1 -- 172.21.15.132:0/1485619950 >> v1:172.21.15.187:6789/0 conn(0x7fe1780ac8e0 legacy=0x7fe17815dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:58.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.831+0000 7fe176ffd640 1 -- 172.21.15.132:0/1485619950 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1888746970 0 0) 0x7fe178161b60 con 0x7fe1780ac8e0 2023-12-20T04:46:58.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.831+0000 7fe177fff640 1 -- 172.21.15.132:0/1485619950 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1780ccbd0 con 0x7fe17815d0f0 2023-12-20T04:46:58.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.832+0000 7fe177fff640 1 --2- 172.21.15.132:0/1485619950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe17815d0f0 0x7fe178161620 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe1680097a0 tx=0x7fe16802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ad648dea93b2c455 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:58.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.832+0000 7fe176ffd640 1 -- 172.21.15.132:0/1485619950 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168031830 con 0x7fe17815d0f0 2023-12-20T04:46:58.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.832+0000 7fe176ffd640 1 -- 172.21.15.132:0/1485619950 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe168031990 con 0x7fe17815d0f0 2023-12-20T04:46:58.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.832+0000 7fe176ffd640 1 -- 172.21.15.132:0/1485619950 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe168031d20 con 0x7fe17815d0f0 2023-12-20T04:46:58.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.833+0000 7fe17e421640 1 -- 172.21.15.132:0/1485619950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe17815d0f0 msgr2=0x7fe178161620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:58.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.833+0000 7fe17e421640 1 --2- 172.21.15.132:0/1485619950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe17815d0f0 0x7fe178161620 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7fe1680097a0 tx=0x7fe16802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.833+0000 7fe17e421640 1 -- 172.21.15.132:0/1485619950 shutdown_connections 2023-12-20T04:46:58.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.833+0000 7fe17e421640 1 --2- 172.21.15.132:0/1485619950 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1780acd10 0x7fe1780b0790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.833+0000 7fe17e421640 1 --2- 172.21.15.132:0/1485619950 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe17815d0f0 0x7fe178161620 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.833+0000 7fe17e421640 1 -- 172.21.15.132:0/1485619950 >> 172.21.15.132:0/1485619950 conn(0x7fe1780ced10 msgr2=0x7fe1780cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:58.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.833+0000 7fe17e421640 1 -- 172.21.15.132:0/1485619950 shutdown_connections 2023-12-20T04:46:58.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.833+0000 7fe17e421640 1 -- 172.21.15.132:0/1485619950 wait complete. 2023-12-20T04:46:58.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.834+0000 7fe17e421640 1 Processor -- start 2023-12-20T04:46:58.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.834+0000 7fe17e421640 1 -- start start 2023-12-20T04:46:58.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.835+0000 7fe17e421640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1780ac8e0 0x7fe1780c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:58.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.835+0000 7fe17e421640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1780acd10 0x7fe178157090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:58.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.835+0000 7fe17e421640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe17815d0f0 0x7fe1781575d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:58.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.835+0000 7fe17e421640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1780b38b0 con 0x7fe17815d0f0 2023-12-20T04:46:58.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.835+0000 7fe17e421640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe178158c70 con 0x7fe1780ac8e0 2023-12-20T04:46:58.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.835+0000 7fe17e421640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe178158f30 con 0x7fe1780acd10 2023-12-20T04:46:58.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.835+0000 7fe17c9be640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe17815d0f0 0x7fe1781575d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:58.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.835+0000 7fe17c9be640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe17815d0f0 0x7fe1781575d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57466/0 (socket says 172.21.15.132:57466) 2023-12-20T04:46:58.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.835+0000 7fe17c9be640 1 -- 172.21.15.132:0/3580844392 learned_addr learned my addr 172.21.15.132:0/3580844392 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:58.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.835+0000 7fe177fff640 1 --2- 172.21.15.132:0/3580844392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1780ac8e0 0x7fe1780c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:58.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.835+0000 7fe1777fe640 1 --2- 172.21.15.132:0/3580844392 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1780acd10 0x7fe178157090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:58.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.835+0000 7fe17c9be640 1 -- 172.21.15.132:0/3580844392 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1780acd10 msgr2=0x7fe178157090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:58.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.835+0000 7fe17c9be640 1 --2- 172.21.15.132:0/3580844392 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1780acd10 0x7fe178157090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.835+0000 7fe17c9be640 1 -- 172.21.15.132:0/3580844392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1780ac8e0 msgr2=0x7fe1780c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:58.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.835+0000 7fe17c9be640 1 --2- 172.21.15.132:0/3580844392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1780ac8e0 0x7fe1780c5d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:58.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.835+0000 7fe17c9be640 1 -- 172.21.15.132:0/3580844392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe168009400 con 0x7fe17815d0f0 2023-12-20T04:46:58.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.836+0000 7fe17c9be640 1 --2- 172.21.15.132:0/3580844392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe17815d0f0 0x7fe1781575d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fe17000efc0 tx=0x7fe17000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:58.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.836+0000 7fe174ff9640 1 -- 172.21.15.132:0/3580844392 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170014480 con 0x7fe17815d0f0 2023-12-20T04:46:58.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.836+0000 7fe174ff9640 1 -- 172.21.15.132:0/3580844392 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17000f040 con 0x7fe17815d0f0 2023-12-20T04:46:58.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.836+0000 7fe17e421640 1 -- 172.21.15.132:0/3580844392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe178159210 con 0x7fe17815d0f0 2023-12-20T04:46:58.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.836+0000 7fe174ff9640 1 -- 172.21.15.132:0/3580844392 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe170014820 con 0x7fe17815d0f0 2023-12-20T04:46:58.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.836+0000 7fe17e421640 1 -- 172.21.15.132:0/3580844392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1781597d0 con 0x7fe17815d0f0 2023-12-20T04:46:58.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.837+0000 7fe17e421640 1 -- 172.21.15.132:0/3580844392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17804e840 con 0x7fe17815d0f0 2023-12-20T04:46:58.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.837+0000 7fe174ff9640 1 -- 172.21.15.132:0/3580844392 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe170014980 con 0x7fe17815d0f0 2023-12-20T04:46:58.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.838+0000 7fe174ff9640 1 --2- 172.21.15.132:0/3580844392 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe16406a430 0x7fe16406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:58.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.838+0000 7fe174ff9640 1 -- 172.21.15.132:0/3580844392 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe170089380 con 0x7fe17815d0f0 2023-12-20T04:46:58.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.838+0000 7fe177fff640 1 --2- 172.21.15.132:0/3580844392 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe16406a430 0x7fe16406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:58.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.838+0000 7fe174ff9640 1 -- 172.21.15.132:0/3580844392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7fe164072020 con 0x7fe17815d0f0 2023-12-20T04:46:58.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.838+0000 7fe177fff640 1 --2- 172.21.15.132:0/3580844392 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe16406a430 0x7fe16406c8f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe168036000 tx=0x7fe16803d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:58.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:58.842+0000 7fe174ff9640 1 -- 172.21.15.132:0/3580844392 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe170018060 con 0x7fe17815d0f0 2023-12-20T04:46:59.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.041+0000 7fe17e421640 1 -- 172.21.15.132:0/3580844392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe1780b4c90 con 0x7fe17815d0f0 2023-12-20T04:46:59.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.042+0000 7fe174ff9640 1 -- 172.21.15.132:0/3580844392 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fe170054a70 con 0x7fe17815d0f0 2023-12-20T04:46:59.044 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:59.044 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":32,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2337953767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2337953767},{"type":"v1","addr":"172.21.15.187:6835","nonce":2337953767}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6540,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/41640576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":41640576},{"type":"v1","addr":"172.21.15.132:6836","nonce":41640576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6543,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2936157584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2936157584},{"type":"v1","addr":"172.21.15.132:6837","nonce":2936157584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:46:22.459815+0000","modified":"2023-12-20T04:46:24.470923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6552":{"gid":6552,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6833/3732620607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3732620607},{"type":"v1","addr":"172.21.15.187:6833","nonce":3732620607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-20T04:46:59.044 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 32 2023-12-20T04:46:59.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.043+0000 7fe17e421640 1 -- 172.21.15.132:0/3580844392 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe16406a430 msgr2=0x7fe16406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.043+0000 7fe17e421640 1 --2- 172.21.15.132:0/3580844392 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe16406a430 0x7fe16406c8f0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fe168036000 tx=0x7fe16803d040 comp rx=0 tx=0).stop 2023-12-20T04:46:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.043+0000 7fe17e421640 1 -- 172.21.15.132:0/3580844392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe17815d0f0 msgr2=0x7fe1781575d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.043+0000 7fe17e421640 1 --2- 172.21.15.132:0/3580844392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe17815d0f0 0x7fe1781575d0 secure :-1 s=READY pgs=945 cs=0 l=1 rev1=1 crypto rx=0x7fe17000efc0 tx=0x7fe17000c490 comp rx=0 tx=0).stop 2023-12-20T04:46:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.043+0000 7fe17e421640 1 -- 172.21.15.132:0/3580844392 shutdown_connections 2023-12-20T04:46:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.044+0000 7fe17e421640 1 --2- 172.21.15.132:0/3580844392 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe16406a430 0x7fe16406c8f0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.044+0000 7fe17e421640 1 --2- 172.21.15.132:0/3580844392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe17815d0f0 0x7fe1781575d0 unknown :-1 s=CLOSED pgs=945 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.044+0000 7fe17e421640 1 --2- 172.21.15.132:0/3580844392 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1780acd10 0x7fe178157090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.044+0000 7fe17e421640 1 --2- 172.21.15.132:0/3580844392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1780ac8e0 0x7fe1780c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.044+0000 7fe17e421640 1 -- 172.21.15.132:0/3580844392 >> 172.21.15.132:0/3580844392 conn(0x7fe1780ced10 msgr2=0x7fe1780cbe70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.044+0000 7fe17e421640 1 -- 172.21.15.132:0/3580844392 shutdown_connections 2023-12-20T04:46:59.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.044+0000 7fe17e421640 1 -- 172.21.15.132:0/3580844392 wait complete. 2023-12-20T04:46:59.057 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:46:59.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.154+0000 7f4d404b9640 1 Processor -- start 2023-12-20T04:46:59.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.154+0000 7f4d404b9640 1 -- start start 2023-12-20T04:46:59.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.155+0000 7f4d404b9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4d380cba90 0x7f4d380cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.155+0000 7f4d404b9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d38161ff0 con 0x7f4d38160ba0 2023-12-20T04:46:59.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.155+0000 7f4d404b9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d381613e0 con 0x7f4d380ce2a0 2023-12-20T04:46:59.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.155+0000 7f4d404b9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d380cca40 con 0x7f4d380cba90 2023-12-20T04:46:59.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.155+0000 7f4d3e255640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4d38160ba0 0x7f4d380cb380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45466/0 (socket says 172.21.15.132:45466) 2023-12-20T04:46:59.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.155+0000 7f4d3e255640 1 -- 172.21.15.132:0/2777786982 learned_addr learned my addr 172.21.15.132:0/2777786982 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:46:59.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3da54640 1 --2- 172.21.15.132:0/2777786982 >> v2:172.21.15.187:3300/0 conn(0x7f4d380cba90 0x7f4d380cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3d253640 1 -- 172.21.15.132:0/2777786982 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 646714051 0 0) 0x7f4d38161ff0 con 0x7f4d38160ba0 2023-12-20T04:46:59.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3d253640 1 -- 172.21.15.132:0/2777786982 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d24003520 con 0x7f4d38160ba0 2023-12-20T04:46:59.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3d253640 1 -- 172.21.15.132:0/2777786982 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1971011976 0 0) 0x7f4d381613e0 con 0x7f4d380ce2a0 2023-12-20T04:46:59.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3d253640 1 -- 172.21.15.132:0/2777786982 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d38161ff0 con 0x7f4d380ce2a0 2023-12-20T04:46:59.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3d253640 1 -- 172.21.15.132:0/2777786982 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2583556198 0 0) 0x7f4d24003520 con 0x7f4d38160ba0 2023-12-20T04:46:59.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3d253640 1 -- 172.21.15.132:0/2777786982 >> v2:172.21.15.187:3300/0 conn(0x7f4d380cba90 msgr2=0x7f4d380cf000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:59.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3d253640 1 --2- 172.21.15.132:0/2777786982 >> v2:172.21.15.187:3300/0 conn(0x7f4d380cba90 0x7f4d380cf000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3d253640 1 -- 172.21.15.132:0/2777786982 >> v1:172.21.15.187:6789/0 conn(0x7f4d380ce2a0 legacy=0x7f4d380cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3d253640 1 -- 172.21.15.132:0/2777786982 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d381616c0 con 0x7f4d38160ba0 2023-12-20T04:46:59.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3d253640 1 -- 172.21.15.132:0/2777786982 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f4d340015f0 con 0x7f4d38160ba0 2023-12-20T04:46:59.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3d253640 1 -- 172.21.15.132:0/2777786982 >> v1:172.21.15.132:6789/0 conn(0x7f4d38160ba0 legacy=0x7f4d380cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3d253640 1 --2- 172.21.15.132:0/2777786982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d24003b50 0x7f4d24003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3d253640 1 --2- 172.21.15.132:0/2777786982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d240047c0 0x7f4d24004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3d253640 1 --2- 172.21.15.132:0/2777786982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d240051d0 0x7f4d2400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3d253640 1 -- 172.21.15.132:0/2777786982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2400c0d0 con 0x7f4d240051d0 2023-12-20T04:46:59.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3d253640 1 -- 172.21.15.132:0/2777786982 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2400c240 con 0x7f4d240047c0 2023-12-20T04:46:59.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3d253640 1 -- 172.21.15.132:0/2777786982 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d2400c400 con 0x7f4d24003b50 2023-12-20T04:46:59.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3ea56640 1 --2- 172.21.15.132:0/2777786982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d240051d0 0x7f4d2400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3da54640 1 --2- 172.21.15.132:0/2777786982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d240047c0 0x7f4d24004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3e255640 1 --2- 172.21.15.132:0/2777786982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d24003b50 0x7f4d24003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3ea56640 1 -- 172.21.15.132:0/2777786982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d24003b50 msgr2=0x7f4d24003f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:59.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3ea56640 1 --2- 172.21.15.132:0/2777786982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d24003b50 0x7f4d24003f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3ea56640 1 -- 172.21.15.132:0/2777786982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d240047c0 msgr2=0x7f4d24004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:59.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3ea56640 1 --2- 172.21.15.132:0/2777786982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d240047c0 0x7f4d24004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.156+0000 7f4d3ea56640 1 -- 172.21.15.132:0/2777786982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d24003520 con 0x7f4d240051d0 2023-12-20T04:46:59.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.157+0000 7f4d3ea56640 1 -- 172.21.15.132:0/2777786982 reap_dead start 2023-12-20T04:46:59.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.157+0000 7f4d3ea56640 1 --2- 172.21.15.132:0/2777786982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d240051d0 0x7f4d2400b980 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f4d30001fa0 tx=0x7f4d240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c65dd58d5b7ec1a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:59.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.157+0000 7f4d3d253640 1 -- 172.21.15.132:0/2777786982 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30003b70 con 0x7f4d240051d0 2023-12-20T04:46:59.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.157+0000 7f4d3d253640 1 -- 172.21.15.132:0/2777786982 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d30003cd0 con 0x7f4d240051d0 2023-12-20T04:46:59.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.157+0000 7f4d3d253640 1 -- 172.21.15.132:0/2777786982 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d30005310 con 0x7f4d240051d0 2023-12-20T04:46:59.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.158+0000 7f4d404b9640 1 -- 172.21.15.132:0/2777786982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d240051d0 msgr2=0x7f4d2400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.158+0000 7f4d404b9640 1 --2- 172.21.15.132:0/2777786982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d240051d0 0x7f4d2400b980 secure :-1 s=READY pgs=947 cs=0 l=1 rev1=1 crypto rx=0x7f4d30001fa0 tx=0x7f4d240057f0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.158+0000 7f4d404b9640 1 -- 172.21.15.132:0/2777786982 shutdown_connections 2023-12-20T04:46:59.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.158+0000 7f4d404b9640 1 --2- 172.21.15.132:0/2777786982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d240051d0 0x7f4d2400b980 unknown :-1 s=CLOSED pgs=947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.158+0000 7f4d404b9640 1 -- 172.21.15.132:0/2777786982 >> 172.21.15.132:0/2777786982 conn(0x7f4d380cd7b0 msgr2=0x7f4d380cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:59.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.158+0000 7f4d404b9640 1 -- 172.21.15.132:0/2777786982 shutdown_connections 2023-12-20T04:46:59.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.158+0000 7f4d404b9640 1 -- 172.21.15.132:0/2777786982 wait complete. 2023-12-20T04:46:59.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.159+0000 7f4d404b9640 1 Processor -- start 2023-12-20T04:46:59.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.159+0000 7f4d404b9640 1 -- start start 2023-12-20T04:46:59.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d404b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d240051d0 0x7f4d38158240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d404b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d380ae7b0 0x7f4d380ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d404b9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d3806bf30 0x7f4d3806c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d404b9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d3806c900 con 0x7f4d240051d0 2023-12-20T04:46:59.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d404b9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380ad1c0 con 0x7f4d3806bf30 2023-12-20T04:46:59.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d404b9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d380ad4a0 con 0x7f4d380ae7b0 2023-12-20T04:46:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d3e255640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d240051d0 0x7f4d38158240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d3e255640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d240051d0 0x7f4d38158240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57496/0 (socket says 172.21.15.132:57496) 2023-12-20T04:46:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d3e255640 1 -- 172.21.15.132:0/4126014703 learned_addr learned my addr 172.21.15.132:0/4126014703 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d3ea56640 1 --2- 172.21.15.132:0/4126014703 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d3806bf30 0x7f4d3806c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d3da54640 1 --2- 172.21.15.132:0/4126014703 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d380ae7b0 0x7f4d380ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d3e255640 1 -- 172.21.15.132:0/4126014703 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d380ae7b0 msgr2=0x7f4d380ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d3e255640 1 --2- 172.21.15.132:0/4126014703 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d380ae7b0 0x7f4d380ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d3e255640 1 -- 172.21.15.132:0/4126014703 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d3806bf30 msgr2=0x7f4d3806c3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d3e255640 1 --2- 172.21.15.132:0/4126014703 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d3806bf30 0x7f4d3806c3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d3e255640 1 -- 172.21.15.132:0/4126014703 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d380ad780 con 0x7f4d240051d0 2023-12-20T04:46:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d3ea56640 1 --2- 172.21.15.132:0/4126014703 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d3806bf30 0x7f4d3806c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d3e255640 1 --2- 172.21.15.132:0/4126014703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d240051d0 0x7f4d38158240 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f4d34004db0 tx=0x7f4d34007430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d2effd640 1 -- 172.21.15.132:0/4126014703 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d340010d0 con 0x7f4d240051d0 2023-12-20T04:46:59.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d2effd640 1 -- 172.21.15.132:0/4126014703 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d34007770 con 0x7f4d240051d0 2023-12-20T04:46:59.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d2effd640 1 -- 172.21.15.132:0/4126014703 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d3400f970 con 0x7f4d240051d0 2023-12-20T04:46:59.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.160+0000 7f4d404b9640 1 -- 172.21.15.132:0/4126014703 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d380ada60 con 0x7f4d240051d0 2023-12-20T04:46:59.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.161+0000 7f4d404b9640 1 -- 172.21.15.132:0/4126014703 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d38158780 con 0x7f4d240051d0 2023-12-20T04:46:59.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.161+0000 7f4d404b9640 1 -- 172.21.15.132:0/4126014703 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d380adf80 con 0x7f4d240051d0 2023-12-20T04:46:59.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.162+0000 7f4d2effd640 1 -- 172.21.15.132:0/4126014703 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4d3400fad0 con 0x7f4d240051d0 2023-12-20T04:46:59.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.162+0000 7f4d2effd640 1 --2- 172.21.15.132:0/4126014703 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d1c06a430 0x7f4d1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.162+0000 7f4d2effd640 1 -- 172.21.15.132:0/4126014703 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4d34088880 con 0x7f4d240051d0 2023-12-20T04:46:59.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.162+0000 7f4d3da54640 1 --2- 172.21.15.132:0/4126014703 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d1c06a430 0x7f4d1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.162+0000 7f4d2effd640 1 -- 172.21.15.132:0/4126014703 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7f4d1c072020 con 0x7f4d240051d0 2023-12-20T04:46:59.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.163+0000 7f4d3da54640 1 --2- 172.21.15.132:0/4126014703 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d1c06a430 0x7f4d1c06c8f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4d380aebf0 tx=0x7f4d28008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:59.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.167+0000 7f4d2effd640 1 -- 172.21.15.132:0/4126014703 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4d380adf80 con 0x7f4d240051d0 2023-12-20T04:46:59.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.335+0000 7f4d404b9640 1 -- 172.21.15.132:0/4126014703 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d380adf80 con 0x7f4d240051d0 2023-12-20T04:46:59.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.336+0000 7f4d2effd640 1 -- 172.21.15.132:0/4126014703 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v86) v1 ==== 74+0+16288 (secure 0 0 0) 0x7f4d380adf80 con 0x7f4d240051d0 2023-12-20T04:46:59.338 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:46:59.338 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":86,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:46:42.871118+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:46:20.852337+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-20T04:46:21.431144+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","full","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:46:59.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.338+0000 7f4d404b9640 1 -- 172.21.15.132:0/4126014703 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d1c06a430 msgr2=0x7f4d1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.338+0000 7f4d404b9640 1 --2- 172.21.15.132:0/4126014703 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d1c06a430 0x7f4d1c06c8f0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f4d380aebf0 tx=0x7f4d28008040 comp rx=0 tx=0).stop 2023-12-20T04:46:59.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.338+0000 7f4d404b9640 1 -- 172.21.15.132:0/4126014703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d240051d0 msgr2=0x7f4d38158240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.338+0000 7f4d404b9640 1 --2- 172.21.15.132:0/4126014703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d240051d0 0x7f4d38158240 secure :-1 s=READY pgs=948 cs=0 l=1 rev1=1 crypto rx=0x7f4d34004db0 tx=0x7f4d34007430 comp rx=0 tx=0).stop 2023-12-20T04:46:59.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.338+0000 7f4d404b9640 1 -- 172.21.15.132:0/4126014703 shutdown_connections 2023-12-20T04:46:59.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.338+0000 7f4d404b9640 1 --2- 172.21.15.132:0/4126014703 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d1c06a430 0x7f4d1c06c8f0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.338+0000 7f4d404b9640 1 --2- 172.21.15.132:0/4126014703 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d3806bf30 0x7f4d3806c3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.338+0000 7f4d404b9640 1 --2- 172.21.15.132:0/4126014703 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d380ae7b0 0x7f4d380ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.338+0000 7f4d404b9640 1 --2- 172.21.15.132:0/4126014703 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d240051d0 0x7f4d38158240 unknown :-1 s=CLOSED pgs=948 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.338+0000 7f4d404b9640 1 -- 172.21.15.132:0/4126014703 >> 172.21.15.132:0/4126014703 conn(0x7f4d380cd7b0 msgr2=0x7f4d3806b780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:59.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.338+0000 7f4d404b9640 1 -- 172.21.15.132:0/4126014703 shutdown_connections 2023-12-20T04:46:59.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.338+0000 7f4d404b9640 1 -- 172.21.15.132:0/4126014703 wait complete. 2023-12-20T04:46:59.351 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 10, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:46:20.852337+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 11, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:46:21.431144+0000', 'flags': 3, 'flags_names': 'hashpspool,full', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '85', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:46:59.351 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:46:59.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.452+0000 7f35d5bae640 1 Processor -- start 2023-12-20T04:46:59.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.452+0000 7f35d5bae640 1 -- start start 2023-12-20T04:46:59.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.453+0000 7f35d5bae640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f35d015aee0 0x7f35d015eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.453+0000 7f35d5bae640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35d00cb2b0 0x7f35d00cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.453+0000 7f35d5bae640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f35d00d0130 con 0x7f35d00cdbb0 2023-12-20T04:46:59.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.453+0000 7f35d5bae640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f35d00ce040 con 0x7f35d015aee0 2023-12-20T04:46:59.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.453+0000 7f35d5bae640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d015f370 con 0x7f35d00cb2b0 2023-12-20T04:46:59.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.453+0000 7f35cf7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f35d015aee0 0x7f35d015eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.453+0000 7f35cf7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f35d015aee0 0x7f35d015eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57510/0 (socket says 172.21.15.132:57510) 2023-12-20T04:46:59.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.453+0000 7f35cf7fe640 1 -- 172.21.15.132:0/2085697431 learned_addr learned my addr 172.21.15.132:0/2085697431 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:59.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.453+0000 7f35ceffd640 1 --2- 172.21.15.132:0/2085697431 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35d00cb2b0 0x7f35d00cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.453+0000 7f35cf7fe640 1 -- 172.21.15.132:0/2085697431 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35d00cb2b0 msgr2=0x7f35d00cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:59.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.453+0000 7f35cf7fe640 1 --2- 172.21.15.132:0/2085697431 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35d00cb2b0 0x7f35d00cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.453+0000 7f35cf7fe640 1 -- 172.21.15.132:0/2085697431 >> v1:172.21.15.187:6789/0 conn(0x7f35d00cdbb0 legacy=0x7f35d00ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:59.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.453+0000 7f35cf7fe640 1 -- 172.21.15.132:0/2085697431 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35d015f650 con 0x7f35d015aee0 2023-12-20T04:46:59.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.454+0000 7f35cf7fe640 1 --2- 172.21.15.132:0/2085697431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35d015aee0 0x7f35d015eb40 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009870 tx=0x7f35c002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aade236e105a4441 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:59.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.454+0000 7f35ce7fc640 1 -- 172.21.15.132:0/2085697431 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0030840 con 0x7f35d015aee0 2023-12-20T04:46:59.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.454+0000 7f35ce7fc640 1 -- 172.21.15.132:0/2085697431 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c00309a0 con 0x7f35d015aee0 2023-12-20T04:46:59.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.454+0000 7f35ce7fc640 1 -- 172.21.15.132:0/2085697431 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0030d30 con 0x7f35d015aee0 2023-12-20T04:46:59.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.455+0000 7f35d5bae640 1 -- 172.21.15.132:0/2085697431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35d015aee0 msgr2=0x7f35d015eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.455+0000 7f35d5bae640 1 --2- 172.21.15.132:0/2085697431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35d015aee0 0x7f35d015eb40 secure :-1 s=READY pgs=949 cs=0 l=1 rev1=1 crypto rx=0x7f35c0009870 tx=0x7f35c002b980 comp rx=0 tx=0).stop 2023-12-20T04:46:59.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.455+0000 7f35d5bae640 1 -- 172.21.15.132:0/2085697431 shutdown_connections 2023-12-20T04:46:59.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.455+0000 7f35d5bae640 1 --2- 172.21.15.132:0/2085697431 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35d00cb2b0 0x7f35d00cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.455+0000 7f35d5bae640 1 --2- 172.21.15.132:0/2085697431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35d015aee0 0x7f35d015eb40 unknown :-1 s=CLOSED pgs=949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.455+0000 7f35d5bae640 1 -- 172.21.15.132:0/2085697431 >> 172.21.15.132:0/2085697431 conn(0x7f35d0072c60 msgr2=0x7f35d0073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:59.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.455+0000 7f35d5bae640 1 -- 172.21.15.132:0/2085697431 shutdown_connections 2023-12-20T04:46:59.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.455+0000 7f35d5bae640 1 -- 172.21.15.132:0/2085697431 wait complete. 2023-12-20T04:46:59.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.456+0000 7f35d5bae640 1 Processor -- start 2023-12-20T04:46:59.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.456+0000 7f35d5bae640 1 -- start start 2023-12-20T04:46:59.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.457+0000 7f35d5bae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35d00cb2b0 0x7f35d0155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.457+0000 7f35d5bae640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35d00cdbb0 0x7f35d0153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.457+0000 7f35d5bae640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35d015aee0 0x7f35d0154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.457+0000 7f35d5bae640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d014f730 con 0x7f35d00cb2b0 2023-12-20T04:46:59.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.457+0000 7f35d5bae640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35d0153820 con 0x7f35d00cdbb0 2023-12-20T04:46:59.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.457+0000 7f35d5bae640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35d006c6b0 con 0x7f35d015aee0 2023-12-20T04:46:59.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.457+0000 7f35cf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35d00cb2b0 0x7f35d0155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.457+0000 7f35cf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35d00cb2b0 0x7f35d0155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57520/0 (socket says 172.21.15.132:57520) 2023-12-20T04:46:59.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.457+0000 7f35cf7fe640 1 -- 172.21.15.132:0/183163434 learned_addr learned my addr 172.21.15.132:0/183163434 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:59.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.457+0000 7f35cf7fe640 1 -- 172.21.15.132:0/183163434 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35d015aee0 msgr2=0x7f35d0154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.457+0000 7f35cf7fe640 1 --2- 172.21.15.132:0/183163434 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35d015aee0 0x7f35d0154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.457+0000 7f35cf7fe640 1 -- 172.21.15.132:0/183163434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35d00cdbb0 msgr2=0x7f35d0153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.457+0000 7f35cf7fe640 1 --2- 172.21.15.132:0/183163434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35d00cdbb0 0x7f35d0153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.457+0000 7f35cf7fe640 1 -- 172.21.15.132:0/183163434 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35c00094d0 con 0x7f35d00cb2b0 2023-12-20T04:46:59.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.457+0000 7f35cf7fe640 1 --2- 172.21.15.132:0/183163434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35d00cb2b0 0x7f35d0155f90 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f35c002b9c0 tx=0x7f35c0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:59.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.458+0000 7f35b7fff640 1 -- 172.21.15.132:0/183163434 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0039a90 con 0x7f35d00cb2b0 2023-12-20T04:46:59.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.458+0000 7f35b7fff640 1 -- 172.21.15.132:0/183163434 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35c0039bf0 con 0x7f35d00cb2b0 2023-12-20T04:46:59.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.458+0000 7f35d5bae640 1 -- 172.21.15.132:0/183163434 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35d0153550 con 0x7f35d00cb2b0 2023-12-20T04:46:59.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.458+0000 7f35b7fff640 1 -- 172.21.15.132:0/183163434 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f35c0043410 con 0x7f35d00cb2b0 2023-12-20T04:46:59.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.458+0000 7f35d5bae640 1 -- 172.21.15.132:0/183163434 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35d006bbd0 con 0x7f35d00cb2b0 2023-12-20T04:46:59.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.459+0000 7f35d5bae640 1 -- 172.21.15.132:0/183163434 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35d004e840 con 0x7f35d00cb2b0 2023-12-20T04:46:59.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.459+0000 7f35b7fff640 1 -- 172.21.15.132:0/183163434 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f35c004c3b0 con 0x7f35d00cb2b0 2023-12-20T04:46:59.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.459+0000 7f35b7fff640 1 --2- 172.21.15.132:0/183163434 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f35bc06a430 0x7f35bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.459+0000 7f35b7fff640 1 -- 172.21.15.132:0/183163434 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f35c00aad30 con 0x7f35d00cb2b0 2023-12-20T04:46:59.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.459+0000 7f35ceffd640 1 --2- 172.21.15.132:0/183163434 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f35bc06a430 0x7f35bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.459+0000 7f35b7fff640 1 -- 172.21.15.132:0/183163434 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7f35bc072020 con 0x7f35d00cb2b0 2023-12-20T04:46:59.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.460+0000 7f35ceffd640 1 --2- 172.21.15.132:0/183163434 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f35bc06a430 0x7f35bc06c8f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f35c4006fd0 tx=0x7f35c4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:59.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.464+0000 7f35b7fff640 1 -- 172.21.15.132:0/183163434 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f35c0076490 con 0x7f35d00cb2b0 2023-12-20T04:46:59.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.626+0000 7f35d5bae640 1 -- 172.21.15.132:0/183163434 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f35d00b2890 con 0x7f35d00cb2b0 2023-12-20T04:46:59.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.626+0000 7f35b7fff640 1 -- 172.21.15.132:0/183163434 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v86) v1 ==== 93+0+10 (secure 0 0 0) 0x7f35c00480a0 con 0x7f35d00cb2b0 2023-12-20T04:46:59.628 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:46:59.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.628+0000 7f35d5bae640 1 -- 172.21.15.132:0/183163434 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f35bc06a430 msgr2=0x7f35bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.628+0000 7f35d5bae640 1 --2- 172.21.15.132:0/183163434 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f35bc06a430 0x7f35bc06c8f0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f35c4006fd0 tx=0x7f35c4008040 comp rx=0 tx=0).stop 2023-12-20T04:46:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.629+0000 7f35d5bae640 1 -- 172.21.15.132:0/183163434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35d00cb2b0 msgr2=0x7f35d0155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.629+0000 7f35d5bae640 1 --2- 172.21.15.132:0/183163434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35d00cb2b0 0x7f35d0155f90 secure :-1 s=READY pgs=950 cs=0 l=1 rev1=1 crypto rx=0x7f35c002b9c0 tx=0x7f35c0004730 comp rx=0 tx=0).stop 2023-12-20T04:46:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.629+0000 7f35d5bae640 1 -- 172.21.15.132:0/183163434 shutdown_connections 2023-12-20T04:46:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.629+0000 7f35d5bae640 1 --2- 172.21.15.132:0/183163434 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f35bc06a430 0x7f35bc06c8f0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.629+0000 7f35d5bae640 1 --2- 172.21.15.132:0/183163434 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35d015aee0 0x7f35d0154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.629+0000 7f35d5bae640 1 --2- 172.21.15.132:0/183163434 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35d00cdbb0 0x7f35d0153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.629+0000 7f35d5bae640 1 --2- 172.21.15.132:0/183163434 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f35d00cb2b0 0x7f35d0155f90 unknown :-1 s=CLOSED pgs=950 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.629+0000 7f35d5bae640 1 -- 172.21.15.132:0/183163434 >> 172.21.15.132:0/183163434 conn(0x7f35d0072c60 msgr2=0x7f35d00cd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.629+0000 7f35d5bae640 1 -- 172.21.15.132:0/183163434 shutdown_connections 2023-12-20T04:46:59.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.629+0000 7f35d5bae640 1 -- 172.21.15.132:0/183163434 wait complete. 2023-12-20T04:46:59.642 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:46:59.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.742+0000 7f921d9fb640 1 Processor -- start 2023-12-20T04:46:59.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.742+0000 7f921d9fb640 1 -- start start 2023-12-20T04:46:59.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.743+0000 7f921d9fb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9218069c30 0x7f9218070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.743+0000 7f921d9fb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f921815d360 0x7f921806a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.743+0000 7f921d9fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92180cbde0 0x7f92180ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.743+0000 7f921d9fb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92180c4f40 con 0x7f921815d360 2023-12-20T04:46:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.743+0000 7f921d9fb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f92180af5b0 con 0x7f9218069c30 2023-12-20T04:46:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.743+0000 7f921d9fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921806a550 con 0x7f92180cbde0 2023-12-20T04:46:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.743+0000 7f92167fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f921815d360 0x7f921806a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.743+0000 7f92167fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f921815d360 0x7f921806a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57536/0 (socket says 172.21.15.132:57536) 2023-12-20T04:46:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.743+0000 7f92167fc640 1 -- 172.21.15.132:0/1668294667 learned_addr learned my addr 172.21.15.132:0/1668294667 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.744+0000 7f9216ffd640 1 --2- 172.21.15.132:0/1668294667 >> v2:172.21.15.187:3300/0 conn(0x7f9218069c30 0x7f9218070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.744+0000 7f92177fe640 1 --2- 172.21.15.132:0/1668294667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92180cbde0 0x7f92180ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.744+0000 7f92167fc640 1 -- 172.21.15.132:0/1668294667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92180cbde0 msgr2=0x7f92180ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.744+0000 7f92167fc640 1 --2- 172.21.15.132:0/1668294667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92180cbde0 0x7f92180ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.744+0000 7f92167fc640 1 -- 172.21.15.132:0/1668294667 >> v2:172.21.15.187:3300/0 conn(0x7f9218069c30 msgr2=0x7f9218070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:46:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.744+0000 7f92167fc640 1 --2- 172.21.15.132:0/1668294667 >> v2:172.21.15.187:3300/0 conn(0x7f9218069c30 0x7f9218070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.744+0000 7f92167fc640 1 -- 172.21.15.132:0/1668294667 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9218070a40 con 0x7f921815d360 2023-12-20T04:46:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.744+0000 7f92177fe640 1 --2- 172.21.15.132:0/1668294667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92180cbde0 0x7f92180ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:46:59.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.744+0000 7f92167fc640 1 --2- 172.21.15.132:0/1668294667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f921815d360 0x7f921806a010 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f9218071870 tx=0x7f920c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af84c30aac3181c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.745+0000 7f9215ffb640 1 -- 172.21.15.132:0/1668294667 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c031870 con 0x7f921815d360 2023-12-20T04:46:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.745+0000 7f9215ffb640 1 -- 172.21.15.132:0/1668294667 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920c0319d0 con 0x7f921815d360 2023-12-20T04:46:59.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.745+0000 7f9215ffb640 1 -- 172.21.15.132:0/1668294667 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f920c031d60 con 0x7f921815d360 2023-12-20T04:46:59.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.745+0000 7f921d9fb640 1 -- 172.21.15.132:0/1668294667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f921815d360 msgr2=0x7f921806a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.745+0000 7f921d9fb640 1 --2- 172.21.15.132:0/1668294667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f921815d360 0x7f921806a010 secure :-1 s=READY pgs=951 cs=0 l=1 rev1=1 crypto rx=0x7f9218071870 tx=0x7f920c02b910 comp rx=0 tx=0).stop 2023-12-20T04:46:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.745+0000 7f921d9fb640 1 -- 172.21.15.132:0/1668294667 shutdown_connections 2023-12-20T04:46:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.745+0000 7f921d9fb640 1 --2- 172.21.15.132:0/1668294667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92180cbde0 0x7f92180ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.745+0000 7f921d9fb640 1 --2- 172.21.15.132:0/1668294667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f921815d360 0x7f921806a010 unknown :-1 s=CLOSED pgs=951 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.745+0000 7f921d9fb640 1 --2- 172.21.15.132:0/1668294667 >> v2:172.21.15.187:3300/0 conn(0x7f9218069c30 0x7f9218070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.745+0000 7f921d9fb640 1 -- 172.21.15.132:0/1668294667 >> 172.21.15.132:0/1668294667 conn(0x7f92180cc630 msgr2=0x7f92180cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.745+0000 7f921d9fb640 1 -- 172.21.15.132:0/1668294667 shutdown_connections 2023-12-20T04:46:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.745+0000 7f921d9fb640 1 -- 172.21.15.132:0/1668294667 wait complete. 2023-12-20T04:46:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.746+0000 7f921d9fb640 1 Processor -- start 2023-12-20T04:46:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.746+0000 7f921d9fb640 1 -- start start 2023-12-20T04:46:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.747+0000 7f921d9fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9218069c30 0x7f9218151450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.747+0000 7f921d9fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92180cbde0 0x7f92181f5f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.747+0000 7f921d9fb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f921815d360 0x7f92181f64c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.747+0000 7f921d9fb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9218151990 con 0x7f9218069c30 2023-12-20T04:46:59.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.747+0000 7f921d9fb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f921815b150 con 0x7f921815d360 2023-12-20T04:46:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.747+0000 7f921d9fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f921815ae70 con 0x7f92180cbde0 2023-12-20T04:46:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.747+0000 7f9216ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9218069c30 0x7f9218151450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.747+0000 7f9216ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9218069c30 0x7f9218151450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57542/0 (socket says 172.21.15.132:57542) 2023-12-20T04:46:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.747+0000 7f9216ffd640 1 -- 172.21.15.132:0/2174062240 learned_addr learned my addr 172.21.15.132:0/2174062240 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:46:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.747+0000 7f92177fe640 1 --2- 172.21.15.132:0/2174062240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f921815d360 0x7f92181f64c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.747+0000 7f92167fc640 1 --2- 172.21.15.132:0/2174062240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92180cbde0 0x7f92181f5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.747+0000 7f9216ffd640 1 -- 172.21.15.132:0/2174062240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92180cbde0 msgr2=0x7f92181f5f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.747+0000 7f9216ffd640 1 --2- 172.21.15.132:0/2174062240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92180cbde0 0x7f92181f5f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.747+0000 7f9216ffd640 1 -- 172.21.15.132:0/2174062240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f921815d360 msgr2=0x7f92181f64c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.747+0000 7f9216ffd640 1 --2- 172.21.15.132:0/2174062240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f921815d360 0x7f92181f64c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.747+0000 7f9216ffd640 1 -- 172.21.15.132:0/2174062240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f920c0094d0 con 0x7f9218069c30 2023-12-20T04:46:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.747+0000 7f92177fe640 1 --2- 172.21.15.132:0/2174062240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f921815d360 0x7f92181f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:59.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.748+0000 7f92167fc640 1 --2- 172.21.15.132:0/2174062240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92180cbde0 0x7f92181f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:46:59.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.748+0000 7f9216ffd640 1 --2- 172.21.15.132:0/2174062240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9218069c30 0x7f9218151450 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f920800eed0 tx=0x7f920800b480 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:59.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.748+0000 7f91fffff640 1 -- 172.21.15.132:0/2174062240 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9208010040 con 0x7f9218069c30 2023-12-20T04:46:59.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.748+0000 7f91fffff640 1 -- 172.21.15.132:0/2174062240 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f920800bd90 con 0x7f9218069c30 2023-12-20T04:46:59.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.748+0000 7f921d9fb640 1 -- 172.21.15.132:0/2174062240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f921806c720 con 0x7f9218069c30 2023-12-20T04:46:59.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.748+0000 7f91fffff640 1 -- 172.21.15.132:0/2174062240 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9208014620 con 0x7f9218069c30 2023-12-20T04:46:59.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.748+0000 7f921d9fb640 1 -- 172.21.15.132:0/2174062240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f921806cce0 con 0x7f9218069c30 2023-12-20T04:46:59.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.749+0000 7f921d9fb640 1 -- 172.21.15.132:0/2174062240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f921806ce70 con 0x7f9218069c30 2023-12-20T04:46:59.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.749+0000 7f91fffff640 1 -- 172.21.15.132:0/2174062240 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9208014990 con 0x7f9218069c30 2023-12-20T04:46:59.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.750+0000 7f91fffff640 1 --2- 172.21.15.132:0/2174062240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f920406a430 0x7f920406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:46:59.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.750+0000 7f91fffff640 1 -- 172.21.15.132:0/2174062240 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(86..86 src has 1..86) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9208089200 con 0x7f9218069c30 2023-12-20T04:46:59.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.750+0000 7f92167fc640 1 --2- 172.21.15.132:0/2174062240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f920406a430 0x7f920406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:46:59.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.750+0000 7f91fffff640 1 -- 172.21.15.132:0/2174062240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=87}) v3 -- 0x7f9204072020 con 0x7f9218069c30 2023-12-20T04:46:59.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.750+0000 7f92167fc640 1 --2- 172.21.15.132:0/2174062240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f920406a430 0x7f920406c8f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f920c036000 tx=0x7f920c03c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:46:59.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.754+0000 7f91fffff640 1 -- 172.21.15.132:0/2174062240 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9208054840 con 0x7f9218069c30 2023-12-20T04:46:59.908 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:46:59.907+0000 7f1a5f3c2640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-12-20T04:46:59.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.916+0000 7f91fffff640 1 -- 172.21.15.132:0/2174062240 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(87..87 src has 1..87) v4 ==== 296+0+0 (secure 0 0 0) 0x7f9208058c00 con 0x7f9218069c30 2023-12-20T04:46:59.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.916+0000 7f91fffff640 1 -- 172.21.15.132:0/2174062240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7f9204072860 con 0x7f9218069c30 2023-12-20T04:46:59.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.922+0000 7f921d9fb640 1 -- 172.21.15.132:0/2174062240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f921804e840 con 0x7f9218069c30 2023-12-20T04:46:59.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.922+0000 7f91fffff640 1 -- 172.21.15.132:0/2174062240 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v87) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9208057e60 con 0x7f9218069c30 2023-12-20T04:46:59.924 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:46:59.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.924+0000 7f921d9fb640 1 -- 172.21.15.132:0/2174062240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f920406a430 msgr2=0x7f920406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.924+0000 7f921d9fb640 1 --2- 172.21.15.132:0/2174062240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f920406a430 0x7f920406c8f0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f920c036000 tx=0x7f920c03c040 comp rx=0 tx=0).stop 2023-12-20T04:46:59.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.924+0000 7f921d9fb640 1 -- 172.21.15.132:0/2174062240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9218069c30 msgr2=0x7f9218151450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:46:59.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.924+0000 7f921d9fb640 1 --2- 172.21.15.132:0/2174062240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9218069c30 0x7f9218151450 secure :-1 s=READY pgs=952 cs=0 l=1 rev1=1 crypto rx=0x7f920800eed0 tx=0x7f920800b480 comp rx=0 tx=0).stop 2023-12-20T04:46:59.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.924+0000 7f921d9fb640 1 -- 172.21.15.132:0/2174062240 shutdown_connections 2023-12-20T04:46:59.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.924+0000 7f921d9fb640 1 --2- 172.21.15.132:0/2174062240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f920406a430 0x7f920406c8f0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.924+0000 7f921d9fb640 1 --2- 172.21.15.132:0/2174062240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f921815d360 0x7f92181f64c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.924+0000 7f921d9fb640 1 --2- 172.21.15.132:0/2174062240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f92180cbde0 0x7f92181f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.924+0000 7f921d9fb640 1 --2- 172.21.15.132:0/2174062240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9218069c30 0x7f9218151450 unknown :-1 s=CLOSED pgs=952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:46:59.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.924+0000 7f921d9fb640 1 -- 172.21.15.132:0/2174062240 >> 172.21.15.132:0/2174062240 conn(0x7f92180cc630 msgr2=0x7f92180cb000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:46:59.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.924+0000 7f921d9fb640 1 -- 172.21.15.132:0/2174062240 shutdown_connections 2023-12-20T04:46:59.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:46:59.924+0000 7f921d9fb640 1 -- 172.21.15.132:0/2174062240 wait complete. 2023-12-20T04:46:59.937 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:47:00.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.038+0000 7fd5ed7f0640 1 Processor -- start 2023-12-20T04:47:00.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.038+0000 7fd5ed7f0640 1 -- start start 2023-12-20T04:47:00.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.038+0000 7fd5ed7f0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80cf790 0x7fd5e80cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.039+0000 7fd5ed7f0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd5e80b6080 0x7fd5e80b64d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.039+0000 7fd5ed7f0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd5e80d0150 con 0x7fd5e815d300 2023-12-20T04:47:00.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.039+0000 7fd5ed7f0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd5e80d2920 con 0x7fd5e80b6080 2023-12-20T04:47:00.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.039+0000 7fd5ed7f0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e80d1d10 con 0x7fd5e80cf790 2023-12-20T04:47:00.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.039+0000 7fd5e77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd5e80b6080 0x7fd5e80b64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.039+0000 7fd5e6ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd5e815d300 0x7fd5e80d1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45476/0 (socket says 172.21.15.132:45476) 2023-12-20T04:47:00.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.039+0000 7fd5e6ffd640 1 -- 172.21.15.132:0/142499095 learned_addr learned my addr 172.21.15.132:0/142499095 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:00.041 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.039+0000 7fd5e77fe640 1 -- 172.21.15.132:0/142499095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80cf790 msgr2=0x7fd5e80cfc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:00.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.039+0000 7fd5e77fe640 1 --2- 172.21.15.132:0/142499095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80cf790 0x7fd5e80cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.039+0000 7fd5e77fe640 1 -- 172.21.15.132:0/142499095 >> v1:172.21.15.132:6789/0 conn(0x7fd5e815d300 legacy=0x7fd5e80d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.039+0000 7fd5e67fc640 1 -- 172.21.15.132:0/142499095 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3664502611 0 0) 0x7fd5e80d0150 con 0x7fd5e815d300 2023-12-20T04:47:00.042 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.039+0000 7fd5e77fe640 1 -- 172.21.15.132:0/142499095 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e80d1ff0 con 0x7fd5e80b6080 2023-12-20T04:47:00.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.040+0000 7fd5e77fe640 1 --2- 172.21.15.132:0/142499095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5e80b6080 0x7fd5e80b64d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009d90 tx=0x7fd5e002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d58818775ddfa490 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:00.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.040+0000 7fd5e67fc640 1 -- 172.21.15.132:0/142499095 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e002cc50 con 0x7fd5e80b6080 2023-12-20T04:47:00.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.040+0000 7fd5e67fc640 1 -- 172.21.15.132:0/142499095 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e002cdb0 con 0x7fd5e80b6080 2023-12-20T04:47:00.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.040+0000 7fd5e67fc640 1 -- 172.21.15.132:0/142499095 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e0034660 con 0x7fd5e80b6080 2023-12-20T04:47:00.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.040+0000 7fd5ed7f0640 1 -- 172.21.15.132:0/142499095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5e80b6080 msgr2=0x7fd5e80b64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.040+0000 7fd5ed7f0640 1 --2- 172.21.15.132:0/142499095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5e80b6080 0x7fd5e80b64d0 secure :-1 s=READY pgs=954 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009d90 tx=0x7fd5e002bea0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.040+0000 7fd5ed7f0640 1 -- 172.21.15.132:0/142499095 shutdown_connections 2023-12-20T04:47:00.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.040+0000 7fd5ed7f0640 1 --2- 172.21.15.132:0/142499095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5e80b6080 0x7fd5e80b64d0 unknown :-1 s=CLOSED pgs=954 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.040+0000 7fd5ed7f0640 1 --2- 172.21.15.132:0/142499095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80cf790 0x7fd5e80cfc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.040+0000 7fd5ed7f0640 1 -- 172.21.15.132:0/142499095 >> 172.21.15.132:0/142499095 conn(0x7fd5e806a3d0 msgr2=0x7fd5e806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:00.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.040+0000 7fd5ed7f0640 1 -- 172.21.15.132:0/142499095 shutdown_connections 2023-12-20T04:47:00.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.040+0000 7fd5ed7f0640 1 -- 172.21.15.132:0/142499095 wait complete. 2023-12-20T04:47:00.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.042+0000 7fd5ed7f0640 1 Processor -- start 2023-12-20T04:47:00.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.042+0000 7fd5ed7f0640 1 -- start start 2023-12-20T04:47:00.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.042+0000 7fd5ed7f0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80b6080 0x7fd5e81f2650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.042+0000 7fd5ed7f0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5e80cf790 0x7fd5e815f320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.042+0000 7fd5ed7f0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5e815d300 0x7fd5e80c70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.042+0000 7fd5ed7f0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e815fc50 con 0x7fd5e815d300 2023-12-20T04:47:00.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.042+0000 7fd5ed7f0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e815ff30 con 0x7fd5e80cf790 2023-12-20T04:47:00.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.042+0000 7fd5ed7f0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd5e80c68e0 con 0x7fd5e80b6080 2023-12-20T04:47:00.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.042+0000 7fd5e77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5e815d300 0x7fd5e80c70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.042+0000 7fd5e77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5e815d300 0x7fd5e80c70e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57562/0 (socket says 172.21.15.132:57562) 2023-12-20T04:47:00.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.042+0000 7fd5e77fe640 1 -- 172.21.15.132:0/72847866 learned_addr learned my addr 172.21.15.132:0/72847866 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:00.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.043+0000 7fd5e6ffd640 1 --2- 172.21.15.132:0/72847866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80b6080 0x7fd5e81f2650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.043+0000 7fd5dffff640 1 --2- 172.21.15.132:0/72847866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5e80cf790 0x7fd5e815f320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.043+0000 7fd5e77fe640 1 -- 172.21.15.132:0/72847866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80b6080 msgr2=0x7fd5e81f2650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.043+0000 7fd5e77fe640 1 --2- 172.21.15.132:0/72847866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80b6080 0x7fd5e81f2650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.043+0000 7fd5e77fe640 1 -- 172.21.15.132:0/72847866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5e80cf790 msgr2=0x7fd5e815f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.043+0000 7fd5e77fe640 1 --2- 172.21.15.132:0/72847866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5e80cf790 0x7fd5e815f320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.043+0000 7fd5e77fe640 1 -- 172.21.15.132:0/72847866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd5e0009a70 con 0x7fd5e815d300 2023-12-20T04:47:00.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.043+0000 7fd5e77fe640 1 --2- 172.21.15.132:0/72847866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5e815d300 0x7fd5e80c70e0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009d90 tx=0x7fd5e0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:00.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.043+0000 7fd5df7fe640 1 -- 172.21.15.132:0/72847866 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e003e610 con 0x7fd5e815d300 2023-12-20T04:47:00.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.043+0000 7fd5df7fe640 1 -- 172.21.15.132:0/72847866 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd5e003e790 con 0x7fd5e815d300 2023-12-20T04:47:00.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.043+0000 7fd5df7fe640 1 -- 172.21.15.132:0/72847866 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd5e003eb40 con 0x7fd5e815d300 2023-12-20T04:47:00.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.043+0000 7fd5ed7f0640 1 -- 172.21.15.132:0/72847866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd5e80c6bc0 con 0x7fd5e815d300 2023-12-20T04:47:00.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.043+0000 7fd5ed7f0640 1 -- 172.21.15.132:0/72847866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd5e815f860 con 0x7fd5e815d300 2023-12-20T04:47:00.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.044+0000 7fd5ed7f0640 1 -- 172.21.15.132:0/72847866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd5e815ab00 con 0x7fd5e815d300 2023-12-20T04:47:00.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.044+0000 7fd5df7fe640 1 -- 172.21.15.132:0/72847866 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd5e003b050 con 0x7fd5e815d300 2023-12-20T04:47:00.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.045+0000 7fd5df7fe640 1 --2- 172.21.15.132:0/72847866 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd5c806a430 0x7fd5c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.045+0000 7fd5df7fe640 1 -- 172.21.15.132:0/72847866 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd5e00ab320 con 0x7fd5e815d300 2023-12-20T04:47:00.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.045+0000 7fd5e6ffd640 1 --2- 172.21.15.132:0/72847866 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd5c806a430 0x7fd5c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.045+0000 7fd5df7fe640 1 -- 172.21.15.132:0/72847866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7fd5c8072020 con 0x7fd5e815d300 2023-12-20T04:47:00.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.045+0000 7fd5e6ffd640 1 --2- 172.21.15.132:0/72847866 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd5c806a430 0x7fd5c806c8f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8000f60 tx=0x7fd5d8007c00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:00.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.049+0000 7fd5df7fe640 1 -- 172.21.15.132:0/72847866 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd5e0039060 con 0x7fd5e815d300 2023-12-20T04:47:00.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.216+0000 7fd5ed7f0640 1 -- 172.21.15.132:0/72847866 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fd5e80c6dd0 con 0x7fd5e815d300 2023-12-20T04:47:00.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.216+0000 7fd5df7fe640 1 -- 172.21.15.132:0/72847866 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v87) v1 ==== 100+0+11 (secure 0 0 0) 0x7fd5e004e070 con 0x7fd5e815d300 2023-12-20T04:47:00.218 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:47:00.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.218+0000 7fd5ed7f0640 1 -- 172.21.15.132:0/72847866 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd5c806a430 msgr2=0x7fd5c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.218+0000 7fd5ed7f0640 1 --2- 172.21.15.132:0/72847866 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd5c806a430 0x7fd5c806c8f0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7fd5d8000f60 tx=0x7fd5d8007c00 comp rx=0 tx=0).stop 2023-12-20T04:47:00.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.218+0000 7fd5ed7f0640 1 -- 172.21.15.132:0/72847866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5e815d300 msgr2=0x7fd5e80c70e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.218+0000 7fd5ed7f0640 1 --2- 172.21.15.132:0/72847866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5e815d300 0x7fd5e80c70e0 secure :-1 s=READY pgs=955 cs=0 l=1 rev1=1 crypto rx=0x7fd5e0009d90 tx=0x7fd5e0004a40 comp rx=0 tx=0).stop 2023-12-20T04:47:00.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.218+0000 7fd5ed7f0640 1 -- 172.21.15.132:0/72847866 shutdown_connections 2023-12-20T04:47:00.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.218+0000 7fd5ed7f0640 1 --2- 172.21.15.132:0/72847866 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd5c806a430 0x7fd5c806c8f0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.218+0000 7fd5ed7f0640 1 --2- 172.21.15.132:0/72847866 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd5e815d300 0x7fd5e80c70e0 unknown :-1 s=CLOSED pgs=955 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.218+0000 7fd5ed7f0640 1 --2- 172.21.15.132:0/72847866 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd5e80cf790 0x7fd5e815f320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.218+0000 7fd5ed7f0640 1 --2- 172.21.15.132:0/72847866 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd5e80b6080 0x7fd5e81f2650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.218+0000 7fd5ed7f0640 1 -- 172.21.15.132:0/72847866 >> 172.21.15.132:0/72847866 conn(0x7fd5e806a3d0 msgr2=0x7fd5e815c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:00.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.218+0000 7fd5ed7f0640 1 -- 172.21.15.132:0/72847866 shutdown_connections 2023-12-20T04:47:00.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.218+0000 7fd5ed7f0640 1 -- 172.21.15.132:0/72847866 wait complete. 2023-12-20T04:47:00.231 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:47:00.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.329+0000 7f649cf31640 1 Processor -- start 2023-12-20T04:47:00.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.329+0000 7f649cf31640 1 -- start start 2023-12-20T04:47:00.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.330+0000 7f649cf31640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6498160450 0x7f6498160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.330+0000 7f649cf31640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f64980b5090 0x7f64980d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.330+0000 7f649cf31640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64980b5ec0 con 0x7f64981611b0 2023-12-20T04:47:00.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.330+0000 7f649cf31640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64981617e0 con 0x7f64980b5090 2023-12-20T04:47:00.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.330+0000 7f649cf31640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64980d0fc0 con 0x7f6498160450 2023-12-20T04:47:00.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.330+0000 7f6496d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f64980b5090 0x7f64980d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.330+0000 7f648ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f64981611b0 0x7f64980b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45478/0 (socket says 172.21.15.132:45478) 2023-12-20T04:47:00.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.330+0000 7f6496d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f64980b5090 0x7f64980d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57570/0 (socket says 172.21.15.132:57570) 2023-12-20T04:47:00.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.330+0000 7f648ffff640 1 -- 172.21.15.132:0/3635353495 learned_addr learned my addr 172.21.15.132:0/3635353495 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:00.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.330+0000 7f649659c640 1 --2- 172.21.15.132:0/3635353495 >> v2:172.21.15.187:3300/0 conn(0x7f6498160450 0x7f6498160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.330+0000 7f6496d9d640 1 -- 172.21.15.132:0/3635353495 >> v2:172.21.15.187:3300/0 conn(0x7f6498160450 msgr2=0x7f6498160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:00.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.330+0000 7f6496d9d640 1 --2- 172.21.15.132:0/3635353495 >> v2:172.21.15.187:3300/0 conn(0x7f6498160450 0x7f6498160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.330+0000 7f6496d9d640 1 -- 172.21.15.132:0/3635353495 >> v1:172.21.15.132:6789/0 conn(0x7f64981611b0 legacy=0x7f64980b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.330+0000 7f6496d9d640 1 -- 172.21.15.132:0/3635353495 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64980d12a0 con 0x7f64980b5090 2023-12-20T04:47:00.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.330+0000 7f6495d9b640 1 -- 172.21.15.132:0/3635353495 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1942957593 0 0) 0x7f64980b5ec0 con 0x7f64981611b0 2023-12-20T04:47:00.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.331+0000 7f6496d9d640 1 --2- 172.21.15.132:0/3635353495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64980b5090 0x7f64980d1aa0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f649808b150 tx=0x7f649002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb8857a37a4b783 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:00.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.331+0000 7f6495d9b640 1 -- 172.21.15.132:0/3635353495 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649002cd00 con 0x7f64980b5090 2023-12-20T04:47:00.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.331+0000 7f6495d9b640 1 -- 172.21.15.132:0/3635353495 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649002ce60 con 0x7f64980b5090 2023-12-20T04:47:00.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.331+0000 7f6495d9b640 1 -- 172.21.15.132:0/3635353495 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6490034660 con 0x7f64980b5090 2023-12-20T04:47:00.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.332+0000 7f649cf31640 1 -- 172.21.15.132:0/3635353495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64980b5090 msgr2=0x7f64980d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.332+0000 7f649cf31640 1 --2- 172.21.15.132:0/3635353495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64980b5090 0x7f64980d1aa0 secure :-1 s=READY pgs=957 cs=0 l=1 rev1=1 crypto rx=0x7f649808b150 tx=0x7f649002bf50 comp rx=0 tx=0).stop 2023-12-20T04:47:00.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.332+0000 7f649cf31640 1 -- 172.21.15.132:0/3635353495 shutdown_connections 2023-12-20T04:47:00.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.332+0000 7f649cf31640 1 --2- 172.21.15.132:0/3635353495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64980b5090 0x7f64980d1aa0 unknown :-1 s=CLOSED pgs=957 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.332+0000 7f649cf31640 1 --2- 172.21.15.132:0/3635353495 >> v2:172.21.15.187:3300/0 conn(0x7f6498160450 0x7f6498160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.332+0000 7f649cf31640 1 -- 172.21.15.132:0/3635353495 >> 172.21.15.132:0/3635353495 conn(0x7f64980cf980 msgr2=0x7f64980cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:00.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.332+0000 7f649cf31640 1 -- 172.21.15.132:0/3635353495 shutdown_connections 2023-12-20T04:47:00.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.332+0000 7f649cf31640 1 -- 172.21.15.132:0/3635353495 wait complete. 2023-12-20T04:47:00.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.333+0000 7f649cf31640 1 Processor -- start 2023-12-20T04:47:00.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.333+0000 7f649cf31640 1 -- start start 2023-12-20T04:47:00.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f649cf31640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64980b5090 0x7f64981f2050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f649cf31640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6498160450 0x7f64980d3560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f649cf31640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64981611b0 0x7f649814f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f649cf31640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64981f2590 con 0x7f64981611b0 2023-12-20T04:47:00.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f649cf31640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64980d24c0 con 0x7f64980b5090 2023-12-20T04:47:00.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f649cf31640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64980d27a0 con 0x7f6498160450 2023-12-20T04:47:00.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f6496d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64981611b0 0x7f649814f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f6496d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64981611b0 0x7f649814f630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57582/0 (socket says 172.21.15.132:57582) 2023-12-20T04:47:00.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f6496d9d640 1 -- 172.21.15.132:0/2848125728 learned_addr learned my addr 172.21.15.132:0/2848125728 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:00.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f649659c640 1 --2- 172.21.15.132:0/2848125728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64980b5090 0x7f64981f2050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f648ffff640 1 --2- 172.21.15.132:0/2848125728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6498160450 0x7f64980d3560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f6496d9d640 1 -- 172.21.15.132:0/2848125728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6498160450 msgr2=0x7f64980d3560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f6496d9d640 1 --2- 172.21.15.132:0/2848125728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6498160450 0x7f64980d3560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f6496d9d640 1 -- 172.21.15.132:0/2848125728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64980b5090 msgr2=0x7f64981f2050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f6496d9d640 1 --2- 172.21.15.132:0/2848125728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64980b5090 0x7f64981f2050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f6496d9d640 1 -- 172.21.15.132:0/2848125728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6490009a70 con 0x7f64981611b0 2023-12-20T04:47:00.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f648ffff640 1 --2- 172.21.15.132:0/2848125728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6498160450 0x7f64980d3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:00.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f6496d9d640 1 --2- 172.21.15.132:0/2848125728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64981611b0 0x7f649814f630 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f6490009e80 tx=0x7f6490004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:00.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.334+0000 7f648effd640 1 -- 172.21.15.132:0/2848125728 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649003d600 con 0x7f64981611b0 2023-12-20T04:47:00.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.335+0000 7f648effd640 1 -- 172.21.15.132:0/2848125728 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649003d780 con 0x7f64981611b0 2023-12-20T04:47:00.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.335+0000 7f648effd640 1 -- 172.21.15.132:0/2848125728 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649003db30 con 0x7f64981611b0 2023-12-20T04:47:00.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.335+0000 7f649cf31640 1 -- 172.21.15.132:0/2848125728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64980d2a80 con 0x7f64981611b0 2023-12-20T04:47:00.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.335+0000 7f649cf31640 1 -- 172.21.15.132:0/2848125728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64980d3040 con 0x7f64981611b0 2023-12-20T04:47:00.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.335+0000 7f649cf31640 1 -- 172.21.15.132:0/2848125728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649804e840 con 0x7f64981611b0 2023-12-20T04:47:00.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.336+0000 7f648effd640 1 -- 172.21.15.132:0/2848125728 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f649003b040 con 0x7f64981611b0 2023-12-20T04:47:00.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.336+0000 7f648effd640 1 --2- 172.21.15.132:0/2848125728 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f647806a430 0x7f647806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.336+0000 7f649659c640 1 --2- 172.21.15.132:0/2848125728 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f647806a430 0x7f647806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.337+0000 7f648effd640 1 -- 172.21.15.132:0/2848125728 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f64900aae80 con 0x7f64981611b0 2023-12-20T04:47:00.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.337+0000 7f648effd640 1 -- 172.21.15.132:0/2848125728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7f6478072020 con 0x7f64981611b0 2023-12-20T04:47:00.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.337+0000 7f649659c640 1 --2- 172.21.15.132:0/2848125728 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f647806a430 0x7f647806c8f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6488009ad0 tx=0x7f6488008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:00.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.341+0000 7f648effd640 1 -- 172.21.15.132:0/2848125728 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f64900764c0 con 0x7f64981611b0 2023-12-20T04:47:00.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.541+0000 7f649cf31640 1 -- 172.21.15.132:0/2848125728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f64980d0ad0 con 0x7f64981611b0 2023-12-20T04:47:00.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.542+0000 7f648effd640 1 -- 172.21.15.132:0/2848125728 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f649004e020 con 0x7f64981611b0 2023-12-20T04:47:00.544 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:00.544 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":32,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2337953767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2337953767},{"type":"v1","addr":"172.21.15.187:6835","nonce":2337953767}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6540,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/41640576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":41640576},{"type":"v1","addr":"172.21.15.132:6836","nonce":41640576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6543,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2936157584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2936157584},{"type":"v1","addr":"172.21.15.132:6837","nonce":2936157584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:46:22.459815+0000","modified":"2023-12-20T04:46:24.470923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6552":{"gid":6552,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6833/3732620607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3732620607},{"type":"v1","addr":"172.21.15.187:6833","nonce":3732620607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-20T04:47:00.544 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 32 2023-12-20T04:47:00.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.544+0000 7f649cf31640 1 -- 172.21.15.132:0/2848125728 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f647806a430 msgr2=0x7f647806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.544+0000 7f649cf31640 1 --2- 172.21.15.132:0/2848125728 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f647806a430 0x7f647806c8f0 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f6488009ad0 tx=0x7f6488008040 comp rx=0 tx=0).stop 2023-12-20T04:47:00.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.544+0000 7f649cf31640 1 -- 172.21.15.132:0/2848125728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64981611b0 msgr2=0x7f649814f630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.544+0000 7f649cf31640 1 --2- 172.21.15.132:0/2848125728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64981611b0 0x7f649814f630 secure :-1 s=READY pgs=958 cs=0 l=1 rev1=1 crypto rx=0x7f6490009e80 tx=0x7f6490004a40 comp rx=0 tx=0).stop 2023-12-20T04:47:00.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.544+0000 7f649cf31640 1 -- 172.21.15.132:0/2848125728 shutdown_connections 2023-12-20T04:47:00.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.544+0000 7f649cf31640 1 --2- 172.21.15.132:0/2848125728 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f647806a430 0x7f647806c8f0 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.544+0000 7f649cf31640 1 --2- 172.21.15.132:0/2848125728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f64981611b0 0x7f649814f630 unknown :-1 s=CLOSED pgs=958 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.544+0000 7f649cf31640 1 --2- 172.21.15.132:0/2848125728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6498160450 0x7f64980d3560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.544+0000 7f649cf31640 1 --2- 172.21.15.132:0/2848125728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f64980b5090 0x7f64981f2050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.544+0000 7f649cf31640 1 -- 172.21.15.132:0/2848125728 >> 172.21.15.132:0/2848125728 conn(0x7f64980cf980 msgr2=0x7f649815da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:00.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.544+0000 7f649cf31640 1 -- 172.21.15.132:0/2848125728 shutdown_connections 2023-12-20T04:47:00.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.544+0000 7f649cf31640 1 -- 172.21.15.132:0/2848125728 wait complete. 2023-12-20T04:47:00.557 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:47:00.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.654+0000 7f354f3ab640 1 Processor -- start 2023-12-20T04:47:00.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.655+0000 7f354f3ab640 1 -- start start 2023-12-20T04:47:00.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.655+0000 7f354f3ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35481588e0 0x7f3548069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.655+0000 7f354f3ab640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f354806a170 0x7f354806c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.655+0000 7f354f3ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f354806cd30 0x7f35480b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.655+0000 7f354f3ab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354806d520 con 0x7f354806cd30 2023-12-20T04:47:00.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.655+0000 7f354f3ab640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f354806a5d0 con 0x7f354806a170 2023-12-20T04:47:00.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.655+0000 7f354f3ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f354806ea90 con 0x7f35481588e0 2023-12-20T04:47:00.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.655+0000 7f354d948640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f354806cd30 0x7f35480b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.655+0000 7f354d948640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f354806cd30 0x7f35480b4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57592/0 (socket says 172.21.15.132:57592) 2023-12-20T04:47:00.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.655+0000 7f354d948640 1 -- 172.21.15.132:0/2886471985 learned_addr learned my addr 172.21.15.132:0/2886471985 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:00.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.656+0000 7f354d147640 1 --2- 172.21.15.132:0/2886471985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35481588e0 0x7f3548069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.656+0000 7f354c946640 1 --2- 172.21.15.132:0/2886471985 >> v2:172.21.15.187:3300/0 conn(0x7f354806a170 0x7f354806c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.656+0000 7f354d948640 1 -- 172.21.15.132:0/2886471985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35481588e0 msgr2=0x7f3548069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:00.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.656+0000 7f354d948640 1 --2- 172.21.15.132:0/2886471985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35481588e0 0x7f3548069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.656+0000 7f354d948640 1 -- 172.21.15.132:0/2886471985 >> v2:172.21.15.187:3300/0 conn(0x7f354806a170 msgr2=0x7f354806c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:00.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.656+0000 7f354d948640 1 --2- 172.21.15.132:0/2886471985 >> v2:172.21.15.187:3300/0 conn(0x7f354806a170 0x7f354806c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.656+0000 7f354d948640 1 -- 172.21.15.132:0/2886471985 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f354806e160 con 0x7f354806cd30 2023-12-20T04:47:00.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.656+0000 7f354d948640 1 --2- 172.21.15.132:0/2886471985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f354806cd30 0x7f35480b4bb0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f354806be10 tx=0x7f354002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a66bcf85466367a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:00.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.657+0000 7f3547fff640 1 -- 172.21.15.132:0/2886471985 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540031870 con 0x7f354806cd30 2023-12-20T04:47:00.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.657+0000 7f3547fff640 1 -- 172.21.15.132:0/2886471985 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f35400319d0 con 0x7f354806cd30 2023-12-20T04:47:00.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.657+0000 7f3547fff640 1 -- 172.21.15.132:0/2886471985 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3540031d60 con 0x7f354806cd30 2023-12-20T04:47:00.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.657+0000 7f354f3ab640 1 -- 172.21.15.132:0/2886471985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f354806cd30 msgr2=0x7f35480b4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.657+0000 7f354f3ab640 1 --2- 172.21.15.132:0/2886471985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f354806cd30 0x7f35480b4bb0 secure :-1 s=READY pgs=959 cs=0 l=1 rev1=1 crypto rx=0x7f354806be10 tx=0x7f354002b910 comp rx=0 tx=0).stop 2023-12-20T04:47:00.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.657+0000 7f354f3ab640 1 -- 172.21.15.132:0/2886471985 shutdown_connections 2023-12-20T04:47:00.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.657+0000 7f354f3ab640 1 --2- 172.21.15.132:0/2886471985 >> v2:172.21.15.187:3300/0 conn(0x7f354806a170 0x7f354806c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.657+0000 7f354f3ab640 1 --2- 172.21.15.132:0/2886471985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f354806cd30 0x7f35480b4bb0 unknown :-1 s=CLOSED pgs=959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.657+0000 7f354f3ab640 1 --2- 172.21.15.132:0/2886471985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f35481588e0 0x7f3548069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.657+0000 7f354f3ab640 1 -- 172.21.15.132:0/2886471985 >> 172.21.15.132:0/2886471985 conn(0x7f35480cfca0 msgr2=0x7f35480d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:00.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.657+0000 7f354f3ab640 1 -- 172.21.15.132:0/2886471985 shutdown_connections 2023-12-20T04:47:00.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.657+0000 7f354f3ab640 1 -- 172.21.15.132:0/2886471985 wait complete. 2023-12-20T04:47:00.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.658+0000 7f354f3ab640 1 Processor -- start 2023-12-20T04:47:00.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.658+0000 7f354f3ab640 1 -- start start 2023-12-20T04:47:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.659+0000 7f354f3ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f354806a170 0x7f35480cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.659+0000 7f354f3ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f354806cd30 0x7f35481f1fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.659+0000 7f354f3ab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35481588e0 0x7f3548156a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.659+0000 7f354f3ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35480cea40 con 0x7f354806a170 2023-12-20T04:47:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.659+0000 7f354f3ab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35480ce1a0 con 0x7f35481588e0 2023-12-20T04:47:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.659+0000 7f354f3ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f35480ce480 con 0x7f354806cd30 2023-12-20T04:47:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.659+0000 7f354d147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f354806a170 0x7f35480cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.659+0000 7f354d147640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f354806a170 0x7f35480cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57594/0 (socket says 172.21.15.132:57594) 2023-12-20T04:47:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.659+0000 7f354d147640 1 -- 172.21.15.132:0/1202617664 learned_addr learned my addr 172.21.15.132:0/1202617664 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.659+0000 7f354c946640 1 --2- 172.21.15.132:0/1202617664 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f354806cd30 0x7f35481f1fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.659+0000 7f354d948640 1 --2- 172.21.15.132:0/1202617664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35481588e0 0x7f3548156a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.660+0000 7f354d147640 1 -- 172.21.15.132:0/1202617664 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f354806cd30 msgr2=0x7f35481f1fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.660+0000 7f354d147640 1 --2- 172.21.15.132:0/1202617664 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f354806cd30 0x7f35481f1fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.660+0000 7f354d147640 1 -- 172.21.15.132:0/1202617664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35481588e0 msgr2=0x7f3548156a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.660+0000 7f354d147640 1 --2- 172.21.15.132:0/1202617664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35481588e0 0x7f3548156a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.660+0000 7f354d147640 1 -- 172.21.15.132:0/1202617664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f35400094d0 con 0x7f354806a170 2023-12-20T04:47:00.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.660+0000 7f354d147640 1 --2- 172.21.15.132:0/1202617664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f354806a170 0x7f35480cd870 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f3538007ef0 tx=0x7f353800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:00.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.660+0000 7f3545ffb640 1 -- 172.21.15.132:0/1202617664 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538014620 con 0x7f354806a170 2023-12-20T04:47:00.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.660+0000 7f3545ffb640 1 -- 172.21.15.132:0/1202617664 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3538014780 con 0x7f354806a170 2023-12-20T04:47:00.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.660+0000 7f354f3ab640 1 -- 172.21.15.132:0/1202617664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35480ce760 con 0x7f354806a170 2023-12-20T04:47:00.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.660+0000 7f3545ffb640 1 -- 172.21.15.132:0/1202617664 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3538014b30 con 0x7f354806a170 2023-12-20T04:47:00.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.660+0000 7f354f3ab640 1 -- 172.21.15.132:0/1202617664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f35480cddb0 con 0x7f354806a170 2023-12-20T04:47:00.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.661+0000 7f354f3ab640 1 -- 172.21.15.132:0/1202617664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f35480ac8e0 con 0x7f354806a170 2023-12-20T04:47:00.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.661+0000 7f3545ffb640 1 -- 172.21.15.132:0/1202617664 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3538014c90 con 0x7f354806a170 2023-12-20T04:47:00.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.662+0000 7f3545ffb640 1 --2- 172.21.15.132:0/1202617664 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f353406a430 0x7f353406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.662+0000 7f3545ffb640 1 -- 172.21.15.132:0/1202617664 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(87..87 src has 1..87) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3538089150 con 0x7f354806a170 2023-12-20T04:47:00.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.662+0000 7f354c946640 1 --2- 172.21.15.132:0/1202617664 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f353406a430 0x7f353406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.662+0000 7f3545ffb640 1 -- 172.21.15.132:0/1202617664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=88}) v3 -- 0x7f3534072020 con 0x7f354806a170 2023-12-20T04:47:00.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.662+0000 7f354c946640 1 --2- 172.21.15.132:0/1202617664 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f353406a430 0x7f353406c8f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f35480ca000 tx=0x7f353c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:00.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.666+0000 7f3545ffb640 1 -- 172.21.15.132:0/1202617664 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f35480ac8e0 con 0x7f354806a170 2023-12-20T04:47:00.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.833+0000 7f354f3ab640 1 -- 172.21.15.132:0/1202617664 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f35480ac8e0 con 0x7f354806a170 2023-12-20T04:47:00.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.834+0000 7f3545ffb640 1 -- 172.21.15.132:0/1202617664 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v87) v1 ==== 74+0+16281 (secure 0 0 0) 0x7f35480ac8e0 con 0x7f354806a170 2023-12-20T04:47:00.836 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:00.836 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":87,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:46:59.908158+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:46:20.852337+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-20T04:46:21.431144+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","full","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:47:00.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.836+0000 7f354f3ab640 1 -- 172.21.15.132:0/1202617664 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f353406a430 msgr2=0x7f353406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.836+0000 7f354f3ab640 1 --2- 172.21.15.132:0/1202617664 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f353406a430 0x7f353406c8f0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f35480ca000 tx=0x7f353c008040 comp rx=0 tx=0).stop 2023-12-20T04:47:00.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.836+0000 7f354f3ab640 1 -- 172.21.15.132:0/1202617664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f354806a170 msgr2=0x7f35480cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.836+0000 7f354f3ab640 1 --2- 172.21.15.132:0/1202617664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f354806a170 0x7f35480cd870 secure :-1 s=READY pgs=960 cs=0 l=1 rev1=1 crypto rx=0x7f3538007ef0 tx=0x7f353800e4b0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.836+0000 7f354f3ab640 1 -- 172.21.15.132:0/1202617664 shutdown_connections 2023-12-20T04:47:00.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.836+0000 7f354f3ab640 1 --2- 172.21.15.132:0/1202617664 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f353406a430 0x7f353406c8f0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.836+0000 7f354f3ab640 1 --2- 172.21.15.132:0/1202617664 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f35481588e0 0x7f3548156a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.836+0000 7f354f3ab640 1 --2- 172.21.15.132:0/1202617664 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f354806cd30 0x7f35481f1fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.836+0000 7f354f3ab640 1 --2- 172.21.15.132:0/1202617664 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f354806a170 0x7f35480cd870 unknown :-1 s=CLOSED pgs=960 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.836+0000 7f354f3ab640 1 -- 172.21.15.132:0/1202617664 >> 172.21.15.132:0/1202617664 conn(0x7f35480cfca0 msgr2=0x7f3548158160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:00.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.836+0000 7f354f3ab640 1 -- 172.21.15.132:0/1202617664 shutdown_connections 2023-12-20T04:47:00.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.836+0000 7f354f3ab640 1 -- 172.21.15.132:0/1202617664 wait complete. 2023-12-20T04:47:00.850 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-20T04:47:00.850 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:47:00.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.951+0000 7f392dba7640 1 Processor -- start 2023-12-20T04:47:00.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.951+0000 7f392dba7640 1 -- start start 2023-12-20T04:47:00.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.952+0000 7f392dba7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f39280b4980 0x7f39280b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.952+0000 7f392dba7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39280b5320 con 0x7f3928160450 2023-12-20T04:47:00.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.952+0000 7f392dba7640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f39280b5ec0 con 0x7f39280d1aa0 2023-12-20T04:47:00.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.952+0000 7f392dba7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f39281617e0 con 0x7f39280b4980 2023-12-20T04:47:00.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.952+0000 7f3926ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f39280b4980 0x7f39280b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.952+0000 7f39277fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3928160450 0x7f3928160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45482/0 (socket says 172.21.15.132:45482) 2023-12-20T04:47:00.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.952+0000 7f39277fe640 1 -- 172.21.15.132:0/1698751495 learned_addr learned my addr 172.21.15.132:0/1698751495 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:00.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.953+0000 7f3926ffd640 1 -- 172.21.15.132:0/1698751495 >> v1:172.21.15.187:6789/0 conn(0x7f39280d1aa0 legacy=0x7f39280d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:00.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.953+0000 7f3926ffd640 1 -- 172.21.15.132:0/1698751495 >> v1:172.21.15.132:6789/0 conn(0x7f3928160450 legacy=0x7f3928160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.953+0000 7f3926ffd640 1 -- 172.21.15.132:0/1698751495 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f39280d0fc0 con 0x7f39280b4980 2023-12-20T04:47:00.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.953+0000 7f39267fc640 1 -- 172.21.15.132:0/1698751495 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1396420439 0 0) 0x7f39280b5320 con 0x7f3928160450 2023-12-20T04:47:00.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.953+0000 7f3926ffd640 1 --2- 172.21.15.132:0/1698751495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39280b4980 0x7f39280b4de0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f391c0097a0 tx=0x7f391c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb6dea91ccd2062f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:00.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.953+0000 7f39267fc640 1 -- 172.21.15.132:0/1698751495 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c030610 con 0x7f39280b4980 2023-12-20T04:47:00.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.953+0000 7f39267fc640 1 -- 172.21.15.132:0/1698751495 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c030770 con 0x7f39280b4980 2023-12-20T04:47:00.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.953+0000 7f39267fc640 1 -- 172.21.15.132:0/1698751495 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c030b00 con 0x7f39280b4980 2023-12-20T04:47:00.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.954+0000 7f392dba7640 1 -- 172.21.15.132:0/1698751495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39280b4980 msgr2=0x7f39280b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.954+0000 7f392dba7640 1 --2- 172.21.15.132:0/1698751495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39280b4980 0x7f39280b4de0 secure :-1 s=READY pgs=962 cs=0 l=1 rev1=1 crypto rx=0x7f391c0097a0 tx=0x7f391c02b960 comp rx=0 tx=0).stop 2023-12-20T04:47:00.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.954+0000 7f392dba7640 1 -- 172.21.15.132:0/1698751495 shutdown_connections 2023-12-20T04:47:00.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.954+0000 7f392dba7640 1 --2- 172.21.15.132:0/1698751495 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39280b4980 0x7f39280b4de0 unknown :-1 s=CLOSED pgs=962 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.954+0000 7f392dba7640 1 -- 172.21.15.132:0/1698751495 >> 172.21.15.132:0/1698751495 conn(0x7f39280cf980 msgr2=0x7f39280cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:00.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.954+0000 7f392dba7640 1 -- 172.21.15.132:0/1698751495 shutdown_connections 2023-12-20T04:47:00.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.954+0000 7f392dba7640 1 -- 172.21.15.132:0/1698751495 wait complete. 2023-12-20T04:47:00.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.955+0000 7f392dba7640 1 Processor -- start 2023-12-20T04:47:00.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.955+0000 7f392dba7640 1 -- start start 2023-12-20T04:47:00.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.956+0000 7f392dba7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39280b4980 0x7f39280b3f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.956+0000 7f392dba7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39280d1aa0 0x7f392815e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.956+0000 7f392dba7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3928160450 0x7f392815e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.956+0000 7f392dba7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39280cbc90 con 0x7f39280d1aa0 2023-12-20T04:47:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.956+0000 7f392dba7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f39280cbf30 con 0x7f3928160450 2023-12-20T04:47:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.956+0000 7f392dba7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f39280cc210 con 0x7f39280b4980 2023-12-20T04:47:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.956+0000 7f3926ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39280d1aa0 0x7f392815e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.956+0000 7f3926ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39280d1aa0 0x7f392815e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57602/0 (socket says 172.21.15.132:57602) 2023-12-20T04:47:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.956+0000 7f3926ffd640 1 -- 172.21.15.132:0/3238781501 learned_addr learned my addr 172.21.15.132:0/3238781501 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.956+0000 7f39277fe640 1 --2- 172.21.15.132:0/3238781501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39280b4980 0x7f39280b3f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.956+0000 7f3926ffd640 1 -- 172.21.15.132:0/3238781501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39280b4980 msgr2=0x7f39280b3f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.956+0000 7f3926ffd640 1 --2- 172.21.15.132:0/3238781501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39280b4980 0x7f39280b3f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.956+0000 7f3926ffd640 1 -- 172.21.15.132:0/3238781501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3928160450 msgr2=0x7f392815e650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.956+0000 7f3926ffd640 1 --2- 172.21.15.132:0/3238781501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3928160450 0x7f392815e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.956+0000 7f3926ffd640 1 -- 172.21.15.132:0/3238781501 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f391c009400 con 0x7f39280d1aa0 2023-12-20T04:47:00.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.957+0000 7f3926ffd640 1 --2- 172.21.15.132:0/3238781501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39280d1aa0 0x7f392815e110 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f391c0098c0 tx=0x7f391c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:00.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.957+0000 7f390ffff640 1 -- 172.21.15.132:0/3238781501 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c03e040 con 0x7f39280d1aa0 2023-12-20T04:47:00.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.957+0000 7f390ffff640 1 -- 172.21.15.132:0/3238781501 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f391c039c90 con 0x7f39280d1aa0 2023-12-20T04:47:00.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.957+0000 7f390ffff640 1 -- 172.21.15.132:0/3238781501 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f391c0443f0 con 0x7f39280d1aa0 2023-12-20T04:47:00.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.957+0000 7f392dba7640 1 -- 172.21.15.132:0/3238781501 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f39280cc4f0 con 0x7f39280d1aa0 2023-12-20T04:47:00.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.957+0000 7f392dba7640 1 -- 172.21.15.132:0/3238781501 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f39280b2e10 con 0x7f39280d1aa0 2023-12-20T04:47:00.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.958+0000 7f392dba7640 1 -- 172.21.15.132:0/3238781501 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f39280b6c40 con 0x7f39280d1aa0 2023-12-20T04:47:00.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.958+0000 7f390ffff640 1 -- 172.21.15.132:0/3238781501 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f391c043390 con 0x7f39280d1aa0 2023-12-20T04:47:00.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.959+0000 7f390ffff640 1 --2- 172.21.15.132:0/3238781501 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f391406a430 0x7f391406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:00.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.959+0000 7f390ffff640 1 -- 172.21.15.132:0/3238781501 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f391c0aac70 con 0x7f39280d1aa0 2023-12-20T04:47:00.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.959+0000 7f39277fe640 1 --2- 172.21.15.132:0/3238781501 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f391406a430 0x7f391406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:00.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.959+0000 7f390ffff640 1 -- 172.21.15.132:0/3238781501 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f3914072020 con 0x7f39280d1aa0 2023-12-20T04:47:00.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.959+0000 7f39277fe640 1 --2- 172.21.15.132:0/3238781501 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f391406a430 0x7f391406c8f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3918000f60 tx=0x7f3918009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:00.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:00.963+0000 7f390ffff640 1 -- 172.21.15.132:0/3238781501 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f391c034060 con 0x7f39280d1aa0 2023-12-20T04:47:01.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.167+0000 7f392dba7640 1 -- 172.21.15.132:0/3238781501 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f392804e840 con 0x7f39280d1aa0 2023-12-20T04:47:01.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.168+0000 7f390ffff640 1 -- 172.21.15.132:0/3238781501 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f391c049070 con 0x7f39280d1aa0 2023-12-20T04:47:01.170 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:01.170 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":32,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2337953767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2337953767},{"type":"v1","addr":"172.21.15.187:6835","nonce":2337953767}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6540,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/41640576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":41640576},{"type":"v1","addr":"172.21.15.132:6836","nonce":41640576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6543,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2936157584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2936157584},{"type":"v1","addr":"172.21.15.132:6837","nonce":2936157584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:46:22.459815+0000","modified":"2023-12-20T04:46:24.470923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6552":{"gid":6552,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6833/3732620607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3732620607},{"type":"v1","addr":"172.21.15.187:6833","nonce":3732620607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-20T04:47:01.170 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 32 2023-12-20T04:47:01.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.170+0000 7f392dba7640 1 -- 172.21.15.132:0/3238781501 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f391406a430 msgr2=0x7f391406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:01.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.170+0000 7f392dba7640 1 --2- 172.21.15.132:0/3238781501 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f391406a430 0x7f391406c8f0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3918000f60 tx=0x7f3918009040 comp rx=0 tx=0).stop 2023-12-20T04:47:01.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.170+0000 7f392dba7640 1 -- 172.21.15.132:0/3238781501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39280d1aa0 msgr2=0x7f392815e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:01.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.170+0000 7f392dba7640 1 --2- 172.21.15.132:0/3238781501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39280d1aa0 0x7f392815e110 secure :-1 s=READY pgs=963 cs=0 l=1 rev1=1 crypto rx=0x7f391c0098c0 tx=0x7f391c004730 comp rx=0 tx=0).stop 2023-12-20T04:47:01.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.170+0000 7f392dba7640 1 -- 172.21.15.132:0/3238781501 shutdown_connections 2023-12-20T04:47:01.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.170+0000 7f392dba7640 1 --2- 172.21.15.132:0/3238781501 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f391406a430 0x7f391406c8f0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.170+0000 7f392dba7640 1 --2- 172.21.15.132:0/3238781501 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3928160450 0x7f392815e650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.170+0000 7f392dba7640 1 --2- 172.21.15.132:0/3238781501 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f39280d1aa0 0x7f392815e110 unknown :-1 s=CLOSED pgs=963 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.170+0000 7f392dba7640 1 --2- 172.21.15.132:0/3238781501 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f39280b4980 0x7f39280b3f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.170+0000 7f392dba7640 1 -- 172.21.15.132:0/3238781501 >> 172.21.15.132:0/3238781501 conn(0x7f39280cf980 msgr2=0x7f3928155900 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:01.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.170+0000 7f392dba7640 1 -- 172.21.15.132:0/3238781501 shutdown_connections 2023-12-20T04:47:01.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.170+0000 7f392dba7640 1 -- 172.21.15.132:0/3238781501 wait complete. 2023-12-20T04:47:01.183 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:47:01.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.280+0000 7f7ac3947640 1 Processor -- start 2023-12-20T04:47:01.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.281+0000 7f7ac3947640 1 -- start start 2023-12-20T04:47:01.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.281+0000 7f7ac3947640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7abc15d110 0x7f7abc069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.281+0000 7f7ac3947640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7abc15d4f0 0x7f7abc06a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.281+0000 7f7ac3947640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7abc161ce0 con 0x7f7abc0aeb00 2023-12-20T04:47:01.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.281+0000 7f7ac3947640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc0aca50 con 0x7f7abc15d110 2023-12-20T04:47:01.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.281+0000 7f7ac3947640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7abc160df0 con 0x7f7abc15d4f0 2023-12-20T04:47:01.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.281+0000 7f7ac16e3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7abc15d110 0x7f7abc069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.281+0000 7f7ac1ee4640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7abc0aeb00 0x7f7abc070560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45488/0 (socket says 172.21.15.132:45488) 2023-12-20T04:47:01.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.282+0000 7f7ac1ee4640 1 -- 172.21.15.132:0/1470338349 learned_addr learned my addr 172.21.15.132:0/1470338349 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:01.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.282+0000 7f7ac0ee2640 1 --2- 172.21.15.132:0/1470338349 >> v2:172.21.15.187:3300/0 conn(0x7f7abc15d4f0 0x7f7abc06a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.282+0000 7f7ac16e3640 1 -- 172.21.15.132:0/1470338349 >> v2:172.21.15.187:3300/0 conn(0x7f7abc15d4f0 msgr2=0x7f7abc06a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:01.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.282+0000 7f7ac16e3640 1 --2- 172.21.15.132:0/1470338349 >> v2:172.21.15.187:3300/0 conn(0x7f7abc15d4f0 0x7f7abc06a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.282+0000 7f7ac16e3640 1 -- 172.21.15.132:0/1470338349 >> v1:172.21.15.132:6789/0 conn(0x7f7abc0aeb00 legacy=0x7f7abc070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:01.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.282+0000 7f7ac16e3640 1 -- 172.21.15.132:0/1470338349 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7abc1610d0 con 0x7f7abc15d110 2023-12-20T04:47:01.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.282+0000 7f7ab3fff640 1 -- 172.21.15.132:0/1470338349 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2521199859 0 0) 0x7f7abc161ce0 con 0x7f7abc0aeb00 2023-12-20T04:47:01.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.283+0000 7f7ac16e3640 1 --2- 172.21.15.132:0/1470338349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7abc15d110 0x7f7abc069de0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0740f0 tx=0x7f7ab402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3acabe423df7c654 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:01.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.283+0000 7f7ab3fff640 1 -- 172.21.15.132:0/1470338349 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4031830 con 0x7f7abc15d110 2023-12-20T04:47:01.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.283+0000 7f7ab3fff640 1 -- 172.21.15.132:0/1470338349 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ab4031990 con 0x7f7abc15d110 2023-12-20T04:47:01.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.283+0000 7f7ab3fff640 1 -- 172.21.15.132:0/1470338349 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ab4031d20 con 0x7f7abc15d110 2023-12-20T04:47:01.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.283+0000 7f7ac3947640 1 -- 172.21.15.132:0/1470338349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7abc15d110 msgr2=0x7f7abc069de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:01.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.283+0000 7f7ac3947640 1 --2- 172.21.15.132:0/1470338349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7abc15d110 0x7f7abc069de0 secure :-1 s=READY pgs=965 cs=0 l=1 rev1=1 crypto rx=0x7f7abc0740f0 tx=0x7f7ab402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.283+0000 7f7ac3947640 1 -- 172.21.15.132:0/1470338349 shutdown_connections 2023-12-20T04:47:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.283+0000 7f7ac3947640 1 --2- 172.21.15.132:0/1470338349 >> v2:172.21.15.187:3300/0 conn(0x7f7abc15d4f0 0x7f7abc06a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.283+0000 7f7ac3947640 1 --2- 172.21.15.132:0/1470338349 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7abc15d110 0x7f7abc069de0 unknown :-1 s=CLOSED pgs=965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.283+0000 7f7ac3947640 1 -- 172.21.15.132:0/1470338349 >> 172.21.15.132:0/1470338349 conn(0x7f7abc0cfbd0 msgr2=0x7f7abc0cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.283+0000 7f7ac3947640 1 -- 172.21.15.132:0/1470338349 shutdown_connections 2023-12-20T04:47:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.283+0000 7f7ac3947640 1 -- 172.21.15.132:0/1470338349 wait complete. 2023-12-20T04:47:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.284+0000 7f7ac3947640 1 Processor -- start 2023-12-20T04:47:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.285+0000 7f7ac3947640 1 -- start start 2023-12-20T04:47:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.285+0000 7f7ac3947640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7abc0aeb00 0x7f7abc0c7680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.285+0000 7f7ac3947640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7abc15d110 0x7f7abc1f2a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.285+0000 7f7ac3947640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7abc15d4f0 0x7f7abc0c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.285+0000 7f7ac3947640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc1f63d0 con 0x7f7abc15d110 2023-12-20T04:47:01.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.285+0000 7f7ac3947640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc1f6010 con 0x7f7abc0aeb00 2023-12-20T04:47:01.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.285+0000 7f7ac3947640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc1f3270 con 0x7f7abc15d4f0 2023-12-20T04:47:01.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.285+0000 7f7ac0ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7abc15d110 0x7f7abc1f2a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.285+0000 7f7ac0ee2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7abc15d110 0x7f7abc1f2a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57632/0 (socket says 172.21.15.132:57632) 2023-12-20T04:47:01.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.285+0000 7f7ac0ee2640 1 -- 172.21.15.132:0/1331868654 learned_addr learned my addr 172.21.15.132:0/1331868654 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:01.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.286+0000 7f7ac16e3640 1 --2- 172.21.15.132:0/1331868654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7abc0aeb00 0x7f7abc0c7680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.286+0000 7f7ac1ee4640 1 --2- 172.21.15.132:0/1331868654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7abc15d4f0 0x7f7abc0c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.286+0000 7f7ac0ee2640 1 -- 172.21.15.132:0/1331868654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7abc15d4f0 msgr2=0x7f7abc0c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:01.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.286+0000 7f7ac0ee2640 1 --2- 172.21.15.132:0/1331868654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7abc15d4f0 0x7f7abc0c9450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.286+0000 7f7ac0ee2640 1 -- 172.21.15.132:0/1331868654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7abc0aeb00 msgr2=0x7f7abc0c7680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:01.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.286+0000 7f7ac0ee2640 1 --2- 172.21.15.132:0/1331868654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7abc0aeb00 0x7f7abc0c7680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.286+0000 7f7ac0ee2640 1 -- 172.21.15.132:0/1331868654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ab40093a0 con 0x7f7abc15d110 2023-12-20T04:47:01.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.286+0000 7f7ac0ee2640 1 --2- 172.21.15.132:0/1331868654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7abc15d110 0x7f7abc1f2a20 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00d800 tx=0x7f7aac00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:01.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.286+0000 7f7ab1ffb640 1 -- 172.21.15.132:0/1331868654 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac00b6c0 con 0x7f7abc15d110 2023-12-20T04:47:01.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.286+0000 7f7ab1ffb640 1 -- 172.21.15.132:0/1331868654 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aac00b820 con 0x7f7abc15d110 2023-12-20T04:47:01.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.286+0000 7f7ac3947640 1 -- 172.21.15.132:0/1331868654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc1f3550 con 0x7f7abc15d110 2023-12-20T04:47:01.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.286+0000 7f7ab1ffb640 1 -- 172.21.15.132:0/1331868654 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aac00bbb0 con 0x7f7abc15d110 2023-12-20T04:47:01.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.286+0000 7f7ac3947640 1 -- 172.21.15.132:0/1331868654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc1f2f60 con 0x7f7abc15d110 2023-12-20T04:47:01.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.287+0000 7f7ac3947640 1 -- 172.21.15.132:0/1331868654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7abc1f6640 con 0x7f7abc15d110 2023-12-20T04:47:01.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.287+0000 7f7ab1ffb640 1 -- 172.21.15.132:0/1331868654 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7aac00bd10 con 0x7f7abc15d110 2023-12-20T04:47:01.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.288+0000 7f7ab1ffb640 1 --2- 172.21.15.132:0/1331868654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7aa006a430 0x7f7aa006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.288+0000 7f7ab1ffb640 1 -- 172.21.15.132:0/1331868654 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f7aac088dd0 con 0x7f7abc15d110 2023-12-20T04:47:01.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.288+0000 7f7ac16e3640 1 --2- 172.21.15.132:0/1331868654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7aa006a430 0x7f7aa006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.288+0000 7f7ab1ffb640 1 -- 172.21.15.132:0/1331868654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f7aa0072020 con 0x7f7abc15d110 2023-12-20T04:47:01.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.288+0000 7f7ac16e3640 1 --2- 172.21.15.132:0/1331868654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7aa006a430 0x7f7aa006c8f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4036000 tx=0x7f7ab403c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:01.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.292+0000 7f7ab1ffb640 1 -- 172.21.15.132:0/1331868654 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7aac054410 con 0x7f7abc15d110 2023-12-20T04:47:01.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.490+0000 7f7ac3947640 1 -- 172.21.15.132:0/1331868654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f7abc04e840 con 0x7f7abc15d110 2023-12-20T04:47:01.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.490+0000 7f7ab1ffb640 1 -- 172.21.15.132:0/1331868654 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 32 v32) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f7aac08a030 con 0x7f7abc15d110 2023-12-20T04:47:01.493 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:01.493 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":32,"default_fscid":5,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2337953767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2337953767},{"type":"v1","addr":"172.21.15.187:6835","nonce":2337953767}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6540,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/41640576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":41640576},{"type":"v1","addr":"172.21.15.132:6836","nonce":41640576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6543,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2936157584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2936157584},{"type":"v1","addr":"172.21.15.132:6837","nonce":2936157584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:46:22.459815+0000","modified":"2023-12-20T04:46:24.470923+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6552},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6552":{"gid":6552,"name":"d","rank":0,"incarnation":30,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6833/3732620607","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3732620607},{"type":"v1","addr":"172.21.15.187:6833","nonce":3732620607}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[11],"metadata_pool":10,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":5}]} 2023-12-20T04:47:01.493 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 32 2023-12-20T04:47:01.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.492+0000 7f7ac3947640 1 -- 172.21.15.132:0/1331868654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7aa006a430 msgr2=0x7f7aa006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:01.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.492+0000 7f7ac3947640 1 --2- 172.21.15.132:0/1331868654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7aa006a430 0x7f7aa006c8f0 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f7ab4036000 tx=0x7f7ab403c040 comp rx=0 tx=0).stop 2023-12-20T04:47:01.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.492+0000 7f7ac3947640 1 -- 172.21.15.132:0/1331868654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7abc15d110 msgr2=0x7f7abc1f2a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:01.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.492+0000 7f7ac3947640 1 --2- 172.21.15.132:0/1331868654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7abc15d110 0x7f7abc1f2a20 secure :-1 s=READY pgs=966 cs=0 l=1 rev1=1 crypto rx=0x7f7aac00d800 tx=0x7f7aac00dcc0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.492+0000 7f7ac3947640 1 -- 172.21.15.132:0/1331868654 shutdown_connections 2023-12-20T04:47:01.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.492+0000 7f7ac3947640 1 --2- 172.21.15.132:0/1331868654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7aa006a430 0x7f7aa006c8f0 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.492+0000 7f7ac3947640 1 --2- 172.21.15.132:0/1331868654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7abc15d4f0 0x7f7abc0c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.492+0000 7f7ac3947640 1 --2- 172.21.15.132:0/1331868654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7abc15d110 0x7f7abc1f2a20 unknown :-1 s=CLOSED pgs=966 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.492+0000 7f7ac3947640 1 --2- 172.21.15.132:0/1331868654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7abc0aeb00 0x7f7abc0c7680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.492+0000 7f7ac3947640 1 -- 172.21.15.132:0/1331868654 >> 172.21.15.132:0/1331868654 conn(0x7f7abc0cfbd0 msgr2=0x7f7abc15c8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:01.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.492+0000 7f7ac3947640 1 -- 172.21.15.132:0/1331868654 shutdown_connections 2023-12-20T04:47:01.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.492+0000 7f7ac3947640 1 -- 172.21.15.132:0/1331868654 wait complete. 2023-12-20T04:47:01.505 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:47:01.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.603+0000 7f9cda3d2640 1 Processor -- start 2023-12-20T04:47:01.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.603+0000 7f9cda3d2640 1 -- start start 2023-12-20T04:47:01.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.604+0000 7f9cda3d2640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9cd4160450 0x7f9cd4160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.604+0000 7f9cda3d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cd40b5090 0x7f9cd40d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.604+0000 7f9cda3d2640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cd40b5ec0 con 0x7f9cd41611b0 2023-12-20T04:47:01.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.604+0000 7f9cda3d2640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cd41617e0 con 0x7f9cd4160450 2023-12-20T04:47:01.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.604+0000 7f9cda3d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd40d0fc0 con 0x7f9cd40b5090 2023-12-20T04:47:01.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.604+0000 7f9cd896f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cd40b5090 0x7f9cd40d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.604+0000 7f9cd3fff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9cd4160450 0x7f9cd4160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.604+0000 7f9cd37fe640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f9cd41611b0 0x7f9cd40b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:39230/0 (socket says 172.21.15.132:39230) 2023-12-20T04:47:01.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.604+0000 7f9cd896f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cd40b5090 0x7f9cd40d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:40526/0 (socket says 172.21.15.132:40526) 2023-12-20T04:47:01.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.604+0000 7f9cd3fff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9cd4160450 0x7f9cd4160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:45752/0 (socket says 172.21.15.132:45752) 2023-12-20T04:47:01.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.604+0000 7f9cd896f640 1 -- 172.21.15.132:0/468586452 learned_addr learned my addr 172.21.15.132:0/468586452 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:01.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.604+0000 7f9cd3fff640 1 -- 172.21.15.132:0/468586452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cd40b5090 msgr2=0x7f9cd40d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:01.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.604+0000 7f9cd3fff640 1 --2- 172.21.15.132:0/468586452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cd40b5090 0x7f9cd40d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.604+0000 7f9cd3fff640 1 -- 172.21.15.132:0/468586452 >> v1:172.21.15.187:6789/0 conn(0x7f9cd41611b0 legacy=0x7f9cd40b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:01.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.605+0000 7f9cd3fff640 1 -- 172.21.15.132:0/468586452 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd40d12a0 con 0x7f9cd4160450 2023-12-20T04:47:01.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.605+0000 7f9cd896f640 1 --2- 172.21.15.132:0/468586452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cd40b5090 0x7f9cd40d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:47:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.605+0000 7f9cd3fff640 1 --2- 172.21.15.132:0/468586452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cd4160450 0x7f9cd4160c70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40097a0 tx=0x7f9cc402b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc9ba3c7e9d02297 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.605+0000 7f9cd2ffd640 1 -- 172.21.15.132:0/468586452 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4030610 con 0x7f9cd4160450 2023-12-20T04:47:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.605+0000 7f9cd2ffd640 1 -- 172.21.15.132:0/468586452 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cc4030770 con 0x7f9cd4160450 2023-12-20T04:47:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.605+0000 7f9cd2ffd640 1 -- 172.21.15.132:0/468586452 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cc4030b00 con 0x7f9cd4160450 2023-12-20T04:47:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.606+0000 7f9cda3d2640 1 -- 172.21.15.132:0/468586452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cd4160450 msgr2=0x7f9cd4160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.606+0000 7f9cda3d2640 1 --2- 172.21.15.132:0/468586452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cd4160450 0x7f9cd4160c70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f9cc40097a0 tx=0x7f9cc402b960 comp rx=0 tx=0).stop 2023-12-20T04:47:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.606+0000 7f9cda3d2640 1 -- 172.21.15.132:0/468586452 shutdown_connections 2023-12-20T04:47:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.606+0000 7f9cda3d2640 1 --2- 172.21.15.132:0/468586452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cd40b5090 0x7f9cd40d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.606+0000 7f9cda3d2640 1 --2- 172.21.15.132:0/468586452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cd4160450 0x7f9cd4160c70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.606+0000 7f9cda3d2640 1 -- 172.21.15.132:0/468586452 >> 172.21.15.132:0/468586452 conn(0x7f9cd40cf980 msgr2=0x7f9cd40cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.606+0000 7f9cda3d2640 1 -- 172.21.15.132:0/468586452 shutdown_connections 2023-12-20T04:47:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.606+0000 7f9cda3d2640 1 -- 172.21.15.132:0/468586452 wait complete. 2023-12-20T04:47:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.607+0000 7f9cda3d2640 1 Processor -- start 2023-12-20T04:47:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.607+0000 7f9cda3d2640 1 -- start start 2023-12-20T04:47:01.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.608+0000 7f9cda3d2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cd40b5090 0x7f9cd41f3210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.608+0000 7f9cda3d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cd4160450 0x7f9cd4159ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.608+0000 7f9cda3d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cd41611b0 0x7f9cd415a800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.608+0000 7f9cda3d2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd4159780 con 0x7f9cd41611b0 2023-12-20T04:47:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.608+0000 7f9cda3d2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd4158de0 con 0x7f9cd40b5090 2023-12-20T04:47:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.608+0000 7f9cda3d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cd41590c0 con 0x7f9cd4160450 2023-12-20T04:47:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.608+0000 7f9cd896f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cd41611b0 0x7f9cd415a800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.608+0000 7f9cd896f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cd41611b0 0x7f9cd415a800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57642/0 (socket says 172.21.15.132:57642) 2023-12-20T04:47:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.608+0000 7f9cd896f640 1 -- 172.21.15.132:0/3125180481 learned_addr learned my addr 172.21.15.132:0/3125180481 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.608+0000 7f9cd3fff640 1 --2- 172.21.15.132:0/3125180481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cd40b5090 0x7f9cd41f3210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.608+0000 7f9cd37fe640 1 --2- 172.21.15.132:0/3125180481 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cd4160450 0x7f9cd4159ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.608+0000 7f9cd896f640 1 -- 172.21.15.132:0/3125180481 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cd4160450 msgr2=0x7f9cd4159ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.608+0000 7f9cd896f640 1 --2- 172.21.15.132:0/3125180481 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cd4160450 0x7f9cd4159ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.608+0000 7f9cd896f640 1 -- 172.21.15.132:0/3125180481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cd40b5090 msgr2=0x7f9cd41f3210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.608+0000 7f9cd896f640 1 --2- 172.21.15.132:0/3125180481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cd40b5090 0x7f9cd41f3210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.608+0000 7f9cd896f640 1 -- 172.21.15.132:0/3125180481 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ccc009b30 con 0x7f9cd41611b0 2023-12-20T04:47:01.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.609+0000 7f9cd896f640 1 --2- 172.21.15.132:0/3125180481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cd41611b0 0x7f9cd415a800 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00ef90 tx=0x7f9ccc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:01.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.609+0000 7f9cd0ff9640 1 -- 172.21.15.132:0/3125180481 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc018070 con 0x7f9cd41611b0 2023-12-20T04:47:01.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.609+0000 7f9cd0ff9640 1 -- 172.21.15.132:0/3125180481 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ccc00f040 con 0x7f9cd41611b0 2023-12-20T04:47:01.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.609+0000 7f9cda3d2640 1 -- 172.21.15.132:0/3125180481 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cc4009400 con 0x7f9cd41611b0 2023-12-20T04:47:01.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.609+0000 7f9cd0ff9640 1 -- 172.21.15.132:0/3125180481 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ccc00ce20 con 0x7f9cd41611b0 2023-12-20T04:47:01.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.609+0000 7f9cda3d2640 1 -- 172.21.15.132:0/3125180481 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cd415ad40 con 0x7f9cd41611b0 2023-12-20T04:47:01.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.610+0000 7f9cda3d2640 1 -- 172.21.15.132:0/3125180481 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cd40b89b0 con 0x7f9cd41611b0 2023-12-20T04:47:01.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.610+0000 7f9cd0ff9640 1 -- 172.21.15.132:0/3125180481 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9ccc014480 con 0x7f9cd41611b0 2023-12-20T04:47:01.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.611+0000 7f9cd0ff9640 1 --2- 172.21.15.132:0/3125180481 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc006a430 0x7f9cc006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.611+0000 7f9cd0ff9640 1 -- 172.21.15.132:0/3125180481 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9ccc088c50 con 0x7f9cd41611b0 2023-12-20T04:47:01.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.611+0000 7f9cd3fff640 1 --2- 172.21.15.132:0/3125180481 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc006a430 0x7f9cc006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.611+0000 7f9cd0ff9640 1 -- 172.21.15.132:0/3125180481 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f9cc0072020 con 0x7f9cd41611b0 2023-12-20T04:47:01.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.611+0000 7f9cd3fff640 1 --2- 172.21.15.132:0/3125180481 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc006a430 0x7f9cc006c8f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4036000 tx=0x7f9cc4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:01.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.615+0000 7f9cd0ff9640 1 -- 172.21.15.132:0/3125180481 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9cd40b89b0 con 0x7f9cd41611b0 2023-12-20T04:47:01.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.784+0000 7f9cda3d2640 1 -- 172.21.15.132:0/3125180481 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cd41598c0 con 0x7f9cd41611b0 2023-12-20T04:47:01.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.786+0000 7f9cd0ff9640 1 -- 172.21.15.132:0/3125180481 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v88) v1 ==== 74+0+16274 (secure 0 0 0) 0x7f9cd41598c0 con 0x7f9cd41611b0 2023-12-20T04:47:01.787 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:01.788 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":88,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:47:00.916810+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":10,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:46:20.852337+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":11,"pool_name":"cephfs_data","create_time":"2023-12-20T04:46:21.431144+0000","flags":3,"flags_names":"hashpspool,full","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"85","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","full","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","full","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"11.8","mappings":[{"from":6,"to":0}]},{"pgid":"11.1c","mappings":[{"from":6,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:47:01.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.788+0000 7f9cda3d2640 1 -- 172.21.15.132:0/3125180481 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc006a430 msgr2=0x7f9cc006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:01.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.788+0000 7f9cda3d2640 1 --2- 172.21.15.132:0/3125180481 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc006a430 0x7f9cc006c8f0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f9cc4036000 tx=0x7f9cc4008030 comp rx=0 tx=0).stop 2023-12-20T04:47:01.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.788+0000 7f9cda3d2640 1 -- 172.21.15.132:0/3125180481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cd41611b0 msgr2=0x7f9cd415a800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:01.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.788+0000 7f9cda3d2640 1 --2- 172.21.15.132:0/3125180481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cd41611b0 0x7f9cd415a800 secure :-1 s=READY pgs=967 cs=0 l=1 rev1=1 crypto rx=0x7f9ccc00ef90 tx=0x7f9ccc00c490 comp rx=0 tx=0).stop 2023-12-20T04:47:01.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.788+0000 7f9cda3d2640 1 -- 172.21.15.132:0/3125180481 shutdown_connections 2023-12-20T04:47:01.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.788+0000 7f9cda3d2640 1 --2- 172.21.15.132:0/3125180481 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc006a430 0x7f9cc006c8f0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.788+0000 7f9cda3d2640 1 --2- 172.21.15.132:0/3125180481 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cd41611b0 0x7f9cd415a800 unknown :-1 s=CLOSED pgs=967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.788+0000 7f9cda3d2640 1 --2- 172.21.15.132:0/3125180481 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cd4160450 0x7f9cd4159ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.788+0000 7f9cda3d2640 1 --2- 172.21.15.132:0/3125180481 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cd40b5090 0x7f9cd41f3210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.788+0000 7f9cda3d2640 1 -- 172.21.15.132:0/3125180481 >> 172.21.15.132:0/3125180481 conn(0x7f9cd40cf980 msgr2=0x7f9cd40d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:01.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.788+0000 7f9cda3d2640 1 -- 172.21.15.132:0/3125180481 shutdown_connections 2023-12-20T04:47:01.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.788+0000 7f9cda3d2640 1 -- 172.21.15.132:0/3125180481 wait complete. 2023-12-20T04:47:01.801 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-20T04:47:01.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.899+0000 7f0888cc4640 1 Processor -- start 2023-12-20T04:47:01.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.899+0000 7f0888cc4640 1 -- start start 2023-12-20T04:47:01.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.900+0000 7f0888cc4640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f088415d110 0x7f08840b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.900+0000 7f0888cc4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840b1d10 0x7f08840b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.900+0000 7f0888cc4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0884161940 0x7f08840b4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.900+0000 7f0888cc4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08840cd660 con 0x7f0884161940 2023-12-20T04:47:01.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.900+0000 7f0888cc4640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f08840cd940 con 0x7f088415d110 2023-12-20T04:47:01.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.900+0000 7f0888cc4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0884160e60 con 0x7f08840b1d10 2023-12-20T04:47:01.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.901+0000 7f0882d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0884161940 0x7f08840b4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.901+0000 7f0882d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0884161940 0x7f08840b4dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57652/0 (socket says 172.21.15.132:57652) 2023-12-20T04:47:01.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.901+0000 7f0882d9d640 1 -- 172.21.15.132:0/1981394346 learned_addr learned my addr 172.21.15.132:0/1981394346 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:01.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.901+0000 7f088259c640 1 --2- 172.21.15.132:0/1981394346 >> v2:172.21.15.187:3300/0 conn(0x7f088415d110 0x7f08840b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.901+0000 7f0882d9d640 1 -- 172.21.15.132:0/1981394346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840b1d10 msgr2=0x7f08840b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:01.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.901+0000 7f0881d9b640 1 --2- 172.21.15.132:0/1981394346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840b1d10 0x7f08840b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.901+0000 7f0882d9d640 1 --2- 172.21.15.132:0/1981394346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840b1d10 0x7f08840b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.901+0000 7f0882d9d640 1 -- 172.21.15.132:0/1981394346 >> v2:172.21.15.187:3300/0 conn(0x7f088415d110 msgr2=0x7f08840b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:01.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.901+0000 7f0882d9d640 1 --2- 172.21.15.132:0/1981394346 >> v2:172.21.15.187:3300/0 conn(0x7f088415d110 0x7f08840b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.901+0000 7f0882d9d640 1 -- 172.21.15.132:0/1981394346 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0884161140 con 0x7f0884161940 2023-12-20T04:47:01.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.901+0000 7f088259c640 1 --2- 172.21.15.132:0/1981394346 >> v2:172.21.15.187:3300/0 conn(0x7f088415d110 0x7f08840b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:01.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.901+0000 7f0881d9b640 1 --2- 172.21.15.132:0/1981394346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840b1d10 0x7f08840b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:01.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.902+0000 7f0882d9d640 1 --2- 172.21.15.132:0/1981394346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0884161940 0x7f08840b4dc0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f088406ccf0 tx=0x7f087c02b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c24bf530086fc7aa server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:01.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.902+0000 7f088159a640 1 -- 172.21.15.132:0/1981394346 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c031860 con 0x7f0884161940 2023-12-20T04:47:01.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.902+0000 7f088159a640 1 -- 172.21.15.132:0/1981394346 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087c0319c0 con 0x7f0884161940 2023-12-20T04:47:01.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.902+0000 7f088159a640 1 -- 172.21.15.132:0/1981394346 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087c031d50 con 0x7f0884161940 2023-12-20T04:47:01.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.902+0000 7f0888cc4640 1 -- 172.21.15.132:0/1981394346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0884161940 msgr2=0x7f08840b4dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:01.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.902+0000 7f0888cc4640 1 --2- 172.21.15.132:0/1981394346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0884161940 0x7f08840b4dc0 secure :-1 s=READY pgs=968 cs=0 l=1 rev1=1 crypto rx=0x7f088406ccf0 tx=0x7f087c02b900 comp rx=0 tx=0).stop 2023-12-20T04:47:01.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.902+0000 7f0888cc4640 1 -- 172.21.15.132:0/1981394346 shutdown_connections 2023-12-20T04:47:01.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.902+0000 7f0888cc4640 1 --2- 172.21.15.132:0/1981394346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0884161940 0x7f08840b4dc0 unknown :-1 s=CLOSED pgs=968 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.902+0000 7f0888cc4640 1 --2- 172.21.15.132:0/1981394346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08840b1d10 0x7f08840b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.902+0000 7f0888cc4640 1 --2- 172.21.15.132:0/1981394346 >> v2:172.21.15.187:3300/0 conn(0x7f088415d110 0x7f08840b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.902+0000 7f0888cc4640 1 -- 172.21.15.132:0/1981394346 >> 172.21.15.132:0/1981394346 conn(0x7f08840cf880 msgr2=0x7f08840cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:01.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.902+0000 7f0888cc4640 1 -- 172.21.15.132:0/1981394346 shutdown_connections 2023-12-20T04:47:01.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.902+0000 7f0888cc4640 1 -- 172.21.15.132:0/1981394346 wait complete. 2023-12-20T04:47:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.904+0000 7f0888cc4640 1 Processor -- start 2023-12-20T04:47:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.904+0000 7f0888cc4640 1 -- start start 2023-12-20T04:47:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.904+0000 7f0888cc4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08840b1d10 0x7f08840b7b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.904+0000 7f0888cc4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f088415d110 0x7f088415e6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.904+0000 7f0888cc4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0884161940 0x7f0884147a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.904+0000 7f0888cc4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088415fd90 con 0x7f08840b1d10 2023-12-20T04:47:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.904+0000 7f0888cc4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f088415f180 con 0x7f088415d110 2023-12-20T04:47:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.904+0000 7f0888cc4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f088415f460 con 0x7f0884161940 2023-12-20T04:47:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.905+0000 7f088259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08840b1d10 0x7f08840b7b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.905+0000 7f088259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08840b1d10 0x7f08840b7b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57660/0 (socket says 172.21.15.132:57660) 2023-12-20T04:47:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.905+0000 7f088259c640 1 -- 172.21.15.132:0/3636841958 learned_addr learned my addr 172.21.15.132:0/3636841958 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.905+0000 7f0881d9b640 1 --2- 172.21.15.132:0/3636841958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f088415d110 0x7f088415e6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.905+0000 7f0882d9d640 1 --2- 172.21.15.132:0/3636841958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0884161940 0x7f0884147a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.905+0000 7f088259c640 1 -- 172.21.15.132:0/3636841958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0884161940 msgr2=0x7f0884147a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:01.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.905+0000 7f088259c640 1 --2- 172.21.15.132:0/3636841958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0884161940 0x7f0884147a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.905+0000 7f088259c640 1 -- 172.21.15.132:0/3636841958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f088415d110 msgr2=0x7f088415e6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:01.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.905+0000 7f088259c640 1 --2- 172.21.15.132:0/3636841958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f088415d110 0x7f088415e6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:01.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.905+0000 7f088259c640 1 -- 172.21.15.132:0/3636841958 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f087c0094d0 con 0x7f08840b1d10 2023-12-20T04:47:01.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.905+0000 7f088259c640 1 --2- 172.21.15.132:0/3636841958 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08840b1d10 0x7f08840b7b60 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f087400cf60 tx=0x7f087400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:01.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.905+0000 7f0872ffd640 1 -- 172.21.15.132:0/3636841958 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087400d840 con 0x7f08840b1d10 2023-12-20T04:47:01.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.905+0000 7f0872ffd640 1 -- 172.21.15.132:0/3636841958 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f087400d9a0 con 0x7f08840b1d10 2023-12-20T04:47:01.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.905+0000 7f0888cc4640 1 -- 172.21.15.132:0/3636841958 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f088415f740 con 0x7f08840b1d10 2023-12-20T04:47:01.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.905+0000 7f0872ffd640 1 -- 172.21.15.132:0/3636841958 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f087400dd30 con 0x7f08840b1d10 2023-12-20T04:47:01.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.905+0000 7f0888cc4640 1 -- 172.21.15.132:0/3636841958 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08841f2b50 con 0x7f08840b1d10 2023-12-20T04:47:01.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.906+0000 7f0888cc4640 1 -- 172.21.15.132:0/3636841958 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f088404e840 con 0x7f08840b1d10 2023-12-20T04:47:01.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.907+0000 7f0872ffd640 1 -- 172.21.15.132:0/3636841958 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0874015440 con 0x7f08840b1d10 2023-12-20T04:47:01.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.907+0000 7f0872ffd640 1 --2- 172.21.15.132:0/3636841958 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f086406a460 0x7f086406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:01.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.907+0000 7f0872ffd640 1 -- 172.21.15.132:0/3636841958 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(88..88 src has 1..88) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f08740892a0 con 0x7f08840b1d10 2023-12-20T04:47:01.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.907+0000 7f0881d9b640 1 --2- 172.21.15.132:0/3636841958 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f086406a460 0x7f086406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:01.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.907+0000 7f0872ffd640 1 -- 172.21.15.132:0/3636841958 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=89}) v3 -- 0x7f0864072050 con 0x7f08840b1d10 2023-12-20T04:47:01.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.907+0000 7f0881d9b640 1 --2- 172.21.15.132:0/3636841958 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f086406a460 0x7f086406c920 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f08840cc6a0 tx=0x7f0878008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:01.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:01.911+0000 7f0872ffd640 1 -- 172.21.15.132:0/3636841958 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f087401a060 con 0x7f08840b1d10 2023-12-20T04:47:02.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.109+0000 7f0888cc4640 1 -- 172.21.15.132:0/3636841958 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f08840d0b10 con 0x7f08840b1d10 2023-12-20T04:47:02.112 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:47:02.110+0000 7f1a5cbbd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-20T04:47:02.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.114+0000 7f0872ffd640 1 -- 172.21.15.132:0/3636841958 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(89..89 src has 1..89) v4 ==== 374+0+0 (secure 0 0 0) 0x7f08740585c0 con 0x7f08840b1d10 2023-12-20T04:47:02.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.114+0000 7f0872ffd640 1 -- 172.21.15.132:0/3636841958 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7f0864072900 con 0x7f08840b1d10 2023-12-20T04:47:02.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.122+0000 7f0872ffd640 1 -- 172.21.15.132:0/3636841958 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v33) v1 ==== 161+0+0 (secure 0 0 0) 0x7f0874054900 con 0x7f08840b1d10 2023-12-20T04:47:02.124 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-20T04:47:02.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.124+0000 7f0888cc4640 1 -- 172.21.15.132:0/3636841958 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f086406a460 msgr2=0x7f086406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:02.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.124+0000 7f0888cc4640 1 --2- 172.21.15.132:0/3636841958 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f086406a460 0x7f086406c920 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f08840cc6a0 tx=0x7f0878008040 comp rx=0 tx=0).stop 2023-12-20T04:47:02.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.124+0000 7f0888cc4640 1 -- 172.21.15.132:0/3636841958 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08840b1d10 msgr2=0x7f08840b7b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:02.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.124+0000 7f0888cc4640 1 --2- 172.21.15.132:0/3636841958 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08840b1d10 0x7f08840b7b60 secure :-1 s=READY pgs=969 cs=0 l=1 rev1=1 crypto rx=0x7f087400cf60 tx=0x7f087400cf90 comp rx=0 tx=0).stop 2023-12-20T04:47:02.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.124+0000 7f0888cc4640 1 -- 172.21.15.132:0/3636841958 shutdown_connections 2023-12-20T04:47:02.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.124+0000 7f0888cc4640 1 --2- 172.21.15.132:0/3636841958 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f086406a460 0x7f086406c920 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:02.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.124+0000 7f0888cc4640 1 --2- 172.21.15.132:0/3636841958 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0884161940 0x7f0884147a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:02.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.124+0000 7f0888cc4640 1 --2- 172.21.15.132:0/3636841958 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f088415d110 0x7f088415e6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:02.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.124+0000 7f0888cc4640 1 --2- 172.21.15.132:0/3636841958 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08840b1d10 0x7f08840b7b60 unknown :-1 s=CLOSED pgs=969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:02.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.124+0000 7f0888cc4640 1 -- 172.21.15.132:0/3636841958 >> 172.21.15.132:0/3636841958 conn(0x7f08840cf880 msgr2=0x7f08840cea90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:02.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.124+0000 7f0888cc4640 1 -- 172.21.15.132:0/3636841958 shutdown_connections 2023-12-20T04:47:02.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.124+0000 7f0888cc4640 1 -- 172.21.15.132:0/3636841958 wait complete. 2023-12-20T04:47:02.137 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-20T04:47:02.163 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-12-20T04:47:02.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.237+0000 7f9c58a41640 1 Processor -- start 2023-12-20T04:47:02.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.237+0000 7f9c58a41640 1 -- start start 2023-12-20T04:47:02.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.238+0000 7f9c58a41640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c5415cf20 0x7f9c5406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:02.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.238+0000 7f9c58a41640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9c5415d300 0x7f9c54161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:02.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.238+0000 7f9c58a41640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c54161c40 con 0x7f9c540cd4b0 2023-12-20T04:47:02.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.238+0000 7f9c58a41640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9c5406cc90 con 0x7f9c5415d300 2023-12-20T04:47:02.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.238+0000 7f9c58a41640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540b2f30 con 0x7f9c5415cf20 2023-12-20T04:47:02.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.238+0000 7f9c51d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9c5415d300 0x7f9c54161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:02.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.238+0000 7f9c52d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9c540cd4b0 0x7f9c540ceb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45494/0 (socket says 172.21.15.132:45494) 2023-12-20T04:47:02.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.238+0000 7f9c52d9d640 1 -- 172.21.15.132:0/460073269 learned_addr learned my addr 172.21.15.132:0/460073269 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:02.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.239+0000 7f9c5259c640 1 --2- 172.21.15.132:0/460073269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c5415cf20 0x7f9c5406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:02.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.239+0000 7f9c51d9b640 1 -- 172.21.15.132:0/460073269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c5415cf20 msgr2=0x7f9c5406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:02.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.239+0000 7f9c51d9b640 1 --2- 172.21.15.132:0/460073269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c5415cf20 0x7f9c5406c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:02.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.239+0000 7f9c51d9b640 1 -- 172.21.15.132:0/460073269 >> v1:172.21.15.132:6789/0 conn(0x7f9c540cd4b0 legacy=0x7f9c540ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:02.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.239+0000 7f9c5159a640 1 -- 172.21.15.132:0/460073269 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 245956959 0 0) 0x7f9c54161c40 con 0x7f9c540cd4b0 2023-12-20T04:47:02.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.239+0000 7f9c51d9b640 1 -- 172.21.15.132:0/460073269 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c540b3210 con 0x7f9c5415d300 2023-12-20T04:47:02.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.239+0000 7f9c51d9b640 1 --2- 172.21.15.132:0/460073269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c5415d300 0x7f9c54161700 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9c480097a0 tx=0x7f9c4802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3af42201f8242c0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:02.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.239+0000 7f9c5159a640 1 -- 172.21.15.132:0/460073269 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48031830 con 0x7f9c5415d300 2023-12-20T04:47:02.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.240+0000 7f9c5159a640 1 -- 172.21.15.132:0/460073269 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c48031990 con 0x7f9c5415d300 2023-12-20T04:47:02.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.240+0000 7f9c5159a640 1 -- 172.21.15.132:0/460073269 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c48031d20 con 0x7f9c5415d300 2023-12-20T04:47:02.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.240+0000 7f9c58a41640 1 -- 172.21.15.132:0/460073269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c5415d300 msgr2=0x7f9c54161700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:02.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.240+0000 7f9c58a41640 1 --2- 172.21.15.132:0/460073269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c5415d300 0x7f9c54161700 secure :-1 s=READY pgs=973 cs=0 l=1 rev1=1 crypto rx=0x7f9c480097a0 tx=0x7f9c4802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:47:02.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.240+0000 7f9c58a41640 1 -- 172.21.15.132:0/460073269 shutdown_connections 2023-12-20T04:47:02.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.240+0000 7f9c58a41640 1 --2- 172.21.15.132:0/460073269 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c5415d300 0x7f9c54161700 unknown :-1 s=CLOSED pgs=973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:02.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.240+0000 7f9c58a41640 1 --2- 172.21.15.132:0/460073269 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c5415cf20 0x7f9c5406c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:02.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.240+0000 7f9c58a41640 1 -- 172.21.15.132:0/460073269 >> 172.21.15.132:0/460073269 conn(0x7f9c54072c60 msgr2=0x7f9c54073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:02.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.240+0000 7f9c58a41640 1 -- 172.21.15.132:0/460073269 shutdown_connections 2023-12-20T04:47:02.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.240+0000 7f9c58a41640 1 -- 172.21.15.132:0/460073269 wait complete. 2023-12-20T04:47:02.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.241+0000 7f9c58a41640 1 Processor -- start 2023-12-20T04:47:02.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.241+0000 7f9c58a41640 1 -- start start 2023-12-20T04:47:02.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.242+0000 7f9c58a41640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c540cd4b0 0x7f9c540b4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:02.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.242+0000 7f9c58a41640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c5415cf20 0x7f9c5414f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:02.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.242+0000 7f9c58a41640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c5415d300 0x7f9c540b1640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:02.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.242+0000 7f9c58a41640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540b4db0 con 0x7f9c540cd4b0 2023-12-20T04:47:02.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.242+0000 7f9c58a41640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c5414f600 con 0x7f9c5415cf20 2023-12-20T04:47:02.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.242+0000 7f9c58a41640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c540b37d0 con 0x7f9c5415d300 2023-12-20T04:47:02.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.242+0000 7f9c5259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c540cd4b0 0x7f9c540b4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:02.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.242+0000 7f9c5259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c540cd4b0 0x7f9c540b4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57674/0 (socket says 172.21.15.132:57674) 2023-12-20T04:47:02.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.242+0000 7f9c5259c640 1 -- 172.21.15.132:0/166629029 learned_addr learned my addr 172.21.15.132:0/166629029 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:02.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.243+0000 7f9c51d9b640 1 --2- 172.21.15.132:0/166629029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c5415cf20 0x7f9c5414f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:02.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.243+0000 7f9c52d9d640 1 --2- 172.21.15.132:0/166629029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c5415d300 0x7f9c540b1640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:02.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.243+0000 7f9c5259c640 1 -- 172.21.15.132:0/166629029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c5415d300 msgr2=0x7f9c540b1640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:02.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.243+0000 7f9c5259c640 1 --2- 172.21.15.132:0/166629029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c5415d300 0x7f9c540b1640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:02.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.243+0000 7f9c5259c640 1 -- 172.21.15.132:0/166629029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c5415cf20 msgr2=0x7f9c5414f0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:02.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.243+0000 7f9c5259c640 1 --2- 172.21.15.132:0/166629029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c5415cf20 0x7f9c5414f0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:02.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.243+0000 7f9c5259c640 1 -- 172.21.15.132:0/166629029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c48009400 con 0x7f9c540cd4b0 2023-12-20T04:47:02.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.243+0000 7f9c51d9b640 1 --2- 172.21.15.132:0/166629029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c5415cf20 0x7f9c5414f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:02.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.243+0000 7f9c52d9d640 1 --2- 172.21.15.132:0/166629029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c5415d300 0x7f9c540b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:02.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.243+0000 7f9c5259c640 1 --2- 172.21.15.132:0/166629029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c540cd4b0 0x7f9c540b4870 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400cdf0 tx=0x7f9c4400a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:02.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.243+0000 7f9c42ffd640 1 -- 172.21.15.132:0/166629029 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44003b90 con 0x7f9c540cd4b0 2023-12-20T04:47:02.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.243+0000 7f9c42ffd640 1 -- 172.21.15.132:0/166629029 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c44003d10 con 0x7f9c540cd4b0 2023-12-20T04:47:02.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.243+0000 7f9c58a41640 1 -- 172.21.15.132:0/166629029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c540b3ab0 con 0x7f9c540cd4b0 2023-12-20T04:47:02.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.243+0000 7f9c42ffd640 1 -- 172.21.15.132:0/166629029 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c44004260 con 0x7f9c540cd4b0 2023-12-20T04:47:02.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.243+0000 7f9c58a41640 1 -- 172.21.15.132:0/166629029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c540b4070 con 0x7f9c540cd4b0 2023-12-20T04:47:02.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.244+0000 7f9c58a41640 1 -- 172.21.15.132:0/166629029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c5404e840 con 0x7f9c540cd4b0 2023-12-20T04:47:02.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.244+0000 7f9c42ffd640 1 -- 172.21.15.132:0/166629029 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9c440043c0 con 0x7f9c540cd4b0 2023-12-20T04:47:02.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.245+0000 7f9c42ffd640 1 --2- 172.21.15.132:0/166629029 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c3406a430 0x7f9c3406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:02.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.245+0000 7f9c42ffd640 1 -- 172.21.15.132:0/166629029 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(89..89 src has 1..89) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f9c44012070 con 0x7f9c540cd4b0 2023-12-20T04:47:02.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.245+0000 7f9c51d9b640 1 --2- 172.21.15.132:0/166629029 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c3406a430 0x7f9c3406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:02.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.245+0000 7f9c42ffd640 1 -- 172.21.15.132:0/166629029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=90}) v3 -- 0x7f9c34072130 con 0x7f9c540cd4b0 2023-12-20T04:47:02.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.245+0000 7f9c51d9b640 1 --2- 172.21.15.132:0/166629029 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c3406a430 0x7f9c3406c8f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9c48036000 tx=0x7f9c48008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:02.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.249+0000 7f9c42ffd640 1 -- 172.21.15.132:0/166629029 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9c440549d0 con 0x7f9c540cd4b0 2023-12-20T04:47:02.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:02.449+0000 7f9c58a41640 1 -- 172.21.15.132:0/166629029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f9c540b2890 con 0x7f9c540cd4b0 2023-12-20T04:47:03.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.126+0000 7f9c42ffd640 1 -- 172.21.15.132:0/166629029 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(90..90 src has 1..90) v4 ==== 296+0+0 (secure 0 0 0) 0x7f9c4401d340 con 0x7f9c540cd4b0 2023-12-20T04:47:03.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.126+0000 7f9c42ffd640 1 -- 172.21.15.132:0/166629029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=91}) v3 -- 0x7f9c340729e0 con 0x7f9c540cd4b0 2023-12-20T04:47:03.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.134+0000 7f9c42ffd640 1 -- 172.21.15.132:0/166629029 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v34) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9c44057ff0 con 0x7f9c540cd4b0 2023-12-20T04:47:03.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.136+0000 7f9c58a41640 1 -- 172.21.15.132:0/166629029 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c3406a430 msgr2=0x7f9c3406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:03.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.136+0000 7f9c58a41640 1 --2- 172.21.15.132:0/166629029 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c3406a430 0x7f9c3406c8f0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f9c48036000 tx=0x7f9c48008030 comp rx=0 tx=0).stop 2023-12-20T04:47:03.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.136+0000 7f9c58a41640 1 -- 172.21.15.132:0/166629029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c540cd4b0 msgr2=0x7f9c540b4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:03.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.136+0000 7f9c58a41640 1 --2- 172.21.15.132:0/166629029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c540cd4b0 0x7f9c540b4870 secure :-1 s=READY pgs=974 cs=0 l=1 rev1=1 crypto rx=0x7f9c4400cdf0 tx=0x7f9c4400a660 comp rx=0 tx=0).stop 2023-12-20T04:47:03.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.136+0000 7f9c58a41640 1 -- 172.21.15.132:0/166629029 shutdown_connections 2023-12-20T04:47:03.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.136+0000 7f9c58a41640 1 --2- 172.21.15.132:0/166629029 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c3406a430 0x7f9c3406c8f0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:03.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.136+0000 7f9c58a41640 1 --2- 172.21.15.132:0/166629029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c5415d300 0x7f9c540b1640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:03.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.136+0000 7f9c58a41640 1 --2- 172.21.15.132:0/166629029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c5415cf20 0x7f9c5414f0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:03.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.136+0000 7f9c58a41640 1 --2- 172.21.15.132:0/166629029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c540cd4b0 0x7f9c540b4870 unknown :-1 s=CLOSED pgs=974 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:03.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.136+0000 7f9c58a41640 1 -- 172.21.15.132:0/166629029 >> 172.21.15.132:0/166629029 conn(0x7f9c54072c60 msgr2=0x7f9c5415bf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:03.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.136+0000 7f9c58a41640 1 -- 172.21.15.132:0/166629029 shutdown_connections 2023-12-20T04:47:03.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.136+0000 7f9c58a41640 1 -- 172.21.15.132:0/166629029 wait complete. 2023-12-20T04:47:03.151 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-20T04:47:03.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.255+0000 7fb8e01d2640 1 Processor -- start 2023-12-20T04:47:03.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.255+0000 7fb8e01d2640 1 -- start start 2023-12-20T04:47:03.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.256+0000 7fb8e01d2640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb8d815d190 0x7fb8d8160b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:03.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.256+0000 7fb8e01d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8d80b87a0 0x7fb8d80cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:03.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.256+0000 7fb8e01d2640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb8d8161a70 con 0x7fb8d80ce020 2023-12-20T04:47:03.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.256+0000 7fb8e01d2640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb8d80ce4b0 con 0x7fb8d815d190 2023-12-20T04:47:03.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.256+0000 7fb8e01d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d80b5fb0 con 0x7fb8d80b87a0 2023-12-20T04:47:03.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.256+0000 7fb8dd76d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8d80b87a0 0x7fb8d80cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:03.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.256+0000 7fb8ddf6e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb8d815d190 0x7fb8d8160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:03.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.256+0000 7fb8de76f640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fb8d80ce020 0x7fb8d80b4890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:39238/0 (socket says 172.21.15.132:39238) 2023-12-20T04:47:03.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.256+0000 7fb8de76f640 1 -- 172.21.15.132:0/2681148963 learned_addr learned my addr 172.21.15.132:0/2681148963 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:03.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.256+0000 7fb8dcf6c640 1 -- 172.21.15.132:0/2681148963 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1279347200 0 0) 0x7fb8d8161a70 con 0x7fb8d80ce020 2023-12-20T04:47:03.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.256+0000 7fb8dcf6c640 1 -- 172.21.15.132:0/2681148963 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb8c4003520 con 0x7fb8d80ce020 2023-12-20T04:47:03.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.257+0000 7fb8dd76d640 1 -- 172.21.15.132:0/2681148963 >> v2:172.21.15.187:3300/0 conn(0x7fb8d815d190 msgr2=0x7fb8d8160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:03.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.257+0000 7fb8dd76d640 1 --2- 172.21.15.132:0/2681148963 >> v2:172.21.15.187:3300/0 conn(0x7fb8d815d190 0x7fb8d8160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:03.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.257+0000 7fb8dd76d640 1 -- 172.21.15.132:0/2681148963 >> v1:172.21.15.187:6789/0 conn(0x7fb8d80ce020 legacy=0x7fb8d80b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:03.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.257+0000 7fb8dd76d640 1 -- 172.21.15.132:0/2681148963 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d81611d0 con 0x7fb8d80b87a0 2023-12-20T04:47:03.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.257+0000 7fb8ddf6e640 1 --2- 172.21.15.132:0/2681148963 >> v2:172.21.15.187:3300/0 conn(0x7fb8d815d190 0x7fb8d8160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:47:03.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.257+0000 7fb8dd76d640 1 --2- 172.21.15.132:0/2681148963 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8d80b87a0 0x7fb8d80cdae0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80097a0 tx=0x7fb8c802b7a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=250391358657033b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:03.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.257+0000 7fb8dcf6c640 1 -- 172.21.15.132:0/2681148963 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c802f050 con 0x7fb8d80b87a0 2023-12-20T04:47:03.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.258+0000 7fb8dcf6c640 1 -- 172.21.15.132:0/2681148963 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8c8031700 con 0x7fb8d80b87a0 2023-12-20T04:47:03.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.258+0000 7fb8dcf6c640 1 -- 172.21.15.132:0/2681148963 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8c8031a90 con 0x7fb8d80b87a0 2023-12-20T04:47:03.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.258+0000 7fb8e01d2640 1 -- 172.21.15.132:0/2681148963 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8d80b87a0 msgr2=0x7fb8d80cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:03.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.258+0000 7fb8e01d2640 1 --2- 172.21.15.132:0/2681148963 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8d80b87a0 0x7fb8d80cdae0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7fb8c80097a0 tx=0x7fb8c802b7a0 comp rx=0 tx=0).stop 2023-12-20T04:47:03.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.258+0000 7fb8e01d2640 1 -- 172.21.15.132:0/2681148963 shutdown_connections 2023-12-20T04:47:03.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.258+0000 7fb8e01d2640 1 --2- 172.21.15.132:0/2681148963 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8d80b87a0 0x7fb8d80cdae0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:03.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.258+0000 7fb8e01d2640 1 --2- 172.21.15.132:0/2681148963 >> v2:172.21.15.187:3300/0 conn(0x7fb8d815d190 0x7fb8d8160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:03.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.258+0000 7fb8e01d2640 1 -- 172.21.15.132:0/2681148963 >> 172.21.15.132:0/2681148963 conn(0x7fb8d806a290 msgr2=0x7fb8d806a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:03.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.258+0000 7fb8e01d2640 1 -- 172.21.15.132:0/2681148963 shutdown_connections 2023-12-20T04:47:03.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.258+0000 7fb8e01d2640 1 -- 172.21.15.132:0/2681148963 wait complete. 2023-12-20T04:47:03.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.259+0000 7fb8e01d2640 1 Processor -- start 2023-12-20T04:47:03.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.259+0000 7fb8e01d2640 1 -- start start 2023-12-20T04:47:03.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.260+0000 7fb8e01d2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8d80b87a0 0x7fb8d814e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:03.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.260+0000 7fb8e01d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8d80ce020 0x7fb8d80cb700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:03.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.260+0000 7fb8e01d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d815d190 0x7fb8d80cbc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:03.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.260+0000 7fb8e01d2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d81544f0 con 0x7fb8d815d190 2023-12-20T04:47:03.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.260+0000 7fb8e01d2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d80ca010 con 0x7fb8d80b87a0 2023-12-20T04:47:03.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.260+0000 7fb8e01d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb8d80ca2f0 con 0x7fb8d80ce020 2023-12-20T04:47:03.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.260+0000 7fb8de76f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d815d190 0x7fb8d80cbc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:03.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.260+0000 7fb8de76f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d815d190 0x7fb8d80cbc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57686/0 (socket says 172.21.15.132:57686) 2023-12-20T04:47:03.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.260+0000 7fb8de76f640 1 -- 172.21.15.132:0/3712646351 learned_addr learned my addr 172.21.15.132:0/3712646351 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:03.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.260+0000 7fb8ddf6e640 1 --2- 172.21.15.132:0/3712646351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8d80b87a0 0x7fb8d814e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:03.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.260+0000 7fb8dd76d640 1 --2- 172.21.15.132:0/3712646351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8d80ce020 0x7fb8d80cb700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:03.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.260+0000 7fb8de76f640 1 -- 172.21.15.132:0/3712646351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8d80ce020 msgr2=0x7fb8d80cb700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:03.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.260+0000 7fb8de76f640 1 --2- 172.21.15.132:0/3712646351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8d80ce020 0x7fb8d80cb700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:03.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.260+0000 7fb8de76f640 1 -- 172.21.15.132:0/3712646351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8d80b87a0 msgr2=0x7fb8d814e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:03.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.260+0000 7fb8de76f640 1 --2- 172.21.15.132:0/3712646351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8d80b87a0 0x7fb8d814e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:03.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.260+0000 7fb8de76f640 1 -- 172.21.15.132:0/3712646351 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8d4009400 con 0x7fb8d815d190 2023-12-20T04:47:03.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.261+0000 7fb8de76f640 1 --2- 172.21.15.132:0/3712646351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d815d190 0x7fb8d80cbc40 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000cb40 tx=0x7fb8d000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:03.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.261+0000 7fb8ce7fc640 1 -- 172.21.15.132:0/3712646351 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d000aca0 con 0x7fb8d815d190 2023-12-20T04:47:03.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.261+0000 7fb8ce7fc640 1 -- 172.21.15.132:0/3712646351 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb8d000ae00 con 0x7fb8d815d190 2023-12-20T04:47:03.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.261+0000 7fb8e01d2640 1 -- 172.21.15.132:0/3712646351 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8c8009400 con 0x7fb8d815d190 2023-12-20T04:47:03.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.261+0000 7fb8ce7fc640 1 -- 172.21.15.132:0/3712646351 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb8d0012620 con 0x7fb8d815d190 2023-12-20T04:47:03.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.261+0000 7fb8e01d2640 1 -- 172.21.15.132:0/3712646351 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8d80ca8b0 con 0x7fb8d815d190 2023-12-20T04:47:03.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.262+0000 7fb8e01d2640 1 -- 172.21.15.132:0/3712646351 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8d80caaa0 con 0x7fb8d815d190 2023-12-20T04:47:03.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.262+0000 7fb8ce7fc640 1 -- 172.21.15.132:0/3712646351 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb8d0007070 con 0x7fb8d815d190 2023-12-20T04:47:03.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.262+0000 7fb8ce7fc640 1 --2- 172.21.15.132:0/3712646351 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb8bc06a430 0x7fb8bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:03.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.263+0000 7fb8ce7fc640 1 -- 172.21.15.132:0/3712646351 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(90..90 src has 1..90) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fb8d00888d0 con 0x7fb8d815d190 2023-12-20T04:47:03.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.263+0000 7fb8ddf6e640 1 --2- 172.21.15.132:0/3712646351 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb8bc06a430 0x7fb8bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:03.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.263+0000 7fb8ce7fc640 1 -- 172.21.15.132:0/3712646351 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=91}) v3 -- 0x7fb8bc072130 con 0x7fb8d815d190 2023-12-20T04:47:03.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.263+0000 7fb8ddf6e640 1 --2- 172.21.15.132:0/3712646351 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb8bc06a430 0x7fb8bc06c8f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009c30 tx=0x7fb8d4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:03.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.267+0000 7fb8ce7fc640 1 -- 172.21.15.132:0/3712646351 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb8d0053f70 con 0x7fb8d815d190 2023-12-20T04:47:03.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:03.433+0000 7fb8e01d2640 1 -- 172.21.15.132:0/3712646351 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fb8d8161760 con 0x7fb8d815d190 2023-12-20T04:47:04.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.134+0000 7fb8ce7fc640 1 -- 172.21.15.132:0/3712646351 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(91..91 src has 1..91) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fb8d0088060 con 0x7fb8d815d190 2023-12-20T04:47:04.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.134+0000 7fb8ce7fc640 1 -- 172.21.15.132:0/3712646351 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=92}) v3 -- 0x7fb8bc070560 con 0x7fb8d815d190 2023-12-20T04:47:04.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.138+0000 7fb8ce7fc640 1 -- 172.21.15.132:0/3712646351 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v91) v1 ==== 181+0+0 (secure 0 0 0) 0x7fb8d0017030 con 0x7fb8d815d190 2023-12-20T04:47:04.140 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2023-12-20T04:47:04.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.142+0000 7fb8e01d2640 1 -- 172.21.15.132:0/3712646351 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb8bc06a430 msgr2=0x7fb8bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:04.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.142+0000 7fb8e01d2640 1 --2- 172.21.15.132:0/3712646351 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb8bc06a430 0x7fb8bc06c8f0 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fb8d4009c30 tx=0x7fb8d4009190 comp rx=0 tx=0).stop 2023-12-20T04:47:04.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.142+0000 7fb8e01d2640 1 -- 172.21.15.132:0/3712646351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d815d190 msgr2=0x7fb8d80cbc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:04.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.142+0000 7fb8e01d2640 1 --2- 172.21.15.132:0/3712646351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d815d190 0x7fb8d80cbc40 secure :-1 s=READY pgs=975 cs=0 l=1 rev1=1 crypto rx=0x7fb8d000cb40 tx=0x7fb8d000a060 comp rx=0 tx=0).stop 2023-12-20T04:47:04.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.142+0000 7fb8e01d2640 1 -- 172.21.15.132:0/3712646351 shutdown_connections 2023-12-20T04:47:04.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.142+0000 7fb8e01d2640 1 --2- 172.21.15.132:0/3712646351 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb8bc06a430 0x7fb8bc06c8f0 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:04.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.142+0000 7fb8e01d2640 1 --2- 172.21.15.132:0/3712646351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb8d815d190 0x7fb8d80cbc40 unknown :-1 s=CLOSED pgs=975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:04.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.142+0000 7fb8e01d2640 1 --2- 172.21.15.132:0/3712646351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb8d80ce020 0x7fb8d80cb700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:04.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.142+0000 7fb8e01d2640 1 --2- 172.21.15.132:0/3712646351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb8d80b87a0 0x7fb8d814e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:04.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.142+0000 7fb8e01d2640 1 -- 172.21.15.132:0/3712646351 >> 172.21.15.132:0/3712646351 conn(0x7fb8d806a290 msgr2=0x7fb8d81573f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:04.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.142+0000 7fb8e01d2640 1 -- 172.21.15.132:0/3712646351 shutdown_connections 2023-12-20T04:47:04.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.142+0000 7fb8e01d2640 1 -- 172.21.15.132:0/3712646351 wait complete. 2023-12-20T04:47:04.157 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-20T04:47:04.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.261+0000 7f62ad369640 1 Processor -- start 2023-12-20T04:47:04.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.261+0000 7f62ad369640 1 -- start start 2023-12-20T04:47:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.262+0000 7f62ad369640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a815d130 0x7f62a80d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.262+0000 7f62ad369640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f62a81618e0 0x7f62a80b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.262+0000 7f62ad369640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f62a80b27d0 con 0x7f62a8160d50 2023-12-20T04:47:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.262+0000 7f62ad369640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62a80d1ff0 con 0x7f62a81618e0 2023-12-20T04:47:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.262+0000 7f62ad369640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80b2a90 con 0x7f62a815d130 2023-12-20T04:47:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.262+0000 7f62a77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f62a81618e0 0x7f62a80b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.262+0000 7f62a77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f62a81618e0 0x7f62a80b3570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57702/0 (socket says 172.21.15.132:57702) 2023-12-20T04:47:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.262+0000 7f62a77fe640 1 -- 172.21.15.132:0/4112375343 learned_addr learned my addr 172.21.15.132:0/4112375343 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.262+0000 7f62a6ffd640 1 --2- 172.21.15.132:0/4112375343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a815d130 0x7f62a80d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.262+0000 7f62a77fe640 1 -- 172.21.15.132:0/4112375343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a815d130 msgr2=0x7f62a80d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:04.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.262+0000 7f62a77fe640 1 --2- 172.21.15.132:0/4112375343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a815d130 0x7f62a80d17c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:04.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.262+0000 7f62a77fe640 1 -- 172.21.15.132:0/4112375343 >> v1:172.21.15.187:6789/0 conn(0x7f62a8160d50 legacy=0x7f62a81611d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:04.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.262+0000 7f62a77fe640 1 -- 172.21.15.132:0/4112375343 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a80b2d70 con 0x7f62a81618e0 2023-12-20T04:47:04.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.263+0000 7f62a77fe640 1 --2- 172.21.15.132:0/4112375343 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62a81618e0 0x7f62a80b3570 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009e80 tx=0x7f62a002be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a512ef0a67d4150 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:04.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.263+0000 7f62a67fc640 1 -- 172.21.15.132:0/4112375343 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a002c9c0 con 0x7f62a81618e0 2023-12-20T04:47:04.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.263+0000 7f62a67fc640 1 -- 172.21.15.132:0/4112375343 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a002cb20 con 0x7f62a81618e0 2023-12-20T04:47:04.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.263+0000 7f62a67fc640 1 -- 172.21.15.132:0/4112375343 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a00343f0 con 0x7f62a81618e0 2023-12-20T04:47:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.263+0000 7f62ad369640 1 -- 172.21.15.132:0/4112375343 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62a81618e0 msgr2=0x7f62a80b3570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.263+0000 7f62ad369640 1 --2- 172.21.15.132:0/4112375343 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62a81618e0 0x7f62a80b3570 secure :-1 s=READY pgs=976 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009e80 tx=0x7f62a002be20 comp rx=0 tx=0).stop 2023-12-20T04:47:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.264+0000 7f62ad369640 1 -- 172.21.15.132:0/4112375343 shutdown_connections 2023-12-20T04:47:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.264+0000 7f62ad369640 1 --2- 172.21.15.132:0/4112375343 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62a81618e0 0x7f62a80b3570 unknown :-1 s=CLOSED pgs=976 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.264+0000 7f62ad369640 1 --2- 172.21.15.132:0/4112375343 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a815d130 0x7f62a80d17c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:04.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.264+0000 7f62ad369640 1 -- 172.21.15.132:0/4112375343 >> 172.21.15.132:0/4112375343 conn(0x7f62a80d2eb0 msgr2=0x7f62a80d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.264+0000 7f62ad369640 1 -- 172.21.15.132:0/4112375343 shutdown_connections 2023-12-20T04:47:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.264+0000 7f62ad369640 1 -- 172.21.15.132:0/4112375343 wait complete. 2023-12-20T04:47:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.265+0000 7f62ad369640 1 Processor -- start 2023-12-20T04:47:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.265+0000 7f62ad369640 1 -- start start 2023-12-20T04:47:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.265+0000 7f62ad369640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62a815d130 0x7f62a815bee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f62ad369640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a8160d50 0x7f62a80c75c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f62ad369640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62a81618e0 0x7f62a80cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f62ad369640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80cb100 con 0x7f62a81618e0 2023-12-20T04:47:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f62ad369640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80cb3e0 con 0x7f62a815d130 2023-12-20T04:47:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f62ad369640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62a80cb6c0 con 0x7f62a8160d50 2023-12-20T04:47:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f62a77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62a81618e0 0x7f62a80cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:04.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f62a77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62a81618e0 0x7f62a80cc1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57712/0 (socket says 172.21.15.132:57712) 2023-12-20T04:47:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f62a77fe640 1 -- 172.21.15.132:0/1648428451 learned_addr learned my addr 172.21.15.132:0/1648428451 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f62a6ffd640 1 --2- 172.21.15.132:0/1648428451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62a815d130 0x7f62a815bee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f629e7fc640 1 --2- 172.21.15.132:0/1648428451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a8160d50 0x7f62a80c75c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f62a77fe640 1 -- 172.21.15.132:0/1648428451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a8160d50 msgr2=0x7f62a80c75c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f62a77fe640 1 --2- 172.21.15.132:0/1648428451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a8160d50 0x7f62a80c75c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f62a77fe640 1 -- 172.21.15.132:0/1648428451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62a815d130 msgr2=0x7f62a815bee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f62a77fe640 1 --2- 172.21.15.132:0/1648428451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62a815d130 0x7f62a815bee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f62a77fe640 1 -- 172.21.15.132:0/1648428451 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62a0009b30 con 0x7f62a81618e0 2023-12-20T04:47:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f62a77fe640 1 --2- 172.21.15.132:0/1648428451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62a81618e0 0x7f62a80cc1a0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009fa0 tx=0x7f62a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f629ffff640 1 -- 172.21.15.132:0/1648428451 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a0009510 con 0x7f62a81618e0 2023-12-20T04:47:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f629ffff640 1 -- 172.21.15.132:0/1648428451 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62a003e450 con 0x7f62a81618e0 2023-12-20T04:47:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f629ffff640 1 -- 172.21.15.132:0/1648428451 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62a003e800 con 0x7f62a81618e0 2023-12-20T04:47:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f62ad369640 1 -- 172.21.15.132:0/1648428451 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62a80cb9a0 con 0x7f62a81618e0 2023-12-20T04:47:04.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.266+0000 7f62ad369640 1 -- 172.21.15.132:0/1648428451 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62a815c420 con 0x7f62a81618e0 2023-12-20T04:47:04.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.267+0000 7f62ad369640 1 -- 172.21.15.132:0/1648428451 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62a80cbe60 con 0x7f62a81618e0 2023-12-20T04:47:04.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.268+0000 7f629ffff640 1 -- 172.21.15.132:0/1648428451 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f62a003e960 con 0x7f62a81618e0 2023-12-20T04:47:04.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.268+0000 7f629ffff640 1 --2- 172.21.15.132:0/1648428451 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f628806a430 0x7f628806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:04.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.268+0000 7f629ffff640 1 -- 172.21.15.132:0/1648428451 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(91..91 src has 1..91) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f62a00ab520 con 0x7f62a81618e0 2023-12-20T04:47:04.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.268+0000 7f62a6ffd640 1 --2- 172.21.15.132:0/1648428451 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f628806a430 0x7f628806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:04.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.268+0000 7f62a6ffd640 1 --2- 172.21.15.132:0/1648428451 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f628806a430 0x7f628806c8f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6298006fd0 tx=0x7f6298008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:04.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.272+0000 7f629ffff640 1 -- 172.21.15.132:0/1648428451 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f62a0076cc0 con 0x7f62a81618e0 2023-12-20T04:47:04.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:04.438+0000 7f62ad369640 1 -- 172.21.15.132:0/1648428451 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f62a804e840 con 0x7f62a81618e0 2023-12-20T04:47:05.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.141+0000 7f629ffff640 1 -- 172.21.15.132:0/1648428451 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v92) v1 ==== 169+0+0 (secure 0 0 0) 0x7f62a007a2e0 con 0x7f62a81618e0 2023-12-20T04:47:05.145 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2023-12-20T04:47:05.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.148+0000 7f62ad369640 1 -- 172.21.15.132:0/1648428451 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f628806a430 msgr2=0x7f628806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:05.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.148+0000 7f62ad369640 1 --2- 172.21.15.132:0/1648428451 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f628806a430 0x7f628806c8f0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7f6298006fd0 tx=0x7f6298008040 comp rx=0 tx=0).stop 2023-12-20T04:47:05.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.148+0000 7f62ad369640 1 -- 172.21.15.132:0/1648428451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62a81618e0 msgr2=0x7f62a80cc1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:05.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.148+0000 7f62ad369640 1 --2- 172.21.15.132:0/1648428451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62a81618e0 0x7f62a80cc1a0 secure :-1 s=READY pgs=977 cs=0 l=1 rev1=1 crypto rx=0x7f62a0009fa0 tx=0x7f62a0004a40 comp rx=0 tx=0).stop 2023-12-20T04:47:05.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.148+0000 7f62ad369640 1 -- 172.21.15.132:0/1648428451 shutdown_connections 2023-12-20T04:47:05.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.148+0000 7f62ad369640 1 --2- 172.21.15.132:0/1648428451 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f628806a430 0x7f628806c8f0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.148+0000 7f62ad369640 1 --2- 172.21.15.132:0/1648428451 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f62a81618e0 0x7f62a80cc1a0 unknown :-1 s=CLOSED pgs=977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.148+0000 7f62ad369640 1 --2- 172.21.15.132:0/1648428451 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62a8160d50 0x7f62a80c75c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.148+0000 7f62ad369640 1 --2- 172.21.15.132:0/1648428451 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62a815d130 0x7f62a815bee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.148+0000 7f62ad369640 1 -- 172.21.15.132:0/1648428451 >> 172.21.15.132:0/1648428451 conn(0x7f62a80d2eb0 msgr2=0x7f62a815f300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:05.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.148+0000 7f62ad369640 1 -- 172.21.15.132:0/1648428451 shutdown_connections 2023-12-20T04:47:05.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.148+0000 7f62ad369640 1 -- 172.21.15.132:0/1648428451 wait complete. 2023-12-20T04:47:05.162 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-20T04:47:05.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.264+0000 7fe1f8305640 1 Processor -- start 2023-12-20T04:47:05.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.264+0000 7fe1f8305640 1 -- start start 2023-12-20T04:47:05.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.265+0000 7fe1f8305640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe1f00cd950 0x7fe1f00caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:05.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.265+0000 7fe1f8305640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe1f00c41f0 0x7fe1f006b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:05.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.265+0000 7fe1f8305640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1f01439f0 con 0x7fe1f0143610 2023-12-20T04:47:05.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.265+0000 7fe1f8305640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f00c46f0 con 0x7fe1f00cd950 2023-12-20T04:47:05.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.265+0000 7fe1f8305640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1f00c49d0 con 0x7fe1f00c41f0 2023-12-20T04:47:05.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.265+0000 7fe1f58a0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe1f00cd950 0x7fe1f00caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:05.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.265+0000 7fe1f58a0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe1f00cd950 0x7fe1f00caa40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57722/0 (socket says 172.21.15.132:57722) 2023-12-20T04:47:05.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.265+0000 7fe1f60a1640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe1f0143610 0x7fe1f00cd240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45504/0 (socket says 172.21.15.132:45504) 2023-12-20T04:47:05.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.265+0000 7fe1f58a0640 1 -- 172.21.15.132:0/2688534286 learned_addr learned my addr 172.21.15.132:0/2688534286 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:05.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.265+0000 7fe1f58a0640 1 -- 172.21.15.132:0/2688534286 >> v2:172.21.15.187:3300/0 conn(0x7fe1f00c41f0 msgr2=0x7fe1f006b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:05.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.265+0000 7fe1f58a0640 1 --2- 172.21.15.132:0/2688534286 >> v2:172.21.15.187:3300/0 conn(0x7fe1f00c41f0 0x7fe1f006b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.265+0000 7fe1f58a0640 1 -- 172.21.15.132:0/2688534286 >> v1:172.21.15.132:6789/0 conn(0x7fe1f0143610 legacy=0x7fe1f00cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:05.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.265+0000 7fe1f58a0640 1 -- 172.21.15.132:0/2688534286 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1f00c4cb0 con 0x7fe1f00cd950 2023-12-20T04:47:05.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.265+0000 7fe1f509f640 1 -- 172.21.15.132:0/2688534286 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1376313361 0 0) 0x7fe1f01439f0 con 0x7fe1f0143610 2023-12-20T04:47:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.266+0000 7fe1f58a0640 1 --2- 172.21.15.132:0/2688534286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f00cd950 0x7fe1f00caa40 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fe1f006d620 tx=0x7fe1e002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1f4491e8a07cca14 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.266+0000 7fe1f509f640 1 -- 172.21.15.132:0/2688534286 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0030860 con 0x7fe1f00cd950 2023-12-20T04:47:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.266+0000 7fe1f509f640 1 -- 172.21.15.132:0/2688534286 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e00309c0 con 0x7fe1f00cd950 2023-12-20T04:47:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.266+0000 7fe1f509f640 1 -- 172.21.15.132:0/2688534286 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0030d50 con 0x7fe1f00cd950 2023-12-20T04:47:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.267+0000 7fe1f8305640 1 -- 172.21.15.132:0/2688534286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f00cd950 msgr2=0x7fe1f00caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.267+0000 7fe1f8305640 1 --2- 172.21.15.132:0/2688534286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f00cd950 0x7fe1f00caa40 secure :-1 s=READY pgs=979 cs=0 l=1 rev1=1 crypto rx=0x7fe1f006d620 tx=0x7fe1e002b9a0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.267+0000 7fe1f8305640 1 -- 172.21.15.132:0/2688534286 shutdown_connections 2023-12-20T04:47:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.267+0000 7fe1f8305640 1 --2- 172.21.15.132:0/2688534286 >> v2:172.21.15.187:3300/0 conn(0x7fe1f00c41f0 0x7fe1f006b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.267+0000 7fe1f8305640 1 --2- 172.21.15.132:0/2688534286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f00cd950 0x7fe1f00caa40 unknown :-1 s=CLOSED pgs=979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.267+0000 7fe1f8305640 1 -- 172.21.15.132:0/2688534286 >> 172.21.15.132:0/2688534286 conn(0x7fe1f006a260 msgr2=0x7fe1f00b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.267+0000 7fe1f8305640 1 -- 172.21.15.132:0/2688534286 shutdown_connections 2023-12-20T04:47:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.267+0000 7fe1f8305640 1 -- 172.21.15.132:0/2688534286 wait complete. 2023-12-20T04:47:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.268+0000 7fe1f8305640 1 Processor -- start 2023-12-20T04:47:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.268+0000 7fe1f8305640 1 -- start start 2023-12-20T04:47:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f8305640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1f00c41f0 0x7fe1f0071020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f8305640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f00cd950 0x7fe1f00b3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:05.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f8305640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1f0143610 0x7fe1f00b1a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:05.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f8305640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f0071690 con 0x7fe1f00cd950 2023-12-20T04:47:05.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f8305640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00b2460 con 0x7fe1f00c41f0 2023-12-20T04:47:05.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f8305640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1f00b2700 con 0x7fe1f0143610 2023-12-20T04:47:05.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f58a0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f00cd950 0x7fe1f00b3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:05.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f58a0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f00cd950 0x7fe1f00b3e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57726/0 (socket says 172.21.15.132:57726) 2023-12-20T04:47:05.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f58a0640 1 -- 172.21.15.132:0/2348842600 learned_addr learned my addr 172.21.15.132:0/2348842600 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:05.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f60a1640 1 --2- 172.21.15.132:0/2348842600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1f00c41f0 0x7fe1f0071020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:05.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f68a2640 1 --2- 172.21.15.132:0/2348842600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1f0143610 0x7fe1f00b1a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:05.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f58a0640 1 -- 172.21.15.132:0/2348842600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1f0143610 msgr2=0x7fe1f00b1a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:05.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f58a0640 1 --2- 172.21.15.132:0/2348842600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1f0143610 0x7fe1f00b1a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f58a0640 1 -- 172.21.15.132:0/2348842600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1f00c41f0 msgr2=0x7fe1f0071020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:05.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f58a0640 1 --2- 172.21.15.132:0/2348842600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1f00c41f0 0x7fe1f0071020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f58a0640 1 -- 172.21.15.132:0/2348842600 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e00094d0 con 0x7fe1f00cd950 2023-12-20T04:47:05.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f60a1640 1 --2- 172.21.15.132:0/2348842600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1f00c41f0 0x7fe1f0071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:05.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f68a2640 1 --2- 172.21.15.132:0/2348842600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1f0143610 0x7fe1f00b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:05.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f58a0640 1 --2- 172.21.15.132:0/2348842600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f00cd950 0x7fe1f00b3e60 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00090b0 tx=0x7fe1e0004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:05.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1e6ffd640 1 -- 172.21.15.132:0/2348842600 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e003e040 con 0x7fe1f00cd950 2023-12-20T04:47:05.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1e6ffd640 1 -- 172.21.15.132:0/2348842600 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1e0039d50 con 0x7fe1f00cd950 2023-12-20T04:47:05.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1e6ffd640 1 -- 172.21.15.132:0/2348842600 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1e0004270 con 0x7fe1f00cd950 2023-12-20T04:47:05.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.269+0000 7fe1f8305640 1 -- 172.21.15.132:0/2348842600 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1f00b29e0 con 0x7fe1f00cd950 2023-12-20T04:47:05.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.270+0000 7fe1f8305640 1 -- 172.21.15.132:0/2348842600 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1f0158ff0 con 0x7fe1f00cd950 2023-12-20T04:47:05.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.270+0000 7fe1f8305640 1 -- 172.21.15.132:0/2348842600 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1f004e840 con 0x7fe1f00cd950 2023-12-20T04:47:05.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.271+0000 7fe1e6ffd640 1 -- 172.21.15.132:0/2348842600 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe1e00043d0 con 0x7fe1f00cd950 2023-12-20T04:47:05.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.271+0000 7fe1e6ffd640 1 --2- 172.21.15.132:0/2348842600 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1d406a430 0x7fe1d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:05.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.271+0000 7fe1e6ffd640 1 -- 172.21.15.132:0/2348842600 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe1e00aabb0 con 0x7fe1f00cd950 2023-12-20T04:47:05.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.271+0000 7fe1f60a1640 1 --2- 172.21.15.132:0/2348842600 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1d406a430 0x7fe1d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:05.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.272+0000 7fe1f60a1640 1 --2- 172.21.15.132:0/2348842600 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1d406a430 0x7fe1d406c8f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec007fd0 tx=0x7fe1ec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:05.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.275+0000 7fe1e6ffd640 1 -- 172.21.15.132:0/2348842600 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe1e0076650 con 0x7fe1f00cd950 2023-12-20T04:47:05.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.441+0000 7fe1f8305640 1 -- 172.21.15.132:0/2348842600 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fe1f00c3fd0 con 0x7fe1f00cd950 2023-12-20T04:47:05.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.445+0000 7fe1e6ffd640 1 -- 172.21.15.132:0/2348842600 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v9) v1 ==== 104+0+0 (secure 0 0 0) 0x7fe1e0079c70 con 0x7fe1f00cd950 2023-12-20T04:47:05.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.447+0000 7fe1f8305640 1 -- 172.21.15.132:0/2348842600 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1d406a430 msgr2=0x7fe1d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:05.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.447+0000 7fe1f8305640 1 --2- 172.21.15.132:0/2348842600 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1d406a430 0x7fe1d406c8f0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7fe1ec007fd0 tx=0x7fe1ec009040 comp rx=0 tx=0).stop 2023-12-20T04:47:05.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.447+0000 7fe1f8305640 1 -- 172.21.15.132:0/2348842600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f00cd950 msgr2=0x7fe1f00b3e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:05.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.447+0000 7fe1f8305640 1 --2- 172.21.15.132:0/2348842600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f00cd950 0x7fe1f00b3e60 secure :-1 s=READY pgs=980 cs=0 l=1 rev1=1 crypto rx=0x7fe1e00090b0 tx=0x7fe1e0004730 comp rx=0 tx=0).stop 2023-12-20T04:47:05.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.447+0000 7fe1f8305640 1 -- 172.21.15.132:0/2348842600 shutdown_connections 2023-12-20T04:47:05.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.447+0000 7fe1f8305640 1 --2- 172.21.15.132:0/2348842600 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1d406a430 0x7fe1d406c8f0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.447+0000 7fe1f8305640 1 --2- 172.21.15.132:0/2348842600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1f0143610 0x7fe1f00b1a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.447+0000 7fe1f8305640 1 --2- 172.21.15.132:0/2348842600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1f00cd950 0x7fe1f00b3e60 unknown :-1 s=CLOSED pgs=980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.447+0000 7fe1f8305640 1 --2- 172.21.15.132:0/2348842600 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1f00c41f0 0x7fe1f0071020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.447+0000 7fe1f8305640 1 -- 172.21.15.132:0/2348842600 >> 172.21.15.132:0/2348842600 conn(0x7fe1f006a260 msgr2=0x7fe1f00b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:05.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.448+0000 7fe1f8305640 1 -- 172.21.15.132:0/2348842600 shutdown_connections 2023-12-20T04:47:05.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.448+0000 7fe1f8305640 1 -- 172.21.15.132:0/2348842600 wait complete. 2023-12-20T04:47:05.460 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync' 2023-12-20T04:47:05.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.557+0000 7f7a74d39640 1 Processor -- start 2023-12-20T04:47:05.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.557+0000 7f7a74d39640 1 -- start start 2023-12-20T04:47:05.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.558+0000 7f7a74d39640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7a700d0370 0x7f7a700b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:05.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.558+0000 7f7a74d39640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a700cdc10 0x7f7a7006c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:05.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.558+0000 7f7a74d39640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7a700b2f90 con 0x7f7a7015d100 2023-12-20T04:47:05.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.558+0000 7f7a74d39640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7a701613c0 con 0x7f7a700d0370 2023-12-20T04:47:05.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.558+0000 7f7a74d39640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a700d1b00 con 0x7f7a700cdc10 2023-12-20T04:47:05.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.559+0000 7f7a6dd9b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7a700d0370 0x7f7a700b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:05.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.559+0000 7f7a6ed9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a700cdc10 0x7f7a7006c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:05.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.559+0000 7f7a6e59c640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f7a7015d100 0x7f7a700cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:39264/0 (socket says 172.21.15.132:39264) 2023-12-20T04:47:05.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.559+0000 7f7a6dd9b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7a700d0370 0x7f7a700b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:45836/0 (socket says 172.21.15.132:45836) 2023-12-20T04:47:05.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.559+0000 7f7a6e59c640 1 -- 172.21.15.132:0/747851521 learned_addr learned my addr 172.21.15.132:0/747851521 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:05.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.559+0000 7f7a6dd9b640 1 -- 172.21.15.132:0/747851521 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a700cdc10 msgr2=0x7f7a7006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:05.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.559+0000 7f7a6dd9b640 1 --2- 172.21.15.132:0/747851521 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a700cdc10 0x7f7a7006c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.559+0000 7f7a6dd9b640 1 -- 172.21.15.132:0/747851521 >> v1:172.21.15.187:6789/0 conn(0x7f7a7015d100 legacy=0x7f7a700cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:05.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.559+0000 7f7a6dd9b640 1 -- 172.21.15.132:0/747851521 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a700d0810 con 0x7f7a700d0370 2023-12-20T04:47:05.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.559+0000 7f7a6ed9d640 1 --2- 172.21.15.132:0/747851521 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a700cdc10 0x7f7a7006c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:47:05.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.560+0000 7f7a6dd9b640 1 --2- 172.21.15.132:0/747851521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a700d0370 0x7f7a700b2a50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7a640097a0 tx=0x7f7a6402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=8292406c95407657 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:05.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.560+0000 7f7a6d59a640 1 -- 172.21.15.132:0/747851521 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64031830 con 0x7f7a700d0370 2023-12-20T04:47:05.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.560+0000 7f7a6d59a640 1 -- 172.21.15.132:0/747851521 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a64031990 con 0x7f7a700d0370 2023-12-20T04:47:05.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.560+0000 7f7a6d59a640 1 -- 172.21.15.132:0/747851521 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a64031d20 con 0x7f7a700d0370 2023-12-20T04:47:05.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.560+0000 7f7a74d39640 1 -- 172.21.15.132:0/747851521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a700d0370 msgr2=0x7f7a700b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:05.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.560+0000 7f7a74d39640 1 --2- 172.21.15.132:0/747851521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a700d0370 0x7f7a700b2a50 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f7a640097a0 tx=0x7f7a6402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.561+0000 7f7a74d39640 1 -- 172.21.15.132:0/747851521 shutdown_connections 2023-12-20T04:47:05.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.561+0000 7f7a74d39640 1 --2- 172.21.15.132:0/747851521 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a700cdc10 0x7f7a7006c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.561+0000 7f7a74d39640 1 --2- 172.21.15.132:0/747851521 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a700d0370 0x7f7a700b2a50 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.561+0000 7f7a74d39640 1 -- 172.21.15.132:0/747851521 >> 172.21.15.132:0/747851521 conn(0x7f7a7006d7c0 msgr2=0x7f7a7006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:05.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.561+0000 7f7a74d39640 1 -- 172.21.15.132:0/747851521 shutdown_connections 2023-12-20T04:47:05.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.561+0000 7f7a74d39640 1 -- 172.21.15.132:0/747851521 wait complete. 2023-12-20T04:47:05.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.562+0000 7f7a74d39640 1 Processor -- start 2023-12-20T04:47:05.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.562+0000 7f7a74d39640 1 -- start start 2023-12-20T04:47:05.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.563+0000 7f7a74d39640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a700cdc10 0x7f7a700b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:05.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.563+0000 7f7a74d39640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a700d0370 0x7f7a700ca600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:05.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.563+0000 7f7a74d39640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a7015d100 0x7f7a700c65c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:05.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.563+0000 7f7a74d39640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a700c5890 con 0x7f7a7015d100 2023-12-20T04:47:05.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.563+0000 7f7a74d39640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a70160390 con 0x7f7a700d0370 2023-12-20T04:47:05.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.563+0000 7f7a74d39640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7a700c5ae0 con 0x7f7a700cdc10 2023-12-20T04:47:05.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.563+0000 7f7a6ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a7015d100 0x7f7a700c65c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:05.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.563+0000 7f7a6ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a7015d100 0x7f7a700c65c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57736/0 (socket says 172.21.15.132:57736) 2023-12-20T04:47:05.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.563+0000 7f7a6ed9d640 1 -- 172.21.15.132:0/3701500178 learned_addr learned my addr 172.21.15.132:0/3701500178 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:05.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.563+0000 7f7a6dd9b640 1 --2- 172.21.15.132:0/3701500178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a700d0370 0x7f7a700ca600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:05.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.563+0000 7f7a6e59c640 1 --2- 172.21.15.132:0/3701500178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a700cdc10 0x7f7a700b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:05.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.563+0000 7f7a6ed9d640 1 -- 172.21.15.132:0/3701500178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a700cdc10 msgr2=0x7f7a700b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:05.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.563+0000 7f7a6ed9d640 1 --2- 172.21.15.132:0/3701500178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a700cdc10 0x7f7a700b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.563+0000 7f7a6ed9d640 1 -- 172.21.15.132:0/3701500178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a700d0370 msgr2=0x7f7a700ca600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:05.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.563+0000 7f7a6ed9d640 1 --2- 172.21.15.132:0/3701500178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a700d0370 0x7f7a700ca600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.563+0000 7f7a6ed9d640 1 -- 172.21.15.132:0/3701500178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a68009400 con 0x7f7a7015d100 2023-12-20T04:47:05.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.563+0000 7f7a6ed9d640 1 --2- 172.21.15.132:0/3701500178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a7015d100 0x7f7a700c65c0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800e930 tx=0x7f7a6800edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:05.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.564+0000 7f7a5effd640 1 -- 172.21.15.132:0/3701500178 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a68009700 con 0x7f7a7015d100 2023-12-20T04:47:05.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.564+0000 7f7a5effd640 1 -- 172.21.15.132:0/3701500178 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a6800ca00 con 0x7f7a7015d100 2023-12-20T04:47:05.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.564+0000 7f7a74d39640 1 -- 172.21.15.132:0/3701500178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a64009400 con 0x7f7a7015d100 2023-12-20T04:47:05.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.564+0000 7f7a5effd640 1 -- 172.21.15.132:0/3701500178 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a6800cd90 con 0x7f7a7015d100 2023-12-20T04:47:05.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.564+0000 7f7a74d39640 1 -- 172.21.15.132:0/3701500178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a700c60a0 con 0x7f7a7015d100 2023-12-20T04:47:05.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.564+0000 7f7a74d39640 1 -- 172.21.15.132:0/3701500178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a700c6290 con 0x7f7a7015d100 2023-12-20T04:47:05.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.565+0000 7f7a5effd640 1 -- 172.21.15.132:0/3701500178 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7a68013470 con 0x7f7a7015d100 2023-12-20T04:47:05.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.565+0000 7f7a5effd640 1 --2- 172.21.15.132:0/3701500178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a5006a430 0x7f7a5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:05.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.565+0000 7f7a5effd640 1 -- 172.21.15.132:0/3701500178 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7a68088120 con 0x7f7a7015d100 2023-12-20T04:47:05.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.565+0000 7f7a6e59c640 1 --2- 172.21.15.132:0/3701500178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a5006a430 0x7f7a5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:05.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.566+0000 7f7a6e59c640 1 --2- 172.21.15.132:0/3701500178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a5006a430 0x7f7a5006c8f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7a600012e0 tx=0x7f7a60001990 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:05.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.570+0000 7f7a5effd640 1 -- 172.21.15.132:0/3701500178 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7a68053c10 con 0x7f7a7015d100 2023-12-20T04:47:05.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.798+0000 7f7a74d39640 1 -- 172.21.15.132:0/3701500178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]} v 0) v1 -- 0x7f7a7004e840 con 0x7f7a7015d100 2023-12-20T04:47:05.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.930+0000 7f7a5effd640 1 -- 172.21.15.132:0/3701500178 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_fsync"]}]=0 v233) v1 ==== 133+0+0 (secure 0 0 0) 0x7f7a68057230 con 0x7f7a7015d100 2023-12-20T04:47:05.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.932+0000 7f7a74d39640 1 -- 172.21.15.132:0/3701500178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a5006a430 msgr2=0x7f7a5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:05.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.932+0000 7f7a74d39640 1 --2- 172.21.15.132:0/3701500178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a5006a430 0x7f7a5006c8f0 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f7a600012e0 tx=0x7f7a60001990 comp rx=0 tx=0).stop 2023-12-20T04:47:05.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.932+0000 7f7a74d39640 1 -- 172.21.15.132:0/3701500178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a7015d100 msgr2=0x7f7a700c65c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:05.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.932+0000 7f7a74d39640 1 --2- 172.21.15.132:0/3701500178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a7015d100 0x7f7a700c65c0 secure :-1 s=READY pgs=981 cs=0 l=1 rev1=1 crypto rx=0x7f7a6800e930 tx=0x7f7a6800edf0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.932+0000 7f7a74d39640 1 -- 172.21.15.132:0/3701500178 shutdown_connections 2023-12-20T04:47:05.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.932+0000 7f7a74d39640 1 --2- 172.21.15.132:0/3701500178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a5006a430 0x7f7a5006c8f0 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.932+0000 7f7a74d39640 1 --2- 172.21.15.132:0/3701500178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7a7015d100 0x7f7a700c65c0 unknown :-1 s=CLOSED pgs=981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.932+0000 7f7a74d39640 1 --2- 172.21.15.132:0/3701500178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7a700d0370 0x7f7a700ca600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.932+0000 7f7a74d39640 1 --2- 172.21.15.132:0/3701500178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7a700cdc10 0x7f7a700b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:05.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.932+0000 7f7a74d39640 1 -- 172.21.15.132:0/3701500178 >> 172.21.15.132:0/3701500178 conn(0x7f7a7006d7c0 msgr2=0x7f7a700cb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:05.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.932+0000 7f7a74d39640 1 -- 172.21.15.132:0/3701500178 shutdown_connections 2023-12-20T04:47:05.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:05.932+0000 7f7a74d39640 1 -- 172.21.15.132:0/3701500178 wait complete. 2023-12-20T04:47:05.945 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-12-20T04:47:05.945 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestClusterFull) 2023-12-20T04:47:05.945 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-12-20T04:47:06.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.043+0000 7f84f213c640 1 Processor -- start 2023-12-20T04:47:06.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.043+0000 7f84f213c640 1 -- start start 2023-12-20T04:47:06.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.044+0000 7f84f213c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f84ec0ce950 0x7f84ec0b0d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:06.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.044+0000 7f84f213c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ec0c98e0 con 0x7f84ec0ca610 2023-12-20T04:47:06.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.044+0000 7f84f213c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84ec0b20e0 con 0x7f84ec06b600 2023-12-20T04:47:06.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.044+0000 7f84f213c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84ec0b1610 con 0x7f84ec0ce950 2023-12-20T04:47:06.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.044+0000 7f84eaffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f84ec0ce950 0x7f84ec0b0d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:06.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.044+0000 7f84ebfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f84ec0ca610 0x7f84ec0caaa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45506/0 (socket says 172.21.15.132:45506) 2023-12-20T04:47:06.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.044+0000 7f84ebfff640 1 -- 172.21.15.132:0/257487112 learned_addr learned my addr 172.21.15.132:0/257487112 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:06.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.044+0000 7f84eaffd640 1 -- 172.21.15.132:0/257487112 >> v1:172.21.15.187:6789/0 conn(0x7f84ec06b600 legacy=0x7f84ec06b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:06.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.044+0000 7f84eaffd640 1 -- 172.21.15.132:0/257487112 >> v1:172.21.15.132:6789/0 conn(0x7f84ec0ca610 legacy=0x7f84ec0caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:06.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.044+0000 7f84ea7fc640 1 -- 172.21.15.132:0/257487112 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2921148727 0 0) 0x7f84ec0c98e0 con 0x7f84ec0ca610 2023-12-20T04:47:06.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.044+0000 7f84eaffd640 1 -- 172.21.15.132:0/257487112 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84ec0c9b30 con 0x7f84ec0ce950 2023-12-20T04:47:06.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.045+0000 7f84eaffd640 1 --2- 172.21.15.132:0/257487112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84ec0ce950 0x7f84ec0b0d10 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f84e00097d0 tx=0x7f84e002b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c40e1e2a65878fbb server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:06.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.045+0000 7f84ea7fc640 1 -- 172.21.15.132:0/257487112 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0030610 con 0x7f84ec0ce950 2023-12-20T04:47:06.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.045+0000 7f84ea7fc640 1 -- 172.21.15.132:0/257487112 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e0030770 con 0x7f84ec0ce950 2023-12-20T04:47:06.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.045+0000 7f84ea7fc640 1 -- 172.21.15.132:0/257487112 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0030b00 con 0x7f84ec0ce950 2023-12-20T04:47:06.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.046+0000 7f84f213c640 1 -- 172.21.15.132:0/257487112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84ec0ce950 msgr2=0x7f84ec0b0d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:06.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.046+0000 7f84f213c640 1 --2- 172.21.15.132:0/257487112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84ec0ce950 0x7f84ec0b0d10 secure :-1 s=READY pgs=983 cs=0 l=1 rev1=1 crypto rx=0x7f84e00097d0 tx=0x7f84e002b960 comp rx=0 tx=0).stop 2023-12-20T04:47:06.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.046+0000 7f84f213c640 1 -- 172.21.15.132:0/257487112 shutdown_connections 2023-12-20T04:47:06.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.046+0000 7f84f213c640 1 --2- 172.21.15.132:0/257487112 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84ec0ce950 0x7f84ec0b0d10 unknown :-1 s=CLOSED pgs=983 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:06.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.046+0000 7f84f213c640 1 -- 172.21.15.132:0/257487112 >> 172.21.15.132:0/257487112 conn(0x7f84ec0cbd10 msgr2=0x7f84ec0cc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:06.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.046+0000 7f84f213c640 1 -- 172.21.15.132:0/257487112 shutdown_connections 2023-12-20T04:47:06.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.046+0000 7f84f213c640 1 -- 172.21.15.132:0/257487112 wait complete. 2023-12-20T04:47:06.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.047+0000 7f84f213c640 1 Processor -- start 2023-12-20T04:47:06.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.047+0000 7f84f213c640 1 -- start start 2023-12-20T04:47:06.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84f213c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84ec06b600 0x7f84ec15b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:06.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84f213c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84ec0ca610 0x7f84ec0c3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:06.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84f213c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84ec0ce950 0x7f84ec0c3c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:06.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84f213c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0c41d0 con 0x7f84ec0ca610 2023-12-20T04:47:06.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84f213c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0b0700 con 0x7f84ec06b600 2023-12-20T04:47:06.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84f213c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84ec0afb80 con 0x7f84ec0ce950 2023-12-20T04:47:06.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84eaffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84ec0ca610 0x7f84ec0c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:06.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84eaffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84ec0ca610 0x7f84ec0c3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57756/0 (socket says 172.21.15.132:57756) 2023-12-20T04:47:06.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84eaffd640 1 -- 172.21.15.132:0/566813989 learned_addr learned my addr 172.21.15.132:0/566813989 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:06.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84eb7fe640 1 --2- 172.21.15.132:0/566813989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84ec06b600 0x7f84ec15b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:06.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84ebfff640 1 --2- 172.21.15.132:0/566813989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84ec0ce950 0x7f84ec0c3c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:06.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84eaffd640 1 -- 172.21.15.132:0/566813989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84ec0ce950 msgr2=0x7f84ec0c3c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:06.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84eaffd640 1 --2- 172.21.15.132:0/566813989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84ec0ce950 0x7f84ec0c3c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:06.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84eaffd640 1 -- 172.21.15.132:0/566813989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84ec06b600 msgr2=0x7f84ec15b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:06.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84eaffd640 1 --2- 172.21.15.132:0/566813989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84ec06b600 0x7f84ec15b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:06.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84eaffd640 1 -- 172.21.15.132:0/566813989 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e0009400 con 0x7f84ec0ca610 2023-12-20T04:47:06.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84ebfff640 1 --2- 172.21.15.132:0/566813989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84ec0ce950 0x7f84ec0c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:06.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84eaffd640 1 --2- 172.21.15.132:0/566813989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84ec0ca610 0x7f84ec0c3750 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f84e00098f0 tx=0x7f84e00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:06.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.048+0000 7f84d3fff640 1 -- 172.21.15.132:0/566813989 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e003e070 con 0x7f84ec0ca610 2023-12-20T04:47:06.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.049+0000 7f84d3fff640 1 -- 172.21.15.132:0/566813989 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e0039a10 con 0x7f84ec0ca610 2023-12-20T04:47:06.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.049+0000 7f84f213c640 1 -- 172.21.15.132:0/566813989 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84ec0afe60 con 0x7f84ec0ca610 2023-12-20T04:47:06.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.049+0000 7f84d3fff640 1 -- 172.21.15.132:0/566813989 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e0039da0 con 0x7f84ec0ca610 2023-12-20T04:47:06.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.049+0000 7f84f213c640 1 -- 172.21.15.132:0/566813989 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84ec0b0420 con 0x7f84ec0ca610 2023-12-20T04:47:06.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.049+0000 7f84f213c640 1 -- 172.21.15.132:0/566813989 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84ec1f33d0 con 0x7f84ec0ca610 2023-12-20T04:47:06.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.050+0000 7f84d3fff640 1 -- 172.21.15.132:0/566813989 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f84e004b400 con 0x7f84ec0ca610 2023-12-20T04:47:06.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.050+0000 7f84d3fff640 1 --2- 172.21.15.132:0/566813989 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f84d806a430 0x7f84d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:06.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.050+0000 7f84d3fff640 1 -- 172.21.15.132:0/566813989 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f84e00aaa10 con 0x7f84ec0ca610 2023-12-20T04:47:06.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.050+0000 7f84eb7fe640 1 --2- 172.21.15.132:0/566813989 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f84d806a430 0x7f84d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:06.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.051+0000 7f84eb7fe640 1 --2- 172.21.15.132:0/566813989 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f84d806a430 0x7f84d806c8f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f84ec0b0a60 tx=0x7f84dc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:06.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.054+0000 7f84d3fff640 1 -- 172.21.15.132:0/566813989 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f84ec1f33d0 con 0x7f84ec0ca610 2023-12-20T04:47:06.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.283+0000 7f84f213c640 1 -- 172.21.15.132:0/566813989 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f84ec1f33d0 con 0x7f84ec0ca610 2023-12-20T04:47:06.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.934+0000 7f84d3fff640 1 -- 172.21.15.132:0/566813989 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v234) v1 ==== 140+0+0 (secure 0 0 0) 0x7f84ec1f33d0 con 0x7f84ec0ca610 2023-12-20T04:47:06.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.936+0000 7f84f213c640 1 -- 172.21.15.132:0/566813989 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f84d806a430 msgr2=0x7f84d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:06.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.936+0000 7f84f213c640 1 --2- 172.21.15.132:0/566813989 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f84d806a430 0x7f84d806c8f0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f84ec0b0a60 tx=0x7f84dc009040 comp rx=0 tx=0).stop 2023-12-20T04:47:06.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.936+0000 7f84f213c640 1 -- 172.21.15.132:0/566813989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84ec0ca610 msgr2=0x7f84ec0c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:06.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.936+0000 7f84f213c640 1 --2- 172.21.15.132:0/566813989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84ec0ca610 0x7f84ec0c3750 secure :-1 s=READY pgs=984 cs=0 l=1 rev1=1 crypto rx=0x7f84e00098f0 tx=0x7f84e00046c0 comp rx=0 tx=0).stop 2023-12-20T04:47:06.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.936+0000 7f84f213c640 1 -- 172.21.15.132:0/566813989 shutdown_connections 2023-12-20T04:47:06.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.936+0000 7f84f213c640 1 --2- 172.21.15.132:0/566813989 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f84d806a430 0x7f84d806c8f0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:06.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.936+0000 7f84f213c640 1 --2- 172.21.15.132:0/566813989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84ec0ce950 0x7f84ec0c3c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:06.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.936+0000 7f84f213c640 1 --2- 172.21.15.132:0/566813989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84ec0ca610 0x7f84ec0c3750 unknown :-1 s=CLOSED pgs=984 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:06.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.936+0000 7f84f213c640 1 --2- 172.21.15.132:0/566813989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84ec06b600 0x7f84ec15b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:06.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.936+0000 7f84f213c640 1 -- 172.21.15.132:0/566813989 >> 172.21.15.132:0/566813989 conn(0x7f84ec0cbd10 msgr2=0x7f84ec06b9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:06.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.936+0000 7f84f213c640 1 -- 172.21.15.132:0/566813989 shutdown_connections 2023-12-20T04:47:06.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:06.936+0000 7f84f213c640 1 -- 172.21.15.132:0/566813989 wait complete. 2023-12-20T04:47:06.950 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_objectstore 2023-12-20T04:47:07.063 INFO:teuthology.orchestra.run.smithi132.stdout:{"osd_objectstore":"memstore"} 2023-12-20T04:47:07.064 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_objectstore": "memstore" } 2023-12-20T04:47:07.064 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-20T04:47:07.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.168+0000 7f7eb9516640 1 Processor -- start 2023-12-20T04:47:07.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.168+0000 7f7eb9516640 1 -- start start 2023-12-20T04:47:07.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.169+0000 7f7eb9516640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eb4069c30 0x7f7eb4070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:07.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.169+0000 7f7eb9516640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb40c4f40 con 0x7f7eb40cbde0 2023-12-20T04:47:07.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.169+0000 7f7eb9516640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7eb40af5b0 con 0x7f7eb415d360 2023-12-20T04:47:07.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.169+0000 7f7eb9516640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4070a40 con 0x7f7eb4069c30 2023-12-20T04:47:07.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.169+0000 7f7eb37fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7eb40cbde0 0x7f7eb40ca170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:45516/0 (socket says 172.21.15.132:45516) 2023-12-20T04:47:07.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.169+0000 7f7eb37fe640 1 -- 172.21.15.132:0/641545360 learned_addr learned my addr 172.21.15.132:0/641545360 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:07.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.169+0000 7f7eb2ffd640 1 --2- 172.21.15.132:0/641545360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eb4069c30 0x7f7eb4070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:07.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb1ffb640 1 -- 172.21.15.132:0/641545360 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1735547327 0 0) 0x7f7eb40c4f40 con 0x7f7eb40cbde0 2023-12-20T04:47:07.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb1ffb640 1 -- 172.21.15.132:0/641545360 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e9c003520 con 0x7f7eb40cbde0 2023-12-20T04:47:07.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb1ffb640 1 -- 172.21.15.132:0/641545360 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3854534961 0 0) 0x7f7eb40af5b0 con 0x7f7eb415d360 2023-12-20T04:47:07.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb1ffb640 1 -- 172.21.15.132:0/641545360 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7eb40c4f40 con 0x7f7eb415d360 2023-12-20T04:47:07.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb1ffb640 1 -- 172.21.15.132:0/641545360 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2919631350 0 0) 0x7f7e9c003520 con 0x7f7eb40cbde0 2023-12-20T04:47:07.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb1ffb640 1 -- 172.21.15.132:0/641545360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eb4069c30 msgr2=0x7f7eb4070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:07.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb1ffb640 1 --2- 172.21.15.132:0/641545360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eb4069c30 0x7f7eb4070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb1ffb640 1 -- 172.21.15.132:0/641545360 >> v1:172.21.15.187:6789/0 conn(0x7f7eb415d360 legacy=0x7f7eb406a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:07.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb1ffb640 1 -- 172.21.15.132:0/641545360 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb4070d20 con 0x7f7eb40cbde0 2023-12-20T04:47:07.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb1ffb640 1 -- 172.21.15.132:0/641545360 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f7eac001670 con 0x7f7eb40cbde0 2023-12-20T04:47:07.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb1ffb640 1 -- 172.21.15.132:0/641545360 >> v1:172.21.15.132:6789/0 conn(0x7f7eb40cbde0 legacy=0x7f7eb40ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:07.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb1ffb640 1 --2- 172.21.15.132:0/641545360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e9c003b30 0x7f7e9c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:07.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb1ffb640 1 --2- 172.21.15.132:0/641545360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e9c0047c0 0x7f7e9c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:07.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb1ffb640 1 --2- 172.21.15.132:0/641545360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eb4069c30 0x7f7e9c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:07.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb1ffb640 1 -- 172.21.15.132:0/641545360 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb4070a40 con 0x7f7e9c0047c0 2023-12-20T04:47:07.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb1ffb640 1 -- 172.21.15.132:0/641545360 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c00ba30 con 0x7f7e9c003b30 2023-12-20T04:47:07.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb1ffb640 1 -- 172.21.15.132:0/641545360 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e9c00bbf0 con 0x7f7eb4069c30 2023-12-20T04:47:07.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb27fc640 1 --2- 172.21.15.132:0/641545360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e9c0047c0 0x7f7e9c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:07.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb2ffd640 1 --2- 172.21.15.132:0/641545360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e9c003b30 0x7f7e9c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:07.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb37fe640 1 --2- 172.21.15.132:0/641545360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eb4069c30 0x7f7e9c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:07.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb27fc640 1 -- 172.21.15.132:0/641545360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eb4069c30 msgr2=0x7f7e9c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:07.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb27fc640 1 --2- 172.21.15.132:0/641545360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eb4069c30 0x7f7e9c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb27fc640 1 -- 172.21.15.132:0/641545360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e9c003b30 msgr2=0x7f7e9c003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:07.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb27fc640 1 --2- 172.21.15.132:0/641545360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e9c003b30 0x7f7e9c003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb27fc640 1 -- 172.21.15.132:0/641545360 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e9c003520 con 0x7f7e9c0047c0 2023-12-20T04:47:07.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.170+0000 7f7eb2ffd640 1 --2- 172.21.15.132:0/641545360 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e9c003b30 0x7f7e9c003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:07.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.171+0000 7f7eb27fc640 1 --2- 172.21.15.132:0/641545360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e9c0047c0 0x7f7e9c004c40 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f7ea80018d0 tx=0x7f7e9c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d664b403814d67d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:07.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.171+0000 7f7eb1ffb640 1 -- 172.21.15.132:0/641545360 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea80052d0 con 0x7f7e9c0047c0 2023-12-20T04:47:07.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.171+0000 7f7eb1ffb640 1 -- 172.21.15.132:0/641545360 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea8005430 con 0x7f7e9c0047c0 2023-12-20T04:47:07.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.171+0000 7f7eb1ffb640 1 -- 172.21.15.132:0/641545360 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea8003810 con 0x7f7e9c0047c0 2023-12-20T04:47:07.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.172+0000 7f7eb9516640 1 -- 172.21.15.132:0/641545360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e9c0047c0 msgr2=0x7f7e9c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:07.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.172+0000 7f7eb9516640 1 --2- 172.21.15.132:0/641545360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e9c0047c0 0x7f7e9c004c40 secure :-1 s=READY pgs=986 cs=0 l=1 rev1=1 crypto rx=0x7f7ea80018d0 tx=0x7f7e9c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.172+0000 7f7eb37fe640 1 -- 172.21.15.132:0/641545360 reap_dead start 2023-12-20T04:47:07.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.172+0000 7f7eb9516640 1 -- 172.21.15.132:0/641545360 shutdown_connections 2023-12-20T04:47:07.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.172+0000 7f7eb9516640 1 -- 172.21.15.132:0/641545360 >> 172.21.15.132:0/641545360 conn(0x7f7eb40cc630 msgr2=0x7f7eb40cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:07.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.172+0000 7f7eb9516640 1 -- 172.21.15.132:0/641545360 shutdown_connections 2023-12-20T04:47:07.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.172+0000 7f7eb9516640 1 -- 172.21.15.132:0/641545360 wait complete. 2023-12-20T04:47:07.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.173+0000 7f7eb9516640 1 Processor -- start 2023-12-20T04:47:07.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.173+0000 7f7eb9516640 1 -- start start 2023-12-20T04:47:07.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb9516640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e9c0047c0 0x7f7eb40b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:07.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb9516640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7eb40ae1e0 0x7f7eb415f140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:07.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb9516640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eb415f680 0x7f7eb4154310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb9516640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40b39e0 con 0x7f7e9c0047c0 2023-12-20T04:47:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb9516640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb415fb70 con 0x7f7eb40ae1e0 2023-12-20T04:47:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb9516640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7eb40b3c80 con 0x7f7eb415f680 2023-12-20T04:47:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e9c0047c0 0x7f7eb40b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e9c0047c0 0x7f7eb40b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:57776/0 (socket says 172.21.15.132:57776) 2023-12-20T04:47:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb2ffd640 1 -- 172.21.15.132:0/1337150879 learned_addr learned my addr 172.21.15.132:0/1337150879 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb27fc640 1 --2- 172.21.15.132:0/1337150879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7eb40ae1e0 0x7f7eb415f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb37fe640 1 --2- 172.21.15.132:0/1337150879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eb415f680 0x7f7eb4154310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb2ffd640 1 -- 172.21.15.132:0/1337150879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eb415f680 msgr2=0x7f7eb4154310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb2ffd640 1 --2- 172.21.15.132:0/1337150879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eb415f680 0x7f7eb4154310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb2ffd640 1 -- 172.21.15.132:0/1337150879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7eb40ae1e0 msgr2=0x7f7eb415f140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb2ffd640 1 --2- 172.21.15.132:0/1337150879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7eb40ae1e0 0x7f7eb415f140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb2ffd640 1 -- 172.21.15.132:0/1337150879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7eb40b3f60 con 0x7f7e9c0047c0 2023-12-20T04:47:07.181 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb2ffd640 1 --2- 172.21.15.132:0/1337150879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e9c0047c0 0x7f7eb40b4480 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40101c0 tx=0x7f7ea4010680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7e9b7fe640 1 -- 172.21.15.132:0/1337150879 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea400e050 con 0x7f7e9c0047c0 2023-12-20T04:47:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7e9b7fe640 1 -- 172.21.15.132:0/1337150879 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ea400f040 con 0x7f7e9c0047c0 2023-12-20T04:47:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7eb9516640 1 -- 172.21.15.132:0/1337150879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7eb40b1ec0 con 0x7f7e9c0047c0 2023-12-20T04:47:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.174+0000 7f7e9b7fe640 1 -- 172.21.15.132:0/1337150879 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ea4003bb0 con 0x7f7e9c0047c0 2023-12-20T04:47:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.175+0000 7f7eb9516640 1 -- 172.21.15.132:0/1337150879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7eb40ae640 con 0x7f7e9c0047c0 2023-12-20T04:47:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.175+0000 7f7eb9516640 1 -- 172.21.15.132:0/1337150879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7eb40ae890 con 0x7f7e9c0047c0 2023-12-20T04:47:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.176+0000 7f7e9b7fe640 1 -- 172.21.15.132:0/1337150879 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7ea4003d10 con 0x7f7e9c0047c0 2023-12-20T04:47:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.176+0000 7f7e9b7fe640 1 --2- 172.21.15.132:0/1337150879 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ea006a430 0x7f7ea006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.176+0000 7f7e9b7fe640 1 -- 172.21.15.132:0/1337150879 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7ea4089400 con 0x7f7e9c0047c0 2023-12-20T04:47:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.176+0000 7f7eb27fc640 1 --2- 172.21.15.132:0/1337150879 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ea006a430 0x7f7ea006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:07.182 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.177+0000 7f7eb27fc640 1 --2- 172.21.15.132:0/1337150879 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ea006a430 0x7f7ea006c8f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8034000 tx=0x7f7ea8031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:07.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.181+0000 7f7e9b7fe640 1 -- 172.21.15.132:0/1337150879 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7ea4054cf0 con 0x7f7e9c0047c0 2023-12-20T04:47:07.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.346+0000 7f7eb9516640 1 -- 172.21.15.132:0/1337150879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f7eb40b40f0 con 0x7f7e9c0047c0 2023-12-20T04:47:07.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.352+0000 7f7e9b7fe640 1 -- 172.21.15.132:0/1337150879 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v10)=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7ea4058310 con 0x7f7e9c0047c0 2023-12-20T04:47:07.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.354+0000 7f7eb9516640 1 -- 172.21.15.132:0/1337150879 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ea006a430 msgr2=0x7f7ea006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:07.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.354+0000 7f7eb9516640 1 --2- 172.21.15.132:0/1337150879 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ea006a430 0x7f7ea006c8f0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f7ea8034000 tx=0x7f7ea8031000 comp rx=0 tx=0).stop 2023-12-20T04:47:07.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.354+0000 7f7eb9516640 1 -- 172.21.15.132:0/1337150879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e9c0047c0 msgr2=0x7f7eb40b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:07.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.354+0000 7f7eb9516640 1 --2- 172.21.15.132:0/1337150879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e9c0047c0 0x7f7eb40b4480 secure :-1 s=READY pgs=987 cs=0 l=1 rev1=1 crypto rx=0x7f7ea40101c0 tx=0x7f7ea4010680 comp rx=0 tx=0).stop 2023-12-20T04:47:07.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.354+0000 7f7eb9516640 1 -- 172.21.15.132:0/1337150879 shutdown_connections 2023-12-20T04:47:07.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.354+0000 7f7eb9516640 1 --2- 172.21.15.132:0/1337150879 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ea006a430 0x7f7ea006c8f0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.354+0000 7f7eb9516640 1 --2- 172.21.15.132:0/1337150879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7eb415f680 0x7f7eb4154310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.354+0000 7f7eb9516640 1 --2- 172.21.15.132:0/1337150879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7eb40ae1e0 0x7f7eb415f140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.354+0000 7f7eb9516640 1 --2- 172.21.15.132:0/1337150879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e9c0047c0 0x7f7eb40b4480 unknown :-1 s=CLOSED pgs=987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.354+0000 7f7eb9516640 1 -- 172.21.15.132:0/1337150879 >> 172.21.15.132:0/1337150879 conn(0x7f7eb40cc630 msgr2=0x7f7eb40ce940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:07.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.354+0000 7f7eb9516640 1 -- 172.21.15.132:0/1337150879 shutdown_connections 2023-12-20T04:47:07.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.354+0000 7f7eb9516640 1 -- 172.21.15.132:0/1337150879 wait complete. 2023-12-20T04:47:07.366 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:47:07.367 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:47:07.412 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:47:07.459 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:47:07.459 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:47:07.459 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:47:07.476 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:47:07.476 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:47:07.476 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:47:07.493 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:47:07.494 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:47:07.494 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:47:07.531 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:47:07.531 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:47:07.531 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:47:07.550 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:47:07.550 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-20T04:47:07.550 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:47:07.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.669+0000 7fe57170a640 1 Processor -- start 2023-12-20T04:47:07.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.669+0000 7fe57170a640 1 -- start start 2023-12-20T04:47:07.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.670+0000 7fe57170a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe56c15d4f0 0x7fe56c0aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:07.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.670+0000 7fe57170a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe56c0af040 0x7fe56c0c4f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:07.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.670+0000 7fe57170a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe56c0af470 con 0x7fe56c15d110 2023-12-20T04:47:07.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.670+0000 7fe57170a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56c161ce0 con 0x7fe56c15d4f0 2023-12-20T04:47:07.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.670+0000 7fe57170a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe56c0aca50 con 0x7fe56c0af040 2023-12-20T04:47:07.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.670+0000 7fe563fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe56c15d4f0 0x7fe56c0aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:07.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.670+0000 7fe563fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe56c15d4f0 0x7fe56c0aeb00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34634/0 (socket says 172.21.15.132:34634) 2023-12-20T04:47:07.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.670+0000 7fe563fff640 1 -- 172.21.15.132:0/1501969752 learned_addr learned my addr 172.21.15.132:0/1501969752 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:07.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.671+0000 7fe563fff640 1 -- 172.21.15.132:0/1501969752 >> v2:172.21.15.187:3300/0 conn(0x7fe56c0af040 msgr2=0x7fe56c0c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:07.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.671+0000 7fe56b7fe640 1 --2- 172.21.15.132:0/1501969752 >> v2:172.21.15.187:3300/0 conn(0x7fe56c0af040 0x7fe56c0c4f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:07.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.671+0000 7fe563fff640 1 --2- 172.21.15.132:0/1501969752 >> v2:172.21.15.187:3300/0 conn(0x7fe56c0af040 0x7fe56c0c4f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.671+0000 7fe563fff640 1 -- 172.21.15.132:0/1501969752 >> v1:172.21.15.187:6789/0 conn(0x7fe56c15d110 legacy=0x7fe56c069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:07.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.671+0000 7fe563fff640 1 -- 172.21.15.132:0/1501969752 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe56c160df0 con 0x7fe56c15d4f0 2023-12-20T04:47:07.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.671+0000 7fe563fff640 1 --2- 172.21.15.132:0/1501969752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56c15d4f0 0x7fe56c0aeb00 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0704f0 tx=0x7fe55402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b001246d77bee9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:07.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.671+0000 7fe56a7fc640 1 -- 172.21.15.132:0/1501969752 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554031870 con 0x7fe56c15d4f0 2023-12-20T04:47:07.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.672+0000 7fe56a7fc640 1 -- 172.21.15.132:0/1501969752 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe5540319d0 con 0x7fe56c15d4f0 2023-12-20T04:47:07.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.672+0000 7fe56a7fc640 1 -- 172.21.15.132:0/1501969752 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe554031d60 con 0x7fe56c15d4f0 2023-12-20T04:47:07.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.672+0000 7fe57170a640 1 -- 172.21.15.132:0/1501969752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56c15d4f0 msgr2=0x7fe56c0aeb00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.672+0000 7fe57170a640 1 --2- 172.21.15.132:0/1501969752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56c15d4f0 0x7fe56c0aeb00 secure :-1 s=READY pgs=988 cs=0 l=1 rev1=1 crypto rx=0x7fe56c0704f0 tx=0x7fe55402b910 comp rx=0 tx=0).stop 2023-12-20T04:47:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.672+0000 7fe57170a640 1 -- 172.21.15.132:0/1501969752 shutdown_connections 2023-12-20T04:47:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.672+0000 7fe57170a640 1 --2- 172.21.15.132:0/1501969752 >> v2:172.21.15.187:3300/0 conn(0x7fe56c0af040 0x7fe56c0c4f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.672+0000 7fe57170a640 1 --2- 172.21.15.132:0/1501969752 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56c15d4f0 0x7fe56c0aeb00 unknown :-1 s=CLOSED pgs=988 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.672+0000 7fe57170a640 1 -- 172.21.15.132:0/1501969752 >> 172.21.15.132:0/1501969752 conn(0x7fe56c0cfbd0 msgr2=0x7fe56c0cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.672+0000 7fe57170a640 1 -- 172.21.15.132:0/1501969752 shutdown_connections 2023-12-20T04:47:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.672+0000 7fe57170a640 1 -- 172.21.15.132:0/1501969752 wait complete. 2023-12-20T04:47:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.673+0000 7fe57170a640 1 Processor -- start 2023-12-20T04:47:07.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.673+0000 7fe57170a640 1 -- start start 2023-12-20T04:47:07.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.674+0000 7fe57170a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56c0af040 0x7fe56c0ad230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.674+0000 7fe57170a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe56c15d110 0x7fe56c0c7a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.674+0000 7fe57170a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe56c15d4f0 0x7fe56c0c7f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.674+0000 7fe57170a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c1f6180 con 0x7fe56c0af040 2023-12-20T04:47:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.674+0000 7fe57170a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c0c6f40 con 0x7fe56c15d110 2023-12-20T04:47:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.674+0000 7fe57170a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c1f3470 con 0x7fe56c15d4f0 2023-12-20T04:47:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.674+0000 7fe56affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56c0af040 0x7fe56c0ad230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.674+0000 7fe56affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56c0af040 0x7fe56c0ad230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34642/0 (socket says 172.21.15.132:34642) 2023-12-20T04:47:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.674+0000 7fe56affd640 1 -- 172.21.15.132:0/3932259319 learned_addr learned my addr 172.21.15.132:0/3932259319 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.674+0000 7fe56affd640 1 -- 172.21.15.132:0/3932259319 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe56c15d4f0 msgr2=0x7fe56c0c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.674+0000 7fe56affd640 1 --2- 172.21.15.132:0/3932259319 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe56c15d4f0 0x7fe56c0c7f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.674+0000 7fe56affd640 1 -- 172.21.15.132:0/3932259319 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe56c15d110 msgr2=0x7fe56c0c7a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:07.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.674+0000 7fe56affd640 1 --2- 172.21.15.132:0/3932259319 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe56c15d110 0x7fe56c0c7a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.674+0000 7fe56affd640 1 -- 172.21.15.132:0/3932259319 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5540094d0 con 0x7fe56c0af040 2023-12-20T04:47:07.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.674+0000 7fe56affd640 1 --2- 172.21.15.132:0/3932259319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56c0af040 0x7fe56c0ad230 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00b3c0 tx=0x7fe55c00b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:07.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.675+0000 7fe5637fe640 1 -- 172.21.15.132:0/3932259319 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c015070 con 0x7fe56c0af040 2023-12-20T04:47:07.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.675+0000 7fe5637fe640 1 -- 172.21.15.132:0/3932259319 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe55c005920 con 0x7fe56c0af040 2023-12-20T04:47:07.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.675+0000 7fe57170a640 1 -- 172.21.15.132:0/3932259319 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56c1f3750 con 0x7fe56c0af040 2023-12-20T04:47:07.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.675+0000 7fe5637fe640 1 -- 172.21.15.132:0/3932259319 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe55c005d30 con 0x7fe56c0af040 2023-12-20T04:47:07.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.675+0000 7fe57170a640 1 -- 172.21.15.132:0/3932259319 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56c0c74e0 con 0x7fe56c0af040 2023-12-20T04:47:07.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.676+0000 7fe57170a640 1 -- 172.21.15.132:0/3932259319 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56c0c76d0 con 0x7fe56c0af040 2023-12-20T04:47:07.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.676+0000 7fe5637fe640 1 -- 172.21.15.132:0/3932259319 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe55c005fd0 con 0x7fe56c0af040 2023-12-20T04:47:07.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.677+0000 7fe5637fe640 1 --2- 172.21.15.132:0/3932259319 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe54c06a430 0x7fe54c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:07.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.677+0000 7fe563fff640 1 --2- 172.21.15.132:0/3932259319 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe54c06a430 0x7fe54c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:07.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.677+0000 7fe5637fe640 1 -- 172.21.15.132:0/3932259319 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(92..92 src has 1..92) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe55c087c80 con 0x7fe56c0af040 2023-12-20T04:47:07.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.677+0000 7fe563fff640 1 --2- 172.21.15.132:0/3932259319 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe54c06a430 0x7fe54c06c8f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe554036000 tx=0x7fe554030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:07.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.681+0000 7fe5637fe640 1 -- 172.21.15.132:0/3932259319 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe55c053600 con 0x7fe56c0af040 2023-12-20T04:47:07.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.883+0000 7fe57170a640 1 -- 172.21.15.132:0/3932259319 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe56c04e840 con 0x7fe56c0af040 2023-12-20T04:47:07.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.883+0000 7fe5637fe640 1 -- 172.21.15.132:0/3932259319 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 34 v34) v1 ==== 94+0+3535 (secure 0 0 0) 0x7fe55c056c20 con 0x7fe56c0af040 2023-12-20T04:47:07.886 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:07.886 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":34,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5480,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2337953767","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":2337953767},{"type":"v1","addr":"172.21.15.187:6835","nonce":2337953767}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6121,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/2696956266","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":2696956266},{"type":"v1","addr":"172.21.15.187:6833","nonce":2696956266}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":34},{"gid":6540,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/41640576","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":41640576},{"type":"v1","addr":"172.21.15.132:6836","nonce":41640576}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29},{"gid":6543,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2936157584","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2936157584},{"type":"v1","addr":"172.21.15.132:6837","nonce":2936157584}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":29}],"filesystems":[]} 2023-12-20T04:47:07.886 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 34 2023-12-20T04:47:07.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.885+0000 7fe57170a640 1 -- 172.21.15.132:0/3932259319 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe54c06a430 msgr2=0x7fe54c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:07.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.885+0000 7fe57170a640 1 --2- 172.21.15.132:0/3932259319 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe54c06a430 0x7fe54c06c8f0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7fe554036000 tx=0x7fe554030000 comp rx=0 tx=0).stop 2023-12-20T04:47:07.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.885+0000 7fe57170a640 1 -- 172.21.15.132:0/3932259319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56c0af040 msgr2=0x7fe56c0ad230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:07.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.885+0000 7fe57170a640 1 --2- 172.21.15.132:0/3932259319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56c0af040 0x7fe56c0ad230 secure :-1 s=READY pgs=989 cs=0 l=1 rev1=1 crypto rx=0x7fe55c00b3c0 tx=0x7fe55c00b880 comp rx=0 tx=0).stop 2023-12-20T04:47:07.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.885+0000 7fe57170a640 1 -- 172.21.15.132:0/3932259319 shutdown_connections 2023-12-20T04:47:07.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.885+0000 7fe57170a640 1 --2- 172.21.15.132:0/3932259319 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe54c06a430 0x7fe54c06c8f0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.885+0000 7fe57170a640 1 --2- 172.21.15.132:0/3932259319 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe56c15d4f0 0x7fe56c0c7f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.885+0000 7fe57170a640 1 --2- 172.21.15.132:0/3932259319 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe56c15d110 0x7fe56c0c7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.885+0000 7fe57170a640 1 --2- 172.21.15.132:0/3932259319 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe56c0af040 0x7fe56c0ad230 unknown :-1 s=CLOSED pgs=989 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:07.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.885+0000 7fe57170a640 1 -- 172.21.15.132:0/3932259319 >> 172.21.15.132:0/3932259319 conn(0x7fe56c0cfbd0 msgr2=0x7fe56c06eab0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:07.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.886+0000 7fe57170a640 1 -- 172.21.15.132:0/3932259319 shutdown_connections 2023-12-20T04:47:07.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:07.886+0000 7fe57170a640 1 -- 172.21.15.132:0/3932259319 wait complete. 2023-12-20T04:47:07.899 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-20T04:47:07.899 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-20T04:47:07.899 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-20T04:47:07.899 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:47:07.899 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-20T04:47:07.899 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-20T04:47:07.900 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-20T04:47:07.900 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:47:07.900 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-20T04:47:07.900 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-20T04:47:07.900 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-20T04:47:07.900 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:47:07.901 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-20T04:47:07.901 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-20T04:47:07.901 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-20T04:47:07.901 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:47:07.908 INFO:tasks.ceph.mds.a:Stopped 2023-12-20T04:47:07.908 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-20T04:47:07.909 INFO:tasks.ceph.mds.c:Stopped 2023-12-20T04:47:07.910 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-20T04:47:07.912 INFO:tasks.ceph.mds.b:Stopped 2023-12-20T04:47:07.912 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-20T04:47:07.913 INFO:tasks.ceph.mds.d:Stopped 2023-12-20T04:47:07.913 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-20T04:47:07.951 INFO:tasks.ceph.mds.a:Started 2023-12-20T04:47:07.951 DEBUG:teuthology.parallel:result is None 2023-12-20T04:47:07.952 INFO:tasks.ceph.mds.c:Started 2023-12-20T04:47:07.952 DEBUG:teuthology.parallel:result is None 2023-12-20T04:47:07.955 INFO:tasks.ceph.mds.b:Started 2023-12-20T04:47:07.955 DEBUG:teuthology.parallel:result is None 2023-12-20T04:47:07.955 INFO:tasks.ceph.mds.d:Started 2023-12-20T04:47:07.956 DEBUG:teuthology.parallel:result is None 2023-12-20T04:47:07.956 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-20T04:47:08.027 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-12-20T04:47:08.027 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-12-20T04:47:08.028 INFO:tasks.ceph.mds.a.smithi132.stderr:2023-12-20T04:47:08.026+0000 7f8502901640 -1 PosixStack listen unable to listen on v2:0.0.0.0:6834/0: (98) Address already in use 2023-12-20T04:47:08.038 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-12-20T04:47:08.039 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-12-20T04:47:08.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.059+0000 7fc6b2f92640 1 Processor -- start 2023-12-20T04:47:08.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.059+0000 7fc6b2f92640 1 -- start start 2023-12-20T04:47:08.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.059+0000 7fc6b2f92640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6ac143700 0x7fc6ac0704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:08.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.060+0000 7fc6b152f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc6ac15e1c0 0x7fc6ac0cb000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35494/0 (socket says 172.21.15.132:35494) 2023-12-20T04:47:08.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.060+0000 7fc6b152f640 1 -- 172.21.15.132:0/533351910 learned_addr learned my addr 172.21.15.132:0/533351910 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:08.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.060+0000 7fc6b2f92640 1 -- 172.21.15.132:0/533351910 --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac143ae0 con 0x7fc6ac15e1c0 2023-12-20T04:47:08.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.060+0000 7fc6b0d2e640 1 --2- 172.21.15.132:0/533351910 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6ac143700 0x7fc6ac0704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:08.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.060+0000 7fc6b2f92640 1 -- 172.21.15.132:0/533351910 --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6ac15e7e0 con 0x7fc6ac070a30 2023-12-20T04:47:08.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.060+0000 7fc6b2f92640 1 -- 172.21.15.132:0/533351910 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac070eb0 con 0x7fc6ac143700 2023-12-20T04:47:08.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.060+0000 7fc6ab7fe640 1 -- 172.21.15.132:0/533351910 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 781060822 0 0) 0x7fc6ac143ae0 con 0x7fc6ac15e1c0 2023-12-20T04:47:08.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.060+0000 7fc6ab7fe640 1 -- 172.21.15.132:0/533351910 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc69c003520 con 0x7fc6ac15e1c0 2023-12-20T04:47:08.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.060+0000 7fc6b0d2e640 1 -- 172.21.15.132:0/533351910 >> v1:172.21.15.187:6789/0 conn(0x7fc6ac070a30 legacy=0x7fc6ac15dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:08.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.060+0000 7fc6b0d2e640 1 -- 172.21.15.132:0/533351910 >> v1:172.21.15.132:6789/0 conn(0x7fc6ac15e1c0 legacy=0x7fc6ac0cb000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:08.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.060+0000 7fc6b0d2e640 1 -- 172.21.15.132:0/533351910 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6ac0c4a30 con 0x7fc6ac143700 2023-12-20T04:47:08.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.061+0000 7fc6b0d2e640 1 --2- 172.21.15.132:0/533351910 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6ac143700 0x7fc6ac0704f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00097d0 tx=0x7fc6a002b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b6acea2ac9d27a00 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:08.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.065+0000 7fc6ab7fe640 1 -- 172.21.15.132:0/533351910 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0031890 con 0x7fc6ac143700 2023-12-20T04:47:08.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.065+0000 7fc6ab7fe640 1 -- 172.21.15.132:0/533351910 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6a00319f0 con 0x7fc6ac143700 2023-12-20T04:47:08.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.065+0000 7fc6ab7fe640 1 -- 172.21.15.132:0/533351910 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6a0031d80 con 0x7fc6ac143700 2023-12-20T04:47:08.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.066+0000 7fc6b2f92640 1 -- 172.21.15.132:0/533351910 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6ac143700 msgr2=0x7fc6ac0704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:08.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.066+0000 7fc6b2f92640 1 --2- 172.21.15.132:0/533351910 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6ac143700 0x7fc6ac0704f0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7fc6a00097d0 tx=0x7fc6a002b930 comp rx=0 tx=0).stop 2023-12-20T04:47:08.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.066+0000 7fc6b2f92640 1 -- 172.21.15.132:0/533351910 shutdown_connections 2023-12-20T04:47:08.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.066+0000 7fc6b2f92640 1 --2- 172.21.15.132:0/533351910 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6ac143700 0x7fc6ac0704f0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:08.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.066+0000 7fc6b2f92640 1 -- 172.21.15.132:0/533351910 >> 172.21.15.132:0/533351910 conn(0x7fc6ac0cfb10 msgr2=0x7fc6ac0cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:08.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.066+0000 7fc6b2f92640 1 -- 172.21.15.132:0/533351910 shutdown_connections 2023-12-20T04:47:08.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.066+0000 7fc6b2f92640 1 -- 172.21.15.132:0/533351910 wait complete. 2023-12-20T04:47:08.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.068+0000 7fc6b2f92640 1 Processor -- start 2023-12-20T04:47:08.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.068+0000 7fc6b2f92640 1 -- start start 2023-12-20T04:47:08.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.068+0000 7fc6b2f92640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6ac070a30 0x7fc6ac1597d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:08.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.068+0000 7fc6b2f92640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6ac15e1c0 0x7fc6ac0ad920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:08.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.068+0000 7fc6b2f92640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6ac0ade60 0x7fc6ac0b2e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:08.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.068+0000 7fc6b2f92640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac141c30 con 0x7fc6ac15e1c0 2023-12-20T04:47:08.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.068+0000 7fc6b2f92640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac13bf50 con 0x7fc6ac070a30 2023-12-20T04:47:08.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.069+0000 7fc6b2f92640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6ac0ae2d0 con 0x7fc6ac0ade60 2023-12-20T04:47:08.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.069+0000 7fc6abfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6ac15e1c0 0x7fc6ac0ad920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:08.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.069+0000 7fc6abfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6ac15e1c0 0x7fc6ac0ad920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34666/0 (socket says 172.21.15.132:34666) 2023-12-20T04:47:08.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.069+0000 7fc6abfff640 1 -- 172.21.15.132:0/4291613929 learned_addr learned my addr 172.21.15.132:0/4291613929 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:08.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.069+0000 7fc6b152f640 1 --2- 172.21.15.132:0/4291613929 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6ac0ade60 0x7fc6ac0b2e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:08.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.069+0000 7fc6b0d2e640 1 --2- 172.21.15.132:0/4291613929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6ac070a30 0x7fc6ac1597d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:08.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.069+0000 7fc6abfff640 1 -- 172.21.15.132:0/4291613929 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6ac0ade60 msgr2=0x7fc6ac0b2e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:08.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.069+0000 7fc6abfff640 1 --2- 172.21.15.132:0/4291613929 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6ac0ade60 0x7fc6ac0b2e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:08.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.069+0000 7fc6abfff640 1 -- 172.21.15.132:0/4291613929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6ac070a30 msgr2=0x7fc6ac1597d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:08.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.069+0000 7fc6abfff640 1 --2- 172.21.15.132:0/4291613929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6ac070a30 0x7fc6ac1597d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:08.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.069+0000 7fc6abfff640 1 -- 172.21.15.132:0/4291613929 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6a0009400 con 0x7fc6ac15e1c0 2023-12-20T04:47:08.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.069+0000 7fc6abfff640 1 --2- 172.21.15.132:0/4291613929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6ac15e1c0 0x7fc6ac0ad920 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fc69800c480 tx=0x7fc69800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:08.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.073+0000 7fc6a97fa640 1 -- 172.21.15.132:0/4291613929 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6980052d0 con 0x7fc6ac15e1c0 2023-12-20T04:47:08.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.073+0000 7fc6b2f92640 1 -- 172.21.15.132:0/4291613929 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6ac13aeb0 con 0x7fc6ac15e1c0 2023-12-20T04:47:08.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.073+0000 7fc6a97fa640 1 -- 172.21.15.132:0/4291613929 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc698005430 con 0x7fc6ac15e1c0 2023-12-20T04:47:08.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.073+0000 7fc6a97fa640 1 -- 172.21.15.132:0/4291613929 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc698012870 con 0x7fc6ac15e1c0 2023-12-20T04:47:08.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.073+0000 7fc6b2f92640 1 -- 172.21.15.132:0/4291613929 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6ac13b470 con 0x7fc6ac15e1c0 2023-12-20T04:47:08.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.074+0000 7fc6b2f92640 1 -- 172.21.15.132:0/4291613929 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6ac04e840 con 0x7fc6ac15e1c0 2023-12-20T04:47:08.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.074+0000 7fc6a97fa640 1 -- 172.21.15.132:0/4291613929 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc6980129d0 con 0x7fc6ac15e1c0 2023-12-20T04:47:08.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.074+0000 7fc6a97fa640 1 --2- 172.21.15.132:0/4291613929 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc69006a460 0x7fc69006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:08.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.074+0000 7fc6a97fa640 1 -- 172.21.15.132:0/4291613929 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(96..96 src has 1..96) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc698088020 con 0x7fc6ac15e1c0 2023-12-20T04:47:08.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.074+0000 7fc6b0d2e640 1 --2- 172.21.15.132:0/4291613929 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc69006a460 0x7fc69006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:08.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.075+0000 7fc6b0d2e640 1 --2- 172.21.15.132:0/4291613929 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc69006a460 0x7fc69006c920 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0036000 tx=0x7fc6a003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:08.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.078+0000 7fc6a97fa640 1 -- 172.21.15.132:0/4291613929 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc6980539d0 con 0x7fc6ac15e1c0 2023-12-20T04:47:08.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:08.257+0000 7fc6b2f92640 1 -- 172.21.15.132:0/4291613929 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7fc6ac071770 con 0x7fc6ac15e1c0 2023-12-20T04:47:09.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.088+0000 7fc6a97fa640 1 -- 172.21.15.132:0/4291613929 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v97) v1 ==== 97+0+0 (secure 0 0 0) 0x7fc698056ff0 con 0x7fc6ac15e1c0 2023-12-20T04:47:09.090 INFO:teuthology.orchestra.run.smithi132.stderr: removed all blocklist entries 2023-12-20T04:47:09.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.090+0000 7fc6b2f92640 1 -- 172.21.15.132:0/4291613929 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc69006a460 msgr2=0x7fc69006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:09.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.090+0000 7fc6b2f92640 1 --2- 172.21.15.132:0/4291613929 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc69006a460 0x7fc69006c920 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7fc6a0036000 tx=0x7fc6a003c040 comp rx=0 tx=0).stop 2023-12-20T04:47:09.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.090+0000 7fc6b2f92640 1 -- 172.21.15.132:0/4291613929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6ac15e1c0 msgr2=0x7fc6ac0ad920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:09.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.090+0000 7fc6b2f92640 1 --2- 172.21.15.132:0/4291613929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6ac15e1c0 0x7fc6ac0ad920 secure :-1 s=READY pgs=998 cs=0 l=1 rev1=1 crypto rx=0x7fc69800c480 tx=0x7fc69800c940 comp rx=0 tx=0).stop 2023-12-20T04:47:09.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.090+0000 7fc6b2f92640 1 -- 172.21.15.132:0/4291613929 shutdown_connections 2023-12-20T04:47:09.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.090+0000 7fc6b2f92640 1 --2- 172.21.15.132:0/4291613929 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc69006a460 0x7fc69006c920 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.090+0000 7fc6b2f92640 1 --2- 172.21.15.132:0/4291613929 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc6ac0ade60 0x7fc6ac0b2e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.090+0000 7fc6b2f92640 1 --2- 172.21.15.132:0/4291613929 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6ac15e1c0 0x7fc6ac0ad920 unknown :-1 s=CLOSED pgs=998 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.090+0000 7fc6b2f92640 1 --2- 172.21.15.132:0/4291613929 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc6ac070a30 0x7fc6ac1597d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.090+0000 7fc6b2f92640 1 -- 172.21.15.132:0/4291613929 >> 172.21.15.132:0/4291613929 conn(0x7fc6ac0cfb10 msgr2=0x7fc6ac0cc090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:09.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.091+0000 7fc6b2f92640 1 -- 172.21.15.132:0/4291613929 shutdown_connections 2023-12-20T04:47:09.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.091+0000 7fc6b2f92640 1 -- 172.21.15.132:0/4291613929 wait complete. 2023-12-20T04:47:09.106 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-20T04:47:09.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.209+0000 7fb68e966640 1 Processor -- start 2023-12-20T04:47:09.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.209+0000 7fb68e966640 1 -- start start 2023-12-20T04:47:09.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.210+0000 7fb68e966640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb688160450 0x7fb688160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.210+0000 7fb68e966640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6880b5090 0x7fb6880d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.210+0000 7fb68e966640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb6880b5ec0 con 0x7fb6881611b0 2023-12-20T04:47:09.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.210+0000 7fb68e966640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb6881617e0 con 0x7fb688160450 2023-12-20T04:47:09.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.210+0000 7fb68e966640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb6880d0fc0 con 0x7fb6880b5090 2023-12-20T04:47:09.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.210+0000 7fb6877fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb6881611b0 0x7fb6880b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35500/0 (socket says 172.21.15.132:35500) 2023-12-20T04:47:09.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.210+0000 7fb6877fe640 1 -- 172.21.15.132:0/1388959422 learned_addr learned my addr 172.21.15.132:0/1388959422 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:09.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb686ffd640 1 -- 172.21.15.132:0/1388959422 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3671015797 0 0) 0x7fb6880b5ec0 con 0x7fb6881611b0 2023-12-20T04:47:09.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb686ffd640 1 -- 172.21.15.132:0/1388959422 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb670003520 con 0x7fb6881611b0 2023-12-20T04:47:09.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb68cf03640 1 --2- 172.21.15.132:0/1388959422 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6880b5090 0x7fb6880d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb687fff640 1 --2- 172.21.15.132:0/1388959422 >> v2:172.21.15.187:3300/0 conn(0x7fb688160450 0x7fb688160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb686ffd640 1 -- 172.21.15.132:0/1388959422 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 282247456 0 0) 0x7fb670003520 con 0x7fb6881611b0 2023-12-20T04:47:09.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb686ffd640 1 -- 172.21.15.132:0/1388959422 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6880b5090 msgr2=0x7fb6880d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:09.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb686ffd640 1 --2- 172.21.15.132:0/1388959422 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6880b5090 0x7fb6880d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb686ffd640 1 -- 172.21.15.132:0/1388959422 >> v2:172.21.15.187:3300/0 conn(0x7fb688160450 msgr2=0x7fb688160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:09.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb686ffd640 1 --2- 172.21.15.132:0/1388959422 >> v2:172.21.15.187:3300/0 conn(0x7fb688160450 0x7fb688160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb686ffd640 1 -- 172.21.15.132:0/1388959422 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6880d12a0 con 0x7fb6881611b0 2023-12-20T04:47:09.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb686ffd640 1 -- 172.21.15.132:0/1388959422 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fb67c001670 con 0x7fb6881611b0 2023-12-20T04:47:09.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb68cf03640 1 --2- 172.21.15.132:0/1388959422 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6880b5090 0x7fb6880d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:09.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb687fff640 1 --2- 172.21.15.132:0/1388959422 >> v2:172.21.15.187:3300/0 conn(0x7fb688160450 0x7fb688160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb686ffd640 1 -- 172.21.15.132:0/1388959422 >> v1:172.21.15.132:6789/0 conn(0x7fb6881611b0 legacy=0x7fb6880b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb686ffd640 1 --2- 172.21.15.132:0/1388959422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb670003970 0x7fb670003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb686ffd640 1 --2- 172.21.15.132:0/1388959422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6700047c0 0x7fb670004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb686ffd640 1 --2- 172.21.15.132:0/1388959422 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6880b5090 0x7fb670005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb686ffd640 1 -- 172.21.15.132:0/1388959422 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6881617e0 con 0x7fb6700047c0 2023-12-20T04:47:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb686ffd640 1 -- 172.21.15.132:0/1388959422 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6880d0fc0 con 0x7fb670003970 2023-12-20T04:47:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb686ffd640 1 -- 172.21.15.132:0/1388959422 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb67000bac0 con 0x7fb6880b5090 2023-12-20T04:47:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb6877fe640 1 --2- 172.21.15.132:0/1388959422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6700047c0 0x7fb670004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb687fff640 1 --2- 172.21.15.132:0/1388959422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb670003970 0x7fb670003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb68cf03640 1 --2- 172.21.15.132:0/1388959422 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6880b5090 0x7fb670005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb6877fe640 1 -- 172.21.15.132:0/1388959422 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6880b5090 msgr2=0x7fb670005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb6877fe640 1 --2- 172.21.15.132:0/1388959422 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6880b5090 0x7fb670005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb6877fe640 1 -- 172.21.15.132:0/1388959422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb670003970 msgr2=0x7fb670003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb6877fe640 1 --2- 172.21.15.132:0/1388959422 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb670003970 0x7fb670003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.211+0000 7fb6877fe640 1 -- 172.21.15.132:0/1388959422 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb670003520 con 0x7fb6700047c0 2023-12-20T04:47:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.212+0000 7fb6877fe640 1 --2- 172.21.15.132:0/1388959422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6700047c0 0x7fb670004c40 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00c240 tx=0x7fb6700057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0eb27299906e4df server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.212+0000 7fb686ffd640 1 -- 172.21.15.132:0/1388959422 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c02cb00 con 0x7fb6700047c0 2023-12-20T04:47:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.212+0000 7fb686ffd640 1 -- 172.21.15.132:0/1388959422 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb67c02cc60 con 0x7fb6700047c0 2023-12-20T04:47:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.212+0000 7fb686ffd640 1 -- 172.21.15.132:0/1388959422 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67c0058d0 con 0x7fb6700047c0 2023-12-20T04:47:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.213+0000 7fb68e966640 1 -- 172.21.15.132:0/1388959422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6700047c0 msgr2=0x7fb670004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.213+0000 7fb68e966640 1 --2- 172.21.15.132:0/1388959422 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6700047c0 0x7fb670004c40 secure :-1 s=READY pgs=1000 cs=0 l=1 rev1=1 crypto rx=0x7fb67c00c240 tx=0x7fb6700057f0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.213+0000 7fb68cf03640 1 -- 172.21.15.132:0/1388959422 reap_dead start 2023-12-20T04:47:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.213+0000 7fb68e966640 1 -- 172.21.15.132:0/1388959422 shutdown_connections 2023-12-20T04:47:09.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.213+0000 7fb68e966640 1 -- 172.21.15.132:0/1388959422 >> 172.21.15.132:0/1388959422 conn(0x7fb6880cf980 msgr2=0x7fb6880cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.213+0000 7fb68e966640 1 -- 172.21.15.132:0/1388959422 shutdown_connections 2023-12-20T04:47:09.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.213+0000 7fb68e966640 1 -- 172.21.15.132:0/1388959422 wait complete. 2023-12-20T04:47:09.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.214+0000 7fb68e966640 1 Processor -- start 2023-12-20T04:47:09.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.214+0000 7fb68e966640 1 -- start start 2023-12-20T04:47:09.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb68e966640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6700047c0 0x7fb68814b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb68e966640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb68815f680 0x7fb68815d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb68e966640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6880b73e0 0x7fb6880b7890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb68e966640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6880b7dd0 con 0x7fb6700047c0 2023-12-20T04:47:09.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb68e966640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb68814b8d0 con 0x7fb68815f680 2023-12-20T04:47:09.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb68e966640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb68814be00 con 0x7fb6880b73e0 2023-12-20T04:47:09.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb687fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6700047c0 0x7fb68814b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb687fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6700047c0 0x7fb68814b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34672/0 (socket says 172.21.15.132:34672) 2023-12-20T04:47:09.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb687fff640 1 -- 172.21.15.132:0/664262129 learned_addr learned my addr 172.21.15.132:0/664262129 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:09.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb6877fe640 1 --2- 172.21.15.132:0/664262129 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb68815f680 0x7fb68815d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb68cf03640 1 --2- 172.21.15.132:0/664262129 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6880b73e0 0x7fb6880b7890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb687fff640 1 -- 172.21.15.132:0/664262129 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6880b73e0 msgr2=0x7fb6880b7890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb687fff640 1 --2- 172.21.15.132:0/664262129 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6880b73e0 0x7fb6880b7890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb687fff640 1 -- 172.21.15.132:0/664262129 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb68815f680 msgr2=0x7fb68815d9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb687fff640 1 --2- 172.21.15.132:0/664262129 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb68815f680 0x7fb68815d9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb687fff640 1 -- 172.21.15.132:0/664262129 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6880a9a60 con 0x7fb6700047c0 2023-12-20T04:47:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb6877fe640 1 --2- 172.21.15.132:0/664262129 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb68815f680 0x7fb68815d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.215+0000 7fb687fff640 1 --2- 172.21.15.132:0/664262129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6700047c0 0x7fb68814b390 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fb678011650 tx=0x7fb678011b10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.216+0000 7fb684ff9640 1 -- 172.21.15.132:0/664262129 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67800c070 con 0x7fb6700047c0 2023-12-20T04:47:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.216+0000 7fb684ff9640 1 -- 172.21.15.132:0/664262129 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb678004220 con 0x7fb6700047c0 2023-12-20T04:47:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.216+0000 7fb68e966640 1 -- 172.21.15.132:0/664262129 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6880a9d40 con 0x7fb6700047c0 2023-12-20T04:47:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.216+0000 7fb684ff9640 1 -- 172.21.15.132:0/664262129 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb67800f760 con 0x7fb6700047c0 2023-12-20T04:47:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.216+0000 7fb68e966640 1 -- 172.21.15.132:0/664262129 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6880aa300 con 0x7fb6700047c0 2023-12-20T04:47:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.217+0000 7fb68e966640 1 -- 172.21.15.132:0/664262129 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb68804e840 con 0x7fb6700047c0 2023-12-20T04:47:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.217+0000 7fb684ff9640 1 -- 172.21.15.132:0/664262129 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb67800f8c0 con 0x7fb6700047c0 2023-12-20T04:47:09.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.217+0000 7fb684ff9640 1 --2- 172.21.15.132:0/664262129 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb67406a460 0x7fb67406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.217+0000 7fb6877fe640 1 --2- 172.21.15.132:0/664262129 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb67406a460 0x7fb67406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.217+0000 7fb684ff9640 1 -- 172.21.15.132:0/664262129 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb678088520 con 0x7fb6700047c0 2023-12-20T04:47:09.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.218+0000 7fb6877fe640 1 --2- 172.21.15.132:0/664262129 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb67406a460 0x7fb67406c920 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb67c034000 tx=0x7fb67c007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:09.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.222+0000 7fb684ff9640 1 -- 172.21.15.132:0/664262129 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb678053ef0 con 0x7fb6700047c0 2023-12-20T04:47:09.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.451+0000 7fb68e966640 1 -- 172.21.15.132:0/664262129 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fb6880d0ad0 con 0x7fb6700047c0 2023-12-20T04:47:09.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.452+0000 7fb684ff9640 1 -- 172.21.15.132:0/664262129 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v16) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fb678057510 con 0x7fb6700047c0 2023-12-20T04:47:09.454 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:09.454 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:47:09.454 INFO:teuthology.orchestra.run.smithi132.stdout: "auth_dump": [ 2023-12-20T04:47:09.454 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.454 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.a", 2023-12-20T04:47:09.454 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlbTdZOxAAUDz0Eno9DYvrYM1xg5jG/A==", 2023-12-20T04:47:09.454 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.455 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:47:09.455 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:47:09.455 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:47:09.455 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:47:09.455 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.455 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.455 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.455 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.b", 2023-12-20T04:47:09.455 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl43gVDBAA1qJwUU+Ii4BalGf3NtJnGA==", 2023-12-20T04:47:09.455 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.455 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:47:09.455 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:47:09.455 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:47:09.456 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:47:09.456 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.456 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.456 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.c", 2023-12-20T04:47:09.456 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlaSUVBxAA7HN3dSo9xfvkjvc6bwMxWg==", 2023-12-20T04:47:09.456 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.456 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:47:09.456 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:47:09.456 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:47:09.456 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:47:09.456 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.457 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.457 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.d", 2023-12-20T04:47:09.457 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl1DR4ExAANNOyGlf1Ayre/xZEb9JHYg==", 2023-12-20T04:47:09.457 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.457 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:47:09.457 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:47:09.457 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:47:09.457 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:47:09.457 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.457 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.457 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.457 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.0", 2023-12-20T04:47:09.457 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCucIJlwZfxORAAiT2g1poLu3OkmoyxNJQc8Q==", 2023-12-20T04:47:09.457 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.458 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:47:09.458 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:47:09.458 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:47:09.458 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.458 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.458 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.458 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.1", 2023-12-20T04:47:09.458 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlejHYBRAAKurKpW5gyOAQ+E4Su4xMSQ==", 2023-12-20T04:47:09.458 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.458 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:47:09.458 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:47:09.458 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:47:09.458 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.458 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.459 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.459 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.2", 2023-12-20T04:47:09.459 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlyfz8DBAA9a6tUjHF8IRIKeldwVFMcw==", 2023-12-20T04:47:09.459 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.459 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:47:09.459 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:47:09.459 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:47:09.459 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.459 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.459 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.459 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.3", 2023-12-20T04:47:09.459 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJllFEeFBAA6URrqUjQqHsrI5+qEBVs3g==", 2023-12-20T04:47:09.459 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.459 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:47:09.460 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:47:09.460 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:47:09.460 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.460 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.460 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.460 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.4", 2023-12-20T04:47:09.460 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlvGqcJhAAgn2wuSTwLT+TOHoE4iaVSg==", 2023-12-20T04:47:09.460 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.460 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:47:09.460 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:47:09.460 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:47:09.460 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.460 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.460 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.461 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.5", 2023-12-20T04:47:09.461 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlWrkTLhAA2KlpxTFPaiXLCvmURpg5rw==", 2023-12-20T04:47:09.461 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.461 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:47:09.461 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:47:09.461 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:47:09.461 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.461 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.461 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.461 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.6", 2023-12-20T04:47:09.461 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlnOQfNRAA//EVx0BZYQd7ovK2tFhgfA==", 2023-12-20T04:47:09.461 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.461 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:47:09.461 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:47:09.462 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:47:09.462 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.462 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.462 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.462 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.7", 2023-12-20T04:47:09.462 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCzcIJl4nfDABAAtBdl2qkzKcqhmzsukC7G5w==", 2023-12-20T04:47:09.462 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.462 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:47:09.462 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:47:09.462 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:47:09.462 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.462 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.462 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.462 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.0", 2023-12-20T04:47:09.462 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlm/nGFxAA6zndayizc50Il7l74BxkgQ==", 2023-12-20T04:47:09.463 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.463 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:47:09.463 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow r", 2023-12-20T04:47:09.463 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-20T04:47:09.463 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.463 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.463 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.463 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.1", 2023-12-20T04:47:09.463 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlppb6IBAArqCoSlSE5coxkj4+XjPoWg==", 2023-12-20T04:47:09.463 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.463 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:47:09.463 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:47:09.463 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:47:09.463 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:47:09.463 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.464 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.464 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.464 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.2", 2023-12-20T04:47:09.464 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlMgWUHRAAqSdmRGx+9J+3dO7ntaApdw==", 2023-12-20T04:47:09.464 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.464 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:47:09.464 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:47:09.464 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:47:09.464 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:47:09.464 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.464 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.464 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.464 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.3", 2023-12-20T04:47:09.465 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlcIe3JhAAjv9KfknxwySJURWdePN7vw==", 2023-12-20T04:47:09.465 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.465 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:47:09.465 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:47:09.465 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:47:09.465 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:47:09.465 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.465 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.465 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.465 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.admin", 2023-12-20T04:47:09.465 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJljrTdHhAAsAlaFaKctSv71GrifKs6zA==", 2023-12-20T04:47:09.465 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.466 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:47:09.466 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:47:09.466 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:47:09.466 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:47:09.466 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.466 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.466 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.466 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.x", 2023-12-20T04:47:09.466 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJl+KnxNxAAM/b3mubTMYlB9QUbfcPW8g==", 2023-12-20T04:47:09.466 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.466 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:47:09.466 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:47:09.466 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:47:09.466 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.466 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:09.467 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:09.467 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.y", 2023-12-20T04:47:09.467 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlMyAMNBAAWpoBNevgGIkZ7zKEdKn3Ag==", 2023-12-20T04:47:09.467 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:47:09.467 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:47:09.467 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:47:09.467 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:47:09.467 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.467 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:09.467 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:09.467 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:47:09.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.454+0000 7fb68e966640 1 -- 172.21.15.132:0/664262129 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb67406a460 msgr2=0x7fb67406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:09.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.454+0000 7fb68e966640 1 --2- 172.21.15.132:0/664262129 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb67406a460 0x7fb67406c920 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fb67c034000 tx=0x7fb67c007000 comp rx=0 tx=0).stop 2023-12-20T04:47:09.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.454+0000 7fb68e966640 1 -- 172.21.15.132:0/664262129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6700047c0 msgr2=0x7fb68814b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:09.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.454+0000 7fb68e966640 1 --2- 172.21.15.132:0/664262129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6700047c0 0x7fb68814b390 secure :-1 s=READY pgs=1001 cs=0 l=1 rev1=1 crypto rx=0x7fb678011650 tx=0x7fb678011b10 comp rx=0 tx=0).stop 2023-12-20T04:47:09.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.454+0000 7fb68e966640 1 -- 172.21.15.132:0/664262129 shutdown_connections 2023-12-20T04:47:09.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.454+0000 7fb68e966640 1 --2- 172.21.15.132:0/664262129 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb67406a460 0x7fb67406c920 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.454+0000 7fb68e966640 1 --2- 172.21.15.132:0/664262129 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb6880b73e0 0x7fb6880b7890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.454+0000 7fb68e966640 1 --2- 172.21.15.132:0/664262129 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb68815f680 0x7fb68815d9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.454+0000 7fb68e966640 1 --2- 172.21.15.132:0/664262129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb6700047c0 0x7fb68814b390 unknown :-1 s=CLOSED pgs=1001 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.454+0000 7fb68e966640 1 -- 172.21.15.132:0/664262129 >> 172.21.15.132:0/664262129 conn(0x7fb6880cf980 msgr2=0x7fb6880b62a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:09.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.454+0000 7fb68e966640 1 -- 172.21.15.132:0/664262129 shutdown_connections 2023-12-20T04:47:09.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.454+0000 7fb68e966640 1 -- 172.21.15.132:0/664262129 wait complete. 2023-12-20T04:47:09.470 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:47:09.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.568+0000 7f57ae070640 1 Processor -- start 2023-12-20T04:47:09.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.568+0000 7f57ae070640 1 -- start start 2023-12-20T04:47:09.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.568+0000 7f57ae070640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57a815e530 0x7f57a806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.568+0000 7f57ae070640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f57a806c240 0x7f57a806c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.568+0000 7f57ae070640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57a80ccf30 con 0x7f57a8159b50 2023-12-20T04:47:09.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.568+0000 7f57ae070640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57a806cc10 con 0x7f57a806c240 2023-12-20T04:47:09.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.568+0000 7f57ae070640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a80caa60 con 0x7f57a815e530 2023-12-20T04:47:09.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.569+0000 7f57a77fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f57a8159b50 0x7f57a80c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35506/0 (socket says 172.21.15.132:35506) 2023-12-20T04:47:09.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.569+0000 7f57a77fe640 1 -- 172.21.15.132:0/3600045150 learned_addr learned my addr 172.21.15.132:0/3600045150 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:09.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.569+0000 7f57a7fff640 1 --2- 172.21.15.132:0/3600045150 >> v2:172.21.15.132:3300/0 conn(0x7f57a806c240 0x7f57a806c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.569+0000 7f57a6ffd640 1 --2- 172.21.15.132:0/3600045150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57a815e530 0x7f57a806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.569+0000 7f57a7fff640 1 -- 172.21.15.132:0/3600045150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57a815e530 msgr2=0x7f57a806fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:09.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.569+0000 7f57a7fff640 1 --2- 172.21.15.132:0/3600045150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57a815e530 0x7f57a806fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.569+0000 7f57a7fff640 1 -- 172.21.15.132:0/3600045150 >> v1:172.21.15.132:6789/0 conn(0x7f57a8159b50 legacy=0x7f57a80c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:09.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.569+0000 7f57a7fff640 1 -- 172.21.15.132:0/3600045150 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a80ca1c0 con 0x7f57a806c240 2023-12-20T04:47:09.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.569+0000 7f57a6ffd640 1 --2- 172.21.15.132:0/3600045150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57a815e530 0x7f57a806fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:09.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.569+0000 7f57a67fc640 1 -- 172.21.15.132:0/3600045150 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1806078134 0 0) 0x7f57a80ccf30 con 0x7f57a8159b50 2023-12-20T04:47:09.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.570+0000 7f57a7fff640 1 --2- 172.21.15.132:0/3600045150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57a806c240 0x7f57a806c6d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009d90 tx=0x7f57a002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f9febe75a4a31 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:09.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.570+0000 7f57a67fc640 1 -- 172.21.15.132:0/3600045150 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a002cc50 con 0x7f57a806c240 2023-12-20T04:47:09.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.570+0000 7f57a67fc640 1 -- 172.21.15.132:0/3600045150 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a002cdb0 con 0x7f57a806c240 2023-12-20T04:47:09.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.570+0000 7f57a67fc640 1 -- 172.21.15.132:0/3600045150 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0034660 con 0x7f57a806c240 2023-12-20T04:47:09.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.570+0000 7f57ae070640 1 -- 172.21.15.132:0/3600045150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57a806c240 msgr2=0x7f57a806c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:09.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.570+0000 7f57ae070640 1 --2- 172.21.15.132:0/3600045150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57a806c240 0x7f57a806c6d0 secure :-1 s=READY pgs=1003 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009d90 tx=0x7f57a002bea0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.570+0000 7f57ae070640 1 -- 172.21.15.132:0/3600045150 shutdown_connections 2023-12-20T04:47:09.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.570+0000 7f57ae070640 1 --2- 172.21.15.132:0/3600045150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57a806c240 0x7f57a806c6d0 unknown :-1 s=CLOSED pgs=1003 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.570+0000 7f57ae070640 1 --2- 172.21.15.132:0/3600045150 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57a815e530 0x7f57a806fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.570+0000 7f57ae070640 1 -- 172.21.15.132:0/3600045150 >> 172.21.15.132:0/3600045150 conn(0x7f57a80ced10 msgr2=0x7f57a80cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:09.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.570+0000 7f57ae070640 1 -- 172.21.15.132:0/3600045150 shutdown_connections 2023-12-20T04:47:09.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.570+0000 7f57ae070640 1 -- 172.21.15.132:0/3600045150 wait complete. 2023-12-20T04:47:09.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.572+0000 7f57ae070640 1 Processor -- start 2023-12-20T04:47:09.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.572+0000 7f57ae070640 1 -- start start 2023-12-20T04:47:09.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.572+0000 7f57ae070640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57a806c240 0x7f57a814f770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.572+0000 7f57ae070640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57a8159b50 0x7f57a815bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.572+0000 7f57ae070640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57a815e530 0x7f57a80b3420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.572+0000 7f57ae070640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a815c7f0 con 0x7f57a815e530 2023-12-20T04:47:09.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.572+0000 7f57ae070640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57a815cad0 con 0x7f57a806c240 2023-12-20T04:47:09.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.572+0000 7f57ae070640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57a815cdb0 con 0x7f57a8159b50 2023-12-20T04:47:09.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.572+0000 7f57a7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57a815e530 0x7f57a80b3420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.573+0000 7f57a7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57a815e530 0x7f57a80b3420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34686/0 (socket says 172.21.15.132:34686) 2023-12-20T04:47:09.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.573+0000 7f57a7fff640 1 -- 172.21.15.132:0/848702065 learned_addr learned my addr 172.21.15.132:0/848702065 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:09.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.573+0000 7f57a77fe640 1 --2- 172.21.15.132:0/848702065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57a806c240 0x7f57a814f770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.573+0000 7f57a6ffd640 1 --2- 172.21.15.132:0/848702065 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57a8159b50 0x7f57a815bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.573+0000 7f57a7fff640 1 -- 172.21.15.132:0/848702065 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57a8159b50 msgr2=0x7f57a815bfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:09.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.573+0000 7f57a7fff640 1 --2- 172.21.15.132:0/848702065 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57a8159b50 0x7f57a815bfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.573+0000 7f57a7fff640 1 -- 172.21.15.132:0/848702065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57a806c240 msgr2=0x7f57a814f770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:09.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.573+0000 7f57a7fff640 1 --2- 172.21.15.132:0/848702065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57a806c240 0x7f57a814f770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.573+0000 7f57a7fff640 1 -- 172.21.15.132:0/848702065 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57a0009a70 con 0x7f57a815e530 2023-12-20T04:47:09.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.573+0000 7f57a77fe640 1 --2- 172.21.15.132:0/848702065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57a806c240 0x7f57a814f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:09.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.573+0000 7f57a7fff640 1 --2- 172.21.15.132:0/848702065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57a815e530 0x7f57a80b3420 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009d90 tx=0x7f57a0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:09.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.573+0000 7f578ffff640 1 -- 172.21.15.132:0/848702065 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0003b90 con 0x7f57a815e530 2023-12-20T04:47:09.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.573+0000 7f578ffff640 1 -- 172.21.15.132:0/848702065 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f57a0003cf0 con 0x7f57a815e530 2023-12-20T04:47:09.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.573+0000 7f57ae070640 1 -- 172.21.15.132:0/848702065 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57a815a060 con 0x7f57a815e530 2023-12-20T04:47:09.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.573+0000 7f578ffff640 1 -- 172.21.15.132:0/848702065 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57a0004270 con 0x7f57a815e530 2023-12-20T04:47:09.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.573+0000 7f57ae070640 1 -- 172.21.15.132:0/848702065 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57a815d090 con 0x7f57a815e530 2023-12-20T04:47:09.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.574+0000 7f57ae070640 1 -- 172.21.15.132:0/848702065 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57a815a250 con 0x7f57a815e530 2023-12-20T04:47:09.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.574+0000 7f578ffff640 1 -- 172.21.15.132:0/848702065 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f57a003b050 con 0x7f57a815e530 2023-12-20T04:47:09.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.575+0000 7f578ffff640 1 --2- 172.21.15.132:0/848702065 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f579406a430 0x7f579406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.575+0000 7f578ffff640 1 -- 172.21.15.132:0/848702065 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f57a00aab10 con 0x7f57a815e530 2023-12-20T04:47:09.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.575+0000 7f57a77fe640 1 --2- 172.21.15.132:0/848702065 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f579406a430 0x7f579406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.575+0000 7f57a77fe640 1 --2- 172.21.15.132:0/848702065 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f579406a430 0x7f579406c8f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5798000f60 tx=0x7f5798007c10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:09.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.579+0000 7f578ffff640 1 -- 172.21.15.132:0/848702065 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f57a00764e0 con 0x7f57a815e530 2023-12-20T04:47:09.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.747+0000 7f57ae070640 1 -- 172.21.15.132:0/848702065 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57a804e840 con 0x7f57a815e530 2023-12-20T04:47:09.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.747+0000 7f578ffff640 1 -- 172.21.15.132:0/848702065 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v97) v1 ==== 74+0+12438 (secure 0 0 0) 0x7f57a0079b00 con 0x7f57a815e530 2023-12-20T04:47:09.749 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:09.749 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":97,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:47:09.080530+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":11,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":80,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:47:09.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.749+0000 7f57ae070640 1 -- 172.21.15.132:0/848702065 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f579406a430 msgr2=0x7f579406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:09.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.749+0000 7f57ae070640 1 --2- 172.21.15.132:0/848702065 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f579406a430 0x7f579406c8f0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7f5798000f60 tx=0x7f5798007c10 comp rx=0 tx=0).stop 2023-12-20T04:47:09.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.749+0000 7f57ae070640 1 -- 172.21.15.132:0/848702065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57a815e530 msgr2=0x7f57a80b3420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:09.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.749+0000 7f57ae070640 1 --2- 172.21.15.132:0/848702065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57a815e530 0x7f57a80b3420 secure :-1 s=READY pgs=1004 cs=0 l=1 rev1=1 crypto rx=0x7f57a0009d90 tx=0x7f57a0004a40 comp rx=0 tx=0).stop 2023-12-20T04:47:09.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.749+0000 7f57ae070640 1 -- 172.21.15.132:0/848702065 shutdown_connections 2023-12-20T04:47:09.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.749+0000 7f57ae070640 1 --2- 172.21.15.132:0/848702065 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f579406a430 0x7f579406c8f0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.749+0000 7f57ae070640 1 --2- 172.21.15.132:0/848702065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57a815e530 0x7f57a80b3420 unknown :-1 s=CLOSED pgs=1004 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.749+0000 7f57ae070640 1 --2- 172.21.15.132:0/848702065 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57a8159b50 0x7f57a815bfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.749+0000 7f57ae070640 1 --2- 172.21.15.132:0/848702065 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f57a806c240 0x7f57a814f770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.749+0000 7f57ae070640 1 -- 172.21.15.132:0/848702065 >> 172.21.15.132:0/848702065 conn(0x7f57a80ced10 msgr2=0x7f57a8071040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:09.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.750+0000 7f57ae070640 1 -- 172.21.15.132:0/848702065 shutdown_connections 2023-12-20T04:47:09.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.750+0000 7f57ae070640 1 -- 172.21.15.132:0/848702065 wait complete. 2023-12-20T04:47:09.763 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '91', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:47:09.763 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:47:09.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.864+0000 7f40ec417640 1 Processor -- start 2023-12-20T04:47:09.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.865+0000 7f40ec417640 1 -- start start 2023-12-20T04:47:09.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.865+0000 7f40ec417640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f40e415aee0 0x7f40e415eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.865+0000 7f40ec417640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40e40cb2b0 0x7f40e40cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.865+0000 7f40ec417640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f40e40cdbb0 0x7f40e40ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.865+0000 7f40ec417640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e40ce040 con 0x7f40e415aee0 2023-12-20T04:47:09.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.865+0000 7f40ec417640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f40e40d0130 con 0x7f40e40cdbb0 2023-12-20T04:47:09.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.865+0000 7f40ec417640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e415f370 con 0x7f40e40cb2b0 2023-12-20T04:47:09.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.866+0000 7f40ea1b3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f40e415aee0 0x7f40e415eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.866+0000 7f40ea1b3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f40e415aee0 0x7f40e415eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34696/0 (socket says 172.21.15.132:34696) 2023-12-20T04:47:09.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.866+0000 7f40ea1b3640 1 -- 172.21.15.132:0/522167619 learned_addr learned my addr 172.21.15.132:0/522167619 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:09.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.866+0000 7f40e99b2640 1 --2- 172.21.15.132:0/522167619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40e40cb2b0 0x7f40e40cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.866+0000 7f40ea9b4640 1 --2- 172.21.15.132:0/522167619 >> v2:172.21.15.187:3300/0 conn(0x7f40e40cdbb0 0x7f40e40ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.866+0000 7f40ea1b3640 1 -- 172.21.15.132:0/522167619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40e40cb2b0 msgr2=0x7f40e40cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:09.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.866+0000 7f40ea1b3640 1 --2- 172.21.15.132:0/522167619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40e40cb2b0 0x7f40e40cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.866+0000 7f40ea1b3640 1 -- 172.21.15.132:0/522167619 >> v2:172.21.15.187:3300/0 conn(0x7f40e40cdbb0 msgr2=0x7f40e40ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:09.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.866+0000 7f40ea1b3640 1 --2- 172.21.15.132:0/522167619 >> v2:172.21.15.187:3300/0 conn(0x7f40e40cdbb0 0x7f40e40ceb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.866+0000 7f40ea1b3640 1 -- 172.21.15.132:0/522167619 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e415f650 con 0x7f40e415aee0 2023-12-20T04:47:09.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.866+0000 7f40e99b2640 1 --2- 172.21.15.132:0/522167619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40e40cb2b0 0x7f40e40cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:09.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.866+0000 7f40ea9b4640 1 --2- 172.21.15.132:0/522167619 >> v2:172.21.15.187:3300/0 conn(0x7f40e40cdbb0 0x7f40e40ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:09.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.867+0000 7f40ea1b3640 1 --2- 172.21.15.132:0/522167619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40e415aee0 0x7f40e415eb40 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f40e40b3060 tx=0x7f40e002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=164475a9f80059a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:09.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.867+0000 7f40e91b1640 1 -- 172.21.15.132:0/522167619 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0031870 con 0x7f40e415aee0 2023-12-20T04:47:09.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.867+0000 7f40e91b1640 1 -- 172.21.15.132:0/522167619 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40e00319d0 con 0x7f40e415aee0 2023-12-20T04:47:09.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.867+0000 7f40e91b1640 1 -- 172.21.15.132:0/522167619 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40e0031d60 con 0x7f40e415aee0 2023-12-20T04:47:09.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.867+0000 7f40ec417640 1 -- 172.21.15.132:0/522167619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40e415aee0 msgr2=0x7f40e415eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:09.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.867+0000 7f40ec417640 1 --2- 172.21.15.132:0/522167619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40e415aee0 0x7f40e415eb40 secure :-1 s=READY pgs=1005 cs=0 l=1 rev1=1 crypto rx=0x7f40e40b3060 tx=0x7f40e002b910 comp rx=0 tx=0).stop 2023-12-20T04:47:09.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.867+0000 7f40ec417640 1 -- 172.21.15.132:0/522167619 shutdown_connections 2023-12-20T04:47:09.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.867+0000 7f40ec417640 1 --2- 172.21.15.132:0/522167619 >> v2:172.21.15.187:3300/0 conn(0x7f40e40cdbb0 0x7f40e40ceb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.867+0000 7f40ec417640 1 --2- 172.21.15.132:0/522167619 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40e40cb2b0 0x7f40e40cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.867+0000 7f40ec417640 1 --2- 172.21.15.132:0/522167619 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40e415aee0 0x7f40e415eb40 unknown :-1 s=CLOSED pgs=1005 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.867+0000 7f40ec417640 1 -- 172.21.15.132:0/522167619 >> 172.21.15.132:0/522167619 conn(0x7f40e4072c60 msgr2=0x7f40e4073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:09.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.867+0000 7f40ec417640 1 -- 172.21.15.132:0/522167619 shutdown_connections 2023-12-20T04:47:09.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.867+0000 7f40ec417640 1 -- 172.21.15.132:0/522167619 wait complete. 2023-12-20T04:47:09.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.869+0000 7f40ec417640 1 Processor -- start 2023-12-20T04:47:09.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.869+0000 7f40ec417640 1 -- start start 2023-12-20T04:47:09.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.869+0000 7f40ec417640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40e40cb2b0 0x7f40e4153bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.869+0000 7f40ec417640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40e40cdbb0 0x7f40e414fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.869+0000 7f40ec417640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40e415aee0 0x7f40e4150290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.869+0000 7f40ec417640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e4154100 con 0x7f40e415aee0 2023-12-20T04:47:09.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.869+0000 7f40ec417640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40e4150ab0 con 0x7f40e40cb2b0 2023-12-20T04:47:09.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.869+0000 7f40ec417640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40e40c7ed0 con 0x7f40e40cdbb0 2023-12-20T04:47:09.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.869+0000 7f40ea9b4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40e415aee0 0x7f40e4150290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.869+0000 7f40ea9b4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40e415aee0 0x7f40e4150290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34706/0 (socket says 172.21.15.132:34706) 2023-12-20T04:47:09.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.869+0000 7f40ea9b4640 1 -- 172.21.15.132:0/2660094510 learned_addr learned my addr 172.21.15.132:0/2660094510 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:09.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.870+0000 7f40e99b2640 1 --2- 172.21.15.132:0/2660094510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40e40cdbb0 0x7f40e414fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.870+0000 7f40ea1b3640 1 --2- 172.21.15.132:0/2660094510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40e40cb2b0 0x7f40e4153bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.870+0000 7f40ea9b4640 1 -- 172.21.15.132:0/2660094510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40e40cdbb0 msgr2=0x7f40e414fd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:09.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.870+0000 7f40ea9b4640 1 --2- 172.21.15.132:0/2660094510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40e40cdbb0 0x7f40e414fd50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.870+0000 7f40ea9b4640 1 -- 172.21.15.132:0/2660094510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40e40cb2b0 msgr2=0x7f40e4153bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:09.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.870+0000 7f40ea9b4640 1 --2- 172.21.15.132:0/2660094510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40e40cb2b0 0x7f40e4153bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:09.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.870+0000 7f40ea9b4640 1 -- 172.21.15.132:0/2660094510 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40e00094d0 con 0x7f40e415aee0 2023-12-20T04:47:09.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.870+0000 7f40ea1b3640 1 --2- 172.21.15.132:0/2660094510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40e40cb2b0 0x7f40e4153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:09.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.870+0000 7f40e99b2640 1 --2- 172.21.15.132:0/2660094510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40e40cdbb0 0x7f40e414fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:09.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.870+0000 7f40ea9b4640 1 --2- 172.21.15.132:0/2660094510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40e415aee0 0x7f40e4150290 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00cd50 tx=0x7f40dc00a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:09.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.870+0000 7f40daffd640 1 -- 172.21.15.132:0/2660094510 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc00f680 con 0x7f40e415aee0 2023-12-20T04:47:09.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.870+0000 7f40daffd640 1 -- 172.21.15.132:0/2660094510 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f40dc00f800 con 0x7f40e415aee0 2023-12-20T04:47:09.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.870+0000 7f40ec417640 1 -- 172.21.15.132:0/2660094510 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40e40c81b0 con 0x7f40e415aee0 2023-12-20T04:47:09.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.870+0000 7f40daffd640 1 -- 172.21.15.132:0/2660094510 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f40dc00fbb0 con 0x7f40e415aee0 2023-12-20T04:47:09.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.870+0000 7f40ec417640 1 -- 172.21.15.132:0/2660094510 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40e41507d0 con 0x7f40e415aee0 2023-12-20T04:47:09.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.871+0000 7f40ec417640 1 -- 172.21.15.132:0/2660094510 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40e40c7d30 con 0x7f40e415aee0 2023-12-20T04:47:09.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.871+0000 7f40daffd640 1 -- 172.21.15.132:0/2660094510 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f40dc00b040 con 0x7f40e415aee0 2023-12-20T04:47:09.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.872+0000 7f40daffd640 1 --2- 172.21.15.132:0/2660094510 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f40c806a430 0x7f40c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:09.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.872+0000 7f40daffd640 1 -- 172.21.15.132:0/2660094510 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f40dc088fd0 con 0x7f40e415aee0 2023-12-20T04:47:09.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.872+0000 7f40ea1b3640 1 --2- 172.21.15.132:0/2660094510 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f40c806a430 0x7f40c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:09.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.872+0000 7f40ea1b3640 1 --2- 172.21.15.132:0/2660094510 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f40c806a430 0x7f40c806c8f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f40e0036000 tx=0x7f40e003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:09.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:09.876+0000 7f40daffd640 1 -- 172.21.15.132:0/2660094510 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f40e40c7d30 con 0x7f40e415aee0 2023-12-20T04:47:10.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.043+0000 7f40ec417640 1 -- 172.21.15.132:0/2660094510 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f40e40c86d0 con 0x7f40e415aee0 2023-12-20T04:47:10.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.043+0000 7f40daffd640 1 -- 172.21.15.132:0/2660094510 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v97) v1 ==== 93+0+10 (secure 0 0 0) 0x7f40e40c86d0 con 0x7f40e415aee0 2023-12-20T04:47:10.046 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:47:10.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.045+0000 7f40ec417640 1 -- 172.21.15.132:0/2660094510 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f40c806a430 msgr2=0x7f40c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:10.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.045+0000 7f40ec417640 1 --2- 172.21.15.132:0/2660094510 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f40c806a430 0x7f40c806c8f0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7f40e0036000 tx=0x7f40e003c040 comp rx=0 tx=0).stop 2023-12-20T04:47:10.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.045+0000 7f40ec417640 1 -- 172.21.15.132:0/2660094510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40e415aee0 msgr2=0x7f40e4150290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:10.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.045+0000 7f40ec417640 1 --2- 172.21.15.132:0/2660094510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40e415aee0 0x7f40e4150290 secure :-1 s=READY pgs=1006 cs=0 l=1 rev1=1 crypto rx=0x7f40dc00cd50 tx=0x7f40dc00a650 comp rx=0 tx=0).stop 2023-12-20T04:47:10.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.045+0000 7f40ec417640 1 -- 172.21.15.132:0/2660094510 shutdown_connections 2023-12-20T04:47:10.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.045+0000 7f40ec417640 1 --2- 172.21.15.132:0/2660094510 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f40c806a430 0x7f40c806c8f0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.045+0000 7f40ec417640 1 --2- 172.21.15.132:0/2660094510 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f40e415aee0 0x7f40e4150290 unknown :-1 s=CLOSED pgs=1006 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.045+0000 7f40ec417640 1 --2- 172.21.15.132:0/2660094510 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f40e40cdbb0 0x7f40e414fd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.045+0000 7f40ec417640 1 --2- 172.21.15.132:0/2660094510 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f40e40cb2b0 0x7f40e4153bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.045+0000 7f40ec417640 1 -- 172.21.15.132:0/2660094510 >> 172.21.15.132:0/2660094510 conn(0x7f40e4072c60 msgr2=0x7f40e40c6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:10.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.045+0000 7f40ec417640 1 -- 172.21.15.132:0/2660094510 shutdown_connections 2023-12-20T04:47:10.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.045+0000 7f40ec417640 1 -- 172.21.15.132:0/2660094510 wait complete. 2023-12-20T04:47:10.058 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-20T04:47:10.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.157+0000 7fe193547640 1 Processor -- start 2023-12-20T04:47:10.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.157+0000 7fe193547640 1 -- start start 2023-12-20T04:47:10.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.158+0000 7fe193547640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe18c0b4f90 0x7fe18c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:10.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.158+0000 7fe193547640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18c0cd660 con 0x7fe18c15d110 2023-12-20T04:47:10.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.158+0000 7fe193547640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe18c0cd940 con 0x7fe18c0b1d10 2023-12-20T04:47:10.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.158+0000 7fe193547640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe18c160e60 con 0x7fe18c0b4f90 2023-12-20T04:47:10.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.158+0000 7fe190ae2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe18c0b4f90 0x7fe18c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:10.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.158+0000 7fe1912e3640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe18c15d110 0x7fe18c0b4880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35514/0 (socket says 172.21.15.132:35514) 2023-12-20T04:47:10.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.158+0000 7fe1912e3640 1 -- 172.21.15.132:0/847472995 learned_addr learned my addr 172.21.15.132:0/847472995 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:10.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.158+0000 7fe190ae2640 1 -- 172.21.15.132:0/847472995 >> v1:172.21.15.187:6789/0 conn(0x7fe18c0b1d10 legacy=0x7fe18c0d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:10.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.158+0000 7fe190ae2640 1 -- 172.21.15.132:0/847472995 >> v1:172.21.15.132:6789/0 conn(0x7fe18c15d110 legacy=0x7fe18c0b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:10.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.158+0000 7fe190ae2640 1 -- 172.21.15.132:0/847472995 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe18c161140 con 0x7fe18c0b4f90 2023-12-20T04:47:10.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.158+0000 7fe183fff640 1 -- 172.21.15.132:0/847472995 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 216235670 0 0) 0x7fe18c0cd660 con 0x7fe18c15d110 2023-12-20T04:47:10.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.159+0000 7fe190ae2640 1 --2- 172.21.15.132:0/847472995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18c0b4f90 0x7fe18c0b21f0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0097a0 tx=0x7fe17c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d18803472b04c2c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:10.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.159+0000 7fe183fff640 1 -- 172.21.15.132:0/847472995 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c031830 con 0x7fe18c0b4f90 2023-12-20T04:47:10.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.159+0000 7fe183fff640 1 -- 172.21.15.132:0/847472995 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe17c031990 con 0x7fe18c0b4f90 2023-12-20T04:47:10.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.159+0000 7fe183fff640 1 -- 172.21.15.132:0/847472995 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe17c031d20 con 0x7fe18c0b4f90 2023-12-20T04:47:10.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.159+0000 7fe193547640 1 -- 172.21.15.132:0/847472995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18c0b4f90 msgr2=0x7fe18c0b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:10.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.159+0000 7fe193547640 1 --2- 172.21.15.132:0/847472995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18c0b4f90 0x7fe18c0b21f0 secure :-1 s=READY pgs=1008 cs=0 l=1 rev1=1 crypto rx=0x7fe17c0097a0 tx=0x7fe17c02b8d0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.159+0000 7fe193547640 1 -- 172.21.15.132:0/847472995 shutdown_connections 2023-12-20T04:47:10.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.159+0000 7fe193547640 1 --2- 172.21.15.132:0/847472995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18c0b4f90 0x7fe18c0b21f0 unknown :-1 s=CLOSED pgs=1008 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.159+0000 7fe193547640 1 -- 172.21.15.132:0/847472995 >> 172.21.15.132:0/847472995 conn(0x7fe18c0cf880 msgr2=0x7fe18c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:10.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.160+0000 7fe193547640 1 -- 172.21.15.132:0/847472995 shutdown_connections 2023-12-20T04:47:10.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.160+0000 7fe193547640 1 -- 172.21.15.132:0/847472995 wait complete. 2023-12-20T04:47:10.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.161+0000 7fe193547640 1 Processor -- start 2023-12-20T04:47:10.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.161+0000 7fe193547640 1 -- start start 2023-12-20T04:47:10.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.161+0000 7fe193547640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18c0b1d10 0x7fe18c140190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:10.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.161+0000 7fe193547640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe18c0b4f90 0x7fe18c157aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:10.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.161+0000 7fe193547640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe18c15d110 0x7fe18c15d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:10.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.161+0000 7fe193547640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c1f3330 con 0x7fe18c0b1d10 2023-12-20T04:47:10.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.161+0000 7fe193547640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c157fe0 con 0x7fe18c0b4f90 2023-12-20T04:47:10.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.161+0000 7fe193547640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe18c1f3050 con 0x7fe18c15d110 2023-12-20T04:47:10.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.162+0000 7fe1912e3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18c0b1d10 0x7fe18c140190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:10.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.162+0000 7fe1912e3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18c0b1d10 0x7fe18c140190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34738/0 (socket says 172.21.15.132:34738) 2023-12-20T04:47:10.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.162+0000 7fe1912e3640 1 -- 172.21.15.132:0/272529079 learned_addr learned my addr 172.21.15.132:0/272529079 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:10.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.162+0000 7fe190ae2640 1 --2- 172.21.15.132:0/272529079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe18c0b4f90 0x7fe18c157aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.162+0000 7fe191ae4640 1 --2- 172.21.15.132:0/272529079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe18c15d110 0x7fe18c15d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.162+0000 7fe1912e3640 1 -- 172.21.15.132:0/272529079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe18c15d110 msgr2=0x7fe18c15d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.162+0000 7fe1912e3640 1 --2- 172.21.15.132:0/272529079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe18c15d110 0x7fe18c15d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.162+0000 7fe1912e3640 1 -- 172.21.15.132:0/272529079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe18c0b4f90 msgr2=0x7fe18c157aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.162+0000 7fe1912e3640 1 --2- 172.21.15.132:0/272529079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe18c0b4f90 0x7fe18c157aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.162+0000 7fe1912e3640 1 -- 172.21.15.132:0/272529079 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe17c009400 con 0x7fe18c0b1d10 2023-12-20T04:47:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.162+0000 7fe191ae4640 1 --2- 172.21.15.132:0/272529079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe18c15d110 0x7fe18c15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.162+0000 7fe1912e3640 1 --2- 172.21.15.132:0/272529079 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18c0b1d10 0x7fe18c140190 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c430 tx=0x7fe18800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.162+0000 7fe181ffb640 1 -- 172.21.15.132:0/272529079 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1880074e0 con 0x7fe18c0b1d10 2023-12-20T04:47:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.162+0000 7fe181ffb640 1 -- 172.21.15.132:0/272529079 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe188007660 con 0x7fe18c0b1d10 2023-12-20T04:47:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.162+0000 7fe193547640 1 -- 172.21.15.132:0/272529079 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe18c0cb0a0 con 0x7fe18c0b1d10 2023-12-20T04:47:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.162+0000 7fe181ffb640 1 -- 172.21.15.132:0/272529079 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe188004a20 con 0x7fe18c0b1d10 2023-12-20T04:47:10.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.162+0000 7fe193547640 1 -- 172.21.15.132:0/272529079 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe18c0cb660 con 0x7fe18c0b1d10 2023-12-20T04:47:10.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.163+0000 7fe193547640 1 -- 172.21.15.132:0/272529079 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe18c04e840 con 0x7fe18c0b1d10 2023-12-20T04:47:10.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.163+0000 7fe181ffb640 1 -- 172.21.15.132:0/272529079 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe188004b80 con 0x7fe18c0b1d10 2023-12-20T04:47:10.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.164+0000 7fe181ffb640 1 --2- 172.21.15.132:0/272529079 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe17006a430 0x7fe17006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:10.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.164+0000 7fe181ffb640 1 -- 172.21.15.132:0/272529079 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe188088340 con 0x7fe18c0b1d10 2023-12-20T04:47:10.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.164+0000 7fe190ae2640 1 --2- 172.21.15.132:0/272529079 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe17006a430 0x7fe17006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:10.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.164+0000 7fe190ae2640 1 --2- 172.21.15.132:0/272529079 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe17006a430 0x7fe17006c8f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe17c036000 tx=0x7fe17c03d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:10.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.168+0000 7fe181ffb640 1 -- 172.21.15.132:0/272529079 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe188053c80 con 0x7fe18c0b1d10 2023-12-20T04:47:10.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.337+0000 7fe193547640 1 -- 172.21.15.132:0/272529079 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fe18c0d1c90 con 0x7fe18c0b1d10 2023-12-20T04:47:10.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.337+0000 7fe181ffb640 1 -- 172.21.15.132:0/272529079 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v97) v1 ==== 84+0+65 (secure 0 0 0) 0x7fe1880572a0 con 0x7fe18c0b1d10 2023-12-20T04:47:10.339 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:10.339 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-12-20T04:47:10.339 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:10.339 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-12-20T04:47:10.339 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-12-20T04:47:10.340 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:10.340 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-12-20T04:47:10.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.339+0000 7fe193547640 1 -- 172.21.15.132:0/272529079 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe17006a430 msgr2=0x7fe17006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:10.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.339+0000 7fe193547640 1 --2- 172.21.15.132:0/272529079 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe17006a430 0x7fe17006c8f0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fe17c036000 tx=0x7fe17c03d040 comp rx=0 tx=0).stop 2023-12-20T04:47:10.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.339+0000 7fe193547640 1 -- 172.21.15.132:0/272529079 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18c0b1d10 msgr2=0x7fe18c140190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:10.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.339+0000 7fe193547640 1 --2- 172.21.15.132:0/272529079 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18c0b1d10 0x7fe18c140190 secure :-1 s=READY pgs=1009 cs=0 l=1 rev1=1 crypto rx=0x7fe18800c430 tx=0x7fe18800c8f0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.339+0000 7fe193547640 1 -- 172.21.15.132:0/272529079 shutdown_connections 2023-12-20T04:47:10.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.339+0000 7fe193547640 1 --2- 172.21.15.132:0/272529079 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe17006a430 0x7fe17006c8f0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.339+0000 7fe193547640 1 --2- 172.21.15.132:0/272529079 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe18c15d110 0x7fe18c15d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.339+0000 7fe193547640 1 --2- 172.21.15.132:0/272529079 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe18c0b4f90 0x7fe18c157aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.339+0000 7fe193547640 1 --2- 172.21.15.132:0/272529079 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe18c0b1d10 0x7fe18c140190 unknown :-1 s=CLOSED pgs=1009 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.339+0000 7fe193547640 1 -- 172.21.15.132:0/272529079 >> 172.21.15.132:0/272529079 conn(0x7fe18c0cf880 msgr2=0x7fe18c065910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:10.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.339+0000 7fe193547640 1 -- 172.21.15.132:0/272529079 shutdown_connections 2023-12-20T04:47:10.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.339+0000 7fe193547640 1 -- 172.21.15.132:0/272529079 wait complete. 2023-12-20T04:47:10.353 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-20T04:47:10.353 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-20T04:47:10.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.455+0000 7f5c4ec0b640 1 Processor -- start 2023-12-20T04:47:10.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.455+0000 7f5c4ec0b640 1 -- start start 2023-12-20T04:47:10.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.456+0000 7f5c4ec0b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c4815d190 0x7f5c48160b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:10.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.456+0000 7f5c4ec0b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5c480ce1f0 0x7f5c480d18a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:10.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.456+0000 7f5c4ec0b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5c48161a70 con 0x7f5c480b87a0 2023-12-20T04:47:10.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.456+0000 7f5c4ec0b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5c480b5fb0 con 0x7f5c480ce1f0 2023-12-20T04:47:10.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.456+0000 7f5c4ec0b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c481611d0 con 0x7f5c4815d190 2023-12-20T04:47:10.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.456+0000 7f5c4d1a8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5c480ce1f0 0x7f5c480d18a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:10.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.456+0000 7f5c4d1a8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5c480ce1f0 0x7f5c480d18a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34750/0 (socket says 172.21.15.132:34750) 2023-12-20T04:47:10.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.456+0000 7f5c4d1a8640 1 -- 172.21.15.132:0/760810891 learned_addr learned my addr 172.21.15.132:0/760810891 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:10.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.456+0000 7f5c4c9a7640 1 --2- 172.21.15.132:0/760810891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c4815d190 0x7f5c48160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:10.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.456+0000 7f5c4d1a8640 1 -- 172.21.15.132:0/760810891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c4815d190 msgr2=0x7f5c48160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:10.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.456+0000 7f5c4d1a8640 1 --2- 172.21.15.132:0/760810891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c4815d190 0x7f5c48160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.456+0000 7f5c4d1a8640 1 -- 172.21.15.132:0/760810891 >> v1:172.21.15.187:6789/0 conn(0x7f5c480b87a0 legacy=0x7f5c480cdae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:10.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.456+0000 7f5c4d1a8640 1 -- 172.21.15.132:0/760810891 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c481614b0 con 0x7f5c480ce1f0 2023-12-20T04:47:10.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.457+0000 7f5c4d1a8640 1 --2- 172.21.15.132:0/760810891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c480ce1f0 0x7f5c480d18a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009e50 tx=0x7f5c4002be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8401e75ea1f48fc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:10.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.457+0000 7f5c477fe640 1 -- 172.21.15.132:0/760810891 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c4002c9e0 con 0x7f5c480ce1f0 2023-12-20T04:47:10.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.457+0000 7f5c477fe640 1 -- 172.21.15.132:0/760810891 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c4002cb40 con 0x7f5c480ce1f0 2023-12-20T04:47:10.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.457+0000 7f5c477fe640 1 -- 172.21.15.132:0/760810891 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c400343f0 con 0x7f5c480ce1f0 2023-12-20T04:47:10.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.458+0000 7f5c4ec0b640 1 -- 172.21.15.132:0/760810891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c480ce1f0 msgr2=0x7f5c480d18a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:10.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.458+0000 7f5c4ec0b640 1 --2- 172.21.15.132:0/760810891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c480ce1f0 0x7f5c480d18a0 secure :-1 s=READY pgs=1010 cs=0 l=1 rev1=1 crypto rx=0x7f5c40009e50 tx=0x7f5c4002be40 comp rx=0 tx=0).stop 2023-12-20T04:47:10.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.458+0000 7f5c4ec0b640 1 -- 172.21.15.132:0/760810891 shutdown_connections 2023-12-20T04:47:10.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.458+0000 7f5c4ec0b640 1 --2- 172.21.15.132:0/760810891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c480ce1f0 0x7f5c480d18a0 unknown :-1 s=CLOSED pgs=1010 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.458+0000 7f5c4ec0b640 1 --2- 172.21.15.132:0/760810891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c4815d190 0x7f5c48160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.458+0000 7f5c4ec0b640 1 -- 172.21.15.132:0/760810891 >> 172.21.15.132:0/760810891 conn(0x7f5c4806a290 msgr2=0x7f5c4806a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:10.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.458+0000 7f5c4ec0b640 1 -- 172.21.15.132:0/760810891 shutdown_connections 2023-12-20T04:47:10.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.458+0000 7f5c4ec0b640 1 -- 172.21.15.132:0/760810891 wait complete. 2023-12-20T04:47:10.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.459+0000 7f5c4ec0b640 1 Processor -- start 2023-12-20T04:47:10.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.459+0000 7f5c4ec0b640 1 -- start start 2023-12-20T04:47:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4ec0b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c480b87a0 0x7f5c48157390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4ec0b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c480ce1f0 0x7f5c4815f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4ec0b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c4815d190 0x7f5c4815f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4ec0b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c48158980 con 0x7f5c480b87a0 2023-12-20T04:47:10.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4ec0b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c481f25f0 con 0x7f5c480ce1f0 2023-12-20T04:47:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4ec0b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5c48157d70 con 0x7f5c4815d190 2023-12-20T04:47:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4c9a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c480b87a0 0x7f5c48157390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4c9a7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c480b87a0 0x7f5c48157390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34766/0 (socket says 172.21.15.132:34766) 2023-12-20T04:47:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4c9a7640 1 -- 172.21.15.132:0/125399659 learned_addr learned my addr 172.21.15.132:0/125399659 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4d1a8640 1 --2- 172.21.15.132:0/125399659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c4815d190 0x7f5c4815f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c47fff640 1 --2- 172.21.15.132:0/125399659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c480ce1f0 0x7f5c4815f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4c9a7640 1 -- 172.21.15.132:0/125399659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c4815d190 msgr2=0x7f5c4815f610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4c9a7640 1 --2- 172.21.15.132:0/125399659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c4815d190 0x7f5c4815f610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4c9a7640 1 -- 172.21.15.132:0/125399659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c480ce1f0 msgr2=0x7f5c4815f0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4c9a7640 1 --2- 172.21.15.132:0/125399659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c480ce1f0 0x7f5c4815f0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4c9a7640 1 -- 172.21.15.132:0/125399659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c40009b30 con 0x7f5c480b87a0 2023-12-20T04:47:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4d1a8640 1 --2- 172.21.15.132:0/125399659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c4815d190 0x7f5c4815f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c47fff640 1 --2- 172.21.15.132:0/125399659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c480ce1f0 0x7f5c4815f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:10.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4c9a7640 1 --2- 172.21.15.132:0/125399659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c480b87a0 0x7f5c48157390 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00d5d0 tx=0x7f5c3c00da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c457fa640 1 -- 172.21.15.132:0/125399659 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c0125f0 con 0x7f5c480b87a0 2023-12-20T04:47:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c457fa640 1 -- 172.21.15.132:0/125399659 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5c3c012770 con 0x7f5c480b87a0 2023-12-20T04:47:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c457fa640 1 -- 172.21.15.132:0/125399659 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5c3c012b20 con 0x7f5c480b87a0 2023-12-20T04:47:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4ec0b640 1 -- 172.21.15.132:0/125399659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c48158050 con 0x7f5c480b87a0 2023-12-20T04:47:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.460+0000 7f5c4ec0b640 1 -- 172.21.15.132:0/125399659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c48158610 con 0x7f5c480b87a0 2023-12-20T04:47:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.461+0000 7f5c4ec0b640 1 -- 172.21.15.132:0/125399659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c4804e840 con 0x7f5c480b87a0 2023-12-20T04:47:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.462+0000 7f5c457fa640 1 -- 172.21.15.132:0/125399659 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5c3c012c80 con 0x7f5c480b87a0 2023-12-20T04:47:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.462+0000 7f5c457fa640 1 --2- 172.21.15.132:0/125399659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5c2c06a460 0x7f5c2c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.462+0000 7f5c457fa640 1 -- 172.21.15.132:0/125399659 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(97..97 src has 1..97) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f5c3c088a30 con 0x7f5c480b87a0 2023-12-20T04:47:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.462+0000 7f5c47fff640 1 --2- 172.21.15.132:0/125399659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5c2c06a460 0x7f5c2c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:10.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.462+0000 7f5c47fff640 1 --2- 172.21.15.132:0/125399659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5c2c06a460 0x7f5c2c06c920 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5c34007fd0 tx=0x7f5c34009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:10.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.466+0000 7f5c457fa640 1 -- 172.21.15.132:0/125399659 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5c3c054370 con 0x7f5c480b87a0 2023-12-20T04:47:10.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.631+0000 7f5c4ec0b640 1 -- 172.21.15.132:0/125399659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f5c480d0b20 con 0x7f5c480b87a0 2023-12-20T04:47:10.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.950+0000 7f5c457fa640 1 -- 172.21.15.132:0/125399659 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v98) v1 ==== 138+0+0 (secure 0 0 0) 0x7f5c3c057990 con 0x7f5c480b87a0 2023-12-20T04:47:10.952 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2023-12-20T04:47:10.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.953+0000 7f5c4ec0b640 1 -- 172.21.15.132:0/125399659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5c2c06a460 msgr2=0x7f5c2c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:10.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.953+0000 7f5c4ec0b640 1 --2- 172.21.15.132:0/125399659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5c2c06a460 0x7f5c2c06c920 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7f5c34007fd0 tx=0x7f5c34009040 comp rx=0 tx=0).stop 2023-12-20T04:47:10.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.953+0000 7f5c4ec0b640 1 -- 172.21.15.132:0/125399659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c480b87a0 msgr2=0x7f5c48157390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:10.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.953+0000 7f5c4ec0b640 1 --2- 172.21.15.132:0/125399659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c480b87a0 0x7f5c48157390 secure :-1 s=READY pgs=1011 cs=0 l=1 rev1=1 crypto rx=0x7f5c3c00d5d0 tx=0x7f5c3c00da90 comp rx=0 tx=0).stop 2023-12-20T04:47:10.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.953+0000 7f5c4ec0b640 1 -- 172.21.15.132:0/125399659 shutdown_connections 2023-12-20T04:47:10.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.953+0000 7f5c4ec0b640 1 --2- 172.21.15.132:0/125399659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5c2c06a460 0x7f5c2c06c920 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.953+0000 7f5c4ec0b640 1 --2- 172.21.15.132:0/125399659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5c4815d190 0x7f5c4815f610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.953+0000 7f5c4ec0b640 1 --2- 172.21.15.132:0/125399659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5c480ce1f0 0x7f5c4815f0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.953+0000 7f5c4ec0b640 1 --2- 172.21.15.132:0/125399659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5c480b87a0 0x7f5c48157390 unknown :-1 s=CLOSED pgs=1011 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:10.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.953+0000 7f5c4ec0b640 1 -- 172.21.15.132:0/125399659 >> 172.21.15.132:0/125399659 conn(0x7f5c4806a290 msgr2=0x7f5c480d2140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:10.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.953+0000 7f5c4ec0b640 1 -- 172.21.15.132:0/125399659 shutdown_connections 2023-12-20T04:47:10.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:10.953+0000 7f5c4ec0b640 1 -- 172.21.15.132:0/125399659 wait complete. 2023-12-20T04:47:10.967 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-20T04:47:11.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.073+0000 7ff192516640 1 Processor -- start 2023-12-20T04:47:11.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.073+0000 7ff192516640 1 -- start start 2023-12-20T04:47:11.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.073+0000 7ff192516640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff18c15d300 0x7ff18c0d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:11.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.073+0000 7ff192516640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff18c0d1550 0x7ff18c0cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:11.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.073+0000 7ff192516640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff18c0d1a90 con 0x7ff18c0cfdc0 2023-12-20T04:47:11.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.073+0000 7ff192516640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff18c0d0230 con 0x7ff18c15d300 2023-12-20T04:47:11.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.073+0000 7ff192516640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c0d1d70 con 0x7ff18c0d1550 2023-12-20T04:47:11.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.074+0000 7ff18bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff18c15d300 0x7ff18c0d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:11.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.074+0000 7ff18bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff18c15d300 0x7ff18c0d1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34780/0 (socket says 172.21.15.132:34780) 2023-12-20T04:47:11.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.074+0000 7ff18bfff640 1 -- 172.21.15.132:0/1478942267 learned_addr learned my addr 172.21.15.132:0/1478942267 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:11.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.074+0000 7ff18b7fe640 1 --2- 172.21.15.132:0/1478942267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff18c0d1550 0x7ff18c0cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:11.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.074+0000 7ff18bfff640 1 -- 172.21.15.132:0/1478942267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff18c0d1550 msgr2=0x7ff18c0cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:11.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.074+0000 7ff18bfff640 1 --2- 172.21.15.132:0/1478942267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff18c0d1550 0x7ff18c0cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:11.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.074+0000 7ff18bfff640 1 -- 172.21.15.132:0/1478942267 >> v1:172.21.15.187:6789/0 conn(0x7ff18c0cfdc0 legacy=0x7ff18c0b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:11.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.074+0000 7ff18bfff640 1 -- 172.21.15.132:0/1478942267 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff18c0d2050 con 0x7ff18c15d300 2023-12-20T04:47:11.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.074+0000 7ff18b7fe640 1 --2- 172.21.15.132:0/1478942267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff18c0d1550 0x7ff18c0cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:11.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.075+0000 7ff18bfff640 1 --2- 172.21.15.132:0/1478942267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff18c15d300 0x7ff18c0d1010 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009870 tx=0x7ff17c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ee29f508509f8c1 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:11.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.075+0000 7ff18affd640 1 -- 172.21.15.132:0/1478942267 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c030840 con 0x7ff18c15d300 2023-12-20T04:47:11.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.075+0000 7ff18affd640 1 -- 172.21.15.132:0/1478942267 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff17c0309a0 con 0x7ff18c15d300 2023-12-20T04:47:11.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.075+0000 7ff18affd640 1 -- 172.21.15.132:0/1478942267 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff17c030d30 con 0x7ff18c15d300 2023-12-20T04:47:11.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.075+0000 7ff192516640 1 -- 172.21.15.132:0/1478942267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff18c15d300 msgr2=0x7ff18c0d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:11.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.075+0000 7ff192516640 1 --2- 172.21.15.132:0/1478942267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff18c15d300 0x7ff18c0d1010 secure :-1 s=READY pgs=1012 cs=0 l=1 rev1=1 crypto rx=0x7ff17c009870 tx=0x7ff17c02b980 comp rx=0 tx=0).stop 2023-12-20T04:47:11.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.075+0000 7ff192516640 1 -- 172.21.15.132:0/1478942267 shutdown_connections 2023-12-20T04:47:11.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.075+0000 7ff192516640 1 --2- 172.21.15.132:0/1478942267 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff18c0d1550 0x7ff18c0cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:11.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.075+0000 7ff192516640 1 --2- 172.21.15.132:0/1478942267 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff18c15d300 0x7ff18c0d1010 unknown :-1 s=CLOSED pgs=1012 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:11.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.075+0000 7ff192516640 1 -- 172.21.15.132:0/1478942267 >> 172.21.15.132:0/1478942267 conn(0x7ff18c06a3d0 msgr2=0x7ff18c06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:11.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.075+0000 7ff192516640 1 -- 172.21.15.132:0/1478942267 shutdown_connections 2023-12-20T04:47:11.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.075+0000 7ff192516640 1 -- 172.21.15.132:0/1478942267 wait complete. 2023-12-20T04:47:11.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.076+0000 7ff192516640 1 Processor -- start 2023-12-20T04:47:11.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.077+0000 7ff192516640 1 -- start start 2023-12-20T04:47:11.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.077+0000 7ff192516640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff18c0cfdc0 0x7ff18c0c9390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:11.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.077+0000 7ff192516640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff18c0d1550 0x7ff18c0b28b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:11.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.077+0000 7ff192516640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff18c15d300 0x7ff18c0b2df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:11.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.077+0000 7ff192516640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c15e500 con 0x7ff18c15d300 2023-12-20T04:47:11.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.077+0000 7ff192516640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c15d880 con 0x7ff18c0cfdc0 2023-12-20T04:47:11.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.077+0000 7ff192516640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff18c15db60 con 0x7ff18c0d1550 2023-12-20T04:47:11.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.077+0000 7ff190ab3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff18c15d300 0x7ff18c0b2df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:11.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.078+0000 7ff190ab3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff18c15d300 0x7ff18c0b2df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34796/0 (socket says 172.21.15.132:34796) 2023-12-20T04:47:11.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.078+0000 7ff190ab3640 1 -- 172.21.15.132:0/3405722979 learned_addr learned my addr 172.21.15.132:0/3405722979 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:11.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.078+0000 7ff18bfff640 1 --2- 172.21.15.132:0/3405722979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff18c0cfdc0 0x7ff18c0c9390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:11.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.078+0000 7ff18b7fe640 1 --2- 172.21.15.132:0/3405722979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff18c0d1550 0x7ff18c0b28b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:11.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.078+0000 7ff190ab3640 1 -- 172.21.15.132:0/3405722979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff18c0d1550 msgr2=0x7ff18c0b28b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:11.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.078+0000 7ff190ab3640 1 --2- 172.21.15.132:0/3405722979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff18c0d1550 0x7ff18c0b28b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:11.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.078+0000 7ff190ab3640 1 -- 172.21.15.132:0/3405722979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff18c0cfdc0 msgr2=0x7ff18c0c9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:11.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.078+0000 7ff190ab3640 1 --2- 172.21.15.132:0/3405722979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff18c0cfdc0 0x7ff18c0c9390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:11.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.078+0000 7ff190ab3640 1 -- 172.21.15.132:0/3405722979 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff17c0094d0 con 0x7ff18c15d300 2023-12-20T04:47:11.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.078+0000 7ff18b7fe640 1 --2- 172.21.15.132:0/3405722979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff18c0d1550 0x7ff18c0b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:11.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.078+0000 7ff18bfff640 1 --2- 172.21.15.132:0/3405722979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff18c0cfdc0 0x7ff18c0c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:11.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.078+0000 7ff190ab3640 1 --2- 172.21.15.132:0/3405722979 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff18c15d300 0x7ff18c0b2df0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7ff18400c6b0 tx=0x7ff18400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:11.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.078+0000 7ff188ff9640 1 -- 172.21.15.132:0/3405722979 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff184003b70 con 0x7ff18c15d300 2023-12-20T04:47:11.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.078+0000 7ff188ff9640 1 -- 172.21.15.132:0/3405722979 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff184003cf0 con 0x7ff18c15d300 2023-12-20T04:47:11.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.078+0000 7ff192516640 1 -- 172.21.15.132:0/3405722979 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff18c15de40 con 0x7ff18c15d300 2023-12-20T04:47:11.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.078+0000 7ff188ff9640 1 -- 172.21.15.132:0/3405722979 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff184005310 con 0x7ff18c15d300 2023-12-20T04:47:11.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.078+0000 7ff192516640 1 -- 172.21.15.132:0/3405722979 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff18c160450 con 0x7ff18c15d300 2023-12-20T04:47:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.079+0000 7ff192516640 1 -- 172.21.15.132:0/3405722979 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff18c15e640 con 0x7ff18c15d300 2023-12-20T04:47:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.080+0000 7ff188ff9640 1 -- 172.21.15.132:0/3405722979 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff184005470 con 0x7ff18c15d300 2023-12-20T04:47:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.080+0000 7ff188ff9640 1 --2- 172.21.15.132:0/3405722979 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff17806a430 0x7ff17806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.080+0000 7ff188ff9640 1 -- 172.21.15.132:0/3405722979 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(98..98 src has 1..98) v4 ==== 5227+0+0 (secure 0 0 0) 0x7ff184088450 con 0x7ff18c15d300 2023-12-20T04:47:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.080+0000 7ff18bfff640 1 --2- 172.21.15.132:0/3405722979 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff17806a430 0x7ff17806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:11.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.081+0000 7ff18bfff640 1 --2- 172.21.15.132:0/3405722979 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff17806a430 0x7ff17806c8f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff17c036000 tx=0x7ff17c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:11.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.085+0000 7ff188ff9640 1 -- 172.21.15.132:0/3405722979 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff18c15e640 con 0x7ff18c15d300 2023-12-20T04:47:11.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.253+0000 7ff192516640 1 -- 172.21.15.132:0/3405722979 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7ff18c15e640 con 0x7ff18c15d300 2023-12-20T04:47:11.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.952+0000 7ff188ff9640 1 -- 172.21.15.132:0/3405722979 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v99) v1 ==== 170+0+0 (secure 0 0 0) 0x7ff18c15e640 con 0x7ff18c15d300 2023-12-20T04:47:11.955 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2023-12-20T04:47:11.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.958+0000 7ff192516640 1 -- 172.21.15.132:0/3405722979 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff17806a430 msgr2=0x7ff17806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:11.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.959+0000 7ff192516640 1 --2- 172.21.15.132:0/3405722979 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff17806a430 0x7ff17806c8f0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7ff17c036000 tx=0x7ff17c008030 comp rx=0 tx=0).stop 2023-12-20T04:47:11.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.959+0000 7ff192516640 1 -- 172.21.15.132:0/3405722979 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff18c15d300 msgr2=0x7ff18c0b2df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:11.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.959+0000 7ff192516640 1 --2- 172.21.15.132:0/3405722979 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff18c15d300 0x7ff18c0b2df0 secure :-1 s=READY pgs=1013 cs=0 l=1 rev1=1 crypto rx=0x7ff18400c6b0 tx=0x7ff18400cb70 comp rx=0 tx=0).stop 2023-12-20T04:47:11.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.961+0000 7ff192516640 1 -- 172.21.15.132:0/3405722979 shutdown_connections 2023-12-20T04:47:11.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.961+0000 7ff192516640 1 --2- 172.21.15.132:0/3405722979 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff17806a430 0x7ff17806c8f0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:11.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.961+0000 7ff192516640 1 --2- 172.21.15.132:0/3405722979 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff18c15d300 0x7ff18c0b2df0 unknown :-1 s=CLOSED pgs=1013 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:11.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.961+0000 7ff192516640 1 --2- 172.21.15.132:0/3405722979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff18c0d1550 0x7ff18c0b28b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:11.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.961+0000 7ff192516640 1 --2- 172.21.15.132:0/3405722979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff18c0cfdc0 0x7ff18c0c9390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:11.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.961+0000 7ff192516640 1 -- 172.21.15.132:0/3405722979 >> 172.21.15.132:0/3405722979 conn(0x7ff18c06a3d0 msgr2=0x7ff18c151ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:11.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.962+0000 7ff192516640 1 -- 172.21.15.132:0/3405722979 shutdown_connections 2023-12-20T04:47:11.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:11.962+0000 7ff192516640 1 -- 172.21.15.132:0/3405722979 wait complete. 2023-12-20T04:47:11.978 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-20T04:47:12.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.084+0000 7f8c53ae0640 1 Processor -- start 2023-12-20T04:47:12.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.084+0000 7f8c53ae0640 1 -- start start 2023-12-20T04:47:12.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.085+0000 7f8c53ae0640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8c4c0cf880 0x7f8c4c0cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.085+0000 7f8c53ae0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8c4c0b60e0 0x7f8c4c0b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.085+0000 7f8c53ae0640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8c4c0d1a90 con 0x7f8c4c15d300 2023-12-20T04:47:12.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.085+0000 7f8c53ae0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c4c0d0250 con 0x7f8c4c0b60e0 2023-12-20T04:47:12.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.085+0000 7f8c53ae0640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8c4c0d1d70 con 0x7f8c4c0cf880 2023-12-20T04:47:12.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.085+0000 7f8c5207d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8c4c0b60e0 0x7f8c4c0b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.085+0000 7f8c5207d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8c4c0b60e0 0x7f8c4c0b64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34802/0 (socket says 172.21.15.132:34802) 2023-12-20T04:47:12.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.085+0000 7f8c5207d640 1 -- 172.21.15.132:0/818507332 learned_addr learned my addr 172.21.15.132:0/818507332 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:12.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.085+0000 7f8c5107b640 1 --2- 172.21.15.132:0/818507332 >> v2:172.21.15.187:3300/0 conn(0x7f8c4c0cf880 0x7f8c4c0cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.085+0000 7f8c5207d640 1 -- 172.21.15.132:0/818507332 >> v2:172.21.15.187:3300/0 conn(0x7f8c4c0cf880 msgr2=0x7f8c4c0cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:12.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.085+0000 7f8c5207d640 1 --2- 172.21.15.132:0/818507332 >> v2:172.21.15.187:3300/0 conn(0x7f8c4c0cf880 0x7f8c4c0cfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.085+0000 7f8c5207d640 1 -- 172.21.15.132:0/818507332 >> v1:172.21.15.187:6789/0 conn(0x7f8c4c15d300 legacy=0x7f8c4c0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.085+0000 7f8c5207d640 1 -- 172.21.15.132:0/818507332 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c4c0d2050 con 0x7f8c4c0b60e0 2023-12-20T04:47:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.086+0000 7f8c5207d640 1 --2- 172.21.15.132:0/818507332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c4c0b60e0 0x7f8c4c0b64f0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c0d0560 tx=0x7f8c4402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c26ada1fe0848384 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.086+0000 7f8c5087a640 1 -- 172.21.15.132:0/818507332 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4402cb20 con 0x7f8c4c0b60e0 2023-12-20T04:47:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.086+0000 7f8c5087a640 1 -- 172.21.15.132:0/818507332 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c4402cc80 con 0x7f8c4c0b60e0 2023-12-20T04:47:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.086+0000 7f8c5087a640 1 -- 172.21.15.132:0/818507332 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c440343f0 con 0x7f8c4c0b60e0 2023-12-20T04:47:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.086+0000 7f8c53ae0640 1 -- 172.21.15.132:0/818507332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c4c0b60e0 msgr2=0x7f8c4c0b64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.086+0000 7f8c53ae0640 1 --2- 172.21.15.132:0/818507332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c4c0b60e0 0x7f8c4c0b64f0 secure :-1 s=READY pgs=1014 cs=0 l=1 rev1=1 crypto rx=0x7f8c4c0d0560 tx=0x7f8c4402bf80 comp rx=0 tx=0).stop 2023-12-20T04:47:12.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.087+0000 7f8c53ae0640 1 -- 172.21.15.132:0/818507332 shutdown_connections 2023-12-20T04:47:12.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.087+0000 7f8c53ae0640 1 --2- 172.21.15.132:0/818507332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c4c0b60e0 0x7f8c4c0b64f0 unknown :-1 s=CLOSED pgs=1014 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.087+0000 7f8c53ae0640 1 --2- 172.21.15.132:0/818507332 >> v2:172.21.15.187:3300/0 conn(0x7f8c4c0cf880 0x7f8c4c0cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.087+0000 7f8c53ae0640 1 -- 172.21.15.132:0/818507332 >> 172.21.15.132:0/818507332 conn(0x7f8c4c06a3d0 msgr2=0x7f8c4c06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:12.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.087+0000 7f8c53ae0640 1 -- 172.21.15.132:0/818507332 shutdown_connections 2023-12-20T04:47:12.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.087+0000 7f8c53ae0640 1 -- 172.21.15.132:0/818507332 wait complete. 2023-12-20T04:47:12.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.088+0000 7f8c53ae0640 1 Processor -- start 2023-12-20T04:47:12.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.088+0000 7f8c53ae0640 1 -- start start 2023-12-20T04:47:12.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.088+0000 7f8c53ae0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c4c0b60e0 0x7f8c4c0c88f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.088+0000 7f8c53ae0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c4c0cf880 0x7f8c4c0c6c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.088+0000 7f8c53ae0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c4c15d300 0x7f8c4c0b3330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c53ae0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c0c7800 con 0x7f8c4c15d300 2023-12-20T04:47:12.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c53ae0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c0c8e30 con 0x7f8c4c0cf880 2023-12-20T04:47:12.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c53ae0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8c4c0c9f40 con 0x7f8c4c0b60e0 2023-12-20T04:47:12.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c5207d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c4c15d300 0x7f8c4c0b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c5207d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c4c15d300 0x7f8c4c0b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34806/0 (socket says 172.21.15.132:34806) 2023-12-20T04:47:12.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c5207d640 1 -- 172.21.15.132:0/1677668128 learned_addr learned my addr 172.21.15.132:0/1677668128 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:12.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c5187c640 1 --2- 172.21.15.132:0/1677668128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c4c0b60e0 0x7f8c4c0c88f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c5107b640 1 --2- 172.21.15.132:0/1677668128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c4c0cf880 0x7f8c4c0c6c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c5207d640 1 -- 172.21.15.132:0/1677668128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c4c0b60e0 msgr2=0x7f8c4c0c88f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c5207d640 1 --2- 172.21.15.132:0/1677668128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c4c0b60e0 0x7f8c4c0c88f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c5207d640 1 -- 172.21.15.132:0/1677668128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c4c0cf880 msgr2=0x7f8c4c0c6c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c5207d640 1 --2- 172.21.15.132:0/1677668128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c4c0cf880 0x7f8c4c0c6c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c5207d640 1 -- 172.21.15.132:0/1677668128 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c44009b30 con 0x7f8c4c15d300 2023-12-20T04:47:12.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c5207d640 1 --2- 172.21.15.132:0/1677668128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c4c15d300 0x7f8c4c0b3330 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f8c44036040 tx=0x7f8c44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:12.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c427fc640 1 -- 172.21.15.132:0/1677668128 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c44007e70 con 0x7f8c4c15d300 2023-12-20T04:47:12.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c427fc640 1 -- 172.21.15.132:0/1677668128 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8c44009510 con 0x7f8c4c15d300 2023-12-20T04:47:12.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c427fc640 1 -- 172.21.15.132:0/1677668128 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8c4403e690 con 0x7f8c4c15d300 2023-12-20T04:47:12.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c53ae0640 1 -- 172.21.15.132:0/1677668128 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c4c0ca190 con 0x7f8c4c15d300 2023-12-20T04:47:12.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.089+0000 7f8c53ae0640 1 -- 172.21.15.132:0/1677668128 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c4c0ca520 con 0x7f8c4c15d300 2023-12-20T04:47:12.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.090+0000 7f8c53ae0640 1 -- 172.21.15.132:0/1677668128 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c4c04e840 con 0x7f8c4c15d300 2023-12-20T04:47:12.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.091+0000 7f8c427fc640 1 -- 172.21.15.132:0/1677668128 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8c4403e7f0 con 0x7f8c4c15d300 2023-12-20T04:47:12.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.091+0000 7f8c427fc640 1 --2- 172.21.15.132:0/1677668128 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8c3006a430 0x7f8c3006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.091+0000 7f8c5187c640 1 --2- 172.21.15.132:0/1677668128 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8c3006a430 0x7f8c3006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.091+0000 7f8c427fc640 1 -- 172.21.15.132:0/1677668128 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(99..99 src has 1..99) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f8c440ab590 con 0x7f8c4c15d300 2023-12-20T04:47:12.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.092+0000 7f8c5187c640 1 --2- 172.21.15.132:0/1677668128 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8c3006a430 0x7f8c3006c8f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8c48000f60 tx=0x7f8c48009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:12.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.096+0000 7f8c427fc640 1 -- 172.21.15.132:0/1677668128 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8c44076db0 con 0x7f8c4c15d300 2023-12-20T04:47:12.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.297+0000 7f8c53ae0640 1 -- 172.21.15.132:0/1677668128 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f8c4c1547a0 con 0x7f8c4c15d300 2023-12-20T04:47:12.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.308+0000 7f8c427fc640 1 -- 172.21.15.132:0/1677668128 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 12 and data pool 13 v36) v1 ==== 174+0+0 (secure 0 0 0) 0x7f8c4407a3d0 con 0x7f8c4c15d300 2023-12-20T04:47:12.311 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 12 and data pool 13 2023-12-20T04:47:12.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.315+0000 7f8c53ae0640 1 -- 172.21.15.132:0/1677668128 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8c3006a430 msgr2=0x7f8c3006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.315+0000 7f8c53ae0640 1 --2- 172.21.15.132:0/1677668128 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8c3006a430 0x7f8c3006c8f0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7f8c48000f60 tx=0x7f8c48009040 comp rx=0 tx=0).stop 2023-12-20T04:47:12.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.315+0000 7f8c53ae0640 1 -- 172.21.15.132:0/1677668128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c4c15d300 msgr2=0x7f8c4c0b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.315+0000 7f8c53ae0640 1 --2- 172.21.15.132:0/1677668128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c4c15d300 0x7f8c4c0b3330 secure :-1 s=READY pgs=1015 cs=0 l=1 rev1=1 crypto rx=0x7f8c44036040 tx=0x7f8c44004a40 comp rx=0 tx=0).stop 2023-12-20T04:47:12.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.317+0000 7f8c53ae0640 1 -- 172.21.15.132:0/1677668128 shutdown_connections 2023-12-20T04:47:12.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.317+0000 7f8c53ae0640 1 --2- 172.21.15.132:0/1677668128 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8c3006a430 0x7f8c3006c8f0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.317+0000 7f8c53ae0640 1 --2- 172.21.15.132:0/1677668128 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8c4c15d300 0x7f8c4c0b3330 unknown :-1 s=CLOSED pgs=1015 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.318+0000 7f8c53ae0640 1 --2- 172.21.15.132:0/1677668128 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8c4c0cf880 0x7f8c4c0c6c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.318+0000 7f8c53ae0640 1 --2- 172.21.15.132:0/1677668128 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8c4c0b60e0 0x7f8c4c0c88f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.318+0000 7f8c53ae0640 1 -- 172.21.15.132:0/1677668128 >> 172.21.15.132:0/1677668128 conn(0x7f8c4c06a3d0 msgr2=0x7f8c4c06a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:12.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.319+0000 7f8c53ae0640 1 -- 172.21.15.132:0/1677668128 shutdown_connections 2023-12-20T04:47:12.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.319+0000 7f8c53ae0640 1 -- 172.21.15.132:0/1677668128 wait complete. 2023-12-20T04:47:12.333 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:47:12.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.432+0000 7f855f939640 1 Processor -- start 2023-12-20T04:47:12.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.432+0000 7f855f939640 1 -- start start 2023-12-20T04:47:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.433+0000 7f855f939640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f85580b4980 0x7f85580b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.433+0000 7f855f939640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85580d1aa0 0x7f85580d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.433+0000 7f855f939640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f85580b5320 con 0x7f8558160450 2023-12-20T04:47:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.433+0000 7f855f939640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f85580b5ec0 con 0x7f85580b4980 2023-12-20T04:47:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.433+0000 7f855f939640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f85581617e0 con 0x7f85580d1aa0 2023-12-20T04:47:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.433+0000 7f855ced4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f85580b4980 0x7f85580b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.433+0000 7f855ced4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f85580b4980 0x7f85580b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34818/0 (socket says 172.21.15.132:34818) 2023-12-20T04:47:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.433+0000 7f855ced4640 1 -- 172.21.15.132:0/923157728 learned_addr learned my addr 172.21.15.132:0/923157728 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.433+0000 7f855ded6640 1 --2- 172.21.15.132:0/923157728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85580d1aa0 0x7f85580d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.433+0000 7f855ced4640 1 -- 172.21.15.132:0/923157728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85580d1aa0 msgr2=0x7f85580d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.433+0000 7f855ced4640 1 --2- 172.21.15.132:0/923157728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85580d1aa0 0x7f85580d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.433+0000 7f855ced4640 1 -- 172.21.15.132:0/923157728 >> v1:172.21.15.187:6789/0 conn(0x7f8558160450 legacy=0x7f8558160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.433+0000 7f855ced4640 1 -- 172.21.15.132:0/923157728 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85580d0fc0 con 0x7f85580b4980 2023-12-20T04:47:12.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.434+0000 7f855ced4640 1 --2- 172.21.15.132:0/923157728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85580b4980 0x7f85580b4de0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f8548009870 tx=0x7f854802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f0df2d36d4aa001c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:12.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.434+0000 7f854ffff640 1 -- 172.21.15.132:0/923157728 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854802f840 con 0x7f85580b4980 2023-12-20T04:47:12.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.434+0000 7f854ffff640 1 -- 172.21.15.132:0/923157728 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f854802f9a0 con 0x7f85580b4980 2023-12-20T04:47:12.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.434+0000 7f854ffff640 1 -- 172.21.15.132:0/923157728 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f854802fd30 con 0x7f85580b4980 2023-12-20T04:47:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.435+0000 7f855f939640 1 -- 172.21.15.132:0/923157728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85580b4980 msgr2=0x7f85580b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.435+0000 7f855f939640 1 --2- 172.21.15.132:0/923157728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85580b4980 0x7f85580b4de0 secure :-1 s=READY pgs=1016 cs=0 l=1 rev1=1 crypto rx=0x7f8548009870 tx=0x7f854802ba20 comp rx=0 tx=0).stop 2023-12-20T04:47:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.435+0000 7f855f939640 1 -- 172.21.15.132:0/923157728 shutdown_connections 2023-12-20T04:47:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.435+0000 7f855f939640 1 --2- 172.21.15.132:0/923157728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85580d1aa0 0x7f85580d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.435+0000 7f855f939640 1 --2- 172.21.15.132:0/923157728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85580b4980 0x7f85580b4de0 unknown :-1 s=CLOSED pgs=1016 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.435+0000 7f855f939640 1 -- 172.21.15.132:0/923157728 >> 172.21.15.132:0/923157728 conn(0x7f85580cf980 msgr2=0x7f85580cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.435+0000 7f855f939640 1 -- 172.21.15.132:0/923157728 shutdown_connections 2023-12-20T04:47:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.435+0000 7f855f939640 1 -- 172.21.15.132:0/923157728 wait complete. 2023-12-20T04:47:12.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.436+0000 7f855f939640 1 Processor -- start 2023-12-20T04:47:12.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.436+0000 7f855f939640 1 -- start start 2023-12-20T04:47:12.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855f939640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85580b4980 0x7f855815b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855f939640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85580d1aa0 0x7f855806a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855f939640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8558160450 0x7f8558151fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855f939640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f85581580a0 con 0x7f85580d1aa0 2023-12-20T04:47:12.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855f939640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8558157420 con 0x7f8558160450 2023-12-20T04:47:12.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855f939640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8558157700 con 0x7f85580b4980 2023-12-20T04:47:12.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855ced4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85580d1aa0 0x7f855806a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855ced4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85580d1aa0 0x7f855806a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34828/0 (socket says 172.21.15.132:34828) 2023-12-20T04:47:12.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855ced4640 1 -- 172.21.15.132:0/2112078979 learned_addr learned my addr 172.21.15.132:0/2112078979 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:12.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855d6d5640 1 --2- 172.21.15.132:0/2112078979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85580b4980 0x7f855815b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855ded6640 1 --2- 172.21.15.132:0/2112078979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8558160450 0x7f8558151fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855ced4640 1 -- 172.21.15.132:0/2112078979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85580b4980 msgr2=0x7f855815b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855ced4640 1 --2- 172.21.15.132:0/2112078979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85580b4980 0x7f855815b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855ced4640 1 -- 172.21.15.132:0/2112078979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8558160450 msgr2=0x7f8558151fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855ced4640 1 --2- 172.21.15.132:0/2112078979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8558160450 0x7f8558151fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855ced4640 1 -- 172.21.15.132:0/2112078979 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f85480094d0 con 0x7f85580d1aa0 2023-12-20T04:47:12.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855d6d5640 1 --2- 172.21.15.132:0/2112078979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85580b4980 0x7f855815b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:12.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855ced4640 1 --2- 172.21.15.132:0/2112078979 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85580d1aa0 0x7f855806a410 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f8548000c00 tx=0x7f8548004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:12.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f854dffb640 1 -- 172.21.15.132:0/2112078979 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548037c40 con 0x7f85580d1aa0 2023-12-20T04:47:12.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f854dffb640 1 -- 172.21.15.132:0/2112078979 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8548037da0 con 0x7f85580d1aa0 2023-12-20T04:47:12.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f855f939640 1 -- 172.21.15.132:0/2112078979 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f85581579e0 con 0x7f85580d1aa0 2023-12-20T04:47:12.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.437+0000 7f854dffb640 1 -- 172.21.15.132:0/2112078979 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8548041640 con 0x7f85580d1aa0 2023-12-20T04:47:12.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.438+0000 7f855f939640 1 -- 172.21.15.132:0/2112078979 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f855815be90 con 0x7f85580d1aa0 2023-12-20T04:47:12.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.439+0000 7f855f939640 1 -- 172.21.15.132:0/2112078979 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f85581581e0 con 0x7f85580d1aa0 2023-12-20T04:47:12.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.439+0000 7f854dffb640 1 -- 172.21.15.132:0/2112078979 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f85480417a0 con 0x7f85580d1aa0 2023-12-20T04:47:12.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.439+0000 7f854dffb640 1 --2- 172.21.15.132:0/2112078979 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f853c06a430 0x7f853c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.440+0000 7f854dffb640 1 -- 172.21.15.132:0/2112078979 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f854803c070 con 0x7f85580d1aa0 2023-12-20T04:47:12.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.440+0000 7f855d6d5640 1 --2- 172.21.15.132:0/2112078979 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f853c06a430 0x7f853c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.440+0000 7f855d6d5640 1 --2- 172.21.15.132:0/2112078979 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f853c06a430 0x7f853c06c8f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8554000f60 tx=0x7f8554009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:12.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.444+0000 7f854dffb640 1 -- 172.21.15.132:0/2112078979 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f85581581e0 con 0x7f85580d1aa0 2023-12-20T04:47:12.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.610+0000 7f855f939640 1 -- 172.21.15.132:0/2112078979 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f85581581e0 con 0x7f85580d1aa0 2023-12-20T04:47:12.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.612+0000 7f854dffb640 1 -- 172.21.15.132:0/2112078979 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16156 (secure 0 0 0) 0x7f85581581e0 con 0x7f85580d1aa0 2023-12-20T04:47:12.614 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:12.614 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":100,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:47:12.299328+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:47:10.649946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-20T04:47:11.271933+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:47:12.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.613+0000 7f855f939640 1 -- 172.21.15.132:0/2112078979 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f853c06a430 msgr2=0x7f853c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.613+0000 7f855f939640 1 --2- 172.21.15.132:0/2112078979 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f853c06a430 0x7f853c06c8f0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7f8554000f60 tx=0x7f8554009040 comp rx=0 tx=0).stop 2023-12-20T04:47:12.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.613+0000 7f855f939640 1 -- 172.21.15.132:0/2112078979 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85580d1aa0 msgr2=0x7f855806a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.613+0000 7f855f939640 1 --2- 172.21.15.132:0/2112078979 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85580d1aa0 0x7f855806a410 secure :-1 s=READY pgs=1017 cs=0 l=1 rev1=1 crypto rx=0x7f8548000c00 tx=0x7f8548004730 comp rx=0 tx=0).stop 2023-12-20T04:47:12.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.613+0000 7f855f939640 1 -- 172.21.15.132:0/2112078979 shutdown_connections 2023-12-20T04:47:12.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.613+0000 7f855f939640 1 --2- 172.21.15.132:0/2112078979 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f853c06a430 0x7f853c06c8f0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.613+0000 7f855f939640 1 --2- 172.21.15.132:0/2112078979 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8558160450 0x7f8558151fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.614+0000 7f855f939640 1 --2- 172.21.15.132:0/2112078979 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f85580d1aa0 0x7f855806a410 unknown :-1 s=CLOSED pgs=1017 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.614+0000 7f855f939640 1 --2- 172.21.15.132:0/2112078979 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f85580b4980 0x7f855815b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.614+0000 7f855f939640 1 -- 172.21.15.132:0/2112078979 >> 172.21.15.132:0/2112078979 conn(0x7f85580cf980 msgr2=0x7f85580b6940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:12.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.614+0000 7f855f939640 1 -- 172.21.15.132:0/2112078979 shutdown_connections 2023-12-20T04:47:12.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.614+0000 7f855f939640 1 -- 172.21.15.132:0/2112078979 wait complete. 2023-12-20T04:47:12.627 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:47:12.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.724+0000 7fbd3dba7640 1 Processor -- start 2023-12-20T04:47:12.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.724+0000 7fbd3dba7640 1 -- start start 2023-12-20T04:47:12.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.725+0000 7fbd3dba7640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbd380d0370 0x7fbd380b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.725+0000 7fbd3dba7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbd380cdc10 0x7fbd3806c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.725+0000 7fbd3dba7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd380b2f90 con 0x7fbd3815d100 2023-12-20T04:47:12.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.725+0000 7fbd3dba7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd381613c0 con 0x7fbd380cdc10 2023-12-20T04:47:12.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.725+0000 7fbd3dba7640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd380d1b00 con 0x7fbd380d0370 2023-12-20T04:47:12.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.725+0000 7fbd37fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbd380cdc10 0x7fbd3806c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.725+0000 7fbd377fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbd3815d100 0x7fbd380cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35520/0 (socket says 172.21.15.132:35520) 2023-12-20T04:47:12.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.725+0000 7fbd377fe640 1 -- 172.21.15.132:0/1475632970 learned_addr learned my addr 172.21.15.132:0/1475632970 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:12.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.726+0000 7fbd2effd640 1 --2- 172.21.15.132:0/1475632970 >> v2:172.21.15.187:3300/0 conn(0x7fbd380d0370 0x7fbd380b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.726+0000 7fbd37fff640 1 -- 172.21.15.132:0/1475632970 >> v2:172.21.15.187:3300/0 conn(0x7fbd380d0370 msgr2=0x7fbd380b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:12.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.726+0000 7fbd37fff640 1 --2- 172.21.15.132:0/1475632970 >> v2:172.21.15.187:3300/0 conn(0x7fbd380d0370 0x7fbd380b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.726+0000 7fbd37fff640 1 -- 172.21.15.132:0/1475632970 >> v1:172.21.15.132:6789/0 conn(0x7fbd3815d100 legacy=0x7fbd380cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.726+0000 7fbd36ffd640 1 -- 172.21.15.132:0/1475632970 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3107303502 0 0) 0x7fbd28001110 con 0x7fbd3815d100 2023-12-20T04:47:12.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.726+0000 7fbd37fff640 1 -- 172.21.15.132:0/1475632970 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd380d0810 con 0x7fbd380cdc10 2023-12-20T04:47:12.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.726+0000 7fbd2effd640 1 --2- 172.21.15.132:0/1475632970 >> v2:172.21.15.187:3300/0 conn(0x7fbd380d0370 0x7fbd380b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:12.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.726+0000 7fbd37fff640 1 --2- 172.21.15.132:0/1475632970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd380cdc10 0x7fbd3806c190 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fbd3806d6c0 tx=0x7fbd3002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bbd811bb5d8ae092 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:12.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.727+0000 7fbd36ffd640 1 -- 172.21.15.132:0/1475632970 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd3002cc80 con 0x7fbd380cdc10 2023-12-20T04:47:12.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.727+0000 7fbd36ffd640 1 -- 172.21.15.132:0/1475632970 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd3002cde0 con 0x7fbd380cdc10 2023-12-20T04:47:12.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.727+0000 7fbd36ffd640 1 -- 172.21.15.132:0/1475632970 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd30034660 con 0x7fbd380cdc10 2023-12-20T04:47:12.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.727+0000 7fbd3dba7640 1 -- 172.21.15.132:0/1475632970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd380cdc10 msgr2=0x7fbd3806c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.727+0000 7fbd3dba7640 1 --2- 172.21.15.132:0/1475632970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd380cdc10 0x7fbd3806c190 secure :-1 s=READY pgs=1019 cs=0 l=1 rev1=1 crypto rx=0x7fbd3806d6c0 tx=0x7fbd3002bed0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.727+0000 7fbd3dba7640 1 -- 172.21.15.132:0/1475632970 shutdown_connections 2023-12-20T04:47:12.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.727+0000 7fbd3dba7640 1 --2- 172.21.15.132:0/1475632970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd380cdc10 0x7fbd3806c190 unknown :-1 s=CLOSED pgs=1019 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.727+0000 7fbd3dba7640 1 --2- 172.21.15.132:0/1475632970 >> v2:172.21.15.187:3300/0 conn(0x7fbd380d0370 0x7fbd380b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.727+0000 7fbd3dba7640 1 -- 172.21.15.132:0/1475632970 >> 172.21.15.132:0/1475632970 conn(0x7fbd3806d7c0 msgr2=0x7fbd3806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:12.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.727+0000 7fbd3dba7640 1 -- 172.21.15.132:0/1475632970 shutdown_connections 2023-12-20T04:47:12.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.727+0000 7fbd3dba7640 1 -- 172.21.15.132:0/1475632970 wait complete. 2023-12-20T04:47:12.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.728+0000 7fbd3dba7640 1 Processor -- start 2023-12-20T04:47:12.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.729+0000 7fbd3dba7640 1 -- start start 2023-12-20T04:47:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.729+0000 7fbd3dba7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd380cdc10 0x7fbd3815bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.729+0000 7fbd3dba7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd380d0370 0x7fbd381e6ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.729+0000 7fbd3dba7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd3815d100 0x7fbd380b5580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.729+0000 7fbd3dba7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3815f390 con 0x7fbd380cdc10 2023-12-20T04:47:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.729+0000 7fbd3dba7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3815f670 con 0x7fbd380d0370 2023-12-20T04:47:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.729+0000 7fbd3dba7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd3815f950 con 0x7fbd3815d100 2023-12-20T04:47:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.729+0000 7fbd377fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd380cdc10 0x7fbd3815bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.729+0000 7fbd377fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd380cdc10 0x7fbd3815bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34834/0 (socket says 172.21.15.132:34834) 2023-12-20T04:47:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.729+0000 7fbd377fe640 1 -- 172.21.15.132:0/439873091 learned_addr learned my addr 172.21.15.132:0/439873091 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.730+0000 7fbd2effd640 1 --2- 172.21.15.132:0/439873091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd380d0370 0x7fbd381e6ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.730+0000 7fbd37fff640 1 --2- 172.21.15.132:0/439873091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd3815d100 0x7fbd380b5580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.730+0000 7fbd377fe640 1 -- 172.21.15.132:0/439873091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd3815d100 msgr2=0x7fbd380b5580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.730+0000 7fbd377fe640 1 --2- 172.21.15.132:0/439873091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd3815d100 0x7fbd380b5580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.730+0000 7fbd377fe640 1 -- 172.21.15.132:0/439873091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd380d0370 msgr2=0x7fbd381e6ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.730+0000 7fbd377fe640 1 --2- 172.21.15.132:0/439873091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd380d0370 0x7fbd381e6ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.730+0000 7fbd377fe640 1 -- 172.21.15.132:0/439873091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd30009a70 con 0x7fbd380cdc10 2023-12-20T04:47:12.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.730+0000 7fbd377fe640 1 --2- 172.21.15.132:0/439873091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd380cdc10 0x7fbd3815bb80 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800c780 tx=0x7fbd2800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:12.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.730+0000 7fbd34ff9640 1 -- 172.21.15.132:0/439873091 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd280072d0 con 0x7fbd380cdc10 2023-12-20T04:47:12.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.730+0000 7fbd34ff9640 1 -- 172.21.15.132:0/439873091 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd28007450 con 0x7fbd380cdc10 2023-12-20T04:47:12.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.730+0000 7fbd3dba7640 1 -- 172.21.15.132:0/439873091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd3815fc30 con 0x7fbd380cdc10 2023-12-20T04:47:12.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.730+0000 7fbd34ff9640 1 -- 172.21.15.132:0/439873091 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd280047e0 con 0x7fbd380cdc10 2023-12-20T04:47:12.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.730+0000 7fbd3dba7640 1 -- 172.21.15.132:0/439873091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd3815c0c0 con 0x7fbd380cdc10 2023-12-20T04:47:12.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.731+0000 7fbd3dba7640 1 -- 172.21.15.132:0/439873091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd38160150 con 0x7fbd380cdc10 2023-12-20T04:47:12.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.731+0000 7fbd34ff9640 1 -- 172.21.15.132:0/439873091 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbd28004960 con 0x7fbd380cdc10 2023-12-20T04:47:12.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.732+0000 7fbd34ff9640 1 --2- 172.21.15.132:0/439873091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd1806a430 0x7fbd1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:12.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.732+0000 7fbd34ff9640 1 -- 172.21.15.132:0/439873091 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbd28087cb0 con 0x7fbd380cdc10 2023-12-20T04:47:12.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.732+0000 7fbd2effd640 1 --2- 172.21.15.132:0/439873091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd1806a430 0x7fbd1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:12.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.732+0000 7fbd2effd640 1 --2- 172.21.15.132:0/439873091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd1806a430 0x7fbd1806c8f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbd380cac80 tx=0x7fbd20008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:12.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.736+0000 7fbd34ff9640 1 -- 172.21.15.132:0/439873091 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbd38160150 con 0x7fbd380cdc10 2023-12-20T04:47:12.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.905+0000 7fbd3dba7640 1 -- 172.21.15.132:0/439873091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbd380b2f90 con 0x7fbd380cdc10 2023-12-20T04:47:12.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.906+0000 7fbd34ff9640 1 -- 172.21.15.132:0/439873091 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v100) v1 ==== 74+0+16156 (secure 0 0 0) 0x7fbd380b2f90 con 0x7fbd380cdc10 2023-12-20T04:47:12.908 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:12.908 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":100,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:47:12.299328+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:47:10.649946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-20T04:47:11.271933+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:47:12.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.908+0000 7fbd3dba7640 1 -- 172.21.15.132:0/439873091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd1806a430 msgr2=0x7fbd1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.908+0000 7fbd3dba7640 1 --2- 172.21.15.132:0/439873091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd1806a430 0x7fbd1806c8f0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fbd380cac80 tx=0x7fbd20008040 comp rx=0 tx=0).stop 2023-12-20T04:47:12.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.908+0000 7fbd3dba7640 1 -- 172.21.15.132:0/439873091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd380cdc10 msgr2=0x7fbd3815bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:12.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.908+0000 7fbd3dba7640 1 --2- 172.21.15.132:0/439873091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd380cdc10 0x7fbd3815bb80 secure :-1 s=READY pgs=1020 cs=0 l=1 rev1=1 crypto rx=0x7fbd2800c780 tx=0x7fbd2800cc40 comp rx=0 tx=0).stop 2023-12-20T04:47:12.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.908+0000 7fbd3dba7640 1 -- 172.21.15.132:0/439873091 shutdown_connections 2023-12-20T04:47:12.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.908+0000 7fbd3dba7640 1 --2- 172.21.15.132:0/439873091 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd1806a430 0x7fbd1806c8f0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.908+0000 7fbd3dba7640 1 --2- 172.21.15.132:0/439873091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd3815d100 0x7fbd380b5580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.908+0000 7fbd3dba7640 1 --2- 172.21.15.132:0/439873091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd380d0370 0x7fbd381e6ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.908+0000 7fbd3dba7640 1 --2- 172.21.15.132:0/439873091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd380cdc10 0x7fbd3815bb80 unknown :-1 s=CLOSED pgs=1020 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:12.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.908+0000 7fbd3dba7640 1 -- 172.21.15.132:0/439873091 >> 172.21.15.132:0/439873091 conn(0x7fbd3806d7c0 msgr2=0x7fbd380cb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:12.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.908+0000 7fbd3dba7640 1 -- 172.21.15.132:0/439873091 shutdown_connections 2023-12-20T04:47:12.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:12.908+0000 7fbd3dba7640 1 -- 172.21.15.132:0/439873091 wait complete. 2023-12-20T04:47:12.921 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-20T04:47:13.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.022+0000 7f172def7640 1 Processor -- start 2023-12-20T04:47:13.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.022+0000 7f172def7640 1 -- start start 2023-12-20T04:47:13.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.023+0000 7f172def7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f172815d260 0x7f17280cee40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:13.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.023+0000 7f172def7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17280b3a50 con 0x7f17280cbed0 2023-12-20T04:47:13.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.023+0000 7f172def7640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17280cffe0 con 0x7f17280cd480 2023-12-20T04:47:13.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.023+0000 7f172def7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17280d02c0 con 0x7f172815d260 2023-12-20T04:47:13.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.023+0000 7f17277fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f172815d260 0x7f17280cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.023+0000 7f1727fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f17280cbed0 0x7f17280cc340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35536/0 (socket says 172.21.15.132:35536) 2023-12-20T04:47:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.023+0000 7f1727fff640 1 -- 172.21.15.132:0/1109113731 learned_addr learned my addr 172.21.15.132:0/1109113731 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.023+0000 7f17277fe640 1 -- 172.21.15.132:0/1109113731 >> v1:172.21.15.187:6789/0 conn(0x7f17280cd480 legacy=0x7f17280cd910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.023+0000 7f17277fe640 1 -- 172.21.15.132:0/1109113731 >> v1:172.21.15.132:6789/0 conn(0x7f17280cbed0 legacy=0x7f17280cc340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.023+0000 7f17267fc640 1 -- 172.21.15.132:0/1109113731 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3660078590 0 0) 0x7f17280b3a50 con 0x7f17280cbed0 2023-12-20T04:47:13.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.023+0000 7f17277fe640 1 -- 172.21.15.132:0/1109113731 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17280cb3f0 con 0x7f172815d260 2023-12-20T04:47:13.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.024+0000 7f17277fe640 1 --2- 172.21.15.132:0/1109113731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f172815d260 0x7f17280cee40 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f17180097a0 tx=0x7f171802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d85cd3080ad8174 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:13.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.024+0000 7f17267fc640 1 -- 172.21.15.132:0/1109113731 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718030610 con 0x7f172815d260 2023-12-20T04:47:13.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.024+0000 7f17267fc640 1 -- 172.21.15.132:0/1109113731 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1718030770 con 0x7f172815d260 2023-12-20T04:47:13.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.024+0000 7f17267fc640 1 -- 172.21.15.132:0/1109113731 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1718030b00 con 0x7f172815d260 2023-12-20T04:47:13.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.025+0000 7f172def7640 1 -- 172.21.15.132:0/1109113731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f172815d260 msgr2=0x7f17280cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:13.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.025+0000 7f172def7640 1 --2- 172.21.15.132:0/1109113731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f172815d260 0x7f17280cee40 secure :-1 s=READY pgs=1022 cs=0 l=1 rev1=1 crypto rx=0x7f17180097a0 tx=0x7f171802b960 comp rx=0 tx=0).stop 2023-12-20T04:47:13.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.025+0000 7f172def7640 1 -- 172.21.15.132:0/1109113731 shutdown_connections 2023-12-20T04:47:13.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.025+0000 7f172def7640 1 --2- 172.21.15.132:0/1109113731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f172815d260 0x7f17280cee40 unknown :-1 s=CLOSED pgs=1022 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:13.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.025+0000 7f172def7640 1 -- 172.21.15.132:0/1109113731 >> 172.21.15.132:0/1109113731 conn(0x7f1728099f60 msgr2=0x7f17280d0c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:13.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.025+0000 7f172def7640 1 -- 172.21.15.132:0/1109113731 shutdown_connections 2023-12-20T04:47:13.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.025+0000 7f172def7640 1 -- 172.21.15.132:0/1109113731 wait complete. 2023-12-20T04:47:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.026+0000 7f172def7640 1 Processor -- start 2023-12-20T04:47:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.026+0000 7f172def7640 1 -- start start 2023-12-20T04:47:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f172def7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17280cbed0 0x7f172815f0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f172def7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17280cd480 0x7f17281593d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:13.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f172def7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f172815d260 0x7f172806b070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f172def7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172815f5e0 con 0x7f17280cd480 2023-12-20T04:47:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f172def7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1728159910 con 0x7f17280cbed0 2023-12-20T04:47:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f172def7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17280c9820 con 0x7f172815d260 2023-12-20T04:47:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f1726ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17280cd480 0x7f17281593d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f1726ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17280cd480 0x7f17281593d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34854/0 (socket says 172.21.15.132:34854) 2023-12-20T04:47:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f1726ffd640 1 -- 172.21.15.132:0/3332851184 learned_addr learned my addr 172.21.15.132:0/3332851184 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f1726ffd640 1 -- 172.21.15.132:0/3332851184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f172815d260 msgr2=0x7f172806b070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f17277fe640 1 --2- 172.21.15.132:0/3332851184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17280cbed0 0x7f172815f0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f1727fff640 1 --2- 172.21.15.132:0/3332851184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f172815d260 0x7f172806b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f1726ffd640 1 --2- 172.21.15.132:0/3332851184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f172815d260 0x7f172806b070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f1726ffd640 1 -- 172.21.15.132:0/3332851184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17280cbed0 msgr2=0x7f172815f0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f1726ffd640 1 --2- 172.21.15.132:0/3332851184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17280cbed0 0x7f172815f0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f1726ffd640 1 -- 172.21.15.132:0/3332851184 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1718009400 con 0x7f17280cd480 2023-12-20T04:47:13.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f17277fe640 1 --2- 172.21.15.132:0/3332851184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17280cbed0 0x7f172815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:13.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f1727fff640 1 --2- 172.21.15.132:0/3332851184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f172815d260 0x7f172806b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:13.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.027+0000 7f1726ffd640 1 --2- 172.21.15.132:0/3332851184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17280cd480 0x7f17281593d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f171c00c400 tx=0x7f171c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:13.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.028+0000 7f170ffff640 1 -- 172.21.15.132:0/3332851184 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c0052d0 con 0x7f17280cd480 2023-12-20T04:47:13.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.028+0000 7f170ffff640 1 -- 172.21.15.132:0/3332851184 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f171c005430 con 0x7f17280cd480 2023-12-20T04:47:13.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.028+0000 7f172def7640 1 -- 172.21.15.132:0/3332851184 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17280c9b00 con 0x7f17280cd480 2023-12-20T04:47:13.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.028+0000 7f170ffff640 1 -- 172.21.15.132:0/3332851184 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f171c003830 con 0x7f17280cd480 2023-12-20T04:47:13.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.028+0000 7f172def7640 1 -- 172.21.15.132:0/3332851184 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17280ca0c0 con 0x7f17280cd480 2023-12-20T04:47:13.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.029+0000 7f172def7640 1 -- 172.21.15.132:0/3332851184 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172804e840 con 0x7f17280cd480 2023-12-20T04:47:13.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.029+0000 7f170ffff640 1 -- 172.21.15.132:0/3332851184 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f171c003990 con 0x7f17280cd480 2023-12-20T04:47:13.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.029+0000 7f170ffff640 1 --2- 172.21.15.132:0/3332851184 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f171406a430 0x7f171406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:13.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.030+0000 7f17277fe640 1 --2- 172.21.15.132:0/3332851184 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f171406a430 0x7f171406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:13.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.030+0000 7f170ffff640 1 -- 172.21.15.132:0/3332851184 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(100..100 src has 1..100) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f171c087e30 con 0x7f17280cd480 2023-12-20T04:47:13.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.030+0000 7f17277fe640 1 --2- 172.21.15.132:0/3332851184 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f171406a430 0x7f171406c8f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1718036000 tx=0x7f171803b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:13.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.034+0000 7f170ffff640 1 -- 172.21.15.132:0/3332851184 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f171c0534b0 con 0x7f17280cd480 2023-12-20T04:47:13.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.233+0000 7f172def7640 1 -- 172.21.15.132:0/3332851184 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f172806d8f0 con 0x7f17280cd480 2023-12-20T04:47:13.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.308+0000 7f170ffff640 1 -- 172.21.15.132:0/3332851184 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v37) v1 ==== 118+0+0 (secure 0 0 0) 0x7f171c056ad0 con 0x7f17280cd480 2023-12-20T04:47:13.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.310+0000 7f172def7640 1 -- 172.21.15.132:0/3332851184 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f171406a430 msgr2=0x7f171406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:13.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.310+0000 7f172def7640 1 --2- 172.21.15.132:0/3332851184 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f171406a430 0x7f171406c8f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1718036000 tx=0x7f171803b040 comp rx=0 tx=0).stop 2023-12-20T04:47:13.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.310+0000 7f172def7640 1 -- 172.21.15.132:0/3332851184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17280cd480 msgr2=0x7f17281593d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:13.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.310+0000 7f172def7640 1 --2- 172.21.15.132:0/3332851184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17280cd480 0x7f17281593d0 secure :-1 s=READY pgs=1023 cs=0 l=1 rev1=1 crypto rx=0x7f171c00c400 tx=0x7f171c00c8c0 comp rx=0 tx=0).stop 2023-12-20T04:47:13.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.311+0000 7f172def7640 1 -- 172.21.15.132:0/3332851184 shutdown_connections 2023-12-20T04:47:13.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.311+0000 7f172def7640 1 --2- 172.21.15.132:0/3332851184 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f171406a430 0x7f171406c8f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:13.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.311+0000 7f172def7640 1 --2- 172.21.15.132:0/3332851184 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f172815d260 0x7f172806b070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:13.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.311+0000 7f172def7640 1 --2- 172.21.15.132:0/3332851184 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17280cd480 0x7f17281593d0 unknown :-1 s=CLOSED pgs=1023 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:13.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.311+0000 7f172def7640 1 --2- 172.21.15.132:0/3332851184 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17280cbed0 0x7f172815f0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:13.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.311+0000 7f172def7640 1 -- 172.21.15.132:0/3332851184 >> 172.21.15.132:0/3332851184 conn(0x7f1728099f60 msgr2=0x7f172815b380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:13.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.311+0000 7f172def7640 1 -- 172.21.15.132:0/3332851184 shutdown_connections 2023-12-20T04:47:13.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.311+0000 7f172def7640 1 -- 172.21.15.132:0/3332851184 wait complete. 2023-12-20T04:47:13.323 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-20T04:47:13.323 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-20T04:47:13.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.425+0000 7f272abc9640 1 Processor -- start 2023-12-20T04:47:13.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.425+0000 7f272abc9640 1 -- start start 2023-12-20T04:47:13.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.425+0000 7f272abc9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27240cb060 0x7f27240ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:13.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.425+0000 7f272abc9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27240cabd0 con 0x7f2724143510 2023-12-20T04:47:13.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.425+0000 7f272abc9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f27240c9fc0 con 0x7f27240c9a00 2023-12-20T04:47:13.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.425+0000 7f272abc9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27240ca2a0 con 0x7f27240cb060 2023-12-20T04:47:13.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f2728965640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2724143510 0x7f27240c52a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35544/0 (socket says 172.21.15.132:35544) 2023-12-20T04:47:13.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f2728965640 1 -- 172.21.15.132:0/3811121538 learned_addr learned my addr 172.21.15.132:0/3811121538 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:13.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f2723fff640 1 --2- 172.21.15.132:0/3811121538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27240cb060 0x7f27240ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:13.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f27237fe640 1 -- 172.21.15.132:0/3811121538 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213983606 0 0) 0x7f27240cabd0 con 0x7f2724143510 2023-12-20T04:47:13.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f27237fe640 1 -- 172.21.15.132:0/3811121538 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2714003520 con 0x7f2724143510 2023-12-20T04:47:13.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f27237fe640 1 -- 172.21.15.132:0/3811121538 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3044978656 0 0) 0x7f2714003520 con 0x7f2724143510 2023-12-20T04:47:13.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f27237fe640 1 -- 172.21.15.132:0/3811121538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27240cb060 msgr2=0x7f27240ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:13.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f27237fe640 1 --2- 172.21.15.132:0/3811121538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27240cb060 0x7f27240ccf80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:13.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f27237fe640 1 -- 172.21.15.132:0/3811121538 >> v1:172.21.15.187:6789/0 conn(0x7f27240c9a00 legacy=0x7f272406b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:13.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f27237fe640 1 -- 172.21.15.132:0/3811121538 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27240ca580 con 0x7f2724143510 2023-12-20T04:47:13.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f27237fe640 1 -- 172.21.15.132:0/3811121538 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f2718001670 con 0x7f2724143510 2023-12-20T04:47:13.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f27237fe640 1 -- 172.21.15.132:0/3811121538 >> v1:172.21.15.132:6789/0 conn(0x7f2724143510 legacy=0x7f27240c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:13.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f27237fe640 1 --2- 172.21.15.132:0/3811121538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27140039a0 0x7f2714003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:13.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f27237fe640 1 --2- 172.21.15.132:0/3811121538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27240cb060 0x7f27140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:13.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f27237fe640 1 --2- 172.21.15.132:0/3811121538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2714004d00 0x7f2714005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:13.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f27237fe640 1 -- 172.21.15.132:0/3811121538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27240ca2a0 con 0x7f2714004d00 2023-12-20T04:47:13.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f27237fe640 1 -- 172.21.15.132:0/3811121538 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f271400b980 con 0x7f27140039a0 2023-12-20T04:47:13.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f27237fe640 1 -- 172.21.15.132:0/3811121538 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f271400bb40 con 0x7f27240cb060 2023-12-20T04:47:13.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f2729166640 1 --2- 172.21.15.132:0/3811121538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2714004d00 0x7f2714005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:13.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f2728965640 1 --2- 172.21.15.132:0/3811121538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27140039a0 0x7f2714003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:13.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f2723fff640 1 --2- 172.21.15.132:0/3811121538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27240cb060 0x7f27140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:13.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.426+0000 7f2729166640 1 -- 172.21.15.132:0/3811121538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27240cb060 msgr2=0x7f27140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:13.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.427+0000 7f2729166640 1 --2- 172.21.15.132:0/3811121538 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27240cb060 0x7f27140047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:13.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.427+0000 7f2729166640 1 -- 172.21.15.132:0/3811121538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27140039a0 msgr2=0x7f2714003d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:13.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.427+0000 7f2729166640 1 --2- 172.21.15.132:0/3811121538 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f27140039a0 0x7f2714003d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:13.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.427+0000 7f2729166640 1 -- 172.21.15.132:0/3811121538 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714003520 con 0x7f2714004d00 2023-12-20T04:47:13.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.427+0000 7f2729166640 1 --2- 172.21.15.132:0/3811121538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2714004d00 0x7f2714005180 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f271c001f60 tx=0x7f27140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3baef68048b7c32a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:13.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.427+0000 7f27237fe640 1 -- 172.21.15.132:0/3811121538 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c02d6f0 con 0x7f2714004d00 2023-12-20T04:47:13.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.427+0000 7f27237fe640 1 -- 172.21.15.132:0/3811121538 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c02d870 con 0x7f2714004d00 2023-12-20T04:47:13.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.427+0000 7f27237fe640 1 -- 172.21.15.132:0/3811121538 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c02dc20 con 0x7f2714004d00 2023-12-20T04:47:13.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.428+0000 7f272abc9640 1 -- 172.21.15.132:0/3811121538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2714004d00 msgr2=0x7f2714005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:13.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.428+0000 7f272abc9640 1 --2- 172.21.15.132:0/3811121538 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2714004d00 0x7f2714005180 secure :-1 s=READY pgs=1025 cs=0 l=1 rev1=1 crypto rx=0x7f271c001f60 tx=0x7f27140057f0 comp rx=0 tx=0).stop 2023-12-20T04:47:13.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.428+0000 7f2729166640 1 -- 172.21.15.132:0/3811121538 reap_dead start 2023-12-20T04:47:13.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.428+0000 7f272abc9640 1 -- 172.21.15.132:0/3811121538 shutdown_connections 2023-12-20T04:47:13.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.428+0000 7f272abc9640 1 -- 172.21.15.132:0/3811121538 >> 172.21.15.132:0/3811121538 conn(0x7f272406a260 msgr2=0x7f27240b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:13.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.428+0000 7f272abc9640 1 -- 172.21.15.132:0/3811121538 shutdown_connections 2023-12-20T04:47:13.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.428+0000 7f272abc9640 1 -- 172.21.15.132:0/3811121538 wait complete. 2023-12-20T04:47:13.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.429+0000 7f272abc9640 1 Processor -- start 2023-12-20T04:47:13.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.429+0000 7f272abc9640 1 -- start start 2023-12-20T04:47:13.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.430+0000 7f272abc9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2724159730 0x7f27240c64a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:13.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.430+0000 7f272abc9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27240a89a0 0x7f27241f02f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:13.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.430+0000 7f272abc9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27241f0830 0x7f272406b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:13.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.430+0000 7f272abc9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27241f1290 con 0x7f27241f0830 2023-12-20T04:47:13.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.430+0000 7f272abc9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f27241f0cd0 con 0x7f2724159730 2023-12-20T04:47:13.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.430+0000 7f272abc9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f27241f0fb0 con 0x7f27240a89a0 2023-12-20T04:47:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.430+0000 7f2729166640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27241f0830 0x7f272406b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.430+0000 7f2729166640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27241f0830 0x7f272406b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34874/0 (socket says 172.21.15.132:34874) 2023-12-20T04:47:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.430+0000 7f2729166640 1 -- 172.21.15.132:0/1192358981 learned_addr learned my addr 172.21.15.132:0/1192358981 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.430+0000 7f2728965640 1 --2- 172.21.15.132:0/1192358981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2724159730 0x7f27240c64a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.430+0000 7f2723fff640 1 --2- 172.21.15.132:0/1192358981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27240a89a0 0x7f27241f02f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.430+0000 7f2729166640 1 -- 172.21.15.132:0/1192358981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27240a89a0 msgr2=0x7f27241f02f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.430+0000 7f2729166640 1 --2- 172.21.15.132:0/1192358981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27240a89a0 0x7f27241f02f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.430+0000 7f2729166640 1 -- 172.21.15.132:0/1192358981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2724159730 msgr2=0x7f27240c64a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.430+0000 7f2729166640 1 --2- 172.21.15.132:0/1192358981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2724159730 0x7f27240c64a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.431+0000 7f2729166640 1 -- 172.21.15.132:0/1192358981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f27240c5ca0 con 0x7f27241f0830 2023-12-20T04:47:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.431+0000 7f2729166640 1 --2- 172.21.15.132:0/1192358981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27241f0830 0x7f272406b9f0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f271c037040 tx=0x7f271c0015b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.431+0000 7f27217fa640 1 -- 172.21.15.132:0/1192358981 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c02dea0 con 0x7f27241f0830 2023-12-20T04:47:13.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.431+0000 7f27217fa640 1 -- 172.21.15.132:0/1192358981 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f271c003b70 con 0x7f27241f0830 2023-12-20T04:47:13.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.431+0000 7f27217fa640 1 -- 172.21.15.132:0/1192358981 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f271c005070 con 0x7f27241f0830 2023-12-20T04:47:13.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.431+0000 7f272abc9640 1 -- 172.21.15.132:0/1192358981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f27240c5f80 con 0x7f27241f0830 2023-12-20T04:47:13.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.431+0000 7f272abc9640 1 -- 172.21.15.132:0/1192358981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2724159b10 con 0x7f27241f0830 2023-12-20T04:47:13.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.432+0000 7f272abc9640 1 -- 172.21.15.132:0/1192358981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f27240c6170 con 0x7f27241f0830 2023-12-20T04:47:13.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.432+0000 7f27217fa640 1 -- 172.21.15.132:0/1192358981 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f271c0051d0 con 0x7f27241f0830 2023-12-20T04:47:13.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.433+0000 7f27217fa640 1 --2- 172.21.15.132:0/1192358981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f270806a430 0x7f270806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:13.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.433+0000 7f2728965640 1 --2- 172.21.15.132:0/1192358981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f270806a430 0x7f270806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:13.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.433+0000 7f27217fa640 1 -- 172.21.15.132:0/1192358981 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f271c031070 con 0x7f27241f0830 2023-12-20T04:47:13.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.433+0000 7f2728965640 1 --2- 172.21.15.132:0/1192358981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f270806a430 0x7f270806c8f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2718000c00 tx=0x7f2718009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:13.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.437+0000 7f27217fa640 1 -- 172.21.15.132:0/1192358981 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f271c075430 con 0x7f27241f0830 2023-12-20T04:47:13.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:13.637+0000 7f272abc9640 1 -- 172.21.15.132:0/1192358981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f272404e840 con 0x7f27241f0830 2023-12-20T04:47:13.949 INFO:tasks.ceph.mds.b.smithi187.stderr:2023-12-20T04:47:13.947+0000 7f32e57a1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:47:14.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.310+0000 7f27217fa640 1 -- 172.21.15.132:0/1192358981 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v38) v1 ==== 122+0+0 (secure 0 0 0) 0x7f271c078a50 con 0x7f27241f0830 2023-12-20T04:47:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.313+0000 7f272abc9640 1 -- 172.21.15.132:0/1192358981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f270806a430 msgr2=0x7f270806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.313+0000 7f272abc9640 1 --2- 172.21.15.132:0/1192358981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f270806a430 0x7f270806c8f0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f2718000c00 tx=0x7f2718009040 comp rx=0 tx=0).stop 2023-12-20T04:47:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.313+0000 7f272abc9640 1 -- 172.21.15.132:0/1192358981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27241f0830 msgr2=0x7f272406b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.313+0000 7f272abc9640 1 --2- 172.21.15.132:0/1192358981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27241f0830 0x7f272406b9f0 secure :-1 s=READY pgs=1026 cs=0 l=1 rev1=1 crypto rx=0x7f271c037040 tx=0x7f271c0015b0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.313+0000 7f272abc9640 1 -- 172.21.15.132:0/1192358981 shutdown_connections 2023-12-20T04:47:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.313+0000 7f272abc9640 1 --2- 172.21.15.132:0/1192358981 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f270806a430 0x7f270806c8f0 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.313+0000 7f272abc9640 1 --2- 172.21.15.132:0/1192358981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f27241f0830 0x7f272406b9f0 unknown :-1 s=CLOSED pgs=1026 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.313+0000 7f272abc9640 1 --2- 172.21.15.132:0/1192358981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f27240a89a0 0x7f27241f02f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.313+0000 7f272abc9640 1 --2- 172.21.15.132:0/1192358981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2724159730 0x7f27240c64a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.313+0000 7f272abc9640 1 -- 172.21.15.132:0/1192358981 >> 172.21.15.132:0/1192358981 conn(0x7f272406a260 msgr2=0x7f272415a3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.313+0000 7f272abc9640 1 -- 172.21.15.132:0/1192358981 shutdown_connections 2023-12-20T04:47:14.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.313+0000 7f272abc9640 1 -- 172.21.15.132:0/1192358981 wait complete. 2023-12-20T04:47:14.328 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-20T04:47:14.328 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:47:14.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.431+0000 7f4695973640 1 Processor -- start 2023-12-20T04:47:14.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.431+0000 7f4695973640 1 -- start start 2023-12-20T04:47:14.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.432+0000 7f4695973640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46901588e0 0x7f4690069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:14.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.432+0000 7f4695973640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f469006a170 0x7f469006c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:14.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.432+0000 7f4695973640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f469006a5d0 con 0x7f469006cd30 2023-12-20T04:47:14.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.432+0000 7f4695973640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f469006d520 con 0x7f469006a170 2023-12-20T04:47:14.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.432+0000 7f4695973640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f469006ea90 con 0x7f46901588e0 2023-12-20T04:47:14.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.433+0000 7f468effd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46901588e0 0x7f4690069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:14.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.433+0000 7f468e7fc640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f469006a170 0x7f469006c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:14.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.433+0000 7f468effd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46901588e0 0x7f4690069c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:51756/0 (socket says 172.21.15.132:51756) 2023-12-20T04:47:14.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.433+0000 7f468effd640 1 -- 172.21.15.132:0/3719313350 learned_addr learned my addr 172.21.15.132:0/3719313350 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:14.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.433+0000 7f468f7fe640 1 --1- 172.21.15.132:0/3719313350 >> v1:172.21.15.187:6789/0 conn(0x7f469006cd30 0x7f46900b4bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:39434/0 (socket says 172.21.15.132:39434) 2023-12-20T04:47:14.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.433+0000 7f468effd640 1 -- 172.21.15.132:0/3719313350 >> v2:172.21.15.187:3300/0 conn(0x7f469006a170 msgr2=0x7f469006c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:14.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.433+0000 7f468effd640 1 --2- 172.21.15.132:0/3719313350 >> v2:172.21.15.187:3300/0 conn(0x7f469006a170 0x7f469006c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.433+0000 7f468effd640 1 -- 172.21.15.132:0/3719313350 >> v1:172.21.15.187:6789/0 conn(0x7f469006cd30 legacy=0x7f46900b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:14.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.433+0000 7f468effd640 1 -- 172.21.15.132:0/3719313350 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f469006e160 con 0x7f46901588e0 2023-12-20T04:47:14.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.433+0000 7f468e7fc640 1 --2- 172.21.15.132:0/3719313350 >> v2:172.21.15.187:3300/0 conn(0x7f469006a170 0x7f469006c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:47:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.434+0000 7f468effd640 1 --2- 172.21.15.132:0/3719313350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46901588e0 0x7f4690069c30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4680009e50 tx=0x7f468002bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d8efd1a06d9b28e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.434+0000 7f468dffb640 1 -- 172.21.15.132:0/3719313350 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f468002cb00 con 0x7f46901588e0 2023-12-20T04:47:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.434+0000 7f468dffb640 1 -- 172.21.15.132:0/3719313350 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f468002cc60 con 0x7f46901588e0 2023-12-20T04:47:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.434+0000 7f468dffb640 1 -- 172.21.15.132:0/3719313350 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46800343f0 con 0x7f46901588e0 2023-12-20T04:47:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.434+0000 7f4695973640 1 -- 172.21.15.132:0/3719313350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46901588e0 msgr2=0x7f4690069c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.434+0000 7f4695973640 1 --2- 172.21.15.132:0/3719313350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46901588e0 0x7f4690069c30 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f4680009e50 tx=0x7f468002bf60 comp rx=0 tx=0).stop 2023-12-20T04:47:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.434+0000 7f4695973640 1 -- 172.21.15.132:0/3719313350 shutdown_connections 2023-12-20T04:47:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.434+0000 7f4695973640 1 --2- 172.21.15.132:0/3719313350 >> v2:172.21.15.187:3300/0 conn(0x7f469006a170 0x7f469006c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.434+0000 7f4695973640 1 --2- 172.21.15.132:0/3719313350 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f46901588e0 0x7f4690069c30 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.434+0000 7f4695973640 1 -- 172.21.15.132:0/3719313350 >> 172.21.15.132:0/3719313350 conn(0x7f46900cfca0 msgr2=0x7f46900d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:14.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.435+0000 7f4695973640 1 -- 172.21.15.132:0/3719313350 shutdown_connections 2023-12-20T04:47:14.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.435+0000 7f4695973640 1 -- 172.21.15.132:0/3719313350 wait complete. 2023-12-20T04:47:14.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.436+0000 7f4695973640 1 Processor -- start 2023-12-20T04:47:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.436+0000 7f4695973640 1 -- start start 2023-12-20T04:47:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.436+0000 7f4695973640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f469006a170 0x7f469015ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f4695973640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f469006cd30 0x7f46900c7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f4695973640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46901588e0 0x7f46900b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f4695973640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f469015b190 con 0x7f46901588e0 2023-12-20T04:47:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f4695973640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f46900c8200 con 0x7f469006cd30 2023-12-20T04:47:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f4695973640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f46900c8440 con 0x7f469006a170 2023-12-20T04:47:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f468f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46901588e0 0x7f46900b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f468f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46901588e0 0x7f46900b4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34880/0 (socket says 172.21.15.132:34880) 2023-12-20T04:47:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f468f7fe640 1 -- 172.21.15.132:0/2202082644 learned_addr learned my addr 172.21.15.132:0/2202082644 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f468e7fc640 1 --2- 172.21.15.132:0/2202082644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f469006cd30 0x7f46900c7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f468effd640 1 --2- 172.21.15.132:0/2202082644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f469006a170 0x7f469015ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f468f7fe640 1 -- 172.21.15.132:0/2202082644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f469006a170 msgr2=0x7f469015ac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:14.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f468f7fe640 1 --2- 172.21.15.132:0/2202082644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f469006a170 0x7f469015ac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f468f7fe640 1 -- 172.21.15.132:0/2202082644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f469006cd30 msgr2=0x7f46900c7cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:14.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f468f7fe640 1 --2- 172.21.15.132:0/2202082644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f469006cd30 0x7f46900c7cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f468f7fe640 1 -- 172.21.15.132:0/2202082644 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4684009400 con 0x7f46901588e0 2023-12-20T04:47:14.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f468e7fc640 1 --2- 172.21.15.132:0/2202082644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f469006cd30 0x7f46900c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:14.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f468f7fe640 1 --2- 172.21.15.132:0/2202082644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46901588e0 0x7f46900b4ea0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f468800c400 tx=0x7f468800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:14.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f4677fff640 1 -- 172.21.15.132:0/2202082644 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46880074e0 con 0x7f46901588e0 2023-12-20T04:47:14.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f4677fff640 1 -- 172.21.15.132:0/2202082644 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4688007640 con 0x7f46901588e0 2023-12-20T04:47:14.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f4695973640 1 -- 172.21.15.132:0/2202082644 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4680009b30 con 0x7f46901588e0 2023-12-20T04:47:14.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.437+0000 7f4677fff640 1 -- 172.21.15.132:0/2202082644 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f46880049e0 con 0x7f46901588e0 2023-12-20T04:47:14.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.438+0000 7f4695973640 1 -- 172.21.15.132:0/2202082644 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46901f5350 con 0x7f46901588e0 2023-12-20T04:47:14.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.439+0000 7f4695973640 1 -- 172.21.15.132:0/2202082644 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f469004e840 con 0x7f46901588e0 2023-12-20T04:47:14.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.439+0000 7f4677fff640 1 -- 172.21.15.132:0/2202082644 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4688004b40 con 0x7f46901588e0 2023-12-20T04:47:14.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.439+0000 7f4677fff640 1 --2- 172.21.15.132:0/2202082644 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f467c06a430 0x7f467c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:14.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.439+0000 7f4677fff640 1 -- 172.21.15.132:0/2202082644 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4688088170 con 0x7f46901588e0 2023-12-20T04:47:14.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.439+0000 7f468effd640 1 --2- 172.21.15.132:0/2202082644 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f467c06a430 0x7f467c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:14.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.440+0000 7f468effd640 1 --2- 172.21.15.132:0/2202082644 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f467c06a430 0x7f467c06c8f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4680035000 tx=0x7f4680030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:14.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.444+0000 7f4677fff640 1 -- 172.21.15.132:0/2202082644 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f46880537f0 con 0x7f46901588e0 2023-12-20T04:47:14.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.643+0000 7f4695973640 1 -- 172.21.15.132:0/2202082644 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f46900cb380 con 0x7f46901588e0 2023-12-20T04:47:14.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.644+0000 7f4677fff640 1 -- 172.21.15.132:0/2202082644 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f4688056e10 con 0x7f46901588e0 2023-12-20T04:47:14.646 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:14.646 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6939,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2115867433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2115867433},{"type":"v1","addr":"172.21.15.132:6837","nonce":2115867433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6942,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/162444556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":162444556},{"type":"v1","addr":"172.21.15.132:6836","nonce":162444556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2089611890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2089611890},{"type":"v1","addr":"172.21.15.187:6835","nonce":2089611890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:47:12.299623+0000","modified":"2023-12-20T04:47:14.308466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6957},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6957":{"gid":6957,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/786513656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":786513656},{"type":"v1","addr":"172.21.15.187:6834","nonce":786513656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-20T04:47:14.646 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 38 2023-12-20T04:47:14.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.646+0000 7f4695973640 1 -- 172.21.15.132:0/2202082644 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f467c06a430 msgr2=0x7f467c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:14.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.646+0000 7f4695973640 1 --2- 172.21.15.132:0/2202082644 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f467c06a430 0x7f467c06c8f0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f4680035000 tx=0x7f4680030000 comp rx=0 tx=0).stop 2023-12-20T04:47:14.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.646+0000 7f4695973640 1 -- 172.21.15.132:0/2202082644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46901588e0 msgr2=0x7f46900b4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:14.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.646+0000 7f4695973640 1 --2- 172.21.15.132:0/2202082644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46901588e0 0x7f46900b4ea0 secure :-1 s=READY pgs=1027 cs=0 l=1 rev1=1 crypto rx=0x7f468800c400 tx=0x7f468800c8c0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.646+0000 7f4695973640 1 -- 172.21.15.132:0/2202082644 shutdown_connections 2023-12-20T04:47:14.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.646+0000 7f4695973640 1 --2- 172.21.15.132:0/2202082644 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f467c06a430 0x7f467c06c8f0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.646+0000 7f4695973640 1 --2- 172.21.15.132:0/2202082644 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f46901588e0 0x7f46900b4ea0 unknown :-1 s=CLOSED pgs=1027 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.646+0000 7f4695973640 1 --2- 172.21.15.132:0/2202082644 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f469006cd30 0x7f46900c7cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.646+0000 7f4695973640 1 --2- 172.21.15.132:0/2202082644 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f469006a170 0x7f469015ac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.646+0000 7f4695973640 1 -- 172.21.15.132:0/2202082644 >> 172.21.15.132:0/2202082644 conn(0x7f46900cfca0 msgr2=0x7f46901580b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:14.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.646+0000 7f4695973640 1 -- 172.21.15.132:0/2202082644 shutdown_connections 2023-12-20T04:47:14.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.646+0000 7f4695973640 1 -- 172.21.15.132:0/2202082644 wait complete. 2023-12-20T04:47:14.659 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:47:14.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.756+0000 7f3ebdeee640 1 Processor -- start 2023-12-20T04:47:14.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.756+0000 7f3ebdeee640 1 -- start start 2023-12-20T04:47:14.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.757+0000 7f3ebdeee640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb80cdc10 0x7f3eb806c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:14.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.757+0000 7f3ebdeee640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb81613c0 con 0x7f3eb815d100 2023-12-20T04:47:14.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.757+0000 7f3ebdeee640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3eb80d1b00 con 0x7f3eb80d0370 2023-12-20T04:47:14.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.757+0000 7f3ebdeee640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb806cde0 con 0x7f3eb80cdc10 2023-12-20T04:47:14.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.757+0000 7f3eb77fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3eb815d100 0x7f3eb80cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35556/0 (socket says 172.21.15.132:35556) 2023-12-20T04:47:14.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.757+0000 7f3eb77fe640 1 -- 172.21.15.132:0/3645844707 learned_addr learned my addr 172.21.15.132:0/3645844707 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:14.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.757+0000 7f3eb7fff640 1 --2- 172.21.15.132:0/3645844707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb80cdc10 0x7f3eb806c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:14.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.757+0000 7f3eb67fc640 1 -- 172.21.15.132:0/3645844707 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1909843211 0 0) 0x7f3eb81613c0 con 0x7f3eb815d100 2023-12-20T04:47:14.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.757+0000 7f3eb67fc640 1 -- 172.21.15.132:0/3645844707 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3ea0003520 con 0x7f3eb815d100 2023-12-20T04:47:14.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.758+0000 7f3eb67fc640 1 -- 172.21.15.132:0/3645844707 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1094910476 0 0) 0x7f3eb80d1b00 con 0x7f3eb80d0370 2023-12-20T04:47:14.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.758+0000 7f3eb7fff640 1 -- 172.21.15.132:0/3645844707 >> v1:172.21.15.187:6789/0 conn(0x7f3eb80d0370 legacy=0x7f3eb806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:14.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.758+0000 7f3eb7fff640 1 -- 172.21.15.132:0/3645844707 >> v1:172.21.15.132:6789/0 conn(0x7f3eb815d100 legacy=0x7f3eb80cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:14.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.758+0000 7f3eb7fff640 1 -- 172.21.15.132:0/3645844707 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb80d0810 con 0x7f3eb80cdc10 2023-12-20T04:47:14.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.759+0000 7f3eb7fff640 1 --2- 172.21.15.132:0/3645844707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb80cdc10 0x7f3eb806c8a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009dc0 tx=0x7f3eb002bd10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c85d000b81eb43d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:14.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.759+0000 7f3eb67fc640 1 -- 172.21.15.132:0/3645844707 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ea8001670 con 0x7f3eb80cdc10 2023-12-20T04:47:14.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.759+0000 7f3eb67fc640 1 -- 172.21.15.132:0/3645844707 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb002c840 con 0x7f3eb80cdc10 2023-12-20T04:47:14.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.759+0000 7f3eb67fc640 1 -- 172.21.15.132:0/3645844707 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb002cbd0 con 0x7f3eb80cdc10 2023-12-20T04:47:14.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.759+0000 7f3ebdeee640 1 -- 172.21.15.132:0/3645844707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb80cdc10 msgr2=0x7f3eb806c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:14.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.759+0000 7f3ebdeee640 1 --2- 172.21.15.132:0/3645844707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb80cdc10 0x7f3eb806c8a0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0009dc0 tx=0x7f3eb002bd10 comp rx=0 tx=0).stop 2023-12-20T04:47:14.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.759+0000 7f3ebdeee640 1 -- 172.21.15.132:0/3645844707 shutdown_connections 2023-12-20T04:47:14.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.759+0000 7f3ebdeee640 1 --2- 172.21.15.132:0/3645844707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb80cdc10 0x7f3eb806c8a0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.759+0000 7f3ebdeee640 1 -- 172.21.15.132:0/3645844707 >> 172.21.15.132:0/3645844707 conn(0x7f3eb806d7c0 msgr2=0x7f3eb806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:14.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.759+0000 7f3ebdeee640 1 -- 172.21.15.132:0/3645844707 shutdown_connections 2023-12-20T04:47:14.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.759+0000 7f3ebdeee640 1 -- 172.21.15.132:0/3645844707 wait complete. 2023-12-20T04:47:14.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.760+0000 7f3ebdeee640 1 Processor -- start 2023-12-20T04:47:14.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.761+0000 7f3ebdeee640 1 -- start start 2023-12-20T04:47:14.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.761+0000 7f3ebdeee640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb80cdc10 0x7f3eb8158700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:14.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.761+0000 7f3ebdeee640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3eb80d0370 0x7f3eb81e77e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:14.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.761+0000 7f3ebdeee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb815d100 0x7f3eb81e7d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:14.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.761+0000 7f3ebdeee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb8158c40 con 0x7f3eb815d100 2023-12-20T04:47:14.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.761+0000 7f3ebdeee640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb81e8360 con 0x7f3eb80d0370 2023-12-20T04:47:14.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.761+0000 7f3ebdeee640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3eb81e8640 con 0x7f3eb80cdc10 2023-12-20T04:47:14.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.761+0000 7f3eb7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb815d100 0x7f3eb81e7d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:14.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.761+0000 7f3eb7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb815d100 0x7f3eb81e7d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34884/0 (socket says 172.21.15.132:34884) 2023-12-20T04:47:14.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.761+0000 7f3eb7fff640 1 -- 172.21.15.132:0/893581612 learned_addr learned my addr 172.21.15.132:0/893581612 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:14.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.762+0000 7f3eb77fe640 1 --2- 172.21.15.132:0/893581612 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb80cdc10 0x7f3eb8158700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:14.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.762+0000 7f3eb6ffd640 1 --2- 172.21.15.132:0/893581612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3eb80d0370 0x7f3eb81e77e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:14.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.762+0000 7f3eb7fff640 1 -- 172.21.15.132:0/893581612 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb80cdc10 msgr2=0x7f3eb8158700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:14.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.762+0000 7f3eb7fff640 1 --2- 172.21.15.132:0/893581612 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb80cdc10 0x7f3eb8158700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.762+0000 7f3eb7fff640 1 -- 172.21.15.132:0/893581612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3eb80d0370 msgr2=0x7f3eb81e77e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:14.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.762+0000 7f3eb7fff640 1 --2- 172.21.15.132:0/893581612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3eb80d0370 0x7f3eb81e77e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.762+0000 7f3eb7fff640 1 -- 172.21.15.132:0/893581612 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3eb0009a70 con 0x7f3eb815d100 2023-12-20T04:47:14.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.762+0000 7f3eb6ffd640 1 --2- 172.21.15.132:0/893581612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3eb80d0370 0x7f3eb81e77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:14.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.762+0000 7f3eb7fff640 1 --2- 172.21.15.132:0/893581612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb815d100 0x7f3eb81e7d20 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0037040 tx=0x7f3eb0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:14.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.762+0000 7f3e9ffff640 1 -- 172.21.15.132:0/893581612 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0034e80 con 0x7f3eb815d100 2023-12-20T04:47:14.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.762+0000 7f3e9ffff640 1 -- 172.21.15.132:0/893581612 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3eb002ce50 con 0x7f3eb815d100 2023-12-20T04:47:14.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.762+0000 7f3ebdeee640 1 -- 172.21.15.132:0/893581612 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3eb81e8920 con 0x7f3eb815d100 2023-12-20T04:47:14.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.762+0000 7f3e9ffff640 1 -- 172.21.15.132:0/893581612 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3eb0003bb0 con 0x7f3eb815d100 2023-12-20T04:47:14.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.762+0000 7f3ebdeee640 1 -- 172.21.15.132:0/893581612 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3eb81e8ee0 con 0x7f3eb815d100 2023-12-20T04:47:14.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.763+0000 7f3ebdeee640 1 -- 172.21.15.132:0/893581612 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3eb804e840 con 0x7f3eb815d100 2023-12-20T04:47:14.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.763+0000 7f3e9ffff640 1 -- 172.21.15.132:0/893581612 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3eb003b050 con 0x7f3eb815d100 2023-12-20T04:47:14.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.764+0000 7f3e9ffff640 1 --2- 172.21.15.132:0/893581612 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ea406a430 0x7f3ea406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:14.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.764+0000 7f3e9ffff640 1 -- 172.21.15.132:0/893581612 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3eb00aad20 con 0x7f3eb815d100 2023-12-20T04:47:14.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.764+0000 7f3eb77fe640 1 --2- 172.21.15.132:0/893581612 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ea406a430 0x7f3ea406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:14.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.764+0000 7f3eb77fe640 1 --2- 172.21.15.132:0/893581612 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ea406a430 0x7f3ea406c8f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8000c00 tx=0x7f3ea8001990 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:14.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.768+0000 7f3e9ffff640 1 -- 172.21.15.132:0/893581612 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3eb0076310 con 0x7f3eb815d100 2023-12-20T04:47:14.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.935+0000 7f3ebdeee640 1 -- 172.21.15.132:0/893581612 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f3eb80c7be0 con 0x7f3eb815d100 2023-12-20T04:47:14.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.936+0000 7f3e9ffff640 1 -- 172.21.15.132:0/893581612 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v101) v1 ==== 74+0+16143 (secure 0 0 0) 0x7f3eb0079930 con 0x7f3eb815d100 2023-12-20T04:47:14.938 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:14.938 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":101,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:47:13.302784+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"91","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:47:10.649946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"100","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-20T04:47:11.271933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"101","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:47:14.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.938+0000 7f3ebdeee640 1 -- 172.21.15.132:0/893581612 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ea406a430 msgr2=0x7f3ea406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:14.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.938+0000 7f3ebdeee640 1 --2- 172.21.15.132:0/893581612 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ea406a430 0x7f3ea406c8f0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3ea8000c00 tx=0x7f3ea8001990 comp rx=0 tx=0).stop 2023-12-20T04:47:14.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.938+0000 7f3ebdeee640 1 -- 172.21.15.132:0/893581612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb815d100 msgr2=0x7f3eb81e7d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:14.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.938+0000 7f3ebdeee640 1 --2- 172.21.15.132:0/893581612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb815d100 0x7f3eb81e7d20 secure :-1 s=READY pgs=1029 cs=0 l=1 rev1=1 crypto rx=0x7f3eb0037040 tx=0x7f3eb0004a40 comp rx=0 tx=0).stop 2023-12-20T04:47:14.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.938+0000 7f3ebdeee640 1 -- 172.21.15.132:0/893581612 shutdown_connections 2023-12-20T04:47:14.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.938+0000 7f3ebdeee640 1 --2- 172.21.15.132:0/893581612 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ea406a430 0x7f3ea406c8f0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.938+0000 7f3ebdeee640 1 --2- 172.21.15.132:0/893581612 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3eb815d100 0x7f3eb81e7d20 unknown :-1 s=CLOSED pgs=1029 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.938+0000 7f3ebdeee640 1 --2- 172.21.15.132:0/893581612 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3eb80d0370 0x7f3eb81e77e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.938+0000 7f3ebdeee640 1 --2- 172.21.15.132:0/893581612 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3eb80cdc10 0x7f3eb8158700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:14.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.938+0000 7f3ebdeee640 1 -- 172.21.15.132:0/893581612 >> 172.21.15.132:0/893581612 conn(0x7f3eb806d7c0 msgr2=0x7f3eb80ccb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:14.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.938+0000 7f3ebdeee640 1 -- 172.21.15.132:0/893581612 shutdown_connections 2023-12-20T04:47:14.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:14.938+0000 7f3ebdeee640 1 -- 172.21.15.132:0/893581612 wait complete. 2023-12-20T04:47:14.952 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-20T04:47:14.952 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:47:15.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.050+0000 7fbed3500640 1 Processor -- start 2023-12-20T04:47:15.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.050+0000 7fbed3500640 1 -- start start 2023-12-20T04:47:15.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.051+0000 7fbed3500640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbecc0d0370 0x7fbecc0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.051+0000 7fbed3500640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbecc0cdc10 0x7fbecc06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.051+0000 7fbed3500640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbecc0b2f90 con 0x7fbecc15d100 2023-12-20T04:47:15.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.051+0000 7fbed3500640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbecc1613c0 con 0x7fbecc0d0370 2023-12-20T04:47:15.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.051+0000 7fbed3500640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbecc0d1b00 con 0x7fbecc0cdc10 2023-12-20T04:47:15.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.051+0000 7fbed0a9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbecc0d0370 0x7fbecc0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.051+0000 7fbed0a9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbecc0d0370 0x7fbecc0b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34900/0 (socket says 172.21.15.132:34900) 2023-12-20T04:47:15.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.051+0000 7fbed0a9b640 1 -- 172.21.15.132:0/1101275271 learned_addr learned my addr 172.21.15.132:0/1101275271 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:15.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.052+0000 7fbed0a9b640 1 -- 172.21.15.132:0/1101275271 >> v2:172.21.15.187:3300/0 conn(0x7fbecc0cdc10 msgr2=0x7fbecc06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:15.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.052+0000 7fbed0a9b640 1 --2- 172.21.15.132:0/1101275271 >> v2:172.21.15.187:3300/0 conn(0x7fbecc0cdc10 0x7fbecc06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.052+0000 7fbed0a9b640 1 -- 172.21.15.132:0/1101275271 >> v1:172.21.15.187:6789/0 conn(0x7fbecc15d100 legacy=0x7fbecc0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:15.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.052+0000 7fbed0a9b640 1 -- 172.21.15.132:0/1101275271 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbecc0d0810 con 0x7fbecc0d0370 2023-12-20T04:47:15.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.052+0000 7fbed0a9b640 1 --2- 172.21.15.132:0/1101275271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbecc0d0370 0x7fbecc0b2a50 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fbecc161330 tx=0x7fbebc02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e08668932e612bef server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:15.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.052+0000 7fbec3fff640 1 -- 172.21.15.132:0/1101275271 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc031870 con 0x7fbecc0d0370 2023-12-20T04:47:15.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.052+0000 7fbec3fff640 1 -- 172.21.15.132:0/1101275271 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbebc0319d0 con 0x7fbecc0d0370 2023-12-20T04:47:15.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.052+0000 7fbec3fff640 1 -- 172.21.15.132:0/1101275271 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbebc031d60 con 0x7fbecc0d0370 2023-12-20T04:47:15.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.053+0000 7fbed3500640 1 -- 172.21.15.132:0/1101275271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbecc0d0370 msgr2=0x7fbecc0b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:15.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.053+0000 7fbed3500640 1 --2- 172.21.15.132:0/1101275271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbecc0d0370 0x7fbecc0b2a50 secure :-1 s=READY pgs=1030 cs=0 l=1 rev1=1 crypto rx=0x7fbecc161330 tx=0x7fbebc02b910 comp rx=0 tx=0).stop 2023-12-20T04:47:15.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.053+0000 7fbed3500640 1 -- 172.21.15.132:0/1101275271 shutdown_connections 2023-12-20T04:47:15.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.053+0000 7fbed3500640 1 --2- 172.21.15.132:0/1101275271 >> v2:172.21.15.187:3300/0 conn(0x7fbecc0cdc10 0x7fbecc06c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.053+0000 7fbed3500640 1 --2- 172.21.15.132:0/1101275271 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbecc0d0370 0x7fbecc0b2a50 unknown :-1 s=CLOSED pgs=1030 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.053+0000 7fbed3500640 1 -- 172.21.15.132:0/1101275271 >> 172.21.15.132:0/1101275271 conn(0x7fbecc06d7c0 msgr2=0x7fbecc06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:15.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.053+0000 7fbed3500640 1 -- 172.21.15.132:0/1101275271 shutdown_connections 2023-12-20T04:47:15.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.053+0000 7fbed3500640 1 -- 172.21.15.132:0/1101275271 wait complete. 2023-12-20T04:47:15.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.054+0000 7fbed3500640 1 Processor -- start 2023-12-20T04:47:15.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.054+0000 7fbed3500640 1 -- start start 2023-12-20T04:47:15.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.055+0000 7fbed3500640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbecc0cdc10 0x7fbecc0b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.055+0000 7fbed3500640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbecc0d0370 0x7fbecc0c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.055+0000 7fbed3500640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbecc15d100 0x7fbecc15ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.055+0000 7fbed3500640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc154730 con 0x7fbecc15d100 2023-12-20T04:47:15.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.055+0000 7fbed3500640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc1591e0 con 0x7fbecc0cdc10 2023-12-20T04:47:15.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.055+0000 7fbed3500640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbecc1f66b0 con 0x7fbecc0d0370 2023-12-20T04:47:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.055+0000 7fbed1a9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbecc15d100 0x7fbecc15ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.055+0000 7fbed1a9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbecc15d100 0x7fbecc15ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34914/0 (socket says 172.21.15.132:34914) 2023-12-20T04:47:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.055+0000 7fbed1a9d640 1 -- 172.21.15.132:0/410922976 learned_addr learned my addr 172.21.15.132:0/410922976 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.055+0000 7fbed129c640 1 --2- 172.21.15.132:0/410922976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbecc0cdc10 0x7fbecc0b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.055+0000 7fbed0a9b640 1 --2- 172.21.15.132:0/410922976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbecc0d0370 0x7fbecc0c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.055+0000 7fbed1a9d640 1 -- 172.21.15.132:0/410922976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbecc0d0370 msgr2=0x7fbecc0c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.055+0000 7fbed1a9d640 1 --2- 172.21.15.132:0/410922976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbecc0d0370 0x7fbecc0c7ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.055+0000 7fbed1a9d640 1 -- 172.21.15.132:0/410922976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbecc0cdc10 msgr2=0x7fbecc0b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.055+0000 7fbed1a9d640 1 --2- 172.21.15.132:0/410922976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbecc0cdc10 0x7fbecc0b2290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.055+0000 7fbed1a9d640 1 -- 172.21.15.132:0/410922976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc0094d0 con 0x7fbecc15d100 2023-12-20T04:47:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.056+0000 7fbed1a9d640 1 --2- 172.21.15.132:0/410922976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbecc15d100 0x7fbecc15ad60 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fbec400b970 tx=0x7fbec400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.056+0000 7fbec1ffb640 1 -- 172.21.15.132:0/410922976 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec400cb40 con 0x7fbecc15d100 2023-12-20T04:47:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.056+0000 7fbec1ffb640 1 -- 172.21.15.132:0/410922976 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbec400ccc0 con 0x7fbecc15d100 2023-12-20T04:47:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.056+0000 7fbed3500640 1 -- 172.21.15.132:0/410922976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbecc1f6990 con 0x7fbecc15d100 2023-12-20T04:47:15.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.056+0000 7fbec1ffb640 1 -- 172.21.15.132:0/410922976 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbec4014680 con 0x7fbecc15d100 2023-12-20T04:47:15.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.056+0000 7fbed3500640 1 -- 172.21.15.132:0/410922976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbecc1f6f50 con 0x7fbecc15d100 2023-12-20T04:47:15.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.057+0000 7fbed3500640 1 -- 172.21.15.132:0/410922976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbecc1593a0 con 0x7fbecc15d100 2023-12-20T04:47:15.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.057+0000 7fbec1ffb640 1 -- 172.21.15.132:0/410922976 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbec401d3b0 con 0x7fbecc15d100 2023-12-20T04:47:15.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.057+0000 7fbec1ffb640 1 --2- 172.21.15.132:0/410922976 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbeb006a430 0x7fbeb006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.057+0000 7fbec1ffb640 1 -- 172.21.15.132:0/410922976 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbec4088870 con 0x7fbecc15d100 2023-12-20T04:47:15.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.058+0000 7fbed129c640 1 --2- 172.21.15.132:0/410922976 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbeb006a430 0x7fbeb006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.058+0000 7fbed129c640 1 --2- 172.21.15.132:0/410922976 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbeb006a430 0x7fbeb006c8f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbec8007fd0 tx=0x7fbec8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:15.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.062+0000 7fbec1ffb640 1 -- 172.21.15.132:0/410922976 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbec4053e60 con 0x7fbecc15d100 2023-12-20T04:47:15.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.225+0000 7fbed3500640 1 -- 172.21.15.132:0/410922976 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fbecc161050 con 0x7fbeb006a430 2023-12-20T04:47:15.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.232+0000 7fbec1ffb640 1 -- 172.21.15.132:0/410922976 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276369 (secure 0 0 0) 0x7fbec8001c60 con 0x7fbeb006a430 2023-12-20T04:47:15.237 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:15.238 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:47:15.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.235+0000 7fbed3500640 1 -- 172.21.15.132:0/410922976 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbeb006a430 msgr2=0x7fbeb006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:15.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.235+0000 7fbed3500640 1 --2- 172.21.15.132:0/410922976 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbeb006a430 0x7fbeb006c8f0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7fbec8007fd0 tx=0x7fbec8009040 comp rx=0 tx=0).stop 2023-12-20T04:47:15.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.235+0000 7fbed3500640 1 -- 172.21.15.132:0/410922976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbecc15d100 msgr2=0x7fbecc15ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:15.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.235+0000 7fbed3500640 1 --2- 172.21.15.132:0/410922976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbecc15d100 0x7fbecc15ad60 secure :-1 s=READY pgs=1031 cs=0 l=1 rev1=1 crypto rx=0x7fbec400b970 tx=0x7fbec400be30 comp rx=0 tx=0).stop 2023-12-20T04:47:15.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.235+0000 7fbed3500640 1 -- 172.21.15.132:0/410922976 shutdown_connections 2023-12-20T04:47:15.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.235+0000 7fbed3500640 1 --2- 172.21.15.132:0/410922976 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbeb006a430 0x7fbeb006c8f0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.235+0000 7fbed3500640 1 --2- 172.21.15.132:0/410922976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbecc15d100 0x7fbecc15ad60 unknown :-1 s=CLOSED pgs=1031 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.235+0000 7fbed3500640 1 --2- 172.21.15.132:0/410922976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbecc0d0370 0x7fbecc0c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.235+0000 7fbed3500640 1 --2- 172.21.15.132:0/410922976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbecc0cdc10 0x7fbecc0b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.235+0000 7fbed3500640 1 -- 172.21.15.132:0/410922976 >> 172.21.15.132:0/410922976 conn(0x7fbecc06d7c0 msgr2=0x7fbecc15b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:15.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.235+0000 7fbed3500640 1 -- 172.21.15.132:0/410922976 shutdown_connections 2023-12-20T04:47:15.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.235+0000 7fbed3500640 1 -- 172.21.15.132:0/410922976 wait complete. 2023-12-20T04:47:15.248 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2023-12-20T04:47:14.149143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5225,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557274,"statfs":{"total":1600000000,"available":1594648975,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000613"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.950492+0000","last_change":"2023-12-20T04:47:10.950492+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.950492+0000","last_undegraded":"2023-12-20T04:47:10.950492+0000","last_fullsized":"2023-12-20T04:47:10.950492+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:59:55.486432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.948931+0000","last_change":"2023-12-20T04:47:10.948931+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.948931+0000","last_undegraded":"2023-12-20T04:47:10.948931+0000","last_fullsized":"2023-12-20T04:47:10.948931+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:24.195503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949807+0000","last_change":"2023-12-20T04:47:10.949807+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949807+0000","last_undegraded":"2023-12-20T04:47:10.949807+0000","last_fullsized":"2023-12-20T04:47:10.949807+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:19:12.580438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949775+0000","last_change":"2023-12-20T04:47:10.949775+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949775+0000","last_undegraded":"2023-12-20T04:47:10.949775+0000","last_fullsized":"2023-12-20T04:47:10.949775+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:30:07.400173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.948879+0000","last_change":"2023-12-20T04:47:10.948879+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.948879+0000","last_undegraded":"2023-12-20T04:47:10.948879+0000","last_fullsized":"2023-12-20T04:47:10.948879+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:34:39.263240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.948493+0000","last_change":"2023-12-20T04:47:10.948493+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.948493+0000","last_undegraded":"2023-12-20T04:47:10.948493+0000","last_fullsized":"2023-12-20T04:47:10.948493+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:07:16.555642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949498+0000","last_change":"2023-12-20T04:47:10.949498+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949498+0000","last_undegraded":"2023-12-20T04:47:10.949498+0000","last_fullsized":"2023-12-20T04:47:10.949498+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:05:38.046766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952798+0000","last_change":"2023-12-20T04:47:10.952798+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952798+0000","last_undegraded":"2023-12-20T04:47:10.952798+0000","last_fullsized":"2023-12-20T04:47:10.952798+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:27:15.310466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949712+0000","last_change":"2023-12-20T04:47:10.949712+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949712+0000","last_undegraded":"2023-12-20T04:47:10.949712+0000","last_fullsized":"2023-12-20T04:47:10.949712+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:34:39.263240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949648+0000","last_change":"2023-12-20T04:47:10.949648+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949648+0000","last_undegraded":"2023-12-20T04:47:10.949648+0000","last_fullsized":"2023-12-20T04:47:10.949648+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:18:33.413422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949656+0000","last_change":"2023-12-20T04:47:10.949656+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949656+0000","last_undegraded":"2023-12-20T04:47:10.949656+0000","last_fullsized":"2023-12-20T04:47:10.949656+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:24.195503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952093+0000","last_change":"2023-12-20T04:47:10.952093+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952093+0000","last_undegraded":"2023-12-20T04:47:10.952093+0000","last_fullsized":"2023-12-20T04:47:10.952093+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:15:43.167465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952500+0000","last_change":"2023-12-20T04:47:10.952500+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952500+0000","last_undegraded":"2023-12-20T04:47:10.952500+0000","last_fullsized":"2023-12-20T04:47:10.952500+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:37.421468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952393+0000","last_change":"2023-12-20T04:47:10.952393+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952393+0000","last_undegraded":"2023-12-20T04:47:10.952393+0000","last_fullsized":"2023-12-20T04:47:10.952393+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:29:56.453248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952111+0000","last_change":"2023-12-20T04:47:10.952111+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952111+0000","last_undegraded":"2023-12-20T04:47:10.952111+0000","last_fullsized":"2023-12-20T04:47:10.952111+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:37.421468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949579+0000","last_change":"2023-12-20T04:47:10.949579+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949579+0000","last_undegraded":"2023-12-20T04:47:10.949579+0000","last_fullsized":"2023-12-20T04:47:10.949579+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:28:31.135425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.950772+0000","last_change":"2023-12-20T04:47:10.950772+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.950772+0000","last_undegraded":"2023-12-20T04:47:10.950772+0000","last_fullsized":"2023-12-20T04:47:10.950772+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:13:49.006881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949427+0000","last_change":"2023-12-20T04:47:10.949427+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949427+0000","last_undegraded":"2023-12-20T04:47:10.949427+0000","last_fullsized":"2023-12-20T04:47:10.949427+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:43:49.085959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949502+0000","last_change":"2023-12-20T04:47:10.949502+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949502+0000","last_undegraded":"2023-12-20T04:47:10.949502+0000","last_fullsized":"2023-12-20T04:47:10.949502+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:33:55.135998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952410+0000","last_change":"2023-12-20T04:47:10.952410+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952410+0000","last_undegraded":"2023-12-20T04:47:10.952410+0000","last_fullsized":"2023-12-20T04:47:10.952410+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:31:43.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952401+0000","last_change":"2023-12-20T04:47:10.952401+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952401+0000","last_undegraded":"2023-12-20T04:47:10.952401+0000","last_fullsized":"2023-12-20T04:47:10.952401+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:14:49.931435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.951976+0000","last_change":"2023-12-20T04:47:10.951976+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.951976+0000","last_undegraded":"2023-12-20T04:47:10.951976+0000","last_fullsized":"2023-12-20T04:47:10.951976+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:43:37.374450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952052+0000","last_change":"2023-12-20T04:47:10.952052+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952052+0000","last_undegraded":"2023-12-20T04:47:10.952052+0000","last_fullsized":"2023-12-20T04:47:10.952052+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:48.773190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952045+0000","last_change":"2023-12-20T04:47:10.952045+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952045+0000","last_undegraded":"2023-12-20T04:47:10.952045+0000","last_fullsized":"2023-12-20T04:47:10.952045+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:57:12.056094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952087+0000","last_change":"2023-12-20T04:47:10.952087+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952087+0000","last_undegraded":"2023-12-20T04:47:10.952087+0000","last_fullsized":"2023-12-20T04:47:10.952087+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:11:02.381162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.950119+0000","last_change":"2023-12-20T04:47:10.950119+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.950119+0000","last_undegraded":"2023-12-20T04:47:10.950119+0000","last_fullsized":"2023-12-20T04:47:10.950119+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:17:19.170567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949640+0000","last_change":"2023-12-20T04:47:10.949640+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949640+0000","last_undegraded":"2023-12-20T04:47:10.949640+0000","last_fullsized":"2023-12-20T04:47:10.949640+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:38:22.215544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949430+0000","last_change":"2023-12-20T04:47:10.949430+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949430+0000","last_undegraded":"2023-12-20T04:47:10.949430+0000","last_fullsized":"2023-12-20T04:47:10.949430+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:27:23.394159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.948492+0000","last_change":"2023-12-20T04:47:10.948492+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.948492+0000","last_undegraded":"2023-12-20T04:47:10.948492+0000","last_fullsized":"2023-12-20T04:47:10.948492+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:28:05.732418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.950167+0000","last_change":"2023-12-20T04:47:10.950167+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.950167+0000","last_undegraded":"2023-12-20T04:47:10.950167+0000","last_fullsized":"2023-12-20T04:47:10.950167+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:34:16.121204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.948492+0000","last_change":"2023-12-20T04:47:10.948492+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.948492+0000","last_undegraded":"2023-12-20T04:47:10.948492+0000","last_fullsized":"2023-12-20T04:47:10.948492+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:38:22.215544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.951408+0000","last_change":"2023-12-20T04:47:10.951408+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.951408+0000","last_undegraded":"2023-12-20T04:47:10.951408+0000","last_fullsized":"2023-12-20T04:47:10.951408+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:34:16.121204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":232,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-20T04:47:09.905271+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:47:09.905271+0000","last_peered":"2023-12-20T04:47:09.905271+0000","last_clean":"2023-12-20T04:47:09.905271+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:47:09.905271+0000","last_undegraded":"2023-12-20T04:47:09.905271+0000","last_fullsized":"2023-12-20T04:47:09.905271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1084,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198889073,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.79200000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46899999999999997}]},{"osd":1,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69799999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77600000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.625}]},{"osd":2,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.40600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.74199999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60099999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.753,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.55500000000000005}]},{"osd":4,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69299999999999995,"5min":0.753,"15min":0.753},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48599999999999999,"15min":0.48799999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.70399999999999996}]},{"osd":5,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58599999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.438},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.33800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52400000000000002,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70199999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66800000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.74399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194804,"statfs":{"total":200000000,"available":199479441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.498,"15min":0.49299999999999999},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.40500000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.68000000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.503}]},{"osd":1,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.47199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.749,"5min":0.751,"15min":0.751},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.437,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.624}]},{"osd":2,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.29999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71599999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.36299999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.42599999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.52700000000000002,"15min":0.499},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.435,"5min":0.377,"15min":0.377},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.47599999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.49399999999999999,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.58699999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.5,"15min":0.49299999999999999},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63700000000000001,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53800000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51300000000000001,"15min":0.51700000000000002},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70899999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52100000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68700000000000006,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.44700000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72199999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.63800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194804,"statfs":{"total":200000000,"available":199479441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.66700000000000004,"5min":0.745,"15min":0.745},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72399999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.60999999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.749,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58499999999999996}]},{"osd":2,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72299999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68799999999999994,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.59899999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.47999999999999998,"15min":0.504},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.63900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.375},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47299999999999998,"15min":0.47999999999999998},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65800000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.32800000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48699999999999999,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.65500000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.52900000000000003,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.75600000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54100000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.52700000000000002},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58699999999999997,"15min":0.60799999999999998},"min":{"1min":0.40300000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77600000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194804,"statfs":{"total":200000000,"available":199479441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.28699999999999998,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.71499999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.624}]},{"osd":1,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70099999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.32800000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75600000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54100000000000004,"15min":0.55600000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.33900000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.73999999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.495}]},{"osd":3,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78100000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45200000000000001,"15min":0.47399999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.65000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.495,"15min":0.50600000000000001},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54200000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48699999999999999,"15min":0.503},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.71399999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51200000000000001,"15min":0.53100000000000003},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69999999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.55600000000000005}]},{"osd":7,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.51400000000000001},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65500000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194804,"statfs":{"total":200000000,"available":199479441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.34699999999999998,"15min":0.33800000000000002},"min":{"1min":0.23699999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.315},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.35299999999999998},"min":{"1min":0.30499999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.29799999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.32700000000000001,"15min":0.31900000000000001},"min":{"1min":0.26000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35199999999999998,"15min":0.33400000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.27900000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34499999999999997},"min":{"1min":0.23599999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52000000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.249},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.374},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.33300000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71699999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78800000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61199999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.41399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.80400000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.59499999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56799999999999995,"15min":0.55600000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.41899999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194804,"statfs":{"total":200000000,"available":199479441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.32100000000000001,"15min":0.29599999999999999},"min":{"1min":0.20899999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.61499999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38600000000000001,"15min":0.34300000000000003},"min":{"1min":0.27700000000000002,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.53700000000000003,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.36699999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.34899999999999998,"15min":0.32900000000000001},"min":{"1min":0.23499999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.55900000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.36699999999999999,"15min":0.34799999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.53400000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.38700000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.38900000000000001,"15min":0.35699999999999998},"min":{"1min":0.247,"5min":0.216,"15min":0.216},"max":{"1min":0.68100000000000005,"5min":0.995,"15min":0.995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.38800000000000001,"15min":0.36899999999999999},"min":{"1min":0.29299999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61699999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.35299999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80400000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58899999999999997,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.94699999999999995,"5min":2.347,"15min":2.347},"last":0.46600000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80600000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60199999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79000000000000004,"5min":2.274,"15min":2.274},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.91100000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.505}]},{"osd":7,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82999999999999996,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.499},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.86699999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":514,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194798,"statfs":{"total":200000000,"available":199473624,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.30499999999999999,"15min":0.28699999999999998},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.34300000000000003,"15min":0.32700000000000001},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52100000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.33700000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.30299999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.47599999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.34699999999999998},"min":{"1min":0.24199999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.375}]},{"osd":3,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.373,"15min":0.35299999999999998},"min":{"1min":0.21299999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"min":{"1min":0.28999999999999998,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54300000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.27200000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.70899999999999996,"5min":0.873,"15min":0.873},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82899999999999996,"5min":1.002,"15min":1.002},"last":0.53000000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.85799999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73099999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46999999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.39300000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70899999999999996,"5min":1.038,"15min":1.038},"last":0.502},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51400000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84399999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83099999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.53500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1084,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198889073,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.313,"15min":0.307},"min":{"1min":0.21099999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.45200000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.307},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.311},"min":{"1min":0.254,"5min":0.184,"15min":0.184},"max":{"1min":0.47299999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.28299999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35499999999999998},"min":{"1min":0.29899999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.501,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.34499999999999997},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.42899999999999999,"5min":0.622,"15min":0.622},"last":0.371}]},{"osd":3,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.32200000000000001},"min":{"1min":0.24399999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.36099999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53400000000000003,"15min":0.51700000000000002},"min":{"1min":0.438,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.38500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.432}]},{"osd":5,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.40699999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76200000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56000000000000005,"15min":0.54300000000000004},"min":{"1min":0.435,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42399999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.442},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73399999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.57099999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.70199999999999996,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.55300000000000005}]}]}],"pool_statfs":[]}} 2023-12-20T04:47:15.254 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:47:15.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.387+0000 7f175b009640 1 Processor -- start 2023-12-20T04:47:15.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.387+0000 7f175b009640 1 -- start start 2023-12-20T04:47:15.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.388+0000 7f175b009640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1754160450 0x7f1754160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.388+0000 7f175b009640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17541611b0 0x7f17540b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.388+0000 7f175b009640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17540b5ec0 con 0x7f17540b4ec0 2023-12-20T04:47:15.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.388+0000 7f175b009640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17540b5350 con 0x7f1754160450 2023-12-20T04:47:15.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.388+0000 7f175b009640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17541617e0 con 0x7f17541611b0 2023-12-20T04:47:15.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.388+0000 7f17595a6640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f17540b4ec0 0x7f175406a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35566/0 (socket says 172.21.15.132:35566) 2023-12-20T04:47:15.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.388+0000 7f17595a6640 1 -- 172.21.15.132:0/3705819857 learned_addr learned my addr 172.21.15.132:0/3705819857 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:15.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f1753fff640 1 --2- 172.21.15.132:0/3705819857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17541611b0 0x7f17540b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f1758da5640 1 --2- 172.21.15.132:0/3705819857 >> v2:172.21.15.187:3300/0 conn(0x7f1754160450 0x7f1754160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f17537fe640 1 -- 172.21.15.132:0/3705819857 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1444859085 0 0) 0x7f17540b5ec0 con 0x7f17540b4ec0 2023-12-20T04:47:15.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f17537fe640 1 -- 172.21.15.132:0/3705819857 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f173c003520 con 0x7f17540b4ec0 2023-12-20T04:47:15.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f17537fe640 1 -- 172.21.15.132:0/3705819857 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1707209647 0 0) 0x7f173c003520 con 0x7f17540b4ec0 2023-12-20T04:47:15.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f17537fe640 1 -- 172.21.15.132:0/3705819857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17541611b0 msgr2=0x7f17540b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:15.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f17537fe640 1 --2- 172.21.15.132:0/3705819857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17541611b0 0x7f17540b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f17537fe640 1 -- 172.21.15.132:0/3705819857 >> v2:172.21.15.187:3300/0 conn(0x7f1754160450 msgr2=0x7f1754160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:15.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f17537fe640 1 --2- 172.21.15.132:0/3705819857 >> v2:172.21.15.187:3300/0 conn(0x7f1754160450 0x7f1754160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f17537fe640 1 -- 172.21.15.132:0/3705819857 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17540d0fc0 con 0x7f17540b4ec0 2023-12-20T04:47:15.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f17537fe640 1 -- 172.21.15.132:0/3705819857 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f174c0019f0 con 0x7f17540b4ec0 2023-12-20T04:47:15.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f17537fe640 1 -- 172.21.15.132:0/3705819857 >> v1:172.21.15.132:6789/0 conn(0x7f17540b4ec0 legacy=0x7f175406a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:15.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f17537fe640 1 --2- 172.21.15.132:0/3705819857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f173c003970 0x7f173c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f17537fe640 1 --2- 172.21.15.132:0/3705819857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f173c0047c0 0x7f173c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f17537fe640 1 --2- 172.21.15.132:0/3705819857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17541611b0 0x7f173c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f17537fe640 1 -- 172.21.15.132:0/3705819857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17540b5350 con 0x7f173c0047c0 2023-12-20T04:47:15.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f17537fe640 1 -- 172.21.15.132:0/3705819857 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17541617e0 con 0x7f173c003970 2023-12-20T04:47:15.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f17537fe640 1 -- 172.21.15.132:0/3705819857 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f173c00b980 con 0x7f17541611b0 2023-12-20T04:47:15.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f1753fff640 1 --2- 172.21.15.132:0/3705819857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f173c0047c0 0x7f173c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f1758da5640 1 --2- 172.21.15.132:0/3705819857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f173c003970 0x7f173c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f17595a6640 1 --2- 172.21.15.132:0/3705819857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17541611b0 0x7f173c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f1753fff640 1 -- 172.21.15.132:0/3705819857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17541611b0 msgr2=0x7f173c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:15.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f1753fff640 1 --2- 172.21.15.132:0/3705819857 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17541611b0 0x7f173c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f1753fff640 1 -- 172.21.15.132:0/3705819857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f173c003970 msgr2=0x7f173c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:15.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f1753fff640 1 --2- 172.21.15.132:0/3705819857 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f173c003970 0x7f173c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.389+0000 7f1753fff640 1 -- 172.21.15.132:0/3705819857 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f173c003520 con 0x7f173c0047c0 2023-12-20T04:47:15.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.390+0000 7f1753fff640 1 --2- 172.21.15.132:0/3705819857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f173c0047c0 0x7f173c004c40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f1748009ac0 tx=0x7f173c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4adb5dc4e4663d54 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:15.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.390+0000 7f17537fe640 1 -- 172.21.15.132:0/3705819857 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174802c6b0 con 0x7f173c0047c0 2023-12-20T04:47:15.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.390+0000 7f17537fe640 1 -- 172.21.15.132:0/3705819857 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174802c810 con 0x7f173c0047c0 2023-12-20T04:47:15.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.390+0000 7f17537fe640 1 -- 172.21.15.132:0/3705819857 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174802cba0 con 0x7f173c0047c0 2023-12-20T04:47:15.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.391+0000 7f175b009640 1 -- 172.21.15.132:0/3705819857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f173c0047c0 msgr2=0x7f173c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:15.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.391+0000 7f175b009640 1 --2- 172.21.15.132:0/3705819857 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f173c0047c0 0x7f173c004c40 secure :-1 s=READY pgs=1033 cs=0 l=1 rev1=1 crypto rx=0x7f1748009ac0 tx=0x7f173c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.391+0000 7f17595a6640 1 -- 172.21.15.132:0/3705819857 reap_dead start 2023-12-20T04:47:15.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.391+0000 7f175b009640 1 -- 172.21.15.132:0/3705819857 shutdown_connections 2023-12-20T04:47:15.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.391+0000 7f175b009640 1 -- 172.21.15.132:0/3705819857 >> 172.21.15.132:0/3705819857 conn(0x7f17540cf980 msgr2=0x7f17540cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:15.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.391+0000 7f175b009640 1 -- 172.21.15.132:0/3705819857 shutdown_connections 2023-12-20T04:47:15.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.391+0000 7f175b009640 1 -- 172.21.15.132:0/3705819857 wait complete. 2023-12-20T04:47:15.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.392+0000 7f175b009640 1 Processor -- start 2023-12-20T04:47:15.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.392+0000 7f175b009640 1 -- start start 2023-12-20T04:47:15.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f175b009640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f173c0047c0 0x7f175415c170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f175b009640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17541f38a0 0x7f17540c8950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f175b009640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f175415ac40 0x7f175415b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f175b009640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175415b610 con 0x7f173c0047c0 2023-12-20T04:47:15.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f175b009640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f175415c6b0 con 0x7f17541f38a0 2023-12-20T04:47:15.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f175b009640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f175415e470 con 0x7f175415ac40 2023-12-20T04:47:15.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f1758da5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f173c0047c0 0x7f175415c170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f1758da5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f173c0047c0 0x7f175415c170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34942/0 (socket says 172.21.15.132:34942) 2023-12-20T04:47:15.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f1758da5640 1 -- 172.21.15.132:0/2052031877 learned_addr learned my addr 172.21.15.132:0/2052031877 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:15.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f1753fff640 1 --2- 172.21.15.132:0/2052031877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17541f38a0 0x7f17540c8950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f1758da5640 1 -- 172.21.15.132:0/2052031877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f175415ac40 msgr2=0x7f175415b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:15.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f1758da5640 1 --2- 172.21.15.132:0/2052031877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f175415ac40 0x7f175415b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f1758da5640 1 -- 172.21.15.132:0/2052031877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17541f38a0 msgr2=0x7f17540c8950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:15.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f1758da5640 1 --2- 172.21.15.132:0/2052031877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17541f38a0 0x7f17540c8950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f1758da5640 1 -- 172.21.15.132:0/2052031877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17540b7170 con 0x7f173c0047c0 2023-12-20T04:47:15.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f1758da5640 1 --2- 172.21.15.132:0/2052031877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f173c0047c0 0x7f175415c170 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f1744011a70 tx=0x7f1744011f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:15.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f17517fa640 1 -- 172.21.15.132:0/2052031877 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1744009680 con 0x7f173c0047c0 2023-12-20T04:47:15.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f17517fa640 1 -- 172.21.15.132:0/2052031877 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f174400fad0 con 0x7f173c0047c0 2023-12-20T04:47:15.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f17517fa640 1 -- 172.21.15.132:0/2052031877 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f174400fe60 con 0x7f173c0047c0 2023-12-20T04:47:15.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f175b009640 1 -- 172.21.15.132:0/2052031877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17540b7450 con 0x7f173c0047c0 2023-12-20T04:47:15.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.393+0000 7f175b009640 1 -- 172.21.15.132:0/2052031877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17540b7a10 con 0x7f173c0047c0 2023-12-20T04:47:15.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.395+0000 7f175b009640 1 -- 172.21.15.132:0/2052031877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1754071670 con 0x7f173c0047c0 2023-12-20T04:47:15.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.395+0000 7f17517fa640 1 -- 172.21.15.132:0/2052031877 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1744014440 con 0x7f173c0047c0 2023-12-20T04:47:15.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.395+0000 7f17517fa640 1 --2- 172.21.15.132:0/2052031877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f174006a430 0x7f174006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.396+0000 7f1753fff640 1 --2- 172.21.15.132:0/2052031877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f174006a430 0x7f174006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.396+0000 7f17517fa640 1 -- 172.21.15.132:0/2052031877 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1744089100 con 0x7f173c0047c0 2023-12-20T04:47:15.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.396+0000 7f1753fff640 1 --2- 172.21.15.132:0/2052031877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f174006a430 0x7f174006c8f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1748036000 tx=0x7f1748030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:15.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.400+0000 7f17517fa640 1 -- 172.21.15.132:0/2052031877 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1744054780 con 0x7f173c0047c0 2023-12-20T04:47:15.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.561+0000 7f175b009640 1 -- 172.21.15.132:0/2052031877 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f17540d1580 con 0x7f174006a430 2023-12-20T04:47:15.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.568+0000 7f17517fa640 1 -- 172.21.15.132:0/2052031877 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276369 (secure 0 0 0) 0x7f1748034440 con 0x7f174006a430 2023-12-20T04:47:15.573 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:15.574 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:47:15.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.571+0000 7f175b009640 1 -- 172.21.15.132:0/2052031877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f174006a430 msgr2=0x7f174006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:15.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.571+0000 7f175b009640 1 --2- 172.21.15.132:0/2052031877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f174006a430 0x7f174006c8f0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f1748036000 tx=0x7f1748030000 comp rx=0 tx=0).stop 2023-12-20T04:47:15.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.571+0000 7f175b009640 1 -- 172.21.15.132:0/2052031877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f173c0047c0 msgr2=0x7f175415c170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:15.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.571+0000 7f175b009640 1 --2- 172.21.15.132:0/2052031877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f173c0047c0 0x7f175415c170 secure :-1 s=READY pgs=1034 cs=0 l=1 rev1=1 crypto rx=0x7f1744011a70 tx=0x7f1744011f30 comp rx=0 tx=0).stop 2023-12-20T04:47:15.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.571+0000 7f175b009640 1 -- 172.21.15.132:0/2052031877 shutdown_connections 2023-12-20T04:47:15.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.571+0000 7f175b009640 1 --2- 172.21.15.132:0/2052031877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f174006a430 0x7f174006c8f0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.571+0000 7f175b009640 1 --2- 172.21.15.132:0/2052031877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f175415ac40 0x7f175415b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.571+0000 7f175b009640 1 --2- 172.21.15.132:0/2052031877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17541f38a0 0x7f17540c8950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.571+0000 7f175b009640 1 --2- 172.21.15.132:0/2052031877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f173c0047c0 0x7f175415c170 unknown :-1 s=CLOSED pgs=1034 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.571+0000 7f175b009640 1 -- 172.21.15.132:0/2052031877 >> 172.21.15.132:0/2052031877 conn(0x7f17540cf980 msgr2=0x7f17540d3790 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:15.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.571+0000 7f175b009640 1 -- 172.21.15.132:0/2052031877 shutdown_connections 2023-12-20T04:47:15.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.571+0000 7f175b009640 1 -- 172.21.15.132:0/2052031877 wait complete. 2023-12-20T04:47:15.584 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2023-12-20T04:47:14.149143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5225,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557274,"statfs":{"total":1600000000,"available":1594648975,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000613"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.950492+0000","last_change":"2023-12-20T04:47:10.950492+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.950492+0000","last_undegraded":"2023-12-20T04:47:10.950492+0000","last_fullsized":"2023-12-20T04:47:10.950492+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:59:55.486432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.948931+0000","last_change":"2023-12-20T04:47:10.948931+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.948931+0000","last_undegraded":"2023-12-20T04:47:10.948931+0000","last_fullsized":"2023-12-20T04:47:10.948931+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:24.195503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949807+0000","last_change":"2023-12-20T04:47:10.949807+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949807+0000","last_undegraded":"2023-12-20T04:47:10.949807+0000","last_fullsized":"2023-12-20T04:47:10.949807+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:19:12.580438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949775+0000","last_change":"2023-12-20T04:47:10.949775+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949775+0000","last_undegraded":"2023-12-20T04:47:10.949775+0000","last_fullsized":"2023-12-20T04:47:10.949775+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:30:07.400173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.948879+0000","last_change":"2023-12-20T04:47:10.948879+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.948879+0000","last_undegraded":"2023-12-20T04:47:10.948879+0000","last_fullsized":"2023-12-20T04:47:10.948879+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:34:39.263240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.948493+0000","last_change":"2023-12-20T04:47:10.948493+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.948493+0000","last_undegraded":"2023-12-20T04:47:10.948493+0000","last_fullsized":"2023-12-20T04:47:10.948493+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:07:16.555642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949498+0000","last_change":"2023-12-20T04:47:10.949498+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949498+0000","last_undegraded":"2023-12-20T04:47:10.949498+0000","last_fullsized":"2023-12-20T04:47:10.949498+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:05:38.046766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952798+0000","last_change":"2023-12-20T04:47:10.952798+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952798+0000","last_undegraded":"2023-12-20T04:47:10.952798+0000","last_fullsized":"2023-12-20T04:47:10.952798+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:27:15.310466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949712+0000","last_change":"2023-12-20T04:47:10.949712+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949712+0000","last_undegraded":"2023-12-20T04:47:10.949712+0000","last_fullsized":"2023-12-20T04:47:10.949712+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:34:39.263240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949648+0000","last_change":"2023-12-20T04:47:10.949648+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949648+0000","last_undegraded":"2023-12-20T04:47:10.949648+0000","last_fullsized":"2023-12-20T04:47:10.949648+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:18:33.413422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949656+0000","last_change":"2023-12-20T04:47:10.949656+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949656+0000","last_undegraded":"2023-12-20T04:47:10.949656+0000","last_fullsized":"2023-12-20T04:47:10.949656+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:24.195503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952093+0000","last_change":"2023-12-20T04:47:10.952093+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952093+0000","last_undegraded":"2023-12-20T04:47:10.952093+0000","last_fullsized":"2023-12-20T04:47:10.952093+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:15:43.167465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952500+0000","last_change":"2023-12-20T04:47:10.952500+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952500+0000","last_undegraded":"2023-12-20T04:47:10.952500+0000","last_fullsized":"2023-12-20T04:47:10.952500+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:37.421468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952393+0000","last_change":"2023-12-20T04:47:10.952393+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952393+0000","last_undegraded":"2023-12-20T04:47:10.952393+0000","last_fullsized":"2023-12-20T04:47:10.952393+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:29:56.453248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952111+0000","last_change":"2023-12-20T04:47:10.952111+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952111+0000","last_undegraded":"2023-12-20T04:47:10.952111+0000","last_fullsized":"2023-12-20T04:47:10.952111+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:37.421468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949579+0000","last_change":"2023-12-20T04:47:10.949579+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949579+0000","last_undegraded":"2023-12-20T04:47:10.949579+0000","last_fullsized":"2023-12-20T04:47:10.949579+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:28:31.135425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.950772+0000","last_change":"2023-12-20T04:47:10.950772+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.950772+0000","last_undegraded":"2023-12-20T04:47:10.950772+0000","last_fullsized":"2023-12-20T04:47:10.950772+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:13:49.006881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949427+0000","last_change":"2023-12-20T04:47:10.949427+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949427+0000","last_undegraded":"2023-12-20T04:47:10.949427+0000","last_fullsized":"2023-12-20T04:47:10.949427+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:43:49.085959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949502+0000","last_change":"2023-12-20T04:47:10.949502+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949502+0000","last_undegraded":"2023-12-20T04:47:10.949502+0000","last_fullsized":"2023-12-20T04:47:10.949502+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:33:55.135998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952410+0000","last_change":"2023-12-20T04:47:10.952410+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952410+0000","last_undegraded":"2023-12-20T04:47:10.952410+0000","last_fullsized":"2023-12-20T04:47:10.952410+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:31:43.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952401+0000","last_change":"2023-12-20T04:47:10.952401+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952401+0000","last_undegraded":"2023-12-20T04:47:10.952401+0000","last_fullsized":"2023-12-20T04:47:10.952401+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:14:49.931435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.951976+0000","last_change":"2023-12-20T04:47:10.951976+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.951976+0000","last_undegraded":"2023-12-20T04:47:10.951976+0000","last_fullsized":"2023-12-20T04:47:10.951976+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:43:37.374450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952052+0000","last_change":"2023-12-20T04:47:10.952052+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952052+0000","last_undegraded":"2023-12-20T04:47:10.952052+0000","last_fullsized":"2023-12-20T04:47:10.952052+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:48.773190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952045+0000","last_change":"2023-12-20T04:47:10.952045+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952045+0000","last_undegraded":"2023-12-20T04:47:10.952045+0000","last_fullsized":"2023-12-20T04:47:10.952045+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:57:12.056094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952087+0000","last_change":"2023-12-20T04:47:10.952087+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952087+0000","last_undegraded":"2023-12-20T04:47:10.952087+0000","last_fullsized":"2023-12-20T04:47:10.952087+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:11:02.381162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.950119+0000","last_change":"2023-12-20T04:47:10.950119+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.950119+0000","last_undegraded":"2023-12-20T04:47:10.950119+0000","last_fullsized":"2023-12-20T04:47:10.950119+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:17:19.170567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949640+0000","last_change":"2023-12-20T04:47:10.949640+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949640+0000","last_undegraded":"2023-12-20T04:47:10.949640+0000","last_fullsized":"2023-12-20T04:47:10.949640+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:38:22.215544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949430+0000","last_change":"2023-12-20T04:47:10.949430+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949430+0000","last_undegraded":"2023-12-20T04:47:10.949430+0000","last_fullsized":"2023-12-20T04:47:10.949430+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:27:23.394159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.948492+0000","last_change":"2023-12-20T04:47:10.948492+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.948492+0000","last_undegraded":"2023-12-20T04:47:10.948492+0000","last_fullsized":"2023-12-20T04:47:10.948492+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:28:05.732418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.950167+0000","last_change":"2023-12-20T04:47:10.950167+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.950167+0000","last_undegraded":"2023-12-20T04:47:10.950167+0000","last_fullsized":"2023-12-20T04:47:10.950167+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:34:16.121204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.948492+0000","last_change":"2023-12-20T04:47:10.948492+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.948492+0000","last_undegraded":"2023-12-20T04:47:10.948492+0000","last_fullsized":"2023-12-20T04:47:10.948492+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:38:22.215544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.951408+0000","last_change":"2023-12-20T04:47:10.951408+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.951408+0000","last_undegraded":"2023-12-20T04:47:10.951408+0000","last_fullsized":"2023-12-20T04:47:10.951408+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:34:16.121204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":232,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-20T04:47:09.905271+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:47:09.905271+0000","last_peered":"2023-12-20T04:47:09.905271+0000","last_clean":"2023-12-20T04:47:09.905271+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:47:09.905271+0000","last_undegraded":"2023-12-20T04:47:09.905271+0000","last_fullsized":"2023-12-20T04:47:09.905271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1084,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198889073,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.79200000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46899999999999997}]},{"osd":1,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69799999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77600000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.625}]},{"osd":2,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.40600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.74199999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60099999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.753,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.55500000000000005}]},{"osd":4,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69299999999999995,"5min":0.753,"15min":0.753},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48599999999999999,"15min":0.48799999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.70399999999999996}]},{"osd":5,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58599999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.438},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.33800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52400000000000002,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70199999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66800000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.74399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194804,"statfs":{"total":200000000,"available":199479441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.498,"15min":0.49299999999999999},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.40500000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.68000000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.503}]},{"osd":1,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.47199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.749,"5min":0.751,"15min":0.751},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.437,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.624}]},{"osd":2,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.29999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71599999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.36299999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.42599999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.52700000000000002,"15min":0.499},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.435,"5min":0.377,"15min":0.377},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.47599999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.49399999999999999,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.58699999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.5,"15min":0.49299999999999999},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63700000000000001,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53800000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51300000000000001,"15min":0.51700000000000002},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70899999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52100000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68700000000000006,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.44700000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72199999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.63800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194804,"statfs":{"total":200000000,"available":199479441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.66700000000000004,"5min":0.745,"15min":0.745},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72399999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.60999999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.749,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58499999999999996}]},{"osd":2,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72299999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68799999999999994,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.59899999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.47999999999999998,"15min":0.504},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.63900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.375},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47299999999999998,"15min":0.47999999999999998},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65800000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.32800000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48699999999999999,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.65500000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.52900000000000003,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.75600000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54100000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.52700000000000002},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58699999999999997,"15min":0.60799999999999998},"min":{"1min":0.40300000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77600000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194804,"statfs":{"total":200000000,"available":199479441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.28699999999999998,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.71499999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.624}]},{"osd":1,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70099999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.32800000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75600000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54100000000000004,"15min":0.55600000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.33900000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.73999999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.495}]},{"osd":3,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78100000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45200000000000001,"15min":0.47399999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.65000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.495,"15min":0.50600000000000001},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54200000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48699999999999999,"15min":0.503},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.71399999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51200000000000001,"15min":0.53100000000000003},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69999999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.55600000000000005}]},{"osd":7,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.51400000000000001},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65500000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194804,"statfs":{"total":200000000,"available":199479441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.34699999999999998,"15min":0.33800000000000002},"min":{"1min":0.23699999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.315},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.35299999999999998},"min":{"1min":0.30499999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.29799999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.32700000000000001,"15min":0.31900000000000001},"min":{"1min":0.26000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35199999999999998,"15min":0.33400000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.27900000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34499999999999997},"min":{"1min":0.23599999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52000000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.249},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.374},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.33300000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71699999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78800000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61199999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.41399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.80400000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.59499999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56799999999999995,"15min":0.55600000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.41899999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194804,"statfs":{"total":200000000,"available":199479441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.32100000000000001,"15min":0.29599999999999999},"min":{"1min":0.20899999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.61499999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38600000000000001,"15min":0.34300000000000003},"min":{"1min":0.27700000000000002,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.53700000000000003,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.36699999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.34899999999999998,"15min":0.32900000000000001},"min":{"1min":0.23499999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.55900000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.36699999999999999,"15min":0.34799999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.53400000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.38700000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.38900000000000001,"15min":0.35699999999999998},"min":{"1min":0.247,"5min":0.216,"15min":0.216},"max":{"1min":0.68100000000000005,"5min":0.995,"15min":0.995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.38800000000000001,"15min":0.36899999999999999},"min":{"1min":0.29299999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61699999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.35299999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80400000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58899999999999997,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.94699999999999995,"5min":2.347,"15min":2.347},"last":0.46600000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80600000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60199999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79000000000000004,"5min":2.274,"15min":2.274},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.91100000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.505}]},{"osd":7,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82999999999999996,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.499},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.86699999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":514,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194798,"statfs":{"total":200000000,"available":199473624,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.30499999999999999,"15min":0.28699999999999998},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.34300000000000003,"15min":0.32700000000000001},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52100000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.33700000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.30299999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.47599999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.34699999999999998},"min":{"1min":0.24199999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.375}]},{"osd":3,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.373,"15min":0.35299999999999998},"min":{"1min":0.21299999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"min":{"1min":0.28999999999999998,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54300000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.27200000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.70899999999999996,"5min":0.873,"15min":0.873},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82899999999999996,"5min":1.002,"15min":1.002},"last":0.53000000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.85799999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73099999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46999999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.39300000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70899999999999996,"5min":1.038,"15min":1.038},"last":0.502},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51400000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84399999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83099999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.53500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1084,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198889073,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.313,"15min":0.307},"min":{"1min":0.21099999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.45200000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.307},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.311},"min":{"1min":0.254,"5min":0.184,"15min":0.184},"max":{"1min":0.47299999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.28299999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35499999999999998},"min":{"1min":0.29899999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.501,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.34499999999999997},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.42899999999999999,"5min":0.622,"15min":0.622},"last":0.371}]},{"osd":3,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.32200000000000001},"min":{"1min":0.24399999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.36099999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53400000000000003,"15min":0.51700000000000002},"min":{"1min":0.438,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.38500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.432}]},{"osd":5,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.40699999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76200000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56000000000000005,"15min":0.54300000000000004},"min":{"1min":0.435,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42399999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.442},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73399999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.57099999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.70199999999999996,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.55300000000000005}]}]}],"pool_statfs":[]}} 2023-12-20T04:47:15.589 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:47:15.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.722+0000 7f18dc0cf640 1 Processor -- start 2023-12-20T04:47:15.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.723+0000 7f18dc0cf640 1 -- start start 2023-12-20T04:47:15.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.723+0000 7f18dc0cf640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f18d41588e0 0x7f18d4069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.723+0000 7f18dc0cf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d406cf00 0x7f18d40b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.723+0000 7f18dc0cf640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f18d406ea90 con 0x7f18d406a170 2023-12-20T04:47:15.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.723+0000 7f18dc0cf640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f18d406d520 con 0x7f18d41588e0 2023-12-20T04:47:15.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.723+0000 7f18dc0cf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d406a600 con 0x7f18d406cf00 2023-12-20T04:47:15.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.724+0000 7f18da66c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d406cf00 0x7f18d40b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.724+0000 7f18d9e6b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f18d41588e0 0x7f18d4069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.724+0000 7f18da66c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d406cf00 0x7f18d40b4bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:51834/0 (socket says 172.21.15.132:51834) 2023-12-20T04:47:15.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.724+0000 7f18da66c640 1 -- 172.21.15.132:0/1572137495 learned_addr learned my addr 172.21.15.132:0/1572137495 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:15.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.724+0000 7f18da66c640 1 -- 172.21.15.132:0/1572137495 >> v2:172.21.15.187:3300/0 conn(0x7f18d41588e0 msgr2=0x7f18d4069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:15.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.724+0000 7f18da66c640 1 --2- 172.21.15.132:0/1572137495 >> v2:172.21.15.187:3300/0 conn(0x7f18d41588e0 0x7f18d4069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.724+0000 7f18da66c640 1 -- 172.21.15.132:0/1572137495 >> v1:172.21.15.187:6789/0 conn(0x7f18d406a170 legacy=0x7f18d406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:15.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.724+0000 7f18da66c640 1 -- 172.21.15.132:0/1572137495 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18d406e160 con 0x7f18d406cf00 2023-12-20T04:47:15.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.725+0000 7f18da66c640 1 --2- 172.21.15.132:0/1572137495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d406cf00 0x7f18d40b4bb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009e50 tx=0x7f18cc02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfccfcca16a02817 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:15.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.725+0000 7f18d8e69640 1 -- 172.21.15.132:0/1572137495 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc02cb00 con 0x7f18d406cf00 2023-12-20T04:47:15.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.725+0000 7f18d8e69640 1 -- 172.21.15.132:0/1572137495 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18cc02cc60 con 0x7f18d406cf00 2023-12-20T04:47:15.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.725+0000 7f18d8e69640 1 -- 172.21.15.132:0/1572137495 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18cc0343f0 con 0x7f18d406cf00 2023-12-20T04:47:15.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.725+0000 7f18dc0cf640 1 -- 172.21.15.132:0/1572137495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d406cf00 msgr2=0x7f18d40b4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:15.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.725+0000 7f18dc0cf640 1 --2- 172.21.15.132:0/1572137495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d406cf00 0x7f18d40b4bb0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f18cc009e50 tx=0x7f18cc02bf60 comp rx=0 tx=0).stop 2023-12-20T04:47:15.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.725+0000 7f18dc0cf640 1 -- 172.21.15.132:0/1572137495 shutdown_connections 2023-12-20T04:47:15.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.725+0000 7f18dc0cf640 1 --2- 172.21.15.132:0/1572137495 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d406cf00 0x7f18d40b4bb0 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.725+0000 7f18dc0cf640 1 --2- 172.21.15.132:0/1572137495 >> v2:172.21.15.187:3300/0 conn(0x7f18d41588e0 0x7f18d4069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.725+0000 7f18dc0cf640 1 -- 172.21.15.132:0/1572137495 >> 172.21.15.132:0/1572137495 conn(0x7f18d40cfca0 msgr2=0x7f18d40d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:15.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.726+0000 7f18dc0cf640 1 -- 172.21.15.132:0/1572137495 shutdown_connections 2023-12-20T04:47:15.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.726+0000 7f18dc0cf640 1 -- 172.21.15.132:0/1572137495 wait complete. 2023-12-20T04:47:15.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.727+0000 7f18dc0cf640 1 Processor -- start 2023-12-20T04:47:15.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.727+0000 7f18dc0cf640 1 -- start start 2023-12-20T04:47:15.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.727+0000 7f18dc0cf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18d406a170 0x7f18d40cf350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.727+0000 7f18dc0cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18d406cf00 0x7f18d414cbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.727+0000 7f18dc0cf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d41588e0 0x7f18d41f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.727+0000 7f18dc0cf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40ce3b0 con 0x7f18d406cf00 2023-12-20T04:47:15.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.727+0000 7f18dc0cf640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40ce7d0 con 0x7f18d406a170 2023-12-20T04:47:15.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.727+0000 7f18dc0cf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f18d40cda10 con 0x7f18d41588e0 2023-12-20T04:47:15.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.728+0000 7f18d966a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18d406cf00 0x7f18d414cbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.728+0000 7f18d966a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18d406cf00 0x7f18d414cbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34946/0 (socket says 172.21.15.132:34946) 2023-12-20T04:47:15.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.728+0000 7f18d966a640 1 -- 172.21.15.132:0/814759198 learned_addr learned my addr 172.21.15.132:0/814759198 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:15.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.728+0000 7f18d9e6b640 1 --2- 172.21.15.132:0/814759198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18d406a170 0x7f18d40cf350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.728+0000 7f18da66c640 1 --2- 172.21.15.132:0/814759198 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d41588e0 0x7f18d41f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.728+0000 7f18d966a640 1 -- 172.21.15.132:0/814759198 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d41588e0 msgr2=0x7f18d41f1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:15.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.728+0000 7f18d966a640 1 --2- 172.21.15.132:0/814759198 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d41588e0 0x7f18d41f1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.728+0000 7f18d966a640 1 -- 172.21.15.132:0/814759198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18d406a170 msgr2=0x7f18d40cf350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:15.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.728+0000 7f18d966a640 1 --2- 172.21.15.132:0/814759198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18d406a170 0x7f18d40cf350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.728+0000 7f18d966a640 1 -- 172.21.15.132:0/814759198 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f18cc009b30 con 0x7f18d406cf00 2023-12-20T04:47:15.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.728+0000 7f18d966a640 1 --2- 172.21.15.132:0/814759198 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18d406cf00 0x7f18d414cbe0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f18c400c400 tx=0x7f18c400c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:15.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.728+0000 7f18ca7fc640 1 -- 172.21.15.132:0/814759198 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c40052d0 con 0x7f18d406cf00 2023-12-20T04:47:15.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.728+0000 7f18ca7fc640 1 -- 172.21.15.132:0/814759198 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f18c4005430 con 0x7f18d406cf00 2023-12-20T04:47:15.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.728+0000 7f18dc0cf640 1 -- 172.21.15.132:0/814759198 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f18d40cdcf0 con 0x7f18d406cf00 2023-12-20T04:47:15.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.728+0000 7f18ca7fc640 1 -- 172.21.15.132:0/814759198 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f18c4003830 con 0x7f18d406cf00 2023-12-20T04:47:15.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.728+0000 7f18dc0cf640 1 -- 172.21.15.132:0/814759198 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f18d414d4c0 con 0x7f18d406cf00 2023-12-20T04:47:15.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.729+0000 7f18dc0cf640 1 -- 172.21.15.132:0/814759198 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f18d40ce4f0 con 0x7f18d406cf00 2023-12-20T04:47:15.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.730+0000 7f18ca7fc640 1 -- 172.21.15.132:0/814759198 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f18c4003990 con 0x7f18d406cf00 2023-12-20T04:47:15.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.730+0000 7f18ca7fc640 1 --2- 172.21.15.132:0/814759198 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f18b806a430 0x7f18b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:15.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.730+0000 7f18ca7fc640 1 -- 172.21.15.132:0/814759198 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f18c4087df0 con 0x7f18d406cf00 2023-12-20T04:47:15.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.730+0000 7f18d9e6b640 1 --2- 172.21.15.132:0/814759198 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f18b806a430 0x7f18b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:15.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.731+0000 7f18d9e6b640 1 --2- 172.21.15.132:0/814759198 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f18b806a430 0x7f18b806c8f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f18d41575e0 tx=0x7f18d0009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:15.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.734+0000 7f18ca7fc640 1 -- 172.21.15.132:0/814759198 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f18d40ce4f0 con 0x7f18d406cf00 2023-12-20T04:47:15.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.898+0000 7f18dc0cf640 1 -- 172.21.15.132:0/814759198 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f18d406e720 con 0x7f18b806a430 2023-12-20T04:47:15.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.905+0000 7f18ca7fc640 1 -- 172.21.15.132:0/814759198 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276369 (secure 0 0 0) 0x7f18d0011a30 con 0x7f18b806a430 2023-12-20T04:47:15.910 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:15.911 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:47:15.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.908+0000 7f18dc0cf640 1 -- 172.21.15.132:0/814759198 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f18b806a430 msgr2=0x7f18b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.908+0000 7f18dc0cf640 1 --2- 172.21.15.132:0/814759198 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f18b806a430 0x7f18b806c8f0 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f18d41575e0 tx=0x7f18d0009190 comp rx=0 tx=0).stop 2023-12-20T04:47:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.908+0000 7f18dc0cf640 1 -- 172.21.15.132:0/814759198 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18d406cf00 msgr2=0x7f18d414cbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.908+0000 7f18dc0cf640 1 --2- 172.21.15.132:0/814759198 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18d406cf00 0x7f18d414cbe0 secure :-1 s=READY pgs=1035 cs=0 l=1 rev1=1 crypto rx=0x7f18c400c400 tx=0x7f18c400c8c0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.908+0000 7f18dc0cf640 1 -- 172.21.15.132:0/814759198 shutdown_connections 2023-12-20T04:47:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.908+0000 7f18dc0cf640 1 --2- 172.21.15.132:0/814759198 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f18b806a430 0x7f18b806c8f0 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.908+0000 7f18dc0cf640 1 --2- 172.21.15.132:0/814759198 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f18d41588e0 0x7f18d41f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.908+0000 7f18dc0cf640 1 --2- 172.21.15.132:0/814759198 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f18d406cf00 0x7f18d414cbe0 unknown :-1 s=CLOSED pgs=1035 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.908+0000 7f18dc0cf640 1 --2- 172.21.15.132:0/814759198 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f18d406a170 0x7f18d40cf350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.908+0000 7f18dc0cf640 1 -- 172.21.15.132:0/814759198 >> 172.21.15.132:0/814759198 conn(0x7f18d40cfca0 msgr2=0x7f18d4159570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.908+0000 7f18dc0cf640 1 -- 172.21.15.132:0/814759198 shutdown_connections 2023-12-20T04:47:15.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:15.909+0000 7f18dc0cf640 1 -- 172.21.15.132:0/814759198 wait complete. 2023-12-20T04:47:15.921 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":232,"stamp":"2023-12-20T04:47:14.149143+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":9,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5225,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557274,"statfs":{"total":1600000000,"available":1594648975,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000613"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.950492+0000","last_change":"2023-12-20T04:47:10.950492+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.950492+0000","last_undegraded":"2023-12-20T04:47:10.950492+0000","last_fullsized":"2023-12-20T04:47:10.950492+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:59:55.486432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.948931+0000","last_change":"2023-12-20T04:47:10.948931+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.948931+0000","last_undegraded":"2023-12-20T04:47:10.948931+0000","last_fullsized":"2023-12-20T04:47:10.948931+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:24.195503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949807+0000","last_change":"2023-12-20T04:47:10.949807+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949807+0000","last_undegraded":"2023-12-20T04:47:10.949807+0000","last_fullsized":"2023-12-20T04:47:10.949807+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:19:12.580438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949775+0000","last_change":"2023-12-20T04:47:10.949775+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949775+0000","last_undegraded":"2023-12-20T04:47:10.949775+0000","last_fullsized":"2023-12-20T04:47:10.949775+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:30:07.400173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.948879+0000","last_change":"2023-12-20T04:47:10.948879+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.948879+0000","last_undegraded":"2023-12-20T04:47:10.948879+0000","last_fullsized":"2023-12-20T04:47:10.948879+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:34:39.263240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.948493+0000","last_change":"2023-12-20T04:47:10.948493+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.948493+0000","last_undegraded":"2023-12-20T04:47:10.948493+0000","last_fullsized":"2023-12-20T04:47:10.948493+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:07:16.555642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949498+0000","last_change":"2023-12-20T04:47:10.949498+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949498+0000","last_undegraded":"2023-12-20T04:47:10.949498+0000","last_fullsized":"2023-12-20T04:47:10.949498+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:05:38.046766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952798+0000","last_change":"2023-12-20T04:47:10.952798+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952798+0000","last_undegraded":"2023-12-20T04:47:10.952798+0000","last_fullsized":"2023-12-20T04:47:10.952798+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:27:15.310466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949712+0000","last_change":"2023-12-20T04:47:10.949712+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949712+0000","last_undegraded":"2023-12-20T04:47:10.949712+0000","last_fullsized":"2023-12-20T04:47:10.949712+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:34:39.263240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949648+0000","last_change":"2023-12-20T04:47:10.949648+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949648+0000","last_undegraded":"2023-12-20T04:47:10.949648+0000","last_fullsized":"2023-12-20T04:47:10.949648+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:18:33.413422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.15","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949656+0000","last_change":"2023-12-20T04:47:10.949656+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949656+0000","last_undegraded":"2023-12-20T04:47:10.949656+0000","last_fullsized":"2023-12-20T04:47:10.949656+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:24.195503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.14","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952093+0000","last_change":"2023-12-20T04:47:10.952093+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952093+0000","last_undegraded":"2023-12-20T04:47:10.952093+0000","last_fullsized":"2023-12-20T04:47:10.952093+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:15:43.167465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.13","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952500+0000","last_change":"2023-12-20T04:47:10.952500+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952500+0000","last_undegraded":"2023-12-20T04:47:10.952500+0000","last_fullsized":"2023-12-20T04:47:10.952500+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:37.421468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952393+0000","last_change":"2023-12-20T04:47:10.952393+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952393+0000","last_undegraded":"2023-12-20T04:47:10.952393+0000","last_fullsized":"2023-12-20T04:47:10.952393+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:29:56.453248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952111+0000","last_change":"2023-12-20T04:47:10.952111+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952111+0000","last_undegraded":"2023-12-20T04:47:10.952111+0000","last_fullsized":"2023-12-20T04:47:10.952111+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:37.421468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.10","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949579+0000","last_change":"2023-12-20T04:47:10.949579+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949579+0000","last_undegraded":"2023-12-20T04:47:10.949579+0000","last_fullsized":"2023-12-20T04:47:10.949579+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:28:31.135425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.f","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.950772+0000","last_change":"2023-12-20T04:47:10.950772+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.950772+0000","last_undegraded":"2023-12-20T04:47:10.950772+0000","last_fullsized":"2023-12-20T04:47:10.950772+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:13:49.006881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.e","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949427+0000","last_change":"2023-12-20T04:47:10.949427+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949427+0000","last_undegraded":"2023-12-20T04:47:10.949427+0000","last_fullsized":"2023-12-20T04:47:10.949427+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:43:49.085959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949502+0000","last_change":"2023-12-20T04:47:10.949502+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949502+0000","last_undegraded":"2023-12-20T04:47:10.949502+0000","last_fullsized":"2023-12-20T04:47:10.949502+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:33:55.135998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.b","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952410+0000","last_change":"2023-12-20T04:47:10.952410+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952410+0000","last_undegraded":"2023-12-20T04:47:10.952410+0000","last_fullsized":"2023-12-20T04:47:10.952410+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:31:43.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952401+0000","last_change":"2023-12-20T04:47:10.952401+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952401+0000","last_undegraded":"2023-12-20T04:47:10.952401+0000","last_fullsized":"2023-12-20T04:47:10.952401+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:14:49.931435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.951976+0000","last_change":"2023-12-20T04:47:10.951976+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.951976+0000","last_undegraded":"2023-12-20T04:47:10.951976+0000","last_fullsized":"2023-12-20T04:47:10.951976+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:43:37.374450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952052+0000","last_change":"2023-12-20T04:47:10.952052+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952052+0000","last_undegraded":"2023-12-20T04:47:10.952052+0000","last_fullsized":"2023-12-20T04:47:10.952052+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:48.773190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.7","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952045+0000","last_change":"2023-12-20T04:47:10.952045+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952045+0000","last_undegraded":"2023-12-20T04:47:10.952045+0000","last_fullsized":"2023-12-20T04:47:10.952045+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:57:12.056094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.952087+0000","last_change":"2023-12-20T04:47:10.952087+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.952087+0000","last_undegraded":"2023-12-20T04:47:10.952087+0000","last_fullsized":"2023-12-20T04:47:10.952087+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:11:02.381162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.950119+0000","last_change":"2023-12-20T04:47:10.950119+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.950119+0000","last_undegraded":"2023-12-20T04:47:10.950119+0000","last_fullsized":"2023-12-20T04:47:10.950119+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:17:19.170567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949640+0000","last_change":"2023-12-20T04:47:10.949640+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949640+0000","last_undegraded":"2023-12-20T04:47:10.949640+0000","last_fullsized":"2023-12-20T04:47:10.949640+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:38:22.215544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.949430+0000","last_change":"2023-12-20T04:47:10.949430+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.949430+0000","last_undegraded":"2023-12-20T04:47:10.949430+0000","last_fullsized":"2023-12-20T04:47:10.949430+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:27:23.394159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.948492+0000","last_change":"2023-12-20T04:47:10.948492+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.948492+0000","last_undegraded":"2023-12-20T04:47:10.948492+0000","last_fullsized":"2023-12-20T04:47:10.948492+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:28:05.732418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.950167+0000","last_change":"2023-12-20T04:47:10.950167+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.950167+0000","last_undegraded":"2023-12-20T04:47:10.950167+0000","last_fullsized":"2023-12-20T04:47:10.950167+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:34:16.121204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.948492+0000","last_change":"2023-12-20T04:47:10.948492+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.948492+0000","last_undegraded":"2023-12-20T04:47:10.948492+0000","last_fullsized":"2023-12-20T04:47:10.948492+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:38:22.215544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:47:11.946682+0000","last_change":"2023-12-20T04:47:11.946682+0000","last_active":"2023-12-20T04:47:11.946682+0000","last_peered":"2023-12-20T04:47:11.946682+0000","last_clean":"2023-12-20T04:47:11.946682+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:11.946682+0000","last_undegraded":"2023-12-20T04:47:11.946682+0000","last_fullsized":"2023-12-20T04:47:11.946682+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"12.d","version":"0'0","reported_seq":1,"reported_epoch":98,"state":"creating+peering","last_fresh":"2023-12-20T04:47:10.951408+0000","last_change":"2023-12-20T04:47:10.951408+0000","last_active":"2023-12-20T04:47:10.942478+0000","last_peered":"2023-12-20T04:47:10.942478+0000","last_clean":"2023-12-20T04:47:10.942478+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:47:10.951408+0000","last_undegraded":"2023-12-20T04:47:10.951408+0000","last_fullsized":"2023-12-20T04:47:10.951408+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:34:16.121204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":232,"reported_epoch":97,"state":"active+clean","last_fresh":"2023-12-20T04:47:09.905271+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:47:09.905271+0000","last_peered":"2023-12-20T04:47:09.905271+0000","last_clean":"2023-12-20T04:47:09.905271+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:47:09.905271+0000","last_undegraded":"2023-12-20T04:47:09.905271+0000","last_fullsized":"2023-12-20T04:47:09.905271+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1084,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198889073,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.64600000000000002},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.79200000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46899999999999997}]},{"osd":1,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69799999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.66600000000000004},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77600000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.625}]},{"osd":2,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.40600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.74199999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.60099999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.753,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.55500000000000005}]},{"osd":4,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69299999999999995,"5min":0.753,"15min":0.753},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48599999999999999,"15min":0.48799999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.70399999999999996}]},{"osd":5,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58599999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.438},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.33800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.68300000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52400000000000002,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70199999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66800000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.74399999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194804,"statfs":{"total":200000000,"available":199479441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.498,"15min":0.49299999999999999},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.40500000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.68000000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.503}]},{"osd":1,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.47199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.749,"5min":0.751,"15min":0.751},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.437,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.624}]},{"osd":2,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.29999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71599999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.36299999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.42599999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.52700000000000002,"15min":0.499},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.435,"5min":0.377,"15min":0.377},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.47599999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.49399999999999999,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.58699999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.66800000000000004},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.5,"15min":0.49299999999999999},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63700000000000001,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53800000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51300000000000001,"15min":0.51700000000000002},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70899999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.52100000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68700000000000006,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.44700000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72199999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.63800000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194804,"statfs":{"total":200000000,"available":199479441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.66700000000000004,"5min":0.745,"15min":0.745},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72399999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.60999999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.749,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.58499999999999996}]},{"osd":2,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72299999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.47399999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68799999999999994,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.59899999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.47999999999999998,"15min":0.504},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.63900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.375},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47299999999999998,"15min":0.47999999999999998},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65800000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.32800000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48699999999999999,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.65500000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.41899999999999998},{"interface":"front","average":{"1min":0.499,"5min":0.52900000000000003,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.75600000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54100000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.52700000000000002},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58699999999999997,"15min":0.60799999999999998},"min":{"1min":0.40300000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77600000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.52700000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194804,"statfs":{"total":200000000,"available":199479441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.28699999999999998,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.71499999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.624}]},{"osd":1,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70099999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.32800000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75600000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.64300000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54100000000000004,"15min":0.55600000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.33900000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.73999999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.495}]},{"osd":3,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78100000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.66900000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45200000000000001,"15min":0.47399999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.65000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.495,"15min":0.50600000000000001},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.54200000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48699999999999999,"15min":0.503},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.71399999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51200000000000001,"15min":0.53100000000000003},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69999999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.55600000000000005}]},{"osd":7,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.51400000000000001},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65500000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.46000000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194804,"statfs":{"total":200000000,"available":199479441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.34699999999999998,"15min":0.33800000000000002},"min":{"1min":0.23699999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.315},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.35299999999999998},"min":{"1min":0.30499999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.29799999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.32700000000000001,"15min":0.31900000000000001},"min":{"1min":0.26000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35199999999999998,"15min":0.33400000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.27900000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34499999999999997},"min":{"1min":0.23599999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52000000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.249},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.374},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.33300000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71699999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.56899999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78800000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.61199999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.41399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.80400000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.59499999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.55100000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56799999999999995,"15min":0.55600000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.62,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.41899999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63200000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574905,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":508,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194804,"statfs":{"total":200000000,"available":199479441,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.32100000000000001,"15min":0.29599999999999999},"min":{"1min":0.20899999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.61499999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38600000000000001,"15min":0.34300000000000003},"min":{"1min":0.27700000000000002,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.53700000000000003,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.36699999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.34899999999999998,"15min":0.32900000000000001},"min":{"1min":0.23499999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.55900000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.28899999999999998},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.36699999999999999,"15min":0.34799999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.53400000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.38700000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.38900000000000001,"15min":0.35699999999999998},"min":{"1min":0.247,"5min":0.216,"15min":0.216},"max":{"1min":0.68100000000000005,"5min":0.995,"15min":0.995},"last":0.33900000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.38800000000000001,"15min":0.36899999999999999},"min":{"1min":0.29299999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61699999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.35299999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80400000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58899999999999997,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.94699999999999995,"5min":2.347,"15min":2.347},"last":0.46600000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80600000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.60199999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79000000000000004,"5min":2.274,"15min":2.274},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.91100000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.505}]},{"osd":7,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82999999999999996,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.499},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.86699999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.54200000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574906,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":514,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194798,"statfs":{"total":200000000,"available":199473624,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.30499999999999999,"15min":0.28699999999999998},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.34300000000000003,"15min":0.32700000000000001},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52100000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.33700000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.30299999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.47599999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.24199999999999999},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.34699999999999998},"min":{"1min":0.24199999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.375}]},{"osd":3,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.373,"15min":0.35299999999999998},"min":{"1min":0.21299999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"min":{"1min":0.28999999999999998,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54300000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.27200000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.70899999999999996,"5min":0.873,"15min":0.873},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82899999999999996,"5min":1.002,"15min":1.002},"last":0.53000000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.85799999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73099999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46999999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.39300000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70899999999999996,"5min":1.038,"15min":1.038},"last":0.502},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.51400000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84399999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83099999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.53500000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574905,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1084,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194227,"statfs":{"total":200000000,"available":198889073,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.313,"15min":0.307},"min":{"1min":0.21099999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.45200000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.307},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.311},"min":{"1min":0.254,"5min":0.184,"15min":0.184},"max":{"1min":0.47299999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.28299999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35499999999999998},"min":{"1min":0.29899999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.501,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.34499999999999997},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.42899999999999999,"5min":0.622,"15min":0.622},"last":0.371}]},{"osd":3,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.32200000000000001},"min":{"1min":0.24399999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.36099999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53400000000000003,"15min":0.51700000000000002},"min":{"1min":0.438,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.38500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.432}]},{"osd":5,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.40699999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76200000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.52300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56000000000000005,"15min":0.54300000000000004},"min":{"1min":0.435,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.42399999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.442},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73399999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.57099999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.70199999999999996,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.45800000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.55300000000000005}]}]}],"pool_statfs":[]}} 2023-12-20T04:47:15.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3f is not active+clean 2023-12-20T04:47:15.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3e is not active+clean 2023-12-20T04:47:15.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3d is not active+clean 2023-12-20T04:47:15.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3c is not active+clean 2023-12-20T04:47:15.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.926 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3b is not active+clean 2023-12-20T04:47:15.926 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3a is not active+clean 2023-12-20T04:47:15.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.39 is not active+clean 2023-12-20T04:47:15.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.38 is not active+clean 2023-12-20T04:47:15.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.37 is not active+clean 2023-12-20T04:47:15.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.927 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.36 is not active+clean 2023-12-20T04:47:15.927 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.35 is not active+clean 2023-12-20T04:47:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.34 is not active+clean 2023-12-20T04:47:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.33 is not active+clean 2023-12-20T04:47:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.32 is not active+clean 2023-12-20T04:47:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.31 is not active+clean 2023-12-20T04:47:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.30 is not active+clean 2023-12-20T04:47:15.928 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2f is not active+clean 2023-12-20T04:47:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2e is not active+clean 2023-12-20T04:47:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2d is not active+clean 2023-12-20T04:47:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2c is not active+clean 2023-12-20T04:47:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2b is not active+clean 2023-12-20T04:47:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.929 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2a is not active+clean 2023-12-20T04:47:15.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.29 is not active+clean 2023-12-20T04:47:15.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.28 is not active+clean 2023-12-20T04:47:15.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.27 is not active+clean 2023-12-20T04:47:15.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.26 is not active+clean 2023-12-20T04:47:15.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.930 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.25 is not active+clean 2023-12-20T04:47:15.930 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.24 is not active+clean 2023-12-20T04:47:15.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.23 is not active+clean 2023-12-20T04:47:15.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.22 is not active+clean 2023-12-20T04:47:15.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.21 is not active+clean 2023-12-20T04:47:15.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.20 is not active+clean 2023-12-20T04:47:15.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.931 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1e is not active+clean 2023-12-20T04:47:15.931 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1f is not active+clean 2023-12-20T04:47:15.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.950492+0000', 'last_change': '2023-12-20T04:47:10.950492+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.950492+0000', 'last_undegraded': '2023-12-20T04:47:10.950492+0000', 'last_fullsized': '2023-12-20T04:47:10.950492+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:59:55.486432+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:47:15.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1f is not active+clean 2023-12-20T04:47:15.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1e is not active+clean 2023-12-20T04:47:15.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.948931+0000', 'last_change': '2023-12-20T04:47:10.948931+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.948931+0000', 'last_undegraded': '2023-12-20T04:47:10.948931+0000', 'last_fullsized': '2023-12-20T04:47:10.948931+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:25:24.195503+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:47:15.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1c is not active+clean 2023-12-20T04:47:15.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1d is not active+clean 2023-12-20T04:47:15.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.949807+0000', 'last_change': '2023-12-20T04:47:10.949807+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.949807+0000', 'last_undegraded': '2023-12-20T04:47:10.949807+0000', 'last_fullsized': '2023-12-20T04:47:10.949807+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:19:12.580438+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:47:15.932 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1d is not active+clean 2023-12-20T04:47:15.932 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1c is not active+clean 2023-12-20T04:47:15.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.949775+0000', 'last_change': '2023-12-20T04:47:10.949775+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.949775+0000', 'last_undegraded': '2023-12-20T04:47:10.949775+0000', 'last_fullsized': '2023-12-20T04:47:10.949775+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:30:07.400173+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:47:15.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1a is not active+clean 2023-12-20T04:47:15.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1b is not active+clean 2023-12-20T04:47:15.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.948879+0000', 'last_change': '2023-12-20T04:47:10.948879+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.948879+0000', 'last_undegraded': '2023-12-20T04:47:10.948879+0000', 'last_fullsized': '2023-12-20T04:47:10.948879+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T05:34:39.263240+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:47:15.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1b is not active+clean 2023-12-20T04:47:15.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1a is not active+clean 2023-12-20T04:47:15.933 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.948493+0000', 'last_change': '2023-12-20T04:47:10.948493+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.948493+0000', 'last_undegraded': '2023-12-20T04:47:10.948493+0000', 'last_fullsized': '2023-12-20T04:47:10.948493+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T06:07:16.555642+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:47:15.933 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.18 is not active+clean 2023-12-20T04:47:15.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.19 is not active+clean 2023-12-20T04:47:15.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.949498+0000', 'last_change': '2023-12-20T04:47:10.949498+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.949498+0000', 'last_undegraded': '2023-12-20T04:47:10.949498+0000', 'last_fullsized': '2023-12-20T04:47:10.949498+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:05:38.046766+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:47:15.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.19 is not active+clean 2023-12-20T04:47:15.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.18 is not active+clean 2023-12-20T04:47:15.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.952798+0000', 'last_change': '2023-12-20T04:47:10.952798+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.952798+0000', 'last_undegraded': '2023-12-20T04:47:10.952798+0000', 'last_fullsized': '2023-12-20T04:47:10.952798+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T12:27:15.310466+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 4], 'acting': [1, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:47:15.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.16 is not active+clean 2023-12-20T04:47:15.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.934 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.17 is not active+clean 2023-12-20T04:47:15.934 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.949712+0000', 'last_change': '2023-12-20T04:47:10.949712+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.949712+0000', 'last_undegraded': '2023-12-20T04:47:10.949712+0000', 'last_fullsized': '2023-12-20T04:47:10.949712+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T05:34:39.263240+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:47:15.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.17 is not active+clean 2023-12-20T04:47:15.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.16 is not active+clean 2023-12-20T04:47:15.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.949648+0000', 'last_change': '2023-12-20T04:47:10.949648+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.949648+0000', 'last_undegraded': '2023-12-20T04:47:10.949648+0000', 'last_fullsized': '2023-12-20T04:47:10.949648+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:18:33.413422+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 4], 'acting': [6, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:47:15.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.14 is not active+clean 2023-12-20T04:47:15.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.15 is not active+clean 2023-12-20T04:47:15.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.949656+0000', 'last_change': '2023-12-20T04:47:10.949656+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.949656+0000', 'last_undegraded': '2023-12-20T04:47:10.949656+0000', 'last_fullsized': '2023-12-20T04:47:10.949656+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:25:24.195503+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 1], 'acting': [6, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:47:15.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.15 is not active+clean 2023-12-20T04:47:15.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.935 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.14 is not active+clean 2023-12-20T04:47:15.935 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.952093+0000', 'last_change': '2023-12-20T04:47:10.952093+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.952093+0000', 'last_undegraded': '2023-12-20T04:47:10.952093+0000', 'last_fullsized': '2023-12-20T04:47:10.952093+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T14:15:43.167465+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 3], 'acting': [5, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:47:15.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.12 is not active+clean 2023-12-20T04:47:15.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.13 is not active+clean 2023-12-20T04:47:15.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.952500+0000', 'last_change': '2023-12-20T04:47:10.952500+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.952500+0000', 'last_undegraded': '2023-12-20T04:47:10.952500+0000', 'last_fullsized': '2023-12-20T04:47:10.952500+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:49:37.421468+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:47:15.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.13 is not active+clean 2023-12-20T04:47:15.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.12 is not active+clean 2023-12-20T04:47:15.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.952393+0000', 'last_change': '2023-12-20T04:47:10.952393+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.952393+0000', 'last_undegraded': '2023-12-20T04:47:10.952393+0000', 'last_fullsized': '2023-12-20T04:47:10.952393+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:29:56.453248+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:47:15.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.10 is not active+clean 2023-12-20T04:47:15.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.936 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.11 is not active+clean 2023-12-20T04:47:15.936 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.952111+0000', 'last_change': '2023-12-20T04:47:10.952111+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.952111+0000', 'last_undegraded': '2023-12-20T04:47:10.952111+0000', 'last_fullsized': '2023-12-20T04:47:10.952111+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:49:37.421468+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:47:15.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.11 is not active+clean 2023-12-20T04:47:15.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.10 is not active+clean 2023-12-20T04:47:15.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.949579+0000', 'last_change': '2023-12-20T04:47:10.949579+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.949579+0000', 'last_undegraded': '2023-12-20T04:47:10.949579+0000', 'last_fullsized': '2023-12-20T04:47:10.949579+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:28:31.135425+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:47:15.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.e is not active+clean 2023-12-20T04:47:15.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.f is not active+clean 2023-12-20T04:47:15.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.950772+0000', 'last_change': '2023-12-20T04:47:10.950772+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.950772+0000', 'last_undegraded': '2023-12-20T04:47:10.950772+0000', 'last_fullsized': '2023-12-20T04:47:10.950772+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T13:13:49.006881+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:47:15.937 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.f is not active+clean 2023-12-20T04:47:15.937 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.e is not active+clean 2023-12-20T04:47:15.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.949427+0000', 'last_change': '2023-12-20T04:47:10.949427+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.949427+0000', 'last_undegraded': '2023-12-20T04:47:10.949427+0000', 'last_fullsized': '2023-12-20T04:47:10.949427+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T16:43:49.085959+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:47:15.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.d is not active+clean 2023-12-20T04:47:15.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.c is not active+clean 2023-12-20T04:47:15.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.949502+0000', 'last_change': '2023-12-20T04:47:10.949502+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.949502+0000', 'last_undegraded': '2023-12-20T04:47:10.949502+0000', 'last_fullsized': '2023-12-20T04:47:10.949502+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T12:33:55.135998+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:47:15.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.a is not active+clean 2023-12-20T04:47:15.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.b is not active+clean 2023-12-20T04:47:15.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.952410+0000', 'last_change': '2023-12-20T04:47:10.952410+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.952410+0000', 'last_undegraded': '2023-12-20T04:47:10.952410+0000', 'last_fullsized': '2023-12-20T04:47:10.952410+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T16:31:43.075915+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:47:15.938 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.b is not active+clean 2023-12-20T04:47:15.938 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.a is not active+clean 2023-12-20T04:47:15.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.952401+0000', 'last_change': '2023-12-20T04:47:10.952401+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.952401+0000', 'last_undegraded': '2023-12-20T04:47:10.952401+0000', 'last_fullsized': '2023-12-20T04:47:10.952401+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T13:14:49.931435+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:47:15.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.8 is not active+clean 2023-12-20T04:47:15.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.9 is not active+clean 2023-12-20T04:47:15.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.951976+0000', 'last_change': '2023-12-20T04:47:10.951976+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.951976+0000', 'last_undegraded': '2023-12-20T04:47:10.951976+0000', 'last_fullsized': '2023-12-20T04:47:10.951976+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T13:43:37.374450+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:47:15.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.9 is not active+clean 2023-12-20T04:47:15.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.8 is not active+clean 2023-12-20T04:47:15.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.952052+0000', 'last_change': '2023-12-20T04:47:10.952052+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.952052+0000', 'last_undegraded': '2023-12-20T04:47:10.952052+0000', 'last_fullsized': '2023-12-20T04:47:10.952052+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:39:48.773190+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:47:15.939 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.6 is not active+clean 2023-12-20T04:47:15.939 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.7 is not active+clean 2023-12-20T04:47:15.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.952045+0000', 'last_change': '2023-12-20T04:47:10.952045+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.952045+0000', 'last_undegraded': '2023-12-20T04:47:10.952045+0000', 'last_fullsized': '2023-12-20T04:47:10.952045+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T11:57:12.056094+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:47:15.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.7 is not active+clean 2023-12-20T04:47:15.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.6 is not active+clean 2023-12-20T04:47:15.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.952087+0000', 'last_change': '2023-12-20T04:47:10.952087+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.952087+0000', 'last_undegraded': '2023-12-20T04:47:10.952087+0000', 'last_fullsized': '2023-12-20T04:47:10.952087+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T12:11:02.381162+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:47:15.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.4 is not active+clean 2023-12-20T04:47:15.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.940 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.5 is not active+clean 2023-12-20T04:47:15.940 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.950119+0000', 'last_change': '2023-12-20T04:47:10.950119+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.950119+0000', 'last_undegraded': '2023-12-20T04:47:10.950119+0000', 'last_fullsized': '2023-12-20T04:47:10.950119+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T07:17:19.170567+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 2], 'acting': [6, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:47:15.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.5 is not active+clean 2023-12-20T04:47:15.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.4 is not active+clean 2023-12-20T04:47:15.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.949640+0000', 'last_change': '2023-12-20T04:47:10.949640+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.949640+0000', 'last_undegraded': '2023-12-20T04:47:10.949640+0000', 'last_fullsized': '2023-12-20T04:47:10.949640+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:38:22.215544+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:47:15.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.2 is not active+clean 2023-12-20T04:47:15.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.3 is not active+clean 2023-12-20T04:47:15.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.949430+0000', 'last_change': '2023-12-20T04:47:10.949430+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.949430+0000', 'last_undegraded': '2023-12-20T04:47:10.949430+0000', 'last_fullsized': '2023-12-20T04:47:10.949430+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T11:27:23.394159+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 7], 'acting': [0, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:47:15.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.3 is not active+clean 2023-12-20T04:47:15.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.941 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.2 is not active+clean 2023-12-20T04:47:15.941 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.948492+0000', 'last_change': '2023-12-20T04:47:10.948492+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.948492+0000', 'last_undegraded': '2023-12-20T04:47:10.948492+0000', 'last_fullsized': '2023-12-20T04:47:10.948492+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T14:28:05.732418+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:47:15.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.0 is not active+clean 2023-12-20T04:47:15.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.1 is not active+clean 2023-12-20T04:47:15.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.950167+0000', 'last_change': '2023-12-20T04:47:10.950167+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.950167+0000', 'last_undegraded': '2023-12-20T04:47:10.950167+0000', 'last_fullsized': '2023-12-20T04:47:10.950167+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:34:16.121204+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:47:15.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.1 is not active+clean 2023-12-20T04:47:15.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.0 is not active+clean 2023-12-20T04:47:15.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.948492+0000', 'last_change': '2023-12-20T04:47:10.948492+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.948492+0000', 'last_undegraded': '2023-12-20T04:47:10.948492+0000', 'last_fullsized': '2023-12-20T04:47:10.948492+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:38:22.215544+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 6], 'acting': [4, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:47:15.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 13.c is not active+clean 2023-12-20T04:47:15.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '13.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:47:11.946682+0000', 'last_change': '2023-12-20T04:47:11.946682+0000', 'last_active': '2023-12-20T04:47:11.946682+0000', 'last_peered': '2023-12-20T04:47:11.946682+0000', 'last_clean': '2023-12-20T04:47:11.946682+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:11.946682+0000', 'last_undegraded': '2023-12-20T04:47:11.946682+0000', 'last_fullsized': '2023-12-20T04:47:11.946682+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:11.946682+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:47:15.942 INFO:tasks.cephfs.filesystem.ceph_manager:PG 12.d is not active+clean 2023-12-20T04:47:15.942 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '12.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 98, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:47:10.951408+0000', 'last_change': '2023-12-20T04:47:10.951408+0000', 'last_active': '2023-12-20T04:47:10.942478+0000', 'last_peered': '2023-12-20T04:47:10.942478+0000', 'last_clean': '2023-12-20T04:47:10.942478+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:47:10.951408+0000', 'last_undegraded': '2023-12-20T04:47:10.951408+0000', 'last_fullsized': '2023-12-20T04:47:10.951408+0000', 'mapping_epoch': 98, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 98, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'last_clean_scrub_stamp': '2023-12-20T04:47:10.942478+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:34:16.121204+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:47:15.943 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-20T04:47:16.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.058+0000 7feadc4d5640 1 Processor -- start 2023-12-20T04:47:16.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.059+0000 7feadc4d5640 1 -- start start 2023-12-20T04:47:16.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.059+0000 7feadc4d5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fead4159bb0 0x7fead406f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:16.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.060+0000 7feadc4d5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fead406bba0 0x7fead40ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:16.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.060+0000 7feadc4d5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fead406c8e0 con 0x7fead40ad720 2023-12-20T04:47:16.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.060+0000 7feadc4d5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fead415e420 con 0x7fead4159bb0 2023-12-20T04:47:16.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.060+0000 7feadc4d5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead415e700 con 0x7fead406bba0 2023-12-20T04:47:16.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.060+0000 7feada271640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fead4159bb0 0x7fead406f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:16.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.060+0000 7fead9a70640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fead40ad720 0x7fead406b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:35582/0 (socket says 172.21.15.132:35582) 2023-12-20T04:47:16.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.060+0000 7fead9a70640 1 -- 172.21.15.132:0/3906805178 learned_addr learned my addr 172.21.15.132:0/3906805178 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:16.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.060+0000 7feada271640 1 -- 172.21.15.132:0/3906805178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fead406bba0 msgr2=0x7fead40ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:16.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.060+0000 7feadaa72640 1 --2- 172.21.15.132:0/3906805178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fead406bba0 0x7fead40ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:16.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.060+0000 7fead926f640 1 -- 172.21.15.132:0/3906805178 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2476253747 0 0) 0x7fead406c8e0 con 0x7fead40ad720 2023-12-20T04:47:16.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.060+0000 7feada271640 1 --2- 172.21.15.132:0/3906805178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fead406bba0 0x7fead40ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.060+0000 7feada271640 1 -- 172.21.15.132:0/3906805178 >> v1:172.21.15.132:6789/0 conn(0x7fead40ad720 legacy=0x7fead406b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:16.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.060+0000 7feada271640 1 -- 172.21.15.132:0/3906805178 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fead40c9d10 con 0x7fead4159bb0 2023-12-20T04:47:16.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.060+0000 7feadaa72640 1 --2- 172.21.15.132:0/3906805178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fead406bba0 0x7fead40ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:16.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.061+0000 7feada271640 1 --2- 172.21.15.132:0/3906805178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead4159bb0 0x7fead406f3e0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7feac40097a0 tx=0x7feac402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d6d54746bd235c61 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:16.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.061+0000 7fead926f640 1 -- 172.21.15.132:0/3906805178 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4031830 con 0x7fead4159bb0 2023-12-20T04:47:16.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.061+0000 7fead926f640 1 -- 172.21.15.132:0/3906805178 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feac4031990 con 0x7fead4159bb0 2023-12-20T04:47:16.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.061+0000 7fead926f640 1 -- 172.21.15.132:0/3906805178 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feac4031d20 con 0x7fead4159bb0 2023-12-20T04:47:16.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.061+0000 7feadc4d5640 1 -- 172.21.15.132:0/3906805178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead4159bb0 msgr2=0x7fead406f3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:16.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.061+0000 7feadc4d5640 1 --2- 172.21.15.132:0/3906805178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead4159bb0 0x7fead406f3e0 secure :-1 s=READY pgs=1037 cs=0 l=1 rev1=1 crypto rx=0x7feac40097a0 tx=0x7feac402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.061+0000 7feadc4d5640 1 -- 172.21.15.132:0/3906805178 shutdown_connections 2023-12-20T04:47:16.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.061+0000 7feadc4d5640 1 --2- 172.21.15.132:0/3906805178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fead406bba0 0x7fead40ca510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.061+0000 7feadc4d5640 1 --2- 172.21.15.132:0/3906805178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead4159bb0 0x7fead406f3e0 unknown :-1 s=CLOSED pgs=1037 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.061+0000 7feadc4d5640 1 -- 172.21.15.132:0/3906805178 >> 172.21.15.132:0/3906805178 conn(0x7fead406a260 msgr2=0x7fead40b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:16.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.062+0000 7feadc4d5640 1 -- 172.21.15.132:0/3906805178 shutdown_connections 2023-12-20T04:47:16.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.062+0000 7feadc4d5640 1 -- 172.21.15.132:0/3906805178 wait complete. 2023-12-20T04:47:16.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.063+0000 7feadc4d5640 1 Processor -- start 2023-12-20T04:47:16.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.063+0000 7feadc4d5640 1 -- start start 2023-12-20T04:47:16.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.063+0000 7feadc4d5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fead406bba0 0x7fead414dab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:16.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.063+0000 7feadc4d5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fead40ad720 0x7fead41518b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:16.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.063+0000 7feadc4d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead4159bb0 0x7fead4153da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:16.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.063+0000 7feadc4d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead4156420 con 0x7fead4159bb0 2023-12-20T04:47:16.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.063+0000 7feadc4d5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead414dff0 con 0x7fead406bba0 2023-12-20T04:47:16.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.063+0000 7feadc4d5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fead4151df0 con 0x7fead40ad720 2023-12-20T04:47:16.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.063+0000 7feadaa72640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead4159bb0 0x7fead4153da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:16.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.063+0000 7feadaa72640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead4159bb0 0x7fead4153da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34960/0 (socket says 172.21.15.132:34960) 2023-12-20T04:47:16.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.064+0000 7feadaa72640 1 -- 172.21.15.132:0/2279011381 learned_addr learned my addr 172.21.15.132:0/2279011381 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:16.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.064+0000 7feada271640 1 --2- 172.21.15.132:0/2279011381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fead406bba0 0x7fead414dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:16.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.064+0000 7fead9a70640 1 --2- 172.21.15.132:0/2279011381 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fead40ad720 0x7fead41518b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:16.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.064+0000 7feadaa72640 1 -- 172.21.15.132:0/2279011381 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fead40ad720 msgr2=0x7fead41518b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:16.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.064+0000 7feadaa72640 1 --2- 172.21.15.132:0/2279011381 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fead40ad720 0x7fead41518b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.064+0000 7feadaa72640 1 -- 172.21.15.132:0/2279011381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fead406bba0 msgr2=0x7fead414dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:16.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.064+0000 7feadaa72640 1 --2- 172.21.15.132:0/2279011381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fead406bba0 0x7fead414dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.064+0000 7feadaa72640 1 -- 172.21.15.132:0/2279011381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac4009400 con 0x7fead4159bb0 2023-12-20T04:47:16.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.064+0000 7feada271640 1 --2- 172.21.15.132:0/2279011381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fead406bba0 0x7fead414dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:16.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.064+0000 7fead9a70640 1 --2- 172.21.15.132:0/2279011381 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fead40ad720 0x7fead41518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:16.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.064+0000 7feadaa72640 1 --2- 172.21.15.132:0/2279011381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead4159bb0 0x7fead4153da0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7feacc00cea0 tx=0x7feacc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:16.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.064+0000 7feacaffd640 1 -- 172.21.15.132:0/2279011381 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc003b90 con 0x7fead4159bb0 2023-12-20T04:47:16.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.064+0000 7feacaffd640 1 -- 172.21.15.132:0/2279011381 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feacc003d10 con 0x7fead4159bb0 2023-12-20T04:47:16.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.064+0000 7feacaffd640 1 -- 172.21.15.132:0/2279011381 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feacc004260 con 0x7fead4159bb0 2023-12-20T04:47:16.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.064+0000 7feadc4d5640 1 -- 172.21.15.132:0/2279011381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead41542e0 con 0x7fead4159bb0 2023-12-20T04:47:16.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.064+0000 7feadc4d5640 1 -- 172.21.15.132:0/2279011381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead41522e0 con 0x7fead4159bb0 2023-12-20T04:47:16.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.065+0000 7feadc4d5640 1 -- 172.21.15.132:0/2279011381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead4156560 con 0x7fead4159bb0 2023-12-20T04:47:16.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.065+0000 7feacaffd640 1 -- 172.21.15.132:0/2279011381 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feacc0043c0 con 0x7fead4159bb0 2023-12-20T04:47:16.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.066+0000 7feacaffd640 1 --2- 172.21.15.132:0/2279011381 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feab806a460 0x7feab806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:16.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.066+0000 7feada271640 1 --2- 172.21.15.132:0/2279011381 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feab806a460 0x7feab806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:16.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.066+0000 7feacaffd640 1 -- 172.21.15.132:0/2279011381 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feacc0891a0 con 0x7fead4159bb0 2023-12-20T04:47:16.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.066+0000 7feada271640 1 --2- 172.21.15.132:0/2279011381 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feab806a460 0x7feab806c920 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7feac4036000 tx=0x7feac4008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:16.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.070+0000 7feacaffd640 1 -- 172.21.15.132:0/2279011381 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fead4156560 con 0x7fead4159bb0 2023-12-20T04:47:16.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.307+0000 7feadc4d5640 1 -- 172.21.15.132:0/2279011381 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fead4156560 con 0x7fead4159bb0 2023-12-20T04:47:16.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.307+0000 7feacaffd640 1 -- 172.21.15.132:0/2279011381 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1522 (secure 0 0 0) 0x7fead4156560 con 0x7fead4159bb0 2023-12-20T04:47:16.309 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:16.309 INFO:teuthology.orchestra.run.smithi132.stdout:{"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":286,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":101,"num_osds":8,"num_up_osds":8,"osd_up_since":1703047355,"num_in_osds":8,"osd_in_since":1703047352,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":5351025,"bytes_avail":1594648975,"bytes_total":1600000000,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":38,"id":6,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":6,"rank":0,"name":"b","status":"up:active","gid":6957}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":4,"modified":"2023-12-20T04:47:02.147354+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"b":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-20T04:47:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.309+0000 7feadc4d5640 1 -- 172.21.15.132:0/2279011381 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feab806a460 msgr2=0x7feab806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.309+0000 7feadc4d5640 1 --2- 172.21.15.132:0/2279011381 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feab806a460 0x7feab806c920 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7feac4036000 tx=0x7feac4008030 comp rx=0 tx=0).stop 2023-12-20T04:47:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.309+0000 7feadc4d5640 1 -- 172.21.15.132:0/2279011381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead4159bb0 msgr2=0x7fead4153da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.309+0000 7feadc4d5640 1 --2- 172.21.15.132:0/2279011381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead4159bb0 0x7fead4153da0 secure :-1 s=READY pgs=1038 cs=0 l=1 rev1=1 crypto rx=0x7feacc00cea0 tx=0x7feacc00cf90 comp rx=0 tx=0).stop 2023-12-20T04:47:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.309+0000 7feadc4d5640 1 -- 172.21.15.132:0/2279011381 shutdown_connections 2023-12-20T04:47:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.309+0000 7feadc4d5640 1 --2- 172.21.15.132:0/2279011381 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feab806a460 0x7feab806c920 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.309+0000 7feadc4d5640 1 --2- 172.21.15.132:0/2279011381 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fead4159bb0 0x7fead4153da0 unknown :-1 s=CLOSED pgs=1038 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.309+0000 7feadc4d5640 1 --2- 172.21.15.132:0/2279011381 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fead40ad720 0x7fead41518b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.309+0000 7feadc4d5640 1 --2- 172.21.15.132:0/2279011381 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fead406bba0 0x7fead414dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.309+0000 7feadc4d5640 1 -- 172.21.15.132:0/2279011381 >> 172.21.15.132:0/2279011381 conn(0x7fead406a260 msgr2=0x7fead40ccbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:16.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.309+0000 7feadc4d5640 1 -- 172.21.15.132:0/2279011381 shutdown_connections 2023-12-20T04:47:16.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.309+0000 7feadc4d5640 1 -- 172.21.15.132:0/2279011381 wait complete. 2023-12-20T04:47:16.322 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-20T04:47:16.322 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:47:16.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.420+0000 7f9b136ee640 1 Processor -- start 2023-12-20T04:47:16.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.421+0000 7f9b136ee640 1 -- start start 2023-12-20T04:47:16.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.421+0000 7f9b136ee640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9b0c160ba0 0x7f9b0c0cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:16.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.421+0000 7f9b136ee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9b0c0ce2a0 0x7f9b0c0cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:16.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.421+0000 7f9b136ee640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b0c0b0290 0x7f9b0c06f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:16.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.421+0000 7f9b136ee640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0c0cca40 con 0x7f9b0c0ce2a0 2023-12-20T04:47:16.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.421+0000 7f9b136ee640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9b0c161ff0 con 0x7f9b0c160ba0 2023-12-20T04:47:16.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.421+0000 7f9b136ee640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c1613e0 con 0x7f9b0c0b0290 2023-12-20T04:47:16.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.422+0000 7f9b10c89640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9b0c0ce2a0 0x7f9b0c0cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:16.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.422+0000 7f9b10c89640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9b0c0ce2a0 0x7f9b0c0cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34968/0 (socket says 172.21.15.132:34968) 2023-12-20T04:47:16.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.422+0000 7f9b10c89640 1 -- 172.21.15.132:0/3904251268 learned_addr learned my addr 172.21.15.132:0/3904251268 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:16.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.422+0000 7f9b10c89640 1 -- 172.21.15.132:0/3904251268 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b0c0b0290 msgr2=0x7f9b0c06f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:16.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.422+0000 7f9b10c89640 1 --2- 172.21.15.132:0/3904251268 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b0c0b0290 0x7f9b0c06f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.422+0000 7f9b1148a640 1 --2- 172.21.15.132:0/3904251268 >> v2:172.21.15.187:3300/0 conn(0x7f9b0c160ba0 0x7f9b0c0cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:16.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.422+0000 7f9b10c89640 1 -- 172.21.15.132:0/3904251268 >> v2:172.21.15.187:3300/0 conn(0x7f9b0c160ba0 msgr2=0x7f9b0c0cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:16.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.422+0000 7f9b10c89640 1 --2- 172.21.15.132:0/3904251268 >> v2:172.21.15.187:3300/0 conn(0x7f9b0c160ba0 0x7f9b0c0cb380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.422+0000 7f9b10c89640 1 -- 172.21.15.132:0/3904251268 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b0c1616c0 con 0x7f9b0c0ce2a0 2023-12-20T04:47:16.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.422+0000 7f9b1148a640 1 --2- 172.21.15.132:0/3904251268 >> v2:172.21.15.187:3300/0 conn(0x7f9b0c160ba0 0x7f9b0c0cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:16.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.423+0000 7f9b10c89640 1 --2- 172.21.15.132:0/3904251268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b0c0ce2a0 0x7f9b0c0cb8c0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0cc6f0 tx=0x7f9afc02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc14f5de17e3c287 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:16.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.423+0000 7f9b03fff640 1 -- 172.21.15.132:0/3904251268 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc0317c0 con 0x7f9b0c0ce2a0 2023-12-20T04:47:16.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.423+0000 7f9b03fff640 1 -- 172.21.15.132:0/3904251268 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9afc031920 con 0x7f9b0c0ce2a0 2023-12-20T04:47:16.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.423+0000 7f9b03fff640 1 -- 172.21.15.132:0/3904251268 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9afc031cb0 con 0x7f9b0c0ce2a0 2023-12-20T04:47:16.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.423+0000 7f9b136ee640 1 -- 172.21.15.132:0/3904251268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b0c0ce2a0 msgr2=0x7f9b0c0cb8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:16.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.423+0000 7f9b136ee640 1 --2- 172.21.15.132:0/3904251268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b0c0ce2a0 0x7f9b0c0cb8c0 secure :-1 s=READY pgs=1039 cs=0 l=1 rev1=1 crypto rx=0x7f9b0c0cc6f0 tx=0x7f9afc02b860 comp rx=0 tx=0).stop 2023-12-20T04:47:16.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.423+0000 7f9b136ee640 1 -- 172.21.15.132:0/3904251268 shutdown_connections 2023-12-20T04:47:16.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.423+0000 7f9b136ee640 1 --2- 172.21.15.132:0/3904251268 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b0c0b0290 0x7f9b0c06f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.423+0000 7f9b136ee640 1 --2- 172.21.15.132:0/3904251268 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b0c0ce2a0 0x7f9b0c0cb8c0 unknown :-1 s=CLOSED pgs=1039 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.423+0000 7f9b136ee640 1 --2- 172.21.15.132:0/3904251268 >> v2:172.21.15.187:3300/0 conn(0x7f9b0c160ba0 0x7f9b0c0cb380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.423+0000 7f9b136ee640 1 -- 172.21.15.132:0/3904251268 >> 172.21.15.132:0/3904251268 conn(0x7f9b0c0cd7b0 msgr2=0x7f9b0c0cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:16.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.423+0000 7f9b136ee640 1 -- 172.21.15.132:0/3904251268 shutdown_connections 2023-12-20T04:47:16.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.423+0000 7f9b136ee640 1 -- 172.21.15.132:0/3904251268 wait complete. 2023-12-20T04:47:16.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.424+0000 7f9b136ee640 1 Processor -- start 2023-12-20T04:47:16.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.425+0000 7f9b136ee640 1 -- start start 2023-12-20T04:47:16.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.425+0000 7f9b136ee640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b0c0b0290 0x7f9b0c1f6570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:16.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.425+0000 7f9b136ee640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b0c0ce2a0 0x7f9b0c1513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:16.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.425+0000 7f9b136ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b0c160ba0 0x7f9b0c1529f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:16.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.425+0000 7f9b136ee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c1f7510 con 0x7f9b0c160ba0 2023-12-20T04:47:16.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.425+0000 7f9b136ee640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c154e60 con 0x7f9b0c0ce2a0 2023-12-20T04:47:16.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.425+0000 7f9b136ee640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9b0c1f6c70 con 0x7f9b0c0b0290 2023-12-20T04:47:16.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.425+0000 7f9b11c8b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b0c160ba0 0x7f9b0c1529f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:16.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.425+0000 7f9b11c8b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b0c160ba0 0x7f9b0c1529f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34976/0 (socket says 172.21.15.132:34976) 2023-12-20T04:47:16.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.425+0000 7f9b11c8b640 1 -- 172.21.15.132:0/4053689659 learned_addr learned my addr 172.21.15.132:0/4053689659 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:16.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.426+0000 7f9b11c8b640 1 -- 172.21.15.132:0/4053689659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b0c0b0290 msgr2=0x7f9b0c1f6570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:16.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.426+0000 7f9b10c89640 1 --2- 172.21.15.132:0/4053689659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b0c0ce2a0 0x7f9b0c1513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:16.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.426+0000 7f9b1148a640 1 --2- 172.21.15.132:0/4053689659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b0c0b0290 0x7f9b0c1f6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:16.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.426+0000 7f9b11c8b640 1 --2- 172.21.15.132:0/4053689659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b0c0b0290 0x7f9b0c1f6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.426+0000 7f9b11c8b640 1 -- 172.21.15.132:0/4053689659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b0c0ce2a0 msgr2=0x7f9b0c1513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.426+0000 7f9b11c8b640 1 --2- 172.21.15.132:0/4053689659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b0c0ce2a0 0x7f9b0c1513f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.426+0000 7f9b11c8b640 1 -- 172.21.15.132:0/4053689659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9afc0094d0 con 0x7f9b0c160ba0 2023-12-20T04:47:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.426+0000 7f9b10c89640 1 --2- 172.21.15.132:0/4053689659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b0c0ce2a0 0x7f9b0c1513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.426+0000 7f9b11c8b640 1 --2- 172.21.15.132:0/4053689659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b0c160ba0 0x7f9b0c1529f0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400b9a0 tx=0x7f9b0400be60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.426+0000 7f9b01ffb640 1 -- 172.21.15.132:0/4053689659 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b0400cba0 con 0x7f9b0c160ba0 2023-12-20T04:47:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.426+0000 7f9b01ffb640 1 -- 172.21.15.132:0/4053689659 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9b0400cd20 con 0x7f9b0c160ba0 2023-12-20T04:47:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.426+0000 7f9b136ee640 1 -- 172.21.15.132:0/4053689659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b0c1f6f50 con 0x7f9b0c160ba0 2023-12-20T04:47:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.426+0000 7f9b01ffb640 1 -- 172.21.15.132:0/4053689659 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9b04014680 con 0x7f9b0c160ba0 2023-12-20T04:47:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.426+0000 7f9b136ee640 1 -- 172.21.15.132:0/4053689659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b0c0c8ff0 con 0x7f9b0c160ba0 2023-12-20T04:47:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.427+0000 7f9b136ee640 1 -- 172.21.15.132:0/4053689659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b0c0c91e0 con 0x7f9b0c160ba0 2023-12-20T04:47:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.427+0000 7f9b01ffb640 1 -- 172.21.15.132:0/4053689659 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9b0401d3b0 con 0x7f9b0c160ba0 2023-12-20T04:47:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.428+0000 7f9b01ffb640 1 --2- 172.21.15.132:0/4053689659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9af006a430 0x7f9af006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.428+0000 7f9b01ffb640 1 -- 172.21.15.132:0/4053689659 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9b04088860 con 0x7f9b0c160ba0 2023-12-20T04:47:16.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.428+0000 7f9b1148a640 1 --2- 172.21.15.132:0/4053689659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9af006a430 0x7f9af006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:16.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.428+0000 7f9b1148a640 1 --2- 172.21.15.132:0/4053689659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9af006a430 0x7f9af006c8f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800b840 tx=0x7f9b08008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:16.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.432+0000 7f9b01ffb640 1 -- 172.21.15.132:0/4053689659 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9b04053ee0 con 0x7f9b0c160ba0 2023-12-20T04:47:16.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.593+0000 7f9b136ee640 1 -- 172.21.15.132:0/4053689659 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f9b0c1589d0 con 0x7f9af006a430 2023-12-20T04:47:16.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.600+0000 7f9b01ffb640 1 -- 172.21.15.132:0/4053689659 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285469 (secure 0 0 0) 0x7f9b0c1589d0 con 0x7f9af006a430 2023-12-20T04:47:16.605 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:16.607 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:47:16.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.603+0000 7f9b136ee640 1 -- 172.21.15.132:0/4053689659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9af006a430 msgr2=0x7f9af006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:16.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.603+0000 7f9b136ee640 1 --2- 172.21.15.132:0/4053689659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9af006a430 0x7f9af006c8f0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f9b0800b840 tx=0x7f9b08008040 comp rx=0 tx=0).stop 2023-12-20T04:47:16.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.603+0000 7f9b136ee640 1 -- 172.21.15.132:0/4053689659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b0c160ba0 msgr2=0x7f9b0c1529f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:16.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.603+0000 7f9b136ee640 1 --2- 172.21.15.132:0/4053689659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b0c160ba0 0x7f9b0c1529f0 secure :-1 s=READY pgs=1040 cs=0 l=1 rev1=1 crypto rx=0x7f9b0400b9a0 tx=0x7f9b0400be60 comp rx=0 tx=0).stop 2023-12-20T04:47:16.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.604+0000 7f9b136ee640 1 -- 172.21.15.132:0/4053689659 shutdown_connections 2023-12-20T04:47:16.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.604+0000 7f9b136ee640 1 --2- 172.21.15.132:0/4053689659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9af006a430 0x7f9af006c8f0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.604+0000 7f9b136ee640 1 --2- 172.21.15.132:0/4053689659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9b0c160ba0 0x7f9b0c1529f0 unknown :-1 s=CLOSED pgs=1040 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.604+0000 7f9b136ee640 1 --2- 172.21.15.132:0/4053689659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9b0c0ce2a0 0x7f9b0c1513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.604+0000 7f9b136ee640 1 --2- 172.21.15.132:0/4053689659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9b0c0b0290 0x7f9b0c1f6570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:16.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.604+0000 7f9b136ee640 1 -- 172.21.15.132:0/4053689659 >> 172.21.15.132:0/4053689659 conn(0x7f9b0c0cd7b0 msgr2=0x7f9b0c0cf000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:16.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.604+0000 7f9b136ee640 1 -- 172.21.15.132:0/4053689659 shutdown_connections 2023-12-20T04:47:16.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:16.604+0000 7f9b136ee640 1 -- 172.21.15.132:0/4053689659 wait complete. 2023-12-20T04:47:16.616 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":233,"stamp":"2023-12-20T04:47:16.149468+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5421,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557078,"statfs":{"total":1600000000,"available":1594448732,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.202471"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718340+0000","last_change":"2023-12-20T04:47:12.319816+0000","last_active":"2023-12-20T04:47:13.718340+0000","last_peered":"2023-12-20T04:47:13.718340+0000","last_clean":"2023-12-20T04:47:13.718340+0000","last_became_active":"2023-12-20T04:47:12.319572+0000","last_became_peered":"2023-12-20T04:47:12.319572+0000","last_unstale":"2023-12-20T04:47:13.718340+0000","last_undegraded":"2023-12-20T04:47:13.718340+0000","last_fullsized":"2023-12-20T04:47:13.718340+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:48:26.370370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305926+0000","last_change":"2023-12-20T04:47:12.321504+0000","last_active":"2023-12-20T04:47:13.305926+0000","last_peered":"2023-12-20T04:47:13.305926+0000","last_clean":"2023-12-20T04:47:13.305926+0000","last_became_active":"2023-12-20T04:47:12.320558+0000","last_became_peered":"2023-12-20T04:47:12.320558+0000","last_unstale":"2023-12-20T04:47:13.305926+0000","last_undegraded":"2023-12-20T04:47:13.305926+0000","last_fullsized":"2023-12-20T04:47:13.305926+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:47:46.083643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305596+0000","last_change":"2023-12-20T04:47:12.317527+0000","last_active":"2023-12-20T04:47:13.305596+0000","last_peered":"2023-12-20T04:47:13.305596+0000","last_clean":"2023-12-20T04:47:13.305596+0000","last_became_active":"2023-12-20T04:47:12.317308+0000","last_became_peered":"2023-12-20T04:47:12.317308+0000","last_unstale":"2023-12-20T04:47:13.305596+0000","last_undegraded":"2023-12-20T04:47:13.305596+0000","last_fullsized":"2023-12-20T04:47:13.305596+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:19:54.145383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307488+0000","last_change":"2023-12-20T04:47:12.317502+0000","last_active":"2023-12-20T04:47:13.307488+0000","last_peered":"2023-12-20T04:47:13.307488+0000","last_clean":"2023-12-20T04:47:13.307488+0000","last_became_active":"2023-12-20T04:47:12.317005+0000","last_became_peered":"2023-12-20T04:47:12.317005+0000","last_unstale":"2023-12-20T04:47:13.307488+0000","last_undegraded":"2023-12-20T04:47:13.307488+0000","last_fullsized":"2023-12-20T04:47:13.307488+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:52:35.520239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308268+0000","last_change":"2023-12-20T04:47:12.312082+0000","last_active":"2023-12-20T04:47:13.308268+0000","last_peered":"2023-12-20T04:47:13.308268+0000","last_clean":"2023-12-20T04:47:13.308268+0000","last_became_active":"2023-12-20T04:47:12.311835+0000","last_became_peered":"2023-12-20T04:47:12.311835+0000","last_unstale":"2023-12-20T04:47:13.308268+0000","last_undegraded":"2023-12-20T04:47:13.308268+0000","last_fullsized":"2023-12-20T04:47:13.308268+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:55:35.518784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.717918+0000","last_change":"2023-12-20T04:47:12.318185+0000","last_active":"2023-12-20T04:47:13.717918+0000","last_peered":"2023-12-20T04:47:13.717918+0000","last_clean":"2023-12-20T04:47:13.717918+0000","last_became_active":"2023-12-20T04:47:12.315846+0000","last_became_peered":"2023-12-20T04:47:12.315846+0000","last_unstale":"2023-12-20T04:47:13.717918+0000","last_undegraded":"2023-12-20T04:47:13.717918+0000","last_fullsized":"2023-12-20T04:47:13.717918+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:34:17.125409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307742+0000","last_change":"2023-12-20T04:47:12.311994+0000","last_active":"2023-12-20T04:47:13.307742+0000","last_peered":"2023-12-20T04:47:13.307742+0000","last_clean":"2023-12-20T04:47:13.307742+0000","last_became_active":"2023-12-20T04:47:12.311759+0000","last_became_peered":"2023-12-20T04:47:12.311759+0000","last_unstale":"2023-12-20T04:47:13.307742+0000","last_undegraded":"2023-12-20T04:47:13.307742+0000","last_fullsized":"2023-12-20T04:47:13.307742+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:00:40.904917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718077+0000","last_change":"2023-12-20T04:47:12.319002+0000","last_active":"2023-12-20T04:47:13.718077+0000","last_peered":"2023-12-20T04:47:13.718077+0000","last_clean":"2023-12-20T04:47:13.718077+0000","last_became_active":"2023-12-20T04:47:12.316809+0000","last_became_peered":"2023-12-20T04:47:12.316809+0000","last_unstale":"2023-12-20T04:47:13.718077+0000","last_undegraded":"2023-12-20T04:47:13.718077+0000","last_fullsized":"2023-12-20T04:47:13.718077+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:47:46.083643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.717759+0000","last_change":"2023-12-20T04:47:12.313212+0000","last_active":"2023-12-20T04:47:13.717759+0000","last_peered":"2023-12-20T04:47:13.717759+0000","last_clean":"2023-12-20T04:47:13.717759+0000","last_became_active":"2023-12-20T04:47:12.312929+0000","last_became_peered":"2023-12-20T04:47:12.312929+0000","last_unstale":"2023-12-20T04:47:13.717759+0000","last_undegraded":"2023-12-20T04:47:13.717759+0000","last_fullsized":"2023-12-20T04:47:13.717759+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:38:23.219749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718287+0000","last_change":"2023-12-20T04:47:12.318674+0000","last_active":"2023-12-20T04:47:13.718287+0000","last_peered":"2023-12-20T04:47:13.718287+0000","last_clean":"2023-12-20T04:47:13.718287+0000","last_became_active":"2023-12-20T04:47:12.318444+0000","last_became_peered":"2023-12-20T04:47:12.318444+0000","last_unstale":"2023-12-20T04:47:13.718287+0000","last_undegraded":"2023-12-20T04:47:13.718287+0000","last_fullsized":"2023-12-20T04:47:13.718287+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:27:49.207248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305906+0000","last_change":"2023-12-20T04:47:12.316674+0000","last_active":"2023-12-20T04:47:13.305906+0000","last_peered":"2023-12-20T04:47:13.305906+0000","last_clean":"2023-12-20T04:47:13.305906+0000","last_became_active":"2023-12-20T04:47:12.315714+0000","last_became_peered":"2023-12-20T04:47:12.315714+0000","last_unstale":"2023-12-20T04:47:13.305906+0000","last_undegraded":"2023-12-20T04:47:13.305906+0000","last_fullsized":"2023-12-20T04:47:13.305906+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:35:09.638327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718268+0000","last_change":"2023-12-20T04:47:12.319261+0000","last_active":"2023-12-20T04:47:13.718268+0000","last_peered":"2023-12-20T04:47:13.718268+0000","last_clean":"2023-12-20T04:47:13.718268+0000","last_became_active":"2023-12-20T04:47:12.319008+0000","last_became_peered":"2023-12-20T04:47:12.319008+0000","last_unstale":"2023-12-20T04:47:13.718268+0000","last_undegraded":"2023-12-20T04:47:13.718268+0000","last_fullsized":"2023-12-20T04:47:13.718268+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:55:35.518784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305726+0000","last_change":"2023-12-20T04:47:12.315546+0000","last_active":"2023-12-20T04:47:13.305726+0000","last_peered":"2023-12-20T04:47:13.305726+0000","last_clean":"2023-12-20T04:47:13.305726+0000","last_became_active":"2023-12-20T04:47:12.315326+0000","last_became_peered":"2023-12-20T04:47:12.315326+0000","last_unstale":"2023-12-20T04:47:13.305726+0000","last_undegraded":"2023-12-20T04:47:13.305726+0000","last_fullsized":"2023-12-20T04:47:13.305726+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:49.777395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307561+0000","last_change":"2023-12-20T04:47:12.317354+0000","last_active":"2023-12-20T04:47:13.307561+0000","last_peered":"2023-12-20T04:47:13.307561+0000","last_clean":"2023-12-20T04:47:13.307561+0000","last_became_active":"2023-12-20T04:47:12.316169+0000","last_became_peered":"2023-12-20T04:47:12.316169+0000","last_unstale":"2023-12-20T04:47:13.307561+0000","last_undegraded":"2023-12-20T04:47:13.307561+0000","last_fullsized":"2023-12-20T04:47:13.307561+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:03:47.167403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.717428+0000","last_change":"2023-12-20T04:47:12.312075+0000","last_active":"2023-12-20T04:47:13.717428+0000","last_peered":"2023-12-20T04:47:13.717428+0000","last_clean":"2023-12-20T04:47:13.717428+0000","last_became_active":"2023-12-20T04:47:12.311886+0000","last_became_peered":"2023-12-20T04:47:12.311886+0000","last_unstale":"2023-12-20T04:47:13.717428+0000","last_undegraded":"2023-12-20T04:47:13.717428+0000","last_fullsized":"2023-12-20T04:47:13.717428+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:48:26.370370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308329+0000","last_change":"2023-12-20T04:47:12.321602+0000","last_active":"2023-12-20T04:47:13.308329+0000","last_peered":"2023-12-20T04:47:13.308329+0000","last_clean":"2023-12-20T04:47:13.308329+0000","last_became_active":"2023-12-20T04:47:12.320847+0000","last_became_peered":"2023-12-20T04:47:12.320847+0000","last_unstale":"2023-12-20T04:47:13.308329+0000","last_undegraded":"2023-12-20T04:47:13.308329+0000","last_fullsized":"2023-12-20T04:47:13.308329+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:29:57.457453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308096+0000","last_change":"2023-12-20T04:47:12.308376+0000","last_active":"2023-12-20T04:47:13.308096+0000","last_peered":"2023-12-20T04:47:13.308096+0000","last_clean":"2023-12-20T04:47:13.308096+0000","last_became_active":"2023-12-20T04:47:12.307677+0000","last_became_peered":"2023-12-20T04:47:12.307677+0000","last_unstale":"2023-12-20T04:47:13.308096+0000","last_undegraded":"2023-12-20T04:47:13.308096+0000","last_fullsized":"2023-12-20T04:47:13.308096+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:31:44.080120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307802+0000","last_change":"2023-12-20T04:47:12.319818+0000","last_active":"2023-12-20T04:47:13.307802+0000","last_peered":"2023-12-20T04:47:13.307802+0000","last_clean":"2023-12-20T04:47:13.307802+0000","last_became_active":"2023-12-20T04:47:12.318202+0000","last_became_peered":"2023-12-20T04:47:12.318202+0000","last_unstale":"2023-12-20T04:47:13.307802+0000","last_undegraded":"2023-12-20T04:47:13.307802+0000","last_fullsized":"2023-12-20T04:47:13.307802+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:01:05.467132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305681+0000","last_change":"2023-12-20T04:47:12.311031+0000","last_active":"2023-12-20T04:47:13.305681+0000","last_peered":"2023-12-20T04:47:13.305681+0000","last_clean":"2023-12-20T04:47:13.305681+0000","last_became_active":"2023-12-20T04:47:12.310827+0000","last_became_peered":"2023-12-20T04:47:12.310827+0000","last_unstale":"2023-12-20T04:47:13.305681+0000","last_undegraded":"2023-12-20T04:47:13.305681+0000","last_fullsized":"2023-12-20T04:47:13.305681+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:55:55.758924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307884+0000","last_change":"2023-12-20T04:47:12.307249+0000","last_active":"2023-12-20T04:47:13.307884+0000","last_peered":"2023-12-20T04:47:13.307884+0000","last_clean":"2023-12-20T04:47:13.307884+0000","last_became_active":"2023-12-20T04:47:12.307039+0000","last_became_peered":"2023-12-20T04:47:12.307039+0000","last_unstale":"2023-12-20T04:47:13.307884+0000","last_undegraded":"2023-12-20T04:47:13.307884+0000","last_fullsized":"2023-12-20T04:47:13.307884+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:31:06.096865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307769+0000","last_change":"2023-12-20T04:47:12.307238+0000","last_active":"2023-12-20T04:47:13.307769+0000","last_peered":"2023-12-20T04:47:13.307769+0000","last_clean":"2023-12-20T04:47:13.307769+0000","last_became_active":"2023-12-20T04:47:12.307015+0000","last_became_peered":"2023-12-20T04:47:12.307015+0000","last_unstale":"2023-12-20T04:47:13.307769+0000","last_undegraded":"2023-12-20T04:47:13.307769+0000","last_fullsized":"2023-12-20T04:47:13.307769+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:15:37.855644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.306004+0000","last_change":"2023-12-20T04:47:12.315175+0000","last_active":"2023-12-20T04:47:13.306004+0000","last_peered":"2023-12-20T04:47:13.306004+0000","last_clean":"2023-12-20T04:47:13.306004+0000","last_became_active":"2023-12-20T04:47:12.314862+0000","last_became_peered":"2023-12-20T04:47:12.314862+0000","last_unstale":"2023-12-20T04:47:13.306004+0000","last_undegraded":"2023-12-20T04:47:13.306004+0000","last_fullsized":"2023-12-20T04:47:13.306004+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:34:17.125409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718341+0000","last_change":"2023-12-20T04:47:12.324138+0000","last_active":"2023-12-20T04:47:13.718341+0000","last_peered":"2023-12-20T04:47:13.718341+0000","last_clean":"2023-12-20T04:47:13.718341+0000","last_became_active":"2023-12-20T04:47:12.323252+0000","last_became_peered":"2023-12-20T04:47:12.323252+0000","last_unstale":"2023-12-20T04:47:13.718341+0000","last_undegraded":"2023-12-20T04:47:13.718341+0000","last_fullsized":"2023-12-20T04:47:13.718341+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:16:01.372088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307711+0000","last_change":"2023-12-20T04:47:12.308577+0000","last_active":"2023-12-20T04:47:13.307711+0000","last_peered":"2023-12-20T04:47:13.307711+0000","last_clean":"2023-12-20T04:47:13.307711+0000","last_became_active":"2023-12-20T04:47:12.308326+0000","last_became_peered":"2023-12-20T04:47:12.308326+0000","last_unstale":"2023-12-20T04:47:13.307711+0000","last_undegraded":"2023-12-20T04:47:13.307711+0000","last_fullsized":"2023-12-20T04:47:13.307711+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:32:45.625444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.306039+0000","last_change":"2023-12-20T04:47:12.319804+0000","last_active":"2023-12-20T04:47:13.306039+0000","last_peered":"2023-12-20T04:47:13.306039+0000","last_clean":"2023-12-20T04:47:13.306039+0000","last_became_active":"2023-12-20T04:47:12.319587+0000","last_became_peered":"2023-12-20T04:47:12.319587+0000","last_unstale":"2023-12-20T04:47:13.306039+0000","last_undegraded":"2023-12-20T04:47:13.306039+0000","last_fullsized":"2023-12-20T04:47:13.306039+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:59:56.490637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305725+0000","last_change":"2023-12-20T04:47:12.314195+0000","last_active":"2023-12-20T04:47:13.305725+0000","last_peered":"2023-12-20T04:47:13.305725+0000","last_clean":"2023-12-20T04:47:13.305725+0000","last_became_active":"2023-12-20T04:47:12.312322+0000","last_became_peered":"2023-12-20T04:47:12.312322+0000","last_unstale":"2023-12-20T04:47:13.305725+0000","last_undegraded":"2023-12-20T04:47:13.305725+0000","last_fullsized":"2023-12-20T04:47:13.305725+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:31:44.080120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308580+0000","last_change":"2023-12-20T04:47:12.314548+0000","last_active":"2023-12-20T04:47:13.308580+0000","last_peered":"2023-12-20T04:47:13.308580+0000","last_clean":"2023-12-20T04:47:13.308580+0000","last_became_active":"2023-12-20T04:47:12.314291+0000","last_became_peered":"2023-12-20T04:47:12.314291+0000","last_unstale":"2023-12-20T04:47:13.308580+0000","last_undegraded":"2023-12-20T04:47:13.308580+0000","last_fullsized":"2023-12-20T04:47:13.308580+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:55:55.758924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718456+0000","last_change":"2023-12-20T04:47:12.324273+0000","last_active":"2023-12-20T04:47:13.718456+0000","last_peered":"2023-12-20T04:47:13.718456+0000","last_clean":"2023-12-20T04:47:13.718456+0000","last_became_active":"2023-12-20T04:47:12.323761+0000","last_became_peered":"2023-12-20T04:47:12.323761+0000","last_unstale":"2023-12-20T04:47:13.718456+0000","last_undegraded":"2023-12-20T04:47:13.718456+0000","last_fullsized":"2023-12-20T04:47:13.718456+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:23:39.357137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305732+0000","last_change":"2023-12-20T04:47:12.315114+0000","last_active":"2023-12-20T04:47:13.305732+0000","last_peered":"2023-12-20T04:47:13.305732+0000","last_clean":"2023-12-20T04:47:13.305732+0000","last_became_active":"2023-12-20T04:47:12.314806+0000","last_became_peered":"2023-12-20T04:47:12.314806+0000","last_unstale":"2023-12-20T04:47:13.305732+0000","last_undegraded":"2023-12-20T04:47:13.305732+0000","last_fullsized":"2023-12-20T04:47:13.305732+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:05:39.050971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.306133+0000","last_change":"2023-12-20T04:47:12.314930+0000","last_active":"2023-12-20T04:47:13.306133+0000","last_peered":"2023-12-20T04:47:13.306133+0000","last_clean":"2023-12-20T04:47:13.306133+0000","last_became_active":"2023-12-20T04:47:12.314581+0000","last_became_peered":"2023-12-20T04:47:12.314581+0000","last_unstale":"2023-12-20T04:47:13.306133+0000","last_undegraded":"2023-12-20T04:47:13.306133+0000","last_fullsized":"2023-12-20T04:47:13.306133+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:19:13.584643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308622+0000","last_change":"2023-12-20T04:47:12.313523+0000","last_active":"2023-12-20T04:47:13.308622+0000","last_peered":"2023-12-20T04:47:13.308622+0000","last_clean":"2023-12-20T04:47:13.308622+0000","last_became_active":"2023-12-20T04:47:12.312750+0000","last_became_peered":"2023-12-20T04:47:12.312750+0000","last_unstale":"2023-12-20T04:47:13.308622+0000","last_undegraded":"2023-12-20T04:47:13.308622+0000","last_fullsized":"2023-12-20T04:47:13.308622+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:19:54.145383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718401+0000","last_change":"2023-12-20T04:47:12.321614+0000","last_active":"2023-12-20T04:47:13.718401+0000","last_peered":"2023-12-20T04:47:13.718401+0000","last_clean":"2023-12-20T04:47:13.718401+0000","last_became_active":"2023-12-20T04:47:12.321375+0000","last_became_peered":"2023-12-20T04:47:12.321375+0000","last_unstale":"2023-12-20T04:47:13.718401+0000","last_undegraded":"2023-12-20T04:47:13.718401+0000","last_fullsized":"2023-12-20T04:47:13.718401+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:28:32.139630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307968+0000","last_change":"2023-12-20T04:47:12.321378+0000","last_active":"2023-12-20T04:47:13.307968+0000","last_peered":"2023-12-20T04:47:13.307968+0000","last_clean":"2023-12-20T04:47:13.307968+0000","last_became_active":"2023-12-20T04:47:12.320972+0000","last_became_peered":"2023-12-20T04:47:12.320972+0000","last_unstale":"2023-12-20T04:47:13.307968+0000","last_undegraded":"2023-12-20T04:47:13.307968+0000","last_fullsized":"2023-12-20T04:47:13.307968+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:43:50.090163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"100'4","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.325687+0000","last_change":"2023-12-20T04:47:11.961534+0000","last_active":"2023-12-20T04:47:12.325687+0000","last_peered":"2023-12-20T04:47:12.325687+0000","last_clean":"2023-12-20T04:47:12.325687+0000","last_became_active":"2023-12-20T04:47:11.956878+0000","last_became_peered":"2023-12-20T04:47:11.956878+0000","last_unstale":"2023-12-20T04:47:12.325687+0000","last_undegraded":"2023-12-20T04:47:12.325687+0000","last_fullsized":"2023-12-20T04:47:12.325687+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:59:55.486432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718554+0000","last_change":"2023-12-20T04:47:12.323961+0000","last_active":"2023-12-20T04:47:13.718554+0000","last_peered":"2023-12-20T04:47:13.718554+0000","last_clean":"2023-12-20T04:47:13.718554+0000","last_became_active":"2023-12-20T04:47:12.322933+0000","last_became_peered":"2023-12-20T04:47:12.322933+0000","last_unstale":"2023-12-20T04:47:13.718554+0000","last_undegraded":"2023-12-20T04:47:13.718554+0000","last_fullsized":"2023-12-20T04:47:13.718554+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:41:05.944614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"100'1","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.321200+0000","last_change":"2023-12-20T04:47:11.961534+0000","last_active":"2023-12-20T04:47:12.321200+0000","last_peered":"2023-12-20T04:47:12.321200+0000","last_clean":"2023-12-20T04:47:12.321200+0000","last_became_active":"2023-12-20T04:47:11.961319+0000","last_became_peered":"2023-12-20T04:47:11.961319+0000","last_unstale":"2023-12-20T04:47:12.321200+0000","last_undegraded":"2023-12-20T04:47:12.321200+0000","last_fullsized":"2023-12-20T04:47:12.321200+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:24.195503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718448+0000","last_change":"2023-12-20T04:47:12.323160+0000","last_active":"2023-12-20T04:47:13.718448+0000","last_peered":"2023-12-20T04:47:13.718448+0000","last_clean":"2023-12-20T04:47:13.718448+0000","last_became_active":"2023-12-20T04:47:12.322634+0000","last_became_peered":"2023-12-20T04:47:12.322634+0000","last_unstale":"2023-12-20T04:47:13.718448+0000","last_undegraded":"2023-12-20T04:47:13.718448+0000","last_fullsized":"2023-12-20T04:47:13.718448+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:30:15.686258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"100'2","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.319752+0000","last_change":"2023-12-20T04:47:11.957843+0000","last_active":"2023-12-20T04:47:12.319752+0000","last_peered":"2023-12-20T04:47:12.319752+0000","last_clean":"2023-12-20T04:47:12.319752+0000","last_became_active":"2023-12-20T04:47:11.957543+0000","last_became_peered":"2023-12-20T04:47:11.957543+0000","last_unstale":"2023-12-20T04:47:12.319752+0000","last_undegraded":"2023-12-20T04:47:12.319752+0000","last_fullsized":"2023-12-20T04:47:12.319752+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:19:12.580438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305915+0000","last_change":"2023-12-20T04:47:12.313018+0000","last_active":"2023-12-20T04:47:13.305915+0000","last_peered":"2023-12-20T04:47:13.305915+0000","last_clean":"2023-12-20T04:47:13.305915+0000","last_became_active":"2023-12-20T04:47:12.312767+0000","last_became_peered":"2023-12-20T04:47:12.312767+0000","last_unstale":"2023-12-20T04:47:13.305915+0000","last_undegraded":"2023-12-20T04:47:13.305915+0000","last_fullsized":"2023-12-20T04:47:13.305915+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:48:26.370370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"100'2","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.319649+0000","last_change":"2023-12-20T04:47:11.956264+0000","last_active":"2023-12-20T04:47:12.319649+0000","last_peered":"2023-12-20T04:47:12.319649+0000","last_clean":"2023-12-20T04:47:12.319649+0000","last_became_active":"2023-12-20T04:47:11.955989+0000","last_became_peered":"2023-12-20T04:47:11.955989+0000","last_unstale":"2023-12-20T04:47:12.319649+0000","last_undegraded":"2023-12-20T04:47:12.319649+0000","last_fullsized":"2023-12-20T04:47:12.319649+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:30:07.400173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305653+0000","last_change":"2023-12-20T04:47:12.313401+0000","last_active":"2023-12-20T04:47:13.305653+0000","last_peered":"2023-12-20T04:47:13.305653+0000","last_clean":"2023-12-20T04:47:13.305653+0000","last_became_active":"2023-12-20T04:47:12.312651+0000","last_became_peered":"2023-12-20T04:47:12.312651+0000","last_unstale":"2023-12-20T04:47:13.305653+0000","last_undegraded":"2023-12-20T04:47:13.305653+0000","last_fullsized":"2023-12-20T04:47:13.305653+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:33:56.140203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"100'1","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.321765+0000","last_change":"2023-12-20T04:47:11.959564+0000","last_active":"2023-12-20T04:47:12.321765+0000","last_peered":"2023-12-20T04:47:12.321765+0000","last_clean":"2023-12-20T04:47:12.321765+0000","last_became_active":"2023-12-20T04:47:11.957369+0000","last_became_peered":"2023-12-20T04:47:11.957369+0000","last_unstale":"2023-12-20T04:47:12.321765+0000","last_undegraded":"2023-12-20T04:47:12.321765+0000","last_fullsized":"2023-12-20T04:47:12.321765+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:34:39.263240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308248+0000","last_change":"2023-12-20T04:47:12.307951+0000","last_active":"2023-12-20T04:47:13.308248+0000","last_peered":"2023-12-20T04:47:13.308248+0000","last_clean":"2023-12-20T04:47:13.308248+0000","last_became_active":"2023-12-20T04:47:12.307380+0000","last_became_peered":"2023-12-20T04:47:12.307380+0000","last_unstale":"2023-12-20T04:47:13.308248+0000","last_undegraded":"2023-12-20T04:47:13.308248+0000","last_fullsized":"2023-12-20T04:47:13.308248+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:49.777395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"100'1","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.320244+0000","last_change":"2023-12-20T04:47:11.961098+0000","last_active":"2023-12-20T04:47:12.320244+0000","last_peered":"2023-12-20T04:47:12.320244+0000","last_clean":"2023-12-20T04:47:12.320244+0000","last_became_active":"2023-12-20T04:47:11.960844+0000","last_became_peered":"2023-12-20T04:47:11.960844+0000","last_unstale":"2023-12-20T04:47:12.320244+0000","last_undegraded":"2023-12-20T04:47:12.320244+0000","last_fullsized":"2023-12-20T04:47:12.320244+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:07:16.555642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305782+0000","last_change":"2023-12-20T04:47:12.318872+0000","last_active":"2023-12-20T04:47:13.305782+0000","last_peered":"2023-12-20T04:47:13.305782+0000","last_clean":"2023-12-20T04:47:13.305782+0000","last_became_active":"2023-12-20T04:47:12.318327+0000","last_became_peered":"2023-12-20T04:47:12.318327+0000","last_unstale":"2023-12-20T04:47:13.305782+0000","last_undegraded":"2023-12-20T04:47:13.305782+0000","last_fullsized":"2023-12-20T04:47:13.305782+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:30:15.686258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.305083+0000","last_change":"2023-12-20T04:47:11.951890+0000","last_active":"2023-12-20T04:47:12.305083+0000","last_peered":"2023-12-20T04:47:12.305083+0000","last_clean":"2023-12-20T04:47:12.305083+0000","last_became_active":"2023-12-20T04:47:11.951676+0000","last_became_peered":"2023-12-20T04:47:11.951676+0000","last_unstale":"2023-12-20T04:47:12.305083+0000","last_undegraded":"2023-12-20T04:47:12.305083+0000","last_fullsized":"2023-12-20T04:47:12.305083+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:05:38.046766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.717365+0000","last_change":"2023-12-20T04:47:12.316244+0000","last_active":"2023-12-20T04:47:13.717365+0000","last_peered":"2023-12-20T04:47:13.717365+0000","last_clean":"2023-12-20T04:47:13.717365+0000","last_became_active":"2023-12-20T04:47:12.316037+0000","last_became_peered":"2023-12-20T04:47:12.316037+0000","last_unstale":"2023-12-20T04:47:13.717365+0000","last_undegraded":"2023-12-20T04:47:13.717365+0000","last_fullsized":"2023-12-20T04:47:13.717365+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:55:55.758924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.310108+0000","last_change":"2023-12-20T04:47:11.961498+0000","last_active":"2023-12-20T04:47:12.310108+0000","last_peered":"2023-12-20T04:47:12.310108+0000","last_clean":"2023-12-20T04:47:12.310108+0000","last_became_active":"2023-12-20T04:47:11.961274+0000","last_became_peered":"2023-12-20T04:47:11.961274+0000","last_unstale":"2023-12-20T04:47:12.310108+0000","last_undegraded":"2023-12-20T04:47:12.310108+0000","last_fullsized":"2023-12-20T04:47:12.310108+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:27:15.310466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.717545+0000","last_change":"2023-12-20T04:47:12.315110+0000","last_active":"2023-12-20T04:47:13.717545+0000","last_peered":"2023-12-20T04:47:13.717545+0000","last_clean":"2023-12-20T04:47:13.717545+0000","last_became_active":"2023-12-20T04:47:12.314899+0000","last_became_peered":"2023-12-20T04:47:12.314899+0000","last_unstale":"2023-12-20T04:47:13.717545+0000","last_undegraded":"2023-12-20T04:47:13.717545+0000","last_fullsized":"2023-12-20T04:47:13.717545+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:42:44.567217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.312205+0000","last_change":"2023-12-20T04:47:11.954119+0000","last_active":"2023-12-20T04:47:12.312205+0000","last_peered":"2023-12-20T04:47:12.312205+0000","last_clean":"2023-12-20T04:47:12.312205+0000","last_became_active":"2023-12-20T04:47:11.953865+0000","last_became_peered":"2023-12-20T04:47:11.953865+0000","last_unstale":"2023-12-20T04:47:12.312205+0000","last_undegraded":"2023-12-20T04:47:12.312205+0000","last_fullsized":"2023-12-20T04:47:12.312205+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:34:39.263240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718032+0000","last_change":"2023-12-20T04:47:12.318384+0000","last_active":"2023-12-20T04:47:13.718032+0000","last_peered":"2023-12-20T04:47:13.718032+0000","last_clean":"2023-12-20T04:47:13.718032+0000","last_became_active":"2023-12-20T04:47:12.316537+0000","last_became_peered":"2023-12-20T04:47:12.316537+0000","last_unstale":"2023-12-20T04:47:13.718032+0000","last_undegraded":"2023-12-20T04:47:13.718032+0000","last_fullsized":"2023-12-20T04:47:13.718032+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:18:34.417627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.311506+0000","last_change":"2023-12-20T04:47:11.960495+0000","last_active":"2023-12-20T04:47:12.311506+0000","last_peered":"2023-12-20T04:47:12.311506+0000","last_clean":"2023-12-20T04:47:12.311506+0000","last_became_active":"2023-12-20T04:47:11.960178+0000","last_became_peered":"2023-12-20T04:47:11.960178+0000","last_unstale":"2023-12-20T04:47:12.311506+0000","last_undegraded":"2023-12-20T04:47:12.311506+0000","last_fullsized":"2023-12-20T04:47:12.311506+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:18:33.413422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305765+0000","last_change":"2023-12-20T04:47:12.319512+0000","last_active":"2023-12-20T04:47:13.305765+0000","last_peered":"2023-12-20T04:47:13.305765+0000","last_clean":"2023-12-20T04:47:13.305765+0000","last_became_active":"2023-12-20T04:47:12.319295+0000","last_became_peered":"2023-12-20T04:47:12.319295+0000","last_unstale":"2023-12-20T04:47:13.305765+0000","last_undegraded":"2023-12-20T04:47:13.305765+0000","last_fullsized":"2023-12-20T04:47:13.305765+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:55:35.518784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"100'3","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.325509+0000","last_change":"2023-12-20T04:47:11.962148+0000","last_active":"2023-12-20T04:47:12.325509+0000","last_peered":"2023-12-20T04:47:12.325509+0000","last_clean":"2023-12-20T04:47:12.325509+0000","last_became_active":"2023-12-20T04:47:11.960199+0000","last_became_peered":"2023-12-20T04:47:11.960199+0000","last_unstale":"2023-12-20T04:47:12.325509+0000","last_undegraded":"2023-12-20T04:47:12.325509+0000","last_fullsized":"2023-12-20T04:47:12.325509+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:24.195503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308201+0000","last_change":"2023-12-20T04:47:12.309938+0000","last_active":"2023-12-20T04:47:13.308201+0000","last_peered":"2023-12-20T04:47:13.308201+0000","last_clean":"2023-12-20T04:47:13.308201+0000","last_became_active":"2023-12-20T04:47:12.309700+0000","last_became_peered":"2023-12-20T04:47:12.309700+0000","last_unstale":"2023-12-20T04:47:13.308201+0000","last_undegraded":"2023-12-20T04:47:13.308201+0000","last_fullsized":"2023-12-20T04:47:13.308201+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:27:49.207248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"100'6","reported_seq":17,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.324083+0000","last_change":"2023-12-20T04:47:11.955106+0000","last_active":"2023-12-20T04:47:12.324083+0000","last_peered":"2023-12-20T04:47:12.324083+0000","last_clean":"2023-12-20T04:47:12.324083+0000","last_became_active":"2023-12-20T04:47:11.954868+0000","last_became_peered":"2023-12-20T04:47:11.954868+0000","last_unstale":"2023-12-20T04:47:12.324083+0000","last_undegraded":"2023-12-20T04:47:12.324083+0000","last_fullsized":"2023-12-20T04:47:12.324083+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:15:43.167465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.306201+0000","last_change":"2023-12-20T04:47:12.308553+0000","last_active":"2023-12-20T04:47:13.306201+0000","last_peered":"2023-12-20T04:47:13.306201+0000","last_clean":"2023-12-20T04:47:13.306201+0000","last_became_active":"2023-12-20T04:47:12.307990+0000","last_became_peered":"2023-12-20T04:47:12.307990+0000","last_unstale":"2023-12-20T04:47:13.306201+0000","last_undegraded":"2023-12-20T04:47:13.306201+0000","last_fullsized":"2023-12-20T04:47:13.306201+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:48:26.370370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"100'2","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.321892+0000","last_change":"2023-12-20T04:47:11.958402+0000","last_active":"2023-12-20T04:47:12.321892+0000","last_peered":"2023-12-20T04:47:12.321892+0000","last_clean":"2023-12-20T04:47:12.321892+0000","last_became_active":"2023-12-20T04:47:11.958172+0000","last_became_peered":"2023-12-20T04:47:11.958172+0000","last_unstale":"2023-12-20T04:47:12.321892+0000","last_undegraded":"2023-12-20T04:47:12.321892+0000","last_fullsized":"2023-12-20T04:47:12.321892+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:37.421468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305857+0000","last_change":"2023-12-20T04:47:12.319208+0000","last_active":"2023-12-20T04:47:13.305857+0000","last_peered":"2023-12-20T04:47:13.305857+0000","last_clean":"2023-12-20T04:47:13.305857+0000","last_became_active":"2023-12-20T04:47:12.318643+0000","last_became_peered":"2023-12-20T04:47:12.318643+0000","last_unstale":"2023-12-20T04:47:13.305857+0000","last_undegraded":"2023-12-20T04:47:13.305857+0000","last_fullsized":"2023-12-20T04:47:13.305857+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:55:35.518784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.308659+0000","last_change":"2023-12-20T04:47:11.956731+0000","last_active":"2023-12-20T04:47:12.308659+0000","last_peered":"2023-12-20T04:47:12.308659+0000","last_clean":"2023-12-20T04:47:12.308659+0000","last_became_active":"2023-12-20T04:47:11.956045+0000","last_became_peered":"2023-12-20T04:47:11.956045+0000","last_unstale":"2023-12-20T04:47:12.308659+0000","last_undegraded":"2023-12-20T04:47:12.308659+0000","last_fullsized":"2023-12-20T04:47:12.308659+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:29:56.453248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305570+0000","last_change":"2023-12-20T04:47:12.313238+0000","last_active":"2023-12-20T04:47:13.305570+0000","last_peered":"2023-12-20T04:47:13.305570+0000","last_clean":"2023-12-20T04:47:13.305570+0000","last_became_active":"2023-12-20T04:47:12.312335+0000","last_became_peered":"2023-12-20T04:47:12.312335+0000","last_unstale":"2023-12-20T04:47:13.305570+0000","last_undegraded":"2023-12-20T04:47:13.305570+0000","last_fullsized":"2023-12-20T04:47:13.305570+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:43:50.090163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.313475+0000","last_change":"2023-12-20T04:47:11.962601+0000","last_active":"2023-12-20T04:47:12.313475+0000","last_peered":"2023-12-20T04:47:12.313475+0000","last_clean":"2023-12-20T04:47:12.313475+0000","last_became_active":"2023-12-20T04:47:11.962328+0000","last_became_peered":"2023-12-20T04:47:11.962328+0000","last_unstale":"2023-12-20T04:47:12.313475+0000","last_undegraded":"2023-12-20T04:47:12.313475+0000","last_fullsized":"2023-12-20T04:47:12.313475+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:37.421468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.306049+0000","last_change":"2023-12-20T04:47:12.321621+0000","last_active":"2023-12-20T04:47:13.306049+0000","last_peered":"2023-12-20T04:47:13.306049+0000","last_clean":"2023-12-20T04:47:13.306049+0000","last_became_active":"2023-12-20T04:47:12.320856+0000","last_became_peered":"2023-12-20T04:47:12.320856+0000","last_unstale":"2023-12-20T04:47:13.306049+0000","last_undegraded":"2023-12-20T04:47:13.306049+0000","last_fullsized":"2023-12-20T04:47:13.306049+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:13:50.011086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"100'8","reported_seq":19,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.321861+0000","last_change":"2023-12-20T04:47:11.958895+0000","last_active":"2023-12-20T04:47:12.321861+0000","last_peered":"2023-12-20T04:47:12.321861+0000","last_clean":"2023-12-20T04:47:12.321861+0000","last_became_active":"2023-12-20T04:47:11.958668+0000","last_became_peered":"2023-12-20T04:47:11.958668+0000","last_unstale":"2023-12-20T04:47:12.321861+0000","last_undegraded":"2023-12-20T04:47:12.321861+0000","last_fullsized":"2023-12-20T04:47:12.321861+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:28:31.135425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305963+0000","last_change":"2023-12-20T04:47:12.316463+0000","last_active":"2023-12-20T04:47:13.305963+0000","last_peered":"2023-12-20T04:47:13.305963+0000","last_clean":"2023-12-20T04:47:13.305963+0000","last_became_active":"2023-12-20T04:47:12.316205+0000","last_became_peered":"2023-12-20T04:47:12.316205+0000","last_unstale":"2023-12-20T04:47:13.305963+0000","last_undegraded":"2023-12-20T04:47:13.305963+0000","last_fullsized":"2023-12-20T04:47:13.305963+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:21:42.966504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"100'1","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.321009+0000","last_change":"2023-12-20T04:47:11.959082+0000","last_active":"2023-12-20T04:47:12.321009+0000","last_peered":"2023-12-20T04:47:12.321009+0000","last_clean":"2023-12-20T04:47:12.321009+0000","last_became_active":"2023-12-20T04:47:11.958261+0000","last_became_peered":"2023-12-20T04:47:11.958261+0000","last_unstale":"2023-12-20T04:47:12.321009+0000","last_undegraded":"2023-12-20T04:47:12.321009+0000","last_fullsized":"2023-12-20T04:47:12.321009+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:13:49.006881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718006+0000","last_change":"2023-12-20T04:47:12.320850+0000","last_active":"2023-12-20T04:47:13.718006+0000","last_peered":"2023-12-20T04:47:13.718006+0000","last_clean":"2023-12-20T04:47:13.718006+0000","last_became_active":"2023-12-20T04:47:12.320431+0000","last_became_peered":"2023-12-20T04:47:12.320431+0000","last_unstale":"2023-12-20T04:47:13.718006+0000","last_undegraded":"2023-12-20T04:47:13.718006+0000","last_fullsized":"2023-12-20T04:47:13.718006+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:42:44.567217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"100'2","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.321025+0000","last_change":"2023-12-20T04:47:11.953852+0000","last_active":"2023-12-20T04:47:12.321025+0000","last_peered":"2023-12-20T04:47:12.321025+0000","last_clean":"2023-12-20T04:47:12.321025+0000","last_became_active":"2023-12-20T04:47:11.953639+0000","last_became_peered":"2023-12-20T04:47:11.953639+0000","last_unstale":"2023-12-20T04:47:12.321025+0000","last_undegraded":"2023-12-20T04:47:12.321025+0000","last_fullsized":"2023-12-20T04:47:12.321025+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:43:49.085959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308464+0000","last_change":"2023-12-20T04:47:12.313693+0000","last_active":"2023-12-20T04:47:13.308464+0000","last_peered":"2023-12-20T04:47:13.308464+0000","last_clean":"2023-12-20T04:47:13.308464+0000","last_became_active":"2023-12-20T04:47:12.313254+0000","last_became_peered":"2023-12-20T04:47:12.313254+0000","last_unstale":"2023-12-20T04:47:13.308464+0000","last_undegraded":"2023-12-20T04:47:13.308464+0000","last_fullsized":"2023-12-20T04:47:13.308464+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:05:39.050971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.304532+0000","last_change":"2023-12-20T04:47:11.951913+0000","last_active":"2023-12-20T04:47:12.304532+0000","last_peered":"2023-12-20T04:47:12.304532+0000","last_clean":"2023-12-20T04:47:12.304532+0000","last_became_active":"2023-12-20T04:47:11.951690+0000","last_became_peered":"2023-12-20T04:47:11.951690+0000","last_unstale":"2023-12-20T04:47:12.304532+0000","last_undegraded":"2023-12-20T04:47:12.304532+0000","last_fullsized":"2023-12-20T04:47:12.304532+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:33:55.135998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307780+0000","last_change":"2023-12-20T04:47:12.317211+0000","last_active":"2023-12-20T04:47:13.307780+0000","last_peered":"2023-12-20T04:47:13.307780+0000","last_clean":"2023-12-20T04:47:13.307780+0000","last_became_active":"2023-12-20T04:47:12.315664+0000","last_became_peered":"2023-12-20T04:47:12.315664+0000","last_unstale":"2023-12-20T04:47:13.307780+0000","last_undegraded":"2023-12-20T04:47:13.307780+0000","last_fullsized":"2023-12-20T04:47:13.307780+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:04:08.897319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"100'2","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.320403+0000","last_change":"2023-12-20T04:47:11.957846+0000","last_active":"2023-12-20T04:47:12.320403+0000","last_peered":"2023-12-20T04:47:12.320403+0000","last_clean":"2023-12-20T04:47:12.320403+0000","last_became_active":"2023-12-20T04:47:11.957628+0000","last_became_peered":"2023-12-20T04:47:11.957628+0000","last_unstale":"2023-12-20T04:47:12.320403+0000","last_undegraded":"2023-12-20T04:47:12.320403+0000","last_fullsized":"2023-12-20T04:47:12.320403+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:31:43.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718175+0000","last_change":"2023-12-20T04:47:12.313275+0000","last_active":"2023-12-20T04:47:13.718175+0000","last_peered":"2023-12-20T04:47:13.718175+0000","last_clean":"2023-12-20T04:47:13.718175+0000","last_became_active":"2023-12-20T04:47:12.313026+0000","last_became_peered":"2023-12-20T04:47:12.313026+0000","last_unstale":"2023-12-20T04:47:13.718175+0000","last_undegraded":"2023-12-20T04:47:13.718175+0000","last_fullsized":"2023-12-20T04:47:13.718175+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:13:50.011086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.307086+0000","last_change":"2023-12-20T04:47:11.959587+0000","last_active":"2023-12-20T04:47:12.307086+0000","last_peered":"2023-12-20T04:47:12.307086+0000","last_clean":"2023-12-20T04:47:12.307086+0000","last_became_active":"2023-12-20T04:47:11.958769+0000","last_became_peered":"2023-12-20T04:47:11.958769+0000","last_unstale":"2023-12-20T04:47:12.307086+0000","last_undegraded":"2023-12-20T04:47:12.307086+0000","last_fullsized":"2023-12-20T04:47:12.307086+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:14:49.931435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307829+0000","last_change":"2023-12-20T04:47:12.313934+0000","last_active":"2023-12-20T04:47:13.307829+0000","last_peered":"2023-12-20T04:47:13.307829+0000","last_clean":"2023-12-20T04:47:13.307829+0000","last_became_active":"2023-12-20T04:47:12.313734+0000","last_became_peered":"2023-12-20T04:47:12.313734+0000","last_unstale":"2023-12-20T04:47:13.307829+0000","last_undegraded":"2023-12-20T04:47:13.307829+0000","last_fullsized":"2023-12-20T04:47:13.307829+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:11:19.295959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.306130+0000","last_change":"2023-12-20T04:47:11.959267+0000","last_active":"2023-12-20T04:47:12.306130+0000","last_peered":"2023-12-20T04:47:12.306130+0000","last_clean":"2023-12-20T04:47:12.306130+0000","last_became_active":"2023-12-20T04:47:11.958955+0000","last_became_peered":"2023-12-20T04:47:11.958955+0000","last_unstale":"2023-12-20T04:47:12.306130+0000","last_undegraded":"2023-12-20T04:47:12.306130+0000","last_fullsized":"2023-12-20T04:47:12.306130+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:43:37.374450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.717957+0000","last_change":"2023-12-20T04:47:12.318589+0000","last_active":"2023-12-20T04:47:13.717957+0000","last_peered":"2023-12-20T04:47:13.717957+0000","last_clean":"2023-12-20T04:47:13.717957+0000","last_became_active":"2023-12-20T04:47:12.318184+0000","last_became_peered":"2023-12-20T04:47:12.318184+0000","last_unstale":"2023-12-20T04:47:13.717957+0000","last_undegraded":"2023-12-20T04:47:13.717957+0000","last_fullsized":"2023-12-20T04:47:13.717957+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:59:56.490637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.308739+0000","last_change":"2023-12-20T04:47:11.956539+0000","last_active":"2023-12-20T04:47:12.308739+0000","last_peered":"2023-12-20T04:47:12.308739+0000","last_clean":"2023-12-20T04:47:12.308739+0000","last_became_active":"2023-12-20T04:47:11.955735+0000","last_became_peered":"2023-12-20T04:47:11.955735+0000","last_unstale":"2023-12-20T04:47:12.308739+0000","last_undegraded":"2023-12-20T04:47:12.308739+0000","last_fullsized":"2023-12-20T04:47:12.308739+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:48.773190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308319+0000","last_change":"2023-12-20T04:47:12.314483+0000","last_active":"2023-12-20T04:47:13.308319+0000","last_peered":"2023-12-20T04:47:13.308319+0000","last_clean":"2023-12-20T04:47:13.308319+0000","last_became_active":"2023-12-20T04:47:12.314234+0000","last_became_peered":"2023-12-20T04:47:12.314234+0000","last_unstale":"2023-12-20T04:47:13.308319+0000","last_undegraded":"2023-12-20T04:47:13.308319+0000","last_fullsized":"2023-12-20T04:47:13.308319+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:48:26.370370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"100'2","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.323305+0000","last_change":"2023-12-20T04:47:11.960736+0000","last_active":"2023-12-20T04:47:12.323305+0000","last_peered":"2023-12-20T04:47:12.323305+0000","last_clean":"2023-12-20T04:47:12.323305+0000","last_became_active":"2023-12-20T04:47:11.960370+0000","last_became_peered":"2023-12-20T04:47:11.960370+0000","last_unstale":"2023-12-20T04:47:12.323305+0000","last_undegraded":"2023-12-20T04:47:12.323305+0000","last_fullsized":"2023-12-20T04:47:12.323305+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:57:12.056094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305762+0000","last_change":"2023-12-20T04:47:12.316747+0000","last_active":"2023-12-20T04:47:13.305762+0000","last_peered":"2023-12-20T04:47:13.305762+0000","last_clean":"2023-12-20T04:47:13.305762+0000","last_became_active":"2023-12-20T04:47:12.316492+0000","last_became_peered":"2023-12-20T04:47:12.316492+0000","last_unstale":"2023-12-20T04:47:13.305762+0000","last_undegraded":"2023-12-20T04:47:13.305762+0000","last_fullsized":"2023-12-20T04:47:13.305762+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:29:57.457453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.308790+0000","last_change":"2023-12-20T04:47:11.959243+0000","last_active":"2023-12-20T04:47:12.308790+0000","last_peered":"2023-12-20T04:47:12.308790+0000","last_clean":"2023-12-20T04:47:12.308790+0000","last_became_active":"2023-12-20T04:47:11.959011+0000","last_became_peered":"2023-12-20T04:47:11.959011+0000","last_unstale":"2023-12-20T04:47:12.308790+0000","last_undegraded":"2023-12-20T04:47:12.308790+0000","last_fullsized":"2023-12-20T04:47:12.308790+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:11:02.381162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718403+0000","last_change":"2023-12-20T04:47:12.312961+0000","last_active":"2023-12-20T04:47:13.718403+0000","last_peered":"2023-12-20T04:47:13.718403+0000","last_clean":"2023-12-20T04:47:13.718403+0000","last_became_active":"2023-12-20T04:47:12.312746+0000","last_became_peered":"2023-12-20T04:47:12.312746+0000","last_unstale":"2023-12-20T04:47:13.718403+0000","last_undegraded":"2023-12-20T04:47:13.718403+0000","last_fullsized":"2023-12-20T04:47:13.718403+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:19:54.145383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.315108+0000","last_change":"2023-12-20T04:47:11.958772+0000","last_active":"2023-12-20T04:47:12.315108+0000","last_peered":"2023-12-20T04:47:12.315108+0000","last_clean":"2023-12-20T04:47:12.315108+0000","last_became_active":"2023-12-20T04:47:11.957887+0000","last_became_peered":"2023-12-20T04:47:11.957887+0000","last_unstale":"2023-12-20T04:47:12.315108+0000","last_undegraded":"2023-12-20T04:47:12.315108+0000","last_fullsized":"2023-12-20T04:47:12.315108+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:17:19.170567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308051+0000","last_change":"2023-12-20T04:47:12.307062+0000","last_active":"2023-12-20T04:47:13.308051+0000","last_peered":"2023-12-20T04:47:13.308051+0000","last_clean":"2023-12-20T04:47:13.308051+0000","last_became_active":"2023-12-20T04:47:12.306812+0000","last_became_peered":"2023-12-20T04:47:12.306812+0000","last_unstale":"2023-12-20T04:47:13.308051+0000","last_undegraded":"2023-12-20T04:47:13.308051+0000","last_fullsized":"2023-12-20T04:47:13.308051+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:30:15.686258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.310741+0000","last_change":"2023-12-20T04:47:11.953965+0000","last_active":"2023-12-20T04:47:12.310741+0000","last_peered":"2023-12-20T04:47:12.310741+0000","last_clean":"2023-12-20T04:47:12.310741+0000","last_became_active":"2023-12-20T04:47:11.953721+0000","last_became_peered":"2023-12-20T04:47:11.953721+0000","last_unstale":"2023-12-20T04:47:12.310741+0000","last_undegraded":"2023-12-20T04:47:12.310741+0000","last_fullsized":"2023-12-20T04:47:12.310741+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:38:22.215544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.717892+0000","last_change":"2023-12-20T04:47:12.313935+0000","last_active":"2023-12-20T04:47:13.717892+0000","last_peered":"2023-12-20T04:47:13.717892+0000","last_clean":"2023-12-20T04:47:13.717892+0000","last_became_active":"2023-12-20T04:47:12.313711+0000","last_became_peered":"2023-12-20T04:47:12.313711+0000","last_unstale":"2023-12-20T04:47:13.717892+0000","last_undegraded":"2023-12-20T04:47:13.717892+0000","last_fullsized":"2023-12-20T04:47:13.717892+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:35:09.638327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.305174+0000","last_change":"2023-12-20T04:47:11.962166+0000","last_active":"2023-12-20T04:47:12.305174+0000","last_peered":"2023-12-20T04:47:12.305174+0000","last_clean":"2023-12-20T04:47:12.305174+0000","last_became_active":"2023-12-20T04:47:11.961376+0000","last_became_peered":"2023-12-20T04:47:11.961376+0000","last_unstale":"2023-12-20T04:47:12.305174+0000","last_undegraded":"2023-12-20T04:47:12.305174+0000","last_fullsized":"2023-12-20T04:47:12.305174+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:27:23.394159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.306288+0000","last_change":"2023-12-20T04:47:12.308676+0000","last_active":"2023-12-20T04:47:13.306288+0000","last_peered":"2023-12-20T04:47:13.306288+0000","last_clean":"2023-12-20T04:47:13.306288+0000","last_became_active":"2023-12-20T04:47:12.308319+0000","last_became_peered":"2023-12-20T04:47:12.308319+0000","last_unstale":"2023-12-20T04:47:13.306288+0000","last_undegraded":"2023-12-20T04:47:13.306288+0000","last_fullsized":"2023-12-20T04:47:13.306288+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:30:15.686258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.306930+0000","last_change":"2023-12-20T04:47:11.963831+0000","last_active":"2023-12-20T04:47:12.306930+0000","last_peered":"2023-12-20T04:47:12.306930+0000","last_clean":"2023-12-20T04:47:12.306930+0000","last_became_active":"2023-12-20T04:47:11.963459+0000","last_became_peered":"2023-12-20T04:47:11.963459+0000","last_unstale":"2023-12-20T04:47:12.306930+0000","last_undegraded":"2023-12-20T04:47:12.306930+0000","last_fullsized":"2023-12-20T04:47:12.306930+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:28:05.732418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305789+0000","last_change":"2023-12-20T04:47:12.315039+0000","last_active":"2023-12-20T04:47:13.305789+0000","last_peered":"2023-12-20T04:47:13.305789+0000","last_clean":"2023-12-20T04:47:13.305789+0000","last_became_active":"2023-12-20T04:47:12.314798+0000","last_became_peered":"2023-12-20T04:47:12.314798+0000","last_unstale":"2023-12-20T04:47:13.305789+0000","last_undegraded":"2023-12-20T04:47:13.305789+0000","last_fullsized":"2023-12-20T04:47:13.305789+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:27:49.207248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.315688+0000","last_change":"2023-12-20T04:47:11.961695+0000","last_active":"2023-12-20T04:47:12.315688+0000","last_peered":"2023-12-20T04:47:12.315688+0000","last_clean":"2023-12-20T04:47:12.315688+0000","last_became_active":"2023-12-20T04:47:11.959458+0000","last_became_peered":"2023-12-20T04:47:11.959458+0000","last_unstale":"2023-12-20T04:47:12.315688+0000","last_undegraded":"2023-12-20T04:47:12.315688+0000","last_fullsized":"2023-12-20T04:47:12.315688+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:34:16.121204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718708+0000","last_change":"2023-12-20T04:47:12.316873+0000","last_active":"2023-12-20T04:47:13.718708+0000","last_peered":"2023-12-20T04:47:13.718708+0000","last_clean":"2023-12-20T04:47:13.718708+0000","last_became_active":"2023-12-20T04:47:12.316454+0000","last_became_peered":"2023-12-20T04:47:12.316454+0000","last_unstale":"2023-12-20T04:47:13.718708+0000","last_undegraded":"2023-12-20T04:47:13.718708+0000","last_fullsized":"2023-12-20T04:47:13.718708+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:55:55.758924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.305594+0000","last_change":"2023-12-20T04:47:11.957215+0000","last_active":"2023-12-20T04:47:12.305594+0000","last_peered":"2023-12-20T04:47:12.305594+0000","last_clean":"2023-12-20T04:47:12.305594+0000","last_became_active":"2023-12-20T04:47:11.956981+0000","last_became_peered":"2023-12-20T04:47:11.956981+0000","last_unstale":"2023-12-20T04:47:12.305594+0000","last_undegraded":"2023-12-20T04:47:12.305594+0000","last_fullsized":"2023-12-20T04:47:12.305594+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:38:22.215544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.306135+0000","last_change":"2023-12-20T04:47:12.321750+0000","last_active":"2023-12-20T04:47:13.306135+0000","last_peered":"2023-12-20T04:47:13.306135+0000","last_clean":"2023-12-20T04:47:13.306135+0000","last_became_active":"2023-12-20T04:47:12.321315+0000","last_became_peered":"2023-12-20T04:47:12.321315+0000","last_unstale":"2023-12-20T04:47:13.306135+0000","last_undegraded":"2023-12-20T04:47:13.306135+0000","last_fullsized":"2023-12-20T04:47:13.306135+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:30:08.404378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"100'1","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.323446+0000","last_change":"2023-12-20T04:47:11.962260+0000","last_active":"2023-12-20T04:47:12.323446+0000","last_peered":"2023-12-20T04:47:12.323446+0000","last_clean":"2023-12-20T04:47:12.323446+0000","last_became_active":"2023-12-20T04:47:11.961934+0000","last_became_peered":"2023-12-20T04:47:11.961934+0000","last_unstale":"2023-12-20T04:47:12.323446+0000","last_undegraded":"2023-12-20T04:47:12.323446+0000","last_fullsized":"2023-12-20T04:47:12.323446+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:34:16.121204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":235,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.311125+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:47:12.311125+0000","last_peered":"2023-12-20T04:47:12.311125+0000","last_clean":"2023-12-20T04:47:12.311125+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:47:12.311125+0000","last_undegraded":"2023-12-20T04:47:12.311125+0000","last_fullsized":"2023-12-20T04:47:12.311125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1109,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194202,"statfs":{"total":200000000,"available":198863836,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.502},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.79200000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.433}]},{"osd":1,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69799999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77600000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54100000000000004}]},{"osd":2,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.40600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.74199999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58199999999999996}]},{"osd":3,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.753,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.48199999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69299999999999995,"5min":0.753,"15min":0.753},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48599999999999999,"15min":0.48799999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.59599999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58599999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.33800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.57099999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52400000000000002,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70199999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66800000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.55700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":533,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194778,"statfs":{"total":200000000,"available":199453580,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.498,"15min":0.49299999999999999},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.497},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.40500000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.68000000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41999999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.47199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.749,"5min":0.751,"15min":0.751},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.437,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.46500000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.29999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71599999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.36299999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.38900000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.52700000000000002,"15min":0.499},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.435,"5min":0.377,"15min":0.377},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.43099999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.49399999999999999,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.58699999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.44},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.5,"15min":0.49299999999999999},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63700000000000001,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.312}]},{"osd":5,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51300000000000001,"15min":0.51700000000000002},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70899999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.33500000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68700000000000006,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.377},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.44700000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72199999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":534,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194778,"statfs":{"total":200000000,"available":199452688,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.66700000000000004,"5min":0.745,"15min":0.745},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72399999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54700000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.749,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.56999999999999995}]},{"osd":2,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72299999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63800000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68799999999999994,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.58199999999999996}]},{"osd":4,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.47999999999999998,"15min":0.504},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.63900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47299999999999998,"15min":0.47999999999999998},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65800000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.53200000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48699999999999999,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.65500000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.52900000000000003,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.75600000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60799999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.52700000000000002},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58699999999999997,"15min":0.60799999999999998},"min":{"1min":0.40300000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77600000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.70399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":532,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194779,"statfs":{"total":200000000,"available":199454274,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.28699999999999998,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.71499999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.308},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.33000000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70099999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.32800000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75600000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.36499999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54100000000000004,"15min":0.55600000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.33900000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.73999999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.44900000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78100000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.48499999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45200000000000001,"15min":0.47399999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.65000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.495,"15min":0.50600000000000001},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.505}]},{"osd":6,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48699999999999999,"15min":0.503},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.71399999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51200000000000001,"15min":0.53100000000000003},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69999999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52100000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.51400000000000001},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65500000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":534,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194778,"statfs":{"total":200000000,"available":199452710,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.34699999999999998,"15min":0.33800000000000002},"min":{"1min":0.23699999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.35299999999999998},"min":{"1min":0.30499999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.42899999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.32700000000000001,"15min":0.31900000000000001},"min":{"1min":0.26000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35199999999999998,"15min":0.33400000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.35599999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34499999999999997},"min":{"1min":0.23599999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52000000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.373},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.374},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.41599999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71699999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.754},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78800000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.76800000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.41399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.80400000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58599999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56799999999999995,"15min":0.55600000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.64300000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.41899999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":533,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194778,"statfs":{"total":200000000,"available":199453692,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.32100000000000001,"15min":0.29599999999999999},"min":{"1min":0.20899999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.61499999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38600000000000001,"15min":0.34300000000000003},"min":{"1min":0.27700000000000002,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.53700000000000003,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.30299999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.34899999999999998,"15min":0.32900000000000001},"min":{"1min":0.23499999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.55900000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.36699999999999999,"15min":0.34799999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.53400000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.42599999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.38900000000000001,"15min":0.35699999999999998},"min":{"1min":0.247,"5min":0.216,"15min":0.216},"max":{"1min":0.68100000000000005,"5min":0.995,"15min":0.995},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.38800000000000001,"15min":0.36899999999999999},"min":{"1min":0.29299999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61699999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.46500000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80400000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58899999999999997,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.94699999999999995,"5min":2.347,"15min":2.347},"last":0.59099999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80600000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51700000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79000000000000004,"5min":2.274,"15min":2.274},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.91100000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.39700000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82999999999999996,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.86699999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.498}]}]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":533,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194779,"statfs":{"total":200000000,"available":199454080,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.30499999999999999,"15min":0.28699999999999998},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.314},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.34300000000000003,"15min":0.32700000000000001},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52100000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.38500000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.30299999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.47599999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.34699999999999998},"min":{"1min":0.24199999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.36199999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.373,"15min":0.35299999999999998},"min":{"1min":0.21299999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"min":{"1min":0.28999999999999998,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54300000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.42099999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.70899999999999996,"5min":0.873,"15min":0.873},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82899999999999996,"5min":1.002,"15min":1.002},"last":0.67300000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.85799999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73099999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.71699999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.39300000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70899999999999996,"5min":1.038,"15min":1.038},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.624}]},{"osd":7,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84399999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83099999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1109,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194203,"statfs":{"total":200000000,"available":198863872,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.313,"15min":0.307},"min":{"1min":0.21099999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.45200000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.311},"min":{"1min":0.254,"5min":0.184,"15min":0.184},"max":{"1min":0.47299999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.35399999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35499999999999998},"min":{"1min":0.29899999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.501,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.34499999999999997},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.42899999999999999,"5min":0.622,"15min":0.622},"last":0.32900000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.32200000000000001},"min":{"1min":0.24399999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.309},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.34000000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53400000000000003,"15min":0.51700000000000002},"min":{"1min":0.438,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.38500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.621}]},{"osd":5,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.40699999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76200000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56000000000000005,"15min":0.54300000000000004},"min":{"1min":0.435,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73399999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.70199999999999996,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63900000000000001}]}]}],"pool_statfs":[]}} 2023-12-20T04:47:17.708 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:47:17.711 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:47:19.623 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:47:19.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.732+0000 7fd320e28640 1 Processor -- start 2023-12-20T04:47:19.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.732+0000 7fd320e28640 1 -- start start 2023-12-20T04:47:19.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.733+0000 7fd320e28640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd31c15d100 0x7fd31c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:19.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.733+0000 7fd320e28640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd31c0cdc10 0x7fd31c06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:19.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.733+0000 7fd320e28640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd31c0b2f90 con 0x7fd31c0d0370 2023-12-20T04:47:19.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.733+0000 7fd320e28640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd31c1613c0 con 0x7fd31c0cdc10 2023-12-20T04:47:19.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.733+0000 7fd320e28640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c0d1b00 con 0x7fd31c15d100 2023-12-20T04:47:19.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.733+0000 7fd31ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd31c0cdc10 0x7fd31c06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:19.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.733+0000 7fd31ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd31c0cdc10 0x7fd31c06c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53610/0 (socket says 172.21.15.132:53610) 2023-12-20T04:47:19.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.733+0000 7fd31ad9d640 1 -- 172.21.15.132:0/1035156348 learned_addr learned my addr 172.21.15.132:0/1035156348 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:19.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.733+0000 7fd31a59c640 1 --2- 172.21.15.132:0/1035156348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd31c15d100 0x7fd31c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:19.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.733+0000 7fd31ad9d640 1 -- 172.21.15.132:0/1035156348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd31c15d100 msgr2=0x7fd31c0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:19.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.733+0000 7fd31ad9d640 1 --2- 172.21.15.132:0/1035156348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd31c15d100 0x7fd31c0b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:19.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.733+0000 7fd31ad9d640 1 -- 172.21.15.132:0/1035156348 >> v1:172.21.15.187:6789/0 conn(0x7fd31c0d0370 legacy=0x7fd31c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:19.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.733+0000 7fd31ad9d640 1 -- 172.21.15.132:0/1035156348 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd31c0d0810 con 0x7fd31c0cdc10 2023-12-20T04:47:19.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.734+0000 7fd31ad9d640 1 --2- 172.21.15.132:0/1035156348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd31c0cdc10 0x7fd31c06c190 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd314009e50 tx=0x7fd31402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83e54ec9779c3595 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:19.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.734+0000 7fd319d9b640 1 -- 172.21.15.132:0/1035156348 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd31402ca70 con 0x7fd31c0cdc10 2023-12-20T04:47:19.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.734+0000 7fd319d9b640 1 -- 172.21.15.132:0/1035156348 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd31402cbd0 con 0x7fd31c0cdc10 2023-12-20T04:47:19.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.734+0000 7fd319d9b640 1 -- 172.21.15.132:0/1035156348 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd3140343f0 con 0x7fd31c0cdc10 2023-12-20T04:47:19.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.735+0000 7fd320e28640 1 -- 172.21.15.132:0/1035156348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd31c0cdc10 msgr2=0x7fd31c06c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:19.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.735+0000 7fd320e28640 1 --2- 172.21.15.132:0/1035156348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd31c0cdc10 0x7fd31c06c190 secure :-1 s=READY pgs=1041 cs=0 l=1 rev1=1 crypto rx=0x7fd314009e50 tx=0x7fd31402bed0 comp rx=0 tx=0).stop 2023-12-20T04:47:19.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.735+0000 7fd320e28640 1 -- 172.21.15.132:0/1035156348 shutdown_connections 2023-12-20T04:47:19.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.735+0000 7fd320e28640 1 --2- 172.21.15.132:0/1035156348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd31c0cdc10 0x7fd31c06c190 unknown :-1 s=CLOSED pgs=1041 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:19.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.735+0000 7fd320e28640 1 --2- 172.21.15.132:0/1035156348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd31c15d100 0x7fd31c0b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:19.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.735+0000 7fd320e28640 1 -- 172.21.15.132:0/1035156348 >> 172.21.15.132:0/1035156348 conn(0x7fd31c06d7c0 msgr2=0x7fd31c06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:19.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.735+0000 7fd320e28640 1 -- 172.21.15.132:0/1035156348 shutdown_connections 2023-12-20T04:47:19.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.735+0000 7fd320e28640 1 -- 172.21.15.132:0/1035156348 wait complete. 2023-12-20T04:47:19.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.736+0000 7fd320e28640 1 Processor -- start 2023-12-20T04:47:19.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.736+0000 7fd320e28640 1 -- start start 2023-12-20T04:47:19.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.737+0000 7fd320e28640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd31c0cdc10 0x7fd31c15d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:19.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.737+0000 7fd320e28640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd31c0d0370 0x7fd31c15f3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:19.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.737+0000 7fd320e28640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd31c15d100 0x7fd31c1f27c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:19.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.737+0000 7fd320e28640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c0c9fa0 con 0x7fd31c0cdc10 2023-12-20T04:47:19.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.737+0000 7fd320e28640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c0ca280 con 0x7fd31c0d0370 2023-12-20T04:47:19.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.737+0000 7fd320e28640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd31c0ca560 con 0x7fd31c15d100 2023-12-20T04:47:19.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.737+0000 7fd31a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd31c0cdc10 0x7fd31c15d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:19.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.737+0000 7fd31a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd31c0cdc10 0x7fd31c15d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53614/0 (socket says 172.21.15.132:53614) 2023-12-20T04:47:19.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.737+0000 7fd31a59c640 1 -- 172.21.15.132:0/3261370764 learned_addr learned my addr 172.21.15.132:0/3261370764 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:19.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.737+0000 7fd31a59c640 1 -- 172.21.15.132:0/3261370764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd31c15d100 msgr2=0x7fd31c1f27c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:19.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.737+0000 7fd31ad9d640 1 --2- 172.21.15.132:0/3261370764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd31c15d100 0x7fd31c1f27c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:19.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.737+0000 7fd311d9b640 1 --2- 172.21.15.132:0/3261370764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd31c0d0370 0x7fd31c15f3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:19.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.737+0000 7fd31a59c640 1 --2- 172.21.15.132:0/3261370764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd31c15d100 0x7fd31c1f27c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:19.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.737+0000 7fd31a59c640 1 -- 172.21.15.132:0/3261370764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd31c0d0370 msgr2=0x7fd31c15f3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:19.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.737+0000 7fd31a59c640 1 --2- 172.21.15.132:0/3261370764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd31c0d0370 0x7fd31c15f3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:19.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.737+0000 7fd31a59c640 1 -- 172.21.15.132:0/3261370764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd314009b30 con 0x7fd31c0cdc10 2023-12-20T04:47:19.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.737+0000 7fd31a59c640 1 --2- 172.21.15.132:0/3261370764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd31c0cdc10 0x7fd31c15d4e0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00d5f0 tx=0x7fd30c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:19.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.738+0000 7fd3137fe640 1 -- 172.21.15.132:0/3261370764 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c0125f0 con 0x7fd31c0cdc10 2023-12-20T04:47:19.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.738+0000 7fd3137fe640 1 -- 172.21.15.132:0/3261370764 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd30c012750 con 0x7fd31c0cdc10 2023-12-20T04:47:19.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.738+0000 7fd3137fe640 1 -- 172.21.15.132:0/3261370764 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd30c012b00 con 0x7fd31c0cdc10 2023-12-20T04:47:19.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.738+0000 7fd320e28640 1 -- 172.21.15.132:0/3261370764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd31c0ca840 con 0x7fd31c0cdc10 2023-12-20T04:47:19.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.738+0000 7fd320e28640 1 -- 172.21.15.132:0/3261370764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd31c15da20 con 0x7fd31c0cdc10 2023-12-20T04:47:19.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.739+0000 7fd320e28640 1 -- 172.21.15.132:0/3261370764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31c15dbe0 con 0x7fd31c0cdc10 2023-12-20T04:47:19.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.739+0000 7fd3137fe640 1 -- 172.21.15.132:0/3261370764 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd30c012c60 con 0x7fd31c0cdc10 2023-12-20T04:47:19.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.739+0000 7fd3137fe640 1 --2- 172.21.15.132:0/3261370764 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2fc06a430 0x7fd2fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:19.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.740+0000 7fd3137fe640 1 -- 172.21.15.132:0/3261370764 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd30c088d00 con 0x7fd31c0cdc10 2023-12-20T04:47:19.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.740+0000 7fd311d9b640 1 --2- 172.21.15.132:0/3261370764 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2fc06a430 0x7fd2fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:19.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.740+0000 7fd311d9b640 1 --2- 172.21.15.132:0/3261370764 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2fc06a430 0x7fd2fc06c8f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0cc250 tx=0x7fd304009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:19.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.744+0000 7fd3137fe640 1 -- 172.21.15.132:0/3261370764 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd30c054380 con 0x7fd31c0cdc10 2023-12-20T04:47:19.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.908+0000 7fd320e28640 1 -- 172.21.15.132:0/3261370764 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fd31c0ca3f0 con 0x7fd2fc06a430 2023-12-20T04:47:19.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.915+0000 7fd3137fe640 1 -- 172.21.15.132:0/3261370764 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285469 (secure 0 0 0) 0x7fd31c0ca3f0 con 0x7fd2fc06a430 2023-12-20T04:47:19.921 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:19.922 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:47:19.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.918+0000 7fd320e28640 1 -- 172.21.15.132:0/3261370764 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2fc06a430 msgr2=0x7fd2fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:19.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.918+0000 7fd320e28640 1 --2- 172.21.15.132:0/3261370764 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2fc06a430 0x7fd2fc06c8f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7fd31c0cc250 tx=0x7fd304009040 comp rx=0 tx=0).stop 2023-12-20T04:47:19.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.918+0000 7fd320e28640 1 -- 172.21.15.132:0/3261370764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd31c0cdc10 msgr2=0x7fd31c15d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:19.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.918+0000 7fd320e28640 1 --2- 172.21.15.132:0/3261370764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd31c0cdc10 0x7fd31c15d4e0 secure :-1 s=READY pgs=1042 cs=0 l=1 rev1=1 crypto rx=0x7fd30c00d5f0 tx=0x7fd30c00dab0 comp rx=0 tx=0).stop 2023-12-20T04:47:19.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.919+0000 7fd320e28640 1 -- 172.21.15.132:0/3261370764 shutdown_connections 2023-12-20T04:47:19.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.919+0000 7fd320e28640 1 --2- 172.21.15.132:0/3261370764 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2fc06a430 0x7fd2fc06c8f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:19.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.919+0000 7fd320e28640 1 --2- 172.21.15.132:0/3261370764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd31c15d100 0x7fd31c1f27c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:19.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.919+0000 7fd320e28640 1 --2- 172.21.15.132:0/3261370764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd31c0d0370 0x7fd31c15f3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:19.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.919+0000 7fd320e28640 1 --2- 172.21.15.132:0/3261370764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd31c0cdc10 0x7fd31c15d4e0 unknown :-1 s=CLOSED pgs=1042 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:19.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.919+0000 7fd320e28640 1 -- 172.21.15.132:0/3261370764 >> 172.21.15.132:0/3261370764 conn(0x7fd31c06d7c0 msgr2=0x7fd31c0cb170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:19.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.919+0000 7fd320e28640 1 -- 172.21.15.132:0/3261370764 shutdown_connections 2023-12-20T04:47:19.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:19.919+0000 7fd320e28640 1 -- 172.21.15.132:0/3261370764 wait complete. 2023-12-20T04:47:19.932 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":234,"stamp":"2023-12-20T04:47:18.149943+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":5421,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1557078,"statfs":{"total":1600000000,"available":1594448732,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.200519"},"pg_stats":[{"pgid":"13.3f","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718340+0000","last_change":"2023-12-20T04:47:12.319816+0000","last_active":"2023-12-20T04:47:13.718340+0000","last_peered":"2023-12-20T04:47:13.718340+0000","last_clean":"2023-12-20T04:47:13.718340+0000","last_became_active":"2023-12-20T04:47:12.319572+0000","last_became_peered":"2023-12-20T04:47:12.319572+0000","last_unstale":"2023-12-20T04:47:13.718340+0000","last_undegraded":"2023-12-20T04:47:13.718340+0000","last_fullsized":"2023-12-20T04:47:13.718340+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:48:26.370370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.3e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305926+0000","last_change":"2023-12-20T04:47:12.321504+0000","last_active":"2023-12-20T04:47:13.305926+0000","last_peered":"2023-12-20T04:47:13.305926+0000","last_clean":"2023-12-20T04:47:13.305926+0000","last_became_active":"2023-12-20T04:47:12.320558+0000","last_became_peered":"2023-12-20T04:47:12.320558+0000","last_unstale":"2023-12-20T04:47:13.305926+0000","last_undegraded":"2023-12-20T04:47:13.305926+0000","last_fullsized":"2023-12-20T04:47:13.305926+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:47:46.083643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.3d","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305596+0000","last_change":"2023-12-20T04:47:12.317527+0000","last_active":"2023-12-20T04:47:13.305596+0000","last_peered":"2023-12-20T04:47:13.305596+0000","last_clean":"2023-12-20T04:47:13.305596+0000","last_became_active":"2023-12-20T04:47:12.317308+0000","last_became_peered":"2023-12-20T04:47:12.317308+0000","last_unstale":"2023-12-20T04:47:13.305596+0000","last_undegraded":"2023-12-20T04:47:13.305596+0000","last_fullsized":"2023-12-20T04:47:13.305596+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:19:54.145383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.3c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307488+0000","last_change":"2023-12-20T04:47:12.317502+0000","last_active":"2023-12-20T04:47:13.307488+0000","last_peered":"2023-12-20T04:47:13.307488+0000","last_clean":"2023-12-20T04:47:13.307488+0000","last_became_active":"2023-12-20T04:47:12.317005+0000","last_became_peered":"2023-12-20T04:47:12.317005+0000","last_unstale":"2023-12-20T04:47:13.307488+0000","last_undegraded":"2023-12-20T04:47:13.307488+0000","last_fullsized":"2023-12-20T04:47:13.307488+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:52:35.520239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.3b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308268+0000","last_change":"2023-12-20T04:47:12.312082+0000","last_active":"2023-12-20T04:47:13.308268+0000","last_peered":"2023-12-20T04:47:13.308268+0000","last_clean":"2023-12-20T04:47:13.308268+0000","last_became_active":"2023-12-20T04:47:12.311835+0000","last_became_peered":"2023-12-20T04:47:12.311835+0000","last_unstale":"2023-12-20T04:47:13.308268+0000","last_undegraded":"2023-12-20T04:47:13.308268+0000","last_fullsized":"2023-12-20T04:47:13.308268+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:55:35.518784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.3a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.717918+0000","last_change":"2023-12-20T04:47:12.318185+0000","last_active":"2023-12-20T04:47:13.717918+0000","last_peered":"2023-12-20T04:47:13.717918+0000","last_clean":"2023-12-20T04:47:13.717918+0000","last_became_active":"2023-12-20T04:47:12.315846+0000","last_became_peered":"2023-12-20T04:47:12.315846+0000","last_unstale":"2023-12-20T04:47:13.717918+0000","last_undegraded":"2023-12-20T04:47:13.717918+0000","last_fullsized":"2023-12-20T04:47:13.717918+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:34:17.125409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.39","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307742+0000","last_change":"2023-12-20T04:47:12.311994+0000","last_active":"2023-12-20T04:47:13.307742+0000","last_peered":"2023-12-20T04:47:13.307742+0000","last_clean":"2023-12-20T04:47:13.307742+0000","last_became_active":"2023-12-20T04:47:12.311759+0000","last_became_peered":"2023-12-20T04:47:12.311759+0000","last_unstale":"2023-12-20T04:47:13.307742+0000","last_undegraded":"2023-12-20T04:47:13.307742+0000","last_fullsized":"2023-12-20T04:47:13.307742+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:00:40.904917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.38","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718077+0000","last_change":"2023-12-20T04:47:12.319002+0000","last_active":"2023-12-20T04:47:13.718077+0000","last_peered":"2023-12-20T04:47:13.718077+0000","last_clean":"2023-12-20T04:47:13.718077+0000","last_became_active":"2023-12-20T04:47:12.316809+0000","last_became_peered":"2023-12-20T04:47:12.316809+0000","last_unstale":"2023-12-20T04:47:13.718077+0000","last_undegraded":"2023-12-20T04:47:13.718077+0000","last_fullsized":"2023-12-20T04:47:13.718077+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:47:46.083643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.37","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.717759+0000","last_change":"2023-12-20T04:47:12.313212+0000","last_active":"2023-12-20T04:47:13.717759+0000","last_peered":"2023-12-20T04:47:13.717759+0000","last_clean":"2023-12-20T04:47:13.717759+0000","last_became_active":"2023-12-20T04:47:12.312929+0000","last_became_peered":"2023-12-20T04:47:12.312929+0000","last_unstale":"2023-12-20T04:47:13.717759+0000","last_undegraded":"2023-12-20T04:47:13.717759+0000","last_fullsized":"2023-12-20T04:47:13.717759+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:38:23.219749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.36","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718287+0000","last_change":"2023-12-20T04:47:12.318674+0000","last_active":"2023-12-20T04:47:13.718287+0000","last_peered":"2023-12-20T04:47:13.718287+0000","last_clean":"2023-12-20T04:47:13.718287+0000","last_became_active":"2023-12-20T04:47:12.318444+0000","last_became_peered":"2023-12-20T04:47:12.318444+0000","last_unstale":"2023-12-20T04:47:13.718287+0000","last_undegraded":"2023-12-20T04:47:13.718287+0000","last_fullsized":"2023-12-20T04:47:13.718287+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:27:49.207248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.35","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305906+0000","last_change":"2023-12-20T04:47:12.316674+0000","last_active":"2023-12-20T04:47:13.305906+0000","last_peered":"2023-12-20T04:47:13.305906+0000","last_clean":"2023-12-20T04:47:13.305906+0000","last_became_active":"2023-12-20T04:47:12.315714+0000","last_became_peered":"2023-12-20T04:47:12.315714+0000","last_unstale":"2023-12-20T04:47:13.305906+0000","last_undegraded":"2023-12-20T04:47:13.305906+0000","last_fullsized":"2023-12-20T04:47:13.305906+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:35:09.638327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.34","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718268+0000","last_change":"2023-12-20T04:47:12.319261+0000","last_active":"2023-12-20T04:47:13.718268+0000","last_peered":"2023-12-20T04:47:13.718268+0000","last_clean":"2023-12-20T04:47:13.718268+0000","last_became_active":"2023-12-20T04:47:12.319008+0000","last_became_peered":"2023-12-20T04:47:12.319008+0000","last_unstale":"2023-12-20T04:47:13.718268+0000","last_undegraded":"2023-12-20T04:47:13.718268+0000","last_fullsized":"2023-12-20T04:47:13.718268+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:55:35.518784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.33","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305726+0000","last_change":"2023-12-20T04:47:12.315546+0000","last_active":"2023-12-20T04:47:13.305726+0000","last_peered":"2023-12-20T04:47:13.305726+0000","last_clean":"2023-12-20T04:47:13.305726+0000","last_became_active":"2023-12-20T04:47:12.315326+0000","last_became_peered":"2023-12-20T04:47:12.315326+0000","last_unstale":"2023-12-20T04:47:13.305726+0000","last_undegraded":"2023-12-20T04:47:13.305726+0000","last_fullsized":"2023-12-20T04:47:13.305726+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:49.777395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.32","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307561+0000","last_change":"2023-12-20T04:47:12.317354+0000","last_active":"2023-12-20T04:47:13.307561+0000","last_peered":"2023-12-20T04:47:13.307561+0000","last_clean":"2023-12-20T04:47:13.307561+0000","last_became_active":"2023-12-20T04:47:12.316169+0000","last_became_peered":"2023-12-20T04:47:12.316169+0000","last_unstale":"2023-12-20T04:47:13.307561+0000","last_undegraded":"2023-12-20T04:47:13.307561+0000","last_fullsized":"2023-12-20T04:47:13.307561+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:03:47.167403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.31","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.717428+0000","last_change":"2023-12-20T04:47:12.312075+0000","last_active":"2023-12-20T04:47:13.717428+0000","last_peered":"2023-12-20T04:47:13.717428+0000","last_clean":"2023-12-20T04:47:13.717428+0000","last_became_active":"2023-12-20T04:47:12.311886+0000","last_became_peered":"2023-12-20T04:47:12.311886+0000","last_unstale":"2023-12-20T04:47:13.717428+0000","last_undegraded":"2023-12-20T04:47:13.717428+0000","last_fullsized":"2023-12-20T04:47:13.717428+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:48:26.370370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.30","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308329+0000","last_change":"2023-12-20T04:47:12.321602+0000","last_active":"2023-12-20T04:47:13.308329+0000","last_peered":"2023-12-20T04:47:13.308329+0000","last_clean":"2023-12-20T04:47:13.308329+0000","last_became_active":"2023-12-20T04:47:12.320847+0000","last_became_peered":"2023-12-20T04:47:12.320847+0000","last_unstale":"2023-12-20T04:47:13.308329+0000","last_undegraded":"2023-12-20T04:47:13.308329+0000","last_fullsized":"2023-12-20T04:47:13.308329+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:29:57.457453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2f","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308096+0000","last_change":"2023-12-20T04:47:12.308376+0000","last_active":"2023-12-20T04:47:13.308096+0000","last_peered":"2023-12-20T04:47:13.308096+0000","last_clean":"2023-12-20T04:47:13.308096+0000","last_became_active":"2023-12-20T04:47:12.307677+0000","last_became_peered":"2023-12-20T04:47:12.307677+0000","last_unstale":"2023-12-20T04:47:13.308096+0000","last_undegraded":"2023-12-20T04:47:13.308096+0000","last_fullsized":"2023-12-20T04:47:13.308096+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:31:44.080120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.2e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307802+0000","last_change":"2023-12-20T04:47:12.319818+0000","last_active":"2023-12-20T04:47:13.307802+0000","last_peered":"2023-12-20T04:47:13.307802+0000","last_clean":"2023-12-20T04:47:13.307802+0000","last_became_active":"2023-12-20T04:47:12.318202+0000","last_became_peered":"2023-12-20T04:47:12.318202+0000","last_unstale":"2023-12-20T04:47:13.307802+0000","last_undegraded":"2023-12-20T04:47:13.307802+0000","last_fullsized":"2023-12-20T04:47:13.307802+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:01:05.467132+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2d","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305681+0000","last_change":"2023-12-20T04:47:12.311031+0000","last_active":"2023-12-20T04:47:13.305681+0000","last_peered":"2023-12-20T04:47:13.305681+0000","last_clean":"2023-12-20T04:47:13.305681+0000","last_became_active":"2023-12-20T04:47:12.310827+0000","last_became_peered":"2023-12-20T04:47:12.310827+0000","last_unstale":"2023-12-20T04:47:13.305681+0000","last_undegraded":"2023-12-20T04:47:13.305681+0000","last_fullsized":"2023-12-20T04:47:13.305681+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:55:55.758924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.2c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307884+0000","last_change":"2023-12-20T04:47:12.307249+0000","last_active":"2023-12-20T04:47:13.307884+0000","last_peered":"2023-12-20T04:47:13.307884+0000","last_clean":"2023-12-20T04:47:13.307884+0000","last_became_active":"2023-12-20T04:47:12.307039+0000","last_became_peered":"2023-12-20T04:47:12.307039+0000","last_unstale":"2023-12-20T04:47:13.307884+0000","last_undegraded":"2023-12-20T04:47:13.307884+0000","last_fullsized":"2023-12-20T04:47:13.307884+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:31:06.096865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307769+0000","last_change":"2023-12-20T04:47:12.307238+0000","last_active":"2023-12-20T04:47:13.307769+0000","last_peered":"2023-12-20T04:47:13.307769+0000","last_clean":"2023-12-20T04:47:13.307769+0000","last_became_active":"2023-12-20T04:47:12.307015+0000","last_became_peered":"2023-12-20T04:47:12.307015+0000","last_unstale":"2023-12-20T04:47:13.307769+0000","last_undegraded":"2023-12-20T04:47:13.307769+0000","last_fullsized":"2023-12-20T04:47:13.307769+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:15:37.855644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.2a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.306004+0000","last_change":"2023-12-20T04:47:12.315175+0000","last_active":"2023-12-20T04:47:13.306004+0000","last_peered":"2023-12-20T04:47:13.306004+0000","last_clean":"2023-12-20T04:47:13.306004+0000","last_became_active":"2023-12-20T04:47:12.314862+0000","last_became_peered":"2023-12-20T04:47:12.314862+0000","last_unstale":"2023-12-20T04:47:13.306004+0000","last_undegraded":"2023-12-20T04:47:13.306004+0000","last_fullsized":"2023-12-20T04:47:13.306004+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:34:17.125409+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.29","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718341+0000","last_change":"2023-12-20T04:47:12.324138+0000","last_active":"2023-12-20T04:47:13.718341+0000","last_peered":"2023-12-20T04:47:13.718341+0000","last_clean":"2023-12-20T04:47:13.718341+0000","last_became_active":"2023-12-20T04:47:12.323252+0000","last_became_peered":"2023-12-20T04:47:12.323252+0000","last_unstale":"2023-12-20T04:47:13.718341+0000","last_undegraded":"2023-12-20T04:47:13.718341+0000","last_fullsized":"2023-12-20T04:47:13.718341+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:16:01.372088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.28","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307711+0000","last_change":"2023-12-20T04:47:12.308577+0000","last_active":"2023-12-20T04:47:13.307711+0000","last_peered":"2023-12-20T04:47:13.307711+0000","last_clean":"2023-12-20T04:47:13.307711+0000","last_became_active":"2023-12-20T04:47:12.308326+0000","last_became_peered":"2023-12-20T04:47:12.308326+0000","last_unstale":"2023-12-20T04:47:13.307711+0000","last_undegraded":"2023-12-20T04:47:13.307711+0000","last_fullsized":"2023-12-20T04:47:13.307711+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:32:45.625444+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.27","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.306039+0000","last_change":"2023-12-20T04:47:12.319804+0000","last_active":"2023-12-20T04:47:13.306039+0000","last_peered":"2023-12-20T04:47:13.306039+0000","last_clean":"2023-12-20T04:47:13.306039+0000","last_became_active":"2023-12-20T04:47:12.319587+0000","last_became_peered":"2023-12-20T04:47:12.319587+0000","last_unstale":"2023-12-20T04:47:13.306039+0000","last_undegraded":"2023-12-20T04:47:13.306039+0000","last_fullsized":"2023-12-20T04:47:13.306039+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:59:56.490637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.26","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305725+0000","last_change":"2023-12-20T04:47:12.314195+0000","last_active":"2023-12-20T04:47:13.305725+0000","last_peered":"2023-12-20T04:47:13.305725+0000","last_clean":"2023-12-20T04:47:13.305725+0000","last_became_active":"2023-12-20T04:47:12.312322+0000","last_became_peered":"2023-12-20T04:47:12.312322+0000","last_unstale":"2023-12-20T04:47:13.305725+0000","last_undegraded":"2023-12-20T04:47:13.305725+0000","last_fullsized":"2023-12-20T04:47:13.305725+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:31:44.080120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"13.25","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308580+0000","last_change":"2023-12-20T04:47:12.314548+0000","last_active":"2023-12-20T04:47:13.308580+0000","last_peered":"2023-12-20T04:47:13.308580+0000","last_clean":"2023-12-20T04:47:13.308580+0000","last_became_active":"2023-12-20T04:47:12.314291+0000","last_became_peered":"2023-12-20T04:47:12.314291+0000","last_unstale":"2023-12-20T04:47:13.308580+0000","last_undegraded":"2023-12-20T04:47:13.308580+0000","last_fullsized":"2023-12-20T04:47:13.308580+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:55:55.758924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.24","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718456+0000","last_change":"2023-12-20T04:47:12.324273+0000","last_active":"2023-12-20T04:47:13.718456+0000","last_peered":"2023-12-20T04:47:13.718456+0000","last_clean":"2023-12-20T04:47:13.718456+0000","last_became_active":"2023-12-20T04:47:12.323761+0000","last_became_peered":"2023-12-20T04:47:12.323761+0000","last_unstale":"2023-12-20T04:47:13.718456+0000","last_undegraded":"2023-12-20T04:47:13.718456+0000","last_fullsized":"2023-12-20T04:47:13.718456+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:23:39.357137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.23","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305732+0000","last_change":"2023-12-20T04:47:12.315114+0000","last_active":"2023-12-20T04:47:13.305732+0000","last_peered":"2023-12-20T04:47:13.305732+0000","last_clean":"2023-12-20T04:47:13.305732+0000","last_became_active":"2023-12-20T04:47:12.314806+0000","last_became_peered":"2023-12-20T04:47:12.314806+0000","last_unstale":"2023-12-20T04:47:13.305732+0000","last_undegraded":"2023-12-20T04:47:13.305732+0000","last_fullsized":"2023-12-20T04:47:13.305732+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:05:39.050971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.22","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.306133+0000","last_change":"2023-12-20T04:47:12.314930+0000","last_active":"2023-12-20T04:47:13.306133+0000","last_peered":"2023-12-20T04:47:13.306133+0000","last_clean":"2023-12-20T04:47:13.306133+0000","last_became_active":"2023-12-20T04:47:12.314581+0000","last_became_peered":"2023-12-20T04:47:12.314581+0000","last_unstale":"2023-12-20T04:47:13.306133+0000","last_undegraded":"2023-12-20T04:47:13.306133+0000","last_fullsized":"2023-12-20T04:47:13.306133+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:19:13.584643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.21","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308622+0000","last_change":"2023-12-20T04:47:12.313523+0000","last_active":"2023-12-20T04:47:13.308622+0000","last_peered":"2023-12-20T04:47:13.308622+0000","last_clean":"2023-12-20T04:47:13.308622+0000","last_became_active":"2023-12-20T04:47:12.312750+0000","last_became_peered":"2023-12-20T04:47:12.312750+0000","last_unstale":"2023-12-20T04:47:13.308622+0000","last_undegraded":"2023-12-20T04:47:13.308622+0000","last_fullsized":"2023-12-20T04:47:13.308622+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:19:54.145383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.20","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718401+0000","last_change":"2023-12-20T04:47:12.321614+0000","last_active":"2023-12-20T04:47:13.718401+0000","last_peered":"2023-12-20T04:47:13.718401+0000","last_clean":"2023-12-20T04:47:13.718401+0000","last_became_active":"2023-12-20T04:47:12.321375+0000","last_became_peered":"2023-12-20T04:47:12.321375+0000","last_unstale":"2023-12-20T04:47:13.718401+0000","last_undegraded":"2023-12-20T04:47:13.718401+0000","last_fullsized":"2023-12-20T04:47:13.718401+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:28:32.139630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307968+0000","last_change":"2023-12-20T04:47:12.321378+0000","last_active":"2023-12-20T04:47:13.307968+0000","last_peered":"2023-12-20T04:47:13.307968+0000","last_clean":"2023-12-20T04:47:13.307968+0000","last_became_active":"2023-12-20T04:47:12.320972+0000","last_became_peered":"2023-12-20T04:47:12.320972+0000","last_unstale":"2023-12-20T04:47:13.307968+0000","last_undegraded":"2023-12-20T04:47:13.307968+0000","last_fullsized":"2023-12-20T04:47:13.307968+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:43:50.090163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1f","version":"100'4","reported_seq":15,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.325687+0000","last_change":"2023-12-20T04:47:11.961534+0000","last_active":"2023-12-20T04:47:12.325687+0000","last_peered":"2023-12-20T04:47:12.325687+0000","last_clean":"2023-12-20T04:47:12.325687+0000","last_became_active":"2023-12-20T04:47:11.956878+0000","last_became_peered":"2023-12-20T04:47:11.956878+0000","last_unstale":"2023-12-20T04:47:12.325687+0000","last_undegraded":"2023-12-20T04:47:12.325687+0000","last_fullsized":"2023-12-20T04:47:12.325687+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:59:55.486432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1f","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718554+0000","last_change":"2023-12-20T04:47:12.323961+0000","last_active":"2023-12-20T04:47:13.718554+0000","last_peered":"2023-12-20T04:47:13.718554+0000","last_clean":"2023-12-20T04:47:13.718554+0000","last_became_active":"2023-12-20T04:47:12.322933+0000","last_became_peered":"2023-12-20T04:47:12.322933+0000","last_unstale":"2023-12-20T04:47:13.718554+0000","last_undegraded":"2023-12-20T04:47:13.718554+0000","last_fullsized":"2023-12-20T04:47:13.718554+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:41:05.944614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1e","version":"100'1","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.321200+0000","last_change":"2023-12-20T04:47:11.961534+0000","last_active":"2023-12-20T04:47:12.321200+0000","last_peered":"2023-12-20T04:47:12.321200+0000","last_clean":"2023-12-20T04:47:12.321200+0000","last_became_active":"2023-12-20T04:47:11.961319+0000","last_became_peered":"2023-12-20T04:47:11.961319+0000","last_unstale":"2023-12-20T04:47:12.321200+0000","last_undegraded":"2023-12-20T04:47:12.321200+0000","last_fullsized":"2023-12-20T04:47:12.321200+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:24.195503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718448+0000","last_change":"2023-12-20T04:47:12.323160+0000","last_active":"2023-12-20T04:47:13.718448+0000","last_peered":"2023-12-20T04:47:13.718448+0000","last_clean":"2023-12-20T04:47:13.718448+0000","last_became_active":"2023-12-20T04:47:12.322634+0000","last_became_peered":"2023-12-20T04:47:12.322634+0000","last_unstale":"2023-12-20T04:47:13.718448+0000","last_undegraded":"2023-12-20T04:47:13.718448+0000","last_fullsized":"2023-12-20T04:47:13.718448+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:30:15.686258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.1d","version":"100'2","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.319752+0000","last_change":"2023-12-20T04:47:11.957843+0000","last_active":"2023-12-20T04:47:12.319752+0000","last_peered":"2023-12-20T04:47:12.319752+0000","last_clean":"2023-12-20T04:47:12.319752+0000","last_became_active":"2023-12-20T04:47:11.957543+0000","last_became_peered":"2023-12-20T04:47:11.957543+0000","last_unstale":"2023-12-20T04:47:12.319752+0000","last_undegraded":"2023-12-20T04:47:12.319752+0000","last_fullsized":"2023-12-20T04:47:12.319752+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:19:12.580438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1d","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305915+0000","last_change":"2023-12-20T04:47:12.313018+0000","last_active":"2023-12-20T04:47:13.305915+0000","last_peered":"2023-12-20T04:47:13.305915+0000","last_clean":"2023-12-20T04:47:13.305915+0000","last_became_active":"2023-12-20T04:47:12.312767+0000","last_became_peered":"2023-12-20T04:47:12.312767+0000","last_unstale":"2023-12-20T04:47:13.305915+0000","last_undegraded":"2023-12-20T04:47:13.305915+0000","last_fullsized":"2023-12-20T04:47:13.305915+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:48:26.370370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1c","version":"100'2","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.319649+0000","last_change":"2023-12-20T04:47:11.956264+0000","last_active":"2023-12-20T04:47:12.319649+0000","last_peered":"2023-12-20T04:47:12.319649+0000","last_clean":"2023-12-20T04:47:12.319649+0000","last_became_active":"2023-12-20T04:47:11.955989+0000","last_became_peered":"2023-12-20T04:47:11.955989+0000","last_unstale":"2023-12-20T04:47:12.319649+0000","last_undegraded":"2023-12-20T04:47:12.319649+0000","last_fullsized":"2023-12-20T04:47:12.319649+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:30:07.400173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.1a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305653+0000","last_change":"2023-12-20T04:47:12.313401+0000","last_active":"2023-12-20T04:47:13.305653+0000","last_peered":"2023-12-20T04:47:13.305653+0000","last_clean":"2023-12-20T04:47:13.305653+0000","last_became_active":"2023-12-20T04:47:12.312651+0000","last_became_peered":"2023-12-20T04:47:12.312651+0000","last_unstale":"2023-12-20T04:47:13.305653+0000","last_undegraded":"2023-12-20T04:47:13.305653+0000","last_fullsized":"2023-12-20T04:47:13.305653+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:33:56.140203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.1b","version":"100'1","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.321765+0000","last_change":"2023-12-20T04:47:11.959564+0000","last_active":"2023-12-20T04:47:12.321765+0000","last_peered":"2023-12-20T04:47:12.321765+0000","last_clean":"2023-12-20T04:47:12.321765+0000","last_became_active":"2023-12-20T04:47:11.957369+0000","last_became_peered":"2023-12-20T04:47:11.957369+0000","last_unstale":"2023-12-20T04:47:12.321765+0000","last_undegraded":"2023-12-20T04:47:12.321765+0000","last_fullsized":"2023-12-20T04:47:12.321765+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:34:39.263240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.1b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308248+0000","last_change":"2023-12-20T04:47:12.307951+0000","last_active":"2023-12-20T04:47:13.308248+0000","last_peered":"2023-12-20T04:47:13.308248+0000","last_clean":"2023-12-20T04:47:13.308248+0000","last_became_active":"2023-12-20T04:47:12.307380+0000","last_became_peered":"2023-12-20T04:47:12.307380+0000","last_unstale":"2023-12-20T04:47:13.308248+0000","last_undegraded":"2023-12-20T04:47:13.308248+0000","last_fullsized":"2023-12-20T04:47:13.308248+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:49.777395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.1a","version":"100'1","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.320244+0000","last_change":"2023-12-20T04:47:11.961098+0000","last_active":"2023-12-20T04:47:12.320244+0000","last_peered":"2023-12-20T04:47:12.320244+0000","last_clean":"2023-12-20T04:47:12.320244+0000","last_became_active":"2023-12-20T04:47:11.960844+0000","last_became_peered":"2023-12-20T04:47:11.960844+0000","last_unstale":"2023-12-20T04:47:12.320244+0000","last_undegraded":"2023-12-20T04:47:12.320244+0000","last_fullsized":"2023-12-20T04:47:12.320244+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:07:16.555642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.18","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305782+0000","last_change":"2023-12-20T04:47:12.318872+0000","last_active":"2023-12-20T04:47:13.305782+0000","last_peered":"2023-12-20T04:47:13.305782+0000","last_clean":"2023-12-20T04:47:13.305782+0000","last_became_active":"2023-12-20T04:47:12.318327+0000","last_became_peered":"2023-12-20T04:47:12.318327+0000","last_unstale":"2023-12-20T04:47:13.305782+0000","last_undegraded":"2023-12-20T04:47:13.305782+0000","last_fullsized":"2023-12-20T04:47:13.305782+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:30:15.686258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.19","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.305083+0000","last_change":"2023-12-20T04:47:11.951890+0000","last_active":"2023-12-20T04:47:12.305083+0000","last_peered":"2023-12-20T04:47:12.305083+0000","last_clean":"2023-12-20T04:47:12.305083+0000","last_became_active":"2023-12-20T04:47:11.951676+0000","last_became_peered":"2023-12-20T04:47:11.951676+0000","last_unstale":"2023-12-20T04:47:12.305083+0000","last_undegraded":"2023-12-20T04:47:12.305083+0000","last_fullsized":"2023-12-20T04:47:12.305083+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:05:38.046766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.19","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.717365+0000","last_change":"2023-12-20T04:47:12.316244+0000","last_active":"2023-12-20T04:47:13.717365+0000","last_peered":"2023-12-20T04:47:13.717365+0000","last_clean":"2023-12-20T04:47:13.717365+0000","last_became_active":"2023-12-20T04:47:12.316037+0000","last_became_peered":"2023-12-20T04:47:12.316037+0000","last_unstale":"2023-12-20T04:47:13.717365+0000","last_undegraded":"2023-12-20T04:47:13.717365+0000","last_fullsized":"2023-12-20T04:47:13.717365+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:55:55.758924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.18","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.310108+0000","last_change":"2023-12-20T04:47:11.961498+0000","last_active":"2023-12-20T04:47:12.310108+0000","last_peered":"2023-12-20T04:47:12.310108+0000","last_clean":"2023-12-20T04:47:12.310108+0000","last_became_active":"2023-12-20T04:47:11.961274+0000","last_became_peered":"2023-12-20T04:47:11.961274+0000","last_unstale":"2023-12-20T04:47:12.310108+0000","last_undegraded":"2023-12-20T04:47:12.310108+0000","last_fullsized":"2023-12-20T04:47:12.310108+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:27:15.310466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.16","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.717545+0000","last_change":"2023-12-20T04:47:12.315110+0000","last_active":"2023-12-20T04:47:13.717545+0000","last_peered":"2023-12-20T04:47:13.717545+0000","last_clean":"2023-12-20T04:47:13.717545+0000","last_became_active":"2023-12-20T04:47:12.314899+0000","last_became_peered":"2023-12-20T04:47:12.314899+0000","last_unstale":"2023-12-20T04:47:13.717545+0000","last_undegraded":"2023-12-20T04:47:13.717545+0000","last_fullsized":"2023-12-20T04:47:13.717545+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:42:44.567217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"12.17","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.312205+0000","last_change":"2023-12-20T04:47:11.954119+0000","last_active":"2023-12-20T04:47:12.312205+0000","last_peered":"2023-12-20T04:47:12.312205+0000","last_clean":"2023-12-20T04:47:12.312205+0000","last_became_active":"2023-12-20T04:47:11.953865+0000","last_became_peered":"2023-12-20T04:47:11.953865+0000","last_unstale":"2023-12-20T04:47:12.312205+0000","last_undegraded":"2023-12-20T04:47:12.312205+0000","last_fullsized":"2023-12-20T04:47:12.312205+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:34:39.263240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.17","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718032+0000","last_change":"2023-12-20T04:47:12.318384+0000","last_active":"2023-12-20T04:47:13.718032+0000","last_peered":"2023-12-20T04:47:13.718032+0000","last_clean":"2023-12-20T04:47:13.718032+0000","last_became_active":"2023-12-20T04:47:12.316537+0000","last_became_peered":"2023-12-20T04:47:12.316537+0000","last_unstale":"2023-12-20T04:47:13.718032+0000","last_undegraded":"2023-12-20T04:47:13.718032+0000","last_fullsized":"2023-12-20T04:47:13.718032+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:18:34.417627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.16","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.311506+0000","last_change":"2023-12-20T04:47:11.960495+0000","last_active":"2023-12-20T04:47:12.311506+0000","last_peered":"2023-12-20T04:47:12.311506+0000","last_clean":"2023-12-20T04:47:12.311506+0000","last_became_active":"2023-12-20T04:47:11.960178+0000","last_became_peered":"2023-12-20T04:47:11.960178+0000","last_unstale":"2023-12-20T04:47:12.311506+0000","last_undegraded":"2023-12-20T04:47:12.311506+0000","last_fullsized":"2023-12-20T04:47:12.311506+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:18:33.413422+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.14","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305765+0000","last_change":"2023-12-20T04:47:12.319512+0000","last_active":"2023-12-20T04:47:13.305765+0000","last_peered":"2023-12-20T04:47:13.305765+0000","last_clean":"2023-12-20T04:47:13.305765+0000","last_became_active":"2023-12-20T04:47:12.319295+0000","last_became_peered":"2023-12-20T04:47:12.319295+0000","last_unstale":"2023-12-20T04:47:13.305765+0000","last_undegraded":"2023-12-20T04:47:13.305765+0000","last_fullsized":"2023-12-20T04:47:13.305765+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:55:35.518784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.15","version":"100'3","reported_seq":14,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.325509+0000","last_change":"2023-12-20T04:47:11.962148+0000","last_active":"2023-12-20T04:47:12.325509+0000","last_peered":"2023-12-20T04:47:12.325509+0000","last_clean":"2023-12-20T04:47:12.325509+0000","last_became_active":"2023-12-20T04:47:11.960199+0000","last_became_peered":"2023-12-20T04:47:11.960199+0000","last_unstale":"2023-12-20T04:47:12.325509+0000","last_undegraded":"2023-12-20T04:47:12.325509+0000","last_fullsized":"2023-12-20T04:47:12.325509+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:24.195503+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.15","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308201+0000","last_change":"2023-12-20T04:47:12.309938+0000","last_active":"2023-12-20T04:47:13.308201+0000","last_peered":"2023-12-20T04:47:13.308201+0000","last_clean":"2023-12-20T04:47:13.308201+0000","last_became_active":"2023-12-20T04:47:12.309700+0000","last_became_peered":"2023-12-20T04:47:12.309700+0000","last_unstale":"2023-12-20T04:47:13.308201+0000","last_undegraded":"2023-12-20T04:47:13.308201+0000","last_fullsized":"2023-12-20T04:47:13.308201+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:27:49.207248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.14","version":"100'6","reported_seq":17,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.324083+0000","last_change":"2023-12-20T04:47:11.955106+0000","last_active":"2023-12-20T04:47:12.324083+0000","last_peered":"2023-12-20T04:47:12.324083+0000","last_clean":"2023-12-20T04:47:12.324083+0000","last_became_active":"2023-12-20T04:47:11.954868+0000","last_became_peered":"2023-12-20T04:47:11.954868+0000","last_unstale":"2023-12-20T04:47:12.324083+0000","last_undegraded":"2023-12-20T04:47:12.324083+0000","last_fullsized":"2023-12-20T04:47:12.324083+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:15:43.167465+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.12","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.306201+0000","last_change":"2023-12-20T04:47:12.308553+0000","last_active":"2023-12-20T04:47:13.306201+0000","last_peered":"2023-12-20T04:47:13.306201+0000","last_clean":"2023-12-20T04:47:13.306201+0000","last_became_active":"2023-12-20T04:47:12.307990+0000","last_became_peered":"2023-12-20T04:47:12.307990+0000","last_unstale":"2023-12-20T04:47:13.306201+0000","last_undegraded":"2023-12-20T04:47:13.306201+0000","last_fullsized":"2023-12-20T04:47:13.306201+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:48:26.370370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.13","version":"100'2","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.321892+0000","last_change":"2023-12-20T04:47:11.958402+0000","last_active":"2023-12-20T04:47:12.321892+0000","last_peered":"2023-12-20T04:47:12.321892+0000","last_clean":"2023-12-20T04:47:12.321892+0000","last_became_active":"2023-12-20T04:47:11.958172+0000","last_became_peered":"2023-12-20T04:47:11.958172+0000","last_unstale":"2023-12-20T04:47:12.321892+0000","last_undegraded":"2023-12-20T04:47:12.321892+0000","last_fullsized":"2023-12-20T04:47:12.321892+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:37.421468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.13","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305857+0000","last_change":"2023-12-20T04:47:12.319208+0000","last_active":"2023-12-20T04:47:13.305857+0000","last_peered":"2023-12-20T04:47:13.305857+0000","last_clean":"2023-12-20T04:47:13.305857+0000","last_became_active":"2023-12-20T04:47:12.318643+0000","last_became_peered":"2023-12-20T04:47:12.318643+0000","last_unstale":"2023-12-20T04:47:13.305857+0000","last_undegraded":"2023-12-20T04:47:13.305857+0000","last_fullsized":"2023-12-20T04:47:13.305857+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:55:35.518784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.12","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.308659+0000","last_change":"2023-12-20T04:47:11.956731+0000","last_active":"2023-12-20T04:47:12.308659+0000","last_peered":"2023-12-20T04:47:12.308659+0000","last_clean":"2023-12-20T04:47:12.308659+0000","last_became_active":"2023-12-20T04:47:11.956045+0000","last_became_peered":"2023-12-20T04:47:11.956045+0000","last_unstale":"2023-12-20T04:47:12.308659+0000","last_undegraded":"2023-12-20T04:47:12.308659+0000","last_fullsized":"2023-12-20T04:47:12.308659+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:29:56.453248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.10","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305570+0000","last_change":"2023-12-20T04:47:12.313238+0000","last_active":"2023-12-20T04:47:13.305570+0000","last_peered":"2023-12-20T04:47:13.305570+0000","last_clean":"2023-12-20T04:47:13.305570+0000","last_became_active":"2023-12-20T04:47:12.312335+0000","last_became_peered":"2023-12-20T04:47:12.312335+0000","last_unstale":"2023-12-20T04:47:13.305570+0000","last_undegraded":"2023-12-20T04:47:13.305570+0000","last_fullsized":"2023-12-20T04:47:13.305570+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:43:50.090163+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.11","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.313475+0000","last_change":"2023-12-20T04:47:11.962601+0000","last_active":"2023-12-20T04:47:12.313475+0000","last_peered":"2023-12-20T04:47:12.313475+0000","last_clean":"2023-12-20T04:47:12.313475+0000","last_became_active":"2023-12-20T04:47:11.962328+0000","last_became_peered":"2023-12-20T04:47:11.962328+0000","last_unstale":"2023-12-20T04:47:12.313475+0000","last_undegraded":"2023-12-20T04:47:12.313475+0000","last_fullsized":"2023-12-20T04:47:12.313475+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:37.421468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"13.11","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.306049+0000","last_change":"2023-12-20T04:47:12.321621+0000","last_active":"2023-12-20T04:47:13.306049+0000","last_peered":"2023-12-20T04:47:13.306049+0000","last_clean":"2023-12-20T04:47:13.306049+0000","last_became_active":"2023-12-20T04:47:12.320856+0000","last_became_peered":"2023-12-20T04:47:12.320856+0000","last_unstale":"2023-12-20T04:47:13.306049+0000","last_undegraded":"2023-12-20T04:47:13.306049+0000","last_fullsized":"2023-12-20T04:47:13.306049+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:13:50.011086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.10","version":"100'8","reported_seq":19,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.321861+0000","last_change":"2023-12-20T04:47:11.958895+0000","last_active":"2023-12-20T04:47:12.321861+0000","last_peered":"2023-12-20T04:47:12.321861+0000","last_clean":"2023-12-20T04:47:12.321861+0000","last_became_active":"2023-12-20T04:47:11.958668+0000","last_became_peered":"2023-12-20T04:47:11.958668+0000","last_unstale":"2023-12-20T04:47:12.321861+0000","last_undegraded":"2023-12-20T04:47:12.321861+0000","last_fullsized":"2023-12-20T04:47:12.321861+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:28:31.135425+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.e","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305963+0000","last_change":"2023-12-20T04:47:12.316463+0000","last_active":"2023-12-20T04:47:13.305963+0000","last_peered":"2023-12-20T04:47:13.305963+0000","last_clean":"2023-12-20T04:47:13.305963+0000","last_became_active":"2023-12-20T04:47:12.316205+0000","last_became_peered":"2023-12-20T04:47:12.316205+0000","last_unstale":"2023-12-20T04:47:13.305963+0000","last_undegraded":"2023-12-20T04:47:13.305963+0000","last_fullsized":"2023-12-20T04:47:13.305963+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:21:42.966504+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.f","version":"100'1","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.321009+0000","last_change":"2023-12-20T04:47:11.959082+0000","last_active":"2023-12-20T04:47:12.321009+0000","last_peered":"2023-12-20T04:47:12.321009+0000","last_clean":"2023-12-20T04:47:12.321009+0000","last_became_active":"2023-12-20T04:47:11.958261+0000","last_became_peered":"2023-12-20T04:47:11.958261+0000","last_unstale":"2023-12-20T04:47:12.321009+0000","last_undegraded":"2023-12-20T04:47:12.321009+0000","last_fullsized":"2023-12-20T04:47:12.321009+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:13:49.006881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.f","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718006+0000","last_change":"2023-12-20T04:47:12.320850+0000","last_active":"2023-12-20T04:47:13.718006+0000","last_peered":"2023-12-20T04:47:13.718006+0000","last_clean":"2023-12-20T04:47:13.718006+0000","last_became_active":"2023-12-20T04:47:12.320431+0000","last_became_peered":"2023-12-20T04:47:12.320431+0000","last_unstale":"2023-12-20T04:47:13.718006+0000","last_undegraded":"2023-12-20T04:47:13.718006+0000","last_fullsized":"2023-12-20T04:47:13.718006+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:42:44.567217+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.e","version":"100'2","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.321025+0000","last_change":"2023-12-20T04:47:11.953852+0000","last_active":"2023-12-20T04:47:12.321025+0000","last_peered":"2023-12-20T04:47:12.321025+0000","last_clean":"2023-12-20T04:47:12.321025+0000","last_became_active":"2023-12-20T04:47:11.953639+0000","last_became_peered":"2023-12-20T04:47:11.953639+0000","last_unstale":"2023-12-20T04:47:12.321025+0000","last_undegraded":"2023-12-20T04:47:12.321025+0000","last_fullsized":"2023-12-20T04:47:12.321025+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:43:49.085959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.d","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308464+0000","last_change":"2023-12-20T04:47:12.313693+0000","last_active":"2023-12-20T04:47:13.308464+0000","last_peered":"2023-12-20T04:47:13.308464+0000","last_clean":"2023-12-20T04:47:13.308464+0000","last_became_active":"2023-12-20T04:47:12.313254+0000","last_became_peered":"2023-12-20T04:47:12.313254+0000","last_unstale":"2023-12-20T04:47:13.308464+0000","last_undegraded":"2023-12-20T04:47:13.308464+0000","last_fullsized":"2023-12-20T04:47:13.308464+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:05:39.050971+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.c","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.304532+0000","last_change":"2023-12-20T04:47:11.951913+0000","last_active":"2023-12-20T04:47:12.304532+0000","last_peered":"2023-12-20T04:47:12.304532+0000","last_clean":"2023-12-20T04:47:12.304532+0000","last_became_active":"2023-12-20T04:47:11.951690+0000","last_became_peered":"2023-12-20T04:47:11.951690+0000","last_unstale":"2023-12-20T04:47:12.304532+0000","last_undegraded":"2023-12-20T04:47:12.304532+0000","last_fullsized":"2023-12-20T04:47:12.304532+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:33:55.135998+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.a","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307780+0000","last_change":"2023-12-20T04:47:12.317211+0000","last_active":"2023-12-20T04:47:13.307780+0000","last_peered":"2023-12-20T04:47:13.307780+0000","last_clean":"2023-12-20T04:47:13.307780+0000","last_became_active":"2023-12-20T04:47:12.315664+0000","last_became_peered":"2023-12-20T04:47:12.315664+0000","last_unstale":"2023-12-20T04:47:13.307780+0000","last_undegraded":"2023-12-20T04:47:13.307780+0000","last_fullsized":"2023-12-20T04:47:13.307780+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:04:08.897319+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.b","version":"100'2","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.320403+0000","last_change":"2023-12-20T04:47:11.957846+0000","last_active":"2023-12-20T04:47:12.320403+0000","last_peered":"2023-12-20T04:47:12.320403+0000","last_clean":"2023-12-20T04:47:12.320403+0000","last_became_active":"2023-12-20T04:47:11.957628+0000","last_became_peered":"2023-12-20T04:47:11.957628+0000","last_unstale":"2023-12-20T04:47:12.320403+0000","last_undegraded":"2023-12-20T04:47:12.320403+0000","last_fullsized":"2023-12-20T04:47:12.320403+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:31:43.075915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.b","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718175+0000","last_change":"2023-12-20T04:47:12.313275+0000","last_active":"2023-12-20T04:47:13.718175+0000","last_peered":"2023-12-20T04:47:13.718175+0000","last_clean":"2023-12-20T04:47:13.718175+0000","last_became_active":"2023-12-20T04:47:12.313026+0000","last_became_peered":"2023-12-20T04:47:12.313026+0000","last_unstale":"2023-12-20T04:47:13.718175+0000","last_undegraded":"2023-12-20T04:47:13.718175+0000","last_fullsized":"2023-12-20T04:47:13.718175+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:13:50.011086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.a","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.307086+0000","last_change":"2023-12-20T04:47:11.959587+0000","last_active":"2023-12-20T04:47:12.307086+0000","last_peered":"2023-12-20T04:47:12.307086+0000","last_clean":"2023-12-20T04:47:12.307086+0000","last_became_active":"2023-12-20T04:47:11.958769+0000","last_became_peered":"2023-12-20T04:47:11.958769+0000","last_unstale":"2023-12-20T04:47:12.307086+0000","last_undegraded":"2023-12-20T04:47:12.307086+0000","last_fullsized":"2023-12-20T04:47:12.307086+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:14:49.931435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.8","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.307829+0000","last_change":"2023-12-20T04:47:12.313934+0000","last_active":"2023-12-20T04:47:13.307829+0000","last_peered":"2023-12-20T04:47:13.307829+0000","last_clean":"2023-12-20T04:47:13.307829+0000","last_became_active":"2023-12-20T04:47:12.313734+0000","last_became_peered":"2023-12-20T04:47:12.313734+0000","last_unstale":"2023-12-20T04:47:13.307829+0000","last_undegraded":"2023-12-20T04:47:13.307829+0000","last_fullsized":"2023-12-20T04:47:13.307829+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:11:19.295959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"12.9","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.306130+0000","last_change":"2023-12-20T04:47:11.959267+0000","last_active":"2023-12-20T04:47:12.306130+0000","last_peered":"2023-12-20T04:47:12.306130+0000","last_clean":"2023-12-20T04:47:12.306130+0000","last_became_active":"2023-12-20T04:47:11.958955+0000","last_became_peered":"2023-12-20T04:47:11.958955+0000","last_unstale":"2023-12-20T04:47:12.306130+0000","last_undegraded":"2023-12-20T04:47:12.306130+0000","last_fullsized":"2023-12-20T04:47:12.306130+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:43:37.374450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"13.9","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.717957+0000","last_change":"2023-12-20T04:47:12.318589+0000","last_active":"2023-12-20T04:47:13.717957+0000","last_peered":"2023-12-20T04:47:13.717957+0000","last_clean":"2023-12-20T04:47:13.717957+0000","last_became_active":"2023-12-20T04:47:12.318184+0000","last_became_peered":"2023-12-20T04:47:12.318184+0000","last_unstale":"2023-12-20T04:47:13.717957+0000","last_undegraded":"2023-12-20T04:47:13.717957+0000","last_fullsized":"2023-12-20T04:47:13.717957+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:59:56.490637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.8","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.308739+0000","last_change":"2023-12-20T04:47:11.956539+0000","last_active":"2023-12-20T04:47:12.308739+0000","last_peered":"2023-12-20T04:47:12.308739+0000","last_clean":"2023-12-20T04:47:12.308739+0000","last_became_active":"2023-12-20T04:47:11.955735+0000","last_became_peered":"2023-12-20T04:47:11.955735+0000","last_unstale":"2023-12-20T04:47:12.308739+0000","last_undegraded":"2023-12-20T04:47:12.308739+0000","last_fullsized":"2023-12-20T04:47:12.308739+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:48.773190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"13.6","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308319+0000","last_change":"2023-12-20T04:47:12.314483+0000","last_active":"2023-12-20T04:47:13.308319+0000","last_peered":"2023-12-20T04:47:13.308319+0000","last_clean":"2023-12-20T04:47:13.308319+0000","last_became_active":"2023-12-20T04:47:12.314234+0000","last_became_peered":"2023-12-20T04:47:12.314234+0000","last_unstale":"2023-12-20T04:47:13.308319+0000","last_undegraded":"2023-12-20T04:47:13.308319+0000","last_fullsized":"2023-12-20T04:47:13.308319+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:48:26.370370+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.7","version":"100'2","reported_seq":13,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.323305+0000","last_change":"2023-12-20T04:47:11.960736+0000","last_active":"2023-12-20T04:47:12.323305+0000","last_peered":"2023-12-20T04:47:12.323305+0000","last_clean":"2023-12-20T04:47:12.323305+0000","last_became_active":"2023-12-20T04:47:11.960370+0000","last_became_peered":"2023-12-20T04:47:11.960370+0000","last_unstale":"2023-12-20T04:47:12.323305+0000","last_undegraded":"2023-12-20T04:47:12.323305+0000","last_fullsized":"2023-12-20T04:47:12.323305+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:57:12.056094+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.7","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305762+0000","last_change":"2023-12-20T04:47:12.316747+0000","last_active":"2023-12-20T04:47:13.305762+0000","last_peered":"2023-12-20T04:47:13.305762+0000","last_clean":"2023-12-20T04:47:13.305762+0000","last_became_active":"2023-12-20T04:47:12.316492+0000","last_became_peered":"2023-12-20T04:47:12.316492+0000","last_unstale":"2023-12-20T04:47:13.305762+0000","last_undegraded":"2023-12-20T04:47:13.305762+0000","last_fullsized":"2023-12-20T04:47:13.305762+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:29:57.457453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.6","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.308790+0000","last_change":"2023-12-20T04:47:11.959243+0000","last_active":"2023-12-20T04:47:12.308790+0000","last_peered":"2023-12-20T04:47:12.308790+0000","last_clean":"2023-12-20T04:47:12.308790+0000","last_became_active":"2023-12-20T04:47:11.959011+0000","last_became_peered":"2023-12-20T04:47:11.959011+0000","last_unstale":"2023-12-20T04:47:12.308790+0000","last_undegraded":"2023-12-20T04:47:12.308790+0000","last_fullsized":"2023-12-20T04:47:12.308790+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:11:02.381162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"13.4","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718403+0000","last_change":"2023-12-20T04:47:12.312961+0000","last_active":"2023-12-20T04:47:13.718403+0000","last_peered":"2023-12-20T04:47:13.718403+0000","last_clean":"2023-12-20T04:47:13.718403+0000","last_became_active":"2023-12-20T04:47:12.312746+0000","last_became_peered":"2023-12-20T04:47:12.312746+0000","last_unstale":"2023-12-20T04:47:13.718403+0000","last_undegraded":"2023-12-20T04:47:13.718403+0000","last_fullsized":"2023-12-20T04:47:13.718403+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:19:54.145383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.5","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.315108+0000","last_change":"2023-12-20T04:47:11.958772+0000","last_active":"2023-12-20T04:47:12.315108+0000","last_peered":"2023-12-20T04:47:12.315108+0000","last_clean":"2023-12-20T04:47:12.315108+0000","last_became_active":"2023-12-20T04:47:11.957887+0000","last_became_peered":"2023-12-20T04:47:11.957887+0000","last_unstale":"2023-12-20T04:47:12.315108+0000","last_undegraded":"2023-12-20T04:47:12.315108+0000","last_fullsized":"2023-12-20T04:47:12.315108+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:17:19.170567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.5","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.308051+0000","last_change":"2023-12-20T04:47:12.307062+0000","last_active":"2023-12-20T04:47:13.308051+0000","last_peered":"2023-12-20T04:47:13.308051+0000","last_clean":"2023-12-20T04:47:13.308051+0000","last_became_active":"2023-12-20T04:47:12.306812+0000","last_became_peered":"2023-12-20T04:47:12.306812+0000","last_unstale":"2023-12-20T04:47:13.308051+0000","last_undegraded":"2023-12-20T04:47:13.308051+0000","last_fullsized":"2023-12-20T04:47:13.308051+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:30:15.686258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"12.4","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.310741+0000","last_change":"2023-12-20T04:47:11.953965+0000","last_active":"2023-12-20T04:47:12.310741+0000","last_peered":"2023-12-20T04:47:12.310741+0000","last_clean":"2023-12-20T04:47:12.310741+0000","last_became_active":"2023-12-20T04:47:11.953721+0000","last_became_peered":"2023-12-20T04:47:11.953721+0000","last_unstale":"2023-12-20T04:47:12.310741+0000","last_undegraded":"2023-12-20T04:47:12.310741+0000","last_fullsized":"2023-12-20T04:47:12.310741+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:38:22.215544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.2","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.717892+0000","last_change":"2023-12-20T04:47:12.313935+0000","last_active":"2023-12-20T04:47:13.717892+0000","last_peered":"2023-12-20T04:47:13.717892+0000","last_clean":"2023-12-20T04:47:13.717892+0000","last_became_active":"2023-12-20T04:47:12.313711+0000","last_became_peered":"2023-12-20T04:47:12.313711+0000","last_unstale":"2023-12-20T04:47:13.717892+0000","last_undegraded":"2023-12-20T04:47:13.717892+0000","last_fullsized":"2023-12-20T04:47:13.717892+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:35:09.638327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"12.3","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.305174+0000","last_change":"2023-12-20T04:47:11.962166+0000","last_active":"2023-12-20T04:47:12.305174+0000","last_peered":"2023-12-20T04:47:12.305174+0000","last_clean":"2023-12-20T04:47:12.305174+0000","last_became_active":"2023-12-20T04:47:11.961376+0000","last_became_peered":"2023-12-20T04:47:11.961376+0000","last_unstale":"2023-12-20T04:47:12.305174+0000","last_undegraded":"2023-12-20T04:47:12.305174+0000","last_fullsized":"2023-12-20T04:47:12.305174+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:27:23.394159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"13.3","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.306288+0000","last_change":"2023-12-20T04:47:12.308676+0000","last_active":"2023-12-20T04:47:13.306288+0000","last_peered":"2023-12-20T04:47:13.306288+0000","last_clean":"2023-12-20T04:47:13.306288+0000","last_became_active":"2023-12-20T04:47:12.308319+0000","last_became_peered":"2023-12-20T04:47:12.308319+0000","last_unstale":"2023-12-20T04:47:13.306288+0000","last_undegraded":"2023-12-20T04:47:13.306288+0000","last_fullsized":"2023-12-20T04:47:13.306288+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:30:15.686258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"12.2","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.306930+0000","last_change":"2023-12-20T04:47:11.963831+0000","last_active":"2023-12-20T04:47:12.306930+0000","last_peered":"2023-12-20T04:47:12.306930+0000","last_clean":"2023-12-20T04:47:12.306930+0000","last_became_active":"2023-12-20T04:47:11.963459+0000","last_became_peered":"2023-12-20T04:47:11.963459+0000","last_unstale":"2023-12-20T04:47:12.306930+0000","last_undegraded":"2023-12-20T04:47:12.306930+0000","last_fullsized":"2023-12-20T04:47:12.306930+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:28:05.732418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.0","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.305789+0000","last_change":"2023-12-20T04:47:12.315039+0000","last_active":"2023-12-20T04:47:13.305789+0000","last_peered":"2023-12-20T04:47:13.305789+0000","last_clean":"2023-12-20T04:47:13.305789+0000","last_became_active":"2023-12-20T04:47:12.314798+0000","last_became_peered":"2023-12-20T04:47:12.314798+0000","last_unstale":"2023-12-20T04:47:13.305789+0000","last_undegraded":"2023-12-20T04:47:13.305789+0000","last_fullsized":"2023-12-20T04:47:13.305789+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:27:49.207248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"12.1","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.315688+0000","last_change":"2023-12-20T04:47:11.961695+0000","last_active":"2023-12-20T04:47:12.315688+0000","last_peered":"2023-12-20T04:47:12.315688+0000","last_clean":"2023-12-20T04:47:12.315688+0000","last_became_active":"2023-12-20T04:47:11.959458+0000","last_became_peered":"2023-12-20T04:47:11.959458+0000","last_unstale":"2023-12-20T04:47:12.315688+0000","last_undegraded":"2023-12-20T04:47:12.315688+0000","last_fullsized":"2023-12-20T04:47:12.315688+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:34:16.121204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"13.1","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.718708+0000","last_change":"2023-12-20T04:47:12.316873+0000","last_active":"2023-12-20T04:47:13.718708+0000","last_peered":"2023-12-20T04:47:13.718708+0000","last_clean":"2023-12-20T04:47:13.718708+0000","last_became_active":"2023-12-20T04:47:12.316454+0000","last_became_peered":"2023-12-20T04:47:12.316454+0000","last_unstale":"2023-12-20T04:47:13.718708+0000","last_undegraded":"2023-12-20T04:47:13.718708+0000","last_fullsized":"2023-12-20T04:47:13.718708+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:55:55.758924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"12.0","version":"0'0","reported_seq":11,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.305594+0000","last_change":"2023-12-20T04:47:11.957215+0000","last_active":"2023-12-20T04:47:12.305594+0000","last_peered":"2023-12-20T04:47:12.305594+0000","last_clean":"2023-12-20T04:47:12.305594+0000","last_became_active":"2023-12-20T04:47:11.956981+0000","last_became_peered":"2023-12-20T04:47:11.956981+0000","last_unstale":"2023-12-20T04:47:12.305594+0000","last_undegraded":"2023-12-20T04:47:12.305594+0000","last_fullsized":"2023-12-20T04:47:12.305594+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:38:22.215544+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"13.c","version":"0'0","reported_seq":10,"reported_epoch":101,"state":"active+clean","last_fresh":"2023-12-20T04:47:13.306135+0000","last_change":"2023-12-20T04:47:12.321750+0000","last_active":"2023-12-20T04:47:13.306135+0000","last_peered":"2023-12-20T04:47:13.306135+0000","last_clean":"2023-12-20T04:47:13.306135+0000","last_became_active":"2023-12-20T04:47:12.321315+0000","last_became_peered":"2023-12-20T04:47:12.321315+0000","last_unstale":"2023-12-20T04:47:13.306135+0000","last_undegraded":"2023-12-20T04:47:13.306135+0000","last_fullsized":"2023-12-20T04:47:13.306135+0000","mapping_epoch":99,"log_start":"0'0","ondisk_log_start":"0'0","created":99,"last_epoch_clean":100,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:11.946682+0000","last_clean_scrub_stamp":"2023-12-20T04:47:11.946682+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:30:08.404378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"12.d","version":"100'1","reported_seq":12,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.323446+0000","last_change":"2023-12-20T04:47:11.962260+0000","last_active":"2023-12-20T04:47:12.323446+0000","last_peered":"2023-12-20T04:47:12.323446+0000","last_clean":"2023-12-20T04:47:12.323446+0000","last_became_active":"2023-12-20T04:47:11.961934+0000","last_became_peered":"2023-12-20T04:47:11.961934+0000","last_unstale":"2023-12-20T04:47:12.323446+0000","last_undegraded":"2023-12-20T04:47:12.323446+0000","last_fullsized":"2023-12-20T04:47:12.323446+0000","mapping_epoch":98,"log_start":"0'0","ondisk_log_start":"0'0","created":98,"last_epoch_clean":99,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:47:10.942478+0000","last_clean_scrub_stamp":"2023-12-20T04:47:10.942478+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:34:16.121204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":235,"reported_epoch":100,"state":"active+clean","last_fresh":"2023-12-20T04:47:12.311125+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:47:12.311125+0000","last_peered":"2023-12-20T04:47:12.311125+0000","last_clean":"2023-12-20T04:47:12.311125+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:47:12.311125+0000","last_undegraded":"2023-12-20T04:47:12.311125+0000","last_fullsized":"2023-12-20T04:47:12.311125+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":13,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":12,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":19,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1109,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194202,"statfs":{"total":200000000,"available":198863836,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.54600000000000004,"15min":0.53200000000000003},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":1.0860000000000001,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.502},{"interface":"front","average":{"1min":0.54200000000000004,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.25600000000000001,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.79200000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.433}]},{"osd":1,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.69799999999999995,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.77600000000000002,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.54100000000000004}]},{"osd":2,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.40600000000000003,"5min":0.374,"15min":0.374},"max":{"1min":0.97699999999999998,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.74199999999999999,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58199999999999996}]},{"osd":3,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.56799999999999995,"5min":0.56200000000000006,"15min":0.55600000000000005},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":1.048,"5min":1.048,"15min":1.048},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.56399999999999995,"15min":0.56200000000000006},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.753,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.48199999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.69299999999999995,"5min":0.753,"15min":0.753},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48599999999999999,"15min":0.48799999999999999},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.59599999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.45300000000000001,"5min":0.48199999999999998,"15min":0.48999999999999999},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.58599999999999997,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.33800000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.67600000000000005,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.57099999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.52400000000000002,"15min":0.54800000000000004},"min":{"1min":0.34399999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.70199999999999996,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.53100000000000003,"15min":0.53500000000000003},"min":{"1min":0.33200000000000002,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.66800000000000004,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.55700000000000005}]}]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":30,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":533,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194778,"statfs":{"total":200000000,"available":199453580,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53600000000000003,"5min":0.498,"15min":0.49299999999999999},"min":{"1min":0.33000000000000002,"5min":0.309,"15min":0.309},"max":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"last":0.497},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53500000000000003,"15min":0.53600000000000003},"min":{"1min":0.40500000000000003,"5min":0.314,"15min":0.314},"max":{"1min":0.68000000000000005,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.41999999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.54800000000000004,"15min":0.53000000000000003},"min":{"1min":0.47199999999999998,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.749,"5min":0.751,"15min":0.751},"last":0.36699999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.56999999999999995,"15min":0.57799999999999996},"min":{"1min":0.437,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.46500000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.51700000000000002,"15min":0.50700000000000001},"min":{"1min":0.29999999999999999,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.71599999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.40100000000000002},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.36299999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.78400000000000003,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.38900000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.52700000000000002,"15min":0.499},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.72099999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.435,"5min":0.377,"15min":0.377},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.43099999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.49399999999999999,"15min":0.51000000000000001},"min":{"1min":0.35799999999999998,"5min":0.311,"15min":0.311},"max":{"1min":0.58699999999999997,"5min":0.73999999999999999,"15min":0.73999999999999999},"last":0.44},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.5,"15min":0.49299999999999999},"min":{"1min":0.37,"5min":0.32200000000000001,"15min":0.32200000000000001},"max":{"1min":0.63700000000000001,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.312}]},{"osd":5,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.48699999999999999,"5min":0.51300000000000001,"15min":0.51700000000000002},"min":{"1min":0.36399999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.70899999999999996,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.55000000000000004,"15min":0.55800000000000005},"min":{"1min":0.36799999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.69699999999999995,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.33500000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.54400000000000004,"15min":0.54900000000000004},"min":{"1min":0.40400000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.68700000000000006,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.377},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.58699999999999997,"15min":0.58099999999999996},"min":{"1min":0.44700000000000001,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.72199999999999998,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":16,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":534,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194778,"statfs":{"total":200000000,"available":199452688,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.52200000000000002,"15min":0.50700000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.66700000000000004,"5min":0.745,"15min":0.745},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.72399999999999998,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.54700000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54300000000000004,"15min":0.54900000000000004},"min":{"1min":0.26000000000000001,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.749,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78400000000000003,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.56999999999999995}]},{"osd":2,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.51400000000000001,"15min":0.51000000000000001},"min":{"1min":0.28199999999999997,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64800000000000002,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.52400000000000002,"15min":0.51600000000000001},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.72299999999999998,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63800000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51700000000000002,"5min":0.52900000000000003,"15min":0.52800000000000002},"min":{"1min":0.29899999999999999,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.68799999999999994,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.54800000000000004,"15min":0.54200000000000004},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.58199999999999996}]},{"osd":4,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.47999999999999998,"15min":0.504},"min":{"1min":0.249,"5min":0.249,"15min":0.249},"max":{"1min":0.63900000000000001,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.47299999999999998,"15min":0.47999999999999998},"min":{"1min":0.30099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.65800000000000003,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.53200000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.48699999999999999,"15min":0.50700000000000001},"min":{"1min":0.35699999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.65500000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.499,"5min":0.52900000000000003,"15min":0.54300000000000004},"min":{"1min":0.36399999999999999,"5min":0.31,"15min":0.31},"max":{"1min":0.75600000000000001,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.60799999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:46:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.52700000000000002},"min":{"1min":0.33200000000000002,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.56399999999999995},{"interface":"front","average":{"1min":0.54600000000000004,"5min":0.58699999999999997,"15min":0.60799999999999998},"min":{"1min":0.40300000000000002,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":0.77600000000000002,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.70399999999999996}]}]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":532,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194779,"statfs":{"total":200000000,"available":199454274,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.52300000000000002,"15min":0.52200000000000002},"min":{"1min":0.28699999999999998,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.71499999999999997,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.308},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.52200000000000002,"15min":0.51800000000000002},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.73099999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.33000000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53200000000000003,"15min":0.51400000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.70099999999999996,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.32800000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.75600000000000001,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.36499999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.54100000000000004,"15min":0.55600000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.72999999999999998,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.51900000000000002,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.33900000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.73999999999999999,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.44900000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56299999999999994,"15min":0.55400000000000005},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.76700000000000002,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.47499999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58699999999999997,"15min":0.58599999999999997},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.78100000000000003,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.48499999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.42899999999999999,"5min":0.45200000000000001,"15min":0.47399999999999998},"min":{"1min":0.222,"5min":0.222,"15min":0.222},"max":{"1min":0.65000000000000002,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.49199999999999999,"5min":0.495,"15min":0.50600000000000001},"min":{"1min":0.32500000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.68200000000000005,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.505}]},{"osd":6,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.48699999999999999,"15min":0.503},"min":{"1min":0.26400000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.71399999999999997,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.51200000000000001,"15min":0.53100000000000003},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69999999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52100000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:46:42 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.51300000000000001,"15min":0.51400000000000001},"min":{"1min":0.35699999999999998,"5min":0.316,"15min":0.316},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55700000000000005},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.53700000000000003,"15min":0.54500000000000004},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.65500000000000003,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.58999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":534,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194778,"statfs":{"total":200000000,"available":199452710,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.34699999999999998,"15min":0.33800000000000002},"min":{"1min":0.23699999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.629,"5min":0.629,"15min":0.629},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.35299999999999998},"min":{"1min":0.30499999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.64000000000000001,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.42899999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.32700000000000001,"15min":0.31900000000000001},"min":{"1min":0.26000000000000001,"5min":0.219,"15min":0.219},"max":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.35199999999999998,"15min":0.33400000000000002},"min":{"1min":0.20399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.58299999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"last":0.35599999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.34999999999999998,"15min":0.34499999999999997},"min":{"1min":0.23599999999999999,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.52000000000000002,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.373},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38600000000000001,"15min":0.374},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.41599999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.54400000000000004,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.71699999999999997,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.754},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56599999999999995,"15min":0.55700000000000005},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.78800000000000003,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.76800000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.56499999999999995,"15min":0.55700000000000005},"min":{"1min":0.41399999999999998,"5min":0.31,"15min":0.31},"max":{"1min":0.80400000000000005,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56799999999999995,"15min":0.55600000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.58599999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.57299999999999995,"15min":0.57899999999999996},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.83799999999999997,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.74199999999999999},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56799999999999995,"15min":0.55600000000000005},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.83399999999999996,"5min":0.83399999999999996,"15min":0.83399999999999996},"last":0.64300000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:46:45 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.57399999999999995,"15min":0.56100000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.41899999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.70999999999999996}]}]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":533,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194778,"statfs":{"total":200000000,"available":199453692,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.373,"5min":0.32100000000000001,"15min":0.29599999999999999},"min":{"1min":0.20899999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.61499999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.38600000000000001,"15min":0.34300000000000003},"min":{"1min":0.27700000000000002,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.53700000000000003,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.30299999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.34899999999999998,"15min":0.32900000000000001},"min":{"1min":0.23499999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.55900000000000005,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.36699999999999999,"15min":0.34799999999999998},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.53400000000000003,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.42599999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42499999999999999,"5min":0.38900000000000001,"15min":0.35699999999999998},"min":{"1min":0.247,"5min":0.216,"15min":0.216},"max":{"1min":0.68100000000000005,"5min":0.995,"15min":0.995},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.42099999999999999,"5min":0.38800000000000001,"15min":0.36899999999999999},"min":{"1min":0.29299999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.61699999999999999,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.46500000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.56399999999999995,"15min":0.56799999999999995},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80400000000000005,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.56100000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58899999999999997,"15min":0.56899999999999995},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.94699999999999995,"5min":2.347,"15min":2.347},"last":0.59099999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57899999999999996},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.997,"5min":0.997,"15min":0.997},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.55900000000000005,"15min":0.55000000000000004},"min":{"1min":0.41899999999999998,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.80600000000000005,"5min":0.82999999999999996,"15min":0.82999999999999996},"last":0.51700000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.59099999999999997,"15min":0.57499999999999996},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.79000000000000004,"5min":2.274,"15min":2.274},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.58099999999999996,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.91100000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.39700000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:46:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.82999999999999996,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.58199999999999996,"15min":0.57699999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.86699999999999999,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.498}]}]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":533,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194779,"statfs":{"total":200000000,"available":199454080,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.318,"5min":0.30499999999999999,"15min":0.28699999999999998},"min":{"1min":0.16400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.49399999999999999,"5min":0.49399999999999999,"15min":0.49399999999999999},"last":0.314},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.34300000000000003,"15min":0.32700000000000001},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.52100000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.38500000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.32100000000000001,"15min":0.30299999999999999},"min":{"1min":0.19500000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.47599999999999998,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.33400000000000002},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.34699999999999998},"min":{"1min":0.24199999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.57299999999999995,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.36199999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.40699999999999997,"5min":0.373,"15min":0.35299999999999998},"min":{"1min":0.21299999999999999,"5min":0.191,"15min":0.191},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.40300000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.36099999999999999,"15min":0.35199999999999998},"min":{"1min":0.28999999999999998,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54300000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.42099999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.55400000000000005,"15min":0.56299999999999994},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.70899999999999996,"5min":0.873,"15min":0.873},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.57199999999999995,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.34899999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.82899999999999996,"5min":1.002,"15min":1.002},"last":0.67300000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55900000000000005,"15min":0.55500000000000005},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.85799999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.53800000000000003},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.73099999999999998,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.71699999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55900000000000005,"15min":0.55600000000000005},"min":{"1min":0.39300000000000002,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.70899999999999996,"5min":1.038,"15min":1.038},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56200000000000006},"min":{"1min":0.40100000000000002,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.82199999999999995,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.624}]},{"osd":7,"last update":"Wed Dec 20 04:46:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59099999999999997,"15min":0.59099999999999997},"min":{"1min":0.41299999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.84399999999999997,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.59499999999999997,"15min":0.60799999999999998},"min":{"1min":0.376,"5min":0.376,"15min":0.376},"max":{"1min":0.83099999999999996,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.65900000000000003}]}]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1109,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194203,"statfs":{"total":200000000,"available":198863872,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.316,"5min":0.313,"15min":0.307},"min":{"1min":0.21099999999999999,"5min":0.184,"15min":0.184},"max":{"1min":0.45200000000000001,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.32900000000000001,"15min":0.311},"min":{"1min":0.254,"5min":0.184,"15min":0.184},"max":{"1min":0.47299999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.35399999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.35899999999999999,"15min":0.35499999999999998},"min":{"1min":0.29899999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.501,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.34599999999999997,"5min":0.34999999999999998,"15min":0.34499999999999997},"min":{"1min":0.23400000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.42899999999999999,"5min":0.622,"15min":0.622},"last":0.32900000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.35699999999999998,"5min":0.33900000000000002,"15min":0.32200000000000001},"min":{"1min":0.24399999999999999,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.48999999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.309},{"interface":"front","average":{"1min":0.38800000000000001,"5min":0.379,"15min":0.36599999999999999},"min":{"1min":0.311,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.34000000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57199999999999995,"5min":0.53400000000000003,"15min":0.51700000000000002},"min":{"1min":0.438,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.76500000000000001,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.38500000000000001,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.621}]},{"osd":5,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.53600000000000003,"15min":0.51600000000000001},"min":{"1min":0.40699999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.76200000000000001,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56000000000000005,"15min":0.54300000000000004},"min":{"1min":0.435,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.67200000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.59399999999999997,"15min":0.58199999999999996},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.58799999999999997,"15min":0.57999999999999996},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.73399999999999999,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.59899999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:46:41 2023","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.55800000000000005,"15min":0.54800000000000004},"min":{"1min":0.42099999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.70199999999999996,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.45600000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.63900000000000001}]}]}],"pool_statfs":[]}} 2023-12-20T04:47:19.937 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-20T04:47:19.937 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-20T04:47:20.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.077+0000 7f3f296fb640 1 Processor -- start 2023-12-20T04:47:20.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.077+0000 7f3f296fb640 1 -- start start 2023-12-20T04:47:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.077+0000 7f3f296fb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f240cf790 0x7f3f240cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.077+0000 7f3f296fb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f240d2920 con 0x7f3f240b6080 2023-12-20T04:47:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.077+0000 7f3f296fb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f240d1d10 con 0x7f3f2415d300 2023-12-20T04:47:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.077+0000 7f3f296fb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f240d0180 con 0x7f3f240cf790 2023-12-20T04:47:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.078+0000 7f3f1a7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f240cf790 0x7f3f240cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.078+0000 7f3f237fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3f240b6080 0x7f3f240b6490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53022/0 (socket says 172.21.15.132:53022) 2023-12-20T04:47:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.078+0000 7f3f237fe640 1 -- 172.21.15.132:0/2707360987 learned_addr learned my addr 172.21.15.132:0/2707360987 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.078+0000 7f3f1a7fc640 1 -- 172.21.15.132:0/2707360987 >> v1:172.21.15.187:6789/0 conn(0x7f3f2415d300 legacy=0x7f3f240d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.078+0000 7f3f1a7fc640 1 -- 172.21.15.132:0/2707360987 >> v1:172.21.15.132:6789/0 conn(0x7f3f240b6080 legacy=0x7f3f240b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.078+0000 7f3f227fc640 1 -- 172.21.15.132:0/2707360987 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 500288232 0 0) 0x7f3f240d2920 con 0x7f3f240b6080 2023-12-20T04:47:20.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.078+0000 7f3f1a7fc640 1 -- 172.21.15.132:0/2707360987 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f240d1ff0 con 0x7f3f240cf790 2023-12-20T04:47:20.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.079+0000 7f3f1a7fc640 1 --2- 172.21.15.132:0/2707360987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f240cf790 0x7f3f240cfc40 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0097a0 tx=0x7f3f0c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c8c8d336d213d6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:20.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.079+0000 7f3f227fc640 1 -- 172.21.15.132:0/2707360987 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c031830 con 0x7f3f240cf790 2023-12-20T04:47:20.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.079+0000 7f3f227fc640 1 -- 172.21.15.132:0/2707360987 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0c031990 con 0x7f3f240cf790 2023-12-20T04:47:20.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.079+0000 7f3f227fc640 1 -- 172.21.15.132:0/2707360987 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c031d20 con 0x7f3f240cf790 2023-12-20T04:47:20.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.079+0000 7f3f296fb640 1 -- 172.21.15.132:0/2707360987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f240cf790 msgr2=0x7f3f240cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:20.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.079+0000 7f3f296fb640 1 --2- 172.21.15.132:0/2707360987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f240cf790 0x7f3f240cfc40 secure :-1 s=READY pgs=1044 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c0097a0 tx=0x7f3f0c02b8d0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.079+0000 7f3f296fb640 1 -- 172.21.15.132:0/2707360987 shutdown_connections 2023-12-20T04:47:20.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.079+0000 7f3f296fb640 1 --2- 172.21.15.132:0/2707360987 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f240cf790 0x7f3f240cfc40 unknown :-1 s=CLOSED pgs=1044 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.079+0000 7f3f296fb640 1 -- 172.21.15.132:0/2707360987 >> 172.21.15.132:0/2707360987 conn(0x7f3f2406a3d0 msgr2=0x7f3f2406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:20.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.079+0000 7f3f296fb640 1 -- 172.21.15.132:0/2707360987 shutdown_connections 2023-12-20T04:47:20.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.079+0000 7f3f296fb640 1 -- 172.21.15.132:0/2707360987 wait complete. 2023-12-20T04:47:20.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.080+0000 7f3f296fb640 1 Processor -- start 2023-12-20T04:47:20.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.081+0000 7f3f296fb640 1 -- start start 2023-12-20T04:47:20.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.081+0000 7f3f296fb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f240b6080 0x7f3f240cc9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:20.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.081+0000 7f3f296fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f240cf790 0x7f3f24150450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:20.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.081+0000 7f3f296fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f2415d300 0x7f3f240ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:20.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.081+0000 7f3f296fb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f24150e60 con 0x7f3f240cf790 2023-12-20T04:47:20.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.081+0000 7f3f296fb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f24150990 con 0x7f3f240b6080 2023-12-20T04:47:20.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.081+0000 7f3f296fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f240cae90 con 0x7f3f2415d300 2023-12-20T04:47:20.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.081+0000 7f3f1a7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f240cf790 0x7f3f24150450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:20.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.081+0000 7f3f1a7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f240cf790 0x7f3f24150450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53646/0 (socket says 172.21.15.132:53646) 2023-12-20T04:47:20.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.081+0000 7f3f1a7fc640 1 -- 172.21.15.132:0/3416992042 learned_addr learned my addr 172.21.15.132:0/3416992042 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:20.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.082+0000 7f3f237fe640 1 --2- 172.21.15.132:0/3416992042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f2415d300 0x7f3f240ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:20.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.082+0000 7f3f22ffd640 1 --2- 172.21.15.132:0/3416992042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f240b6080 0x7f3f240cc9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:20.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.082+0000 7f3f1a7fc640 1 -- 172.21.15.132:0/3416992042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f2415d300 msgr2=0x7f3f240ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:20.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.082+0000 7f3f1a7fc640 1 --2- 172.21.15.132:0/3416992042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f2415d300 0x7f3f240ca950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.082+0000 7f3f1a7fc640 1 -- 172.21.15.132:0/3416992042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f240b6080 msgr2=0x7f3f240cc9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:20.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.082+0000 7f3f1a7fc640 1 --2- 172.21.15.132:0/3416992042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f240b6080 0x7f3f240cc9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.082+0000 7f3f1a7fc640 1 -- 172.21.15.132:0/3416992042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f0c009400 con 0x7f3f240cf790 2023-12-20T04:47:20.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.082+0000 7f3f1a7fc640 1 --2- 172.21.15.132:0/3416992042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f240cf790 0x7f3f24150450 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c02bee0 tx=0x7f3f0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:20.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.082+0000 7f3f1bfff640 1 -- 172.21.15.132:0/3416992042 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c03ba70 con 0x7f3f240cf790 2023-12-20T04:47:20.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.082+0000 7f3f1bfff640 1 -- 172.21.15.132:0/3416992042 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f0c03bbd0 con 0x7f3f240cf790 2023-12-20T04:47:20.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.082+0000 7f3f296fb640 1 -- 172.21.15.132:0/3416992042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f24151350 con 0x7f3f240cf790 2023-12-20T04:47:20.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.082+0000 7f3f1bfff640 1 -- 172.21.15.132:0/3416992042 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0c0453f0 con 0x7f3f240cf790 2023-12-20T04:47:20.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.082+0000 7f3f296fb640 1 -- 172.21.15.132:0/3416992042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f240cb3a0 con 0x7f3f240cf790 2023-12-20T04:47:20.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.083+0000 7f3f296fb640 1 -- 172.21.15.132:0/3416992042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f2404e840 con 0x7f3f240cf790 2023-12-20T04:47:20.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.083+0000 7f3f1bfff640 1 -- 172.21.15.132:0/3416992042 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3f0c045550 con 0x7f3f240cf790 2023-12-20T04:47:20.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.084+0000 7f3f1bfff640 1 --2- 172.21.15.132:0/3416992042 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3f0406a430 0x7f3f0406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:20.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.084+0000 7f3f1bfff640 1 -- 172.21.15.132:0/3416992042 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f0c0aafb0 con 0x7f3f240cf790 2023-12-20T04:47:20.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.084+0000 7f3f22ffd640 1 --2- 172.21.15.132:0/3416992042 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3f0406a430 0x7f3f0406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:20.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.084+0000 7f3f22ffd640 1 --2- 172.21.15.132:0/3416992042 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3f0406a430 0x7f3f0406c8f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3f2415b450 tx=0x7f3f14009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:20.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.088+0000 7f3f1bfff640 1 -- 172.21.15.132:0/3416992042 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3f0c0ddca0 con 0x7f3f240cf790 2023-12-20T04:47:20.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.320+0000 7f3f296fb640 1 -- 172.21.15.132:0/3416992042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3f241514e0 con 0x7f3f240cf790 2023-12-20T04:47:20.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.324+0000 7f3f1bfff640 1 -- 172.21.15.132:0/3416992042 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v17) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3f0c0766c0 con 0x7f3f240cf790 2023-12-20T04:47:20.325 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.0 2023-12-20T04:47:20.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.326+0000 7f3f296fb640 1 -- 172.21.15.132:0/3416992042 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3f0406a430 msgr2=0x7f3f0406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:20.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.326+0000 7f3f296fb640 1 --2- 172.21.15.132:0/3416992042 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3f0406a430 0x7f3f0406c8f0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f3f2415b450 tx=0x7f3f14009040 comp rx=0 tx=0).stop 2023-12-20T04:47:20.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.326+0000 7f3f296fb640 1 -- 172.21.15.132:0/3416992042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f240cf790 msgr2=0x7f3f24150450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:20.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.326+0000 7f3f296fb640 1 --2- 172.21.15.132:0/3416992042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f240cf790 0x7f3f24150450 secure :-1 s=READY pgs=1045 cs=0 l=1 rev1=1 crypto rx=0x7f3f0c02bee0 tx=0x7f3f0c0046c0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.326+0000 7f3f296fb640 1 -- 172.21.15.132:0/3416992042 shutdown_connections 2023-12-20T04:47:20.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.326+0000 7f3f296fb640 1 --2- 172.21.15.132:0/3416992042 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3f0406a430 0x7f3f0406c8f0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.326+0000 7f3f296fb640 1 --2- 172.21.15.132:0/3416992042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f2415d300 0x7f3f240ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.326+0000 7f3f296fb640 1 --2- 172.21.15.132:0/3416992042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f240cf790 0x7f3f24150450 unknown :-1 s=CLOSED pgs=1045 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.326+0000 7f3f296fb640 1 --2- 172.21.15.132:0/3416992042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f240b6080 0x7f3f240cc9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.326+0000 7f3f296fb640 1 -- 172.21.15.132:0/3416992042 >> 172.21.15.132:0/3416992042 conn(0x7f3f2406a3d0 msgr2=0x7f3f240b7d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:20.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.326+0000 7f3f296fb640 1 -- 172.21.15.132:0/3416992042 shutdown_connections 2023-12-20T04:47:20.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.326+0000 7f3f296fb640 1 -- 172.21.15.132:0/3416992042 wait complete. 2023-12-20T04:47:20.338 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:47:20.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.436+0000 7ff6ea4df640 1 Processor -- start 2023-12-20T04:47:20.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.436+0000 7ff6ea4df640 1 -- start start 2023-12-20T04:47:20.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.437+0000 7ff6ea4df640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff6e40b1630 0x7ff6e40ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:20.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.437+0000 7ff6ea4df640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6e406c720 0x7ff6e40c9640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:20.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.437+0000 7ff6ea4df640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6e40cba00 con 0x7ff6e415d120 2023-12-20T04:47:20.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.437+0000 7ff6ea4df640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6e415d500 con 0x7ff6e40b1630 2023-12-20T04:47:20.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.437+0000 7ff6ea4df640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e40ae1f0 con 0x7ff6e406c720 2023-12-20T04:47:20.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.437+0000 7ff6e37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff6e40b1630 0x7ff6e40ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:20.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.437+0000 7ff6e37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff6e40b1630 0x7ff6e40ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53660/0 (socket says 172.21.15.132:53660) 2023-12-20T04:47:20.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.437+0000 7ff6e37fe640 1 -- 172.21.15.132:0/133984559 learned_addr learned my addr 172.21.15.132:0/133984559 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:20.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.437+0000 7ff6e8a7c640 1 --2- 172.21.15.132:0/133984559 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6e406c720 0x7ff6e40c9640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:20.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.437+0000 7ff6e37fe640 1 -- 172.21.15.132:0/133984559 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6e406c720 msgr2=0x7ff6e40c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:20.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.437+0000 7ff6e37fe640 1 --2- 172.21.15.132:0/133984559 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6e406c720 0x7ff6e40c9640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.437+0000 7ff6e37fe640 1 -- 172.21.15.132:0/133984559 >> v1:172.21.15.187:6789/0 conn(0x7ff6e415d120 legacy=0x7ff6e40b0f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:20.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.437+0000 7ff6e37fe640 1 -- 172.21.15.132:0/133984559 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6e40cc860 con 0x7ff6e40b1630 2023-12-20T04:47:20.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.437+0000 7ff6e8a7c640 1 --2- 172.21.15.132:0/133984559 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6e406c720 0x7ff6e40c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:20.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.438+0000 7ff6e37fe640 1 --2- 172.21.15.132:0/133984559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b1630 0x7ff6e40ce9a0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8009870 tx=0x7ff6d802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1812c77c91bba7d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:20.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.438+0000 7ff6e2ffd640 1 -- 172.21.15.132:0/133984559 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8030840 con 0x7ff6e40b1630 2023-12-20T04:47:20.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.438+0000 7ff6e2ffd640 1 -- 172.21.15.132:0/133984559 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d80309a0 con 0x7ff6e40b1630 2023-12-20T04:47:20.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.438+0000 7ff6e2ffd640 1 -- 172.21.15.132:0/133984559 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8030d30 con 0x7ff6e40b1630 2023-12-20T04:47:20.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.439+0000 7ff6ea4df640 1 -- 172.21.15.132:0/133984559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b1630 msgr2=0x7ff6e40ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:20.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.439+0000 7ff6ea4df640 1 --2- 172.21.15.132:0/133984559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b1630 0x7ff6e40ce9a0 secure :-1 s=READY pgs=1046 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8009870 tx=0x7ff6d802b980 comp rx=0 tx=0).stop 2023-12-20T04:47:20.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.439+0000 7ff6ea4df640 1 -- 172.21.15.132:0/133984559 shutdown_connections 2023-12-20T04:47:20.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.439+0000 7ff6ea4df640 1 --2- 172.21.15.132:0/133984559 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6e406c720 0x7ff6e40c9640 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.439+0000 7ff6ea4df640 1 --2- 172.21.15.132:0/133984559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b1630 0x7ff6e40ce9a0 unknown :-1 s=CLOSED pgs=1046 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.439+0000 7ff6ea4df640 1 -- 172.21.15.132:0/133984559 >> 172.21.15.132:0/133984559 conn(0x7ff6e406a050 msgr2=0x7ff6e406a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:20.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.439+0000 7ff6ea4df640 1 -- 172.21.15.132:0/133984559 shutdown_connections 2023-12-20T04:47:20.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.439+0000 7ff6ea4df640 1 -- 172.21.15.132:0/133984559 wait complete. 2023-12-20T04:47:20.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.440+0000 7ff6ea4df640 1 Processor -- start 2023-12-20T04:47:20.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.440+0000 7ff6ea4df640 1 -- start start 2023-12-20T04:47:20.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6ea4df640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6e406c720 0x7ff6e41f1ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:20.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6ea4df640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b1630 0x7ff6e40c6ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:20.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6ea4df640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6e415d120 0x7ff6e40c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:20.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6ea4df640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e40c7520 con 0x7ff6e40b1630 2023-12-20T04:47:20.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6ea4df640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e40c7800 con 0x7ff6e406c720 2023-12-20T04:47:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6ea4df640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6e40c7ae0 con 0x7ff6e415d120 2023-12-20T04:47:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6e37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b1630 0x7ff6e40c6ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6e37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b1630 0x7ff6e40c6ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53662/0 (socket says 172.21.15.132:53662) 2023-12-20T04:47:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6e37fe640 1 -- 172.21.15.132:0/727401047 learned_addr learned my addr 172.21.15.132:0/727401047 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6e3fff640 1 --2- 172.21.15.132:0/727401047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6e406c720 0x7ff6e41f1ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6e8a7c640 1 --2- 172.21.15.132:0/727401047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6e415d120 0x7ff6e40c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6e37fe640 1 -- 172.21.15.132:0/727401047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6e415d120 msgr2=0x7ff6e40c7f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6e37fe640 1 --2- 172.21.15.132:0/727401047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6e415d120 0x7ff6e40c7f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6e37fe640 1 -- 172.21.15.132:0/727401047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6e406c720 msgr2=0x7ff6e41f1ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6e37fe640 1 --2- 172.21.15.132:0/727401047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6e406c720 0x7ff6e41f1ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6e37fe640 1 -- 172.21.15.132:0/727401047 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6d80094d0 con 0x7ff6e40b1630 2023-12-20T04:47:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6e8a7c640 1 --2- 172.21.15.132:0/727401047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6e415d120 0x7ff6e40c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.441+0000 7ff6e37fe640 1 --2- 172.21.15.132:0/727401047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b1630 0x7ff6e40c6ad0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8000c00 tx=0x7ff6d8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:20.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.442+0000 7ff6e0ff9640 1 -- 172.21.15.132:0/727401047 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8039c90 con 0x7ff6e40b1630 2023-12-20T04:47:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.442+0000 7ff6e0ff9640 1 -- 172.21.15.132:0/727401047 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6d8039df0 con 0x7ff6e40b1630 2023-12-20T04:47:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.442+0000 7ff6e0ff9640 1 -- 172.21.15.132:0/727401047 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6d8043640 con 0x7ff6e40b1630 2023-12-20T04:47:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.442+0000 7ff6ea4df640 1 -- 172.21.15.132:0/727401047 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6e40c27d0 con 0x7ff6e40b1630 2023-12-20T04:47:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.442+0000 7ff6ea4df640 1 -- 172.21.15.132:0/727401047 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6e4152bc0 con 0x7ff6e40b1630 2023-12-20T04:47:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.443+0000 7ff6ea4df640 1 -- 172.21.15.132:0/727401047 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6e4066820 con 0x7ff6e40b1630 2023-12-20T04:47:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.443+0000 7ff6e0ff9640 1 -- 172.21.15.132:0/727401047 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff6d80437a0 con 0x7ff6e40b1630 2023-12-20T04:47:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.444+0000 7ff6e0ff9640 1 --2- 172.21.15.132:0/727401047 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6d006a430 0x7ff6d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.444+0000 7ff6e0ff9640 1 -- 172.21.15.132:0/727401047 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff6d803e070 con 0x7ff6e40b1630 2023-12-20T04:47:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.444+0000 7ff6e3fff640 1 --2- 172.21.15.132:0/727401047 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6d006a430 0x7ff6d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:20.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.444+0000 7ff6e3fff640 1 --2- 172.21.15.132:0/727401047 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6d006a430 0x7ff6d006c8f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4000f60 tx=0x7ff6d4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:20.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.448+0000 7ff6e0ff9640 1 -- 172.21.15.132:0/727401047 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff6d8076f50 con 0x7ff6e40b1630 2023-12-20T04:47:20.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.645+0000 7ff6ea4df640 1 -- 172.21.15.132:0/727401047 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff6e40c2cf0 con 0x7ff6e40b1630 2023-12-20T04:47:20.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.645+0000 7ff6e0ff9640 1 -- 172.21.15.132:0/727401047 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4717 (secure 0 0 0) 0x7ff6e40c2cf0 con 0x7ff6e40b1630 2023-12-20T04:47:20.648 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:20.648 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6939,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2115867433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2115867433},{"type":"v1","addr":"172.21.15.132:6837","nonce":2115867433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6942,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/162444556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":162444556},{"type":"v1","addr":"172.21.15.132:6836","nonce":162444556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2089611890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2089611890},{"type":"v1","addr":"172.21.15.187:6835","nonce":2089611890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:47:12.299623+0000","modified":"2023-12-20T04:47:14.308466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6957},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6957":{"gid":6957,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/786513656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":786513656},{"type":"v1","addr":"172.21.15.187:6834","nonce":786513656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-20T04:47:20.648 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 38 2023-12-20T04:47:20.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.647+0000 7ff6ea4df640 1 -- 172.21.15.132:0/727401047 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6d006a430 msgr2=0x7ff6d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:20.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.647+0000 7ff6ea4df640 1 --2- 172.21.15.132:0/727401047 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6d006a430 0x7ff6d006c8f0 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7ff6d4000f60 tx=0x7ff6d4009040 comp rx=0 tx=0).stop 2023-12-20T04:47:20.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.647+0000 7ff6ea4df640 1 -- 172.21.15.132:0/727401047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b1630 msgr2=0x7ff6e40c6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:20.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.647+0000 7ff6ea4df640 1 --2- 172.21.15.132:0/727401047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b1630 0x7ff6e40c6ad0 secure :-1 s=READY pgs=1047 cs=0 l=1 rev1=1 crypto rx=0x7ff6d8000c00 tx=0x7ff6d8004730 comp rx=0 tx=0).stop 2023-12-20T04:47:20.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.647+0000 7ff6ea4df640 1 -- 172.21.15.132:0/727401047 shutdown_connections 2023-12-20T04:47:20.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.647+0000 7ff6ea4df640 1 --2- 172.21.15.132:0/727401047 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6d006a430 0x7ff6d006c8f0 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.647+0000 7ff6ea4df640 1 --2- 172.21.15.132:0/727401047 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6e415d120 0x7ff6e40c7f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.647+0000 7ff6ea4df640 1 --2- 172.21.15.132:0/727401047 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6e40b1630 0x7ff6e40c6ad0 unknown :-1 s=CLOSED pgs=1047 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.647+0000 7ff6ea4df640 1 --2- 172.21.15.132:0/727401047 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6e406c720 0x7ff6e41f1ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:20.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.647+0000 7ff6ea4df640 1 -- 172.21.15.132:0/727401047 >> 172.21.15.132:0/727401047 conn(0x7ff6e406a050 msgr2=0x7ff6e40aea00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:20.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.647+0000 7ff6ea4df640 1 -- 172.21.15.132:0/727401047 shutdown_connections 2023-12-20T04:47:20.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:20.647+0000 7ff6ea4df640 1 -- 172.21.15.132:0/727401047 wait complete. 2023-12-20T04:47:21.063 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 38, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-20T04:47:12.299623+0000', 'modified': '2023-12-20T04:47:14.308466+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 6957}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_6957': {'gid': 6957, 'name': 'b', 'rank': 0, 'incarnation': 36, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.187:6834/786513656', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6832', 'nonce': 786513656}, {'type': 'v1', 'addr': '172.21.15.187:6834', 'nonce': 786513656}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [13], 'metadata_pool': 12, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-20T04:47:21.063 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-20T04:47:21.064 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.b status 2023-12-20T04:47:21.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.165+0000 7fd2f8838640 1 Processor -- start 2023-12-20T04:47:21.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.165+0000 7fd2f8838640 1 -- start start 2023-12-20T04:47:21.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.166+0000 7fd2f8838640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2f406bba0 0x7fd2f406f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.166+0000 7fd2f8838640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd2f40ad720 0x7fd2f40ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.166+0000 7fd2f8838640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd2f406c8e0 con 0x7fd2f4159bb0 2023-12-20T04:47:21.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.166+0000 7fd2f8838640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd2f415e420 con 0x7fd2f40ad720 2023-12-20T04:47:21.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.166+0000 7fd2f8838640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f415e700 con 0x7fd2f406bba0 2023-12-20T04:47:21.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.166+0000 7fd2f2d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd2f40ad720 0x7fd2f40ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.166+0000 7fd2f2d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd2f40ad720 0x7fd2f40ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53676/0 (socket says 172.21.15.132:53676) 2023-12-20T04:47:21.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.166+0000 7fd2f2d9d640 1 -- 172.21.15.132:0/1931623488 learned_addr learned my addr 172.21.15.132:0/1931623488 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:21.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.167+0000 7fd2f1d9b640 1 --2- 172.21.15.132:0/1931623488 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2f406bba0 0x7fd2f406f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.167+0000 7fd2f2d9d640 1 -- 172.21.15.132:0/1931623488 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2f406bba0 msgr2=0x7fd2f406f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:21.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.167+0000 7fd2f2d9d640 1 --2- 172.21.15.132:0/1931623488 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2f406bba0 0x7fd2f406f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.167+0000 7fd2f2d9d640 1 -- 172.21.15.132:0/1931623488 >> v1:172.21.15.187:6789/0 conn(0x7fd2f4159bb0 legacy=0x7fd2f406b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:21.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.167+0000 7fd2f2d9d640 1 -- 172.21.15.132:0/1931623488 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2f40c9d10 con 0x7fd2f40ad720 2023-12-20T04:47:21.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.167+0000 7fd2f1d9b640 1 --2- 172.21.15.132:0/1931623488 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2f406bba0 0x7fd2f406f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:21.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.167+0000 7fd2f2d9d640 1 --2- 172.21.15.132:0/1931623488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2f40ad720 0x7fd2f40ca510 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009870 tx=0x7fd2ec02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a83e997daaa6508b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:21.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.167+0000 7fd2f159a640 1 -- 172.21.15.132:0/1931623488 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec031640 con 0x7fd2f40ad720 2023-12-20T04:47:21.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.168+0000 7fd2f159a640 1 -- 172.21.15.132:0/1931623488 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ec0317a0 con 0x7fd2f40ad720 2023-12-20T04:47:21.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.168+0000 7fd2f159a640 1 -- 172.21.15.132:0/1931623488 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec031b30 con 0x7fd2f40ad720 2023-12-20T04:47:21.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.168+0000 7fd2f8838640 1 -- 172.21.15.132:0/1931623488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2f40ad720 msgr2=0x7fd2f40ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:21.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.168+0000 7fd2f8838640 1 --2- 172.21.15.132:0/1931623488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2f40ad720 0x7fd2f40ca510 secure :-1 s=READY pgs=1048 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009870 tx=0x7fd2ec02b8f0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.168+0000 7fd2f8838640 1 -- 172.21.15.132:0/1931623488 shutdown_connections 2023-12-20T04:47:21.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.168+0000 7fd2f8838640 1 --2- 172.21.15.132:0/1931623488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2f40ad720 0x7fd2f40ca510 unknown :-1 s=CLOSED pgs=1048 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.168+0000 7fd2f8838640 1 --2- 172.21.15.132:0/1931623488 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2f406bba0 0x7fd2f406f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.168+0000 7fd2f8838640 1 -- 172.21.15.132:0/1931623488 >> 172.21.15.132:0/1931623488 conn(0x7fd2f406a260 msgr2=0x7fd2f40b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:21.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.168+0000 7fd2f8838640 1 -- 172.21.15.132:0/1931623488 shutdown_connections 2023-12-20T04:47:21.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.168+0000 7fd2f8838640 1 -- 172.21.15.132:0/1931623488 wait complete. 2023-12-20T04:47:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.169+0000 7fd2f8838640 1 Processor -- start 2023-12-20T04:47:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.169+0000 7fd2f8838640 1 -- start start 2023-12-20T04:47:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.170+0000 7fd2f8838640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2f406bba0 0x7fd2f4148120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.170+0000 7fd2f8838640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2f40ad720 0x7fd2f4149f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.170+0000 7fd2f8838640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2f4159bb0 0x7fd2f40c81c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.170+0000 7fd2f8838640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f415a490 con 0x7fd2f4159bb0 2023-12-20T04:47:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.170+0000 7fd2f8838640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f415a770 con 0x7fd2f40ad720 2023-12-20T04:47:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.170+0000 7fd2f8838640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f415aa50 con 0x7fd2f406bba0 2023-12-20T04:47:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.170+0000 7fd2f2d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2f4159bb0 0x7fd2f40c81c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.170+0000 7fd2f2d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2f4159bb0 0x7fd2f40c81c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53692/0 (socket says 172.21.15.132:53692) 2023-12-20T04:47:21.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.170+0000 7fd2f2d9d640 1 -- 172.21.15.132:0/3073606133 learned_addr learned my addr 172.21.15.132:0/3073606133 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:21.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.170+0000 7fd2f259c640 1 --2- 172.21.15.132:0/3073606133 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2f406bba0 0x7fd2f4148120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.170+0000 7fd2f1d9b640 1 --2- 172.21.15.132:0/3073606133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2f40ad720 0x7fd2f4149f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.170+0000 7fd2f2d9d640 1 -- 172.21.15.132:0/3073606133 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2f406bba0 msgr2=0x7fd2f4148120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:21.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.170+0000 7fd2f2d9d640 1 --2- 172.21.15.132:0/3073606133 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2f406bba0 0x7fd2f4148120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.170+0000 7fd2f2d9d640 1 -- 172.21.15.132:0/3073606133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2f40ad720 msgr2=0x7fd2f4149f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:21.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.171+0000 7fd2f2d9d640 1 --2- 172.21.15.132:0/3073606133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2f40ad720 0x7fd2f4149f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.171+0000 7fd2f2d9d640 1 -- 172.21.15.132:0/3073606133 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec0094d0 con 0x7fd2f4159bb0 2023-12-20T04:47:21.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.171+0000 7fd2f2d9d640 1 --2- 172.21.15.132:0/3073606133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2f4159bb0 0x7fd2f40c81c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009870 tx=0x7fd2ec0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:21.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.171+0000 7fd2e2ffd640 1 -- 172.21.15.132:0/3073606133 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec03ac60 con 0x7fd2f4159bb0 2023-12-20T04:47:21.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.171+0000 7fd2e2ffd640 1 -- 172.21.15.132:0/3073606133 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2ec03ade0 con 0x7fd2f4159bb0 2023-12-20T04:47:21.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.171+0000 7fd2f8838640 1 -- 172.21.15.132:0/3073606133 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f415ad30 con 0x7fd2f4159bb0 2023-12-20T04:47:21.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.171+0000 7fd2e2ffd640 1 -- 172.21.15.132:0/3073606133 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec044630 con 0x7fd2f4159bb0 2023-12-20T04:47:21.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.171+0000 7fd2f8838640 1 -- 172.21.15.132:0/3073606133 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f4148660 con 0x7fd2f4159bb0 2023-12-20T04:47:21.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.173+0000 7fd2e2ffd640 1 -- 172.21.15.132:0/3073606133 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd2ec02f050 con 0x7fd2f4159bb0 2023-12-20T04:47:21.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.173+0000 7fd2e2ffd640 1 --2- 172.21.15.132:0/3073606133 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2d406a430 0x7fd2d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.173+0000 7fd2e2ffd640 1 -- 172.21.15.132:0/3073606133 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2ec0aa980 con 0x7fd2f4159bb0 2023-12-20T04:47:21.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.173+0000 7fd2f259c640 1 --2- 172.21.15.132:0/3073606133 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2d406a430 0x7fd2d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.174+0000 7fd2f259c640 1 --2- 172.21.15.132:0/3073606133 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2d406a430 0x7fd2d406c8f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40c7690 tx=0x7fd2e40094d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:21.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.174+0000 7fd2fb3af740 1 Processor -- start 2023-12-20T04:47:21.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.174+0000 7fd2fb3af740 1 -- start start 2023-12-20T04:47:21.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2fb3af740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02390 0x5626cead5520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2fb3af740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02770 0x5626ceb05120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2fb3af740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626cead5a60 0x5626ceb05660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2fb3af740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626cea450b0 con 0x5626ceb02770 2023-12-20T04:47:21.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2fb3af740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626cea42840 con 0x5626ceb02390 2023-12-20T04:47:21.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2fb3af740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626cea3e130 con 0x5626cead5a60 2023-12-20T04:47:21.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2f1d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02770 0x5626ceb05120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2f1d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02770 0x5626ceb05120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53694/0 (socket says 172.21.15.132:53694) 2023-12-20T04:47:21.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2f1d9b640 1 -- 172.21.15.132:0/2691019161 learned_addr learned my addr 172.21.15.132:0/2691019161 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:21.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2f2d9d640 1 --2- 172.21.15.132:0/2691019161 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626cead5a60 0x5626ceb05660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2f259c640 1 --2- 172.21.15.132:0/2691019161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02390 0x5626cead5520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2f1d9b640 1 -- 172.21.15.132:0/2691019161 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626cead5a60 msgr2=0x5626ceb05660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:21.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2f1d9b640 1 --2- 172.21.15.132:0/2691019161 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626cead5a60 0x5626ceb05660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2f1d9b640 1 -- 172.21.15.132:0/2691019161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02390 msgr2=0x5626cead5520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:21.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2f1d9b640 1 --2- 172.21.15.132:0/2691019161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02390 0x5626cead5520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2f1d9b640 1 -- 172.21.15.132:0/2691019161 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626ce9f8c40 con 0x5626ceb02770 2023-12-20T04:47:21.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2f259c640 1 --2- 172.21.15.132:0/2691019161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02390 0x5626cead5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:21.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2f1d9b640 1 --2- 172.21.15.132:0/2691019161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02770 0x5626ceb05120 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800d930 tx=0x7fd2e800ddf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12bfb7ce0679e06e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:21.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.175+0000 7fd2d3fff640 1 -- 172.21.15.132:0/2691019161 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e800fa80 con 0x5626ceb02770 2023-12-20T04:47:21.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.176+0000 7fd2d3fff640 1 -- 172.21.15.132:0/2691019161 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e800c030 con 0x5626ceb02770 2023-12-20T04:47:21.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.176+0000 7fd2d3fff640 1 -- 172.21.15.132:0/2691019161 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e800fde0 con 0x5626ceb02770 2023-12-20T04:47:21.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.176+0000 7fd2fb3af740 1 -- 172.21.15.132:0/2691019161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02770 msgr2=0x5626ceb05120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:21.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.176+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/2691019161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02770 0x5626ceb05120 secure :-1 s=READY pgs=1050 cs=0 l=1 rev1=1 crypto rx=0x7fd2e800d930 tx=0x7fd2e800ddf0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.176+0000 7fd2fb3af740 1 -- 172.21.15.132:0/2691019161 shutdown_connections 2023-12-20T04:47:21.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.176+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/2691019161 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626cead5a60 0x5626ceb05660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.176+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/2691019161 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02770 0x5626ceb05120 unknown :-1 s=CLOSED pgs=1050 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.176+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/2691019161 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02390 0x5626cead5520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.176+0000 7fd2fb3af740 1 -- 172.21.15.132:0/2691019161 >> 172.21.15.132:0/2691019161 conn(0x5626cead7830 msgr2=0x5626ceb20120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:21.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.176+0000 7fd2fb3af740 1 -- 172.21.15.132:0/2691019161 shutdown_connections 2023-12-20T04:47:21.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.176+0000 7fd2fb3af740 1 -- 172.21.15.132:0/2691019161 wait complete. 2023-12-20T04:47:21.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.177+0000 7fd2fb3af740 1 -- start start 2023-12-20T04:47:21.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.177+0000 7fd2fb3af740 1 Processor -- start 2023-12-20T04:47:21.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2fb3af740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626ceb02390 0x5626ceb19cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2fb3af740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02770 0x5626ceb23fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2fb3af740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb17490 0x5626ceb07160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2fb3af740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ce9fc840 con 0x5626ceb02770 2023-12-20T04:47:21.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2fb3af740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ce9fc4e0 con 0x5626ceb17490 2023-12-20T04:47:21.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2fb3af740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626ce9c2230 con 0x5626ceb02390 2023-12-20T04:47:21.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2fb3af740 10 client.0 _ll_register_callbacks cb 0x5626cea136d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:47:21.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2f1d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02770 0x5626ceb23fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2f1d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02770 0x5626ceb23fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53710/0 (socket says 172.21.15.132:53710) 2023-12-20T04:47:21.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2f1d9b640 1 -- 172.21.15.132:0/4109418330 learned_addr learned my addr 172.21.15.132:0/4109418330 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:21.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2f2d9d640 1 --2- 172.21.15.132:0/4109418330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb17490 0x5626ceb07160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2f259c640 1 --2- 172.21.15.132:0/4109418330 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626ceb02390 0x5626ceb19cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2f1d9b640 1 -- 172.21.15.132:0/4109418330 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626ceb02390 msgr2=0x5626ceb19cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:21.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2f1d9b640 1 --2- 172.21.15.132:0/4109418330 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626ceb02390 0x5626ceb19cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2f1d9b640 1 -- 172.21.15.132:0/4109418330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb17490 msgr2=0x5626ceb07160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:21.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2f1d9b640 1 --2- 172.21.15.132:0/4109418330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb17490 0x5626ceb07160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2f1d9b640 1 -- 172.21.15.132:0/4109418330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e800e040 con 0x5626ceb02770 2023-12-20T04:47:21.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2f1d9b640 1 --2- 172.21.15.132:0/4109418330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02770 0x5626ceb23fd0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8008010 tx=0x7fd2e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=913f638cec464e4a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:21.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:47:21.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2d17fa640 1 -- 172.21.15.132:0/4109418330 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e8022070 con 0x5626ceb02770 2023-12-20T04:47:21.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2d17fa640 1 -- 172.21.15.132:0/4109418330 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2e80044f0 con 0x5626ceb02770 2023-12-20T04:47:21.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.178+0000 7fd2fb3af740 1 -- 172.21.15.132:0/4109418330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x5626cea67970 con 0x5626ceb02770 2023-12-20T04:47:21.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.179+0000 7fd2d17fa640 1 -- 172.21.15.132:0/4109418330 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2e800fdc0 con 0x5626ceb02770 2023-12-20T04:47:21.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.179+0000 7fd2fb3af740 10 client.7113 fetch_fsmap learned FSMap version 38 2023-12-20T04:47:21.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.179+0000 7fd2fb3af740 1 -- 172.21.15.132:0/4109418330 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x5626cea3c7b0 con 0x5626ceb02770 2023-12-20T04:47:21.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.179+0000 7fd2d17fa640 1 -- 172.21.15.132:0/4109418330 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x5626cea67970 con 0x5626ceb02770 2023-12-20T04:47:21.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.179+0000 7fd2d17fa640 1 -- 172.21.15.132:0/4109418330 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 38) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd2e8005990 con 0x5626ceb02770 2023-12-20T04:47:21.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.179+0000 7fd2fb3af740 10 client.7113 fetch_fsmap finished waiting for FSMap version 38 2023-12-20T04:47:21.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.179+0000 7fd2fb3af740 10 client.7113 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-20T04:47:21.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.179+0000 7fd2fb3af740 20 client.7113 populate_metadata read hostname 'smithi132' 2023-12-20T04:47:21.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.179+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/4109418330 >> [v2:172.21.15.187:6832/786513656,v1:172.21.15.187:6834/786513656] conn(0x5626ceb33790 0x5626ceb1bc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.179+0000 7fd2fb3af740 4 client.7113 mds_command: new command op to 6957 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-20T04:47:21.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.179+0000 7fd2fb3af740 1 -- 172.21.15.132:0/4109418330 --> [v2:172.21.15.187:6832/786513656,v1:172.21.15.187:6834/786513656] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x5626cea2ff00 con 0x5626ceb33790 2023-12-20T04:47:21.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.179+0000 7fd2f259c640 1 --2- 172.21.15.132:0/4109418330 >> [v2:172.21.15.187:6832/786513656,v1:172.21.15.187:6834/786513656] conn(0x5626ceb33790 0x5626ceb1bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.180+0000 7fd2d17fa640 10 client.7113 ms_handle_connect on v2:172.21.15.187:6832/786513656 2023-12-20T04:47:21.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.180+0000 7fd2f259c640 1 --2- 172.21.15.132:0/4109418330 >> [v2:172.21.15.187:6832/786513656,v1:172.21.15.187:6834/786513656] conn(0x5626ceb33790 0x5626ceb1bc40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3b8b402578147bb7 server_cookie=71b5548328ab33bf in_seq=0 out_seq=0 2023-12-20T04:47:21.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.180+0000 7fd2d17fa640 1 -- 172.21.15.132:0/4109418330 <== mds.0 v2:172.21.15.187:6832/786513656 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x5626cea2ff00 con 0x5626ceb33790 2023-12-20T04:47:21.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.180+0000 7fd2d17fa640 10 client.7113 handle_command_reply: tid=0 2023-12-20T04:47:21.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.180+0000 7fd2fb3af740 1 client.7113 shutdown 2023-12-20T04:47:21.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.181+0000 7fd2fb3af740 1 -- 172.21.15.132:0/4109418330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02770 msgr2=0x5626ceb23fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:21.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.181+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/4109418330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02770 0x5626ceb23fd0 secure :-1 s=READY pgs=1051 cs=0 l=1 rev1=1 crypto rx=0x7fd2e8008010 tx=0x7fd2e8004730 comp rx=0 tx=0).stop 2023-12-20T04:47:21.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.181+0000 7fd2fb3af740 1 -- 172.21.15.132:0/4109418330 shutdown_connections 2023-12-20T04:47:21.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.181+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/4109418330 >> [v2:172.21.15.187:6832/786513656,v1:172.21.15.187:6834/786513656] conn(0x5626ceb33790 0x5626ceb1bc40 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.181+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/4109418330 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb17490 0x5626ceb07160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.181+0000 7fd2d17fa640 0 client.7113 ms_handle_reset on v2:172.21.15.187:6832/786513656 2023-12-20T04:47:21.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.181+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/4109418330 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02770 0x5626ceb23fd0 unknown :-1 s=CLOSED pgs=1051 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.181+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/4109418330 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626ceb02390 0x5626ceb19cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.181+0000 7fd2fb3af740 1 -- 172.21.15.132:0/4109418330 >> 172.21.15.132:0/4109418330 conn(0x5626cead5a60 msgr2=0x5626cead9370 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:21.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.181+0000 7fd2fb3af740 1 -- 172.21.15.132:0/4109418330 shutdown_connections 2023-12-20T04:47:21.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.181+0000 7fd2fb3af740 1 -- 172.21.15.132:0/4109418330 wait complete. 2023-12-20T04:47:21.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.181+0000 7fd2fb3af740 20 client.7113 trim_cache size 0 max 16384 2023-12-20T04:47:21.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.196+0000 7fd2fb3af740 1 Processor -- start 2023-12-20T04:47:21.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.196+0000 7fd2fb3af740 1 -- start start 2023-12-20T04:47:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.196+0000 7fd2fb3af740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02390 0x5626ceb083d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.196+0000 7fd2fb3af740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02770 0x5626ceb07a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.196+0000 7fd2fb3af740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626ceb17490 0x5626ceb7fb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.196+0000 7fd2fb3af740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626cead6180 con 0x5626ceb02390 2023-12-20T04:47:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.196+0000 7fd2fb3af740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ceaf8530 con 0x5626ceb02770 2023-12-20T04:47:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.196+0000 7fd2fb3af740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626ceb08ba0 con 0x5626ceb17490 2023-12-20T04:47:21.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.197+0000 7fd2f259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02390 0x5626ceb083d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.197+0000 7fd2f259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02390 0x5626ceb083d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53722/0 (socket says 172.21.15.132:53722) 2023-12-20T04:47:21.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.197+0000 7fd2f259c640 1 -- 172.21.15.132:0/2639220479 learned_addr learned my addr 172.21.15.132:0/2639220479 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:21.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.197+0000 7fd2f1d9b640 1 --2- 172.21.15.132:0/2639220479 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02770 0x5626ceb07a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.197+0000 7fd2f259c640 1 -- 172.21.15.132:0/2639220479 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626ceb17490 msgr2=0x5626ceb7fb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:21.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.197+0000 7fd2f2d9d640 1 --2- 172.21.15.132:0/2639220479 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626ceb17490 0x5626ceb7fb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.197+0000 7fd2f259c640 1 --2- 172.21.15.132:0/2639220479 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626ceb17490 0x5626ceb7fb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.197+0000 7fd2f259c640 1 -- 172.21.15.132:0/2639220479 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02770 msgr2=0x5626ceb07a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:21.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.197+0000 7fd2f259c640 1 --2- 172.21.15.132:0/2639220479 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02770 0x5626ceb07a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.197+0000 7fd2f259c640 1 -- 172.21.15.132:0/2639220479 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x5626ce9debe0 con 0x5626ceb02390 2023-12-20T04:47:21.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.197+0000 7fd2f1d9b640 1 --2- 172.21.15.132:0/2639220479 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02770 0x5626ceb07a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:21.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.197+0000 7fd2f2d9d640 1 --2- 172.21.15.132:0/2639220479 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626ceb17490 0x5626ceb7fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:21.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.197+0000 7fd2f259c640 1 --2- 172.21.15.132:0/2639220479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02390 0x5626ceb083d0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400cfd0 tx=0x7fd2e4015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd5b8d62d5d3fb2a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:21.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.197+0000 7fd2e0ff9640 1 -- 172.21.15.132:0/2639220479 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e401c040 con 0x5626ceb02390 2023-12-20T04:47:21.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.197+0000 7fd2e0ff9640 1 -- 172.21.15.132:0/2639220479 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e401d040 con 0x5626ceb02390 2023-12-20T04:47:21.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.197+0000 7fd2e0ff9640 1 -- 172.21.15.132:0/2639220479 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4011070 con 0x5626ceb02390 2023-12-20T04:47:21.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.198+0000 7fd2fb3af740 1 -- 172.21.15.132:0/2639220479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02390 msgr2=0x5626ceb083d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:21.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.198+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/2639220479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02390 0x5626ceb083d0 secure :-1 s=READY pgs=1052 cs=0 l=1 rev1=1 crypto rx=0x7fd2e400cfd0 tx=0x7fd2e4015000 comp rx=0 tx=0).stop 2023-12-20T04:47:21.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.198+0000 7fd2fb3af740 1 -- 172.21.15.132:0/2639220479 shutdown_connections 2023-12-20T04:47:21.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.198+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/2639220479 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626ceb17490 0x5626ceb7fb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.198+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/2639220479 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02770 0x5626ceb07a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.198+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/2639220479 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02390 0x5626ceb083d0 unknown :-1 s=CLOSED pgs=1052 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.198+0000 7fd2fb3af740 1 -- 172.21.15.132:0/2639220479 >> 172.21.15.132:0/2639220479 conn(0x5626cead5a60 msgr2=0x5626cead0880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:21.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.198+0000 7fd2fb3af740 1 -- 172.21.15.132:0/2639220479 shutdown_connections 2023-12-20T04:47:21.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.198+0000 7fd2fb3af740 1 -- 172.21.15.132:0/2639220479 wait complete. 2023-12-20T04:47:21.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.198+0000 7fd2fb3af740 1 -- start start 2023-12-20T04:47:21.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.198+0000 7fd2fb3af740 1 Processor -- start 2023-12-20T04:47:21.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.199+0000 7fd2fb3af740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02390 0x5626ceb7e8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.199+0000 7fd2fb3af740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02770 0x5626ceb1f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.199+0000 7fd2fb3af740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626ceb17490 0x5626ceb21b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.199+0000 7fd2fb3af740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ceb06ac0 con 0x5626ceb02390 2023-12-20T04:47:21.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.199+0000 7fd2fb3af740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x5626ceb1f970 con 0x5626ceb02770 2023-12-20T04:47:21.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.199+0000 7fd2fb3af740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x5626ceb216d0 con 0x5626ceb17490 2023-12-20T04:47:21.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.199+0000 7fd2fb3af740 10 client.0 _ll_register_callbacks cb 0x7fd2e800d280 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:47:21.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.199+0000 7fd2f259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02390 0x5626ceb7e8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.199+0000 7fd2f259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02390 0x5626ceb7e8d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53732/0 (socket says 172.21.15.132:53732) 2023-12-20T04:47:21.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.199+0000 7fd2f259c640 1 -- 172.21.15.132:0/1413070784 learned_addr learned my addr 172.21.15.132:0/1413070784 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:21.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.199+0000 7fd2f2d9d640 1 --2- 172.21.15.132:0/1413070784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626ceb17490 0x5626ceb21b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.199+0000 7fd2f1d9b640 1 --2- 172.21.15.132:0/1413070784 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02770 0x5626ceb1f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.199+0000 7fd2f259c640 1 -- 172.21.15.132:0/1413070784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626ceb17490 msgr2=0x5626ceb21b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:21.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.199+0000 7fd2f259c640 1 --2- 172.21.15.132:0/1413070784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626ceb17490 0x5626ceb21b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.199+0000 7fd2f259c640 1 -- 172.21.15.132:0/1413070784 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02770 msgr2=0x5626ceb1f250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:21.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.199+0000 7fd2f259c640 1 --2- 172.21.15.132:0/1413070784 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02770 0x5626ceb1f250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.199+0000 7fd2f259c640 1 -- 172.21.15.132:0/1413070784 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2e4026880 con 0x5626ceb02390 2023-12-20T04:47:21.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2f1d9b640 1 --2- 172.21.15.132:0/1413070784 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02770 0x5626ceb1f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:21.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2f259c640 1 --2- 172.21.15.132:0/1413070784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02390 0x5626ceb7e8d0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4009830 tx=0x7fd2e4004a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d1c8f4507921875 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:21.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2d17fa640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:47:21.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2d17fa640 1 -- 172.21.15.132:0/1413070784 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd2e4017b80 con 0x5626ceb02390 2023-12-20T04:47:21.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2d17fa640 1 -- 172.21.15.132:0/1413070784 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd2e4017ce0 con 0x5626ceb02390 2023-12-20T04:47:21.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2fb3af740 1 -- 172.21.15.132:0/1413070784 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fd2e800c030 con 0x5626ceb02390 2023-12-20T04:47:21.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2d17fa640 1 -- 172.21.15.132:0/1413070784 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fd2e4017ea0 con 0x5626ceb02390 2023-12-20T04:47:21.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2fb3af740 10 client.7119 fetch_fsmap learned FSMap version 38 2023-12-20T04:47:21.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2fb3af740 1 -- 172.21.15.132:0/1413070784 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=38,monmap=2+}) v3 -- 0x5626cea042f0 con 0x5626ceb02390 2023-12-20T04:47:21.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2d17fa640 1 -- 172.21.15.132:0/1413070784 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd2e800c030 con 0x5626ceb02390 2023-12-20T04:47:21.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2d17fa640 1 -- 172.21.15.132:0/1413070784 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 38) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fd2e4032450 con 0x5626ceb02390 2023-12-20T04:47:21.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2fb3af740 10 client.7119 fetch_fsmap finished waiting for FSMap version 38 2023-12-20T04:47:21.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2fb3af740 10 client.7119 resolve_mds: resolved name 'b' to daemon mds.b 2023-12-20T04:47:21.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2fb3af740 20 client.7119 populate_metadata read hostname 'smithi132' 2023-12-20T04:47:21.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/1413070784 >> [v2:172.21.15.187:6832/786513656,v1:172.21.15.187:6834/786513656] conn(0x5626ceb04e40 0x5626ceb05220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2fb3af740 4 client.7119 mds_command: new command op to 6957 tid=0[{"prefix": "status"}] 2023-12-20T04:47:21.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2fb3af740 1 -- 172.21.15.132:0/1413070784 --> [v2:172.21.15.187:6832/786513656,v1:172.21.15.187:6834/786513656] -- command(tid 0: {"prefix": "status"}) v1 -- 0x5626cea371b0 con 0x5626ceb04e40 2023-12-20T04:47:21.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.200+0000 7fd2f1d9b640 1 --2- 172.21.15.132:0/1413070784 >> [v2:172.21.15.187:6832/786513656,v1:172.21.15.187:6834/786513656] conn(0x5626ceb04e40 0x5626ceb05220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.201+0000 7fd2d17fa640 10 client.7119 ms_handle_connect on v2:172.21.15.187:6832/786513656 2023-12-20T04:47:21.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.201+0000 7fd2f1d9b640 1 --2- 172.21.15.132:0/1413070784 >> [v2:172.21.15.187:6832/786513656,v1:172.21.15.187:6834/786513656] conn(0x5626ceb04e40 0x5626ceb05220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ffabf2e5e503c0e0 server_cookie=c8d801531721397f in_seq=0 out_seq=0 2023-12-20T04:47:21.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.201+0000 7fd2d17fa640 1 -- 172.21.15.132:0/1413070784 <== mds.0 v2:172.21.15.187:6832/786513656 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+327 (crc 0 0 0) 0x5626cea371b0 con 0x5626ceb04e40 2023-12-20T04:47:21.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.201+0000 7fd2d17fa640 10 client.7119 handle_command_reply: tid=0 2023-12-20T04:47:21.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.201+0000 7fd2fb3af740 1 client.7119 shutdown 2023-12-20T04:47:21.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.201+0000 7fd2fb3af740 1 -- 172.21.15.132:0/1413070784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02390 msgr2=0x5626ceb7e8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:21.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.201+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/1413070784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02390 0x5626ceb7e8d0 secure :-1 s=READY pgs=1053 cs=0 l=1 rev1=1 crypto rx=0x7fd2e4009830 tx=0x7fd2e4004a00 comp rx=0 tx=0).stop 2023-12-20T04:47:21.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.201+0000 7fd2fb3af740 1 -- 172.21.15.132:0/1413070784 shutdown_connections 2023-12-20T04:47:21.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.201+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/1413070784 >> [v2:172.21.15.187:6832/786513656,v1:172.21.15.187:6834/786513656] conn(0x5626ceb04e40 0x5626ceb05220 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.201+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/1413070784 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x5626ceb17490 0x5626ceb21b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.201+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/1413070784 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x5626ceb02770 0x5626ceb1f250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.201+0000 7fd2d17fa640 0 client.7119 ms_handle_reset on v2:172.21.15.187:6832/786513656 2023-12-20T04:47:21.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.201+0000 7fd2fb3af740 1 --2- 172.21.15.132:0/1413070784 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x5626ceb02390 0x5626ceb7e8d0 unknown :-1 s=CLOSED pgs=1053 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.201+0000 7fd2fb3af740 1 -- 172.21.15.132:0/1413070784 >> 172.21.15.132:0/1413070784 conn(0x5626cead5a60 msgr2=0x5626cead0880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:21.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.201+0000 7fd2fb3af740 1 -- 172.21.15.132:0/1413070784 shutdown_connections 2023-12-20T04:47:21.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.201+0000 7fd2fb3af740 1 -- 172.21.15.132:0/1413070784 wait complete. 2023-12-20T04:47:21.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.201+0000 7fd2fb3af740 20 client.7119 trim_cache size 0 max 16384 2023-12-20T04:47:21.216 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:47:21.216 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:47:21.216 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-12-20T04:47:21.216 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 6957, 2023-12-20T04:47:21.216 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-12-20T04:47:21.216 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-12-20T04:47:21.216 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-12-20T04:47:21.216 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 8.8991009349999999, 2023-12-20T04:47:21.216 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 38, 2023-12-20T04:47:21.216 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 101, 2023-12-20T04:47:21.217 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 101, 2023-12-20T04:47:21.217 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 13.162896518 2023-12-20T04:47:21.217 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:47:21.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.202+0000 7fd2f8838640 1 -- 172.21.15.132:0/3073606133 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2d406a430 msgr2=0x7fd2d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:21.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.202+0000 7fd2f8838640 1 --2- 172.21.15.132:0/3073606133 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2d406a430 0x7fd2d406c8f0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7fd2f40c7690 tx=0x7fd2e40094d0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.202+0000 7fd2f8838640 1 -- 172.21.15.132:0/3073606133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2f4159bb0 msgr2=0x7fd2f40c81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:21.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.202+0000 7fd2f8838640 1 --2- 172.21.15.132:0/3073606133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2f4159bb0 0x7fd2f40c81c0 secure :-1 s=READY pgs=1049 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec009870 tx=0x7fd2ec0046c0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.202+0000 7fd2f8838640 1 -- 172.21.15.132:0/3073606133 shutdown_connections 2023-12-20T04:47:21.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.202+0000 7fd2f8838640 1 --2- 172.21.15.132:0/3073606133 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd2d406a430 0x7fd2d406c8f0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.202+0000 7fd2f8838640 1 --2- 172.21.15.132:0/3073606133 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd2f4159bb0 0x7fd2f40c81c0 unknown :-1 s=CLOSED pgs=1049 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.202+0000 7fd2f8838640 1 --2- 172.21.15.132:0/3073606133 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd2f40ad720 0x7fd2f4149f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.202+0000 7fd2f8838640 1 --2- 172.21.15.132:0/3073606133 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd2f406bba0 0x7fd2f4148120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.202+0000 7fd2f8838640 1 -- 172.21.15.132:0/3073606133 >> 172.21.15.132:0/3073606133 conn(0x7fd2f406a260 msgr2=0x7fd2f40adb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:21.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.202+0000 7fd2f8838640 1 -- 172.21.15.132:0/3073606133 shutdown_connections 2023-12-20T04:47:21.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.202+0000 7fd2f8838640 1 -- 172.21.15.132:0/3073606133 wait complete. 2023-12-20T04:47:21.221 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:47:21.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.319+0000 7f3f18955640 1 Processor -- start 2023-12-20T04:47:21.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.319+0000 7f3f18955640 1 -- start start 2023-12-20T04:47:21.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f18955640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3f140cdc10 0x7f3f1406c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f18955640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f141613c0 con 0x7f3f1415d100 2023-12-20T04:47:21.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f18955640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f140d1b00 con 0x7f3f140d0370 2023-12-20T04:47:21.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f18955640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f1406cde0 con 0x7f3f140cdc10 2023-12-20T04:47:21.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f1259c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3f1415d100 0x7f3f140cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53024/0 (socket says 172.21.15.132:53024) 2023-12-20T04:47:21.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f1259c640 1 -- 172.21.15.132:0/304998486 learned_addr learned my addr 172.21.15.132:0/304998486 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:21.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f11d9b640 1 -- 172.21.15.132:0/304998486 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 651419157 0 0) 0x7f3f141613c0 con 0x7f3f1415d100 2023-12-20T04:47:21.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f11d9b640 1 -- 172.21.15.132:0/304998486 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3f00003520 con 0x7f3f1415d100 2023-12-20T04:47:21.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f12d9d640 1 --2- 172.21.15.132:0/304998486 >> v2:172.21.15.187:3300/0 conn(0x7f3f140cdc10 0x7f3f1406c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f11d9b640 1 -- 172.21.15.132:0/304998486 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 243064272 0 0) 0x7f3f00003520 con 0x7f3f1415d100 2023-12-20T04:47:21.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f11d9b640 1 -- 172.21.15.132:0/304998486 >> v2:172.21.15.187:3300/0 conn(0x7f3f140cdc10 msgr2=0x7f3f1406c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:21.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f11d9b640 1 --2- 172.21.15.132:0/304998486 >> v2:172.21.15.187:3300/0 conn(0x7f3f140cdc10 0x7f3f1406c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f11d9b640 1 -- 172.21.15.132:0/304998486 >> v1:172.21.15.187:6789/0 conn(0x7f3f140d0370 legacy=0x7f3f1406c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:21.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f11d9b640 1 -- 172.21.15.132:0/304998486 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f140d0810 con 0x7f3f1415d100 2023-12-20T04:47:21.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f11d9b640 1 -- 172.21.15.132:0/304998486 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f3f04001670 con 0x7f3f1415d100 2023-12-20T04:47:21.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f11d9b640 1 -- 172.21.15.132:0/304998486 >> v1:172.21.15.132:6789/0 conn(0x7f3f1415d100 legacy=0x7f3f140cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:21.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f11d9b640 1 --2- 172.21.15.132:0/304998486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f00003970 0x7f3f00003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f11d9b640 1 --2- 172.21.15.132:0/304998486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f000047c0 0x7f3f00004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f11d9b640 1 --2- 172.21.15.132:0/304998486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f00005180 0x7f3f0000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.320+0000 7f3f11d9b640 1 -- 172.21.15.132:0/304998486 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f1406cde0 con 0x7f3f00003970 2023-12-20T04:47:21.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.321+0000 7f3f11d9b640 1 -- 172.21.15.132:0/304998486 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0000c020 con 0x7f3f00005180 2023-12-20T04:47:21.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.321+0000 7f3f11d9b640 1 -- 172.21.15.132:0/304998486 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f0000c1e0 con 0x7f3f000047c0 2023-12-20T04:47:21.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.321+0000 7f3f1259c640 1 --2- 172.21.15.132:0/304998486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f00003970 0x7f3f00003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.321+0000 7f3f12d9d640 1 --2- 172.21.15.132:0/304998486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f00005180 0x7f3f0000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.321+0000 7f3f0bfff640 1 --2- 172.21.15.132:0/304998486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f000047c0 0x7f3f00004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.321+0000 7f3f1259c640 1 -- 172.21.15.132:0/304998486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f000047c0 msgr2=0x7f3f00004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:21.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.321+0000 7f3f1259c640 1 --2- 172.21.15.132:0/304998486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f000047c0 0x7f3f00004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.321+0000 7f3f1259c640 1 -- 172.21.15.132:0/304998486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f00005180 msgr2=0x7f3f0000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:21.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.321+0000 7f3f1259c640 1 --2- 172.21.15.132:0/304998486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f00005180 0x7f3f0000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.321+0000 7f3f1259c640 1 -- 172.21.15.132:0/304998486 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f00003520 con 0x7f3f00003970 2023-12-20T04:47:21.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.321+0000 7f3f12d9d640 1 -- 172.21.15.132:0/304998486 reap_dead start 2023-12-20T04:47:21.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.322+0000 7f3f1259c640 1 --2- 172.21.15.132:0/304998486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f00003970 0x7f3f00003d90 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400c240 tx=0x7f3f000057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1fc79c95d4d4679c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:21.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.322+0000 7f3f11d9b640 1 -- 172.21.15.132:0/304998486 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f04005ad0 con 0x7f3f00003970 2023-12-20T04:47:21.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.322+0000 7f3f11d9b640 1 -- 172.21.15.132:0/304998486 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f04005c30 con 0x7f3f00003970 2023-12-20T04:47:21.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.322+0000 7f3f11d9b640 1 -- 172.21.15.132:0/304998486 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f0402ca90 con 0x7f3f00003970 2023-12-20T04:47:21.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.322+0000 7f3f18955640 1 -- 172.21.15.132:0/304998486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f00003970 msgr2=0x7f3f00003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:21.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.322+0000 7f3f18955640 1 --2- 172.21.15.132:0/304998486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f00003970 0x7f3f00003d90 secure :-1 s=READY pgs=1055 cs=0 l=1 rev1=1 crypto rx=0x7f3f0400c240 tx=0x7f3f000057f0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.322+0000 7f3f18955640 1 -- 172.21.15.132:0/304998486 shutdown_connections 2023-12-20T04:47:21.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.322+0000 7f3f18955640 1 --2- 172.21.15.132:0/304998486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f00003970 0x7f3f00003d90 unknown :-1 s=CLOSED pgs=1055 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.322+0000 7f3f18955640 1 -- 172.21.15.132:0/304998486 >> 172.21.15.132:0/304998486 conn(0x7f3f1406d7c0 msgr2=0x7f3f1406dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:21.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.322+0000 7f3f18955640 1 -- 172.21.15.132:0/304998486 shutdown_connections 2023-12-20T04:47:21.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.322+0000 7f3f18955640 1 -- 172.21.15.132:0/304998486 wait complete. 2023-12-20T04:47:21.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.324+0000 7f3f18955640 1 Processor -- start 2023-12-20T04:47:21.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.324+0000 7f3f18955640 1 -- start start 2023-12-20T04:47:21.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.324+0000 7f3f18955640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f00003970 0x7f3f14155440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.324+0000 7f3f18955640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140ac8e0 0x7f3f141f23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.324+0000 7f3f18955640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f14154f10 0x7f3f140b5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.324+0000 7f3f18955640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f141f2910 con 0x7f3f140ac8e0 2023-12-20T04:47:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.324+0000 7f3f18955640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f140b4a00 con 0x7f3f14154f10 2023-12-20T04:47:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.324+0000 7f3f18955640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f140b4ce0 con 0x7f3f00003970 2023-12-20T04:47:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.324+0000 7f3f0bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140ac8e0 0x7f3f141f23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.324+0000 7f3f0bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140ac8e0 0x7f3f141f23d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53760/0 (socket says 172.21.15.132:53760) 2023-12-20T04:47:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.324+0000 7f3f0bfff640 1 -- 172.21.15.132:0/3708648665 learned_addr learned my addr 172.21.15.132:0/3708648665 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.325+0000 7f3f12d9d640 1 --2- 172.21.15.132:0/3708648665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f14154f10 0x7f3f140b5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.325+0000 7f3f1259c640 1 --2- 172.21.15.132:0/3708648665 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f00003970 0x7f3f14155440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.325+0000 7f3f0bfff640 1 -- 172.21.15.132:0/3708648665 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f00003970 msgr2=0x7f3f14155440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.325+0000 7f3f0bfff640 1 --2- 172.21.15.132:0/3708648665 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f00003970 0x7f3f14155440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.325+0000 7f3f0bfff640 1 -- 172.21.15.132:0/3708648665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f14154f10 msgr2=0x7f3f140b5aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.325+0000 7f3f0bfff640 1 --2- 172.21.15.132:0/3708648665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f14154f10 0x7f3f140b5aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.325+0000 7f3f0bfff640 1 -- 172.21.15.132:0/3708648665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f140b4fc0 con 0x7f3f140ac8e0 2023-12-20T04:47:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.325+0000 7f3f1259c640 1 --2- 172.21.15.132:0/3708648665 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f00003970 0x7f3f14155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:21.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.325+0000 7f3f0bfff640 1 --2- 172.21.15.132:0/3708648665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140ac8e0 0x7f3f141f23d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00e480 tx=0x7f3efc00e940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:21.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.325+0000 7f3f0affd640 1 -- 172.21.15.132:0/3708648665 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc0052e0 con 0x7f3f140ac8e0 2023-12-20T04:47:21.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.325+0000 7f3f0affd640 1 -- 172.21.15.132:0/3708648665 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3efc005440 con 0x7f3f140ac8e0 2023-12-20T04:47:21.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.325+0000 7f3f0affd640 1 -- 172.21.15.132:0/3708648665 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3efc003830 con 0x7f3f140ac8e0 2023-12-20T04:47:21.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.325+0000 7f3f18955640 1 -- 172.21.15.132:0/3708648665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f140b52a0 con 0x7f3f140ac8e0 2023-12-20T04:47:21.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.325+0000 7f3f18955640 1 -- 172.21.15.132:0/3708648665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f140b46b0 con 0x7f3f140ac8e0 2023-12-20T04:47:21.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.326+0000 7f3f18955640 1 -- 172.21.15.132:0/3708648665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f1404e840 con 0x7f3f140ac8e0 2023-12-20T04:47:21.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.326+0000 7f3f0affd640 1 -- 172.21.15.132:0/3708648665 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3efc003990 con 0x7f3f140ac8e0 2023-12-20T04:47:21.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.327+0000 7f3f0affd640 1 --2- 172.21.15.132:0/3708648665 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ef406a460 0x7f3ef406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:21.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.327+0000 7f3f1259c640 1 --2- 172.21.15.132:0/3708648665 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ef406a460 0x7f3ef406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:21.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.327+0000 7f3f0affd640 1 -- 172.21.15.132:0/3708648665 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3efc088610 con 0x7f3f140ac8e0 2023-12-20T04:47:21.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.327+0000 7f3f1259c640 1 --2- 172.21.15.132:0/3708648665 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ef406a460 0x7f3ef406c920 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3f04034000 tx=0x7f3f04009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:21.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.331+0000 7f3f0affd640 1 -- 172.21.15.132:0/3708648665 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3efc053c90 con 0x7f3f140ac8e0 2023-12-20T04:47:21.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.531+0000 7f3f18955640 1 -- 172.21.15.132:0/3708648665 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f3f140b37d0 con 0x7f3f140ac8e0 2023-12-20T04:47:21.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.532+0000 7f3f0affd640 1 -- 172.21.15.132:0/3708648665 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+73 (secure 0 0 0) 0x7f3efc0572b0 con 0x7f3f140ac8e0 2023-12-20T04:47:21.534 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:47:21.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.533+0000 7f3f18955640 1 -- 172.21.15.132:0/3708648665 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ef406a460 msgr2=0x7f3ef406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:21.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.533+0000 7f3f18955640 1 --2- 172.21.15.132:0/3708648665 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ef406a460 0x7f3ef406c920 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f3f04034000 tx=0x7f3f04009030 comp rx=0 tx=0).stop 2023-12-20T04:47:21.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.533+0000 7f3f18955640 1 -- 172.21.15.132:0/3708648665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140ac8e0 msgr2=0x7f3f141f23d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:21.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.533+0000 7f3f18955640 1 --2- 172.21.15.132:0/3708648665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140ac8e0 0x7f3f141f23d0 secure :-1 s=READY pgs=1056 cs=0 l=1 rev1=1 crypto rx=0x7f3efc00e480 tx=0x7f3efc00e940 comp rx=0 tx=0).stop 2023-12-20T04:47:21.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.533+0000 7f3f18955640 1 -- 172.21.15.132:0/3708648665 shutdown_connections 2023-12-20T04:47:21.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.533+0000 7f3f18955640 1 --2- 172.21.15.132:0/3708648665 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ef406a460 0x7f3ef406c920 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.533+0000 7f3f18955640 1 --2- 172.21.15.132:0/3708648665 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f14154f10 0x7f3f140b5aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.533+0000 7f3f18955640 1 --2- 172.21.15.132:0/3708648665 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f140ac8e0 0x7f3f141f23d0 unknown :-1 s=CLOSED pgs=1056 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.533+0000 7f3f18955640 1 --2- 172.21.15.132:0/3708648665 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f00003970 0x7f3f14155440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:21.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.533+0000 7f3f18955640 1 -- 172.21.15.132:0/3708648665 >> 172.21.15.132:0/3708648665 conn(0x7f3f1406d7c0 msgr2=0x7f3f1415b4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:21.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.533+0000 7f3f18955640 1 -- 172.21.15.132:0/3708648665 shutdown_connections 2023-12-20T04:47:21.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:21.534+0000 7f3f18955640 1 -- 172.21.15.132:0/3708648665 wait complete. 2023-12-20T04:47:21.546 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:47:21.546 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:47:21.546 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-12-20T04:47:21.546 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-20T04:47:21.546 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-20T04:47:21.547 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:47:21.547 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:47:21.547 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:47:21.547 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:47:21.547 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:21.547 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-12-20T04:47:21.562 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:47:21.562 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:47:21.562 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:47:21.563 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:47:21.563 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-20T04:47:21.563 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:47:21.563 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:47:21.563 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:47:21.563 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-12-20T04:47:21.563 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:47:21.563 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-12-20T04:47:21.563 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-12-20T04:47:21.563 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:47:21.563 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-12-20T04:47:21.564 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:47:21.564 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-12-20T04:47:21.564 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:47:21.564 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42432sec preferred_lft 42432sec 2023-12-20T04:47:21.564 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-12-20T04:47:21.564 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:47:21.564 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:47:21.564 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:47:21.564 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:47:21.564 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:47:21.565 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::60dd:37ff:fe28:558b/64 scope link 2023-12-20T04:47:21.565 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:47:21.565 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:47:21.565 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 86:13:fe:55:4c:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-20T04:47:21.565 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::8413:feff:fe55:4c04/64 scope link 2023-12-20T04:47:21.565 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:47:21.565 INFO:teuthology.orchestra.run.smithi132.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:47:21.565 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-20T04:47:21.565 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::839:72ff:fea7:b332/64 scope link 2023-12-20T04:47:21.565 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:47:21.566 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:21.566 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:47:21.628 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-20T04:47:21.629 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:21.630 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-12-20T04:47:21.685 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-12-20T04:47:21.685 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:47:21.685 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:47:21.685 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:47:21.685 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:47:21.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:21.686 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:47:21.686 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:47:21.686 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:47:21.686 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:47:21.686 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:47:21.686 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:47:21.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:21.782 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-20T04:47:21.798 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-20T04:47:21.799 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-20T04:47:21.799 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:47:21.799 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:21.799 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-12-20T04:47:21.865 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-20T04:47:21.865 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:47:21.865 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-20T04:47:21.921 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:47:21.921 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:47:21.921 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:47:21.975 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:47:22.042 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:47:22.043 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:47:22.108 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:47:22.109 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:47:22.109 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:22.110 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:47:22.164 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:47:22.164 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-20T04:47:22.207 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:47:22.234 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:47:22.234 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:47:22.292 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:2023-12-20T04:47:22.291+0000 7fe33c97c480 -1 init, newargv = 0x564a4c04e4e0 newargc=15 2023-12-20T04:47:22.293 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[107339]: starting ceph client 2023-12-20T04:47:22.297 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[107339]: starting fuse 2023-12-20T04:47:22.302 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:47:22.303 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:47:22.303 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:22.304 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:47:22.358 INFO:teuthology.orchestra.run.smithi132.stdout:41 2023-12-20T04:47:22.358 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:47:22.359 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:47:22.359 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:47:22.359 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:47:22.359 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:47:22.359 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:47:22.359 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:47:22.359 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:47:22.359 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:47:22.359 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:47:22.359 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:47:22.359 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:47:22.359 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:47:22.359 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:47:22.360 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:47:22.360 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:47:22.360 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:47:22.360 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:47:22.360 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:47:22.360 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:47:22.360 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:47:22.360 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:47:22.360 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:47:22.360 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:47:22.360 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:47:22.360 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:47:22.360 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:47:22.360 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:47:22.474 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.107339.asok 2023-12-20T04:47:22.660 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.107339.asok 2023-12-20T04:47:22.660 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:22.661 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.107339.asok status 2023-12-20T04:47:22.795 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:47:22.795 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:47:22.795 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:47:22.796 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:47:22.796 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:47:22.796 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:47:22.796 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:47:22.796 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "107339", 2023-12-20T04:47:22.796 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:47:22.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:22.796 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2023-12-20T04:47:22.796 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:47:22.796 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 7131, 2023-12-20T04:47:22.796 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:47:22.796 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:47:22.796 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:47:22.796 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 7131 2023-12-20T04:47:22.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:47:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:47:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 1891768081 2023-12-20T04:47:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:47:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:47:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 1891768081 2023-12-20T04:47:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.7131 192.168.0.1:0/1891768081", 2023-12-20T04:47:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/1891768081", 2023-12-20T04:47:22.797 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2023-12-20T04:47:22.798 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 38, 2023-12-20T04:47:22.798 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 101, 2023-12-20T04:47:22.798 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:47:22.798 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:47:22.798 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:47:22.798 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:47:22.804 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:22.804 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2023-12-20T04:47:22.804 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-20T04:47:22.819 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2023-12-20T04:47:22.819 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-20T04:47:22.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:22.819 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:47:22.888 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:47:23.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.026+0000 7fd1c8c1e640 1 Processor -- start 2023-12-20T04:47:23.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.026+0000 7fd1c8c1e640 1 -- start start 2023-12-20T04:47:23.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.027+0000 7fd1c8c1e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1c4159b50 0x7fd1c40c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:23.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.027+0000 7fd1c8c1e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd1c406c240 0x7fd1c406c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:23.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.027+0000 7fd1c8c1e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd1c40ccf30 con 0x7fd1c415e530 2023-12-20T04:47:23.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.027+0000 7fd1c8c1e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd1c406cc10 con 0x7fd1c406c240 2023-12-20T04:47:23.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.027+0000 7fd1c8c1e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40caa60 con 0x7fd1c4159b50 2023-12-20T04:47:23.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.027+0000 7fd1c2d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd1c406c240 0x7fd1c406c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:23.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.027+0000 7fd1c2d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd1c406c240 0x7fd1c406c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53766/0 (socket says 172.21.15.132:53766) 2023-12-20T04:47:23.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.027+0000 7fd1c2d9d640 1 -- 172.21.15.132:0/3059299008 learned_addr learned my addr 172.21.15.132:0/3059299008 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:23.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.027+0000 7fd1c259c640 1 --2- 172.21.15.132:0/3059299008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1c4159b50 0x7fd1c40c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:23.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.027+0000 7fd1c2d9d640 1 -- 172.21.15.132:0/3059299008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1c4159b50 msgr2=0x7fd1c40c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:23.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.027+0000 7fd1c2d9d640 1 --2- 172.21.15.132:0/3059299008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1c4159b50 0x7fd1c40c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:23.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.027+0000 7fd1c2d9d640 1 -- 172.21.15.132:0/3059299008 >> v1:172.21.15.187:6789/0 conn(0x7fd1c415e530 legacy=0x7fd1c406fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:23.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.027+0000 7fd1c2d9d640 1 -- 172.21.15.132:0/3059299008 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1c40ca1c0 con 0x7fd1c406c240 2023-12-20T04:47:23.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.027+0000 7fd1c259c640 1 --2- 172.21.15.132:0/3059299008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1c4159b50 0x7fd1c40c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:23.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.028+0000 7fd1c2d9d640 1 --2- 172.21.15.132:0/3059299008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1c406c240 0x7fd1c406c6d0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009e50 tx=0x7fd1bc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f29081bf902e4acd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:23.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.028+0000 7fd1c159a640 1 -- 172.21.15.132:0/3059299008 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc02ca70 con 0x7fd1c406c240 2023-12-20T04:47:23.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.028+0000 7fd1c159a640 1 -- 172.21.15.132:0/3059299008 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1bc02cbd0 con 0x7fd1c406c240 2023-12-20T04:47:23.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.028+0000 7fd1c159a640 1 -- 172.21.15.132:0/3059299008 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1bc0343f0 con 0x7fd1c406c240 2023-12-20T04:47:23.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.029+0000 7fd1c8c1e640 1 -- 172.21.15.132:0/3059299008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1c406c240 msgr2=0x7fd1c406c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:23.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.029+0000 7fd1c8c1e640 1 --2- 172.21.15.132:0/3059299008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1c406c240 0x7fd1c406c6d0 secure :-1 s=READY pgs=1059 cs=0 l=1 rev1=1 crypto rx=0x7fd1bc009e50 tx=0x7fd1bc02bed0 comp rx=0 tx=0).stop 2023-12-20T04:47:23.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.029+0000 7fd1c8c1e640 1 -- 172.21.15.132:0/3059299008 shutdown_connections 2023-12-20T04:47:23.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.029+0000 7fd1c8c1e640 1 --2- 172.21.15.132:0/3059299008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1c406c240 0x7fd1c406c6d0 unknown :-1 s=CLOSED pgs=1059 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:23.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.029+0000 7fd1c8c1e640 1 --2- 172.21.15.132:0/3059299008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1c4159b50 0x7fd1c40c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:23.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.029+0000 7fd1c8c1e640 1 -- 172.21.15.132:0/3059299008 >> 172.21.15.132:0/3059299008 conn(0x7fd1c40ced10 msgr2=0x7fd1c40cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:23.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.029+0000 7fd1c8c1e640 1 -- 172.21.15.132:0/3059299008 shutdown_connections 2023-12-20T04:47:23.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.029+0000 7fd1c8c1e640 1 -- 172.21.15.132:0/3059299008 wait complete. 2023-12-20T04:47:23.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.030+0000 7fd1c8c1e640 1 Processor -- start 2023-12-20T04:47:23.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.030+0000 7fd1c8c1e640 1 -- start start 2023-12-20T04:47:23.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.031+0000 7fd1c8c1e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1c406c240 0x7fd1c414dce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:23.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.031+0000 7fd1c8c1e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1c4159b50 0x7fd1c414e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:23.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.031+0000 7fd1c8c1e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1c415e530 0x7fd1c413e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:23.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.031+0000 7fd1c8c1e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c414ede0 con 0x7fd1c4159b50 2023-12-20T04:47:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.031+0000 7fd1c8c1e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c413ea20 con 0x7fd1c406c240 2023-12-20T04:47:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.031+0000 7fd1c8c1e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd1c40c31b0 con 0x7fd1c415e530 2023-12-20T04:47:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.031+0000 7fd1c1d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1c4159b50 0x7fd1c414e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.031+0000 7fd1c1d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1c4159b50 0x7fd1c414e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53768/0 (socket says 172.21.15.132:53768) 2023-12-20T04:47:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.031+0000 7fd1c1d9b640 1 -- 172.21.15.132:0/781618709 learned_addr learned my addr 172.21.15.132:0/781618709 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.031+0000 7fd1c2d9d640 1 --2- 172.21.15.132:0/781618709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1c415e530 0x7fd1c413e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.031+0000 7fd1c259c640 1 --2- 172.21.15.132:0/781618709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1c406c240 0x7fd1c414dce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.031+0000 7fd1c1d9b640 1 -- 172.21.15.132:0/781618709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1c415e530 msgr2=0x7fd1c413e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.031+0000 7fd1c1d9b640 1 --2- 172.21.15.132:0/781618709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1c415e530 0x7fd1c413e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.031+0000 7fd1c1d9b640 1 -- 172.21.15.132:0/781618709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1c406c240 msgr2=0x7fd1c414dce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.031+0000 7fd1c1d9b640 1 --2- 172.21.15.132:0/781618709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1c406c240 0x7fd1c414dce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.031+0000 7fd1c1d9b640 1 -- 172.21.15.132:0/781618709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd1bc009b30 con 0x7fd1c4159b50 2023-12-20T04:47:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.032+0000 7fd1c1d9b640 1 --2- 172.21.15.132:0/781618709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1c4159b50 0x7fd1c414e8a0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800c430 tx=0x7fd1b800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.032+0000 7fd1b2ffd640 1 -- 172.21.15.132:0/781618709 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8011790 con 0x7fd1c4159b50 2023-12-20T04:47:23.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.032+0000 7fd1b2ffd640 1 -- 172.21.15.132:0/781618709 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd1b80118f0 con 0x7fd1c4159b50 2023-12-20T04:47:23.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.032+0000 7fd1c8c1e640 1 -- 172.21.15.132:0/781618709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd1c41506e0 con 0x7fd1c4159b50 2023-12-20T04:47:23.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.032+0000 7fd1b2ffd640 1 -- 172.21.15.132:0/781618709 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd1b8011ce0 con 0x7fd1c4159b50 2023-12-20T04:47:23.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.032+0000 7fd1c8c1e640 1 -- 172.21.15.132:0/781618709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd1c4150ca0 con 0x7fd1c4159b50 2023-12-20T04:47:23.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.033+0000 7fd1c8c1e640 1 -- 172.21.15.132:0/781618709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd1c40c9e20 con 0x7fd1c4159b50 2023-12-20T04:47:23.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.033+0000 7fd1b2ffd640 1 -- 172.21.15.132:0/781618709 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd1b801c460 con 0x7fd1c4159b50 2023-12-20T04:47:23.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.034+0000 7fd1b2ffd640 1 --2- 172.21.15.132:0/781618709 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd1a406a460 0x7fd1a406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:23.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.034+0000 7fd1c259c640 1 --2- 172.21.15.132:0/781618709 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd1a406a460 0x7fd1a406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:23.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.034+0000 7fd1b2ffd640 1 -- 172.21.15.132:0/781618709 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd1b8088850 con 0x7fd1c4159b50 2023-12-20T04:47:23.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.034+0000 7fd1c259c640 1 --2- 172.21.15.132:0/781618709 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd1a406a460 0x7fd1a406c920 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd1c41f41c0 tx=0x7fd1b4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:23.040 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.038+0000 7fd1b2ffd640 1 -- 172.21.15.132:0/781618709 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd1b8053e40 con 0x7fd1c4159b50 2023-12-20T04:47:23.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.240+0000 7fd1c8c1e640 1 -- 172.21.15.132:0/781618709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fd1c404e840 con 0x7fd1c4159b50 2023-12-20T04:47:23.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.241+0000 7fd1b2ffd640 1 -- 172.21.15.132:0/781618709 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v38) v1 ==== 53+0+73 (secure 0 0 0) 0x7fd1b8057460 con 0x7fd1c4159b50 2023-12-20T04:47:23.243 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:47:23.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.242+0000 7fd1c8c1e640 1 -- 172.21.15.132:0/781618709 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd1a406a460 msgr2=0x7fd1a406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.242+0000 7fd1c8c1e640 1 --2- 172.21.15.132:0/781618709 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd1a406a460 0x7fd1a406c920 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fd1c41f41c0 tx=0x7fd1b4008040 comp rx=0 tx=0).stop 2023-12-20T04:47:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.242+0000 7fd1c8c1e640 1 -- 172.21.15.132:0/781618709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1c4159b50 msgr2=0x7fd1c414e8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.242+0000 7fd1c8c1e640 1 --2- 172.21.15.132:0/781618709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1c4159b50 0x7fd1c414e8a0 secure :-1 s=READY pgs=1060 cs=0 l=1 rev1=1 crypto rx=0x7fd1b800c430 tx=0x7fd1b800c8f0 comp rx=0 tx=0).stop 2023-12-20T04:47:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.243+0000 7fd1c8c1e640 1 -- 172.21.15.132:0/781618709 shutdown_connections 2023-12-20T04:47:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.243+0000 7fd1c8c1e640 1 --2- 172.21.15.132:0/781618709 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd1a406a460 0x7fd1a406c920 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.243+0000 7fd1c8c1e640 1 --2- 172.21.15.132:0/781618709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd1c415e530 0x7fd1c413e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.243+0000 7fd1c8c1e640 1 --2- 172.21.15.132:0/781618709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd1c4159b50 0x7fd1c414e8a0 unknown :-1 s=CLOSED pgs=1060 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.243+0000 7fd1c8c1e640 1 --2- 172.21.15.132:0/781618709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd1c406c240 0x7fd1c414dce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.243+0000 7fd1c8c1e640 1 -- 172.21.15.132:0/781618709 >> 172.21.15.132:0/781618709 conn(0x7fd1c40ced10 msgr2=0x7fd1c40cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.243+0000 7fd1c8c1e640 1 -- 172.21.15.132:0/781618709 shutdown_connections 2023-12-20T04:47:23.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:23.243+0000 7fd1c8c1e640 1 -- 172.21.15.132:0/781618709 wait complete. 2023-12-20T04:47:23.255 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:47:23.255 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:47:23.255 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-12-20T04:47:23.255 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-20T04:47:23.255 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-20T04:47:23.255 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:47:23.255 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:47:23.256 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:47:23.256 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:47:23.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:23.256 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-12-20T04:47:23.274 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:47:23.274 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:47:23.274 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:47:23.275 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:47:23.275 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-20T04:47:23.275 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:47:23.275 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:47:23.275 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:47:23.275 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-12-20T04:47:23.275 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:47:23.275 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:47:23.275 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-12-20T04:47:23.275 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:47:23.275 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:47:23.275 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:47:23.275 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:47:23.275 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:47:23.276 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42442sec preferred_lft 42442sec 2023-12-20T04:47:23.276 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-12-20T04:47:23.276 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:47:23.276 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:47:23.276 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:47:23.276 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:47:23.276 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:47:23.276 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::a8bc:1cff:fe40:54ea/64 scope link 2023-12-20T04:47:23.276 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:47:23.276 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:47:23.276 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-20T04:47:23.276 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c8e:c0ff:fe7a:bdc/64 scope link 2023-12-20T04:47:23.276 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:47:23.276 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:47:23.276 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether be:98:9a:6f:62:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-20T04:47:23.277 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::bc98:9aff:fe6f:6282/64 scope link 2023-12-20T04:47:23.277 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:47:23.277 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:23.277 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:47:23.344 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-12-20T04:47:23.346 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:23.346 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-12-20T04:47:23.404 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-12-20T04:47:23.404 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:47:23.404 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:47:23.404 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:47:23.404 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:47:23.404 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:23.404 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:47:23.404 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:47:23.404 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:47:23.404 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:47:23.405 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:47:23.405 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:47:23.505 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:23.505 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-20T04:47:23.520 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-20T04:47:23.520 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-20T04:47:23.520 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:47:23.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:23.520 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2023-12-20T04:47:23.588 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-20T04:47:23.588 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:47:23.588 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-20T04:47:23.643 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:47:23.644 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:47:23.644 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:47:23.698 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:47:23.766 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:47:23.766 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:47:23.832 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:47:23.833 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:47:23.834 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:23.834 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:47:23.890 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:47:23.890 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-20T04:47:23.933 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:47:23.959 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:47:23.959 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:47:24.018 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:2023-12-20T04:47:24.016+0000 7f57dea4b480 -1 init, newargv = 0x55e73e3e36b0 newargc=15 2023-12-20T04:47:24.018 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[89272]: starting ceph client 2023-12-20T04:47:24.022 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[89272]: starting fuse 2023-12-20T04:47:24.028 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:47:24.029 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:47:24.030 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:24.030 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:47:24.085 INFO:teuthology.orchestra.run.smithi187.stdout:41 2023-12-20T04:47:24.085 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:47:24.085 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:47:24.085 DEBUG:teuthology.orchestra.run.smithi187:> import glob 2023-12-20T04:47:24.085 DEBUG:teuthology.orchestra.run.smithi187:> import re 2023-12-20T04:47:24.085 DEBUG:teuthology.orchestra.run.smithi187:> import os 2023-12-20T04:47:24.086 DEBUG:teuthology.orchestra.run.smithi187:> import subprocess 2023-12-20T04:47:24.086 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:47:24.086 DEBUG:teuthology.orchestra.run.smithi187:> def _find_admin_socket(client_name): 2023-12-20T04:47:24.086 DEBUG:teuthology.orchestra.run.smithi187:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-20T04:47:24.086 DEBUG:teuthology.orchestra.run.smithi187:> files = glob.glob(asok_path) 2023-12-20T04:47:24.086 DEBUG:teuthology.orchestra.run.smithi187:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-20T04:47:24.086 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:47:24.086 DEBUG:teuthology.orchestra.run.smithi187:> # Given a non-glob path, it better be there 2023-12-20T04:47:24.086 DEBUG:teuthology.orchestra.run.smithi187:> if "*" not in asok_path: 2023-12-20T04:47:24.086 DEBUG:teuthology.orchestra.run.smithi187:> assert(len(files) == 1) 2023-12-20T04:47:24.086 DEBUG:teuthology.orchestra.run.smithi187:> return files[0] 2023-12-20T04:47:24.086 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:47:24.086 DEBUG:teuthology.orchestra.run.smithi187:> for f in files: 2023-12-20T04:47:24.087 DEBUG:teuthology.orchestra.run.smithi187:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:47:24.087 DEBUG:teuthology.orchestra.run.smithi187:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:47:24.087 DEBUG:teuthology.orchestra.run.smithi187:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:47:24.087 DEBUG:teuthology.orchestra.run.smithi187:> contents = proc_f.read() 2023-12-20T04:47:24.087 DEBUG:teuthology.orchestra.run.smithi187:> if mountpoint in contents: 2023-12-20T04:47:24.087 DEBUG:teuthology.orchestra.run.smithi187:> return f 2023-12-20T04:47:24.087 DEBUG:teuthology.orchestra.run.smithi187:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:47:24.087 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:47:24.087 DEBUG:teuthology.orchestra.run.smithi187:> print(_find_admin_socket("client.1")) 2023-12-20T04:47:24.087 DEBUG:teuthology.orchestra.run.smithi187:> ' 2023-12-20T04:47:24.201 INFO:teuthology.orchestra.run.smithi187.stdout:/var/run/ceph/ceph-client.1.89272.asok 2023-12-20T04:47:24.388 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.89272.asok 2023-12-20T04:47:24.388 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:24.388 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.89272.asok status 2023-12-20T04:47:24.523 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-12-20T04:47:24.523 INFO:teuthology.orchestra.run.smithi187.stdout: "metadata": { 2023-12-20T04:47:24.523 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:47:24.523 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:47:24.523 INFO:teuthology.orchestra.run.smithi187.stdout: "entity_id": "1", 2023-12-20T04:47:24.523 INFO:teuthology.orchestra.run.smithi187.stdout: "hostname": "smithi187", 2023-12-20T04:47:24.523 INFO:teuthology.orchestra.run.smithi187.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-20T04:47:24.524 INFO:teuthology.orchestra.run.smithi187.stdout: "pid": "89272", 2023-12-20T04:47:24.524 INFO:teuthology.orchestra.run.smithi187.stdout: "root": "/" 2023-12-20T04:47:24.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:47:24.524 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_count": 0, 2023-12-20T04:47:24.524 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_pinned_count": 0, 2023-12-20T04:47:24.524 INFO:teuthology.orchestra.run.smithi187.stdout: "id": 6289, 2023-12-20T04:47:24.524 INFO:teuthology.orchestra.run.smithi187.stdout: "inst": { 2023-12-20T04:47:24.524 INFO:teuthology.orchestra.run.smithi187.stdout: "name": { 2023-12-20T04:47:24.524 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "client", 2023-12-20T04:47:24.524 INFO:teuthology.orchestra.run.smithi187.stdout: "num": 6289 2023-12-20T04:47:24.524 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:47:24.524 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:47:24.524 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:47:24.525 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:47:24.525 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 1793518308 2023-12-20T04:47:24.525 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-12-20T04:47:24.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:47:24.525 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:47:24.525 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:47:24.525 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:47:24.525 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 1793518308 2023-12-20T04:47:24.525 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:47:24.525 INFO:teuthology.orchestra.run.smithi187.stdout: "inst_str": "client.6289 192.168.0.1:0/1793518308", 2023-12-20T04:47:24.525 INFO:teuthology.orchestra.run.smithi187.stdout: "addr_str": "192.168.0.1:0/1793518308", 2023-12-20T04:47:24.525 INFO:teuthology.orchestra.run.smithi187.stdout: "inode_count": 1, 2023-12-20T04:47:24.525 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_epoch": 38, 2023-12-20T04:47:24.525 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch": 101, 2023-12-20T04:47:24.526 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:47:24.526 INFO:teuthology.orchestra.run.smithi187.stdout: "blocklisted": false, 2023-12-20T04:47:24.526 INFO:teuthology.orchestra.run.smithi187.stdout: "fs_name": "cephfs" 2023-12-20T04:47:24.526 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-12-20T04:47:24.531 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:24.531 DEBUG:teuthology.orchestra.run.smithi187:> stat --file-system '--printf=%T 2023-12-20T04:47:24.531 DEBUG:teuthology.orchestra.run.smithi187:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-20T04:47:24.546 INFO:teuthology.orchestra.run.smithi187.stdout:fuseblk 2023-12-20T04:47:24.546 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-20T04:47:24.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:24.546 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:47:24.613 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:47:24.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.722+0000 7f90c6641640 1 Processor -- start 2023-12-20T04:47:24.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.722+0000 7f90c6641640 1 -- start start 2023-12-20T04:47:24.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.723+0000 7f90c6641640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f90c015cf00 0x7f90c0161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:24.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.723+0000 7f90c6641640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f90c00cfdd0 0x7f90c00d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:24.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.723+0000 7f90c6641640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f90c00b8e20 con 0x7f90c00b1a00 2023-12-20T04:47:24.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.723+0000 7f90c6641640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c00cdff0 con 0x7f90c015cf00 2023-12-20T04:47:24.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.723+0000 7f90c6641640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90c00ce2d0 con 0x7f90c00cfdd0 2023-12-20T04:47:24.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.723+0000 7f90bffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f90c015cf00 0x7f90c0161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:24.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.723+0000 7f90bf7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f90c00b1a00 0x7f90c00cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53028/0 (socket says 172.21.15.132:53028) 2023-12-20T04:47:24.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.723+0000 7f90bf7fe640 1 -- 172.21.15.132:0/1293171129 learned_addr learned my addr 172.21.15.132:0/1293171129 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:24.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.724+0000 7f90bffff640 1 -- 172.21.15.132:0/1293171129 >> v2:172.21.15.187:3300/0 conn(0x7f90c00cfdd0 msgr2=0x7f90c00d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:24.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.724+0000 7f90c4bde640 1 --2- 172.21.15.132:0/1293171129 >> v2:172.21.15.187:3300/0 conn(0x7f90c00cfdd0 0x7f90c00d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:24.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.724+0000 7f90bffff640 1 --2- 172.21.15.132:0/1293171129 >> v2:172.21.15.187:3300/0 conn(0x7f90c00cfdd0 0x7f90c00d15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:24.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.724+0000 7f90beffd640 1 -- 172.21.15.132:0/1293171129 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4012863423 0 0) 0x7f90c00b8e20 con 0x7f90c00b1a00 2023-12-20T04:47:24.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.724+0000 7f90bffff640 1 -- 172.21.15.132:0/1293171129 >> v1:172.21.15.132:6789/0 conn(0x7f90c00b1a00 legacy=0x7f90c00cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:24.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.724+0000 7f90bffff640 1 -- 172.21.15.132:0/1293171129 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90c00ce5b0 con 0x7f90c015cf00 2023-12-20T04:47:24.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.725+0000 7f90bffff640 1 --2- 172.21.15.132:0/1293171129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90c015cf00 0x7f90c0161440 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f90c00cea30 tx=0x7f90b002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94bd18f2c26ff35b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:24.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.725+0000 7f90beffd640 1 -- 172.21.15.132:0/1293171129 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b002e070 con 0x7f90c015cf00 2023-12-20T04:47:24.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.725+0000 7f90beffd640 1 -- 172.21.15.132:0/1293171129 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b00315a0 con 0x7f90c015cf00 2023-12-20T04:47:24.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.725+0000 7f90beffd640 1 -- 172.21.15.132:0/1293171129 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b0031930 con 0x7f90c015cf00 2023-12-20T04:47:24.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.725+0000 7f90c6641640 1 -- 172.21.15.132:0/1293171129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90c015cf00 msgr2=0x7f90c0161440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:24.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.725+0000 7f90c6641640 1 --2- 172.21.15.132:0/1293171129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90c015cf00 0x7f90c0161440 secure :-1 s=READY pgs=1062 cs=0 l=1 rev1=1 crypto rx=0x7f90c00cea30 tx=0x7f90b002b840 comp rx=0 tx=0).stop 2023-12-20T04:47:24.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.725+0000 7f90c6641640 1 -- 172.21.15.132:0/1293171129 shutdown_connections 2023-12-20T04:47:24.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.725+0000 7f90c6641640 1 --2- 172.21.15.132:0/1293171129 >> v2:172.21.15.187:3300/0 conn(0x7f90c00cfdd0 0x7f90c00d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:24.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.725+0000 7f90c6641640 1 --2- 172.21.15.132:0/1293171129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90c015cf00 0x7f90c0161440 unknown :-1 s=CLOSED pgs=1062 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:24.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.725+0000 7f90c6641640 1 -- 172.21.15.132:0/1293171129 >> 172.21.15.132:0/1293171129 conn(0x7f90c006a290 msgr2=0x7f90c006a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:24.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.725+0000 7f90c6641640 1 -- 172.21.15.132:0/1293171129 shutdown_connections 2023-12-20T04:47:24.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.725+0000 7f90c6641640 1 -- 172.21.15.132:0/1293171129 wait complete. 2023-12-20T04:47:24.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.726+0000 7f90c6641640 1 Processor -- start 2023-12-20T04:47:24.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.727+0000 7f90c6641640 1 -- start start 2023-12-20T04:47:24.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.727+0000 7f90c6641640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90c00b1a00 0x7f90c00a97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:24.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.727+0000 7f90c6641640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90c00cfdd0 0x7f90c01594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:24.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.727+0000 7f90c6641640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90c015cf00 0x7f90c00cc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:24.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.727+0000 7f90c6641640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c00aaa80 con 0x7f90c015cf00 2023-12-20T04:47:24.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.727+0000 7f90c6641640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90c00aa1e0 con 0x7f90c00b1a00 2023-12-20T04:47:24.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.727+0000 7f90c6641640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90c01599e0 con 0x7f90c00cfdd0 2023-12-20T04:47:24.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.728+0000 7f90c4bde640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90c015cf00 0x7f90c00cc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:24.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.728+0000 7f90c4bde640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90c015cf00 0x7f90c00cc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:53790/0 (socket says 172.21.15.132:53790) 2023-12-20T04:47:24.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.728+0000 7f90c4bde640 1 -- 172.21.15.132:0/644683614 learned_addr learned my addr 172.21.15.132:0/644683614 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:24.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.728+0000 7f90bffff640 1 --2- 172.21.15.132:0/644683614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90c00b1a00 0x7f90c00a97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:24.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.728+0000 7f90bf7fe640 1 --2- 172.21.15.132:0/644683614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90c00cfdd0 0x7f90c01594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:24.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.728+0000 7f90c4bde640 1 -- 172.21.15.132:0/644683614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90c00cfdd0 msgr2=0x7f90c01594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:24.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.728+0000 7f90c4bde640 1 --2- 172.21.15.132:0/644683614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90c00cfdd0 0x7f90c01594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:24.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.728+0000 7f90c4bde640 1 -- 172.21.15.132:0/644683614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90c00b1a00 msgr2=0x7f90c00a97d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:24.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.728+0000 7f90c4bde640 1 --2- 172.21.15.132:0/644683614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90c00b1a00 0x7f90c00a97d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:24.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.728+0000 7f90c4bde640 1 -- 172.21.15.132:0/644683614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90b0009400 con 0x7f90c015cf00 2023-12-20T04:47:24.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.728+0000 7f90c4bde640 1 --2- 172.21.15.132:0/644683614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90c015cf00 0x7f90c00cc0b0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f90b800cd40 tx=0x7f90b800a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:24.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.728+0000 7f90bcff9640 1 -- 172.21.15.132:0/644683614 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8003b90 con 0x7f90c015cf00 2023-12-20T04:47:24.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.728+0000 7f90bcff9640 1 -- 172.21.15.132:0/644683614 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90b8003cf0 con 0x7f90c015cf00 2023-12-20T04:47:24.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.728+0000 7f90c6641640 1 -- 172.21.15.132:0/644683614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90c01f7300 con 0x7f90c015cf00 2023-12-20T04:47:24.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.728+0000 7f90bcff9640 1 -- 172.21.15.132:0/644683614 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f90b8004240 con 0x7f90c015cf00 2023-12-20T04:47:24.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.728+0000 7f90c6641640 1 -- 172.21.15.132:0/644683614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90c00aa710 con 0x7f90c015cf00 2023-12-20T04:47:24.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.729+0000 7f90c6641640 1 -- 172.21.15.132:0/644683614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f90c004e840 con 0x7f90c015cf00 2023-12-20T04:47:24.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.730+0000 7f90bcff9640 1 -- 172.21.15.132:0/644683614 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f90b80043a0 con 0x7f90c015cf00 2023-12-20T04:47:24.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.730+0000 7f90bcff9640 1 --2- 172.21.15.132:0/644683614 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90ac06a430 0x7f90ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:24.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.730+0000 7f90bffff640 1 --2- 172.21.15.132:0/644683614 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90ac06a430 0x7f90ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:24.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.730+0000 7f90bcff9640 1 -- 172.21.15.132:0/644683614 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f90b8012070 con 0x7f90c015cf00 2023-12-20T04:47:24.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.731+0000 7f90bffff640 1 --2- 172.21.15.132:0/644683614 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90ac06a430 0x7f90ac06c8f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f90b0036000 tx=0x7f90b003d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:24.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.734+0000 7f90bcff9640 1 -- 172.21.15.132:0/644683614 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f90b80547b0 con 0x7f90c015cf00 2023-12-20T04:47:24.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.935+0000 7f90c6641640 1 -- 172.21.15.132:0/644683614 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f90c00b2170 con 0x7f90c015cf00 2023-12-20T04:47:24.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.936+0000 7f90bcff9640 1 -- 172.21.15.132:0/644683614 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f90b8057dd0 con 0x7f90c015cf00 2023-12-20T04:47:24.938 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:24.938 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6939,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2115867433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2115867433},{"type":"v1","addr":"172.21.15.132:6837","nonce":2115867433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6942,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/162444556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":162444556},{"type":"v1","addr":"172.21.15.132:6836","nonce":162444556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2089611890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2089611890},{"type":"v1","addr":"172.21.15.187:6835","nonce":2089611890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:47:12.299623+0000","modified":"2023-12-20T04:47:14.308466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6957},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6957":{"gid":6957,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/786513656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":786513656},{"type":"v1","addr":"172.21.15.187:6834","nonce":786513656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-20T04:47:24.938 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 38 2023-12-20T04:47:24.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.937+0000 7f90c6641640 1 -- 172.21.15.132:0/644683614 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90ac06a430 msgr2=0x7f90ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:24.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.937+0000 7f90c6641640 1 --2- 172.21.15.132:0/644683614 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90ac06a430 0x7f90ac06c8f0 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f90b0036000 tx=0x7f90b003d040 comp rx=0 tx=0).stop 2023-12-20T04:47:24.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.937+0000 7f90c6641640 1 -- 172.21.15.132:0/644683614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90c015cf00 msgr2=0x7f90c00cc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:24.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.937+0000 7f90c6641640 1 --2- 172.21.15.132:0/644683614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90c015cf00 0x7f90c00cc0b0 secure :-1 s=READY pgs=1063 cs=0 l=1 rev1=1 crypto rx=0x7f90b800cd40 tx=0x7f90b800a660 comp rx=0 tx=0).stop 2023-12-20T04:47:24.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.937+0000 7f90c6641640 1 -- 172.21.15.132:0/644683614 shutdown_connections 2023-12-20T04:47:24.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.937+0000 7f90c6641640 1 --2- 172.21.15.132:0/644683614 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f90ac06a430 0x7f90ac06c8f0 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:24.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.937+0000 7f90c6641640 1 --2- 172.21.15.132:0/644683614 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f90c015cf00 0x7f90c00cc0b0 unknown :-1 s=CLOSED pgs=1063 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:24.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.937+0000 7f90c6641640 1 --2- 172.21.15.132:0/644683614 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f90c00cfdd0 0x7f90c01594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:24.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.937+0000 7f90c6641640 1 --2- 172.21.15.132:0/644683614 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f90c00b1a00 0x7f90c00a97d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:24.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.937+0000 7f90c6641640 1 -- 172.21.15.132:0/644683614 >> 172.21.15.132:0/644683614 conn(0x7f90c006a290 msgr2=0x7f90c01607b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:24.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.938+0000 7f90c6641640 1 -- 172.21.15.132:0/644683614 shutdown_connections 2023-12-20T04:47:24.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:24.938+0000 7f90c6641640 1 -- 172.21.15.132:0/644683614 wait complete. 2023-12-20T04:47:24.950 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-12-20T04:47:25.065 INFO:teuthology.orchestra.run.smithi187.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":6957,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":12.753323162999999,"mdsmap_epoch":38,"osdmap_epoch":101,"osdmap_epoch_barrier":101,"uptime":17.017118087} 2023-12-20T04:47:25.066 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 6957, "mdsmap_epoch": 38, "osdmap_epoch": 101, "osdmap_epoch_barrier": 101, "rank_uptime": 12.753323163, "state": "up:active", "uptime": 17.017118087, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:47:25.066 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-20T04:47:25.180 INFO:teuthology.orchestra.run.smithi132.stdout:{"osd_mon_report_interval":"5"} 2023-12-20T04:47:25.180 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-20T04:47:25.180 INFO:tasks.cephfs.test_full:Writing 531MB should fill this cluster 2023-12-20T04:47:25.180 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:47:25.180 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:47:25.195 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:25.196 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=265 seek=0) 2023-12-20T04:47:26.326 INFO:teuthology.orchestra.run.smithi132.stderr:265+0 records in 2023-12-20T04:47:26.327 INFO:teuthology.orchestra.run.smithi132.stderr:265+0 records out 2023-12-20T04:47:26.327 INFO:teuthology.orchestra.run.smithi132.stderr:277872640 bytes (278 MB, 265 MiB) copied, 1.07145 s, 259 MB/s 2023-12-20T04:47:26.327 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:47:26.327 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:47:26.342 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:26.343 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=292 seek=0) 2023-12-20T04:47:27.536 INFO:teuthology.orchestra.run.smithi132.stderr:292+0 records in 2023-12-20T04:47:27.537 INFO:teuthology.orchestra.run.smithi132.stderr:292+0 records out 2023-12-20T04:47:27.537 INFO:teuthology.orchestra.run.smithi132.stderr:306184192 bytes (306 MB, 292 MiB) copied, 1.13565 s, 270 MB/s 2023-12-20T04:47:27.537 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-20T04:47:27.537 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:47:27.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.637+0000 7feb5d836640 1 Processor -- start 2023-12-20T04:47:27.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.637+0000 7feb5d836640 1 -- start start 2023-12-20T04:47:27.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb5d836640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb580ac8e0 0x7feb580acce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:27.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb5d836640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb580ccbd0 con 0x7feb5815dce0 2023-12-20T04:47:27.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb5d836640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7feb580cce90 con 0x7feb5815d0f0 2023-12-20T04:47:27.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb5d836640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb580ce920 con 0x7feb580ac8e0 2023-12-20T04:47:27.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb577fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7feb5815dce0 0x7feb580b0790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44038/0 (socket says 172.21.15.132:44038) 2023-12-20T04:47:27.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb577fe640 1 -- 172.21.15.132:0/1316718534 learned_addr learned my addr 172.21.15.132:0/1316718534 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:27.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb567fc640 1 -- 172.21.15.132:0/1316718534 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2240387498 0 0) 0x7feb580ccbd0 con 0x7feb5815dce0 2023-12-20T04:47:27.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb4ffff640 1 --2- 172.21.15.132:0/1316718534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb580ac8e0 0x7feb580acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:27.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb567fc640 1 -- 172.21.15.132:0/1316718534 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7feb44003520 con 0x7feb5815dce0 2023-12-20T04:47:27.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb567fc640 1 -- 172.21.15.132:0/1316718534 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 49226840 0 0) 0x7feb44003520 con 0x7feb5815dce0 2023-12-20T04:47:27.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb567fc640 1 -- 172.21.15.132:0/1316718534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb580ac8e0 msgr2=0x7feb580acce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:27.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb567fc640 1 --2- 172.21.15.132:0/1316718534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb580ac8e0 0x7feb580acce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:27.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb567fc640 1 -- 172.21.15.132:0/1316718534 >> v1:172.21.15.187:6789/0 conn(0x7feb5815d0f0 legacy=0x7feb58161620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:27.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb567fc640 1 -- 172.21.15.132:0/1316718534 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb580cd170 con 0x7feb5815dce0 2023-12-20T04:47:27.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb567fc640 1 -- 172.21.15.132:0/1316718534 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7feb500019f0 con 0x7feb5815dce0 2023-12-20T04:47:27.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb567fc640 1 -- 172.21.15.132:0/1316718534 >> v1:172.21.15.132:6789/0 conn(0x7feb5815dce0 legacy=0x7feb580b0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:27.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb567fc640 1 --2- 172.21.15.132:0/1316718534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb440039a0 0x7feb44003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:27.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb567fc640 1 --2- 172.21.15.132:0/1316718534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb440047c0 0x7feb44004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:27.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb567fc640 1 --2- 172.21.15.132:0/1316718534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb580ac8e0 0x7feb44005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:27.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb567fc640 1 -- 172.21.15.132:0/1316718534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb580ce920 con 0x7feb440039a0 2023-12-20T04:47:27.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb567fc640 1 -- 172.21.15.132:0/1316718534 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb4400ba30 con 0x7feb440047c0 2023-12-20T04:47:27.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.638+0000 7feb567fc640 1 -- 172.21.15.132:0/1316718534 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb4400bbf0 con 0x7feb580ac8e0 2023-12-20T04:47:27.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.639+0000 7feb56ffd640 1 --2- 172.21.15.132:0/1316718534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb440039a0 0x7feb44003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:27.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.639+0000 7feb577fe640 1 --2- 172.21.15.132:0/1316718534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb580ac8e0 0x7feb44005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:27.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.639+0000 7feb4ffff640 1 --2- 172.21.15.132:0/1316718534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb440047c0 0x7feb44004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:27.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.639+0000 7feb56ffd640 1 -- 172.21.15.132:0/1316718534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb580ac8e0 msgr2=0x7feb44005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:27.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.639+0000 7feb56ffd640 1 --2- 172.21.15.132:0/1316718534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb580ac8e0 0x7feb44005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:27.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.639+0000 7feb56ffd640 1 -- 172.21.15.132:0/1316718534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb440047c0 msgr2=0x7feb44004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:27.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.639+0000 7feb56ffd640 1 --2- 172.21.15.132:0/1316718534 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb440047c0 0x7feb44004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:27.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.639+0000 7feb56ffd640 1 -- 172.21.15.132:0/1316718534 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb44003520 con 0x7feb440039a0 2023-12-20T04:47:27.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.639+0000 7feb577fe640 1 --2- 172.21.15.132:0/1316718534 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb580ac8e0 0x7feb44005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:47:27.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.640+0000 7feb56ffd640 1 --2- 172.21.15.132:0/1316718534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb440039a0 0x7feb44003dc0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7feb48001720 tx=0x7feb440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43b10a45296f92fa server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:27.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.640+0000 7feb567fc640 1 -- 172.21.15.132:0/1316718534 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb480052d0 con 0x7feb440039a0 2023-12-20T04:47:27.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.640+0000 7feb567fc640 1 -- 172.21.15.132:0/1316718534 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4802e050 con 0x7feb440039a0 2023-12-20T04:47:27.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.640+0000 7feb567fc640 1 -- 172.21.15.132:0/1316718534 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb480035f0 con 0x7feb440039a0 2023-12-20T04:47:27.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.640+0000 7feb5d836640 1 -- 172.21.15.132:0/1316718534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb440039a0 msgr2=0x7feb44003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:27.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.640+0000 7feb5d836640 1 --2- 172.21.15.132:0/1316718534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb440039a0 0x7feb44003dc0 secure :-1 s=READY pgs=1065 cs=0 l=1 rev1=1 crypto rx=0x7feb48001720 tx=0x7feb440057f0 comp rx=0 tx=0).stop 2023-12-20T04:47:27.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.640+0000 7feb577fe640 1 -- 172.21.15.132:0/1316718534 reap_dead start 2023-12-20T04:47:27.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.640+0000 7feb5d836640 1 -- 172.21.15.132:0/1316718534 shutdown_connections 2023-12-20T04:47:27.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.640+0000 7feb5d836640 1 -- 172.21.15.132:0/1316718534 >> 172.21.15.132:0/1316718534 conn(0x7feb580ced10 msgr2=0x7feb580cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:27.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.640+0000 7feb5d836640 1 -- 172.21.15.132:0/1316718534 shutdown_connections 2023-12-20T04:47:27.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.640+0000 7feb5d836640 1 -- 172.21.15.132:0/1316718534 wait complete. 2023-12-20T04:47:27.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.641+0000 7feb5d836640 1 Processor -- start 2023-12-20T04:47:27.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.642+0000 7feb5d836640 1 -- start start 2023-12-20T04:47:27.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.642+0000 7feb5d836640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb440039a0 0x7feb580b2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:27.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.642+0000 7feb5d836640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb580c7ce0 0x7feb58150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:27.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.642+0000 7feb5d836640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb580b3b00 0x7feb580aeff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:27.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.642+0000 7feb5d836640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb581513e0 con 0x7feb580c7ce0 2023-12-20T04:47:27.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.642+0000 7feb5d836640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb580c6c40 con 0x7feb440039a0 2023-12-20T04:47:27.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.642+0000 7feb5d836640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7feb580c6f20 con 0x7feb580b3b00 2023-12-20T04:47:27.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.642+0000 7feb4ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb580c7ce0 0x7feb58150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:27.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.642+0000 7feb4ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb580c7ce0 0x7feb58150ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37312/0 (socket says 172.21.15.132:37312) 2023-12-20T04:47:27.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.642+0000 7feb4ffff640 1 -- 172.21.15.132:0/1694712452 learned_addr learned my addr 172.21.15.132:0/1694712452 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:27.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.642+0000 7feb56ffd640 1 --2- 172.21.15.132:0/1694712452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb440039a0 0x7feb580b2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:27.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.642+0000 7feb577fe640 1 --2- 172.21.15.132:0/1694712452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb580b3b00 0x7feb580aeff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:27.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.643+0000 7feb4ffff640 1 -- 172.21.15.132:0/1694712452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb580b3b00 msgr2=0x7feb580aeff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:27.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.643+0000 7feb4ffff640 1 --2- 172.21.15.132:0/1694712452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb580b3b00 0x7feb580aeff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:27.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.643+0000 7feb4ffff640 1 -- 172.21.15.132:0/1694712452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb440039a0 msgr2=0x7feb580b2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:27.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.643+0000 7feb4ffff640 1 --2- 172.21.15.132:0/1694712452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb440039a0 0x7feb580b2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:27.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.643+0000 7feb4ffff640 1 -- 172.21.15.132:0/1694712452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb580c7200 con 0x7feb580c7ce0 2023-12-20T04:47:27.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.643+0000 7feb4ffff640 1 --2- 172.21.15.132:0/1694712452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb580c7ce0 0x7feb58150ea0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7feb400118e0 tx=0x7feb40011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:27.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.643+0000 7feb54ff9640 1 -- 172.21.15.132:0/1694712452 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb4000faf0 con 0x7feb580c7ce0 2023-12-20T04:47:27.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.643+0000 7feb54ff9640 1 -- 172.21.15.132:0/1694712452 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7feb4000fc50 con 0x7feb580c7ce0 2023-12-20T04:47:27.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.643+0000 7feb54ff9640 1 -- 172.21.15.132:0/1694712452 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7feb40014440 con 0x7feb580c7ce0 2023-12-20T04:47:27.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.643+0000 7feb5d836640 1 -- 172.21.15.132:0/1694712452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb580c74e0 con 0x7feb580c7ce0 2023-12-20T04:47:27.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.643+0000 7feb5d836640 1 -- 172.21.15.132:0/1694712452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb580c8140 con 0x7feb580c7ce0 2023-12-20T04:47:27.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.644+0000 7feb5d836640 1 -- 172.21.15.132:0/1694712452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb5804e840 con 0x7feb580c7ce0 2023-12-20T04:47:27.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.644+0000 7feb54ff9640 1 -- 172.21.15.132:0/1694712452 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7feb400145a0 con 0x7feb580c7ce0 2023-12-20T04:47:27.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.645+0000 7feb54ff9640 1 --2- 172.21.15.132:0/1694712452 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feb3806a430 0x7feb3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:27.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.645+0000 7feb56ffd640 1 --2- 172.21.15.132:0/1694712452 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feb3806a430 0x7feb3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:27.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.645+0000 7feb54ff9640 1 -- 172.21.15.132:0/1694712452 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(101..101 src has 1..101) v4 ==== 5709+0+0 (secure 0 0 0) 0x7feb40088f80 con 0x7feb580c7ce0 2023-12-20T04:47:27.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.645+0000 7feb56ffd640 1 --2- 172.21.15.132:0/1694712452 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feb3806a430 0x7feb3806c8f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7feb48033000 tx=0x7feb48009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:27.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.650+0000 7feb54ff9640 1 -- 172.21.15.132:0/1694712452 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7feb400bbca0 con 0x7feb580c7ce0 2023-12-20T04:47:27.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.816+0000 7feb5d836640 1 -- 172.21.15.132:0/1694712452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7feb580ae020 con 0x7feb580c7ce0 2023-12-20T04:47:27.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.817+0000 7feb54ff9640 1 -- 172.21.15.132:0/1694712452 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v101) v1 ==== 81+0+33578 (secure 0 0 0) 0x7feb400546b0 con 0x7feb580c7ce0 2023-12-20T04:47:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:27.820 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:47:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 101, 2023-12-20T04:47:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:47:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:47:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:47:13.302784+0000", 2023-12-20T04:47:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:47:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:47:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:47:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:47:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:47:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:47:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:47:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:47:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:47:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:47:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:47:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:47:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:47:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:47:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 13, 2023-12-20T04:47:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:47:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:47:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:47:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:47:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:47:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:47:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:47:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:47:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:47:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:47:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:47:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:47:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:47:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:47:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:47:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:47:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "91", 2023-12-20T04:47:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:47:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:47:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:47:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:47:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:47:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:47:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:47:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:47:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 12, 2023-12-20T04:47:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:47:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:47:10.649946+0000", 2023-12-20T04:47:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:47:27.828 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:47:27.828 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:27.828 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:27.828 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:27.828 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:27.828 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:27.828 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:27.828 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:27.828 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:27.828 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:27.828 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:27.828 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:47:27.828 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:47:27.828 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:47:27.828 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:47:27.829 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:47:27.829 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:27.829 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:27.829 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:27.829 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:27.829 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:27.829 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:27.829 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:27.829 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.829 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "100", 2023-12-20T04:47:27.829 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:27.829 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:27.829 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:27.829 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:27.829 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:27.830 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:27.830 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:27.830 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:27.830 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:27.830 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:27.830 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:27.830 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:27.830 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:27.830 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:27.830 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:27.830 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:27.830 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:27.830 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:27.830 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:27.830 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:27.831 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:27.831 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:27.831 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:27.831 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:27.831 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:27.831 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:27.831 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.831 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:27.831 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:27.831 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:27.831 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:27.831 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:27.831 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:27.831 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:27.831 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:27.832 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:27.832 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:27.832 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:27.832 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:27.832 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:47:27.832 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:47:27.832 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:47:27.832 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.832 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:27.832 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:47:27.832 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:47:27.832 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.832 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.832 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:27.832 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 2, 2023-12-20T04:47:27.832 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 2, 2023-12-20T04:47:27.833 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:47:27.833 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:47:27.833 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:47:27.833 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:27.833 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:27.833 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:27.833 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.833 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.833 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.833 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 13, 2023-12-20T04:47:27.833 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:47:27.833 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:47:11.271933+0000", 2023-12-20T04:47:27.833 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:47:27.833 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:47:27.833 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:27.834 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:27.834 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:27.834 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:27.834 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:27.834 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:27.834 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:27.834 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:27.834 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:27.834 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:27.834 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:47:27.834 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:47:27.834 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:47:27.834 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:47:27.834 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:47:27.834 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:27.835 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:27.835 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:27.835 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:27.835 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:27.835 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:27.835 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:27.835 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.835 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "101", 2023-12-20T04:47:27.835 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:27.835 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:27.835 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:27.835 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:27.835 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:27.835 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:27.835 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:27.836 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:27.836 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:27.836 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:27.836 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:27.836 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:27.836 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:27.836 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:27.836 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:27.836 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:27.836 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:27.836 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:27.836 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:27.836 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:27.836 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:27.836 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:27.837 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:27.837 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:27.837 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:27.837 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:27.837 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.837 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:27.837 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:27.837 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:27.837 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:27.837 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:27.837 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:27.837 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:27.837 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:27.837 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:27.837 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:27.838 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:27.838 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:27.838 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:47:27.838 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:47:27.838 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.838 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:27.838 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:47:27.838 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:47:27.838 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.838 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.838 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:27.838 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.3799999952316284, 2023-12-20T04:47:27.838 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.3799999952316284, 2023-12-20T04:47:27.838 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:47:27.838 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-20T04:47:27.839 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-20T04:47:27.839 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:27.839 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:27.839 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:27.839 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.839 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.839 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:27.839 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:47:27.839 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.839 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:47:27.839 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:27.839 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:27.839 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:27.839 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:27.839 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:27.840 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:27.840 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:27.840 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:27.840 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:27.840 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:27.840 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:27.840 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:27.840 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.840 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.840 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.840 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:47:27.840 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:27.840 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.840 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.840 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.840 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:47:27.841 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:27.841 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.841 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.841 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:27.841 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.841 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.841 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.841 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:47:27.841 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:27.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.841 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.841 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.841 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:47:27.841 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:27.842 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.842 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.842 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.842 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:27.842 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.842 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.842 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.842 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:47:27.842 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:27.842 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.842 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.842 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.842 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:47:27.842 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:27.842 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.843 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.843 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:27.843 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.843 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.843 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.843 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:47:27.843 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:27.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.843 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.843 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.843 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:47:27.843 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:27.843 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.843 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.844 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:47:27.844 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:47:27.844 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:47:27.844 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:47:27.844 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:27.844 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:27.844 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:27.844 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.844 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.844 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:47:27.844 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:27.844 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:27.844 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:27.844 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:27.845 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:27.845 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:27.845 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:27.845 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:27.845 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:27.845 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:27.845 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:27.845 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:27.845 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.845 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.845 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:47:27.845 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:27.845 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.846 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.846 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:47:27.846 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:27.846 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.846 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.846 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.846 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:27.846 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.846 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.846 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:47:27.846 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:27.846 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.846 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.847 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:47:27.847 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:27.847 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.847 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.847 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:27.847 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.847 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.847 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:47:27.847 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:27.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.847 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.847 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:47:27.847 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:27.848 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.848 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.848 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:27.848 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.848 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.848 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:47:27.848 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:27.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.848 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.848 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:47:27.848 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:27.848 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.848 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.849 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:47:27.849 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:47:27.849 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:47:27.849 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:47:27.849 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:27.849 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:27.849 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:27.849 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.849 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:47:27.849 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:27.849 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:27.849 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:47:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:27.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:47:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:47:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.851 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:47:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:47:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.852 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.853 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:47:27.853 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:27.853 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.853 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.853 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:27.853 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.853 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.853 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:47:27.853 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:27.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.853 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.854 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:47:27.854 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:27.854 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.854 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.854 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:47:27.854 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:47:27.854 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:47:27.854 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:47:27.854 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:27.854 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:27.854 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:27.854 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.854 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.855 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:47:27.855 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:27.855 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:27.855 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:27.855 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:27.855 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:27.855 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:27.855 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:27.855 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:27.855 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:27.855 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:27.855 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:27.855 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:27.855 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.856 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.856 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:47:27.856 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:27.856 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.856 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.856 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.856 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:47:27.856 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:27.856 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.856 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.856 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.856 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:27.856 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.856 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.856 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.857 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:47:27.857 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:27.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.857 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.857 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.857 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:47:27.857 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:27.857 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.857 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.857 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:27.857 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.857 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.857 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.858 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:47:27.858 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:27.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.858 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.858 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:47:27.858 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:27.858 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.858 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.858 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:27.858 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.858 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.858 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:47:27.859 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:27.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.859 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.859 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.859 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:47:27.859 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:27.859 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.859 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.859 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:47:27.859 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:47:27.859 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:47:27.859 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:47:27.859 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:27.859 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:27.859 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:27.860 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.860 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:47:27.860 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:27.860 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:27.860 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:27.860 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:27.860 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:27.860 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:27.860 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:27.860 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:27.860 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:27.860 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:27.860 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:27.861 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:27.861 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.861 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.861 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.861 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:47:27.861 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:27.861 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.861 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.861 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.861 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:47:27.861 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:27.861 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.861 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.861 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.861 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:27.862 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.862 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.862 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.862 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:47:27.862 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:27.862 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.862 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.862 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.862 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:47:27.862 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:27.862 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.862 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.862 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.862 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:27.862 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.862 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.863 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.863 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:47:27.863 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:27.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.863 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.863 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.863 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:47:27.863 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:27.863 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.863 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.863 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:27.863 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.863 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.863 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.864 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:47:27.864 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:27.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.864 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.864 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:47:27.864 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:27.864 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.864 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.864 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:47:27.864 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:47:27.864 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:47:27.864 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:47:27.864 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:27.865 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:27.865 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:27.865 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.865 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:47:27.865 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:27.865 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:27.865 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:27.865 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:27.865 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:27.865 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:27.865 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:27.865 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:27.865 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:27.866 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:27.866 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:27.866 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:27.866 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.866 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.866 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.866 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:47:27.866 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:27.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.866 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.866 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.866 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:47:27.866 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:27.866 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.866 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.867 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:27.867 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.867 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.867 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:47:27.867 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:27.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.867 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.867 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:47:27.867 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:27.867 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.867 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.868 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:27.868 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.868 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.868 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.868 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:47:27.868 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:27.868 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.868 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.868 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.868 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:47:27.868 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:27.868 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.868 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.868 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.868 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:27.869 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.869 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.869 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:47:27.869 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:27.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.869 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.869 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:47:27.869 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:27.869 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.869 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.869 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:47:27.869 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:47:27.870 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:47:27.870 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:47:27.870 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:27.870 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:27.870 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:27.870 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.870 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:47:27.870 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:27.870 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:27.870 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:27.870 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:27.870 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:27.871 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:27.871 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:27.871 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:27.871 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:27.871 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:27.871 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:27.871 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:27.871 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.871 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.871 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:47:27.871 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:27.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.872 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.872 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:47:27.872 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:27.872 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.872 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.872 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:27.872 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.872 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.872 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:47:27.872 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:27.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.872 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.873 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:47:27.873 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:27.873 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.873 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.873 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:27.873 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.873 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.873 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.873 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:47:27.873 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:27.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.873 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.873 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.873 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:47:27.874 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:27.874 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.874 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.874 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.874 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:27.874 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.874 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.874 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.874 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:47:27.874 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:27.874 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.874 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.874 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.874 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:47:27.874 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:27.875 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.875 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.875 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:47:27.875 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:47:27.875 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:47:27.875 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:47:27.875 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:27.875 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:27.875 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:27.875 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.875 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:47:27.875 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:27.875 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:27.876 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:27.876 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:27.876 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:27.876 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:27.876 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:27.876 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:27.876 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:27.876 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:27.876 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:27.876 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:27.876 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.876 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.876 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:47:27.876 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:27.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.877 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.877 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:47:27.877 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:27.877 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.877 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.877 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:27.877 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.877 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.877 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:47:27.877 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:27.878 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.878 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.878 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.878 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:47:27.878 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:27.878 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.878 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.878 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.878 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:27.878 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.878 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.878 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.878 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:47:27.878 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:27.878 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.878 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.879 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.879 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:47:27.879 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:27.879 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.879 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.879 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.879 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:27.879 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:27.879 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.879 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:27.879 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:47:27.879 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:27.879 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.879 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.880 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:27.880 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:47:27.880 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:27.880 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.880 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.880 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.880 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:47:27.880 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:47:27.880 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:47:27.880 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:47:27.880 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:27.880 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:27.880 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:27.880 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:27.880 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.881 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:27.881 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:47:27.881 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.881 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:47:27.881 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:27.881 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:27.881 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:27.881 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:27.881 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:27.881 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:47:27.881 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:27.881 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.881 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.881 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:47:27.881 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:27.882 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:27.882 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:27.882 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:27.882 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:27.882 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:47:27.882 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:27.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.882 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.882 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:47:27.882 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:27.882 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:27.882 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:27.882 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:27.882 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:27.882 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:47:27.882 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:27.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.883 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.883 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:47:27.883 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:27.883 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:27.883 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:27.883 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:27.883 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:27.883 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:47:27.883 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:27.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.883 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.883 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:47:27.883 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:27.883 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:27.884 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:27.884 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:27.884 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:27.884 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:47:27.884 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:27.884 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.884 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.884 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:47:27.884 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:27.884 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:27.884 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:27.884 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:27.884 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:27.884 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:47:27.885 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:27.885 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.885 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:47:27.885 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:27.885 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:27.885 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:27.885 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:27.885 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:27.885 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:47:27.885 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:27.885 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:27.885 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:47:27.886 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:27.886 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:27.886 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:27.886 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:27.886 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:27.886 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:47:27.886 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:27.886 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.886 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:27.886 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:47:27.886 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:47:27.886 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:47:27.886 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:47:27.886 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:47:27.886 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:47:27.887 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:47:27.887 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:47:27.887 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:47:27.887 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:47:27.887 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:47:27.887 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:47:27.887 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:47:27.887 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:47:27.887 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:27.887 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:47:27.887 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:47:27.887 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:47:27.887 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:47:27.887 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:47:27.888 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:47:27.888 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:47:27.888 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:47:27.888 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:47:27.888 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:47:27.888 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:47:27.888 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:27.888 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:47:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.820+0000 7feb5d836640 1 -- 172.21.15.132:0/1694712452 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feb3806a430 msgr2=0x7feb3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.820+0000 7feb5d836640 1 --2- 172.21.15.132:0/1694712452 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feb3806a430 0x7feb3806c8f0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7feb48033000 tx=0x7feb48009030 comp rx=0 tx=0).stop 2023-12-20T04:47:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.820+0000 7feb5d836640 1 -- 172.21.15.132:0/1694712452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb580c7ce0 msgr2=0x7feb58150ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.820+0000 7feb5d836640 1 --2- 172.21.15.132:0/1694712452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb580c7ce0 0x7feb58150ea0 secure :-1 s=READY pgs=1066 cs=0 l=1 rev1=1 crypto rx=0x7feb400118e0 tx=0x7feb40011da0 comp rx=0 tx=0).stop 2023-12-20T04:47:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.820+0000 7feb5d836640 1 -- 172.21.15.132:0/1694712452 shutdown_connections 2023-12-20T04:47:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.820+0000 7feb5d836640 1 --2- 172.21.15.132:0/1694712452 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feb3806a430 0x7feb3806c8f0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.820+0000 7feb5d836640 1 --2- 172.21.15.132:0/1694712452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7feb580b3b00 0x7feb580aeff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.820+0000 7feb5d836640 1 --2- 172.21.15.132:0/1694712452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7feb580c7ce0 0x7feb58150ea0 unknown :-1 s=CLOSED pgs=1066 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.820+0000 7feb5d836640 1 --2- 172.21.15.132:0/1694712452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7feb440039a0 0x7feb580b2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.820+0000 7feb5d836640 1 -- 172.21.15.132:0/1694712452 >> 172.21.15.132:0/1694712452 conn(0x7feb580ced10 msgr2=0x7feb58151a80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:27.890 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.820+0000 7feb5d836640 1 -- 172.21.15.132:0/1694712452 shutdown_connections 2023-12-20T04:47:27.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:27.820+0000 7feb5d836640 1 -- 172.21.15.132:0/1694712452 wait complete. 2023-12-20T04:47:27.891 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-20T04:47:28.852 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:47:28.851+0000 7f1a5f3c2640 -1 log_channel(cluster) log [ERR] : Health check failed: 2 full osd(s) (OSD_FULL) 2023-12-20T04:47:32.892 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:47:33.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.003+0000 7f6bebe38640 1 Processor -- start 2023-12-20T04:47:33.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.003+0000 7f6bebe38640 1 -- start start 2023-12-20T04:47:33.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.004+0000 7f6bebe38640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6be415aed0 0x7f6be406c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.004+0000 7f6bebe38640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6be40b13e0 0x7f6be40c9d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.004+0000 7f6bebe38640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6be415f3a0 con 0x7f6be40b0fa0 2023-12-20T04:47:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.004+0000 7f6bebe38640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6be4071c90 con 0x7f6be40b13e0 2023-12-20T04:47:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.004+0000 7f6bebe38640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be40cc190 con 0x7f6be415aed0 2023-12-20T04:47:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.004+0000 7f6bea3d5640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6be40b13e0 0x7f6be40c9d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.004+0000 7f6be9bd4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6be415aed0 0x7f6be406c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.004+0000 7f6bea3d5640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6be40b13e0 0x7f6be40c9d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:39076/0 (socket says 172.21.15.132:39076) 2023-12-20T04:47:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.004+0000 7f6bea3d5640 1 -- 172.21.15.132:0/1351053882 learned_addr learned my addr 172.21.15.132:0/1351053882 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.004+0000 7f6be93d3640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f6be40b0fa0 0x7f6be40c9640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:43576/0 (socket says 172.21.15.132:43576) 2023-12-20T04:47:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.004+0000 7f6be9bd4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6be415aed0 0x7f6be406c0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:49224/0 (socket says 172.21.15.132:49224) 2023-12-20T04:47:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.005+0000 7f6bea3d5640 1 -- 172.21.15.132:0/1351053882 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6be415aed0 msgr2=0x7f6be406c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.005+0000 7f6bea3d5640 1 --2- 172.21.15.132:0/1351053882 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6be415aed0 0x7f6be406c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.005+0000 7f6bea3d5640 1 -- 172.21.15.132:0/1351053882 >> v1:172.21.15.187:6789/0 conn(0x7f6be40b0fa0 legacy=0x7f6be40c9640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.005+0000 7f6bea3d5640 1 -- 172.21.15.132:0/1351053882 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be415eae0 con 0x7f6be40b13e0 2023-12-20T04:47:33.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.005+0000 7f6be9bd4640 1 --2- 172.21.15.132:0/1351053882 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6be415aed0 0x7f6be406c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:47:33.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.005+0000 7f6bea3d5640 1 --2- 172.21.15.132:0/1351053882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be40b13e0 0x7f6be40c9d50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc009e50 tx=0x7f6bdc02bf60 comp rx=0 tx=0).ready entity=mon.1 client_cookie=51eceb61eaf08af6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:33.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.006+0000 7f6be8bd2640 1 -- 172.21.15.132:0/1351053882 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc02cb00 con 0x7f6be40b13e0 2023-12-20T04:47:33.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.006+0000 7f6be8bd2640 1 -- 172.21.15.132:0/1351053882 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6bdc02cc60 con 0x7f6be40b13e0 2023-12-20T04:47:33.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.006+0000 7f6be8bd2640 1 -- 172.21.15.132:0/1351053882 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6bdc0343f0 con 0x7f6be40b13e0 2023-12-20T04:47:33.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.006+0000 7f6bebe38640 1 -- 172.21.15.132:0/1351053882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be40b13e0 msgr2=0x7f6be40c9d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.006+0000 7f6bebe38640 1 --2- 172.21.15.132:0/1351053882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be40b13e0 0x7f6be40c9d50 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f6bdc009e50 tx=0x7f6bdc02bf60 comp rx=0 tx=0).stop 2023-12-20T04:47:33.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.006+0000 7f6bebe38640 1 -- 172.21.15.132:0/1351053882 shutdown_connections 2023-12-20T04:47:33.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.006+0000 7f6bebe38640 1 --2- 172.21.15.132:0/1351053882 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be40b13e0 0x7f6be40c9d50 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.006+0000 7f6bebe38640 1 --2- 172.21.15.132:0/1351053882 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6be415aed0 0x7f6be406c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.006+0000 7f6bebe38640 1 -- 172.21.15.132:0/1351053882 >> 172.21.15.132:0/1351053882 conn(0x7f6be406a050 msgr2=0x7f6be406a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:33.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.006+0000 7f6bebe38640 1 -- 172.21.15.132:0/1351053882 shutdown_connections 2023-12-20T04:47:33.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.006+0000 7f6bebe38640 1 -- 172.21.15.132:0/1351053882 wait complete. 2023-12-20T04:47:33.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.007+0000 7f6bebe38640 1 Processor -- start 2023-12-20T04:47:33.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.007+0000 7f6bebe38640 1 -- start start 2023-12-20T04:47:33.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.008+0000 7f6bebe38640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6be40b0fa0 0x7f6be4151860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.008+0000 7f6bebe38640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be40b13e0 0x7f6be41f38b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.008+0000 7f6bebe38640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6be415aed0 0x7f6be415d770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.008+0000 7f6bebe38640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be4154650 con 0x7f6be40b0fa0 2023-12-20T04:47:33.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.008+0000 7f6bebe38640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be415b650 con 0x7f6be40b13e0 2023-12-20T04:47:33.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.008+0000 7f6bebe38640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6be415b930 con 0x7f6be415aed0 2023-12-20T04:47:33.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.008+0000 7f6be9bd4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6be40b0fa0 0x7f6be4151860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.008+0000 7f6be9bd4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6be40b0fa0 0x7f6be4151860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37328/0 (socket says 172.21.15.132:37328) 2023-12-20T04:47:33.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.008+0000 7f6be9bd4640 1 -- 172.21.15.132:0/1025166976 learned_addr learned my addr 172.21.15.132:0/1025166976 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:33.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.009+0000 7f6bea3d5640 1 --2- 172.21.15.132:0/1025166976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6be415aed0 0x7f6be415d770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.009+0000 7f6be93d3640 1 --2- 172.21.15.132:0/1025166976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be40b13e0 0x7f6be41f38b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.009+0000 7f6be9bd4640 1 -- 172.21.15.132:0/1025166976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6be415aed0 msgr2=0x7f6be415d770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.009+0000 7f6be9bd4640 1 --2- 172.21.15.132:0/1025166976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6be415aed0 0x7f6be415d770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.009+0000 7f6be9bd4640 1 -- 172.21.15.132:0/1025166976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be40b13e0 msgr2=0x7f6be41f38b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.009+0000 7f6be9bd4640 1 --2- 172.21.15.132:0/1025166976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be40b13e0 0x7f6be41f38b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.009+0000 7f6be9bd4640 1 -- 172.21.15.132:0/1025166976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6be0009400 con 0x7f6be40b0fa0 2023-12-20T04:47:33.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.009+0000 7f6be93d3640 1 --2- 172.21.15.132:0/1025166976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be40b13e0 0x7f6be41f38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:33.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.009+0000 7f6be9bd4640 1 --2- 172.21.15.132:0/1025166976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6be40b0fa0 0x7f6be4151860 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f6be000e960 tx=0x7f6be000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:33.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.009+0000 7f6bda7fc640 1 -- 172.21.15.132:0/1025166976 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be000ca00 con 0x7f6be40b0fa0 2023-12-20T04:47:33.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.009+0000 7f6bda7fc640 1 -- 172.21.15.132:0/1025166976 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6be000cb60 con 0x7f6be40b0fa0 2023-12-20T04:47:33.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.009+0000 7f6bebe38640 1 -- 172.21.15.132:0/1025166976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bdc009b30 con 0x7f6be40b0fa0 2023-12-20T04:47:33.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.009+0000 7f6bda7fc640 1 -- 172.21.15.132:0/1025166976 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6be0013470 con 0x7f6be40b0fa0 2023-12-20T04:47:33.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.009+0000 7f6bebe38640 1 -- 172.21.15.132:0/1025166976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be415bef0 con 0x7f6be40b0fa0 2023-12-20T04:47:33.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.010+0000 7f6bebe38640 1 -- 172.21.15.132:0/1025166976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be4066820 con 0x7f6be40b0fa0 2023-12-20T04:47:33.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.010+0000 7f6bda7fc640 1 -- 172.21.15.132:0/1025166976 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6be00135d0 con 0x7f6be40b0fa0 2023-12-20T04:47:33.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.011+0000 7f6bda7fc640 1 --2- 172.21.15.132:0/1025166976 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6bc806a430 0x7f6bc806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.011+0000 7f6bda7fc640 1 -- 172.21.15.132:0/1025166976 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6be0088b00 con 0x7f6be40b0fa0 2023-12-20T04:47:33.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.011+0000 7f6be93d3640 1 --2- 172.21.15.132:0/1025166976 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6bc806a430 0x7f6bc806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.011+0000 7f6bda7fc640 1 -- 172.21.15.132:0/1025166976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=106}) v3 -- 0x7f6bc8071f60 con 0x7f6be40b0fa0 2023-12-20T04:47:33.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.011+0000 7f6be93d3640 1 --2- 172.21.15.132:0/1025166976 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6bc806a430 0x7f6bc806c8f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6be40ca750 tx=0x7f6bd4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:33.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.015+0000 7f6bda7fc640 1 -- 172.21.15.132:0/1025166976 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6be0054180 con 0x7f6be40b0fa0 2023-12-20T04:47:33.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.183+0000 7f6bebe38640 1 -- 172.21.15.132:0/1025166976 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f6be404e840 con 0x7f6be40b0fa0 2023-12-20T04:47:33.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.184+0000 7f6bda7fc640 1 -- 172.21.15.132:0/1025166976 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v105) v1 ==== 81+0+33746 (secure 0 0 0) 0x7f6be0021020 con 0x7f6be40b0fa0 2023-12-20T04:47:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:33.187 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:47:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 105, 2023-12-20T04:47:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:47:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:47:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:47:32.919536+0000", 2023-12-20T04:47:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:47:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:47:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:47:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:47:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:47:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:47:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:47:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:47:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:47:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:47:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:47:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:47:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:47:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:47:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 13, 2023-12-20T04:47:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:47:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:47:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:47:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:47:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:47:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:47:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:47:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:47:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:47:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:47:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:47:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:47:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:47:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:47:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:47:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:47:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "102", 2023-12-20T04:47:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:47:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:47:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:47:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:47:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:47:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:47:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:47:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:47:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 12, 2023-12-20T04:47:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:47:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:47:10.649946+0000", 2023-12-20T04:47:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:47:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:47:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:47:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:47:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:47:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:47:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:47:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "102", 2023-12-20T04:47:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:47:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:47:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:47:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:47:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:47:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 2, 2023-12-20T04:47:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 2, 2023-12-20T04:47:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:47:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:47:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:47:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 13, 2023-12-20T04:47:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:47:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:47:11.271933+0000", 2023-12-20T04:47:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:47:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:47:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:47:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:47:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:47:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:47:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:47:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:33.203 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:33.203 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:33.203 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:33.203 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:33.203 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.203 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "102", 2023-12-20T04:47:33.203 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:33.203 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:33.203 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:33.203 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:33.203 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:33.203 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:33.203 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:33.204 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:33.204 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:33.204 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:33.204 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:33.204 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:33.204 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:33.204 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:33.204 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:33.204 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:33.204 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:33.204 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:33.204 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:33.204 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:33.204 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:33.205 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:33.205 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:33.205 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:33.205 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:33.205 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:33.205 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.205 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:33.205 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:33.205 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:33.205 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:33.205 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:33.205 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:33.205 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:33.206 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:33.206 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:33.206 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:33.206 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:33.206 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:33.206 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:47:33.206 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:47:33.206 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.206 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:33.206 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:47:33.206 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:47:33.206 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.206 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.206 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:33.206 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.3799999952316284, 2023-12-20T04:47:33.207 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.3799999952316284, 2023-12-20T04:47:33.207 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:47:33.207 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-20T04:47:33.207 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-20T04:47:33.207 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:33.207 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:33.207 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:33.207 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.207 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.207 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:33.207 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:47:33.207 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.207 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:47:33.208 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:33.208 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:33.208 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:33.208 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:33.208 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:33.208 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:33.208 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:33.208 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:33.208 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:33.208 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:33.208 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:33.208 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:33.208 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.208 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.208 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.209 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:47:33.209 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:33.209 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.209 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.209 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.209 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:47:33.209 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:33.209 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.209 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.209 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.209 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:33.209 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.209 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.210 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.210 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:47:33.210 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:33.210 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.210 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.210 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.210 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:47:33.210 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:33.210 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.210 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.210 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.210 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:33.210 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.210 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.211 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.211 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:47:33.211 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:33.211 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.211 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.211 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.211 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:47:33.211 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:33.211 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.211 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.211 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.211 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:33.211 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.211 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:47:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:47:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:47:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:47:33.212 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:47:33.213 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:47:33.213 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:33.213 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:33.213 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:33.213 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:33.213 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.213 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.213 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.213 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:47:33.213 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:33.213 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:33.213 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:33.213 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:33.213 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:33.214 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:33.214 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:33.214 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:33.214 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:33.214 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:33.214 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:33.214 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:33.214 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.214 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.214 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.214 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:47:33.214 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:33.214 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.214 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.214 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.215 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:47:33.215 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:33.215 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.215 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.215 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.215 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:33.215 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.215 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.215 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.215 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:47:33.215 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:33.215 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.215 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.215 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.215 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:47:33.216 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:33.216 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.216 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.216 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.216 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:33.216 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.216 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.216 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.216 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:47:33.216 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:33.216 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.216 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.216 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.216 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:47:33.216 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:33.217 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.217 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.217 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.217 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:33.217 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.217 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.217 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.217 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:47:33.217 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:33.217 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.217 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.217 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.217 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:47:33.218 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:33.218 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.218 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.218 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.218 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:47:33.218 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:47:33.218 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:47:33.218 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:47:33.218 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:33.218 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:33.218 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:33.218 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:33.218 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.218 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.218 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.219 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:47:33.219 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:33.219 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:33.219 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:33.219 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:33.219 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:33.219 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:33.219 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:33.219 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:33.219 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:33.219 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:33.219 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:33.219 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:33.219 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.220 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.220 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.220 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:47:33.220 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:33.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.220 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.220 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.220 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:47:33.220 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:33.220 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.220 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.220 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.220 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:33.220 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.220 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.220 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.221 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:47:33.221 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:33.221 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.221 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.221 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.221 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:47:33.221 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:33.221 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.221 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.221 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.221 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:33.221 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.221 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.222 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.222 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:47:33.222 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:33.222 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.222 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.222 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.222 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:47:33.222 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:33.222 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.222 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.222 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.222 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:33.222 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.222 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.222 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.223 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:47:33.223 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:33.223 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.223 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.223 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.223 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:47:33.223 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:33.223 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.223 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.223 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.223 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:47:33.223 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:47:33.223 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:47:33.223 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:47:33.223 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:33.224 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:33.224 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:33.224 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:33.224 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.224 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.224 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.224 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:47:33.224 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:33.224 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:33.224 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:33.224 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:33.224 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:33.224 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:33.224 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:33.225 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:33.225 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:33.225 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:33.225 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:33.225 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:33.225 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.225 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.225 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.225 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:47:33.225 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:33.225 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.225 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.225 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.225 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:47:33.226 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:33.226 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.226 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.226 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.226 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:33.226 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.226 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.226 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.226 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:47:33.226 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:33.226 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.226 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.226 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.226 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:47:33.226 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:33.227 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.227 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.227 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:33.227 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.227 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.227 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.227 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:47:33.227 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:33.227 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.227 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.227 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.227 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:47:33.227 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:33.228 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.228 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.228 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.228 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:33.228 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.228 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.228 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.228 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:47:33.228 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:33.228 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.228 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.228 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.228 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:47:33.228 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:33.228 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.229 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.229 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.229 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:47:33.229 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:47:33.229 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:47:33.229 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:47:33.229 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:33.229 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:33.229 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:33.229 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.229 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.229 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.229 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:47:33.229 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:33.229 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:33.230 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:33.230 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:33.230 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:33.230 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:33.230 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:33.230 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:33.230 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:33.230 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:33.230 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:33.230 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:33.230 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.230 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.230 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.230 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:47:33.230 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:33.231 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.231 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.231 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.231 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:47:33.231 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:33.231 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.231 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.231 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.231 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:33.231 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.231 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.231 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.231 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:47:33.231 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:33.231 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.232 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.232 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.232 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:47:33.232 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:33.232 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.232 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.232 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.232 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:33.232 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.232 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.232 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.232 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:47:33.232 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:33.232 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.232 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.233 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.233 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:47:33.233 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:33.233 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.233 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.233 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.233 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:33.233 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.233 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.233 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.233 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:47:33.233 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:33.233 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.233 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.233 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.234 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:47:33.234 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:33.234 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.234 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.234 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.234 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:47:33.234 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:47:33.234 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:47:33.234 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:47:33.234 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:33.234 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:33.234 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:33.234 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:33.234 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.234 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.235 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.235 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:47:33.235 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:33.235 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:33.235 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:33.235 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:33.235 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:33.235 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:33.235 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:33.235 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:33.235 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:33.235 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:33.235 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:33.235 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:33.235 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.236 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.236 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.236 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:47:33.236 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:33.236 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.236 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.236 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.236 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:47:33.236 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:33.236 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.236 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.236 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.236 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:33.236 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.236 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.237 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.237 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:47:33.237 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:33.237 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.237 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.237 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.237 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:47:33.237 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:33.237 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.237 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.237 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.237 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:33.237 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.237 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.238 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.238 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:47:33.238 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:33.238 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.238 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.238 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.238 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:47:33.238 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:33.238 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.238 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.238 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.238 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:33.238 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.238 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.238 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.239 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:47:33.239 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:33.239 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.239 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.239 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.239 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:47:33.239 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:33.239 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.239 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.239 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.239 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:47:33.239 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:47:33.239 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:47:33.239 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:47:33.240 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:33.240 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:33.240 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:33.240 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.240 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.240 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.240 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:47:33.240 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:33.240 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:33.240 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:33.240 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:33.240 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:33.240 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:33.240 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:33.240 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:33.241 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:33.241 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:33.241 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:33.241 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:33.241 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.241 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.241 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.241 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:47:33.241 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:33.241 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.241 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.241 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.241 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:47:33.241 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:33.242 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.242 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.242 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.242 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:33.242 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.242 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.242 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.242 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:47:33.242 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:33.242 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.242 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.242 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.242 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:47:33.242 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:33.243 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.243 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.243 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.243 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:33.243 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.243 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.243 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.243 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:47:33.243 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:33.243 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.243 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.243 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.243 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:47:33.243 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:33.243 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.244 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.244 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.244 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:33.244 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.244 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.244 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.244 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:47:33.244 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:33.244 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.244 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.244 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.244 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:47:33.244 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:33.244 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.245 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.245 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.245 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:47:33.245 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:47:33.245 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:47:33.245 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:47:33.245 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:33.245 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:33.245 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:33.245 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:33.245 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.245 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.245 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.245 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:47:33.245 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:33.246 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:33.246 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:33.246 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:33.246 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:33.246 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:33.246 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:33.246 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:33.246 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:33.246 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:33.246 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:33.248 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:33.248 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.248 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.248 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.248 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:47:33.248 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:33.249 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.249 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.249 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.249 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:47:33.249 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:33.249 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.249 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.249 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.249 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:33.249 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.249 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.249 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.249 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:47:33.249 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:33.250 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.250 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.250 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.250 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:47:33.250 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:33.250 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.250 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.250 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.250 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:33.250 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.250 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.250 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.250 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:47:33.250 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:33.251 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.251 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.251 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.251 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:47:33.251 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:33.251 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.251 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.251 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.251 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:33.251 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.251 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.251 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.251 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:47:33.251 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:33.252 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.252 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.252 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.252 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:47:33.252 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:33.252 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.252 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.252 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.252 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:47:33.252 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:47:33.252 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:47:33.252 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:47:33.252 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:33.252 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull", 2023-12-20T04:47:33.252 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:33.253 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:33.253 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.253 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.253 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:33.253 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:47:33.253 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.253 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:47:33.253 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:33.253 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:33.253 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:33.253 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:33.253 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:33.253 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:47:33.253 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:47:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:47:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:47:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:33.254 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:47:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:47:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:47:33.255 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:47:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:47:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:47:33.256 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:33.257 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:33.257 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:33.257 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:33.257 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:33.257 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:47:33.257 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:33.257 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.257 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.257 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:47:33.257 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:33.257 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:33.257 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:33.257 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:33.257 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:33.257 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:47:33.258 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:33.258 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.258 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.258 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:47:33.258 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:33.258 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:33.258 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:33.258 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:33.258 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:33.258 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:47:33.258 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:33.258 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.258 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:33.259 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:47:33.259 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:47:33.259 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:47:33.259 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:47:33.259 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:47:33.259 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:47:33.259 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:47:33.259 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:47:33.259 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:47:33.259 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:47:33.259 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:47:33.259 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:47:33.259 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:47:33.259 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:47:33.259 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.260 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.260 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:47:33.260 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:47:33.260 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:47:33.260 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:47:33.260 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:47:33.260 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:47:33.260 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:47:33.260 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:47:33.260 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:47:33.260 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:47:33.260 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:47:33.260 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.260 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:47:33.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.186+0000 7f6bebe38640 1 -- 172.21.15.132:0/1025166976 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6bc806a430 msgr2=0x7f6bc806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.186+0000 7f6bebe38640 1 --2- 172.21.15.132:0/1025166976 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6bc806a430 0x7f6bc806c8f0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f6be40ca750 tx=0x7f6bd4009040 comp rx=0 tx=0).stop 2023-12-20T04:47:33.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.186+0000 7f6bebe38640 1 -- 172.21.15.132:0/1025166976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6be40b0fa0 msgr2=0x7f6be4151860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.186+0000 7f6bebe38640 1 --2- 172.21.15.132:0/1025166976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6be40b0fa0 0x7f6be4151860 secure :-1 s=READY pgs=1067 cs=0 l=1 rev1=1 crypto rx=0x7f6be000e960 tx=0x7f6be000ee20 comp rx=0 tx=0).stop 2023-12-20T04:47:33.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.186+0000 7f6bebe38640 1 -- 172.21.15.132:0/1025166976 shutdown_connections 2023-12-20T04:47:33.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.186+0000 7f6bebe38640 1 --2- 172.21.15.132:0/1025166976 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6bc806a430 0x7f6bc806c8f0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.186+0000 7f6bebe38640 1 --2- 172.21.15.132:0/1025166976 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6be415aed0 0x7f6be415d770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.186+0000 7f6bebe38640 1 --2- 172.21.15.132:0/1025166976 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6be40b13e0 0x7f6be41f38b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.186+0000 7f6bebe38640 1 --2- 172.21.15.132:0/1025166976 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6be40b0fa0 0x7f6be4151860 unknown :-1 s=CLOSED pgs=1067 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.186+0000 7f6bebe38640 1 -- 172.21.15.132:0/1025166976 >> 172.21.15.132:0/1025166976 conn(0x7f6be406a050 msgr2=0x7f6be40ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:33.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.186+0000 7f6bebe38640 1 -- 172.21.15.132:0/1025166976 shutdown_connections 2023-12-20T04:47:33.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.186+0000 7f6bebe38640 1 -- 172.21.15.132:0/1025166976 wait complete. 2023-12-20T04:47:33.263 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-20T04:47:33.264 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:47:33.264 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:47:33.280 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:33.280 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=265) 2023-12-20T04:47:33.400 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:47:33.400 INFO:teuthology.orchestra.run.smithi132.stderr:dd: error writing 'large_file_b': No space left on device 2023-12-20T04:47:33.400 INFO:teuthology.orchestra.run.smithi132.stderr:dd: closing output file 'large_file_b': No space left on device 2023-12-20T04:47:33.401 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:47:33.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.499+0000 7f33ee6db640 1 Processor -- start 2023-12-20T04:47:33.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.499+0000 7f33ee6db640 1 -- start start 2023-12-20T04:47:33.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.500+0000 7f33ee6db640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f33e80af210 0x7f33e8168120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.500+0000 7f33ee6db640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e8161ce0 con 0x7f33e815d4f0 2023-12-20T04:47:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.500+0000 7f33ee6db640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33e80aca50 con 0x7f33e815d110 2023-12-20T04:47:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.500+0000 7f33ee6db640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33e8160df0 con 0x7f33e80af210 2023-12-20T04:47:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.500+0000 7f33e77fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f33e815d4f0 0x7f33e80aeb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44040/0 (socket says 172.21.15.132:44040) 2023-12-20T04:47:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.500+0000 7f33e77fe640 1 -- 172.21.15.132:0/1543275749 learned_addr learned my addr 172.21.15.132:0/1543275749 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.500+0000 7f33ecc78640 1 --2- 172.21.15.132:0/1543275749 >> v2:172.21.15.187:3300/0 conn(0x7f33e80af210 0x7f33e8168120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.500+0000 7f33e6ffd640 1 -- 172.21.15.132:0/1543275749 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 787614482 0 0) 0x7f33e8161ce0 con 0x7f33e815d4f0 2023-12-20T04:47:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.500+0000 7f33e6ffd640 1 -- 172.21.15.132:0/1543275749 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33d0003520 con 0x7f33e815d4f0 2023-12-20T04:47:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e6ffd640 1 -- 172.21.15.132:0/1543275749 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2392464155 0 0) 0x7f33d0003520 con 0x7f33e815d4f0 2023-12-20T04:47:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e6ffd640 1 -- 172.21.15.132:0/1543275749 >> v2:172.21.15.187:3300/0 conn(0x7f33e80af210 msgr2=0x7f33e8168120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e6ffd640 1 --2- 172.21.15.132:0/1543275749 >> v2:172.21.15.187:3300/0 conn(0x7f33e80af210 0x7f33e8168120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e6ffd640 1 -- 172.21.15.132:0/1543275749 >> v1:172.21.15.187:6789/0 conn(0x7f33e815d110 legacy=0x7f33e8069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e6ffd640 1 -- 172.21.15.132:0/1543275749 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e81610d0 con 0x7f33e815d4f0 2023-12-20T04:47:33.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e6ffd640 1 -- 172.21.15.132:0/1543275749 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f33dc001670 con 0x7f33e815d4f0 2023-12-20T04:47:33.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e6ffd640 1 -- 172.21.15.132:0/1543275749 >> v1:172.21.15.132:6789/0 conn(0x7f33e815d4f0 legacy=0x7f33e80aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e6ffd640 1 --2- 172.21.15.132:0/1543275749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33d0003970 0x7f33d0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e6ffd640 1 --2- 172.21.15.132:0/1543275749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33d00047c0 0x7f33d0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e6ffd640 1 --2- 172.21.15.132:0/1543275749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33d0005180 0x7f33d000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e6ffd640 1 -- 172.21.15.132:0/1543275749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e8160df0 con 0x7f33d0003970 2023-12-20T04:47:33.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e6ffd640 1 -- 172.21.15.132:0/1543275749 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33d000c020 con 0x7f33d00047c0 2023-12-20T04:47:33.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e6ffd640 1 -- 172.21.15.132:0/1543275749 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33d000c1e0 con 0x7f33d0005180 2023-12-20T04:47:33.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e7fff640 1 --2- 172.21.15.132:0/1543275749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33d0003970 0x7f33d0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e77fe640 1 --2- 172.21.15.132:0/1543275749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33d00047c0 0x7f33d0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33ecc78640 1 --2- 172.21.15.132:0/1543275749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33d0005180 0x7f33d000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e7fff640 1 -- 172.21.15.132:0/1543275749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33d0005180 msgr2=0x7f33d000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:33.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e7fff640 1 --2- 172.21.15.132:0/1543275749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33d0005180 0x7f33d000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e7fff640 1 -- 172.21.15.132:0/1543275749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33d00047c0 msgr2=0x7f33d0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e7fff640 1 --2- 172.21.15.132:0/1543275749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33d00047c0 0x7f33d0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33ecc78640 1 -- 172.21.15.132:0/1543275749 reap_dead start 2023-12-20T04:47:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e7fff640 1 -- 172.21.15.132:0/1543275749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33d0003520 con 0x7f33d0003970 2023-12-20T04:47:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.501+0000 7f33e77fe640 1 --2- 172.21.15.132:0/1543275749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33d00047c0 0x7f33d0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.502+0000 7f33e7fff640 1 --2- 172.21.15.132:0/1543275749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33d0003970 0x7f33d0003d90 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f33d8001770 tx=0x7f33d00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d25a4863012c1ee server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.502+0000 7f33e6ffd640 1 -- 172.21.15.132:0/1543275749 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d80052d0 con 0x7f33d0003970 2023-12-20T04:47:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.502+0000 7f33e6ffd640 1 -- 172.21.15.132:0/1543275749 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33d802e050 con 0x7f33d0003970 2023-12-20T04:47:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.502+0000 7f33e6ffd640 1 -- 172.21.15.132:0/1543275749 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33d8003640 con 0x7f33d0003970 2023-12-20T04:47:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.502+0000 7f33ee6db640 1 -- 172.21.15.132:0/1543275749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33d0003970 msgr2=0x7f33d0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.502+0000 7f33ee6db640 1 --2- 172.21.15.132:0/1543275749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33d0003970 0x7f33d0003d90 secure :-1 s=READY pgs=1069 cs=0 l=1 rev1=1 crypto rx=0x7f33d8001770 tx=0x7f33d00057f0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.502+0000 7f33ee6db640 1 -- 172.21.15.132:0/1543275749 shutdown_connections 2023-12-20T04:47:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.502+0000 7f33ee6db640 1 --2- 172.21.15.132:0/1543275749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33d0003970 0x7f33d0003d90 unknown :-1 s=CLOSED pgs=1069 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.502+0000 7f33ee6db640 1 -- 172.21.15.132:0/1543275749 >> 172.21.15.132:0/1543275749 conn(0x7f33e80cfbd0 msgr2=0x7f33e80cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.502+0000 7f33ee6db640 1 -- 172.21.15.132:0/1543275749 shutdown_connections 2023-12-20T04:47:33.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.502+0000 7f33ee6db640 1 -- 172.21.15.132:0/1543275749 wait complete. 2023-12-20T04:47:33.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.504+0000 7f33ee6db640 1 Processor -- start 2023-12-20T04:47:33.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.504+0000 7f33ee6db640 1 -- start start 2023-12-20T04:47:33.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.504+0000 7f33ee6db640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33d0003970 0x7f33e80b0040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.504+0000 7f33ee6db640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33e8160610 0x7f33e81f2170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.504+0000 7f33ee6db640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33e80c7950 0x7f33e80c7db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.504+0000 7f33ee6db640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e80c82f0 con 0x7f33e80c7950 2023-12-20T04:47:33.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.504+0000 7f33ee6db640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33e806d260 con 0x7f33d0003970 2023-12-20T04:47:33.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.504+0000 7f33ee6db640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33e806d540 con 0x7f33e8160610 2023-12-20T04:47:33.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.505+0000 7f33ecc78640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33e80c7950 0x7f33e80c7db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.505+0000 7f33ecc78640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33e80c7950 0x7f33e80c7db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37348/0 (socket says 172.21.15.132:37348) 2023-12-20T04:47:33.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.505+0000 7f33ecc78640 1 -- 172.21.15.132:0/632201579 learned_addr learned my addr 172.21.15.132:0/632201579 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:33.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.505+0000 7f33e77fe640 1 --2- 172.21.15.132:0/632201579 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33e8160610 0x7f33e81f2170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.505+0000 7f33e7fff640 1 --2- 172.21.15.132:0/632201579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33d0003970 0x7f33e80b0040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.505+0000 7f33ecc78640 1 -- 172.21.15.132:0/632201579 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33e8160610 msgr2=0x7f33e81f2170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.505+0000 7f33ecc78640 1 --2- 172.21.15.132:0/632201579 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33e8160610 0x7f33e81f2170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.505+0000 7f33ecc78640 1 -- 172.21.15.132:0/632201579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33d0003970 msgr2=0x7f33e80b0040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.505+0000 7f33ecc78640 1 --2- 172.21.15.132:0/632201579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33d0003970 0x7f33e80b0040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.505+0000 7f33ecc78640 1 -- 172.21.15.132:0/632201579 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33e80b0940 con 0x7f33e80c7950 2023-12-20T04:47:33.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.505+0000 7f33ecc78640 1 --2- 172.21.15.132:0/632201579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33e80c7950 0x7f33e80c7db0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f33e80c6500 tx=0x7f33e00115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:33.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.505+0000 7f33e4ff9640 1 -- 172.21.15.132:0/632201579 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e000e070 con 0x7f33e80c7950 2023-12-20T04:47:33.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.505+0000 7f33e4ff9640 1 -- 172.21.15.132:0/632201579 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e0011c30 con 0x7f33e80c7950 2023-12-20T04:47:33.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.505+0000 7f33ee6db640 1 -- 172.21.15.132:0/632201579 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33e80b0c20 con 0x7f33e80c7950 2023-12-20T04:47:33.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.505+0000 7f33e4ff9640 1 -- 172.21.15.132:0/632201579 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e0011de0 con 0x7f33e80c7950 2023-12-20T04:47:33.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.505+0000 7f33ee6db640 1 -- 172.21.15.132:0/632201579 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33e80b0580 con 0x7f33e80c7950 2023-12-20T04:47:33.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.506+0000 7f33ee6db640 1 -- 172.21.15.132:0/632201579 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33e804e840 con 0x7f33e80c7950 2023-12-20T04:47:33.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.507+0000 7f33e4ff9640 1 -- 172.21.15.132:0/632201579 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f33e0003ba0 con 0x7f33e80c7950 2023-12-20T04:47:33.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.507+0000 7f33e4ff9640 1 --2- 172.21.15.132:0/632201579 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33d406a460 0x7f33d406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.507+0000 7f33e7fff640 1 --2- 172.21.15.132:0/632201579 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33d406a460 0x7f33d406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.507+0000 7f33e4ff9640 1 -- 172.21.15.132:0/632201579 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33e0088e80 con 0x7f33e80c7950 2023-12-20T04:47:33.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.507+0000 7f33e4ff9640 1 -- 172.21.15.132:0/632201579 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=106}) v3 -- 0x7f33d4071f90 con 0x7f33e80c7950 2023-12-20T04:47:33.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.508+0000 7f33e7fff640 1 --2- 172.21.15.132:0/632201579 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33d406a460 0x7f33d406c920 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f33d8033000 tx=0x7f33d8009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:33.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.511+0000 7f33e4ff9640 1 -- 172.21.15.132:0/632201579 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f33e0054500 con 0x7f33e80c7950 2023-12-20T04:47:33.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.677+0000 7f33ee6db640 1 -- 172.21.15.132:0/632201579 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f33e80b0710 con 0x7f33e80c7950 2023-12-20T04:47:33.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.678+0000 7f33e4ff9640 1 -- 172.21.15.132:0/632201579 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v105) v1 ==== 81+0+33746 (secure 0 0 0) 0x7f33e0057b20 con 0x7f33e80c7950 2023-12-20T04:47:33.680 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:33.680 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:47:33.680 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 105, 2023-12-20T04:47:33.680 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:47:33.681 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:47:33.681 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:47:32.919536+0000", 2023-12-20T04:47:33.681 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:47:33.681 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:47:33.681 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:47:33.681 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:47:33.681 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:47:33.681 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:47:33.681 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:47:33.681 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:47:33.681 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:47:33.681 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:33.681 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:47:33.681 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:47:33.682 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:47:33.682 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:47:33.682 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:47:33.682 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 13, 2023-12-20T04:47:33.682 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:47:33.682 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:47:33.682 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:47:33.682 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:47:33.682 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:47:33.682 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:47:33.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.682 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:47:33.682 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:47:33.682 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:47:33.682 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:47:33.683 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:47:33.683 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:33.683 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:33.683 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:33.683 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:33.683 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:33.683 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:33.683 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:33.683 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:33.683 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:33.683 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:33.683 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:47:33.683 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:47:33.683 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:47:33.683 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:47:33.684 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:47:33.684 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:33.684 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:33.684 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:33.684 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:33.684 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:33.684 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:33.684 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:33.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.684 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "102", 2023-12-20T04:47:33.684 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:33.684 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:33.684 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:33.684 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:33.684 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:33.685 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:33.685 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:33.685 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:33.685 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:33.685 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:33.685 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:33.685 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:33.685 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:33.685 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:33.685 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:33.685 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:33.685 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:33.685 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:33.685 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:33.686 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:33.686 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:33.686 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:33.686 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:33.686 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:33.686 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:33.686 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:33.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.686 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:33.686 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:33.686 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:33.686 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:33.686 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:33.686 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:33.686 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:33.687 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:33.687 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:33.687 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:33.687 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:33.687 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:33.687 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:47:33.687 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:47:33.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.687 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:33.687 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:47:33.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.687 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:33.687 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:47:33.687 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:47:33.687 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:47:33.688 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:47:33.688 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:47:33.688 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:33.688 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:33.688 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:33.688 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.688 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 12, 2023-12-20T04:47:33.688 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:47:33.688 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:47:10.649946+0000", 2023-12-20T04:47:33.689 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:47:33.689 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:47:33.689 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:33.689 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:33.689 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:33.689 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:33.689 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:33.689 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:33.689 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:33.689 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:33.689 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:33.689 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:33.689 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:47:33.689 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:47:33.690 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:47:33.690 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:47:33.690 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:47:33.690 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:33.690 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:33.690 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:33.690 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:33.690 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:33.690 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:33.690 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:33.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.690 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "102", 2023-12-20T04:47:33.690 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:33.690 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:33.690 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:33.691 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:33.691 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:33.691 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:33.691 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:33.691 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:33.691 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:33.691 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:33.691 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:33.691 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:33.691 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:33.691 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:33.691 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:33.691 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:33.691 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:33.692 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:33.692 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:33.692 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:33.692 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:33.692 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:33.692 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:33.692 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:33.692 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:33.692 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:33.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.692 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:33.692 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:33.692 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:33.692 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:33.692 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:33.693 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:33.693 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:33.693 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:33.693 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:33.693 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:33.693 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:33.693 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:33.693 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:47:33.693 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:47:33.693 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:47:33.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.693 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:33.693 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:47:33.693 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:47:33.694 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.694 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:33.694 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 2, 2023-12-20T04:47:33.694 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 2, 2023-12-20T04:47:33.694 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:47:33.694 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:47:33.694 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:47:33.694 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:33.694 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:33.694 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:33.694 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.695 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 13, 2023-12-20T04:47:33.695 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:47:33.695 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:47:11.271933+0000", 2023-12-20T04:47:33.695 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:47:33.695 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:47:33.695 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:33.695 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:33.695 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:33.695 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:33.695 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:33.695 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:33.695 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:33.695 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:33.695 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:33.695 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:33.696 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:47:33.696 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:47:33.696 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:47:33.696 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:47:33.696 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:47:33.696 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:33.696 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:33.696 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:33.696 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:33.696 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:33.696 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:33.696 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:33.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.696 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "102", 2023-12-20T04:47:33.696 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:33.697 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:33.697 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:33.697 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:33.697 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:33.697 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:33.697 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:33.697 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:33.697 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:33.697 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:33.697 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:33.697 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:33.697 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:33.697 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:33.698 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:33.698 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:33.698 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:33.698 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:33.698 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:33.698 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:33.698 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:33.698 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:33.698 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:33.698 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:33.698 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:33.698 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:33.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.698 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:33.698 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:33.699 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:33.699 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:33.699 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:33.699 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:33.699 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:33.699 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:33.699 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:33.699 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:33.699 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:33.699 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:33.699 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:47:33.699 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:47:33.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.699 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:33.699 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:47:33.700 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:47:33.700 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.700 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:33.700 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.3799999952316284, 2023-12-20T04:47:33.700 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.3799999952316284, 2023-12-20T04:47:33.700 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:47:33.700 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-20T04:47:33.700 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-20T04:47:33.700 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:33.700 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:33.700 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:33.700 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.700 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.701 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:33.701 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:47:33.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.701 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:47:33.701 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:33.701 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:33.701 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:33.701 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:33.701 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:33.701 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:33.701 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:33.701 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:33.701 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:33.701 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:33.702 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:33.702 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:33.702 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.702 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.702 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:47:33.702 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:33.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.702 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.702 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:47:33.702 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:33.702 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.702 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.703 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:33.703 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.703 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.703 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:47:33.703 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:33.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.703 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.703 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:47:33.703 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:33.703 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.703 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.703 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:33.704 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.704 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.704 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:47:33.704 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:33.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.704 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.704 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:47:33.704 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:33.704 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.704 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.704 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:33.704 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.705 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.705 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:47:33.705 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:33.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.705 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.705 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:47:33.705 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:33.705 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.705 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.705 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.705 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:47:33.705 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:47:33.706 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:47:33.706 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:47:33.706 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:33.706 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:33.706 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:33.706 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:33.706 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.706 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:47:33.706 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:33.706 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:33.706 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:33.706 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:33.706 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:33.707 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:33.707 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:33.707 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:33.707 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:33.707 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:33.707 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:33.707 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:33.707 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.707 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.707 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:47:33.707 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:33.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.707 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.707 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:47:33.708 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:33.708 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.708 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.708 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:33.708 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.708 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.708 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:47:33.708 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:33.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.708 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.708 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:47:33.709 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:33.709 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.709 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.709 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:33.709 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.709 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.709 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:47:33.709 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:33.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.709 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.709 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:47:33.709 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:33.710 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.710 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.710 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:33.710 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.710 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.710 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:47:33.710 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:33.710 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.710 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.710 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:47:33.710 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:33.711 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.711 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.711 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:47:33.711 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:47:33.711 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:47:33.711 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:47:33.711 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:33.711 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:33.711 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:33.711 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:33.711 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.711 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.711 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:47:33.712 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:33.712 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:33.712 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:33.712 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:33.712 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:33.712 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:33.712 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:33.712 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:33.712 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:33.712 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:33.712 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:33.712 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:33.712 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.712 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.713 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.713 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:47:33.713 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:33.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.713 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.713 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:47:33.713 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:33.713 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.713 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.713 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.713 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:33.713 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.713 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.714 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.714 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:47:33.714 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:33.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.714 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.714 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:47:33.714 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:33.714 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.714 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.714 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.714 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:33.714 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.714 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.714 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.715 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:47:33.715 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:33.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.715 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.715 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:47:33.715 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:33.715 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.715 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.715 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.715 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:33.715 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.715 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.715 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.715 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:47:33.716 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:33.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.716 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.716 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.716 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:47:33.716 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:33.716 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.716 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.716 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.716 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:47:33.716 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:47:33.716 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:47:33.716 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:47:33.716 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:33.717 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:33.717 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:33.717 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:33.717 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.717 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.717 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.717 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:47:33.717 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:33.717 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:33.717 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:33.717 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:33.717 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:33.717 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:33.717 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:33.717 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:33.718 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:33.718 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:33.718 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:33.718 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:33.718 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.718 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.718 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:47:33.718 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:33.718 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.718 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.718 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.718 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:47:33.718 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:33.718 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.719 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.719 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:33.719 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.719 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.719 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:47:33.719 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:33.719 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.719 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.719 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.719 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:47:33.719 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:33.719 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.720 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.720 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:33.720 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.720 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.720 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.720 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:47:33.720 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:33.720 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.720 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.720 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.720 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:47:33.720 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:33.720 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.720 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.721 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:33.721 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.721 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.721 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:47:33.721 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:33.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.721 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.721 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.721 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:47:33.721 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:33.721 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.721 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.721 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.722 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:47:33.722 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:47:33.722 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:47:33.722 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:47:33.722 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:33.722 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:33.722 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:33.722 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.722 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.722 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.722 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:47:33.722 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:33.722 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:33.722 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:33.722 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:33.723 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:33.723 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:33.723 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:33.723 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:33.723 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:33.723 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:33.723 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:33.723 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:33.723 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.723 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.723 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:47:33.723 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:33.723 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.723 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.724 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.724 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:47:33.724 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:33.724 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.724 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.724 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:33.724 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.724 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.724 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:47:33.724 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:33.724 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.725 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.725 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:47:33.725 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:33.725 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.725 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.725 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.725 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:33.725 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.725 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.725 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:47:33.725 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:33.725 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.725 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.725 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.726 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:47:33.726 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:33.726 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.726 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.726 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.726 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:33.726 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.726 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.726 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.726 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:47:33.726 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:33.726 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.726 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.726 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.727 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:47:33.727 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:33.727 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.727 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.727 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.727 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:47:33.727 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:47:33.727 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:47:33.727 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:47:33.727 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:33.727 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:33.727 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:33.727 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:33.727 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.727 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.728 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.728 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:47:33.728 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:33.728 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:33.728 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:33.728 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:33.728 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:33.728 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:33.728 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:33.728 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:33.728 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:33.728 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:33.728 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:33.728 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:33.729 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.729 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.729 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:47:33.729 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:33.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.729 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.729 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.729 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:47:33.729 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:33.729 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.729 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.729 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.729 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:33.729 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.730 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.730 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:47:33.730 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:33.730 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.730 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.730 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:47:33.730 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:33.730 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.730 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.730 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.730 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:33.730 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.730 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.731 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.731 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:47:33.731 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:33.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.731 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.731 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.731 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:47:33.731 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:33.731 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.731 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.731 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.731 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:33.731 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.731 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.731 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.732 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:47:33.732 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:33.732 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.732 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.732 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.732 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:47:33.732 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:33.732 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.732 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.732 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.732 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:47:33.732 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:47:33.732 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:47:33.732 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:47:33.732 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:33.733 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:33.733 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:33.733 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.733 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.733 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.733 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:47:33.733 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:33.733 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:33.733 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:33.733 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:33.733 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:33.733 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:33.733 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:33.733 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:33.734 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:33.734 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:33.734 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:33.734 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:33.734 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.734 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.734 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:47:33.734 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:33.734 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.734 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.734 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.734 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:47:33.734 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:33.735 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.735 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.735 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:33.735 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.735 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.735 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.735 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:47:33.735 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:33.735 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.735 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.735 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.735 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:47:33.735 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:33.735 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.735 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.736 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:33.736 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.736 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.736 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.736 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:47:33.736 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:33.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.736 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.736 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.736 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:47:33.736 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:33.736 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.736 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.736 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.737 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:33.737 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.737 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.737 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:47:33.737 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:33.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.737 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.737 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.737 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:47:33.737 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:33.737 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.737 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.737 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.738 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:47:33.738 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:47:33.738 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:47:33.738 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:47:33.738 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:33.738 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:33.738 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:33.738 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:33.738 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.738 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.738 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.738 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:47:33.738 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:33.738 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:33.738 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:33.739 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:33.739 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:33.739 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:33.739 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:33.739 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:33.739 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:33.739 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:33.739 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:33.739 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:33.739 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.739 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.739 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.739 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:47:33.739 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:33.739 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.740 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.740 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.740 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:47:33.740 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:33.740 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.740 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.740 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.740 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:33.740 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.740 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.740 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.740 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:47:33.740 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:33.740 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.740 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.741 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.741 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:47:33.741 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:33.741 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.741 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.741 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.741 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:33.741 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.741 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.741 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:47:33.741 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:33.741 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.742 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.742 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:47:33.742 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:33.742 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.742 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.742 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.742 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:33.742 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:33.742 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.742 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:33.742 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:47:33.742 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:33.742 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.742 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.742 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:33.743 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:47:33.743 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:33.743 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.743 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.743 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.743 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:47:33.743 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:47:33.743 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:47:33.743 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:47:33.743 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:33.743 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull", 2023-12-20T04:47:33.743 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:33.743 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:33.743 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:33.743 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.744 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:33.744 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:47:33.744 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.744 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:47:33.744 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:33.744 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:33.744 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:33.744 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:33.744 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:33.744 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:47:33.744 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:33.744 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.744 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.744 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:47:33.745 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:33.745 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:33.745 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:33.745 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:33.745 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:33.745 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:47:33.745 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:33.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.745 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.745 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:47:33.745 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:33.745 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:33.745 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:33.745 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:33.745 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:33.746 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:47:33.746 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:33.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.746 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.746 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:47:33.746 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:33.746 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:33.746 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:33.746 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:33.746 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:33.746 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:47:33.746 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:33.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.746 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.747 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:47:33.747 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:33.747 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:33.747 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:33.747 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:33.747 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:33.747 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:47:33.747 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:33.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.747 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:47:33.747 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:33.747 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:33.747 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:33.747 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:33.748 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:33.748 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:47:33.748 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:33.748 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.748 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.748 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:47:33.748 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:33.748 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:33.748 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:33.748 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:33.748 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:33.748 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:47:33.748 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:33.748 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.748 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:33.749 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:47:33.749 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:33.749 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:33.749 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:33.749 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:33.749 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:33.749 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:47:33.749 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:33.749 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.749 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:33.749 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:47:33.749 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:47:33.749 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:47:33.749 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:47:33.750 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:47:33.750 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:47:33.750 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:47:33.750 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:47:33.750 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:47:33.750 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:47:33.750 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:47:33.750 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:47:33.750 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:47:33.750 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:47:33.750 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.750 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:33.750 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:47:33.750 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:47:33.750 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:47:33.751 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:47:33.751 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:47:33.751 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:47:33.751 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:47:33.751 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:47:33.751 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:47:33.751 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:47:33.751 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:47:33.751 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:33.751 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:47:33.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.680+0000 7f33ee6db640 1 -- 172.21.15.132:0/632201579 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33d406a460 msgr2=0x7f33d406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.680+0000 7f33ee6db640 1 --2- 172.21.15.132:0/632201579 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33d406a460 0x7f33d406c920 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7f33d8033000 tx=0x7f33d8009030 comp rx=0 tx=0).stop 2023-12-20T04:47:33.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.680+0000 7f33ee6db640 1 -- 172.21.15.132:0/632201579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33e80c7950 msgr2=0x7f33e80c7db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.680+0000 7f33ee6db640 1 --2- 172.21.15.132:0/632201579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33e80c7950 0x7f33e80c7db0 secure :-1 s=READY pgs=1070 cs=0 l=1 rev1=1 crypto rx=0x7f33e80c6500 tx=0x7f33e00115a0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.680+0000 7f33ee6db640 1 -- 172.21.15.132:0/632201579 shutdown_connections 2023-12-20T04:47:33.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.680+0000 7f33ee6db640 1 --2- 172.21.15.132:0/632201579 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33d406a460 0x7f33d406c920 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.680+0000 7f33ee6db640 1 --2- 172.21.15.132:0/632201579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33e80c7950 0x7f33e80c7db0 unknown :-1 s=CLOSED pgs=1070 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.680+0000 7f33ee6db640 1 --2- 172.21.15.132:0/632201579 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33e8160610 0x7f33e81f2170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.680+0000 7f33ee6db640 1 --2- 172.21.15.132:0/632201579 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33d0003970 0x7f33e80b0040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.680+0000 7f33ee6db640 1 -- 172.21.15.132:0/632201579 >> 172.21.15.132:0/632201579 conn(0x7f33e80cfbd0 msgr2=0x7f33e815c950 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:33.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.680+0000 7f33ee6db640 1 -- 172.21.15.132:0/632201579 shutdown_connections 2023-12-20T04:47:33.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.680+0000 7f33ee6db640 1 -- 172.21.15.132:0/632201579 wait complete. 2023-12-20T04:47:33.754 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:47:33.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.852+0000 7f2fbb74e640 1 Processor -- start 2023-12-20T04:47:33.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.852+0000 7f2fbb74e640 1 -- start start 2023-12-20T04:47:33.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.853+0000 7f2fbb74e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb415ab70 0x7f2fb4160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.853+0000 7f2fbb74e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb406d530 con 0x7f2fb40cf280 2023-12-20T04:47:33.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.853+0000 7f2fbb74e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2fb4070540 con 0x7f2fb406a340 2023-12-20T04:47:33.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.853+0000 7f2fbb74e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb4070790 con 0x7f2fb415ab70 2023-12-20T04:47:33.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.853+0000 7f2fb8ce9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2fb40cf280 0x7f2fb4069c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44050/0 (socket says 172.21.15.132:44050) 2023-12-20T04:47:33.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.853+0000 7f2fb8ce9640 1 -- 172.21.15.132:0/2238270097 learned_addr learned my addr 172.21.15.132:0/2238270097 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:33.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.854+0000 7f2fb94ea640 1 --2- 172.21.15.132:0/2238270097 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb415ab70 0x7f2fb4160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.854+0000 7f2fabfff640 1 -- 172.21.15.132:0/2238270097 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4118753537 0 0) 0x7f2fb406d530 con 0x7f2fb40cf280 2023-12-20T04:47:33.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.854+0000 7f2fabfff640 1 -- 172.21.15.132:0/2238270097 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fa0003520 con 0x7f2fb40cf280 2023-12-20T04:47:33.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.854+0000 7f2fabfff640 1 -- 172.21.15.132:0/2238270097 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396885723 0 0) 0x7f2fb4070540 con 0x7f2fb406a340 2023-12-20T04:47:33.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.854+0000 7f2fabfff640 1 -- 172.21.15.132:0/2238270097 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2fb406d530 con 0x7f2fb406a340 2023-12-20T04:47:33.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.854+0000 7f2fabfff640 1 -- 172.21.15.132:0/2238270097 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 118480329 0 0) 0x7f2fa0003520 con 0x7f2fb40cf280 2023-12-20T04:47:33.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.854+0000 7f2fb94ea640 1 -- 172.21.15.132:0/2238270097 >> v1:172.21.15.187:6789/0 conn(0x7f2fb406a340 legacy=0x7f2fb415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.854+0000 7f2fb94ea640 1 -- 172.21.15.132:0/2238270097 >> v1:172.21.15.132:6789/0 conn(0x7f2fb40cf280 legacy=0x7f2fb4069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.854+0000 7f2fb94ea640 1 -- 172.21.15.132:0/2238270097 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb4070a70 con 0x7f2fb415ab70 2023-12-20T04:47:33.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.855+0000 7f2fb94ea640 1 --2- 172.21.15.132:0/2238270097 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb415ab70 0x7f2fb4160d70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00097d0 tx=0x7f2fb002b800 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a984b2afe7d07f3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:33.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.855+0000 7f2fabfff640 1 -- 172.21.15.132:0/2238270097 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4001670 con 0x7f2fb415ab70 2023-12-20T04:47:33.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.855+0000 7f2fabfff640 1 -- 172.21.15.132:0/2238270097 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fb002e050 con 0x7f2fb415ab70 2023-12-20T04:47:33.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.855+0000 7f2fabfff640 1 -- 172.21.15.132:0/2238270097 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fb0030710 con 0x7f2fb415ab70 2023-12-20T04:47:33.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.855+0000 7f2fbb74e640 1 -- 172.21.15.132:0/2238270097 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb415ab70 msgr2=0x7f2fb4160d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.855+0000 7f2fbb74e640 1 --2- 172.21.15.132:0/2238270097 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb415ab70 0x7f2fb4160d70 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f2fb00097d0 tx=0x7f2fb002b800 comp rx=0 tx=0).stop 2023-12-20T04:47:33.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.855+0000 7f2fbb74e640 1 -- 172.21.15.132:0/2238270097 shutdown_connections 2023-12-20T04:47:33.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.855+0000 7f2fbb74e640 1 --2- 172.21.15.132:0/2238270097 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb415ab70 0x7f2fb4160d70 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.855+0000 7f2fbb74e640 1 -- 172.21.15.132:0/2238270097 >> 172.21.15.132:0/2238270097 conn(0x7f2fb40cfca0 msgr2=0x7f2fb40d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:33.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.855+0000 7f2fbb74e640 1 -- 172.21.15.132:0/2238270097 shutdown_connections 2023-12-20T04:47:33.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.855+0000 7f2fbb74e640 1 -- 172.21.15.132:0/2238270097 wait complete. 2023-12-20T04:47:33.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.857+0000 7f2fbb74e640 1 Processor -- start 2023-12-20T04:47:33.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.857+0000 7f2fbb74e640 1 -- start start 2023-12-20T04:47:33.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.857+0000 7f2fbb74e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fb406a340 0x7f2fb40ad800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.857+0000 7f2fbb74e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb40cf280 0x7f2fb41f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.857+0000 7f2fbb74e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb415ab70 0x7f2fb41f65a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.857+0000 7f2fbb74e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb41600c0 con 0x7f2fb40cf280 2023-12-20T04:47:33.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.857+0000 7f2fbb74e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb40ae030 con 0x7f2fb406a340 2023-12-20T04:47:33.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.857+0000 7f2fbb74e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2fb415f790 con 0x7f2fb415ab70 2023-12-20T04:47:33.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.857+0000 7f2fb8ce9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb40cf280 0x7f2fb41f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.857+0000 7f2fb8ce9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb40cf280 0x7f2fb41f6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37364/0 (socket says 172.21.15.132:37364) 2023-12-20T04:47:33.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.857+0000 7f2fb8ce9640 1 -- 172.21.15.132:0/2630063524 learned_addr learned my addr 172.21.15.132:0/2630063524 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:33.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.857+0000 7f2fb94ea640 1 --2- 172.21.15.132:0/2630063524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fb406a340 0x7f2fb40ad800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.857+0000 7f2fb9ceb640 1 --2- 172.21.15.132:0/2630063524 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb415ab70 0x7f2fb41f65a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.858+0000 7f2fb8ce9640 1 -- 172.21.15.132:0/2630063524 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb415ab70 msgr2=0x7f2fb41f65a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.858+0000 7f2fb8ce9640 1 --2- 172.21.15.132:0/2630063524 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb415ab70 0x7f2fb41f65a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.858+0000 7f2fb8ce9640 1 -- 172.21.15.132:0/2630063524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fb406a340 msgr2=0x7f2fb40ad800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.858+0000 7f2fb8ce9640 1 --2- 172.21.15.132:0/2630063524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fb406a340 0x7f2fb40ad800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.858+0000 7f2fb8ce9640 1 -- 172.21.15.132:0/2630063524 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fb0009400 con 0x7f2fb40cf280 2023-12-20T04:47:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.858+0000 7f2fb9ceb640 1 --2- 172.21.15.132:0/2630063524 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb415ab70 0x7f2fb41f65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.858+0000 7f2fb94ea640 1 --2- 172.21.15.132:0/2630063524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fb406a340 0x7f2fb40ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.858+0000 7f2fb8ce9640 1 --2- 172.21.15.132:0/2630063524 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb40cf280 0x7f2fb41f6060 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400c750 tx=0x7f2fa400cc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.858+0000 7f2fa9ffb640 1 -- 172.21.15.132:0/2630063524 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4005ad0 con 0x7f2fb40cf280 2023-12-20T04:47:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.858+0000 7f2fa9ffb640 1 -- 172.21.15.132:0/2630063524 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2fa4005c30 con 0x7f2fb40cf280 2023-12-20T04:47:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.858+0000 7f2fbb74e640 1 -- 172.21.15.132:0/2630063524 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fb415fa70 con 0x7f2fb40cf280 2023-12-20T04:47:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.858+0000 7f2fa9ffb640 1 -- 172.21.15.132:0/2630063524 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2fa4007070 con 0x7f2fb40cf280 2023-12-20T04:47:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.858+0000 7f2fbb74e640 1 -- 172.21.15.132:0/2630063524 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fb40add40 con 0x7f2fb40cf280 2023-12-20T04:47:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.859+0000 7f2fbb74e640 1 -- 172.21.15.132:0/2630063524 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fb4071010 con 0x7f2fb40cf280 2023-12-20T04:47:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.859+0000 7f2fa9ffb640 1 -- 172.21.15.132:0/2630063524 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2fa40071d0 con 0x7f2fb40cf280 2023-12-20T04:47:33.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.860+0000 7f2fa9ffb640 1 --2- 172.21.15.132:0/2630063524 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2f9806a430 0x7f2f9806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:33.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.860+0000 7f2fa9ffb640 1 -- 172.21.15.132:0/2630063524 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2fa4087f50 con 0x7f2fb40cf280 2023-12-20T04:47:33.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.860+0000 7f2fb94ea640 1 --2- 172.21.15.132:0/2630063524 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2f9806a430 0x7f2f9806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:33.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.860+0000 7f2fa9ffb640 1 -- 172.21.15.132:0/2630063524 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=106}) v3 -- 0x7f2f98071f60 con 0x7f2fb40cf280 2023-12-20T04:47:33.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.860+0000 7f2fb94ea640 1 --2- 172.21.15.132:0/2630063524 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2f9806a430 0x7f2f9806c8f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0034000 tx=0x7f2fb0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:33.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:33.864+0000 7f2fa9ffb640 1 -- 172.21.15.132:0/2630063524 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2fb4071010 con 0x7f2fb40cf280 2023-12-20T04:47:34.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.065+0000 7f2fbb74e640 1 -- 172.21.15.132:0/2630063524 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f2fb4071010 con 0x7f2fb40cf280 2023-12-20T04:47:34.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.066+0000 7f2fa9ffb640 1 -- 172.21.15.132:0/2630063524 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f2fb4071010 con 0x7f2fb40cf280 2023-12-20T04:47:34.068 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:34.068 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6939,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2115867433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2115867433},{"type":"v1","addr":"172.21.15.132:6837","nonce":2115867433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6942,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/162444556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":162444556},{"type":"v1","addr":"172.21.15.132:6836","nonce":162444556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2089611890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2089611890},{"type":"v1","addr":"172.21.15.187:6835","nonce":2089611890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:47:12.299623+0000","modified":"2023-12-20T04:47:14.308466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6957},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6957":{"gid":6957,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/786513656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":786513656},{"type":"v1","addr":"172.21.15.187:6834","nonce":786513656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-20T04:47:34.068 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 38 2023-12-20T04:47:34.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.068+0000 7f2fbb74e640 1 -- 172.21.15.132:0/2630063524 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2f9806a430 msgr2=0x7f2f9806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:34.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.068+0000 7f2fbb74e640 1 --2- 172.21.15.132:0/2630063524 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2f9806a430 0x7f2f9806c8f0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7f2fb0034000 tx=0x7f2fb0008030 comp rx=0 tx=0).stop 2023-12-20T04:47:34.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.068+0000 7f2fbb74e640 1 -- 172.21.15.132:0/2630063524 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb40cf280 msgr2=0x7f2fb41f6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:34.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.068+0000 7f2fbb74e640 1 --2- 172.21.15.132:0/2630063524 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb40cf280 0x7f2fb41f6060 secure :-1 s=READY pgs=1072 cs=0 l=1 rev1=1 crypto rx=0x7f2fa400c750 tx=0x7f2fa400cc10 comp rx=0 tx=0).stop 2023-12-20T04:47:34.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.068+0000 7f2fbb74e640 1 -- 172.21.15.132:0/2630063524 shutdown_connections 2023-12-20T04:47:34.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.068+0000 7f2fbb74e640 1 --2- 172.21.15.132:0/2630063524 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2f9806a430 0x7f2f9806c8f0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:34.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.068+0000 7f2fbb74e640 1 --2- 172.21.15.132:0/2630063524 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2fb415ab70 0x7f2fb41f65a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:34.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.068+0000 7f2fbb74e640 1 --2- 172.21.15.132:0/2630063524 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2fb40cf280 0x7f2fb41f6060 unknown :-1 s=CLOSED pgs=1072 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:34.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.068+0000 7f2fbb74e640 1 --2- 172.21.15.132:0/2630063524 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2fb406a340 0x7f2fb40ad800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:34.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.068+0000 7f2fbb74e640 1 -- 172.21.15.132:0/2630063524 >> 172.21.15.132:0/2630063524 conn(0x7f2fb40cfca0 msgr2=0x7f2fb40c6310 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:34.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.068+0000 7f2fbb74e640 1 -- 172.21.15.132:0/2630063524 shutdown_connections 2023-12-20T04:47:34.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.068+0000 7f2fbb74e640 1 -- 172.21.15.132:0/2630063524 wait complete. 2023-12-20T04:47:34.081 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-12-20T04:47:34.207 INFO:teuthology.orchestra.run.smithi187.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":6957,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":21.894302988,"mdsmap_epoch":38,"osdmap_epoch":105,"osdmap_epoch_barrier":101,"uptime":26.158098701} 2023-12-20T04:47:34.207 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 6957, "mdsmap_epoch": 38, "osdmap_epoch": 105, "osdmap_epoch_barrier": 101, "rank_uptime": 21.894302988, "state": "up:active", "uptime": 26.158098701, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:47:34.207 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-20T04:47:34.208 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:47:34.208 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:47:34.224 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:34.224 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=small_file_1 bs=1M conv=fdatasync count=0 seek=0) 2023-12-20T04:47:34.280 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:2023-12-20T04:47:34.278+0000 7fe321ffb640 -1 client.7131 handle_client_reply no pending request on tid 14 safe is:1 2023-12-20T04:47:34.280 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:47:34.281 INFO:teuthology.orchestra.run.smithi132.stderr:dd: failed to open 'small_file_1': Permission denied 2023-12-20T04:47:34.281 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:34.281 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-20T04:47:34.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:34.340 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-20T04:47:34.414 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:47:34.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.552+0000 7fddd922c640 1 Processor -- start 2023-12-20T04:47:34.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.552+0000 7fddd922c640 1 -- start start 2023-12-20T04:47:34.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.553+0000 7fddd922c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fddd415b7d0 0x7fddd415bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:34.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.553+0000 7fddd922c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd406f750 con 0x7fddd40d08c0 2023-12-20T04:47:34.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.553+0000 7fddd922c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddd406fa30 con 0x7fddd406f0e0 2023-12-20T04:47:34.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.553+0000 7fddd922c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddd415f060 con 0x7fddd415b7d0 2023-12-20T04:47:34.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.553+0000 7fddd2d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fddd40d08c0 0x7fddd40cd030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44054/0 (socket says 172.21.15.132:44054) 2023-12-20T04:47:34.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.553+0000 7fddd2d9d640 1 -- 172.21.15.132:0/3590905059 learned_addr learned my addr 172.21.15.132:0/3590905059 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:34.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.553+0000 7fddd359e640 1 --2- 172.21.15.132:0/3590905059 >> v2:172.21.15.187:3300/0 conn(0x7fddd415b7d0 0x7fddd415bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:34.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.553+0000 7fddd259c640 1 -- 172.21.15.132:0/3590905059 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3603137471 0 0) 0x7fddd406f750 con 0x7fddd40d08c0 2023-12-20T04:47:34.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd259c640 1 -- 172.21.15.132:0/3590905059 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fddc0003520 con 0x7fddd40d08c0 2023-12-20T04:47:34.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd259c640 1 -- 172.21.15.132:0/3590905059 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1970670641 0 0) 0x7fddc0003520 con 0x7fddd40d08c0 2023-12-20T04:47:34.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd259c640 1 -- 172.21.15.132:0/3590905059 >> v2:172.21.15.187:3300/0 conn(0x7fddd415b7d0 msgr2=0x7fddd415bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:34.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd259c640 1 --2- 172.21.15.132:0/3590905059 >> v2:172.21.15.187:3300/0 conn(0x7fddd415b7d0 0x7fddd415bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:34.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd259c640 1 -- 172.21.15.132:0/3590905059 >> v1:172.21.15.187:6789/0 conn(0x7fddd406f0e0 legacy=0x7fddd415f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:34.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd259c640 1 -- 172.21.15.132:0/3590905059 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd406fd10 con 0x7fddd40d08c0 2023-12-20T04:47:34.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd259c640 1 -- 172.21.15.132:0/3590905059 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fddc4001670 con 0x7fddd40d08c0 2023-12-20T04:47:34.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd259c640 1 -- 172.21.15.132:0/3590905059 >> v1:172.21.15.132:6789/0 conn(0x7fddd40d08c0 legacy=0x7fddd40cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:34.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd259c640 1 --2- 172.21.15.132:0/3590905059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddc0003970 0x7fddc0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:34.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd259c640 1 --2- 172.21.15.132:0/3590905059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddc00047c0 0x7fddc0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:34.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd259c640 1 --2- 172.21.15.132:0/3590905059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddc00052a0 0x7fddc000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:34.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd259c640 1 -- 172.21.15.132:0/3590905059 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd415f060 con 0x7fddc00052a0 2023-12-20T04:47:34.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd259c640 1 -- 172.21.15.132:0/3590905059 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddc000c170 con 0x7fddc00047c0 2023-12-20T04:47:34.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd259c640 1 -- 172.21.15.132:0/3590905059 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddc000c330 con 0x7fddc0003970 2023-12-20T04:47:34.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd359e640 1 --2- 172.21.15.132:0/3590905059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddc00052a0 0x7fddc000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:34.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd2d9d640 1 --2- 172.21.15.132:0/3590905059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddc0003970 0x7fddc0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:34.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddca59c640 1 --2- 172.21.15.132:0/3590905059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddc00047c0 0x7fddc0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:34.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd359e640 1 -- 172.21.15.132:0/3590905059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddc0003970 msgr2=0x7fddc0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:34.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd359e640 1 --2- 172.21.15.132:0/3590905059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddc0003970 0x7fddc0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:34.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd359e640 1 -- 172.21.15.132:0/3590905059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddc00047c0 msgr2=0x7fddc0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:34.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd359e640 1 --2- 172.21.15.132:0/3590905059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddc00047c0 0x7fddc0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:34.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.554+0000 7fddd359e640 1 -- 172.21.15.132:0/3590905059 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddc0003520 con 0x7fddc00052a0 2023-12-20T04:47:34.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.555+0000 7fddd359e640 1 -- 172.21.15.132:0/3590905059 reap_dead start 2023-12-20T04:47:34.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.555+0000 7fddd359e640 1 --2- 172.21.15.132:0/3590905059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddc00052a0 0x7fddc000b980 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009f90 tx=0x7fddc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ece48af16ff5e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:34.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.555+0000 7fddd259c640 1 -- 172.21.15.132:0/3590905059 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc02cc20 con 0x7fddc00052a0 2023-12-20T04:47:34.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.555+0000 7fddd259c640 1 -- 172.21.15.132:0/3590905059 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc00f040 con 0x7fddc00052a0 2023-12-20T04:47:34.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.555+0000 7fddd259c640 1 -- 172.21.15.132:0/3590905059 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc003990 con 0x7fddc00052a0 2023-12-20T04:47:34.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.556+0000 7fddd922c640 1 -- 172.21.15.132:0/3590905059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddc00052a0 msgr2=0x7fddc000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:34.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.556+0000 7fddd922c640 1 --2- 172.21.15.132:0/3590905059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddc00052a0 0x7fddc000b980 secure :-1 s=READY pgs=1074 cs=0 l=1 rev1=1 crypto rx=0x7fddcc009f90 tx=0x7fddc00057f0 comp rx=0 tx=0).stop 2023-12-20T04:47:34.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.556+0000 7fddd922c640 1 -- 172.21.15.132:0/3590905059 shutdown_connections 2023-12-20T04:47:34.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.556+0000 7fddd922c640 1 --2- 172.21.15.132:0/3590905059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddc00052a0 0x7fddc000b980 unknown :-1 s=CLOSED pgs=1074 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:34.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.556+0000 7fddd922c640 1 -- 172.21.15.132:0/3590905059 >> 172.21.15.132:0/3590905059 conn(0x7fddd40cd7b0 msgr2=0x7fddd40cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:34.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.556+0000 7fddd922c640 1 -- 172.21.15.132:0/3590905059 shutdown_connections 2023-12-20T04:47:34.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.556+0000 7fddd922c640 1 -- 172.21.15.132:0/3590905059 wait complete. 2023-12-20T04:47:34.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.557+0000 7fddd922c640 1 Processor -- start 2023-12-20T04:47:34.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.557+0000 7fddd922c640 1 -- start start 2023-12-20T04:47:34.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddd922c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddc00052a0 0x7fddd41f4ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:34.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddd922c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddd40b5cf0 0x7fddd415cfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:34.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddd922c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd40b6170 0x7fddd415d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:34.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddd922c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd414e200 con 0x7fddd40b6170 2023-12-20T04:47:34.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddd922c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddd41f5020 con 0x7fddc00052a0 2023-12-20T04:47:34.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddd922c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddd40ca180 con 0x7fddd40b5cf0 2023-12-20T04:47:34.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddd359e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd40b6170 0x7fddd415d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:34.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddd359e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd40b6170 0x7fddd415d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37386/0 (socket says 172.21.15.132:37386) 2023-12-20T04:47:34.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddd359e640 1 -- 172.21.15.132:0/3840200155 learned_addr learned my addr 172.21.15.132:0/3840200155 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:34.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddd2d9d640 1 --2- 172.21.15.132:0/3840200155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddc00052a0 0x7fddd41f4ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:34.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddca59c640 1 --2- 172.21.15.132:0/3840200155 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddd40b5cf0 0x7fddd415cfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:34.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddd359e640 1 -- 172.21.15.132:0/3840200155 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddd40b5cf0 msgr2=0x7fddd415cfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:34.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddd359e640 1 --2- 172.21.15.132:0/3840200155 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddd40b5cf0 0x7fddd415cfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:34.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddd359e640 1 -- 172.21.15.132:0/3840200155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddc00052a0 msgr2=0x7fddd41f4ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:34.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddd359e640 1 --2- 172.21.15.132:0/3840200155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddc00052a0 0x7fddd41f4ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:34.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddd359e640 1 -- 172.21.15.132:0/3840200155 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddd40ca460 con 0x7fddd40b6170 2023-12-20T04:47:34.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddd2d9d640 1 --2- 172.21.15.132:0/3840200155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddc00052a0 0x7fddd41f4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:34.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.558+0000 7fddd359e640 1 --2- 172.21.15.132:0/3840200155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd40b6170 0x7fddd415d4f0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fddcc02c690 tx=0x7fddcc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:34.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.559+0000 7fddcbfff640 1 -- 172.21.15.132:0/3840200155 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc003da0 con 0x7fddd40b6170 2023-12-20T04:47:34.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.559+0000 7fddcbfff640 1 -- 172.21.15.132:0/3840200155 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fddcc0358d0 con 0x7fddd40b6170 2023-12-20T04:47:34.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.559+0000 7fddcbfff640 1 -- 172.21.15.132:0/3840200155 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fddcc035c60 con 0x7fddd40b6170 2023-12-20T04:47:34.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.559+0000 7fddd922c640 1 -- 172.21.15.132:0/3840200155 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fddd40ca740 con 0x7fddd40b6170 2023-12-20T04:47:34.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.559+0000 7fddd922c640 1 -- 172.21.15.132:0/3840200155 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddd40cad00 con 0x7fddd40b6170 2023-12-20T04:47:34.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.560+0000 7fddd922c640 1 -- 172.21.15.132:0/3840200155 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddd40caf20 con 0x7fddd40b6170 2023-12-20T04:47:34.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.560+0000 7fddcbfff640 1 -- 172.21.15.132:0/3840200155 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fddcc035dc0 con 0x7fddd40b6170 2023-12-20T04:47:34.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.561+0000 7fddcbfff640 1 --2- 172.21.15.132:0/3840200155 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fddb406a460 0x7fddb406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:34.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.561+0000 7fddcbfff640 1 -- 172.21.15.132:0/3840200155 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(105..105 src has 1..105) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fddcc0ab5a0 con 0x7fddd40b6170 2023-12-20T04:47:34.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.561+0000 7fddd2d9d640 1 --2- 172.21.15.132:0/3840200155 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fddb406a460 0x7fddb406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:34.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.561+0000 7fddcbfff640 1 -- 172.21.15.132:0/3840200155 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=106}) v3 -- 0x7fddb4071f90 con 0x7fddd40b6170 2023-12-20T04:47:34.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.561+0000 7fddd2d9d640 1 --2- 172.21.15.132:0/3840200155 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fddb406a460 0x7fddb406c920 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fddc4007c60 tx=0x7fddc4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:34.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.565+0000 7fddcbfff640 1 -- 172.21.15.132:0/3840200155 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fddcc076cb0 con 0x7fddd40b6170 2023-12-20T04:47:34.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.735+0000 7fddd922c640 1 -- 172.21.15.132:0/3840200155 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fddd404e840 con 0x7fddd40b6170 2023-12-20T04:47:34.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.736+0000 7fddcbfff640 1 -- 172.21.15.132:0/3840200155 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v105) v1 ==== 81+0+33746 (secure 0 0 0) 0x7fddcc07a2d0 con 0x7fddd40b6170 2023-12-20T04:47:34.739 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:34.739 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:47:34.739 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 105, 2023-12-20T04:47:34.739 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:47:34.739 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:47:34.739 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:47:32.919536+0000", 2023-12-20T04:47:34.739 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:47:34.739 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:47:34.739 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:47:34.739 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:47:34.739 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:47:34.739 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:47:34.740 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:47:34.740 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:47:34.740 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:47:34.740 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:34.740 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:47:34.740 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:47:34.740 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:47:34.740 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:47:34.740 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:47:34.740 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 13, 2023-12-20T04:47:34.740 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:47:34.740 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:47:34.740 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:47:34.741 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:47:34.741 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:47:34.741 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:47:34.741 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.741 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:47:34.741 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:47:34.741 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:47:34.741 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:47:34.741 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:47:34.741 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:34.741 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:34.741 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:34.741 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:34.742 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:34.742 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:34.742 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:34.742 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:34.742 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:34.742 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:34.742 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:47:34.742 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:47:34.742 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:47:34.742 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:47:34.742 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:47:34.742 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:34.742 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:34.742 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:34.743 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:34.743 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:34.743 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:34.743 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:34.743 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.743 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "102", 2023-12-20T04:47:34.743 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:34.743 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:34.743 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:34.743 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:34.743 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:34.743 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:34.743 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:34.744 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:34.744 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:34.744 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:34.744 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:34.744 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:34.744 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:34.744 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:34.744 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:34.744 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:34.744 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:34.744 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:34.744 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:34.744 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:34.745 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:34.745 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:34.745 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:34.745 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:34.745 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:34.745 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:34.745 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.745 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:34.745 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:34.745 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:34.745 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:34.745 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:34.745 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:34.745 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:34.746 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:34.746 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:34.746 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:34.746 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:34.746 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:34.746 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:47:34.746 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:47:34.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.746 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:34.746 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:47:34.746 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.746 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:34.746 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:47:34.747 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:47:34.747 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:47:34.747 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:47:34.747 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:47:34.747 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:34.747 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:34.747 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:34.747 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.747 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.747 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.747 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 12, 2023-12-20T04:47:34.747 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:47:34.747 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:47:10.649946+0000", 2023-12-20T04:47:34.747 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:47:34.748 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:47:34.748 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:34.748 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:34.748 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:34.748 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:34.748 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:34.748 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:34.748 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:34.748 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:34.748 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:34.748 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:34.748 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:47:34.748 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:47:34.748 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:47:34.749 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:47:34.749 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:47:34.749 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:34.749 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:34.749 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:34.749 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:34.749 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:34.749 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:34.749 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:34.749 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.749 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "102", 2023-12-20T04:47:34.750 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:34.750 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:34.750 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:34.750 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:34.750 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:34.750 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:34.750 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:34.750 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:34.750 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:34.750 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:34.750 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:34.750 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:34.750 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:34.750 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:34.751 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:34.751 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:34.751 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:34.751 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:34.751 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:34.751 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:34.751 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:34.751 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:34.751 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:34.751 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:34.751 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:34.751 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:34.751 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.751 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:34.752 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:34.752 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:34.752 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:34.752 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:34.752 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:34.752 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:34.752 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:34.752 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:34.752 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:34.752 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:34.752 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:34.752 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:47:34.752 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:47:34.752 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:47:34.753 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.753 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:34.753 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:47:34.753 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:47:34.753 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.753 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.753 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:34.753 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 2, 2023-12-20T04:47:34.753 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 2, 2023-12-20T04:47:34.753 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:47:34.753 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:47:34.753 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:47:34.754 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:34.754 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:34.754 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:34.754 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.754 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.754 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.754 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 13, 2023-12-20T04:47:34.754 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:47:34.754 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:47:11.271933+0000", 2023-12-20T04:47:34.754 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:47:34.754 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:47:34.754 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:34.754 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:34.755 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:34.755 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:34.755 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:34.755 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:34.755 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:34.755 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:34.755 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:34.755 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:34.755 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:47:34.755 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:47:34.755 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:47:34.755 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:47:34.756 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:47:34.756 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:34.756 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:34.756 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:34.756 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:34.756 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:34.756 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:34.756 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:34.756 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.756 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "102", 2023-12-20T04:47:34.756 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:34.756 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:34.756 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:34.756 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:34.757 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:34.757 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:34.757 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:34.757 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:34.757 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:34.757 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:34.757 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:34.757 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:34.757 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:34.757 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:34.757 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:34.757 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:34.757 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:34.758 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:34.758 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:34.758 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:34.758 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:34.758 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:34.758 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:34.758 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:34.758 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:34.758 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:34.758 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.758 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:34.758 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:34.758 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:34.759 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:34.759 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:34.759 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:34.759 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:34.759 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:34.759 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:34.759 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:34.759 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:34.759 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:34.759 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:47:34.760 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:47:34.760 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.760 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:34.760 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:47:34.760 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:47:34.760 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.760 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.760 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:34.760 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.3799999952316284, 2023-12-20T04:47:34.760 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.3799999952316284, 2023-12-20T04:47:34.760 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:47:34.760 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-20T04:47:34.760 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-20T04:47:34.760 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:34.761 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:34.761 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:34.761 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.761 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.761 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:34.761 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:47:34.761 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.761 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:47:34.761 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:34.761 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:34.761 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:34.761 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:34.762 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:34.762 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:34.762 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:34.762 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:34.762 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:34.762 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:34.762 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:34.762 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:34.762 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.762 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.762 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.762 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:47:34.762 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:34.763 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.763 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.763 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.763 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:47:34.763 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:34.763 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.763 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.763 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.763 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:34.763 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.763 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.763 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.763 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:47:34.764 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:34.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.764 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.764 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.764 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:47:34.764 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:34.764 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.764 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.764 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:34.764 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.764 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.764 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.764 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:47:34.765 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:34.765 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.765 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.765 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.765 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:47:34.765 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:34.765 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.765 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.765 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.765 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:34.765 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.765 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.765 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.766 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:47:34.766 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:34.766 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.766 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.766 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.766 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:47:34.766 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:34.766 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.766 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.766 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.766 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:47:34.766 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:47:34.766 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:47:34.766 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:47:34.767 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:34.767 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:34.767 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:34.767 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:34.767 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.767 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.767 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:47:34.767 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:34.767 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:34.767 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:34.767 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:34.767 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:34.768 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:34.768 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:34.768 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:34.768 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:34.768 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:34.768 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:34.768 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:34.768 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.768 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.768 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.768 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:47:34.768 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:34.768 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.768 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.768 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.768 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:47:34.769 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:34.769 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.769 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.769 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.769 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:34.769 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.769 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.769 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.769 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:47:34.769 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:34.769 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.769 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.769 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.769 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:47:34.770 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:34.770 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.770 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.770 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.770 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:34.770 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.770 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.770 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.770 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:47:34.770 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:34.770 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.770 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.771 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.771 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:47:34.771 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:34.771 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.771 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.771 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:34.771 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.771 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.771 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.771 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:47:34.771 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:34.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.772 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.772 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.772 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:47:34.772 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:34.772 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.772 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.772 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:47:34.772 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:47:34.772 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:47:34.772 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:47:34.772 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:34.772 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:34.772 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:34.773 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:34.773 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.773 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:47:34.773 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:34.773 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:34.773 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:34.773 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:34.773 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:34.773 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:34.773 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:34.773 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:34.774 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:34.774 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:34.774 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:34.774 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:34.774 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.774 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.774 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:47:34.774 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:34.774 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.774 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.774 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.774 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:47:34.774 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:34.774 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.775 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.775 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:34.775 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.775 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.775 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:47:34.775 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:34.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.775 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.775 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.775 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:47:34.775 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:34.776 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.776 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.776 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:34.776 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.776 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.776 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:47:34.776 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:34.776 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.776 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.776 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.776 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:47:34.777 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:34.777 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.777 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.777 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:34.777 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.777 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.777 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:47:34.777 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:34.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.777 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.777 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.778 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:47:34.778 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:34.778 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.778 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.778 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:47:34.778 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:47:34.778 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:47:34.778 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:47:34.778 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:34.778 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:34.778 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:34.778 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:34.778 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.779 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:47:34.779 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:34.779 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:34.779 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:34.779 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:34.779 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:34.779 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:34.779 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:34.779 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:34.779 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:34.779 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:34.779 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:34.779 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:34.780 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.780 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.780 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:47:34.780 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:34.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.780 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.780 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:47:34.780 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:34.780 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.780 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.781 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:34.781 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.781 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.781 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:47:34.781 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:34.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.781 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.781 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:47:34.781 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:34.781 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.781 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.782 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:34.782 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.782 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.782 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:47:34.782 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:34.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.782 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.782 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:47:34.782 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:34.782 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.782 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.783 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:34.783 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.783 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.783 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:47:34.783 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:34.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.783 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.783 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:47:34.783 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:34.783 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.783 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.784 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:47:34.784 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:47:34.784 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:47:34.784 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:47:34.784 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:34.784 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:34.784 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:34.784 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.784 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:47:34.784 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:34.784 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:34.785 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:34.785 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:34.785 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:34.785 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:34.785 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:34.785 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:34.785 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:34.785 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:34.785 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:34.785 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:34.785 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.785 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.786 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:47:34.786 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:34.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.786 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.786 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:47:34.786 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:34.786 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.786 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.786 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:34.786 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.786 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.786 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:47:34.787 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:34.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.787 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.787 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:47:34.787 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:34.787 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.787 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.788 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:34.788 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.788 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.788 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:47:34.788 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:34.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.788 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.788 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:47:34.788 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:34.788 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.789 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.789 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:34.789 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.789 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.789 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:47:34.789 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:34.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.789 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.789 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:47:34.790 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:34.790 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.790 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.790 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:47:34.790 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:47:34.790 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:47:34.790 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:47:34.790 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:34.790 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:34.790 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:34.790 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:34.790 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.791 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:47:34.791 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:34.791 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:34.791 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:34.791 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:34.791 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:34.791 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:34.791 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:34.791 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:34.791 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:34.791 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:34.791 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:34.791 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:34.792 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.792 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.792 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:47:34.792 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:34.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.792 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.792 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:47:34.792 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:34.792 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.793 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.793 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:34.793 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.793 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.793 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:47:34.793 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:34.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.793 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.793 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:47:34.793 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:34.794 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.794 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.794 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:34.794 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.794 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.794 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:47:34.794 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:34.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.794 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.794 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:47:34.794 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:34.795 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.795 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.795 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:34.795 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.795 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.795 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:47:34.795 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:34.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.795 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.795 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:47:34.796 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:34.796 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.796 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.796 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:47:34.796 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:47:34.796 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:47:34.796 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:47:34.796 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:34.796 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:34.796 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:34.796 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.797 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:47:34.797 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:34.797 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:34.797 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:34.797 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:34.797 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:34.797 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:34.797 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:34.797 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:34.797 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:34.797 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:34.797 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:34.798 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:34.798 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.798 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.798 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:47:34.798 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:34.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.798 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.798 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:47:34.798 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:34.798 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.799 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.799 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:34.799 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.799 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.799 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:47:34.799 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:34.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.799 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.800 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:47:34.800 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:34.800 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.800 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.800 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:34.800 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.800 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.800 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:47:34.800 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:34.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:47:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:47:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.801 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:47:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:47:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:47:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:47:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:47:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:34.802 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:34.803 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.803 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.803 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.803 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:47:34.803 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:34.803 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:34.803 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:34.803 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:34.803 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:34.803 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:34.803 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:34.803 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:34.803 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:34.803 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:34.804 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:34.804 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:34.804 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.804 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.804 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.804 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:47:34.804 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:34.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.804 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.804 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.804 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:47:34.804 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:34.804 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.804 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.805 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:34.805 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.805 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.805 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.805 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:47:34.805 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:34.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.805 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.805 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.805 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:47:34.805 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:34.805 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.805 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.806 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:34.806 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.806 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.806 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.806 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:47:34.806 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:34.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.806 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.806 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.806 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:47:34.806 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:34.806 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.806 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.806 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:34.807 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:34.807 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.807 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:34.807 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:47:34.807 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:34.807 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.807 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.807 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:34.807 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:47:34.807 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:34.807 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.807 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.808 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:47:34.808 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:47:34.808 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:47:34.808 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:47:34.808 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:34.808 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull", 2023-12-20T04:47:34.808 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:34.808 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:34.808 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:34.808 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.808 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:34.808 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:47:34.809 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.809 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:47:34.809 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:34.809 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:34.809 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:34.809 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:34.809 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:34.809 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:47:34.809 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:34.809 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.809 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.809 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:47:34.810 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:34.810 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:34.810 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:34.810 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:34.810 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:34.810 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:47:34.810 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:34.810 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.810 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.810 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:47:34.810 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:34.810 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:34.810 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:34.810 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:34.811 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:34.811 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:47:34.811 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:34.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.811 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.811 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:47:34.811 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:34.811 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:34.811 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:34.811 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:34.811 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:34.811 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:47:34.811 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:34.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.812 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:47:34.812 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:34.812 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:34.812 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:34.812 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:34.812 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:34.812 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:47:34.812 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:34.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.813 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:47:34.813 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:34.813 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:34.813 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:34.813 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:34.813 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:34.813 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:47:34.813 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:34.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.813 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.813 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:47:34.814 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:34.814 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:34.814 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:34.814 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:34.814 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:34.814 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:47:34.814 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:34.814 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.814 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:34.814 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:47:34.814 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:34.814 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:34.814 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:34.815 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:34.815 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:34.815 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:47:34.815 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:34.815 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.815 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:34.815 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:47:34.815 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:47:34.815 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:47:34.815 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:47:34.815 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:47:34.815 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:47:34.815 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:47:34.815 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:47:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:47:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:47:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:47:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:47:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:47:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:47:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:47:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:47:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:47:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:47:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:47:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:47:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:47:34.816 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:47:34.817 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:47:34.817 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:47:34.817 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:47:34.817 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:34.817 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:47:34.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.738+0000 7fddd922c640 1 -- 172.21.15.132:0/3840200155 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fddb406a460 msgr2=0x7fddb406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:34.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.738+0000 7fddd922c640 1 --2- 172.21.15.132:0/3840200155 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fddb406a460 0x7fddb406c920 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7fddc4007c60 tx=0x7fddc4009040 comp rx=0 tx=0).stop 2023-12-20T04:47:34.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.738+0000 7fddd922c640 1 -- 172.21.15.132:0/3840200155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd40b6170 msgr2=0x7fddd415d4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:34.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.738+0000 7fddd922c640 1 --2- 172.21.15.132:0/3840200155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd40b6170 0x7fddd415d4f0 secure :-1 s=READY pgs=1075 cs=0 l=1 rev1=1 crypto rx=0x7fddcc02c690 tx=0x7fddcc009750 comp rx=0 tx=0).stop 2023-12-20T04:47:34.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.738+0000 7fddd922c640 1 -- 172.21.15.132:0/3840200155 shutdown_connections 2023-12-20T04:47:34.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.738+0000 7fddd922c640 1 --2- 172.21.15.132:0/3840200155 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fddb406a460 0x7fddb406c920 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:34.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.738+0000 7fddd922c640 1 --2- 172.21.15.132:0/3840200155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddd40b6170 0x7fddd415d4f0 unknown :-1 s=CLOSED pgs=1075 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:34.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.738+0000 7fddd922c640 1 --2- 172.21.15.132:0/3840200155 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddd40b5cf0 0x7fddd415cfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:34.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.738+0000 7fddd922c640 1 --2- 172.21.15.132:0/3840200155 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddc00052a0 0x7fddd41f4ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:34.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.738+0000 7fddd922c640 1 -- 172.21.15.132:0/3840200155 >> 172.21.15.132:0/3840200155 conn(0x7fddd40cd7b0 msgr2=0x7fddd415e0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:34.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.739+0000 7fddd922c640 1 -- 172.21.15.132:0/3840200155 shutdown_connections 2023-12-20T04:47:34.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:34.739+0000 7fddd922c640 1 -- 172.21.15.132:0/3840200155 wait complete. 2023-12-20T04:47:34.820 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-20T04:47:34.838 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:47:34.836+0000 7f1a5f3c2640 -1 log_channel(cluster) log [ERR] : Health check update: 5 full osd(s) (OSD_FULL) 2023-12-20T04:47:39.821 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:47:39.839 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:47:39.837+0000 7f1a5f3c2640 -1 log_channel(cluster) log [ERR] : Health check update: 3 full osd(s) (OSD_FULL) 2023-12-20T04:47:39.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.932+0000 7f8d4a177640 1 Processor -- start 2023-12-20T04:47:39.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.932+0000 7f8d4a177640 1 -- start start 2023-12-20T04:47:39.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.932+0000 7f8d4a177640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8d441588e0 0x7f8d44069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:39.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.932+0000 7f8d4a177640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4406ea90 con 0x7f8d4406cf00 2023-12-20T04:47:39.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.932+0000 7f8d4a177640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8d4406e160 con 0x7f8d4406a170 2023-12-20T04:47:39.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.932+0000 7f8d4a177640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8d4406d520 con 0x7f8d441588e0 2023-12-20T04:47:39.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.933+0000 7f8d437fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8d441588e0 0x7f8d44069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:39.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.933+0000 7f8d43fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8d4406cf00 0x7f8d440b4bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47444/0 (socket says 172.21.15.132:47444) 2023-12-20T04:47:39.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.933+0000 7f8d43fff640 1 -- 172.21.15.132:0/1421988272 learned_addr learned my addr 172.21.15.132:0/1421988272 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:39.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.933+0000 7f8d437fe640 1 -- 172.21.15.132:0/1421988272 >> v1:172.21.15.187:6789/0 conn(0x7f8d4406a170 legacy=0x7f8d4406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:39.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.933+0000 7f8d437fe640 1 -- 172.21.15.132:0/1421988272 >> v1:172.21.15.132:6789/0 conn(0x7f8d4406cf00 legacy=0x7f8d440b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:39.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.933+0000 7f8d437fe640 1 -- 172.21.15.132:0/1421988272 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d4406e440 con 0x7f8d441588e0 2023-12-20T04:47:39.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.933+0000 7f8d42ffd640 1 -- 172.21.15.132:0/1421988272 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 473087294 0 0) 0x7f8d4406ea90 con 0x7f8d4406cf00 2023-12-20T04:47:39.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.934+0000 7f8d437fe640 1 --2- 172.21.15.132:0/1421988272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d441588e0 0x7f8d44069c30 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f8d340097a0 tx=0x7f8d3402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9581ab98924d087b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:39.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.934+0000 7f8d42ffd640 1 -- 172.21.15.132:0/1421988272 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d34031830 con 0x7f8d441588e0 2023-12-20T04:47:39.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.934+0000 7f8d42ffd640 1 -- 172.21.15.132:0/1421988272 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d34031990 con 0x7f8d441588e0 2023-12-20T04:47:39.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.934+0000 7f8d42ffd640 1 -- 172.21.15.132:0/1421988272 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d34031d20 con 0x7f8d441588e0 2023-12-20T04:47:39.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.934+0000 7f8d4a177640 1 -- 172.21.15.132:0/1421988272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d441588e0 msgr2=0x7f8d44069c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:39.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.934+0000 7f8d4a177640 1 --2- 172.21.15.132:0/1421988272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d441588e0 0x7f8d44069c30 secure :-1 s=READY pgs=1077 cs=0 l=1 rev1=1 crypto rx=0x7f8d340097a0 tx=0x7f8d3402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:47:39.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.934+0000 7f8d4a177640 1 -- 172.21.15.132:0/1421988272 shutdown_connections 2023-12-20T04:47:39.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.934+0000 7f8d4a177640 1 --2- 172.21.15.132:0/1421988272 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d441588e0 0x7f8d44069c30 unknown :-1 s=CLOSED pgs=1077 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:39.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.934+0000 7f8d4a177640 1 -- 172.21.15.132:0/1421988272 >> 172.21.15.132:0/1421988272 conn(0x7f8d440cfca0 msgr2=0x7f8d440d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:39.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.934+0000 7f8d4a177640 1 -- 172.21.15.132:0/1421988272 shutdown_connections 2023-12-20T04:47:39.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.934+0000 7f8d4a177640 1 -- 172.21.15.132:0/1421988272 wait complete. 2023-12-20T04:47:39.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.936+0000 7f8d4a177640 1 Processor -- start 2023-12-20T04:47:39.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.936+0000 7f8d4a177640 1 -- start start 2023-12-20T04:47:39.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.936+0000 7f8d4a177640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d4406a170 0x7f8d441f2360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:39.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.936+0000 7f8d4a177640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d4406cf00 0x7f8d4414cc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:39.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.936+0000 7f8d4a177640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d441588e0 0x7f8d440c87d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:39.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.936+0000 7f8d4a177640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d441f28a0 con 0x7f8d4406a170 2023-12-20T04:47:39.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.936+0000 7f8d4a177640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d440c4d80 con 0x7f8d4406cf00 2023-12-20T04:47:39.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.936+0000 7f8d4a177640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8d440c5060 con 0x7f8d441588e0 2023-12-20T04:47:39.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d437fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d4406a170 0x7f8d441f2360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:39.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d437fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d4406a170 0x7f8d441f2360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44048/0 (socket says 172.21.15.132:44048) 2023-12-20T04:47:39.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d437fe640 1 -- 172.21.15.132:0/1956159824 learned_addr learned my addr 172.21.15.132:0/1956159824 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:39.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d43fff640 1 --2- 172.21.15.132:0/1956159824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d441588e0 0x7f8d440c87d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:39.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d3affd640 1 --2- 172.21.15.132:0/1956159824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d4406cf00 0x7f8d4414cc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:39.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d437fe640 1 -- 172.21.15.132:0/1956159824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d441588e0 msgr2=0x7f8d440c87d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:39.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d437fe640 1 --2- 172.21.15.132:0/1956159824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d441588e0 0x7f8d440c87d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:39.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d437fe640 1 -- 172.21.15.132:0/1956159824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d4406cf00 msgr2=0x7f8d4414cc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:39.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d437fe640 1 --2- 172.21.15.132:0/1956159824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d4406cf00 0x7f8d4414cc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:39.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d437fe640 1 -- 172.21.15.132:0/1956159824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d34009400 con 0x7f8d4406a170 2023-12-20T04:47:39.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d43fff640 1 --2- 172.21.15.132:0/1956159824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d441588e0 0x7f8d440c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:39.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d3affd640 1 --2- 172.21.15.132:0/1956159824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d4406cf00 0x7f8d4414cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:39.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d437fe640 1 --2- 172.21.15.132:0/1956159824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d4406a170 0x7f8d441f2360 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f8d340098c0 tx=0x7f8d340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:39.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d40ff9640 1 -- 172.21.15.132:0/1956159824 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d3403ba70 con 0x7f8d4406a170 2023-12-20T04:47:39.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d40ff9640 1 -- 172.21.15.132:0/1956159824 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8d3403bbd0 con 0x7f8d4406a170 2023-12-20T04:47:39.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d4a177640 1 -- 172.21.15.132:0/1956159824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d440c5340 con 0x7f8d4406a170 2023-12-20T04:47:39.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d40ff9640 1 -- 172.21.15.132:0/1956159824 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8d340453f0 con 0x7f8d4406a170 2023-12-20T04:47:39.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.937+0000 7f8d4a177640 1 -- 172.21.15.132:0/1956159824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d440c5900 con 0x7f8d4406a170 2023-12-20T04:47:39.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.938+0000 7f8d4a177640 1 -- 172.21.15.132:0/1956159824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d4404e840 con 0x7f8d4406a170 2023-12-20T04:47:39.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.939+0000 7f8d40ff9640 1 -- 172.21.15.132:0/1956159824 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8d3404e450 con 0x7f8d4406a170 2023-12-20T04:47:39.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.939+0000 7f8d40ff9640 1 --2- 172.21.15.132:0/1956159824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8d2406a460 0x7f8d2406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:39.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.939+0000 7f8d40ff9640 1 -- 172.21.15.132:0/1956159824 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(108..108 src has 1..108) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8d340aac10 con 0x7f8d4406a170 2023-12-20T04:47:39.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.939+0000 7f8d3affd640 1 --2- 172.21.15.132:0/1956159824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8d2406a460 0x7f8d2406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:39.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.939+0000 7f8d40ff9640 1 -- 172.21.15.132:0/1956159824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=109}) v3 -- 0x7f8d24072050 con 0x7f8d4406a170 2023-12-20T04:47:39.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.940+0000 7f8d3affd640 1 --2- 172.21.15.132:0/1956159824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8d2406a460 0x7f8d2406c920 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8d440c4820 tx=0x7f8d2c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:39.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.943+0000 7f8d40ff9640 1 -- 172.21.15.132:0/1956159824 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8d340762e0 con 0x7f8d4406a170 2023-12-20T04:47:39.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.964+0000 7f8d40ff9640 1 -- 172.21.15.132:0/1956159824 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(109..109 src has 1..109) v4 ==== 296+0+0 (secure 0 0 0) 0x7f8d3407a6a0 con 0x7f8d4406a170 2023-12-20T04:47:39.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:39.964+0000 7f8d40ff9640 1 -- 172.21.15.132:0/1956159824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=110}) v3 -- 0x7f8d24072790 con 0x7f8d4406a170 2023-12-20T04:47:40.115 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:40.114+0000 7f8d4a177640 1 -- 172.21.15.132:0/1956159824 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f8d440c35b0 con 0x7f8d4406a170 2023-12-20T04:47:40.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:40.115+0000 7f8d40ff9640 1 -- 172.21.15.132:0/1956159824 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v109) v1 ==== 81+0+34045 (secure 0 0 0) 0x7f8d34079900 con 0x7f8d4406a170 2023-12-20T04:47:40.117 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:40.117 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:47:40.117 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 109, 2023-12-20T04:47:40.117 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:47:40.117 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:47:40.117 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:47:39.964119+0000", 2023-12-20T04:47:40.118 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:47:40.118 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:47:40.118 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:47:40.118 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:47:40.118 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:47:40.118 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:47:40.118 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:47:40.118 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:47:40.118 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:47:40.118 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:40.118 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:47:40.118 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:47:40.118 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:47:40.118 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:47:40.119 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:47:40.119 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 13, 2023-12-20T04:47:40.119 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:47:40.119 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:47:40.119 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "luminous", 2023-12-20T04:47:40.119 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:47:40.119 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:47:40.119 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:47:40.119 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.119 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:47:40.119 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:47:40.119 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:47:40.119 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:47:40.119 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:47:40.120 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:40.120 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:40.120 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:40.120 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:40.120 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:40.120 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:40.120 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:40.120 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:40.120 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:40.120 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:40.120 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:47:40.120 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:47:40.120 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:47:40.120 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:47:40.121 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:47:40.121 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:40.121 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:40.121 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:40.121 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:40.121 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:40.121 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:40.121 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:40.121 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.121 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "102", 2023-12-20T04:47:40.121 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:40.121 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:40.121 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:40.121 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:40.122 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:40.122 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:40.122 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:40.122 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:40.122 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:40.122 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:40.122 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:40.122 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:40.122 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:40.122 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:40.122 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:40.122 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:40.122 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:40.122 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:40.122 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:40.123 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:40.123 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:40.123 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:40.123 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:40.123 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:40.123 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:40.123 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:40.123 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.123 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:40.123 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:40.123 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:40.123 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:40.123 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:40.123 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:40.123 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:40.124 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:40.124 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:40.124 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:40.124 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:40.124 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:40.124 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:47:40.124 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:47:40.124 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.124 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:40.124 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:47:40.124 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.124 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:40.124 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:47:40.125 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:47:40.125 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:47:40.125 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:47:40.125 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:47:40.125 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:40.125 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:40.125 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:40.125 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.125 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.125 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.125 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 12, 2023-12-20T04:47:40.125 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:47:40.125 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:47:10.649946+0000", 2023-12-20T04:47:40.126 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:47:40.126 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:47:40.126 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:40.126 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:40.126 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:40.126 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:40.126 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:40.126 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:40.126 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:40.126 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:40.126 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:40.126 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:40.126 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:47:40.126 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:47:40.126 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:47:40.127 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:47:40.127 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:47:40.127 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:40.127 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:40.127 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:40.127 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:40.127 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:40.127 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:40.127 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:40.127 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.127 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "102", 2023-12-20T04:47:40.127 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:40.127 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:40.127 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:40.128 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:40.128 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:40.128 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:40.128 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:40.128 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:40.128 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:40.128 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:40.128 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:40.128 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:40.128 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:40.128 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:40.128 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:40.128 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:40.128 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:40.128 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:40.129 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:40.129 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:40.129 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:40.129 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:40.129 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:40.129 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:40.129 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:40.129 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:40.129 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.129 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:40.129 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:40.129 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:40.129 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:40.129 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:40.129 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:40.130 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:40.130 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:40.130 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:40.130 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:40.130 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:40.130 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:40.130 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:47:40.130 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:47:40.130 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:47:40.130 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.130 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:40.130 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:47:40.130 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:47:40.130 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.130 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.131 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:40.131 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 2, 2023-12-20T04:47:40.131 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 2, 2023-12-20T04:47:40.131 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:47:40.131 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:47:40.131 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:47:40.131 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:40.131 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:40.131 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:40.131 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.131 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.131 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.131 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 13, 2023-12-20T04:47:40.131 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:47:40.131 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:47:11.271933+0000", 2023-12-20T04:47:40.132 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 3, 2023-12-20T04:47:40.132 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full", 2023-12-20T04:47:40.132 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:40.132 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:40.132 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:40.132 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:40.132 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:40.132 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:40.132 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:40.132 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:40.132 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:40.132 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:40.132 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:47:40.132 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:47:40.132 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:47:40.133 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:47:40.133 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:47:40.133 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:40.133 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:40.133 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:40.133 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:40.133 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:40.133 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:40.133 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:40.133 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.133 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "102", 2023-12-20T04:47:40.133 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:40.133 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:40.133 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:40.133 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:40.134 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:40.134 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:40.134 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:40.134 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:40.134 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:40.134 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:40.134 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:40.134 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:40.134 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:40.134 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:40.134 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:40.134 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:40.134 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:40.134 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:40.135 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:40.135 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:40.135 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:40.135 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:40.135 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:40.135 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:40.135 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:40.135 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:40.135 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.135 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:40.135 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:40.135 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:40.135 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:40.135 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:40.135 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:40.136 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:40.136 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:40.136 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:40.136 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:40.136 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:40.136 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:40.136 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:47:40.136 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:47:40.136 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.136 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:40.136 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:47:40.136 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:47:40.136 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.136 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.137 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:40.137 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.3799999952316284, 2023-12-20T04:47:40.137 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.3799999952316284, 2023-12-20T04:47:40.137 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:47:40.137 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-20T04:47:40.137 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-20T04:47:40.137 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:40.137 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:40.137 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:40.137 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.137 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.137 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:40.137 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:47:40.137 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.138 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:47:40.138 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:40.138 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:40.138 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:40.138 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:40.138 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:40.138 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:40.138 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:40.138 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:40.138 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:40.138 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:40.138 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:40.138 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:40.138 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.139 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.139 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.139 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:47:40.139 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:40.139 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.139 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.139 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.139 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:47:40.139 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:40.139 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.139 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.139 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.139 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:40.139 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.139 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.139 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.140 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:47:40.140 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:40.140 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.140 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.140 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.140 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:47:40.140 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:40.140 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.140 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.140 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.140 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:40.140 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.140 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.141 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.141 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:47:40.141 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:40.141 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.141 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.141 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.141 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:47:40.141 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:40.141 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.141 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.141 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.141 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:40.141 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.141 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.141 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.142 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:47:40.142 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:40.142 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.142 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.142 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.142 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:47:40.142 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:40.142 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.142 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.142 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.142 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:47:40.142 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:47:40.142 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:47:40.142 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:47:40.143 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:40.143 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:40.143 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:40.143 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.143 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.143 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.143 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:47:40.143 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:40.143 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:40.143 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:40.143 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:40.143 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:40.143 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:40.143 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:40.143 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:40.144 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:40.144 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:40.144 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:40.144 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:40.144 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.144 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.144 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.144 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:47:40.144 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:40.144 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.144 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.144 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.144 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:47:40.144 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:40.144 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.145 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.145 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.145 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:40.145 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.145 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.145 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.145 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:47:40.145 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:40.145 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.145 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.145 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.145 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:47:40.145 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:40.145 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.146 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.146 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.146 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:40.146 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.146 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.146 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.146 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:47:40.146 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:40.146 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.146 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.146 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.146 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:47:40.146 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:40.146 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.146 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.147 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.147 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:40.147 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.147 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.147 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.147 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:47:40.147 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:40.147 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.147 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.147 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.147 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:47:40.147 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:40.147 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.147 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.148 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.148 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:47:40.148 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:47:40.148 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:47:40.148 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:47:40.148 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:40.148 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:40.148 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:40.148 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:40.148 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.148 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.148 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.148 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:47:40.148 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:40.149 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:40.149 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:40.149 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:40.149 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:40.149 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:40.149 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:40.149 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:40.149 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:40.149 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:40.149 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:40.149 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:40.149 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.149 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.149 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.149 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:47:40.150 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:40.150 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.150 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.150 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.150 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:47:40.150 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:40.150 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.150 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.150 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.150 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:40.150 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.150 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.150 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.150 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:47:40.150 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:40.151 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.151 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.151 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.151 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:47:40.151 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:40.151 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.151 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.151 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.151 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:40.151 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.151 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.151 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.151 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:47:40.151 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:40.152 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.152 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.152 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.152 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:47:40.152 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:40.152 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.152 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.152 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.152 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:40.152 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.152 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.152 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.152 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:47:40.152 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:40.153 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.153 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.153 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.153 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:47:40.153 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:40.153 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.153 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.153 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.153 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:47:40.153 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:47:40.153 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:47:40.153 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:47:40.153 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:40.154 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:40.154 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:40.154 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:40.154 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.154 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.154 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.154 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:47:40.154 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:40.154 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:40.154 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:40.154 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:40.154 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:40.154 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:40.154 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:40.155 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:40.155 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 106, 2023-12-20T04:47:40.155 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:40.155 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:40.155 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:40.155 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.155 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.155 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.155 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:47:40.155 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:40.155 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.155 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.155 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.155 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:47:40.156 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:40.156 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.156 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.156 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.156 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:40.156 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.156 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.156 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.156 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:47:40.156 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:40.156 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.156 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.156 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.156 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:47:40.157 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:40.157 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.157 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.157 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.157 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:40.157 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.157 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.157 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.157 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:47:40.157 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:40.157 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.157 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.158 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.158 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:47:40.158 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:40.158 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.158 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.158 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.158 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:40.158 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.158 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.158 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.158 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:47:40.158 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:40.158 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.158 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.159 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.159 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:47:40.159 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:40.159 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.159 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.159 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.159 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:47:40.159 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:47:40.159 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:47:40.159 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:47:40.159 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:40.159 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:40.159 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:40.159 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.160 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.160 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.160 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:47:40.160 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:40.160 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:40.160 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:40.160 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:40.160 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:40.160 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:40.160 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:40.160 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:40.160 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:40.160 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:40.160 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:40.160 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:40.161 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.161 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.161 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:47:40.161 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:40.161 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.161 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.161 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:47:40.161 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:40.161 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.161 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.162 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:40.162 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.162 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.162 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:47:40.162 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:40.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.162 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.162 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:47:40.162 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:40.162 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.163 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.163 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.163 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:40.163 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.163 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.163 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.163 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:47:40.163 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:40.163 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.163 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.163 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.163 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:47:40.163 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:40.163 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.164 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.164 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:40.164 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.164 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.164 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.164 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:47:40.164 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:40.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.164 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.164 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.164 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:47:40.165 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:40.165 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.165 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.165 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:47:40.165 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:47:40.165 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:47:40.165 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:47:40.165 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:40.165 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:40.165 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:40.165 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.165 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.166 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:47:40.166 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:40.166 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:40.166 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:40.166 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:40.166 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:40.166 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:40.166 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:40.166 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:40.166 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 106, 2023-12-20T04:47:40.166 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:40.166 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:40.166 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:40.166 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.167 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.167 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:47:40.167 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:40.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.167 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.167 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:47:40.167 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:40.167 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.167 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.167 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:40.167 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.168 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.168 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:47:40.168 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:40.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.168 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.168 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:47:40.168 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:40.168 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.168 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.168 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:40.168 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.169 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.169 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.169 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:47:40.169 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:40.169 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.169 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.169 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.169 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:47:40.169 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:40.169 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.169 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.169 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.170 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:40.170 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.170 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.170 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.170 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:47:40.170 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:40.170 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.170 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.170 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.170 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:47:40.170 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:40.170 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.170 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.170 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.170 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:47:40.171 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:47:40.171 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:47:40.171 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:47:40.171 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:40.171 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:40.171 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:40.171 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.171 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.171 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:47:40.171 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:40.171 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:40.171 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:40.172 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:40.172 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:40.172 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:40.172 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:40.172 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:40.172 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:40.172 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:40.172 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:40.172 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:40.172 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.172 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.173 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:47:40.173 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:40.173 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.173 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.173 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:47:40.173 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:40.173 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.173 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.173 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.173 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:40.173 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.174 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.174 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:47:40.174 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:40.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.174 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.174 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.174 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:47:40.174 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:40.174 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.174 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.174 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:40.174 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.175 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.175 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.175 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:47:40.175 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:40.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.175 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.175 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.175 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:47:40.175 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:40.175 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.175 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.175 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:40.176 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.176 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.176 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.176 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:47:40.176 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:40.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.176 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.176 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.176 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:47:40.176 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:40.176 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.176 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.176 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:47:40.177 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:47:40.177 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:47:40.177 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:47:40.177 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:40.177 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:40.177 INFO:teuthology.orchestra.run.smithi132.stdout: "full", 2023-12-20T04:47:40.177 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:40.177 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.177 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:47:40.177 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:40.178 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:40.178 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:40.178 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:40.178 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:40.178 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:40.178 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:40.178 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:40.178 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:40.178 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:40.178 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:40.178 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:40.178 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.178 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.178 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.179 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:47:40.179 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:40.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.179 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.179 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:47:40.179 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:40.179 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.179 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.179 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:40.179 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.179 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.180 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:47:40.180 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:40.180 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.180 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.180 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.180 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:47:40.180 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:40.180 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.180 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.180 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.180 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:40.180 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.181 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.181 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:47:40.181 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:40.181 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.181 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.181 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:47:40.181 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:40.181 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.181 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.181 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.181 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:40.182 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:40.182 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.182 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:40.182 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:47:40.182 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:40.182 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.182 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.182 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:40.182 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:47:40.182 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:40.182 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.182 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.182 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.182 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:47:40.183 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:47:40.183 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:47:40.183 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:47:40.183 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:40.183 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:40.183 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:40.183 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.183 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.183 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:40.183 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:47:40.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.183 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:47:40.184 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:40.184 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:40.184 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:40.184 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:40.184 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:40.184 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:47:40.184 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:40.184 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.184 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.184 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:47:40.184 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:40.184 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:40.184 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:40.184 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:40.185 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:40.185 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:47:40.185 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:40.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.185 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.185 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:47:40.185 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:40.185 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:40.185 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:40.185 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:40.185 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:40.185 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:47:40.186 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:40.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.186 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.186 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:47:40.186 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:40.186 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:40.186 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:40.186 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:40.186 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:40.186 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:47:40.186 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:40.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.186 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.187 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:47:40.187 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:40.187 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:40.187 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:40.187 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:40.187 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:40.187 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:47:40.187 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:40.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.187 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:47:40.187 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:40.187 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:40.187 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:40.187 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:40.188 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:40.188 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:47:40.188 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:40.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.188 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.188 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:47:40.188 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:40.188 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:40.188 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:40.188 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:40.188 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:40.188 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:47:40.188 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:40.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.189 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.189 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:47:40.189 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:40.189 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:40.189 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:40.189 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:40.189 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:40.189 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:47:40.189 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:40.189 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.189 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:40.189 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:47:40.189 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [ 2023-12-20T04:47:40.190 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.190 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "13.1c", 2023-12-20T04:47:40.190 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:47:40.190 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.190 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 6, 2023-12-20T04:47:40.190 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 3 2023-12-20T04:47:40.190 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.190 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.190 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.190 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "13.23", 2023-12-20T04:47:40.190 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:47:40.190 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:40.191 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 1, 2023-12-20T04:47:40.191 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 5 2023-12-20T04:47:40.191 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.191 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:40.191 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.191 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:40.191 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:47:40.191 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:47:40.191 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:47:40.191 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:47:40.191 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:47:40.191 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:47:40.191 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:47:40.191 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:47:40.192 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:47:40.192 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:47:40.192 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:47:40.192 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:47:40.192 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.192 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:40.192 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:47:40.192 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:47:40.192 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:47:40.192 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:47:40.192 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:47:40.192 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:47:40.192 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:47:40.192 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:47:40.192 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:47:40.192 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:47:40.193 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:47:40.193 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:40.193 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:47:40.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:40.117+0000 7f8d4a177640 1 -- 172.21.15.132:0/1956159824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8d2406a460 msgr2=0x7f8d2406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:40.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:40.117+0000 7f8d4a177640 1 --2- 172.21.15.132:0/1956159824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8d2406a460 0x7f8d2406c920 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f8d440c4820 tx=0x7f8d2c008040 comp rx=0 tx=0).stop 2023-12-20T04:47:40.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:40.117+0000 7f8d4a177640 1 -- 172.21.15.132:0/1956159824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d4406a170 msgr2=0x7f8d441f2360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:40.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:40.117+0000 7f8d4a177640 1 --2- 172.21.15.132:0/1956159824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d4406a170 0x7f8d441f2360 secure :-1 s=READY pgs=1078 cs=0 l=1 rev1=1 crypto rx=0x7f8d340098c0 tx=0x7f8d340046c0 comp rx=0 tx=0).stop 2023-12-20T04:47:40.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:40.117+0000 7f8d4a177640 1 -- 172.21.15.132:0/1956159824 shutdown_connections 2023-12-20T04:47:40.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:40.117+0000 7f8d4a177640 1 --2- 172.21.15.132:0/1956159824 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8d2406a460 0x7f8d2406c920 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:40.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:40.117+0000 7f8d4a177640 1 --2- 172.21.15.132:0/1956159824 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8d441588e0 0x7f8d440c87d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:40.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:40.117+0000 7f8d4a177640 1 --2- 172.21.15.132:0/1956159824 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8d4406cf00 0x7f8d4414cc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:40.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:40.117+0000 7f8d4a177640 1 --2- 172.21.15.132:0/1956159824 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8d4406a170 0x7f8d441f2360 unknown :-1 s=CLOSED pgs=1078 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:40.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:40.117+0000 7f8d4a177640 1 -- 172.21.15.132:0/1956159824 >> 172.21.15.132:0/1956159824 conn(0x7f8d440cfca0 msgr2=0x7f8d440d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:40.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:40.117+0000 7f8d4a177640 1 -- 172.21.15.132:0/1956159824 shutdown_connections 2023-12-20T04:47:40.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:40.117+0000 7f8d4a177640 1 -- 172.21.15.132:0/1956159824 wait complete. 2023-12-20T04:47:40.196 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-20T04:47:42.976 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:47:42.975+0000 7f1a5f3c2640 -1 log_channel(cluster) log [ERR] : Health check failed: Full OSDs blocking recovery: 1 pg recovery_toofull (PG_RECOVERY_FULL) 2023-12-20T04:47:45.197 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:47:45.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.308+0000 7fc7f5f41640 1 Processor -- start 2023-12-20T04:47:45.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.308+0000 7fc7f5f41640 1 -- start start 2023-12-20T04:47:45.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.308+0000 7fc7f5f41640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc7f0159b50 0x7fc7f00c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:45.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.308+0000 7fc7f5f41640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc7f015e530 0x7fc7f006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:45.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.308+0000 7fc7f5f41640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7f00ccf30 con 0x7fc7f006c240 2023-12-20T04:47:45.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.308+0000 7fc7f5f41640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f00caa60 con 0x7fc7f0159b50 2023-12-20T04:47:45.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.308+0000 7fc7f5f41640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7f00ccc90 con 0x7fc7f015e530 2023-12-20T04:47:45.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.308+0000 7fc7ef7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc7f0159b50 0x7fc7f00c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:45.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.308+0000 7fc7effff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc7f006c240 0x7fc7f00cd3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47458/0 (socket says 172.21.15.132:47458) 2023-12-20T04:47:45.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.308+0000 7fc7ef7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc7f0159b50 0x7fc7f00c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44052/0 (socket says 172.21.15.132:44052) 2023-12-20T04:47:45.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.309+0000 7fc7effff640 1 -- 172.21.15.132:0/1103398809 learned_addr learned my addr 172.21.15.132:0/1103398809 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:45.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.309+0000 7fc7eeffd640 1 --2- 172.21.15.132:0/1103398809 >> v2:172.21.15.187:3300/0 conn(0x7fc7f015e530 0x7fc7f006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:45.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.309+0000 7fc7ef7fe640 1 -- 172.21.15.132:0/1103398809 >> v2:172.21.15.187:3300/0 conn(0x7fc7f015e530 msgr2=0x7fc7f006fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:45.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.309+0000 7fc7ef7fe640 1 --2- 172.21.15.132:0/1103398809 >> v2:172.21.15.187:3300/0 conn(0x7fc7f015e530 0x7fc7f006fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.309+0000 7fc7ef7fe640 1 -- 172.21.15.132:0/1103398809 >> v1:172.21.15.132:6789/0 conn(0x7fc7f006c240 legacy=0x7fc7f00cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:45.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.309+0000 7fc7ef7fe640 1 -- 172.21.15.132:0/1103398809 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7f00ca1c0 con 0x7fc7f0159b50 2023-12-20T04:47:45.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.309+0000 7fc7ee7fc640 1 -- 172.21.15.132:0/1103398809 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1793747844 0 0) 0x7fc7f00ccf30 con 0x7fc7f006c240 2023-12-20T04:47:45.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.309+0000 7fc7eeffd640 1 --2- 172.21.15.132:0/1103398809 >> v2:172.21.15.187:3300/0 conn(0x7fc7f015e530 0x7fc7f006fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:45.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.310+0000 7fc7ef7fe640 1 --2- 172.21.15.132:0/1103398809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7f0159b50 0x7fc7f00c9930 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00097a0 tx=0x7fc7e002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f00e31232742e57d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:45.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.310+0000 7fc7ee7fc640 1 -- 172.21.15.132:0/1103398809 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0031830 con 0x7fc7f0159b50 2023-12-20T04:47:45.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.310+0000 7fc7ee7fc640 1 -- 172.21.15.132:0/1103398809 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e0031990 con 0x7fc7f0159b50 2023-12-20T04:47:45.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.310+0000 7fc7ee7fc640 1 -- 172.21.15.132:0/1103398809 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e0031d20 con 0x7fc7f0159b50 2023-12-20T04:47:45.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.310+0000 7fc7f5f41640 1 -- 172.21.15.132:0/1103398809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7f0159b50 msgr2=0x7fc7f00c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:45.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.310+0000 7fc7f5f41640 1 --2- 172.21.15.132:0/1103398809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7f0159b50 0x7fc7f00c9930 secure :-1 s=READY pgs=1080 cs=0 l=1 rev1=1 crypto rx=0x7fc7e00097a0 tx=0x7fc7e002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.310+0000 7fc7f5f41640 1 -- 172.21.15.132:0/1103398809 shutdown_connections 2023-12-20T04:47:45.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.310+0000 7fc7f5f41640 1 --2- 172.21.15.132:0/1103398809 >> v2:172.21.15.187:3300/0 conn(0x7fc7f015e530 0x7fc7f006fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.310+0000 7fc7f5f41640 1 --2- 172.21.15.132:0/1103398809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7f0159b50 0x7fc7f00c9930 unknown :-1 s=CLOSED pgs=1080 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.310+0000 7fc7f5f41640 1 -- 172.21.15.132:0/1103398809 >> 172.21.15.132:0/1103398809 conn(0x7fc7f00ced10 msgr2=0x7fc7f00cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:45.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.310+0000 7fc7f5f41640 1 -- 172.21.15.132:0/1103398809 shutdown_connections 2023-12-20T04:47:45.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.310+0000 7fc7f5f41640 1 -- 172.21.15.132:0/1103398809 wait complete. 2023-12-20T04:47:45.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.311+0000 7fc7f5f41640 1 Processor -- start 2023-12-20T04:47:45.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.312+0000 7fc7f5f41640 1 -- start start 2023-12-20T04:47:45.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.312+0000 7fc7f5f41640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7f006c240 0x7fc7f0154200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:45.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.312+0000 7fc7f5f41640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7f0159b50 0x7fc7f015c1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:45.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.312+0000 7fc7f5f41640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7f015e530 0x7fc7f00c9100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:45.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.312+0000 7fc7f5f41640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f0159fa0 con 0x7fc7f0159b50 2023-12-20T04:47:45.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.312+0000 7fc7f5f41640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f015cb60 con 0x7fc7f015e530 2023-12-20T04:47:45.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.312+0000 7fc7f5f41640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7f015ce40 con 0x7fc7f006c240 2023-12-20T04:47:45.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.313+0000 7fc7eeffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7f0159b50 0x7fc7f015c1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:45.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.313+0000 7fc7eeffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7f0159b50 0x7fc7f015c1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44062/0 (socket says 172.21.15.132:44062) 2023-12-20T04:47:45.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.313+0000 7fc7eeffd640 1 -- 172.21.15.132:0/1666589995 learned_addr learned my addr 172.21.15.132:0/1666589995 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:45.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.313+0000 7fc7ef7fe640 1 --2- 172.21.15.132:0/1666589995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7f006c240 0x7fc7f0154200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:45.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.313+0000 7fc7effff640 1 --2- 172.21.15.132:0/1666589995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7f015e530 0x7fc7f00c9100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:45.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.313+0000 7fc7eeffd640 1 -- 172.21.15.132:0/1666589995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7f006c240 msgr2=0x7fc7f0154200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:45.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.313+0000 7fc7eeffd640 1 --2- 172.21.15.132:0/1666589995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7f006c240 0x7fc7f0154200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.313+0000 7fc7eeffd640 1 -- 172.21.15.132:0/1666589995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7f015e530 msgr2=0x7fc7f00c9100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:45.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.313+0000 7fc7eeffd640 1 --2- 172.21.15.132:0/1666589995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7f015e530 0x7fc7f00c9100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.313+0000 7fc7eeffd640 1 -- 172.21.15.132:0/1666589995 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7e0009400 con 0x7fc7f0159b50 2023-12-20T04:47:45.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.313+0000 7fc7eeffd640 1 --2- 172.21.15.132:0/1666589995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7f0159b50 0x7fc7f015c1f0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400c7f0 tx=0x7fc7e400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:45.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.313+0000 7fc7d7fff640 1 -- 172.21.15.132:0/1666589995 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e4007a30 con 0x7fc7f0159b50 2023-12-20T04:47:45.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.313+0000 7fc7d7fff640 1 -- 172.21.15.132:0/1666589995 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7e4007b90 con 0x7fc7f0159b50 2023-12-20T04:47:45.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.313+0000 7fc7f5f41640 1 -- 172.21.15.132:0/1666589995 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7f015d120 con 0x7fc7f0159b50 2023-12-20T04:47:45.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.313+0000 7fc7d7fff640 1 -- 172.21.15.132:0/1666589995 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7e400ce40 con 0x7fc7f0159b50 2023-12-20T04:47:45.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.313+0000 7fc7f5f41640 1 -- 172.21.15.132:0/1666589995 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7f0154740 con 0x7fc7f0159b50 2023-12-20T04:47:45.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.314+0000 7fc7f5f41640 1 -- 172.21.15.132:0/1666589995 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7f015a0e0 con 0x7fc7f0159b50 2023-12-20T04:47:45.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.315+0000 7fc7d7fff640 1 -- 172.21.15.132:0/1666589995 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc7e40113f0 con 0x7fc7f0159b50 2023-12-20T04:47:45.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.315+0000 7fc7d7fff640 1 --2- 172.21.15.132:0/1666589995 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc7dc06a430 0x7fc7dc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:45.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.315+0000 7fc7d7fff640 1 -- 172.21.15.132:0/1666589995 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc7e4088ac0 con 0x7fc7f0159b50 2023-12-20T04:47:45.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.315+0000 7fc7ef7fe640 1 --2- 172.21.15.132:0/1666589995 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc7dc06a430 0x7fc7dc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:45.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.316+0000 7fc7ef7fe640 1 --2- 172.21.15.132:0/1666589995 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc7dc06a430 0x7fc7dc06c8f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0036000 tx=0x7fc7e0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:45.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.320+0000 7fc7d7fff640 1 -- 172.21.15.132:0/1666589995 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc7f015a0e0 con 0x7fc7f0159b50 2023-12-20T04:47:45.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.486+0000 7fc7f5f41640 1 -- 172.21.15.132:0/1666589995 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fc7f015a0e0 con 0x7fc7f0159b50 2023-12-20T04:47:45.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.488+0000 7fc7d7fff640 1 -- 172.21.15.132:0/1666589995 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) v1 ==== 81+0+33958 (secure 0 0 0) 0x7fc7f015a0e0 con 0x7fc7f0159b50 2023-12-20T04:47:45.490 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:45.490 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:47:45.490 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 110, 2023-12-20T04:47:45.490 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:47:45.490 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:47:45.491 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:47:40.970633+0000", 2023-12-20T04:47:45.491 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:47:45.491 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:47:45.491 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:47:45.491 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:47:45.491 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:47:45.491 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:47:45.491 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:47:45.491 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:47:45.491 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:47:45.491 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:45.491 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:47:45.491 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:47:45.491 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:47:45.492 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:47:45.492 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:47:45.492 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 13, 2023-12-20T04:47:45.492 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:47:45.492 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:47:45.492 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "luminous", 2023-12-20T04:47:45.492 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:47:45.492 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:47:45.492 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:47:45.492 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.492 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:47:45.492 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:47:45.492 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:47:45.492 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:47:45.493 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:47:45.493 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:45.493 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:45.493 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:45.493 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:45.493 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:45.493 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:45.493 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:45.493 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:45.493 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:45.493 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:45.493 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:47:45.493 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:47:45.493 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:47:45.494 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:47:45.494 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:47:45.494 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:45.494 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:45.494 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:45.494 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:45.494 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:45.494 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:45.494 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:45.494 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.494 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:47:45.494 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:45.494 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:45.494 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:45.495 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:45.495 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:45.495 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:45.495 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:45.495 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:45.495 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:45.495 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:45.495 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:45.495 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:45.495 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:45.495 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:45.495 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:45.495 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:45.495 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:45.496 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:47:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:47:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:47:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.497 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:47:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:47:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:47:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:47:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:47:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 12, 2023-12-20T04:47:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:47:45.498 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:47:10.649946+0000", 2023-12-20T04:47:45.499 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:47:45.499 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:47:45.499 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:45.499 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:45.499 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:45.499 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:45.499 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:45.499 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:45.499 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:45.499 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:45.499 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:45.499 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:45.499 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:47:45.499 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:47:45.500 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:47:45.500 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:47:45.500 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:47:45.500 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:45.500 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:45.500 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:45.500 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:45.500 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:45.500 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:45.500 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:45.500 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.500 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:47:45.500 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:45.500 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:45.501 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:45.501 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:45.501 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:45.501 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:45.501 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:45.501 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:45.501 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:45.501 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:45.501 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:45.501 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:45.501 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:45.501 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:45.501 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:45.501 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:45.502 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:45.502 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:45.502 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:45.502 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:45.502 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:45.502 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:45.502 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:45.502 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:45.502 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:45.502 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:45.502 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.502 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:45.502 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:45.502 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:45.502 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:45.503 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:45.503 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:45.503 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:45.503 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:45.503 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:45.503 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:45.503 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:45.503 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:45.503 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:47:45.503 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:47:45.503 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:47:45.503 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.503 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:45.503 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:47:45.504 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:47:45.504 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.504 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.504 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:45.504 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 2, 2023-12-20T04:47:45.504 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 2, 2023-12-20T04:47:45.504 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:47:45.504 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:47:45.504 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:47:45.504 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:45.504 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:45.504 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:45.504 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.504 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.505 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.505 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 13, 2023-12-20T04:47:45.505 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:47:45.505 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:47:11.271933+0000", 2023-12-20T04:47:45.505 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:47:45.505 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:47:45.505 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:45.505 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:45.505 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:45.505 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:45.505 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:45.505 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:45.505 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:45.505 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:45.506 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:45.506 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:45.506 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:47:45.506 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:47:45.506 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:47:45.506 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:47:45.506 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:47:45.506 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:45.506 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:45.506 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:45.506 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:45.506 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:45.506 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:45.506 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:45.507 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.507 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:47:45.507 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:45.507 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:45.507 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:45.507 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:45.507 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:45.507 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:45.507 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:45.507 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:45.507 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:45.507 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:45.507 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:45.507 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:45.508 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:45.508 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:45.508 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:45.508 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:45.508 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:45.508 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:45.508 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:45.508 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:45.508 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:45.508 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:45.508 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:45.508 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:45.508 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:45.508 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:45.509 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.509 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:45.509 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:45.509 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:45.509 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:45.509 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:45.509 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:45.509 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:45.509 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:45.509 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:45.509 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:45.509 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:45.509 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:45.510 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:47:45.510 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:47:45.510 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.510 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:45.510 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:47:45.510 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:47:45.510 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.510 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.510 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:45.510 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.3799999952316284, 2023-12-20T04:47:45.510 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.3799999952316284, 2023-12-20T04:47:45.510 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:47:45.510 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-20T04:47:45.510 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-20T04:47:45.511 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:45.511 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:45.511 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:45.511 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.511 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.511 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:45.511 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:47:45.511 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.511 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:47:45.511 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:45.511 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:45.511 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:45.511 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:45.511 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:45.512 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:45.512 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:45.512 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:45.512 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:45.512 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:45.512 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:45.512 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:45.512 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.512 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.512 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.512 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:47:45.512 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:45.512 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.512 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.512 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.513 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:47:45.513 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:45.513 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.513 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.513 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.513 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:45.513 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.513 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.513 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.513 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:47:45.513 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:45.513 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.513 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.514 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.514 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:47:45.514 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:45.514 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.514 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.514 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.514 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:45.514 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.514 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.514 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.514 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:47:45.514 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:45.514 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.514 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.515 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.515 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:47:45.515 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:45.515 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.515 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.515 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.515 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:45.515 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.515 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.515 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.515 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:47:45.515 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:45.515 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.515 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.515 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.516 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:47:45.516 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:45.516 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.516 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.516 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.516 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:47:45.516 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:47:45.516 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:47:45.516 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:47:45.516 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:45.516 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:45.516 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:45.516 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.516 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.517 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.517 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:47:45.517 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:45.517 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:45.517 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:45.517 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:45.517 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:45.517 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:45.517 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:45.517 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:45.517 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:45.517 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:45.517 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:45.518 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:45.518 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.518 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.518 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.518 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:47:45.518 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:45.518 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.518 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.518 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.518 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:47:45.518 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:45.518 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.518 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.518 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.518 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:45.519 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.519 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.519 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.519 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:47:45.519 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:45.519 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.519 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.519 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.519 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:47:45.519 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:45.519 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.519 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.519 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.519 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:45.520 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.520 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.520 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.520 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:47:45.520 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:45.520 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.520 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.520 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.520 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:47:45.520 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:45.520 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.520 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.520 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.520 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:45.521 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.521 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.521 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.521 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:47:45.521 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:45.521 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.521 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.521 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.521 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:47:45.521 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:45.521 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.521 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.521 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.522 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:47:45.522 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:47:45.522 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:47:45.522 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:47:45.522 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:45.522 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:45.522 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:45.522 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.522 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.522 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.522 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:47:45.522 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:45.522 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:45.522 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:45.522 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:45.523 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:45.523 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:45.523 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:45.523 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:45.523 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:45.523 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:45.523 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:45.523 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:45.523 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.523 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.523 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.523 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:47:45.523 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:45.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.524 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.524 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.524 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:47:45.524 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:45.524 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.524 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.524 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:45.524 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.524 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.524 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.524 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:47:45.524 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:45.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.524 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.525 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.525 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:47:45.525 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:45.525 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.525 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.525 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.525 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:45.525 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.525 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.525 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.525 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:47:45.525 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:45.525 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.526 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.526 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.526 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:47:45.526 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:45.526 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.526 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.526 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.526 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:45.526 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.526 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.526 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.526 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:47:45.526 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:45.526 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.527 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.527 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.527 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:47:45.527 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:45.527 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.527 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.527 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.527 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:47:45.527 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:47:45.527 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:47:45.527 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:47:45.527 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:45.527 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:45.528 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:45.528 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.528 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.528 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.528 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:47:45.528 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:45.528 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:45.528 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:45.528 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:45.528 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:45.528 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:45.528 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:45.528 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:45.528 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 106, 2023-12-20T04:47:45.528 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:45.529 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:45.529 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:45.529 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.529 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.529 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.529 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:47:45.529 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:45.529 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.529 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.529 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.529 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:47:45.529 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:45.529 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.529 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:47:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:47:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:45.530 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:47:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:47:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.531 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:47:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:47:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.532 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.533 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:47:45.533 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:47:45.533 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:47:45.533 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:47:45.533 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:45.533 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:45.533 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:45.533 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.533 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.533 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.533 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:47:45.533 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:45.533 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:45.534 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:45.534 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:45.534 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:45.534 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:45.534 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:45.534 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:45.534 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:45.534 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:45.534 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:45.534 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:45.534 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.534 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.534 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.534 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:47:45.535 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:45.535 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.535 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.535 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.535 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:47:45.535 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:45.535 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.535 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.535 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.535 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:45.535 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.535 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.535 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.535 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:47:45.535 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:45.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.536 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.536 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.536 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:47:45.536 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:45.536 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.536 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.536 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:45.536 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.536 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.536 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.536 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:47:45.536 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:45.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.537 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.537 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.537 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:47:45.537 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:45.537 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.537 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.537 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:45.537 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.537 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.537 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.537 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:47:45.537 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:45.538 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.538 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.538 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.538 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:47:45.538 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:45.538 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.538 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.538 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.538 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:47:45.538 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:47:45.538 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:47:45.538 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:47:45.538 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:45.538 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:45.538 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:45.539 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.539 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.539 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.539 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:47:45.539 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:45.539 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:45.539 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:45.539 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:45.539 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:45.539 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:45.539 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:45.539 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:45.539 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 106, 2023-12-20T04:47:45.539 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:45.540 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:45.540 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:45.540 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.540 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.540 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.540 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:47:45.540 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:45.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.540 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.540 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.540 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:47:45.540 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:45.540 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.540 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.541 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:45.541 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.541 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.541 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:47:45.541 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:45.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.541 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.541 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:47:45.541 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:45.541 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.541 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.541 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:45.542 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.542 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.542 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.542 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:47:45.542 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:45.542 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.542 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.542 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.542 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:47:45.542 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:45.542 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.542 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.542 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.542 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:45.543 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.543 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.543 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.543 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:47:45.543 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:45.543 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.543 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.543 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.543 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:47:45.543 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:45.543 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.543 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.543 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.543 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:47:45.544 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:47:45.544 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:47:45.544 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:47:45.544 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:45.544 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:45.544 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:45.544 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.544 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.544 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:47:45.544 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:45.544 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:45.544 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:45.544 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:45.545 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:45.545 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:45.545 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:45.545 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:45.545 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:45.545 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:45.545 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:45.545 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:45.545 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.545 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.545 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.545 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:47:45.545 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:45.545 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.546 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.546 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.546 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:47:45.546 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:45.546 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.546 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.546 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:45.546 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.546 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.546 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.546 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:47:45.546 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:45.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.546 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.547 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.547 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:47:45.547 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:45.547 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.547 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.547 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.547 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:45.547 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.547 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.547 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.547 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:47:45.547 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:45.547 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.547 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.548 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.548 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:47:45.548 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:45.548 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.548 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.548 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.548 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:45.548 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.548 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.548 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.548 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:47:45.548 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:45.548 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.548 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.548 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.549 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:47:45.549 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:45.549 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.549 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.549 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.549 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:47:45.549 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:47:45.549 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:47:45.549 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:47:45.549 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:45.549 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:45.549 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:45.549 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.549 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.549 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.550 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:47:45.550 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:45.550 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:45.550 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:45.550 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:45.550 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:45.550 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:45.550 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:45.550 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:45.550 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:45.550 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:45.550 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:45.550 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:45.550 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.551 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.551 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.551 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:47:45.551 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:45.551 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.551 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.551 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.551 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:47:45.551 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:45.551 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.551 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.551 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.551 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:45.551 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.551 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.552 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.552 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:47:45.552 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:45.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.552 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.552 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:47:45.552 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:45.552 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.552 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.552 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:45.552 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.553 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.553 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:47:45.553 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:45.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.553 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.553 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.553 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:47:45.553 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:45.553 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.553 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.553 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:45.553 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.553 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.554 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.554 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:47:45.554 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:45.554 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.554 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.554 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.554 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:47:45.554 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:45.554 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.554 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.554 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.554 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:47:45.554 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:47:45.554 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:47:45.555 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:47:45.555 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:45.555 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:45.555 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:45.555 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.555 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.555 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:45.555 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:47:45.555 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.555 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:47:45.555 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:45.555 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:45.555 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:45.555 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:45.556 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:45.556 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:47:45.556 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:45.556 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.556 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.556 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:47:45.556 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:45.556 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:45.556 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:45.556 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:45.556 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:45.556 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:47:45.556 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:45.556 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.556 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.557 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:47:45.557 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:45.557 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:45.557 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:45.557 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:45.557 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:45.557 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:47:45.557 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:45.557 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.557 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.557 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:47:45.557 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:45.557 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:45.557 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:45.558 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:45.558 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:45.558 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:47:45.558 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:45.558 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.558 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.558 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:47:45.558 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:45.558 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:45.558 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:45.558 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:45.558 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:45.558 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:47:45.558 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:45.558 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.559 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.559 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:47:45.559 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:45.559 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:45.559 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:45.559 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:45.559 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:45.559 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:47:45.559 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:45.559 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.559 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.559 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:47:45.559 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:45.559 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:45.559 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:45.560 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:45.560 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:45.560 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:47:45.560 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:45.560 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.560 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.560 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:47:45.560 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:45.560 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:45.560 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:45.560 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:45.560 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:45.560 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:47:45.560 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:45.560 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.561 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:45.561 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:47:45.561 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [ 2023-12-20T04:47:45.561 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.561 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "13.1c", 2023-12-20T04:47:45.561 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:47:45.561 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.561 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 6, 2023-12-20T04:47:45.561 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 3 2023-12-20T04:47:45.561 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.561 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.561 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.561 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.561 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "13.23", 2023-12-20T04:47:45.562 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:47:45.562 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.562 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 1, 2023-12-20T04:47:45.562 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 5 2023-12-20T04:47:45.562 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.562 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.562 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.562 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:45.562 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:47:45.562 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:47:45.562 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:47:45.562 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:47:45.562 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:47:45.562 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:47:45.562 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:47:45.563 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:47:45.563 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:47:45.563 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:47:45.563 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:47:45.563 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:47:45.563 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.563 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.563 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:47:45.563 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:47:45.563 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:47:45.563 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:47:45.563 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:47:45.563 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:47:45.563 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:47:45.563 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:47:45.564 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:47:45.564 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:47:45.564 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:47:45.564 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.564 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:47:45.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.490+0000 7fc7f5f41640 1 -- 172.21.15.132:0/1666589995 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc7dc06a430 msgr2=0x7fc7dc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:45.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.490+0000 7fc7f5f41640 1 --2- 172.21.15.132:0/1666589995 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc7dc06a430 0x7fc7dc06c8f0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7fc7e0036000 tx=0x7fc7e0008030 comp rx=0 tx=0).stop 2023-12-20T04:47:45.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.490+0000 7fc7f5f41640 1 -- 172.21.15.132:0/1666589995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7f0159b50 msgr2=0x7fc7f015c1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:45.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.490+0000 7fc7f5f41640 1 --2- 172.21.15.132:0/1666589995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7f0159b50 0x7fc7f015c1f0 secure :-1 s=READY pgs=1081 cs=0 l=1 rev1=1 crypto rx=0x7fc7e400c7f0 tx=0x7fc7e400cbf0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.490+0000 7fc7f5f41640 1 -- 172.21.15.132:0/1666589995 shutdown_connections 2023-12-20T04:47:45.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.490+0000 7fc7f5f41640 1 --2- 172.21.15.132:0/1666589995 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc7dc06a430 0x7fc7dc06c8f0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.490+0000 7fc7f5f41640 1 --2- 172.21.15.132:0/1666589995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7f015e530 0x7fc7f00c9100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.490+0000 7fc7f5f41640 1 --2- 172.21.15.132:0/1666589995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7f0159b50 0x7fc7f015c1f0 unknown :-1 s=CLOSED pgs=1081 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.490+0000 7fc7f5f41640 1 --2- 172.21.15.132:0/1666589995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7f006c240 0x7fc7f0154200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.490+0000 7fc7f5f41640 1 -- 172.21.15.132:0/1666589995 >> 172.21.15.132:0/1666589995 conn(0x7fc7f00ced10 msgr2=0x7fc7f00b28b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:45.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.490+0000 7fc7f5f41640 1 -- 172.21.15.132:0/1666589995 shutdown_connections 2023-12-20T04:47:45.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.490+0000 7fc7f5f41640 1 -- 172.21.15.132:0/1666589995 wait complete. 2023-12-20T04:47:45.567 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-20T04:47:45.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:47:45.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.665+0000 7f980f3b1640 1 Processor -- start 2023-12-20T04:47:45.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.665+0000 7f980f3b1640 1 -- start start 2023-12-20T04:47:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.666+0000 7f980f3b1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f98080cd2d0 0x7f98080cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.666+0000 7f980f3b1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9808161650 0x7f980806fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.666+0000 7f980f3b1640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98080ae2d0 con 0x7f980815d120 2023-12-20T04:47:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.666+0000 7f980f3b1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9808071c60 con 0x7f98080cd2d0 2023-12-20T04:47:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.666+0000 7f980f3b1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f980806f7f0 con 0x7f9808161650 2023-12-20T04:47:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.666+0000 7f980c94c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f98080cd2d0 0x7f98080cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.666+0000 7f980c94c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f98080cd2d0 0x7f98080cea10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44070/0 (socket says 172.21.15.132:44070) 2023-12-20T04:47:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.666+0000 7f980c94c640 1 -- 172.21.15.132:0/2802010277 learned_addr learned my addr 172.21.15.132:0/2802010277 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.666+0000 7f980d94e640 1 --2- 172.21.15.132:0/2802010277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9808161650 0x7f980806fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.666+0000 7f980c94c640 1 -- 172.21.15.132:0/2802010277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9808161650 msgr2=0x7f980806fc80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.666+0000 7f980c94c640 1 --2- 172.21.15.132:0/2802010277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9808161650 0x7f980806fc80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.666+0000 7f980c94c640 1 -- 172.21.15.132:0/2802010277 >> v1:172.21.15.187:6789/0 conn(0x7f980815d120 legacy=0x7f98080ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:45.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.666+0000 7f980c94c640 1 -- 172.21.15.132:0/2802010277 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9808161b00 con 0x7f98080cd2d0 2023-12-20T04:47:45.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.666+0000 7f980d94e640 1 --2- 172.21.15.132:0/2802010277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9808161650 0x7f980806fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:45.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.667+0000 7f980c94c640 1 --2- 172.21.15.132:0/2802010277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98080cd2d0 0x7f98080cea10 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f97f80098a0 tx=0x7f97f802b7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab955216822dfb32 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:45.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.667+0000 7f97fffff640 1 -- 172.21.15.132:0/2802010277 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8031520 con 0x7f98080cd2d0 2023-12-20T04:47:45.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.667+0000 7f97fffff640 1 -- 172.21.15.132:0/2802010277 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97f8031680 con 0x7f98080cd2d0 2023-12-20T04:47:45.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.667+0000 7f97fffff640 1 -- 172.21.15.132:0/2802010277 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f97f8031a10 con 0x7f98080cd2d0 2023-12-20T04:47:45.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.667+0000 7f980f3b1640 1 -- 172.21.15.132:0/2802010277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98080cd2d0 msgr2=0x7f98080cea10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.667+0000 7f980f3b1640 1 --2- 172.21.15.132:0/2802010277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98080cd2d0 0x7f98080cea10 secure :-1 s=READY pgs=1082 cs=0 l=1 rev1=1 crypto rx=0x7f97f80098a0 tx=0x7f97f802b7c0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.667+0000 7f980f3b1640 1 -- 172.21.15.132:0/2802010277 shutdown_connections 2023-12-20T04:47:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.667+0000 7f980f3b1640 1 --2- 172.21.15.132:0/2802010277 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9808161650 0x7f980806fc80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.667+0000 7f980f3b1640 1 --2- 172.21.15.132:0/2802010277 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f98080cd2d0 0x7f98080cea10 unknown :-1 s=CLOSED pgs=1082 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.668+0000 7f980f3b1640 1 -- 172.21.15.132:0/2802010277 >> 172.21.15.132:0/2802010277 conn(0x7f980806a050 msgr2=0x7f980806a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.668+0000 7f980f3b1640 1 -- 172.21.15.132:0/2802010277 shutdown_connections 2023-12-20T04:47:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.668+0000 7f980f3b1640 1 -- 172.21.15.132:0/2802010277 wait complete. 2023-12-20T04:47:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.669+0000 7f980f3b1640 1 Processor -- start 2023-12-20T04:47:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.669+0000 7f980f3b1640 1 -- start start 2023-12-20T04:47:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.669+0000 7f980f3b1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98080cd2d0 0x7f98081f20d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.669+0000 7f980f3b1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f980815d120 0x7f980815f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.669+0000 7f980f3b1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9808161650 0x7f980815fec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:45.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.669+0000 7f980f3b1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98080c23d0 con 0x7f9808161650 2023-12-20T04:47:45.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.669+0000 7f980f3b1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98080c2da0 con 0x7f98080cd2d0 2023-12-20T04:47:45.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.669+0000 7f980f3b1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98081604f0 con 0x7f980815d120 2023-12-20T04:47:45.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.670+0000 7f980d94e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9808161650 0x7f980815fec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:45.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.670+0000 7f980d94e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9808161650 0x7f980815fec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44076/0 (socket says 172.21.15.132:44076) 2023-12-20T04:47:45.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.670+0000 7f980d94e640 1 -- 172.21.15.132:0/3940032829 learned_addr learned my addr 172.21.15.132:0/3940032829 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:45.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.670+0000 7f980d14d640 1 --2- 172.21.15.132:0/3940032829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98080cd2d0 0x7f98081f20d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:45.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.670+0000 7f980c94c640 1 --2- 172.21.15.132:0/3940032829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f980815d120 0x7f980815f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:45.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.670+0000 7f980d94e640 1 -- 172.21.15.132:0/3940032829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f980815d120 msgr2=0x7f980815f980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:45.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.670+0000 7f980d94e640 1 --2- 172.21.15.132:0/3940032829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f980815d120 0x7f980815f980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.670+0000 7f980d94e640 1 -- 172.21.15.132:0/3940032829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98080cd2d0 msgr2=0x7f98081f20d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:45.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.670+0000 7f980d94e640 1 --2- 172.21.15.132:0/3940032829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98080cd2d0 0x7f98081f20d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.670+0000 7f980d94e640 1 -- 172.21.15.132:0/3940032829 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97f80094d0 con 0x7f9808161650 2023-12-20T04:47:45.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.670+0000 7f980d94e640 1 --2- 172.21.15.132:0/3940032829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9808161650 0x7f980815fec0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f980000cef0 tx=0x7f980000a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:45.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.670+0000 7f97fdffb640 1 -- 172.21.15.132:0/3940032829 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980000d840 con 0x7f9808161650 2023-12-20T04:47:45.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.670+0000 7f97fdffb640 1 -- 172.21.15.132:0/3940032829 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f980000d9c0 con 0x7f9808161650 2023-12-20T04:47:45.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.670+0000 7f97fdffb640 1 -- 172.21.15.132:0/3940032829 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f980000dd70 con 0x7f9808161650 2023-12-20T04:47:45.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.670+0000 7f980f3b1640 1 -- 172.21.15.132:0/3940032829 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98081607d0 con 0x7f9808161650 2023-12-20T04:47:45.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.670+0000 7f980f3b1640 1 -- 172.21.15.132:0/3940032829 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98080c32d0 con 0x7f9808161650 2023-12-20T04:47:45.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.672+0000 7f980f3b1640 1 -- 172.21.15.132:0/3940032829 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9808066820 con 0x7f9808161650 2023-12-20T04:47:45.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.672+0000 7f97fdffb640 1 -- 172.21.15.132:0/3940032829 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f980001e3b0 con 0x7f9808161650 2023-12-20T04:47:45.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.672+0000 7f97fdffb640 1 --2- 172.21.15.132:0/3940032829 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f97ec06a430 0x7f97ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:45.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.672+0000 7f97fdffb640 1 -- 172.21.15.132:0/3940032829 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f98000893e0 con 0x7f9808161650 2023-12-20T04:47:45.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.672+0000 7f980d14d640 1 --2- 172.21.15.132:0/3940032829 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f97ec06a430 0x7f97ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:45.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.673+0000 7f980d14d640 1 --2- 172.21.15.132:0/3940032829 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f97ec06a430 0x7f97ec06c8f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9804006fd0 tx=0x7f9804008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:45.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.676+0000 7f97fdffb640 1 -- 172.21.15.132:0/3940032829 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9800054a50 con 0x7f9808161650 2023-12-20T04:47:45.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.843+0000 7f980f3b1640 1 -- 172.21.15.132:0/3940032829 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f98080c34f0 con 0x7f9808161650 2023-12-20T04:47:45.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.845+0000 7f97fdffb640 1 -- 172.21.15.132:0/3940032829 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v110) v1 ==== 81+0+33958 (secure 0 0 0) 0x7f9800058070 con 0x7f9808161650 2023-12-20T04:47:45.847 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:45.847 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:47:45.847 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 110, 2023-12-20T04:47:45.847 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:47:45.847 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:47:45.847 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:47:40.970633+0000", 2023-12-20T04:47:45.847 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:47:45.848 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:47:45.848 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:47:45.848 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:47:45.848 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:47:45.848 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:47:45.848 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:47:45.848 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:47:45.848 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:47:45.848 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:45.848 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:47:45.848 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:47:45.848 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:47:45.848 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:47:45.849 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:47:45.849 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 13, 2023-12-20T04:47:45.849 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:47:45.849 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:47:45.849 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "luminous", 2023-12-20T04:47:45.849 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:47:45.849 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:47:45.849 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:47:45.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.849 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:47:45.849 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:47:45.849 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:47:45.849 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:47:45.849 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:47:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:47:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:47:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:47:45.850 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:47:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:47:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:47:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:45.851 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:45.852 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:45.853 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:45.853 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:45.853 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:45.853 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:45.853 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:45.853 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:45.853 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:45.853 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:45.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.853 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:45.853 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:45.853 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:45.853 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:45.854 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:45.854 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:45.854 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:45.854 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:45.854 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:45.854 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:45.854 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:45.854 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:45.854 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:47:45.854 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:47:45.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.854 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:45.854 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:47:45.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.855 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:45.855 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:47:45.855 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:47:45.855 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:47:45.855 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:47:45.855 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:47:45.855 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:45.855 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:45.855 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:45.855 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.855 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 12, 2023-12-20T04:47:45.855 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:47:45.855 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:47:10.649946+0000", 2023-12-20T04:47:45.856 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:47:45.856 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:47:45.856 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:45.856 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:45.856 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:45.856 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:45.856 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:45.856 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:45.856 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:45.856 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:45.856 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:45.856 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:45.856 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:47:45.856 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:47:45.856 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:47:45.857 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:47:45.857 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:47:45.857 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:45.857 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:45.857 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:45.857 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:45.857 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:45.857 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:45.857 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:45.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.857 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:47:45.857 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:45.857 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:45.857 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:45.858 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:45.858 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:45.858 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:45.858 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:45.858 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:45.858 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:45.858 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:45.858 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:45.858 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:45.858 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:45.858 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:45.858 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:45.858 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:45.858 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:45.858 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:45.859 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:45.859 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:45.859 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:45.859 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:45.859 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:45.859 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:45.859 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:45.859 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:45.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.859 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:45.859 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:45.859 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:45.859 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:45.859 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:45.859 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:45.860 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:45.860 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:45.860 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:45.860 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:45.860 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:45.860 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:45.860 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:47:45.860 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:47:45.860 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:47:45.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.860 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:45.860 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:47:45.860 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:47:45.860 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.861 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.861 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:45.861 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 2, 2023-12-20T04:47:45.861 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 2, 2023-12-20T04:47:45.861 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:47:45.861 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:47:45.861 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:47:45.861 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:45.861 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:45.861 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:45.861 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.861 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.861 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.862 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 13, 2023-12-20T04:47:45.862 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:47:45.862 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:47:11.271933+0000", 2023-12-20T04:47:45.862 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:47:45.862 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:47:45.862 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:47:45.862 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:47:45.862 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:47:45.862 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:47:45.862 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:47:45.862 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:47:45.862 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:47:45.862 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:47:45.862 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:47:45.863 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:47:45.863 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:47:45.863 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:47:45.863 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:47:45.863 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:47:45.863 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:47:45.863 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:47:45.863 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:47:45.863 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:47:45.863 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:47:45.863 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:47:45.863 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:47:45.863 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:47:45.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.863 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:47:45.864 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:47:45.864 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:47:45.864 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:47:45.864 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:47:45.864 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:47:45.864 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:47:45.864 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:47:45.864 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:47:45.864 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:47:45.864 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:47:45.864 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:47:45.864 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:47:45.864 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:47:45.864 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:47:45.865 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:47:45.865 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:47:45.865 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:47:45.865 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:47:45.865 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:47:45.865 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:47:45.865 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:47:45.865 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:47:45.865 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:47:45.865 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:47:45.865 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:47:45.865 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:47:45.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.866 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:47:45.866 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:47:45.866 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:47:45.866 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:47:45.866 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:47:45.866 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:47:45.866 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:47:45.866 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:47:45.866 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:47:45.866 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:47:45.866 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:47:45.866 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:47:45.866 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:47:45.866 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:47:45.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.867 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:47:45.867 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:47:45.867 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:47:45.867 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.867 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:47:45.867 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.3799999952316284, 2023-12-20T04:47:45.867 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.3799999952316284, 2023-12-20T04:47:45.867 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:47:45.867 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-20T04:47:45.867 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-20T04:47:45.867 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:47:45.867 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:47:45.867 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:47:45.867 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.868 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.868 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:45.868 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:47:45.868 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.868 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:47:45.868 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:45.868 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:45.868 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:45.868 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:45.868 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:45.868 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:45.868 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:45.868 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:45.868 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:45.869 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:45.869 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:45.869 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:45.869 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.869 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.869 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:47:45.869 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:45.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.869 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.869 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:47:45.869 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:45.869 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.870 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.870 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:45.870 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.870 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.870 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:47:45.870 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:45.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.870 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.870 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:47:45.870 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:45.870 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.870 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.871 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:45.871 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.871 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.871 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:47:45.871 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:45.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.871 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.871 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:47:45.871 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:45.871 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.871 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.872 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:45.872 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.872 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.872 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:47:45.872 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:45.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.872 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.872 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:47:45.872 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:47:45.872 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.872 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.873 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:47:45.873 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:47:45.873 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:47:45.873 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:47:45.873 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:45.873 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:45.873 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:45.873 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.873 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.873 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:47:45.873 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:45.873 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:45.874 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:45.874 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:45.874 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:45.874 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:45.874 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:45.874 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:45.874 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:45.874 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:45.874 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:45.874 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:45.874 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.874 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.874 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.874 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:47:45.874 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:45.874 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.875 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.875 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:47:45.875 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:45.875 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.875 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.875 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:45.875 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.875 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.875 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:47:45.875 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:45.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.876 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.876 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:47:45.876 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:45.876 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.876 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.876 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:45.876 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.876 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.876 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:47:45.876 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:45.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.876 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.877 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:47:45.877 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:45.877 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.877 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.877 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:45.877 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.877 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.877 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:47:45.877 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:45.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.877 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.878 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:47:45.878 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:47:45.878 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.878 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.878 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.878 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:47:45.878 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:47:45.878 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:47:45.878 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:47:45.878 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:45.878 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:45.878 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:45.878 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.878 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.878 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.879 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:47:45.879 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:45.879 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:45.879 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:45.879 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:45.879 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:45.879 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:45.879 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:45.879 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:45.879 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:45.879 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:45.879 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:45.879 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:45.879 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.879 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.880 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.880 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:47:45.880 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:45.880 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.880 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.880 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.880 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:47:45.880 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:45.880 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.880 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.880 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.880 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:45.880 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.880 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.880 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.881 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:47:45.881 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:45.881 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.881 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.881 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.881 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:47:45.881 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:45.881 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.881 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.881 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.881 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:45.881 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.881 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.881 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.882 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:47:45.882 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:45.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.882 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.882 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.882 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:47:45.882 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:45.882 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.882 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.882 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:45.882 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.882 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.882 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.883 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:47:45.883 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:45.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.883 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.883 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.883 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:47:45.883 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:47:45.883 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.883 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.883 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:47:45.883 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:47:45.883 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:47:45.883 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:47:45.883 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:45.884 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:45.884 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:45.884 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.884 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.884 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.884 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:47:45.884 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:45.884 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:45.884 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:45.884 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:45.884 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:45.884 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:45.884 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:45.884 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:45.884 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 106, 2023-12-20T04:47:45.885 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:45.885 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:45.885 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:45.885 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.885 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.885 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:47:45.885 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:45.885 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.885 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.885 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:47:45.885 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:45.886 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.886 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.886 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.886 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:45.886 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.886 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.886 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.886 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:47:45.886 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:45.886 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.886 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.886 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.886 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:47:45.886 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:45.886 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.887 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.887 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:45.887 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.887 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.887 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.887 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:47:45.887 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:45.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.887 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.887 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.887 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:47:45.887 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:45.887 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.887 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.888 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.888 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:45.888 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.888 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.888 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.888 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:47:45.888 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:45.888 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.888 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.888 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.888 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:47:45.888 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:47:45.888 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.888 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.889 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.889 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:47:45.889 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:47:45.889 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:47:45.889 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:47:45.889 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:45.889 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:45.889 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:45.889 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.889 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.889 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.889 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:47:45.889 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:45.890 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:45.890 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:45.890 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:45.890 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:45.890 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:45.890 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:45.890 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:45.890 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:45.890 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:45.890 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:45.890 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:45.890 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.890 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.890 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.890 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:47:45.891 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:45.891 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.891 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.891 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.891 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:47:45.891 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:45.891 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.891 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.891 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.891 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:45.891 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.891 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.891 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.891 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:47:45.891 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:45.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.892 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.892 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.892 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:47:45.892 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:45.892 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.892 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.892 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:45.892 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.892 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.892 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.892 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:47:45.892 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:45.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.892 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.893 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.893 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:47:45.893 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:45.893 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.893 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.893 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.893 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:45.893 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.893 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.893 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.893 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:47:45.893 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:45.893 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.893 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.894 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.894 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:47:45.894 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:47:45.894 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.894 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.894 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.894 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:47:45.894 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:47:45.894 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:47:45.894 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:47:45.894 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:45.894 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:45.894 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:45.894 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.894 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.895 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.895 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:47:45.895 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:45.895 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:45.895 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:45.895 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:45.895 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:45.895 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:45.895 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:45.895 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:45.895 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 106, 2023-12-20T04:47:45.895 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:45.895 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:45.895 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:45.895 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.896 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.896 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.896 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:47:45.896 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:45.896 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.896 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.896 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.896 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:47:45.896 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:45.896 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.896 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.896 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.896 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:45.896 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.897 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.897 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.897 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:47:45.897 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:45.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.897 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.897 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.897 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:47:45.897 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:45.897 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.897 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.897 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:45.897 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.898 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.898 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.898 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:47:45.898 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:45.898 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.898 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.898 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.898 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:47:45.898 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:45.898 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.898 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.898 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.898 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:45.898 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.898 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.898 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.899 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:47:45.899 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:45.899 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.899 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.899 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.899 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:47:45.899 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:47:45.899 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.899 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.899 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.899 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:47:45.899 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:47:45.899 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:47:45.899 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:47:45.900 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:45.900 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:45.900 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:45.900 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.900 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.900 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.900 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:47:45.900 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:45.900 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:45.900 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:45.900 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:45.900 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:45.900 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:45.900 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:45.900 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:45.901 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:45.901 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:45.901 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:45.901 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:45.901 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.901 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.901 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.901 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:47:45.901 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:45.901 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.901 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.901 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.901 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:47:45.901 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:45.901 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.902 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.902 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.902 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:45.902 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.902 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.902 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.902 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:47:45.902 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:45.902 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.902 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.902 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.902 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:47:45.902 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:45.902 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.902 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.903 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.903 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:45.903 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.903 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.903 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.903 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:47:45.903 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:45.903 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.903 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.903 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.903 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:47:45.903 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:45.903 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.903 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.904 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.904 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:45.904 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.904 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.904 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.904 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:47:45.904 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:45.904 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.904 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.904 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.904 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:47:45.904 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:47:45.904 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.904 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.904 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.905 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:47:45.905 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:47:45.905 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:47:45.905 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:47:45.905 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:45.905 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:45.905 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:45.905 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.905 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.905 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.905 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:47:45.905 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:47:45.905 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:47:45.905 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:47:45.906 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:47:45.906 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:47:45.906 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:47:45.906 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:47:45.906 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:47:45.906 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 99, 2023-12-20T04:47:45.906 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:47:45.906 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:47:45.906 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:47:45.906 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.906 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.906 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.906 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:47:45.906 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:45.906 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.907 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.907 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.907 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:47:45.907 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:45.907 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.907 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.907 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.907 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:47:45.907 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.907 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.907 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.907 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:47:45.907 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:45.907 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.908 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.908 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.908 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:47:45.908 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:45.908 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.908 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.908 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.908 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:47:45.908 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.908 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.908 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.908 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:47:45.908 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:45.908 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.908 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.909 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.909 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:47:45.909 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:45.909 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.909 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.909 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.909 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:47:45.909 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:47:45.909 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.909 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:47:45.909 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:47:45.909 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:45.909 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.909 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.910 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:47:45.910 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:47:45.910 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:47:45.910 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.910 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.910 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.910 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:47:45.910 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:47:45.910 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:47:45.910 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:47:45.910 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:47:45.910 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:47:45.910 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:47:45.910 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.910 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.911 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:45.911 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:47:45.911 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.911 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:47:45.911 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:45.911 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:45.911 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:45.911 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:45.911 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:45.911 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:47:45.911 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:45.911 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.911 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.911 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:47:45.911 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:45.912 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:45.912 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:45.912 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:45.912 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:45.912 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:47:45.912 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:45.912 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.912 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.912 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:47:45.912 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:45.912 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:45.912 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:45.912 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:45.912 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:45.912 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:47:45.913 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:45.913 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.913 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.913 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:47:45.913 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:45.913 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:45.913 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:45.913 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:45.913 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:45.913 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:47:45.913 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:45.913 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.913 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.913 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:47:45.913 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:45.914 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:45.914 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:45.914 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:45.914 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:45.914 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:47:45.914 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:45.914 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.914 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.914 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:47:45.914 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:45.914 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:45.914 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:45.914 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:45.914 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:45.915 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:47:45.915 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:45.915 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.915 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.915 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:47:45.915 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:45.915 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:45.915 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:45.915 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:45.915 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:45.915 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:47:45.915 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:45.915 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.915 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.915 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:47:45.916 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:47:45.916 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:47:45.916 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:47:45.916 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:47:45.916 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:47:45.916 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:47:45.916 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:47:45.916 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.916 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:45.916 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:47:45.916 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [ 2023-12-20T04:47:45.916 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.916 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "13.1c", 2023-12-20T04:47:45.916 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:47:45.917 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.917 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 6, 2023-12-20T04:47:45.917 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 3 2023-12-20T04:47:45.917 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.917 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.917 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.917 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.917 INFO:teuthology.orchestra.run.smithi132.stdout: "pgid": "13.23", 2023-12-20T04:47:45.917 INFO:teuthology.orchestra.run.smithi132.stdout: "mappings": [ 2023-12-20T04:47:45.917 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:47:45.917 INFO:teuthology.orchestra.run.smithi132.stdout: "from": 1, 2023-12-20T04:47:45.917 INFO:teuthology.orchestra.run.smithi132.stdout: "to": 5 2023-12-20T04:47:45.917 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.917 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:47:45.917 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.918 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:47:45.918 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:47:45.918 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:47:45.918 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:47:45.918 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:47:45.918 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:47:45.918 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:47:45.918 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:47:45.918 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:47:45.918 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:47:45.918 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:47:45.918 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:47:45.918 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:47:45.918 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.918 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:47:45.919 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:47:45.919 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:47:45.919 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:47:45.919 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:47:45.919 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:47:45.919 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:47:45.919 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:47:45.919 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:47:45.919 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:47:45.919 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:47:45.919 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:47:45.919 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:47:45.919 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:47:45.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.847+0000 7f980f3b1640 1 -- 172.21.15.132:0/3940032829 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f97ec06a430 msgr2=0x7f97ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:45.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.847+0000 7f980f3b1640 1 --2- 172.21.15.132:0/3940032829 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f97ec06a430 0x7f97ec06c8f0 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f9804006fd0 tx=0x7f9804008040 comp rx=0 tx=0).stop 2023-12-20T04:47:45.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.847+0000 7f980f3b1640 1 -- 172.21.15.132:0/3940032829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9808161650 msgr2=0x7f980815fec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:45.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.847+0000 7f980f3b1640 1 --2- 172.21.15.132:0/3940032829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9808161650 0x7f980815fec0 secure :-1 s=READY pgs=1083 cs=0 l=1 rev1=1 crypto rx=0x7f980000cef0 tx=0x7f980000a710 comp rx=0 tx=0).stop 2023-12-20T04:47:45.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.847+0000 7f980f3b1640 1 -- 172.21.15.132:0/3940032829 shutdown_connections 2023-12-20T04:47:45.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.847+0000 7f980f3b1640 1 --2- 172.21.15.132:0/3940032829 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f97ec06a430 0x7f97ec06c8f0 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.847+0000 7f980f3b1640 1 --2- 172.21.15.132:0/3940032829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9808161650 0x7f980815fec0 unknown :-1 s=CLOSED pgs=1083 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.847+0000 7f980f3b1640 1 --2- 172.21.15.132:0/3940032829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f980815d120 0x7f980815f980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.847+0000 7f980f3b1640 1 --2- 172.21.15.132:0/3940032829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98080cd2d0 0x7f98081f20d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:45.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.847+0000 7f980f3b1640 1 -- 172.21.15.132:0/3940032829 >> 172.21.15.132:0/3940032829 conn(0x7f980806a050 msgr2=0x7f98080ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:45.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.847+0000 7f980f3b1640 1 -- 172.21.15.132:0/3940032829 shutdown_connections 2023-12-20T04:47:45.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:45.847+0000 7f980f3b1640 1 -- 172.21.15.132:0/3940032829 wait complete. 2023-12-20T04:47:45.923 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:47:46.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.022+0000 7f4830843640 1 Processor -- start 2023-12-20T04:47:46.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.022+0000 7f4830843640 1 -- start start 2023-12-20T04:47:46.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.023+0000 7f4830843640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f482c15cef0 0x7f482c0cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:46.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.023+0000 7f4830843640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482c0ad2f0 0x7f482c06bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:46.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.023+0000 7f4830843640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f482c0ad7a0 con 0x7f482c15d2d0 2023-12-20T04:47:46.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.023+0000 7f4830843640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f482c0add30 con 0x7f482c15cef0 2023-12-20T04:47:46.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.023+0000 7f4830843640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0ae010 con 0x7f482c0ad2f0 2023-12-20T04:47:46.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.023+0000 7f482ad9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482c0ad2f0 0x7f482c06bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:46.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.023+0000 7f482a59c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f482c15cef0 0x7f482c0cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:46.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.023+0000 7f482ad9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482c0ad2f0 0x7f482c06bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:41368/0 (socket says 172.21.15.132:41368) 2023-12-20T04:47:46.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.023+0000 7f482ad9d640 1 -- 172.21.15.132:0/3234321011 learned_addr learned my addr 172.21.15.132:0/3234321011 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:46.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.023+0000 7f4829d9b640 1 -- 172.21.15.132:0/3234321011 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1213230255 0 0) 0x7f482c0ad7a0 con 0x7f482c15d2d0 2023-12-20T04:47:46.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.023+0000 7f4829d9b640 1 -- 172.21.15.132:0/3234321011 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4818003520 con 0x7f482c15d2d0 2023-12-20T04:47:46.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.023+0000 7f482ad9d640 1 -- 172.21.15.132:0/3234321011 >> v2:172.21.15.187:3300/0 conn(0x7f482c15cef0 msgr2=0x7f482c0cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:46.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.023+0000 7f482ad9d640 1 --2- 172.21.15.132:0/3234321011 >> v2:172.21.15.187:3300/0 conn(0x7f482c15cef0 0x7f482c0cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:46.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.023+0000 7f482ad9d640 1 -- 172.21.15.132:0/3234321011 >> v1:172.21.15.187:6789/0 conn(0x7f482c15d2d0 legacy=0x7f482c0cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:46.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.023+0000 7f482ad9d640 1 -- 172.21.15.132:0/3234321011 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f482c072d00 con 0x7f482c0ad2f0 2023-12-20T04:47:46.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.023+0000 7f482a59c640 1 --2- 172.21.15.132:0/3234321011 >> v2:172.21.15.187:3300/0 conn(0x7f482c15cef0 0x7f482c0cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:47:46.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.024+0000 7f482ad9d640 1 --2- 172.21.15.132:0/3234321011 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482c0ad2f0 0x7f482c06bd00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4824009e50 tx=0x7f482402bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c0f7c1f50fe1c63f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:46.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.024+0000 7f4829d9b640 1 -- 172.21.15.132:0/3234321011 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f482402cb90 con 0x7f482c0ad2f0 2023-12-20T04:47:46.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.024+0000 7f4829d9b640 1 -- 172.21.15.132:0/3234321011 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f482402ccf0 con 0x7f482c0ad2f0 2023-12-20T04:47:46.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.024+0000 7f4829d9b640 1 -- 172.21.15.132:0/3234321011 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48240345f0 con 0x7f482c0ad2f0 2023-12-20T04:47:46.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.025+0000 7f4830843640 1 -- 172.21.15.132:0/3234321011 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482c0ad2f0 msgr2=0x7f482c06bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:46.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.025+0000 7f4830843640 1 --2- 172.21.15.132:0/3234321011 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482c0ad2f0 0x7f482c06bd00 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f4824009e50 tx=0x7f482402bff0 comp rx=0 tx=0).stop 2023-12-20T04:47:46.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.025+0000 7f4830843640 1 -- 172.21.15.132:0/3234321011 shutdown_connections 2023-12-20T04:47:46.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.025+0000 7f4830843640 1 --2- 172.21.15.132:0/3234321011 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482c0ad2f0 0x7f482c06bd00 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:46.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.025+0000 7f4830843640 1 --2- 172.21.15.132:0/3234321011 >> v2:172.21.15.187:3300/0 conn(0x7f482c15cef0 0x7f482c0cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:46.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.025+0000 7f4830843640 1 -- 172.21.15.132:0/3234321011 >> 172.21.15.132:0/3234321011 conn(0x7f482c0cf330 msgr2=0x7f482c0cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:46.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.025+0000 7f4830843640 1 -- 172.21.15.132:0/3234321011 shutdown_connections 2023-12-20T04:47:46.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.025+0000 7f4830843640 1 -- 172.21.15.132:0/3234321011 wait complete. 2023-12-20T04:47:46.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.026+0000 7f4830843640 1 Processor -- start 2023-12-20T04:47:46.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.026+0000 7f4830843640 1 -- start start 2023-12-20T04:47:46.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.027+0000 7f4830843640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f482c0ad2f0 0x7f482c06a440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:46.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.027+0000 7f4830843640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f482c15cef0 0x7f482c0b4480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:46.031 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.027+0000 7f4830843640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482c15d2d0 0x7f482c0b49c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:46.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.027+0000 7f4830843640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c1f6c20 con 0x7f482c15cef0 2023-12-20T04:47:46.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.027+0000 7f4830843640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f482c0b4f00 con 0x7f482c0ad2f0 2023-12-20T04:47:46.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.027+0000 7f4830843640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f482c1f5c30 con 0x7f482c15d2d0 2023-12-20T04:47:46.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.027+0000 7f4823fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f482c15cef0 0x7f482c0b4480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:46.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.027+0000 7f4823fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f482c15cef0 0x7f482c0b4480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44090/0 (socket says 172.21.15.132:44090) 2023-12-20T04:47:46.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.027+0000 7f4823fff640 1 -- 172.21.15.132:0/616675838 learned_addr learned my addr 172.21.15.132:0/616675838 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:46.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.027+0000 7f482ad9d640 1 --2- 172.21.15.132:0/616675838 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482c15d2d0 0x7f482c0b49c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:46.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.027+0000 7f482a59c640 1 --2- 172.21.15.132:0/616675838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f482c0ad2f0 0x7f482c06a440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:46.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.027+0000 7f4823fff640 1 -- 172.21.15.132:0/616675838 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482c15d2d0 msgr2=0x7f482c0b49c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:46.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.027+0000 7f4823fff640 1 --2- 172.21.15.132:0/616675838 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482c15d2d0 0x7f482c0b49c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:46.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.027+0000 7f4823fff640 1 -- 172.21.15.132:0/616675838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f482c0ad2f0 msgr2=0x7f482c06a440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:46.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.027+0000 7f4823fff640 1 --2- 172.21.15.132:0/616675838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f482c0ad2f0 0x7f482c06a440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:46.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.027+0000 7f4823fff640 1 -- 172.21.15.132:0/616675838 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f481c009400 con 0x7f482c15cef0 2023-12-20T04:47:46.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.028+0000 7f4823fff640 1 --2- 172.21.15.132:0/616675838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f482c15cef0 0x7f482c0b4480 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f481400c460 tx=0x7f481400c920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:46.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.028+0000 7f4822ffd640 1 -- 172.21.15.132:0/616675838 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48140052d0 con 0x7f482c15cef0 2023-12-20T04:47:46.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.028+0000 7f4822ffd640 1 -- 172.21.15.132:0/616675838 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4814005450 con 0x7f482c15cef0 2023-12-20T04:47:46.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.028+0000 7f4830843640 1 -- 172.21.15.132:0/616675838 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4824009b30 con 0x7f482c15cef0 2023-12-20T04:47:46.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.028+0000 7f4822ffd640 1 -- 172.21.15.132:0/616675838 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4814003830 con 0x7f482c15cef0 2023-12-20T04:47:46.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.028+0000 7f4830843640 1 -- 172.21.15.132:0/616675838 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f482c1f6160 con 0x7f482c15cef0 2023-12-20T04:47:46.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.029+0000 7f4830843640 1 -- 172.21.15.132:0/616675838 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f482c04e840 con 0x7f482c15cef0 2023-12-20T04:47:46.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.029+0000 7f4822ffd640 1 -- 172.21.15.132:0/616675838 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4814003990 con 0x7f482c15cef0 2023-12-20T04:47:46.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.029+0000 7f4822ffd640 1 --2- 172.21.15.132:0/616675838 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f480c06a430 0x7f480c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:46.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.030+0000 7f4822ffd640 1 -- 172.21.15.132:0/616675838 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4814087eb0 con 0x7f482c15cef0 2023-12-20T04:47:46.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.030+0000 7f482a59c640 1 --2- 172.21.15.132:0/616675838 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f480c06a430 0x7f480c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:46.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.030+0000 7f482a59c640 1 --2- 172.21.15.132:0/616675838 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f480c06a430 0x7f480c06c8f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f481c009c60 tx=0x7f481c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:46.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.034+0000 7f4822ffd640 1 -- 172.21.15.132:0/616675838 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f48140534f0 con 0x7f482c15cef0 2023-12-20T04:47:46.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.236+0000 7f4830843640 1 -- 172.21.15.132:0/616675838 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f482c065f00 con 0x7f482c15cef0 2023-12-20T04:47:46.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.236+0000 7f4822ffd640 1 -- 172.21.15.132:0/616675838 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f4814056b10 con 0x7f482c15cef0 2023-12-20T04:47:46.238 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:46.238 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6939,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2115867433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2115867433},{"type":"v1","addr":"172.21.15.132:6837","nonce":2115867433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6942,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/162444556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":162444556},{"type":"v1","addr":"172.21.15.132:6836","nonce":162444556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2089611890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2089611890},{"type":"v1","addr":"172.21.15.187:6835","nonce":2089611890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:47:12.299623+0000","modified":"2023-12-20T04:47:14.308466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6957},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6957":{"gid":6957,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/786513656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":786513656},{"type":"v1","addr":"172.21.15.187:6834","nonce":786513656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-20T04:47:46.239 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 38 2023-12-20T04:47:46.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.238+0000 7f4830843640 1 -- 172.21.15.132:0/616675838 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f480c06a430 msgr2=0x7f480c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:46.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.238+0000 7f4830843640 1 --2- 172.21.15.132:0/616675838 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f480c06a430 0x7f480c06c8f0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f481c009c60 tx=0x7f481c008040 comp rx=0 tx=0).stop 2023-12-20T04:47:46.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.238+0000 7f4830843640 1 -- 172.21.15.132:0/616675838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f482c15cef0 msgr2=0x7f482c0b4480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:46.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.238+0000 7f4830843640 1 --2- 172.21.15.132:0/616675838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f482c15cef0 0x7f482c0b4480 secure :-1 s=READY pgs=1084 cs=0 l=1 rev1=1 crypto rx=0x7f481400c460 tx=0x7f481400c920 comp rx=0 tx=0).stop 2023-12-20T04:47:46.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.238+0000 7f4830843640 1 -- 172.21.15.132:0/616675838 shutdown_connections 2023-12-20T04:47:46.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.238+0000 7f4830843640 1 --2- 172.21.15.132:0/616675838 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f480c06a430 0x7f480c06c8f0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:46.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.238+0000 7f4830843640 1 --2- 172.21.15.132:0/616675838 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f482c15d2d0 0x7f482c0b49c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:46.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.238+0000 7f4830843640 1 --2- 172.21.15.132:0/616675838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f482c15cef0 0x7f482c0b4480 unknown :-1 s=CLOSED pgs=1084 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:46.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.238+0000 7f4830843640 1 --2- 172.21.15.132:0/616675838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f482c0ad2f0 0x7f482c06a440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:46.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.238+0000 7f4830843640 1 -- 172.21.15.132:0/616675838 >> 172.21.15.132:0/616675838 conn(0x7f482c0cf330 msgr2=0x7f482c0ac8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:46.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.238+0000 7f4830843640 1 -- 172.21.15.132:0/616675838 shutdown_connections 2023-12-20T04:47:46.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.238+0000 7f4830843640 1 -- 172.21.15.132:0/616675838 wait complete. 2023-12-20T04:47:46.251 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.b.asok --format=json status 2023-12-20T04:47:46.378 INFO:teuthology.orchestra.run.smithi187.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":6957,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":34.064251167999998,"mdsmap_epoch":38,"osdmap_epoch":110,"osdmap_epoch_barrier":105,"uptime":38.328047320000003} 2023-12-20T04:47:46.378 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 6957, "mdsmap_epoch": 38, "osdmap_epoch": 110, "osdmap_epoch_barrier": 105, "rank_uptime": 34.064251168, "state": "up:active", "uptime": 38.32804732, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:47:46.378 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-20T04:47:46.378 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:47:46.378 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:47:46.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:46.395 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-20T04:47:46.651 INFO:teuthology.orchestra.run.smithi132.stderr:50+0 records in 2023-12-20T04:47:46.651 INFO:teuthology.orchestra.run.smithi132.stderr:50+0 records out 2023-12-20T04:47:46.652 INFO:teuthology.orchestra.run.smithi132.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.198184 s, 265 MB/s 2023-12-20T04:47:46.652 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:47:46.652 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:47:46.709 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:47:46.749 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:47:46.749 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:47:46.749 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:47:46.765 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:47:46.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.902+0000 7f55fb173640 1 Processor -- start 2023-12-20T04:47:46.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.902+0000 7f55fb173640 1 -- start start 2023-12-20T04:47:46.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.903+0000 7f55fb173640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55f415e2d0 0x7f55f40b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:46.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.903+0000 7f55fb173640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f55f40cf0b0 0x7f55f40d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:46.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.903+0000 7f55fb173640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55f40cd740 con 0x7f55f40cb420 2023-12-20T04:47:46.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.903+0000 7f55fb173640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f55f40ce230 con 0x7f55f40cf0b0 2023-12-20T04:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.903+0000 7f55fb173640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f40cd990 con 0x7f55f415e2d0 2023-12-20T04:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.903+0000 7f55f8f0f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55f415e2d0 0x7f55f40b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.903+0000 7f55f9710640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f55f40cf0b0 0x7f55f40d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.903+0000 7f55ebfff640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f55f40cb420 0x7f55f40ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:38456/0 (socket says 172.21.15.132:38456) 2023-12-20T04:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.903+0000 7f55ebfff640 1 -- 172.21.15.132:0/819889140 learned_addr learned my addr 172.21.15.132:0/819889140 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.903+0000 7f55f8f0f640 1 -- 172.21.15.132:0/819889140 >> v2:172.21.15.187:3300/0 conn(0x7f55f40cf0b0 msgr2=0x7f55f40d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.903+0000 7f55f8f0f640 1 --2- 172.21.15.132:0/819889140 >> v2:172.21.15.187:3300/0 conn(0x7f55f40cf0b0 0x7f55f40d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.903+0000 7f55f8f0f640 1 -- 172.21.15.132:0/819889140 >> v1:172.21.15.187:6789/0 conn(0x7f55f40cb420 legacy=0x7f55f40ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.903+0000 7f55f8f0f640 1 -- 172.21.15.132:0/819889140 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55f40cdc70 con 0x7f55f415e2d0 2023-12-20T04:47:46.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.903+0000 7f55f9710640 1 --2- 172.21.15.132:0/819889140 >> v2:172.21.15.187:3300/0 conn(0x7f55f40cf0b0 0x7f55f40d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:47:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.904+0000 7f55f8f0f640 1 --2- 172.21.15.132:0/819889140 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55f415e2d0 0x7f55f40b3330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f55f00097a0 tx=0x7f55f002b660 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9957c720be47db60 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.904+0000 7f55eb7fe640 1 -- 172.21.15.132:0/819889140 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0030710 con 0x7f55f415e2d0 2023-12-20T04:47:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.904+0000 7f55eb7fe640 1 -- 172.21.15.132:0/819889140 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f002e050 con 0x7f55f415e2d0 2023-12-20T04:47:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.904+0000 7f55eb7fe640 1 -- 172.21.15.132:0/819889140 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f0030a90 con 0x7f55f415e2d0 2023-12-20T04:47:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.905+0000 7f55fb173640 1 -- 172.21.15.132:0/819889140 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55f415e2d0 msgr2=0x7f55f40b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.905+0000 7f55fb173640 1 --2- 172.21.15.132:0/819889140 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55f415e2d0 0x7f55f40b3330 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f55f00097a0 tx=0x7f55f002b660 comp rx=0 tx=0).stop 2023-12-20T04:47:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.905+0000 7f55fb173640 1 -- 172.21.15.132:0/819889140 shutdown_connections 2023-12-20T04:47:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.905+0000 7f55fb173640 1 --2- 172.21.15.132:0/819889140 >> v2:172.21.15.187:3300/0 conn(0x7f55f40cf0b0 0x7f55f40d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.905+0000 7f55fb173640 1 --2- 172.21.15.132:0/819889140 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55f415e2d0 0x7f55f40b3330 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.905+0000 7f55fb173640 1 -- 172.21.15.132:0/819889140 >> 172.21.15.132:0/819889140 conn(0x7f55f406d7c0 msgr2=0x7f55f406dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.905+0000 7f55fb173640 1 -- 172.21.15.132:0/819889140 shutdown_connections 2023-12-20T04:47:46.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.905+0000 7f55fb173640 1 -- 172.21.15.132:0/819889140 wait complete. 2023-12-20T04:47:46.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.906+0000 7f55fb173640 1 Processor -- start 2023-12-20T04:47:46.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.906+0000 7f55fb173640 1 -- start start 2023-12-20T04:47:46.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.907+0000 7f55fb173640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55f40cb420 0x7f55f406ad40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:46.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.907+0000 7f55fb173640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55f40cf0b0 0x7f55f41f3580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:46.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.907+0000 7f55fb173640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55f415e2d0 0x7f55f40afdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:46.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.907+0000 7f55fb173640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f40c73c0 con 0x7f55f40cb420 2023-12-20T04:47:46.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.907+0000 7f55fb173640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55f41f3ac0 con 0x7f55f40cf0b0 2023-12-20T04:47:46.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.907+0000 7f55fb173640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55f406b320 con 0x7f55f415e2d0 2023-12-20T04:47:46.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.907+0000 7f55f8f0f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55f40cb420 0x7f55f406ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:46.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.907+0000 7f55f8f0f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55f40cb420 0x7f55f406ad40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44100/0 (socket says 172.21.15.132:44100) 2023-12-20T04:47:46.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.907+0000 7f55f8f0f640 1 -- 172.21.15.132:0/2085291492 learned_addr learned my addr 172.21.15.132:0/2085291492 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:46.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.907+0000 7f55f9710640 1 --2- 172.21.15.132:0/2085291492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55f415e2d0 0x7f55f40afdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:46.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.907+0000 7f55ebfff640 1 --2- 172.21.15.132:0/2085291492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55f40cf0b0 0x7f55f41f3580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:46.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.907+0000 7f55f8f0f640 1 -- 172.21.15.132:0/2085291492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55f415e2d0 msgr2=0x7f55f40afdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:46.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.907+0000 7f55f8f0f640 1 --2- 172.21.15.132:0/2085291492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55f415e2d0 0x7f55f40afdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:46.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.907+0000 7f55f8f0f640 1 -- 172.21.15.132:0/2085291492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55f40cf0b0 msgr2=0x7f55f41f3580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:46.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.907+0000 7f55f8f0f640 1 --2- 172.21.15.132:0/2085291492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55f40cf0b0 0x7f55f41f3580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:46.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.907+0000 7f55f8f0f640 1 -- 172.21.15.132:0/2085291492 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55ec009a70 con 0x7f55f40cb420 2023-12-20T04:47:46.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.908+0000 7f55f8f0f640 1 --2- 172.21.15.132:0/2085291492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55f40cb420 0x7f55f406ad40 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f55f00098c0 tx=0x7f55f00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:46.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.908+0000 7f55e97fa640 1 -- 172.21.15.132:0/2085291492 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f003c620 con 0x7f55f40cb420 2023-12-20T04:47:46.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.908+0000 7f55e97fa640 1 -- 172.21.15.132:0/2085291492 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55f003c7a0 con 0x7f55f40cb420 2023-12-20T04:47:46.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.908+0000 7f55e97fa640 1 -- 172.21.15.132:0/2085291492 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55f003cb50 con 0x7f55f40cb420 2023-12-20T04:47:46.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.908+0000 7f55fb173640 1 -- 172.21.15.132:0/2085291492 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55f0009400 con 0x7f55f40cb420 2023-12-20T04:47:46.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.908+0000 7f55fb173640 1 -- 172.21.15.132:0/2085291492 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f55f406b8e0 con 0x7f55f40cb420 2023-12-20T04:47:46.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.909+0000 7f55fb173640 1 -- 172.21.15.132:0/2085291492 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f55f404e840 con 0x7f55f40cb420 2023-12-20T04:47:46.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.909+0000 7f55e97fa640 1 -- 172.21.15.132:0/2085291492 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f55f0039070 con 0x7f55f40cb420 2023-12-20T04:47:46.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.910+0000 7f55e97fa640 1 --2- 172.21.15.132:0/2085291492 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55e006a430 0x7f55e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:46.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.910+0000 7f55e97fa640 1 -- 172.21.15.132:0/2085291492 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f55f00a9e70 con 0x7f55f40cb420 2023-12-20T04:47:46.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.910+0000 7f55ebfff640 1 --2- 172.21.15.132:0/2085291492 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55e006a430 0x7f55e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:46.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.910+0000 7f55ebfff640 1 --2- 172.21.15.132:0/2085291492 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55e006a430 0x7f55e006c8f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f55f41f3c70 tx=0x7f55e4007e20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:46.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:46.914+0000 7f55e97fa640 1 -- 172.21.15.132:0/2085291492 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f55f00754d0 con 0x7f55f40cb420 2023-12-20T04:47:47.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.081+0000 7f55fb173640 1 -- 172.21.15.132:0/2085291492 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f55f406bc80 con 0x7f55f40cb420 2023-12-20T04:47:47.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.082+0000 7f55e97fa640 1 -- 172.21.15.132:0/2085291492 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16244 (secure 0 0 0) 0x7f55f003ccb0 con 0x7f55f40cb420 2023-12-20T04:47:47.084 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:47.085 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":110,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:47:40.970633+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:47:10.649946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-20T04:47:11.271933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1c","mappings":[{"from":6,"to":3}]},{"pgid":"13.23","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:47:47.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.084+0000 7f55fb173640 1 -- 172.21.15.132:0/2085291492 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55e006a430 msgr2=0x7f55e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.084+0000 7f55fb173640 1 --2- 172.21.15.132:0/2085291492 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55e006a430 0x7f55e006c8f0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f55f41f3c70 tx=0x7f55e4007e20 comp rx=0 tx=0).stop 2023-12-20T04:47:47.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.084+0000 7f55fb173640 1 -- 172.21.15.132:0/2085291492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55f40cb420 msgr2=0x7f55f406ad40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.084+0000 7f55fb173640 1 --2- 172.21.15.132:0/2085291492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55f40cb420 0x7f55f406ad40 secure :-1 s=READY pgs=1085 cs=0 l=1 rev1=1 crypto rx=0x7f55f00098c0 tx=0x7f55f00046c0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.085+0000 7f55fb173640 1 -- 172.21.15.132:0/2085291492 shutdown_connections 2023-12-20T04:47:47.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.085+0000 7f55fb173640 1 --2- 172.21.15.132:0/2085291492 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55e006a430 0x7f55e006c8f0 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.085+0000 7f55fb173640 1 --2- 172.21.15.132:0/2085291492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55f415e2d0 0x7f55f40afdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.085+0000 7f55fb173640 1 --2- 172.21.15.132:0/2085291492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f55f40cf0b0 0x7f55f41f3580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.085+0000 7f55fb173640 1 --2- 172.21.15.132:0/2085291492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f55f40cb420 0x7f55f406ad40 unknown :-1 s=CLOSED pgs=1085 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.085+0000 7f55fb173640 1 -- 172.21.15.132:0/2085291492 >> 172.21.15.132:0/2085291492 conn(0x7f55f406d7c0 msgr2=0x7f55f415ca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:47.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.085+0000 7f55fb173640 1 -- 172.21.15.132:0/2085291492 shutdown_connections 2023-12-20T04:47:47.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.085+0000 7f55fb173640 1 -- 172.21.15.132:0/2085291492 wait complete. 2023-12-20T04:47:47.097 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:47:10.649946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:47:11.271933+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:47:47.098 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:47:47.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.198+0000 7f76c702c640 1 Processor -- start 2023-12-20T04:47:47.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.198+0000 7f76c702c640 1 -- start start 2023-12-20T04:47:47.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.199+0000 7f76c702c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76c0069c30 0x7f76c0070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.199+0000 7f76c702c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76c015d360 0x7f76c006a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.199+0000 7f76c702c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f76c00cbde0 0x7f76c00ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.199+0000 7f76c702c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c00c4f40 con 0x7f76c015d360 2023-12-20T04:47:47.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.199+0000 7f76c702c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76c00af5b0 con 0x7f76c00cbde0 2023-12-20T04:47:47.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.199+0000 7f76c702c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c006a550 con 0x7f76c0069c30 2023-12-20T04:47:47.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.199+0000 7f76bffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76c015d360 0x7f76c006a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.199+0000 7f76bffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76c015d360 0x7f76c006a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44106/0 (socket says 172.21.15.132:44106) 2023-12-20T04:47:47.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.199+0000 7f76bffff640 1 -- 172.21.15.132:0/4148337338 learned_addr learned my addr 172.21.15.132:0/4148337338 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:47.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.199+0000 7f76c4dc8640 1 --2- 172.21.15.132:0/4148337338 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76c0069c30 0x7f76c0070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.199+0000 7f76c55c9640 1 --2- 172.21.15.132:0/4148337338 >> v2:172.21.15.187:3300/0 conn(0x7f76c00cbde0 0x7f76c00ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.199+0000 7f76bffff640 1 -- 172.21.15.132:0/4148337338 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76c0069c30 msgr2=0x7f76c0070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:47.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.199+0000 7f76bffff640 1 --2- 172.21.15.132:0/4148337338 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76c0069c30 0x7f76c0070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.199+0000 7f76bffff640 1 -- 172.21.15.132:0/4148337338 >> v2:172.21.15.187:3300/0 conn(0x7f76c00cbde0 msgr2=0x7f76c00ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:47.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.199+0000 7f76bffff640 1 --2- 172.21.15.132:0/4148337338 >> v2:172.21.15.187:3300/0 conn(0x7f76c00cbde0 0x7f76c00ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.199+0000 7f76bffff640 1 -- 172.21.15.132:0/4148337338 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76c0070a40 con 0x7f76c015d360 2023-12-20T04:47:47.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.199+0000 7f76c55c9640 1 --2- 172.21.15.132:0/4148337338 >> v2:172.21.15.187:3300/0 conn(0x7f76c00cbde0 0x7f76c00ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:47.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.200+0000 7f76bffff640 1 --2- 172.21.15.132:0/4148337338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76c015d360 0x7f76c006a010 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f76c00719e0 tx=0x7f76ac02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e80938994aa4675f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:47.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.200+0000 7f76bf7fe640 1 -- 172.21.15.132:0/4148337338 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac031870 con 0x7f76c015d360 2023-12-20T04:47:47.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.200+0000 7f76bf7fe640 1 -- 172.21.15.132:0/4148337338 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76ac0319d0 con 0x7f76c015d360 2023-12-20T04:47:47.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.200+0000 7f76bf7fe640 1 -- 172.21.15.132:0/4148337338 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76ac031d60 con 0x7f76c015d360 2023-12-20T04:47:47.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.200+0000 7f76c702c640 1 -- 172.21.15.132:0/4148337338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76c015d360 msgr2=0x7f76c006a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.200+0000 7f76c702c640 1 --2- 172.21.15.132:0/4148337338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76c015d360 0x7f76c006a010 secure :-1 s=READY pgs=1086 cs=0 l=1 rev1=1 crypto rx=0x7f76c00719e0 tx=0x7f76ac02b910 comp rx=0 tx=0).stop 2023-12-20T04:47:47.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.201+0000 7f76c702c640 1 -- 172.21.15.132:0/4148337338 shutdown_connections 2023-12-20T04:47:47.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.201+0000 7f76c702c640 1 --2- 172.21.15.132:0/4148337338 >> v2:172.21.15.187:3300/0 conn(0x7f76c00cbde0 0x7f76c00ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.201+0000 7f76c702c640 1 --2- 172.21.15.132:0/4148337338 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76c015d360 0x7f76c006a010 unknown :-1 s=CLOSED pgs=1086 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.201+0000 7f76c702c640 1 --2- 172.21.15.132:0/4148337338 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76c0069c30 0x7f76c0070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.201+0000 7f76c702c640 1 -- 172.21.15.132:0/4148337338 >> 172.21.15.132:0/4148337338 conn(0x7f76c00cc630 msgr2=0x7f76c00cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:47.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.201+0000 7f76c702c640 1 -- 172.21.15.132:0/4148337338 shutdown_connections 2023-12-20T04:47:47.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.201+0000 7f76c702c640 1 -- 172.21.15.132:0/4148337338 wait complete. 2023-12-20T04:47:47.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.202+0000 7f76c702c640 1 Processor -- start 2023-12-20T04:47:47.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.202+0000 7f76c702c640 1 -- start start 2023-12-20T04:47:47.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c702c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76c0069c30 0x7f76c0158e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c702c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76c00cbde0 0x7f76c00c9270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c702c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76c015d360 0x7f76c015fc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c702c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c00c9ac0 con 0x7f76c0069c30 2023-12-20T04:47:47.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c702c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76c00c7ea0 con 0x7f76c015d360 2023-12-20T04:47:47.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c702c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76c0159ff0 con 0x7f76c00cbde0 2023-12-20T04:47:47.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c4dc8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76c0069c30 0x7f76c0158e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c4dc8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76c0069c30 0x7f76c0158e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44116/0 (socket says 172.21.15.132:44116) 2023-12-20T04:47:47.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c4dc8640 1 -- 172.21.15.132:0/3310384520 learned_addr learned my addr 172.21.15.132:0/3310384520 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:47.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c55c9640 1 --2- 172.21.15.132:0/3310384520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76c015d360 0x7f76c015fc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76bffff640 1 --2- 172.21.15.132:0/3310384520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76c00cbde0 0x7f76c00c9270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c4dc8640 1 -- 172.21.15.132:0/3310384520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76c00cbde0 msgr2=0x7f76c00c9270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c4dc8640 1 --2- 172.21.15.132:0/3310384520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76c00cbde0 0x7f76c00c9270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c4dc8640 1 -- 172.21.15.132:0/3310384520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76c015d360 msgr2=0x7f76c015fc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c4dc8640 1 --2- 172.21.15.132:0/3310384520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76c015d360 0x7f76c015fc40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c4dc8640 1 -- 172.21.15.132:0/3310384520 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac0094d0 con 0x7f76c0069c30 2023-12-20T04:47:47.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76bffff640 1 --2- 172.21.15.132:0/3310384520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76c00cbde0 0x7f76c00c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:47.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c4dc8640 1 --2- 172.21.15.132:0/3310384520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76c0069c30 0x7f76c0158e30 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f76b400c7f0 tx=0x7f76b400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:47.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76bd7fa640 1 -- 172.21.15.132:0/3310384520 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4004220 con 0x7f76c0069c30 2023-12-20T04:47:47.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76bd7fa640 1 -- 172.21.15.132:0/3310384520 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76b40043a0 con 0x7f76c0069c30 2023-12-20T04:47:47.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c702c640 1 -- 172.21.15.132:0/3310384520 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76c015a2d0 con 0x7f76c0069c30 2023-12-20T04:47:47.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76bd7fa640 1 -- 172.21.15.132:0/3310384520 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76b4007860 con 0x7f76c0069c30 2023-12-20T04:47:47.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.203+0000 7f76c702c640 1 -- 172.21.15.132:0/3310384520 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76c00c97b0 con 0x7f76c0069c30 2023-12-20T04:47:47.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.204+0000 7f76c702c640 1 -- 172.21.15.132:0/3310384520 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76c004e840 con 0x7f76c0069c30 2023-12-20T04:47:47.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.205+0000 7f76bd7fa640 1 -- 172.21.15.132:0/3310384520 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f76b4007bd0 con 0x7f76c0069c30 2023-12-20T04:47:47.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.205+0000 7f76bd7fa640 1 --2- 172.21.15.132:0/3310384520 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f76a406a430 0x7f76a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.205+0000 7f76bd7fa640 1 -- 172.21.15.132:0/3310384520 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f76b40887d0 con 0x7f76c0069c30 2023-12-20T04:47:47.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.205+0000 7f76bffff640 1 --2- 172.21.15.132:0/3310384520 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f76a406a430 0x7f76a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.206+0000 7f76bffff640 1 --2- 172.21.15.132:0/3310384520 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f76a406a430 0x7f76a406c8f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f76ac036000 tx=0x7f76ac03c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:47.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.209+0000 7f76bd7fa640 1 -- 172.21.15.132:0/3310384520 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f76b4053ec0 con 0x7f76c0069c30 2023-12-20T04:47:47.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.376+0000 7f76c702c640 1 -- 172.21.15.132:0/3310384520 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f76c006a9a0 con 0x7f76c0069c30 2023-12-20T04:47:47.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.377+0000 7f76bd7fa640 1 -- 172.21.15.132:0/3310384520 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7f76b401e020 con 0x7f76c0069c30 2023-12-20T04:47:47.381 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:47:47.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.379+0000 7f76c702c640 1 -- 172.21.15.132:0/3310384520 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f76a406a430 msgr2=0x7f76a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.379+0000 7f76c702c640 1 --2- 172.21.15.132:0/3310384520 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f76a406a430 0x7f76a406c8f0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7f76ac036000 tx=0x7f76ac03c040 comp rx=0 tx=0).stop 2023-12-20T04:47:47.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.379+0000 7f76c702c640 1 -- 172.21.15.132:0/3310384520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76c0069c30 msgr2=0x7f76c0158e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.379+0000 7f76c702c640 1 --2- 172.21.15.132:0/3310384520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76c0069c30 0x7f76c0158e30 secure :-1 s=READY pgs=1087 cs=0 l=1 rev1=1 crypto rx=0x7f76b400c7f0 tx=0x7f76b400ccb0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.379+0000 7f76c702c640 1 -- 172.21.15.132:0/3310384520 shutdown_connections 2023-12-20T04:47:47.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.379+0000 7f76c702c640 1 --2- 172.21.15.132:0/3310384520 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f76a406a430 0x7f76a406c8f0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.379+0000 7f76c702c640 1 --2- 172.21.15.132:0/3310384520 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76c015d360 0x7f76c015fc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.379+0000 7f76c702c640 1 --2- 172.21.15.132:0/3310384520 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76c00cbde0 0x7f76c00c9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.379+0000 7f76c702c640 1 --2- 172.21.15.132:0/3310384520 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76c0069c30 0x7f76c0158e30 unknown :-1 s=CLOSED pgs=1087 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.379+0000 7f76c702c640 1 -- 172.21.15.132:0/3310384520 >> 172.21.15.132:0/3310384520 conn(0x7f76c00cc630 msgr2=0x7f76c015b720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:47.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.379+0000 7f76c702c640 1 -- 172.21.15.132:0/3310384520 shutdown_connections 2023-12-20T04:47:47.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.379+0000 7f76c702c640 1 -- 172.21.15.132:0/3310384520 wait complete. 2023-12-20T04:47:47.391 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:47:47.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.492+0000 7fefbb9ab640 1 Processor -- start 2023-12-20T04:47:47.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.492+0000 7fefbb9ab640 1 -- start start 2023-12-20T04:47:47.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.493+0000 7fefbb9ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb415d300 0x7fefb406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.493+0000 7fefbb9ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fefb40cd4b0 0x7fefb40cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.493+0000 7fefbb9ab640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fefb406cc90 con 0x7fefb415cf20 2023-12-20T04:47:47.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.493+0000 7fefbb9ab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fefb40cde60 con 0x7fefb40cd4b0 2023-12-20T04:47:47.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.493+0000 7fefbb9ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40b2f30 con 0x7fefb415d300 2023-12-20T04:47:47.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.493+0000 7fefb9f48640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fefb40cd4b0 0x7fefb40cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.493+0000 7fefb9f48640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fefb40cd4b0 0x7fefb40cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43574/0 (socket says 172.21.15.132:43574) 2023-12-20T04:47:47.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.493+0000 7fefb9f48640 1 -- 172.21.15.132:0/2963712243 learned_addr learned my addr 172.21.15.132:0/2963712243 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:47.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.493+0000 7fefb8f46640 1 --2- 172.21.15.132:0/2963712243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb415d300 0x7fefb406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.493+0000 7fefb9f48640 1 -- 172.21.15.132:0/2963712243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb415d300 msgr2=0x7fefb406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:47.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.493+0000 7fefb9f48640 1 --2- 172.21.15.132:0/2963712243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb415d300 0x7fefb406c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.494+0000 7fefb9f48640 1 -- 172.21.15.132:0/2963712243 >> v1:172.21.15.187:6789/0 conn(0x7fefb415cf20 legacy=0x7fefb4161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.494+0000 7fefb9f48640 1 -- 172.21.15.132:0/2963712243 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefb40b3210 con 0x7fefb40cd4b0 2023-12-20T04:47:47.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.494+0000 7fefb8f46640 1 --2- 172.21.15.132:0/2963712243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb415d300 0x7fefb406c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:47.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.494+0000 7fefb9f48640 1 --2- 172.21.15.132:0/2963712243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fefb40cd4b0 0x7fefb40cd920 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fefac009e50 tx=0x7fefac02bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2e926526604c497 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:47.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.494+0000 7fefabfff640 1 -- 172.21.15.132:0/2963712243 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac02cb00 con 0x7fefb40cd4b0 2023-12-20T04:47:47.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.494+0000 7fefabfff640 1 -- 172.21.15.132:0/2963712243 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefac02cc60 con 0x7fefb40cd4b0 2023-12-20T04:47:47.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.494+0000 7fefabfff640 1 -- 172.21.15.132:0/2963712243 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefac0343f0 con 0x7fefb40cd4b0 2023-12-20T04:47:47.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.495+0000 7fefbb9ab640 1 -- 172.21.15.132:0/2963712243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fefb40cd4b0 msgr2=0x7fefb40cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.495+0000 7fefbb9ab640 1 --2- 172.21.15.132:0/2963712243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fefb40cd4b0 0x7fefb40cd920 secure :-1 s=READY pgs=1088 cs=0 l=1 rev1=1 crypto rx=0x7fefac009e50 tx=0x7fefac02bf60 comp rx=0 tx=0).stop 2023-12-20T04:47:47.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.495+0000 7fefbb9ab640 1 -- 172.21.15.132:0/2963712243 shutdown_connections 2023-12-20T04:47:47.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.495+0000 7fefbb9ab640 1 --2- 172.21.15.132:0/2963712243 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fefb40cd4b0 0x7fefb40cd920 unknown :-1 s=CLOSED pgs=1088 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.495+0000 7fefbb9ab640 1 --2- 172.21.15.132:0/2963712243 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb415d300 0x7fefb406c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.495+0000 7fefbb9ab640 1 -- 172.21.15.132:0/2963712243 >> 172.21.15.132:0/2963712243 conn(0x7fefb4072c60 msgr2=0x7fefb4073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:47.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.495+0000 7fefbb9ab640 1 -- 172.21.15.132:0/2963712243 shutdown_connections 2023-12-20T04:47:47.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.495+0000 7fefbb9ab640 1 -- 172.21.15.132:0/2963712243 wait complete. 2023-12-20T04:47:47.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.496+0000 7fefbb9ab640 1 Processor -- start 2023-12-20T04:47:47.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.496+0000 7fefbb9ab640 1 -- start start 2023-12-20T04:47:47.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefbb9ab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb40cd4b0 0x7fefb40c4cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefbb9ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fefb415cf20 0x7fefb4150c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefbb9ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb415d300 0x7fefb414a2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefbb9ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40c5230 con 0x7fefb415cf20 2023-12-20T04:47:47.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefbb9ab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40c8bc0 con 0x7fefb40cd4b0 2023-12-20T04:47:47.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefbb9ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fefb4151150 con 0x7fefb415d300 2023-12-20T04:47:47.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefb8f46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fefb415cf20 0x7fefb4150c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefb8f46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fefb415cf20 0x7fefb4150c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43588/0 (socket says 172.21.15.132:43588) 2023-12-20T04:47:47.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefb8f46640 1 -- 172.21.15.132:0/521749030 learned_addr learned my addr 172.21.15.132:0/521749030 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:47.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefb9f48640 1 --2- 172.21.15.132:0/521749030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb415d300 0x7fefb414a2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefb9747640 1 --2- 172.21.15.132:0/521749030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb40cd4b0 0x7fefb40c4cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefb8f46640 1 -- 172.21.15.132:0/521749030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb415d300 msgr2=0x7fefb414a2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefb8f46640 1 --2- 172.21.15.132:0/521749030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb415d300 0x7fefb414a2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefb8f46640 1 -- 172.21.15.132:0/521749030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb40cd4b0 msgr2=0x7fefb40c4cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefb8f46640 1 --2- 172.21.15.132:0/521749030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb40cd4b0 0x7fefb40c4cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefb8f46640 1 -- 172.21.15.132:0/521749030 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fefac009b30 con 0x7fefb415cf20 2023-12-20T04:47:47.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefb9747640 1 --2- 172.21.15.132:0/521749030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb40cd4b0 0x7fefb40c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:47.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.497+0000 7fefb8f46640 1 --2- 172.21.15.132:0/521749030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fefb415cf20 0x7fefb4150c10 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fefa400d7d0 tx=0x7fefa400dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:47.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.498+0000 7fefa9ffb640 1 -- 172.21.15.132:0/521749030 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4004030 con 0x7fefb415cf20 2023-12-20T04:47:47.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.498+0000 7fefa9ffb640 1 -- 172.21.15.132:0/521749030 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fefa4004190 con 0x7fefb415cf20 2023-12-20T04:47:47.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.498+0000 7fefbb9ab640 1 -- 172.21.15.132:0/521749030 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb40c7dd0 con 0x7fefb415cf20 2023-12-20T04:47:47.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.498+0000 7fefa9ffb640 1 -- 172.21.15.132:0/521749030 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fefa4004520 con 0x7fefb415cf20 2023-12-20T04:47:47.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.498+0000 7fefbb9ab640 1 -- 172.21.15.132:0/521749030 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb40c8390 con 0x7fefb415cf20 2023-12-20T04:47:47.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.499+0000 7fefbb9ab640 1 -- 172.21.15.132:0/521749030 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb404e840 con 0x7fefb415cf20 2023-12-20T04:47:47.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.499+0000 7fefa9ffb640 1 -- 172.21.15.132:0/521749030 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fefa400b6c0 con 0x7fefb415cf20 2023-12-20T04:47:47.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.499+0000 7fefa9ffb640 1 --2- 172.21.15.132:0/521749030 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fef9806a460 0x7fef9806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.499+0000 7fefa9ffb640 1 -- 172.21.15.132:0/521749030 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fefa4088ac0 con 0x7fefb415cf20 2023-12-20T04:47:47.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.500+0000 7fefb9747640 1 --2- 172.21.15.132:0/521749030 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fef9806a460 0x7fef9806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.500+0000 7fefb9747640 1 --2- 172.21.15.132:0/521749030 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fef9806a460 0x7fef9806c920 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fefb0001680 tx=0x7fefb0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:47.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.504+0000 7fefa9ffb640 1 -- 172.21.15.132:0/521749030 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fefa4054070 con 0x7fefb415cf20 2023-12-20T04:47:47.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.667+0000 7fefbb9ab640 1 -- 172.21.15.132:0/521749030 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fefb40cd290 con 0x7fefb415cf20 2023-12-20T04:47:47.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.668+0000 7fefa9ffb640 1 -- 172.21.15.132:0/521749030 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7fefa4057690 con 0x7fefb415cf20 2023-12-20T04:47:47.670 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:47:47.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.670+0000 7fefbb9ab640 1 -- 172.21.15.132:0/521749030 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fef9806a460 msgr2=0x7fef9806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.670+0000 7fefbb9ab640 1 --2- 172.21.15.132:0/521749030 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fef9806a460 0x7fef9806c920 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fefb0001680 tx=0x7fefb0009040 comp rx=0 tx=0).stop 2023-12-20T04:47:47.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.670+0000 7fefbb9ab640 1 -- 172.21.15.132:0/521749030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fefb415cf20 msgr2=0x7fefb4150c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.670+0000 7fefbb9ab640 1 --2- 172.21.15.132:0/521749030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fefb415cf20 0x7fefb4150c10 secure :-1 s=READY pgs=1089 cs=0 l=1 rev1=1 crypto rx=0x7fefa400d7d0 tx=0x7fefa400dc90 comp rx=0 tx=0).stop 2023-12-20T04:47:47.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.670+0000 7fefbb9ab640 1 -- 172.21.15.132:0/521749030 shutdown_connections 2023-12-20T04:47:47.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.670+0000 7fefbb9ab640 1 --2- 172.21.15.132:0/521749030 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fef9806a460 0x7fef9806c920 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.670+0000 7fefbb9ab640 1 --2- 172.21.15.132:0/521749030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fefb415d300 0x7fefb414a2b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.670+0000 7fefbb9ab640 1 --2- 172.21.15.132:0/521749030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fefb415cf20 0x7fefb4150c10 unknown :-1 s=CLOSED pgs=1089 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.670+0000 7fefbb9ab640 1 --2- 172.21.15.132:0/521749030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fefb40cd4b0 0x7fefb40c4cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.670+0000 7fefbb9ab640 1 -- 172.21.15.132:0/521749030 >> 172.21.15.132:0/521749030 conn(0x7fefb4072c60 msgr2=0x7fefb40ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:47.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.670+0000 7fefbb9ab640 1 -- 172.21.15.132:0/521749030 shutdown_connections 2023-12-20T04:47:47.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.670+0000 7fefbb9ab640 1 -- 172.21.15.132:0/521749030 wait complete. 2023-12-20T04:47:47.683 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:47:47.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.783+0000 7f1993a1e640 1 Processor -- start 2023-12-20T04:47:47.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.783+0000 7f1993a1e640 1 -- start start 2023-12-20T04:47:47.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.784+0000 7f1993a1e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f198c15cf20 0x7f198c06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.784+0000 7f1993a1e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198c06cc90 con 0x7f198c15d300 2023-12-20T04:47:47.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.784+0000 7f1993a1e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f198c0b2f30 con 0x7f198c0cd4b0 2023-12-20T04:47:47.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.784+0000 7f1993a1e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f198c0b3210 con 0x7f198c15cf20 2023-12-20T04:47:47.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.784+0000 7f1990fb9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f198c15d300 0x7f198c161700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56382/0 (socket says 172.21.15.132:56382) 2023-12-20T04:47:47.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.784+0000 7f1990fb9640 1 -- 172.21.15.132:0/457868748 learned_addr learned my addr 172.21.15.132:0/457868748 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:47.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.784+0000 7f19917ba640 1 --2- 172.21.15.132:0/457868748 >> v2:172.21.15.187:3300/0 conn(0x7f198c15cf20 0x7f198c06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.785+0000 7f1983fff640 1 -- 172.21.15.132:0/457868748 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2577324011 0 0) 0x7f198c06cc90 con 0x7f198c15d300 2023-12-20T04:47:47.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.785+0000 7f1983fff640 1 -- 172.21.15.132:0/457868748 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1978003520 con 0x7f198c15d300 2023-12-20T04:47:47.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.785+0000 7f19917ba640 1 -- 172.21.15.132:0/457868748 >> v1:172.21.15.187:6789/0 conn(0x7f198c0cd4b0 legacy=0x7f198c0d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.785+0000 7f1983fff640 1 -- 172.21.15.132:0/457868748 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 736777465 0 0) 0x7f1978003520 con 0x7f198c15d300 2023-12-20T04:47:47.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.785+0000 7f19917ba640 1 -- 172.21.15.132:0/457868748 >> v1:172.21.15.132:6789/0 conn(0x7f198c15d300 legacy=0x7f198c161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.785+0000 7f19917ba640 1 -- 172.21.15.132:0/457868748 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f198c0b34f0 con 0x7f198c15cf20 2023-12-20T04:47:47.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.786+0000 7f19917ba640 1 --2- 172.21.15.132:0/457868748 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f198c15cf20 0x7f198c06c590 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1984009d90 tx=0x7f198402be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40546f5acd64c83e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:47.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.786+0000 7f1983fff640 1 -- 172.21.15.132:0/457868748 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f197c001670 con 0x7f198c15cf20 2023-12-20T04:47:47.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.786+0000 7f1983fff640 1 -- 172.21.15.132:0/457868748 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f198402c940 con 0x7f198c15cf20 2023-12-20T04:47:47.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.786+0000 7f1983fff640 1 -- 172.21.15.132:0/457868748 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f198402ccb0 con 0x7f198c15cf20 2023-12-20T04:47:47.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.786+0000 7f1993a1e640 1 -- 172.21.15.132:0/457868748 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f198c15cf20 msgr2=0x7f198c06c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.786+0000 7f1993a1e640 1 --2- 172.21.15.132:0/457868748 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f198c15cf20 0x7f198c06c590 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f1984009d90 tx=0x7f198402be10 comp rx=0 tx=0).stop 2023-12-20T04:47:47.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.786+0000 7f1993a1e640 1 -- 172.21.15.132:0/457868748 shutdown_connections 2023-12-20T04:47:47.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.786+0000 7f1993a1e640 1 --2- 172.21.15.132:0/457868748 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f198c15cf20 0x7f198c06c590 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.786+0000 7f1993a1e640 1 -- 172.21.15.132:0/457868748 >> 172.21.15.132:0/457868748 conn(0x7f198c072c60 msgr2=0x7f198c073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:47.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.786+0000 7f1993a1e640 1 -- 172.21.15.132:0/457868748 shutdown_connections 2023-12-20T04:47:47.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.786+0000 7f1993a1e640 1 -- 172.21.15.132:0/457868748 wait complete. 2023-12-20T04:47:47.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.788+0000 7f1993a1e640 1 Processor -- start 2023-12-20T04:47:47.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.788+0000 7f1993a1e640 1 -- start start 2023-12-20T04:47:47.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.788+0000 7f1993a1e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f198c0cd4b0 0x7f198c0ae050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.788+0000 7f1993a1e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f198c15cf20 0x7f198c159fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.788+0000 7f1993a1e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f198c15d300 0x7f198c0b58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.788+0000 7f1993a1e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c0b6890 con 0x7f198c15d300 2023-12-20T04:47:47.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.788+0000 7f1993a1e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198c0b3d70 con 0x7f198c0cd4b0 2023-12-20T04:47:47.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.788+0000 7f1993a1e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198c15a510 con 0x7f198c15cf20 2023-12-20T04:47:47.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.788+0000 7f1991fbb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f198c15d300 0x7f198c0b58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.788+0000 7f1991fbb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f198c15d300 0x7f198c0b58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43590/0 (socket says 172.21.15.132:43590) 2023-12-20T04:47:47.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.788+0000 7f1991fbb640 1 -- 172.21.15.132:0/2803523785 learned_addr learned my addr 172.21.15.132:0/2803523785 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:47.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.789+0000 7f19917ba640 1 --2- 172.21.15.132:0/2803523785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f198c0cd4b0 0x7f198c0ae050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.789+0000 7f1990fb9640 1 --2- 172.21.15.132:0/2803523785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f198c15cf20 0x7f198c159fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.789+0000 7f1991fbb640 1 -- 172.21.15.132:0/2803523785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f198c15cf20 msgr2=0x7f198c159fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.789+0000 7f1991fbb640 1 --2- 172.21.15.132:0/2803523785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f198c15cf20 0x7f198c159fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.789+0000 7f1991fbb640 1 -- 172.21.15.132:0/2803523785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f198c0cd4b0 msgr2=0x7f198c0ae050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.789+0000 7f1991fbb640 1 --2- 172.21.15.132:0/2803523785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f198c0cd4b0 0x7f198c0ae050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.789+0000 7f1991fbb640 1 -- 172.21.15.132:0/2803523785 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1984009a70 con 0x7f198c15d300 2023-12-20T04:47:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.789+0000 7f1990fb9640 1 --2- 172.21.15.132:0/2803523785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f198c15cf20 0x7f198c159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.789+0000 7f19917ba640 1 --2- 172.21.15.132:0/2803523785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f198c0cd4b0 0x7f198c0ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.789+0000 7f1991fbb640 1 --2- 172.21.15.132:0/2803523785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f198c15d300 0x7f198c0b58f0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f198800c400 tx=0x7f198800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.789+0000 7f1981ffb640 1 -- 172.21.15.132:0/2803523785 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19880052d0 con 0x7f198c15d300 2023-12-20T04:47:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.789+0000 7f1981ffb640 1 -- 172.21.15.132:0/2803523785 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1988005430 con 0x7f198c15d300 2023-12-20T04:47:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.789+0000 7f1993a1e640 1 -- 172.21.15.132:0/2803523785 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f198c0b62d0 con 0x7f198c15d300 2023-12-20T04:47:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.789+0000 7f1981ffb640 1 -- 172.21.15.132:0/2803523785 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1988003810 con 0x7f198c15d300 2023-12-20T04:47:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.789+0000 7f1993a1e640 1 -- 172.21.15.132:0/2803523785 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f198c0b3a00 con 0x7f198c15d300 2023-12-20T04:47:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.790+0000 7f1993a1e640 1 -- 172.21.15.132:0/2803523785 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f198c0663d0 con 0x7f198c15d300 2023-12-20T04:47:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.790+0000 7f1981ffb640 1 -- 172.21.15.132:0/2803523785 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1988003970 con 0x7f198c15d300 2023-12-20T04:47:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.791+0000 7f1981ffb640 1 --2- 172.21.15.132:0/2803523785 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f197006a430 0x7f197006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:47.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.791+0000 7f1981ffb640 1 -- 172.21.15.132:0/2803523785 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1988087f30 con 0x7f198c15d300 2023-12-20T04:47:47.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.791+0000 7f19917ba640 1 --2- 172.21.15.132:0/2803523785 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f197006a430 0x7f197006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:47.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.791+0000 7f19917ba640 1 --2- 172.21.15.132:0/2803523785 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f197006a430 0x7f197006c8f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1984036000 tx=0x7f1984030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:47.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.795+0000 7f1981ffb640 1 -- 172.21.15.132:0/2803523785 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f19880534e0 con 0x7f198c15d300 2023-12-20T04:47:47.855 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:47:47.858 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:47:47.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.965+0000 7f1993a1e640 1 -- 172.21.15.132:0/2803523785 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f198c0b3860 con 0x7f198c15d300 2023-12-20T04:47:47.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.965+0000 7f1981ffb640 1 -- 172.21.15.132:0/2803523785 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1988017020 con 0x7f198c15d300 2023-12-20T04:47:47.967 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:47:47.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.967+0000 7f1993a1e640 1 -- 172.21.15.132:0/2803523785 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f197006a430 msgr2=0x7f197006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.967+0000 7f1993a1e640 1 --2- 172.21.15.132:0/2803523785 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f197006a430 0x7f197006c8f0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7f1984036000 tx=0x7f1984030000 comp rx=0 tx=0).stop 2023-12-20T04:47:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.967+0000 7f1993a1e640 1 -- 172.21.15.132:0/2803523785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f198c15d300 msgr2=0x7f198c0b58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.967+0000 7f1993a1e640 1 --2- 172.21.15.132:0/2803523785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f198c15d300 0x7f198c0b58f0 secure :-1 s=READY pgs=1091 cs=0 l=1 rev1=1 crypto rx=0x7f198800c400 tx=0x7f198800c8c0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.967+0000 7f1993a1e640 1 -- 172.21.15.132:0/2803523785 shutdown_connections 2023-12-20T04:47:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.967+0000 7f1993a1e640 1 --2- 172.21.15.132:0/2803523785 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f197006a430 0x7f197006c8f0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.967+0000 7f1993a1e640 1 --2- 172.21.15.132:0/2803523785 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f198c15d300 0x7f198c0b58f0 unknown :-1 s=CLOSED pgs=1091 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.967+0000 7f1993a1e640 1 --2- 172.21.15.132:0/2803523785 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f198c15cf20 0x7f198c159fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.967+0000 7f1993a1e640 1 --2- 172.21.15.132:0/2803523785 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f198c0cd4b0 0x7f198c0ae050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.967+0000 7f1993a1e640 1 -- 172.21.15.132:0/2803523785 >> 172.21.15.132:0/2803523785 conn(0x7f198c072c60 msgr2=0x7f198c0b1af0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.967+0000 7f1993a1e640 1 -- 172.21.15.132:0/2803523785 shutdown_connections 2023-12-20T04:47:47.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:47.967+0000 7f1993a1e640 1 -- 172.21.15.132:0/2803523785 wait complete. 2023-12-20T04:47:47.980 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:47:48.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.079+0000 7fc568a2c640 1 Processor -- start 2023-12-20T04:47:48.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.079+0000 7fc568a2c640 1 -- start start 2023-12-20T04:47:48.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.080+0000 7fc568a2c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5640d30a0 0x7fc5640cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.080+0000 7fc568a2c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc56415d2c0 0x7fc5640d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.080+0000 7fc568a2c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc5640d0cf0 con 0x7fc5640d0060 2023-12-20T04:47:48.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.080+0000 7fc568a2c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc5640d39c0 con 0x7fc56415d2c0 2023-12-20T04:47:48.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.080+0000 7fc568a2c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640d0550 con 0x7fc5640d30a0 2023-12-20T04:47:48.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.080+0000 7fc561d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc56415d2c0 0x7fc5640d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.080+0000 7fc562d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc5640d0060 0x7fc564160c20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56386/0 (socket says 172.21.15.132:56386) 2023-12-20T04:47:48.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.080+0000 7fc561d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc56415d2c0 0x7fc5640d3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43604/0 (socket says 172.21.15.132:43604) 2023-12-20T04:47:48.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.080+0000 7fc562d9d640 1 -- 172.21.15.132:0/1648393397 learned_addr learned my addr 172.21.15.132:0/1648393397 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.080+0000 7fc56259c640 1 --2- 172.21.15.132:0/1648393397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5640d30a0 0x7fc5640cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.080+0000 7fc561d9b640 1 -- 172.21.15.132:0/1648393397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5640d30a0 msgr2=0x7fc5640cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.080+0000 7fc56159a640 1 -- 172.21.15.132:0/1648393397 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2257217393 0 0) 0x7fc5640d0cf0 con 0x7fc5640d0060 2023-12-20T04:47:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.080+0000 7fc561d9b640 1 --2- 172.21.15.132:0/1648393397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5640d30a0 0x7fc5640cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.080+0000 7fc561d9b640 1 -- 172.21.15.132:0/1648393397 >> v1:172.21.15.132:6789/0 conn(0x7fc5640d0060 legacy=0x7fc564160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.080+0000 7fc561d9b640 1 -- 172.21.15.132:0/1648393397 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5640cddc0 con 0x7fc56415d2c0 2023-12-20T04:47:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.080+0000 7fc56259c640 1 --2- 172.21.15.132:0/1648393397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5640d30a0 0x7fc5640cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.081+0000 7fc561d9b640 1 --2- 172.21.15.132:0/1648393397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc56415d2c0 0x7fc5640d3480 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc5580097a0 tx=0x7fc55802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da9335d6031d828d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.081+0000 7fc56159a640 1 -- 172.21.15.132:0/1648393397 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558031830 con 0x7fc56415d2c0 2023-12-20T04:47:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.081+0000 7fc56159a640 1 -- 172.21.15.132:0/1648393397 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc558031990 con 0x7fc56415d2c0 2023-12-20T04:47:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.081+0000 7fc56159a640 1 -- 172.21.15.132:0/1648393397 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc558031d20 con 0x7fc56415d2c0 2023-12-20T04:47:48.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.082+0000 7fc568a2c640 1 -- 172.21.15.132:0/1648393397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc56415d2c0 msgr2=0x7fc5640d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:48.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.082+0000 7fc568a2c640 1 --2- 172.21.15.132:0/1648393397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc56415d2c0 0x7fc5640d3480 secure :-1 s=READY pgs=1093 cs=0 l=1 rev1=1 crypto rx=0x7fc5580097a0 tx=0x7fc55802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.082+0000 7fc568a2c640 1 -- 172.21.15.132:0/1648393397 shutdown_connections 2023-12-20T04:47:48.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.082+0000 7fc568a2c640 1 --2- 172.21.15.132:0/1648393397 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc56415d2c0 0x7fc5640d3480 unknown :-1 s=CLOSED pgs=1093 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.082+0000 7fc568a2c640 1 --2- 172.21.15.132:0/1648393397 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5640d30a0 0x7fc5640cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.082+0000 7fc568a2c640 1 -- 172.21.15.132:0/1648393397 >> 172.21.15.132:0/1648393397 conn(0x7fc564072e40 msgr2=0x7fc564073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:48.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.082+0000 7fc568a2c640 1 -- 172.21.15.132:0/1648393397 shutdown_connections 2023-12-20T04:47:48.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.082+0000 7fc568a2c640 1 -- 172.21.15.132:0/1648393397 wait complete. 2023-12-20T04:47:48.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.083+0000 7fc568a2c640 1 Processor -- start 2023-12-20T04:47:48.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.083+0000 7fc568a2c640 1 -- start start 2023-12-20T04:47:48.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc568a2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5640d0060 0x7fc56414ac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc568a2c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5640d30a0 0x7fc56415eb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc568a2c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc56415d2c0 0x7fc5640cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc568a2c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640c6590 con 0x7fc5640d0060 2023-12-20T04:47:48.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc568a2c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640cabb0 con 0x7fc56415d2c0 2023-12-20T04:47:48.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc568a2c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5640cae90 con 0x7fc5640d30a0 2023-12-20T04:47:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc56259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5640d0060 0x7fc56414ac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc56259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5640d0060 0x7fc56414ac50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43606/0 (socket says 172.21.15.132:43606) 2023-12-20T04:47:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc56259c640 1 -- 172.21.15.132:0/190578437 learned_addr learned my addr 172.21.15.132:0/190578437 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc561d9b640 1 --2- 172.21.15.132:0/190578437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5640d30a0 0x7fc56415eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc562d9d640 1 --2- 172.21.15.132:0/190578437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc56415d2c0 0x7fc5640cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc56259c640 1 -- 172.21.15.132:0/190578437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5640d30a0 msgr2=0x7fc56415eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc56259c640 1 --2- 172.21.15.132:0/190578437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5640d30a0 0x7fc56415eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc56259c640 1 -- 172.21.15.132:0/190578437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc56415d2c0 msgr2=0x7fc5640cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc56259c640 1 --2- 172.21.15.132:0/190578437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc56415d2c0 0x7fc5640cbc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc56259c640 1 -- 172.21.15.132:0/190578437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc558009400 con 0x7fc5640d0060 2023-12-20T04:47:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc56259c640 1 --2- 172.21.15.132:0/190578437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5640d0060 0x7fc56414ac50 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00e730 tx=0x7fc55c00ebf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc552ffd640 1 -- 172.21.15.132:0/190578437 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c004230 con 0x7fc5640d0060 2023-12-20T04:47:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc552ffd640 1 -- 172.21.15.132:0/190578437 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc55c004390 con 0x7fc5640d0060 2023-12-20T04:47:48.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc568a2c640 1 -- 172.21.15.132:0/190578437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5640cb170 con 0x7fc5640d0060 2023-12-20T04:47:48.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc552ffd640 1 -- 172.21.15.132:0/190578437 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc55c00c8f0 con 0x7fc5640d0060 2023-12-20T04:47:48.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.084+0000 7fc568a2c640 1 -- 172.21.15.132:0/190578437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5640cb730 con 0x7fc5640d0060 2023-12-20T04:47:48.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.085+0000 7fc568a2c640 1 -- 172.21.15.132:0/190578437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc56404e840 con 0x7fc5640d0060 2023-12-20T04:47:48.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.086+0000 7fc552ffd640 1 -- 172.21.15.132:0/190578437 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc55c00ca50 con 0x7fc5640d0060 2023-12-20T04:47:48.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.086+0000 7fc552ffd640 1 --2- 172.21.15.132:0/190578437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc54406a430 0x7fc54406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.086+0000 7fc561d9b640 1 --2- 172.21.15.132:0/190578437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc54406a430 0x7fc54406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.086+0000 7fc552ffd640 1 -- 172.21.15.132:0/190578437 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc55c0885e0 con 0x7fc5640d0060 2023-12-20T04:47:48.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.087+0000 7fc561d9b640 1 --2- 172.21.15.132:0/190578437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc54406a430 0x7fc54406c8f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc558036000 tx=0x7fc55803c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:48.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.091+0000 7fc552ffd640 1 -- 172.21.15.132:0/190578437 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc55c053b00 con 0x7fc5640d0060 2023-12-20T04:47:48.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.269+0000 7fc568a2c640 1 -- 172.21.15.132:0/190578437 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fc5640cdba0 con 0x7fc5640d0060 2023-12-20T04:47:48.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.270+0000 7fc552ffd640 1 -- 172.21.15.132:0/190578437 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v110) v1 ==== 80+0+0 (secure 0 0 0) 0x7fc55c057120 con 0x7fc5640d0060 2023-12-20T04:47:48.272 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:47:48.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.271+0000 7fc568a2c640 1 -- 172.21.15.132:0/190578437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc54406a430 msgr2=0x7fc54406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.271+0000 7fc568a2c640 1 --2- 172.21.15.132:0/190578437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc54406a430 0x7fc54406c8f0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc558036000 tx=0x7fc55803c040 comp rx=0 tx=0).stop 2023-12-20T04:47:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.271+0000 7fc568a2c640 1 -- 172.21.15.132:0/190578437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5640d0060 msgr2=0x7fc56414ac50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.271+0000 7fc568a2c640 1 --2- 172.21.15.132:0/190578437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5640d0060 0x7fc56414ac50 secure :-1 s=READY pgs=1094 cs=0 l=1 rev1=1 crypto rx=0x7fc55c00e730 tx=0x7fc55c00ebf0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.271+0000 7fc568a2c640 1 -- 172.21.15.132:0/190578437 shutdown_connections 2023-12-20T04:47:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.271+0000 7fc568a2c640 1 --2- 172.21.15.132:0/190578437 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc54406a430 0x7fc54406c8f0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.271+0000 7fc568a2c640 1 --2- 172.21.15.132:0/190578437 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc56415d2c0 0x7fc5640cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.271+0000 7fc568a2c640 1 --2- 172.21.15.132:0/190578437 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc5640d30a0 0x7fc56415eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.271+0000 7fc568a2c640 1 --2- 172.21.15.132:0/190578437 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc5640d0060 0x7fc56414ac50 unknown :-1 s=CLOSED pgs=1094 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.271+0000 7fc568a2c640 1 -- 172.21.15.132:0/190578437 >> 172.21.15.132:0/190578437 conn(0x7fc564072e40 msgr2=0x7fc5640b7fc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.272+0000 7fc568a2c640 1 -- 172.21.15.132:0/190578437 shutdown_connections 2023-12-20T04:47:48.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.272+0000 7fc568a2c640 1 -- 172.21.15.132:0/190578437 wait complete. 2023-12-20T04:47:48.284 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2023-12-20T04:47:48.284 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:48.284 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-20T04:47:48.312 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[107339]: fuse finished with error 0 and tester_r 0 2023-12-20T04:47:48.316 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:47:48.316 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:48.316 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-20T04:47:48.482 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:47:48.482 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:47:48.500 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:47:48.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.621+0000 7f6312720640 1 Processor -- start 2023-12-20T04:47:48.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.621+0000 7f6312720640 1 -- start start 2023-12-20T04:47:48.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.621+0000 7f6312720640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f630c15d100 0x7f630c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.621+0000 7f6312720640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f630c0d0370 0x7f630c0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.621+0000 7f6312720640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f630c0b2f90 con 0x7f630c161850 2023-12-20T04:47:48.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.621+0000 7f6312720640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630c1613c0 con 0x7f630c15d100 2023-12-20T04:47:48.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.621+0000 7f6312720640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f630c0d1b00 con 0x7f630c0d0370 2023-12-20T04:47:48.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.622+0000 7f630bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f630c15d100 0x7f630c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.622+0000 7f6310cbd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f630c161850 0x7f630c06c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56390/0 (socket says 172.21.15.132:56390) 2023-12-20T04:47:48.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.622+0000 7f6310cbd640 1 -- 172.21.15.132:0/3395058125 learned_addr learned my addr 172.21.15.132:0/3395058125 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:48.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.622+0000 7f630b7fe640 1 --2- 172.21.15.132:0/3395058125 >> v2:172.21.15.187:3300/0 conn(0x7f630c0d0370 0x7f630c0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.622+0000 7f630bfff640 1 -- 172.21.15.132:0/3395058125 >> v2:172.21.15.187:3300/0 conn(0x7f630c0d0370 msgr2=0x7f630c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:48.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.622+0000 7f630bfff640 1 --2- 172.21.15.132:0/3395058125 >> v2:172.21.15.187:3300/0 conn(0x7f630c0d0370 0x7f630c0cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.622+0000 7f630bfff640 1 -- 172.21.15.132:0/3395058125 >> v1:172.21.15.132:6789/0 conn(0x7f630c161850 legacy=0x7f630c06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:48.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.622+0000 7f630affd640 1 -- 172.21.15.132:0/3395058125 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3396519852 0 0) 0x7f6304001490 con 0x7f630c161850 2023-12-20T04:47:48.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.622+0000 7f630bfff640 1 -- 172.21.15.132:0/3395058125 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f630c0d0810 con 0x7f630c15d100 2023-12-20T04:47:48.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.622+0000 7f630b7fe640 1 --2- 172.21.15.132:0/3395058125 >> v2:172.21.15.187:3300/0 conn(0x7f630c0d0370 0x7f630c0cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:48.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.623+0000 7f630bfff640 1 --2- 172.21.15.132:0/3395058125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c15d100 0x7f630c0b2a50 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f630c06d6c0 tx=0x7f62fc02b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=19c5720e7c70bfc7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:48.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.623+0000 7f630affd640 1 -- 172.21.15.132:0/3395058125 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc02e070 con 0x7f630c15d100 2023-12-20T04:47:48.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.623+0000 7f630affd640 1 -- 172.21.15.132:0/3395058125 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62fc0315a0 con 0x7f630c15d100 2023-12-20T04:47:48.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.623+0000 7f630affd640 1 -- 172.21.15.132:0/3395058125 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62fc031930 con 0x7f630c15d100 2023-12-20T04:47:48.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.623+0000 7f6312720640 1 -- 172.21.15.132:0/3395058125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c15d100 msgr2=0x7f630c0b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:48.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.623+0000 7f6312720640 1 --2- 172.21.15.132:0/3395058125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c15d100 0x7f630c0b2a50 secure :-1 s=READY pgs=1096 cs=0 l=1 rev1=1 crypto rx=0x7f630c06d6c0 tx=0x7f62fc02b840 comp rx=0 tx=0).stop 2023-12-20T04:47:48.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.623+0000 7f6312720640 1 -- 172.21.15.132:0/3395058125 shutdown_connections 2023-12-20T04:47:48.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.623+0000 7f6312720640 1 --2- 172.21.15.132:0/3395058125 >> v2:172.21.15.187:3300/0 conn(0x7f630c0d0370 0x7f630c0cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.623+0000 7f6312720640 1 --2- 172.21.15.132:0/3395058125 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c15d100 0x7f630c0b2a50 unknown :-1 s=CLOSED pgs=1096 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.623+0000 7f6312720640 1 -- 172.21.15.132:0/3395058125 >> 172.21.15.132:0/3395058125 conn(0x7f630c06d7c0 msgr2=0x7f630c06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:48.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.623+0000 7f6312720640 1 -- 172.21.15.132:0/3395058125 shutdown_connections 2023-12-20T04:47:48.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.623+0000 7f6312720640 1 -- 172.21.15.132:0/3395058125 wait complete. 2023-12-20T04:47:48.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.624+0000 7f6312720640 1 Processor -- start 2023-12-20T04:47:48.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.625+0000 7f6312720640 1 -- start start 2023-12-20T04:47:48.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.625+0000 7f6312720640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f630c0d0370 0x7f630c159eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.625+0000 7f6312720640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f630c15d100 0x7f630c0af140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.625+0000 7f6312720640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c161850 0x7f630c0acd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.625+0000 7f6312720640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c15a3f0 con 0x7f630c161850 2023-12-20T04:47:48.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.625+0000 7f6312720640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f630c0ca860 con 0x7f630c15d100 2023-12-20T04:47:48.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.625+0000 7f6312720640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630c1f2840 con 0x7f630c0d0370 2023-12-20T04:47:48.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.625+0000 7f6310cbd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c161850 0x7f630c0acd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.626+0000 7f6310cbd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c161850 0x7f630c0acd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43628/0 (socket says 172.21.15.132:43628) 2023-12-20T04:47:48.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.626+0000 7f6310cbd640 1 -- 172.21.15.132:0/166237920 learned_addr learned my addr 172.21.15.132:0/166237920 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:48.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.626+0000 7f630b7fe640 1 --2- 172.21.15.132:0/166237920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f630c15d100 0x7f630c0af140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.626+0000 7f630bfff640 1 --2- 172.21.15.132:0/166237920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f630c0d0370 0x7f630c159eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.626+0000 7f6310cbd640 1 -- 172.21.15.132:0/166237920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f630c0d0370 msgr2=0x7f630c159eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:48.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.626+0000 7f6310cbd640 1 --2- 172.21.15.132:0/166237920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f630c0d0370 0x7f630c159eb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.626+0000 7f6310cbd640 1 -- 172.21.15.132:0/166237920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f630c15d100 msgr2=0x7f630c0af140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:48.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.626+0000 7f6310cbd640 1 --2- 172.21.15.132:0/166237920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f630c15d100 0x7f630c0af140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.626+0000 7f6310cbd640 1 -- 172.21.15.132:0/166237920 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62fc009400 con 0x7f630c161850 2023-12-20T04:47:48.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.626+0000 7f6310cbd640 1 --2- 172.21.15.132:0/166237920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c161850 0x7f630c0acd10 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f630400c7d0 tx=0x7f630400cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:48.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.626+0000 7f6308ff9640 1 -- 172.21.15.132:0/166237920 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630400a640 con 0x7f630c161850 2023-12-20T04:47:48.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.626+0000 7f6308ff9640 1 -- 172.21.15.132:0/166237920 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f630400a7c0 con 0x7f630c161850 2023-12-20T04:47:48.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.626+0000 7f6312720640 1 -- 172.21.15.132:0/166237920 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f630c0c9ce0 con 0x7f630c161850 2023-12-20T04:47:48.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.626+0000 7f6308ff9640 1 -- 172.21.15.132:0/166237920 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f630400abb0 con 0x7f630c161850 2023-12-20T04:47:48.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.626+0000 7f6312720640 1 -- 172.21.15.132:0/166237920 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f630c0ca2a0 con 0x7f630c161850 2023-12-20T04:47:48.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.627+0000 7f6312720640 1 -- 172.21.15.132:0/166237920 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630c04e840 con 0x7f630c161850 2023-12-20T04:47:48.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.628+0000 7f6308ff9640 1 -- 172.21.15.132:0/166237920 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f630400ad10 con 0x7f630c161850 2023-12-20T04:47:48.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.628+0000 7f6308ff9640 1 --2- 172.21.15.132:0/166237920 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62f806a430 0x7f62f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.628+0000 7f630bfff640 1 --2- 172.21.15.132:0/166237920 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62f806a430 0x7f62f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.628+0000 7f6308ff9640 1 -- 172.21.15.132:0/166237920 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6304087cf0 con 0x7f630c161850 2023-12-20T04:47:48.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.629+0000 7f630bfff640 1 --2- 172.21.15.132:0/166237920 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62f806a430 0x7f62f806c8f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f62fc036000 tx=0x7f62fc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:48.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.632+0000 7f6308ff9640 1 -- 172.21.15.132:0/166237920 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f630408c070 con 0x7f630c161850 2023-12-20T04:47:48.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.797+0000 7f6312720640 1 -- 172.21.15.132:0/166237920 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f630c0b2f90 con 0x7f630c161850 2023-12-20T04:47:48.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.799+0000 7f6308ff9640 1 -- 172.21.15.132:0/166237920 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16244 (secure 0 0 0) 0x7f630c0b2f90 con 0x7f630c161850 2023-12-20T04:47:48.801 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:48.801 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":110,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:47:40.970633+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:47:10.649946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-20T04:47:11.271933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1c","mappings":[{"from":6,"to":3}]},{"pgid":"13.23","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:47:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.801+0000 7f6312720640 1 -- 172.21.15.132:0/166237920 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62f806a430 msgr2=0x7f62f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.801+0000 7f6312720640 1 --2- 172.21.15.132:0/166237920 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62f806a430 0x7f62f806c8f0 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7f62fc036000 tx=0x7f62fc008030 comp rx=0 tx=0).stop 2023-12-20T04:47:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.801+0000 7f6312720640 1 -- 172.21.15.132:0/166237920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c161850 msgr2=0x7f630c0acd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.801+0000 7f6312720640 1 --2- 172.21.15.132:0/166237920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c161850 0x7f630c0acd10 secure :-1 s=READY pgs=1097 cs=0 l=1 rev1=1 crypto rx=0x7f630400c7d0 tx=0x7f630400cc90 comp rx=0 tx=0).stop 2023-12-20T04:47:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.801+0000 7f6312720640 1 -- 172.21.15.132:0/166237920 shutdown_connections 2023-12-20T04:47:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.801+0000 7f6312720640 1 --2- 172.21.15.132:0/166237920 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62f806a430 0x7f62f806c8f0 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.801+0000 7f6312720640 1 --2- 172.21.15.132:0/166237920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f630c161850 0x7f630c0acd10 unknown :-1 s=CLOSED pgs=1097 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.801+0000 7f6312720640 1 --2- 172.21.15.132:0/166237920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f630c15d100 0x7f630c0af140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.801+0000 7f6312720640 1 --2- 172.21.15.132:0/166237920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f630c0d0370 0x7f630c159eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.801+0000 7f6312720640 1 -- 172.21.15.132:0/166237920 >> 172.21.15.132:0/166237920 conn(0x7f630c06d7c0 msgr2=0x7f630c06c570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.801+0000 7f6312720640 1 -- 172.21.15.132:0/166237920 shutdown_connections 2023-12-20T04:47:48.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.801+0000 7f6312720640 1 -- 172.21.15.132:0/166237920 wait complete. 2023-12-20T04:47:48.814 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:47:10.649946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:47:11.271933+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:47:48.815 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:47:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.915+0000 7ff062973640 1 Processor -- start 2023-12-20T04:47:48.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.915+0000 7ff062973640 1 -- start start 2023-12-20T04:47:48.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.915+0000 7ff062973640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff05c0d18b0 0x7ff05c165ed0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.915+0000 7ff062973640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c0d0130 con 0x7ff05c15aee0 2023-12-20T04:47:48.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.915+0000 7ff062973640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff05c15f370 con 0x7ff05c0cb2b0 2023-12-20T04:47:48.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.915+0000 7ff062973640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c15f650 con 0x7ff05c0d18b0 2023-12-20T04:47:48.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff05c15aee0 0x7ff05c15eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56396/0 (socket says 172.21.15.132:56396) 2023-12-20T04:47:48.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05bfff640 1 -- 172.21.15.132:0/102385080 learned_addr learned my addr 172.21.15.132:0/102385080 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:48.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05affd640 1 -- 172.21.15.132:0/102385080 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2692281239 0 0) 0x7ff05c0d0130 con 0x7ff05c15aee0 2023-12-20T04:47:48.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff060f10640 1 --2- 172.21.15.132:0/102385080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff05c0d18b0 0x7ff05c165ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05affd640 1 -- 172.21.15.132:0/102385080 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff044003520 con 0x7ff05c15aee0 2023-12-20T04:47:48.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05affd640 1 -- 172.21.15.132:0/102385080 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2426665167 0 0) 0x7ff044003520 con 0x7ff05c15aee0 2023-12-20T04:47:48.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05affd640 1 -- 172.21.15.132:0/102385080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff05c0d18b0 msgr2=0x7ff05c165ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:48.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05affd640 1 --2- 172.21.15.132:0/102385080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff05c0d18b0 0x7ff05c165ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05affd640 1 -- 172.21.15.132:0/102385080 >> v1:172.21.15.187:6789/0 conn(0x7ff05c0cb2b0 legacy=0x7ff05c0cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:48.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05affd640 1 -- 172.21.15.132:0/102385080 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c15f930 con 0x7ff05c15aee0 2023-12-20T04:47:48.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05affd640 1 -- 172.21.15.132:0/102385080 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7ff04c001670 con 0x7ff05c15aee0 2023-12-20T04:47:48.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05affd640 1 -- 172.21.15.132:0/102385080 >> v1:172.21.15.132:6789/0 conn(0x7ff05c15aee0 legacy=0x7ff05c15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:48.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05affd640 1 --2- 172.21.15.132:0/102385080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0440039a0 0x7ff044003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05affd640 1 --2- 172.21.15.132:0/102385080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff05c0d18b0 0x7ff0440047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05affd640 1 --2- 172.21.15.132:0/102385080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff044004d00 0x7ff044005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05affd640 1 -- 172.21.15.132:0/102385080 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c15f650 con 0x7ff0440039a0 2023-12-20T04:47:48.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05affd640 1 -- 172.21.15.132:0/102385080 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff04400bb10 con 0x7ff044004d00 2023-12-20T04:47:48.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05affd640 1 -- 172.21.15.132:0/102385080 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff04400bca0 con 0x7ff05c0d18b0 2023-12-20T04:47:48.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05bfff640 1 --2- 172.21.15.132:0/102385080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0440039a0 0x7ff044003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff05b7fe640 1 --2- 172.21.15.132:0/102385080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff05c0d18b0 0x7ff0440047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.916+0000 7ff060f10640 1 --2- 172.21.15.132:0/102385080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff044004d00 0x7ff044005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.917+0000 7ff05bfff640 1 -- 172.21.15.132:0/102385080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff05c0d18b0 msgr2=0x7ff0440047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:48.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.917+0000 7ff05bfff640 1 --2- 172.21.15.132:0/102385080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff05c0d18b0 0x7ff0440047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.917+0000 7ff05bfff640 1 -- 172.21.15.132:0/102385080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff044004d00 msgr2=0x7ff044005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:48.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.917+0000 7ff05bfff640 1 --2- 172.21.15.132:0/102385080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff044004d00 0x7ff044005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.917+0000 7ff05bfff640 1 -- 172.21.15.132:0/102385080 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff044003520 con 0x7ff0440039a0 2023-12-20T04:47:48.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.917+0000 7ff05b7fe640 1 --2- 172.21.15.132:0/102385080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff05c0d18b0 0x7ff0440047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:48.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.917+0000 7ff060f10640 1 --2- 172.21.15.132:0/102385080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff044004d00 0x7ff044005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:48.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.917+0000 7ff05bfff640 1 --2- 172.21.15.132:0/102385080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0440039a0 0x7ff044003dc0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00c270 tx=0x7ff0440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b32daf64abf7e588 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:48.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.917+0000 7ff05affd640 1 -- 172.21.15.132:0/102385080 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c005ad0 con 0x7ff0440039a0 2023-12-20T04:47:48.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.917+0000 7ff05affd640 1 -- 172.21.15.132:0/102385080 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff04c005c30 con 0x7ff0440039a0 2023-12-20T04:47:48.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.917+0000 7ff05affd640 1 -- 172.21.15.132:0/102385080 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff04c02c8a0 con 0x7ff0440039a0 2023-12-20T04:47:48.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.918+0000 7ff062973640 1 -- 172.21.15.132:0/102385080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0440039a0 msgr2=0x7ff044003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:48.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.918+0000 7ff062973640 1 --2- 172.21.15.132:0/102385080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0440039a0 0x7ff044003dc0 secure :-1 s=READY pgs=1099 cs=0 l=1 rev1=1 crypto rx=0x7ff04c00c270 tx=0x7ff0440057f0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.918+0000 7ff060f10640 1 -- 172.21.15.132:0/102385080 reap_dead start 2023-12-20T04:47:48.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.918+0000 7ff062973640 1 -- 172.21.15.132:0/102385080 shutdown_connections 2023-12-20T04:47:48.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.918+0000 7ff062973640 1 -- 172.21.15.132:0/102385080 >> 172.21.15.132:0/102385080 conn(0x7ff05c072c60 msgr2=0x7ff05c073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:48.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.918+0000 7ff062973640 1 -- 172.21.15.132:0/102385080 shutdown_connections 2023-12-20T04:47:48.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.918+0000 7ff062973640 1 -- 172.21.15.132:0/102385080 wait complete. 2023-12-20T04:47:48.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.919+0000 7ff062973640 1 Processor -- start 2023-12-20T04:47:48.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.919+0000 7ff062973640 1 -- start start 2023-12-20T04:47:48.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.920+0000 7ff062973640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0440039a0 0x7ff05c15c610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.920+0000 7ff062973640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff05c15cb50 0x7ff05c0c8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.920+0000 7ff062973640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff05c14f070 0x7ff05c0c8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.920+0000 7ff062973640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c15d060 con 0x7ff05c15cb50 2023-12-20T04:47:48.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.920+0000 7ff062973640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c15d340 con 0x7ff05c14f070 2023-12-20T04:47:48.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.920+0000 7ff062973640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff05c15d620 con 0x7ff0440039a0 2023-12-20T04:47:48.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.920+0000 7ff05b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff05c15cb50 0x7ff05c0c8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.920+0000 7ff05b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff05c15cb50 0x7ff05c0c8500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43640/0 (socket says 172.21.15.132:43640) 2023-12-20T04:47:48.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.920+0000 7ff05b7fe640 1 -- 172.21.15.132:0/1825690982 learned_addr learned my addr 172.21.15.132:0/1825690982 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:48.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.920+0000 7ff05bfff640 1 --2- 172.21.15.132:0/1825690982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0440039a0 0x7ff05c15c610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.920+0000 7ff060f10640 1 --2- 172.21.15.132:0/1825690982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff05c14f070 0x7ff05c0c8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.920+0000 7ff05b7fe640 1 -- 172.21.15.132:0/1825690982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0440039a0 msgr2=0x7ff05c15c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:48.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.920+0000 7ff05b7fe640 1 --2- 172.21.15.132:0/1825690982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0440039a0 0x7ff05c15c610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.921+0000 7ff05b7fe640 1 -- 172.21.15.132:0/1825690982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff05c14f070 msgr2=0x7ff05c0c8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:48.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.921+0000 7ff05b7fe640 1 --2- 172.21.15.132:0/1825690982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff05c14f070 0x7ff05c0c8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:48.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.921+0000 7ff05b7fe640 1 -- 172.21.15.132:0/1825690982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff05c15d900 con 0x7ff05c15cb50 2023-12-20T04:47:48.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.921+0000 7ff060f10640 1 --2- 172.21.15.132:0/1825690982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff05c14f070 0x7ff05c0c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:48.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.921+0000 7ff05b7fe640 1 --2- 172.21.15.132:0/1825690982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff05c15cb50 0x7ff05c0c8500 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7ff05000e600 tx=0x7ff05000eac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:48.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.921+0000 7ff058ff9640 1 -- 172.21.15.132:0/1825690982 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0500052e0 con 0x7ff05c15cb50 2023-12-20T04:47:48.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.921+0000 7ff058ff9640 1 -- 172.21.15.132:0/1825690982 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff050005440 con 0x7ff05c15cb50 2023-12-20T04:47:48.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.921+0000 7ff058ff9640 1 -- 172.21.15.132:0/1825690982 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0500037f0 con 0x7ff05c15cb50 2023-12-20T04:47:48.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.921+0000 7ff062973640 1 -- 172.21.15.132:0/1825690982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff05c15dbe0 con 0x7ff05c15cb50 2023-12-20T04:47:48.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.921+0000 7ff062973640 1 -- 172.21.15.132:0/1825690982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff05c1f6610 con 0x7ff05c15cb50 2023-12-20T04:47:48.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.922+0000 7ff062973640 1 -- 172.21.15.132:0/1825690982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff05c0cb020 con 0x7ff05c15cb50 2023-12-20T04:47:48.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.922+0000 7ff058ff9640 1 -- 172.21.15.132:0/1825690982 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff050003950 con 0x7ff05c15cb50 2023-12-20T04:47:48.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.922+0000 7ff058ff9640 1 --2- 172.21.15.132:0/1825690982 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff04806a430 0x7ff04806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:48.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.923+0000 7ff058ff9640 1 -- 172.21.15.132:0/1825690982 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff0500887c0 con 0x7ff05c15cb50 2023-12-20T04:47:48.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.923+0000 7ff05bfff640 1 --2- 172.21.15.132:0/1825690982 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff04806a430 0x7ff04806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:48.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.923+0000 7ff05bfff640 1 --2- 172.21.15.132:0/1825690982 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff04806a430 0x7ff04806c8f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff04c034000 tx=0x7ff04c009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:48.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:48.927+0000 7ff058ff9640 1 -- 172.21.15.132:0/1825690982 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff050053d70 con 0x7ff05c15cb50 2023-12-20T04:47:49.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.093+0000 7ff062973640 1 -- 172.21.15.132:0/1825690982 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff05c04e840 con 0x7ff05c15cb50 2023-12-20T04:47:49.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.094+0000 7ff058ff9640 1 -- 172.21.15.132:0/1825690982 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff050057390 con 0x7ff05c15cb50 2023-12-20T04:47:49.096 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:47:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.096+0000 7ff062973640 1 -- 172.21.15.132:0/1825690982 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff04806a430 msgr2=0x7ff04806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.096+0000 7ff062973640 1 --2- 172.21.15.132:0/1825690982 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff04806a430 0x7ff04806c8f0 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7ff04c034000 tx=0x7ff04c009030 comp rx=0 tx=0).stop 2023-12-20T04:47:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.096+0000 7ff062973640 1 -- 172.21.15.132:0/1825690982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff05c15cb50 msgr2=0x7ff05c0c8500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.096+0000 7ff062973640 1 --2- 172.21.15.132:0/1825690982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff05c15cb50 0x7ff05c0c8500 secure :-1 s=READY pgs=1100 cs=0 l=1 rev1=1 crypto rx=0x7ff05000e600 tx=0x7ff05000eac0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.096+0000 7ff062973640 1 -- 172.21.15.132:0/1825690982 shutdown_connections 2023-12-20T04:47:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.096+0000 7ff062973640 1 --2- 172.21.15.132:0/1825690982 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff04806a430 0x7ff04806c8f0 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.096+0000 7ff062973640 1 --2- 172.21.15.132:0/1825690982 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff05c14f070 0x7ff05c0c8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.096+0000 7ff062973640 1 --2- 172.21.15.132:0/1825690982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff05c15cb50 0x7ff05c0c8500 unknown :-1 s=CLOSED pgs=1100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.096+0000 7ff062973640 1 --2- 172.21.15.132:0/1825690982 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0440039a0 0x7ff05c15c610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.096+0000 7ff062973640 1 -- 172.21.15.132:0/1825690982 >> 172.21.15.132:0/1825690982 conn(0x7ff05c072c60 msgr2=0x7ff05c0c4840 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:49.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.096+0000 7ff062973640 1 -- 172.21.15.132:0/1825690982 shutdown_connections 2023-12-20T04:47:49.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.096+0000 7ff062973640 1 -- 172.21.15.132:0/1825690982 wait complete. 2023-12-20T04:47:49.109 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:47:49.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.210+0000 7f1443212640 1 Processor -- start 2023-12-20T04:47:49.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.210+0000 7f1443212640 1 -- start start 2023-12-20T04:47:49.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.211+0000 7f1443212640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f143c0caee0 0x7f143c0c5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.211+0000 7f1443212640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f143c06f450 0x7f143c0cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.211+0000 7f1443212640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f143c06b960 con 0x7f143c06f8d0 2023-12-20T04:47:49.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.211+0000 7f1443212640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f143c0c4c30 con 0x7f143c0caee0 2023-12-20T04:47:49.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.211+0000 7f1443212640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143c0c4390 con 0x7f143c06f450 2023-12-20T04:47:49.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.211+0000 7f1440fae640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f143c0caee0 0x7f143c0c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.211+0000 7f14417af640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f143c06f8d0 0x7f143c06bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56402/0 (socket says 172.21.15.132:56402) 2023-12-20T04:47:49.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.211+0000 7f14417af640 1 -- 172.21.15.132:0/4110432962 learned_addr learned my addr 172.21.15.132:0/4110432962 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:49.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.212+0000 7f1440fae640 1 -- 172.21.15.132:0/4110432962 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f143c06f450 msgr2=0x7f143c0cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:49.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.212+0000 7f143bfff640 1 --2- 172.21.15.132:0/4110432962 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f143c06f450 0x7f143c0cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.212+0000 7f1440fae640 1 --2- 172.21.15.132:0/4110432962 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f143c06f450 0x7f143c0cb2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.212+0000 7f1440fae640 1 -- 172.21.15.132:0/4110432962 >> v1:172.21.15.132:6789/0 conn(0x7f143c06f8d0 legacy=0x7f143c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.212+0000 7f1440fae640 1 -- 172.21.15.132:0/4110432962 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f143c0c4670 con 0x7f143c0caee0 2023-12-20T04:47:49.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.212+0000 7f1440fae640 1 --2- 172.21.15.132:0/4110432962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f143c0caee0 0x7f143c0c5330 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f142c0097a0 tx=0x7f142c02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f0f4068c85fc175 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:49.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.212+0000 7f143b7fe640 1 -- 172.21.15.132:0/4110432962 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c030710 con 0x7f143c0caee0 2023-12-20T04:47:49.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.212+0000 7f143b7fe640 1 -- 172.21.15.132:0/4110432962 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c02e050 con 0x7f143c0caee0 2023-12-20T04:47:49.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.213+0000 7f143b7fe640 1 -- 172.21.15.132:0/4110432962 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c030a90 con 0x7f143c0caee0 2023-12-20T04:47:49.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.213+0000 7f1443212640 1 -- 172.21.15.132:0/4110432962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f143c0caee0 msgr2=0x7f143c0c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.213+0000 7f1443212640 1 --2- 172.21.15.132:0/4110432962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f143c0caee0 0x7f143c0c5330 secure :-1 s=READY pgs=1102 cs=0 l=1 rev1=1 crypto rx=0x7f142c0097a0 tx=0x7f142c02b710 comp rx=0 tx=0).stop 2023-12-20T04:47:49.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.213+0000 7f1443212640 1 -- 172.21.15.132:0/4110432962 shutdown_connections 2023-12-20T04:47:49.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.213+0000 7f1443212640 1 --2- 172.21.15.132:0/4110432962 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f143c06f450 0x7f143c0cb2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.213+0000 7f1443212640 1 --2- 172.21.15.132:0/4110432962 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f143c0caee0 0x7f143c0c5330 unknown :-1 s=CLOSED pgs=1102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.213+0000 7f1443212640 1 -- 172.21.15.132:0/4110432962 >> 172.21.15.132:0/4110432962 conn(0x7f143c06a260 msgr2=0x7f143c0b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:49.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.213+0000 7f1443212640 1 -- 172.21.15.132:0/4110432962 shutdown_connections 2023-12-20T04:47:49.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.213+0000 7f1443212640 1 -- 172.21.15.132:0/4110432962 wait complete. 2023-12-20T04:47:49.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.214+0000 7f1443212640 1 Processor -- start 2023-12-20T04:47:49.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.214+0000 7f1443212640 1 -- start start 2023-12-20T04:47:49.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.215+0000 7f1443212640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f143c06f450 0x7f143c143a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.215+0000 7f1443212640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f143c06f8d0 0x7f143c130ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.215+0000 7f1443212640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f143c0caee0 0x7f143c131420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.215+0000 7f1443212640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c12eea0 con 0x7f143c06f450 2023-12-20T04:47:49.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.215+0000 7f1443212640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f143c12f460 con 0x7f143c06f8d0 2023-12-20T04:47:49.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.215+0000 7f1443212640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f143c15dbd0 con 0x7f143c0caee0 2023-12-20T04:47:49.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.215+0000 7f1440fae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f143c06f450 0x7f143c143a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.215+0000 7f1440fae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f143c06f450 0x7f143c143a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43656/0 (socket says 172.21.15.132:43656) 2023-12-20T04:47:49.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.215+0000 7f1440fae640 1 -- 172.21.15.132:0/2842962378 learned_addr learned my addr 172.21.15.132:0/2842962378 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:49.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.215+0000 7f1440fae640 1 -- 172.21.15.132:0/2842962378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f143c0caee0 msgr2=0x7f143c131420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.215+0000 7f1440fae640 1 --2- 172.21.15.132:0/2842962378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f143c0caee0 0x7f143c131420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.215+0000 7f143bfff640 1 --2- 172.21.15.132:0/2842962378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f143c06f8d0 0x7f143c130ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.215+0000 7f1440fae640 1 -- 172.21.15.132:0/2842962378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f143c06f8d0 msgr2=0x7f143c130ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.216+0000 7f1440fae640 1 --2- 172.21.15.132:0/2842962378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f143c06f8d0 0x7f143c130ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.216+0000 7f1440fae640 1 -- 172.21.15.132:0/2842962378 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f142c009400 con 0x7f143c06f450 2023-12-20T04:47:49.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.216+0000 7f143bfff640 1 --2- 172.21.15.132:0/2842962378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f143c06f8d0 0x7f143c130ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:49.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.216+0000 7f1440fae640 1 --2- 172.21.15.132:0/2842962378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f143c06f450 0x7f143c143a90 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f142c0098c0 tx=0x7f142c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:49.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.216+0000 7f14397fa640 1 -- 172.21.15.132:0/2842962378 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c032950 con 0x7f143c06f450 2023-12-20T04:47:49.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.216+0000 7f14397fa640 1 -- 172.21.15.132:0/2842962378 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f142c032ab0 con 0x7f143c06f450 2023-12-20T04:47:49.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.216+0000 7f1443212640 1 -- 172.21.15.132:0/2842962378 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f143c15deb0 con 0x7f143c06f450 2023-12-20T04:47:49.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.216+0000 7f14397fa640 1 -- 172.21.15.132:0/2842962378 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f142c032e60 con 0x7f143c06f450 2023-12-20T04:47:49.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.216+0000 7f1443212640 1 -- 172.21.15.132:0/2842962378 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f143c15cea0 con 0x7f143c06f450 2023-12-20T04:47:49.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.217+0000 7f1443212640 1 -- 172.21.15.132:0/2842962378 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f143c04e840 con 0x7f143c06f450 2023-12-20T04:47:49.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.217+0000 7f14397fa640 1 -- 172.21.15.132:0/2842962378 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f142c039040 con 0x7f143c06f450 2023-12-20T04:47:49.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.218+0000 7f14397fa640 1 --2- 172.21.15.132:0/2842962378 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f142806a460 0x7f142806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.218+0000 7f14397fa640 1 -- 172.21.15.132:0/2842962378 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f142c0aa1f0 con 0x7f143c06f450 2023-12-20T04:47:49.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.218+0000 7f143bfff640 1 --2- 172.21.15.132:0/2842962378 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f142806a460 0x7f142806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.218+0000 7f143bfff640 1 --2- 172.21.15.132:0/2842962378 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f142806a460 0x7f142806c920 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f143c1f4990 tx=0x7f1430008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:49.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.222+0000 7f14397fa640 1 -- 172.21.15.132:0/2842962378 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f142c075950 con 0x7f143c06f450 2023-12-20T04:47:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.387+0000 7f1443212640 1 -- 172.21.15.132:0/2842962378 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f143c140fd0 con 0x7f143c06f450 2023-12-20T04:47:49.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.387+0000 7f14397fa640 1 -- 172.21.15.132:0/2842962378 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7f142c078f70 con 0x7f143c06f450 2023-12-20T04:47:49.389 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:47:49.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.389+0000 7f1443212640 1 -- 172.21.15.132:0/2842962378 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f142806a460 msgr2=0x7f142806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.389+0000 7f1443212640 1 --2- 172.21.15.132:0/2842962378 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f142806a460 0x7f142806c920 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7f143c1f4990 tx=0x7f1430008040 comp rx=0 tx=0).stop 2023-12-20T04:47:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.389+0000 7f1443212640 1 -- 172.21.15.132:0/2842962378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f143c06f450 msgr2=0x7f143c143a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.389+0000 7f1443212640 1 --2- 172.21.15.132:0/2842962378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f143c06f450 0x7f143c143a90 secure :-1 s=READY pgs=1103 cs=0 l=1 rev1=1 crypto rx=0x7f142c0098c0 tx=0x7f142c0046c0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.389+0000 7f1443212640 1 -- 172.21.15.132:0/2842962378 shutdown_connections 2023-12-20T04:47:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.389+0000 7f1443212640 1 --2- 172.21.15.132:0/2842962378 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f142806a460 0x7f142806c920 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.389+0000 7f1443212640 1 --2- 172.21.15.132:0/2842962378 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f143c0caee0 0x7f143c131420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.389+0000 7f1443212640 1 --2- 172.21.15.132:0/2842962378 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f143c06f8d0 0x7f143c130ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.389+0000 7f1443212640 1 --2- 172.21.15.132:0/2842962378 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f143c06f450 0x7f143c143a90 unknown :-1 s=CLOSED pgs=1103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.389+0000 7f1443212640 1 -- 172.21.15.132:0/2842962378 >> 172.21.15.132:0/2842962378 conn(0x7f143c06a260 msgr2=0x7f143c06fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.389+0000 7f1443212640 1 -- 172.21.15.132:0/2842962378 shutdown_connections 2023-12-20T04:47:49.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.389+0000 7f1443212640 1 -- 172.21.15.132:0/2842962378 wait complete. 2023-12-20T04:47:49.403 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:47:49.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.502+0000 7f31e4870640 1 Processor -- start 2023-12-20T04:47:49.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.503+0000 7f31e4870640 1 -- start start 2023-12-20T04:47:49.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.503+0000 7f31e4870640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31e0143610 0x7f31e00caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.503+0000 7f31e4870640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f31e00c41f0 0x7f31e00cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.503+0000 7f31e4870640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f31e00cd780 0x7f31e015d890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.503+0000 7f31e4870640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e00cdc30 con 0x7f31e00cd780 2023-12-20T04:47:49.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.503+0000 7f31e4870640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31e01439f0 con 0x7f31e00c41f0 2023-12-20T04:47:49.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.503+0000 7f31e4870640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00c46f0 con 0x7f31e0143610 2023-12-20T04:47:49.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.503+0000 7f31ded9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f31e00cd780 0x7f31e015d890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.503+0000 7f31ded9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f31e00cd780 0x7f31e015d890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43672/0 (socket says 172.21.15.132:43672) 2023-12-20T04:47:49.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.503+0000 7f31ded9d640 1 -- 172.21.15.132:0/3701062678 learned_addr learned my addr 172.21.15.132:0/3701062678 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:49.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.504+0000 7f31de59c640 1 --2- 172.21.15.132:0/3701062678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31e0143610 0x7f31e00caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.504+0000 7f31d7fff640 1 --2- 172.21.15.132:0/3701062678 >> v2:172.21.15.187:3300/0 conn(0x7f31e00c41f0 0x7f31e00cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.504+0000 7f31ded9d640 1 -- 172.21.15.132:0/3701062678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31e0143610 msgr2=0x7f31e00caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:49.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.504+0000 7f31ded9d640 1 --2- 172.21.15.132:0/3701062678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31e0143610 0x7f31e00caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.504+0000 7f31ded9d640 1 -- 172.21.15.132:0/3701062678 >> v2:172.21.15.187:3300/0 conn(0x7f31e00c41f0 msgr2=0x7f31e00cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:49.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.504+0000 7f31ded9d640 1 --2- 172.21.15.132:0/3701062678 >> v2:172.21.15.187:3300/0 conn(0x7f31e00c41f0 0x7f31e00cd240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.504+0000 7f31ded9d640 1 -- 172.21.15.132:0/3701062678 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31e00c49d0 con 0x7f31e00cd780 2023-12-20T04:47:49.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.504+0000 7f31ded9d640 1 --2- 172.21.15.132:0/3701062678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e00cd780 0x7f31e015d890 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f31e006d6d0 tx=0x7f31d802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8c4dcff86015aa9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:49.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.505+0000 7f31ddd9b640 1 -- 172.21.15.132:0/3701062678 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d802ea80 con 0x7f31e00cd780 2023-12-20T04:47:49.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.505+0000 7f31ddd9b640 1 -- 172.21.15.132:0/3701062678 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d802ebe0 con 0x7f31e00cd780 2023-12-20T04:47:49.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.505+0000 7f31ddd9b640 1 -- 172.21.15.132:0/3701062678 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d8009600 con 0x7f31e00cd780 2023-12-20T04:47:49.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.505+0000 7f31e4870640 1 -- 172.21.15.132:0/3701062678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e00cd780 msgr2=0x7f31e015d890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.505+0000 7f31e4870640 1 --2- 172.21.15.132:0/3701062678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e00cd780 0x7f31e015d890 secure :-1 s=READY pgs=1104 cs=0 l=1 rev1=1 crypto rx=0x7f31e006d6d0 tx=0x7f31d802e0e0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.505+0000 7f31e4870640 1 -- 172.21.15.132:0/3701062678 shutdown_connections 2023-12-20T04:47:49.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.505+0000 7f31e4870640 1 --2- 172.21.15.132:0/3701062678 >> v2:172.21.15.187:3300/0 conn(0x7f31e00c41f0 0x7f31e00cd240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.505+0000 7f31e4870640 1 --2- 172.21.15.132:0/3701062678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e00cd780 0x7f31e015d890 unknown :-1 s=CLOSED pgs=1104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.505+0000 7f31e4870640 1 --2- 172.21.15.132:0/3701062678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31e0143610 0x7f31e00caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.505+0000 7f31e4870640 1 -- 172.21.15.132:0/3701062678 >> 172.21.15.132:0/3701062678 conn(0x7f31e006a260 msgr2=0x7f31e00b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:49.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.505+0000 7f31e4870640 1 -- 172.21.15.132:0/3701062678 shutdown_connections 2023-12-20T04:47:49.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.505+0000 7f31e4870640 1 -- 172.21.15.132:0/3701062678 wait complete. 2023-12-20T04:47:49.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.506+0000 7f31e4870640 1 Processor -- start 2023-12-20T04:47:49.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.507+0000 7f31e4870640 1 -- start start 2023-12-20T04:47:49.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.507+0000 7f31e4870640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31e00c41f0 0x7f31e0159070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.507+0000 7f31e4870640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31e00cd780 0x7f31e00cba30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.507+0000 7f31e4870640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e0143610 0x7f31e00cbf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.507+0000 7f31e4870640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e01595b0 con 0x7f31e0143610 2023-12-20T04:47:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.507+0000 7f31e4870640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00b18a0 con 0x7f31e00cd780 2023-12-20T04:47:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.507+0000 7f31e4870640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31e00b1b80 con 0x7f31e00c41f0 2023-12-20T04:47:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.507+0000 7f31ded9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e0143610 0x7f31e00cbf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.507+0000 7f31ded9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e0143610 0x7f31e00cbf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43682/0 (socket says 172.21.15.132:43682) 2023-12-20T04:47:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.507+0000 7f31ded9d640 1 -- 172.21.15.132:0/396248017 learned_addr learned my addr 172.21.15.132:0/396248017 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.507+0000 7f31de59c640 1 --2- 172.21.15.132:0/396248017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31e00c41f0 0x7f31e0159070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.508+0000 7f31d7fff640 1 --2- 172.21.15.132:0/396248017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31e00cd780 0x7f31e00cba30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.508+0000 7f31ded9d640 1 -- 172.21.15.132:0/396248017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31e00c41f0 msgr2=0x7f31e0159070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.508+0000 7f31ded9d640 1 --2- 172.21.15.132:0/396248017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31e00c41f0 0x7f31e0159070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.508+0000 7f31ded9d640 1 -- 172.21.15.132:0/396248017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31e00cd780 msgr2=0x7f31e00cba30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.508+0000 7f31ded9d640 1 --2- 172.21.15.132:0/396248017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31e00cd780 0x7f31e00cba30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.508+0000 7f31ded9d640 1 -- 172.21.15.132:0/396248017 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31d800bd40 con 0x7f31e0143610 2023-12-20T04:47:49.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.508+0000 7f31d7fff640 1 --2- 172.21.15.132:0/396248017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31e00cd780 0x7f31e00cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:49.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.508+0000 7f31ded9d640 1 --2- 172.21.15.132:0/396248017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e0143610 0x7f31e00cbf70 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f31d8038040 tx=0x7f31d8004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:49.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.508+0000 7f31d6ffd640 1 -- 172.21.15.132:0/396248017 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d802ea80 con 0x7f31e0143610 2023-12-20T04:47:49.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.508+0000 7f31d6ffd640 1 -- 172.21.15.132:0/396248017 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31d800b720 con 0x7f31e0143610 2023-12-20T04:47:49.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.508+0000 7f31d6ffd640 1 -- 172.21.15.132:0/396248017 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31d80408a0 con 0x7f31e0143610 2023-12-20T04:47:49.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.508+0000 7f31e4870640 1 -- 172.21.15.132:0/396248017 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31e00b1e60 con 0x7f31e0143610 2023-12-20T04:47:49.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.508+0000 7f31e4870640 1 -- 172.21.15.132:0/396248017 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31e00b2420 con 0x7f31e0143610 2023-12-20T04:47:49.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.509+0000 7f31e4870640 1 -- 172.21.15.132:0/396248017 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31e004e840 con 0x7f31e0143610 2023-12-20T04:47:49.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.509+0000 7f31d6ffd640 1 -- 172.21.15.132:0/396248017 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f31d802ed50 con 0x7f31e0143610 2023-12-20T04:47:49.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.510+0000 7f31d6ffd640 1 --2- 172.21.15.132:0/396248017 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31c006a430 0x7f31c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.510+0000 7f31d6ffd640 1 -- 172.21.15.132:0/396248017 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f31d80ad660 con 0x7f31e0143610 2023-12-20T04:47:49.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.510+0000 7f31de59c640 1 --2- 172.21.15.132:0/396248017 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31c006a430 0x7f31c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.510+0000 7f31de59c640 1 --2- 172.21.15.132:0/396248017 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31c006a430 0x7f31c006c8f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f31d0006fd0 tx=0x7f31d0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:49.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.514+0000 7f31d6ffd640 1 -- 172.21.15.132:0/396248017 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f31d8078c20 con 0x7f31e0143610 2023-12-20T04:47:49.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.679+0000 7f31e4870640 1 -- 172.21.15.132:0/396248017 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f31e00c3fd0 con 0x7f31e0143610 2023-12-20T04:47:49.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.679+0000 7f31d6ffd640 1 -- 172.21.15.132:0/396248017 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7f31d807c240 con 0x7f31e0143610 2023-12-20T04:47:49.681 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:47:49.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.681+0000 7f31e4870640 1 -- 172.21.15.132:0/396248017 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31c006a430 msgr2=0x7f31c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.681+0000 7f31e4870640 1 --2- 172.21.15.132:0/396248017 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31c006a430 0x7f31c006c8f0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 crypto rx=0x7f31d0006fd0 tx=0x7f31d0008040 comp rx=0 tx=0).stop 2023-12-20T04:47:49.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.681+0000 7f31e4870640 1 -- 172.21.15.132:0/396248017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e0143610 msgr2=0x7f31e00cbf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.681+0000 7f31e4870640 1 --2- 172.21.15.132:0/396248017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e0143610 0x7f31e00cbf70 secure :-1 s=READY pgs=1105 cs=0 l=1 rev1=1 crypto rx=0x7f31d8038040 tx=0x7f31d8004a40 comp rx=0 tx=0).stop 2023-12-20T04:47:49.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.681+0000 7f31e4870640 1 -- 172.21.15.132:0/396248017 shutdown_connections 2023-12-20T04:47:49.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.681+0000 7f31e4870640 1 --2- 172.21.15.132:0/396248017 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f31c006a430 0x7f31c006c8f0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.681+0000 7f31e4870640 1 --2- 172.21.15.132:0/396248017 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f31e0143610 0x7f31e00cbf70 unknown :-1 s=CLOSED pgs=1105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.681+0000 7f31e4870640 1 --2- 172.21.15.132:0/396248017 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f31e00cd780 0x7f31e00cba30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.681+0000 7f31e4870640 1 --2- 172.21.15.132:0/396248017 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f31e00c41f0 0x7f31e0159070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.681+0000 7f31e4870640 1 -- 172.21.15.132:0/396248017 >> 172.21.15.132:0/396248017 conn(0x7f31e006a260 msgr2=0x7f31e00aef50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:49.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.681+0000 7f31e4870640 1 -- 172.21.15.132:0/396248017 shutdown_connections 2023-12-20T04:47:49.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.681+0000 7f31e4870640 1 -- 172.21.15.132:0/396248017 wait complete. 2023-12-20T04:47:49.695 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:47:49.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.794+0000 7f959df73640 1 Processor -- start 2023-12-20T04:47:49.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.794+0000 7f959df73640 1 -- start start 2023-12-20T04:47:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.795+0000 7f959df73640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f959815af00 0x7f95980d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.795+0000 7f959df73640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9598160e80 0x7f959815e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.795+0000 7f959df73640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f959815b2e0 con 0x7f959815e570 2023-12-20T04:47:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.795+0000 7f959df73640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f959815dc10 con 0x7f959815af00 2023-12-20T04:47:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.795+0000 7f959df73640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9598161660 con 0x7f9598160e80 2023-12-20T04:47:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.795+0000 7f95977fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f959815af00 0x7f95980d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.795+0000 7f95977fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f959815af00 0x7f95980d0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43696/0 (socket says 172.21.15.132:43696) 2023-12-20T04:47:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.795+0000 7f95977fe640 1 -- 172.21.15.132:0/771468046 learned_addr learned my addr 172.21.15.132:0/771468046 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.795+0000 7f9596ffd640 1 --2- 172.21.15.132:0/771468046 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9598160e80 0x7f959815e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.795+0000 7f95977fe640 1 -- 172.21.15.132:0/771468046 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9598160e80 msgr2=0x7f959815e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.795+0000 7f95977fe640 1 --2- 172.21.15.132:0/771468046 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9598160e80 0x7f959815e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.795+0000 7f95977fe640 1 -- 172.21.15.132:0/771468046 >> v1:172.21.15.187:6789/0 conn(0x7f959815e570 legacy=0x7f959806ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.795+0000 7f95977fe640 1 -- 172.21.15.132:0/771468046 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9598161940 con 0x7f959815af00 2023-12-20T04:47:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.795+0000 7f9596ffd640 1 --2- 172.21.15.132:0/771468046 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9598160e80 0x7f959815e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.796+0000 7f95977fe640 1 --2- 172.21.15.132:0/771468046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f959815af00 0x7f95980d0520 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f9588009870 tx=0x7f958802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6285132c9386060 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.796+0000 7f95967fc640 1 -- 172.21.15.132:0/771468046 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95880317c0 con 0x7f959815af00 2023-12-20T04:47:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.796+0000 7f95967fc640 1 -- 172.21.15.132:0/771468046 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9588031920 con 0x7f959815af00 2023-12-20T04:47:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.796+0000 7f95967fc640 1 -- 172.21.15.132:0/771468046 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9588031cb0 con 0x7f959815af00 2023-12-20T04:47:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.797+0000 7f959df73640 1 -- 172.21.15.132:0/771468046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f959815af00 msgr2=0x7f95980d0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.797+0000 7f959df73640 1 --2- 172.21.15.132:0/771468046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f959815af00 0x7f95980d0520 secure :-1 s=READY pgs=1106 cs=0 l=1 rev1=1 crypto rx=0x7f9588009870 tx=0x7f958802b860 comp rx=0 tx=0).stop 2023-12-20T04:47:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.797+0000 7f959df73640 1 -- 172.21.15.132:0/771468046 shutdown_connections 2023-12-20T04:47:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.797+0000 7f959df73640 1 --2- 172.21.15.132:0/771468046 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9598160e80 0x7f959815e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.797+0000 7f959df73640 1 --2- 172.21.15.132:0/771468046 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f959815af00 0x7f95980d0520 unknown :-1 s=CLOSED pgs=1106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.797+0000 7f959df73640 1 -- 172.21.15.132:0/771468046 >> 172.21.15.132:0/771468046 conn(0x7f959806d640 msgr2=0x7f959806da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.797+0000 7f959df73640 1 -- 172.21.15.132:0/771468046 shutdown_connections 2023-12-20T04:47:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.797+0000 7f959df73640 1 -- 172.21.15.132:0/771468046 wait complete. 2023-12-20T04:47:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.798+0000 7f959df73640 1 Processor -- start 2023-12-20T04:47:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.798+0000 7f959df73640 1 -- start start 2023-12-20T04:47:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.799+0000 7f959df73640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f959815af00 0x7f959815be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.799+0000 7f959df73640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f959815e570 0x7f95981f22f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.799+0000 7f959df73640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9598160e80 0x7f959815fa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.799+0000 7f959df73640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95980b22f0 con 0x7f959815af00 2023-12-20T04:47:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.799+0000 7f959df73640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95980b25d0 con 0x7f959815e570 2023-12-20T04:47:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.799+0000 7f959df73640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f95980b28b0 con 0x7f9598160e80 2023-12-20T04:47:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.799+0000 7f95977fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f959815af00 0x7f959815be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.799+0000 7f95977fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f959815af00 0x7f959815be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43706/0 (socket says 172.21.15.132:43706) 2023-12-20T04:47:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.799+0000 7f95977fe640 1 -- 172.21.15.132:0/3614163672 learned_addr learned my addr 172.21.15.132:0/3614163672 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.799+0000 7f9597fff640 1 --2- 172.21.15.132:0/3614163672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9598160e80 0x7f959815fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.799+0000 7f9596ffd640 1 --2- 172.21.15.132:0/3614163672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f959815e570 0x7f95981f22f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.799+0000 7f95977fe640 1 -- 172.21.15.132:0/3614163672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9598160e80 msgr2=0x7f959815fa50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.799+0000 7f95977fe640 1 --2- 172.21.15.132:0/3614163672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9598160e80 0x7f959815fa50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.799+0000 7f95977fe640 1 -- 172.21.15.132:0/3614163672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f959815e570 msgr2=0x7f95981f22f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.799+0000 7f95977fe640 1 --2- 172.21.15.132:0/3614163672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f959815e570 0x7f95981f22f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.799+0000 7f95977fe640 1 -- 172.21.15.132:0/3614163672 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95880094d0 con 0x7f959815af00 2023-12-20T04:47:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.799+0000 7f95977fe640 1 --2- 172.21.15.132:0/3614163672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f959815af00 0x7f959815be50 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f958802b8a0 tx=0x7f95880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.800+0000 7f957ffff640 1 -- 172.21.15.132:0/3614163672 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95880329a0 con 0x7f959815af00 2023-12-20T04:47:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.800+0000 7f957ffff640 1 -- 172.21.15.132:0/3614163672 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9588032b40 con 0x7f959815af00 2023-12-20T04:47:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.800+0000 7f957ffff640 1 -- 172.21.15.132:0/3614163672 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f95880453f0 con 0x7f959815af00 2023-12-20T04:47:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.800+0000 7f959df73640 1 -- 172.21.15.132:0/3614163672 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95980b2b90 con 0x7f959815af00 2023-12-20T04:47:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.800+0000 7f959df73640 1 -- 172.21.15.132:0/3614163672 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f959815c390 con 0x7f959815af00 2023-12-20T04:47:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.801+0000 7f959df73640 1 -- 172.21.15.132:0/3614163672 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95980ad660 con 0x7f959815af00 2023-12-20T04:47:49.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.801+0000 7f957ffff640 1 -- 172.21.15.132:0/3614163672 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f958804e450 con 0x7f959815af00 2023-12-20T04:47:49.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.801+0000 7f957ffff640 1 --2- 172.21.15.132:0/3614163672 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f958406a430 0x7f958406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:49.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.802+0000 7f9596ffd640 1 --2- 172.21.15.132:0/3614163672 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f958406a430 0x7f958406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:49.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.802+0000 7f957ffff640 1 -- 172.21.15.132:0/3614163672 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f95880aacc0 con 0x7f959815af00 2023-12-20T04:47:49.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.802+0000 7f9596ffd640 1 --2- 172.21.15.132:0/3614163672 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f958406a430 0x7f958406c8f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f959815e470 tx=0x7f958c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:49.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.806+0000 7f957ffff640 1 -- 172.21.15.132:0/3614163672 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9588076270 con 0x7f959815af00 2023-12-20T04:47:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.988+0000 7f959df73640 1 -- 172.21.15.132:0/3614163672 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f95980b30b0 con 0x7f959815af00 2023-12-20T04:47:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.988+0000 7f957ffff640 1 -- 172.21.15.132:0/3614163672 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v110) v1 ==== 80+0+0 (secure 0 0 0) 0x7f9588079890 con 0x7f959815af00 2023-12-20T04:47:49.990 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:47:49.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.990+0000 7f959df73640 1 -- 172.21.15.132:0/3614163672 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f958406a430 msgr2=0x7f958406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.990+0000 7f959df73640 1 --2- 172.21.15.132:0/3614163672 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f958406a430 0x7f958406c8f0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f959815e470 tx=0x7f958c008040 comp rx=0 tx=0).stop 2023-12-20T04:47:49.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.990+0000 7f959df73640 1 -- 172.21.15.132:0/3614163672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f959815af00 msgr2=0x7f959815be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:49.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.990+0000 7f959df73640 1 --2- 172.21.15.132:0/3614163672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f959815af00 0x7f959815be50 secure :-1 s=READY pgs=1107 cs=0 l=1 rev1=1 crypto rx=0x7f958802b8a0 tx=0x7f95880046c0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.990+0000 7f959df73640 1 -- 172.21.15.132:0/3614163672 shutdown_connections 2023-12-20T04:47:49.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.990+0000 7f959df73640 1 --2- 172.21.15.132:0/3614163672 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f958406a430 0x7f958406c8f0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.990+0000 7f959df73640 1 --2- 172.21.15.132:0/3614163672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9598160e80 0x7f959815fa50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.990+0000 7f959df73640 1 --2- 172.21.15.132:0/3614163672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f959815e570 0x7f95981f22f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.990+0000 7f959df73640 1 --2- 172.21.15.132:0/3614163672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f959815af00 0x7f959815be50 unknown :-1 s=CLOSED pgs=1107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:49.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.990+0000 7f959df73640 1 -- 172.21.15.132:0/3614163672 >> 172.21.15.132:0/3614163672 conn(0x7f959806d640 msgr2=0x7f95980cc2d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:49.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.991+0000 7f959df73640 1 -- 172.21.15.132:0/3614163672 shutdown_connections 2023-12-20T04:47:49.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:49.991+0000 7f959df73640 1 -- 172.21.15.132:0/3614163672 wait complete. 2023-12-20T04:47:50.003 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi187.front.sepia.ceph.com... 2023-12-20T04:47:50.003 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:50.004 DEBUG:teuthology.orchestra.run.smithi187:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-20T04:47:50.034 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[89272]: fuse finished with error 0 and tester_r 0 2023-12-20T04:47:50.036 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:47:50.036 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:50.036 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-20T04:47:50.205 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:47:50.205 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:47:50.220 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:47:50.220 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:47:50.221 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:50.221 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-20T04:47:50.275 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:47:50.275 INFO:teuthology.orchestra.run.smithi132.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-20T04:47:50.275 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:47:50.276 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:47:50.294 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:47:50.294 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:47:50.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:47:50.295 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-20T04:47:50.352 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:47:50.352 INFO:teuthology.orchestra.run.smithi187.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-20T04:47:50.352 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:47:50.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.450+0000 7fcee45ce640 1 Processor -- start 2023-12-20T04:47:50.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.450+0000 7fcee45ce640 1 -- start start 2023-12-20T04:47:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.451+0000 7fcee45ce640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcedc15d4f0 0x7fcedc0aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.451+0000 7fcee45ce640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcedc0af470 con 0x7fcedc0af040 2023-12-20T04:47:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.451+0000 7fcee45ce640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcedc161ce0 con 0x7fcedc15d110 2023-12-20T04:47:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.451+0000 7fcee45ce640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcedc0aca50 con 0x7fcedc15d4f0 2023-12-20T04:47:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.451+0000 7fcee2b6b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcedc0af040 0x7fcedc0c4f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56406/0 (socket says 172.21.15.132:56406) 2023-12-20T04:47:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.451+0000 7fcee2b6b640 1 -- 172.21.15.132:0/1544163743 learned_addr learned my addr 172.21.15.132:0/1544163743 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.451+0000 7fcee1368640 1 -- 172.21.15.132:0/1544163743 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3764585843 0 0) 0x7fcedc0af470 con 0x7fcedc0af040 2023-12-20T04:47:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.451+0000 7fcee1368640 1 -- 172.21.15.132:0/1544163743 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcec8003520 con 0x7fcedc0af040 2023-12-20T04:47:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.451+0000 7fcee1b69640 1 --2- 172.21.15.132:0/1544163743 >> v2:172.21.15.187:3300/0 conn(0x7fcedc15d4f0 0x7fcedc0aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee1368640 1 -- 172.21.15.132:0/1544163743 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 281199888 0 0) 0x7fcec8003520 con 0x7fcedc0af040 2023-12-20T04:47:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee1368640 1 -- 172.21.15.132:0/1544163743 >> v2:172.21.15.187:3300/0 conn(0x7fcedc15d4f0 msgr2=0x7fcedc0aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee1368640 1 --2- 172.21.15.132:0/1544163743 >> v2:172.21.15.187:3300/0 conn(0x7fcedc15d4f0 0x7fcedc0aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee1368640 1 -- 172.21.15.132:0/1544163743 >> v1:172.21.15.187:6789/0 conn(0x7fcedc15d110 legacy=0x7fcedc069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee1368640 1 -- 172.21.15.132:0/1544163743 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc160df0 con 0x7fcedc0af040 2023-12-20T04:47:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee1368640 1 -- 172.21.15.132:0/1544163743 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fced40019f0 con 0x7fcedc0af040 2023-12-20T04:47:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee1368640 1 -- 172.21.15.132:0/1544163743 >> v1:172.21.15.132:6789/0 conn(0x7fcedc0af040 legacy=0x7fcedc0c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee1368640 1 --2- 172.21.15.132:0/1544163743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8003970 0x7fcec8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee1368640 1 --2- 172.21.15.132:0/1544163743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcec80047c0 0x7fcec8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee1368640 1 --2- 172.21.15.132:0/1544163743 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcec8005180 0x7fcec800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee1368640 1 -- 172.21.15.132:0/1544163743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc0aca50 con 0x7fcec8003970 2023-12-20T04:47:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee1368640 1 -- 172.21.15.132:0/1544163743 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec800c020 con 0x7fcec80047c0 2023-12-20T04:47:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee1368640 1 -- 172.21.15.132:0/1544163743 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec800c1e0 con 0x7fcec8005180 2023-12-20T04:47:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee236a640 1 --2- 172.21.15.132:0/1544163743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8003970 0x7fcec8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee1b69640 1 --2- 172.21.15.132:0/1544163743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcec80047c0 0x7fcec8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee2b6b640 1 --2- 172.21.15.132:0/1544163743 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcec8005180 0x7fcec800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee236a640 1 -- 172.21.15.132:0/1544163743 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcec8005180 msgr2=0x7fcec800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:50.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee236a640 1 --2- 172.21.15.132:0/1544163743 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcec8005180 0x7fcec800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee236a640 1 -- 172.21.15.132:0/1544163743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcec80047c0 msgr2=0x7fcec8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee236a640 1 --2- 172.21.15.132:0/1544163743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcec80047c0 0x7fcec8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee236a640 1 -- 172.21.15.132:0/1544163743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec8003520 con 0x7fcec8003970 2023-12-20T04:47:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.452+0000 7fcee2b6b640 1 -- 172.21.15.132:0/1544163743 reap_dead start 2023-12-20T04:47:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.453+0000 7fcee236a640 1 --2- 172.21.15.132:0/1544163743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8003970 0x7fcec8003d90 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0af600 tx=0x7fcec80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2705fddd58a42435 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.453+0000 7fcee1368640 1 -- 172.21.15.132:0/1544163743 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced80052d0 con 0x7fcec8003970 2023-12-20T04:47:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.453+0000 7fcee1368640 1 -- 172.21.15.132:0/1544163743 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced802e050 con 0x7fcec8003970 2023-12-20T04:47:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.453+0000 7fcee1368640 1 -- 172.21.15.132:0/1544163743 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced8003640 con 0x7fcec8003970 2023-12-20T04:47:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.453+0000 7fcee45ce640 1 -- 172.21.15.132:0/1544163743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8003970 msgr2=0x7fcec8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.453+0000 7fcee45ce640 1 --2- 172.21.15.132:0/1544163743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8003970 0x7fcec8003d90 secure :-1 s=READY pgs=1109 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0af600 tx=0x7fcec80057f0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.453+0000 7fcee45ce640 1 -- 172.21.15.132:0/1544163743 shutdown_connections 2023-12-20T04:47:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.453+0000 7fcee45ce640 1 --2- 172.21.15.132:0/1544163743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8003970 0x7fcec8003d90 unknown :-1 s=CLOSED pgs=1109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.453+0000 7fcee45ce640 1 -- 172.21.15.132:0/1544163743 >> 172.21.15.132:0/1544163743 conn(0x7fcedc0cfbd0 msgr2=0x7fcedc0cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.453+0000 7fcee45ce640 1 -- 172.21.15.132:0/1544163743 shutdown_connections 2023-12-20T04:47:50.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.453+0000 7fcee45ce640 1 -- 172.21.15.132:0/1544163743 wait complete. 2023-12-20T04:47:50.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.455+0000 7fcee45ce640 1 Processor -- start 2023-12-20T04:47:50.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.455+0000 7fcee45ce640 1 -- start start 2023-12-20T04:47:50.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.455+0000 7fcee45ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8003970 0x7fcedc0b0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:50.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.455+0000 7fcee45ce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcedc151350 0x7fcedc0c7040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:50.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.455+0000 7fcee45ce640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcedc0c7690 0x7fcedc0c7b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:50.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.455+0000 7fcee45ce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc1517d0 con 0x7fcec8003970 2023-12-20T04:47:50.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.455+0000 7fcee45ce640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc0c9b00 con 0x7fcedc0c7690 2023-12-20T04:47:50.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.455+0000 7fcee45ce640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc0c8050 con 0x7fcedc151350 2023-12-20T04:47:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.455+0000 7fcee236a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8003970 0x7fcedc0b0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.455+0000 7fcee236a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8003970 0x7fcedc0b0d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43718/0 (socket says 172.21.15.132:43718) 2023-12-20T04:47:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.455+0000 7fcee236a640 1 -- 172.21.15.132:0/1450066260 learned_addr learned my addr 172.21.15.132:0/1450066260 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.456+0000 7fcee2b6b640 1 --2- 172.21.15.132:0/1450066260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcedc0c7690 0x7fcedc0c7b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.456+0000 7fcee1b69640 1 --2- 172.21.15.132:0/1450066260 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcedc151350 0x7fcedc0c7040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.456+0000 7fcee236a640 1 -- 172.21.15.132:0/1450066260 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcedc151350 msgr2=0x7fcedc0c7040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.456+0000 7fcee236a640 1 --2- 172.21.15.132:0/1450066260 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcedc151350 0x7fcedc0c7040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.456+0000 7fcee236a640 1 -- 172.21.15.132:0/1450066260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcedc0c7690 msgr2=0x7fcedc0c7b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.456+0000 7fcee236a640 1 --2- 172.21.15.132:0/1450066260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcedc0c7690 0x7fcedc0c7b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.456+0000 7fcee236a640 1 -- 172.21.15.132:0/1450066260 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc0b08c0 con 0x7fcec8003970 2023-12-20T04:47:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.456+0000 7fcee236a640 1 --2- 172.21.15.132:0/1450066260 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8003970 0x7fcedc0b0d50 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fced802bbb0 tx=0x7fced8001170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.456+0000 7fced2ffd640 1 -- 172.21.15.132:0/1450066260 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced8006e20 con 0x7fcec8003970 2023-12-20T04:47:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.456+0000 7fced2ffd640 1 -- 172.21.15.132:0/1450066260 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced8007250 con 0x7fcec8003970 2023-12-20T04:47:50.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.456+0000 7fced2ffd640 1 -- 172.21.15.132:0/1450066260 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced8007600 con 0x7fcec8003970 2023-12-20T04:47:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.456+0000 7fcee45ce640 1 -- 172.21.15.132:0/1450066260 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcedc06e1f0 con 0x7fcec8003970 2023-12-20T04:47:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.456+0000 7fcee45ce640 1 -- 172.21.15.132:0/1450066260 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcedc0b0270 con 0x7fcec8003970 2023-12-20T04:47:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.457+0000 7fcee45ce640 1 -- 172.21.15.132:0/1450066260 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcedc151730 con 0x7fcec8003970 2023-12-20T04:47:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.457+0000 7fced2ffd640 1 -- 172.21.15.132:0/1450066260 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fced8003640 con 0x7fcec8003970 2023-12-20T04:47:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.458+0000 7fced2ffd640 1 --2- 172.21.15.132:0/1450066260 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcec006a430 0x7fcec006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.458+0000 7fced2ffd640 1 -- 172.21.15.132:0/1450066260 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fced80aa630 con 0x7fcec8003970 2023-12-20T04:47:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.458+0000 7fcee1b69640 1 --2- 172.21.15.132:0/1450066260 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcec006a430 0x7fcec006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.458+0000 7fcee1b69640 1 --2- 172.21.15.132:0/1450066260 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcec006a430 0x7fcec006c8f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0b17d0 tx=0x7fcecc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:50.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.462+0000 7fced2ffd640 1 -- 172.21.15.132:0/1450066260 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fced8075c70 con 0x7fcec8003970 2023-12-20T04:47:50.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.661+0000 7fcee45ce640 1 -- 172.21.15.132:0/1450066260 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcedc04e840 con 0x7fcec8003970 2023-12-20T04:47:50.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.662+0000 7fced2ffd640 1 -- 172.21.15.132:0/1450066260 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fced8079290 con 0x7fcec8003970 2023-12-20T04:47:50.664 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:50.664 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6939,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2115867433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2115867433},{"type":"v1","addr":"172.21.15.132:6837","nonce":2115867433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6942,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/162444556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":162444556},{"type":"v1","addr":"172.21.15.132:6836","nonce":162444556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2089611890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2089611890},{"type":"v1","addr":"172.21.15.187:6835","nonce":2089611890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:47:12.299623+0000","modified":"2023-12-20T04:47:14.308466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6957},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6957":{"gid":6957,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/786513656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":786513656},{"type":"v1","addr":"172.21.15.187:6834","nonce":786513656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-20T04:47:50.664 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 38 2023-12-20T04:47:50.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.663+0000 7fcee45ce640 1 -- 172.21.15.132:0/1450066260 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcec006a430 msgr2=0x7fcec006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:50.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.663+0000 7fcee45ce640 1 --2- 172.21.15.132:0/1450066260 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcec006a430 0x7fcec006c8f0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fcedc0b17d0 tx=0x7fcecc008040 comp rx=0 tx=0).stop 2023-12-20T04:47:50.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.663+0000 7fcee45ce640 1 -- 172.21.15.132:0/1450066260 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8003970 msgr2=0x7fcedc0b0d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:50.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.663+0000 7fcee45ce640 1 --2- 172.21.15.132:0/1450066260 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8003970 0x7fcedc0b0d50 secure :-1 s=READY pgs=1110 cs=0 l=1 rev1=1 crypto rx=0x7fced802bbb0 tx=0x7fced8001170 comp rx=0 tx=0).stop 2023-12-20T04:47:50.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.663+0000 7fcee45ce640 1 -- 172.21.15.132:0/1450066260 shutdown_connections 2023-12-20T04:47:50.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.663+0000 7fcee45ce640 1 --2- 172.21.15.132:0/1450066260 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcec006a430 0x7fcec006c8f0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.663+0000 7fcee45ce640 1 --2- 172.21.15.132:0/1450066260 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcedc0c7690 0x7fcedc0c7b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.663+0000 7fcee45ce640 1 --2- 172.21.15.132:0/1450066260 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcedc151350 0x7fcedc0c7040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.663+0000 7fcee45ce640 1 --2- 172.21.15.132:0/1450066260 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8003970 0x7fcedc0b0d50 unknown :-1 s=CLOSED pgs=1110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.663+0000 7fcee45ce640 1 -- 172.21.15.132:0/1450066260 >> 172.21.15.132:0/1450066260 conn(0x7fcedc0cfbd0 msgr2=0x7fcedc0ae020 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:50.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.663+0000 7fcee45ce640 1 -- 172.21.15.132:0/1450066260 shutdown_connections 2023-12-20T04:47:50.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.663+0000 7fcee45ce640 1 -- 172.21.15.132:0/1450066260 wait complete. 2023-12-20T04:47:50.677 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:47:50.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.775+0000 7faa755fa640 1 Processor -- start 2023-12-20T04:47:50.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.775+0000 7faa755fa640 1 -- start start 2023-12-20T04:47:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.776+0000 7faa755fa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa70160ba0 0x7faa700cb380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.776+0000 7faa755fa640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa70161ff0 con 0x7faa700ce2a0 2023-12-20T04:47:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.776+0000 7faa755fa640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa7006ff00 con 0x7faa700d0010 2023-12-20T04:47:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.776+0000 7faa755fa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa700cca40 con 0x7faa70160ba0 2023-12-20T04:47:50.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.776+0000 7faa6e7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7faa700ce2a0 0x7faa7006f0e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56414/0 (socket says 172.21.15.132:56414) 2023-12-20T04:47:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.776+0000 7faa6e7fc640 1 -- 172.21.15.132:0/1257340296 learned_addr learned my addr 172.21.15.132:0/1257340296 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.776+0000 7faa6effd640 1 --2- 172.21.15.132:0/1257340296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa70160ba0 0x7faa700cb380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.777+0000 7faa6dffb640 1 -- 172.21.15.132:0/1257340296 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1293168669 0 0) 0x7faa70161ff0 con 0x7faa700ce2a0 2023-12-20T04:47:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.777+0000 7faa6dffb640 1 -- 172.21.15.132:0/1257340296 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa58003520 con 0x7faa700ce2a0 2023-12-20T04:47:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.777+0000 7faa6dffb640 1 -- 172.21.15.132:0/1257340296 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2574078634 0 0) 0x7faa7006ff00 con 0x7faa700d0010 2023-12-20T04:47:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.777+0000 7faa6dffb640 1 -- 172.21.15.132:0/1257340296 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa70161ff0 con 0x7faa700d0010 2023-12-20T04:47:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.777+0000 7faa6effd640 1 -- 172.21.15.132:0/1257340296 >> v1:172.21.15.187:6789/0 conn(0x7faa700d0010 legacy=0x7faa7006f7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.777+0000 7faa6dffb640 1 -- 172.21.15.132:0/1257340296 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1224757304 0 0) 0x7faa58003520 con 0x7faa700ce2a0 2023-12-20T04:47:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.777+0000 7faa6effd640 1 -- 172.21.15.132:0/1257340296 >> v1:172.21.15.132:6789/0 conn(0x7faa700ce2a0 legacy=0x7faa7006f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.777+0000 7faa6effd640 1 -- 172.21.15.132:0/1257340296 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa701613e0 con 0x7faa70160ba0 2023-12-20T04:47:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.778+0000 7faa6effd640 1 --2- 172.21.15.132:0/1257340296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa70160ba0 0x7faa700cb380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa60009dc0 tx=0x7faa6002bd50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ad29f16404a8b1b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.778+0000 7faa6dffb640 1 -- 172.21.15.132:0/1257340296 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa64001670 con 0x7faa70160ba0 2023-12-20T04:47:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.778+0000 7faa6dffb640 1 -- 172.21.15.132:0/1257340296 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa6002c880 con 0x7faa70160ba0 2023-12-20T04:47:50.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.778+0000 7faa6dffb640 1 -- 172.21.15.132:0/1257340296 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa6002cbf0 con 0x7faa70160ba0 2023-12-20T04:47:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.778+0000 7faa755fa640 1 -- 172.21.15.132:0/1257340296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa70160ba0 msgr2=0x7faa700cb380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.778+0000 7faa755fa640 1 --2- 172.21.15.132:0/1257340296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa70160ba0 0x7faa700cb380 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7faa60009dc0 tx=0x7faa6002bd50 comp rx=0 tx=0).stop 2023-12-20T04:47:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.778+0000 7faa755fa640 1 -- 172.21.15.132:0/1257340296 shutdown_connections 2023-12-20T04:47:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.778+0000 7faa755fa640 1 --2- 172.21.15.132:0/1257340296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa70160ba0 0x7faa700cb380 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.778+0000 7faa755fa640 1 -- 172.21.15.132:0/1257340296 >> 172.21.15.132:0/1257340296 conn(0x7faa700cd7b0 msgr2=0x7faa700cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.778+0000 7faa755fa640 1 -- 172.21.15.132:0/1257340296 shutdown_connections 2023-12-20T04:47:50.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.778+0000 7faa755fa640 1 -- 172.21.15.132:0/1257340296 wait complete. 2023-12-20T04:47:50.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.780+0000 7faa755fa640 1 Processor -- start 2023-12-20T04:47:50.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.780+0000 7faa755fa640 1 -- start start 2023-12-20T04:47:50.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.780+0000 7faa755fa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa700ce2a0 0x7faa7015eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:50.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.780+0000 7faa755fa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa700d0010 0x7faa70153510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:50.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.780+0000 7faa755fa640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa70160ba0 0x7faa7015cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.780+0000 7faa755fa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa700afbd0 con 0x7faa700d0010 2023-12-20T04:47:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.780+0000 7faa755fa640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa7015f150 con 0x7faa70160ba0 2023-12-20T04:47:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.780+0000 7faa755fa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa7015f430 con 0x7faa700ce2a0 2023-12-20T04:47:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.781+0000 7faa6e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa700d0010 0x7faa70153510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.781+0000 7faa6e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa700d0010 0x7faa70153510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43720/0 (socket says 172.21.15.132:43720) 2023-12-20T04:47:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.781+0000 7faa6e7fc640 1 -- 172.21.15.132:0/4105613416 learned_addr learned my addr 172.21.15.132:0/4105613416 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.781+0000 7faa6effd640 1 --2- 172.21.15.132:0/4105613416 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa700ce2a0 0x7faa7015eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.781+0000 7faa6f7fe640 1 --2- 172.21.15.132:0/4105613416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa70160ba0 0x7faa7015cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.781+0000 7faa6e7fc640 1 -- 172.21.15.132:0/4105613416 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa700ce2a0 msgr2=0x7faa7015eb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.781+0000 7faa6e7fc640 1 --2- 172.21.15.132:0/4105613416 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa700ce2a0 0x7faa7015eb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.781+0000 7faa6e7fc640 1 -- 172.21.15.132:0/4105613416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa70160ba0 msgr2=0x7faa7015cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.781+0000 7faa6e7fc640 1 --2- 172.21.15.132:0/4105613416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa70160ba0 0x7faa7015cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.781+0000 7faa6e7fc640 1 -- 172.21.15.132:0/4105613416 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa60009a70 con 0x7faa700d0010 2023-12-20T04:47:50.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.781+0000 7faa6e7fc640 1 --2- 172.21.15.132:0/4105613416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa700d0010 0x7faa70153510 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c520 tx=0x7faa6400c9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:50.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.781+0000 7faa577fe640 1 -- 172.21.15.132:0/4105613416 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa64005ce0 con 0x7faa700d0010 2023-12-20T04:47:50.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.781+0000 7faa577fe640 1 -- 172.21.15.132:0/4105613416 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa64005e40 con 0x7faa700d0010 2023-12-20T04:47:50.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.781+0000 7faa755fa640 1 -- 172.21.15.132:0/4105613416 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa700afe40 con 0x7faa700d0010 2023-12-20T04:47:50.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.781+0000 7faa577fe640 1 -- 172.21.15.132:0/4105613416 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa64007270 con 0x7faa700d0010 2023-12-20T04:47:50.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.781+0000 7faa755fa640 1 -- 172.21.15.132:0/4105613416 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa7015d520 con 0x7faa700d0010 2023-12-20T04:47:50.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.782+0000 7faa755fa640 1 -- 172.21.15.132:0/4105613416 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa700b0030 con 0x7faa700d0010 2023-12-20T04:47:50.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.783+0000 7faa577fe640 1 -- 172.21.15.132:0/4105613416 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faa64007490 con 0x7faa700d0010 2023-12-20T04:47:50.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.783+0000 7faa577fe640 1 --2- 172.21.15.132:0/4105613416 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa5c06a430 0x7faa5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:50.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.783+0000 7faa577fe640 1 -- 172.21.15.132:0/4105613416 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7faa64087f10 con 0x7faa700d0010 2023-12-20T04:47:50.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.783+0000 7faa6effd640 1 --2- 172.21.15.132:0/4105613416 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa5c06a430 0x7faa5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:50.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.783+0000 7faa6effd640 1 --2- 172.21.15.132:0/4105613416 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa5c06a430 0x7faa5c06c8f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7faa60036000 tx=0x7faa60030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:50.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.787+0000 7faa577fe640 1 -- 172.21.15.132:0/4105613416 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7faa64053570 con 0x7faa700d0010 2023-12-20T04:47:50.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.956+0000 7faa755fa640 1 -- 172.21.15.132:0/4105613416 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7faa7004e840 con 0x7faa700d0010 2023-12-20T04:47:50.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.957+0000 7faa577fe640 1 -- 172.21.15.132:0/4105613416 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16244 (secure 0 0 0) 0x7faa64017090 con 0x7faa700d0010 2023-12-20T04:47:50.959 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:50.960 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":110,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:47:40.970633+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:47:10.649946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-20T04:47:11.271933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1c","mappings":[{"from":6,"to":3}]},{"pgid":"13.23","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:47:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.959+0000 7faa755fa640 1 -- 172.21.15.132:0/4105613416 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa5c06a430 msgr2=0x7faa5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.959+0000 7faa755fa640 1 --2- 172.21.15.132:0/4105613416 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa5c06a430 0x7faa5c06c8f0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7faa60036000 tx=0x7faa60030000 comp rx=0 tx=0).stop 2023-12-20T04:47:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.959+0000 7faa755fa640 1 -- 172.21.15.132:0/4105613416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa700d0010 msgr2=0x7faa70153510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.959+0000 7faa755fa640 1 --2- 172.21.15.132:0/4105613416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa700d0010 0x7faa70153510 secure :-1 s=READY pgs=1112 cs=0 l=1 rev1=1 crypto rx=0x7faa6400c520 tx=0x7faa6400c9e0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.959+0000 7faa755fa640 1 -- 172.21.15.132:0/4105613416 shutdown_connections 2023-12-20T04:47:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.959+0000 7faa755fa640 1 --2- 172.21.15.132:0/4105613416 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa5c06a430 0x7faa5c06c8f0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.959+0000 7faa755fa640 1 --2- 172.21.15.132:0/4105613416 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa70160ba0 0x7faa7015cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.959+0000 7faa755fa640 1 --2- 172.21.15.132:0/4105613416 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa700d0010 0x7faa70153510 unknown :-1 s=CLOSED pgs=1112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.959+0000 7faa755fa640 1 --2- 172.21.15.132:0/4105613416 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa700ce2a0 0x7faa7015eb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.959+0000 7faa755fa640 1 -- 172.21.15.132:0/4105613416 >> 172.21.15.132:0/4105613416 conn(0x7faa700cd7b0 msgr2=0x7faa7006ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.959+0000 7faa755fa640 1 -- 172.21.15.132:0/4105613416 shutdown_connections 2023-12-20T04:47:50.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:50.959+0000 7faa755fa640 1 -- 172.21.15.132:0/4105613416 wait complete. 2023-12-20T04:47:50.972 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 12, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:47:10.649946+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 13, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:47:11.271933+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:47:50.973 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:47:51.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.074+0000 7fb969373640 1 Processor -- start 2023-12-20T04:47:51.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.074+0000 7fb969373640 1 -- start start 2023-12-20T04:47:51.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.075+0000 7fb969373640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9640b1a80 0x7fb964070080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.075+0000 7fb969373640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb9640719d0 0x7fb9640705c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.075+0000 7fb969373640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9641598f0 con 0x7fb964159510 2023-12-20T04:47:51.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.075+0000 7fb969373640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9640d0180 con 0x7fb9640719d0 2023-12-20T04:47:51.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.075+0000 7fb969373640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640cf600 con 0x7fb9640b1a80 2023-12-20T04:47:51.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.076+0000 7fb962ffd640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fb964159510 0x7fb9640b1370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:46296/0 (socket says 172.21.15.132:46296) 2023-12-20T04:47:51.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.076+0000 7fb95a7fc640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9640b1a80 0x7fb964070080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.076+0000 7fb962ffd640 1 -- 172.21.15.132:0/893904492 learned_addr learned my addr 172.21.15.132:0/893904492 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:51.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.076+0000 7fb9637fe640 1 --2- 172.21.15.132:0/893904492 >> v2:172.21.15.187:3300/0 conn(0x7fb9640719d0 0x7fb9640705c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.076+0000 7fb9627fc640 1 -- 172.21.15.132:0/893904492 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 160443883 0 0) 0x7fb9641598f0 con 0x7fb964159510 2023-12-20T04:47:51.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.076+0000 7fb95a7fc640 1 -- 172.21.15.132:0/893904492 >> v2:172.21.15.187:3300/0 conn(0x7fb9640719d0 msgr2=0x7fb9640705c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:51.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.076+0000 7fb95a7fc640 1 --2- 172.21.15.132:0/893904492 >> v2:172.21.15.187:3300/0 conn(0x7fb9640719d0 0x7fb9640705c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.076+0000 7fb95a7fc640 1 -- 172.21.15.132:0/893904492 >> v1:172.21.15.187:6789/0 conn(0x7fb964159510 legacy=0x7fb9640b1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.076+0000 7fb95a7fc640 1 -- 172.21.15.132:0/893904492 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9640cf8e0 con 0x7fb9640b1a80 2023-12-20T04:47:51.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.077+0000 7fb95a7fc640 1 --2- 172.21.15.132:0/893904492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9640b1a80 0x7fb964070080 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0097a0 tx=0x7fb94c02b840 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9620075dc909a0b5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:51.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.077+0000 7fb9627fc640 1 -- 172.21.15.132:0/893904492 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c02e070 con 0x7fb9640b1a80 2023-12-20T04:47:51.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.077+0000 7fb9627fc640 1 -- 172.21.15.132:0/893904492 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94c0315a0 con 0x7fb9640b1a80 2023-12-20T04:47:51.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.077+0000 7fb9627fc640 1 -- 172.21.15.132:0/893904492 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb94c031930 con 0x7fb9640b1a80 2023-12-20T04:47:51.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.077+0000 7fb969373640 1 -- 172.21.15.132:0/893904492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9640b1a80 msgr2=0x7fb964070080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.077+0000 7fb969373640 1 --2- 172.21.15.132:0/893904492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9640b1a80 0x7fb964070080 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7fb94c0097a0 tx=0x7fb94c02b840 comp rx=0 tx=0).stop 2023-12-20T04:47:51.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.077+0000 7fb969373640 1 -- 172.21.15.132:0/893904492 shutdown_connections 2023-12-20T04:47:51.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.077+0000 7fb969373640 1 --2- 172.21.15.132:0/893904492 >> v2:172.21.15.187:3300/0 conn(0x7fb9640719d0 0x7fb9640705c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.077+0000 7fb969373640 1 --2- 172.21.15.132:0/893904492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9640b1a80 0x7fb964070080 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.077+0000 7fb969373640 1 -- 172.21.15.132:0/893904492 >> 172.21.15.132:0/893904492 conn(0x7fb96406bfc0 msgr2=0x7fb96406c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:51.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.077+0000 7fb969373640 1 -- 172.21.15.132:0/893904492 shutdown_connections 2023-12-20T04:47:51.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.077+0000 7fb969373640 1 -- 172.21.15.132:0/893904492 wait complete. 2023-12-20T04:47:51.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.078+0000 7fb969373640 1 Processor -- start 2023-12-20T04:47:51.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.079+0000 7fb969373640 1 -- start start 2023-12-20T04:47:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.079+0000 7fb969373640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9640719d0 0x7fb96414de60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.079+0000 7fb969373640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9640b1a80 0x7fb964157770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.079+0000 7fb969373640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb964159510 0x7fb9640c86c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.079+0000 7fb969373640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640b3170 con 0x7fb964159510 2023-12-20T04:47:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.079+0000 7fb969373640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb96414e3a0 con 0x7fb9640719d0 2023-12-20T04:47:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.079+0000 7fb969373640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9640b20d0 con 0x7fb9640b1a80 2023-12-20T04:47:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.079+0000 7fb9637fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb964159510 0x7fb9640c86c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.080+0000 7fb9637fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb964159510 0x7fb9640c86c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43722/0 (socket says 172.21.15.132:43722) 2023-12-20T04:47:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.080+0000 7fb9637fe640 1 -- 172.21.15.132:0/2693861908 learned_addr learned my addr 172.21.15.132:0/2693861908 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.080+0000 7fb95a7fc640 1 --2- 172.21.15.132:0/2693861908 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9640b1a80 0x7fb964157770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.080+0000 7fb962ffd640 1 --2- 172.21.15.132:0/2693861908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9640719d0 0x7fb96414de60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.080+0000 7fb9637fe640 1 -- 172.21.15.132:0/2693861908 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9640b1a80 msgr2=0x7fb964157770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.080+0000 7fb9637fe640 1 --2- 172.21.15.132:0/2693861908 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9640b1a80 0x7fb964157770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.080+0000 7fb9637fe640 1 -- 172.21.15.132:0/2693861908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9640719d0 msgr2=0x7fb96414de60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.080+0000 7fb9637fe640 1 --2- 172.21.15.132:0/2693861908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9640719d0 0x7fb96414de60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.080+0000 7fb9637fe640 1 -- 172.21.15.132:0/2693861908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb94c009400 con 0x7fb964159510 2023-12-20T04:47:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.080+0000 7fb9637fe640 1 --2- 172.21.15.132:0/2693861908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb964159510 0x7fb9640c86c0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00efc0 tx=0x7fb95c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.080+0000 7fb95bfff640 1 -- 172.21.15.132:0/2693861908 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c009ba0 con 0x7fb964159510 2023-12-20T04:47:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.080+0000 7fb95bfff640 1 -- 172.21.15.132:0/2693861908 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb95c00f040 con 0x7fb964159510 2023-12-20T04:47:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.080+0000 7fb969373640 1 -- 172.21.15.132:0/2693861908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9640b23b0 con 0x7fb964159510 2023-12-20T04:47:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.080+0000 7fb95bfff640 1 -- 172.21.15.132:0/2693861908 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb95c0146c0 con 0x7fb964159510 2023-12-20T04:47:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.080+0000 7fb969373640 1 -- 172.21.15.132:0/2693861908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9640b2970 con 0x7fb964159510 2023-12-20T04:47:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.081+0000 7fb969373640 1 -- 172.21.15.132:0/2693861908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb964066480 con 0x7fb964159510 2023-12-20T04:47:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.082+0000 7fb95bfff640 1 -- 172.21.15.132:0/2693861908 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb95c014820 con 0x7fb964159510 2023-12-20T04:47:51.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.082+0000 7fb95bfff640 1 --2- 172.21.15.132:0/2693861908 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb94406a430 0x7fb94406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.082+0000 7fb95bfff640 1 -- 172.21.15.132:0/2693861908 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb95c0897c0 con 0x7fb964159510 2023-12-20T04:47:51.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.082+0000 7fb962ffd640 1 --2- 172.21.15.132:0/2693861908 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb94406a430 0x7fb94406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.083+0000 7fb962ffd640 1 --2- 172.21.15.132:0/2693861908 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb94406a430 0x7fb94406c8f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb954000f60 tx=0x7fb954007b50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:51.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.086+0000 7fb95bfff640 1 -- 172.21.15.132:0/2693861908 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb95c054d70 con 0x7fb964159510 2023-12-20T04:47:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.252+0000 7fb969373640 1 -- 172.21.15.132:0/2693861908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fb96404e840 con 0x7fb964159510 2023-12-20T04:47:51.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.253+0000 7fb95bfff640 1 -- 172.21.15.132:0/2693861908 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v110) v1 ==== 93+0+10 (secure 0 0 0) 0x7fb95c0180a0 con 0x7fb964159510 2023-12-20T04:47:51.255 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:47:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.254+0000 7fb969373640 1 -- 172.21.15.132:0/2693861908 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb94406a430 msgr2=0x7fb94406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.254+0000 7fb969373640 1 --2- 172.21.15.132:0/2693861908 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb94406a430 0x7fb94406c8f0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb954000f60 tx=0x7fb954007b50 comp rx=0 tx=0).stop 2023-12-20T04:47:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.254+0000 7fb969373640 1 -- 172.21.15.132:0/2693861908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb964159510 msgr2=0x7fb9640c86c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.254+0000 7fb969373640 1 --2- 172.21.15.132:0/2693861908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb964159510 0x7fb9640c86c0 secure :-1 s=READY pgs=1113 cs=0 l=1 rev1=1 crypto rx=0x7fb95c00efc0 tx=0x7fb95c00c490 comp rx=0 tx=0).stop 2023-12-20T04:47:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.254+0000 7fb969373640 1 -- 172.21.15.132:0/2693861908 shutdown_connections 2023-12-20T04:47:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.254+0000 7fb969373640 1 --2- 172.21.15.132:0/2693861908 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb94406a430 0x7fb94406c8f0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.254+0000 7fb969373640 1 --2- 172.21.15.132:0/2693861908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb964159510 0x7fb9640c86c0 unknown :-1 s=CLOSED pgs=1113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.254+0000 7fb969373640 1 --2- 172.21.15.132:0/2693861908 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9640b1a80 0x7fb964157770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.254+0000 7fb969373640 1 --2- 172.21.15.132:0/2693861908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9640719d0 0x7fb96414de60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.255+0000 7fb969373640 1 -- 172.21.15.132:0/2693861908 >> 172.21.15.132:0/2693861908 conn(0x7fb96406bfc0 msgr2=0x7fb964072d60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.255+0000 7fb969373640 1 -- 172.21.15.132:0/2693861908 shutdown_connections 2023-12-20T04:47:51.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.255+0000 7fb969373640 1 -- 172.21.15.132:0/2693861908 wait complete. 2023-12-20T04:47:51.267 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:47:51.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.367+0000 7f649b6d5640 1 Processor -- start 2023-12-20T04:47:51.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.367+0000 7f649b6d5640 1 -- start start 2023-12-20T04:47:51.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.368+0000 7f649b6d5640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f649415cf20 0x7f649406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.368+0000 7f649b6d5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f649406cc90 con 0x7f649415d300 2023-12-20T04:47:51.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.368+0000 7f649b6d5640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f64940b2f30 con 0x7f64940cd4b0 2023-12-20T04:47:51.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.368+0000 7f649b6d5640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f64940b3210 con 0x7f649415cf20 2023-12-20T04:47:51.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.368+0000 7f6498c70640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f649415d300 0x7f6494161700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56422/0 (socket says 172.21.15.132:56422) 2023-12-20T04:47:51.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.368+0000 7f6498c70640 1 -- 172.21.15.132:0/4228799564 learned_addr learned my addr 172.21.15.132:0/4228799564 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:51.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f6499471640 1 --2- 172.21.15.132:0/4228799564 >> v2:172.21.15.187:3300/0 conn(0x7f649415cf20 0x7f649406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f648bfff640 1 -- 172.21.15.132:0/4228799564 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2610696053 0 0) 0x7f649406cc90 con 0x7f649415d300 2023-12-20T04:47:51.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f648bfff640 1 -- 172.21.15.132:0/4228799564 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6480003520 con 0x7f649415d300 2023-12-20T04:47:51.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f648bfff640 1 -- 172.21.15.132:0/4228799564 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3652051868 0 0) 0x7f6480003520 con 0x7f649415d300 2023-12-20T04:47:51.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f648bfff640 1 -- 172.21.15.132:0/4228799564 >> v2:172.21.15.187:3300/0 conn(0x7f649415cf20 msgr2=0x7f649406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:51.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f648bfff640 1 --2- 172.21.15.132:0/4228799564 >> v2:172.21.15.187:3300/0 conn(0x7f649415cf20 0x7f649406c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f648bfff640 1 -- 172.21.15.132:0/4228799564 >> v1:172.21.15.187:6789/0 conn(0x7f64940cd4b0 legacy=0x7f64940d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f648bfff640 1 -- 172.21.15.132:0/4228799564 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64940b34f0 con 0x7f649415d300 2023-12-20T04:47:51.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f648bfff640 1 -- 172.21.15.132:0/4228799564 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f6484001670 con 0x7f649415d300 2023-12-20T04:47:51.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f648bfff640 1 -- 172.21.15.132:0/4228799564 >> v1:172.21.15.132:6789/0 conn(0x7f649415d300 legacy=0x7f6494161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f648bfff640 1 --2- 172.21.15.132:0/4228799564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6480003970 0x7f6480003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f648bfff640 1 --2- 172.21.15.132:0/4228799564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480004370 0x7f6480004840 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f648bfff640 1 --2- 172.21.15.132:0/4228799564 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6480005040 0x7f648000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f648bfff640 1 -- 172.21.15.132:0/4228799564 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64940b3210 con 0x7f6480004370 2023-12-20T04:47:51.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f648bfff640 1 -- 172.21.15.132:0/4228799564 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f648000bfa0 con 0x7f6480003970 2023-12-20T04:47:51.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f648bfff640 1 -- 172.21.15.132:0/4228799564 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f648000c160 con 0x7f6480005040 2023-12-20T04:47:51.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f6498c70640 1 --2- 172.21.15.132:0/4228799564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480004370 0x7f6480004840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f6499471640 1 --2- 172.21.15.132:0/4228799564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6480003970 0x7f6480003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f6499c72640 1 --2- 172.21.15.132:0/4228799564 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6480005040 0x7f648000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f6498c70640 1 -- 172.21.15.132:0/4228799564 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6480005040 msgr2=0x7f648000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:51.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f6498c70640 1 --2- 172.21.15.132:0/4228799564 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6480005040 0x7f648000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f6498c70640 1 -- 172.21.15.132:0/4228799564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6480003970 msgr2=0x7f6480003d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:51.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f6498c70640 1 --2- 172.21.15.132:0/4228799564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6480003970 0x7f6480003d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f6498c70640 1 -- 172.21.15.132:0/4228799564 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6480003520 con 0x7f6480004370 2023-12-20T04:47:51.374 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.369+0000 7f6499c72640 1 -- 172.21.15.132:0/4228799564 reap_dead start 2023-12-20T04:47:51.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.370+0000 7f6498c70640 1 --2- 172.21.15.132:0/4228799564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480004370 0x7f6480004840 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f648400c210 tx=0x7f64800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=78a2f19e40c34e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:51.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.370+0000 7f648bfff640 1 -- 172.21.15.132:0/4228799564 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6484005ad0 con 0x7f6480004370 2023-12-20T04:47:51.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.370+0000 7f648bfff640 1 -- 172.21.15.132:0/4228799564 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6484005c50 con 0x7f6480004370 2023-12-20T04:47:51.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.370+0000 7f648bfff640 1 -- 172.21.15.132:0/4228799564 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f648402c890 con 0x7f6480004370 2023-12-20T04:47:51.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.371+0000 7f649b6d5640 1 -- 172.21.15.132:0/4228799564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480004370 msgr2=0x7f6480004840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.371+0000 7f649b6d5640 1 --2- 172.21.15.132:0/4228799564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480004370 0x7f6480004840 secure :-1 s=READY pgs=1115 cs=0 l=1 rev1=1 crypto rx=0x7f648400c210 tx=0x7f64800057f0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.371+0000 7f649b6d5640 1 -- 172.21.15.132:0/4228799564 shutdown_connections 2023-12-20T04:47:51.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.371+0000 7f649b6d5640 1 --2- 172.21.15.132:0/4228799564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480004370 0x7f6480004840 unknown :-1 s=CLOSED pgs=1115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.371+0000 7f649b6d5640 1 -- 172.21.15.132:0/4228799564 >> 172.21.15.132:0/4228799564 conn(0x7f6494072c60 msgr2=0x7f6494073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:51.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.371+0000 7f649b6d5640 1 -- 172.21.15.132:0/4228799564 shutdown_connections 2023-12-20T04:47:51.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.371+0000 7f649b6d5640 1 -- 172.21.15.132:0/4228799564 wait complete. 2023-12-20T04:47:51.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.372+0000 7f649b6d5640 1 Processor -- start 2023-12-20T04:47:51.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.372+0000 7f649b6d5640 1 -- start start 2023-12-20T04:47:51.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f649b6d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480004370 0x7f64940acf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f649b6d5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64940c3b50 0x7f64941f6410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f649b6d5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6494157d90 0x7f64940d0150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f649b6d5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64940ad480 con 0x7f6480004370 2023-12-20T04:47:51.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f649b6d5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64940ad6b0 con 0x7f6494157d90 2023-12-20T04:47:51.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f649b6d5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f64940ad990 con 0x7f64940c3b50 2023-12-20T04:47:51.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f6499471640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480004370 0x7f64940acf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f6499471640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480004370 0x7f64940acf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43744/0 (socket says 172.21.15.132:43744) 2023-12-20T04:47:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f6499471640 1 -- 172.21.15.132:0/1546953177 learned_addr learned my addr 172.21.15.132:0/1546953177 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f6499c72640 1 --2- 172.21.15.132:0/1546953177 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6494157d90 0x7f64940d0150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f6498c70640 1 --2- 172.21.15.132:0/1546953177 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64940c3b50 0x7f64941f6410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f6499471640 1 -- 172.21.15.132:0/1546953177 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64940c3b50 msgr2=0x7f64941f6410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f6499471640 1 --2- 172.21.15.132:0/1546953177 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64940c3b50 0x7f64941f6410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f6499471640 1 -- 172.21.15.132:0/1546953177 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6494157d90 msgr2=0x7f64940d0150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f6499471640 1 --2- 172.21.15.132:0/1546953177 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6494157d90 0x7f64940d0150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f6499471640 1 -- 172.21.15.132:0/1546953177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f64941f5c10 con 0x7f6480004370 2023-12-20T04:47:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f6499471640 1 --2- 172.21.15.132:0/1546953177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480004370 0x7f64940acf40 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f6490009f00 tx=0x7f649000f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f6489ffb640 1 -- 172.21.15.132:0/1546953177 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f649000e040 con 0x7f6480004370 2023-12-20T04:47:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f6489ffb640 1 -- 172.21.15.132:0/1546953177 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f649000f040 con 0x7f6480004370 2023-12-20T04:47:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f649b6d5640 1 -- 172.21.15.132:0/1546953177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64941f5ef0 con 0x7f6480004370 2023-12-20T04:47:51.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.373+0000 7f6489ffb640 1 -- 172.21.15.132:0/1546953177 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6490003bb0 con 0x7f6480004370 2023-12-20T04:47:51.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.374+0000 7f649b6d5640 1 -- 172.21.15.132:0/1546953177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64940adc70 con 0x7f6480004370 2023-12-20T04:47:51.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.374+0000 7f649b6d5640 1 -- 172.21.15.132:0/1546953177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f649404e840 con 0x7f6480004370 2023-12-20T04:47:51.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.375+0000 7f6489ffb640 1 -- 172.21.15.132:0/1546953177 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6490003d10 con 0x7f6480004370 2023-12-20T04:47:51.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.375+0000 7f6489ffb640 1 --2- 172.21.15.132:0/1546953177 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f647806a430 0x7f647806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.375+0000 7f6489ffb640 1 -- 172.21.15.132:0/1546953177 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f64900894b0 con 0x7f6480004370 2023-12-20T04:47:51.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.375+0000 7f6498c70640 1 --2- 172.21.15.132:0/1546953177 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f647806a430 0x7f647806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.376+0000 7f6498c70640 1 --2- 172.21.15.132:0/1546953177 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f647806a430 0x7f647806c8f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6484034000 tx=0x7f6484009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:51.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.380+0000 7f6489ffb640 1 -- 172.21.15.132:0/1546953177 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6490054af0 con 0x7f6480004370 2023-12-20T04:47:51.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.544+0000 7f649b6d5640 1 -- 172.21.15.132:0/1546953177 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f64940b2890 con 0x7f6480004370 2023-12-20T04:47:51.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.545+0000 7f6489ffb640 1 -- 172.21.15.132:0/1546953177 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v110) v1 ==== 104+0+11 (secure 0 0 0) 0x7f6490058110 con 0x7f6480004370 2023-12-20T04:47:51.547 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:47:51.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.547+0000 7f649b6d5640 1 -- 172.21.15.132:0/1546953177 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f647806a430 msgr2=0x7f647806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.547+0000 7f649b6d5640 1 --2- 172.21.15.132:0/1546953177 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f647806a430 0x7f647806c8f0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f6484034000 tx=0x7f6484009030 comp rx=0 tx=0).stop 2023-12-20T04:47:51.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.547+0000 7f649b6d5640 1 -- 172.21.15.132:0/1546953177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480004370 msgr2=0x7f64940acf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.547+0000 7f649b6d5640 1 --2- 172.21.15.132:0/1546953177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480004370 0x7f64940acf40 secure :-1 s=READY pgs=1116 cs=0 l=1 rev1=1 crypto rx=0x7f6490009f00 tx=0x7f649000f580 comp rx=0 tx=0).stop 2023-12-20T04:47:51.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.547+0000 7f649b6d5640 1 -- 172.21.15.132:0/1546953177 shutdown_connections 2023-12-20T04:47:51.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.547+0000 7f649b6d5640 1 --2- 172.21.15.132:0/1546953177 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f647806a430 0x7f647806c8f0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.547+0000 7f649b6d5640 1 --2- 172.21.15.132:0/1546953177 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6494157d90 0x7f64940d0150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.547+0000 7f649b6d5640 1 --2- 172.21.15.132:0/1546953177 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f64940c3b50 0x7f64941f6410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.547+0000 7f649b6d5640 1 --2- 172.21.15.132:0/1546953177 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6480004370 0x7f64940acf40 unknown :-1 s=CLOSED pgs=1116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.547+0000 7f649b6d5640 1 -- 172.21.15.132:0/1546953177 >> 172.21.15.132:0/1546953177 conn(0x7f6494072c60 msgr2=0x7f649415f190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.547+0000 7f649b6d5640 1 -- 172.21.15.132:0/1546953177 shutdown_connections 2023-12-20T04:47:51.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.547+0000 7f649b6d5640 1 -- 172.21.15.132:0/1546953177 wait complete. 2023-12-20T04:47:51.560 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:47:51.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.660+0000 7fc8ba44a640 1 Processor -- start 2023-12-20T04:47:51.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.660+0000 7fc8ba44a640 1 -- start start 2023-12-20T04:47:51.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.661+0000 7fc8ba44a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc8b4069c30 0x7fc8b4070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.661+0000 7fc8ba44a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b40c4f40 con 0x7fc8b40cbde0 2023-12-20T04:47:51.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.661+0000 7fc8ba44a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8b40af5b0 con 0x7fc8b415d360 2023-12-20T04:47:51.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.661+0000 7fc8ba44a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8b4070a40 con 0x7fc8b4069c30 2023-12-20T04:47:51.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.661+0000 7fc8b3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc8b4069c30 0x7fc8b4070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.662+0000 7fc8b3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc8b4069c30 0x7fc8b4070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43752/0 (socket says 172.21.15.132:43752) 2023-12-20T04:47:51.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.662+0000 7fc8b3fff640 1 -- 172.21.15.132:0/1795181491 learned_addr learned my addr 172.21.15.132:0/1795181491 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:51.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.662+0000 7fc8b3fff640 1 -- 172.21.15.132:0/1795181491 >> v1:172.21.15.187:6789/0 conn(0x7fc8b415d360 legacy=0x7fc8b406a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.662+0000 7fc8b3fff640 1 -- 172.21.15.132:0/1795181491 >> v1:172.21.15.132:6789/0 conn(0x7fc8b40cbde0 legacy=0x7fc8b40ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.662+0000 7fc8b3fff640 1 -- 172.21.15.132:0/1795181491 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8b4070d20 con 0x7fc8b4069c30 2023-12-20T04:47:51.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.662+0000 7fc8b2ffd640 1 -- 172.21.15.132:0/1795181491 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 480925385 0 0) 0x7fc8b40c4f40 con 0x7fc8b40cbde0 2023-12-20T04:47:51.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.663+0000 7fc8b3fff640 1 --2- 172.21.15.132:0/1795181491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4069c30 0x7fc8b4070460 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009870 tx=0x7fc8a402ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a39b019f9cc8ed8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:51.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.663+0000 7fc8b2ffd640 1 -- 172.21.15.132:0/1795181491 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a402f840 con 0x7fc8b4069c30 2023-12-20T04:47:51.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.663+0000 7fc8b2ffd640 1 -- 172.21.15.132:0/1795181491 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a402f9a0 con 0x7fc8b4069c30 2023-12-20T04:47:51.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.663+0000 7fc8b2ffd640 1 -- 172.21.15.132:0/1795181491 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a402fd30 con 0x7fc8b4069c30 2023-12-20T04:47:51.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.663+0000 7fc8ba44a640 1 -- 172.21.15.132:0/1795181491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4069c30 msgr2=0x7fc8b4070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.663+0000 7fc8ba44a640 1 --2- 172.21.15.132:0/1795181491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4069c30 0x7fc8b4070460 secure :-1 s=READY pgs=1118 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009870 tx=0x7fc8a402ba20 comp rx=0 tx=0).stop 2023-12-20T04:47:51.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.663+0000 7fc8ba44a640 1 -- 172.21.15.132:0/1795181491 shutdown_connections 2023-12-20T04:47:51.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.663+0000 7fc8ba44a640 1 --2- 172.21.15.132:0/1795181491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4069c30 0x7fc8b4070460 unknown :-1 s=CLOSED pgs=1118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.663+0000 7fc8ba44a640 1 -- 172.21.15.132:0/1795181491 >> 172.21.15.132:0/1795181491 conn(0x7fc8b40cc630 msgr2=0x7fc8b40cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:51.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.663+0000 7fc8ba44a640 1 -- 172.21.15.132:0/1795181491 shutdown_connections 2023-12-20T04:47:51.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.663+0000 7fc8ba44a640 1 -- 172.21.15.132:0/1795181491 wait complete. 2023-12-20T04:47:51.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.664+0000 7fc8ba44a640 1 Processor -- start 2023-12-20T04:47:51.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.665+0000 7fc8ba44a640 1 -- start start 2023-12-20T04:47:51.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.665+0000 7fc8ba44a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4069c30 0x7fc8b40b37c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.665+0000 7fc8ba44a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8b40cbde0 0x7fc8b41584a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.665+0000 7fc8ba44a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8b415d360 0x7fc8b406df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.665+0000 7fc8ba44a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b41f35c0 con 0x7fc8b4069c30 2023-12-20T04:47:51.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.665+0000 7fc8ba44a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b41f26f0 con 0x7fc8b415d360 2023-12-20T04:47:51.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.665+0000 7fc8ba44a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8b40b5670 con 0x7fc8b40cbde0 2023-12-20T04:47:51.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.665+0000 7fc8b3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4069c30 0x7fc8b40b37c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.665+0000 7fc8b3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4069c30 0x7fc8b40b37c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43754/0 (socket says 172.21.15.132:43754) 2023-12-20T04:47:51.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.665+0000 7fc8b3fff640 1 -- 172.21.15.132:0/3764730639 learned_addr learned my addr 172.21.15.132:0/3764730639 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:51.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.666+0000 7fc8b37fe640 1 --2- 172.21.15.132:0/3764730639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8b40cbde0 0x7fc8b41584a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.666+0000 7fc8b89e7640 1 --2- 172.21.15.132:0/3764730639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8b415d360 0x7fc8b406df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.666+0000 7fc8b3fff640 1 -- 172.21.15.132:0/3764730639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8b40cbde0 msgr2=0x7fc8b41584a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.666+0000 7fc8b3fff640 1 --2- 172.21.15.132:0/3764730639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8b40cbde0 0x7fc8b41584a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.666+0000 7fc8b3fff640 1 -- 172.21.15.132:0/3764730639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8b415d360 msgr2=0x7fc8b406df80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.666+0000 7fc8b3fff640 1 --2- 172.21.15.132:0/3764730639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8b415d360 0x7fc8b406df80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.666+0000 7fc8b3fff640 1 -- 172.21.15.132:0/3764730639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8a40094d0 con 0x7fc8b4069c30 2023-12-20T04:47:51.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.666+0000 7fc8b89e7640 1 --2- 172.21.15.132:0/3764730639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8b415d360 0x7fc8b406df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:51.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.666+0000 7fc8b3fff640 1 --2- 172.21.15.132:0/3764730639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4069c30 0x7fc8b40b37c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009870 tx=0x7fc8a4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:51.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.666+0000 7fc8b0ff9640 1 -- 172.21.15.132:0/3764730639 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a402f7f0 con 0x7fc8b4069c30 2023-12-20T04:47:51.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.666+0000 7fc8b0ff9640 1 -- 172.21.15.132:0/3764730639 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8a4041400 con 0x7fc8b4069c30 2023-12-20T04:47:51.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.666+0000 7fc8b0ff9640 1 -- 172.21.15.132:0/3764730639 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc8a40417b0 con 0x7fc8b4069c30 2023-12-20T04:47:51.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.666+0000 7fc8ba44a640 1 -- 172.21.15.132:0/3764730639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8b41f2940 con 0x7fc8b4069c30 2023-12-20T04:47:51.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.666+0000 7fc8ba44a640 1 -- 172.21.15.132:0/3764730639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8b41f2f00 con 0x7fc8b4069c30 2023-12-20T04:47:51.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.667+0000 7fc8ba44a640 1 -- 172.21.15.132:0/3764730639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8b404e840 con 0x7fc8b4069c30 2023-12-20T04:47:51.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.667+0000 7fc8b0ff9640 1 -- 172.21.15.132:0/3764730639 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc8a4041910 con 0x7fc8b4069c30 2023-12-20T04:47:51.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.668+0000 7fc8b0ff9640 1 --2- 172.21.15.132:0/3764730639 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8a006a430 0x7fc8a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.668+0000 7fc8b37fe640 1 --2- 172.21.15.132:0/3764730639 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8a006a430 0x7fc8a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.668+0000 7fc8b0ff9640 1 -- 172.21.15.132:0/3764730639 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fc8a403c070 con 0x7fc8b4069c30 2023-12-20T04:47:51.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.668+0000 7fc8b37fe640 1 --2- 172.21.15.132:0/3764730639 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8a006a430 0x7fc8a006c8f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40ce500 tx=0x7fc8a8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:51.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.672+0000 7fc8b0ff9640 1 -- 172.21.15.132:0/3764730639 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc8a4076df0 con 0x7fc8b4069c30 2023-12-20T04:47:51.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.840+0000 7fc8ba44a640 1 -- 172.21.15.132:0/3764730639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc8b406a9a0 con 0x7fc8b4069c30 2023-12-20T04:47:51.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.840+0000 7fc8b0ff9640 1 -- 172.21.15.132:0/3764730639 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v110) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc8a407a410 con 0x7fc8b4069c30 2023-12-20T04:47:51.842 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:47:51.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.842+0000 7fc8ba44a640 1 -- 172.21.15.132:0/3764730639 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8a006a430 msgr2=0x7fc8a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.842+0000 7fc8ba44a640 1 --2- 172.21.15.132:0/3764730639 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8a006a430 0x7fc8a006c8f0 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fc8b40ce500 tx=0x7fc8a8009040 comp rx=0 tx=0).stop 2023-12-20T04:47:51.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.842+0000 7fc8ba44a640 1 -- 172.21.15.132:0/3764730639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4069c30 msgr2=0x7fc8b40b37c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.842+0000 7fc8ba44a640 1 --2- 172.21.15.132:0/3764730639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4069c30 0x7fc8b40b37c0 secure :-1 s=READY pgs=1119 cs=0 l=1 rev1=1 crypto rx=0x7fc8a4009870 tx=0x7fc8a4004730 comp rx=0 tx=0).stop 2023-12-20T04:47:51.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.842+0000 7fc8ba44a640 1 -- 172.21.15.132:0/3764730639 shutdown_connections 2023-12-20T04:47:51.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.842+0000 7fc8ba44a640 1 --2- 172.21.15.132:0/3764730639 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc8a006a430 0x7fc8a006c8f0 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.842+0000 7fc8ba44a640 1 --2- 172.21.15.132:0/3764730639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8b415d360 0x7fc8b406df80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.842+0000 7fc8ba44a640 1 --2- 172.21.15.132:0/3764730639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc8b40cbde0 0x7fc8b41584a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.842+0000 7fc8ba44a640 1 --2- 172.21.15.132:0/3764730639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc8b4069c30 0x7fc8b40b37c0 unknown :-1 s=CLOSED pgs=1119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.842+0000 7fc8ba44a640 1 -- 172.21.15.132:0/3764730639 >> 172.21.15.132:0/3764730639 conn(0x7fc8b40cc630 msgr2=0x7fc8b40ae870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:51.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.842+0000 7fc8ba44a640 1 -- 172.21.15.132:0/3764730639 shutdown_connections 2023-12-20T04:47:51.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.842+0000 7fc8ba44a640 1 -- 172.21.15.132:0/3764730639 wait complete. 2023-12-20T04:47:51.855 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:47:51.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.953+0000 7fd6c60ab640 1 Processor -- start 2023-12-20T04:47:51.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.953+0000 7fd6c60ab640 1 -- start start 2023-12-20T04:47:51.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.954+0000 7fd6c60ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6c006c240 0x7fd6c006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.954+0000 7fd6c60ab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c00ccf30 con 0x7fd6c0159b50 2023-12-20T04:47:51.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.954+0000 7fd6c60ab640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6c00ca1c0 con 0x7fd6c015e530 2023-12-20T04:47:51.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.954+0000 7fd6c60ab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6c006cc10 con 0x7fd6c006c240 2023-12-20T04:47:51.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.954+0000 7fd6bf7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd6c0159b50 0x7fd6c00c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56438/0 (socket says 172.21.15.132:56438) 2023-12-20T04:47:51.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.954+0000 7fd6bf7fe640 1 -- 172.21.15.132:0/1666864850 learned_addr learned my addr 172.21.15.132:0/1666864850 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:51.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.954+0000 7fd6bffff640 1 --2- 172.21.15.132:0/1666864850 >> v2:172.21.15.132:3300/0 conn(0x7fd6c006c240 0x7fd6c006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.955+0000 7fd6be7fc640 1 -- 172.21.15.132:0/1666864850 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 570400453 0 0) 0x7fd6c00ccf30 con 0x7fd6c0159b50 2023-12-20T04:47:51.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.955+0000 7fd6be7fc640 1 -- 172.21.15.132:0/1666864850 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd6a8003520 con 0x7fd6c0159b50 2023-12-20T04:47:51.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.955+0000 7fd6bffff640 1 -- 172.21.15.132:0/1666864850 >> v1:172.21.15.187:6789/0 conn(0x7fd6c015e530 legacy=0x7fd6c006fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.955+0000 7fd6bffff640 1 -- 172.21.15.132:0/1666864850 >> v1:172.21.15.132:6789/0 conn(0x7fd6c0159b50 legacy=0x7fd6c00c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.955+0000 7fd6be7fc640 1 -- 172.21.15.132:0/1666864850 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2926023632 0 0) 0x7fd6c00ca1c0 con 0x7fd6c015e530 2023-12-20T04:47:51.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.955+0000 7fd6bffff640 1 -- 172.21.15.132:0/1666864850 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6c00ca4a0 con 0x7fd6c006c240 2023-12-20T04:47:51.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.956+0000 7fd6bffff640 1 --2- 172.21.15.132:0/1666864850 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6c006c240 0x7fd6c006c6d0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8009dc0 tx=0x7fd6b802bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=814ba93c977b3128 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:51.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.956+0000 7fd6be7fc640 1 -- 172.21.15.132:0/1666864850 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b802ccd0 con 0x7fd6c006c240 2023-12-20T04:47:51.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.956+0000 7fd6be7fc640 1 -- 172.21.15.132:0/1666864850 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b802ce30 con 0x7fd6c006c240 2023-12-20T04:47:51.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.956+0000 7fd6be7fc640 1 -- 172.21.15.132:0/1666864850 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b8034660 con 0x7fd6c006c240 2023-12-20T04:47:51.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.956+0000 7fd6c60ab640 1 -- 172.21.15.132:0/1666864850 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6c006c240 msgr2=0x7fd6c006c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.956+0000 7fd6c60ab640 1 --2- 172.21.15.132:0/1666864850 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6c006c240 0x7fd6c006c6d0 secure :-1 s=READY pgs=1121 cs=0 l=1 rev1=1 crypto rx=0x7fd6b8009dc0 tx=0x7fd6b802bf20 comp rx=0 tx=0).stop 2023-12-20T04:47:51.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.956+0000 7fd6c60ab640 1 -- 172.21.15.132:0/1666864850 shutdown_connections 2023-12-20T04:47:51.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.956+0000 7fd6c60ab640 1 --2- 172.21.15.132:0/1666864850 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6c006c240 0x7fd6c006c6d0 unknown :-1 s=CLOSED pgs=1121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.956+0000 7fd6c60ab640 1 -- 172.21.15.132:0/1666864850 >> 172.21.15.132:0/1666864850 conn(0x7fd6c00ced10 msgr2=0x7fd6c00cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:51.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.956+0000 7fd6c60ab640 1 -- 172.21.15.132:0/1666864850 shutdown_connections 2023-12-20T04:47:51.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.956+0000 7fd6c60ab640 1 -- 172.21.15.132:0/1666864850 wait complete. 2023-12-20T04:47:51.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.958+0000 7fd6c60ab640 1 Processor -- start 2023-12-20T04:47:51.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.958+0000 7fd6c60ab640 1 -- start start 2023-12-20T04:47:51.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6c60ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6c006c240 0x7fd6c015b800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6c60ab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6c0159b50 0x7fd6c0146b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6c60ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6c015e530 0x7fd6c01553a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6c60ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c0156800 con 0x7fd6c006c240 2023-12-20T04:47:51.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6c60ab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c015bd40 con 0x7fd6c0159b50 2023-12-20T04:47:51.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6c60ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6c0155bf0 con 0x7fd6c015e530 2023-12-20T04:47:51.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6bf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6c006c240 0x7fd6c015b800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6bf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6c006c240 0x7fd6c015b800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43778/0 (socket says 172.21.15.132:43778) 2023-12-20T04:47:51.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6bf7fe640 1 -- 172.21.15.132:0/1611876483 learned_addr learned my addr 172.21.15.132:0/1611876483 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:51.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6bffff640 1 --2- 172.21.15.132:0/1611876483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6c015e530 0x7fd6c01553a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6beffd640 1 --2- 172.21.15.132:0/1611876483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6c0159b50 0x7fd6c0146b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6bf7fe640 1 -- 172.21.15.132:0/1611876483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6c015e530 msgr2=0x7fd6c01553a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6bf7fe640 1 --2- 172.21.15.132:0/1611876483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6c015e530 0x7fd6c01553a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6bf7fe640 1 -- 172.21.15.132:0/1611876483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6c0159b50 msgr2=0x7fd6c0146b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:51.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6bf7fe640 1 --2- 172.21.15.132:0/1611876483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6c0159b50 0x7fd6c0146b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:51.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6bf7fe640 1 -- 172.21.15.132:0/1611876483 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6b8009a70 con 0x7fd6c006c240 2023-12-20T04:47:51.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6bf7fe640 1 --2- 172.21.15.132:0/1611876483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6c006c240 0x7fd6c015b800 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000c430 tx=0x7fd6b000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:51.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.959+0000 7fd6a7fff640 1 -- 172.21.15.132:0/1611876483 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b0005ce0 con 0x7fd6c006c240 2023-12-20T04:47:51.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.960+0000 7fd6a7fff640 1 -- 172.21.15.132:0/1611876483 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6b0005e40 con 0x7fd6c006c240 2023-12-20T04:47:51.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.960+0000 7fd6c60ab640 1 -- 172.21.15.132:0/1611876483 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6c0155ed0 con 0x7fd6c006c240 2023-12-20T04:47:51.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.960+0000 7fd6a7fff640 1 -- 172.21.15.132:0/1611876483 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6b00072f0 con 0x7fd6c006c240 2023-12-20T04:47:51.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.960+0000 7fd6c60ab640 1 -- 172.21.15.132:0/1611876483 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6c0156490 con 0x7fd6c006c240 2023-12-20T04:47:51.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.961+0000 7fd6c60ab640 1 -- 172.21.15.132:0/1611876483 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6c004e840 con 0x7fd6c006c240 2023-12-20T04:47:51.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.961+0000 7fd6a7fff640 1 -- 172.21.15.132:0/1611876483 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd6b0007450 con 0x7fd6c006c240 2023-12-20T04:47:51.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.961+0000 7fd6a7fff640 1 --2- 172.21.15.132:0/1611876483 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6ac06a430 0x7fd6ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:51.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.961+0000 7fd6a7fff640 1 -- 172.21.15.132:0/1611876483 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fd6b0087fc0 con 0x7fd6c006c240 2023-12-20T04:47:51.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.961+0000 7fd6beffd640 1 --2- 172.21.15.132:0/1611876483 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6ac06a430 0x7fd6ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:51.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.962+0000 7fd6beffd640 1 --2- 172.21.15.132:0/1611876483 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6ac06a430 0x7fd6ac06c8f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd6c00c5eb0 tx=0x7fd6b4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:51.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:51.966+0000 7fd6a7fff640 1 -- 172.21.15.132:0/1611876483 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd6b00baca0 con 0x7fd6c006c240 2023-12-20T04:47:52.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.167+0000 7fd6c60ab640 1 -- 172.21.15.132:0/1611876483 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd6c00b4c90 con 0x7fd6c006c240 2023-12-20T04:47:52.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.168+0000 7fd6a7fff640 1 -- 172.21.15.132:0/1611876483 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fd6b0017070 con 0x7fd6c006c240 2023-12-20T04:47:52.170 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:52.170 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6939,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2115867433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2115867433},{"type":"v1","addr":"172.21.15.132:6837","nonce":2115867433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6942,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/162444556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":162444556},{"type":"v1","addr":"172.21.15.132:6836","nonce":162444556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2089611890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2089611890},{"type":"v1","addr":"172.21.15.187:6835","nonce":2089611890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:47:12.299623+0000","modified":"2023-12-20T04:47:14.308466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6957},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6957":{"gid":6957,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/786513656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":786513656},{"type":"v1","addr":"172.21.15.187:6834","nonce":786513656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-20T04:47:52.170 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 38 2023-12-20T04:47:52.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.170+0000 7fd6c60ab640 1 -- 172.21.15.132:0/1611876483 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6ac06a430 msgr2=0x7fd6ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:52.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.170+0000 7fd6c60ab640 1 --2- 172.21.15.132:0/1611876483 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6ac06a430 0x7fd6ac06c8f0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fd6c00c5eb0 tx=0x7fd6b4009040 comp rx=0 tx=0).stop 2023-12-20T04:47:52.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.170+0000 7fd6c60ab640 1 -- 172.21.15.132:0/1611876483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6c006c240 msgr2=0x7fd6c015b800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:52.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.170+0000 7fd6c60ab640 1 --2- 172.21.15.132:0/1611876483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6c006c240 0x7fd6c015b800 secure :-1 s=READY pgs=1122 cs=0 l=1 rev1=1 crypto rx=0x7fd6b000c430 tx=0x7fd6b000c8f0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.170+0000 7fd6c60ab640 1 -- 172.21.15.132:0/1611876483 shutdown_connections 2023-12-20T04:47:52.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.170+0000 7fd6c60ab640 1 --2- 172.21.15.132:0/1611876483 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6ac06a430 0x7fd6ac06c8f0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.170+0000 7fd6c60ab640 1 --2- 172.21.15.132:0/1611876483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6c015e530 0x7fd6c01553a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.170+0000 7fd6c60ab640 1 --2- 172.21.15.132:0/1611876483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6c0159b50 0x7fd6c0146b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.170+0000 7fd6c60ab640 1 --2- 172.21.15.132:0/1611876483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6c006c240 0x7fd6c015b800 unknown :-1 s=CLOSED pgs=1122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.170+0000 7fd6c60ab640 1 -- 172.21.15.132:0/1611876483 >> 172.21.15.132:0/1611876483 conn(0x7fd6c00ced10 msgr2=0x7fd6c006b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:52.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.170+0000 7fd6c60ab640 1 -- 172.21.15.132:0/1611876483 shutdown_connections 2023-12-20T04:47:52.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.170+0000 7fd6c60ab640 1 -- 172.21.15.132:0/1611876483 wait complete. 2023-12-20T04:47:52.183 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:47:52.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.281+0000 7f575de69640 1 Processor -- start 2023-12-20T04:47:52.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.281+0000 7f575de69640 1 -- start start 2023-12-20T04:47:52.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.282+0000 7f575de69640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f575815d110 0x7f5758069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.282+0000 7f575de69640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57580af210 0x7f575806a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.282+0000 7f575de69640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5758161ce0 con 0x7f575815d4f0 2023-12-20T04:47:52.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.282+0000 7f575de69640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57580aca50 con 0x7f575815d110 2023-12-20T04:47:52.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.282+0000 7f575de69640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5758160df0 con 0x7f57580af210 2023-12-20T04:47:52.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.282+0000 7f57577fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f575815d110 0x7f5758069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:52.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.282+0000 7f57577fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f575815d110 0x7f5758069de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43788/0 (socket says 172.21.15.132:43788) 2023-12-20T04:47:52.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.282+0000 7f57577fe640 1 -- 172.21.15.132:0/2833975561 learned_addr learned my addr 172.21.15.132:0/2833975561 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:52.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.282+0000 7f5757fff640 1 --2- 172.21.15.132:0/2833975561 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57580af210 0x7f575806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:52.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.282+0000 7f57577fe640 1 -- 172.21.15.132:0/2833975561 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57580af210 msgr2=0x7f575806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:52.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.282+0000 7f57577fe640 1 --2- 172.21.15.132:0/2833975561 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57580af210 0x7f575806a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.282+0000 7f57577fe640 1 -- 172.21.15.132:0/2833975561 >> v1:172.21.15.187:6789/0 conn(0x7f575815d4f0 legacy=0x7f57580aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:52.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.282+0000 7f57577fe640 1 -- 172.21.15.132:0/2833975561 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57581610d0 con 0x7f575815d110 2023-12-20T04:47:52.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.283+0000 7f57577fe640 1 --2- 172.21.15.132:0/2833975561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f575815d110 0x7f5758069de0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5748009850 tx=0x7f574802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e02f67810faf6b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:52.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.283+0000 7f57567fc640 1 -- 172.21.15.132:0/2833975561 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748004230 con 0x7f575815d110 2023-12-20T04:47:52.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.283+0000 7f57567fc640 1 -- 172.21.15.132:0/2833975561 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5748004390 con 0x7f575815d110 2023-12-20T04:47:52.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.283+0000 7f57567fc640 1 -- 172.21.15.132:0/2833975561 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748031830 con 0x7f575815d110 2023-12-20T04:47:52.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.284+0000 7f575de69640 1 -- 172.21.15.132:0/2833975561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f575815d110 msgr2=0x7f5758069de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:52.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.284+0000 7f575de69640 1 --2- 172.21.15.132:0/2833975561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f575815d110 0x7f5758069de0 secure :-1 s=READY pgs=1123 cs=0 l=1 rev1=1 crypto rx=0x7f5748009850 tx=0x7f574802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.284+0000 7f575de69640 1 -- 172.21.15.132:0/2833975561 shutdown_connections 2023-12-20T04:47:52.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.284+0000 7f575de69640 1 --2- 172.21.15.132:0/2833975561 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57580af210 0x7f575806a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.284+0000 7f575de69640 1 --2- 172.21.15.132:0/2833975561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f575815d110 0x7f5758069de0 unknown :-1 s=CLOSED pgs=1123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.284+0000 7f575de69640 1 -- 172.21.15.132:0/2833975561 >> 172.21.15.132:0/2833975561 conn(0x7f57580cfbd0 msgr2=0x7f57580cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:52.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.284+0000 7f575de69640 1 -- 172.21.15.132:0/2833975561 shutdown_connections 2023-12-20T04:47:52.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.284+0000 7f575de69640 1 -- 172.21.15.132:0/2833975561 wait complete. 2023-12-20T04:47:52.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.285+0000 7f575de69640 1 Processor -- start 2023-12-20T04:47:52.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.285+0000 7f575de69640 1 -- start start 2023-12-20T04:47:52.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.286+0000 7f575de69640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57580af210 0x7f57580b0d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.286+0000 7f575de69640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f575815d110 0x7f57580c5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.286+0000 7f575de69640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f575815d4f0 0x7f57580c5860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.286+0000 7f575de69640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57581f7000 con 0x7f57580af210 2023-12-20T04:47:52.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.286+0000 7f575de69640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57581f6380 con 0x7f575815d110 2023-12-20T04:47:52.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.286+0000 7f575de69640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57581f6660 con 0x7f575815d4f0 2023-12-20T04:47:52.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.286+0000 7f57577fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57580af210 0x7f57580b0d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:52.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.286+0000 7f57577fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57580af210 0x7f57580b0d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43800/0 (socket says 172.21.15.132:43800) 2023-12-20T04:47:52.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.286+0000 7f57577fe640 1 -- 172.21.15.132:0/3951012903 learned_addr learned my addr 172.21.15.132:0/3951012903 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:52.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.286+0000 7f57577fe640 1 -- 172.21.15.132:0/3951012903 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f575815d4f0 msgr2=0x7f57580c5860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:52.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.286+0000 7f57577fe640 1 --2- 172.21.15.132:0/3951012903 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f575815d4f0 0x7f57580c5860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.286+0000 7f57577fe640 1 -- 172.21.15.132:0/3951012903 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f575815d110 msgr2=0x7f57580c5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:52.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.286+0000 7f57577fe640 1 --2- 172.21.15.132:0/3951012903 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f575815d110 0x7f57580c5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.286+0000 7f57577fe640 1 -- 172.21.15.132:0/3951012903 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5748009460 con 0x7f57580af210 2023-12-20T04:47:52.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.286+0000 7f57577fe640 1 --2- 172.21.15.132:0/3951012903 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57580af210 0x7f57580b0d90 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f5748000c00 tx=0x7f57480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:52.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.287+0000 7f573ffff640 1 -- 172.21.15.132:0/3951012903 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748031830 con 0x7f57580af210 2023-12-20T04:47:52.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.287+0000 7f573ffff640 1 -- 172.21.15.132:0/3951012903 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f574803f070 con 0x7f57580af210 2023-12-20T04:47:52.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.287+0000 7f575de69640 1 -- 172.21.15.132:0/3951012903 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57581f6940 con 0x7f57580af210 2023-12-20T04:47:52.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.287+0000 7f573ffff640 1 -- 172.21.15.132:0/3951012903 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5748031bb0 con 0x7f57580af210 2023-12-20T04:47:52.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.287+0000 7f575de69640 1 -- 172.21.15.132:0/3951012903 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57580b12d0 con 0x7f57580af210 2023-12-20T04:47:52.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.288+0000 7f575de69640 1 -- 172.21.15.132:0/3951012903 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f57581f7140 con 0x7f57580af210 2023-12-20T04:47:52.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.288+0000 7f573ffff640 1 -- 172.21.15.132:0/3951012903 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5748041030 con 0x7f57580af210 2023-12-20T04:47:52.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.288+0000 7f573ffff640 1 --2- 172.21.15.132:0/3951012903 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f574406a430 0x7f574406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.288+0000 7f573ffff640 1 -- 172.21.15.132:0/3951012903 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f57480aaad0 con 0x7f57580af210 2023-12-20T04:47:52.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.288+0000 7f5756ffd640 1 --2- 172.21.15.132:0/3951012903 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f574406a430 0x7f574406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:52.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.289+0000 7f5756ffd640 1 --2- 172.21.15.132:0/3951012903 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f574406a430 0x7f574406c8f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5758160360 tx=0x7f574c007990 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:52.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.293+0000 7f573ffff640 1 -- 172.21.15.132:0/3951012903 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f57581f7140 con 0x7f57580af210 2023-12-20T04:47:52.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.464+0000 7f575de69640 1 -- 172.21.15.132:0/3951012903 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f57581f7140 con 0x7f57580af210 2023-12-20T04:47:52.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.465+0000 7f573ffff640 1 -- 172.21.15.132:0/3951012903 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16244 (secure 0 0 0) 0x7f57581f7140 con 0x7f57580af210 2023-12-20T04:47:52.467 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:52.467 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":110,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:47:40.970633+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:47:10.649946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-20T04:47:11.271933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1c","mappings":[{"from":6,"to":3}]},{"pgid":"13.23","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:47:52.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.467+0000 7f575de69640 1 -- 172.21.15.132:0/3951012903 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f574406a430 msgr2=0x7f574406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:52.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.467+0000 7f575de69640 1 --2- 172.21.15.132:0/3951012903 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f574406a430 0x7f574406c8f0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7f5758160360 tx=0x7f574c007990 comp rx=0 tx=0).stop 2023-12-20T04:47:52.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.467+0000 7f575de69640 1 -- 172.21.15.132:0/3951012903 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57580af210 msgr2=0x7f57580b0d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:52.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.467+0000 7f575de69640 1 --2- 172.21.15.132:0/3951012903 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57580af210 0x7f57580b0d90 secure :-1 s=READY pgs=1124 cs=0 l=1 rev1=1 crypto rx=0x7f5748000c00 tx=0x7f57480046c0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.467+0000 7f575de69640 1 -- 172.21.15.132:0/3951012903 shutdown_connections 2023-12-20T04:47:52.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.467+0000 7f575de69640 1 --2- 172.21.15.132:0/3951012903 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f574406a430 0x7f574406c8f0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.467+0000 7f575de69640 1 --2- 172.21.15.132:0/3951012903 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f575815d4f0 0x7f57580c5860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.467+0000 7f575de69640 1 --2- 172.21.15.132:0/3951012903 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f575815d110 0x7f57580c5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.467+0000 7f575de69640 1 --2- 172.21.15.132:0/3951012903 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57580af210 0x7f57580b0d90 unknown :-1 s=CLOSED pgs=1124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.467+0000 7f575de69640 1 -- 172.21.15.132:0/3951012903 >> 172.21.15.132:0/3951012903 conn(0x7f57580cfbd0 msgr2=0x7f57580ca400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:52.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.467+0000 7f575de69640 1 -- 172.21.15.132:0/3951012903 shutdown_connections 2023-12-20T04:47:52.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.467+0000 7f575de69640 1 -- 172.21.15.132:0/3951012903 wait complete. 2023-12-20T04:47:52.480 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-20T04:47:52.480 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:47:52.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.578+0000 7fece54fb640 1 Processor -- start 2023-12-20T04:47:52.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.578+0000 7fece54fb640 1 -- start start 2023-12-20T04:47:52.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.579+0000 7fece54fb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fece0160450 0x7fece0160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.579+0000 7fece54fb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fece00b5090 0x7fece00d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.579+0000 7fece54fb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fece00b5ec0 con 0x7fece01611b0 2023-12-20T04:47:52.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.579+0000 7fece54fb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece01617e0 con 0x7fece0160450 2023-12-20T04:47:52.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.579+0000 7fece54fb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fece00d0fc0 con 0x7fece00b5090 2023-12-20T04:47:52.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.579+0000 7fecdeffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fece0160450 0x7fece0160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:52.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.579+0000 7fecdeffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fece0160450 0x7fece0160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43806/0 (socket says 172.21.15.132:43806) 2023-12-20T04:47:52.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.579+0000 7fecdeffd640 1 -- 172.21.15.132:0/664571574 learned_addr learned my addr 172.21.15.132:0/664571574 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:52.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.579+0000 7fecdeffd640 1 -- 172.21.15.132:0/664571574 >> v2:172.21.15.187:3300/0 conn(0x7fece00b5090 msgr2=0x7fece00d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:52.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.579+0000 7fecdeffd640 1 --2- 172.21.15.132:0/664571574 >> v2:172.21.15.187:3300/0 conn(0x7fece00b5090 0x7fece00d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.579+0000 7fecdeffd640 1 -- 172.21.15.132:0/664571574 >> v1:172.21.15.187:6789/0 conn(0x7fece01611b0 legacy=0x7fece00b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:52.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.579+0000 7fecdeffd640 1 -- 172.21.15.132:0/664571574 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fece00d12a0 con 0x7fece0160450 2023-12-20T04:47:52.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.580+0000 7fecdeffd640 1 --2- 172.21.15.132:0/664571574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fece0160450 0x7fece0160c70 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fece0073c40 tx=0x7fecd002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66f5637354d44a18 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:52.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.580+0000 7fecddffb640 1 -- 172.21.15.132:0/664571574 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0030860 con 0x7fece0160450 2023-12-20T04:47:52.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.580+0000 7fecddffb640 1 -- 172.21.15.132:0/664571574 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd00309c0 con 0x7fece0160450 2023-12-20T04:47:52.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.580+0000 7fecddffb640 1 -- 172.21.15.132:0/664571574 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd0030d50 con 0x7fece0160450 2023-12-20T04:47:52.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.581+0000 7fece54fb640 1 -- 172.21.15.132:0/664571574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fece0160450 msgr2=0x7fece0160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:52.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.581+0000 7fece54fb640 1 --2- 172.21.15.132:0/664571574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fece0160450 0x7fece0160c70 secure :-1 s=READY pgs=1125 cs=0 l=1 rev1=1 crypto rx=0x7fece0073c40 tx=0x7fecd002b9a0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.581+0000 7fece54fb640 1 -- 172.21.15.132:0/664571574 shutdown_connections 2023-12-20T04:47:52.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.581+0000 7fece54fb640 1 --2- 172.21.15.132:0/664571574 >> v2:172.21.15.187:3300/0 conn(0x7fece00b5090 0x7fece00d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.581+0000 7fece54fb640 1 --2- 172.21.15.132:0/664571574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fece0160450 0x7fece0160c70 unknown :-1 s=CLOSED pgs=1125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.581+0000 7fece54fb640 1 -- 172.21.15.132:0/664571574 >> 172.21.15.132:0/664571574 conn(0x7fece00cf980 msgr2=0x7fece00cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:52.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.581+0000 7fece54fb640 1 -- 172.21.15.132:0/664571574 shutdown_connections 2023-12-20T04:47:52.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.581+0000 7fece54fb640 1 -- 172.21.15.132:0/664571574 wait complete. 2023-12-20T04:47:52.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.582+0000 7fece54fb640 1 Processor -- start 2023-12-20T04:47:52.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.582+0000 7fece54fb640 1 -- start start 2023-12-20T04:47:52.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fece54fb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fece00b5090 0x7fece01f6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fece54fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fece0160450 0x7fece01f2c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fece54fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fece01611b0 0x7fece015e750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fece54fb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece015c160 con 0x7fece0160450 2023-12-20T04:47:52.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fece54fb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fece015c440 con 0x7fece00b5090 2023-12-20T04:47:52.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fece54fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fece015c720 con 0x7fece01611b0 2023-12-20T04:47:52.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fecde7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fece0160450 0x7fece01f2c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:52.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fecde7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fece0160450 0x7fece01f2c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43818/0 (socket says 172.21.15.132:43818) 2023-12-20T04:47:52.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fecde7fc640 1 -- 172.21.15.132:0/1024569854 learned_addr learned my addr 172.21.15.132:0/1024569854 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:52.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fecdeffd640 1 --2- 172.21.15.132:0/1024569854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fece00b5090 0x7fece01f6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:52.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fecdf7fe640 1 --2- 172.21.15.132:0/1024569854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fece01611b0 0x7fece015e750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:52.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fecde7fc640 1 -- 172.21.15.132:0/1024569854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fece01611b0 msgr2=0x7fece015e750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:52.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fecde7fc640 1 --2- 172.21.15.132:0/1024569854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fece01611b0 0x7fece015e750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fecde7fc640 1 -- 172.21.15.132:0/1024569854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fece00b5090 msgr2=0x7fece01f6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:52.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fecde7fc640 1 --2- 172.21.15.132:0/1024569854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fece00b5090 0x7fece01f6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fecde7fc640 1 -- 172.21.15.132:0/1024569854 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fecd00094d0 con 0x7fece0160450 2023-12-20T04:47:52.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fecdf7fe640 1 --2- 172.21.15.132:0/1024569854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fece01611b0 0x7fece015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:52.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fecdeffd640 1 --2- 172.21.15.132:0/1024569854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fece00b5090 0x7fece01f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:52.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fecde7fc640 1 --2- 172.21.15.132:0/1024569854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fece0160450 0x7fece01f2c70 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fecd400b3e0 tx=0x7fecd400b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:52.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fecc77fe640 1 -- 172.21.15.132:0/1024569854 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4011830 con 0x7fece0160450 2023-12-20T04:47:52.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fecc77fe640 1 -- 172.21.15.132:0/1024569854 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fecd40119b0 con 0x7fece0160450 2023-12-20T04:47:52.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fecc77fe640 1 -- 172.21.15.132:0/1024569854 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fecd4011d60 con 0x7fece0160450 2023-12-20T04:47:52.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fece54fb640 1 -- 172.21.15.132:0/1024569854 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fece015ca00 con 0x7fece0160450 2023-12-20T04:47:52.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.583+0000 7fece54fb640 1 -- 172.21.15.132:0/1024569854 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fece01f7060 con 0x7fece0160450 2023-12-20T04:47:52.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.584+0000 7fece54fb640 1 -- 172.21.15.132:0/1024569854 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fece015cf20 con 0x7fece0160450 2023-12-20T04:47:52.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.585+0000 7fecc77fe640 1 -- 172.21.15.132:0/1024569854 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fecd401a400 con 0x7fece0160450 2023-12-20T04:47:52.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.585+0000 7fecc77fe640 1 --2- 172.21.15.132:0/1024569854 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feccc06a430 0x7feccc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.585+0000 7fecc77fe640 1 -- 172.21.15.132:0/1024569854 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fecd4088a50 con 0x7fece0160450 2023-12-20T04:47:52.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.585+0000 7fecdeffd640 1 --2- 172.21.15.132:0/1024569854 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feccc06a430 0x7feccc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:52.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.586+0000 7fecdeffd640 1 --2- 172.21.15.132:0/1024569854 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feccc06a430 0x7feccc06c8f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fecd0036000 tx=0x7fecd003b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:52.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.589+0000 7fecc77fe640 1 -- 172.21.15.132:0/1024569854 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fece015cf20 con 0x7fece0160450 2023-12-20T04:47:52.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.790+0000 7fece54fb640 1 -- 172.21.15.132:0/1024569854 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fece015cf20 con 0x7fece0160450 2023-12-20T04:47:52.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.790+0000 7fecc77fe640 1 -- 172.21.15.132:0/1024569854 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fece015cf20 con 0x7fece0160450 2023-12-20T04:47:52.792 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:52.792 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6939,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2115867433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2115867433},{"type":"v1","addr":"172.21.15.132:6837","nonce":2115867433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6942,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/162444556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":162444556},{"type":"v1","addr":"172.21.15.132:6836","nonce":162444556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2089611890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2089611890},{"type":"v1","addr":"172.21.15.187:6835","nonce":2089611890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:47:12.299623+0000","modified":"2023-12-20T04:47:14.308466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6957},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6957":{"gid":6957,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/786513656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":786513656},{"type":"v1","addr":"172.21.15.187:6834","nonce":786513656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-20T04:47:52.793 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 38 2023-12-20T04:47:52.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.792+0000 7fece54fb640 1 -- 172.21.15.132:0/1024569854 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feccc06a430 msgr2=0x7feccc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:52.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.792+0000 7fece54fb640 1 --2- 172.21.15.132:0/1024569854 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feccc06a430 0x7feccc06c8f0 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fecd0036000 tx=0x7fecd003b040 comp rx=0 tx=0).stop 2023-12-20T04:47:52.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.792+0000 7fece54fb640 1 -- 172.21.15.132:0/1024569854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fece0160450 msgr2=0x7fece01f2c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:52.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.792+0000 7fece54fb640 1 --2- 172.21.15.132:0/1024569854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fece0160450 0x7fece01f2c70 secure :-1 s=READY pgs=1126 cs=0 l=1 rev1=1 crypto rx=0x7fecd400b3e0 tx=0x7fecd400b8a0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.792+0000 7fece54fb640 1 -- 172.21.15.132:0/1024569854 shutdown_connections 2023-12-20T04:47:52.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.792+0000 7fece54fb640 1 --2- 172.21.15.132:0/1024569854 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feccc06a430 0x7feccc06c8f0 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.792+0000 7fece54fb640 1 --2- 172.21.15.132:0/1024569854 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fece01611b0 0x7fece015e750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.792+0000 7fece54fb640 1 --2- 172.21.15.132:0/1024569854 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fece0160450 0x7fece01f2c70 unknown :-1 s=CLOSED pgs=1126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.792+0000 7fece54fb640 1 --2- 172.21.15.132:0/1024569854 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fece00b5090 0x7fece01f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.792+0000 7fece54fb640 1 -- 172.21.15.132:0/1024569854 >> 172.21.15.132:0/1024569854 conn(0x7fece00cf980 msgr2=0x7fece00659f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:52.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.792+0000 7fece54fb640 1 -- 172.21.15.132:0/1024569854 shutdown_connections 2023-12-20T04:47:52.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.792+0000 7fece54fb640 1 -- 172.21.15.132:0/1024569854 wait complete. 2023-12-20T04:47:52.805 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:47:52.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.903+0000 7fb563f2a640 1 Processor -- start 2023-12-20T04:47:52.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.903+0000 7fb563f2a640 1 -- start start 2023-12-20T04:47:52.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.904+0000 7fb563f2a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0cf0b0 0x7fb55c0b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.904+0000 7fb563f2a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb55c0cb420 0x7fb55c0d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.904+0000 7fb563f2a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb55c0cd740 con 0x7fb55c15e2d0 2023-12-20T04:47:52.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.904+0000 7fb563f2a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb55c0ce230 con 0x7fb55c0cb420 2023-12-20T04:47:52.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.904+0000 7fb563f2a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0cd990 con 0x7fb55c0cf0b0 2023-12-20T04:47:52.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.904+0000 7fb5614c5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0cf0b0 0x7fb55c0b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:52.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.904+0000 7fb5624c7640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb55c0cb420 0x7fb55c0d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:52.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.904+0000 7fb5614c5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0cf0b0 0x7fb55c0b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:56256/0 (socket says 172.21.15.132:56256) 2023-12-20T04:47:52.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.904+0000 7fb5614c5640 1 -- 172.21.15.132:0/2362796487 learned_addr learned my addr 172.21.15.132:0/2362796487 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:52.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.904+0000 7fb5614c5640 1 -- 172.21.15.132:0/2362796487 >> v2:172.21.15.187:3300/0 conn(0x7fb55c0cb420 msgr2=0x7fb55c0d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:52.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.905+0000 7fb5614c5640 1 --2- 172.21.15.132:0/2362796487 >> v2:172.21.15.187:3300/0 conn(0x7fb55c0cb420 0x7fb55c0d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.905+0000 7fb5614c5640 1 -- 172.21.15.132:0/2362796487 >> v1:172.21.15.187:6789/0 conn(0x7fb55c15e2d0 legacy=0x7fb55c0ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:52.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.905+0000 7fb5614c5640 1 -- 172.21.15.132:0/2362796487 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb55c0cdc70 con 0x7fb55c0cf0b0 2023-12-20T04:47:52.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.905+0000 7fb5614c5640 1 --2- 172.21.15.132:0/2362796487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0cf0b0 0x7fb55c0b3330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009870 tx=0x7fb54c02b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c8fd241a22a91c2b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:52.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.905+0000 7fb560cc4640 1 -- 172.21.15.132:0/2362796487 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c031640 con 0x7fb55c0cf0b0 2023-12-20T04:47:52.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.906+0000 7fb560cc4640 1 -- 172.21.15.132:0/2362796487 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54c0317a0 con 0x7fb55c0cf0b0 2023-12-20T04:47:52.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.906+0000 7fb560cc4640 1 -- 172.21.15.132:0/2362796487 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54c031b30 con 0x7fb55c0cf0b0 2023-12-20T04:47:52.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.906+0000 7fb563f2a640 1 -- 172.21.15.132:0/2362796487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0cf0b0 msgr2=0x7fb55c0b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:52.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.906+0000 7fb563f2a640 1 --2- 172.21.15.132:0/2362796487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0cf0b0 0x7fb55c0b3330 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7fb54c009870 tx=0x7fb54c02b8f0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.906+0000 7fb563f2a640 1 -- 172.21.15.132:0/2362796487 shutdown_connections 2023-12-20T04:47:52.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.906+0000 7fb563f2a640 1 --2- 172.21.15.132:0/2362796487 >> v2:172.21.15.187:3300/0 conn(0x7fb55c0cb420 0x7fb55c0d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.906+0000 7fb563f2a640 1 --2- 172.21.15.132:0/2362796487 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0cf0b0 0x7fb55c0b3330 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.906+0000 7fb563f2a640 1 -- 172.21.15.132:0/2362796487 >> 172.21.15.132:0/2362796487 conn(0x7fb55c06d7c0 msgr2=0x7fb55c06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:52.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.906+0000 7fb563f2a640 1 -- 172.21.15.132:0/2362796487 shutdown_connections 2023-12-20T04:47:52.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.906+0000 7fb563f2a640 1 -- 172.21.15.132:0/2362796487 wait complete. 2023-12-20T04:47:52.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.907+0000 7fb563f2a640 1 Processor -- start 2023-12-20T04:47:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.907+0000 7fb563f2a640 1 -- start start 2023-12-20T04:47:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.908+0000 7fb563f2a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0cb420 0x7fb55c0c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.908+0000 7fb563f2a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55c0cf0b0 0x7fb55c15e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.908+0000 7fb563f2a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb55c15e2d0 0x7fb55c15ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.908+0000 7fb563f2a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0ca480 con 0x7fb55c15e2d0 2023-12-20T04:47:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.908+0000 7fb563f2a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0c5f60 con 0x7fb55c0cf0b0 2023-12-20T04:47:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.908+0000 7fb563f2a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55c0c6240 con 0x7fb55c0cb420 2023-12-20T04:47:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.908+0000 7fb5624c7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb55c15e2d0 0x7fb55c15ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.908+0000 7fb5624c7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb55c15e2d0 0x7fb55c15ee50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43824/0 (socket says 172.21.15.132:43824) 2023-12-20T04:47:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.908+0000 7fb5624c7640 1 -- 172.21.15.132:0/3284080382 learned_addr learned my addr 172.21.15.132:0/3284080382 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.908+0000 7fb561cc6640 1 --2- 172.21.15.132:0/3284080382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0cb420 0x7fb55c0c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.908+0000 7fb5614c5640 1 --2- 172.21.15.132:0/3284080382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55c0cf0b0 0x7fb55c15e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.909+0000 7fb5624c7640 1 -- 172.21.15.132:0/3284080382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0cb420 msgr2=0x7fb55c0c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:52.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.909+0000 7fb5624c7640 1 --2- 172.21.15.132:0/3284080382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0cb420 0x7fb55c0c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.909+0000 7fb5624c7640 1 -- 172.21.15.132:0/3284080382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55c0cf0b0 msgr2=0x7fb55c15e910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:52.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.909+0000 7fb5624c7640 1 --2- 172.21.15.132:0/3284080382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55c0cf0b0 0x7fb55c15e910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:52.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.909+0000 7fb5624c7640 1 -- 172.21.15.132:0/3284080382 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb54c0094d0 con 0x7fb55c15e2d0 2023-12-20T04:47:52.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.909+0000 7fb5624c7640 1 --2- 172.21.15.132:0/3284080382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb55c15e2d0 0x7fb55c15ee50 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fb55400efc0 tx=0x7fb55400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:52.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.909+0000 7fb5527fc640 1 -- 172.21.15.132:0/3284080382 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554014480 con 0x7fb55c15e2d0 2023-12-20T04:47:52.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.909+0000 7fb5527fc640 1 -- 172.21.15.132:0/3284080382 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55400f040 con 0x7fb55c15e2d0 2023-12-20T04:47:52.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.909+0000 7fb563f2a640 1 -- 172.21.15.132:0/3284080382 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55c0c6520 con 0x7fb55c15e2d0 2023-12-20T04:47:52.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.909+0000 7fb5527fc640 1 -- 172.21.15.132:0/3284080382 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb554014820 con 0x7fb55c15e2d0 2023-12-20T04:47:52.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.909+0000 7fb563f2a640 1 -- 172.21.15.132:0/3284080382 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55c0c6ae0 con 0x7fb55c15e2d0 2023-12-20T04:47:52.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.910+0000 7fb563f2a640 1 -- 172.21.15.132:0/3284080382 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55c0c6cd0 con 0x7fb55c15e2d0 2023-12-20T04:47:52.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.910+0000 7fb5527fc640 1 -- 172.21.15.132:0/3284080382 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb554014980 con 0x7fb55c15e2d0 2023-12-20T04:47:52.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.911+0000 7fb5527fc640 1 --2- 172.21.15.132:0/3284080382 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb54006a430 0x7fb54006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:52.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.911+0000 7fb5527fc640 1 -- 172.21.15.132:0/3284080382 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb554089400 con 0x7fb55c15e2d0 2023-12-20T04:47:52.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.911+0000 7fb561cc6640 1 --2- 172.21.15.132:0/3284080382 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb54006a430 0x7fb54006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:52.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.911+0000 7fb561cc6640 1 --2- 172.21.15.132:0/3284080382 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb54006a430 0x7fb54006c8f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb558000f60 tx=0x7fb558009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:52.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:52.915+0000 7fb5527fc640 1 -- 172.21.15.132:0/3284080382 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb554054a70 con 0x7fb55c15e2d0 2023-12-20T04:47:53.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.118+0000 7fb563f2a640 1 -- 172.21.15.132:0/3284080382 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb55c04e840 con 0x7fb55c15e2d0 2023-12-20T04:47:53.121 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.118+0000 7fb5527fc640 1 -- 172.21.15.132:0/3284080382 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 38 v38) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fb554058090 con 0x7fb55c15e2d0 2023-12-20T04:47:53.121 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:53.121 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":38,"default_fscid":6,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6939,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2115867433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2115867433},{"type":"v1","addr":"172.21.15.132:6837","nonce":2115867433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6942,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/162444556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":162444556},{"type":"v1","addr":"172.21.15.132:6836","nonce":162444556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2089611890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2089611890},{"type":"v1","addr":"172.21.15.187:6835","nonce":2089611890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[{"mdsmap":{"epoch":38,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:47:12.299623+0000","modified":"2023-12-20T04:47:14.308466+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":6957},"failed":[],"damaged":[],"stopped":[],"info":{"gid_6957":{"gid":6957,"name":"b","rank":0,"incarnation":36,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6834/786513656","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":786513656},{"type":"v1","addr":"172.21.15.187:6834","nonce":786513656}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[13],"metadata_pool":12,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":6}]} 2023-12-20T04:47:53.122 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 38 2023-12-20T04:47:53.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.120+0000 7fb563f2a640 1 -- 172.21.15.132:0/3284080382 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb54006a430 msgr2=0x7fb54006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.120+0000 7fb563f2a640 1 --2- 172.21.15.132:0/3284080382 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb54006a430 0x7fb54006c8f0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb558000f60 tx=0x7fb558009040 comp rx=0 tx=0).stop 2023-12-20T04:47:53.122 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.120+0000 7fb563f2a640 1 -- 172.21.15.132:0/3284080382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb55c15e2d0 msgr2=0x7fb55c15ee50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.120+0000 7fb563f2a640 1 --2- 172.21.15.132:0/3284080382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb55c15e2d0 0x7fb55c15ee50 secure :-1 s=READY pgs=1127 cs=0 l=1 rev1=1 crypto rx=0x7fb55400efc0 tx=0x7fb55400c490 comp rx=0 tx=0).stop 2023-12-20T04:47:53.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.120+0000 7fb563f2a640 1 -- 172.21.15.132:0/3284080382 shutdown_connections 2023-12-20T04:47:53.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.120+0000 7fb563f2a640 1 --2- 172.21.15.132:0/3284080382 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb54006a430 0x7fb54006c8f0 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.120+0000 7fb563f2a640 1 --2- 172.21.15.132:0/3284080382 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb55c15e2d0 0x7fb55c15ee50 unknown :-1 s=CLOSED pgs=1127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.120+0000 7fb563f2a640 1 --2- 172.21.15.132:0/3284080382 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55c0cf0b0 0x7fb55c15e910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.120+0000 7fb563f2a640 1 --2- 172.21.15.132:0/3284080382 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55c0cb420 0x7fb55c0c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.120+0000 7fb563f2a640 1 -- 172.21.15.132:0/3284080382 >> 172.21.15.132:0/3284080382 conn(0x7fb55c06d7c0 msgr2=0x7fb55c0ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:53.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.120+0000 7fb563f2a640 1 -- 172.21.15.132:0/3284080382 shutdown_connections 2023-12-20T04:47:53.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.120+0000 7fb563f2a640 1 -- 172.21.15.132:0/3284080382 wait complete. 2023-12-20T04:47:53.133 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:47:53.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.230+0000 7f0647cbd640 1 Processor -- start 2023-12-20T04:47:53.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.230+0000 7f0647cbd640 1 -- start start 2023-12-20T04:47:53.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.231+0000 7f0647cbd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f064006c240 0x7f064006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:53.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.231+0000 7f0647cbd640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06400ccf30 con 0x7f064015e530 2023-12-20T04:47:53.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.231+0000 7f0647cbd640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06400ca1c0 con 0x7f0640159b50 2023-12-20T04:47:53.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.231+0000 7f0647cbd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f064006cc10 con 0x7f064006c240 2023-12-20T04:47:53.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.231+0000 7f0645258640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f064015e530 0x7f064006fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56454/0 (socket says 172.21.15.132:56454) 2023-12-20T04:47:53.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.231+0000 7f0645258640 1 -- 172.21.15.132:0/4156720731 learned_addr learned my addr 172.21.15.132:0/4156720731 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:53.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.231+0000 7f064625a640 1 --2- 172.21.15.132:0/4156720731 >> v2:172.21.15.132:3300/0 conn(0x7f064006c240 0x7f064006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:53.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.231+0000 7f064625a640 1 -- 172.21.15.132:0/4156720731 >> v1:172.21.15.187:6789/0 conn(0x7f0640159b50 legacy=0x7f06400c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:53.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.231+0000 7f064625a640 1 -- 172.21.15.132:0/4156720731 >> v1:172.21.15.132:6789/0 conn(0x7f064015e530 legacy=0x7f064006fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.231+0000 7f0644a57640 1 -- 172.21.15.132:0/4156720731 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2270386996 0 0) 0x7f06400ccf30 con 0x7f064015e530 2023-12-20T04:47:53.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.231+0000 7f064625a640 1 -- 172.21.15.132:0/4156720731 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06400ca4a0 con 0x7f064006c240 2023-12-20T04:47:53.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.232+0000 7f064625a640 1 --2- 172.21.15.132:0/4156720731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064006c240 0x7f064006c6d0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f06380097d0 tx=0x7f063802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efef3ceec759b256 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:53.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.232+0000 7f0644a57640 1 -- 172.21.15.132:0/4156720731 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638031830 con 0x7f064006c240 2023-12-20T04:47:53.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.232+0000 7f0644a57640 1 -- 172.21.15.132:0/4156720731 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0638031990 con 0x7f064006c240 2023-12-20T04:47:53.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.232+0000 7f0644a57640 1 -- 172.21.15.132:0/4156720731 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0638031d20 con 0x7f064006c240 2023-12-20T04:47:53.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.233+0000 7f0647cbd640 1 -- 172.21.15.132:0/4156720731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064006c240 msgr2=0x7f064006c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.233+0000 7f0647cbd640 1 --2- 172.21.15.132:0/4156720731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064006c240 0x7f064006c6d0 secure :-1 s=READY pgs=1129 cs=0 l=1 rev1=1 crypto rx=0x7f06380097d0 tx=0x7f063802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.233+0000 7f0647cbd640 1 -- 172.21.15.132:0/4156720731 shutdown_connections 2023-12-20T04:47:53.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.233+0000 7f0647cbd640 1 --2- 172.21.15.132:0/4156720731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f064006c240 0x7f064006c6d0 unknown :-1 s=CLOSED pgs=1129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.233+0000 7f0647cbd640 1 -- 172.21.15.132:0/4156720731 >> 172.21.15.132:0/4156720731 conn(0x7f06400ced10 msgr2=0x7f06400cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:53.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.233+0000 7f0647cbd640 1 -- 172.21.15.132:0/4156720731 shutdown_connections 2023-12-20T04:47:53.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.233+0000 7f0647cbd640 1 -- 172.21.15.132:0/4156720731 wait complete. 2023-12-20T04:47:53.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.234+0000 7f0647cbd640 1 Processor -- start 2023-12-20T04:47:53.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.234+0000 7f0647cbd640 1 -- start start 2023-12-20T04:47:53.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f0647cbd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064006c240 0x7f06401ef3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:53.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f0647cbd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0640159b50 0x7f0640155780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:53.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f0647cbd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f064015e530 0x7f0640157ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:53.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f0647cbd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0640155fd0 con 0x7f0640159b50 2023-12-20T04:47:53.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f0647cbd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06401562b0 con 0x7f064015e530 2023-12-20T04:47:53.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f0647cbd640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0640156590 con 0x7f064006c240 2023-12-20T04:47:53.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f0645258640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0640159b50 0x7f0640155780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:53.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f0645258640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0640159b50 0x7f0640155780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43846/0 (socket says 172.21.15.132:43846) 2023-12-20T04:47:53.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f0645258640 1 -- 172.21.15.132:0/2041099209 learned_addr learned my addr 172.21.15.132:0/2041099209 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:53.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f0645258640 1 -- 172.21.15.132:0/2041099209 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064006c240 msgr2=0x7f06401ef3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f0645258640 1 --2- 172.21.15.132:0/2041099209 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064006c240 0x7f06401ef3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f0645258640 1 -- 172.21.15.132:0/2041099209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f064015e530 msgr2=0x7f0640157ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f0645258640 1 --2- 172.21.15.132:0/2041099209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f064015e530 0x7f0640157ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f0645258640 1 -- 172.21.15.132:0/2041099209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0638009400 con 0x7f0640159b50 2023-12-20T04:47:53.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f0645258640 1 --2- 172.21.15.132:0/2041099209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0640159b50 0x7f0640155780 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f063000c4d0 tx=0x7f063000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:53.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f06367fc640 1 -- 172.21.15.132:0/2041099209 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06300074e0 con 0x7f0640159b50 2023-12-20T04:47:53.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f06367fc640 1 -- 172.21.15.132:0/2041099209 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0630007660 con 0x7f0640159b50 2023-12-20T04:47:53.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f06367fc640 1 -- 172.21.15.132:0/2041099209 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0630004a20 con 0x7f0640159b50 2023-12-20T04:47:53.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f0647cbd640 1 -- 172.21.15.132:0/2041099209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0640156870 con 0x7f0640159b50 2023-12-20T04:47:53.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.235+0000 7f0647cbd640 1 -- 172.21.15.132:0/2041099209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0640155cc0 con 0x7f0640159b50 2023-12-20T04:47:53.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.236+0000 7f0647cbd640 1 -- 172.21.15.132:0/2041099209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0640156d90 con 0x7f0640159b50 2023-12-20T04:47:53.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.237+0000 7f06367fc640 1 -- 172.21.15.132:0/2041099209 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0630004b80 con 0x7f0640159b50 2023-12-20T04:47:53.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.237+0000 7f06367fc640 1 --2- 172.21.15.132:0/2041099209 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f062406a430 0x7f062406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:53.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.237+0000 7f06367fc640 1 -- 172.21.15.132:0/2041099209 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0630087a70 con 0x7f0640159b50 2023-12-20T04:47:53.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.237+0000 7f0645a59640 1 --2- 172.21.15.132:0/2041099209 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f062406a430 0x7f062406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:53.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.238+0000 7f0645a59640 1 --2- 172.21.15.132:0/2041099209 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f062406a430 0x7f062406c8f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f063c0043c0 tx=0x7f063c007d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:53.243 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.241+0000 7f06367fc640 1 -- 172.21.15.132:0/2041099209 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0640156d90 con 0x7f0640159b50 2023-12-20T04:47:53.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.409+0000 7f0647cbd640 1 -- 172.21.15.132:0/2041099209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0640156d90 con 0x7f0640159b50 2023-12-20T04:47:53.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.410+0000 7f06367fc640 1 -- 172.21.15.132:0/2041099209 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v110) v1 ==== 74+0+16244 (secure 0 0 0) 0x7f0640156d90 con 0x7f0640159b50 2023-12-20T04:47:53.412 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:53.412 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":110,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:47:40.970633+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":12,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:47:10.649946+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":13,"pool_name":"cephfs_data","create_time":"2023-12-20T04:47:11.271933+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"13.1c","mappings":[{"from":6,"to":3}]},{"pgid":"13.23","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:47:53.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.412+0000 7f0647cbd640 1 -- 172.21.15.132:0/2041099209 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f062406a430 msgr2=0x7f062406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.412+0000 7f0647cbd640 1 --2- 172.21.15.132:0/2041099209 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f062406a430 0x7f062406c8f0 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f063c0043c0 tx=0x7f063c007d30 comp rx=0 tx=0).stop 2023-12-20T04:47:53.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.412+0000 7f0647cbd640 1 -- 172.21.15.132:0/2041099209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0640159b50 msgr2=0x7f0640155780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.412+0000 7f0647cbd640 1 --2- 172.21.15.132:0/2041099209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0640159b50 0x7f0640155780 secure :-1 s=READY pgs=1130 cs=0 l=1 rev1=1 crypto rx=0x7f063000c4d0 tx=0x7f063000c990 comp rx=0 tx=0).stop 2023-12-20T04:47:53.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.412+0000 7f0647cbd640 1 -- 172.21.15.132:0/2041099209 shutdown_connections 2023-12-20T04:47:53.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.412+0000 7f0647cbd640 1 --2- 172.21.15.132:0/2041099209 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f062406a430 0x7f062406c8f0 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.412+0000 7f0647cbd640 1 --2- 172.21.15.132:0/2041099209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f064015e530 0x7f0640157ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.412+0000 7f0647cbd640 1 --2- 172.21.15.132:0/2041099209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0640159b50 0x7f0640155780 unknown :-1 s=CLOSED pgs=1130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.412+0000 7f0647cbd640 1 --2- 172.21.15.132:0/2041099209 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f064006c240 0x7f06401ef3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.412+0000 7f0647cbd640 1 -- 172.21.15.132:0/2041099209 >> 172.21.15.132:0/2041099209 conn(0x7f06400ced10 msgr2=0x7f0640154100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:53.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.412+0000 7f0647cbd640 1 -- 172.21.15.132:0/2041099209 shutdown_connections 2023-12-20T04:47:53.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.412+0000 7f0647cbd640 1 -- 172.21.15.132:0/2041099209 wait complete. 2023-12-20T04:47:53.425 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-20T04:47:53.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.525+0000 7f3cdce4a640 1 Processor -- start 2023-12-20T04:47:53.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.525+0000 7f3cdce4a640 1 -- start start 2023-12-20T04:47:53.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.525+0000 7f3cdce4a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3cd806ad40 0x7f3cd80b2750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:53.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.525+0000 7f3cdce4a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3cd815d1a0 0x7f3cd80b2c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:53.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.525+0000 7f3cdce4a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3cd80cb9f0 con 0x7f3cd815cdc0 2023-12-20T04:47:53.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.525+0000 7f3cdce4a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd80d1a70 con 0x7f3cd815d1a0 2023-12-20T04:47:53.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.525+0000 7f3cdce4a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3cd80d1790 con 0x7f3cd806ad40 2023-12-20T04:47:53.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.526+0000 7f3cd6d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3cd815d1a0 0x7f3cd80b2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:53.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.526+0000 7f3cd6d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3cd815d1a0 0x7f3cd80b2c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43862/0 (socket says 172.21.15.132:43862) 2023-12-20T04:47:53.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.526+0000 7f3cd6d9d640 1 -- 172.21.15.132:0/2622848169 learned_addr learned my addr 172.21.15.132:0/2622848169 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:53.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.526+0000 7f3ccffff640 1 --2- 172.21.15.132:0/2622848169 >> v2:172.21.15.187:3300/0 conn(0x7f3cd806ad40 0x7f3cd80b2750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:53.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.526+0000 7f3cd6d9d640 1 -- 172.21.15.132:0/2622848169 >> v2:172.21.15.187:3300/0 conn(0x7f3cd806ad40 msgr2=0x7f3cd80b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:53.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.526+0000 7f3cd6d9d640 1 --2- 172.21.15.132:0/2622848169 >> v2:172.21.15.187:3300/0 conn(0x7f3cd806ad40 0x7f3cd80b2750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.526+0000 7f3cd6d9d640 1 -- 172.21.15.132:0/2622848169 >> v1:172.21.15.187:6789/0 conn(0x7f3cd815cdc0 legacy=0x7f3cd80d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.526+0000 7f3cd6d9d640 1 -- 172.21.15.132:0/2622848169 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd80cb3a0 con 0x7f3cd815d1a0 2023-12-20T04:47:53.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.526+0000 7f3ccffff640 1 --2- 172.21.15.132:0/2622848169 >> v2:172.21.15.187:3300/0 conn(0x7f3cd806ad40 0x7f3cd80b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:53.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.527+0000 7f3cd6d9d640 1 --2- 172.21.15.132:0/2622848169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cd815d1a0 0x7f3cd80b2c90 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f3cd806eb00 tx=0x7f3cd002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d105c328de8bcbbf server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:53.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.527+0000 7f3cd5d9b640 1 -- 172.21.15.132:0/2622848169 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd002cb20 con 0x7f3cd815d1a0 2023-12-20T04:47:53.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.527+0000 7f3cd5d9b640 1 -- 172.21.15.132:0/2622848169 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd002cc80 con 0x7f3cd815d1a0 2023-12-20T04:47:53.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.527+0000 7f3cd5d9b640 1 -- 172.21.15.132:0/2622848169 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd00343f0 con 0x7f3cd815d1a0 2023-12-20T04:47:53.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.527+0000 7f3cdce4a640 1 -- 172.21.15.132:0/2622848169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cd815d1a0 msgr2=0x7f3cd80b2c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.527+0000 7f3cdce4a640 1 --2- 172.21.15.132:0/2622848169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cd815d1a0 0x7f3cd80b2c90 secure :-1 s=READY pgs=1131 cs=0 l=1 rev1=1 crypto rx=0x7f3cd806eb00 tx=0x7f3cd002bf80 comp rx=0 tx=0).stop 2023-12-20T04:47:53.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.527+0000 7f3cdce4a640 1 -- 172.21.15.132:0/2622848169 shutdown_connections 2023-12-20T04:47:53.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.527+0000 7f3cdce4a640 1 --2- 172.21.15.132:0/2622848169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cd815d1a0 0x7f3cd80b2c90 unknown :-1 s=CLOSED pgs=1131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.527+0000 7f3cdce4a640 1 --2- 172.21.15.132:0/2622848169 >> v2:172.21.15.187:3300/0 conn(0x7f3cd806ad40 0x7f3cd80b2750 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.527+0000 7f3cdce4a640 1 -- 172.21.15.132:0/2622848169 >> 172.21.15.132:0/2622848169 conn(0x7f3cd8072c60 msgr2=0x7f3cd8073070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:53.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.527+0000 7f3cdce4a640 1 -- 172.21.15.132:0/2622848169 shutdown_connections 2023-12-20T04:47:53.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.527+0000 7f3cdce4a640 1 -- 172.21.15.132:0/2622848169 wait complete. 2023-12-20T04:47:53.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.529+0000 7f3cdce4a640 1 Processor -- start 2023-12-20T04:47:53.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.529+0000 7f3cdce4a640 1 -- start start 2023-12-20T04:47:53.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.529+0000 7f3cdce4a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cd806ad40 0x7f3cd8154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:53.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.529+0000 7f3cdce4a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cd815cdc0 0x7f3cd80b1020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:53.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.529+0000 7f3cdce4a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cd815d1a0 0x7f3cd80b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:53.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.529+0000 7f3cdce4a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80c98f0 con 0x7f3cd815d1a0 2023-12-20T04:47:53.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.529+0000 7f3cdce4a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80c8220 con 0x7f3cd806ad40 2023-12-20T04:47:53.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.529+0000 7f3cdce4a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3cd80c8500 con 0x7f3cd815cdc0 2023-12-20T04:47:53.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.530+0000 7f3cd6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cd815d1a0 0x7f3cd80b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:53.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.530+0000 7f3cd6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cd815d1a0 0x7f3cd80b1560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43870/0 (socket says 172.21.15.132:43870) 2023-12-20T04:47:53.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.530+0000 7f3cd6d9d640 1 -- 172.21.15.132:0/1157669782 learned_addr learned my addr 172.21.15.132:0/1157669782 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:53.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.530+0000 7f3cd659c640 1 --2- 172.21.15.132:0/1157669782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cd806ad40 0x7f3cd8154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:53.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.530+0000 7f3ccffff640 1 --2- 172.21.15.132:0/1157669782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cd815cdc0 0x7f3cd80b1020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:53.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.530+0000 7f3cd6d9d640 1 -- 172.21.15.132:0/1157669782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cd815cdc0 msgr2=0x7f3cd80b1020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.530+0000 7f3cd6d9d640 1 --2- 172.21.15.132:0/1157669782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cd815cdc0 0x7f3cd80b1020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.530+0000 7f3cd6d9d640 1 -- 172.21.15.132:0/1157669782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cd806ad40 msgr2=0x7f3cd8154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.530+0000 7f3cd6d9d640 1 --2- 172.21.15.132:0/1157669782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cd806ad40 0x7f3cd8154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.530+0000 7f3cd6d9d640 1 -- 172.21.15.132:0/1157669782 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cd0009b30 con 0x7f3cd815d1a0 2023-12-20T04:47:53.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.530+0000 7f3cd6d9d640 1 --2- 172.21.15.132:0/1157669782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cd815d1a0 0x7f3cd80b1560 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0036040 tx=0x7f3cd0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:53.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.530+0000 7f3cceffd640 1 -- 172.21.15.132:0/1157669782 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd0007e70 con 0x7f3cd815d1a0 2023-12-20T04:47:53.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.530+0000 7f3cceffd640 1 -- 172.21.15.132:0/1157669782 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3cd0009510 con 0x7f3cd815d1a0 2023-12-20T04:47:53.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.530+0000 7f3cceffd640 1 -- 172.21.15.132:0/1157669782 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3cd003e690 con 0x7f3cd815d1a0 2023-12-20T04:47:53.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.530+0000 7f3cdce4a640 1 -- 172.21.15.132:0/1157669782 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cd80c87e0 con 0x7f3cd815d1a0 2023-12-20T04:47:53.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.530+0000 7f3cdce4a640 1 -- 172.21.15.132:0/1157669782 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cd815fcc0 con 0x7f3cd815d1a0 2023-12-20T04:47:53.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.531+0000 7f3cdce4a640 1 -- 172.21.15.132:0/1157669782 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cd80c8d00 con 0x7f3cd815d1a0 2023-12-20T04:47:53.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.532+0000 7f3cceffd640 1 -- 172.21.15.132:0/1157669782 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3cd003e7f0 con 0x7f3cd815d1a0 2023-12-20T04:47:53.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.532+0000 7f3cceffd640 1 --2- 172.21.15.132:0/1157669782 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cb806a460 0x7f3cb806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:53.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.532+0000 7f3cceffd640 1 -- 172.21.15.132:0/1157669782 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(110..110 src has 1..110) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f3cd00ab310 con 0x7f3cd815d1a0 2023-12-20T04:47:53.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.532+0000 7f3cd659c640 1 --2- 172.21.15.132:0/1157669782 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cb806a460 0x7f3cb806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:53.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.533+0000 7f3cd659c640 1 --2- 172.21.15.132:0/1157669782 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cb806a460 0x7f3cb806c920 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8000f60 tx=0x7f3cc8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:53.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.536+0000 7f3cceffd640 1 -- 172.21.15.132:0/1157669782 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3cd80c8d00 con 0x7f3cd815d1a0 2023-12-20T04:47:53.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.735+0000 7f3cdce4a640 1 -- 172.21.15.132:0/1157669782 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f3cd80c9a30 con 0x7f3cd815d1a0 2023-12-20T04:47:53.738 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:47:53.736+0000 7f1a5cbbd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-20T04:47:53.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.743+0000 7f3cceffd640 1 -- 172.21.15.132:0/1157669782 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v39) v1 ==== 161+0+0 (secure 0 0 0) 0x7f3cd80c9a30 con 0x7f3cd815d1a0 2023-12-20T04:47:53.745 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-20T04:47:53.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.745+0000 7f3cdce4a640 1 -- 172.21.15.132:0/1157669782 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cb806a460 msgr2=0x7f3cb806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.745+0000 7f3cdce4a640 1 --2- 172.21.15.132:0/1157669782 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cb806a460 0x7f3cb806c920 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f3cc8000f60 tx=0x7f3cc8009040 comp rx=0 tx=0).stop 2023-12-20T04:47:53.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.745+0000 7f3cdce4a640 1 -- 172.21.15.132:0/1157669782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cd815d1a0 msgr2=0x7f3cd80b1560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.745+0000 7f3cdce4a640 1 --2- 172.21.15.132:0/1157669782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cd815d1a0 0x7f3cd80b1560 secure :-1 s=READY pgs=1132 cs=0 l=1 rev1=1 crypto rx=0x7f3cd0036040 tx=0x7f3cd0004a40 comp rx=0 tx=0).stop 2023-12-20T04:47:53.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.745+0000 7f3cdce4a640 1 -- 172.21.15.132:0/1157669782 shutdown_connections 2023-12-20T04:47:53.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.745+0000 7f3cdce4a640 1 --2- 172.21.15.132:0/1157669782 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3cb806a460 0x7f3cb806c920 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.745+0000 7f3cdce4a640 1 --2- 172.21.15.132:0/1157669782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3cd815d1a0 0x7f3cd80b1560 unknown :-1 s=CLOSED pgs=1132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.745+0000 7f3cdce4a640 1 --2- 172.21.15.132:0/1157669782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3cd815cdc0 0x7f3cd80b1020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.745+0000 7f3cdce4a640 1 --2- 172.21.15.132:0/1157669782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3cd806ad40 0x7f3cd8154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.745+0000 7f3cdce4a640 1 -- 172.21.15.132:0/1157669782 >> 172.21.15.132:0/1157669782 conn(0x7f3cd8072c60 msgr2=0x7f3cd815d680 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:53.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.745+0000 7f3cdce4a640 1 -- 172.21.15.132:0/1157669782 shutdown_connections 2023-12-20T04:47:53.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.745+0000 7f3cdce4a640 1 -- 172.21.15.132:0/1157669782 wait complete. 2023-12-20T04:47:53.749 INFO:tasks.ceph.mds.b.smithi187.stderr: -9659> 2023-12-20T04:47:13.947+0000 7f32e57a1640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:47:53.758 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-20T04:47:53.783 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-12-20T04:47:53.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.858+0000 7fd98a3b9640 1 Processor -- start 2023-12-20T04:47:53.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.858+0000 7fd98a3b9640 1 -- start start 2023-12-20T04:47:53.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.859+0000 7fd98a3b9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd98415d300 0x7fd9840d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.859+0000 7fd98a3b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9840cff90 0x7fd9840b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.859+0000 7fd98a3b9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd9840d1a90 con 0x7fd9840d1550 2023-12-20T04:47:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.859+0000 7fd98a3b9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd9840d1d70 con 0x7fd98415d300 2023-12-20T04:47:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.859+0000 7fd98a3b9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9840d2050 con 0x7fd9840cff90 2023-12-20T04:47:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.859+0000 7fd983fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd98415d300 0x7fd9840d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.859+0000 7fd9837fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd9840d1550 0x7fd9840cf880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56464/0 (socket says 172.21.15.132:56464) 2023-12-20T04:47:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.859+0000 7fd9837fe640 1 -- 172.21.15.132:0/3278877874 learned_addr learned my addr 172.21.15.132:0/3278877874 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.859+0000 7fd988956640 1 --2- 172.21.15.132:0/3278877874 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9840cff90 0x7fd9840b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.859+0000 7fd983fff640 1 -- 172.21.15.132:0/3278877874 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9840cff90 msgr2=0x7fd9840b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.859+0000 7fd983fff640 1 --2- 172.21.15.132:0/3278877874 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9840cff90 0x7fd9840b60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.859+0000 7fd983fff640 1 -- 172.21.15.132:0/3278877874 >> v1:172.21.15.132:6789/0 conn(0x7fd9840d1550 legacy=0x7fd9840cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.859+0000 7fd983fff640 1 -- 172.21.15.132:0/3278877874 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd9840d2330 con 0x7fd98415d300 2023-12-20T04:47:53.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.859+0000 7fd982ffd640 1 -- 172.21.15.132:0/3278877874 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1837903629 0 0) 0x7fd9840d1a90 con 0x7fd9840d1550 2023-12-20T04:47:53.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.860+0000 7fd983fff640 1 --2- 172.21.15.132:0/3278877874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd98415d300 0x7fd9840d1010 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fd9740097a0 tx=0x7fd97402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceff51a3fc97ea39 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:53.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.860+0000 7fd982ffd640 1 -- 172.21.15.132:0/3278877874 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974031830 con 0x7fd98415d300 2023-12-20T04:47:53.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.860+0000 7fd982ffd640 1 -- 172.21.15.132:0/3278877874 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd974031990 con 0x7fd98415d300 2023-12-20T04:47:53.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.860+0000 7fd982ffd640 1 -- 172.21.15.132:0/3278877874 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd974031d20 con 0x7fd98415d300 2023-12-20T04:47:53.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.860+0000 7fd98a3b9640 1 -- 172.21.15.132:0/3278877874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd98415d300 msgr2=0x7fd9840d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.860+0000 7fd98a3b9640 1 --2- 172.21.15.132:0/3278877874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd98415d300 0x7fd9840d1010 secure :-1 s=READY pgs=1135 cs=0 l=1 rev1=1 crypto rx=0x7fd9740097a0 tx=0x7fd97402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.861+0000 7fd98a3b9640 1 -- 172.21.15.132:0/3278877874 shutdown_connections 2023-12-20T04:47:53.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.861+0000 7fd98a3b9640 1 --2- 172.21.15.132:0/3278877874 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9840cff90 0x7fd9840b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.861+0000 7fd98a3b9640 1 --2- 172.21.15.132:0/3278877874 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd98415d300 0x7fd9840d1010 unknown :-1 s=CLOSED pgs=1135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.861+0000 7fd98a3b9640 1 -- 172.21.15.132:0/3278877874 >> 172.21.15.132:0/3278877874 conn(0x7fd98406a3d0 msgr2=0x7fd98406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:53.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.861+0000 7fd98a3b9640 1 -- 172.21.15.132:0/3278877874 shutdown_connections 2023-12-20T04:47:53.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.861+0000 7fd98a3b9640 1 -- 172.21.15.132:0/3278877874 wait complete. 2023-12-20T04:47:53.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.862+0000 7fd98a3b9640 1 Processor -- start 2023-12-20T04:47:53.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.862+0000 7fd98a3b9640 1 -- start start 2023-12-20T04:47:53.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd98a3b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9840cff90 0x7fd9840c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:53.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd98a3b9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9840d1550 0x7fd9840cbb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:53.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd98a3b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd98415d300 0x7fd984152dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:53.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd98a3b9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9840c7100 con 0x7fd98415d300 2023-12-20T04:47:53.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd98a3b9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd9840b4220 con 0x7fd9840d1550 2023-12-20T04:47:53.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd98a3b9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd9840c9800 con 0x7fd9840cff90 2023-12-20T04:47:53.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd988956640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd98415d300 0x7fd984152dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:53.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd988956640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd98415d300 0x7fd984152dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43876/0 (socket says 172.21.15.132:43876) 2023-12-20T04:47:53.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd988956640 1 -- 172.21.15.132:0/236818096 learned_addr learned my addr 172.21.15.132:0/236818096 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:53.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd983fff640 1 --2- 172.21.15.132:0/236818096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9840cff90 0x7fd9840c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:53.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd9837fe640 1 --2- 172.21.15.132:0/236818096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9840d1550 0x7fd9840cbb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:53.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd988956640 1 -- 172.21.15.132:0/236818096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9840cff90 msgr2=0x7fd9840c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd988956640 1 --2- 172.21.15.132:0/236818096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9840cff90 0x7fd9840c92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd988956640 1 -- 172.21.15.132:0/236818096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9840d1550 msgr2=0x7fd9840cbb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:53.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd988956640 1 --2- 172.21.15.132:0/236818096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9840d1550 0x7fd9840cbb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:53.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd988956640 1 -- 172.21.15.132:0/236818096 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd974009400 con 0x7fd98415d300 2023-12-20T04:47:53.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd9837fe640 1 --2- 172.21.15.132:0/236818096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9840d1550 0x7fd9840cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:53.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd988956640 1 --2- 172.21.15.132:0/236818096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd98415d300 0x7fd984152dd0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00cd60 tx=0x7fd97c00a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:53.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd980ff9640 1 -- 172.21.15.132:0/236818096 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c003b90 con 0x7fd98415d300 2023-12-20T04:47:53.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd980ff9640 1 -- 172.21.15.132:0/236818096 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd97c003d10 con 0x7fd98415d300 2023-12-20T04:47:53.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd980ff9640 1 -- 172.21.15.132:0/236818096 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd97c004260 con 0x7fd98415d300 2023-12-20T04:47:53.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd98a3b9640 1 -- 172.21.15.132:0/236818096 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd9840b36a0 con 0x7fd98415d300 2023-12-20T04:47:53.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.863+0000 7fd98a3b9640 1 -- 172.21.15.132:0/236818096 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd9840b3c60 con 0x7fd98415d300 2023-12-20T04:47:53.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.864+0000 7fd98a3b9640 1 -- 172.21.15.132:0/236818096 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd9840c7270 con 0x7fd98415d300 2023-12-20T04:47:53.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.865+0000 7fd980ff9640 1 -- 172.21.15.132:0/236818096 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd97c0043c0 con 0x7fd98415d300 2023-12-20T04:47:53.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.865+0000 7fd980ff9640 1 --2- 172.21.15.132:0/236818096 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd97006a460 0x7fd97006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:53.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.865+0000 7fd980ff9640 1 -- 172.21.15.132:0/236818096 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5853+0+0 (secure 0 0 0) 0x7fd97c012070 con 0x7fd98415d300 2023-12-20T04:47:53.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.865+0000 7fd983fff640 1 --2- 172.21.15.132:0/236818096 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd97006a460 0x7fd97006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:53.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.866+0000 7fd983fff640 1 --2- 172.21.15.132:0/236818096 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd97006a460 0x7fd97006c920 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd974036000 tx=0x7fd97403c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:53.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:53.870+0000 7fd980ff9640 1 -- 172.21.15.132:0/236818096 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd97c054880 con 0x7fd98415d300 2023-12-20T04:47:54.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.070+0000 7fd98a3b9640 1 -- 172.21.15.132:0/236818096 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fd98404e840 con 0x7fd98415d300 2023-12-20T04:47:54.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.745+0000 7fd980ff9640 1 -- 172.21.15.132:0/236818096 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v40) v1 ==== 104+0+0 (secure 0 0 0) 0x7fd97c057ea0 con 0x7fd98415d300 2023-12-20T04:47:54.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.747+0000 7fd98a3b9640 1 -- 172.21.15.132:0/236818096 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd97006a460 msgr2=0x7fd97006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:54.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.747+0000 7fd98a3b9640 1 --2- 172.21.15.132:0/236818096 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd97006a460 0x7fd97006c920 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fd974036000 tx=0x7fd97403c040 comp rx=0 tx=0).stop 2023-12-20T04:47:54.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.747+0000 7fd98a3b9640 1 -- 172.21.15.132:0/236818096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd98415d300 msgr2=0x7fd984152dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:54.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.747+0000 7fd98a3b9640 1 --2- 172.21.15.132:0/236818096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd98415d300 0x7fd984152dd0 secure :-1 s=READY pgs=1136 cs=0 l=1 rev1=1 crypto rx=0x7fd97c00cd60 tx=0x7fd97c00a660 comp rx=0 tx=0).stop 2023-12-20T04:47:54.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.747+0000 7fd98a3b9640 1 -- 172.21.15.132:0/236818096 shutdown_connections 2023-12-20T04:47:54.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.747+0000 7fd98a3b9640 1 --2- 172.21.15.132:0/236818096 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd97006a460 0x7fd97006c920 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:54.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.747+0000 7fd98a3b9640 1 --2- 172.21.15.132:0/236818096 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd98415d300 0x7fd984152dd0 unknown :-1 s=CLOSED pgs=1136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:54.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.747+0000 7fd98a3b9640 1 --2- 172.21.15.132:0/236818096 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd9840d1550 0x7fd9840cbb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:54.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.747+0000 7fd98a3b9640 1 --2- 172.21.15.132:0/236818096 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd9840cff90 0x7fd9840c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:54.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.747+0000 7fd98a3b9640 1 -- 172.21.15.132:0/236818096 >> 172.21.15.132:0/236818096 conn(0x7fd98406a3d0 msgr2=0x7fd984151d80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:54.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.747+0000 7fd98a3b9640 1 -- 172.21.15.132:0/236818096 shutdown_connections 2023-12-20T04:47:54.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.747+0000 7fd98a3b9640 1 -- 172.21.15.132:0/236818096 wait complete. 2023-12-20T04:47:54.761 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-20T04:47:54.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.865+0000 7f2763737640 1 Processor -- start 2023-12-20T04:47:54.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.865+0000 7f2763737640 1 -- start start 2023-12-20T04:47:54.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.866+0000 7f2763737640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f275c15d190 0x7f275c160b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:54.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.866+0000 7f2763737640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f275c0b87a0 0x7f275c0cdae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:54.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.866+0000 7f2763737640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f275c0ce470 con 0x7f275c0ce020 2023-12-20T04:47:54.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.866+0000 7f2763737640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275c0b5fb0 con 0x7f275c0b87a0 2023-12-20T04:47:54.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.866+0000 7f2763737640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f275c161a70 con 0x7f275c15d190 2023-12-20T04:47:54.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.866+0000 7f2760cd2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f275c0b87a0 0x7f275c0cdae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:54.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.866+0000 7f2760cd2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f275c0b87a0 0x7f275c0cdae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43878/0 (socket says 172.21.15.132:43878) 2023-12-20T04:47:54.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.866+0000 7f2760cd2640 1 -- 172.21.15.132:0/3732384848 learned_addr learned my addr 172.21.15.132:0/3732384848 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:54.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.866+0000 7f27614d3640 1 --2- 172.21.15.132:0/3732384848 >> v2:172.21.15.187:3300/0 conn(0x7f275c15d190 0x7f275c160b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:54.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.866+0000 7f2760cd2640 1 -- 172.21.15.132:0/3732384848 >> v2:172.21.15.187:3300/0 conn(0x7f275c15d190 msgr2=0x7f275c160b80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:54.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.866+0000 7f2760cd2640 1 --2- 172.21.15.132:0/3732384848 >> v2:172.21.15.187:3300/0 conn(0x7f275c15d190 0x7f275c160b80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:54.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.866+0000 7f2760cd2640 1 -- 172.21.15.132:0/3732384848 >> v1:172.21.15.187:6789/0 conn(0x7f275c0ce020 legacy=0x7f275c0b4890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:54.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.866+0000 7f2760cd2640 1 -- 172.21.15.132:0/3732384848 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f275c1611d0 con 0x7f275c0b87a0 2023-12-20T04:47:54.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.867+0000 7f2760cd2640 1 --2- 172.21.15.132:0/3732384848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f275c0b87a0 0x7f275c0cdae0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f275c06b060 tx=0x7f274c02b7f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c3a127d20415873 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:54.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.867+0000 7f2753fff640 1 -- 172.21.15.132:0/3732384848 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c031750 con 0x7f275c0b87a0 2023-12-20T04:47:54.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.867+0000 7f2753fff640 1 -- 172.21.15.132:0/3732384848 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f274c0318b0 con 0x7f275c0b87a0 2023-12-20T04:47:54.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.867+0000 7f2753fff640 1 -- 172.21.15.132:0/3732384848 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f274c031c40 con 0x7f275c0b87a0 2023-12-20T04:47:54.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.867+0000 7f2763737640 1 -- 172.21.15.132:0/3732384848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f275c0b87a0 msgr2=0x7f275c0cdae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:54.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.867+0000 7f2763737640 1 --2- 172.21.15.132:0/3732384848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f275c0b87a0 0x7f275c0cdae0 secure :-1 s=READY pgs=1137 cs=0 l=1 rev1=1 crypto rx=0x7f275c06b060 tx=0x7f274c02b7f0 comp rx=0 tx=0).stop 2023-12-20T04:47:54.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.868+0000 7f2763737640 1 -- 172.21.15.132:0/3732384848 shutdown_connections 2023-12-20T04:47:54.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.868+0000 7f2763737640 1 --2- 172.21.15.132:0/3732384848 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f275c0b87a0 0x7f275c0cdae0 unknown :-1 s=CLOSED pgs=1137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:54.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.868+0000 7f2763737640 1 --2- 172.21.15.132:0/3732384848 >> v2:172.21.15.187:3300/0 conn(0x7f275c15d190 0x7f275c160b80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:54.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.868+0000 7f2763737640 1 -- 172.21.15.132:0/3732384848 >> 172.21.15.132:0/3732384848 conn(0x7f275c06a290 msgr2=0x7f275c06a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:54.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.868+0000 7f2763737640 1 -- 172.21.15.132:0/3732384848 shutdown_connections 2023-12-20T04:47:54.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.868+0000 7f2763737640 1 -- 172.21.15.132:0/3732384848 wait complete. 2023-12-20T04:47:54.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.869+0000 7f2763737640 1 Processor -- start 2023-12-20T04:47:54.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.869+0000 7f2763737640 1 -- start start 2023-12-20T04:47:54.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.869+0000 7f2763737640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f275c0b87a0 0x7f275c1f20b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:54.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.869+0000 7f2763737640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f275c0ce020 0x7f275c158d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:54.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.869+0000 7f2763737640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f275c15d190 0x7f275c1592d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:54.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f2763737640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c1f25f0 con 0x7f275c0b87a0 2023-12-20T04:47:54.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f2763737640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f275c0ccc70 con 0x7f275c15d190 2023-12-20T04:47:54.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f2763737640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f275c0ccf50 con 0x7f275c0ce020 2023-12-20T04:47:54.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f27614d3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f275c0b87a0 0x7f275c1f20b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:54.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f27614d3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f275c0b87a0 0x7f275c1f20b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43888/0 (socket says 172.21.15.132:43888) 2023-12-20T04:47:54.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f27614d3640 1 -- 172.21.15.132:0/1206104672 learned_addr learned my addr 172.21.15.132:0/1206104672 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:54.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f2761cd4640 1 --2- 172.21.15.132:0/1206104672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f275c15d190 0x7f275c1592d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:54.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f2760cd2640 1 --2- 172.21.15.132:0/1206104672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f275c0ce020 0x7f275c158d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:54.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f27614d3640 1 -- 172.21.15.132:0/1206104672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f275c0ce020 msgr2=0x7f275c158d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:54.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f27614d3640 1 --2- 172.21.15.132:0/1206104672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f275c0ce020 0x7f275c158d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:54.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f27614d3640 1 -- 172.21.15.132:0/1206104672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f275c15d190 msgr2=0x7f275c1592d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:54.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f27614d3640 1 --2- 172.21.15.132:0/1206104672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f275c15d190 0x7f275c1592d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:54.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f27614d3640 1 -- 172.21.15.132:0/1206104672 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f274c0094d0 con 0x7f275c0b87a0 2023-12-20T04:47:54.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f2760cd2640 1 --2- 172.21.15.132:0/1206104672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f275c0ce020 0x7f275c158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:54.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f27614d3640 1 --2- 172.21.15.132:0/1206104672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f275c0b87a0 0x7f275c1f20b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f275800d5f0 tx=0x7f275800dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:54.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f2751ffb640 1 -- 172.21.15.132:0/1206104672 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f27580125f0 con 0x7f275c0b87a0 2023-12-20T04:47:54.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f2751ffb640 1 -- 172.21.15.132:0/1206104672 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2758012750 con 0x7f275c0b87a0 2023-12-20T04:47:54.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f2763737640 1 -- 172.21.15.132:0/1206104672 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f275c0c6e60 con 0x7f275c0b87a0 2023-12-20T04:47:54.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f2751ffb640 1 -- 172.21.15.132:0/1206104672 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2758012b00 con 0x7f275c0b87a0 2023-12-20T04:47:54.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.870+0000 7f2763737640 1 -- 172.21.15.132:0/1206104672 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f275c0c7420 con 0x7f275c0b87a0 2023-12-20T04:47:54.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.871+0000 7f2763737640 1 -- 172.21.15.132:0/1206104672 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f275c0c75e0 con 0x7f275c0b87a0 2023-12-20T04:47:54.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.872+0000 7f2751ffb640 1 -- 172.21.15.132:0/1206104672 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2758012c60 con 0x7f275c0b87a0 2023-12-20T04:47:54.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.872+0000 7f2751ffb640 1 --2- 172.21.15.132:0/1206104672 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f274006a460 0x7f274006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:54.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.872+0000 7f2751ffb640 1 -- 172.21.15.132:0/1206104672 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(111..111 src has 1..111) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f2758088d70 con 0x7f275c0b87a0 2023-12-20T04:47:54.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.872+0000 7f2760cd2640 1 --2- 172.21.15.132:0/1206104672 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f274006a460 0x7f274006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:54.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.872+0000 7f2760cd2640 1 --2- 172.21.15.132:0/1206104672 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f274006a460 0x7f274006c920 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f274c035000 tx=0x7f274c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:54.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:54.876+0000 7f2751ffb640 1 -- 172.21.15.132:0/1206104672 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2758054360 con 0x7f275c0b87a0 2023-12-20T04:47:55.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.041+0000 7f2763737640 1 -- 172.21.15.132:0/1206104672 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f275c04e840 con 0x7f275c0b87a0 2023-12-20T04:47:55.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.846+0000 7f2751ffb640 1 -- 172.21.15.132:0/1206104672 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v112) v1 ==== 181+0+0 (secure 0 0 0) 0x7f2758057980 con 0x7f275c0b87a0 2023-12-20T04:47:55.848 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2023-12-20T04:47:55.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.849+0000 7f2763737640 1 -- 172.21.15.132:0/1206104672 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f274006a460 msgr2=0x7f274006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:55.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.849+0000 7f2763737640 1 --2- 172.21.15.132:0/1206104672 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f274006a460 0x7f274006c920 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f274c035000 tx=0x7f274c008030 comp rx=0 tx=0).stop 2023-12-20T04:47:55.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.849+0000 7f2763737640 1 -- 172.21.15.132:0/1206104672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f275c0b87a0 msgr2=0x7f275c1f20b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:55.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.849+0000 7f2763737640 1 --2- 172.21.15.132:0/1206104672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f275c0b87a0 0x7f275c1f20b0 secure :-1 s=READY pgs=1138 cs=0 l=1 rev1=1 crypto rx=0x7f275800d5f0 tx=0x7f275800dab0 comp rx=0 tx=0).stop 2023-12-20T04:47:55.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.849+0000 7f2763737640 1 -- 172.21.15.132:0/1206104672 shutdown_connections 2023-12-20T04:47:55.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.849+0000 7f2763737640 1 --2- 172.21.15.132:0/1206104672 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f274006a460 0x7f274006c920 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:55.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.849+0000 7f2763737640 1 --2- 172.21.15.132:0/1206104672 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f275c15d190 0x7f275c1592d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:55.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.849+0000 7f2763737640 1 --2- 172.21.15.132:0/1206104672 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f275c0ce020 0x7f275c158d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:55.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.849+0000 7f2763737640 1 --2- 172.21.15.132:0/1206104672 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f275c0b87a0 0x7f275c1f20b0 unknown :-1 s=CLOSED pgs=1138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:55.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.849+0000 7f2763737640 1 -- 172.21.15.132:0/1206104672 >> 172.21.15.132:0/1206104672 conn(0x7f275c06a290 msgr2=0x7f275c0d17a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:55.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.849+0000 7f2763737640 1 -- 172.21.15.132:0/1206104672 shutdown_connections 2023-12-20T04:47:55.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.849+0000 7f2763737640 1 -- 172.21.15.132:0/1206104672 wait complete. 2023-12-20T04:47:55.865 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-20T04:47:55.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.969+0000 7f87f74ab640 1 Processor -- start 2023-12-20T04:47:55.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.969+0000 7f87f74ab640 1 -- start start 2023-12-20T04:47:55.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f74ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f87f015d220 0x7f87f006afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:55.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f74ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f00cfab0 0x7f87f006b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:55.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f74ab640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f87f006bc00 0x7f87f0160cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:55.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f74ab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f006c090 con 0x7f87f015d220 2023-12-20T04:47:55.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f74ab640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87f00d1b80 con 0x7f87f006bc00 2023-12-20T04:47:55.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f74ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f015d600 con 0x7f87f00cfab0 2023-12-20T04:47:55.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f5247640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f87f015d220 0x7f87f006afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:55.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f5247640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f87f015d220 0x7f87f006afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43900/0 (socket says 172.21.15.132:43900) 2023-12-20T04:47:55.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f5247640 1 -- 172.21.15.132:0/2727341760 learned_addr learned my addr 172.21.15.132:0/2727341760 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:55.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f5a48640 1 --2- 172.21.15.132:0/2727341760 >> v2:172.21.15.187:3300/0 conn(0x7f87f006bc00 0x7f87f0160cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:55.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f5247640 1 -- 172.21.15.132:0/2727341760 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f00cfab0 msgr2=0x7f87f006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:55.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f4a46640 1 --2- 172.21.15.132:0/2727341760 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f00cfab0 0x7f87f006b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:55.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f5247640 1 --2- 172.21.15.132:0/2727341760 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f00cfab0 0x7f87f006b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:55.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f5247640 1 -- 172.21.15.132:0/2727341760 >> v2:172.21.15.187:3300/0 conn(0x7f87f006bc00 msgr2=0x7f87f0160cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:55.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f5247640 1 --2- 172.21.15.132:0/2727341760 >> v2:172.21.15.187:3300/0 conn(0x7f87f006bc00 0x7f87f0160cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:55.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f5247640 1 -- 172.21.15.132:0/2727341760 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87f00d0020 con 0x7f87f015d220 2023-12-20T04:47:55.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f5a48640 1 --2- 172.21.15.132:0/2727341760 >> v2:172.21.15.187:3300/0 conn(0x7f87f006bc00 0x7f87f0160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:55.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.970+0000 7f87f4a46640 1 --2- 172.21.15.132:0/2727341760 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f00cfab0 0x7f87f006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:55.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.971+0000 7f87f5247640 1 --2- 172.21.15.132:0/2727341760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f015d220 0x7f87f006afe0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f87f00d1780 tx=0x7f87ec02b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f661e09b4e3e4e50 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:55.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.971+0000 7f87e7fff640 1 -- 172.21.15.132:0/2727341760 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec004230 con 0x7f87f015d220 2023-12-20T04:47:55.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.971+0000 7f87e7fff640 1 -- 172.21.15.132:0/2727341760 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87ec004390 con 0x7f87f015d220 2023-12-20T04:47:55.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.971+0000 7f87e7fff640 1 -- 172.21.15.132:0/2727341760 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87ec003810 con 0x7f87f015d220 2023-12-20T04:47:55.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.972+0000 7f87f74ab640 1 -- 172.21.15.132:0/2727341760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f015d220 msgr2=0x7f87f006afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:55.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.972+0000 7f87f74ab640 1 --2- 172.21.15.132:0/2727341760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f015d220 0x7f87f006afe0 secure :-1 s=READY pgs=1139 cs=0 l=1 rev1=1 crypto rx=0x7f87f00d1780 tx=0x7f87ec02b860 comp rx=0 tx=0).stop 2023-12-20T04:47:55.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.972+0000 7f87f74ab640 1 -- 172.21.15.132:0/2727341760 shutdown_connections 2023-12-20T04:47:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.972+0000 7f87f74ab640 1 --2- 172.21.15.132:0/2727341760 >> v2:172.21.15.187:3300/0 conn(0x7f87f006bc00 0x7f87f0160cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.972+0000 7f87f74ab640 1 --2- 172.21.15.132:0/2727341760 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f00cfab0 0x7f87f006b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.972+0000 7f87f74ab640 1 --2- 172.21.15.132:0/2727341760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f015d220 0x7f87f006afe0 unknown :-1 s=CLOSED pgs=1139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.972+0000 7f87f74ab640 1 -- 172.21.15.132:0/2727341760 >> 172.21.15.132:0/2727341760 conn(0x7f87f0099fa0 msgr2=0x7f87f00d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.972+0000 7f87f74ab640 1 -- 172.21.15.132:0/2727341760 shutdown_connections 2023-12-20T04:47:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.972+0000 7f87f74ab640 1 -- 172.21.15.132:0/2727341760 wait complete. 2023-12-20T04:47:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.973+0000 7f87f74ab640 1 Processor -- start 2023-12-20T04:47:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.973+0000 7f87f74ab640 1 -- start start 2023-12-20T04:47:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87f74ab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87f006bc00 0x7f87f01f69c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87f74ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f00cfab0 0x7f87f0144d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87f74ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f015d220 0x7f87f015e820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87f74ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f0145240 con 0x7f87f00cfab0 2023-12-20T04:47:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87f74ab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87f0145510 con 0x7f87f006bc00 2023-12-20T04:47:55.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87f74ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87f01457f0 con 0x7f87f015d220 2023-12-20T04:47:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87f4a46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f00cfab0 0x7f87f0144d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87f4a46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f00cfab0 0x7f87f0144d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43916/0 (socket says 172.21.15.132:43916) 2023-12-20T04:47:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87f4a46640 1 -- 172.21.15.132:0/1599264933 learned_addr learned my addr 172.21.15.132:0/1599264933 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87f4a46640 1 -- 172.21.15.132:0/1599264933 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f015d220 msgr2=0x7f87f015e820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87f4a46640 1 --2- 172.21.15.132:0/1599264933 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f015d220 0x7f87f015e820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87f4a46640 1 -- 172.21.15.132:0/1599264933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87f006bc00 msgr2=0x7f87f01f69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87f4a46640 1 --2- 172.21.15.132:0/1599264933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87f006bc00 0x7f87f01f69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87f4a46640 1 -- 172.21.15.132:0/1599264933 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec009460 con 0x7f87f00cfab0 2023-12-20T04:47:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87f4a46640 1 --2- 172.21.15.132:0/1599264933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f00cfab0 0x7f87f0144d00 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f87e000c7f0 tx=0x7f87e000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87e5ffb640 1 -- 172.21.15.132:0/1599264933 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e0007a30 con 0x7f87f00cfab0 2023-12-20T04:47:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87e5ffb640 1 -- 172.21.15.132:0/1599264933 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87e0007b90 con 0x7f87f00cfab0 2023-12-20T04:47:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87e5ffb640 1 -- 172.21.15.132:0/1599264933 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f87e000ce40 con 0x7f87f00cfab0 2023-12-20T04:47:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.974+0000 7f87f74ab640 1 -- 172.21.15.132:0/1599264933 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87f0145ad0 con 0x7f87f00cfab0 2023-12-20T04:47:55.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.975+0000 7f87f74ab640 1 -- 172.21.15.132:0/1599264933 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87f0155020 con 0x7f87f00cfab0 2023-12-20T04:47:55.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.975+0000 7f87f74ab640 1 -- 172.21.15.132:0/1599264933 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87f006c1f0 con 0x7f87f00cfab0 2023-12-20T04:47:55.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.976+0000 7f87e5ffb640 1 -- 172.21.15.132:0/1599264933 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f87e00113f0 con 0x7f87f00cfab0 2023-12-20T04:47:55.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.976+0000 7f87e5ffb640 1 --2- 172.21.15.132:0/1599264933 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f87d406a430 0x7f87d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:55.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.976+0000 7f87e5ffb640 1 -- 172.21.15.132:0/1599264933 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(112..112 src has 1..112) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f87e0088990 con 0x7f87f00cfab0 2023-12-20T04:47:55.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.976+0000 7f87f5247640 1 --2- 172.21.15.132:0/1599264933 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f87d406a430 0x7f87d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:55.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.977+0000 7f87f5247640 1 --2- 172.21.15.132:0/1599264933 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f87d406a430 0x7f87d406c8f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f87ec034000 tx=0x7f87ec030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:55.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:55.981+0000 7f87e5ffb640 1 -- 172.21.15.132:0/1599264933 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f87e00540a0 con 0x7f87f00cfab0 2023-12-20T04:47:56.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:56.150+0000 7f87f74ab640 1 -- 172.21.15.132:0/1599264933 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f87f01551b0 con 0x7f87f00cfab0 2023-12-20T04:47:57.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.076+0000 7f87e5ffb640 1 -- 172.21.15.132:0/1599264933 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v113) v1 ==== 169+0+0 (secure 0 0 0) 0x7f87f01551b0 con 0x7f87f00cfab0 2023-12-20T04:47:57.078 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2023-12-20T04:47:57.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.079+0000 7f87f74ab640 1 -- 172.21.15.132:0/1599264933 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f87d406a430 msgr2=0x7f87d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:57.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.079+0000 7f87f74ab640 1 --2- 172.21.15.132:0/1599264933 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f87d406a430 0x7f87d406c8f0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7f87ec034000 tx=0x7f87ec030000 comp rx=0 tx=0).stop 2023-12-20T04:47:57.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.079+0000 7f87f74ab640 1 -- 172.21.15.132:0/1599264933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f00cfab0 msgr2=0x7f87f0144d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:57.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.079+0000 7f87f74ab640 1 --2- 172.21.15.132:0/1599264933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f00cfab0 0x7f87f0144d00 secure :-1 s=READY pgs=1140 cs=0 l=1 rev1=1 crypto rx=0x7f87e000c7f0 tx=0x7f87e000cbf0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.079+0000 7f87f74ab640 1 -- 172.21.15.132:0/1599264933 shutdown_connections 2023-12-20T04:47:57.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.079+0000 7f87f74ab640 1 --2- 172.21.15.132:0/1599264933 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f87d406a430 0x7f87d406c8f0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.080+0000 7f87f74ab640 1 --2- 172.21.15.132:0/1599264933 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87f015d220 0x7f87f015e820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.080+0000 7f87f74ab640 1 --2- 172.21.15.132:0/1599264933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87f00cfab0 0x7f87f0144d00 unknown :-1 s=CLOSED pgs=1140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.080+0000 7f87f74ab640 1 --2- 172.21.15.132:0/1599264933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f87f006bc00 0x7f87f01f69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.080+0000 7f87f74ab640 1 -- 172.21.15.132:0/1599264933 >> 172.21.15.132:0/1599264933 conn(0x7f87f0099fa0 msgr2=0x7f87f006dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:57.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.080+0000 7f87f74ab640 1 -- 172.21.15.132:0/1599264933 shutdown_connections 2023-12-20T04:47:57.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.080+0000 7f87f74ab640 1 -- 172.21.15.132:0/1599264933 wait complete. 2023-12-20T04:47:57.095 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-20T04:47:57.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.200+0000 7fa2e5696640 1 Processor -- start 2023-12-20T04:47:57.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.200+0000 7fa2e5696640 1 -- start start 2023-12-20T04:47:57.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.201+0000 7fa2e5696640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa2e00cb2b0 0x7fa2e00cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:57.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.201+0000 7fa2e5696640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa2e00cdbb0 0x7fa2e00d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:57.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.201+0000 7fa2e5696640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2e00ce000 con 0x7fa2e015aee0 2023-12-20T04:47:57.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.201+0000 7fa2e5696640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e00d0130 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.201+0000 7fa2e5696640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2e015f370 con 0x7fa2e00cdbb0 2023-12-20T04:47:57.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.201+0000 7fa2de7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa2e00cb2b0 0x7fa2e00cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:57.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.201+0000 7fa2deffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa2e015aee0 0x7fa2e015eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:56478/0 (socket says 172.21.15.132:56478) 2023-12-20T04:47:57.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.201+0000 7fa2deffd640 1 -- 172.21.15.132:0/2393628219 learned_addr learned my addr 172.21.15.132:0/2393628219 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:57.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.202+0000 7fa2de7fc640 1 -- 172.21.15.132:0/2393628219 >> v2:172.21.15.187:3300/0 conn(0x7fa2e00cdbb0 msgr2=0x7fa2e00d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:57.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.202+0000 7fa2de7fc640 1 --2- 172.21.15.132:0/2393628219 >> v2:172.21.15.187:3300/0 conn(0x7fa2e00cdbb0 0x7fa2e00d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.202+0000 7fa2de7fc640 1 -- 172.21.15.132:0/2393628219 >> v1:172.21.15.132:6789/0 conn(0x7fa2e015aee0 legacy=0x7fa2e015eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:57.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.202+0000 7fa2ddffb640 1 -- 172.21.15.132:0/2393628219 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3123103890 0 0) 0x7fa2d0001490 con 0x7fa2e015aee0 2023-12-20T04:47:57.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.202+0000 7fa2de7fc640 1 -- 172.21.15.132:0/2393628219 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2e015f650 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.202+0000 7fa2de7fc640 1 --2- 172.21.15.132:0/2393628219 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2e00cb2b0 0x7fa2e00cd670 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80097a0 tx=0x7fa2c802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c11a1fa92fc3f86a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:57.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.203+0000 7fa2ddffb640 1 -- 172.21.15.132:0/2393628219 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8031830 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.203+0000 7fa2ddffb640 1 -- 172.21.15.132:0/2393628219 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2c8031990 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.203+0000 7fa2ddffb640 1 -- 172.21.15.132:0/2393628219 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2c8031d20 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.203+0000 7fa2e5696640 1 -- 172.21.15.132:0/2393628219 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2e00cb2b0 msgr2=0x7fa2e00cd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:57.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.203+0000 7fa2e5696640 1 --2- 172.21.15.132:0/2393628219 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2e00cb2b0 0x7fa2e00cd670 secure :-1 s=READY pgs=1142 cs=0 l=1 rev1=1 crypto rx=0x7fa2c80097a0 tx=0x7fa2c802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.203+0000 7fa2e5696640 1 -- 172.21.15.132:0/2393628219 shutdown_connections 2023-12-20T04:47:57.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.203+0000 7fa2e5696640 1 --2- 172.21.15.132:0/2393628219 >> v2:172.21.15.187:3300/0 conn(0x7fa2e00cdbb0 0x7fa2e00d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.203+0000 7fa2e5696640 1 --2- 172.21.15.132:0/2393628219 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2e00cb2b0 0x7fa2e00cd670 unknown :-1 s=CLOSED pgs=1142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.203+0000 7fa2e5696640 1 -- 172.21.15.132:0/2393628219 >> 172.21.15.132:0/2393628219 conn(0x7fa2e0072c60 msgr2=0x7fa2e0073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:57.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.203+0000 7fa2e5696640 1 -- 172.21.15.132:0/2393628219 shutdown_connections 2023-12-20T04:47:57.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.203+0000 7fa2e5696640 1 -- 172.21.15.132:0/2393628219 wait complete. 2023-12-20T04:47:57.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.204+0000 7fa2e5696640 1 Processor -- start 2023-12-20T04:47:57.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.204+0000 7fa2e5696640 1 -- start start 2023-12-20T04:47:57.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.205+0000 7fa2e5696640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2e00cb2b0 0x7fa2e00c9760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:57.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.205+0000 7fa2e5696640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2e00cdbb0 0x7fa2e014f730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:57.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.205+0000 7fa2e5696640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2e015aee0 0x7fa2e0153f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:57.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.205+0000 7fa2e5696640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00ca710 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.205+0000 7fa2e5696640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e014fc70 con 0x7fa2e015aee0 2023-12-20T04:47:57.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.205+0000 7fa2e5696640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2e00c9e70 con 0x7fa2e00cdbb0 2023-12-20T04:47:57.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.205+0000 7fa2deffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2e00cb2b0 0x7fa2e00c9760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:57.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.205+0000 7fa2deffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2e00cb2b0 0x7fa2e00c9760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43940/0 (socket says 172.21.15.132:43940) 2023-12-20T04:47:57.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.205+0000 7fa2deffd640 1 -- 172.21.15.132:0/212572163 learned_addr learned my addr 172.21.15.132:0/212572163 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:57.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.205+0000 7fa2df7fe640 1 --2- 172.21.15.132:0/212572163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2e015aee0 0x7fa2e0153f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:57.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.205+0000 7fa2de7fc640 1 --2- 172.21.15.132:0/212572163 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2e00cdbb0 0x7fa2e014f730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:57.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.205+0000 7fa2deffd640 1 -- 172.21.15.132:0/212572163 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2e00cdbb0 msgr2=0x7fa2e014f730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:57.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.205+0000 7fa2deffd640 1 --2- 172.21.15.132:0/212572163 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2e00cdbb0 0x7fa2e014f730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.205+0000 7fa2deffd640 1 -- 172.21.15.132:0/212572163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2e015aee0 msgr2=0x7fa2e0153f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.205+0000 7fa2deffd640 1 --2- 172.21.15.132:0/212572163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2e015aee0 0x7fa2e0153f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.206+0000 7fa2deffd640 1 -- 172.21.15.132:0/212572163 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2c8009400 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.206+0000 7fa2de7fc640 1 --2- 172.21.15.132:0/212572163 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2e00cdbb0 0x7fa2e014f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:57.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.206+0000 7fa2df7fe640 1 --2- 172.21.15.132:0/212572163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2e015aee0 0x7fa2e0153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:47:57.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.206+0000 7fa2deffd640 1 --2- 172.21.15.132:0/212572163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2e00cb2b0 0x7fa2e00c9760 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000c7c0 tx=0x7fa2d000cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:57.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.206+0000 7fa2d77fe640 1 -- 172.21.15.132:0/212572163 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000a640 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.206+0000 7fa2d77fe640 1 -- 172.21.15.132:0/212572163 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2d000a7c0 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.206+0000 7fa2d77fe640 1 -- 172.21.15.132:0/212572163 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2d000ab70 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.206+0000 7fa2e5696640 1 -- 172.21.15.132:0/212572163 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2e00ca150 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.206+0000 7fa2e5696640 1 -- 172.21.15.132:0/212572163 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2e015c370 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.207+0000 7fa2e5696640 1 -- 172.21.15.132:0/212572163 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2e004e840 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.207+0000 7fa2d77fe640 1 -- 172.21.15.132:0/212572163 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa2d000acd0 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.208+0000 7fa2d77fe640 1 --2- 172.21.15.132:0/212572163 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2c006a460 0x7fa2c006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:57.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.208+0000 7fa2d77fe640 1 -- 172.21.15.132:0/212572163 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fa2d0087840 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.208+0000 7fa2de7fc640 1 --2- 172.21.15.132:0/212572163 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2c006a460 0x7fa2c006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:57.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.208+0000 7fa2de7fc640 1 --2- 172.21.15.132:0/212572163 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2c006a460 0x7fa2c006c920 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8036000 tx=0x7fa2c803c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:57.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.212+0000 7fa2d77fe640 1 -- 172.21.15.132:0/212572163 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa2d00531c0 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.377+0000 7fa2e5696640 1 -- 172.21.15.132:0/212572163 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fa2e00ce000 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.383 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.381+0000 7fa2d77fe640 1 -- 172.21.15.132:0/212572163 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v11) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa2e00ce000 con 0x7fa2e00cb2b0 2023-12-20T04:47:57.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.383+0000 7fa2e5696640 1 -- 172.21.15.132:0/212572163 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2c006a460 msgr2=0x7fa2c006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:57.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.383+0000 7fa2e5696640 1 --2- 172.21.15.132:0/212572163 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2c006a460 0x7fa2c006c920 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fa2c8036000 tx=0x7fa2c803c040 comp rx=0 tx=0).stop 2023-12-20T04:47:57.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.383+0000 7fa2e5696640 1 -- 172.21.15.132:0/212572163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2e00cb2b0 msgr2=0x7fa2e00c9760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:57.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.383+0000 7fa2e5696640 1 --2- 172.21.15.132:0/212572163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2e00cb2b0 0x7fa2e00c9760 secure :-1 s=READY pgs=1143 cs=0 l=1 rev1=1 crypto rx=0x7fa2d000c7c0 tx=0x7fa2d000cc80 comp rx=0 tx=0).stop 2023-12-20T04:47:57.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.383+0000 7fa2e5696640 1 -- 172.21.15.132:0/212572163 shutdown_connections 2023-12-20T04:47:57.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.383+0000 7fa2e5696640 1 --2- 172.21.15.132:0/212572163 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2c006a460 0x7fa2c006c920 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.383+0000 7fa2e5696640 1 --2- 172.21.15.132:0/212572163 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2e015aee0 0x7fa2e0153f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.383+0000 7fa2e5696640 1 --2- 172.21.15.132:0/212572163 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2e00cdbb0 0x7fa2e014f730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.383+0000 7fa2e5696640 1 --2- 172.21.15.132:0/212572163 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2e00cb2b0 0x7fa2e00c9760 unknown :-1 s=CLOSED pgs=1143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.383+0000 7fa2e5696640 1 -- 172.21.15.132:0/212572163 >> 172.21.15.132:0/212572163 conn(0x7fa2e0072c60 msgr2=0x7fa2e00b44d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:57.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.384+0000 7fa2e5696640 1 -- 172.21.15.132:0/212572163 shutdown_connections 2023-12-20T04:47:57.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.384+0000 7fa2e5696640 1 -- 172.21.15.132:0/212572163 wait complete. 2023-12-20T04:47:57.397 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file' 2023-12-20T04:47:57.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.495+0000 7f599edf0640 1 Processor -- start 2023-12-20T04:47:57.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.495+0000 7f599edf0640 1 -- start start 2023-12-20T04:47:57.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.496+0000 7f599edf0640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f59980cf0b0 0x7f59980b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:57.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.496+0000 7f599edf0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59980cb420 0x7f59980d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:57.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.496+0000 7f599edf0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f59980cd740 con 0x7f599815e2d0 2023-12-20T04:47:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.496+0000 7f599edf0640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f59980ce230 con 0x7f59980cf0b0 2023-12-20T04:47:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.496+0000 7f599edf0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59980cd990 con 0x7f59980cb420 2023-12-20T04:47:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.496+0000 7f599cb8c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f599815e2d0 0x7f59980ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43698/0 (socket says 172.21.15.132:43698) 2023-12-20T04:47:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.496+0000 7f599cb8c640 1 -- 172.21.15.132:0/1797380024 learned_addr learned my addr 172.21.15.132:0/1797380024 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.496+0000 7f5997fff640 1 --2- 172.21.15.132:0/1797380024 >> v2:172.21.15.187:3300/0 conn(0x7f59980cf0b0 0x7f59980b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.496+0000 7f599d38d640 1 --2- 172.21.15.132:0/1797380024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59980cb420 0x7f59980d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.496+0000 7f59977fe640 1 -- 172.21.15.132:0/1797380024 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2944750541 0 0) 0x7f59980cd740 con 0x7f599815e2d0 2023-12-20T04:47:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.496+0000 7f59977fe640 1 -- 172.21.15.132:0/1797380024 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5980003520 con 0x7f599815e2d0 2023-12-20T04:47:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f59977fe640 1 -- 172.21.15.132:0/1797380024 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1334190874 0 0) 0x7f5980003520 con 0x7f599815e2d0 2023-12-20T04:47:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f59977fe640 1 -- 172.21.15.132:0/1797380024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59980cb420 msgr2=0x7f59980d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f59977fe640 1 --2- 172.21.15.132:0/1797380024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59980cb420 0x7f59980d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f59977fe640 1 -- 172.21.15.132:0/1797380024 >> v2:172.21.15.187:3300/0 conn(0x7f59980cf0b0 msgr2=0x7f59980b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:57.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f59977fe640 1 --2- 172.21.15.132:0/1797380024 >> v2:172.21.15.187:3300/0 conn(0x7f59980cf0b0 0x7f59980b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f59977fe640 1 -- 172.21.15.132:0/1797380024 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59980cdc70 con 0x7f599815e2d0 2023-12-20T04:47:57.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f59977fe640 1 -- 172.21.15.132:0/1797380024 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f5988001670 con 0x7f599815e2d0 2023-12-20T04:47:57.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f59977fe640 1 -- 172.21.15.132:0/1797380024 >> v1:172.21.15.132:6789/0 conn(0x7f599815e2d0 legacy=0x7f59980ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:57.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f59977fe640 1 --2- 172.21.15.132:0/1797380024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5980003970 0x7f5980003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:57.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f59977fe640 1 --2- 172.21.15.132:0/1797380024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59800047c0 0x7f5980004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:57.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f59977fe640 1 --2- 172.21.15.132:0/1797380024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59980cb420 0x7f5980005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:57.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f59977fe640 1 -- 172.21.15.132:0/1797380024 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59980ce230 con 0x7f5980003970 2023-12-20T04:47:57.503 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f59977fe640 1 -- 172.21.15.132:0/1797380024 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59980cd990 con 0x7f59800047c0 2023-12-20T04:47:57.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f59977fe640 1 -- 172.21.15.132:0/1797380024 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f598000b980 con 0x7f59980cb420 2023-12-20T04:47:57.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f599cb8c640 1 --2- 172.21.15.132:0/1797380024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5980003970 0x7f5980003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:57.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f5997fff640 1 --2- 172.21.15.132:0/1797380024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59800047c0 0x7f5980004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:57.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f599d38d640 1 --2- 172.21.15.132:0/1797380024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59980cb420 0x7f5980005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:57.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f599cb8c640 1 -- 172.21.15.132:0/1797380024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59980cb420 msgr2=0x7f5980005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:57.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f599cb8c640 1 --2- 172.21.15.132:0/1797380024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59980cb420 0x7f5980005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f599cb8c640 1 -- 172.21.15.132:0/1797380024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59800047c0 msgr2=0x7f5980004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:57.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f599cb8c640 1 --2- 172.21.15.132:0/1797380024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59800047c0 0x7f5980004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f599cb8c640 1 -- 172.21.15.132:0/1797380024 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5980003520 con 0x7f5980003970 2023-12-20T04:47:57.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f5997fff640 1 --2- 172.21.15.132:0/1797380024 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59800047c0 0x7f5980004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:57.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.497+0000 7f599d38d640 1 --2- 172.21.15.132:0/1797380024 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f59980cb420 0x7f5980005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:57.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.498+0000 7f599cb8c640 1 --2- 172.21.15.132:0/1797380024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5980003970 0x7f5980003d90 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f598800c2c0 tx=0x7f59800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b52c40ca03f4df6b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:57.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.498+0000 7f59977fe640 1 -- 172.21.15.132:0/1797380024 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5988005ad0 con 0x7f5980003970 2023-12-20T04:47:57.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.498+0000 7f59977fe640 1 -- 172.21.15.132:0/1797380024 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5988005c30 con 0x7f5980003970 2023-12-20T04:47:57.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.498+0000 7f59977fe640 1 -- 172.21.15.132:0/1797380024 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f598802c8b0 con 0x7f5980003970 2023-12-20T04:47:57.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.498+0000 7f599edf0640 1 -- 172.21.15.132:0/1797380024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5980003970 msgr2=0x7f5980003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:57.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.498+0000 7f599edf0640 1 --2- 172.21.15.132:0/1797380024 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5980003970 0x7f5980003d90 secure :-1 s=READY pgs=1145 cs=0 l=1 rev1=1 crypto rx=0x7f598800c2c0 tx=0x7f59800057f0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.498+0000 7f599d38d640 1 -- 172.21.15.132:0/1797380024 reap_dead start 2023-12-20T04:47:57.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.498+0000 7f599edf0640 1 -- 172.21.15.132:0/1797380024 shutdown_connections 2023-12-20T04:47:57.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.498+0000 7f599edf0640 1 -- 172.21.15.132:0/1797380024 >> 172.21.15.132:0/1797380024 conn(0x7f599806d7c0 msgr2=0x7f599806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:57.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.498+0000 7f599edf0640 1 -- 172.21.15.132:0/1797380024 shutdown_connections 2023-12-20T04:47:57.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.498+0000 7f599edf0640 1 -- 172.21.15.132:0/1797380024 wait complete. 2023-12-20T04:47:57.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.500+0000 7f599edf0640 1 Processor -- start 2023-12-20T04:47:57.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.500+0000 7f599edf0640 1 -- start start 2023-12-20T04:47:57.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.500+0000 7f599edf0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5980003970 0x7f59981553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:57.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.500+0000 7f599edf0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59980c97c0 0x7f59980b53a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:57.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.500+0000 7f599edf0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59980c9c40 0x7f59980b58e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:57.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.500+0000 7f599edf0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59981558f0 con 0x7f59980c9c40 2023-12-20T04:47:57.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.500+0000 7f599edf0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f59980c82f0 con 0x7f59980c97c0 2023-12-20T04:47:57.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.500+0000 7f599edf0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f59980c85d0 con 0x7f5980003970 2023-12-20T04:47:57.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.501+0000 7f599d38d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59980c9c40 0x7f59980b58e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:57.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.501+0000 7f599d38d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59980c9c40 0x7f59980b58e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59706/0 (socket says 172.21.15.132:59706) 2023-12-20T04:47:57.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.501+0000 7f599d38d640 1 -- 172.21.15.132:0/3452734147 learned_addr learned my addr 172.21.15.132:0/3452734147 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:57.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.501+0000 7f5997fff640 1 --2- 172.21.15.132:0/3452734147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59980c97c0 0x7f59980b53a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:57.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.501+0000 7f599cb8c640 1 --2- 172.21.15.132:0/3452734147 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5980003970 0x7f59981553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:57.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.501+0000 7f599d38d640 1 -- 172.21.15.132:0/3452734147 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5980003970 msgr2=0x7f59981553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:57.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.501+0000 7f599d38d640 1 --2- 172.21.15.132:0/3452734147 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5980003970 0x7f59981553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.501+0000 7f599d38d640 1 -- 172.21.15.132:0/3452734147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59980c97c0 msgr2=0x7f59980b53a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:57.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.501+0000 7f599d38d640 1 --2- 172.21.15.132:0/3452734147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59980c97c0 0x7f59980b53a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:57.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.501+0000 7f599d38d640 1 -- 172.21.15.132:0/3452734147 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f59980c88b0 con 0x7f59980c9c40 2023-12-20T04:47:57.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.501+0000 7f599cb8c640 1 --2- 172.21.15.132:0/3452734147 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5980003970 0x7f59981553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:47:57.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.501+0000 7f599d38d640 1 --2- 172.21.15.132:0/3452734147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59980c9c40 0x7f59980b58e0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f59980ce950 tx=0x7f5990010590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:57.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.501+0000 7f59957fa640 1 -- 172.21.15.132:0/3452734147 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f599000e050 con 0x7f59980c9c40 2023-12-20T04:47:57.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.501+0000 7f59957fa640 1 -- 172.21.15.132:0/3452734147 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f599000f040 con 0x7f59980c9c40 2023-12-20T04:47:57.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.501+0000 7f599edf0640 1 -- 172.21.15.132:0/3452734147 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f59980c8b90 con 0x7f59980c9c40 2023-12-20T04:47:57.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.501+0000 7f59957fa640 1 -- 172.21.15.132:0/3452734147 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5990003bd0 con 0x7f59980c9c40 2023-12-20T04:47:57.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.501+0000 7f599edf0640 1 -- 172.21.15.132:0/3452734147 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f59980c8080 con 0x7f59980c9c40 2023-12-20T04:47:57.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.502+0000 7f599edf0640 1 -- 172.21.15.132:0/3452734147 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f59980c8d20 con 0x7f59980c9c40 2023-12-20T04:47:57.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.503+0000 7f59957fa640 1 -- 172.21.15.132:0/3452734147 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5990003d30 con 0x7f59980c9c40 2023-12-20T04:47:57.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.503+0000 7f59957fa640 1 --2- 172.21.15.132:0/3452734147 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f598406a430 0x7f598406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:57.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.503+0000 7f59957fa640 1 -- 172.21.15.132:0/3452734147 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5990088f60 con 0x7f59980c9c40 2023-12-20T04:47:57.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.503+0000 7f599cb8c640 1 --2- 172.21.15.132:0/3452734147 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f598406a430 0x7f598406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:57.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.503+0000 7f599cb8c640 1 --2- 172.21.15.132:0/3452734147 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f598406a430 0x7f598406c8f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5988034000 tx=0x7f5988007000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:57.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.507+0000 7f59957fa640 1 -- 172.21.15.132:0/3452734147 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f59900548e0 con 0x7f59980c9c40 2023-12-20T04:47:57.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:57.735+0000 7f599edf0640 1 -- 172.21.15.132:0/3452734147 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]} v 0) v1 -- 0x7f599804e840 con 0x7f59980c9c40 2023-12-20T04:47:58.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.077+0000 7f59957fa640 1 -- 172.21.15.132:0/3452734147 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestClusterFull.test_full_same_file"]}]=0 v278) v1 ==== 137+0+0 (secure 0 0 0) 0x7f5990057f00 con 0x7f59980c9c40 2023-12-20T04:47:58.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.080+0000 7f599edf0640 1 -- 172.21.15.132:0/3452734147 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f598406a430 msgr2=0x7f598406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:58.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.080+0000 7f599edf0640 1 --2- 172.21.15.132:0/3452734147 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f598406a430 0x7f598406c8f0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f5988034000 tx=0x7f5988007000 comp rx=0 tx=0).stop 2023-12-20T04:47:58.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.080+0000 7f599edf0640 1 -- 172.21.15.132:0/3452734147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59980c9c40 msgr2=0x7f59980b58e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:58.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.080+0000 7f599edf0640 1 --2- 172.21.15.132:0/3452734147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59980c9c40 0x7f59980b58e0 secure :-1 s=READY pgs=1146 cs=0 l=1 rev1=1 crypto rx=0x7f59980ce950 tx=0x7f5990010590 comp rx=0 tx=0).stop 2023-12-20T04:47:58.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.080+0000 7f599edf0640 1 -- 172.21.15.132:0/3452734147 shutdown_connections 2023-12-20T04:47:58.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.080+0000 7f599edf0640 1 --2- 172.21.15.132:0/3452734147 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f598406a430 0x7f598406c8f0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:58.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.080+0000 7f599edf0640 1 --2- 172.21.15.132:0/3452734147 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f59980c9c40 0x7f59980b58e0 unknown :-1 s=CLOSED pgs=1146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:58.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.080+0000 7f599edf0640 1 --2- 172.21.15.132:0/3452734147 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f59980c97c0 0x7f59980b53a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:58.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.080+0000 7f599edf0640 1 --2- 172.21.15.132:0/3452734147 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5980003970 0x7f59981553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:58.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.080+0000 7f599edf0640 1 -- 172.21.15.132:0/3452734147 >> 172.21.15.132:0/3452734147 conn(0x7f599806d7c0 msgr2=0x7f599815ef70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:58.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.080+0000 7f599edf0640 1 -- 172.21.15.132:0/3452734147 shutdown_connections 2023-12-20T04:47:58.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.080+0000 7f599edf0640 1 -- 172.21.15.132:0/3452734147 wait complete. 2023-12-20T04:47:58.094 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestClusterFull) ... ok 2023-12-20T04:47:58.094 INFO:tasks.cephfs_test_runner:Starting test: test_barrier (tasks.cephfs.test_full.TestQuotaFull) That when an OSD epoch barrier is set on an MDS, subsequently 2023-12-20T04:47:58.095 INFO:tasks.cephfs_test_runner:test_barrier (tasks.cephfs.test_full.TestQuotaFull) 2023-12-20T04:47:58.095 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-12-20T04:47:58.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.194+0000 7fe12853e640 1 Processor -- start 2023-12-20T04:47:58.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.194+0000 7fe12853e640 1 -- start start 2023-12-20T04:47:58.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.195+0000 7fe12853e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe1200cdc10 0x7fe12006c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:58.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.195+0000 7fe12853e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1201613c0 con 0x7fe1200d0370 2023-12-20T04:47:58.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.195+0000 7fe12853e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1200d1b00 con 0x7fe12015d100 2023-12-20T04:47:58.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.195+0000 7fe12853e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe12006cde0 con 0x7fe1200cdc10 2023-12-20T04:47:58.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.195+0000 7fe126adb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe1200cdc10 0x7fe12006c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:58.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.195+0000 7fe125ad9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe1200d0370 0x7fe12006c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43714/0 (socket says 172.21.15.132:43714) 2023-12-20T04:47:58.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.195+0000 7fe125ad9640 1 -- 172.21.15.132:0/843727738 learned_addr learned my addr 172.21.15.132:0/843727738 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:47:58.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.195+0000 7fe126adb640 1 -- 172.21.15.132:0/843727738 >> v1:172.21.15.187:6789/0 conn(0x7fe12015d100 legacy=0x7fe1200cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:58.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.195+0000 7fe126adb640 1 -- 172.21.15.132:0/843727738 >> v1:172.21.15.132:6789/0 conn(0x7fe1200d0370 legacy=0x7fe12006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:58.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.195+0000 7fe126adb640 1 -- 172.21.15.132:0/843727738 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1200d0810 con 0x7fe1200cdc10 2023-12-20T04:47:58.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.196+0000 7fe126adb640 1 --2- 172.21.15.132:0/843727738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1200cdc10 0x7fe12006c8a0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fe118009d90 tx=0x7fe11802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2259e312ed2ec161 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:58.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.196+0000 7fe1252d8640 1 -- 172.21.15.132:0/843727738 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe11802cc60 con 0x7fe1200cdc10 2023-12-20T04:47:58.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.196+0000 7fe1252d8640 1 -- 172.21.15.132:0/843727738 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe11802cdc0 con 0x7fe1200cdc10 2023-12-20T04:47:58.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.196+0000 7fe1252d8640 1 -- 172.21.15.132:0/843727738 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118034660 con 0x7fe1200cdc10 2023-12-20T04:47:58.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.196+0000 7fe12853e640 1 -- 172.21.15.132:0/843727738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1200cdc10 msgr2=0x7fe12006c8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:58.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.196+0000 7fe12853e640 1 --2- 172.21.15.132:0/843727738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1200cdc10 0x7fe12006c8a0 secure :-1 s=READY pgs=1148 cs=0 l=1 rev1=1 crypto rx=0x7fe118009d90 tx=0x7fe11802beb0 comp rx=0 tx=0).stop 2023-12-20T04:47:58.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.197+0000 7fe12853e640 1 -- 172.21.15.132:0/843727738 shutdown_connections 2023-12-20T04:47:58.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.197+0000 7fe12853e640 1 --2- 172.21.15.132:0/843727738 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1200cdc10 0x7fe12006c8a0 unknown :-1 s=CLOSED pgs=1148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:58.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.197+0000 7fe12853e640 1 -- 172.21.15.132:0/843727738 >> 172.21.15.132:0/843727738 conn(0x7fe12006d7c0 msgr2=0x7fe12006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:58.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.197+0000 7fe12853e640 1 -- 172.21.15.132:0/843727738 shutdown_connections 2023-12-20T04:47:58.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.197+0000 7fe12853e640 1 -- 172.21.15.132:0/843727738 wait complete. 2023-12-20T04:47:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.198+0000 7fe12853e640 1 Processor -- start 2023-12-20T04:47:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.198+0000 7fe12853e640 1 -- start start 2023-12-20T04:47:58.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.198+0000 7fe12853e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1200cdc10 0x7fe1200b4df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.198+0000 7fe12853e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1200d0370 0x7fe1201e67d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.198+0000 7fe12853e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe12015d100 0x7fe120158d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.198+0000 7fe12853e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1200b5330 con 0x7fe12015d100 2023-12-20T04:47:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.198+0000 7fe12853e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe12015ab90 con 0x7fe1200d0370 2023-12-20T04:47:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.198+0000 7fe12853e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe12015a5d0 con 0x7fe1200cdc10 2023-12-20T04:47:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.199+0000 7fe126adb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe12015d100 0x7fe120158d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:58.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.199+0000 7fe126adb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe12015d100 0x7fe120158d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59724/0 (socket says 172.21.15.132:59724) 2023-12-20T04:47:58.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.199+0000 7fe126adb640 1 -- 172.21.15.132:0/1156097755 learned_addr learned my addr 172.21.15.132:0/1156097755 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:58.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.199+0000 7fe125ad9640 1 --2- 172.21.15.132:0/1156097755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1200d0370 0x7fe1201e67d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:58.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.199+0000 7fe1262da640 1 --2- 172.21.15.132:0/1156097755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1200cdc10 0x7fe1200b4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:58.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.199+0000 7fe126adb640 1 -- 172.21.15.132:0/1156097755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1200cdc10 msgr2=0x7fe1200b4df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:58.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.199+0000 7fe126adb640 1 --2- 172.21.15.132:0/1156097755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1200cdc10 0x7fe1200b4df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:58.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.199+0000 7fe126adb640 1 -- 172.21.15.132:0/1156097755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1200d0370 msgr2=0x7fe1201e67d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:58.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.199+0000 7fe126adb640 1 --2- 172.21.15.132:0/1156097755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1200d0370 0x7fe1201e67d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:58.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.199+0000 7fe126adb640 1 -- 172.21.15.132:0/1156097755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe118009a70 con 0x7fe12015d100 2023-12-20T04:47:58.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.199+0000 7fe126adb640 1 --2- 172.21.15.132:0/1156097755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe12015d100 0x7fe120158d50 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fe118009d90 tx=0x7fe118004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:58.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.199+0000 7fe116ffd640 1 -- 172.21.15.132:0/1156097755 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118040450 con 0x7fe12015d100 2023-12-20T04:47:58.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.199+0000 7fe116ffd640 1 -- 172.21.15.132:0/1156097755 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1180405d0 con 0x7fe12015d100 2023-12-20T04:47:58.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.199+0000 7fe12853e640 1 -- 172.21.15.132:0/1156097755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe12015a8b0 con 0x7fe12015d100 2023-12-20T04:47:58.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.199+0000 7fe116ffd640 1 -- 172.21.15.132:0/1156097755 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe118040980 con 0x7fe12015d100 2023-12-20T04:47:58.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.199+0000 7fe12853e640 1 -- 172.21.15.132:0/1156097755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1200c8220 con 0x7fe12015d100 2023-12-20T04:47:58.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.200+0000 7fe12853e640 1 -- 172.21.15.132:0/1156097755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe12004e840 con 0x7fe12015d100 2023-12-20T04:47:58.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.200+0000 7fe116ffd640 1 -- 172.21.15.132:0/1156097755 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe118040ae0 con 0x7fe12015d100 2023-12-20T04:47:58.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.201+0000 7fe116ffd640 1 --2- 172.21.15.132:0/1156097755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe10406a430 0x7fe10406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:58.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.201+0000 7fe116ffd640 1 -- 172.21.15.132:0/1156097755 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe1180ab120 con 0x7fe12015d100 2023-12-20T04:47:58.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.201+0000 7fe1262da640 1 --2- 172.21.15.132:0/1156097755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe10406a430 0x7fe10406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:58.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.201+0000 7fe1262da640 1 --2- 172.21.15.132:0/1156097755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe10406a430 0x7fe10406c8f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe11c006fd0 tx=0x7fe11c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:58.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.205+0000 7fe116ffd640 1 -- 172.21.15.132:0/1156097755 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe118076ad0 con 0x7fe12015d100 2023-12-20T04:47:58.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:58.433+0000 7fe12853e640 1 -- 172.21.15.132:0/1156097755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7fe1200cb3b0 con 0x7fe12015d100 2023-12-20T04:47:59.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.081+0000 7fe116ffd640 1 -- 172.21.15.132:0/1156097755 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v279) v1 ==== 131+0+0 (secure 0 0 0) 0x7fe11807a0f0 con 0x7fe12015d100 2023-12-20T04:47:59.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.083+0000 7fe12853e640 1 -- 172.21.15.132:0/1156097755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe10406a430 msgr2=0x7fe10406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:59.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.083+0000 7fe12853e640 1 --2- 172.21.15.132:0/1156097755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe10406a430 0x7fe10406c8f0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fe11c006fd0 tx=0x7fe11c008040 comp rx=0 tx=0).stop 2023-12-20T04:47:59.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.083+0000 7fe12853e640 1 -- 172.21.15.132:0/1156097755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe12015d100 msgr2=0x7fe120158d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:59.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.083+0000 7fe12853e640 1 --2- 172.21.15.132:0/1156097755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe12015d100 0x7fe120158d50 secure :-1 s=READY pgs=1149 cs=0 l=1 rev1=1 crypto rx=0x7fe118009d90 tx=0x7fe118004a40 comp rx=0 tx=0).stop 2023-12-20T04:47:59.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.084+0000 7fe12853e640 1 -- 172.21.15.132:0/1156097755 shutdown_connections 2023-12-20T04:47:59.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.084+0000 7fe12853e640 1 --2- 172.21.15.132:0/1156097755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe10406a430 0x7fe10406c8f0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.084+0000 7fe12853e640 1 --2- 172.21.15.132:0/1156097755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe12015d100 0x7fe120158d50 unknown :-1 s=CLOSED pgs=1149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.084+0000 7fe12853e640 1 --2- 172.21.15.132:0/1156097755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1200d0370 0x7fe1201e67d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.084+0000 7fe12853e640 1 --2- 172.21.15.132:0/1156097755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1200cdc10 0x7fe1200b4df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.084+0000 7fe12853e640 1 -- 172.21.15.132:0/1156097755 >> 172.21.15.132:0/1156097755 conn(0x7fe12006d7c0 msgr2=0x7fe12015f4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:59.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.084+0000 7fe12853e640 1 -- 172.21.15.132:0/1156097755 shutdown_connections 2023-12-20T04:47:59.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.084+0000 7fe12853e640 1 -- 172.21.15.132:0/1156097755 wait complete. 2023-12-20T04:47:59.098 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-20T04:47:59.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.201+0000 7fbb6a68f640 1 Processor -- start 2023-12-20T04:47:59.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.201+0000 7fbb6a68f640 1 -- start start 2023-12-20T04:47:59.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.202+0000 7fbb6a68f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbb6415d300 0x7fbb640d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:59.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.202+0000 7fbb6a68f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbb640cff90 0x7fbb640b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:59.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.202+0000 7fbb6a68f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb640d1a90 con 0x7fbb640d1550 2023-12-20T04:47:59.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.202+0000 7fbb6a68f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb640d1d70 con 0x7fbb6415d300 2023-12-20T04:47:59.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.202+0000 7fbb6a68f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb640d2050 con 0x7fbb640cff90 2023-12-20T04:47:59.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.202+0000 7fbb63fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbb6415d300 0x7fbb640d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:59.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.202+0000 7fbb63fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbb6415d300 0x7fbb640d1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59736/0 (socket says 172.21.15.132:59736) 2023-12-20T04:47:59.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.202+0000 7fbb63fff640 1 -- 172.21.15.132:0/1276066760 learned_addr learned my addr 172.21.15.132:0/1276066760 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:59.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.202+0000 7fbb63fff640 1 -- 172.21.15.132:0/1276066760 >> v2:172.21.15.187:3300/0 conn(0x7fbb640cff90 msgr2=0x7fbb640b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:59.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.202+0000 7fbb63fff640 1 --2- 172.21.15.132:0/1276066760 >> v2:172.21.15.187:3300/0 conn(0x7fbb640cff90 0x7fbb640b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.202+0000 7fbb63fff640 1 -- 172.21.15.132:0/1276066760 >> v1:172.21.15.187:6789/0 conn(0x7fbb640d1550 legacy=0x7fbb640cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:59.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.202+0000 7fbb63fff640 1 -- 172.21.15.132:0/1276066760 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb640d2330 con 0x7fbb6415d300 2023-12-20T04:47:59.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.203+0000 7fbb63fff640 1 --2- 172.21.15.132:0/1276066760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb6415d300 0x7fbb640d1010 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fbb640d07c0 tx=0x7fbb5402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=111c7734833aa5e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:59.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.203+0000 7fbb62ffd640 1 -- 172.21.15.132:0/1276066760 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb54031870 con 0x7fbb6415d300 2023-12-20T04:47:59.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.203+0000 7fbb62ffd640 1 -- 172.21.15.132:0/1276066760 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb540319d0 con 0x7fbb6415d300 2023-12-20T04:47:59.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.203+0000 7fbb62ffd640 1 -- 172.21.15.132:0/1276066760 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb54031d60 con 0x7fbb6415d300 2023-12-20T04:47:59.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.203+0000 7fbb6a68f640 1 -- 172.21.15.132:0/1276066760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb6415d300 msgr2=0x7fbb640d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:59.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.203+0000 7fbb6a68f640 1 --2- 172.21.15.132:0/1276066760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb6415d300 0x7fbb640d1010 secure :-1 s=READY pgs=1150 cs=0 l=1 rev1=1 crypto rx=0x7fbb640d07c0 tx=0x7fbb5402b910 comp rx=0 tx=0).stop 2023-12-20T04:47:59.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.203+0000 7fbb6a68f640 1 -- 172.21.15.132:0/1276066760 shutdown_connections 2023-12-20T04:47:59.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.203+0000 7fbb6a68f640 1 --2- 172.21.15.132:0/1276066760 >> v2:172.21.15.187:3300/0 conn(0x7fbb640cff90 0x7fbb640b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.204+0000 7fbb6a68f640 1 --2- 172.21.15.132:0/1276066760 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb6415d300 0x7fbb640d1010 unknown :-1 s=CLOSED pgs=1150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.204+0000 7fbb6a68f640 1 -- 172.21.15.132:0/1276066760 >> 172.21.15.132:0/1276066760 conn(0x7fbb6406a3d0 msgr2=0x7fbb6406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:59.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.204+0000 7fbb6a68f640 1 -- 172.21.15.132:0/1276066760 shutdown_connections 2023-12-20T04:47:59.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.204+0000 7fbb6a68f640 1 -- 172.21.15.132:0/1276066760 wait complete. 2023-12-20T04:47:59.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.205+0000 7fbb6a68f640 1 Processor -- start 2023-12-20T04:47:59.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.205+0000 7fbb6a68f640 1 -- start start 2023-12-20T04:47:59.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.205+0000 7fbb6a68f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb640cff90 0x7fbb6414b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:59.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.205+0000 7fbb6a68f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb640d1550 0x7fbb6414a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:59.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.205+0000 7fbb6a68f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb6415d300 0x7fbb6414ce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:59.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb6a68f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb640cae60 con 0x7fbb640cff90 2023-12-20T04:47:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb6a68f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb641f2f00 con 0x7fbb640d1550 2023-12-20T04:47:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb6a68f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6415ff90 con 0x7fbb6415d300 2023-12-20T04:47:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb63fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb640cff90 0x7fbb6414b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb63fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb640cff90 0x7fbb6414b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59740/0 (socket says 172.21.15.132:59740) 2023-12-20T04:47:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb63fff640 1 -- 172.21.15.132:0/1093719771 learned_addr learned my addr 172.21.15.132:0/1093719771 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb637fe640 1 --2- 172.21.15.132:0/1093719771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb640d1550 0x7fbb6414a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb68c2c640 1 --2- 172.21.15.132:0/1093719771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb6415d300 0x7fbb6414ce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb63fff640 1 -- 172.21.15.132:0/1093719771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb6415d300 msgr2=0x7fbb6414ce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb63fff640 1 --2- 172.21.15.132:0/1093719771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb6415d300 0x7fbb6414ce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb63fff640 1 -- 172.21.15.132:0/1093719771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb640d1550 msgr2=0x7fbb6414a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb63fff640 1 --2- 172.21.15.132:0/1093719771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb640d1550 0x7fbb6414a160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb63fff640 1 -- 172.21.15.132:0/1093719771 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb540094d0 con 0x7fbb640cff90 2023-12-20T04:47:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb63fff640 1 --2- 172.21.15.132:0/1093719771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb640cff90 0x7fbb6414b5d0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fbb54000c00 tx=0x7fbb540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb60ff9640 1 -- 172.21.15.132:0/1093719771 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb54031840 con 0x7fbb640cff90 2023-12-20T04:47:59.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb60ff9640 1 -- 172.21.15.132:0/1093719771 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb540443f0 con 0x7fbb640cff90 2023-12-20T04:47:59.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb6a68f640 1 -- 172.21.15.132:0/1093719771 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb640ca530 con 0x7fbb640cff90 2023-12-20T04:47:59.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb60ff9640 1 -- 172.21.15.132:0/1093719771 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb540447a0 con 0x7fbb640cff90 2023-12-20T04:47:59.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.206+0000 7fbb6a68f640 1 -- 172.21.15.132:0/1093719771 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb640caaf0 con 0x7fbb640cff90 2023-12-20T04:47:59.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.207+0000 7fbb6a68f640 1 -- 172.21.15.132:0/1093719771 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb6404e840 con 0x7fbb640cff90 2023-12-20T04:47:59.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.208+0000 7fbb60ff9640 1 -- 172.21.15.132:0/1093719771 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbb5404d450 con 0x7fbb640cff90 2023-12-20T04:47:59.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.208+0000 7fbb60ff9640 1 --2- 172.21.15.132:0/1093719771 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb5006a430 0x7fbb5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:59.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.208+0000 7fbb637fe640 1 --2- 172.21.15.132:0/1093719771 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb5006a430 0x7fbb5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:59.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.208+0000 7fbb60ff9640 1 -- 172.21.15.132:0/1093719771 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fbb5402d040 con 0x7fbb640cff90 2023-12-20T04:47:59.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.209+0000 7fbb637fe640 1 --2- 172.21.15.132:0/1093719771 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb5006a430 0x7fbb5006c8f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbb640c5c20 tx=0x7fbb58009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:59.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.213+0000 7fbb60ff9640 1 -- 172.21.15.132:0/1093719771 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbb54076730 con 0x7fbb640cff90 2023-12-20T04:47:59.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.377+0000 7fbb6a68f640 1 -- 172.21.15.132:0/1093719771 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fbb640b7ce0 con 0x7fbb640cff90 2023-12-20T04:47:59.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.380+0000 7fbb60ff9640 1 -- 172.21.15.132:0/1093719771 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v12)=0 v12) v1 ==== 122+0+0 (secure 0 0 0) 0x7fbb54079d50 con 0x7fbb640cff90 2023-12-20T04:47:59.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.382+0000 7fbb6a68f640 1 -- 172.21.15.132:0/1093719771 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb5006a430 msgr2=0x7fbb5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:59.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.382+0000 7fbb6a68f640 1 --2- 172.21.15.132:0/1093719771 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb5006a430 0x7fbb5006c8f0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fbb640c5c20 tx=0x7fbb58009040 comp rx=0 tx=0).stop 2023-12-20T04:47:59.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.382+0000 7fbb6a68f640 1 -- 172.21.15.132:0/1093719771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb640cff90 msgr2=0x7fbb6414b5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:59.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.382+0000 7fbb6a68f640 1 --2- 172.21.15.132:0/1093719771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb640cff90 0x7fbb6414b5d0 secure :-1 s=READY pgs=1151 cs=0 l=1 rev1=1 crypto rx=0x7fbb54000c00 tx=0x7fbb540046c0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.382+0000 7fbb6a68f640 1 -- 172.21.15.132:0/1093719771 shutdown_connections 2023-12-20T04:47:59.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.382+0000 7fbb6a68f640 1 --2- 172.21.15.132:0/1093719771 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb5006a430 0x7fbb5006c8f0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.382+0000 7fbb6a68f640 1 --2- 172.21.15.132:0/1093719771 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb6415d300 0x7fbb6414ce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.382+0000 7fbb6a68f640 1 --2- 172.21.15.132:0/1093719771 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb640d1550 0x7fbb6414a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.382+0000 7fbb6a68f640 1 --2- 172.21.15.132:0/1093719771 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb640cff90 0x7fbb6414b5d0 unknown :-1 s=CLOSED pgs=1151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.382+0000 7fbb6a68f640 1 -- 172.21.15.132:0/1093719771 >> 172.21.15.132:0/1093719771 conn(0x7fbb6406a3d0 msgr2=0x7fbb640b6de0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:59.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.382+0000 7fbb6a68f640 1 -- 172.21.15.132:0/1093719771 shutdown_connections 2023-12-20T04:47:59.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.382+0000 7fbb6a68f640 1 -- 172.21.15.132:0/1093719771 wait complete. 2023-12-20T04:47:59.395 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:47:59.396 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:47:59.438 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:47:59.487 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:47:59.488 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:47:59.488 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:47:59.502 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:47:59.503 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:47:59.503 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:47:59.519 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:47:59.520 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:47:59.520 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:47:59.558 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:47:59.558 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:47:59.558 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:47:59.576 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:47:59.576 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-20T04:47:59.577 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:47:59.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.697+0000 7fc6331c9640 1 Processor -- start 2023-12-20T04:47:59.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.697+0000 7fc6331c9640 1 -- start start 2023-12-20T04:47:59.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.698+0000 7fc6331c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc62c0d0370 0x7fc62c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:59.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.698+0000 7fc6331c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc62c0cdc10 0x7fc62c06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:59.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.698+0000 7fc6331c9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc62c0b2f90 con 0x7fc62c15d100 2023-12-20T04:47:59.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.698+0000 7fc6331c9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc62c1613c0 con 0x7fc62c0cdc10 2023-12-20T04:47:59.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.698+0000 7fc6331c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c0d1b00 con 0x7fc62c0d0370 2023-12-20T04:47:59.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.698+0000 7fc631766640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc62c0cdc10 0x7fc62c06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:59.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.698+0000 7fc631766640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc62c0cdc10 0x7fc62c06c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59750/0 (socket says 172.21.15.132:59750) 2023-12-20T04:47:59.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.698+0000 7fc631766640 1 -- 172.21.15.132:0/838956701 learned_addr learned my addr 172.21.15.132:0/838956701 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:59.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.698+0000 7fc62bfff640 1 --2- 172.21.15.132:0/838956701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc62c0d0370 0x7fc62c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:59.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.698+0000 7fc631766640 1 -- 172.21.15.132:0/838956701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc62c0d0370 msgr2=0x7fc62c0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:47:59.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.698+0000 7fc631766640 1 --2- 172.21.15.132:0/838956701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc62c0d0370 0x7fc62c0b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.698+0000 7fc631766640 1 -- 172.21.15.132:0/838956701 >> v1:172.21.15.187:6789/0 conn(0x7fc62c15d100 legacy=0x7fc62c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:59.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.698+0000 7fc631766640 1 -- 172.21.15.132:0/838956701 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc62c0d0810 con 0x7fc62c0cdc10 2023-12-20T04:47:59.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.699+0000 7fc631766640 1 --2- 172.21.15.132:0/838956701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc62c0cdc10 0x7fc62c06c190 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fc624009e50 tx=0x7fc62402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29cf18dd0f96f511 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:59.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.699+0000 7fc62b7fe640 1 -- 172.21.15.132:0/838956701 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62402ca70 con 0x7fc62c0cdc10 2023-12-20T04:47:59.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.699+0000 7fc62b7fe640 1 -- 172.21.15.132:0/838956701 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc62402cbd0 con 0x7fc62c0cdc10 2023-12-20T04:47:59.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.699+0000 7fc62b7fe640 1 -- 172.21.15.132:0/838956701 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6240343f0 con 0x7fc62c0cdc10 2023-12-20T04:47:59.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.700+0000 7fc6331c9640 1 -- 172.21.15.132:0/838956701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc62c0cdc10 msgr2=0x7fc62c06c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:59.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.700+0000 7fc6331c9640 1 --2- 172.21.15.132:0/838956701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc62c0cdc10 0x7fc62c06c190 secure :-1 s=READY pgs=1152 cs=0 l=1 rev1=1 crypto rx=0x7fc624009e50 tx=0x7fc62402bed0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.700+0000 7fc6331c9640 1 -- 172.21.15.132:0/838956701 shutdown_connections 2023-12-20T04:47:59.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.700+0000 7fc6331c9640 1 --2- 172.21.15.132:0/838956701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc62c0cdc10 0x7fc62c06c190 unknown :-1 s=CLOSED pgs=1152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.700+0000 7fc6331c9640 1 --2- 172.21.15.132:0/838956701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc62c0d0370 0x7fc62c0b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.700+0000 7fc6331c9640 1 -- 172.21.15.132:0/838956701 >> 172.21.15.132:0/838956701 conn(0x7fc62c06d7c0 msgr2=0x7fc62c06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:59.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.700+0000 7fc6331c9640 1 -- 172.21.15.132:0/838956701 shutdown_connections 2023-12-20T04:47:59.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.700+0000 7fc6331c9640 1 -- 172.21.15.132:0/838956701 wait complete. 2023-12-20T04:47:59.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.701+0000 7fc6331c9640 1 Processor -- start 2023-12-20T04:47:59.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.701+0000 7fc6331c9640 1 -- start start 2023-12-20T04:47:59.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc6331c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc62c0cdc10 0x7fc62c15fef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:59.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc6331c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc62c0d0370 0x7fc62c1e64d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:59.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc6331c9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc62c15d100 0x7fc62c15b740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:59.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc6331c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c1e6a10 con 0x7fc62c0d0370 2023-12-20T04:47:59.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc6331c9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c15bc80 con 0x7fc62c15d100 2023-12-20T04:47:59.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc6331c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc62c15e310 con 0x7fc62c0cdc10 2023-12-20T04:47:59.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc62bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc62c0d0370 0x7fc62c1e64d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:59.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc62bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc62c0d0370 0x7fc62c1e64d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59752/0 (socket says 172.21.15.132:59752) 2023-12-20T04:47:59.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc62bfff640 1 -- 172.21.15.132:0/2936533629 learned_addr learned my addr 172.21.15.132:0/2936533629 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:47:59.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc62bfff640 1 -- 172.21.15.132:0/2936533629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc62c0cdc10 msgr2=0x7fc62c15fef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:59.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc631766640 1 --2- 172.21.15.132:0/2936533629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc62c15d100 0x7fc62c15b740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:59.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc630f65640 1 --2- 172.21.15.132:0/2936533629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc62c0cdc10 0x7fc62c15fef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:59.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc62bfff640 1 --2- 172.21.15.132:0/2936533629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc62c0cdc10 0x7fc62c15fef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc62bfff640 1 -- 172.21.15.132:0/2936533629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc62c15d100 msgr2=0x7fc62c15b740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:59.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc62bfff640 1 --2- 172.21.15.132:0/2936533629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc62c15d100 0x7fc62c15b740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc62bfff640 1 -- 172.21.15.132:0/2936533629 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc624009b30 con 0x7fc62c0d0370 2023-12-20T04:47:59.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc62bfff640 1 --2- 172.21.15.132:0/2936533629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc62c0d0370 0x7fc62c1e64d0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fc61800d800 tx=0x7fc61800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:59.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc6297fa640 1 -- 172.21.15.132:0/2936533629 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61800b6c0 con 0x7fc62c0d0370 2023-12-20T04:47:59.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc6297fa640 1 -- 172.21.15.132:0/2936533629 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc61800b820 con 0x7fc62c0d0370 2023-12-20T04:47:59.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc6331c9640 1 -- 172.21.15.132:0/2936533629 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc62c15e5b0 con 0x7fc62c0d0370 2023-12-20T04:47:59.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc6297fa640 1 -- 172.21.15.132:0/2936533629 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc61800bbb0 con 0x7fc62c0d0370 2023-12-20T04:47:59.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.702+0000 7fc6331c9640 1 -- 172.21.15.132:0/2936533629 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc62c15eb70 con 0x7fc62c0d0370 2023-12-20T04:47:59.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.703+0000 7fc6331c9640 1 -- 172.21.15.132:0/2936533629 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc62c15ed30 con 0x7fc62c0d0370 2023-12-20T04:47:59.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.704+0000 7fc6297fa640 1 -- 172.21.15.132:0/2936533629 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc61800bd10 con 0x7fc62c0d0370 2023-12-20T04:47:59.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.704+0000 7fc6297fa640 1 --2- 172.21.15.132:0/2936533629 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc61006a430 0x7fc61006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:47:59.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.704+0000 7fc6297fa640 1 -- 172.21.15.132:0/2936533629 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(113..113 src has 1..113) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc618088b20 con 0x7fc62c0d0370 2023-12-20T04:47:59.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.704+0000 7fc630f65640 1 --2- 172.21.15.132:0/2936533629 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc61006a430 0x7fc61006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:47:59.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.705+0000 7fc630f65640 1 --2- 172.21.15.132:0/2936533629 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc61006a430 0x7fc61006c8f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc620000f60 tx=0x7fc620009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:47:59.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.709+0000 7fc6297fa640 1 -- 172.21.15.132:0/2936533629 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc618054410 con 0x7fc62c0d0370 2023-12-20T04:47:59.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.912+0000 7fc6331c9640 1 -- 172.21.15.132:0/2936533629 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc62c04e840 con 0x7fc62c0d0370 2023-12-20T04:47:59.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.912+0000 7fc6297fa640 1 -- 172.21.15.132:0/2936533629 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 40 v40) v1 ==== 94+0+3538 (secure 0 0 0) 0x7fc618057a30 con 0x7fc62c0d0370 2023-12-20T04:47:59.914 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:47:59.914 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":40,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":5918,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/3799935532","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3799935532},{"type":"v1","addr":"172.21.15.187:6834","nonce":3799935532}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":40},{"gid":6939,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2115867433","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2115867433},{"type":"v1","addr":"172.21.15.132:6837","nonce":2115867433}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6942,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/162444556","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":162444556},{"type":"v1","addr":"172.21.15.132:6836","nonce":162444556}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35},{"gid":6954,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2089611890","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2089611890},{"type":"v1","addr":"172.21.15.187:6835","nonce":2089611890}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":35}],"filesystems":[]} 2023-12-20T04:47:59.915 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 40 2023-12-20T04:47:59.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.914+0000 7fc6331c9640 1 -- 172.21.15.132:0/2936533629 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc61006a430 msgr2=0x7fc61006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:59.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.914+0000 7fc6331c9640 1 --2- 172.21.15.132:0/2936533629 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc61006a430 0x7fc61006c8f0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7fc620000f60 tx=0x7fc620009040 comp rx=0 tx=0).stop 2023-12-20T04:47:59.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.914+0000 7fc6331c9640 1 -- 172.21.15.132:0/2936533629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc62c0d0370 msgr2=0x7fc62c1e64d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:47:59.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.914+0000 7fc6331c9640 1 --2- 172.21.15.132:0/2936533629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc62c0d0370 0x7fc62c1e64d0 secure :-1 s=READY pgs=1153 cs=0 l=1 rev1=1 crypto rx=0x7fc61800d800 tx=0x7fc61800dcc0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.914+0000 7fc6331c9640 1 -- 172.21.15.132:0/2936533629 shutdown_connections 2023-12-20T04:47:59.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.914+0000 7fc6331c9640 1 --2- 172.21.15.132:0/2936533629 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc61006a430 0x7fc61006c8f0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.914+0000 7fc6331c9640 1 --2- 172.21.15.132:0/2936533629 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc62c15d100 0x7fc62c15b740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.914+0000 7fc6331c9640 1 --2- 172.21.15.132:0/2936533629 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc62c0d0370 0x7fc62c1e64d0 unknown :-1 s=CLOSED pgs=1153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.914+0000 7fc6331c9640 1 --2- 172.21.15.132:0/2936533629 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc62c0cdc10 0x7fc62c15fef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:47:59.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.914+0000 7fc6331c9640 1 -- 172.21.15.132:0/2936533629 >> 172.21.15.132:0/2936533629 conn(0x7fc62c06d7c0 msgr2=0x7fc62c0c9eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:47:59.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.914+0000 7fc6331c9640 1 -- 172.21.15.132:0/2936533629 shutdown_connections 2023-12-20T04:47:59.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:47:59.914+0000 7fc6331c9640 1 -- 172.21.15.132:0/2936533629 wait complete. 2023-12-20T04:47:59.927 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-20T04:47:59.927 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-20T04:47:59.928 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-20T04:47:59.928 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:47:59.928 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-20T04:47:59.928 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-20T04:47:59.928 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-20T04:47:59.928 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:47:59.928 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-20T04:47:59.929 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-20T04:47:59.929 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-20T04:47:59.929 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:47:59.929 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-20T04:47:59.929 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-20T04:47:59.929 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-20T04:47:59.929 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:47:59.937 INFO:tasks.ceph.mds.a:Stopped 2023-12-20T04:47:59.937 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-20T04:47:59.938 INFO:tasks.ceph.mds.c:Stopped 2023-12-20T04:47:59.938 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-20T04:47:59.940 INFO:tasks.ceph.mds.b:Stopped 2023-12-20T04:47:59.940 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-20T04:47:59.941 INFO:tasks.ceph.mds.d:Stopped 2023-12-20T04:47:59.941 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-20T04:47:59.979 INFO:tasks.ceph.mds.a:Started 2023-12-20T04:47:59.980 DEBUG:teuthology.parallel:result is None 2023-12-20T04:47:59.980 INFO:tasks.ceph.mds.c:Started 2023-12-20T04:47:59.980 DEBUG:teuthology.parallel:result is None 2023-12-20T04:47:59.983 INFO:tasks.ceph.mds.b:Started 2023-12-20T04:47:59.983 DEBUG:teuthology.parallel:result is None 2023-12-20T04:47:59.984 INFO:tasks.ceph.mds.d:Started 2023-12-20T04:47:59.984 DEBUG:teuthology.parallel:result is None 2023-12-20T04:47:59.984 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-20T04:48:00.055 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-12-20T04:48:00.056 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-12-20T04:48:00.067 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-12-20T04:48:00.068 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-12-20T04:48:00.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.088+0000 7f756df4e640 1 Processor -- start 2023-12-20T04:48:00.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.088+0000 7f756df4e640 1 -- start start 2023-12-20T04:48:00.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.089+0000 7f756df4e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f75680d30a0 0x7f75680cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.089+0000 7f756df4e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75680d0060 0x7f75680d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.089+0000 7f756df4e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75680d0cf0 con 0x7f756815d2c0 2023-12-20T04:48:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.089+0000 7f756df4e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f75680d0550 con 0x7f75680d30a0 2023-12-20T04:48:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.089+0000 7f756df4e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75680cddc0 con 0x7f75680d0060 2023-12-20T04:48:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.089+0000 7f75677fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f75680d30a0 0x7f75680cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.089+0000 7f75677fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f75680d30a0 0x7f75680cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59806/0 (socket says 172.21.15.132:59806) 2023-12-20T04:48:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.089+0000 7f7566ffd640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f756815d2c0 0x7f75680d3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:45554/0 (socket says 172.21.15.132:45554) 2023-12-20T04:48:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.089+0000 7f75677fe640 1 -- 172.21.15.132:0/3253798296 learned_addr learned my addr 172.21.15.132:0/3253798296 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.089+0000 7f7567fff640 1 --2- 172.21.15.132:0/3253798296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75680d0060 0x7f75680d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.089+0000 7f75677fe640 1 -- 172.21.15.132:0/3253798296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75680d0060 msgr2=0x7f75680d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.089+0000 7f75677fe640 1 --2- 172.21.15.132:0/3253798296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75680d0060 0x7f75680d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.089+0000 7f75677fe640 1 -- 172.21.15.132:0/3253798296 >> v1:172.21.15.187:6789/0 conn(0x7f756815d2c0 legacy=0x7f75680d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:00.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.090+0000 7f75677fe640 1 -- 172.21.15.132:0/3253798296 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75680ce0a0 con 0x7f75680d30a0 2023-12-20T04:48:00.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.090+0000 7f7567fff640 1 --2- 172.21.15.132:0/3253798296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75680d0060 0x7f75680d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:48:00.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.090+0000 7f75677fe640 1 --2- 172.21.15.132:0/3253798296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75680d30a0 0x7f75680cd5c0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f755c009870 tx=0x7f755c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88374f222d7d9d18 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:00.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.091+0000 7f75667fc640 1 -- 172.21.15.132:0/3253798296 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c030840 con 0x7f75680d30a0 2023-12-20T04:48:00.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.091+0000 7f75667fc640 1 -- 172.21.15.132:0/3253798296 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f755c0309a0 con 0x7f75680d30a0 2023-12-20T04:48:00.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.091+0000 7f75667fc640 1 -- 172.21.15.132:0/3253798296 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f755c030d30 con 0x7f75680d30a0 2023-12-20T04:48:00.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.092+0000 7f756df4e640 1 -- 172.21.15.132:0/3253798296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75680d30a0 msgr2=0x7f75680cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:00.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.092+0000 7f756df4e640 1 --2- 172.21.15.132:0/3253798296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75680d30a0 0x7f75680cd5c0 secure :-1 s=READY pgs=1163 cs=0 l=1 rev1=1 crypto rx=0x7f755c009870 tx=0x7f755c02b980 comp rx=0 tx=0).stop 2023-12-20T04:48:00.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.092+0000 7f756df4e640 1 -- 172.21.15.132:0/3253798296 shutdown_connections 2023-12-20T04:48:00.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.092+0000 7f756df4e640 1 --2- 172.21.15.132:0/3253798296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75680d0060 0x7f75680d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:00.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.092+0000 7f756df4e640 1 --2- 172.21.15.132:0/3253798296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75680d30a0 0x7f75680cd5c0 unknown :-1 s=CLOSED pgs=1163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:00.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.092+0000 7f756df4e640 1 -- 172.21.15.132:0/3253798296 >> 172.21.15.132:0/3253798296 conn(0x7f7568072e40 msgr2=0x7f7568073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:00.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.092+0000 7f756df4e640 1 -- 172.21.15.132:0/3253798296 shutdown_connections 2023-12-20T04:48:00.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.092+0000 7f756df4e640 1 -- 172.21.15.132:0/3253798296 wait complete. 2023-12-20T04:48:00.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.093+0000 7f756df4e640 1 Processor -- start 2023-12-20T04:48:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.094+0000 7f756df4e640 1 -- start start 2023-12-20T04:48:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.094+0000 7f756df4e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75680d0060 0x7f756815c560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.094+0000 7f756df4e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75680d30a0 0x7f75680b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.094+0000 7f756df4e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f756815d2c0 0x7f75680b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.094+0000 7f756df4e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75680cb830 con 0x7f756815d2c0 2023-12-20T04:48:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.094+0000 7f756df4e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75681f35e0 con 0x7f75680d30a0 2023-12-20T04:48:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.094+0000 7f756df4e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75681f2960 con 0x7f75680d0060 2023-12-20T04:48:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.095+0000 7f7567fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f756815d2c0 0x7f75680b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.095+0000 7f7567fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f756815d2c0 0x7f75680b7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59812/0 (socket says 172.21.15.132:59812) 2023-12-20T04:48:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.095+0000 7f7566ffd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75680d30a0 0x7f75680b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.095+0000 7f75677fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75680d0060 0x7f756815c560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:00.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.095+0000 7f7567fff640 1 -- 172.21.15.132:0/1636140989 learned_addr learned my addr 172.21.15.132:0/1636140989 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:00.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.095+0000 7f7567fff640 1 -- 172.21.15.132:0/1636140989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75680d0060 msgr2=0x7f756815c560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:00.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.095+0000 7f7567fff640 1 --2- 172.21.15.132:0/1636140989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75680d0060 0x7f756815c560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:00.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.095+0000 7f7567fff640 1 -- 172.21.15.132:0/1636140989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75680d30a0 msgr2=0x7f75680b7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:00.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.095+0000 7f7567fff640 1 --2- 172.21.15.132:0/1636140989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75680d30a0 0x7f75680b7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:00.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.095+0000 7f7567fff640 1 -- 172.21.15.132:0/1636140989 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7560009a70 con 0x7f756815d2c0 2023-12-20T04:48:00.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.095+0000 7f7567fff640 1 --2- 172.21.15.132:0/1636140989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f756815d2c0 0x7f75680b7540 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f7560009f00 tx=0x7f756000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:00.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.095+0000 7f754ffff640 1 -- 172.21.15.132:0/1636140989 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7560009d70 con 0x7f756815d2c0 2023-12-20T04:48:00.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.095+0000 7f754ffff640 1 -- 172.21.15.132:0/1636140989 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f756000f040 con 0x7f756815d2c0 2023-12-20T04:48:00.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.095+0000 7f756df4e640 1 -- 172.21.15.132:0/1636140989 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f755c0094d0 con 0x7f756815d2c0 2023-12-20T04:48:00.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.095+0000 7f754ffff640 1 -- 172.21.15.132:0/1636140989 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7560003bb0 con 0x7f756815d2c0 2023-12-20T04:48:00.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.095+0000 7f756df4e640 1 -- 172.21.15.132:0/1636140989 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75681f2f20 con 0x7f756815d2c0 2023-12-20T04:48:00.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.096+0000 7f754ffff640 1 -- 172.21.15.132:0/1636140989 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7560014480 con 0x7f756815d2c0 2023-12-20T04:48:00.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.097+0000 7f754ffff640 1 --2- 172.21.15.132:0/1636140989 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f755406a430 0x7f755406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:00.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.097+0000 7f756df4e640 1 -- 172.21.15.132:0/1636140989 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f756804e840 con 0x7f756815d2c0 2023-12-20T04:48:00.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.097+0000 7f75677fe640 1 --2- 172.21.15.132:0/1636140989 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f755406a430 0x7f755406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:00.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.097+0000 7f754ffff640 1 -- 172.21.15.132:0/1636140989 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(117..117 src has 1..117) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f75600891c0 con 0x7f756815d2c0 2023-12-20T04:48:00.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.097+0000 7f75677fe640 1 --2- 172.21.15.132:0/1636140989 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f755406a430 0x7f755406c8f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f755c036000 tx=0x7f755c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:00.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.102+0000 7f754ffff640 1 -- 172.21.15.132:0/1636140989 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7560018080 con 0x7f756815d2c0 2023-12-20T04:48:00.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:00.279+0000 7f756df4e640 1 -- 172.21.15.132:0/1636140989 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7568158850 con 0x7f756815d2c0 2023-12-20T04:48:01.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.101+0000 7f754ffff640 1 -- 172.21.15.132:0/1636140989 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v118) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7560054b60 con 0x7f756815d2c0 2023-12-20T04:48:01.104 INFO:teuthology.orchestra.run.smithi132.stderr: removed all blocklist entries 2023-12-20T04:48:01.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.104+0000 7f756df4e640 1 -- 172.21.15.132:0/1636140989 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f755406a430 msgr2=0x7f755406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.104+0000 7f756df4e640 1 --2- 172.21.15.132:0/1636140989 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f755406a430 0x7f755406c8f0 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f755c036000 tx=0x7f755c008030 comp rx=0 tx=0).stop 2023-12-20T04:48:01.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.104+0000 7f756df4e640 1 -- 172.21.15.132:0/1636140989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f756815d2c0 msgr2=0x7f75680b7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.104+0000 7f756df4e640 1 --2- 172.21.15.132:0/1636140989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f756815d2c0 0x7f75680b7540 secure :-1 s=READY pgs=1164 cs=0 l=1 rev1=1 crypto rx=0x7f7560009f00 tx=0x7f756000c490 comp rx=0 tx=0).stop 2023-12-20T04:48:01.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.104+0000 7f756df4e640 1 -- 172.21.15.132:0/1636140989 shutdown_connections 2023-12-20T04:48:01.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.104+0000 7f756df4e640 1 --2- 172.21.15.132:0/1636140989 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f755406a430 0x7f755406c8f0 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.104+0000 7f756df4e640 1 --2- 172.21.15.132:0/1636140989 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f756815d2c0 0x7f75680b7540 unknown :-1 s=CLOSED pgs=1164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.104+0000 7f756df4e640 1 --2- 172.21.15.132:0/1636140989 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75680d30a0 0x7f75680b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.104+0000 7f756df4e640 1 --2- 172.21.15.132:0/1636140989 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75680d0060 0x7f756815c560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.104+0000 7f756df4e640 1 -- 172.21.15.132:0/1636140989 >> 172.21.15.132:0/1636140989 conn(0x7f7568072e40 msgr2=0x7f75680d3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:01.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.104+0000 7f756df4e640 1 -- 172.21.15.132:0/1636140989 shutdown_connections 2023-12-20T04:48:01.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.104+0000 7f756df4e640 1 -- 172.21.15.132:0/1636140989 wait complete. 2023-12-20T04:48:01.119 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-20T04:48:01.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.222+0000 7f53acaee640 1 Processor -- start 2023-12-20T04:48:01.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.222+0000 7f53acaee640 1 -- start start 2023-12-20T04:48:01.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.223+0000 7f53acaee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f53a815d100 0x7f53a80b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.223+0000 7f53acaee640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53a80d0370 0x7f53a80cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.223+0000 7f53acaee640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f53a80b2f90 con 0x7f53a8161850 2023-12-20T04:48:01.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.223+0000 7f53acaee640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f53a81613c0 con 0x7f53a815d100 2023-12-20T04:48:01.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.223+0000 7f53acaee640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80d1b00 con 0x7f53a80d0370 2023-12-20T04:48:01.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.223+0000 7f53a659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f53a815d100 0x7f53a80b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:01.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.223+0000 7f53a6d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f53a8161850 0x7f53a806c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43730/0 (socket says 172.21.15.132:43730) 2023-12-20T04:48:01.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.223+0000 7f53a659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f53a815d100 0x7f53a80b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59816/0 (socket says 172.21.15.132:59816) 2023-12-20T04:48:01.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.223+0000 7f53a6d9d640 1 -- 172.21.15.132:0/134677410 learned_addr learned my addr 172.21.15.132:0/134677410 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:01.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.224+0000 7f53a659c640 1 -- 172.21.15.132:0/134677410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53a80d0370 msgr2=0x7f53a80cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:01.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.224+0000 7f53a5d9b640 1 --2- 172.21.15.132:0/134677410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53a80d0370 0x7f53a80cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:01.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.224+0000 7f53a559a640 1 -- 172.21.15.132:0/134677410 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1686837842 0 0) 0x7f53a0001490 con 0x7f53a8161850 2023-12-20T04:48:01.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.224+0000 7f53a659c640 1 --2- 172.21.15.132:0/134677410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53a80d0370 0x7f53a80cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.224+0000 7f53a659c640 1 -- 172.21.15.132:0/134677410 >> v1:172.21.15.132:6789/0 conn(0x7f53a8161850 legacy=0x7f53a806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.224+0000 7f53a659c640 1 -- 172.21.15.132:0/134677410 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53a80d0810 con 0x7f53a815d100 2023-12-20T04:48:01.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.224+0000 7f53a5d9b640 1 --2- 172.21.15.132:0/134677410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53a80d0370 0x7f53a80cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:01.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.224+0000 7f53a659c640 1 --2- 172.21.15.132:0/134677410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53a815d100 0x7f53a80b2a50 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f53980097a0 tx=0x7f539802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9906b42eaa268b19 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:01.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.224+0000 7f53a559a640 1 -- 172.21.15.132:0/134677410 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f539802e070 con 0x7f53a815d100 2023-12-20T04:48:01.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.225+0000 7f53a559a640 1 -- 172.21.15.132:0/134677410 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53980315a0 con 0x7f53a815d100 2023-12-20T04:48:01.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.225+0000 7f53a559a640 1 -- 172.21.15.132:0/134677410 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5398031930 con 0x7f53a815d100 2023-12-20T04:48:01.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.225+0000 7f53acaee640 1 -- 172.21.15.132:0/134677410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53a815d100 msgr2=0x7f53a80b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.225+0000 7f53acaee640 1 --2- 172.21.15.132:0/134677410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53a815d100 0x7f53a80b2a50 secure :-1 s=READY pgs=1166 cs=0 l=1 rev1=1 crypto rx=0x7f53980097a0 tx=0x7f539802b840 comp rx=0 tx=0).stop 2023-12-20T04:48:01.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.225+0000 7f53acaee640 1 -- 172.21.15.132:0/134677410 shutdown_connections 2023-12-20T04:48:01.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.225+0000 7f53acaee640 1 --2- 172.21.15.132:0/134677410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53a80d0370 0x7f53a80cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.225+0000 7f53acaee640 1 --2- 172.21.15.132:0/134677410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53a815d100 0x7f53a80b2a50 unknown :-1 s=CLOSED pgs=1166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.225+0000 7f53acaee640 1 -- 172.21.15.132:0/134677410 >> 172.21.15.132:0/134677410 conn(0x7f53a806d7c0 msgr2=0x7f53a806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:01.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.225+0000 7f53acaee640 1 -- 172.21.15.132:0/134677410 shutdown_connections 2023-12-20T04:48:01.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.225+0000 7f53acaee640 1 -- 172.21.15.132:0/134677410 wait complete. 2023-12-20T04:48:01.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.226+0000 7f53acaee640 1 Processor -- start 2023-12-20T04:48:01.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.226+0000 7f53acaee640 1 -- start start 2023-12-20T04:48:01.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.227+0000 7f53acaee640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53a80d0370 0x7f53a80ca670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.227+0000 7f53acaee640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53a815d100 0x7f53a815a3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.227+0000 7f53acaee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53a8161850 0x7f53a80c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.227+0000 7f53acaee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80c92f0 con 0x7f53a8161850 2023-12-20T04:48:01.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.227+0000 7f53acaee640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80c95d0 con 0x7f53a815d100 2023-12-20T04:48:01.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.227+0000 7f53acaee640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f53a80c98b0 con 0x7f53a80d0370 2023-12-20T04:48:01.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.227+0000 7f53a6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53a8161850 0x7f53a80c5a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:01.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.227+0000 7f53a6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53a8161850 0x7f53a80c5a70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59818/0 (socket says 172.21.15.132:59818) 2023-12-20T04:48:01.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.227+0000 7f53a6d9d640 1 -- 172.21.15.132:0/422985740 learned_addr learned my addr 172.21.15.132:0/422985740 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:01.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.227+0000 7f53a5d9b640 1 --2- 172.21.15.132:0/422985740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53a815d100 0x7f53a815a3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:01.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.227+0000 7f53a659c640 1 --2- 172.21.15.132:0/422985740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53a80d0370 0x7f53a80ca670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:01.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.228+0000 7f53a6d9d640 1 -- 172.21.15.132:0/422985740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53a80d0370 msgr2=0x7f53a80ca670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.228+0000 7f53a6d9d640 1 --2- 172.21.15.132:0/422985740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53a80d0370 0x7f53a80ca670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.228+0000 7f53a6d9d640 1 -- 172.21.15.132:0/422985740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53a815d100 msgr2=0x7f53a815a3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.228+0000 7f53a6d9d640 1 --2- 172.21.15.132:0/422985740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53a815d100 0x7f53a815a3f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.228+0000 7f53a6d9d640 1 -- 172.21.15.132:0/422985740 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5398009400 con 0x7f53a8161850 2023-12-20T04:48:01.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.228+0000 7f53a659c640 1 --2- 172.21.15.132:0/422985740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53a80d0370 0x7f53a80ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:01.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.228+0000 7f53a6d9d640 1 --2- 172.21.15.132:0/422985740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53a8161850 0x7f53a80c5a70 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f53a000c780 tx=0x7f53a000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:01.232 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.228+0000 7f5396ffd640 1 -- 172.21.15.132:0/422985740 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a000ce90 con 0x7f53a8161850 2023-12-20T04:48:01.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.228+0000 7f5396ffd640 1 -- 172.21.15.132:0/422985740 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f53a000a640 con 0x7f53a8161850 2023-12-20T04:48:01.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.228+0000 7f53acaee640 1 -- 172.21.15.132:0/422985740 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53a80c9b90 con 0x7f53a8161850 2023-12-20T04:48:01.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.228+0000 7f5396ffd640 1 -- 172.21.15.132:0/422985740 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f53a000a9d0 con 0x7f53a8161850 2023-12-20T04:48:01.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.228+0000 7f53acaee640 1 -- 172.21.15.132:0/422985740 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53a80ca150 con 0x7f53a8161850 2023-12-20T04:48:01.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.229+0000 7f53acaee640 1 -- 172.21.15.132:0/422985740 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53a80ca340 con 0x7f53a8161850 2023-12-20T04:48:01.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.229+0000 7f5396ffd640 1 -- 172.21.15.132:0/422985740 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f53a000ab30 con 0x7f53a8161850 2023-12-20T04:48:01.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.230+0000 7f5396ffd640 1 --2- 172.21.15.132:0/422985740 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f538806a430 0x7f538806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.230+0000 7f53a659c640 1 --2- 172.21.15.132:0/422985740 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f538806a430 0x7f538806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:01.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.230+0000 7f5396ffd640 1 -- 172.21.15.132:0/422985740 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f53a00878d0 con 0x7f53a8161850 2023-12-20T04:48:01.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.230+0000 7f53a659c640 1 --2- 172.21.15.132:0/422985740 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f538806a430 0x7f538806c8f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5398036000 tx=0x7f539803d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:01.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.234+0000 7f5396ffd640 1 -- 172.21.15.132:0/422985740 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f53a00532a0 con 0x7f53a8161850 2023-12-20T04:48:01.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.463+0000 7f53acaee640 1 -- 172.21.15.132:0/422985740 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f53a80b2f90 con 0x7f53a8161850 2023-12-20T04:48:01.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.463+0000 7f5396ffd640 1 -- 172.21.15.132:0/422985740 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v17) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f53a80b2f90 con 0x7f53a8161850 2023-12-20T04:48:01.465 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:01.466 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:48:01.466 INFO:teuthology.orchestra.run.smithi132.stdout: "auth_dump": [ 2023-12-20T04:48:01.466 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.466 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.a", 2023-12-20T04:48:01.466 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlbTdZOxAAUDz0Eno9DYvrYM1xg5jG/A==", 2023-12-20T04:48:01.466 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.466 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:48:01.466 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:48:01.466 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:48:01.466 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:01.466 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.466 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.467 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.467 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.b", 2023-12-20T04:48:01.467 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl43gVDBAA1qJwUU+Ii4BalGf3NtJnGA==", 2023-12-20T04:48:01.467 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.467 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:48:01.467 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:48:01.467 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:48:01.467 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:01.467 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.467 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.467 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.467 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.c", 2023-12-20T04:48:01.467 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlaSUVBxAA7HN3dSo9xfvkjvc6bwMxWg==", 2023-12-20T04:48:01.467 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.468 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:48:01.468 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:48:01.468 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:48:01.468 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:01.468 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.468 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.468 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.468 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.d", 2023-12-20T04:48:01.468 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl1DR4ExAANNOyGlf1Ayre/xZEb9JHYg==", 2023-12-20T04:48:01.468 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.468 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:48:01.468 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:48:01.468 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:48:01.468 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:01.469 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.469 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.469 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.469 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.0", 2023-12-20T04:48:01.469 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCucIJlwZfxORAAiT2g1poLu3OkmoyxNJQc8Q==", 2023-12-20T04:48:01.469 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.469 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:48:01.469 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:48:01.469 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:01.469 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.469 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.469 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.469 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.1", 2023-12-20T04:48:01.469 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlejHYBRAAKurKpW5gyOAQ+E4Su4xMSQ==", 2023-12-20T04:48:01.470 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.470 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:48:01.470 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:48:01.470 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:01.470 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.470 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.470 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.470 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.2", 2023-12-20T04:48:01.470 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlyfz8DBAA9a6tUjHF8IRIKeldwVFMcw==", 2023-12-20T04:48:01.470 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.470 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:48:01.470 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:48:01.470 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:01.470 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.471 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.471 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.471 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.3", 2023-12-20T04:48:01.471 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJllFEeFBAA6URrqUjQqHsrI5+qEBVs3g==", 2023-12-20T04:48:01.471 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.471 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:48:01.471 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:48:01.471 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:01.471 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.471 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.471 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.471 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.4", 2023-12-20T04:48:01.471 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlvGqcJhAAgn2wuSTwLT+TOHoE4iaVSg==", 2023-12-20T04:48:01.471 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.472 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:48:01.472 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:48:01.472 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:01.472 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.472 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.472 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.472 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.5", 2023-12-20T04:48:01.472 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlWrkTLhAA2KlpxTFPaiXLCvmURpg5rw==", 2023-12-20T04:48:01.472 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.472 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:48:01.472 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:48:01.472 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:01.472 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.472 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.472 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.473 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.6", 2023-12-20T04:48:01.473 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlnOQfNRAA//EVx0BZYQd7ovK2tFhgfA==", 2023-12-20T04:48:01.473 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.473 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:48:01.473 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:48:01.473 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:01.473 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.473 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.473 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.473 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.7", 2023-12-20T04:48:01.473 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCzcIJl4nfDABAAtBdl2qkzKcqhmzsukC7G5w==", 2023-12-20T04:48:01.473 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.473 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:48:01.474 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:48:01.474 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:01.474 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.474 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.474 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.474 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.0", 2023-12-20T04:48:01.474 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlm/nGFxAA6zndayizc50Il7l74BxkgQ==", 2023-12-20T04:48:01.474 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.474 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:48:01.474 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow r", 2023-12-20T04:48:01.474 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-20T04:48:01.474 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.474 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.474 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.475 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.1", 2023-12-20T04:48:01.475 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlppb6IBAArqCoSlSE5coxkj4+XjPoWg==", 2023-12-20T04:48:01.475 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.475 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:48:01.475 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:48:01.475 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:48:01.475 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:48:01.475 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.475 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.475 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.475 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.2", 2023-12-20T04:48:01.475 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlMgWUHRAAqSdmRGx+9J+3dO7ntaApdw==", 2023-12-20T04:48:01.475 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.476 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:48:01.476 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:48:01.476 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:48:01.476 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:48:01.476 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.476 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.476 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.476 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.3", 2023-12-20T04:48:01.476 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlcIe3JhAAjv9KfknxwySJURWdePN7vw==", 2023-12-20T04:48:01.476 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.476 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:48:01.476 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:48:01.476 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:48:01.477 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:48:01.477 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.477 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.477 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.477 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.admin", 2023-12-20T04:48:01.477 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJljrTdHhAAsAlaFaKctSv71GrifKs6zA==", 2023-12-20T04:48:01.477 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.477 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:48:01.477 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:48:01.477 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:48:01.477 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:01.477 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.477 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.477 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.478 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.x", 2023-12-20T04:48:01.478 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJl+KnxNxAAM/b3mubTMYlB9QUbfcPW8g==", 2023-12-20T04:48:01.478 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.478 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:48:01.478 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:48:01.478 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:01.478 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.478 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:01.478 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:01.478 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.y", 2023-12-20T04:48:01.478 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlMyAMNBAAWpoBNevgGIkZ7zKEdKn3Ag==", 2023-12-20T04:48:01.478 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:01.478 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:48:01.478 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:48:01.479 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:01.479 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.479 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:01.479 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:01.479 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:48:01.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.465+0000 7f53acaee640 1 -- 172.21.15.132:0/422985740 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f538806a430 msgr2=0x7f538806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.465+0000 7f53acaee640 1 --2- 172.21.15.132:0/422985740 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f538806a430 0x7f538806c8f0 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f5398036000 tx=0x7f539803d040 comp rx=0 tx=0).stop 2023-12-20T04:48:01.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.465+0000 7f53acaee640 1 -- 172.21.15.132:0/422985740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53a8161850 msgr2=0x7f53a80c5a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.465+0000 7f53acaee640 1 --2- 172.21.15.132:0/422985740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53a8161850 0x7f53a80c5a70 secure :-1 s=READY pgs=1167 cs=0 l=1 rev1=1 crypto rx=0x7f53a000c780 tx=0x7f53a000cc40 comp rx=0 tx=0).stop 2023-12-20T04:48:01.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.465+0000 7f53acaee640 1 -- 172.21.15.132:0/422985740 shutdown_connections 2023-12-20T04:48:01.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.465+0000 7f53acaee640 1 --2- 172.21.15.132:0/422985740 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f538806a430 0x7f538806c8f0 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.465+0000 7f53acaee640 1 --2- 172.21.15.132:0/422985740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f53a8161850 0x7f53a80c5a70 unknown :-1 s=CLOSED pgs=1167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.465+0000 7f53acaee640 1 --2- 172.21.15.132:0/422985740 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f53a815d100 0x7f53a815a3f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.465+0000 7f53acaee640 1 --2- 172.21.15.132:0/422985740 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f53a80d0370 0x7f53a80ca670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.465+0000 7f53acaee640 1 -- 172.21.15.132:0/422985740 >> 172.21.15.132:0/422985740 conn(0x7f53a806d7c0 msgr2=0x7f53a806b870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:01.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.465+0000 7f53acaee640 1 -- 172.21.15.132:0/422985740 shutdown_connections 2023-12-20T04:48:01.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.465+0000 7f53acaee640 1 -- 172.21.15.132:0/422985740 wait complete. 2023-12-20T04:48:01.482 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:48:01.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.579+0000 7fc636421640 1 Processor -- start 2023-12-20T04:48:01.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.579+0000 7fc636421640 1 -- start start 2023-12-20T04:48:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.580+0000 7fc636421640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc63015d100 0x7fc6300b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.580+0000 7fc636421640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc6300d0370 0x7fc6300cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.580+0000 7fc636421640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc6300b2f90 con 0x7fc630161850 2023-12-20T04:48:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.580+0000 7fc636421640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6301613c0 con 0x7fc6300d0370 2023-12-20T04:48:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.580+0000 7fc636421640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc6300d1b00 con 0x7fc63015d100 2023-12-20T04:48:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.580+0000 7fc62f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc6300d0370 0x7fc6300cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.580+0000 7fc62f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc6300d0370 0x7fc6300cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59828/0 (socket says 172.21.15.132:59828) 2023-12-20T04:48:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.580+0000 7fc62f7fe640 1 -- 172.21.15.132:0/3458869607 learned_addr learned my addr 172.21.15.132:0/3458869607 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.580+0000 7fc6349be640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc630161850 0x7fc63006c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43736/0 (socket says 172.21.15.132:43736) 2023-12-20T04:48:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.580+0000 7fc62f7fe640 1 -- 172.21.15.132:0/3458869607 >> v2:172.21.15.187:3300/0 conn(0x7fc63015d100 msgr2=0x7fc6300b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.580+0000 7fc62ffff640 1 --2- 172.21.15.132:0/3458869607 >> v2:172.21.15.187:3300/0 conn(0x7fc63015d100 0x7fc6300b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.580+0000 7fc62f7fe640 1 --2- 172.21.15.132:0/3458869607 >> v2:172.21.15.187:3300/0 conn(0x7fc63015d100 0x7fc6300b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.580+0000 7fc62f7fe640 1 -- 172.21.15.132:0/3458869607 >> v1:172.21.15.132:6789/0 conn(0x7fc630161850 legacy=0x7fc63006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.580+0000 7fc62effd640 1 -- 172.21.15.132:0/3458869607 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2989366349 0 0) 0x7fc628001490 con 0x7fc630161850 2023-12-20T04:48:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.580+0000 7fc62f7fe640 1 -- 172.21.15.132:0/3458869607 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6300d0810 con 0x7fc6300d0370 2023-12-20T04:48:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.580+0000 7fc62ffff640 1 --2- 172.21.15.132:0/3458869607 >> v2:172.21.15.187:3300/0 conn(0x7fc63015d100 0x7fc6300b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.581+0000 7fc62f7fe640 1 --2- 172.21.15.132:0/3458869607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6300d0370 0x7fc6300cd500 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fc63006e5e0 tx=0x7fc62002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a47bf60bfabff961 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.581+0000 7fc62effd640 1 -- 172.21.15.132:0/3458869607 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620031870 con 0x7fc6300d0370 2023-12-20T04:48:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.581+0000 7fc62effd640 1 -- 172.21.15.132:0/3458869607 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6200319d0 con 0x7fc6300d0370 2023-12-20T04:48:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.581+0000 7fc62effd640 1 -- 172.21.15.132:0/3458869607 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc620031d60 con 0x7fc6300d0370 2023-12-20T04:48:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.581+0000 7fc636421640 1 -- 172.21.15.132:0/3458869607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6300d0370 msgr2=0x7fc6300cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.581+0000 7fc636421640 1 --2- 172.21.15.132:0/3458869607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6300d0370 0x7fc6300cd500 secure :-1 s=READY pgs=1169 cs=0 l=1 rev1=1 crypto rx=0x7fc63006e5e0 tx=0x7fc62002b910 comp rx=0 tx=0).stop 2023-12-20T04:48:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.581+0000 7fc636421640 1 -- 172.21.15.132:0/3458869607 shutdown_connections 2023-12-20T04:48:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.581+0000 7fc636421640 1 --2- 172.21.15.132:0/3458869607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6300d0370 0x7fc6300cd500 unknown :-1 s=CLOSED pgs=1169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.581+0000 7fc636421640 1 --2- 172.21.15.132:0/3458869607 >> v2:172.21.15.187:3300/0 conn(0x7fc63015d100 0x7fc6300b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.581+0000 7fc636421640 1 -- 172.21.15.132:0/3458869607 >> 172.21.15.132:0/3458869607 conn(0x7fc63006d7c0 msgr2=0x7fc63006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:01.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.582+0000 7fc636421640 1 -- 172.21.15.132:0/3458869607 shutdown_connections 2023-12-20T04:48:01.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.582+0000 7fc636421640 1 -- 172.21.15.132:0/3458869607 wait complete. 2023-12-20T04:48:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.583+0000 7fc636421640 1 Processor -- start 2023-12-20T04:48:01.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.583+0000 7fc636421640 1 -- start start 2023-12-20T04:48:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.583+0000 7fc636421640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6300d0370 0x7fc63015f950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.583+0000 7fc636421640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc63015d100 0x7fc6300c99c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.583+0000 7fc636421640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc630161850 0x7fc6300c9f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc636421640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300c7ea0 con 0x7fc6300d0370 2023-12-20T04:48:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc636421640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300add00 con 0x7fc630161850 2023-12-20T04:48:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc636421640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc6300c80b0 con 0x7fc63015d100 2023-12-20T04:48:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc62ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6300d0370 0x7fc63015f950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc62ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6300d0370 0x7fc63015f950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59830/0 (socket says 172.21.15.132:59830) 2023-12-20T04:48:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc62ffff640 1 -- 172.21.15.132:0/1060348238 learned_addr learned my addr 172.21.15.132:0/1060348238 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc62f7fe640 1 --2- 172.21.15.132:0/1060348238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc63015d100 0x7fc6300c99c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc6349be640 1 --2- 172.21.15.132:0/1060348238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc630161850 0x7fc6300c9f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc62ffff640 1 -- 172.21.15.132:0/1060348238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc63015d100 msgr2=0x7fc6300c99c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc62ffff640 1 --2- 172.21.15.132:0/1060348238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc63015d100 0x7fc6300c99c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc62ffff640 1 -- 172.21.15.132:0/1060348238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc630161850 msgr2=0x7fc6300c9f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc62ffff640 1 --2- 172.21.15.132:0/1060348238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc630161850 0x7fc6300c9f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc62ffff640 1 -- 172.21.15.132:0/1060348238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6200094d0 con 0x7fc6300d0370 2023-12-20T04:48:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc62ffff640 1 --2- 172.21.15.132:0/1060348238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6300d0370 0x7fc63015f950 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fc62400c7f0 tx=0x7fc62400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc62cff9640 1 -- 172.21.15.132:0/1060348238 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc624007a30 con 0x7fc6300d0370 2023-12-20T04:48:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc62cff9640 1 -- 172.21.15.132:0/1060348238 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc624007b90 con 0x7fc6300d0370 2023-12-20T04:48:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc636421640 1 -- 172.21.15.132:0/1060348238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6300c8390 con 0x7fc6300d0370 2023-12-20T04:48:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc62cff9640 1 -- 172.21.15.132:0/1060348238 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc62400ce40 con 0x7fc6300d0370 2023-12-20T04:48:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.584+0000 7fc636421640 1 -- 172.21.15.132:0/1060348238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6300ad990 con 0x7fc6300d0370 2023-12-20T04:48:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.585+0000 7fc636421640 1 -- 172.21.15.132:0/1060348238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6300cbb70 con 0x7fc6300d0370 2023-12-20T04:48:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.586+0000 7fc62cff9640 1 -- 172.21.15.132:0/1060348238 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc6240113f0 con 0x7fc6300d0370 2023-12-20T04:48:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.586+0000 7fc62cff9640 1 --2- 172.21.15.132:0/1060348238 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc61c06a430 0x7fc61c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.586+0000 7fc62cff9640 1 -- 172.21.15.132:0/1060348238 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc6240887c0 con 0x7fc6300d0370 2023-12-20T04:48:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.586+0000 7fc62f7fe640 1 --2- 172.21.15.132:0/1060348238 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc61c06a430 0x7fc61c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:01.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.587+0000 7fc62f7fe640 1 --2- 172.21.15.132:0/1060348238 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc61c06a430 0x7fc61c06c8f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc620036000 tx=0x7fc620008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:01.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.590+0000 7fc62cff9640 1 -- 172.21.15.132:0/1060348238 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc624054100 con 0x7fc6300d0370 2023-12-20T04:48:01.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.756+0000 7fc636421640 1 -- 172.21.15.132:0/1060348238 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc63004e840 con 0x7fc6300d0370 2023-12-20T04:48:01.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.757+0000 7fc62cff9640 1 -- 172.21.15.132:0/1060348238 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v118) v1 ==== 74+0+12442 (secure 0 0 0) 0x7fc624057720 con 0x7fc6300d0370 2023-12-20T04:48:01.759 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:01.759 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":118,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:48:01.093640+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":13,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":106,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":99,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:48:01.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.759+0000 7fc636421640 1 -- 172.21.15.132:0/1060348238 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc61c06a430 msgr2=0x7fc61c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.759+0000 7fc636421640 1 --2- 172.21.15.132:0/1060348238 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc61c06a430 0x7fc61c06c8f0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7fc620036000 tx=0x7fc620008030 comp rx=0 tx=0).stop 2023-12-20T04:48:01.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.759+0000 7fc636421640 1 -- 172.21.15.132:0/1060348238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6300d0370 msgr2=0x7fc63015f950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.759+0000 7fc636421640 1 --2- 172.21.15.132:0/1060348238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6300d0370 0x7fc63015f950 secure :-1 s=READY pgs=1170 cs=0 l=1 rev1=1 crypto rx=0x7fc62400c7f0 tx=0x7fc62400cbf0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.759+0000 7fc636421640 1 -- 172.21.15.132:0/1060348238 shutdown_connections 2023-12-20T04:48:01.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.759+0000 7fc636421640 1 --2- 172.21.15.132:0/1060348238 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc61c06a430 0x7fc61c06c8f0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.759+0000 7fc636421640 1 --2- 172.21.15.132:0/1060348238 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc630161850 0x7fc6300c9f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.759+0000 7fc636421640 1 --2- 172.21.15.132:0/1060348238 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc63015d100 0x7fc6300c99c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.759+0000 7fc636421640 1 --2- 172.21.15.132:0/1060348238 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc6300d0370 0x7fc63015f950 unknown :-1 s=CLOSED pgs=1170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.759+0000 7fc636421640 1 -- 172.21.15.132:0/1060348238 >> 172.21.15.132:0/1060348238 conn(0x7fc63006d7c0 msgr2=0x7fc6300cb460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:01.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.759+0000 7fc636421640 1 -- 172.21.15.132:0/1060348238 shutdown_connections 2023-12-20T04:48:01.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.759+0000 7fc636421640 1 -- 172.21.15.132:0/1060348238 wait complete. 2023-12-20T04:48:01.772 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:48:01.772 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:48:01.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.873+0000 7f2ea3d3e640 1 Processor -- start 2023-12-20T04:48:01.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.873+0000 7f2ea3d3e640 1 -- start start 2023-12-20T04:48:01.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.874+0000 7f2ea3d3e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2e9c15d300 0x7f2e9c0d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.874+0000 7f2ea3d3e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2e9c0cff90 0x7f2e9c0b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.874+0000 7f2ea3d3e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2e9c0d1a90 con 0x7f2e9c0d1550 2023-12-20T04:48:01.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.874+0000 7f2ea3d3e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c0d1d70 con 0x7f2e9c15d300 2023-12-20T04:48:01.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.874+0000 7f2ea3d3e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2e9c0d2050 con 0x7f2e9c0cff90 2023-12-20T04:48:01.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.874+0000 7f2ea1ada640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2e9c15d300 0x7f2e9c0d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:01.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.874+0000 7f2ea12d9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2e9c0d1550 0x7f2e9c0cf880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43740/0 (socket says 172.21.15.132:43740) 2023-12-20T04:48:01.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.874+0000 7f2ea1ada640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2e9c15d300 0x7f2e9c0d1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59846/0 (socket says 172.21.15.132:59846) 2023-12-20T04:48:01.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.874+0000 7f2ea12d9640 1 -- 172.21.15.132:0/3829454254 learned_addr learned my addr 172.21.15.132:0/3829454254 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:01.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.874+0000 7f2ea1ada640 1 -- 172.21.15.132:0/3829454254 >> v2:172.21.15.187:3300/0 conn(0x7f2e9c0cff90 msgr2=0x7f2e9c0b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:01.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.874+0000 7f2ea22db640 1 --2- 172.21.15.132:0/3829454254 >> v2:172.21.15.187:3300/0 conn(0x7f2e9c0cff90 0x7f2e9c0b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:01.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.874+0000 7f2ea1ada640 1 --2- 172.21.15.132:0/3829454254 >> v2:172.21.15.187:3300/0 conn(0x7f2e9c0cff90 0x7f2e9c0b60e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.874+0000 7f2ea0ad8640 1 -- 172.21.15.132:0/3829454254 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 669991196 0 0) 0x7f2e9c0d1a90 con 0x7f2e9c0d1550 2023-12-20T04:48:01.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.874+0000 7f2ea1ada640 1 -- 172.21.15.132:0/3829454254 >> v1:172.21.15.132:6789/0 conn(0x7f2e9c0d1550 legacy=0x7f2e9c0cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.874+0000 7f2ea1ada640 1 -- 172.21.15.132:0/3829454254 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e9c0d2330 con 0x7f2e9c15d300 2023-12-20T04:48:01.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.874+0000 7f2ea22db640 1 --2- 172.21.15.132:0/3829454254 >> v2:172.21.15.187:3300/0 conn(0x7f2e9c0cff90 0x7f2e9c0b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:01.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.875+0000 7f2ea1ada640 1 --2- 172.21.15.132:0/3829454254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e9c15d300 0x7f2e9c0d1010 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0d07c0 tx=0x7f2e9802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26159dcd92007044 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:01.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.875+0000 7f2ea0ad8640 1 -- 172.21.15.132:0/3829454254 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e98031830 con 0x7f2e9c15d300 2023-12-20T04:48:01.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.875+0000 7f2ea0ad8640 1 -- 172.21.15.132:0/3829454254 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e98031990 con 0x7f2e9c15d300 2023-12-20T04:48:01.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.875+0000 7f2ea0ad8640 1 -- 172.21.15.132:0/3829454254 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e98031d20 con 0x7f2e9c15d300 2023-12-20T04:48:01.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.875+0000 7f2ea3d3e640 1 -- 172.21.15.132:0/3829454254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e9c15d300 msgr2=0x7f2e9c0d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.875+0000 7f2ea3d3e640 1 --2- 172.21.15.132:0/3829454254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e9c15d300 0x7f2e9c0d1010 secure :-1 s=READY pgs=1172 cs=0 l=1 rev1=1 crypto rx=0x7f2e9c0d07c0 tx=0x7f2e9802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.876+0000 7f2ea3d3e640 1 -- 172.21.15.132:0/3829454254 shutdown_connections 2023-12-20T04:48:01.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.876+0000 7f2ea3d3e640 1 --2- 172.21.15.132:0/3829454254 >> v2:172.21.15.187:3300/0 conn(0x7f2e9c0cff90 0x7f2e9c0b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.876+0000 7f2ea3d3e640 1 --2- 172.21.15.132:0/3829454254 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e9c15d300 0x7f2e9c0d1010 unknown :-1 s=CLOSED pgs=1172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.876+0000 7f2ea3d3e640 1 -- 172.21.15.132:0/3829454254 >> 172.21.15.132:0/3829454254 conn(0x7f2e9c06a3d0 msgr2=0x7f2e9c06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:01.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.876+0000 7f2ea3d3e640 1 -- 172.21.15.132:0/3829454254 shutdown_connections 2023-12-20T04:48:01.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.876+0000 7f2ea3d3e640 1 -- 172.21.15.132:0/3829454254 wait complete. 2023-12-20T04:48:01.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.877+0000 7f2ea3d3e640 1 Processor -- start 2023-12-20T04:48:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.877+0000 7f2ea3d3e640 1 -- start start 2023-12-20T04:48:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.877+0000 7f2ea3d3e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e9c0cff90 0x7f2e9c151610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2ea3d3e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e9c0d1550 0x7f2e9c0ca950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2ea3d3e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e9c15d300 0x7f2e9c0b48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2ea3d3e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c15d6e0 con 0x7f2e9c0cff90 2023-12-20T04:48:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2ea3d3e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c151b50 con 0x7f2e9c15d300 2023-12-20T04:48:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2ea3d3e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2e9c0cae90 con 0x7f2e9c0d1550 2023-12-20T04:48:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2ea1ada640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e9c0cff90 0x7f2e9c151610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2ea1ada640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e9c0cff90 0x7f2e9c151610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59854/0 (socket says 172.21.15.132:59854) 2023-12-20T04:48:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2ea1ada640 1 -- 172.21.15.132:0/2915309445 learned_addr learned my addr 172.21.15.132:0/2915309445 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2ea12d9640 1 --2- 172.21.15.132:0/2915309445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e9c0d1550 0x7f2e9c0ca950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2ea1ada640 1 -- 172.21.15.132:0/2915309445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e9c0d1550 msgr2=0x7f2e9c0ca950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2ea1ada640 1 --2- 172.21.15.132:0/2915309445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e9c0d1550 0x7f2e9c0ca950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2ea1ada640 1 -- 172.21.15.132:0/2915309445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e9c15d300 msgr2=0x7f2e9c0b48e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2ea1ada640 1 --2- 172.21.15.132:0/2915309445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e9c15d300 0x7f2e9c0b48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2ea1ada640 1 -- 172.21.15.132:0/2915309445 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2e98009400 con 0x7f2e9c0cff90 2023-12-20T04:48:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2ea1ada640 1 --2- 172.21.15.132:0/2915309445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e9c0cff90 0x7f2e9c151610 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009860 tx=0x7f2e980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2e927fc640 1 -- 172.21.15.132:0/2915309445 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e9803baa0 con 0x7f2e9c0cff90 2023-12-20T04:48:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2e927fc640 1 -- 172.21.15.132:0/2915309445 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2e9803bc00 con 0x7f2e9c0cff90 2023-12-20T04:48:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2e927fc640 1 -- 172.21.15.132:0/2915309445 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2e980433f0 con 0x7f2e9c0cff90 2023-12-20T04:48:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2ea3d3e640 1 -- 172.21.15.132:0/2915309445 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2e9c160500 con 0x7f2e9c0cff90 2023-12-20T04:48:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.878+0000 7f2ea3d3e640 1 -- 172.21.15.132:0/2915309445 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2e9c15dba0 con 0x7f2e9c0cff90 2023-12-20T04:48:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.879+0000 7f2ea3d3e640 1 -- 172.21.15.132:0/2915309445 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2e9c04e840 con 0x7f2e9c0cff90 2023-12-20T04:48:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.880+0000 7f2e927fc640 1 -- 172.21.15.132:0/2915309445 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2e9804c3b0 con 0x7f2e9c0cff90 2023-12-20T04:48:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.880+0000 7f2e927fc640 1 --2- 172.21.15.132:0/2915309445 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2e8006a430 0x7f2e8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:01.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.880+0000 7f2e927fc640 1 -- 172.21.15.132:0/2915309445 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2e980aa560 con 0x7f2e9c0cff90 2023-12-20T04:48:01.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.880+0000 7f2ea12d9640 1 --2- 172.21.15.132:0/2915309445 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2e8006a430 0x7f2e8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:01.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.881+0000 7f2ea12d9640 1 --2- 172.21.15.132:0/2915309445 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2e8006a430 0x7f2e8006c8f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c001360 tx=0x7f2e8c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:01.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:01.884+0000 7f2e927fc640 1 -- 172.21.15.132:0/2915309445 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2e98075fc0 con 0x7f2e9c0cff90 2023-12-20T04:48:02.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.048+0000 7f2ea3d3e640 1 -- 172.21.15.132:0/2915309445 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2e9c1e7010 con 0x7f2e9c0cff90 2023-12-20T04:48:02.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.049+0000 7f2e927fc640 1 -- 172.21.15.132:0/2915309445 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v118) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2e980350a0 con 0x7f2e9c0cff90 2023-12-20T04:48:02.051 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:48:02.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.051+0000 7f2ea3d3e640 1 -- 172.21.15.132:0/2915309445 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2e8006a430 msgr2=0x7f2e8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:02.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.051+0000 7f2ea3d3e640 1 --2- 172.21.15.132:0/2915309445 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2e8006a430 0x7f2e8006c8f0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f2e8c001360 tx=0x7f2e8c009040 comp rx=0 tx=0).stop 2023-12-20T04:48:02.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.051+0000 7f2ea3d3e640 1 -- 172.21.15.132:0/2915309445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e9c0cff90 msgr2=0x7f2e9c151610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:02.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.051+0000 7f2ea3d3e640 1 --2- 172.21.15.132:0/2915309445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e9c0cff90 0x7f2e9c151610 secure :-1 s=READY pgs=1173 cs=0 l=1 rev1=1 crypto rx=0x7f2e98009860 tx=0x7f2e980046c0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.051+0000 7f2ea3d3e640 1 -- 172.21.15.132:0/2915309445 shutdown_connections 2023-12-20T04:48:02.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.051+0000 7f2ea3d3e640 1 --2- 172.21.15.132:0/2915309445 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2e8006a430 0x7f2e8006c8f0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.051+0000 7f2ea3d3e640 1 --2- 172.21.15.132:0/2915309445 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2e9c15d300 0x7f2e9c0b48e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.051+0000 7f2ea3d3e640 1 --2- 172.21.15.132:0/2915309445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2e9c0d1550 0x7f2e9c0ca950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.051+0000 7f2ea3d3e640 1 --2- 172.21.15.132:0/2915309445 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2e9c0cff90 0x7f2e9c151610 unknown :-1 s=CLOSED pgs=1173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.051+0000 7f2ea3d3e640 1 -- 172.21.15.132:0/2915309445 >> 172.21.15.132:0/2915309445 conn(0x7f2e9c06a3d0 msgr2=0x7f2e9c0b74f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:02.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.051+0000 7f2ea3d3e640 1 -- 172.21.15.132:0/2915309445 shutdown_connections 2023-12-20T04:48:02.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.051+0000 7f2ea3d3e640 1 -- 172.21.15.132:0/2915309445 wait complete. 2023-12-20T04:48:02.064 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-20T04:48:02.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.163+0000 7f246152e640 1 Processor -- start 2023-12-20T04:48:02.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.163+0000 7f246152e640 1 -- start start 2023-12-20T04:48:02.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.164+0000 7f246152e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f245c0d30a0 0x7f245c0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:02.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.164+0000 7f246152e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245c0d0cf0 con 0x7f245c15d2c0 2023-12-20T04:48:02.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.164+0000 7f246152e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f245c0d0550 con 0x7f245c0d0060 2023-12-20T04:48:02.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.164+0000 7f246152e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f245c0cddc0 con 0x7f245c0d30a0 2023-12-20T04:48:02.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.164+0000 7f245a7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f245c15d2c0 0x7f245c0d3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43752/0 (socket says 172.21.15.132:43752) 2023-12-20T04:48:02.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.164+0000 7f245a7fc640 1 -- 172.21.15.132:0/1349597984 learned_addr learned my addr 172.21.15.132:0/1349597984 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:02.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.164+0000 7f245affd640 1 --2- 172.21.15.132:0/1349597984 >> v2:172.21.15.187:3300/0 conn(0x7f245c0d30a0 0x7f245c0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:02.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.164+0000 7f2459ffb640 1 -- 172.21.15.132:0/1349597984 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2419404557 0 0) 0x7f245c0d0cf0 con 0x7f245c15d2c0 2023-12-20T04:48:02.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.164+0000 7f2459ffb640 1 -- 172.21.15.132:0/1349597984 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2448003520 con 0x7f245c15d2c0 2023-12-20T04:48:02.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.164+0000 7f2459ffb640 1 -- 172.21.15.132:0/1349597984 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1902037958 0 0) 0x7f2448003520 con 0x7f245c15d2c0 2023-12-20T04:48:02.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.164+0000 7f2459ffb640 1 -- 172.21.15.132:0/1349597984 >> v2:172.21.15.187:3300/0 conn(0x7f245c0d30a0 msgr2=0x7f245c0cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:02.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.164+0000 7f2459ffb640 1 --2- 172.21.15.132:0/1349597984 >> v2:172.21.15.187:3300/0 conn(0x7f245c0d30a0 0x7f245c0cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.164+0000 7f2459ffb640 1 -- 172.21.15.132:0/1349597984 >> v1:172.21.15.187:6789/0 conn(0x7f245c0d0060 legacy=0x7f245c0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:02.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.164+0000 7f2459ffb640 1 -- 172.21.15.132:0/1349597984 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c0ce0a0 con 0x7f245c15d2c0 2023-12-20T04:48:02.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.164+0000 7f2459ffb640 1 -- 172.21.15.132:0/1349597984 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f2444001670 con 0x7f245c15d2c0 2023-12-20T04:48:02.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.165+0000 7f2459ffb640 1 -- 172.21.15.132:0/1349597984 >> v1:172.21.15.132:6789/0 conn(0x7f245c15d2c0 legacy=0x7f245c0d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:02.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.165+0000 7f2459ffb640 1 --2- 172.21.15.132:0/1349597984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2448003970 0x7f2448003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:02.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.165+0000 7f2459ffb640 1 --2- 172.21.15.132:0/1349597984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24480047c0 0x7f2448004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:02.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.165+0000 7f2459ffb640 1 --2- 172.21.15.132:0/1349597984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2448005180 0x7f244800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:02.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.165+0000 7f2459ffb640 1 -- 172.21.15.132:0/1349597984 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c0cddc0 con 0x7f2448005180 2023-12-20T04:48:02.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.165+0000 7f2459ffb640 1 -- 172.21.15.132:0/1349597984 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f244800c020 con 0x7f24480047c0 2023-12-20T04:48:02.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.165+0000 7f2459ffb640 1 -- 172.21.15.132:0/1349597984 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f244800c1e0 con 0x7f2448003970 2023-12-20T04:48:02.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.165+0000 7f245b7fe640 1 --2- 172.21.15.132:0/1349597984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2448005180 0x7f244800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:02.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.165+0000 7f245a7fc640 1 --2- 172.21.15.132:0/1349597984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24480047c0 0x7f2448004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:02.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.165+0000 7f245affd640 1 --2- 172.21.15.132:0/1349597984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2448003970 0x7f2448003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:02.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.165+0000 7f245b7fe640 1 -- 172.21.15.132:0/1349597984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2448003970 msgr2=0x7f2448003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:02.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.165+0000 7f245b7fe640 1 --2- 172.21.15.132:0/1349597984 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2448003970 0x7f2448003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.165+0000 7f245b7fe640 1 -- 172.21.15.132:0/1349597984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24480047c0 msgr2=0x7f2448004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:02.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.165+0000 7f245b7fe640 1 --2- 172.21.15.132:0/1349597984 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f24480047c0 0x7f2448004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.165+0000 7f245b7fe640 1 -- 172.21.15.132:0/1349597984 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2448003520 con 0x7f2448005180 2023-12-20T04:48:02.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.166+0000 7f245b7fe640 1 -- 172.21.15.132:0/1349597984 reap_dead start 2023-12-20T04:48:02.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.166+0000 7f245b7fe640 1 --2- 172.21.15.132:0/1349597984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2448005180 0x7f244800b980 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f244c001750 tx=0x7f24480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87024a4232ab931b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:02.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.166+0000 7f2459ffb640 1 -- 172.21.15.132:0/1349597984 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c0052d0 con 0x7f2448005180 2023-12-20T04:48:02.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.166+0000 7f2459ffb640 1 -- 172.21.15.132:0/1349597984 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c02e050 con 0x7f2448005180 2023-12-20T04:48:02.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.166+0000 7f2459ffb640 1 -- 172.21.15.132:0/1349597984 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c003830 con 0x7f2448005180 2023-12-20T04:48:02.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.166+0000 7f246152e640 1 -- 172.21.15.132:0/1349597984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2448005180 msgr2=0x7f244800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:02.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.166+0000 7f246152e640 1 --2- 172.21.15.132:0/1349597984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2448005180 0x7f244800b980 secure :-1 s=READY pgs=1175 cs=0 l=1 rev1=1 crypto rx=0x7f244c001750 tx=0x7f24480057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.166+0000 7f246152e640 1 -- 172.21.15.132:0/1349597984 shutdown_connections 2023-12-20T04:48:02.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.166+0000 7f246152e640 1 --2- 172.21.15.132:0/1349597984 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2448005180 0x7f244800b980 unknown :-1 s=CLOSED pgs=1175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.166+0000 7f246152e640 1 -- 172.21.15.132:0/1349597984 >> 172.21.15.132:0/1349597984 conn(0x7f245c072e40 msgr2=0x7f245c073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:02.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.166+0000 7f246152e640 1 -- 172.21.15.132:0/1349597984 shutdown_connections 2023-12-20T04:48:02.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.167+0000 7f246152e640 1 -- 172.21.15.132:0/1349597984 wait complete. 2023-12-20T04:48:02.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.168+0000 7f246152e640 1 Processor -- start 2023-12-20T04:48:02.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.168+0000 7f246152e640 1 -- start start 2023-12-20T04:48:02.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f246152e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2448005180 0x7f245c0c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:02.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f246152e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f245c15d6a0 0x7f245c0d1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:02.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f246152e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f245c15db20 0x7f245c0d2300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:02.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f246152e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c1f3700 con 0x7f245c15db20 2023-12-20T04:48:02.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f246152e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f245c1f2a80 con 0x7f245c15d6a0 2023-12-20T04:48:02.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f246152e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f245c1f2d60 con 0x7f2448005180 2023-12-20T04:48:02.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f245b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f245c15db20 0x7f245c0d2300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:02.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f245b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f245c15db20 0x7f245c0d2300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59874/0 (socket says 172.21.15.132:59874) 2023-12-20T04:48:02.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f245b7fe640 1 -- 172.21.15.132:0/2673295122 learned_addr learned my addr 172.21.15.132:0/2673295122 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:02.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f245affd640 1 --2- 172.21.15.132:0/2673295122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2448005180 0x7f245c0c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:02.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f245a7fc640 1 --2- 172.21.15.132:0/2673295122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f245c15d6a0 0x7f245c0d1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:02.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f245b7fe640 1 -- 172.21.15.132:0/2673295122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2448005180 msgr2=0x7f245c0c8d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:02.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f245b7fe640 1 --2- 172.21.15.132:0/2673295122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2448005180 0x7f245c0c8d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f245b7fe640 1 -- 172.21.15.132:0/2673295122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f245c15d6a0 msgr2=0x7f245c0d1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:02.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f245b7fe640 1 --2- 172.21.15.132:0/2673295122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f245c15d6a0 0x7f245c0d1dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f245b7fe640 1 -- 172.21.15.132:0/2673295122 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f245c1f3040 con 0x7f245c15db20 2023-12-20T04:48:02.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f245b7fe640 1 --2- 172.21.15.132:0/2673295122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f245c15db20 0x7f245c0d2300 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f244c001870 tx=0x7f244c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:02.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f24537fe640 1 -- 172.21.15.132:0/2673295122 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c039070 con 0x7f245c15db20 2023-12-20T04:48:02.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f24537fe640 1 -- 172.21.15.132:0/2673295122 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f244c007a30 con 0x7f245c15db20 2023-12-20T04:48:02.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f246152e640 1 -- 172.21.15.132:0/2673295122 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f245c1f3320 con 0x7f245c15db20 2023-12-20T04:48:02.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f24537fe640 1 -- 172.21.15.132:0/2673295122 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f244c007030 con 0x7f245c15db20 2023-12-20T04:48:02.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.169+0000 7f246152e640 1 -- 172.21.15.132:0/2673295122 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f245c160120 con 0x7f245c15db20 2023-12-20T04:48:02.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.170+0000 7f246152e640 1 -- 172.21.15.132:0/2673295122 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f245c1f38f0 con 0x7f245c15db20 2023-12-20T04:48:02.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.171+0000 7f24537fe640 1 -- 172.21.15.132:0/2673295122 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f244c03c020 con 0x7f245c15db20 2023-12-20T04:48:02.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.171+0000 7f24537fe640 1 --2- 172.21.15.132:0/2673295122 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f243c06a430 0x7f243c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:02.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.171+0000 7f24537fe640 1 -- 172.21.15.132:0/2673295122 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f244c0a8820 con 0x7f245c15db20 2023-12-20T04:48:02.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.171+0000 7f245affd640 1 --2- 172.21.15.132:0/2673295122 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f243c06a430 0x7f243c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:02.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.171+0000 7f245affd640 1 --2- 172.21.15.132:0/2673295122 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f243c06a430 0x7f243c06c8f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2454014450 tx=0x7f245400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:02.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.175+0000 7f24537fe640 1 -- 172.21.15.132:0/2673295122 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f245c1f38f0 con 0x7f245c15db20 2023-12-20T04:48:02.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.343+0000 7f246152e640 1 -- 172.21.15.132:0/2673295122 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f245c1f38d0 con 0x7f245c15db20 2023-12-20T04:48:02.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.344+0000 7f24537fe640 1 -- 172.21.15.132:0/2673295122 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v118) v1 ==== 84+0+65 (secure 0 0 0) 0x7f244c044060 con 0x7f245c15db20 2023-12-20T04:48:02.347 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:02.347 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-12-20T04:48:02.347 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:02.348 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-12-20T04:48:02.348 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-12-20T04:48:02.348 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:02.348 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-12-20T04:48:02.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.346+0000 7f246152e640 1 -- 172.21.15.132:0/2673295122 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f243c06a430 msgr2=0x7f243c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:02.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.346+0000 7f246152e640 1 --2- 172.21.15.132:0/2673295122 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f243c06a430 0x7f243c06c8f0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f2454014450 tx=0x7f245400b040 comp rx=0 tx=0).stop 2023-12-20T04:48:02.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.346+0000 7f246152e640 1 -- 172.21.15.132:0/2673295122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f245c15db20 msgr2=0x7f245c0d2300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:02.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.346+0000 7f246152e640 1 --2- 172.21.15.132:0/2673295122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f245c15db20 0x7f245c0d2300 secure :-1 s=READY pgs=1176 cs=0 l=1 rev1=1 crypto rx=0x7f244c001870 tx=0x7f244c001120 comp rx=0 tx=0).stop 2023-12-20T04:48:02.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.346+0000 7f246152e640 1 -- 172.21.15.132:0/2673295122 shutdown_connections 2023-12-20T04:48:02.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.346+0000 7f246152e640 1 --2- 172.21.15.132:0/2673295122 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f243c06a430 0x7f243c06c8f0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.346+0000 7f246152e640 1 --2- 172.21.15.132:0/2673295122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f245c15db20 0x7f245c0d2300 unknown :-1 s=CLOSED pgs=1176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.346+0000 7f246152e640 1 --2- 172.21.15.132:0/2673295122 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f245c15d6a0 0x7f245c0d1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.346+0000 7f246152e640 1 --2- 172.21.15.132:0/2673295122 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2448005180 0x7f245c0c8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.346+0000 7f246152e640 1 -- 172.21.15.132:0/2673295122 >> 172.21.15.132:0/2673295122 conn(0x7f245c072e40 msgr2=0x7f245c0b2d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:02.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.346+0000 7f246152e640 1 -- 172.21.15.132:0/2673295122 shutdown_connections 2023-12-20T04:48:02.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.346+0000 7f246152e640 1 -- 172.21.15.132:0/2673295122 wait complete. 2023-12-20T04:48:02.359 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-20T04:48:02.360 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-20T04:48:02.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.461+0000 7f4f72d69640 1 Processor -- start 2023-12-20T04:48:02.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.461+0000 7f4f72d69640 1 -- start start 2023-12-20T04:48:02.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.462+0000 7f4f72d69640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4f6c15d300 0x7f4f6c06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.462+0000 7f4f72d69640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6c06cc90 con 0x7f4f6c15cf20 2023-12-20T04:48:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.462+0000 7f4f72d69640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f6c0b2f30 con 0x7f4f6c0cd4b0 2023-12-20T04:48:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.462+0000 7f4f72d69640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f6c0b3210 con 0x7f4f6c15d300 2023-12-20T04:48:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.462+0000 7f4f70b05640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4f6c15cf20 0x7f4f6c161700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43766/0 (socket says 172.21.15.132:43766) 2023-12-20T04:48:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.462+0000 7f4f70b05640 1 -- 172.21.15.132:0/2638787396 learned_addr learned my addr 172.21.15.132:0/2638787396 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:02.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f6bfff640 1 --2- 172.21.15.132:0/2638787396 >> v2:172.21.15.187:3300/0 conn(0x7f4f6c15d300 0x7f4f6c06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f6b7fe640 1 -- 172.21.15.132:0/2638787396 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3053476723 0 0) 0x7f4f6c06cc90 con 0x7f4f6c15cf20 2023-12-20T04:48:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f6b7fe640 1 -- 172.21.15.132:0/2638787396 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f54003520 con 0x7f4f6c15cf20 2023-12-20T04:48:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f6b7fe640 1 -- 172.21.15.132:0/2638787396 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3981792835 0 0) 0x7f4f54003520 con 0x7f4f6c15cf20 2023-12-20T04:48:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f6b7fe640 1 -- 172.21.15.132:0/2638787396 >> v2:172.21.15.187:3300/0 conn(0x7f4f6c15d300 msgr2=0x7f4f6c06c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f6b7fe640 1 --2- 172.21.15.132:0/2638787396 >> v2:172.21.15.187:3300/0 conn(0x7f4f6c15d300 0x7f4f6c06c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f6b7fe640 1 -- 172.21.15.132:0/2638787396 >> v1:172.21.15.187:6789/0 conn(0x7f4f6c0cd4b0 legacy=0x7f4f6c0d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f6b7fe640 1 -- 172.21.15.132:0/2638787396 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c0b34f0 con 0x7f4f6c15cf20 2023-12-20T04:48:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f6b7fe640 1 -- 172.21.15.132:0/2638787396 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f4f5c001670 con 0x7f4f6c15cf20 2023-12-20T04:48:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f6b7fe640 1 -- 172.21.15.132:0/2638787396 >> v1:172.21.15.132:6789/0 conn(0x7f4f6c15cf20 legacy=0x7f4f6c161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f6b7fe640 1 --2- 172.21.15.132:0/2638787396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f54003970 0x7f4f54003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f6b7fe640 1 --2- 172.21.15.132:0/2638787396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f540047c0 0x7f4f54004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f6b7fe640 1 --2- 172.21.15.132:0/2638787396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f54005180 0x7f4f5400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f6b7fe640 1 -- 172.21.15.132:0/2638787396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c0b3210 con 0x7f4f54003970 2023-12-20T04:48:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f6b7fe640 1 -- 172.21.15.132:0/2638787396 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5400c020 con 0x7f4f540047c0 2023-12-20T04:48:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f6b7fe640 1 -- 172.21.15.132:0/2638787396 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5400c1e0 con 0x7f4f54005180 2023-12-20T04:48:02.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f70b05640 1 --2- 172.21.15.132:0/2638787396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f54003970 0x7f4f54003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:02.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f6bfff640 1 --2- 172.21.15.132:0/2638787396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f540047c0 0x7f4f54004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:02.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f71306640 1 --2- 172.21.15.132:0/2638787396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f54005180 0x7f4f5400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:02.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f70b05640 1 -- 172.21.15.132:0/2638787396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f54005180 msgr2=0x7f4f5400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:02.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f70b05640 1 --2- 172.21.15.132:0/2638787396 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f54005180 0x7f4f5400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f70b05640 1 -- 172.21.15.132:0/2638787396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f540047c0 msgr2=0x7f4f54004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:02.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f70b05640 1 --2- 172.21.15.132:0/2638787396 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f540047c0 0x7f4f54004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f70b05640 1 -- 172.21.15.132:0/2638787396 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f54003520 con 0x7f4f54003970 2023-12-20T04:48:02.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.463+0000 7f4f71306640 1 -- 172.21.15.132:0/2638787396 reap_dead start 2023-12-20T04:48:02.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.464+0000 7f4f70b05640 1 --2- 172.21.15.132:0/2638787396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f54003970 0x7f4f54003d90 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00c240 tx=0x7f4f540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91fdf32aa6d96b14 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:02.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.464+0000 7f4f6b7fe640 1 -- 172.21.15.132:0/2638787396 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c005ad0 con 0x7f4f54003970 2023-12-20T04:48:02.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.464+0000 7f4f6b7fe640 1 -- 172.21.15.132:0/2638787396 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f5c005c50 con 0x7f4f54003970 2023-12-20T04:48:02.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.464+0000 7f4f6b7fe640 1 -- 172.21.15.132:0/2638787396 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f5c02c8b0 con 0x7f4f54003970 2023-12-20T04:48:02.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.465+0000 7f4f72d69640 1 -- 172.21.15.132:0/2638787396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f54003970 msgr2=0x7f4f54003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:02.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.465+0000 7f4f72d69640 1 --2- 172.21.15.132:0/2638787396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f54003970 0x7f4f54003d90 secure :-1 s=READY pgs=1178 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c00c240 tx=0x7f4f540057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.465+0000 7f4f72d69640 1 -- 172.21.15.132:0/2638787396 shutdown_connections 2023-12-20T04:48:02.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.465+0000 7f4f72d69640 1 --2- 172.21.15.132:0/2638787396 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f54003970 0x7f4f54003d90 unknown :-1 s=CLOSED pgs=1178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.465+0000 7f4f72d69640 1 -- 172.21.15.132:0/2638787396 >> 172.21.15.132:0/2638787396 conn(0x7f4f6c072c60 msgr2=0x7f4f6c073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:02.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.465+0000 7f4f72d69640 1 -- 172.21.15.132:0/2638787396 shutdown_connections 2023-12-20T04:48:02.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.465+0000 7f4f72d69640 1 -- 172.21.15.132:0/2638787396 wait complete. 2023-12-20T04:48:02.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.466+0000 7f4f72d69640 1 Processor -- start 2023-12-20T04:48:02.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.466+0000 7f4f72d69640 1 -- start start 2023-12-20T04:48:02.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f72d69640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f54003970 0x7f4f6c1598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:02.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f72d69640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f6c161060 0x7f4f6c1614e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:02.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f72d69640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6c0b42d0 0x7f4f6c0b4750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:02.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f72d69640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c161a20 con 0x7f4f6c0b42d0 2023-12-20T04:48:02.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f72d69640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c159de0 con 0x7f4f6c161060 2023-12-20T04:48:02.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f72d69640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f6c0c50e0 con 0x7f4f54003970 2023-12-20T04:48:02.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f71306640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6c0b42d0 0x7f4f6c0b4750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:02.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f71306640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6c0b42d0 0x7f4f6c0b4750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59888/0 (socket says 172.21.15.132:59888) 2023-12-20T04:48:02.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f71306640 1 -- 172.21.15.132:0/578823042 learned_addr learned my addr 172.21.15.132:0/578823042 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:02.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f70b05640 1 --2- 172.21.15.132:0/578823042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f54003970 0x7f4f6c1598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:02.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f6bfff640 1 --2- 172.21.15.132:0/578823042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f6c161060 0x7f4f6c1614e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:02.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f71306640 1 -- 172.21.15.132:0/578823042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f54003970 msgr2=0x7f4f6c1598a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:02.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f71306640 1 --2- 172.21.15.132:0/578823042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f54003970 0x7f4f6c1598a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f71306640 1 -- 172.21.15.132:0/578823042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f6c161060 msgr2=0x7f4f6c1614e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:02.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f71306640 1 --2- 172.21.15.132:0/578823042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f6c161060 0x7f4f6c1614e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:02.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f71306640 1 -- 172.21.15.132:0/578823042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f6c0b5070 con 0x7f4f6c0b42d0 2023-12-20T04:48:02.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f71306640 1 --2- 172.21.15.132:0/578823042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6c0b42d0 0x7f4f6c0b4750 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f4f64007fd0 tx=0x7f4f6400ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:02.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f697fa640 1 -- 172.21.15.132:0/578823042 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f64003970 con 0x7f4f6c0b42d0 2023-12-20T04:48:02.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f697fa640 1 -- 172.21.15.132:0/578823042 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f64003af0 con 0x7f4f6c0b42d0 2023-12-20T04:48:02.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f72d69640 1 -- 172.21.15.132:0/578823042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f6c0b5350 con 0x7f4f6c0b42d0 2023-12-20T04:48:02.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f697fa640 1 -- 172.21.15.132:0/578823042 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f64003ea0 con 0x7f4f6c0b42d0 2023-12-20T04:48:02.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.467+0000 7f4f72d69640 1 -- 172.21.15.132:0/578823042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f6c0b5910 con 0x7f4f6c0b42d0 2023-12-20T04:48:02.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.468+0000 7f4f72d69640 1 -- 172.21.15.132:0/578823042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f6c04e840 con 0x7f4f6c0b42d0 2023-12-20T04:48:02.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.469+0000 7f4f697fa640 1 -- 172.21.15.132:0/578823042 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4f640050d0 con 0x7f4f6c0b42d0 2023-12-20T04:48:02.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.469+0000 7f4f697fa640 1 --2- 172.21.15.132:0/578823042 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5806a430 0x7f4f5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:02.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.469+0000 7f4f697fa640 1 -- 172.21.15.132:0/578823042 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(118..118 src has 1..118) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f4f640881d0 con 0x7f4f6c0b42d0 2023-12-20T04:48:02.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.469+0000 7f4f70b05640 1 --2- 172.21.15.132:0/578823042 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5806a430 0x7f4f5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:02.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.470+0000 7f4f70b05640 1 --2- 172.21.15.132:0/578823042 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5806a430 0x7f4f5806c8f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c034000 tx=0x7f4f5c009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:02.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.473+0000 7f4f697fa640 1 -- 172.21.15.132:0/578823042 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4f64053ba0 con 0x7f4f6c0b42d0 2023-12-20T04:48:02.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:02.641+0000 7f4f72d69640 1 -- 172.21.15.132:0/578823042 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f4f6c0b2890 con 0x7f4f6c0b42d0 2023-12-20T04:48:03.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.113+0000 7f4f697fa640 1 -- 172.21.15.132:0/578823042 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v119) v1 ==== 138+0+0 (secure 0 0 0) 0x7f4f640571c0 con 0x7f4f6c0b42d0 2023-12-20T04:48:03.116 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2023-12-20T04:48:03.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.116+0000 7f4f72d69640 1 -- 172.21.15.132:0/578823042 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5806a430 msgr2=0x7f4f5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:03.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.116+0000 7f4f72d69640 1 --2- 172.21.15.132:0/578823042 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5806a430 0x7f4f5806c8f0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f4f5c034000 tx=0x7f4f5c009030 comp rx=0 tx=0).stop 2023-12-20T04:48:03.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.116+0000 7f4f72d69640 1 -- 172.21.15.132:0/578823042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6c0b42d0 msgr2=0x7f4f6c0b4750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:03.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.116+0000 7f4f72d69640 1 --2- 172.21.15.132:0/578823042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6c0b42d0 0x7f4f6c0b4750 secure :-1 s=READY pgs=1179 cs=0 l=1 rev1=1 crypto rx=0x7f4f64007fd0 tx=0x7f4f6400ec10 comp rx=0 tx=0).stop 2023-12-20T04:48:03.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.117+0000 7f4f72d69640 1 -- 172.21.15.132:0/578823042 shutdown_connections 2023-12-20T04:48:03.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.117+0000 7f4f72d69640 1 --2- 172.21.15.132:0/578823042 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5806a430 0x7f4f5806c8f0 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:03.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.117+0000 7f4f72d69640 1 --2- 172.21.15.132:0/578823042 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6c0b42d0 0x7f4f6c0b4750 unknown :-1 s=CLOSED pgs=1179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:03.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.117+0000 7f4f72d69640 1 --2- 172.21.15.132:0/578823042 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f6c161060 0x7f4f6c1614e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:03.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.117+0000 7f4f72d69640 1 --2- 172.21.15.132:0/578823042 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f54003970 0x7f4f6c1598a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:03.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.117+0000 7f4f72d69640 1 -- 172.21.15.132:0/578823042 >> 172.21.15.132:0/578823042 conn(0x7f4f6c072c60 msgr2=0x7f4f6c15f7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:03.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.117+0000 7f4f72d69640 1 -- 172.21.15.132:0/578823042 shutdown_connections 2023-12-20T04:48:03.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.117+0000 7f4f72d69640 1 -- 172.21.15.132:0/578823042 wait complete. 2023-12-20T04:48:03.130 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-20T04:48:03.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.235+0000 7fcd1bb00640 1 Processor -- start 2023-12-20T04:48:03.237 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.235+0000 7fcd1bb00640 1 -- start start 2023-12-20T04:48:03.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.236+0000 7fcd1bb00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcd140cb2b0 0x7fcd140cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:03.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.236+0000 7fcd1bb00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcd140cdbb0 0x7fcd140d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:03.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.236+0000 7fcd1bb00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd140ce000 con 0x7fcd1415aee0 2023-12-20T04:48:03.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.236+0000 7fcd1bb00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd140d0130 con 0x7fcd140cdbb0 2023-12-20T04:48:03.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.236+0000 7fcd1bb00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd1415f370 con 0x7fcd140cb2b0 2023-12-20T04:48:03.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.236+0000 7fcd1a09d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcd140cdbb0 0x7fcd140d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:03.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.236+0000 7fcd1a09d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcd140cdbb0 0x7fcd140d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59894/0 (socket says 172.21.15.132:59894) 2023-12-20T04:48:03.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.236+0000 7fcd1a09d640 1 -- 172.21.15.132:0/2830803122 learned_addr learned my addr 172.21.15.132:0/2830803122 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:03.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.236+0000 7fcd1909b640 1 --2- 172.21.15.132:0/2830803122 >> v2:172.21.15.187:3300/0 conn(0x7fcd140cb2b0 0x7fcd140cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:03.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.236+0000 7fcd1a09d640 1 -- 172.21.15.132:0/2830803122 >> v2:172.21.15.187:3300/0 conn(0x7fcd140cb2b0 msgr2=0x7fcd140cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:03.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.236+0000 7fcd1a09d640 1 --2- 172.21.15.132:0/2830803122 >> v2:172.21.15.187:3300/0 conn(0x7fcd140cb2b0 0x7fcd140cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:03.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.236+0000 7fcd1a09d640 1 -- 172.21.15.132:0/2830803122 >> v1:172.21.15.187:6789/0 conn(0x7fcd1415aee0 legacy=0x7fcd1415eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:03.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.236+0000 7fcd1a09d640 1 -- 172.21.15.132:0/2830803122 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd1415f650 con 0x7fcd140cdbb0 2023-12-20T04:48:03.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.236+0000 7fcd1909b640 1 --2- 172.21.15.132:0/2830803122 >> v2:172.21.15.187:3300/0 conn(0x7fcd140cb2b0 0x7fcd140cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:03.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.237+0000 7fcd1a09d640 1 --2- 172.21.15.132:0/2830803122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd140cdbb0 0x7fcd140d08a0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009e50 tx=0x7fcd0c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdfae27b4c6d7a43 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:03.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.237+0000 7fcd1889a640 1 -- 172.21.15.132:0/2830803122 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c02ca80 con 0x7fcd140cdbb0 2023-12-20T04:48:03.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.237+0000 7fcd1889a640 1 -- 172.21.15.132:0/2830803122 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd0c02cbe0 con 0x7fcd140cdbb0 2023-12-20T04:48:03.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.237+0000 7fcd1889a640 1 -- 172.21.15.132:0/2830803122 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd0c0343f0 con 0x7fcd140cdbb0 2023-12-20T04:48:03.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.238+0000 7fcd1bb00640 1 -- 172.21.15.132:0/2830803122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd140cdbb0 msgr2=0x7fcd140d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:03.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.238+0000 7fcd1bb00640 1 --2- 172.21.15.132:0/2830803122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd140cdbb0 0x7fcd140d08a0 secure :-1 s=READY pgs=1180 cs=0 l=1 rev1=1 crypto rx=0x7fcd0c009e50 tx=0x7fcd0c02bee0 comp rx=0 tx=0).stop 2023-12-20T04:48:03.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.238+0000 7fcd1bb00640 1 -- 172.21.15.132:0/2830803122 shutdown_connections 2023-12-20T04:48:03.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.238+0000 7fcd1bb00640 1 --2- 172.21.15.132:0/2830803122 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd140cdbb0 0x7fcd140d08a0 unknown :-1 s=CLOSED pgs=1180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:03.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.238+0000 7fcd1bb00640 1 --2- 172.21.15.132:0/2830803122 >> v2:172.21.15.187:3300/0 conn(0x7fcd140cb2b0 0x7fcd140cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:03.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.238+0000 7fcd1bb00640 1 -- 172.21.15.132:0/2830803122 >> 172.21.15.132:0/2830803122 conn(0x7fcd14072c60 msgr2=0x7fcd14073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:03.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.238+0000 7fcd1bb00640 1 -- 172.21.15.132:0/2830803122 shutdown_connections 2023-12-20T04:48:03.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.238+0000 7fcd1bb00640 1 -- 172.21.15.132:0/2830803122 wait complete. 2023-12-20T04:48:03.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.239+0000 7fcd1bb00640 1 Processor -- start 2023-12-20T04:48:03.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.239+0000 7fcd1bb00640 1 -- start start 2023-12-20T04:48:03.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.240+0000 7fcd1bb00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd140cb2b0 0x7fcd1415c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:03.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.240+0000 7fcd1bb00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd140cdbb0 0x7fcd141f1370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:03.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.240+0000 7fcd1bb00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd1415aee0 0x7fcd141f1ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:03.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.240+0000 7fcd1bb00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd141f18b0 con 0x7fcd140cb2b0 2023-12-20T04:48:03.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.240+0000 7fcd1bb00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1415ccd0 con 0x7fcd1415aee0 2023-12-20T04:48:03.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.240+0000 7fcd1bb00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd1415cfb0 con 0x7fcd140cdbb0 2023-12-20T04:48:03.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.240+0000 7fcd1989c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd140cb2b0 0x7fcd1415c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:03.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.240+0000 7fcd1989c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd140cb2b0 0x7fcd1415c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59896/0 (socket says 172.21.15.132:59896) 2023-12-20T04:48:03.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.240+0000 7fcd1989c640 1 -- 172.21.15.132:0/101135025 learned_addr learned my addr 172.21.15.132:0/101135025 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:03.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.240+0000 7fcd1a09d640 1 --2- 172.21.15.132:0/101135025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd1415aee0 0x7fcd141f1ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:03.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.240+0000 7fcd1909b640 1 --2- 172.21.15.132:0/101135025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd140cdbb0 0x7fcd141f1370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:03.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.240+0000 7fcd1989c640 1 -- 172.21.15.132:0/101135025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd140cdbb0 msgr2=0x7fcd141f1370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:03.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.240+0000 7fcd1989c640 1 --2- 172.21.15.132:0/101135025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd140cdbb0 0x7fcd141f1370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:03.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.240+0000 7fcd1989c640 1 -- 172.21.15.132:0/101135025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd1415aee0 msgr2=0x7fcd141f1ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:03.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.240+0000 7fcd1989c640 1 --2- 172.21.15.132:0/101135025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd1415aee0 0x7fcd141f1ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:03.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.240+0000 7fcd1989c640 1 -- 172.21.15.132:0/101135025 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd0c009b30 con 0x7fcd140cb2b0 2023-12-20T04:48:03.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.241+0000 7fcd1989c640 1 --2- 172.21.15.132:0/101135025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd140cb2b0 0x7fcd1415c6f0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000c430 tx=0x7fcd1000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:03.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.241+0000 7fcd0a7fc640 1 -- 172.21.15.132:0/101135025 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10011790 con 0x7fcd140cb2b0 2023-12-20T04:48:03.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.241+0000 7fcd0a7fc640 1 -- 172.21.15.132:0/101135025 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd100118f0 con 0x7fcd140cb2b0 2023-12-20T04:48:03.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.241+0000 7fcd1bb00640 1 -- 172.21.15.132:0/101135025 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd1415d290 con 0x7fcd140cb2b0 2023-12-20T04:48:03.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.241+0000 7fcd0a7fc640 1 -- 172.21.15.132:0/101135025 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd10011ce0 con 0x7fcd140cb2b0 2023-12-20T04:48:03.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.241+0000 7fcd1bb00640 1 -- 172.21.15.132:0/101135025 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd1415d850 con 0x7fcd140cb2b0 2023-12-20T04:48:03.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.242+0000 7fcd1bb00640 1 -- 172.21.15.132:0/101135025 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd1404e840 con 0x7fcd140cb2b0 2023-12-20T04:48:03.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.242+0000 7fcd0a7fc640 1 -- 172.21.15.132:0/101135025 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcd1001c460 con 0x7fcd140cb2b0 2023-12-20T04:48:03.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.242+0000 7fcd0a7fc640 1 --2- 172.21.15.132:0/101135025 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fccf806a430 0x7fccf806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:03.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.243+0000 7fcd0a7fc640 1 -- 172.21.15.132:0/101135025 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(119..119 src has 1..119) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fcd10088730 con 0x7fcd140cb2b0 2023-12-20T04:48:03.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.243+0000 7fcd1909b640 1 --2- 172.21.15.132:0/101135025 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fccf806a430 0x7fccf806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:03.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.243+0000 7fcd1909b640 1 --2- 172.21.15.132:0/101135025 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fccf806a430 0x7fccf806c8f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcd140aa8d0 tx=0x7fcd04008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:03.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.247+0000 7fcd0a7fc640 1 -- 172.21.15.132:0/101135025 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcd10053e70 con 0x7fcd140cb2b0 2023-12-20T04:48:03.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:03.414+0000 7fcd1bb00640 1 -- 172.21.15.132:0/101135025 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fcd140b2890 con 0x7fcd140cb2b0 2023-12-20T04:48:04.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.115+0000 7fcd0a7fc640 1 -- 172.21.15.132:0/101135025 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v120) v1 ==== 170+0+0 (secure 0 0 0) 0x7fcd10057490 con 0x7fcd140cb2b0 2023-12-20T04:48:04.117 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2023-12-20T04:48:04.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.122+0000 7fcd1bb00640 1 -- 172.21.15.132:0/101135025 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fccf806a430 msgr2=0x7fccf806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.122+0000 7fcd1bb00640 1 --2- 172.21.15.132:0/101135025 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fccf806a430 0x7fccf806c8f0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7fcd140aa8d0 tx=0x7fcd04008040 comp rx=0 tx=0).stop 2023-12-20T04:48:04.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.123+0000 7fcd1bb00640 1 -- 172.21.15.132:0/101135025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd140cb2b0 msgr2=0x7fcd1415c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.123+0000 7fcd1bb00640 1 --2- 172.21.15.132:0/101135025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd140cb2b0 0x7fcd1415c6f0 secure :-1 s=READY pgs=1181 cs=0 l=1 rev1=1 crypto rx=0x7fcd1000c430 tx=0x7fcd1000c8f0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.123+0000 7fcd1bb00640 1 -- 172.21.15.132:0/101135025 shutdown_connections 2023-12-20T04:48:04.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.123+0000 7fcd1bb00640 1 --2- 172.21.15.132:0/101135025 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fccf806a430 0x7fccf806c8f0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.123+0000 7fcd1bb00640 1 --2- 172.21.15.132:0/101135025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd1415aee0 0x7fcd141f1ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.123+0000 7fcd1bb00640 1 --2- 172.21.15.132:0/101135025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd140cdbb0 0x7fcd141f1370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.123+0000 7fcd1bb00640 1 --2- 172.21.15.132:0/101135025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd140cb2b0 0x7fcd1415c6f0 unknown :-1 s=CLOSED pgs=1181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.123+0000 7fcd1bb00640 1 -- 172.21.15.132:0/101135025 >> 172.21.15.132:0/101135025 conn(0x7fcd14072c60 msgr2=0x7fcd140b3910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:04.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.123+0000 7fcd1bb00640 1 -- 172.21.15.132:0/101135025 shutdown_connections 2023-12-20T04:48:04.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.123+0000 7fcd1bb00640 1 -- 172.21.15.132:0/101135025 wait complete. 2023-12-20T04:48:04.138 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-20T04:48:04.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.242+0000 7f39122a1640 1 Processor -- start 2023-12-20T04:48:04.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.242+0000 7f39122a1640 1 -- start start 2023-12-20T04:48:04.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f39122a1640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f390c0cf880 0x7f390c0cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f39122a1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c0d1a90 con 0x7f390c0b60e0 2023-12-20T04:48:04.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f39122a1640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f390c0d1d70 con 0x7f390c15d300 2023-12-20T04:48:04.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f39122a1640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f390c0d0250 con 0x7f390c0cf880 2023-12-20T04:48:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f391083e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f390c0b60e0 0x7f390c0b64f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43780/0 (socket says 172.21.15.132:43780) 2023-12-20T04:48:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f391083e640 1 -- 172.21.15.132:0/962879135 learned_addr learned my addr 172.21.15.132:0/962879135 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f390affd640 1 -- 172.21.15.132:0/962879135 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3597036201 0 0) 0x7f390c0d1a90 con 0x7f390c0b60e0 2023-12-20T04:48:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f390b7fe640 1 --2- 172.21.15.132:0/962879135 >> v2:172.21.15.187:3300/0 conn(0x7f390c0cf880 0x7f390c0cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f390affd640 1 -- 172.21.15.132:0/962879135 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f38f4003520 con 0x7f390c0b60e0 2023-12-20T04:48:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f390affd640 1 -- 172.21.15.132:0/962879135 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1654981313 0 0) 0x7f38f4003520 con 0x7f390c0b60e0 2023-12-20T04:48:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f390affd640 1 -- 172.21.15.132:0/962879135 >> v2:172.21.15.187:3300/0 conn(0x7f390c0cf880 msgr2=0x7f390c0cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f390affd640 1 --2- 172.21.15.132:0/962879135 >> v2:172.21.15.187:3300/0 conn(0x7f390c0cf880 0x7f390c0cfd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f390affd640 1 -- 172.21.15.132:0/962879135 >> v1:172.21.15.187:6789/0 conn(0x7f390c15d300 legacy=0x7f390c0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f390affd640 1 -- 172.21.15.132:0/962879135 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c0d2050 con 0x7f390c0b60e0 2023-12-20T04:48:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f390affd640 1 -- 172.21.15.132:0/962879135 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f39040019f0 con 0x7f390c0b60e0 2023-12-20T04:48:04.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f390affd640 1 -- 172.21.15.132:0/962879135 >> v1:172.21.15.132:6789/0 conn(0x7f390c0b60e0 legacy=0x7f390c0b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f390affd640 1 --2- 172.21.15.132:0/962879135 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38f4003970 0x7f38f4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f390affd640 1 --2- 172.21.15.132:0/962879135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38f40047c0 0x7f38f4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f390affd640 1 --2- 172.21.15.132:0/962879135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38f4005180 0x7f38f400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f390affd640 1 -- 172.21.15.132:0/962879135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c0d0250 con 0x7f38f40047c0 2023-12-20T04:48:04.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f390affd640 1 -- 172.21.15.132:0/962879135 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f38f400c020 con 0x7f38f4005180 2023-12-20T04:48:04.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.243+0000 7f390affd640 1 -- 172.21.15.132:0/962879135 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f38f400c1e0 con 0x7f38f4003970 2023-12-20T04:48:04.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.244+0000 7f390b7fe640 1 --2- 172.21.15.132:0/962879135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38f40047c0 0x7f38f4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.244+0000 7f390bfff640 1 --2- 172.21.15.132:0/962879135 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38f4003970 0x7f38f4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.244+0000 7f391083e640 1 --2- 172.21.15.132:0/962879135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38f4005180 0x7f38f400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.244+0000 7f390b7fe640 1 -- 172.21.15.132:0/962879135 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38f4003970 msgr2=0x7f38f4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.244+0000 7f390b7fe640 1 --2- 172.21.15.132:0/962879135 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f38f4003970 0x7f38f4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.244+0000 7f390b7fe640 1 -- 172.21.15.132:0/962879135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38f4005180 msgr2=0x7f38f400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.244+0000 7f390b7fe640 1 --2- 172.21.15.132:0/962879135 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f38f4005180 0x7f38f400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.244+0000 7f391083e640 1 -- 172.21.15.132:0/962879135 reap_dead start 2023-12-20T04:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.244+0000 7f390b7fe640 1 -- 172.21.15.132:0/962879135 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f38f4003520 con 0x7f38f40047c0 2023-12-20T04:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.245+0000 7f390b7fe640 1 --2- 172.21.15.132:0/962879135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38f40047c0 0x7f38f4004c40 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f3900009ab0 tx=0x7f38f40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1e4c342bc4ba73 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.245+0000 7f390affd640 1 -- 172.21.15.132:0/962879135 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900005990 con 0x7f38f40047c0 2023-12-20T04:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.245+0000 7f390affd640 1 -- 172.21.15.132:0/962879135 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3900005af0 con 0x7f38f40047c0 2023-12-20T04:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.245+0000 7f390affd640 1 -- 172.21.15.132:0/962879135 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3900005ea0 con 0x7f38f40047c0 2023-12-20T04:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.245+0000 7f39122a1640 1 -- 172.21.15.132:0/962879135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38f40047c0 msgr2=0x7f38f4004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.245+0000 7f39122a1640 1 --2- 172.21.15.132:0/962879135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38f40047c0 0x7f38f4004c40 secure :-1 s=READY pgs=1183 cs=0 l=1 rev1=1 crypto rx=0x7f3900009ab0 tx=0x7f38f40057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.245+0000 7f39122a1640 1 -- 172.21.15.132:0/962879135 shutdown_connections 2023-12-20T04:48:04.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.245+0000 7f39122a1640 1 --2- 172.21.15.132:0/962879135 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38f40047c0 0x7f38f4004c40 unknown :-1 s=CLOSED pgs=1183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.245+0000 7f39122a1640 1 -- 172.21.15.132:0/962879135 >> 172.21.15.132:0/962879135 conn(0x7f390c06a3d0 msgr2=0x7f390c06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.245+0000 7f39122a1640 1 -- 172.21.15.132:0/962879135 shutdown_connections 2023-12-20T04:48:04.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.245+0000 7f39122a1640 1 -- 172.21.15.132:0/962879135 wait complete. 2023-12-20T04:48:04.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.246+0000 7f39122a1640 1 Processor -- start 2023-12-20T04:48:04.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.247+0000 7f39122a1640 1 -- start start 2023-12-20T04:48:04.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.247+0000 7f39122a1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38f40047c0 0x7f390c0c5410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.247+0000 7f39122a1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f390c1e6ed0 0x7f390c1e7350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.247+0000 7f39122a1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f390c15b6e0 0x7f390c15bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.247+0000 7f39122a1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c15abc0 con 0x7f38f40047c0 2023-12-20T04:48:04.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.247+0000 7f39122a1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f390c1e7890 con 0x7f390c1e6ed0 2023-12-20T04:48:04.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.247+0000 7f39122a1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f390c15c3a0 con 0x7f390c15b6e0 2023-12-20T04:48:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.247+0000 7f390bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38f40047c0 0x7f390c0c5410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.247+0000 7f390bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38f40047c0 0x7f390c0c5410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59922/0 (socket says 172.21.15.132:59922) 2023-12-20T04:48:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.247+0000 7f390bfff640 1 -- 172.21.15.132:0/2702658179 learned_addr learned my addr 172.21.15.132:0/2702658179 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.248+0000 7f390b7fe640 1 --2- 172.21.15.132:0/2702658179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f390c1e6ed0 0x7f390c1e7350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.248+0000 7f391083e640 1 --2- 172.21.15.132:0/2702658179 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f390c15b6e0 0x7f390c15bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.248+0000 7f390bfff640 1 -- 172.21.15.132:0/2702658179 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f390c15b6e0 msgr2=0x7f390c15bb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.248+0000 7f390bfff640 1 --2- 172.21.15.132:0/2702658179 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f390c15b6e0 0x7f390c15bb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.248+0000 7f390bfff640 1 -- 172.21.15.132:0/2702658179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f390c1e6ed0 msgr2=0x7f390c1e7350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.248+0000 7f390bfff640 1 --2- 172.21.15.132:0/2702658179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f390c1e6ed0 0x7f390c1e7350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.248+0000 7f390bfff640 1 -- 172.21.15.132:0/2702658179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f390c15a220 con 0x7f38f40047c0 2023-12-20T04:48:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.248+0000 7f390b7fe640 1 --2- 172.21.15.132:0/2702658179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f390c1e6ed0 0x7f390c1e7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:04.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.248+0000 7f391083e640 1 --2- 172.21.15.132:0/2702658179 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f390c15b6e0 0x7f390c15bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:04.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.248+0000 7f390bfff640 1 --2- 172.21.15.132:0/2702658179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38f40047c0 0x7f390c0c5410 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00f5f0 tx=0x7f38fc00fab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:04.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.248+0000 7f3908ff9640 1 -- 172.21.15.132:0/2702658179 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc0052e0 con 0x7f38f40047c0 2023-12-20T04:48:04.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.248+0000 7f3908ff9640 1 -- 172.21.15.132:0/2702658179 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f38fc005440 con 0x7f38f40047c0 2023-12-20T04:48:04.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.248+0000 7f39122a1640 1 -- 172.21.15.132:0/2702658179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f390c15a500 con 0x7f38f40047c0 2023-12-20T04:48:04.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.248+0000 7f3908ff9640 1 -- 172.21.15.132:0/2702658179 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f38fc003810 con 0x7f38f40047c0 2023-12-20T04:48:04.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.248+0000 7f39122a1640 1 -- 172.21.15.132:0/2702658179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f390c0c5950 con 0x7f38f40047c0 2023-12-20T04:48:04.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.249+0000 7f39122a1640 1 -- 172.21.15.132:0/2702658179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f390c04e840 con 0x7f38f40047c0 2023-12-20T04:48:04.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.249+0000 7f3908ff9640 1 -- 172.21.15.132:0/2702658179 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f38fc003970 con 0x7f38f40047c0 2023-12-20T04:48:04.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.250+0000 7f3908ff9640 1 --2- 172.21.15.132:0/2702658179 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f38f806a430 0x7f38f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.250+0000 7f3908ff9640 1 -- 172.21.15.132:0/2702658179 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(120..120 src has 1..120) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f38fc0886b0 con 0x7f38f40047c0 2023-12-20T04:48:04.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.250+0000 7f390b7fe640 1 --2- 172.21.15.132:0/2702658179 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f38f806a430 0x7f38f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.250+0000 7f390b7fe640 1 --2- 172.21.15.132:0/2702658179 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f38f806a430 0x7f38f806c8f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3900035000 tx=0x7f3900030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:04.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.254+0000 7f3908ff9640 1 -- 172.21.15.132:0/2702658179 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f38fc053d90 con 0x7f38f40047c0 2023-12-20T04:48:04.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.454+0000 7f39122a1640 1 -- 172.21.15.132:0/2702658179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f390c0cd8c0 con 0x7f38f40047c0 2023-12-20T04:48:04.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.463+0000 7f3908ff9640 1 -- 172.21.15.132:0/2702658179 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 14 and data pool 15 v42) v1 ==== 174+0+0 (secure 0 0 0) 0x7f38fc0573b0 con 0x7f38f40047c0 2023-12-20T04:48:04.467 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 14 and data pool 15 2023-12-20T04:48:04.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.470+0000 7f39122a1640 1 -- 172.21.15.132:0/2702658179 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f38f806a430 msgr2=0x7f38f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.471+0000 7f39122a1640 1 --2- 172.21.15.132:0/2702658179 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f38f806a430 0x7f38f806c8f0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f3900035000 tx=0x7f3900030000 comp rx=0 tx=0).stop 2023-12-20T04:48:04.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.471+0000 7f39122a1640 1 -- 172.21.15.132:0/2702658179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38f40047c0 msgr2=0x7f390c0c5410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.471+0000 7f39122a1640 1 --2- 172.21.15.132:0/2702658179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38f40047c0 0x7f390c0c5410 secure :-1 s=READY pgs=1184 cs=0 l=1 rev1=1 crypto rx=0x7f38fc00f5f0 tx=0x7f38fc00fab0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.474+0000 7f39122a1640 1 -- 172.21.15.132:0/2702658179 shutdown_connections 2023-12-20T04:48:04.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.474+0000 7f39122a1640 1 --2- 172.21.15.132:0/2702658179 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f38f806a430 0x7f38f806c8f0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.475+0000 7f39122a1640 1 --2- 172.21.15.132:0/2702658179 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f390c15b6e0 0x7f390c15bb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.475+0000 7f39122a1640 1 --2- 172.21.15.132:0/2702658179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f390c1e6ed0 0x7f390c1e7350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.475+0000 7f39122a1640 1 --2- 172.21.15.132:0/2702658179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f38f40047c0 0x7f390c0c5410 unknown :-1 s=CLOSED pgs=1184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.475+0000 7f39122a1640 1 -- 172.21.15.132:0/2702658179 >> 172.21.15.132:0/2702658179 conn(0x7f390c06a3d0 msgr2=0x7f390c0b71c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:04.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.475+0000 7f39122a1640 1 -- 172.21.15.132:0/2702658179 shutdown_connections 2023-12-20T04:48:04.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.475+0000 7f39122a1640 1 -- 172.21.15.132:0/2702658179 wait complete. 2023-12-20T04:48:04.489 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:48:04.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.587+0000 7fe178db1640 1 Processor -- start 2023-12-20T04:48:04.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.587+0000 7fe178db1640 1 -- start start 2023-12-20T04:48:04.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe178db1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1740cf0b0 0x7fe1740b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe178db1640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe1740cb420 0x7fe1740d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe178db1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe1740cd740 con 0x7fe17415e2d0 2023-12-20T04:48:04.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe178db1640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1740ce230 con 0x7fe1740cb420 2023-12-20T04:48:04.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe178db1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740cd990 con 0x7fe1740cf0b0 2023-12-20T04:48:04.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe17259c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe17415e2d0 0x7fe1740ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43782/0 (socket says 172.21.15.132:43782) 2023-12-20T04:48:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe17259c640 1 -- 172.21.15.132:0/2310892971 learned_addr learned my addr 172.21.15.132:0/2310892971 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe172d9d640 1 --2- 172.21.15.132:0/2310892971 >> v2:172.21.15.187:3300/0 conn(0x7fe1740cb420 0x7fe1740d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe16bfff640 1 --2- 172.21.15.132:0/2310892971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1740cf0b0 0x7fe1740b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe171d9b640 1 -- 172.21.15.132:0/2310892971 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4148055385 0 0) 0x7fe1740cd740 con 0x7fe17415e2d0 2023-12-20T04:48:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe171d9b640 1 -- 172.21.15.132:0/2310892971 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe160003520 con 0x7fe17415e2d0 2023-12-20T04:48:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe171d9b640 1 -- 172.21.15.132:0/2310892971 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3632515080 0 0) 0x7fe160003520 con 0x7fe17415e2d0 2023-12-20T04:48:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe171d9b640 1 -- 172.21.15.132:0/2310892971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1740cf0b0 msgr2=0x7fe1740b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe171d9b640 1 --2- 172.21.15.132:0/2310892971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1740cf0b0 0x7fe1740b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe171d9b640 1 -- 172.21.15.132:0/2310892971 >> v2:172.21.15.187:3300/0 conn(0x7fe1740cb420 msgr2=0x7fe1740d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe171d9b640 1 --2- 172.21.15.132:0/2310892971 >> v2:172.21.15.187:3300/0 conn(0x7fe1740cb420 0x7fe1740d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe171d9b640 1 -- 172.21.15.132:0/2310892971 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1740cdc70 con 0x7fe17415e2d0 2023-12-20T04:48:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe171d9b640 1 -- 172.21.15.132:0/2310892971 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fe164001670 con 0x7fe17415e2d0 2023-12-20T04:48:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe171d9b640 1 -- 172.21.15.132:0/2310892971 >> v1:172.21.15.132:6789/0 conn(0x7fe17415e2d0 legacy=0x7fe1740ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe171d9b640 1 --2- 172.21.15.132:0/2310892971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1740cf0b0 0x7fe160003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe171d9b640 1 --2- 172.21.15.132:0/2310892971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe160003ef0 0x7fe1600047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe171d9b640 1 --2- 172.21.15.132:0/2310892971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe160004d00 0x7fe160005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe171d9b640 1 -- 172.21.15.132:0/2310892971 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740ce230 con 0x7fe160003ef0 2023-12-20T04:48:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe171d9b640 1 -- 172.21.15.132:0/2310892971 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740cd990 con 0x7fe160004d00 2023-12-20T04:48:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.588+0000 7fe171d9b640 1 -- 172.21.15.132:0/2310892971 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe16000b9d0 con 0x7fe1740cf0b0 2023-12-20T04:48:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.589+0000 7fe16bfff640 1 --2- 172.21.15.132:0/2310892971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe160003ef0 0x7fe1600047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.589+0000 7fe17259c640 1 --2- 172.21.15.132:0/2310892971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1740cf0b0 0x7fe160003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.589+0000 7fe172d9d640 1 --2- 172.21.15.132:0/2310892971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe160004d00 0x7fe160005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.589+0000 7fe16bfff640 1 -- 172.21.15.132:0/2310892971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1740cf0b0 msgr2=0x7fe160003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.589+0000 7fe16bfff640 1 --2- 172.21.15.132:0/2310892971 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1740cf0b0 0x7fe160003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.589+0000 7fe16bfff640 1 -- 172.21.15.132:0/2310892971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe160004d00 msgr2=0x7fe160005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.589+0000 7fe16bfff640 1 --2- 172.21.15.132:0/2310892971 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe160004d00 0x7fe160005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.589+0000 7fe16bfff640 1 -- 172.21.15.132:0/2310892971 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe160003520 con 0x7fe160003ef0 2023-12-20T04:48:04.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.589+0000 7fe16bfff640 1 --2- 172.21.15.132:0/2310892971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe160003ef0 0x7fe1600047c0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fe15c009af0 tx=0x7fe1600057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f54e288be776175 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:04.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.590+0000 7fe171d9b640 1 -- 172.21.15.132:0/2310892971 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c02c6b0 con 0x7fe160003ef0 2023-12-20T04:48:04.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.590+0000 7fe171d9b640 1 -- 172.21.15.132:0/2310892971 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe15c02c810 con 0x7fe160003ef0 2023-12-20T04:48:04.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.590+0000 7fe171d9b640 1 -- 172.21.15.132:0/2310892971 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe15c02cba0 con 0x7fe160003ef0 2023-12-20T04:48:04.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.590+0000 7fe178db1640 1 -- 172.21.15.132:0/2310892971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe160003ef0 msgr2=0x7fe1600047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.590+0000 7fe178db1640 1 --2- 172.21.15.132:0/2310892971 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe160003ef0 0x7fe1600047c0 secure :-1 s=READY pgs=1186 cs=0 l=1 rev1=1 crypto rx=0x7fe15c009af0 tx=0x7fe1600057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.590+0000 7fe172d9d640 1 -- 172.21.15.132:0/2310892971 reap_dead start 2023-12-20T04:48:04.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.590+0000 7fe178db1640 1 -- 172.21.15.132:0/2310892971 shutdown_connections 2023-12-20T04:48:04.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.590+0000 7fe178db1640 1 -- 172.21.15.132:0/2310892971 >> 172.21.15.132:0/2310892971 conn(0x7fe17406d7c0 msgr2=0x7fe17406dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:04.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.590+0000 7fe178db1640 1 -- 172.21.15.132:0/2310892971 shutdown_connections 2023-12-20T04:48:04.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.590+0000 7fe178db1640 1 -- 172.21.15.132:0/2310892971 wait complete. 2023-12-20T04:48:04.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.591+0000 7fe178db1640 1 Processor -- start 2023-12-20T04:48:04.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.592+0000 7fe178db1640 1 -- start start 2023-12-20T04:48:04.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.592+0000 7fe178db1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe160003ef0 0x7fe174156570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.592+0000 7fe178db1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1740c65c0 0x7fe1740c4730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.592+0000 7fe178db1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe174151bc0 0x7fe1740b4e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.592+0000 7fe178db1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740c4c70 con 0x7fe160003ef0 2023-12-20T04:48:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.592+0000 7fe178db1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740c4f10 con 0x7fe174151bc0 2023-12-20T04:48:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.592+0000 7fe178db1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1740c51f0 con 0x7fe1740c65c0 2023-12-20T04:48:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.592+0000 7fe17259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe160003ef0 0x7fe174156570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.592+0000 7fe17259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe160003ef0 0x7fe174156570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59946/0 (socket says 172.21.15.132:59946) 2023-12-20T04:48:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.592+0000 7fe17259c640 1 -- 172.21.15.132:0/3433899448 learned_addr learned my addr 172.21.15.132:0/3433899448 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.592+0000 7fe172d9d640 1 --2- 172.21.15.132:0/3433899448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe174151bc0 0x7fe1740b4e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.592+0000 7fe16bfff640 1 --2- 172.21.15.132:0/3433899448 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1740c65c0 0x7fe1740c4730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.593+0000 7fe17259c640 1 -- 172.21.15.132:0/3433899448 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1740c65c0 msgr2=0x7fe1740c4730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.593+0000 7fe17259c640 1 --2- 172.21.15.132:0/3433899448 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1740c65c0 0x7fe1740c4730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.593+0000 7fe17259c640 1 -- 172.21.15.132:0/3433899448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe174151bc0 msgr2=0x7fe1740b4e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.593+0000 7fe17259c640 1 --2- 172.21.15.132:0/3433899448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe174151bc0 0x7fe1740b4e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.593+0000 7fe17259c640 1 -- 172.21.15.132:0/3433899448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1740c54d0 con 0x7fe160003ef0 2023-12-20T04:48:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.593+0000 7fe172d9d640 1 --2- 172.21.15.132:0/3433899448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe174151bc0 0x7fe1740b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.593+0000 7fe17259c640 1 --2- 172.21.15.132:0/3433899448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe160003ef0 0x7fe174156570 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fe164007340 tx=0x7fe164007800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.593+0000 7fe16affd640 1 -- 172.21.15.132:0/3433899448 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16400f940 con 0x7fe160003ef0 2023-12-20T04:48:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.593+0000 7fe16affd640 1 -- 172.21.15.132:0/3433899448 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe16400fac0 con 0x7fe160003ef0 2023-12-20T04:48:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.593+0000 7fe178db1640 1 -- 172.21.15.132:0/3433899448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1740c57b0 con 0x7fe160003ef0 2023-12-20T04:48:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.593+0000 7fe16affd640 1 -- 172.21.15.132:0/3433899448 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe16400fe70 con 0x7fe160003ef0 2023-12-20T04:48:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.593+0000 7fe178db1640 1 -- 172.21.15.132:0/3433899448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe174152040 con 0x7fe160003ef0 2023-12-20T04:48:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.594+0000 7fe178db1640 1 -- 172.21.15.132:0/3433899448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe17404e840 con 0x7fe160003ef0 2023-12-20T04:48:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.594+0000 7fe16affd640 1 -- 172.21.15.132:0/3433899448 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe16401d460 con 0x7fe160003ef0 2023-12-20T04:48:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.595+0000 7fe16affd640 1 --2- 172.21.15.132:0/3433899448 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe15406a430 0x7fe15406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.595+0000 7fe16affd640 1 -- 172.21.15.132:0/3433899448 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe164088b40 con 0x7fe160003ef0 2023-12-20T04:48:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.595+0000 7fe16bfff640 1 --2- 172.21.15.132:0/3433899448 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe15406a430 0x7fe15406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.595+0000 7fe16bfff640 1 --2- 172.21.15.132:0/3433899448 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe15406a430 0x7fe15406c8f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe15c036000 tx=0x7fe15c030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:04.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.599+0000 7fe16affd640 1 -- 172.21.15.132:0/3433899448 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe1640541c0 con 0x7fe160003ef0 2023-12-20T04:48:04.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.767+0000 7fe178db1640 1 -- 172.21.15.132:0/3433899448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe1740ce480 con 0x7fe160003ef0 2023-12-20T04:48:04.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.768+0000 7fe16affd640 1 -- 172.21.15.132:0/3433899448 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+16113 (secure 0 0 0) 0x7fe1640577e0 con 0x7fe160003ef0 2023-12-20T04:48:04.770 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:04.770 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":121,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:48:04.456325+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:48:02.660300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-20T04:48:03.433311+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:48:04.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.770+0000 7fe178db1640 1 -- 172.21.15.132:0/3433899448 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe15406a430 msgr2=0x7fe15406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.770+0000 7fe178db1640 1 --2- 172.21.15.132:0/3433899448 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe15406a430 0x7fe15406c8f0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7fe15c036000 tx=0x7fe15c030000 comp rx=0 tx=0).stop 2023-12-20T04:48:04.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.770+0000 7fe178db1640 1 -- 172.21.15.132:0/3433899448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe160003ef0 msgr2=0x7fe174156570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.770+0000 7fe178db1640 1 --2- 172.21.15.132:0/3433899448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe160003ef0 0x7fe174156570 secure :-1 s=READY pgs=1187 cs=0 l=1 rev1=1 crypto rx=0x7fe164007340 tx=0x7fe164007800 comp rx=0 tx=0).stop 2023-12-20T04:48:04.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.770+0000 7fe178db1640 1 -- 172.21.15.132:0/3433899448 shutdown_connections 2023-12-20T04:48:04.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.770+0000 7fe178db1640 1 --2- 172.21.15.132:0/3433899448 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe15406a430 0x7fe15406c8f0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.770+0000 7fe178db1640 1 --2- 172.21.15.132:0/3433899448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe174151bc0 0x7fe1740b4e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.770+0000 7fe178db1640 1 --2- 172.21.15.132:0/3433899448 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1740c65c0 0x7fe1740c4730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.770+0000 7fe178db1640 1 --2- 172.21.15.132:0/3433899448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe160003ef0 0x7fe174156570 unknown :-1 s=CLOSED pgs=1187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.770+0000 7fe178db1640 1 -- 172.21.15.132:0/3433899448 >> 172.21.15.132:0/3433899448 conn(0x7fe17406d7c0 msgr2=0x7fe1740ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:04.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.770+0000 7fe178db1640 1 -- 172.21.15.132:0/3433899448 shutdown_connections 2023-12-20T04:48:04.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.770+0000 7fe178db1640 1 -- 172.21.15.132:0/3433899448 wait complete. 2023-12-20T04:48:04.783 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:48:04.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.882+0000 7f66a358b640 1 Processor -- start 2023-12-20T04:48:04.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.882+0000 7f66a358b640 1 -- start start 2023-12-20T04:48:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.883+0000 7f66a358b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f669c0caa90 0x7f669c0caf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.883+0000 7f66a358b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f669c06cc30 0x7f669c06d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.883+0000 7f66a358b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f669c15e4c0 con 0x7f669c159d00 2023-12-20T04:48:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.883+0000 7f66a358b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f669c06c220 con 0x7f669c0caa90 2023-12-20T04:48:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.883+0000 7f66a358b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c06d5e0 con 0x7f669c06cc30 2023-12-20T04:48:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.884+0000 7f66a0b26640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f669c0caa90 0x7f669c0caf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.884+0000 7f66a1b28640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f669c06cc30 0x7f669c06d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.884+0000 7f66a1327640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f669c159d00 0x7f669c15da00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:45618/0 (socket says 172.21.15.132:45618) 2023-12-20T04:48:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.884+0000 7f66a1327640 1 -- 172.21.15.132:0/451265262 learned_addr learned my addr 172.21.15.132:0/451265262 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.884+0000 7f66a0b26640 1 -- 172.21.15.132:0/451265262 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f669c06cc30 msgr2=0x7f669c06d0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.884+0000 7f66a0b26640 1 --2- 172.21.15.132:0/451265262 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f669c06cc30 0x7f669c06d0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.884+0000 7f66a0b26640 1 -- 172.21.15.132:0/451265262 >> v1:172.21.15.187:6789/0 conn(0x7f669c159d00 legacy=0x7f669c15da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.884+0000 7f6693fff640 1 -- 172.21.15.132:0/451265262 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1353795902 0 0) 0x7f669c15e4c0 con 0x7f669c159d00 2023-12-20T04:48:04.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.884+0000 7f66a0b26640 1 -- 172.21.15.132:0/451265262 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f669c15e7a0 con 0x7f669c0caa90 2023-12-20T04:48:04.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.884+0000 7f66a1b28640 1 --2- 172.21.15.132:0/451265262 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f669c06cc30 0x7f669c06d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:48:04.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.885+0000 7f66a0b26640 1 --2- 172.21.15.132:0/451265262 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f669c0caa90 0x7f669c0caf20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f66980097a0 tx=0x7f669802b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=a40aa83c5f2e0acc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:04.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.885+0000 7f6693fff640 1 -- 172.21.15.132:0/451265262 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698031830 con 0x7f669c0caa90 2023-12-20T04:48:04.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.885+0000 7f6693fff640 1 -- 172.21.15.132:0/451265262 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6698031990 con 0x7f669c0caa90 2023-12-20T04:48:04.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.885+0000 7f6693fff640 1 -- 172.21.15.132:0/451265262 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6698031d20 con 0x7f669c0caa90 2023-12-20T04:48:04.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.886+0000 7f66a358b640 1 -- 172.21.15.132:0/451265262 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f669c0caa90 msgr2=0x7f669c0caf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.886+0000 7f66a358b640 1 --2- 172.21.15.132:0/451265262 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f669c0caa90 0x7f669c0caf20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f66980097a0 tx=0x7f669802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.886+0000 7f66a358b640 1 -- 172.21.15.132:0/451265262 shutdown_connections 2023-12-20T04:48:04.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.886+0000 7f66a358b640 1 --2- 172.21.15.132:0/451265262 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f669c06cc30 0x7f669c06d0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.886+0000 7f66a358b640 1 --2- 172.21.15.132:0/451265262 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f669c0caa90 0x7f669c0caf20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.886+0000 7f66a358b640 1 -- 172.21.15.132:0/451265262 >> 172.21.15.132:0/451265262 conn(0x7f669c0cfca0 msgr2=0x7f669c0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:04.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.886+0000 7f66a358b640 1 -- 172.21.15.132:0/451265262 shutdown_connections 2023-12-20T04:48:04.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.886+0000 7f66a358b640 1 -- 172.21.15.132:0/451265262 wait complete. 2023-12-20T04:48:04.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.887+0000 7f66a358b640 1 Processor -- start 2023-12-20T04:48:04.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.887+0000 7f66a358b640 1 -- start start 2023-12-20T04:48:04.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a358b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f669c06cc30 0x7f669c069ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a358b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f669c0caa90 0x7f669c0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a358b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f669c159d00 0x7f669c0c72b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a358b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c14cd50 con 0x7f669c0caa90 2023-12-20T04:48:04.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a358b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f669c14db70 con 0x7f669c06cc30 2023-12-20T04:48:04.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a358b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f669c14cf60 con 0x7f669c159d00 2023-12-20T04:48:04.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a0b26640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f669c0caa90 0x7f669c0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a0b26640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f669c0caa90 0x7f669c0c6d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59954/0 (socket says 172.21.15.132:59954) 2023-12-20T04:48:04.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a0b26640 1 -- 172.21.15.132:0/858346701 learned_addr learned my addr 172.21.15.132:0/858346701 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:04.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a1327640 1 --2- 172.21.15.132:0/858346701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f669c06cc30 0x7f669c069ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a1b28640 1 --2- 172.21.15.132:0/858346701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f669c159d00 0x7f669c0c72b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a0b26640 1 -- 172.21.15.132:0/858346701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f669c159d00 msgr2=0x7f669c0c72b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a0b26640 1 --2- 172.21.15.132:0/858346701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f669c159d00 0x7f669c0c72b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a0b26640 1 -- 172.21.15.132:0/858346701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f669c06cc30 msgr2=0x7f669c069ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:04.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a0b26640 1 --2- 172.21.15.132:0/858346701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f669c06cc30 0x7f669c069ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:04.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a0b26640 1 -- 172.21.15.132:0/858346701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6694009a70 con 0x7f669c0caa90 2023-12-20T04:48:04.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a0b26640 1 --2- 172.21.15.132:0/858346701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f669c0caa90 0x7f669c0c6d70 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f66980098c0 tx=0x7f66980046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:04.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f6691ffb640 1 -- 172.21.15.132:0/858346701 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669803a630 con 0x7f669c0caa90 2023-12-20T04:48:04.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f6691ffb640 1 -- 172.21.15.132:0/858346701 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f669803a7b0 con 0x7f669c0caa90 2023-12-20T04:48:04.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f66a358b640 1 -- 172.21.15.132:0/858346701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6698009400 con 0x7f669c0caa90 2023-12-20T04:48:04.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.888+0000 7f6691ffb640 1 -- 172.21.15.132:0/858346701 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f669803ab60 con 0x7f669c0caa90 2023-12-20T04:48:04.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.889+0000 7f66a358b640 1 -- 172.21.15.132:0/858346701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f669c14d520 con 0x7f669c0caa90 2023-12-20T04:48:04.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.890+0000 7f66a358b640 1 -- 172.21.15.132:0/858346701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f669c04e840 con 0x7f669c0caa90 2023-12-20T04:48:04.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.890+0000 7f6691ffb640 1 -- 172.21.15.132:0/858346701 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f669803acc0 con 0x7f669c0caa90 2023-12-20T04:48:04.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.890+0000 7f6691ffb640 1 --2- 172.21.15.132:0/858346701 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f668006a430 0x7f668006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:04.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.890+0000 7f6691ffb640 1 -- 172.21.15.132:0/858346701 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f66980aa4e0 con 0x7f669c0caa90 2023-12-20T04:48:04.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.890+0000 7f66a1327640 1 --2- 172.21.15.132:0/858346701 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f668006a430 0x7f668006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:04.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.891+0000 7f66a1327640 1 --2- 172.21.15.132:0/858346701 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f668006a430 0x7f668006c8f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f668c000f60 tx=0x7f668c007d50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:04.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:04.895+0000 7f6691ffb640 1 -- 172.21.15.132:0/858346701 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6698075ca0 con 0x7f669c0caa90 2023-12-20T04:48:05.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.064+0000 7f66a358b640 1 -- 172.21.15.132:0/858346701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f669c06c400 con 0x7f669c0caa90 2023-12-20T04:48:05.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.065+0000 7f6691ffb640 1 -- 172.21.15.132:0/858346701 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v121) v1 ==== 74+0+16113 (secure 0 0 0) 0x7f66980792c0 con 0x7f669c0caa90 2023-12-20T04:48:05.067 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:05.067 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":121,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:48:04.456325+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:48:02.660300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-20T04:48:03.433311+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:48:05.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.067+0000 7f66a358b640 1 -- 172.21.15.132:0/858346701 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f668006a430 msgr2=0x7f668006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:05.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.067+0000 7f66a358b640 1 --2- 172.21.15.132:0/858346701 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f668006a430 0x7f668006c8f0 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f668c000f60 tx=0x7f668c007d50 comp rx=0 tx=0).stop 2023-12-20T04:48:05.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.067+0000 7f66a358b640 1 -- 172.21.15.132:0/858346701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f669c0caa90 msgr2=0x7f669c0c6d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:05.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.067+0000 7f66a358b640 1 --2- 172.21.15.132:0/858346701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f669c0caa90 0x7f669c0c6d70 secure :-1 s=READY pgs=1188 cs=0 l=1 rev1=1 crypto rx=0x7f66980098c0 tx=0x7f66980046c0 comp rx=0 tx=0).stop 2023-12-20T04:48:05.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.067+0000 7f66a358b640 1 -- 172.21.15.132:0/858346701 shutdown_connections 2023-12-20T04:48:05.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.067+0000 7f66a358b640 1 --2- 172.21.15.132:0/858346701 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f668006a430 0x7f668006c8f0 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:05.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.067+0000 7f66a358b640 1 --2- 172.21.15.132:0/858346701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f669c159d00 0x7f669c0c72b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:05.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.067+0000 7f66a358b640 1 --2- 172.21.15.132:0/858346701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f669c0caa90 0x7f669c0c6d70 unknown :-1 s=CLOSED pgs=1188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:05.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.067+0000 7f66a358b640 1 --2- 172.21.15.132:0/858346701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f669c06cc30 0x7f669c069ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:05.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.067+0000 7f66a358b640 1 -- 172.21.15.132:0/858346701 >> 172.21.15.132:0/858346701 conn(0x7f669c0cfca0 msgr2=0x7f669c0cefe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:05.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.067+0000 7f66a358b640 1 -- 172.21.15.132:0/858346701 shutdown_connections 2023-12-20T04:48:05.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.067+0000 7f66a358b640 1 -- 172.21.15.132:0/858346701 wait complete. 2023-12-20T04:48:05.080 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-20T04:48:05.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.182+0000 7f1379c15640 1 Processor -- start 2023-12-20T04:48:05.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.182+0000 7f1379c15640 1 -- start start 2023-12-20T04:48:05.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.182+0000 7f1379c15640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1374143610 0x7f13740caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:05.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.182+0000 7f1379c15640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f13740cd950 0x7f137406b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:05.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.182+0000 7f1379c15640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f13741439f0 con 0x7f13740c41f0 2023-12-20T04:48:05.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.182+0000 7f1379c15640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13740c46f0 con 0x7f13740cd950 2023-12-20T04:48:05.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.183+0000 7f1379c15640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13740c49d0 con 0x7f1374143610 2023-12-20T04:48:05.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.183+0000 7f1372ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f13740c41f0 0x7f13740cd240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43786/0 (socket says 172.21.15.132:43786) 2023-12-20T04:48:05.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.183+0000 7f1372ffd640 1 -- 172.21.15.132:0/711837649 learned_addr learned my addr 172.21.15.132:0/711837649 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:05.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.183+0000 7f13737fe640 1 --2- 172.21.15.132:0/711837649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1374143610 0x7f13740caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:05.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.183+0000 7f1373fff640 1 --2- 172.21.15.132:0/711837649 >> v2:172.21.15.187:3300/0 conn(0x7f13740cd950 0x7f137406b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:05.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.183+0000 7f13727fc640 1 -- 172.21.15.132:0/711837649 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 152864943 0 0) 0x7f13741439f0 con 0x7f13740c41f0 2023-12-20T04:48:05.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.183+0000 7f13727fc640 1 -- 172.21.15.132:0/711837649 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f135c003520 con 0x7f13740c41f0 2023-12-20T04:48:05.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.183+0000 7f13727fc640 1 -- 172.21.15.132:0/711837649 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3212535190 0 0) 0x7f135c003520 con 0x7f13740c41f0 2023-12-20T04:48:05.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.183+0000 7f13737fe640 1 -- 172.21.15.132:0/711837649 >> v2:172.21.15.187:3300/0 conn(0x7f13740cd950 msgr2=0x7f137406b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:05.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.183+0000 7f13737fe640 1 --2- 172.21.15.132:0/711837649 >> v2:172.21.15.187:3300/0 conn(0x7f13740cd950 0x7f137406b450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:05.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.183+0000 7f13737fe640 1 -- 172.21.15.132:0/711837649 >> v1:172.21.15.132:6789/0 conn(0x7f13740c41f0 legacy=0x7f13740cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:05.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.183+0000 7f13737fe640 1 -- 172.21.15.132:0/711837649 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13740c4cb0 con 0x7f1374143610 2023-12-20T04:48:05.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.183+0000 7f1373fff640 1 --2- 172.21.15.132:0/711837649 >> v2:172.21.15.187:3300/0 conn(0x7f13740cd950 0x7f137406b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:48:05.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.184+0000 7f13737fe640 1 --2- 172.21.15.132:0/711837649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1374143610 0x7f13740caa40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f13680097a0 tx=0x7f136802b790 comp rx=0 tx=0).ready entity=mon.2 client_cookie=16a8e12a780a2eae server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:05.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.184+0000 7f13727fc640 1 -- 172.21.15.132:0/711837649 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1364001690 con 0x7f1374143610 2023-12-20T04:48:05.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.184+0000 7f13727fc640 1 -- 172.21.15.132:0/711837649 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f136802e050 con 0x7f1374143610 2023-12-20T04:48:05.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.184+0000 7f13727fc640 1 -- 172.21.15.132:0/711837649 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1368030710 con 0x7f1374143610 2023-12-20T04:48:05.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.185+0000 7f1379c15640 1 -- 172.21.15.132:0/711837649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1374143610 msgr2=0x7f13740caa40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:05.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.185+0000 7f1379c15640 1 --2- 172.21.15.132:0/711837649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1374143610 0x7f13740caa40 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f13680097a0 tx=0x7f136802b790 comp rx=0 tx=0).stop 2023-12-20T04:48:05.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.185+0000 7f1379c15640 1 -- 172.21.15.132:0/711837649 shutdown_connections 2023-12-20T04:48:05.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.185+0000 7f1379c15640 1 --2- 172.21.15.132:0/711837649 >> v2:172.21.15.187:3300/0 conn(0x7f13740cd950 0x7f137406b450 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:05.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.185+0000 7f1379c15640 1 --2- 172.21.15.132:0/711837649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1374143610 0x7f13740caa40 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:05.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.185+0000 7f1379c15640 1 -- 172.21.15.132:0/711837649 >> 172.21.15.132:0/711837649 conn(0x7f137406a260 msgr2=0x7f13740b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:05.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.185+0000 7f1379c15640 1 -- 172.21.15.132:0/711837649 shutdown_connections 2023-12-20T04:48:05.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.185+0000 7f1379c15640 1 -- 172.21.15.132:0/711837649 wait complete. 2023-12-20T04:48:05.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.186+0000 7f1379c15640 1 Processor -- start 2023-12-20T04:48:05.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.186+0000 7f1379c15640 1 -- start start 2023-12-20T04:48:05.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.187+0000 7f1379c15640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13740c41f0 0x7f13741f1f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:05.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.187+0000 7f1379c15640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13740cd950 0x7f13740c6580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:05.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.187+0000 7f1379c15640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1374143610 0x7f13740c6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:05.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.187+0000 7f1379c15640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13740c70f0 con 0x7f13740c41f0 2023-12-20T04:48:05.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.187+0000 7f1379c15640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13740c73d0 con 0x7f1374143610 2023-12-20T04:48:05.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.187+0000 7f1379c15640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13740c76b0 con 0x7f13740cd950 2023-12-20T04:48:05.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.187+0000 7f13737fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13740c41f0 0x7f13741f1f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:05.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.187+0000 7f13737fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13740c41f0 0x7f13741f1f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59958/0 (socket says 172.21.15.132:59958) 2023-12-20T04:48:05.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.187+0000 7f13737fe640 1 -- 172.21.15.132:0/3413571384 learned_addr learned my addr 172.21.15.132:0/3413571384 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:05.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.187+0000 7f1372ffd640 1 --2- 172.21.15.132:0/3413571384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13740cd950 0x7f13740c6580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:05.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.187+0000 7f1373fff640 1 --2- 172.21.15.132:0/3413571384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1374143610 0x7f13740c6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:05.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.187+0000 7f13737fe640 1 -- 172.21.15.132:0/3413571384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13740cd950 msgr2=0x7f13740c6580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:05.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.187+0000 7f13737fe640 1 --2- 172.21.15.132:0/3413571384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13740cd950 0x7f13740c6580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:05.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.187+0000 7f13737fe640 1 -- 172.21.15.132:0/3413571384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1374143610 msgr2=0x7f13740c6ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:05.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.187+0000 7f13737fe640 1 --2- 172.21.15.132:0/3413571384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1374143610 0x7f13740c6ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:05.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.187+0000 7f13737fe640 1 -- 172.21.15.132:0/3413571384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f136c009a70 con 0x7f13740c41f0 2023-12-20T04:48:05.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.187+0000 7f13737fe640 1 --2- 172.21.15.132:0/3413571384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13740c41f0 0x7f13741f1f10 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f1368000c00 tx=0x7f13680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:05.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.188+0000 7f135bfff640 1 -- 172.21.15.132:0/3413571384 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136803f070 con 0x7f13740c41f0 2023-12-20T04:48:05.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.188+0000 7f135bfff640 1 -- 172.21.15.132:0/3413571384 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1368006e10 con 0x7f13740c41f0 2023-12-20T04:48:05.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.188+0000 7f1379c15640 1 -- 172.21.15.132:0/3413571384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1368009400 con 0x7f13740c41f0 2023-12-20T04:48:05.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.188+0000 7f135bfff640 1 -- 172.21.15.132:0/3413571384 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f136803a8e0 con 0x7f13740c41f0 2023-12-20T04:48:05.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.188+0000 7f1379c15640 1 -- 172.21.15.132:0/3413571384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13740c7c70 con 0x7f13740c41f0 2023-12-20T04:48:05.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.189+0000 7f1379c15640 1 -- 172.21.15.132:0/3413571384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f137404e840 con 0x7f13740c41f0 2023-12-20T04:48:05.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.189+0000 7f135bfff640 1 -- 172.21.15.132:0/3413571384 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f136803aa40 con 0x7f13740c41f0 2023-12-20T04:48:05.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.189+0000 7f135bfff640 1 --2- 172.21.15.132:0/3413571384 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f136006a430 0x7f136006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:05.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.190+0000 7f135bfff640 1 -- 172.21.15.132:0/3413571384 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(121..121 src has 1..121) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13680ac200 con 0x7f13740c41f0 2023-12-20T04:48:05.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.190+0000 7f1372ffd640 1 --2- 172.21.15.132:0/3413571384 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f136006a430 0x7f136006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:05.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.190+0000 7f1372ffd640 1 --2- 172.21.15.132:0/3413571384 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f136006a430 0x7f136006c8f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1364001eb0 tx=0x7f1364001cc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:05.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.194+0000 7f135bfff640 1 -- 172.21.15.132:0/3413571384 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1368077760 con 0x7f13740c41f0 2023-12-20T04:48:05.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:05.393+0000 7f1379c15640 1 -- 172.21.15.132:0/3413571384 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f13740c7e30 con 0x7f13740c41f0 2023-12-20T04:48:05.853 INFO:tasks.ceph.mds.a.smithi132.stderr:2023-12-20T04:48:05.851+0000 7fd92217b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:48:06.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.132+0000 7f135bfff640 1 -- 172.21.15.132:0/3413571384 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v44) v1 ==== 118+0+0 (secure 0 0 0) 0x7f13680370b0 con 0x7f13740c41f0 2023-12-20T04:48:06.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.136+0000 7f1379c15640 1 -- 172.21.15.132:0/3413571384 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f136006a430 msgr2=0x7f136006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:06.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.136+0000 7f1379c15640 1 --2- 172.21.15.132:0/3413571384 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f136006a430 0x7f136006c8f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f1364001eb0 tx=0x7f1364001cc0 comp rx=0 tx=0).stop 2023-12-20T04:48:06.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.136+0000 7f1379c15640 1 -- 172.21.15.132:0/3413571384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13740c41f0 msgr2=0x7f13741f1f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:06.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.136+0000 7f1379c15640 1 --2- 172.21.15.132:0/3413571384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13740c41f0 0x7f13741f1f10 secure :-1 s=READY pgs=1190 cs=0 l=1 rev1=1 crypto rx=0x7f1368000c00 tx=0x7f13680046c0 comp rx=0 tx=0).stop 2023-12-20T04:48:06.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.136+0000 7f1379c15640 1 -- 172.21.15.132:0/3413571384 shutdown_connections 2023-12-20T04:48:06.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.136+0000 7f1379c15640 1 --2- 172.21.15.132:0/3413571384 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f136006a430 0x7f136006c8f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:06.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.136+0000 7f1379c15640 1 --2- 172.21.15.132:0/3413571384 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1374143610 0x7f13740c6ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:06.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.136+0000 7f1379c15640 1 --2- 172.21.15.132:0/3413571384 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f13740cd950 0x7f13740c6580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:06.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.136+0000 7f1379c15640 1 --2- 172.21.15.132:0/3413571384 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13740c41f0 0x7f13741f1f10 unknown :-1 s=CLOSED pgs=1190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:06.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.136+0000 7f1379c15640 1 -- 172.21.15.132:0/3413571384 >> 172.21.15.132:0/3413571384 conn(0x7f137406a260 msgr2=0x7f13741428d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:06.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.136+0000 7f1379c15640 1 -- 172.21.15.132:0/3413571384 shutdown_connections 2023-12-20T04:48:06.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.136+0000 7f1379c15640 1 -- 172.21.15.132:0/3413571384 wait complete. 2023-12-20T04:48:06.149 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-20T04:48:06.149 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-20T04:48:06.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.251+0000 7f133a3fb640 1 Processor -- start 2023-12-20T04:48:06.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.251+0000 7f133a3fb640 1 -- start start 2023-12-20T04:48:06.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.252+0000 7f133a3fb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f13340cf1d0 0x7f133415e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:06.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.252+0000 7f133a3fb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f13340ce7e0 0x7f13340708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:06.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.252+0000 7f133a3fb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f133415e740 con 0x7f1334070460 2023-12-20T04:48:06.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.252+0000 7f133a3fb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1334070e30 con 0x7f13340ce7e0 2023-12-20T04:48:06.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.252+0000 7f133a3fb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f13340cb6b0 con 0x7f13340cf1d0 2023-12-20T04:48:06.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.252+0000 7f1338998640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f13340ce7e0 0x7f13340708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:06.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.252+0000 7f1338998640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f13340ce7e0 0x7f13340708f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59962/0 (socket says 172.21.15.132:59962) 2023-12-20T04:48:06.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.252+0000 7f1338998640 1 -- 172.21.15.132:0/2480813166 learned_addr learned my addr 172.21.15.132:0/2480813166 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:06.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.253+0000 7f1333fff640 1 --2- 172.21.15.132:0/2480813166 >> v2:172.21.15.187:3300/0 conn(0x7f13340cf1d0 0x7f133415e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:06.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.253+0000 7f1338998640 1 -- 172.21.15.132:0/2480813166 >> v2:172.21.15.187:3300/0 conn(0x7f13340cf1d0 msgr2=0x7f133415e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:06.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.253+0000 7f1338998640 1 --2- 172.21.15.132:0/2480813166 >> v2:172.21.15.187:3300/0 conn(0x7f13340cf1d0 0x7f133415e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:06.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.253+0000 7f1338998640 1 -- 172.21.15.132:0/2480813166 >> v1:172.21.15.187:6789/0 conn(0x7f1334070460 legacy=0x7f13340c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:06.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.253+0000 7f1338998640 1 -- 172.21.15.132:0/2480813166 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f13340cb990 con 0x7f13340ce7e0 2023-12-20T04:48:06.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.253+0000 7f1333fff640 1 --2- 172.21.15.132:0/2480813166 >> v2:172.21.15.187:3300/0 conn(0x7f13340cf1d0 0x7f133415e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:06.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.253+0000 7f1338998640 1 --2- 172.21.15.132:0/2480813166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13340ce7e0 0x7f13340708f0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f1334073ad0 tx=0x7f132c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f184d3bac8c1aeee server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:06.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.253+0000 7f1332ffd640 1 -- 172.21.15.132:0/2480813166 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c02ca80 con 0x7f13340ce7e0 2023-12-20T04:48:06.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.254+0000 7f1332ffd640 1 -- 172.21.15.132:0/2480813166 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f132c02cbe0 con 0x7f13340ce7e0 2023-12-20T04:48:06.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.254+0000 7f1332ffd640 1 -- 172.21.15.132:0/2480813166 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f132c0343f0 con 0x7f13340ce7e0 2023-12-20T04:48:06.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.254+0000 7f133a3fb640 1 -- 172.21.15.132:0/2480813166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13340ce7e0 msgr2=0x7f13340708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:06.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.254+0000 7f133a3fb640 1 --2- 172.21.15.132:0/2480813166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13340ce7e0 0x7f13340708f0 secure :-1 s=READY pgs=1191 cs=0 l=1 rev1=1 crypto rx=0x7f1334073ad0 tx=0x7f132c02bee0 comp rx=0 tx=0).stop 2023-12-20T04:48:06.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.254+0000 7f133a3fb640 1 -- 172.21.15.132:0/2480813166 shutdown_connections 2023-12-20T04:48:06.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.254+0000 7f133a3fb640 1 --2- 172.21.15.132:0/2480813166 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13340ce7e0 0x7f13340708f0 unknown :-1 s=CLOSED pgs=1191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:06.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.254+0000 7f133a3fb640 1 --2- 172.21.15.132:0/2480813166 >> v2:172.21.15.187:3300/0 conn(0x7f13340cf1d0 0x7f133415e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:06.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.254+0000 7f133a3fb640 1 -- 172.21.15.132:0/2480813166 >> 172.21.15.132:0/2480813166 conn(0x7f13340cc630 msgr2=0x7f13340cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:06.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.254+0000 7f133a3fb640 1 -- 172.21.15.132:0/2480813166 shutdown_connections 2023-12-20T04:48:06.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.254+0000 7f133a3fb640 1 -- 172.21.15.132:0/2480813166 wait complete. 2023-12-20T04:48:06.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.255+0000 7f133a3fb640 1 Processor -- start 2023-12-20T04:48:06.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.255+0000 7f133a3fb640 1 -- start start 2023-12-20T04:48:06.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.256+0000 7f133a3fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1334070460 0x7f13341eff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:06.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.256+0000 7f133a3fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13340ce7e0 0x7f1334135190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:06.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.256+0000 7f133a3fb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13340cf1d0 0x7f13340c8ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:06.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.256+0000 7f133a3fb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13341f04d0 con 0x7f13340ce7e0 2023-12-20T04:48:06.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.256+0000 7f133a3fb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f13340b5710 con 0x7f13340cf1d0 2023-12-20T04:48:06.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.256+0000 7f133a3fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f13340a8660 con 0x7f1334070460 2023-12-20T04:48:06.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.256+0000 7f13337fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13340ce7e0 0x7f1334135190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:06.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.256+0000 7f13337fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13340ce7e0 0x7f1334135190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59976/0 (socket says 172.21.15.132:59976) 2023-12-20T04:48:06.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.256+0000 7f13337fe640 1 -- 172.21.15.132:0/2244243314 learned_addr learned my addr 172.21.15.132:0/2244243314 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:06.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.256+0000 7f1338998640 1 --2- 172.21.15.132:0/2244243314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13340cf1d0 0x7f13340c8ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:06.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.256+0000 7f1333fff640 1 --2- 172.21.15.132:0/2244243314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1334070460 0x7f13341eff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:06.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.257+0000 7f13337fe640 1 -- 172.21.15.132:0/2244243314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1334070460 msgr2=0x7f13341eff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.257+0000 7f13337fe640 1 --2- 172.21.15.132:0/2244243314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1334070460 0x7f13341eff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.257+0000 7f13337fe640 1 -- 172.21.15.132:0/2244243314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13340cf1d0 msgr2=0x7f13340c8ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.257+0000 7f13337fe640 1 --2- 172.21.15.132:0/2244243314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13340cf1d0 0x7f13340c8ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.257+0000 7f13337fe640 1 -- 172.21.15.132:0/2244243314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f132c009b30 con 0x7f13340ce7e0 2023-12-20T04:48:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.257+0000 7f13337fe640 1 --2- 172.21.15.132:0/2244243314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13340ce7e0 0x7f1334135190 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f132800c430 tx=0x7f132800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.257+0000 7f1330ff9640 1 -- 172.21.15.132:0/2244243314 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1328011790 con 0x7f13340ce7e0 2023-12-20T04:48:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.257+0000 7f1330ff9640 1 -- 172.21.15.132:0/2244243314 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f13280118f0 con 0x7f13340ce7e0 2023-12-20T04:48:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.257+0000 7f133a3fb640 1 -- 172.21.15.132:0/2244243314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13340a8940 con 0x7f13340ce7e0 2023-12-20T04:48:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.257+0000 7f1330ff9640 1 -- 172.21.15.132:0/2244243314 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1328011ce0 con 0x7f13340ce7e0 2023-12-20T04:48:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.257+0000 7f133a3fb640 1 -- 172.21.15.132:0/2244243314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f13341356d0 con 0x7f13340ce7e0 2023-12-20T04:48:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.258+0000 7f133a3fb640 1 -- 172.21.15.132:0/2244243314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f13340a84c0 con 0x7f13340ce7e0 2023-12-20T04:48:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.258+0000 7f1330ff9640 1 -- 172.21.15.132:0/2244243314 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f132801c460 con 0x7f13340ce7e0 2023-12-20T04:48:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.259+0000 7f1330ff9640 1 --2- 172.21.15.132:0/2244243314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f132006a430 0x7f132006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:06.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.259+0000 7f1333fff640 1 --2- 172.21.15.132:0/2244243314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f132006a430 0x7f132006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:06.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.259+0000 7f1330ff9640 1 -- 172.21.15.132:0/2244243314 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f13280886e0 con 0x7f13340ce7e0 2023-12-20T04:48:06.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.259+0000 7f1333fff640 1 --2- 172.21.15.132:0/2244243314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f132006a430 0x7f132006c8f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f132400aac0 tx=0x7f1324008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:06.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.263+0000 7f1330ff9640 1 -- 172.21.15.132:0/2244243314 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f13340a84c0 con 0x7f13340ce7e0 2023-12-20T04:48:06.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:06.461+0000 7f133a3fb640 1 -- 172.21.15.132:0/2244243314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f13340a84c0 con 0x7f13340ce7e0 2023-12-20T04:48:07.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.142+0000 7f1330ff9640 1 -- 172.21.15.132:0/2244243314 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v45) v1 ==== 122+0+0 (secure 0 0 0) 0x7f13340a84c0 con 0x7f13340ce7e0 2023-12-20T04:48:07.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.145+0000 7f133a3fb640 1 -- 172.21.15.132:0/2244243314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f132006a430 msgr2=0x7f132006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.145+0000 7f133a3fb640 1 --2- 172.21.15.132:0/2244243314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f132006a430 0x7f132006c8f0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f132400aac0 tx=0x7f1324008040 comp rx=0 tx=0).stop 2023-12-20T04:48:07.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.145+0000 7f133a3fb640 1 -- 172.21.15.132:0/2244243314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13340ce7e0 msgr2=0x7f1334135190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.145+0000 7f133a3fb640 1 --2- 172.21.15.132:0/2244243314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13340ce7e0 0x7f1334135190 secure :-1 s=READY pgs=1192 cs=0 l=1 rev1=1 crypto rx=0x7f132800c430 tx=0x7f132800c8f0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.145+0000 7f133a3fb640 1 -- 172.21.15.132:0/2244243314 shutdown_connections 2023-12-20T04:48:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.145+0000 7f133a3fb640 1 --2- 172.21.15.132:0/2244243314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f132006a430 0x7f132006c8f0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.145+0000 7f133a3fb640 1 --2- 172.21.15.132:0/2244243314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f13340cf1d0 0x7f13340c8ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.145+0000 7f133a3fb640 1 --2- 172.21.15.132:0/2244243314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f13340ce7e0 0x7f1334135190 unknown :-1 s=CLOSED pgs=1192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.145+0000 7f133a3fb640 1 --2- 172.21.15.132:0/2244243314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1334070460 0x7f13341eff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.145+0000 7f133a3fb640 1 -- 172.21.15.132:0/2244243314 >> 172.21.15.132:0/2244243314 conn(0x7f13340cc630 msgr2=0x7f13340659c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.145+0000 7f133a3fb640 1 -- 172.21.15.132:0/2244243314 shutdown_connections 2023-12-20T04:48:07.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.145+0000 7f133a3fb640 1 -- 172.21.15.132:0/2244243314 wait complete. 2023-12-20T04:48:07.158 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-20T04:48:07.158 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:48:07.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.260+0000 7fec989fb640 1 Processor -- start 2023-12-20T04:48:07.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.260+0000 7fec989fb640 1 -- start start 2023-12-20T04:48:07.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.261+0000 7fec989fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec940b16b0 0x7fec9406c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.261+0000 7fec989fb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9415f3a0 con 0x7fec940cb180 2023-12-20T04:48:07.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.261+0000 7fec989fb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fec9415eae0 con 0x7fec9415aed0 2023-12-20T04:48:07.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.261+0000 7fec989fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec94071c90 con 0x7fec940b16b0 2023-12-20T04:48:07.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.261+0000 7fec92d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fec940cb180 0x7fec940cb5f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43794/0 (socket says 172.21.15.132:43794) 2023-12-20T04:48:07.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.261+0000 7fec92d9d640 1 -- 172.21.15.132:0/1457891348 learned_addr learned my addr 172.21.15.132:0/1457891348 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:07.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.261+0000 7fec91d9b640 1 --2- 172.21.15.132:0/1457891348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec940b16b0 0x7fec9406c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.261+0000 7fec9159a640 1 -- 172.21.15.132:0/1457891348 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60090576 0 0) 0x7fec9415f3a0 con 0x7fec940cb180 2023-12-20T04:48:07.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.261+0000 7fec9159a640 1 -- 172.21.15.132:0/1457891348 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fec7c003520 con 0x7fec940cb180 2023-12-20T04:48:07.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9159a640 1 -- 172.21.15.132:0/1457891348 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4120722199 0 0) 0x7fec7c003520 con 0x7fec940cb180 2023-12-20T04:48:07.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9159a640 1 -- 172.21.15.132:0/1457891348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec940b16b0 msgr2=0x7fec9406c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:07.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9159a640 1 --2- 172.21.15.132:0/1457891348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec940b16b0 0x7fec9406c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9159a640 1 -- 172.21.15.132:0/1457891348 >> v1:172.21.15.187:6789/0 conn(0x7fec9415aed0 legacy=0x7fec940b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9159a640 1 -- 172.21.15.132:0/1457891348 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9415ed50 con 0x7fec940cb180 2023-12-20T04:48:07.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9159a640 1 -- 172.21.15.132:0/1457891348 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fec8c001670 con 0x7fec940cb180 2023-12-20T04:48:07.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9159a640 1 -- 172.21.15.132:0/1457891348 >> v1:172.21.15.132:6789/0 conn(0x7fec940cb180 legacy=0x7fec940cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9159a640 1 --2- 172.21.15.132:0/1457891348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0039a0 0x7fec7c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9159a640 1 --2- 172.21.15.132:0/1457891348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec940b16b0 0x7fec7c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9159a640 1 --2- 172.21.15.132:0/1457891348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec7c004d00 0x7fec7c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9159a640 1 -- 172.21.15.132:0/1457891348 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec94071c90 con 0x7fec7c0039a0 2023-12-20T04:48:07.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9159a640 1 -- 172.21.15.132:0/1457891348 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c00ba60 con 0x7fec7c004d00 2023-12-20T04:48:07.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9159a640 1 -- 172.21.15.132:0/1457891348 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec7c00bc20 con 0x7fec940b16b0 2023-12-20T04:48:07.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9259c640 1 --2- 172.21.15.132:0/1457891348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0039a0 0x7fec7c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec91d9b640 1 --2- 172.21.15.132:0/1457891348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec940b16b0 0x7fec7c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec92d9d640 1 --2- 172.21.15.132:0/1457891348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec7c004d00 0x7fec7c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9259c640 1 -- 172.21.15.132:0/1457891348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec940b16b0 msgr2=0x7fec7c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:07.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9259c640 1 --2- 172.21.15.132:0/1457891348 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec940b16b0 0x7fec7c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9259c640 1 -- 172.21.15.132:0/1457891348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec7c004d00 msgr2=0x7fec7c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:07.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9259c640 1 --2- 172.21.15.132:0/1457891348 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec7c004d00 0x7fec7c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.262+0000 7fec9259c640 1 -- 172.21.15.132:0/1457891348 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec7c003520 con 0x7fec7c0039a0 2023-12-20T04:48:07.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.263+0000 7fec9259c640 1 --2- 172.21.15.132:0/1457891348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0039a0 0x7fec7c003dc0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fec84001e20 tx=0x7fec7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1943826dd942595d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:07.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.263+0000 7fec9159a640 1 -- 172.21.15.132:0/1457891348 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec84003b70 con 0x7fec7c0039a0 2023-12-20T04:48:07.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.263+0000 7fec9159a640 1 -- 172.21.15.132:0/1457891348 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec84003cd0 con 0x7fec7c0039a0 2023-12-20T04:48:07.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.263+0000 7fec9159a640 1 -- 172.21.15.132:0/1457891348 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec84005310 con 0x7fec7c0039a0 2023-12-20T04:48:07.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.263+0000 7fec989fb640 1 -- 172.21.15.132:0/1457891348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0039a0 msgr2=0x7fec7c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.263+0000 7fec989fb640 1 --2- 172.21.15.132:0/1457891348 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0039a0 0x7fec7c003dc0 secure :-1 s=READY pgs=1194 cs=0 l=1 rev1=1 crypto rx=0x7fec84001e20 tx=0x7fec7c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.263+0000 7fec92d9d640 1 -- 172.21.15.132:0/1457891348 reap_dead start 2023-12-20T04:48:07.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.264+0000 7fec989fb640 1 -- 172.21.15.132:0/1457891348 shutdown_connections 2023-12-20T04:48:07.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.264+0000 7fec989fb640 1 -- 172.21.15.132:0/1457891348 >> 172.21.15.132:0/1457891348 conn(0x7fec9406a050 msgr2=0x7fec9406a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:07.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.264+0000 7fec989fb640 1 -- 172.21.15.132:0/1457891348 shutdown_connections 2023-12-20T04:48:07.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.264+0000 7fec989fb640 1 -- 172.21.15.132:0/1457891348 wait complete. 2023-12-20T04:48:07.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.265+0000 7fec989fb640 1 Processor -- start 2023-12-20T04:48:07.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.265+0000 7fec989fb640 1 -- start start 2023-12-20T04:48:07.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec989fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0039a0 0x7fec940ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec989fb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec94153c80 0x7fec9414b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec989fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec94156180 0x7fec94156600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec989fb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec940ceaf0 con 0x7fec7c0039a0 2023-12-20T04:48:07.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec989fb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec94153b00 con 0x7fec94153c80 2023-12-20T04:48:07.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec989fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fec94154610 con 0x7fec94156180 2023-12-20T04:48:07.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec9259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0039a0 0x7fec940ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec9259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0039a0 0x7fec940ce5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59996/0 (socket says 172.21.15.132:59996) 2023-12-20T04:48:07.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec9259c640 1 -- 172.21.15.132:0/2136938071 learned_addr learned my addr 172.21.15.132:0/2136938071 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec92d9d640 1 --2- 172.21.15.132:0/2136938071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec94156180 0x7fec94156600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec91d9b640 1 --2- 172.21.15.132:0/2136938071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec94153c80 0x7fec9414b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec9259c640 1 -- 172.21.15.132:0/2136938071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec94156180 msgr2=0x7fec94156600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec9259c640 1 --2- 172.21.15.132:0/2136938071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec94156180 0x7fec94156600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec9259c640 1 -- 172.21.15.132:0/2136938071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec94153c80 msgr2=0x7fec9414b220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec9259c640 1 --2- 172.21.15.132:0/2136938071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec94153c80 0x7fec9414b220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec9259c640 1 -- 172.21.15.132:0/2136938071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec9415c7b0 con 0x7fec7c0039a0 2023-12-20T04:48:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec92d9d640 1 --2- 172.21.15.132:0/2136938071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec94156180 0x7fec94156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec9259c640 1 --2- 172.21.15.132:0/2136938071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0039a0 0x7fec940ce5b0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fec84001f40 tx=0x7fec840014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec82ffd640 1 -- 172.21.15.132:0/2136938071 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec8403e070 con 0x7fec7c0039a0 2023-12-20T04:48:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec82ffd640 1 -- 172.21.15.132:0/2136938071 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fec84006b50 con 0x7fec7c0039a0 2023-12-20T04:48:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec989fb640 1 -- 172.21.15.132:0/2136938071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec9415c480 con 0x7fec7c0039a0 2023-12-20T04:48:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec82ffd640 1 -- 172.21.15.132:0/2136938071 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fec84007030 con 0x7fec7c0039a0 2023-12-20T04:48:07.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.266+0000 7fec989fb640 1 -- 172.21.15.132:0/2136938071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec94154b40 con 0x7fec7c0039a0 2023-12-20T04:48:07.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.268+0000 7fec989fb640 1 -- 172.21.15.132:0/2136938071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec94066820 con 0x7fec7c0039a0 2023-12-20T04:48:07.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.268+0000 7fec82ffd640 1 -- 172.21.15.132:0/2136938071 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fec84007190 con 0x7fec7c0039a0 2023-12-20T04:48:07.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.268+0000 7fec82ffd640 1 --2- 172.21.15.132:0/2136938071 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fec7406a430 0x7fec7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.268+0000 7fec82ffd640 1 -- 172.21.15.132:0/2136938071 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fec840aa350 con 0x7fec7c0039a0 2023-12-20T04:48:07.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.268+0000 7fec91d9b640 1 --2- 172.21.15.132:0/2136938071 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fec7406a430 0x7fec7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.269+0000 7fec91d9b640 1 --2- 172.21.15.132:0/2136938071 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fec7406a430 0x7fec7406c8f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fec9415e5d0 tx=0x7fec88008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:07.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.273+0000 7fec82ffd640 1 -- 172.21.15.132:0/2136938071 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fec840759d0 con 0x7fec7c0039a0 2023-12-20T04:48:07.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.471+0000 7fec989fb640 1 -- 172.21.15.132:0/2136938071 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fec940caff0 con 0x7fec7c0039a0 2023-12-20T04:48:07.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.471+0000 7fec82ffd640 1 -- 172.21.15.132:0/2136938071 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4723 (secure 0 0 0) 0x7fec84078ff0 con 0x7fec7c0039a0 2023-12-20T04:48:07.472 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:07.472 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":45,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3951194420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3951194420},{"type":"v1","addr":"172.21.15.187:6833","nonce":3951194420}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1575999914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1575999914},{"type":"v1","addr":"172.21.15.187:6835","nonce":1575999914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2208233017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2208233017},{"type":"v1","addr":"172.21.15.132:6836","nonce":2208233017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:48:04.456610+0000","modified":"2023-12-20T04:48:07.132847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7422":{"gid":7422,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/3935356761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":3935356761},{"type":"v1","addr":"172.21.15.132:6837","nonce":3935356761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-20T04:48:07.473 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 45 2023-12-20T04:48:07.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.473+0000 7fec989fb640 1 -- 172.21.15.132:0/2136938071 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fec7406a430 msgr2=0x7fec7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.473+0000 7fec989fb640 1 --2- 172.21.15.132:0/2136938071 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fec7406a430 0x7fec7406c8f0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fec9415e5d0 tx=0x7fec88008040 comp rx=0 tx=0).stop 2023-12-20T04:48:07.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.473+0000 7fec989fb640 1 -- 172.21.15.132:0/2136938071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0039a0 msgr2=0x7fec940ce5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.473+0000 7fec989fb640 1 --2- 172.21.15.132:0/2136938071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0039a0 0x7fec940ce5b0 secure :-1 s=READY pgs=1195 cs=0 l=1 rev1=1 crypto rx=0x7fec84001f40 tx=0x7fec840014a0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.473+0000 7fec989fb640 1 -- 172.21.15.132:0/2136938071 shutdown_connections 2023-12-20T04:48:07.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.473+0000 7fec989fb640 1 --2- 172.21.15.132:0/2136938071 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fec7406a430 0x7fec7406c8f0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.473+0000 7fec989fb640 1 --2- 172.21.15.132:0/2136938071 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fec94156180 0x7fec94156600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.473+0000 7fec989fb640 1 --2- 172.21.15.132:0/2136938071 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fec94153c80 0x7fec9414b220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.473+0000 7fec989fb640 1 --2- 172.21.15.132:0/2136938071 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fec7c0039a0 0x7fec940ce5b0 unknown :-1 s=CLOSED pgs=1195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.473+0000 7fec989fb640 1 -- 172.21.15.132:0/2136938071 >> 172.21.15.132:0/2136938071 conn(0x7fec9406a050 msgr2=0x7fec9406a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:07.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.473+0000 7fec989fb640 1 -- 172.21.15.132:0/2136938071 shutdown_connections 2023-12-20T04:48:07.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.473+0000 7fec989fb640 1 -- 172.21.15.132:0/2136938071 wait complete. 2023-12-20T04:48:07.485 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:48:07.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.584+0000 7fdd9ce0b640 1 Processor -- start 2023-12-20T04:48:07.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.584+0000 7fdd9ce0b640 1 -- start start 2023-12-20T04:48:07.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.585+0000 7fdd9ce0b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd980cdc10 0x7fdd9806c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.585+0000 7fdd9ce0b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd981613c0 con 0x7fdd9815d100 2023-12-20T04:48:07.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.585+0000 7fdd9ce0b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdd980d1b00 con 0x7fdd980d0370 2023-12-20T04:48:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.585+0000 7fdd9ce0b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9806cde0 con 0x7fdd980cdc10 2023-12-20T04:48:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.585+0000 7fdd9659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdd9815d100 0x7fdd980cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48514/0 (socket says 172.21.15.132:48514) 2023-12-20T04:48:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.585+0000 7fdd9659c640 1 -- 172.21.15.132:0/97864483 learned_addr learned my addr 172.21.15.132:0/97864483 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.585+0000 7fdd9559a640 1 -- 172.21.15.132:0/97864483 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3376295912 0 0) 0x7fdd981613c0 con 0x7fdd9815d100 2023-12-20T04:48:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.585+0000 7fdd96d9d640 1 --2- 172.21.15.132:0/97864483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd980cdc10 0x7fdd9806c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.585+0000 7fdd9559a640 1 -- 172.21.15.132:0/97864483 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdd80003520 con 0x7fdd9815d100 2023-12-20T04:48:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.585+0000 7fdd9559a640 1 -- 172.21.15.132:0/97864483 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2949771871 0 0) 0x7fdd80003520 con 0x7fdd9815d100 2023-12-20T04:48:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.585+0000 7fdd9559a640 1 -- 172.21.15.132:0/97864483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd980cdc10 msgr2=0x7fdd9806c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.585+0000 7fdd9559a640 1 --2- 172.21.15.132:0/97864483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd980cdc10 0x7fdd9806c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.585+0000 7fdd9559a640 1 -- 172.21.15.132:0/97864483 >> v1:172.21.15.187:6789/0 conn(0x7fdd980d0370 legacy=0x7fdd9806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.585+0000 7fdd9559a640 1 -- 172.21.15.132:0/97864483 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd980d0810 con 0x7fdd9815d100 2023-12-20T04:48:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.585+0000 7fdd9559a640 1 -- 172.21.15.132:0/97864483 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fdd88001670 con 0x7fdd9815d100 2023-12-20T04:48:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.585+0000 7fdd9559a640 1 -- 172.21.15.132:0/97864483 >> v1:172.21.15.132:6789/0 conn(0x7fdd9815d100 legacy=0x7fdd980cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.586+0000 7fdd9559a640 1 --2- 172.21.15.132:0/97864483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd980cdc10 0x7fdd800039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.586+0000 7fdd9559a640 1 --2- 172.21.15.132:0/97864483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd80003f20 0x7fdd800047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.586+0000 7fdd9559a640 1 --2- 172.21.15.132:0/97864483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd80004d00 0x7fdd80005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.586+0000 7fdd9559a640 1 -- 172.21.15.132:0/97864483 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9806cde0 con 0x7fdd80003f20 2023-12-20T04:48:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.586+0000 7fdd9559a640 1 -- 172.21.15.132:0/97864483 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8000ba60 con 0x7fdd80004d00 2023-12-20T04:48:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.586+0000 7fdd9559a640 1 -- 172.21.15.132:0/97864483 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd8000bc20 con 0x7fdd980cdc10 2023-12-20T04:48:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.586+0000 7fdd95d9b640 1 --2- 172.21.15.132:0/97864483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd80003f20 0x7fdd800047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.586+0000 7fdd9659c640 1 --2- 172.21.15.132:0/97864483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd980cdc10 0x7fdd800039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.586+0000 7fdd96d9d640 1 --2- 172.21.15.132:0/97864483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd80004d00 0x7fdd80005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.586+0000 7fdd95d9b640 1 -- 172.21.15.132:0/97864483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd980cdc10 msgr2=0x7fdd800039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.586+0000 7fdd95d9b640 1 --2- 172.21.15.132:0/97864483 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd980cdc10 0x7fdd800039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.586+0000 7fdd95d9b640 1 -- 172.21.15.132:0/97864483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd80004d00 msgr2=0x7fdd80005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.586+0000 7fdd95d9b640 1 --2- 172.21.15.132:0/97864483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd80004d00 0x7fdd80005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.586+0000 7fdd95d9b640 1 -- 172.21.15.132:0/97864483 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd80003520 con 0x7fdd80003f20 2023-12-20T04:48:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.586+0000 7fdd96d9d640 1 --2- 172.21.15.132:0/97864483 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd80004d00 0x7fdd80005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.587+0000 7fdd95d9b640 1 --2- 172.21.15.132:0/97864483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd80003f20 0x7fdd800047c0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c001750 tx=0x7fdd800057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86be36b548fcc513 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:07.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.587+0000 7fdd9559a640 1 -- 172.21.15.132:0/97864483 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0052d0 con 0x7fdd80003f20 2023-12-20T04:48:07.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.587+0000 7fdd9559a640 1 -- 172.21.15.132:0/97864483 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c02e050 con 0x7fdd80003f20 2023-12-20T04:48:07.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.587+0000 7fdd9559a640 1 -- 172.21.15.132:0/97864483 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c003830 con 0x7fdd80003f20 2023-12-20T04:48:07.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.587+0000 7fdd9ce0b640 1 -- 172.21.15.132:0/97864483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd80003f20 msgr2=0x7fdd800047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.587+0000 7fdd9ce0b640 1 --2- 172.21.15.132:0/97864483 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd80003f20 0x7fdd800047c0 secure :-1 s=READY pgs=1197 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c001750 tx=0x7fdd800057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.587+0000 7fdd96d9d640 1 -- 172.21.15.132:0/97864483 reap_dead start 2023-12-20T04:48:07.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.587+0000 7fdd9ce0b640 1 -- 172.21.15.132:0/97864483 shutdown_connections 2023-12-20T04:48:07.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.587+0000 7fdd9ce0b640 1 -- 172.21.15.132:0/97864483 >> 172.21.15.132:0/97864483 conn(0x7fdd9806d7c0 msgr2=0x7fdd9806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:07.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.587+0000 7fdd9ce0b640 1 -- 172.21.15.132:0/97864483 shutdown_connections 2023-12-20T04:48:07.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.587+0000 7fdd9ce0b640 1 -- 172.21.15.132:0/97864483 wait complete. 2023-12-20T04:48:07.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.589+0000 7fdd9ce0b640 1 Processor -- start 2023-12-20T04:48:07.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.589+0000 7fdd9ce0b640 1 -- start start 2023-12-20T04:48:07.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.589+0000 7fdd9ce0b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd80003f20 0x7fdd981601c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.589+0000 7fdd9ce0b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd980b6880 0x7fdd9814bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.589+0000 7fdd9ce0b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd9814ef70 0x7fdd980b0fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.589+0000 7fdd9ce0b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd981f30c0 con 0x7fdd980b6880 2023-12-20T04:48:07.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.589+0000 7fdd9ce0b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9815f120 con 0x7fdd80003f20 2023-12-20T04:48:07.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.589+0000 7fdd9ce0b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd9815f400 con 0x7fdd9814ef70 2023-12-20T04:48:07.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.590+0000 7fdd95d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd980b6880 0x7fdd9814bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.590+0000 7fdd95d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd980b6880 0x7fdd9814bdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44602/0 (socket says 172.21.15.132:44602) 2023-12-20T04:48:07.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.590+0000 7fdd95d9b640 1 -- 172.21.15.132:0/3645256237 learned_addr learned my addr 172.21.15.132:0/3645256237 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:07.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.590+0000 7fdd96d9d640 1 --2- 172.21.15.132:0/3645256237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd9814ef70 0x7fdd980b0fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.590+0000 7fdd9659c640 1 --2- 172.21.15.132:0/3645256237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd80003f20 0x7fdd981601c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.590+0000 7fdd95d9b640 1 -- 172.21.15.132:0/3645256237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd9814ef70 msgr2=0x7fdd980b0fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.590+0000 7fdd95d9b640 1 --2- 172.21.15.132:0/3645256237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd9814ef70 0x7fdd980b0fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.590+0000 7fdd95d9b640 1 -- 172.21.15.132:0/3645256237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd80003f20 msgr2=0x7fdd981601c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.590+0000 7fdd95d9b640 1 --2- 172.21.15.132:0/3645256237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd80003f20 0x7fdd981601c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.590+0000 7fdd95d9b640 1 -- 172.21.15.132:0/3645256237 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd9815f6e0 con 0x7fdd980b6880 2023-12-20T04:48:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.590+0000 7fdd96d9d640 1 --2- 172.21.15.132:0/3645256237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd9814ef70 0x7fdd980b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.590+0000 7fdd95d9b640 1 --2- 172.21.15.132:0/3645256237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd980b6880 0x7fdd9814bdd0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c008fd0 tx=0x7fdd8c001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.590+0000 7fdd86ffd640 1 -- 172.21.15.132:0/3645256237 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c0076c0 con 0x7fdd980b6880 2023-12-20T04:48:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.590+0000 7fdd86ffd640 1 -- 172.21.15.132:0/3645256237 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd8c007a30 con 0x7fdd980b6880 2023-12-20T04:48:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.590+0000 7fdd9ce0b640 1 -- 172.21.15.132:0/3645256237 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd9815f9c0 con 0x7fdd980b6880 2023-12-20T04:48:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.590+0000 7fdd86ffd640 1 -- 172.21.15.132:0/3645256237 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd8c006be0 con 0x7fdd980b6880 2023-12-20T04:48:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.590+0000 7fdd9ce0b640 1 -- 172.21.15.132:0/3645256237 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd9815edd0 con 0x7fdd980b6880 2023-12-20T04:48:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.591+0000 7fdd9ce0b640 1 -- 172.21.15.132:0/3645256237 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd981f30a0 con 0x7fdd980b6880 2023-12-20T04:48:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.592+0000 7fdd86ffd640 1 -- 172.21.15.132:0/3645256237 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdd8c006d40 con 0x7fdd980b6880 2023-12-20T04:48:07.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.592+0000 7fdd86ffd640 1 --2- 172.21.15.132:0/3645256237 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd7806a430 0x7fdd7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.592+0000 7fdd86ffd640 1 -- 172.21.15.132:0/3645256237 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd8c0aaa00 con 0x7fdd980b6880 2023-12-20T04:48:07.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.592+0000 7fdd9659c640 1 --2- 172.21.15.132:0/3645256237 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd7806a430 0x7fdd7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.592+0000 7fdd9659c640 1 --2- 172.21.15.132:0/3645256237 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd7806a430 0x7fdd7806c8f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fdd88007d20 tx=0x7fdd88009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:07.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.596+0000 7fdd86ffd640 1 -- 172.21.15.132:0/3645256237 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdd981f30a0 con 0x7fdd980b6880 2023-12-20T04:48:07.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.762+0000 7fdd9ce0b640 1 -- 172.21.15.132:0/3645256237 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fdd9815f540 con 0x7fdd980b6880 2023-12-20T04:48:07.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.763+0000 7fdd86ffd640 1 -- 172.21.15.132:0/3645256237 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v122) v1 ==== 74+0+16100 (secure 0 0 0) 0x7fdd9815f540 con 0x7fdd980b6880 2023-12-20T04:48:07.764 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:07.764 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":122,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:48:05.458172+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:48:02.660300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-20T04:48:03.433311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"122","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:48:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.765+0000 7fdd9ce0b640 1 -- 172.21.15.132:0/3645256237 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd7806a430 msgr2=0x7fdd7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.765+0000 7fdd9ce0b640 1 --2- 172.21.15.132:0/3645256237 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd7806a430 0x7fdd7806c8f0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fdd88007d20 tx=0x7fdd88009040 comp rx=0 tx=0).stop 2023-12-20T04:48:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.765+0000 7fdd9ce0b640 1 -- 172.21.15.132:0/3645256237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd980b6880 msgr2=0x7fdd9814bdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.765+0000 7fdd9ce0b640 1 --2- 172.21.15.132:0/3645256237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd980b6880 0x7fdd9814bdd0 secure :-1 s=READY pgs=1198 cs=0 l=1 rev1=1 crypto rx=0x7fdd8c008fd0 tx=0x7fdd8c001120 comp rx=0 tx=0).stop 2023-12-20T04:48:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.765+0000 7fdd9ce0b640 1 -- 172.21.15.132:0/3645256237 shutdown_connections 2023-12-20T04:48:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.765+0000 7fdd9ce0b640 1 --2- 172.21.15.132:0/3645256237 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd7806a430 0x7fdd7806c8f0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.765+0000 7fdd9ce0b640 1 --2- 172.21.15.132:0/3645256237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd9814ef70 0x7fdd980b0fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.765+0000 7fdd9ce0b640 1 --2- 172.21.15.132:0/3645256237 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd980b6880 0x7fdd9814bdd0 unknown :-1 s=CLOSED pgs=1198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.765+0000 7fdd9ce0b640 1 --2- 172.21.15.132:0/3645256237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd80003f20 0x7fdd981601c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.765+0000 7fdd9ce0b640 1 -- 172.21.15.132:0/3645256237 >> 172.21.15.132:0/3645256237 conn(0x7fdd9806d7c0 msgr2=0x7fdd980b21b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.765+0000 7fdd9ce0b640 1 -- 172.21.15.132:0/3645256237 shutdown_connections 2023-12-20T04:48:07.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.765+0000 7fdd9ce0b640 1 -- 172.21.15.132:0/3645256237 wait complete. 2023-12-20T04:48:07.778 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-20T04:48:07.778 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:48:07.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.876+0000 7f7f0f651640 1 Processor -- start 2023-12-20T04:48:07.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.877+0000 7f7f0f651640 1 -- start start 2023-12-20T04:48:07.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.877+0000 7f7f0f651640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f0815e2d0 0x7f7f080b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.877+0000 7f7f0f651640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7f080cb420 0x7f7f080ce9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.877+0000 7f7f0f651640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f080cd740 con 0x7f7f080ceee0 2023-12-20T04:48:07.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.877+0000 7f7f0f651640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f080ce230 con 0x7f7f080cb420 2023-12-20T04:48:07.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.877+0000 7f7f0f651640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f080cf310 con 0x7f7f0815e2d0 2023-12-20T04:48:07.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.878+0000 7f7f0cbec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7f080cb420 0x7f7f080ce9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.878+0000 7f7f0cbec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7f080cb420 0x7f7f080ce9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44606/0 (socket says 172.21.15.132:44606) 2023-12-20T04:48:07.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.878+0000 7f7f0dbee640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7f080ceee0 0x7f7f0815ea00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48526/0 (socket says 172.21.15.132:48526) 2023-12-20T04:48:07.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.878+0000 7f7f0cbec640 1 -- 172.21.15.132:0/3475811221 learned_addr learned my addr 172.21.15.132:0/3475811221 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:07.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.878+0000 7f7f0d3ed640 1 --2- 172.21.15.132:0/3475811221 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f0815e2d0 0x7f7f080b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.878+0000 7f7f0cbec640 1 -- 172.21.15.132:0/3475811221 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f0815e2d0 msgr2=0x7f7f080b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:07.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.878+0000 7f7f0cbec640 1 --2- 172.21.15.132:0/3475811221 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f0815e2d0 0x7f7f080b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.878+0000 7f7f0cbec640 1 -- 172.21.15.132:0/3475811221 >> v1:172.21.15.132:6789/0 conn(0x7f7f080ceee0 legacy=0x7f7f0815ea00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.878+0000 7f7efffff640 1 -- 172.21.15.132:0/3475811221 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2183353777 0 0) 0x7f7f080cd740 con 0x7f7f080ceee0 2023-12-20T04:48:07.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.878+0000 7f7f0cbec640 1 -- 172.21.15.132:0/3475811221 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f080cd990 con 0x7f7f080cb420 2023-12-20T04:48:07.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.879+0000 7f7f0cbec640 1 --2- 172.21.15.132:0/3475811221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080cb420 0x7f7f080ce9a0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009870 tx=0x7f7ef802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a4cbe4dff919b3c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:07.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.879+0000 7f7efffff640 1 -- 172.21.15.132:0/3475811221 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8031640 con 0x7f7f080cb420 2023-12-20T04:48:07.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.879+0000 7f7efffff640 1 -- 172.21.15.132:0/3475811221 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef80317a0 con 0x7f7f080cb420 2023-12-20T04:48:07.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.879+0000 7f7efffff640 1 -- 172.21.15.132:0/3475811221 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8031b30 con 0x7f7f080cb420 2023-12-20T04:48:07.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.879+0000 7f7f0f651640 1 -- 172.21.15.132:0/3475811221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080cb420 msgr2=0x7f7f080ce9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.879+0000 7f7f0f651640 1 --2- 172.21.15.132:0/3475811221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080cb420 0x7f7f080ce9a0 secure :-1 s=READY pgs=1200 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8009870 tx=0x7f7ef802b8f0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.879+0000 7f7f0f651640 1 -- 172.21.15.132:0/3475811221 shutdown_connections 2023-12-20T04:48:07.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.879+0000 7f7f0f651640 1 --2- 172.21.15.132:0/3475811221 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080cb420 0x7f7f080ce9a0 unknown :-1 s=CLOSED pgs=1200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.879+0000 7f7f0f651640 1 --2- 172.21.15.132:0/3475811221 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f0815e2d0 0x7f7f080b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.879+0000 7f7f0f651640 1 -- 172.21.15.132:0/3475811221 >> 172.21.15.132:0/3475811221 conn(0x7f7f0806d7c0 msgr2=0x7f7f0806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:07.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.879+0000 7f7f0f651640 1 -- 172.21.15.132:0/3475811221 shutdown_connections 2023-12-20T04:48:07.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.879+0000 7f7f0f651640 1 -- 172.21.15.132:0/3475811221 wait complete. 2023-12-20T04:48:07.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.881+0000 7f7f0f651640 1 Processor -- start 2023-12-20T04:48:07.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.881+0000 7f7f0f651640 1 -- start start 2023-12-20T04:48:07.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.881+0000 7f7f0f651640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f080cb420 0x7f7f080b4d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.881+0000 7f7f0f651640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080ceee0 0x7f7f080b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.881+0000 7f7f0f651640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f0815e2d0 0x7f7f081f2e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.881+0000 7f7f0f651640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f080c4700 con 0x7f7f080ceee0 2023-12-20T04:48:07.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.881+0000 7f7f0f651640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f080addd0 con 0x7f7f0815e2d0 2023-12-20T04:48:07.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.881+0000 7f7f0f651640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f080c8210 con 0x7f7f080cb420 2023-12-20T04:48:07.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.881+0000 7f7f0cbec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080ceee0 0x7f7f080b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.881+0000 7f7f0cbec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080ceee0 0x7f7f080b5260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44610/0 (socket says 172.21.15.132:44610) 2023-12-20T04:48:07.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.881+0000 7f7f0cbec640 1 -- 172.21.15.132:0/1256668638 learned_addr learned my addr 172.21.15.132:0/1256668638 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:07.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.881+0000 7f7f0d3ed640 1 --2- 172.21.15.132:0/1256668638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f080cb420 0x7f7f080b4d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.882+0000 7f7f0dbee640 1 --2- 172.21.15.132:0/1256668638 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f0815e2d0 0x7f7f081f2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.882+0000 7f7f0cbec640 1 -- 172.21.15.132:0/1256668638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f080cb420 msgr2=0x7f7f080b4d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.882+0000 7f7f0cbec640 1 --2- 172.21.15.132:0/1256668638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f080cb420 0x7f7f080b4d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.882+0000 7f7f0cbec640 1 -- 172.21.15.132:0/1256668638 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f0815e2d0 msgr2=0x7f7f081f2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:07.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.882+0000 7f7f0cbec640 1 --2- 172.21.15.132:0/1256668638 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f0815e2d0 0x7f7f081f2e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:07.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.882+0000 7f7f0cbec640 1 -- 172.21.15.132:0/1256668638 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ef80094d0 con 0x7f7f080ceee0 2023-12-20T04:48:07.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.882+0000 7f7f0d3ed640 1 --2- 172.21.15.132:0/1256668638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f080cb420 0x7f7f080b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:07.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.882+0000 7f7f0dbee640 1 --2- 172.21.15.132:0/1256668638 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f0815e2d0 0x7f7f081f2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:07.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.882+0000 7f7f0cbec640 1 --2- 172.21.15.132:0/1256668638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080ceee0 0x7f7f080b5260 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8034040 tx=0x7f7ef80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:07.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.882+0000 7f7efdffb640 1 -- 172.21.15.132:0/1256668638 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8004230 con 0x7f7f080ceee0 2023-12-20T04:48:07.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.882+0000 7f7efdffb640 1 -- 172.21.15.132:0/1256668638 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7ef80043b0 con 0x7f7f080ceee0 2023-12-20T04:48:07.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.882+0000 7f7f0f651640 1 -- 172.21.15.132:0/1256668638 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f080c84f0 con 0x7f7f080ceee0 2023-12-20T04:48:07.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.882+0000 7f7efdffb640 1 -- 172.21.15.132:0/1256668638 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7ef8004520 con 0x7f7f080ceee0 2023-12-20T04:48:07.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.882+0000 7f7f0f651640 1 -- 172.21.15.132:0/1256668638 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f080c8ab0 con 0x7f7f080ceee0 2023-12-20T04:48:07.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.883+0000 7f7f0f651640 1 -- 172.21.15.132:0/1256668638 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0804e840 con 0x7f7f080ceee0 2023-12-20T04:48:07.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.884+0000 7f7efdffb640 1 -- 172.21.15.132:0/1256668638 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7ef8042070 con 0x7f7f080ceee0 2023-12-20T04:48:07.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.884+0000 7f7efdffb640 1 --2- 172.21.15.132:0/1256668638 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7eec06a430 0x7f7eec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:07.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.884+0000 7f7efdffb640 1 -- 172.21.15.132:0/1256668638 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7ef80aa6c0 con 0x7f7f080ceee0 2023-12-20T04:48:07.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.884+0000 7f7f0d3ed640 1 --2- 172.21.15.132:0/1256668638 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7eec06a430 0x7f7eec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:07.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.884+0000 7f7f0d3ed640 1 --2- 172.21.15.132:0/1256668638 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7eec06a430 0x7f7eec06c8f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7f040074c0 tx=0x7f7f0400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:07.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:07.888+0000 7f7efdffb640 1 -- 172.21.15.132:0/1256668638 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7ef8075d40 con 0x7f7f080ceee0 2023-12-20T04:48:08.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.055+0000 7f7f0f651640 1 -- 172.21.15.132:0/1256668638 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7f080cdf50 con 0x7f7eec06a430 2023-12-20T04:48:08.063 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.063+0000 7f7efdffb640 1 -- 172.21.15.132:0/1256668638 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285691 (secure 0 0 0) 0x7f7f0400f050 con 0x7f7eec06a430 2023-12-20T04:48:08.070 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:08.072 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:48:08.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.066+0000 7f7f0f651640 1 -- 172.21.15.132:0/1256668638 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7eec06a430 msgr2=0x7f7eec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.066+0000 7f7f0f651640 1 --2- 172.21.15.132:0/1256668638 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7eec06a430 0x7f7eec06c8f0 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f7f040074c0 tx=0x7f7f0400b040 comp rx=0 tx=0).stop 2023-12-20T04:48:08.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.066+0000 7f7f0f651640 1 -- 172.21.15.132:0/1256668638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080ceee0 msgr2=0x7f7f080b5260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.066+0000 7f7f0f651640 1 --2- 172.21.15.132:0/1256668638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080ceee0 0x7f7f080b5260 secure :-1 s=READY pgs=1201 cs=0 l=1 rev1=1 crypto rx=0x7f7ef8034040 tx=0x7f7ef80046c0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.066+0000 7f7f0f651640 1 -- 172.21.15.132:0/1256668638 shutdown_connections 2023-12-20T04:48:08.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.066+0000 7f7f0f651640 1 --2- 172.21.15.132:0/1256668638 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7eec06a430 0x7f7eec06c8f0 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.066+0000 7f7f0f651640 1 --2- 172.21.15.132:0/1256668638 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f0815e2d0 0x7f7f081f2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.066+0000 7f7f0f651640 1 --2- 172.21.15.132:0/1256668638 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080ceee0 0x7f7f080b5260 unknown :-1 s=CLOSED pgs=1201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.066+0000 7f7f0f651640 1 --2- 172.21.15.132:0/1256668638 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f080cb420 0x7f7f080b4d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.066+0000 7f7f0f651640 1 -- 172.21.15.132:0/1256668638 >> 172.21.15.132:0/1256668638 conn(0x7f7f0806d7c0 msgr2=0x7f7f080d06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:08.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.066+0000 7f7f0f651640 1 -- 172.21.15.132:0/1256668638 shutdown_connections 2023-12-20T04:48:08.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.066+0000 7f7f0f651640 1 -- 172.21.15.132:0/1256668638 wait complete. 2023-12-20T04:48:08.078 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2023-12-20T04:48:06.160436+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6376,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556123,"statfs":{"total":1600000000,"available":1593470432,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000587"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972605+0000","last_change":"2023-12-20T04:48:04.470193+0000","last_active":"2023-12-20T04:48:05.972605+0000","last_peered":"2023-12-20T04:48:05.972605+0000","last_clean":"2023-12-20T04:48:05.972605+0000","last_became_active":"2023-12-20T04:48:04.469960+0000","last_became_peered":"2023-12-20T04:48:04.469960+0000","last_unstale":"2023-12-20T04:48:05.972605+0000","last_undegraded":"2023-12-20T04:48:05.972605+0000","last_fullsized":"2023-12-20T04:48:05.972605+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:41:42.038791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462345+0000","last_change":"2023-12-20T04:48:04.469975+0000","last_active":"2023-12-20T04:48:05.462345+0000","last_peered":"2023-12-20T04:48:05.462345+0000","last_clean":"2023-12-20T04:48:05.462345+0000","last_became_active":"2023-12-20T04:48:04.469558+0000","last_became_peered":"2023-12-20T04:48:04.469558+0000","last_unstale":"2023-12-20T04:48:05.462345+0000","last_undegraded":"2023-12-20T04:48:05.462345+0000","last_fullsized":"2023-12-20T04:48:05.462345+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:05.002903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972561+0000","last_change":"2023-12-20T04:48:04.471311+0000","last_active":"2023-12-20T04:48:05.972561+0000","last_peered":"2023-12-20T04:48:05.972561+0000","last_clean":"2023-12-20T04:48:05.972561+0000","last_became_active":"2023-12-20T04:48:04.471102+0000","last_became_peered":"2023-12-20T04:48:04.471102+0000","last_unstale":"2023-12-20T04:48:05.972561+0000","last_undegraded":"2023-12-20T04:48:05.972561+0000","last_fullsized":"2023-12-20T04:48:05.972561+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:23:45.943142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723109+0000","last_change":"2023-12-20T04:48:04.472555+0000","last_active":"2023-12-20T04:48:05.723109+0000","last_peered":"2023-12-20T04:48:05.723109+0000","last_clean":"2023-12-20T04:48:05.723109+0000","last_became_active":"2023-12-20T04:48:04.472353+0000","last_became_peered":"2023-12-20T04:48:04.472353+0000","last_unstale":"2023-12-20T04:48:05.723109+0000","last_undegraded":"2023-12-20T04:48:05.723109+0000","last_fullsized":"2023-12-20T04:48:05.723109+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:29:37.812575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614602+0000","last_change":"2023-12-20T04:48:04.469675+0000","last_active":"2023-12-20T04:48:05.614602+0000","last_peered":"2023-12-20T04:48:05.614602+0000","last_clean":"2023-12-20T04:48:05.614602+0000","last_became_active":"2023-12-20T04:48:04.469436+0000","last_became_peered":"2023-12-20T04:48:04.469436+0000","last_unstale":"2023-12-20T04:48:05.614602+0000","last_undegraded":"2023-12-20T04:48:05.614602+0000","last_fullsized":"2023-12-20T04:48:05.614602+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:19:37.392440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614907+0000","last_change":"2023-12-20T04:48:04.473138+0000","last_active":"2023-12-20T04:48:05.614907+0000","last_peered":"2023-12-20T04:48:05.614907+0000","last_clean":"2023-12-20T04:48:05.614907+0000","last_became_active":"2023-12-20T04:48:04.472290+0000","last_became_peered":"2023-12-20T04:48:04.472290+0000","last_unstale":"2023-12-20T04:48:05.614907+0000","last_undegraded":"2023-12-20T04:48:05.614907+0000","last_fullsized":"2023-12-20T04:48:05.614907+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:00:02.350668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614801+0000","last_change":"2023-12-20T04:48:04.469019+0000","last_active":"2023-12-20T04:48:05.614801+0000","last_peered":"2023-12-20T04:48:05.614801+0000","last_clean":"2023-12-20T04:48:05.614801+0000","last_became_active":"2023-12-20T04:48:04.468636+0000","last_became_peered":"2023-12-20T04:48:04.468636+0000","last_unstale":"2023-12-20T04:48:05.614801+0000","last_undegraded":"2023-12-20T04:48:05.614801+0000","last_fullsized":"2023-12-20T04:48:05.614801+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:56:02.738711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462260+0000","last_change":"2023-12-20T04:48:04.468161+0000","last_active":"2023-12-20T04:48:05.462260+0000","last_peered":"2023-12-20T04:48:05.462260+0000","last_clean":"2023-12-20T04:48:05.462260+0000","last_became_active":"2023-12-20T04:48:04.467041+0000","last_became_peered":"2023-12-20T04:48:04.467041+0000","last_unstale":"2023-12-20T04:48:05.462260+0000","last_undegraded":"2023-12-20T04:48:05.462260+0000","last_fullsized":"2023-12-20T04:48:05.462260+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:18:51.782612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462461+0000","last_change":"2023-12-20T04:48:04.473845+0000","last_active":"2023-12-20T04:48:05.462461+0000","last_peered":"2023-12-20T04:48:05.462461+0000","last_clean":"2023-12-20T04:48:05.462461+0000","last_became_active":"2023-12-20T04:48:04.473614+0000","last_became_peered":"2023-12-20T04:48:04.473614+0000","last_unstale":"2023-12-20T04:48:05.462461+0000","last_undegraded":"2023-12-20T04:48:05.462461+0000","last_fullsized":"2023-12-20T04:48:05.462461+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:29:37.812575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614715+0000","last_change":"2023-12-20T04:48:04.472700+0000","last_active":"2023-12-20T04:48:05.614715+0000","last_peered":"2023-12-20T04:48:05.614715+0000","last_clean":"2023-12-20T04:48:05.614715+0000","last_became_active":"2023-12-20T04:48:04.472251+0000","last_became_peered":"2023-12-20T04:48:04.472251+0000","last_unstale":"2023-12-20T04:48:05.614715+0000","last_undegraded":"2023-12-20T04:48:05.614715+0000","last_fullsized":"2023-12-20T04:48:05.614715+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:54:22.755243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.615007+0000","last_change":"2023-12-20T04:48:04.472866+0000","last_active":"2023-12-20T04:48:05.615007+0000","last_peered":"2023-12-20T04:48:05.615007+0000","last_clean":"2023-12-20T04:48:05.615007+0000","last_became_active":"2023-12-20T04:48:04.471756+0000","last_became_peered":"2023-12-20T04:48:04.471756+0000","last_unstale":"2023-12-20T04:48:05.615007+0000","last_undegraded":"2023-12-20T04:48:05.615007+0000","last_fullsized":"2023-12-20T04:48:05.615007+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:20:12.320261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.463001+0000","last_change":"2023-12-20T04:48:04.461593+0000","last_active":"2023-12-20T04:48:05.463001+0000","last_peered":"2023-12-20T04:48:05.463001+0000","last_clean":"2023-12-20T04:48:05.463001+0000","last_became_active":"2023-12-20T04:48:04.461387+0000","last_became_peered":"2023-12-20T04:48:04.461387+0000","last_unstale":"2023-12-20T04:48:05.463001+0000","last_undegraded":"2023-12-20T04:48:05.463001+0000","last_fullsized":"2023-12-20T04:48:05.463001+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:39:30.603069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723141+0000","last_change":"2023-12-20T04:48:04.468264+0000","last_active":"2023-12-20T04:48:05.723141+0000","last_peered":"2023-12-20T04:48:05.723141+0000","last_clean":"2023-12-20T04:48:05.723141+0000","last_became_active":"2023-12-20T04:48:04.468049+0000","last_became_peered":"2023-12-20T04:48:04.468049+0000","last_unstale":"2023-12-20T04:48:05.723141+0000","last_undegraded":"2023-12-20T04:48:05.723141+0000","last_fullsized":"2023-12-20T04:48:05.723141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:17:26.742618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.613826+0000","last_change":"2023-12-20T04:48:04.472244+0000","last_active":"2023-12-20T04:48:05.613826+0000","last_peered":"2023-12-20T04:48:05.613826+0000","last_clean":"2023-12-20T04:48:05.613826+0000","last_became_active":"2023-12-20T04:48:04.470915+0000","last_became_peered":"2023-12-20T04:48:04.470915+0000","last_unstale":"2023-12-20T04:48:05.613826+0000","last_undegraded":"2023-12-20T04:48:05.613826+0000","last_fullsized":"2023-12-20T04:48:05.613826+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:49:31.357423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723279+0000","last_change":"2023-12-20T04:48:04.471255+0000","last_active":"2023-12-20T04:48:05.723279+0000","last_peered":"2023-12-20T04:48:05.723279+0000","last_clean":"2023-12-20T04:48:05.723279+0000","last_became_active":"2023-12-20T04:48:04.470749+0000","last_became_peered":"2023-12-20T04:48:04.470749+0000","last_unstale":"2023-12-20T04:48:05.723279+0000","last_undegraded":"2023-12-20T04:48:05.723279+0000","last_fullsized":"2023-12-20T04:48:05.723279+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:22:12.152872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.615092+0000","last_change":"2023-12-20T04:48:04.475787+0000","last_active":"2023-12-20T04:48:05.615092+0000","last_peered":"2023-12-20T04:48:05.615092+0000","last_clean":"2023-12-20T04:48:05.615092+0000","last_became_active":"2023-12-20T04:48:04.475567+0000","last_became_peered":"2023-12-20T04:48:04.475567+0000","last_unstale":"2023-12-20T04:48:05.615092+0000","last_undegraded":"2023-12-20T04:48:05.615092+0000","last_fullsized":"2023-12-20T04:48:05.615092+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:17:26.742618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462436+0000","last_change":"2023-12-20T04:48:04.467243+0000","last_active":"2023-12-20T04:48:05.462436+0000","last_peered":"2023-12-20T04:48:05.462436+0000","last_clean":"2023-12-20T04:48:05.462436+0000","last_became_active":"2023-12-20T04:48:04.467015+0000","last_became_peered":"2023-12-20T04:48:04.467015+0000","last_unstale":"2023-12-20T04:48:05.462436+0000","last_undegraded":"2023-12-20T04:48:05.462436+0000","last_fullsized":"2023-12-20T04:48:05.462436+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:50:40.717560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723209+0000","last_change":"2023-12-20T04:48:04.466092+0000","last_active":"2023-12-20T04:48:05.723209+0000","last_peered":"2023-12-20T04:48:05.723209+0000","last_clean":"2023-12-20T04:48:05.723209+0000","last_became_active":"2023-12-20T04:48:04.465548+0000","last_became_peered":"2023-12-20T04:48:04.465548+0000","last_unstale":"2023-12-20T04:48:05.723209+0000","last_undegraded":"2023-12-20T04:48:05.723209+0000","last_fullsized":"2023-12-20T04:48:05.723209+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:39:46.431943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.613926+0000","last_change":"2023-12-20T04:48:04.472631+0000","last_active":"2023-12-20T04:48:05.613926+0000","last_peered":"2023-12-20T04:48:05.613926+0000","last_clean":"2023-12-20T04:48:05.613926+0000","last_became_active":"2023-12-20T04:48:04.471791+0000","last_became_peered":"2023-12-20T04:48:04.471791+0000","last_unstale":"2023-12-20T04:48:05.613926+0000","last_undegraded":"2023-12-20T04:48:05.613926+0000","last_fullsized":"2023-12-20T04:48:05.613926+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:06:41.310616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462649+0000","last_change":"2023-12-20T04:48:04.473024+0000","last_active":"2023-12-20T04:48:05.462649+0000","last_peered":"2023-12-20T04:48:05.462649+0000","last_clean":"2023-12-20T04:48:05.462649+0000","last_became_active":"2023-12-20T04:48:04.472811+0000","last_became_peered":"2023-12-20T04:48:04.472811+0000","last_unstale":"2023-12-20T04:48:05.462649+0000","last_undegraded":"2023-12-20T04:48:05.462649+0000","last_fullsized":"2023-12-20T04:48:05.462649+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:10:14.757866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.613861+0000","last_change":"2023-12-20T04:48:04.470153+0000","last_active":"2023-12-20T04:48:05.613861+0000","last_peered":"2023-12-20T04:48:05.613861+0000","last_clean":"2023-12-20T04:48:05.613861+0000","last_became_active":"2023-12-20T04:48:04.468731+0000","last_became_peered":"2023-12-20T04:48:04.468731+0000","last_unstale":"2023-12-20T04:48:05.613861+0000","last_undegraded":"2023-12-20T04:48:05.613861+0000","last_fullsized":"2023-12-20T04:48:05.613861+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:02:20.446691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462572+0000","last_change":"2023-12-20T04:48:04.469795+0000","last_active":"2023-12-20T04:48:05.462572+0000","last_peered":"2023-12-20T04:48:05.462572+0000","last_clean":"2023-12-20T04:48:05.462572+0000","last_became_active":"2023-12-20T04:48:04.468579+0000","last_became_peered":"2023-12-20T04:48:04.468579+0000","last_unstale":"2023-12-20T04:48:05.462572+0000","last_undegraded":"2023-12-20T04:48:05.462572+0000","last_fullsized":"2023-12-20T04:48:05.462572+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:32:11.734476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462334+0000","last_change":"2023-12-20T04:48:04.472823+0000","last_active":"2023-12-20T04:48:05.462334+0000","last_peered":"2023-12-20T04:48:05.462334+0000","last_clean":"2023-12-20T04:48:05.462334+0000","last_became_active":"2023-12-20T04:48:04.471766+0000","last_became_peered":"2023-12-20T04:48:04.471766+0000","last_unstale":"2023-12-20T04:48:05.462334+0000","last_undegraded":"2023-12-20T04:48:05.462334+0000","last_fullsized":"2023-12-20T04:48:05.462334+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:26:33.636009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614385+0000","last_change":"2023-12-20T04:48:04.470362+0000","last_active":"2023-12-20T04:48:05.614385+0000","last_peered":"2023-12-20T04:48:05.614385+0000","last_clean":"2023-12-20T04:48:05.614385+0000","last_became_active":"2023-12-20T04:48:04.470131+0000","last_became_peered":"2023-12-20T04:48:04.470131+0000","last_unstale":"2023-12-20T04:48:05.614385+0000","last_undegraded":"2023-12-20T04:48:05.614385+0000","last_fullsized":"2023-12-20T04:48:05.614385+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:10:14.757866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614810+0000","last_change":"2023-12-20T04:48:04.465997+0000","last_active":"2023-12-20T04:48:05.614810+0000","last_peered":"2023-12-20T04:48:05.614810+0000","last_clean":"2023-12-20T04:48:05.614810+0000","last_became_active":"2023-12-20T04:48:04.465514+0000","last_became_peered":"2023-12-20T04:48:04.465514+0000","last_unstale":"2023-12-20T04:48:05.614810+0000","last_undegraded":"2023-12-20T04:48:05.614810+0000","last_fullsized":"2023-12-20T04:48:05.614810+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:59.497404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462403+0000","last_change":"2023-12-20T04:48:04.463093+0000","last_active":"2023-12-20T04:48:05.462403+0000","last_peered":"2023-12-20T04:48:05.462403+0000","last_clean":"2023-12-20T04:48:05.462403+0000","last_became_active":"2023-12-20T04:48:04.462898+0000","last_became_peered":"2023-12-20T04:48:04.462898+0000","last_unstale":"2023-12-20T04:48:05.462403+0000","last_undegraded":"2023-12-20T04:48:05.462403+0000","last_fullsized":"2023-12-20T04:48:05.462403+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:49:15.275874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614873+0000","last_change":"2023-12-20T04:48:04.465505+0000","last_active":"2023-12-20T04:48:05.614873+0000","last_peered":"2023-12-20T04:48:05.614873+0000","last_clean":"2023-12-20T04:48:05.614873+0000","last_became_active":"2023-12-20T04:48:04.465266+0000","last_became_peered":"2023-12-20T04:48:04.465266+0000","last_unstale":"2023-12-20T04:48:05.614873+0000","last_undegraded":"2023-12-20T04:48:05.614873+0000","last_fullsized":"2023-12-20T04:48:05.614873+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:29:37.812575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614475+0000","last_change":"2023-12-20T04:48:04.470738+0000","last_active":"2023-12-20T04:48:05.614475+0000","last_peered":"2023-12-20T04:48:05.614475+0000","last_clean":"2023-12-20T04:48:05.614475+0000","last_became_active":"2023-12-20T04:48:04.470330+0000","last_became_peered":"2023-12-20T04:48:04.470330+0000","last_unstale":"2023-12-20T04:48:05.614475+0000","last_undegraded":"2023-12-20T04:48:05.614475+0000","last_fullsized":"2023-12-20T04:48:05.614475+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:54:53.740300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462266+0000","last_change":"2023-12-20T04:48:04.462684+0000","last_active":"2023-12-20T04:48:05.462266+0000","last_peered":"2023-12-20T04:48:05.462266+0000","last_clean":"2023-12-20T04:48:05.462266+0000","last_became_active":"2023-12-20T04:48:04.462484+0000","last_became_peered":"2023-12-20T04:48:04.462484+0000","last_unstale":"2023-12-20T04:48:05.462266+0000","last_undegraded":"2023-12-20T04:48:05.462266+0000","last_fullsized":"2023-12-20T04:48:05.462266+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:54:22.755243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614071+0000","last_change":"2023-12-20T04:48:04.471044+0000","last_active":"2023-12-20T04:48:05.614071+0000","last_peered":"2023-12-20T04:48:05.614071+0000","last_clean":"2023-12-20T04:48:05.614071+0000","last_became_active":"2023-12-20T04:48:04.470699+0000","last_became_peered":"2023-12-20T04:48:04.470699+0000","last_unstale":"2023-12-20T04:48:05.614071+0000","last_undegraded":"2023-12-20T04:48:05.614071+0000","last_fullsized":"2023-12-20T04:48:05.614071+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:23:05.958927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723248+0000","last_change":"2023-12-20T04:48:04.469960+0000","last_active":"2023-12-20T04:48:05.723248+0000","last_peered":"2023-12-20T04:48:05.723248+0000","last_clean":"2023-12-20T04:48:05.723248+0000","last_became_active":"2023-12-20T04:48:04.469744+0000","last_became_peered":"2023-12-20T04:48:04.469744+0000","last_unstale":"2023-12-20T04:48:05.723248+0000","last_undegraded":"2023-12-20T04:48:05.723248+0000","last_fullsized":"2023-12-20T04:48:05.723248+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:00:02.350668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972655+0000","last_change":"2023-12-20T04:48:04.465787+0000","last_active":"2023-12-20T04:48:05.972655+0000","last_peered":"2023-12-20T04:48:05.972655+0000","last_clean":"2023-12-20T04:48:05.972655+0000","last_became_active":"2023-12-20T04:48:04.465343+0000","last_became_peered":"2023-12-20T04:48:04.465343+0000","last_unstale":"2023-12-20T04:48:05.972655+0000","last_undegraded":"2023-12-20T04:48:05.972655+0000","last_fullsized":"2023-12-20T04:48:05.972655+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:56:42.348204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614018+0000","last_change":"2023-12-20T04:48:04.472106+0000","last_active":"2023-12-20T04:48:05.614018+0000","last_peered":"2023-12-20T04:48:05.614018+0000","last_clean":"2023-12-20T04:48:05.614018+0000","last_became_active":"2023-12-20T04:48:04.470537+0000","last_became_peered":"2023-12-20T04:48:04.470537+0000","last_unstale":"2023-12-20T04:48:05.614018+0000","last_undegraded":"2023-12-20T04:48:05.614018+0000","last_fullsized":"2023-12-20T04:48:05.614018+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:36:02.503928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"121'4","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462496+0000","last_change":"2023-12-20T04:48:04.116197+0000","last_active":"2023-12-20T04:48:05.462496+0000","last_peered":"2023-12-20T04:48:05.462496+0000","last_clean":"2023-12-20T04:48:05.462496+0000","last_became_active":"2023-12-20T04:48:04.115438+0000","last_became_peered":"2023-12-20T04:48:04.115438+0000","last_unstale":"2023-12-20T04:48:05.462496+0000","last_undegraded":"2023-12-20T04:48:05.462496+0000","last_fullsized":"2023-12-20T04:48:05.462496+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:56:01.734412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723265+0000","last_change":"2023-12-20T04:48:04.469237+0000","last_active":"2023-12-20T04:48:05.723265+0000","last_peered":"2023-12-20T04:48:05.723265+0000","last_clean":"2023-12-20T04:48:05.723265+0000","last_became_active":"2023-12-20T04:48:04.469015+0000","last_became_peered":"2023-12-20T04:48:04.469015+0000","last_unstale":"2023-12-20T04:48:05.723265+0000","last_undegraded":"2023-12-20T04:48:05.723265+0000","last_fullsized":"2023-12-20T04:48:05.723265+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:20:12.320261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"121'1","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614474+0000","last_change":"2023-12-20T04:48:04.119117+0000","last_active":"2023-12-20T04:48:05.614474+0000","last_peered":"2023-12-20T04:48:05.614474+0000","last_clean":"2023-12-20T04:48:05.614474+0000","last_became_active":"2023-12-20T04:48:04.118793+0000","last_became_peered":"2023-12-20T04:48:04.118793+0000","last_unstale":"2023-12-20T04:48:05.614474+0000","last_undegraded":"2023-12-20T04:48:05.614474+0000","last_fullsized":"2023-12-20T04:48:05.614474+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:42:25.004520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972895+0000","last_change":"2023-12-20T04:48:04.462454+0000","last_active":"2023-12-20T04:48:05.972895+0000","last_peered":"2023-12-20T04:48:05.972895+0000","last_clean":"2023-12-20T04:48:05.972895+0000","last_became_active":"2023-12-20T04:48:04.462240+0000","last_became_peered":"2023-12-20T04:48:04.462240+0000","last_unstale":"2023-12-20T04:48:05.972895+0000","last_undegraded":"2023-12-20T04:48:05.972895+0000","last_fullsized":"2023-12-20T04:48:05.972895+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:20:53.834334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"121'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462436+0000","last_change":"2023-12-20T04:48:04.123295+0000","last_active":"2023-12-20T04:48:05.462436+0000","last_peered":"2023-12-20T04:48:05.462436+0000","last_clean":"2023-12-20T04:48:05.462436+0000","last_became_active":"2023-12-20T04:48:04.123033+0000","last_became_peered":"2023-12-20T04:48:04.123033+0000","last_unstale":"2023-12-20T04:48:05.462436+0000","last_undegraded":"2023-12-20T04:48:05.462436+0000","last_fullsized":"2023-12-20T04:48:05.462436+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:22:11.148574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462763+0000","last_change":"2023-12-20T04:48:04.468555+0000","last_active":"2023-12-20T04:48:05.462763+0000","last_peered":"2023-12-20T04:48:05.462763+0000","last_clean":"2023-12-20T04:48:05.462763+0000","last_became_active":"2023-12-20T04:48:04.468271+0000","last_became_peered":"2023-12-20T04:48:04.468271+0000","last_unstale":"2023-12-20T04:48:05.462763+0000","last_undegraded":"2023-12-20T04:48:05.462763+0000","last_fullsized":"2023-12-20T04:48:05.462763+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:23:12.739173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"121'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462497+0000","last_change":"2023-12-20T04:48:04.116926+0000","last_active":"2023-12-20T04:48:05.462497+0000","last_peered":"2023-12-20T04:48:05.462497+0000","last_clean":"2023-12-20T04:48:05.462497+0000","last_became_active":"2023-12-20T04:48:04.116270+0000","last_became_peered":"2023-12-20T04:48:04.116270+0000","last_unstale":"2023-12-20T04:48:05.462497+0000","last_undegraded":"2023-12-20T04:48:05.462497+0000","last_fullsized":"2023-12-20T04:48:05.462497+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:10:13.753568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.461986+0000","last_change":"2023-12-20T04:48:04.474420+0000","last_active":"2023-12-20T04:48:05.461986+0000","last_peered":"2023-12-20T04:48:05.461986+0000","last_clean":"2023-12-20T04:48:05.461986+0000","last_became_active":"2023-12-20T04:48:04.474058+0000","last_became_peered":"2023-12-20T04:48:04.474058+0000","last_unstale":"2023-12-20T04:48:05.461986+0000","last_undegraded":"2023-12-20T04:48:05.461986+0000","last_fullsized":"2023-12-20T04:48:05.461986+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:54:50.124497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"121'1","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972837+0000","last_change":"2023-12-20T04:48:04.117333+0000","last_active":"2023-12-20T04:48:05.972837+0000","last_peered":"2023-12-20T04:48:05.972837+0000","last_clean":"2023-12-20T04:48:05.972837+0000","last_became_active":"2023-12-20T04:48:04.117057+0000","last_became_peered":"2023-12-20T04:48:04.117057+0000","last_unstale":"2023-12-20T04:48:05.972837+0000","last_undegraded":"2023-12-20T04:48:05.972837+0000","last_fullsized":"2023-12-20T04:48:05.972837+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:35:52.033049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614930+0000","last_change":"2023-12-20T04:48:04.468866+0000","last_active":"2023-12-20T04:48:05.614930+0000","last_peered":"2023-12-20T04:48:05.614930+0000","last_clean":"2023-12-20T04:48:05.614930+0000","last_became_active":"2023-12-20T04:48:04.468328+0000","last_became_peered":"2023-12-20T04:48:04.468328+0000","last_unstale":"2023-12-20T04:48:05.614930+0000","last_undegraded":"2023-12-20T04:48:05.614930+0000","last_fullsized":"2023-12-20T04:48:05.614930+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:46:46.191407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"121'1","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462546+0000","last_change":"2023-12-20T04:48:04.115663+0000","last_active":"2023-12-20T04:48:05.462546+0000","last_peered":"2023-12-20T04:48:05.462546+0000","last_clean":"2023-12-20T04:48:05.462546+0000","last_became_active":"2023-12-20T04:48:04.114411+0000","last_became_peered":"2023-12-20T04:48:04.114411+0000","last_unstale":"2023-12-20T04:48:05.462546+0000","last_undegraded":"2023-12-20T04:48:05.462546+0000","last_fullsized":"2023-12-20T04:48:05.462546+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:46:45.187109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723353+0000","last_change":"2023-12-20T04:48:04.471415+0000","last_active":"2023-12-20T04:48:05.723353+0000","last_peered":"2023-12-20T04:48:05.723353+0000","last_clean":"2023-12-20T04:48:05.723353+0000","last_became_active":"2023-12-20T04:48:04.471041+0000","last_became_peered":"2023-12-20T04:48:04.471041+0000","last_unstale":"2023-12-20T04:48:05.723353+0000","last_undegraded":"2023-12-20T04:48:05.723353+0000","last_fullsized":"2023-12-20T04:48:05.723353+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:58:47.794784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614761+0000","last_change":"2023-12-20T04:48:04.117343+0000","last_active":"2023-12-20T04:48:05.614761+0000","last_peered":"2023-12-20T04:48:05.614761+0000","last_clean":"2023-12-20T04:48:05.614761+0000","last_became_active":"2023-12-20T04:48:04.116886+0000","last_became_peered":"2023-12-20T04:48:04.116886+0000","last_unstale":"2023-12-20T04:48:05.614761+0000","last_undegraded":"2023-12-20T04:48:05.614761+0000","last_fullsized":"2023-12-20T04:48:05.614761+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:41:41.034492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462573+0000","last_change":"2023-12-20T04:48:04.473183+0000","last_active":"2023-12-20T04:48:05.462573+0000","last_peered":"2023-12-20T04:48:05.462573+0000","last_clean":"2023-12-20T04:48:05.462573+0000","last_became_active":"2023-12-20T04:48:04.472915+0000","last_became_peered":"2023-12-20T04:48:04.472915+0000","last_unstale":"2023-12-20T04:48:05.462573+0000","last_undegraded":"2023-12-20T04:48:05.462573+0000","last_fullsized":"2023-12-20T04:48:05.462573+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:22:12.152872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.973049+0000","last_change":"2023-12-20T04:48:04.114906+0000","last_active":"2023-12-20T04:48:05.973049+0000","last_peered":"2023-12-20T04:48:05.973049+0000","last_clean":"2023-12-20T04:48:05.973049+0000","last_became_active":"2023-12-20T04:48:04.114679+0000","last_became_peered":"2023-12-20T04:48:04.114679+0000","last_unstale":"2023-12-20T04:48:05.973049+0000","last_undegraded":"2023-12-20T04:48:05.973049+0000","last_fullsized":"2023-12-20T04:48:05.973049+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:07:37.214668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462650+0000","last_change":"2023-12-20T04:48:04.463700+0000","last_active":"2023-12-20T04:48:05.462650+0000","last_peered":"2023-12-20T04:48:05.462650+0000","last_clean":"2023-12-20T04:48:05.462650+0000","last_became_active":"2023-12-20T04:48:04.463502+0000","last_became_peered":"2023-12-20T04:48:04.463502+0000","last_unstale":"2023-12-20T04:48:05.462650+0000","last_undegraded":"2023-12-20T04:48:05.462650+0000","last_fullsized":"2023-12-20T04:48:05.462650+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:05:37.178776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972830+0000","last_change":"2023-12-20T04:48:04.123179+0000","last_active":"2023-12-20T04:48:05.972830+0000","last_peered":"2023-12-20T04:48:05.972830+0000","last_clean":"2023-12-20T04:48:05.972830+0000","last_became_active":"2023-12-20T04:48:04.122683+0000","last_became_peered":"2023-12-20T04:48:04.122683+0000","last_unstale":"2023-12-20T04:48:05.972830+0000","last_undegraded":"2023-12-20T04:48:05.972830+0000","last_fullsized":"2023-12-20T04:48:05.972830+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:42:54.492598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462902+0000","last_change":"2023-12-20T04:48:04.468288+0000","last_active":"2023-12-20T04:48:05.462902+0000","last_peered":"2023-12-20T04:48:05.462902+0000","last_clean":"2023-12-20T04:48:05.462902+0000","last_became_active":"2023-12-20T04:48:04.468044+0000","last_became_peered":"2023-12-20T04:48:04.468044+0000","last_unstale":"2023-12-20T04:48:05.462902+0000","last_undegraded":"2023-12-20T04:48:05.462902+0000","last_fullsized":"2023-12-20T04:48:05.462902+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:20:12.320261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723165+0000","last_change":"2023-12-20T04:48:04.115678+0000","last_active":"2023-12-20T04:48:05.723165+0000","last_peered":"2023-12-20T04:48:05.723165+0000","last_clean":"2023-12-20T04:48:05.723165+0000","last_became_active":"2023-12-20T04:48:04.115435+0000","last_became_peered":"2023-12-20T04:48:04.115435+0000","last_unstale":"2023-12-20T04:48:05.723165+0000","last_undegraded":"2023-12-20T04:48:05.723165+0000","last_fullsized":"2023-12-20T04:48:05.723165+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:14:55.438681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614376+0000","last_change":"2023-12-20T04:48:04.471213+0000","last_active":"2023-12-20T04:48:05.614376+0000","last_peered":"2023-12-20T04:48:05.614376+0000","last_clean":"2023-12-20T04:48:05.614376+0000","last_became_active":"2023-12-20T04:48:04.470972+0000","last_became_peered":"2023-12-20T04:48:04.470972+0000","last_unstale":"2023-12-20T04:48:05.614376+0000","last_undegraded":"2023-12-20T04:48:05.614376+0000","last_fullsized":"2023-12-20T04:48:05.614376+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:02:45.514616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"121'3","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614551+0000","last_change":"2023-12-20T04:48:04.119891+0000","last_active":"2023-12-20T04:48:05.614551+0000","last_peered":"2023-12-20T04:48:05.614551+0000","last_clean":"2023-12-20T04:48:05.614551+0000","last_became_active":"2023-12-20T04:48:04.119669+0000","last_became_peered":"2023-12-20T04:48:04.119669+0000","last_unstale":"2023-12-20T04:48:05.614551+0000","last_undegraded":"2023-12-20T04:48:05.614551+0000","last_fullsized":"2023-12-20T04:48:05.614551+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:20:52.830035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614400+0000","last_change":"2023-12-20T04:48:04.469504+0000","last_active":"2023-12-20T04:48:05.614400+0000","last_peered":"2023-12-20T04:48:05.614400+0000","last_clean":"2023-12-20T04:48:05.614400+0000","last_became_active":"2023-12-20T04:48:04.469168+0000","last_became_peered":"2023-12-20T04:48:04.469168+0000","last_unstale":"2023-12-20T04:48:05.614400+0000","last_undegraded":"2023-12-20T04:48:05.614400+0000","last_fullsized":"2023-12-20T04:48:05.614400+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:39:46.431943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"121'6","reported_seq":17,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462815+0000","last_change":"2023-12-20T04:48:04.116538+0000","last_active":"2023-12-20T04:48:05.462815+0000","last_peered":"2023-12-20T04:48:05.462815+0000","last_clean":"2023-12-20T04:48:05.462815+0000","last_became_active":"2023-12-20T04:48:04.116336+0000","last_became_peered":"2023-12-20T04:48:04.116336+0000","last_unstale":"2023-12-20T04:48:05.462815+0000","last_undegraded":"2023-12-20T04:48:05.462815+0000","last_fullsized":"2023-12-20T04:48:05.462815+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:20:52.830035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723094+0000","last_change":"2023-12-20T04:48:04.474352+0000","last_active":"2023-12-20T04:48:05.723094+0000","last_peered":"2023-12-20T04:48:05.723094+0000","last_clean":"2023-12-20T04:48:05.723094+0000","last_became_active":"2023-12-20T04:48:04.474123+0000","last_became_peered":"2023-12-20T04:48:04.474123+0000","last_unstale":"2023-12-20T04:48:05.723094+0000","last_undegraded":"2023-12-20T04:48:05.723094+0000","last_fullsized":"2023-12-20T04:48:05.723094+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:51:37.554534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"121'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614160+0000","last_change":"2023-12-20T04:48:04.122195+0000","last_active":"2023-12-20T04:48:05.614160+0000","last_peered":"2023-12-20T04:48:05.614160+0000","last_clean":"2023-12-20T04:48:05.614160+0000","last_became_active":"2023-12-20T04:48:04.121857+0000","last_became_peered":"2023-12-20T04:48:04.121857+0000","last_unstale":"2023-12-20T04:48:05.614160+0000","last_undegraded":"2023-12-20T04:48:05.614160+0000","last_fullsized":"2023-12-20T04:48:05.614160+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:39:19.005423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972961+0000","last_change":"2023-12-20T04:48:04.469564+0000","last_active":"2023-12-20T04:48:05.972961+0000","last_peered":"2023-12-20T04:48:05.972961+0000","last_clean":"2023-12-20T04:48:05.972961+0000","last_became_active":"2023-12-20T04:48:04.469370+0000","last_became_peered":"2023-12-20T04:48:04.469370+0000","last_unstale":"2023-12-20T04:48:05.972961+0000","last_undegraded":"2023-12-20T04:48:05.972961+0000","last_fullsized":"2023-12-20T04:48:05.972961+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:31:36.283158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614034+0000","last_change":"2023-12-20T04:48:04.123900+0000","last_active":"2023-12-20T04:48:05.614034+0000","last_peered":"2023-12-20T04:48:05.614034+0000","last_clean":"2023-12-20T04:48:05.614034+0000","last_became_active":"2023-12-20T04:48:04.123661+0000","last_became_peered":"2023-12-20T04:48:04.123661+0000","last_unstale":"2023-12-20T04:48:05.614034+0000","last_undegraded":"2023-12-20T04:48:05.614034+0000","last_fullsized":"2023-12-20T04:48:05.614034+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:43:27.633118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462733+0000","last_change":"2023-12-20T04:48:04.470646+0000","last_active":"2023-12-20T04:48:05.462733+0000","last_peered":"2023-12-20T04:48:05.462733+0000","last_clean":"2023-12-20T04:48:05.462733+0000","last_became_active":"2023-12-20T04:48:04.469517+0000","last_became_peered":"2023-12-20T04:48:04.469517+0000","last_unstale":"2023-12-20T04:48:05.462733+0000","last_undegraded":"2023-12-20T04:48:05.462733+0000","last_fullsized":"2023-12-20T04:48:05.462733+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:56:02.738711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.463081+0000","last_change":"2023-12-20T04:48:04.115845+0000","last_active":"2023-12-20T04:48:05.463081+0000","last_peered":"2023-12-20T04:48:05.463081+0000","last_clean":"2023-12-20T04:48:05.463081+0000","last_became_active":"2023-12-20T04:48:04.115612+0000","last_became_peered":"2023-12-20T04:48:04.115612+0000","last_unstale":"2023-12-20T04:48:05.463081+0000","last_undegraded":"2023-12-20T04:48:05.463081+0000","last_fullsized":"2023-12-20T04:48:05.463081+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:49:21.832343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.613941+0000","last_change":"2023-12-20T04:48:04.467464+0000","last_active":"2023-12-20T04:48:05.613941+0000","last_peered":"2023-12-20T04:48:05.613941+0000","last_clean":"2023-12-20T04:48:05.613941+0000","last_became_active":"2023-12-20T04:48:04.467269+0000","last_became_peered":"2023-12-20T04:48:04.467269+0000","last_unstale":"2023-12-20T04:48:05.613941+0000","last_undegraded":"2023-12-20T04:48:05.613941+0000","last_fullsized":"2023-12-20T04:48:05.613941+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:13:37.713642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"121'8","reported_seq":19,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972742+0000","last_change":"2023-12-20T04:48:04.118966+0000","last_active":"2023-12-20T04:48:05.972742+0000","last_peered":"2023-12-20T04:48:05.972742+0000","last_clean":"2023-12-20T04:48:05.972742+0000","last_became_active":"2023-12-20T04:48:04.118708+0000","last_became_peered":"2023-12-20T04:48:04.118708+0000","last_unstale":"2023-12-20T04:48:05.972742+0000","last_undegraded":"2023-12-20T04:48:05.972742+0000","last_fullsized":"2023-12-20T04:48:05.972742+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:28.762689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614474+0000","last_change":"2023-12-20T04:48:04.469780+0000","last_active":"2023-12-20T04:48:05.614474+0000","last_peered":"2023-12-20T04:48:05.614474+0000","last_clean":"2023-12-20T04:48:05.614474+0000","last_became_active":"2023-12-20T04:48:04.467749+0000","last_became_peered":"2023-12-20T04:48:04.467749+0000","last_unstale":"2023-12-20T04:48:05.614474+0000","last_undegraded":"2023-12-20T04:48:05.614474+0000","last_fullsized":"2023-12-20T04:48:05.614474+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:49:15.275874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"121'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462871+0000","last_change":"2023-12-20T04:48:04.121158+0000","last_active":"2023-12-20T04:48:05.462871+0000","last_peered":"2023-12-20T04:48:05.462871+0000","last_clean":"2023-12-20T04:48:05.462871+0000","last_became_active":"2023-12-20T04:48:04.120926+0000","last_became_peered":"2023-12-20T04:48:04.120926+0000","last_unstale":"2023-12-20T04:48:05.462871+0000","last_undegraded":"2023-12-20T04:48:05.462871+0000","last_fullsized":"2023-12-20T04:48:05.462871+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:17:29.322846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462078+0000","last_change":"2023-12-20T04:48:04.467385+0000","last_active":"2023-12-20T04:48:05.462078+0000","last_peered":"2023-12-20T04:48:05.462078+0000","last_clean":"2023-12-20T04:48:05.462078+0000","last_became_active":"2023-12-20T04:48:04.466713+0000","last_became_peered":"2023-12-20T04:48:04.466713+0000","last_unstale":"2023-12-20T04:48:05.462078+0000","last_undegraded":"2023-12-20T04:48:05.462078+0000","last_fullsized":"2023-12-20T04:48:05.462078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:12:47.759423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"121'1","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614613+0000","last_change":"2023-12-20T04:48:04.120801+0000","last_active":"2023-12-20T04:48:05.614613+0000","last_peered":"2023-12-20T04:48:05.614613+0000","last_clean":"2023-12-20T04:48:05.614613+0000","last_became_active":"2023-12-20T04:48:04.120538+0000","last_became_peered":"2023-12-20T04:48:04.120538+0000","last_unstale":"2023-12-20T04:48:05.614613+0000","last_undegraded":"2023-12-20T04:48:05.614613+0000","last_fullsized":"2023-12-20T04:48:05.614613+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:00:52.478004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.615181+0000","last_change":"2023-12-20T04:48:04.473697+0000","last_active":"2023-12-20T04:48:05.615181+0000","last_peered":"2023-12-20T04:48:05.615181+0000","last_clean":"2023-12-20T04:48:05.615181+0000","last_became_active":"2023-12-20T04:48:04.473446+0000","last_became_peered":"2023-12-20T04:48:04.473446+0000","last_unstale":"2023-12-20T04:48:05.615181+0000","last_undegraded":"2023-12-20T04:48:05.615181+0000","last_fullsized":"2023-12-20T04:48:05.615181+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:39:30.603069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462710+0000","last_change":"2023-12-20T04:48:04.117672+0000","last_active":"2023-12-20T04:48:05.462710+0000","last_peered":"2023-12-20T04:48:05.462710+0000","last_clean":"2023-12-20T04:48:05.462710+0000","last_became_active":"2023-12-20T04:48:04.117478+0000","last_became_peered":"2023-12-20T04:48:04.117478+0000","last_unstale":"2023-12-20T04:48:05.462710+0000","last_undegraded":"2023-12-20T04:48:05.462710+0000","last_fullsized":"2023-12-20T04:48:05.462710+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:56:41.343906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614082+0000","last_change":"2023-12-20T04:48:04.473633+0000","last_active":"2023-12-20T04:48:05.614082+0000","last_peered":"2023-12-20T04:48:05.614082+0000","last_clean":"2023-12-20T04:48:05.614082+0000","last_became_active":"2023-12-20T04:48:04.473252+0000","last_became_peered":"2023-12-20T04:48:04.473252+0000","last_unstale":"2023-12-20T04:48:05.614082+0000","last_undegraded":"2023-12-20T04:48:05.614082+0000","last_fullsized":"2023-12-20T04:48:05.614082+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:38:48.179536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"121'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462599+0000","last_change":"2023-12-20T04:48:04.121657+0000","last_active":"2023-12-20T04:48:05.462599+0000","last_peered":"2023-12-20T04:48:05.462599+0000","last_clean":"2023-12-20T04:48:05.462599+0000","last_became_active":"2023-12-20T04:48:04.121461+0000","last_became_peered":"2023-12-20T04:48:04.121461+0000","last_unstale":"2023-12-20T04:48:05.462599+0000","last_undegraded":"2023-12-20T04:48:05.462599+0000","last_fullsized":"2023-12-20T04:48:05.462599+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:51:36.550236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.613875+0000","last_change":"2023-12-20T04:48:04.467391+0000","last_active":"2023-12-20T04:48:05.613875+0000","last_peered":"2023-12-20T04:48:05.613875+0000","last_clean":"2023-12-20T04:48:05.613875+0000","last_became_active":"2023-12-20T04:48:04.467143+0000","last_became_peered":"2023-12-20T04:48:04.467143+0000","last_unstale":"2023-12-20T04:48:05.613875+0000","last_undegraded":"2023-12-20T04:48:05.613875+0000","last_fullsized":"2023-12-20T04:48:05.613875+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:52:15.241383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462014+0000","last_change":"2023-12-20T04:48:04.119863+0000","last_active":"2023-12-20T04:48:05.462014+0000","last_peered":"2023-12-20T04:48:05.462014+0000","last_clean":"2023-12-20T04:48:05.462014+0000","last_became_active":"2023-12-20T04:48:04.119581+0000","last_became_peered":"2023-12-20T04:48:04.119581+0000","last_unstale":"2023-12-20T04:48:05.462014+0000","last_undegraded":"2023-12-20T04:48:05.462014+0000","last_fullsized":"2023-12-20T04:48:05.462014+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:07:37.214668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.613955+0000","last_change":"2023-12-20T04:48:04.467010+0000","last_active":"2023-12-20T04:48:05.613955+0000","last_peered":"2023-12-20T04:48:05.613955+0000","last_clean":"2023-12-20T04:48:05.613955+0000","last_became_active":"2023-12-20T04:48:04.466320+0000","last_became_peered":"2023-12-20T04:48:04.466320+0000","last_unstale":"2023-12-20T04:48:05.613955+0000","last_undegraded":"2023-12-20T04:48:05.613955+0000","last_fullsized":"2023-12-20T04:48:05.613955+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:58:09.862917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462094+0000","last_change":"2023-12-20T04:48:04.120157+0000","last_active":"2023-12-20T04:48:05.462094+0000","last_peered":"2023-12-20T04:48:05.462094+0000","last_clean":"2023-12-20T04:48:05.462094+0000","last_became_active":"2023-12-20T04:48:04.119199+0000","last_became_peered":"2023-12-20T04:48:04.119199+0000","last_unstale":"2023-12-20T04:48:05.462094+0000","last_undegraded":"2023-12-20T04:48:05.462094+0000","last_fullsized":"2023-12-20T04:48:05.462094+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:08:34.850605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614901+0000","last_change":"2023-12-20T04:48:04.471973+0000","last_active":"2023-12-20T04:48:05.614901+0000","last_peered":"2023-12-20T04:48:05.614901+0000","last_clean":"2023-12-20T04:48:05.614901+0000","last_became_active":"2023-12-20T04:48:04.471113+0000","last_became_peered":"2023-12-20T04:48:04.471113+0000","last_unstale":"2023-12-20T04:48:05.614901+0000","last_undegraded":"2023-12-20T04:48:05.614901+0000","last_fullsized":"2023-12-20T04:48:05.614901+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:00:02.350668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462580+0000","last_change":"2023-12-20T04:48:04.116500+0000","last_active":"2023-12-20T04:48:05.462580+0000","last_peered":"2023-12-20T04:48:05.462580+0000","last_clean":"2023-12-20T04:48:05.462580+0000","last_became_active":"2023-12-20T04:48:04.115956+0000","last_became_peered":"2023-12-20T04:48:04.115956+0000","last_unstale":"2023-12-20T04:48:05.462580+0000","last_undegraded":"2023-12-20T04:48:05.462580+0000","last_fullsized":"2023-12-20T04:48:05.462580+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:54:34.484294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462393+0000","last_change":"2023-12-20T04:48:04.471992+0000","last_active":"2023-12-20T04:48:05.462393+0000","last_peered":"2023-12-20T04:48:05.462393+0000","last_clean":"2023-12-20T04:48:05.462393+0000","last_became_active":"2023-12-20T04:48:04.468643+0000","last_became_peered":"2023-12-20T04:48:04.468643+0000","last_unstale":"2023-12-20T04:48:05.462393+0000","last_undegraded":"2023-12-20T04:48:05.462393+0000","last_fullsized":"2023-12-20T04:48:05.462393+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:51:59.446917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"121'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462327+0000","last_change":"2023-12-20T04:48:04.120153+0000","last_active":"2023-12-20T04:48:05.462327+0000","last_peered":"2023-12-20T04:48:05.462327+0000","last_clean":"2023-12-20T04:48:05.462327+0000","last_became_active":"2023-12-20T04:48:04.119731+0000","last_became_peered":"2023-12-20T04:48:04.119731+0000","last_unstale":"2023-12-20T04:48:05.462327+0000","last_undegraded":"2023-12-20T04:48:05.462327+0000","last_fullsized":"2023-12-20T04:48:05.462327+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:28.762689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972748+0000","last_change":"2023-12-20T04:48:04.470260+0000","last_active":"2023-12-20T04:48:05.972748+0000","last_peered":"2023-12-20T04:48:05.972748+0000","last_clean":"2023-12-20T04:48:05.972748+0000","last_became_active":"2023-12-20T04:48:04.470039+0000","last_became_peered":"2023-12-20T04:48:04.470039+0000","last_unstale":"2023-12-20T04:48:05.972748+0000","last_undegraded":"2023-12-20T04:48:05.972748+0000","last_fullsized":"2023-12-20T04:48:05.972748+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:14:56.442979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"121'1","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462646+0000","last_change":"2023-12-20T04:48:04.120358+0000","last_active":"2023-12-20T04:48:05.462646+0000","last_peered":"2023-12-20T04:48:05.462646+0000","last_clean":"2023-12-20T04:48:05.462646+0000","last_became_active":"2023-12-20T04:48:04.120138+0000","last_became_peered":"2023-12-20T04:48:04.120138+0000","last_unstale":"2023-12-20T04:48:05.462646+0000","last_undegraded":"2023-12-20T04:48:05.462646+0000","last_fullsized":"2023-12-20T04:48:05.462646+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:41:41.034492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.973008+0000","last_change":"2023-12-20T04:48:04.472514+0000","last_active":"2023-12-20T04:48:05.973008+0000","last_peered":"2023-12-20T04:48:05.973008+0000","last_clean":"2023-12-20T04:48:05.973008+0000","last_became_active":"2023-12-20T04:48:04.471752+0000","last_became_peered":"2023-12-20T04:48:04.471752+0000","last_unstale":"2023-12-20T04:48:05.973008+0000","last_undegraded":"2023-12-20T04:48:05.973008+0000","last_fullsized":"2023-12-20T04:48:05.973008+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:42:26.008818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462354+0000","last_change":"2023-12-20T04:48:04.118727+0000","last_active":"2023-12-20T04:48:05.462354+0000","last_peered":"2023-12-20T04:48:05.462354+0000","last_clean":"2023-12-20T04:48:05.462354+0000","last_became_active":"2023-12-20T04:48:04.118506+0000","last_became_peered":"2023-12-20T04:48:04.118506+0000","last_unstale":"2023-12-20T04:48:05.462354+0000","last_undegraded":"2023-12-20T04:48:05.462354+0000","last_fullsized":"2023-12-20T04:48:05.462354+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:42:25.004520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614672+0000","last_change":"2023-12-20T04:48:04.474317+0000","last_active":"2023-12-20T04:48:05.614672+0000","last_peered":"2023-12-20T04:48:05.614672+0000","last_clean":"2023-12-20T04:48:05.614672+0000","last_became_active":"2023-12-20T04:48:04.474045+0000","last_became_peered":"2023-12-20T04:48:04.474045+0000","last_unstale":"2023-12-20T04:48:05.614672+0000","last_undegraded":"2023-12-20T04:48:05.614672+0000","last_fullsized":"2023-12-20T04:48:05.614672+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:17:26.742618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614993+0000","last_change":"2023-12-20T04:48:04.120729+0000","last_active":"2023-12-20T04:48:05.614993+0000","last_peered":"2023-12-20T04:48:05.614993+0000","last_clean":"2023-12-20T04:48:05.614993+0000","last_became_active":"2023-12-20T04:48:04.120503+0000","last_became_peered":"2023-12-20T04:48:04.120503+0000","last_unstale":"2023-12-20T04:48:05.614993+0000","last_undegraded":"2023-12-20T04:48:05.614993+0000","last_fullsized":"2023-12-20T04:48:05.614993+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:23:11.734874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614008+0000","last_change":"2023-12-20T04:48:04.468597+0000","last_active":"2023-12-20T04:48:05.614008+0000","last_peered":"2023-12-20T04:48:05.614008+0000","last_clean":"2023-12-20T04:48:05.614008+0000","last_became_active":"2023-12-20T04:48:04.468401+0000","last_became_peered":"2023-12-20T04:48:04.468401+0000","last_unstale":"2023-12-20T04:48:05.614008+0000","last_undegraded":"2023-12-20T04:48:05.614008+0000","last_fullsized":"2023-12-20T04:48:05.614008+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:58:46.556108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462653+0000","last_change":"2023-12-20T04:48:04.115019+0000","last_active":"2023-12-20T04:48:05.462653+0000","last_peered":"2023-12-20T04:48:05.462653+0000","last_clean":"2023-12-20T04:48:05.462653+0000","last_became_active":"2023-12-20T04:48:04.113738+0000","last_became_peered":"2023-12-20T04:48:04.113738+0000","last_unstale":"2023-12-20T04:48:05.462653+0000","last_undegraded":"2023-12-20T04:48:05.462653+0000","last_fullsized":"2023-12-20T04:48:05.462653+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:58:46.790486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462959+0000","last_change":"2023-12-20T04:48:04.464640+0000","last_active":"2023-12-20T04:48:05.462959+0000","last_peered":"2023-12-20T04:48:05.462959+0000","last_clean":"2023-12-20T04:48:05.462959+0000","last_became_active":"2023-12-20T04:48:04.464406+0000","last_became_peered":"2023-12-20T04:48:04.464406+0000","last_unstale":"2023-12-20T04:48:05.462959+0000","last_undegraded":"2023-12-20T04:48:05.462959+0000","last_fullsized":"2023-12-20T04:48:05.462959+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:51:37.554534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614884+0000","last_change":"2023-12-20T04:48:04.115931+0000","last_active":"2023-12-20T04:48:05.614884+0000","last_peered":"2023-12-20T04:48:05.614884+0000","last_clean":"2023-12-20T04:48:05.614884+0000","last_became_active":"2023-12-20T04:48:04.115604+0000","last_became_peered":"2023-12-20T04:48:04.115604+0000","last_unstale":"2023-12-20T04:48:05.614884+0000","last_undegraded":"2023-12-20T04:48:05.614884+0000","last_fullsized":"2023-12-20T04:48:05.614884+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:23:44.938843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614143+0000","last_change":"2023-12-20T04:48:04.472454+0000","last_active":"2023-12-20T04:48:05.614143+0000","last_peered":"2023-12-20T04:48:05.614143+0000","last_clean":"2023-12-20T04:48:05.614143+0000","last_became_active":"2023-12-20T04:48:04.471342+0000","last_became_peered":"2023-12-20T04:48:04.471342+0000","last_unstale":"2023-12-20T04:48:05.614143+0000","last_undegraded":"2023-12-20T04:48:05.614143+0000","last_fullsized":"2023-12-20T04:48:05.614143+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:19:26.856704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723317+0000","last_change":"2023-12-20T04:48:04.116677+0000","last_active":"2023-12-20T04:48:05.723317+0000","last_peered":"2023-12-20T04:48:05.723317+0000","last_clean":"2023-12-20T04:48:05.723317+0000","last_became_active":"2023-12-20T04:48:04.116461+0000","last_became_peered":"2023-12-20T04:48:04.116461+0000","last_unstale":"2023-12-20T04:48:05.723317+0000","last_undegraded":"2023-12-20T04:48:05.723317+0000","last_fullsized":"2023-12-20T04:48:05.723317+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:56:41.343906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614588+0000","last_change":"2023-12-20T04:48:04.470593+0000","last_active":"2023-12-20T04:48:05.614588+0000","last_peered":"2023-12-20T04:48:05.614588+0000","last_clean":"2023-12-20T04:48:05.614588+0000","last_became_active":"2023-12-20T04:48:04.470033+0000","last_became_peered":"2023-12-20T04:48:04.470033+0000","last_unstale":"2023-12-20T04:48:05.614588+0000","last_undegraded":"2023-12-20T04:48:05.614588+0000","last_fullsized":"2023-12-20T04:48:05.614588+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:39:46.431943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614186+0000","last_change":"2023-12-20T04:48:04.124297+0000","last_active":"2023-12-20T04:48:05.614186+0000","last_peered":"2023-12-20T04:48:05.614186+0000","last_clean":"2023-12-20T04:48:05.614186+0000","last_became_active":"2023-12-20T04:48:04.123500+0000","last_became_peered":"2023-12-20T04:48:04.123500+0000","last_unstale":"2023-12-20T04:48:05.614186+0000","last_undegraded":"2023-12-20T04:48:05.614186+0000","last_fullsized":"2023-12-20T04:48:05.614186+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:20:02.801224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614003+0000","last_change":"2023-12-20T04:48:04.466663+0000","last_active":"2023-12-20T04:48:05.614003+0000","last_peered":"2023-12-20T04:48:05.614003+0000","last_clean":"2023-12-20T04:48:05.614003+0000","last_became_active":"2023-12-20T04:48:04.466452+0000","last_became_peered":"2023-12-20T04:48:04.466452+0000","last_unstale":"2023-12-20T04:48:05.614003+0000","last_undegraded":"2023-12-20T04:48:05.614003+0000","last_fullsized":"2023-12-20T04:48:05.614003+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:18:19.511502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"121'1","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614556+0000","last_change":"2023-12-20T04:48:04.121937+0000","last_active":"2023-12-20T04:48:05.614556+0000","last_peered":"2023-12-20T04:48:05.614556+0000","last_clean":"2023-12-20T04:48:05.614556+0000","last_became_active":"2023-12-20T04:48:04.121767+0000","last_became_peered":"2023-12-20T04:48:04.121767+0000","last_unstale":"2023-12-20T04:48:05.614556+0000","last_undegraded":"2023-12-20T04:48:05.614556+0000","last_fullsized":"2023-12-20T04:48:05.614556+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:49:21.832343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":252,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-20T04:48:04.464650+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:48:04.464650+0000","last_peered":"2023-12-20T04:48:04.464650+0000","last_clean":"2023-12-20T04:48:04.464650+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:48:04.464650+0000","last_undegraded":"2023-12-20T04:48:04.464650+0000","last_fullsized":"2023-12-20T04:48:04.464650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1231,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194081,"statfs":{"total":200000000,"available":198739144,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.42499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73399999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.623},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52200000000000002},"min":{"1min":0.33100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67300000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46000000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.39700000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.68700000000000006,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71599999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.50600000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.65200000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70099999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48399999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70299999999999996,"5min":1.048,"15min":1.048},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.42699999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65600000000000003,"5min":0.753,"15min":0.753},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.49199999999999999,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70399999999999996,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.375}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.49099999999999999},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68999999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.40500000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57899999999999996}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51900000000000002,"15min":0.54600000000000004},"min":{"1min":0.34399999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71599999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.59599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":649,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194663,"statfs":{"total":200000000,"available":199335272,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.50800000000000001,"15min":0.496},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.31900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.36699999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.53100000000000003},"min":{"1min":0.36699999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.49199999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52200000000000002,"15min":0.50800000000000001},"min":{"1min":0.40100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69999999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52200000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53100000000000003,"15min":0.5},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.433}]},{"osd":4,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48199999999999998,"15min":0.50600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.49399999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70399999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.504}]},{"osd":5,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68799999999999994,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.38600000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73199999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":648,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194663,"statfs":{"total":200000000,"available":199335854,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.63700000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.33300000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.80600000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.35899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58299999999999996}]},{"osd":2,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.41499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68300000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.32300000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66100000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.371,"5min":0.312,"15min":0.312},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48999999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47699999999999998,"15min":0.503},"min":{"1min":0.28799999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.749,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.47599999999999998,"15min":0.48099999999999998},"min":{"1min":0.32800000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.38900000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48399999999999999,"15min":0.50600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52700000000000002,"15min":0.54200000000000004},"min":{"1min":0.37,"5min":0.31,"15min":0.31},"max":{"1min":0.78600000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52700000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73099999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75800000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.59699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":656,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194656,"statfs":{"total":200000000,"available":199327936,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.308,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.33000000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.67100000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.68600000000000005}]},{"osd":1,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.34200000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69899999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.36499999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.72699999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54000000000000004,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.76000000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.371,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.51600000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.48499999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.877,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.70199999999999996}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.56599999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.436},{"interface":"front","average":{"1min":0.499,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.39900000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48799999999999999,"15min":0.503},"min":{"1min":0.371,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.72199999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70499999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.49099999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.34599999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.47899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334338,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35199999999999998,"15min":0.34000000000000002},"min":{"1min":0.20100000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.58299999999999996,"5min":0.629,"15min":0.629},"last":0.219},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.374,"15min":0.35599999999999998},"min":{"1min":0.29099999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.56200000000000006,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.29899999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.32100000000000001},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.247},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.33700000000000002},"min":{"1min":0.27800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.27800000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35099999999999998,"15min":0.34499999999999997},"min":{"1min":0.249,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49299999999999999,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.376},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.33500000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55800000000000005,"15min":0.54300000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.76800000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.45200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72199999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56200000000000006}]},{"osd":6,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.38500000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76700000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58399999999999996,"15min":0.56100000000000005},"min":{"1min":0.495,"5min":0.37,"15min":0.37},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60799999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80600000000000005,"5min":0.879,"15min":0.879},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80300000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":654,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194657,"statfs":{"total":200000000,"available":199329590,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.29999999999999999},"min":{"1min":0.246,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.44700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.252},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39300000000000002,"15min":0.34499999999999997},"min":{"1min":0.25800000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.504,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.36099999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35599999999999998,"15min":0.33100000000000002},"min":{"1min":0.24099999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.54300000000000004,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.38,"5min":0.375,"15min":0.35099999999999998},"min":{"1min":0.247,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.5,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.32200000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.35999999999999999},"min":{"1min":0.27700000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.58299999999999996,"5min":0.995,"15min":0.995},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.372},"min":{"1min":0.28100000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.53600000000000003,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.379}]},{"osd":4,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.442,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75,"5min":2.347,"15min":2.347},"last":0.77100000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.42099999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84999999999999998,"5min":0.997,"15min":0.997},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.83499999999999996}]},{"osd":6,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59199999999999997,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71699999999999997,"5min":2.274,"15min":2.274},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.82299999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.57099999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59099999999999997,"15min":0.57999999999999996},"min":{"1min":0.45100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.77700000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.81699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":654,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194657,"statfs":{"total":200000000,"available":199329624,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.316,"15min":0.28999999999999998},"min":{"1min":0.23000000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.35299999999999998,"15min":0.33100000000000002},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.39000000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.33200000000000002,"15min":0.307},"min":{"1min":0.20599999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.52400000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.377,"15min":0.35099999999999998},"min":{"1min":0.26900000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.33000000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.35799999999999998},"min":{"1min":0.29499999999999998,"5min":0.191,"15min":0.191},"max":{"1min":0.61699999999999999,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36399999999999999,"15min":0.35299999999999998},"min":{"1min":0.26400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54800000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.35399999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.312,"15min":0.312},"max":{"1min":0.70999999999999996,"5min":0.873,"15min":0.873},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.45000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73099999999999998,"5min":1.002,"15min":1.002},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.42099999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.54200000000000004},"min":{"1min":0.45900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.58399999999999996}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.47999999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":1.038,"15min":1.038},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.56299999999999994},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66900000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.59299999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.42899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72299999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.51500000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73499999999999999,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1231,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194080,"statfs":{"total":200000000,"available":198738674,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32200000000000001,"15min":0.31},"min":{"1min":0.25,"5min":0.184,"15min":0.184},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.246},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.314},"min":{"1min":0.27400000000000002,"5min":0.184,"15min":0.184},"max":{"1min":0.46300000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.40100000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.28599999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.53500000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.26500000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.51300000000000001,"5min":0.622,"15min":0.622},"last":0.32700000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34799999999999998,"15min":0.32500000000000001},"min":{"1min":0.29099999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.31},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.36899999999999999},"min":{"1min":0.29399999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.29999999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55200000000000005,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.432,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.36799999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.52200000000000002},"min":{"1min":0.432,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73199999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57199999999999995,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82999999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.443}]},{"osd":6,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88200000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.58399999999999996},"min":{"1min":0.45300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.45500000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.747,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.39300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83399999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.46300000000000002}]}]}],"pool_statfs":[]}} 2023-12-20T04:48:08.084 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:48:08.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.218+0000 7f07afeaf640 1 Processor -- start 2023-12-20T04:48:08.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.218+0000 7f07afeaf640 1 -- start start 2023-12-20T04:48:08.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.219+0000 7f07afeaf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a80cd2d0 0x7f07a80cea10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.219+0000 7f07afeaf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07a8161690 0x7f07a806fc80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.219+0000 7f07afeaf640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a80b0fc0 con 0x7f07a815d120 2023-12-20T04:48:08.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.219+0000 7f07afeaf640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a8071c80 con 0x7f07a8161690 2023-12-20T04:48:08.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.219+0000 7f07afeaf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a8161b20 con 0x7f07a80cd2d0 2023-12-20T04:48:08.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.219+0000 7f07ae44c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07a8161690 0x7f07a806fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:08.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.219+0000 7f07ae44c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f07a8161690 0x7f07a806fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44614/0 (socket says 172.21.15.132:44614) 2023-12-20T04:48:08.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.219+0000 7f07ae44c640 1 -- 172.21.15.132:0/2203036473 learned_addr learned my addr 172.21.15.132:0/2203036473 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:08.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.219+0000 7f07ad44a640 1 --2- 172.21.15.132:0/2203036473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a80cd2d0 0x7f07a80cea10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:08.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.220+0000 7f07ae44c640 1 -- 172.21.15.132:0/2203036473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a80cd2d0 msgr2=0x7f07a80cea10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:08.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.220+0000 7f07ae44c640 1 --2- 172.21.15.132:0/2203036473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a80cd2d0 0x7f07a80cea10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.220+0000 7f07ae44c640 1 -- 172.21.15.132:0/2203036473 >> v1:172.21.15.187:6789/0 conn(0x7f07a815d120 legacy=0x7f07a80ccbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.220+0000 7f07ae44c640 1 -- 172.21.15.132:0/2203036473 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a806f7f0 con 0x7f07a8161690 2023-12-20T04:48:08.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.220+0000 7f07ae44c640 1 --2- 172.21.15.132:0/2203036473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a8161690 0x7f07a806fc80 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f07a0009e50 tx=0x7f07a002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a36ddf66f716fd9a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:08.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.221+0000 7f07acc49640 1 -- 172.21.15.132:0/2203036473 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a002ca70 con 0x7f07a8161690 2023-12-20T04:48:08.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.221+0000 7f07acc49640 1 -- 172.21.15.132:0/2203036473 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f07a002cbd0 con 0x7f07a8161690 2023-12-20T04:48:08.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.221+0000 7f07acc49640 1 -- 172.21.15.132:0/2203036473 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07a00343f0 con 0x7f07a8161690 2023-12-20T04:48:08.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.221+0000 7f07afeaf640 1 -- 172.21.15.132:0/2203036473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a8161690 msgr2=0x7f07a806fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.221+0000 7f07afeaf640 1 --2- 172.21.15.132:0/2203036473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a8161690 0x7f07a806fc80 secure :-1 s=READY pgs=1202 cs=0 l=1 rev1=1 crypto rx=0x7f07a0009e50 tx=0x7f07a002bed0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.221+0000 7f07afeaf640 1 -- 172.21.15.132:0/2203036473 shutdown_connections 2023-12-20T04:48:08.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.221+0000 7f07afeaf640 1 --2- 172.21.15.132:0/2203036473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a8161690 0x7f07a806fc80 unknown :-1 s=CLOSED pgs=1202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.221+0000 7f07afeaf640 1 --2- 172.21.15.132:0/2203036473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a80cd2d0 0x7f07a80cea10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.221+0000 7f07afeaf640 1 -- 172.21.15.132:0/2203036473 >> 172.21.15.132:0/2203036473 conn(0x7f07a806a050 msgr2=0x7f07a806a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:08.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.221+0000 7f07afeaf640 1 -- 172.21.15.132:0/2203036473 shutdown_connections 2023-12-20T04:48:08.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.221+0000 7f07afeaf640 1 -- 172.21.15.132:0/2203036473 wait complete. 2023-12-20T04:48:08.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.222+0000 7f07afeaf640 1 Processor -- start 2023-12-20T04:48:08.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.222+0000 7f07afeaf640 1 -- start start 2023-12-20T04:48:08.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.223+0000 7f07afeaf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07a80cd2d0 0x7f07a8146500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.223+0000 7f07afeaf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a815d120 0x7f07a815b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.223+0000 7f07afeaf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a8161690 0x7f07a815b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.223+0000 7f07afeaf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a8157ce0 con 0x7f07a815d120 2023-12-20T04:48:08.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.223+0000 7f07afeaf640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a81570d0 con 0x7f07a80cd2d0 2023-12-20T04:48:08.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.223+0000 7f07afeaf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a81573b0 con 0x7f07a8161690 2023-12-20T04:48:08.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.223+0000 7f07ad44a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a815d120 0x7f07a815b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:08.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.223+0000 7f07ad44a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a815d120 0x7f07a815b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44618/0 (socket says 172.21.15.132:44618) 2023-12-20T04:48:08.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.223+0000 7f07ad44a640 1 -- 172.21.15.132:0/3697448564 learned_addr learned my addr 172.21.15.132:0/3697448564 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:08.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.223+0000 7f07adc4b640 1 --2- 172.21.15.132:0/3697448564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07a80cd2d0 0x7f07a8146500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:08.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.223+0000 7f07ae44c640 1 --2- 172.21.15.132:0/3697448564 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a8161690 0x7f07a815b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:08.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.224+0000 7f07ad44a640 1 -- 172.21.15.132:0/3697448564 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a8161690 msgr2=0x7f07a815b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.224+0000 7f07ad44a640 1 --2- 172.21.15.132:0/3697448564 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a8161690 0x7f07a815b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.224+0000 7f07ad44a640 1 -- 172.21.15.132:0/3697448564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07a80cd2d0 msgr2=0x7f07a8146500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.224+0000 7f07ad44a640 1 --2- 172.21.15.132:0/3697448564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07a80cd2d0 0x7f07a8146500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.224+0000 7f07ad44a640 1 -- 172.21.15.132:0/3697448564 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a0009b30 con 0x7f07a815d120 2023-12-20T04:48:08.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.224+0000 7f07adc4b640 1 --2- 172.21.15.132:0/3697448564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07a80cd2d0 0x7f07a8146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:08.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.224+0000 7f07ad44a640 1 --2- 172.21.15.132:0/3697448564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a815d120 0x7f07a815b000 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f079800e870 tx=0x7f079800ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:08.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.224+0000 7f079e7fc640 1 -- 172.21.15.132:0/3697448564 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f07980094f0 con 0x7f07a815d120 2023-12-20T04:48:08.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.224+0000 7f079e7fc640 1 -- 172.21.15.132:0/3697448564 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079800c940 con 0x7f07a815d120 2023-12-20T04:48:08.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.224+0000 7f079e7fc640 1 -- 172.21.15.132:0/3697448564 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079800ccf0 con 0x7f07a815d120 2023-12-20T04:48:08.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.224+0000 7f07afeaf640 1 -- 172.21.15.132:0/3697448564 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a8157690 con 0x7f07a815d120 2023-12-20T04:48:08.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.224+0000 7f07afeaf640 1 -- 172.21.15.132:0/3697448564 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a8156310 con 0x7f07a815d120 2023-12-20T04:48:08.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.225+0000 7f07afeaf640 1 -- 172.21.15.132:0/3697448564 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a8066820 con 0x7f07a815d120 2023-12-20T04:48:08.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.225+0000 7f079e7fc640 1 -- 172.21.15.132:0/3697448564 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0798013470 con 0x7f07a815d120 2023-12-20T04:48:08.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.226+0000 7f079e7fc640 1 --2- 172.21.15.132:0/3697448564 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f078c06a430 0x7f078c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.226+0000 7f079e7fc640 1 -- 172.21.15.132:0/3697448564 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07980889c0 con 0x7f07a815d120 2023-12-20T04:48:08.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.226+0000 7f07adc4b640 1 --2- 172.21.15.132:0/3697448564 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f078c06a430 0x7f078c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:08.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.226+0000 7f07adc4b640 1 --2- 172.21.15.132:0/3697448564 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f078c06a430 0x7f078c06c8f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f07a4007fd0 tx=0x7f07a4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:08.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.230+0000 7f079e7fc640 1 -- 172.21.15.132:0/3697448564 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0798053fb0 con 0x7f07a815d120 2023-12-20T04:48:08.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.394+0000 7f07afeaf640 1 -- 172.21.15.132:0/3697448564 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07a80b1210 con 0x7f078c06a430 2023-12-20T04:48:08.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.401+0000 7f079e7fc640 1 -- 172.21.15.132:0/3697448564 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285691 (secure 0 0 0) 0x7f07a4001c90 con 0x7f078c06a430 2023-12-20T04:48:08.405 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:08.406 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:48:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.404+0000 7f07afeaf640 1 -- 172.21.15.132:0/3697448564 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f078c06a430 msgr2=0x7f078c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.404+0000 7f07afeaf640 1 --2- 172.21.15.132:0/3697448564 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f078c06a430 0x7f078c06c8f0 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f07a4007fd0 tx=0x7f07a4009040 comp rx=0 tx=0).stop 2023-12-20T04:48:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.404+0000 7f07afeaf640 1 -- 172.21.15.132:0/3697448564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a815d120 msgr2=0x7f07a815b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.404+0000 7f07afeaf640 1 --2- 172.21.15.132:0/3697448564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a815d120 0x7f07a815b000 secure :-1 s=READY pgs=1203 cs=0 l=1 rev1=1 crypto rx=0x7f079800e870 tx=0x7f079800ed30 comp rx=0 tx=0).stop 2023-12-20T04:48:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.404+0000 7f07afeaf640 1 -- 172.21.15.132:0/3697448564 shutdown_connections 2023-12-20T04:48:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.404+0000 7f07afeaf640 1 --2- 172.21.15.132:0/3697448564 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f078c06a430 0x7f078c06c8f0 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.404+0000 7f07afeaf640 1 --2- 172.21.15.132:0/3697448564 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a8161690 0x7f07a815b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.404+0000 7f07afeaf640 1 --2- 172.21.15.132:0/3697448564 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a815d120 0x7f07a815b000 unknown :-1 s=CLOSED pgs=1203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.404+0000 7f07afeaf640 1 --2- 172.21.15.132:0/3697448564 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07a80cd2d0 0x7f07a8146500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.405+0000 7f07afeaf640 1 -- 172.21.15.132:0/3697448564 >> 172.21.15.132:0/3697448564 conn(0x7f07a806a050 msgr2=0x7f07a80ccbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:08.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.405+0000 7f07afeaf640 1 -- 172.21.15.132:0/3697448564 shutdown_connections 2023-12-20T04:48:08.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.405+0000 7f07afeaf640 1 -- 172.21.15.132:0/3697448564 wait complete. 2023-12-20T04:48:08.416 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":280,"stamp":"2023-12-20T04:48:08.160862+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":167,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6376,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1556123,"statfs":{"total":1600000000,"available":1593470432,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.050898"},"pg_stats":[{"pgid":"15.3f","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972605+0000","last_change":"2023-12-20T04:48:04.470193+0000","last_active":"2023-12-20T04:48:05.972605+0000","last_peered":"2023-12-20T04:48:05.972605+0000","last_clean":"2023-12-20T04:48:05.972605+0000","last_became_active":"2023-12-20T04:48:04.469960+0000","last_became_peered":"2023-12-20T04:48:04.469960+0000","last_unstale":"2023-12-20T04:48:05.972605+0000","last_undegraded":"2023-12-20T04:48:05.972605+0000","last_fullsized":"2023-12-20T04:48:05.972605+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:41:42.038791+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3e","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462345+0000","last_change":"2023-12-20T04:48:04.469975+0000","last_active":"2023-12-20T04:48:05.462345+0000","last_peered":"2023-12-20T04:48:05.462345+0000","last_clean":"2023-12-20T04:48:05.462345+0000","last_became_active":"2023-12-20T04:48:04.469558+0000","last_became_peered":"2023-12-20T04:48:04.469558+0000","last_unstale":"2023-12-20T04:48:05.462345+0000","last_undegraded":"2023-12-20T04:48:05.462345+0000","last_fullsized":"2023-12-20T04:48:05.462345+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:22:05.002903+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3d","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972561+0000","last_change":"2023-12-20T04:48:04.471311+0000","last_active":"2023-12-20T04:48:05.972561+0000","last_peered":"2023-12-20T04:48:05.972561+0000","last_clean":"2023-12-20T04:48:05.972561+0000","last_became_active":"2023-12-20T04:48:04.471102+0000","last_became_peered":"2023-12-20T04:48:04.471102+0000","last_unstale":"2023-12-20T04:48:05.972561+0000","last_undegraded":"2023-12-20T04:48:05.972561+0000","last_fullsized":"2023-12-20T04:48:05.972561+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:23:45.943142+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.3c","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723109+0000","last_change":"2023-12-20T04:48:04.472555+0000","last_active":"2023-12-20T04:48:05.723109+0000","last_peered":"2023-12-20T04:48:05.723109+0000","last_clean":"2023-12-20T04:48:05.723109+0000","last_became_active":"2023-12-20T04:48:04.472353+0000","last_became_peered":"2023-12-20T04:48:04.472353+0000","last_unstale":"2023-12-20T04:48:05.723109+0000","last_undegraded":"2023-12-20T04:48:05.723109+0000","last_fullsized":"2023-12-20T04:48:05.723109+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:29:37.812575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.3b","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614602+0000","last_change":"2023-12-20T04:48:04.469675+0000","last_active":"2023-12-20T04:48:05.614602+0000","last_peered":"2023-12-20T04:48:05.614602+0000","last_clean":"2023-12-20T04:48:05.614602+0000","last_became_active":"2023-12-20T04:48:04.469436+0000","last_became_peered":"2023-12-20T04:48:04.469436+0000","last_unstale":"2023-12-20T04:48:05.614602+0000","last_undegraded":"2023-12-20T04:48:05.614602+0000","last_fullsized":"2023-12-20T04:48:05.614602+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:19:37.392440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.3a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614907+0000","last_change":"2023-12-20T04:48:04.473138+0000","last_active":"2023-12-20T04:48:05.614907+0000","last_peered":"2023-12-20T04:48:05.614907+0000","last_clean":"2023-12-20T04:48:05.614907+0000","last_became_active":"2023-12-20T04:48:04.472290+0000","last_became_peered":"2023-12-20T04:48:04.472290+0000","last_unstale":"2023-12-20T04:48:05.614907+0000","last_undegraded":"2023-12-20T04:48:05.614907+0000","last_fullsized":"2023-12-20T04:48:05.614907+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:00:02.350668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.39","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614801+0000","last_change":"2023-12-20T04:48:04.469019+0000","last_active":"2023-12-20T04:48:05.614801+0000","last_peered":"2023-12-20T04:48:05.614801+0000","last_clean":"2023-12-20T04:48:05.614801+0000","last_became_active":"2023-12-20T04:48:04.468636+0000","last_became_peered":"2023-12-20T04:48:04.468636+0000","last_unstale":"2023-12-20T04:48:05.614801+0000","last_undegraded":"2023-12-20T04:48:05.614801+0000","last_fullsized":"2023-12-20T04:48:05.614801+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:56:02.738711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.38","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462260+0000","last_change":"2023-12-20T04:48:04.468161+0000","last_active":"2023-12-20T04:48:05.462260+0000","last_peered":"2023-12-20T04:48:05.462260+0000","last_clean":"2023-12-20T04:48:05.462260+0000","last_became_active":"2023-12-20T04:48:04.467041+0000","last_became_peered":"2023-12-20T04:48:04.467041+0000","last_unstale":"2023-12-20T04:48:05.462260+0000","last_undegraded":"2023-12-20T04:48:05.462260+0000","last_fullsized":"2023-12-20T04:48:05.462260+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:18:51.782612+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.37","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462461+0000","last_change":"2023-12-20T04:48:04.473845+0000","last_active":"2023-12-20T04:48:05.462461+0000","last_peered":"2023-12-20T04:48:05.462461+0000","last_clean":"2023-12-20T04:48:05.462461+0000","last_became_active":"2023-12-20T04:48:04.473614+0000","last_became_peered":"2023-12-20T04:48:04.473614+0000","last_unstale":"2023-12-20T04:48:05.462461+0000","last_undegraded":"2023-12-20T04:48:05.462461+0000","last_fullsized":"2023-12-20T04:48:05.462461+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:29:37.812575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.36","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614715+0000","last_change":"2023-12-20T04:48:04.472700+0000","last_active":"2023-12-20T04:48:05.614715+0000","last_peered":"2023-12-20T04:48:05.614715+0000","last_clean":"2023-12-20T04:48:05.614715+0000","last_became_active":"2023-12-20T04:48:04.472251+0000","last_became_peered":"2023-12-20T04:48:04.472251+0000","last_unstale":"2023-12-20T04:48:05.614715+0000","last_undegraded":"2023-12-20T04:48:05.614715+0000","last_fullsized":"2023-12-20T04:48:05.614715+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:54:22.755243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.35","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.615007+0000","last_change":"2023-12-20T04:48:04.472866+0000","last_active":"2023-12-20T04:48:05.615007+0000","last_peered":"2023-12-20T04:48:05.615007+0000","last_clean":"2023-12-20T04:48:05.615007+0000","last_became_active":"2023-12-20T04:48:04.471756+0000","last_became_peered":"2023-12-20T04:48:04.471756+0000","last_unstale":"2023-12-20T04:48:05.615007+0000","last_undegraded":"2023-12-20T04:48:05.615007+0000","last_fullsized":"2023-12-20T04:48:05.615007+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:20:12.320261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.34","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.463001+0000","last_change":"2023-12-20T04:48:04.461593+0000","last_active":"2023-12-20T04:48:05.463001+0000","last_peered":"2023-12-20T04:48:05.463001+0000","last_clean":"2023-12-20T04:48:05.463001+0000","last_became_active":"2023-12-20T04:48:04.461387+0000","last_became_peered":"2023-12-20T04:48:04.461387+0000","last_unstale":"2023-12-20T04:48:05.463001+0000","last_undegraded":"2023-12-20T04:48:05.463001+0000","last_fullsized":"2023-12-20T04:48:05.463001+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:39:30.603069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.33","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723141+0000","last_change":"2023-12-20T04:48:04.468264+0000","last_active":"2023-12-20T04:48:05.723141+0000","last_peered":"2023-12-20T04:48:05.723141+0000","last_clean":"2023-12-20T04:48:05.723141+0000","last_became_active":"2023-12-20T04:48:04.468049+0000","last_became_peered":"2023-12-20T04:48:04.468049+0000","last_unstale":"2023-12-20T04:48:05.723141+0000","last_undegraded":"2023-12-20T04:48:05.723141+0000","last_fullsized":"2023-12-20T04:48:05.723141+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:17:26.742618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.32","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.613826+0000","last_change":"2023-12-20T04:48:04.472244+0000","last_active":"2023-12-20T04:48:05.613826+0000","last_peered":"2023-12-20T04:48:05.613826+0000","last_clean":"2023-12-20T04:48:05.613826+0000","last_became_active":"2023-12-20T04:48:04.470915+0000","last_became_peered":"2023-12-20T04:48:04.470915+0000","last_unstale":"2023-12-20T04:48:05.613826+0000","last_undegraded":"2023-12-20T04:48:05.613826+0000","last_fullsized":"2023-12-20T04:48:05.613826+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:49:31.357423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.31","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723279+0000","last_change":"2023-12-20T04:48:04.471255+0000","last_active":"2023-12-20T04:48:05.723279+0000","last_peered":"2023-12-20T04:48:05.723279+0000","last_clean":"2023-12-20T04:48:05.723279+0000","last_became_active":"2023-12-20T04:48:04.470749+0000","last_became_peered":"2023-12-20T04:48:04.470749+0000","last_unstale":"2023-12-20T04:48:05.723279+0000","last_undegraded":"2023-12-20T04:48:05.723279+0000","last_fullsized":"2023-12-20T04:48:05.723279+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:22:12.152872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.30","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.615092+0000","last_change":"2023-12-20T04:48:04.475787+0000","last_active":"2023-12-20T04:48:05.615092+0000","last_peered":"2023-12-20T04:48:05.615092+0000","last_clean":"2023-12-20T04:48:05.615092+0000","last_became_active":"2023-12-20T04:48:04.475567+0000","last_became_peered":"2023-12-20T04:48:04.475567+0000","last_unstale":"2023-12-20T04:48:05.615092+0000","last_undegraded":"2023-12-20T04:48:05.615092+0000","last_fullsized":"2023-12-20T04:48:05.615092+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:17:26.742618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.2f","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462436+0000","last_change":"2023-12-20T04:48:04.467243+0000","last_active":"2023-12-20T04:48:05.462436+0000","last_peered":"2023-12-20T04:48:05.462436+0000","last_clean":"2023-12-20T04:48:05.462436+0000","last_became_active":"2023-12-20T04:48:04.467015+0000","last_became_peered":"2023-12-20T04:48:04.467015+0000","last_unstale":"2023-12-20T04:48:05.462436+0000","last_undegraded":"2023-12-20T04:48:05.462436+0000","last_fullsized":"2023-12-20T04:48:05.462436+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:50:40.717560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.2e","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723209+0000","last_change":"2023-12-20T04:48:04.466092+0000","last_active":"2023-12-20T04:48:05.723209+0000","last_peered":"2023-12-20T04:48:05.723209+0000","last_clean":"2023-12-20T04:48:05.723209+0000","last_became_active":"2023-12-20T04:48:04.465548+0000","last_became_peered":"2023-12-20T04:48:04.465548+0000","last_unstale":"2023-12-20T04:48:05.723209+0000","last_undegraded":"2023-12-20T04:48:05.723209+0000","last_fullsized":"2023-12-20T04:48:05.723209+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:39:46.431943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.2d","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.613926+0000","last_change":"2023-12-20T04:48:04.472631+0000","last_active":"2023-12-20T04:48:05.613926+0000","last_peered":"2023-12-20T04:48:05.613926+0000","last_clean":"2023-12-20T04:48:05.613926+0000","last_became_active":"2023-12-20T04:48:04.471791+0000","last_became_peered":"2023-12-20T04:48:04.471791+0000","last_unstale":"2023-12-20T04:48:05.613926+0000","last_undegraded":"2023-12-20T04:48:05.613926+0000","last_fullsized":"2023-12-20T04:48:05.613926+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:06:41.310616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2c","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462649+0000","last_change":"2023-12-20T04:48:04.473024+0000","last_active":"2023-12-20T04:48:05.462649+0000","last_peered":"2023-12-20T04:48:05.462649+0000","last_clean":"2023-12-20T04:48:05.462649+0000","last_became_active":"2023-12-20T04:48:04.472811+0000","last_became_peered":"2023-12-20T04:48:04.472811+0000","last_unstale":"2023-12-20T04:48:05.462649+0000","last_undegraded":"2023-12-20T04:48:05.462649+0000","last_fullsized":"2023-12-20T04:48:05.462649+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:10:14.757866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.2b","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.613861+0000","last_change":"2023-12-20T04:48:04.470153+0000","last_active":"2023-12-20T04:48:05.613861+0000","last_peered":"2023-12-20T04:48:05.613861+0000","last_clean":"2023-12-20T04:48:05.613861+0000","last_became_active":"2023-12-20T04:48:04.468731+0000","last_became_peered":"2023-12-20T04:48:04.468731+0000","last_unstale":"2023-12-20T04:48:05.613861+0000","last_undegraded":"2023-12-20T04:48:05.613861+0000","last_fullsized":"2023-12-20T04:48:05.613861+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:02:20.446691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.2a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462572+0000","last_change":"2023-12-20T04:48:04.469795+0000","last_active":"2023-12-20T04:48:05.462572+0000","last_peered":"2023-12-20T04:48:05.462572+0000","last_clean":"2023-12-20T04:48:05.462572+0000","last_became_active":"2023-12-20T04:48:04.468579+0000","last_became_peered":"2023-12-20T04:48:04.468579+0000","last_unstale":"2023-12-20T04:48:05.462572+0000","last_undegraded":"2023-12-20T04:48:05.462572+0000","last_fullsized":"2023-12-20T04:48:05.462572+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:32:11.734476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.29","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462334+0000","last_change":"2023-12-20T04:48:04.472823+0000","last_active":"2023-12-20T04:48:05.462334+0000","last_peered":"2023-12-20T04:48:05.462334+0000","last_clean":"2023-12-20T04:48:05.462334+0000","last_became_active":"2023-12-20T04:48:04.471766+0000","last_became_peered":"2023-12-20T04:48:04.471766+0000","last_unstale":"2023-12-20T04:48:05.462334+0000","last_undegraded":"2023-12-20T04:48:05.462334+0000","last_fullsized":"2023-12-20T04:48:05.462334+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:26:33.636009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.28","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614385+0000","last_change":"2023-12-20T04:48:04.470362+0000","last_active":"2023-12-20T04:48:05.614385+0000","last_peered":"2023-12-20T04:48:05.614385+0000","last_clean":"2023-12-20T04:48:05.614385+0000","last_became_active":"2023-12-20T04:48:04.470131+0000","last_became_peered":"2023-12-20T04:48:04.470131+0000","last_unstale":"2023-12-20T04:48:05.614385+0000","last_undegraded":"2023-12-20T04:48:05.614385+0000","last_fullsized":"2023-12-20T04:48:05.614385+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:10:14.757866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.27","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614810+0000","last_change":"2023-12-20T04:48:04.465997+0000","last_active":"2023-12-20T04:48:05.614810+0000","last_peered":"2023-12-20T04:48:05.614810+0000","last_clean":"2023-12-20T04:48:05.614810+0000","last_became_active":"2023-12-20T04:48:04.465514+0000","last_became_peered":"2023-12-20T04:48:04.465514+0000","last_unstale":"2023-12-20T04:48:05.614810+0000","last_undegraded":"2023-12-20T04:48:05.614810+0000","last_fullsized":"2023-12-20T04:48:05.614810+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:59.497404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.26","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462403+0000","last_change":"2023-12-20T04:48:04.463093+0000","last_active":"2023-12-20T04:48:05.462403+0000","last_peered":"2023-12-20T04:48:05.462403+0000","last_clean":"2023-12-20T04:48:05.462403+0000","last_became_active":"2023-12-20T04:48:04.462898+0000","last_became_peered":"2023-12-20T04:48:04.462898+0000","last_unstale":"2023-12-20T04:48:05.462403+0000","last_undegraded":"2023-12-20T04:48:05.462403+0000","last_fullsized":"2023-12-20T04:48:05.462403+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:49:15.275874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.25","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614873+0000","last_change":"2023-12-20T04:48:04.465505+0000","last_active":"2023-12-20T04:48:05.614873+0000","last_peered":"2023-12-20T04:48:05.614873+0000","last_clean":"2023-12-20T04:48:05.614873+0000","last_became_active":"2023-12-20T04:48:04.465266+0000","last_became_peered":"2023-12-20T04:48:04.465266+0000","last_unstale":"2023-12-20T04:48:05.614873+0000","last_undegraded":"2023-12-20T04:48:05.614873+0000","last_fullsized":"2023-12-20T04:48:05.614873+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:29:37.812575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.24","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614475+0000","last_change":"2023-12-20T04:48:04.470738+0000","last_active":"2023-12-20T04:48:05.614475+0000","last_peered":"2023-12-20T04:48:05.614475+0000","last_clean":"2023-12-20T04:48:05.614475+0000","last_became_active":"2023-12-20T04:48:04.470330+0000","last_became_peered":"2023-12-20T04:48:04.470330+0000","last_unstale":"2023-12-20T04:48:05.614475+0000","last_undegraded":"2023-12-20T04:48:05.614475+0000","last_fullsized":"2023-12-20T04:48:05.614475+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:54:53.740300+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.23","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462266+0000","last_change":"2023-12-20T04:48:04.462684+0000","last_active":"2023-12-20T04:48:05.462266+0000","last_peered":"2023-12-20T04:48:05.462266+0000","last_clean":"2023-12-20T04:48:05.462266+0000","last_became_active":"2023-12-20T04:48:04.462484+0000","last_became_peered":"2023-12-20T04:48:04.462484+0000","last_unstale":"2023-12-20T04:48:05.462266+0000","last_undegraded":"2023-12-20T04:48:05.462266+0000","last_fullsized":"2023-12-20T04:48:05.462266+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:54:22.755243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.22","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614071+0000","last_change":"2023-12-20T04:48:04.471044+0000","last_active":"2023-12-20T04:48:05.614071+0000","last_peered":"2023-12-20T04:48:05.614071+0000","last_clean":"2023-12-20T04:48:05.614071+0000","last_became_active":"2023-12-20T04:48:04.470699+0000","last_became_peered":"2023-12-20T04:48:04.470699+0000","last_unstale":"2023-12-20T04:48:05.614071+0000","last_undegraded":"2023-12-20T04:48:05.614071+0000","last_fullsized":"2023-12-20T04:48:05.614071+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:23:05.958927+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.21","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723248+0000","last_change":"2023-12-20T04:48:04.469960+0000","last_active":"2023-12-20T04:48:05.723248+0000","last_peered":"2023-12-20T04:48:05.723248+0000","last_clean":"2023-12-20T04:48:05.723248+0000","last_became_active":"2023-12-20T04:48:04.469744+0000","last_became_peered":"2023-12-20T04:48:04.469744+0000","last_unstale":"2023-12-20T04:48:05.723248+0000","last_undegraded":"2023-12-20T04:48:05.723248+0000","last_fullsized":"2023-12-20T04:48:05.723248+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:00:02.350668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.20","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972655+0000","last_change":"2023-12-20T04:48:04.465787+0000","last_active":"2023-12-20T04:48:05.972655+0000","last_peered":"2023-12-20T04:48:05.972655+0000","last_clean":"2023-12-20T04:48:05.972655+0000","last_became_active":"2023-12-20T04:48:04.465343+0000","last_became_peered":"2023-12-20T04:48:04.465343+0000","last_unstale":"2023-12-20T04:48:05.972655+0000","last_undegraded":"2023-12-20T04:48:05.972655+0000","last_fullsized":"2023-12-20T04:48:05.972655+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:56:42.348204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1e","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614018+0000","last_change":"2023-12-20T04:48:04.472106+0000","last_active":"2023-12-20T04:48:05.614018+0000","last_peered":"2023-12-20T04:48:05.614018+0000","last_clean":"2023-12-20T04:48:05.614018+0000","last_became_active":"2023-12-20T04:48:04.470537+0000","last_became_peered":"2023-12-20T04:48:04.470537+0000","last_unstale":"2023-12-20T04:48:05.614018+0000","last_undegraded":"2023-12-20T04:48:05.614018+0000","last_fullsized":"2023-12-20T04:48:05.614018+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:36:02.503928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1f","version":"121'4","reported_seq":15,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462496+0000","last_change":"2023-12-20T04:48:04.116197+0000","last_active":"2023-12-20T04:48:05.462496+0000","last_peered":"2023-12-20T04:48:05.462496+0000","last_clean":"2023-12-20T04:48:05.462496+0000","last_became_active":"2023-12-20T04:48:04.115438+0000","last_became_peered":"2023-12-20T04:48:04.115438+0000","last_unstale":"2023-12-20T04:48:05.462496+0000","last_undegraded":"2023-12-20T04:48:05.462496+0000","last_fullsized":"2023-12-20T04:48:05.462496+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:56:01.734412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1f","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723265+0000","last_change":"2023-12-20T04:48:04.469237+0000","last_active":"2023-12-20T04:48:05.723265+0000","last_peered":"2023-12-20T04:48:05.723265+0000","last_clean":"2023-12-20T04:48:05.723265+0000","last_became_active":"2023-12-20T04:48:04.469015+0000","last_became_peered":"2023-12-20T04:48:04.469015+0000","last_unstale":"2023-12-20T04:48:05.723265+0000","last_undegraded":"2023-12-20T04:48:05.723265+0000","last_fullsized":"2023-12-20T04:48:05.723265+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:20:12.320261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.1e","version":"121'1","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614474+0000","last_change":"2023-12-20T04:48:04.119117+0000","last_active":"2023-12-20T04:48:05.614474+0000","last_peered":"2023-12-20T04:48:05.614474+0000","last_clean":"2023-12-20T04:48:05.614474+0000","last_became_active":"2023-12-20T04:48:04.118793+0000","last_became_peered":"2023-12-20T04:48:04.118793+0000","last_unstale":"2023-12-20T04:48:05.614474+0000","last_undegraded":"2023-12-20T04:48:05.614474+0000","last_fullsized":"2023-12-20T04:48:05.614474+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:42:25.004520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.1c","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972895+0000","last_change":"2023-12-20T04:48:04.462454+0000","last_active":"2023-12-20T04:48:05.972895+0000","last_peered":"2023-12-20T04:48:05.972895+0000","last_clean":"2023-12-20T04:48:05.972895+0000","last_became_active":"2023-12-20T04:48:04.462240+0000","last_became_peered":"2023-12-20T04:48:04.462240+0000","last_unstale":"2023-12-20T04:48:05.972895+0000","last_undegraded":"2023-12-20T04:48:05.972895+0000","last_fullsized":"2023-12-20T04:48:05.972895+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:20:53.834334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.1d","version":"121'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462436+0000","last_change":"2023-12-20T04:48:04.123295+0000","last_active":"2023-12-20T04:48:05.462436+0000","last_peered":"2023-12-20T04:48:05.462436+0000","last_clean":"2023-12-20T04:48:05.462436+0000","last_became_active":"2023-12-20T04:48:04.123033+0000","last_became_peered":"2023-12-20T04:48:04.123033+0000","last_unstale":"2023-12-20T04:48:05.462436+0000","last_undegraded":"2023-12-20T04:48:05.462436+0000","last_fullsized":"2023-12-20T04:48:05.462436+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:22:11.148574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1d","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462763+0000","last_change":"2023-12-20T04:48:04.468555+0000","last_active":"2023-12-20T04:48:05.462763+0000","last_peered":"2023-12-20T04:48:05.462763+0000","last_clean":"2023-12-20T04:48:05.462763+0000","last_became_active":"2023-12-20T04:48:04.468271+0000","last_became_peered":"2023-12-20T04:48:04.468271+0000","last_unstale":"2023-12-20T04:48:05.462763+0000","last_undegraded":"2023-12-20T04:48:05.462763+0000","last_fullsized":"2023-12-20T04:48:05.462763+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:23:12.739173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.1c","version":"121'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462497+0000","last_change":"2023-12-20T04:48:04.116926+0000","last_active":"2023-12-20T04:48:05.462497+0000","last_peered":"2023-12-20T04:48:05.462497+0000","last_clean":"2023-12-20T04:48:05.462497+0000","last_became_active":"2023-12-20T04:48:04.116270+0000","last_became_peered":"2023-12-20T04:48:04.116270+0000","last_unstale":"2023-12-20T04:48:05.462497+0000","last_undegraded":"2023-12-20T04:48:05.462497+0000","last_fullsized":"2023-12-20T04:48:05.462497+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:10:13.753568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.1a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.461986+0000","last_change":"2023-12-20T04:48:04.474420+0000","last_active":"2023-12-20T04:48:05.461986+0000","last_peered":"2023-12-20T04:48:05.461986+0000","last_clean":"2023-12-20T04:48:05.461986+0000","last_became_active":"2023-12-20T04:48:04.474058+0000","last_became_peered":"2023-12-20T04:48:04.474058+0000","last_unstale":"2023-12-20T04:48:05.461986+0000","last_undegraded":"2023-12-20T04:48:05.461986+0000","last_fullsized":"2023-12-20T04:48:05.461986+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:54:50.124497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.1b","version":"121'1","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972837+0000","last_change":"2023-12-20T04:48:04.117333+0000","last_active":"2023-12-20T04:48:05.972837+0000","last_peered":"2023-12-20T04:48:05.972837+0000","last_clean":"2023-12-20T04:48:05.972837+0000","last_became_active":"2023-12-20T04:48:04.117057+0000","last_became_peered":"2023-12-20T04:48:04.117057+0000","last_unstale":"2023-12-20T04:48:05.972837+0000","last_undegraded":"2023-12-20T04:48:05.972837+0000","last_fullsized":"2023-12-20T04:48:05.972837+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:35:52.033049+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.1b","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614930+0000","last_change":"2023-12-20T04:48:04.468866+0000","last_active":"2023-12-20T04:48:05.614930+0000","last_peered":"2023-12-20T04:48:05.614930+0000","last_clean":"2023-12-20T04:48:05.614930+0000","last_became_active":"2023-12-20T04:48:04.468328+0000","last_became_peered":"2023-12-20T04:48:04.468328+0000","last_unstale":"2023-12-20T04:48:05.614930+0000","last_undegraded":"2023-12-20T04:48:05.614930+0000","last_fullsized":"2023-12-20T04:48:05.614930+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:46:46.191407+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.1a","version":"121'1","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462546+0000","last_change":"2023-12-20T04:48:04.115663+0000","last_active":"2023-12-20T04:48:05.462546+0000","last_peered":"2023-12-20T04:48:05.462546+0000","last_clean":"2023-12-20T04:48:05.462546+0000","last_became_active":"2023-12-20T04:48:04.114411+0000","last_became_peered":"2023-12-20T04:48:04.114411+0000","last_unstale":"2023-12-20T04:48:05.462546+0000","last_undegraded":"2023-12-20T04:48:05.462546+0000","last_fullsized":"2023-12-20T04:48:05.462546+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:46:45.187109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.18","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723353+0000","last_change":"2023-12-20T04:48:04.471415+0000","last_active":"2023-12-20T04:48:05.723353+0000","last_peered":"2023-12-20T04:48:05.723353+0000","last_clean":"2023-12-20T04:48:05.723353+0000","last_became_active":"2023-12-20T04:48:04.471041+0000","last_became_peered":"2023-12-20T04:48:04.471041+0000","last_unstale":"2023-12-20T04:48:05.723353+0000","last_undegraded":"2023-12-20T04:48:05.723353+0000","last_fullsized":"2023-12-20T04:48:05.723353+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:58:47.794784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.19","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614761+0000","last_change":"2023-12-20T04:48:04.117343+0000","last_active":"2023-12-20T04:48:05.614761+0000","last_peered":"2023-12-20T04:48:05.614761+0000","last_clean":"2023-12-20T04:48:05.614761+0000","last_became_active":"2023-12-20T04:48:04.116886+0000","last_became_peered":"2023-12-20T04:48:04.116886+0000","last_unstale":"2023-12-20T04:48:05.614761+0000","last_undegraded":"2023-12-20T04:48:05.614761+0000","last_fullsized":"2023-12-20T04:48:05.614761+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:41:41.034492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.19","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462573+0000","last_change":"2023-12-20T04:48:04.473183+0000","last_active":"2023-12-20T04:48:05.462573+0000","last_peered":"2023-12-20T04:48:05.462573+0000","last_clean":"2023-12-20T04:48:05.462573+0000","last_became_active":"2023-12-20T04:48:04.472915+0000","last_became_peered":"2023-12-20T04:48:04.472915+0000","last_unstale":"2023-12-20T04:48:05.462573+0000","last_undegraded":"2023-12-20T04:48:05.462573+0000","last_fullsized":"2023-12-20T04:48:05.462573+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:22:12.152872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.18","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.973049+0000","last_change":"2023-12-20T04:48:04.114906+0000","last_active":"2023-12-20T04:48:05.973049+0000","last_peered":"2023-12-20T04:48:05.973049+0000","last_clean":"2023-12-20T04:48:05.973049+0000","last_became_active":"2023-12-20T04:48:04.114679+0000","last_became_peered":"2023-12-20T04:48:04.114679+0000","last_unstale":"2023-12-20T04:48:05.973049+0000","last_undegraded":"2023-12-20T04:48:05.973049+0000","last_fullsized":"2023-12-20T04:48:05.973049+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:07:37.214668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.16","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462650+0000","last_change":"2023-12-20T04:48:04.463700+0000","last_active":"2023-12-20T04:48:05.462650+0000","last_peered":"2023-12-20T04:48:05.462650+0000","last_clean":"2023-12-20T04:48:05.462650+0000","last_became_active":"2023-12-20T04:48:04.463502+0000","last_became_peered":"2023-12-20T04:48:04.463502+0000","last_unstale":"2023-12-20T04:48:05.462650+0000","last_undegraded":"2023-12-20T04:48:05.462650+0000","last_fullsized":"2023-12-20T04:48:05.462650+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:05:37.178776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.17","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972830+0000","last_change":"2023-12-20T04:48:04.123179+0000","last_active":"2023-12-20T04:48:05.972830+0000","last_peered":"2023-12-20T04:48:05.972830+0000","last_clean":"2023-12-20T04:48:05.972830+0000","last_became_active":"2023-12-20T04:48:04.122683+0000","last_became_peered":"2023-12-20T04:48:04.122683+0000","last_unstale":"2023-12-20T04:48:05.972830+0000","last_undegraded":"2023-12-20T04:48:05.972830+0000","last_fullsized":"2023-12-20T04:48:05.972830+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:42:54.492598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.17","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462902+0000","last_change":"2023-12-20T04:48:04.468288+0000","last_active":"2023-12-20T04:48:05.462902+0000","last_peered":"2023-12-20T04:48:05.462902+0000","last_clean":"2023-12-20T04:48:05.462902+0000","last_became_active":"2023-12-20T04:48:04.468044+0000","last_became_peered":"2023-12-20T04:48:04.468044+0000","last_unstale":"2023-12-20T04:48:05.462902+0000","last_undegraded":"2023-12-20T04:48:05.462902+0000","last_fullsized":"2023-12-20T04:48:05.462902+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:20:12.320261+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.16","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723165+0000","last_change":"2023-12-20T04:48:04.115678+0000","last_active":"2023-12-20T04:48:05.723165+0000","last_peered":"2023-12-20T04:48:05.723165+0000","last_clean":"2023-12-20T04:48:05.723165+0000","last_became_active":"2023-12-20T04:48:04.115435+0000","last_became_peered":"2023-12-20T04:48:04.115435+0000","last_unstale":"2023-12-20T04:48:05.723165+0000","last_undegraded":"2023-12-20T04:48:05.723165+0000","last_fullsized":"2023-12-20T04:48:05.723165+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:14:55.438681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.14","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614376+0000","last_change":"2023-12-20T04:48:04.471213+0000","last_active":"2023-12-20T04:48:05.614376+0000","last_peered":"2023-12-20T04:48:05.614376+0000","last_clean":"2023-12-20T04:48:05.614376+0000","last_became_active":"2023-12-20T04:48:04.470972+0000","last_became_peered":"2023-12-20T04:48:04.470972+0000","last_unstale":"2023-12-20T04:48:05.614376+0000","last_undegraded":"2023-12-20T04:48:05.614376+0000","last_fullsized":"2023-12-20T04:48:05.614376+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:02:45.514616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.15","version":"121'3","reported_seq":14,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614551+0000","last_change":"2023-12-20T04:48:04.119891+0000","last_active":"2023-12-20T04:48:05.614551+0000","last_peered":"2023-12-20T04:48:05.614551+0000","last_clean":"2023-12-20T04:48:05.614551+0000","last_became_active":"2023-12-20T04:48:04.119669+0000","last_became_peered":"2023-12-20T04:48:04.119669+0000","last_unstale":"2023-12-20T04:48:05.614551+0000","last_undegraded":"2023-12-20T04:48:05.614551+0000","last_fullsized":"2023-12-20T04:48:05.614551+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:20:52.830035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"15.15","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614400+0000","last_change":"2023-12-20T04:48:04.469504+0000","last_active":"2023-12-20T04:48:05.614400+0000","last_peered":"2023-12-20T04:48:05.614400+0000","last_clean":"2023-12-20T04:48:05.614400+0000","last_became_active":"2023-12-20T04:48:04.469168+0000","last_became_peered":"2023-12-20T04:48:04.469168+0000","last_unstale":"2023-12-20T04:48:05.614400+0000","last_undegraded":"2023-12-20T04:48:05.614400+0000","last_fullsized":"2023-12-20T04:48:05.614400+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:39:46.431943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.14","version":"121'6","reported_seq":17,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462815+0000","last_change":"2023-12-20T04:48:04.116538+0000","last_active":"2023-12-20T04:48:05.462815+0000","last_peered":"2023-12-20T04:48:05.462815+0000","last_clean":"2023-12-20T04:48:05.462815+0000","last_became_active":"2023-12-20T04:48:04.116336+0000","last_became_peered":"2023-12-20T04:48:04.116336+0000","last_unstale":"2023-12-20T04:48:05.462815+0000","last_undegraded":"2023-12-20T04:48:05.462815+0000","last_fullsized":"2023-12-20T04:48:05.462815+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:20:52.830035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.12","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723094+0000","last_change":"2023-12-20T04:48:04.474352+0000","last_active":"2023-12-20T04:48:05.723094+0000","last_peered":"2023-12-20T04:48:05.723094+0000","last_clean":"2023-12-20T04:48:05.723094+0000","last_became_active":"2023-12-20T04:48:04.474123+0000","last_became_peered":"2023-12-20T04:48:04.474123+0000","last_unstale":"2023-12-20T04:48:05.723094+0000","last_undegraded":"2023-12-20T04:48:05.723094+0000","last_fullsized":"2023-12-20T04:48:05.723094+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:51:37.554534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"14.13","version":"121'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614160+0000","last_change":"2023-12-20T04:48:04.122195+0000","last_active":"2023-12-20T04:48:05.614160+0000","last_peered":"2023-12-20T04:48:05.614160+0000","last_clean":"2023-12-20T04:48:05.614160+0000","last_became_active":"2023-12-20T04:48:04.121857+0000","last_became_peered":"2023-12-20T04:48:04.121857+0000","last_unstale":"2023-12-20T04:48:05.614160+0000","last_undegraded":"2023-12-20T04:48:05.614160+0000","last_fullsized":"2023-12-20T04:48:05.614160+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:39:19.005423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.13","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972961+0000","last_change":"2023-12-20T04:48:04.469564+0000","last_active":"2023-12-20T04:48:05.972961+0000","last_peered":"2023-12-20T04:48:05.972961+0000","last_clean":"2023-12-20T04:48:05.972961+0000","last_became_active":"2023-12-20T04:48:04.469370+0000","last_became_peered":"2023-12-20T04:48:04.469370+0000","last_unstale":"2023-12-20T04:48:05.972961+0000","last_undegraded":"2023-12-20T04:48:05.972961+0000","last_fullsized":"2023-12-20T04:48:05.972961+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:31:36.283158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.12","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614034+0000","last_change":"2023-12-20T04:48:04.123900+0000","last_active":"2023-12-20T04:48:05.614034+0000","last_peered":"2023-12-20T04:48:05.614034+0000","last_clean":"2023-12-20T04:48:05.614034+0000","last_became_active":"2023-12-20T04:48:04.123661+0000","last_became_peered":"2023-12-20T04:48:04.123661+0000","last_unstale":"2023-12-20T04:48:05.614034+0000","last_undegraded":"2023-12-20T04:48:05.614034+0000","last_fullsized":"2023-12-20T04:48:05.614034+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:43:27.633118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.10","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462733+0000","last_change":"2023-12-20T04:48:04.470646+0000","last_active":"2023-12-20T04:48:05.462733+0000","last_peered":"2023-12-20T04:48:05.462733+0000","last_clean":"2023-12-20T04:48:05.462733+0000","last_became_active":"2023-12-20T04:48:04.469517+0000","last_became_peered":"2023-12-20T04:48:04.469517+0000","last_unstale":"2023-12-20T04:48:05.462733+0000","last_undegraded":"2023-12-20T04:48:05.462733+0000","last_fullsized":"2023-12-20T04:48:05.462733+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:56:02.738711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.11","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.463081+0000","last_change":"2023-12-20T04:48:04.115845+0000","last_active":"2023-12-20T04:48:05.463081+0000","last_peered":"2023-12-20T04:48:05.463081+0000","last_clean":"2023-12-20T04:48:05.463081+0000","last_became_active":"2023-12-20T04:48:04.115612+0000","last_became_peered":"2023-12-20T04:48:04.115612+0000","last_unstale":"2023-12-20T04:48:05.463081+0000","last_undegraded":"2023-12-20T04:48:05.463081+0000","last_fullsized":"2023-12-20T04:48:05.463081+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:49:21.832343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.11","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.613941+0000","last_change":"2023-12-20T04:48:04.467464+0000","last_active":"2023-12-20T04:48:05.613941+0000","last_peered":"2023-12-20T04:48:05.613941+0000","last_clean":"2023-12-20T04:48:05.613941+0000","last_became_active":"2023-12-20T04:48:04.467269+0000","last_became_peered":"2023-12-20T04:48:04.467269+0000","last_unstale":"2023-12-20T04:48:05.613941+0000","last_undegraded":"2023-12-20T04:48:05.613941+0000","last_fullsized":"2023-12-20T04:48:05.613941+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:13:37.713642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.10","version":"121'8","reported_seq":19,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972742+0000","last_change":"2023-12-20T04:48:04.118966+0000","last_active":"2023-12-20T04:48:05.972742+0000","last_peered":"2023-12-20T04:48:05.972742+0000","last_clean":"2023-12-20T04:48:05.972742+0000","last_became_active":"2023-12-20T04:48:04.118708+0000","last_became_peered":"2023-12-20T04:48:04.118708+0000","last_unstale":"2023-12-20T04:48:05.972742+0000","last_undegraded":"2023-12-20T04:48:05.972742+0000","last_fullsized":"2023-12-20T04:48:05.972742+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:28.762689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"15.f","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614474+0000","last_change":"2023-12-20T04:48:04.469780+0000","last_active":"2023-12-20T04:48:05.614474+0000","last_peered":"2023-12-20T04:48:05.614474+0000","last_clean":"2023-12-20T04:48:05.614474+0000","last_became_active":"2023-12-20T04:48:04.467749+0000","last_became_peered":"2023-12-20T04:48:04.467749+0000","last_unstale":"2023-12-20T04:48:05.614474+0000","last_undegraded":"2023-12-20T04:48:05.614474+0000","last_fullsized":"2023-12-20T04:48:05.614474+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:49:15.275874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.e","version":"121'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462871+0000","last_change":"2023-12-20T04:48:04.121158+0000","last_active":"2023-12-20T04:48:05.462871+0000","last_peered":"2023-12-20T04:48:05.462871+0000","last_clean":"2023-12-20T04:48:05.462871+0000","last_became_active":"2023-12-20T04:48:04.120926+0000","last_became_peered":"2023-12-20T04:48:04.120926+0000","last_unstale":"2023-12-20T04:48:05.462871+0000","last_undegraded":"2023-12-20T04:48:05.462871+0000","last_fullsized":"2023-12-20T04:48:05.462871+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:17:29.322846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"15.c","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462078+0000","last_change":"2023-12-20T04:48:04.467385+0000","last_active":"2023-12-20T04:48:05.462078+0000","last_peered":"2023-12-20T04:48:05.462078+0000","last_clean":"2023-12-20T04:48:05.462078+0000","last_became_active":"2023-12-20T04:48:04.466713+0000","last_became_peered":"2023-12-20T04:48:04.466713+0000","last_unstale":"2023-12-20T04:48:05.462078+0000","last_undegraded":"2023-12-20T04:48:05.462078+0000","last_fullsized":"2023-12-20T04:48:05.462078+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:12:47.759423+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"14.d","version":"121'1","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614613+0000","last_change":"2023-12-20T04:48:04.120801+0000","last_active":"2023-12-20T04:48:05.614613+0000","last_peered":"2023-12-20T04:48:05.614613+0000","last_clean":"2023-12-20T04:48:05.614613+0000","last_became_active":"2023-12-20T04:48:04.120538+0000","last_became_peered":"2023-12-20T04:48:04.120538+0000","last_unstale":"2023-12-20T04:48:05.614613+0000","last_undegraded":"2023-12-20T04:48:05.614613+0000","last_fullsized":"2023-12-20T04:48:05.614613+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:00:52.478004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.d","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.615181+0000","last_change":"2023-12-20T04:48:04.473697+0000","last_active":"2023-12-20T04:48:05.615181+0000","last_peered":"2023-12-20T04:48:05.615181+0000","last_clean":"2023-12-20T04:48:05.615181+0000","last_became_active":"2023-12-20T04:48:04.473446+0000","last_became_peered":"2023-12-20T04:48:04.473446+0000","last_unstale":"2023-12-20T04:48:05.615181+0000","last_undegraded":"2023-12-20T04:48:05.615181+0000","last_fullsized":"2023-12-20T04:48:05.615181+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:39:30.603069+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"14.c","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462710+0000","last_change":"2023-12-20T04:48:04.117672+0000","last_active":"2023-12-20T04:48:05.462710+0000","last_peered":"2023-12-20T04:48:05.462710+0000","last_clean":"2023-12-20T04:48:05.462710+0000","last_became_active":"2023-12-20T04:48:04.117478+0000","last_became_peered":"2023-12-20T04:48:04.117478+0000","last_unstale":"2023-12-20T04:48:05.462710+0000","last_undegraded":"2023-12-20T04:48:05.462710+0000","last_fullsized":"2023-12-20T04:48:05.462710+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:56:41.343906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.a","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614082+0000","last_change":"2023-12-20T04:48:04.473633+0000","last_active":"2023-12-20T04:48:05.614082+0000","last_peered":"2023-12-20T04:48:05.614082+0000","last_clean":"2023-12-20T04:48:05.614082+0000","last_became_active":"2023-12-20T04:48:04.473252+0000","last_became_peered":"2023-12-20T04:48:04.473252+0000","last_unstale":"2023-12-20T04:48:05.614082+0000","last_undegraded":"2023-12-20T04:48:05.614082+0000","last_fullsized":"2023-12-20T04:48:05.614082+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:38:48.179536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.b","version":"121'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462599+0000","last_change":"2023-12-20T04:48:04.121657+0000","last_active":"2023-12-20T04:48:05.462599+0000","last_peered":"2023-12-20T04:48:05.462599+0000","last_clean":"2023-12-20T04:48:05.462599+0000","last_became_active":"2023-12-20T04:48:04.121461+0000","last_became_peered":"2023-12-20T04:48:04.121461+0000","last_unstale":"2023-12-20T04:48:05.462599+0000","last_undegraded":"2023-12-20T04:48:05.462599+0000","last_fullsized":"2023-12-20T04:48:05.462599+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:51:36.550236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.b","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.613875+0000","last_change":"2023-12-20T04:48:04.467391+0000","last_active":"2023-12-20T04:48:05.613875+0000","last_peered":"2023-12-20T04:48:05.613875+0000","last_clean":"2023-12-20T04:48:05.613875+0000","last_became_active":"2023-12-20T04:48:04.467143+0000","last_became_peered":"2023-12-20T04:48:04.467143+0000","last_unstale":"2023-12-20T04:48:05.613875+0000","last_undegraded":"2023-12-20T04:48:05.613875+0000","last_fullsized":"2023-12-20T04:48:05.613875+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:52:15.241383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.a","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462014+0000","last_change":"2023-12-20T04:48:04.119863+0000","last_active":"2023-12-20T04:48:05.462014+0000","last_peered":"2023-12-20T04:48:05.462014+0000","last_clean":"2023-12-20T04:48:05.462014+0000","last_became_active":"2023-12-20T04:48:04.119581+0000","last_became_peered":"2023-12-20T04:48:04.119581+0000","last_unstale":"2023-12-20T04:48:05.462014+0000","last_undegraded":"2023-12-20T04:48:05.462014+0000","last_fullsized":"2023-12-20T04:48:05.462014+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:07:37.214668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.8","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.613955+0000","last_change":"2023-12-20T04:48:04.467010+0000","last_active":"2023-12-20T04:48:05.613955+0000","last_peered":"2023-12-20T04:48:05.613955+0000","last_clean":"2023-12-20T04:48:05.613955+0000","last_became_active":"2023-12-20T04:48:04.466320+0000","last_became_peered":"2023-12-20T04:48:04.466320+0000","last_unstale":"2023-12-20T04:48:05.613955+0000","last_undegraded":"2023-12-20T04:48:05.613955+0000","last_fullsized":"2023-12-20T04:48:05.613955+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:58:09.862917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.9","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462094+0000","last_change":"2023-12-20T04:48:04.120157+0000","last_active":"2023-12-20T04:48:05.462094+0000","last_peered":"2023-12-20T04:48:05.462094+0000","last_clean":"2023-12-20T04:48:05.462094+0000","last_became_active":"2023-12-20T04:48:04.119199+0000","last_became_peered":"2023-12-20T04:48:04.119199+0000","last_unstale":"2023-12-20T04:48:05.462094+0000","last_undegraded":"2023-12-20T04:48:05.462094+0000","last_fullsized":"2023-12-20T04:48:05.462094+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:08:34.850605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.9","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614901+0000","last_change":"2023-12-20T04:48:04.471973+0000","last_active":"2023-12-20T04:48:05.614901+0000","last_peered":"2023-12-20T04:48:05.614901+0000","last_clean":"2023-12-20T04:48:05.614901+0000","last_became_active":"2023-12-20T04:48:04.471113+0000","last_became_peered":"2023-12-20T04:48:04.471113+0000","last_unstale":"2023-12-20T04:48:05.614901+0000","last_undegraded":"2023-12-20T04:48:05.614901+0000","last_fullsized":"2023-12-20T04:48:05.614901+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:00:02.350668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.8","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462580+0000","last_change":"2023-12-20T04:48:04.116500+0000","last_active":"2023-12-20T04:48:05.462580+0000","last_peered":"2023-12-20T04:48:05.462580+0000","last_clean":"2023-12-20T04:48:05.462580+0000","last_became_active":"2023-12-20T04:48:04.115956+0000","last_became_peered":"2023-12-20T04:48:04.115956+0000","last_unstale":"2023-12-20T04:48:05.462580+0000","last_undegraded":"2023-12-20T04:48:05.462580+0000","last_fullsized":"2023-12-20T04:48:05.462580+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:54:34.484294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.6","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462393+0000","last_change":"2023-12-20T04:48:04.471992+0000","last_active":"2023-12-20T04:48:05.462393+0000","last_peered":"2023-12-20T04:48:05.462393+0000","last_clean":"2023-12-20T04:48:05.462393+0000","last_became_active":"2023-12-20T04:48:04.468643+0000","last_became_peered":"2023-12-20T04:48:04.468643+0000","last_unstale":"2023-12-20T04:48:05.462393+0000","last_undegraded":"2023-12-20T04:48:05.462393+0000","last_fullsized":"2023-12-20T04:48:05.462393+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:51:59.446917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"14.7","version":"121'2","reported_seq":13,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462327+0000","last_change":"2023-12-20T04:48:04.120153+0000","last_active":"2023-12-20T04:48:05.462327+0000","last_peered":"2023-12-20T04:48:05.462327+0000","last_clean":"2023-12-20T04:48:05.462327+0000","last_became_active":"2023-12-20T04:48:04.119731+0000","last_became_peered":"2023-12-20T04:48:04.119731+0000","last_unstale":"2023-12-20T04:48:05.462327+0000","last_undegraded":"2023-12-20T04:48:05.462327+0000","last_fullsized":"2023-12-20T04:48:05.462327+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:28.762689+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"15.7","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.972748+0000","last_change":"2023-12-20T04:48:04.470260+0000","last_active":"2023-12-20T04:48:05.972748+0000","last_peered":"2023-12-20T04:48:05.972748+0000","last_clean":"2023-12-20T04:48:05.972748+0000","last_became_active":"2023-12-20T04:48:04.470039+0000","last_became_peered":"2023-12-20T04:48:04.470039+0000","last_unstale":"2023-12-20T04:48:05.972748+0000","last_undegraded":"2023-12-20T04:48:05.972748+0000","last_fullsized":"2023-12-20T04:48:05.972748+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:14:56.442979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.6","version":"121'1","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462646+0000","last_change":"2023-12-20T04:48:04.120358+0000","last_active":"2023-12-20T04:48:05.462646+0000","last_peered":"2023-12-20T04:48:05.462646+0000","last_clean":"2023-12-20T04:48:05.462646+0000","last_became_active":"2023-12-20T04:48:04.120138+0000","last_became_peered":"2023-12-20T04:48:04.120138+0000","last_unstale":"2023-12-20T04:48:05.462646+0000","last_undegraded":"2023-12-20T04:48:05.462646+0000","last_fullsized":"2023-12-20T04:48:05.462646+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:41:41.034492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.4","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.973008+0000","last_change":"2023-12-20T04:48:04.472514+0000","last_active":"2023-12-20T04:48:05.973008+0000","last_peered":"2023-12-20T04:48:05.973008+0000","last_clean":"2023-12-20T04:48:05.973008+0000","last_became_active":"2023-12-20T04:48:04.471752+0000","last_became_peered":"2023-12-20T04:48:04.471752+0000","last_unstale":"2023-12-20T04:48:05.973008+0000","last_undegraded":"2023-12-20T04:48:05.973008+0000","last_fullsized":"2023-12-20T04:48:05.973008+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:42:26.008818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"14.5","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462354+0000","last_change":"2023-12-20T04:48:04.118727+0000","last_active":"2023-12-20T04:48:05.462354+0000","last_peered":"2023-12-20T04:48:05.462354+0000","last_clean":"2023-12-20T04:48:05.462354+0000","last_became_active":"2023-12-20T04:48:04.118506+0000","last_became_peered":"2023-12-20T04:48:04.118506+0000","last_unstale":"2023-12-20T04:48:05.462354+0000","last_undegraded":"2023-12-20T04:48:05.462354+0000","last_fullsized":"2023-12-20T04:48:05.462354+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:42:25.004520+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.5","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614672+0000","last_change":"2023-12-20T04:48:04.474317+0000","last_active":"2023-12-20T04:48:05.614672+0000","last_peered":"2023-12-20T04:48:05.614672+0000","last_clean":"2023-12-20T04:48:05.614672+0000","last_became_active":"2023-12-20T04:48:04.474045+0000","last_became_peered":"2023-12-20T04:48:04.474045+0000","last_unstale":"2023-12-20T04:48:05.614672+0000","last_undegraded":"2023-12-20T04:48:05.614672+0000","last_fullsized":"2023-12-20T04:48:05.614672+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:17:26.742618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.4","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614993+0000","last_change":"2023-12-20T04:48:04.120729+0000","last_active":"2023-12-20T04:48:05.614993+0000","last_peered":"2023-12-20T04:48:05.614993+0000","last_clean":"2023-12-20T04:48:05.614993+0000","last_became_active":"2023-12-20T04:48:04.120503+0000","last_became_peered":"2023-12-20T04:48:04.120503+0000","last_unstale":"2023-12-20T04:48:05.614993+0000","last_undegraded":"2023-12-20T04:48:05.614993+0000","last_fullsized":"2023-12-20T04:48:05.614993+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:23:11.734874+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.2","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614008+0000","last_change":"2023-12-20T04:48:04.468597+0000","last_active":"2023-12-20T04:48:05.614008+0000","last_peered":"2023-12-20T04:48:05.614008+0000","last_clean":"2023-12-20T04:48:05.614008+0000","last_became_active":"2023-12-20T04:48:04.468401+0000","last_became_peered":"2023-12-20T04:48:04.468401+0000","last_unstale":"2023-12-20T04:48:05.614008+0000","last_undegraded":"2023-12-20T04:48:05.614008+0000","last_fullsized":"2023-12-20T04:48:05.614008+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:58:46.556108+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.3","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462653+0000","last_change":"2023-12-20T04:48:04.115019+0000","last_active":"2023-12-20T04:48:05.462653+0000","last_peered":"2023-12-20T04:48:05.462653+0000","last_clean":"2023-12-20T04:48:05.462653+0000","last_became_active":"2023-12-20T04:48:04.113738+0000","last_became_peered":"2023-12-20T04:48:04.113738+0000","last_unstale":"2023-12-20T04:48:05.462653+0000","last_undegraded":"2023-12-20T04:48:05.462653+0000","last_fullsized":"2023-12-20T04:48:05.462653+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:58:46.790486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"15.3","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.462959+0000","last_change":"2023-12-20T04:48:04.464640+0000","last_active":"2023-12-20T04:48:05.462959+0000","last_peered":"2023-12-20T04:48:05.462959+0000","last_clean":"2023-12-20T04:48:05.462959+0000","last_became_active":"2023-12-20T04:48:04.464406+0000","last_became_peered":"2023-12-20T04:48:04.464406+0000","last_unstale":"2023-12-20T04:48:05.462959+0000","last_undegraded":"2023-12-20T04:48:05.462959+0000","last_fullsized":"2023-12-20T04:48:05.462959+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:51:37.554534+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"14.2","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614884+0000","last_change":"2023-12-20T04:48:04.115931+0000","last_active":"2023-12-20T04:48:05.614884+0000","last_peered":"2023-12-20T04:48:05.614884+0000","last_clean":"2023-12-20T04:48:05.614884+0000","last_became_active":"2023-12-20T04:48:04.115604+0000","last_became_peered":"2023-12-20T04:48:04.115604+0000","last_unstale":"2023-12-20T04:48:05.614884+0000","last_undegraded":"2023-12-20T04:48:05.614884+0000","last_fullsized":"2023-12-20T04:48:05.614884+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:23:44.938843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"15.0","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614143+0000","last_change":"2023-12-20T04:48:04.472454+0000","last_active":"2023-12-20T04:48:05.614143+0000","last_peered":"2023-12-20T04:48:05.614143+0000","last_clean":"2023-12-20T04:48:05.614143+0000","last_became_active":"2023-12-20T04:48:04.471342+0000","last_became_peered":"2023-12-20T04:48:04.471342+0000","last_unstale":"2023-12-20T04:48:05.614143+0000","last_undegraded":"2023-12-20T04:48:05.614143+0000","last_fullsized":"2023-12-20T04:48:05.614143+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:19:26.856704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.1","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.723317+0000","last_change":"2023-12-20T04:48:04.116677+0000","last_active":"2023-12-20T04:48:05.723317+0000","last_peered":"2023-12-20T04:48:05.723317+0000","last_clean":"2023-12-20T04:48:05.723317+0000","last_became_active":"2023-12-20T04:48:04.116461+0000","last_became_peered":"2023-12-20T04:48:04.116461+0000","last_unstale":"2023-12-20T04:48:05.723317+0000","last_undegraded":"2023-12-20T04:48:05.723317+0000","last_fullsized":"2023-12-20T04:48:05.723317+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:56:41.343906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"15.1","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614588+0000","last_change":"2023-12-20T04:48:04.470593+0000","last_active":"2023-12-20T04:48:05.614588+0000","last_peered":"2023-12-20T04:48:05.614588+0000","last_clean":"2023-12-20T04:48:05.614588+0000","last_became_active":"2023-12-20T04:48:04.470033+0000","last_became_peered":"2023-12-20T04:48:04.470033+0000","last_unstale":"2023-12-20T04:48:05.614588+0000","last_undegraded":"2023-12-20T04:48:05.614588+0000","last_fullsized":"2023-12-20T04:48:05.614588+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:39:46.431943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"14.0","version":"0'0","reported_seq":11,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614186+0000","last_change":"2023-12-20T04:48:04.124297+0000","last_active":"2023-12-20T04:48:05.614186+0000","last_peered":"2023-12-20T04:48:05.614186+0000","last_clean":"2023-12-20T04:48:05.614186+0000","last_became_active":"2023-12-20T04:48:04.123500+0000","last_became_peered":"2023-12-20T04:48:04.123500+0000","last_unstale":"2023-12-20T04:48:05.614186+0000","last_undegraded":"2023-12-20T04:48:05.614186+0000","last_fullsized":"2023-12-20T04:48:05.614186+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:20:02.801224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"15.e","version":"0'0","reported_seq":10,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614003+0000","last_change":"2023-12-20T04:48:04.466663+0000","last_active":"2023-12-20T04:48:05.614003+0000","last_peered":"2023-12-20T04:48:05.614003+0000","last_clean":"2023-12-20T04:48:05.614003+0000","last_became_active":"2023-12-20T04:48:04.466452+0000","last_became_peered":"2023-12-20T04:48:04.466452+0000","last_unstale":"2023-12-20T04:48:05.614003+0000","last_undegraded":"2023-12-20T04:48:05.614003+0000","last_fullsized":"2023-12-20T04:48:05.614003+0000","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":120,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:04.107284+0000","last_clean_scrub_stamp":"2023-12-20T04:48:04.107284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:18:19.511502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"14.f","version":"121'1","reported_seq":12,"reported_epoch":122,"state":"active+clean","last_fresh":"2023-12-20T04:48:05.614556+0000","last_change":"2023-12-20T04:48:04.121937+0000","last_active":"2023-12-20T04:48:05.614556+0000","last_peered":"2023-12-20T04:48:05.614556+0000","last_clean":"2023-12-20T04:48:05.614556+0000","last_became_active":"2023-12-20T04:48:04.121767+0000","last_became_peered":"2023-12-20T04:48:04.121767+0000","last_unstale":"2023-12-20T04:48:05.614556+0000","last_undegraded":"2023-12-20T04:48:05.614556+0000","last_fullsized":"2023-12-20T04:48:05.614556+0000","mapping_epoch":119,"log_start":"0'0","ondisk_log_start":"0'0","created":119,"last_epoch_clean":120,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:03.102986+0000","last_clean_scrub_stamp":"2023-12-20T04:48:03.102986+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:49:21.832343+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":252,"reported_epoch":121,"state":"active+clean","last_fresh":"2023-12-20T04:48:04.464650+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:48:04.464650+0000","last_peered":"2023-12-20T04:48:04.464650+0000","last_clean":"2023-12-20T04:48:04.464650+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:48:04.464650+0000","last_undegraded":"2023-12-20T04:48:04.464650+0000","last_fullsized":"2023-12-20T04:48:04.464650+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":15,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":14,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574916,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1231,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194081,"statfs":{"total":200000000,"available":198739144,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.42499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73399999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.623},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52200000000000002},"min":{"1min":0.33100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67300000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.46000000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.39700000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.68700000000000006,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71599999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.50600000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.65200000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70099999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.48399999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70299999999999996,"5min":1.048,"15min":1.048},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.42699999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65600000000000003,"5min":0.753,"15min":0.753},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.49199999999999999,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70399999999999996,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.375}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.49099999999999999},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68999999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.40500000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.57899999999999996}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51900000000000002,"15min":0.54600000000000004},"min":{"1min":0.34399999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71599999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.59599999999999997}]}]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":649,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194663,"statfs":{"total":200000000,"available":199335272,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.50800000000000001,"15min":0.496},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.46400000000000002},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.31900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.36699999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.53100000000000003},"min":{"1min":0.36699999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.32100000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.49199999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52200000000000002,"15min":0.50800000000000001},"min":{"1min":0.40100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69999999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52200000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53100000000000003,"15min":0.5},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.433}]},{"osd":4,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48199999999999998,"15min":0.50600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.42199999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.49399999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70399999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.504}]},{"osd":5,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68799999999999994,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.38600000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73199999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.53200000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574916,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":648,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194663,"statfs":{"total":200000000,"available":199335854,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.63700000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.33300000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.80600000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.35899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58299999999999996}]},{"osd":2,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.41499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68300000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.54600000000000004}]},{"osd":3,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.32300000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66100000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.371,"5min":0.312,"15min":0.312},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.48999999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47699999999999998,"15min":0.503},"min":{"1min":0.28799999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.749,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.501,"5min":0.47599999999999998,"15min":0.48099999999999998},"min":{"1min":0.32800000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.38900000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48399999999999999,"15min":0.50600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52700000000000002,"15min":0.54200000000000004},"min":{"1min":0.37,"5min":0.31,"15min":0.31},"max":{"1min":0.78600000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.52700000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73099999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.47599999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75800000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.59699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574916,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":656,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194656,"statfs":{"total":200000000,"available":199327936,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.308,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.33000000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.67100000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.68600000000000005}]},{"osd":1,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.34200000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69899999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.36499999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.72699999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54000000000000004,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.76000000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.371,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.51600000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.48499999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.877,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.70199999999999996}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.56599999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.436},{"interface":"front","average":{"1min":0.499,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.39900000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48799999999999999,"15min":0.503},"min":{"1min":0.371,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.72199999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70499999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.49099999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.34599999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.46500000000000002},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.47899999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574916,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":650,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194662,"statfs":{"total":200000000,"available":199334338,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35199999999999998,"15min":0.34000000000000002},"min":{"1min":0.20100000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.58299999999999996,"5min":0.629,"15min":0.629},"last":0.219},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.374,"15min":0.35599999999999998},"min":{"1min":0.29099999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.56200000000000006,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.29899999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.32100000000000001},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.247},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.33700000000000002},"min":{"1min":0.27800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.27800000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35099999999999998,"15min":0.34499999999999997},"min":{"1min":0.249,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49299999999999999,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.376},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.33500000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55800000000000005,"15min":0.54300000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.76800000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.45200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72199999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.56200000000000006}]},{"osd":6,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.38500000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76700000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58399999999999996,"15min":0.56100000000000005},"min":{"1min":0.495,"5min":0.37,"15min":0.37},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.60799999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80600000000000005,"5min":0.879,"15min":0.879},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80300000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.63800000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574916,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":654,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194657,"statfs":{"total":200000000,"available":199329590,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.29999999999999999},"min":{"1min":0.246,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.44700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.252},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39300000000000002,"15min":0.34499999999999997},"min":{"1min":0.25800000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.504,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.36099999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35599999999999998,"15min":0.33100000000000002},"min":{"1min":0.24099999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.54300000000000004,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.34599999999999997},{"interface":"front","average":{"1min":0.38,"5min":0.375,"15min":0.35099999999999998},"min":{"1min":0.247,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.5,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.32200000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.35999999999999999},"min":{"1min":0.27700000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.58299999999999996,"5min":0.995,"15min":0.995},"last":0.38900000000000001},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.372},"min":{"1min":0.28100000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.53600000000000003,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.379}]},{"osd":4,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.442,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.68000000000000005},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75,"5min":2.347,"15min":2.347},"last":0.77100000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.42099999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84999999999999998,"5min":0.997,"15min":0.997},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.83499999999999996}]},{"osd":6,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59199999999999997,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71699999999999997,"5min":2.274,"15min":2.274},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.82299999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.57999999999999996}]},{"osd":7,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.57099999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59099999999999997,"15min":0.57999999999999996},"min":{"1min":0.45100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.77700000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.81699999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574917,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":654,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194657,"statfs":{"total":200000000,"available":199329624,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.316,"15min":0.28999999999999998},"min":{"1min":0.23000000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.30499999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.35299999999999998,"15min":0.33100000000000002},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.39000000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.33200000000000002,"15min":0.307},"min":{"1min":0.20599999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.52400000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.26600000000000001},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.377,"15min":0.35099999999999998},"min":{"1min":0.26900000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.33000000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.35799999999999998},"min":{"1min":0.29499999999999998,"5min":0.191,"15min":0.191},"max":{"1min":0.61699999999999999,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36399999999999999,"15min":0.35299999999999998},"min":{"1min":0.26400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54800000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.35399999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.312,"15min":0.312},"max":{"1min":0.70999999999999996,"5min":0.873,"15min":0.873},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.45000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73099999999999998,"5min":1.002,"15min":1.002},"last":0.69299999999999995}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.42099999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.54200000000000004},"min":{"1min":0.45900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.58399999999999996}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.47999999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":1.038,"15min":1.038},"last":0.66900000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.56299999999999994},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66900000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.59299999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.42899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72299999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.51500000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73499999999999999,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.71099999999999997}]}]},{"osd":0,"up_from":13,"seq":55834574916,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1231,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194080,"statfs":{"total":200000000,"available":198738674,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32200000000000001,"15min":0.31},"min":{"1min":0.25,"5min":0.184,"15min":0.184},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.246},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.314},"min":{"1min":0.27400000000000002,"5min":0.184,"15min":0.184},"max":{"1min":0.46300000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.40100000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.28599999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.53500000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.28399999999999997},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.26500000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.51300000000000001,"5min":0.622,"15min":0.622},"last":0.32700000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34799999999999998,"15min":0.32500000000000001},"min":{"1min":0.29099999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.31},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.36899999999999999},"min":{"1min":0.29399999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.29999999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55200000000000005,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.432,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.36799999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.52200000000000002},"min":{"1min":0.432,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73199999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.42599999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57199999999999995,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82999999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.443}]},{"osd":6,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88200000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.58399999999999996},"min":{"1min":0.45300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.45500000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.747,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.39300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83399999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.46300000000000002}]}]}],"pool_statfs":[]}} 2023-12-20T04:48:08.421 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-20T04:48:08.421 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-20T04:48:08.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.563+0000 7f89a5900640 1 Processor -- start 2023-12-20T04:48:08.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.563+0000 7f89a5900640 1 -- start start 2023-12-20T04:48:08.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.563+0000 7f89a5900640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89a00cf790 0x7f89a00cfc10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.563+0000 7f89a5900640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a00d0150 con 0x7f89a015d300 2023-12-20T04:48:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.563+0000 7f89a5900640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f89a00d2920 con 0x7f89a00b6080 2023-12-20T04:48:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.563+0000 7f89a5900640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a00d1d10 con 0x7f89a00cf790 2023-12-20T04:48:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.564+0000 7f899effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f89a015d300 0x7f89a00d1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48532/0 (socket says 172.21.15.132:48532) 2023-12-20T04:48:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.564+0000 7f899effd640 1 -- 172.21.15.132:0/2365103420 learned_addr learned my addr 172.21.15.132:0/2365103420 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.564+0000 7f899e7fc640 1 --2- 172.21.15.132:0/2365103420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89a00cf790 0x7f89a00cfc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.564+0000 7f899dffb640 1 -- 172.21.15.132:0/2365103420 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3887616626 0 0) 0x7f89a00d0150 con 0x7f89a015d300 2023-12-20T04:48:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.564+0000 7f899dffb640 1 -- 172.21.15.132:0/2365103420 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8988003520 con 0x7f89a015d300 2023-12-20T04:48:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.564+0000 7f899dffb640 1 -- 172.21.15.132:0/2365103420 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3865967161 0 0) 0x7f89a00d2920 con 0x7f89a00b6080 2023-12-20T04:48:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.564+0000 7f899dffb640 1 -- 172.21.15.132:0/2365103420 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f89a00d0150 con 0x7f89a00b6080 2023-12-20T04:48:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.564+0000 7f899e7fc640 1 -- 172.21.15.132:0/2365103420 >> v1:172.21.15.187:6789/0 conn(0x7f89a00b6080 legacy=0x7f89a00b64d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.564+0000 7f899e7fc640 1 -- 172.21.15.132:0/2365103420 >> v1:172.21.15.132:6789/0 conn(0x7f89a015d300 legacy=0x7f89a00d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.564+0000 7f899e7fc640 1 -- 172.21.15.132:0/2365103420 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a00d1ff0 con 0x7f89a00cf790 2023-12-20T04:48:08.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.565+0000 7f899e7fc640 1 --2- 172.21.15.132:0/2365103420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89a00cf790 0x7f89a00cfc10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f89940097d0 tx=0x7f899402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=aaeaff6b28a45270 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:08.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.565+0000 7f899dffb640 1 -- 172.21.15.132:0/2365103420 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994031890 con 0x7f89a00cf790 2023-12-20T04:48:08.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.565+0000 7f899dffb640 1 -- 172.21.15.132:0/2365103420 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f89940319f0 con 0x7f89a00cf790 2023-12-20T04:48:08.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.565+0000 7f899dffb640 1 -- 172.21.15.132:0/2365103420 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8994031d80 con 0x7f89a00cf790 2023-12-20T04:48:08.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.565+0000 7f89a5900640 1 -- 172.21.15.132:0/2365103420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89a00cf790 msgr2=0x7f89a00cfc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.565+0000 7f89a5900640 1 --2- 172.21.15.132:0/2365103420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89a00cf790 0x7f89a00cfc10 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f89940097d0 tx=0x7f899402b930 comp rx=0 tx=0).stop 2023-12-20T04:48:08.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.566+0000 7f89a5900640 1 -- 172.21.15.132:0/2365103420 shutdown_connections 2023-12-20T04:48:08.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.566+0000 7f89a5900640 1 --2- 172.21.15.132:0/2365103420 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89a00cf790 0x7f89a00cfc10 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.566+0000 7f89a5900640 1 -- 172.21.15.132:0/2365103420 >> 172.21.15.132:0/2365103420 conn(0x7f89a006a3d0 msgr2=0x7f89a006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:08.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.566+0000 7f89a5900640 1 -- 172.21.15.132:0/2365103420 shutdown_connections 2023-12-20T04:48:08.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.566+0000 7f89a5900640 1 -- 172.21.15.132:0/2365103420 wait complete. 2023-12-20T04:48:08.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.567+0000 7f89a5900640 1 Processor -- start 2023-12-20T04:48:08.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.567+0000 7f89a5900640 1 -- start start 2023-12-20T04:48:08.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f89a5900640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89a00b6080 0x7f89a01f3080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f89a5900640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89a00cf790 0x7f89a00cabf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f89a5900640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89a015d300 0x7f89a014e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f89a5900640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a01f2c60 con 0x7f89a00b6080 2023-12-20T04:48:08.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f89a5900640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89a01f25e0 con 0x7f89a015d300 2023-12-20T04:48:08.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f89a5900640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f89a00cb4f0 con 0x7f89a00cf790 2023-12-20T04:48:08.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f899effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89a00b6080 0x7f89a01f3080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f899effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89a00b6080 0x7f89a01f3080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44632/0 (socket says 172.21.15.132:44632) 2023-12-20T04:48:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f899effd640 1 -- 172.21.15.132:0/247391156 learned_addr learned my addr 172.21.15.132:0/247391156 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f899e7fc640 1 --2- 172.21.15.132:0/247391156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89a00cf790 0x7f89a00cabf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f899f7fe640 1 --2- 172.21.15.132:0/247391156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89a015d300 0x7f89a014e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f899effd640 1 -- 172.21.15.132:0/247391156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89a00cf790 msgr2=0x7f89a00cabf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f899effd640 1 --2- 172.21.15.132:0/247391156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89a00cf790 0x7f89a00cabf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f899effd640 1 -- 172.21.15.132:0/247391156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89a015d300 msgr2=0x7f89a014e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f899effd640 1 --2- 172.21.15.132:0/247391156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89a015d300 0x7f89a014e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f899effd640 1 -- 172.21.15.132:0/247391156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8994009400 con 0x7f89a00b6080 2023-12-20T04:48:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f899f7fe640 1 --2- 172.21.15.132:0/247391156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89a015d300 0x7f89a014e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f899effd640 1 --2- 172.21.15.132:0/247391156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89a00b6080 0x7f89a01f3080 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f899000c410 tx=0x7f899000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f8987fff640 1 -- 172.21.15.132:0/247391156 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8990005ce0 con 0x7f89a00b6080 2023-12-20T04:48:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f8987fff640 1 -- 172.21.15.132:0/247391156 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8990005e40 con 0x7f89a00b6080 2023-12-20T04:48:08.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f89a5900640 1 -- 172.21.15.132:0/247391156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89a01f2880 con 0x7f89a00b6080 2023-12-20T04:48:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f8987fff640 1 -- 172.21.15.132:0/247391156 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f89900072d0 con 0x7f89a00b6080 2023-12-20T04:48:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.568+0000 7f89a5900640 1 -- 172.21.15.132:0/247391156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89a00cb130 con 0x7f89a00b6080 2023-12-20T04:48:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.569+0000 7f89a5900640 1 -- 172.21.15.132:0/247391156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89a01f2da0 con 0x7f89a00b6080 2023-12-20T04:48:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.570+0000 7f8987fff640 1 -- 172.21.15.132:0/247391156 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8990007430 con 0x7f89a00b6080 2023-12-20T04:48:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.570+0000 7f8987fff640 1 --2- 172.21.15.132:0/247391156 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f898c06a430 0x7f898c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.570+0000 7f8987fff640 1 -- 172.21.15.132:0/247391156 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8990087dc0 con 0x7f89a00b6080 2023-12-20T04:48:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.570+0000 7f899e7fc640 1 --2- 172.21.15.132:0/247391156 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f898c06a430 0x7f898c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:08.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.571+0000 7f899e7fc640 1 --2- 172.21.15.132:0/247391156 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f898c06a430 0x7f898c06c8f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8994036000 tx=0x7f899403c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:08.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.575+0000 7f8987fff640 1 -- 172.21.15.132:0/247391156 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f89900534f0 con 0x7f89a00b6080 2023-12-20T04:48:08.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.805+0000 7f89a5900640 1 -- 172.21.15.132:0/247391156 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f89a004e840 con 0x7f89a00b6080 2023-12-20T04:48:08.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.809+0000 7f8987fff640 1 -- 172.21.15.132:0/247391156 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v18) v1 ==== 190+0+0 (secure 0 0 0) 0x7f8990056b10 con 0x7f89a00b6080 2023-12-20T04:48:08.809 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.0 2023-12-20T04:48:08.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.811+0000 7f89a5900640 1 -- 172.21.15.132:0/247391156 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f898c06a430 msgr2=0x7f898c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.811+0000 7f89a5900640 1 --2- 172.21.15.132:0/247391156 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f898c06a430 0x7f898c06c8f0 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f8994036000 tx=0x7f899403c040 comp rx=0 tx=0).stop 2023-12-20T04:48:08.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.811+0000 7f89a5900640 1 -- 172.21.15.132:0/247391156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89a00b6080 msgr2=0x7f89a01f3080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.811+0000 7f89a5900640 1 --2- 172.21.15.132:0/247391156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89a00b6080 0x7f89a01f3080 secure :-1 s=READY pgs=1205 cs=0 l=1 rev1=1 crypto rx=0x7f899000c410 tx=0x7f899000c8d0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.811+0000 7f89a5900640 1 -- 172.21.15.132:0/247391156 shutdown_connections 2023-12-20T04:48:08.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.811+0000 7f89a5900640 1 --2- 172.21.15.132:0/247391156 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f898c06a430 0x7f898c06c8f0 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.811+0000 7f89a5900640 1 --2- 172.21.15.132:0/247391156 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f89a015d300 0x7f89a014e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.811+0000 7f89a5900640 1 --2- 172.21.15.132:0/247391156 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f89a00cf790 0x7f89a00cabf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.811+0000 7f89a5900640 1 --2- 172.21.15.132:0/247391156 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f89a00b6080 0x7f89a01f3080 unknown :-1 s=CLOSED pgs=1205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.811+0000 7f89a5900640 1 -- 172.21.15.132:0/247391156 >> 172.21.15.132:0/247391156 conn(0x7f89a006a3d0 msgr2=0x7f89a015b9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:08.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.811+0000 7f89a5900640 1 -- 172.21.15.132:0/247391156 shutdown_connections 2023-12-20T04:48:08.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.811+0000 7f89a5900640 1 -- 172.21.15.132:0/247391156 wait complete. 2023-12-20T04:48:08.823 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:48:08.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.921+0000 7fdf4de2b640 1 Processor -- start 2023-12-20T04:48:08.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.922+0000 7fdf4de2b640 1 -- start start 2023-12-20T04:48:08.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.922+0000 7fdf4de2b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdf48159b50 0x7fdf480c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.922+0000 7fdf4de2b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf480ccf30 con 0x7fdf4806c240 2023-12-20T04:48:08.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.922+0000 7fdf4de2b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdf480ca1c0 con 0x7fdf4815e530 2023-12-20T04:48:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.922+0000 7fdf4de2b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdf480caa60 con 0x7fdf48159b50 2023-12-20T04:48:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.922+0000 7fdf47fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdf4806c240 0x7fdf480cd3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48542/0 (socket says 172.21.15.132:48542) 2023-12-20T04:48:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.922+0000 7fdf47fff640 1 -- 172.21.15.132:0/2895648825 learned_addr learned my addr 172.21.15.132:0/2895648825 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf477fe640 1 --2- 172.21.15.132:0/2895648825 >> v2:172.21.15.187:3300/0 conn(0x7fdf48159b50 0x7fdf480c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf467fc640 1 -- 172.21.15.132:0/2895648825 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3022484332 0 0) 0x7fdf480ccf30 con 0x7fdf4806c240 2023-12-20T04:48:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf467fc640 1 -- 172.21.15.132:0/2895648825 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf30003520 con 0x7fdf4806c240 2023-12-20T04:48:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf467fc640 1 -- 172.21.15.132:0/2895648825 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63109521 0 0) 0x7fdf480ca1c0 con 0x7fdf4815e530 2023-12-20T04:48:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf467fc640 1 -- 172.21.15.132:0/2895648825 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdf480ccf30 con 0x7fdf4815e530 2023-12-20T04:48:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf467fc640 1 -- 172.21.15.132:0/2895648825 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4096311653 0 0) 0x7fdf30003520 con 0x7fdf4806c240 2023-12-20T04:48:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf467fc640 1 -- 172.21.15.132:0/2895648825 >> v2:172.21.15.187:3300/0 conn(0x7fdf48159b50 msgr2=0x7fdf480c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf467fc640 1 --2- 172.21.15.132:0/2895648825 >> v2:172.21.15.187:3300/0 conn(0x7fdf48159b50 0x7fdf480c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf467fc640 1 -- 172.21.15.132:0/2895648825 >> v1:172.21.15.187:6789/0 conn(0x7fdf4815e530 legacy=0x7fdf4806fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf467fc640 1 -- 172.21.15.132:0/2895648825 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf480ca4a0 con 0x7fdf4806c240 2023-12-20T04:48:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf467fc640 1 -- 172.21.15.132:0/2895648825 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fdf400019f0 con 0x7fdf4806c240 2023-12-20T04:48:08.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf477fe640 1 --2- 172.21.15.132:0/2895648825 >> v2:172.21.15.187:3300/0 conn(0x7fdf48159b50 0x7fdf480c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:48:08.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf467fc640 1 -- 172.21.15.132:0/2895648825 >> v1:172.21.15.132:6789/0 conn(0x7fdf4806c240 legacy=0x7fdf480cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf467fc640 1 --2- 172.21.15.132:0/2895648825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf30003b00 0x7fdf30003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf467fc640 1 --2- 172.21.15.132:0/2895648825 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf300047c0 0x7fdf30004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf467fc640 1 --2- 172.21.15.132:0/2895648825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf30005180 0x7fdf3000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf467fc640 1 -- 172.21.15.132:0/2895648825 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf480caa60 con 0x7fdf30003b00 2023-12-20T04:48:08.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf467fc640 1 -- 172.21.15.132:0/2895648825 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3000c000 con 0x7fdf30005180 2023-12-20T04:48:08.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf467fc640 1 -- 172.21.15.132:0/2895648825 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf3000c1c0 con 0x7fdf300047c0 2023-12-20T04:48:08.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf477fe640 1 --2- 172.21.15.132:0/2895648825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf30003b00 0x7fdf30003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:08.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf46ffd640 1 --2- 172.21.15.132:0/2895648825 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf300047c0 0x7fdf30004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:08.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf47fff640 1 --2- 172.21.15.132:0/2895648825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf30005180 0x7fdf3000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:08.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf477fe640 1 -- 172.21.15.132:0/2895648825 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf300047c0 msgr2=0x7fdf30004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:08.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf477fe640 1 --2- 172.21.15.132:0/2895648825 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf300047c0 0x7fdf30004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf477fe640 1 -- 172.21.15.132:0/2895648825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf30005180 msgr2=0x7fdf3000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:08.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf477fe640 1 --2- 172.21.15.132:0/2895648825 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf30005180 0x7fdf3000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf47fff640 1 -- 172.21.15.132:0/2895648825 reap_dead start 2023-12-20T04:48:08.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.923+0000 7fdf477fe640 1 -- 172.21.15.132:0/2895648825 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf30003520 con 0x7fdf30003b00 2023-12-20T04:48:08.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.924+0000 7fdf477fe640 1 --2- 172.21.15.132:0/2895648825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf30003b00 0x7fdf30003f00 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009c90 tx=0x7fdf300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f46c53c796331b05 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:08.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.924+0000 7fdf467fc640 1 -- 172.21.15.132:0/2895648825 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3802c8f0 con 0x7fdf30003b00 2023-12-20T04:48:08.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.924+0000 7fdf467fc640 1 -- 172.21.15.132:0/2895648825 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf3802ca50 con 0x7fdf30003b00 2023-12-20T04:48:08.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.924+0000 7fdf467fc640 1 -- 172.21.15.132:0/2895648825 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf3802ce40 con 0x7fdf30003b00 2023-12-20T04:48:08.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.925+0000 7fdf4de2b640 1 -- 172.21.15.132:0/2895648825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf30003b00 msgr2=0x7fdf30003f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.925+0000 7fdf4de2b640 1 --2- 172.21.15.132:0/2895648825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf30003b00 0x7fdf30003f00 secure :-1 s=READY pgs=1207 cs=0 l=1 rev1=1 crypto rx=0x7fdf38009c90 tx=0x7fdf300057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.925+0000 7fdf4de2b640 1 -- 172.21.15.132:0/2895648825 shutdown_connections 2023-12-20T04:48:08.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.925+0000 7fdf4de2b640 1 --2- 172.21.15.132:0/2895648825 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf30003b00 0x7fdf30003f00 unknown :-1 s=CLOSED pgs=1207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.925+0000 7fdf4de2b640 1 -- 172.21.15.132:0/2895648825 >> 172.21.15.132:0/2895648825 conn(0x7fdf480ced10 msgr2=0x7fdf480cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:08.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.925+0000 7fdf4de2b640 1 -- 172.21.15.132:0/2895648825 shutdown_connections 2023-12-20T04:48:08.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.925+0000 7fdf4de2b640 1 -- 172.21.15.132:0/2895648825 wait complete. 2023-12-20T04:48:08.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.926+0000 7fdf4de2b640 1 Processor -- start 2023-12-20T04:48:08.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.926+0000 7fdf4de2b640 1 -- start start 2023-12-20T04:48:08.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.927+0000 7fdf4de2b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf30003b00 0x7fdf4814f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.927+0000 7fdf4de2b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf48149460 0x7fdf4814cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.927+0000 7fdf4de2b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf480cb410 0x7fdf480cb890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.927+0000 7fdf4de2b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf480cbdd0 con 0x7fdf30003b00 2023-12-20T04:48:08.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.927+0000 7fdf4de2b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdf481498e0 con 0x7fdf48149460 2023-12-20T04:48:08.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.927+0000 7fdf4de2b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdf48150370 con 0x7fdf480cb410 2023-12-20T04:48:08.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.927+0000 7fdf477fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf30003b00 0x7fdf4814f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:08.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.927+0000 7fdf477fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf30003b00 0x7fdf4814f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44658/0 (socket says 172.21.15.132:44658) 2023-12-20T04:48:08.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.927+0000 7fdf477fe640 1 -- 172.21.15.132:0/93876296 learned_addr learned my addr 172.21.15.132:0/93876296 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:08.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.927+0000 7fdf477fe640 1 -- 172.21.15.132:0/93876296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf480cb410 msgr2=0x7fdf480cb890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.927+0000 7fdf477fe640 1 --2- 172.21.15.132:0/93876296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf480cb410 0x7fdf480cb890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.927+0000 7fdf477fe640 1 -- 172.21.15.132:0/93876296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf48149460 msgr2=0x7fdf4814cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:08.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.927+0000 7fdf477fe640 1 --2- 172.21.15.132:0/93876296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf48149460 0x7fdf4814cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:08.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.927+0000 7fdf477fe640 1 -- 172.21.15.132:0/93876296 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdf4814f760 con 0x7fdf30003b00 2023-12-20T04:48:08.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.927+0000 7fdf477fe640 1 --2- 172.21.15.132:0/93876296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf30003b00 0x7fdf4814f180 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fdf38037040 tx=0x7fdf38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:08.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.927+0000 7fdf2ffff640 1 -- 172.21.15.132:0/93876296 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf38034b40 con 0x7fdf30003b00 2023-12-20T04:48:08.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.928+0000 7fdf2ffff640 1 -- 172.21.15.132:0/93876296 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdf38034ca0 con 0x7fdf30003b00 2023-12-20T04:48:08.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.928+0000 7fdf2ffff640 1 -- 172.21.15.132:0/93876296 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdf38004260 con 0x7fdf30003b00 2023-12-20T04:48:08.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.928+0000 7fdf4de2b640 1 -- 172.21.15.132:0/93876296 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdf4814fa40 con 0x7fdf30003b00 2023-12-20T04:48:08.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.928+0000 7fdf4de2b640 1 -- 172.21.15.132:0/93876296 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdf48150000 con 0x7fdf30003b00 2023-12-20T04:48:08.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.928+0000 7fdf4de2b640 1 -- 172.21.15.132:0/93876296 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdf48150190 con 0x7fdf30003b00 2023-12-20T04:48:08.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.929+0000 7fdf2ffff640 1 -- 172.21.15.132:0/93876296 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdf38003610 con 0x7fdf30003b00 2023-12-20T04:48:08.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.929+0000 7fdf2ffff640 1 --2- 172.21.15.132:0/93876296 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdf3406a430 0x7fdf3406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:08.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.929+0000 7fdf2ffff640 1 -- 172.21.15.132:0/93876296 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdf380aad10 con 0x7fdf30003b00 2023-12-20T04:48:08.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.929+0000 7fdf46ffd640 1 --2- 172.21.15.132:0/93876296 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdf3406a430 0x7fdf3406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:08.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.930+0000 7fdf46ffd640 1 --2- 172.21.15.132:0/93876296 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdf3406a430 0x7fdf3406c8f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdf481f22a0 tx=0x7fdf3c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:08.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:08.934+0000 7fdf2ffff640 1 -- 172.21.15.132:0/93876296 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdf380764b0 con 0x7fdf30003b00 2023-12-20T04:48:09.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.133+0000 7fdf4de2b640 1 -- 172.21.15.132:0/93876296 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fdf4804e840 con 0x7fdf30003b00 2023-12-20T04:48:09.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.133+0000 7fdf2ffff640 1 -- 172.21.15.132:0/93876296 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4723 (secure 0 0 0) 0x7fdf38079ad0 con 0x7fdf30003b00 2023-12-20T04:48:09.134 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:09.134 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":45,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3951194420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3951194420},{"type":"v1","addr":"172.21.15.187:6833","nonce":3951194420}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1575999914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1575999914},{"type":"v1","addr":"172.21.15.187:6835","nonce":1575999914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2208233017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2208233017},{"type":"v1","addr":"172.21.15.132:6836","nonce":2208233017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:48:04.456610+0000","modified":"2023-12-20T04:48:07.132847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7422":{"gid":7422,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/3935356761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":3935356761},{"type":"v1","addr":"172.21.15.132:6837","nonce":3935356761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-20T04:48:09.135 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 45 2023-12-20T04:48:09.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.135+0000 7fdf4de2b640 1 -- 172.21.15.132:0/93876296 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdf3406a430 msgr2=0x7fdf3406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:09.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.135+0000 7fdf4de2b640 1 --2- 172.21.15.132:0/93876296 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdf3406a430 0x7fdf3406c8f0 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7fdf481f22a0 tx=0x7fdf3c009040 comp rx=0 tx=0).stop 2023-12-20T04:48:09.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.135+0000 7fdf4de2b640 1 -- 172.21.15.132:0/93876296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf30003b00 msgr2=0x7fdf4814f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:09.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.135+0000 7fdf4de2b640 1 --2- 172.21.15.132:0/93876296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf30003b00 0x7fdf4814f180 secure :-1 s=READY pgs=1208 cs=0 l=1 rev1=1 crypto rx=0x7fdf38037040 tx=0x7fdf38004730 comp rx=0 tx=0).stop 2023-12-20T04:48:09.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.135+0000 7fdf4de2b640 1 -- 172.21.15.132:0/93876296 shutdown_connections 2023-12-20T04:48:09.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.135+0000 7fdf4de2b640 1 --2- 172.21.15.132:0/93876296 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdf3406a430 0x7fdf3406c8f0 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.135+0000 7fdf4de2b640 1 --2- 172.21.15.132:0/93876296 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdf480cb410 0x7fdf480cb890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.135+0000 7fdf4de2b640 1 --2- 172.21.15.132:0/93876296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdf48149460 0x7fdf4814cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.135+0000 7fdf4de2b640 1 --2- 172.21.15.132:0/93876296 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdf30003b00 0x7fdf4814f180 unknown :-1 s=CLOSED pgs=1208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.135+0000 7fdf4de2b640 1 -- 172.21.15.132:0/93876296 >> 172.21.15.132:0/93876296 conn(0x7fdf480ced10 msgr2=0x7fdf480b3870 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:09.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.135+0000 7fdf4de2b640 1 -- 172.21.15.132:0/93876296 shutdown_connections 2023-12-20T04:48:09.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.135+0000 7fdf4de2b640 1 -- 172.21.15.132:0/93876296 wait complete. 2023-12-20T04:48:09.550 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 45, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-20T04:48:04.456610+0000', 'modified': '2023-12-20T04:48:07.132847+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7422}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7422': {'gid': 7422, 'name': 'a', 'rank': 0, 'incarnation': 42, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6837/3935356761', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6835', 'nonce': 3935356761}, {'type': 'v1', 'addr': '172.21.15.132:6837', 'nonce': 3935356761}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [15], 'metadata_pool': 14, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-20T04:48:09.550 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-20T04:48:09.550 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-20T04:48:09.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.652+0000 7fc50f173640 1 Processor -- start 2023-12-20T04:48:09.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.652+0000 7fc50f173640 1 -- start start 2023-12-20T04:48:09.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.653+0000 7fc50f173640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc508143700 0x7fc5080704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.653+0000 7fc50f173640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc508070a30 0x7fc50815dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.653+0000 7fc50f173640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc50815dff0 0x7fc5080cd6e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.653+0000 7fc50f173640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc508070eb0 con 0x7fc508143700 2023-12-20T04:48:09.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.653+0000 7fc50f173640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc508143ae0 con 0x7fc50815dff0 2023-12-20T04:48:09.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.653+0000 7fc50f173640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc50815e7e0 con 0x7fc508070a30 2023-12-20T04:48:09.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.653+0000 7fc50cf0f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc508143700 0x7fc5080704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.653+0000 7fc50cf0f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc508143700 0x7fc5080704f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44660/0 (socket says 172.21.15.132:44660) 2023-12-20T04:48:09.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.653+0000 7fc50cf0f640 1 -- 172.21.15.132:0/3707090707 learned_addr learned my addr 172.21.15.132:0/3707090707 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:09.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.654+0000 7fc507fff640 1 --2- 172.21.15.132:0/3707090707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc508070a30 0x7fc50815dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.654+0000 7fc50d710640 1 --2- 172.21.15.132:0/3707090707 >> v2:172.21.15.187:3300/0 conn(0x7fc50815dff0 0x7fc5080cd6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.654+0000 7fc50cf0f640 1 -- 172.21.15.132:0/3707090707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc508070a30 msgr2=0x7fc50815dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:09.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.654+0000 7fc50cf0f640 1 --2- 172.21.15.132:0/3707090707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc508070a30 0x7fc50815dab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.654+0000 7fc50cf0f640 1 -- 172.21.15.132:0/3707090707 >> v2:172.21.15.187:3300/0 conn(0x7fc50815dff0 msgr2=0x7fc5080cd6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:09.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.654+0000 7fc50cf0f640 1 --2- 172.21.15.132:0/3707090707 >> v2:172.21.15.187:3300/0 conn(0x7fc50815dff0 0x7fc5080cd6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.654+0000 7fc50cf0f640 1 -- 172.21.15.132:0/3707090707 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc5080c4a30 con 0x7fc508143700 2023-12-20T04:48:09.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.654+0000 7fc50d710640 1 --2- 172.21.15.132:0/3707090707 >> v2:172.21.15.187:3300/0 conn(0x7fc50815dff0 0x7fc5080cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:09.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.654+0000 7fc50cf0f640 1 --2- 172.21.15.132:0/3707090707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc508143700 0x7fc5080704f0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fc5080c6690 tx=0x7fc4f802e0e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f07c1e38875b6ea5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:09.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.655+0000 7fc5077fe640 1 -- 172.21.15.132:0/3707090707 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f802ee90 con 0x7fc508143700 2023-12-20T04:48:09.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.655+0000 7fc5077fe640 1 -- 172.21.15.132:0/3707090707 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4f8036440 con 0x7fc508143700 2023-12-20T04:48:09.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.655+0000 7fc5077fe640 1 -- 172.21.15.132:0/3707090707 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f80367d0 con 0x7fc508143700 2023-12-20T04:48:09.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.655+0000 7fc50f173640 1 -- 172.21.15.132:0/3707090707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc508143700 msgr2=0x7fc5080704f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:09.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.655+0000 7fc50f173640 1 --2- 172.21.15.132:0/3707090707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc508143700 0x7fc5080704f0 secure :-1 s=READY pgs=1209 cs=0 l=1 rev1=1 crypto rx=0x7fc5080c6690 tx=0x7fc4f802e0e0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.655+0000 7fc50f173640 1 -- 172.21.15.132:0/3707090707 shutdown_connections 2023-12-20T04:48:09.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.655+0000 7fc50f173640 1 --2- 172.21.15.132:0/3707090707 >> v2:172.21.15.187:3300/0 conn(0x7fc50815dff0 0x7fc5080cd6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.655+0000 7fc50f173640 1 --2- 172.21.15.132:0/3707090707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc508070a30 0x7fc50815dab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.655+0000 7fc50f173640 1 --2- 172.21.15.132:0/3707090707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc508143700 0x7fc5080704f0 unknown :-1 s=CLOSED pgs=1209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.655+0000 7fc50f173640 1 -- 172.21.15.132:0/3707090707 >> 172.21.15.132:0/3707090707 conn(0x7fc5080cfb10 msgr2=0x7fc5080cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:09.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.655+0000 7fc50f173640 1 -- 172.21.15.132:0/3707090707 shutdown_connections 2023-12-20T04:48:09.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.655+0000 7fc50f173640 1 -- 172.21.15.132:0/3707090707 wait complete. 2023-12-20T04:48:09.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.656+0000 7fc50f173640 1 Processor -- start 2023-12-20T04:48:09.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.656+0000 7fc50f173640 1 -- start start 2023-12-20T04:48:09.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.657+0000 7fc50f173640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc508070a30 0x7fc5080ae060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.657+0000 7fc50f173640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc508143700 0x7fc5080ae5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.657+0000 7fc50f173640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc50815dff0 0x7fc5080c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.657+0000 7fc50f173640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5080b4f60 con 0x7fc508143700 2023-12-20T04:48:09.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.657+0000 7fc50f173640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5080aeae0 con 0x7fc508070a30 2023-12-20T04:48:09.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.657+0000 7fc50f173640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5081f3cd0 con 0x7fc50815dff0 2023-12-20T04:48:09.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.657+0000 7fc507fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc508143700 0x7fc5080ae5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.657+0000 7fc507fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc508143700 0x7fc5080ae5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44676/0 (socket says 172.21.15.132:44676) 2023-12-20T04:48:09.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.657+0000 7fc507fff640 1 -- 172.21.15.132:0/99916469 learned_addr learned my addr 172.21.15.132:0/99916469 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:09.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.658+0000 7fc507fff640 1 -- 172.21.15.132:0/99916469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc50815dff0 msgr2=0x7fc5080c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:09.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.658+0000 7fc507fff640 1 --2- 172.21.15.132:0/99916469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc50815dff0 0x7fc5080c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.658+0000 7fc507fff640 1 -- 172.21.15.132:0/99916469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc508070a30 msgr2=0x7fc5080ae060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:09.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.658+0000 7fc507fff640 1 --2- 172.21.15.132:0/99916469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc508070a30 0x7fc5080ae060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.658+0000 7fc507fff640 1 -- 172.21.15.132:0/99916469 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4f800b770 con 0x7fc508143700 2023-12-20T04:48:09.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.658+0000 7fc507fff640 1 --2- 172.21.15.132:0/99916469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc508143700 0x7fc5080ae5a0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00e8c0 tx=0x7fc4fc00ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:09.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.658+0000 7fc5057fa640 1 -- 172.21.15.132:0/99916469 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc00c940 con 0x7fc508143700 2023-12-20T04:48:09.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.658+0000 7fc5057fa640 1 -- 172.21.15.132:0/99916469 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc4fc00caa0 con 0x7fc508143700 2023-12-20T04:48:09.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.658+0000 7fc50f173640 1 -- 172.21.15.132:0/99916469 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5081f30c0 con 0x7fc508143700 2023-12-20T04:48:09.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.658+0000 7fc5057fa640 1 -- 172.21.15.132:0/99916469 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4fc00ce30 con 0x7fc508143700 2023-12-20T04:48:09.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.658+0000 7fc50f173640 1 -- 172.21.15.132:0/99916469 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5081f3680 con 0x7fc508143700 2023-12-20T04:48:09.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.659+0000 7fc5057fa640 1 -- 172.21.15.132:0/99916469 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc4fc013470 con 0x7fc508143700 2023-12-20T04:48:09.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.660+0000 7fc5057fa640 1 --2- 172.21.15.132:0/99916469 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc4f406a430 0x7fc4f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.660+0000 7fc5057fa640 1 -- 172.21.15.132:0/99916469 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4fc088af0 con 0x7fc508143700 2023-12-20T04:48:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.660+0000 7fc50cf0f640 1 --2- 172.21.15.132:0/99916469 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc4f406a430 0x7fc4f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.660+0000 7fc50cf0f640 1 --2- 172.21.15.132:0/99916469 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc4f406a430 0x7fc4f406c8f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8038000 tx=0x7fc4f8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.661+0000 7fc511dc3740 1 Processor -- start 2023-12-20T04:48:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.661+0000 7fc511dc3740 1 -- start start 2023-12-20T04:48:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.661+0000 7fc511dc3740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38390 0x55d8eba0b520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.661+0000 7fc511dc3740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38770 0x55d8eba3b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.661+0000 7fc511dc3740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0ba60 0x55d8eba3b660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.661+0000 7fc511dc3740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8eb97b0b0 con 0x55d8eba0ba60 2023-12-20T04:48:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.661+0000 7fc511dc3740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8eb978840 con 0x55d8eba38390 2023-12-20T04:48:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.661+0000 7fc511dc3740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8eb974130 con 0x55d8eba38770 2023-12-20T04:48:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.661+0000 7fc50d710640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0ba60 0x55d8eba3b660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.661+0000 7fc50d710640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0ba60 0x55d8eba3b660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44688/0 (socket says 172.21.15.132:44688) 2023-12-20T04:48:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.661+0000 7fc50d710640 1 -- 172.21.15.132:0/2827654100 learned_addr learned my addr 172.21.15.132:0/2827654100 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:09.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.662+0000 7fc507fff640 1 --2- 172.21.15.132:0/2827654100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38770 0x55d8eba3b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.662+0000 7fc50cf0f640 1 --2- 172.21.15.132:0/2827654100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38390 0x55d8eba0b520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.662+0000 7fc50d710640 1 -- 172.21.15.132:0/2827654100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38770 msgr2=0x55d8eba3b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.662+0000 7fc50d710640 1 --2- 172.21.15.132:0/2827654100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38770 0x55d8eba3b120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.662+0000 7fc50d710640 1 -- 172.21.15.132:0/2827654100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38390 msgr2=0x55d8eba0b520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.662+0000 7fc50d710640 1 --2- 172.21.15.132:0/2827654100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38390 0x55d8eba0b520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.662+0000 7fc50d710640 1 -- 172.21.15.132:0/2827654100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8eb92ec40 con 0x55d8eba0ba60 2023-12-20T04:48:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.662+0000 7fc50d710640 1 --2- 172.21.15.132:0/2827654100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0ba60 0x55d8eba3b660 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fc500009f30 tx=0x7fc5000077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91d179f757f94929 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.662+0000 7fc4ee7fc640 1 -- 172.21.15.132:0/2827654100 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500003b90 con 0x55d8eba0ba60 2023-12-20T04:48:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.662+0000 7fc4ee7fc640 1 -- 172.21.15.132:0/2827654100 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50000f040 con 0x55d8eba0ba60 2023-12-20T04:48:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.662+0000 7fc4ee7fc640 1 -- 172.21.15.132:0/2827654100 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500004030 con 0x55d8eba0ba60 2023-12-20T04:48:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.662+0000 7fc511dc3740 1 -- 172.21.15.132:0/2827654100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0ba60 msgr2=0x55d8eba3b660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.662+0000 7fc511dc3740 1 --2- 172.21.15.132:0/2827654100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0ba60 0x55d8eba3b660 secure :-1 s=READY pgs=1211 cs=0 l=1 rev1=1 crypto rx=0x7fc500009f30 tx=0x7fc5000077c0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.663+0000 7fc511dc3740 1 -- 172.21.15.132:0/2827654100 shutdown_connections 2023-12-20T04:48:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.663+0000 7fc511dc3740 1 --2- 172.21.15.132:0/2827654100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0ba60 0x55d8eba3b660 unknown :-1 s=CLOSED pgs=1211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.663+0000 7fc511dc3740 1 --2- 172.21.15.132:0/2827654100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38770 0x55d8eba3b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.663+0000 7fc511dc3740 1 --2- 172.21.15.132:0/2827654100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38390 0x55d8eba0b520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.663+0000 7fc511dc3740 1 -- 172.21.15.132:0/2827654100 >> 172.21.15.132:0/2827654100 conn(0x55d8eba0d830 msgr2=0x55d8eba56120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.663+0000 7fc511dc3740 1 -- 172.21.15.132:0/2827654100 shutdown_connections 2023-12-20T04:48:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.663+0000 7fc511dc3740 1 -- 172.21.15.132:0/2827654100 wait complete. 2023-12-20T04:48:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.663+0000 7fc511dc3740 1 -- start start 2023-12-20T04:48:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.663+0000 7fc511dc3740 1 Processor -- start 2023-12-20T04:48:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc511dc3740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38390 0x55d8eba3eac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc511dc3740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38770 0x55d8eba68d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc511dc3740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba699d0 0x55d8eba692c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc511dc3740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8eb932840 con 0x55d8eba699d0 2023-12-20T04:48:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc511dc3740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8eb9324e0 con 0x55d8eba38390 2023-12-20T04:48:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc511dc3740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8eb8f8230 con 0x55d8eba38770 2023-12-20T04:48:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc511dc3740 10 client.0 _ll_register_callbacks cb 0x55d8eb9496d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:48:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc50d710640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba699d0 0x55d8eba692c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc50d710640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba699d0 0x55d8eba692c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44700/0 (socket says 172.21.15.132:44700) 2023-12-20T04:48:09.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc50d710640 1 -- 172.21.15.132:0/3812634008 learned_addr learned my addr 172.21.15.132:0/3812634008 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:09.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc507fff640 1 --2- 172.21.15.132:0/3812634008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38770 0x55d8eba68d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc50cf0f640 1 --2- 172.21.15.132:0/3812634008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38390 0x55d8eba3eac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc50d710640 1 -- 172.21.15.132:0/3812634008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38770 msgr2=0x55d8eba68d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:09.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc50d710640 1 --2- 172.21.15.132:0/3812634008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38770 0x55d8eba68d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc50d710640 1 -- 172.21.15.132:0/3812634008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38390 msgr2=0x55d8eba3eac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:09.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc50d710640 1 --2- 172.21.15.132:0/3812634008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38390 0x55d8eba3eac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc50d710640 1 -- 172.21.15.132:0/3812634008 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc500009b30 con 0x55d8eba699d0 2023-12-20T04:48:09.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.664+0000 7fc50cf0f640 1 --2- 172.21.15.132:0/3812634008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38390 0x55d8eba3eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:09.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.665+0000 7fc50d710640 1 --2- 172.21.15.132:0/3812634008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba699d0 0x55d8eba692c0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fc50000afd0 tx=0x7fc500009570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1da58424c47781c2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:09.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.665+0000 7fc4e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:48:09.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.665+0000 7fc4e77fe640 1 -- 172.21.15.132:0/3812634008 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500004500 con 0x55d8eba699d0 2023-12-20T04:48:09.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.665+0000 7fc4e77fe640 1 -- 172.21.15.132:0/3812634008 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc500004660 con 0x55d8eba699d0 2023-12-20T04:48:09.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.665+0000 7fc511dc3740 1 -- 172.21.15.132:0/3812634008 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8eb99d970 con 0x55d8eba699d0 2023-12-20T04:48:09.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.665+0000 7fc4e77fe640 1 -- 172.21.15.132:0/3812634008 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc500004820 con 0x55d8eba699d0 2023-12-20T04:48:09.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.665+0000 7fc511dc3740 10 client.7563 fetch_fsmap learned FSMap version 45 2023-12-20T04:48:09.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.665+0000 7fc511dc3740 1 -- 172.21.15.132:0/3812634008 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x55d8eb9727b0 con 0x55d8eba699d0 2023-12-20T04:48:09.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.665+0000 7fc4e77fe640 1 -- 172.21.15.132:0/3812634008 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d8eb99d970 con 0x55d8eba699d0 2023-12-20T04:48:09.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.665+0000 7fc4e77fe640 1 -- 172.21.15.132:0/3812634008 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 45) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc500012070 con 0x55d8eba699d0 2023-12-20T04:48:09.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.665+0000 7fc511dc3740 10 client.7563 fetch_fsmap finished waiting for FSMap version 45 2023-12-20T04:48:09.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.665+0000 7fc511dc3740 10 client.7563 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-20T04:48:09.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.665+0000 7fc511dc3740 20 client.7563 populate_metadata read hostname 'smithi132' 2023-12-20T04:48:09.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.665+0000 7fc511dc3740 1 --2- 172.21.15.132:0/3812634008 >> [v2:172.21.15.132:6835/3935356761,v1:172.21.15.132:6837/3935356761] conn(0x55d8eba71080 0x55d8eba73470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.665+0000 7fc511dc3740 4 client.7563 mds_command: new command op to 7422 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-20T04:48:09.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.665+0000 7fc511dc3740 1 -- 172.21.15.132:0/3812634008 --> [v2:172.21.15.132:6835/3935356761,v1:172.21.15.132:6837/3935356761] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8eb965f00 con 0x55d8eba71080 2023-12-20T04:48:09.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.665+0000 7fc50cf0f640 1 --2- 172.21.15.132:0/3812634008 >> [v2:172.21.15.132:6835/3935356761,v1:172.21.15.132:6837/3935356761] conn(0x55d8eba71080 0x55d8eba73470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.666+0000 7fc4e77fe640 10 client.7563 ms_handle_connect on v2:172.21.15.132:6835/3935356761 2023-12-20T04:48:09.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.666+0000 7fc50cf0f640 1 --2- 172.21.15.132:0/3812634008 >> [v2:172.21.15.132:6835/3935356761,v1:172.21.15.132:6837/3935356761] conn(0x55d8eba71080 0x55d8eba73470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=118f776efd96a6c0 server_cookie=8d24497bde1a0e2a in_seq=0 out_seq=0 2023-12-20T04:48:09.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.666+0000 7fc4e77fe640 1 -- 172.21.15.132:0/3812634008 <== mds.0 v2:172.21.15.132:6835/3935356761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55d8eb965f00 con 0x55d8eba71080 2023-12-20T04:48:09.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.666+0000 7fc4e77fe640 10 client.7563 handle_command_reply: tid=0 2023-12-20T04:48:09.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.666+0000 7fc511dc3740 1 client.7563 shutdown 2023-12-20T04:48:09.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.666+0000 7fc511dc3740 1 -- 172.21.15.132:0/3812634008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba699d0 msgr2=0x55d8eba692c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:09.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.666+0000 7fc511dc3740 1 --2- 172.21.15.132:0/3812634008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba699d0 0x55d8eba692c0 secure :-1 s=READY pgs=1212 cs=0 l=1 rev1=1 crypto rx=0x7fc50000afd0 tx=0x7fc500009570 comp rx=0 tx=0).stop 2023-12-20T04:48:09.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.666+0000 7fc511dc3740 1 -- 172.21.15.132:0/3812634008 shutdown_connections 2023-12-20T04:48:09.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.666+0000 7fc511dc3740 1 --2- 172.21.15.132:0/3812634008 >> [v2:172.21.15.132:6835/3935356761,v1:172.21.15.132:6837/3935356761] conn(0x55d8eba71080 0x55d8eba73470 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.666+0000 7fc511dc3740 1 --2- 172.21.15.132:0/3812634008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba699d0 0x55d8eba692c0 unknown :-1 s=CLOSED pgs=1212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.666+0000 7fc4e77fe640 0 client.7563 ms_handle_reset on v2:172.21.15.132:6835/3935356761 2023-12-20T04:48:09.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.666+0000 7fc511dc3740 1 --2- 172.21.15.132:0/3812634008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38770 0x55d8eba68d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.666+0000 7fc511dc3740 1 --2- 172.21.15.132:0/3812634008 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38390 0x55d8eba3eac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.666+0000 7fc511dc3740 1 -- 172.21.15.132:0/3812634008 >> 172.21.15.132:0/3812634008 conn(0x55d8eba0ba60 msgr2=0x55d8eba0f340 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:09.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.667+0000 7fc511dc3740 1 -- 172.21.15.132:0/3812634008 shutdown_connections 2023-12-20T04:48:09.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.667+0000 7fc511dc3740 1 -- 172.21.15.132:0/3812634008 wait complete. 2023-12-20T04:48:09.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.667+0000 7fc511dc3740 20 client.7563 trim_cache size 0 max 16384 2023-12-20T04:48:09.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.681+0000 7fc511dc3740 1 Processor -- start 2023-12-20T04:48:09.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.681+0000 7fc511dc3740 1 -- start start 2023-12-20T04:48:09.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.682+0000 7fc511dc3740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38390 0x55d8eba0f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.682+0000 7fc511dc3740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38770 0x55d8eba55b00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.682+0000 7fc511dc3740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0f5c0 0x55d8eba56040 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.682+0000 7fc511dc3740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8eb9732d0 con 0x55d8eba0f5c0 2023-12-20T04:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.682+0000 7fc511dc3740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8eba0be40 con 0x55d8eba38770 2023-12-20T04:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.682+0000 7fc511dc3740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8eba0a620 con 0x55d8eba38390 2023-12-20T04:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.682+0000 7fc50d710640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0f5c0 0x55d8eba56040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.682+0000 7fc50d710640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0f5c0 0x55d8eba56040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44710/0 (socket says 172.21.15.132:44710) 2023-12-20T04:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.682+0000 7fc50d710640 1 -- 172.21.15.132:0/3254232838 learned_addr learned my addr 172.21.15.132:0/3254232838 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.682+0000 7fc50d710640 1 -- 172.21.15.132:0/3254232838 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38390 msgr2=0x55d8eba0f080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.682+0000 7fc50d710640 1 --2- 172.21.15.132:0/3254232838 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38390 0x55d8eba0f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.682+0000 7fc50d710640 1 -- 172.21.15.132:0/3254232838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38770 msgr2=0x55d8eba55b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.682+0000 7fc50d710640 1 --2- 172.21.15.132:0/3254232838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38770 0x55d8eba55b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.682+0000 7fc50d710640 1 -- 172.21.15.132:0/3254232838 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8eb914be0 con 0x55d8eba0f5c0 2023-12-20T04:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.683+0000 7fc50d710640 1 --2- 172.21.15.132:0/3254232838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0f5c0 0x55d8eba56040 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fc500002230 tx=0x7fc50001d000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e8a2fec0a7840d8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.683+0000 7fc4eeffd640 1 -- 172.21.15.132:0/3254232838 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc5000125b0 con 0x55d8eba0f5c0 2023-12-20T04:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.683+0000 7fc4eeffd640 1 -- 172.21.15.132:0/3254232838 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc500007160 con 0x55d8eba0f5c0 2023-12-20T04:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.683+0000 7fc4eeffd640 1 -- 172.21.15.132:0/3254232838 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc500012770 con 0x55d8eba0f5c0 2023-12-20T04:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.683+0000 7fc511dc3740 1 -- 172.21.15.132:0/3254232838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0f5c0 msgr2=0x55d8eba56040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.683+0000 7fc511dc3740 1 --2- 172.21.15.132:0/3254232838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0f5c0 0x55d8eba56040 secure :-1 s=READY pgs=1213 cs=0 l=1 rev1=1 crypto rx=0x7fc500002230 tx=0x7fc50001d000 comp rx=0 tx=0).stop 2023-12-20T04:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.683+0000 7fc511dc3740 1 -- 172.21.15.132:0/3254232838 shutdown_connections 2023-12-20T04:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.683+0000 7fc511dc3740 1 --2- 172.21.15.132:0/3254232838 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0f5c0 0x55d8eba56040 unknown :-1 s=CLOSED pgs=1213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.683+0000 7fc511dc3740 1 --2- 172.21.15.132:0/3254232838 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38770 0x55d8eba55b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.683+0000 7fc511dc3740 1 --2- 172.21.15.132:0/3254232838 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38390 0x55d8eba0f080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.683+0000 7fc511dc3740 1 -- 172.21.15.132:0/3254232838 >> 172.21.15.132:0/3254232838 conn(0x55d8eba0ba60 msgr2=0x55d8eba06880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.683+0000 7fc511dc3740 1 -- 172.21.15.132:0/3254232838 shutdown_connections 2023-12-20T04:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.683+0000 7fc511dc3740 1 -- 172.21.15.132:0/3254232838 wait complete. 2023-12-20T04:48:09.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.684+0000 7fc511dc3740 1 -- start start 2023-12-20T04:48:09.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.684+0000 7fc511dc3740 1 Processor -- start 2023-12-20T04:48:09.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc511dc3740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0f5c0 0x55d8eba56020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc511dc3740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38390 0x55d8eba68d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc511dc3740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38770 0x55d8eba10b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc511dc3740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8eba77810 con 0x55d8eba0f5c0 2023-12-20T04:48:09.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc511dc3740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8eba311b0 con 0x55d8eba38770 2023-12-20T04:48:09.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc511dc3740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8eba568e0 con 0x55d8eba38390 2023-12-20T04:48:09.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc511dc3740 10 client.0 _ll_register_callbacks cb 0x7fc508066d80 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:48:09.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc50cf0f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0f5c0 0x55d8eba56020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc50cf0f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0f5c0 0x55d8eba56020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44712/0 (socket says 172.21.15.132:44712) 2023-12-20T04:48:09.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc50cf0f640 1 -- 172.21.15.132:0/1547407014 learned_addr learned my addr 172.21.15.132:0/1547407014 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:09.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc507fff640 1 --2- 172.21.15.132:0/1547407014 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38390 0x55d8eba68d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc50d710640 1 --2- 172.21.15.132:0/1547407014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38770 0x55d8eba10b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc50cf0f640 1 -- 172.21.15.132:0/1547407014 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38390 msgr2=0x55d8eba68d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:09.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc50cf0f640 1 --2- 172.21.15.132:0/1547407014 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38390 0x55d8eba68d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc50cf0f640 1 -- 172.21.15.132:0/1547407014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38770 msgr2=0x55d8eba10b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:09.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc50cf0f640 1 --2- 172.21.15.132:0/1547407014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38770 0x55d8eba10b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc50cf0f640 1 -- 172.21.15.132:0/1547407014 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8eb9727b0 con 0x55d8eba0f5c0 2023-12-20T04:48:09.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc507fff640 1 --2- 172.21.15.132:0/1547407014 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38390 0x55d8eba68d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:09.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc50d710640 1 --2- 172.21.15.132:0/1547407014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38770 0x55d8eba10b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:09.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc50cf0f640 1 --2- 172.21.15.132:0/1547407014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0f5c0 0x55d8eba56020 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8006da0 tx=0x7fc4f8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f34bc67e1a905e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:09.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc4e77fe640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:48:09.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc4e77fe640 1 -- 172.21.15.132:0/1547407014 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4f8052bc0 con 0x55d8eba0f5c0 2023-12-20T04:48:09.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc4e77fe640 1 -- 172.21.15.132:0/1547407014 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4f8046040 con 0x55d8eba0f5c0 2023-12-20T04:48:09.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.685+0000 7fc511dc3740 1 -- 172.21.15.132:0/1547407014 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc50000f040 con 0x55d8eba0f5c0 2023-12-20T04:48:09.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.686+0000 7fc4e77fe640 1 -- 172.21.15.132:0/1547407014 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=45) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc4f80523e0 con 0x55d8eba0f5c0 2023-12-20T04:48:09.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.686+0000 7fc511dc3740 10 client.7569 fetch_fsmap learned FSMap version 45 2023-12-20T04:48:09.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.686+0000 7fc511dc3740 1 -- 172.21.15.132:0/1547407014 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=45,monmap=2+}) v3 -- 0x55d8eb93a2f0 con 0x55d8eba0f5c0 2023-12-20T04:48:09.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.686+0000 7fc4e77fe640 1 -- 172.21.15.132:0/1547407014 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc50000f040 con 0x55d8eba0f5c0 2023-12-20T04:48:09.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.686+0000 7fc4e77fe640 1 -- 172.21.15.132:0/1547407014 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 45) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc4f803d030 con 0x55d8eba0f5c0 2023-12-20T04:48:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.686+0000 7fc511dc3740 10 client.7569 fetch_fsmap finished waiting for FSMap version 45 2023-12-20T04:48:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.686+0000 7fc511dc3740 10 client.7569 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-20T04:48:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.686+0000 7fc511dc3740 20 client.7569 populate_metadata read hostname 'smithi132' 2023-12-20T04:48:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.686+0000 7fc511dc3740 1 --2- 172.21.15.132:0/1547407014 >> [v2:172.21.15.132:6835/3935356761,v1:172.21.15.132:6837/3935356761] conn(0x55d8ebaabea0 0x55d8ebaac280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.686+0000 7fc511dc3740 4 client.7569 mds_command: new command op to 7422 tid=0[{"prefix": "status"}] 2023-12-20T04:48:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.686+0000 7fc511dc3740 1 -- 172.21.15.132:0/1547407014 --> [v2:172.21.15.132:6835/3935356761,v1:172.21.15.132:6837/3935356761] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d8eb96d1b0 con 0x55d8ebaabea0 2023-12-20T04:48:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.686+0000 7fc507fff640 1 --2- 172.21.15.132:0/1547407014 >> [v2:172.21.15.132:6835/3935356761,v1:172.21.15.132:6837/3935356761] conn(0x55d8ebaabea0 0x55d8ebaac280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.686+0000 7fc4e77fe640 10 client.7569 ms_handle_connect on v2:172.21.15.132:6835/3935356761 2023-12-20T04:48:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.686+0000 7fc507fff640 1 --2- 172.21.15.132:0/1547407014 >> [v2:172.21.15.132:6835/3935356761,v1:172.21.15.132:6837/3935356761] conn(0x55d8ebaabea0 0x55d8ebaac280 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f6c6bf4b097901 server_cookie=49ee36aac4d65f37 in_seq=0 out_seq=0 2023-12-20T04:48:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.686+0000 7fc4e77fe640 1 -- 172.21.15.132:0/1547407014 <== mds.0 v2:172.21.15.132:6835/3935356761 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55d8eb96d1b0 con 0x55d8ebaabea0 2023-12-20T04:48:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc4e77fe640 10 client.7569 handle_command_reply: tid=0 2023-12-20T04:48:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc511dc3740 1 client.7569 shutdown 2023-12-20T04:48:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc511dc3740 1 -- 172.21.15.132:0/1547407014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0f5c0 msgr2=0x55d8eba56020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:09.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc511dc3740 1 --2- 172.21.15.132:0/1547407014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0f5c0 0x55d8eba56020 secure :-1 s=READY pgs=1214 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8006da0 tx=0x7fc4f8004730 comp rx=0 tx=0).stop 2023-12-20T04:48:09.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc511dc3740 1 -- 172.21.15.132:0/1547407014 shutdown_connections 2023-12-20T04:48:09.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc511dc3740 1 --2- 172.21.15.132:0/1547407014 >> [v2:172.21.15.132:6835/3935356761,v1:172.21.15.132:6837/3935356761] conn(0x55d8ebaabea0 0x55d8ebaac280 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc511dc3740 1 --2- 172.21.15.132:0/1547407014 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8eba38770 0x55d8eba10b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc4e77fe640 0 client.7569 ms_handle_reset on v2:172.21.15.132:6835/3935356761 2023-12-20T04:48:09.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc511dc3740 1 --2- 172.21.15.132:0/1547407014 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8eba38390 0x55d8eba68d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc511dc3740 1 --2- 172.21.15.132:0/1547407014 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8eba0f5c0 0x55d8eba56020 unknown :-1 s=CLOSED pgs=1214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc511dc3740 1 -- 172.21.15.132:0/1547407014 >> 172.21.15.132:0/1547407014 conn(0x55d8eba0ba60 msgr2=0x55d8eba10480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:09.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc511dc3740 1 -- 172.21.15.132:0/1547407014 shutdown_connections 2023-12-20T04:48:09.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc511dc3740 1 -- 172.21.15.132:0/1547407014 wait complete. 2023-12-20T04:48:09.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc511dc3740 20 client.7569 trim_cache size 0 max 16384 2023-12-20T04:48:09.694 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:48:09.694 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:48:09.695 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-12-20T04:48:09.695 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 7422, 2023-12-20T04:48:09.695 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-12-20T04:48:09.695 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-12-20T04:48:09.695 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-12-20T04:48:09.695 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 5.2284769899999999, 2023-12-20T04:48:09.695 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 45, 2023-12-20T04:48:09.695 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 122, 2023-12-20T04:48:09.695 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 122, 2023-12-20T04:48:09.695 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 9.6307253880000001 2023-12-20T04:48:09.695 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:48:09.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc50f173640 1 -- 172.21.15.132:0/99916469 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc4f406a430 msgr2=0x7fc4f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:09.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc50f173640 1 --2- 172.21.15.132:0/99916469 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc4f406a430 0x7fc4f406c8f0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7fc4f8038000 tx=0x7fc4f8008040 comp rx=0 tx=0).stop 2023-12-20T04:48:09.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc50f173640 1 -- 172.21.15.132:0/99916469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc508143700 msgr2=0x7fc5080ae5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:09.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc50f173640 1 --2- 172.21.15.132:0/99916469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc508143700 0x7fc5080ae5a0 secure :-1 s=READY pgs=1210 cs=0 l=1 rev1=1 crypto rx=0x7fc4fc00e8c0 tx=0x7fc4fc00ed80 comp rx=0 tx=0).stop 2023-12-20T04:48:09.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc50f173640 1 -- 172.21.15.132:0/99916469 shutdown_connections 2023-12-20T04:48:09.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc50f173640 1 --2- 172.21.15.132:0/99916469 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc4f406a430 0x7fc4f406c8f0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc50f173640 1 --2- 172.21.15.132:0/99916469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc50815dff0 0x7fc5080c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc50f173640 1 --2- 172.21.15.132:0/99916469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc508143700 0x7fc5080ae5a0 unknown :-1 s=CLOSED pgs=1210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc50f173640 1 --2- 172.21.15.132:0/99916469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc508070a30 0x7fc5080ae060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc50f173640 1 -- 172.21.15.132:0/99916469 >> 172.21.15.132:0/99916469 conn(0x7fc5080cfb10 msgr2=0x7fc5080cb9c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:09.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.687+0000 7fc50f173640 1 -- 172.21.15.132:0/99916469 shutdown_connections 2023-12-20T04:48:09.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.688+0000 7fc50f173640 1 -- 172.21.15.132:0/99916469 wait complete. 2023-12-20T04:48:09.701 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:48:09.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.799+0000 7f761778e640 1 Processor -- start 2023-12-20T04:48:09.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.799+0000 7f761778e640 1 -- start start 2023-12-20T04:48:09.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.800+0000 7f761778e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7610159b50 0x7f76100c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.800+0000 7f761778e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f761015e530 0x7f761006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.800+0000 7f761778e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f761006c240 0x7f761006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.800+0000 7f761778e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f761006cc10 con 0x7f761015e530 2023-12-20T04:48:09.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.800+0000 7f761778e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76100caa60 con 0x7f761006c240 2023-12-20T04:48:09.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.800+0000 7f761778e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76100ccc90 con 0x7f7610159b50 2023-12-20T04:48:09.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.800+0000 7f7614d29640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f761015e530 0x7f761006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.800+0000 7f7614d29640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f761015e530 0x7f761006fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44726/0 (socket says 172.21.15.132:44726) 2023-12-20T04:48:09.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.800+0000 7f7614d29640 1 -- 172.21.15.132:0/1686037684 learned_addr learned my addr 172.21.15.132:0/1686037684 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:09.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.800+0000 7f761552a640 1 --2- 172.21.15.132:0/1686037684 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7610159b50 0x7f76100c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.800+0000 7f7615d2b640 1 --2- 172.21.15.132:0/1686037684 >> v2:172.21.15.187:3300/0 conn(0x7f761006c240 0x7f761006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.800+0000 7f7614d29640 1 -- 172.21.15.132:0/1686037684 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7610159b50 msgr2=0x7f76100c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:09.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.800+0000 7f7614d29640 1 --2- 172.21.15.132:0/1686037684 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7610159b50 0x7f76100c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.800+0000 7f7614d29640 1 -- 172.21.15.132:0/1686037684 >> v2:172.21.15.187:3300/0 conn(0x7f761006c240 msgr2=0x7f761006c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:09.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.800+0000 7f7614d29640 1 --2- 172.21.15.132:0/1686037684 >> v2:172.21.15.187:3300/0 conn(0x7f761006c240 0x7f761006c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.800+0000 7f7614d29640 1 -- 172.21.15.132:0/1686037684 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76100ccf30 con 0x7f761015e530 2023-12-20T04:48:09.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.801+0000 7f7614d29640 1 --2- 172.21.15.132:0/1686037684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761015e530 0x7f761006fd70 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f76100c5ce0 tx=0x7f760002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=876847d800eaa2e0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:09.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.801+0000 7f7607fff640 1 -- 172.21.15.132:0/1686037684 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600031870 con 0x7f761015e530 2023-12-20T04:48:09.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.801+0000 7f7607fff640 1 -- 172.21.15.132:0/1686037684 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76000319d0 con 0x7f761015e530 2023-12-20T04:48:09.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.801+0000 7f7607fff640 1 -- 172.21.15.132:0/1686037684 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7600031d60 con 0x7f761015e530 2023-12-20T04:48:09.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.802+0000 7f761778e640 1 -- 172.21.15.132:0/1686037684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761015e530 msgr2=0x7f761006fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:09.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.802+0000 7f761778e640 1 --2- 172.21.15.132:0/1686037684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761015e530 0x7f761006fd70 secure :-1 s=READY pgs=1215 cs=0 l=1 rev1=1 crypto rx=0x7f76100c5ce0 tx=0x7f760002b910 comp rx=0 tx=0).stop 2023-12-20T04:48:09.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.802+0000 7f761778e640 1 -- 172.21.15.132:0/1686037684 shutdown_connections 2023-12-20T04:48:09.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.802+0000 7f761778e640 1 --2- 172.21.15.132:0/1686037684 >> v2:172.21.15.187:3300/0 conn(0x7f761006c240 0x7f761006c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.802+0000 7f761778e640 1 --2- 172.21.15.132:0/1686037684 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761015e530 0x7f761006fd70 unknown :-1 s=CLOSED pgs=1215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.802+0000 7f761778e640 1 --2- 172.21.15.132:0/1686037684 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7610159b50 0x7f76100c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.802+0000 7f761778e640 1 -- 172.21.15.132:0/1686037684 >> 172.21.15.132:0/1686037684 conn(0x7f76100ced10 msgr2=0x7f76100cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:09.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.802+0000 7f761778e640 1 -- 172.21.15.132:0/1686037684 shutdown_connections 2023-12-20T04:48:09.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.802+0000 7f761778e640 1 -- 172.21.15.132:0/1686037684 wait complete. 2023-12-20T04:48:09.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.803+0000 7f761778e640 1 Processor -- start 2023-12-20T04:48:09.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.803+0000 7f761778e640 1 -- start start 2023-12-20T04:48:09.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f761778e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761006c240 0x7f76100c33f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f761778e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7610159b50 0x7f761014c760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f761778e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f761015e530 0x7f76101516f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f761778e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76100c2f60 con 0x7f761006c240 2023-12-20T04:48:09.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f761778e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f761014cca0 con 0x7f7610159b50 2023-12-20T04:48:09.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f761778e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76100c2950 con 0x7f761015e530 2023-12-20T04:48:09.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f761552a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761006c240 0x7f76100c33f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f761552a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761006c240 0x7f76100c33f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44742/0 (socket says 172.21.15.132:44742) 2023-12-20T04:48:09.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f761552a640 1 -- 172.21.15.132:0/1029053192 learned_addr learned my addr 172.21.15.132:0/1029053192 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:09.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f761552a640 1 -- 172.21.15.132:0/1029053192 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f761015e530 msgr2=0x7f76101516f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:09.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f761552a640 1 --2- 172.21.15.132:0/1029053192 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f761015e530 0x7f76101516f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f761552a640 1 -- 172.21.15.132:0/1029053192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7610159b50 msgr2=0x7f761014c760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:09.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f7614d29640 1 --2- 172.21.15.132:0/1029053192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7610159b50 0x7f761014c760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f761552a640 1 --2- 172.21.15.132:0/1029053192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7610159b50 0x7f761014c760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:09.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f761552a640 1 -- 172.21.15.132:0/1029053192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76000094d0 con 0x7f761006c240 2023-12-20T04:48:09.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f7614d29640 1 --2- 172.21.15.132:0/1029053192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7610159b50 0x7f761014c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:09.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f761552a640 1 --2- 172.21.15.132:0/1029053192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761006c240 0x7f76100c33f0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f760c00d800 tx=0x7f760c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:09.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.804+0000 7f7605ffb640 1 -- 172.21.15.132:0/1029053192 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c00b6c0 con 0x7f761006c240 2023-12-20T04:48:09.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.805+0000 7f7605ffb640 1 -- 172.21.15.132:0/1029053192 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f760c00b820 con 0x7f761006c240 2023-12-20T04:48:09.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.805+0000 7f761778e640 1 -- 172.21.15.132:0/1029053192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7610152270 con 0x7f761006c240 2023-12-20T04:48:09.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.805+0000 7f7605ffb640 1 -- 172.21.15.132:0/1029053192 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f760c00bbb0 con 0x7f761006c240 2023-12-20T04:48:09.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.805+0000 7f761778e640 1 -- 172.21.15.132:0/1029053192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76100c2bf0 con 0x7f761006c240 2023-12-20T04:48:09.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.806+0000 7f761778e640 1 -- 172.21.15.132:0/1029053192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76100c27b0 con 0x7f761006c240 2023-12-20T04:48:09.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.806+0000 7f7605ffb640 1 -- 172.21.15.132:0/1029053192 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f760c00bd10 con 0x7f761006c240 2023-12-20T04:48:09.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.806+0000 7f7605ffb640 1 --2- 172.21.15.132:0/1029053192 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f75f406a430 0x7f75f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:09.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.806+0000 7f7605ffb640 1 -- 172.21.15.132:0/1029053192 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f760c088de0 con 0x7f761006c240 2023-12-20T04:48:09.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.806+0000 7f7614d29640 1 --2- 172.21.15.132:0/1029053192 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f75f406a430 0x7f75f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:09.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.807+0000 7f7614d29640 1 --2- 172.21.15.132:0/1029053192 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f75f406a430 0x7f75f406c8f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7600036000 tx=0x7f760003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:09.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:09.810+0000 7f7605ffb640 1 -- 172.21.15.132:0/1029053192 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f76100c27b0 con 0x7f761006c240 2023-12-20T04:48:10.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:10.013+0000 7f761778e640 1 -- 172.21.15.132:0/1029053192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f76100c27b0 con 0x7f761006c240 2023-12-20T04:48:10.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:10.013+0000 7f7605ffb640 1 -- 172.21.15.132:0/1029053192 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v45) v1 ==== 53+0+73 (secure 0 0 0) 0x7f76100c27b0 con 0x7f761006c240 2023-12-20T04:48:10.014 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:48:10.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:10.015+0000 7f761778e640 1 -- 172.21.15.132:0/1029053192 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f75f406a430 msgr2=0x7f75f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:10.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:10.015+0000 7f761778e640 1 --2- 172.21.15.132:0/1029053192 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f75f406a430 0x7f75f406c8f0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7f7600036000 tx=0x7f760003c040 comp rx=0 tx=0).stop 2023-12-20T04:48:10.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:10.015+0000 7f761778e640 1 -- 172.21.15.132:0/1029053192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761006c240 msgr2=0x7f76100c33f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:10.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:10.015+0000 7f761778e640 1 --2- 172.21.15.132:0/1029053192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761006c240 0x7f76100c33f0 secure :-1 s=READY pgs=1216 cs=0 l=1 rev1=1 crypto rx=0x7f760c00d800 tx=0x7f760c00dcc0 comp rx=0 tx=0).stop 2023-12-20T04:48:10.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:10.015+0000 7f761778e640 1 -- 172.21.15.132:0/1029053192 shutdown_connections 2023-12-20T04:48:10.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:10.015+0000 7f761778e640 1 --2- 172.21.15.132:0/1029053192 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f75f406a430 0x7f75f406c8f0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:10.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:10.015+0000 7f761778e640 1 --2- 172.21.15.132:0/1029053192 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f761015e530 0x7f76101516f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:10.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:10.015+0000 7f761778e640 1 --2- 172.21.15.132:0/1029053192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7610159b50 0x7f761014c760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:10.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:10.015+0000 7f761778e640 1 --2- 172.21.15.132:0/1029053192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f761006c240 0x7f76100c33f0 unknown :-1 s=CLOSED pgs=1216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:10.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:10.015+0000 7f761778e640 1 -- 172.21.15.132:0/1029053192 >> 172.21.15.132:0/1029053192 conn(0x7f76100ced10 msgr2=0x7f76100cb410 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:10.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:10.015+0000 7f761778e640 1 -- 172.21.15.132:0/1029053192 shutdown_connections 2023-12-20T04:48:10.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:10.015+0000 7f761778e640 1 -- 172.21.15.132:0/1029053192 wait complete. 2023-12-20T04:48:10.027 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:48:10.027 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:48:10.027 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-12-20T04:48:10.027 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-20T04:48:10.027 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-20T04:48:10.027 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:48:10.027 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:48:10.027 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:48:10.027 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:48:10.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:10.028 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-12-20T04:48:10.043 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:48:10.043 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:48:10.043 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:48:10.043 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:10.043 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-20T04:48:10.043 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:10.043 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:48:10.043 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:10.043 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-12-20T04:48:10.043 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:48:10.043 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:10.043 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-12-20T04:48:10.044 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:48:10.044 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:10.044 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:48:10.044 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:10.044 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:48:10.044 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42384sec preferred_lft 42384sec 2023-12-20T04:48:10.044 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-12-20T04:48:10.044 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:10.044 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:48:10.044 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:10.044 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:48:10.044 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:10.044 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::60dd:37ff:fe28:558b/64 scope link 2023-12-20T04:48:10.044 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:10.044 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:48:10.045 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 86:13:fe:55:4c:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-20T04:48:10.045 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::8413:feff:fe55:4c04/64 scope link 2023-12-20T04:48:10.045 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:10.045 INFO:teuthology.orchestra.run.smithi132.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:48:10.045 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-20T04:48:10.045 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::839:72ff:fea7:b332/64 scope link 2023-12-20T04:48:10.045 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:10.045 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:10.045 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:48:10.109 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-20T04:48:10.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:10.110 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-12-20T04:48:10.166 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-12-20T04:48:10.166 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:48:10.166 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:48:10.166 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:48:10.166 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:48:10.167 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:10.167 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:48:10.167 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:48:10.167 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:48:10.167 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:48:10.167 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:48:10.167 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:48:10.261 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:10.261 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-20T04:48:10.276 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-20T04:48:10.276 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-20T04:48:10.276 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:48:10.276 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:10.276 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-12-20T04:48:10.343 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-20T04:48:10.343 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:48:10.343 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-20T04:48:10.398 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:48:10.398 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:48:10.398 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:48:10.453 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:48:10.519 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:48:10.519 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:48:10.585 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:48:10.586 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:48:10.587 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:10.587 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:48:10.641 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:48:10.641 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-20T04:48:10.684 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:48:10.710 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:48:10.710 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:48:10.770 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:2023-12-20T04:48:10.768+0000 7f9f16640480 -1 init, newargv = 0x557bf1151500 newargc=15 2023-12-20T04:48:10.770 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[110748]: starting ceph client 2023-12-20T04:48:10.773 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[110748]: starting fuse 2023-12-20T04:48:10.778 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:48:10.779 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:48:10.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:10.780 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:48:10.834 INFO:teuthology.orchestra.run.smithi132.stdout:41 2023-12-20T04:48:10.834 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:48:10.834 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:48:10.835 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:48:10.835 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:48:10.835 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:48:10.835 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:48:10.835 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:10.835 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:48:10.835 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:48:10.835 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:48:10.835 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:48:10.835 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:10.835 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:48:10.835 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:48:10.835 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:48:10.835 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:48:10.835 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:10.835 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:48:10.836 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:48:10.836 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:48:10.836 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:48:10.836 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:48:10.836 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:48:10.836 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:48:10.836 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:48:10.836 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:10.836 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:48:10.836 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:48:10.950 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.110748.asok 2023-12-20T04:48:11.137 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.110748.asok 2023-12-20T04:48:11.137 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:11.137 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.110748.asok status 2023-12-20T04:48:11.270 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:48:11.270 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:48:11.270 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:48:11.270 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:48:11.270 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:48:11.270 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:48:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:48:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "110748", 2023-12-20T04:48:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:48:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2023-12-20T04:48:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:48:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 7581, 2023-12-20T04:48:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:48:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:48:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:48:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 7581 2023-12-20T04:48:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:48:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:48:11.271 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3640881913 2023-12-20T04:48:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:48:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:48:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3640881913 2023-12-20T04:48:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.7581 192.168.0.1:0/3640881913", 2023-12-20T04:48:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/3640881913", 2023-12-20T04:48:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2023-12-20T04:48:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 45, 2023-12-20T04:48:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 122, 2023-12-20T04:48:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:48:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:48:11.272 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:48:11.273 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:48:11.278 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:11.279 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2023-12-20T04:48:11.279 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-20T04:48:11.294 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2023-12-20T04:48:11.294 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-20T04:48:11.294 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:11.294 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:48:11.363 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:48:11.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.500+0000 7fb043296640 1 Processor -- start 2023-12-20T04:48:11.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.501+0000 7fb043296640 1 -- start start 2023-12-20T04:48:11.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.501+0000 7fb043296640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb03c15e530 0x7fb03c06fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:11.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.501+0000 7fb043296640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03c06c240 0x7fb03c06c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:11.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.501+0000 7fb043296640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb03c0ccf30 con 0x7fb03c159b50 2023-12-20T04:48:11.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.501+0000 7fb043296640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb03c06cc10 con 0x7fb03c15e530 2023-12-20T04:48:11.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.501+0000 7fb043296640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c0caa60 con 0x7fb03c06c240 2023-12-20T04:48:11.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.502+0000 7fb041833640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03c06c240 0x7fb03c06c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:11.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.502+0000 7fb040831640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb03c15e530 0x7fb03c06fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:11.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.502+0000 7fb041032640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fb03c159b50 0x7fb03c0c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:50936/0 (socket says 172.21.15.132:50936) 2023-12-20T04:48:11.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.502+0000 7fb041032640 1 -- 172.21.15.132:0/916744556 learned_addr learned my addr 172.21.15.132:0/916744556 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:11.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.502+0000 7fb041833640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03c06c240 0x7fb03c06c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:48370/0 (socket says 172.21.15.132:48370) 2023-12-20T04:48:11.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.502+0000 7fb041833640 1 -- 172.21.15.132:0/916744556 >> v2:172.21.15.187:3300/0 conn(0x7fb03c15e530 msgr2=0x7fb03c06fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:11.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.502+0000 7fb041833640 1 --2- 172.21.15.132:0/916744556 >> v2:172.21.15.187:3300/0 conn(0x7fb03c15e530 0x7fb03c06fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:11.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.502+0000 7fb041833640 1 -- 172.21.15.132:0/916744556 >> v1:172.21.15.187:6789/0 conn(0x7fb03c159b50 legacy=0x7fb03c0c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:11.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.502+0000 7fb041833640 1 -- 172.21.15.132:0/916744556 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb03c0ca1c0 con 0x7fb03c06c240 2023-12-20T04:48:11.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.502+0000 7fb040831640 1 --2- 172.21.15.132:0/916744556 >> v2:172.21.15.187:3300/0 conn(0x7fb03c15e530 0x7fb03c06fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:48:11.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.503+0000 7fb041833640 1 --2- 172.21.15.132:0/916744556 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03c06c240 0x7fb03c06c6d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0097a0 tx=0x7fb02c02b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=544074ca5666bf0e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:11.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.503+0000 7fb03bfff640 1 -- 172.21.15.132:0/916744556 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c031830 con 0x7fb03c06c240 2023-12-20T04:48:11.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.503+0000 7fb03bfff640 1 -- 172.21.15.132:0/916744556 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb02c031990 con 0x7fb03c06c240 2023-12-20T04:48:11.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.503+0000 7fb03bfff640 1 -- 172.21.15.132:0/916744556 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb02c031d20 con 0x7fb03c06c240 2023-12-20T04:48:11.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.504+0000 7fb043296640 1 -- 172.21.15.132:0/916744556 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03c06c240 msgr2=0x7fb03c06c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:11.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.504+0000 7fb043296640 1 --2- 172.21.15.132:0/916744556 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03c06c240 0x7fb03c06c6d0 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7fb02c0097a0 tx=0x7fb02c02b8d0 comp rx=0 tx=0).stop 2023-12-20T04:48:11.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.504+0000 7fb043296640 1 -- 172.21.15.132:0/916744556 shutdown_connections 2023-12-20T04:48:11.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.504+0000 7fb043296640 1 --2- 172.21.15.132:0/916744556 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03c06c240 0x7fb03c06c6d0 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:11.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.504+0000 7fb043296640 1 --2- 172.21.15.132:0/916744556 >> v2:172.21.15.187:3300/0 conn(0x7fb03c15e530 0x7fb03c06fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:11.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.504+0000 7fb043296640 1 -- 172.21.15.132:0/916744556 >> 172.21.15.132:0/916744556 conn(0x7fb03c0ced10 msgr2=0x7fb03c0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:11.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.504+0000 7fb043296640 1 -- 172.21.15.132:0/916744556 shutdown_connections 2023-12-20T04:48:11.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.504+0000 7fb043296640 1 -- 172.21.15.132:0/916744556 wait complete. 2023-12-20T04:48:11.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.505+0000 7fb043296640 1 Processor -- start 2023-12-20T04:48:11.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.505+0000 7fb043296640 1 -- start start 2023-12-20T04:48:11.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb043296640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03c06c240 0x7fb03c1f3a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:11.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb043296640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb03c159b50 0x7fb03c165190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:11.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb043296640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb03c15e530 0x7fb03c1f2cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:11.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb043296640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c1656d0 con 0x7fb03c159b50 2023-12-20T04:48:11.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb043296640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c14efc0 con 0x7fb03c15e530 2023-12-20T04:48:11.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb043296640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c14f2a0 con 0x7fb03c06c240 2023-12-20T04:48:11.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb040831640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb03c159b50 0x7fb03c165190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:11.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb040831640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb03c159b50 0x7fb03c165190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44752/0 (socket says 172.21.15.132:44752) 2023-12-20T04:48:11.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb040831640 1 -- 172.21.15.132:0/1780040766 learned_addr learned my addr 172.21.15.132:0/1780040766 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:11.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb041032640 1 --2- 172.21.15.132:0/1780040766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03c06c240 0x7fb03c1f3a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:11.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb041833640 1 --2- 172.21.15.132:0/1780040766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb03c15e530 0x7fb03c1f2cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:11.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb040831640 1 -- 172.21.15.132:0/1780040766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03c06c240 msgr2=0x7fb03c1f3a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:11.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb040831640 1 --2- 172.21.15.132:0/1780040766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03c06c240 0x7fb03c1f3a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:11.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb040831640 1 -- 172.21.15.132:0/1780040766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb03c15e530 msgr2=0x7fb03c1f2cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:11.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb040831640 1 --2- 172.21.15.132:0/1780040766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb03c15e530 0x7fb03c1f2cc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:11.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb040831640 1 -- 172.21.15.132:0/1780040766 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb030009400 con 0x7fb03c159b50 2023-12-20T04:48:11.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb041032640 1 --2- 172.21.15.132:0/1780040766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03c06c240 0x7fb03c1f3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:11.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb041833640 1 --2- 172.21.15.132:0/1780040766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb03c15e530 0x7fb03c1f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:11.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb040831640 1 --2- 172.21.15.132:0/1780040766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb03c159b50 0x7fb03c165190 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fb03000ebe0 tx=0x7fb03000c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:11.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb039ffb640 1 -- 172.21.15.132:0/1780040766 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb030009760 con 0x7fb03c159b50 2023-12-20T04:48:11.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb039ffb640 1 -- 172.21.15.132:0/1780040766 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb03000cc30 con 0x7fb03c159b50 2023-12-20T04:48:11.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb043296640 1 -- 172.21.15.132:0/1780040766 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb02c009400 con 0x7fb03c159b50 2023-12-20T04:48:11.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.506+0000 7fb039ffb640 1 -- 172.21.15.132:0/1780040766 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb03000eee0 con 0x7fb03c159b50 2023-12-20T04:48:11.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.507+0000 7fb043296640 1 -- 172.21.15.132:0/1780040766 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03c0c4cb0 con 0x7fb03c159b50 2023-12-20T04:48:11.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.508+0000 7fb043296640 1 -- 172.21.15.132:0/1780040766 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03c070260 con 0x7fb03c159b50 2023-12-20T04:48:11.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.508+0000 7fb039ffb640 1 -- 172.21.15.132:0/1780040766 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb030013470 con 0x7fb03c159b50 2023-12-20T04:48:11.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.508+0000 7fb039ffb640 1 --2- 172.21.15.132:0/1780040766 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb02806a460 0x7fb02806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:11.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.508+0000 7fb039ffb640 1 -- 172.21.15.132:0/1780040766 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb030088c10 con 0x7fb03c159b50 2023-12-20T04:48:11.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.508+0000 7fb041032640 1 --2- 172.21.15.132:0/1780040766 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb02806a460 0x7fb02806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:11.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.509+0000 7fb041032640 1 --2- 172.21.15.132:0/1780040766 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb02806a460 0x7fb02806c920 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb034005c00 tx=0x7fb034009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:11.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.513+0000 7fb039ffb640 1 -- 172.21.15.132:0/1780040766 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb030054200 con 0x7fb03c159b50 2023-12-20T04:48:11.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.713+0000 7fb043296640 1 -- 172.21.15.132:0/1780040766 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fb03c04e840 con 0x7fb03c159b50 2023-12-20T04:48:11.715 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.713+0000 7fb039ffb640 1 -- 172.21.15.132:0/1780040766 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v45) v1 ==== 53+0+73 (secure 0 0 0) 0x7fb030017060 con 0x7fb03c159b50 2023-12-20T04:48:11.715 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:48:11.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.715+0000 7fb043296640 1 -- 172.21.15.132:0/1780040766 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb02806a460 msgr2=0x7fb02806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:11.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.715+0000 7fb043296640 1 --2- 172.21.15.132:0/1780040766 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb02806a460 0x7fb02806c920 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7fb034005c00 tx=0x7fb034009040 comp rx=0 tx=0).stop 2023-12-20T04:48:11.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.715+0000 7fb043296640 1 -- 172.21.15.132:0/1780040766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb03c159b50 msgr2=0x7fb03c165190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:11.717 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.715+0000 7fb043296640 1 --2- 172.21.15.132:0/1780040766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb03c159b50 0x7fb03c165190 secure :-1 s=READY pgs=1220 cs=0 l=1 rev1=1 crypto rx=0x7fb03000ebe0 tx=0x7fb03000c520 comp rx=0 tx=0).stop 2023-12-20T04:48:11.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.715+0000 7fb043296640 1 -- 172.21.15.132:0/1780040766 shutdown_connections 2023-12-20T04:48:11.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.715+0000 7fb043296640 1 --2- 172.21.15.132:0/1780040766 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb02806a460 0x7fb02806c920 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:11.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.715+0000 7fb043296640 1 --2- 172.21.15.132:0/1780040766 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb03c15e530 0x7fb03c1f2cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:11.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.715+0000 7fb043296640 1 --2- 172.21.15.132:0/1780040766 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb03c159b50 0x7fb03c165190 unknown :-1 s=CLOSED pgs=1220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:11.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.715+0000 7fb043296640 1 --2- 172.21.15.132:0/1780040766 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb03c06c240 0x7fb03c1f3a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:11.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.715+0000 7fb043296640 1 -- 172.21.15.132:0/1780040766 >> 172.21.15.132:0/1780040766 conn(0x7fb03c0ced10 msgr2=0x7fb03c0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:11.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.715+0000 7fb043296640 1 -- 172.21.15.132:0/1780040766 shutdown_connections 2023-12-20T04:48:11.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:11.715+0000 7fb043296640 1 -- 172.21.15.132:0/1780040766 wait complete. 2023-12-20T04:48:11.728 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:48:11.728 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:48:11.728 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-12-20T04:48:11.728 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-20T04:48:11.728 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-20T04:48:11.728 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:48:11.728 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:48:11.729 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:48:11.729 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:48:11.729 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:11.729 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-12-20T04:48:11.748 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:48:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:48:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:48:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-20T04:48:11.748 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:11.749 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:48:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-12-20T04:48:11.749 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:48:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-12-20T04:48:11.749 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:48:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:11.749 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:48:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:48:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42394sec preferred_lft 42394sec 2023-12-20T04:48:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-12-20T04:48:11.749 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:11.749 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:48:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:48:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::a8bc:1cff:fe40:54ea/64 scope link 2023-12-20T04:48:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:11.750 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:48:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-20T04:48:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c8e:c0ff:fe7a:bdc/64 scope link 2023-12-20T04:48:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:11.750 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:48:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether be:98:9a:6f:62:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-20T04:48:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::bc98:9aff:fe6f:6282/64 scope link 2023-12-20T04:48:11.750 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:11.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:11.750 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:48:11.819 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-12-20T04:48:11.820 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:11.820 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-12-20T04:48:11.878 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-12-20T04:48:11.878 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:48:11.878 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:48:11.878 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:48:11.878 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:48:11.878 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:11.878 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:48:11.879 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:48:11.879 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:48:11.879 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:48:11.879 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:48:11.879 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:48:11.977 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:11.978 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-20T04:48:11.993 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-20T04:48:11.993 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-20T04:48:11.993 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:48:11.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:11.993 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2023-12-20T04:48:12.061 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-20T04:48:12.061 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:48:12.061 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-20T04:48:12.116 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:48:12.117 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:48:12.117 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:48:12.171 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:48:12.239 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:48:12.239 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:48:12.305 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:48:12.307 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:48:12.307 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:12.307 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:48:12.362 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:48:12.362 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-20T04:48:12.405 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:48:12.431 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:48:12.432 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:48:12.490 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:2023-12-20T04:48:12.489+0000 7f394c60b480 -1 init, newargv = 0x5606d9c8f570 newargc=15 2023-12-20T04:48:12.491 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[89982]: starting ceph client 2023-12-20T04:48:12.495 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[89982]: starting fuse 2023-12-20T04:48:12.499 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:48:12.500 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:48:12.500 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:12.500 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:48:12.554 INFO:teuthology.orchestra.run.smithi187.stdout:41 2023-12-20T04:48:12.555 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:48:12.555 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:48:12.555 DEBUG:teuthology.orchestra.run.smithi187:> import glob 2023-12-20T04:48:12.555 DEBUG:teuthology.orchestra.run.smithi187:> import re 2023-12-20T04:48:12.555 DEBUG:teuthology.orchestra.run.smithi187:> import os 2023-12-20T04:48:12.555 DEBUG:teuthology.orchestra.run.smithi187:> import subprocess 2023-12-20T04:48:12.555 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:48:12.555 DEBUG:teuthology.orchestra.run.smithi187:> def _find_admin_socket(client_name): 2023-12-20T04:48:12.555 DEBUG:teuthology.orchestra.run.smithi187:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-20T04:48:12.555 DEBUG:teuthology.orchestra.run.smithi187:> files = glob.glob(asok_path) 2023-12-20T04:48:12.555 DEBUG:teuthology.orchestra.run.smithi187:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-20T04:48:12.555 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:48:12.556 DEBUG:teuthology.orchestra.run.smithi187:> # Given a non-glob path, it better be there 2023-12-20T04:48:12.556 DEBUG:teuthology.orchestra.run.smithi187:> if "*" not in asok_path: 2023-12-20T04:48:12.556 DEBUG:teuthology.orchestra.run.smithi187:> assert(len(files) == 1) 2023-12-20T04:48:12.556 DEBUG:teuthology.orchestra.run.smithi187:> return files[0] 2023-12-20T04:48:12.556 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:48:12.556 DEBUG:teuthology.orchestra.run.smithi187:> for f in files: 2023-12-20T04:48:12.556 DEBUG:teuthology.orchestra.run.smithi187:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:48:12.556 DEBUG:teuthology.orchestra.run.smithi187:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:48:12.556 DEBUG:teuthology.orchestra.run.smithi187:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:48:12.556 DEBUG:teuthology.orchestra.run.smithi187:> contents = proc_f.read() 2023-12-20T04:48:12.556 DEBUG:teuthology.orchestra.run.smithi187:> if mountpoint in contents: 2023-12-20T04:48:12.556 DEBUG:teuthology.orchestra.run.smithi187:> return f 2023-12-20T04:48:12.556 DEBUG:teuthology.orchestra.run.smithi187:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:48:12.556 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:48:12.556 DEBUG:teuthology.orchestra.run.smithi187:> print(_find_admin_socket("client.1")) 2023-12-20T04:48:12.556 DEBUG:teuthology.orchestra.run.smithi187:> ' 2023-12-20T04:48:12.669 INFO:teuthology.orchestra.run.smithi187.stdout:/var/run/ceph/ceph-client.1.89982.asok 2023-12-20T04:48:12.856 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.89982.asok 2023-12-20T04:48:12.856 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:12.856 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.89982.asok status 2023-12-20T04:48:12.991 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-12-20T04:48:12.991 INFO:teuthology.orchestra.run.smithi187.stdout: "metadata": { 2023-12-20T04:48:12.991 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:48:12.991 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:48:12.991 INFO:teuthology.orchestra.run.smithi187.stdout: "entity_id": "1", 2023-12-20T04:48:12.991 INFO:teuthology.orchestra.run.smithi187.stdout: "hostname": "smithi187", 2023-12-20T04:48:12.991 INFO:teuthology.orchestra.run.smithi187.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-20T04:48:12.991 INFO:teuthology.orchestra.run.smithi187.stdout: "pid": "89982", 2023-12-20T04:48:12.991 INFO:teuthology.orchestra.run.smithi187.stdout: "root": "/" 2023-12-20T04:48:12.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:48:12.992 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_count": 0, 2023-12-20T04:48:12.992 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_pinned_count": 0, 2023-12-20T04:48:12.992 INFO:teuthology.orchestra.run.smithi187.stdout: "id": 6053, 2023-12-20T04:48:12.992 INFO:teuthology.orchestra.run.smithi187.stdout: "inst": { 2023-12-20T04:48:12.992 INFO:teuthology.orchestra.run.smithi187.stdout: "name": { 2023-12-20T04:48:12.992 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "client", 2023-12-20T04:48:12.992 INFO:teuthology.orchestra.run.smithi187.stdout: "num": 6053 2023-12-20T04:48:12.992 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:48:12.992 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:48:12.992 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:48:12.992 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:48:12.992 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 1398503971 2023-12-20T04:48:12.992 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-12-20T04:48:12.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:48:12.993 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:48:12.993 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:48:12.993 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:48:12.993 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 1398503971 2023-12-20T04:48:12.993 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:48:12.993 INFO:teuthology.orchestra.run.smithi187.stdout: "inst_str": "client.6053 192.168.0.1:0/1398503971", 2023-12-20T04:48:12.993 INFO:teuthology.orchestra.run.smithi187.stdout: "addr_str": "192.168.0.1:0/1398503971", 2023-12-20T04:48:12.993 INFO:teuthology.orchestra.run.smithi187.stdout: "inode_count": 1, 2023-12-20T04:48:12.993 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_epoch": 45, 2023-12-20T04:48:12.993 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch": 122, 2023-12-20T04:48:12.993 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:48:12.993 INFO:teuthology.orchestra.run.smithi187.stdout: "blocklisted": false, 2023-12-20T04:48:12.993 INFO:teuthology.orchestra.run.smithi187.stdout: "fs_name": "cephfs" 2023-12-20T04:48:12.993 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-12-20T04:48:12.999 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:12.999 DEBUG:teuthology.orchestra.run.smithi187:> stat --file-system '--printf=%T 2023-12-20T04:48:12.999 DEBUG:teuthology.orchestra.run.smithi187:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-20T04:48:13.014 INFO:teuthology.orchestra.run.smithi187.stdout:fuseblk 2023-12-20T04:48:13.014 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-20T04:48:13.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:13.014 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:48:13.081 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:48:13.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.190+0000 7f32f69cb640 1 Processor -- start 2023-12-20T04:48:13.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.190+0000 7f32f69cb640 1 -- start start 2023-12-20T04:48:13.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.191+0000 7f32f69cb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32f00b4980 0x7f32f00b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:13.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.191+0000 7f32f69cb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f32f00d1aa0 0x7f32f00d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:13.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.191+0000 7f32f69cb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32f00b5320 con 0x7f32f0160450 2023-12-20T04:48:13.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.191+0000 7f32f69cb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f32f00b5ec0 con 0x7f32f00d1aa0 2023-12-20T04:48:13.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.191+0000 7f32f69cb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f01617e0 con 0x7f32f00b4980 2023-12-20T04:48:13.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.191+0000 7f32effff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f32f0160450 0x7f32f0160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48550/0 (socket says 172.21.15.132:48550) 2023-12-20T04:48:13.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.191+0000 7f32effff640 1 -- 172.21.15.132:0/2448664105 learned_addr learned my addr 172.21.15.132:0/2448664105 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:13.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.191+0000 7f32f4f68640 1 --2- 172.21.15.132:0/2448664105 >> v2:172.21.15.187:3300/0 conn(0x7f32f00d1aa0 0x7f32f00d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:13.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.191+0000 7f32ef7fe640 1 --2- 172.21.15.132:0/2448664105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32f00b4980 0x7f32f00b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:13.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.191+0000 7f32eeffd640 1 -- 172.21.15.132:0/2448664105 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 94766313 0 0) 0x7f32f00b5320 con 0x7f32f0160450 2023-12-20T04:48:13.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.191+0000 7f32eeffd640 1 -- 172.21.15.132:0/2448664105 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32d8003520 con 0x7f32f0160450 2023-12-20T04:48:13.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32eeffd640 1 -- 172.21.15.132:0/2448664105 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1303038719 0 0) 0x7f32d8003520 con 0x7f32f0160450 2023-12-20T04:48:13.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32eeffd640 1 -- 172.21.15.132:0/2448664105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32f00b4980 msgr2=0x7f32f00b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:13.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32eeffd640 1 --2- 172.21.15.132:0/2448664105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32f00b4980 0x7f32f00b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32eeffd640 1 -- 172.21.15.132:0/2448664105 >> v2:172.21.15.187:3300/0 conn(0x7f32f00d1aa0 msgr2=0x7f32f00d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:13.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32eeffd640 1 --2- 172.21.15.132:0/2448664105 >> v2:172.21.15.187:3300/0 conn(0x7f32f00d1aa0 0x7f32f00d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32eeffd640 1 -- 172.21.15.132:0/2448664105 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f00d0fc0 con 0x7f32f0160450 2023-12-20T04:48:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32eeffd640 1 -- 172.21.15.132:0/2448664105 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f32e0001670 con 0x7f32f0160450 2023-12-20T04:48:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32eeffd640 1 -- 172.21.15.132:0/2448664105 >> v1:172.21.15.132:6789/0 conn(0x7f32f0160450 legacy=0x7f32f0160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32eeffd640 1 --2- 172.21.15.132:0/2448664105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32d8003970 0x7f32d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32eeffd640 1 --2- 172.21.15.132:0/2448664105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32f00b4980 0x7f32d80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32eeffd640 1 --2- 172.21.15.132:0/2448664105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32d8004d00 0x7f32d8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32eeffd640 1 -- 172.21.15.132:0/2448664105 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f00b5ec0 con 0x7f32d8003970 2023-12-20T04:48:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32eeffd640 1 -- 172.21.15.132:0/2448664105 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f01617e0 con 0x7f32d8004d00 2023-12-20T04:48:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32eeffd640 1 -- 172.21.15.132:0/2448664105 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32d800b9b0 con 0x7f32f00b4980 2023-12-20T04:48:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32effff640 1 --2- 172.21.15.132:0/2448664105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32d8003970 0x7f32d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32ef7fe640 1 --2- 172.21.15.132:0/2448664105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32f00b4980 0x7f32d80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32f4f68640 1 --2- 172.21.15.132:0/2448664105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32d8004d00 0x7f32d8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32effff640 1 -- 172.21.15.132:0/2448664105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32f00b4980 msgr2=0x7f32d80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32effff640 1 --2- 172.21.15.132:0/2448664105 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32f00b4980 0x7f32d80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32effff640 1 -- 172.21.15.132:0/2448664105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32d8004d00 msgr2=0x7f32d8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32effff640 1 --2- 172.21.15.132:0/2448664105 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32d8004d00 0x7f32d8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.192+0000 7f32effff640 1 -- 172.21.15.132:0/2448664105 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32d8003520 con 0x7f32d8003970 2023-12-20T04:48:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.193+0000 7f32effff640 1 --2- 172.21.15.132:0/2448664105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32d8003970 0x7f32d8003d90 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f32e000c190 tx=0x7f32d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e5a0abbd985af21 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.193+0000 7f32eeffd640 1 -- 172.21.15.132:0/2448664105 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0005ad0 con 0x7f32d8003970 2023-12-20T04:48:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.193+0000 7f32eeffd640 1 -- 172.21.15.132:0/2448664105 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e0005c30 con 0x7f32d8003970 2023-12-20T04:48:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.193+0000 7f32eeffd640 1 -- 172.21.15.132:0/2448664105 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e002c850 con 0x7f32d8003970 2023-12-20T04:48:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.194+0000 7f32f69cb640 1 -- 172.21.15.132:0/2448664105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32d8003970 msgr2=0x7f32d8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.194+0000 7f32f69cb640 1 --2- 172.21.15.132:0/2448664105 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32d8003970 0x7f32d8003d90 secure :-1 s=READY pgs=1223 cs=0 l=1 rev1=1 crypto rx=0x7f32e000c190 tx=0x7f32d80057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.194+0000 7f32f4f68640 1 -- 172.21.15.132:0/2448664105 reap_dead start 2023-12-20T04:48:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.194+0000 7f32f69cb640 1 -- 172.21.15.132:0/2448664105 shutdown_connections 2023-12-20T04:48:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.194+0000 7f32f69cb640 1 -- 172.21.15.132:0/2448664105 >> 172.21.15.132:0/2448664105 conn(0x7f32f00cf980 msgr2=0x7f32f00cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.194+0000 7f32f69cb640 1 -- 172.21.15.132:0/2448664105 shutdown_connections 2023-12-20T04:48:13.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.194+0000 7f32f69cb640 1 -- 172.21.15.132:0/2448664105 wait complete. 2023-12-20T04:48:13.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.195+0000 7f32f69cb640 1 Processor -- start 2023-12-20T04:48:13.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.195+0000 7f32f69cb640 1 -- start start 2023-12-20T04:48:13.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32f69cb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32d8003970 0x7f32f015bda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:13.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32f69cb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32f0154420 0x7f32f015e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:13.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32f69cb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32f01f6000 0x7f32f01f6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:13.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32f69cb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f0156ff0 con 0x7f32d8003970 2023-12-20T04:48:13.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32f69cb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32f01f69c0 con 0x7f32f0154420 2023-12-20T04:48:13.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32f69cb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32f015e930 con 0x7f32f01f6000 2023-12-20T04:48:13.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32effff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32d8003970 0x7f32f015bda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:13.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32effff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32d8003970 0x7f32f015bda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44766/0 (socket says 172.21.15.132:44766) 2023-12-20T04:48:13.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32effff640 1 -- 172.21.15.132:0/1442803726 learned_addr learned my addr 172.21.15.132:0/1442803726 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:13.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32effff640 1 -- 172.21.15.132:0/1442803726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32f01f6000 msgr2=0x7f32f01f6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:13.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32effff640 1 --2- 172.21.15.132:0/1442803726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32f01f6000 0x7f32f01f6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32effff640 1 -- 172.21.15.132:0/1442803726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32f0154420 msgr2=0x7f32f015e100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:13.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32effff640 1 --2- 172.21.15.132:0/1442803726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32f0154420 0x7f32f015e100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32effff640 1 -- 172.21.15.132:0/1442803726 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32f015ec10 con 0x7f32d8003970 2023-12-20T04:48:13.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32effff640 1 --2- 172.21.15.132:0/1442803726 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32d8003970 0x7f32f015bda0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f32e002c3f0 tx=0x7f32e0001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:13.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32ecff9640 1 -- 172.21.15.132:0/1442803726 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e0039030 con 0x7f32d8003970 2023-12-20T04:48:13.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32ecff9640 1 -- 172.21.15.132:0/1442803726 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f32e002cc60 con 0x7f32d8003970 2023-12-20T04:48:13.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32f69cb640 1 -- 172.21.15.132:0/1442803726 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32f015eef0 con 0x7f32d8003970 2023-12-20T04:48:13.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32ecff9640 1 -- 172.21.15.132:0/1442803726 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32e003c040 con 0x7f32d8003970 2023-12-20T04:48:13.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.196+0000 7f32f69cb640 1 -- 172.21.15.132:0/1442803726 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f32f015e640 con 0x7f32d8003970 2023-12-20T04:48:13.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.198+0000 7f32f69cb640 1 -- 172.21.15.132:0/1442803726 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f32f015f130 con 0x7f32d8003970 2023-12-20T04:48:13.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.198+0000 7f32ecff9640 1 -- 172.21.15.132:0/1442803726 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f32e0032070 con 0x7f32d8003970 2023-12-20T04:48:13.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.198+0000 7f32ecff9640 1 --2- 172.21.15.132:0/1442803726 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f32dc06a460 0x7f32dc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:13.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.198+0000 7f32ecff9640 1 -- 172.21.15.132:0/1442803726 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32e00a9c50 con 0x7f32d8003970 2023-12-20T04:48:13.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.198+0000 7f32ef7fe640 1 --2- 172.21.15.132:0/1442803726 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f32dc06a460 0x7f32dc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:13.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.199+0000 7f32ef7fe640 1 --2- 172.21.15.132:0/1442803726 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f32dc06a460 0x7f32dc06c920 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f32f015f3e0 tx=0x7f32e4009320 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:13.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.202+0000 7f32ecff9640 1 -- 172.21.15.132:0/1442803726 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f32e00af020 con 0x7f32d8003970 2023-12-20T04:48:13.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.402+0000 7f32f69cb640 1 -- 172.21.15.132:0/1442803726 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f32f004e840 con 0x7f32d8003970 2023-12-20T04:48:13.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.402+0000 7f32ecff9640 1 -- 172.21.15.132:0/1442803726 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f32e0075240 con 0x7f32d8003970 2023-12-20T04:48:13.404 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:13.405 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":45,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3951194420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3951194420},{"type":"v1","addr":"172.21.15.187:6833","nonce":3951194420}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1575999914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1575999914},{"type":"v1","addr":"172.21.15.187:6835","nonce":1575999914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2208233017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2208233017},{"type":"v1","addr":"172.21.15.132:6836","nonce":2208233017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:48:04.456610+0000","modified":"2023-12-20T04:48:07.132847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7422":{"gid":7422,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/3935356761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":3935356761},{"type":"v1","addr":"172.21.15.132:6837","nonce":3935356761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-20T04:48:13.405 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 45 2023-12-20T04:48:13.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.404+0000 7f32f69cb640 1 -- 172.21.15.132:0/1442803726 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f32dc06a460 msgr2=0x7f32dc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:13.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.404+0000 7f32f69cb640 1 --2- 172.21.15.132:0/1442803726 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f32dc06a460 0x7f32dc06c920 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7f32f015f3e0 tx=0x7f32e4009320 comp rx=0 tx=0).stop 2023-12-20T04:48:13.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.404+0000 7f32f69cb640 1 -- 172.21.15.132:0/1442803726 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32d8003970 msgr2=0x7f32f015bda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:13.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.404+0000 7f32f69cb640 1 --2- 172.21.15.132:0/1442803726 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32d8003970 0x7f32f015bda0 secure :-1 s=READY pgs=1224 cs=0 l=1 rev1=1 crypto rx=0x7f32e002c3f0 tx=0x7f32e0001930 comp rx=0 tx=0).stop 2023-12-20T04:48:13.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.404+0000 7f32f69cb640 1 -- 172.21.15.132:0/1442803726 shutdown_connections 2023-12-20T04:48:13.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.404+0000 7f32f69cb640 1 --2- 172.21.15.132:0/1442803726 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f32dc06a460 0x7f32dc06c920 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.404+0000 7f32f69cb640 1 --2- 172.21.15.132:0/1442803726 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32f01f6000 0x7f32f01f6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.404+0000 7f32f69cb640 1 --2- 172.21.15.132:0/1442803726 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f32f0154420 0x7f32f015e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.404+0000 7f32f69cb640 1 --2- 172.21.15.132:0/1442803726 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32d8003970 0x7f32f015bda0 unknown :-1 s=CLOSED pgs=1224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.404+0000 7f32f69cb640 1 -- 172.21.15.132:0/1442803726 >> 172.21.15.132:0/1442803726 conn(0x7f32f00cf980 msgr2=0x7f32f00cc070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:13.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.404+0000 7f32f69cb640 1 -- 172.21.15.132:0/1442803726 shutdown_connections 2023-12-20T04:48:13.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.404+0000 7f32f69cb640 1 -- 172.21.15.132:0/1442803726 wait complete. 2023-12-20T04:48:13.418 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-20T04:48:13.532 INFO:teuthology.orchestra.run.smithi132.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":7422,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.0641932500000006,"mdsmap_epoch":45,"osdmap_epoch":122,"osdmap_epoch_barrier":122,"uptime":13.46644401} 2023-12-20T04:48:13.532 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 7422, "mdsmap_epoch": 45, "osdmap_epoch": 122, "osdmap_epoch_barrier": 122, "rank_uptime": 9.06419325, "state": "up:active", "uptime": 13.46644401, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:48:13.532 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-20T04:48:13.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.634+0000 7f4e5e870640 1 Processor -- start 2023-12-20T04:48:13.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.634+0000 7f4e5e870640 1 -- start start 2023-12-20T04:48:13.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.635+0000 7f4e5e870640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4e5815cee0 0x7f4e580cf590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:13.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.635+0000 7f4e5e870640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4e5806c960 0x7f4e58069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:13.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.635+0000 7f4e5e870640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e5815de00 con 0x7f4e5806c4d0 2023-12-20T04:48:13.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.635+0000 7f4e5e870640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5815e0e0 con 0x7f4e5815cee0 2023-12-20T04:48:13.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.635+0000 7f4e5e870640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e5815e3c0 con 0x7f4e5806c960 2023-12-20T04:48:13.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.635+0000 7f4e57fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4e5815cee0 0x7f4e580cf590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.635+0000 7f4e577fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4e5806c4d0 0x7f4e5815d2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48562/0 (socket says 172.21.15.132:48562) 2023-12-20T04:48:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.635+0000 7f4e57fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4e5815cee0 0x7f4e580cf590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44780/0 (socket says 172.21.15.132:44780) 2023-12-20T04:48:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.635+0000 7f4e577fe640 1 -- 172.21.15.132:0/1673409737 learned_addr learned my addr 172.21.15.132:0/1673409737 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.635+0000 7f4e57fff640 1 -- 172.21.15.132:0/1673409737 >> v2:172.21.15.187:3300/0 conn(0x7f4e5806c960 msgr2=0x7f4e58069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.635+0000 7f4e5ce0d640 1 --2- 172.21.15.132:0/1673409737 >> v2:172.21.15.187:3300/0 conn(0x7f4e5806c960 0x7f4e58069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.635+0000 7f4e56ffd640 1 -- 172.21.15.132:0/1673409737 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3273676497 0 0) 0x7f4e5815de00 con 0x7f4e5806c4d0 2023-12-20T04:48:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.635+0000 7f4e57fff640 1 --2- 172.21.15.132:0/1673409737 >> v2:172.21.15.187:3300/0 conn(0x7f4e5806c960 0x7f4e58069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.635+0000 7f4e57fff640 1 -- 172.21.15.132:0/1673409737 >> v1:172.21.15.132:6789/0 conn(0x7f4e5806c4d0 legacy=0x7f4e5815d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.635+0000 7f4e57fff640 1 -- 172.21.15.132:0/1673409737 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e580cc500 con 0x7f4e5815cee0 2023-12-20T04:48:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.635+0000 7f4e5ce0d640 1 --2- 172.21.15.132:0/1673409737 >> v2:172.21.15.187:3300/0 conn(0x7f4e5806c960 0x7f4e58069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.636+0000 7f4e57fff640 1 --2- 172.21.15.132:0/1673409737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e5815cee0 0x7f4e580cf590 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f4e5806eee0 tx=0x7f4e4802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6354c8c3993fc125 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.636+0000 7f4e56ffd640 1 -- 172.21.15.132:0/1673409737 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e48031830 con 0x7f4e5815cee0 2023-12-20T04:48:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.636+0000 7f4e56ffd640 1 -- 172.21.15.132:0/1673409737 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e48031990 con 0x7f4e5815cee0 2023-12-20T04:48:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.636+0000 7f4e56ffd640 1 -- 172.21.15.132:0/1673409737 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e48031d20 con 0x7f4e5815cee0 2023-12-20T04:48:13.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.637+0000 7f4e5e870640 1 -- 172.21.15.132:0/1673409737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e5815cee0 msgr2=0x7f4e580cf590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.637+0000 7f4e5e870640 1 --2- 172.21.15.132:0/1673409737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e5815cee0 0x7f4e580cf590 secure :-1 s=READY pgs=1226 cs=0 l=1 rev1=1 crypto rx=0x7f4e5806eee0 tx=0x7f4e4802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.637+0000 7f4e5e870640 1 -- 172.21.15.132:0/1673409737 shutdown_connections 2023-12-20T04:48:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.637+0000 7f4e5e870640 1 --2- 172.21.15.132:0/1673409737 >> v2:172.21.15.187:3300/0 conn(0x7f4e5806c960 0x7f4e58069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.637+0000 7f4e5e870640 1 --2- 172.21.15.132:0/1673409737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e5815cee0 0x7f4e580cf590 unknown :-1 s=CLOSED pgs=1226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.637+0000 7f4e5e870640 1 -- 172.21.15.132:0/1673409737 >> 172.21.15.132:0/1673409737 conn(0x7f4e580b16b0 msgr2=0x7f4e580b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.637+0000 7f4e5e870640 1 -- 172.21.15.132:0/1673409737 shutdown_connections 2023-12-20T04:48:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.637+0000 7f4e5e870640 1 -- 172.21.15.132:0/1673409737 wait complete. 2023-12-20T04:48:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.638+0000 7f4e5e870640 1 Processor -- start 2023-12-20T04:48:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.638+0000 7f4e5e870640 1 -- start start 2023-12-20T04:48:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e5e870640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e5806c4d0 0x7f4e580b3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e5e870640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e5806c960 0x7f4e581f2e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e5e870640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e5815cee0 0x7f4e580b0880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e5e870640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e581f3390 con 0x7f4e5806c4d0 2023-12-20T04:48:13.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e5e870640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e580b3d00 con 0x7f4e5815cee0 2023-12-20T04:48:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e5e870640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e580b3fe0 con 0x7f4e5806c960 2023-12-20T04:48:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e57fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e5806c4d0 0x7f4e580b3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e57fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e5806c4d0 0x7f4e580b3720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44794/0 (socket says 172.21.15.132:44794) 2023-12-20T04:48:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e57fff640 1 -- 172.21.15.132:0/4249827570 learned_addr learned my addr 172.21.15.132:0/4249827570 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e57fff640 1 -- 172.21.15.132:0/4249827570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e5806c960 msgr2=0x7f4e581f2e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e57fff640 1 --2- 172.21.15.132:0/4249827570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e5806c960 0x7f4e581f2e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e57fff640 1 -- 172.21.15.132:0/4249827570 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e5815cee0 msgr2=0x7f4e580b0880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e57fff640 1 --2- 172.21.15.132:0/4249827570 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e5815cee0 0x7f4e580b0880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e57fff640 1 -- 172.21.15.132:0/4249827570 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e48009400 con 0x7f4e5806c4d0 2023-12-20T04:48:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e57fff640 1 --2- 172.21.15.132:0/4249827570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e5806c4d0 0x7f4e580b3720 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f4e48000c00 tx=0x7f4e480046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e54ff9640 1 -- 172.21.15.132:0/4249827570 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4803aa60 con 0x7f4e5806c4d0 2023-12-20T04:48:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e54ff9640 1 -- 172.21.15.132:0/4249827570 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4803abe0 con 0x7f4e5806c4d0 2023-12-20T04:48:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e5e870640 1 -- 172.21.15.132:0/4249827570 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e580b42c0 con 0x7f4e5806c4d0 2023-12-20T04:48:13.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e54ff9640 1 -- 172.21.15.132:0/4249827570 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e480443f0 con 0x7f4e5806c4d0 2023-12-20T04:48:13.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.639+0000 7f4e5e870640 1 -- 172.21.15.132:0/4249827570 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e580b0dc0 con 0x7f4e5806c4d0 2023-12-20T04:48:13.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.640+0000 7f4e5e870640 1 -- 172.21.15.132:0/4249827570 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e580b47e0 con 0x7f4e5806c4d0 2023-12-20T04:48:13.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.641+0000 7f4e54ff9640 1 -- 172.21.15.132:0/4249827570 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4e4804d450 con 0x7f4e5806c4d0 2023-12-20T04:48:13.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.641+0000 7f4e54ff9640 1 --2- 172.21.15.132:0/4249827570 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e4406a430 0x7f4e4406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:13.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.641+0000 7f4e54ff9640 1 -- 172.21.15.132:0/4249827570 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(122..122 src has 1..122) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e480aaa90 con 0x7f4e5806c4d0 2023-12-20T04:48:13.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.641+0000 7f4e577fe640 1 --2- 172.21.15.132:0/4249827570 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e4406a430 0x7f4e4406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:13.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.641+0000 7f4e577fe640 1 --2- 172.21.15.132:0/4249827570 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e4406a430 0x7f4e4406c8f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c007fd0 tx=0x7f4e4c007920 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:13.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.645+0000 7f4e54ff9640 1 -- 172.21.15.132:0/4249827570 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4e48076230 con 0x7f4e5806c4d0 2023-12-20T04:48:13.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.810+0000 7f4e5e870640 1 -- 172.21.15.132:0/4249827570 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f4e5804e840 con 0x7f4e5806c4d0 2023-12-20T04:48:13.857 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.855+0000 7f4e54ff9640 1 -- 172.21.15.132:0/4249827570 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v123) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4e48035070 con 0x7f4e5806c4d0 2023-12-20T04:48:13.857 INFO:teuthology.orchestra.run.smithi132.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-20T04:48:13.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.857+0000 7f4e5e870640 1 -- 172.21.15.132:0/4249827570 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e4406a430 msgr2=0x7f4e4406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:13.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.857+0000 7f4e5e870640 1 --2- 172.21.15.132:0/4249827570 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e4406a430 0x7f4e4406c8f0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c007fd0 tx=0x7f4e4c007920 comp rx=0 tx=0).stop 2023-12-20T04:48:13.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.857+0000 7f4e5e870640 1 -- 172.21.15.132:0/4249827570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e5806c4d0 msgr2=0x7f4e580b3720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:13.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.857+0000 7f4e5e870640 1 --2- 172.21.15.132:0/4249827570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e5806c4d0 0x7f4e580b3720 secure :-1 s=READY pgs=1227 cs=0 l=1 rev1=1 crypto rx=0x7f4e48000c00 tx=0x7f4e480046c0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.857+0000 7f4e5e870640 1 -- 172.21.15.132:0/4249827570 shutdown_connections 2023-12-20T04:48:13.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.857+0000 7f4e5e870640 1 --2- 172.21.15.132:0/4249827570 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e4406a430 0x7f4e4406c8f0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.857+0000 7f4e5e870640 1 --2- 172.21.15.132:0/4249827570 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e5815cee0 0x7f4e580b0880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.857+0000 7f4e5e870640 1 --2- 172.21.15.132:0/4249827570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e5806c960 0x7f4e581f2e50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.857+0000 7f4e5e870640 1 --2- 172.21.15.132:0/4249827570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e5806c4d0 0x7f4e580b3720 unknown :-1 s=CLOSED pgs=1227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:13.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.857+0000 7f4e5e870640 1 -- 172.21.15.132:0/4249827570 >> 172.21.15.132:0/4249827570 conn(0x7f4e580b16b0 msgr2=0x7f4e580ccde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:13.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.857+0000 7f4e5e870640 1 -- 172.21.15.132:0/4249827570 shutdown_connections 2023-12-20T04:48:13.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:13.857+0000 7f4e5e870640 1 -- 172.21.15.132:0/4249827570 wait complete. 2023-12-20T04:48:13.870 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:48:13.870 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:48:13.871 DEBUG:teuthology.orchestra.run.smithi132:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-20T04:48:13.871 DEBUG:teuthology.orchestra.run.smithi132:> os.fchmod(fd, 0O666) 2023-12-20T04:48:13.871 DEBUG:teuthology.orchestra.run.smithi132:> os.fsync(fd) 2023-12-20T04:48:13.871 DEBUG:teuthology.orchestra.run.smithi132:> os.close(fd) 2023-12-20T04:48:13.871 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:48:14.121 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:48:14.121 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:48:14.121 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:48:14.121 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:48:14.121 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:48:14.121 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:14.121 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:48:14.121 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:48:14.121 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:48:14.121 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:48:14.122 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:14.122 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:48:14.122 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:48:14.122 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:48:14.122 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:48:14.122 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:14.122 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:48:14.122 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:48:14.122 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:48:14.122 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:48:14.122 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:48:14.122 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:48:14.122 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:48:14.122 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:48:14.122 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:14.122 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:48:14.123 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:48:14.236 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.110748.asok 2023-12-20T04:48:14.423 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.110748.asok 2023-12-20T04:48:14.423 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:14.423 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.110748.asok status 2023-12-20T04:48:14.558 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:48:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:48:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:48:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:48:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:48:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:48:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:48:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "110748", 2023-12-20T04:48:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:48:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 1, 2023-12-20T04:48:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:48:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 7581, 2023-12-20T04:48:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:48:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:48:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:48:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 7581 2023-12-20T04:48:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:48:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:48:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3640881913 2023-12-20T04:48:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:48:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:48:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3640881913 2023-12-20T04:48:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.7581 192.168.0.1:0/3640881913", 2023-12-20T04:48:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/3640881913", 2023-12-20T04:48:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 2, 2023-12-20T04:48:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 45, 2023-12-20T04:48:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 122, 2023-12-20T04:48:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 122, 2023-12-20T04:48:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:48:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:48:14.561 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:48:14.567 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set pause 2023-12-20T04:48:14.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.664+0000 7fa3f2bd2640 1 Processor -- start 2023-12-20T04:48:14.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.664+0000 7fa3f2bd2640 1 -- start start 2023-12-20T04:48:14.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.665+0000 7fa3f2bd2640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa3ec0d30a0 0x7fa3ec0cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:14.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.665+0000 7fa3f2bd2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ec0d0cf0 con 0x7fa3ec15d2c0 2023-12-20T04:48:14.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.665+0000 7fa3f2bd2640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3ec0d0550 con 0x7fa3ec0d0060 2023-12-20T04:48:14.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.665+0000 7fa3f2bd2640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3ec0cddc0 con 0x7fa3ec0d30a0 2023-12-20T04:48:14.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.665+0000 7fa3ebfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa3ec15d2c0 0x7fa3ec0d3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48578/0 (socket says 172.21.15.132:48578) 2023-12-20T04:48:14.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.665+0000 7fa3ebfff640 1 -- 172.21.15.132:0/2158297057 learned_addr learned my addr 172.21.15.132:0/2158297057 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:14.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3eb7fe640 1 -- 172.21.15.132:0/2158297057 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 311956872 0 0) 0x7fa3ec0d0cf0 con 0x7fa3ec15d2c0 2023-12-20T04:48:14.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3eb7fe640 1 -- 172.21.15.132:0/2158297057 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa3d4003520 con 0x7fa3ec15d2c0 2023-12-20T04:48:14.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3f096e640 1 --2- 172.21.15.132:0/2158297057 >> v2:172.21.15.187:3300/0 conn(0x7fa3ec0d30a0 0x7fa3ec0cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:14.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3eb7fe640 1 -- 172.21.15.132:0/2158297057 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 844963485 0 0) 0x7fa3d4003520 con 0x7fa3ec15d2c0 2023-12-20T04:48:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3eb7fe640 1 -- 172.21.15.132:0/2158297057 >> v2:172.21.15.187:3300/0 conn(0x7fa3ec0d30a0 msgr2=0x7fa3ec0cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3eb7fe640 1 --2- 172.21.15.132:0/2158297057 >> v2:172.21.15.187:3300/0 conn(0x7fa3ec0d30a0 0x7fa3ec0cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3eb7fe640 1 -- 172.21.15.132:0/2158297057 >> v1:172.21.15.187:6789/0 conn(0x7fa3ec0d0060 legacy=0x7fa3ec0d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3eb7fe640 1 -- 172.21.15.132:0/2158297057 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec0ce0a0 con 0x7fa3ec15d2c0 2023-12-20T04:48:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3eb7fe640 1 -- 172.21.15.132:0/2158297057 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fa3e0001670 con 0x7fa3ec15d2c0 2023-12-20T04:48:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3eb7fe640 1 -- 172.21.15.132:0/2158297057 >> v1:172.21.15.132:6789/0 conn(0x7fa3ec15d2c0 legacy=0x7fa3ec0d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3eb7fe640 1 --2- 172.21.15.132:0/2158297057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3d4003970 0x7fa3d4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3eb7fe640 1 --2- 172.21.15.132:0/2158297057 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d40047c0 0x7fa3d4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3eb7fe640 1 --2- 172.21.15.132:0/2158297057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d4005180 0x7fa3d400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3eb7fe640 1 -- 172.21.15.132:0/2158297057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0cddc0 con 0x7fa3d4003970 2023-12-20T04:48:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3eb7fe640 1 -- 172.21.15.132:0/2158297057 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d400c020 con 0x7fa3d4005180 2023-12-20T04:48:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3eb7fe640 1 -- 172.21.15.132:0/2158297057 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3d400c1e0 con 0x7fa3d40047c0 2023-12-20T04:48:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3f096e640 1 --2- 172.21.15.132:0/2158297057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3d4003970 0x7fa3d4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3ebfff640 1 --2- 172.21.15.132:0/2158297057 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d40047c0 0x7fa3d4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3f116f640 1 --2- 172.21.15.132:0/2158297057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d4005180 0x7fa3d400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3f096e640 1 -- 172.21.15.132:0/2158297057 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d40047c0 msgr2=0x7fa3d4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3f096e640 1 --2- 172.21.15.132:0/2158297057 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3d40047c0 0x7fa3d4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3f096e640 1 -- 172.21.15.132:0/2158297057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d4005180 msgr2=0x7fa3d400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3f096e640 1 --2- 172.21.15.132:0/2158297057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3d4005180 0x7fa3d400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3f096e640 1 -- 172.21.15.132:0/2158297057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3d4003520 con 0x7fa3d4003970 2023-12-20T04:48:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.666+0000 7fa3f116f640 1 -- 172.21.15.132:0/2158297057 reap_dead start 2023-12-20T04:48:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.667+0000 7fa3f096e640 1 --2- 172.21.15.132:0/2158297057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3d4003970 0x7fa3d4003d90 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009ac0 tx=0x7fa3d40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71efd1a12799b8a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.667+0000 7fa3eb7fe640 1 -- 172.21.15.132:0/2158297057 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc02c6b0 con 0x7fa3d4003970 2023-12-20T04:48:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.667+0000 7fa3eb7fe640 1 -- 172.21.15.132:0/2158297057 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc02c810 con 0x7fa3d4003970 2023-12-20T04:48:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.667+0000 7fa3eb7fe640 1 -- 172.21.15.132:0/2158297057 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc02cba0 con 0x7fa3d4003970 2023-12-20T04:48:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.668+0000 7fa3f2bd2640 1 -- 172.21.15.132:0/2158297057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3d4003970 msgr2=0x7fa3d4003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.668+0000 7fa3f2bd2640 1 --2- 172.21.15.132:0/2158297057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3d4003970 0x7fa3d4003d90 secure :-1 s=READY pgs=1229 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009ac0 tx=0x7fa3d40057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.668+0000 7fa3f2bd2640 1 -- 172.21.15.132:0/2158297057 shutdown_connections 2023-12-20T04:48:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.668+0000 7fa3f2bd2640 1 --2- 172.21.15.132:0/2158297057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3d4003970 0x7fa3d4003d90 unknown :-1 s=CLOSED pgs=1229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.668+0000 7fa3f2bd2640 1 -- 172.21.15.132:0/2158297057 >> 172.21.15.132:0/2158297057 conn(0x7fa3ec072e40 msgr2=0x7fa3ec073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.668+0000 7fa3f2bd2640 1 -- 172.21.15.132:0/2158297057 shutdown_connections 2023-12-20T04:48:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.668+0000 7fa3f2bd2640 1 -- 172.21.15.132:0/2158297057 wait complete. 2023-12-20T04:48:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.669+0000 7fa3f2bd2640 1 Processor -- start 2023-12-20T04:48:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.669+0000 7fa3f2bd2640 1 -- start start 2023-12-20T04:48:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.670+0000 7fa3f2bd2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3d4003970 0x7fa3ec15a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.670+0000 7fa3f2bd2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3ec0cc010 0x7fa3ec0cc490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.670+0000 7fa3f2bd2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3ec1e70c0 0x7fa3ec1e7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:14.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.670+0000 7fa3f2bd2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec1e7a80 con 0x7fa3d4003970 2023-12-20T04:48:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.670+0000 7fa3f2bd2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec0ccb00 con 0x7fa3ec0cc010 2023-12-20T04:48:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.670+0000 7fa3f2bd2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ec15aad0 con 0x7fa3ec1e70c0 2023-12-20T04:48:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.670+0000 7fa3f096e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3d4003970 0x7fa3ec15a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.670+0000 7fa3f096e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3d4003970 0x7fa3ec15a590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44812/0 (socket says 172.21.15.132:44812) 2023-12-20T04:48:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.670+0000 7fa3f096e640 1 -- 172.21.15.132:0/1842196826 learned_addr learned my addr 172.21.15.132:0/1842196826 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.670+0000 7fa3f096e640 1 -- 172.21.15.132:0/1842196826 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3ec1e70c0 msgr2=0x7fa3ec1e7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.670+0000 7fa3f096e640 1 --2- 172.21.15.132:0/1842196826 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3ec1e70c0 0x7fa3ec1e7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.670+0000 7fa3f096e640 1 -- 172.21.15.132:0/1842196826 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3ec0cc010 msgr2=0x7fa3ec0cc490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.670+0000 7fa3f096e640 1 --2- 172.21.15.132:0/1842196826 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3ec0cc010 0x7fa3ec0cc490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.670+0000 7fa3f096e640 1 -- 172.21.15.132:0/1842196826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3ec15e700 con 0x7fa3d4003970 2023-12-20T04:48:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.670+0000 7fa3f096e640 1 --2- 172.21.15.132:0/1842196826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3d4003970 0x7fa3ec15a590 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009ac0 tx=0x7fa3dc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.670+0000 7fa3e97fa640 1 -- 172.21.15.132:0/1842196826 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc003810 con 0x7fa3d4003970 2023-12-20T04:48:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.671+0000 7fa3e97fa640 1 -- 172.21.15.132:0/1842196826 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3dc003970 con 0x7fa3d4003970 2023-12-20T04:48:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.671+0000 7fa3f2bd2640 1 -- 172.21.15.132:0/1842196826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ec15e9e0 con 0x7fa3d4003970 2023-12-20T04:48:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.671+0000 7fa3e97fa640 1 -- 172.21.15.132:0/1842196826 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3dc003d00 con 0x7fa3d4003970 2023-12-20T04:48:14.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.671+0000 7fa3f2bd2640 1 -- 172.21.15.132:0/1842196826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ec15efa0 con 0x7fa3d4003970 2023-12-20T04:48:14.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.671+0000 7fa3f2bd2640 1 -- 172.21.15.132:0/1842196826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ec04e840 con 0x7fa3d4003970 2023-12-20T04:48:14.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.672+0000 7fa3e97fa640 1 -- 172.21.15.132:0/1842196826 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa3dc040450 con 0x7fa3d4003970 2023-12-20T04:48:14.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.672+0000 7fa3e97fa640 1 --2- 172.21.15.132:0/1842196826 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa3d806a430 0x7fa3d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:14.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.672+0000 7fa3e97fa640 1 -- 172.21.15.132:0/1842196826 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(123..123 src has 1..123) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3dc0aa750 con 0x7fa3d4003970 2023-12-20T04:48:14.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.672+0000 7fa3ebfff640 1 --2- 172.21.15.132:0/1842196826 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa3d806a430 0x7fa3d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:14.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.673+0000 7fa3ebfff640 1 --2- 172.21.15.132:0/1842196826 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa3d806a430 0x7fa3d806c8f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0001eb0 tx=0x7fa3e0001d40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:14.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.676+0000 7fa3e97fa640 1 -- 172.21.15.132:0/1842196826 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa3dc075dd0 con 0x7fa3d4003970 2023-12-20T04:48:14.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:14.852+0000 7fa3f2bd2640 1 -- 172.21.15.132:0/1842196826 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd set", "key": "pause"} v 0) v1 -- 0x7fa3ec0b8870 con 0x7fa3d4003970 2023-12-20T04:48:15.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.850+0000 7fa3e97fa640 1 -- 172.21.15.132:0/1842196826 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd set", "key": "pause"}]=0 pauserd,pausewr is set v124) v1 ==== 93+0+0 (secure 0 0 0) 0x7fa3dc003e60 con 0x7fa3d4003970 2023-12-20T04:48:15.852 INFO:teuthology.orchestra.run.smithi132.stderr:pauserd,pausewr is set 2023-12-20T04:48:15.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.853+0000 7fa3f2bd2640 1 -- 172.21.15.132:0/1842196826 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa3d806a430 msgr2=0x7fa3d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:15.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.853+0000 7fa3f2bd2640 1 --2- 172.21.15.132:0/1842196826 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa3d806a430 0x7fa3d806c8f0 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7fa3e0001eb0 tx=0x7fa3e0001d40 comp rx=0 tx=0).stop 2023-12-20T04:48:15.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.853+0000 7fa3f2bd2640 1 -- 172.21.15.132:0/1842196826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3d4003970 msgr2=0x7fa3ec15a590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:15.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.853+0000 7fa3f2bd2640 1 --2- 172.21.15.132:0/1842196826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3d4003970 0x7fa3ec15a590 secure :-1 s=READY pgs=1230 cs=0 l=1 rev1=1 crypto rx=0x7fa3dc009ac0 tx=0x7fa3dc004730 comp rx=0 tx=0).stop 2023-12-20T04:48:15.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.853+0000 7fa3f2bd2640 1 -- 172.21.15.132:0/1842196826 shutdown_connections 2023-12-20T04:48:15.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.853+0000 7fa3f2bd2640 1 --2- 172.21.15.132:0/1842196826 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa3d806a430 0x7fa3d806c8f0 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:15.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.853+0000 7fa3f2bd2640 1 --2- 172.21.15.132:0/1842196826 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3ec1e70c0 0x7fa3ec1e7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:15.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.853+0000 7fa3f2bd2640 1 --2- 172.21.15.132:0/1842196826 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3ec0cc010 0x7fa3ec0cc490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:15.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.853+0000 7fa3f2bd2640 1 --2- 172.21.15.132:0/1842196826 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3d4003970 0x7fa3ec15a590 unknown :-1 s=CLOSED pgs=1230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:15.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.853+0000 7fa3f2bd2640 1 -- 172.21.15.132:0/1842196826 >> 172.21.15.132:0/1842196826 conn(0x7fa3ec072e40 msgr2=0x7fa3ec0b2e50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:15.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.853+0000 7fa3f2bd2640 1 -- 172.21.15.132:0/1842196826 shutdown_connections 2023-12-20T04:48:15.856 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.853+0000 7fa3f2bd2640 1 -- 172.21.15.132:0/1842196826 wait complete. 2023-12-20T04:48:15.868 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset pause 2023-12-20T04:48:15.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.972+0000 7f5241963640 1 Processor -- start 2023-12-20T04:48:15.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.972+0000 7f5241963640 1 -- start start 2023-12-20T04:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.973+0000 7f5241963640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f523c06bba0 0x7f523c06f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.973+0000 7f5241963640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f523c0ad720 0x7f523c0ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.973+0000 7f5241963640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f523c06c8e0 con 0x7f523c159bb0 2023-12-20T04:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.973+0000 7f5241963640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f523c15e420 con 0x7f523c0ad720 2023-12-20T04:48:15.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.973+0000 7f5241963640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c15e700 con 0x7f523c06bba0 2023-12-20T04:48:15.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.973+0000 7f523b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f523c0ad720 0x7f523c0ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:15.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.973+0000 7f523affd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f523c159bb0 0x7f523c06b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:48594/0 (socket says 172.21.15.132:48594) 2023-12-20T04:48:15.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.973+0000 7f523b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f523c0ad720 0x7f523c0ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44820/0 (socket says 172.21.15.132:44820) 2023-12-20T04:48:15.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.973+0000 7f523affd640 1 -- 172.21.15.132:0/772080360 learned_addr learned my addr 172.21.15.132:0/772080360 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:15.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.973+0000 7f523a7fc640 1 --2- 172.21.15.132:0/772080360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f523c06bba0 0x7f523c06f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:15.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.974+0000 7f523b7fe640 1 -- 172.21.15.132:0/772080360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f523c06bba0 msgr2=0x7f523c06f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:15.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.974+0000 7f523b7fe640 1 --2- 172.21.15.132:0/772080360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f523c06bba0 0x7f523c06f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:15.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.974+0000 7f523b7fe640 1 -- 172.21.15.132:0/772080360 >> v1:172.21.15.132:6789/0 conn(0x7f523c159bb0 legacy=0x7f523c06b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:15.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.974+0000 7f523b7fe640 1 -- 172.21.15.132:0/772080360 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f523c0c9d10 con 0x7f523c0ad720 2023-12-20T04:48:15.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.974+0000 7f5239ffb640 1 -- 172.21.15.132:0/772080360 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1381265494 0 0) 0x7f523c06c8e0 con 0x7f523c159bb0 2023-12-20T04:48:15.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.974+0000 7f523b7fe640 1 --2- 172.21.15.132:0/772080360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f523c0ad720 0x7f523c0ca510 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f52340097a0 tx=0x7f523402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58c78a91c59825de server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:15.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.974+0000 7f5239ffb640 1 -- 172.21.15.132:0/772080360 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234031830 con 0x7f523c0ad720 2023-12-20T04:48:15.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.974+0000 7f5239ffb640 1 -- 172.21.15.132:0/772080360 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5234031990 con 0x7f523c0ad720 2023-12-20T04:48:15.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.974+0000 7f5239ffb640 1 -- 172.21.15.132:0/772080360 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5234031d20 con 0x7f523c0ad720 2023-12-20T04:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.975+0000 7f5241963640 1 -- 172.21.15.132:0/772080360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f523c0ad720 msgr2=0x7f523c0ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.975+0000 7f5241963640 1 --2- 172.21.15.132:0/772080360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f523c0ad720 0x7f523c0ca510 secure :-1 s=READY pgs=1232 cs=0 l=1 rev1=1 crypto rx=0x7f52340097a0 tx=0x7f523402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.975+0000 7f5241963640 1 -- 172.21.15.132:0/772080360 shutdown_connections 2023-12-20T04:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.975+0000 7f5241963640 1 --2- 172.21.15.132:0/772080360 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f523c0ad720 0x7f523c0ca510 unknown :-1 s=CLOSED pgs=1232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.975+0000 7f5241963640 1 --2- 172.21.15.132:0/772080360 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f523c06bba0 0x7f523c06f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.975+0000 7f5241963640 1 -- 172.21.15.132:0/772080360 >> 172.21.15.132:0/772080360 conn(0x7f523c06a260 msgr2=0x7f523c0b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.975+0000 7f5241963640 1 -- 172.21.15.132:0/772080360 shutdown_connections 2023-12-20T04:48:15.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.975+0000 7f5241963640 1 -- 172.21.15.132:0/772080360 wait complete. 2023-12-20T04:48:15.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.976+0000 7f5241963640 1 Processor -- start 2023-12-20T04:48:15.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.976+0000 7f5241963640 1 -- start start 2023-12-20T04:48:15.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.977+0000 7f5241963640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f523c06bba0 0x7f523c15a150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:15.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.977+0000 7f5241963640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f523c0ad720 0x7f523c0c48f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:15.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.977+0000 7f5241963640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f523c159bb0 0x7f523c0c4e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:15.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.977+0000 7f5241963640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c1f0180 con 0x7f523c159bb0 2023-12-20T04:48:15.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.977+0000 7f5241963640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f523c1ef600 con 0x7f523c06bba0 2023-12-20T04:48:15.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.977+0000 7f5241963640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f523c1ef8e0 con 0x7f523c0ad720 2023-12-20T04:48:15.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.977+0000 7f523b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f523c159bb0 0x7f523c0c4e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:15.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.977+0000 7f523b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f523c159bb0 0x7f523c0c4e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44832/0 (socket says 172.21.15.132:44832) 2023-12-20T04:48:15.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.977+0000 7f523b7fe640 1 -- 172.21.15.132:0/4008490192 learned_addr learned my addr 172.21.15.132:0/4008490192 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:15.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.977+0000 7f523b7fe640 1 -- 172.21.15.132:0/4008490192 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f523c0ad720 msgr2=0x7f523c0c48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:15.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.977+0000 7f523a7fc640 1 --2- 172.21.15.132:0/4008490192 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f523c0ad720 0x7f523c0c48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:15.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.977+0000 7f523affd640 1 --2- 172.21.15.132:0/4008490192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f523c06bba0 0x7f523c15a150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:15.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.977+0000 7f523b7fe640 1 --2- 172.21.15.132:0/4008490192 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f523c0ad720 0x7f523c0c48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:15.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.977+0000 7f523b7fe640 1 -- 172.21.15.132:0/4008490192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f523c06bba0 msgr2=0x7f523c15a150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:15.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.977+0000 7f523b7fe640 1 --2- 172.21.15.132:0/4008490192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f523c06bba0 0x7f523c15a150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:15.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.977+0000 7f523b7fe640 1 -- 172.21.15.132:0/4008490192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5234009400 con 0x7f523c159bb0 2023-12-20T04:48:15.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.978+0000 7f523a7fc640 1 --2- 172.21.15.132:0/4008490192 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f523c0ad720 0x7f523c0c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:15.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.978+0000 7f523affd640 1 --2- 172.21.15.132:0/4008490192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f523c06bba0 0x7f523c15a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:15.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.978+0000 7f523b7fe640 1 --2- 172.21.15.132:0/4008490192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f523c159bb0 0x7f523c0c4e30 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f52340098c0 tx=0x7f52340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:15.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.978+0000 7f5223fff640 1 -- 172.21.15.132:0/4008490192 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523403a630 con 0x7f523c159bb0 2023-12-20T04:48:15.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.978+0000 7f5223fff640 1 -- 172.21.15.132:0/4008490192 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f523403a790 con 0x7f523c159bb0 2023-12-20T04:48:15.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.978+0000 7f5241963640 1 -- 172.21.15.132:0/4008490192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f523c1efbc0 con 0x7f523c159bb0 2023-12-20T04:48:15.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.978+0000 7f5223fff640 1 -- 172.21.15.132:0/4008490192 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f523403ab40 con 0x7f523c159bb0 2023-12-20T04:48:15.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.978+0000 7f5241963640 1 -- 172.21.15.132:0/4008490192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f523c1ef1d0 con 0x7f523c159bb0 2023-12-20T04:48:15.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.979+0000 7f5241963640 1 -- 172.21.15.132:0/4008490192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f523c1efa20 con 0x7f523c159bb0 2023-12-20T04:48:15.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.979+0000 7f5223fff640 1 -- 172.21.15.132:0/4008490192 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f523403aca0 con 0x7f523c159bb0 2023-12-20T04:48:15.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.980+0000 7f5223fff640 1 --2- 172.21.15.132:0/4008490192 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f522806a430 0x7f522806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:15.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.980+0000 7f5223fff640 1 -- 172.21.15.132:0/4008490192 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(124..124 src has 1..124) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f52340aa6d0 con 0x7f523c159bb0 2023-12-20T04:48:15.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.980+0000 7f523affd640 1 --2- 172.21.15.132:0/4008490192 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f522806a430 0x7f522806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:15.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.980+0000 7f5223fff640 1 -- 172.21.15.132:0/4008490192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=125+}) v3 -- 0x7f5228071f60 con 0x7f523c159bb0 2023-12-20T04:48:15.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.980+0000 7f523affd640 1 --2- 172.21.15.132:0/4008490192 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f522806a430 0x7f522806c8f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f522c007fd0 tx=0x7f522c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:15.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:15.984+0000 7f5223fff640 1 -- 172.21.15.132:0/4008490192 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5234048060 con 0x7f523c159bb0 2023-12-20T04:48:16.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.159+0000 7f5241963640 1 -- 172.21.15.132:0/4008490192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd unset", "key": "pause"} v 0) v1 -- 0x7f523c04e840 con 0x7f523c159bb0 2023-12-20T04:48:16.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.871+0000 7f5223fff640 1 -- 172.21.15.132:0/4008490192 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(125..125 src has 1..125) v4 ==== 288+0+0 (secure 0 0 0) 0x7f523407a1a0 con 0x7f523c159bb0 2023-12-20T04:48:16.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.871+0000 7f5223fff640 1 -- 172.21.15.132:0/4008490192 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=126}) v3 -- 0x7f5228072810 con 0x7f523c159bb0 2023-12-20T04:48:16.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.874+0000 7f5223fff640 1 -- 172.21.15.132:0/4008490192 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "osd unset", "key": "pause"}]=0 pauserd,pausewr is unset v125) v1 ==== 97+0+0 (secure 0 0 0) 0x7f5234035020 con 0x7f523c159bb0 2023-12-20T04:48:16.876 INFO:teuthology.orchestra.run.smithi132.stderr:pauserd,pausewr is unset 2023-12-20T04:48:16.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.876+0000 7f5241963640 1 -- 172.21.15.132:0/4008490192 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f522806a430 msgr2=0x7f522806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:16.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.876+0000 7f5241963640 1 --2- 172.21.15.132:0/4008490192 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f522806a430 0x7f522806c8f0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7f522c007fd0 tx=0x7f522c009040 comp rx=0 tx=0).stop 2023-12-20T04:48:16.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.876+0000 7f5241963640 1 -- 172.21.15.132:0/4008490192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f523c159bb0 msgr2=0x7f523c0c4e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:16.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.876+0000 7f5241963640 1 --2- 172.21.15.132:0/4008490192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f523c159bb0 0x7f523c0c4e30 secure :-1 s=READY pgs=1233 cs=0 l=1 rev1=1 crypto rx=0x7f52340098c0 tx=0x7f52340046c0 comp rx=0 tx=0).stop 2023-12-20T04:48:16.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.876+0000 7f5241963640 1 -- 172.21.15.132:0/4008490192 shutdown_connections 2023-12-20T04:48:16.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.876+0000 7f5241963640 1 --2- 172.21.15.132:0/4008490192 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f522806a430 0x7f522806c8f0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:16.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.876+0000 7f5241963640 1 --2- 172.21.15.132:0/4008490192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f523c159bb0 0x7f523c0c4e30 unknown :-1 s=CLOSED pgs=1233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:16.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.876+0000 7f5241963640 1 --2- 172.21.15.132:0/4008490192 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f523c0ad720 0x7f523c0c48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:16.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.876+0000 7f5241963640 1 --2- 172.21.15.132:0/4008490192 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f523c06bba0 0x7f523c15a150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:16.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.876+0000 7f5241963640 1 -- 172.21.15.132:0/4008490192 >> 172.21.15.132:0/4008490192 conn(0x7f523c06a260 msgr2=0x7f523c0ce990 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:16.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.876+0000 7f5241963640 1 -- 172.21.15.132:0/4008490192 shutdown_connections 2023-12-20T04:48:16.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.876+0000 7f5241963640 1 -- 172.21.15.132:0/4008490192 wait complete. 2023-12-20T04:48:16.891 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:48:16.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.992+0000 7f6e1324b640 1 Processor -- start 2023-12-20T04:48:16.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.992+0000 7f6e1324b640 1 -- start start 2023-12-20T04:48:16.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.992+0000 7f6e1324b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6e0c15ab70 0x7f6e0c160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:16.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.992+0000 7f6e1324b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6e0c0cf280 0x7f6e0c069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:16.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.993+0000 7f6e1324b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e0c06d530 con 0x7f6e0c0cf730 2023-12-20T04:48:16.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.993+0000 7f6e1324b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e0c070540 con 0x7f6e0c15ab70 2023-12-20T04:48:16.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.993+0000 7f6e1324b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e0c070790 con 0x7f6e0c0cf280 2023-12-20T04:48:16.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.993+0000 7f6e10fe7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6e0c15ab70 0x7f6e0c160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:16.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.993+0000 7f6e10fe7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6e0c15ab70 0x7f6e0c160d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44848/0 (socket says 172.21.15.132:44848) 2023-12-20T04:48:16.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.993+0000 7f6e10fe7640 1 -- 172.21.15.132:0/803458038 learned_addr learned my addr 172.21.15.132:0/803458038 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:16.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.993+0000 7f6e0bfff640 1 --2- 172.21.15.132:0/803458038 >> v2:172.21.15.187:3300/0 conn(0x7f6e0c0cf280 0x7f6e0c069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:16.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.993+0000 7f6e10fe7640 1 -- 172.21.15.132:0/803458038 >> v2:172.21.15.187:3300/0 conn(0x7f6e0c0cf280 msgr2=0x7f6e0c069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:16.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.993+0000 7f6e10fe7640 1 --2- 172.21.15.132:0/803458038 >> v2:172.21.15.187:3300/0 conn(0x7f6e0c0cf280 0x7f6e0c069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:16.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.993+0000 7f6e10fe7640 1 -- 172.21.15.132:0/803458038 >> v1:172.21.15.187:6789/0 conn(0x7f6e0c0cf730 legacy=0x7f6e0c15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:16.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.993+0000 7f6e10fe7640 1 -- 172.21.15.132:0/803458038 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e0c070a70 con 0x7f6e0c15ab70 2023-12-20T04:48:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.993+0000 7f6e0bfff640 1 --2- 172.21.15.132:0/803458038 >> v2:172.21.15.187:3300/0 conn(0x7f6e0c0cf280 0x7f6e0c069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.994+0000 7f6e10fe7640 1 --2- 172.21.15.132:0/803458038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e0c15ab70 0x7f6e0c160d70 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0cc440 tx=0x7f6e0002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b8e3a287ee15030 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.994+0000 7f6e0b7fe640 1 -- 172.21.15.132:0/803458038 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00031870 con 0x7f6e0c15ab70 2023-12-20T04:48:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.994+0000 7f6e0b7fe640 1 -- 172.21.15.132:0/803458038 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e000319d0 con 0x7f6e0c15ab70 2023-12-20T04:48:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.994+0000 7f6e0b7fe640 1 -- 172.21.15.132:0/803458038 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e00031d60 con 0x7f6e0c15ab70 2023-12-20T04:48:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.994+0000 7f6e1324b640 1 -- 172.21.15.132:0/803458038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e0c15ab70 msgr2=0x7f6e0c160d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.994+0000 7f6e1324b640 1 --2- 172.21.15.132:0/803458038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e0c15ab70 0x7f6e0c160d70 secure :-1 s=READY pgs=1234 cs=0 l=1 rev1=1 crypto rx=0x7f6e0c0cc440 tx=0x7f6e0002b910 comp rx=0 tx=0).stop 2023-12-20T04:48:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.994+0000 7f6e1324b640 1 -- 172.21.15.132:0/803458038 shutdown_connections 2023-12-20T04:48:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.994+0000 7f6e1324b640 1 --2- 172.21.15.132:0/803458038 >> v2:172.21.15.187:3300/0 conn(0x7f6e0c0cf280 0x7f6e0c069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.994+0000 7f6e1324b640 1 --2- 172.21.15.132:0/803458038 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e0c15ab70 0x7f6e0c160d70 unknown :-1 s=CLOSED pgs=1234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.994+0000 7f6e1324b640 1 -- 172.21.15.132:0/803458038 >> 172.21.15.132:0/803458038 conn(0x7f6e0c0cfca0 msgr2=0x7f6e0c0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.994+0000 7f6e1324b640 1 -- 172.21.15.132:0/803458038 shutdown_connections 2023-12-20T04:48:16.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.994+0000 7f6e1324b640 1 -- 172.21.15.132:0/803458038 wait complete. 2023-12-20T04:48:17.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.996+0000 7f6e1324b640 1 Processor -- start 2023-12-20T04:48:17.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.996+0000 7f6e1324b640 1 -- start start 2023-12-20T04:48:17.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.996+0000 7f6e1324b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e0c0cf280 0x7f6e0c0aebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:17.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.996+0000 7f6e1324b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e0c0cf730 0x7f6e0c159030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:17.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.996+0000 7f6e1324b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e0c15ab70 0x7f6e0c15d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:17.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.996+0000 7f6e1324b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c15e470 con 0x7f6e0c15ab70 2023-12-20T04:48:17.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.996+0000 7f6e1324b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c15e750 con 0x7f6e0c0cf280 2023-12-20T04:48:17.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.996+0000 7f6e1324b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e0c15f650 con 0x7f6e0c0cf730 2023-12-20T04:48:17.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.996+0000 7f6e117e8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e0c15ab70 0x7f6e0c15d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:17.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.997+0000 7f6e117e8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e0c15ab70 0x7f6e0c15d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:44862/0 (socket says 172.21.15.132:44862) 2023-12-20T04:48:17.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.997+0000 7f6e117e8640 1 -- 172.21.15.132:0/2612042796 learned_addr learned my addr 172.21.15.132:0/2612042796 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:17.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.997+0000 7f6e10fe7640 1 --2- 172.21.15.132:0/2612042796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e0c0cf280 0x7f6e0c0aebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:17.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.997+0000 7f6e0bfff640 1 --2- 172.21.15.132:0/2612042796 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e0c0cf730 0x7f6e0c159030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:17.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.997+0000 7f6e117e8640 1 -- 172.21.15.132:0/2612042796 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e0c0cf730 msgr2=0x7f6e0c159030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:17.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.997+0000 7f6e117e8640 1 --2- 172.21.15.132:0/2612042796 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e0c0cf730 0x7f6e0c159030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:17.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.997+0000 7f6e117e8640 1 -- 172.21.15.132:0/2612042796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e0c0cf280 msgr2=0x7f6e0c0aebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:17.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.997+0000 7f6e117e8640 1 --2- 172.21.15.132:0/2612042796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e0c0cf280 0x7f6e0c0aebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:17.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.997+0000 7f6e117e8640 1 -- 172.21.15.132:0/2612042796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e000094d0 con 0x7f6e0c15ab70 2023-12-20T04:48:17.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.997+0000 7f6e117e8640 1 --2- 172.21.15.132:0/2612042796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e0c15ab70 0x7f6e0c15d9d0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400c780 tx=0x7f6e0400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:17.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.997+0000 7f6e097fa640 1 -- 172.21.15.132:0/2612042796 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e04004b60 con 0x7f6e0c15ab70 2023-12-20T04:48:17.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.997+0000 7f6e097fa640 1 -- 172.21.15.132:0/2612042796 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e0400ce90 con 0x7f6e0c15ab70 2023-12-20T04:48:17.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.997+0000 7f6e097fa640 1 -- 172.21.15.132:0/2612042796 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e0400a850 con 0x7f6e0c15ab70 2023-12-20T04:48:17.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.997+0000 7f6e1324b640 1 -- 172.21.15.132:0/2612042796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e0c15f930 con 0x7f6e0c15ab70 2023-12-20T04:48:17.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.997+0000 7f6e1324b640 1 -- 172.21.15.132:0/2612042796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e0c15df10 con 0x7f6e0c15ab70 2023-12-20T04:48:17.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.998+0000 7f6e1324b640 1 -- 172.21.15.132:0/2612042796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e0c15f4b0 con 0x7f6e0c15ab70 2023-12-20T04:48:17.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.999+0000 7f6e097fa640 1 -- 172.21.15.132:0/2612042796 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6e0400a9b0 con 0x7f6e0c15ab70 2023-12-20T04:48:17.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.999+0000 7f6e097fa640 1 --2- 172.21.15.132:0/2612042796 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6df006a430 0x7f6df006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:17.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.999+0000 7f6e097fa640 1 -- 172.21.15.132:0/2612042796 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e04088950 con 0x7f6e0c15ab70 2023-12-20T04:48:17.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.999+0000 7f6e10fe7640 1 --2- 172.21.15.132:0/2612042796 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6df006a430 0x7f6df006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:17.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:16.999+0000 7f6e10fe7640 1 --2- 172.21.15.132:0/2612042796 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6df006a430 0x7f6df006c8f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6e00036000 tx=0x7f6e0003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:17.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.003+0000 7f6e097fa640 1 -- 172.21.15.132:0/2612042796 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6e0c15f4b0 con 0x7f6e0c15ab70 2023-12-20T04:48:17.176 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.174+0000 7f6e1324b640 1 -- 172.21.15.132:0/2612042796 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6e0c15fb70 con 0x7f6e0c15ab70 2023-12-20T04:48:17.177 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.175+0000 7f6e097fa640 1 -- 172.21.15.132:0/2612042796 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16107 (secure 0 0 0) 0x7f6e0c15fb70 con 0x7f6e0c15ab70 2023-12-20T04:48:17.177 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:17.177 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":125,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:48:16.867874+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:48:02.660300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-20T04:48:03.433311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:48:17.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.177+0000 7f6e1324b640 1 -- 172.21.15.132:0/2612042796 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6df006a430 msgr2=0x7f6df006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:17.179 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.177+0000 7f6e1324b640 1 --2- 172.21.15.132:0/2612042796 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6df006a430 0x7f6df006c8f0 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f6e00036000 tx=0x7f6e0003c040 comp rx=0 tx=0).stop 2023-12-20T04:48:17.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.177+0000 7f6e1324b640 1 -- 172.21.15.132:0/2612042796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e0c15ab70 msgr2=0x7f6e0c15d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:17.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.177+0000 7f6e1324b640 1 --2- 172.21.15.132:0/2612042796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e0c15ab70 0x7f6e0c15d9d0 secure :-1 s=READY pgs=1235 cs=0 l=1 rev1=1 crypto rx=0x7f6e0400c780 tx=0x7f6e0400cc40 comp rx=0 tx=0).stop 2023-12-20T04:48:17.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.177+0000 7f6e1324b640 1 -- 172.21.15.132:0/2612042796 shutdown_connections 2023-12-20T04:48:17.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.177+0000 7f6e1324b640 1 --2- 172.21.15.132:0/2612042796 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6df006a430 0x7f6df006c8f0 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:17.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.177+0000 7f6e1324b640 1 --2- 172.21.15.132:0/2612042796 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e0c15ab70 0x7f6e0c15d9d0 unknown :-1 s=CLOSED pgs=1235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:17.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.177+0000 7f6e1324b640 1 --2- 172.21.15.132:0/2612042796 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e0c0cf730 0x7f6e0c159030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:17.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.177+0000 7f6e1324b640 1 --2- 172.21.15.132:0/2612042796 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e0c0cf280 0x7f6e0c0aebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:17.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.177+0000 7f6e1324b640 1 -- 172.21.15.132:0/2612042796 >> 172.21.15.132:0/2612042796 conn(0x7f6e0c0cfca0 msgr2=0x7f6e0c15b8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:17.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.177+0000 7f6e1324b640 1 -- 172.21.15.132:0/2612042796 shutdown_connections 2023-12-20T04:48:17.180 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.177+0000 7f6e1324b640 1 -- 172.21.15.132:0/2612042796 wait complete. 2023-12-20T04:48:17.190 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:48:17.190 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:48:17.191 DEBUG:teuthology.orchestra.run.smithi132:> fd = os.open("/home/ubuntu/cephtest/mnt.0/foo", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-20T04:48:17.191 DEBUG:teuthology.orchestra.run.smithi132:> os.fchmod(fd, 0O666) 2023-12-20T04:48:17.191 DEBUG:teuthology.orchestra.run.smithi132:> os.fsync(fd) 2023-12-20T04:48:17.191 DEBUG:teuthology.orchestra.run.smithi132:> os.close(fd) 2023-12-20T04:48:17.191 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:48:17.441 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:48:17.441 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:48:17.441 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:48:17.441 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:48:17.442 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:48:17.442 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:17.442 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:48:17.442 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:48:17.442 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:48:17.442 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:48:17.442 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:17.442 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:48:17.442 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:48:17.442 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:48:17.442 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:48:17.442 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:17.442 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:48:17.442 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:48:17.442 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:48:17.443 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:48:17.443 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:48:17.443 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:48:17.443 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:48:17.443 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:48:17.443 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:17.443 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:48:17.443 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:48:17.558 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.110748.asok 2023-12-20T04:48:17.745 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.110748.asok 2023-12-20T04:48:17.745 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:17.745 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.110748.asok status 2023-12-20T04:48:17.881 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:48:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:48:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:48:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:48:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:48:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:48:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:48:17.881 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "110748", 2023-12-20T04:48:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:48:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 1, 2023-12-20T04:48:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:48:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 7581, 2023-12-20T04:48:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:48:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:48:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:48:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 7581 2023-12-20T04:48:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:48:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:48:17.882 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3640881913 2023-12-20T04:48:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:48:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:48:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3640881913 2023-12-20T04:48:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.7581 192.168.0.1:0/3640881913", 2023-12-20T04:48:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/3640881913", 2023-12-20T04:48:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 2, 2023-12-20T04:48:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 45, 2023-12-20T04:48:17.883 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 122, 2023-12-20T04:48:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 122, 2023-12-20T04:48:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:48:17.884 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:48:17.884 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:48:17.890 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:48:17.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.988+0000 7f99bde42640 1 Processor -- start 2023-12-20T04:48:17.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.988+0000 7f99bde42640 1 -- start start 2023-12-20T04:48:17.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.989+0000 7f99bde42640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b815cef0 0x7f99b80cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:17.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.989+0000 7f99bde42640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f99b80ad2f0 0x7f99b806bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:17.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.989+0000 7f99bde42640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99b80ad780 con 0x7f99b815d2d0 2023-12-20T04:48:17.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.989+0000 7f99bde42640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99b80add30 con 0x7f99b80ad2f0 2023-12-20T04:48:17.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.989+0000 7f99bde42640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80ae010 con 0x7f99b815cef0 2023-12-20T04:48:17.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.989+0000 7f99b7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f99b80ad2f0 0x7f99b806bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:17.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.989+0000 7f99b7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f99b80ad2f0 0x7f99b806bd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34214/0 (socket says 172.21.15.132:34214) 2023-12-20T04:48:17.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.989+0000 7f99b7fff640 1 -- 172.21.15.132:0/484629346 learned_addr learned my addr 172.21.15.132:0/484629346 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:17.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.989+0000 7f99b77fe640 1 --2- 172.21.15.132:0/484629346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b815cef0 0x7f99b80cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:17.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.989+0000 7f99b7fff640 1 -- 172.21.15.132:0/484629346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b815cef0 msgr2=0x7f99b80cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.989+0000 7f99b7fff640 1 --2- 172.21.15.132:0/484629346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b815cef0 0x7f99b80cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.989+0000 7f99b7fff640 1 -- 172.21.15.132:0/484629346 >> v1:172.21.15.187:6789/0 conn(0x7f99b815d2d0 legacy=0x7f99b80cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.989+0000 7f99b7fff640 1 -- 172.21.15.132:0/484629346 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b8072d00 con 0x7f99b80ad2f0 2023-12-20T04:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.989+0000 7f99b77fe640 1 --2- 172.21.15.132:0/484629346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b815cef0 0x7f99b80cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.990+0000 7f99b7fff640 1 --2- 172.21.15.132:0/484629346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b80ad2f0 0x7f99b806bd00 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009e50 tx=0x7f99b002bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa26c6b506e6cb0b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.990+0000 7f99b67fc640 1 -- 172.21.15.132:0/484629346 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b002caf0 con 0x7f99b80ad2f0 2023-12-20T04:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.990+0000 7f99b67fc640 1 -- 172.21.15.132:0/484629346 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b002cc50 con 0x7f99b80ad2f0 2023-12-20T04:48:17.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.990+0000 7f99b67fc640 1 -- 172.21.15.132:0/484629346 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b00343f0 con 0x7f99b80ad2f0 2023-12-20T04:48:17.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.990+0000 7f99bde42640 1 -- 172.21.15.132:0/484629346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b80ad2f0 msgr2=0x7f99b806bd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:17.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.990+0000 7f99bde42640 1 --2- 172.21.15.132:0/484629346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b80ad2f0 0x7f99b806bd00 secure :-1 s=READY pgs=1236 cs=0 l=1 rev1=1 crypto rx=0x7f99b0009e50 tx=0x7f99b002bf50 comp rx=0 tx=0).stop 2023-12-20T04:48:17.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.991+0000 7f99bde42640 1 -- 172.21.15.132:0/484629346 shutdown_connections 2023-12-20T04:48:17.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.991+0000 7f99bde42640 1 --2- 172.21.15.132:0/484629346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b80ad2f0 0x7f99b806bd00 unknown :-1 s=CLOSED pgs=1236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:17.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.991+0000 7f99bde42640 1 --2- 172.21.15.132:0/484629346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b815cef0 0x7f99b80cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:17.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.991+0000 7f99bde42640 1 -- 172.21.15.132:0/484629346 >> 172.21.15.132:0/484629346 conn(0x7f99b80cf330 msgr2=0x7f99b80cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:17.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.991+0000 7f99bde42640 1 -- 172.21.15.132:0/484629346 shutdown_connections 2023-12-20T04:48:17.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.991+0000 7f99bde42640 1 -- 172.21.15.132:0/484629346 wait complete. 2023-12-20T04:48:17.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.992+0000 7f99bde42640 1 Processor -- start 2023-12-20T04:48:17.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.992+0000 7f99bde42640 1 -- start start 2023-12-20T04:48:17.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.992+0000 7f99bde42640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b80ad2f0 0x7f99b814e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:17.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.992+0000 7f99bde42640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b815cef0 0x7f99b80b0000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:17.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.992+0000 7f99bde42640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b815d2d0 0x7f99b80b0540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:17.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.992+0000 7f99bde42640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b815da30 con 0x7f99b815d2d0 2023-12-20T04:48:17.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.992+0000 7f99bde42640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80b2f80 con 0x7f99b815cef0 2023-12-20T04:48:17.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.992+0000 7f99bde42640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99b80b31d0 con 0x7f99b80ad2f0 2023-12-20T04:48:17.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.993+0000 7f99b7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b815d2d0 0x7f99b80b0540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:17.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.993+0000 7f99b7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b815d2d0 0x7f99b80b0540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34216/0 (socket says 172.21.15.132:34216) 2023-12-20T04:48:17.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.993+0000 7f99b7fff640 1 -- 172.21.15.132:0/2950412578 learned_addr learned my addr 172.21.15.132:0/2950412578 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:17.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.993+0000 7f99b6ffd640 1 --2- 172.21.15.132:0/2950412578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b815cef0 0x7f99b80b0000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:17.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.993+0000 7f99b77fe640 1 --2- 172.21.15.132:0/2950412578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b80ad2f0 0x7f99b814e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:17.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.993+0000 7f99b7fff640 1 -- 172.21.15.132:0/2950412578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b80ad2f0 msgr2=0x7f99b814e8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:17.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.993+0000 7f99b7fff640 1 --2- 172.21.15.132:0/2950412578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b80ad2f0 0x7f99b814e8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:17.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.993+0000 7f99b7fff640 1 -- 172.21.15.132:0/2950412578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b815cef0 msgr2=0x7f99b80b0000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:17.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.993+0000 7f99b7fff640 1 --2- 172.21.15.132:0/2950412578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b815cef0 0x7f99b80b0000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:17.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.993+0000 7f99b7fff640 1 -- 172.21.15.132:0/2950412578 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99b0009b30 con 0x7f99b815d2d0 2023-12-20T04:48:17.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.993+0000 7f99b77fe640 1 --2- 172.21.15.132:0/2950412578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b80ad2f0 0x7f99b814e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:17.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.993+0000 7f99b7fff640 1 --2- 172.21.15.132:0/2950412578 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b815d2d0 0x7f99b80b0540 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f99b0036040 tx=0x7f99b0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:17.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.993+0000 7f999ffff640 1 -- 172.21.15.132:0/2950412578 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b003e450 con 0x7f99b815d2d0 2023-12-20T04:48:17.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.993+0000 7f999ffff640 1 -- 172.21.15.132:0/2950412578 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99b003e5d0 con 0x7f99b815d2d0 2023-12-20T04:48:17.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.993+0000 7f99bde42640 1 -- 172.21.15.132:0/2950412578 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99b80b34b0 con 0x7f99b815d2d0 2023-12-20T04:48:17.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.993+0000 7f999ffff640 1 -- 172.21.15.132:0/2950412578 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99b003e980 con 0x7f99b815d2d0 2023-12-20T04:48:17.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.993+0000 7f99bde42640 1 -- 172.21.15.132:0/2950412578 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99b80b3a70 con 0x7f99b815d2d0 2023-12-20T04:48:17.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.994+0000 7f99bde42640 1 -- 172.21.15.132:0/2950412578 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99b804e840 con 0x7f99b815d2d0 2023-12-20T04:48:17.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.995+0000 7f999ffff640 1 -- 172.21.15.132:0/2950412578 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f99b003eae0 con 0x7f99b815d2d0 2023-12-20T04:48:17.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.995+0000 7f999ffff640 1 --2- 172.21.15.132:0/2950412578 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99a406a430 0x7f99a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:17.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.995+0000 7f999ffff640 1 -- 172.21.15.132:0/2950412578 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99b00ab750 con 0x7f99b815d2d0 2023-12-20T04:48:18.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.995+0000 7f99b77fe640 1 --2- 172.21.15.132:0/2950412578 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99a406a430 0x7f99a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:18.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.995+0000 7f99b77fe640 1 --2- 172.21.15.132:0/2950412578 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99a406a430 0x7f99a406c8f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f99b80cfe20 tx=0x7f99a8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:18.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:17.999+0000 7f999ffff640 1 -- 172.21.15.132:0/2950412578 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f99b0076d40 con 0x7f99b815d2d0 2023-12-20T04:48:18.057 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:48:18.060 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:48:18.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:18.202+0000 7f99bde42640 1 -- 172.21.15.132:0/2950412578 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f99b80b52b0 con 0x7f99b815d2d0 2023-12-20T04:48:18.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:18.203+0000 7f999ffff640 1 -- 172.21.15.132:0/2950412578 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f99b007a360 con 0x7f99b815d2d0 2023-12-20T04:48:18.205 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:18.205 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":45,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3951194420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3951194420},{"type":"v1","addr":"172.21.15.187:6833","nonce":3951194420}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1575999914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1575999914},{"type":"v1","addr":"172.21.15.187:6835","nonce":1575999914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2208233017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2208233017},{"type":"v1","addr":"172.21.15.132:6836","nonce":2208233017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:48:04.456610+0000","modified":"2023-12-20T04:48:07.132847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7422":{"gid":7422,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/3935356761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":3935356761},{"type":"v1","addr":"172.21.15.132:6837","nonce":3935356761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-20T04:48:18.206 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 45 2023-12-20T04:48:18.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:18.205+0000 7f99bde42640 1 -- 172.21.15.132:0/2950412578 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99a406a430 msgr2=0x7f99a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:18.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:18.205+0000 7f99bde42640 1 --2- 172.21.15.132:0/2950412578 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99a406a430 0x7f99a406c8f0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f99b80cfe20 tx=0x7f99a8008040 comp rx=0 tx=0).stop 2023-12-20T04:48:18.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:18.205+0000 7f99bde42640 1 -- 172.21.15.132:0/2950412578 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b815d2d0 msgr2=0x7f99b80b0540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:18.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:18.205+0000 7f99bde42640 1 --2- 172.21.15.132:0/2950412578 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b815d2d0 0x7f99b80b0540 secure :-1 s=READY pgs=1237 cs=0 l=1 rev1=1 crypto rx=0x7f99b0036040 tx=0x7f99b0004a40 comp rx=0 tx=0).stop 2023-12-20T04:48:18.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:18.205+0000 7f99bde42640 1 -- 172.21.15.132:0/2950412578 shutdown_connections 2023-12-20T04:48:18.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:18.205+0000 7f99bde42640 1 --2- 172.21.15.132:0/2950412578 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99a406a430 0x7f99a406c8f0 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:18.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:18.205+0000 7f99bde42640 1 --2- 172.21.15.132:0/2950412578 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99b815d2d0 0x7f99b80b0540 unknown :-1 s=CLOSED pgs=1237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:18.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:18.205+0000 7f99bde42640 1 --2- 172.21.15.132:0/2950412578 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99b815cef0 0x7f99b80b0000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:18.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:18.205+0000 7f99bde42640 1 --2- 172.21.15.132:0/2950412578 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99b80ad2f0 0x7f99b814e8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:18.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:18.205+0000 7f99bde42640 1 -- 172.21.15.132:0/2950412578 >> 172.21.15.132:0/2950412578 conn(0x7f99b80cf330 msgr2=0x7f99b806d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:18.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:18.205+0000 7f99bde42640 1 -- 172.21.15.132:0/2950412578 shutdown_connections 2023-12-20T04:48:18.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:18.205+0000 7f99bde42640 1 -- 172.21.15.132:0/2950412578 wait complete. 2023-12-20T04:48:18.218 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json osdmap barrier 125 2023-12-20T04:48:18.331 DEBUG:tasks.cephfs.filesystem:_json_asok output empty 2023-12-20T04:48:18.331 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:48:18.331 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:48:18.331 DEBUG:teuthology.orchestra.run.smithi132:> fd = os.open("/home/ubuntu/cephtest/mnt.0/baz", os.O_CREAT | os.O_RDWR, 0O600) 2023-12-20T04:48:18.331 DEBUG:teuthology.orchestra.run.smithi132:> os.fchmod(fd, 0O666) 2023-12-20T04:48:18.331 DEBUG:teuthology.orchestra.run.smithi132:> os.fsync(fd) 2023-12-20T04:48:18.331 DEBUG:teuthology.orchestra.run.smithi132:> os.close(fd) 2023-12-20T04:48:18.331 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:48:18.582 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:48:18.582 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:48:18.582 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:48:18.582 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:48:18.582 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:48:18.582 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:18.582 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:48:18.582 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:48:18.583 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:48:18.583 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:48:18.583 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:18.583 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:48:18.583 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:48:18.583 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:48:18.583 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:48:18.583 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:18.583 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:48:18.583 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:48:18.583 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:48:18.583 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:48:18.583 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:48:18.583 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:48:18.583 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:48:18.583 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:48:18.584 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:18.584 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:48:18.584 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:48:18.700 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.110748.asok 2023-12-20T04:48:18.886 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.110748.asok 2023-12-20T04:48:18.886 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:18.887 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.110748.asok status 2023-12-20T04:48:19.022 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:48:19.022 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:48:19.022 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:48:19.022 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:48:19.022 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:48:19.022 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:48:19.022 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:48:19.022 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "110748", 2023-12-20T04:48:19.022 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:48:19.022 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:19.022 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 2, 2023-12-20T04:48:19.023 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:48:19.023 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 7581, 2023-12-20T04:48:19.023 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:48:19.023 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:48:19.023 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:48:19.023 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 7581 2023-12-20T04:48:19.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:19.023 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:48:19.023 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:19.023 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:48:19.023 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3640881913 2023-12-20T04:48:19.023 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:19.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:19.023 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:48:19.023 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:19.023 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:48:19.024 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3640881913 2023-12-20T04:48:19.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:19.024 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.7581 192.168.0.1:0/3640881913", 2023-12-20T04:48:19.024 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/3640881913", 2023-12-20T04:48:19.024 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 3, 2023-12-20T04:48:19.024 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 45, 2023-12-20T04:48:19.024 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 125, 2023-12-20T04:48:19.024 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 125, 2023-12-20T04:48:19.024 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:48:19.024 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:48:19.024 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:48:19.030 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:48:19.030 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:48:19.030 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:48:19.030 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:48:19.030 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:48:19.030 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:19.030 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:48:19.030 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:48:19.031 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:48:19.031 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:48:19.031 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:19.031 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:48:19.031 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:48:19.031 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:48:19.031 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:48:19.031 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:19.031 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:48:19.031 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:48:19.031 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:48:19.031 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:48:19.031 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:48:19.031 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:48:19.031 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:48:19.031 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:48:19.032 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:19.032 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:48:19.032 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:48:19.108 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.110748.asok 2023-12-20T04:48:19.295 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.110748.asok 2023-12-20T04:48:19.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:19.295 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.110748.asok status 2023-12-20T04:48:19.432 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:48:19.432 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:48:19.432 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:48:19.432 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:48:19.432 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:48:19.432 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:48:19.432 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:48:19.432 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "110748", 2023-12-20T04:48:19.432 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:48:19.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:19.433 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 2, 2023-12-20T04:48:19.433 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:48:19.433 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 7581, 2023-12-20T04:48:19.433 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:48:19.433 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:48:19.433 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:48:19.433 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 7581 2023-12-20T04:48:19.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:19.433 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:48:19.433 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:19.433 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:48:19.433 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3640881913 2023-12-20T04:48:19.434 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:19.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:19.434 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:48:19.434 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:19.434 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:48:19.434 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 3640881913 2023-12-20T04:48:19.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:19.434 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.7581 192.168.0.1:0/3640881913", 2023-12-20T04:48:19.434 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/3640881913", 2023-12-20T04:48:19.434 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 3, 2023-12-20T04:48:19.434 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 45, 2023-12-20T04:48:19.434 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 125, 2023-12-20T04:48:19.434 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 125, 2023-12-20T04:48:19.435 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:48:19.435 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:48:19.435 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:48:19.440 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-20T04:48:19.440 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:48:19.440 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:48:19.480 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:48:19.527 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:48:19.527 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:48:19.527 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:48:19.543 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:48:19.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.680+0000 7f7142d99640 1 Processor -- start 2023-12-20T04:48:19.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.680+0000 7f7142d99640 1 -- start start 2023-12-20T04:48:19.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.681+0000 7f7142d99640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f713c06a340 0x7f713c06c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:19.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.681+0000 7f7142d99640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c06ea90 con 0x7f713c1588e0 2023-12-20T04:48:19.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.681+0000 7f7142d99640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f713c06e160 con 0x7f713c06cd30 2023-12-20T04:48:19.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.681+0000 7f7142d99640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f713c06d520 con 0x7f713c06a340 2023-12-20T04:48:19.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.681+0000 7f7140b35640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f713c1588e0 0x7f713c069c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57142/0 (socket says 172.21.15.132:57142) 2023-12-20T04:48:19.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.681+0000 7f7140b35640 1 -- 172.21.15.132:0/1136466967 learned_addr learned my addr 172.21.15.132:0/1136466967 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:19.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713bfff640 1 --2- 172.21.15.132:0/1136466967 >> v2:172.21.15.187:3300/0 conn(0x7f713c06a340 0x7f713c06c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:19.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713b7fe640 1 -- 172.21.15.132:0/1136466967 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1437900339 0 0) 0x7f713c06ea90 con 0x7f713c1588e0 2023-12-20T04:48:19.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713b7fe640 1 -- 172.21.15.132:0/1136466967 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7124003520 con 0x7f713c1588e0 2023-12-20T04:48:19.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713b7fe640 1 -- 172.21.15.132:0/1136466967 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3195756082 0 0) 0x7f713c06e160 con 0x7f713c06cd30 2023-12-20T04:48:19.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713b7fe640 1 -- 172.21.15.132:0/1136466967 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f713c06ea90 con 0x7f713c06cd30 2023-12-20T04:48:19.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713b7fe640 1 -- 172.21.15.132:0/1136466967 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 103044785 0 0) 0x7f7124003520 con 0x7f713c1588e0 2023-12-20T04:48:19.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713b7fe640 1 -- 172.21.15.132:0/1136466967 >> v2:172.21.15.187:3300/0 conn(0x7f713c06a340 msgr2=0x7f713c06c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:19.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713b7fe640 1 --2- 172.21.15.132:0/1136466967 >> v2:172.21.15.187:3300/0 conn(0x7f713c06a340 0x7f713c06c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:19.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713b7fe640 1 -- 172.21.15.132:0/1136466967 >> v1:172.21.15.187:6789/0 conn(0x7f713c06cd30 legacy=0x7f713c0b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:19.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713b7fe640 1 -- 172.21.15.132:0/1136466967 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c06e440 con 0x7f713c1588e0 2023-12-20T04:48:19.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713b7fe640 1 -- 172.21.15.132:0/1136466967 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f712c001670 con 0x7f713c1588e0 2023-12-20T04:48:19.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713b7fe640 1 -- 172.21.15.132:0/1136466967 >> v1:172.21.15.132:6789/0 conn(0x7f713c1588e0 legacy=0x7f713c069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:19.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713b7fe640 1 --2- 172.21.15.132:0/1136466967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7124003b00 0x7f7124003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:19.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713b7fe640 1 --2- 172.21.15.132:0/1136466967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71240047c0 0x7f7124004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:19.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713b7fe640 1 --2- 172.21.15.132:0/1136466967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7124005180 0x7f712400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:19.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713b7fe640 1 -- 172.21.15.132:0/1136466967 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c06d520 con 0x7f7124005180 2023-12-20T04:48:19.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713b7fe640 1 -- 172.21.15.132:0/1136466967 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f712400c000 con 0x7f7124003b00 2023-12-20T04:48:19.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713b7fe640 1 -- 172.21.15.132:0/1136466967 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f712400c1c0 con 0x7f71240047c0 2023-12-20T04:48:19.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f7141336640 1 --2- 172.21.15.132:0/1136466967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7124005180 0x7f712400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:19.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f7140b35640 1 --2- 172.21.15.132:0/1136466967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7124003b00 0x7f7124003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:19.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f713bfff640 1 --2- 172.21.15.132:0/1136466967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71240047c0 0x7f7124004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:19.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.682+0000 7f7141336640 1 -- 172.21.15.132:0/1136466967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71240047c0 msgr2=0x7f7124004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:19.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.683+0000 7f7141336640 1 --2- 172.21.15.132:0/1136466967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71240047c0 0x7f7124004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:19.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.683+0000 7f7141336640 1 -- 172.21.15.132:0/1136466967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7124003b00 msgr2=0x7f7124003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:19.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.683+0000 7f7141336640 1 --2- 172.21.15.132:0/1136466967 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7124003b00 0x7f7124003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:19.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.683+0000 7f7141336640 1 -- 172.21.15.132:0/1136466967 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7124003520 con 0x7f7124005180 2023-12-20T04:48:19.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.683+0000 7f713bfff640 1 --2- 172.21.15.132:0/1136466967 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f71240047c0 0x7f7124004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:19.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.683+0000 7f7141336640 1 -- 172.21.15.132:0/1136466967 reap_dead start 2023-12-20T04:48:19.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.683+0000 7f7141336640 1 --2- 172.21.15.132:0/1136466967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7124005180 0x7f712400b980 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f7134001fd0 tx=0x7f71240057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d8d3a3f4fa3c202 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:19.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.683+0000 7f713b7fe640 1 -- 172.21.15.132:0/1136466967 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134003b70 con 0x7f7124005180 2023-12-20T04:48:19.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.683+0000 7f713b7fe640 1 -- 172.21.15.132:0/1136466967 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7134003cd0 con 0x7f7124005180 2023-12-20T04:48:19.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.683+0000 7f713b7fe640 1 -- 172.21.15.132:0/1136466967 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7134005310 con 0x7f7124005180 2023-12-20T04:48:19.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.684+0000 7f7142d99640 1 -- 172.21.15.132:0/1136466967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7124005180 msgr2=0x7f712400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:19.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.684+0000 7f7142d99640 1 --2- 172.21.15.132:0/1136466967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7124005180 0x7f712400b980 secure :-1 s=READY pgs=1239 cs=0 l=1 rev1=1 crypto rx=0x7f7134001fd0 tx=0x7f71240057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:19.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.684+0000 7f7142d99640 1 -- 172.21.15.132:0/1136466967 shutdown_connections 2023-12-20T04:48:19.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.684+0000 7f7142d99640 1 --2- 172.21.15.132:0/1136466967 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7124005180 0x7f712400b980 unknown :-1 s=CLOSED pgs=1239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:19.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.684+0000 7f7142d99640 1 -- 172.21.15.132:0/1136466967 >> 172.21.15.132:0/1136466967 conn(0x7f713c0cfca0 msgr2=0x7f713c0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:19.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.684+0000 7f7142d99640 1 -- 172.21.15.132:0/1136466967 shutdown_connections 2023-12-20T04:48:19.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.684+0000 7f7142d99640 1 -- 172.21.15.132:0/1136466967 wait complete. 2023-12-20T04:48:19.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.685+0000 7f7142d99640 1 Processor -- start 2023-12-20T04:48:19.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.685+0000 7f7142d99640 1 -- start start 2023-12-20T04:48:19.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.686+0000 7f7142d99640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7124005180 0x7f713c0c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:19.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.686+0000 7f7142d99640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f713c15c450 0x7f713c15a460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:19.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.686+0000 7f7142d99640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f713c15c8d0 0x7f713c15a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:19.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.686+0000 7f7142d99640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c15afd0 con 0x7f713c15c450 2023-12-20T04:48:19.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.686+0000 7f7142d99640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0c7fb0 con 0x7f7124005180 2023-12-20T04:48:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.686+0000 7f7142d99640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f713c0c8290 con 0x7f713c15c8d0 2023-12-20T04:48:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.686+0000 7f713bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f713c15c450 0x7f713c15a460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.686+0000 7f713bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f713c15c450 0x7f713c15a460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34224/0 (socket says 172.21.15.132:34224) 2023-12-20T04:48:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.686+0000 7f713bfff640 1 -- 172.21.15.132:0/3070831527 learned_addr learned my addr 172.21.15.132:0/3070831527 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.686+0000 7f7141336640 1 --2- 172.21.15.132:0/3070831527 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f713c15c8d0 0x7f713c15a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.686+0000 7f7140b35640 1 --2- 172.21.15.132:0/3070831527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7124005180 0x7f713c0c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.686+0000 7f713bfff640 1 -- 172.21.15.132:0/3070831527 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f713c15c8d0 msgr2=0x7f713c15a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.686+0000 7f713bfff640 1 --2- 172.21.15.132:0/3070831527 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f713c15c8d0 0x7f713c15a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.686+0000 7f713bfff640 1 -- 172.21.15.132:0/3070831527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7124005180 msgr2=0x7f713c0c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.686+0000 7f713bfff640 1 --2- 172.21.15.132:0/3070831527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7124005180 0x7f713c0c5c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.686+0000 7f713bfff640 1 -- 172.21.15.132:0/3070831527 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f713c0c8570 con 0x7f713c15c450 2023-12-20T04:48:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.686+0000 7f713bfff640 1 --2- 172.21.15.132:0/3070831527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f713c15c450 0x7f713c15a460 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f71300114e0 tx=0x7f71300119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.687+0000 7f71397fa640 1 -- 172.21.15.132:0/3070831527 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130015870 con 0x7f713c15c450 2023-12-20T04:48:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.687+0000 7f71397fa640 1 -- 172.21.15.132:0/3070831527 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f71300159d0 con 0x7f713c15c450 2023-12-20T04:48:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.687+0000 7f7142d99640 1 -- 172.21.15.132:0/3070831527 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f713c0c8850 con 0x7f713c15c450 2023-12-20T04:48:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.687+0000 7f71397fa640 1 -- 172.21.15.132:0/3070831527 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7130015d40 con 0x7f713c15c450 2023-12-20T04:48:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.687+0000 7f7142d99640 1 -- 172.21.15.132:0/3070831527 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f713c0c6150 con 0x7f713c15c450 2023-12-20T04:48:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.688+0000 7f7142d99640 1 -- 172.21.15.132:0/3070831527 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f713c04e840 con 0x7f713c15c450 2023-12-20T04:48:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.688+0000 7f71397fa640 1 -- 172.21.15.132:0/3070831527 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f713001d400 con 0x7f713c15c450 2023-12-20T04:48:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.688+0000 7f71397fa640 1 --2- 172.21.15.132:0/3070831527 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f712806a430 0x7f712806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.689+0000 7f71397fa640 1 -- 172.21.15.132:0/3070831527 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7130089130 con 0x7f713c15c450 2023-12-20T04:48:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.689+0000 7f7140b35640 1 --2- 172.21.15.132:0/3070831527 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f712806a430 0x7f712806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.689+0000 7f7140b35640 1 --2- 172.21.15.132:0/3070831527 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f712806a430 0x7f712806c8f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f712c001eb0 tx=0x7f712c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:19.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.693+0000 7f71397fa640 1 -- 172.21.15.132:0/3070831527 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7130054720 con 0x7f713c15c450 2023-12-20T04:48:19.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.859+0000 7f7142d99640 1 -- 172.21.15.132:0/3070831527 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f713c0c4730 con 0x7f713c15c450 2023-12-20T04:48:19.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.860+0000 7f71397fa640 1 -- 172.21.15.132:0/3070831527 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16107 (secure 0 0 0) 0x7f7130057d40 con 0x7f713c15c450 2023-12-20T04:48:19.862 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:19.862 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":125,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:48:16.867874+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:48:02.660300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-20T04:48:03.433311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:48:19.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.862+0000 7f7142d99640 1 -- 172.21.15.132:0/3070831527 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f712806a430 msgr2=0x7f712806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:19.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.862+0000 7f7142d99640 1 --2- 172.21.15.132:0/3070831527 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f712806a430 0x7f712806c8f0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7f712c001eb0 tx=0x7f712c009040 comp rx=0 tx=0).stop 2023-12-20T04:48:19.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.862+0000 7f7142d99640 1 -- 172.21.15.132:0/3070831527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f713c15c450 msgr2=0x7f713c15a460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:19.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.862+0000 7f7142d99640 1 --2- 172.21.15.132:0/3070831527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f713c15c450 0x7f713c15a460 secure :-1 s=READY pgs=1240 cs=0 l=1 rev1=1 crypto rx=0x7f71300114e0 tx=0x7f71300119a0 comp rx=0 tx=0).stop 2023-12-20T04:48:19.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.862+0000 7f7142d99640 1 -- 172.21.15.132:0/3070831527 shutdown_connections 2023-12-20T04:48:19.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.862+0000 7f7142d99640 1 --2- 172.21.15.132:0/3070831527 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f712806a430 0x7f712806c8f0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:19.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.862+0000 7f7142d99640 1 --2- 172.21.15.132:0/3070831527 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f713c15c8d0 0x7f713c15a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:19.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.862+0000 7f7142d99640 1 --2- 172.21.15.132:0/3070831527 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f713c15c450 0x7f713c15a460 unknown :-1 s=CLOSED pgs=1240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:19.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.862+0000 7f7142d99640 1 --2- 172.21.15.132:0/3070831527 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7124005180 0x7f713c0c5c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:19.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.862+0000 7f7142d99640 1 -- 172.21.15.132:0/3070831527 >> 172.21.15.132:0/3070831527 conn(0x7f713c0cfca0 msgr2=0x7f713c069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:19.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.862+0000 7f7142d99640 1 -- 172.21.15.132:0/3070831527 shutdown_connections 2023-12-20T04:48:19.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.862+0000 7f7142d99640 1 -- 172.21.15.132:0/3070831527 wait complete. 2023-12-20T04:48:19.875 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:48:02.660300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:48:03.433311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:48:19.876 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:48:19.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.976+0000 7fadd18ee640 1 Processor -- start 2023-12-20T04:48:19.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.976+0000 7fadd18ee640 1 -- start start 2023-12-20T04:48:19.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.977+0000 7fadd18ee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fadcc15cf20 0x7fadcc06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:19.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.977+0000 7fadd18ee640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadcc0cd4b0 0x7fadcc0cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:19.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.977+0000 7fadd18ee640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fadcc06cc90 con 0x7fadcc15d300 2023-12-20T04:48:19.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.977+0000 7fadd18ee640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fadcc0cde80 con 0x7fadcc15cf20 2023-12-20T04:48:19.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.977+0000 7fadd18ee640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc0b2f30 con 0x7fadcc0cd4b0 2023-12-20T04:48:19.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.977+0000 7fadcaffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fadcc15cf20 0x7fadcc06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:19.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.977+0000 7fadcaffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fadcc15cf20 0x7fadcc06c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34230/0 (socket says 172.21.15.132:34230) 2023-12-20T04:48:19.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.977+0000 7fadcaffd640 1 -- 172.21.15.132:0/2113519963 learned_addr learned my addr 172.21.15.132:0/2113519963 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:19.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.978+0000 7fadcb7fe640 1 --2- 172.21.15.132:0/2113519963 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadcc0cd4b0 0x7fadcc0cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:19.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.978+0000 7fadcaffd640 1 -- 172.21.15.132:0/2113519963 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadcc0cd4b0 msgr2=0x7fadcc0cd940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:19.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.978+0000 7fadcaffd640 1 --2- 172.21.15.132:0/2113519963 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadcc0cd4b0 0x7fadcc0cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:19.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.978+0000 7fadcaffd640 1 -- 172.21.15.132:0/2113519963 >> v1:172.21.15.187:6789/0 conn(0x7fadcc15d300 legacy=0x7fadcc161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:19.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.978+0000 7fadcaffd640 1 -- 172.21.15.132:0/2113519963 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadcc0b3210 con 0x7fadcc15cf20 2023-12-20T04:48:19.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.978+0000 7fadcaffd640 1 --2- 172.21.15.132:0/2113519963 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadcc15cf20 0x7fadcc06c590 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fadcc071180 tx=0x7fadbc02be90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=195ffd51f4608b62 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:19.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.979+0000 7fadc9ffb640 1 -- 172.21.15.132:0/2113519963 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc02ca30 con 0x7fadcc15cf20 2023-12-20T04:48:19.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.979+0000 7fadc9ffb640 1 -- 172.21.15.132:0/2113519963 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadbc02cb90 con 0x7fadcc15cf20 2023-12-20T04:48:19.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.979+0000 7fadc9ffb640 1 -- 172.21.15.132:0/2113519963 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc0343f0 con 0x7fadcc15cf20 2023-12-20T04:48:19.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.979+0000 7fadd18ee640 1 -- 172.21.15.132:0/2113519963 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadcc15cf20 msgr2=0x7fadcc06c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:19.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.979+0000 7fadd18ee640 1 --2- 172.21.15.132:0/2113519963 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadcc15cf20 0x7fadcc06c590 secure :-1 s=READY pgs=1241 cs=0 l=1 rev1=1 crypto rx=0x7fadcc071180 tx=0x7fadbc02be90 comp rx=0 tx=0).stop 2023-12-20T04:48:19.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.979+0000 7fadd18ee640 1 -- 172.21.15.132:0/2113519963 shutdown_connections 2023-12-20T04:48:19.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.979+0000 7fadd18ee640 1 --2- 172.21.15.132:0/2113519963 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadcc0cd4b0 0x7fadcc0cd940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:19.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.979+0000 7fadd18ee640 1 --2- 172.21.15.132:0/2113519963 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadcc15cf20 0x7fadcc06c590 unknown :-1 s=CLOSED pgs=1241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:19.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.979+0000 7fadd18ee640 1 -- 172.21.15.132:0/2113519963 >> 172.21.15.132:0/2113519963 conn(0x7fadcc072c60 msgr2=0x7fadcc073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:19.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.979+0000 7fadd18ee640 1 -- 172.21.15.132:0/2113519963 shutdown_connections 2023-12-20T04:48:19.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.979+0000 7fadd18ee640 1 -- 172.21.15.132:0/2113519963 wait complete. 2023-12-20T04:48:19.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.980+0000 7fadd18ee640 1 Processor -- start 2023-12-20T04:48:19.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.980+0000 7fadd18ee640 1 -- start start 2023-12-20T04:48:19.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.981+0000 7fadd18ee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadcc0cd4b0 0x7fadcc0c51a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:19.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.981+0000 7fadd18ee640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadcc15cf20 0x7fadcc0c6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:19.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.981+0000 7fadd18ee640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fadcc15d300 0x7fadcc0cc7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:19.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.981+0000 7fadd18ee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc0c5780 con 0x7fadcc0cd4b0 2023-12-20T04:48:19.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.981+0000 7fadd18ee640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc0c5a60 con 0x7fadcc15d300 2023-12-20T04:48:19.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.981+0000 7fadd18ee640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fadcc0c5d40 con 0x7fadcc15cf20 2023-12-20T04:48:19.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.981+0000 7fadcaffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadcc0cd4b0 0x7fadcc0c51a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:19.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.981+0000 7fadcaffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadcc0cd4b0 0x7fadcc0c51a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34234/0 (socket says 172.21.15.132:34234) 2023-12-20T04:48:19.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.981+0000 7fadcaffd640 1 -- 172.21.15.132:0/2259574755 learned_addr learned my addr 172.21.15.132:0/2259574755 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:19.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.981+0000 7fadcb7fe640 1 --2- 172.21.15.132:0/2259574755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fadcc15d300 0x7fadcc0cc7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:19.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.981+0000 7fadcaffd640 1 -- 172.21.15.132:0/2259574755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadcc15cf20 msgr2=0x7fadcc0c6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:19.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.981+0000 7fadca7fc640 1 --2- 172.21.15.132:0/2259574755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadcc15cf20 0x7fadcc0c6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:19.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.982+0000 7fadcaffd640 1 --2- 172.21.15.132:0/2259574755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadcc15cf20 0x7fadcc0c6820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:19.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.982+0000 7fadcaffd640 1 -- 172.21.15.132:0/2259574755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fadcc15d300 msgr2=0x7fadcc0cc7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:19.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.982+0000 7fadcaffd640 1 --2- 172.21.15.132:0/2259574755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fadcc15d300 0x7fadcc0cc7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:19.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.982+0000 7fadcaffd640 1 -- 172.21.15.132:0/2259574755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadbc009b30 con 0x7fadcc0cd4b0 2023-12-20T04:48:19.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.982+0000 7fadcaffd640 1 --2- 172.21.15.132:0/2259574755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadcc0cd4b0 0x7fadcc0c51a0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fadbc036040 tx=0x7fadbc004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:19.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.982+0000 7fadb3fff640 1 -- 172.21.15.132:0/2259574755 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc03e450 con 0x7fadcc0cd4b0 2023-12-20T04:48:19.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.982+0000 7fadb3fff640 1 -- 172.21.15.132:0/2259574755 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fadbc03e5f0 con 0x7fadcc0cd4b0 2023-12-20T04:48:19.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.982+0000 7fadd18ee640 1 -- 172.21.15.132:0/2259574755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadcc0c6020 con 0x7fadcc0cd4b0 2023-12-20T04:48:19.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.982+0000 7fadb3fff640 1 -- 172.21.15.132:0/2259574755 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fadbc03e9a0 con 0x7fadcc0cd4b0 2023-12-20T04:48:19.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.982+0000 7fadd18ee640 1 -- 172.21.15.132:0/2259574755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadcc0c7310 con 0x7fadcc0cd4b0 2023-12-20T04:48:19.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.983+0000 7fadd18ee640 1 -- 172.21.15.132:0/2259574755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadcc0c6540 con 0x7fadcc0cd4b0 2023-12-20T04:48:19.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.983+0000 7fadb3fff640 1 -- 172.21.15.132:0/2259574755 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fadbc03eb00 con 0x7fadcc0cd4b0 2023-12-20T04:48:19.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.984+0000 7fadb3fff640 1 --2- 172.21.15.132:0/2259574755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fadb806a460 0x7fadb806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:19.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.984+0000 7fadb3fff640 1 -- 172.21.15.132:0/2259574755 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fadbc0ab600 con 0x7fadcc0cd4b0 2023-12-20T04:48:19.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.984+0000 7fadca7fc640 1 --2- 172.21.15.132:0/2259574755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fadb806a460 0x7fadb806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:19.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.984+0000 7fadca7fc640 1 --2- 172.21.15.132:0/2259574755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fadb806a460 0x7fadb806c920 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fadcc15c480 tx=0x7fadc0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:19.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:19.988+0000 7fadb3fff640 1 -- 172.21.15.132:0/2259574755 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fadcc0c6540 con 0x7fadcc0cd4b0 2023-12-20T04:48:20.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.155+0000 7fadd18ee640 1 -- 172.21.15.132:0/2259574755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fadcc0c6540 con 0x7fadcc0cd4b0 2023-12-20T04:48:20.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.155+0000 7fadb3fff640 1 -- 172.21.15.132:0/2259574755 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) v1 ==== 93+0+10 (secure 0 0 0) 0x7fadcc0c6540 con 0x7fadcc0cd4b0 2023-12-20T04:48:20.157 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:48:20.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.157+0000 7fadd18ee640 1 -- 172.21.15.132:0/2259574755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fadb806a460 msgr2=0x7fadb806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.157+0000 7fadd18ee640 1 --2- 172.21.15.132:0/2259574755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fadb806a460 0x7fadb806c920 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fadcc15c480 tx=0x7fadc0008040 comp rx=0 tx=0).stop 2023-12-20T04:48:20.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.157+0000 7fadd18ee640 1 -- 172.21.15.132:0/2259574755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadcc0cd4b0 msgr2=0x7fadcc0c51a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.157+0000 7fadd18ee640 1 --2- 172.21.15.132:0/2259574755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadcc0cd4b0 0x7fadcc0c51a0 secure :-1 s=READY pgs=1242 cs=0 l=1 rev1=1 crypto rx=0x7fadbc036040 tx=0x7fadbc004a40 comp rx=0 tx=0).stop 2023-12-20T04:48:20.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.157+0000 7fadd18ee640 1 -- 172.21.15.132:0/2259574755 shutdown_connections 2023-12-20T04:48:20.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.157+0000 7fadd18ee640 1 --2- 172.21.15.132:0/2259574755 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fadb806a460 0x7fadb806c920 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.157+0000 7fadd18ee640 1 --2- 172.21.15.132:0/2259574755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fadcc15d300 0x7fadcc0cc7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.157+0000 7fadd18ee640 1 --2- 172.21.15.132:0/2259574755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fadcc15cf20 0x7fadcc0c6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.157+0000 7fadd18ee640 1 --2- 172.21.15.132:0/2259574755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fadcc0cd4b0 0x7fadcc0c51a0 unknown :-1 s=CLOSED pgs=1242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.157+0000 7fadd18ee640 1 -- 172.21.15.132:0/2259574755 >> 172.21.15.132:0/2259574755 conn(0x7fadcc072c60 msgr2=0x7fadcc0b1dd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:20.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.157+0000 7fadd18ee640 1 -- 172.21.15.132:0/2259574755 shutdown_connections 2023-12-20T04:48:20.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.157+0000 7fadd18ee640 1 -- 172.21.15.132:0/2259574755 wait complete. 2023-12-20T04:48:20.170 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:48:20.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.271+0000 7f3c51d3e640 1 Processor -- start 2023-12-20T04:48:20.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.271+0000 7f3c51d3e640 1 -- start start 2023-12-20T04:48:20.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.271+0000 7f3c51d3e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c4c0cdbc0 0x7f3c4c06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.271+0000 7f3c51d3e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4c06cc90 con 0x7f3c4c15d300 2023-12-20T04:48:20.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.271+0000 7f3c51d3e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c4c0b2f30 con 0x7f3c4c15cf20 2023-12-20T04:48:20.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.271+0000 7f3c51d3e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0b3210 con 0x7f3c4c0cdbc0 2023-12-20T04:48:20.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4affd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3c4c15d300 0x7f3c4c0cd4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57150/0 (socket says 172.21.15.132:57150) 2023-12-20T04:48:20.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4affd640 1 -- 172.21.15.132:0/696841293 learned_addr learned my addr 172.21.15.132:0/696841293 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:20.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4bfff640 1 --2- 172.21.15.132:0/696841293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c4c0cdbc0 0x7f3c4c06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4a7fc640 1 -- 172.21.15.132:0/696841293 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3573987322 0 0) 0x7f3c4c06cc90 con 0x7f3c4c15d300 2023-12-20T04:48:20.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4a7fc640 1 -- 172.21.15.132:0/696841293 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c34003520 con 0x7f3c4c15d300 2023-12-20T04:48:20.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4a7fc640 1 -- 172.21.15.132:0/696841293 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2629474661 0 0) 0x7f3c4c0b2f30 con 0x7f3c4c15cf20 2023-12-20T04:48:20.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4a7fc640 1 -- 172.21.15.132:0/696841293 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3c4c06cc90 con 0x7f3c4c15cf20 2023-12-20T04:48:20.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4a7fc640 1 -- 172.21.15.132:0/696841293 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 933848716 0 0) 0x7f3c34003520 con 0x7f3c4c15d300 2023-12-20T04:48:20.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4a7fc640 1 -- 172.21.15.132:0/696841293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c4c0cdbc0 msgr2=0x7f3c4c06c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:20.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4a7fc640 1 --2- 172.21.15.132:0/696841293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c4c0cdbc0 0x7f3c4c06c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4a7fc640 1 -- 172.21.15.132:0/696841293 >> v1:172.21.15.187:6789/0 conn(0x7f3c4c15cf20 legacy=0x7f3c4c161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4a7fc640 1 -- 172.21.15.132:0/696841293 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c0b34f0 con 0x7f3c4c15d300 2023-12-20T04:48:20.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4a7fc640 1 -- 172.21.15.132:0/696841293 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f3c40001670 con 0x7f3c4c15d300 2023-12-20T04:48:20.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4a7fc640 1 -- 172.21.15.132:0/696841293 >> v1:172.21.15.132:6789/0 conn(0x7f3c4c15d300 legacy=0x7f3c4c0cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4a7fc640 1 --2- 172.21.15.132:0/696841293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c4c0cdbc0 0x7f3c34003b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4a7fc640 1 --2- 172.21.15.132:0/696841293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c340040e0 0x7f3c340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4a7fc640 1 --2- 172.21.15.132:0/696841293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c34004d00 0x7f3c34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4a7fc640 1 -- 172.21.15.132:0/696841293 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0b3210 con 0x7f3c340040e0 2023-12-20T04:48:20.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4a7fc640 1 -- 172.21.15.132:0/696841293 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3400bac0 con 0x7f3c34004d00 2023-12-20T04:48:20.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4a7fc640 1 -- 172.21.15.132:0/696841293 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c3400bc80 con 0x7f3c4c0cdbc0 2023-12-20T04:48:20.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4affd640 1 --2- 172.21.15.132:0/696841293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c340040e0 0x7f3c340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4b7fe640 1 --2- 172.21.15.132:0/696841293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c4c0cdbc0 0x7f3c34003b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.272+0000 7f3c4bfff640 1 --2- 172.21.15.132:0/696841293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c34004d00 0x7f3c34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.273+0000 7f3c4affd640 1 -- 172.21.15.132:0/696841293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c4c0cdbc0 msgr2=0x7f3c34003b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:20.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.273+0000 7f3c4affd640 1 --2- 172.21.15.132:0/696841293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c4c0cdbc0 0x7f3c34003b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.273+0000 7f3c4affd640 1 -- 172.21.15.132:0/696841293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c34004d00 msgr2=0x7f3c34005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:20.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.273+0000 7f3c4affd640 1 --2- 172.21.15.132:0/696841293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c34004d00 0x7f3c34005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.273+0000 7f3c4affd640 1 -- 172.21.15.132:0/696841293 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c34003520 con 0x7f3c340040e0 2023-12-20T04:48:20.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.273+0000 7f3c4bfff640 1 --2- 172.21.15.132:0/696841293 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c34004d00 0x7f3c34005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:20.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.273+0000 7f3c4b7fe640 1 --2- 172.21.15.132:0/696841293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c4c0cdbc0 0x7f3c34003b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:20.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.273+0000 7f3c4affd640 1 --2- 172.21.15.132:0/696841293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c340040e0 0x7f3c340047c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f3c40007f90 tx=0x7f3c340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fc25b6ae2f8ffe server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:20.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.273+0000 7f3c4a7fc640 1 -- 172.21.15.132:0/696841293 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40005ad0 con 0x7f3c340040e0 2023-12-20T04:48:20.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.273+0000 7f3c4a7fc640 1 -- 172.21.15.132:0/696841293 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c40005c30 con 0x7f3c340040e0 2023-12-20T04:48:20.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.273+0000 7f3c4a7fc640 1 -- 172.21.15.132:0/696841293 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40007290 con 0x7f3c340040e0 2023-12-20T04:48:20.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.274+0000 7f3c51d3e640 1 -- 172.21.15.132:0/696841293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c340040e0 msgr2=0x7f3c340047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.274+0000 7f3c51d3e640 1 --2- 172.21.15.132:0/696841293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c340040e0 0x7f3c340047c0 secure :-1 s=READY pgs=1244 cs=0 l=1 rev1=1 crypto rx=0x7f3c40007f90 tx=0x7f3c340057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.274+0000 7f3c4bfff640 1 -- 172.21.15.132:0/696841293 reap_dead start 2023-12-20T04:48:20.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.274+0000 7f3c51d3e640 1 -- 172.21.15.132:0/696841293 shutdown_connections 2023-12-20T04:48:20.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.274+0000 7f3c51d3e640 1 -- 172.21.15.132:0/696841293 >> 172.21.15.132:0/696841293 conn(0x7f3c4c072c60 msgr2=0x7f3c4c073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:20.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.274+0000 7f3c51d3e640 1 -- 172.21.15.132:0/696841293 shutdown_connections 2023-12-20T04:48:20.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.274+0000 7f3c51d3e640 1 -- 172.21.15.132:0/696841293 wait complete. 2023-12-20T04:48:20.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.275+0000 7f3c51d3e640 1 Processor -- start 2023-12-20T04:48:20.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.275+0000 7f3c51d3e640 1 -- start start 2023-12-20T04:48:20.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.276+0000 7f3c51d3e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c340040e0 0x7f3c4c157380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.276+0000 7f3c51d3e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c4c0ae7f0 0x7f3c4c0c5bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.276+0000 7f3c51d3e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c4c0aec70 0x7f3c4c0b1740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.276+0000 7f3c51d3e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0af790 con 0x7f3c4c0ae7f0 2023-12-20T04:48:20.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.276+0000 7f3c51d3e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0acdb0 con 0x7f3c4c0aec70 2023-12-20T04:48:20.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.276+0000 7f3c51d3e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c4c0aca80 con 0x7f3c340040e0 2023-12-20T04:48:20.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.276+0000 7f3c4affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c4c0ae7f0 0x7f3c4c0c5bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.276+0000 7f3c4affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c4c0ae7f0 0x7f3c4c0c5bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34242/0 (socket says 172.21.15.132:34242) 2023-12-20T04:48:20.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.276+0000 7f3c4affd640 1 -- 172.21.15.132:0/2442964604 learned_addr learned my addr 172.21.15.132:0/2442964604 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:20.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.276+0000 7f3c4b7fe640 1 --2- 172.21.15.132:0/2442964604 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c340040e0 0x7f3c4c157380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.276+0000 7f3c4bfff640 1 --2- 172.21.15.132:0/2442964604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c4c0aec70 0x7f3c4c0b1740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.276+0000 7f3c4affd640 1 -- 172.21.15.132:0/2442964604 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c340040e0 msgr2=0x7f3c4c157380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.276+0000 7f3c4affd640 1 --2- 172.21.15.132:0/2442964604 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c340040e0 0x7f3c4c157380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.276+0000 7f3c4affd640 1 -- 172.21.15.132:0/2442964604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c4c0aec70 msgr2=0x7f3c4c0b1740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.276+0000 7f3c4affd640 1 --2- 172.21.15.132:0/2442964604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c4c0aec70 0x7f3c4c0b1740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.276+0000 7f3c4affd640 1 -- 172.21.15.132:0/2442964604 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c4c0af1d0 con 0x7f3c4c0ae7f0 2023-12-20T04:48:20.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.277+0000 7f3c4affd640 1 --2- 172.21.15.132:0/2442964604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c4c0ae7f0 0x7f3c4c0c5bb0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f3c4002c240 tx=0x7f3c40001930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:20.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.277+0000 7f3c33fff640 1 -- 172.21.15.132:0/2442964604 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40039070 con 0x7f3c4c0ae7f0 2023-12-20T04:48:20.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.277+0000 7f3c33fff640 1 -- 172.21.15.132:0/2442964604 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c40007580 con 0x7f3c4c0ae7f0 2023-12-20T04:48:20.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.277+0000 7f3c51d3e640 1 -- 172.21.15.132:0/2442964604 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c4c0af4b0 con 0x7f3c4c0ae7f0 2023-12-20T04:48:20.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.277+0000 7f3c33fff640 1 -- 172.21.15.132:0/2442964604 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4003c040 con 0x7f3c4c0ae7f0 2023-12-20T04:48:20.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.277+0000 7f3c51d3e640 1 -- 172.21.15.132:0/2442964604 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c4c1f2d30 con 0x7f3c4c0ae7f0 2023-12-20T04:48:20.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.278+0000 7f3c51d3e640 1 -- 172.21.15.132:0/2442964604 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c4c0ac8e0 con 0x7f3c4c0ae7f0 2023-12-20T04:48:20.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.278+0000 7f3c33fff640 1 -- 172.21.15.132:0/2442964604 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3c40032070 con 0x7f3c4c0ae7f0 2023-12-20T04:48:20.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.278+0000 7f3c33fff640 1 --2- 172.21.15.132:0/2442964604 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3c3806a460 0x7f3c3806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.279+0000 7f3c33fff640 1 -- 172.21.15.132:0/2442964604 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3c400a9bd0 con 0x7f3c4c0ae7f0 2023-12-20T04:48:20.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.279+0000 7f3c4b7fe640 1 --2- 172.21.15.132:0/2442964604 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3c3806a460 0x7f3c3806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.279+0000 7f3c4b7fe640 1 --2- 172.21.15.132:0/2442964604 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3c3806a460 0x7f3c3806c920 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0ae020 tx=0x7f3c3c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:20.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.283+0000 7f3c33fff640 1 -- 172.21.15.132:0/2442964604 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3c4c0ac8e0 con 0x7f3c4c0ae7f0 2023-12-20T04:48:20.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.449+0000 7f3c51d3e640 1 -- 172.21.15.132:0/2442964604 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3c4c0ac8e0 con 0x7f3c4c0ae7f0 2023-12-20T04:48:20.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.449+0000 7f3c33fff640 1 -- 172.21.15.132:0/2442964604 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v125) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3c4c0ac8e0 con 0x7f3c4c0ae7f0 2023-12-20T04:48:20.451 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:48:20.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.451+0000 7f3c51d3e640 1 -- 172.21.15.132:0/2442964604 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3c3806a460 msgr2=0x7f3c3806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.451+0000 7f3c51d3e640 1 --2- 172.21.15.132:0/2442964604 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3c3806a460 0x7f3c3806c920 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7f3c4c0ae020 tx=0x7f3c3c009040 comp rx=0 tx=0).stop 2023-12-20T04:48:20.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.451+0000 7f3c51d3e640 1 -- 172.21.15.132:0/2442964604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c4c0ae7f0 msgr2=0x7f3c4c0c5bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.451+0000 7f3c51d3e640 1 --2- 172.21.15.132:0/2442964604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c4c0ae7f0 0x7f3c4c0c5bb0 secure :-1 s=READY pgs=1245 cs=0 l=1 rev1=1 crypto rx=0x7f3c4002c240 tx=0x7f3c40001930 comp rx=0 tx=0).stop 2023-12-20T04:48:20.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.451+0000 7f3c51d3e640 1 -- 172.21.15.132:0/2442964604 shutdown_connections 2023-12-20T04:48:20.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.451+0000 7f3c51d3e640 1 --2- 172.21.15.132:0/2442964604 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3c3806a460 0x7f3c3806c920 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.451+0000 7f3c51d3e640 1 --2- 172.21.15.132:0/2442964604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c4c0aec70 0x7f3c4c0b1740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.451+0000 7f3c51d3e640 1 --2- 172.21.15.132:0/2442964604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c4c0ae7f0 0x7f3c4c0c5bb0 unknown :-1 s=CLOSED pgs=1245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.451+0000 7f3c51d3e640 1 --2- 172.21.15.132:0/2442964604 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c340040e0 0x7f3c4c157380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.451+0000 7f3c51d3e640 1 -- 172.21.15.132:0/2442964604 >> 172.21.15.132:0/2442964604 conn(0x7f3c4c072c60 msgr2=0x7f3c4c15aa20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:20.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.451+0000 7f3c51d3e640 1 -- 172.21.15.132:0/2442964604 shutdown_connections 2023-12-20T04:48:20.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.451+0000 7f3c51d3e640 1 -- 172.21.15.132:0/2442964604 wait complete. 2023-12-20T04:48:20.464 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:48:20.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.564+0000 7f0f392af640 1 Processor -- start 2023-12-20T04:48:20.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.565+0000 7f0f392af640 1 -- start start 2023-12-20T04:48:20.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.565+0000 7f0f392af640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0f340cf790 0x7f0f340cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.565+0000 7f0f392af640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f340b6080 0x7f0f340b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.565+0000 7f0f392af640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f340d2920 con 0x7f0f3415d300 2023-12-20T04:48:20.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.565+0000 7f0f392af640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f340d0180 con 0x7f0f340cf790 2023-12-20T04:48:20.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.565+0000 7f0f392af640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f340d1d10 con 0x7f0f340b6080 2023-12-20T04:48:20.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.565+0000 7f0f327fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0f340cf790 0x7f0f340cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.565+0000 7f0f327fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0f340cf790 0x7f0f340cfc40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34250/0 (socket says 172.21.15.132:34250) 2023-12-20T04:48:20.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.565+0000 7f0f327fc640 1 -- 172.21.15.132:0/3163423010 learned_addr learned my addr 172.21.15.132:0/3163423010 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:20.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.566+0000 7f0f337fe640 1 --2- 172.21.15.132:0/3163423010 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f340b6080 0x7f0f340b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.566+0000 7f0f327fc640 1 -- 172.21.15.132:0/3163423010 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f340b6080 msgr2=0x7f0f340b64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:20.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.566+0000 7f0f327fc640 1 --2- 172.21.15.132:0/3163423010 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f340b6080 0x7f0f340b64b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.566+0000 7f0f327fc640 1 -- 172.21.15.132:0/3163423010 >> v1:172.21.15.187:6789/0 conn(0x7f0f3415d300 legacy=0x7f0f340d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.566+0000 7f0f327fc640 1 -- 172.21.15.132:0/3163423010 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f340d1ff0 con 0x7f0f340cf790 2023-12-20T04:48:20.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.566+0000 7f0f327fc640 1 --2- 172.21.15.132:0/3163423010 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f340cf790 0x7f0f340cfc40 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009870 tx=0x7f0f2802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5fb1d8cbaef6ad server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:20.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.567+0000 7f0f31ffb640 1 -- 172.21.15.132:0/3163423010 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28030840 con 0x7f0f340cf790 2023-12-20T04:48:20.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.567+0000 7f0f31ffb640 1 -- 172.21.15.132:0/3163423010 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f280309a0 con 0x7f0f340cf790 2023-12-20T04:48:20.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.567+0000 7f0f31ffb640 1 -- 172.21.15.132:0/3163423010 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f28030d30 con 0x7f0f340cf790 2023-12-20T04:48:20.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.567+0000 7f0f392af640 1 -- 172.21.15.132:0/3163423010 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f340cf790 msgr2=0x7f0f340cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.567+0000 7f0f392af640 1 --2- 172.21.15.132:0/3163423010 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f340cf790 0x7f0f340cfc40 secure :-1 s=READY pgs=1246 cs=0 l=1 rev1=1 crypto rx=0x7f0f28009870 tx=0x7f0f2802b980 comp rx=0 tx=0).stop 2023-12-20T04:48:20.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.567+0000 7f0f392af640 1 -- 172.21.15.132:0/3163423010 shutdown_connections 2023-12-20T04:48:20.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.567+0000 7f0f392af640 1 --2- 172.21.15.132:0/3163423010 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f340b6080 0x7f0f340b64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.567+0000 7f0f392af640 1 --2- 172.21.15.132:0/3163423010 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f340cf790 0x7f0f340cfc40 unknown :-1 s=CLOSED pgs=1246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.567+0000 7f0f392af640 1 -- 172.21.15.132:0/3163423010 >> 172.21.15.132:0/3163423010 conn(0x7f0f3406a3d0 msgr2=0x7f0f3406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:20.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.567+0000 7f0f392af640 1 -- 172.21.15.132:0/3163423010 shutdown_connections 2023-12-20T04:48:20.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.567+0000 7f0f392af640 1 -- 172.21.15.132:0/3163423010 wait complete. 2023-12-20T04:48:20.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.568+0000 7f0f392af640 1 Processor -- start 2023-12-20T04:48:20.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.568+0000 7f0f392af640 1 -- start start 2023-12-20T04:48:20.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.569+0000 7f0f392af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f340b6080 0x7f0f341471c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.569+0000 7f0f392af640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f340cf790 0x7f0f340cbfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.569+0000 7f0f392af640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f3415d300 0x7f0f340c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.569+0000 7f0f392af640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f34147700 con 0x7f0f340b6080 2023-12-20T04:48:20.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.569+0000 7f0f392af640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f340c9fe0 con 0x7f0f3415d300 2023-12-20T04:48:20.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.569+0000 7f0f392af640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f341f2ab0 con 0x7f0f340cf790 2023-12-20T04:48:20.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.569+0000 7f0f32ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f340b6080 0x7f0f341471c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.569+0000 7f0f32ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f340b6080 0x7f0f341471c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34258/0 (socket says 172.21.15.132:34258) 2023-12-20T04:48:20.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.569+0000 7f0f32ffd640 1 -- 172.21.15.132:0/2307295745 learned_addr learned my addr 172.21.15.132:0/2307295745 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:20.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.569+0000 7f0f337fe640 1 --2- 172.21.15.132:0/2307295745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f3415d300 0x7f0f340c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.569+0000 7f0f327fc640 1 --2- 172.21.15.132:0/2307295745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f340cf790 0x7f0f340cbfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.569+0000 7f0f32ffd640 1 -- 172.21.15.132:0/2307295745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f340cf790 msgr2=0x7f0f340cbfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.569+0000 7f0f32ffd640 1 --2- 172.21.15.132:0/2307295745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f340cf790 0x7f0f340cbfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.569+0000 7f0f32ffd640 1 -- 172.21.15.132:0/2307295745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f3415d300 msgr2=0x7f0f340c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.569+0000 7f0f32ffd640 1 --2- 172.21.15.132:0/2307295745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f3415d300 0x7f0f340c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.569+0000 7f0f32ffd640 1 -- 172.21.15.132:0/2307295745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f280094d0 con 0x7f0f340b6080 2023-12-20T04:48:20.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.570+0000 7f0f32ffd640 1 --2- 172.21.15.132:0/2307295745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f340b6080 0x7f0f341471c0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400c870 tx=0x7f0f2400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:20.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.570+0000 7f0f1b7fe640 1 -- 172.21.15.132:0/2307295745 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f24003b70 con 0x7f0f340b6080 2023-12-20T04:48:20.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.570+0000 7f0f1b7fe640 1 -- 172.21.15.132:0/2307295745 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f24003cf0 con 0x7f0f340b6080 2023-12-20T04:48:20.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.570+0000 7f0f392af640 1 -- 172.21.15.132:0/2307295745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f340cca10 con 0x7f0f340b6080 2023-12-20T04:48:20.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.570+0000 7f0f1b7fe640 1 -- 172.21.15.132:0/2307295745 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f2400aa90 con 0x7f0f340b6080 2023-12-20T04:48:20.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.570+0000 7f0f392af640 1 -- 172.21.15.132:0/2307295745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f340ca560 con 0x7f0f340b6080 2023-12-20T04:48:20.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.571+0000 7f0f392af640 1 -- 172.21.15.132:0/2307295745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f3404e840 con 0x7f0f340b6080 2023-12-20T04:48:20.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.571+0000 7f0f1b7fe640 1 -- 172.21.15.132:0/2307295745 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0f2400abf0 con 0x7f0f340b6080 2023-12-20T04:48:20.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.571+0000 7f0f1b7fe640 1 --2- 172.21.15.132:0/2307295745 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f2006a460 0x7f0f2006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.572+0000 7f0f1b7fe640 1 -- 172.21.15.132:0/2307295745 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f240887c0 con 0x7f0f340b6080 2023-12-20T04:48:20.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.572+0000 7f0f327fc640 1 --2- 172.21.15.132:0/2307295745 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f2006a460 0x7f0f2006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.572+0000 7f0f327fc640 1 --2- 172.21.15.132:0/2307295745 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f2006a460 0x7f0f2006c920 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0f28036000 tx=0x7f0f28008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:20.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.576+0000 7f0f1b7fe640 1 -- 172.21.15.132:0/2307295745 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0f24053dc0 con 0x7f0f340b6080 2023-12-20T04:48:20.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.742+0000 7f0f392af640 1 -- 172.21.15.132:0/2307295745 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f0f34159b90 con 0x7f0f340b6080 2023-12-20T04:48:20.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.742+0000 7f0f1b7fe640 1 -- 172.21.15.132:0/2307295745 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v125) v1 ==== 100+0+11 (secure 0 0 0) 0x7f0f240573e0 con 0x7f0f340b6080 2023-12-20T04:48:20.744 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:48:20.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.744+0000 7f0f392af640 1 -- 172.21.15.132:0/2307295745 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f2006a460 msgr2=0x7f0f2006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.744+0000 7f0f392af640 1 --2- 172.21.15.132:0/2307295745 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f2006a460 0x7f0f2006c920 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7f0f28036000 tx=0x7f0f28008030 comp rx=0 tx=0).stop 2023-12-20T04:48:20.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.744+0000 7f0f392af640 1 -- 172.21.15.132:0/2307295745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f340b6080 msgr2=0x7f0f341471c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.744+0000 7f0f392af640 1 --2- 172.21.15.132:0/2307295745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f340b6080 0x7f0f341471c0 secure :-1 s=READY pgs=1247 cs=0 l=1 rev1=1 crypto rx=0x7f0f2400c870 tx=0x7f0f2400cd30 comp rx=0 tx=0).stop 2023-12-20T04:48:20.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.744+0000 7f0f392af640 1 -- 172.21.15.132:0/2307295745 shutdown_connections 2023-12-20T04:48:20.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.744+0000 7f0f392af640 1 --2- 172.21.15.132:0/2307295745 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f2006a460 0x7f0f2006c920 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.744+0000 7f0f392af640 1 --2- 172.21.15.132:0/2307295745 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f3415d300 0x7f0f340c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.744+0000 7f0f392af640 1 --2- 172.21.15.132:0/2307295745 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f340cf790 0x7f0f340cbfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.744+0000 7f0f392af640 1 --2- 172.21.15.132:0/2307295745 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f340b6080 0x7f0f341471c0 unknown :-1 s=CLOSED pgs=1247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.744+0000 7f0f392af640 1 -- 172.21.15.132:0/2307295745 >> 172.21.15.132:0/2307295745 conn(0x7f0f3406a3d0 msgr2=0x7f0f3415c300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:20.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.744+0000 7f0f392af640 1 -- 172.21.15.132:0/2307295745 shutdown_connections 2023-12-20T04:48:20.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.744+0000 7f0f392af640 1 -- 172.21.15.132:0/2307295745 wait complete. 2023-12-20T04:48:20.757 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:48:20.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.857+0000 7f6df9541640 1 Processor -- start 2023-12-20T04:48:20.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.857+0000 7f6df9541640 1 -- start start 2023-12-20T04:48:20.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.858+0000 7f6df9541640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6df415d2c0 0x7f6df40cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.858+0000 7f6df9541640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6df40d0060 0x7f6df40d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.858+0000 7f6df9541640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6df40d0cf0 con 0x7f6df40d30a0 2023-12-20T04:48:20.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.858+0000 7f6df9541640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df40d0550 con 0x7f6df40d0060 2023-12-20T04:48:20.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.858+0000 7f6df9541640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6df40cddc0 con 0x7f6df415d2c0 2023-12-20T04:48:20.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.858+0000 7f6df37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6df40d0060 0x7f6df40d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.858+0000 7f6df37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6df40d0060 0x7f6df40d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34266/0 (socket says 172.21.15.132:34266) 2023-12-20T04:48:20.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.858+0000 7f6df37fe640 1 -- 172.21.15.132:0/1519774694 learned_addr learned my addr 172.21.15.132:0/1519774694 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:20.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.858+0000 7f6debfff640 1 --2- 172.21.15.132:0/1519774694 >> v2:172.21.15.187:3300/0 conn(0x7f6df415d2c0 0x7f6df40cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.858+0000 7f6df37fe640 1 -- 172.21.15.132:0/1519774694 >> v2:172.21.15.187:3300/0 conn(0x7f6df415d2c0 msgr2=0x7f6df40cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:20.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.858+0000 7f6df37fe640 1 --2- 172.21.15.132:0/1519774694 >> v2:172.21.15.187:3300/0 conn(0x7f6df415d2c0 0x7f6df40cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.858+0000 7f6df37fe640 1 -- 172.21.15.132:0/1519774694 >> v1:172.21.15.187:6789/0 conn(0x7f6df40d30a0 legacy=0x7f6df40d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:20.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.858+0000 7f6df37fe640 1 -- 172.21.15.132:0/1519774694 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6df40ce0a0 con 0x7f6df40d0060 2023-12-20T04:48:20.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.859+0000 7f6df37fe640 1 --2- 172.21.15.132:0/1519774694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6df40d0060 0x7f6df40d1180 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f6df40b59c0 tx=0x7f6dec02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5191498ceca3c406 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:20.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.859+0000 7f6df27fc640 1 -- 172.21.15.132:0/1519774694 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec02ca80 con 0x7f6df40d0060 2023-12-20T04:48:20.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.859+0000 7f6df27fc640 1 -- 172.21.15.132:0/1519774694 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dec02cbe0 con 0x7f6df40d0060 2023-12-20T04:48:20.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.859+0000 7f6df27fc640 1 -- 172.21.15.132:0/1519774694 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dec0343f0 con 0x7f6df40d0060 2023-12-20T04:48:20.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.860+0000 7f6df9541640 1 -- 172.21.15.132:0/1519774694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6df40d0060 msgr2=0x7f6df40d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.860+0000 7f6df9541640 1 --2- 172.21.15.132:0/1519774694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6df40d0060 0x7f6df40d1180 secure :-1 s=READY pgs=1248 cs=0 l=1 rev1=1 crypto rx=0x7f6df40b59c0 tx=0x7f6dec02bee0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.860+0000 7f6df9541640 1 -- 172.21.15.132:0/1519774694 shutdown_connections 2023-12-20T04:48:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.860+0000 7f6df9541640 1 --2- 172.21.15.132:0/1519774694 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6df40d0060 0x7f6df40d1180 unknown :-1 s=CLOSED pgs=1248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.860+0000 7f6df9541640 1 --2- 172.21.15.132:0/1519774694 >> v2:172.21.15.187:3300/0 conn(0x7f6df415d2c0 0x7f6df40cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.860+0000 7f6df9541640 1 -- 172.21.15.132:0/1519774694 >> 172.21.15.132:0/1519774694 conn(0x7f6df4072e40 msgr2=0x7f6df4073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.860+0000 7f6df9541640 1 -- 172.21.15.132:0/1519774694 shutdown_connections 2023-12-20T04:48:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.860+0000 7f6df9541640 1 -- 172.21.15.132:0/1519774694 wait complete. 2023-12-20T04:48:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.861+0000 7f6df9541640 1 Processor -- start 2023-12-20T04:48:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.861+0000 7f6df9541640 1 -- start start 2023-12-20T04:48:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.861+0000 7f6df9541640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6df40d0060 0x7f6df414d230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6df9541640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6df40d30a0 0x7f6df415fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6df9541640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6df415d2c0 0x7f6df4160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6df9541640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df414d770 con 0x7f6df40d0060 2023-12-20T04:48:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6df9541640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6df41f2990 con 0x7f6df415d2c0 2023-12-20T04:48:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6df9541640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6df41f2c30 con 0x7f6df40d30a0 2023-12-20T04:48:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6df2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6df40d0060 0x7f6df414d230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6df2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6df40d0060 0x7f6df414d230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34282/0 (socket says 172.21.15.132:34282) 2023-12-20T04:48:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6df2ffd640 1 -- 172.21.15.132:0/1744867814 learned_addr learned my addr 172.21.15.132:0/1744867814 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6debfff640 1 --2- 172.21.15.132:0/1744867814 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6df40d30a0 0x7f6df415fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6df37fe640 1 --2- 172.21.15.132:0/1744867814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6df415d2c0 0x7f6df4160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6df2ffd640 1 -- 172.21.15.132:0/1744867814 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6df40d30a0 msgr2=0x7f6df415fc10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6df2ffd640 1 --2- 172.21.15.132:0/1744867814 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6df40d30a0 0x7f6df415fc10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6df2ffd640 1 -- 172.21.15.132:0/1744867814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6df415d2c0 msgr2=0x7f6df4160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6df2ffd640 1 --2- 172.21.15.132:0/1744867814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6df415d2c0 0x7f6df4160150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:20.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6df2ffd640 1 -- 172.21.15.132:0/1744867814 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dec009b30 con 0x7f6df40d0060 2023-12-20T04:48:20.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6df2ffd640 1 --2- 172.21.15.132:0/1744867814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6df40d0060 0x7f6df414d230 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c410 tx=0x7f6de400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:20.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6deb7fe640 1 -- 172.21.15.132:0/1744867814 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de40035f0 con 0x7f6df40d0060 2023-12-20T04:48:20.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6deb7fe640 1 -- 172.21.15.132:0/1744867814 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6de4003750 con 0x7f6df40d0060 2023-12-20T04:48:20.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6df9541640 1 -- 172.21.15.132:0/1744867814 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6df41f2f10 con 0x7f6df40d0060 2023-12-20T04:48:20.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6deb7fe640 1 -- 172.21.15.132:0/1744867814 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6de4003b40 con 0x7f6df40d0060 2023-12-20T04:48:20.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.862+0000 7f6df9541640 1 -- 172.21.15.132:0/1744867814 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6df41f2680 con 0x7f6df40d0060 2023-12-20T04:48:20.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.863+0000 7f6df9541640 1 -- 172.21.15.132:0/1744867814 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6df404e840 con 0x7f6df40d0060 2023-12-20T04:48:20.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.864+0000 7f6deb7fe640 1 -- 172.21.15.132:0/1744867814 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6de4003ca0 con 0x7f6df40d0060 2023-12-20T04:48:20.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.864+0000 7f6deb7fe640 1 --2- 172.21.15.132:0/1744867814 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6dd406a430 0x7f6dd406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:20.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.864+0000 7f6debfff640 1 --2- 172.21.15.132:0/1744867814 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6dd406a430 0x7f6dd406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:20.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.864+0000 7f6deb7fe640 1 -- 172.21.15.132:0/1744867814 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6de4087f40 con 0x7f6df40d0060 2023-12-20T04:48:20.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.865+0000 7f6debfff640 1 --2- 172.21.15.132:0/1744867814 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6dd406a430 0x7f6dd406c8f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc006fd0 tx=0x7f6ddc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:20.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:20.869+0000 7f6deb7fe640 1 -- 172.21.15.132:0/1744867814 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6de40535c0 con 0x7f6df40d0060 2023-12-20T04:48:21.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.045+0000 7f6df9541640 1 -- 172.21.15.132:0/1744867814 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f6df40cdba0 con 0x7f6df40d0060 2023-12-20T04:48:21.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.046+0000 7f6deb7fe640 1 -- 172.21.15.132:0/1744867814 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v125) v1 ==== 80+0+0 (secure 0 0 0) 0x7f6de4017080 con 0x7f6df40d0060 2023-12-20T04:48:21.047 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:48:21.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.047+0000 7f6df9541640 1 -- 172.21.15.132:0/1744867814 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6dd406a430 msgr2=0x7f6dd406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:21.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.047+0000 7f6df9541640 1 --2- 172.21.15.132:0/1744867814 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6dd406a430 0x7f6dd406c8f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f6ddc006fd0 tx=0x7f6ddc008040 comp rx=0 tx=0).stop 2023-12-20T04:48:21.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.047+0000 7f6df9541640 1 -- 172.21.15.132:0/1744867814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6df40d0060 msgr2=0x7f6df414d230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:21.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.047+0000 7f6df9541640 1 --2- 172.21.15.132:0/1744867814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6df40d0060 0x7f6df414d230 secure :-1 s=READY pgs=1249 cs=0 l=1 rev1=1 crypto rx=0x7f6de400c410 tx=0x7f6de400c8d0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.047+0000 7f6df9541640 1 -- 172.21.15.132:0/1744867814 shutdown_connections 2023-12-20T04:48:21.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.047+0000 7f6df9541640 1 --2- 172.21.15.132:0/1744867814 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6dd406a430 0x7f6dd406c8f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.047+0000 7f6df9541640 1 --2- 172.21.15.132:0/1744867814 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6df415d2c0 0x7f6df4160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.047+0000 7f6df9541640 1 --2- 172.21.15.132:0/1744867814 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6df40d30a0 0x7f6df415fc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.047+0000 7f6df9541640 1 --2- 172.21.15.132:0/1744867814 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6df40d0060 0x7f6df414d230 unknown :-1 s=CLOSED pgs=1249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.047+0000 7f6df9541640 1 -- 172.21.15.132:0/1744867814 >> 172.21.15.132:0/1744867814 conn(0x7f6df4072e40 msgr2=0x7f6df40b55b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:21.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.047+0000 7f6df9541640 1 -- 172.21.15.132:0/1744867814 shutdown_connections 2023-12-20T04:48:21.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.047+0000 7f6df9541640 1 -- 172.21.15.132:0/1744867814 wait complete. 2023-12-20T04:48:21.060 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2023-12-20T04:48:21.060 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:21.060 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-20T04:48:21.086 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[110748]: fuse finished with error 0 and tester_r 0 2023-12-20T04:48:21.087 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:48:21.087 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:21.087 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-20T04:48:21.170 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:48:21.170 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:48:21.189 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:48:21.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.308+0000 7f1e7bc96640 1 Processor -- start 2023-12-20T04:48:21.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.308+0000 7f1e7bc96640 1 -- start start 2023-12-20T04:48:21.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.309+0000 7f1e7bc96640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e740c92d0 0x7f1e740c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.309+0000 7f1e7bc96640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1e7415a3a0 0x7f1e7406c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.309+0000 7f1e7bc96640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e7415aa30 con 0x7f1e7413cce0 2023-12-20T04:48:21.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.309+0000 7f1e7bc96640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e7415a810 con 0x7f1e7415a3a0 2023-12-20T04:48:21.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.309+0000 7f1e7bc96640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e740c9bf0 con 0x7f1e740c92d0 2023-12-20T04:48:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.309+0000 7f1e7a233640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1e7415a3a0 0x7f1e7406c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.309+0000 7f1e7a233640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1e7415a3a0 0x7f1e7406c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34296/0 (socket says 172.21.15.132:34296) 2023-12-20T04:48:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.309+0000 7f1e7a233640 1 -- 172.21.15.132:0/3484778027 learned_addr learned my addr 172.21.15.132:0/3484778027 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.309+0000 7f1e79231640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1e7413cce0 0x7f1e74159c90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57154/0 (socket says 172.21.15.132:57154) 2023-12-20T04:48:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.310+0000 7f1e79a32640 1 --2- 172.21.15.132:0/3484778027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e740c92d0 0x7f1e740c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.310+0000 7f1e7a233640 1 -- 172.21.15.132:0/3484778027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e740c92d0 msgr2=0x7f1e740c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.310+0000 7f1e7a233640 1 --2- 172.21.15.132:0/3484778027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e740c92d0 0x7f1e740c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.310+0000 7f1e7a233640 1 -- 172.21.15.132:0/3484778027 >> v1:172.21.15.132:6789/0 conn(0x7f1e7413cce0 legacy=0x7f1e74159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.310+0000 7f1e78a30640 1 -- 172.21.15.132:0/3484778027 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2786008017 0 0) 0x7f1e7415aa30 con 0x7f1e7413cce0 2023-12-20T04:48:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.310+0000 7f1e7a233640 1 -- 172.21.15.132:0/3484778027 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e7406b260 con 0x7f1e7415a3a0 2023-12-20T04:48:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.310+0000 7f1e7a233640 1 --2- 172.21.15.132:0/3484778027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e7415a3a0 0x7f1e7406c020 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009e50 tx=0x7f1e6c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ee88b7eee9cbe41 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.311+0000 7f1e78a30640 1 -- 172.21.15.132:0/3484778027 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c02ca70 con 0x7f1e7415a3a0 2023-12-20T04:48:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.311+0000 7f1e78a30640 1 -- 172.21.15.132:0/3484778027 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c02cbd0 con 0x7f1e7415a3a0 2023-12-20T04:48:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.311+0000 7f1e78a30640 1 -- 172.21.15.132:0/3484778027 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c0343f0 con 0x7f1e7415a3a0 2023-12-20T04:48:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.311+0000 7f1e7bc96640 1 -- 172.21.15.132:0/3484778027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e7415a3a0 msgr2=0x7f1e7406c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.311+0000 7f1e7bc96640 1 --2- 172.21.15.132:0/3484778027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e7415a3a0 0x7f1e7406c020 secure :-1 s=READY pgs=1251 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009e50 tx=0x7f1e6c02bed0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.311+0000 7f1e7bc96640 1 -- 172.21.15.132:0/3484778027 shutdown_connections 2023-12-20T04:48:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.311+0000 7f1e7bc96640 1 --2- 172.21.15.132:0/3484778027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e7415a3a0 0x7f1e7406c020 unknown :-1 s=CLOSED pgs=1251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.311+0000 7f1e7bc96640 1 --2- 172.21.15.132:0/3484778027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e740c92d0 0x7f1e740c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.311+0000 7f1e7bc96640 1 -- 172.21.15.132:0/3484778027 >> 172.21.15.132:0/3484778027 conn(0x7f1e740ced10 msgr2=0x7f1e740cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.311+0000 7f1e7bc96640 1 -- 172.21.15.132:0/3484778027 shutdown_connections 2023-12-20T04:48:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.311+0000 7f1e7bc96640 1 -- 172.21.15.132:0/3484778027 wait complete. 2023-12-20T04:48:21.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.312+0000 7f1e7bc96640 1 Processor -- start 2023-12-20T04:48:21.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.312+0000 7f1e7bc96640 1 -- start start 2023-12-20T04:48:21.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.313+0000 7f1e7bc96640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e740c92d0 0x7f1e7415b900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.313+0000 7f1e7bc96640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e7413cce0 0x7f1e74156250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.313+0000 7f1e7bc96640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e7415a3a0 0x7f1e74153490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.313+0000 7f1e7bc96640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e74155e30 con 0x7f1e7415a3a0 2023-12-20T04:48:21.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.313+0000 7f1e7bc96640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e74154f60 con 0x7f1e7413cce0 2023-12-20T04:48:21.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.313+0000 7f1e7bc96640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e74156790 con 0x7f1e740c92d0 2023-12-20T04:48:21.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.313+0000 7f1e7a233640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e7415a3a0 0x7f1e74153490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:21.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.313+0000 7f1e7a233640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e7415a3a0 0x7f1e74153490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34306/0 (socket says 172.21.15.132:34306) 2023-12-20T04:48:21.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.313+0000 7f1e7a233640 1 -- 172.21.15.132:0/3966586793 learned_addr learned my addr 172.21.15.132:0/3966586793 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:21.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.313+0000 7f1e79a32640 1 --2- 172.21.15.132:0/3966586793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e740c92d0 0x7f1e7415b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:21.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.313+0000 7f1e79231640 1 --2- 172.21.15.132:0/3966586793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e7413cce0 0x7f1e74156250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:21.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.313+0000 7f1e7a233640 1 -- 172.21.15.132:0/3966586793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e740c92d0 msgr2=0x7f1e7415b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:21.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.313+0000 7f1e7a233640 1 --2- 172.21.15.132:0/3966586793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e740c92d0 0x7f1e7415b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.313+0000 7f1e7a233640 1 -- 172.21.15.132:0/3966586793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e7413cce0 msgr2=0x7f1e74156250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:21.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.313+0000 7f1e7a233640 1 --2- 172.21.15.132:0/3966586793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e7413cce0 0x7f1e74156250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.313+0000 7f1e7a233640 1 -- 172.21.15.132:0/3966586793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c009b30 con 0x7f1e7415a3a0 2023-12-20T04:48:21.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.314+0000 7f1e7a233640 1 --2- 172.21.15.132:0/3966586793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e7415a3a0 0x7f1e74153490 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009e50 tx=0x7f1e6c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:21.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.314+0000 7f1e6a7fc640 1 -- 172.21.15.132:0/3966586793 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c009510 con 0x7f1e7415a3a0 2023-12-20T04:48:21.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.314+0000 7f1e6a7fc640 1 -- 172.21.15.132:0/3966586793 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e6c03e450 con 0x7f1e7415a3a0 2023-12-20T04:48:21.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.314+0000 7f1e7bc96640 1 -- 172.21.15.132:0/3966586793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e741551b0 con 0x7f1e7415a3a0 2023-12-20T04:48:21.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.314+0000 7f1e6a7fc640 1 -- 172.21.15.132:0/3966586793 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e6c03e7e0 con 0x7f1e7415a3a0 2023-12-20T04:48:21.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.314+0000 7f1e7bc96640 1 -- 172.21.15.132:0/3966586793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e74155770 con 0x7f1e7415a3a0 2023-12-20T04:48:21.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.315+0000 7f1e7bc96640 1 -- 172.21.15.132:0/3966586793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e74155f70 con 0x7f1e7415a3a0 2023-12-20T04:48:21.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.315+0000 7f1e6a7fc640 1 -- 172.21.15.132:0/3966586793 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1e6c03e940 con 0x7f1e7415a3a0 2023-12-20T04:48:21.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.315+0000 7f1e6a7fc640 1 --2- 172.21.15.132:0/3966586793 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1e5806a430 0x7f1e5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.316+0000 7f1e6a7fc640 1 -- 172.21.15.132:0/3966586793 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1e6c0ab8d0 con 0x7f1e7415a3a0 2023-12-20T04:48:21.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.316+0000 7f1e79a32640 1 --2- 172.21.15.132:0/3966586793 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1e5806a430 0x7f1e5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:21.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.316+0000 7f1e79a32640 1 --2- 172.21.15.132:0/3966586793 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1e5806a430 0x7f1e5806c8f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1e70006fd0 tx=0x7f1e70008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:21.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.320+0000 7f1e6a7fc640 1 -- 172.21.15.132:0/3966586793 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1e6c076f50 con 0x7f1e7415a3a0 2023-12-20T04:48:21.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.486+0000 7f1e7bc96640 1 -- 172.21.15.132:0/3966586793 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f1e7415ded0 con 0x7f1e7415a3a0 2023-12-20T04:48:21.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.487+0000 7f1e6a7fc640 1 -- 172.21.15.132:0/3966586793 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16107 (secure 0 0 0) 0x7f1e6c033e80 con 0x7f1e7415a3a0 2023-12-20T04:48:21.489 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:21.489 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":125,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:48:16.867874+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:48:02.660300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-20T04:48:03.433311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:48:21.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.489+0000 7f1e7bc96640 1 -- 172.21.15.132:0/3966586793 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1e5806a430 msgr2=0x7f1e5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:21.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.489+0000 7f1e7bc96640 1 --2- 172.21.15.132:0/3966586793 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1e5806a430 0x7f1e5806c8f0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f1e70006fd0 tx=0x7f1e70008040 comp rx=0 tx=0).stop 2023-12-20T04:48:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.489+0000 7f1e7bc96640 1 -- 172.21.15.132:0/3966586793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e7415a3a0 msgr2=0x7f1e74153490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.489+0000 7f1e7bc96640 1 --2- 172.21.15.132:0/3966586793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e7415a3a0 0x7f1e74153490 secure :-1 s=READY pgs=1252 cs=0 l=1 rev1=1 crypto rx=0x7f1e6c009e50 tx=0x7f1e6c004a40 comp rx=0 tx=0).stop 2023-12-20T04:48:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.489+0000 7f1e7bc96640 1 -- 172.21.15.132:0/3966586793 shutdown_connections 2023-12-20T04:48:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.489+0000 7f1e7bc96640 1 --2- 172.21.15.132:0/3966586793 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1e5806a430 0x7f1e5806c8f0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.489+0000 7f1e7bc96640 1 --2- 172.21.15.132:0/3966586793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e7415a3a0 0x7f1e74153490 unknown :-1 s=CLOSED pgs=1252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.489+0000 7f1e7bc96640 1 --2- 172.21.15.132:0/3966586793 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e7413cce0 0x7f1e74156250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.489+0000 7f1e7bc96640 1 --2- 172.21.15.132:0/3966586793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e740c92d0 0x7f1e7415b900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.489+0000 7f1e7bc96640 1 -- 172.21.15.132:0/3966586793 >> 172.21.15.132:0/3966586793 conn(0x7f1e740ced10 msgr2=0x7f1e740cdc40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.489+0000 7f1e7bc96640 1 -- 172.21.15.132:0/3966586793 shutdown_connections 2023-12-20T04:48:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.489+0000 7f1e7bc96640 1 -- 172.21.15.132:0/3966586793 wait complete. 2023-12-20T04:48:21.502 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:48:02.660300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:48:03.433311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:48:21.502 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:48:21.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.603+0000 7f006f3f0640 1 Processor -- start 2023-12-20T04:48:21.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.604+0000 7f006f3f0640 1 -- start start 2023-12-20T04:48:21.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.604+0000 7f006f3f0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f006815d300 0x7f00680d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.604+0000 7f006f3f0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f00680cff90 0x7f00680b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.604+0000 7f006f3f0640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00680d1a90 con 0x7f00680d1550 2023-12-20T04:48:21.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.604+0000 7f006f3f0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f00680d1d70 con 0x7f00680cff90 2023-12-20T04:48:21.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.604+0000 7f006f3f0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00680d2050 con 0x7f006815d300 2023-12-20T04:48:21.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.605+0000 7f006d98d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f00680cff90 0x7f00680b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:21.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.605+0000 7f006d98d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f00680cff90 0x7f00680b60e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34318/0 (socket says 172.21.15.132:34318) 2023-12-20T04:48:21.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.605+0000 7f006d98d640 1 -- 172.21.15.132:0/3220601999 learned_addr learned my addr 172.21.15.132:0/3220601999 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:21.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.605+0000 7f006d98d640 1 -- 172.21.15.132:0/3220601999 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f006815d300 msgr2=0x7f00680d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:21.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.605+0000 7f006d98d640 1 --2- 172.21.15.132:0/3220601999 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f006815d300 0x7f00680d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.605+0000 7f006d98d640 1 -- 172.21.15.132:0/3220601999 >> v1:172.21.15.187:6789/0 conn(0x7f00680d1550 legacy=0x7f00680cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:21.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.605+0000 7f006d98d640 1 -- 172.21.15.132:0/3220601999 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00680d2330 con 0x7f00680cff90 2023-12-20T04:48:21.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.606+0000 7f006d98d640 1 --2- 172.21.15.132:0/3220601999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00680cff90 0x7f00680b60e0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f0064009e50 tx=0x7f006402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a19e0128924fbbe server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:21.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.606+0000 7f005ffff640 1 -- 172.21.15.132:0/3220601999 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f006402ca70 con 0x7f00680cff90 2023-12-20T04:48:21.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.606+0000 7f005ffff640 1 -- 172.21.15.132:0/3220601999 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f006402cbd0 con 0x7f00680cff90 2023-12-20T04:48:21.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.606+0000 7f005ffff640 1 -- 172.21.15.132:0/3220601999 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f00640343f0 con 0x7f00680cff90 2023-12-20T04:48:21.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.606+0000 7f006f3f0640 1 -- 172.21.15.132:0/3220601999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00680cff90 msgr2=0x7f00680b60e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:21.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.606+0000 7f006f3f0640 1 --2- 172.21.15.132:0/3220601999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00680cff90 0x7f00680b60e0 secure :-1 s=READY pgs=1253 cs=0 l=1 rev1=1 crypto rx=0x7f0064009e50 tx=0x7f006402bed0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.606+0000 7f006f3f0640 1 -- 172.21.15.132:0/3220601999 shutdown_connections 2023-12-20T04:48:21.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.606+0000 7f006f3f0640 1 --2- 172.21.15.132:0/3220601999 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00680cff90 0x7f00680b60e0 unknown :-1 s=CLOSED pgs=1253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.606+0000 7f006f3f0640 1 --2- 172.21.15.132:0/3220601999 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f006815d300 0x7f00680d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.606+0000 7f006f3f0640 1 -- 172.21.15.132:0/3220601999 >> 172.21.15.132:0/3220601999 conn(0x7f006806a3d0 msgr2=0x7f006806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:21.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.606+0000 7f006f3f0640 1 -- 172.21.15.132:0/3220601999 shutdown_connections 2023-12-20T04:48:21.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.606+0000 7f006f3f0640 1 -- 172.21.15.132:0/3220601999 wait complete. 2023-12-20T04:48:21.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.608+0000 7f006f3f0640 1 Processor -- start 2023-12-20T04:48:21.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.608+0000 7f006f3f0640 1 -- start start 2023-12-20T04:48:21.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.608+0000 7f006f3f0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00680cff90 0x7f00681531e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.608+0000 7f006f3f0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00680d1550 0x7f00680b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.608+0000 7f006f3f0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f006815d300 0x7f00680b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.608+0000 7f006f3f0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f006815d8f0 con 0x7f00680cff90 2023-12-20T04:48:21.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.608+0000 7f006f3f0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00680b4a60 con 0x7f00680d1550 2023-12-20T04:48:21.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.608+0000 7f006f3f0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00681f29c0 con 0x7f006815d300 2023-12-20T04:48:21.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.608+0000 7f006d18c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00680cff90 0x7f00681531e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:21.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.608+0000 7f006d18c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00680cff90 0x7f00681531e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34330/0 (socket says 172.21.15.132:34330) 2023-12-20T04:48:21.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.608+0000 7f006d18c640 1 -- 172.21.15.132:0/2904683073 learned_addr learned my addr 172.21.15.132:0/2904683073 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:21.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.609+0000 7f006d98d640 1 --2- 172.21.15.132:0/2904683073 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f006815d300 0x7f00680b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:21.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.609+0000 7f006c98b640 1 --2- 172.21.15.132:0/2904683073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00680d1550 0x7f00680b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:21.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.609+0000 7f006d18c640 1 -- 172.21.15.132:0/2904683073 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f006815d300 msgr2=0x7f00680b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:21.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.609+0000 7f006d18c640 1 --2- 172.21.15.132:0/2904683073 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f006815d300 0x7f00680b4ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.609+0000 7f006d18c640 1 -- 172.21.15.132:0/2904683073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00680d1550 msgr2=0x7f00680b28d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:21.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.609+0000 7f006d18c640 1 --2- 172.21.15.132:0/2904683073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00680d1550 0x7f00680b28d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.609+0000 7f006d18c640 1 -- 172.21.15.132:0/2904683073 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0064009b30 con 0x7f00680cff90 2023-12-20T04:48:21.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.609+0000 7f006d98d640 1 --2- 172.21.15.132:0/2904683073 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f006815d300 0x7f00680b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:21.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.609+0000 7f006c98b640 1 --2- 172.21.15.132:0/2904683073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00680d1550 0x7f00680b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:21.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.609+0000 7f006d18c640 1 --2- 172.21.15.132:0/2904683073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00680cff90 0x7f00681531e0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f006000b440 tx=0x7f006000b900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:21.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.609+0000 7f005dffb640 1 -- 172.21.15.132:0/2904683073 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0060011890 con 0x7f00680cff90 2023-12-20T04:48:21.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.609+0000 7f005dffb640 1 -- 172.21.15.132:0/2904683073 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00600119f0 con 0x7f00680cff90 2023-12-20T04:48:21.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.609+0000 7f006f3f0640 1 -- 172.21.15.132:0/2904683073 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f00680b4450 con 0x7f00680cff90 2023-12-20T04:48:21.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.609+0000 7f005dffb640 1 -- 172.21.15.132:0/2904683073 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0060011da0 con 0x7f00680cff90 2023-12-20T04:48:21.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.609+0000 7f006f3f0640 1 -- 172.21.15.132:0/2904683073 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00680c7720 con 0x7f00680cff90 2023-12-20T04:48:21.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.610+0000 7f006f3f0640 1 -- 172.21.15.132:0/2904683073 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f006804e840 con 0x7f00680cff90 2023-12-20T04:48:21.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.610+0000 7f005dffb640 1 -- 172.21.15.132:0/2904683073 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f006001a400 con 0x7f00680cff90 2023-12-20T04:48:21.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.611+0000 7f005dffb640 1 --2- 172.21.15.132:0/2904683073 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f004c06a430 0x7f004c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.611+0000 7f005dffb640 1 -- 172.21.15.132:0/2904683073 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0060088ca0 con 0x7f00680cff90 2023-12-20T04:48:21.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.611+0000 7f006c98b640 1 --2- 172.21.15.132:0/2904683073 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f004c06a430 0x7f004c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:21.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.611+0000 7f006c98b640 1 --2- 172.21.15.132:0/2904683073 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f004c06a430 0x7f004c06c8f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0068154630 tx=0x7f0058009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:21.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.615+0000 7f005dffb640 1 -- 172.21.15.132:0/2904683073 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0060054200 con 0x7f00680cff90 2023-12-20T04:48:21.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.780+0000 7f006f3f0640 1 -- 172.21.15.132:0/2904683073 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f00680ccf70 con 0x7f00680cff90 2023-12-20T04:48:21.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.780+0000 7f005dffb640 1 -- 172.21.15.132:0/2904683073 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0060015070 con 0x7f00680cff90 2023-12-20T04:48:21.783 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:48:21.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.782+0000 7f006f3f0640 1 -- 172.21.15.132:0/2904683073 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f004c06a430 msgr2=0x7f004c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:21.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.782+0000 7f006f3f0640 1 --2- 172.21.15.132:0/2904683073 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f004c06a430 0x7f004c06c8f0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f0068154630 tx=0x7f0058009040 comp rx=0 tx=0).stop 2023-12-20T04:48:21.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.782+0000 7f006f3f0640 1 -- 172.21.15.132:0/2904683073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00680cff90 msgr2=0x7f00681531e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:21.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.782+0000 7f006f3f0640 1 --2- 172.21.15.132:0/2904683073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00680cff90 0x7f00681531e0 secure :-1 s=READY pgs=1254 cs=0 l=1 rev1=1 crypto rx=0x7f006000b440 tx=0x7f006000b900 comp rx=0 tx=0).stop 2023-12-20T04:48:21.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.782+0000 7f006f3f0640 1 -- 172.21.15.132:0/2904683073 shutdown_connections 2023-12-20T04:48:21.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.782+0000 7f006f3f0640 1 --2- 172.21.15.132:0/2904683073 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f004c06a430 0x7f004c06c8f0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.782+0000 7f006f3f0640 1 --2- 172.21.15.132:0/2904683073 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f006815d300 0x7f00680b4ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.782+0000 7f006f3f0640 1 --2- 172.21.15.132:0/2904683073 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f00680d1550 0x7f00680b28d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.782+0000 7f006f3f0640 1 --2- 172.21.15.132:0/2904683073 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f00680cff90 0x7f00681531e0 unknown :-1 s=CLOSED pgs=1254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.782+0000 7f006f3f0640 1 -- 172.21.15.132:0/2904683073 >> 172.21.15.132:0/2904683073 conn(0x7f006806a3d0 msgr2=0x7f006815a530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:21.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.782+0000 7f006f3f0640 1 -- 172.21.15.132:0/2904683073 shutdown_connections 2023-12-20T04:48:21.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.782+0000 7f006f3f0640 1 -- 172.21.15.132:0/2904683073 wait complete. 2023-12-20T04:48:21.795 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:48:21.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.896+0000 7f99d8da2640 1 Processor -- start 2023-12-20T04:48:21.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.896+0000 7f99d8da2640 1 -- start start 2023-12-20T04:48:21.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.897+0000 7f99d8da2640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f99d41607a0 0x7f99d40cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.897+0000 7f99d8da2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99d40d27f0 0x7f99d40cdf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.897+0000 7f99d8da2640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99d40d24d0 con 0x7f99d40d0210 2023-12-20T04:48:21.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.897+0000 7f99d8da2640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99d40b8cc0 con 0x7f99d41607a0 2023-12-20T04:48:21.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.897+0000 7f99d8da2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40b89e0 con 0x7f99d40d27f0 2023-12-20T04:48:21.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.898+0000 7f99d37fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f99d41607a0 0x7f99d40cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:21.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.898+0000 7f99d2ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99d40d27f0 0x7f99d40cdf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:21.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.898+0000 7f99d3fff640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f99d40d0210 0x7f99d40d0840 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:36844/0 (socket says 172.21.15.132:36844) 2023-12-20T04:48:21.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.898+0000 7f99d3fff640 1 -- 172.21.15.132:0/2356144445 learned_addr learned my addr 172.21.15.132:0/2356144445 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:21.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.898+0000 7f99d2ffd640 1 -- 172.21.15.132:0/2356144445 >> v2:172.21.15.187:3300/0 conn(0x7f99d41607a0 msgr2=0x7f99d40cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:21.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.898+0000 7f99d2ffd640 1 --2- 172.21.15.132:0/2356144445 >> v2:172.21.15.187:3300/0 conn(0x7f99d41607a0 0x7f99d40cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.898+0000 7f99d2ffd640 1 -- 172.21.15.132:0/2356144445 >> v1:172.21.15.187:6789/0 conn(0x7f99d40d0210 legacy=0x7f99d40d0840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:21.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.898+0000 7f99d2ffd640 1 -- 172.21.15.132:0/2356144445 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99d40d19f0 con 0x7f99d40d27f0 2023-12-20T04:48:21.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.898+0000 7f99d37fe640 1 --2- 172.21.15.132:0/2356144445 >> v2:172.21.15.187:3300/0 conn(0x7f99d41607a0 0x7f99d40cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:48:21.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.899+0000 7f99d2ffd640 1 --2- 172.21.15.132:0/2356144445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99d40d27f0 0x7f99d40cdf80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f99c80097a0 tx=0x7f99c802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=9789b5f045eb1001 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:21.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.899+0000 7f99d27fc640 1 -- 172.21.15.132:0/2356144445 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8031830 con 0x7f99d40d27f0 2023-12-20T04:48:21.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.899+0000 7f99d27fc640 1 -- 172.21.15.132:0/2356144445 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99c8031990 con 0x7f99d40d27f0 2023-12-20T04:48:21.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.899+0000 7f99d27fc640 1 -- 172.21.15.132:0/2356144445 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99c8031d20 con 0x7f99d40d27f0 2023-12-20T04:48:21.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.899+0000 7f99d8da2640 1 -- 172.21.15.132:0/2356144445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99d40d27f0 msgr2=0x7f99d40cdf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:21.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.899+0000 7f99d8da2640 1 --2- 172.21.15.132:0/2356144445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99d40d27f0 0x7f99d40cdf80 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f99c80097a0 tx=0x7f99c802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.899+0000 7f99d8da2640 1 -- 172.21.15.132:0/2356144445 shutdown_connections 2023-12-20T04:48:21.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.899+0000 7f99d8da2640 1 --2- 172.21.15.132:0/2356144445 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99d40d27f0 0x7f99d40cdf80 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.899+0000 7f99d8da2640 1 --2- 172.21.15.132:0/2356144445 >> v2:172.21.15.187:3300/0 conn(0x7f99d41607a0 0x7f99d40cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.899+0000 7f99d8da2640 1 -- 172.21.15.132:0/2356144445 >> 172.21.15.132:0/2356144445 conn(0x7f99d40cf6f0 msgr2=0x7f99d40cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:21.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.900+0000 7f99d8da2640 1 -- 172.21.15.132:0/2356144445 shutdown_connections 2023-12-20T04:48:21.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.900+0000 7f99d8da2640 1 -- 172.21.15.132:0/2356144445 wait complete. 2023-12-20T04:48:21.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.901+0000 7f99d8da2640 1 Processor -- start 2023-12-20T04:48:21.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.901+0000 7f99d8da2640 1 -- start start 2023-12-20T04:48:21.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.901+0000 7f99d8da2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99d40d0210 0x7f99d40cb390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.901+0000 7f99d8da2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99d40d27f0 0x7f99d40cb8d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.901+0000 7f99d8da2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99d41607a0 0x7f99d41e5890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.901+0000 7f99d8da2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40c9fd0 con 0x7f99d41607a0 2023-12-20T04:48:21.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.901+0000 7f99d8da2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40c9690 con 0x7f99d40d27f0 2023-12-20T04:48:21.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.901+0000 7f99d8da2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99d40c93b0 con 0x7f99d40d0210 2023-12-20T04:48:21.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.902+0000 7f99d3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99d41607a0 0x7f99d41e5890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:21.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.902+0000 7f99d3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99d41607a0 0x7f99d41e5890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34336/0 (socket says 172.21.15.132:34336) 2023-12-20T04:48:21.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.902+0000 7f99d3fff640 1 -- 172.21.15.132:0/2604952404 learned_addr learned my addr 172.21.15.132:0/2604952404 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:21.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.902+0000 7f99d37fe640 1 --2- 172.21.15.132:0/2604952404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99d40d0210 0x7f99d40cb390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:21.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.902+0000 7f99d2ffd640 1 --2- 172.21.15.132:0/2604952404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99d40d27f0 0x7f99d40cb8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:21.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.902+0000 7f99d3fff640 1 -- 172.21.15.132:0/2604952404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99d40d0210 msgr2=0x7f99d40cb390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:21.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.902+0000 7f99d3fff640 1 --2- 172.21.15.132:0/2604952404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99d40d0210 0x7f99d40cb390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.902+0000 7f99d3fff640 1 -- 172.21.15.132:0/2604952404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99d40d27f0 msgr2=0x7f99d40cb8d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:21.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.902+0000 7f99d3fff640 1 --2- 172.21.15.132:0/2604952404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99d40d27f0 0x7f99d40cb8d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:21.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.902+0000 7f99d3fff640 1 -- 172.21.15.132:0/2604952404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99c4009400 con 0x7f99d41607a0 2023-12-20T04:48:21.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.902+0000 7f99d3fff640 1 --2- 172.21.15.132:0/2604952404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99d41607a0 0x7f99d41e5890 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00cad0 tx=0x7f99cc00cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:21.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.902+0000 7f99bbfff640 1 -- 172.21.15.132:0/2604952404 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc00ac30 con 0x7f99d41607a0 2023-12-20T04:48:21.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.902+0000 7f99bbfff640 1 -- 172.21.15.132:0/2604952404 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99cc00ad90 con 0x7f99d41607a0 2023-12-20T04:48:21.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.902+0000 7f99d8da2640 1 -- 172.21.15.132:0/2604952404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99c8009400 con 0x7f99d41607a0 2023-12-20T04:48:21.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.902+0000 7f99bbfff640 1 -- 172.21.15.132:0/2604952404 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99cc012600 con 0x7f99d41607a0 2023-12-20T04:48:21.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.902+0000 7f99d8da2640 1 -- 172.21.15.132:0/2604952404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99d40cc440 con 0x7f99d41607a0 2023-12-20T04:48:21.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.903+0000 7f99d8da2640 1 -- 172.21.15.132:0/2604952404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99d40673e0 con 0x7f99d41607a0 2023-12-20T04:48:21.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.904+0000 7f99bbfff640 1 -- 172.21.15.132:0/2604952404 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f99cc007070 con 0x7f99d41607a0 2023-12-20T04:48:21.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.904+0000 7f99bbfff640 1 --2- 172.21.15.132:0/2604952404 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99c006a430 0x7f99c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:21.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.904+0000 7f99bbfff640 1 -- 172.21.15.132:0/2604952404 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99cc0886b0 con 0x7f99d41607a0 2023-12-20T04:48:21.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.904+0000 7f99d37fe640 1 --2- 172.21.15.132:0/2604952404 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99c006a430 0x7f99c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:21.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.905+0000 7f99d37fe640 1 --2- 172.21.15.132:0/2604952404 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99c006a430 0x7f99c006c8f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009cd0 tx=0x7f99c4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:21.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:21.908+0000 7f99bbfff640 1 -- 172.21.15.132:0/2604952404 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f99cc053d50 con 0x7f99d41607a0 2023-12-20T04:48:22.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.074+0000 7f99d8da2640 1 -- 172.21.15.132:0/2604952404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f99d415efb0 con 0x7f99d41607a0 2023-12-20T04:48:22.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.074+0000 7f99bbfff640 1 -- 172.21.15.132:0/2604952404 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v125) v1 ==== 104+0+11 (secure 0 0 0) 0x7f99cc057370 con 0x7f99d41607a0 2023-12-20T04:48:22.076 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:48:22.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.076+0000 7f99d8da2640 1 -- 172.21.15.132:0/2604952404 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99c006a430 msgr2=0x7f99c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:22.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.076+0000 7f99d8da2640 1 --2- 172.21.15.132:0/2604952404 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99c006a430 0x7f99c006c8f0 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f99c4009cd0 tx=0x7f99c4009190 comp rx=0 tx=0).stop 2023-12-20T04:48:22.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.076+0000 7f99d8da2640 1 -- 172.21.15.132:0/2604952404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99d41607a0 msgr2=0x7f99d41e5890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:22.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.076+0000 7f99d8da2640 1 --2- 172.21.15.132:0/2604952404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99d41607a0 0x7f99d41e5890 secure :-1 s=READY pgs=1255 cs=0 l=1 rev1=1 crypto rx=0x7f99cc00cad0 tx=0x7f99cc00cf90 comp rx=0 tx=0).stop 2023-12-20T04:48:22.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.076+0000 7f99d8da2640 1 -- 172.21.15.132:0/2604952404 shutdown_connections 2023-12-20T04:48:22.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.076+0000 7f99d8da2640 1 --2- 172.21.15.132:0/2604952404 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99c006a430 0x7f99c006c8f0 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.076+0000 7f99d8da2640 1 --2- 172.21.15.132:0/2604952404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99d41607a0 0x7f99d41e5890 unknown :-1 s=CLOSED pgs=1255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.076+0000 7f99d8da2640 1 --2- 172.21.15.132:0/2604952404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99d40d27f0 0x7f99d40cb8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.076+0000 7f99d8da2640 1 --2- 172.21.15.132:0/2604952404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99d40d0210 0x7f99d40cb390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.076+0000 7f99d8da2640 1 -- 172.21.15.132:0/2604952404 >> 172.21.15.132:0/2604952404 conn(0x7f99d40cf6f0 msgr2=0x7f99d40b76d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:22.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.076+0000 7f99d8da2640 1 -- 172.21.15.132:0/2604952404 shutdown_connections 2023-12-20T04:48:22.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.076+0000 7f99d8da2640 1 -- 172.21.15.132:0/2604952404 wait complete. 2023-12-20T04:48:22.089 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:48:22.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.190+0000 7fb428589640 1 Processor -- start 2023-12-20T04:48:22.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.190+0000 7fb428589640 1 -- start start 2023-12-20T04:48:22.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.191+0000 7fb428589640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4200cfc40 0x7fb4200b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:22.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.191+0000 7fb428589640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4200d2920 con 0x7fb4200cf790 2023-12-20T04:48:22.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.191+0000 7fb428589640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb4200d1d10 con 0x7fb42015d300 2023-12-20T04:48:22.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.191+0000 7fb428589640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb4200d1ff0 con 0x7fb4200cfc40 2023-12-20T04:48:22.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425b24640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb4200cf790 0x7fb4200b6080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57160/0 (socket says 172.21.15.132:57160) 2023-12-20T04:48:22.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425b24640 1 -- 172.21.15.132:0/2743648086 learned_addr learned my addr 172.21.15.132:0/2743648086 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:22.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425323640 1 -- 172.21.15.132:0/2743648086 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 581362534 0 0) 0x7fb4200d2920 con 0x7fb4200cf790 2023-12-20T04:48:22.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425323640 1 -- 172.21.15.132:0/2743648086 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb40c003520 con 0x7fb4200cf790 2023-12-20T04:48:22.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb426b26640 1 --2- 172.21.15.132:0/2743648086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4200cfc40 0x7fb4200b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:22.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425323640 1 -- 172.21.15.132:0/2743648086 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2776202109 0 0) 0x7fb40c003520 con 0x7fb4200cf790 2023-12-20T04:48:22.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425323640 1 -- 172.21.15.132:0/2743648086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4200cfc40 msgr2=0x7fb4200b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:22.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425323640 1 --2- 172.21.15.132:0/2743648086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4200cfc40 0x7fb4200b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425323640 1 -- 172.21.15.132:0/2743648086 >> v1:172.21.15.187:6789/0 conn(0x7fb42015d300 legacy=0x7fb4200d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:22.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425323640 1 -- 172.21.15.132:0/2743648086 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4200d22d0 con 0x7fb4200cf790 2023-12-20T04:48:22.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425323640 1 -- 172.21.15.132:0/2743648086 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fb410001670 con 0x7fb4200cf790 2023-12-20T04:48:22.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425323640 1 -- 172.21.15.132:0/2743648086 >> v1:172.21.15.132:6789/0 conn(0x7fb4200cf790 legacy=0x7fb4200b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:22.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425323640 1 --2- 172.21.15.132:0/2743648086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb40c0039a0 0x7fb40c003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:22.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425323640 1 --2- 172.21.15.132:0/2743648086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4200cfc40 0x7fb40c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:22.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425323640 1 --2- 172.21.15.132:0/2743648086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb40c004d00 0x7fb40c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:22.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425323640 1 -- 172.21.15.132:0/2743648086 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4200d1ff0 con 0x7fb40c0039a0 2023-12-20T04:48:22.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425323640 1 -- 172.21.15.132:0/2743648086 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c00bb10 con 0x7fb40c004d00 2023-12-20T04:48:22.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425323640 1 -- 172.21.15.132:0/2743648086 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb40c00bca0 con 0x7fb4200cfc40 2023-12-20T04:48:22.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb426325640 1 --2- 172.21.15.132:0/2743648086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb40c0039a0 0x7fb40c003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:22.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb425b24640 1 --2- 172.21.15.132:0/2743648086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4200cfc40 0x7fb40c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:22.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb426b26640 1 --2- 172.21.15.132:0/2743648086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb40c004d00 0x7fb40c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:22.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb426325640 1 -- 172.21.15.132:0/2743648086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4200cfc40 msgr2=0x7fb40c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:22.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb426325640 1 --2- 172.21.15.132:0/2743648086 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4200cfc40 0x7fb40c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb426325640 1 -- 172.21.15.132:0/2743648086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb40c004d00 msgr2=0x7fb40c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:22.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb426325640 1 --2- 172.21.15.132:0/2743648086 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb40c004d00 0x7fb40c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.192+0000 7fb426325640 1 -- 172.21.15.132:0/2743648086 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb40c003520 con 0x7fb40c0039a0 2023-12-20T04:48:22.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.193+0000 7fb426325640 1 --2- 172.21.15.132:0/2743648086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb40c0039a0 0x7fb40c003dc0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fb41c001e80 tx=0x7fb40c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f960f898b548e5b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:22.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.193+0000 7fb425323640 1 -- 172.21.15.132:0/2743648086 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c003b70 con 0x7fb40c0039a0 2023-12-20T04:48:22.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.193+0000 7fb425323640 1 -- 172.21.15.132:0/2743648086 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41c003cd0 con 0x7fb40c0039a0 2023-12-20T04:48:22.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.193+0000 7fb425323640 1 -- 172.21.15.132:0/2743648086 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c005310 con 0x7fb40c0039a0 2023-12-20T04:48:22.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.194+0000 7fb428589640 1 -- 172.21.15.132:0/2743648086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb40c0039a0 msgr2=0x7fb40c003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:22.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.194+0000 7fb428589640 1 --2- 172.21.15.132:0/2743648086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb40c0039a0 0x7fb40c003dc0 secure :-1 s=READY pgs=1257 cs=0 l=1 rev1=1 crypto rx=0x7fb41c001e80 tx=0x7fb40c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.194+0000 7fb426b26640 1 -- 172.21.15.132:0/2743648086 reap_dead start 2023-12-20T04:48:22.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.194+0000 7fb428589640 1 -- 172.21.15.132:0/2743648086 shutdown_connections 2023-12-20T04:48:22.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.194+0000 7fb428589640 1 -- 172.21.15.132:0/2743648086 >> 172.21.15.132:0/2743648086 conn(0x7fb42006a3d0 msgr2=0x7fb42006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:22.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.194+0000 7fb428589640 1 -- 172.21.15.132:0/2743648086 shutdown_connections 2023-12-20T04:48:22.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.194+0000 7fb428589640 1 -- 172.21.15.132:0/2743648086 wait complete. 2023-12-20T04:48:22.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.195+0000 7fb428589640 1 Processor -- start 2023-12-20T04:48:22.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.195+0000 7fb428589640 1 -- start start 2023-12-20T04:48:22.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb428589640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb40c0039a0 0x7fb42014a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:22.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb428589640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4201556c0 0x7fb420153df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:22.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb428589640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4201535d0 0x7fb42015f5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:22.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb428589640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb420155230 con 0x7fb40c0039a0 2023-12-20T04:48:22.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb428589640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb420154620 con 0x7fb4201556c0 2023-12-20T04:48:22.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb428589640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb420154900 con 0x7fb4201535d0 2023-12-20T04:48:22.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb426325640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb40c0039a0 0x7fb42014a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:22.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb426325640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb40c0039a0 0x7fb42014a2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34350/0 (socket says 172.21.15.132:34350) 2023-12-20T04:48:22.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb426325640 1 -- 172.21.15.132:0/3699210191 learned_addr learned my addr 172.21.15.132:0/3699210191 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:22.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb425b24640 1 --2- 172.21.15.132:0/3699210191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4201556c0 0x7fb420153df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:22.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb426b26640 1 --2- 172.21.15.132:0/3699210191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4201535d0 0x7fb42015f5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:22.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb426325640 1 -- 172.21.15.132:0/3699210191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4201535d0 msgr2=0x7fb42015f5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:22.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb426325640 1 --2- 172.21.15.132:0/3699210191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4201535d0 0x7fb42015f5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb426325640 1 -- 172.21.15.132:0/3699210191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4201556c0 msgr2=0x7fb420153df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:22.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb426325640 1 --2- 172.21.15.132:0/3699210191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4201556c0 0x7fb420153df0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb426325640 1 -- 172.21.15.132:0/3699210191 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb420154be0 con 0x7fb40c0039a0 2023-12-20T04:48:22.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb425b24640 1 --2- 172.21.15.132:0/3699210191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4201556c0 0x7fb420153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:22.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb426325640 1 --2- 172.21.15.132:0/3699210191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb40c0039a0 0x7fb42014a2f0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fb41c02bf90 tx=0x7fb41c0014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:22.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb416ffd640 1 -- 172.21.15.132:0/3699210191 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c03e070 con 0x7fb40c0039a0 2023-12-20T04:48:22.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb416ffd640 1 -- 172.21.15.132:0/3699210191 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb41c006b50 con 0x7fb40c0039a0 2023-12-20T04:48:22.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb428589640 1 -- 172.21.15.132:0/3699210191 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb420154ec0 con 0x7fb40c0039a0 2023-12-20T04:48:22.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.196+0000 7fb416ffd640 1 -- 172.21.15.132:0/3699210191 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb41c007030 con 0x7fb40c0039a0 2023-12-20T04:48:22.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.197+0000 7fb428589640 1 -- 172.21.15.132:0/3699210191 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb42015fb00 con 0x7fb40c0039a0 2023-12-20T04:48:22.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.198+0000 7fb428589640 1 -- 172.21.15.132:0/3699210191 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb42004e840 con 0x7fb40c0039a0 2023-12-20T04:48:22.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.198+0000 7fb416ffd640 1 -- 172.21.15.132:0/3699210191 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb41c007190 con 0x7fb40c0039a0 2023-12-20T04:48:22.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.198+0000 7fb416ffd640 1 --2- 172.21.15.132:0/3699210191 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb40406a430 0x7fb40406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:22.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.198+0000 7fb416ffd640 1 -- 172.21.15.132:0/3699210191 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb41c0aa5a0 con 0x7fb40c0039a0 2023-12-20T04:48:22.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.198+0000 7fb425b24640 1 --2- 172.21.15.132:0/3699210191 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb40406a430 0x7fb40406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:22.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.199+0000 7fb425b24640 1 --2- 172.21.15.132:0/3699210191 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb40406a430 0x7fb40406c8f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb4201f6310 tx=0x7fb410009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:22.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.203+0000 7fb416ffd640 1 -- 172.21.15.132:0/3699210191 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb41c075b00 con 0x7fb40c0039a0 2023-12-20T04:48:22.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.368+0000 7fb428589640 1 -- 172.21.15.132:0/3699210191 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb4200b8da0 con 0x7fb40c0039a0 2023-12-20T04:48:22.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.368+0000 7fb416ffd640 1 -- 172.21.15.132:0/3699210191 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v125) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb41c079120 con 0x7fb40c0039a0 2023-12-20T04:48:22.370 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:48:22.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.370+0000 7fb428589640 1 -- 172.21.15.132:0/3699210191 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb40406a430 msgr2=0x7fb40406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:22.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.370+0000 7fb428589640 1 --2- 172.21.15.132:0/3699210191 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb40406a430 0x7fb40406c8f0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fb4201f6310 tx=0x7fb410009040 comp rx=0 tx=0).stop 2023-12-20T04:48:22.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.370+0000 7fb428589640 1 -- 172.21.15.132:0/3699210191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb40c0039a0 msgr2=0x7fb42014a2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:22.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.370+0000 7fb428589640 1 --2- 172.21.15.132:0/3699210191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb40c0039a0 0x7fb42014a2f0 secure :-1 s=READY pgs=1258 cs=0 l=1 rev1=1 crypto rx=0x7fb41c02bf90 tx=0x7fb41c0014a0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.370+0000 7fb428589640 1 -- 172.21.15.132:0/3699210191 shutdown_connections 2023-12-20T04:48:22.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.370+0000 7fb428589640 1 --2- 172.21.15.132:0/3699210191 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb40406a430 0x7fb40406c8f0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.370+0000 7fb428589640 1 --2- 172.21.15.132:0/3699210191 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb4201535d0 0x7fb42015f5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.370+0000 7fb428589640 1 --2- 172.21.15.132:0/3699210191 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb4201556c0 0x7fb420153df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.370+0000 7fb428589640 1 --2- 172.21.15.132:0/3699210191 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb40c0039a0 0x7fb42014a2f0 unknown :-1 s=CLOSED pgs=1258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.370+0000 7fb428589640 1 -- 172.21.15.132:0/3699210191 >> 172.21.15.132:0/3699210191 conn(0x7fb42006a3d0 msgr2=0x7fb4200d0d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:22.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.370+0000 7fb428589640 1 -- 172.21.15.132:0/3699210191 shutdown_connections 2023-12-20T04:48:22.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.370+0000 7fb428589640 1 -- 172.21.15.132:0/3699210191 wait complete. 2023-12-20T04:48:22.383 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:48:22.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.482+0000 7f48b3ac4640 1 Processor -- start 2023-12-20T04:48:22.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.482+0000 7f48b3ac4640 1 -- start start 2023-12-20T04:48:22.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.483+0000 7f48b3ac4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48ac0d0cd0 0x7f48ac0b3a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:22.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.483+0000 7f48b3ac4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ac0ceaa0 con 0x7f48ac0ce5a0 2023-12-20T04:48:22.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.483+0000 7f48b3ac4640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f48ac0ced80 con 0x7f48ac0d14d0 2023-12-20T04:48:22.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.483+0000 7f48b3ac4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac0b2850 con 0x7f48ac0d0cd0 2023-12-20T04:48:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.483+0000 7f48b105f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f48ac0ce5a0 0x7f48ac0b3330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57172/0 (socket says 172.21.15.132:57172) 2023-12-20T04:48:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.483+0000 7f48b105f640 1 -- 172.21.15.132:0/1983074732 learned_addr learned my addr 172.21.15.132:0/1983074732 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.483+0000 7f48b2061640 1 --2- 172.21.15.132:0/1983074732 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48ac0d0cd0 0x7f48ac0b3a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.483+0000 7f48b085e640 1 -- 172.21.15.132:0/1983074732 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4013179623 0 0) 0x7f48ac0ceaa0 con 0x7f48ac0ce5a0 2023-12-20T04:48:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.483+0000 7f48b085e640 1 -- 172.21.15.132:0/1983074732 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4894003520 con 0x7f48ac0ce5a0 2023-12-20T04:48:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.483+0000 7f48b085e640 1 -- 172.21.15.132:0/1983074732 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4047291956 0 0) 0x7f48ac0ced80 con 0x7f48ac0d14d0 2023-12-20T04:48:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.483+0000 7f48b085e640 1 -- 172.21.15.132:0/1983074732 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f48ac0ceaa0 con 0x7f48ac0d14d0 2023-12-20T04:48:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.483+0000 7f48b2061640 1 -- 172.21.15.132:0/1983074732 >> v1:172.21.15.187:6789/0 conn(0x7f48ac0d14d0 legacy=0x7f48ac0d18b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.483+0000 7f48b2061640 1 -- 172.21.15.132:0/1983074732 >> v1:172.21.15.132:6789/0 conn(0x7f48ac0ce5a0 legacy=0x7f48ac0b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:22.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.483+0000 7f48b2061640 1 -- 172.21.15.132:0/1983074732 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48ac0b2b30 con 0x7f48ac0d0cd0 2023-12-20T04:48:22.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.484+0000 7f48b2061640 1 --2- 172.21.15.132:0/1983074732 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48ac0d0cd0 0x7f48ac0b3a40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f48a40097d0 tx=0x7f48a402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=17c085c7621c1c2f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:22.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.484+0000 7f48b085e640 1 -- 172.21.15.132:0/1983074732 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4031890 con 0x7f48ac0d0cd0 2023-12-20T04:48:22.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.484+0000 7f48b085e640 1 -- 172.21.15.132:0/1983074732 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a40319f0 con 0x7f48ac0d0cd0 2023-12-20T04:48:22.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.484+0000 7f48b085e640 1 -- 172.21.15.132:0/1983074732 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4031d60 con 0x7f48ac0d0cd0 2023-12-20T04:48:22.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.485+0000 7f48b3ac4640 1 -- 172.21.15.132:0/1983074732 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48ac0d0cd0 msgr2=0x7f48ac0b3a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:22.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.485+0000 7f48b3ac4640 1 --2- 172.21.15.132:0/1983074732 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48ac0d0cd0 0x7f48ac0b3a40 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f48a40097d0 tx=0x7f48a402b930 comp rx=0 tx=0).stop 2023-12-20T04:48:22.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.485+0000 7f48b3ac4640 1 -- 172.21.15.132:0/1983074732 shutdown_connections 2023-12-20T04:48:22.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.485+0000 7f48b3ac4640 1 --2- 172.21.15.132:0/1983074732 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48ac0d0cd0 0x7f48ac0b3a40 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.485+0000 7f48b3ac4640 1 -- 172.21.15.132:0/1983074732 >> 172.21.15.132:0/1983074732 conn(0x7f48ac09c1d0 msgr2=0x7f48ac0d2ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:22.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.485+0000 7f48b3ac4640 1 -- 172.21.15.132:0/1983074732 shutdown_connections 2023-12-20T04:48:22.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.485+0000 7f48b3ac4640 1 -- 172.21.15.132:0/1983074732 wait complete. 2023-12-20T04:48:22.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.486+0000 7f48b3ac4640 1 Processor -- start 2023-12-20T04:48:22.489 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.486+0000 7f48b3ac4640 1 -- start start 2023-12-20T04:48:22.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b3ac4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48ac0ce5a0 0x7f48ac1f66a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:22.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b3ac4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48ac0d0cd0 0x7f48ac0cce10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:22.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b3ac4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48ac0d14d0 0x7f48ac0c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:22.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b3ac4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac0c7160 con 0x7f48ac0d14d0 2023-12-20T04:48:22.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b3ac4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac1f6be0 con 0x7f48ac0ce5a0 2023-12-20T04:48:22.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b3ac4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f48ac0c7a60 con 0x7f48ac0d0cd0 2023-12-20T04:48:22.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b2061640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48ac0d14d0 0x7f48ac0c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b2061640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48ac0d14d0 0x7f48ac0c92c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34354/0 (socket says 172.21.15.132:34354) 2023-12-20T04:48:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b2061640 1 -- 172.21.15.132:0/3313294985 learned_addr learned my addr 172.21.15.132:0/3313294985 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b105f640 1 --2- 172.21.15.132:0/3313294985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48ac0d0cd0 0x7f48ac0cce10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b1860640 1 --2- 172.21.15.132:0/3313294985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48ac0ce5a0 0x7f48ac1f66a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b2061640 1 -- 172.21.15.132:0/3313294985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48ac0d0cd0 msgr2=0x7f48ac0cce10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b2061640 1 --2- 172.21.15.132:0/3313294985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48ac0d0cd0 0x7f48ac0cce10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b2061640 1 -- 172.21.15.132:0/3313294985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48ac0ce5a0 msgr2=0x7f48ac1f66a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b2061640 1 --2- 172.21.15.132:0/3313294985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48ac0ce5a0 0x7f48ac1f66a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b2061640 1 -- 172.21.15.132:0/3313294985 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f48a4009400 con 0x7f48ac0d14d0 2023-12-20T04:48:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b1860640 1 --2- 172.21.15.132:0/3313294985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48ac0ce5a0 0x7f48ac1f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b2061640 1 --2- 172.21.15.132:0/3313294985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48ac0d14d0 0x7f48ac0c92c0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f48a402b970 tx=0x7f48a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48aa7fc640 1 -- 172.21.15.132:0/3313294985 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a403bbf0 con 0x7f48ac0d14d0 2023-12-20T04:48:22.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48aa7fc640 1 -- 172.21.15.132:0/3313294985 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f48a403bd50 con 0x7f48ac0d14d0 2023-12-20T04:48:22.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b3ac4640 1 -- 172.21.15.132:0/3313294985 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f48ac0c7d40 con 0x7f48ac0d14d0 2023-12-20T04:48:22.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48aa7fc640 1 -- 172.21.15.132:0/3313294985 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48a4045610 con 0x7f48ac0d14d0 2023-12-20T04:48:22.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.487+0000 7f48b3ac4640 1 -- 172.21.15.132:0/3313294985 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48ac0c8300 con 0x7f48ac0d14d0 2023-12-20T04:48:22.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.489+0000 7f48b3ac4640 1 -- 172.21.15.132:0/3313294985 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f48ac04e840 con 0x7f48ac0d14d0 2023-12-20T04:48:22.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.489+0000 7f48aa7fc640 1 -- 172.21.15.132:0/3313294985 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f48a404e430 con 0x7f48ac0d14d0 2023-12-20T04:48:22.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.489+0000 7f48aa7fc640 1 --2- 172.21.15.132:0/3313294985 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f489806a460 0x7f489806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:22.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.489+0000 7f48b1860640 1 --2- 172.21.15.132:0/3313294985 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f489806a460 0x7f489806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:22.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.490+0000 7f48aa7fc640 1 -- 172.21.15.132:0/3313294985 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f48a40aae40 con 0x7f48ac0d14d0 2023-12-20T04:48:22.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.490+0000 7f48b1860640 1 --2- 172.21.15.132:0/3313294985 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f489806a460 0x7f489806c920 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f489c001d70 tx=0x7f489c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:22.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.494+0000 7f48aa7fc640 1 -- 172.21.15.132:0/3313294985 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f48a40764c0 con 0x7f48ac0d14d0 2023-12-20T04:48:22.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.670+0000 7f48b3ac4640 1 -- 172.21.15.132:0/3313294985 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f48ac0d12b0 con 0x7f48ac0d14d0 2023-12-20T04:48:22.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.671+0000 7f48aa7fc640 1 -- 172.21.15.132:0/3313294985 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v125) v1 ==== 80+0+0 (secure 0 0 0) 0x7f48a4006e10 con 0x7f48ac0d14d0 2023-12-20T04:48:22.672 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:48:22.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.672+0000 7f48b3ac4640 1 -- 172.21.15.132:0/3313294985 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f489806a460 msgr2=0x7f489806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:22.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.672+0000 7f48b3ac4640 1 --2- 172.21.15.132:0/3313294985 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f489806a460 0x7f489806c920 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f489c001d70 tx=0x7f489c009040 comp rx=0 tx=0).stop 2023-12-20T04:48:22.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.672+0000 7f48b3ac4640 1 -- 172.21.15.132:0/3313294985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48ac0d14d0 msgr2=0x7f48ac0c92c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:22.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.672+0000 7f48b3ac4640 1 --2- 172.21.15.132:0/3313294985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48ac0d14d0 0x7f48ac0c92c0 secure :-1 s=READY pgs=1260 cs=0 l=1 rev1=1 crypto rx=0x7f48a402b970 tx=0x7f48a40046c0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.673+0000 7f48b3ac4640 1 -- 172.21.15.132:0/3313294985 shutdown_connections 2023-12-20T04:48:22.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.673+0000 7f48b3ac4640 1 --2- 172.21.15.132:0/3313294985 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f489806a460 0x7f489806c920 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.673+0000 7f48b3ac4640 1 --2- 172.21.15.132:0/3313294985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48ac0d14d0 0x7f48ac0c92c0 unknown :-1 s=CLOSED pgs=1260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.673+0000 7f48b3ac4640 1 --2- 172.21.15.132:0/3313294985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f48ac0d0cd0 0x7f48ac0cce10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.673+0000 7f48b3ac4640 1 --2- 172.21.15.132:0/3313294985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48ac0ce5a0 0x7f48ac1f66a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:22.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.673+0000 7f48b3ac4640 1 -- 172.21.15.132:0/3313294985 >> 172.21.15.132:0/3313294985 conn(0x7f48ac09c1d0 msgr2=0x7f48ac15c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:22.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.673+0000 7f48b3ac4640 1 -- 172.21.15.132:0/3313294985 shutdown_connections 2023-12-20T04:48:22.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:22.673+0000 7f48b3ac4640 1 -- 172.21.15.132:0/3313294985 wait complete. 2023-12-20T04:48:22.685 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi187.front.sepia.ceph.com... 2023-12-20T04:48:22.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:22.686 DEBUG:teuthology.orchestra.run.smithi187:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-20T04:48:22.716 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[89982]: fuse finished with error 0 and tester_r 0 2023-12-20T04:48:22.718 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:48:22.718 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:22.718 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-20T04:48:22.889 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:48:22.889 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:48:22.904 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:48:22.904 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:48:22.904 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:22.904 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-20T04:48:22.959 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:48:22.960 INFO:teuthology.orchestra.run.smithi132.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-20T04:48:22.960 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:48:22.960 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:48:22.977 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:48:22.978 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:48:22.978 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:22.978 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-20T04:48:23.033 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:48:23.033 INFO:teuthology.orchestra.run.smithi187.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-20T04:48:23.034 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:48:23.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.131+0000 7fac59677640 1 Processor -- start 2023-12-20T04:48:23.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.131+0000 7fac59677640 1 -- start start 2023-12-20T04:48:23.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.132+0000 7fac59677640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fac540b4980 0x7fac540b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.132+0000 7fac59677640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac540b5320 con 0x7fac540d1aa0 2023-12-20T04:48:23.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.132+0000 7fac59677640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fac540b5ec0 con 0x7fac54160450 2023-12-20T04:48:23.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.132+0000 7fac59677640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fac541617e0 con 0x7fac540b4980 2023-12-20T04:48:23.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.132+0000 7fac537fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fac540d1aa0 0x7fac540d1ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57176/0 (socket says 172.21.15.132:57176) 2023-12-20T04:48:23.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.132+0000 7fac537fe640 1 -- 172.21.15.132:0/4053610261 learned_addr learned my addr 172.21.15.132:0/4053610261 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:23.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.132+0000 7fac527fc640 1 --2- 172.21.15.132:0/4053610261 >> v2:172.21.15.187:3300/0 conn(0x7fac540b4980 0x7fac540b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.132+0000 7fac51ffb640 1 -- 172.21.15.132:0/4053610261 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2971721693 0 0) 0x7fac540b5320 con 0x7fac540d1aa0 2023-12-20T04:48:23.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.132+0000 7fac51ffb640 1 -- 172.21.15.132:0/4053610261 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac3c003520 con 0x7fac540d1aa0 2023-12-20T04:48:23.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.132+0000 7fac51ffb640 1 -- 172.21.15.132:0/4053610261 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2836780916 0 0) 0x7fac540b5ec0 con 0x7fac54160450 2023-12-20T04:48:23.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.133+0000 7fac51ffb640 1 -- 172.21.15.132:0/4053610261 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fac540b5320 con 0x7fac54160450 2023-12-20T04:48:23.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.133+0000 7fac51ffb640 1 -- 172.21.15.132:0/4053610261 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3411264641 0 0) 0x7fac3c003520 con 0x7fac540d1aa0 2023-12-20T04:48:23.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.133+0000 7fac527fc640 1 -- 172.21.15.132:0/4053610261 >> v1:172.21.15.187:6789/0 conn(0x7fac54160450 legacy=0x7fac54160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.133+0000 7fac527fc640 1 -- 172.21.15.132:0/4053610261 >> v1:172.21.15.132:6789/0 conn(0x7fac540d1aa0 legacy=0x7fac540d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.133+0000 7fac527fc640 1 -- 172.21.15.132:0/4053610261 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac540d0fc0 con 0x7fac540b4980 2023-12-20T04:48:23.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.133+0000 7fac527fc640 1 --2- 172.21.15.132:0/4053610261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac540b4980 0x7fac540b4de0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fac480097a0 tx=0x7fac4802b8b0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40e9c702e46b1767 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:23.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.134+0000 7fac51ffb640 1 -- 172.21.15.132:0/4053610261 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c0019f0 con 0x7fac540b4980 2023-12-20T04:48:23.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.134+0000 7fac51ffb640 1 -- 172.21.15.132:0/4053610261 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac48031590 con 0x7fac540b4980 2023-12-20T04:48:23.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.134+0000 7fac51ffb640 1 -- 172.21.15.132:0/4053610261 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac48031920 con 0x7fac540b4980 2023-12-20T04:48:23.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.134+0000 7fac59677640 1 -- 172.21.15.132:0/4053610261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac540b4980 msgr2=0x7fac540b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.134+0000 7fac59677640 1 --2- 172.21.15.132:0/4053610261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac540b4980 0x7fac540b4de0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fac480097a0 tx=0x7fac4802b8b0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.134+0000 7fac59677640 1 -- 172.21.15.132:0/4053610261 shutdown_connections 2023-12-20T04:48:23.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.134+0000 7fac59677640 1 --2- 172.21.15.132:0/4053610261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac540b4980 0x7fac540b4de0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.134+0000 7fac59677640 1 -- 172.21.15.132:0/4053610261 >> 172.21.15.132:0/4053610261 conn(0x7fac540cf980 msgr2=0x7fac540cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:23.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.134+0000 7fac59677640 1 -- 172.21.15.132:0/4053610261 shutdown_connections 2023-12-20T04:48:23.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.134+0000 7fac59677640 1 -- 172.21.15.132:0/4053610261 wait complete. 2023-12-20T04:48:23.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.135+0000 7fac59677640 1 Processor -- start 2023-12-20T04:48:23.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.135+0000 7fac59677640 1 -- start start 2023-12-20T04:48:23.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.136+0000 7fac59677640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac540b4980 0x7fac5415e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.136+0000 7fac59677640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac540d1aa0 0x7fac5414b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.136+0000 7fac59677640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac54160450 0x7fac540cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.136+0000 7fac59677640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5414b960 con 0x7fac54160450 2023-12-20T04:48:23.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.136+0000 7fac59677640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac5415ecb0 con 0x7fac540b4980 2023-12-20T04:48:23.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.136+0000 7fac59677640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fac5415ef90 con 0x7fac540d1aa0 2023-12-20T04:48:23.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.136+0000 7fac537fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac54160450 0x7fac540cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.136+0000 7fac537fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac54160450 0x7fac540cb330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34358/0 (socket says 172.21.15.132:34358) 2023-12-20T04:48:23.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.136+0000 7fac537fe640 1 -- 172.21.15.132:0/2633486218 learned_addr learned my addr 172.21.15.132:0/2633486218 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:23.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.137+0000 7fac527fc640 1 --2- 172.21.15.132:0/2633486218 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac540d1aa0 0x7fac5414b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.137+0000 7fac52ffd640 1 --2- 172.21.15.132:0/2633486218 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac540b4980 0x7fac5415e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.137+0000 7fac537fe640 1 -- 172.21.15.132:0/2633486218 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac540d1aa0 msgr2=0x7fac5414b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.137+0000 7fac537fe640 1 --2- 172.21.15.132:0/2633486218 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac540d1aa0 0x7fac5414b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.137+0000 7fac537fe640 1 -- 172.21.15.132:0/2633486218 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac540b4980 msgr2=0x7fac5415e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.137+0000 7fac537fe640 1 --2- 172.21.15.132:0/2633486218 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac540b4980 0x7fac5415e6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.137+0000 7fac537fe640 1 -- 172.21.15.132:0/2633486218 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac48009400 con 0x7fac54160450 2023-12-20T04:48:23.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.137+0000 7fac527fc640 1 --2- 172.21.15.132:0/2633486218 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac540d1aa0 0x7fac5414b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:23.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.137+0000 7fac537fe640 1 --2- 172.21.15.132:0/2633486218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac54160450 0x7fac540cb330 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fac4c002020 tx=0x7fac4c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:23.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.137+0000 7fac3b7fe640 1 -- 172.21.15.132:0/2633486218 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c012400 con 0x7fac54160450 2023-12-20T04:48:23.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.137+0000 7fac3b7fe640 1 -- 172.21.15.132:0/2633486218 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fac4c012560 con 0x7fac54160450 2023-12-20T04:48:23.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.137+0000 7fac59677640 1 -- 172.21.15.132:0/2633486218 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac5415f270 con 0x7fac54160450 2023-12-20T04:48:23.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.137+0000 7fac3b7fe640 1 -- 172.21.15.132:0/2633486218 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fac4c012910 con 0x7fac54160450 2023-12-20T04:48:23.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.137+0000 7fac59677640 1 -- 172.21.15.132:0/2633486218 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac5415f830 con 0x7fac54160450 2023-12-20T04:48:23.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.138+0000 7fac59677640 1 -- 172.21.15.132:0/2633486218 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac5415fa20 con 0x7fac54160450 2023-12-20T04:48:23.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.138+0000 7fac3b7fe640 1 -- 172.21.15.132:0/2633486218 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fac4c012a70 con 0x7fac54160450 2023-12-20T04:48:23.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.139+0000 7fac3b7fe640 1 --2- 172.21.15.132:0/2633486218 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fac4006a430 0x7fac4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.139+0000 7fac3b7fe640 1 -- 172.21.15.132:0/2633486218 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fac4c089110 con 0x7fac54160450 2023-12-20T04:48:23.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.139+0000 7fac52ffd640 1 --2- 172.21.15.132:0/2633486218 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fac4006a430 0x7fac4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.139+0000 7fac52ffd640 1 --2- 172.21.15.132:0/2633486218 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fac4006a430 0x7fac4006c8f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fac440010e0 tx=0x7fac44009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:23.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.143+0000 7fac3b7fe640 1 -- 172.21.15.132:0/2633486218 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fac4c054700 con 0x7fac54160450 2023-12-20T04:48:23.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.345+0000 7fac59677640 1 -- 172.21.15.132:0/2633486218 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fac5404e840 con 0x7fac54160450 2023-12-20T04:48:23.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.345+0000 7fac3b7fe640 1 -- 172.21.15.132:0/2633486218 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4723 (secure 0 0 0) 0x7fac4c057d20 con 0x7fac54160450 2023-12-20T04:48:23.347 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:23.347 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":45,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3951194420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3951194420},{"type":"v1","addr":"172.21.15.187:6833","nonce":3951194420}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1575999914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1575999914},{"type":"v1","addr":"172.21.15.187:6835","nonce":1575999914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2208233017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2208233017},{"type":"v1","addr":"172.21.15.132:6836","nonce":2208233017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:48:04.456610+0000","modified":"2023-12-20T04:48:07.132847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7422":{"gid":7422,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/3935356761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":3935356761},{"type":"v1","addr":"172.21.15.132:6837","nonce":3935356761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-20T04:48:23.347 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 45 2023-12-20T04:48:23.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.347+0000 7fac59677640 1 -- 172.21.15.132:0/2633486218 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fac4006a430 msgr2=0x7fac4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.347+0000 7fac59677640 1 --2- 172.21.15.132:0/2633486218 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fac4006a430 0x7fac4006c8f0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fac440010e0 tx=0x7fac44009040 comp rx=0 tx=0).stop 2023-12-20T04:48:23.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.347+0000 7fac59677640 1 -- 172.21.15.132:0/2633486218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac54160450 msgr2=0x7fac540cb330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.347+0000 7fac59677640 1 --2- 172.21.15.132:0/2633486218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac54160450 0x7fac540cb330 secure :-1 s=READY pgs=1262 cs=0 l=1 rev1=1 crypto rx=0x7fac4c002020 tx=0x7fac4c00a430 comp rx=0 tx=0).stop 2023-12-20T04:48:23.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.347+0000 7fac59677640 1 -- 172.21.15.132:0/2633486218 shutdown_connections 2023-12-20T04:48:23.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.347+0000 7fac59677640 1 --2- 172.21.15.132:0/2633486218 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fac4006a430 0x7fac4006c8f0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.347+0000 7fac59677640 1 --2- 172.21.15.132:0/2633486218 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fac54160450 0x7fac540cb330 unknown :-1 s=CLOSED pgs=1262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.347+0000 7fac59677640 1 --2- 172.21.15.132:0/2633486218 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fac540d1aa0 0x7fac5414b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.347+0000 7fac59677640 1 --2- 172.21.15.132:0/2633486218 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fac540b4980 0x7fac5415e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.347+0000 7fac59677640 1 -- 172.21.15.132:0/2633486218 >> 172.21.15.132:0/2633486218 conn(0x7fac540cf980 msgr2=0x7fac5406a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:23.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.347+0000 7fac59677640 1 -- 172.21.15.132:0/2633486218 shutdown_connections 2023-12-20T04:48:23.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.347+0000 7fac59677640 1 -- 172.21.15.132:0/2633486218 wait complete. 2023-12-20T04:48:23.360 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:48:23.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.458+0000 7f2b0e3d2640 1 Processor -- start 2023-12-20T04:48:23.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.458+0000 7f2b0e3d2640 1 -- start start 2023-12-20T04:48:23.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.459+0000 7f2b0e3d2640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2b080b4980 0x7f2b080b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.459+0000 7f2b0e3d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b080d1aa0 0x7f2b080d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.459+0000 7f2b0e3d2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b080b5320 con 0x7f2b08160450 2023-12-20T04:48:23.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.459+0000 7f2b0e3d2640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2b080b5ec0 con 0x7f2b080b4980 2023-12-20T04:48:23.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.459+0000 7f2b0e3d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b081617e0 con 0x7f2b080d1aa0 2023-12-20T04:48:23.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.459+0000 7f2b07fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2b08160450 0x7f2b08160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57184/0 (socket says 172.21.15.132:57184) 2023-12-20T04:48:23.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.459+0000 7f2b07fff640 1 -- 172.21.15.132:0/393811332 learned_addr learned my addr 172.21.15.132:0/393811332 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:23.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.459+0000 7f2b06ffd640 1 -- 172.21.15.132:0/393811332 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3192154972 0 0) 0x7f2b080b5320 con 0x7f2b08160450 2023-12-20T04:48:23.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.459+0000 7f2b077fe640 1 --2- 172.21.15.132:0/393811332 >> v2:172.21.15.187:3300/0 conn(0x7f2b080b4980 0x7f2b080b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.459+0000 7f2b0c96f640 1 --2- 172.21.15.132:0/393811332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b080d1aa0 0x7f2b080d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.459+0000 7f2b06ffd640 1 -- 172.21.15.132:0/393811332 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2af0003520 con 0x7f2b08160450 2023-12-20T04:48:23.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b06ffd640 1 -- 172.21.15.132:0/393811332 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1884925168 0 0) 0x7f2af0003520 con 0x7f2b08160450 2023-12-20T04:48:23.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b06ffd640 1 -- 172.21.15.132:0/393811332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b080d1aa0 msgr2=0x7f2b080d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:23.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b06ffd640 1 --2- 172.21.15.132:0/393811332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b080d1aa0 0x7f2b080d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b06ffd640 1 -- 172.21.15.132:0/393811332 >> v2:172.21.15.187:3300/0 conn(0x7f2b080b4980 msgr2=0x7f2b080b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:23.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b06ffd640 1 --2- 172.21.15.132:0/393811332 >> v2:172.21.15.187:3300/0 conn(0x7f2b080b4980 0x7f2b080b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b06ffd640 1 -- 172.21.15.132:0/393811332 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b080d0fc0 con 0x7f2b08160450 2023-12-20T04:48:23.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b06ffd640 1 -- 172.21.15.132:0/393811332 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f2af8001690 con 0x7f2b08160450 2023-12-20T04:48:23.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b06ffd640 1 -- 172.21.15.132:0/393811332 >> v1:172.21.15.132:6789/0 conn(0x7f2b08160450 legacy=0x7f2b08160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b06ffd640 1 --2- 172.21.15.132:0/393811332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2af0003970 0x7f2af0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b06ffd640 1 --2- 172.21.15.132:0/393811332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af00047c0 0x7f2af0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b06ffd640 1 --2- 172.21.15.132:0/393811332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b080d1aa0 0x7f2af0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b06ffd640 1 -- 172.21.15.132:0/393811332 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080b5ec0 con 0x7f2af0003970 2023-12-20T04:48:23.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b06ffd640 1 -- 172.21.15.132:0/393811332 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b081617e0 con 0x7f2af00047c0 2023-12-20T04:48:23.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b06ffd640 1 -- 172.21.15.132:0/393811332 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2af000b980 con 0x7f2b080d1aa0 2023-12-20T04:48:23.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b07fff640 1 --2- 172.21.15.132:0/393811332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2af0003970 0x7f2af0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b077fe640 1 --2- 172.21.15.132:0/393811332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af00047c0 0x7f2af0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b0c96f640 1 --2- 172.21.15.132:0/393811332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b080d1aa0 0x7f2af0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b07fff640 1 -- 172.21.15.132:0/393811332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b080d1aa0 msgr2=0x7f2af0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:23.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b07fff640 1 --2- 172.21.15.132:0/393811332 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b080d1aa0 0x7f2af0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b07fff640 1 -- 172.21.15.132:0/393811332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af00047c0 msgr2=0x7f2af0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:23.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b07fff640 1 --2- 172.21.15.132:0/393811332 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2af00047c0 0x7f2af0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.460+0000 7f2b07fff640 1 -- 172.21.15.132:0/393811332 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2af0003520 con 0x7f2af0003970 2023-12-20T04:48:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.461+0000 7f2b07fff640 1 --2- 172.21.15.132:0/393811332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2af0003970 0x7f2af0003d90 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f2af800c210 tx=0x7f2af00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c80fee04fb6aba26 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.461+0000 7f2b06ffd640 1 -- 172.21.15.132:0/393811332 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8005ad0 con 0x7f2af0003970 2023-12-20T04:48:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.461+0000 7f2b06ffd640 1 -- 172.21.15.132:0/393811332 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af8005c30 con 0x7f2af0003970 2023-12-20T04:48:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.461+0000 7f2b06ffd640 1 -- 172.21.15.132:0/393811332 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af802c8b0 con 0x7f2af0003970 2023-12-20T04:48:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.462+0000 7f2b0e3d2640 1 -- 172.21.15.132:0/393811332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2af0003970 msgr2=0x7f2af0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.462+0000 7f2b0e3d2640 1 --2- 172.21.15.132:0/393811332 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2af0003970 0x7f2af0003d90 secure :-1 s=READY pgs=1264 cs=0 l=1 rev1=1 crypto rx=0x7f2af800c210 tx=0x7f2af00057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.462+0000 7f2b0c96f640 1 -- 172.21.15.132:0/393811332 reap_dead start 2023-12-20T04:48:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.462+0000 7f2b0e3d2640 1 -- 172.21.15.132:0/393811332 shutdown_connections 2023-12-20T04:48:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.462+0000 7f2b0e3d2640 1 -- 172.21.15.132:0/393811332 >> 172.21.15.132:0/393811332 conn(0x7f2b080cf980 msgr2=0x7f2b080cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.462+0000 7f2b0e3d2640 1 -- 172.21.15.132:0/393811332 shutdown_connections 2023-12-20T04:48:23.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.462+0000 7f2b0e3d2640 1 -- 172.21.15.132:0/393811332 wait complete. 2023-12-20T04:48:23.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.463+0000 7f2b0e3d2640 1 Processor -- start 2023-12-20T04:48:23.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.463+0000 7f2b0e3d2640 1 -- start start 2023-12-20T04:48:23.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b0e3d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2af0003970 0x7f2b0815a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b0e3d2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b08154090 0x7f2b080c8a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b0e3d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b08154d00 0x7f2b080cc1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b0e3d2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b08154510 con 0x7f2af0003970 2023-12-20T04:48:23.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b0e3d2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b080c8fc0 con 0x7f2b08154090 2023-12-20T04:48:23.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b0e3d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b08153030 con 0x7f2b08154d00 2023-12-20T04:48:23.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b07fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2af0003970 0x7f2b0815a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b07fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2af0003970 0x7f2b0815a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34364/0 (socket says 172.21.15.132:34364) 2023-12-20T04:48:23.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b07fff640 1 -- 172.21.15.132:0/3531128582 learned_addr learned my addr 172.21.15.132:0/3531128582 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:23.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b0c96f640 1 --2- 172.21.15.132:0/3531128582 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b08154d00 0x7f2b080cc1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b077fe640 1 --2- 172.21.15.132:0/3531128582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b08154090 0x7f2b080c8a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b07fff640 1 -- 172.21.15.132:0/3531128582 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b08154d00 msgr2=0x7f2b080cc1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b07fff640 1 --2- 172.21.15.132:0/3531128582 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b08154d00 0x7f2b080cc1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b07fff640 1 -- 172.21.15.132:0/3531128582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b08154090 msgr2=0x7f2b080c8a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b07fff640 1 --2- 172.21.15.132:0/3531128582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b08154090 0x7f2b080c8a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b07fff640 1 -- 172.21.15.132:0/3531128582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b081532d0 con 0x7f2af0003970 2023-12-20T04:48:23.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b07fff640 1 --2- 172.21.15.132:0/3531128582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2af0003970 0x7f2b0815a5a0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f2af802c450 tx=0x7f2af8001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:23.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b04ff9640 1 -- 172.21.15.132:0/3531128582 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af8039070 con 0x7f2af0003970 2023-12-20T04:48:23.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b04ff9640 1 -- 172.21.15.132:0/3531128582 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2af802dd70 con 0x7f2af0003970 2023-12-20T04:48:23.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b0e3d2640 1 -- 172.21.15.132:0/3531128582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b081535b0 con 0x7f2af0003970 2023-12-20T04:48:23.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.464+0000 7f2b04ff9640 1 -- 172.21.15.132:0/3531128582 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2af80072b0 con 0x7f2af0003970 2023-12-20T04:48:23.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.465+0000 7f2b0e3d2640 1 -- 172.21.15.132:0/3531128582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b08153b70 con 0x7f2af0003970 2023-12-20T04:48:23.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.465+0000 7f2b0e3d2640 1 -- 172.21.15.132:0/3531128582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b0804e840 con 0x7f2af0003970 2023-12-20T04:48:23.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.466+0000 7f2b04ff9640 1 -- 172.21.15.132:0/3531128582 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2af8032070 con 0x7f2af0003970 2023-12-20T04:48:23.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.466+0000 7f2b04ff9640 1 --2- 172.21.15.132:0/3531128582 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2af406a430 0x7f2af406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.466+0000 7f2b077fe640 1 --2- 172.21.15.132:0/3531128582 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2af406a430 0x7f2af406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.466+0000 7f2b04ff9640 1 -- 172.21.15.132:0/3531128582 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2af803c040 con 0x7f2af0003970 2023-12-20T04:48:23.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.467+0000 7f2b077fe640 1 --2- 172.21.15.132:0/3531128582 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2af406a430 0x7f2af406c8f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2b08154960 tx=0x7f2afc009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:23.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.471+0000 7f2b04ff9640 1 -- 172.21.15.132:0/3531128582 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2af8075430 con 0x7f2af0003970 2023-12-20T04:48:23.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.636+0000 7f2b0e3d2640 1 -- 172.21.15.132:0/3531128582 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f2b080d1270 con 0x7f2af0003970 2023-12-20T04:48:23.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.638+0000 7f2b04ff9640 1 -- 172.21.15.132:0/3531128582 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16107 (secure 0 0 0) 0x7f2af8045090 con 0x7f2af0003970 2023-12-20T04:48:23.639 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:23.640 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":125,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:48:16.867874+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:48:02.660300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-20T04:48:03.433311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:48:23.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.639+0000 7f2b0e3d2640 1 -- 172.21.15.132:0/3531128582 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2af406a430 msgr2=0x7f2af406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.639+0000 7f2b0e3d2640 1 --2- 172.21.15.132:0/3531128582 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2af406a430 0x7f2af406c8f0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f2b08154960 tx=0x7f2afc009190 comp rx=0 tx=0).stop 2023-12-20T04:48:23.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.639+0000 7f2b0e3d2640 1 -- 172.21.15.132:0/3531128582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2af0003970 msgr2=0x7f2b0815a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.639+0000 7f2b0e3d2640 1 --2- 172.21.15.132:0/3531128582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2af0003970 0x7f2b0815a5a0 secure :-1 s=READY pgs=1265 cs=0 l=1 rev1=1 crypto rx=0x7f2af802c450 tx=0x7f2af8001a20 comp rx=0 tx=0).stop 2023-12-20T04:48:23.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.639+0000 7f2b0e3d2640 1 -- 172.21.15.132:0/3531128582 shutdown_connections 2023-12-20T04:48:23.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.639+0000 7f2b0e3d2640 1 --2- 172.21.15.132:0/3531128582 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2af406a430 0x7f2af406c8f0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.639+0000 7f2b0e3d2640 1 --2- 172.21.15.132:0/3531128582 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b08154d00 0x7f2b080cc1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.639+0000 7f2b0e3d2640 1 --2- 172.21.15.132:0/3531128582 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b08154090 0x7f2b080c8a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.639+0000 7f2b0e3d2640 1 --2- 172.21.15.132:0/3531128582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2af0003970 0x7f2b0815a5a0 unknown :-1 s=CLOSED pgs=1265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.639+0000 7f2b0e3d2640 1 -- 172.21.15.132:0/3531128582 >> 172.21.15.132:0/3531128582 conn(0x7f2b080cf980 msgr2=0x7f2b080b6360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:23.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.640+0000 7f2b0e3d2640 1 -- 172.21.15.132:0/3531128582 shutdown_connections 2023-12-20T04:48:23.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.640+0000 7f2b0e3d2640 1 -- 172.21.15.132:0/3531128582 wait complete. 2023-12-20T04:48:23.653 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 14, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:48:02.660300+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '121', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2.5, 'score_stable': 2.5, 'optimal_score': 1, 'raw_score_acting': 2.5, 'raw_score_stable': 2.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 15, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:48:03.433311+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '123', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:48:23.653 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:48:23.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.753+0000 7f6dde577640 1 Processor -- start 2023-12-20T04:48:23.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.753+0000 7f6dde577640 1 -- start start 2023-12-20T04:48:23.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.754+0000 7f6dde577640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6dd8069c30 0x7f6dd8070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.754+0000 7f6dde577640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dd80cbde0 0x7f6dd80ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.754+0000 7f6dde577640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6dd80c4f40 con 0x7f6dd815d360 2023-12-20T04:48:23.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.754+0000 7f6dde577640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6dd80af5b0 con 0x7f6dd8069c30 2023-12-20T04:48:23.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.754+0000 7f6dde577640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd8070a40 con 0x7f6dd80cbde0 2023-12-20T04:48:23.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.754+0000 7f6dd7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6dd8069c30 0x7f6dd8070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.754+0000 7f6dd7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6dd8069c30 0x7f6dd8070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34374/0 (socket says 172.21.15.132:34374) 2023-12-20T04:48:23.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.754+0000 7f6dd7fff640 1 -- 172.21.15.132:0/1997435316 learned_addr learned my addr 172.21.15.132:0/1997435316 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:23.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.755+0000 7f6dd7fff640 1 -- 172.21.15.132:0/1997435316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dd80cbde0 msgr2=0x7f6dd80ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:23.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.755+0000 7f6ddcb14640 1 --2- 172.21.15.132:0/1997435316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dd80cbde0 0x7f6dd80ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.755+0000 7f6dd7fff640 1 --2- 172.21.15.132:0/1997435316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dd80cbde0 0x7f6dd80ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.755+0000 7f6dd7fff640 1 -- 172.21.15.132:0/1997435316 >> v1:172.21.15.187:6789/0 conn(0x7f6dd815d360 legacy=0x7f6dd806a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:23.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.755+0000 7f6dd7fff640 1 -- 172.21.15.132:0/1997435316 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd8070d20 con 0x7f6dd8069c30 2023-12-20T04:48:23.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.755+0000 7f6dd7fff640 1 --2- 172.21.15.132:0/1997435316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dd8069c30 0x7f6dd8070460 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009870 tx=0x7f6dc802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=20f8e707662c0224 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:23.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.755+0000 7f6dd6ffd640 1 -- 172.21.15.132:0/1997435316 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8031640 con 0x7f6dd8069c30 2023-12-20T04:48:23.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.756+0000 7f6dd6ffd640 1 -- 172.21.15.132:0/1997435316 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dc80317a0 con 0x7f6dd8069c30 2023-12-20T04:48:23.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.756+0000 7f6dd6ffd640 1 -- 172.21.15.132:0/1997435316 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dc8031b30 con 0x7f6dd8069c30 2023-12-20T04:48:23.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.756+0000 7f6dde577640 1 -- 172.21.15.132:0/1997435316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dd8069c30 msgr2=0x7f6dd8070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.756+0000 7f6dde577640 1 --2- 172.21.15.132:0/1997435316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dd8069c30 0x7f6dd8070460 secure :-1 s=READY pgs=1266 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8009870 tx=0x7f6dc802b8f0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.756+0000 7f6dde577640 1 -- 172.21.15.132:0/1997435316 shutdown_connections 2023-12-20T04:48:23.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.756+0000 7f6dde577640 1 --2- 172.21.15.132:0/1997435316 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dd80cbde0 0x7f6dd80ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.756+0000 7f6dde577640 1 --2- 172.21.15.132:0/1997435316 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dd8069c30 0x7f6dd8070460 unknown :-1 s=CLOSED pgs=1266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.756+0000 7f6dde577640 1 -- 172.21.15.132:0/1997435316 >> 172.21.15.132:0/1997435316 conn(0x7f6dd80cc630 msgr2=0x7f6dd80cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:23.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.756+0000 7f6dde577640 1 -- 172.21.15.132:0/1997435316 shutdown_connections 2023-12-20T04:48:23.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.756+0000 7f6dde577640 1 -- 172.21.15.132:0/1997435316 wait complete. 2023-12-20T04:48:23.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.757+0000 7f6dde577640 1 Processor -- start 2023-12-20T04:48:23.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.757+0000 7f6dde577640 1 -- start start 2023-12-20T04:48:23.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.758+0000 7f6dde577640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dd8069c30 0x7f6dd80c5640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.758+0000 7f6dde577640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dd80cbde0 0x7f6dd80b2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.758+0000 7f6dde577640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dd815d360 0x7f6dd80b2ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.758+0000 7f6dde577640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80b4760 con 0x7f6dd80cbde0 2023-12-20T04:48:23.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.758+0000 7f6dde577640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80b3530 con 0x7f6dd8069c30 2023-12-20T04:48:23.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.758+0000 7f6dde577640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6dd80b3800 con 0x7f6dd815d360 2023-12-20T04:48:23.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.758+0000 7f6dd77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dd80cbde0 0x7f6dd80b2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.758+0000 7f6dd77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dd80cbde0 0x7f6dd80b2ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34390/0 (socket says 172.21.15.132:34390) 2023-12-20T04:48:23.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.758+0000 7f6dd77fe640 1 -- 172.21.15.132:0/2525093266 learned_addr learned my addr 172.21.15.132:0/2525093266 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:23.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.758+0000 7f6dd77fe640 1 -- 172.21.15.132:0/2525093266 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dd815d360 msgr2=0x7f6dd80b2ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.758+0000 7f6dd77fe640 1 --2- 172.21.15.132:0/2525093266 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dd815d360 0x7f6dd80b2ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.758+0000 7f6dd77fe640 1 -- 172.21.15.132:0/2525093266 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dd8069c30 msgr2=0x7f6dd80c5640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.758+0000 7f6dd77fe640 1 --2- 172.21.15.132:0/2525093266 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dd8069c30 0x7f6dd80c5640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.758+0000 7f6dd77fe640 1 -- 172.21.15.132:0/2525093266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dc80094d0 con 0x7f6dd80cbde0 2023-12-20T04:48:23.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.759+0000 7f6dd77fe640 1 --2- 172.21.15.132:0/2525093266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dd80cbde0 0x7f6dd80b2ab0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00b3f0 tx=0x7f6dcc00b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:23.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.759+0000 7f6dd4ff9640 1 -- 172.21.15.132:0/2525093266 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc011830 con 0x7f6dd80cbde0 2023-12-20T04:48:23.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.759+0000 7f6dd4ff9640 1 -- 172.21.15.132:0/2525093266 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6dcc011990 con 0x7f6dd80cbde0 2023-12-20T04:48:23.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.759+0000 7f6dde577640 1 -- 172.21.15.132:0/2525093266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6dd80b3ae0 con 0x7f6dd80cbde0 2023-12-20T04:48:23.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.759+0000 7f6dd4ff9640 1 -- 172.21.15.132:0/2525093266 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6dcc011d40 con 0x7f6dd80cbde0 2023-12-20T04:48:23.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.759+0000 7f6dde577640 1 -- 172.21.15.132:0/2525093266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6dd80b4380 con 0x7f6dd80cbde0 2023-12-20T04:48:23.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.760+0000 7f6dde577640 1 -- 172.21.15.132:0/2525093266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6dd80b45a0 con 0x7f6dd80cbde0 2023-12-20T04:48:23.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.760+0000 7f6dd4ff9640 1 -- 172.21.15.132:0/2525093266 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6dcc01a400 con 0x7f6dd80cbde0 2023-12-20T04:48:23.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.761+0000 7f6dd4ff9640 1 --2- 172.21.15.132:0/2525093266 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6dc406a430 0x7f6dc406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:23.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.761+0000 7f6dd4ff9640 1 -- 172.21.15.132:0/2525093266 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6dcc0887d0 con 0x7f6dd80cbde0 2023-12-20T04:48:23.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.761+0000 7f6dd7fff640 1 --2- 172.21.15.132:0/2525093266 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6dc406a430 0x7f6dc406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:23.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.761+0000 7f6dd7fff640 1 --2- 172.21.15.132:0/2525093266 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6dc406a430 0x7f6dc406c8f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8036000 tx=0x7f6dc8030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:23.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.765+0000 7f6dd4ff9640 1 -- 172.21.15.132:0/2525093266 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6dcc053dc0 con 0x7f6dd80cbde0 2023-12-20T04:48:23.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.931+0000 7f6dde577640 1 -- 172.21.15.132:0/2525093266 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6dd80b3cd0 con 0x7f6dd80cbde0 2023-12-20T04:48:23.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.932+0000 7f6dd4ff9640 1 -- 172.21.15.132:0/2525093266 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v125) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6dcc0150a0 con 0x7f6dd80cbde0 2023-12-20T04:48:23.934 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:48:23.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.933+0000 7f6dde577640 1 -- 172.21.15.132:0/2525093266 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6dc406a430 msgr2=0x7f6dc406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.933+0000 7f6dde577640 1 --2- 172.21.15.132:0/2525093266 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6dc406a430 0x7f6dc406c8f0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f6dc8036000 tx=0x7f6dc8030000 comp rx=0 tx=0).stop 2023-12-20T04:48:23.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.934+0000 7f6dde577640 1 -- 172.21.15.132:0/2525093266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dd80cbde0 msgr2=0x7f6dd80b2ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:23.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.934+0000 7f6dde577640 1 --2- 172.21.15.132:0/2525093266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dd80cbde0 0x7f6dd80b2ab0 secure :-1 s=READY pgs=1267 cs=0 l=1 rev1=1 crypto rx=0x7f6dcc00b3f0 tx=0x7f6dcc00b8b0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.934+0000 7f6dde577640 1 -- 172.21.15.132:0/2525093266 shutdown_connections 2023-12-20T04:48:23.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.934+0000 7f6dde577640 1 --2- 172.21.15.132:0/2525093266 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6dc406a430 0x7f6dc406c8f0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.934+0000 7f6dde577640 1 --2- 172.21.15.132:0/2525093266 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6dd815d360 0x7f6dd80b2ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.934+0000 7f6dde577640 1 --2- 172.21.15.132:0/2525093266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6dd80cbde0 0x7f6dd80b2ab0 unknown :-1 s=CLOSED pgs=1267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.934+0000 7f6dde577640 1 --2- 172.21.15.132:0/2525093266 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6dd8069c30 0x7f6dd80c5640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:23.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.934+0000 7f6dde577640 1 -- 172.21.15.132:0/2525093266 >> 172.21.15.132:0/2525093266 conn(0x7f6dd80cc630 msgr2=0x7f6dd80b0ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:23.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.934+0000 7f6dde577640 1 -- 172.21.15.132:0/2525093266 shutdown_connections 2023-12-20T04:48:23.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:23.934+0000 7f6dde577640 1 -- 172.21.15.132:0/2525093266 wait complete. 2023-12-20T04:48:23.947 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:48:24.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.047+0000 7fe4ccc82640 1 Processor -- start 2023-12-20T04:48:24.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.047+0000 7fe4ccc82640 1 -- start start 2023-12-20T04:48:24.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.048+0000 7fe4ccc82640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe4c815cf20 0x7fe4c806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.048+0000 7fe4ccc82640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4c815d300 0x7fe4c8161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.048+0000 7fe4ccc82640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe4c8161c40 con 0x7fe4c80cd4b0 2023-12-20T04:48:24.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.048+0000 7fe4ccc82640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe4c806cc90 con 0x7fe4c815cf20 2023-12-20T04:48:24.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.048+0000 7fe4ccc82640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c80b2f30 con 0x7fe4c815d300 2023-12-20T04:48:24.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.048+0000 7fe4c6d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe4c80cd4b0 0x7fe4c80ceb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57186/0 (socket says 172.21.15.132:57186) 2023-12-20T04:48:24.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.048+0000 7fe4c6d9d640 1 -- 172.21.15.132:0/1606051739 learned_addr learned my addr 172.21.15.132:0/1606051739 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:24.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.049+0000 7fe4c5d9b640 1 --2- 172.21.15.132:0/1606051739 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4c815d300 0x7fe4c8161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.049+0000 7fe4c659c640 1 --2- 172.21.15.132:0/1606051739 >> v2:172.21.15.187:3300/0 conn(0x7fe4c815cf20 0x7fe4c806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.049+0000 7fe4c559a640 1 -- 172.21.15.132:0/1606051739 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3617715150 0 0) 0x7fe4c8161c40 con 0x7fe4c80cd4b0 2023-12-20T04:48:24.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.049+0000 7fe4c559a640 1 -- 172.21.15.132:0/1606051739 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe4b0003520 con 0x7fe4c80cd4b0 2023-12-20T04:48:24.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.049+0000 7fe4c559a640 1 -- 172.21.15.132:0/1606051739 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4217583405 0 0) 0x7fe4b0003520 con 0x7fe4c80cd4b0 2023-12-20T04:48:24.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.049+0000 7fe4c659c640 1 -- 172.21.15.132:0/1606051739 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4c815d300 msgr2=0x7fe4c8161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:24.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.049+0000 7fe4c659c640 1 --2- 172.21.15.132:0/1606051739 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4c815d300 0x7fe4c8161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.049+0000 7fe4c659c640 1 -- 172.21.15.132:0/1606051739 >> v1:172.21.15.132:6789/0 conn(0x7fe4c80cd4b0 legacy=0x7fe4c80ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.049+0000 7fe4c659c640 1 -- 172.21.15.132:0/1606051739 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4c80b3210 con 0x7fe4c815cf20 2023-12-20T04:48:24.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.049+0000 7fe4c5d9b640 1 --2- 172.21.15.132:0/1606051739 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4c815d300 0x7fe4c8161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:48:24.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.050+0000 7fe4c659c640 1 --2- 172.21.15.132:0/1606051739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4c815cf20 0x7fe4c806c590 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009d90 tx=0x7fe4b802bd70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=847ef7ebc5938006 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:24.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.050+0000 7fe4c559a640 1 -- 172.21.15.132:0/1606051739 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4c0001670 con 0x7fe4c815cf20 2023-12-20T04:48:24.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.050+0000 7fe4c559a640 1 -- 172.21.15.132:0/1606051739 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4b802c8a0 con 0x7fe4c815cf20 2023-12-20T04:48:24.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.050+0000 7fe4c559a640 1 -- 172.21.15.132:0/1606051739 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4b802cc30 con 0x7fe4c815cf20 2023-12-20T04:48:24.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.051+0000 7fe4ccc82640 1 -- 172.21.15.132:0/1606051739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4c815cf20 msgr2=0x7fe4c806c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.051+0000 7fe4ccc82640 1 --2- 172.21.15.132:0/1606051739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4c815cf20 0x7fe4c806c590 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8009d90 tx=0x7fe4b802bd70 comp rx=0 tx=0).stop 2023-12-20T04:48:24.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.051+0000 7fe4ccc82640 1 -- 172.21.15.132:0/1606051739 shutdown_connections 2023-12-20T04:48:24.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.051+0000 7fe4ccc82640 1 --2- 172.21.15.132:0/1606051739 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4c815d300 0x7fe4c8161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.051+0000 7fe4ccc82640 1 --2- 172.21.15.132:0/1606051739 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4c815cf20 0x7fe4c806c590 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.051+0000 7fe4ccc82640 1 -- 172.21.15.132:0/1606051739 >> 172.21.15.132:0/1606051739 conn(0x7fe4c8072c60 msgr2=0x7fe4c8073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:24.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.051+0000 7fe4ccc82640 1 -- 172.21.15.132:0/1606051739 shutdown_connections 2023-12-20T04:48:24.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.051+0000 7fe4ccc82640 1 -- 172.21.15.132:0/1606051739 wait complete. 2023-12-20T04:48:24.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.052+0000 7fe4ccc82640 1 Processor -- start 2023-12-20T04:48:24.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.052+0000 7fe4ccc82640 1 -- start start 2023-12-20T04:48:24.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4ccc82640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4c80cd4b0 0x7fe4c80c5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4ccc82640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c815cf20 0x7fe4c81598a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4ccc82640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4c815d300 0x7fe4c80cc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4ccc82640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c815ad30 con 0x7fe4c815cf20 2023-12-20T04:48:24.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4ccc82640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c80c4910 con 0x7fe4c815d300 2023-12-20T04:48:24.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4ccc82640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe4c80c4bd0 con 0x7fe4c80cd4b0 2023-12-20T04:48:24.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4c5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c815cf20 0x7fe4c81598a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4c5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c815cf20 0x7fe4c81598a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34406/0 (socket says 172.21.15.132:34406) 2023-12-20T04:48:24.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4c5d9b640 1 -- 172.21.15.132:0/2000245336 learned_addr learned my addr 172.21.15.132:0/2000245336 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:24.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4c659c640 1 --2- 172.21.15.132:0/2000245336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4c80cd4b0 0x7fe4c80c5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4c5d9b640 1 -- 172.21.15.132:0/2000245336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4c80cd4b0 msgr2=0x7fe4c80c5990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4c5d9b640 1 --2- 172.21.15.132:0/2000245336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4c80cd4b0 0x7fe4c80c5990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4c5d9b640 1 -- 172.21.15.132:0/2000245336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4c815d300 msgr2=0x7fe4c80cc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4c5d9b640 1 --2- 172.21.15.132:0/2000245336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4c815d300 0x7fe4c80cc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4c5d9b640 1 -- 172.21.15.132:0/2000245336 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4bc009400 con 0x7fe4c815cf20 2023-12-20T04:48:24.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4c5d9b640 1 --2- 172.21.15.132:0/2000245336 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c815cf20 0x7fe4c81598a0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00e960 tx=0x7fe4bc00ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:24.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4b6ffd640 1 -- 172.21.15.132:0/2000245336 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc00ca00 con 0x7fe4c815cf20 2023-12-20T04:48:24.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4b6ffd640 1 -- 172.21.15.132:0/2000245336 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe4bc00cb60 con 0x7fe4c815cf20 2023-12-20T04:48:24.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4ccc82640 1 -- 172.21.15.132:0/2000245336 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4b8009a70 con 0x7fe4c815cf20 2023-12-20T04:48:24.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4b6ffd640 1 -- 172.21.15.132:0/2000245336 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe4bc013470 con 0x7fe4c815cf20 2023-12-20T04:48:24.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.053+0000 7fe4ccc82640 1 -- 172.21.15.132:0/2000245336 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4c80c5190 con 0x7fe4c815cf20 2023-12-20T04:48:24.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.054+0000 7fe4ccc82640 1 -- 172.21.15.132:0/2000245336 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4c8066cd0 con 0x7fe4c815cf20 2023-12-20T04:48:24.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.055+0000 7fe4b6ffd640 1 -- 172.21.15.132:0/2000245336 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe4bc0135d0 con 0x7fe4c815cf20 2023-12-20T04:48:24.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.055+0000 7fe4b6ffd640 1 --2- 172.21.15.132:0/2000245336 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe4a806a460 0x7fe4a806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.055+0000 7fe4b6ffd640 1 -- 172.21.15.132:0/2000245336 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe4bc088be0 con 0x7fe4c815cf20 2023-12-20T04:48:24.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.055+0000 7fe4c659c640 1 --2- 172.21.15.132:0/2000245336 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe4a806a460 0x7fe4a806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.056+0000 7fe4c659c640 1 --2- 172.21.15.132:0/2000245336 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe4a806a460 0x7fe4a806c920 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8036000 tx=0x7fe4b8030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:24.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.060+0000 7fe4b6ffd640 1 -- 172.21.15.132:0/2000245336 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe4bc0541d0 con 0x7fe4c815cf20 2023-12-20T04:48:24.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.226+0000 7fe4ccc82640 1 -- 172.21.15.132:0/2000245336 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fe4c804e840 con 0x7fe4c815cf20 2023-12-20T04:48:24.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.226+0000 7fe4b6ffd640 1 -- 172.21.15.132:0/2000245336 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v125) v1 ==== 104+0+11 (secure 0 0 0) 0x7fe4bc0577f0 con 0x7fe4c815cf20 2023-12-20T04:48:24.228 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:48:24.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.228+0000 7fe4ccc82640 1 -- 172.21.15.132:0/2000245336 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe4a806a460 msgr2=0x7fe4a806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.228+0000 7fe4ccc82640 1 --2- 172.21.15.132:0/2000245336 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe4a806a460 0x7fe4a806c920 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fe4b8036000 tx=0x7fe4b8030000 comp rx=0 tx=0).stop 2023-12-20T04:48:24.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.228+0000 7fe4ccc82640 1 -- 172.21.15.132:0/2000245336 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c815cf20 msgr2=0x7fe4c81598a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.228+0000 7fe4ccc82640 1 --2- 172.21.15.132:0/2000245336 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c815cf20 0x7fe4c81598a0 secure :-1 s=READY pgs=1269 cs=0 l=1 rev1=1 crypto rx=0x7fe4bc00e960 tx=0x7fe4bc00ee20 comp rx=0 tx=0).stop 2023-12-20T04:48:24.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.228+0000 7fe4ccc82640 1 -- 172.21.15.132:0/2000245336 shutdown_connections 2023-12-20T04:48:24.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.228+0000 7fe4ccc82640 1 --2- 172.21.15.132:0/2000245336 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe4a806a460 0x7fe4a806c920 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.228+0000 7fe4ccc82640 1 --2- 172.21.15.132:0/2000245336 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe4c815d300 0x7fe4c80cc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.228+0000 7fe4ccc82640 1 --2- 172.21.15.132:0/2000245336 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe4c815cf20 0x7fe4c81598a0 unknown :-1 s=CLOSED pgs=1269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.228+0000 7fe4ccc82640 1 --2- 172.21.15.132:0/2000245336 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe4c80cd4b0 0x7fe4c80c5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.228+0000 7fe4ccc82640 1 -- 172.21.15.132:0/2000245336 >> 172.21.15.132:0/2000245336 conn(0x7fe4c8072c60 msgr2=0x7fe4c815bc80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:24.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.228+0000 7fe4ccc82640 1 -- 172.21.15.132:0/2000245336 shutdown_connections 2023-12-20T04:48:24.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.228+0000 7fe4ccc82640 1 -- 172.21.15.132:0/2000245336 wait complete. 2023-12-20T04:48:24.241 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:48:24.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.342+0000 7f8490e96640 1 Processor -- start 2023-12-20T04:48:24.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.342+0000 7f8490e96640 1 -- start start 2023-12-20T04:48:24.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.343+0000 7f8490e96640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f848c06f450 0x7f848c0cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.343+0000 7f8490e96640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848c06b960 con 0x7f848c06f8d0 2023-12-20T04:48:24.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.343+0000 7f8490e96640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f848c0c4390 con 0x7f848c0caee0 2023-12-20T04:48:24.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.343+0000 7f8490e96640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f848c0c4c30 con 0x7f848c06f450 2023-12-20T04:48:24.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.343+0000 7f848ad9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f848c06f8d0 0x7f848c06bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57188/0 (socket says 172.21.15.132:57188) 2023-12-20T04:48:24.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.343+0000 7f848ad9d640 1 -- 172.21.15.132:0/1162478603 learned_addr learned my addr 172.21.15.132:0/1162478603 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:24.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.343+0000 7f8489d9b640 1 --2- 172.21.15.132:0/1162478603 >> v2:172.21.15.187:3300/0 conn(0x7f848c06f450 0x7f848c0cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.343+0000 7f848959a640 1 -- 172.21.15.132:0/1162478603 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 207327462 0 0) 0x7f848c06b960 con 0x7f848c06f8d0 2023-12-20T04:48:24.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.343+0000 7f848959a640 1 -- 172.21.15.132:0/1162478603 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8474003520 con 0x7f848c06f8d0 2023-12-20T04:48:24.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848959a640 1 -- 172.21.15.132:0/1162478603 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2790368583 0 0) 0x7f8474003520 con 0x7f848c06f8d0 2023-12-20T04:48:24.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848959a640 1 -- 172.21.15.132:0/1162478603 >> v2:172.21.15.187:3300/0 conn(0x7f848c06f450 msgr2=0x7f848c0cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:24.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848959a640 1 --2- 172.21.15.132:0/1162478603 >> v2:172.21.15.187:3300/0 conn(0x7f848c06f450 0x7f848c0cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848959a640 1 -- 172.21.15.132:0/1162478603 >> v1:172.21.15.187:6789/0 conn(0x7f848c0caee0 legacy=0x7f848c0c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848959a640 1 -- 172.21.15.132:0/1162478603 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c0c4670 con 0x7f848c06f8d0 2023-12-20T04:48:24.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848959a640 1 -- 172.21.15.132:0/1162478603 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f8484001670 con 0x7f848c06f8d0 2023-12-20T04:48:24.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848959a640 1 -- 172.21.15.132:0/1162478603 >> v1:172.21.15.132:6789/0 conn(0x7f848c06f8d0 legacy=0x7f848c06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848959a640 1 --2- 172.21.15.132:0/1162478603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8474003970 0x7f8474003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848959a640 1 --2- 172.21.15.132:0/1162478603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84740047c0 0x7f8474004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848959a640 1 --2- 172.21.15.132:0/1162478603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8474005180 0x7f847400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848959a640 1 -- 172.21.15.132:0/1162478603 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c0c4c30 con 0x7f8474005180 2023-12-20T04:48:24.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848959a640 1 -- 172.21.15.132:0/1162478603 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f847400c020 con 0x7f84740047c0 2023-12-20T04:48:24.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848959a640 1 -- 172.21.15.132:0/1162478603 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f847400c1e0 con 0x7f8474003970 2023-12-20T04:48:24.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848ad9d640 1 --2- 172.21.15.132:0/1162478603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8474005180 0x7f847400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848a59c640 1 --2- 172.21.15.132:0/1162478603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8474003970 0x7f8474003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f8489d9b640 1 --2- 172.21.15.132:0/1162478603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84740047c0 0x7f8474004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848ad9d640 1 -- 172.21.15.132:0/1162478603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8474003970 msgr2=0x7f8474003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:24.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848ad9d640 1 --2- 172.21.15.132:0/1162478603 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8474003970 0x7f8474003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848ad9d640 1 -- 172.21.15.132:0/1162478603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84740047c0 msgr2=0x7f8474004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:24.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848ad9d640 1 --2- 172.21.15.132:0/1162478603 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84740047c0 0x7f8474004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.344+0000 7f848ad9d640 1 -- 172.21.15.132:0/1162478603 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8474003520 con 0x7f8474005180 2023-12-20T04:48:24.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.345+0000 7f848ad9d640 1 -- 172.21.15.132:0/1162478603 reap_dead start 2023-12-20T04:48:24.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.345+0000 7f848ad9d640 1 --2- 172.21.15.132:0/1162478603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8474005180 0x7f847400b980 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f848400c240 tx=0x7f84740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517dee45ff560c6c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:24.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.345+0000 7f848959a640 1 -- 172.21.15.132:0/1162478603 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8484005ad0 con 0x7f8474005180 2023-12-20T04:48:24.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.345+0000 7f848959a640 1 -- 172.21.15.132:0/1162478603 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8484005c70 con 0x7f8474005180 2023-12-20T04:48:24.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.345+0000 7f848959a640 1 -- 172.21.15.132:0/1162478603 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848402c8b0 con 0x7f8474005180 2023-12-20T04:48:24.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.345+0000 7f8490e96640 1 -- 172.21.15.132:0/1162478603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8474005180 msgr2=0x7f847400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.345+0000 7f8490e96640 1 --2- 172.21.15.132:0/1162478603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8474005180 0x7f847400b980 secure :-1 s=READY pgs=1271 cs=0 l=1 rev1=1 crypto rx=0x7f848400c240 tx=0x7f84740057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.346+0000 7f8490e96640 1 -- 172.21.15.132:0/1162478603 shutdown_connections 2023-12-20T04:48:24.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.346+0000 7f8490e96640 1 --2- 172.21.15.132:0/1162478603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8474005180 0x7f847400b980 unknown :-1 s=CLOSED pgs=1271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.346+0000 7f8490e96640 1 -- 172.21.15.132:0/1162478603 >> 172.21.15.132:0/1162478603 conn(0x7f848c06a260 msgr2=0x7f848c0b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:24.350 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.346+0000 7f8490e96640 1 -- 172.21.15.132:0/1162478603 shutdown_connections 2023-12-20T04:48:24.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.346+0000 7f8490e96640 1 -- 172.21.15.132:0/1162478603 wait complete. 2023-12-20T04:48:24.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.347+0000 7f8490e96640 1 Processor -- start 2023-12-20T04:48:24.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.347+0000 7f8490e96640 1 -- start start 2023-12-20T04:48:24.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f8490e96640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8474005180 0x7f848c13e430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f8490e96640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f848c1e42a0 0x7f848c0c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f8490e96640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f848c1e4720 0x7f848c0c6c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f8490e96640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c1cfc70 con 0x7f848c1e42a0 2023-12-20T04:48:24.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f8490e96640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f848c1e4cf0 con 0x7f8474005180 2023-12-20T04:48:24.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f8490e96640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f848c1e4fd0 con 0x7f848c1e4720 2023-12-20T04:48:24.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f8489d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f848c1e42a0 0x7f848c0c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f8489d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f848c1e42a0 0x7f848c0c6710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34430/0 (socket says 172.21.15.132:34430) 2023-12-20T04:48:24.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f8489d9b640 1 -- 172.21.15.132:0/3932075178 learned_addr learned my addr 172.21.15.132:0/3932075178 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:24.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f848a59c640 1 --2- 172.21.15.132:0/3932075178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8474005180 0x7f848c13e430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f848ad9d640 1 --2- 172.21.15.132:0/3932075178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f848c1e4720 0x7f848c0c6c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f8489d9b640 1 -- 172.21.15.132:0/3932075178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f848c1e4720 msgr2=0x7f848c0c6c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f8489d9b640 1 --2- 172.21.15.132:0/3932075178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f848c1e4720 0x7f848c0c6c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f8489d9b640 1 -- 172.21.15.132:0/3932075178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8474005180 msgr2=0x7f848c13e430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f8489d9b640 1 --2- 172.21.15.132:0/3932075178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8474005180 0x7f848c13e430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f8489d9b640 1 -- 172.21.15.132:0/3932075178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f848c1e52b0 con 0x7f848c1e42a0 2023-12-20T04:48:24.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f8489d9b640 1 --2- 172.21.15.132:0/3932075178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f848c1e42a0 0x7f848c0c6710 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f84800118e0 tx=0x7f8480011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:24.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f847affd640 1 -- 172.21.15.132:0/3932075178 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f848000faf0 con 0x7f848c1e42a0 2023-12-20T04:48:24.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f847affd640 1 -- 172.21.15.132:0/3932075178 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f848000fc50 con 0x7f848c1e42a0 2023-12-20T04:48:24.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f8490e96640 1 -- 172.21.15.132:0/3932075178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f848c1e5590 con 0x7f848c1e42a0 2023-12-20T04:48:24.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f847affd640 1 -- 172.21.15.132:0/3932075178 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8480014440 con 0x7f848c1e42a0 2023-12-20T04:48:24.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.348+0000 7f8490e96640 1 -- 172.21.15.132:0/3932075178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f848c1e1460 con 0x7f848c1e42a0 2023-12-20T04:48:24.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.349+0000 7f8490e96640 1 -- 172.21.15.132:0/3932075178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f848c0c92a0 con 0x7f848c1e42a0 2023-12-20T04:48:24.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.350+0000 7f847affd640 1 -- 172.21.15.132:0/3932075178 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f84800145a0 con 0x7f848c1e42a0 2023-12-20T04:48:24.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.350+0000 7f847affd640 1 --2- 172.21.15.132:0/3932075178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f846c06a430 0x7f846c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.350+0000 7f848a59c640 1 --2- 172.21.15.132:0/3932075178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f846c06a430 0x7f846c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.350+0000 7f847affd640 1 -- 172.21.15.132:0/3932075178 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8480089230 con 0x7f848c1e42a0 2023-12-20T04:48:24.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.351+0000 7f848a59c640 1 --2- 172.21.15.132:0/3932075178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f846c06a430 0x7f846c06c8f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f847c000f80 tx=0x7f847c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:24.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.355+0000 7f847affd640 1 -- 172.21.15.132:0/3932075178 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8480054820 con 0x7f848c1e42a0 2023-12-20T04:48:24.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.523+0000 7f8490e96640 1 -- 172.21.15.132:0/3932075178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f848c04e840 con 0x7f848c1e42a0 2023-12-20T04:48:24.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.523+0000 7f847affd640 1 -- 172.21.15.132:0/3932075178 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v125) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8480057e40 con 0x7f848c1e42a0 2023-12-20T04:48:24.525 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:48:24.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.525+0000 7f8490e96640 1 -- 172.21.15.132:0/3932075178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f846c06a430 msgr2=0x7f846c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.525+0000 7f8490e96640 1 --2- 172.21.15.132:0/3932075178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f846c06a430 0x7f846c06c8f0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f847c000f80 tx=0x7f847c009040 comp rx=0 tx=0).stop 2023-12-20T04:48:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.525+0000 7f8490e96640 1 -- 172.21.15.132:0/3932075178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f848c1e42a0 msgr2=0x7f848c0c6710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.525+0000 7f8490e96640 1 --2- 172.21.15.132:0/3932075178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f848c1e42a0 0x7f848c0c6710 secure :-1 s=READY pgs=1272 cs=0 l=1 rev1=1 crypto rx=0x7f84800118e0 tx=0x7f8480011da0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.525+0000 7f8490e96640 1 -- 172.21.15.132:0/3932075178 shutdown_connections 2023-12-20T04:48:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.525+0000 7f8490e96640 1 --2- 172.21.15.132:0/3932075178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f846c06a430 0x7f846c06c8f0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.525+0000 7f8490e96640 1 --2- 172.21.15.132:0/3932075178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f848c1e4720 0x7f848c0c6c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.525+0000 7f8490e96640 1 --2- 172.21.15.132:0/3932075178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f848c1e42a0 0x7f848c0c6710 unknown :-1 s=CLOSED pgs=1272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.525+0000 7f8490e96640 1 --2- 172.21.15.132:0/3932075178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8474005180 0x7f848c13e430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.525+0000 7f8490e96640 1 -- 172.21.15.132:0/3932075178 >> 172.21.15.132:0/3932075178 conn(0x7f848c06a260 msgr2=0x7f848c070e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.525+0000 7f8490e96640 1 -- 172.21.15.132:0/3932075178 shutdown_connections 2023-12-20T04:48:24.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.525+0000 7f8490e96640 1 -- 172.21.15.132:0/3932075178 wait complete. 2023-12-20T04:48:24.538 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:48:24.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.636+0000 7f8764832640 1 Processor -- start 2023-12-20T04:48:24.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.636+0000 7f8764832640 1 -- start start 2023-12-20T04:48:24.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.637+0000 7f8764832640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f876015cef0 0x7f87600cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.637+0000 7f8764832640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87600ad2f0 0x7f876006bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.637+0000 7f8764832640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f87600ad7a0 con 0x7f876015d2d0 2023-12-20T04:48:24.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.637+0000 7f8764832640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f87600add30 con 0x7f876015cef0 2023-12-20T04:48:24.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.637+0000 7f8764832640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87600ae010 con 0x7f87600ad2f0 2023-12-20T04:48:24.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.637+0000 7f875e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f876015cef0 0x7f87600cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.637+0000 7f875e59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f876015cef0 0x7f87600cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34436/0 (socket says 172.21.15.132:34436) 2023-12-20T04:48:24.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.637+0000 7f875e59c640 1 -- 172.21.15.132:0/2850726793 learned_addr learned my addr 172.21.15.132:0/2850726793 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:24.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.637+0000 7f875ed9d640 1 --2- 172.21.15.132:0/2850726793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87600ad2f0 0x7f876006bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.637+0000 7f875e59c640 1 -- 172.21.15.132:0/2850726793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87600ad2f0 msgr2=0x7f876006bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:24.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.637+0000 7f875e59c640 1 --2- 172.21.15.132:0/2850726793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87600ad2f0 0x7f876006bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.637+0000 7f875e59c640 1 -- 172.21.15.132:0/2850726793 >> v1:172.21.15.187:6789/0 conn(0x7f876015d2d0 legacy=0x7f87600cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:24.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.637+0000 7f875e59c640 1 -- 172.21.15.132:0/2850726793 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8760072d00 con 0x7f876015cef0 2023-12-20T04:48:24.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.638+0000 7f875e59c640 1 --2- 172.21.15.132:0/2850726793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f876015cef0 0x7f87600cecc0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f8750009870 tx=0x7f875002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=970b67837f469cfd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:24.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.638+0000 7f875d59a640 1 -- 172.21.15.132:0/2850726793 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750030840 con 0x7f876015cef0 2023-12-20T04:48:24.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.638+0000 7f875d59a640 1 -- 172.21.15.132:0/2850726793 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f87500309a0 con 0x7f876015cef0 2023-12-20T04:48:24.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.638+0000 7f875d59a640 1 -- 172.21.15.132:0/2850726793 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750030d30 con 0x7f876015cef0 2023-12-20T04:48:24.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.639+0000 7f8764832640 1 -- 172.21.15.132:0/2850726793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f876015cef0 msgr2=0x7f87600cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.639+0000 7f8764832640 1 --2- 172.21.15.132:0/2850726793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f876015cef0 0x7f87600cecc0 secure :-1 s=READY pgs=1273 cs=0 l=1 rev1=1 crypto rx=0x7f8750009870 tx=0x7f875002b980 comp rx=0 tx=0).stop 2023-12-20T04:48:24.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.639+0000 7f8764832640 1 -- 172.21.15.132:0/2850726793 shutdown_connections 2023-12-20T04:48:24.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.639+0000 7f8764832640 1 --2- 172.21.15.132:0/2850726793 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f87600ad2f0 0x7f876006bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.639+0000 7f8764832640 1 --2- 172.21.15.132:0/2850726793 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f876015cef0 0x7f87600cecc0 unknown :-1 s=CLOSED pgs=1273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.639+0000 7f8764832640 1 -- 172.21.15.132:0/2850726793 >> 172.21.15.132:0/2850726793 conn(0x7f87600cf330 msgr2=0x7f87600cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:24.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.639+0000 7f8764832640 1 -- 172.21.15.132:0/2850726793 shutdown_connections 2023-12-20T04:48:24.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.639+0000 7f8764832640 1 -- 172.21.15.132:0/2850726793 wait complete. 2023-12-20T04:48:24.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.640+0000 7f8764832640 1 Processor -- start 2023-12-20T04:48:24.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.640+0000 7f8764832640 1 -- start start 2023-12-20T04:48:24.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.641+0000 7f8764832640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600ad2f0 0x7f87600b4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.641+0000 7f8764832640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f876015cef0 0x7f87600ca190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.641+0000 7f8764832640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f876015d2d0 0x7f87600ca6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.641+0000 7f8764832640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8760151240 con 0x7f87600ad2f0 2023-12-20T04:48:24.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.641+0000 7f8764832640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87600c6530 con 0x7f876015d2d0 2023-12-20T04:48:24.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.641+0000 7f8764832640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f87600cac10 con 0x7f876015cef0 2023-12-20T04:48:24.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.641+0000 7f875e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600ad2f0 0x7f87600b4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.641+0000 7f875e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600ad2f0 0x7f87600b4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34438/0 (socket says 172.21.15.132:34438) 2023-12-20T04:48:24.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.641+0000 7f875e59c640 1 -- 172.21.15.132:0/1391489574 learned_addr learned my addr 172.21.15.132:0/1391489574 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:24.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.641+0000 7f875e59c640 1 -- 172.21.15.132:0/1391489574 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f876015cef0 msgr2=0x7f87600ca190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.641+0000 7f875e59c640 1 --2- 172.21.15.132:0/1391489574 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f876015cef0 0x7f87600ca190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.641+0000 7f875e59c640 1 -- 172.21.15.132:0/1391489574 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f876015d2d0 msgr2=0x7f87600ca6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.641+0000 7f875e59c640 1 --2- 172.21.15.132:0/1391489574 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f876015d2d0 0x7f87600ca6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.641+0000 7f875e59c640 1 -- 172.21.15.132:0/1391489574 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87500094d0 con 0x7f87600ad2f0 2023-12-20T04:48:24.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.641+0000 7f875e59c640 1 --2- 172.21.15.132:0/1391489574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600ad2f0 0x7f87600b4820 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f8750009870 tx=0x7f8750004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:24.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.642+0000 7f874effd640 1 -- 172.21.15.132:0/1391489574 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750039c90 con 0x7f87600ad2f0 2023-12-20T04:48:24.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.642+0000 7f874effd640 1 -- 172.21.15.132:0/1391489574 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8750039df0 con 0x7f87600ad2f0 2023-12-20T04:48:24.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.642+0000 7f874effd640 1 -- 172.21.15.132:0/1391489574 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8750043620 con 0x7f87600ad2f0 2023-12-20T04:48:24.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.642+0000 7f8764832640 1 -- 172.21.15.132:0/1391489574 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87600cae70 con 0x7f87600ad2f0 2023-12-20T04:48:24.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.642+0000 7f8764832640 1 -- 172.21.15.132:0/1391489574 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87600cb430 con 0x7f87600ad2f0 2023-12-20T04:48:24.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.642+0000 7f8764832640 1 -- 172.21.15.132:0/1391489574 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f876004e840 con 0x7f87600ad2f0 2023-12-20T04:48:24.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.643+0000 7f874effd640 1 -- 172.21.15.132:0/1391489574 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8750043780 con 0x7f87600ad2f0 2023-12-20T04:48:24.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.643+0000 7f874effd640 1 --2- 172.21.15.132:0/1391489574 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f874006a430 0x7f874006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.643+0000 7f874effd640 1 -- 172.21.15.132:0/1391489574 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f875003e070 con 0x7f87600ad2f0 2023-12-20T04:48:24.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.644+0000 7f875dd9b640 1 --2- 172.21.15.132:0/1391489574 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f874006a430 0x7f874006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.644+0000 7f875dd9b640 1 --2- 172.21.15.132:0/1391489574 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f874006a430 0x7f874006c8f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8754006fd0 tx=0x7f8754006bc0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:24.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.648+0000 7f874effd640 1 -- 172.21.15.132:0/1391489574 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8750076fe0 con 0x7f87600ad2f0 2023-12-20T04:48:24.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.848+0000 7f8764832640 1 -- 172.21.15.132:0/1391489574 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f87600b52b0 con 0x7f87600ad2f0 2023-12-20T04:48:24.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.849+0000 7f874effd640 1 -- 172.21.15.132:0/1391489574 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f8750034090 con 0x7f87600ad2f0 2023-12-20T04:48:24.851 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:24.851 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":45,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3951194420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3951194420},{"type":"v1","addr":"172.21.15.187:6833","nonce":3951194420}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1575999914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1575999914},{"type":"v1","addr":"172.21.15.187:6835","nonce":1575999914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2208233017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2208233017},{"type":"v1","addr":"172.21.15.132:6836","nonce":2208233017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:48:04.456610+0000","modified":"2023-12-20T04:48:07.132847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7422":{"gid":7422,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/3935356761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":3935356761},{"type":"v1","addr":"172.21.15.132:6837","nonce":3935356761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-20T04:48:24.851 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 45 2023-12-20T04:48:24.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.851+0000 7f8764832640 1 -- 172.21.15.132:0/1391489574 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f874006a430 msgr2=0x7f874006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.851+0000 7f8764832640 1 --2- 172.21.15.132:0/1391489574 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f874006a430 0x7f874006c8f0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f8754006fd0 tx=0x7f8754006bc0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.851+0000 7f8764832640 1 -- 172.21.15.132:0/1391489574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600ad2f0 msgr2=0x7f87600b4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.851+0000 7f8764832640 1 --2- 172.21.15.132:0/1391489574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600ad2f0 0x7f87600b4820 secure :-1 s=READY pgs=1274 cs=0 l=1 rev1=1 crypto rx=0x7f8750009870 tx=0x7f8750004730 comp rx=0 tx=0).stop 2023-12-20T04:48:24.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.851+0000 7f8764832640 1 -- 172.21.15.132:0/1391489574 shutdown_connections 2023-12-20T04:48:24.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.851+0000 7f8764832640 1 --2- 172.21.15.132:0/1391489574 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f874006a430 0x7f874006c8f0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.851+0000 7f8764832640 1 --2- 172.21.15.132:0/1391489574 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f876015d2d0 0x7f87600ca6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.851+0000 7f8764832640 1 --2- 172.21.15.132:0/1391489574 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f876015cef0 0x7f87600ca190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.851+0000 7f8764832640 1 --2- 172.21.15.132:0/1391489574 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f87600ad2f0 0x7f87600b4820 unknown :-1 s=CLOSED pgs=1274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.851+0000 7f8764832640 1 -- 172.21.15.132:0/1391489574 >> 172.21.15.132:0/1391489574 conn(0x7f87600cf330 msgr2=0x7f8760160a40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:24.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.851+0000 7f8764832640 1 -- 172.21.15.132:0/1391489574 shutdown_connections 2023-12-20T04:48:24.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.851+0000 7f8764832640 1 -- 172.21.15.132:0/1391489574 wait complete. 2023-12-20T04:48:24.865 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:48:24.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.963+0000 7fe220a77640 1 Processor -- start 2023-12-20T04:48:24.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.963+0000 7fe220a77640 1 -- start start 2023-12-20T04:48:24.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.964+0000 7fe220a77640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe21c0d0370 0x7fe21c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.964+0000 7fe220a77640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe21c0cdc10 0x7fe21c06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.964+0000 7fe220a77640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe21c0b2f90 con 0x7fe21c15d100 2023-12-20T04:48:24.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.964+0000 7fe220a77640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe21c1613c0 con 0x7fe21c0d0370 2023-12-20T04:48:24.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.964+0000 7fe220a77640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c0d1b00 con 0x7fe21c0cdc10 2023-12-20T04:48:24.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.964+0000 7fe219d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe21c0d0370 0x7fe21c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.965+0000 7fe219d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe21c0d0370 0x7fe21c0b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34448/0 (socket says 172.21.15.132:34448) 2023-12-20T04:48:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.965+0000 7fe219d9b640 1 -- 172.21.15.132:0/2896488750 learned_addr learned my addr 172.21.15.132:0/2896488750 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.965+0000 7fe21ad9d640 1 --2- 172.21.15.132:0/2896488750 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe21c0cdc10 0x7fe21c06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.965+0000 7fe219d9b640 1 -- 172.21.15.132:0/2896488750 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe21c0cdc10 msgr2=0x7fe21c06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.965+0000 7fe219d9b640 1 --2- 172.21.15.132:0/2896488750 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe21c0cdc10 0x7fe21c06c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.965+0000 7fe219d9b640 1 -- 172.21.15.132:0/2896488750 >> v1:172.21.15.187:6789/0 conn(0x7fe21c15d100 legacy=0x7fe21c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.965+0000 7fe219d9b640 1 -- 172.21.15.132:0/2896488750 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe21c0d0810 con 0x7fe21c0d0370 2023-12-20T04:48:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.965+0000 7fe219d9b640 1 --2- 172.21.15.132:0/2896488750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe21c0d0370 0x7fe21c0b2a50 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fe204009870 tx=0x7fe20402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16a2264a847789e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.966+0000 7fe21959a640 1 -- 172.21.15.132:0/2896488750 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe204030840 con 0x7fe21c0d0370 2023-12-20T04:48:24.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.966+0000 7fe21959a640 1 -- 172.21.15.132:0/2896488750 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe2040309a0 con 0x7fe21c0d0370 2023-12-20T04:48:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.966+0000 7fe21959a640 1 -- 172.21.15.132:0/2896488750 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe204030d30 con 0x7fe21c0d0370 2023-12-20T04:48:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.966+0000 7fe220a77640 1 -- 172.21.15.132:0/2896488750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe21c0d0370 msgr2=0x7fe21c0b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.966+0000 7fe220a77640 1 --2- 172.21.15.132:0/2896488750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe21c0d0370 0x7fe21c0b2a50 secure :-1 s=READY pgs=1275 cs=0 l=1 rev1=1 crypto rx=0x7fe204009870 tx=0x7fe20402b980 comp rx=0 tx=0).stop 2023-12-20T04:48:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.966+0000 7fe220a77640 1 -- 172.21.15.132:0/2896488750 shutdown_connections 2023-12-20T04:48:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.966+0000 7fe220a77640 1 --2- 172.21.15.132:0/2896488750 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe21c0cdc10 0x7fe21c06c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.966+0000 7fe220a77640 1 --2- 172.21.15.132:0/2896488750 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe21c0d0370 0x7fe21c0b2a50 unknown :-1 s=CLOSED pgs=1275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.966+0000 7fe220a77640 1 -- 172.21.15.132:0/2896488750 >> 172.21.15.132:0/2896488750 conn(0x7fe21c06d7c0 msgr2=0x7fe21c06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.966+0000 7fe220a77640 1 -- 172.21.15.132:0/2896488750 shutdown_connections 2023-12-20T04:48:24.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.966+0000 7fe220a77640 1 -- 172.21.15.132:0/2896488750 wait complete. 2023-12-20T04:48:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.968+0000 7fe220a77640 1 Processor -- start 2023-12-20T04:48:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.968+0000 7fe220a77640 1 -- start start 2023-12-20T04:48:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.968+0000 7fe220a77640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe21c0cdc10 0x7fe21c154e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.968+0000 7fe220a77640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe21c0d0370 0x7fe21c0b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.968+0000 7fe220a77640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe21c15d100 0x7fe21c0b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.968+0000 7fe220a77640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c0af390 con 0x7fe21c0cdc10 2023-12-20T04:48:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.968+0000 7fe220a77640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c0b4d50 con 0x7fe21c0d0370 2023-12-20T04:48:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.968+0000 7fe220a77640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe21c0aea60 con 0x7fe21c15d100 2023-12-20T04:48:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.968+0000 7fe21a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe21c0cdc10 0x7fe21c154e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.968+0000 7fe21a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe21c0cdc10 0x7fe21c154e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34450/0 (socket says 172.21.15.132:34450) 2023-12-20T04:48:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.969+0000 7fe21a59c640 1 -- 172.21.15.132:0/1335704393 learned_addr learned my addr 172.21.15.132:0/1335704393 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.969+0000 7fe21ad9d640 1 --2- 172.21.15.132:0/1335704393 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe21c15d100 0x7fe21c0b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.969+0000 7fe219d9b640 1 --2- 172.21.15.132:0/1335704393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe21c0d0370 0x7fe21c0b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.969+0000 7fe21a59c640 1 -- 172.21.15.132:0/1335704393 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe21c15d100 msgr2=0x7fe21c0b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.969+0000 7fe21a59c640 1 --2- 172.21.15.132:0/1335704393 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe21c15d100 0x7fe21c0b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.969+0000 7fe21a59c640 1 -- 172.21.15.132:0/1335704393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe21c0d0370 msgr2=0x7fe21c0b39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.969+0000 7fe21a59c640 1 --2- 172.21.15.132:0/1335704393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe21c0d0370 0x7fe21c0b39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.969+0000 7fe21a59c640 1 -- 172.21.15.132:0/1335704393 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe2040094d0 con 0x7fe21c0cdc10 2023-12-20T04:48:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.969+0000 7fe21a59c640 1 --2- 172.21.15.132:0/1335704393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe21c0cdc10 0x7fe21c154e60 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fe21400c870 tx=0x7fe21400cd30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.969+0000 7fe212ffd640 1 -- 172.21.15.132:0/1335704393 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe214003b70 con 0x7fe21c0cdc10 2023-12-20T04:48:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.969+0000 7fe212ffd640 1 -- 172.21.15.132:0/1335704393 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe214003cf0 con 0x7fe21c0cdc10 2023-12-20T04:48:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.969+0000 7fe212ffd640 1 -- 172.21.15.132:0/1335704393 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe21400aa90 con 0x7fe21c0cdc10 2023-12-20T04:48:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.969+0000 7fe220a77640 1 -- 172.21.15.132:0/1335704393 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe21c0aed40 con 0x7fe21c0cdc10 2023-12-20T04:48:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.969+0000 7fe220a77640 1 -- 172.21.15.132:0/1335704393 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe21c1553a0 con 0x7fe21c0cdc10 2023-12-20T04:48:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.970+0000 7fe220a77640 1 -- 172.21.15.132:0/1335704393 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe21c066480 con 0x7fe21c0cdc10 2023-12-20T04:48:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.971+0000 7fe212ffd640 1 -- 172.21.15.132:0/1335704393 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe21400abf0 con 0x7fe21c0cdc10 2023-12-20T04:48:24.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.971+0000 7fe212ffd640 1 --2- 172.21.15.132:0/1335704393 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1fc06a430 0x7fe1fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.971+0000 7fe212ffd640 1 -- 172.21.15.132:0/1335704393 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe214088460 con 0x7fe21c0cdc10 2023-12-20T04:48:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.971+0000 7fe219d9b640 1 --2- 172.21.15.132:0/1335704393 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1fc06a430 0x7fe1fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:24.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.971+0000 7fe219d9b640 1 --2- 172.21.15.132:0/1335704393 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1fc06a430 0x7fe1fc06c8f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe204036000 tx=0x7fe204008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:24.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:24.975+0000 7fe212ffd640 1 -- 172.21.15.132:0/1335704393 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe214053b90 con 0x7fe21c0cdc10 2023-12-20T04:48:25.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.142+0000 7fe220a77640 1 -- 172.21.15.132:0/1335704393 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe21c0b2f90 con 0x7fe21c0cdc10 2023-12-20T04:48:25.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.143+0000 7fe212ffd640 1 -- 172.21.15.132:0/1335704393 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16107 (secure 0 0 0) 0x7fe21c0b2f90 con 0x7fe21c0cdc10 2023-12-20T04:48:25.145 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:25.145 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":125,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:48:16.867874+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:48:02.660300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-20T04:48:03.433311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:48:25.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.145+0000 7fe220a77640 1 -- 172.21.15.132:0/1335704393 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1fc06a430 msgr2=0x7fe1fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.145+0000 7fe220a77640 1 --2- 172.21.15.132:0/1335704393 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1fc06a430 0x7fe1fc06c8f0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe204036000 tx=0x7fe204008030 comp rx=0 tx=0).stop 2023-12-20T04:48:25.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.145+0000 7fe220a77640 1 -- 172.21.15.132:0/1335704393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe21c0cdc10 msgr2=0x7fe21c154e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.145+0000 7fe220a77640 1 --2- 172.21.15.132:0/1335704393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe21c0cdc10 0x7fe21c154e60 secure :-1 s=READY pgs=1276 cs=0 l=1 rev1=1 crypto rx=0x7fe21400c870 tx=0x7fe21400cd30 comp rx=0 tx=0).stop 2023-12-20T04:48:25.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.145+0000 7fe220a77640 1 -- 172.21.15.132:0/1335704393 shutdown_connections 2023-12-20T04:48:25.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.145+0000 7fe220a77640 1 --2- 172.21.15.132:0/1335704393 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1fc06a430 0x7fe1fc06c8f0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.145+0000 7fe220a77640 1 --2- 172.21.15.132:0/1335704393 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe21c15d100 0x7fe21c0b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.145+0000 7fe220a77640 1 --2- 172.21.15.132:0/1335704393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe21c0d0370 0x7fe21c0b39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.145+0000 7fe220a77640 1 --2- 172.21.15.132:0/1335704393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe21c0cdc10 0x7fe21c154e60 unknown :-1 s=CLOSED pgs=1276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.145+0000 7fe220a77640 1 -- 172.21.15.132:0/1335704393 >> 172.21.15.132:0/1335704393 conn(0x7fe21c06d7c0 msgr2=0x7fe21c15b550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:25.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.145+0000 7fe220a77640 1 -- 172.21.15.132:0/1335704393 shutdown_connections 2023-12-20T04:48:25.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.145+0000 7fe220a77640 1 -- 172.21.15.132:0/1335704393 wait complete. 2023-12-20T04:48:25.159 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-20T04:48:25.159 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:48:25.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.257+0000 7f05e253e640 1 Processor -- start 2023-12-20T04:48:25.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.257+0000 7f05e253e640 1 -- start start 2023-12-20T04:48:25.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.258+0000 7f05e253e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f05dc0d0370 0x7f05dc0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.258+0000 7f05e253e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f05dc0cdc10 0x7f05dc06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.258+0000 7f05e253e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05dc0b2f90 con 0x7f05dc15d100 2023-12-20T04:48:25.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.258+0000 7f05e253e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05dc1613c0 con 0x7f05dc0d0370 2023-12-20T04:48:25.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.258+0000 7f05e253e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05dc0d1b00 con 0x7f05dc0cdc10 2023-12-20T04:48:25.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.258+0000 7f05db7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f05dc0d0370 0x7f05dc0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:25.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.258+0000 7f05db7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f05dc0d0370 0x7f05dc0b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34456/0 (socket says 172.21.15.132:34456) 2023-12-20T04:48:25.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.258+0000 7f05db7fe640 1 -- 172.21.15.132:0/2181801582 learned_addr learned my addr 172.21.15.132:0/2181801582 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:25.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.258+0000 7f05db7fe640 1 -- 172.21.15.132:0/2181801582 >> v2:172.21.15.187:3300/0 conn(0x7f05dc0cdc10 msgr2=0x7f05dc06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:25.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.258+0000 7f05db7fe640 1 --2- 172.21.15.132:0/2181801582 >> v2:172.21.15.187:3300/0 conn(0x7f05dc0cdc10 0x7f05dc06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.258+0000 7f05db7fe640 1 -- 172.21.15.132:0/2181801582 >> v1:172.21.15.187:6789/0 conn(0x7f05dc15d100 legacy=0x7f05dc0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:25.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.258+0000 7f05db7fe640 1 -- 172.21.15.132:0/2181801582 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05dc0d0810 con 0x7f05dc0d0370 2023-12-20T04:48:25.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.259+0000 7f05db7fe640 1 --2- 172.21.15.132:0/2181801582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05dc0d0370 0x7f05dc0b2a50 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f05dc161330 tx=0x7f05d002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e52e5140f31d150 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:25.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.259+0000 7f05daffd640 1 -- 172.21.15.132:0/2181801582 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0031870 con 0x7f05dc0d0370 2023-12-20T04:48:25.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.259+0000 7f05daffd640 1 -- 172.21.15.132:0/2181801582 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d00319d0 con 0x7f05dc0d0370 2023-12-20T04:48:25.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.259+0000 7f05daffd640 1 -- 172.21.15.132:0/2181801582 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0031d60 con 0x7f05dc0d0370 2023-12-20T04:48:25.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.260+0000 7f05e253e640 1 -- 172.21.15.132:0/2181801582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05dc0d0370 msgr2=0x7f05dc0b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.260+0000 7f05e253e640 1 --2- 172.21.15.132:0/2181801582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05dc0d0370 0x7f05dc0b2a50 secure :-1 s=READY pgs=1277 cs=0 l=1 rev1=1 crypto rx=0x7f05dc161330 tx=0x7f05d002b910 comp rx=0 tx=0).stop 2023-12-20T04:48:25.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.260+0000 7f05e253e640 1 -- 172.21.15.132:0/2181801582 shutdown_connections 2023-12-20T04:48:25.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.260+0000 7f05e253e640 1 --2- 172.21.15.132:0/2181801582 >> v2:172.21.15.187:3300/0 conn(0x7f05dc0cdc10 0x7f05dc06c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.260+0000 7f05e253e640 1 --2- 172.21.15.132:0/2181801582 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05dc0d0370 0x7f05dc0b2a50 unknown :-1 s=CLOSED pgs=1277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.260+0000 7f05e253e640 1 -- 172.21.15.132:0/2181801582 >> 172.21.15.132:0/2181801582 conn(0x7f05dc06d7c0 msgr2=0x7f05dc06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:25.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.260+0000 7f05e253e640 1 -- 172.21.15.132:0/2181801582 shutdown_connections 2023-12-20T04:48:25.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.260+0000 7f05e253e640 1 -- 172.21.15.132:0/2181801582 wait complete. 2023-12-20T04:48:25.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.261+0000 7f05e253e640 1 Processor -- start 2023-12-20T04:48:25.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.261+0000 7f05e253e640 1 -- start start 2023-12-20T04:48:25.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.262+0000 7f05e253e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05dc0cdc10 0x7f05dc0b2290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.262+0000 7f05e253e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05dc0d0370 0x7f05dc0c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.262+0000 7f05e253e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05dc15d100 0x7f05dc15ad60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.262+0000 7f05e253e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc154730 con 0x7f05dc0d0370 2023-12-20T04:48:25.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.262+0000 7f05e253e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc1591e0 con 0x7f05dc0cdc10 2023-12-20T04:48:25.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.262+0000 7f05e253e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05dc1f66b0 con 0x7f05dc15d100 2023-12-20T04:48:25.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.262+0000 7f05db7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05dc0d0370 0x7f05dc0c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:25.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.262+0000 7f05db7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05dc0d0370 0x7f05dc0c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34460/0 (socket says 172.21.15.132:34460) 2023-12-20T04:48:25.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.262+0000 7f05db7fe640 1 -- 172.21.15.132:0/3767263346 learned_addr learned my addr 172.21.15.132:0/3767263346 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:25.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.262+0000 7f05e0adb640 1 --2- 172.21.15.132:0/3767263346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05dc15d100 0x7f05dc15ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:25.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.262+0000 7f05db7fe640 1 -- 172.21.15.132:0/3767263346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05dc15d100 msgr2=0x7f05dc15ad60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.262+0000 7f05db7fe640 1 --2- 172.21.15.132:0/3767263346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05dc15d100 0x7f05dc15ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.262+0000 7f05db7fe640 1 -- 172.21.15.132:0/3767263346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05dc0cdc10 msgr2=0x7f05dc0b2290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.262+0000 7f05db7fe640 1 --2- 172.21.15.132:0/3767263346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05dc0cdc10 0x7f05dc0b2290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.262+0000 7f05db7fe640 1 -- 172.21.15.132:0/3767263346 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05d00094d0 con 0x7f05dc0d0370 2023-12-20T04:48:25.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.262+0000 7f05db7fe640 1 --2- 172.21.15.132:0/3767263346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05dc0d0370 0x7f05dc0c7ea0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f05d0000c00 tx=0x7f05d00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:25.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.263+0000 7f05d8ff9640 1 -- 172.21.15.132:0/3767263346 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d003ad10 con 0x7f05dc0d0370 2023-12-20T04:48:25.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.263+0000 7f05d8ff9640 1 -- 172.21.15.132:0/3767263346 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f05d003ae70 con 0x7f05dc0d0370 2023-12-20T04:48:25.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.263+0000 7f05e253e640 1 -- 172.21.15.132:0/3767263346 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05dc1f6990 con 0x7f05dc0d0370 2023-12-20T04:48:25.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.263+0000 7f05d8ff9640 1 -- 172.21.15.132:0/3767263346 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05d0044610 con 0x7f05dc0d0370 2023-12-20T04:48:25.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.263+0000 7f05e253e640 1 -- 172.21.15.132:0/3767263346 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05dc1f6f50 con 0x7f05dc0d0370 2023-12-20T04:48:25.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.264+0000 7f05e253e640 1 -- 172.21.15.132:0/3767263346 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05dc04e840 con 0x7f05dc0d0370 2023-12-20T04:48:25.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.264+0000 7f05d8ff9640 1 -- 172.21.15.132:0/3767263346 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f05d004d450 con 0x7f05dc0d0370 2023-12-20T04:48:25.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.264+0000 7f05d8ff9640 1 --2- 172.21.15.132:0/3767263346 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f05c806a430 0x7f05c806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.265+0000 7f05d8ff9640 1 -- 172.21.15.132:0/3767263346 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f05d002d040 con 0x7f05dc0d0370 2023-12-20T04:48:25.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.265+0000 7f05dbfff640 1 --2- 172.21.15.132:0/3767263346 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f05c806a430 0x7f05c806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:25.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.265+0000 7f05dbfff640 1 --2- 172.21.15.132:0/3767263346 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f05c806a430 0x7f05c806c8f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f05cc001560 tx=0x7f05cc007990 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:25.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.269+0000 7f05d8ff9640 1 -- 172.21.15.132:0/3767263346 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f05d00764f0 con 0x7f05dc0d0370 2023-12-20T04:48:25.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.470+0000 7f05e253e640 1 -- 172.21.15.132:0/3767263346 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f05dc0b2f90 con 0x7f05dc0d0370 2023-12-20T04:48:25.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.470+0000 7f05d8ff9640 1 -- 172.21.15.132:0/3767263346 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f05dc0b2f90 con 0x7f05dc0d0370 2023-12-20T04:48:25.472 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:25.472 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":45,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3951194420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3951194420},{"type":"v1","addr":"172.21.15.187:6833","nonce":3951194420}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1575999914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1575999914},{"type":"v1","addr":"172.21.15.187:6835","nonce":1575999914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2208233017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2208233017},{"type":"v1","addr":"172.21.15.132:6836","nonce":2208233017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:48:04.456610+0000","modified":"2023-12-20T04:48:07.132847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7422":{"gid":7422,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/3935356761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":3935356761},{"type":"v1","addr":"172.21.15.132:6837","nonce":3935356761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-20T04:48:25.473 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 45 2023-12-20T04:48:25.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.472+0000 7f05e253e640 1 -- 172.21.15.132:0/3767263346 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f05c806a430 msgr2=0x7f05c806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.472+0000 7f05e253e640 1 --2- 172.21.15.132:0/3767263346 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f05c806a430 0x7f05c806c8f0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 crypto rx=0x7f05cc001560 tx=0x7f05cc007990 comp rx=0 tx=0).stop 2023-12-20T04:48:25.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.472+0000 7f05e253e640 1 -- 172.21.15.132:0/3767263346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05dc0d0370 msgr2=0x7f05dc0c7ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.472+0000 7f05e253e640 1 --2- 172.21.15.132:0/3767263346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05dc0d0370 0x7f05dc0c7ea0 secure :-1 s=READY pgs=1278 cs=0 l=1 rev1=1 crypto rx=0x7f05d0000c00 tx=0x7f05d00046c0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.472+0000 7f05e253e640 1 -- 172.21.15.132:0/3767263346 shutdown_connections 2023-12-20T04:48:25.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.472+0000 7f05e253e640 1 --2- 172.21.15.132:0/3767263346 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f05c806a430 0x7f05c806c8f0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.472+0000 7f05e253e640 1 --2- 172.21.15.132:0/3767263346 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05dc15d100 0x7f05dc15ad60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.472+0000 7f05e253e640 1 --2- 172.21.15.132:0/3767263346 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05dc0d0370 0x7f05dc0c7ea0 unknown :-1 s=CLOSED pgs=1278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.472+0000 7f05e253e640 1 --2- 172.21.15.132:0/3767263346 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05dc0cdc10 0x7f05dc0b2290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.472+0000 7f05e253e640 1 -- 172.21.15.132:0/3767263346 >> 172.21.15.132:0/3767263346 conn(0x7f05dc06d7c0 msgr2=0x7f05dc15b630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:25.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.472+0000 7f05e253e640 1 -- 172.21.15.132:0/3767263346 shutdown_connections 2023-12-20T04:48:25.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.472+0000 7f05e253e640 1 -- 172.21.15.132:0/3767263346 wait complete. 2023-12-20T04:48:25.486 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:48:25.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.583+0000 7f0ff8cfb640 1 Processor -- start 2023-12-20T04:48:25.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.583+0000 7f0ff8cfb640 1 -- start start 2023-12-20T04:48:25.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff8cfb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff4159b50 0x7f0ff40c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff8cfb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff40ccf30 con 0x7f0ff406c240 2023-12-20T04:48:25.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff8cfb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ff40ca1c0 con 0x7f0ff415e530 2023-12-20T04:48:25.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff8cfb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40caa60 con 0x7f0ff4159b50 2023-12-20T04:48:25.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff2d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0ff406c240 0x7f0ff40cd3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57196/0 (socket says 172.21.15.132:57196) 2023-12-20T04:48:25.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff2d9d640 1 -- 172.21.15.132:0/884597292 learned_addr learned my addr 172.21.15.132:0/884597292 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:25.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff259c640 1 --2- 172.21.15.132:0/884597292 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff4159b50 0x7f0ff40c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:25.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff1d9b640 1 -- 172.21.15.132:0/884597292 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1482610414 0 0) 0x7f0ff40ccf30 con 0x7f0ff406c240 2023-12-20T04:48:25.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff1d9b640 1 -- 172.21.15.132:0/884597292 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0fe0003520 con 0x7f0ff406c240 2023-12-20T04:48:25.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff1d9b640 1 -- 172.21.15.132:0/884597292 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1714778255 0 0) 0x7f0fe0003520 con 0x7f0ff406c240 2023-12-20T04:48:25.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff1d9b640 1 -- 172.21.15.132:0/884597292 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff4159b50 msgr2=0x7f0ff40c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:25.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff1d9b640 1 --2- 172.21.15.132:0/884597292 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff4159b50 0x7f0ff40c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff1d9b640 1 -- 172.21.15.132:0/884597292 >> v1:172.21.15.187:6789/0 conn(0x7f0ff415e530 legacy=0x7f0ff406fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff1d9b640 1 -- 172.21.15.132:0/884597292 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff40ca4a0 con 0x7f0ff406c240 2023-12-20T04:48:25.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff1d9b640 1 -- 172.21.15.132:0/884597292 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f0fec0019f0 con 0x7f0ff406c240 2023-12-20T04:48:25.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff1d9b640 1 -- 172.21.15.132:0/884597292 >> v1:172.21.15.132:6789/0 conn(0x7f0ff406c240 legacy=0x7f0ff40cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff1d9b640 1 --2- 172.21.15.132:0/884597292 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff4159b50 0x7f0fe00039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.584+0000 7f0ff1d9b640 1 --2- 172.21.15.132:0/884597292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fe0003f20 0x7f0fe00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.585+0000 7f0ff1d9b640 1 --2- 172.21.15.132:0/884597292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fe0004d00 0x7f0fe0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.585+0000 7f0ff1d9b640 1 -- 172.21.15.132:0/884597292 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff40caa60 con 0x7f0fe0003f20 2023-12-20T04:48:25.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.585+0000 7f0ff1d9b640 1 -- 172.21.15.132:0/884597292 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe000ba60 con 0x7f0fe0004d00 2023-12-20T04:48:25.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.585+0000 7f0ff1d9b640 1 -- 172.21.15.132:0/884597292 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fe000bc20 con 0x7f0ff4159b50 2023-12-20T04:48:25.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.585+0000 7f0febfff640 1 --2- 172.21.15.132:0/884597292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fe0003f20 0x7f0fe00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:25.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.585+0000 7f0ff259c640 1 --2- 172.21.15.132:0/884597292 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff4159b50 0x7f0fe00039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:25.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.585+0000 7f0ff2d9d640 1 --2- 172.21.15.132:0/884597292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fe0004d00 0x7f0fe0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:25.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.585+0000 7f0febfff640 1 -- 172.21.15.132:0/884597292 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff4159b50 msgr2=0x7f0fe00039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:25.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.585+0000 7f0febfff640 1 --2- 172.21.15.132:0/884597292 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff4159b50 0x7f0fe00039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.585+0000 7f0febfff640 1 -- 172.21.15.132:0/884597292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fe0004d00 msgr2=0x7f0fe0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:25.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.585+0000 7f0febfff640 1 --2- 172.21.15.132:0/884597292 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fe0004d00 0x7f0fe0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.585+0000 7f0febfff640 1 -- 172.21.15.132:0/884597292 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fe0003520 con 0x7f0fe0003f20 2023-12-20T04:48:25.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.586+0000 7f0febfff640 1 --2- 172.21.15.132:0/884597292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fe0003f20 0x7f0fe00047c0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc001750 tx=0x7f0fe00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cb4d65355f51aec server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:25.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.586+0000 7f0ff1d9b640 1 -- 172.21.15.132:0/884597292 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0052d0 con 0x7f0fe0003f20 2023-12-20T04:48:25.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.586+0000 7f0ff1d9b640 1 -- 172.21.15.132:0/884597292 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc02e050 con 0x7f0fe0003f20 2023-12-20T04:48:25.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.586+0000 7f0ff1d9b640 1 -- 172.21.15.132:0/884597292 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc003830 con 0x7f0fe0003f20 2023-12-20T04:48:25.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.586+0000 7f0ff8cfb640 1 -- 172.21.15.132:0/884597292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fe0003f20 msgr2=0x7f0fe00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.586+0000 7f0ff8cfb640 1 --2- 172.21.15.132:0/884597292 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fe0003f20 0x7f0fe00047c0 secure :-1 s=READY pgs=1280 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc001750 tx=0x7f0fe00057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.586+0000 7f0ff2d9d640 1 -- 172.21.15.132:0/884597292 reap_dead start 2023-12-20T04:48:25.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.586+0000 7f0ff8cfb640 1 -- 172.21.15.132:0/884597292 shutdown_connections 2023-12-20T04:48:25.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.586+0000 7f0ff8cfb640 1 -- 172.21.15.132:0/884597292 >> 172.21.15.132:0/884597292 conn(0x7f0ff40ced10 msgr2=0x7f0ff40cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:25.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.586+0000 7f0ff8cfb640 1 -- 172.21.15.132:0/884597292 shutdown_connections 2023-12-20T04:48:25.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.586+0000 7f0ff8cfb640 1 -- 172.21.15.132:0/884597292 wait complete. 2023-12-20T04:48:25.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.588+0000 7f0ff8cfb640 1 Processor -- start 2023-12-20T04:48:25.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.588+0000 7f0ff8cfb640 1 -- start start 2023-12-20T04:48:25.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.588+0000 7f0ff8cfb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fe0003f20 0x7f0ff406b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.588+0000 7f0ff8cfb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff4157f20 0x7f0ff4158360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.588+0000 7f0ff8cfb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff40b3030 0x7f0ff40b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.588+0000 7f0ff8cfb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff415aa20 con 0x7f0ff4157f20 2023-12-20T04:48:25.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.588+0000 7f0ff8cfb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff41588a0 con 0x7f0fe0003f20 2023-12-20T04:48:25.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.588+0000 7f0ff8cfb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ff4155ae0 con 0x7f0ff40b3030 2023-12-20T04:48:25.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.588+0000 7f0febfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff4157f20 0x7f0ff4158360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:25.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.588+0000 7f0febfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff4157f20 0x7f0ff4158360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34464/0 (socket says 172.21.15.132:34464) 2023-12-20T04:48:25.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.588+0000 7f0febfff640 1 -- 172.21.15.132:0/3621131698 learned_addr learned my addr 172.21.15.132:0/3621131698 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:25.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.588+0000 7f0ff259c640 1 --2- 172.21.15.132:0/3621131698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fe0003f20 0x7f0ff406b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:25.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.588+0000 7f0ff2d9d640 1 --2- 172.21.15.132:0/3621131698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff40b3030 0x7f0ff40b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:25.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.589+0000 7f0febfff640 1 -- 172.21.15.132:0/3621131698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff40b3030 msgr2=0x7f0ff40b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.589+0000 7f0febfff640 1 --2- 172.21.15.132:0/3621131698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff40b3030 0x7f0ff40b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.589+0000 7f0febfff640 1 -- 172.21.15.132:0/3621131698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fe0003f20 msgr2=0x7f0ff406b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.589+0000 7f0febfff640 1 --2- 172.21.15.132:0/3621131698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fe0003f20 0x7f0ff406b3a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.589+0000 7f0febfff640 1 -- 172.21.15.132:0/3621131698 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ff41590c0 con 0x7f0ff4157f20 2023-12-20T04:48:25.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.589+0000 7f0febfff640 1 --2- 172.21.15.132:0/3621131698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff4157f20 0x7f0ff4158360 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc008fd0 tx=0x7f0fdc001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:25.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.589+0000 7f0feaffd640 1 -- 172.21.15.132:0/3621131698 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc0076c0 con 0x7f0ff4157f20 2023-12-20T04:48:25.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.589+0000 7f0feaffd640 1 -- 172.21.15.132:0/3621131698 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0fdc007a30 con 0x7f0ff4157f20 2023-12-20T04:48:25.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.589+0000 7f0feaffd640 1 -- 172.21.15.132:0/3621131698 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0fdc006be0 con 0x7f0ff4157f20 2023-12-20T04:48:25.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.589+0000 7f0ff8cfb640 1 -- 172.21.15.132:0/3621131698 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ff4158b00 con 0x7f0ff4157f20 2023-12-20T04:48:25.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.589+0000 7f0ff8cfb640 1 -- 172.21.15.132:0/3621131698 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ff415a6b0 con 0x7f0ff4157f20 2023-12-20T04:48:25.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.590+0000 7f0ff8cfb640 1 -- 172.21.15.132:0/3621131698 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ff415a840 con 0x7f0ff4157f20 2023-12-20T04:48:25.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.590+0000 7f0feaffd640 1 -- 172.21.15.132:0/3621131698 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0fdc006d40 con 0x7f0ff4157f20 2023-12-20T04:48:25.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.591+0000 7f0feaffd640 1 --2- 172.21.15.132:0/3621131698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fd406a460 0x7f0fd406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.591+0000 7f0ff259c640 1 --2- 172.21.15.132:0/3621131698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fd406a460 0x7f0fd406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:25.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.591+0000 7f0feaffd640 1 -- 172.21.15.132:0/3621131698 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0fdc0aa5a0 con 0x7f0ff4157f20 2023-12-20T04:48:25.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.591+0000 7f0ff259c640 1 --2- 172.21.15.132:0/3621131698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fd406a460 0x7f0fd406c920 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4009b00 tx=0x7f0fe4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:25.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.595+0000 7f0feaffd640 1 -- 172.21.15.132:0/3621131698 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0fdc075c20 con 0x7f0ff4157f20 2023-12-20T04:48:25.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.794+0000 7f0ff8cfb640 1 -- 172.21.15.132:0/3621131698 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0ff415aa20 con 0x7f0ff4157f20 2023-12-20T04:48:25.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.794+0000 7f0feaffd640 1 -- 172.21.15.132:0/3621131698 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 45 v45) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f0fdc079240 con 0x7f0ff4157f20 2023-12-20T04:48:25.797 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:25.797 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":45,"default_fscid":7,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3951194420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3951194420},{"type":"v1","addr":"172.21.15.187:6833","nonce":3951194420}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1575999914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1575999914},{"type":"v1","addr":"172.21.15.187:6835","nonce":1575999914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2208233017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2208233017},{"type":"v1","addr":"172.21.15.132:6836","nonce":2208233017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41}],"filesystems":[{"mdsmap":{"epoch":45,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:48:04.456610+0000","modified":"2023-12-20T04:48:07.132847+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7422},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7422":{"gid":7422,"name":"a","rank":0,"incarnation":42,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/3935356761","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":3935356761},{"type":"v1","addr":"172.21.15.132:6837","nonce":3935356761}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[15],"metadata_pool":14,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":7}]} 2023-12-20T04:48:25.797 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 45 2023-12-20T04:48:25.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.796+0000 7f0ff8cfb640 1 -- 172.21.15.132:0/3621131698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fd406a460 msgr2=0x7f0fd406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.796+0000 7f0ff8cfb640 1 --2- 172.21.15.132:0/3621131698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fd406a460 0x7f0fd406c920 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f0fe4009b00 tx=0x7f0fe4008040 comp rx=0 tx=0).stop 2023-12-20T04:48:25.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.796+0000 7f0ff8cfb640 1 -- 172.21.15.132:0/3621131698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff4157f20 msgr2=0x7f0ff4158360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.796+0000 7f0ff8cfb640 1 --2- 172.21.15.132:0/3621131698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff4157f20 0x7f0ff4158360 secure :-1 s=READY pgs=1281 cs=0 l=1 rev1=1 crypto rx=0x7f0fdc008fd0 tx=0x7f0fdc001120 comp rx=0 tx=0).stop 2023-12-20T04:48:25.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.796+0000 7f0ff8cfb640 1 -- 172.21.15.132:0/3621131698 shutdown_connections 2023-12-20T04:48:25.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.796+0000 7f0ff8cfb640 1 --2- 172.21.15.132:0/3621131698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0fd406a460 0x7f0fd406c920 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.796+0000 7f0ff8cfb640 1 --2- 172.21.15.132:0/3621131698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ff40b3030 0x7f0ff40b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.796+0000 7f0ff8cfb640 1 --2- 172.21.15.132:0/3621131698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ff4157f20 0x7f0ff4158360 unknown :-1 s=CLOSED pgs=1281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.796+0000 7f0ff8cfb640 1 --2- 172.21.15.132:0/3621131698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fe0003f20 0x7f0ff406b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.796+0000 7f0ff8cfb640 1 -- 172.21.15.132:0/3621131698 >> 172.21.15.132:0/3621131698 conn(0x7f0ff40ced10 msgr2=0x7f0ff4154120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:25.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.796+0000 7f0ff8cfb640 1 -- 172.21.15.132:0/3621131698 shutdown_connections 2023-12-20T04:48:25.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.796+0000 7f0ff8cfb640 1 -- 172.21.15.132:0/3621131698 wait complete. 2023-12-20T04:48:25.809 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:48:25.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.907+0000 7ff99ac84640 1 Processor -- start 2023-12-20T04:48:25.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.907+0000 7ff99ac84640 1 -- start start 2023-12-20T04:48:25.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.908+0000 7ff99ac84640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff99406a340 0x7ff99415dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.908+0000 7ff99ac84640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff994161220 con 0x7ff994160d70 2023-12-20T04:48:25.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.908+0000 7ff99ac84640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff99406d530 con 0x7ff99415ab70 2023-12-20T04:48:25.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.908+0000 7ff99ac84640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff994070540 con 0x7ff99406a340 2023-12-20T04:48:25.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.908+0000 7ff999221640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff99406a340 0x7ff99415dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:25.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.908+0000 7ff999221640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff99406a340 0x7ff99415dad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34466/0 (socket says 172.21.15.132:34466) 2023-12-20T04:48:25.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.908+0000 7ff999221640 1 -- 172.21.15.132:0/147293168 learned_addr learned my addr 172.21.15.132:0/147293168 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:25.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.908+0000 7ff993fff640 1 --1- 172.21.15.132:0/147293168 >> v1:172.21.15.132:6789/0 conn(0x7ff994160d70 0x7ff994069c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57204/0 (socket says 172.21.15.132:57204) 2023-12-20T04:48:25.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.909+0000 7ff999221640 1 -- 172.21.15.132:0/147293168 >> v1:172.21.15.187:6789/0 conn(0x7ff99415ab70 legacy=0x7ff9940cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.909+0000 7ff999221640 1 -- 172.21.15.132:0/147293168 >> v1:172.21.15.132:6789/0 conn(0x7ff994160d70 legacy=0x7ff994069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.909+0000 7ff999221640 1 -- 172.21.15.132:0/147293168 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff994070790 con 0x7ff99406a340 2023-12-20T04:48:25.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.909+0000 7ff9937fe640 1 -- 172.21.15.132:0/147293168 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2374064747 0 0) 0x7ff994161220 con 0x7ff994160d70 2023-12-20T04:48:25.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.909+0000 7ff999221640 1 --2- 172.21.15.132:0/147293168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff99406a340 0x7ff99415dad0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7ff98c009e50 tx=0x7ff98c02c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=697602615f56491b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:25.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.909+0000 7ff9937fe640 1 -- 172.21.15.132:0/147293168 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c02cbb0 con 0x7ff99406a340 2023-12-20T04:48:25.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.910+0000 7ff9937fe640 1 -- 172.21.15.132:0/147293168 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c02cd10 con 0x7ff99406a340 2023-12-20T04:48:25.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.910+0000 7ff9937fe640 1 -- 172.21.15.132:0/147293168 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c034610 con 0x7ff99406a340 2023-12-20T04:48:25.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.910+0000 7ff99ac84640 1 -- 172.21.15.132:0/147293168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff99406a340 msgr2=0x7ff99415dad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.910+0000 7ff99ac84640 1 --2- 172.21.15.132:0/147293168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff99406a340 0x7ff99415dad0 secure :-1 s=READY pgs=1283 cs=0 l=1 rev1=1 crypto rx=0x7ff98c009e50 tx=0x7ff98c02c010 comp rx=0 tx=0).stop 2023-12-20T04:48:25.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.910+0000 7ff99ac84640 1 -- 172.21.15.132:0/147293168 shutdown_connections 2023-12-20T04:48:25.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.910+0000 7ff99ac84640 1 --2- 172.21.15.132:0/147293168 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff99406a340 0x7ff99415dad0 unknown :-1 s=CLOSED pgs=1283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.910+0000 7ff99ac84640 1 -- 172.21.15.132:0/147293168 >> 172.21.15.132:0/147293168 conn(0x7ff9940cfca0 msgr2=0x7ff9940d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:25.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.910+0000 7ff99ac84640 1 -- 172.21.15.132:0/147293168 shutdown_connections 2023-12-20T04:48:25.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.910+0000 7ff99ac84640 1 -- 172.21.15.132:0/147293168 wait complete. 2023-12-20T04:48:25.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.911+0000 7ff99ac84640 1 Processor -- start 2023-12-20T04:48:25.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.911+0000 7ff99ac84640 1 -- start start 2023-12-20T04:48:25.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.912+0000 7ff99ac84640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff99406a340 0x7ff994159440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.912+0000 7ff99ac84640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff99415ab70 0x7ff9940ca3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.912+0000 7ff99ac84640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff994160d70 0x7ff99415f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.912+0000 7ff99ac84640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9940cb750 con 0x7ff994160d70 2023-12-20T04:48:25.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.912+0000 7ff99ac84640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9940caeb0 con 0x7ff99415ab70 2023-12-20T04:48:25.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.912+0000 7ff99ac84640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9940cb190 con 0x7ff99406a340 2023-12-20T04:48:25.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.912+0000 7ff999221640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff994160d70 0x7ff99415f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:25.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.912+0000 7ff999221640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff994160d70 0x7ff99415f9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34476/0 (socket says 172.21.15.132:34476) 2023-12-20T04:48:25.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.912+0000 7ff999221640 1 -- 172.21.15.132:0/183164575 learned_addr learned my addr 172.21.15.132:0/183164575 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:25.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.912+0000 7ff999221640 1 -- 172.21.15.132:0/183164575 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff99406a340 msgr2=0x7ff994159440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.912+0000 7ff999221640 1 --2- 172.21.15.132:0/183164575 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff99406a340 0x7ff994159440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.912+0000 7ff999221640 1 -- 172.21.15.132:0/183164575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff99415ab70 msgr2=0x7ff9940ca3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:25.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.912+0000 7ff993fff640 1 --2- 172.21.15.132:0/183164575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff99415ab70 0x7ff9940ca3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:25.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.913+0000 7ff999221640 1 --2- 172.21.15.132:0/183164575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff99415ab70 0x7ff9940ca3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:25.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.913+0000 7ff999221640 1 -- 172.21.15.132:0/183164575 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff98c009b30 con 0x7ff994160d70 2023-12-20T04:48:25.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.913+0000 7ff999221640 1 --2- 172.21.15.132:0/183164575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff994160d70 0x7ff99415f9e0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7ff98c036040 tx=0x7ff98c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:25.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.913+0000 7ff9917fa640 1 -- 172.21.15.132:0/183164575 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c003990 con 0x7ff994160d70 2023-12-20T04:48:25.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.913+0000 7ff9917fa640 1 -- 172.21.15.132:0/183164575 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff98c003af0 con 0x7ff994160d70 2023-12-20T04:48:25.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.913+0000 7ff9917fa640 1 -- 172.21.15.132:0/183164575 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff98c003c80 con 0x7ff994160d70 2023-12-20T04:48:25.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.913+0000 7ff99ac84640 1 -- 172.21.15.132:0/183164575 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9940cb470 con 0x7ff994160d70 2023-12-20T04:48:25.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.913+0000 7ff99ac84640 1 -- 172.21.15.132:0/183164575 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9940af640 con 0x7ff994160d70 2023-12-20T04:48:25.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.914+0000 7ff99ac84640 1 -- 172.21.15.132:0/183164575 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9940c6d70 con 0x7ff994160d70 2023-12-20T04:48:25.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.914+0000 7ff9917fa640 1 -- 172.21.15.132:0/183164575 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff98c048460 con 0x7ff994160d70 2023-12-20T04:48:25.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.915+0000 7ff9917fa640 1 --2- 172.21.15.132:0/183164575 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff98006a430 0x7ff98006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:25.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.915+0000 7ff9917fa640 1 -- 172.21.15.132:0/183164575 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff98c0aaf70 con 0x7ff994160d70 2023-12-20T04:48:25.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.915+0000 7ff998a20640 1 --2- 172.21.15.132:0/183164575 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff98006a430 0x7ff98006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:25.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.915+0000 7ff998a20640 1 --2- 172.21.15.132:0/183164575 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff98006a430 0x7ff98006c8f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff984000f60 tx=0x7ff9840079b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:25.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:25.919+0000 7ff9917fa640 1 -- 172.21.15.132:0/183164575 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff98c0ddca0 con 0x7ff994160d70 2023-12-20T04:48:26.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.085+0000 7ff99ac84640 1 -- 172.21.15.132:0/183164575 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff99404e840 con 0x7ff994160d70 2023-12-20T04:48:26.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.086+0000 7ff9917fa640 1 -- 172.21.15.132:0/183164575 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v125) v1 ==== 74+0+16107 (secure 0 0 0) 0x7ff9940c6d70 con 0x7ff994160d70 2023-12-20T04:48:26.088 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:26.088 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":125,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:48:16.867874+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":14,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:48:02.660300+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"121","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":15,"pool_name":"cephfs_data","create_time":"2023-12-20T04:48:03.433311+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"123","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:48:26.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.088+0000 7ff99ac84640 1 -- 172.21.15.132:0/183164575 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff98006a430 msgr2=0x7ff98006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:26.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.088+0000 7ff99ac84640 1 --2- 172.21.15.132:0/183164575 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff98006a430 0x7ff98006c8f0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7ff984000f60 tx=0x7ff9840079b0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.088+0000 7ff99ac84640 1 -- 172.21.15.132:0/183164575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff994160d70 msgr2=0x7ff99415f9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.088+0000 7ff99ac84640 1 --2- 172.21.15.132:0/183164575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff994160d70 0x7ff99415f9e0 secure :-1 s=READY pgs=1284 cs=0 l=1 rev1=1 crypto rx=0x7ff98c036040 tx=0x7ff98c004a40 comp rx=0 tx=0).stop 2023-12-20T04:48:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.088+0000 7ff99ac84640 1 -- 172.21.15.132:0/183164575 shutdown_connections 2023-12-20T04:48:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.088+0000 7ff99ac84640 1 --2- 172.21.15.132:0/183164575 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff98006a430 0x7ff98006c8f0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.088+0000 7ff99ac84640 1 --2- 172.21.15.132:0/183164575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff994160d70 0x7ff99415f9e0 unknown :-1 s=CLOSED pgs=1284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.088+0000 7ff99ac84640 1 --2- 172.21.15.132:0/183164575 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff99415ab70 0x7ff9940ca3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.088+0000 7ff99ac84640 1 --2- 172.21.15.132:0/183164575 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff99406a340 0x7ff994159440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.088+0000 7ff99ac84640 1 -- 172.21.15.132:0/183164575 >> 172.21.15.132:0/183164575 conn(0x7ff9940cfca0 msgr2=0x7ff994069c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.088+0000 7ff99ac84640 1 -- 172.21.15.132:0/183164575 shutdown_connections 2023-12-20T04:48:26.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.088+0000 7ff99ac84640 1 -- 172.21.15.132:0/183164575 wait complete. 2023-12-20T04:48:26.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-20T04:48:26.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.201+0000 7f8a8bc2c640 1 Processor -- start 2023-12-20T04:48:26.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.202+0000 7f8a8bc2c640 1 -- start start 2023-12-20T04:48:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.202+0000 7f8a8bc2c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8a840d0520 0x7f8a8415e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.202+0000 7f8a8bc2c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a8415e570 0x7f8a8406ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.202+0000 7f8a8bc2c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a8415b2e0 con 0x7f8a8415af00 2023-12-20T04:48:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.202+0000 7f8a8bc2c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a8415dc10 con 0x7f8a840d0520 2023-12-20T04:48:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.202+0000 7f8a8bc2c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a840d09b0 con 0x7f8a8415e570 2023-12-20T04:48:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.203+0000 7f8a891c7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8a840d0520 0x7f8a8415e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.203+0000 7f8a891c7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8a840d0520 0x7f8a8415e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34484/0 (socket says 172.21.15.132:34484) 2023-12-20T04:48:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.203+0000 7f8a891c7640 1 -- 172.21.15.132:0/3167616195 learned_addr learned my addr 172.21.15.132:0/3167616195 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.203+0000 7f8a8a1c9640 1 --2- 172.21.15.132:0/3167616195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a8415e570 0x7f8a8406ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.203+0000 7f8a891c7640 1 -- 172.21.15.132:0/3167616195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a8415e570 msgr2=0x7f8a8406ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:26.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.203+0000 7f8a891c7640 1 --2- 172.21.15.132:0/3167616195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a8415e570 0x7f8a8406ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.203+0000 7f8a891c7640 1 -- 172.21.15.132:0/3167616195 >> v1:172.21.15.187:6789/0 conn(0x7f8a8415af00 legacy=0x7f8a84160e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:26.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.203+0000 7f8a891c7640 1 -- 172.21.15.132:0/3167616195 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a84161660 con 0x7f8a840d0520 2023-12-20T04:48:26.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.204+0000 7f8a891c7640 1 --2- 172.21.15.132:0/3167616195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a840d0520 0x7f8a8415e030 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f8a740098a0 tx=0x7f8a7402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0080e2d81a1e21 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:26.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.204+0000 7f8a889c6640 1 -- 172.21.15.132:0/3167616195 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a740317c0 con 0x7f8a840d0520 2023-12-20T04:48:26.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.204+0000 7f8a889c6640 1 -- 172.21.15.132:0/3167616195 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a74031920 con 0x7f8a840d0520 2023-12-20T04:48:26.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.204+0000 7f8a889c6640 1 -- 172.21.15.132:0/3167616195 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a74031cb0 con 0x7f8a840d0520 2023-12-20T04:48:26.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.204+0000 7f8a8bc2c640 1 -- 172.21.15.132:0/3167616195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a840d0520 msgr2=0x7f8a8415e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:26.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.204+0000 7f8a8bc2c640 1 --2- 172.21.15.132:0/3167616195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a840d0520 0x7f8a8415e030 secure :-1 s=READY pgs=1285 cs=0 l=1 rev1=1 crypto rx=0x7f8a740098a0 tx=0x7f8a7402b860 comp rx=0 tx=0).stop 2023-12-20T04:48:26.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.204+0000 7f8a8bc2c640 1 -- 172.21.15.132:0/3167616195 shutdown_connections 2023-12-20T04:48:26.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.204+0000 7f8a8bc2c640 1 --2- 172.21.15.132:0/3167616195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a8415e570 0x7f8a8406ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.204+0000 7f8a8bc2c640 1 --2- 172.21.15.132:0/3167616195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a840d0520 0x7f8a8415e030 unknown :-1 s=CLOSED pgs=1285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.204+0000 7f8a8bc2c640 1 -- 172.21.15.132:0/3167616195 >> 172.21.15.132:0/3167616195 conn(0x7f8a8406d640 msgr2=0x7f8a8406da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:26.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.204+0000 7f8a8bc2c640 1 -- 172.21.15.132:0/3167616195 shutdown_connections 2023-12-20T04:48:26.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.204+0000 7f8a8bc2c640 1 -- 172.21.15.132:0/3167616195 wait complete. 2023-12-20T04:48:26.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.205+0000 7f8a8bc2c640 1 Processor -- start 2023-12-20T04:48:26.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.206+0000 7f8a8bc2c640 1 -- start start 2023-12-20T04:48:26.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.206+0000 7f8a8bc2c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a840d0520 0x7f8a84156170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:26.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.206+0000 7f8a8bc2c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a8415af00 0x7f8a840b1940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:26.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.206+0000 7f8a8bc2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a8415e570 0x7f8a84156a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:26.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.206+0000 7f8a8bc2c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a840ac8e0 con 0x7f8a8415e570 2023-12-20T04:48:26.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.206+0000 7f8a8bc2c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a84157470 con 0x7f8a8415af00 2023-12-20T04:48:26.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.206+0000 7f8a8bc2c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a84157750 con 0x7f8a840d0520 2023-12-20T04:48:26.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.206+0000 7f8a8a1c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a8415e570 0x7f8a84156a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:26.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.206+0000 7f8a8a1c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a8415e570 0x7f8a84156a20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34488/0 (socket says 172.21.15.132:34488) 2023-12-20T04:48:26.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.206+0000 7f8a8a1c9640 1 -- 172.21.15.132:0/170828602 learned_addr learned my addr 172.21.15.132:0/170828602 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:26.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.206+0000 7f8a899c8640 1 --2- 172.21.15.132:0/170828602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a840d0520 0x7f8a84156170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:26.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.206+0000 7f8a891c7640 1 --2- 172.21.15.132:0/170828602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a8415af00 0x7f8a840b1940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:26.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.207+0000 7f8a8a1c9640 1 -- 172.21.15.132:0/170828602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a840d0520 msgr2=0x7f8a84156170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:26.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.207+0000 7f8a8a1c9640 1 --2- 172.21.15.132:0/170828602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a840d0520 0x7f8a84156170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.207+0000 7f8a8a1c9640 1 -- 172.21.15.132:0/170828602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a8415af00 msgr2=0x7f8a840b1940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:26.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.207+0000 7f8a8a1c9640 1 --2- 172.21.15.132:0/170828602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a8415af00 0x7f8a840b1940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.207+0000 7f8a8a1c9640 1 -- 172.21.15.132:0/170828602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a740094d0 con 0x7f8a8415e570 2023-12-20T04:48:26.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.207+0000 7f8a891c7640 1 --2- 172.21.15.132:0/170828602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a8415af00 0x7f8a840b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:26.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.207+0000 7f8a8a1c9640 1 --2- 172.21.15.132:0/170828602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a8415e570 0x7f8a84156a20 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f8a80007e40 tx=0x7f8a8000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:26.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.207+0000 7f8a7a7fc640 1 -- 172.21.15.132:0/170828602 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a80014620 con 0x7f8a8415e570 2023-12-20T04:48:26.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.207+0000 7f8a7a7fc640 1 -- 172.21.15.132:0/170828602 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a8000ee90 con 0x7f8a8415e570 2023-12-20T04:48:26.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.207+0000 7f8a7a7fc640 1 -- 172.21.15.132:0/170828602 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a800149e0 con 0x7f8a8415e570 2023-12-20T04:48:26.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.207+0000 7f8a8bc2c640 1 -- 172.21.15.132:0/170828602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a84157a30 con 0x7f8a8415e570 2023-12-20T04:48:26.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.207+0000 7f8a8bc2c640 1 -- 172.21.15.132:0/170828602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a841566b0 con 0x7f8a8415e570 2023-12-20T04:48:26.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.208+0000 7f8a8bc2c640 1 -- 172.21.15.132:0/170828602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a840acd70 con 0x7f8a8415e570 2023-12-20T04:48:26.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.208+0000 7f8a7a7fc640 1 -- 172.21.15.132:0/170828602 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8a80014b40 con 0x7f8a8415e570 2023-12-20T04:48:26.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.209+0000 7f8a7a7fc640 1 --2- 172.21.15.132:0/170828602 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8a6806a430 0x7f8a6806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:26.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.209+0000 7f8a899c8640 1 --2- 172.21.15.132:0/170828602 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8a6806a430 0x7f8a6806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:26.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.209+0000 7f8a7a7fc640 1 -- 172.21.15.132:0/170828602 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(125..125 src has 1..125) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8a80089230 con 0x7f8a8415e570 2023-12-20T04:48:26.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.209+0000 7f8a899c8640 1 --2- 172.21.15.132:0/170828602 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8a6806a430 0x7f8a6806c8f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c004f60 tx=0x7f8a7c007e30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:26.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.213+0000 7f8a7a7fc640 1 -- 172.21.15.132:0/170828602 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8a840acd70 con 0x7f8a8415e570 2023-12-20T04:48:26.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.415+0000 7f8a8bc2c640 1 -- 172.21.15.132:0/170828602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f8a840acd70 con 0x7f8a8415e570 2023-12-20T04:48:26.418 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:48:26.416+0000 7f1a5cbbd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-20T04:48:26.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.424+0000 7f8a7a7fc640 1 -- 172.21.15.132:0/170828602 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v46) v1 ==== 161+0+0 (secure 0 0 0) 0x7f8a840acd70 con 0x7f8a8415e570 2023-12-20T04:48:26.425 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-20T04:48:26.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.426+0000 7f8a8bc2c640 1 -- 172.21.15.132:0/170828602 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8a6806a430 msgr2=0x7f8a6806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:26.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.426+0000 7f8a8bc2c640 1 --2- 172.21.15.132:0/170828602 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8a6806a430 0x7f8a6806c8f0 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f8a7c004f60 tx=0x7f8a7c007e30 comp rx=0 tx=0).stop 2023-12-20T04:48:26.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.426+0000 7f8a8bc2c640 1 -- 172.21.15.132:0/170828602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a8415e570 msgr2=0x7f8a84156a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:26.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.426+0000 7f8a8bc2c640 1 --2- 172.21.15.132:0/170828602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a8415e570 0x7f8a84156a20 secure :-1 s=READY pgs=1286 cs=0 l=1 rev1=1 crypto rx=0x7f8a80007e40 tx=0x7f8a8000e4b0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.428 INFO:tasks.ceph.mds.a.smithi132.stderr: -3306> 2023-12-20T04:48:05.851+0000 7fd92217b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:48:26.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.426+0000 7f8a8bc2c640 1 -- 172.21.15.132:0/170828602 shutdown_connections 2023-12-20T04:48:26.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.426+0000 7f8a8bc2c640 1 --2- 172.21.15.132:0/170828602 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8a6806a430 0x7f8a6806c8f0 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.426+0000 7f8a8bc2c640 1 --2- 172.21.15.132:0/170828602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a8415e570 0x7f8a84156a20 unknown :-1 s=CLOSED pgs=1286 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.426+0000 7f8a8bc2c640 1 --2- 172.21.15.132:0/170828602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a8415af00 0x7f8a840b1940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.426+0000 7f8a8bc2c640 1 --2- 172.21.15.132:0/170828602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a840d0520 0x7f8a84156170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.426+0000 7f8a8bc2c640 1 -- 172.21.15.132:0/170828602 >> 172.21.15.132:0/170828602 conn(0x7f8a8406d640 msgr2=0x7f8a840cc2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:26.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.426+0000 7f8a8bc2c640 1 -- 172.21.15.132:0/170828602 shutdown_connections 2023-12-20T04:48:26.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.426+0000 7f8a8bc2c640 1 -- 172.21.15.132:0/170828602 wait complete. 2023-12-20T04:48:26.439 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-20T04:48:26.456 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-12-20T04:48:26.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.541+0000 7fc0e52af640 1 Processor -- start 2023-12-20T04:48:26.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.541+0000 7fc0e52af640 1 -- start start 2023-12-20T04:48:26.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.542+0000 7fc0e52af640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0e015d300 0x7fc0e00d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:26.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.542+0000 7fc0e52af640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc0e00cfea0 0x7fc0e00b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:26.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.542+0000 7fc0e52af640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0e00d2920 con 0x7fc0e00d17d0 2023-12-20T04:48:26.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.542+0000 7fc0e52af640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0e00d1d10 con 0x7fc0e00cfea0 2023-12-20T04:48:26.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.542+0000 7fc0e52af640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e00d1ff0 con 0x7fc0e015d300 2023-12-20T04:48:26.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.542+0000 7fc0df7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc0e00cfea0 0x7fc0e00b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:26.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.542+0000 7fc0de7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc0e00d17d0 0x7fc0e00cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:57224/0 (socket says 172.21.15.132:57224) 2023-12-20T04:48:26.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.542+0000 7fc0de7fc640 1 -- 172.21.15.132:0/3536724421 learned_addr learned my addr 172.21.15.132:0/3536724421 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:26.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.542+0000 7fc0deffd640 1 --2- 172.21.15.132:0/3536724421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0e015d300 0x7fc0e00d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:26.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.542+0000 7fc0df7fe640 1 -- 172.21.15.132:0/3536724421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0e015d300 msgr2=0x7fc0e00d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:26.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.542+0000 7fc0df7fe640 1 --2- 172.21.15.132:0/3536724421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0e015d300 0x7fc0e00d1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.542+0000 7fc0df7fe640 1 -- 172.21.15.132:0/3536724421 >> v1:172.21.15.132:6789/0 conn(0x7fc0e00d17d0 legacy=0x7fc0e00cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:26.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.542+0000 7fc0df7fe640 1 -- 172.21.15.132:0/3536724421 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0e00d22d0 con 0x7fc0e00cfea0 2023-12-20T04:48:26.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.542+0000 7fc0ddffb640 1 -- 172.21.15.132:0/3536724421 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3481192389 0 0) 0x7fc0e00d2920 con 0x7fc0e00d17d0 2023-12-20T04:48:26.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.543+0000 7fc0df7fe640 1 --2- 172.21.15.132:0/3536724421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0e00cfea0 0x7fc0e00b6080 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8009d90 tx=0x7fc0d802bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d8159961857ea9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:26.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.543+0000 7fc0ddffb640 1 -- 172.21.15.132:0/3536724421 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d802cc50 con 0x7fc0e00cfea0 2023-12-20T04:48:26.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.543+0000 7fc0ddffb640 1 -- 172.21.15.132:0/3536724421 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d802cdb0 con 0x7fc0e00cfea0 2023-12-20T04:48:26.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.543+0000 7fc0ddffb640 1 -- 172.21.15.132:0/3536724421 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d8034660 con 0x7fc0e00cfea0 2023-12-20T04:48:26.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.544+0000 7fc0e52af640 1 -- 172.21.15.132:0/3536724421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0e00cfea0 msgr2=0x7fc0e00b6080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:26.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.544+0000 7fc0e52af640 1 --2- 172.21.15.132:0/3536724421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0e00cfea0 0x7fc0e00b6080 secure :-1 s=READY pgs=1291 cs=0 l=1 rev1=1 crypto rx=0x7fc0d8009d90 tx=0x7fc0d802bea0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.544+0000 7fc0e52af640 1 -- 172.21.15.132:0/3536724421 shutdown_connections 2023-12-20T04:48:26.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.544+0000 7fc0e52af640 1 --2- 172.21.15.132:0/3536724421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0e00cfea0 0x7fc0e00b6080 unknown :-1 s=CLOSED pgs=1291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.544+0000 7fc0e52af640 1 --2- 172.21.15.132:0/3536724421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0e015d300 0x7fc0e00d1290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.544+0000 7fc0e52af640 1 -- 172.21.15.132:0/3536724421 >> 172.21.15.132:0/3536724421 conn(0x7fc0e006a3d0 msgr2=0x7fc0e006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:26.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.544+0000 7fc0e52af640 1 -- 172.21.15.132:0/3536724421 shutdown_connections 2023-12-20T04:48:26.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.544+0000 7fc0e52af640 1 -- 172.21.15.132:0/3536724421 wait complete. 2023-12-20T04:48:26.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.545+0000 7fc0e52af640 1 Processor -- start 2023-12-20T04:48:26.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.545+0000 7fc0e52af640 1 -- start start 2023-12-20T04:48:26.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0e52af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0e00cfea0 0x7fc0e014d9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:26.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0e52af640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0e00d17d0 0x7fc0e015d800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:26.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0e52af640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0e015d300 0x7fc0e00c8880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:26.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0e52af640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e00cd070 con 0x7fc0e00cfea0 2023-12-20T04:48:26.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0e52af640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e0160050 con 0x7fc0e00d17d0 2023-12-20T04:48:26.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0e52af640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0e0160330 con 0x7fc0e015d300 2023-12-20T04:48:26.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0deffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0e00cfea0 0x7fc0e014d9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:26.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0deffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0e00cfea0 0x7fc0e014d9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34516/0 (socket says 172.21.15.132:34516) 2023-12-20T04:48:26.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0deffd640 1 -- 172.21.15.132:0/585866110 learned_addr learned my addr 172.21.15.132:0/585866110 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:26.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0deffd640 1 -- 172.21.15.132:0/585866110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0e015d300 msgr2=0x7fc0e00c8880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:26.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0deffd640 1 --2- 172.21.15.132:0/585866110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0e015d300 0x7fc0e00c8880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0deffd640 1 -- 172.21.15.132:0/585866110 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0e00d17d0 msgr2=0x7fc0e015d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:26.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0deffd640 1 --2- 172.21.15.132:0/585866110 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0e00d17d0 0x7fc0e015d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:26.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0deffd640 1 -- 172.21.15.132:0/585866110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0d8009a70 con 0x7fc0e00cfea0 2023-12-20T04:48:26.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0deffd640 1 --2- 172.21.15.132:0/585866110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0e00cfea0 0x7fc0e014d9d0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400e870 tx=0x7fc0d400ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:26.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0c77fe640 1 -- 172.21.15.132:0/585866110 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d40094f0 con 0x7fc0e00cfea0 2023-12-20T04:48:26.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0c77fe640 1 -- 172.21.15.132:0/585866110 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc0d400c940 con 0x7fc0e00cfea0 2023-12-20T04:48:26.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0e52af640 1 -- 172.21.15.132:0/585866110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0e00c8360 con 0x7fc0e00cfea0 2023-12-20T04:48:26.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0c77fe640 1 -- 172.21.15.132:0/585866110 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc0d400ccf0 con 0x7fc0e00cfea0 2023-12-20T04:48:26.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.546+0000 7fc0e52af640 1 -- 172.21.15.132:0/585866110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0e014df10 con 0x7fc0e00cfea0 2023-12-20T04:48:26.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.547+0000 7fc0e52af640 1 -- 172.21.15.132:0/585866110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0e014e190 con 0x7fc0e00cfea0 2023-12-20T04:48:26.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.548+0000 7fc0c77fe640 1 -- 172.21.15.132:0/585866110 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc0d4013470 con 0x7fc0e00cfea0 2023-12-20T04:48:26.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.548+0000 7fc0c77fe640 1 --2- 172.21.15.132:0/585866110 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc0cc06a430 0x7fc0cc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:26.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.548+0000 7fc0c77fe640 1 -- 172.21.15.132:0/585866110 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fc0d4088aa0 con 0x7fc0e00cfea0 2023-12-20T04:48:26.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.548+0000 7fc0de7fc640 1 --2- 172.21.15.132:0/585866110 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc0cc06a430 0x7fc0cc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:26.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.549+0000 7fc0de7fc640 1 --2- 172.21.15.132:0/585866110 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc0cc06a430 0x7fc0cc06c8f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0007fd0 tx=0x7fc0d0007920 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:26.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.553+0000 7fc0c77fe640 1 -- 172.21.15.132:0/585866110 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc0d4054030 con 0x7fc0e00cfea0 2023-12-20T04:48:26.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:26.751+0000 7fc0e52af640 1 -- 172.21.15.132:0/585866110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fc0e004e840 con 0x7fc0e00cfea0 2023-12-20T04:48:27.427 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.425+0000 7fc0c77fe640 1 -- 172.21.15.132:0/585866110 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v47) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc0d4057650 con 0x7fc0e00cfea0 2023-12-20T04:48:27.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.427+0000 7fc0e52af640 1 -- 172.21.15.132:0/585866110 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc0cc06a430 msgr2=0x7fc0cc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:27.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.427+0000 7fc0e52af640 1 --2- 172.21.15.132:0/585866110 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc0cc06a430 0x7fc0cc06c8f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7fc0d0007fd0 tx=0x7fc0d0007920 comp rx=0 tx=0).stop 2023-12-20T04:48:27.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.427+0000 7fc0e52af640 1 -- 172.21.15.132:0/585866110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0e00cfea0 msgr2=0x7fc0e014d9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:27.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.427+0000 7fc0e52af640 1 --2- 172.21.15.132:0/585866110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0e00cfea0 0x7fc0e014d9d0 secure :-1 s=READY pgs=1292 cs=0 l=1 rev1=1 crypto rx=0x7fc0d400e870 tx=0x7fc0d400ed30 comp rx=0 tx=0).stop 2023-12-20T04:48:27.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.428+0000 7fc0e52af640 1 -- 172.21.15.132:0/585866110 shutdown_connections 2023-12-20T04:48:27.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.428+0000 7fc0e52af640 1 --2- 172.21.15.132:0/585866110 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc0cc06a430 0x7fc0cc06c8f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:27.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.428+0000 7fc0e52af640 1 --2- 172.21.15.132:0/585866110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc0e015d300 0x7fc0e00c8880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:27.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.428+0000 7fc0e52af640 1 --2- 172.21.15.132:0/585866110 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc0e00d17d0 0x7fc0e015d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:27.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.428+0000 7fc0e52af640 1 --2- 172.21.15.132:0/585866110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0e00cfea0 0x7fc0e014d9d0 unknown :-1 s=CLOSED pgs=1292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:27.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.428+0000 7fc0e52af640 1 -- 172.21.15.132:0/585866110 >> 172.21.15.132:0/585866110 conn(0x7fc0e006a3d0 msgr2=0x7fc0e006a940 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:27.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.428+0000 7fc0e52af640 1 -- 172.21.15.132:0/585866110 shutdown_connections 2023-12-20T04:48:27.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.428+0000 7fc0e52af640 1 -- 172.21.15.132:0/585866110 wait complete. 2023-12-20T04:48:27.443 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-20T04:48:27.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.592+0000 7f6a6c469640 1 Processor -- start 2023-12-20T04:48:27.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.592+0000 7f6a6c469640 1 -- start start 2023-12-20T04:48:27.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.592+0000 7f6a6c469640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a6415d1e0 0x7f6a640ce870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:27.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.592+0000 7f6a6c469640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6a64160c50 0x7f6a640b0980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:27.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.592+0000 7f6a6c469640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6a640b0ec0 0x7f6a640cce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:27.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.592+0000 7f6a6c469640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a6415d5c0 con 0x7f6a64160c50 2023-12-20T04:48:27.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.592+0000 7f6a6c469640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6a64161c20 con 0x7f6a640b0ec0 2023-12-20T04:48:27.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.592+0000 7f6a6c469640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a640b1350 con 0x7f6a6415d1e0 2023-12-20T04:48:27.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.593+0000 7f6a69a04640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6a64160c50 0x7f6a640b0980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:27.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.593+0000 7f6a69a04640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6a64160c50 0x7f6a640b0980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49276/0 (socket says 172.21.15.132:49276) 2023-12-20T04:48:27.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.593+0000 7f6a69a04640 1 -- 172.21.15.132:0/1092558570 learned_addr learned my addr 172.21.15.132:0/1092558570 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:27.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.593+0000 7f6a6a205640 1 --2- 172.21.15.132:0/1092558570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a6415d1e0 0x7f6a640ce870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:27.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.593+0000 7f6a6aa06640 1 --2- 172.21.15.132:0/1092558570 >> v2:172.21.15.187:3300/0 conn(0x7f6a640b0ec0 0x7f6a640cce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:27.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.593+0000 7f6a69a04640 1 -- 172.21.15.132:0/1092558570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a6415d1e0 msgr2=0x7f6a640ce870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:27.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.593+0000 7f6a69a04640 1 --2- 172.21.15.132:0/1092558570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a6415d1e0 0x7f6a640ce870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:27.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.593+0000 7f6a69a04640 1 -- 172.21.15.132:0/1092558570 >> v2:172.21.15.187:3300/0 conn(0x7f6a640b0ec0 msgr2=0x7f6a640cce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:27.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.593+0000 7f6a69a04640 1 --2- 172.21.15.132:0/1092558570 >> v2:172.21.15.187:3300/0 conn(0x7f6a640b0ec0 0x7f6a640cce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:27.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.593+0000 7f6a69a04640 1 -- 172.21.15.132:0/1092558570 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a641610b0 con 0x7f6a64160c50 2023-12-20T04:48:27.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.593+0000 7f6a6aa06640 1 --2- 172.21.15.132:0/1092558570 >> v2:172.21.15.187:3300/0 conn(0x7f6a640b0ec0 0x7f6a640cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:27.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.594+0000 7f6a69a04640 1 --2- 172.21.15.132:0/1092558570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a64160c50 0x7f6a640b0980 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f6a640c5f60 tx=0x7f6a5402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fde73ff23a956a2d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:27.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.594+0000 7f6a69203640 1 -- 172.21.15.132:0/1092558570 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a540317e0 con 0x7f6a64160c50 2023-12-20T04:48:27.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.594+0000 7f6a69203640 1 -- 172.21.15.132:0/1092558570 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a54031940 con 0x7f6a64160c50 2023-12-20T04:48:27.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.594+0000 7f6a69203640 1 -- 172.21.15.132:0/1092558570 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54031cd0 con 0x7f6a64160c50 2023-12-20T04:48:27.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.595+0000 7f6a6c469640 1 -- 172.21.15.132:0/1092558570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a64160c50 msgr2=0x7f6a640b0980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:27.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.595+0000 7f6a6c469640 1 --2- 172.21.15.132:0/1092558570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a64160c50 0x7f6a640b0980 secure :-1 s=READY pgs=1293 cs=0 l=1 rev1=1 crypto rx=0x7f6a640c5f60 tx=0x7f6a5402b880 comp rx=0 tx=0).stop 2023-12-20T04:48:27.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.595+0000 7f6a6c469640 1 -- 172.21.15.132:0/1092558570 shutdown_connections 2023-12-20T04:48:27.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.595+0000 7f6a6c469640 1 --2- 172.21.15.132:0/1092558570 >> v2:172.21.15.187:3300/0 conn(0x7f6a640b0ec0 0x7f6a640cce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:27.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.595+0000 7f6a6c469640 1 --2- 172.21.15.132:0/1092558570 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a64160c50 0x7f6a640b0980 unknown :-1 s=CLOSED pgs=1293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:27.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.595+0000 7f6a6c469640 1 --2- 172.21.15.132:0/1092558570 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a6415d1e0 0x7f6a640ce870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:27.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.595+0000 7f6a6c469640 1 -- 172.21.15.132:0/1092558570 >> 172.21.15.132:0/1092558570 conn(0x7f6a640cb980 msgr2=0x7f6a640cbd60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:27.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.595+0000 7f6a6c469640 1 -- 172.21.15.132:0/1092558570 shutdown_connections 2023-12-20T04:48:27.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.595+0000 7f6a6c469640 1 -- 172.21.15.132:0/1092558570 wait complete. 2023-12-20T04:48:27.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.596+0000 7f6a6c469640 1 Processor -- start 2023-12-20T04:48:27.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.596+0000 7f6a6c469640 1 -- start start 2023-12-20T04:48:27.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a6c469640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a640b0ec0 0x7f6a641495d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:27.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a6c469640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6415d1e0 0x7f6a64146b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a6c469640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a64160c50 0x7f6a640b4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a6c469640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a641f2510 con 0x7f6a6415d1e0 2023-12-20T04:48:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a6c469640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a64149b10 con 0x7f6a64160c50 2023-12-20T04:48:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a6c469640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6415eaf0 con 0x7f6a640b0ec0 2023-12-20T04:48:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a69a04640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6415d1e0 0x7f6a64146b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a69a04640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6415d1e0 0x7f6a64146b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49284/0 (socket says 172.21.15.132:49284) 2023-12-20T04:48:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a69a04640 1 -- 172.21.15.132:0/1028484842 learned_addr learned my addr 172.21.15.132:0/1028484842 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a6a205640 1 --2- 172.21.15.132:0/1028484842 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a640b0ec0 0x7f6a641495d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a6aa06640 1 --2- 172.21.15.132:0/1028484842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a64160c50 0x7f6a640b4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a69a04640 1 -- 172.21.15.132:0/1028484842 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a640b0ec0 msgr2=0x7f6a641495d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a69a04640 1 --2- 172.21.15.132:0/1028484842 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a640b0ec0 0x7f6a641495d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a69a04640 1 -- 172.21.15.132:0/1028484842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a64160c50 msgr2=0x7f6a640b4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:27.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a69a04640 1 --2- 172.21.15.132:0/1028484842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a64160c50 0x7f6a640b4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:27.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a69a04640 1 -- 172.21.15.132:0/1028484842 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a540094d0 con 0x7f6a6415d1e0 2023-12-20T04:48:27.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a69a04640 1 --2- 172.21.15.132:0/1028484842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6415d1e0 0x7f6a64146b30 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f6a5402b8c0 tx=0x7f6a540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:27.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a5affd640 1 -- 172.21.15.132:0/1028484842 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54032880 con 0x7f6a6415d1e0 2023-12-20T04:48:27.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a5affd640 1 -- 172.21.15.132:0/1028484842 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a54032a20 con 0x7f6a6415d1e0 2023-12-20T04:48:27.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a6c469640 1 -- 172.21.15.132:0/1028484842 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a641f5f70 con 0x7f6a6415d1e0 2023-12-20T04:48:27.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a5affd640 1 -- 172.21.15.132:0/1028484842 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a54032dd0 con 0x7f6a6415d1e0 2023-12-20T04:48:27.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.597+0000 7f6a6c469640 1 -- 172.21.15.132:0/1028484842 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a641f6530 con 0x7f6a6415d1e0 2023-12-20T04:48:27.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.598+0000 7f6a6c469640 1 -- 172.21.15.132:0/1028484842 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a641f2680 con 0x7f6a6415d1e0 2023-12-20T04:48:27.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.599+0000 7f6a5affd640 1 -- 172.21.15.132:0/1028484842 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6a5404e450 con 0x7f6a6415d1e0 2023-12-20T04:48:27.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.599+0000 7f6a5affd640 1 --2- 172.21.15.132:0/1028484842 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6a4806a430 0x7f6a4806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:27.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.599+0000 7f6a5affd640 1 -- 172.21.15.132:0/1028484842 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(126..126 src has 1..126) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f6a540aaa10 con 0x7f6a6415d1e0 2023-12-20T04:48:27.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.599+0000 7f6a6a205640 1 --2- 172.21.15.132:0/1028484842 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6a4806a430 0x7f6a4806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:27.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.600+0000 7f6a6a205640 1 --2- 172.21.15.132:0/1028484842 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6a4806a430 0x7f6a4806c8f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0074e0 tx=0x7f6a5c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:27.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.603+0000 7f6a5affd640 1 -- 172.21.15.132:0/1028484842 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6a641f2680 con 0x7f6a6415d1e0 2023-12-20T04:48:27.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:27.772+0000 7f6a6c469640 1 -- 172.21.15.132:0/1028484842 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f6a641f2650 con 0x7f6a6415d1e0 2023-12-20T04:48:28.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.428+0000 7f6a5affd640 1 -- 172.21.15.132:0/1028484842 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v127) v1 ==== 181+0+0 (secure 0 0 0) 0x7f6a54079a30 con 0x7f6a6415d1e0 2023-12-20T04:48:28.431 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2023-12-20T04:48:28.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.431+0000 7f6a6c469640 1 -- 172.21.15.132:0/1028484842 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6a4806a430 msgr2=0x7f6a4806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:28.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.431+0000 7f6a6c469640 1 --2- 172.21.15.132:0/1028484842 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6a4806a430 0x7f6a4806c8f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f6a5c0074e0 tx=0x7f6a5c00b040 comp rx=0 tx=0).stop 2023-12-20T04:48:28.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.431+0000 7f6a6c469640 1 -- 172.21.15.132:0/1028484842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6415d1e0 msgr2=0x7f6a64146b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:28.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.431+0000 7f6a6c469640 1 --2- 172.21.15.132:0/1028484842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6415d1e0 0x7f6a64146b30 secure :-1 s=READY pgs=1294 cs=0 l=1 rev1=1 crypto rx=0x7f6a5402b8c0 tx=0x7f6a540046c0 comp rx=0 tx=0).stop 2023-12-20T04:48:28.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.431+0000 7f6a6c469640 1 -- 172.21.15.132:0/1028484842 shutdown_connections 2023-12-20T04:48:28.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.431+0000 7f6a6c469640 1 --2- 172.21.15.132:0/1028484842 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6a4806a430 0x7f6a4806c8f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:28.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.431+0000 7f6a6c469640 1 --2- 172.21.15.132:0/1028484842 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a64160c50 0x7f6a640b4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:28.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.431+0000 7f6a6c469640 1 --2- 172.21.15.132:0/1028484842 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6415d1e0 0x7f6a64146b30 unknown :-1 s=CLOSED pgs=1294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:28.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.431+0000 7f6a6c469640 1 --2- 172.21.15.132:0/1028484842 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a640b0ec0 0x7f6a641495d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:28.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.431+0000 7f6a6c469640 1 -- 172.21.15.132:0/1028484842 >> 172.21.15.132:0/1028484842 conn(0x7f6a640cb980 msgr2=0x7f6a640cce00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:28.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.432+0000 7f6a6c469640 1 -- 172.21.15.132:0/1028484842 shutdown_connections 2023-12-20T04:48:28.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.432+0000 7f6a6c469640 1 -- 172.21.15.132:0/1028484842 wait complete. 2023-12-20T04:48:28.446 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-20T04:48:28.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.551+0000 7fa37abb9640 1 Processor -- start 2023-12-20T04:48:28.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.551+0000 7fa37abb9640 1 -- start start 2023-12-20T04:48:28.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.552+0000 7fa37abb9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa37415d1a0 0x7fa37406c800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:28.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.552+0000 7fa37abb9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa374072c60 0x7fa3740b0d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:28.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.552+0000 7fa37abb9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa3740730c0 0x7fa3740b1280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:28.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.552+0000 7fa37abb9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37406b760 con 0x7fa3740730c0 2023-12-20T04:48:28.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.552+0000 7fa37abb9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa37406ba40 con 0x7fa374072c60 2023-12-20T04:48:28.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.552+0000 7fa37abb9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa37406bd20 con 0x7fa37415d1a0 2023-12-20T04:48:28.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.552+0000 7fa379156640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa3740730c0 0x7fa3740b1280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:28.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.552+0000 7fa379156640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa3740730c0 0x7fa3740b1280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49286/0 (socket says 172.21.15.132:49286) 2023-12-20T04:48:28.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.552+0000 7fa379156640 1 -- 172.21.15.132:0/4084852650 learned_addr learned my addr 172.21.15.132:0/4084852650 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:28.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.552+0000 7fa378955640 1 --2- 172.21.15.132:0/4084852650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa37415d1a0 0x7fa37406c800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:28.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.552+0000 7fa373fff640 1 --2- 172.21.15.132:0/4084852650 >> v2:172.21.15.187:3300/0 conn(0x7fa374072c60 0x7fa3740b0d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:28.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.552+0000 7fa379156640 1 -- 172.21.15.132:0/4084852650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa37415d1a0 msgr2=0x7fa37406c800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:28.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.552+0000 7fa379156640 1 --2- 172.21.15.132:0/4084852650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa37415d1a0 0x7fa37406c800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:28.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.552+0000 7fa379156640 1 -- 172.21.15.132:0/4084852650 >> v2:172.21.15.187:3300/0 conn(0x7fa374072c60 msgr2=0x7fa3740b0d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:28.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.552+0000 7fa379156640 1 --2- 172.21.15.132:0/4084852650 >> v2:172.21.15.187:3300/0 conn(0x7fa374072c60 0x7fa3740b0d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:28.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.552+0000 7fa379156640 1 -- 172.21.15.132:0/4084852650 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa37406c000 con 0x7fa3740730c0 2023-12-20T04:48:28.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.552+0000 7fa373fff640 1 --2- 172.21.15.132:0/4084852650 >> v2:172.21.15.187:3300/0 conn(0x7fa374072c60 0x7fa3740b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:28.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.553+0000 7fa379156640 1 --2- 172.21.15.132:0/4084852650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3740730c0 0x7fa3740b1280 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fa3740d02d0 tx=0x7fa36c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f50c6b5cb08b6d61 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:28.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.553+0000 7fa3737fe640 1 -- 172.21.15.132:0/4084852650 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c02ca70 con 0x7fa3740730c0 2023-12-20T04:48:28.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.553+0000 7fa3737fe640 1 -- 172.21.15.132:0/4084852650 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36c02cbd0 con 0x7fa3740730c0 2023-12-20T04:48:28.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.553+0000 7fa3737fe640 1 -- 172.21.15.132:0/4084852650 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36c0343f0 con 0x7fa3740730c0 2023-12-20T04:48:28.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.554+0000 7fa37abb9640 1 -- 172.21.15.132:0/4084852650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3740730c0 msgr2=0x7fa3740b1280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:28.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.554+0000 7fa37abb9640 1 --2- 172.21.15.132:0/4084852650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3740730c0 0x7fa3740b1280 secure :-1 s=READY pgs=1295 cs=0 l=1 rev1=1 crypto rx=0x7fa3740d02d0 tx=0x7fa36c02bed0 comp rx=0 tx=0).stop 2023-12-20T04:48:28.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.554+0000 7fa37abb9640 1 -- 172.21.15.132:0/4084852650 shutdown_connections 2023-12-20T04:48:28.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.554+0000 7fa37abb9640 1 --2- 172.21.15.132:0/4084852650 >> v2:172.21.15.187:3300/0 conn(0x7fa374072c60 0x7fa3740b0d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:28.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.554+0000 7fa37abb9640 1 --2- 172.21.15.132:0/4084852650 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3740730c0 0x7fa3740b1280 unknown :-1 s=CLOSED pgs=1295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:28.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.554+0000 7fa37abb9640 1 --2- 172.21.15.132:0/4084852650 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa37415d1a0 0x7fa37406c800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:28.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.554+0000 7fa37abb9640 1 -- 172.21.15.132:0/4084852650 >> 172.21.15.132:0/4084852650 conn(0x7fa3740cbd40 msgr2=0x7fa3740cc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:28.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.554+0000 7fa37abb9640 1 -- 172.21.15.132:0/4084852650 shutdown_connections 2023-12-20T04:48:28.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.554+0000 7fa37abb9640 1 -- 172.21.15.132:0/4084852650 wait complete. 2023-12-20T04:48:28.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.555+0000 7fa37abb9640 1 Processor -- start 2023-12-20T04:48:28.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.555+0000 7fa37abb9640 1 -- start start 2023-12-20T04:48:28.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.556+0000 7fa37abb9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa374072c60 0x7fa3740c5650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:28.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.556+0000 7fa37abb9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3740730c0 0x7fa3740caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:28.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.556+0000 7fa37abb9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa37415d1a0 0x7fa3740caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:28.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.556+0000 7fa37abb9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740c6c80 con 0x7fa374072c60 2023-12-20T04:48:28.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.556+0000 7fa37abb9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740c74e0 con 0x7fa37415d1a0 2023-12-20T04:48:28.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.556+0000 7fa37abb9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3740c5b90 con 0x7fa3740730c0 2023-12-20T04:48:28.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.556+0000 7fa378955640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa374072c60 0x7fa3740c5650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:28.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.556+0000 7fa378955640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa374072c60 0x7fa3740c5650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49302/0 (socket says 172.21.15.132:49302) 2023-12-20T04:48:28.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.556+0000 7fa378955640 1 -- 172.21.15.132:0/1455226667 learned_addr learned my addr 172.21.15.132:0/1455226667 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:28.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.556+0000 7fa373fff640 1 --2- 172.21.15.132:0/1455226667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3740730c0 0x7fa3740caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:28.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.556+0000 7fa379156640 1 --2- 172.21.15.132:0/1455226667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa37415d1a0 0x7fa3740caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:28.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.556+0000 7fa378955640 1 -- 172.21.15.132:0/1455226667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3740730c0 msgr2=0x7fa3740caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:28.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.556+0000 7fa378955640 1 --2- 172.21.15.132:0/1455226667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3740730c0 0x7fa3740caa00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:28.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.556+0000 7fa378955640 1 -- 172.21.15.132:0/1455226667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa37415d1a0 msgr2=0x7fa3740caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:28.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.556+0000 7fa378955640 1 --2- 172.21.15.132:0/1455226667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa37415d1a0 0x7fa3740caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:28.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.556+0000 7fa378955640 1 -- 172.21.15.132:0/1455226667 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa36c009b30 con 0x7fa374072c60 2023-12-20T04:48:28.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.556+0000 7fa379156640 1 --2- 172.21.15.132:0/1455226667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa37415d1a0 0x7fa3740caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:28.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.557+0000 7fa378955640 1 --2- 172.21.15.132:0/1455226667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa374072c60 0x7fa3740c5650 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fa36400d800 tx=0x7fa36400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:28.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.557+0000 7fa3717fa640 1 -- 172.21.15.132:0/1455226667 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36400b6c0 con 0x7fa374072c60 2023-12-20T04:48:28.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.557+0000 7fa3717fa640 1 -- 172.21.15.132:0/1455226667 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa36400b820 con 0x7fa374072c60 2023-12-20T04:48:28.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.557+0000 7fa3717fa640 1 -- 172.21.15.132:0/1455226667 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa36400bbb0 con 0x7fa374072c60 2023-12-20T04:48:28.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.557+0000 7fa37abb9640 1 -- 172.21.15.132:0/1455226667 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3741f3610 con 0x7fa374072c60 2023-12-20T04:48:28.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.557+0000 7fa37abb9640 1 -- 172.21.15.132:0/1455226667 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3740c7170 con 0x7fa374072c60 2023-12-20T04:48:28.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.558+0000 7fa37abb9640 1 -- 172.21.15.132:0/1455226667 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa37404e840 con 0x7fa374072c60 2023-12-20T04:48:28.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.558+0000 7fa3717fa640 1 -- 172.21.15.132:0/1455226667 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa36400bd10 con 0x7fa374072c60 2023-12-20T04:48:28.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.558+0000 7fa3717fa640 1 --2- 172.21.15.132:0/1455226667 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa36006a430 0x7fa36006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:28.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.559+0000 7fa3717fa640 1 -- 172.21.15.132:0/1455226667 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(127..127 src has 1..127) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fa364088b40 con 0x7fa374072c60 2023-12-20T04:48:28.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.559+0000 7fa373fff640 1 --2- 172.21.15.132:0/1455226667 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa36006a430 0x7fa36006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:28.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.559+0000 7fa373fff640 1 --2- 172.21.15.132:0/1455226667 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa36006a430 0x7fa36006c8f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa3740b1040 tx=0x7fa368008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:28.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.563+0000 7fa3717fa640 1 -- 172.21.15.132:0/1455226667 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa364054320 con 0x7fa374072c60 2023-12-20T04:48:28.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:28.731+0000 7fa37abb9640 1 -- 172.21.15.132:0/1455226667 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fa3740cd330 con 0x7fa374072c60 2023-12-20T04:48:29.436 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2023-12-20T04:48:29.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.433+0000 7fa3717fa640 1 -- 172.21.15.132:0/1455226667 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v128) v1 ==== 169+0+0 (secure 0 0 0) 0x7fa364057940 con 0x7fa374072c60 2023-12-20T04:48:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.437+0000 7fa37abb9640 1 -- 172.21.15.132:0/1455226667 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa36006a430 msgr2=0x7fa36006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.437+0000 7fa37abb9640 1 --2- 172.21.15.132:0/1455226667 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa36006a430 0x7fa36006c8f0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7fa3740b1040 tx=0x7fa368008040 comp rx=0 tx=0).stop 2023-12-20T04:48:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.437+0000 7fa37abb9640 1 -- 172.21.15.132:0/1455226667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa374072c60 msgr2=0x7fa3740c5650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.437+0000 7fa37abb9640 1 --2- 172.21.15.132:0/1455226667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa374072c60 0x7fa3740c5650 secure :-1 s=READY pgs=1296 cs=0 l=1 rev1=1 crypto rx=0x7fa36400d800 tx=0x7fa36400dcc0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.438+0000 7fa37abb9640 1 -- 172.21.15.132:0/1455226667 shutdown_connections 2023-12-20T04:48:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.438+0000 7fa37abb9640 1 --2- 172.21.15.132:0/1455226667 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa36006a430 0x7fa36006c8f0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.438+0000 7fa37abb9640 1 --2- 172.21.15.132:0/1455226667 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa37415d1a0 0x7fa3740caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.438+0000 7fa37abb9640 1 --2- 172.21.15.132:0/1455226667 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3740730c0 0x7fa3740caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.438+0000 7fa37abb9640 1 --2- 172.21.15.132:0/1455226667 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa374072c60 0x7fa3740c5650 unknown :-1 s=CLOSED pgs=1296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.438+0000 7fa37abb9640 1 -- 172.21.15.132:0/1455226667 >> 172.21.15.132:0/1455226667 conn(0x7fa3740cbd40 msgr2=0x7fa3740b35e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:29.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.438+0000 7fa37abb9640 1 -- 172.21.15.132:0/1455226667 shutdown_connections 2023-12-20T04:48:29.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.438+0000 7fa37abb9640 1 -- 172.21.15.132:0/1455226667 wait complete. 2023-12-20T04:48:29.452 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-20T04:48:29.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.555+0000 7fad5e6e7640 1 Processor -- start 2023-12-20T04:48:29.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.555+0000 7fad5e6e7640 1 -- start start 2023-12-20T04:48:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad5e6e7640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fad580caee0 0x7fad580c5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad5e6e7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5806f8d0 0x7fad5806bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad5e6e7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad5806b960 con 0x7fad5806f450 2023-12-20T04:48:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad5e6e7640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad580c4c30 con 0x7fad580caee0 2023-12-20T04:48:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad5e6e7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad580c4390 con 0x7fad5806f8d0 2023-12-20T04:48:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad577fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fad5806f450 0x7fad580cb2c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36444/0 (socket says 172.21.15.132:36444) 2023-12-20T04:48:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad577fe640 1 -- 172.21.15.132:0/634325157 learned_addr learned my addr 172.21.15.132:0/634325157 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad56ffd640 1 -- 172.21.15.132:0/634325157 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1989236275 0 0) 0x7fad5806b960 con 0x7fad5806f450 2023-12-20T04:48:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad56ffd640 1 -- 172.21.15.132:0/634325157 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad40003520 con 0x7fad5806f450 2023-12-20T04:48:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad5cc84640 1 --2- 172.21.15.132:0/634325157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5806f8d0 0x7fad5806bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad57fff640 1 --2- 172.21.15.132:0/634325157 >> v2:172.21.15.187:3300/0 conn(0x7fad580caee0 0x7fad580c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:29.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad56ffd640 1 -- 172.21.15.132:0/634325157 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3594328408 0 0) 0x7fad40003520 con 0x7fad5806f450 2023-12-20T04:48:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad56ffd640 1 -- 172.21.15.132:0/634325157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5806f8d0 msgr2=0x7fad5806bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad56ffd640 1 --2- 172.21.15.132:0/634325157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5806f8d0 0x7fad5806bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad56ffd640 1 -- 172.21.15.132:0/634325157 >> v2:172.21.15.187:3300/0 conn(0x7fad580caee0 msgr2=0x7fad580c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad56ffd640 1 --2- 172.21.15.132:0/634325157 >> v2:172.21.15.187:3300/0 conn(0x7fad580caee0 0x7fad580c5330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad56ffd640 1 -- 172.21.15.132:0/634325157 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad580c4670 con 0x7fad5806f450 2023-12-20T04:48:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.556+0000 7fad56ffd640 1 -- 172.21.15.132:0/634325157 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fad4c001670 con 0x7fad5806f450 2023-12-20T04:48:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.557+0000 7fad56ffd640 1 -- 172.21.15.132:0/634325157 >> v1:172.21.15.132:6789/0 conn(0x7fad5806f450 legacy=0x7fad580cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.557+0000 7fad56ffd640 1 --2- 172.21.15.132:0/634325157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5806f8d0 0x7fad40003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.557+0000 7fad56ffd640 1 --2- 172.21.15.132:0/634325157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad40003fa0 0x7fad400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.557+0000 7fad56ffd640 1 --2- 172.21.15.132:0/634325157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad40004d00 0x7fad40005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.557+0000 7fad56ffd640 1 -- 172.21.15.132:0/634325157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad580c4c30 con 0x7fad40004d00 2023-12-20T04:48:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.557+0000 7fad56ffd640 1 -- 172.21.15.132:0/634325157 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad580c4390 con 0x7fad40003fa0 2023-12-20T04:48:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.557+0000 7fad56ffd640 1 -- 172.21.15.132:0/634325157 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad4000ba80 con 0x7fad5806f8d0 2023-12-20T04:48:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.557+0000 7fad5cc84640 1 --2- 172.21.15.132:0/634325157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad40004d00 0x7fad40005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:29.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.557+0000 7fad57fff640 1 --2- 172.21.15.132:0/634325157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5806f8d0 0x7fad40003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.557+0000 7fad577fe640 1 --2- 172.21.15.132:0/634325157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad40003fa0 0x7fad400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.557+0000 7fad5cc84640 1 -- 172.21.15.132:0/634325157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5806f8d0 msgr2=0x7fad40003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.557+0000 7fad5cc84640 1 --2- 172.21.15.132:0/634325157 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5806f8d0 0x7fad40003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.557+0000 7fad5cc84640 1 -- 172.21.15.132:0/634325157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad40003fa0 msgr2=0x7fad400047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.557+0000 7fad5cc84640 1 --2- 172.21.15.132:0/634325157 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad40003fa0 0x7fad400047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.557+0000 7fad5cc84640 1 -- 172.21.15.132:0/634325157 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad40003520 con 0x7fad40004d00 2023-12-20T04:48:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.558+0000 7fad5cc84640 1 --2- 172.21.15.132:0/634325157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad40004d00 0x7fad40005180 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fad50007360 tx=0x7fad400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d0c088b4dd9f89f0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.558+0000 7fad56ffd640 1 -- 172.21.15.132:0/634325157 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad5002ccd0 con 0x7fad40004d00 2023-12-20T04:48:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.558+0000 7fad56ffd640 1 -- 172.21.15.132:0/634325157 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad5002ce30 con 0x7fad40004d00 2023-12-20T04:48:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.558+0000 7fad56ffd640 1 -- 172.21.15.132:0/634325157 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad50034660 con 0x7fad40004d00 2023-12-20T04:48:29.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.558+0000 7fad5e6e7640 1 -- 172.21.15.132:0/634325157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad40004d00 msgr2=0x7fad40005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:29.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.558+0000 7fad5e6e7640 1 --2- 172.21.15.132:0/634325157 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad40004d00 0x7fad40005180 secure :-1 s=READY pgs=1298 cs=0 l=1 rev1=1 crypto rx=0x7fad50007360 tx=0x7fad400057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.558+0000 7fad5cc84640 1 -- 172.21.15.132:0/634325157 reap_dead start 2023-12-20T04:48:29.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.558+0000 7fad5e6e7640 1 -- 172.21.15.132:0/634325157 shutdown_connections 2023-12-20T04:48:29.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.558+0000 7fad5e6e7640 1 -- 172.21.15.132:0/634325157 >> 172.21.15.132:0/634325157 conn(0x7fad5806a260 msgr2=0x7fad580b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:29.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.558+0000 7fad5e6e7640 1 -- 172.21.15.132:0/634325157 shutdown_connections 2023-12-20T04:48:29.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.558+0000 7fad5e6e7640 1 -- 172.21.15.132:0/634325157 wait complete. 2023-12-20T04:48:29.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.559+0000 7fad5e6e7640 1 Processor -- start 2023-12-20T04:48:29.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.560+0000 7fad5e6e7640 1 -- start start 2023-12-20T04:48:29.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.560+0000 7fad5e6e7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5813fbf0 0x7fad5813ffd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:29.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.560+0000 7fad5e6e7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad581405e0 0x7fad58142e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:29.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.560+0000 7fad5e6e7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad580b16b0 0x7fad580c7620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:29.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.560+0000 7fad5e6e7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad580b2570 con 0x7fad581405e0 2023-12-20T04:48:29.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.560+0000 7fad5e6e7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad581423f0 con 0x7fad580b16b0 2023-12-20T04:48:29.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.560+0000 7fad5e6e7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad580b1fb0 con 0x7fad5813fbf0 2023-12-20T04:48:29.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.560+0000 7fad577fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad581405e0 0x7fad58142e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:29.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.560+0000 7fad577fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad581405e0 0x7fad58142e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49324/0 (socket says 172.21.15.132:49324) 2023-12-20T04:48:29.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.560+0000 7fad577fe640 1 -- 172.21.15.132:0/2261140351 learned_addr learned my addr 172.21.15.132:0/2261140351 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:29.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.561+0000 7fad57fff640 1 --2- 172.21.15.132:0/2261140351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5813fbf0 0x7fad5813ffd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:29.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.561+0000 7fad5cc84640 1 --2- 172.21.15.132:0/2261140351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad580b16b0 0x7fad580c7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:29.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.561+0000 7fad577fe640 1 -- 172.21.15.132:0/2261140351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5813fbf0 msgr2=0x7fad5813ffd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:29.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.561+0000 7fad577fe640 1 --2- 172.21.15.132:0/2261140351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5813fbf0 0x7fad5813ffd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.561+0000 7fad577fe640 1 -- 172.21.15.132:0/2261140351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad580b16b0 msgr2=0x7fad580c7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:29.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.561+0000 7fad577fe640 1 --2- 172.21.15.132:0/2261140351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad580b16b0 0x7fad580c7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.561+0000 7fad577fe640 1 -- 172.21.15.132:0/2261140351 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad580b2290 con 0x7fad581405e0 2023-12-20T04:48:29.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.561+0000 7fad577fe640 1 --2- 172.21.15.132:0/2261140351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad581405e0 0x7fad58142e00 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0072c0 tx=0x7fad4c007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:29.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.561+0000 7fad54ff9640 1 -- 172.21.15.132:0/2261140351 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c00fa20 con 0x7fad581405e0 2023-12-20T04:48:29.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.561+0000 7fad54ff9640 1 -- 172.21.15.132:0/2261140351 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad4c00fb80 con 0x7fad581405e0 2023-12-20T04:48:29.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.561+0000 7fad5e6e7640 1 -- 172.21.15.132:0/2261140351 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad58142600 con 0x7fad581405e0 2023-12-20T04:48:29.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.561+0000 7fad54ff9640 1 -- 172.21.15.132:0/2261140351 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad4c0133f0 con 0x7fad581405e0 2023-12-20T04:48:29.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.561+0000 7fad5e6e7640 1 -- 172.21.15.132:0/2261140351 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad58143340 con 0x7fad581405e0 2023-12-20T04:48:29.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.562+0000 7fad5e6e7640 1 -- 172.21.15.132:0/2261140351 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad5804e840 con 0x7fad581405e0 2023-12-20T04:48:29.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.563+0000 7fad54ff9640 1 -- 172.21.15.132:0/2261140351 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fad4c013550 con 0x7fad581405e0 2023-12-20T04:48:29.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.563+0000 7fad54ff9640 1 --2- 172.21.15.132:0/2261140351 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fad4406a430 0x7fad4406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:29.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.563+0000 7fad57fff640 1 --2- 172.21.15.132:0/2261140351 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fad4406a430 0x7fad4406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:29.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.563+0000 7fad54ff9640 1 -- 172.21.15.132:0/2261140351 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fad4c088730 con 0x7fad581405e0 2023-12-20T04:48:29.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.563+0000 7fad57fff640 1 --2- 172.21.15.132:0/2261140351 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fad4406a430 0x7fad4406c8f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fad48006fd0 tx=0x7fad48008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:29.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.567+0000 7fad54ff9640 1 -- 172.21.15.132:0/2261140351 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fad4c054160 con 0x7fad581405e0 2023-12-20T04:48:29.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.731+0000 7fad5e6e7640 1 -- 172.21.15.132:0/2261140351 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fad58065e90 con 0x7fad581405e0 2023-12-20T04:48:29.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.735+0000 7fad54ff9640 1 -- 172.21.15.132:0/2261140351 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v13) v1 ==== 104+0+0 (secure 0 0 0) 0x7fad4c057780 con 0x7fad581405e0 2023-12-20T04:48:29.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.737+0000 7fad5e6e7640 1 -- 172.21.15.132:0/2261140351 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fad4406a430 msgr2=0x7fad4406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:29.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.737+0000 7fad5e6e7640 1 --2- 172.21.15.132:0/2261140351 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fad4406a430 0x7fad4406c8f0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fad48006fd0 tx=0x7fad48008040 comp rx=0 tx=0).stop 2023-12-20T04:48:29.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.737+0000 7fad5e6e7640 1 -- 172.21.15.132:0/2261140351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad581405e0 msgr2=0x7fad58142e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:29.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.737+0000 7fad5e6e7640 1 --2- 172.21.15.132:0/2261140351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad581405e0 0x7fad58142e00 secure :-1 s=READY pgs=1299 cs=0 l=1 rev1=1 crypto rx=0x7fad4c0072c0 tx=0x7fad4c007780 comp rx=0 tx=0).stop 2023-12-20T04:48:29.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.737+0000 7fad5e6e7640 1 -- 172.21.15.132:0/2261140351 shutdown_connections 2023-12-20T04:48:29.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.737+0000 7fad5e6e7640 1 --2- 172.21.15.132:0/2261140351 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fad4406a430 0x7fad4406c8f0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.737+0000 7fad5e6e7640 1 --2- 172.21.15.132:0/2261140351 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad580b16b0 0x7fad580c7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.737+0000 7fad5e6e7640 1 --2- 172.21.15.132:0/2261140351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad581405e0 0x7fad58142e00 unknown :-1 s=CLOSED pgs=1299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.737+0000 7fad5e6e7640 1 --2- 172.21.15.132:0/2261140351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad5813fbf0 0x7fad5813ffd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.737+0000 7fad5e6e7640 1 -- 172.21.15.132:0/2261140351 >> 172.21.15.132:0/2261140351 conn(0x7fad5806a260 msgr2=0x7fad581e5110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:29.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.737+0000 7fad5e6e7640 1 -- 172.21.15.132:0/2261140351 shutdown_connections 2023-12-20T04:48:29.741 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.737+0000 7fad5e6e7640 1 -- 172.21.15.132:0/2261140351 wait complete. 2023-12-20T04:48:29.750 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier' 2023-12-20T04:48:29.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.848+0000 7f96e7f8b640 1 Processor -- start 2023-12-20T04:48:29.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.848+0000 7f96e7f8b640 1 -- start start 2023-12-20T04:48:29.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.849+0000 7f96e7f8b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f96e0159d00 0x7f96e015da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:29.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.849+0000 7f96e7f8b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e015e4c0 con 0x7f96e006cc30 2023-12-20T04:48:29.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.849+0000 7f96e7f8b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96e015e7a0 con 0x7f96e015df40 2023-12-20T04:48:29.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.849+0000 7f96e7f8b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96e006c220 con 0x7f96e0159d00 2023-12-20T04:48:29.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.849+0000 7f96e6528640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f96e006cc30 0x7f96e006dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36458/0 (socket says 172.21.15.132:36458) 2023-12-20T04:48:29.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.849+0000 7f96e6528640 1 -- 172.21.15.132:0/2016726069 learned_addr learned my addr 172.21.15.132:0/2016726069 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:29.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.849+0000 7f96e5d27640 1 --2- 172.21.15.132:0/2016726069 >> v2:172.21.15.187:3300/0 conn(0x7f96e0159d00 0x7f96e015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:29.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.850+0000 7f96e5d27640 1 -- 172.21.15.132:0/2016726069 >> v1:172.21.15.187:6789/0 conn(0x7f96e015df40 legacy=0x7f96e00caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:29.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.850+0000 7f96e5d27640 1 -- 172.21.15.132:0/2016726069 >> v1:172.21.15.132:6789/0 conn(0x7f96e006cc30 legacy=0x7f96e006dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:29.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.850+0000 7f96e5d27640 1 -- 172.21.15.132:0/2016726069 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96e006c430 con 0x7f96e0159d00 2023-12-20T04:48:29.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.851+0000 7f96e5d27640 1 --2- 172.21.15.132:0/2016726069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96e0159d00 0x7f96e015da00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f96dc0097a0 tx=0x7f96dc02b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=da39260652fdc1b6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:29.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.852+0000 7f96e4d25640 1 -- 172.21.15.132:0/2016726069 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc030610 con 0x7f96e0159d00 2023-12-20T04:48:29.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.852+0000 7f96e4d25640 1 -- 172.21.15.132:0/2016726069 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96dc030770 con 0x7f96e0159d00 2023-12-20T04:48:29.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.852+0000 7f96e4d25640 1 -- 172.21.15.132:0/2016726069 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96dc030b00 con 0x7f96e0159d00 2023-12-20T04:48:29.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.852+0000 7f96e7f8b640 1 -- 172.21.15.132:0/2016726069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96e0159d00 msgr2=0x7f96e015da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:29.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.852+0000 7f96e7f8b640 1 --2- 172.21.15.132:0/2016726069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96e0159d00 0x7f96e015da00 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f96dc0097a0 tx=0x7f96dc02b960 comp rx=0 tx=0).stop 2023-12-20T04:48:29.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.853+0000 7f96e7f8b640 1 -- 172.21.15.132:0/2016726069 shutdown_connections 2023-12-20T04:48:29.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.853+0000 7f96e7f8b640 1 --2- 172.21.15.132:0/2016726069 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96e0159d00 0x7f96e015da00 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.853+0000 7f96e7f8b640 1 -- 172.21.15.132:0/2016726069 >> 172.21.15.132:0/2016726069 conn(0x7f96e00cfca0 msgr2=0x7f96e00d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:29.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.853+0000 7f96e7f8b640 1 -- 172.21.15.132:0/2016726069 shutdown_connections 2023-12-20T04:48:29.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.853+0000 7f96e7f8b640 1 -- 172.21.15.132:0/2016726069 wait complete. 2023-12-20T04:48:29.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.854+0000 7f96e7f8b640 1 Processor -- start 2023-12-20T04:48:29.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.854+0000 7f96e7f8b640 1 -- start start 2023-12-20T04:48:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.854+0000 7f96e7f8b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f96e006cc30 0x7f96e0155190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.854+0000 7f96e7f8b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96e0159d00 0x7f96e01578f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.854+0000 7f96e7f8b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96e015df40 0x7f96e00b4d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.854+0000 7f96e7f8b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01556d0 con 0x7f96e0159d00 2023-12-20T04:48:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.854+0000 7f96e7f8b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96e01562c0 con 0x7f96e015df40 2023-12-20T04:48:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.854+0000 7f96e7f8b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96e00c8540 con 0x7f96e006cc30 2023-12-20T04:48:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.855+0000 7f96e5526640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96e0159d00 0x7f96e01578f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.855+0000 7f96e5526640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96e0159d00 0x7f96e01578f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49336/0 (socket says 172.21.15.132:49336) 2023-12-20T04:48:29.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.855+0000 7f96e5526640 1 -- 172.21.15.132:0/3890785067 learned_addr learned my addr 172.21.15.132:0/3890785067 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:29.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.855+0000 7f96e5d27640 1 --2- 172.21.15.132:0/3890785067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f96e006cc30 0x7f96e0155190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:29.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.855+0000 7f96e6528640 1 --2- 172.21.15.132:0/3890785067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96e015df40 0x7f96e00b4d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:29.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.855+0000 7f96e5526640 1 -- 172.21.15.132:0/3890785067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f96e006cc30 msgr2=0x7f96e0155190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:29.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.855+0000 7f96e5526640 1 --2- 172.21.15.132:0/3890785067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f96e006cc30 0x7f96e0155190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.855+0000 7f96e5526640 1 -- 172.21.15.132:0/3890785067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96e015df40 msgr2=0x7f96e00b4d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:29.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.855+0000 7f96e5526640 1 --2- 172.21.15.132:0/3890785067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96e015df40 0x7f96e00b4d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:29.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.855+0000 7f96e5526640 1 -- 172.21.15.132:0/3890785067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96dc009400 con 0x7f96e0159d00 2023-12-20T04:48:29.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.855+0000 7f96e5526640 1 --2- 172.21.15.132:0/3890785067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96e0159d00 0x7f96e01578f0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f96d000c430 tx=0x7f96d000c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:29.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.855+0000 7f96d67fc640 1 -- 172.21.15.132:0/3890785067 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d00052d0 con 0x7f96e0159d00 2023-12-20T04:48:29.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.855+0000 7f96d67fc640 1 -- 172.21.15.132:0/3890785067 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96d0005430 con 0x7f96e0159d00 2023-12-20T04:48:29.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.855+0000 7f96e7f8b640 1 -- 172.21.15.132:0/3890785067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96e0157e30 con 0x7f96e0159d00 2023-12-20T04:48:29.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.855+0000 7f96d67fc640 1 -- 172.21.15.132:0/3890785067 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96d0003830 con 0x7f96e0159d00 2023-12-20T04:48:29.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.855+0000 7f96e7f8b640 1 -- 172.21.15.132:0/3890785067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96e00c7ef0 con 0x7f96e0159d00 2023-12-20T04:48:29.860 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.856+0000 7f96e7f8b640 1 -- 172.21.15.132:0/3890785067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96e004e840 con 0x7f96e0159d00 2023-12-20T04:48:29.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.857+0000 7f96d67fc640 1 -- 172.21.15.132:0/3890785067 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f96d0003990 con 0x7f96e0159d00 2023-12-20T04:48:29.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.857+0000 7f96d67fc640 1 --2- 172.21.15.132:0/3890785067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96c406a430 0x7f96c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:29.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.857+0000 7f96d67fc640 1 -- 172.21.15.132:0/3890785067 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f96d0087c10 con 0x7f96e0159d00 2023-12-20T04:48:29.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.857+0000 7f96e5d27640 1 --2- 172.21.15.132:0/3890785067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96c406a430 0x7f96c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:29.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.857+0000 7f96e5d27640 1 --2- 172.21.15.132:0/3890785067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96c406a430 0x7f96c406c8f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f96dc036000 tx=0x7f96dc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:29.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:29.861+0000 7f96d67fc640 1 -- 172.21.15.132:0/3890785067 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f96d00534f0 con 0x7f96e0159d00 2023-12-20T04:48:30.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.089+0000 7f96e7f8b640 1 -- 172.21.15.132:0/3890785067 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]} v 0) v1 -- 0x7f96e0073e00 con 0x7f96e0159d00 2023-12-20T04:48:30.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.434+0000 7f96d67fc640 1 -- 172.21.15.132:0/3890785067 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_barrier"]}]=0 v308) v1 ==== 128+0+0 (secure 0 0 0) 0x7f96d0056b10 con 0x7f96e0159d00 2023-12-20T04:48:30.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.436+0000 7f96e7f8b640 1 -- 172.21.15.132:0/3890785067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96c406a430 msgr2=0x7f96c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:30.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.436+0000 7f96e7f8b640 1 --2- 172.21.15.132:0/3890785067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96c406a430 0x7f96c406c8f0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7f96dc036000 tx=0x7f96dc008030 comp rx=0 tx=0).stop 2023-12-20T04:48:30.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.436+0000 7f96e7f8b640 1 -- 172.21.15.132:0/3890785067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96e0159d00 msgr2=0x7f96e01578f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:30.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.436+0000 7f96e7f8b640 1 --2- 172.21.15.132:0/3890785067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96e0159d00 0x7f96e01578f0 secure :-1 s=READY pgs=1301 cs=0 l=1 rev1=1 crypto rx=0x7f96d000c430 tx=0x7f96d000c8f0 comp rx=0 tx=0).stop 2023-12-20T04:48:30.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.436+0000 7f96e7f8b640 1 -- 172.21.15.132:0/3890785067 shutdown_connections 2023-12-20T04:48:30.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.436+0000 7f96e7f8b640 1 --2- 172.21.15.132:0/3890785067 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96c406a430 0x7f96c406c8f0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:30.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.436+0000 7f96e7f8b640 1 --2- 172.21.15.132:0/3890785067 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96e015df40 0x7f96e00b4d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:30.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.436+0000 7f96e7f8b640 1 --2- 172.21.15.132:0/3890785067 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96e0159d00 0x7f96e01578f0 unknown :-1 s=CLOSED pgs=1301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:30.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.436+0000 7f96e7f8b640 1 --2- 172.21.15.132:0/3890785067 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f96e006cc30 0x7f96e0155190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:30.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.436+0000 7f96e7f8b640 1 -- 172.21.15.132:0/3890785067 >> 172.21.15.132:0/3890785067 conn(0x7f96e00cfca0 msgr2=0x7f96e00cb470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:30.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.436+0000 7f96e7f8b640 1 -- 172.21.15.132:0/3890785067 shutdown_connections 2023-12-20T04:48:30.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.436+0000 7f96e7f8b640 1 -- 172.21.15.132:0/3890785067 wait complete. 2023-12-20T04:48:30.449 INFO:tasks.cephfs_test_runner:That when an OSD epoch barrier is set on an MDS, subsequently ... ok 2023-12-20T04:48:30.449 INFO:tasks.cephfs_test_runner:Starting test: test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) 2023-12-20T04:48:30.450 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-12-20T04:48:30.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.547+0000 7f1488577640 1 Processor -- start 2023-12-20T04:48:30.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.547+0000 7f1488577640 1 -- start start 2023-12-20T04:48:30.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.548+0000 7f1488577640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1480160d70 0x7f1480069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:30.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.548+0000 7f1488577640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f148006a170 0x7f148015dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:30.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.548+0000 7f1488577640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1480161220 con 0x7f148015ab70 2023-12-20T04:48:30.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.548+0000 7f1488577640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f148006d530 con 0x7f1480160d70 2023-12-20T04:48:30.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.548+0000 7f1488577640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1480070540 con 0x7f148006a170 2023-12-20T04:48:30.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.549+0000 7f1486b14640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f148006a170 0x7f148015dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:30.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.549+0000 7f1485b12640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1480160d70 0x7f1480069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:30.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.549+0000 7f1486313640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f148015ab70 0x7f14800cf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:49758/0 (socket says 172.21.15.132:49758) 2023-12-20T04:48:30.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.549+0000 7f1486313640 1 -- 172.21.15.132:0/3559137794 learned_addr learned my addr 172.21.15.132:0/3559137794 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:30.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.549+0000 7f1485b12640 1 -- 172.21.15.132:0/3559137794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f148006a170 msgr2=0x7f148015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:30.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.549+0000 7f1485b12640 1 --2- 172.21.15.132:0/3559137794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f148006a170 0x7f148015dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:30.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.549+0000 7f1485b12640 1 -- 172.21.15.132:0/3559137794 >> v1:172.21.15.187:6789/0 conn(0x7f148015ab70 legacy=0x7f14800cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:30.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.549+0000 7f1485b12640 1 -- 172.21.15.132:0/3559137794 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f148006a580 con 0x7f1480160d70 2023-12-20T04:48:30.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.550+0000 7f1485b12640 1 --2- 172.21.15.132:0/3559137794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1480160d70 0x7f1480069c30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f14700097a0 tx=0x7f147002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=2e5fc9406bb0368 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:30.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.550+0000 7f1485311640 1 -- 172.21.15.132:0/3559137794 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470031830 con 0x7f1480160d70 2023-12-20T04:48:30.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.550+0000 7f1485311640 1 -- 172.21.15.132:0/3559137794 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1470031990 con 0x7f1480160d70 2023-12-20T04:48:30.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.550+0000 7f1485311640 1 -- 172.21.15.132:0/3559137794 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1470031d20 con 0x7f1480160d70 2023-12-20T04:48:30.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.550+0000 7f1488577640 1 -- 172.21.15.132:0/3559137794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1480160d70 msgr2=0x7f1480069c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:30.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.550+0000 7f1488577640 1 --2- 172.21.15.132:0/3559137794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1480160d70 0x7f1480069c30 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f14700097a0 tx=0x7f147002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:48:30.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.551+0000 7f1488577640 1 -- 172.21.15.132:0/3559137794 shutdown_connections 2023-12-20T04:48:30.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.551+0000 7f1488577640 1 --2- 172.21.15.132:0/3559137794 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f148006a170 0x7f148015dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:30.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.551+0000 7f1488577640 1 --2- 172.21.15.132:0/3559137794 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1480160d70 0x7f1480069c30 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:30.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.551+0000 7f1488577640 1 -- 172.21.15.132:0/3559137794 >> 172.21.15.132:0/3559137794 conn(0x7f14800cfca0 msgr2=0x7f14800d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:30.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.551+0000 7f1488577640 1 -- 172.21.15.132:0/3559137794 shutdown_connections 2023-12-20T04:48:30.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.551+0000 7f1488577640 1 -- 172.21.15.132:0/3559137794 wait complete. 2023-12-20T04:48:30.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.552+0000 7f1488577640 1 Processor -- start 2023-12-20T04:48:30.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.552+0000 7f1488577640 1 -- start start 2023-12-20T04:48:30.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.552+0000 7f1488577640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f148006a170 0x7f14800acc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:30.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.552+0000 7f1488577640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f148015ab70 0x7f148015fd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:30.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.552+0000 7f1488577640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1480160d70 0x7f14800ae670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:30.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1488577640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148015ea20 con 0x7f148006a170 2023-12-20T04:48:30.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1488577640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f148015ec70 con 0x7f1480160d70 2023-12-20T04:48:30.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1488577640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f148015ef50 con 0x7f148015ab70 2023-12-20T04:48:30.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1486313640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f148006a170 0x7f14800acc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:30.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1486313640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f148006a170 0x7f14800acc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49350/0 (socket says 172.21.15.132:49350) 2023-12-20T04:48:30.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1486313640 1 -- 172.21.15.132:0/28105743 learned_addr learned my addr 172.21.15.132:0/28105743 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:30.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1485b12640 1 --2- 172.21.15.132:0/28105743 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f148015ab70 0x7f148015fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:30.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1486b14640 1 --2- 172.21.15.132:0/28105743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1480160d70 0x7f14800ae670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:30.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1486313640 1 -- 172.21.15.132:0/28105743 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f148015ab70 msgr2=0x7f148015fd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:30.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1486313640 1 --2- 172.21.15.132:0/28105743 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f148015ab70 0x7f148015fd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:30.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1486313640 1 -- 172.21.15.132:0/28105743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1480160d70 msgr2=0x7f14800ae670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:30.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1486313640 1 --2- 172.21.15.132:0/28105743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1480160d70 0x7f14800ae670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:30.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1486313640 1 -- 172.21.15.132:0/28105743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1470009400 con 0x7f148006a170 2023-12-20T04:48:30.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1486313640 1 --2- 172.21.15.132:0/28105743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f148006a170 0x7f14800acc00 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f147c00cba0 tx=0x7f147c00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:30.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1476ffd640 1 -- 172.21.15.132:0/28105743 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c00ad40 con 0x7f148006a170 2023-12-20T04:48:30.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1476ffd640 1 -- 172.21.15.132:0/28105743 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f147c012400 con 0x7f148006a170 2023-12-20T04:48:30.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1488577640 1 -- 172.21.15.132:0/28105743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f148015f230 con 0x7f148006a170 2023-12-20T04:48:30.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1476ffd640 1 -- 172.21.15.132:0/28105743 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f147c00aea0 con 0x7f148006a170 2023-12-20T04:48:30.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.553+0000 7f1488577640 1 -- 172.21.15.132:0/28105743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f148015f5c0 con 0x7f148006a170 2023-12-20T04:48:30.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.554+0000 7f1488577640 1 -- 172.21.15.132:0/28105743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f148015f3c0 con 0x7f148006a170 2023-12-20T04:48:30.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.555+0000 7f1476ffd640 1 -- 172.21.15.132:0/28105743 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f147c007070 con 0x7f148006a170 2023-12-20T04:48:30.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.555+0000 7f1476ffd640 1 --2- 172.21.15.132:0/28105743 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f146406a430 0x7f146406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:30.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.555+0000 7f1476ffd640 1 -- 172.21.15.132:0/28105743 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f147c0884a0 con 0x7f148006a170 2023-12-20T04:48:30.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.555+0000 7f1485b12640 1 --2- 172.21.15.132:0/28105743 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f146406a430 0x7f146406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:30.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.556+0000 7f1485b12640 1 --2- 172.21.15.132:0/28105743 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f146406a430 0x7f146406c8f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1470036000 tx=0x7f147003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:30.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.559+0000 7f1476ffd640 1 -- 172.21.15.132:0/28105743 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f147c053ed0 con 0x7f148006a170 2023-12-20T04:48:30.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:30.788+0000 7f1488577640 1 -- 172.21.15.132:0/28105743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f14800ad200 con 0x7f148006a170 2023-12-20T04:48:31.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.438+0000 7f1476ffd640 1 -- 172.21.15.132:0/28105743 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v309) v1 ==== 143+0+0 (secure 0 0 0) 0x7f147c0170d0 con 0x7f148006a170 2023-12-20T04:48:31.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.440+0000 7f1488577640 1 -- 172.21.15.132:0/28105743 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f146406a430 msgr2=0x7f146406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.440+0000 7f1488577640 1 --2- 172.21.15.132:0/28105743 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f146406a430 0x7f146406c8f0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f1470036000 tx=0x7f147003c040 comp rx=0 tx=0).stop 2023-12-20T04:48:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.440+0000 7f1488577640 1 -- 172.21.15.132:0/28105743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f148006a170 msgr2=0x7f14800acc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.440+0000 7f1488577640 1 --2- 172.21.15.132:0/28105743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f148006a170 0x7f14800acc00 secure :-1 s=READY pgs=1302 cs=0 l=1 rev1=1 crypto rx=0x7f147c00cba0 tx=0x7f147c00a430 comp rx=0 tx=0).stop 2023-12-20T04:48:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.440+0000 7f1488577640 1 -- 172.21.15.132:0/28105743 shutdown_connections 2023-12-20T04:48:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.440+0000 7f1488577640 1 --2- 172.21.15.132:0/28105743 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f146406a430 0x7f146406c8f0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.440+0000 7f1488577640 1 --2- 172.21.15.132:0/28105743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1480160d70 0x7f14800ae670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.440+0000 7f1488577640 1 --2- 172.21.15.132:0/28105743 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f148015ab70 0x7f148015fd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.440+0000 7f1488577640 1 --2- 172.21.15.132:0/28105743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f148006a170 0x7f14800acc00 unknown :-1 s=CLOSED pgs=1302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.440+0000 7f1488577640 1 -- 172.21.15.132:0/28105743 >> 172.21.15.132:0/28105743 conn(0x7f14800cfca0 msgr2=0x7f14800b5170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.441+0000 7f1488577640 1 -- 172.21.15.132:0/28105743 shutdown_connections 2023-12-20T04:48:31.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.441+0000 7f1488577640 1 -- 172.21.15.132:0/28105743 wait complete. 2023-12-20T04:48:31.455 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-20T04:48:31.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.559+0000 7fc86f77d640 1 Processor -- start 2023-12-20T04:48:31.560 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.559+0000 7fc86f77d640 1 -- start start 2023-12-20T04:48:31.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.559+0000 7fc86f77d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc868069c30 0x7fc868070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:31.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.559+0000 7fc86f77d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc86815d360 0x7fc86806a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:31.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.559+0000 7fc86f77d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc8680c4f40 con 0x7fc8680cbde0 2023-12-20T04:48:31.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.559+0000 7fc86f77d640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc8680af5b0 con 0x7fc86815d360 2023-12-20T04:48:31.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.559+0000 7fc86f77d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc86806a550 con 0x7fc868069c30 2023-12-20T04:48:31.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.560+0000 7fc86cd18640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc86815d360 0x7fc86806a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:31.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.560+0000 7fc86cd18640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc86815d360 0x7fc86806a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49364/0 (socket says 172.21.15.132:49364) 2023-12-20T04:48:31.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.560+0000 7fc86cd18640 1 -- 172.21.15.132:0/32577849 learned_addr learned my addr 172.21.15.132:0/32577849 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:31.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.560+0000 7fc86d519640 1 --2- 172.21.15.132:0/32577849 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc868069c30 0x7fc868070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:31.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.560+0000 7fc86cd18640 1 -- 172.21.15.132:0/32577849 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc868069c30 msgr2=0x7fc868070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:31.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.560+0000 7fc86cd18640 1 --2- 172.21.15.132:0/32577849 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc868069c30 0x7fc868070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:31.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.560+0000 7fc86cd18640 1 -- 172.21.15.132:0/32577849 >> v1:172.21.15.187:6789/0 conn(0x7fc8680cbde0 legacy=0x7fc8680ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:31.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.560+0000 7fc86cd18640 1 -- 172.21.15.132:0/32577849 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc868070a40 con 0x7fc86815d360 2023-12-20T04:48:31.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.560+0000 7fc86d519640 1 --2- 172.21.15.132:0/32577849 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc868069c30 0x7fc868070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:31.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.561+0000 7fc86cd18640 1 --2- 172.21.15.132:0/32577849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc86815d360 0x7fc86806a010 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fc864009870 tx=0x7fc86402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa9366703c09a888 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:31.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.561+0000 7fc85ffff640 1 -- 172.21.15.132:0/32577849 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864030840 con 0x7fc86815d360 2023-12-20T04:48:31.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.561+0000 7fc85ffff640 1 -- 172.21.15.132:0/32577849 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc8640309a0 con 0x7fc86815d360 2023-12-20T04:48:31.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.561+0000 7fc85ffff640 1 -- 172.21.15.132:0/32577849 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc864030d30 con 0x7fc86815d360 2023-12-20T04:48:31.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.561+0000 7fc86f77d640 1 -- 172.21.15.132:0/32577849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc86815d360 msgr2=0x7fc86806a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:31.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.561+0000 7fc86f77d640 1 --2- 172.21.15.132:0/32577849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc86815d360 0x7fc86806a010 secure :-1 s=READY pgs=1303 cs=0 l=1 rev1=1 crypto rx=0x7fc864009870 tx=0x7fc86402b980 comp rx=0 tx=0).stop 2023-12-20T04:48:31.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.561+0000 7fc86f77d640 1 -- 172.21.15.132:0/32577849 shutdown_connections 2023-12-20T04:48:31.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.561+0000 7fc86f77d640 1 --2- 172.21.15.132:0/32577849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc86815d360 0x7fc86806a010 unknown :-1 s=CLOSED pgs=1303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:31.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.561+0000 7fc86f77d640 1 --2- 172.21.15.132:0/32577849 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc868069c30 0x7fc868070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:31.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.561+0000 7fc86f77d640 1 -- 172.21.15.132:0/32577849 >> 172.21.15.132:0/32577849 conn(0x7fc8680cc630 msgr2=0x7fc8680cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:31.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.561+0000 7fc86f77d640 1 -- 172.21.15.132:0/32577849 shutdown_connections 2023-12-20T04:48:31.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.562+0000 7fc86f77d640 1 -- 172.21.15.132:0/32577849 wait complete. 2023-12-20T04:48:31.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.563+0000 7fc86f77d640 1 Processor -- start 2023-12-20T04:48:31.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.563+0000 7fc86f77d640 1 -- start start 2023-12-20T04:48:31.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.563+0000 7fc86f77d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc868069c30 0x7fc86815feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:31.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.563+0000 7fc86f77d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8680cbde0 0x7fc8680b43d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:31.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.563+0000 7fc86f77d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc86815d360 0x7fc8680b4910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:31.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.563+0000 7fc86f77d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8680b4e50 con 0x7fc868069c30 2023-12-20T04:48:31.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.563+0000 7fc86f77d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8680b5050 con 0x7fc8680cbde0 2023-12-20T04:48:31.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.563+0000 7fc86f77d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc8680b2960 con 0x7fc86815d360 2023-12-20T04:48:31.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.563+0000 7fc86d519640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc868069c30 0x7fc86815feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:31.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.563+0000 7fc86d519640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc868069c30 0x7fc86815feb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49372/0 (socket says 172.21.15.132:49372) 2023-12-20T04:48:31.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.563+0000 7fc86d519640 1 -- 172.21.15.132:0/2721284748 learned_addr learned my addr 172.21.15.132:0/2721284748 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:31.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.564+0000 7fc86cd18640 1 --2- 172.21.15.132:0/2721284748 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8680cbde0 0x7fc8680b43d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:31.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.564+0000 7fc86dd1a640 1 --2- 172.21.15.132:0/2721284748 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc86815d360 0x7fc8680b4910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:31.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.564+0000 7fc86d519640 1 -- 172.21.15.132:0/2721284748 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc86815d360 msgr2=0x7fc8680b4910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:31.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.564+0000 7fc86d519640 1 --2- 172.21.15.132:0/2721284748 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc86815d360 0x7fc8680b4910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:31.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.564+0000 7fc86d519640 1 -- 172.21.15.132:0/2721284748 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8680cbde0 msgr2=0x7fc8680b43d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:31.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.564+0000 7fc86d519640 1 --2- 172.21.15.132:0/2721284748 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8680cbde0 0x7fc8680b43d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:31.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.564+0000 7fc86d519640 1 -- 172.21.15.132:0/2721284748 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8640094d0 con 0x7fc868069c30 2023-12-20T04:48:31.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.564+0000 7fc86d519640 1 --2- 172.21.15.132:0/2721284748 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc868069c30 0x7fc86815feb0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fc85800d7d0 tx=0x7fc85800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:31.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.564+0000 7fc85dffb640 1 -- 172.21.15.132:0/2721284748 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858004030 con 0x7fc868069c30 2023-12-20T04:48:31.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.564+0000 7fc85dffb640 1 -- 172.21.15.132:0/2721284748 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc858004190 con 0x7fc868069c30 2023-12-20T04:48:31.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.564+0000 7fc85dffb640 1 -- 172.21.15.132:0/2721284748 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc858004520 con 0x7fc868069c30 2023-12-20T04:48:31.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.564+0000 7fc86f77d640 1 -- 172.21.15.132:0/2721284748 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8680b2c40 con 0x7fc868069c30 2023-12-20T04:48:31.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.564+0000 7fc86f77d640 1 -- 172.21.15.132:0/2721284748 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8680b3200 con 0x7fc868069c30 2023-12-20T04:48:31.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.565+0000 7fc86f77d640 1 -- 172.21.15.132:0/2721284748 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc86804e840 con 0x7fc868069c30 2023-12-20T04:48:31.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.565+0000 7fc85dffb640 1 -- 172.21.15.132:0/2721284748 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc85800b6c0 con 0x7fc868069c30 2023-12-20T04:48:31.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.566+0000 7fc85dffb640 1 --2- 172.21.15.132:0/2721284748 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc84c06a430 0x7fc84c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:31.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.566+0000 7fc85dffb640 1 -- 172.21.15.132:0/2721284748 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc8580887d0 con 0x7fc868069c30 2023-12-20T04:48:31.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.566+0000 7fc86cd18640 1 --2- 172.21.15.132:0/2721284748 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc84c06a430 0x7fc84c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:31.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.566+0000 7fc86cd18640 1 --2- 172.21.15.132:0/2721284748 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc84c06a430 0x7fc84c06c8f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc864036000 tx=0x7fc864008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:31.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.570+0000 7fc85dffb640 1 -- 172.21.15.132:0/2721284748 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc8580540c0 con 0x7fc868069c30 2023-12-20T04:48:31.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.736+0000 7fc86f77d640 1 -- 172.21.15.132:0/2721284748 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7fc8680b1570 con 0x7fc868069c30 2023-12-20T04:48:31.742 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.740+0000 7fc85dffb640 1 -- 172.21.15.132:0/2721284748 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v14)=0 v14) v1 ==== 122+0+0 (secure 0 0 0) 0x7fc8580576e0 con 0x7fc868069c30 2023-12-20T04:48:31.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.742+0000 7fc86f77d640 1 -- 172.21.15.132:0/2721284748 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc84c06a430 msgr2=0x7fc84c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:31.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.742+0000 7fc86f77d640 1 --2- 172.21.15.132:0/2721284748 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc84c06a430 0x7fc84c06c8f0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fc864036000 tx=0x7fc864008030 comp rx=0 tx=0).stop 2023-12-20T04:48:31.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.742+0000 7fc86f77d640 1 -- 172.21.15.132:0/2721284748 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc868069c30 msgr2=0x7fc86815feb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:31.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.742+0000 7fc86f77d640 1 --2- 172.21.15.132:0/2721284748 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc868069c30 0x7fc86815feb0 secure :-1 s=READY pgs=1304 cs=0 l=1 rev1=1 crypto rx=0x7fc85800d7d0 tx=0x7fc85800dc90 comp rx=0 tx=0).stop 2023-12-20T04:48:31.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.742+0000 7fc86f77d640 1 -- 172.21.15.132:0/2721284748 shutdown_connections 2023-12-20T04:48:31.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.742+0000 7fc86f77d640 1 --2- 172.21.15.132:0/2721284748 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc84c06a430 0x7fc84c06c8f0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:31.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.742+0000 7fc86f77d640 1 --2- 172.21.15.132:0/2721284748 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc86815d360 0x7fc8680b4910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:31.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.742+0000 7fc86f77d640 1 --2- 172.21.15.132:0/2721284748 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc8680cbde0 0x7fc8680b43d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:31.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.742+0000 7fc86f77d640 1 --2- 172.21.15.132:0/2721284748 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc868069c30 0x7fc86815feb0 unknown :-1 s=CLOSED pgs=1304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:31.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.742+0000 7fc86f77d640 1 -- 172.21.15.132:0/2721284748 >> 172.21.15.132:0/2721284748 conn(0x7fc8680cc630 msgr2=0x7fc86806c5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:31.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.742+0000 7fc86f77d640 1 -- 172.21.15.132:0/2721284748 shutdown_connections 2023-12-20T04:48:31.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:31.742+0000 7fc86f77d640 1 -- 172.21.15.132:0/2721284748 wait complete. 2023-12-20T04:48:31.755 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:48:31.755 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:48:31.795 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:48:31.841 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:48:31.841 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:48:31.841 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:48:31.857 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:48:31.857 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:48:31.857 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:48:31.874 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:48:31.874 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:48:31.874 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:48:31.911 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:48:31.911 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:48:31.912 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:48:31.930 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:48:31.930 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-20T04:48:31.930 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:48:32.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.048+0000 7f0b7392a640 1 Processor -- start 2023-12-20T04:48:32.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.049+0000 7f0b7392a640 1 -- start start 2023-12-20T04:48:32.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.049+0000 7f0b7392a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b6c1588e0 0x7f0b6c069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:32.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.049+0000 7f0b7392a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0b6c06a170 0x7f0b6c06c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:32.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.049+0000 7f0b7392a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b6c06a5d0 con 0x7f0b6c06cd30 2023-12-20T04:48:32.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.049+0000 7f0b7392a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b6c06d520 con 0x7f0b6c06a170 2023-12-20T04:48:32.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.049+0000 7f0b7392a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c06ea90 con 0x7f0b6c1588e0 2023-12-20T04:48:32.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.050+0000 7f0b716c6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b6c1588e0 0x7f0b6c069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:32.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.050+0000 7f0b70ec5640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0b6c06a170 0x7f0b6c06c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:32.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.050+0000 7f0b716c6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b6c1588e0 0x7f0b6c069c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:57800/0 (socket says 172.21.15.132:57800) 2023-12-20T04:48:32.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.050+0000 7f0b71ec7640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f0b6c06cd30 0x7f0b6c0b4bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:49772/0 (socket says 172.21.15.132:49772) 2023-12-20T04:48:32.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.050+0000 7f0b716c6640 1 -- 172.21.15.132:0/3846052043 learned_addr learned my addr 172.21.15.132:0/3846052043 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:32.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.050+0000 7f0b716c6640 1 -- 172.21.15.132:0/3846052043 >> v2:172.21.15.187:3300/0 conn(0x7f0b6c06a170 msgr2=0x7f0b6c06c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:32.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.050+0000 7f0b716c6640 1 --2- 172.21.15.132:0/3846052043 >> v2:172.21.15.187:3300/0 conn(0x7f0b6c06a170 0x7f0b6c06c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:32.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.050+0000 7f0b716c6640 1 -- 172.21.15.132:0/3846052043 >> v1:172.21.15.187:6789/0 conn(0x7f0b6c06cd30 legacy=0x7f0b6c0b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:32.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.050+0000 7f0b63fff640 1 -- 172.21.15.132:0/3846052043 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3610008675 0 0) 0x7f0b6c06a5d0 con 0x7f0b6c06cd30 2023-12-20T04:48:32.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.050+0000 7f0b716c6640 1 -- 172.21.15.132:0/3846052043 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b6c06e160 con 0x7f0b6c1588e0 2023-12-20T04:48:32.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.050+0000 7f0b70ec5640 1 --2- 172.21.15.132:0/3846052043 >> v2:172.21.15.187:3300/0 conn(0x7f0b6c06a170 0x7f0b6c06c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:48:32.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.051+0000 7f0b716c6640 1 --2- 172.21.15.132:0/3846052043 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b6c1588e0 0x7f0b6c069c30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009e50 tx=0x7f0b6802bf50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=718d3598154002a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.051+0000 7f0b63fff640 1 -- 172.21.15.132:0/3846052043 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6802caf0 con 0x7f0b6c1588e0 2023-12-20T04:48:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.051+0000 7f0b63fff640 1 -- 172.21.15.132:0/3846052043 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6802cc50 con 0x7f0b6c1588e0 2023-12-20T04:48:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.051+0000 7f0b63fff640 1 -- 172.21.15.132:0/3846052043 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b680343f0 con 0x7f0b6c1588e0 2023-12-20T04:48:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.052+0000 7f0b7392a640 1 -- 172.21.15.132:0/3846052043 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b6c1588e0 msgr2=0x7f0b6c069c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.052+0000 7f0b7392a640 1 --2- 172.21.15.132:0/3846052043 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b6c1588e0 0x7f0b6c069c30 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009e50 tx=0x7f0b6802bf50 comp rx=0 tx=0).stop 2023-12-20T04:48:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.052+0000 7f0b7392a640 1 -- 172.21.15.132:0/3846052043 shutdown_connections 2023-12-20T04:48:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.052+0000 7f0b7392a640 1 --2- 172.21.15.132:0/3846052043 >> v2:172.21.15.187:3300/0 conn(0x7f0b6c06a170 0x7f0b6c06c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.052+0000 7f0b7392a640 1 --2- 172.21.15.132:0/3846052043 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b6c1588e0 0x7f0b6c069c30 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.052+0000 7f0b7392a640 1 -- 172.21.15.132:0/3846052043 >> 172.21.15.132:0/3846052043 conn(0x7f0b6c0cfca0 msgr2=0x7f0b6c0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.052+0000 7f0b7392a640 1 -- 172.21.15.132:0/3846052043 shutdown_connections 2023-12-20T04:48:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.052+0000 7f0b7392a640 1 -- 172.21.15.132:0/3846052043 wait complete. 2023-12-20T04:48:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.053+0000 7f0b7392a640 1 Processor -- start 2023-12-20T04:48:32.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.053+0000 7f0b7392a640 1 -- start start 2023-12-20T04:48:32.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b7392a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b6c06a170 0x7f0b6c0c8a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:32.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b7392a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b6c06cd30 0x7f0b6c0c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:32.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b7392a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b6c1588e0 0x7f0b6c1f60b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:32.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b7392a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0c8fd0 con 0x7f0b6c06a170 2023-12-20T04:48:32.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b7392a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0cd870 con 0x7f0b6c06cd30 2023-12-20T04:48:32.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b7392a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b6c0cdb30 con 0x7f0b6c1588e0 2023-12-20T04:48:32.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b716c6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b6c06a170 0x7f0b6c0c8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:32.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b716c6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b6c06a170 0x7f0b6c0c8a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49384/0 (socket says 172.21.15.132:49384) 2023-12-20T04:48:32.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b716c6640 1 -- 172.21.15.132:0/3379768972 learned_addr learned my addr 172.21.15.132:0/3379768972 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:32.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b71ec7640 1 --2- 172.21.15.132:0/3379768972 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b6c1588e0 0x7f0b6c1f60b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:32.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b70ec5640 1 --2- 172.21.15.132:0/3379768972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b6c06cd30 0x7f0b6c0c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:32.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b716c6640 1 -- 172.21.15.132:0/3379768972 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b6c1588e0 msgr2=0x7f0b6c1f60b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:32.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b716c6640 1 --2- 172.21.15.132:0/3379768972 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b6c1588e0 0x7f0b6c1f60b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:32.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b716c6640 1 -- 172.21.15.132:0/3379768972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b6c06cd30 msgr2=0x7f0b6c0c6d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:32.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b716c6640 1 --2- 172.21.15.132:0/3379768972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b6c06cd30 0x7f0b6c0c6d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:32.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b716c6640 1 -- 172.21.15.132:0/3379768972 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b5c009400 con 0x7f0b6c06a170 2023-12-20T04:48:32.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b716c6640 1 --2- 172.21.15.132:0/3379768972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b6c06a170 0x7f0b6c0c8a90 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009e50 tx=0x7f0b68004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:32.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.054+0000 7f0b61ffb640 1 -- 172.21.15.132:0/3379768972 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b68009510 con 0x7f0b6c06a170 2023-12-20T04:48:32.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.055+0000 7f0b61ffb640 1 -- 172.21.15.132:0/3379768972 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b6803e450 con 0x7f0b6c06a170 2023-12-20T04:48:32.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.055+0000 7f0b7392a640 1 -- 172.21.15.132:0/3379768972 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b68009b30 con 0x7f0b6c06a170 2023-12-20T04:48:32.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.055+0000 7f0b61ffb640 1 -- 172.21.15.132:0/3379768972 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b6803e600 con 0x7f0b6c06a170 2023-12-20T04:48:32.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.055+0000 7f0b7392a640 1 -- 172.21.15.132:0/3379768972 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b6c0ce0f0 con 0x7f0b6c06a170 2023-12-20T04:48:32.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.056+0000 7f0b7392a640 1 -- 172.21.15.132:0/3379768972 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b6c04e840 con 0x7f0b6c06a170 2023-12-20T04:48:32.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.056+0000 7f0b61ffb640 1 -- 172.21.15.132:0/3379768972 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0b6803e760 con 0x7f0b6c06a170 2023-12-20T04:48:32.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.056+0000 7f0b61ffb640 1 --2- 172.21.15.132:0/3379768972 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b5006a430 0x7f0b5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:32.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.057+0000 7f0b70ec5640 1 --2- 172.21.15.132:0/3379768972 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b5006a430 0x7f0b5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:32.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.057+0000 7f0b61ffb640 1 -- 172.21.15.132:0/3379768972 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(128..128 src has 1..128) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0b680aafb0 con 0x7f0b6c06a170 2023-12-20T04:48:32.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.057+0000 7f0b70ec5640 1 --2- 172.21.15.132:0/3379768972 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b5006a430 0x7f0b5006c8f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0d0810 tx=0x7f0b5c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:32.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.061+0000 7f0b61ffb640 1 -- 172.21.15.132:0/3379768972 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0b680ddca0 con 0x7f0b6c06a170 2023-12-20T04:48:32.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.261+0000 7f0b7392a640 1 -- 172.21.15.132:0/3379768972 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0b6c0b35a0 con 0x7f0b6c06a170 2023-12-20T04:48:32.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.261+0000 7f0b61ffb640 1 -- 172.21.15.132:0/3379768972 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 47 v47) v1 ==== 94+0+3541 (secure 0 0 0) 0x7f0b68043df0 con 0x7f0b6c06a170 2023-12-20T04:48:32.263 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:32.263 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":47,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6475,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3951194420","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3951194420},{"type":"v1","addr":"172.21.15.187:6833","nonce":3951194420}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":6478,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/1575999914","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":1575999914},{"type":"v1","addr":"172.21.15.187:6835","nonce":1575999914}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7419,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2208233017","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2208233017},{"type":"v1","addr":"172.21.15.132:6836","nonce":2208233017}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":41},{"gid":7770,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/2294641992","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2294641992},{"type":"v1","addr":"172.21.15.132:6837","nonce":2294641992}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":47}],"filesystems":[]} 2023-12-20T04:48:32.264 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 47 2023-12-20T04:48:32.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.263+0000 7f0b7392a640 1 -- 172.21.15.132:0/3379768972 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b5006a430 msgr2=0x7f0b5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:32.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.263+0000 7f0b7392a640 1 --2- 172.21.15.132:0/3379768972 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b5006a430 0x7f0b5006c8f0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7f0b6c0d0810 tx=0x7f0b5c008040 comp rx=0 tx=0).stop 2023-12-20T04:48:32.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.263+0000 7f0b7392a640 1 -- 172.21.15.132:0/3379768972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b6c06a170 msgr2=0x7f0b6c0c8a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:32.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.263+0000 7f0b7392a640 1 --2- 172.21.15.132:0/3379768972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b6c06a170 0x7f0b6c0c8a90 secure :-1 s=READY pgs=1305 cs=0 l=1 rev1=1 crypto rx=0x7f0b68009e50 tx=0x7f0b68004a40 comp rx=0 tx=0).stop 2023-12-20T04:48:32.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.263+0000 7f0b7392a640 1 -- 172.21.15.132:0/3379768972 shutdown_connections 2023-12-20T04:48:32.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.263+0000 7f0b7392a640 1 --2- 172.21.15.132:0/3379768972 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b5006a430 0x7f0b5006c8f0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:32.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.263+0000 7f0b7392a640 1 --2- 172.21.15.132:0/3379768972 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b6c1588e0 0x7f0b6c1f60b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:32.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.263+0000 7f0b7392a640 1 --2- 172.21.15.132:0/3379768972 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b6c06cd30 0x7f0b6c0c6d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:32.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.263+0000 7f0b7392a640 1 --2- 172.21.15.132:0/3379768972 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b6c06a170 0x7f0b6c0c8a90 unknown :-1 s=CLOSED pgs=1305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:32.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.263+0000 7f0b7392a640 1 -- 172.21.15.132:0/3379768972 >> 172.21.15.132:0/3379768972 conn(0x7f0b6c0cfca0 msgr2=0x7f0b6c0b0b90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:32.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.263+0000 7f0b7392a640 1 -- 172.21.15.132:0/3379768972 shutdown_connections 2023-12-20T04:48:32.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.263+0000 7f0b7392a640 1 -- 172.21.15.132:0/3379768972 wait complete. 2023-12-20T04:48:32.276 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-20T04:48:32.276 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-20T04:48:32.277 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-20T04:48:32.277 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:48:32.277 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-20T04:48:32.277 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-20T04:48:32.277 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-20T04:48:32.277 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:48:32.277 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-20T04:48:32.278 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-20T04:48:32.278 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-20T04:48:32.278 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:48:32.278 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-20T04:48:32.278 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-20T04:48:32.278 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-20T04:48:32.278 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:48:32.286 INFO:tasks.ceph.mds.a:Stopped 2023-12-20T04:48:32.286 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-20T04:48:32.287 INFO:tasks.ceph.mds.c:Stopped 2023-12-20T04:48:32.287 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-20T04:48:32.289 INFO:tasks.ceph.mds.b:Stopped 2023-12-20T04:48:32.289 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-20T04:48:32.290 INFO:tasks.ceph.mds.d:Stopped 2023-12-20T04:48:32.290 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-20T04:48:32.329 INFO:tasks.ceph.mds.a:Started 2023-12-20T04:48:32.329 DEBUG:teuthology.parallel:result is None 2023-12-20T04:48:32.329 INFO:tasks.ceph.mds.c:Started 2023-12-20T04:48:32.330 DEBUG:teuthology.parallel:result is None 2023-12-20T04:48:32.332 INFO:tasks.ceph.mds.b:Started 2023-12-20T04:48:32.332 DEBUG:teuthology.parallel:result is None 2023-12-20T04:48:32.332 INFO:tasks.ceph.mds.d:Started 2023-12-20T04:48:32.333 DEBUG:teuthology.parallel:result is None 2023-12-20T04:48:32.333 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-20T04:48:32.405 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-12-20T04:48:32.405 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-12-20T04:48:32.413 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-12-20T04:48:32.414 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-12-20T04:48:32.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.437+0000 7f77964b6640 1 Processor -- start 2023-12-20T04:48:32.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.437+0000 7f77964b6640 1 -- start start 2023-12-20T04:48:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.438+0000 7f77964b6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f779015ab50 0x7f77901614d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.438+0000 7f77964b6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77900b2130 0x7f77900b2570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.438+0000 7f77964b6640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f779006bc40 0x7f779006c0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.438+0000 7f77964b6640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f779015e460 con 0x7f779015ab50 2023-12-20T04:48:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.438+0000 7f77964b6640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f77900b2ab0 con 0x7f779006bc40 2023-12-20T04:48:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.438+0000 7f778ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f779015ab50 0x7f77901614d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.438+0000 7f77964b6640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f779015af30 con 0x7f77900b2130 2023-12-20T04:48:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.438+0000 7f778ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f779015ab50 0x7f77901614d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49424/0 (socket says 172.21.15.132:49424) 2023-12-20T04:48:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.438+0000 7f778ffff640 1 -- 172.21.15.132:0/967357630 learned_addr learned my addr 172.21.15.132:0/967357630 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.438+0000 7f778f7fe640 1 --2- 172.21.15.132:0/967357630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77900b2130 0x7f77900b2570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:32.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.438+0000 7f7794a53640 1 --2- 172.21.15.132:0/967357630 >> v2:172.21.15.187:3300/0 conn(0x7f779006bc40 0x7f779006c0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.438+0000 7f778ffff640 1 -- 172.21.15.132:0/967357630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77900b2130 msgr2=0x7f77900b2570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.438+0000 7f778ffff640 1 --2- 172.21.15.132:0/967357630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77900b2130 0x7f77900b2570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.438+0000 7f778ffff640 1 -- 172.21.15.132:0/967357630 >> v2:172.21.15.187:3300/0 conn(0x7f779006bc40 msgr2=0x7f779006c0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.438+0000 7f778ffff640 1 --2- 172.21.15.132:0/967357630 >> v2:172.21.15.187:3300/0 conn(0x7f779006bc40 0x7f779006c0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.438+0000 7f778ffff640 1 -- 172.21.15.132:0/967357630 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7790161a10 con 0x7f779015ab50 2023-12-20T04:48:32.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.439+0000 7f778ffff640 1 --2- 172.21.15.132:0/967357630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f779015ab50 0x7f77901614d0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f77900b3e60 tx=0x7f778002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50adf4f156a1bbaa server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:32.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.439+0000 7f778effd640 1 -- 172.21.15.132:0/967357630 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780031870 con 0x7f779015ab50 2023-12-20T04:48:32.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.439+0000 7f778effd640 1 -- 172.21.15.132:0/967357630 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f77800319d0 con 0x7f779015ab50 2023-12-20T04:48:32.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.439+0000 7f778effd640 1 -- 172.21.15.132:0/967357630 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7780031d60 con 0x7f779015ab50 2023-12-20T04:48:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.440+0000 7f77964b6640 1 -- 172.21.15.132:0/967357630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f779015ab50 msgr2=0x7f77901614d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.440+0000 7f77964b6640 1 --2- 172.21.15.132:0/967357630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f779015ab50 0x7f77901614d0 secure :-1 s=READY pgs=1313 cs=0 l=1 rev1=1 crypto rx=0x7f77900b3e60 tx=0x7f778002b910 comp rx=0 tx=0).stop 2023-12-20T04:48:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.440+0000 7f77964b6640 1 -- 172.21.15.132:0/967357630 shutdown_connections 2023-12-20T04:48:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.440+0000 7f77964b6640 1 --2- 172.21.15.132:0/967357630 >> v2:172.21.15.187:3300/0 conn(0x7f779006bc40 0x7f779006c0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.440+0000 7f77964b6640 1 --2- 172.21.15.132:0/967357630 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77900b2130 0x7f77900b2570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.440+0000 7f77964b6640 1 --2- 172.21.15.132:0/967357630 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f779015ab50 0x7f77901614d0 unknown :-1 s=CLOSED pgs=1313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.440+0000 7f77964b6640 1 -- 172.21.15.132:0/967357630 >> 172.21.15.132:0/967357630 conn(0x7f7790069c30 msgr2=0x7f779006a010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.440+0000 7f77964b6640 1 -- 172.21.15.132:0/967357630 shutdown_connections 2023-12-20T04:48:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.440+0000 7f77964b6640 1 -- 172.21.15.132:0/967357630 wait complete. 2023-12-20T04:48:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.441+0000 7f77964b6640 1 Processor -- start 2023-12-20T04:48:32.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.442+0000 7f77964b6640 1 -- start start 2023-12-20T04:48:32.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.442+0000 7f77964b6640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f779006bc40 0x7f779013ad80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:32.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.442+0000 7f77964b6640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77900b2130 0x7f7790158c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:32.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.443+0000 7f77964b6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f779015ab50 0x7f7790159150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:32.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.443+0000 7f77964b6640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f779014fb50 con 0x7f779015ab50 2023-12-20T04:48:32.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.443+0000 7f77964b6640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7790159690 con 0x7f779006bc40 2023-12-20T04:48:32.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.443+0000 7f77964b6640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7790159940 con 0x7f77900b2130 2023-12-20T04:48:32.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.443+0000 7f7794a53640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f779015ab50 0x7f7790159150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:32.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.443+0000 7f7794a53640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f779015ab50 0x7f7790159150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49434/0 (socket says 172.21.15.132:49434) 2023-12-20T04:48:32.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.443+0000 7f7794a53640 1 -- 172.21.15.132:0/2920349943 learned_addr learned my addr 172.21.15.132:0/2920349943 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:32.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.443+0000 7f778ffff640 1 --2- 172.21.15.132:0/2920349943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f779006bc40 0x7f779013ad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:32.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.443+0000 7f778f7fe640 1 --2- 172.21.15.132:0/2920349943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77900b2130 0x7f7790158c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:32.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.443+0000 7f7794a53640 1 -- 172.21.15.132:0/2920349943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77900b2130 msgr2=0x7f7790158c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:32.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.443+0000 7f7794a53640 1 --2- 172.21.15.132:0/2920349943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77900b2130 0x7f7790158c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:32.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.443+0000 7f7794a53640 1 -- 172.21.15.132:0/2920349943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f779006bc40 msgr2=0x7f779013ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:32.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.443+0000 7f7794a53640 1 --2- 172.21.15.132:0/2920349943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f779006bc40 0x7f779013ad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:32.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.443+0000 7f7794a53640 1 -- 172.21.15.132:0/2920349943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f77800094d0 con 0x7f779015ab50 2023-12-20T04:48:32.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.443+0000 7f7794a53640 1 --2- 172.21.15.132:0/2920349943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f779015ab50 0x7f7790159150 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f778800efc0 tx=0x7f778800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:32.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.446+0000 7f778cff9640 1 -- 172.21.15.132:0/2920349943 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788009ba0 con 0x7f779015ab50 2023-12-20T04:48:32.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.446+0000 7f77964b6640 1 -- 172.21.15.132:0/2920349943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7790159c20 con 0x7f779015ab50 2023-12-20T04:48:32.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.446+0000 7f77964b6640 1 -- 172.21.15.132:0/2920349943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f779015a1e0 con 0x7f779015ab50 2023-12-20T04:48:32.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.446+0000 7f778cff9640 1 -- 172.21.15.132:0/2920349943 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f778800f040 con 0x7f779015ab50 2023-12-20T04:48:32.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.446+0000 7f778cff9640 1 -- 172.21.15.132:0/2920349943 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7788014680 con 0x7f779015ab50 2023-12-20T04:48:32.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.447+0000 7f77964b6640 1 -- 172.21.15.132:0/2920349943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7770005250 con 0x7f779015ab50 2023-12-20T04:48:32.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.448+0000 7f778cff9640 1 -- 172.21.15.132:0/2920349943 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f77880147e0 con 0x7f779015ab50 2023-12-20T04:48:32.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.448+0000 7f778cff9640 1 --2- 172.21.15.132:0/2920349943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f777c06a430 0x7f777c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:32.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.448+0000 7f778cff9640 1 -- 172.21.15.132:0/2920349943 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(132..132 src has 1..132) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7788089020 con 0x7f779015ab50 2023-12-20T04:48:32.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.448+0000 7f778ffff640 1 --2- 172.21.15.132:0/2920349943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f777c06a430 0x7f777c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:32.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.449+0000 7f778ffff640 1 --2- 172.21.15.132:0/2920349943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f777c06a430 0x7f777c06c8f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7780036000 tx=0x7f778003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:32.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.452+0000 7f778cff9640 1 -- 172.21.15.132:0/2920349943 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f77880549c0 con 0x7f779015ab50 2023-12-20T04:48:32.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:32.629+0000 7f77964b6640 1 -- 172.21.15.132:0/2920349943 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f7770005500 con 0x7f779015ab50 2023-12-20T04:48:33.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.455+0000 7f778cff9640 1 -- 172.21.15.132:0/2920349943 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v133) v1 ==== 97+0+0 (secure 0 0 0) 0x7f7788057fe0 con 0x7f779015ab50 2023-12-20T04:48:33.457 INFO:teuthology.orchestra.run.smithi132.stderr: removed all blocklist entries 2023-12-20T04:48:33.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.457+0000 7f77964b6640 1 -- 172.21.15.132:0/2920349943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f777c06a430 msgr2=0x7f777c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:33.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.457+0000 7f77964b6640 1 --2- 172.21.15.132:0/2920349943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f777c06a430 0x7f777c06c8f0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f7780036000 tx=0x7f778003c040 comp rx=0 tx=0).stop 2023-12-20T04:48:33.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.457+0000 7f77964b6640 1 -- 172.21.15.132:0/2920349943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f779015ab50 msgr2=0x7f7790159150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:33.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.457+0000 7f77964b6640 1 --2- 172.21.15.132:0/2920349943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f779015ab50 0x7f7790159150 secure :-1 s=READY pgs=1314 cs=0 l=1 rev1=1 crypto rx=0x7f778800efc0 tx=0x7f778800c490 comp rx=0 tx=0).stop 2023-12-20T04:48:33.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.457+0000 7f77964b6640 1 -- 172.21.15.132:0/2920349943 shutdown_connections 2023-12-20T04:48:33.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.457+0000 7f77964b6640 1 --2- 172.21.15.132:0/2920349943 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f777c06a430 0x7f777c06c8f0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.457+0000 7f77964b6640 1 --2- 172.21.15.132:0/2920349943 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f779015ab50 0x7f7790159150 unknown :-1 s=CLOSED pgs=1314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.457+0000 7f77964b6640 1 --2- 172.21.15.132:0/2920349943 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f77900b2130 0x7f7790158c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.457+0000 7f77964b6640 1 --2- 172.21.15.132:0/2920349943 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f779006bc40 0x7f779013ad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.457+0000 7f77964b6640 1 -- 172.21.15.132:0/2920349943 >> 172.21.15.132:0/2920349943 conn(0x7f7790069c30 msgr2=0x7f779015f5c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:33.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.457+0000 7f77964b6640 1 -- 172.21.15.132:0/2920349943 shutdown_connections 2023-12-20T04:48:33.460 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.457+0000 7f77964b6640 1 -- 172.21.15.132:0/2920349943 wait complete. 2023-12-20T04:48:33.471 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-20T04:48:33.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.570+0000 7f0dfd45b640 1 Processor -- start 2023-12-20T04:48:33.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.570+0000 7f0dfd45b640 1 -- start start 2023-12-20T04:48:33.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.571+0000 7f0dfd45b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0df80b4980 0x7f0df80b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:33.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.571+0000 7f0dfd45b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0df80d1aa0 0x7f0df80d1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:33.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.571+0000 7f0dfd45b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0df80b5320 con 0x7f0df8160450 2023-12-20T04:48:33.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.571+0000 7f0dfd45b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df80b5ec0 con 0x7f0df80b4980 2023-12-20T04:48:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.571+0000 7f0dfd45b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0df81617e0 con 0x7f0df80d1aa0 2023-12-20T04:48:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.571+0000 7f0df67fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0df80b4980 0x7f0df80b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.571+0000 7f0df67fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0df80b4980 0x7f0df80b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49446/0 (socket says 172.21.15.132:49446) 2023-12-20T04:48:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.571+0000 7f0df67fc640 1 -- 172.21.15.132:0/1300935941 learned_addr learned my addr 172.21.15.132:0/1300935941 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.571+0000 7f0df77fe640 1 --2- 172.21.15.132:0/1300935941 >> v2:172.21.15.187:3300/0 conn(0x7f0df80d1aa0 0x7f0df80d1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.571+0000 7f0df67fc640 1 -- 172.21.15.132:0/1300935941 >> v2:172.21.15.187:3300/0 conn(0x7f0df80d1aa0 msgr2=0x7f0df80d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.571+0000 7f0df67fc640 1 --2- 172.21.15.132:0/1300935941 >> v2:172.21.15.187:3300/0 conn(0x7f0df80d1aa0 0x7f0df80d1ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.571+0000 7f0df67fc640 1 -- 172.21.15.132:0/1300935941 >> v1:172.21.15.187:6789/0 conn(0x7f0df8160450 legacy=0x7f0df8160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:33.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.571+0000 7f0df67fc640 1 -- 172.21.15.132:0/1300935941 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df80d0fc0 con 0x7f0df80b4980 2023-12-20T04:48:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.572+0000 7f0df67fc640 1 --2- 172.21.15.132:0/1300935941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df80b4980 0x7f0df80b4de0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f0df8073c40 tx=0x7f0dec02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8dbc09043131a9d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.572+0000 7f0df5ffb640 1 -- 172.21.15.132:0/1300935941 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec030860 con 0x7f0df80b4980 2023-12-20T04:48:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.572+0000 7f0df5ffb640 1 -- 172.21.15.132:0/1300935941 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0dec0309c0 con 0x7f0df80b4980 2023-12-20T04:48:33.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.572+0000 7f0df5ffb640 1 -- 172.21.15.132:0/1300935941 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0dec030d50 con 0x7f0df80b4980 2023-12-20T04:48:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.573+0000 7f0dfd45b640 1 -- 172.21.15.132:0/1300935941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df80b4980 msgr2=0x7f0df80b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.573+0000 7f0dfd45b640 1 --2- 172.21.15.132:0/1300935941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df80b4980 0x7f0df80b4de0 secure :-1 s=READY pgs=1315 cs=0 l=1 rev1=1 crypto rx=0x7f0df8073c40 tx=0x7f0dec02b9a0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.573+0000 7f0dfd45b640 1 -- 172.21.15.132:0/1300935941 shutdown_connections 2023-12-20T04:48:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.573+0000 7f0dfd45b640 1 --2- 172.21.15.132:0/1300935941 >> v2:172.21.15.187:3300/0 conn(0x7f0df80d1aa0 0x7f0df80d1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.573+0000 7f0dfd45b640 1 --2- 172.21.15.132:0/1300935941 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df80b4980 0x7f0df80b4de0 unknown :-1 s=CLOSED pgs=1315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.573+0000 7f0dfd45b640 1 -- 172.21.15.132:0/1300935941 >> 172.21.15.132:0/1300935941 conn(0x7f0df80cf980 msgr2=0x7f0df80cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.573+0000 7f0dfd45b640 1 -- 172.21.15.132:0/1300935941 shutdown_connections 2023-12-20T04:48:33.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.573+0000 7f0dfd45b640 1 -- 172.21.15.132:0/1300935941 wait complete. 2023-12-20T04:48:33.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.574+0000 7f0dfd45b640 1 Processor -- start 2023-12-20T04:48:33.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.574+0000 7f0dfd45b640 1 -- start start 2023-12-20T04:48:33.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0dfd45b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df80b4980 0x7f0df814b290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:33.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0dfd45b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0df80d1aa0 0x7f0df80caf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:33.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0dfd45b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0df8160450 0x7f0df80cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:33.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0dfd45b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df8159d50 con 0x7f0df80b4980 2023-12-20T04:48:33.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0dfd45b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0df80cd2e0 con 0x7f0df80d1aa0 2023-12-20T04:48:33.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0dfd45b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0df8159420 con 0x7f0df8160450 2023-12-20T04:48:33.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0df6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df80b4980 0x7f0df814b290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:33.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0df6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df80b4980 0x7f0df814b290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49460/0 (socket says 172.21.15.132:49460) 2023-12-20T04:48:33.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0df6ffd640 1 -- 172.21.15.132:0/2448490731 learned_addr learned my addr 172.21.15.132:0/2448490731 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:33.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0df67fc640 1 --2- 172.21.15.132:0/2448490731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0df80d1aa0 0x7f0df80caf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:33.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0df77fe640 1 --2- 172.21.15.132:0/2448490731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0df8160450 0x7f0df80cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:33.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0df6ffd640 1 -- 172.21.15.132:0/2448490731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0df8160450 msgr2=0x7f0df80cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:33.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0df6ffd640 1 --2- 172.21.15.132:0/2448490731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0df8160450 0x7f0df80cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0df6ffd640 1 -- 172.21.15.132:0/2448490731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0df80d1aa0 msgr2=0x7f0df80caf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:33.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0df6ffd640 1 --2- 172.21.15.132:0/2448490731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0df80d1aa0 0x7f0df80caf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0df6ffd640 1 -- 172.21.15.132:0/2448490731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0dec0094d0 con 0x7f0df80b4980 2023-12-20T04:48:33.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0df67fc640 1 --2- 172.21.15.132:0/2448490731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0df80d1aa0 0x7f0df80caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:33.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.575+0000 7f0df6ffd640 1 --2- 172.21.15.132:0/2448490731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df80b4980 0x7f0df814b290 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f0de800b3f0 tx=0x7f0de800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:33.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.576+0000 7f0ddf7fe640 1 -- 172.21.15.132:0/2448490731 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de8011830 con 0x7f0df80b4980 2023-12-20T04:48:33.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.576+0000 7f0ddf7fe640 1 -- 172.21.15.132:0/2448490731 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0de8011990 con 0x7f0df80b4980 2023-12-20T04:48:33.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.576+0000 7f0dfd45b640 1 -- 172.21.15.132:0/2448490731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0df8159700 con 0x7f0df80b4980 2023-12-20T04:48:33.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.576+0000 7f0ddf7fe640 1 -- 172.21.15.132:0/2448490731 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0de8011d40 con 0x7f0df80b4980 2023-12-20T04:48:33.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.576+0000 7f0dfd45b640 1 -- 172.21.15.132:0/2448490731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0df814b7d0 con 0x7f0df80b4980 2023-12-20T04:48:33.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.577+0000 7f0dfd45b640 1 -- 172.21.15.132:0/2448490731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0df804e840 con 0x7f0df80b4980 2023-12-20T04:48:33.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.577+0000 7f0ddf7fe640 1 -- 172.21.15.132:0/2448490731 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0de801a400 con 0x7f0df80b4980 2023-12-20T04:48:33.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.577+0000 7f0ddf7fe640 1 --2- 172.21.15.132:0/2448490731 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0de406a430 0x7f0de406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:33.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.577+0000 7f0ddf7fe640 1 -- 172.21.15.132:0/2448490731 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f0de80884e0 con 0x7f0df80b4980 2023-12-20T04:48:33.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.577+0000 7f0df67fc640 1 --2- 172.21.15.132:0/2448490731 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0de406a430 0x7f0de406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:33.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.578+0000 7f0df67fc640 1 --2- 172.21.15.132:0/2448490731 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0de406a430 0x7f0de406c8f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0dec036000 tx=0x7f0dec008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:33.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.582+0000 7f0ddf7fe640 1 -- 172.21.15.132:0/2448490731 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0de8053d90 con 0x7f0df80b4980 2023-12-20T04:48:33.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.807+0000 7f0dfd45b640 1 -- 172.21.15.132:0/2448490731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f0df80d0ad0 con 0x7f0df80b4980 2023-12-20T04:48:33.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.808+0000 7f0ddf7fe640 1 -- 172.21.15.132:0/2448490731 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v18) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f0de8015090 con 0x7f0df80b4980 2023-12-20T04:48:33.810 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:33.810 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:48:33.810 INFO:teuthology.orchestra.run.smithi132.stdout: "auth_dump": [ 2023-12-20T04:48:33.810 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.810 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.a", 2023-12-20T04:48:33.810 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlbTdZOxAAUDz0Eno9DYvrYM1xg5jG/A==", 2023-12-20T04:48:33.810 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.810 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:48:33.810 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:48:33.811 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:48:33.811 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:33.811 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.811 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.811 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.b", 2023-12-20T04:48:33.811 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl43gVDBAA1qJwUU+Ii4BalGf3NtJnGA==", 2023-12-20T04:48:33.811 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.811 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:48:33.811 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:48:33.811 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:48:33.811 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:33.811 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.812 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.c", 2023-12-20T04:48:33.812 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlaSUVBxAA7HN3dSo9xfvkjvc6bwMxWg==", 2023-12-20T04:48:33.812 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.812 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:48:33.812 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:48:33.812 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:48:33.812 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:33.812 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.812 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.d", 2023-12-20T04:48:33.812 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl1DR4ExAANNOyGlf1Ayre/xZEb9JHYg==", 2023-12-20T04:48:33.812 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.812 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:48:33.813 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:48:33.813 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:48:33.813 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:33.813 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.813 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.813 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.0", 2023-12-20T04:48:33.813 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCucIJlwZfxORAAiT2g1poLu3OkmoyxNJQc8Q==", 2023-12-20T04:48:33.813 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.813 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:48:33.813 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:48:33.813 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:33.813 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.813 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.814 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.1", 2023-12-20T04:48:33.814 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlejHYBRAAKurKpW5gyOAQ+E4Su4xMSQ==", 2023-12-20T04:48:33.814 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.814 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:48:33.814 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:48:33.814 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:33.814 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.814 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.814 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.814 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.2", 2023-12-20T04:48:33.814 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlyfz8DBAA9a6tUjHF8IRIKeldwVFMcw==", 2023-12-20T04:48:33.814 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.814 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:48:33.814 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:48:33.815 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:33.815 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.815 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.815 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.3", 2023-12-20T04:48:33.815 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJllFEeFBAA6URrqUjQqHsrI5+qEBVs3g==", 2023-12-20T04:48:33.815 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.815 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:48:33.815 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:48:33.815 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:33.815 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.815 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.815 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.4", 2023-12-20T04:48:33.816 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlvGqcJhAAgn2wuSTwLT+TOHoE4iaVSg==", 2023-12-20T04:48:33.816 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.816 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:48:33.816 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:48:33.816 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:33.816 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.816 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.816 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.816 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.5", 2023-12-20T04:48:33.816 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlWrkTLhAA2KlpxTFPaiXLCvmURpg5rw==", 2023-12-20T04:48:33.816 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.816 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:48:33.816 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:48:33.817 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:33.817 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.817 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.6", 2023-12-20T04:48:33.817 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlnOQfNRAA//EVx0BZYQd7ovK2tFhgfA==", 2023-12-20T04:48:33.817 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.817 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:48:33.817 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:48:33.817 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:33.817 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.817 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.7", 2023-12-20T04:48:33.817 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCzcIJl4nfDABAAtBdl2qkzKcqhmzsukC7G5w==", 2023-12-20T04:48:33.818 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.818 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:48:33.818 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:48:33.818 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:33.818 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.818 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.818 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.0", 2023-12-20T04:48:33.818 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlm/nGFxAA6zndayizc50Il7l74BxkgQ==", 2023-12-20T04:48:33.818 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.818 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:48:33.818 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow r", 2023-12-20T04:48:33.818 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-20T04:48:33.818 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.819 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.819 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.1", 2023-12-20T04:48:33.819 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlppb6IBAArqCoSlSE5coxkj4+XjPoWg==", 2023-12-20T04:48:33.819 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.819 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:48:33.819 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:48:33.819 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:48:33.819 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:48:33.819 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.819 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.819 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.819 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.2", 2023-12-20T04:48:33.819 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlMgWUHRAAqSdmRGx+9J+3dO7ntaApdw==", 2023-12-20T04:48:33.819 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.820 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:48:33.820 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:48:33.820 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:48:33.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:48:33.820 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.820 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.820 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.820 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.3", 2023-12-20T04:48:33.820 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlcIe3JhAAjv9KfknxwySJURWdePN7vw==", 2023-12-20T04:48:33.820 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.820 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:48:33.820 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:48:33.820 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:48:33.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:48:33.820 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.821 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.821 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.821 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.admin", 2023-12-20T04:48:33.821 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJljrTdHhAAsAlaFaKctSv71GrifKs6zA==", 2023-12-20T04:48:33.821 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.821 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:48:33.821 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:48:33.821 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:48:33.821 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:33.821 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.821 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.821 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.821 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.x", 2023-12-20T04:48:33.822 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJl+KnxNxAAM/b3mubTMYlB9QUbfcPW8g==", 2023-12-20T04:48:33.822 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.822 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:48:33.822 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:48:33.822 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:33.822 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.822 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:33.822 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:33.822 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.y", 2023-12-20T04:48:33.822 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlMyAMNBAAWpoBNevgGIkZ7zKEdKn3Ag==", 2023-12-20T04:48:33.822 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:48:33.822 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:48:33.822 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:48:33.822 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:48:33.822 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.823 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:33.823 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:33.823 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:48:33.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.809+0000 7f0dfd45b640 1 -- 172.21.15.132:0/2448490731 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0de406a430 msgr2=0x7f0de406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:33.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.809+0000 7f0dfd45b640 1 --2- 172.21.15.132:0/2448490731 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0de406a430 0x7f0de406c8f0 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7f0dec036000 tx=0x7f0dec008030 comp rx=0 tx=0).stop 2023-12-20T04:48:33.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.809+0000 7f0dfd45b640 1 -- 172.21.15.132:0/2448490731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df80b4980 msgr2=0x7f0df814b290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:33.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.809+0000 7f0dfd45b640 1 --2- 172.21.15.132:0/2448490731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df80b4980 0x7f0df814b290 secure :-1 s=READY pgs=1316 cs=0 l=1 rev1=1 crypto rx=0x7f0de800b3f0 tx=0x7f0de800b8b0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.809+0000 7f0dfd45b640 1 -- 172.21.15.132:0/2448490731 shutdown_connections 2023-12-20T04:48:33.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.809+0000 7f0dfd45b640 1 --2- 172.21.15.132:0/2448490731 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0de406a430 0x7f0de406c8f0 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.809+0000 7f0dfd45b640 1 --2- 172.21.15.132:0/2448490731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0df8160450 0x7f0df80cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.809+0000 7f0dfd45b640 1 --2- 172.21.15.132:0/2448490731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0df80d1aa0 0x7f0df80caf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.810+0000 7f0dfd45b640 1 --2- 172.21.15.132:0/2448490731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0df80b4980 0x7f0df814b290 unknown :-1 s=CLOSED pgs=1316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.810+0000 7f0dfd45b640 1 -- 172.21.15.132:0/2448490731 >> 172.21.15.132:0/2448490731 conn(0x7f0df80cf980 msgr2=0x7f0df81552c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:33.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.810+0000 7f0dfd45b640 1 -- 172.21.15.132:0/2448490731 shutdown_connections 2023-12-20T04:48:33.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.810+0000 7f0dfd45b640 1 -- 172.21.15.132:0/2448490731 wait complete. 2023-12-20T04:48:33.826 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:48:33.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.923+0000 7fed99681640 1 Processor -- start 2023-12-20T04:48:33.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.923+0000 7fed99681640 1 -- start start 2023-12-20T04:48:33.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.924+0000 7fed99681640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed941588e0 0x7fed94069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:33.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.924+0000 7fed99681640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fed9406a170 0x7fed9406c7f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:33.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.924+0000 7fed99681640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fed9406a5d0 con 0x7fed9406cd30 2023-12-20T04:48:33.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.924+0000 7fed99681640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fed9406d520 con 0x7fed9406a170 2023-12-20T04:48:33.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.924+0000 7fed99681640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed9406ea90 con 0x7fed941588e0 2023-12-20T04:48:33.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.924+0000 7fed937fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fed9406cd30 0x7fed940b4bb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36490/0 (socket says 172.21.15.132:36490) 2023-12-20T04:48:33.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.924+0000 7fed937fe640 1 -- 172.21.15.132:0/3733105585 learned_addr learned my addr 172.21.15.132:0/3733105585 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:33.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.924+0000 7fed927fc640 1 --2- 172.21.15.132:0/3733105585 >> v2:172.21.15.187:3300/0 conn(0x7fed9406a170 0x7fed9406c7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:33.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.924+0000 7fed92ffd640 1 --2- 172.21.15.132:0/3733105585 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed941588e0 0x7fed94069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:33.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed91ffb640 1 -- 172.21.15.132:0/3733105585 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1688733359 0 0) 0x7fed9406a5d0 con 0x7fed9406cd30 2023-12-20T04:48:33.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed91ffb640 1 -- 172.21.15.132:0/3733105585 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fed7c003520 con 0x7fed9406cd30 2023-12-20T04:48:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed91ffb640 1 -- 172.21.15.132:0/3733105585 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1148753868 0 0) 0x7fed7c003520 con 0x7fed9406cd30 2023-12-20T04:48:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed91ffb640 1 -- 172.21.15.132:0/3733105585 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed941588e0 msgr2=0x7fed94069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed91ffb640 1 --2- 172.21.15.132:0/3733105585 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed941588e0 0x7fed94069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed91ffb640 1 -- 172.21.15.132:0/3733105585 >> v2:172.21.15.187:3300/0 conn(0x7fed9406a170 msgr2=0x7fed9406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed91ffb640 1 --2- 172.21.15.132:0/3733105585 >> v2:172.21.15.187:3300/0 conn(0x7fed9406a170 0x7fed9406c7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed91ffb640 1 -- 172.21.15.132:0/3733105585 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed9406e160 con 0x7fed9406cd30 2023-12-20T04:48:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed91ffb640 1 -- 172.21.15.132:0/3733105585 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fed8c001670 con 0x7fed9406cd30 2023-12-20T04:48:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed927fc640 1 --2- 172.21.15.132:0/3733105585 >> v2:172.21.15.187:3300/0 conn(0x7fed9406a170 0x7fed9406c7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:48:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed92ffd640 1 --2- 172.21.15.132:0/3733105585 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed941588e0 0x7fed94069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:48:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed91ffb640 1 -- 172.21.15.132:0/3733105585 >> v1:172.21.15.132:6789/0 conn(0x7fed9406cd30 legacy=0x7fed940b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed91ffb640 1 --2- 172.21.15.132:0/3733105585 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed941588e0 0x7fed7c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed91ffb640 1 --2- 172.21.15.132:0/3733105585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed7c003eb0 0x7fed7c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed91ffb640 1 --2- 172.21.15.132:0/3733105585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed7c004d00 0x7fed7c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed91ffb640 1 -- 172.21.15.132:0/3733105585 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9406d520 con 0x7fed7c004d00 2023-12-20T04:48:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed91ffb640 1 -- 172.21.15.132:0/3733105585 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed9406ea90 con 0x7fed7c003eb0 2023-12-20T04:48:33.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed91ffb640 1 -- 172.21.15.132:0/3733105585 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed7c00b980 con 0x7fed941588e0 2023-12-20T04:48:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed937fe640 1 --2- 172.21.15.132:0/3733105585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed7c004d00 0x7fed7c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed92ffd640 1 --2- 172.21.15.132:0/3733105585 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed941588e0 0x7fed7c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed927fc640 1 --2- 172.21.15.132:0/3733105585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed7c003eb0 0x7fed7c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed937fe640 1 -- 172.21.15.132:0/3733105585 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed941588e0 msgr2=0x7fed7c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed937fe640 1 --2- 172.21.15.132:0/3733105585 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed941588e0 0x7fed7c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed937fe640 1 -- 172.21.15.132:0/3733105585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed7c003eb0 msgr2=0x7fed7c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed937fe640 1 --2- 172.21.15.132:0/3733105585 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed7c003eb0 0x7fed7c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.925+0000 7fed937fe640 1 -- 172.21.15.132:0/3733105585 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed84009a70 con 0x7fed7c004d00 2023-12-20T04:48:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.926+0000 7fed937fe640 1 --2- 172.21.15.132:0/3733105585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed7c004d00 0x7fed7c005180 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00c240 tx=0x7fed7c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a1c6f41792906a5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.926+0000 7fed91ffb640 1 -- 172.21.15.132:0/3733105585 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c02cb00 con 0x7fed7c004d00 2023-12-20T04:48:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.926+0000 7fed91ffb640 1 -- 172.21.15.132:0/3733105585 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8c02cc60 con 0x7fed7c004d00 2023-12-20T04:48:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.926+0000 7fed91ffb640 1 -- 172.21.15.132:0/3733105585 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8c005af0 con 0x7fed7c004d00 2023-12-20T04:48:33.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.927+0000 7fed99681640 1 -- 172.21.15.132:0/3733105585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed7c004d00 msgr2=0x7fed7c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.927+0000 7fed99681640 1 --2- 172.21.15.132:0/3733105585 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed7c004d00 0x7fed7c005180 secure :-1 s=READY pgs=1318 cs=0 l=1 rev1=1 crypto rx=0x7fed8c00c240 tx=0x7fed7c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.927+0000 7fed937fe640 1 -- 172.21.15.132:0/3733105585 reap_dead start 2023-12-20T04:48:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.927+0000 7fed99681640 1 -- 172.21.15.132:0/3733105585 shutdown_connections 2023-12-20T04:48:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.927+0000 7fed99681640 1 -- 172.21.15.132:0/3733105585 >> 172.21.15.132:0/3733105585 conn(0x7fed940cfca0 msgr2=0x7fed940d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.927+0000 7fed99681640 1 -- 172.21.15.132:0/3733105585 shutdown_connections 2023-12-20T04:48:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.927+0000 7fed99681640 1 -- 172.21.15.132:0/3733105585 wait complete. 2023-12-20T04:48:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.928+0000 7fed99681640 1 Processor -- start 2023-12-20T04:48:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.928+0000 7fed99681640 1 -- start start 2023-12-20T04:48:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed99681640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed941555b0 0x7fed940ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed99681640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed94157970 0x7fed940c4d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed99681640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed940ae7f0 0x7fed940aec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed99681640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed940af1c0 con 0x7fed941555b0 2023-12-20T04:48:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed99681640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fed940adbf0 con 0x7fed94157970 2023-12-20T04:48:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed99681640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fed940cd9a0 con 0x7fed940ae7f0 2023-12-20T04:48:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed92ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed941555b0 0x7fed940ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed92ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed941555b0 0x7fed940ad2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49480/0 (socket says 172.21.15.132:49480) 2023-12-20T04:48:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed92ffd640 1 -- 172.21.15.132:0/2914824471 learned_addr learned my addr 172.21.15.132:0/2914824471 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed92ffd640 1 -- 172.21.15.132:0/2914824471 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed940ae7f0 msgr2=0x7fed940aec80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed92ffd640 1 --2- 172.21.15.132:0/2914824471 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed940ae7f0 0x7fed940aec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed92ffd640 1 -- 172.21.15.132:0/2914824471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed94157970 msgr2=0x7fed940c4d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed92ffd640 1 --2- 172.21.15.132:0/2914824471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed94157970 0x7fed940c4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed92ffd640 1 -- 172.21.15.132:0/2914824471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fed940cdc80 con 0x7fed941555b0 2023-12-20T04:48:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed92ffd640 1 --2- 172.21.15.132:0/2914824471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed941555b0 0x7fed940ad2f0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fed8400f430 tx=0x7fed8400f8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed7b7fe640 1 -- 172.21.15.132:0/2914824471 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed8400e040 con 0x7fed941555b0 2023-12-20T04:48:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed7b7fe640 1 -- 172.21.15.132:0/2914824471 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fed8400f040 con 0x7fed941555b0 2023-12-20T04:48:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.929+0000 7fed7b7fe640 1 -- 172.21.15.132:0/2914824471 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fed84003df0 con 0x7fed941555b0 2023-12-20T04:48:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.930+0000 7fed99681640 1 -- 172.21.15.132:0/2914824471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fed940cdf60 con 0x7fed941555b0 2023-12-20T04:48:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.930+0000 7fed99681640 1 -- 172.21.15.132:0/2914824471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fed940ad830 con 0x7fed941555b0 2023-12-20T04:48:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.930+0000 7fed99681640 1 -- 172.21.15.132:0/2914824471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fed9404e840 con 0x7fed941555b0 2023-12-20T04:48:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.931+0000 7fed7b7fe640 1 -- 172.21.15.132:0/2914824471 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fed84004030 con 0x7fed941555b0 2023-12-20T04:48:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.931+0000 7fed7b7fe640 1 --2- 172.21.15.132:0/2914824471 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fed8006a430 0x7fed8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:33.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.931+0000 7fed7b7fe640 1 -- 172.21.15.132:0/2914824471 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fed840891e0 con 0x7fed941555b0 2023-12-20T04:48:33.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.931+0000 7fed927fc640 1 --2- 172.21.15.132:0/2914824471 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fed8006a430 0x7fed8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:33.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.932+0000 7fed927fc640 1 --2- 172.21.15.132:0/2914824471 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fed8006a430 0x7fed8006c8f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fed88009c40 tx=0x7fed88009760 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:33.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:33.936+0000 7fed7b7fe640 1 -- 172.21.15.132:0/2914824471 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fed84054bb0 con 0x7fed941555b0 2023-12-20T04:48:34.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.103+0000 7fed99681640 1 -- 172.21.15.132:0/2914824471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fed940c35b0 con 0x7fed941555b0 2023-12-20T04:48:34.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.104+0000 7fed7b7fe640 1 -- 172.21.15.132:0/2914824471 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v133) v1 ==== 74+0+12448 (secure 0 0 0) 0x7fed840581d0 con 0x7fed941555b0 2023-12-20T04:48:34.106 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:34.106 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":133,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:48:33.453663+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":15,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":120,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:48:34.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.106+0000 7fed99681640 1 -- 172.21.15.132:0/2914824471 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fed8006a430 msgr2=0x7fed8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:34.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.106+0000 7fed99681640 1 --2- 172.21.15.132:0/2914824471 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fed8006a430 0x7fed8006c8f0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fed88009c40 tx=0x7fed88009760 comp rx=0 tx=0).stop 2023-12-20T04:48:34.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.106+0000 7fed99681640 1 -- 172.21.15.132:0/2914824471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed941555b0 msgr2=0x7fed940ad2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:34.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.106+0000 7fed99681640 1 --2- 172.21.15.132:0/2914824471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed941555b0 0x7fed940ad2f0 secure :-1 s=READY pgs=1319 cs=0 l=1 rev1=1 crypto rx=0x7fed8400f430 tx=0x7fed8400f8f0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.106+0000 7fed99681640 1 -- 172.21.15.132:0/2914824471 shutdown_connections 2023-12-20T04:48:34.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.106+0000 7fed99681640 1 --2- 172.21.15.132:0/2914824471 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fed8006a430 0x7fed8006c8f0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.106+0000 7fed99681640 1 --2- 172.21.15.132:0/2914824471 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fed940ae7f0 0x7fed940aec80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.106+0000 7fed99681640 1 --2- 172.21.15.132:0/2914824471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fed94157970 0x7fed940c4d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.106+0000 7fed99681640 1 --2- 172.21.15.132:0/2914824471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fed941555b0 0x7fed940ad2f0 unknown :-1 s=CLOSED pgs=1319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.106+0000 7fed99681640 1 -- 172.21.15.132:0/2914824471 >> 172.21.15.132:0/2914824471 conn(0x7fed940cfca0 msgr2=0x7fed94159080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:34.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.106+0000 7fed99681640 1 -- 172.21.15.132:0/2914824471 shutdown_connections 2023-12-20T04:48:34.109 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.106+0000 7fed99681640 1 -- 172.21.15.132:0/2914824471 wait complete. 2023-12-20T04:48:34.119 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:48:34.120 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:48:34.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.221+0000 7f6657577640 1 Processor -- start 2023-12-20T04:48:34.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.221+0000 7f6657577640 1 -- start start 2023-12-20T04:48:34.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6657577640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665015cf20 0x7f665006c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6657577640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f665015d300 0x7f6650161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6657577640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6650161c40 con 0x7f66500cd4b0 2023-12-20T04:48:34.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6657577640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f665006cc90 con 0x7f665015d300 2023-12-20T04:48:34.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6657577640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66500b2f30 con 0x7f665015cf20 2023-12-20T04:48:34.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6655b14640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f66500cd4b0 0x7f66500ceb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36502/0 (socket says 172.21.15.132:36502) 2023-12-20T04:48:34.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6655b14640 1 -- 172.21.15.132:0/2035258091 learned_addr learned my addr 172.21.15.132:0/2035258091 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:34.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6655313640 1 --2- 172.21.15.132:0/2035258091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665015cf20 0x7f665006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6654b12640 1 --2- 172.21.15.132:0/2035258091 >> v2:172.21.15.187:3300/0 conn(0x7f665015d300 0x7f6650161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6647fff640 1 -- 172.21.15.132:0/2035258091 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1251867391 0 0) 0x7f6650161c40 con 0x7f66500cd4b0 2023-12-20T04:48:34.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6647fff640 1 -- 172.21.15.132:0/2035258091 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f663c003520 con 0x7f66500cd4b0 2023-12-20T04:48:34.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6647fff640 1 -- 172.21.15.132:0/2035258091 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1925109788 0 0) 0x7f663c003520 con 0x7f66500cd4b0 2023-12-20T04:48:34.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6647fff640 1 -- 172.21.15.132:0/2035258091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665015cf20 msgr2=0x7f665006c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:34.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6647fff640 1 --2- 172.21.15.132:0/2035258091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665015cf20 0x7f665006c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6647fff640 1 -- 172.21.15.132:0/2035258091 >> v2:172.21.15.187:3300/0 conn(0x7f665015d300 msgr2=0x7f6650161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:34.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6647fff640 1 --2- 172.21.15.132:0/2035258091 >> v2:172.21.15.187:3300/0 conn(0x7f665015d300 0x7f6650161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6647fff640 1 -- 172.21.15.132:0/2035258091 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66500b3210 con 0x7f66500cd4b0 2023-12-20T04:48:34.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6647fff640 1 -- 172.21.15.132:0/2035258091 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f66480019f0 con 0x7f66500cd4b0 2023-12-20T04:48:34.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.222+0000 7f6647fff640 1 -- 172.21.15.132:0/2035258091 >> v1:172.21.15.132:6789/0 conn(0x7f66500cd4b0 legacy=0x7f66500ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:34.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.223+0000 7f6647fff640 1 --2- 172.21.15.132:0/2035258091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665015cf20 0x7f663c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.223+0000 7f6647fff640 1 --2- 172.21.15.132:0/2035258091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f663c003ef0 0x7f663c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.223+0000 7f6647fff640 1 --2- 172.21.15.132:0/2035258091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f663c004d00 0x7f663c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.223+0000 7f6647fff640 1 -- 172.21.15.132:0/2035258091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665006cc90 con 0x7f663c003ef0 2023-12-20T04:48:34.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.223+0000 7f6647fff640 1 -- 172.21.15.132:0/2035258091 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66500b2f30 con 0x7f663c004d00 2023-12-20T04:48:34.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.223+0000 7f6647fff640 1 -- 172.21.15.132:0/2035258091 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f663c00b980 con 0x7f665015cf20 2023-12-20T04:48:34.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.223+0000 7f6654b12640 1 --2- 172.21.15.132:0/2035258091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f663c003ef0 0x7f663c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.223+0000 7f6655b14640 1 --2- 172.21.15.132:0/2035258091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f663c004d00 0x7f663c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.223+0000 7f6655313640 1 --2- 172.21.15.132:0/2035258091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665015cf20 0x7f663c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.223+0000 7f6654b12640 1 -- 172.21.15.132:0/2035258091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665015cf20 msgr2=0x7f663c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.223+0000 7f6654b12640 1 --2- 172.21.15.132:0/2035258091 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f665015cf20 0x7f663c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.223+0000 7f6654b12640 1 -- 172.21.15.132:0/2035258091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f663c004d00 msgr2=0x7f663c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.223+0000 7f6654b12640 1 --2- 172.21.15.132:0/2035258091 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f663c004d00 0x7f663c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.223+0000 7f6654b12640 1 -- 172.21.15.132:0/2035258091 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f663c003520 con 0x7f663c003ef0 2023-12-20T04:48:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.224+0000 7f6654b12640 1 --2- 172.21.15.132:0/2035258091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f663c003ef0 0x7f663c0047c0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f6640009ac0 tx=0x7f663c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c092e97357f0aa43 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.224+0000 7f6647fff640 1 -- 172.21.15.132:0/2035258091 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664002c6d0 con 0x7f663c003ef0 2023-12-20T04:48:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.224+0000 7f6647fff640 1 -- 172.21.15.132:0/2035258091 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f664002c830 con 0x7f663c003ef0 2023-12-20T04:48:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.224+0000 7f6647fff640 1 -- 172.21.15.132:0/2035258091 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f664002cbc0 con 0x7f663c003ef0 2023-12-20T04:48:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.224+0000 7f6657577640 1 -- 172.21.15.132:0/2035258091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f663c003ef0 msgr2=0x7f663c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.224+0000 7f6657577640 1 --2- 172.21.15.132:0/2035258091 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f663c003ef0 0x7f663c0047c0 secure :-1 s=READY pgs=1321 cs=0 l=1 rev1=1 crypto rx=0x7f6640009ac0 tx=0x7f663c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.224+0000 7f6655b14640 1 -- 172.21.15.132:0/2035258091 reap_dead start 2023-12-20T04:48:34.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.224+0000 7f6657577640 1 -- 172.21.15.132:0/2035258091 shutdown_connections 2023-12-20T04:48:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.224+0000 7f6657577640 1 -- 172.21.15.132:0/2035258091 >> 172.21.15.132:0/2035258091 conn(0x7f6650072c60 msgr2=0x7f6650073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.224+0000 7f6657577640 1 -- 172.21.15.132:0/2035258091 shutdown_connections 2023-12-20T04:48:34.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.224+0000 7f6657577640 1 -- 172.21.15.132:0/2035258091 wait complete. 2023-12-20T04:48:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.225+0000 7f6657577640 1 Processor -- start 2023-12-20T04:48:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.226+0000 7f6657577640 1 -- start start 2023-12-20T04:48:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.226+0000 7f6657577640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f663c003ef0 0x7f665014dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.226+0000 7f6657577640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6650159f70 0x7f66500c7550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.226+0000 7f6657577640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66500b60e0 0x7f66500b6560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.226+0000 7f6657577640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f66500b5cc0 con 0x7f66500b60e0 2023-12-20T04:48:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.226+0000 7f6657577640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f665014e4e0 con 0x7f6650159f70 2023-12-20T04:48:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.226+0000 7f6657577640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f66500b5040 con 0x7f663c003ef0 2023-12-20T04:48:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.226+0000 7f6655b14640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66500b60e0 0x7f66500b6560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.226+0000 7f6655b14640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66500b60e0 0x7f66500b6560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49506/0 (socket says 172.21.15.132:49506) 2023-12-20T04:48:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.226+0000 7f6655b14640 1 -- 172.21.15.132:0/190895438 learned_addr learned my addr 172.21.15.132:0/190895438 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:34.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.226+0000 7f6655313640 1 --2- 172.21.15.132:0/190895438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f663c003ef0 0x7f665014dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.226+0000 7f6654b12640 1 --2- 172.21.15.132:0/190895438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6650159f70 0x7f66500c7550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.227+0000 7f6655b14640 1 -- 172.21.15.132:0/190895438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f663c003ef0 msgr2=0x7f665014dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.227+0000 7f6655b14640 1 --2- 172.21.15.132:0/190895438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f663c003ef0 0x7f665014dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.227+0000 7f6655b14640 1 -- 172.21.15.132:0/190895438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6650159f70 msgr2=0x7f66500c7550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.227+0000 7f6655b14640 1 --2- 172.21.15.132:0/190895438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6650159f70 0x7f66500c7550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.227+0000 7f6655b14640 1 -- 172.21.15.132:0/190895438 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f66500b5320 con 0x7f66500b60e0 2023-12-20T04:48:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.227+0000 7f6655b14640 1 --2- 172.21.15.132:0/190895438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66500b60e0 0x7f66500b6560 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f6650071330 tx=0x7f664800a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.227+0000 7f6645ffb640 1 -- 172.21.15.132:0/190895438 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6648007970 con 0x7f66500b60e0 2023-12-20T04:48:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.227+0000 7f6645ffb640 1 -- 172.21.15.132:0/190895438 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6648007ad0 con 0x7f66500b60e0 2023-12-20T04:48:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.227+0000 7f6645ffb640 1 -- 172.21.15.132:0/190895438 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6648013630 con 0x7f66500b60e0 2023-12-20T04:48:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.227+0000 7f6657577640 1 -- 172.21.15.132:0/190895438 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66500b5600 con 0x7f66500b60e0 2023-12-20T04:48:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.227+0000 7f6657577640 1 -- 172.21.15.132:0/190895438 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f66500c7a90 con 0x7f66500b60e0 2023-12-20T04:48:34.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.228+0000 7f6657577640 1 -- 172.21.15.132:0/190895438 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f66500b5e00 con 0x7f66500b60e0 2023-12-20T04:48:34.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.228+0000 7f6645ffb640 1 -- 172.21.15.132:0/190895438 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6648013790 con 0x7f66500b60e0 2023-12-20T04:48:34.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.229+0000 7f6645ffb640 1 --2- 172.21.15.132:0/190895438 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f663406a460 0x7f663406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.229+0000 7f6655313640 1 --2- 172.21.15.132:0/190895438 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f663406a460 0x7f663406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.229+0000 7f6645ffb640 1 -- 172.21.15.132:0/190895438 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f6648088eb0 con 0x7f66500b60e0 2023-12-20T04:48:34.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.229+0000 7f6655313640 1 --2- 172.21.15.132:0/190895438 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f663406a460 0x7f663406c920 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f664c009a60 tx=0x7f664c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:34.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.233+0000 7f6645ffb640 1 -- 172.21.15.132:0/190895438 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f66500b5e00 con 0x7f66500b60e0 2023-12-20T04:48:34.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.399+0000 7f6657577640 1 -- 172.21.15.132:0/190895438 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f66500b5e00 con 0x7f66500b60e0 2023-12-20T04:48:34.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.400+0000 7f6645ffb640 1 -- 172.21.15.132:0/190895438 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v133) v1 ==== 93+0+10 (secure 0 0 0) 0x7f66500b5e00 con 0x7f66500b60e0 2023-12-20T04:48:34.402 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:48:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.402+0000 7f6657577640 1 -- 172.21.15.132:0/190895438 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f663406a460 msgr2=0x7f663406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.402+0000 7f6657577640 1 --2- 172.21.15.132:0/190895438 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f663406a460 0x7f663406c920 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f664c009a60 tx=0x7f664c009190 comp rx=0 tx=0).stop 2023-12-20T04:48:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.402+0000 7f6657577640 1 -- 172.21.15.132:0/190895438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66500b60e0 msgr2=0x7f66500b6560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.402+0000 7f6657577640 1 --2- 172.21.15.132:0/190895438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66500b60e0 0x7f66500b6560 secure :-1 s=READY pgs=1322 cs=0 l=1 rev1=1 crypto rx=0x7f6650071330 tx=0x7f664800a730 comp rx=0 tx=0).stop 2023-12-20T04:48:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.402+0000 7f6657577640 1 -- 172.21.15.132:0/190895438 shutdown_connections 2023-12-20T04:48:34.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.402+0000 7f6657577640 1 --2- 172.21.15.132:0/190895438 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f663406a460 0x7f663406c920 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.402+0000 7f6657577640 1 --2- 172.21.15.132:0/190895438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f66500b60e0 0x7f66500b6560 unknown :-1 s=CLOSED pgs=1322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.402+0000 7f6657577640 1 --2- 172.21.15.132:0/190895438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6650159f70 0x7f66500c7550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.402+0000 7f6657577640 1 --2- 172.21.15.132:0/190895438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f663c003ef0 0x7f665014dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.402+0000 7f6657577640 1 -- 172.21.15.132:0/190895438 >> 172.21.15.132:0/190895438 conn(0x7f6650072c60 msgr2=0x7f66500b20d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.402+0000 7f6657577640 1 -- 172.21.15.132:0/190895438 shutdown_connections 2023-12-20T04:48:34.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.402+0000 7f6657577640 1 -- 172.21.15.132:0/190895438 wait complete. 2023-12-20T04:48:34.415 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-20T04:48:34.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.513+0000 7fc709a69640 1 Processor -- start 2023-12-20T04:48:34.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.513+0000 7fc709a69640 1 -- start start 2023-12-20T04:48:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.514+0000 7fc709a69640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc7040b2700 0x7fc7040b2ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.514+0000 7fc709a69640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc7041444f0 0x7fc7040b3020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.514+0000 7fc709a69640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc704140ab0 0x7fc704140f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.514+0000 7fc709a69640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc7040cb800 con 0x7fc7040b2700 2023-12-20T04:48:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.514+0000 7fc709a69640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc70415b630 con 0x7fc7041444f0 2023-12-20T04:48:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.514+0000 7fc709a69640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7040b3560 con 0x7fc704140ab0 2023-12-20T04:48:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.514+0000 7fc7037fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc7040b2700 0x7fc7040b2ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.514+0000 7fc7037fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc7040b2700 0x7fc7040b2ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49522/0 (socket says 172.21.15.132:49522) 2023-12-20T04:48:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.514+0000 7fc7037fe640 1 -- 172.21.15.132:0/681685608 learned_addr learned my addr 172.21.15.132:0/681685608 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:34.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.514+0000 7fc7037fe640 1 -- 172.21.15.132:0/681685608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc704140ab0 msgr2=0x7fc704140f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:34.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.514+0000 7fc703fff640 1 --2- 172.21.15.132:0/681685608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc704140ab0 0x7fc704140f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.514+0000 7fc702ffd640 1 --2- 172.21.15.132:0/681685608 >> v2:172.21.15.187:3300/0 conn(0x7fc7041444f0 0x7fc7040b3020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.514+0000 7fc7037fe640 1 --2- 172.21.15.132:0/681685608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc704140ab0 0x7fc704140f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.514+0000 7fc7037fe640 1 -- 172.21.15.132:0/681685608 >> v2:172.21.15.187:3300/0 conn(0x7fc7041444f0 msgr2=0x7fc7040b3020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:34.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.514+0000 7fc7037fe640 1 --2- 172.21.15.132:0/681685608 >> v2:172.21.15.187:3300/0 conn(0x7fc7041444f0 0x7fc7040b3020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.514+0000 7fc7037fe640 1 -- 172.21.15.132:0/681685608 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7040cb240 con 0x7fc7040b2700 2023-12-20T04:48:34.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.515+0000 7fc7037fe640 1 --2- 172.21.15.132:0/681685608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7040b2700 0x7fc7040b2ae0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fc7040678c0 tx=0x7fc6f402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ada1dd0a04e8c22f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:34.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.515+0000 7fc7027fc640 1 -- 172.21.15.132:0/681685608 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f40317e0 con 0x7fc7040b2700 2023-12-20T04:48:34.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.515+0000 7fc7027fc640 1 -- 172.21.15.132:0/681685608 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f4031940 con 0x7fc7040b2700 2023-12-20T04:48:34.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.515+0000 7fc7027fc640 1 -- 172.21.15.132:0/681685608 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f4031cd0 con 0x7fc7040b2700 2023-12-20T04:48:34.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.516+0000 7fc709a69640 1 -- 172.21.15.132:0/681685608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7040b2700 msgr2=0x7fc7040b2ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:34.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.516+0000 7fc709a69640 1 --2- 172.21.15.132:0/681685608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7040b2700 0x7fc7040b2ae0 secure :-1 s=READY pgs=1323 cs=0 l=1 rev1=1 crypto rx=0x7fc7040678c0 tx=0x7fc6f402b880 comp rx=0 tx=0).stop 2023-12-20T04:48:34.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.516+0000 7fc709a69640 1 -- 172.21.15.132:0/681685608 shutdown_connections 2023-12-20T04:48:34.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.516+0000 7fc709a69640 1 --2- 172.21.15.132:0/681685608 >> v2:172.21.15.187:3300/0 conn(0x7fc7041444f0 0x7fc7040b3020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.516+0000 7fc709a69640 1 --2- 172.21.15.132:0/681685608 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc704140ab0 0x7fc704140f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.516+0000 7fc709a69640 1 --2- 172.21.15.132:0/681685608 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7040b2700 0x7fc7040b2ae0 unknown :-1 s=CLOSED pgs=1323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.516+0000 7fc709a69640 1 -- 172.21.15.132:0/681685608 >> 172.21.15.132:0/681685608 conn(0x7fc70406d640 msgr2=0x7fc70406da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:34.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.516+0000 7fc709a69640 1 -- 172.21.15.132:0/681685608 shutdown_connections 2023-12-20T04:48:34.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.516+0000 7fc709a69640 1 -- 172.21.15.132:0/681685608 wait complete. 2023-12-20T04:48:34.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.517+0000 7fc709a69640 1 Processor -- start 2023-12-20T04:48:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.517+0000 7fc709a69640 1 -- start start 2023-12-20T04:48:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.518+0000 7fc709a69640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7040b2700 0x7fc70415d3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.518+0000 7fc709a69640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc704140ab0 0x7fc704158c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.518+0000 7fc709a69640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7041444f0 0x7fc70406da20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.518+0000 7fc709a69640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc704159190 con 0x7fc704140ab0 2023-12-20T04:48:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.518+0000 7fc709a69640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7040c7e40 con 0x7fc7040b2700 2023-12-20T04:48:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.518+0000 7fc709a69640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7040c8120 con 0x7fc7041444f0 2023-12-20T04:48:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.518+0000 7fc702ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc704140ab0 0x7fc704158c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.518+0000 7fc702ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc704140ab0 0x7fc704158c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49524/0 (socket says 172.21.15.132:49524) 2023-12-20T04:48:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.518+0000 7fc702ffd640 1 -- 172.21.15.132:0/497831459 learned_addr learned my addr 172.21.15.132:0/497831459 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.518+0000 7fc702ffd640 1 -- 172.21.15.132:0/497831459 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7041444f0 msgr2=0x7fc70406da20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.518+0000 7fc702ffd640 1 --2- 172.21.15.132:0/497831459 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7041444f0 0x7fc70406da20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.518+0000 7fc702ffd640 1 -- 172.21.15.132:0/497831459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7040b2700 msgr2=0x7fc70415d3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.518+0000 7fc702ffd640 1 --2- 172.21.15.132:0/497831459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7040b2700 0x7fc70415d3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.518+0000 7fc702ffd640 1 -- 172.21.15.132:0/497831459 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f40094d0 con 0x7fc704140ab0 2023-12-20T04:48:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.518+0000 7fc702ffd640 1 --2- 172.21.15.132:0/497831459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc704140ab0 0x7fc704158c50 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800c7f0 tx=0x7fc6f800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.518+0000 7fc6ebfff640 1 -- 172.21.15.132:0/497831459 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8004220 con 0x7fc704140ab0 2023-12-20T04:48:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.518+0000 7fc6ebfff640 1 -- 172.21.15.132:0/497831459 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc6f8004380 con 0x7fc704140ab0 2023-12-20T04:48:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.519+0000 7fc709a69640 1 -- 172.21.15.132:0/497831459 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7040c8400 con 0x7fc704140ab0 2023-12-20T04:48:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.519+0000 7fc6ebfff640 1 -- 172.21.15.132:0/497831459 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc6f8007840 con 0x7fc704140ab0 2023-12-20T04:48:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.519+0000 7fc709a69640 1 -- 172.21.15.132:0/497831459 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7040c89c0 con 0x7fc704140ab0 2023-12-20T04:48:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.520+0000 7fc709a69640 1 -- 172.21.15.132:0/497831459 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7040c8be0 con 0x7fc704140ab0 2023-12-20T04:48:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.520+0000 7fc6ebfff640 1 -- 172.21.15.132:0/497831459 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc6f8007bb0 con 0x7fc704140ab0 2023-12-20T04:48:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.520+0000 7fc6ebfff640 1 --2- 172.21.15.132:0/497831459 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc6f006a460 0x7fc6f006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.520+0000 7fc6ebfff640 1 -- 172.21.15.132:0/497831459 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc6f80884b0 con 0x7fc704140ab0 2023-12-20T04:48:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.520+0000 7fc7037fe640 1 --2- 172.21.15.132:0/497831459 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc6f006a460 0x7fc6f006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.521+0000 7fc7037fe640 1 --2- 172.21.15.132:0/497831459 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc6f006a460 0x7fc6f006c920 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4036000 tx=0x7fc6f4030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:34.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.525+0000 7fc6ebfff640 1 -- 172.21.15.132:0/497831459 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc6f8053d70 con 0x7fc704140ab0 2023-12-20T04:48:34.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.690+0000 7fc709a69640 1 -- 172.21.15.132:0/497831459 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fc70404e840 con 0x7fc704140ab0 2023-12-20T04:48:34.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.690+0000 7fc6ebfff640 1 -- 172.21.15.132:0/497831459 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v133) v1 ==== 84+0+65 (secure 0 0 0) 0x7fc6f8007e60 con 0x7fc704140ab0 2023-12-20T04:48:34.692 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:34.692 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-12-20T04:48:34.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:34.693 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-12-20T04:48:34.693 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-12-20T04:48:34.693 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:34.693 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-12-20T04:48:34.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.692+0000 7fc709a69640 1 -- 172.21.15.132:0/497831459 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc6f006a460 msgr2=0x7fc6f006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:34.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.692+0000 7fc709a69640 1 --2- 172.21.15.132:0/497831459 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc6f006a460 0x7fc6f006c920 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7fc6f4036000 tx=0x7fc6f4030000 comp rx=0 tx=0).stop 2023-12-20T04:48:34.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.692+0000 7fc709a69640 1 -- 172.21.15.132:0/497831459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc704140ab0 msgr2=0x7fc704158c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:34.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.692+0000 7fc709a69640 1 --2- 172.21.15.132:0/497831459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc704140ab0 0x7fc704158c50 secure :-1 s=READY pgs=1324 cs=0 l=1 rev1=1 crypto rx=0x7fc6f800c7f0 tx=0x7fc6f800ccb0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.692+0000 7fc709a69640 1 -- 172.21.15.132:0/497831459 shutdown_connections 2023-12-20T04:48:34.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.692+0000 7fc709a69640 1 --2- 172.21.15.132:0/497831459 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc6f006a460 0x7fc6f006c920 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.692+0000 7fc709a69640 1 --2- 172.21.15.132:0/497831459 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7041444f0 0x7fc70406da20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.692+0000 7fc709a69640 1 --2- 172.21.15.132:0/497831459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc704140ab0 0x7fc704158c50 unknown :-1 s=CLOSED pgs=1324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.692+0000 7fc709a69640 1 --2- 172.21.15.132:0/497831459 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7040b2700 0x7fc70415d3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.692+0000 7fc709a69640 1 -- 172.21.15.132:0/497831459 >> 172.21.15.132:0/497831459 conn(0x7fc70406d640 msgr2=0x7fc7041400c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:34.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.692+0000 7fc709a69640 1 -- 172.21.15.132:0/497831459 shutdown_connections 2023-12-20T04:48:34.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.692+0000 7fc709a69640 1 -- 172.21.15.132:0/497831459 wait complete. 2023-12-20T04:48:34.705 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-20T04:48:34.705 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-20T04:48:34.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.807+0000 7f2093169640 1 Processor -- start 2023-12-20T04:48:34.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.807+0000 7f2093169640 1 -- start start 2023-12-20T04:48:34.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.808+0000 7f2093169640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f208c06eba0 0x7f208c0cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.808+0000 7f2093169640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f208c0cea10 0x7f208c0cf0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.808+0000 7f2093169640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f208c0d1b80 con 0x7f208c0cf630 2023-12-20T04:48:34.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.808+0000 7f2093169640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f208c0cc660 con 0x7f208c06eba0 2023-12-20T04:48:34.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.808+0000 7f2093169640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208c0cfac0 con 0x7f208c0cea10 2023-12-20T04:48:34.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.808+0000 7f208bfff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f208c0cea10 0x7f208c0cf0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.808+0000 7f2090f05640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f208c06eba0 0x7f208c0cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.808+0000 7f208bfff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f208c0cea10 0x7f208c0cf0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:57988/0 (socket says 172.21.15.132:57988) 2023-12-20T04:48:34.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.808+0000 7f208bfff640 1 -- 172.21.15.132:0/2509946176 learned_addr learned my addr 172.21.15.132:0/2509946176 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:34.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.809+0000 7f2090f05640 1 -- 172.21.15.132:0/2509946176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f208c0cea10 msgr2=0x7f208c0cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:34.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.809+0000 7f2090f05640 1 --2- 172.21.15.132:0/2509946176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f208c0cea10 0x7f208c0cf0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.809+0000 7f2090f05640 1 -- 172.21.15.132:0/2509946176 >> v1:172.21.15.187:6789/0 conn(0x7f208c0cf630 legacy=0x7f208c15a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:34.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.809+0000 7f208b7fe640 1 -- 172.21.15.132:0/2509946176 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1655091346 0 0) 0x7f208c0d1b80 con 0x7f208c0cf630 2023-12-20T04:48:34.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.809+0000 7f2090f05640 1 -- 172.21.15.132:0/2509946176 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f208c06e230 con 0x7f208c06eba0 2023-12-20T04:48:34.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.809+0000 7f208bfff640 1 --2- 172.21.15.132:0/2509946176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f208c0cea10 0x7f208c0cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:48:34.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.810+0000 7f2090f05640 1 --2- 172.21.15.132:0/2509946176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f208c06eba0 0x7f208c0cdde0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f207c009790 tx=0x7f207c02b810 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d2fc2a26067909e4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:34.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.810+0000 7f208b7fe640 1 -- 172.21.15.132:0/2509946176 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c031770 con 0x7f208c06eba0 2023-12-20T04:48:34.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.810+0000 7f208b7fe640 1 -- 172.21.15.132:0/2509946176 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f207c0318d0 con 0x7f208c06eba0 2023-12-20T04:48:34.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.810+0000 7f208b7fe640 1 -- 172.21.15.132:0/2509946176 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f207c031c60 con 0x7f208c06eba0 2023-12-20T04:48:34.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.810+0000 7f2093169640 1 -- 172.21.15.132:0/2509946176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f208c06eba0 msgr2=0x7f208c0cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:34.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.810+0000 7f2093169640 1 --2- 172.21.15.132:0/2509946176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f208c06eba0 0x7f208c0cdde0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7f207c009790 tx=0x7f207c02b810 comp rx=0 tx=0).stop 2023-12-20T04:48:34.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.810+0000 7f2093169640 1 -- 172.21.15.132:0/2509946176 shutdown_connections 2023-12-20T04:48:34.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.810+0000 7f2093169640 1 --2- 172.21.15.132:0/2509946176 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f208c0cea10 0x7f208c0cf0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.810+0000 7f2093169640 1 --2- 172.21.15.132:0/2509946176 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f208c06eba0 0x7f208c0cdde0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.810+0000 7f2093169640 1 -- 172.21.15.132:0/2509946176 >> 172.21.15.132:0/2509946176 conn(0x7f208c099fa0 msgr2=0x7f208c0d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:34.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.810+0000 7f2093169640 1 -- 172.21.15.132:0/2509946176 shutdown_connections 2023-12-20T04:48:34.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.810+0000 7f2093169640 1 -- 172.21.15.132:0/2509946176 wait complete. 2023-12-20T04:48:34.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.811+0000 7f2093169640 1 Processor -- start 2023-12-20T04:48:34.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.812+0000 7f2093169640 1 -- start start 2023-12-20T04:48:34.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.812+0000 7f2093169640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f208c06eba0 0x7f208c0b1410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.812+0000 7f2093169640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f208c0cea10 0x7f208c158460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.812+0000 7f2093169640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f208c0cf630 0x7f208c0b0b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.812+0000 7f2093169640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c0b10b0 con 0x7f208c0cea10 2023-12-20T04:48:34.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.812+0000 7f2093169640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f208c0ae220 con 0x7f208c0cf630 2023-12-20T04:48:34.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.812+0000 7f2093169640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f208c0b2570 con 0x7f208c06eba0 2023-12-20T04:48:34.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.813+0000 7f208bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f208c0cea10 0x7f208c158460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.813+0000 7f208bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f208c0cea10 0x7f208c158460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49534/0 (socket says 172.21.15.132:49534) 2023-12-20T04:48:34.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.813+0000 7f208bfff640 1 -- 172.21.15.132:0/1020139868 learned_addr learned my addr 172.21.15.132:0/1020139868 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:34.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.813+0000 7f2090f05640 1 --2- 172.21.15.132:0/1020139868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f208c06eba0 0x7f208c0b1410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.813+0000 7f2091706640 1 --2- 172.21.15.132:0/1020139868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f208c0cf630 0x7f208c0b0b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.813+0000 7f208bfff640 1 -- 172.21.15.132:0/1020139868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f208c06eba0 msgr2=0x7f208c0b1410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:34.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.813+0000 7f208bfff640 1 --2- 172.21.15.132:0/1020139868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f208c06eba0 0x7f208c0b1410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.813+0000 7f208bfff640 1 -- 172.21.15.132:0/1020139868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f208c0cf630 msgr2=0x7f208c0b0b70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:34.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.813+0000 7f208bfff640 1 --2- 172.21.15.132:0/1020139868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f208c0cf630 0x7f208c0b0b70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:34.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.813+0000 7f208bfff640 1 -- 172.21.15.132:0/1020139868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20800094d0 con 0x7f208c0cea10 2023-12-20T04:48:34.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.813+0000 7f208bfff640 1 --2- 172.21.15.132:0/1020139868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f208c0cea10 0x7f208c158460 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f208000e9d0 tx=0x7f208000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:34.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.813+0000 7f20897fa640 1 -- 172.21.15.132:0/1020139868 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f208000ca60 con 0x7f208c0cea10 2023-12-20T04:48:34.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.813+0000 7f20897fa640 1 -- 172.21.15.132:0/1020139868 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f208000cbc0 con 0x7f208c0cea10 2023-12-20T04:48:34.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.813+0000 7f20897fa640 1 -- 172.21.15.132:0/1020139868 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2080013470 con 0x7f208c0cea10 2023-12-20T04:48:34.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.813+0000 7f2093169640 1 -- 172.21.15.132:0/1020139868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207c0093a0 con 0x7f208c0cea10 2023-12-20T04:48:34.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.813+0000 7f2093169640 1 -- 172.21.15.132:0/1020139868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f208c0c4f00 con 0x7f208c0cea10 2023-12-20T04:48:34.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.814+0000 7f2093169640 1 -- 172.21.15.132:0/1020139868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f208c04e840 con 0x7f208c0cea10 2023-12-20T04:48:34.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.815+0000 7f20897fa640 1 -- 172.21.15.132:0/1020139868 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f20800135d0 con 0x7f208c0cea10 2023-12-20T04:48:34.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.815+0000 7f20897fa640 1 --2- 172.21.15.132:0/1020139868 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f207806a430 0x7f207806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:34.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.815+0000 7f20897fa640 1 -- 172.21.15.132:0/1020139868 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(133..133 src has 1..133) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f2080088870 con 0x7f208c0cea10 2023-12-20T04:48:34.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.815+0000 7f2090f05640 1 --2- 172.21.15.132:0/1020139868 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f207806a430 0x7f207806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:34.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.816+0000 7f2090f05640 1 --2- 172.21.15.132:0/1020139868 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f207806a430 0x7f207806c8f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f207c036000 tx=0x7f207c03e040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:34.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.820+0000 7f20897fa640 1 -- 172.21.15.132:0/1020139868 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2080054260 con 0x7f208c0cea10 2023-12-20T04:48:34.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:34.989+0000 7f2093169640 1 -- 172.21.15.132:0/1020139868 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f208c0ce390 con 0x7f208c0cea10 2023-12-20T04:48:35.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.853+0000 7f20897fa640 1 -- 172.21.15.132:0/1020139868 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v134) v1 ==== 138+0+0 (secure 0 0 0) 0x7f20800170b0 con 0x7f208c0cea10 2023-12-20T04:48:35.855 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2023-12-20T04:48:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.858+0000 7f2093169640 1 -- 172.21.15.132:0/1020139868 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f207806a430 msgr2=0x7f207806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.858+0000 7f2093169640 1 --2- 172.21.15.132:0/1020139868 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f207806a430 0x7f207806c8f0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f207c036000 tx=0x7f207c03e040 comp rx=0 tx=0).stop 2023-12-20T04:48:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.858+0000 7f2093169640 1 -- 172.21.15.132:0/1020139868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f208c0cea10 msgr2=0x7f208c158460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.858+0000 7f2093169640 1 --2- 172.21.15.132:0/1020139868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f208c0cea10 0x7f208c158460 secure :-1 s=READY pgs=1325 cs=0 l=1 rev1=1 crypto rx=0x7f208000e9d0 tx=0x7f208000ee90 comp rx=0 tx=0).stop 2023-12-20T04:48:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.858+0000 7f2093169640 1 -- 172.21.15.132:0/1020139868 shutdown_connections 2023-12-20T04:48:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.858+0000 7f2093169640 1 --2- 172.21.15.132:0/1020139868 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f207806a430 0x7f207806c8f0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.858+0000 7f2093169640 1 --2- 172.21.15.132:0/1020139868 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f208c0cf630 0x7f208c0b0b70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.858+0000 7f2093169640 1 --2- 172.21.15.132:0/1020139868 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f208c0cea10 0x7f208c158460 unknown :-1 s=CLOSED pgs=1325 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.858+0000 7f2093169640 1 --2- 172.21.15.132:0/1020139868 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f208c06eba0 0x7f208c0b1410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.858+0000 7f2093169640 1 -- 172.21.15.132:0/1020139868 >> 172.21.15.132:0/1020139868 conn(0x7f208c099fa0 msgr2=0x7f208c0c9d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.858+0000 7f2093169640 1 -- 172.21.15.132:0/1020139868 shutdown_connections 2023-12-20T04:48:35.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.859+0000 7f2093169640 1 -- 172.21.15.132:0/1020139868 wait complete. 2023-12-20T04:48:35.874 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-20T04:48:35.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.985+0000 7fbfaaaee640 1 Processor -- start 2023-12-20T04:48:35.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.985+0000 7fbfaaaee640 1 -- start start 2023-12-20T04:48:35.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.985+0000 7fbfaaaee640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfa415cf20 0x7fbfa406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:35.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.985+0000 7fbfaaaee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbfa40cd4b0 0x7fbfa40cd940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:35.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.985+0000 7fbfaaaee640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbfa406cc90 con 0x7fbfa415d300 2023-12-20T04:48:35.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.985+0000 7fbfaaaee640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbfa40cde80 con 0x7fbfa40cd4b0 2023-12-20T04:48:35.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.985+0000 7fbfaaaee640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40b2f30 con 0x7fbfa415cf20 2023-12-20T04:48:35.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.986+0000 7fbfa908b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbfa40cd4b0 0x7fbfa40cd940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:35.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.986+0000 7fbfa3fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbfa415d300 0x7fbfa4161700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36512/0 (socket says 172.21.15.132:36512) 2023-12-20T04:48:35.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.986+0000 7fbfa908b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbfa40cd4b0 0x7fbfa40cd940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49550/0 (socket says 172.21.15.132:49550) 2023-12-20T04:48:35.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.986+0000 7fbfa3fff640 1 -- 172.21.15.132:0/1556303410 learned_addr learned my addr 172.21.15.132:0/1556303410 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:35.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.986+0000 7fbfa888a640 1 --2- 172.21.15.132:0/1556303410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfa415cf20 0x7fbfa406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:35.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.986+0000 7fbfa908b640 1 -- 172.21.15.132:0/1556303410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfa415cf20 msgr2=0x7fbfa406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:35.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.986+0000 7fbfa908b640 1 --2- 172.21.15.132:0/1556303410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfa415cf20 0x7fbfa406c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:35.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.986+0000 7fbfa908b640 1 -- 172.21.15.132:0/1556303410 >> v1:172.21.15.132:6789/0 conn(0x7fbfa415d300 legacy=0x7fbfa4161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:35.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.986+0000 7fbfa37fe640 1 -- 172.21.15.132:0/1556303410 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1736462168 0 0) 0x7fbfa406cc90 con 0x7fbfa415d300 2023-12-20T04:48:35.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.986+0000 7fbfa908b640 1 -- 172.21.15.132:0/1556303410 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfa40b3210 con 0x7fbfa40cd4b0 2023-12-20T04:48:35.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.987+0000 7fbfa908b640 1 --2- 172.21.15.132:0/1556303410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfa40cd4b0 0x7fbfa40cd940 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009d90 tx=0x7fbf9c02bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=124ef12fb03d5aa9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:35.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.987+0000 7fbfa37fe640 1 -- 172.21.15.132:0/1556303410 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c02cc50 con 0x7fbfa40cd4b0 2023-12-20T04:48:35.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.987+0000 7fbfa37fe640 1 -- 172.21.15.132:0/1556303410 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9c02cdb0 con 0x7fbfa40cd4b0 2023-12-20T04:48:35.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.987+0000 7fbfa37fe640 1 -- 172.21.15.132:0/1556303410 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9c034660 con 0x7fbfa40cd4b0 2023-12-20T04:48:35.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.987+0000 7fbfaaaee640 1 -- 172.21.15.132:0/1556303410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfa40cd4b0 msgr2=0x7fbfa40cd940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:35.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.987+0000 7fbfaaaee640 1 --2- 172.21.15.132:0/1556303410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfa40cd4b0 0x7fbfa40cd940 secure :-1 s=READY pgs=1327 cs=0 l=1 rev1=1 crypto rx=0x7fbf9c009d90 tx=0x7fbf9c02bea0 comp rx=0 tx=0).stop 2023-12-20T04:48:35.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.987+0000 7fbfaaaee640 1 -- 172.21.15.132:0/1556303410 shutdown_connections 2023-12-20T04:48:35.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.987+0000 7fbfaaaee640 1 --2- 172.21.15.132:0/1556303410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfa40cd4b0 0x7fbfa40cd940 unknown :-1 s=CLOSED pgs=1327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:35.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.987+0000 7fbfaaaee640 1 --2- 172.21.15.132:0/1556303410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfa415cf20 0x7fbfa406c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:35.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.987+0000 7fbfaaaee640 1 -- 172.21.15.132:0/1556303410 >> 172.21.15.132:0/1556303410 conn(0x7fbfa4072c60 msgr2=0x7fbfa4073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:35.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.988+0000 7fbfaaaee640 1 -- 172.21.15.132:0/1556303410 shutdown_connections 2023-12-20T04:48:35.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.988+0000 7fbfaaaee640 1 -- 172.21.15.132:0/1556303410 wait complete. 2023-12-20T04:48:35.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.989+0000 7fbfaaaee640 1 Processor -- start 2023-12-20T04:48:35.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.989+0000 7fbfaaaee640 1 -- start start 2023-12-20T04:48:35.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.989+0000 7fbfaaaee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfa40cd4b0 0x7fbfa41f3200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:35.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.989+0000 7fbfaaaee640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfa415cf20 0x7fbfa40b1cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:35.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.989+0000 7fbfaaaee640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfa415d300 0x7fbfa40cbfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:35.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.989+0000 7fbfaaaee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa41f3740 con 0x7fbfa40cd4b0 2023-12-20T04:48:35.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.990+0000 7fbfaaaee640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40c6b40 con 0x7fbfa415d300 2023-12-20T04:48:35.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.990+0000 7fbfaaaee640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbfa40c6e20 con 0x7fbfa415cf20 2023-12-20T04:48:35.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.990+0000 7fbfa888a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfa40cd4b0 0x7fbfa41f3200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:35.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.990+0000 7fbfa888a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfa40cd4b0 0x7fbfa41f3200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49562/0 (socket says 172.21.15.132:49562) 2023-12-20T04:48:35.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.990+0000 7fbfa888a640 1 -- 172.21.15.132:0/4225827743 learned_addr learned my addr 172.21.15.132:0/4225827743 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:35.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.990+0000 7fbfa3fff640 1 --2- 172.21.15.132:0/4225827743 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfa415cf20 0x7fbfa40b1cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:35.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.990+0000 7fbfa888a640 1 -- 172.21.15.132:0/4225827743 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfa415cf20 msgr2=0x7fbfa40b1cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:35.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.990+0000 7fbfa888a640 1 --2- 172.21.15.132:0/4225827743 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfa415cf20 0x7fbfa40b1cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:35.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.990+0000 7fbfa888a640 1 -- 172.21.15.132:0/4225827743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfa415d300 msgr2=0x7fbfa40cbfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:35.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.990+0000 7fbfa888a640 1 --2- 172.21.15.132:0/4225827743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfa415d300 0x7fbfa40cbfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:35.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.990+0000 7fbfa888a640 1 -- 172.21.15.132:0/4225827743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf9c009a70 con 0x7fbfa40cd4b0 2023-12-20T04:48:35.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.990+0000 7fbfa888a640 1 --2- 172.21.15.132:0/4225827743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfa40cd4b0 0x7fbfa41f3200 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800d800 tx=0x7fbf9800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:35.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.990+0000 7fbfa17fa640 1 -- 172.21.15.132:0/4225827743 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9800b6c0 con 0x7fbfa40cd4b0 2023-12-20T04:48:35.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.990+0000 7fbfa17fa640 1 -- 172.21.15.132:0/4225827743 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbf9800b820 con 0x7fbfa40cd4b0 2023-12-20T04:48:35.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.990+0000 7fbfaaaee640 1 -- 172.21.15.132:0/4225827743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbfa40c7100 con 0x7fbfa40cd4b0 2023-12-20T04:48:35.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.990+0000 7fbfa17fa640 1 -- 172.21.15.132:0/4225827743 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbf9800bbb0 con 0x7fbfa40cd4b0 2023-12-20T04:48:35.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.990+0000 7fbfaaaee640 1 -- 172.21.15.132:0/4225827743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbfa40c76c0 con 0x7fbfa40cd4b0 2023-12-20T04:48:35.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.991+0000 7fbfaaaee640 1 -- 172.21.15.132:0/4225827743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbfa40c7880 con 0x7fbfa40cd4b0 2023-12-20T04:48:35.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.992+0000 7fbfa17fa640 1 -- 172.21.15.132:0/4225827743 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbf9800bd10 con 0x7fbfa40cd4b0 2023-12-20T04:48:35.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.992+0000 7fbfa17fa640 1 --2- 172.21.15.132:0/4225827743 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbf8806a430 0x7fbf8806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:35.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.992+0000 7fbfa17fa640 1 -- 172.21.15.132:0/4225827743 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(134..134 src has 1..134) v4 ==== 5227+0+0 (secure 0 0 0) 0x7fbf980898e0 con 0x7fbfa40cd4b0 2023-12-20T04:48:35.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.992+0000 7fbfa3fff640 1 --2- 172.21.15.132:0/4225827743 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbf8806a430 0x7fbf8806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:35.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.992+0000 7fbfa3fff640 1 --2- 172.21.15.132:0/4225827743 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbf8806a430 0x7fbf8806c8f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbfa414dd00 tx=0x7fbf90009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:35.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:35.996+0000 7fbfa17fa640 1 -- 172.21.15.132:0/4225827743 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbf98054410 con 0x7fbfa40cd4b0 2023-12-20T04:48:36.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.163+0000 7fbfaaaee640 1 -- 172.21.15.132:0/4225827743 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7fbfa404e840 con 0x7fbfa40cd4b0 2023-12-20T04:48:36.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.864+0000 7fbfa17fa640 1 -- 172.21.15.132:0/4225827743 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v135) v1 ==== 170+0+0 (secure 0 0 0) 0x7fbf98057a30 con 0x7fbfa40cd4b0 2023-12-20T04:48:36.870 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2023-12-20T04:48:36.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.872+0000 7fbfaaaee640 1 -- 172.21.15.132:0/4225827743 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbf8806a430 msgr2=0x7fbf8806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:36.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.872+0000 7fbfaaaee640 1 --2- 172.21.15.132:0/4225827743 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbf8806a430 0x7fbf8806c8f0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7fbfa414dd00 tx=0x7fbf90009040 comp rx=0 tx=0).stop 2023-12-20T04:48:36.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.872+0000 7fbfaaaee640 1 -- 172.21.15.132:0/4225827743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfa40cd4b0 msgr2=0x7fbfa41f3200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:36.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.872+0000 7fbfaaaee640 1 --2- 172.21.15.132:0/4225827743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfa40cd4b0 0x7fbfa41f3200 secure :-1 s=READY pgs=1328 cs=0 l=1 rev1=1 crypto rx=0x7fbf9800d800 tx=0x7fbf9800dcc0 comp rx=0 tx=0).stop 2023-12-20T04:48:36.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.872+0000 7fbfaaaee640 1 -- 172.21.15.132:0/4225827743 shutdown_connections 2023-12-20T04:48:36.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.872+0000 7fbfaaaee640 1 --2- 172.21.15.132:0/4225827743 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbf8806a430 0x7fbf8806c8f0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:36.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.872+0000 7fbfaaaee640 1 --2- 172.21.15.132:0/4225827743 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbfa415d300 0x7fbfa40cbfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:36.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.872+0000 7fbfaaaee640 1 --2- 172.21.15.132:0/4225827743 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbfa415cf20 0x7fbfa40b1cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:36.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.872+0000 7fbfaaaee640 1 --2- 172.21.15.132:0/4225827743 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbfa40cd4b0 0x7fbfa41f3200 unknown :-1 s=CLOSED pgs=1328 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:36.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.872+0000 7fbfaaaee640 1 -- 172.21.15.132:0/4225827743 >> 172.21.15.132:0/4225827743 conn(0x7fbfa4072c60 msgr2=0x7fbfa415bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:36.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.872+0000 7fbfaaaee640 1 -- 172.21.15.132:0/4225827743 shutdown_connections 2023-12-20T04:48:36.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.872+0000 7fbfaaaee640 1 -- 172.21.15.132:0/4225827743 wait complete. 2023-12-20T04:48:36.886 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-20T04:48:36.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.988+0000 7fa66b070640 1 Processor -- start 2023-12-20T04:48:36.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.988+0000 7fa66b070640 1 -- start start 2023-12-20T04:48:36.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.989+0000 7fa66b070640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa6640cf880 0x7fa6640cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:36.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.989+0000 7fa66b070640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa6640b60e0 0x7fa6640b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:36.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.989+0000 7fa66b070640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa6640d1a90 con 0x7fa66415d300 2023-12-20T04:48:36.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.989+0000 7fa66b070640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6640d0250 con 0x7fa6640cf880 2023-12-20T04:48:36.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.989+0000 7fa66b070640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa6640d1d70 con 0x7fa6640b60e0 2023-12-20T04:48:36.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.989+0000 7fa663fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa6640cf880 0x7fa6640cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:36.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.989+0000 7fa668e0c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa66415d300 0x7fa6640d1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36516/0 (socket says 172.21.15.132:36516) 2023-12-20T04:48:36.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.989+0000 7fa663fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa6640cf880 0x7fa6640cfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49568/0 (socket says 172.21.15.132:49568) 2023-12-20T04:48:36.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.989+0000 7fa668e0c640 1 -- 172.21.15.132:0/3112530575 learned_addr learned my addr 172.21.15.132:0/3112530575 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:36.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.989+0000 7fa663fff640 1 -- 172.21.15.132:0/3112530575 >> v2:172.21.15.187:3300/0 conn(0x7fa6640b60e0 msgr2=0x7fa6640b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:36.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.989+0000 7fa663fff640 1 --2- 172.21.15.132:0/3112530575 >> v2:172.21.15.187:3300/0 conn(0x7fa6640b60e0 0x7fa6640b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:36.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.989+0000 7fa663fff640 1 -- 172.21.15.132:0/3112530575 >> v1:172.21.15.132:6789/0 conn(0x7fa66415d300 legacy=0x7fa6640d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:36.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.990+0000 7fa663fff640 1 -- 172.21.15.132:0/3112530575 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6640d2050 con 0x7fa6640cf880 2023-12-20T04:48:36.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.989+0000 7fa6637fe640 1 -- 172.21.15.132:0/3112530575 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2560022450 0 0) 0x7fa6640d1a90 con 0x7fa66415d300 2023-12-20T04:48:36.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.990+0000 7fa663fff640 1 --2- 172.21.15.132:0/3112530575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6640cf880 0x7fa6640cfd10 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fa6640d07c0 tx=0x7fa65002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5c4d87c85b1b540 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:36.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.990+0000 7fa6637fe640 1 -- 172.21.15.132:0/3112530575 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650031830 con 0x7fa6640cf880 2023-12-20T04:48:36.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.990+0000 7fa6637fe640 1 -- 172.21.15.132:0/3112530575 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa650031990 con 0x7fa6640cf880 2023-12-20T04:48:36.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.990+0000 7fa6637fe640 1 -- 172.21.15.132:0/3112530575 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa650031d20 con 0x7fa6640cf880 2023-12-20T04:48:36.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.991+0000 7fa66b070640 1 -- 172.21.15.132:0/3112530575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6640cf880 msgr2=0x7fa6640cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:36.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.991+0000 7fa66b070640 1 --2- 172.21.15.132:0/3112530575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6640cf880 0x7fa6640cfd10 secure :-1 s=READY pgs=1330 cs=0 l=1 rev1=1 crypto rx=0x7fa6640d07c0 tx=0x7fa65002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:48:36.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.991+0000 7fa66b070640 1 -- 172.21.15.132:0/3112530575 shutdown_connections 2023-12-20T04:48:36.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.991+0000 7fa66b070640 1 --2- 172.21.15.132:0/3112530575 >> v2:172.21.15.187:3300/0 conn(0x7fa6640b60e0 0x7fa6640b64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:36.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.991+0000 7fa66b070640 1 --2- 172.21.15.132:0/3112530575 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6640cf880 0x7fa6640cfd10 unknown :-1 s=CLOSED pgs=1330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:36.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.991+0000 7fa66b070640 1 -- 172.21.15.132:0/3112530575 >> 172.21.15.132:0/3112530575 conn(0x7fa66406a3d0 msgr2=0x7fa66406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:36.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.991+0000 7fa66b070640 1 -- 172.21.15.132:0/3112530575 shutdown_connections 2023-12-20T04:48:36.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.991+0000 7fa66b070640 1 -- 172.21.15.132:0/3112530575 wait complete. 2023-12-20T04:48:36.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.992+0000 7fa66b070640 1 Processor -- start 2023-12-20T04:48:36.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.992+0000 7fa66b070640 1 -- start start 2023-12-20T04:48:36.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa66b070640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6640b60e0 0x7fa664153130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:36.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa66b070640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6640cf880 0x7fa66414a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:36.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa66b070640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa66415d300 0x7fa6640c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:36.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa66b070640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6640cc350 con 0x7fa6640b60e0 2023-12-20T04:48:36.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa66b070640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66415fbb0 con 0x7fa6640cf880 2023-12-20T04:48:36.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa66b070640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa66415efa0 con 0x7fa66415d300 2023-12-20T04:48:36.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa668e0c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6640b60e0 0x7fa664153130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:36.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa668e0c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6640b60e0 0x7fa664153130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49580/0 (socket says 172.21.15.132:49580) 2023-12-20T04:48:36.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa668e0c640 1 -- 172.21.15.132:0/3550023448 learned_addr learned my addr 172.21.15.132:0/3550023448 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:36.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa66960d640 1 --2- 172.21.15.132:0/3550023448 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa66415d300 0x7fa6640c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:36.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa663fff640 1 --2- 172.21.15.132:0/3550023448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6640cf880 0x7fa66414a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:36.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa668e0c640 1 -- 172.21.15.132:0/3550023448 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa66415d300 msgr2=0x7fa6640c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:36.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa668e0c640 1 --2- 172.21.15.132:0/3550023448 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa66415d300 0x7fa6640c9f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:36.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa668e0c640 1 -- 172.21.15.132:0/3550023448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6640cf880 msgr2=0x7fa66414a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa668e0c640 1 --2- 172.21.15.132:0/3550023448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6640cf880 0x7fa66414a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa668e0c640 1 -- 172.21.15.132:0/3550023448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa6500093a0 con 0x7fa6640b60e0 2023-12-20T04:48:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa66960d640 1 --2- 172.21.15.132:0/3550023448 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa66415d300 0x7fa6640c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.993+0000 7fa663fff640 1 --2- 172.21.15.132:0/3550023448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6640cf880 0x7fa66414a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.994+0000 7fa668e0c640 1 --2- 172.21.15.132:0/3550023448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6640b60e0 0x7fa664153130 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fa65800c500 tx=0x7fa65800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.994+0000 7fa6617fa640 1 -- 172.21.15.132:0/3550023448 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa658007560 con 0x7fa6640b60e0 2023-12-20T04:48:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.994+0000 7fa66b070640 1 -- 172.21.15.132:0/3550023448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66415f280 con 0x7fa6640b60e0 2023-12-20T04:48:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.994+0000 7fa6617fa640 1 -- 172.21.15.132:0/3550023448 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa6580047e0 con 0x7fa6640b60e0 2023-12-20T04:48:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.994+0000 7fa6617fa640 1 -- 172.21.15.132:0/3550023448 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa658004b90 con 0x7fa6640b60e0 2023-12-20T04:48:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.994+0000 7fa66b070640 1 -- 172.21.15.132:0/3550023448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa66415f840 con 0x7fa6640b60e0 2023-12-20T04:48:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.995+0000 7fa66b070640 1 -- 172.21.15.132:0/3550023448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66404e840 con 0x7fa6640b60e0 2023-12-20T04:48:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.995+0000 7fa6617fa640 1 -- 172.21.15.132:0/3550023448 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa658004cf0 con 0x7fa6640b60e0 2023-12-20T04:48:36.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.995+0000 7fa6617fa640 1 --2- 172.21.15.132:0/3550023448 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa64806a430 0x7fa64806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:36.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.996+0000 7fa6617fa640 1 -- 172.21.15.132:0/3550023448 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(135..135 src has 1..135) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fa658087a50 con 0x7fa6640b60e0 2023-12-20T04:48:36.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.996+0000 7fa663fff640 1 --2- 172.21.15.132:0/3550023448 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa64806a430 0x7fa64806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:36.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:36.996+0000 7fa663fff640 1 --2- 172.21.15.132:0/3550023448 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa64806a430 0x7fa64806c8f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa650036000 tx=0x7fa650008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:37.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.000+0000 7fa6617fa640 1 -- 172.21.15.132:0/3550023448 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa6580530b0 con 0x7fa6640b60e0 2023-12-20T04:48:37.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.198+0000 7fa66b070640 1 -- 172.21.15.132:0/3550023448 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fa6640ccf70 con 0x7fa6640b60e0 2023-12-20T04:48:37.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.204+0000 7fa6617fa640 1 -- 172.21.15.132:0/3550023448 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 16 and data pool 17 v49) v1 ==== 174+0+0 (secure 0 0 0) 0x7fa6580566d0 con 0x7fa6640b60e0 2023-12-20T04:48:37.208 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 16 and data pool 17 2023-12-20T04:48:37.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.212+0000 7fa66b070640 1 -- 172.21.15.132:0/3550023448 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa64806a430 msgr2=0x7fa64806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:37.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.212+0000 7fa66b070640 1 --2- 172.21.15.132:0/3550023448 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa64806a430 0x7fa64806c8f0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7fa650036000 tx=0x7fa650008030 comp rx=0 tx=0).stop 2023-12-20T04:48:37.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.212+0000 7fa66b070640 1 -- 172.21.15.132:0/3550023448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6640b60e0 msgr2=0x7fa664153130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:37.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.212+0000 7fa66b070640 1 --2- 172.21.15.132:0/3550023448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6640b60e0 0x7fa664153130 secure :-1 s=READY pgs=1331 cs=0 l=1 rev1=1 crypto rx=0x7fa65800c500 tx=0x7fa65800c9c0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.212+0000 7fa66b070640 1 -- 172.21.15.132:0/3550023448 shutdown_connections 2023-12-20T04:48:37.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.212+0000 7fa66b070640 1 --2- 172.21.15.132:0/3550023448 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa64806a430 0x7fa64806c8f0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.212+0000 7fa66b070640 1 --2- 172.21.15.132:0/3550023448 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa66415d300 0x7fa6640c9f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.212+0000 7fa66b070640 1 --2- 172.21.15.132:0/3550023448 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa6640cf880 0x7fa66414a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.212+0000 7fa66b070640 1 --2- 172.21.15.132:0/3550023448 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa6640b60e0 0x7fa664153130 unknown :-1 s=CLOSED pgs=1331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.212+0000 7fa66b070640 1 -- 172.21.15.132:0/3550023448 >> 172.21.15.132:0/3550023448 conn(0x7fa66406a3d0 msgr2=0x7fa664154250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:37.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.214+0000 7fa66b070640 1 -- 172.21.15.132:0/3550023448 shutdown_connections 2023-12-20T04:48:37.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.214+0000 7fa66b070640 1 -- 172.21.15.132:0/3550023448 wait complete. 2023-12-20T04:48:37.232 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:48:37.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.330+0000 7f70a47ab640 1 Processor -- start 2023-12-20T04:48:37.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.330+0000 7f70a47ab640 1 -- start start 2023-12-20T04:48:37.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.331+0000 7f70a47ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f709c159d00 0x7f709c15da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.331+0000 7f70a47ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f709c15df40 0x7f709c0caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.331+0000 7f70a47ab640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f709c0cafd0 0x7f709c06cc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.331+0000 7f70a47ab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c06c220 con 0x7f709c15df40 2023-12-20T04:48:37.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.331+0000 7f70a47ab640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f709c15e4c0 con 0x7f709c0cafd0 2023-12-20T04:48:37.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.331+0000 7f70a47ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c15e7a0 con 0x7f709c159d00 2023-12-20T04:48:37.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.332+0000 7f70a1d46640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f709c15df40 0x7f709c0caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.332+0000 7f70a1d46640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f709c15df40 0x7f709c0caa90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49592/0 (socket says 172.21.15.132:49592) 2023-12-20T04:48:37.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.332+0000 7f70a1d46640 1 -- 172.21.15.132:0/964908253 learned_addr learned my addr 172.21.15.132:0/964908253 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:37.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.332+0000 7f70a2d48640 1 --2- 172.21.15.132:0/964908253 >> v2:172.21.15.187:3300/0 conn(0x7f709c0cafd0 0x7f709c06cc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.332+0000 7f70a2547640 1 --2- 172.21.15.132:0/964908253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f709c159d00 0x7f709c15da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.332+0000 7f70a1d46640 1 -- 172.21.15.132:0/964908253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f709c159d00 msgr2=0x7f709c15da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:37.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.332+0000 7f70a1d46640 1 --2- 172.21.15.132:0/964908253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f709c159d00 0x7f709c15da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.332+0000 7f70a1d46640 1 -- 172.21.15.132:0/964908253 >> v2:172.21.15.187:3300/0 conn(0x7f709c0cafd0 msgr2=0x7f709c06cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:37.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.332+0000 7f70a1d46640 1 --2- 172.21.15.132:0/964908253 >> v2:172.21.15.187:3300/0 conn(0x7f709c0cafd0 0x7f709c06cc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.332+0000 7f70a1d46640 1 -- 172.21.15.132:0/964908253 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f709c06c430 con 0x7f709c15df40 2023-12-20T04:48:37.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.332+0000 7f70a2547640 1 --2- 172.21.15.132:0/964908253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f709c159d00 0x7f709c15da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:37.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.333+0000 7f70a1d46640 1 --2- 172.21.15.132:0/964908253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f709c15df40 0x7f709c0caa90 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f709c0cc4f0 tx=0x7f708c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf040c5d6982d05d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:37.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.333+0000 7f70a1545640 1 -- 172.21.15.132:0/964908253 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c031870 con 0x7f709c15df40 2023-12-20T04:48:37.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.333+0000 7f70a1545640 1 -- 172.21.15.132:0/964908253 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c0319d0 con 0x7f709c15df40 2023-12-20T04:48:37.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.333+0000 7f70a1545640 1 -- 172.21.15.132:0/964908253 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c031d60 con 0x7f709c15df40 2023-12-20T04:48:37.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.333+0000 7f70a47ab640 1 -- 172.21.15.132:0/964908253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f709c15df40 msgr2=0x7f709c0caa90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:37.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.333+0000 7f70a47ab640 1 --2- 172.21.15.132:0/964908253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f709c15df40 0x7f709c0caa90 secure :-1 s=READY pgs=1332 cs=0 l=1 rev1=1 crypto rx=0x7f709c0cc4f0 tx=0x7f708c02b910 comp rx=0 tx=0).stop 2023-12-20T04:48:37.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.333+0000 7f70a47ab640 1 -- 172.21.15.132:0/964908253 shutdown_connections 2023-12-20T04:48:37.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.333+0000 7f70a47ab640 1 --2- 172.21.15.132:0/964908253 >> v2:172.21.15.187:3300/0 conn(0x7f709c0cafd0 0x7f709c06cc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.333+0000 7f70a47ab640 1 --2- 172.21.15.132:0/964908253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f709c15df40 0x7f709c0caa90 unknown :-1 s=CLOSED pgs=1332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.333+0000 7f70a47ab640 1 --2- 172.21.15.132:0/964908253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f709c159d00 0x7f709c15da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.333+0000 7f70a47ab640 1 -- 172.21.15.132:0/964908253 >> 172.21.15.132:0/964908253 conn(0x7f709c0cfca0 msgr2=0x7f709c0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:37.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.333+0000 7f70a47ab640 1 -- 172.21.15.132:0/964908253 shutdown_connections 2023-12-20T04:48:37.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.333+0000 7f70a47ab640 1 -- 172.21.15.132:0/964908253 wait complete. 2023-12-20T04:48:37.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.334+0000 7f70a47ab640 1 Processor -- start 2023-12-20T04:48:37.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.335+0000 7f70a47ab640 1 -- start start 2023-12-20T04:48:37.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.335+0000 7f70a47ab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f709c0cafd0 0x7f709c1e4080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.335+0000 7f70a47ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f709c159d00 0x7f709c152bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.335+0000 7f70a47ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f709c15df40 0x7f709c1530f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.335+0000 7f70a47ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c0b1560 con 0x7f709c159d00 2023-12-20T04:48:37.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.335+0000 7f70a47ab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f709c0b0310 con 0x7f709c0cafd0 2023-12-20T04:48:37.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.335+0000 7f70a47ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f709c0b05f0 con 0x7f709c15df40 2023-12-20T04:48:37.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.335+0000 7f70a1d46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f709c159d00 0x7f709c152bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.335+0000 7f70a1d46640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f709c159d00 0x7f709c152bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49602/0 (socket says 172.21.15.132:49602) 2023-12-20T04:48:37.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.335+0000 7f70a1d46640 1 -- 172.21.15.132:0/182650131 learned_addr learned my addr 172.21.15.132:0/182650131 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:37.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.336+0000 7f70a1d46640 1 -- 172.21.15.132:0/182650131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f709c15df40 msgr2=0x7f709c1530f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:37.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.336+0000 7f70a2d48640 1 --2- 172.21.15.132:0/182650131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f709c15df40 0x7f709c1530f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.336+0000 7f70a1d46640 1 --2- 172.21.15.132:0/182650131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f709c15df40 0x7f709c1530f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.336+0000 7f70a1d46640 1 -- 172.21.15.132:0/182650131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f709c0cafd0 msgr2=0x7f709c1e4080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:37.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.336+0000 7f70a2547640 1 --2- 172.21.15.132:0/182650131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f709c0cafd0 0x7f709c1e4080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.336+0000 7f70a1d46640 1 --2- 172.21.15.132:0/182650131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f709c0cafd0 0x7f709c1e4080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.336+0000 7f70a1d46640 1 -- 172.21.15.132:0/182650131 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f708c0094d0 con 0x7f709c159d00 2023-12-20T04:48:37.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.336+0000 7f70a1d46640 1 --2- 172.21.15.132:0/182650131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f709c159d00 0x7f709c152bb0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f708c02b950 tx=0x7f708c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:37.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.336+0000 7f7092ffd640 1 -- 172.21.15.132:0/182650131 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c03ad30 con 0x7f709c159d00 2023-12-20T04:48:37.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.336+0000 7f7092ffd640 1 -- 172.21.15.132:0/182650131 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f708c0443f0 con 0x7f709c159d00 2023-12-20T04:48:37.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.336+0000 7f70a47ab640 1 -- 172.21.15.132:0/182650131 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f709c13e8e0 con 0x7f709c159d00 2023-12-20T04:48:37.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.336+0000 7f7092ffd640 1 -- 172.21.15.132:0/182650131 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f708c0447a0 con 0x7f709c159d00 2023-12-20T04:48:37.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.336+0000 7f70a47ab640 1 -- 172.21.15.132:0/182650131 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f709c13eea0 con 0x7f709c159d00 2023-12-20T04:48:37.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.337+0000 7f70a47ab640 1 -- 172.21.15.132:0/182650131 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f709c13f090 con 0x7f709c159d00 2023-12-20T04:48:37.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.337+0000 7f7092ffd640 1 -- 172.21.15.132:0/182650131 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f708c04d450 con 0x7f709c159d00 2023-12-20T04:48:37.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.338+0000 7f7092ffd640 1 --2- 172.21.15.132:0/182650131 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f708006a430 0x7f708006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.338+0000 7f70a2547640 1 --2- 172.21.15.132:0/182650131 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f708006a430 0x7f708006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.338+0000 7f7092ffd640 1 -- 172.21.15.132:0/182650131 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f708c02d040 con 0x7f709c159d00 2023-12-20T04:48:37.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.338+0000 7f70a2547640 1 --2- 172.21.15.132:0/182650131 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f708006a430 0x7f708006c8f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f709c157130 tx=0x7f70980084f0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:37.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.342+0000 7f7092ffd640 1 -- 172.21.15.132:0/182650131 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f708c0764c0 con 0x7f709c159d00 2023-12-20T04:48:37.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.509+0000 7f70a47ab640 1 -- 172.21.15.132:0/182650131 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f709c04e840 con 0x7f709c159d00 2023-12-20T04:48:37.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.510+0000 7f7092ffd640 1 -- 172.21.15.132:0/182650131 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+16121 (secure 0 0 0) 0x7f708c035020 con 0x7f709c159d00 2023-12-20T04:48:37.512 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:37.512 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":136,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:48:37.200034+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:48:35.008751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-20T04:48:36.182609+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:48:37.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.512+0000 7f70a47ab640 1 -- 172.21.15.132:0/182650131 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f708006a430 msgr2=0x7f708006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:37.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.512+0000 7f70a47ab640 1 --2- 172.21.15.132:0/182650131 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f708006a430 0x7f708006c8f0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f709c157130 tx=0x7f70980084f0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.512+0000 7f70a47ab640 1 -- 172.21.15.132:0/182650131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f709c159d00 msgr2=0x7f709c152bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:37.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.512+0000 7f70a47ab640 1 --2- 172.21.15.132:0/182650131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f709c159d00 0x7f709c152bb0 secure :-1 s=READY pgs=1333 cs=0 l=1 rev1=1 crypto rx=0x7f708c02b950 tx=0x7f708c0046c0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.512+0000 7f70a47ab640 1 -- 172.21.15.132:0/182650131 shutdown_connections 2023-12-20T04:48:37.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.512+0000 7f70a47ab640 1 --2- 172.21.15.132:0/182650131 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f708006a430 0x7f708006c8f0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.512+0000 7f70a47ab640 1 --2- 172.21.15.132:0/182650131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f709c15df40 0x7f709c1530f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.512+0000 7f70a47ab640 1 --2- 172.21.15.132:0/182650131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f709c159d00 0x7f709c152bb0 unknown :-1 s=CLOSED pgs=1333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.512+0000 7f70a47ab640 1 --2- 172.21.15.132:0/182650131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f709c0cafd0 0x7f709c1e4080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.512+0000 7f70a47ab640 1 -- 172.21.15.132:0/182650131 >> 172.21.15.132:0/182650131 conn(0x7f709c0cfca0 msgr2=0x7f709c0cb470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:37.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.512+0000 7f70a47ab640 1 -- 172.21.15.132:0/182650131 shutdown_connections 2023-12-20T04:48:37.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.512+0000 7f70a47ab640 1 -- 172.21.15.132:0/182650131 wait complete. 2023-12-20T04:48:37.526 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:48:37.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.622+0000 7fc421851640 1 Processor -- start 2023-12-20T04:48:37.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.622+0000 7fc421851640 1 -- start start 2023-12-20T04:48:37.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.623+0000 7fc421851640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc41c06f0e0 0x7fc41c15f480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.623+0000 7fc421851640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41c06f750 con 0x7fc41c0d08c0 2023-12-20T04:48:37.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.623+0000 7fc421851640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc41c06fa30 con 0x7fc41c15f9c0 2023-12-20T04:48:37.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.623+0000 7fc421851640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc41c15f060 con 0x7fc41c06f0e0 2023-12-20T04:48:37.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.623+0000 7fc41affd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc41c0d08c0 0x7fc41c0cd030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47722/0 (socket says 172.21.15.132:47722) 2023-12-20T04:48:37.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.623+0000 7fc41affd640 1 -- 172.21.15.132:0/3388699134 learned_addr learned my addr 172.21.15.132:0/3388699134 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:37.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc419ffb640 1 -- 172.21.15.132:0/3388699134 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 335247485 0 0) 0x7fc41c06f750 con 0x7fc41c0d08c0 2023-12-20T04:48:37.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc419ffb640 1 -- 172.21.15.132:0/3388699134 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc404003520 con 0x7fc41c0d08c0 2023-12-20T04:48:37.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc41a7fc640 1 --2- 172.21.15.132:0/3388699134 >> v2:172.21.15.187:3300/0 conn(0x7fc41c06f0e0 0x7fc41c15f480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc419ffb640 1 -- 172.21.15.132:0/3388699134 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2027411920 0 0) 0x7fc404003520 con 0x7fc41c0d08c0 2023-12-20T04:48:37.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc419ffb640 1 -- 172.21.15.132:0/3388699134 >> v2:172.21.15.187:3300/0 conn(0x7fc41c06f0e0 msgr2=0x7fc41c15f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:37.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc419ffb640 1 --2- 172.21.15.132:0/3388699134 >> v2:172.21.15.187:3300/0 conn(0x7fc41c06f0e0 0x7fc41c15f480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc419ffb640 1 -- 172.21.15.132:0/3388699134 >> v1:172.21.15.187:6789/0 conn(0x7fc41c15f9c0 legacy=0x7fc41c15b7d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:37.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc419ffb640 1 -- 172.21.15.132:0/3388699134 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c06fd10 con 0x7fc41c0d08c0 2023-12-20T04:48:37.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc419ffb640 1 -- 172.21.15.132:0/3388699134 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fc40c0019f0 con 0x7fc41c0d08c0 2023-12-20T04:48:37.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc419ffb640 1 -- 172.21.15.132:0/3388699134 >> v1:172.21.15.132:6789/0 conn(0x7fc41c0d08c0 legacy=0x7fc41c0cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:37.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc419ffb640 1 --2- 172.21.15.132:0/3388699134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc404003970 0x7fc404003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc419ffb640 1 --2- 172.21.15.132:0/3388699134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4040047c0 0x7fc404004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc419ffb640 1 --2- 172.21.15.132:0/3388699134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4040052a0 0x7fc40400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc419ffb640 1 -- 172.21.15.132:0/3388699134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c15f060 con 0x7fc4040047c0 2023-12-20T04:48:37.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc419ffb640 1 -- 172.21.15.132:0/3388699134 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc40400c1f0 con 0x7fc404003970 2023-12-20T04:48:37.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc419ffb640 1 -- 172.21.15.132:0/3388699134 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc40400c3b0 con 0x7fc4040052a0 2023-12-20T04:48:37.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc41a7fc640 1 --2- 172.21.15.132:0/3388699134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4040047c0 0x7fc404004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc41affd640 1 --2- 172.21.15.132:0/3388699134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc404003970 0x7fc404003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc41b7fe640 1 --2- 172.21.15.132:0/3388699134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4040052a0 0x7fc40400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc41a7fc640 1 -- 172.21.15.132:0/3388699134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4040052a0 msgr2=0x7fc40400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:37.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc41a7fc640 1 --2- 172.21.15.132:0/3388699134 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc4040052a0 0x7fc40400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc41a7fc640 1 -- 172.21.15.132:0/3388699134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc404003970 msgr2=0x7fc404003d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:37.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc41a7fc640 1 --2- 172.21.15.132:0/3388699134 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc404003970 0x7fc404003d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc41a7fc640 1 -- 172.21.15.132:0/3388699134 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc404003520 con 0x7fc4040047c0 2023-12-20T04:48:37.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.624+0000 7fc41b7fe640 1 -- 172.21.15.132:0/3388699134 reap_dead start 2023-12-20T04:48:37.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.625+0000 7fc41a7fc640 1 --2- 172.21.15.132:0/3388699134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4040047c0 0x7fc404004c40 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fc41000ba00 tx=0x7fc4040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2153b9c17a421a45 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:37.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.625+0000 7fc419ffb640 1 -- 172.21.15.132:0/3388699134 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc4100325f0 con 0x7fc4040047c0 2023-12-20T04:48:37.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.625+0000 7fc419ffb640 1 -- 172.21.15.132:0/3388699134 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc410032750 con 0x7fc4040047c0 2023-12-20T04:48:37.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.625+0000 7fc419ffb640 1 -- 172.21.15.132:0/3388699134 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc410032ae0 con 0x7fc4040047c0 2023-12-20T04:48:37.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.626+0000 7fc421851640 1 -- 172.21.15.132:0/3388699134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4040047c0 msgr2=0x7fc404004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:37.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.626+0000 7fc421851640 1 --2- 172.21.15.132:0/3388699134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4040047c0 0x7fc404004c40 secure :-1 s=READY pgs=1335 cs=0 l=1 rev1=1 crypto rx=0x7fc41000ba00 tx=0x7fc4040057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.626+0000 7fc421851640 1 -- 172.21.15.132:0/3388699134 shutdown_connections 2023-12-20T04:48:37.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.626+0000 7fc421851640 1 --2- 172.21.15.132:0/3388699134 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4040047c0 0x7fc404004c40 unknown :-1 s=CLOSED pgs=1335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.626+0000 7fc421851640 1 -- 172.21.15.132:0/3388699134 >> 172.21.15.132:0/3388699134 conn(0x7fc41c0cd7b0 msgr2=0x7fc41c0cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:37.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.626+0000 7fc421851640 1 -- 172.21.15.132:0/3388699134 shutdown_connections 2023-12-20T04:48:37.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.626+0000 7fc421851640 1 -- 172.21.15.132:0/3388699134 wait complete. 2023-12-20T04:48:37.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.627+0000 7fc421851640 1 Processor -- start 2023-12-20T04:48:37.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.627+0000 7fc421851640 1 -- start start 2023-12-20T04:48:37.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc421851640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4040047c0 0x7fc41c1f1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc421851640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc41c0c59a0 0x7fc41c15a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc421851640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc41c15a950 0x7fc41c15b950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc421851640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c15add0 con 0x7fc4040047c0 2023-12-20T04:48:37.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc421851640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c1f1770 con 0x7fc41c0c59a0 2023-12-20T04:48:37.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc421851640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc41c0c6160 con 0x7fc41c15a950 2023-12-20T04:48:37.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc41affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4040047c0 0x7fc41c1f1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc41affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4040047c0 0x7fc41c1f1230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52614/0 (socket says 172.21.15.132:52614) 2023-12-20T04:48:37.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc41affd640 1 -- 172.21.15.132:0/1505996167 learned_addr learned my addr 172.21.15.132:0/1505996167 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:37.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc41a7fc640 1 --2- 172.21.15.132:0/1505996167 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc41c0c59a0 0x7fc41c15a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc41b7fe640 1 --2- 172.21.15.132:0/1505996167 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc41c15a950 0x7fc41c15b950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc41affd640 1 -- 172.21.15.132:0/1505996167 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc41c15a950 msgr2=0x7fc41c15b950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:37.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc41affd640 1 --2- 172.21.15.132:0/1505996167 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc41c15a950 0x7fc41c15b950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc41affd640 1 -- 172.21.15.132:0/1505996167 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc41c0c59a0 msgr2=0x7fc41c15a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:37.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc41affd640 1 --2- 172.21.15.132:0/1505996167 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc41c0c59a0 0x7fc41c15a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc41affd640 1 -- 172.21.15.132:0/1505996167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc41c0c6440 con 0x7fc4040047c0 2023-12-20T04:48:37.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc41affd640 1 --2- 172.21.15.132:0/1505996167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4040047c0 0x7fc41c1f1230 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fc40c007970 tx=0x7fc40c00a730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:37.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc403fff640 1 -- 172.21.15.132:0/1505996167 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c00ade0 con 0x7fc4040047c0 2023-12-20T04:48:37.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.628+0000 7fc403fff640 1 -- 172.21.15.132:0/1505996167 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc40c0133f0 con 0x7fc4040047c0 2023-12-20T04:48:37.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.629+0000 7fc421851640 1 -- 172.21.15.132:0/1505996167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc41c0c6720 con 0x7fc4040047c0 2023-12-20T04:48:37.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.629+0000 7fc403fff640 1 -- 172.21.15.132:0/1505996167 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc40c0137a0 con 0x7fc4040047c0 2023-12-20T04:48:37.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.629+0000 7fc421851640 1 -- 172.21.15.132:0/1505996167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc41c0c6ce0 con 0x7fc4040047c0 2023-12-20T04:48:37.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.630+0000 7fc421851640 1 -- 172.21.15.132:0/1505996167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc41c06a060 con 0x7fc4040047c0 2023-12-20T04:48:37.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.630+0000 7fc403fff640 1 -- 172.21.15.132:0/1505996167 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc40c013900 con 0x7fc4040047c0 2023-12-20T04:48:37.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.630+0000 7fc403fff640 1 --2- 172.21.15.132:0/1505996167 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc40806a460 0x7fc40806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.631+0000 7fc41a7fc640 1 --2- 172.21.15.132:0/1505996167 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc40806a460 0x7fc40806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.631+0000 7fc403fff640 1 -- 172.21.15.132:0/1505996167 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc40c089340 con 0x7fc4040047c0 2023-12-20T04:48:37.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.631+0000 7fc41a7fc640 1 --2- 172.21.15.132:0/1505996167 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc40806a460 0x7fc40806c920 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc4040057a0 tx=0x7fc41003d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:37.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.635+0000 7fc403fff640 1 -- 172.21.15.132:0/1505996167 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc40c054a70 con 0x7fc4040047c0 2023-12-20T04:48:37.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.802+0000 7fc421851640 1 -- 172.21.15.132:0/1505996167 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fc41c04e840 con 0x7fc4040047c0 2023-12-20T04:48:37.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.803+0000 7fc403fff640 1 -- 172.21.15.132:0/1505996167 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v136) v1 ==== 74+0+16121 (secure 0 0 0) 0x7fc40c017090 con 0x7fc4040047c0 2023-12-20T04:48:37.805 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:37.805 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":136,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:48:37.200034+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:48:35.008751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-20T04:48:36.182609+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:48:37.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.805+0000 7fc421851640 1 -- 172.21.15.132:0/1505996167 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc40806a460 msgr2=0x7fc40806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:37.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.805+0000 7fc421851640 1 --2- 172.21.15.132:0/1505996167 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc40806a460 0x7fc40806c920 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7fc4040057a0 tx=0x7fc41003d040 comp rx=0 tx=0).stop 2023-12-20T04:48:37.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.805+0000 7fc421851640 1 -- 172.21.15.132:0/1505996167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4040047c0 msgr2=0x7fc41c1f1230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:37.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.805+0000 7fc421851640 1 --2- 172.21.15.132:0/1505996167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4040047c0 0x7fc41c1f1230 secure :-1 s=READY pgs=1336 cs=0 l=1 rev1=1 crypto rx=0x7fc40c007970 tx=0x7fc40c00a730 comp rx=0 tx=0).stop 2023-12-20T04:48:37.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.805+0000 7fc421851640 1 -- 172.21.15.132:0/1505996167 shutdown_connections 2023-12-20T04:48:37.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.805+0000 7fc421851640 1 --2- 172.21.15.132:0/1505996167 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc40806a460 0x7fc40806c920 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.805+0000 7fc421851640 1 --2- 172.21.15.132:0/1505996167 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc41c15a950 0x7fc41c15b950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.805+0000 7fc421851640 1 --2- 172.21.15.132:0/1505996167 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc41c0c59a0 0x7fc41c15a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.805+0000 7fc421851640 1 --2- 172.21.15.132:0/1505996167 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4040047c0 0x7fc41c1f1230 unknown :-1 s=CLOSED pgs=1336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.805+0000 7fc421851640 1 -- 172.21.15.132:0/1505996167 >> 172.21.15.132:0/1505996167 conn(0x7fc41c0cd7b0 msgr2=0x7fc41c15dda0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:37.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.805+0000 7fc421851640 1 -- 172.21.15.132:0/1505996167 shutdown_connections 2023-12-20T04:48:37.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.805+0000 7fc421851640 1 -- 172.21.15.132:0/1505996167 wait complete. 2023-12-20T04:48:37.818 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-20T04:48:37.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.919+0000 7f6e52b69640 1 Processor -- start 2023-12-20T04:48:37.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.919+0000 7f6e52b69640 1 -- start start 2023-12-20T04:48:37.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.920+0000 7f6e52b69640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6e4c0cf1d0 0x7f6e4c15e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.920+0000 7f6e52b69640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f6e4c070460 0x7f6e4c0708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.920+0000 7f6e52b69640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e4c0c4a70 0x7f6e4c0c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.920+0000 7f6e52b69640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4c070e30 con 0x7f6e4c0cf1d0 2023-12-20T04:48:37.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.920+0000 7f6e52b69640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e4c15e740 con 0x7f6e4c070460 2023-12-20T04:48:37.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.920+0000 7f6e52b69640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c0cb6b0 con 0x7f6e4c0c4a70 2023-12-20T04:48:37.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.920+0000 7f6e50905640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6e4c0cf1d0 0x7f6e4c15e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.920+0000 7f6e50905640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6e4c0cf1d0 0x7f6e4c15e200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52630/0 (socket says 172.21.15.132:52630) 2023-12-20T04:48:37.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.920+0000 7f6e50905640 1 -- 172.21.15.132:0/2389379351 learned_addr learned my addr 172.21.15.132:0/2389379351 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:37.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.921+0000 7f6e51106640 1 --2- 172.21.15.132:0/2389379351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e4c0c4a70 0x7f6e4c0c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.921+0000 7f6e4bfff640 1 --2- 172.21.15.132:0/2389379351 >> v2:172.21.15.187:3300/0 conn(0x7f6e4c070460 0x7f6e4c0708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.921+0000 7f6e50905640 1 -- 172.21.15.132:0/2389379351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e4c0c4a70 msgr2=0x7f6e4c0c4ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:37.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.921+0000 7f6e50905640 1 --2- 172.21.15.132:0/2389379351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e4c0c4a70 0x7f6e4c0c4ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.921+0000 7f6e50905640 1 -- 172.21.15.132:0/2389379351 >> v2:172.21.15.187:3300/0 conn(0x7f6e4c070460 msgr2=0x7f6e4c0708f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:37.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.921+0000 7f6e50905640 1 --2- 172.21.15.132:0/2389379351 >> v2:172.21.15.187:3300/0 conn(0x7f6e4c070460 0x7f6e4c0708f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.921+0000 7f6e50905640 1 -- 172.21.15.132:0/2389379351 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e4c0cb990 con 0x7f6e4c0cf1d0 2023-12-20T04:48:37.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.921+0000 7f6e50905640 1 --2- 172.21.15.132:0/2389379351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e4c0cf1d0 0x7f6e4c15e200 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0d0af0 tx=0x7f6e3c02e0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=830aafac58fe1dad server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:37.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.922+0000 7f6e4b7fe640 1 -- 172.21.15.132:0/2389379351 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c02ee80 con 0x7f6e4c0cf1d0 2023-12-20T04:48:37.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.922+0000 7f6e4b7fe640 1 -- 172.21.15.132:0/2389379351 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e3c036440 con 0x7f6e4c0cf1d0 2023-12-20T04:48:37.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.922+0000 7f6e4b7fe640 1 -- 172.21.15.132:0/2389379351 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e3c0367b0 con 0x7f6e4c0cf1d0 2023-12-20T04:48:37.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.922+0000 7f6e52b69640 1 -- 172.21.15.132:0/2389379351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e4c0cf1d0 msgr2=0x7f6e4c15e200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:37.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.922+0000 7f6e52b69640 1 --2- 172.21.15.132:0/2389379351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e4c0cf1d0 0x7f6e4c15e200 secure :-1 s=READY pgs=1337 cs=0 l=1 rev1=1 crypto rx=0x7f6e4c0d0af0 tx=0x7f6e3c02e0d0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.922+0000 7f6e52b69640 1 -- 172.21.15.132:0/2389379351 shutdown_connections 2023-12-20T04:48:37.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.922+0000 7f6e52b69640 1 --2- 172.21.15.132:0/2389379351 >> v2:172.21.15.187:3300/0 conn(0x7f6e4c070460 0x7f6e4c0708f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.922+0000 7f6e52b69640 1 --2- 172.21.15.132:0/2389379351 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e4c0c4a70 0x7f6e4c0c4ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.922+0000 7f6e52b69640 1 --2- 172.21.15.132:0/2389379351 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e4c0cf1d0 0x7f6e4c15e200 unknown :-1 s=CLOSED pgs=1337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.922+0000 7f6e52b69640 1 -- 172.21.15.132:0/2389379351 >> 172.21.15.132:0/2389379351 conn(0x7f6e4c0cc630 msgr2=0x7f6e4c0cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:37.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.922+0000 7f6e52b69640 1 -- 172.21.15.132:0/2389379351 shutdown_connections 2023-12-20T04:48:37.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.922+0000 7f6e52b69640 1 -- 172.21.15.132:0/2389379351 wait complete. 2023-12-20T04:48:37.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.923+0000 7f6e52b69640 1 Processor -- start 2023-12-20T04:48:37.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.923+0000 7f6e52b69640 1 -- start start 2023-12-20T04:48:37.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.924+0000 7f6e52b69640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e4c070460 0x7f6e4c0c7600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.924+0000 7f6e52b69640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e4c0c4a70 0x7f6e4c1592b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.924+0000 7f6e52b69640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e4c0cf1d0 0x7f6e4c0c4ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.924+0000 7f6e52b69640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c15ae90 con 0x7f6e4c0cf1d0 2023-12-20T04:48:37.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.924+0000 7f6e52b69640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c15a280 con 0x7f6e4c070460 2023-12-20T04:48:37.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.924+0000 7f6e52b69640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e4c15a560 con 0x7f6e4c0c4a70 2023-12-20T04:48:37.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.924+0000 7f6e51106640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e4c0cf1d0 0x7f6e4c0c4ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.924+0000 7f6e51106640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e4c0cf1d0 0x7f6e4c0c4ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52638/0 (socket says 172.21.15.132:52638) 2023-12-20T04:48:37.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.924+0000 7f6e51106640 1 -- 172.21.15.132:0/196920865 learned_addr learned my addr 172.21.15.132:0/196920865 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:37.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.925+0000 7f6e51106640 1 -- 172.21.15.132:0/196920865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e4c0c4a70 msgr2=0x7f6e4c1592b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:37.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.925+0000 7f6e4bfff640 1 --2- 172.21.15.132:0/196920865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e4c0c4a70 0x7f6e4c1592b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.925+0000 7f6e50905640 1 --2- 172.21.15.132:0/196920865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e4c070460 0x7f6e4c0c7600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.925+0000 7f6e51106640 1 --2- 172.21.15.132:0/196920865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e4c0c4a70 0x7f6e4c1592b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.925+0000 7f6e51106640 1 -- 172.21.15.132:0/196920865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e4c070460 msgr2=0x7f6e4c0c7600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:37.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.925+0000 7f6e51106640 1 --2- 172.21.15.132:0/196920865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e4c070460 0x7f6e4c0c7600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:37.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.925+0000 7f6e51106640 1 -- 172.21.15.132:0/196920865 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e3c00b770 con 0x7f6e4c0cf1d0 2023-12-20T04:48:37.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.925+0000 7f6e51106640 1 --2- 172.21.15.132:0/196920865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e4c0cf1d0 0x7f6e4c0c4ec0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f6e44007e40 tx=0x7f6e4400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:37.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.925+0000 7f6e497fa640 1 -- 172.21.15.132:0/196920865 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e44014620 con 0x7f6e4c0cf1d0 2023-12-20T04:48:37.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.925+0000 7f6e497fa640 1 -- 172.21.15.132:0/196920865 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e4400ee90 con 0x7f6e4c0cf1d0 2023-12-20T04:48:37.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.925+0000 7f6e52b69640 1 -- 172.21.15.132:0/196920865 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e4c15a840 con 0x7f6e4c0cf1d0 2023-12-20T04:48:37.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.925+0000 7f6e497fa640 1 -- 172.21.15.132:0/196920865 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e440149e0 con 0x7f6e4c0cf1d0 2023-12-20T04:48:37.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.925+0000 7f6e52b69640 1 -- 172.21.15.132:0/196920865 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e4c0c7b40 con 0x7f6e4c0cf1d0 2023-12-20T04:48:37.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.926+0000 7f6e52b69640 1 -- 172.21.15.132:0/196920865 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e4c04e840 con 0x7f6e4c0cf1d0 2023-12-20T04:48:37.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.926+0000 7f6e497fa640 1 -- 172.21.15.132:0/196920865 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6e44014b40 con 0x7f6e4c0cf1d0 2023-12-20T04:48:37.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.927+0000 7f6e497fa640 1 --2- 172.21.15.132:0/196920865 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6e3806a430 0x7f6e3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:37.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.927+0000 7f6e50905640 1 --2- 172.21.15.132:0/196920865 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6e3806a430 0x7f6e3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:37.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.927+0000 7f6e497fa640 1 -- 172.21.15.132:0/196920865 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(136..136 src has 1..136) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6e44089180 con 0x7f6e4c0cf1d0 2023-12-20T04:48:37.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.927+0000 7f6e50905640 1 --2- 172.21.15.132:0/196920865 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6e3806a430 0x7f6e3806c8f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c038000 tx=0x7f6e3c032000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:37.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:37.931+0000 7f6e497fa640 1 -- 172.21.15.132:0/196920865 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6e44054800 con 0x7f6e4c0cf1d0 2023-12-20T04:48:38.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.136+0000 7f6e52b69640 1 -- 172.21.15.132:0/196920865 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f6e4c140f10 con 0x7f6e4c0cf1d0 2023-12-20T04:48:38.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.207+0000 7f6e497fa640 1 -- 172.21.15.132:0/196920865 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v50) v1 ==== 118+0+0 (secure 0 0 0) 0x7f6e44057e20 con 0x7f6e4c0cf1d0 2023-12-20T04:48:38.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.209+0000 7f6e52b69640 1 -- 172.21.15.132:0/196920865 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6e3806a430 msgr2=0x7f6e3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:38.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.209+0000 7f6e52b69640 1 --2- 172.21.15.132:0/196920865 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6e3806a430 0x7f6e3806c8f0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f6e3c038000 tx=0x7f6e3c032000 comp rx=0 tx=0).stop 2023-12-20T04:48:38.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.209+0000 7f6e52b69640 1 -- 172.21.15.132:0/196920865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e4c0cf1d0 msgr2=0x7f6e4c0c4ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:38.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.209+0000 7f6e52b69640 1 --2- 172.21.15.132:0/196920865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e4c0cf1d0 0x7f6e4c0c4ec0 secure :-1 s=READY pgs=1338 cs=0 l=1 rev1=1 crypto rx=0x7f6e44007e40 tx=0x7f6e4400e4b0 comp rx=0 tx=0).stop 2023-12-20T04:48:38.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.209+0000 7f6e52b69640 1 -- 172.21.15.132:0/196920865 shutdown_connections 2023-12-20T04:48:38.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.209+0000 7f6e52b69640 1 --2- 172.21.15.132:0/196920865 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6e3806a430 0x7f6e3806c8f0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:38.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.209+0000 7f6e52b69640 1 --2- 172.21.15.132:0/196920865 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e4c0cf1d0 0x7f6e4c0c4ec0 unknown :-1 s=CLOSED pgs=1338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:38.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.209+0000 7f6e52b69640 1 --2- 172.21.15.132:0/196920865 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e4c0c4a70 0x7f6e4c1592b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:38.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.209+0000 7f6e52b69640 1 --2- 172.21.15.132:0/196920865 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e4c070460 0x7f6e4c0c7600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:38.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.209+0000 7f6e52b69640 1 -- 172.21.15.132:0/196920865 >> 172.21.15.132:0/196920865 conn(0x7f6e4c0cc630 msgr2=0x7f6e4c06c780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:38.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.209+0000 7f6e52b69640 1 -- 172.21.15.132:0/196920865 shutdown_connections 2023-12-20T04:48:38.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.209+0000 7f6e52b69640 1 -- 172.21.15.132:0/196920865 wait complete. 2023-12-20T04:48:38.222 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-20T04:48:38.222 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-20T04:48:38.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.323+0000 7f28893ab640 1 Processor -- start 2023-12-20T04:48:38.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.323+0000 7f28893ab640 1 -- start start 2023-12-20T04:48:38.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.323+0000 7f28893ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f28840cf790 0x7f28840cfc40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:38.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.324+0000 7f28893ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28840b6080 0x7f28840b64b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:38.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.324+0000 7f28893ab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f28840d2920 con 0x7f288415d300 2023-12-20T04:48:38.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.324+0000 7f28893ab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f28840d0180 con 0x7f28840cf790 2023-12-20T04:48:38.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.324+0000 7f28893ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28840d1d10 con 0x7f28840b6080 2023-12-20T04:48:38.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.324+0000 7f287bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f28840cf790 0x7f28840cfc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:38.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.324+0000 7f2882ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f288415d300 0x7f28840d1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47724/0 (socket says 172.21.15.132:47724) 2023-12-20T04:48:38.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.324+0000 7f2882ffd640 1 -- 172.21.15.132:0/1200386195 learned_addr learned my addr 172.21.15.132:0/1200386195 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:38.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.324+0000 7f287bfff640 1 -- 172.21.15.132:0/1200386195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28840b6080 msgr2=0x7f28840b64b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:38.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.324+0000 7f287bfff640 1 --2- 172.21.15.132:0/1200386195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28840b6080 0x7f28840b64b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:38.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.324+0000 7f287bfff640 1 -- 172.21.15.132:0/1200386195 >> v1:172.21.15.132:6789/0 conn(0x7f288415d300 legacy=0x7f28840d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:38.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.324+0000 7f287bfff640 1 -- 172.21.15.132:0/1200386195 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f28840d1ff0 con 0x7f28840cf790 2023-12-20T04:48:38.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.325+0000 7f287bfff640 1 --2- 172.21.15.132:0/1200386195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840cf790 0x7f28840cfc40 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f286c0097a0 tx=0x7f286c02b710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5fdd24eddfd3dfba server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:38.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.325+0000 7f28827fc640 1 -- 172.21.15.132:0/1200386195 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c030710 con 0x7f28840cf790 2023-12-20T04:48:38.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.325+0000 7f28827fc640 1 -- 172.21.15.132:0/1200386195 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c02e050 con 0x7f28840cf790 2023-12-20T04:48:38.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.325+0000 7f28827fc640 1 -- 172.21.15.132:0/1200386195 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c030a90 con 0x7f28840cf790 2023-12-20T04:48:38.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.325+0000 7f28893ab640 1 -- 172.21.15.132:0/1200386195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840cf790 msgr2=0x7f28840cfc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:38.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.325+0000 7f28893ab640 1 --2- 172.21.15.132:0/1200386195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840cf790 0x7f28840cfc40 secure :-1 s=READY pgs=1340 cs=0 l=1 rev1=1 crypto rx=0x7f286c0097a0 tx=0x7f286c02b710 comp rx=0 tx=0).stop 2023-12-20T04:48:38.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.325+0000 7f28893ab640 1 -- 172.21.15.132:0/1200386195 shutdown_connections 2023-12-20T04:48:38.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.325+0000 7f28893ab640 1 --2- 172.21.15.132:0/1200386195 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f28840b6080 0x7f28840b64b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:38.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.325+0000 7f28893ab640 1 --2- 172.21.15.132:0/1200386195 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840cf790 0x7f28840cfc40 unknown :-1 s=CLOSED pgs=1340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:38.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.325+0000 7f28893ab640 1 -- 172.21.15.132:0/1200386195 >> 172.21.15.132:0/1200386195 conn(0x7f288406a3d0 msgr2=0x7f288406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:38.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.325+0000 7f28893ab640 1 -- 172.21.15.132:0/1200386195 shutdown_connections 2023-12-20T04:48:38.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.325+0000 7f28893ab640 1 -- 172.21.15.132:0/1200386195 wait complete. 2023-12-20T04:48:38.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.327+0000 7f28893ab640 1 Processor -- start 2023-12-20T04:48:38.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.327+0000 7f28893ab640 1 -- start start 2023-12-20T04:48:38.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.327+0000 7f28893ab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28840b6080 0x7f28841471b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:38.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.327+0000 7f28893ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840cf790 0x7f28840cc230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:38.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.327+0000 7f28893ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288415d300 0x7f28840c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:38.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.327+0000 7f28893ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28841476f0 con 0x7f28840cf790 2023-12-20T04:48:38.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.327+0000 7f28893ab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28840c9f40 con 0x7f28840b6080 2023-12-20T04:48:38.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.327+0000 7f28893ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f28840ccc10 con 0x7f288415d300 2023-12-20T04:48:38.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.327+0000 7f287bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840cf790 0x7f28840cc230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:38.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.327+0000 7f287bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840cf790 0x7f28840cc230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52648/0 (socket says 172.21.15.132:52648) 2023-12-20T04:48:38.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.327+0000 7f287bfff640 1 -- 172.21.15.132:0/2309386233 learned_addr learned my addr 172.21.15.132:0/2309386233 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:38.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.328+0000 7f28837fe640 1 --2- 172.21.15.132:0/2309386233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288415d300 0x7f28840c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:38.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.328+0000 7f287bfff640 1 -- 172.21.15.132:0/2309386233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288415d300 msgr2=0x7f28840c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:38.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.328+0000 7f2882ffd640 1 --2- 172.21.15.132:0/2309386233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28840b6080 0x7f28841471b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:38.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.328+0000 7f287bfff640 1 --2- 172.21.15.132:0/2309386233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288415d300 0x7f28840c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:38.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.328+0000 7f287bfff640 1 -- 172.21.15.132:0/2309386233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28840b6080 msgr2=0x7f28841471b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:38.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.328+0000 7f287bfff640 1 --2- 172.21.15.132:0/2309386233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28840b6080 0x7f28841471b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:38.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.328+0000 7f287bfff640 1 -- 172.21.15.132:0/2309386233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f286c009400 con 0x7f28840cf790 2023-12-20T04:48:38.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.328+0000 7f28837fe640 1 --2- 172.21.15.132:0/2309386233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288415d300 0x7f28840c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:38.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.328+0000 7f2882ffd640 1 --2- 172.21.15.132:0/2309386233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28840b6080 0x7f28841471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:38.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.328+0000 7f287bfff640 1 --2- 172.21.15.132:0/2309386233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840cf790 0x7f28840cc230 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f286c0097a0 tx=0x7f286c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:38.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.328+0000 7f287b7fe640 1 -- 172.21.15.132:0/2309386233 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c032910 con 0x7f28840cf790 2023-12-20T04:48:38.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.328+0000 7f287b7fe640 1 -- 172.21.15.132:0/2309386233 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f286c032a70 con 0x7f28840cf790 2023-12-20T04:48:38.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.328+0000 7f28893ab640 1 -- 172.21.15.132:0/2309386233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28840ca190 con 0x7f28840cf790 2023-12-20T04:48:38.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.328+0000 7f287b7fe640 1 -- 172.21.15.132:0/2309386233 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f286c032e20 con 0x7f28840cf790 2023-12-20T04:48:38.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.328+0000 7f28893ab640 1 -- 172.21.15.132:0/2309386233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28840ca750 con 0x7f28840cf790 2023-12-20T04:48:38.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.329+0000 7f28893ab640 1 -- 172.21.15.132:0/2309386233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f288404e840 con 0x7f28840cf790 2023-12-20T04:48:38.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.330+0000 7f287b7fe640 1 -- 172.21.15.132:0/2309386233 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f286c039040 con 0x7f28840cf790 2023-12-20T04:48:38.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.330+0000 7f287b7fe640 1 --2- 172.21.15.132:0/2309386233 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f286406a430 0x7f286406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:38.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.330+0000 7f287b7fe640 1 -- 172.21.15.132:0/2309386233 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f286c0aa770 con 0x7f28840cf790 2023-12-20T04:48:38.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.330+0000 7f2882ffd640 1 --2- 172.21.15.132:0/2309386233 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f286406a430 0x7f286406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:38.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.330+0000 7f2882ffd640 1 --2- 172.21.15.132:0/2309386233 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f286406a430 0x7f286406c8f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2874000f60 tx=0x7f2874009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:38.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.334+0000 7f287b7fe640 1 -- 172.21.15.132:0/2309386233 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f286c075e80 con 0x7f28840cf790 2023-12-20T04:48:38.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:38.537+0000 7f28893ab640 1 -- 172.21.15.132:0/2309386233 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f28840b76e0 con 0x7f28840cf790 2023-12-20T04:48:39.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.209+0000 7f287b7fe640 1 -- 172.21.15.132:0/2309386233 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v51) v1 ==== 122+0+0 (secure 0 0 0) 0x7f286c0370c0 con 0x7f28840cf790 2023-12-20T04:48:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.211+0000 7f28893ab640 1 -- 172.21.15.132:0/2309386233 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f286406a430 msgr2=0x7f286406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.211+0000 7f28893ab640 1 --2- 172.21.15.132:0/2309386233 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f286406a430 0x7f286406c8f0 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7f2874000f60 tx=0x7f2874009040 comp rx=0 tx=0).stop 2023-12-20T04:48:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.211+0000 7f28893ab640 1 -- 172.21.15.132:0/2309386233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840cf790 msgr2=0x7f28840cc230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.211+0000 7f28893ab640 1 --2- 172.21.15.132:0/2309386233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840cf790 0x7f28840cc230 secure :-1 s=READY pgs=1341 cs=0 l=1 rev1=1 crypto rx=0x7f286c0097a0 tx=0x7f286c0046c0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.211+0000 7f28893ab640 1 -- 172.21.15.132:0/2309386233 shutdown_connections 2023-12-20T04:48:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.211+0000 7f28893ab640 1 --2- 172.21.15.132:0/2309386233 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f286406a430 0x7f286406c8f0 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.212+0000 7f28893ab640 1 --2- 172.21.15.132:0/2309386233 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f288415d300 0x7f28840c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.212+0000 7f28893ab640 1 --2- 172.21.15.132:0/2309386233 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f28840cf790 0x7f28840cc230 unknown :-1 s=CLOSED pgs=1341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.212+0000 7f28893ab640 1 --2- 172.21.15.132:0/2309386233 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f28840b6080 0x7f28841471b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.212+0000 7f28893ab640 1 -- 172.21.15.132:0/2309386233 >> 172.21.15.132:0/2309386233 conn(0x7f288406a3d0 msgr2=0x7f28840b7c00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:39.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.212+0000 7f28893ab640 1 -- 172.21.15.132:0/2309386233 shutdown_connections 2023-12-20T04:48:39.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.212+0000 7f28893ab640 1 -- 172.21.15.132:0/2309386233 wait complete. 2023-12-20T04:48:39.226 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-20T04:48:39.226 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:48:39.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.326+0000 7f88f3f5c640 1 Processor -- start 2023-12-20T04:48:39.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.326+0000 7f88f3f5c640 1 -- start start 2023-12-20T04:48:39.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.327+0000 7f88f3f5c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f88ec0d0370 0x7f88ec0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.327+0000 7f88f3f5c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ec0b2f90 con 0x7f88ec15d100 2023-12-20T04:48:39.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.327+0000 7f88f3f5c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f88ec1613c0 con 0x7f88ec0cdc10 2023-12-20T04:48:39.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.327+0000 7f88f3f5c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f88ec0d1b00 con 0x7f88ec0d0370 2023-12-20T04:48:39.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.327+0000 7f88f1cf8640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f88ec15d100 0x7f88ec0cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47726/0 (socket says 172.21.15.132:47726) 2023-12-20T04:48:39.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.327+0000 7f88f1cf8640 1 -- 172.21.15.132:0/3251838569 learned_addr learned my addr 172.21.15.132:0/3251838569 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:39.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.327+0000 7f88f0cf6640 1 -- 172.21.15.132:0/3251838569 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1653358958 0 0) 0x7f88e8001490 con 0x7f88ec15d100 2023-12-20T04:48:39.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f14f7640 1 --2- 172.21.15.132:0/3251838569 >> v2:172.21.15.187:3300/0 conn(0x7f88ec0d0370 0x7f88ec0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f0cf6640 1 -- 172.21.15.132:0/3251838569 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f88d8003520 con 0x7f88ec15d100 2023-12-20T04:48:39.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f0cf6640 1 -- 172.21.15.132:0/3251838569 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 836846202 0 0) 0x7f88d8003520 con 0x7f88ec15d100 2023-12-20T04:48:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f0cf6640 1 -- 172.21.15.132:0/3251838569 >> v2:172.21.15.187:3300/0 conn(0x7f88ec0d0370 msgr2=0x7f88ec0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f0cf6640 1 --2- 172.21.15.132:0/3251838569 >> v2:172.21.15.187:3300/0 conn(0x7f88ec0d0370 0x7f88ec0b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f0cf6640 1 -- 172.21.15.132:0/3251838569 >> v1:172.21.15.187:6789/0 conn(0x7f88ec0cdc10 legacy=0x7f88ec06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f0cf6640 1 -- 172.21.15.132:0/3251838569 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec0d0810 con 0x7f88ec15d100 2023-12-20T04:48:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f0cf6640 1 -- 172.21.15.132:0/3251838569 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f88e8001b80 con 0x7f88ec15d100 2023-12-20T04:48:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f0cf6640 1 -- 172.21.15.132:0/3251838569 >> v1:172.21.15.132:6789/0 conn(0x7f88ec15d100 legacy=0x7f88ec0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f0cf6640 1 --2- 172.21.15.132:0/3251838569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88d8003970 0x7f88d8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f0cf6640 1 --2- 172.21.15.132:0/3251838569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88d80047c0 0x7f88d8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f0cf6640 1 --2- 172.21.15.132:0/3251838569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88d8005180 0x7f88d800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f0cf6640 1 -- 172.21.15.132:0/3251838569 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0d1b00 con 0x7f88d8003970 2023-12-20T04:48:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f0cf6640 1 -- 172.21.15.132:0/3251838569 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88d800c020 con 0x7f88d80047c0 2023-12-20T04:48:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f0cf6640 1 -- 172.21.15.132:0/3251838569 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88d800c1e0 con 0x7f88d8005180 2023-12-20T04:48:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f1cf8640 1 --2- 172.21.15.132:0/3251838569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88d8003970 0x7f88d8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f14f7640 1 --2- 172.21.15.132:0/3251838569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88d80047c0 0x7f88d8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f24f9640 1 --2- 172.21.15.132:0/3251838569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88d8005180 0x7f88d800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f1cf8640 1 -- 172.21.15.132:0/3251838569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88d8005180 msgr2=0x7f88d800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:39.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f1cf8640 1 --2- 172.21.15.132:0/3251838569 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88d8005180 0x7f88d800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f1cf8640 1 -- 172.21.15.132:0/3251838569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88d80047c0 msgr2=0x7f88d8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:39.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f1cf8640 1 --2- 172.21.15.132:0/3251838569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88d80047c0 0x7f88d8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f1cf8640 1 -- 172.21.15.132:0/3251838569 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88d8003520 con 0x7f88d8003970 2023-12-20T04:48:39.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f24f9640 1 -- 172.21.15.132:0/3251838569 reap_dead start 2023-12-20T04:48:39.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.328+0000 7f88f14f7640 1 --2- 172.21.15.132:0/3251838569 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88d80047c0 0x7f88d8004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:39.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.329+0000 7f88f1cf8640 1 --2- 172.21.15.132:0/3251838569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88d8003970 0x7f88d8003d90 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f88e800a830 tx=0x7f88d80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cf344fd029f9e727 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:39.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.329+0000 7f88f0cf6640 1 -- 172.21.15.132:0/3251838569 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8034630 con 0x7f88d8003970 2023-12-20T04:48:39.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.329+0000 7f88f0cf6640 1 -- 172.21.15.132:0/3251838569 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88e802f070 con 0x7f88d8003970 2023-12-20T04:48:39.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.329+0000 7f88f0cf6640 1 -- 172.21.15.132:0/3251838569 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88e8034a30 con 0x7f88d8003970 2023-12-20T04:48:39.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.330+0000 7f88f3f5c640 1 -- 172.21.15.132:0/3251838569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88d8003970 msgr2=0x7f88d8003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.330+0000 7f88f3f5c640 1 --2- 172.21.15.132:0/3251838569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88d8003970 0x7f88d8003d90 secure :-1 s=READY pgs=1343 cs=0 l=1 rev1=1 crypto rx=0x7f88e800a830 tx=0x7f88d80057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.330+0000 7f88f3f5c640 1 -- 172.21.15.132:0/3251838569 shutdown_connections 2023-12-20T04:48:39.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.330+0000 7f88f3f5c640 1 --2- 172.21.15.132:0/3251838569 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88d8003970 0x7f88d8003d90 unknown :-1 s=CLOSED pgs=1343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.330+0000 7f88f3f5c640 1 -- 172.21.15.132:0/3251838569 >> 172.21.15.132:0/3251838569 conn(0x7f88ec06d7c0 msgr2=0x7f88ec06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:39.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.330+0000 7f88f3f5c640 1 -- 172.21.15.132:0/3251838569 shutdown_connections 2023-12-20T04:48:39.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.330+0000 7f88f3f5c640 1 -- 172.21.15.132:0/3251838569 wait complete. 2023-12-20T04:48:39.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.331+0000 7f88f3f5c640 1 Processor -- start 2023-12-20T04:48:39.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.331+0000 7f88f3f5c640 1 -- start start 2023-12-20T04:48:39.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.331+0000 7f88f3f5c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88d8003970 0x7f88ec0c37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.331+0000 7f88f3f5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88ec155130 0x7f88ec1555b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.331+0000 7f88f3f5c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88ec0b4ad0 0x7f88ec0b4f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88f3f5c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec159d50 con 0x7f88ec155130 2023-12-20T04:48:39.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88f3f5c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec155af0 con 0x7f88ec0b4ad0 2023-12-20T04:48:39.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88f3f5c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f88ec0b5840 con 0x7f88d8003970 2023-12-20T04:48:39.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88f14f7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88ec155130 0x7f88ec1555b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88f14f7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88ec155130 0x7f88ec1555b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52678/0 (socket says 172.21.15.132:52678) 2023-12-20T04:48:39.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88f14f7640 1 -- 172.21.15.132:0/309817782 learned_addr learned my addr 172.21.15.132:0/309817782 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:39.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88f1cf8640 1 --2- 172.21.15.132:0/309817782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88d8003970 0x7f88ec0c37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88f14f7640 1 -- 172.21.15.132:0/309817782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88d8003970 msgr2=0x7f88ec0c37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88f14f7640 1 --2- 172.21.15.132:0/309817782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88d8003970 0x7f88ec0c37f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88f14f7640 1 -- 172.21.15.132:0/309817782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88ec0b4ad0 msgr2=0x7f88ec0b4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88f14f7640 1 --2- 172.21.15.132:0/309817782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88ec0b4ad0 0x7f88ec0b4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88f14f7640 1 -- 172.21.15.132:0/309817782 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec1593b0 con 0x7f88ec155130 2023-12-20T04:48:39.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88f1cf8640 1 --2- 172.21.15.132:0/309817782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88d8003970 0x7f88ec0c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:39.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88f14f7640 1 --2- 172.21.15.132:0/309817782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88ec155130 0x7f88ec1555b0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0114e0 tx=0x7f88dc0119a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:39.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88e27fc640 1 -- 172.21.15.132:0/309817782 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc015870 con 0x7f88ec155130 2023-12-20T04:48:39.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88e27fc640 1 -- 172.21.15.132:0/309817782 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f88dc0159d0 con 0x7f88ec155130 2023-12-20T04:48:39.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88f3f5c640 1 -- 172.21.15.132:0/309817782 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88ec159690 con 0x7f88ec155130 2023-12-20T04:48:39.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88e27fc640 1 -- 172.21.15.132:0/309817782 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f88dc015d80 con 0x7f88ec155130 2023-12-20T04:48:39.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.332+0000 7f88f3f5c640 1 -- 172.21.15.132:0/309817782 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88ec0c3d30 con 0x7f88ec155130 2023-12-20T04:48:39.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.333+0000 7f88f3f5c640 1 -- 172.21.15.132:0/309817782 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88ec159fc0 con 0x7f88ec155130 2023-12-20T04:48:39.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.334+0000 7f88e27fc640 1 -- 172.21.15.132:0/309817782 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f88dc01d400 con 0x7f88ec155130 2023-12-20T04:48:39.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.334+0000 7f88e27fc640 1 --2- 172.21.15.132:0/309817782 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f88d006a430 0x7f88d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.334+0000 7f88e27fc640 1 -- 172.21.15.132:0/309817782 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f88dc088f50 con 0x7f88ec155130 2023-12-20T04:48:39.338 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.334+0000 7f88f1cf8640 1 --2- 172.21.15.132:0/309817782 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f88d006a430 0x7f88d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.335+0000 7f88f1cf8640 1 --2- 172.21.15.132:0/309817782 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f88d006a430 0x7f88d006c8f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f88e8034000 tx=0x7f88e802f000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:39.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.338+0000 7f88e27fc640 1 -- 172.21.15.132:0/309817782 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f88dc0545d0 con 0x7f88ec155130 2023-12-20T04:48:39.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.536+0000 7f88f3f5c640 1 -- 172.21.15.132:0/309817782 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f88ec0ceb90 con 0x7f88ec155130 2023-12-20T04:48:39.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.536+0000 7f88e27fc640 1 -- 172.21.15.132:0/309817782 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f88dc057bf0 con 0x7f88ec155130 2023-12-20T04:48:39.538 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:39.538 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6763,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1413044191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1413044191},{"type":"v1","addr":"172.21.15.132:6837","nonce":1413044191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1584197959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1584197959},{"type":"v1","addr":"172.21.15.187:6834","nonce":1584197959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":7830,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/3080885824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3080885824},{"type":"v1","addr":"172.21.15.132:6836","nonce":3080885824}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:48:37.200402+0000","modified":"2023-12-20T04:48:39.207037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"d","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/1483131498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":1483131498},{"type":"v1","addr":"172.21.15.187:6835","nonce":1483131498}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-20T04:48:39.538 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 51 2023-12-20T04:48:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.538+0000 7f88f3f5c640 1 -- 172.21.15.132:0/309817782 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f88d006a430 msgr2=0x7f88d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.538+0000 7f88f3f5c640 1 --2- 172.21.15.132:0/309817782 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f88d006a430 0x7f88d006c8f0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f88e8034000 tx=0x7f88e802f000 comp rx=0 tx=0).stop 2023-12-20T04:48:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.538+0000 7f88f3f5c640 1 -- 172.21.15.132:0/309817782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88ec155130 msgr2=0x7f88ec1555b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.538+0000 7f88f3f5c640 1 --2- 172.21.15.132:0/309817782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88ec155130 0x7f88ec1555b0 secure :-1 s=READY pgs=1344 cs=0 l=1 rev1=1 crypto rx=0x7f88dc0114e0 tx=0x7f88dc0119a0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.538+0000 7f88f3f5c640 1 -- 172.21.15.132:0/309817782 shutdown_connections 2023-12-20T04:48:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.538+0000 7f88f3f5c640 1 --2- 172.21.15.132:0/309817782 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f88d006a430 0x7f88d006c8f0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.538+0000 7f88f3f5c640 1 --2- 172.21.15.132:0/309817782 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f88ec0b4ad0 0x7f88ec0b4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.538+0000 7f88f3f5c640 1 --2- 172.21.15.132:0/309817782 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f88ec155130 0x7f88ec1555b0 unknown :-1 s=CLOSED pgs=1344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.538+0000 7f88f3f5c640 1 --2- 172.21.15.132:0/309817782 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f88d8003970 0x7f88ec0c37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.538+0000 7f88f3f5c640 1 -- 172.21.15.132:0/309817782 >> 172.21.15.132:0/309817782 conn(0x7f88ec06d7c0 msgr2=0x7f88ec15b760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.539+0000 7f88f3f5c640 1 -- 172.21.15.132:0/309817782 shutdown_connections 2023-12-20T04:48:39.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.539+0000 7f88f3f5c640 1 -- 172.21.15.132:0/309817782 wait complete. 2023-12-20T04:48:39.551 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:48:39.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.649+0000 7f0c42470640 1 Processor -- start 2023-12-20T04:48:39.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.649+0000 7f0c42470640 1 -- start start 2023-12-20T04:48:39.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.650+0000 7f0c42470640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0c3c15e530 0x7f0c3c06fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.650+0000 7f0c42470640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0c3c06c240 0x7f0c3c06c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.650+0000 7f0c42470640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0c3c0ccf30 con 0x7f0c3c159b50 2023-12-20T04:48:39.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.650+0000 7f0c42470640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c06cc10 con 0x7f0c3c15e530 2023-12-20T04:48:39.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.650+0000 7f0c42470640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0c3c0caa60 con 0x7f0c3c06c240 2023-12-20T04:48:39.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.650+0000 7f0c3bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0c3c159b50 0x7f0c3c0c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47742/0 (socket says 172.21.15.132:47742) 2023-12-20T04:48:39.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.650+0000 7f0c3bfff640 1 -- 172.21.15.132:0/1767554737 learned_addr learned my addr 172.21.15.132:0/1767554737 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:39.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.650+0000 7f0c3b7fe640 1 --2- 172.21.15.132:0/1767554737 >> v2:172.21.15.132:3300/0 conn(0x7f0c3c15e530 0x7f0c3c06fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.650+0000 7f0c40a0d640 1 --2- 172.21.15.132:0/1767554737 >> v2:172.21.15.187:3300/0 conn(0x7f0c3c06c240 0x7f0c3c06c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.650+0000 7f0c3affd640 1 -- 172.21.15.132:0/1767554737 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3359403127 0 0) 0x7f0c3c0ccf30 con 0x7f0c3c159b50 2023-12-20T04:48:39.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.650+0000 7f0c3affd640 1 -- 172.21.15.132:0/1767554737 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0c24003520 con 0x7f0c3c159b50 2023-12-20T04:48:39.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.650+0000 7f0c3b7fe640 1 -- 172.21.15.132:0/1767554737 >> v2:172.21.15.187:3300/0 conn(0x7f0c3c06c240 msgr2=0x7f0c3c06c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:39.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.650+0000 7f0c3b7fe640 1 --2- 172.21.15.132:0/1767554737 >> v2:172.21.15.187:3300/0 conn(0x7f0c3c06c240 0x7f0c3c06c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.650+0000 7f0c3b7fe640 1 -- 172.21.15.132:0/1767554737 >> v1:172.21.15.132:6789/0 conn(0x7f0c3c159b50 legacy=0x7f0c3c0c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.650+0000 7f0c3b7fe640 1 -- 172.21.15.132:0/1767554737 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c3c0ca1c0 con 0x7f0c3c15e530 2023-12-20T04:48:39.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.650+0000 7f0c40a0d640 1 --2- 172.21.15.132:0/1767554737 >> v2:172.21.15.187:3300/0 conn(0x7f0c3c06c240 0x7f0c3c06c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:39.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.651+0000 7f0c3b7fe640 1 --2- 172.21.15.132:0/1767554737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c3c15e530 0x7f0c3c06fd70 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f0c300097a0 tx=0x7f0c3002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=910c35e3ad1d5e96 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:39.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.651+0000 7f0c3affd640 1 -- 172.21.15.132:0/1767554737 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30031830 con 0x7f0c3c15e530 2023-12-20T04:48:39.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.651+0000 7f0c3affd640 1 -- 172.21.15.132:0/1767554737 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c30031990 con 0x7f0c3c15e530 2023-12-20T04:48:39.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.651+0000 7f0c3affd640 1 -- 172.21.15.132:0/1767554737 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c30031d20 con 0x7f0c3c15e530 2023-12-20T04:48:39.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.652+0000 7f0c42470640 1 -- 172.21.15.132:0/1767554737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c3c15e530 msgr2=0x7f0c3c06fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.652+0000 7f0c42470640 1 --2- 172.21.15.132:0/1767554737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c3c15e530 0x7f0c3c06fd70 secure :-1 s=READY pgs=1346 cs=0 l=1 rev1=1 crypto rx=0x7f0c300097a0 tx=0x7f0c3002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.652+0000 7f0c42470640 1 -- 172.21.15.132:0/1767554737 shutdown_connections 2023-12-20T04:48:39.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.652+0000 7f0c42470640 1 --2- 172.21.15.132:0/1767554737 >> v2:172.21.15.187:3300/0 conn(0x7f0c3c06c240 0x7f0c3c06c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.652+0000 7f0c42470640 1 --2- 172.21.15.132:0/1767554737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c3c15e530 0x7f0c3c06fd70 unknown :-1 s=CLOSED pgs=1346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.652+0000 7f0c42470640 1 -- 172.21.15.132:0/1767554737 >> 172.21.15.132:0/1767554737 conn(0x7f0c3c0ced10 msgr2=0x7f0c3c0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:39.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.652+0000 7f0c42470640 1 -- 172.21.15.132:0/1767554737 shutdown_connections 2023-12-20T04:48:39.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.652+0000 7f0c42470640 1 -- 172.21.15.132:0/1767554737 wait complete. 2023-12-20T04:48:39.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.653+0000 7f0c42470640 1 Processor -- start 2023-12-20T04:48:39.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.653+0000 7f0c42470640 1 -- start start 2023-12-20T04:48:39.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c42470640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c3c06c240 0x7f0c3c0c4870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c42470640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c3c159b50 0x7f0c3c159f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c42470640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c3c15e530 0x7f0c3c14f5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c42470640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c146db0 con 0x7f0c3c159b50 2023-12-20T04:48:39.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c42470640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c15a470 con 0x7f0c3c06c240 2023-12-20T04:48:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c42470640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0c3c146230 con 0x7f0c3c15e530 2023-12-20T04:48:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c3b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c3c159b50 0x7f0c3c159f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c3b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c3c159b50 0x7f0c3c159f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52698/0 (socket says 172.21.15.132:52698) 2023-12-20T04:48:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c3b7fe640 1 -- 172.21.15.132:0/3453114235 learned_addr learned my addr 172.21.15.132:0/3453114235 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c40a0d640 1 --2- 172.21.15.132:0/3453114235 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c3c15e530 0x7f0c3c14f5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c3b7fe640 1 -- 172.21.15.132:0/3453114235 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c3c15e530 msgr2=0x7f0c3c14f5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c3b7fe640 1 --2- 172.21.15.132:0/3453114235 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c3c15e530 0x7f0c3c14f5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c3b7fe640 1 -- 172.21.15.132:0/3453114235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c3c06c240 msgr2=0x7f0c3c0c4870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c3bfff640 1 --2- 172.21.15.132:0/3453114235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c3c06c240 0x7f0c3c0c4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c3b7fe640 1 --2- 172.21.15.132:0/3453114235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c3c06c240 0x7f0c3c0c4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c3b7fe640 1 -- 172.21.15.132:0/3453114235 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0c30009400 con 0x7f0c3c159b50 2023-12-20T04:48:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c3b7fe640 1 --2- 172.21.15.132:0/3453114235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c3c159b50 0x7f0c3c159f30 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f0c300098c0 tx=0x7f0c300046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.654+0000 7f0c38ff9640 1 -- 172.21.15.132:0/3453114235 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3003a630 con 0x7f0c3c159b50 2023-12-20T04:48:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.655+0000 7f0c38ff9640 1 -- 172.21.15.132:0/3453114235 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0c3003a7d0 con 0x7f0c3c159b50 2023-12-20T04:48:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.655+0000 7f0c42470640 1 -- 172.21.15.132:0/3453114235 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0c3c146510 con 0x7f0c3c159b50 2023-12-20T04:48:39.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.655+0000 7f0c38ff9640 1 -- 172.21.15.132:0/3453114235 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0c3003ab80 con 0x7f0c3c159b50 2023-12-20T04:48:39.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.655+0000 7f0c42470640 1 -- 172.21.15.132:0/3453114235 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0c3c146ad0 con 0x7f0c3c159b50 2023-12-20T04:48:39.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.655+0000 7f0c42470640 1 -- 172.21.15.132:0/3453114235 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0c3c04e840 con 0x7f0c3c159b50 2023-12-20T04:48:39.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.656+0000 7f0c38ff9640 1 -- 172.21.15.132:0/3453114235 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0c3003ace0 con 0x7f0c3c159b50 2023-12-20T04:48:39.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.656+0000 7f0c38ff9640 1 --2- 172.21.15.132:0/3453114235 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0c2806a430 0x7f0c2806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.656+0000 7f0c3bfff640 1 --2- 172.21.15.132:0/3453114235 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0c2806a430 0x7f0c2806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.657+0000 7f0c38ff9640 1 -- 172.21.15.132:0/3453114235 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0c300aa570 con 0x7f0c3c159b50 2023-12-20T04:48:39.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.657+0000 7f0c3bfff640 1 --2- 172.21.15.132:0/3453114235 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0c2806a430 0x7f0c2806c8f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0011e0 tx=0x7f0c2c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:39.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.661+0000 7f0c38ff9640 1 -- 172.21.15.132:0/3453114235 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0c30075bf0 con 0x7f0c3c159b50 2023-12-20T04:48:39.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.827+0000 7f0c42470640 1 -- 172.21.15.132:0/3453114235 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0c3c0b4c90 con 0x7f0c3c159b50 2023-12-20T04:48:39.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.828+0000 7f0c38ff9640 1 -- 172.21.15.132:0/3453114235 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v137) v1 ==== 74+0+16108 (secure 0 0 0) 0x7f0c30044e60 con 0x7f0c3c159b50 2023-12-20T04:48:39.830 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:39.830 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":137,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:48:38.201865+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:48:35.008751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-20T04:48:36.182609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"137","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:48:39.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.830+0000 7f0c42470640 1 -- 172.21.15.132:0/3453114235 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0c2806a430 msgr2=0x7f0c2806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.830+0000 7f0c42470640 1 --2- 172.21.15.132:0/3453114235 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0c2806a430 0x7f0c2806c8f0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c0011e0 tx=0x7f0c2c009040 comp rx=0 tx=0).stop 2023-12-20T04:48:39.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.830+0000 7f0c42470640 1 -- 172.21.15.132:0/3453114235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c3c159b50 msgr2=0x7f0c3c159f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.830+0000 7f0c42470640 1 --2- 172.21.15.132:0/3453114235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c3c159b50 0x7f0c3c159f30 secure :-1 s=READY pgs=1347 cs=0 l=1 rev1=1 crypto rx=0x7f0c300098c0 tx=0x7f0c300046c0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.830+0000 7f0c42470640 1 -- 172.21.15.132:0/3453114235 shutdown_connections 2023-12-20T04:48:39.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.830+0000 7f0c42470640 1 --2- 172.21.15.132:0/3453114235 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0c2806a430 0x7f0c2806c8f0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.830+0000 7f0c42470640 1 --2- 172.21.15.132:0/3453114235 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0c3c15e530 0x7f0c3c14f5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.830+0000 7f0c42470640 1 --2- 172.21.15.132:0/3453114235 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0c3c159b50 0x7f0c3c159f30 unknown :-1 s=CLOSED pgs=1347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.830+0000 7f0c42470640 1 --2- 172.21.15.132:0/3453114235 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0c3c06c240 0x7f0c3c0c4870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.830+0000 7f0c42470640 1 -- 172.21.15.132:0/3453114235 >> 172.21.15.132:0/3453114235 conn(0x7f0c3c0ced10 msgr2=0x7f0c3c0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:39.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.830+0000 7f0c42470640 1 -- 172.21.15.132:0/3453114235 shutdown_connections 2023-12-20T04:48:39.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.830+0000 7f0c42470640 1 -- 172.21.15.132:0/3453114235 wait complete. 2023-12-20T04:48:39.843 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-20T04:48:39.843 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:48:39.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.941+0000 7f4b1c277640 1 Processor -- start 2023-12-20T04:48:39.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.941+0000 7f4b1c277640 1 -- start start 2023-12-20T04:48:39.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.942+0000 7f4b1c277640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4b14160450 0x7f4b14160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.942+0000 7f4b1c277640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4b140b5090 0x7f4b140d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.942+0000 7f4b1c277640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b140b5ec0 con 0x7f4b141611b0 2023-12-20T04:48:39.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.942+0000 7f4b1c277640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b141617e0 con 0x7f4b140b5090 2023-12-20T04:48:39.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.942+0000 7f4b1c277640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b140d0fc0 con 0x7f4b14160450 2023-12-20T04:48:39.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.943+0000 7f4b1a814640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4b140b5090 0x7f4b140d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.943+0000 7f4b19812640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4b141611b0 0x7f4b140b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47746/0 (socket says 172.21.15.132:47746) 2023-12-20T04:48:39.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.943+0000 7f4b19812640 1 -- 172.21.15.132:0/2509685579 learned_addr learned my addr 172.21.15.132:0/2509685579 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:39.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.943+0000 7f4b1a013640 1 --2- 172.21.15.132:0/2509685579 >> v2:172.21.15.187:3300/0 conn(0x7f4b14160450 0x7f4b14160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.943+0000 7f4b1a814640 1 -- 172.21.15.132:0/2509685579 >> v2:172.21.15.187:3300/0 conn(0x7f4b14160450 msgr2=0x7f4b14160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:39.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.943+0000 7f4b1a814640 1 --2- 172.21.15.132:0/2509685579 >> v2:172.21.15.187:3300/0 conn(0x7f4b14160450 0x7f4b14160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.943+0000 7f4b1a814640 1 -- 172.21.15.132:0/2509685579 >> v1:172.21.15.132:6789/0 conn(0x7f4b141611b0 legacy=0x7f4b140b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.943+0000 7f4b1a814640 1 -- 172.21.15.132:0/2509685579 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b140d12a0 con 0x7f4b140b5090 2023-12-20T04:48:39.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.943+0000 7f4b19011640 1 -- 172.21.15.132:0/2509685579 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1570085404 0 0) 0x7f4b140b5ec0 con 0x7f4b141611b0 2023-12-20T04:48:39.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.944+0000 7f4b1a814640 1 --2- 172.21.15.132:0/2509685579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b140b5090 0x7f4b140d1aa0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f4b1408b150 tx=0x7f4b0c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7d08f8e3bc1e25f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:39.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.944+0000 7f4b19011640 1 -- 172.21.15.132:0/2509685579 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c02cd00 con 0x7f4b140b5090 2023-12-20T04:48:39.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.944+0000 7f4b19011640 1 -- 172.21.15.132:0/2509685579 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c02ce60 con 0x7f4b140b5090 2023-12-20T04:48:39.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.944+0000 7f4b19011640 1 -- 172.21.15.132:0/2509685579 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c034660 con 0x7f4b140b5090 2023-12-20T04:48:39.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.944+0000 7f4b1c277640 1 -- 172.21.15.132:0/2509685579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b140b5090 msgr2=0x7f4b140d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.944+0000 7f4b1c277640 1 --2- 172.21.15.132:0/2509685579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b140b5090 0x7f4b140d1aa0 secure :-1 s=READY pgs=1349 cs=0 l=1 rev1=1 crypto rx=0x7f4b1408b150 tx=0x7f4b0c02bf50 comp rx=0 tx=0).stop 2023-12-20T04:48:39.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.944+0000 7f4b1c277640 1 -- 172.21.15.132:0/2509685579 shutdown_connections 2023-12-20T04:48:39.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.944+0000 7f4b1c277640 1 --2- 172.21.15.132:0/2509685579 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b140b5090 0x7f4b140d1aa0 unknown :-1 s=CLOSED pgs=1349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.944+0000 7f4b1c277640 1 --2- 172.21.15.132:0/2509685579 >> v2:172.21.15.187:3300/0 conn(0x7f4b14160450 0x7f4b14160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.944+0000 7f4b1c277640 1 -- 172.21.15.132:0/2509685579 >> 172.21.15.132:0/2509685579 conn(0x7f4b140cf980 msgr2=0x7f4b140cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:39.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.944+0000 7f4b1c277640 1 -- 172.21.15.132:0/2509685579 shutdown_connections 2023-12-20T04:48:39.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.944+0000 7f4b1c277640 1 -- 172.21.15.132:0/2509685579 wait complete. 2023-12-20T04:48:39.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.946+0000 7f4b1c277640 1 Processor -- start 2023-12-20T04:48:39.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.946+0000 7f4b1c277640 1 -- start start 2023-12-20T04:48:39.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.946+0000 7f4b1c277640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b140b5090 0x7f4b140ca710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.946+0000 7f4b1c277640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b14160450 0x7f4b141f32d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.946+0000 7f4b1c277640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b141611b0 0x7f4b140b6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.946+0000 7f4b1c277640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b140cae10 con 0x7f4b141611b0 2023-12-20T04:48:39.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.946+0000 7f4b1c277640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b140cb0f0 con 0x7f4b14160450 2023-12-20T04:48:39.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.946+0000 7f4b1c277640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b140cb3d0 con 0x7f4b140b5090 2023-12-20T04:48:39.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.946+0000 7f4b1a814640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b141611b0 0x7f4b140b6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.946+0000 7f4b1a814640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b141611b0 0x7f4b140b6330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52710/0 (socket says 172.21.15.132:52710) 2023-12-20T04:48:39.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.946+0000 7f4b1a814640 1 -- 172.21.15.132:0/2565048278 learned_addr learned my addr 172.21.15.132:0/2565048278 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:39.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.947+0000 7f4b1a013640 1 --2- 172.21.15.132:0/2565048278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b140b5090 0x7f4b140ca710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.947+0000 7f4b19812640 1 --2- 172.21.15.132:0/2565048278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b14160450 0x7f4b141f32d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.947+0000 7f4b1a814640 1 -- 172.21.15.132:0/2565048278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b140b5090 msgr2=0x7f4b140ca710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.947+0000 7f4b1a814640 1 --2- 172.21.15.132:0/2565048278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b140b5090 0x7f4b140ca710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.947+0000 7f4b1a814640 1 -- 172.21.15.132:0/2565048278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b14160450 msgr2=0x7f4b141f32d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:39.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.947+0000 7f4b1a814640 1 --2- 172.21.15.132:0/2565048278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b14160450 0x7f4b141f32d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:39.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.947+0000 7f4b1a814640 1 -- 172.21.15.132:0/2565048278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b0c009a70 con 0x7f4b141611b0 2023-12-20T04:48:39.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.947+0000 7f4b19812640 1 --2- 172.21.15.132:0/2565048278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b14160450 0x7f4b141f32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:39.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.947+0000 7f4b1a814640 1 --2- 172.21.15.132:0/2565048278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b141611b0 0x7f4b140b6330 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009e80 tx=0x7f4b0c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:39.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.947+0000 7f4b0affd640 1 -- 172.21.15.132:0/2565048278 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c003b90 con 0x7f4b141611b0 2023-12-20T04:48:39.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.947+0000 7f4b0affd640 1 -- 172.21.15.132:0/2565048278 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b0c003cf0 con 0x7f4b141611b0 2023-12-20T04:48:39.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.947+0000 7f4b1c277640 1 -- 172.21.15.132:0/2565048278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b140cb6b0 con 0x7f4b141611b0 2023-12-20T04:48:39.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.947+0000 7f4b0affd640 1 -- 172.21.15.132:0/2565048278 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b0c004230 con 0x7f4b141611b0 2023-12-20T04:48:39.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.947+0000 7f4b1c277640 1 -- 172.21.15.132:0/2565048278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b140b6870 con 0x7f4b141611b0 2023-12-20T04:48:39.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.948+0000 7f4b1c277640 1 -- 172.21.15.132:0/2565048278 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b141f39f0 con 0x7f4b141611b0 2023-12-20T04:48:39.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.948+0000 7f4b0affd640 1 -- 172.21.15.132:0/2565048278 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4b0c03b050 con 0x7f4b141611b0 2023-12-20T04:48:39.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.949+0000 7f4b0affd640 1 --2- 172.21.15.132:0/2565048278 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4af806a430 0x7f4af806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:39.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.949+0000 7f4b0affd640 1 -- 172.21.15.132:0/2565048278 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b0c0ab080 con 0x7f4b141611b0 2023-12-20T04:48:39.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.949+0000 7f4b1a013640 1 --2- 172.21.15.132:0/2565048278 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4af806a430 0x7f4af806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:39.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.949+0000 7f4b1a013640 1 --2- 172.21.15.132:0/2565048278 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4af806a430 0x7f4af806c8f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4b04006fd0 tx=0x7f4b04008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:39.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:39.953+0000 7f4b0affd640 1 -- 172.21.15.132:0/2565048278 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4b141f39f0 con 0x7f4b141611b0 2023-12-20T04:48:40.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.115+0000 7f4b1c277640 1 -- 172.21.15.132:0/2565048278 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4b140b89d0 con 0x7f4af806a430 2023-12-20T04:48:40.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.122+0000 7f4b0affd640 1 -- 172.21.15.132:0/2565048278 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276447 (secure 0 0 0) 0x7f4b04010990 con 0x7f4af806a430 2023-12-20T04:48:40.127 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:40.128 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:48:40.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.125+0000 7f4b1c277640 1 -- 172.21.15.132:0/2565048278 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4af806a430 msgr2=0x7f4af806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.125+0000 7f4b1c277640 1 --2- 172.21.15.132:0/2565048278 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4af806a430 0x7f4af806c8f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f4b04006fd0 tx=0x7f4b04008040 comp rx=0 tx=0).stop 2023-12-20T04:48:40.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.125+0000 7f4b1c277640 1 -- 172.21.15.132:0/2565048278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b141611b0 msgr2=0x7f4b140b6330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.125+0000 7f4b1c277640 1 --2- 172.21.15.132:0/2565048278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b141611b0 0x7f4b140b6330 secure :-1 s=READY pgs=1350 cs=0 l=1 rev1=1 crypto rx=0x7f4b0c009e80 tx=0x7f4b0c004a40 comp rx=0 tx=0).stop 2023-12-20T04:48:40.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.125+0000 7f4b1c277640 1 -- 172.21.15.132:0/2565048278 shutdown_connections 2023-12-20T04:48:40.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.125+0000 7f4b1c277640 1 --2- 172.21.15.132:0/2565048278 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4af806a430 0x7f4af806c8f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.125+0000 7f4b1c277640 1 --2- 172.21.15.132:0/2565048278 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b141611b0 0x7f4b140b6330 unknown :-1 s=CLOSED pgs=1350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.125+0000 7f4b1c277640 1 --2- 172.21.15.132:0/2565048278 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b14160450 0x7f4b141f32d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.125+0000 7f4b1c277640 1 --2- 172.21.15.132:0/2565048278 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b140b5090 0x7f4b140ca710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.125+0000 7f4b1c277640 1 -- 172.21.15.132:0/2565048278 >> 172.21.15.132:0/2565048278 conn(0x7f4b140cf980 msgr2=0x7f4b14159cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:40.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.125+0000 7f4b1c277640 1 -- 172.21.15.132:0/2565048278 shutdown_connections 2023-12-20T04:48:40.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.125+0000 7f4b1c277640 1 -- 172.21.15.132:0/2565048278 wait complete. 2023-12-20T04:48:40.138 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":310,"stamp":"2023-12-20T04:48:38.203999+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6887,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555612,"statfs":{"total":1600000000,"available":1592947077,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.038359"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857406+0000","last_change":"2023-12-20T04:48:35.857406+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857406+0000","last_undegraded":"2023-12-20T04:48:35.857406+0000","last_fullsized":"2023-12-20T04:48:35.857406+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:41:26.866774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856154+0000","last_change":"2023-12-20T04:48:35.856154+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856154+0000","last_undegraded":"2023-12-20T04:48:35.856154+0000","last_fullsized":"2023-12-20T04:48:35.856154+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:45:37.758827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858837+0000","last_change":"2023-12-20T04:48:35.858837+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858837+0000","last_undegraded":"2023-12-20T04:48:35.858837+0000","last_fullsized":"2023-12-20T04:48:35.858837+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:59:46.853598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858372+0000","last_change":"2023-12-20T04:48:35.858372+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858372+0000","last_undegraded":"2023-12-20T04:48:35.858372+0000","last_fullsized":"2023-12-20T04:48:35.858372+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:05.361765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858408+0000","last_change":"2023-12-20T04:48:35.858408+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858408+0000","last_undegraded":"2023-12-20T04:48:35.858408+0000","last_fullsized":"2023-12-20T04:48:35.858408+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:38:39.178936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855923+0000","last_change":"2023-12-20T04:48:35.855923+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855923+0000","last_undegraded":"2023-12-20T04:48:35.855923+0000","last_fullsized":"2023-12-20T04:48:35.855923+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:05.495362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858688+0000","last_change":"2023-12-20T04:48:35.858688+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858688+0000","last_undegraded":"2023-12-20T04:48:35.858688+0000","last_fullsized":"2023-12-20T04:48:35.858688+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:45:37.758827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856340+0000","last_change":"2023-12-20T04:48:35.856340+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856340+0000","last_undegraded":"2023-12-20T04:48:35.856340+0000","last_fullsized":"2023-12-20T04:48:35.856340+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:04.225858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857989+0000","last_change":"2023-12-20T04:48:35.857989+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857989+0000","last_undegraded":"2023-12-20T04:48:35.857989+0000","last_fullsized":"2023-12-20T04:48:35.857989+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:19:23.525928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855901+0000","last_change":"2023-12-20T04:48:35.855901+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855901+0000","last_undegraded":"2023-12-20T04:48:35.855901+0000","last_fullsized":"2023-12-20T04:48:35.855901+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:46:09.941020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856493+0000","last_change":"2023-12-20T04:48:35.856493+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856493+0000","last_undegraded":"2023-12-20T04:48:35.856493+0000","last_fullsized":"2023-12-20T04:48:35.856493+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:35:42.399086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857430+0000","last_change":"2023-12-20T04:48:35.857430+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857430+0000","last_undegraded":"2023-12-20T04:48:35.857430+0000","last_fullsized":"2023-12-20T04:48:35.857430+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:44:24.972128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856903+0000","last_change":"2023-12-20T04:48:35.856903+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856903+0000","last_undegraded":"2023-12-20T04:48:35.856903+0000","last_fullsized":"2023-12-20T04:48:35.856903+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:24:31.465239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857799+0000","last_change":"2023-12-20T04:48:35.857799+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857799+0000","last_undegraded":"2023-12-20T04:48:35.857799+0000","last_fullsized":"2023-12-20T04:48:35.857799+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:46.737836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858471+0000","last_change":"2023-12-20T04:48:35.858471+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858471+0000","last_undegraded":"2023-12-20T04:48:35.858471+0000","last_fullsized":"2023-12-20T04:48:35.858471+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:27:05.379326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857052+0000","last_change":"2023-12-20T04:48:35.857052+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857052+0000","last_undegraded":"2023-12-20T04:48:35.857052+0000","last_fullsized":"2023-12-20T04:48:35.857052+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:54:30.482197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858358+0000","last_change":"2023-12-20T04:48:35.858358+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858358+0000","last_undegraded":"2023-12-20T04:48:35.858358+0000","last_fullsized":"2023-12-20T04:48:35.858358+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:31.190233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857061+0000","last_change":"2023-12-20T04:48:35.857061+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857061+0000","last_undegraded":"2023-12-20T04:48:35.857061+0000","last_fullsized":"2023-12-20T04:48:35.857061+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:13:02.368205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857258+0000","last_change":"2023-12-20T04:48:35.857258+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857258+0000","last_undegraded":"2023-12-20T04:48:35.857258+0000","last_fullsized":"2023-12-20T04:48:35.857258+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:49:25.498201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856392+0000","last_change":"2023-12-20T04:48:35.856392+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856392+0000","last_undegraded":"2023-12-20T04:48:35.856392+0000","last_fullsized":"2023-12-20T04:48:35.856392+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:21:11.425935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857689+0000","last_change":"2023-12-20T04:48:35.857689+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857689+0000","last_undegraded":"2023-12-20T04:48:35.857689+0000","last_fullsized":"2023-12-20T04:48:35.857689+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:06:08.922092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856579+0000","last_change":"2023-12-20T04:48:35.856579+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856579+0000","last_undegraded":"2023-12-20T04:48:35.856579+0000","last_fullsized":"2023-12-20T04:48:35.856579+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:55:54.167519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855880+0000","last_change":"2023-12-20T04:48:35.855880+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855880+0000","last_undegraded":"2023-12-20T04:48:35.855880+0000","last_fullsized":"2023-12-20T04:48:35.855880+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:57:21.208524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855446+0000","last_change":"2023-12-20T04:48:35.855446+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855446+0000","last_undegraded":"2023-12-20T04:48:35.855446+0000","last_fullsized":"2023-12-20T04:48:35.855446+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:45:34.903470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857026+0000","last_change":"2023-12-20T04:48:35.857026+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857026+0000","last_undegraded":"2023-12-20T04:48:35.857026+0000","last_fullsized":"2023-12-20T04:48:35.857026+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:39:00.957194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856691+0000","last_change":"2023-12-20T04:48:35.856691+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856691+0000","last_undegraded":"2023-12-20T04:48:35.856691+0000","last_fullsized":"2023-12-20T04:48:35.856691+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:51:30.201471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855446+0000","last_change":"2023-12-20T04:48:35.855446+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855446+0000","last_undegraded":"2023-12-20T04:48:35.855446+0000","last_fullsized":"2023-12-20T04:48:35.855446+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:57:07.085438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857410+0000","last_change":"2023-12-20T04:48:35.857410+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857410+0000","last_undegraded":"2023-12-20T04:48:35.857410+0000","last_fullsized":"2023-12-20T04:48:35.857410+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:14:17.093075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858690+0000","last_change":"2023-12-20T04:48:35.858690+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858690+0000","last_undegraded":"2023-12-20T04:48:35.858690+0000","last_fullsized":"2023-12-20T04:48:35.858690+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:59:50.306154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858117+0000","last_change":"2023-12-20T04:48:35.858117+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858117+0000","last_undegraded":"2023-12-20T04:48:35.858117+0000","last_fullsized":"2023-12-20T04:48:35.858117+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:35:43.620245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855875+0000","last_change":"2023-12-20T04:48:35.855875+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855875+0000","last_undegraded":"2023-12-20T04:48:35.855875+0000","last_fullsized":"2023-12-20T04:48:35.855875+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:43:00.715984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858050+0000","last_change":"2023-12-20T04:48:35.858050+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858050+0000","last_undegraded":"2023-12-20T04:48:35.858050+0000","last_fullsized":"2023-12-20T04:48:35.858050+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:05:43.588839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":261,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-12-20T04:48:34.353055+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:48:34.353055+0000","last_peered":"2023-12-20T04:48:34.353055+0000","last_clean":"2023-12-20T04:48:34.353055+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:48:34.353055+0000","last_undegraded":"2023-12-20T04:48:34.353055+0000","last_fullsized":"2023-12-20T04:48:34.353055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1296,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194015,"statfs":{"total":200000000,"available":198671973,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.42499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73399999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52200000000000002},"min":{"1min":0.33100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67300000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.437}]},{"osd":1,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.39700000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.68700000000000006,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71599999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.53900000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.65200000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70099999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55400000000000005}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70299999999999996,"5min":1.048,"15min":1.048},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47299999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65600000000000003,"5min":0.753,"15min":0.753},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.49199999999999999,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70399999999999996,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52900000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.49099999999999999},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68999999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.40500000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65400000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51900000000000002,"15min":0.54600000000000004},"min":{"1min":0.34399999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71599999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.626},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.50800000000000001,"15min":0.496},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.31900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.625}]},{"osd":1,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.53100000000000003},"min":{"1min":0.36699999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51400000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52200000000000002,"15min":0.50800000000000001},"min":{"1min":0.40100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69999999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.63900000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53100000000000003,"15min":0.5},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.60499999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48199999999999998,"15min":0.50600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.49399999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70399999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.56000000000000005}]},{"osd":5,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68799999999999994,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.70499999999999996}]},{"osd":7,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73199999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.76300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55100000000000005}]},{"osd":1,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.33300000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.80600000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.35899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51700000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.496},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.41499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68300000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.32300000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66100000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.371,"5min":0.312,"15min":0.312},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47699999999999998,"15min":0.503},"min":{"1min":0.28799999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.749,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.47599999999999998,"15min":0.48099999999999998},"min":{"1min":0.32800000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.434}]},{"osd":6,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48399999999999999,"15min":0.50600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52700000000000002,"15min":0.54200000000000004},"min":{"1min":0.37,"5min":0.31,"15min":0.31},"max":{"1min":0.78600000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58999999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73099999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75800000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.63}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.308,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.33000000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.67100000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.34200000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69899999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.36499999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.315}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54000000000000004,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.76000000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.371,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45000000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.501},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.48499999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.877,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.41099999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.56599999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48799999999999999,"15min":0.503},"min":{"1min":0.371,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.72199999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70499999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48999999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.34599999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35199999999999998,"15min":0.34000000000000002},"min":{"1min":0.20100000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.58299999999999996,"5min":0.629,"15min":0.629},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.374,"15min":0.35599999999999998},"min":{"1min":0.29099999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.56200000000000006,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.52000000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.32100000000000001},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.505},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.33700000000000002},"min":{"1min":0.27800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.44500000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35099999999999998,"15min":0.34499999999999997},"min":{"1min":0.249,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49299999999999999,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.376},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.53500000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55800000000000005,"15min":0.54300000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.76800000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.85999999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.45200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72199999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.91500000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.38500000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76700000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58399999999999996,"15min":0.56100000000000005},"min":{"1min":0.495,"5min":0.37,"15min":0.37},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.754}]},{"osd":7,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80600000000000005,"5min":0.879,"15min":0.879},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80300000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.96099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194592,"statfs":{"total":200000000,"available":199262341,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.29999999999999999},"min":{"1min":0.246,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.44700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39300000000000002,"15min":0.34499999999999997},"min":{"1min":0.25800000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.504,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.50600000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35599999999999998,"15min":0.33100000000000002},"min":{"1min":0.24099999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.54300000000000004,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.375,"15min":0.35099999999999998},"min":{"1min":0.247,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.5,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.52600000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.35999999999999999},"min":{"1min":0.27700000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.58299999999999996,"5min":0.995,"15min":0.995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.372},"min":{"1min":0.28100000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.53600000000000003,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.442,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75,"5min":2.347,"15min":2.347},"last":0.754}]},{"osd":5,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.42099999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84999999999999998,"5min":0.997,"15min":0.997},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70799999999999996}]},{"osd":6,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59199999999999997,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71699999999999997,"5min":2.274,"15min":2.274},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.82299999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.82499999999999996}]},{"osd":7,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.57099999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59099999999999997,"15min":0.57999999999999996},"min":{"1min":0.45100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.77700000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194592,"statfs":{"total":200000000,"available":199262341,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.316,"15min":0.28999999999999998},"min":{"1min":0.23000000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.35299999999999998,"15min":0.33100000000000002},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.33200000000000002,"15min":0.307},"min":{"1min":0.20599999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.52400000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.377,"15min":0.35099999999999998},"min":{"1min":0.26900000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.34999999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.35799999999999998},"min":{"1min":0.29499999999999998,"5min":0.191,"15min":0.191},"max":{"1min":0.61699999999999999,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36399999999999999,"15min":0.35299999999999998},"min":{"1min":0.26400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54800000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.45500000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.312,"15min":0.312},"max":{"1min":0.70999999999999996,"5min":0.873,"15min":0.873},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.45000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73099999999999998,"5min":1.002,"15min":1.002},"last":0.41899999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.42099999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.54200000000000004},"min":{"1min":0.45900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46400000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.47999999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":1.038,"15min":1.038},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.56299999999999994},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66900000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.44600000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.42899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72299999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.51500000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73499999999999999,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1291,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194021,"statfs":{"total":200000000,"available":198677790,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32200000000000001,"15min":0.31},"min":{"1min":0.25,"5min":0.184,"15min":0.184},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.314},"min":{"1min":0.27400000000000002,"5min":0.184,"15min":0.184},"max":{"1min":0.46300000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.25}]},{"osd":2,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.28599999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.53500000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.26500000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.51300000000000001,"5min":0.622,"15min":0.622},"last":0.30299999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34799999999999998,"15min":0.32500000000000001},"min":{"1min":0.29099999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.36899999999999999},"min":{"1min":0.29399999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.318}]},{"osd":4,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55200000000000005,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.432,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.621}]},{"osd":5,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.52200000000000002},"min":{"1min":0.432,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73199999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57199999999999995,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82999999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88200000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.502},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.58399999999999996},"min":{"1min":0.45300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.63400000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.747,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.39300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83399999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52600000000000002}]}]}],"pool_statfs":[]}} 2023-12-20T04:48:40.143 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:48:40.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.276+0000 7fca44ec4640 1 Processor -- start 2023-12-20T04:48:40.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.276+0000 7fca44ec4640 1 -- start start 2023-12-20T04:48:40.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.277+0000 7fca44ec4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca40160450 0x7fca40160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.277+0000 7fca44ec4640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fca401611b0 0x7fca400b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.277+0000 7fca44ec4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fca400b4ec0 0x7fca4006a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.277+0000 7fca44ec4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca400b5350 con 0x7fca400b4ec0 2023-12-20T04:48:40.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.277+0000 7fca44ec4640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca400b5ec0 con 0x7fca401611b0 2023-12-20T04:48:40.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.277+0000 7fca44ec4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca401617e0 con 0x7fca40160450 2023-12-20T04:48:40.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.277+0000 7fca3ed9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fca400b4ec0 0x7fca4006a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.277+0000 7fca3ed9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fca400b4ec0 0x7fca4006a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52724/0 (socket says 172.21.15.132:52724) 2023-12-20T04:48:40.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.277+0000 7fca3ed9d640 1 -- 172.21.15.132:0/1645329061 learned_addr learned my addr 172.21.15.132:0/1645329061 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:40.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.277+0000 7fca3ed9d640 1 -- 172.21.15.132:0/1645329061 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca40160450 msgr2=0x7fca40160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:40.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.277+0000 7fca3e59c640 1 --2- 172.21.15.132:0/1645329061 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca40160450 0x7fca40160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.277+0000 7fca3dd9b640 1 --2- 172.21.15.132:0/1645329061 >> v2:172.21.15.187:3300/0 conn(0x7fca401611b0 0x7fca400b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.278+0000 7fca3ed9d640 1 --2- 172.21.15.132:0/1645329061 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca40160450 0x7fca40160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.278+0000 7fca3ed9d640 1 -- 172.21.15.132:0/1645329061 >> v2:172.21.15.187:3300/0 conn(0x7fca401611b0 msgr2=0x7fca400b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:40.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.278+0000 7fca3ed9d640 1 --2- 172.21.15.132:0/1645329061 >> v2:172.21.15.187:3300/0 conn(0x7fca401611b0 0x7fca400b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.278+0000 7fca3ed9d640 1 -- 172.21.15.132:0/1645329061 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca400d0fc0 con 0x7fca400b4ec0 2023-12-20T04:48:40.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.278+0000 7fca3dd9b640 1 --2- 172.21.15.132:0/1645329061 >> v2:172.21.15.187:3300/0 conn(0x7fca401611b0 0x7fca400b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:40.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.278+0000 7fca3e59c640 1 --2- 172.21.15.132:0/1645329061 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca40160450 0x7fca40160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:40.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.278+0000 7fca3ed9d640 1 --2- 172.21.15.132:0/1645329061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca400b4ec0 0x7fca4006a1a0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fca4006b4a0 tx=0x7fca3802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1236cf9b504e5b1 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:40.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.278+0000 7fca3d59a640 1 -- 172.21.15.132:0/1645329061 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38030860 con 0x7fca400b4ec0 2023-12-20T04:48:40.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.278+0000 7fca3d59a640 1 -- 172.21.15.132:0/1645329061 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca380309c0 con 0x7fca400b4ec0 2023-12-20T04:48:40.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.278+0000 7fca3d59a640 1 -- 172.21.15.132:0/1645329061 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38030d50 con 0x7fca400b4ec0 2023-12-20T04:48:40.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.279+0000 7fca44ec4640 1 -- 172.21.15.132:0/1645329061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca400b4ec0 msgr2=0x7fca4006a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.279+0000 7fca44ec4640 1 --2- 172.21.15.132:0/1645329061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca400b4ec0 0x7fca4006a1a0 secure :-1 s=READY pgs=1351 cs=0 l=1 rev1=1 crypto rx=0x7fca4006b4a0 tx=0x7fca3802b9a0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.279+0000 7fca44ec4640 1 -- 172.21.15.132:0/1645329061 shutdown_connections 2023-12-20T04:48:40.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.279+0000 7fca44ec4640 1 --2- 172.21.15.132:0/1645329061 >> v2:172.21.15.187:3300/0 conn(0x7fca401611b0 0x7fca400b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.279+0000 7fca44ec4640 1 --2- 172.21.15.132:0/1645329061 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca400b4ec0 0x7fca4006a1a0 unknown :-1 s=CLOSED pgs=1351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.279+0000 7fca44ec4640 1 --2- 172.21.15.132:0/1645329061 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca40160450 0x7fca40160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.279+0000 7fca44ec4640 1 -- 172.21.15.132:0/1645329061 >> 172.21.15.132:0/1645329061 conn(0x7fca400cf980 msgr2=0x7fca400cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:40.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.279+0000 7fca44ec4640 1 -- 172.21.15.132:0/1645329061 shutdown_connections 2023-12-20T04:48:40.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.279+0000 7fca44ec4640 1 -- 172.21.15.132:0/1645329061 wait complete. 2023-12-20T04:48:40.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.280+0000 7fca44ec4640 1 Processor -- start 2023-12-20T04:48:40.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.280+0000 7fca44ec4640 1 -- start start 2023-12-20T04:48:40.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.281+0000 7fca44ec4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca400b4ec0 0x7fca400d3720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.281+0000 7fca44ec4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca40160450 0x7fca400b6e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.281+0000 7fca44ec4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca401611b0 0x7fca401f6620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.281+0000 7fca44ec4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca400d1f10 con 0x7fca401611b0 2023-12-20T04:48:40.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.281+0000 7fca44ec4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca400d21f0 con 0x7fca400b4ec0 2023-12-20T04:48:40.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.281+0000 7fca44ec4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca400d24d0 con 0x7fca40160450 2023-12-20T04:48:40.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.281+0000 7fca3ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca401611b0 0x7fca401f6620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.281+0000 7fca3ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca401611b0 0x7fca401f6620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52736/0 (socket says 172.21.15.132:52736) 2023-12-20T04:48:40.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.281+0000 7fca3ed9d640 1 -- 172.21.15.132:0/3742088698 learned_addr learned my addr 172.21.15.132:0/3742088698 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:40.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.281+0000 7fca3ed9d640 1 -- 172.21.15.132:0/3742088698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca40160450 msgr2=0x7fca400b6e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.281+0000 7fca3ed9d640 1 --2- 172.21.15.132:0/3742088698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca40160450 0x7fca400b6e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.281+0000 7fca3ed9d640 1 -- 172.21.15.132:0/3742088698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca400b4ec0 msgr2=0x7fca400d3720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.281+0000 7fca3ed9d640 1 --2- 172.21.15.132:0/3742088698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca400b4ec0 0x7fca400d3720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.281+0000 7fca3ed9d640 1 -- 172.21.15.132:0/3742088698 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca380094d0 con 0x7fca401611b0 2023-12-20T04:48:40.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.282+0000 7fca3ed9d640 1 --2- 172.21.15.132:0/3742088698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca401611b0 0x7fca401f6620 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fca3802b9e0 tx=0x7fca38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:40.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.282+0000 7fca2effd640 1 -- 172.21.15.132:0/3742088698 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca380307f0 con 0x7fca401611b0 2023-12-20T04:48:40.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.282+0000 7fca2effd640 1 -- 172.21.15.132:0/3742088698 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca38039d90 con 0x7fca401611b0 2023-12-20T04:48:40.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.282+0000 7fca2effd640 1 -- 172.21.15.132:0/3742088698 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca38043650 con 0x7fca401611b0 2023-12-20T04:48:40.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.282+0000 7fca44ec4640 1 -- 172.21.15.132:0/3742088698 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca400d27b0 con 0x7fca401611b0 2023-12-20T04:48:40.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.282+0000 7fca44ec4640 1 -- 172.21.15.132:0/3742088698 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca400d3c60 con 0x7fca401611b0 2023-12-20T04:48:40.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.283+0000 7fca44ec4640 1 -- 172.21.15.132:0/3742088698 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca401f6340 con 0x7fca401611b0 2023-12-20T04:48:40.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.283+0000 7fca2effd640 1 -- 172.21.15.132:0/3742088698 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fca3804c3b0 con 0x7fca401611b0 2023-12-20T04:48:40.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.283+0000 7fca2effd640 1 --2- 172.21.15.132:0/3742088698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca2006a430 0x7fca2006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.284+0000 7fca2effd640 1 -- 172.21.15.132:0/3742088698 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca380ab150 con 0x7fca401611b0 2023-12-20T04:48:40.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.284+0000 7fca3e59c640 1 --2- 172.21.15.132:0/3742088698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca2006a430 0x7fca2006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.284+0000 7fca3e59c640 1 --2- 172.21.15.132:0/3742088698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca2006a430 0x7fca2006c8f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fca30008ea0 tx=0x7fca300083d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:40.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.288+0000 7fca2effd640 1 -- 172.21.15.132:0/3742088698 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fca401f6340 con 0x7fca401611b0 2023-12-20T04:48:40.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.451+0000 7fca44ec4640 1 -- 172.21.15.132:0/3742088698 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fca400d1580 con 0x7fca2006a430 2023-12-20T04:48:40.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.457+0000 7fca2effd640 1 -- 172.21.15.132:0/3742088698 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276447 (secure 0 0 0) 0x7fca30012070 con 0x7fca2006a430 2023-12-20T04:48:40.462 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:40.463 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:48:40.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.460+0000 7fca44ec4640 1 -- 172.21.15.132:0/3742088698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca2006a430 msgr2=0x7fca2006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.460+0000 7fca44ec4640 1 --2- 172.21.15.132:0/3742088698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca2006a430 0x7fca2006c8f0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fca30008ea0 tx=0x7fca300083d0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.460+0000 7fca44ec4640 1 -- 172.21.15.132:0/3742088698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca401611b0 msgr2=0x7fca401f6620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.460+0000 7fca44ec4640 1 --2- 172.21.15.132:0/3742088698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca401611b0 0x7fca401f6620 secure :-1 s=READY pgs=1352 cs=0 l=1 rev1=1 crypto rx=0x7fca3802b9e0 tx=0x7fca38004730 comp rx=0 tx=0).stop 2023-12-20T04:48:40.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.460+0000 7fca44ec4640 1 -- 172.21.15.132:0/3742088698 shutdown_connections 2023-12-20T04:48:40.465 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.460+0000 7fca44ec4640 1 --2- 172.21.15.132:0/3742088698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca2006a430 0x7fca2006c8f0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.460+0000 7fca44ec4640 1 --2- 172.21.15.132:0/3742088698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca401611b0 0x7fca401f6620 unknown :-1 s=CLOSED pgs=1352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.460+0000 7fca44ec4640 1 --2- 172.21.15.132:0/3742088698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca40160450 0x7fca400b6e20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.460+0000 7fca44ec4640 1 --2- 172.21.15.132:0/3742088698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca400b4ec0 0x7fca400d3720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.460+0000 7fca44ec4640 1 -- 172.21.15.132:0/3742088698 >> 172.21.15.132:0/3742088698 conn(0x7fca400cf980 msgr2=0x7fca40160830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:40.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.461+0000 7fca44ec4640 1 -- 172.21.15.132:0/3742088698 shutdown_connections 2023-12-20T04:48:40.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.461+0000 7fca44ec4640 1 -- 172.21.15.132:0/3742088698 wait complete. 2023-12-20T04:48:40.473 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2023-12-20T04:48:40.166599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6887,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555612,"statfs":{"total":1600000000,"available":1592947077,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.313615"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857406+0000","last_change":"2023-12-20T04:48:35.857406+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857406+0000","last_undegraded":"2023-12-20T04:48:35.857406+0000","last_fullsized":"2023-12-20T04:48:35.857406+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:41:26.866774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856154+0000","last_change":"2023-12-20T04:48:35.856154+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856154+0000","last_undegraded":"2023-12-20T04:48:35.856154+0000","last_fullsized":"2023-12-20T04:48:35.856154+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:45:37.758827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858837+0000","last_change":"2023-12-20T04:48:35.858837+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858837+0000","last_undegraded":"2023-12-20T04:48:35.858837+0000","last_fullsized":"2023-12-20T04:48:35.858837+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:59:46.853598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858372+0000","last_change":"2023-12-20T04:48:35.858372+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858372+0000","last_undegraded":"2023-12-20T04:48:35.858372+0000","last_fullsized":"2023-12-20T04:48:35.858372+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:05.361765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858408+0000","last_change":"2023-12-20T04:48:35.858408+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858408+0000","last_undegraded":"2023-12-20T04:48:35.858408+0000","last_fullsized":"2023-12-20T04:48:35.858408+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:38:39.178936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855923+0000","last_change":"2023-12-20T04:48:35.855923+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855923+0000","last_undegraded":"2023-12-20T04:48:35.855923+0000","last_fullsized":"2023-12-20T04:48:35.855923+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:05.495362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858688+0000","last_change":"2023-12-20T04:48:35.858688+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858688+0000","last_undegraded":"2023-12-20T04:48:35.858688+0000","last_fullsized":"2023-12-20T04:48:35.858688+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:45:37.758827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856340+0000","last_change":"2023-12-20T04:48:35.856340+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856340+0000","last_undegraded":"2023-12-20T04:48:35.856340+0000","last_fullsized":"2023-12-20T04:48:35.856340+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:04.225858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857989+0000","last_change":"2023-12-20T04:48:35.857989+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857989+0000","last_undegraded":"2023-12-20T04:48:35.857989+0000","last_fullsized":"2023-12-20T04:48:35.857989+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:19:23.525928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855901+0000","last_change":"2023-12-20T04:48:35.855901+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855901+0000","last_undegraded":"2023-12-20T04:48:35.855901+0000","last_fullsized":"2023-12-20T04:48:35.855901+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:46:09.941020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856493+0000","last_change":"2023-12-20T04:48:35.856493+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856493+0000","last_undegraded":"2023-12-20T04:48:35.856493+0000","last_fullsized":"2023-12-20T04:48:35.856493+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:35:42.399086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857430+0000","last_change":"2023-12-20T04:48:35.857430+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857430+0000","last_undegraded":"2023-12-20T04:48:35.857430+0000","last_fullsized":"2023-12-20T04:48:35.857430+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:44:24.972128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856903+0000","last_change":"2023-12-20T04:48:35.856903+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856903+0000","last_undegraded":"2023-12-20T04:48:35.856903+0000","last_fullsized":"2023-12-20T04:48:35.856903+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:24:31.465239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857799+0000","last_change":"2023-12-20T04:48:35.857799+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857799+0000","last_undegraded":"2023-12-20T04:48:35.857799+0000","last_fullsized":"2023-12-20T04:48:35.857799+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:46.737836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858471+0000","last_change":"2023-12-20T04:48:35.858471+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858471+0000","last_undegraded":"2023-12-20T04:48:35.858471+0000","last_fullsized":"2023-12-20T04:48:35.858471+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:27:05.379326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857052+0000","last_change":"2023-12-20T04:48:35.857052+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857052+0000","last_undegraded":"2023-12-20T04:48:35.857052+0000","last_fullsized":"2023-12-20T04:48:35.857052+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:54:30.482197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858358+0000","last_change":"2023-12-20T04:48:35.858358+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858358+0000","last_undegraded":"2023-12-20T04:48:35.858358+0000","last_fullsized":"2023-12-20T04:48:35.858358+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:31.190233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857061+0000","last_change":"2023-12-20T04:48:35.857061+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857061+0000","last_undegraded":"2023-12-20T04:48:35.857061+0000","last_fullsized":"2023-12-20T04:48:35.857061+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:13:02.368205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857258+0000","last_change":"2023-12-20T04:48:35.857258+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857258+0000","last_undegraded":"2023-12-20T04:48:35.857258+0000","last_fullsized":"2023-12-20T04:48:35.857258+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:49:25.498201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856392+0000","last_change":"2023-12-20T04:48:35.856392+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856392+0000","last_undegraded":"2023-12-20T04:48:35.856392+0000","last_fullsized":"2023-12-20T04:48:35.856392+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:21:11.425935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857689+0000","last_change":"2023-12-20T04:48:35.857689+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857689+0000","last_undegraded":"2023-12-20T04:48:35.857689+0000","last_fullsized":"2023-12-20T04:48:35.857689+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:06:08.922092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856579+0000","last_change":"2023-12-20T04:48:35.856579+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856579+0000","last_undegraded":"2023-12-20T04:48:35.856579+0000","last_fullsized":"2023-12-20T04:48:35.856579+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:55:54.167519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855880+0000","last_change":"2023-12-20T04:48:35.855880+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855880+0000","last_undegraded":"2023-12-20T04:48:35.855880+0000","last_fullsized":"2023-12-20T04:48:35.855880+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:57:21.208524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855446+0000","last_change":"2023-12-20T04:48:35.855446+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855446+0000","last_undegraded":"2023-12-20T04:48:35.855446+0000","last_fullsized":"2023-12-20T04:48:35.855446+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:45:34.903470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857026+0000","last_change":"2023-12-20T04:48:35.857026+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857026+0000","last_undegraded":"2023-12-20T04:48:35.857026+0000","last_fullsized":"2023-12-20T04:48:35.857026+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:39:00.957194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856691+0000","last_change":"2023-12-20T04:48:35.856691+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856691+0000","last_undegraded":"2023-12-20T04:48:35.856691+0000","last_fullsized":"2023-12-20T04:48:35.856691+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:51:30.201471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855446+0000","last_change":"2023-12-20T04:48:35.855446+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855446+0000","last_undegraded":"2023-12-20T04:48:35.855446+0000","last_fullsized":"2023-12-20T04:48:35.855446+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:57:07.085438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857410+0000","last_change":"2023-12-20T04:48:35.857410+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857410+0000","last_undegraded":"2023-12-20T04:48:35.857410+0000","last_fullsized":"2023-12-20T04:48:35.857410+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:14:17.093075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858690+0000","last_change":"2023-12-20T04:48:35.858690+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858690+0000","last_undegraded":"2023-12-20T04:48:35.858690+0000","last_fullsized":"2023-12-20T04:48:35.858690+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:59:50.306154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858117+0000","last_change":"2023-12-20T04:48:35.858117+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858117+0000","last_undegraded":"2023-12-20T04:48:35.858117+0000","last_fullsized":"2023-12-20T04:48:35.858117+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:35:43.620245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855875+0000","last_change":"2023-12-20T04:48:35.855875+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855875+0000","last_undegraded":"2023-12-20T04:48:35.855875+0000","last_fullsized":"2023-12-20T04:48:35.855875+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:43:00.715984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858050+0000","last_change":"2023-12-20T04:48:35.858050+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858050+0000","last_undegraded":"2023-12-20T04:48:35.858050+0000","last_fullsized":"2023-12-20T04:48:35.858050+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:05:43.588839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":261,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-12-20T04:48:34.353055+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:48:34.353055+0000","last_peered":"2023-12-20T04:48:34.353055+0000","last_clean":"2023-12-20T04:48:34.353055+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:48:34.353055+0000","last_undegraded":"2023-12-20T04:48:34.353055+0000","last_fullsized":"2023-12-20T04:48:34.353055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1296,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194015,"statfs":{"total":200000000,"available":198671973,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.42499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73399999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52200000000000002},"min":{"1min":0.33100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67300000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.437}]},{"osd":1,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.39700000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.68700000000000006,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71599999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.53900000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.65200000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70099999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55400000000000005}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70299999999999996,"5min":1.048,"15min":1.048},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47299999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65600000000000003,"5min":0.753,"15min":0.753},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.49199999999999999,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70399999999999996,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52900000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.49099999999999999},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68999999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.40500000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65400000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51900000000000002,"15min":0.54600000000000004},"min":{"1min":0.34399999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71599999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.626},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.50800000000000001,"15min":0.496},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.31900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.625}]},{"osd":1,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.53100000000000003},"min":{"1min":0.36699999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51400000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52200000000000002,"15min":0.50800000000000001},"min":{"1min":0.40100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69999999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.63900000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53100000000000003,"15min":0.5},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.60499999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48199999999999998,"15min":0.50600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.49399999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70399999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.56000000000000005}]},{"osd":5,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68799999999999994,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.70499999999999996}]},{"osd":7,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73199999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.76300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55100000000000005}]},{"osd":1,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.33300000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.80600000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.35899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51700000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.496},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.41499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68300000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.32300000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66100000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.371,"5min":0.312,"15min":0.312},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47699999999999998,"15min":0.503},"min":{"1min":0.28799999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.749,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.47599999999999998,"15min":0.48099999999999998},"min":{"1min":0.32800000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.434}]},{"osd":6,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48399999999999999,"15min":0.50600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52700000000000002,"15min":0.54200000000000004},"min":{"1min":0.37,"5min":0.31,"15min":0.31},"max":{"1min":0.78600000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58999999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73099999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75800000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.63}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.308,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.33000000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.67100000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.34200000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69899999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.36499999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.315}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54000000000000004,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.76000000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.371,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45000000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.501},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.48499999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.877,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.41099999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.56599999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48799999999999999,"15min":0.503},"min":{"1min":0.371,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.72199999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70499999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48999999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.34599999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35199999999999998,"15min":0.34000000000000002},"min":{"1min":0.20100000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.58299999999999996,"5min":0.629,"15min":0.629},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.374,"15min":0.35599999999999998},"min":{"1min":0.29099999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.56200000000000006,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.52000000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.32100000000000001},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.505},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.33700000000000002},"min":{"1min":0.27800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.44500000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35099999999999998,"15min":0.34499999999999997},"min":{"1min":0.249,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49299999999999999,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.376},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.53500000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55800000000000005,"15min":0.54300000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.76800000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.85999999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.45200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72199999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.91500000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.38500000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76700000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58399999999999996,"15min":0.56100000000000005},"min":{"1min":0.495,"5min":0.37,"15min":0.37},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.754}]},{"osd":7,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80600000000000005,"5min":0.879,"15min":0.879},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80300000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.96099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194592,"statfs":{"total":200000000,"available":199262341,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.29999999999999999},"min":{"1min":0.246,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.44700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39300000000000002,"15min":0.34499999999999997},"min":{"1min":0.25800000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.504,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.50600000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35599999999999998,"15min":0.33100000000000002},"min":{"1min":0.24099999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.54300000000000004,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.375,"15min":0.35099999999999998},"min":{"1min":0.247,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.5,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.52600000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.35999999999999999},"min":{"1min":0.27700000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.58299999999999996,"5min":0.995,"15min":0.995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.372},"min":{"1min":0.28100000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.53600000000000003,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.442,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75,"5min":2.347,"15min":2.347},"last":0.754}]},{"osd":5,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.42099999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84999999999999998,"5min":0.997,"15min":0.997},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70799999999999996}]},{"osd":6,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59199999999999997,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71699999999999997,"5min":2.274,"15min":2.274},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.82299999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.82499999999999996}]},{"osd":7,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.57099999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59099999999999997,"15min":0.57999999999999996},"min":{"1min":0.45100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.77700000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194592,"statfs":{"total":200000000,"available":199262341,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.316,"15min":0.28999999999999998},"min":{"1min":0.23000000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.35299999999999998,"15min":0.33100000000000002},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.33200000000000002,"15min":0.307},"min":{"1min":0.20599999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.52400000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.377,"15min":0.35099999999999998},"min":{"1min":0.26900000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.34999999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.35799999999999998},"min":{"1min":0.29499999999999998,"5min":0.191,"15min":0.191},"max":{"1min":0.61699999999999999,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36399999999999999,"15min":0.35299999999999998},"min":{"1min":0.26400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54800000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.45500000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.312,"15min":0.312},"max":{"1min":0.70999999999999996,"5min":0.873,"15min":0.873},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.45000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73099999999999998,"5min":1.002,"15min":1.002},"last":0.41899999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.42099999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.54200000000000004},"min":{"1min":0.45900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46400000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.47999999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":1.038,"15min":1.038},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.56299999999999994},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66900000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.44600000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.42899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72299999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.51500000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73499999999999999,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1291,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194021,"statfs":{"total":200000000,"available":198677790,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32200000000000001,"15min":0.31},"min":{"1min":0.25,"5min":0.184,"15min":0.184},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.314},"min":{"1min":0.27400000000000002,"5min":0.184,"15min":0.184},"max":{"1min":0.46300000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.25}]},{"osd":2,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.28599999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.53500000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.26500000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.51300000000000001,"5min":0.622,"15min":0.622},"last":0.30299999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34799999999999998,"15min":0.32500000000000001},"min":{"1min":0.29099999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.36899999999999999},"min":{"1min":0.29399999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.318}]},{"osd":4,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55200000000000005,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.432,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.621}]},{"osd":5,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.52200000000000002},"min":{"1min":0.432,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73199999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57199999999999995,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82999999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88200000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.502},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.58399999999999996},"min":{"1min":0.45300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.63400000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.747,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.39300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83399999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52600000000000002}]}]}],"pool_statfs":[]}} 2023-12-20T04:48:40.513 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:48:40.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.611+0000 7f3224fd2640 1 Processor -- start 2023-12-20T04:48:40.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.611+0000 7f3224fd2640 1 -- start start 2023-12-20T04:48:40.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.612+0000 7f3224fd2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32200b4980 0x7f32200b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.612+0000 7f3224fd2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32200b5320 con 0x7f3220160450 2023-12-20T04:48:40.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.612+0000 7f3224fd2640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f32200b5ec0 con 0x7f32200d1aa0 2023-12-20T04:48:40.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.612+0000 7f3224fd2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32201617e0 con 0x7f32200b4980 2023-12-20T04:48:40.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.612+0000 7f321e59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3220160450 0x7f3220160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47756/0 (socket says 172.21.15.132:47756) 2023-12-20T04:48:40.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.612+0000 7f321e59c640 1 -- 172.21.15.132:0/1260204707 learned_addr learned my addr 172.21.15.132:0/1260204707 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:40.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.613+0000 7f321dd9b640 1 --2- 172.21.15.132:0/1260204707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32200b4980 0x7f32200b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.613+0000 7f321d59a640 1 -- 172.21.15.132:0/1260204707 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1664620231 0 0) 0x7f32200b5320 con 0x7f3220160450 2023-12-20T04:48:40.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.613+0000 7f321d59a640 1 -- 172.21.15.132:0/1260204707 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3208003520 con 0x7f3220160450 2023-12-20T04:48:40.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.613+0000 7f321d59a640 1 -- 172.21.15.132:0/1260204707 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 556081913 0 0) 0x7f32200b5ec0 con 0x7f32200d1aa0 2023-12-20T04:48:40.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.613+0000 7f321d59a640 1 -- 172.21.15.132:0/1260204707 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f32200b5320 con 0x7f32200d1aa0 2023-12-20T04:48:40.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.613+0000 7f321d59a640 1 -- 172.21.15.132:0/1260204707 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 108691298 0 0) 0x7f3208003520 con 0x7f3220160450 2023-12-20T04:48:40.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.613+0000 7f321dd9b640 1 -- 172.21.15.132:0/1260204707 >> v1:172.21.15.187:6789/0 conn(0x7f32200d1aa0 legacy=0x7f32200d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.613+0000 7f321dd9b640 1 -- 172.21.15.132:0/1260204707 >> v1:172.21.15.132:6789/0 conn(0x7f3220160450 legacy=0x7f3220160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.613+0000 7f321dd9b640 1 -- 172.21.15.132:0/1260204707 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f32200d0fc0 con 0x7f32200b4980 2023-12-20T04:48:40.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.614+0000 7f321dd9b640 1 --2- 172.21.15.132:0/1260204707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32200b4980 0x7f32200b4de0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f32140097d0 tx=0x7f321402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=93bf581a9f676a41 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:40.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.614+0000 7f321d59a640 1 -- 172.21.15.132:0/1260204707 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32100019f0 con 0x7f32200b4980 2023-12-20T04:48:40.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.614+0000 7f321d59a640 1 -- 172.21.15.132:0/1260204707 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3214031580 con 0x7f32200b4980 2023-12-20T04:48:40.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.614+0000 7f321d59a640 1 -- 172.21.15.132:0/1260204707 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f32140318f0 con 0x7f32200b4980 2023-12-20T04:48:40.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.614+0000 7f3224fd2640 1 -- 172.21.15.132:0/1260204707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32200b4980 msgr2=0x7f32200b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.614+0000 7f3224fd2640 1 --2- 172.21.15.132:0/1260204707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32200b4980 0x7f32200b4de0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f32140097d0 tx=0x7f321402b8a0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.614+0000 7f3224fd2640 1 -- 172.21.15.132:0/1260204707 shutdown_connections 2023-12-20T04:48:40.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.614+0000 7f3224fd2640 1 --2- 172.21.15.132:0/1260204707 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32200b4980 0x7f32200b4de0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.614+0000 7f3224fd2640 1 -- 172.21.15.132:0/1260204707 >> 172.21.15.132:0/1260204707 conn(0x7f32200cf980 msgr2=0x7f32200cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:40.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.614+0000 7f3224fd2640 1 -- 172.21.15.132:0/1260204707 shutdown_connections 2023-12-20T04:48:40.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.614+0000 7f3224fd2640 1 -- 172.21.15.132:0/1260204707 wait complete. 2023-12-20T04:48:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.616+0000 7f3224fd2640 1 Processor -- start 2023-12-20T04:48:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.616+0000 7f3224fd2640 1 -- start start 2023-12-20T04:48:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f3224fd2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32200b4980 0x7f3220152420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f3224fd2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32200d1aa0 0x7f32201f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f3224fd2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3220160450 0x7f32201f3110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f3224fd2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32201f3d90 con 0x7f32200d1aa0 2023-12-20T04:48:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f3224fd2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32201f4310 con 0x7f3220160450 2023-12-20T04:48:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f3224fd2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f32201f3700 con 0x7f32200b4980 2023-12-20T04:48:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f321dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32200d1aa0 0x7f32201f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f321dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32200d1aa0 0x7f32201f2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52740/0 (socket says 172.21.15.132:52740) 2023-12-20T04:48:40.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f321dd9b640 1 -- 172.21.15.132:0/280891969 learned_addr learned my addr 172.21.15.132:0/280891969 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:40.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f321ed9d640 1 --2- 172.21.15.132:0/280891969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3220160450 0x7f32201f3110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f321e59c640 1 --2- 172.21.15.132:0/280891969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32200b4980 0x7f3220152420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f321dd9b640 1 -- 172.21.15.132:0/280891969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32200b4980 msgr2=0x7f3220152420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f321dd9b640 1 --2- 172.21.15.132:0/280891969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32200b4980 0x7f3220152420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f321dd9b640 1 -- 172.21.15.132:0/280891969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3220160450 msgr2=0x7f32201f3110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f321dd9b640 1 --2- 172.21.15.132:0/280891969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3220160450 0x7f32201f3110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f321dd9b640 1 -- 172.21.15.132:0/280891969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3214009400 con 0x7f32200d1aa0 2023-12-20T04:48:40.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f321ed9d640 1 --2- 172.21.15.132:0/280891969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3220160450 0x7f32201f3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:40.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f321dd9b640 1 --2- 172.21.15.132:0/280891969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32200d1aa0 0x7f32201f2bd0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f3214000c00 tx=0x7f32140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:40.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f320effd640 1 -- 172.21.15.132:0/280891969 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3214032610 con 0x7f32200d1aa0 2023-12-20T04:48:40.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f320effd640 1 -- 172.21.15.132:0/280891969 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3214032770 con 0x7f32200d1aa0 2023-12-20T04:48:40.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f320effd640 1 -- 172.21.15.132:0/280891969 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3214032b00 con 0x7f32200d1aa0 2023-12-20T04:48:40.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.617+0000 7f3224fd2640 1 -- 172.21.15.132:0/280891969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32201f39e0 con 0x7f32200d1aa0 2023-12-20T04:48:40.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.618+0000 7f3224fd2640 1 -- 172.21.15.132:0/280891969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3220152960 con 0x7f32200d1aa0 2023-12-20T04:48:40.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.618+0000 7f3224fd2640 1 -- 172.21.15.132:0/280891969 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f322004e840 con 0x7f32200d1aa0 2023-12-20T04:48:40.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.619+0000 7f320effd640 1 -- 172.21.15.132:0/280891969 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3214032c60 con 0x7f32200d1aa0 2023-12-20T04:48:40.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.619+0000 7f320effd640 1 --2- 172.21.15.132:0/280891969 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f320006a430 0x7f320006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.619+0000 7f321e59c640 1 --2- 172.21.15.132:0/280891969 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f320006a430 0x7f320006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.619+0000 7f320effd640 1 -- 172.21.15.132:0/280891969 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f32140aa4f0 con 0x7f32200d1aa0 2023-12-20T04:48:40.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.620+0000 7f321e59c640 1 --2- 172.21.15.132:0/280891969 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f320006a430 0x7f320006c8f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3210001560 tx=0x7f3210009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:40.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.624+0000 7f320effd640 1 -- 172.21.15.132:0/280891969 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3214075a30 con 0x7f32200d1aa0 2023-12-20T04:48:40.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.786+0000 7f3224fd2640 1 -- 172.21.15.132:0/280891969 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f32200d1580 con 0x7f320006a430 2023-12-20T04:48:40.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.793+0000 7f320effd640 1 -- 172.21.15.132:0/280891969 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276447 (secure 0 0 0) 0x7f321000eec0 con 0x7f320006a430 2023-12-20T04:48:40.797 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:40.798 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:48:40.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.796+0000 7f3224fd2640 1 -- 172.21.15.132:0/280891969 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f320006a430 msgr2=0x7f320006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.796+0000 7f3224fd2640 1 --2- 172.21.15.132:0/280891969 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f320006a430 0x7f320006c8f0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7f3210001560 tx=0x7f3210009040 comp rx=0 tx=0).stop 2023-12-20T04:48:40.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.796+0000 7f3224fd2640 1 -- 172.21.15.132:0/280891969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32200d1aa0 msgr2=0x7f32201f2bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.796+0000 7f3224fd2640 1 --2- 172.21.15.132:0/280891969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32200d1aa0 0x7f32201f2bd0 secure :-1 s=READY pgs=1354 cs=0 l=1 rev1=1 crypto rx=0x7f3214000c00 tx=0x7f32140046c0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.796+0000 7f3224fd2640 1 -- 172.21.15.132:0/280891969 shutdown_connections 2023-12-20T04:48:40.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.796+0000 7f3224fd2640 1 --2- 172.21.15.132:0/280891969 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f320006a430 0x7f320006c8f0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.796+0000 7f3224fd2640 1 --2- 172.21.15.132:0/280891969 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3220160450 0x7f32201f3110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.796+0000 7f3224fd2640 1 --2- 172.21.15.132:0/280891969 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f32200d1aa0 0x7f32201f2bd0 unknown :-1 s=CLOSED pgs=1354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.796+0000 7f3224fd2640 1 --2- 172.21.15.132:0/280891969 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f32200b4980 0x7f3220152420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.796+0000 7f3224fd2640 1 -- 172.21.15.132:0/280891969 >> 172.21.15.132:0/280891969 conn(0x7f32200cf980 msgr2=0x7f32200b7420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:40.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.796+0000 7f3224fd2640 1 -- 172.21.15.132:0/280891969 shutdown_connections 2023-12-20T04:48:40.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.796+0000 7f3224fd2640 1 -- 172.21.15.132:0/280891969 wait complete. 2023-12-20T04:48:40.808 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2023-12-20T04:48:40.166599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6887,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555612,"statfs":{"total":1600000000,"available":1592947077,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.313615"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857406+0000","last_change":"2023-12-20T04:48:35.857406+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857406+0000","last_undegraded":"2023-12-20T04:48:35.857406+0000","last_fullsized":"2023-12-20T04:48:35.857406+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:41:26.866774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856154+0000","last_change":"2023-12-20T04:48:35.856154+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856154+0000","last_undegraded":"2023-12-20T04:48:35.856154+0000","last_fullsized":"2023-12-20T04:48:35.856154+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:45:37.758827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858837+0000","last_change":"2023-12-20T04:48:35.858837+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858837+0000","last_undegraded":"2023-12-20T04:48:35.858837+0000","last_fullsized":"2023-12-20T04:48:35.858837+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:59:46.853598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858372+0000","last_change":"2023-12-20T04:48:35.858372+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858372+0000","last_undegraded":"2023-12-20T04:48:35.858372+0000","last_fullsized":"2023-12-20T04:48:35.858372+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:05.361765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858408+0000","last_change":"2023-12-20T04:48:35.858408+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858408+0000","last_undegraded":"2023-12-20T04:48:35.858408+0000","last_fullsized":"2023-12-20T04:48:35.858408+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:38:39.178936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855923+0000","last_change":"2023-12-20T04:48:35.855923+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855923+0000","last_undegraded":"2023-12-20T04:48:35.855923+0000","last_fullsized":"2023-12-20T04:48:35.855923+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:05.495362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858688+0000","last_change":"2023-12-20T04:48:35.858688+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858688+0000","last_undegraded":"2023-12-20T04:48:35.858688+0000","last_fullsized":"2023-12-20T04:48:35.858688+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:45:37.758827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856340+0000","last_change":"2023-12-20T04:48:35.856340+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856340+0000","last_undegraded":"2023-12-20T04:48:35.856340+0000","last_fullsized":"2023-12-20T04:48:35.856340+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:04.225858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857989+0000","last_change":"2023-12-20T04:48:35.857989+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857989+0000","last_undegraded":"2023-12-20T04:48:35.857989+0000","last_fullsized":"2023-12-20T04:48:35.857989+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:19:23.525928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855901+0000","last_change":"2023-12-20T04:48:35.855901+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855901+0000","last_undegraded":"2023-12-20T04:48:35.855901+0000","last_fullsized":"2023-12-20T04:48:35.855901+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:46:09.941020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856493+0000","last_change":"2023-12-20T04:48:35.856493+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856493+0000","last_undegraded":"2023-12-20T04:48:35.856493+0000","last_fullsized":"2023-12-20T04:48:35.856493+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:35:42.399086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857430+0000","last_change":"2023-12-20T04:48:35.857430+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857430+0000","last_undegraded":"2023-12-20T04:48:35.857430+0000","last_fullsized":"2023-12-20T04:48:35.857430+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:44:24.972128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856903+0000","last_change":"2023-12-20T04:48:35.856903+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856903+0000","last_undegraded":"2023-12-20T04:48:35.856903+0000","last_fullsized":"2023-12-20T04:48:35.856903+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:24:31.465239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857799+0000","last_change":"2023-12-20T04:48:35.857799+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857799+0000","last_undegraded":"2023-12-20T04:48:35.857799+0000","last_fullsized":"2023-12-20T04:48:35.857799+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:46.737836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858471+0000","last_change":"2023-12-20T04:48:35.858471+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858471+0000","last_undegraded":"2023-12-20T04:48:35.858471+0000","last_fullsized":"2023-12-20T04:48:35.858471+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:27:05.379326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857052+0000","last_change":"2023-12-20T04:48:35.857052+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857052+0000","last_undegraded":"2023-12-20T04:48:35.857052+0000","last_fullsized":"2023-12-20T04:48:35.857052+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:54:30.482197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858358+0000","last_change":"2023-12-20T04:48:35.858358+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858358+0000","last_undegraded":"2023-12-20T04:48:35.858358+0000","last_fullsized":"2023-12-20T04:48:35.858358+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:31.190233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857061+0000","last_change":"2023-12-20T04:48:35.857061+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857061+0000","last_undegraded":"2023-12-20T04:48:35.857061+0000","last_fullsized":"2023-12-20T04:48:35.857061+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:13:02.368205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857258+0000","last_change":"2023-12-20T04:48:35.857258+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857258+0000","last_undegraded":"2023-12-20T04:48:35.857258+0000","last_fullsized":"2023-12-20T04:48:35.857258+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:49:25.498201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856392+0000","last_change":"2023-12-20T04:48:35.856392+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856392+0000","last_undegraded":"2023-12-20T04:48:35.856392+0000","last_fullsized":"2023-12-20T04:48:35.856392+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:21:11.425935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857689+0000","last_change":"2023-12-20T04:48:35.857689+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857689+0000","last_undegraded":"2023-12-20T04:48:35.857689+0000","last_fullsized":"2023-12-20T04:48:35.857689+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:06:08.922092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856579+0000","last_change":"2023-12-20T04:48:35.856579+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856579+0000","last_undegraded":"2023-12-20T04:48:35.856579+0000","last_fullsized":"2023-12-20T04:48:35.856579+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:55:54.167519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855880+0000","last_change":"2023-12-20T04:48:35.855880+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855880+0000","last_undegraded":"2023-12-20T04:48:35.855880+0000","last_fullsized":"2023-12-20T04:48:35.855880+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:57:21.208524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855446+0000","last_change":"2023-12-20T04:48:35.855446+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855446+0000","last_undegraded":"2023-12-20T04:48:35.855446+0000","last_fullsized":"2023-12-20T04:48:35.855446+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:45:34.903470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857026+0000","last_change":"2023-12-20T04:48:35.857026+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857026+0000","last_undegraded":"2023-12-20T04:48:35.857026+0000","last_fullsized":"2023-12-20T04:48:35.857026+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:39:00.957194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856691+0000","last_change":"2023-12-20T04:48:35.856691+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856691+0000","last_undegraded":"2023-12-20T04:48:35.856691+0000","last_fullsized":"2023-12-20T04:48:35.856691+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:51:30.201471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855446+0000","last_change":"2023-12-20T04:48:35.855446+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855446+0000","last_undegraded":"2023-12-20T04:48:35.855446+0000","last_fullsized":"2023-12-20T04:48:35.855446+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:57:07.085438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857410+0000","last_change":"2023-12-20T04:48:35.857410+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857410+0000","last_undegraded":"2023-12-20T04:48:35.857410+0000","last_fullsized":"2023-12-20T04:48:35.857410+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:14:17.093075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858690+0000","last_change":"2023-12-20T04:48:35.858690+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858690+0000","last_undegraded":"2023-12-20T04:48:35.858690+0000","last_fullsized":"2023-12-20T04:48:35.858690+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:59:50.306154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858117+0000","last_change":"2023-12-20T04:48:35.858117+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858117+0000","last_undegraded":"2023-12-20T04:48:35.858117+0000","last_fullsized":"2023-12-20T04:48:35.858117+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:35:43.620245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855875+0000","last_change":"2023-12-20T04:48:35.855875+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855875+0000","last_undegraded":"2023-12-20T04:48:35.855875+0000","last_fullsized":"2023-12-20T04:48:35.855875+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:43:00.715984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858050+0000","last_change":"2023-12-20T04:48:35.858050+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858050+0000","last_undegraded":"2023-12-20T04:48:35.858050+0000","last_fullsized":"2023-12-20T04:48:35.858050+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:05:43.588839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":261,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-12-20T04:48:34.353055+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:48:34.353055+0000","last_peered":"2023-12-20T04:48:34.353055+0000","last_clean":"2023-12-20T04:48:34.353055+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:48:34.353055+0000","last_undegraded":"2023-12-20T04:48:34.353055+0000","last_fullsized":"2023-12-20T04:48:34.353055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1296,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194015,"statfs":{"total":200000000,"available":198671973,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.42499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73399999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52200000000000002},"min":{"1min":0.33100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67300000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.437}]},{"osd":1,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.39700000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.68700000000000006,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71599999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.53900000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.65200000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70099999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55400000000000005}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70299999999999996,"5min":1.048,"15min":1.048},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47299999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65600000000000003,"5min":0.753,"15min":0.753},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.49199999999999999,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70399999999999996,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52900000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.49099999999999999},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68999999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.40500000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65400000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51900000000000002,"15min":0.54600000000000004},"min":{"1min":0.34399999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71599999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.626},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.50800000000000001,"15min":0.496},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.31900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.625}]},{"osd":1,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.53100000000000003},"min":{"1min":0.36699999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51400000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52200000000000002,"15min":0.50800000000000001},"min":{"1min":0.40100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69999999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.63900000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53100000000000003,"15min":0.5},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.60499999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48199999999999998,"15min":0.50600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.49399999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70399999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.56000000000000005}]},{"osd":5,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68799999999999994,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.70499999999999996}]},{"osd":7,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73199999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.76300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55100000000000005}]},{"osd":1,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.33300000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.80600000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.35899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51700000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.496},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.41499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68300000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.32300000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66100000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.371,"5min":0.312,"15min":0.312},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47699999999999998,"15min":0.503},"min":{"1min":0.28799999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.749,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.47599999999999998,"15min":0.48099999999999998},"min":{"1min":0.32800000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.434}]},{"osd":6,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48399999999999999,"15min":0.50600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52700000000000002,"15min":0.54200000000000004},"min":{"1min":0.37,"5min":0.31,"15min":0.31},"max":{"1min":0.78600000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58999999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73099999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75800000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.63}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.308,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.33000000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.67100000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.34200000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69899999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.36499999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.315}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54000000000000004,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.76000000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.371,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45000000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.501},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.48499999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.877,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.41099999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.56599999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48799999999999999,"15min":0.503},"min":{"1min":0.371,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.72199999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70499999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48999999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.34599999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35199999999999998,"15min":0.34000000000000002},"min":{"1min":0.20100000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.58299999999999996,"5min":0.629,"15min":0.629},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.374,"15min":0.35599999999999998},"min":{"1min":0.29099999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.56200000000000006,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.52000000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.32100000000000001},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.505},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.33700000000000002},"min":{"1min":0.27800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.44500000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35099999999999998,"15min":0.34499999999999997},"min":{"1min":0.249,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49299999999999999,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.376},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.53500000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55800000000000005,"15min":0.54300000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.76800000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.85999999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.45200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72199999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.91500000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.38500000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76700000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58399999999999996,"15min":0.56100000000000005},"min":{"1min":0.495,"5min":0.37,"15min":0.37},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.754}]},{"osd":7,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80600000000000005,"5min":0.879,"15min":0.879},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80300000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.96099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194592,"statfs":{"total":200000000,"available":199262341,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.29999999999999999},"min":{"1min":0.246,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.44700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39300000000000002,"15min":0.34499999999999997},"min":{"1min":0.25800000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.504,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.50600000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35599999999999998,"15min":0.33100000000000002},"min":{"1min":0.24099999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.54300000000000004,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.375,"15min":0.35099999999999998},"min":{"1min":0.247,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.5,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.52600000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.35999999999999999},"min":{"1min":0.27700000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.58299999999999996,"5min":0.995,"15min":0.995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.372},"min":{"1min":0.28100000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.53600000000000003,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.442,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75,"5min":2.347,"15min":2.347},"last":0.754}]},{"osd":5,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.42099999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84999999999999998,"5min":0.997,"15min":0.997},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70799999999999996}]},{"osd":6,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59199999999999997,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71699999999999997,"5min":2.274,"15min":2.274},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.82299999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.82499999999999996}]},{"osd":7,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.57099999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59099999999999997,"15min":0.57999999999999996},"min":{"1min":0.45100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.77700000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194592,"statfs":{"total":200000000,"available":199262341,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.316,"15min":0.28999999999999998},"min":{"1min":0.23000000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.35299999999999998,"15min":0.33100000000000002},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.33200000000000002,"15min":0.307},"min":{"1min":0.20599999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.52400000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.377,"15min":0.35099999999999998},"min":{"1min":0.26900000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.34999999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.35799999999999998},"min":{"1min":0.29499999999999998,"5min":0.191,"15min":0.191},"max":{"1min":0.61699999999999999,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36399999999999999,"15min":0.35299999999999998},"min":{"1min":0.26400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54800000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.45500000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.312,"15min":0.312},"max":{"1min":0.70999999999999996,"5min":0.873,"15min":0.873},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.45000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73099999999999998,"5min":1.002,"15min":1.002},"last":0.41899999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.42099999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.54200000000000004},"min":{"1min":0.45900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46400000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.47999999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":1.038,"15min":1.038},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.56299999999999994},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66900000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.44600000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.42899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72299999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.51500000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73499999999999999,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1291,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194021,"statfs":{"total":200000000,"available":198677790,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32200000000000001,"15min":0.31},"min":{"1min":0.25,"5min":0.184,"15min":0.184},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.314},"min":{"1min":0.27400000000000002,"5min":0.184,"15min":0.184},"max":{"1min":0.46300000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.25}]},{"osd":2,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.28599999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.53500000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.26500000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.51300000000000001,"5min":0.622,"15min":0.622},"last":0.30299999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34799999999999998,"15min":0.32500000000000001},"min":{"1min":0.29099999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.36899999999999999},"min":{"1min":0.29399999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.318}]},{"osd":4,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55200000000000005,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.432,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.621}]},{"osd":5,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.52200000000000002},"min":{"1min":0.432,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73199999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57199999999999995,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82999999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88200000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.502},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.58399999999999996},"min":{"1min":0.45300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.63400000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.747,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.39300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83399999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52600000000000002}]}]}],"pool_statfs":[]}} 2023-12-20T04:48:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3f is not active+clean 2023-12-20T04:48:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3e is not active+clean 2023-12-20T04:48:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3d is not active+clean 2023-12-20T04:48:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3c is not active+clean 2023-12-20T04:48:40.813 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3b is not active+clean 2023-12-20T04:48:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3a is not active+clean 2023-12-20T04:48:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.39 is not active+clean 2023-12-20T04:48:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.38 is not active+clean 2023-12-20T04:48:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.37 is not active+clean 2023-12-20T04:48:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.36 is not active+clean 2023-12-20T04:48:40.814 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.35 is not active+clean 2023-12-20T04:48:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.34 is not active+clean 2023-12-20T04:48:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.33 is not active+clean 2023-12-20T04:48:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.32 is not active+clean 2023-12-20T04:48:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.31 is not active+clean 2023-12-20T04:48:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.30 is not active+clean 2023-12-20T04:48:40.815 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2f is not active+clean 2023-12-20T04:48:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2e is not active+clean 2023-12-20T04:48:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2d is not active+clean 2023-12-20T04:48:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2c is not active+clean 2023-12-20T04:48:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2b is not active+clean 2023-12-20T04:48:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2a is not active+clean 2023-12-20T04:48:40.816 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.29 is not active+clean 2023-12-20T04:48:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.28 is not active+clean 2023-12-20T04:48:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.27 is not active+clean 2023-12-20T04:48:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.26 is not active+clean 2023-12-20T04:48:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.25 is not active+clean 2023-12-20T04:48:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.24 is not active+clean 2023-12-20T04:48:40.817 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.23 is not active+clean 2023-12-20T04:48:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.22 is not active+clean 2023-12-20T04:48:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.21 is not active+clean 2023-12-20T04:48:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.20 is not active+clean 2023-12-20T04:48:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1e is not active+clean 2023-12-20T04:48:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1f is not active+clean 2023-12-20T04:48:40.818 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.857406+0000', 'last_change': '2023-12-20T04:48:35.857406+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.857406+0000', 'last_undegraded': '2023-12-20T04:48:35.857406+0000', 'last_fullsized': '2023-12-20T04:48:35.857406+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T12:41:26.866774+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:48:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1f is not active+clean 2023-12-20T04:48:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1e is not active+clean 2023-12-20T04:48:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.856154+0000', 'last_change': '2023-12-20T04:48:35.856154+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.856154+0000', 'last_undegraded': '2023-12-20T04:48:35.856154+0000', 'last_fullsized': '2023-12-20T04:48:35.856154+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T11:45:37.758827+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:48:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1c is not active+clean 2023-12-20T04:48:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1d is not active+clean 2023-12-20T04:48:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.858837+0000', 'last_change': '2023-12-20T04:48:35.858837+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.858837+0000', 'last_undegraded': '2023-12-20T04:48:35.858837+0000', 'last_fullsized': '2023-12-20T04:48:35.858837+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T11:59:46.853598+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:48:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1d is not active+clean 2023-12-20T04:48:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1c is not active+clean 2023-12-20T04:48:40.819 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.858372+0000', 'last_change': '2023-12-20T04:48:35.858372+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.858372+0000', 'last_undegraded': '2023-12-20T04:48:35.858372+0000', 'last_fullsized': '2023-12-20T04:48:35.858372+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T04:55:05.361765+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:48:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1a is not active+clean 2023-12-20T04:48:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1b is not active+clean 2023-12-20T04:48:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.858408+0000', 'last_change': '2023-12-20T04:48:35.858408+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.858408+0000', 'last_undegraded': '2023-12-20T04:48:35.858408+0000', 'last_fullsized': '2023-12-20T04:48:35.858408+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T08:38:39.178936+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 1], 'acting': [5, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:48:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1b is not active+clean 2023-12-20T04:48:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1a is not active+clean 2023-12-20T04:48:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.855923+0000', 'last_change': '2023-12-20T04:48:35.855923+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.855923+0000', 'last_undegraded': '2023-12-20T04:48:35.855923+0000', 'last_fullsized': '2023-12-20T04:48:35.855923+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:49:05.495362+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:48:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.18 is not active+clean 2023-12-20T04:48:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.820 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.19 is not active+clean 2023-12-20T04:48:40.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.858688+0000', 'last_change': '2023-12-20T04:48:35.858688+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.858688+0000', 'last_undegraded': '2023-12-20T04:48:35.858688+0000', 'last_fullsized': '2023-12-20T04:48:35.858688+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T11:45:37.758827+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 3], 'acting': [4, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:48:40.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.19 is not active+clean 2023-12-20T04:48:40.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.18 is not active+clean 2023-12-20T04:48:40.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.856340+0000', 'last_change': '2023-12-20T04:48:35.856340+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.856340+0000', 'last_undegraded': '2023-12-20T04:48:35.856340+0000', 'last_fullsized': '2023-12-20T04:48:35.856340+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T06:10:04.225858+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:48:40.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.16 is not active+clean 2023-12-20T04:48:40.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.17 is not active+clean 2023-12-20T04:48:40.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.857989+0000', 'last_change': '2023-12-20T04:48:35.857989+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.857989+0000', 'last_undegraded': '2023-12-20T04:48:35.857989+0000', 'last_fullsized': '2023-12-20T04:48:35.857989+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:19:23.525928+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:48:40.821 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.17 is not active+clean 2023-12-20T04:48:40.821 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.16 is not active+clean 2023-12-20T04:48:40.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.855901+0000', 'last_change': '2023-12-20T04:48:35.855901+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.855901+0000', 'last_undegraded': '2023-12-20T04:48:35.855901+0000', 'last_fullsized': '2023-12-20T04:48:35.855901+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T05:46:09.941020+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:48:40.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.14 is not active+clean 2023-12-20T04:48:40.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.15 is not active+clean 2023-12-20T04:48:40.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.856493+0000', 'last_change': '2023-12-20T04:48:35.856493+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.856493+0000', 'last_undegraded': '2023-12-20T04:48:35.856493+0000', 'last_fullsized': '2023-12-20T04:48:35.856493+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T08:35:42.399086+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 1], 'acting': [0, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:48:40.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.15 is not active+clean 2023-12-20T04:48:40.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.14 is not active+clean 2023-12-20T04:48:40.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.857430+0000', 'last_change': '2023-12-20T04:48:35.857430+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.857430+0000', 'last_undegraded': '2023-12-20T04:48:35.857430+0000', 'last_fullsized': '2023-12-20T04:48:35.857430+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:44:24.972128+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 3], 'acting': [0, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:48:40.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.12 is not active+clean 2023-12-20T04:48:40.822 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.822 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.13 is not active+clean 2023-12-20T04:48:40.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.856903+0000', 'last_change': '2023-12-20T04:48:35.856903+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.856903+0000', 'last_undegraded': '2023-12-20T04:48:35.856903+0000', 'last_fullsized': '2023-12-20T04:48:35.856903+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T07:24:31.465239+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:48:40.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.13 is not active+clean 2023-12-20T04:48:40.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.12 is not active+clean 2023-12-20T04:48:40.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.857799+0000', 'last_change': '2023-12-20T04:48:35.857799+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.857799+0000', 'last_undegraded': '2023-12-20T04:48:35.857799+0000', 'last_fullsized': '2023-12-20T04:48:35.857799+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T05:14:46.737836+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:48:40.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.11 is not active+clean 2023-12-20T04:48:40.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.10 is not active+clean 2023-12-20T04:48:40.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.858471+0000', 'last_change': '2023-12-20T04:48:35.858471+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.858471+0000', 'last_undegraded': '2023-12-20T04:48:35.858471+0000', 'last_fullsized': '2023-12-20T04:48:35.858471+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T16:27:05.379326+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 0], 'acting': [2, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:48:40.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.e is not active+clean 2023-12-20T04:48:40.823 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.823 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.f is not active+clean 2023-12-20T04:48:40.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.857052+0000', 'last_change': '2023-12-20T04:48:35.857052+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.857052+0000', 'last_undegraded': '2023-12-20T04:48:35.857052+0000', 'last_fullsized': '2023-12-20T04:48:35.857052+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T07:54:30.482197+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 5], 'acting': [0, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:48:40.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.f is not active+clean 2023-12-20T04:48:40.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.e is not active+clean 2023-12-20T04:48:40.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.858358+0000', 'last_change': '2023-12-20T04:48:35.858358+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.858358+0000', 'last_undegraded': '2023-12-20T04:48:35.858358+0000', 'last_fullsized': '2023-12-20T04:48:35.858358+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:52:31.190233+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 4], 'acting': [2, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:48:40.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.c is not active+clean 2023-12-20T04:48:40.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.d is not active+clean 2023-12-20T04:48:40.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.857061+0000', 'last_change': '2023-12-20T04:48:35.857061+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.857061+0000', 'last_undegraded': '2023-12-20T04:48:35.857061+0000', 'last_fullsized': '2023-12-20T04:48:35.857061+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T11:13:02.368205+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:48:40.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.d is not active+clean 2023-12-20T04:48:40.824 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.824 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.c is not active+clean 2023-12-20T04:48:40.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.857258+0000', 'last_change': '2023-12-20T04:48:35.857258+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.857258+0000', 'last_undegraded': '2023-12-20T04:48:35.857258+0000', 'last_fullsized': '2023-12-20T04:48:35.857258+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:49:25.498201+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:48:40.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.a is not active+clean 2023-12-20T04:48:40.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.b is not active+clean 2023-12-20T04:48:40.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.856392+0000', 'last_change': '2023-12-20T04:48:35.856392+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.856392+0000', 'last_undegraded': '2023-12-20T04:48:35.856392+0000', 'last_fullsized': '2023-12-20T04:48:35.856392+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:21:11.425935+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:48:40.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.b is not active+clean 2023-12-20T04:48:40.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.a is not active+clean 2023-12-20T04:48:40.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.857689+0000', 'last_change': '2023-12-20T04:48:35.857689+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.857689+0000', 'last_undegraded': '2023-12-20T04:48:35.857689+0000', 'last_fullsized': '2023-12-20T04:48:35.857689+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T14:06:08.922092+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:48:40.825 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.8 is not active+clean 2023-12-20T04:48:40.825 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.9 is not active+clean 2023-12-20T04:48:40.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.856579+0000', 'last_change': '2023-12-20T04:48:35.856579+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.856579+0000', 'last_undegraded': '2023-12-20T04:48:35.856579+0000', 'last_fullsized': '2023-12-20T04:48:35.856579+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T14:55:54.167519+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:48:40.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.9 is not active+clean 2023-12-20T04:48:40.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.8 is not active+clean 2023-12-20T04:48:40.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.855880+0000', 'last_change': '2023-12-20T04:48:35.855880+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.855880+0000', 'last_undegraded': '2023-12-20T04:48:35.855880+0000', 'last_fullsized': '2023-12-20T04:48:35.855880+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T04:57:21.208524+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:48:40.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.6 is not active+clean 2023-12-20T04:48:40.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.7 is not active+clean 2023-12-20T04:48:40.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.855446+0000', 'last_change': '2023-12-20T04:48:35.855446+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.855446+0000', 'last_undegraded': '2023-12-20T04:48:35.855446+0000', 'last_fullsized': '2023-12-20T04:48:35.855446+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T12:45:34.903470+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 0], 'acting': [3, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:48:40.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.7 is not active+clean 2023-12-20T04:48:40.826 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.826 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.6 is not active+clean 2023-12-20T04:48:40.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.857026+0000', 'last_change': '2023-12-20T04:48:35.857026+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.857026+0000', 'last_undegraded': '2023-12-20T04:48:35.857026+0000', 'last_fullsized': '2023-12-20T04:48:35.857026+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T13:39:00.957194+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:48:40.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.4 is not active+clean 2023-12-20T04:48:40.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.5 is not active+clean 2023-12-20T04:48:40.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.856691+0000', 'last_change': '2023-12-20T04:48:35.856691+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.856691+0000', 'last_undegraded': '2023-12-20T04:48:35.856691+0000', 'last_fullsized': '2023-12-20T04:48:35.856691+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T13:51:30.201471+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:48:40.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.5 is not active+clean 2023-12-20T04:48:40.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.4 is not active+clean 2023-12-20T04:48:40.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.855446+0000', 'last_change': '2023-12-20T04:48:35.855446+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.855446+0000', 'last_undegraded': '2023-12-20T04:48:35.855446+0000', 'last_fullsized': '2023-12-20T04:48:35.855446+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:57:07.085438+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:48:40.827 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.2 is not active+clean 2023-12-20T04:48:40.827 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.3 is not active+clean 2023-12-20T04:48:40.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.857410+0000', 'last_change': '2023-12-20T04:48:35.857410+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.857410+0000', 'last_undegraded': '2023-12-20T04:48:35.857410+0000', 'last_fullsized': '2023-12-20T04:48:35.857410+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T12:14:17.093075+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 4], 'acting': [5, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:48:40.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.3 is not active+clean 2023-12-20T04:48:40.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.2 is not active+clean 2023-12-20T04:48:40.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.858690+0000', 'last_change': '2023-12-20T04:48:35.858690+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.858690+0000', 'last_undegraded': '2023-12-20T04:48:35.858690+0000', 'last_fullsized': '2023-12-20T04:48:35.858690+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T05:59:50.306154+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:48:40.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.0 is not active+clean 2023-12-20T04:48:40.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.1 is not active+clean 2023-12-20T04:48:40.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.858117+0000', 'last_change': '2023-12-20T04:48:35.858117+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.858117+0000', 'last_undegraded': '2023-12-20T04:48:35.858117+0000', 'last_fullsized': '2023-12-20T04:48:35.858117+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T06:35:43.620245+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 1], 'acting': [2, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:48:40.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.1 is not active+clean 2023-12-20T04:48:40.828 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.828 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.0 is not active+clean 2023-12-20T04:48:40.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.855875+0000', 'last_change': '2023-12-20T04:48:35.855875+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.855875+0000', 'last_undegraded': '2023-12-20T04:48:35.855875+0000', 'last_fullsized': '2023-12-20T04:48:35.855875+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T06:43:00.715984+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:48:40.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 17.10 is not active+clean 2023-12-20T04:48:40.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '17.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:48:36.853065+0000', 'last_change': '2023-12-20T04:48:36.853065+0000', 'last_active': '2023-12-20T04:48:36.853065+0000', 'last_peered': '2023-12-20T04:48:36.853065+0000', 'last_clean': '2023-12-20T04:48:36.853065+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:36.853065+0000', 'last_undegraded': '2023-12-20T04:48:36.853065+0000', 'last_fullsized': '2023-12-20T04:48:36.853065+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:36.853065+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:48:40.829 INFO:tasks.cephfs.filesystem.ceph_manager:PG 16.11 is not active+clean 2023-12-20T04:48:40.829 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '16.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 134, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:48:35.858050+0000', 'last_change': '2023-12-20T04:48:35.858050+0000', 'last_active': '2023-12-20T04:48:35.850601+0000', 'last_peered': '2023-12-20T04:48:35.850601+0000', 'last_clean': '2023-12-20T04:48:35.850601+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:48:35.858050+0000', 'last_undegraded': '2023-12-20T04:48:35.858050+0000', 'last_fullsized': '2023-12-20T04:48:35.858050+0000', 'mapping_epoch': 134, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 134, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'last_clean_scrub_stamp': '2023-12-20T04:48:35.850601+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T12:05:43.588839+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 0], 'acting': [5, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:48:40.829 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-20T04:48:40.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.947+0000 7fd066228640 1 Processor -- start 2023-12-20T04:48:40.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.947+0000 7fd066228640 1 -- start start 2023-12-20T04:48:40.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.947+0000 7fd066228640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd06006bba0 0x7fd06006f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.947+0000 7fd066228640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0600ad720 0x7fd0600ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.947+0000 7fd066228640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd06006c8e0 con 0x7fd060159bb0 2023-12-20T04:48:40.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.947+0000 7fd066228640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd06015e420 con 0x7fd06006bba0 2023-12-20T04:48:40.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.947+0000 7fd066228640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd06015e700 con 0x7fd0600ad720 2023-12-20T04:48:40.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd060159bb0 0x7fd06006b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47768/0 (socket says 172.21.15.132:47768) 2023-12-20T04:48:40.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05f7fe640 1 -- 172.21.15.132:0/2141155372 learned_addr learned my addr 172.21.15.132:0/2141155372 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:40.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05effd640 1 -- 172.21.15.132:0/2141155372 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3149389091 0 0) 0x7fd06006c8e0 con 0x7fd060159bb0 2023-12-20T04:48:40.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05effd640 1 -- 172.21.15.132:0/2141155372 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd04c003520 con 0x7fd060159bb0 2023-12-20T04:48:40.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd056ffd640 1 --2- 172.21.15.132:0/2141155372 >> v2:172.21.15.187:3300/0 conn(0x7fd06006bba0 0x7fd06006f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05ffff640 1 --2- 172.21.15.132:0/2141155372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0600ad720 0x7fd0600ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05effd640 1 -- 172.21.15.132:0/2141155372 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3317781547 0 0) 0x7fd04c003520 con 0x7fd060159bb0 2023-12-20T04:48:40.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05effd640 1 -- 172.21.15.132:0/2141155372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0600ad720 msgr2=0x7fd0600ca510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:40.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05effd640 1 --2- 172.21.15.132:0/2141155372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0600ad720 0x7fd0600ca510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05effd640 1 -- 172.21.15.132:0/2141155372 >> v2:172.21.15.187:3300/0 conn(0x7fd06006bba0 msgr2=0x7fd06006f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:40.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05effd640 1 --2- 172.21.15.132:0/2141155372 >> v2:172.21.15.187:3300/0 conn(0x7fd06006bba0 0x7fd06006f3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05effd640 1 -- 172.21.15.132:0/2141155372 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0600c9d10 con 0x7fd060159bb0 2023-12-20T04:48:40.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05effd640 1 -- 172.21.15.132:0/2141155372 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fd050001670 con 0x7fd060159bb0 2023-12-20T04:48:40.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05effd640 1 -- 172.21.15.132:0/2141155372 >> v1:172.21.15.132:6789/0 conn(0x7fd060159bb0 legacy=0x7fd06006b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05effd640 1 --2- 172.21.15.132:0/2141155372 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd04c003970 0x7fd04c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05effd640 1 --2- 172.21.15.132:0/2141155372 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04c0047c0 0x7fd04c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05effd640 1 --2- 172.21.15.132:0/2141155372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0600ad720 0x7fd04c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05effd640 1 -- 172.21.15.132:0/2141155372 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06015e420 con 0x7fd04c0047c0 2023-12-20T04:48:40.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05effd640 1 -- 172.21.15.132:0/2141155372 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06015e700 con 0x7fd04c003970 2023-12-20T04:48:40.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05effd640 1 -- 172.21.15.132:0/2141155372 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd04c00b980 con 0x7fd0600ad720 2023-12-20T04:48:40.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd056ffd640 1 --2- 172.21.15.132:0/2141155372 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04c0047c0 0x7fd04c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05f7fe640 1 --2- 172.21.15.132:0/2141155372 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd04c003970 0x7fd04c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.948+0000 7fd05ffff640 1 --2- 172.21.15.132:0/2141155372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0600ad720 0x7fd04c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.949+0000 7fd056ffd640 1 -- 172.21.15.132:0/2141155372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0600ad720 msgr2=0x7fd04c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:40.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.949+0000 7fd056ffd640 1 --2- 172.21.15.132:0/2141155372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd0600ad720 0x7fd04c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.949+0000 7fd056ffd640 1 -- 172.21.15.132:0/2141155372 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd04c003970 msgr2=0x7fd04c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:40.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.949+0000 7fd056ffd640 1 --2- 172.21.15.132:0/2141155372 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd04c003970 0x7fd04c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.949+0000 7fd056ffd640 1 -- 172.21.15.132:0/2141155372 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd04c003520 con 0x7fd04c0047c0 2023-12-20T04:48:40.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.949+0000 7fd056ffd640 1 --2- 172.21.15.132:0/2141155372 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04c0047c0 0x7fd04c004c40 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fd048009ac0 tx=0x7fd04c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242eb137da2f48f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:40.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.949+0000 7fd05effd640 1 -- 172.21.15.132:0/2141155372 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04802c710 con 0x7fd04c0047c0 2023-12-20T04:48:40.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.949+0000 7fd05effd640 1 -- 172.21.15.132:0/2141155372 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd04802c870 con 0x7fd04c0047c0 2023-12-20T04:48:40.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.949+0000 7fd05effd640 1 -- 172.21.15.132:0/2141155372 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd04802cc00 con 0x7fd04c0047c0 2023-12-20T04:48:40.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.950+0000 7fd066228640 1 -- 172.21.15.132:0/2141155372 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04c0047c0 msgr2=0x7fd04c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.950+0000 7fd066228640 1 --2- 172.21.15.132:0/2141155372 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04c0047c0 0x7fd04c004c40 secure :-1 s=READY pgs=1356 cs=0 l=1 rev1=1 crypto rx=0x7fd048009ac0 tx=0x7fd04c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.950+0000 7fd05ffff640 1 -- 172.21.15.132:0/2141155372 reap_dead start 2023-12-20T04:48:40.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.950+0000 7fd066228640 1 -- 172.21.15.132:0/2141155372 shutdown_connections 2023-12-20T04:48:40.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.950+0000 7fd066228640 1 -- 172.21.15.132:0/2141155372 >> 172.21.15.132:0/2141155372 conn(0x7fd06006a260 msgr2=0x7fd0600b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:40.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.950+0000 7fd066228640 1 -- 172.21.15.132:0/2141155372 shutdown_connections 2023-12-20T04:48:40.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.950+0000 7fd066228640 1 -- 172.21.15.132:0/2141155372 wait complete. 2023-12-20T04:48:40.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.951+0000 7fd066228640 1 Processor -- start 2023-12-20T04:48:40.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.951+0000 7fd066228640 1 -- start start 2023-12-20T04:48:40.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd066228640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04c0047c0 0x7fd06014a1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd066228640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd06014a710 0x7fd06014c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd066228640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd06014c970 0x7fd06014cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd066228640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06014ab90 con 0x7fd04c0047c0 2023-12-20T04:48:40.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd066228640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd06014d330 con 0x7fd06014c970 2023-12-20T04:48:40.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd066228640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd0600c6490 con 0x7fd06014a710 2023-12-20T04:48:40.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd05f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04c0047c0 0x7fd06014a1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd05f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04c0047c0 0x7fd06014a1d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52756/0 (socket says 172.21.15.132:52756) 2023-12-20T04:48:40.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd05f7fe640 1 -- 172.21.15.132:0/421023393 learned_addr learned my addr 172.21.15.132:0/421023393 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:40.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd056ffd640 1 --2- 172.21.15.132:0/421023393 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd06014a710 0x7fd06014c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd05ffff640 1 --2- 172.21.15.132:0/421023393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd06014c970 0x7fd06014cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd05f7fe640 1 -- 172.21.15.132:0/421023393 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd06014a710 msgr2=0x7fd06014c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd05f7fe640 1 --2- 172.21.15.132:0/421023393 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd06014a710 0x7fd06014c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd05f7fe640 1 -- 172.21.15.132:0/421023393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd06014c970 msgr2=0x7fd06014cdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:40.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd05f7fe640 1 --2- 172.21.15.132:0/421023393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd06014c970 0x7fd06014cdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:40.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd05f7fe640 1 -- 172.21.15.132:0/421023393 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd0600c6770 con 0x7fd04c0047c0 2023-12-20T04:48:40.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd056ffd640 1 --2- 172.21.15.132:0/421023393 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd06014a710 0x7fd06014c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:40.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.952+0000 7fd05ffff640 1 --2- 172.21.15.132:0/421023393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd06014c970 0x7fd06014cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:40.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.953+0000 7fd05f7fe640 1 --2- 172.21.15.132:0/421023393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04c0047c0 0x7fd06014a1d0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fd050007310 tx=0x7fd0500077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:40.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.953+0000 7fd05cff9640 1 -- 172.21.15.132:0/421023393 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05000f940 con 0x7fd04c0047c0 2023-12-20T04:48:40.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.953+0000 7fd05cff9640 1 -- 172.21.15.132:0/421023393 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd05000fac0 con 0x7fd04c0047c0 2023-12-20T04:48:40.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.953+0000 7fd066228640 1 -- 172.21.15.132:0/421023393 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd0600c6a50 con 0x7fd04c0047c0 2023-12-20T04:48:40.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.953+0000 7fd05cff9640 1 -- 172.21.15.132:0/421023393 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd05000fe70 con 0x7fd04c0047c0 2023-12-20T04:48:40.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.953+0000 7fd066228640 1 -- 172.21.15.132:0/421023393 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd0600c7010 con 0x7fd04c0047c0 2023-12-20T04:48:40.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.954+0000 7fd066228640 1 -- 172.21.15.132:0/421023393 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd06004e840 con 0x7fd04c0047c0 2023-12-20T04:48:40.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.954+0000 7fd05cff9640 1 -- 172.21.15.132:0/421023393 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd05001d460 con 0x7fd04c0047c0 2023-12-20T04:48:40.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.955+0000 7fd05cff9640 1 --2- 172.21.15.132:0/421023393 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd04006a3f0 0x7fd04006c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:40.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.955+0000 7fd056ffd640 1 --2- 172.21.15.132:0/421023393 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd04006a3f0 0x7fd04006c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:40.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.955+0000 7fd05cff9640 1 -- 172.21.15.132:0/421023393 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd050088b30 con 0x7fd04c0047c0 2023-12-20T04:48:40.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.955+0000 7fd056ffd640 1 --2- 172.21.15.132:0/421023393 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd04006a3f0 0x7fd04006c8b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd048036000 tx=0x7fd048030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:40.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:40.959+0000 7fd05cff9640 1 -- 172.21.15.132:0/421023393 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd050054120 con 0x7fd04c0047c0 2023-12-20T04:48:41.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.190+0000 7fd066228640 1 -- 172.21.15.132:0/421023393 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7fd06006c450 con 0x7fd04c0047c0 2023-12-20T04:48:41.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.191+0000 7fd05cff9640 1 -- 172.21.15.132:0/421023393 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1522 (secure 0 0 0) 0x7fd050057740 con 0x7fd04c0047c0 2023-12-20T04:48:41.193 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:41.193 INFO:teuthology.orchestra.run.smithi132.stdout:{"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":371,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":137,"num_osds":8,"num_up_osds":8,"osd_up_since":1703047355,"num_in_osds":8,"osd_in_since":1703047352,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":7052923,"bytes_avail":1592947077,"bytes_total":1600000000,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":51,"id":8,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":8,"rank":0,"name":"d","status":"up:active","gid":7845}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":5,"modified":"2023-12-20T04:47:54.158453+0000","services":{"mds":{"daemons":{"summary":"","a":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"c":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}},"d":{"start_epoch":0,"start_stamp":"0.000000","gid":0,"addr":"(unrecognized address family 0)/0","metadata":{},"task_status":{}}}}}},"progress_events":{}} 2023-12-20T04:48:41.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.193+0000 7fd066228640 1 -- 172.21.15.132:0/421023393 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd04006a3f0 msgr2=0x7fd04006c8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:41.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.193+0000 7fd066228640 1 --2- 172.21.15.132:0/421023393 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd04006a3f0 0x7fd04006c8b0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fd048036000 tx=0x7fd048030000 comp rx=0 tx=0).stop 2023-12-20T04:48:41.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.193+0000 7fd066228640 1 -- 172.21.15.132:0/421023393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04c0047c0 msgr2=0x7fd06014a1d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:41.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.193+0000 7fd066228640 1 --2- 172.21.15.132:0/421023393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04c0047c0 0x7fd06014a1d0 secure :-1 s=READY pgs=1357 cs=0 l=1 rev1=1 crypto rx=0x7fd050007310 tx=0x7fd0500077d0 comp rx=0 tx=0).stop 2023-12-20T04:48:41.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.193+0000 7fd066228640 1 -- 172.21.15.132:0/421023393 shutdown_connections 2023-12-20T04:48:41.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.193+0000 7fd066228640 1 --2- 172.21.15.132:0/421023393 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd04006a3f0 0x7fd04006c8b0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:41.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.193+0000 7fd066228640 1 --2- 172.21.15.132:0/421023393 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd06014c970 0x7fd06014cdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:41.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.193+0000 7fd066228640 1 --2- 172.21.15.132:0/421023393 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd06014a710 0x7fd06014c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:41.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.193+0000 7fd066228640 1 --2- 172.21.15.132:0/421023393 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd04c0047c0 0x7fd06014a1d0 unknown :-1 s=CLOSED pgs=1357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:41.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.193+0000 7fd066228640 1 -- 172.21.15.132:0/421023393 >> 172.21.15.132:0/421023393 conn(0x7fd06006a260 msgr2=0x7fd0600701d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:41.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.193+0000 7fd066228640 1 -- 172.21.15.132:0/421023393 shutdown_connections 2023-12-20T04:48:41.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.193+0000 7fd066228640 1 -- 172.21.15.132:0/421023393 wait complete. 2023-12-20T04:48:41.206 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-20T04:48:41.206 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:48:41.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.305+0000 7f7cc57f0640 1 Processor -- start 2023-12-20T04:48:41.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.305+0000 7f7cc57f0640 1 -- start start 2023-12-20T04:48:41.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.306+0000 7f7cc57f0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cc00d0370 0x7f7cc00b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:41.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.306+0000 7f7cc57f0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc00b2f90 con 0x7f7cc015d100 2023-12-20T04:48:41.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.306+0000 7f7cc57f0640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc01613c0 con 0x7f7cc00cdc10 2023-12-20T04:48:41.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.306+0000 7f7cc57f0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00d1b00 con 0x7f7cc00d0370 2023-12-20T04:48:41.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.306+0000 7f7cbeffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7cc015d100 0x7f7cc00cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47778/0 (socket says 172.21.15.132:47778) 2023-12-20T04:48:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.306+0000 7f7cbeffd640 1 -- 172.21.15.132:0/4011718100 learned_addr learned my addr 172.21.15.132:0/4011718100 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.306+0000 7f7cbe7fc640 1 --2- 172.21.15.132:0/4011718100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cc00d0370 0x7f7cc00b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.306+0000 7f7cbdffb640 1 -- 172.21.15.132:0/4011718100 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3599526386 0 0) 0x7f7cb0001110 con 0x7f7cc015d100 2023-12-20T04:48:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.306+0000 7f7cbdffb640 1 -- 172.21.15.132:0/4011718100 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7ca8003520 con 0x7f7cc015d100 2023-12-20T04:48:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbdffb640 1 -- 172.21.15.132:0/4011718100 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2663127776 0 0) 0x7f7ca8003520 con 0x7f7cc015d100 2023-12-20T04:48:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbdffb640 1 -- 172.21.15.132:0/4011718100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cc00d0370 msgr2=0x7f7cc00b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbdffb640 1 --2- 172.21.15.132:0/4011718100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cc00d0370 0x7f7cc00b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbdffb640 1 -- 172.21.15.132:0/4011718100 >> v1:172.21.15.187:6789/0 conn(0x7f7cc00cdc10 legacy=0x7f7cc006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbdffb640 1 -- 172.21.15.132:0/4011718100 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc00d0810 con 0x7f7cc015d100 2023-12-20T04:48:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbdffb640 1 -- 172.21.15.132:0/4011718100 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f7cb0001800 con 0x7f7cc015d100 2023-12-20T04:48:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbdffb640 1 -- 172.21.15.132:0/4011718100 >> v1:172.21.15.132:6789/0 conn(0x7f7cc015d100 legacy=0x7f7cc00cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbdffb640 1 --2- 172.21.15.132:0/4011718100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ca80039a0 0x7f7ca8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbdffb640 1 --2- 172.21.15.132:0/4011718100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ca80047c0 0x7f7ca8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbdffb640 1 --2- 172.21.15.132:0/4011718100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cc00d0370 0x7f7ca80051e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbdffb640 1 -- 172.21.15.132:0/4011718100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00d1b00 con 0x7f7ca80039a0 2023-12-20T04:48:41.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbdffb640 1 -- 172.21.15.132:0/4011718100 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca800bb10 con 0x7f7ca80047c0 2023-12-20T04:48:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbdffb640 1 -- 172.21.15.132:0/4011718100 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7ca800bcd0 con 0x7f7cc00d0370 2023-12-20T04:48:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbeffd640 1 --2- 172.21.15.132:0/4011718100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ca80039a0 0x7f7ca8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbe7fc640 1 --2- 172.21.15.132:0/4011718100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ca80047c0 0x7f7ca8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbf7fe640 1 --2- 172.21.15.132:0/4011718100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cc00d0370 0x7f7ca80051e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbeffd640 1 -- 172.21.15.132:0/4011718100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cc00d0370 msgr2=0x7f7ca80051e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbeffd640 1 --2- 172.21.15.132:0/4011718100 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cc00d0370 0x7f7ca80051e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbeffd640 1 -- 172.21.15.132:0/4011718100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ca80047c0 msgr2=0x7f7ca8004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbeffd640 1 --2- 172.21.15.132:0/4011718100 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7ca80047c0 0x7f7ca8004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.307+0000 7f7cbeffd640 1 -- 172.21.15.132:0/4011718100 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7ca8003520 con 0x7f7ca80039a0 2023-12-20T04:48:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.308+0000 7f7cbeffd640 1 --2- 172.21.15.132:0/4011718100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ca80039a0 0x7f7ca8003dc0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000c240 tx=0x7f7ca80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92b3c24e6466b837 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.308+0000 7f7cbdffb640 1 -- 172.21.15.132:0/4011718100 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb0005ad0 con 0x7f7ca80039a0 2023-12-20T04:48:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.308+0000 7f7cbdffb640 1 -- 172.21.15.132:0/4011718100 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb0005c50 con 0x7f7ca80039a0 2023-12-20T04:48:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.308+0000 7f7cbdffb640 1 -- 172.21.15.132:0/4011718100 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb002c8b0 con 0x7f7ca80039a0 2023-12-20T04:48:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.308+0000 7f7cc57f0640 1 -- 172.21.15.132:0/4011718100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ca80039a0 msgr2=0x7f7ca8003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.308+0000 7f7cc57f0640 1 --2- 172.21.15.132:0/4011718100 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7ca80039a0 0x7f7ca8003dc0 secure :-1 s=READY pgs=1359 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000c240 tx=0x7f7ca80057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:41.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.308+0000 7f7cbf7fe640 1 -- 172.21.15.132:0/4011718100 reap_dead start 2023-12-20T04:48:41.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.308+0000 7f7cc57f0640 1 -- 172.21.15.132:0/4011718100 shutdown_connections 2023-12-20T04:48:41.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.308+0000 7f7cc57f0640 1 -- 172.21.15.132:0/4011718100 >> 172.21.15.132:0/4011718100 conn(0x7f7cc006d7c0 msgr2=0x7f7cc006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:41.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.308+0000 7f7cc57f0640 1 -- 172.21.15.132:0/4011718100 shutdown_connections 2023-12-20T04:48:41.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.308+0000 7f7cc57f0640 1 -- 172.21.15.132:0/4011718100 wait complete. 2023-12-20T04:48:41.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.310+0000 7f7cc57f0640 1 Processor -- start 2023-12-20T04:48:41.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.310+0000 7f7cc57f0640 1 -- start start 2023-12-20T04:48:41.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.310+0000 7f7cc57f0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ca80039a0 0x7f7cc01546c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:41.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.310+0000 7f7cc57f0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cc00c9660 0x7f7cc00c8c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:41.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.310+0000 7f7cc57f0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc006bec0 0x7f7cc006c340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:41.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.310+0000 7f7cc57f0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc006c880 con 0x7f7cc006bec0 2023-12-20T04:48:41.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.310+0000 7f7cc57f0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00c9b90 con 0x7f7cc00c9660 2023-12-20T04:48:41.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.310+0000 7f7cc57f0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc00c9e70 con 0x7f7ca80039a0 2023-12-20T04:48:41.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.310+0000 7f7cbf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc006bec0 0x7f7cc006c340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:41.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.310+0000 7f7cbf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc006bec0 0x7f7cc006c340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52778/0 (socket says 172.21.15.132:52778) 2023-12-20T04:48:41.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.311+0000 7f7cbf7fe640 1 -- 172.21.15.132:0/269104314 learned_addr learned my addr 172.21.15.132:0/269104314 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:41.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.311+0000 7f7cbeffd640 1 --2- 172.21.15.132:0/269104314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ca80039a0 0x7f7cc01546c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:41.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.311+0000 7f7cbe7fc640 1 --2- 172.21.15.132:0/269104314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cc00c9660 0x7f7cc00c8c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:41.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.311+0000 7f7cbf7fe640 1 -- 172.21.15.132:0/269104314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ca80039a0 msgr2=0x7f7cc01546c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:41.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.311+0000 7f7cbf7fe640 1 --2- 172.21.15.132:0/269104314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ca80039a0 0x7f7cc01546c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:41.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.311+0000 7f7cbf7fe640 1 -- 172.21.15.132:0/269104314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cc00c9660 msgr2=0x7f7cc00c8c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:41.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.311+0000 7f7cbf7fe640 1 --2- 172.21.15.132:0/269104314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cc00c9660 0x7f7cc00c8c00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:41.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.311+0000 7f7cbf7fe640 1 -- 172.21.15.132:0/269104314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc00ca150 con 0x7f7cc006bec0 2023-12-20T04:48:41.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.311+0000 7f7cbeffd640 1 --2- 172.21.15.132:0/269104314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ca80039a0 0x7f7cc01546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:41.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.311+0000 7f7cbe7fc640 1 --2- 172.21.15.132:0/269104314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cc00c9660 0x7f7cc00c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:41.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.311+0000 7f7cbf7fe640 1 --2- 172.21.15.132:0/269104314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc006bec0 0x7f7cc006c340 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00cb380 tx=0x7f7cb800ec10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:41.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.311+0000 7f7ca77fe640 1 -- 172.21.15.132:0/269104314 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8003970 con 0x7f7cc006bec0 2023-12-20T04:48:41.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.311+0000 7f7ca77fe640 1 -- 172.21.15.132:0/269104314 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cb8003ad0 con 0x7f7cc006bec0 2023-12-20T04:48:41.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.311+0000 7f7cc57f0640 1 -- 172.21.15.132:0/269104314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc00ca430 con 0x7f7cc006bec0 2023-12-20T04:48:41.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.311+0000 7f7ca77fe640 1 -- 172.21.15.132:0/269104314 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cb8003e80 con 0x7f7cc006bec0 2023-12-20T04:48:41.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.311+0000 7f7cc57f0640 1 -- 172.21.15.132:0/269104314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc00c9140 con 0x7f7cc006bec0 2023-12-20T04:48:41.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.312+0000 7f7cc57f0640 1 -- 172.21.15.132:0/269104314 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc00ceb80 con 0x7f7cc006bec0 2023-12-20T04:48:41.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.313+0000 7f7ca77fe640 1 -- 172.21.15.132:0/269104314 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7cb80050d0 con 0x7f7cc006bec0 2023-12-20T04:48:41.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.313+0000 7f7ca77fe640 1 --2- 172.21.15.132:0/269104314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7cac06a430 0x7f7cac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:41.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.313+0000 7f7ca77fe640 1 -- 172.21.15.132:0/269104314 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7cb8088620 con 0x7f7cc006bec0 2023-12-20T04:48:41.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.313+0000 7f7cbeffd640 1 --2- 172.21.15.132:0/269104314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7cac06a430 0x7f7cac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:41.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.314+0000 7f7cbeffd640 1 --2- 172.21.15.132:0/269104314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7cac06a430 0x7f7cac06c8f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000c240 tx=0x7f7cb0009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:41.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.317+0000 7f7ca77fe640 1 -- 172.21.15.132:0/269104314 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7cb8053ca0 con 0x7f7cc006bec0 2023-12-20T04:48:41.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.478+0000 7f7cc57f0640 1 -- 172.21.15.132:0/269104314 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7cc0161050 con 0x7f7cac06a430 2023-12-20T04:48:41.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.485+0000 7f7ca77fe640 1 -- 172.21.15.132:0/269104314 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276447 (secure 0 0 0) 0x7f7cb00015c0 con 0x7f7cac06a430 2023-12-20T04:48:41.489 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:41.491 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:48:41.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.488+0000 7f7cc57f0640 1 -- 172.21.15.132:0/269104314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7cac06a430 msgr2=0x7f7cac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:41.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.488+0000 7f7cc57f0640 1 --2- 172.21.15.132:0/269104314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7cac06a430 0x7f7cac06c8f0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 crypto rx=0x7f7cb000c240 tx=0x7f7cb0009030 comp rx=0 tx=0).stop 2023-12-20T04:48:41.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.488+0000 7f7cc57f0640 1 -- 172.21.15.132:0/269104314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc006bec0 msgr2=0x7f7cc006c340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:41.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.488+0000 7f7cc57f0640 1 --2- 172.21.15.132:0/269104314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc006bec0 0x7f7cc006c340 secure :-1 s=READY pgs=1360 cs=0 l=1 rev1=1 crypto rx=0x7f7cc00cb380 tx=0x7f7cb800ec10 comp rx=0 tx=0).stop 2023-12-20T04:48:41.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.488+0000 7f7cc57f0640 1 -- 172.21.15.132:0/269104314 shutdown_connections 2023-12-20T04:48:41.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.488+0000 7f7cc57f0640 1 --2- 172.21.15.132:0/269104314 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7cac06a430 0x7f7cac06c8f0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:41.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.488+0000 7f7cc57f0640 1 --2- 172.21.15.132:0/269104314 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc006bec0 0x7f7cc006c340 unknown :-1 s=CLOSED pgs=1360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:41.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.488+0000 7f7cc57f0640 1 --2- 172.21.15.132:0/269104314 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cc00c9660 0x7f7cc00c8c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:41.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.488+0000 7f7cc57f0640 1 --2- 172.21.15.132:0/269104314 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7ca80039a0 0x7f7cc01546c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:41.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.488+0000 7f7cc57f0640 1 -- 172.21.15.132:0/269104314 >> 172.21.15.132:0/269104314 conn(0x7f7cc006d7c0 msgr2=0x7f7cc00b1ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:41.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.488+0000 7f7cc57f0640 1 -- 172.21.15.132:0/269104314 shutdown_connections 2023-12-20T04:48:41.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:41.488+0000 7f7cc57f0640 1 -- 172.21.15.132:0/269104314 wait complete. 2023-12-20T04:48:41.501 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":311,"stamp":"2023-12-20T04:48:40.166599+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":6887,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555612,"statfs":{"total":1600000000,"available":1592947077,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.313615"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857406+0000","last_change":"2023-12-20T04:48:35.857406+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857406+0000","last_undegraded":"2023-12-20T04:48:35.857406+0000","last_fullsized":"2023-12-20T04:48:35.857406+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:41:26.866774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856154+0000","last_change":"2023-12-20T04:48:35.856154+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856154+0000","last_undegraded":"2023-12-20T04:48:35.856154+0000","last_fullsized":"2023-12-20T04:48:35.856154+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:45:37.758827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858837+0000","last_change":"2023-12-20T04:48:35.858837+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858837+0000","last_undegraded":"2023-12-20T04:48:35.858837+0000","last_fullsized":"2023-12-20T04:48:35.858837+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:59:46.853598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858372+0000","last_change":"2023-12-20T04:48:35.858372+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858372+0000","last_undegraded":"2023-12-20T04:48:35.858372+0000","last_fullsized":"2023-12-20T04:48:35.858372+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:05.361765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858408+0000","last_change":"2023-12-20T04:48:35.858408+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858408+0000","last_undegraded":"2023-12-20T04:48:35.858408+0000","last_fullsized":"2023-12-20T04:48:35.858408+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:38:39.178936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855923+0000","last_change":"2023-12-20T04:48:35.855923+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855923+0000","last_undegraded":"2023-12-20T04:48:35.855923+0000","last_fullsized":"2023-12-20T04:48:35.855923+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:05.495362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858688+0000","last_change":"2023-12-20T04:48:35.858688+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858688+0000","last_undegraded":"2023-12-20T04:48:35.858688+0000","last_fullsized":"2023-12-20T04:48:35.858688+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:45:37.758827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856340+0000","last_change":"2023-12-20T04:48:35.856340+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856340+0000","last_undegraded":"2023-12-20T04:48:35.856340+0000","last_fullsized":"2023-12-20T04:48:35.856340+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:04.225858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857989+0000","last_change":"2023-12-20T04:48:35.857989+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857989+0000","last_undegraded":"2023-12-20T04:48:35.857989+0000","last_fullsized":"2023-12-20T04:48:35.857989+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:19:23.525928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855901+0000","last_change":"2023-12-20T04:48:35.855901+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855901+0000","last_undegraded":"2023-12-20T04:48:35.855901+0000","last_fullsized":"2023-12-20T04:48:35.855901+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:46:09.941020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.15","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856493+0000","last_change":"2023-12-20T04:48:35.856493+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856493+0000","last_undegraded":"2023-12-20T04:48:35.856493+0000","last_fullsized":"2023-12-20T04:48:35.856493+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:35:42.399086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.14","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857430+0000","last_change":"2023-12-20T04:48:35.857430+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857430+0000","last_undegraded":"2023-12-20T04:48:35.857430+0000","last_fullsized":"2023-12-20T04:48:35.857430+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:44:24.972128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.13","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856903+0000","last_change":"2023-12-20T04:48:35.856903+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856903+0000","last_undegraded":"2023-12-20T04:48:35.856903+0000","last_fullsized":"2023-12-20T04:48:35.856903+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:24:31.465239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857799+0000","last_change":"2023-12-20T04:48:35.857799+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857799+0000","last_undegraded":"2023-12-20T04:48:35.857799+0000","last_fullsized":"2023-12-20T04:48:35.857799+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:46.737836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.10","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858471+0000","last_change":"2023-12-20T04:48:35.858471+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858471+0000","last_undegraded":"2023-12-20T04:48:35.858471+0000","last_fullsized":"2023-12-20T04:48:35.858471+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:27:05.379326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.f","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857052+0000","last_change":"2023-12-20T04:48:35.857052+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857052+0000","last_undegraded":"2023-12-20T04:48:35.857052+0000","last_fullsized":"2023-12-20T04:48:35.857052+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:54:30.482197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.e","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858358+0000","last_change":"2023-12-20T04:48:35.858358+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858358+0000","last_undegraded":"2023-12-20T04:48:35.858358+0000","last_fullsized":"2023-12-20T04:48:35.858358+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:31.190233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.d","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857061+0000","last_change":"2023-12-20T04:48:35.857061+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857061+0000","last_undegraded":"2023-12-20T04:48:35.857061+0000","last_fullsized":"2023-12-20T04:48:35.857061+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:13:02.368205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857258+0000","last_change":"2023-12-20T04:48:35.857258+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857258+0000","last_undegraded":"2023-12-20T04:48:35.857258+0000","last_fullsized":"2023-12-20T04:48:35.857258+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:49:25.498201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.b","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856392+0000","last_change":"2023-12-20T04:48:35.856392+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856392+0000","last_undegraded":"2023-12-20T04:48:35.856392+0000","last_fullsized":"2023-12-20T04:48:35.856392+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:21:11.425935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857689+0000","last_change":"2023-12-20T04:48:35.857689+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857689+0000","last_undegraded":"2023-12-20T04:48:35.857689+0000","last_fullsized":"2023-12-20T04:48:35.857689+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:06:08.922092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856579+0000","last_change":"2023-12-20T04:48:35.856579+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856579+0000","last_undegraded":"2023-12-20T04:48:35.856579+0000","last_fullsized":"2023-12-20T04:48:35.856579+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:55:54.167519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855880+0000","last_change":"2023-12-20T04:48:35.855880+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855880+0000","last_undegraded":"2023-12-20T04:48:35.855880+0000","last_fullsized":"2023-12-20T04:48:35.855880+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:57:21.208524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.7","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855446+0000","last_change":"2023-12-20T04:48:35.855446+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855446+0000","last_undegraded":"2023-12-20T04:48:35.855446+0000","last_fullsized":"2023-12-20T04:48:35.855446+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:45:34.903470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857026+0000","last_change":"2023-12-20T04:48:35.857026+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857026+0000","last_undegraded":"2023-12-20T04:48:35.857026+0000","last_fullsized":"2023-12-20T04:48:35.857026+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:39:00.957194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.856691+0000","last_change":"2023-12-20T04:48:35.856691+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.856691+0000","last_undegraded":"2023-12-20T04:48:35.856691+0000","last_fullsized":"2023-12-20T04:48:35.856691+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:51:30.201471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855446+0000","last_change":"2023-12-20T04:48:35.855446+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855446+0000","last_undegraded":"2023-12-20T04:48:35.855446+0000","last_fullsized":"2023-12-20T04:48:35.855446+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:57:07.085438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.857410+0000","last_change":"2023-12-20T04:48:35.857410+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.857410+0000","last_undegraded":"2023-12-20T04:48:35.857410+0000","last_fullsized":"2023-12-20T04:48:35.857410+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:14:17.093075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858690+0000","last_change":"2023-12-20T04:48:35.858690+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858690+0000","last_undegraded":"2023-12-20T04:48:35.858690+0000","last_fullsized":"2023-12-20T04:48:35.858690+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:59:50.306154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858117+0000","last_change":"2023-12-20T04:48:35.858117+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858117+0000","last_undegraded":"2023-12-20T04:48:35.858117+0000","last_fullsized":"2023-12-20T04:48:35.858117+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:35:43.620245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.855875+0000","last_change":"2023-12-20T04:48:35.855875+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.855875+0000","last_undegraded":"2023-12-20T04:48:35.855875+0000","last_fullsized":"2023-12-20T04:48:35.855875+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:43:00.715984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:48:36.853065+0000","last_change":"2023-12-20T04:48:36.853065+0000","last_active":"2023-12-20T04:48:36.853065+0000","last_peered":"2023-12-20T04:48:36.853065+0000","last_clean":"2023-12-20T04:48:36.853065+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:36.853065+0000","last_undegraded":"2023-12-20T04:48:36.853065+0000","last_fullsized":"2023-12-20T04:48:36.853065+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":1,"reported_epoch":134,"state":"creating+peering","last_fresh":"2023-12-20T04:48:35.858050+0000","last_change":"2023-12-20T04:48:35.858050+0000","last_active":"2023-12-20T04:48:35.850601+0000","last_peered":"2023-12-20T04:48:35.850601+0000","last_clean":"2023-12-20T04:48:35.850601+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:48:35.858050+0000","last_undegraded":"2023-12-20T04:48:35.858050+0000","last_fullsized":"2023-12-20T04:48:35.858050+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:05:43.588839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":261,"reported_epoch":133,"state":"active+clean","last_fresh":"2023-12-20T04:48:34.353055+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:48:34.353055+0000","last_peered":"2023-12-20T04:48:34.353055+0000","last_clean":"2023-12-20T04:48:34.353055+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:48:34.353055+0000","last_undegraded":"2023-12-20T04:48:34.353055+0000","last_fullsized":"2023-12-20T04:48:34.353055+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574922,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1296,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194015,"statfs":{"total":200000000,"available":198671973,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.42499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73399999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52200000000000002},"min":{"1min":0.33100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67300000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.437}]},{"osd":1,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.39700000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.68700000000000006,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71599999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.53900000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.65200000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70099999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.55400000000000005}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70299999999999996,"5min":1.048,"15min":1.048},"last":0.59899999999999998},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.47299999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65600000000000003,"5min":0.753,"15min":0.753},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.49199999999999999,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70399999999999996,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.52900000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.49099999999999999},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68999999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.40500000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.65400000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51900000000000002,"15min":0.54600000000000004},"min":{"1min":0.34399999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71599999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.626},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.64700000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.50800000000000001,"15min":0.496},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.31900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.625}]},{"osd":1,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.53100000000000003},"min":{"1min":0.36699999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.51400000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52200000000000002,"15min":0.50800000000000001},"min":{"1min":0.40100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69999999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.63900000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53100000000000003,"15min":0.5},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.60499999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48199999999999998,"15min":0.50600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.49399999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70399999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.56000000000000005}]},{"osd":5,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68799999999999994,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.70499999999999996}]},{"osd":7,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73199999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.76300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55100000000000005}]},{"osd":1,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.33300000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.80600000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.35899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.51700000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.496},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.41499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68300000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.56499999999999995}]},{"osd":3,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.32300000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66100000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.371,"5min":0.312,"15min":0.312},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.53600000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47699999999999998,"15min":0.503},"min":{"1min":0.28799999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.749,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.39900000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.47599999999999998,"15min":0.48099999999999998},"min":{"1min":0.32800000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.434}]},{"osd":6,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48399999999999999,"15min":0.50600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52700000000000002,"15min":0.54200000000000004},"min":{"1min":0.37,"5min":0.31,"15min":0.31},"max":{"1min":0.78600000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.58999999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73099999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75800000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.63}]}]},{"osd":4,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.308,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.34200000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.33000000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.67100000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.42199999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.34200000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69899999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.36499999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.315}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54000000000000004,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.76000000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.371,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.45000000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.501},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.48499999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.877,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.41099999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.56599999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.499,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.56699999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48799999999999999,"15min":0.503},"min":{"1min":0.371,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.72199999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70499999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.48999999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.34599999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.51600000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":714,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194597,"statfs":{"total":200000000,"available":199268158,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35199999999999998,"15min":0.34000000000000002},"min":{"1min":0.20100000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.58299999999999996,"5min":0.629,"15min":0.629},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.374,"15min":0.35599999999999998},"min":{"1min":0.29099999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.56200000000000006,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.52000000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.32100000000000001},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.505},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.33700000000000002},"min":{"1min":0.27800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.44500000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35099999999999998,"15min":0.34499999999999997},"min":{"1min":0.249,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49299999999999999,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.376},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.53500000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55800000000000005,"15min":0.54300000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.93400000000000005},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.76800000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.85999999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.45200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.82099999999999995},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72199999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.91500000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.38500000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76700000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.88200000000000001},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58399999999999996,"15min":0.56100000000000005},"min":{"1min":0.495,"5min":0.37,"15min":0.37},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.754}]},{"osd":7,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80600000000000005,"5min":0.879,"15min":0.879},"last":0.84999999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80300000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.96099999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574922,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194592,"statfs":{"total":200000000,"available":199262341,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.29999999999999999},"min":{"1min":0.246,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.44700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39300000000000002,"15min":0.34499999999999997},"min":{"1min":0.25800000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.504,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.50600000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35599999999999998,"15min":0.33100000000000002},"min":{"1min":0.24099999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.54300000000000004,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.38,"5min":0.375,"15min":0.35099999999999998},"min":{"1min":0.247,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.5,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.52600000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.35999999999999999},"min":{"1min":0.27700000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.58299999999999996,"5min":0.995,"15min":0.995},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.372},"min":{"1min":0.28100000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.53600000000000003,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.47199999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.442,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75,"5min":2.347,"15min":2.347},"last":0.754}]},{"osd":5,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.42099999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84999999999999998,"5min":0.997,"15min":0.997},"last":0.84299999999999997},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.70799999999999996}]},{"osd":6,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59199999999999997,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71699999999999997,"5min":2.274,"15min":2.274},"last":0.71899999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.82299999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.82499999999999996}]},{"osd":7,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.57099999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.78600000000000003},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59099999999999997,"15min":0.57999999999999996},"min":{"1min":0.45100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.77700000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.77600000000000002}]}]},{"osd":1,"up_from":13,"seq":55834574923,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":720,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194592,"statfs":{"total":200000000,"available":199262341,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.316,"15min":0.28999999999999998},"min":{"1min":0.23000000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.35299999999999998,"15min":0.33100000000000002},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.40300000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.33200000000000002,"15min":0.307},"min":{"1min":0.20599999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.52400000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.377,"15min":0.35099999999999998},"min":{"1min":0.26900000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.34999999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.35799999999999998},"min":{"1min":0.29499999999999998,"5min":0.191,"15min":0.191},"max":{"1min":0.61699999999999999,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36399999999999999,"15min":0.35299999999999998},"min":{"1min":0.26400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54800000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.45500000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.312,"15min":0.312},"max":{"1min":0.70999999999999996,"5min":0.873,"15min":0.873},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.45000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73099999999999998,"5min":1.002,"15min":1.002},"last":0.41899999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.42099999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.47699999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.54200000000000004},"min":{"1min":0.45900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.46400000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.47999999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":1.038,"15min":1.038},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.56299999999999994},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66900000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.44600000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.42899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72299999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.51500000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73499999999999999,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.51500000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574922,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1291,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194021,"statfs":{"total":200000000,"available":198677790,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32200000000000001,"15min":0.31},"min":{"1min":0.25,"5min":0.184,"15min":0.184},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.27600000000000002},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.314},"min":{"1min":0.27400000000000002,"5min":0.184,"15min":0.184},"max":{"1min":0.46300000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.25}]},{"osd":2,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.28599999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.53500000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.23699999999999999},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.26500000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.51300000000000001,"5min":0.622,"15min":0.622},"last":0.30299999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34799999999999998,"15min":0.32500000000000001},"min":{"1min":0.29099999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.36899999999999999},"min":{"1min":0.29399999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.318}]},{"osd":4,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55200000000000005,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.432,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.621}]},{"osd":5,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.52200000000000002},"min":{"1min":0.432,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73199999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57199999999999995,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82999999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88200000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.502},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.58399999999999996},"min":{"1min":0.45300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.63400000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.747,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.39300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83399999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52600000000000002}]}]}],"pool_statfs":[]}} 2023-12-20T04:48:42.754 INFO:tasks.ceph.mds.d.smithi187.stderr:2023-12-20T04:48:42.753+0000 7fba6d047640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:48:44.507 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:48:44.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.617+0000 7f7b2feab640 1 Processor -- start 2023-12-20T04:48:44.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.617+0000 7f7b2feab640 1 -- start start 2023-12-20T04:48:44.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.618+0000 7f7b2feab640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7b2815d100 0x7f7b280b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:44.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.618+0000 7f7b2feab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7b280d0370 0x7f7b280cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:44.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.618+0000 7f7b2feab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7b280b2f90 con 0x7f7b28161850 2023-12-20T04:48:44.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.618+0000 7f7b2feab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b281613c0 con 0x7f7b280d0370 2023-12-20T04:48:44.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.618+0000 7f7b2feab640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7b280d1b00 con 0x7f7b2815d100 2023-12-20T04:48:44.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.618+0000 7f7b2d446640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7b280d0370 0x7f7b280cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:44.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.618+0000 7f7b2e448640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7b28161850 0x7f7b2806c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47782/0 (socket says 172.21.15.132:47782) 2023-12-20T04:48:44.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.618+0000 7f7b2e448640 1 -- 172.21.15.132:0/230045910 learned_addr learned my addr 172.21.15.132:0/230045910 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:44.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.618+0000 7f7b2cc45640 1 -- 172.21.15.132:0/230045910 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2138708126 0 0) 0x7f7b20001490 con 0x7f7b28161850 2023-12-20T04:48:44.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.619+0000 7f7b2cc45640 1 -- 172.21.15.132:0/230045910 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7b14003520 con 0x7f7b28161850 2023-12-20T04:48:44.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.619+0000 7f7b2d446640 1 -- 172.21.15.132:0/230045910 >> v2:172.21.15.187:3300/0 conn(0x7f7b2815d100 msgr2=0x7f7b280b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:44.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.619+0000 7f7b2dc47640 1 --2- 172.21.15.132:0/230045910 >> v2:172.21.15.187:3300/0 conn(0x7f7b2815d100 0x7f7b280b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:44.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.619+0000 7f7b2d446640 1 --2- 172.21.15.132:0/230045910 >> v2:172.21.15.187:3300/0 conn(0x7f7b2815d100 0x7f7b280b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:44.621 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.619+0000 7f7b2d446640 1 -- 172.21.15.132:0/230045910 >> v1:172.21.15.132:6789/0 conn(0x7f7b28161850 legacy=0x7f7b2806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:44.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.619+0000 7f7b2d446640 1 -- 172.21.15.132:0/230045910 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b280d0810 con 0x7f7b280d0370 2023-12-20T04:48:44.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.619+0000 7f7b2dc47640 1 --2- 172.21.15.132:0/230045910 >> v2:172.21.15.187:3300/0 conn(0x7f7b2815d100 0x7f7b280b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:44.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.619+0000 7f7b2d446640 1 --2- 172.21.15.132:0/230045910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b280d0370 0x7f7b280cd500 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f7b2806e5e0 tx=0x7f7b1802b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=118de4c0af168bf server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:44.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.620+0000 7f7b2cc45640 1 -- 172.21.15.132:0/230045910 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b1802e070 con 0x7f7b280d0370 2023-12-20T04:48:44.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.620+0000 7f7b2cc45640 1 -- 172.21.15.132:0/230045910 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b180315a0 con 0x7f7b280d0370 2023-12-20T04:48:44.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.620+0000 7f7b2cc45640 1 -- 172.21.15.132:0/230045910 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b18031930 con 0x7f7b280d0370 2023-12-20T04:48:44.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.620+0000 7f7b2feab640 1 -- 172.21.15.132:0/230045910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b280d0370 msgr2=0x7f7b280cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:44.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.620+0000 7f7b2feab640 1 --2- 172.21.15.132:0/230045910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b280d0370 0x7f7b280cd500 secure :-1 s=READY pgs=1362 cs=0 l=1 rev1=1 crypto rx=0x7f7b2806e5e0 tx=0x7f7b1802b840 comp rx=0 tx=0).stop 2023-12-20T04:48:44.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.620+0000 7f7b2feab640 1 -- 172.21.15.132:0/230045910 shutdown_connections 2023-12-20T04:48:44.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.620+0000 7f7b2feab640 1 --2- 172.21.15.132:0/230045910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b280d0370 0x7f7b280cd500 unknown :-1 s=CLOSED pgs=1362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:44.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.620+0000 7f7b2feab640 1 --2- 172.21.15.132:0/230045910 >> v2:172.21.15.187:3300/0 conn(0x7f7b2815d100 0x7f7b280b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:44.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.620+0000 7f7b2feab640 1 -- 172.21.15.132:0/230045910 >> 172.21.15.132:0/230045910 conn(0x7f7b2806d7c0 msgr2=0x7f7b2806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:44.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.620+0000 7f7b2feab640 1 -- 172.21.15.132:0/230045910 shutdown_connections 2023-12-20T04:48:44.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.620+0000 7f7b2feab640 1 -- 172.21.15.132:0/230045910 wait complete. 2023-12-20T04:48:44.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.621+0000 7f7b2feab640 1 Processor -- start 2023-12-20T04:48:44.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.621+0000 7f7b2feab640 1 -- start start 2023-12-20T04:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.622+0000 7f7b2feab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b280d0370 0x7f7b280cd830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.622+0000 7f7b2feab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b2815d100 0x7f7b280c7ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.622+0000 7f7b2feab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b28161850 0x7f7b281556d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.622+0000 7f7b2feab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280ad6b0 con 0x7f7b28161850 2023-12-20T04:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.622+0000 7f7b2feab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280c8580 con 0x7f7b280d0370 2023-12-20T04:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.622+0000 7f7b2feab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7b280c8860 con 0x7f7b2815d100 2023-12-20T04:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.622+0000 7f7b2e448640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b28161850 0x7f7b281556d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.622+0000 7f7b2e448640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b28161850 0x7f7b281556d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52796/0 (socket says 172.21.15.132:52796) 2023-12-20T04:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.622+0000 7f7b2e448640 1 -- 172.21.15.132:0/3079467879 learned_addr learned my addr 172.21.15.132:0/3079467879 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:44.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.623+0000 7f7b2dc47640 1 --2- 172.21.15.132:0/3079467879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b280d0370 0x7f7b280cd830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:44.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.623+0000 7f7b2d446640 1 --2- 172.21.15.132:0/3079467879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b2815d100 0x7f7b280c7ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:44.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.623+0000 7f7b2e448640 1 -- 172.21.15.132:0/3079467879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b2815d100 msgr2=0x7f7b280c7ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:44.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.623+0000 7f7b2e448640 1 --2- 172.21.15.132:0/3079467879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b2815d100 0x7f7b280c7ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:44.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.623+0000 7f7b2e448640 1 -- 172.21.15.132:0/3079467879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b280d0370 msgr2=0x7f7b280cd830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:44.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.623+0000 7f7b2e448640 1 --2- 172.21.15.132:0/3079467879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b280d0370 0x7f7b280cd830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:44.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.623+0000 7f7b2e448640 1 -- 172.21.15.132:0/3079467879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7b18009400 con 0x7f7b28161850 2023-12-20T04:48:44.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.623+0000 7f7b2e448640 1 --2- 172.21.15.132:0/3079467879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b28161850 0x7f7b281556d0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000cb40 tx=0x7f7b2000a060 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:44.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.623+0000 7f7b1e7fc640 1 -- 172.21.15.132:0/3079467879 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b2000aca0 con 0x7f7b28161850 2023-12-20T04:48:44.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.623+0000 7f7b1e7fc640 1 -- 172.21.15.132:0/3079467879 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7b2000ae00 con 0x7f7b28161850 2023-12-20T04:48:44.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.623+0000 7f7b2feab640 1 -- 172.21.15.132:0/3079467879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7b280c8b40 con 0x7f7b28161850 2023-12-20T04:48:44.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.623+0000 7f7b1e7fc640 1 -- 172.21.15.132:0/3079467879 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7b20012620 con 0x7f7b28161850 2023-12-20T04:48:44.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.623+0000 7f7b2feab640 1 -- 172.21.15.132:0/3079467879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7b28155c10 con 0x7f7b28161850 2023-12-20T04:48:44.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.624+0000 7f7b2feab640 1 -- 172.21.15.132:0/3079467879 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7b280ad820 con 0x7f7b28161850 2023-12-20T04:48:44.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.624+0000 7f7b1e7fc640 1 -- 172.21.15.132:0/3079467879 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7b20007070 con 0x7f7b28161850 2023-12-20T04:48:44.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.625+0000 7f7b1e7fc640 1 --2- 172.21.15.132:0/3079467879 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7b0c06a430 0x7f7b0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:44.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.625+0000 7f7b1e7fc640 1 -- 172.21.15.132:0/3079467879 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7b200887d0 con 0x7f7b28161850 2023-12-20T04:48:44.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.625+0000 7f7b2dc47640 1 --2- 172.21.15.132:0/3079467879 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7b0c06a430 0x7f7b0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:44.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.625+0000 7f7b2dc47640 1 --2- 172.21.15.132:0/3079467879 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7b0c06a430 0x7f7b0c06c8f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400a990 tx=0x7f7b24008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:44.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.629+0000 7f7b1e7fc640 1 -- 172.21.15.132:0/3079467879 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7b20053dc0 con 0x7f7b28161850 2023-12-20T04:48:44.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.790+0000 7f7b2feab640 1 -- 172.21.15.132:0/3079467879 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f7b280ad4a0 con 0x7f7b0c06a430 2023-12-20T04:48:44.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.797+0000 7f7b1e7fc640 1 -- 172.21.15.132:0/3079467879 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285661 (secure 0 0 0) 0x7f7b2400a710 con 0x7f7b0c06a430 2023-12-20T04:48:44.802 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:44.804 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:48:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.801+0000 7f7b2feab640 1 -- 172.21.15.132:0/3079467879 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7b0c06a430 msgr2=0x7f7b0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.801+0000 7f7b2feab640 1 --2- 172.21.15.132:0/3079467879 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7b0c06a430 0x7f7b0c06c8f0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f7b2400a990 tx=0x7f7b24008040 comp rx=0 tx=0).stop 2023-12-20T04:48:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.801+0000 7f7b2feab640 1 -- 172.21.15.132:0/3079467879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b28161850 msgr2=0x7f7b281556d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.801+0000 7f7b2feab640 1 --2- 172.21.15.132:0/3079467879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b28161850 0x7f7b281556d0 secure :-1 s=READY pgs=1363 cs=0 l=1 rev1=1 crypto rx=0x7f7b2000cb40 tx=0x7f7b2000a060 comp rx=0 tx=0).stop 2023-12-20T04:48:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.801+0000 7f7b2feab640 1 -- 172.21.15.132:0/3079467879 shutdown_connections 2023-12-20T04:48:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.801+0000 7f7b2feab640 1 --2- 172.21.15.132:0/3079467879 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7b0c06a430 0x7f7b0c06c8f0 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.801+0000 7f7b2feab640 1 --2- 172.21.15.132:0/3079467879 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7b28161850 0x7f7b281556d0 unknown :-1 s=CLOSED pgs=1363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.801+0000 7f7b2feab640 1 --2- 172.21.15.132:0/3079467879 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7b2815d100 0x7f7b280c7ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.801+0000 7f7b2feab640 1 --2- 172.21.15.132:0/3079467879 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7b280d0370 0x7f7b280cd830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.801+0000 7f7b2feab640 1 -- 172.21.15.132:0/3079467879 >> 172.21.15.132:0/3079467879 conn(0x7f7b2806d7c0 msgr2=0x7f7b2806b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.801+0000 7f7b2feab640 1 -- 172.21.15.132:0/3079467879 shutdown_connections 2023-12-20T04:48:44.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.801+0000 7f7b2feab640 1 -- 172.21.15.132:0/3079467879 wait complete. 2023-12-20T04:48:44.814 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":313,"stamp":"2023-12-20T04:48:44.167636+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7071,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1555428,"statfs":{"total":1600000000,"available":1592758468,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.309829"},"pg_stats":[{"pgid":"17.3f","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204705+0000","last_change":"2023-12-20T04:48:37.211716+0000","last_active":"2023-12-20T04:48:38.204705+0000","last_peered":"2023-12-20T04:48:38.204705+0000","last_clean":"2023-12-20T04:48:38.204705+0000","last_became_active":"2023-12-20T04:48:37.209333+0000","last_became_peered":"2023-12-20T04:48:37.209333+0000","last_unstale":"2023-12-20T04:48:38.204705+0000","last_undegraded":"2023-12-20T04:48:38.204705+0000","last_fullsized":"2023-12-20T04:48:38.204705+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:37:38.859010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3e","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204725+0000","last_change":"2023-12-20T04:48:37.216259+0000","last_active":"2023-12-20T04:48:38.204725+0000","last_peered":"2023-12-20T04:48:38.204725+0000","last_clean":"2023-12-20T04:48:38.204725+0000","last_became_active":"2023-12-20T04:48:37.214844+0000","last_became_peered":"2023-12-20T04:48:37.214844+0000","last_unstale":"2023-12-20T04:48:38.204725+0000","last_undegraded":"2023-12-20T04:48:38.204725+0000","last_fullsized":"2023-12-20T04:48:38.204725+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:54:31.484661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.3d","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054084+0000","last_change":"2023-12-20T04:48:37.216257+0000","last_active":"2023-12-20T04:48:39.054084+0000","last_peered":"2023-12-20T04:48:39.054084+0000","last_clean":"2023-12-20T04:48:39.054084+0000","last_became_active":"2023-12-20T04:48:37.215105+0000","last_became_peered":"2023-12-20T04:48:37.215105+0000","last_unstale":"2023-12-20T04:48:39.054084+0000","last_undegraded":"2023-12-20T04:48:39.054084+0000","last_fullsized":"2023-12-20T04:48:39.054084+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:34:43.732631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.3c","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204526+0000","last_change":"2023-12-20T04:48:37.211138+0000","last_active":"2023-12-20T04:48:38.204526+0000","last_peered":"2023-12-20T04:48:38.204526+0000","last_clean":"2023-12-20T04:48:38.204526+0000","last_became_active":"2023-12-20T04:48:37.210608+0000","last_became_peered":"2023-12-20T04:48:37.210608+0000","last_unstale":"2023-12-20T04:48:38.204526+0000","last_undegraded":"2023-12-20T04:48:38.204526+0000","last_fullsized":"2023-12-20T04:48:38.204526+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:59:07.234267+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.3b","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.053998+0000","last_change":"2023-12-20T04:48:37.210198+0000","last_active":"2023-12-20T04:48:39.053998+0000","last_peered":"2023-12-20T04:48:39.053998+0000","last_clean":"2023-12-20T04:48:39.053998+0000","last_became_active":"2023-12-20T04:48:37.209974+0000","last_became_peered":"2023-12-20T04:48:37.209974+0000","last_unstale":"2023-12-20T04:48:39.053998+0000","last_undegraded":"2023-12-20T04:48:39.053998+0000","last_fullsized":"2023-12-20T04:48:39.053998+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:32.135833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.3a","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.053846+0000","last_change":"2023-12-20T04:48:37.213058+0000","last_active":"2023-12-20T04:48:39.053846+0000","last_peered":"2023-12-20T04:48:39.053846+0000","last_clean":"2023-12-20T04:48:39.053846+0000","last_became_active":"2023-12-20T04:48:37.211705+0000","last_became_peered":"2023-12-20T04:48:37.211705+0000","last_unstale":"2023-12-20T04:48:39.053846+0000","last_undegraded":"2023-12-20T04:48:39.053846+0000","last_fullsized":"2023-12-20T04:48:39.053846+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:25.378074+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.39","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.205065+0000","last_change":"2023-12-20T04:48:37.214099+0000","last_active":"2023-12-20T04:48:38.205065+0000","last_peered":"2023-12-20T04:48:38.205065+0000","last_clean":"2023-12-20T04:48:38.205065+0000","last_became_active":"2023-12-20T04:48:37.213722+0000","last_became_peered":"2023-12-20T04:48:37.213722+0000","last_unstale":"2023-12-20T04:48:38.205065+0000","last_undegraded":"2023-12-20T04:48:38.205065+0000","last_fullsized":"2023-12-20T04:48:38.205065+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:56:05.752859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.38","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054409+0000","last_change":"2023-12-20T04:48:37.214001+0000","last_active":"2023-12-20T04:48:39.054409+0000","last_peered":"2023-12-20T04:48:39.054409+0000","last_clean":"2023-12-20T04:48:39.054409+0000","last_became_active":"2023-12-20T04:48:37.213706+0000","last_became_peered":"2023-12-20T04:48:37.213706+0000","last_unstale":"2023-12-20T04:48:39.054409+0000","last_undegraded":"2023-12-20T04:48:39.054409+0000","last_fullsized":"2023-12-20T04:48:39.054409+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:13:03.370670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.37","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204606+0000","last_change":"2023-12-20T04:48:37.214209+0000","last_active":"2023-12-20T04:48:38.204606+0000","last_peered":"2023-12-20T04:48:38.204606+0000","last_clean":"2023-12-20T04:48:38.204606+0000","last_became_active":"2023-12-20T04:48:37.213813+0000","last_became_peered":"2023-12-20T04:48:37.213813+0000","last_unstale":"2023-12-20T04:48:38.204606+0000","last_undegraded":"2023-12-20T04:48:38.204606+0000","last_fullsized":"2023-12-20T04:48:38.204606+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:43:25.906804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.36","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204760+0000","last_change":"2023-12-20T04:48:37.207960+0000","last_active":"2023-12-20T04:48:38.204760+0000","last_peered":"2023-12-20T04:48:38.204760+0000","last_clean":"2023-12-20T04:48:38.204760+0000","last_became_active":"2023-12-20T04:48:37.207758+0000","last_became_peered":"2023-12-20T04:48:37.207758+0000","last_unstale":"2023-12-20T04:48:38.204760+0000","last_undegraded":"2023-12-20T04:48:38.204760+0000","last_fullsized":"2023-12-20T04:48:38.204760+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:48:46.059086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.35","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204989+0000","last_change":"2023-12-20T04:48:37.215373+0000","last_active":"2023-12-20T04:48:38.204989+0000","last_peered":"2023-12-20T04:48:38.204989+0000","last_clean":"2023-12-20T04:48:38.204989+0000","last_became_active":"2023-12-20T04:48:37.215155+0000","last_became_peered":"2023-12-20T04:48:37.215155+0000","last_unstale":"2023-12-20T04:48:38.204989+0000","last_undegraded":"2023-12-20T04:48:38.204989+0000","last_fullsized":"2023-12-20T04:48:38.204989+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:43:01.718448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.34","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204861+0000","last_change":"2023-12-20T04:48:37.207352+0000","last_active":"2023-12-20T04:48:38.204861+0000","last_peered":"2023-12-20T04:48:38.204861+0000","last_clean":"2023-12-20T04:48:38.204861+0000","last_became_active":"2023-12-20T04:48:37.207137+0000","last_became_peered":"2023-12-20T04:48:37.207137+0000","last_unstale":"2023-12-20T04:48:38.204861+0000","last_undegraded":"2023-12-20T04:48:38.204861+0000","last_fullsized":"2023-12-20T04:48:38.204861+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:42:41.077973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.33","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054182+0000","last_change":"2023-12-20T04:48:37.220038+0000","last_active":"2023-12-20T04:48:39.054182+0000","last_peered":"2023-12-20T04:48:39.054182+0000","last_clean":"2023-12-20T04:48:39.054182+0000","last_became_active":"2023-12-20T04:48:37.219085+0000","last_became_peered":"2023-12-20T04:48:37.219085+0000","last_unstale":"2023-12-20T04:48:39.054182+0000","last_undegraded":"2023-12-20T04:48:39.054182+0000","last_fullsized":"2023-12-20T04:48:39.054182+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:51:31.203935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.32","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.053890+0000","last_change":"2023-12-20T04:48:37.215611+0000","last_active":"2023-12-20T04:48:39.053890+0000","last_peered":"2023-12-20T04:48:39.053890+0000","last_clean":"2023-12-20T04:48:39.053890+0000","last_became_active":"2023-12-20T04:48:37.214752+0000","last_became_peered":"2023-12-20T04:48:37.214752+0000","last_unstale":"2023-12-20T04:48:39.053890+0000","last_undegraded":"2023-12-20T04:48:39.053890+0000","last_fullsized":"2023-12-20T04:48:39.053890+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:57:22.210989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.31","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.053969+0000","last_change":"2023-12-20T04:48:37.215047+0000","last_active":"2023-12-20T04:48:39.053969+0000","last_peered":"2023-12-20T04:48:39.053969+0000","last_clean":"2023-12-20T04:48:39.053969+0000","last_became_active":"2023-12-20T04:48:37.214841+0000","last_became_peered":"2023-12-20T04:48:37.214841+0000","last_unstale":"2023-12-20T04:48:39.053969+0000","last_undegraded":"2023-12-20T04:48:39.053969+0000","last_fullsized":"2023-12-20T04:48:39.053969+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:39:54.889238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.30","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204784+0000","last_change":"2023-12-20T04:48:37.218270+0000","last_active":"2023-12-20T04:48:38.204784+0000","last_peered":"2023-12-20T04:48:38.204784+0000","last_clean":"2023-12-20T04:48:38.204784+0000","last_became_active":"2023-12-20T04:48:37.218051+0000","last_became_peered":"2023-12-20T04:48:37.218051+0000","last_unstale":"2023-12-20T04:48:38.204784+0000","last_undegraded":"2023-12-20T04:48:38.204784+0000","last_fullsized":"2023-12-20T04:48:38.204784+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:07:52.592211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.2f","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204824+0000","last_change":"2023-12-20T04:48:37.210578+0000","last_active":"2023-12-20T04:48:38.204824+0000","last_peered":"2023-12-20T04:48:38.204824+0000","last_clean":"2023-12-20T04:48:38.204824+0000","last_became_active":"2023-12-20T04:48:37.210075+0000","last_became_peered":"2023-12-20T04:48:37.210075+0000","last_unstale":"2023-12-20T04:48:38.204824+0000","last_undegraded":"2023-12-20T04:48:38.204824+0000","last_fullsized":"2023-12-20T04:48:38.204824+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:44:25.974593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2e","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.053857+0000","last_change":"2023-12-20T04:48:37.218014+0000","last_active":"2023-12-20T04:48:39.053857+0000","last_peered":"2023-12-20T04:48:39.053857+0000","last_clean":"2023-12-20T04:48:39.053857+0000","last_became_active":"2023-12-20T04:48:37.217738+0000","last_became_peered":"2023-12-20T04:48:37.217738+0000","last_unstale":"2023-12-20T04:48:39.053857+0000","last_undegraded":"2023-12-20T04:48:39.053857+0000","last_fullsized":"2023-12-20T04:48:39.053857+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:43:01.718448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.2d","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054005+0000","last_change":"2023-12-20T04:48:37.218888+0000","last_active":"2023-12-20T04:48:39.054005+0000","last_peered":"2023-12-20T04:48:39.054005+0000","last_clean":"2023-12-20T04:48:39.054005+0000","last_became_active":"2023-12-20T04:48:37.218472+0000","last_became_peered":"2023-12-20T04:48:37.218472+0000","last_unstale":"2023-12-20T04:48:39.054005+0000","last_undegraded":"2023-12-20T04:48:39.054005+0000","last_fullsized":"2023-12-20T04:48:39.054005+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:35:43.401551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.2c","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204871+0000","last_change":"2023-12-20T04:48:37.210358+0000","last_active":"2023-12-20T04:48:38.204871+0000","last_peered":"2023-12-20T04:48:38.204871+0000","last_clean":"2023-12-20T04:48:38.204871+0000","last_became_active":"2023-12-20T04:48:37.210148+0000","last_became_peered":"2023-12-20T04:48:37.210148+0000","last_unstale":"2023-12-20T04:48:38.204871+0000","last_undegraded":"2023-12-20T04:48:38.204871+0000","last_fullsized":"2023-12-20T04:48:38.204871+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:36:57.074800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2b","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.205193+0000","last_change":"2023-12-20T04:48:37.209353+0000","last_active":"2023-12-20T04:48:38.205193+0000","last_peered":"2023-12-20T04:48:38.205193+0000","last_clean":"2023-12-20T04:48:38.205193+0000","last_became_active":"2023-12-20T04:48:37.209084+0000","last_became_peered":"2023-12-20T04:48:37.209084+0000","last_unstale":"2023-12-20T04:48:38.205193+0000","last_undegraded":"2023-12-20T04:48:38.205193+0000","last_fullsized":"2023-12-20T04:48:38.205193+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:01:01.460162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.2a","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054497+0000","last_change":"2023-12-20T04:48:37.214161+0000","last_active":"2023-12-20T04:48:39.054497+0000","last_peered":"2023-12-20T04:48:39.054497+0000","last_clean":"2023-12-20T04:48:39.054497+0000","last_became_active":"2023-12-20T04:48:37.213811+0000","last_became_peered":"2023-12-20T04:48:37.213811+0000","last_unstale":"2023-12-20T04:48:39.054497+0000","last_undegraded":"2023-12-20T04:48:39.054497+0000","last_fullsized":"2023-12-20T04:48:39.054497+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:36:57.074800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.29","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204692+0000","last_change":"2023-12-20T04:48:37.217241+0000","last_active":"2023-12-20T04:48:38.204692+0000","last_peered":"2023-12-20T04:48:38.204692+0000","last_clean":"2023-12-20T04:48:38.204692+0000","last_became_active":"2023-12-20T04:48:37.216841+0000","last_became_peered":"2023-12-20T04:48:37.216841+0000","last_unstale":"2023-12-20T04:48:38.204692+0000","last_undegraded":"2023-12-20T04:48:38.204692+0000","last_fullsized":"2023-12-20T04:48:38.204692+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:35:43.401551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.28","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054254+0000","last_change":"2023-12-20T04:48:37.213946+0000","last_active":"2023-12-20T04:48:39.054254+0000","last_peered":"2023-12-20T04:48:39.054254+0000","last_clean":"2023-12-20T04:48:39.054254+0000","last_became_active":"2023-12-20T04:48:37.213657+0000","last_became_peered":"2023-12-20T04:48:37.213657+0000","last_unstale":"2023-12-20T04:48:39.054254+0000","last_undegraded":"2023-12-20T04:48:39.054254+0000","last_fullsized":"2023-12-20T04:48:39.054254+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:57:22.210989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.27","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204768+0000","last_change":"2023-12-20T04:48:37.215498+0000","last_active":"2023-12-20T04:48:38.204768+0000","last_peered":"2023-12-20T04:48:38.204768+0000","last_clean":"2023-12-20T04:48:38.204768+0000","last_became_active":"2023-12-20T04:48:37.215281+0000","last_became_peered":"2023-12-20T04:48:37.215281+0000","last_unstale":"2023-12-20T04:48:38.204768+0000","last_undegraded":"2023-12-20T04:48:38.204768+0000","last_fullsized":"2023-12-20T04:48:38.204768+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:37:29.653009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.26","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204864+0000","last_change":"2023-12-20T04:48:37.212237+0000","last_active":"2023-12-20T04:48:38.204864+0000","last_peered":"2023-12-20T04:48:38.204864+0000","last_clean":"2023-12-20T04:48:38.204864+0000","last_became_active":"2023-12-20T04:48:37.209616+0000","last_became_peered":"2023-12-20T04:48:37.209616+0000","last_unstale":"2023-12-20T04:48:38.204864+0000","last_undegraded":"2023-12-20T04:48:38.204864+0000","last_fullsized":"2023-12-20T04:48:38.204864+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:39:15.028331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.25","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054010+0000","last_change":"2023-12-20T04:48:37.215707+0000","last_active":"2023-12-20T04:48:39.054010+0000","last_peered":"2023-12-20T04:48:39.054010+0000","last_clean":"2023-12-20T04:48:39.054010+0000","last_became_active":"2023-12-20T04:48:37.215472+0000","last_became_peered":"2023-12-20T04:48:37.215472+0000","last_unstale":"2023-12-20T04:48:39.054010+0000","last_undegraded":"2023-12-20T04:48:39.054010+0000","last_fullsized":"2023-12-20T04:48:39.054010+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:45:35.905934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.24","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054352+0000","last_change":"2023-12-20T04:48:37.207136+0000","last_active":"2023-12-20T04:48:39.054352+0000","last_peered":"2023-12-20T04:48:39.054352+0000","last_clean":"2023-12-20T04:48:39.054352+0000","last_became_active":"2023-12-20T04:48:37.206907+0000","last_became_peered":"2023-12-20T04:48:37.206907+0000","last_unstale":"2023-12-20T04:48:39.054352+0000","last_undegraded":"2023-12-20T04:48:39.054352+0000","last_fullsized":"2023-12-20T04:48:39.054352+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:51:31.203935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.23","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.205118+0000","last_change":"2023-12-20T04:48:37.213776+0000","last_active":"2023-12-20T04:48:38.205118+0000","last_peered":"2023-12-20T04:48:38.205118+0000","last_clean":"2023-12-20T04:48:38.205118+0000","last_became_active":"2023-12-20T04:48:37.213516+0000","last_became_peered":"2023-12-20T04:48:37.213516+0000","last_unstale":"2023-12-20T04:48:38.205118+0000","last_undegraded":"2023-12-20T04:48:38.205118+0000","last_fullsized":"2023-12-20T04:48:38.205118+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:05.228323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.22","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204702+0000","last_change":"2023-12-20T04:48:37.210550+0000","last_active":"2023-12-20T04:48:38.204702+0000","last_peered":"2023-12-20T04:48:38.204702+0000","last_clean":"2023-12-20T04:48:38.204702+0000","last_became_active":"2023-12-20T04:48:37.210332+0000","last_became_peered":"2023-12-20T04:48:37.210332+0000","last_unstale":"2023-12-20T04:48:38.204702+0000","last_undegraded":"2023-12-20T04:48:38.204702+0000","last_fullsized":"2023-12-20T04:48:38.204702+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:57:06.338552+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.21","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204950+0000","last_change":"2023-12-20T04:48:37.212386+0000","last_active":"2023-12-20T04:48:38.204950+0000","last_peered":"2023-12-20T04:48:38.204950+0000","last_clean":"2023-12-20T04:48:38.204950+0000","last_became_active":"2023-12-20T04:48:37.212000+0000","last_became_peered":"2023-12-20T04:48:37.212000+0000","last_unstale":"2023-12-20T04:48:38.204950+0000","last_undegraded":"2023-12-20T04:48:38.204950+0000","last_fullsized":"2023-12-20T04:48:38.204950+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:59:44.787338+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.20","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054173+0000","last_change":"2023-12-20T04:48:37.212850+0000","last_active":"2023-12-20T04:48:39.054173+0000","last_peered":"2023-12-20T04:48:39.054173+0000","last_clean":"2023-12-20T04:48:39.054173+0000","last_became_active":"2023-12-20T04:48:37.211294+0000","last_became_peered":"2023-12-20T04:48:37.211294+0000","last_unstale":"2023-12-20T04:48:39.054173+0000","last_undegraded":"2023-12-20T04:48:39.054173+0000","last_fullsized":"2023-12-20T04:48:39.054173+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:45:38.761292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.1e","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.053743+0000","last_change":"2023-12-20T04:48:37.211051+0000","last_active":"2023-12-20T04:48:39.053743+0000","last_peered":"2023-12-20T04:48:39.053743+0000","last_clean":"2023-12-20T04:48:39.053743+0000","last_became_active":"2023-12-20T04:48:37.210856+0000","last_became_peered":"2023-12-20T04:48:37.210856+0000","last_unstale":"2023-12-20T04:48:39.053743+0000","last_undegraded":"2023-12-20T04:48:39.053743+0000","last_fullsized":"2023-12-20T04:48:39.053743+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:59:51.308619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1f","version":"136'4","reported_seq":15,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.220889+0000","last_change":"2023-12-20T04:48:36.866039+0000","last_active":"2023-12-20T04:48:37.220889+0000","last_peered":"2023-12-20T04:48:37.220889+0000","last_clean":"2023-12-20T04:48:37.220889+0000","last_became_active":"2023-12-20T04:48:36.865780+0000","last_became_peered":"2023-12-20T04:48:36.865780+0000","last_unstale":"2023-12-20T04:48:37.220889+0000","last_undegraded":"2023-12-20T04:48:37.220889+0000","last_fullsized":"2023-12-20T04:48:37.220889+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:41:26.866774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1f","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.053960+0000","last_change":"2023-12-20T04:48:37.214905+0000","last_active":"2023-12-20T04:48:39.053960+0000","last_peered":"2023-12-20T04:48:39.053960+0000","last_clean":"2023-12-20T04:48:39.053960+0000","last_became_active":"2023-12-20T04:48:37.214521+0000","last_became_peered":"2023-12-20T04:48:37.214521+0000","last_unstale":"2023-12-20T04:48:39.053960+0000","last_undegraded":"2023-12-20T04:48:39.053960+0000","last_fullsized":"2023-12-20T04:48:39.053960+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:37:29.653009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.1e","version":"136'1","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.220113+0000","last_change":"2023-12-20T04:48:36.868534+0000","last_active":"2023-12-20T04:48:37.220113+0000","last_peered":"2023-12-20T04:48:37.220113+0000","last_clean":"2023-12-20T04:48:37.220113+0000","last_became_active":"2023-12-20T04:48:36.868311+0000","last_became_peered":"2023-12-20T04:48:36.868311+0000","last_unstale":"2023-12-20T04:48:37.220113+0000","last_undegraded":"2023-12-20T04:48:37.220113+0000","last_fullsized":"2023-12-20T04:48:37.220113+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:45:37.758827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"17.1c","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.053941+0000","last_change":"2023-12-20T04:48:37.211915+0000","last_active":"2023-12-20T04:48:39.053941+0000","last_peered":"2023-12-20T04:48:39.053941+0000","last_clean":"2023-12-20T04:48:39.053941+0000","last_became_active":"2023-12-20T04:48:37.211144+0000","last_became_peered":"2023-12-20T04:48:37.211144+0000","last_unstale":"2023-12-20T04:48:39.053941+0000","last_undegraded":"2023-12-20T04:48:39.053941+0000","last_fullsized":"2023-12-20T04:48:39.053941+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:48:40.305642+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.1d","version":"136'2","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.219396+0000","last_change":"2023-12-20T04:48:36.871889+0000","last_active":"2023-12-20T04:48:37.219396+0000","last_peered":"2023-12-20T04:48:37.219396+0000","last_clean":"2023-12-20T04:48:37.219396+0000","last_became_active":"2023-12-20T04:48:36.871109+0000","last_became_peered":"2023-12-20T04:48:36.871109+0000","last_unstale":"2023-12-20T04:48:37.219396+0000","last_undegraded":"2023-12-20T04:48:37.219396+0000","last_fullsized":"2023-12-20T04:48:37.219396+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:59:46.853598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1d","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.053953+0000","last_change":"2023-12-20T04:48:37.212713+0000","last_active":"2023-12-20T04:48:39.053953+0000","last_peered":"2023-12-20T04:48:39.053953+0000","last_clean":"2023-12-20T04:48:39.053953+0000","last_became_active":"2023-12-20T04:48:37.212386+0000","last_became_peered":"2023-12-20T04:48:37.212386+0000","last_unstale":"2023-12-20T04:48:39.053953+0000","last_undegraded":"2023-12-20T04:48:39.053953+0000","last_fullsized":"2023-12-20T04:48:39.053953+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:43:01.718448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1c","version":"136'2","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.218792+0000","last_change":"2023-12-20T04:48:36.870757+0000","last_active":"2023-12-20T04:48:37.218792+0000","last_peered":"2023-12-20T04:48:37.218792+0000","last_clean":"2023-12-20T04:48:37.218792+0000","last_became_active":"2023-12-20T04:48:36.868558+0000","last_became_peered":"2023-12-20T04:48:36.868558+0000","last_unstale":"2023-12-20T04:48:37.218792+0000","last_undegraded":"2023-12-20T04:48:37.218792+0000","last_fullsized":"2023-12-20T04:48:37.218792+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:55:05.361765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1a","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204612+0000","last_change":"2023-12-20T04:48:37.212922+0000","last_active":"2023-12-20T04:48:38.204612+0000","last_peered":"2023-12-20T04:48:38.204612+0000","last_clean":"2023-12-20T04:48:38.204612+0000","last_became_active":"2023-12-20T04:48:37.212579+0000","last_became_peered":"2023-12-20T04:48:37.212579+0000","last_unstale":"2023-12-20T04:48:38.204612+0000","last_undegraded":"2023-12-20T04:48:38.204612+0000","last_fullsized":"2023-12-20T04:48:38.204612+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:55:05.685090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.1b","version":"136'1","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.219664+0000","last_change":"2023-12-20T04:48:36.869165+0000","last_active":"2023-12-20T04:48:37.219664+0000","last_peered":"2023-12-20T04:48:37.219664+0000","last_clean":"2023-12-20T04:48:37.219664+0000","last_became_active":"2023-12-20T04:48:36.868172+0000","last_became_peered":"2023-12-20T04:48:36.868172+0000","last_unstale":"2023-12-20T04:48:37.219664+0000","last_undegraded":"2023-12-20T04:48:37.219664+0000","last_fullsized":"2023-12-20T04:48:37.219664+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:38:39.178936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.1b","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204919+0000","last_change":"2023-12-20T04:48:37.215955+0000","last_active":"2023-12-20T04:48:38.204919+0000","last_peered":"2023-12-20T04:48:38.204919+0000","last_clean":"2023-12-20T04:48:38.204919+0000","last_became_active":"2023-12-20T04:48:37.214513+0000","last_became_peered":"2023-12-20T04:48:37.214513+0000","last_unstale":"2023-12-20T04:48:38.204919+0000","last_undegraded":"2023-12-20T04:48:38.204919+0000","last_fullsized":"2023-12-20T04:48:38.204919+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:51:31.203935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.1a","version":"136'1","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.216376+0000","last_change":"2023-12-20T04:48:36.867951+0000","last_active":"2023-12-20T04:48:37.216376+0000","last_peered":"2023-12-20T04:48:37.216376+0000","last_clean":"2023-12-20T04:48:37.216376+0000","last_became_active":"2023-12-20T04:48:36.867738+0000","last_became_peered":"2023-12-20T04:48:36.867738+0000","last_unstale":"2023-12-20T04:48:37.216376+0000","last_undegraded":"2023-12-20T04:48:37.216376+0000","last_fullsized":"2023-12-20T04:48:37.216376+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:05.495362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.18","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204846+0000","last_change":"2023-12-20T04:48:37.216174+0000","last_active":"2023-12-20T04:48:38.204846+0000","last_peered":"2023-12-20T04:48:38.204846+0000","last_clean":"2023-12-20T04:48:38.204846+0000","last_became_active":"2023-12-20T04:48:37.215837+0000","last_became_peered":"2023-12-20T04:48:37.215837+0000","last_unstale":"2023-12-20T04:48:38.204846+0000","last_undegraded":"2023-12-20T04:48:38.204846+0000","last_fullsized":"2023-12-20T04:48:38.204846+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:24:33.444356+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.19","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.204326+0000","last_change":"2023-12-20T04:48:36.866221+0000","last_active":"2023-12-20T04:48:37.204326+0000","last_peered":"2023-12-20T04:48:37.204326+0000","last_clean":"2023-12-20T04:48:37.204326+0000","last_became_active":"2023-12-20T04:48:36.865558+0000","last_became_peered":"2023-12-20T04:48:36.865558+0000","last_unstale":"2023-12-20T04:48:37.204326+0000","last_undegraded":"2023-12-20T04:48:37.204326+0000","last_fullsized":"2023-12-20T04:48:37.204326+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:45:37.758827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.19","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204693+0000","last_change":"2023-12-20T04:48:37.214699+0000","last_active":"2023-12-20T04:48:38.204693+0000","last_peered":"2023-12-20T04:48:38.204693+0000","last_clean":"2023-12-20T04:48:38.204693+0000","last_became_active":"2023-12-20T04:48:37.213665+0000","last_became_peered":"2023-12-20T04:48:37.213665+0000","last_unstale":"2023-12-20T04:48:38.204693+0000","last_undegraded":"2023-12-20T04:48:38.204693+0000","last_fullsized":"2023-12-20T04:48:38.204693+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:21:12.428399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.18","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.205032+0000","last_change":"2023-12-20T04:48:36.863459+0000","last_active":"2023-12-20T04:48:37.205032+0000","last_peered":"2023-12-20T04:48:37.205032+0000","last_clean":"2023-12-20T04:48:37.205032+0000","last_became_active":"2023-12-20T04:48:36.863254+0000","last_became_peered":"2023-12-20T04:48:36.863254+0000","last_unstale":"2023-12-20T04:48:37.205032+0000","last_undegraded":"2023-12-20T04:48:37.205032+0000","last_fullsized":"2023-12-20T04:48:37.205032+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:04.225858+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.16","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204883+0000","last_change":"2023-12-20T04:48:37.210048+0000","last_active":"2023-12-20T04:48:38.204883+0000","last_peered":"2023-12-20T04:48:38.204883+0000","last_clean":"2023-12-20T04:48:38.204883+0000","last_became_active":"2023-12-20T04:48:37.209831+0000","last_became_peered":"2023-12-20T04:48:37.209831+0000","last_unstale":"2023-12-20T04:48:38.204883+0000","last_undegraded":"2023-12-20T04:48:38.204883+0000","last_fullsized":"2023-12-20T04:48:38.204883+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:35:53.835751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.17","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.206753+0000","last_change":"2023-12-20T04:48:36.871464+0000","last_active":"2023-12-20T04:48:37.206753+0000","last_peered":"2023-12-20T04:48:37.206753+0000","last_clean":"2023-12-20T04:48:37.206753+0000","last_became_active":"2023-12-20T04:48:36.869437+0000","last_became_peered":"2023-12-20T04:48:36.869437+0000","last_unstale":"2023-12-20T04:48:37.206753+0000","last_undegraded":"2023-12-20T04:48:37.206753+0000","last_fullsized":"2023-12-20T04:48:37.206753+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:19:23.525928+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.17","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054418+0000","last_change":"2023-12-20T04:48:37.216101+0000","last_active":"2023-12-20T04:48:39.054418+0000","last_peered":"2023-12-20T04:48:39.054418+0000","last_clean":"2023-12-20T04:48:39.054418+0000","last_became_active":"2023-12-20T04:48:37.215819+0000","last_became_peered":"2023-12-20T04:48:37.215819+0000","last_unstale":"2023-12-20T04:48:39.054418+0000","last_undegraded":"2023-12-20T04:48:39.054418+0000","last_fullsized":"2023-12-20T04:48:39.054418+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:36:57.074800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.16","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.203583+0000","last_change":"2023-12-20T04:48:36.862053+0000","last_active":"2023-12-20T04:48:37.203583+0000","last_peered":"2023-12-20T04:48:37.203583+0000","last_clean":"2023-12-20T04:48:37.203583+0000","last_became_active":"2023-12-20T04:48:36.861820+0000","last_became_peered":"2023-12-20T04:48:36.861820+0000","last_unstale":"2023-12-20T04:48:37.203583+0000","last_undegraded":"2023-12-20T04:48:37.203583+0000","last_fullsized":"2023-12-20T04:48:37.203583+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:46:09.941020+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.14","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054346+0000","last_change":"2023-12-20T04:48:37.208578+0000","last_active":"2023-12-20T04:48:39.054346+0000","last_peered":"2023-12-20T04:48:39.054346+0000","last_clean":"2023-12-20T04:48:39.054346+0000","last_became_active":"2023-12-20T04:48:37.208201+0000","last_became_peered":"2023-12-20T04:48:37.208201+0000","last_unstale":"2023-12-20T04:48:39.054346+0000","last_undegraded":"2023-12-20T04:48:39.054346+0000","last_fullsized":"2023-12-20T04:48:39.054346+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:28:46.820865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.15","version":"136'3","reported_seq":14,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.221101+0000","last_change":"2023-12-20T04:48:36.867922+0000","last_active":"2023-12-20T04:48:37.221101+0000","last_peered":"2023-12-20T04:48:37.221101+0000","last_clean":"2023-12-20T04:48:37.221101+0000","last_became_active":"2023-12-20T04:48:36.866941+0000","last_became_peered":"2023-12-20T04:48:36.866941+0000","last_unstale":"2023-12-20T04:48:37.221101+0000","last_undegraded":"2023-12-20T04:48:37.221101+0000","last_fullsized":"2023-12-20T04:48:37.221101+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:35:42.399086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.15","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204726+0000","last_change":"2023-12-20T04:48:37.217931+0000","last_active":"2023-12-20T04:48:38.204726+0000","last_peered":"2023-12-20T04:48:38.204726+0000","last_clean":"2023-12-20T04:48:38.204726+0000","last_became_active":"2023-12-20T04:48:37.216615+0000","last_became_peered":"2023-12-20T04:48:37.216615+0000","last_unstale":"2023-12-20T04:48:38.204726+0000","last_undegraded":"2023-12-20T04:48:38.204726+0000","last_fullsized":"2023-12-20T04:48:38.204726+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:55:55.169983+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"16.14","version":"136'6","reported_seq":17,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.222278+0000","last_change":"2023-12-20T04:48:36.864852+0000","last_active":"2023-12-20T04:48:37.222278+0000","last_peered":"2023-12-20T04:48:37.222278+0000","last_clean":"2023-12-20T04:48:37.222278+0000","last_became_active":"2023-12-20T04:48:36.863208+0000","last_became_peered":"2023-12-20T04:48:36.863208+0000","last_unstale":"2023-12-20T04:48:37.222278+0000","last_undegraded":"2023-12-20T04:48:37.222278+0000","last_fullsized":"2023-12-20T04:48:37.222278+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:44:24.972128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.12","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054683+0000","last_change":"2023-12-20T04:48:37.210967+0000","last_active":"2023-12-20T04:48:39.054683+0000","last_peered":"2023-12-20T04:48:39.054683+0000","last_clean":"2023-12-20T04:48:39.054683+0000","last_became_active":"2023-12-20T04:48:37.210700+0000","last_became_peered":"2023-12-20T04:48:37.210700+0000","last_unstale":"2023-12-20T04:48:39.054683+0000","last_undegraded":"2023-12-20T04:48:39.054683+0000","last_fullsized":"2023-12-20T04:48:39.054683+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:01:01.460162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.13","version":"136'2","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.220320+0000","last_change":"2023-12-20T04:48:36.866053+0000","last_active":"2023-12-20T04:48:37.220320+0000","last_peered":"2023-12-20T04:48:37.220320+0000","last_clean":"2023-12-20T04:48:37.220320+0000","last_became_active":"2023-12-20T04:48:36.865612+0000","last_became_peered":"2023-12-20T04:48:36.865612+0000","last_unstale":"2023-12-20T04:48:37.220320+0000","last_undegraded":"2023-12-20T04:48:37.220320+0000","last_fullsized":"2023-12-20T04:48:37.220320+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:24:31.465239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.13","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054513+0000","last_change":"2023-12-20T04:48:37.211307+0000","last_active":"2023-12-20T04:48:39.054513+0000","last_peered":"2023-12-20T04:48:39.054513+0000","last_clean":"2023-12-20T04:48:39.054513+0000","last_became_active":"2023-12-20T04:48:37.210959+0000","last_became_peered":"2023-12-20T04:48:37.210959+0000","last_unstale":"2023-12-20T04:48:39.054513+0000","last_undegraded":"2023-12-20T04:48:39.054513+0000","last_fullsized":"2023-12-20T04:48:39.054513+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:54:31.484661+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.12","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.208500+0000","last_change":"2023-12-20T04:48:36.865713+0000","last_active":"2023-12-20T04:48:37.208500+0000","last_peered":"2023-12-20T04:48:37.208500+0000","last_clean":"2023-12-20T04:48:37.208500+0000","last_became_active":"2023-12-20T04:48:36.865052+0000","last_became_peered":"2023-12-20T04:48:36.865052+0000","last_unstale":"2023-12-20T04:48:37.208500+0000","last_undegraded":"2023-12-20T04:48:37.208500+0000","last_fullsized":"2023-12-20T04:48:37.208500+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:14:46.737836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.11","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054578+0000","last_change":"2023-12-20T04:48:37.208193+0000","last_active":"2023-12-20T04:48:39.054578+0000","last_peered":"2023-12-20T04:48:39.054578+0000","last_clean":"2023-12-20T04:48:39.054578+0000","last_became_active":"2023-12-20T04:48:37.207971+0000","last_became_peered":"2023-12-20T04:48:37.207971+0000","last_unstale":"2023-12-20T04:48:39.054578+0000","last_undegraded":"2023-12-20T04:48:39.054578+0000","last_fullsized":"2023-12-20T04:48:39.054578+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:34:43.732631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.10","version":"136'8","reported_seq":19,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.221919+0000","last_change":"2023-12-20T04:48:36.869184+0000","last_active":"2023-12-20T04:48:37.221919+0000","last_peered":"2023-12-20T04:48:37.221919+0000","last_clean":"2023-12-20T04:48:37.221919+0000","last_became_active":"2023-12-20T04:48:36.868664+0000","last_became_peered":"2023-12-20T04:48:36.868664+0000","last_unstale":"2023-12-20T04:48:37.221919+0000","last_undegraded":"2023-12-20T04:48:37.221919+0000","last_fullsized":"2023-12-20T04:48:37.221919+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:27:05.379326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.e","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054095+0000","last_change":"2023-12-20T04:48:37.213508+0000","last_active":"2023-12-20T04:48:39.054095+0000","last_peered":"2023-12-20T04:48:39.054095+0000","last_clean":"2023-12-20T04:48:39.054095+0000","last_became_active":"2023-12-20T04:48:37.213185+0000","last_became_peered":"2023-12-20T04:48:37.213185+0000","last_unstale":"2023-12-20T04:48:39.054095+0000","last_undegraded":"2023-12-20T04:48:39.054095+0000","last_fullsized":"2023-12-20T04:48:39.054095+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:41:27.869239+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"16.f","version":"136'1","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.221059+0000","last_change":"2023-12-20T04:48:36.871600+0000","last_active":"2023-12-20T04:48:37.221059+0000","last_peered":"2023-12-20T04:48:37.221059+0000","last_clean":"2023-12-20T04:48:37.221059+0000","last_became_active":"2023-12-20T04:48:36.870998+0000","last_became_peered":"2023-12-20T04:48:36.870998+0000","last_unstale":"2023-12-20T04:48:37.221059+0000","last_undegraded":"2023-12-20T04:48:37.221059+0000","last_fullsized":"2023-12-20T04:48:37.221059+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:54:30.482197+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.f","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.053825+0000","last_change":"2023-12-20T04:48:37.215186+0000","last_active":"2023-12-20T04:48:39.053825+0000","last_peered":"2023-12-20T04:48:39.053825+0000","last_clean":"2023-12-20T04:48:39.053825+0000","last_became_active":"2023-12-20T04:48:37.214948+0000","last_became_peered":"2023-12-20T04:48:37.214948+0000","last_unstale":"2023-12-20T04:48:39.053825+0000","last_undegraded":"2023-12-20T04:48:39.053825+0000","last_fullsized":"2023-12-20T04:48:39.053825+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:46:10.943485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"16.e","version":"136'2","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.219979+0000","last_change":"2023-12-20T04:48:36.871525+0000","last_active":"2023-12-20T04:48:37.219979+0000","last_peered":"2023-12-20T04:48:37.219979+0000","last_clean":"2023-12-20T04:48:37.219979+0000","last_became_active":"2023-12-20T04:48:36.868109+0000","last_became_peered":"2023-12-20T04:48:36.868109+0000","last_unstale":"2023-12-20T04:48:37.219979+0000","last_undegraded":"2023-12-20T04:48:37.219979+0000","last_fullsized":"2023-12-20T04:48:37.219979+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:31.190233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.c","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.053676+0000","last_change":"2023-12-20T04:48:37.214032+0000","last_active":"2023-12-20T04:48:39.053676+0000","last_peered":"2023-12-20T04:48:39.053676+0000","last_clean":"2023-12-20T04:48:39.053676+0000","last_became_active":"2023-12-20T04:48:37.213735+0000","last_became_peered":"2023-12-20T04:48:37.213735+0000","last_unstale":"2023-12-20T04:48:39.053676+0000","last_undegraded":"2023-12-20T04:48:39.053676+0000","last_fullsized":"2023-12-20T04:48:39.053676+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:36:57.074800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.d","version":"136'1","reported_seq":12,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.221155+0000","last_change":"2023-12-20T04:48:36.864523+0000","last_active":"2023-12-20T04:48:37.221155+0000","last_peered":"2023-12-20T04:48:37.221155+0000","last_clean":"2023-12-20T04:48:37.221155+0000","last_became_active":"2023-12-20T04:48:36.863604+0000","last_became_peered":"2023-12-20T04:48:36.863604+0000","last_unstale":"2023-12-20T04:48:37.221155+0000","last_undegraded":"2023-12-20T04:48:37.221155+0000","last_fullsized":"2023-12-20T04:48:37.221155+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:13:02.368205+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.d","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.053862+0000","last_change":"2023-12-20T04:48:37.218412+0000","last_active":"2023-12-20T04:48:39.053862+0000","last_peered":"2023-12-20T04:48:39.053862+0000","last_clean":"2023-12-20T04:48:39.053862+0000","last_became_active":"2023-12-20T04:48:37.218067+0000","last_became_peered":"2023-12-20T04:48:37.218067+0000","last_unstale":"2023-12-20T04:48:39.053862+0000","last_undegraded":"2023-12-20T04:48:39.053862+0000","last_fullsized":"2023-12-20T04:48:39.053862+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:05.228323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.c","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.209553+0000","last_change":"2023-12-20T04:48:36.869561+0000","last_active":"2023-12-20T04:48:37.209553+0000","last_peered":"2023-12-20T04:48:37.209553+0000","last_clean":"2023-12-20T04:48:37.209553+0000","last_became_active":"2023-12-20T04:48:36.868958+0000","last_became_peered":"2023-12-20T04:48:36.868958+0000","last_unstale":"2023-12-20T04:48:37.209553+0000","last_undegraded":"2023-12-20T04:48:37.209553+0000","last_fullsized":"2023-12-20T04:48:37.209553+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:49:25.498201+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.a","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054195+0000","last_change":"2023-12-20T04:48:37.215758+0000","last_active":"2023-12-20T04:48:39.054195+0000","last_peered":"2023-12-20T04:48:39.054195+0000","last_clean":"2023-12-20T04:48:39.054195+0000","last_became_active":"2023-12-20T04:48:37.215282+0000","last_became_peered":"2023-12-20T04:48:37.215282+0000","last_unstale":"2023-12-20T04:48:39.054195+0000","last_undegraded":"2023-12-20T04:48:39.054195+0000","last_fullsized":"2023-12-20T04:48:39.054195+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:37:29.653009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.b","version":"136'2","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.221484+0000","last_change":"2023-12-20T04:48:36.868501+0000","last_active":"2023-12-20T04:48:37.221484+0000","last_peered":"2023-12-20T04:48:37.221484+0000","last_clean":"2023-12-20T04:48:37.221484+0000","last_became_active":"2023-12-20T04:48:36.868294+0000","last_became_peered":"2023-12-20T04:48:36.868294+0000","last_unstale":"2023-12-20T04:48:37.221484+0000","last_undegraded":"2023-12-20T04:48:37.221484+0000","last_fullsized":"2023-12-20T04:48:37.221484+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:21:11.425935+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.b","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204768+0000","last_change":"2023-12-20T04:48:37.217284+0000","last_active":"2023-12-20T04:48:38.204768+0000","last_peered":"2023-12-20T04:48:38.204768+0000","last_clean":"2023-12-20T04:48:38.204768+0000","last_became_active":"2023-12-20T04:48:37.214257+0000","last_became_peered":"2023-12-20T04:48:37.214257+0000","last_unstale":"2023-12-20T04:48:38.204768+0000","last_undegraded":"2023-12-20T04:48:38.204768+0000","last_fullsized":"2023-12-20T04:48:38.204768+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:18:13.373449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.a","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.205788+0000","last_change":"2023-12-20T04:48:36.864068+0000","last_active":"2023-12-20T04:48:37.205788+0000","last_peered":"2023-12-20T04:48:37.205788+0000","last_clean":"2023-12-20T04:48:37.205788+0000","last_became_active":"2023-12-20T04:48:36.863860+0000","last_became_peered":"2023-12-20T04:48:36.863860+0000","last_unstale":"2023-12-20T04:48:37.205788+0000","last_undegraded":"2023-12-20T04:48:37.205788+0000","last_fullsized":"2023-12-20T04:48:37.205788+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:06:08.922092+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.8","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.053758+0000","last_change":"2023-12-20T04:48:37.216797+0000","last_active":"2023-12-20T04:48:39.053758+0000","last_peered":"2023-12-20T04:48:39.053758+0000","last_clean":"2023-12-20T04:48:39.053758+0000","last_became_active":"2023-12-20T04:48:37.216576+0000","last_became_peered":"2023-12-20T04:48:37.216576+0000","last_unstale":"2023-12-20T04:48:39.053758+0000","last_undegraded":"2023-12-20T04:48:39.053758+0000","last_fullsized":"2023-12-20T04:48:39.053758+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:12:49.467795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.9","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.214545+0000","last_change":"2023-12-20T04:48:36.866606+0000","last_active":"2023-12-20T04:48:37.214545+0000","last_peered":"2023-12-20T04:48:37.214545+0000","last_clean":"2023-12-20T04:48:37.214545+0000","last_became_active":"2023-12-20T04:48:36.866403+0000","last_became_peered":"2023-12-20T04:48:36.866403+0000","last_unstale":"2023-12-20T04:48:37.214545+0000","last_undegraded":"2023-12-20T04:48:37.214545+0000","last_fullsized":"2023-12-20T04:48:37.214545+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:55:54.167519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"17.9","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054608+0000","last_change":"2023-12-20T04:48:37.206010+0000","last_active":"2023-12-20T04:48:39.054608+0000","last_peered":"2023-12-20T04:48:39.054608+0000","last_clean":"2023-12-20T04:48:39.054608+0000","last_became_active":"2023-12-20T04:48:37.205777+0000","last_became_peered":"2023-12-20T04:48:37.205777+0000","last_unstale":"2023-12-20T04:48:39.054608+0000","last_undegraded":"2023-12-20T04:48:39.054608+0000","last_fullsized":"2023-12-20T04:48:39.054608+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:44:25.974593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.8","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.206048+0000","last_change":"2023-12-20T04:48:36.870473+0000","last_active":"2023-12-20T04:48:37.206048+0000","last_peered":"2023-12-20T04:48:37.206048+0000","last_clean":"2023-12-20T04:48:37.206048+0000","last_became_active":"2023-12-20T04:48:36.867505+0000","last_became_peered":"2023-12-20T04:48:36.867505+0000","last_unstale":"2023-12-20T04:48:37.206048+0000","last_undegraded":"2023-12-20T04:48:37.206048+0000","last_fullsized":"2023-12-20T04:48:37.206048+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:57:21.208524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.6","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054160+0000","last_change":"2023-12-20T04:48:37.219580+0000","last_active":"2023-12-20T04:48:39.054160+0000","last_peered":"2023-12-20T04:48:39.054160+0000","last_clean":"2023-12-20T04:48:39.054160+0000","last_became_active":"2023-12-20T04:48:37.219302+0000","last_became_peered":"2023-12-20T04:48:37.219302+0000","last_unstale":"2023-12-20T04:48:39.054160+0000","last_undegraded":"2023-12-20T04:48:39.054160+0000","last_fullsized":"2023-12-20T04:48:39.054160+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:05.228323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.7","version":"136'2","reported_seq":13,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.220087+0000","last_change":"2023-12-20T04:48:36.865331+0000","last_active":"2023-12-20T04:48:37.220087+0000","last_peered":"2023-12-20T04:48:37.220087+0000","last_clean":"2023-12-20T04:48:37.220087+0000","last_became_active":"2023-12-20T04:48:36.865127+0000","last_became_peered":"2023-12-20T04:48:36.865127+0000","last_unstale":"2023-12-20T04:48:37.220087+0000","last_undegraded":"2023-12-20T04:48:37.220087+0000","last_fullsized":"2023-12-20T04:48:37.220087+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:45:34.903470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.7","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204948+0000","last_change":"2023-12-20T04:48:37.208713+0000","last_active":"2023-12-20T04:48:38.204948+0000","last_peered":"2023-12-20T04:48:38.204948+0000","last_clean":"2023-12-20T04:48:38.204948+0000","last_became_active":"2023-12-20T04:48:37.208502+0000","last_became_peered":"2023-12-20T04:48:37.208502+0000","last_unstale":"2023-12-20T04:48:38.204948+0000","last_undegraded":"2023-12-20T04:48:38.204948+0000","last_fullsized":"2023-12-20T04:48:38.204948+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:32:06.493904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.6","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.209750+0000","last_change":"2023-12-20T04:48:36.868603+0000","last_active":"2023-12-20T04:48:37.209750+0000","last_peered":"2023-12-20T04:48:37.209750+0000","last_clean":"2023-12-20T04:48:37.209750+0000","last_became_active":"2023-12-20T04:48:36.868371+0000","last_became_peered":"2023-12-20T04:48:36.868371+0000","last_unstale":"2023-12-20T04:48:37.209750+0000","last_undegraded":"2023-12-20T04:48:37.209750+0000","last_fullsized":"2023-12-20T04:48:37.209750+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:39:00.957194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"17.4","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204935+0000","last_change":"2023-12-20T04:48:37.216036+0000","last_active":"2023-12-20T04:48:38.204935+0000","last_peered":"2023-12-20T04:48:38.204935+0000","last_clean":"2023-12-20T04:48:38.204935+0000","last_became_active":"2023-12-20T04:48:37.215559+0000","last_became_peered":"2023-12-20T04:48:37.215559+0000","last_unstale":"2023-12-20T04:48:38.204935+0000","last_undegraded":"2023-12-20T04:48:38.204935+0000","last_fullsized":"2023-12-20T04:48:38.204935+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:59:22.452519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.5","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.205084+0000","last_change":"2023-12-20T04:48:36.870000+0000","last_active":"2023-12-20T04:48:37.205084+0000","last_peered":"2023-12-20T04:48:37.205084+0000","last_clean":"2023-12-20T04:48:37.205084+0000","last_became_active":"2023-12-20T04:48:36.867304+0000","last_became_peered":"2023-12-20T04:48:36.867304+0000","last_unstale":"2023-12-20T04:48:37.205084+0000","last_undegraded":"2023-12-20T04:48:37.205084+0000","last_fullsized":"2023-12-20T04:48:37.205084+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:51:30.201471+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.5","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054339+0000","last_change":"2023-12-20T04:48:37.212819+0000","last_active":"2023-12-20T04:48:39.054339+0000","last_peered":"2023-12-20T04:48:39.054339+0000","last_clean":"2023-12-20T04:48:39.054339+0000","last_became_active":"2023-12-20T04:48:37.212607+0000","last_became_peered":"2023-12-20T04:48:37.212607+0000","last_unstale":"2023-12-20T04:48:39.054339+0000","last_undegraded":"2023-12-20T04:48:39.054339+0000","last_fullsized":"2023-12-20T04:48:39.054339+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:35:43.401551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"16.4","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.203681+0000","last_change":"2023-12-20T04:48:36.863372+0000","last_active":"2023-12-20T04:48:37.203681+0000","last_peered":"2023-12-20T04:48:37.203681+0000","last_clean":"2023-12-20T04:48:37.203681+0000","last_became_active":"2023-12-20T04:48:36.863167+0000","last_became_peered":"2023-12-20T04:48:36.863167+0000","last_unstale":"2023-12-20T04:48:37.203681+0000","last_undegraded":"2023-12-20T04:48:37.203681+0000","last_fullsized":"2023-12-20T04:48:37.203681+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:57:07.085438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"17.2","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.205045+0000","last_change":"2023-12-20T04:48:37.211598+0000","last_active":"2023-12-20T04:48:38.205045+0000","last_peered":"2023-12-20T04:48:38.205045+0000","last_clean":"2023-12-20T04:48:38.205045+0000","last_became_active":"2023-12-20T04:48:37.211372+0000","last_became_peered":"2023-12-20T04:48:37.211372+0000","last_unstale":"2023-12-20T04:48:38.205045+0000","last_undegraded":"2023-12-20T04:48:38.205045+0000","last_fullsized":"2023-12-20T04:48:38.205045+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:57:22.210989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.3","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.208587+0000","last_change":"2023-12-20T04:48:36.866493+0000","last_active":"2023-12-20T04:48:37.208587+0000","last_peered":"2023-12-20T04:48:37.208587+0000","last_clean":"2023-12-20T04:48:37.208587+0000","last_became_active":"2023-12-20T04:48:36.866263+0000","last_became_peered":"2023-12-20T04:48:36.866263+0000","last_unstale":"2023-12-20T04:48:37.208587+0000","last_undegraded":"2023-12-20T04:48:37.208587+0000","last_fullsized":"2023-12-20T04:48:37.208587+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:14:17.093075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"17.3","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.205091+0000","last_change":"2023-12-20T04:48:37.208790+0000","last_active":"2023-12-20T04:48:38.205091+0000","last_peered":"2023-12-20T04:48:38.205091+0000","last_clean":"2023-12-20T04:48:38.205091+0000","last_became_active":"2023-12-20T04:48:37.207864+0000","last_became_peered":"2023-12-20T04:48:37.207864+0000","last_unstale":"2023-12-20T04:48:38.205091+0000","last_undegraded":"2023-12-20T04:48:38.205091+0000","last_fullsized":"2023-12-20T04:48:38.205091+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:34:43.732631+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"16.2","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.206350+0000","last_change":"2023-12-20T04:48:36.870365+0000","last_active":"2023-12-20T04:48:37.206350+0000","last_peered":"2023-12-20T04:48:37.206350+0000","last_clean":"2023-12-20T04:48:37.206350+0000","last_became_active":"2023-12-20T04:48:36.870178+0000","last_became_peered":"2023-12-20T04:48:36.870178+0000","last_unstale":"2023-12-20T04:48:37.206350+0000","last_undegraded":"2023-12-20T04:48:37.206350+0000","last_fullsized":"2023-12-20T04:48:37.206350+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:59:50.306154+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"17.0","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054101+0000","last_change":"2023-12-20T04:48:37.218734+0000","last_active":"2023-12-20T04:48:39.054101+0000","last_peered":"2023-12-20T04:48:39.054101+0000","last_clean":"2023-12-20T04:48:39.054101+0000","last_became_active":"2023-12-20T04:48:37.218087+0000","last_became_peered":"2023-12-20T04:48:37.218087+0000","last_unstale":"2023-12-20T04:48:39.054101+0000","last_undegraded":"2023-12-20T04:48:39.054101+0000","last_fullsized":"2023-12-20T04:48:39.054101+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:44:25.974593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"16.1","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.206406+0000","last_change":"2023-12-20T04:48:36.870027+0000","last_active":"2023-12-20T04:48:37.206406+0000","last_peered":"2023-12-20T04:48:37.206406+0000","last_clean":"2023-12-20T04:48:37.206406+0000","last_became_active":"2023-12-20T04:48:36.868971+0000","last_became_peered":"2023-12-20T04:48:36.868971+0000","last_unstale":"2023-12-20T04:48:37.206406+0000","last_undegraded":"2023-12-20T04:48:37.206406+0000","last_fullsized":"2023-12-20T04:48:37.206406+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:35:43.620245+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"17.1","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:38.204856+0000","last_change":"2023-12-20T04:48:37.212779+0000","last_active":"2023-12-20T04:48:38.204856+0000","last_peered":"2023-12-20T04:48:38.204856+0000","last_clean":"2023-12-20T04:48:38.204856+0000","last_became_active":"2023-12-20T04:48:37.212269+0000","last_became_peered":"2023-12-20T04:48:37.212269+0000","last_unstale":"2023-12-20T04:48:38.204856+0000","last_undegraded":"2023-12-20T04:48:38.204856+0000","last_fullsized":"2023-12-20T04:48:38.204856+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:05:19.921955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"16.0","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.205260+0000","last_change":"2023-12-20T04:48:36.871317+0000","last_active":"2023-12-20T04:48:37.205260+0000","last_peered":"2023-12-20T04:48:37.205260+0000","last_clean":"2023-12-20T04:48:37.205260+0000","last_became_active":"2023-12-20T04:48:36.868179+0000","last_became_peered":"2023-12-20T04:48:36.868179+0000","last_unstale":"2023-12-20T04:48:37.205260+0000","last_undegraded":"2023-12-20T04:48:37.205260+0000","last_fullsized":"2023-12-20T04:48:37.205260+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:43:00.715984+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"17.10","version":"0'0","reported_seq":10,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054536+0000","last_change":"2023-12-20T04:48:37.213723+0000","last_active":"2023-12-20T04:48:39.054536+0000","last_peered":"2023-12-20T04:48:39.054536+0000","last_clean":"2023-12-20T04:48:39.054536+0000","last_became_active":"2023-12-20T04:48:37.213419+0000","last_became_peered":"2023-12-20T04:48:37.213419+0000","last_unstale":"2023-12-20T04:48:39.054536+0000","last_undegraded":"2023-12-20T04:48:39.054536+0000","last_fullsized":"2023-12-20T04:48:39.054536+0000","mapping_epoch":135,"log_start":"0'0","ondisk_log_start":"0'0","created":135,"last_epoch_clean":136,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:36.853065+0000","last_clean_scrub_stamp":"2023-12-20T04:48:36.853065+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:43:01.718448+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"16.11","version":"0'0","reported_seq":11,"reported_epoch":136,"state":"active+clean","last_fresh":"2023-12-20T04:48:37.209472+0000","last_change":"2023-12-20T04:48:36.869456+0000","last_active":"2023-12-20T04:48:37.209472+0000","last_peered":"2023-12-20T04:48:37.209472+0000","last_clean":"2023-12-20T04:48:37.209472+0000","last_became_active":"2023-12-20T04:48:36.868475+0000","last_became_peered":"2023-12-20T04:48:36.868475+0000","last_unstale":"2023-12-20T04:48:37.209472+0000","last_undegraded":"2023-12-20T04:48:37.209472+0000","last_fullsized":"2023-12-20T04:48:37.209472+0000","mapping_epoch":134,"log_start":"0'0","ondisk_log_start":"0'0","created":134,"last_epoch_clean":135,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:48:35.850601+0000","last_clean_scrub_stamp":"2023-12-20T04:48:35.850601+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:05:43.588839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":265,"reported_epoch":137,"state":"active+clean","last_fresh":"2023-12-20T04:48:39.054382+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:48:39.054382+0000","last_peered":"2023-12-20T04:48:39.054382+0000","last_clean":"2023-12-20T04:48:39.054382+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:48:39.054382+0000","last_undegraded":"2023-12-20T04:48:39.054382+0000","last_fullsized":"2023-12-20T04:48:39.054382+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":17,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":16,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574923,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1316,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193996,"statfs":{"total":200000000,"available":198652007,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.54900000000000004,"15min":0.53300000000000003},"min":{"1min":0.42499999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.73399999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.50700000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.52200000000000002},"min":{"1min":0.33100000000000002,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67300000000000004,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.67200000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.54700000000000004,"15min":0.54600000000000004},"min":{"1min":0.39700000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.68700000000000006,"5min":0.98799999999999999,"15min":0.98799999999999999},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.58399999999999996,"15min":0.57399999999999995},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.71599999999999997,"5min":1.0269999999999999,"15min":1.0269999999999999},"last":0.64600000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55100000000000005,"15min":0.53300000000000003},"min":{"1min":0.39800000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.65200000000000002,"5min":1.0069999999999999,"15min":1.0069999999999999},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.54800000000000004,"15min":0.54600000000000004},"min":{"1min":0.38700000000000001,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70099999999999996,"5min":0.78000000000000003,"15min":0.78000000000000003},"last":0.629}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.56100000000000005,"15min":0.55500000000000005},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.70299999999999996,"5min":1.048,"15min":1.048},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56799999999999995,"15min":0.56299999999999994},"min":{"1min":0.41699999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.70099999999999996,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.59799999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"min":{"1min":0.38700000000000001,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.65600000000000003,"5min":0.753,"15min":0.753},"last":0.41299999999999998},{"interface":"front","average":{"1min":0.52100000000000002,"5min":0.49199999999999999,"15min":0.48999999999999999},"min":{"1min":0.35199999999999998,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.70399999999999996,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.45600000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.48299999999999998,"15min":0.49099999999999999},"min":{"1min":0.377,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.68999999999999995,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.40500000000000003,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.85299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.52200000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51900000000000002,"15min":0.54600000000000004},"min":{"1min":0.34399999999999997,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.71599999999999997,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.35599999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.74399999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.55000000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574924,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":739,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194573,"statfs":{"total":200000000,"available":199242921,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.50800000000000001,"15min":0.496},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.57099999999999995},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.53200000000000003,"15min":0.53500000000000003},"min":{"1min":0.31900000000000001,"5min":0.314,"15min":0.314},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.40899999999999997}]},{"osd":1,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.55200000000000005,"15min":0.53100000000000003},"min":{"1min":0.36699999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.56899999999999995,"15min":0.57699999999999996},"min":{"1min":0.39700000000000002,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.753,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.52300000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.52200000000000002,"15min":0.50800000000000001},"min":{"1min":0.40100000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.34599999999999997,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.69999999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.42899999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.50900000000000001,"5min":0.53100000000000003,"15min":0.5},"min":{"1min":0.373,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.71799999999999997,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.495},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.78900000000000003,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.50600000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.48199999999999998,"15min":0.50600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.503,"15min":0.49399999999999999},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.70399999999999996,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.46400000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51700000000000002},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.68799999999999994,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.54300000000000004,"15min":0.55500000000000005},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.60499999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:47:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.53900000000000003,"15min":0.54700000000000004},"min":{"1min":0.35299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73199999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58899999999999997,"15min":0.58099999999999996},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.76800000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.55700000000000005}]}]},{"osd":5,"up_from":13,"seq":55834574923,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":739,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194572,"statfs":{"total":200000000,"available":199242387,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.53200000000000003,"15min":0.51000000000000001},"min":{"1min":0.39900000000000002,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.57299999999999995,"15min":0.56100000000000005},"min":{"1min":0.39900000000000002,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.82299999999999995,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.57499999999999996}]},{"osd":1,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54500000000000004,"15min":0.54900000000000004},"min":{"1min":0.33300000000000002,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.80600000000000005,"5min":0.82099999999999995,"15min":0.82099999999999995},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.58499999999999996,"15min":0.57899999999999996},"min":{"1min":0.35899999999999999,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.503}]},{"osd":2,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52200000000000002,"15min":0.51200000000000001},"min":{"1min":0.36099999999999999,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.53200000000000003,"15min":0.51800000000000002},"min":{"1min":0.41499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.68300000000000005,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.52500000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.51200000000000001,"5min":0.52600000000000002,"15min":0.52700000000000002},"min":{"1min":0.32300000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.66100000000000003,"5min":0.80900000000000005,"15min":0.80900000000000005},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.371,"5min":0.312,"15min":0.312},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.47799999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.499,"5min":0.47699999999999998,"15min":0.503},"min":{"1min":0.28799999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.749,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.47599999999999998,"15min":0.48099999999999998},"min":{"1min":0.32800000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.35199999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.503,"5min":0.48399999999999999,"15min":0.50600000000000001},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73299999999999998,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.52700000000000002,"15min":0.54200000000000004},"min":{"1min":0.37,"5min":0.31,"15min":0.31},"max":{"1min":0.78600000000000003,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.54200000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:47:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51400000000000001,"15min":0.52800000000000002},"min":{"1min":0.34200000000000003,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.73099999999999998,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58299999999999996,"15min":0.60699999999999998},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75800000000000001,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.55600000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574923,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":739,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194573,"statfs":{"total":200000000,"available":199242991,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.308,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.62},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.33000000000000002,"5min":0.251,"15min":0.251},"max":{"1min":0.67100000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.66700000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53500000000000003,"15min":0.51500000000000001},"min":{"1min":0.34200000000000003,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69899999999999995,"5min":0.71699999999999997,"15min":0.71699999999999997},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.52900000000000003,"15min":0.52600000000000002},"min":{"1min":0.36499999999999999,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.85699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.54000000000000004,"15min":0.55600000000000005},"min":{"1min":0.41099999999999998,"5min":0.313,"15min":0.313},"max":{"1min":0.76000000000000001,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.53300000000000003,"15min":0.54900000000000004},"min":{"1min":0.371,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.70299999999999996}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.56499999999999995,"15min":0.55500000000000005},"min":{"1min":0.40100000000000002,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.73399999999999999},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.59199999999999997,"15min":0.58799999999999997},"min":{"1min":0.48499999999999999,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.877,"5min":0.91000000000000003,"15min":0.91000000000000003},"last":0.67900000000000005}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.44700000000000001,"5min":0.44400000000000001,"15min":0.47199999999999998},"min":{"1min":0.33000000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.56599999999999995,"5min":0.66200000000000003,"15min":0.66200000000000003},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.499,"5min":0.49199999999999999,"15min":0.505},"min":{"1min":0.32300000000000001,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.66000000000000003,"5min":0.76700000000000002,"15min":0.76700000000000002},"last":0.60099999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.48799999999999999,"15min":0.503},"min":{"1min":0.371,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.72199999999999998,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.52300000000000002,"5min":0.50900000000000001,"15min":0.53000000000000003},"min":{"1min":0.34699999999999998,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.70499999999999996,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.44900000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.51700000000000002,"15min":0.51500000000000001},"min":{"1min":0.34599999999999997,"5min":0.316,"15min":0.316},"max":{"1min":0.76200000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.41899999999999998,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.38400000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574923,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":740,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194571,"statfs":{"total":200000000,"available":199241357,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.35199999999999998,"15min":0.34000000000000002},"min":{"1min":0.20100000000000001,"5min":0.193,"15min":0.193},"max":{"1min":0.58299999999999996,"5min":0.629,"15min":0.629},"last":0.24299999999999999},{"interface":"front","average":{"1min":0.38500000000000001,"5min":0.374,"15min":0.35599999999999998},"min":{"1min":0.29099999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.56200000000000006,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.29799999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34100000000000003,"5min":0.33300000000000002,"15min":0.32100000000000001},"min":{"1min":0.245,"5min":0.219,"15min":0.219},"max":{"1min":0.54200000000000004,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.23200000000000001},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.36099999999999999,"15min":0.33700000000000002},"min":{"1min":0.27800000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.27900000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.35099999999999998,"15min":0.34499999999999997},"min":{"1min":0.249,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.49299999999999999,"5min":0.64900000000000002,"15min":0.64900000000000002},"last":0.32500000000000001},{"interface":"front","average":{"1min":0.40300000000000002,"5min":0.39300000000000002,"15min":0.376},"min":{"1min":0.30499999999999999,"5min":0.25,"15min":0.25},"max":{"1min":0.63600000000000001,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.311}]},{"osd":4,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55800000000000005,"15min":0.54300000000000004},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78100000000000003,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.34300000000000003,"5min":0.313,"15min":0.313},"max":{"1min":0.76800000000000002,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.42499999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.57499999999999996,"15min":0.56000000000000005},"min":{"1min":0.45200000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.57199999999999995,"15min":0.55700000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.72199999999999998,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.44900000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.38500000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.76700000000000002,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.40799999999999997},{"interface":"front","average":{"1min":0.63300000000000001,"5min":0.58399999999999996,"15min":0.56100000000000005},"min":{"1min":0.495,"5min":0.37,"15min":0.37},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.44}]},{"osd":7,"last update":"Wed Dec 20 04:47:49 2023","interfaces":[{"interface":"back","average":{"1min":0.61599999999999999,"5min":0.58599999999999997,"15min":0.56499999999999995},"min":{"1min":0.41899999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80600000000000005,"5min":0.879,"15min":0.879},"last":0.502},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58999999999999997,"15min":0.57799999999999996},"min":{"1min":0.42599999999999999,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":0.80300000000000005,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.45700000000000002}]}]},{"osd":2,"up_from":13,"seq":55834574923,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":739,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194573,"statfs":{"total":200000000,"available":199242991,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.33300000000000002,"15min":0.29999999999999999},"min":{"1min":0.246,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.44700000000000001,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.22900000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.39300000000000002,"15min":0.34499999999999997},"min":{"1min":0.25800000000000001,"5min":0.17699999999999999,"15min":0.17699999999999999},"max":{"1min":0.504,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.29999999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.35399999999999998,"5min":0.35599999999999998,"15min":0.33100000000000002},"min":{"1min":0.24099999999999999,"5min":0.17999999999999999,"15min":0.17999999999999999},"max":{"1min":0.54300000000000004,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.375,"15min":0.35099999999999998},"min":{"1min":0.247,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.5,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.34399999999999997}]},{"osd":3,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.39600000000000002,"5min":0.40000000000000002,"15min":0.35999999999999999},"min":{"1min":0.27700000000000002,"5min":0.216,"15min":0.216},"max":{"1min":0.58299999999999996,"5min":0.995,"15min":0.995},"last":0.312},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39600000000000002,"15min":0.372},"min":{"1min":0.28100000000000003,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.53600000000000003,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.32000000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.56999999999999995,"15min":0.56999999999999995},"min":{"1min":0.442,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.754,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.378},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.59499999999999997,"15min":0.57099999999999995},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.75,"5min":2.347,"15min":2.347},"last":0.40999999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59099999999999997,"5min":0.57699999999999996,"15min":0.57899999999999996},"min":{"1min":0.42099999999999999,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84999999999999998,"5min":0.997,"15min":0.997},"last":0.45900000000000002},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.40200000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.59199999999999997,"15min":0.57499999999999996},"min":{"1min":0.41099999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.71699999999999997,"5min":2.274,"15min":2.274},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.58599999999999997,"15min":0.57399999999999995},"min":{"1min":0.38,"5min":0.373,"15min":0.373},"max":{"1min":0.82299999999999995,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.498}]},{"osd":7,"last update":"Wed Dec 20 04:47:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.59799999999999998,"15min":0.57099999999999995},"min":{"1min":0.39000000000000001,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.80800000000000005,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.443},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.59099999999999997,"15min":0.57999999999999996},"min":{"1min":0.45100000000000001,"5min":0.379,"15min":0.379},"max":{"1min":0.77700000000000002,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.48299999999999998}]}]},{"osd":1,"up_from":13,"seq":55834574924,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":739,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194573,"statfs":{"total":200000000,"available":199242867,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.316,"15min":0.28999999999999998},"min":{"1min":0.23000000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.31900000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.35299999999999998,"15min":0.33100000000000002},"min":{"1min":0.23699999999999999,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.54100000000000004,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.27500000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.33200000000000002,"15min":0.307},"min":{"1min":0.20599999999999999,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.52400000000000002,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.249},{"interface":"front","average":{"1min":0.39100000000000001,"5min":0.377,"15min":0.35099999999999998},"min":{"1min":0.26900000000000002,"5min":0.224,"15min":0.224},"max":{"1min":0.55900000000000005,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.36099999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.41699999999999998,"5min":0.38800000000000001,"15min":0.35799999999999998},"min":{"1min":0.29499999999999998,"5min":0.191,"15min":0.191},"max":{"1min":0.61699999999999999,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.379},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.36399999999999999,"15min":0.35299999999999998},"min":{"1min":0.26400000000000001,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.54800000000000004,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.307}]},{"osd":4,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.437,"5min":0.312,"15min":0.312},"max":{"1min":0.70999999999999996,"5min":0.873,"15min":0.873},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.56899999999999995,"15min":0.54900000000000004},"min":{"1min":0.45000000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.73099999999999998,"5min":1.002,"15min":1.002},"last":0.51600000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.42099999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.73999999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.59199999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.54200000000000004},"min":{"1min":0.45900000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.73699999999999999,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.54100000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.57899999999999996,"5min":0.56399999999999995,"15min":0.55800000000000005},"min":{"1min":0.47999999999999998,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.76300000000000001,"5min":1.038,"15min":1.038},"last":0.55400000000000005},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.57499999999999996,"15min":0.56299999999999994},"min":{"1min":0.438,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.66900000000000004,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56499999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:47:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60199999999999998,"5min":0.59299999999999997,"15min":0.59199999999999997},"min":{"1min":0.42899999999999999,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.72299999999999998,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59299999999999997,"15min":0.60699999999999998},"min":{"1min":0.51500000000000001,"5min":0.376,"15min":0.376},"max":{"1min":0.73499999999999999,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574923,"num_pgs":36,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1317,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193995,"statfs":{"total":200000000,"available":198650947,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.34599999999999997,"5min":0.32200000000000001,"15min":0.31},"min":{"1min":0.25,"5min":0.184,"15min":0.184},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.35999999999999999},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.33900000000000002,"15min":0.314},"min":{"1min":0.27400000000000002,"5min":0.184,"15min":0.184},"max":{"1min":0.46300000000000002,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.28799999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.36599999999999999,"15min":0.35699999999999998},"min":{"1min":0.28599999999999998,"5min":0.218,"15min":0.218},"max":{"1min":0.53500000000000003,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.40999999999999998},{"interface":"front","average":{"1min":0.39200000000000002,"5min":0.35999999999999999,"15min":0.34799999999999998},"min":{"1min":0.26500000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.51300000000000001,"5min":0.622,"15min":0.622},"last":0.40200000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34799999999999998,"15min":0.32500000000000001},"min":{"1min":0.29099999999999998,"5min":0.23899999999999999,"15min":0.23899999999999999},"max":{"1min":0.55300000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38700000000000001,"15min":0.36899999999999999},"min":{"1min":0.29399999999999998,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.53600000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.39200000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.55200000000000005,"15min":0.52300000000000002},"min":{"1min":0.38700000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.78300000000000003,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.52200000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.55800000000000005,"15min":0.53700000000000003},"min":{"1min":0.432,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.75700000000000001,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.55200000000000005,"15min":0.52200000000000002},"min":{"1min":0.432,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.73199999999999998,"5min":0.81200000000000006,"15min":0.81200000000000006},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57199999999999995,"15min":0.54700000000000004},"min":{"1min":0.38200000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.82999999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.55200000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.61299999999999999,"5min":0.60099999999999998,"15min":0.58399999999999996},"min":{"1min":0.442,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.88200000000000001,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.63500000000000001,"5min":0.59899999999999998,"15min":0.58399999999999996},"min":{"1min":0.45300000000000001,"5min":0.374,"15min":0.374},"max":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.55900000000000005}]},{"osd":7,"last update":"Wed Dec 20 04:47:43 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.42299999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.747,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.58199999999999996,"15min":0.57399999999999995},"min":{"1min":0.39300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.83399999999999996,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.53200000000000003}]}]}],"pool_statfs":[]}} 2023-12-20T04:48:44.819 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-20T04:48:44.819 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-20T04:48:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.961+0000 7f0b8ab99640 1 Processor -- start 2023-12-20T04:48:44.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.961+0000 7f0b8ab99640 1 -- start start 2023-12-20T04:48:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.962+0000 7f0b8ab99640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0b8415d300 0x7f0b840d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.962+0000 7f0b8ab99640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b840d17d0 0x7f0b840cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.962+0000 7f0b8ab99640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0b840d2920 con 0x7f0b840cfcd0 2023-12-20T04:48:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.962+0000 7f0b8ab99640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0b840d0160 con 0x7f0b8415d300 2023-12-20T04:48:44.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.962+0000 7f0b8ab99640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b840d1d10 con 0x7f0b840d17d0 2023-12-20T04:48:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.962+0000 7f0b88935640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0b8415d300 0x7f0b840d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.962+0000 7f0b89136640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0b840cfcd0 0x7f0b840b48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47798/0 (socket says 172.21.15.132:47798) 2023-12-20T04:48:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.962+0000 7f0b89136640 1 -- 172.21.15.132:0/4067770795 learned_addr learned my addr 172.21.15.132:0/4067770795 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.963+0000 7f0b88935640 1 -- 172.21.15.132:0/4067770795 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b840d17d0 msgr2=0x7f0b840cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.963+0000 7f0b83fff640 1 --2- 172.21.15.132:0/4067770795 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b840d17d0 0x7f0b840cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.963+0000 7f0b88935640 1 --2- 172.21.15.132:0/4067770795 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b840d17d0 0x7f0b840cf790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.963+0000 7f0b837fe640 1 -- 172.21.15.132:0/4067770795 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4115929384 0 0) 0x7f0b840d2920 con 0x7f0b840cfcd0 2023-12-20T04:48:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.963+0000 7f0b88935640 1 -- 172.21.15.132:0/4067770795 >> v1:172.21.15.132:6789/0 conn(0x7f0b840cfcd0 legacy=0x7f0b840b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.963+0000 7f0b88935640 1 -- 172.21.15.132:0/4067770795 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b840d1ff0 con 0x7f0b8415d300 2023-12-20T04:48:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.963+0000 7f0b88935640 1 --2- 172.21.15.132:0/4067770795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b8415d300 0x7f0b840d1290 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f0b740097a0 tx=0x7f0b7402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33f18a4b9d99208 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.964+0000 7f0b837fe640 1 -- 172.21.15.132:0/4067770795 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74031830 con 0x7f0b8415d300 2023-12-20T04:48:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.964+0000 7f0b837fe640 1 -- 172.21.15.132:0/4067770795 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b74031990 con 0x7f0b8415d300 2023-12-20T04:48:44.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.964+0000 7f0b837fe640 1 -- 172.21.15.132:0/4067770795 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b74031d20 con 0x7f0b8415d300 2023-12-20T04:48:44.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.964+0000 7f0b8ab99640 1 -- 172.21.15.132:0/4067770795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b8415d300 msgr2=0x7f0b840d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:44.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.964+0000 7f0b8ab99640 1 --2- 172.21.15.132:0/4067770795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b8415d300 0x7f0b840d1290 secure :-1 s=READY pgs=1365 cs=0 l=1 rev1=1 crypto rx=0x7f0b740097a0 tx=0x7f0b7402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:48:44.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.964+0000 7f0b8ab99640 1 -- 172.21.15.132:0/4067770795 shutdown_connections 2023-12-20T04:48:44.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.964+0000 7f0b8ab99640 1 --2- 172.21.15.132:0/4067770795 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b840d17d0 0x7f0b840cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:44.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.964+0000 7f0b8ab99640 1 --2- 172.21.15.132:0/4067770795 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b8415d300 0x7f0b840d1290 unknown :-1 s=CLOSED pgs=1365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:44.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.964+0000 7f0b8ab99640 1 -- 172.21.15.132:0/4067770795 >> 172.21.15.132:0/4067770795 conn(0x7f0b8406a3d0 msgr2=0x7f0b8406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:44.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.964+0000 7f0b8ab99640 1 -- 172.21.15.132:0/4067770795 shutdown_connections 2023-12-20T04:48:44.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.964+0000 7f0b8ab99640 1 -- 172.21.15.132:0/4067770795 wait complete. 2023-12-20T04:48:44.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.965+0000 7f0b8ab99640 1 Processor -- start 2023-12-20T04:48:44.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.965+0000 7f0b8ab99640 1 -- start start 2023-12-20T04:48:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.966+0000 7f0b8ab99640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b840cfcd0 0x7f0b841503e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.966+0000 7f0b8ab99640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b840d17d0 0x7f0b840cbc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.966+0000 7f0b8ab99640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8415d300 0x7f0b8415bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.966+0000 7f0b8ab99640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b840cacf0 con 0x7f0b840cfcd0 2023-12-20T04:48:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.966+0000 7f0b8ab99640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0b840ca0e0 con 0x7f0b8415d300 2023-12-20T04:48:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.966+0000 7f0b8ab99640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0b840ca3c0 con 0x7f0b840d17d0 2023-12-20T04:48:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.966+0000 7f0b88935640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b840cfcd0 0x7f0b841503e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.966+0000 7f0b88935640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b840cfcd0 0x7f0b841503e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52816/0 (socket says 172.21.15.132:52816) 2023-12-20T04:48:44.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.966+0000 7f0b88935640 1 -- 172.21.15.132:0/2419524473 learned_addr learned my addr 172.21.15.132:0/2419524473 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.967+0000 7f0b88935640 1 -- 172.21.15.132:0/2419524473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b840d17d0 msgr2=0x7f0b840cbc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.967+0000 7f0b88935640 1 --2- 172.21.15.132:0/2419524473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b840d17d0 0x7f0b840cbc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.967+0000 7f0b88935640 1 -- 172.21.15.132:0/2419524473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8415d300 msgr2=0x7f0b8415bac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.967+0000 7f0b88935640 1 --2- 172.21.15.132:0/2419524473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8415d300 0x7f0b8415bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.967+0000 7f0b88935640 1 -- 172.21.15.132:0/2419524473 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b74009400 con 0x7f0b840cfcd0 2023-12-20T04:48:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.967+0000 7f0b88935640 1 --2- 172.21.15.132:0/2419524473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b840cfcd0 0x7f0b841503e0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f0b7402bee0 tx=0x7f0b740046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.967+0000 7f0b817fa640 1 -- 172.21.15.132:0/2419524473 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b7403ba70 con 0x7f0b840cfcd0 2023-12-20T04:48:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.967+0000 7f0b817fa640 1 -- 172.21.15.132:0/2419524473 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0b7403bbf0 con 0x7f0b840cfcd0 2023-12-20T04:48:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.967+0000 7f0b817fa640 1 -- 172.21.15.132:0/2419524473 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0b740453f0 con 0x7f0b840cfcd0 2023-12-20T04:48:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.967+0000 7f0b8ab99640 1 -- 172.21.15.132:0/2419524473 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0b840ca6a0 con 0x7f0b840cfcd0 2023-12-20T04:48:44.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.967+0000 7f0b8ab99640 1 -- 172.21.15.132:0/2419524473 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0b840cc190 con 0x7f0b840cfcd0 2023-12-20T04:48:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.968+0000 7f0b8ab99640 1 -- 172.21.15.132:0/2419524473 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0b8404e840 con 0x7f0b840cfcd0 2023-12-20T04:48:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.968+0000 7f0b817fa640 1 -- 172.21.15.132:0/2419524473 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0b7404e450 con 0x7f0b840cfcd0 2023-12-20T04:48:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.969+0000 7f0b817fa640 1 --2- 172.21.15.132:0/2419524473 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b7006a430 0x7f0b7006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.969+0000 7f0b817fa640 1 -- 172.21.15.132:0/2419524473 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0b740aac10 con 0x7f0b840cfcd0 2023-12-20T04:48:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.969+0000 7f0b83fff640 1 --2- 172.21.15.132:0/2419524473 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b7006a430 0x7f0b7006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:44.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.969+0000 7f0b83fff640 1 --2- 172.21.15.132:0/2419524473 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b7006a430 0x7f0b7006c8f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0b84160490 tx=0x7f0b78008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:44.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:44.973+0000 7f0b817fa640 1 -- 172.21.15.132:0/2419524473 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0b740763b0 con 0x7f0b840cfcd0 2023-12-20T04:48:45.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.202+0000 7f0b8ab99640 1 -- 172.21.15.132:0/2419524473 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f0b84159190 con 0x7f0b840cfcd0 2023-12-20T04:48:45.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.208+0000 7f0b817fa640 1 -- 172.21.15.132:0/2419524473 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v19) v1 ==== 190+0+0 (secure 0 0 0) 0x7f0b740799d0 con 0x7f0b840cfcd0 2023-12-20T04:48:45.210 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.0 2023-12-20T04:48:45.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.210+0000 7f0b8ab99640 1 -- 172.21.15.132:0/2419524473 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b7006a430 msgr2=0x7f0b7006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:45.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.210+0000 7f0b8ab99640 1 --2- 172.21.15.132:0/2419524473 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b7006a430 0x7f0b7006c8f0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f0b84160490 tx=0x7f0b78008040 comp rx=0 tx=0).stop 2023-12-20T04:48:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.210+0000 7f0b8ab99640 1 -- 172.21.15.132:0/2419524473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b840cfcd0 msgr2=0x7f0b841503e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.210+0000 7f0b8ab99640 1 --2- 172.21.15.132:0/2419524473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b840cfcd0 0x7f0b841503e0 secure :-1 s=READY pgs=1366 cs=0 l=1 rev1=1 crypto rx=0x7f0b7402bee0 tx=0x7f0b740046c0 comp rx=0 tx=0).stop 2023-12-20T04:48:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.210+0000 7f0b8ab99640 1 -- 172.21.15.132:0/2419524473 shutdown_connections 2023-12-20T04:48:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.210+0000 7f0b8ab99640 1 --2- 172.21.15.132:0/2419524473 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0b7006a430 0x7f0b7006c8f0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.210+0000 7f0b8ab99640 1 --2- 172.21.15.132:0/2419524473 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0b8415d300 0x7f0b8415bac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.210+0000 7f0b8ab99640 1 --2- 172.21.15.132:0/2419524473 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0b840d17d0 0x7f0b840cbc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.210+0000 7f0b8ab99640 1 --2- 172.21.15.132:0/2419524473 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0b840cfcd0 0x7f0b841503e0 unknown :-1 s=CLOSED pgs=1366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.210+0000 7f0b8ab99640 1 -- 172.21.15.132:0/2419524473 >> 172.21.15.132:0/2419524473 conn(0x7f0b8406a3d0 msgr2=0x7f0b840cdb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.210+0000 7f0b8ab99640 1 -- 172.21.15.132:0/2419524473 shutdown_connections 2023-12-20T04:48:45.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.210+0000 7f0b8ab99640 1 -- 172.21.15.132:0/2419524473 wait complete. 2023-12-20T04:48:45.224 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:48:45.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.322+0000 7f84acbc9640 1 Processor -- start 2023-12-20T04:48:45.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.322+0000 7f84acbc9640 1 -- start start 2023-12-20T04:48:45.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.323+0000 7f84acbc9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f84a80cf0b0 0x7f84a80b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:45.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.323+0000 7f84acbc9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f84a80cb420 0x7f84a80d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:45.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.323+0000 7f84acbc9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84a80cd740 con 0x7f84a815e2d0 2023-12-20T04:48:45.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.323+0000 7f84acbc9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a80ce230 con 0x7f84a80cf0b0 2023-12-20T04:48:45.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.323+0000 7f84acbc9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84a80cd990 con 0x7f84a80cb420 2023-12-20T04:48:45.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.323+0000 7f849dd9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f84a80cf0b0 0x7f84a80b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:45.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.323+0000 7f84a659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f84a815e2d0 0x7f84a80ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47804/0 (socket says 172.21.15.132:47804) 2023-12-20T04:48:45.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.323+0000 7f84a659c640 1 -- 172.21.15.132:0/2536280309 learned_addr learned my addr 172.21.15.132:0/2536280309 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:45.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.323+0000 7f84a6d9d640 1 --2- 172.21.15.132:0/2536280309 >> v2:172.21.15.187:3300/0 conn(0x7f84a80cb420 0x7f84a80d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:45.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.323+0000 7f849dd9b640 1 -- 172.21.15.132:0/2536280309 >> v2:172.21.15.187:3300/0 conn(0x7f84a80cb420 msgr2=0x7f84a80d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:45.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.323+0000 7f849dd9b640 1 --2- 172.21.15.132:0/2536280309 >> v2:172.21.15.187:3300/0 conn(0x7f84a80cb420 0x7f84a80d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:45.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.323+0000 7f849dd9b640 1 -- 172.21.15.132:0/2536280309 >> v1:172.21.15.132:6789/0 conn(0x7f84a815e2d0 legacy=0x7f84a80ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:45.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.323+0000 7f849dd9b640 1 -- 172.21.15.132:0/2536280309 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84a80cdc70 con 0x7f84a80cf0b0 2023-12-20T04:48:45.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.323+0000 7f84a5d9b640 1 -- 172.21.15.132:0/2536280309 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2787064911 0 0) 0x7f84a80cd740 con 0x7f84a815e2d0 2023-12-20T04:48:45.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.324+0000 7f849dd9b640 1 --2- 172.21.15.132:0/2536280309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a80cf0b0 0x7f84a80b3330 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f84a80cc7e0 tx=0x7f849002b840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97d0b1482d0dbfba server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:45.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.324+0000 7f84a5d9b640 1 -- 172.21.15.132:0/2536280309 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f849002e070 con 0x7f84a80cf0b0 2023-12-20T04:48:45.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.324+0000 7f84a5d9b640 1 -- 172.21.15.132:0/2536280309 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84900315a0 con 0x7f84a80cf0b0 2023-12-20T04:48:45.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.324+0000 7f84a5d9b640 1 -- 172.21.15.132:0/2536280309 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8490031930 con 0x7f84a80cf0b0 2023-12-20T04:48:45.328 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.324+0000 7f84acbc9640 1 -- 172.21.15.132:0/2536280309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a80cf0b0 msgr2=0x7f84a80b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:45.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.324+0000 7f84acbc9640 1 --2- 172.21.15.132:0/2536280309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a80cf0b0 0x7f84a80b3330 secure :-1 s=READY pgs=1368 cs=0 l=1 rev1=1 crypto rx=0x7f84a80cc7e0 tx=0x7f849002b840 comp rx=0 tx=0).stop 2023-12-20T04:48:45.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.324+0000 7f84acbc9640 1 -- 172.21.15.132:0/2536280309 shutdown_connections 2023-12-20T04:48:45.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.324+0000 7f84acbc9640 1 --2- 172.21.15.132:0/2536280309 >> v2:172.21.15.187:3300/0 conn(0x7f84a80cb420 0x7f84a80d07f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:45.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.324+0000 7f84acbc9640 1 --2- 172.21.15.132:0/2536280309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a80cf0b0 0x7f84a80b3330 unknown :-1 s=CLOSED pgs=1368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:45.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.324+0000 7f84acbc9640 1 -- 172.21.15.132:0/2536280309 >> 172.21.15.132:0/2536280309 conn(0x7f84a806d7c0 msgr2=0x7f84a806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:45.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.324+0000 7f84acbc9640 1 -- 172.21.15.132:0/2536280309 shutdown_connections 2023-12-20T04:48:45.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.324+0000 7f84acbc9640 1 -- 172.21.15.132:0/2536280309 wait complete. 2023-12-20T04:48:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.326+0000 7f84acbc9640 1 Processor -- start 2023-12-20T04:48:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.326+0000 7f84acbc9640 1 -- start start 2023-12-20T04:48:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84acbc9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84a80cb420 0x7f84a81554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84acbc9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84a80cf0b0 0x7f84a81571d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84acbc9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a815e2d0 0x7f84a80c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84acbc9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80c4720 con 0x7f84a815e2d0 2023-12-20T04:48:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84acbc9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80c7600 con 0x7f84a80cb420 2023-12-20T04:48:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84acbc9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84a80c49e0 con 0x7f84a80cf0b0 2023-12-20T04:48:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84a6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a815e2d0 0x7f84a80c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:45.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84a6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a815e2d0 0x7f84a80c6b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52836/0 (socket says 172.21.15.132:52836) 2023-12-20T04:48:45.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84a6d9d640 1 -- 172.21.15.132:0/1031627366 learned_addr learned my addr 172.21.15.132:0/1031627366 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:45.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84a659c640 1 --2- 172.21.15.132:0/1031627366 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84a80cb420 0x7f84a81554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:45.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f849dd9b640 1 --2- 172.21.15.132:0/1031627366 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84a80cf0b0 0x7f84a81571d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:45.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84a6d9d640 1 -- 172.21.15.132:0/1031627366 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84a80cf0b0 msgr2=0x7f84a81571d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:45.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84a6d9d640 1 --2- 172.21.15.132:0/1031627366 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84a80cf0b0 0x7f84a81571d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:45.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84a6d9d640 1 -- 172.21.15.132:0/1031627366 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84a80cb420 msgr2=0x7f84a81554d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:45.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84a6d9d640 1 --2- 172.21.15.132:0/1031627366 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84a80cb420 0x7f84a81554d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:45.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84a6d9d640 1 -- 172.21.15.132:0/1031627366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8490009400 con 0x7f84a815e2d0 2023-12-20T04:48:45.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84a6d9d640 1 --2- 172.21.15.132:0/1031627366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a815e2d0 0x7f84a80c6b20 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f84a000cc30 tx=0x7f84a000a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:45.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f849f7fe640 1 -- 172.21.15.132:0/1031627366 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a000ce40 con 0x7f84a815e2d0 2023-12-20T04:48:45.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f849f7fe640 1 -- 172.21.15.132:0/1031627366 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84a0003990 con 0x7f84a815e2d0 2023-12-20T04:48:45.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84acbc9640 1 -- 172.21.15.132:0/1031627366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84a80c4cc0 con 0x7f84a815e2d0 2023-12-20T04:48:45.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f849f7fe640 1 -- 172.21.15.132:0/1031627366 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84a0003d20 con 0x7f84a815e2d0 2023-12-20T04:48:45.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.327+0000 7f84acbc9640 1 -- 172.21.15.132:0/1031627366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84a81f1660 con 0x7f84a815e2d0 2023-12-20T04:48:45.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.329+0000 7f84acbc9640 1 -- 172.21.15.132:0/1031627366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84a804e840 con 0x7f84a815e2d0 2023-12-20T04:48:45.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.329+0000 7f849f7fe640 1 -- 172.21.15.132:0/1031627366 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f84a0003e80 con 0x7f84a815e2d0 2023-12-20T04:48:45.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.329+0000 7f849f7fe640 1 --2- 172.21.15.132:0/1031627366 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f848806a430 0x7f848806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:45.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.329+0000 7f849f7fe640 1 -- 172.21.15.132:0/1031627366 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f84a0088c70 con 0x7f84a815e2d0 2023-12-20T04:48:45.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.329+0000 7f84a659c640 1 --2- 172.21.15.132:0/1031627366 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f848806a430 0x7f848806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:45.335 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.330+0000 7f84a659c640 1 --2- 172.21.15.132:0/1031627366 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f848806a430 0x7f848806c8f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8498000f60 tx=0x7f8498007d50 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:45.336 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.334+0000 7f849f7fe640 1 -- 172.21.15.132:0/1031627366 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f84a0054310 con 0x7f84a815e2d0 2023-12-20T04:48:45.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.533+0000 7f84acbc9640 1 -- 172.21.15.132:0/1031627366 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f84a80ce480 con 0x7f84a815e2d0 2023-12-20T04:48:45.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.534+0000 7f849f7fe640 1 -- 172.21.15.132:0/1031627366 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f84a001d070 con 0x7f84a815e2d0 2023-12-20T04:48:45.536 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:45.536 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6763,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1413044191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1413044191},{"type":"v1","addr":"172.21.15.132:6837","nonce":1413044191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1584197959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1584197959},{"type":"v1","addr":"172.21.15.187:6834","nonce":1584197959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":7830,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/3080885824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3080885824},{"type":"v1","addr":"172.21.15.132:6836","nonce":3080885824}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:48:37.200402+0000","modified":"2023-12-20T04:48:39.207037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"d","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/1483131498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":1483131498},{"type":"v1","addr":"172.21.15.187:6835","nonce":1483131498}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-20T04:48:45.536 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 51 2023-12-20T04:48:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.535+0000 7f84acbc9640 1 -- 172.21.15.132:0/1031627366 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f848806a430 msgr2=0x7f848806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:45.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.535+0000 7f84acbc9640 1 --2- 172.21.15.132:0/1031627366 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f848806a430 0x7f848806c8f0 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x7f8498000f60 tx=0x7f8498007d50 comp rx=0 tx=0).stop 2023-12-20T04:48:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.535+0000 7f84acbc9640 1 -- 172.21.15.132:0/1031627366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a815e2d0 msgr2=0x7f84a80c6b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.535+0000 7f84acbc9640 1 --2- 172.21.15.132:0/1031627366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a815e2d0 0x7f84a80c6b20 secure :-1 s=READY pgs=1369 cs=0 l=1 rev1=1 crypto rx=0x7f84a000cc30 tx=0x7f84a000a5c0 comp rx=0 tx=0).stop 2023-12-20T04:48:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.535+0000 7f84acbc9640 1 -- 172.21.15.132:0/1031627366 shutdown_connections 2023-12-20T04:48:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.535+0000 7f84acbc9640 1 --2- 172.21.15.132:0/1031627366 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f848806a430 0x7f848806c8f0 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.535+0000 7f84acbc9640 1 --2- 172.21.15.132:0/1031627366 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84a815e2d0 0x7f84a80c6b20 unknown :-1 s=CLOSED pgs=1369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.535+0000 7f84acbc9640 1 --2- 172.21.15.132:0/1031627366 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84a80cf0b0 0x7f84a81571d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.535+0000 7f84acbc9640 1 --2- 172.21.15.132:0/1031627366 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84a80cb420 0x7f84a81554d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.535+0000 7f84acbc9640 1 -- 172.21.15.132:0/1031627366 >> 172.21.15.132:0/1031627366 conn(0x7f84a806d7c0 msgr2=0x7f84a815d570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.536+0000 7f84acbc9640 1 -- 172.21.15.132:0/1031627366 shutdown_connections 2023-12-20T04:48:45.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:45.536+0000 7f84acbc9640 1 -- 172.21.15.132:0/1031627366 wait complete. 2023-12-20T04:48:45.951 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 51, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-20T04:48:37.200402+0000', 'modified': '2023-12-20T04:48:39.207037+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 7845}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_7845': {'gid': 7845, 'name': 'd', 'rank': 0, 'incarnation': 49, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.187:6835/1483131498', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.187:6833', 'nonce': 1483131498}, {'type': 'v1', 'addr': '172.21.15.187:6835', 'nonce': 1483131498}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [17], 'metadata_pool': 16, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-20T04:48:45.951 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-20T04:48:45.951 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2023-12-20T04:48:46.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.052+0000 7f2389399640 1 Processor -- start 2023-12-20T04:48:46.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.052+0000 7f2389399640 1 -- start start 2023-12-20T04:48:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.053+0000 7f2389399640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f238415cdc0 0x7f23840d0c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.053+0000 7f2389399640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238406ad40 0x7f23840d1160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.053+0000 7f2389399640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23840cb9f0 con 0x7f238415d1a0 2023-12-20T04:48:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.053+0000 7f2389399640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23840d1a70 con 0x7f238415cdc0 2023-12-20T04:48:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.053+0000 7f2389399640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23840d1790 con 0x7f238406ad40 2023-12-20T04:48:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.053+0000 7f2382ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f238415cdc0 0x7f23840d0c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.053+0000 7f23837fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f238415d1a0 0x7f23840b2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47820/0 (socket says 172.21.15.132:47820) 2023-12-20T04:48:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.053+0000 7f23837fe640 1 -- 172.21.15.132:0/2183165562 learned_addr learned my addr 172.21.15.132:0/2183165562 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.054+0000 7f23827fc640 1 --2- 172.21.15.132:0/2183165562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238406ad40 0x7f23840d1160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.054+0000 7f2382ffd640 1 -- 172.21.15.132:0/2183165562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238406ad40 msgr2=0x7f23840d1160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.054+0000 7f2382ffd640 1 --2- 172.21.15.132:0/2183165562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238406ad40 0x7f23840d1160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.054+0000 7f2382ffd640 1 -- 172.21.15.132:0/2183165562 >> v1:172.21.15.132:6789/0 conn(0x7f238415d1a0 legacy=0x7f23840b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:46.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.054+0000 7f2381ffb640 1 -- 172.21.15.132:0/2183165562 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 644686195 0 0) 0x7f23840cb9f0 con 0x7f238415d1a0 2023-12-20T04:48:46.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.054+0000 7f2382ffd640 1 -- 172.21.15.132:0/2183165562 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23840cb3a0 con 0x7f238415cdc0 2023-12-20T04:48:46.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.054+0000 7f2382ffd640 1 --2- 172.21.15.132:0/2183165562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f238415cdc0 0x7f23840d0c20 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f2374009d90 tx=0x7f237402bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91fce2019ac27a39 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:46.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.055+0000 7f2381ffb640 1 -- 172.21.15.132:0/2183165562 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237402cc50 con 0x7f238415cdc0 2023-12-20T04:48:46.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.055+0000 7f2381ffb640 1 -- 172.21.15.132:0/2183165562 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f237402cdb0 con 0x7f238415cdc0 2023-12-20T04:48:46.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.055+0000 7f2381ffb640 1 -- 172.21.15.132:0/2183165562 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374034660 con 0x7f238415cdc0 2023-12-20T04:48:46.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.055+0000 7f2389399640 1 -- 172.21.15.132:0/2183165562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f238415cdc0 msgr2=0x7f23840d0c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:46.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.055+0000 7f2389399640 1 --2- 172.21.15.132:0/2183165562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f238415cdc0 0x7f23840d0c20 secure :-1 s=READY pgs=1371 cs=0 l=1 rev1=1 crypto rx=0x7f2374009d90 tx=0x7f237402bea0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.055+0000 7f2389399640 1 -- 172.21.15.132:0/2183165562 shutdown_connections 2023-12-20T04:48:46.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.055+0000 7f2389399640 1 --2- 172.21.15.132:0/2183165562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238406ad40 0x7f23840d1160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.055+0000 7f2389399640 1 --2- 172.21.15.132:0/2183165562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f238415cdc0 0x7f23840d0c20 unknown :-1 s=CLOSED pgs=1371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.055+0000 7f2389399640 1 -- 172.21.15.132:0/2183165562 >> 172.21.15.132:0/2183165562 conn(0x7f2384072c60 msgr2=0x7f2384073070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:46.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.055+0000 7f2389399640 1 -- 172.21.15.132:0/2183165562 shutdown_connections 2023-12-20T04:48:46.058 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.055+0000 7f2389399640 1 -- 172.21.15.132:0/2183165562 wait complete. 2023-12-20T04:48:46.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.057+0000 7f2389399640 1 Processor -- start 2023-12-20T04:48:46.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.057+0000 7f2389399640 1 -- start start 2023-12-20T04:48:46.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.057+0000 7f2389399640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f238406ad40 0x7f2384157460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.057+0000 7f2389399640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f238415cdc0 0x7f238415d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.057+0000 7f2389399640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238415d1a0 0x7f23840b3b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.057+0000 7f2389399640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23840c5c00 con 0x7f238415cdc0 2023-12-20T04:48:46.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.057+0000 7f2389399640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23841579a0 con 0x7f238406ad40 2023-12-20T04:48:46.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.057+0000 7f2389399640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23840b0b30 con 0x7f238415d1a0 2023-12-20T04:48:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.057+0000 7f23827fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f238415cdc0 0x7f238415d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.057+0000 7f23827fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f238415cdc0 0x7f238415d6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52860/0 (socket says 172.21.15.132:52860) 2023-12-20T04:48:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.057+0000 7f23827fc640 1 -- 172.21.15.132:0/1268891261 learned_addr learned my addr 172.21.15.132:0/1268891261 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.058+0000 7f23837fe640 1 --2- 172.21.15.132:0/1268891261 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238415d1a0 0x7f23840b3b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.058+0000 7f2382ffd640 1 --2- 172.21.15.132:0/1268891261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f238406ad40 0x7f2384157460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.058+0000 7f23827fc640 1 -- 172.21.15.132:0/1268891261 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238415d1a0 msgr2=0x7f23840b3b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.058+0000 7f23827fc640 1 --2- 172.21.15.132:0/1268891261 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238415d1a0 0x7f23840b3b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.058+0000 7f23827fc640 1 -- 172.21.15.132:0/1268891261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f238406ad40 msgr2=0x7f2384157460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.058+0000 7f23827fc640 1 --2- 172.21.15.132:0/1268891261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f238406ad40 0x7f2384157460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.058+0000 7f23827fc640 1 -- 172.21.15.132:0/1268891261 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2374009a70 con 0x7f238415cdc0 2023-12-20T04:48:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.058+0000 7f2382ffd640 1 --2- 172.21.15.132:0/1268891261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f238406ad40 0x7f2384157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.058+0000 7f23827fc640 1 --2- 172.21.15.132:0/1268891261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f238415cdc0 0x7f238415d6b0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f237800c7f0 tx=0x7f237800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:46.061 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.058+0000 7f236b7fe640 1 -- 172.21.15.132:0/1268891261 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378004220 con 0x7f238415cdc0 2023-12-20T04:48:46.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.058+0000 7f236b7fe640 1 -- 172.21.15.132:0/1268891261 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2378004380 con 0x7f238415cdc0 2023-12-20T04:48:46.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.058+0000 7f2389399640 1 -- 172.21.15.132:0/1268891261 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23840b0e10 con 0x7f238415cdc0 2023-12-20T04:48:46.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.058+0000 7f236b7fe640 1 -- 172.21.15.132:0/1268891261 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2378007840 con 0x7f238415cdc0 2023-12-20T04:48:46.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.058+0000 7f2389399640 1 -- 172.21.15.132:0/1268891261 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23840c5890 con 0x7f238415cdc0 2023-12-20T04:48:46.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.059+0000 7f236b7fe640 1 -- 172.21.15.132:0/1268891261 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2378007bb0 con 0x7f238415cdc0 2023-12-20T04:48:46.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.060+0000 7f236b7fe640 1 --2- 172.21.15.132:0/1268891261 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f237006a430 0x7f237006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.060+0000 7f236b7fe640 1 -- 172.21.15.132:0/1268891261 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23780888e0 con 0x7f238415cdc0 2023-12-20T04:48:46.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.060+0000 7f2382ffd640 1 --2- 172.21.15.132:0/1268891261 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f237006a430 0x7f237006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.060+0000 7f2382ffd640 1 --2- 172.21.15.132:0/1268891261 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f237006a430 0x7f237006c8f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2374036000 tx=0x7f2374030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:46.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.061+0000 7f238bfe4740 1 Processor -- start 2023-12-20T04:48:46.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.061+0000 7f238bfe4740 1 -- start start 2023-12-20T04:48:46.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f238bfe4740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4ed66520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f238bfe4740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4ed93770 0x55ee4ed96120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f238bfe4740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4ed66a60 0x55ee4ed96660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f238bfe4740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4ecd60b0 con 0x55ee4ed93390 2023-12-20T04:48:46.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f238bfe4740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4ecd3840 con 0x55ee4ed93770 2023-12-20T04:48:46.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f238bfe4740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee4eccf130 con 0x55ee4ed66a60 2023-12-20T04:48:46.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f2382ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4ed66520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f2382ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4ed66520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52872/0 (socket says 172.21.15.132:52872) 2023-12-20T04:48:46.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f2382ffd640 1 -- 172.21.15.132:0/3051778373 learned_addr learned my addr 172.21.15.132:0/3051778373 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:46.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f23827fc640 1 --2- 172.21.15.132:0/3051778373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4ed93770 0x55ee4ed96120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f23837fe640 1 --2- 172.21.15.132:0/3051778373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4ed66a60 0x55ee4ed96660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f2382ffd640 1 -- 172.21.15.132:0/3051778373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4ed66a60 msgr2=0x55ee4ed96660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:46.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f2382ffd640 1 --2- 172.21.15.132:0/3051778373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4ed66a60 0x55ee4ed96660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f2382ffd640 1 -- 172.21.15.132:0/3051778373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4ed93770 msgr2=0x55ee4ed96120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:46.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f2382ffd640 1 --2- 172.21.15.132:0/3051778373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4ed93770 0x55ee4ed96120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f2382ffd640 1 -- 172.21.15.132:0/3051778373 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee4ec89c40 con 0x55ee4ed93390 2023-12-20T04:48:46.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f23837fe640 1 --2- 172.21.15.132:0/3051778373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4ed66a60 0x55ee4ed96660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:46.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f2382ffd640 1 --2- 172.21.15.132:0/3051778373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4ed66520 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f237402bee0 tx=0x7f237402e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e1df8b98af17450 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:46.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f2368ff9640 1 -- 172.21.15.132:0/3051778373 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374034e60 con 0x55ee4ed93390 2023-12-20T04:48:46.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f2368ff9640 1 -- 172.21.15.132:0/3051778373 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2374045040 con 0x55ee4ed93390 2023-12-20T04:48:46.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.062+0000 7f2368ff9640 1 -- 172.21.15.132:0/3051778373 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237403e610 con 0x55ee4ed93390 2023-12-20T04:48:46.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.063+0000 7f238bfe4740 1 -- 172.21.15.132:0/3051778373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 msgr2=0x55ee4ed66520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:46.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.063+0000 7f238bfe4740 1 --2- 172.21.15.132:0/3051778373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4ed66520 secure :-1 s=READY pgs=1373 cs=0 l=1 rev1=1 crypto rx=0x7f237402bee0 tx=0x7f237402e000 comp rx=0 tx=0).stop 2023-12-20T04:48:46.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.063+0000 7f238bfe4740 1 -- 172.21.15.132:0/3051778373 shutdown_connections 2023-12-20T04:48:46.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.063+0000 7f238bfe4740 1 --2- 172.21.15.132:0/3051778373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4ed66a60 0x55ee4ed96660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.063+0000 7f238bfe4740 1 --2- 172.21.15.132:0/3051778373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4ed93770 0x55ee4ed96120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.063+0000 7f238bfe4740 1 --2- 172.21.15.132:0/3051778373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4ed66520 unknown :-1 s=CLOSED pgs=1373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.063+0000 7f238bfe4740 1 -- 172.21.15.132:0/3051778373 >> 172.21.15.132:0/3051778373 conn(0x55ee4ed68830 msgr2=0x55ee4edb1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:46.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.063+0000 7f238bfe4740 1 -- 172.21.15.132:0/3051778373 shutdown_connections 2023-12-20T04:48:46.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.063+0000 7f238bfe4740 1 -- 172.21.15.132:0/3051778373 wait complete. 2023-12-20T04:48:46.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.064+0000 7f238bfe4740 1 -- start start 2023-12-20T04:48:46.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.064+0000 7f238bfe4740 1 Processor -- start 2023-12-20T04:48:46.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.064+0000 7f238bfe4740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4edb4a30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f238bfe4740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4ed93770 0x55ee4ed92670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f238bfe4740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4edc3ce0 0x55ee4edc4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f238bfe4740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4ec8d840 con 0x55ee4ed93390 2023-12-20T04:48:46.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f238bfe4740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4ec8d4e0 con 0x55ee4ed93770 2023-12-20T04:48:46.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f238bfe4740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee4ec53230 con 0x55ee4edc3ce0 2023-12-20T04:48:46.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f238bfe4740 10 client.0 _ll_register_callbacks cb 0x55ee4eca46d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:48:46.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f2382ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4edb4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f2382ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4edb4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52886/0 (socket says 172.21.15.132:52886) 2023-12-20T04:48:46.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f2382ffd640 1 -- 172.21.15.132:0/1570316131 learned_addr learned my addr 172.21.15.132:0/1570316131 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:46.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f23837fe640 1 --2- 172.21.15.132:0/1570316131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4edc3ce0 0x55ee4edc4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f23827fc640 1 --2- 172.21.15.132:0/1570316131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4ed93770 0x55ee4ed92670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f2382ffd640 1 -- 172.21.15.132:0/1570316131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4edc3ce0 msgr2=0x55ee4edc4160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:46.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f2382ffd640 1 --2- 172.21.15.132:0/1570316131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4edc3ce0 0x55ee4edc4160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f2382ffd640 1 -- 172.21.15.132:0/1570316131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4ed93770 msgr2=0x55ee4ed92670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:46.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f2382ffd640 1 --2- 172.21.15.132:0/1570316131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4ed93770 0x55ee4ed92670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f2382ffd640 1 -- 172.21.15.132:0/1570316131 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23840cb3a0 con 0x55ee4ed93390 2023-12-20T04:48:46.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f2382ffd640 1 --2- 172.21.15.132:0/1570316131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4edb4a30 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f237402c4b0 tx=0x7f2374004ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29c1dea046f6e861 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:46.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f2361ffb640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:48:46.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f2361ffb640 1 -- 172.21.15.132:0/1570316131 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374004450 con 0x55ee4ed93390 2023-12-20T04:48:46.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f2361ffb640 1 -- 172.21.15.132:0/1570316131 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23740045b0 con 0x55ee4ed93390 2023-12-20T04:48:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f238bfe4740 1 -- 172.21.15.132:0/1570316131 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55ee4ecf8970 con 0x55ee4ed93390 2023-12-20T04:48:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f2361ffb640 1 -- 172.21.15.132:0/1570316131 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2374004770 con 0x55ee4ed93390 2023-12-20T04:48:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f238bfe4740 10 client.8013 fetch_fsmap learned FSMap version 51 2023-12-20T04:48:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f238bfe4740 1 -- 172.21.15.132:0/1570316131 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55ee4eccd7b0 con 0x55ee4ed93390 2023-12-20T04:48:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.065+0000 7f2361ffb640 1 -- 172.21.15.132:0/1570316131 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55ee4ecf8970 con 0x55ee4ed93390 2023-12-20T04:48:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.066+0000 7f2361ffb640 1 -- 172.21.15.132:0/1570316131 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f2374048070 con 0x55ee4ed93390 2023-12-20T04:48:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.066+0000 7f238bfe4740 10 client.8013 fetch_fsmap finished waiting for FSMap version 51 2023-12-20T04:48:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.066+0000 7f238bfe4740 10 client.8013 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-20T04:48:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.066+0000 7f238bfe4740 20 client.8013 populate_metadata read hostname 'smithi132' 2023-12-20T04:48:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.066+0000 7f238bfe4740 1 --2- 172.21.15.132:0/1570316131 >> [v2:172.21.15.187:6833/1483131498,v1:172.21.15.187:6835/1483131498] conn(0x55ee4edae8c0 0x55ee4ed993e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.066+0000 7f238bfe4740 4 client.8013 mds_command: new command op to 7845 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-20T04:48:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.066+0000 7f238bfe4740 1 -- 172.21.15.132:0/1570316131 --> [v2:172.21.15.187:6833/1483131498,v1:172.21.15.187:6835/1483131498] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55ee4ecc0f00 con 0x55ee4edae8c0 2023-12-20T04:48:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.066+0000 7f23827fc640 1 --2- 172.21.15.132:0/1570316131 >> [v2:172.21.15.187:6833/1483131498,v1:172.21.15.187:6835/1483131498] conn(0x55ee4edae8c0 0x55ee4ed993e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.066+0000 7f23827fc640 1 --2- 172.21.15.132:0/1570316131 >> [v2:172.21.15.187:6833/1483131498,v1:172.21.15.187:6835/1483131498] conn(0x55ee4edae8c0 0x55ee4ed993e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=bbf18e80efc20243 server_cookie=fccf5ea7318f7b in_seq=0 out_seq=0 2023-12-20T04:48:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.066+0000 7f2361ffb640 10 client.8013 ms_handle_connect on v2:172.21.15.187:6833/1483131498 2023-12-20T04:48:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.067+0000 7f2361ffb640 1 -- 172.21.15.132:0/1570316131 <== mds.0 v2:172.21.15.187:6833/1483131498 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55ee4ecc0f00 con 0x55ee4edae8c0 2023-12-20T04:48:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.067+0000 7f2361ffb640 10 client.8013 handle_command_reply: tid=0 2023-12-20T04:48:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.067+0000 7f238bfe4740 1 client.8013 shutdown 2023-12-20T04:48:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.067+0000 7f238bfe4740 1 -- 172.21.15.132:0/1570316131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 msgr2=0x55ee4edb4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.067+0000 7f238bfe4740 1 --2- 172.21.15.132:0/1570316131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4edb4a30 secure :-1 s=READY pgs=1374 cs=0 l=1 rev1=1 crypto rx=0x7f237402c4b0 tx=0x7f2374004ab0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.067+0000 7f238bfe4740 1 -- 172.21.15.132:0/1570316131 shutdown_connections 2023-12-20T04:48:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.067+0000 7f238bfe4740 1 --2- 172.21.15.132:0/1570316131 >> [v2:172.21.15.187:6833/1483131498,v1:172.21.15.187:6835/1483131498] conn(0x55ee4edae8c0 0x55ee4ed993e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.067+0000 7f238bfe4740 1 --2- 172.21.15.132:0/1570316131 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4edc3ce0 0x55ee4edc4160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.067+0000 7f238bfe4740 1 --2- 172.21.15.132:0/1570316131 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4ed93770 0x55ee4ed92670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.067+0000 7f238bfe4740 1 --2- 172.21.15.132:0/1570316131 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4edb4a30 unknown :-1 s=CLOSED pgs=1374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.067+0000 7f2361ffb640 0 client.8013 ms_handle_reset on v2:172.21.15.187:6833/1483131498 2023-12-20T04:48:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.067+0000 7f238bfe4740 1 -- 172.21.15.132:0/1570316131 >> 172.21.15.132:0/1570316131 conn(0x55ee4ed66a60 msgr2=0x55ee4ed6a2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.068+0000 7f238bfe4740 1 -- 172.21.15.132:0/1570316131 shutdown_connections 2023-12-20T04:48:46.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.068+0000 7f238bfe4740 1 -- 172.21.15.132:0/1570316131 wait complete. 2023-12-20T04:48:46.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.068+0000 7f238bfe4740 20 client.8013 trim_cache size 0 max 16384 2023-12-20T04:48:46.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.082+0000 7f238bfe4740 1 Processor -- start 2023-12-20T04:48:46.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.082+0000 7f238bfe4740 1 -- start start 2023-12-20T04:48:46.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.083+0000 7f238bfe4740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4edacae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.083+0000 7f238bfe4740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4ed93770 0x55ee4edad020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.083+0000 7f238bfe4740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4edc3ce0 0x55ee4edc2700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.083+0000 7f238bfe4740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4ed624a0 con 0x55ee4ed93390 2023-12-20T04:48:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.083+0000 7f238bfe4740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4ed61e90 con 0x55ee4edc3ce0 2023-12-20T04:48:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.083+0000 7f238bfe4740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee4edad7b0 con 0x55ee4ed93770 2023-12-20T04:48:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.083+0000 7f2382ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4edacae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.083+0000 7f2382ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4edacae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52900/0 (socket says 172.21.15.132:52900) 2023-12-20T04:48:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.083+0000 7f2382ffd640 1 -- 172.21.15.132:0/1671243025 learned_addr learned my addr 172.21.15.132:0/1671243025 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.083+0000 7f2382ffd640 1 -- 172.21.15.132:0/1671243025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4ed93770 msgr2=0x55ee4edad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.083+0000 7f2382ffd640 1 --2- 172.21.15.132:0/1671243025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4ed93770 0x55ee4edad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.083+0000 7f2382ffd640 1 -- 172.21.15.132:0/1671243025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4edc3ce0 msgr2=0x55ee4edc2700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.083+0000 7f2382ffd640 1 --2- 172.21.15.132:0/1671243025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4edc3ce0 0x55ee4edc2700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.083+0000 7f2382ffd640 1 -- 172.21.15.132:0/1671243025 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55ee4ec6fbe0 con 0x55ee4ed93390 2023-12-20T04:48:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.084+0000 7f2382ffd640 1 --2- 172.21.15.132:0/1671243025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4edacae0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f2374000f80 tx=0x7f2374051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13f5acf07c836525 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.084+0000 7f23697fa640 1 -- 172.21.15.132:0/1671243025 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2374054e10 con 0x55ee4ed93390 2023-12-20T04:48:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.084+0000 7f23697fa640 1 -- 172.21.15.132:0/1671243025 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2374003990 con 0x55ee4ed93390 2023-12-20T04:48:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.084+0000 7f23697fa640 1 -- 172.21.15.132:0/1671243025 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23740547b0 con 0x55ee4ed93390 2023-12-20T04:48:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.084+0000 7f238bfe4740 1 -- 172.21.15.132:0/1671243025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 msgr2=0x55ee4edacae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.084+0000 7f238bfe4740 1 --2- 172.21.15.132:0/1671243025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4edacae0 secure :-1 s=READY pgs=1375 cs=0 l=1 rev1=1 crypto rx=0x7f2374000f80 tx=0x7f2374051000 comp rx=0 tx=0).stop 2023-12-20T04:48:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.084+0000 7f238bfe4740 1 -- 172.21.15.132:0/1671243025 shutdown_connections 2023-12-20T04:48:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.084+0000 7f238bfe4740 1 --2- 172.21.15.132:0/1671243025 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4edc3ce0 0x55ee4edc2700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.084+0000 7f238bfe4740 1 --2- 172.21.15.132:0/1671243025 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4ed93770 0x55ee4edad020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.084+0000 7f238bfe4740 1 --2- 172.21.15.132:0/1671243025 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93390 0x55ee4edacae0 unknown :-1 s=CLOSED pgs=1375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.084+0000 7f238bfe4740 1 -- 172.21.15.132:0/1671243025 >> 172.21.15.132:0/1671243025 conn(0x55ee4ed66a60 msgr2=0x55ee4ed69e90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.084+0000 7f238bfe4740 1 -- 172.21.15.132:0/1671243025 shutdown_connections 2023-12-20T04:48:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.084+0000 7f238bfe4740 1 -- 172.21.15.132:0/1671243025 wait complete. 2023-12-20T04:48:46.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.085+0000 7f238bfe4740 1 -- start start 2023-12-20T04:48:46.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.085+0000 7f238bfe4740 1 Processor -- start 2023-12-20T04:48:46.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.085+0000 7f238bfe4740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4ed93390 0x55ee4ee16990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.085+0000 7f238bfe4740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93770 0x55ee4edc5cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.085+0000 7f238bfe4740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4edc3ce0 0x55ee4edc7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.085+0000 7f238bfe4740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4edb4ea0 con 0x55ee4ed93770 2023-12-20T04:48:46.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.085+0000 7f238bfe4740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55ee4ed99e80 con 0x55ee4ed93390 2023-12-20T04:48:46.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.085+0000 7f238bfe4740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55ee4ed665a0 con 0x55ee4edc3ce0 2023-12-20T04:48:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.085+0000 7f238bfe4740 10 client.0 _ll_register_callbacks cb 0x7f2374037070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:48:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f23827fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93770 0x55ee4edc5cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f23827fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93770 0x55ee4edc5cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52904/0 (socket says 172.21.15.132:52904) 2023-12-20T04:48:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f23827fc640 1 -- 172.21.15.132:0/3182781867 learned_addr learned my addr 172.21.15.132:0/3182781867 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f2382ffd640 1 --2- 172.21.15.132:0/3182781867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4ed93390 0x55ee4ee16990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f23837fe640 1 --2- 172.21.15.132:0/3182781867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4edc3ce0 0x55ee4edc7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f23827fc640 1 -- 172.21.15.132:0/3182781867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4edc3ce0 msgr2=0x55ee4edc7ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f23827fc640 1 --2- 172.21.15.132:0/3182781867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4edc3ce0 0x55ee4edc7ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f23827fc640 1 -- 172.21.15.132:0/3182781867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4ed93390 msgr2=0x55ee4ee16990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f23827fc640 1 --2- 172.21.15.132:0/3182781867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4ed93390 0x55ee4ee16990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f23827fc640 1 -- 172.21.15.132:0/3182781867 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55ee4eccd7b0 con 0x55ee4ed93770 2023-12-20T04:48:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f23837fe640 1 --2- 172.21.15.132:0/3182781867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4edc3ce0 0x55ee4edc7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:46.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f23827fc640 1 --2- 172.21.15.132:0/3182781867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93770 0x55ee4edc5cd0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f2378057b20 tx=0x7f2378057c50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223dad8c75a374e3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f2361ffb640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:48:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f2361ffb640 1 -- 172.21.15.132:0/3182781867 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f237805fb70 con 0x55ee4ed93770 2023-12-20T04:48:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f2361ffb640 1 -- 172.21.15.132:0/3182781867 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23780542a0 con 0x55ee4ed93770 2023-12-20T04:48:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f238bfe4740 1 -- 172.21.15.132:0/3182781867 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f2374045040 con 0x55ee4ed93770 2023-12-20T04:48:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f2361ffb640 1 -- 172.21.15.132:0/3182781867 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=51) v2 ==== 24+0+0 (secure 0 0 0) 0x7f2378054460 con 0x55ee4ed93770 2023-12-20T04:48:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f238bfe4740 10 client.8019 fetch_fsmap learned FSMap version 51 2023-12-20T04:48:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f238bfe4740 1 -- 172.21.15.132:0/3182781867 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=51,monmap=2+}) v3 -- 0x55ee4ec952f0 con 0x55ee4ed93770 2023-12-20T04:48:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f2361ffb640 1 -- 172.21.15.132:0/3182781867 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2374045040 con 0x55ee4ed93770 2023-12-20T04:48:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.086+0000 7f2361ffb640 1 -- 172.21.15.132:0/3182781867 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 51) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f237805f6e0 con 0x55ee4ed93770 2023-12-20T04:48:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f238bfe4740 10 client.8019 fetch_fsmap finished waiting for FSMap version 51 2023-12-20T04:48:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f238bfe4740 10 client.8019 resolve_mds: resolved name 'd' to daemon mds.d 2023-12-20T04:48:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f238bfe4740 20 client.8019 populate_metadata read hostname 'smithi132' 2023-12-20T04:48:46.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f238bfe4740 1 --2- 172.21.15.132:0/3182781867 >> [v2:172.21.15.187:6833/1483131498,v1:172.21.15.187:6835/1483131498] conn(0x55ee4ed69e50 0x55ee4ed6a230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f238bfe4740 4 client.8019 mds_command: new command op to 7845 tid=0[{"prefix": "status"}] 2023-12-20T04:48:46.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f238bfe4740 1 -- 172.21.15.132:0/3182781867 --> [v2:172.21.15.187:6833/1483131498,v1:172.21.15.187:6835/1483131498] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55ee4ecc81b0 con 0x55ee4ed69e50 2023-12-20T04:48:46.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f2382ffd640 1 --2- 172.21.15.132:0/3182781867 >> [v2:172.21.15.187:6833/1483131498,v1:172.21.15.187:6835/1483131498] conn(0x55ee4ed69e50 0x55ee4ed6a230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f2361ffb640 10 client.8019 ms_handle_connect on v2:172.21.15.187:6833/1483131498 2023-12-20T04:48:46.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f2382ffd640 1 --2- 172.21.15.132:0/3182781867 >> [v2:172.21.15.187:6833/1483131498,v1:172.21.15.187:6835/1483131498] conn(0x55ee4ed69e50 0x55ee4ed6a230 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fb3925b6dcd55fba server_cookie=e653e79303c4e7e3 in_seq=0 out_seq=0 2023-12-20T04:48:46.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f2361ffb640 1 -- 172.21.15.132:0/3182781867 <== mds.0 v2:172.21.15.187:6833/1483131498 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55ee4ecc81b0 con 0x55ee4ed69e50 2023-12-20T04:48:46.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f2361ffb640 10 client.8019 handle_command_reply: tid=0 2023-12-20T04:48:46.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f238bfe4740 1 client.8019 shutdown 2023-12-20T04:48:46.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f238bfe4740 1 -- 172.21.15.132:0/3182781867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93770 msgr2=0x55ee4edc5cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:46.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f238bfe4740 1 --2- 172.21.15.132:0/3182781867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93770 0x55ee4edc5cd0 secure :-1 s=READY pgs=1376 cs=0 l=1 rev1=1 crypto rx=0x7f2378057b20 tx=0x7f2378057c50 comp rx=0 tx=0).stop 2023-12-20T04:48:46.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f238bfe4740 1 -- 172.21.15.132:0/3182781867 shutdown_connections 2023-12-20T04:48:46.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f238bfe4740 1 --2- 172.21.15.132:0/3182781867 >> [v2:172.21.15.187:6833/1483131498,v1:172.21.15.187:6835/1483131498] conn(0x55ee4ed69e50 0x55ee4ed6a230 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f238bfe4740 1 --2- 172.21.15.132:0/3182781867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55ee4edc3ce0 0x55ee4edc7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f238bfe4740 1 --2- 172.21.15.132:0/3182781867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55ee4ed93770 0x55ee4edc5cd0 unknown :-1 s=CLOSED pgs=1376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f2361ffb640 0 client.8019 ms_handle_reset on v2:172.21.15.187:6833/1483131498 2023-12-20T04:48:46.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.087+0000 7f238bfe4740 1 --2- 172.21.15.132:0/3182781867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55ee4ed93390 0x55ee4ee16990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.088+0000 7f238bfe4740 1 -- 172.21.15.132:0/3182781867 >> 172.21.15.132:0/3182781867 conn(0x55ee4ed66a60 msgr2=0x55ee4edb1000 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:46.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.088+0000 7f238bfe4740 1 -- 172.21.15.132:0/3182781867 shutdown_connections 2023-12-20T04:48:46.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.088+0000 7f238bfe4740 1 -- 172.21.15.132:0/3182781867 wait complete. 2023-12-20T04:48:46.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.088+0000 7f238bfe4740 20 client.8019 trim_cache size 0 max 16384 2023-12-20T04:48:46.098 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:48:46.098 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:48:46.098 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-12-20T04:48:46.098 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 7845, 2023-12-20T04:48:46.098 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-12-20T04:48:46.099 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-12-20T04:48:46.099 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-12-20T04:48:46.099 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 8.8853490930000003, 2023-12-20T04:48:46.099 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 51, 2023-12-20T04:48:46.099 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 137, 2023-12-20T04:48:46.099 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 137, 2023-12-20T04:48:46.099 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 13.673220367000001 2023-12-20T04:48:46.099 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:48:46.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.088+0000 7f2389399640 1 -- 172.21.15.132:0/1268891261 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f237006a430 msgr2=0x7f237006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:46.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.088+0000 7f2389399640 1 --2- 172.21.15.132:0/1268891261 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f237006a430 0x7f237006c8f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f2374036000 tx=0x7f2374030000 comp rx=0 tx=0).stop 2023-12-20T04:48:46.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.088+0000 7f2389399640 1 -- 172.21.15.132:0/1268891261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f238415cdc0 msgr2=0x7f238415d6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:46.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.088+0000 7f2389399640 1 --2- 172.21.15.132:0/1268891261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f238415cdc0 0x7f238415d6b0 secure :-1 s=READY pgs=1372 cs=0 l=1 rev1=1 crypto rx=0x7f237800c7f0 tx=0x7f237800ccb0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.088+0000 7f2389399640 1 -- 172.21.15.132:0/1268891261 shutdown_connections 2023-12-20T04:48:46.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.088+0000 7f2389399640 1 --2- 172.21.15.132:0/1268891261 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f237006a430 0x7f237006c8f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.088+0000 7f2389399640 1 --2- 172.21.15.132:0/1268891261 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f238415d1a0 0x7f23840b3b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.088+0000 7f2389399640 1 --2- 172.21.15.132:0/1268891261 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f238415cdc0 0x7f238415d6b0 unknown :-1 s=CLOSED pgs=1372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.088+0000 7f2389399640 1 --2- 172.21.15.132:0/1268891261 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f238406ad40 0x7f2384157460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.088+0000 7f2389399640 1 -- 172.21.15.132:0/1268891261 >> 172.21.15.132:0/1268891261 conn(0x7f2384072c60 msgr2=0x7f23840ccef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:46.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.088+0000 7f2389399640 1 -- 172.21.15.132:0/1268891261 shutdown_connections 2023-12-20T04:48:46.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.088+0000 7f2389399640 1 -- 172.21.15.132:0/1268891261 wait complete. 2023-12-20T04:48:46.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:48:46.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.201+0000 7fc7c8b00640 1 Processor -- start 2023-12-20T04:48:46.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.201+0000 7fc7c8b00640 1 -- start start 2023-12-20T04:48:46.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c8b00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7c40d0370 0x7fc7c40b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c8b00640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c40b2f90 con 0x7fc7c40cdc10 2023-12-20T04:48:46.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c8b00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc7c41613c0 con 0x7fc7c415d100 2023-12-20T04:48:46.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c8b00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40d1b00 con 0x7fc7c40d0370 2023-12-20T04:48:46.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c2d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc7c40cdc10 0x7fc7c406c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47836/0 (socket says 172.21.15.132:47836) 2023-12-20T04:48:46.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c2d9d640 1 -- 172.21.15.132:0/923195723 learned_addr learned my addr 172.21.15.132:0/923195723 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:46.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c1d9b640 1 --2- 172.21.15.132:0/923195723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7c40d0370 0x7fc7c40b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c159a640 1 -- 172.21.15.132:0/923195723 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2425476128 0 0) 0x7fc7bc001490 con 0x7fc7c40cdc10 2023-12-20T04:48:46.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c159a640 1 -- 172.21.15.132:0/923195723 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc7ac003520 con 0x7fc7c40cdc10 2023-12-20T04:48:46.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c159a640 1 -- 172.21.15.132:0/923195723 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1066844877 0 0) 0x7fc7ac003520 con 0x7fc7c40cdc10 2023-12-20T04:48:46.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c159a640 1 -- 172.21.15.132:0/923195723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7c40d0370 msgr2=0x7fc7c40b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:46.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c159a640 1 --2- 172.21.15.132:0/923195723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7c40d0370 0x7fc7c40b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c159a640 1 -- 172.21.15.132:0/923195723 >> v1:172.21.15.187:6789/0 conn(0x7fc7c415d100 legacy=0x7fc7c40cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:46.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c159a640 1 -- 172.21.15.132:0/923195723 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c40d0810 con 0x7fc7c40cdc10 2023-12-20T04:48:46.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c159a640 1 -- 172.21.15.132:0/923195723 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fc7bc001b80 con 0x7fc7c40cdc10 2023-12-20T04:48:46.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c1d9b640 1 --2- 172.21.15.132:0/923195723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7c40d0370 0x7fc7c40b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:48:46.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c159a640 1 -- 172.21.15.132:0/923195723 >> v1:172.21.15.132:6789/0 conn(0x7fc7c40cdc10 legacy=0x7fc7c406c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:46.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c159a640 1 --2- 172.21.15.132:0/923195723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7ac0039a0 0x7fc7ac003d80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c159a640 1 --2- 172.21.15.132:0/923195723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7c40d0370 0x7fc7ac0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c159a640 1 --2- 172.21.15.132:0/923195723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7ac004d00 0x7fc7ac005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c159a640 1 -- 172.21.15.132:0/923195723 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40d1b00 con 0x7fc7ac0039a0 2023-12-20T04:48:46.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c159a640 1 -- 172.21.15.132:0/923195723 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac00ba30 con 0x7fc7ac004d00 2023-12-20T04:48:46.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c159a640 1 -- 172.21.15.132:0/923195723 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7ac00bbf0 con 0x7fc7c40d0370 2023-12-20T04:48:46.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.202+0000 7fc7c259c640 1 --2- 172.21.15.132:0/923195723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7ac0039a0 0x7fc7ac003d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.203+0000 7fc7c1d9b640 1 --2- 172.21.15.132:0/923195723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7c40d0370 0x7fc7ac0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.203+0000 7fc7c2d9d640 1 --2- 172.21.15.132:0/923195723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7ac004d00 0x7fc7ac005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.203+0000 7fc7c259c640 1 -- 172.21.15.132:0/923195723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7c40d0370 msgr2=0x7fc7ac0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:46.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.203+0000 7fc7c259c640 1 --2- 172.21.15.132:0/923195723 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7c40d0370 0x7fc7ac0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.203+0000 7fc7c259c640 1 -- 172.21.15.132:0/923195723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7ac004d00 msgr2=0x7fc7ac005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:46.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.203+0000 7fc7c259c640 1 --2- 172.21.15.132:0/923195723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7ac004d00 0x7fc7ac005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.203+0000 7fc7c259c640 1 -- 172.21.15.132:0/923195723 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7b8009400 con 0x7fc7ac0039a0 2023-12-20T04:48:46.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.203+0000 7fc7c2d9d640 1 --2- 172.21.15.132:0/923195723 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7ac004d00 0x7fc7ac005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:48:46.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.203+0000 7fc7c259c640 1 --2- 172.21.15.132:0/923195723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7ac0039a0 0x7fc7ac003d80 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4001860 tx=0x7fc7ac0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae990d21c9f8f21d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:46.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.204+0000 7fc7c159a640 1 -- 172.21.15.132:0/923195723 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4033630 con 0x7fc7ac0039a0 2023-12-20T04:48:46.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.204+0000 7fc7c159a640 1 -- 172.21.15.132:0/923195723 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b40337b0 con 0x7fc7ac0039a0 2023-12-20T04:48:46.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.204+0000 7fc7c159a640 1 -- 172.21.15.132:0/923195723 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b4033b60 con 0x7fc7ac0039a0 2023-12-20T04:48:46.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.204+0000 7fc7c8b00640 1 -- 172.21.15.132:0/923195723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7ac0039a0 msgr2=0x7fc7ac003d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:46.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.204+0000 7fc7c8b00640 1 --2- 172.21.15.132:0/923195723 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7ac0039a0 0x7fc7ac003d80 secure :-1 s=READY pgs=1378 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4001860 tx=0x7fc7ac0057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.204+0000 7fc7c2d9d640 1 -- 172.21.15.132:0/923195723 reap_dead start 2023-12-20T04:48:46.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.204+0000 7fc7c8b00640 1 -- 172.21.15.132:0/923195723 shutdown_connections 2023-12-20T04:48:46.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.204+0000 7fc7c8b00640 1 -- 172.21.15.132:0/923195723 >> 172.21.15.132:0/923195723 conn(0x7fc7c406d7c0 msgr2=0x7fc7c406dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:46.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.204+0000 7fc7c8b00640 1 -- 172.21.15.132:0/923195723 shutdown_connections 2023-12-20T04:48:46.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.204+0000 7fc7c8b00640 1 -- 172.21.15.132:0/923195723 wait complete. 2023-12-20T04:48:46.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.205+0000 7fc7c8b00640 1 Processor -- start 2023-12-20T04:48:46.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.205+0000 7fc7c8b00640 1 -- start start 2023-12-20T04:48:46.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.206+0000 7fc7c8b00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7ac0039a0 0x7fc7c415f6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.206+0000 7fc7c8b00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c40ca550 0x7fc7c40b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.206+0000 7fc7c8b00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7c41f68e0 0x7fc7c41f5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.206+0000 7fc7c8b00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40b39f0 con 0x7fc7c40ca550 2023-12-20T04:48:46.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.206+0000 7fc7c8b00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40b4200 con 0x7fc7ac0039a0 2023-12-20T04:48:46.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.206+0000 7fc7c8b00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc7c40ca0c0 con 0x7fc7c41f68e0 2023-12-20T04:48:46.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.206+0000 7fc7c1d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c40ca550 0x7fc7c40b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.206+0000 7fc7c1d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c40ca550 0x7fc7c40b4400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52912/0 (socket says 172.21.15.132:52912) 2023-12-20T04:48:46.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.206+0000 7fc7c1d9b640 1 -- 172.21.15.132:0/4087998115 learned_addr learned my addr 172.21.15.132:0/4087998115 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:46.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.206+0000 7fc7c2d9d640 1 --2- 172.21.15.132:0/4087998115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7c41f68e0 0x7fc7c41f5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.206+0000 7fc7c259c640 1 --2- 172.21.15.132:0/4087998115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7ac0039a0 0x7fc7c415f6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.206+0000 7fc7c1d9b640 1 -- 172.21.15.132:0/4087998115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7c41f68e0 msgr2=0x7fc7c41f5d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:46.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.206+0000 7fc7c1d9b640 1 --2- 172.21.15.132:0/4087998115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7c41f68e0 0x7fc7c41f5d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.206+0000 7fc7c1d9b640 1 -- 172.21.15.132:0/4087998115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7ac0039a0 msgr2=0x7fc7c415f6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:46.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.206+0000 7fc7c1d9b640 1 --2- 172.21.15.132:0/4087998115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7ac0039a0 0x7fc7c415f6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.206+0000 7fc7c1d9b640 1 -- 172.21.15.132:0/4087998115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc7c415fc00 con 0x7fc7c40ca550 2023-12-20T04:48:46.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.206+0000 7fc7c2d9d640 1 --2- 172.21.15.132:0/4087998115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7c41f68e0 0x7fc7c41f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:46.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.207+0000 7fc7c259c640 1 --2- 172.21.15.132:0/4087998115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7ac0039a0 0x7fc7c415f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:46.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.207+0000 7fc7c1d9b640 1 --2- 172.21.15.132:0/4087998115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c40ca550 0x7fc7c40b4400 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8011d00 tx=0x7fc7b800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:46.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.207+0000 7fc7b2ffd640 1 -- 172.21.15.132:0/4087998115 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b800fcc0 con 0x7fc7c40ca550 2023-12-20T04:48:46.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.207+0000 7fc7b2ffd640 1 -- 172.21.15.132:0/4087998115 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc7b800fe20 con 0x7fc7c40ca550 2023-12-20T04:48:46.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.207+0000 7fc7c8b00640 1 -- 172.21.15.132:0/4087998115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc7c40b3c40 con 0x7fc7c40ca550 2023-12-20T04:48:46.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.207+0000 7fc7b2ffd640 1 -- 172.21.15.132:0/4087998115 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc7b8004240 con 0x7fc7c40ca550 2023-12-20T04:48:46.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.207+0000 7fc7c8b00640 1 -- 172.21.15.132:0/4087998115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc7c40b4940 con 0x7fc7c40ca550 2023-12-20T04:48:46.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.208+0000 7fc7c8b00640 1 -- 172.21.15.132:0/4087998115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc7c4160d50 con 0x7fc7c40ca550 2023-12-20T04:48:46.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.208+0000 7fc7b2ffd640 1 -- 172.21.15.132:0/4087998115 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc7b80043a0 con 0x7fc7c40ca550 2023-12-20T04:48:46.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.209+0000 7fc7b2ffd640 1 --2- 172.21.15.132:0/4087998115 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc7a406a430 0x7fc7a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:46.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.209+0000 7fc7b2ffd640 1 -- 172.21.15.132:0/4087998115 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc7b8088ea0 con 0x7fc7c40ca550 2023-12-20T04:48:46.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.209+0000 7fc7c259c640 1 --2- 172.21.15.132:0/4087998115 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc7a406a430 0x7fc7a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:46.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.209+0000 7fc7c259c640 1 --2- 172.21.15.132:0/4087998115 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc7a406a430 0x7fc7a406c8f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4036000 tx=0x7fc7b4031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:46.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.213+0000 7fc7b2ffd640 1 -- 172.21.15.132:0/4087998115 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc7c4160d50 con 0x7fc7c40ca550 2023-12-20T04:48:46.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.415+0000 7fc7c8b00640 1 -- 172.21.15.132:0/4087998115 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc7c4160d50 con 0x7fc7c40ca550 2023-12-20T04:48:46.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.416+0000 7fc7b2ffd640 1 -- 172.21.15.132:0/4087998115 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc7c4160d50 con 0x7fc7c40ca550 2023-12-20T04:48:46.417 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:48:46.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.418+0000 7fc7c8b00640 1 -- 172.21.15.132:0/4087998115 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc7a406a430 msgr2=0x7fc7a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:46.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.418+0000 7fc7c8b00640 1 --2- 172.21.15.132:0/4087998115 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc7a406a430 0x7fc7a406c8f0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7fc7b4036000 tx=0x7fc7b4031000 comp rx=0 tx=0).stop 2023-12-20T04:48:46.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.418+0000 7fc7c8b00640 1 -- 172.21.15.132:0/4087998115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c40ca550 msgr2=0x7fc7c40b4400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:46.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.418+0000 7fc7c8b00640 1 --2- 172.21.15.132:0/4087998115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c40ca550 0x7fc7c40b4400 secure :-1 s=READY pgs=1379 cs=0 l=1 rev1=1 crypto rx=0x7fc7b8011d00 tx=0x7fc7b800f610 comp rx=0 tx=0).stop 2023-12-20T04:48:46.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.418+0000 7fc7c8b00640 1 -- 172.21.15.132:0/4087998115 shutdown_connections 2023-12-20T04:48:46.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.418+0000 7fc7c8b00640 1 --2- 172.21.15.132:0/4087998115 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc7a406a430 0x7fc7a406c8f0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.418+0000 7fc7c8b00640 1 --2- 172.21.15.132:0/4087998115 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc7c41f68e0 0x7fc7c41f5d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.418+0000 7fc7c8b00640 1 --2- 172.21.15.132:0/4087998115 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc7c40ca550 0x7fc7c40b4400 unknown :-1 s=CLOSED pgs=1379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.418+0000 7fc7c8b00640 1 --2- 172.21.15.132:0/4087998115 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc7ac0039a0 0x7fc7c415f6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:46.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.418+0000 7fc7c8b00640 1 -- 172.21.15.132:0/4087998115 >> 172.21.15.132:0/4087998115 conn(0x7fc7c406d7c0 msgr2=0x7fc7c406dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:46.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.418+0000 7fc7c8b00640 1 -- 172.21.15.132:0/4087998115 shutdown_connections 2023-12-20T04:48:46.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:46.418+0000 7fc7c8b00640 1 -- 172.21.15.132:0/4087998115 wait complete. 2023-12-20T04:48:46.429 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:48:46.430 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:48:46.430 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-12-20T04:48:46.430 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-20T04:48:46.430 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-20T04:48:46.430 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:48:46.430 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:48:46.430 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:48:46.430 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:48:46.430 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:46.430 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-12-20T04:48:46.445 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:48:46.446 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:48:46.446 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:48:46.446 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:46.446 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-20T04:48:46.446 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:46.446 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:48:46.446 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:46.446 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-12-20T04:48:46.446 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:48:46.446 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:46.446 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-12-20T04:48:46.446 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:48:46.446 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:46.447 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:48:46.447 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:46.447 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:48:46.447 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42348sec preferred_lft 42348sec 2023-12-20T04:48:46.447 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-12-20T04:48:46.447 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:46.447 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:48:46.447 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:46.447 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:48:46.447 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:46.447 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::60dd:37ff:fe28:558b/64 scope link 2023-12-20T04:48:46.447 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:46.447 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:48:46.447 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 86:13:fe:55:4c:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-20T04:48:46.447 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::8413:feff:fe55:4c04/64 scope link 2023-12-20T04:48:46.447 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:46.448 INFO:teuthology.orchestra.run.smithi132.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:48:46.448 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-20T04:48:46.448 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::839:72ff:fea7:b332/64 scope link 2023-12-20T04:48:46.448 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:46.448 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:46.448 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:48:46.511 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-20T04:48:46.512 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:46.512 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-12-20T04:48:46.567 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-12-20T04:48:46.568 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:48:46.568 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:48:46.568 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:48:46.568 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:48:46.568 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:46.568 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:48:46.568 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:48:46.568 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:48:46.568 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:48:46.569 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:48:46.569 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:48:46.662 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:46.662 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-20T04:48:46.676 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-20T04:48:46.677 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-20T04:48:46.677 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:48:46.677 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:46.677 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-12-20T04:48:46.744 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-20T04:48:46.744 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:48:46.744 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-20T04:48:46.798 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:48:46.799 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:48:46.799 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:48:46.853 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:48:46.921 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:48:46.921 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:48:46.987 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:48:46.988 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:48:46.989 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:46.989 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:48:47.043 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:48:47.043 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-20T04:48:47.086 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:48:47.112 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:48:47.112 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:48:47.172 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:2023-12-20T04:48:47.172+0000 7f02fda45480 -1 init, newargv = 0x55d4169d53e0 newargc=15 2023-12-20T04:48:47.173 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[114193]: starting ceph client 2023-12-20T04:48:47.176 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[114193]: starting fuse 2023-12-20T04:48:47.182 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:48:47.183 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:48:47.183 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:47.183 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:48:47.238 INFO:teuthology.orchestra.run.smithi132.stdout:41 2023-12-20T04:48:47.238 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:48:47.238 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:48:47.239 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:48:47.239 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:48:47.239 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:48:47.239 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:48:47.239 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:47.239 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:48:47.239 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:48:47.239 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:48:47.239 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:48:47.239 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:47.239 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:48:47.239 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:48:47.239 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:48:47.239 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:48:47.240 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:47.240 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:48:47.240 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:48:47.240 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:48:47.240 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:48:47.240 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:48:47.240 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:48:47.240 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:48:47.240 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:48:47.240 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:48:47.240 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:48:47.240 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:48:47.354 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.114193.asok 2023-12-20T04:48:47.541 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.114193.asok 2023-12-20T04:48:47.541 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:47.541 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.114193.asok status 2023-12-20T04:48:47.676 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:48:47.676 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:48:47.677 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:48:47.677 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:48:47.677 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:48:47.677 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:48:47.677 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:48:47.677 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "114193", 2023-12-20T04:48:47.677 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:48:47.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:47.677 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2023-12-20T04:48:47.677 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:48:47.678 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 8034, 2023-12-20T04:48:47.678 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:48:47.678 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:48:47.678 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:48:47.678 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 8034 2023-12-20T04:48:47.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:47.678 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:48:47.678 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:47.678 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:48:47.678 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 1564784880 2023-12-20T04:48:47.678 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:47.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:47.678 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:48:47.679 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:47.679 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:48:47.679 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 1564784880 2023-12-20T04:48:47.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:47.679 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.8034 192.168.0.1:0/1564784880", 2023-12-20T04:48:47.679 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/1564784880", 2023-12-20T04:48:47.679 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2023-12-20T04:48:47.679 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 51, 2023-12-20T04:48:47.679 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 137, 2023-12-20T04:48:47.679 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:48:47.679 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:48:47.679 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:48:47.679 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:48:47.685 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:47.685 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2023-12-20T04:48:47.685 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-20T04:48:47.700 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2023-12-20T04:48:47.700 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-20T04:48:47.700 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:47.700 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:48:47.768 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:48:47.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.908+0000 7f72c5173640 1 Processor -- start 2023-12-20T04:48:47.909 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.908+0000 7f72c5173640 1 -- start start 2023-12-20T04:48:47.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.909+0000 7f72c5173640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72c015ad70 0x7f72c006f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:47.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.909+0000 7f72c5173640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f72c006b130 0x7f72c006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:47.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.909+0000 7f72c5173640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72c00c9ab0 con 0x7f72c00c92d0 2023-12-20T04:48:47.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.909+0000 7f72c5173640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72c015ea40 con 0x7f72c006b130 2023-12-20T04:48:47.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.909+0000 7f72c5173640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00c9d90 con 0x7f72c015ad70 2023-12-20T04:48:47.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.909+0000 7f72bed9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72c015ad70 0x7f72c006f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:47.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.909+0000 7f72bf59e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f72c006b130 0x7f72c006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:47.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.909+0000 7f72bed9d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72c015ad70 0x7f72c006f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:39248/0 (socket says 172.21.15.132:39248) 2023-12-20T04:48:47.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.909+0000 7f72be59c640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f72c00c92d0 0x7f72c015f170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:47710/0 (socket says 172.21.15.132:47710) 2023-12-20T04:48:47.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.909+0000 7f72bed9d640 1 -- 172.21.15.132:0/2426892023 learned_addr learned my addr 172.21.15.132:0/2426892023 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:47.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.909+0000 7f72bf59e640 1 -- 172.21.15.132:0/2426892023 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72c015ad70 msgr2=0x7f72c006f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:47.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.909+0000 7f72bf59e640 1 --2- 172.21.15.132:0/2426892023 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72c015ad70 0x7f72c006f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:47.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.909+0000 7f72bf59e640 1 -- 172.21.15.132:0/2426892023 >> v1:172.21.15.187:6789/0 conn(0x7f72c00c92d0 legacy=0x7f72c015f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:47.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.909+0000 7f72bf59e640 1 -- 172.21.15.132:0/2426892023 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72c00ca070 con 0x7f72c006b130 2023-12-20T04:48:47.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.909+0000 7f72bed9d640 1 --2- 172.21.15.132:0/2426892023 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72c015ad70 0x7f72c006f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:48:47.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.910+0000 7f72bf59e640 1 --2- 172.21.15.132:0/2426892023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c006b130 0x7f72c006b5c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009d90 tx=0x7f72b802bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=7cdd2822c3794b71 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:47.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.911+0000 7f72bdd9b640 1 -- 172.21.15.132:0/2426892023 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b802cc50 con 0x7f72c006b130 2023-12-20T04:48:47.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.911+0000 7f72bdd9b640 1 -- 172.21.15.132:0/2426892023 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b802cdb0 con 0x7f72c006b130 2023-12-20T04:48:47.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.911+0000 7f72bdd9b640 1 -- 172.21.15.132:0/2426892023 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b8034660 con 0x7f72c006b130 2023-12-20T04:48:47.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.911+0000 7f72c5173640 1 -- 172.21.15.132:0/2426892023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c006b130 msgr2=0x7f72c006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:47.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.911+0000 7f72c5173640 1 --2- 172.21.15.132:0/2426892023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c006b130 0x7f72c006b5c0 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 crypto rx=0x7f72b8009d90 tx=0x7f72b802bea0 comp rx=0 tx=0).stop 2023-12-20T04:48:47.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.911+0000 7f72c5173640 1 -- 172.21.15.132:0/2426892023 shutdown_connections 2023-12-20T04:48:47.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.911+0000 7f72c5173640 1 --2- 172.21.15.132:0/2426892023 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c006b130 0x7f72c006b5c0 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:47.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.911+0000 7f72c5173640 1 --2- 172.21.15.132:0/2426892023 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72c015ad70 0x7f72c006f560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:47.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.911+0000 7f72c5173640 1 -- 172.21.15.132:0/2426892023 >> 172.21.15.132:0/2426892023 conn(0x7f72c00ced10 msgr2=0x7f72c00cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:47.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.911+0000 7f72c5173640 1 -- 172.21.15.132:0/2426892023 shutdown_connections 2023-12-20T04:48:47.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.911+0000 7f72c5173640 1 -- 172.21.15.132:0/2426892023 wait complete. 2023-12-20T04:48:47.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.913+0000 7f72c5173640 1 Processor -- start 2023-12-20T04:48:47.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.913+0000 7f72c5173640 1 -- start start 2023-12-20T04:48:47.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.913+0000 7f72c5173640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72c006b130 0x7f72c00c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:47.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.913+0000 7f72c5173640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c00c92d0 0x7f72c014cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:47.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.913+0000 7f72c5173640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72c015ad70 0x7f72c0155910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:47.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.913+0000 7f72c5173640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00c5490 con 0x7f72c006b130 2023-12-20T04:48:47.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.913+0000 7f72c5173640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72c0155e50 con 0x7f72c00c92d0 2023-12-20T04:48:47.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.913+0000 7f72c5173640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72c00c63c0 con 0x7f72c015ad70 2023-12-20T04:48:47.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.913+0000 7f72bed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72c006b130 0x7f72c00c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:47.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.914+0000 7f72bed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72c006b130 0x7f72c00c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43608/0 (socket says 172.21.15.132:43608) 2023-12-20T04:48:47.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.914+0000 7f72bed9d640 1 -- 172.21.15.132:0/843953517 learned_addr learned my addr 172.21.15.132:0/843953517 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:47.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.914+0000 7f72bf59e640 1 --2- 172.21.15.132:0/843953517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72c015ad70 0x7f72c0155910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:47.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.914+0000 7f72be59c640 1 --2- 172.21.15.132:0/843953517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c00c92d0 0x7f72c014cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:47.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.914+0000 7f72bed9d640 1 -- 172.21.15.132:0/843953517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72c015ad70 msgr2=0x7f72c0155910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:47.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.914+0000 7f72bed9d640 1 --2- 172.21.15.132:0/843953517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72c015ad70 0x7f72c0155910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:47.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.914+0000 7f72bed9d640 1 -- 172.21.15.132:0/843953517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c00c92d0 msgr2=0x7f72c014cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:47.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.914+0000 7f72bed9d640 1 --2- 172.21.15.132:0/843953517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c00c92d0 0x7f72c014cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:47.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.914+0000 7f72bed9d640 1 -- 172.21.15.132:0/843953517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72b00094d0 con 0x7f72c006b130 2023-12-20T04:48:47.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.914+0000 7f72bed9d640 1 --2- 172.21.15.132:0/843953517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72c006b130 0x7f72c00c5d50 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f72b000e9d0 tx=0x7f72b000ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:47.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.914+0000 7f72a77fe640 1 -- 172.21.15.132:0/843953517 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b000ca60 con 0x7f72c006b130 2023-12-20T04:48:47.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.914+0000 7f72a77fe640 1 -- 172.21.15.132:0/843953517 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72b000cbc0 con 0x7f72c006b130 2023-12-20T04:48:47.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.914+0000 7f72c5173640 1 -- 172.21.15.132:0/843953517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72b8009a70 con 0x7f72c006b130 2023-12-20T04:48:47.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.914+0000 7f72a77fe640 1 -- 172.21.15.132:0/843953517 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72b0013470 con 0x7f72c006b130 2023-12-20T04:48:47.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.914+0000 7f72c5173640 1 -- 172.21.15.132:0/843953517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72c00c6980 con 0x7f72c006b130 2023-12-20T04:48:47.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.915+0000 7f72c5173640 1 -- 172.21.15.132:0/843953517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72c004e840 con 0x7f72c006b130 2023-12-20T04:48:47.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.916+0000 7f72a77fe640 1 -- 172.21.15.132:0/843953517 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f72b00135d0 con 0x7f72c006b130 2023-12-20T04:48:47.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.916+0000 7f72a77fe640 1 --2- 172.21.15.132:0/843953517 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f72ac06a430 0x7f72ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:47.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.916+0000 7f72a77fe640 1 -- 172.21.15.132:0/843953517 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72b0088b30 con 0x7f72c006b130 2023-12-20T04:48:47.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.916+0000 7f72be59c640 1 --2- 172.21.15.132:0/843953517 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f72ac06a430 0x7f72ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:47.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.917+0000 7f72be59c640 1 --2- 172.21.15.132:0/843953517 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f72ac06a430 0x7f72ac06c8f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f72c015e690 tx=0x7f72b4000ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:47.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:47.920+0000 7f72a77fe640 1 -- 172.21.15.132:0/843953517 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f72b0054260 con 0x7f72c006b130 2023-12-20T04:48:48.125 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:48:48.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:48.124+0000 7f72c5173640 1 -- 172.21.15.132:0/843953517 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f72c00c55e0 con 0x7f72c006b130 2023-12-20T04:48:48.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:48.124+0000 7f72a77fe640 1 -- 172.21.15.132:0/843953517 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v51) v1 ==== 53+0+73 (secure 0 0 0) 0x7f72b0017070 con 0x7f72c006b130 2023-12-20T04:48:48.126 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:48:48.128 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:48:48.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:48.126+0000 7f72c5173640 1 -- 172.21.15.132:0/843953517 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f72ac06a430 msgr2=0x7f72ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:48.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:48.126+0000 7f72c5173640 1 --2- 172.21.15.132:0/843953517 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f72ac06a430 0x7f72ac06c8f0 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f72c015e690 tx=0x7f72b4000ed0 comp rx=0 tx=0).stop 2023-12-20T04:48:48.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:48.126+0000 7f72c5173640 1 -- 172.21.15.132:0/843953517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72c006b130 msgr2=0x7f72c00c5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:48.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:48.126+0000 7f72c5173640 1 --2- 172.21.15.132:0/843953517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72c006b130 0x7f72c00c5d50 secure :-1 s=READY pgs=1383 cs=0 l=1 rev1=1 crypto rx=0x7f72b000e9d0 tx=0x7f72b000ee90 comp rx=0 tx=0).stop 2023-12-20T04:48:48.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:48.126+0000 7f72c5173640 1 -- 172.21.15.132:0/843953517 shutdown_connections 2023-12-20T04:48:48.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:48.126+0000 7f72c5173640 1 --2- 172.21.15.132:0/843953517 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f72ac06a430 0x7f72ac06c8f0 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:48.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:48.126+0000 7f72c5173640 1 --2- 172.21.15.132:0/843953517 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72c015ad70 0x7f72c0155910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:48.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:48.126+0000 7f72c5173640 1 --2- 172.21.15.132:0/843953517 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72c00c92d0 0x7f72c014cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:48.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:48.126+0000 7f72c5173640 1 --2- 172.21.15.132:0/843953517 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72c006b130 0x7f72c00c5d50 unknown :-1 s=CLOSED pgs=1383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:48.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:48.126+0000 7f72c5173640 1 -- 172.21.15.132:0/843953517 >> 172.21.15.132:0/843953517 conn(0x7f72c00ced10 msgr2=0x7f72c006b510 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:48.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:48.127+0000 7f72c5173640 1 -- 172.21.15.132:0/843953517 shutdown_connections 2023-12-20T04:48:48.129 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:48.127+0000 7f72c5173640 1 -- 172.21.15.132:0/843953517 wait complete. 2023-12-20T04:48:48.141 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:48:48.141 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:48:48.141 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-12-20T04:48:48.141 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-20T04:48:48.141 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-20T04:48:48.141 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:48:48.141 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:48:48.141 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:48:48.141 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:48:48.142 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:48.142 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-12-20T04:48:48.190 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:48:48.190 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:48:48.190 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:48:48.190 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:48.191 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-20T04:48:48.191 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:48.191 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:48:48.191 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:48.191 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-12-20T04:48:48.191 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:48:48.191 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:48.191 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-12-20T04:48:48.191 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:48:48.191 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:48.191 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:48:48.191 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:48.191 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:48:48.191 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42357sec preferred_lft 42357sec 2023-12-20T04:48:48.191 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-12-20T04:48:48.192 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:48.192 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:48:48.192 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:48:48.192 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:48:48.192 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:48.192 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::a8bc:1cff:fe40:54ea/64 scope link 2023-12-20T04:48:48.192 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:48.192 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:48:48.192 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-20T04:48:48.192 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c8e:c0ff:fe7a:bdc/64 scope link 2023-12-20T04:48:48.192 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:48.192 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:48:48.192 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether be:98:9a:6f:62:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-20T04:48:48.192 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::bc98:9aff:fe6f:6282/64 scope link 2023-12-20T04:48:48.192 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:48:48.193 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:48.193 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:48:48.258 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-12-20T04:48:48.260 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:48.260 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-12-20T04:48:48.317 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-12-20T04:48:48.317 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:48:48.317 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:48:48.317 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:48:48.317 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:48:48.317 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:48.318 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:48:48.318 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:48:48.318 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:48:48.318 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:48:48.318 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:48:48.318 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:48:48.415 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:48.416 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-20T04:48:48.430 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-20T04:48:48.431 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-20T04:48:48.431 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:48:48.431 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:48.431 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2023-12-20T04:48:48.497 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-20T04:48:48.498 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:48:48.498 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-20T04:48:48.552 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:48:48.552 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:48:48.552 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:48:48.607 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:48:48.674 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:48:48.674 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:48:48.741 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:48:48.742 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:48:48.743 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:48.743 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:48:48.799 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:48:48.799 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-20T04:48:48.841 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:48:48.868 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:48:48.868 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:48:48.928 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:2023-12-20T04:48:48.926+0000 7f96f9c40480 -1 init, newargv = 0x556a22e03920 newargc=15 2023-12-20T04:48:48.928 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[90643]: starting ceph client 2023-12-20T04:48:48.932 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[90643]: starting fuse 2023-12-20T04:48:48.936 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:48:48.937 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:48:48.938 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:48.938 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:48:48.993 INFO:teuthology.orchestra.run.smithi187.stdout:41 2023-12-20T04:48:48.993 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:48:48.994 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:48:48.994 DEBUG:teuthology.orchestra.run.smithi187:> import glob 2023-12-20T04:48:48.994 DEBUG:teuthology.orchestra.run.smithi187:> import re 2023-12-20T04:48:48.994 DEBUG:teuthology.orchestra.run.smithi187:> import os 2023-12-20T04:48:48.994 DEBUG:teuthology.orchestra.run.smithi187:> import subprocess 2023-12-20T04:48:48.994 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:48:48.994 DEBUG:teuthology.orchestra.run.smithi187:> def _find_admin_socket(client_name): 2023-12-20T04:48:48.994 DEBUG:teuthology.orchestra.run.smithi187:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-20T04:48:48.994 DEBUG:teuthology.orchestra.run.smithi187:> files = glob.glob(asok_path) 2023-12-20T04:48:48.994 DEBUG:teuthology.orchestra.run.smithi187:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-20T04:48:48.994 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:48:48.994 DEBUG:teuthology.orchestra.run.smithi187:> # Given a non-glob path, it better be there 2023-12-20T04:48:48.994 DEBUG:teuthology.orchestra.run.smithi187:> if "*" not in asok_path: 2023-12-20T04:48:48.994 DEBUG:teuthology.orchestra.run.smithi187:> assert(len(files) == 1) 2023-12-20T04:48:48.994 DEBUG:teuthology.orchestra.run.smithi187:> return files[0] 2023-12-20T04:48:48.995 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:48:48.995 DEBUG:teuthology.orchestra.run.smithi187:> for f in files: 2023-12-20T04:48:48.995 DEBUG:teuthology.orchestra.run.smithi187:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:48:48.995 DEBUG:teuthology.orchestra.run.smithi187:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:48:48.995 DEBUG:teuthology.orchestra.run.smithi187:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:48:48.995 DEBUG:teuthology.orchestra.run.smithi187:> contents = proc_f.read() 2023-12-20T04:48:48.995 DEBUG:teuthology.orchestra.run.smithi187:> if mountpoint in contents: 2023-12-20T04:48:48.995 DEBUG:teuthology.orchestra.run.smithi187:> return f 2023-12-20T04:48:48.995 DEBUG:teuthology.orchestra.run.smithi187:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:48:48.995 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:48:48.995 DEBUG:teuthology.orchestra.run.smithi187:> print(_find_admin_socket("client.1")) 2023-12-20T04:48:48.995 DEBUG:teuthology.orchestra.run.smithi187:> ' 2023-12-20T04:48:49.109 INFO:teuthology.orchestra.run.smithi187.stdout:/var/run/ceph/ceph-client.1.90643.asok 2023-12-20T04:48:49.295 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.90643.asok 2023-12-20T04:48:49.295 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:49.296 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.90643.asok status 2023-12-20T04:48:49.431 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-12-20T04:48:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: "metadata": { 2023-12-20T04:48:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:48:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:48:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: "entity_id": "1", 2023-12-20T04:48:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: "hostname": "smithi187", 2023-12-20T04:48:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-20T04:48:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: "pid": "90643", 2023-12-20T04:48:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: "root": "/" 2023-12-20T04:48:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:48:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_count": 0, 2023-12-20T04:48:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_pinned_count": 0, 2023-12-20T04:48:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: "id": 6886, 2023-12-20T04:48:49.432 INFO:teuthology.orchestra.run.smithi187.stdout: "inst": { 2023-12-20T04:48:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "name": { 2023-12-20T04:48:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "client", 2023-12-20T04:48:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "num": 6886 2023-12-20T04:48:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:48:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:48:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:48:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:48:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 1735001676 2023-12-20T04:48:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-12-20T04:48:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:48:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:48:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:48:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:48:49.433 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 1735001676 2023-12-20T04:48:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:48:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: "inst_str": "client.6886 192.168.0.1:0/1735001676", 2023-12-20T04:48:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: "addr_str": "192.168.0.1:0/1735001676", 2023-12-20T04:48:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: "inode_count": 1, 2023-12-20T04:48:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_epoch": 51, 2023-12-20T04:48:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch": 137, 2023-12-20T04:48:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:48:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: "blocklisted": false, 2023-12-20T04:48:49.434 INFO:teuthology.orchestra.run.smithi187.stdout: "fs_name": "cephfs" 2023-12-20T04:48:49.434 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-12-20T04:48:49.440 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:49.440 DEBUG:teuthology.orchestra.run.smithi187:> stat --file-system '--printf=%T 2023-12-20T04:48:49.440 DEBUG:teuthology.orchestra.run.smithi187:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-20T04:48:49.456 INFO:teuthology.orchestra.run.smithi187.stdout:fuseblk 2023-12-20T04:48:49.456 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-20T04:48:49.456 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:49.457 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:48:49.524 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:48:49.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.634+0000 7f074e963640 1 Processor -- start 2023-12-20T04:48:49.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.635+0000 7f074e963640 1 -- start start 2023-12-20T04:48:49.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.635+0000 7f074e963640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f074815b7d0 0x7f074815bc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:49.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.635+0000 7f074e963640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074806f750 con 0x7f07480d08c0 2023-12-20T04:48:49.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.635+0000 7f074e963640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f074806fa30 con 0x7f074806f0e0 2023-12-20T04:48:49.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.635+0000 7f074e963640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f074815f060 con 0x7f074815b7d0 2023-12-20T04:48:49.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.635+0000 7f0747fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f07480d08c0 0x7f07480cd030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40740/0 (socket says 172.21.15.132:40740) 2023-12-20T04:48:49.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.635+0000 7f0747fff640 1 -- 172.21.15.132:0/3696484537 learned_addr learned my addr 172.21.15.132:0/3696484537 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:49.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f074cf00640 1 --2- 172.21.15.132:0/3696484537 >> v2:172.21.15.187:3300/0 conn(0x7f074815b7d0 0x7f074815bc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:49.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0746ffd640 1 -- 172.21.15.132:0/3696484537 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2886965841 0 0) 0x7f074806f750 con 0x7f07480d08c0 2023-12-20T04:48:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0746ffd640 1 -- 172.21.15.132:0/3696484537 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0730003520 con 0x7f07480d08c0 2023-12-20T04:48:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0746ffd640 1 -- 172.21.15.132:0/3696484537 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2308289484 0 0) 0x7f0730003520 con 0x7f07480d08c0 2023-12-20T04:48:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0746ffd640 1 -- 172.21.15.132:0/3696484537 >> v2:172.21.15.187:3300/0 conn(0x7f074815b7d0 msgr2=0x7f074815bc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0746ffd640 1 --2- 172.21.15.132:0/3696484537 >> v2:172.21.15.187:3300/0 conn(0x7f074815b7d0 0x7f074815bc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0746ffd640 1 -- 172.21.15.132:0/3696484537 >> v1:172.21.15.187:6789/0 conn(0x7f074806f0e0 legacy=0x7f074815f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0746ffd640 1 -- 172.21.15.132:0/3696484537 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074806fd10 con 0x7f07480d08c0 2023-12-20T04:48:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0746ffd640 1 -- 172.21.15.132:0/3696484537 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f0738001670 con 0x7f07480d08c0 2023-12-20T04:48:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0746ffd640 1 -- 172.21.15.132:0/3696484537 >> v1:172.21.15.132:6789/0 conn(0x7f07480d08c0 legacy=0x7f07480cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0746ffd640 1 --2- 172.21.15.132:0/3696484537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0730003970 0x7f0730003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0746ffd640 1 --2- 172.21.15.132:0/3696484537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07300047c0 0x7f0730004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0746ffd640 1 --2- 172.21.15.132:0/3696484537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07300052a0 0x7f073000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0746ffd640 1 -- 172.21.15.132:0/3696484537 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074815f060 con 0x7f0730003970 2023-12-20T04:48:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0746ffd640 1 -- 172.21.15.132:0/3696484537 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f073000c170 con 0x7f07300047c0 2023-12-20T04:48:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0746ffd640 1 -- 172.21.15.132:0/3696484537 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f073000c330 con 0x7f07300052a0 2023-12-20T04:48:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0747fff640 1 --2- 172.21.15.132:0/3696484537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0730003970 0x7f0730003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f07477fe640 1 --2- 172.21.15.132:0/3696484537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07300047c0 0x7f0730004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f074cf00640 1 --2- 172.21.15.132:0/3696484537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07300052a0 0x7f073000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0747fff640 1 -- 172.21.15.132:0/3696484537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07300052a0 msgr2=0x7f073000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0747fff640 1 --2- 172.21.15.132:0/3696484537 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07300052a0 0x7f073000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0747fff640 1 -- 172.21.15.132:0/3696484537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07300047c0 msgr2=0x7f0730004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0747fff640 1 --2- 172.21.15.132:0/3696484537 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07300047c0 0x7f0730004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.636+0000 7f0747fff640 1 -- 172.21.15.132:0/3696484537 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0730003520 con 0x7f0730003970 2023-12-20T04:48:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.637+0000 7f074cf00640 1 -- 172.21.15.132:0/3696484537 reap_dead start 2023-12-20T04:48:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.637+0000 7f0747fff640 1 --2- 172.21.15.132:0/3696484537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0730003970 0x7f0730003d90 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f073800c210 tx=0x7f07300057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=909d92826f8887c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.637+0000 7f0746ffd640 1 -- 172.21.15.132:0/3696484537 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738005ad0 con 0x7f0730003970 2023-12-20T04:48:49.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.637+0000 7f0746ffd640 1 -- 172.21.15.132:0/3696484537 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0738005c30 con 0x7f0730003970 2023-12-20T04:48:49.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.637+0000 7f0746ffd640 1 -- 172.21.15.132:0/3696484537 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073802ca20 con 0x7f0730003970 2023-12-20T04:48:49.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.638+0000 7f074e963640 1 -- 172.21.15.132:0/3696484537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0730003970 msgr2=0x7f0730003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:49.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.638+0000 7f074e963640 1 --2- 172.21.15.132:0/3696484537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0730003970 0x7f0730003d90 secure :-1 s=READY pgs=1386 cs=0 l=1 rev1=1 crypto rx=0x7f073800c210 tx=0x7f07300057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:49.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.638+0000 7f074e963640 1 -- 172.21.15.132:0/3696484537 shutdown_connections 2023-12-20T04:48:49.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.638+0000 7f074e963640 1 --2- 172.21.15.132:0/3696484537 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0730003970 0x7f0730003d90 unknown :-1 s=CLOSED pgs=1386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:49.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.638+0000 7f074e963640 1 -- 172.21.15.132:0/3696484537 >> 172.21.15.132:0/3696484537 conn(0x7f07480cd7b0 msgr2=0x7f07480cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:49.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.638+0000 7f074e963640 1 -- 172.21.15.132:0/3696484537 shutdown_connections 2023-12-20T04:48:49.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.638+0000 7f074e963640 1 -- 172.21.15.132:0/3696484537 wait complete. 2023-12-20T04:48:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.639+0000 7f074e963640 1 Processor -- start 2023-12-20T04:48:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.639+0000 7f074e963640 1 -- start start 2023-12-20T04:48:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.640+0000 7f074e963640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0730003970 0x7f07480b4fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.640+0000 7f074e963640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f074806b610 0x7f07481548c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.640+0000 7f074e963640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07480af910 0x7f07480afdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.640+0000 7f074e963640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f074806bd80 con 0x7f0730003970 2023-12-20T04:48:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.640+0000 7f074e963640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07480b4500 con 0x7f07480af910 2023-12-20T04:48:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.640+0000 7f074e963640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f074806c520 con 0x7f074806b610 2023-12-20T04:48:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.640+0000 7f0747fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0730003970 0x7f07480b4fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.640+0000 7f0747fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0730003970 0x7f07480b4fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43618/0 (socket says 172.21.15.132:43618) 2023-12-20T04:48:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.640+0000 7f0747fff640 1 -- 172.21.15.132:0/600449253 learned_addr learned my addr 172.21.15.132:0/600449253 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.640+0000 7f07477fe640 1 --2- 172.21.15.132:0/600449253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f074806b610 0x7f07481548c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.640+0000 7f074cf00640 1 --2- 172.21.15.132:0/600449253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07480af910 0x7f07480afdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.641+0000 7f0747fff640 1 -- 172.21.15.132:0/600449253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f074806b610 msgr2=0x7f07481548c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.641+0000 7f0747fff640 1 --2- 172.21.15.132:0/600449253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f074806b610 0x7f07481548c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.641+0000 7f0747fff640 1 -- 172.21.15.132:0/600449253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07480af910 msgr2=0x7f07480afdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.641+0000 7f0747fff640 1 --2- 172.21.15.132:0/600449253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07480af910 0x7f07480afdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.641+0000 7f0747fff640 1 -- 172.21.15.132:0/600449253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f074806baa0 con 0x7f0730003970 2023-12-20T04:48:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.641+0000 7f0747fff640 1 --2- 172.21.15.132:0/600449253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0730003970 0x7f07480b4fa0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f073802c380 tx=0x7f073802e070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.641+0000 7f0744ff9640 1 -- 172.21.15.132:0/600449253 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f073803c040 con 0x7f0730003970 2023-12-20T04:48:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.641+0000 7f0744ff9640 1 -- 172.21.15.132:0/600449253 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f073802cbf0 con 0x7f0730003970 2023-12-20T04:48:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.641+0000 7f074e963640 1 -- 172.21.15.132:0/600449253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07480b47a0 con 0x7f0730003970 2023-12-20T04:48:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.641+0000 7f0744ff9640 1 -- 172.21.15.132:0/600449253 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0738000f90 con 0x7f0730003970 2023-12-20T04:48:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.641+0000 7f074e963640 1 -- 172.21.15.132:0/600449253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07480b54e0 con 0x7f0730003970 2023-12-20T04:48:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.642+0000 7f074e963640 1 -- 172.21.15.132:0/600449253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07480b4360 con 0x7f0730003970 2023-12-20T04:48:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.642+0000 7f0744ff9640 1 -- 172.21.15.132:0/600449253 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0738032070 con 0x7f0730003970 2023-12-20T04:48:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.643+0000 7f0744ff9640 1 --2- 172.21.15.132:0/600449253 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f073406a430 0x7f073406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.643+0000 7f07477fe640 1 --2- 172.21.15.132:0/600449253 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f073406a430 0x7f073406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.643+0000 7f0744ff9640 1 -- 172.21.15.132:0/600449253 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f07380a9da0 con 0x7f0730003970 2023-12-20T04:48:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.643+0000 7f07477fe640 1 --2- 172.21.15.132:0/600449253 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f073406a430 0x7f073406c8f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f073c000c00 tx=0x7f073c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:49.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.647+0000 7f0744ff9640 1 -- 172.21.15.132:0/600449253 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f07480b4360 con 0x7f0730003970 2023-12-20T04:48:49.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.845+0000 7f074e963640 1 -- 172.21.15.132:0/600449253 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07480b4360 con 0x7f0730003970 2023-12-20T04:48:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.846+0000 7f0744ff9640 1 -- 172.21.15.132:0/600449253 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f07480b4360 con 0x7f0730003970 2023-12-20T04:48:49.848 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:49.848 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6763,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1413044191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1413044191},{"type":"v1","addr":"172.21.15.132:6837","nonce":1413044191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1584197959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1584197959},{"type":"v1","addr":"172.21.15.187:6834","nonce":1584197959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":7830,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/3080885824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3080885824},{"type":"v1","addr":"172.21.15.132:6836","nonce":3080885824}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:48:37.200402+0000","modified":"2023-12-20T04:48:39.207037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"d","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/1483131498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":1483131498},{"type":"v1","addr":"172.21.15.187:6835","nonce":1483131498}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-20T04:48:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 51 2023-12-20T04:48:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.847+0000 7f074e963640 1 -- 172.21.15.132:0/600449253 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f073406a430 msgr2=0x7f073406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.847+0000 7f074e963640 1 --2- 172.21.15.132:0/600449253 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f073406a430 0x7f073406c8f0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f073c000c00 tx=0x7f073c009040 comp rx=0 tx=0).stop 2023-12-20T04:48:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.847+0000 7f074e963640 1 -- 172.21.15.132:0/600449253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0730003970 msgr2=0x7f07480b4fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.847+0000 7f074e963640 1 --2- 172.21.15.132:0/600449253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0730003970 0x7f07480b4fa0 secure :-1 s=READY pgs=1387 cs=0 l=1 rev1=1 crypto rx=0x7f073802c380 tx=0x7f073802e070 comp rx=0 tx=0).stop 2023-12-20T04:48:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.847+0000 7f074e963640 1 -- 172.21.15.132:0/600449253 shutdown_connections 2023-12-20T04:48:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.847+0000 7f074e963640 1 --2- 172.21.15.132:0/600449253 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f073406a430 0x7f073406c8f0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.848+0000 7f074e963640 1 --2- 172.21.15.132:0/600449253 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07480af910 0x7f07480afdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.848+0000 7f074e963640 1 --2- 172.21.15.132:0/600449253 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f074806b610 0x7f07481548c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.848+0000 7f074e963640 1 --2- 172.21.15.132:0/600449253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0730003970 0x7f07480b4fa0 unknown :-1 s=CLOSED pgs=1387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.848+0000 7f074e963640 1 -- 172.21.15.132:0/600449253 >> 172.21.15.132:0/600449253 conn(0x7f07480cd7b0 msgr2=0x7f074815cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.848+0000 7f074e963640 1 -- 172.21.15.132:0/600449253 shutdown_connections 2023-12-20T04:48:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:49.848+0000 7f074e963640 1 -- 172.21.15.132:0/600449253 wait complete. 2023-12-20T04:48:49.861 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-20T04:48:49.978 INFO:teuthology.orchestra.run.smithi187.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":7845,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":12.766311391,"mdsmap_epoch":51,"osdmap_epoch":137,"osdmap_epoch_barrier":137,"uptime":17.554175747999999} 2023-12-20T04:48:49.978 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 7845, "mdsmap_epoch": 51, "osdmap_epoch": 137, "osdmap_epoch_barrier": 137, "rank_uptime": 12.766311391, "state": "up:active", "uptime": 17.554175748, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:48:49.979 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-20T04:48:50.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.080+0000 7fbdab7d9640 1 Processor -- start 2023-12-20T04:48:50.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.081+0000 7fbdab7d9640 1 -- start start 2023-12-20T04:48:50.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.081+0000 7fbdab7d9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda415cf20 0x7fbda406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:50.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.081+0000 7fbdab7d9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda406cc90 con 0x7fbda40cd4b0 2023-12-20T04:48:50.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.081+0000 7fbdab7d9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbda40b2f30 con 0x7fbda415d300 2023-12-20T04:48:50.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.081+0000 7fbdab7d9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40b3210 con 0x7fbda415cf20 2023-12-20T04:48:50.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbda9d76640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbda40cd4b0 0x7fbda40d0660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40752/0 (socket says 172.21.15.132:40752) 2023-12-20T04:48:50.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbda9d76640 1 -- 172.21.15.132:0/3170528190 learned_addr learned my addr 172.21.15.132:0/3170528190 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:50.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbda9575640 1 --2- 172.21.15.132:0/3170528190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda415cf20 0x7fbda406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:50.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbd9bfff640 1 -- 172.21.15.132:0/3170528190 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1432720249 0 0) 0x7fbda406cc90 con 0x7fbda40cd4b0 2023-12-20T04:48:50.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbd9bfff640 1 -- 172.21.15.132:0/3170528190 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbd90003520 con 0x7fbda40cd4b0 2023-12-20T04:48:50.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbd9bfff640 1 -- 172.21.15.132:0/3170528190 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2589078821 0 0) 0x7fbd90003520 con 0x7fbda40cd4b0 2023-12-20T04:48:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbd9bfff640 1 -- 172.21.15.132:0/3170528190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda415cf20 msgr2=0x7fbda406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbd9bfff640 1 --2- 172.21.15.132:0/3170528190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda415cf20 0x7fbda406c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbd9bfff640 1 -- 172.21.15.132:0/3170528190 >> v1:172.21.15.187:6789/0 conn(0x7fbda415d300 legacy=0x7fbda4161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbd9bfff640 1 -- 172.21.15.132:0/3170528190 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda40b34f0 con 0x7fbda40cd4b0 2023-12-20T04:48:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbd9bfff640 1 -- 172.21.15.132:0/3170528190 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fbd9c001670 con 0x7fbda40cd4b0 2023-12-20T04:48:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbd9bfff640 1 -- 172.21.15.132:0/3170528190 >> v1:172.21.15.132:6789/0 conn(0x7fbda40cd4b0 legacy=0x7fbda40d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbd9bfff640 1 --2- 172.21.15.132:0/3170528190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd900039a0 0x7fbd90003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbd9bfff640 1 --2- 172.21.15.132:0/3170528190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda415cf20 0x7fbd900047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbd9bfff640 1 --2- 172.21.15.132:0/3170528190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd90004d00 0x7fbd90005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbd9bfff640 1 -- 172.21.15.132:0/3170528190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40b3210 con 0x7fbd90004d00 2023-12-20T04:48:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbd9bfff640 1 -- 172.21.15.132:0/3170528190 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9000bb10 con 0x7fbd900039a0 2023-12-20T04:48:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbd9bfff640 1 -- 172.21.15.132:0/3170528190 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd9000bca0 con 0x7fbda415cf20 2023-12-20T04:48:50.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbda9d76640 1 --2- 172.21.15.132:0/3170528190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd90004d00 0x7fbd90005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:50.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbda9575640 1 --2- 172.21.15.132:0/3170528190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd900039a0 0x7fbd90003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:50.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.082+0000 7fbda8d74640 1 --2- 172.21.15.132:0/3170528190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda415cf20 0x7fbd900047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:50.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.083+0000 7fbda9d76640 1 -- 172.21.15.132:0/3170528190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda415cf20 msgr2=0x7fbd900047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:50.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.083+0000 7fbda9d76640 1 --2- 172.21.15.132:0/3170528190 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda415cf20 0x7fbd900047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:50.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.083+0000 7fbda9d76640 1 -- 172.21.15.132:0/3170528190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd900039a0 msgr2=0x7fbd90003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:50.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.083+0000 7fbda9d76640 1 --2- 172.21.15.132:0/3170528190 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd900039a0 0x7fbd90003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:50.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.083+0000 7fbda9d76640 1 -- 172.21.15.132:0/3170528190 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd90003520 con 0x7fbd90004d00 2023-12-20T04:48:50.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.083+0000 7fbda9d76640 1 --2- 172.21.15.132:0/3170528190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd90004d00 0x7fbd90005180 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00c270 tx=0x7fbd900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dfe951ed9e61eef7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:50.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.083+0000 7fbd9bfff640 1 -- 172.21.15.132:0/3170528190 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c005ad0 con 0x7fbd90004d00 2023-12-20T04:48:50.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.083+0000 7fbd9bfff640 1 -- 172.21.15.132:0/3170528190 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbd9c005c50 con 0x7fbd90004d00 2023-12-20T04:48:50.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.083+0000 7fbd9bfff640 1 -- 172.21.15.132:0/3170528190 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbd9c02c8a0 con 0x7fbd90004d00 2023-12-20T04:48:50.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.084+0000 7fbdab7d9640 1 -- 172.21.15.132:0/3170528190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd90004d00 msgr2=0x7fbd90005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.084+0000 7fbdab7d9640 1 --2- 172.21.15.132:0/3170528190 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd90004d00 0x7fbd90005180 secure :-1 s=READY pgs=1389 cs=0 l=1 rev1=1 crypto rx=0x7fbd9c00c270 tx=0x7fbd900057f0 comp rx=0 tx=0).stop 2023-12-20T04:48:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.084+0000 7fbda9d76640 1 -- 172.21.15.132:0/3170528190 reap_dead start 2023-12-20T04:48:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.084+0000 7fbdab7d9640 1 -- 172.21.15.132:0/3170528190 shutdown_connections 2023-12-20T04:48:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.084+0000 7fbdab7d9640 1 -- 172.21.15.132:0/3170528190 >> 172.21.15.132:0/3170528190 conn(0x7fbda4072c60 msgr2=0x7fbda4073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.084+0000 7fbdab7d9640 1 -- 172.21.15.132:0/3170528190 shutdown_connections 2023-12-20T04:48:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.084+0000 7fbdab7d9640 1 -- 172.21.15.132:0/3170528190 wait complete. 2023-12-20T04:48:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.085+0000 7fbdab7d9640 1 Processor -- start 2023-12-20T04:48:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.085+0000 7fbdab7d9640 1 -- start start 2023-12-20T04:48:50.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.086+0000 7fbdab7d9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbda41f2480 0x7fbda40ae100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.086+0000 7fbdab7d9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda40ae640 0x7fbda40c6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.086+0000 7fbdab7d9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbda40c7060 0x7fbda40af1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.086+0000 7fbdab7d9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40c6700 con 0x7fbda41f2480 2023-12-20T04:48:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.086+0000 7fbdab7d9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40ad2f0 con 0x7fbda40c7060 2023-12-20T04:48:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.086+0000 7fbdab7d9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbda40c57e0 con 0x7fbda40ae640 2023-12-20T04:48:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.086+0000 7fbda9575640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbda41f2480 0x7fbda40ae100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.086+0000 7fbda9575640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbda41f2480 0x7fbda40ae100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43624/0 (socket says 172.21.15.132:43624) 2023-12-20T04:48:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.086+0000 7fbda9575640 1 -- 172.21.15.132:0/4246288797 learned_addr learned my addr 172.21.15.132:0/4246288797 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.086+0000 7fbda8d74640 1 --2- 172.21.15.132:0/4246288797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda40ae640 0x7fbda40c6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.086+0000 7fbda9d76640 1 --2- 172.21.15.132:0/4246288797 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbda40c7060 0x7fbda40af1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.086+0000 7fbda9575640 1 -- 172.21.15.132:0/4246288797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda40ae640 msgr2=0x7fbda40c6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.086+0000 7fbda9575640 1 --2- 172.21.15.132:0/4246288797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda40ae640 0x7fbda40c6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.086+0000 7fbda9575640 1 -- 172.21.15.132:0/4246288797 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbda40c7060 msgr2=0x7fbda40af1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.086+0000 7fbda9575640 1 --2- 172.21.15.132:0/4246288797 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbda40c7060 0x7fbda40af1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.086+0000 7fbda9575640 1 -- 172.21.15.132:0/4246288797 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbda40c5a80 con 0x7fbda41f2480 2023-12-20T04:48:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.087+0000 7fbda9575640 1 --2- 172.21.15.132:0/4246288797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbda41f2480 0x7fbda40ae100 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fbda00046a0 tx=0x7fbda0007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.087+0000 7fbd99ffb640 1 -- 172.21.15.132:0/4246288797 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda0009c30 con 0x7fbda41f2480 2023-12-20T04:48:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.087+0000 7fbd99ffb640 1 -- 172.21.15.132:0/4246288797 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbda0015420 con 0x7fbda41f2480 2023-12-20T04:48:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.087+0000 7fbdab7d9640 1 -- 172.21.15.132:0/4246288797 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbda40c5d60 con 0x7fbda41f2480 2023-12-20T04:48:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.087+0000 7fbd99ffb640 1 -- 172.21.15.132:0/4246288797 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbda00157d0 con 0x7fbda41f2480 2023-12-20T04:48:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.087+0000 7fbdab7d9640 1 -- 172.21.15.132:0/4246288797 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbda40c6320 con 0x7fbda41f2480 2023-12-20T04:48:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.088+0000 7fbdab7d9640 1 -- 172.21.15.132:0/4246288797 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbda415fc70 con 0x7fbda41f2480 2023-12-20T04:48:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.088+0000 7fbd99ffb640 1 -- 172.21.15.132:0/4246288797 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbda0015930 con 0x7fbda41f2480 2023-12-20T04:48:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.089+0000 7fbd99ffb640 1 --2- 172.21.15.132:0/4246288797 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd8806a430 0x7fbd8806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.089+0000 7fbd99ffb640 1 -- 172.21.15.132:0/4246288797 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(137..137 src has 1..137) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbda0089170 con 0x7fbda41f2480 2023-12-20T04:48:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.089+0000 7fbda8d74640 1 --2- 172.21.15.132:0/4246288797 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd8806a430 0x7fbd8806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:50.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.089+0000 7fbda8d74640 1 --2- 172.21.15.132:0/4246288797 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd8806a430 0x7fbd8806c8f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fbda40aea60 tx=0x7fbd94009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:50.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.093+0000 7fbd99ffb640 1 -- 172.21.15.132:0/4246288797 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbda00548a0 con 0x7fbda41f2480 2023-12-20T04:48:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.260+0000 7fbdab7d9640 1 -- 172.21.15.132:0/4246288797 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fbda404e840 con 0x7fbda41f2480 2023-12-20T04:48:50.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.905+0000 7fbd99ffb640 1 -- 172.21.15.132:0/4246288797 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v138) v1 ==== 181+0+0 (secure 0 0 0) 0x7fbda0057ec0 con 0x7fbda41f2480 2023-12-20T04:48:50.908 INFO:teuthology.orchestra.run.smithi132.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-20T04:48:50.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.908+0000 7fbdab7d9640 1 -- 172.21.15.132:0/4246288797 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd8806a430 msgr2=0x7fbd8806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:50.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.908+0000 7fbdab7d9640 1 --2- 172.21.15.132:0/4246288797 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd8806a430 0x7fbd8806c8f0 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7fbda40aea60 tx=0x7fbd94009040 comp rx=0 tx=0).stop 2023-12-20T04:48:50.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.908+0000 7fbdab7d9640 1 -- 172.21.15.132:0/4246288797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbda41f2480 msgr2=0x7fbda40ae100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:50.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.908+0000 7fbdab7d9640 1 --2- 172.21.15.132:0/4246288797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbda41f2480 0x7fbda40ae100 secure :-1 s=READY pgs=1390 cs=0 l=1 rev1=1 crypto rx=0x7fbda00046a0 tx=0x7fbda0007700 comp rx=0 tx=0).stop 2023-12-20T04:48:50.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.908+0000 7fbdab7d9640 1 -- 172.21.15.132:0/4246288797 shutdown_connections 2023-12-20T04:48:50.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.908+0000 7fbdab7d9640 1 --2- 172.21.15.132:0/4246288797 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbd8806a430 0x7fbd8806c8f0 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:50.910 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.908+0000 7fbdab7d9640 1 --2- 172.21.15.132:0/4246288797 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbda40c7060 0x7fbda40af1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:50.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.908+0000 7fbdab7d9640 1 --2- 172.21.15.132:0/4246288797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbda40ae640 0x7fbda40c6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:50.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.908+0000 7fbdab7d9640 1 --2- 172.21.15.132:0/4246288797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbda41f2480 0x7fbda40ae100 unknown :-1 s=CLOSED pgs=1390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:50.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.908+0000 7fbdab7d9640 1 -- 172.21.15.132:0/4246288797 >> 172.21.15.132:0/4246288797 conn(0x7fbda4072c60 msgr2=0x7fbda40d14f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:50.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.908+0000 7fbdab7d9640 1 -- 172.21.15.132:0/4246288797 shutdown_connections 2023-12-20T04:48:50.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:50.908+0000 7fbdab7d9640 1 -- 172.21.15.132:0/4246288797 wait complete. 2023-12-20T04:48:50.922 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-20T04:48:51.035 INFO:teuthology.orchestra.run.smithi132.stdout:{"osd_mon_report_interval":"5"} 2023-12-20T04:48:51.036 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-20T04:48:51.036 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-12-20T04:48:51.036 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:48:51.037 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:48:51.052 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:51.052 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-12-20T04:48:51.192 INFO:teuthology.orchestra.run.smithi132.stderr:16+0 records in 2023-12-20T04:48:51.193 INFO:teuthology.orchestra.run.smithi132.stderr:16+0 records out 2023-12-20T04:48:51.193 INFO:teuthology.orchestra.run.smithi132.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0815348 s, 206 MB/s 2023-12-20T04:48:51.193 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:48:51.193 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:48:51.210 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:48:51.211 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-12-20T04:48:51.348 INFO:teuthology.orchestra.run.smithi132.stderr:17+0 records in 2023-12-20T04:48:51.348 INFO:teuthology.orchestra.run.smithi132.stderr:17+0 records out 2023-12-20T04:48:51.348 INFO:teuthology.orchestra.run.smithi132.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.0789892 s, 226 MB/s 2023-12-20T04:48:51.348 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-20T04:48:51.348 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:48:51.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.446+0000 7fa4e6638640 1 Processor -- start 2023-12-20T04:48:51.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.446+0000 7fa4e6638640 1 -- start start 2023-12-20T04:48:51.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.446+0000 7fa4e6638640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa4e00c92d0 0x7fa4e00c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:51.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.446+0000 7fa4e6638640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa4e015a3a0 0x7fa4e006c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.446+0000 7fa4e6638640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa4e015aa30 con 0x7fa4e013cce0 2023-12-20T04:48:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.446+0000 7fa4e6638640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e00c9bf0 con 0x7fa4e00c92d0 2023-12-20T04:48:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.446+0000 7fa4e6638640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa4e015a780 con 0x7fa4e015a3a0 2023-12-20T04:48:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.447+0000 7fa4dffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa4e00c92d0 0x7fa4e00c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.447+0000 7fa4dffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa4e00c92d0 0x7fa4e00c96b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43634/0 (socket says 172.21.15.132:43634) 2023-12-20T04:48:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.447+0000 7fa4dffff640 1 -- 172.21.15.132:0/4175824977 learned_addr learned my addr 172.21.15.132:0/4175824977 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.447+0000 7fa4e4bd5640 1 --2- 172.21.15.132:0/4175824977 >> v2:172.21.15.187:3300/0 conn(0x7fa4e015a3a0 0x7fa4e006c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.447+0000 7fa4dffff640 1 -- 172.21.15.132:0/4175824977 >> v2:172.21.15.187:3300/0 conn(0x7fa4e015a3a0 msgr2=0x7fa4e006c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.447+0000 7fa4dffff640 1 --2- 172.21.15.132:0/4175824977 >> v2:172.21.15.187:3300/0 conn(0x7fa4e015a3a0 0x7fa4e006c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.447+0000 7fa4dffff640 1 -- 172.21.15.132:0/4175824977 >> v1:172.21.15.187:6789/0 conn(0x7fa4e013cce0 legacy=0x7fa4e0159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.447+0000 7fa4dffff640 1 -- 172.21.15.132:0/4175824977 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4e006b260 con 0x7fa4e00c92d0 2023-12-20T04:48:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.447+0000 7fa4e4bd5640 1 --2- 172.21.15.132:0/4175824977 >> v2:172.21.15.187:3300/0 conn(0x7fa4e015a3a0 0x7fa4e006c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:48:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.448+0000 7fa4dffff640 1 --2- 172.21.15.132:0/4175824977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4e00c92d0 0x7fa4e00c96b0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00ce950 tx=0x7fa4d002de30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c33ddddd186d91a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:51.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.448+0000 7fa4deffd640 1 -- 172.21.15.132:0/4175824977 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d002ebe0 con 0x7fa4e00c92d0 2023-12-20T04:48:51.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.448+0000 7fa4deffd640 1 -- 172.21.15.132:0/4175824977 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4d0032070 con 0x7fa4e00c92d0 2023-12-20T04:48:51.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.448+0000 7fa4deffd640 1 -- 172.21.15.132:0/4175824977 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4d0038400 con 0x7fa4e00c92d0 2023-12-20T04:48:51.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.448+0000 7fa4e6638640 1 -- 172.21.15.132:0/4175824977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4e00c92d0 msgr2=0x7fa4e00c96b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:51.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.448+0000 7fa4e6638640 1 --2- 172.21.15.132:0/4175824977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4e00c92d0 0x7fa4e00c96b0 secure :-1 s=READY pgs=1391 cs=0 l=1 rev1=1 crypto rx=0x7fa4e00ce950 tx=0x7fa4d002de30 comp rx=0 tx=0).stop 2023-12-20T04:48:51.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.448+0000 7fa4e6638640 1 -- 172.21.15.132:0/4175824977 shutdown_connections 2023-12-20T04:48:51.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.448+0000 7fa4e6638640 1 --2- 172.21.15.132:0/4175824977 >> v2:172.21.15.187:3300/0 conn(0x7fa4e015a3a0 0x7fa4e006c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:51.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.448+0000 7fa4e6638640 1 --2- 172.21.15.132:0/4175824977 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4e00c92d0 0x7fa4e00c96b0 unknown :-1 s=CLOSED pgs=1391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:51.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.448+0000 7fa4e6638640 1 -- 172.21.15.132:0/4175824977 >> 172.21.15.132:0/4175824977 conn(0x7fa4e00ced10 msgr2=0x7fa4e00cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:51.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.448+0000 7fa4e6638640 1 -- 172.21.15.132:0/4175824977 shutdown_connections 2023-12-20T04:48:51.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.448+0000 7fa4e6638640 1 -- 172.21.15.132:0/4175824977 wait complete. 2023-12-20T04:48:51.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.449+0000 7fa4e6638640 1 Processor -- start 2023-12-20T04:48:51.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.450+0000 7fa4e6638640 1 -- start start 2023-12-20T04:48:51.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.450+0000 7fa4e6638640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4e00c92d0 0x7fa4e0155be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:51.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.450+0000 7fa4e6638640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4e013cce0 0x7fa4e00b2930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:51.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.450+0000 7fa4e6638640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4e015a3a0 0x7fa4e0157c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:51.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.450+0000 7fa4e6638640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e00b3260 con 0x7fa4e013cce0 2023-12-20T04:48:51.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.450+0000 7fa4e6638640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e00b3540 con 0x7fa4e015a3a0 2023-12-20T04:48:51.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.450+0000 7fa4e6638640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa4e00b3820 con 0x7fa4e00c92d0 2023-12-20T04:48:51.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.451+0000 7fa4df7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4e013cce0 0x7fa4e00b2930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:51.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.451+0000 7fa4df7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4e013cce0 0x7fa4e00b2930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43652/0 (socket says 172.21.15.132:43652) 2023-12-20T04:48:51.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.451+0000 7fa4df7fe640 1 -- 172.21.15.132:0/233835954 learned_addr learned my addr 172.21.15.132:0/233835954 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:51.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.451+0000 7fa4e4bd5640 1 --2- 172.21.15.132:0/233835954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4e015a3a0 0x7fa4e0157c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:51.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.451+0000 7fa4dffff640 1 --2- 172.21.15.132:0/233835954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4e00c92d0 0x7fa4e0155be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:51.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.451+0000 7fa4df7fe640 1 -- 172.21.15.132:0/233835954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4e00c92d0 msgr2=0x7fa4e0155be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:51.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.451+0000 7fa4df7fe640 1 --2- 172.21.15.132:0/233835954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4e00c92d0 0x7fa4e0155be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:51.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.451+0000 7fa4df7fe640 1 -- 172.21.15.132:0/233835954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4e015a3a0 msgr2=0x7fa4e0157c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:51.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.451+0000 7fa4df7fe640 1 --2- 172.21.15.132:0/233835954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4e015a3a0 0x7fa4e0157c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:51.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.451+0000 7fa4df7fe640 1 -- 172.21.15.132:0/233835954 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa4d000b760 con 0x7fa4e013cce0 2023-12-20T04:48:51.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.451+0000 7fa4df7fe640 1 --2- 172.21.15.132:0/233835954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4e013cce0 0x7fa4e00b2930 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800c430 tx=0x7fa4c800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:51.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.451+0000 7fa4dcff9640 1 -- 172.21.15.132:0/233835954 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8011790 con 0x7fa4e013cce0 2023-12-20T04:48:51.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.451+0000 7fa4dcff9640 1 -- 172.21.15.132:0/233835954 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa4c80118f0 con 0x7fa4e013cce0 2023-12-20T04:48:51.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.451+0000 7fa4e6638640 1 -- 172.21.15.132:0/233835954 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4e00b3b00 con 0x7fa4e013cce0 2023-12-20T04:48:51.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.451+0000 7fa4dcff9640 1 -- 172.21.15.132:0/233835954 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa4c8011ce0 con 0x7fa4e013cce0 2023-12-20T04:48:51.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.451+0000 7fa4e6638640 1 -- 172.21.15.132:0/233835954 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4e00b2e70 con 0x7fa4e013cce0 2023-12-20T04:48:51.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.452+0000 7fa4e6638640 1 -- 172.21.15.132:0/233835954 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4e00b3030 con 0x7fa4e013cce0 2023-12-20T04:48:51.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.452+0000 7fa4dcff9640 1 -- 172.21.15.132:0/233835954 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa4c801c460 con 0x7fa4e013cce0 2023-12-20T04:48:51.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.453+0000 7fa4dcff9640 1 --2- 172.21.15.132:0/233835954 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa4c006a430 0x7fa4c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:51.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.453+0000 7fa4dcff9640 1 -- 172.21.15.132:0/233835954 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa4c80886e0 con 0x7fa4e013cce0 2023-12-20T04:48:51.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.453+0000 7fa4dffff640 1 --2- 172.21.15.132:0/233835954 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa4c006a430 0x7fa4c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:51.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.453+0000 7fa4dffff640 1 --2- 172.21.15.132:0/233835954 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa4c006a430 0x7fa4c006c8f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0039000 tx=0x7fa4d0034000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:51.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.457+0000 7fa4dcff9640 1 -- 172.21.15.132:0/233835954 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa4c8053e10 con 0x7fa4e013cce0 2023-12-20T04:48:51.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.625+0000 7fa4e6638640 1 -- 172.21.15.132:0/233835954 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fa4e00b4020 con 0x7fa4e013cce0 2023-12-20T04:48:51.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.626+0000 7fa4dcff9640 1 -- 172.21.15.132:0/233835954 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v138) v1 ==== 81+0+33550 (secure 0 0 0) 0x7fa4e00b4020 con 0x7fa4e013cce0 2023-12-20T04:48:51.628 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:51.628 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:48:51.628 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 138, 2023-12-20T04:48:51.628 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:48:51.628 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:48:51.629 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:48:50.899584+0000", 2023-12-20T04:48:51.629 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:48:51.629 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:48:51.629 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:48:51.629 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:48:51.629 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:48:51.629 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:48:51.629 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:48:51.629 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:48:51.629 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:48:51.629 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:48:51.629 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:48:51.629 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:48:51.629 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:48:51.630 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:48:51.630 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:48:51.630 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 17, 2023-12-20T04:48:51.630 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:48:51.630 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:48:51.630 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:48:51.630 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:48:51.630 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:48:51.630 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:48:51.630 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.630 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:48:51.630 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:48:51.630 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:48:51.630 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:48:51.631 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:48:51.631 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:48:51.631 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:48:51.631 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:48:51.631 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:48:51.631 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:48:51.631 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:48:51.631 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:48:51.631 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:48:51.631 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:48:51.631 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:48:51.631 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:48:51.631 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:48:51.631 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:48:51.631 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:48:51.632 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:48:51.632 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:48:51.632 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:48:51.632 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:48:51.632 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:48:51.632 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:48:51.632 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:48:51.632 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:48:51.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.632 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:48:51.632 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:48:51.632 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:48:51.632 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:48:51.632 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:48:51.632 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:48:51.633 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:48:51.633 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:48:51.633 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:48:51.633 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:48:51.633 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:48:51.633 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:48:51.633 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:48:51.633 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:48:51.633 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:48:51.633 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:48:51.633 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:48:51.633 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:48:51.633 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:48:51.633 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:48:51.634 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:48:51.634 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:48:51.634 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:48:51.634 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:48:51.634 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:48:51.634 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:48:51.634 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:48:51.634 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.634 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:48:51.634 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:48:51.634 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:48:51.634 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:48:51.634 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:48:51.634 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:48:51.634 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:48:51.635 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:48:51.635 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:48:51.635 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:48:51.635 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:48:51.635 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:48:51.635 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:48:51.635 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:48:51.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.635 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:48:51.635 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:48:51.635 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.635 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:48:51.635 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:48:51.635 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:48:51.635 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:48:51.636 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:48:51.636 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:48:51.636 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:48:51.636 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:48:51.636 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:48:51.636 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.636 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.636 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.636 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 16, 2023-12-20T04:48:51.636 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:48:51.636 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:48:35.008751+0000", 2023-12-20T04:48:51.636 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:48:51.636 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:48:51.636 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:48:51.636 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:48:51.637 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:48:51.637 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:48:51.637 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:48:51.637 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:48:51.637 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:48:51.637 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:48:51.637 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:48:51.637 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:48:51.637 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:48:51.637 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:48:51.637 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:48:51.637 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:48:51.637 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:48:51.637 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:48:51.638 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:48:51.638 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:48:51.638 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:48:51.638 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:48:51.638 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:48:51.638 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:48:51.638 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.638 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "136", 2023-12-20T04:48:51.638 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:48:51.638 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:48:51.638 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:48:51.638 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:48:51.638 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:48:51.638 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:48:51.639 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:48:51.639 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:48:51.639 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:48:51.639 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:48:51.639 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:48:51.639 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:48:51.639 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:48:51.639 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:48:51.639 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:48:51.639 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:48:51.639 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:48:51.639 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:48:51.639 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:48:51.639 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:48:51.639 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:48:51.640 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:48:51.640 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:48:51.640 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:48:51.640 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:48:51.640 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:48:51.640 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.640 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:48:51.640 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:48:51.640 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:48:51.640 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:48:51.640 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:48:51.640 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:48:51.640 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:48:51.640 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:48:51.640 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:48:51.641 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:48:51.641 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:48:51.641 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:48:51.641 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:48:51.641 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:48:51.641 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:48:51.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.641 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:48:51.641 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:48:51.641 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:48:51.641 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.641 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.641 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:48:51.641 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:48:51.641 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:48:51.642 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:48:51.642 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:48:51.642 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:48:51.642 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:48:51.642 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:48:51.642 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:48:51.642 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.642 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.642 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.642 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 17, 2023-12-20T04:48:51.642 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:48:51.642 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:48:36.182609+0000", 2023-12-20T04:48:51.642 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:48:51.642 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:48:51.642 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:48:51.643 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:48:51.643 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:48:51.643 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:48:51.643 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:48:51.643 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:48:51.643 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:48:51.643 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:48:51.643 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:48:51.643 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:48:51.643 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:48:51.643 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:48:51.643 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:48:51.643 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:48:51.643 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:48:51.643 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:48:51.644 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:48:51.644 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:48:51.644 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:48:51.644 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:48:51.644 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:48:51.644 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:48:51.644 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.644 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "138", 2023-12-20T04:48:51.644 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:48:51.644 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:48:51.644 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:48:51.644 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:48:51.644 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:48:51.644 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:48:51.644 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:48:51.645 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:48:51.645 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:48:51.645 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 33554432, 2023-12-20T04:48:51.645 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:48:51.645 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:48:51.645 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:48:51.645 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:48:51.645 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:48:51.645 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:48:51.645 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:48:51.645 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:48:51.645 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:48:51.645 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:48:51.645 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:48:51.645 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:48:51.646 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:48:51.646 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:48:51.646 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:48:51.646 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:48:51.646 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.646 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:48:51.646 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:48:51.646 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:48:51.646 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:48:51.646 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:48:51.646 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:48:51.646 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:48:51.646 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:48:51.646 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:48:51.647 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:48:51.647 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:48:51.647 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:48:51.647 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:48:51.647 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:48:51.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.647 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:48:51.647 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:48:51.647 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:48:51.647 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.647 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:48:51.647 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:48:51.647 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:48:51.647 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:48:51.648 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:48:51.648 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:48:51.648 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:48:51.648 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:48:51.648 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:48:51.648 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.648 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.648 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:48:51.648 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:48:51.648 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.648 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:48:51.648 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:48:51.648 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:48:51.648 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:48:51.648 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:48:51.649 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:48:51.649 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:48:51.649 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:48:51.649 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:48:51.649 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:48:51.649 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:48:51.649 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:48:51.649 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:48:51.649 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.649 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.649 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:48:51.649 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:48:51.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.649 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.650 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.650 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:48:51.650 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:48:51.650 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.650 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.650 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:48:51.650 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.650 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.650 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:48:51.650 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:48:51.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.650 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.651 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.651 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:48:51.651 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:48:51.651 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.651 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.651 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:48:51.651 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.651 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.651 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:48:51.651 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:48:51.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.651 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.652 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:48:51.652 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:48:51.652 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.652 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.652 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:48:51.652 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.652 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.652 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:48:51.652 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:48:51.652 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.652 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.652 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.653 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:48:51.653 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:48:51.653 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.653 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.653 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:48:51.653 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:48:51.653 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:48:51.653 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:48:51.653 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:48:51.653 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:48:51.653 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:48:51.653 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.654 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.654 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:48:51.654 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:48:51.654 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:48:51.654 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:48:51.654 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:48:51.654 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:48:51.654 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:48:51.654 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:48:51.654 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:48:51.654 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:48:51.654 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:48:51.654 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:48:51.654 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:48:51.654 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.655 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.655 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:48:51.655 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:48:51.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.655 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.655 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:48:51.655 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:48:51.655 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.655 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.655 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:48:51.655 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.655 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.656 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.656 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:48:51.656 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:48:51.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.656 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.656 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:48:51.656 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:48:51.656 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.656 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.656 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:48:51.656 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.656 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.657 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.657 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:48:51.657 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:48:51.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.657 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.657 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:48:51.657 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:48:51.657 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.657 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.657 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:48:51.657 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.658 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.658 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:48:51.658 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:48:51.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.658 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.658 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.658 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:48:51.658 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:48:51.658 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.658 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.658 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.658 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:48:51.658 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:48:51.658 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:48:51.658 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:48:51.659 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:48:51.659 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:48:51.659 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:48:51.659 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.659 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.659 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:48:51.659 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:48:51.659 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:48:51.659 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:48:51.659 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:48:51.659 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:48:51.659 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:48:51.659 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:48:51.660 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:48:51.660 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:48:51.660 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:48:51.660 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:48:51.660 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:48:51.660 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.660 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.660 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.660 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:48:51.660 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:48:51.660 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.660 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.660 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.660 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:48:51.660 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:48:51.661 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.661 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.661 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.661 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:48:51.661 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.661 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.661 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:48:51.661 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:48:51.661 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.661 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.661 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.661 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:48:51.661 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:48:51.662 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.662 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.662 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:48:51.662 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.662 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.662 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:48:51.662 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:48:51.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.662 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.662 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.662 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:48:51.662 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:48:51.663 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.663 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.663 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:48:51.663 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.663 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.663 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:48:51.663 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:48:51.663 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.663 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.663 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:48:51.663 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:48:51.664 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.664 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.664 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:48:51.664 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:48:51.664 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:48:51.664 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:48:51.664 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:48:51.664 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:48:51.664 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:48:51.664 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.664 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:48:51.664 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:48:51.665 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:48:51.665 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:48:51.665 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:48:51.665 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:48:51.665 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:48:51.665 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:48:51.665 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:48:51.665 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:48:51.665 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:48:51.665 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:48:51.665 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:48:51.665 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.665 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.666 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:48:51.666 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:48:51.666 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.666 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.666 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.666 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:48:51.666 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:48:51.666 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.666 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.666 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.666 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:48:51.666 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.666 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.666 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.666 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:48:51.667 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:48:51.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.667 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.667 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:48:51.667 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:48:51.667 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.667 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.667 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.667 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:48:51.667 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.667 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.667 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.667 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:48:51.668 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:48:51.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.668 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.668 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:48:51.668 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:48:51.668 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.668 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.668 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:48:51.668 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.668 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.668 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:48:51.668 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:48:51.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.669 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.669 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:48:51.669 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:48:51.669 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.669 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.669 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:48:51.669 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:48:51.669 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:48:51.669 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:48:51.669 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:48:51.669 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:48:51.670 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:48:51.670 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.670 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:48:51.670 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:48:51.670 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:48:51.670 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:48:51.670 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:48:51.670 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:48:51.670 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:48:51.670 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:48:51.670 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:48:51.670 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:48:51.670 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:48:51.671 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:48:51.671 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:48:51.671 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.671 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.671 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.671 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:48:51.671 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:48:51.671 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.671 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.671 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.671 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:48:51.671 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:48:51.671 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.671 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.672 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:48:51.672 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.672 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.672 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:48:51.672 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:48:51.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.672 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.672 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:48:51.672 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:48:51.672 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.672 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.673 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:48:51.673 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.673 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.673 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:48:51.673 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:48:51.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.673 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.673 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:48:51.673 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:48:51.673 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.673 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.674 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:48:51.674 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.674 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.674 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:48:51.674 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:48:51.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.674 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.674 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:48:51.674 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:48:51.674 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.674 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.675 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:48:51.675 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:48:51.675 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:48:51.675 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:48:51.675 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:48:51.675 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:48:51.675 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:48:51.675 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.675 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:48:51.675 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:48:51.675 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:48:51.675 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:48:51.675 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:48:51.676 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:48:51.676 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:48:51.676 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:48:51.676 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:48:51.676 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:48:51.676 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:48:51.676 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:48:51.676 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:48:51.676 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.676 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.676 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.676 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:48:51.676 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:48:51.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.677 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.677 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:48:51.677 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:48:51.677 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.677 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.677 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:48:51.677 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.677 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.677 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:48:51.677 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:48:51.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.678 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.678 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:48:51.678 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:48:51.678 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.678 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.678 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:48:51.678 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.678 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.678 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:48:51.678 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:48:51.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.678 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.679 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:48:51.679 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:48:51.679 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.679 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.679 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:48:51.679 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.679 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.679 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:48:51.679 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:48:51.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.679 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.680 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:48:51.680 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:48:51.680 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.680 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.680 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:48:51.680 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:48:51.680 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:48:51.680 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:48:51.680 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:48:51.680 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:48:51.680 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:48:51.680 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.680 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.681 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:48:51.681 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:48:51.681 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:48:51.681 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:48:51.681 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:48:51.681 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:48:51.681 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:48:51.681 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:48:51.681 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:48:51.681 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:48:51.681 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:48:51.681 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:48:51.681 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:48:51.681 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.681 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.682 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.682 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:48:51.682 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:48:51.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.682 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.682 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:48:51.682 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:48:51.682 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.682 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.682 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:48:51.682 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.682 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.683 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:48:51.683 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:48:51.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.683 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.683 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:48:51.683 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:48:51.683 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.683 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.683 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:48:51.683 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.683 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.683 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:48:51.684 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:48:51.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.684 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.684 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:48:51.684 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:48:51.684 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.684 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.684 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:48:51.684 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.684 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.684 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:48:51.684 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:48:51.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.685 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.685 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.685 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:48:51.685 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:48:51.685 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.685 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.685 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:48:51.685 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:48:51.685 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:48:51.685 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:48:51.685 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:48:51.685 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:48:51.685 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:48:51.686 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.686 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.686 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:48:51.686 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:48:51.686 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:48:51.686 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:48:51.686 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:48:51.686 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:48:51.686 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:48:51.686 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:48:51.686 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:48:51.686 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:48:51.686 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:48:51.686 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:48:51.687 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:48:51.687 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.687 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.687 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:48:51.687 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:48:51.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.687 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.687 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:48:51.687 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:48:51.687 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.687 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.687 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:48:51.688 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.688 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.688 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:48:51.688 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:48:51.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.688 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.688 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:48:51.688 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:48:51.688 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.688 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.688 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:48:51.689 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.689 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.689 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:48:51.689 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:48:51.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.689 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.689 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:48:51.689 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:48:51.689 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.689 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.689 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:48:51.690 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:51.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.690 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:51.690 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:48:51.690 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:48:51.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.690 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:51.690 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:48:51.690 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:48:51.690 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.690 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.690 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:48:51.690 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:48:51.691 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:48:51.691 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:48:51.691 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:48:51.691 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:48:51.691 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:48:51.691 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:51.691 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.691 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:48:51.691 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:48:51.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.691 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:48:51.691 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:48:51.691 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:48:51.692 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:48:51.692 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:48:51.692 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:48:51.692 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:48:51.692 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:48:51.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.692 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:48:51.692 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:48:51.692 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:48:51.692 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:48:51.692 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:48:51.692 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:48:51.692 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:48:51.693 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:48:51.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.693 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:48:51.693 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:48:51.693 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:48:51.693 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:48:51.693 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:48:51.693 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:48:51.693 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:48:51.693 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:48:51.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.693 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:48:51.693 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:48:51.694 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:48:51.694 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:48:51.694 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:48:51.694 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:48:51.694 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:48:51.694 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:48:51.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.694 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:48:51.694 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:48:51.694 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:48:51.694 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:48:51.694 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:48:51.694 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:48:51.694 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:48:51.695 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:48:51.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.695 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:48:51.695 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:48:51.695 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:48:51.695 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:48:51.695 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:48:51.695 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:48:51.695 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:48:51.695 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:48:51.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.695 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:48:51.695 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:48:51.696 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:48:51.696 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:48:51.696 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:48:51.696 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:48:51.696 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:48:51.696 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:48:51.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:51.696 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:48:51.696 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:48:51.696 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:48:51.696 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:48:51.696 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:48:51.696 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:48:51.696 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:48:51.697 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:48:51.697 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.697 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:48:51.697 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:48:51.697 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:48:51.697 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:48:51.697 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:48:51.697 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:48:51.697 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:48:51.697 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:48:51.697 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:48:51.697 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:48:51.697 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:48:51.697 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:48:51.698 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:48:51.698 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:48:51.698 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:48:51.698 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:51.698 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:48:51.698 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:48:51.698 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:48:51.698 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:48:51.698 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:48:51.698 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:48:51.698 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:48:51.698 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:48:51.698 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:48:51.698 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:48:51.699 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:48:51.699 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:51.699 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:48:51.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.628+0000 7fa4e6638640 1 -- 172.21.15.132:0/233835954 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa4c006a430 msgr2=0x7fa4c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:51.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.628+0000 7fa4e6638640 1 --2- 172.21.15.132:0/233835954 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa4c006a430 0x7fa4c006c8f0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7fa4d0039000 tx=0x7fa4d0034000 comp rx=0 tx=0).stop 2023-12-20T04:48:51.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.628+0000 7fa4e6638640 1 -- 172.21.15.132:0/233835954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4e013cce0 msgr2=0x7fa4e00b2930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:51.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.628+0000 7fa4e6638640 1 --2- 172.21.15.132:0/233835954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4e013cce0 0x7fa4e00b2930 secure :-1 s=READY pgs=1392 cs=0 l=1 rev1=1 crypto rx=0x7fa4c800c430 tx=0x7fa4c800c8f0 comp rx=0 tx=0).stop 2023-12-20T04:48:51.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.628+0000 7fa4e6638640 1 -- 172.21.15.132:0/233835954 shutdown_connections 2023-12-20T04:48:51.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.628+0000 7fa4e6638640 1 --2- 172.21.15.132:0/233835954 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa4c006a430 0x7fa4c006c8f0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:51.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.628+0000 7fa4e6638640 1 --2- 172.21.15.132:0/233835954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa4e015a3a0 0x7fa4e0157c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:51.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.628+0000 7fa4e6638640 1 --2- 172.21.15.132:0/233835954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa4e013cce0 0x7fa4e00b2930 unknown :-1 s=CLOSED pgs=1392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:51.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.628+0000 7fa4e6638640 1 --2- 172.21.15.132:0/233835954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa4e00c92d0 0x7fa4e0155be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:51.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.628+0000 7fa4e6638640 1 -- 172.21.15.132:0/233835954 >> 172.21.15.132:0/233835954 conn(0x7fa4e00ced10 msgr2=0x7fa4e013ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:51.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.628+0000 7fa4e6638640 1 -- 172.21.15.132:0/233835954 shutdown_connections 2023-12-20T04:48:51.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:51.628+0000 7fa4e6638640 1 -- 172.21.15.132:0/233835954 wait complete. 2023-12-20T04:48:51.702 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-20T04:48:56.703 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:48:56.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.812+0000 7fbd093d2640 1 Processor -- start 2023-12-20T04:48:56.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.812+0000 7fbd093d2640 1 -- start start 2023-12-20T04:48:56.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.813+0000 7fbd093d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd04160450 0x7fbd04160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:56.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.813+0000 7fbd093d2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbd040b5090 0x7fbd040d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:56.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.813+0000 7fbd093d2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbd040b5ec0 con 0x7fbd041611b0 2023-12-20T04:48:56.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.813+0000 7fbd093d2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbd041617e0 con 0x7fbd040b5090 2023-12-20T04:48:56.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.813+0000 7fbd093d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd040d0fc0 con 0x7fbd04160450 2023-12-20T04:48:56.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.813+0000 7fbd037fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbd040b5090 0x7fbd040d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:56.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.813+0000 7fbd027fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbd041611b0 0x7fbd040b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40768/0 (socket says 172.21.15.132:40768) 2023-12-20T04:48:56.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.813+0000 7fbd027fc640 1 -- 172.21.15.132:0/2795992611 learned_addr learned my addr 172.21.15.132:0/2795992611 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:48:56.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.813+0000 7fbd02ffd640 1 --2- 172.21.15.132:0/2795992611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd04160450 0x7fbd04160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:56.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.814+0000 7fbd037fe640 1 -- 172.21.15.132:0/2795992611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd04160450 msgr2=0x7fbd04160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:48:56.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.814+0000 7fbd037fe640 1 --2- 172.21.15.132:0/2795992611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd04160450 0x7fbd04160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:56.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.814+0000 7fbd037fe640 1 -- 172.21.15.132:0/2795992611 >> v1:172.21.15.132:6789/0 conn(0x7fbd041611b0 legacy=0x7fbd040b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:56.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.814+0000 7fbd037fe640 1 -- 172.21.15.132:0/2795992611 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbd040d12a0 con 0x7fbd040b5090 2023-12-20T04:48:56.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.814+0000 7fbd01ffb640 1 -- 172.21.15.132:0/2795992611 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2035815526 0 0) 0x7fbd040b5ec0 con 0x7fbd041611b0 2023-12-20T04:48:56.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.814+0000 7fbd037fe640 1 --2- 172.21.15.132:0/2795992611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd040b5090 0x7fbd040d1aa0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0097a0 tx=0x7fbcfc02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5950eebc3b90da34 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:56.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.814+0000 7fbd01ffb640 1 -- 172.21.15.132:0/2795992611 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc030610 con 0x7fbd040b5090 2023-12-20T04:48:56.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.815+0000 7fbd01ffb640 1 -- 172.21.15.132:0/2795992611 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcfc030770 con 0x7fbd040b5090 2023-12-20T04:48:56.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.815+0000 7fbd01ffb640 1 -- 172.21.15.132:0/2795992611 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc030b00 con 0x7fbd040b5090 2023-12-20T04:48:56.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.815+0000 7fbd093d2640 1 -- 172.21.15.132:0/2795992611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd040b5090 msgr2=0x7fbd040d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:56.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.815+0000 7fbd093d2640 1 --2- 172.21.15.132:0/2795992611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd040b5090 0x7fbd040d1aa0 secure :-1 s=READY pgs=1394 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0097a0 tx=0x7fbcfc02b960 comp rx=0 tx=0).stop 2023-12-20T04:48:56.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.815+0000 7fbd093d2640 1 -- 172.21.15.132:0/2795992611 shutdown_connections 2023-12-20T04:48:56.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.815+0000 7fbd093d2640 1 --2- 172.21.15.132:0/2795992611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd040b5090 0x7fbd040d1aa0 unknown :-1 s=CLOSED pgs=1394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:56.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.815+0000 7fbd093d2640 1 --2- 172.21.15.132:0/2795992611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd04160450 0x7fbd04160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:56.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.815+0000 7fbd093d2640 1 -- 172.21.15.132:0/2795992611 >> 172.21.15.132:0/2795992611 conn(0x7fbd040cf980 msgr2=0x7fbd040cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:56.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.815+0000 7fbd093d2640 1 -- 172.21.15.132:0/2795992611 shutdown_connections 2023-12-20T04:48:56.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.815+0000 7fbd093d2640 1 -- 172.21.15.132:0/2795992611 wait complete. 2023-12-20T04:48:56.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.816+0000 7fbd093d2640 1 Processor -- start 2023-12-20T04:48:56.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.816+0000 7fbd093d2640 1 -- start start 2023-12-20T04:48:56.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.817+0000 7fbd093d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd040b5090 0x7fbd041f3430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:56.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.817+0000 7fbd093d2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd04160450 0x7fbd041547d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:56.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.817+0000 7fbd093d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd041611b0 0x7fbd040d2560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:56.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.817+0000 7fbd093d2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd0415a010 con 0x7fbd041611b0 2023-12-20T04:48:56.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.817+0000 7fbd093d2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbd041f6a10 con 0x7fbd04160450 2023-12-20T04:48:56.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.817+0000 7fbd093d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbd041f6cf0 con 0x7fbd040b5090 2023-12-20T04:48:56.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.817+0000 7fbd037fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd041611b0 0x7fbd040d2560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:56.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.817+0000 7fbd037fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd041611b0 0x7fbd040d2560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:43662/0 (socket says 172.21.15.132:43662) 2023-12-20T04:48:56.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.817+0000 7fbd037fe640 1 -- 172.21.15.132:0/811595623 learned_addr learned my addr 172.21.15.132:0/811595623 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:48:56.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.817+0000 7fbd02ffd640 1 --2- 172.21.15.132:0/811595623 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd040b5090 0x7fbd041f3430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:56.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.817+0000 7fbd027fc640 1 --2- 172.21.15.132:0/811595623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd04160450 0x7fbd041547d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:56.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.818+0000 7fbd037fe640 1 -- 172.21.15.132:0/811595623 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd040b5090 msgr2=0x7fbd041f3430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:56.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.818+0000 7fbd037fe640 1 --2- 172.21.15.132:0/811595623 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd040b5090 0x7fbd041f3430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:56.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.818+0000 7fbd037fe640 1 -- 172.21.15.132:0/811595623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd04160450 msgr2=0x7fbd041547d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:56.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.818+0000 7fbd037fe640 1 --2- 172.21.15.132:0/811595623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd04160450 0x7fbd041547d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:56.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.818+0000 7fbd037fe640 1 -- 172.21.15.132:0/811595623 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcfc009400 con 0x7fbd041611b0 2023-12-20T04:48:56.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.818+0000 7fbd037fe640 1 --2- 172.21.15.132:0/811595623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd041611b0 0x7fbd040d2560 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0098c0 tx=0x7fbcfc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:56.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.818+0000 7fbceb7fe640 1 -- 172.21.15.132:0/811595623 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc03e040 con 0x7fbd041611b0 2023-12-20T04:48:56.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.818+0000 7fbceb7fe640 1 -- 172.21.15.132:0/811595623 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbcfc039c10 con 0x7fbd041611b0 2023-12-20T04:48:56.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.818+0000 7fbd093d2640 1 -- 172.21.15.132:0/811595623 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbd041f2950 con 0x7fbd041611b0 2023-12-20T04:48:56.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.818+0000 7fbceb7fe640 1 -- 172.21.15.132:0/811595623 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbcfc030e10 con 0x7fbd041611b0 2023-12-20T04:48:56.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.818+0000 7fbd093d2640 1 -- 172.21.15.132:0/811595623 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbd041f2f10 con 0x7fbd041611b0 2023-12-20T04:48:56.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.819+0000 7fbd093d2640 1 -- 172.21.15.132:0/811595623 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbd0404e840 con 0x7fbd041611b0 2023-12-20T04:48:56.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.820+0000 7fbceb7fe640 1 -- 172.21.15.132:0/811595623 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbcfc04d3b0 con 0x7fbd041611b0 2023-12-20T04:48:56.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.820+0000 7fbceb7fe640 1 --2- 172.21.15.132:0/811595623 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbcf006a430 0x7fbcf006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:48:56.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.820+0000 7fbceb7fe640 1 -- 172.21.15.132:0/811595623 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(138..138 src has 1..138) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbcfc0aade0 con 0x7fbd041611b0 2023-12-20T04:48:56.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.820+0000 7fbd02ffd640 1 --2- 172.21.15.132:0/811595623 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbcf006a430 0x7fbcf006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:48:56.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.820+0000 7fbd02ffd640 1 --2- 172.21.15.132:0/811595623 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbcf006a430 0x7fbcf006c8f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fbd04157060 tx=0x7fbcf400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:48:56.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.824+0000 7fbceb7fe640 1 -- 172.21.15.132:0/811595623 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbcfc076480 con 0x7fbd041611b0 2023-12-20T04:48:56.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.993+0000 7fbd093d2640 1 -- 172.21.15.132:0/811595623 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fbd040d0ad0 con 0x7fbd041611b0 2023-12-20T04:48:56.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.994+0000 7fbceb7fe640 1 -- 172.21.15.132:0/811595623 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v138) v1 ==== 81+0+33550 (secure 0 0 0) 0x7fbcfc079aa0 con 0x7fbd041611b0 2023-12-20T04:48:56.996 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:48:56.996 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:48:56.996 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 138, 2023-12-20T04:48:56.996 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:48:56.996 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:48:56.997 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:48:50.899584+0000", 2023-12-20T04:48:56.997 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:48:56.997 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:48:56.997 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:48:56.997 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:48:56.997 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:48:56.997 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:48:56.997 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:48:56.997 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:48:56.998 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:48:56.998 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:48:56.998 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:48:56.998 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:48:56.998 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:48:56.998 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:48:56.998 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:48:56.998 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 17, 2023-12-20T04:48:56.998 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:48:56.998 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:48:56.998 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:48:56.998 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:48:56.998 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:48:56.998 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:48:56.999 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:56.999 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:48:56.999 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:48:56.999 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:48:56.999 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:48:56.999 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:48:56.999 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:48:56.999 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:48:56.999 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:48:56.999 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:48:56.999 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:48:56.999 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:48:56.999 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:48:56.999 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:48:57.000 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:48:57.000 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:48:57.000 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:48:57.000 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:48:57.000 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:48:57.000 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:48:57.000 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:48:57.000 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:48:57.000 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:48:57.000 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:48:57.000 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:48:57.000 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:48:57.000 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:48:57.001 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:48:57.001 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.001 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:48:57.001 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:48:57.001 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:48:57.001 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:48:57.001 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:48:57.001 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:48:57.001 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:48:57.001 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:48:57.001 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:48:57.001 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:48:57.001 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:48:57.001 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:48:57.002 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:48:57.002 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:48:57.002 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:48:57.002 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:48:57.002 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:48:57.002 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:48:57.002 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:48:57.002 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:48:57.002 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:48:57.002 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:48:57.002 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:48:57.002 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:48:57.002 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:48:57.002 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:48:57.003 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:48:57.003 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.003 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:48:57.003 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:48:57.003 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:48:57.003 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:48:57.003 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:48:57.003 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:48:57.003 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:48:57.003 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:48:57.003 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:48:57.003 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:48:57.003 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:48:57.003 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:48:57.004 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:48:57.004 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:48:57.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.004 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:48:57.004 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:48:57.004 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.004 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:48:57.004 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:48:57.004 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:48:57.004 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:48:57.004 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:48:57.004 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:48:57.004 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:48:57.004 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:48:57.005 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:48:57.005 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.005 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.005 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.005 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 16, 2023-12-20T04:48:57.005 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:48:57.005 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:48:35.008751+0000", 2023-12-20T04:48:57.005 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:48:57.005 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:48:57.005 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:48:57.005 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:48:57.005 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:48:57.005 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:48:57.005 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:48:57.006 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:48:57.006 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:48:57.006 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:48:57.006 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:48:57.006 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:48:57.006 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:48:57.006 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:48:57.006 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:48:57.006 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:48:57.006 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:48:57.006 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:48:57.006 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:48:57.006 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:48:57.006 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:48:57.007 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:48:57.007 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:48:57.007 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:48:57.007 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.007 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "136", 2023-12-20T04:48:57.007 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:48:57.007 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:48:57.007 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:48:57.007 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:48:57.007 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:48:57.007 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:48:57.007 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:48:57.007 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:48:57.007 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:48:57.007 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:48:57.008 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:48:57.008 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:48:57.008 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:48:57.008 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:48:57.008 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:48:57.008 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:48:57.008 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:48:57.008 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:48:57.008 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:48:57.008 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:48:57.008 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:48:57.008 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:48:57.008 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:48:57.008 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:48:57.009 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:48:57.009 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:48:57.009 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.009 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:48:57.009 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:48:57.009 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:48:57.009 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:48:57.009 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:48:57.009 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:48:57.009 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:48:57.009 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:48:57.009 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:48:57.009 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:48:57.009 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:48:57.010 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:48:57.010 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:48:57.010 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:48:57.010 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:48:57.010 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.010 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:48:57.010 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:48:57.010 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:48:57.010 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.010 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.010 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:48:57.010 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:48:57.010 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:48:57.010 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:48:57.011 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:48:57.011 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:48:57.011 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:48:57.011 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:48:57.011 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:48:57.011 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.011 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.011 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.011 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 17, 2023-12-20T04:48:57.011 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:48:57.011 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:48:36.182609+0000", 2023-12-20T04:48:57.011 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:48:57.011 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:48:57.011 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:48:57.011 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:48:57.012 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:48:57.012 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:48:57.012 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:48:57.012 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:48:57.012 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:48:57.012 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:48:57.012 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:48:57.012 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:48:57.012 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:48:57.012 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:48:57.012 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:48:57.012 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:48:57.012 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:48:57.012 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:48:57.012 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:48:57.013 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:48:57.013 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:48:57.013 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:48:57.013 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:48:57.013 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:48:57.013 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.013 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "138", 2023-12-20T04:48:57.013 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:48:57.013 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:48:57.013 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:48:57.013 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:48:57.013 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:48:57.013 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:48:57.013 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:48:57.014 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:48:57.014 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:48:57.014 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 33554432, 2023-12-20T04:48:57.014 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:48:57.014 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:48:57.014 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:48:57.014 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:48:57.014 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:48:57.014 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:48:57.014 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:48:57.014 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:48:57.014 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:48:57.014 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:48:57.014 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:48:57.015 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:48:57.015 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:48:57.015 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:48:57.015 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:48:57.015 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:48:57.015 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.015 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:48:57.015 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:48:57.015 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:48:57.015 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:48:57.015 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:48:57.015 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:48:57.015 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:48:57.015 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:48:57.015 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:48:57.016 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:48:57.016 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:48:57.016 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:48:57.016 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:48:57.016 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:48:57.016 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.016 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:48:57.016 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:48:57.016 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:48:57.016 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.016 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.016 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:48:57.016 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:48:57.016 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:48:57.016 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:48:57.017 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:48:57.017 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:48:57.017 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:48:57.017 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:48:57.017 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:48:57.017 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.017 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.017 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:48:57.017 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:48:57.017 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.017 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:48:57.017 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:48:57.018 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:48:57.018 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:48:57.018 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:48:57.018 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:48:57.018 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:48:57.018 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:48:57.018 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:48:57.018 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:48:57.018 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:48:57.018 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:48:57.018 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:48:57.018 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.018 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.018 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.018 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:48:57.018 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:48:57.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.019 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.019 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.019 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:48:57.019 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:48:57.019 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.019 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.019 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:48:57.019 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.019 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.019 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.019 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:48:57.019 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:48:57.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.020 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.020 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:48:57.020 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:48:57.020 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.020 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.020 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.020 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:48:57.020 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.020 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.020 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:48:57.020 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:48:57.020 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.021 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.021 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:48:57.021 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:48:57.021 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.021 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.021 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.021 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:48:57.021 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.021 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.021 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.021 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:48:57.021 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:48:57.021 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.021 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.022 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.022 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:48:57.022 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:48:57.022 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.022 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.022 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.022 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:48:57.022 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:48:57.022 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:48:57.022 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:48:57.022 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:48:57.022 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:48:57.022 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:48:57.022 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.023 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.023 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.023 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:48:57.023 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:48:57.023 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:48:57.023 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:48:57.023 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:48:57.023 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:48:57.023 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:48:57.023 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:48:57.023 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:48:57.023 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:48:57.023 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:48:57.023 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:48:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:48:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:48:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:48:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:48:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:48:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:48:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:48:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:48:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:48:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:48:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:48:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:48:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:48:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:48:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:48:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.027 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:48:57.027 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.027 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.027 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.027 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:48:57.027 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:48:57.027 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.027 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.027 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.027 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:48:57.027 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:48:57.027 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.027 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.027 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.027 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:48:57.028 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:48:57.028 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:48:57.028 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:48:57.028 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:48:57.028 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:48:57.028 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:48:57.028 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.028 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.028 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:48:57.028 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:48:57.028 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:48:57.028 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:48:57.028 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:48:57.028 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:48:57.029 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:48:57.029 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:48:57.029 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:48:57.029 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:48:57.029 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:48:57.029 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:48:57.029 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:48:57.029 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.029 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.029 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:48:57.029 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:48:57.029 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.029 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.030 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.030 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:48:57.030 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:48:57.030 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.030 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.030 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:48:57.030 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.030 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.030 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.030 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:48:57.030 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:48:57.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.030 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.031 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.031 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:48:57.031 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:48:57.031 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.031 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.031 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:48:57.031 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.031 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.031 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.031 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:48:57.031 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:48:57.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.031 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.032 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.032 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:48:57.032 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:48:57.032 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.032 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.032 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.032 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:48:57.032 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.032 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.032 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.032 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:48:57.032 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:48:57.032 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.032 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.033 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.033 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:48:57.033 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:48:57.033 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.033 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.033 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.033 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:48:57.033 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:48:57.033 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:48:57.033 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:48:57.033 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:48:57.033 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:48:57.033 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:48:57.033 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.033 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.034 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.034 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:48:57.034 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:48:57.034 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:48:57.034 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:48:57.034 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:48:57.034 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:48:57.034 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:48:57.034 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:48:57.034 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:48:57.034 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:48:57.034 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:48:57.034 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:48:57.034 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:48:57.035 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.035 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.035 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:48:57.035 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:48:57.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.035 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.035 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:48:57.035 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:48:57.035 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.035 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.035 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:48:57.035 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.036 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.036 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:48:57.036 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:48:57.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.036 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.036 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:48:57.036 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:48:57.036 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.036 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.036 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:48:57.036 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.037 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.037 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.037 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:48:57.037 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:48:57.037 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.037 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.037 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.037 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:48:57.037 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:48:57.037 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.037 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.037 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.037 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:48:57.037 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.037 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.038 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.038 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:48:57.038 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:48:57.038 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.038 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.038 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.038 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:48:57.038 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:48:57.038 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.038 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.038 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.038 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:48:57.038 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:48:57.038 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:48:57.039 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:48:57.039 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:48:57.039 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:48:57.039 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:48:57.039 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.039 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.039 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.039 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:48:57.039 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:48:57.039 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:48:57.039 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:48:57.039 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:48:57.039 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:48:57.039 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:48:57.039 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:48:57.040 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:48:57.040 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:48:57.040 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:48:57.040 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:48:57.040 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:48:57.040 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.040 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.040 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:48:57.040 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:48:57.040 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.040 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.040 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:48:57.040 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:48:57.041 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.041 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.041 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.041 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:48:57.041 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.041 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.041 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.041 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:48:57.041 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:48:57.041 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.041 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.041 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.041 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:48:57.041 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:48:57.042 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.042 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.042 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.042 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:48:57.042 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.042 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.042 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.042 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:48:57.042 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:48:57.042 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.042 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.042 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.042 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:48:57.042 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:48:57.043 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.043 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.043 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.043 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:48:57.043 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.043 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.043 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.043 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:48:57.043 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:48:57.043 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.043 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.043 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.043 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:48:57.043 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:48:57.043 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.044 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.044 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.044 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:48:57.044 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:48:57.044 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:48:57.044 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:48:57.044 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:48:57.044 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:48:57.044 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:48:57.044 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.044 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.044 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.044 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:48:57.044 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:48:57.044 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:48:57.045 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:48:57.045 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:48:57.045 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:48:57.045 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:48:57.045 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:48:57.045 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:48:57.045 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:48:57.045 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:48:57.045 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:48:57.045 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:48:57.045 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.045 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.045 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.045 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:48:57.045 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:48:57.046 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.046 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.046 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.046 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:48:57.046 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:48:57.046 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.046 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.046 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.046 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:48:57.046 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.046 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.046 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.046 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:48:57.047 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:48:57.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.047 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.047 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.047 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:48:57.047 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:48:57.047 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.047 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.047 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:48:57.047 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.047 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.047 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.047 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:48:57.047 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:48:57.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.048 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.048 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:48:57.048 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:48:57.048 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.048 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.048 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:48:57.048 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.048 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.048 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:48:57.048 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:48:57.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.049 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.049 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.049 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:48:57.049 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:48:57.049 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.049 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.049 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.049 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:48:57.049 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:48:57.049 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:48:57.049 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:48:57.049 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:48:57.049 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:48:57.049 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:48:57.050 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.050 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.050 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.050 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:48:57.050 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:48:57.050 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:48:57.050 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:48:57.050 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:48:57.050 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:48:57.050 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:48:57.050 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:48:57.050 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:48:57.050 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:48:57.050 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:48:57.050 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:48:57.051 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:48:57.051 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.051 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.051 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.051 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:48:57.051 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:48:57.051 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.051 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.051 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.051 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:48:57.051 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:48:57.051 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.051 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.051 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.052 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:48:57.052 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.052 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.052 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.052 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:48:57.052 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:48:57.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.052 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.052 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.052 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:48:57.052 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:48:57.052 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.052 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.053 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:48:57.053 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.053 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.053 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.053 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:48:57.053 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:48:57.053 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.053 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.053 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.053 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:48:57.053 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:48:57.053 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.053 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.053 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.054 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:48:57.054 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.054 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.054 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.054 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:48:57.054 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:48:57.054 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.054 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.054 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.054 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:48:57.054 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:48:57.054 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.054 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.054 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.054 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:48:57.055 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:48:57.055 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:48:57.055 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:48:57.055 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:48:57.055 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:48:57.055 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:48:57.055 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.055 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.055 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:48:57.055 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:48:57.055 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:48:57.055 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:48:57.055 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:48:57.056 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:48:57.056 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:48:57.056 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:48:57.056 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:48:57.056 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:48:57.056 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:48:57.056 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:48:57.056 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:48:57.056 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.056 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.056 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.056 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:48:57.056 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:48:57.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.056 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.057 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.057 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:48:57.057 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:48:57.057 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.057 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.057 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.057 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:48:57.057 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.057 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.057 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.057 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:48:57.057 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:48:57.057 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.057 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.058 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.058 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:48:57.058 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:48:57.058 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.058 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.058 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.058 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:48:57.058 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.058 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.058 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.058 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:48:57.058 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:48:57.058 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.058 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.058 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.059 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:48:57.059 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:48:57.059 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.059 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.059 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.059 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:48:57.059 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:48:57.059 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.059 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:48:57.059 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:48:57.059 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:48:57.059 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.059 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.059 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:48:57.060 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:48:57.060 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:48:57.060 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.060 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.060 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.060 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:48:57.060 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:48:57.060 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:48:57.060 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:48:57.060 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:48:57.060 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:48:57.060 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:48:57.060 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:48:57.060 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.060 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:48:57.061 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:48:57.061 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.061 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:48:57.061 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:48:57.061 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:48:57.061 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:48:57.061 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:48:57.061 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:48:57.061 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:48:57.061 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:48:57.061 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.061 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.061 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:48:57.061 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:48:57.062 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:48:57.062 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:48:57.062 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:48:57.062 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:48:57.062 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:48:57.062 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:48:57.062 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.062 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.062 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:48:57.062 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:48:57.062 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:48:57.062 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:48:57.062 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:48:57.062 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:48:57.062 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:48:57.063 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:48:57.063 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.063 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.063 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:48:57.063 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:48:57.063 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:48:57.063 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:48:57.063 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:48:57.063 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:48:57.063 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:48:57.063 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:48:57.063 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.063 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.063 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:48:57.064 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:48:57.064 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:48:57.064 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:48:57.064 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:48:57.064 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:48:57.064 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:48:57.064 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:48:57.064 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.064 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.064 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:48:57.064 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:48:57.064 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:48:57.064 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:48:57.064 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:48:57.065 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:48:57.065 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:48:57.065 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:48:57.065 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.065 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.065 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:48:57.065 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:48:57.065 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:48:57.065 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:48:57.065 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:48:57.065 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:48:57.065 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:48:57.065 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:48:57.065 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.066 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:48:57.066 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:48:57.066 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:48:57.066 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:48:57.066 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:48:57.066 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:48:57.066 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:48:57.066 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:48:57.066 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:48:57.066 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.066 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:48:57.066 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:48:57.066 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:48:57.066 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:48:57.067 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:48:57.067 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:48:57.067 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:48:57.067 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:48:57.067 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:48:57.067 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:48:57.067 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:48:57.067 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:48:57.067 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:48:57.067 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:48:57.067 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:48:57.067 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.067 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:48:57.067 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:48:57.067 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:48:57.068 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:48:57.068 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:48:57.068 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:48:57.068 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:48:57.068 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:48:57.068 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:48:57.068 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:48:57.068 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:48:57.068 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:48:57.068 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:48:57.068 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:48:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.996+0000 7fbd093d2640 1 -- 172.21.15.132:0/811595623 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbcf006a430 msgr2=0x7fbcf006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.996+0000 7fbd093d2640 1 --2- 172.21.15.132:0/811595623 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbcf006a430 0x7fbcf006c8f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7fbd04157060 tx=0x7fbcf400b040 comp rx=0 tx=0).stop 2023-12-20T04:48:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.996+0000 7fbd093d2640 1 -- 172.21.15.132:0/811595623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd041611b0 msgr2=0x7fbd040d2560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:48:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.996+0000 7fbd093d2640 1 --2- 172.21.15.132:0/811595623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd041611b0 0x7fbd040d2560 secure :-1 s=READY pgs=1395 cs=0 l=1 rev1=1 crypto rx=0x7fbcfc0098c0 tx=0x7fbcfc004730 comp rx=0 tx=0).stop 2023-12-20T04:48:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.996+0000 7fbd093d2640 1 -- 172.21.15.132:0/811595623 shutdown_connections 2023-12-20T04:48:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.996+0000 7fbd093d2640 1 --2- 172.21.15.132:0/811595623 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbcf006a430 0x7fbcf006c8f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.996+0000 7fbd093d2640 1 --2- 172.21.15.132:0/811595623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbd041611b0 0x7fbd040d2560 unknown :-1 s=CLOSED pgs=1395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.996+0000 7fbd093d2640 1 --2- 172.21.15.132:0/811595623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbd04160450 0x7fbd041547d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.996+0000 7fbd093d2640 1 --2- 172.21.15.132:0/811595623 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbd040b5090 0x7fbd041f3430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:48:57.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.996+0000 7fbd093d2640 1 -- 172.21.15.132:0/811595623 >> 172.21.15.132:0/811595623 conn(0x7fbd040cf980 msgr2=0x7fbd0415e610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:48:57.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.996+0000 7fbd093d2640 1 -- 172.21.15.132:0/811595623 shutdown_connections 2023-12-20T04:48:57.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:48:56.996+0000 7fbd093d2640 1 -- 172.21.15.132:0/811595623 wait complete. 2023-12-20T04:48:57.071 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-20T04:49:02.072 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:49:02.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.182+0000 7f902822c640 1 Processor -- start 2023-12-20T04:49:02.184 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.183+0000 7f902822c640 1 -- start start 2023-12-20T04:49:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.183+0000 7f902822c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9020159b50 0x7f90200c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.183+0000 7f902822c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f902015e530 0x7f902006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.183+0000 7f902822c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f902006c240 0x7f902006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.183+0000 7f902822c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f902006cc10 con 0x7f902006c240 2023-12-20T04:49:02.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.183+0000 7f902822c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f90200caa60 con 0x7f9020159b50 2023-12-20T04:49:02.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.183+0000 7f902822c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90200ccc90 con 0x7f902015e530 2023-12-20T04:49:02.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.184+0000 7f90267c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f902006c240 0x7f902006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:02.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.184+0000 7f90267c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f902006c240 0x7f902006c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49854/0 (socket says 172.21.15.132:49854) 2023-12-20T04:49:02.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.184+0000 7f90267c9640 1 -- 172.21.15.132:0/3795664300 learned_addr learned my addr 172.21.15.132:0/3795664300 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:02.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.184+0000 7f9025fc8640 1 --2- 172.21.15.132:0/3795664300 >> v2:172.21.15.187:3300/0 conn(0x7f9020159b50 0x7f90200c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:02.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.184+0000 7f90257c7640 1 --2- 172.21.15.132:0/3795664300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f902015e530 0x7f902006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:02.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.184+0000 7f90267c9640 1 -- 172.21.15.132:0/3795664300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f902015e530 msgr2=0x7f902006fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:02.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.184+0000 7f90267c9640 1 --2- 172.21.15.132:0/3795664300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f902015e530 0x7f902006fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.184+0000 7f90267c9640 1 -- 172.21.15.132:0/3795664300 >> v2:172.21.15.187:3300/0 conn(0x7f9020159b50 msgr2=0x7f90200c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:02.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.184+0000 7f90267c9640 1 --2- 172.21.15.132:0/3795664300 >> v2:172.21.15.187:3300/0 conn(0x7f9020159b50 0x7f90200c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.184+0000 7f90267c9640 1 -- 172.21.15.132:0/3795664300 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90200ccf30 con 0x7f902006c240 2023-12-20T04:49:02.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.185+0000 7f90267c9640 1 --2- 172.21.15.132:0/3795664300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f902006c240 0x7f902006c6d0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f90200b18a0 tx=0x7f901002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75f7e71774eb948b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:02.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.185+0000 7f9024fc6640 1 -- 172.21.15.132:0/3795664300 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9010031870 con 0x7f902006c240 2023-12-20T04:49:02.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.185+0000 7f9024fc6640 1 -- 172.21.15.132:0/3795664300 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f90100319d0 con 0x7f902006c240 2023-12-20T04:49:02.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.185+0000 7f9024fc6640 1 -- 172.21.15.132:0/3795664300 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9010031d60 con 0x7f902006c240 2023-12-20T04:49:02.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.185+0000 7f902822c640 1 -- 172.21.15.132:0/3795664300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f902006c240 msgr2=0x7f902006c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:02.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.185+0000 7f902822c640 1 --2- 172.21.15.132:0/3795664300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f902006c240 0x7f902006c6d0 secure :-1 s=READY pgs=1396 cs=0 l=1 rev1=1 crypto rx=0x7f90200b18a0 tx=0x7f901002b910 comp rx=0 tx=0).stop 2023-12-20T04:49:02.192 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.185+0000 7f902822c640 1 -- 172.21.15.132:0/3795664300 shutdown_connections 2023-12-20T04:49:02.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.185+0000 7f902822c640 1 --2- 172.21.15.132:0/3795664300 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f902006c240 0x7f902006c6d0 unknown :-1 s=CLOSED pgs=1396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.185+0000 7f902822c640 1 --2- 172.21.15.132:0/3795664300 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f902015e530 0x7f902006fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.185+0000 7f902822c640 1 --2- 172.21.15.132:0/3795664300 >> v2:172.21.15.187:3300/0 conn(0x7f9020159b50 0x7f90200c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.185+0000 7f902822c640 1 -- 172.21.15.132:0/3795664300 >> 172.21.15.132:0/3795664300 conn(0x7f90200ced10 msgr2=0x7f90200cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:02.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.185+0000 7f902822c640 1 -- 172.21.15.132:0/3795664300 shutdown_connections 2023-12-20T04:49:02.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.185+0000 7f902822c640 1 -- 172.21.15.132:0/3795664300 wait complete. 2023-12-20T04:49:02.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.187+0000 7f902822c640 1 Processor -- start 2023-12-20T04:49:02.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.187+0000 7f902822c640 1 -- start start 2023-12-20T04:49:02.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.187+0000 7f902822c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f902006c240 0x7f9020151d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:02.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.187+0000 7f902822c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9020159b50 0x7f9020155810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:02.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.187+0000 7f902822c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f902015e530 0x7f90200c3fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:02.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.187+0000 7f902822c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90200c3b30 con 0x7f902006c240 2023-12-20T04:49:02.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.187+0000 7f902822c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f90200c2f20 con 0x7f9020159b50 2023-12-20T04:49:02.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.187+0000 7f902822c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f90200c3200 con 0x7f902015e530 2023-12-20T04:49:02.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.187+0000 7f9025fc8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f902006c240 0x7f9020151d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:02.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.187+0000 7f9025fc8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f902006c240 0x7f9020151d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49866/0 (socket says 172.21.15.132:49866) 2023-12-20T04:49:02.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.187+0000 7f9025fc8640 1 -- 172.21.15.132:0/24922474 learned_addr learned my addr 172.21.15.132:0/24922474 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:02.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.188+0000 7f90257c7640 1 --2- 172.21.15.132:0/24922474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9020159b50 0x7f9020155810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:02.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.188+0000 7f90267c9640 1 --2- 172.21.15.132:0/24922474 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f902015e530 0x7f90200c3fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:02.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.188+0000 7f9025fc8640 1 -- 172.21.15.132:0/24922474 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f902015e530 msgr2=0x7f90200c3fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:02.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.188+0000 7f9025fc8640 1 --2- 172.21.15.132:0/24922474 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f902015e530 0x7f90200c3fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.188+0000 7f9025fc8640 1 -- 172.21.15.132:0/24922474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9020159b50 msgr2=0x7f9020155810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:02.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.188+0000 7f9025fc8640 1 --2- 172.21.15.132:0/24922474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9020159b50 0x7f9020155810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.188+0000 7f9025fc8640 1 -- 172.21.15.132:0/24922474 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90100094d0 con 0x7f902006c240 2023-12-20T04:49:02.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.188+0000 7f9025fc8640 1 --2- 172.21.15.132:0/24922474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f902006c240 0x7f9020151d70 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f901800efc0 tx=0x7f901800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:02.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.188+0000 7f901e7fc640 1 -- 172.21.15.132:0/24922474 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018014480 con 0x7f902006c240 2023-12-20T04:49:02.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.188+0000 7f901e7fc640 1 -- 172.21.15.132:0/24922474 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f901800f040 con 0x7f902006c240 2023-12-20T04:49:02.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.188+0000 7f902822c640 1 -- 172.21.15.132:0/24922474 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f90200c34e0 con 0x7f902006c240 2023-12-20T04:49:02.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.188+0000 7f901e7fc640 1 -- 172.21.15.132:0/24922474 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9018014800 con 0x7f902006c240 2023-12-20T04:49:02.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.188+0000 7f902822c640 1 -- 172.21.15.132:0/24922474 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f90201522b0 con 0x7f902006c240 2023-12-20T04:49:02.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.189+0000 7f902822c640 1 -- 172.21.15.132:0/24922474 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f902004e840 con 0x7f902006c240 2023-12-20T04:49:02.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.189+0000 7f901e7fc640 1 -- 172.21.15.132:0/24922474 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9018014960 con 0x7f902006c240 2023-12-20T04:49:02.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.190+0000 7f901e7fc640 1 --2- 172.21.15.132:0/24922474 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f900c06a430 0x7f900c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:02.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.190+0000 7f901e7fc640 1 -- 172.21.15.132:0/24922474 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9018089590 con 0x7f902006c240 2023-12-20T04:49:02.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.190+0000 7f90257c7640 1 --2- 172.21.15.132:0/24922474 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f900c06a430 0x7f900c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:02.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.190+0000 7f901e7fc640 1 -- 172.21.15.132:0/24922474 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=140}) v3 -- 0x7f900c071f60 con 0x7f902006c240 2023-12-20T04:49:02.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.190+0000 7f90257c7640 1 --2- 172.21.15.132:0/24922474 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f900c06a430 0x7f900c06c8f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f90201529d0 tx=0x7f9014008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:02.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.194+0000 7f901e7fc640 1 -- 172.21.15.132:0/24922474 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9018054b80 con 0x7f902006c240 2023-12-20T04:49:02.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.362+0000 7f902822c640 1 -- 172.21.15.132:0/24922474 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f902015cf60 con 0x7f902006c240 2023-12-20T04:49:02.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.363+0000 7f901e7fc640 1 -- 172.21.15.132:0/24922474 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+33569 (secure 0 0 0) 0x7f90180581a0 con 0x7f902006c240 2023-12-20T04:49:02.365 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:02.366 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:49:02.366 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 139, 2023-12-20T04:49:02.366 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:49:02.366 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:49:02.366 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:48:59.853998+0000", 2023-12-20T04:49:02.366 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:49:02.366 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:49:02.366 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:49:02.366 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:49:02.366 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:49:02.366 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:49:02.366 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:49:02.366 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:49:02.366 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:49:02.366 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:02.367 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:49:02.367 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:49:02.367 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:49:02.367 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:49:02.367 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:49:02.367 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 17, 2023-12-20T04:49:02.367 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:49:02.367 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:49:02.367 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:49:02.367 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:49:02.367 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:49:02.367 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:49:02.367 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.367 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:49:02.367 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:49:02.368 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:49:02.368 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:49:02.368 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:49:02.368 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:02.368 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:02.368 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:02.368 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:02.368 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:02.368 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:02.368 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:02.368 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:02.368 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:02.368 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:02.368 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:49:02.368 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:49:02.369 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:49:02.369 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:49:02.369 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:49:02.369 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:02.369 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:02.369 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:02.369 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:02.369 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:02.369 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:02.369 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:02.369 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.369 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:49:02.369 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:02.369 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:02.369 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:02.370 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:02.370 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:02.370 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:02.370 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:02.370 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:02.370 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:02.370 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:49:02.370 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:02.370 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:02.370 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:02.370 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:02.370 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:02.370 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:02.370 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:02.370 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:02.371 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:02.371 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:02.371 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:02.371 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:02.371 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:02.371 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:02.371 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:02.371 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:02.371 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.371 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:02.371 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:02.371 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:02.371 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:02.371 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:02.371 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:02.371 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:02.372 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:02.372 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:02.372 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:02.372 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:02.372 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:02.372 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:49:02.372 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:49:02.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.372 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:02.372 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:49:02.372 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.372 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:02.372 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:49:02.372 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:49:02.372 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:49:02.373 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:49:02.373 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:49:02.373 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:02.373 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:02.373 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:02.373 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.373 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.373 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.373 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 16, 2023-12-20T04:49:02.373 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:49:02.373 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:48:35.008751+0000", 2023-12-20T04:49:02.373 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:49:02.373 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:49:02.373 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:02.373 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:02.374 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:02.374 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:02.374 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:02.374 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:02.374 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:02.374 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:02.374 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:02.374 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:02.374 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:49:02.374 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:49:02.374 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:49:02.374 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:49:02.374 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:49:02.374 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:02.374 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:02.374 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:02.375 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:02.375 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:02.375 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:02.375 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:02.375 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.375 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "136", 2023-12-20T04:49:02.375 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:02.375 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:02.375 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:02.375 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:02.375 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:02.375 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:02.375 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:02.375 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:02.375 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:02.375 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:49:02.376 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:02.376 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:02.376 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:02.376 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:02.376 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:02.376 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:02.376 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:02.376 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:02.376 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:02.376 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:02.376 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:02.376 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:02.376 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:02.376 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:02.376 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:02.376 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:02.377 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.377 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:02.377 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:02.377 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:02.377 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:02.377 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:02.377 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:02.377 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:02.377 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:02.377 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:02.377 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:02.377 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:02.377 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:02.377 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:49:02.377 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:49:02.378 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:49:02.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.378 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:02.378 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:49:02.378 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:49:02.378 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.378 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.378 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:02.378 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:49:02.378 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:49:02.378 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:49:02.378 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:49:02.378 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:49:02.378 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:02.378 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:02.378 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:02.379 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.379 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.379 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.379 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 17, 2023-12-20T04:49:02.379 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:49:02.379 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:48:36.182609+0000", 2023-12-20T04:49:02.379 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1027, 2023-12-20T04:49:02.379 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-20T04:49:02.379 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:02.379 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:02.379 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:02.379 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:02.379 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:02.379 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:02.379 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:02.379 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:02.380 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:02.380 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:02.380 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:49:02.380 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:49:02.380 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:49:02.380 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:49:02.380 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:49:02.380 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:02.380 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:02.380 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:02.380 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:02.380 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:02.380 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:02.380 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:02.380 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.381 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "139", 2023-12-20T04:49:02.381 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:02.381 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:02.381 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:02.381 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:02.381 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:02.381 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:02.381 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:02.381 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:02.381 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:02.381 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 33554432, 2023-12-20T04:49:02.381 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:02.381 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:02.381 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:02.382 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:02.382 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:02.382 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:02.382 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:02.382 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:02.382 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:02.382 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:02.382 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:02.382 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:02.382 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:02.382 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:02.382 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:02.382 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:02.382 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.382 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:02.382 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:02.382 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:02.383 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:02.383 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:02.383 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:02.383 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:02.383 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:02.383 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:02.383 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:02.383 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:02.383 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:02.383 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:49:02.383 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:49:02.383 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.383 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:02.383 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:49:02.383 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:49:02.384 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.384 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.384 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:02.384 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:49:02.384 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:49:02.384 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:49:02.384 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:49:02.384 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:49:02.384 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:02.384 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:02.384 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:02.384 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.384 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.384 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:02.384 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:49:02.384 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.384 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:49:02.385 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:02.385 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:02.385 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:02.385 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:02.385 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:02.385 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:02.385 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:02.385 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:02.385 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:02.385 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:02.385 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:02.385 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:02.385 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.385 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.386 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.386 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:49:02.386 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:02.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.386 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.386 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:49:02.386 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:02.386 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.386 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.386 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.386 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:02.386 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.386 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.386 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.387 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:49:02.387 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:02.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.387 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.387 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:49:02.387 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:02.387 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.387 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.387 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.387 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:02.387 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.387 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.387 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.387 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:49:02.387 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:02.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.388 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.388 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:49:02.388 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:02.388 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.388 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.388 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:02.388 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.388 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.388 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:49:02.388 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:02.388 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.388 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.389 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.389 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:49:02.389 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:02.389 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.389 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.389 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.389 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:49:02.389 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:49:02.389 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:49:02.389 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:49:02.389 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:02.389 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:02.389 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:02.389 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.390 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.390 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.390 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:49:02.390 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:02.390 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:02.390 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:02.390 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:02.390 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:02.390 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:02.390 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:02.390 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:02.390 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:02.390 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:02.390 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:02.390 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:02.390 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.391 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.391 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:49:02.391 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:02.391 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.391 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.391 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:49:02.391 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:02.391 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.391 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.391 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.391 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:02.391 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.391 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.391 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:49:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:49:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:49:02.392 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:02.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.393 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.393 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:49:02.393 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:02.393 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.393 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.393 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.393 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:02.393 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.393 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.393 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.393 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:49:02.393 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:49:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:49:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:49:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:49:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:49:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:02.394 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:49:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:02.395 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.396 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.396 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.396 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:49:02.396 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:02.396 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.396 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.396 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.396 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:49:02.396 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:02.396 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.396 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.396 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.396 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:02.396 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.396 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.397 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.397 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:49:02.397 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:02.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.397 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.397 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:49:02.397 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:02.397 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.397 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.397 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.397 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:02.397 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.397 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.397 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:49:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:49:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:49:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:02.398 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.399 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.399 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.399 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:49:02.399 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:02.399 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.399 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.399 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.399 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:49:02.399 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:49:02.399 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:49:02.399 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:49:02.399 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:02.399 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:02.399 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:02.399 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.400 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.400 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:49:02.400 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:02.400 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:02.400 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:02.400 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:02.400 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:02.400 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:02.400 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:02.400 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:02.400 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:02.400 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:02.400 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:02.400 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:02.401 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.401 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.401 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.401 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:49:02.401 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:02.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.401 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.401 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.401 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:49:02.401 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:02.401 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.401 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.401 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.401 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:02.401 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:49:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:49:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.402 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:49:02.403 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:02.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.403 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.403 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:49:02.403 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:02.403 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.403 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.403 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.403 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:02.403 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.403 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.403 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.403 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:49:02.403 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:02.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.404 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.404 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.404 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:49:02.404 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:02.404 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.404 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.404 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:49:02.404 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:49:02.404 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:49:02.404 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:49:02.404 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:02.404 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:02.404 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:02.404 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.405 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.405 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:49:02.405 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:02.405 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:02.405 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:02.405 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:02.405 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:02.405 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:02.405 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:02.405 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:02.405 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:02.405 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:02.405 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:02.405 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:02.406 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.406 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.406 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.406 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:49:02.406 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:02.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.406 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.406 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.406 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:49:02.406 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:02.406 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.406 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.406 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:02.406 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.407 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.407 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:49:02.407 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:02.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.407 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.407 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:49:02.407 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:02.407 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.407 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.407 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:02.407 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.407 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.407 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.408 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:49:02.408 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:02.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.408 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.408 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:49:02.408 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:02.408 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.408 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.408 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.408 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:02.408 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.408 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.408 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.409 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:49:02.409 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:02.409 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.409 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.409 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.409 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:49:02.409 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:02.409 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.409 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.409 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.409 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:49:02.409 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:49:02.409 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:49:02.409 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:49:02.410 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:02.410 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:02.410 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:02.410 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.410 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.410 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:49:02.410 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:02.410 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:02.410 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:02.410 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:02.410 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:02.410 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:02.410 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:02.411 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:02.411 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:02.411 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:02.411 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:02.411 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:02.411 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.411 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.411 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:49:02.411 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:02.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.411 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.411 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:49:02.411 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:02.411 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.412 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.412 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:02.412 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.412 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.412 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:49:02.412 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:02.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.412 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.412 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.412 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:49:02.412 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:02.412 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.412 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.412 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.413 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:02.413 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.413 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.413 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.413 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:49:02.413 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:02.413 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.413 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.413 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.413 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:49:02.413 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:02.413 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.413 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.413 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.413 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:02.414 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.414 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.414 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.414 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:49:02.414 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:02.414 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.414 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.414 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.414 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:49:02.414 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:02.414 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.414 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.414 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.414 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:49:02.414 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:49:02.414 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:49:02.414 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:49:02.415 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:02.415 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:02.415 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:02.415 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.415 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.415 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.415 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:49:02.415 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:02.415 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:02.415 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:02.415 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:02.415 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:02.415 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:02.415 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:02.415 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:02.415 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:02.416 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:02.416 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:02.416 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:02.416 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.416 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.416 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:49:02.416 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:02.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.416 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.416 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.416 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:49:02.416 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:02.416 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.416 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.417 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:02.417 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.417 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.417 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:49:02.417 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:02.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.417 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.417 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:49:02.417 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:02.417 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.417 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.417 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.418 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:02.418 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.418 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.418 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:49:02.418 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:02.418 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.418 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.418 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:49:02.418 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:02.418 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.418 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.418 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.418 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:02.419 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.419 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.419 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:49:02.419 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:02.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.419 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.419 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:49:02.419 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:02.419 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.419 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.419 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:49:02.419 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:49:02.419 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:49:02.420 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:49:02.420 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:02.420 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:02.420 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:02.420 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.420 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.420 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.420 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:49:02.420 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:02.420 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:02.420 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:02.420 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:02.420 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:02.420 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:02.420 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:02.421 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:02.421 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:02.421 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:02.421 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:02.421 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:02.421 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.421 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.421 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:49:02.421 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:02.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.421 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.421 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:49:02.421 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:02.422 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.422 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.422 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:02.422 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.422 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.422 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:49:02.422 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:02.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.422 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.422 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:49:02.422 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:02.422 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.422 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:49:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:49:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.423 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:49:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:49:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:49:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:49:02.424 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:49:02.425 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:49:02.425 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:02.425 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:02.425 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:02.425 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.425 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.425 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:02.425 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:49:02.425 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.425 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:49:02.425 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:02.425 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:02.425 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:02.425 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:02.426 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:02.426 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:49:02.426 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:02.426 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.426 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.426 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:49:02.426 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:02.426 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:02.426 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:02.426 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:02.426 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:02.426 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:49:02.426 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:02.426 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.426 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.427 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:49:02.427 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:02.427 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:02.427 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:02.427 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:02.427 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:02.427 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:49:02.427 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:02.427 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.427 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.427 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:49:02.427 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:02.427 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:02.427 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:02.427 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:02.428 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:02.428 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:49:02.428 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:02.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.428 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:49:02.428 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:02.428 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:02.428 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:02.428 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:02.428 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:02.428 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:49:02.428 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:02.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.429 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:49:02.429 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:02.429 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:02.429 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:02.429 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:02.429 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:02.429 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:49:02.429 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:02.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.429 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:49:02.429 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:02.429 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:02.429 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:02.429 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:02.430 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:02.430 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:49:02.430 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:02.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.430 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:49:02.430 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:02.430 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:02.430 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:02.430 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:02.430 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:02.430 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:49:02.430 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:02.430 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.431 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:02.431 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:49:02.431 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:49:02.431 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:49:02.431 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:49:02.431 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:49:02.431 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:49:02.431 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:49:02.431 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:49:02.431 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:49:02.431 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:49:02.431 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:49:02.431 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:49:02.431 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:49:02.431 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:49:02.432 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.432 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:49:02.432 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:49:02.432 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:49:02.432 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:49:02.432 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:49:02.432 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:49:02.432 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:49:02.432 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:49:02.432 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:49:02.432 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:49:02.432 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:49:02.432 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.432 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:49:02.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.365+0000 7f902822c640 1 -- 172.21.15.132:0/24922474 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f900c06a430 msgr2=0x7f900c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:02.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.365+0000 7f902822c640 1 --2- 172.21.15.132:0/24922474 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f900c06a430 0x7f900c06c8f0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f90201529d0 tx=0x7f9014008040 comp rx=0 tx=0).stop 2023-12-20T04:49:02.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.365+0000 7f902822c640 1 -- 172.21.15.132:0/24922474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f902006c240 msgr2=0x7f9020151d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:02.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.365+0000 7f902822c640 1 --2- 172.21.15.132:0/24922474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f902006c240 0x7f9020151d70 secure :-1 s=READY pgs=1397 cs=0 l=1 rev1=1 crypto rx=0x7f901800efc0 tx=0x7f901800c490 comp rx=0 tx=0).stop 2023-12-20T04:49:02.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.365+0000 7f902822c640 1 -- 172.21.15.132:0/24922474 shutdown_connections 2023-12-20T04:49:02.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.365+0000 7f902822c640 1 --2- 172.21.15.132:0/24922474 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f900c06a430 0x7f900c06c8f0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.365+0000 7f902822c640 1 --2- 172.21.15.132:0/24922474 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f902015e530 0x7f90200c3fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.365+0000 7f902822c640 1 --2- 172.21.15.132:0/24922474 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9020159b50 0x7f9020155810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.365+0000 7f902822c640 1 --2- 172.21.15.132:0/24922474 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f902006c240 0x7f9020151d70 unknown :-1 s=CLOSED pgs=1397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.365+0000 7f902822c640 1 -- 172.21.15.132:0/24922474 >> 172.21.15.132:0/24922474 conn(0x7f90200ced10 msgr2=0x7f90200b21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:02.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.365+0000 7f902822c640 1 -- 172.21.15.132:0/24922474 shutdown_connections 2023-12-20T04:49:02.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.365+0000 7f902822c640 1 -- 172.21.15.132:0/24922474 wait complete. 2023-12-20T04:49:02.435 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-20T04:49:02.436 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:49:02.436 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:49:02.451 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:02.451 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-12-20T04:49:02.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:49:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:dd: error writing 'large_file_b': No space left on device 2023-12-20T04:49:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:dd: closing output file 'large_file_b': No space left on device 2023-12-20T04:49:02.553 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:49:02.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.650+0000 7f72ad7c9640 1 Processor -- start 2023-12-20T04:49:02.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.650+0000 7f72ad7c9640 1 -- start start 2023-12-20T04:49:02.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.651+0000 7f72ad7c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f72a806c240 0x7f72a806c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:02.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.651+0000 7f72ad7c9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a80ccf30 con 0x7f72a815e530 2023-12-20T04:49:02.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.651+0000 7f72ad7c9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f72a80ca1c0 con 0x7f72a8159b50 2023-12-20T04:49:02.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.651+0000 7f72ad7c9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f72a806cc10 con 0x7f72a806c240 2023-12-20T04:49:02.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.651+0000 7f72a77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f72a806c240 0x7f72a806c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:02.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.651+0000 7f72a67fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f72a815e530 0x7f72a806fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60080/0 (socket says 172.21.15.132:60080) 2023-12-20T04:49:02.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.651+0000 7f72a67fc640 1 -- 172.21.15.132:0/2652133051 learned_addr learned my addr 172.21.15.132:0/2652133051 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:02.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.651+0000 7f72a77fe640 1 -- 172.21.15.132:0/2652133051 >> v1:172.21.15.187:6789/0 conn(0x7f72a8159b50 legacy=0x7f72a80c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:02.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.651+0000 7f72a77fe640 1 -- 172.21.15.132:0/2652133051 >> v1:172.21.15.132:6789/0 conn(0x7f72a815e530 legacy=0x7f72a806fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:02.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.651+0000 7f72a77fe640 1 -- 172.21.15.132:0/2652133051 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a80ca4a0 con 0x7f72a806c240 2023-12-20T04:49:02.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.651+0000 7f72a5ffb640 1 -- 172.21.15.132:0/2652133051 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2383659526 0 0) 0x7f72a80ccf30 con 0x7f72a815e530 2023-12-20T04:49:02.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.652+0000 7f72a77fe640 1 --2- 172.21.15.132:0/2652133051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72a806c240 0x7f72a806c6d0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009dc0 tx=0x7f72a002bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aede588253931dc9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:02.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.652+0000 7f72a5ffb640 1 -- 172.21.15.132:0/2652133051 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a002ccd0 con 0x7f72a806c240 2023-12-20T04:49:02.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.652+0000 7f72a5ffb640 1 -- 172.21.15.132:0/2652133051 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f72a002ce30 con 0x7f72a806c240 2023-12-20T04:49:02.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.652+0000 7f72a5ffb640 1 -- 172.21.15.132:0/2652133051 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72a0034660 con 0x7f72a806c240 2023-12-20T04:49:02.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.653+0000 7f72ad7c9640 1 -- 172.21.15.132:0/2652133051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72a806c240 msgr2=0x7f72a806c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:02.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.653+0000 7f72ad7c9640 1 --2- 172.21.15.132:0/2652133051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72a806c240 0x7f72a806c6d0 secure :-1 s=READY pgs=1399 cs=0 l=1 rev1=1 crypto rx=0x7f72a0009dc0 tx=0x7f72a002bf20 comp rx=0 tx=0).stop 2023-12-20T04:49:02.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.653+0000 7f72ad7c9640 1 -- 172.21.15.132:0/2652133051 shutdown_connections 2023-12-20T04:49:02.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.653+0000 7f72ad7c9640 1 --2- 172.21.15.132:0/2652133051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72a806c240 0x7f72a806c6d0 unknown :-1 s=CLOSED pgs=1399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.653+0000 7f72ad7c9640 1 -- 172.21.15.132:0/2652133051 >> 172.21.15.132:0/2652133051 conn(0x7f72a80ced10 msgr2=0x7f72a80cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:02.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.653+0000 7f72ad7c9640 1 -- 172.21.15.132:0/2652133051 shutdown_connections 2023-12-20T04:49:02.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.653+0000 7f72ad7c9640 1 -- 172.21.15.132:0/2652133051 wait complete. 2023-12-20T04:49:02.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.654+0000 7f72ad7c9640 1 Processor -- start 2023-12-20T04:49:02.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.654+0000 7f72ad7c9640 1 -- start start 2023-12-20T04:49:02.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72ad7c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72a806c240 0x7f72a81ef280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:02.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72ad7c9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72a8159b50 0x7f72a81ef7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:02.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72ad7c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72a815e530 0x7f72a81efd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:02.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72ad7c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a80b2920 con 0x7f72a806c240 2023-12-20T04:49:02.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72ad7c9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72a8151390 con 0x7f72a8159b50 2023-12-20T04:49:02.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72ad7c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f72a8151670 con 0x7f72a815e530 2023-12-20T04:49:02.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72a6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72a806c240 0x7f72a81ef280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:02.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72a6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72a806c240 0x7f72a81ef280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49886/0 (socket says 172.21.15.132:49886) 2023-12-20T04:49:02.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72a6ffd640 1 -- 172.21.15.132:0/415093443 learned_addr learned my addr 172.21.15.132:0/415093443 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:02.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72a77fe640 1 --2- 172.21.15.132:0/415093443 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72a815e530 0x7f72a81efd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:02.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72a67fc640 1 --2- 172.21.15.132:0/415093443 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72a8159b50 0x7f72a81ef7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:02.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72a6ffd640 1 -- 172.21.15.132:0/415093443 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72a815e530 msgr2=0x7f72a81efd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:02.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72a6ffd640 1 --2- 172.21.15.132:0/415093443 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72a815e530 0x7f72a81efd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72a6ffd640 1 -- 172.21.15.132:0/415093443 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72a8159b50 msgr2=0x7f72a81ef7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:02.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72a6ffd640 1 --2- 172.21.15.132:0/415093443 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72a8159b50 0x7f72a81ef7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72a6ffd640 1 -- 172.21.15.132:0/415093443 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a0009a70 con 0x7f72a806c240 2023-12-20T04:49:02.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72a6ffd640 1 --2- 172.21.15.132:0/415093443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72a806c240 0x7f72a81ef280 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f729800c450 tx=0x7f729800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:02.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f728f7fe640 1 -- 172.21.15.132:0/415093443 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f72980052d0 con 0x7f72a806c240 2023-12-20T04:49:02.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f728f7fe640 1 -- 172.21.15.132:0/415093443 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7298005430 con 0x7f72a806c240 2023-12-20T04:49:02.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72ad7c9640 1 -- 172.21.15.132:0/415093443 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72a8151950 con 0x7f72a806c240 2023-12-20T04:49:02.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f728f7fe640 1 -- 172.21.15.132:0/415093443 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7298012870 con 0x7f72a806c240 2023-12-20T04:49:02.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.655+0000 7f72ad7c9640 1 -- 172.21.15.132:0/415093443 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72a81f0240 con 0x7f72a806c240 2023-12-20T04:49:02.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.656+0000 7f72ad7c9640 1 -- 172.21.15.132:0/415093443 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72a804e840 con 0x7f72a806c240 2023-12-20T04:49:02.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.657+0000 7f728f7fe640 1 -- 172.21.15.132:0/415093443 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f72980129d0 con 0x7f72a806c240 2023-12-20T04:49:02.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.657+0000 7f728f7fe640 1 --2- 172.21.15.132:0/415093443 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f729406a430 0x7f729406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:02.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.657+0000 7f728f7fe640 1 -- 172.21.15.132:0/415093443 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f72980883f0 con 0x7f72a806c240 2023-12-20T04:49:02.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.657+0000 7f72a67fc640 1 --2- 172.21.15.132:0/415093443 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f729406a430 0x7f729406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:02.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.657+0000 7f728f7fe640 1 -- 172.21.15.132:0/415093443 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=140}) v3 -- 0x7f7294071f60 con 0x7f72a806c240 2023-12-20T04:49:02.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.658+0000 7f72a67fc640 1 --2- 172.21.15.132:0/415093443 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f729406a430 0x7f729406c8f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f72a81f0600 tx=0x7f729c007b90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:02.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.661+0000 7f728f7fe640 1 -- 172.21.15.132:0/415093443 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7298053a70 con 0x7f72a806c240 2023-12-20T04:49:02.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.827+0000 7f72ad7c9640 1 -- 172.21.15.132:0/415093443 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f72a80b4c90 con 0x7f72a806c240 2023-12-20T04:49:02.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.828+0000 7f728f7fe640 1 -- 172.21.15.132:0/415093443 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+33569 (secure 0 0 0) 0x7f7298057090 con 0x7f72a806c240 2023-12-20T04:49:02.830 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:02.830 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:49:02.830 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 139, 2023-12-20T04:49:02.831 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:49:02.831 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:49:02.831 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:48:59.853998+0000", 2023-12-20T04:49:02.831 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:49:02.831 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:49:02.831 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:49:02.831 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:49:02.831 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:49:02.831 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:49:02.831 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:49:02.831 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:49:02.831 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:49:02.831 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:02.831 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:49:02.832 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:49:02.832 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:49:02.832 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:49:02.832 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:49:02.832 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 17, 2023-12-20T04:49:02.832 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:49:02.832 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:49:02.832 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:49:02.832 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:49:02.832 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:49:02.832 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:49:02.832 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.832 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:49:02.833 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:49:02.833 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:49:02.833 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:49:02.833 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:49:02.833 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:02.833 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:02.833 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:02.833 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:02.833 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:02.833 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:02.833 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:02.833 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:02.833 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:02.834 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:02.834 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:49:02.834 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:49:02.834 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:49:02.834 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:49:02.834 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:49:02.834 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:02.834 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:02.834 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:02.834 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:02.834 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:02.834 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:02.834 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:02.834 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.835 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:49:02.835 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:02.835 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:02.835 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:02.835 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:02.835 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:02.835 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:02.835 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:02.835 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:02.835 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:02.835 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:49:02.835 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:02.835 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:02.835 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:02.836 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:02.836 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:02.836 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:02.836 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:02.836 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:02.836 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:02.836 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:02.836 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:02.836 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:02.836 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:02.836 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:02.836 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:02.836 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:02.836 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.836 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:02.837 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:02.837 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:02.837 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:02.837 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:02.837 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:02.837 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:02.837 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:02.837 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:02.837 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:02.837 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:02.837 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:02.837 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:49:02.837 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:49:02.838 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.838 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:02.838 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:49:02.838 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.838 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:02.838 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:49:02.838 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:49:02.838 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:49:02.838 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:49:02.838 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:49:02.838 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:02.838 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:02.838 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:02.838 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.839 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.839 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.839 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 16, 2023-12-20T04:49:02.839 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:49:02.839 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:48:35.008751+0000", 2023-12-20T04:49:02.839 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:49:02.839 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:49:02.839 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:02.839 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:02.839 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:02.839 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:02.839 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:02.839 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:02.839 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:02.840 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:02.840 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:02.840 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:02.840 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:49:02.840 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:49:02.840 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:49:02.840 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:49:02.840 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:49:02.840 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:02.840 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:02.840 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:02.840 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:02.840 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:02.840 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:02.841 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:02.841 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.841 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "136", 2023-12-20T04:49:02.841 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:02.841 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:02.841 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:02.841 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:02.841 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:02.841 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:02.841 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:02.841 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:02.841 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:02.841 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:49:02.841 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:02.842 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:02.843 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:49:02.844 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:49:02.844 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:49:02.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.844 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:02.844 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:49:02.844 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:49:02.844 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.844 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:02.844 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:49:02.844 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:49:02.844 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:49:02.844 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:49:02.844 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:49:02.844 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:02.845 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:02.845 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:02.845 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.845 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.845 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 17, 2023-12-20T04:49:02.845 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:49:02.845 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:48:36.182609+0000", 2023-12-20T04:49:02.845 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1027, 2023-12-20T04:49:02.845 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-20T04:49:02.845 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:02.845 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:02.845 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:02.845 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:02.846 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:02.846 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:02.846 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:02.846 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:02.846 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:02.846 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:02.846 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:49:02.846 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:49:02.846 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:49:02.846 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:49:02.846 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:49:02.846 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:02.846 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:02.846 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:02.847 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:02.847 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:02.847 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:02.847 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:02.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.847 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "139", 2023-12-20T04:49:02.847 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:02.847 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:02.847 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:02.847 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:02.847 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:02.847 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:02.847 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:02.847 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:02.848 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:02.848 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 33554432, 2023-12-20T04:49:02.848 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:02.848 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:02.848 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:02.848 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:02.848 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:02.848 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:02.848 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:02.848 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:02.848 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:02.848 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:02.848 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:02.848 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:02.848 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:02.849 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:02.849 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:02.849 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:02.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.849 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:02.849 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:02.849 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:02.849 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:02.849 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:02.849 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:02.849 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:02.849 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:02.849 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:02.849 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:02.850 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:02.850 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:02.850 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:49:02.850 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:49:02.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.850 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:02.850 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:49:02.850 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:49:02.850 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.850 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:02.850 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:49:02.850 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:49:02.850 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:49:02.851 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:49:02.851 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:49:02.851 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:02.851 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:02.851 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:02.851 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.851 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.851 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:02.851 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:49:02.851 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.851 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:49:02.851 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:02.851 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:02.851 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:02.851 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:02.852 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:02.852 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:02.852 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:02.852 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:02.852 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:02.852 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:02.852 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:02.852 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:02.852 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.852 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.852 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:49:02.852 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:02.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.853 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.853 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:49:02.853 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:02.853 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.853 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.853 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:02.853 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.853 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.853 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:49:02.853 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:02.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.854 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.854 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.854 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:49:02.854 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:02.854 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.854 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.854 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:02.854 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.854 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.854 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.854 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:49:02.854 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:02.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.855 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.855 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:49:02.855 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:02.855 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.855 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.855 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:02.855 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.855 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.855 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:49:02.855 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:02.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.856 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.856 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.856 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:49:02.856 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:02.856 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.856 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.856 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.856 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:49:02.856 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:49:02.856 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:49:02.856 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:49:02.856 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:02.856 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:02.856 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:02.857 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.857 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.857 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:49:02.857 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:02.857 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:02.857 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:02.857 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:02.857 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:02.857 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:02.857 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:02.857 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:02.857 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:02.857 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:02.858 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:02.858 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:02.858 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.858 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.858 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:49:02.858 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:02.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.858 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.858 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:49:02.858 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:02.858 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.858 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.859 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:02.859 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.859 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.859 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.859 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:49:02.859 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:02.859 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.859 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.859 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.859 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:49:02.859 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:02.859 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.859 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.860 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:02.860 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.860 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.860 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:49:02.860 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:02.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.860 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.860 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.860 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:49:02.860 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:02.860 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.860 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.861 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.861 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:02.861 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.861 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.861 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.861 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:49:02.861 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:02.861 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.861 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.861 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.861 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:49:02.861 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:02.861 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.861 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.862 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.862 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:49:02.862 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:49:02.862 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:49:02.862 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:49:02.862 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:02.862 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:02.862 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:02.862 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.862 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.862 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.862 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:49:02.862 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:02.862 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:02.863 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:02.863 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:02.863 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:02.863 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:02.863 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:02.863 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:02.863 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:02.863 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:02.863 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:02.863 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:02.863 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.863 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.863 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.863 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:49:02.864 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:02.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.864 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.864 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:49:02.864 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:02.864 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.864 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.864 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.864 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:02.864 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.864 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.864 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:49:02.865 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:02.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.865 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.865 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:49:02.865 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:02.865 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.865 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.865 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:02.865 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.865 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.865 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:49:02.866 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:02.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.866 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.866 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.866 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:49:02.866 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:02.866 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.866 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.866 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:02.866 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.866 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.866 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.867 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:49:02.867 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:02.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.867 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.867 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:49:02.867 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:02.867 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.867 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.867 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:49:02.867 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:49:02.867 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:49:02.867 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:49:02.868 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:02.868 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:02.868 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:02.868 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.868 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.868 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.868 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:49:02.868 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:02.868 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:02.868 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:02.868 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:02.868 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:02.868 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:02.868 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:02.868 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:02.869 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:02.869 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:02.869 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:02.869 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:02.869 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.869 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.869 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:49:02.869 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:02.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.869 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.869 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:49:02.870 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:02.870 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.870 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.870 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:02.870 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.870 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.870 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:49:02.870 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:02.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.870 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.870 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:49:02.871 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:02.871 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.871 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.871 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:02.871 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.871 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.871 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:49:02.871 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:02.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.871 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.871 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:49:02.872 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:02.872 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.872 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.872 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:02.872 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.872 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.872 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:49:02.872 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:02.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.872 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.872 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:49:02.873 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:02.873 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.873 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.873 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:49:02.873 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:49:02.873 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:49:02.873 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:49:02.873 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:02.873 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:02.873 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:02.873 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.873 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.874 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:49:02.874 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:02.874 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:02.874 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:02.874 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:02.874 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:02.874 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:02.874 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:02.874 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:02.874 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:02.874 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:02.874 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:02.874 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:02.874 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.875 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.875 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:49:02.875 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:02.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.875 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.875 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:49:02.875 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:02.875 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.875 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.875 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:02.875 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.876 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.876 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:49:02.876 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:02.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.876 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.876 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:49:02.876 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:02.876 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.876 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.876 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:02.876 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.877 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.877 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:49:02.877 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:02.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.877 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.877 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:49:02.877 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:02.877 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.877 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.877 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:02.877 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.878 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.878 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.878 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:49:02.878 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:02.878 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.878 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.878 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.878 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:49:02.878 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:02.878 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.878 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.878 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.878 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:49:02.879 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:49:02.879 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:49:02.879 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:49:02.879 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:02.879 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:02.879 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:02.879 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.879 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.879 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.879 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:49:02.879 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:02.879 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:02.879 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:02.879 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:02.879 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:02.880 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:02.880 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:02.880 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:02.880 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:02.880 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:02.880 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:02.880 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:02.880 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.880 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.880 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.880 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:49:02.880 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:02.880 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.881 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.881 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.881 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:49:02.881 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:02.881 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.881 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.881 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.881 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:02.881 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.881 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.881 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.881 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:49:02.881 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:02.881 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.882 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.882 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.882 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:49:02.882 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:02.882 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.882 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.882 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:02.882 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.882 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.882 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.882 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:49:02.882 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:02.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.883 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.883 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.883 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:49:02.883 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:02.883 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.883 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.883 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:02.883 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.883 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.883 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.883 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:49:02.883 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:02.884 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.884 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.884 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.884 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:49:02.884 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:02.884 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.884 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.884 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.884 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:49:02.884 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:49:02.884 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:49:02.884 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:49:02.884 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:02.884 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:02.884 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:02.885 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.885 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.885 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:49:02.885 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:02.885 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:02.885 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:02.885 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:02.885 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:02.885 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:02.885 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:02.885 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:02.885 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:02.885 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:02.886 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:02.886 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:02.886 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.886 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.886 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.886 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:49:02.886 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:02.886 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.886 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.886 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.886 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:49:02.886 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:02.886 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.886 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.886 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.887 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:02.887 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.887 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.887 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.887 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:49:02.887 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:02.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.887 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.887 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.887 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:49:02.887 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:02.887 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.887 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.887 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:02.888 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.888 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.888 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.888 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:49:02.888 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:02.888 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.888 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.888 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.888 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:49:02.888 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:02.888 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.888 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.888 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.888 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:02.889 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.889 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.889 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.889 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:49:02.889 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:02.889 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.889 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.889 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.889 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:49:02.889 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:02.889 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.889 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.889 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.890 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:49:02.890 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:49:02.890 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:49:02.890 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:49:02.890 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:02.890 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:02.890 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:02.890 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.890 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.890 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.890 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:49:02.890 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:02.890 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:02.891 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:02.891 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:02.891 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:02.891 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:02.891 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:02.891 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:02.891 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:02.891 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:02.891 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:02.891 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:02.891 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.891 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.891 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.891 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:49:02.892 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:02.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.892 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.892 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.892 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:49:02.892 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:02.892 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.892 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.892 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:02.892 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.892 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.892 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.892 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:49:02.893 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:02.893 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.893 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.893 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.893 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:49:02.893 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:02.893 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.893 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.893 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.893 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:02.893 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.893 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.893 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.893 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:49:02.894 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:02.894 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.894 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.894 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.894 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:49:02.894 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:02.894 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.894 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.894 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.894 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:02.894 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:02.894 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.894 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:02.894 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:49:02.895 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:02.895 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.895 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.895 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:02.895 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:49:02.895 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:02.895 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.895 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.895 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.895 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:49:02.895 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:49:02.895 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:49:02.895 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:49:02.895 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:02.895 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:02.896 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:02.896 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:02.896 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.896 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:02.896 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:49:02.896 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.896 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:49:02.896 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:02.896 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:02.896 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:02.896 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:02.896 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:02.896 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:49:02.897 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:02.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.897 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.897 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:49:02.897 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:02.897 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:02.897 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:02.897 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:02.897 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:02.897 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:49:02.897 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:02.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.897 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.897 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:49:02.898 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:02.898 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:02.898 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:02.898 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:02.898 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:02.898 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:49:02.898 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:02.898 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.898 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.898 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:49:02.898 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:02.898 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:02.898 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:02.898 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:02.899 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:02.899 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:49:02.899 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:02.899 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.899 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.899 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:49:02.899 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:02.899 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:02.899 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:02.899 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:02.899 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:02.899 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:49:02.899 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:02.899 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.900 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.900 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:49:02.900 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:02.900 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:02.900 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:02.900 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:02.900 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:02.900 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:49:02.900 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:02.900 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.900 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.900 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:49:02.900 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:02.900 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:02.901 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:02.901 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:02.901 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:02.901 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:49:02.901 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:02.901 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.901 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:02.901 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:49:02.901 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:02.901 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:02.901 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:02.901 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:02.901 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:02.901 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:49:02.902 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:02.902 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.902 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:02.902 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:49:02.902 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:49:02.902 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:49:02.902 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:49:02.902 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:49:02.902 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:49:02.902 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:49:02.902 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:49:02.902 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:49:02.902 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:49:02.902 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:49:02.903 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:49:02.903 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:49:02.903 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:49:02.903 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.903 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:02.903 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:49:02.903 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:49:02.903 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:49:02.903 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:49:02.903 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:49:02.903 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:49:02.903 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:49:02.903 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:49:02.903 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:49:02.903 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:49:02.904 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:49:02.904 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:02.904 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:49:02.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.830+0000 7f72ad7c9640 1 -- 172.21.15.132:0/415093443 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f729406a430 msgr2=0x7f729406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:02.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.830+0000 7f72ad7c9640 1 --2- 172.21.15.132:0/415093443 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f729406a430 0x7f729406c8f0 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f72a81f0600 tx=0x7f729c007b90 comp rx=0 tx=0).stop 2023-12-20T04:49:02.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.830+0000 7f72ad7c9640 1 -- 172.21.15.132:0/415093443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72a806c240 msgr2=0x7f72a81ef280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:02.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.830+0000 7f72ad7c9640 1 --2- 172.21.15.132:0/415093443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72a806c240 0x7f72a81ef280 secure :-1 s=READY pgs=1400 cs=0 l=1 rev1=1 crypto rx=0x7f729800c450 tx=0x7f729800c910 comp rx=0 tx=0).stop 2023-12-20T04:49:02.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.830+0000 7f72ad7c9640 1 -- 172.21.15.132:0/415093443 shutdown_connections 2023-12-20T04:49:02.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.830+0000 7f72ad7c9640 1 --2- 172.21.15.132:0/415093443 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f729406a430 0x7f729406c8f0 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.830+0000 7f72ad7c9640 1 --2- 172.21.15.132:0/415093443 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f72a815e530 0x7f72a81efd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.830+0000 7f72ad7c9640 1 --2- 172.21.15.132:0/415093443 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f72a8159b50 0x7f72a81ef7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.830+0000 7f72ad7c9640 1 --2- 172.21.15.132:0/415093443 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f72a806c240 0x7f72a81ef280 unknown :-1 s=CLOSED pgs=1400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:02.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.830+0000 7f72ad7c9640 1 -- 172.21.15.132:0/415093443 >> 172.21.15.132:0/415093443 conn(0x7f72a80ced10 msgr2=0x7f72a8154100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:02.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.830+0000 7f72ad7c9640 1 -- 172.21.15.132:0/415093443 shutdown_connections 2023-12-20T04:49:02.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:02.830+0000 7f72ad7c9640 1 -- 172.21.15.132:0/415093443 wait complete. 2023-12-20T04:49:02.907 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:49:03.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.006+0000 7fa99448f640 1 Processor -- start 2023-12-20T04:49:03.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.006+0000 7fa99448f640 1 -- start start 2023-12-20T04:49:03.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.007+0000 7fa99448f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa98c161340 0x7fa98c06ca90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:03.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.007+0000 7fa99448f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98c0c9620 con 0x7fa98c0b0ea0 2023-12-20T04:49:03.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.007+0000 7fa99448f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa98c06b1d0 con 0x7fa98c0cace0 2023-12-20T04:49:03.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.007+0000 7fa99448f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa98c0cb160 con 0x7fa98c161340 2023-12-20T04:49:03.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.007+0000 7fa99222b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa98c161340 0x7fa98c06ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:03.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.007+0000 7fa992a2c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa98c0b0ea0 0x7fa98c164f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:60086/0 (socket says 172.21.15.132:60086) 2023-12-20T04:49:03.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.007+0000 7fa99222b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa98c161340 0x7fa98c06ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49890/0 (socket says 172.21.15.132:49890) 2023-12-20T04:49:03.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.007+0000 7fa992a2c640 1 -- 172.21.15.132:0/1924286232 learned_addr learned my addr 172.21.15.132:0/1924286232 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:03.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.008+0000 7fa99222b640 1 -- 172.21.15.132:0/1924286232 >> v1:172.21.15.187:6789/0 conn(0x7fa98c0cace0 legacy=0x7fa98c0b0790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:03.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.008+0000 7fa99222b640 1 -- 172.21.15.132:0/1924286232 >> v1:172.21.15.132:6789/0 conn(0x7fa98c0b0ea0 legacy=0x7fa98c164f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:03.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.008+0000 7fa99222b640 1 -- 172.21.15.132:0/1924286232 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa98c06b470 con 0x7fa98c161340 2023-12-20T04:49:03.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.008+0000 7fa99222b640 1 --2- 172.21.15.132:0/1924286232 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa98c161340 0x7fa98c06ca90 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fa988009d90 tx=0x7fa98802beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68b1d7b3c4cae805 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:03.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.008+0000 7fa991229640 1 -- 172.21.15.132:0/1924286232 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa98802cc60 con 0x7fa98c161340 2023-12-20T04:49:03.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.008+0000 7fa991229640 1 -- 172.21.15.132:0/1924286232 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa98802cdc0 con 0x7fa98c161340 2023-12-20T04:49:03.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.008+0000 7fa991229640 1 -- 172.21.15.132:0/1924286232 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988034660 con 0x7fa98c161340 2023-12-20T04:49:03.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.009+0000 7fa99448f640 1 -- 172.21.15.132:0/1924286232 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa98c161340 msgr2=0x7fa98c06ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:03.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.009+0000 7fa99448f640 1 --2- 172.21.15.132:0/1924286232 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa98c161340 0x7fa98c06ca90 secure :-1 s=READY pgs=1402 cs=0 l=1 rev1=1 crypto rx=0x7fa988009d90 tx=0x7fa98802beb0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.009+0000 7fa99448f640 1 -- 172.21.15.132:0/1924286232 shutdown_connections 2023-12-20T04:49:03.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.009+0000 7fa99448f640 1 --2- 172.21.15.132:0/1924286232 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa98c161340 0x7fa98c06ca90 unknown :-1 s=CLOSED pgs=1402 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.009+0000 7fa99448f640 1 -- 172.21.15.132:0/1924286232 >> 172.21.15.132:0/1924286232 conn(0x7fa98c0ced10 msgr2=0x7fa98c0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:03.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.009+0000 7fa99448f640 1 -- 172.21.15.132:0/1924286232 shutdown_connections 2023-12-20T04:49:03.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.009+0000 7fa99448f640 1 -- 172.21.15.132:0/1924286232 wait complete. 2023-12-20T04:49:03.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.010+0000 7fa99448f640 1 Processor -- start 2023-12-20T04:49:03.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.010+0000 7fa99448f640 1 -- start start 2023-12-20T04:49:03.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.011+0000 7fa99448f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa98c0b0ea0 0x7fa98c15ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:03.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.011+0000 7fa99448f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa98c0cace0 0x7fa98c15f230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:03.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.011+0000 7fa99448f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa98c161340 0x7fa98c164eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:03.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.011+0000 7fa99448f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c1fb5f0 con 0x7fa98c0b0ea0 2023-12-20T04:49:03.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.011+0000 7fa99448f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c1faa70 con 0x7fa98c161340 2023-12-20T04:49:03.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.011+0000 7fa99448f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa98c1fad50 con 0x7fa98c0cace0 2023-12-20T04:49:03.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.011+0000 7fa99222b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa98c0b0ea0 0x7fa98c15ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:03.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.011+0000 7fa99222b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa98c0b0ea0 0x7fa98c15ecf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49894/0 (socket says 172.21.15.132:49894) 2023-12-20T04:49:03.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.011+0000 7fa99222b640 1 -- 172.21.15.132:0/2226058372 learned_addr learned my addr 172.21.15.132:0/2226058372 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:03.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.011+0000 7fa99222b640 1 -- 172.21.15.132:0/2226058372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa98c0cace0 msgr2=0x7fa98c15f230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:03.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.011+0000 7fa99222b640 1 --2- 172.21.15.132:0/2226058372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa98c0cace0 0x7fa98c15f230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.011+0000 7fa99222b640 1 -- 172.21.15.132:0/2226058372 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa98c161340 msgr2=0x7fa98c164eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:03.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.011+0000 7fa99222b640 1 --2- 172.21.15.132:0/2226058372 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa98c161340 0x7fa98c164eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.011+0000 7fa99222b640 1 -- 172.21.15.132:0/2226058372 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa988009a70 con 0x7fa98c0b0ea0 2023-12-20T04:49:03.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.011+0000 7fa99222b640 1 --2- 172.21.15.132:0/2226058372 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa98c0b0ea0 0x7fa98c15ecf0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fa988037040 tx=0x7fa988004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:03.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.011+0000 7fa982ffd640 1 -- 172.21.15.132:0/2226058372 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988040650 con 0x7fa98c0b0ea0 2023-12-20T04:49:03.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.012+0000 7fa982ffd640 1 -- 172.21.15.132:0/2226058372 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9880407b0 con 0x7fa98c0b0ea0 2023-12-20T04:49:03.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.012+0000 7fa99448f640 1 -- 172.21.15.132:0/2226058372 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa98c1fb030 con 0x7fa98c0b0ea0 2023-12-20T04:49:03.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.012+0000 7fa982ffd640 1 -- 172.21.15.132:0/2226058372 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa988040b60 con 0x7fa98c0b0ea0 2023-12-20T04:49:03.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.012+0000 7fa99448f640 1 -- 172.21.15.132:0/2226058372 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa98c1fa690 con 0x7fa98c0b0ea0 2023-12-20T04:49:03.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.013+0000 7fa99448f640 1 -- 172.21.15.132:0/2226058372 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa98c0c2fb0 con 0x7fa98c0b0ea0 2023-12-20T04:49:03.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.013+0000 7fa982ffd640 1 -- 172.21.15.132:0/2226058372 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa988040cc0 con 0x7fa98c0b0ea0 2023-12-20T04:49:03.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.013+0000 7fa982ffd640 1 --2- 172.21.15.132:0/2226058372 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa97006a430 0x7fa97006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:03.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.014+0000 7fa982ffd640 1 -- 172.21.15.132:0/2226058372 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa9880ab860 con 0x7fa98c0b0ea0 2023-12-20T04:49:03.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.014+0000 7fa991a2a640 1 --2- 172.21.15.132:0/2226058372 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa97006a430 0x7fa97006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:03.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.014+0000 7fa982ffd640 1 -- 172.21.15.132:0/2226058372 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=140}) v3 -- 0x7fa970071f60 con 0x7fa98c0b0ea0 2023-12-20T04:49:03.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.014+0000 7fa991a2a640 1 --2- 172.21.15.132:0/2226058372 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa97006a430 0x7fa97006c8f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0b5090 tx=0x7fa97c0079b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:03.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.018+0000 7fa982ffd640 1 -- 172.21.15.132:0/2226058372 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa98c0c2fb0 con 0x7fa98c0b0ea0 2023-12-20T04:49:03.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.221+0000 7fa99448f640 1 -- 172.21.15.132:0/2226058372 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa98c0c2fb0 con 0x7fa98c0b0ea0 2023-12-20T04:49:03.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.222+0000 7fa982ffd640 1 -- 172.21.15.132:0/2226058372 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4723 (secure 0 0 0) 0x7fa98c0c2fb0 con 0x7fa98c0b0ea0 2023-12-20T04:49:03.224 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:03.224 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6763,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1413044191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1413044191},{"type":"v1","addr":"172.21.15.132:6837","nonce":1413044191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1584197959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1584197959},{"type":"v1","addr":"172.21.15.187:6834","nonce":1584197959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":7830,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/3080885824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3080885824},{"type":"v1","addr":"172.21.15.132:6836","nonce":3080885824}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:48:37.200402+0000","modified":"2023-12-20T04:48:39.207037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"d","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/1483131498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":1483131498},{"type":"v1","addr":"172.21.15.187:6835","nonce":1483131498}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-20T04:49:03.224 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 51 2023-12-20T04:49:03.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.224+0000 7fa99448f640 1 -- 172.21.15.132:0/2226058372 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa97006a430 msgr2=0x7fa97006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:03.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.224+0000 7fa99448f640 1 --2- 172.21.15.132:0/2226058372 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa97006a430 0x7fa97006c8f0 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7fa98c0b5090 tx=0x7fa97c0079b0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.224+0000 7fa99448f640 1 -- 172.21.15.132:0/2226058372 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa98c0b0ea0 msgr2=0x7fa98c15ecf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:03.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.224+0000 7fa99448f640 1 --2- 172.21.15.132:0/2226058372 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa98c0b0ea0 0x7fa98c15ecf0 secure :-1 s=READY pgs=1403 cs=0 l=1 rev1=1 crypto rx=0x7fa988037040 tx=0x7fa988004a40 comp rx=0 tx=0).stop 2023-12-20T04:49:03.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.224+0000 7fa99448f640 1 -- 172.21.15.132:0/2226058372 shutdown_connections 2023-12-20T04:49:03.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.224+0000 7fa99448f640 1 --2- 172.21.15.132:0/2226058372 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa97006a430 0x7fa97006c8f0 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.224+0000 7fa99448f640 1 --2- 172.21.15.132:0/2226058372 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa98c161340 0x7fa98c164eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.224+0000 7fa99448f640 1 --2- 172.21.15.132:0/2226058372 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa98c0cace0 0x7fa98c15f230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.224+0000 7fa99448f640 1 --2- 172.21.15.132:0/2226058372 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa98c0b0ea0 0x7fa98c15ecf0 unknown :-1 s=CLOSED pgs=1403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.224+0000 7fa99448f640 1 -- 172.21.15.132:0/2226058372 >> 172.21.15.132:0/2226058372 conn(0x7fa98c0ced10 msgr2=0x7fa98c0cd5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:03.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.224+0000 7fa99448f640 1 -- 172.21.15.132:0/2226058372 shutdown_connections 2023-12-20T04:49:03.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.224+0000 7fa99448f640 1 -- 172.21.15.132:0/2226058372 wait complete. 2023-12-20T04:49:03.237 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-20T04:49:03.363 INFO:teuthology.orchestra.run.smithi187.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":7845,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":26.150989235000001,"mdsmap_epoch":51,"osdmap_epoch":139,"osdmap_epoch_barrier":137,"uptime":30.93885423} 2023-12-20T04:49:03.363 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 7845, "mdsmap_epoch": 51, "osdmap_epoch": 139, "osdmap_epoch_barrier": 137, "rank_uptime": 26.150989235, "state": "up:active", "uptime": 30.93885423, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:49:03.363 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-20T04:49:03.363 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:03.363 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-20T04:49:03.382 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:03.382 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-20T04:49:03.441 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:49:03.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.579+0000 7ff1f9c70640 1 Processor -- start 2023-12-20T04:49:03.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.579+0000 7ff1f9c70640 1 -- start start 2023-12-20T04:49:03.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.580+0000 7ff1f9c70640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff1f40b4980 0x7ff1f40b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:03.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.580+0000 7ff1f9c70640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff1f40d1aa0 0x7ff1f40d1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:03.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.580+0000 7ff1f9c70640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1f40b5320 con 0x7ff1f4160450 2023-12-20T04:49:03.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.580+0000 7ff1f9c70640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f40b5ec0 con 0x7ff1f40b4980 2023-12-20T04:49:03.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.580+0000 7ff1f9c70640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1f41617e0 con 0x7ff1f40d1aa0 2023-12-20T04:49:03.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.580+0000 7ff1f2ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff1f40b4980 0x7ff1f40b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:03.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.580+0000 7ff1f2ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff1f40b4980 0x7ff1f40b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49900/0 (socket says 172.21.15.132:49900) 2023-12-20T04:49:03.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.580+0000 7ff1f2ffd640 1 -- 172.21.15.132:0/2036746933 learned_addr learned my addr 172.21.15.132:0/2036746933 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:03.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.580+0000 7ff1f2ffd640 1 -- 172.21.15.132:0/2036746933 >> v2:172.21.15.187:3300/0 conn(0x7ff1f40d1aa0 msgr2=0x7ff1f40d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:03.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.580+0000 7ff1f2ffd640 1 --2- 172.21.15.132:0/2036746933 >> v2:172.21.15.187:3300/0 conn(0x7ff1f40d1aa0 0x7ff1f40d1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.580+0000 7ff1f2ffd640 1 -- 172.21.15.132:0/2036746933 >> v1:172.21.15.187:6789/0 conn(0x7ff1f4160450 legacy=0x7ff1f4160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:03.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.580+0000 7ff1f2ffd640 1 -- 172.21.15.132:0/2036746933 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1f40d0fc0 con 0x7ff1f40b4980 2023-12-20T04:49:03.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.581+0000 7ff1f2ffd640 1 --2- 172.21.15.132:0/2036746933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1f40b4980 0x7ff1f40b4de0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4073c40 tx=0x7ff1e802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4751b5f6edbd4e27 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:03.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.581+0000 7ff1f27fc640 1 -- 172.21.15.132:0/2036746933 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8030860 con 0x7ff1f40b4980 2023-12-20T04:49:03.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.581+0000 7ff1f27fc640 1 -- 172.21.15.132:0/2036746933 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1e80309c0 con 0x7ff1f40b4980 2023-12-20T04:49:03.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.581+0000 7ff1f27fc640 1 -- 172.21.15.132:0/2036746933 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1e8030d50 con 0x7ff1f40b4980 2023-12-20T04:49:03.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.581+0000 7ff1f9c70640 1 -- 172.21.15.132:0/2036746933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1f40b4980 msgr2=0x7ff1f40b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:03.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.581+0000 7ff1f9c70640 1 --2- 172.21.15.132:0/2036746933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1f40b4980 0x7ff1f40b4de0 secure :-1 s=READY pgs=1404 cs=0 l=1 rev1=1 crypto rx=0x7ff1f4073c40 tx=0x7ff1e802b9a0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.581+0000 7ff1f9c70640 1 -- 172.21.15.132:0/2036746933 shutdown_connections 2023-12-20T04:49:03.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.581+0000 7ff1f9c70640 1 --2- 172.21.15.132:0/2036746933 >> v2:172.21.15.187:3300/0 conn(0x7ff1f40d1aa0 0x7ff1f40d1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.581+0000 7ff1f9c70640 1 --2- 172.21.15.132:0/2036746933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1f40b4980 0x7ff1f40b4de0 unknown :-1 s=CLOSED pgs=1404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.581+0000 7ff1f9c70640 1 -- 172.21.15.132:0/2036746933 >> 172.21.15.132:0/2036746933 conn(0x7ff1f40cf980 msgr2=0x7ff1f40cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:03.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.581+0000 7ff1f9c70640 1 -- 172.21.15.132:0/2036746933 shutdown_connections 2023-12-20T04:49:03.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.581+0000 7ff1f9c70640 1 -- 172.21.15.132:0/2036746933 wait complete. 2023-12-20T04:49:03.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.583+0000 7ff1f9c70640 1 Processor -- start 2023-12-20T04:49:03.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.583+0000 7ff1f9c70640 1 -- start start 2023-12-20T04:49:03.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.583+0000 7ff1f9c70640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1f40b4980 0x7ff1f40cce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:03.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.583+0000 7ff1f9c70640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1f40d1aa0 0x7ff1f415ed00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:03.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.583+0000 7ff1f9c70640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1f4160450 0x7ff1f415b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:03.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.583+0000 7ff1f9c70640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40cbdd0 con 0x7ff1f4160450 2023-12-20T04:49:03.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.583+0000 7ff1f9c70640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40cc0b0 con 0x7ff1f40b4980 2023-12-20T04:49:03.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.583+0000 7ff1f9c70640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1f40cc390 con 0x7ff1f40d1aa0 2023-12-20T04:49:03.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.584+0000 7ff1f3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1f4160450 0x7ff1f415b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:03.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.584+0000 7ff1f3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1f4160450 0x7ff1f415b4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:49908/0 (socket says 172.21.15.132:49908) 2023-12-20T04:49:03.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.584+0000 7ff1f3fff640 1 -- 172.21.15.132:0/2022240055 learned_addr learned my addr 172.21.15.132:0/2022240055 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:03.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.584+0000 7ff1f37fe640 1 --2- 172.21.15.132:0/2022240055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1f40b4980 0x7ff1f40cce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:03.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.584+0000 7ff1f2ffd640 1 --2- 172.21.15.132:0/2022240055 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1f40d1aa0 0x7ff1f415ed00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:03.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.584+0000 7ff1f3fff640 1 -- 172.21.15.132:0/2022240055 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1f40d1aa0 msgr2=0x7ff1f415ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:03.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.584+0000 7ff1f3fff640 1 --2- 172.21.15.132:0/2022240055 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1f40d1aa0 0x7ff1f415ed00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.584+0000 7ff1f3fff640 1 -- 172.21.15.132:0/2022240055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1f40b4980 msgr2=0x7ff1f40cce50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:03.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.584+0000 7ff1f3fff640 1 --2- 172.21.15.132:0/2022240055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1f40b4980 0x7ff1f40cce50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.584+0000 7ff1f3fff640 1 -- 172.21.15.132:0/2022240055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e80094d0 con 0x7ff1f4160450 2023-12-20T04:49:03.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.584+0000 7ff1f3fff640 1 --2- 172.21.15.132:0/2022240055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1f4160450 0x7ff1f415b4c0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00b970 tx=0x7ff1ec00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:03.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.584+0000 7ff1dbfff640 1 -- 172.21.15.132:0/2022240055 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec00cb40 con 0x7ff1f4160450 2023-12-20T04:49:03.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.584+0000 7ff1dbfff640 1 -- 172.21.15.132:0/2022240055 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1ec00ccc0 con 0x7ff1f4160450 2023-12-20T04:49:03.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.584+0000 7ff1f9c70640 1 -- 172.21.15.132:0/2022240055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1f40cc670 con 0x7ff1f4160450 2023-12-20T04:49:03.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.584+0000 7ff1dbfff640 1 -- 172.21.15.132:0/2022240055 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1ec014680 con 0x7ff1f4160450 2023-12-20T04:49:03.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.584+0000 7ff1f9c70640 1 -- 172.21.15.132:0/2022240055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1f415f240 con 0x7ff1f4160450 2023-12-20T04:49:03.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.585+0000 7ff1f9c70640 1 -- 172.21.15.132:0/2022240055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1f415f430 con 0x7ff1f4160450 2023-12-20T04:49:03.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.586+0000 7ff1dbfff640 1 -- 172.21.15.132:0/2022240055 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff1ec01d3b0 con 0x7ff1f4160450 2023-12-20T04:49:03.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.586+0000 7ff1dbfff640 1 --2- 172.21.15.132:0/2022240055 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff1e006a430 0x7ff1e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:03.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.586+0000 7ff1dbfff640 1 -- 172.21.15.132:0/2022240055 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff1ec088850 con 0x7ff1f4160450 2023-12-20T04:49:03.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.586+0000 7ff1f37fe640 1 --2- 172.21.15.132:0/2022240055 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff1e006a430 0x7ff1e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:03.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.586+0000 7ff1dbfff640 1 -- 172.21.15.132:0/2022240055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=140}) v3 -- 0x7ff1e0071f60 con 0x7ff1f4160450 2023-12-20T04:49:03.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.586+0000 7ff1f37fe640 1 --2- 172.21.15.132:0/2022240055 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff1e006a430 0x7ff1e006c8f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4006fd0 tx=0x7ff1e4009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:03.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.590+0000 7ff1dbfff640 1 -- 172.21.15.132:0/2022240055 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff1ec019070 con 0x7ff1f4160450 2023-12-20T04:49:03.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.756+0000 7ff1f9c70640 1 -- 172.21.15.132:0/2022240055 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7ff1f404e840 con 0x7ff1f4160450 2023-12-20T04:49:03.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.757+0000 7ff1dbfff640 1 -- 172.21.15.132:0/2022240055 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+33569 (secure 0 0 0) 0x7ff1ec053e60 con 0x7ff1f4160450 2023-12-20T04:49:03.759 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:03.760 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:49:03.760 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 139, 2023-12-20T04:49:03.760 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:49:03.760 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:49:03.760 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:48:59.853998+0000", 2023-12-20T04:49:03.760 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:49:03.760 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:49:03.760 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:49:03.760 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:49:03.760 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:49:03.760 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:49:03.760 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:49:03.760 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:49:03.760 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:49:03.760 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:03.761 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:49:03.761 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:49:03.761 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:49:03.761 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:49:03.761 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:49:03.761 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 17, 2023-12-20T04:49:03.761 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:49:03.761 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:49:03.761 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:49:03.761 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:49:03.761 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:49:03.761 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:49:03.761 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.761 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:49:03.762 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:49:03.762 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:49:03.762 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:49:03.762 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:49:03.762 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:03.762 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:03.762 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:03.762 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:03.762 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:03.762 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:03.762 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:03.762 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:03.762 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:03.762 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:03.762 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:49:03.763 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:49:03.763 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:49:03.763 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:49:03.763 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:49:03.763 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:03.763 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:03.763 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:03.763 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:03.763 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:03.763 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:03.763 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:03.763 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.763 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:49:03.763 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:03.763 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:03.763 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:03.764 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:03.764 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:03.764 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:03.764 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:03.764 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:03.764 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:03.764 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:49:03.764 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:03.764 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:03.764 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:03.764 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:03.764 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:03.764 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:03.764 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:03.764 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:03.765 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:03.765 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:03.765 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:03.765 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:03.765 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:03.765 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:03.765 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:03.765 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:03.765 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.765 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:03.765 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:03.765 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:03.765 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:03.765 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:03.766 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:03.766 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:03.766 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:03.766 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:03.766 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:03.766 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:03.766 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:03.766 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:49:03.766 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:49:03.766 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.766 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:03.766 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:49:03.766 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.766 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:03.766 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:49:03.766 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:49:03.766 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:49:03.767 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:49:03.767 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:49:03.767 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:03.767 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:03.767 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:03.767 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.767 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.767 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 16, 2023-12-20T04:49:03.767 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:49:03.767 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:48:35.008751+0000", 2023-12-20T04:49:03.767 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:49:03.767 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:49:03.767 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:03.767 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:03.767 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:03.768 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:03.768 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:03.768 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:03.768 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:03.768 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:03.768 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:03.768 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:03.768 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:49:03.768 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:49:03.768 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:49:03.768 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:49:03.768 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:49:03.768 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:03.768 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:03.769 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:03.769 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:03.769 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:03.769 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:03.769 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:03.769 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.769 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "136", 2023-12-20T04:49:03.769 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:03.769 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:03.769 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:03.769 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:03.769 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:03.769 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:03.769 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:03.770 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:03.770 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:03.770 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:49:03.770 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:03.770 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:03.770 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:03.770 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:03.770 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:03.770 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:03.770 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:03.770 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:03.770 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:03.770 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:03.770 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:03.770 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:03.770 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:03.771 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:03.771 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:03.771 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:03.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.771 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:03.771 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:03.771 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:03.771 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:03.771 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:03.771 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:03.771 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:03.771 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:03.771 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:03.771 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:03.771 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:03.772 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:03.772 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:49:03.772 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:49:03.772 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:49:03.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.772 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:03.772 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:49:03.772 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:49:03.772 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.772 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:03.772 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:49:03.772 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:49:03.772 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:49:03.773 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:49:03.773 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:49:03.773 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:03.773 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:03.773 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:03.773 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.773 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 17, 2023-12-20T04:49:03.773 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:49:03.773 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:48:36.182609+0000", 2023-12-20T04:49:03.773 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1027, 2023-12-20T04:49:03.773 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-20T04:49:03.773 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:03.774 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:03.775 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:03.775 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:03.775 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:03.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.775 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "139", 2023-12-20T04:49:03.775 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:03.775 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:03.775 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:03.775 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:03.775 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:03.775 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:03.775 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:03.775 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:03.775 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 33554432, 2023-12-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:03.776 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:03.777 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:03.777 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:03.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.777 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:03.777 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:03.777 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:03.777 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:03.777 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:03.777 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:03.777 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:03.777 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:03.777 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:03.777 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:03.777 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:03.777 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:03.778 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:49:03.778 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:49:03.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.778 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:03.778 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:49:03.778 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:49:03.778 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.778 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:03.778 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:49:03.778 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:49:03.778 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:49:03.778 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:49:03.778 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:49:03.778 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:03.778 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:03.779 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:03.779 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.779 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.779 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:03.779 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:49:03.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.779 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:49:03.779 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:03.779 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:03.779 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:03.779 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:03.779 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:03.779 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:03.779 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:03.780 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:03.780 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:03.780 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:03.780 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:03.780 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:03.780 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.780 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.780 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:49:03.780 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:03.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.780 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.780 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:49:03.780 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:03.780 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.781 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.781 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:03.781 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.781 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.781 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:49:03.781 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:03.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.781 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.781 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:49:03.781 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:03.781 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.781 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.782 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:03.782 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.782 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.782 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:49:03.782 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:03.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.782 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.782 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:49:03.782 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:03.782 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.782 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.783 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:03.783 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.783 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.783 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:49:03.783 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:03.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.783 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.783 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:49:03.783 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:03.783 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.783 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.783 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:49:03.784 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:49:03.784 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:49:03.784 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:49:03.784 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:03.784 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:03.784 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:03.784 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.784 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:49:03.784 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:03.784 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:03.784 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:03.784 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:03.784 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:03.784 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:03.785 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:03.785 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:03.785 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:03.785 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:03.785 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:03.785 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:03.785 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.785 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.785 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:49:03.785 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:03.785 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.785 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.785 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:49:03.786 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:03.786 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.786 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.786 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:03.786 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.786 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.786 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:49:03.786 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:03.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.786 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.786 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:49:03.786 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:03.787 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.787 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.787 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:03.787 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.787 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.787 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:49:03.787 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:03.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.787 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.787 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:49:03.787 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:03.787 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.787 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.788 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:03.788 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.788 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.788 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:49:03.788 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:03.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.788 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.788 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:49:03.788 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:03.788 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.788 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.788 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:49:03.789 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:49:03.789 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:49:03.789 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:49:03.789 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:03.789 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:03.789 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:03.789 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.789 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:49:03.789 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:03.789 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:03.789 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:03.789 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:03.790 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:03.790 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:03.790 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:03.790 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:03.790 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:03.790 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:03.790 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:03.790 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:03.790 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.790 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.790 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:49:03.790 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:03.790 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.790 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.790 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.791 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:49:03.791 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:03.791 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.791 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.791 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:03.791 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.791 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.791 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:49:03.791 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:03.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.791 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.791 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:49:03.791 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:03.792 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.792 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.792 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:03.792 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.792 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.792 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:49:03.792 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:03.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.792 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.792 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:49:03.792 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:03.792 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.793 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.793 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:03.793 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.793 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.793 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:49:03.793 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:03.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.793 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.793 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:49:03.793 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:03.793 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.793 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.794 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:49:03.794 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:49:03.794 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:49:03.794 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:49:03.794 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:03.794 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:03.794 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:03.794 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.794 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:49:03.794 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:03.794 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:03.794 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:03.794 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:03.795 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:03.795 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:03.795 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:03.795 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:03.795 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:03.795 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:03.795 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:03.795 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:03.795 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.795 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.795 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:49:03.795 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:03.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.795 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.796 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:49:03.796 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:03.796 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.796 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.796 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:03.796 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.796 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.796 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:49:03.796 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:03.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.796 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.796 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:49:03.797 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:03.797 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.797 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.797 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:03.797 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.797 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.797 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:49:03.797 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:03.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.797 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.797 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:49:03.798 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:03.798 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.798 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.798 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:03.798 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.798 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.798 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:49:03.798 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:03.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.798 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.798 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:49:03.798 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:03.799 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.799 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.799 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:49:03.799 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:49:03.799 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:49:03.799 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:49:03.799 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:03.799 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:03.799 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:03.799 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.799 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:49:03.799 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:03.799 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:03.800 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:03.800 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:03.800 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:03.800 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:03.800 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:03.800 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:03.800 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:03.800 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:03.800 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:03.800 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:03.800 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.800 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.800 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:49:03.800 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:03.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.801 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.801 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.801 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:49:03.801 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:03.801 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.801 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.801 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:03.801 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.801 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.801 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.801 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:49:03.801 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:03.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.802 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.802 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:49:03.802 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:03.802 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.802 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.802 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:03.802 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.802 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.802 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:49:03.802 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:03.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.802 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.803 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:49:03.803 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:03.803 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.803 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.803 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.803 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:03.803 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.803 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.803 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.803 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:49:03.803 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:03.803 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.803 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.803 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.803 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:49:03.804 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:03.804 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.804 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.804 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:49:03.804 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:49:03.804 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:49:03.804 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:49:03.804 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:03.804 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:03.804 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:03.804 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.804 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.804 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:49:03.805 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:03.805 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:03.805 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:03.805 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:03.805 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:03.805 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:03.805 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:03.805 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:03.805 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:03.805 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:03.805 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:03.805 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:03.805 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.805 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.805 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.806 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:49:03.806 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:03.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.806 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.806 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.806 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:49:03.806 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:03.806 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.806 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.806 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:03.806 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.806 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.806 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.806 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:49:03.806 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:03.807 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.807 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.807 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.807 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:49:03.807 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:03.807 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.807 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.807 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.807 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:03.807 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.807 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.807 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.807 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:49:03.807 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:03.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.808 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.808 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.808 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:49:03.808 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:03.808 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.808 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.808 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:03.808 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.808 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.808 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.808 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:49:03.808 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:03.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.809 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.809 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.809 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:49:03.809 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:03.809 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.809 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.809 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.809 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:49:03.809 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:49:03.809 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:49:03.809 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:49:03.809 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:03.809 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:03.809 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:03.809 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.810 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.810 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.810 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:49:03.810 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:03.810 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:03.810 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:03.810 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:03.810 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:03.810 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:03.810 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:03.810 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:03.810 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:03.810 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:03.810 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:03.810 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:03.811 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.811 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.811 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.811 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:49:03.811 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:03.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.811 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.811 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.811 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:49:03.811 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:03.811 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.811 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.811 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.811 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:03.811 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.812 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.812 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:49:03.812 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:03.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.812 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.812 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:49:03.812 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:03.812 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.812 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.812 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:03.812 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.812 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.813 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:49:03.813 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:03.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.813 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.813 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.813 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:49:03.813 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:03.813 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.813 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.813 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:03.813 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.813 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.813 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.814 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:49:03.814 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:03.814 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.814 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.814 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.814 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:49:03.814 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:03.814 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.814 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.814 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.814 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:49:03.814 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:49:03.814 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:49:03.814 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:49:03.814 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:03.815 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:03.815 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:03.815 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.815 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.815 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:49:03.815 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:03.815 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:03.815 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:03.815 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:03.815 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:03.815 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:03.815 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:03.815 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:03.815 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:03.815 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:03.816 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:03.816 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:03.816 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.816 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.816 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.816 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:49:03.816 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:03.816 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.816 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.816 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.816 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:49:03.816 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:03.816 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.816 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.816 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.816 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:03.817 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.817 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.817 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:49:03.817 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:03.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.817 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.817 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:49:03.817 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:03.817 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.817 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.817 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:03.817 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.818 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.818 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.818 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:49:03.818 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:03.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.818 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.818 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.818 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:49:03.818 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:03.818 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.818 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.818 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:03.818 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:03.818 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.818 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:03.819 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:49:03.819 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:03.819 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.819 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.819 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:03.819 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:49:03.819 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:03.819 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.819 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.819 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.819 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:49:03.819 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:49:03.819 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:49:03.819 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:49:03.819 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:03.819 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:03.820 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:03.820 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:03.820 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.820 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:03.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:49:03.820 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:49:03.820 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:03.820 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:03.820 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:03.820 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:03.820 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:03.820 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:49:03.820 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:03.820 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.821 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.821 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:49:03.821 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:03.821 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:03.821 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:03.821 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:03.821 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:03.821 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:49:03.821 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:03.821 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.821 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.821 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:49:03.821 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:03.821 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:03.822 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:03.822 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:03.822 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:03.822 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:49:03.822 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:03.822 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.822 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.822 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:49:03.822 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:03.822 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:03.822 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:03.822 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:03.822 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:03.822 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:49:03.822 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:03.822 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.823 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.823 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:49:03.823 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:03.823 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:03.823 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:03.823 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:03.823 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:03.823 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:49:03.823 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:03.823 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.823 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.823 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:49:03.823 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:03.823 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:03.823 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:03.823 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:03.824 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:03.824 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:49:03.824 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:03.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.824 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.824 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:49:03.824 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:03.824 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:03.824 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:03.824 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:03.824 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:03.824 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:49:03.824 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:03.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.824 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:03.825 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:49:03.825 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:03.825 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:03.825 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:03.825 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:03.825 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:03.825 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:49:03.825 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:03.825 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.825 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:03.825 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:49:03.825 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:49:03.825 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:49:03.825 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:49:03.825 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:49:03.826 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:49:03.826 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:49:03.826 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:49:03.826 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:49:03.826 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:49:03.826 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:49:03.826 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:49:03.826 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:49:03.826 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:49:03.826 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.826 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:03.826 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:49:03.826 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:49:03.826 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:49:03.826 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:49:03.826 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:49:03.827 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:49:03.827 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:49:03.827 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:49:03.827 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:49:03.827 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:49:03.827 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:49:03.827 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:03.827 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:49:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.759+0000 7ff1f9c70640 1 -- 172.21.15.132:0/2022240055 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff1e006a430 msgr2=0x7ff1e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:03.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.759+0000 7ff1f9c70640 1 --2- 172.21.15.132:0/2022240055 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff1e006a430 0x7ff1e006c8f0 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7ff1e4006fd0 tx=0x7ff1e4009060 comp rx=0 tx=0).stop 2023-12-20T04:49:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.759+0000 7ff1f9c70640 1 -- 172.21.15.132:0/2022240055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1f4160450 msgr2=0x7ff1f415b4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.759+0000 7ff1f9c70640 1 --2- 172.21.15.132:0/2022240055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1f4160450 0x7ff1f415b4c0 secure :-1 s=READY pgs=1405 cs=0 l=1 rev1=1 crypto rx=0x7ff1ec00b970 tx=0x7ff1ec00be30 comp rx=0 tx=0).stop 2023-12-20T04:49:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.759+0000 7ff1f9c70640 1 -- 172.21.15.132:0/2022240055 shutdown_connections 2023-12-20T04:49:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.759+0000 7ff1f9c70640 1 --2- 172.21.15.132:0/2022240055 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff1e006a430 0x7ff1e006c8f0 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.759+0000 7ff1f9c70640 1 --2- 172.21.15.132:0/2022240055 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1f4160450 0x7ff1f415b4c0 unknown :-1 s=CLOSED pgs=1405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.759+0000 7ff1f9c70640 1 --2- 172.21.15.132:0/2022240055 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff1f40d1aa0 0x7ff1f415ed00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.759+0000 7ff1f9c70640 1 --2- 172.21.15.132:0/2022240055 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1f40b4980 0x7ff1f40cce50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.759+0000 7ff1f9c70640 1 -- 172.21.15.132:0/2022240055 >> 172.21.15.132:0/2022240055 conn(0x7ff1f40cf980 msgr2=0x7ff1f40b6150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.759+0000 7ff1f9c70640 1 -- 172.21.15.132:0/2022240055 shutdown_connections 2023-12-20T04:49:03.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:03.759+0000 7ff1f9c70640 1 -- 172.21.15.132:0/2022240055 wait complete. 2023-12-20T04:49:03.830 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-20T04:49:08.831 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:49:08.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.942+0000 7f78de3c3640 1 Processor -- start 2023-12-20T04:49:08.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.942+0000 7f78de3c3640 1 -- start start 2023-12-20T04:49:08.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.943+0000 7f78de3c3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78d80b4980 0x7f78d80b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:08.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.943+0000 7f78de3c3640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f78d80d1aa0 0x7f78d80d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:08.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.943+0000 7f78de3c3640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f78d80b5320 con 0x7f78d8160450 2023-12-20T04:49:08.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.943+0000 7f78de3c3640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f78d80b5ec0 con 0x7f78d80d1aa0 2023-12-20T04:49:08.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.943+0000 7f78de3c3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d81617e0 con 0x7f78d80b4980 2023-12-20T04:49:08.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.943+0000 7f78d77fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78d80b4980 0x7f78d80b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:08.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.944+0000 7f78dc960640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f78d80d1aa0 0x7f78d80d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:08.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.944+0000 7f78d77fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78d80b4980 0x7f78d80b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:34676/0 (socket says 172.21.15.132:34676) 2023-12-20T04:49:08.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.944+0000 7f78d77fe640 1 -- 172.21.15.132:0/2722125775 learned_addr learned my addr 172.21.15.132:0/2722125775 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:08.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.944+0000 7f78d77fe640 1 -- 172.21.15.132:0/2722125775 >> v2:172.21.15.187:3300/0 conn(0x7f78d80d1aa0 msgr2=0x7f78d80d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:08.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.944+0000 7f78d77fe640 1 --2- 172.21.15.132:0/2722125775 >> v2:172.21.15.187:3300/0 conn(0x7f78d80d1aa0 0x7f78d80d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:08.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.944+0000 7f78d77fe640 1 -- 172.21.15.132:0/2722125775 >> v1:172.21.15.187:6789/0 conn(0x7f78d8160450 legacy=0x7f78d8160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:08.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.944+0000 7f78d77fe640 1 -- 172.21.15.132:0/2722125775 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d80d0fc0 con 0x7f78d80b4980 2023-12-20T04:49:08.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.944+0000 7f78dc960640 1 --2- 172.21.15.132:0/2722125775 >> v2:172.21.15.187:3300/0 conn(0x7f78d80d1aa0 0x7f78d80d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:49:08.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.945+0000 7f78d77fe640 1 --2- 172.21.15.132:0/2722125775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78d80b4980 0x7f78d80b4de0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f78cc009870 tx=0x7f78cc02ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3aec22ba5e083926 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:08.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.945+0000 7f78d6ffd640 1 -- 172.21.15.132:0/2722125775 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc02f840 con 0x7f78d80b4980 2023-12-20T04:49:08.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.945+0000 7f78d6ffd640 1 -- 172.21.15.132:0/2722125775 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78cc02f9a0 con 0x7f78d80b4980 2023-12-20T04:49:08.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.945+0000 7f78d6ffd640 1 -- 172.21.15.132:0/2722125775 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78cc02fd30 con 0x7f78d80b4980 2023-12-20T04:49:08.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.945+0000 7f78de3c3640 1 -- 172.21.15.132:0/2722125775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78d80b4980 msgr2=0x7f78d80b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:08.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.945+0000 7f78de3c3640 1 --2- 172.21.15.132:0/2722125775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78d80b4980 0x7f78d80b4de0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f78cc009870 tx=0x7f78cc02ba20 comp rx=0 tx=0).stop 2023-12-20T04:49:08.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.945+0000 7f78de3c3640 1 -- 172.21.15.132:0/2722125775 shutdown_connections 2023-12-20T04:49:08.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.945+0000 7f78de3c3640 1 --2- 172.21.15.132:0/2722125775 >> v2:172.21.15.187:3300/0 conn(0x7f78d80d1aa0 0x7f78d80d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:08.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.945+0000 7f78de3c3640 1 --2- 172.21.15.132:0/2722125775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78d80b4980 0x7f78d80b4de0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:08.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.945+0000 7f78de3c3640 1 -- 172.21.15.132:0/2722125775 >> 172.21.15.132:0/2722125775 conn(0x7f78d80cf980 msgr2=0x7f78d80cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:08.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.946+0000 7f78de3c3640 1 -- 172.21.15.132:0/2722125775 shutdown_connections 2023-12-20T04:49:08.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.946+0000 7f78de3c3640 1 -- 172.21.15.132:0/2722125775 wait complete. 2023-12-20T04:49:08.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.947+0000 7f78de3c3640 1 Processor -- start 2023-12-20T04:49:08.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.947+0000 7f78de3c3640 1 -- start start 2023-12-20T04:49:08.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78de3c3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78d80b4980 0x7f78d81f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:08.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78de3c3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78d80d1aa0 0x7f78d8158f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:08.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78de3c3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78d8160450 0x7f78d81efca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:08.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78de3c3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d81f3c30 con 0x7f78d80b4980 2023-12-20T04:49:08.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78de3c3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f78d81574b0 con 0x7f78d8160450 2023-12-20T04:49:08.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78de3c3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f78d8157790 con 0x7f78d80d1aa0 2023-12-20T04:49:08.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78d7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78d80b4980 0x7f78d81f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:08.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78d7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78d80b4980 0x7f78d81f36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40544/0 (socket says 172.21.15.132:40544) 2023-12-20T04:49:08.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78d7fff640 1 -- 172.21.15.132:0/2019063469 learned_addr learned my addr 172.21.15.132:0/2019063469 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:08.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78dc960640 1 --2- 172.21.15.132:0/2019063469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78d8160450 0x7f78d81efca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:08.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78d77fe640 1 --2- 172.21.15.132:0/2019063469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78d80d1aa0 0x7f78d8158f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:08.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78d7fff640 1 -- 172.21.15.132:0/2019063469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78d80d1aa0 msgr2=0x7f78d8158f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:08.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78d7fff640 1 --2- 172.21.15.132:0/2019063469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78d80d1aa0 0x7f78d8158f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:08.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78d7fff640 1 -- 172.21.15.132:0/2019063469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78d8160450 msgr2=0x7f78d81efca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:08.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78d7fff640 1 --2- 172.21.15.132:0/2019063469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78d8160450 0x7f78d81efca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:08.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78d7fff640 1 -- 172.21.15.132:0/2019063469 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f78d0009a70 con 0x7f78d80b4980 2023-12-20T04:49:08.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78dc960640 1 --2- 172.21.15.132:0/2019063469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78d8160450 0x7f78d81efca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:08.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78d7fff640 1 --2- 172.21.15.132:0/2019063469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78d80b4980 0x7f78d81f36f0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f78c800c400 tx=0x7f78c800c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:08.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78d4ff9640 1 -- 172.21.15.132:0/2019063469 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c80052d0 con 0x7f78d80b4980 2023-12-20T04:49:08.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78d4ff9640 1 -- 172.21.15.132:0/2019063469 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f78c8005450 con 0x7f78d80b4980 2023-12-20T04:49:08.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78de3c3640 1 -- 172.21.15.132:0/2019063469 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f78cc0094d0 con 0x7f78d80b4980 2023-12-20T04:49:08.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78d4ff9640 1 -- 172.21.15.132:0/2019063469 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f78c8007260 con 0x7f78d80b4980 2023-12-20T04:49:08.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.948+0000 7f78de3c3640 1 -- 172.21.15.132:0/2019063469 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f78d8157d50 con 0x7f78d80b4980 2023-12-20T04:49:08.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.949+0000 7f78de3c3640 1 -- 172.21.15.132:0/2019063469 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f78d804e840 con 0x7f78d80b4980 2023-12-20T04:49:08.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.950+0000 7f78d4ff9640 1 -- 172.21.15.132:0/2019063469 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f78c80073c0 con 0x7f78d80b4980 2023-12-20T04:49:08.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.950+0000 7f78d4ff9640 1 --2- 172.21.15.132:0/2019063469 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f78c406a430 0x7f78c406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:08.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.950+0000 7f78d4ff9640 1 -- 172.21.15.132:0/2019063469 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(139..139 src has 1..139) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f78c8087d50 con 0x7f78d80b4980 2023-12-20T04:49:08.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.950+0000 7f78d77fe640 1 --2- 172.21.15.132:0/2019063469 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f78c406a430 0x7f78c406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:08.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.950+0000 7f78d4ff9640 1 -- 172.21.15.132:0/2019063469 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=140}) v3 -- 0x7f78c4071f60 con 0x7f78d80b4980 2023-12-20T04:49:08.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.951+0000 7f78d77fe640 1 --2- 172.21.15.132:0/2019063469 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f78c406a430 0x7f78c406c8f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f78cc036000 tx=0x7f78cc008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:08.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:08.955+0000 7f78d4ff9640 1 -- 172.21.15.132:0/2019063469 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f78c808b030 con 0x7f78d80b4980 2023-12-20T04:49:09.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:09.122+0000 7f78de3c3640 1 -- 172.21.15.132:0/2019063469 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f78d80d0ad0 con 0x7f78d80b4980 2023-12-20T04:49:09.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:09.123+0000 7f78d4ff9640 1 -- 172.21.15.132:0/2019063469 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v139) v1 ==== 81+0+33569 (secure 0 0 0) 0x7f78c8056dd0 con 0x7f78d80b4980 2023-12-20T04:49:09.126 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:09.126 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:49:09.126 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 139, 2023-12-20T04:49:09.126 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:49:09.126 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:49:09.126 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:48:59.853998+0000", 2023-12-20T04:49:09.126 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:49:09.126 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:49:09.127 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:49:09.127 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:49:09.127 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:49:09.127 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:49:09.127 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:49:09.127 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:49:09.127 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:49:09.127 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:09.127 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:49:09.127 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:49:09.127 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:49:09.128 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:49:09.128 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:49:09.128 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 17, 2023-12-20T04:49:09.128 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:49:09.128 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:49:09.128 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:49:09.128 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:49:09.128 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:49:09.128 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:49:09.128 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.128 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:49:09.128 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:49:09.128 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:49:09.129 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:49:09.129 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:49:09.129 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:09.129 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:09.129 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:09.129 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:09.129 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:09.129 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:09.129 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:09.129 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:09.129 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:09.130 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:09.130 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:49:09.130 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:49:09.130 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:49:09.130 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:49:09.130 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:49:09.130 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:09.130 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:09.130 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:09.130 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:09.130 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:09.130 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:09.131 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:09.131 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.131 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:49:09.131 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:09.131 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:09.131 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:09.131 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:09.131 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:09.131 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:09.131 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:09.131 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:09.131 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:09.132 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:49:09.132 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:09.132 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:09.132 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:09.132 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:09.132 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:09.132 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:09.132 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:09.132 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:09.132 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:09.132 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:09.132 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:09.132 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:09.133 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:09.133 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:09.133 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:09.133 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:09.133 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.133 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:09.133 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:09.133 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:09.133 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:09.133 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:09.133 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:09.133 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:09.134 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:09.134 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:09.134 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:09.134 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:09.134 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:09.134 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:49:09.134 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:49:09.134 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.134 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:09.134 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:49:09.134 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.134 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:09.135 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:49:09.135 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:49:09.135 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:49:09.135 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:49:09.135 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:49:09.135 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:09.135 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:09.135 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:09.135 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.135 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.135 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.135 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 16, 2023-12-20T04:49:09.136 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:49:09.136 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:48:35.008751+0000", 2023-12-20T04:49:09.136 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:49:09.136 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:49:09.136 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:09.136 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:09.136 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:09.136 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:09.136 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:09.136 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:09.136 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:09.136 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:09.136 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:09.137 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:09.137 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:49:09.137 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:49:09.137 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:49:09.137 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:49:09.137 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:49:09.137 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:09.137 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:09.137 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:09.137 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:09.137 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:09.137 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:09.138 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:09.138 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.138 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "136", 2023-12-20T04:49:09.138 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:09.138 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:09.138 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:09.138 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:09.138 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:09.138 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:09.138 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:09.138 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:09.138 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:09.139 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:49:09.139 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:09.139 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:09.139 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:09.139 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:09.139 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:09.139 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:09.139 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:09.139 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:09.139 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:09.139 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:09.139 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:09.140 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:09.140 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:09.140 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:09.140 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:09.140 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:09.140 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.140 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:09.140 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:09.140 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:09.140 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:09.140 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:09.140 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:09.140 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:09.141 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:09.141 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:09.141 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:09.141 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:09.141 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:09.141 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:49:09.141 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:49:09.141 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:49:09.141 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.141 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:09.141 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:49:09.141 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:49:09.141 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.142 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.142 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:09.142 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:49:09.142 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:49:09.142 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:49:09.142 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:49:09.142 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:49:09.142 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:09.142 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:09.142 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:09.142 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.142 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.142 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.143 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 17, 2023-12-20T04:49:09.143 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:49:09.143 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:48:36.182609+0000", 2023-12-20T04:49:09.143 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1027, 2023-12-20T04:49:09.143 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-20T04:49:09.143 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:09.143 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:09.143 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:09.143 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:09.143 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:09.143 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:09.143 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:09.144 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:09.144 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:09.144 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:09.144 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:49:09.144 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:49:09.144 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:49:09.144 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:49:09.144 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:49:09.144 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:09.144 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:09.144 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:09.144 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:09.144 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:09.144 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:09.145 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:09.145 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.145 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "139", 2023-12-20T04:49:09.145 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:09.145 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:09.145 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:09.145 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:09.145 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:09.145 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:09.145 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:09.145 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:09.145 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:09.145 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 33554432, 2023-12-20T04:49:09.146 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:09.146 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:09.146 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:09.146 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:09.146 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:09.146 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:09.146 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:09.146 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:09.146 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:09.146 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:09.146 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:09.146 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:09.146 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:09.146 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:09.147 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:09.147 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:09.147 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.147 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:09.147 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:09.147 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:09.147 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:09.147 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:09.147 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:09.147 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:09.147 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:09.147 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:09.147 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:09.148 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:09.148 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:09.148 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:49:09.148 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:49:09.148 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.148 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:09.148 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:49:09.148 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:49:09.148 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.148 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.148 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:09.148 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:49:09.148 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:49:09.148 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:49:09.149 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:49:09.149 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:49:09.149 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:09.149 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:09.149 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:09.149 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.149 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.149 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:09.149 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:49:09.149 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.149 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:49:09.149 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:09.149 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:09.150 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:09.150 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:09.150 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:09.150 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:09.150 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:09.150 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:09.150 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:09.150 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:09.150 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:09.150 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:09.150 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.150 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.150 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.150 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:49:09.150 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:09.151 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.151 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.151 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.151 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:49:09.151 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:09.151 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.151 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.151 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.151 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:09.151 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.151 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.151 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.151 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:49:09.151 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:09.152 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.152 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.152 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.152 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:49:09.152 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:09.152 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.152 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.152 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.152 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:09.152 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.152 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.152 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.152 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:49:09.153 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:09.153 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.153 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.153 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.153 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:49:09.153 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:09.153 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.153 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.153 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.153 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:09.153 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.154 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.154 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.154 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:49:09.154 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:09.154 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.154 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.154 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.154 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:49:09.154 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:09.154 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.154 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.154 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.154 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:49:09.155 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:49:09.155 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:49:09.155 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:49:09.155 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:09.155 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:09.155 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:09.155 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.155 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.155 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.155 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:49:09.155 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:09.155 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:09.155 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:09.155 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:09.156 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:09.156 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:09.156 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:09.156 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:09.156 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:09.156 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:09.156 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:09.156 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:09.156 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.156 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.156 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.156 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:49:09.156 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:09.156 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.157 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.157 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.157 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:49:09.157 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:09.157 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.157 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.157 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.157 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:09.157 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.157 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.157 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.157 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:49:09.157 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:09.157 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.158 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.158 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.158 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:49:09.158 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:09.158 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.158 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.158 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.158 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:09.158 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.158 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.158 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.158 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:49:09.158 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:09.158 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.159 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.159 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.159 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:49:09.159 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:09.159 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.159 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.159 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.159 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:09.159 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.159 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.159 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.159 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:49:09.159 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:09.159 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.160 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.160 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.160 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:49:09.160 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:09.160 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.160 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.160 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.160 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:49:09.160 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:49:09.160 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:49:09.160 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:49:09.160 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:09.160 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:09.160 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:09.161 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.161 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.161 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:49:09.161 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:09.161 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:09.161 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:09.161 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:09.161 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:09.161 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:09.161 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:09.161 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:09.161 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:09.161 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:09.161 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:09.162 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:09.162 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.162 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.162 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:49:09.162 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:09.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.162 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.162 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:49:09.162 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:09.162 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.162 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.162 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:09.163 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.163 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.163 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.163 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:49:09.163 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:09.163 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.163 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.163 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.163 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:49:09.163 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:09.163 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.163 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.163 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.163 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:09.164 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.164 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.164 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.164 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:49:09.164 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:09.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.164 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.164 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.164 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:49:09.164 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:09.164 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.164 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.164 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:09.165 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.165 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.165 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.165 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:49:09.165 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:09.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.165 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.165 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.165 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:49:09.165 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:09.165 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.165 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.165 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:49:09.166 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:49:09.166 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:49:09.166 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:49:09.166 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:09.166 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:09.166 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:09.166 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.166 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.166 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.166 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:49:09.166 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:09.166 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:09.166 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:09.167 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:09.167 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:09.167 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:09.167 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:09.167 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:09.167 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:09.167 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:09.167 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:09.167 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:09.167 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.167 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.168 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:49:09.168 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:09.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.168 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.168 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:49:09.168 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:09.168 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.168 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.168 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:09.168 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.168 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.169 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:49:09.169 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:09.169 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.169 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.169 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.169 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:49:09.169 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:09.169 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.169 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.169 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.169 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:09.169 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.169 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.169 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.170 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:49:09.170 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:09.170 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.170 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.170 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.170 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:49:09.170 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:09.170 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.170 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.170 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.170 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:09.170 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.170 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.170 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.170 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:49:09.171 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:09.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.171 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.171 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.171 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:49:09.171 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:09.171 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.171 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.171 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:49:09.171 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:49:09.171 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:49:09.171 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:49:09.171 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:09.171 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:09.172 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:09.172 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.172 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:49:09.172 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:09.172 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:09.172 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:09.172 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:09.172 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:09.172 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:09.172 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:09.172 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:09.172 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:09.173 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:09.173 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:09.173 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:09.173 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.173 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.173 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:49:09.173 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:09.173 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.173 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.173 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:49:09.173 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:09.173 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.174 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.174 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:09.174 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.174 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.174 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.174 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:49:09.174 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:09.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.174 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.174 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.174 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:49:09.174 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:09.174 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.175 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.175 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:09.175 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.175 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.175 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.175 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:49:09.175 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:09.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.175 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.175 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.175 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:49:09.175 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:09.175 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.176 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.176 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:09.176 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.176 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.176 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.176 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:49:09.176 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:09.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.176 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.176 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.176 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:49:09.176 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:09.176 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.177 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.177 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:49:09.177 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:49:09.177 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:49:09.177 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:49:09.177 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:09.177 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:09.177 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:09.177 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.177 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:49:09.178 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:09.178 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:09.178 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:09.178 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:09.178 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:09.178 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:09.178 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:09.178 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:09.178 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:09.178 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:09.178 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:09.178 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:09.178 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.178 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.179 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.179 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:49:09.179 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:09.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.179 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.179 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:49:09.179 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:09.179 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.179 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.179 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:09.179 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.180 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.180 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:49:09.180 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:09.180 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.180 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.180 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.180 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:49:09.180 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:09.180 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.180 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.180 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.180 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:09.180 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.180 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.180 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.181 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:49:09.181 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:09.181 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.181 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.181 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:49:09.181 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:09.181 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.181 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.181 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.181 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:09.181 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.181 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.182 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:49:09.182 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:09.182 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.182 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.182 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.182 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:49:09.182 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:09.182 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.182 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.182 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.182 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:49:09.182 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:49:09.182 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:49:09.182 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:49:09.182 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:09.183 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:09.183 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:09.183 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.183 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.183 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:49:09.183 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:09.183 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:09.183 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:09.183 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:09.183 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:09.183 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:09.183 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:09.184 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:09.184 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:09.184 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:09.184 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:09.184 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:09.184 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.184 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.184 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.184 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:49:09.184 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:09.184 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.184 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.184 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.184 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:49:09.185 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:09.185 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.185 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.185 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:09.185 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.185 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.185 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.185 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:49:09.185 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:09.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.185 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.185 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.185 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:49:09.185 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:09.186 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.186 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.186 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:09.186 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.186 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.186 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.186 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:49:09.186 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:09.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.186 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.186 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.186 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:49:09.186 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:09.187 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.187 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.187 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:09.187 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.187 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.187 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:49:09.187 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:09.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.187 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.187 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:49:09.187 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:09.188 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.188 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.188 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:49:09.188 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:49:09.188 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:49:09.188 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:49:09.188 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:09.188 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:09.188 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:09.188 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.188 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.188 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:49:09.188 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:09.189 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:09.189 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:09.189 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:09.189 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:09.189 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:09.189 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:09.189 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:09.189 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:09.189 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:09.189 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:09.189 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:09.189 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.189 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.189 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.190 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:49:09.190 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:09.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.190 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.190 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.190 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:49:09.190 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:09.190 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.190 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.190 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:09.190 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.191 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.191 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.191 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:49:09.191 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:09.191 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.191 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.191 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.191 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:49:09.191 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:09.191 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.191 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.191 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.192 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:09.192 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.192 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.192 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.192 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:49:09.192 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:09.192 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.192 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.192 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.192 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:49:09.192 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:09.192 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.192 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.193 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.193 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:09.193 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:09.193 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.193 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:09.193 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:49:09.193 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:09.193 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.193 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.193 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:09.193 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:49:09.193 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:09.193 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.194 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.194 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.194 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:49:09.194 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:49:09.194 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:49:09.194 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:49:09.194 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:09.194 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:09.194 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:09.194 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:09.194 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.194 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:09.194 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:49:09.195 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.195 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:49:09.195 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:09.195 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:09.195 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:09.195 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:09.195 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:09.195 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:49:09.195 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:09.195 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.195 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.196 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:49:09.196 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:09.196 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:09.196 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:09.196 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:09.196 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:09.196 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:49:09.196 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:09.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.196 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.197 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:49:09.197 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:09.197 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:09.197 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:09.197 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:09.197 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:09.197 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:49:09.197 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:09.197 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.197 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.197 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:49:09.198 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:09.198 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:09.198 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:09.198 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:09.198 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:09.198 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:49:09.198 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:09.198 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.198 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.198 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:49:09.198 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:09.198 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:09.198 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:09.199 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:09.199 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:09.199 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:49:09.199 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:09.199 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.199 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.199 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:49:09.199 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:09.199 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:09.199 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:09.199 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:09.199 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:09.199 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:49:09.199 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:09.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.200 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.200 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:49:09.200 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:09.200 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:09.200 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:09.200 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:09.200 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:09.200 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:49:09.200 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:09.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.200 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:09.200 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:49:09.200 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:09.200 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:09.201 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:09.201 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:09.201 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:09.201 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:49:09.201 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:09.201 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.201 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:09.201 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:49:09.201 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:49:09.201 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:49:09.201 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:49:09.201 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:49:09.201 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:49:09.202 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:49:09.202 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:49:09.202 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:49:09.202 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:49:09.202 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:49:09.202 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:49:09.202 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:49:09.202 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:49:09.202 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.202 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:09.202 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:49:09.202 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:49:09.202 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:49:09.202 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:49:09.203 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:49:09.203 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:49:09.203 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:49:09.203 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:49:09.203 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:49:09.203 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:49:09.203 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:49:09.203 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:09.203 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:49:09.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:09.125+0000 7f78de3c3640 1 -- 172.21.15.132:0/2019063469 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f78c406a430 msgr2=0x7f78c406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:09.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:09.125+0000 7f78de3c3640 1 --2- 172.21.15.132:0/2019063469 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f78c406a430 0x7f78c406c8f0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f78cc036000 tx=0x7f78cc008030 comp rx=0 tx=0).stop 2023-12-20T04:49:09.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:09.125+0000 7f78de3c3640 1 -- 172.21.15.132:0/2019063469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78d80b4980 msgr2=0x7f78d81f36f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:09.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:09.125+0000 7f78de3c3640 1 --2- 172.21.15.132:0/2019063469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78d80b4980 0x7f78d81f36f0 secure :-1 s=READY pgs=1406 cs=0 l=1 rev1=1 crypto rx=0x7f78c800c400 tx=0x7f78c800c8c0 comp rx=0 tx=0).stop 2023-12-20T04:49:09.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:09.125+0000 7f78de3c3640 1 -- 172.21.15.132:0/2019063469 shutdown_connections 2023-12-20T04:49:09.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:09.125+0000 7f78de3c3640 1 --2- 172.21.15.132:0/2019063469 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f78c406a430 0x7f78c406c8f0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:09.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:09.125+0000 7f78de3c3640 1 --2- 172.21.15.132:0/2019063469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f78d8160450 0x7f78d81efca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:09.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:09.125+0000 7f78de3c3640 1 --2- 172.21.15.132:0/2019063469 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f78d80d1aa0 0x7f78d8158f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:09.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:09.125+0000 7f78de3c3640 1 --2- 172.21.15.132:0/2019063469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f78d80b4980 0x7f78d81f36f0 unknown :-1 s=CLOSED pgs=1406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:09.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:09.125+0000 7f78de3c3640 1 -- 172.21.15.132:0/2019063469 >> 172.21.15.132:0/2019063469 conn(0x7f78d80cf980 msgr2=0x7f78d80b80e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:09.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:09.125+0000 7f78de3c3640 1 -- 172.21.15.132:0/2019063469 shutdown_connections 2023-12-20T04:49:09.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:09.125+0000 7f78de3c3640 1 -- 172.21.15.132:0/2019063469 wait complete. 2023-12-20T04:49:09.206 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-20T04:49:14.207 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:49:14.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.316+0000 7fca2a2ec640 1 Processor -- start 2023-12-20T04:49:14.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.316+0000 7fca2a2ec640 1 -- start start 2023-12-20T04:49:14.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.317+0000 7fca2a2ec640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fca240718e0 0x7fca240cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:14.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.317+0000 7fca2a2ec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fca2406fd60 0x7fca24071cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:14.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.317+0000 7fca2a2ec640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca240ca8e0 0x7fca240b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.317+0000 7fca2a2ec640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca2415b3f0 con 0x7fca2406fd60 2023-12-20T04:49:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.317+0000 7fca2a2ec640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fca240cbba0 con 0x7fca240718e0 2023-12-20T04:49:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.317+0000 7fca2a2ec640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca24072200 con 0x7fca240ca8e0 2023-12-20T04:49:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.317+0000 7fca237fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fca2406fd60 0x7fca24071cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.317+0000 7fca237fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fca2406fd60 0x7fca24071cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40554/0 (socket says 172.21.15.132:40554) 2023-12-20T04:49:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.317+0000 7fca237fe640 1 -- 172.21.15.132:0/909133293 learned_addr learned my addr 172.21.15.132:0/909133293 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.317+0000 7fca23fff640 1 --2- 172.21.15.132:0/909133293 >> v2:172.21.15.187:3300/0 conn(0x7fca240718e0 0x7fca240cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.317+0000 7fca28889640 1 --2- 172.21.15.132:0/909133293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca240ca8e0 0x7fca240b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.317+0000 7fca237fe640 1 -- 172.21.15.132:0/909133293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca240ca8e0 msgr2=0x7fca240b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.317+0000 7fca237fe640 1 --2- 172.21.15.132:0/909133293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca240ca8e0 0x7fca240b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.317+0000 7fca237fe640 1 -- 172.21.15.132:0/909133293 >> v2:172.21.15.187:3300/0 conn(0x7fca240718e0 msgr2=0x7fca240cb4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.317+0000 7fca237fe640 1 --2- 172.21.15.132:0/909133293 >> v2:172.21.15.187:3300/0 conn(0x7fca240718e0 0x7fca240cb4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.317+0000 7fca237fe640 1 -- 172.21.15.132:0/909133293 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca2406cde0 con 0x7fca2406fd60 2023-12-20T04:49:14.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.318+0000 7fca237fe640 1 --2- 172.21.15.132:0/909133293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca2406fd60 0x7fca24071cc0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fca240d0430 tx=0x7fca1802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3183d9ea48a0b360 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:14.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.318+0000 7fca22ffd640 1 -- 172.21.15.132:0/909133293 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca180317e0 con 0x7fca2406fd60 2023-12-20T04:49:14.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.318+0000 7fca22ffd640 1 -- 172.21.15.132:0/909133293 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca18031940 con 0x7fca2406fd60 2023-12-20T04:49:14.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.318+0000 7fca22ffd640 1 -- 172.21.15.132:0/909133293 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca18031cd0 con 0x7fca2406fd60 2023-12-20T04:49:14.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.319+0000 7fca2a2ec640 1 -- 172.21.15.132:0/909133293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca2406fd60 msgr2=0x7fca24071cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:14.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.319+0000 7fca2a2ec640 1 --2- 172.21.15.132:0/909133293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca2406fd60 0x7fca24071cc0 secure :-1 s=READY pgs=1407 cs=0 l=1 rev1=1 crypto rx=0x7fca240d0430 tx=0x7fca1802b880 comp rx=0 tx=0).stop 2023-12-20T04:49:14.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.319+0000 7fca2a2ec640 1 -- 172.21.15.132:0/909133293 shutdown_connections 2023-12-20T04:49:14.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.319+0000 7fca2a2ec640 1 --2- 172.21.15.132:0/909133293 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca240ca8e0 0x7fca240b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.319+0000 7fca2a2ec640 1 --2- 172.21.15.132:0/909133293 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca2406fd60 0x7fca24071cc0 unknown :-1 s=CLOSED pgs=1407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.319+0000 7fca2a2ec640 1 --2- 172.21.15.132:0/909133293 >> v2:172.21.15.187:3300/0 conn(0x7fca240718e0 0x7fca240cb4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.319+0000 7fca2a2ec640 1 -- 172.21.15.132:0/909133293 >> 172.21.15.132:0/909133293 conn(0x7fca240cf330 msgr2=0x7fca240cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:14.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.319+0000 7fca2a2ec640 1 -- 172.21.15.132:0/909133293 shutdown_connections 2023-12-20T04:49:14.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.319+0000 7fca2a2ec640 1 -- 172.21.15.132:0/909133293 wait complete. 2023-12-20T04:49:14.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.320+0000 7fca2a2ec640 1 Processor -- start 2023-12-20T04:49:14.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.320+0000 7fca2a2ec640 1 -- start start 2023-12-20T04:49:14.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.321+0000 7fca2a2ec640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2406fd60 0x7fca2414f520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:14.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.321+0000 7fca2a2ec640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca240718e0 0x7fca240c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:14.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.321+0000 7fca2a2ec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca240ca8e0 0x7fca240c6400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:14.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.321+0000 7fca2a2ec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca2414fa60 con 0x7fca240ca8e0 2023-12-20T04:49:14.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.321+0000 7fca2a2ec640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca240c6ec0 con 0x7fca2406fd60 2023-12-20T04:49:14.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.321+0000 7fca2a2ec640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fca240c71a0 con 0x7fca240718e0 2023-12-20T04:49:14.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.321+0000 7fca28889640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca240ca8e0 0x7fca240c6400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:14.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.321+0000 7fca28889640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca240ca8e0 0x7fca240c6400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40562/0 (socket says 172.21.15.132:40562) 2023-12-20T04:49:14.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.321+0000 7fca28889640 1 -- 172.21.15.132:0/2715033309 learned_addr learned my addr 172.21.15.132:0/2715033309 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:14.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.321+0000 7fca23fff640 1 --2- 172.21.15.132:0/2715033309 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2406fd60 0x7fca2414f520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:14.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.321+0000 7fca237fe640 1 --2- 172.21.15.132:0/2715033309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca240718e0 0x7fca240c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:14.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.321+0000 7fca28889640 1 -- 172.21.15.132:0/2715033309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca240718e0 msgr2=0x7fca240c7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:14.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.321+0000 7fca28889640 1 --2- 172.21.15.132:0/2715033309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca240718e0 0x7fca240c7f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.321+0000 7fca28889640 1 -- 172.21.15.132:0/2715033309 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2406fd60 msgr2=0x7fca2414f520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:14.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.321+0000 7fca28889640 1 --2- 172.21.15.132:0/2715033309 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2406fd60 0x7fca2414f520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.321+0000 7fca28889640 1 -- 172.21.15.132:0/2715033309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca180094d0 con 0x7fca240ca8e0 2023-12-20T04:49:14.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.322+0000 7fca28889640 1 --2- 172.21.15.132:0/2715033309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca240ca8e0 0x7fca240c6400 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fca1c007e40 tx=0x7fca1c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:14.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.322+0000 7fca20ff9640 1 -- 172.21.15.132:0/2715033309 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c014620 con 0x7fca240ca8e0 2023-12-20T04:49:14.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.322+0000 7fca20ff9640 1 -- 172.21.15.132:0/2715033309 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca1c00ee90 con 0x7fca240ca8e0 2023-12-20T04:49:14.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.322+0000 7fca2a2ec640 1 -- 172.21.15.132:0/2715033309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca240c7480 con 0x7fca240ca8e0 2023-12-20T04:49:14.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.322+0000 7fca20ff9640 1 -- 172.21.15.132:0/2715033309 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca1c0149e0 con 0x7fca240ca8e0 2023-12-20T04:49:14.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.322+0000 7fca2a2ec640 1 -- 172.21.15.132:0/2715033309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca240c7a40 con 0x7fca240ca8e0 2023-12-20T04:49:14.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.323+0000 7fca2a2ec640 1 -- 172.21.15.132:0/2715033309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca2406c470 con 0x7fca240ca8e0 2023-12-20T04:49:14.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.323+0000 7fca20ff9640 1 -- 172.21.15.132:0/2715033309 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fca1c014b40 con 0x7fca240ca8e0 2023-12-20T04:49:14.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.324+0000 7fca20ff9640 1 --2- 172.21.15.132:0/2715033309 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca1006a430 0x7fca1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:14.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.324+0000 7fca23fff640 1 --2- 172.21.15.132:0/2715033309 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca1006a430 0x7fca1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:14.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.324+0000 7fca20ff9640 1 -- 172.21.15.132:0/2715033309 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca1c089240 con 0x7fca240ca8e0 2023-12-20T04:49:14.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.324+0000 7fca23fff640 1 --2- 172.21.15.132:0/2715033309 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca1006a430 0x7fca1006c8f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fca14006fd0 tx=0x7fca14008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:14.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.328+0000 7fca20ff9640 1 -- 172.21.15.132:0/2715033309 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fca1c054830 con 0x7fca240ca8e0 2023-12-20T04:49:14.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.493+0000 7fca2a2ec640 1 -- 172.21.15.132:0/2715033309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7fca240c7c30 con 0x7fca240ca8e0 2023-12-20T04:49:14.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.494+0000 7fca20ff9640 1 -- 172.21.15.132:0/2715033309 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) v1 ==== 81+0+33550 (secure 0 0 0) 0x7fca1c057e50 con 0x7fca240ca8e0 2023-12-20T04:49:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:14.497 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:49:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 140, 2023-12-20T04:49:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:49:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:49:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:49:09.856481+0000", 2023-12-20T04:49:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:49:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:49:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:49:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:49:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:49:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:49:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:49:14.497 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:49:14.498 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:49:14.498 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:14.498 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:49:14.498 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:49:14.498 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:49:14.498 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:49:14.498 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:49:14.498 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 17, 2023-12-20T04:49:14.498 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:49:14.498 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:49:14.498 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:49:14.498 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:49:14.498 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:49:14.499 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:49:14.499 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.499 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:49:14.499 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:49:14.499 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:49:14.499 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:49:14.499 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:49:14.499 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:14.499 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:14.499 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:14.499 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:14.499 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:14.499 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:14.499 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:14.499 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:14.499 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:14.500 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:14.500 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:49:14.500 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:49:14.500 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:49:14.500 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:49:14.500 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:49:14.500 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:14.500 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:14.500 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:14.500 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:14.500 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:14.500 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:14.500 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:14.500 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.501 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:49:14.501 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:14.501 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:14.501 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:14.501 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:14.501 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:14.501 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:14.501 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:14.501 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:14.501 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:14.501 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:49:14.501 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:14.501 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:14.501 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:14.501 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:14.501 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:14.501 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:14.502 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:14.502 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:14.502 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:14.502 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:14.502 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:14.502 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:14.502 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:14.502 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:14.502 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:14.502 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:14.502 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.502 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:14.502 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:14.502 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:14.502 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:14.502 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:14.503 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:14.503 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:14.503 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:14.503 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:14.503 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:14.503 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:14.503 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:14.503 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:49:14.503 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:49:14.503 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.503 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:14.503 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:49:14.503 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.503 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:14.503 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:49:14.503 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:49:14.504 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:49:14.504 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:49:14.504 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:49:14.504 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:14.504 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:14.504 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:14.504 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.504 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.504 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.504 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 16, 2023-12-20T04:49:14.504 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:49:14.504 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:48:35.008751+0000", 2023-12-20T04:49:14.504 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:49:14.504 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:49:14.504 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:14.504 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:14.505 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:14.505 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:14.505 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:14.505 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:14.505 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:14.505 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:14.505 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:14.505 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:14.505 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:49:14.505 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:49:14.505 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:49:14.505 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:49:14.505 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:49:14.505 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:14.505 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:14.505 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:14.506 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:14.506 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:14.506 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:14.506 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:14.506 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.506 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "136", 2023-12-20T04:49:14.506 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:14.506 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:14.506 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:14.506 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:14.506 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:14.506 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:14.506 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:14.506 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:14.506 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:14.506 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:49:14.507 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:14.507 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:14.507 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:14.507 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:14.507 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:14.507 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:14.507 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:14.507 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:14.507 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:14.507 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:14.507 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:14.507 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:14.507 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:14.507 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:14.507 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:14.507 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:14.507 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.508 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:14.508 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:14.508 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:14.508 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:14.508 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:14.508 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:14.508 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:14.508 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:14.508 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:14.508 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:14.508 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:14.508 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:14.508 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:49:14.508 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:49:14.508 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:49:14.508 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.509 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:14.509 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:49:14.509 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:49:14.509 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.509 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.509 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:14.509 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:49:14.509 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:49:14.509 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:49:14.509 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:49:14.509 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:49:14.509 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:14.509 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:14.509 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:14.509 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.510 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.510 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.510 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 17, 2023-12-20T04:49:14.510 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:49:14.510 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:48:36.182609+0000", 2023-12-20T04:49:14.510 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:49:14.510 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:49:14.510 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:14.510 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:14.510 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:14.510 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:14.510 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:14.510 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:14.510 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:14.510 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:14.510 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:14.511 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:14.511 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:49:14.511 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:49:14.511 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:49:14.511 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:49:14.511 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:49:14.511 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:14.511 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:14.511 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:14.511 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:14.511 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:14.511 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:14.511 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:14.511 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.511 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "140", 2023-12-20T04:49:14.511 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:14.512 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:14.512 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:14.512 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:14.512 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:14.512 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:14.512 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:14.512 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:14.512 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:14.512 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 33554432, 2023-12-20T04:49:14.512 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:14.512 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:14.512 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:14.512 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:14.512 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:14.512 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:14.512 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:14.513 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:14.513 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:14.513 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:14.513 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:14.513 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:14.513 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:14.513 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:14.513 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:14.513 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:14.513 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.513 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:14.513 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:14.513 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:14.513 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:14.513 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:14.514 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:14.514 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:14.514 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:14.514 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:14.514 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:14.514 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:14.514 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:14.514 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:49:14.514 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:49:14.514 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.514 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:14.514 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:49:14.514 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:49:14.514 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.514 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.514 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:14.515 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:49:14.515 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:49:14.515 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:49:14.515 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:49:14.515 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:49:14.515 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:14.515 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:14.515 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:14.515 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.515 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.515 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:14.515 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:49:14.515 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.515 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:49:14.515 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:14.515 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:14.516 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:14.516 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:14.516 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:14.516 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:14.516 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:14.516 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:14.516 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:14.516 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:14.516 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:14.516 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:14.516 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.516 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.516 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.516 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:49:14.516 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:14.516 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.517 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.517 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.517 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:49:14.517 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:14.517 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.517 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.517 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.517 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:14.517 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.517 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.517 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.517 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:49:14.517 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:14.517 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.517 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.518 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.518 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:49:14.518 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:14.518 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.518 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.518 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.518 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:14.518 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.518 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.518 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.518 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:49:14.518 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:14.518 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.518 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.518 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.518 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:49:14.519 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:14.519 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.519 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.519 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.519 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:14.519 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.519 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.519 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.519 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:49:14.519 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:14.519 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.519 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.519 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.519 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:49:14.519 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:14.520 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.520 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.520 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.520 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:49:14.520 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:49:14.520 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:49:14.520 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:49:14.520 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:14.520 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:14.520 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:14.520 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.520 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.520 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.520 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:49:14.520 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:14.521 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:14.521 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:14.521 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:14.521 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:14.521 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:14.521 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:14.521 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:14.521 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:14.521 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:14.521 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:14.521 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:14.521 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.521 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.521 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.521 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:49:14.522 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:14.522 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.522 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.522 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.522 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:49:14.522 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:14.522 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.522 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.522 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.522 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:14.522 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.522 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.522 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.522 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:49:14.522 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:14.522 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.522 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.523 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.523 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:49:14.523 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:14.523 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.523 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.523 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.523 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:14.523 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.523 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.523 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.523 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:49:14.523 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:14.523 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.523 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.523 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.523 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:49:14.523 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:49:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:49:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.525 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:49:14.525 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:49:14.525 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:49:14.525 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:49:14.525 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:14.525 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:14.525 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:14.525 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.525 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.525 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.525 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:49:14.525 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:14.525 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:14.525 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:14.525 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:14.525 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:14.526 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:14.526 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:14.526 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:14.526 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:14.526 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:14.526 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:14.526 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:14.526 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.526 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.526 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.526 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:49:14.526 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:14.526 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.526 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.526 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.526 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:49:14.526 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:14.527 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.527 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.527 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.527 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:14.527 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.527 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.527 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.527 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:49:14.527 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:14.527 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.527 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.527 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.527 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:49:14.527 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:14.527 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.527 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.527 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.528 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:14.528 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.528 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.528 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.528 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:49:14.528 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:14.528 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.528 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.528 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.528 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:49:14.528 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:14.528 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.528 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.528 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.528 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:14.528 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.529 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.529 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.529 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:49:14.529 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:14.529 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.529 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.529 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.529 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:49:14.529 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:14.529 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.529 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.529 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.529 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:49:14.530 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:49:14.530 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:49:14.530 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:49:14.530 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:14.530 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:14.530 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:14.530 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.530 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.530 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.530 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:49:14.530 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:14.530 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:14.530 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:14.530 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:14.530 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:14.530 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:14.531 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:14.531 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:14.531 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:14.531 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:14.531 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:14.531 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:14.531 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.531 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.531 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.531 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:49:14.531 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:14.531 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.531 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.531 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.531 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:49:14.531 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:14.531 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.532 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.532 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.532 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:14.532 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.532 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.532 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.532 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:49:14.532 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:14.532 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.532 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.532 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.532 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:49:14.532 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:14.532 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.532 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.532 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.532 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:14.533 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.533 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.533 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.533 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:49:14.533 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:14.533 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.533 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.533 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.533 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:49:14.533 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:14.533 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.533 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.533 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.533 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:14.533 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.533 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.534 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.534 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:49:14.534 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:14.534 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.534 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.534 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.534 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:49:14.534 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:14.534 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.534 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.534 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.534 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:49:14.534 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:49:14.534 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:49:14.534 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:49:14.535 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:14.535 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:14.535 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:14.535 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.535 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.535 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.535 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:49:14.535 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:14.535 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:14.535 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:14.535 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:14.535 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:14.535 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:14.535 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:14.535 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:14.536 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:14.536 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:14.536 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:14.536 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:14.536 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.536 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.536 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.536 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:49:14.536 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:14.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.536 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.536 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.536 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:49:14.536 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:14.536 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.536 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.537 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:14.537 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.537 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.537 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.537 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:49:14.537 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:14.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.537 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.537 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.537 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:49:14.537 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:14.537 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.537 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.537 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:14.537 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.537 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.538 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.538 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:49:14.538 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:14.538 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.538 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.538 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.538 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:49:14.538 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:14.538 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.538 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.538 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.538 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:14.538 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.538 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.539 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.539 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:49:14.539 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:14.539 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.539 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.539 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.539 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:49:14.539 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:14.539 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.539 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.539 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.539 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:49:14.539 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:49:14.539 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:49:14.539 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:49:14.539 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:14.540 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:14.540 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:14.540 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.540 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.540 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:49:14.540 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:14.540 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:14.540 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:14.540 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:14.540 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:14.540 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:14.540 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:14.540 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:14.540 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:14.540 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:14.541 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:14.541 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:14.541 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.541 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.541 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:49:14.541 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:14.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.541 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.541 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:49:14.541 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:14.541 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.541 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.541 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:14.541 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.542 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.542 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.542 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:49:14.542 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:14.542 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.542 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.542 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.542 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:49:14.542 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:14.542 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.542 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.542 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.542 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:14.542 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.542 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.542 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.542 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:49:14.543 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:14.543 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.543 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.543 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.543 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:49:14.543 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:14.543 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.543 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.543 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.543 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:14.543 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.543 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.543 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.543 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:49:14.543 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:14.543 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.544 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.544 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.544 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:49:14.544 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:14.544 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.544 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.544 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:49:14.544 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:49:14.544 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:49:14.544 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:49:14.544 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:14.544 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:14.544 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:14.544 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.544 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.545 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:49:14.545 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:14.545 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:14.545 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:14.545 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:14.545 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:14.545 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:14.545 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:14.545 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:14.545 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:14.545 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:14.545 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:14.545 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:14.545 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.545 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.546 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.546 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:49:14.546 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:14.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.546 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.546 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.546 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:49:14.546 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:14.546 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.546 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.546 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:14.546 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.546 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.546 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.546 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:49:14.547 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:14.547 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.547 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.547 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.547 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:49:14.547 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:14.547 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.547 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.547 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.547 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:14.547 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.547 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.547 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.547 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:49:14.547 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:14.547 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.547 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.548 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.548 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:49:14.548 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:14.548 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.548 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.548 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.548 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:14.548 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.548 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.548 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.548 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:49:14.548 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:14.548 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.548 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.548 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.548 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:49:14.548 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:14.549 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.549 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.549 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.549 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:49:14.549 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:49:14.549 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:49:14.549 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:49:14.549 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:14.549 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:14.549 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:14.549 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.549 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.549 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.549 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:49:14.550 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:14.550 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:14.550 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:14.550 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:14.550 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:14.550 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:14.550 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:14.550 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:14.550 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:14.550 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:14.550 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:14.550 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:14.550 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.550 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.550 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.550 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:49:14.551 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:14.551 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.551 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.551 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.551 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:49:14.551 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:14.551 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.551 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.551 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.551 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:14.551 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.551 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.551 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.551 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:49:14.551 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:14.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.552 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.552 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:49:14.552 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:14.552 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.552 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.552 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:14.552 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.552 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.552 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:49:14.552 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:14.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.553 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.553 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:49:14.553 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:14.553 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.553 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.553 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:14.553 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.553 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.553 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.553 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:49:14.553 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:14.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.553 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.553 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.553 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:49:14.554 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:14.554 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.554 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.554 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.554 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:49:14.554 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:49:14.554 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:49:14.554 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:49:14.554 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:14.554 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:14.554 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:14.554 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.554 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.554 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:14.554 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:49:14.554 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.555 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:49:14.555 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:14.555 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:14.555 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:14.555 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:14.555 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:14.555 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:49:14.555 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:14.555 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.555 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.555 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:49:14.555 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:14.555 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:14.555 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:14.555 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:14.555 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:14.556 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:49:14.556 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:14.556 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.556 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.556 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:49:14.556 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:14.556 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:14.556 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:14.556 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:14.556 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:14.556 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:49:14.556 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:14.556 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.556 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.556 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:49:14.556 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:14.557 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:14.557 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:14.557 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:14.557 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:14.557 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:49:14.557 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:14.557 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.557 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.557 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:49:14.557 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:14.557 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:14.557 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:14.557 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:14.557 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:14.557 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:49:14.557 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:14.557 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.558 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.558 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:49:14.558 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:14.558 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:14.558 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:14.558 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:14.558 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:14.558 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:49:14.558 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:14.558 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.558 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.558 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:49:14.558 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:14.558 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:14.558 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:14.558 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:14.558 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:49:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:49:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:49:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:49:14.559 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:49:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:49:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:49:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:49:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:49:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:49:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:49:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:49:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:49:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:49:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:49:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:49:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:49:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:49:14.560 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:49:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:49:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:49:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:49:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:49:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:49:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:49:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:49:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:49:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:49:14.561 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.561 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:49:14.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.496+0000 7fca2a2ec640 1 -- 172.21.15.132:0/2715033309 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca1006a430 msgr2=0x7fca1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:14.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.496+0000 7fca2a2ec640 1 --2- 172.21.15.132:0/2715033309 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca1006a430 0x7fca1006c8f0 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7fca14006fd0 tx=0x7fca14008040 comp rx=0 tx=0).stop 2023-12-20T04:49:14.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.496+0000 7fca2a2ec640 1 -- 172.21.15.132:0/2715033309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca240ca8e0 msgr2=0x7fca240c6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:14.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.496+0000 7fca2a2ec640 1 --2- 172.21.15.132:0/2715033309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca240ca8e0 0x7fca240c6400 secure :-1 s=READY pgs=1408 cs=0 l=1 rev1=1 crypto rx=0x7fca1c007e40 tx=0x7fca1c00e4b0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.496+0000 7fca2a2ec640 1 -- 172.21.15.132:0/2715033309 shutdown_connections 2023-12-20T04:49:14.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.496+0000 7fca2a2ec640 1 --2- 172.21.15.132:0/2715033309 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca1006a430 0x7fca1006c8f0 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.496+0000 7fca2a2ec640 1 --2- 172.21.15.132:0/2715033309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fca240ca8e0 0x7fca240c6400 unknown :-1 s=CLOSED pgs=1408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.496+0000 7fca2a2ec640 1 --2- 172.21.15.132:0/2715033309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fca240718e0 0x7fca240c7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.496+0000 7fca2a2ec640 1 --2- 172.21.15.132:0/2715033309 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fca2406fd60 0x7fca2414f520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.496+0000 7fca2a2ec640 1 -- 172.21.15.132:0/2715033309 >> 172.21.15.132:0/2715033309 conn(0x7fca240cf330 msgr2=0x7fca240cf710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:14.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.496+0000 7fca2a2ec640 1 -- 172.21.15.132:0/2715033309 shutdown_connections 2023-12-20T04:49:14.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.496+0000 7fca2a2ec640 1 -- 172.21.15.132:0/2715033309 wait complete. 2023-12-20T04:49:14.564 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-20T04:49:14.564 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:49:14.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.662+0000 7f42d721e640 1 Processor -- start 2023-12-20T04:49:14.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.662+0000 7f42d721e640 1 -- start start 2023-12-20T04:49:14.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.662+0000 7f42d721e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42d00d0370 0x7f42d00b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:14.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42d721e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d00b2f90 con 0x7f42d015d100 2023-12-20T04:49:14.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42d721e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f42d01613c0 con 0x7f42d00cdc10 2023-12-20T04:49:14.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42d721e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00d1b00 con 0x7f42d00d0370 2023-12-20T04:49:14.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42d4fba640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f42d015d100 0x7f42d00cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58882/0 (socket says 172.21.15.132:58882) 2023-12-20T04:49:14.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42d4fba640 1 -- 172.21.15.132:0/2440771380 learned_addr learned my addr 172.21.15.132:0/2440771380 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:14.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42cffff640 1 --2- 172.21.15.132:0/2440771380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42d00d0370 0x7f42d00b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:14.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42cf7fe640 1 -- 172.21.15.132:0/2440771380 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2744706114 0 0) 0x7f42c8001110 con 0x7f42d015d100 2023-12-20T04:49:14.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42cf7fe640 1 -- 172.21.15.132:0/2440771380 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f42bc003520 con 0x7f42d015d100 2023-12-20T04:49:14.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42cf7fe640 1 -- 172.21.15.132:0/2440771380 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1844406049 0 0) 0x7f42bc003520 con 0x7f42d015d100 2023-12-20T04:49:14.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42cf7fe640 1 -- 172.21.15.132:0/2440771380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42d00d0370 msgr2=0x7f42d00b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:14.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42cf7fe640 1 --2- 172.21.15.132:0/2440771380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42d00d0370 0x7f42d00b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42cf7fe640 1 -- 172.21.15.132:0/2440771380 >> v1:172.21.15.187:6789/0 conn(0x7f42d00cdc10 legacy=0x7f42d006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:14.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42cf7fe640 1 -- 172.21.15.132:0/2440771380 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d00d0810 con 0x7f42d015d100 2023-12-20T04:49:14.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42cf7fe640 1 -- 172.21.15.132:0/2440771380 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f42c8001800 con 0x7f42d015d100 2023-12-20T04:49:14.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42cf7fe640 1 -- 172.21.15.132:0/2440771380 >> v1:172.21.15.132:6789/0 conn(0x7f42d015d100 legacy=0x7f42d00cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:14.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42cf7fe640 1 --2- 172.21.15.132:0/2440771380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42bc0039a0 0x7f42bc003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:14.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42cf7fe640 1 --2- 172.21.15.132:0/2440771380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42d00d0370 0x7f42bc0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:14.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42cf7fe640 1 --2- 172.21.15.132:0/2440771380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42bc004d00 0x7f42bc005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:14.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42cf7fe640 1 -- 172.21.15.132:0/2440771380 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00d1b00 con 0x7f42bc0039a0 2023-12-20T04:49:14.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42cf7fe640 1 -- 172.21.15.132:0/2440771380 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc00bb10 con 0x7f42bc004d00 2023-12-20T04:49:14.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42cf7fe640 1 -- 172.21.15.132:0/2440771380 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42bc00bcd0 con 0x7f42d00d0370 2023-12-20T04:49:14.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42d4fba640 1 --2- 172.21.15.132:0/2440771380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42bc0039a0 0x7f42bc003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:14.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42d57bb640 1 --2- 172.21.15.132:0/2440771380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42bc004d00 0x7f42bc005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:14.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.663+0000 7f42cffff640 1 --2- 172.21.15.132:0/2440771380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42d00d0370 0x7f42bc0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:14.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.664+0000 7f42d4fba640 1 -- 172.21.15.132:0/2440771380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42d00d0370 msgr2=0x7f42bc0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:14.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.664+0000 7f42d4fba640 1 --2- 172.21.15.132:0/2440771380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42d00d0370 0x7f42bc0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.664+0000 7f42d4fba640 1 -- 172.21.15.132:0/2440771380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42bc004d00 msgr2=0x7f42bc005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:14.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.664+0000 7f42d4fba640 1 --2- 172.21.15.132:0/2440771380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42bc004d00 0x7f42bc005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.664+0000 7f42d4fba640 1 -- 172.21.15.132:0/2440771380 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42bc003520 con 0x7f42bc0039a0 2023-12-20T04:49:14.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.664+0000 7f42d4fba640 1 --2- 172.21.15.132:0/2440771380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42bc0039a0 0x7f42bc003dc0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f42c800c240 tx=0x7f42bc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47dbe4b64bd1f30 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:14.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.664+0000 7f42cf7fe640 1 -- 172.21.15.132:0/2440771380 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c8005ad0 con 0x7f42bc0039a0 2023-12-20T04:49:14.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.665+0000 7f42cf7fe640 1 -- 172.21.15.132:0/2440771380 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42c8005c50 con 0x7f42bc0039a0 2023-12-20T04:49:14.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.665+0000 7f42cf7fe640 1 -- 172.21.15.132:0/2440771380 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42c802c8b0 con 0x7f42bc0039a0 2023-12-20T04:49:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.665+0000 7f42d721e640 1 -- 172.21.15.132:0/2440771380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42bc0039a0 msgr2=0x7f42bc003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.665+0000 7f42d721e640 1 --2- 172.21.15.132:0/2440771380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42bc0039a0 0x7f42bc003dc0 secure :-1 s=READY pgs=1410 cs=0 l=1 rev1=1 crypto rx=0x7f42c800c240 tx=0x7f42bc0057f0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.665+0000 7f42d57bb640 1 -- 172.21.15.132:0/2440771380 reap_dead start 2023-12-20T04:49:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.665+0000 7f42d721e640 1 -- 172.21.15.132:0/2440771380 shutdown_connections 2023-12-20T04:49:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.665+0000 7f42d721e640 1 -- 172.21.15.132:0/2440771380 >> 172.21.15.132:0/2440771380 conn(0x7f42d006d7c0 msgr2=0x7f42d006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.665+0000 7f42d721e640 1 -- 172.21.15.132:0/2440771380 shutdown_connections 2023-12-20T04:49:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.665+0000 7f42d721e640 1 -- 172.21.15.132:0/2440771380 wait complete. 2023-12-20T04:49:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.666+0000 7f42d721e640 1 Processor -- start 2023-12-20T04:49:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.666+0000 7f42d721e640 1 -- start start 2023-12-20T04:49:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.667+0000 7f42d721e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42bc0039a0 0x7f42d006bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.667+0000 7f42d721e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42d00caa30 0x7f42d006c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.667+0000 7f42d721e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42d01e64d0 0x7f42d01e6960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.667+0000 7f42d721e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00c9990 con 0x7f42d01e64d0 2023-12-20T04:49:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.667+0000 7f42d721e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00c9c70 con 0x7f42d00caa30 2023-12-20T04:49:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.667+0000 7f42d721e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f42d00c9f50 con 0x7f42bc0039a0 2023-12-20T04:49:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.667+0000 7f42d57bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42d01e64d0 0x7f42d01e6960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.667+0000 7f42d57bb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42d01e64d0 0x7f42d01e6960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40572/0 (socket says 172.21.15.132:40572) 2023-12-20T04:49:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.667+0000 7f42d57bb640 1 -- 172.21.15.132:0/1176643305 learned_addr learned my addr 172.21.15.132:0/1176643305 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:14.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.667+0000 7f42d4fba640 1 --2- 172.21.15.132:0/1176643305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42bc0039a0 0x7f42d006bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.667+0000 7f42cffff640 1 --2- 172.21.15.132:0/1176643305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42d00caa30 0x7f42d006c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.668+0000 7f42d57bb640 1 -- 172.21.15.132:0/1176643305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42bc0039a0 msgr2=0x7f42d006bec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.668+0000 7f42d57bb640 1 --2- 172.21.15.132:0/1176643305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42bc0039a0 0x7f42d006bec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.668+0000 7f42d57bb640 1 -- 172.21.15.132:0/1176643305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42d00caa30 msgr2=0x7f42d006c400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.668+0000 7f42d57bb640 1 --2- 172.21.15.132:0/1176643305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42d00caa30 0x7f42d006c400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.668+0000 7f42d57bb640 1 -- 172.21.15.132:0/1176643305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42d00ca230 con 0x7f42d01e64d0 2023-12-20T04:49:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.668+0000 7f42d57bb640 1 --2- 172.21.15.132:0/1176643305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42d01e64d0 0x7f42d01e6960 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f42d00ce7b0 tx=0x7f42b800f920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.668+0000 7f42cd7fa640 1 -- 172.21.15.132:0/1176643305 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b80053a0 con 0x7f42d01e64d0 2023-12-20T04:49:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.668+0000 7f42cd7fa640 1 -- 172.21.15.132:0/1176643305 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f42b80035f0 con 0x7f42d01e64d0 2023-12-20T04:49:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.668+0000 7f42d721e640 1 -- 172.21.15.132:0/1176643305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d00ca510 con 0x7f42d01e64d0 2023-12-20T04:49:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.668+0000 7f42cd7fa640 1 -- 172.21.15.132:0/1176643305 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f42b80039a0 con 0x7f42d01e64d0 2023-12-20T04:49:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.668+0000 7f42d721e640 1 -- 172.21.15.132:0/1176643305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d01e7080 con 0x7f42d01e64d0 2023-12-20T04:49:14.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.669+0000 7f42d721e640 1 -- 172.21.15.132:0/1176643305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d00ceb80 con 0x7f42d01e64d0 2023-12-20T04:49:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.669+0000 7f42cd7fa640 1 -- 172.21.15.132:0/1176643305 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f42b8003b00 con 0x7f42d01e64d0 2023-12-20T04:49:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.670+0000 7f42cd7fa640 1 --2- 172.21.15.132:0/1176643305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f42b006a430 0x7f42b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.670+0000 7f42cd7fa640 1 -- 172.21.15.132:0/1176643305 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f42b8088510 con 0x7f42d01e64d0 2023-12-20T04:49:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.670+0000 7f42d4fba640 1 --2- 172.21.15.132:0/1176643305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f42b006a430 0x7f42b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:14.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.670+0000 7f42d4fba640 1 --2- 172.21.15.132:0/1176643305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f42b006a430 0x7f42b006c8f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f42c800c240 tx=0x7f42c8009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:14.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.674+0000 7f42cd7fa640 1 -- 172.21.15.132:0/1176643305 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f42b8053b90 con 0x7f42d01e64d0 2023-12-20T04:49:14.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.841+0000 7f42d721e640 1 -- 172.21.15.132:0/1176643305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f42d00ca700 con 0x7f42d01e64d0 2023-12-20T04:49:14.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.842+0000 7f42cd7fa640 1 -- 172.21.15.132:0/1176643305 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v140) v1 ==== 81+0+33550 (secure 0 0 0) 0x7f42b8086e60 con 0x7f42d01e64d0 2023-12-20T04:49:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:14.845 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:49:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 140, 2023-12-20T04:49:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:49:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:49:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:49:09.856481+0000", 2023-12-20T04:49:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:49:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:49:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:49:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:49:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:49:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:49:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:49:14.845 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:49:14.846 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:49:14.846 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:14.846 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:49:14.846 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:49:14.846 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:49:14.846 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:49:14.846 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:49:14.846 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 17, 2023-12-20T04:49:14.846 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:49:14.846 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:49:14.846 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:49:14.846 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:49:14.846 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:49:14.846 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:49:14.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.847 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:49:14.847 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:49:14.847 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:49:14.847 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:49:14.847 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:49:14.847 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:14.847 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:14.847 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:14.847 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:14.847 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:14.847 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:14.847 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:14.847 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:14.847 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:14.847 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:14.848 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:49:14.848 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:49:14.848 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:49:14.848 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:49:14.848 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:49:14.848 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:14.848 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:14.848 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:14.848 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:14.848 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:14.848 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:14.848 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:14.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.848 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:49:14.848 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:14.848 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:14.849 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:14.849 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:14.849 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:14.849 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:14.849 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:14.849 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:14.849 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:14.849 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:49:14.849 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:14.849 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:14.849 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:14.849 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:14.849 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:14.850 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:14.850 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:14.850 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:14.850 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:14.850 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:14.850 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:14.850 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:14.850 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:14.850 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:14.850 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:14.850 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:14.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.850 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:14.850 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:14.850 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:14.851 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:14.851 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:14.851 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:14.851 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:14.851 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:14.851 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:14.851 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:14.851 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:14.851 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:14.851 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:49:14.851 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:49:14.851 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.851 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:14.851 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:49:14.851 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.851 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:14.852 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:49:14.852 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:49:14.852 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:49:14.852 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:49:14.852 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:49:14.852 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:14.852 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:14.852 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:14.852 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.852 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 16, 2023-12-20T04:49:14.852 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:49:14.852 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:48:35.008751+0000", 2023-12-20T04:49:14.852 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:49:14.852 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:49:14.853 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:14.853 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:14.853 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:14.853 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:14.853 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:14.853 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:14.853 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:14.853 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:14.853 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:14.853 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:14.853 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:49:14.853 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:49:14.854 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:49:14.854 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:49:14.854 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:49:14.854 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:14.854 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:14.854 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:14.854 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:14.854 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:14.854 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:14.854 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:14.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.854 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "136", 2023-12-20T04:49:14.854 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:14.854 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:14.854 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:14.854 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:14.855 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:14.855 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:14.855 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:14.855 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:14.855 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:14.855 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:49:14.855 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:14.855 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:14.855 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:14.855 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:14.855 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:14.855 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:14.855 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:14.855 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:14.855 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:14.855 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:14.856 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:14.856 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:14.856 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:14.856 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:14.856 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:14.856 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:14.856 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.856 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:14.856 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:14.856 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:14.856 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:14.856 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:14.856 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:14.856 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:14.856 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:14.857 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:14.857 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:14.857 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:14.857 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:14.857 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:49:14.857 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:49:14.857 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:49:14.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.857 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:14.857 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:49:14.857 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:49:14.857 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.857 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.857 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:14.857 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:49:14.858 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:49:14.858 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:49:14.858 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:49:14.858 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:49:14.858 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:14.858 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:14.858 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:14.858 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.858 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.858 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.858 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 17, 2023-12-20T04:49:14.858 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:49:14.858 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:48:36.182609+0000", 2023-12-20T04:49:14.858 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:49:14.858 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:49:14.858 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:49:14.859 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:49:14.859 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:49:14.859 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:49:14.859 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:49:14.859 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:49:14.859 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:49:14.859 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:49:14.859 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:49:14.859 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:49:14.859 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:49:14.859 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:49:14.859 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:49:14.859 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:49:14.859 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:49:14.859 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:49:14.859 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:49:14.860 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:49:14.860 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:49:14.860 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:49:14.860 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:49:14.860 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:49:14.860 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.860 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "140", 2023-12-20T04:49:14.860 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:49:14.860 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:49:14.860 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:49:14.860 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:49:14.860 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:49:14.860 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:49:14.860 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:49:14.860 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:49:14.861 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:49:14.861 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 33554432, 2023-12-20T04:49:14.861 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:49:14.861 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:49:14.861 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:49:14.861 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:49:14.861 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:49:14.861 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:49:14.861 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:49:14.861 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:49:14.861 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:49:14.861 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:49:14.861 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:49:14.861 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:49:14.861 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:49:14.861 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:49:14.862 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:49:14.862 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:49:14.862 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.862 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:49:14.862 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:49:14.862 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:49:14.862 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:49:14.862 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:49:14.862 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:49:14.862 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:49:14.862 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:49:14.862 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:49:14.862 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:49:14.862 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:49:14.862 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:49:14.862 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:49:14.863 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:49:14.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.863 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:49:14.863 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:49:14.863 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:49:14.863 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.863 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.863 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:49:14.863 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.75, 2023-12-20T04:49:14.863 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.75, 2023-12-20T04:49:14.863 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:49:14.863 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.75, 2023-12-20T04:49:14.863 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.75, 2023-12-20T04:49:14.863 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:49:14.863 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:49:14.864 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:49:14.864 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.864 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.864 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:14.864 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:49:14.864 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.864 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:49:14.864 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:14.864 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:14.864 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:14.864 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:14.864 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:14.864 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:14.864 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:14.864 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:14.864 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:14.865 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:14.865 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:14.865 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:14.865 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.865 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.865 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:49:14.865 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:14.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.865 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.865 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.865 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:49:14.865 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:14.865 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.865 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.865 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:49:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:49:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:14.866 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:49:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:49:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.867 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:49:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:49:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:49:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:49:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:49:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:49:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:49:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:14.868 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:49:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:14.869 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:14.870 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:14.870 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.870 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.870 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:49:14.870 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:14.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.870 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.870 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.870 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:49:14.870 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:14.870 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.870 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.870 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.870 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:14.871 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.871 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.871 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:49:14.871 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:14.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.871 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.871 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:49:14.871 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:14.871 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.871 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.871 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.871 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:14.871 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.871 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.871 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.872 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:49:14.872 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:14.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.872 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.872 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:49:14.872 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:14.872 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.872 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.872 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.872 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:14.872 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.872 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.872 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.872 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:49:14.872 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:14.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.873 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.873 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.873 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:49:14.873 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:49:14.873 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.873 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.873 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.873 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:49:14.873 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:49:14.873 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:49:14.873 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:49:14.873 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:14.873 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:14.873 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:14.873 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.874 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.874 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.874 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:49:14.874 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:14.874 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:14.874 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:14.874 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:14.874 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:14.874 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:14.874 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:14.874 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:14.874 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:14.874 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:14.874 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:14.874 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:14.874 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.875 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.875 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:49:14.875 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:14.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.875 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.875 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:49:14.875 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:14.875 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.875 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.875 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.875 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:14.875 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.875 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.875 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.876 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:49:14.876 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:14.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.876 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.876 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:49:14.876 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:14.876 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.876 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.876 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.876 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:14.876 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.876 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.876 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.876 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:49:14.876 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:14.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.877 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.877 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:49:14.877 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:14.877 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.877 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.877 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:14.877 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.877 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.877 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:49:14.877 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:14.877 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.877 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.878 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.878 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:49:14.878 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:49:14.878 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.878 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.878 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.878 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:49:14.878 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:49:14.878 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:49:14.878 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:49:14.878 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:14.878 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:14.878 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:14.878 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.879 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.879 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.879 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:49:14.879 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:14.879 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:14.879 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:14.879 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:14.879 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:14.879 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:14.879 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:14.879 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:14.879 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:14.879 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:14.879 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:14.879 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:14.879 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.880 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.880 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.880 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:49:14.880 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:14.880 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.880 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.880 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.880 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:49:14.880 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:14.880 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.880 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.880 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.880 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:14.880 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.880 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.881 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.881 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:49:14.881 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:14.881 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.881 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.881 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.881 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:49:14.881 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:14.881 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.881 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.881 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.881 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:14.881 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.881 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.881 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.882 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:49:14.882 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:14.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.882 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.882 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.882 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:49:14.882 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:14.882 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.882 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.882 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.882 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:14.882 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.882 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.882 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.882 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:49:14.883 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:14.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.883 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.883 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.883 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:49:14.883 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:49:14.883 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.883 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.883 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.883 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:49:14.883 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:49:14.883 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:49:14.883 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:49:14.883 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:14.883 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:14.883 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:14.883 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.884 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.884 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.884 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:49:14.884 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:14.884 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:14.884 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:14.884 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:14.884 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:14.884 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:14.884 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:14.884 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:14.884 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:14.884 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:14.884 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:14.884 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:14.884 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.885 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.885 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:49:14.885 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:14.885 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.885 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.885 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:49:14.885 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:14.885 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.885 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.885 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.885 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:14.885 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.885 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.886 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.886 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:49:14.886 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:14.886 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.886 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.886 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.886 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:49:14.886 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:14.886 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.886 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.886 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.886 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:14.886 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.886 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.887 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.887 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:49:14.887 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:14.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.887 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.887 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.887 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:49:14.887 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:14.887 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.887 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.887 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.887 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:14.887 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.887 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.887 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.887 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:49:14.888 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:14.888 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.888 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.888 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.888 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:49:14.888 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:49:14.888 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.888 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.888 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.888 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:49:14.888 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:49:14.888 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:49:14.888 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:49:14.888 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:14.888 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:14.888 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:14.889 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.889 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.889 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.889 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:49:14.889 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:14.889 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:14.889 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:14.889 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:14.889 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:14.889 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:14.889 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:14.889 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:14.889 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:14.889 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:14.890 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:14.890 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:14.890 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.890 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.890 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.890 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:49:14.890 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:14.890 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.890 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.890 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.890 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:49:14.890 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:14.890 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.890 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.891 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.891 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:14.891 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.891 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.891 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.891 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:49:14.891 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:14.891 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.891 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.891 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.891 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:49:14.891 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:14.891 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.891 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.891 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.891 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:14.891 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.892 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.892 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.892 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:49:14.892 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:14.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.892 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.892 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.892 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:49:14.892 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:14.892 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.892 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.892 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.892 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:14.892 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.892 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.892 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.892 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:49:14.893 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:14.893 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.893 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.893 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.893 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:49:14.893 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:49:14.893 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.893 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.893 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.893 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:49:14.893 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:49:14.893 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:49:14.893 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:49:14.893 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:14.893 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:14.894 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:14.894 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.894 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.894 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.894 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:49:14.894 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:14.894 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:14.894 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:14.894 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:14.894 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:14.894 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:14.894 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:14.894 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:14.894 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:14.894 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:14.894 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:14.894 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:14.895 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.895 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.895 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.895 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:49:14.895 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:14.895 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.895 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.895 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.895 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:49:14.895 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:14.895 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.895 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.895 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.895 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:14.895 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.895 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.896 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.896 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:49:14.896 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:14.896 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.896 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.896 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.896 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:49:14.896 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:14.896 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.896 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.896 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.896 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:14.896 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.896 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.897 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.897 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:49:14.897 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:14.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.897 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.897 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.897 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:49:14.897 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:14.897 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.897 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.897 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.897 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:14.897 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.897 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.898 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.898 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:49:14.898 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:14.898 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.898 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.898 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.898 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:49:14.898 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:49:14.898 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.898 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.898 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.898 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:49:14.898 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:49:14.898 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:49:14.898 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:49:14.898 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:14.899 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:14.899 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:14.899 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.899 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.899 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.899 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:49:14.899 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:49:14.899 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:49:14.899 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:49:14.899 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:49:14.899 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:49:14.899 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:49:14.899 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:49:14.899 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:49:14.899 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 135, 2023-12-20T04:49:14.899 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:49:14.899 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:49:14.900 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:49:14.900 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.900 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.900 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.900 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:49:14.900 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:14.900 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.900 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.900 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.900 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:49:14.900 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:14.900 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.900 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.900 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.900 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:49:14.900 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.901 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.901 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.901 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:49:14.901 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:14.901 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.901 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.901 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.901 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:49:14.901 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:14.901 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.901 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.901 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.901 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:49:14.901 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.902 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.902 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.902 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:49:14.902 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:14.902 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.902 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.902 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.902 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:49:14.902 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:14.902 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.902 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.902 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.902 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:49:14.902 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:49:14.902 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.902 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:49:14.902 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:49:14.903 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:14.903 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.903 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.903 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:14.903 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:49:14.903 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:49:14.903 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.903 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.903 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.903 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:49:14.903 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:49:14.903 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:49:14.903 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:49:14.903 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:49:14.903 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:49:14.903 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:49:14.903 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:14.904 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.904 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:14.904 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:49:14.904 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.904 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:49:14.904 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:14.904 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:14.904 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:14.904 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:14.904 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:14.904 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:49:14.904 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:14.904 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.904 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.904 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:49:14.904 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:14.905 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:14.905 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:14.905 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:14.905 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:14.905 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:49:14.905 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:14.905 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.905 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.905 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:49:14.905 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:14.905 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:14.905 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:14.905 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:14.905 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:14.905 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:49:14.905 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:14.906 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.906 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.906 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:49:14.906 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:14.906 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:14.906 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:14.906 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:14.906 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:14.906 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:49:14.906 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:14.906 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.906 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.906 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:49:14.906 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:14.906 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:14.907 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:14.907 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:14.907 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:14.907 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:49:14.907 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:14.907 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.907 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.907 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:49:14.907 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:14.907 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:14.907 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:14.907 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:14.907 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:14.907 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:49:14.907 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:14.907 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.907 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.908 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:49:14.908 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:14.908 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:14.908 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:14.908 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:14.908 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:14.908 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:49:14.908 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:14.908 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.908 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:14.908 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:49:14.908 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:49:14.908 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:49:14.908 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:49:14.908 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:49:14.908 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:49:14.909 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:49:14.909 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:49:14.909 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.909 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:49:14.909 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:49:14.909 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:49:14.909 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:49:14.909 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:49:14.909 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:49:14.909 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:49:14.909 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:49:14.909 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:49:14.909 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:49:14.909 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:49:14.909 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:49:14.909 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:49:14.910 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:49:14.910 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:49:14.910 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.910 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:14.910 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:49:14.910 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:49:14.910 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:49:14.910 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:49:14.910 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:49:14.910 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:49:14.910 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:49:14.910 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:49:14.910 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:49:14.910 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:49:14.910 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:49:14.910 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:14.911 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:49:14.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.844+0000 7f42d721e640 1 -- 172.21.15.132:0/1176643305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f42b006a430 msgr2=0x7f42b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:14.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.844+0000 7f42d721e640 1 --2- 172.21.15.132:0/1176643305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f42b006a430 0x7f42b006c8f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f42c800c240 tx=0x7f42c8009030 comp rx=0 tx=0).stop 2023-12-20T04:49:14.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.844+0000 7f42d721e640 1 -- 172.21.15.132:0/1176643305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42d01e64d0 msgr2=0x7f42d01e6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:14.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.844+0000 7f42d721e640 1 --2- 172.21.15.132:0/1176643305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42d01e64d0 0x7f42d01e6960 secure :-1 s=READY pgs=1411 cs=0 l=1 rev1=1 crypto rx=0x7f42d00ce7b0 tx=0x7f42b800f920 comp rx=0 tx=0).stop 2023-12-20T04:49:14.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.844+0000 7f42d721e640 1 -- 172.21.15.132:0/1176643305 shutdown_connections 2023-12-20T04:49:14.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.844+0000 7f42d721e640 1 --2- 172.21.15.132:0/1176643305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f42b006a430 0x7f42b006c8f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.844+0000 7f42d721e640 1 --2- 172.21.15.132:0/1176643305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f42d01e64d0 0x7f42d01e6960 unknown :-1 s=CLOSED pgs=1411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.844+0000 7f42d721e640 1 --2- 172.21.15.132:0/1176643305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f42d00caa30 0x7f42d006c400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.844+0000 7f42d721e640 1 --2- 172.21.15.132:0/1176643305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f42bc0039a0 0x7f42d006bec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:14.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.844+0000 7f42d721e640 1 -- 172.21.15.132:0/1176643305 >> 172.21.15.132:0/1176643305 conn(0x7f42d006d7c0 msgr2=0x7f42d00cb400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:14.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.844+0000 7f42d721e640 1 -- 172.21.15.132:0/1176643305 shutdown_connections 2023-12-20T04:49:14.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:14.844+0000 7f42d721e640 1 -- 172.21.15.132:0/1176643305 wait complete. 2023-12-20T04:49:14.913 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:49:15.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.020+0000 7f1bdbaab640 1 Processor -- start 2023-12-20T04:49:15.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.020+0000 7f1bdbaab640 1 -- start start 2023-12-20T04:49:15.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.021+0000 7f1bdbaab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1bd413cce0 0x7f1bd4159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:15.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.021+0000 7f1bdbaab640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1bd415a1d0 0x7f1bd406c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:15.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.021+0000 7f1bdbaab640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bd415aa30 con 0x7f1bd40c92d0 2023-12-20T04:49:15.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.021+0000 7f1bdbaab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd406b260 con 0x7f1bd413cce0 2023-12-20T04:49:15.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.021+0000 7f1bdbaab640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bd406b540 con 0x7f1bd415a1d0 2023-12-20T04:49:15.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.021+0000 7f1bd9046640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1bd413cce0 0x7f1bd4159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:15.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.021+0000 7f1bd9046640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1bd413cce0 0x7f1bd4159c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40588/0 (socket says 172.21.15.132:40588) 2023-12-20T04:49:15.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.021+0000 7f1bd9046640 1 -- 172.21.15.132:0/743079910 learned_addr learned my addr 172.21.15.132:0/743079910 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:15.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.021+0000 7f1bda048640 1 --2- 172.21.15.132:0/743079910 >> v2:172.21.15.187:3300/0 conn(0x7f1bd415a1d0 0x7f1bd406c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:15.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.021+0000 7f1bd9046640 1 -- 172.21.15.132:0/743079910 >> v2:172.21.15.187:3300/0 conn(0x7f1bd415a1d0 msgr2=0x7f1bd406c020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:15.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.021+0000 7f1bd9046640 1 --2- 172.21.15.132:0/743079910 >> v2:172.21.15.187:3300/0 conn(0x7f1bd415a1d0 0x7f1bd406c020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:15.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.021+0000 7f1bd9046640 1 -- 172.21.15.132:0/743079910 >> v1:172.21.15.187:6789/0 conn(0x7f1bd40c92d0 legacy=0x7f1bd40c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:15.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.021+0000 7f1bd9046640 1 -- 172.21.15.132:0/743079910 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd406b820 con 0x7f1bd413cce0 2023-12-20T04:49:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.022+0000 7f1bd9046640 1 --2- 172.21.15.132:0/743079910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bd413cce0 0x7f1bd4159c90 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40c5ce0 tx=0x7f1bc402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb9fcb976163241f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.022+0000 7f1bd8845640 1 -- 172.21.15.132:0/743079910 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc40317e0 con 0x7f1bd413cce0 2023-12-20T04:49:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.022+0000 7f1bd8845640 1 -- 172.21.15.132:0/743079910 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc4031940 con 0x7f1bd413cce0 2023-12-20T04:49:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.022+0000 7f1bd8845640 1 -- 172.21.15.132:0/743079910 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4031cd0 con 0x7f1bd413cce0 2023-12-20T04:49:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.023+0000 7f1bdbaab640 1 -- 172.21.15.132:0/743079910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bd413cce0 msgr2=0x7f1bd4159c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.023+0000 7f1bdbaab640 1 --2- 172.21.15.132:0/743079910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bd413cce0 0x7f1bd4159c90 secure :-1 s=READY pgs=1412 cs=0 l=1 rev1=1 crypto rx=0x7f1bd40c5ce0 tx=0x7f1bc402b880 comp rx=0 tx=0).stop 2023-12-20T04:49:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.023+0000 7f1bdbaab640 1 -- 172.21.15.132:0/743079910 shutdown_connections 2023-12-20T04:49:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.023+0000 7f1bdbaab640 1 --2- 172.21.15.132:0/743079910 >> v2:172.21.15.187:3300/0 conn(0x7f1bd415a1d0 0x7f1bd406c020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.023+0000 7f1bdbaab640 1 --2- 172.21.15.132:0/743079910 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bd413cce0 0x7f1bd4159c90 unknown :-1 s=CLOSED pgs=1412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.023+0000 7f1bdbaab640 1 -- 172.21.15.132:0/743079910 >> 172.21.15.132:0/743079910 conn(0x7f1bd40ced10 msgr2=0x7f1bd40cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:15.025 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.023+0000 7f1bdbaab640 1 -- 172.21.15.132:0/743079910 shutdown_connections 2023-12-20T04:49:15.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.023+0000 7f1bdbaab640 1 -- 172.21.15.132:0/743079910 wait complete. 2023-12-20T04:49:15.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.024+0000 7f1bdbaab640 1 Processor -- start 2023-12-20T04:49:15.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.024+0000 7f1bdbaab640 1 -- start start 2023-12-20T04:49:15.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.025+0000 7f1bdbaab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bd40c92d0 0x7f1bd414dcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:15.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.025+0000 7f1bdbaab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bd413cce0 0x7f1bd414d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:15.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.025+0000 7f1bdbaab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bd415a1d0 0x7f1bd40b2b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:15.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.025+0000 7f1bdbaab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd414e1f0 con 0x7f1bd413cce0 2023-12-20T04:49:15.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.025+0000 7f1bdbaab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40c6080 con 0x7f1bd40c92d0 2023-12-20T04:49:15.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.025+0000 7f1bdbaab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd40c6360 con 0x7f1bd415a1d0 2023-12-20T04:49:15.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.025+0000 7f1bd9046640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bd413cce0 0x7f1bd414d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:15.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.025+0000 7f1bd9046640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bd413cce0 0x7f1bd414d5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40592/0 (socket says 172.21.15.132:40592) 2023-12-20T04:49:15.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.025+0000 7f1bd9046640 1 -- 172.21.15.132:0/121549661 learned_addr learned my addr 172.21.15.132:0/121549661 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:15.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.025+0000 7f1bd9847640 1 --2- 172.21.15.132:0/121549661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bd40c92d0 0x7f1bd414dcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:15.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.025+0000 7f1bda048640 1 --2- 172.21.15.132:0/121549661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bd415a1d0 0x7f1bd40b2b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:15.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.025+0000 7f1bd9046640 1 -- 172.21.15.132:0/121549661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bd415a1d0 msgr2=0x7f1bd40b2b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:15.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.025+0000 7f1bd9046640 1 --2- 172.21.15.132:0/121549661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bd415a1d0 0x7f1bd40b2b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:15.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.025+0000 7f1bd9046640 1 -- 172.21.15.132:0/121549661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bd40c92d0 msgr2=0x7f1bd414dcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:15.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.025+0000 7f1bd9046640 1 --2- 172.21.15.132:0/121549661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bd40c92d0 0x7f1bd414dcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:15.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.025+0000 7f1bd9046640 1 -- 172.21.15.132:0/121549661 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc40094d0 con 0x7f1bd413cce0 2023-12-20T04:49:15.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.025+0000 7f1bda048640 1 --2- 172.21.15.132:0/121549661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bd415a1d0 0x7f1bd40b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:15.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.026+0000 7f1bd9046640 1 --2- 172.21.15.132:0/121549661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bd413cce0 0x7f1bd414d5a0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40097f0 tx=0x7f1bc40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:15.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.026+0000 7f1bca7fc640 1 -- 172.21.15.132:0/121549661 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4032880 con 0x7f1bd413cce0 2023-12-20T04:49:15.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.026+0000 7f1bca7fc640 1 -- 172.21.15.132:0/121549661 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bc4032a00 con 0x7f1bd413cce0 2023-12-20T04:49:15.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.026+0000 7f1bdbaab640 1 -- 172.21.15.132:0/121549661 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd414dae0 con 0x7f1bd413cce0 2023-12-20T04:49:15.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.026+0000 7f1bca7fc640 1 -- 172.21.15.132:0/121549661 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bc4032db0 con 0x7f1bd413cce0 2023-12-20T04:49:15.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.026+0000 7f1bdbaab640 1 -- 172.21.15.132:0/121549661 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd40b42e0 con 0x7f1bd413cce0 2023-12-20T04:49:15.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.027+0000 7f1bdbaab640 1 -- 172.21.15.132:0/121549661 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd404e840 con 0x7f1bd413cce0 2023-12-20T04:49:15.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.027+0000 7f1bca7fc640 1 -- 172.21.15.132:0/121549661 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1bc404d3f0 con 0x7f1bd413cce0 2023-12-20T04:49:15.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.028+0000 7f1bca7fc640 1 --2- 172.21.15.132:0/121549661 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bb806a430 0x7f1bb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:15.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.028+0000 7f1bca7fc640 1 -- 172.21.15.132:0/121549661 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1bc40aa580 con 0x7f1bd413cce0 2023-12-20T04:49:15.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.028+0000 7f1bd9847640 1 --2- 172.21.15.132:0/121549661 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bb806a430 0x7f1bb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:15.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.028+0000 7f1bd9847640 1 --2- 172.21.15.132:0/121549661 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bb806a430 0x7f1bb806c8f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0004ea0 tx=0x7f1bd0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:15.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.032+0000 7f1bca7fc640 1 -- 172.21.15.132:0/121549661 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1bc4075d20 con 0x7f1bd413cce0 2023-12-20T04:49:15.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.237+0000 7f1bdbaab640 1 -- 172.21.15.132:0/121549661 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1bd413eb50 con 0x7f1bd413cce0 2023-12-20T04:49:15.239 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.237+0000 7f1bca7fc640 1 -- 172.21.15.132:0/121549661 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f1bc4079340 con 0x7f1bd413cce0 2023-12-20T04:49:15.239 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:15.239 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6763,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1413044191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1413044191},{"type":"v1","addr":"172.21.15.132:6837","nonce":1413044191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1584197959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1584197959},{"type":"v1","addr":"172.21.15.187:6834","nonce":1584197959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":7830,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/3080885824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3080885824},{"type":"v1","addr":"172.21.15.132:6836","nonce":3080885824}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:48:37.200402+0000","modified":"2023-12-20T04:48:39.207037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"d","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/1483131498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":1483131498},{"type":"v1","addr":"172.21.15.187:6835","nonce":1483131498}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-20T04:49:15.240 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 51 2023-12-20T04:49:15.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.239+0000 7f1bdbaab640 1 -- 172.21.15.132:0/121549661 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bb806a430 msgr2=0x7f1bb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:15.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.239+0000 7f1bdbaab640 1 --2- 172.21.15.132:0/121549661 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bb806a430 0x7f1bb806c8f0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0004ea0 tx=0x7f1bd0009040 comp rx=0 tx=0).stop 2023-12-20T04:49:15.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.239+0000 7f1bdbaab640 1 -- 172.21.15.132:0/121549661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bd413cce0 msgr2=0x7f1bd414d5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:15.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.239+0000 7f1bdbaab640 1 --2- 172.21.15.132:0/121549661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bd413cce0 0x7f1bd414d5a0 secure :-1 s=READY pgs=1413 cs=0 l=1 rev1=1 crypto rx=0x7f1bc40097f0 tx=0x7f1bc40046c0 comp rx=0 tx=0).stop 2023-12-20T04:49:15.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.239+0000 7f1bdbaab640 1 -- 172.21.15.132:0/121549661 shutdown_connections 2023-12-20T04:49:15.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.239+0000 7f1bdbaab640 1 --2- 172.21.15.132:0/121549661 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bb806a430 0x7f1bb806c8f0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:15.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.239+0000 7f1bdbaab640 1 --2- 172.21.15.132:0/121549661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bd415a1d0 0x7f1bd40b2b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:15.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.239+0000 7f1bdbaab640 1 --2- 172.21.15.132:0/121549661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bd413cce0 0x7f1bd414d5a0 unknown :-1 s=CLOSED pgs=1413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:15.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.239+0000 7f1bdbaab640 1 --2- 172.21.15.132:0/121549661 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bd40c92d0 0x7f1bd414dcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:15.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.239+0000 7f1bdbaab640 1 -- 172.21.15.132:0/121549661 >> 172.21.15.132:0/121549661 conn(0x7f1bd40ced10 msgr2=0x7f1bd4157d30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:15.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.239+0000 7f1bdbaab640 1 -- 172.21.15.132:0/121549661 shutdown_connections 2023-12-20T04:49:15.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.239+0000 7f1bdbaab640 1 -- 172.21.15.132:0/121549661 wait complete. 2023-12-20T04:49:15.252 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.d.asok --format=json status 2023-12-20T04:49:15.380 INFO:teuthology.orchestra.run.smithi187.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":7845,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":38.166438081999999,"mdsmap_epoch":51,"osdmap_epoch":140,"osdmap_epoch_barrier":139,"uptime":42.954307602999997} 2023-12-20T04:49:15.381 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 7845, "mdsmap_epoch": 51, "osdmap_epoch": 140, "osdmap_epoch_barrier": 139, "rank_uptime": 38.166438082, "state": "up:active", "uptime": 42.954307603, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:49:15.381 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-20T04:49:15.381 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:49:15.381 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:49:15.397 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:15.397 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-20T04:49:15.670 INFO:teuthology.orchestra.run.smithi132.stderr:50+0 records in 2023-12-20T04:49:15.670 INFO:teuthology.orchestra.run.smithi132.stderr:50+0 records out 2023-12-20T04:49:15.670 INFO:teuthology.orchestra.run.smithi132.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.215463 s, 243 MB/s 2023-12-20T04:49:15.671 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:49:15.671 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:49:15.723 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:49:15.766 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:49:15.766 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:49:15.766 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:49:15.782 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:49:15.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.918+0000 7fcb3e5cb640 1 Processor -- start 2023-12-20T04:49:15.920 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.919+0000 7fcb3e5cb640 1 -- start start 2023-12-20T04:49:15.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.919+0000 7fcb3e5cb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcb38159b50 0x7fcb380c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:15.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.919+0000 7fcb3e5cb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcb3806c240 0x7fcb3806c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:15.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.919+0000 7fcb3e5cb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb380ccf30 con 0x7fcb3815e530 2023-12-20T04:49:15.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.919+0000 7fcb3e5cb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb3806cc10 con 0x7fcb3806c240 2023-12-20T04:49:15.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.919+0000 7fcb3e5cb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb380caa60 con 0x7fcb38159b50 2023-12-20T04:49:15.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.919+0000 7fcb3cb68640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcb3806c240 0x7fcb3806c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:15.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.919+0000 7fcb377fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcb3815e530 0x7fcb3806fd70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58884/0 (socket says 172.21.15.132:58884) 2023-12-20T04:49:15.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.919+0000 7fcb377fe640 1 -- 172.21.15.132:0/2323313740 learned_addr learned my addr 172.21.15.132:0/2323313740 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:15.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.920+0000 7fcb37fff640 1 --2- 172.21.15.132:0/2323313740 >> v2:172.21.15.187:3300/0 conn(0x7fcb38159b50 0x7fcb380c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:15.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.920+0000 7fcb3cb68640 1 -- 172.21.15.132:0/2323313740 >> v2:172.21.15.187:3300/0 conn(0x7fcb38159b50 msgr2=0x7fcb380c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:15.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.920+0000 7fcb3cb68640 1 --2- 172.21.15.132:0/2323313740 >> v2:172.21.15.187:3300/0 conn(0x7fcb38159b50 0x7fcb380c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:15.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.920+0000 7fcb3cb68640 1 -- 172.21.15.132:0/2323313740 >> v1:172.21.15.132:6789/0 conn(0x7fcb3815e530 legacy=0x7fcb3806fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:15.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.920+0000 7fcb3cb68640 1 -- 172.21.15.132:0/2323313740 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb380ca1c0 con 0x7fcb3806c240 2023-12-20T04:49:15.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.920+0000 7fcb3cb68640 1 --2- 172.21.15.132:0/2323313740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3806c240 0x7fcb3806c6d0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000bfa0 tx=0x7fcb3002e0b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57fbb8eebe6722ef server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:15.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.921+0000 7fcb36ffd640 1 -- 172.21.15.132:0/2323313740 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb3002ea50 con 0x7fcb3806c240 2023-12-20T04:49:15.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.921+0000 7fcb36ffd640 1 -- 172.21.15.132:0/2323313740 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb3002ebb0 con 0x7fcb3806c240 2023-12-20T04:49:15.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.921+0000 7fcb36ffd640 1 -- 172.21.15.132:0/2323313740 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30009540 con 0x7fcb3806c240 2023-12-20T04:49:15.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.921+0000 7fcb3e5cb640 1 -- 172.21.15.132:0/2323313740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3806c240 msgr2=0x7fcb3806c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:15.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.921+0000 7fcb3e5cb640 1 --2- 172.21.15.132:0/2323313740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3806c240 0x7fcb3806c6d0 secure :-1 s=READY pgs=1415 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000bfa0 tx=0x7fcb3002e0b0 comp rx=0 tx=0).stop 2023-12-20T04:49:15.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.921+0000 7fcb3e5cb640 1 -- 172.21.15.132:0/2323313740 shutdown_connections 2023-12-20T04:49:15.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.921+0000 7fcb3e5cb640 1 --2- 172.21.15.132:0/2323313740 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3806c240 0x7fcb3806c6d0 unknown :-1 s=CLOSED pgs=1415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:15.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.921+0000 7fcb3e5cb640 1 --2- 172.21.15.132:0/2323313740 >> v2:172.21.15.187:3300/0 conn(0x7fcb38159b50 0x7fcb380c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:15.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.921+0000 7fcb3e5cb640 1 -- 172.21.15.132:0/2323313740 >> 172.21.15.132:0/2323313740 conn(0x7fcb380ced10 msgr2=0x7fcb380cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:15.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.921+0000 7fcb3e5cb640 1 -- 172.21.15.132:0/2323313740 shutdown_connections 2023-12-20T04:49:15.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.921+0000 7fcb3e5cb640 1 -- 172.21.15.132:0/2323313740 wait complete. 2023-12-20T04:49:15.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.922+0000 7fcb3e5cb640 1 Processor -- start 2023-12-20T04:49:15.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.923+0000 7fcb3e5cb640 1 -- start start 2023-12-20T04:49:15.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.923+0000 7fcb3e5cb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb3806c240 0x7fcb3815c460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:15.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.923+0000 7fcb3e5cb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb38159b50 0x7fcb3814bb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:15.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.923+0000 7fcb3e5cb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3815e530 0x7fcb3814c080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:15.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.923+0000 7fcb3e5cb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb38159f30 con 0x7fcb3815e530 2023-12-20T04:49:15.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.923+0000 7fcb3e5cb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3814a9f0 con 0x7fcb38159b50 2023-12-20T04:49:15.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.923+0000 7fcb3e5cb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb3814ac40 con 0x7fcb3806c240 2023-12-20T04:49:15.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.923+0000 7fcb3cb68640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3815e530 0x7fcb3814c080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:15.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.923+0000 7fcb3cb68640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3815e530 0x7fcb3814c080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40610/0 (socket says 172.21.15.132:40610) 2023-12-20T04:49:15.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.923+0000 7fcb3cb68640 1 -- 172.21.15.132:0/88251240 learned_addr learned my addr 172.21.15.132:0/88251240 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:15.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.923+0000 7fcb377fe640 1 --2- 172.21.15.132:0/88251240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb38159b50 0x7fcb3814bb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:15.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.923+0000 7fcb37fff640 1 --2- 172.21.15.132:0/88251240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb3806c240 0x7fcb3815c460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:15.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.924+0000 7fcb3cb68640 1 -- 172.21.15.132:0/88251240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb3806c240 msgr2=0x7fcb3815c460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:15.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.924+0000 7fcb3cb68640 1 --2- 172.21.15.132:0/88251240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb3806c240 0x7fcb3815c460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:15.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.924+0000 7fcb3cb68640 1 -- 172.21.15.132:0/88251240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb38159b50 msgr2=0x7fcb3814bb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:15.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.924+0000 7fcb3cb68640 1 --2- 172.21.15.132:0/88251240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb38159b50 0x7fcb3814bb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:15.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.924+0000 7fcb3cb68640 1 -- 172.21.15.132:0/88251240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb3000bc80 con 0x7fcb3815e530 2023-12-20T04:49:15.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.924+0000 7fcb3cb68640 1 --2- 172.21.15.132:0/88251240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3815e530 0x7fcb3814c080 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000bfa0 tx=0x7fcb30004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:15.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.924+0000 7fcb34ff9640 1 -- 172.21.15.132:0/88251240 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30036800 con 0x7fcb3815e530 2023-12-20T04:49:15.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.924+0000 7fcb34ff9640 1 -- 172.21.15.132:0/88251240 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb30036980 con 0x7fcb3815e530 2023-12-20T04:49:15.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.924+0000 7fcb3e5cb640 1 -- 172.21.15.132:0/88251240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb3814af20 con 0x7fcb3815e530 2023-12-20T04:49:15.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.924+0000 7fcb34ff9640 1 -- 172.21.15.132:0/88251240 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb30036d30 con 0x7fcb3815e530 2023-12-20T04:49:15.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.924+0000 7fcb3e5cb640 1 -- 172.21.15.132:0/88251240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb3815a420 con 0x7fcb3815e530 2023-12-20T04:49:15.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.925+0000 7fcb3e5cb640 1 -- 172.21.15.132:0/88251240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb3814b0b0 con 0x7fcb3815e530 2023-12-20T04:49:15.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.925+0000 7fcb34ff9640 1 -- 172.21.15.132:0/88251240 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcb3004a460 con 0x7fcb3815e530 2023-12-20T04:49:15.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.926+0000 7fcb34ff9640 1 --2- 172.21.15.132:0/88251240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcb2406a460 0x7fcb2406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:15.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.926+0000 7fcb37fff640 1 --2- 172.21.15.132:0/88251240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcb2406a460 0x7fcb2406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:15.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.926+0000 7fcb34ff9640 1 -- 172.21.15.132:0/88251240 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb300aba90 con 0x7fcb3815e530 2023-12-20T04:49:15.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.926+0000 7fcb37fff640 1 --2- 172.21.15.132:0/88251240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcb2406a460 0x7fcb2406c920 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c006fd0 tx=0x7fcb2c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:15.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:15.930+0000 7fcb34ff9640 1 -- 172.21.15.132:0/88251240 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcb300771a0 con 0x7fcb3815e530 2023-12-20T04:49:16.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.097+0000 7fcb3e5cb640 1 -- 172.21.15.132:0/88251240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcb3815a610 con 0x7fcb3815e530 2023-12-20T04:49:16.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.098+0000 7fcb34ff9640 1 -- 172.21.15.132:0/88251240 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+16115 (secure 0 0 0) 0x7fcb3007a7c0 con 0x7fcb3815e530 2023-12-20T04:49:16.100 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:16.100 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":140,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:49:09.856481+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:48:35.008751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-20T04:48:36.182609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:49:16.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.100+0000 7fcb3e5cb640 1 -- 172.21.15.132:0/88251240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcb2406a460 msgr2=0x7fcb2406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.100+0000 7fcb3e5cb640 1 --2- 172.21.15.132:0/88251240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcb2406a460 0x7fcb2406c920 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7fcb2c006fd0 tx=0x7fcb2c008040 comp rx=0 tx=0).stop 2023-12-20T04:49:16.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.100+0000 7fcb3e5cb640 1 -- 172.21.15.132:0/88251240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3815e530 msgr2=0x7fcb3814c080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.100+0000 7fcb3e5cb640 1 --2- 172.21.15.132:0/88251240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3815e530 0x7fcb3814c080 secure :-1 s=READY pgs=1416 cs=0 l=1 rev1=1 crypto rx=0x7fcb3000bfa0 tx=0x7fcb30004a40 comp rx=0 tx=0).stop 2023-12-20T04:49:16.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.100+0000 7fcb3e5cb640 1 -- 172.21.15.132:0/88251240 shutdown_connections 2023-12-20T04:49:16.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.100+0000 7fcb3e5cb640 1 --2- 172.21.15.132:0/88251240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcb2406a460 0x7fcb2406c920 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.100+0000 7fcb3e5cb640 1 --2- 172.21.15.132:0/88251240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb3815e530 0x7fcb3814c080 unknown :-1 s=CLOSED pgs=1416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.100+0000 7fcb3e5cb640 1 --2- 172.21.15.132:0/88251240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb38159b50 0x7fcb3814bb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.101+0000 7fcb3e5cb640 1 --2- 172.21.15.132:0/88251240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb3806c240 0x7fcb3815c460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.101+0000 7fcb3e5cb640 1 -- 172.21.15.132:0/88251240 >> 172.21.15.132:0/88251240 conn(0x7fcb380ced10 msgr2=0x7fcb3806b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:16.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.101+0000 7fcb3e5cb640 1 -- 172.21.15.132:0/88251240 shutdown_connections 2023-12-20T04:49:16.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.101+0000 7fcb3e5cb640 1 -- 172.21.15.132:0/88251240 wait complete. 2023-12-20T04:49:16.114 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:48:35.008751+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:48:36.182609+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '140', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:49:16.114 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:49:16.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.215+0000 7ff025cf3640 1 Processor -- start 2023-12-20T04:49:16.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.215+0000 7ff025cf3640 1 -- start start 2023-12-20T04:49:16.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.215+0000 7ff025cf3640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff0201447b0 0x7ff0200c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.215+0000 7ff025cf3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0200ca170 0x7ff0200ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.215+0000 7ff025cf3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0200c4f40 con 0x7ff020069c30 2023-12-20T04:49:16.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.215+0000 7ff025cf3640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff020144b90 con 0x7ff0201447b0 2023-12-20T04:49:16.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.215+0000 7ff025cf3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0200cac30 con 0x7ff0200ca170 2023-12-20T04:49:16.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.216+0000 7ff01ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff020069c30 0x7ff02006c610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58898/0 (socket says 172.21.15.132:58898) 2023-12-20T04:49:16.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.216+0000 7ff01ffff640 1 -- 172.21.15.132:0/3730345173 learned_addr learned my addr 172.21.15.132:0/3730345173 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:16.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.216+0000 7ff01effd640 1 --2- 172.21.15.132:0/3730345173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0200ca170 0x7ff0200ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.216+0000 7ff01f7fe640 1 --2- 172.21.15.132:0/3730345173 >> v2:172.21.15.187:3300/0 conn(0x7ff0201447b0 0x7ff0200c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.216+0000 7ff01e7fc640 1 -- 172.21.15.132:0/3730345173 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3230959838 0 0) 0x7ff0200c4f40 con 0x7ff020069c30 2023-12-20T04:49:16.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.216+0000 7ff01e7fc640 1 -- 172.21.15.132:0/3730345173 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff008003520 con 0x7ff020069c30 2023-12-20T04:49:16.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.216+0000 7ff01f7fe640 1 -- 172.21.15.132:0/3730345173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0200ca170 msgr2=0x7ff0200ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:16.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.216+0000 7ff01f7fe640 1 --2- 172.21.15.132:0/3730345173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0200ca170 0x7ff0200ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.216+0000 7ff01f7fe640 1 -- 172.21.15.132:0/3730345173 >> v1:172.21.15.132:6789/0 conn(0x7ff020069c30 legacy=0x7ff02006c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.216+0000 7ff01f7fe640 1 -- 172.21.15.132:0/3730345173 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0200c5190 con 0x7ff0201447b0 2023-12-20T04:49:16.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.216+0000 7ff01effd640 1 --2- 172.21.15.132:0/3730345173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0200ca170 0x7ff0200ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:49:16.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.217+0000 7ff01f7fe640 1 --2- 172.21.15.132:0/3730345173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0201447b0 0x7ff0200c5c70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff010009d90 tx=0x7ff01002be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f64010ddf72a48e6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:16.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.217+0000 7ff01e7fc640 1 -- 172.21.15.132:0/3730345173 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff01002cbc0 con 0x7ff0201447b0 2023-12-20T04:49:16.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.217+0000 7ff01e7fc640 1 -- 172.21.15.132:0/3730345173 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff01002cd20 con 0x7ff0201447b0 2023-12-20T04:49:16.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.217+0000 7ff01e7fc640 1 -- 172.21.15.132:0/3730345173 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff010034660 con 0x7ff0201447b0 2023-12-20T04:49:16.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.217+0000 7ff025cf3640 1 -- 172.21.15.132:0/3730345173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0201447b0 msgr2=0x7ff0200c5c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.217+0000 7ff025cf3640 1 --2- 172.21.15.132:0/3730345173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0201447b0 0x7ff0200c5c70 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7ff010009d90 tx=0x7ff01002be10 comp rx=0 tx=0).stop 2023-12-20T04:49:16.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.217+0000 7ff025cf3640 1 -- 172.21.15.132:0/3730345173 shutdown_connections 2023-12-20T04:49:16.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.217+0000 7ff025cf3640 1 --2- 172.21.15.132:0/3730345173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0200ca170 0x7ff0200ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.217+0000 7ff025cf3640 1 --2- 172.21.15.132:0/3730345173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0201447b0 0x7ff0200c5c70 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.218+0000 7ff025cf3640 1 -- 172.21.15.132:0/3730345173 >> 172.21.15.132:0/3730345173 conn(0x7ff0200cc630 msgr2=0x7ff0200cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:16.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.218+0000 7ff025cf3640 1 -- 172.21.15.132:0/3730345173 shutdown_connections 2023-12-20T04:49:16.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.218+0000 7ff025cf3640 1 -- 172.21.15.132:0/3730345173 wait complete. 2023-12-20T04:49:16.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.219+0000 7ff025cf3640 1 Processor -- start 2023-12-20T04:49:16.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.219+0000 7ff025cf3640 1 -- start start 2023-12-20T04:49:16.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff025cf3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff020069c30 0x7ff0200ad250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff025cf3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0200ca170 0x7ff0200af090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff025cf3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0201447b0 0x7ff0201f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff025cf3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0200ce2a0 con 0x7ff0201447b0 2023-12-20T04:49:16.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff025cf3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0200ad930 con 0x7ff0200ca170 2023-12-20T04:49:16.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff025cf3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0200ce540 con 0x7ff020069c30 2023-12-20T04:49:16.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff01f7fe640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff020069c30 0x7ff0200ad250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff01effd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0200ca170 0x7ff0200af090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff01effd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0200ca170 0x7ff0200af090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:45018/0 (socket says 172.21.15.132:45018) 2023-12-20T04:49:16.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff01effd640 1 -- 172.21.15.132:0/2836677029 learned_addr learned my addr 172.21.15.132:0/2836677029 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:16.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff01ffff640 1 --2- 172.21.15.132:0/2836677029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0201447b0 0x7ff0201f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff01ffff640 1 -- 172.21.15.132:0/2836677029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff020069c30 msgr2=0x7ff0200ad250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff01ffff640 1 --2- 172.21.15.132:0/2836677029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff020069c30 0x7ff0200ad250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff01ffff640 1 -- 172.21.15.132:0/2836677029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0200ca170 msgr2=0x7ff0200af090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff01ffff640 1 --2- 172.21.15.132:0/2836677029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0200ca170 0x7ff0200af090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff01ffff640 1 -- 172.21.15.132:0/2836677029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff014009400 con 0x7ff0201447b0 2023-12-20T04:49:16.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff01effd640 1 --2- 172.21.15.132:0/2836677029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0200ca170 0x7ff0200af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:49:16.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff01f7fe640 1 --2- 172.21.15.132:0/2836677029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff020069c30 0x7ff0200ad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:49:16.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.220+0000 7ff01ffff640 1 --2- 172.21.15.132:0/2836677029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0201447b0 0x7ff0201f1d10 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7ff01800c340 tx=0x7ff018001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:16.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.221+0000 7ff007fff640 1 -- 172.21.15.132:0/2836677029 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff018005ce0 con 0x7ff0201447b0 2023-12-20T04:49:16.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.221+0000 7ff007fff640 1 -- 172.21.15.132:0/2836677029 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff018005e40 con 0x7ff0201447b0 2023-12-20T04:49:16.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.221+0000 7ff025cf3640 1 -- 172.21.15.132:0/2836677029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff010009a70 con 0x7ff0201447b0 2023-12-20T04:49:16.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.221+0000 7ff007fff640 1 -- 172.21.15.132:0/2836677029 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0180072d0 con 0x7ff0201447b0 2023-12-20T04:49:16.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.221+0000 7ff025cf3640 1 -- 172.21.15.132:0/2836677029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0200ceb00 con 0x7ff0201447b0 2023-12-20T04:49:16.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.222+0000 7ff025cf3640 1 -- 172.21.15.132:0/2836677029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff02004e840 con 0x7ff0201447b0 2023-12-20T04:49:16.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.222+0000 7ff007fff640 1 -- 172.21.15.132:0/2836677029 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff018007430 con 0x7ff0201447b0 2023-12-20T04:49:16.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.222+0000 7ff007fff640 1 --2- 172.21.15.132:0/2836677029 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff00c06a430 0x7ff00c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.222+0000 7ff007fff640 1 -- 172.21.15.132:0/2836677029 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff018087d90 con 0x7ff0201447b0 2023-12-20T04:49:16.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.222+0000 7ff01f7fe640 1 --2- 172.21.15.132:0/2836677029 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff00c06a430 0x7ff00c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.223+0000 7ff01f7fe640 1 --2- 172.21.15.132:0/2836677029 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff00c06a430 0x7ff00c06c8f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff010036000 tx=0x7ff010030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:16.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.226+0000 7ff007fff640 1 -- 172.21.15.132:0/2836677029 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff0180533b0 con 0x7ff0201447b0 2023-12-20T04:49:16.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.390+0000 7ff025cf3640 1 -- 172.21.15.132:0/2836677029 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7ff02006a760 con 0x7ff0201447b0 2023-12-20T04:49:16.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.391+0000 7ff007fff640 1 -- 172.21.15.132:0/2836677029 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v140) v1 ==== 93+0+10 (secure 0 0 0) 0x7ff0180569d0 con 0x7ff0201447b0 2023-12-20T04:49:16.393 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:49:16.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.393+0000 7ff025cf3640 1 -- 172.21.15.132:0/2836677029 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff00c06a430 msgr2=0x7ff00c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.393+0000 7ff025cf3640 1 --2- 172.21.15.132:0/2836677029 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff00c06a430 0x7ff00c06c8f0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7ff010036000 tx=0x7ff010030000 comp rx=0 tx=0).stop 2023-12-20T04:49:16.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.393+0000 7ff025cf3640 1 -- 172.21.15.132:0/2836677029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0201447b0 msgr2=0x7ff0201f1d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.393+0000 7ff025cf3640 1 --2- 172.21.15.132:0/2836677029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0201447b0 0x7ff0201f1d10 secure :-1 s=READY pgs=1418 cs=0 l=1 rev1=1 crypto rx=0x7ff01800c340 tx=0x7ff018001e70 comp rx=0 tx=0).stop 2023-12-20T04:49:16.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.393+0000 7ff025cf3640 1 -- 172.21.15.132:0/2836677029 shutdown_connections 2023-12-20T04:49:16.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.393+0000 7ff025cf3640 1 --2- 172.21.15.132:0/2836677029 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff00c06a430 0x7ff00c06c8f0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.393+0000 7ff025cf3640 1 --2- 172.21.15.132:0/2836677029 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0201447b0 0x7ff0201f1d10 unknown :-1 s=CLOSED pgs=1418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.393+0000 7ff025cf3640 1 --2- 172.21.15.132:0/2836677029 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0200ca170 0x7ff0200af090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.393+0000 7ff025cf3640 1 --2- 172.21.15.132:0/2836677029 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff020069c30 0x7ff0200ad250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.393+0000 7ff025cf3640 1 -- 172.21.15.132:0/2836677029 >> 172.21.15.132:0/2836677029 conn(0x7ff0200cc630 msgr2=0x7ff0200c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:16.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.393+0000 7ff025cf3640 1 -- 172.21.15.132:0/2836677029 shutdown_connections 2023-12-20T04:49:16.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.393+0000 7ff025cf3640 1 -- 172.21.15.132:0/2836677029 wait complete. 2023-12-20T04:49:16.405 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:49:16.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.506+0000 7f4c1658b640 1 Processor -- start 2023-12-20T04:49:16.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.506+0000 7f4c1658b640 1 -- start start 2023-12-20T04:49:16.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.507+0000 7f4c1658b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4c10069c30 0x7f4c10070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.507+0000 7f4c1658b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1015d360 0x7f4c1006a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.507+0000 7f4c1658b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4c100c4f40 con 0x7f4c100cbde0 2023-12-20T04:49:16.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.507+0000 7f4c1658b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c100af5b0 con 0x7f4c10069c30 2023-12-20T04:49:16.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.507+0000 7f4c1658b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c1006a550 con 0x7f4c1015d360 2023-12-20T04:49:16.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.507+0000 7f4c0ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4c10069c30 0x7f4c10070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.507+0000 7f4c0ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4c10069c30 0x7f4c10070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40630/0 (socket says 172.21.15.132:40630) 2023-12-20T04:49:16.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.507+0000 7f4c0ffff640 1 -- 172.21.15.132:0/2549412084 learned_addr learned my addr 172.21.15.132:0/2549412084 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:16.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.507+0000 7f4c0f7fe640 1 --2- 172.21.15.132:0/2549412084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1015d360 0x7f4c1006a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.507+0000 7f4c0ffff640 1 -- 172.21.15.132:0/2549412084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1015d360 msgr2=0x7f4c1006a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:16.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.507+0000 7f4c0ffff640 1 --2- 172.21.15.132:0/2549412084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1015d360 0x7f4c1006a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.507+0000 7f4c0ffff640 1 -- 172.21.15.132:0/2549412084 >> v1:172.21.15.187:6789/0 conn(0x7f4c100cbde0 legacy=0x7f4c100ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.507+0000 7f4c0ffff640 1 -- 172.21.15.132:0/2549412084 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c10070a40 con 0x7f4c10069c30 2023-12-20T04:49:16.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.507+0000 7f4c0f7fe640 1 --2- 172.21.15.132:0/2549412084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1015d360 0x7f4c1006a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:16.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.508+0000 7f4c0ffff640 1 --2- 172.21.15.132:0/2549412084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c10069c30 0x7f4c10070460 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009870 tx=0x7f4c0002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=56375473bc372491 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:16.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.508+0000 7f4c0effd640 1 -- 172.21.15.132:0/2549412084 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00030840 con 0x7f4c10069c30 2023-12-20T04:49:16.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.508+0000 7f4c0effd640 1 -- 172.21.15.132:0/2549412084 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c000309a0 con 0x7f4c10069c30 2023-12-20T04:49:16.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.508+0000 7f4c0effd640 1 -- 172.21.15.132:0/2549412084 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c00030d30 con 0x7f4c10069c30 2023-12-20T04:49:16.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.508+0000 7f4c1658b640 1 -- 172.21.15.132:0/2549412084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c10069c30 msgr2=0x7f4c10070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.508+0000 7f4c1658b640 1 --2- 172.21.15.132:0/2549412084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c10069c30 0x7f4c10070460 secure :-1 s=READY pgs=1419 cs=0 l=1 rev1=1 crypto rx=0x7f4c00009870 tx=0x7f4c0002b980 comp rx=0 tx=0).stop 2023-12-20T04:49:16.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.508+0000 7f4c1658b640 1 -- 172.21.15.132:0/2549412084 shutdown_connections 2023-12-20T04:49:16.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.508+0000 7f4c1658b640 1 --2- 172.21.15.132:0/2549412084 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c1015d360 0x7f4c1006a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.508+0000 7f4c1658b640 1 --2- 172.21.15.132:0/2549412084 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c10069c30 0x7f4c10070460 unknown :-1 s=CLOSED pgs=1419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.508+0000 7f4c1658b640 1 -- 172.21.15.132:0/2549412084 >> 172.21.15.132:0/2549412084 conn(0x7f4c100cc630 msgr2=0x7f4c100cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:16.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.509+0000 7f4c1658b640 1 -- 172.21.15.132:0/2549412084 shutdown_connections 2023-12-20T04:49:16.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.509+0000 7f4c1658b640 1 -- 172.21.15.132:0/2549412084 wait complete. 2023-12-20T04:49:16.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.510+0000 7f4c1658b640 1 Processor -- start 2023-12-20T04:49:16.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.510+0000 7f4c1658b640 1 -- start start 2023-12-20T04:49:16.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.510+0000 7f4c1658b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c10069c30 0x7f4c100cb330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.510+0000 7f4c1658b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c100cbde0 0x7f4c101f1f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.510+0000 7f4c1658b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1015d360 0x7f4c1015b390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.510+0000 7f4c1658b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c101f6a80 con 0x7f4c1015d360 2023-12-20T04:49:16.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.510+0000 7f4c1658b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c101f5e70 con 0x7f4c10069c30 2023-12-20T04:49:16.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.510+0000 7f4c1658b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c101f6150 con 0x7f4c100cbde0 2023-12-20T04:49:16.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c14b28640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1015d360 0x7f4c1015b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c14b28640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1015d360 0x7f4c1015b390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40632/0 (socket says 172.21.15.132:40632) 2023-12-20T04:49:16.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c14b28640 1 -- 172.21.15.132:0/1872423528 learned_addr learned my addr 172.21.15.132:0/1872423528 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:16.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c0ffff640 1 --2- 172.21.15.132:0/1872423528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c10069c30 0x7f4c100cb330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c0f7fe640 1 --2- 172.21.15.132:0/1872423528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c100cbde0 0x7f4c101f1f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c14b28640 1 -- 172.21.15.132:0/1872423528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c100cbde0 msgr2=0x7f4c101f1f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c14b28640 1 --2- 172.21.15.132:0/1872423528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c100cbde0 0x7f4c101f1f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c14b28640 1 -- 172.21.15.132:0/1872423528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c10069c30 msgr2=0x7f4c100cb330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c14b28640 1 --2- 172.21.15.132:0/1872423528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c10069c30 0x7f4c100cb330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c14b28640 1 -- 172.21.15.132:0/1872423528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c000094d0 con 0x7f4c1015d360 2023-12-20T04:49:16.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c0f7fe640 1 --2- 172.21.15.132:0/1872423528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c100cbde0 0x7f4c101f1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:16.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c0ffff640 1 --2- 172.21.15.132:0/1872423528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c10069c30 0x7f4c100cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:16.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c14b28640 1 --2- 172.21.15.132:0/1872423528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1015d360 0x7f4c1015b390 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c7a0 tx=0x7f4c0800cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:16.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c0cff9640 1 -- 172.21.15.132:0/1872423528 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08003b70 con 0x7f4c1015d360 2023-12-20T04:49:16.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c0cff9640 1 -- 172.21.15.132:0/1872423528 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c08003cf0 con 0x7f4c1015d360 2023-12-20T04:49:16.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c0cff9640 1 -- 172.21.15.132:0/1872423528 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c08003ea0 con 0x7f4c1015d360 2023-12-20T04:49:16.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c1658b640 1 -- 172.21.15.132:0/1872423528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c101f6430 con 0x7f4c1015d360 2023-12-20T04:49:16.515 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.511+0000 7f4c1658b640 1 -- 172.21.15.132:0/1872423528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c100cb870 con 0x7f4c1015d360 2023-12-20T04:49:16.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.512+0000 7f4c1658b640 1 -- 172.21.15.132:0/1872423528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c101f6c30 con 0x7f4c1015d360 2023-12-20T04:49:16.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.513+0000 7f4c0cff9640 1 -- 172.21.15.132:0/1872423528 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4c0800aa90 con 0x7f4c1015d360 2023-12-20T04:49:16.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.513+0000 7f4c0cff9640 1 --2- 172.21.15.132:0/1872423528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4bfc06a460 0x7f4bfc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.513+0000 7f4c0cff9640 1 -- 172.21.15.132:0/1872423528 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4c08088760 con 0x7f4c1015d360 2023-12-20T04:49:16.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.513+0000 7f4c0ffff640 1 --2- 172.21.15.132:0/1872423528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4bfc06a460 0x7f4bfc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.514+0000 7f4c0ffff640 1 --2- 172.21.15.132:0/1872423528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4bfc06a460 0x7f4bfc06c920 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4c00036000 tx=0x7f4c0003b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:16.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.517+0000 7f4c0cff9640 1 -- 172.21.15.132:0/1872423528 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4c101f6c30 con 0x7f4c1015d360 2023-12-20T04:49:16.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.682+0000 7f4c1658b640 1 -- 172.21.15.132:0/1872423528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4c1004e840 con 0x7f4c1015d360 2023-12-20T04:49:16.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.683+0000 7f4c0cff9640 1 -- 172.21.15.132:0/1872423528 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v140) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4c08053d50 con 0x7f4c1015d360 2023-12-20T04:49:16.685 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:49:16.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.685+0000 7f4c1658b640 1 -- 172.21.15.132:0/1872423528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4bfc06a460 msgr2=0x7f4bfc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.685+0000 7f4c1658b640 1 --2- 172.21.15.132:0/1872423528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4bfc06a460 0x7f4bfc06c920 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7f4c00036000 tx=0x7f4c0003b040 comp rx=0 tx=0).stop 2023-12-20T04:49:16.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.685+0000 7f4c1658b640 1 -- 172.21.15.132:0/1872423528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1015d360 msgr2=0x7f4c1015b390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.685+0000 7f4c1658b640 1 --2- 172.21.15.132:0/1872423528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1015d360 0x7f4c1015b390 secure :-1 s=READY pgs=1420 cs=0 l=1 rev1=1 crypto rx=0x7f4c0800c7a0 tx=0x7f4c0800cc60 comp rx=0 tx=0).stop 2023-12-20T04:49:16.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.685+0000 7f4c1658b640 1 -- 172.21.15.132:0/1872423528 shutdown_connections 2023-12-20T04:49:16.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.685+0000 7f4c1658b640 1 --2- 172.21.15.132:0/1872423528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4bfc06a460 0x7f4bfc06c920 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.685+0000 7f4c1658b640 1 --2- 172.21.15.132:0/1872423528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c1015d360 0x7f4c1015b390 unknown :-1 s=CLOSED pgs=1420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.685+0000 7f4c1658b640 1 --2- 172.21.15.132:0/1872423528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c100cbde0 0x7f4c101f1f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.685+0000 7f4c1658b640 1 --2- 172.21.15.132:0/1872423528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c10069c30 0x7f4c100cb330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.685+0000 7f4c1658b640 1 -- 172.21.15.132:0/1872423528 >> 172.21.15.132:0/1872423528 conn(0x7f4c100cc630 msgr2=0x7f4c100c6300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:16.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.685+0000 7f4c1658b640 1 -- 172.21.15.132:0/1872423528 shutdown_connections 2023-12-20T04:49:16.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.685+0000 7f4c1658b640 1 -- 172.21.15.132:0/1872423528 wait complete. 2023-12-20T04:49:16.697 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:49:16.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.798+0000 7fabc22af640 1 Processor -- start 2023-12-20T04:49:16.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.798+0000 7fabc22af640 1 -- start start 2023-12-20T04:49:16.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.799+0000 7fabc22af640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabbc0caee0 0x7fabbc0c5330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.799+0000 7fabc22af640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fabbc06f8d0 0x7fabbc06bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.799+0000 7fabc22af640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fabbc06b960 con 0x7fabbc06f450 2023-12-20T04:49:16.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.799+0000 7fabc22af640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fabbc0c4c30 con 0x7fabbc06f8d0 2023-12-20T04:49:16.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.799+0000 7fabc22af640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0c4390 con 0x7fabbc0caee0 2023-12-20T04:49:16.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.799+0000 7fabbbfff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabbc0caee0 0x7fabbc0c5330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.799+0000 7fabc084c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fabbc06f8d0 0x7fabbc06bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.799+0000 7fabbbfff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabbc0caee0 0x7fabbc0c5330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:34798/0 (socket says 172.21.15.132:34798) 2023-12-20T04:49:16.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.799+0000 7fabbbfff640 1 -- 172.21.15.132:0/1376866443 learned_addr learned my addr 172.21.15.132:0/1376866443 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:16.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.800+0000 7fabbbfff640 1 -- 172.21.15.132:0/1376866443 >> v2:172.21.15.187:3300/0 conn(0x7fabbc06f8d0 msgr2=0x7fabbc06bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:16.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.800+0000 7fabbbfff640 1 --2- 172.21.15.132:0/1376866443 >> v2:172.21.15.187:3300/0 conn(0x7fabbc06f8d0 0x7fabbc06bdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.800+0000 7fabbbfff640 1 -- 172.21.15.132:0/1376866443 >> v1:172.21.15.187:6789/0 conn(0x7fabbc06f450 legacy=0x7fabbc0cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.800+0000 7fabbaffd640 1 -- 172.21.15.132:0/1376866443 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1581165962 0 0) 0x7fabbc06b960 con 0x7fabbc06f450 2023-12-20T04:49:16.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.800+0000 7fabbbfff640 1 -- 172.21.15.132:0/1376866443 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabbc0c4670 con 0x7fabbc0caee0 2023-12-20T04:49:16.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.800+0000 7fabc084c640 1 --2- 172.21.15.132:0/1376866443 >> v2:172.21.15.187:3300/0 conn(0x7fabbc06f8d0 0x7fabbc06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:49:16.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.800+0000 7fabbbfff640 1 --2- 172.21.15.132:0/1376866443 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabbc0caee0 0x7fabbc0c5330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fabac009870 tx=0x7fabac02b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=91e4e9f5cfe6e44e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:16.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.801+0000 7fabbaffd640 1 -- 172.21.15.132:0/1376866443 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac030840 con 0x7fabbc0caee0 2023-12-20T04:49:16.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.801+0000 7fabbaffd640 1 -- 172.21.15.132:0/1376866443 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac0309a0 con 0x7fabbc0caee0 2023-12-20T04:49:16.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.801+0000 7fabbaffd640 1 -- 172.21.15.132:0/1376866443 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac030d30 con 0x7fabbc0caee0 2023-12-20T04:49:16.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.801+0000 7fabc22af640 1 -- 172.21.15.132:0/1376866443 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabbc0caee0 msgr2=0x7fabbc0c5330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.804 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.801+0000 7fabc22af640 1 --2- 172.21.15.132:0/1376866443 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabbc0caee0 0x7fabbc0c5330 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7fabac009870 tx=0x7fabac02b980 comp rx=0 tx=0).stop 2023-12-20T04:49:16.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.801+0000 7fabc22af640 1 -- 172.21.15.132:0/1376866443 shutdown_connections 2023-12-20T04:49:16.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.801+0000 7fabc22af640 1 --2- 172.21.15.132:0/1376866443 >> v2:172.21.15.187:3300/0 conn(0x7fabbc06f8d0 0x7fabbc06bdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.801+0000 7fabc22af640 1 --2- 172.21.15.132:0/1376866443 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabbc0caee0 0x7fabbc0c5330 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.801+0000 7fabc22af640 1 -- 172.21.15.132:0/1376866443 >> 172.21.15.132:0/1376866443 conn(0x7fabbc06a260 msgr2=0x7fabbc0b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:16.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.801+0000 7fabc22af640 1 -- 172.21.15.132:0/1376866443 shutdown_connections 2023-12-20T04:49:16.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.801+0000 7fabc22af640 1 -- 172.21.15.132:0/1376866443 wait complete. 2023-12-20T04:49:16.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.802+0000 7fabc22af640 1 Processor -- start 2023-12-20T04:49:16.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.803+0000 7fabc22af640 1 -- start start 2023-12-20T04:49:16.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.803+0000 7fabc22af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabbc06f450 0x7fabbc140600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.803+0000 7fabc22af640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabbc06f8d0 0x7fabbc0c7d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.803+0000 7fabc22af640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabbc0caee0 0x7fabbc141370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.803+0000 7fabc22af640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0c7900 con 0x7fabbc06f450 2023-12-20T04:49:16.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.803+0000 7fabc22af640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0c6cf0 con 0x7fabbc0caee0 2023-12-20T04:49:16.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.803+0000 7fabc22af640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fabbc0c6fd0 con 0x7fabbc06f8d0 2023-12-20T04:49:16.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.803+0000 7fabbbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabbc06f450 0x7fabbc140600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.803+0000 7fabbbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabbc06f450 0x7fabbc140600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40638/0 (socket says 172.21.15.132:40638) 2023-12-20T04:49:16.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.803+0000 7fabbbfff640 1 -- 172.21.15.132:0/3755760830 learned_addr learned my addr 172.21.15.132:0/3755760830 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:16.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.803+0000 7fabc084c640 1 --2- 172.21.15.132:0/3755760830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabbc0caee0 0x7fabbc141370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.804+0000 7fabbb7fe640 1 --2- 172.21.15.132:0/3755760830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabbc06f8d0 0x7fabbc0c7d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.804+0000 7fabbbfff640 1 -- 172.21.15.132:0/3755760830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabbc06f8d0 msgr2=0x7fabbc0c7d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.804+0000 7fabbbfff640 1 --2- 172.21.15.132:0/3755760830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabbc06f8d0 0x7fabbc0c7d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.804+0000 7fabbbfff640 1 -- 172.21.15.132:0/3755760830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabbc0caee0 msgr2=0x7fabbc141370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.804+0000 7fabbbfff640 1 --2- 172.21.15.132:0/3755760830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabbc0caee0 0x7fabbc141370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.804+0000 7fabbbfff640 1 -- 172.21.15.132:0/3755760830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fabb4009a70 con 0x7fabbc06f450 2023-12-20T04:49:16.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.804+0000 7fabc084c640 1 --2- 172.21.15.132:0/3755760830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabbc0caee0 0x7fabbc141370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:49:16.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.804+0000 7fabbbfff640 1 --2- 172.21.15.132:0/3755760830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabbc06f450 0x7fabbc140600 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fabac000c00 tx=0x7fabac0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:16.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.804+0000 7fabb8ff9640 1 -- 172.21.15.132:0/3755760830 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac03e070 con 0x7fabbc06f450 2023-12-20T04:49:16.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.804+0000 7fabb8ff9640 1 -- 172.21.15.132:0/3755760830 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fabac039a10 con 0x7fabbc06f450 2023-12-20T04:49:16.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.804+0000 7fabc22af640 1 -- 172.21.15.132:0/3755760830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fabac0094d0 con 0x7fabbc06f450 2023-12-20T04:49:16.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.804+0000 7fabb8ff9640 1 -- 172.21.15.132:0/3755760830 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fabac039dc0 con 0x7fabbc06f450 2023-12-20T04:49:16.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.804+0000 7fabc22af640 1 -- 172.21.15.132:0/3755760830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fabbc0c7590 con 0x7fabbc06f450 2023-12-20T04:49:16.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.805+0000 7fabc22af640 1 -- 172.21.15.132:0/3755760830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fabbc0c7750 con 0x7fabbc06f450 2023-12-20T04:49:16.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.806+0000 7fabb8ff9640 1 -- 172.21.15.132:0/3755760830 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fabac04b400 con 0x7fabbc06f450 2023-12-20T04:49:16.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.806+0000 7fabb8ff9640 1 --2- 172.21.15.132:0/3755760830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faba806a430 0x7faba806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:16.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.806+0000 7fabb8ff9640 1 -- 172.21.15.132:0/3755760830 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fabac0aac10 con 0x7fabbc06f450 2023-12-20T04:49:16.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.806+0000 7fabbb7fe640 1 --2- 172.21.15.132:0/3755760830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faba806a430 0x7faba806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:16.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.806+0000 7fabbb7fe640 1 --2- 172.21.15.132:0/3755760830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faba806a430 0x7faba806c8f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fabbc06c610 tx=0x7fabb0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:16.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.810+0000 7fabb8ff9640 1 -- 172.21.15.132:0/3755760830 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fabac076290 con 0x7fabbc06f450 2023-12-20T04:49:16.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.978+0000 7fabc22af640 1 -- 172.21.15.132:0/3755760830 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fabbc04e840 con 0x7fabbc06f450 2023-12-20T04:49:16.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.978+0000 7fabb8ff9640 1 -- 172.21.15.132:0/3755760830 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v140) v1 ==== 100+0+11 (secure 0 0 0) 0x7fabac034020 con 0x7fabbc06f450 2023-12-20T04:49:16.980 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:49:16.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.980+0000 7fabc22af640 1 -- 172.21.15.132:0/3755760830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faba806a430 msgr2=0x7faba806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.980+0000 7fabc22af640 1 --2- 172.21.15.132:0/3755760830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faba806a430 0x7faba806c8f0 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7fabbc06c610 tx=0x7fabb0009040 comp rx=0 tx=0).stop 2023-12-20T04:49:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.980+0000 7fabc22af640 1 -- 172.21.15.132:0/3755760830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabbc06f450 msgr2=0x7fabbc140600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.980+0000 7fabc22af640 1 --2- 172.21.15.132:0/3755760830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabbc06f450 0x7fabbc140600 secure :-1 s=READY pgs=1421 cs=0 l=1 rev1=1 crypto rx=0x7fabac000c00 tx=0x7fabac0046c0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.980+0000 7fabc22af640 1 -- 172.21.15.132:0/3755760830 shutdown_connections 2023-12-20T04:49:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.980+0000 7fabc22af640 1 --2- 172.21.15.132:0/3755760830 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faba806a430 0x7faba806c8f0 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.980+0000 7fabc22af640 1 --2- 172.21.15.132:0/3755760830 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fabbc0caee0 0x7fabbc141370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.980+0000 7fabc22af640 1 --2- 172.21.15.132:0/3755760830 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fabbc06f8d0 0x7fabbc0c7d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.980+0000 7fabc22af640 1 --2- 172.21.15.132:0/3755760830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fabbc06f450 0x7fabbc140600 unknown :-1 s=CLOSED pgs=1421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.980+0000 7fabc22af640 1 -- 172.21.15.132:0/3755760830 >> 172.21.15.132:0/3755760830 conn(0x7fabbc06a260 msgr2=0x7fabbc0b0570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.980+0000 7fabc22af640 1 -- 172.21.15.132:0/3755760830 shutdown_connections 2023-12-20T04:49:16.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:16.980+0000 7fabc22af640 1 -- 172.21.15.132:0/3755760830 wait complete. 2023-12-20T04:49:16.993 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:49:17.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.092+0000 7f055922c640 1 Processor -- start 2023-12-20T04:49:17.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.092+0000 7f055922c640 1 -- start start 2023-12-20T04:49:17.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f055922c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0554069c30 0x7f055406a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f055922c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f05540acbb0 0x7f05540ad020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f055922c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f055406a5d0 con 0x7f055415d050 2023-12-20T04:49:17.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f055922c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05540708d0 con 0x7f05540acbb0 2023-12-20T04:49:17.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f055922c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0554070bb0 con 0x7f0554069c30 2023-12-20T04:49:17.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f0552d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f055415d050 0x7f05540c6150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:58906/0 (socket says 172.21.15.132:58906) 2023-12-20T04:49:17.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f0552d9d640 1 -- 172.21.15.132:0/771189633 learned_addr learned my addr 172.21.15.132:0/771189633 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:17.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f0551d9b640 1 -- 172.21.15.132:0/771189633 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3049472606 0 0) 0x7f055406a5d0 con 0x7f055415d050 2023-12-20T04:49:17.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f055359e640 1 --2- 172.21.15.132:0/771189633 >> v2:172.21.15.187:3300/0 conn(0x7f05540acbb0 0x7f05540ad020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f0551d9b640 1 -- 172.21.15.132:0/771189633 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f053c003520 con 0x7f055415d050 2023-12-20T04:49:17.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f055259c640 1 --2- 172.21.15.132:0/771189633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0554069c30 0x7f055406a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f0551d9b640 1 -- 172.21.15.132:0/771189633 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3531198262 0 0) 0x7f053c003520 con 0x7f055415d050 2023-12-20T04:49:17.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f0551d9b640 1 -- 172.21.15.132:0/771189633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0554069c30 msgr2=0x7f055406a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:17.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f0551d9b640 1 --2- 172.21.15.132:0/771189633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0554069c30 0x7f055406a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f0551d9b640 1 -- 172.21.15.132:0/771189633 >> v2:172.21.15.187:3300/0 conn(0x7f05540acbb0 msgr2=0x7f05540ad020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:17.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f0551d9b640 1 --2- 172.21.15.132:0/771189633 >> v2:172.21.15.187:3300/0 conn(0x7f05540acbb0 0x7f05540ad020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f0551d9b640 1 -- 172.21.15.132:0/771189633 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0554070e90 con 0x7f055415d050 2023-12-20T04:49:17.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f0551d9b640 1 -- 172.21.15.132:0/771189633 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f05440019f0 con 0x7f055415d050 2023-12-20T04:49:17.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f0551d9b640 1 -- 172.21.15.132:0/771189633 >> v1:172.21.15.132:6789/0 conn(0x7f055415d050 legacy=0x7f05540c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:17.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f0551d9b640 1 --2- 172.21.15.132:0/771189633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0554069c30 0x7f053c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f0551d9b640 1 --2- 172.21.15.132:0/771189633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f053c003ef0 0x7f053c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.093+0000 7f0551d9b640 1 --2- 172.21.15.132:0/771189633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f053c004d00 0x7f053c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.094+0000 7f0551d9b640 1 -- 172.21.15.132:0/771189633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05540708d0 con 0x7f053c003ef0 2023-12-20T04:49:17.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.094+0000 7f0551d9b640 1 -- 172.21.15.132:0/771189633 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0554070bb0 con 0x7f053c004d00 2023-12-20T04:49:17.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.094+0000 7f0551d9b640 1 -- 172.21.15.132:0/771189633 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f053c00b980 con 0x7f0554069c30 2023-12-20T04:49:17.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.094+0000 7f055259c640 1 --2- 172.21.15.132:0/771189633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f053c003ef0 0x7f053c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.094+0000 7f0552d9d640 1 --2- 172.21.15.132:0/771189633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0554069c30 0x7f053c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.094+0000 7f055359e640 1 --2- 172.21.15.132:0/771189633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f053c004d00 0x7f053c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.094+0000 7f055259c640 1 -- 172.21.15.132:0/771189633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0554069c30 msgr2=0x7f053c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:17.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.094+0000 7f055259c640 1 --2- 172.21.15.132:0/771189633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0554069c30 0x7f053c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.094+0000 7f055259c640 1 -- 172.21.15.132:0/771189633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f053c004d00 msgr2=0x7f053c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:17.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.094+0000 7f055259c640 1 --2- 172.21.15.132:0/771189633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f053c004d00 0x7f053c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.094+0000 7f055259c640 1 -- 172.21.15.132:0/771189633 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f053c003520 con 0x7f053c003ef0 2023-12-20T04:49:17.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.094+0000 7f055359e640 1 --2- 172.21.15.132:0/771189633 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f053c004d00 0x7f053c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:17.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.094+0000 7f0552d9d640 1 --2- 172.21.15.132:0/771189633 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0554069c30 0x7f053c003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:17.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.095+0000 7f055259c640 1 --2- 172.21.15.132:0/771189633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f053c003ef0 0x7f053c0047c0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f0548009ac0 tx=0x7f053c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44e8b618807479dd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:17.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.095+0000 7f0551d9b640 1 -- 172.21.15.132:0/771189633 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054802c6b0 con 0x7f053c003ef0 2023-12-20T04:49:17.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.095+0000 7f0551d9b640 1 -- 172.21.15.132:0/771189633 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054802c810 con 0x7f053c003ef0 2023-12-20T04:49:17.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.095+0000 7f0551d9b640 1 -- 172.21.15.132:0/771189633 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054802cba0 con 0x7f053c003ef0 2023-12-20T04:49:17.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.095+0000 7f055922c640 1 -- 172.21.15.132:0/771189633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f053c003ef0 msgr2=0x7f053c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:17.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.095+0000 7f055922c640 1 --2- 172.21.15.132:0/771189633 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f053c003ef0 0x7f053c0047c0 secure :-1 s=READY pgs=1423 cs=0 l=1 rev1=1 crypto rx=0x7f0548009ac0 tx=0x7f053c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.095+0000 7f055359e640 1 -- 172.21.15.132:0/771189633 reap_dead start 2023-12-20T04:49:17.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.095+0000 7f055922c640 1 -- 172.21.15.132:0/771189633 shutdown_connections 2023-12-20T04:49:17.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.095+0000 7f055922c640 1 -- 172.21.15.132:0/771189633 >> 172.21.15.132:0/771189633 conn(0x7f05540cfb10 msgr2=0x7f05540cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:17.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.095+0000 7f055922c640 1 -- 172.21.15.132:0/771189633 shutdown_connections 2023-12-20T04:49:17.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.095+0000 7f055922c640 1 -- 172.21.15.132:0/771189633 wait complete. 2023-12-20T04:49:17.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.097+0000 7f055922c640 1 Processor -- start 2023-12-20T04:49:17.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.097+0000 7f055922c640 1 -- start start 2023-12-20T04:49:17.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.097+0000 7f055922c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f053c003ef0 0x7f0554156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.097+0000 7f055922c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05541f2ed0 0x7f055415fd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.097+0000 7f055922c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05540af930 0x7f05540afde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.097+0000 7f055922c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f055415f1d0 con 0x7f05540af930 2023-12-20T04:49:17.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.097+0000 7f055922c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05540b0320 con 0x7f053c003ef0 2023-12-20T04:49:17.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.097+0000 7f055922c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f055415e830 con 0x7f05541f2ed0 2023-12-20T04:49:17.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.098+0000 7f055359e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05540af930 0x7f05540afde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.098+0000 7f055359e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05540af930 0x7f05540afde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40654/0 (socket says 172.21.15.132:40654) 2023-12-20T04:49:17.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.098+0000 7f055359e640 1 -- 172.21.15.132:0/2777910214 learned_addr learned my addr 172.21.15.132:0/2777910214 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:17.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.098+0000 7f0552d9d640 1 --2- 172.21.15.132:0/2777910214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f053c003ef0 0x7f0554156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.098+0000 7f055259c640 1 --2- 172.21.15.132:0/2777910214 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05541f2ed0 0x7f055415fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.098+0000 7f055359e640 1 -- 172.21.15.132:0/2777910214 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05541f2ed0 msgr2=0x7f055415fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:17.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.098+0000 7f055359e640 1 --2- 172.21.15.132:0/2777910214 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05541f2ed0 0x7f055415fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.098+0000 7f055359e640 1 -- 172.21.15.132:0/2777910214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f053c003ef0 msgr2=0x7f0554156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:17.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.098+0000 7f055359e640 1 --2- 172.21.15.132:0/2777910214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f053c003ef0 0x7f0554156830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.098+0000 7f055359e640 1 -- 172.21.15.132:0/2777910214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f055415eb10 con 0x7f05540af930 2023-12-20T04:49:17.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.098+0000 7f055359e640 1 --2- 172.21.15.132:0/2777910214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05540af930 0x7f05540afde0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f05540ce610 tx=0x7f054c011860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:17.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.098+0000 7f053b7fe640 1 -- 172.21.15.132:0/2777910214 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c004440 con 0x7f05540af930 2023-12-20T04:49:17.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.098+0000 7f053b7fe640 1 -- 172.21.15.132:0/2777910214 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f054c003610 con 0x7f05540af930 2023-12-20T04:49:17.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.098+0000 7f055922c640 1 -- 172.21.15.132:0/2777910214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f055415edf0 con 0x7f05540af930 2023-12-20T04:49:17.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.098+0000 7f053b7fe640 1 -- 172.21.15.132:0/2777910214 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f054c0039c0 con 0x7f05540af930 2023-12-20T04:49:17.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.098+0000 7f055922c640 1 -- 172.21.15.132:0/2777910214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f055415f5f0 con 0x7f05540af930 2023-12-20T04:49:17.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.099+0000 7f055922c640 1 -- 172.21.15.132:0/2777910214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f055415f310 con 0x7f05540af930 2023-12-20T04:49:17.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.100+0000 7f053b7fe640 1 -- 172.21.15.132:0/2777910214 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f054c003b20 con 0x7f05540af930 2023-12-20T04:49:17.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.100+0000 7f053b7fe640 1 --2- 172.21.15.132:0/2777910214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f054006a430 0x7f054006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.100+0000 7f053b7fe640 1 -- 172.21.15.132:0/2777910214 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f054c088b70 con 0x7f05540af930 2023-12-20T04:49:17.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.100+0000 7f0552d9d640 1 --2- 172.21.15.132:0/2777910214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f054006a430 0x7f054006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.100+0000 7f0552d9d640 1 --2- 172.21.15.132:0/2777910214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f054006a430 0x7f054006c8f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0544001330 tx=0x7f05440017b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:17.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.104+0000 7f053b7fe640 1 -- 172.21.15.132:0/2777910214 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f055415f310 con 0x7f05540af930 2023-12-20T04:49:17.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.285+0000 7f055922c640 1 -- 172.21.15.132:0/2777910214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f055415f310 con 0x7f05540af930 2023-12-20T04:49:17.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.286+0000 7f053b7fe640 1 -- 172.21.15.132:0/2777910214 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v140) v1 ==== 80+0+0 (secure 0 0 0) 0x7f055415f310 con 0x7f05540af930 2023-12-20T04:49:17.288 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:49:17.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.287+0000 7f055922c640 1 -- 172.21.15.132:0/2777910214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f054006a430 msgr2=0x7f054006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:17.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.287+0000 7f055922c640 1 --2- 172.21.15.132:0/2777910214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f054006a430 0x7f054006c8f0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f0544001330 tx=0x7f05440017b0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.287+0000 7f055922c640 1 -- 172.21.15.132:0/2777910214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05540af930 msgr2=0x7f05540afde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:17.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.287+0000 7f055922c640 1 --2- 172.21.15.132:0/2777910214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05540af930 0x7f05540afde0 secure :-1 s=READY pgs=1424 cs=0 l=1 rev1=1 crypto rx=0x7f05540ce610 tx=0x7f054c011860 comp rx=0 tx=0).stop 2023-12-20T04:49:17.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.288+0000 7f055922c640 1 -- 172.21.15.132:0/2777910214 shutdown_connections 2023-12-20T04:49:17.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.288+0000 7f055922c640 1 --2- 172.21.15.132:0/2777910214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f054006a430 0x7f054006c8f0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.288+0000 7f055922c640 1 --2- 172.21.15.132:0/2777910214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05540af930 0x7f05540afde0 unknown :-1 s=CLOSED pgs=1424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.288+0000 7f055922c640 1 --2- 172.21.15.132:0/2777910214 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05541f2ed0 0x7f055415fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.288+0000 7f055922c640 1 --2- 172.21.15.132:0/2777910214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f053c003ef0 0x7f0554156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.288+0000 7f055922c640 1 -- 172.21.15.132:0/2777910214 >> 172.21.15.132:0/2777910214 conn(0x7f05540cfb10 msgr2=0x7f05540d01d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:17.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.288+0000 7f055922c640 1 -- 172.21.15.132:0/2777910214 shutdown_connections 2023-12-20T04:49:17.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.288+0000 7f055922c640 1 -- 172.21.15.132:0/2777910214 wait complete. 2023-12-20T04:49:17.300 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2023-12-20T04:49:17.300 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:17.301 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-20T04:49:17.326 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[114193]: fuse finished with error 0 and tester_r 0 2023-12-20T04:49:17.332 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:49:17.332 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:17.332 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-20T04:49:17.401 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:49:17.401 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:49:17.419 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:49:17.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.538+0000 7f5e997c9640 1 Processor -- start 2023-12-20T04:49:17.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.538+0000 7f5e997c9640 1 -- start start 2023-12-20T04:49:17.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.539+0000 7f5e997c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5e941588e0 0x7f5e94069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.539+0000 7f5e997c9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9406ea90 con 0x7f5e9406a170 2023-12-20T04:49:17.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.539+0000 7f5e997c9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5e9406e160 con 0x7f5e9406cf00 2023-12-20T04:49:17.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.539+0000 7f5e997c9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5e9406d520 con 0x7f5e941588e0 2023-12-20T04:49:17.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.539+0000 7f5e92ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5e941588e0 0x7f5e94069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.539+0000 7f5e927fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5e9406a170 0x7f5e9406c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39960/0 (socket says 172.21.15.132:39960) 2023-12-20T04:49:17.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.539+0000 7f5e927fc640 1 -- 172.21.15.132:0/3454366722 learned_addr learned my addr 172.21.15.132:0/3454366722 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:17.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.540+0000 7f5e92ffd640 1 -- 172.21.15.132:0/3454366722 >> v1:172.21.15.187:6789/0 conn(0x7f5e9406cf00 legacy=0x7f5e940b4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:17.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.540+0000 7f5e92ffd640 1 -- 172.21.15.132:0/3454366722 >> v1:172.21.15.132:6789/0 conn(0x7f5e9406a170 legacy=0x7f5e9406c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:17.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.540+0000 7f5e92ffd640 1 -- 172.21.15.132:0/3454366722 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e9406e440 con 0x7f5e941588e0 2023-12-20T04:49:17.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.540+0000 7f5e91ffb640 1 -- 172.21.15.132:0/3454366722 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2914311972 0 0) 0x7f5e9406ea90 con 0x7f5e9406a170 2023-12-20T04:49:17.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.540+0000 7f5e92ffd640 1 --2- 172.21.15.132:0/3454366722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e941588e0 0x7f5e94069c30 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009d90 tx=0x7f5e8402beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54d1b33753549225 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:17.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.540+0000 7f5e91ffb640 1 -- 172.21.15.132:0/3454366722 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8402cc60 con 0x7f5e941588e0 2023-12-20T04:49:17.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.540+0000 7f5e91ffb640 1 -- 172.21.15.132:0/3454366722 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8402cdc0 con 0x7f5e941588e0 2023-12-20T04:49:17.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.540+0000 7f5e91ffb640 1 -- 172.21.15.132:0/3454366722 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e84034660 con 0x7f5e941588e0 2023-12-20T04:49:17.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.541+0000 7f5e997c9640 1 -- 172.21.15.132:0/3454366722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e941588e0 msgr2=0x7f5e94069c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:17.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.541+0000 7f5e997c9640 1 --2- 172.21.15.132:0/3454366722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e941588e0 0x7f5e94069c30 secure :-1 s=READY pgs=1426 cs=0 l=1 rev1=1 crypto rx=0x7f5e84009d90 tx=0x7f5e8402beb0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.541+0000 7f5e997c9640 1 -- 172.21.15.132:0/3454366722 shutdown_connections 2023-12-20T04:49:17.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.541+0000 7f5e997c9640 1 --2- 172.21.15.132:0/3454366722 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e941588e0 0x7f5e94069c30 unknown :-1 s=CLOSED pgs=1426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.541+0000 7f5e997c9640 1 -- 172.21.15.132:0/3454366722 >> 172.21.15.132:0/3454366722 conn(0x7f5e940cfca0 msgr2=0x7f5e940d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:17.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.541+0000 7f5e997c9640 1 -- 172.21.15.132:0/3454366722 shutdown_connections 2023-12-20T04:49:17.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.541+0000 7f5e997c9640 1 -- 172.21.15.132:0/3454366722 wait complete. 2023-12-20T04:49:17.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.542+0000 7f5e997c9640 1 Processor -- start 2023-12-20T04:49:17.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.542+0000 7f5e997c9640 1 -- start start 2023-12-20T04:49:17.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.543+0000 7f5e997c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e9406a170 0x7f5e940b39d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.543+0000 7f5e997c9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e9406cf00 0x7f5e940aeec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.543+0000 7f5e997c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e941588e0 0x7f5e94157500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.543+0000 7f5e997c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940af400 con 0x7f5e941588e0 2023-12-20T04:49:17.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.543+0000 7f5e997c9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940c6d70 con 0x7f5e9406cf00 2023-12-20T04:49:17.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.543+0000 7f5e997c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5e940cd970 con 0x7f5e9406a170 2023-12-20T04:49:17.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.543+0000 7f5e937fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e941588e0 0x7f5e94157500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.543+0000 7f5e937fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e941588e0 0x7f5e94157500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50244/0 (socket says 172.21.15.132:50244) 2023-12-20T04:49:17.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.543+0000 7f5e937fe640 1 -- 172.21.15.132:0/4057341594 learned_addr learned my addr 172.21.15.132:0/4057341594 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:17.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.543+0000 7f5e92ffd640 1 --2- 172.21.15.132:0/4057341594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e9406a170 0x7f5e940b39d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.543+0000 7f5e927fc640 1 --2- 172.21.15.132:0/4057341594 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e9406cf00 0x7f5e940aeec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.543+0000 7f5e937fe640 1 -- 172.21.15.132:0/4057341594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e9406a170 msgr2=0x7f5e940b39d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:17.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.543+0000 7f5e937fe640 1 --2- 172.21.15.132:0/4057341594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e9406a170 0x7f5e940b39d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.543+0000 7f5e937fe640 1 -- 172.21.15.132:0/4057341594 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e9406cf00 msgr2=0x7f5e940aeec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:17.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.543+0000 7f5e937fe640 1 --2- 172.21.15.132:0/4057341594 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e9406cf00 0x7f5e940aeec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.543+0000 7f5e937fe640 1 -- 172.21.15.132:0/4057341594 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5e84009a70 con 0x7f5e941588e0 2023-12-20T04:49:17.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.544+0000 7f5e937fe640 1 --2- 172.21.15.132:0/4057341594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e941588e0 0x7f5e94157500 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00b4c0 tx=0x7f5e8c00b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:17.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.544+0000 7f5e7b7fe640 1 -- 172.21.15.132:0/4057341594 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c011830 con 0x7f5e941588e0 2023-12-20T04:49:17.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.544+0000 7f5e7b7fe640 1 -- 172.21.15.132:0/4057341594 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5e8c0119b0 con 0x7f5e941588e0 2023-12-20T04:49:17.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.544+0000 7f5e7b7fe640 1 -- 172.21.15.132:0/4057341594 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5e8c011d60 con 0x7f5e941588e0 2023-12-20T04:49:17.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.544+0000 7f5e997c9640 1 -- 172.21.15.132:0/4057341594 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5e940b40d0 con 0x7f5e941588e0 2023-12-20T04:49:17.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.544+0000 7f5e997c9640 1 -- 172.21.15.132:0/4057341594 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5e940b4690 con 0x7f5e941588e0 2023-12-20T04:49:17.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.545+0000 7f5e997c9640 1 -- 172.21.15.132:0/4057341594 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5e9404e840 con 0x7f5e941588e0 2023-12-20T04:49:17.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.545+0000 7f5e7b7fe640 1 -- 172.21.15.132:0/4057341594 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5e8c01a410 con 0x7f5e941588e0 2023-12-20T04:49:17.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.546+0000 7f5e7b7fe640 1 --2- 172.21.15.132:0/4057341594 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5e8006a460 0x7f5e8006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.546+0000 7f5e92ffd640 1 --2- 172.21.15.132:0/4057341594 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5e8006a460 0x7f5e8006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.546+0000 7f5e7b7fe640 1 -- 172.21.15.132:0/4057341594 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5e8c0883a0 con 0x7f5e941588e0 2023-12-20T04:49:17.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.546+0000 7f5e92ffd640 1 --2- 172.21.15.132:0/4057341594 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5e8006a460 0x7f5e8006c920 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5e84036000 tx=0x7f5e84030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:17.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.550+0000 7f5e7b7fe640 1 -- 172.21.15.132:0/4057341594 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5e8c053a20 con 0x7f5e941588e0 2023-12-20T04:49:17.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.719+0000 7f5e997c9640 1 -- 172.21.15.132:0/4057341594 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f5e940c35b0 con 0x7f5e941588e0 2023-12-20T04:49:17.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.721+0000 7f5e7b7fe640 1 -- 172.21.15.132:0/4057341594 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v140) v1 ==== 74+0+16115 (secure 0 0 0) 0x7f5e8c057040 con 0x7f5e941588e0 2023-12-20T04:49:17.723 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:17.723 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":140,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:49:09.856481+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:48:35.008751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-20T04:48:36.182609+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"140","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:49:17.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.722+0000 7f5e997c9640 1 -- 172.21.15.132:0/4057341594 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5e8006a460 msgr2=0x7f5e8006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:17.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.722+0000 7f5e997c9640 1 --2- 172.21.15.132:0/4057341594 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5e8006a460 0x7f5e8006c920 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f5e84036000 tx=0x7f5e84030000 comp rx=0 tx=0).stop 2023-12-20T04:49:17.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.722+0000 7f5e997c9640 1 -- 172.21.15.132:0/4057341594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e941588e0 msgr2=0x7f5e94157500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:17.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.722+0000 7f5e997c9640 1 --2- 172.21.15.132:0/4057341594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e941588e0 0x7f5e94157500 secure :-1 s=READY pgs=1427 cs=0 l=1 rev1=1 crypto rx=0x7f5e8c00b4c0 tx=0x7f5e8c00b980 comp rx=0 tx=0).stop 2023-12-20T04:49:17.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.723+0000 7f5e997c9640 1 -- 172.21.15.132:0/4057341594 shutdown_connections 2023-12-20T04:49:17.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.723+0000 7f5e997c9640 1 --2- 172.21.15.132:0/4057341594 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5e8006a460 0x7f5e8006c920 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.723+0000 7f5e997c9640 1 --2- 172.21.15.132:0/4057341594 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5e941588e0 0x7f5e94157500 unknown :-1 s=CLOSED pgs=1427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.723+0000 7f5e997c9640 1 --2- 172.21.15.132:0/4057341594 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5e9406cf00 0x7f5e940aeec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.723+0000 7f5e997c9640 1 --2- 172.21.15.132:0/4057341594 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5e9406a170 0x7f5e940b39d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.723+0000 7f5e997c9640 1 -- 172.21.15.132:0/4057341594 >> 172.21.15.132:0/4057341594 conn(0x7f5e940cfca0 msgr2=0x7f5e940d0080 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:17.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.723+0000 7f5e997c9640 1 -- 172.21.15.132:0/4057341594 shutdown_connections 2023-12-20T04:49:17.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.723+0000 7f5e997c9640 1 -- 172.21.15.132:0/4057341594 wait complete. 2023-12-20T04:49:17.736 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:48:35.008751+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:48:36.182609+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '140', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:49:17.737 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:49:17.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.837+0000 7f3647c05640 1 Processor -- start 2023-12-20T04:49:17.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.838+0000 7f3647c05640 1 -- start start 2023-12-20T04:49:17.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.838+0000 7f3647c05640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3640143510 0x7f36400c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.838+0000 7f3647c05640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36400cabd0 con 0x7f36400cd690 2023-12-20T04:49:17.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.838+0000 7f3647c05640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f36400c9fc0 con 0x7f36400cb060 2023-12-20T04:49:17.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.838+0000 7f3647c05640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f36400ca2a0 con 0x7f3640143510 2023-12-20T04:49:17.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f36461a2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f36400cd690 0x7f364006b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39964/0 (socket says 172.21.15.132:39964) 2023-12-20T04:49:17.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f36461a2640 1 -- 172.21.15.132:0/3854695798 learned_addr learned my addr 172.21.15.132:0/3854695798 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:17.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f36459a1640 1 --2- 172.21.15.132:0/3854695798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3640143510 0x7f36400c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f364499f640 1 -- 172.21.15.132:0/3854695798 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 559299234 0 0) 0x7f36400cabd0 con 0x7f36400cd690 2023-12-20T04:49:17.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f364499f640 1 -- 172.21.15.132:0/3854695798 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f362c003520 con 0x7f36400cd690 2023-12-20T04:49:17.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f364499f640 1 -- 172.21.15.132:0/3854695798 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1603273714 0 0) 0x7f36400c9fc0 con 0x7f36400cb060 2023-12-20T04:49:17.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f364499f640 1 -- 172.21.15.132:0/3854695798 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f36400cabd0 con 0x7f36400cb060 2023-12-20T04:49:17.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f364499f640 1 -- 172.21.15.132:0/3854695798 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 351050004 0 0) 0x7f362c003520 con 0x7f36400cd690 2023-12-20T04:49:17.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f364499f640 1 -- 172.21.15.132:0/3854695798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3640143510 msgr2=0x7f36400c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:17.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f364499f640 1 --2- 172.21.15.132:0/3854695798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3640143510 0x7f36400c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f364499f640 1 -- 172.21.15.132:0/3854695798 >> v1:172.21.15.187:6789/0 conn(0x7f36400cb060 legacy=0x7f36400ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:17.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f364499f640 1 -- 172.21.15.132:0/3854695798 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36400ca580 con 0x7f36400cd690 2023-12-20T04:49:17.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f364499f640 1 -- 172.21.15.132:0/3854695798 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f36380019f0 con 0x7f36400cd690 2023-12-20T04:49:17.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f364499f640 1 -- 172.21.15.132:0/3854695798 >> v1:172.21.15.132:6789/0 conn(0x7f36400cd690 legacy=0x7f364006b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:17.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f364499f640 1 --2- 172.21.15.132:0/3854695798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f362c003b30 0x7f362c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f364499f640 1 --2- 172.21.15.132:0/3854695798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f362c0047c0 0x7f362c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f364499f640 1 --2- 172.21.15.132:0/3854695798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3640143510 0x7f362c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f364499f640 1 -- 172.21.15.132:0/3854695798 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36400ca2a0 con 0x7f362c0047c0 2023-12-20T04:49:17.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f364499f640 1 -- 172.21.15.132:0/3854695798 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f362c00ba30 con 0x7f362c003b30 2023-12-20T04:49:17.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f364499f640 1 -- 172.21.15.132:0/3854695798 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f362c00bbf0 con 0x7f3640143510 2023-12-20T04:49:17.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f36451a0640 1 --2- 172.21.15.132:0/3854695798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f362c0047c0 0x7f362c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f36461a2640 1 --2- 172.21.15.132:0/3854695798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3640143510 0x7f362c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.839+0000 7f36459a1640 1 --2- 172.21.15.132:0/3854695798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f362c003b30 0x7f362c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.840+0000 7f36451a0640 1 -- 172.21.15.132:0/3854695798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3640143510 msgr2=0x7f362c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:17.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.840+0000 7f36451a0640 1 --2- 172.21.15.132:0/3854695798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3640143510 0x7f362c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.840+0000 7f36451a0640 1 -- 172.21.15.132:0/3854695798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f362c003b30 msgr2=0x7f362c003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:17.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.840+0000 7f36451a0640 1 --2- 172.21.15.132:0/3854695798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f362c003b30 0x7f362c003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.840+0000 7f36451a0640 1 -- 172.21.15.132:0/3854695798 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f362c003520 con 0x7f362c0047c0 2023-12-20T04:49:17.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.840+0000 7f36459a1640 1 --2- 172.21.15.132:0/3854695798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f362c003b30 0x7f362c003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:17.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.840+0000 7f36461a2640 1 --2- 172.21.15.132:0/3854695798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3640143510 0x7f362c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:17.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.840+0000 7f36451a0640 1 --2- 172.21.15.132:0/3854695798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f362c0047c0 0x7f362c004c40 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f36300018a0 tx=0x7f362c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe58301aa61f8fd6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:17.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.840+0000 7f364499f640 1 -- 172.21.15.132:0/3854695798 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36300052d0 con 0x7f362c0047c0 2023-12-20T04:49:17.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.841+0000 7f364499f640 1 -- 172.21.15.132:0/3854695798 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3630005430 con 0x7f362c0047c0 2023-12-20T04:49:17.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.841+0000 7f364499f640 1 -- 172.21.15.132:0/3854695798 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630003810 con 0x7f362c0047c0 2023-12-20T04:49:17.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.841+0000 7f3647c05640 1 -- 172.21.15.132:0/3854695798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f362c0047c0 msgr2=0x7f362c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:17.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.841+0000 7f3647c05640 1 --2- 172.21.15.132:0/3854695798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f362c0047c0 0x7f362c004c40 secure :-1 s=READY pgs=1429 cs=0 l=1 rev1=1 crypto rx=0x7f36300018a0 tx=0x7f362c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.841+0000 7f36461a2640 1 -- 172.21.15.132:0/3854695798 reap_dead start 2023-12-20T04:49:17.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.841+0000 7f3647c05640 1 -- 172.21.15.132:0/3854695798 shutdown_connections 2023-12-20T04:49:17.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.841+0000 7f3647c05640 1 -- 172.21.15.132:0/3854695798 >> 172.21.15.132:0/3854695798 conn(0x7f364006a260 msgr2=0x7f36400b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:17.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.841+0000 7f3647c05640 1 -- 172.21.15.132:0/3854695798 shutdown_connections 2023-12-20T04:49:17.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.841+0000 7f3647c05640 1 -- 172.21.15.132:0/3854695798 wait complete. 2023-12-20T04:49:17.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.842+0000 7f3647c05640 1 Processor -- start 2023-12-20T04:49:17.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.842+0000 7f3647c05640 1 -- start start 2023-12-20T04:49:17.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.843+0000 7f3647c05640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f362c0047c0 0x7f364006bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.843+0000 7f3647c05640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f364013f900 0x7f364013bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.843+0000 7f3647c05640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f364013fd80 0x7f364013c210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.843+0000 7f3647c05640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f364013c750 con 0x7f364013f900 2023-12-20T04:49:17.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.843+0000 7f3647c05640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f36400b1960 con 0x7f362c0047c0 2023-12-20T04:49:17.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.843+0000 7f3647c05640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f364006bb40 con 0x7f364013fd80 2023-12-20T04:49:17.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.843+0000 7f36451a0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f364013f900 0x7f364013bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.843+0000 7f36451a0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f364013f900 0x7f364013bcd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50270/0 (socket says 172.21.15.132:50270) 2023-12-20T04:49:17.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.843+0000 7f36451a0640 1 -- 172.21.15.132:0/262837965 learned_addr learned my addr 172.21.15.132:0/262837965 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:17.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.843+0000 7f36459a1640 1 --2- 172.21.15.132:0/262837965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f362c0047c0 0x7f364006bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.843+0000 7f36461a2640 1 --2- 172.21.15.132:0/262837965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f364013fd80 0x7f364013c210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.843+0000 7f36451a0640 1 -- 172.21.15.132:0/262837965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f364013fd80 msgr2=0x7f364013c210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:17.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.843+0000 7f36451a0640 1 --2- 172.21.15.132:0/262837965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f364013fd80 0x7f364013c210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.843+0000 7f36451a0640 1 -- 172.21.15.132:0/262837965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f362c0047c0 msgr2=0x7f364006bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:17.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.843+0000 7f36451a0640 1 --2- 172.21.15.132:0/262837965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f362c0047c0 0x7f364006bfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:17.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.843+0000 7f36451a0640 1 -- 172.21.15.132:0/262837965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f36400709c0 con 0x7f364013f900 2023-12-20T04:49:17.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.844+0000 7f36451a0640 1 --2- 172.21.15.132:0/262837965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f364013f900 0x7f364013bcd0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f3630035040 tx=0x7f36300012d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:17.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.844+0000 7f36367fc640 1 -- 172.21.15.132:0/262837965 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3630006d90 con 0x7f364013f900 2023-12-20T04:49:17.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.844+0000 7f36367fc640 1 -- 172.21.15.132:0/262837965 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3630007040 con 0x7f364013f900 2023-12-20T04:49:17.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.844+0000 7f36367fc640 1 -- 172.21.15.132:0/262837965 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f36300073b0 con 0x7f364013f900 2023-12-20T04:49:17.853 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.844+0000 7f3647c05640 1 -- 172.21.15.132:0/262837965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f364006b4f0 con 0x7f364013f900 2023-12-20T04:49:17.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.844+0000 7f3647c05640 1 -- 172.21.15.132:0/262837965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3640070ca0 con 0x7f364013f900 2023-12-20T04:49:17.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.845+0000 7f3647c05640 1 -- 172.21.15.132:0/262837965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f364004e840 con 0x7f364013f900 2023-12-20T04:49:17.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.845+0000 7f36367fc640 1 -- 172.21.15.132:0/262837965 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3630007510 con 0x7f364013f900 2023-12-20T04:49:17.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.846+0000 7f36367fc640 1 --2- 172.21.15.132:0/262837965 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f362406a430 0x7f362406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:17.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.846+0000 7f36459a1640 1 --2- 172.21.15.132:0/262837965 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f362406a430 0x7f362406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:17.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.846+0000 7f36367fc640 1 -- 172.21.15.132:0/262837965 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f36300aa470 con 0x7f364013f900 2023-12-20T04:49:17.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.846+0000 7f36459a1640 1 --2- 172.21.15.132:0/262837965 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f362406a430 0x7f362406c8f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f363c0098d0 tx=0x7f363c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:17.855 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:17.850+0000 7f36367fc640 1 -- 172.21.15.132:0/262837965 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3630075ba0 con 0x7f364013f900 2023-12-20T04:49:18.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.014+0000 7f3647c05640 1 -- 172.21.15.132:0/262837965 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f36400c3f90 con 0x7f364013f900 2023-12-20T04:49:18.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.014+0000 7f36367fc640 1 -- 172.21.15.132:0/262837965 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v140) v1 ==== 93+0+10 (secure 0 0 0) 0x7f363004b020 con 0x7f364013f900 2023-12-20T04:49:18.016 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:49:18.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.016+0000 7f3647c05640 1 -- 172.21.15.132:0/262837965 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f362406a430 msgr2=0x7f362406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.016+0000 7f3647c05640 1 --2- 172.21.15.132:0/262837965 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f362406a430 0x7f362406c8f0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f363c0098d0 tx=0x7f363c008040 comp rx=0 tx=0).stop 2023-12-20T04:49:18.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.016+0000 7f3647c05640 1 -- 172.21.15.132:0/262837965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f364013f900 msgr2=0x7f364013bcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.016+0000 7f3647c05640 1 --2- 172.21.15.132:0/262837965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f364013f900 0x7f364013bcd0 secure :-1 s=READY pgs=1430 cs=0 l=1 rev1=1 crypto rx=0x7f3630035040 tx=0x7f36300012d0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.016+0000 7f3647c05640 1 -- 172.21.15.132:0/262837965 shutdown_connections 2023-12-20T04:49:18.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.016+0000 7f3647c05640 1 --2- 172.21.15.132:0/262837965 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f362406a430 0x7f362406c8f0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.021 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.016+0000 7f3647c05640 1 --2- 172.21.15.132:0/262837965 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f364013fd80 0x7f364013c210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.016+0000 7f3647c05640 1 --2- 172.21.15.132:0/262837965 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f364013f900 0x7f364013bcd0 unknown :-1 s=CLOSED pgs=1430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.016+0000 7f3647c05640 1 --2- 172.21.15.132:0/262837965 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f362c0047c0 0x7f364006bfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.016+0000 7f3647c05640 1 -- 172.21.15.132:0/262837965 >> 172.21.15.132:0/262837965 conn(0x7f364006a260 msgr2=0x7f364015c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:18.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.016+0000 7f3647c05640 1 -- 172.21.15.132:0/262837965 shutdown_connections 2023-12-20T04:49:18.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.016+0000 7f3647c05640 1 -- 172.21.15.132:0/262837965 wait complete. 2023-12-20T04:49:18.029 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:49:18.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.130+0000 7fcf71fe0640 1 Processor -- start 2023-12-20T04:49:18.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.130+0000 7fcf71fe0640 1 -- start start 2023-12-20T04:49:18.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.131+0000 7fcf71fe0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf6c15cf20 0x7fcf6c06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.131+0000 7fcf71fe0640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcf6c15d300 0x7fcf6c161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.131+0000 7fcf71fe0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf6c161c40 con 0x7fcf6c0cd4b0 2023-12-20T04:49:18.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.131+0000 7fcf71fe0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6c06cc90 con 0x7fcf6c15cf20 2023-12-20T04:49:18.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.131+0000 7fcf71fe0640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf6c0b2f30 con 0x7fcf6c15d300 2023-12-20T04:49:18.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.131+0000 7fcf6b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf6c15cf20 0x7fcf6c06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.131+0000 7fcf6bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcf6c0cd4b0 0x7fcf6c0ceb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39970/0 (socket says 172.21.15.132:39970) 2023-12-20T04:49:18.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.131+0000 7fcf6bfff640 1 -- 172.21.15.132:0/3558741609 learned_addr learned my addr 172.21.15.132:0/3558741609 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:18.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.132+0000 7fcf6b7fe640 1 -- 172.21.15.132:0/3558741609 >> v2:172.21.15.187:3300/0 conn(0x7fcf6c15d300 msgr2=0x7fcf6c161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:18.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.131+0000 7fcf6affd640 1 --2- 172.21.15.132:0/3558741609 >> v2:172.21.15.187:3300/0 conn(0x7fcf6c15d300 0x7fcf6c161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.132+0000 7fcf6a7fc640 1 -- 172.21.15.132:0/3558741609 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 101769571 0 0) 0x7fcf6c161c40 con 0x7fcf6c0cd4b0 2023-12-20T04:49:18.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.132+0000 7fcf6b7fe640 1 --2- 172.21.15.132:0/3558741609 >> v2:172.21.15.187:3300/0 conn(0x7fcf6c15d300 0x7fcf6c161700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.132+0000 7fcf6b7fe640 1 -- 172.21.15.132:0/3558741609 >> v1:172.21.15.132:6789/0 conn(0x7fcf6c0cd4b0 legacy=0x7fcf6c0ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.132+0000 7fcf6b7fe640 1 -- 172.21.15.132:0/3558741609 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf6c0b3210 con 0x7fcf6c15cf20 2023-12-20T04:49:18.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.132+0000 7fcf6affd640 1 --2- 172.21.15.132:0/3558741609 >> v2:172.21.15.187:3300/0 conn(0x7fcf6c15d300 0x7fcf6c161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:18.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.132+0000 7fcf6b7fe640 1 --2- 172.21.15.132:0/3558741609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6c15cf20 0x7fcf6c06c590 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c160c30 tx=0x7fcf5c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8e1658f68232886 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:18.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.132+0000 7fcf6a7fc640 1 -- 172.21.15.132:0/3558741609 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c031830 con 0x7fcf6c15cf20 2023-12-20T04:49:18.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.132+0000 7fcf6a7fc640 1 -- 172.21.15.132:0/3558741609 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c031990 con 0x7fcf6c15cf20 2023-12-20T04:49:18.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.133+0000 7fcf6a7fc640 1 -- 172.21.15.132:0/3558741609 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c031d20 con 0x7fcf6c15cf20 2023-12-20T04:49:18.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.133+0000 7fcf71fe0640 1 -- 172.21.15.132:0/3558741609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6c15cf20 msgr2=0x7fcf6c06c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.133+0000 7fcf71fe0640 1 --2- 172.21.15.132:0/3558741609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6c15cf20 0x7fcf6c06c590 secure :-1 s=READY pgs=1432 cs=0 l=1 rev1=1 crypto rx=0x7fcf6c160c30 tx=0x7fcf5c02b8d0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.133+0000 7fcf71fe0640 1 -- 172.21.15.132:0/3558741609 shutdown_connections 2023-12-20T04:49:18.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.133+0000 7fcf71fe0640 1 --2- 172.21.15.132:0/3558741609 >> v2:172.21.15.187:3300/0 conn(0x7fcf6c15d300 0x7fcf6c161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.133+0000 7fcf71fe0640 1 --2- 172.21.15.132:0/3558741609 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6c15cf20 0x7fcf6c06c590 unknown :-1 s=CLOSED pgs=1432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.133+0000 7fcf71fe0640 1 -- 172.21.15.132:0/3558741609 >> 172.21.15.132:0/3558741609 conn(0x7fcf6c072c60 msgr2=0x7fcf6c073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:18.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.133+0000 7fcf71fe0640 1 -- 172.21.15.132:0/3558741609 shutdown_connections 2023-12-20T04:49:18.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.133+0000 7fcf71fe0640 1 -- 172.21.15.132:0/3558741609 wait complete. 2023-12-20T04:49:18.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.134+0000 7fcf71fe0640 1 Processor -- start 2023-12-20T04:49:18.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.134+0000 7fcf71fe0640 1 -- start start 2023-12-20T04:49:18.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf71fe0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6c0cd4b0 0x7fcf6c0b3810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf71fe0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf6c15cf20 0x7fcf6c160da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf71fe0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf6c15d300 0x7fcf6c1612e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf71fe0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c15f290 con 0x7fcf6c0cd4b0 2023-12-20T04:49:18.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf71fe0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c0af220 con 0x7fcf6c15d300 2023-12-20T04:49:18.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf71fe0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf6c0b3d50 con 0x7fcf6c15cf20 2023-12-20T04:49:18.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf6b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6c0cd4b0 0x7fcf6c0b3810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf6b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6c0cd4b0 0x7fcf6c0b3810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50294/0 (socket says 172.21.15.132:50294) 2023-12-20T04:49:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf6b7fe640 1 -- 172.21.15.132:0/4268404654 learned_addr learned my addr 172.21.15.132:0/4268404654 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf6affd640 1 --2- 172.21.15.132:0/4268404654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf6c15cf20 0x7fcf6c160da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf6b7fe640 1 -- 172.21.15.132:0/4268404654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf6c15cf20 msgr2=0x7fcf6c160da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf6bfff640 1 --2- 172.21.15.132:0/4268404654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf6c15d300 0x7fcf6c1612e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf6b7fe640 1 --2- 172.21.15.132:0/4268404654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf6c15cf20 0x7fcf6c160da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf6b7fe640 1 -- 172.21.15.132:0/4268404654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf6c15d300 msgr2=0x7fcf6c1612e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf6b7fe640 1 --2- 172.21.15.132:0/4268404654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf6c15d300 0x7fcf6c1612e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf6b7fe640 1 -- 172.21.15.132:0/4268404654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf5c009400 con 0x7fcf6c0cd4b0 2023-12-20T04:49:18.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf6bfff640 1 --2- 172.21.15.132:0/4268404654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf6c15d300 0x7fcf6c1612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:18.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.135+0000 7fcf6affd640 1 --2- 172.21.15.132:0/4268404654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf6c15cf20 0x7fcf6c160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:18.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.136+0000 7fcf6b7fe640 1 --2- 172.21.15.132:0/4268404654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6c0cd4b0 0x7fcf6c0b3810 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c02bee0 tx=0x7fcf5c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:18.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.136+0000 7fcf53fff640 1 -- 172.21.15.132:0/4268404654 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c03ba70 con 0x7fcf6c0cd4b0 2023-12-20T04:49:18.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.136+0000 7fcf53fff640 1 -- 172.21.15.132:0/4268404654 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf5c03bbf0 con 0x7fcf6c0cd4b0 2023-12-20T04:49:18.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.136+0000 7fcf71fe0640 1 -- 172.21.15.132:0/4268404654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf6c149820 con 0x7fcf6c0cd4b0 2023-12-20T04:49:18.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.136+0000 7fcf53fff640 1 -- 172.21.15.132:0/4268404654 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf5c0433f0 con 0x7fcf6c0cd4b0 2023-12-20T04:49:18.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.136+0000 7fcf71fe0640 1 -- 172.21.15.132:0/4268404654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf6c15ebd0 con 0x7fcf6c0cd4b0 2023-12-20T04:49:18.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.137+0000 7fcf71fe0640 1 -- 172.21.15.132:0/4268404654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf6c06c590 con 0x7fcf6c0cd4b0 2023-12-20T04:49:18.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.137+0000 7fcf53fff640 1 -- 172.21.15.132:0/4268404654 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcf5c043550 con 0x7fcf6c0cd4b0 2023-12-20T04:49:18.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.138+0000 7fcf53fff640 1 --2- 172.21.15.132:0/4268404654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf5806a430 0x7fcf5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.138+0000 7fcf53fff640 1 -- 172.21.15.132:0/4268404654 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf5c0aa6e0 con 0x7fcf6c0cd4b0 2023-12-20T04:49:18.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.138+0000 7fcf6affd640 1 --2- 172.21.15.132:0/4268404654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf5806a430 0x7fcf5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.138+0000 7fcf6affd640 1 --2- 172.21.15.132:0/4268404654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf5806a430 0x7fcf5806c8f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fcf60006fd0 tx=0x7fcf60008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:18.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.142+0000 7fcf53fff640 1 -- 172.21.15.132:0/4268404654 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcf5c075e80 con 0x7fcf6c0cd4b0 2023-12-20T04:49:18.188 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:49:18.191 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:49:18.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.311+0000 7fcf71fe0640 1 -- 172.21.15.132:0/4268404654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fcf6c06ca10 con 0x7fcf6c0cd4b0 2023-12-20T04:49:18.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.312+0000 7fcf53fff640 1 -- 172.21.15.132:0/4268404654 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v140) v1 ==== 104+0+11 (secure 0 0 0) 0x7fcf5c0794a0 con 0x7fcf6c0cd4b0 2023-12-20T04:49:18.314 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:49:18.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.313+0000 7fcf71fe0640 1 -- 172.21.15.132:0/4268404654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf5806a430 msgr2=0x7fcf5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.313+0000 7fcf71fe0640 1 --2- 172.21.15.132:0/4268404654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf5806a430 0x7fcf5806c8f0 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fcf60006fd0 tx=0x7fcf60008040 comp rx=0 tx=0).stop 2023-12-20T04:49:18.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.313+0000 7fcf71fe0640 1 -- 172.21.15.132:0/4268404654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6c0cd4b0 msgr2=0x7fcf6c0b3810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.313+0000 7fcf71fe0640 1 --2- 172.21.15.132:0/4268404654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6c0cd4b0 0x7fcf6c0b3810 secure :-1 s=READY pgs=1433 cs=0 l=1 rev1=1 crypto rx=0x7fcf5c02bee0 tx=0x7fcf5c0046c0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.314+0000 7fcf71fe0640 1 -- 172.21.15.132:0/4268404654 shutdown_connections 2023-12-20T04:49:18.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.314+0000 7fcf71fe0640 1 --2- 172.21.15.132:0/4268404654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf5806a430 0x7fcf5806c8f0 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.314+0000 7fcf71fe0640 1 --2- 172.21.15.132:0/4268404654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf6c15d300 0x7fcf6c1612e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.314+0000 7fcf71fe0640 1 --2- 172.21.15.132:0/4268404654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf6c15cf20 0x7fcf6c160da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.314+0000 7fcf71fe0640 1 --2- 172.21.15.132:0/4268404654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf6c0cd4b0 0x7fcf6c0b3810 unknown :-1 s=CLOSED pgs=1433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.314+0000 7fcf71fe0640 1 -- 172.21.15.132:0/4268404654 >> 172.21.15.132:0/4268404654 conn(0x7fcf6c072c60 msgr2=0x7fcf6c0b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:18.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.314+0000 7fcf71fe0640 1 -- 172.21.15.132:0/4268404654 shutdown_connections 2023-12-20T04:49:18.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.314+0000 7fcf71fe0640 1 -- 172.21.15.132:0/4268404654 wait complete. 2023-12-20T04:49:18.327 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:49:18.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.428+0000 7fb9e3527640 1 Processor -- start 2023-12-20T04:49:18.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.428+0000 7fb9e3527640 1 -- start start 2023-12-20T04:49:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.429+0000 7fb9e3527640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9dc15cf20 0x7fb9dc06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.429+0000 7fb9e3527640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9dc06cc90 con 0x7fb9dc0cd4b0 2023-12-20T04:49:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.429+0000 7fb9e3527640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9dc0b2f30 con 0x7fb9dc15d300 2023-12-20T04:49:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.429+0000 7fb9e3527640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0b3210 con 0x7fb9dc15cf20 2023-12-20T04:49:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.429+0000 7fb9e1ac4640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb9dc0cd4b0 0x7fb9dc0d0660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39976/0 (socket says 172.21.15.132:39976) 2023-12-20T04:49:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.429+0000 7fb9e1ac4640 1 -- 172.21.15.132:0/573596542 learned_addr learned my addr 172.21.15.132:0/573596542 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.429+0000 7fb9e12c3640 1 --2- 172.21.15.132:0/573596542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9dc15cf20 0x7fb9dc06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9d3fff640 1 -- 172.21.15.132:0/573596542 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 192384900 0 0) 0x7fb9dc06cc90 con 0x7fb9dc0cd4b0 2023-12-20T04:49:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9d3fff640 1 -- 172.21.15.132:0/573596542 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb9c8003520 con 0x7fb9dc0cd4b0 2023-12-20T04:49:18.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9d3fff640 1 -- 172.21.15.132:0/573596542 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1823893409 0 0) 0x7fb9c8003520 con 0x7fb9dc0cd4b0 2023-12-20T04:49:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9d3fff640 1 -- 172.21.15.132:0/573596542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9dc15cf20 msgr2=0x7fb9dc06c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9d3fff640 1 --2- 172.21.15.132:0/573596542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9dc15cf20 0x7fb9dc06c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9d3fff640 1 -- 172.21.15.132:0/573596542 >> v1:172.21.15.187:6789/0 conn(0x7fb9dc15d300 legacy=0x7fb9dc161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9d3fff640 1 -- 172.21.15.132:0/573596542 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc0b34f0 con 0x7fb9dc0cd4b0 2023-12-20T04:49:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9d3fff640 1 -- 172.21.15.132:0/573596542 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fb9d4001670 con 0x7fb9dc0cd4b0 2023-12-20T04:49:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9d3fff640 1 -- 172.21.15.132:0/573596542 >> v1:172.21.15.132:6789/0 conn(0x7fb9dc0cd4b0 legacy=0x7fb9dc0d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9d3fff640 1 --2- 172.21.15.132:0/573596542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9c80039a0 0x7fb9c8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9d3fff640 1 --2- 172.21.15.132:0/573596542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9dc15cf20 0x7fb9c80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9d3fff640 1 --2- 172.21.15.132:0/573596542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9c8004d00 0x7fb9c8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9d3fff640 1 -- 172.21.15.132:0/573596542 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0b3210 con 0x7fb9c8004d00 2023-12-20T04:49:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9d3fff640 1 -- 172.21.15.132:0/573596542 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c800ba30 con 0x7fb9c80039a0 2023-12-20T04:49:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9d3fff640 1 -- 172.21.15.132:0/573596542 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9c800bbf0 con 0x7fb9dc15cf20 2023-12-20T04:49:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9e1ac4640 1 --2- 172.21.15.132:0/573596542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9c8004d00 0x7fb9c8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9e12c3640 1 --2- 172.21.15.132:0/573596542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9c80039a0 0x7fb9c8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9e0ac2640 1 --2- 172.21.15.132:0/573596542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9dc15cf20 0x7fb9c80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9e1ac4640 1 -- 172.21.15.132:0/573596542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9dc15cf20 msgr2=0x7fb9c80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9e1ac4640 1 --2- 172.21.15.132:0/573596542 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9dc15cf20 0x7fb9c80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9e1ac4640 1 -- 172.21.15.132:0/573596542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9c80039a0 msgr2=0x7fb9c8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:18.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9e1ac4640 1 --2- 172.21.15.132:0/573596542 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9c80039a0 0x7fb9c8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.430+0000 7fb9e1ac4640 1 -- 172.21.15.132:0/573596542 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c8003520 con 0x7fb9c8004d00 2023-12-20T04:49:18.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.431+0000 7fb9e1ac4640 1 --2- 172.21.15.132:0/573596542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9c8004d00 0x7fb9c8005180 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400c210 tx=0x7fb9c80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b8e5f827241c62 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:18.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.431+0000 7fb9d3fff640 1 -- 172.21.15.132:0/573596542 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d4005ad0 con 0x7fb9c8004d00 2023-12-20T04:49:18.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.431+0000 7fb9d3fff640 1 -- 172.21.15.132:0/573596542 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d4005c30 con 0x7fb9c8004d00 2023-12-20T04:49:18.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.431+0000 7fb9d3fff640 1 -- 172.21.15.132:0/573596542 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d402c890 con 0x7fb9c8004d00 2023-12-20T04:49:18.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.432+0000 7fb9e3527640 1 -- 172.21.15.132:0/573596542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9c8004d00 msgr2=0x7fb9c8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.432+0000 7fb9e3527640 1 --2- 172.21.15.132:0/573596542 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9c8004d00 0x7fb9c8005180 secure :-1 s=READY pgs=1435 cs=0 l=1 rev1=1 crypto rx=0x7fb9d400c210 tx=0x7fb9c80057f0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.432+0000 7fb9e1ac4640 1 -- 172.21.15.132:0/573596542 reap_dead start 2023-12-20T04:49:18.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.432+0000 7fb9e3527640 1 -- 172.21.15.132:0/573596542 shutdown_connections 2023-12-20T04:49:18.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.432+0000 7fb9e3527640 1 -- 172.21.15.132:0/573596542 >> 172.21.15.132:0/573596542 conn(0x7fb9dc072c60 msgr2=0x7fb9dc073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:18.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.432+0000 7fb9e3527640 1 -- 172.21.15.132:0/573596542 shutdown_connections 2023-12-20T04:49:18.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.432+0000 7fb9e3527640 1 -- 172.21.15.132:0/573596542 wait complete. 2023-12-20T04:49:18.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.433+0000 7fb9e3527640 1 Processor -- start 2023-12-20T04:49:18.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.433+0000 7fb9e3527640 1 -- start start 2023-12-20T04:49:18.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e3527640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9c8004d00 0x7fb9dc1f6a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e3527640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9dc0c4790 0x7fb9dc161440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e3527640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9dc0c8b70 0x7fb9dc159dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e3527640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0c4c10 con 0x7fb9c8004d00 2023-12-20T04:49:18.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e3527640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0c4ee0 con 0x7fb9dc0c4790 2023-12-20T04:49:18.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e3527640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9dc0c51c0 con 0x7fb9dc0c8b70 2023-12-20T04:49:18.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e12c3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9c8004d00 0x7fb9dc1f6a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e12c3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9c8004d00 0x7fb9dc1f6a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50320/0 (socket says 172.21.15.132:50320) 2023-12-20T04:49:18.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e12c3640 1 -- 172.21.15.132:0/2469263240 learned_addr learned my addr 172.21.15.132:0/2469263240 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:18.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e1ac4640 1 --2- 172.21.15.132:0/2469263240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9dc0c8b70 0x7fb9dc159dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e0ac2640 1 --2- 172.21.15.132:0/2469263240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9dc0c4790 0x7fb9dc161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e12c3640 1 -- 172.21.15.132:0/2469263240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9dc0c8b70 msgr2=0x7fb9dc159dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e12c3640 1 --2- 172.21.15.132:0/2469263240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9dc0c8b70 0x7fb9dc159dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e12c3640 1 -- 172.21.15.132:0/2469263240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9dc0c4790 msgr2=0x7fb9dc161440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e12c3640 1 --2- 172.21.15.132:0/2469263240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9dc0c4790 0x7fb9dc161440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e12c3640 1 -- 172.21.15.132:0/2469263240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9dc0c54a0 con 0x7fb9c8004d00 2023-12-20T04:49:18.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e1ac4640 1 --2- 172.21.15.132:0/2469263240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9dc0c8b70 0x7fb9dc159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:18.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e0ac2640 1 --2- 172.21.15.132:0/2469263240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9dc0c4790 0x7fb9dc161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:18.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e12c3640 1 --2- 172.21.15.132:0/2469263240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9c8004d00 0x7fb9dc1f6a10 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8011e30 tx=0x7fb9d800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:18.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9d1ffb640 1 -- 172.21.15.132:0/2469263240 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d800e040 con 0x7fb9c8004d00 2023-12-20T04:49:18.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9d1ffb640 1 -- 172.21.15.132:0/2469263240 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9d800f040 con 0x7fb9c8004d00 2023-12-20T04:49:18.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9e3527640 1 -- 172.21.15.132:0/2469263240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9dc0c61a0 con 0x7fb9c8004d00 2023-12-20T04:49:18.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.434+0000 7fb9d1ffb640 1 -- 172.21.15.132:0/2469263240 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9d8009c00 con 0x7fb9c8004d00 2023-12-20T04:49:18.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.435+0000 7fb9e3527640 1 -- 172.21.15.132:0/2469263240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9dc161b60 con 0x7fb9c8004d00 2023-12-20T04:49:18.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.436+0000 7fb9e3527640 1 -- 172.21.15.132:0/2469263240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9dc04e840 con 0x7fb9c8004d00 2023-12-20T04:49:18.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.436+0000 7fb9d1ffb640 1 -- 172.21.15.132:0/2469263240 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb9d8015850 con 0x7fb9c8004d00 2023-12-20T04:49:18.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.436+0000 7fb9d1ffb640 1 --2- 172.21.15.132:0/2469263240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb9c006a460 0x7fb9c006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.436+0000 7fb9d1ffb640 1 -- 172.21.15.132:0/2469263240 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9d8089560 con 0x7fb9c8004d00 2023-12-20T04:49:18.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.436+0000 7fb9e0ac2640 1 --2- 172.21.15.132:0/2469263240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb9c006a460 0x7fb9c006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.437+0000 7fb9e0ac2640 1 --2- 172.21.15.132:0/2469263240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb9c006a460 0x7fb9c006c920 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0afc50 tx=0x7fb9cc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:18.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.441+0000 7fb9d1ffb640 1 -- 172.21.15.132:0/2469263240 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb9d8054b50 con 0x7fb9c8004d00 2023-12-20T04:49:18.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.607+0000 7fb9e3527640 1 -- 172.21.15.132:0/2469263240 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fb9dc161b60 con 0x7fb9c8004d00 2023-12-20T04:49:18.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.607+0000 7fb9d1ffb640 1 -- 172.21.15.132:0/2469263240 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v140) v1 ==== 100+0+11 (secure 0 0 0) 0x7fb9dc161b60 con 0x7fb9c8004d00 2023-12-20T04:49:18.609 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:49:18.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.609+0000 7fb9e3527640 1 -- 172.21.15.132:0/2469263240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb9c006a460 msgr2=0x7fb9c006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.609+0000 7fb9e3527640 1 --2- 172.21.15.132:0/2469263240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb9c006a460 0x7fb9c006c920 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7fb9dc0afc50 tx=0x7fb9cc009040 comp rx=0 tx=0).stop 2023-12-20T04:49:18.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.609+0000 7fb9e3527640 1 -- 172.21.15.132:0/2469263240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9c8004d00 msgr2=0x7fb9dc1f6a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.609+0000 7fb9e3527640 1 --2- 172.21.15.132:0/2469263240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9c8004d00 0x7fb9dc1f6a10 secure :-1 s=READY pgs=1436 cs=0 l=1 rev1=1 crypto rx=0x7fb9d8011e30 tx=0x7fb9d800f580 comp rx=0 tx=0).stop 2023-12-20T04:49:18.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.609+0000 7fb9e3527640 1 -- 172.21.15.132:0/2469263240 shutdown_connections 2023-12-20T04:49:18.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.609+0000 7fb9e3527640 1 --2- 172.21.15.132:0/2469263240 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb9c006a460 0x7fb9c006c920 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.609+0000 7fb9e3527640 1 --2- 172.21.15.132:0/2469263240 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9dc0c8b70 0x7fb9dc159dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.609+0000 7fb9e3527640 1 --2- 172.21.15.132:0/2469263240 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9dc0c4790 0x7fb9dc161440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.609+0000 7fb9e3527640 1 --2- 172.21.15.132:0/2469263240 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9c8004d00 0x7fb9dc1f6a10 unknown :-1 s=CLOSED pgs=1436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.609+0000 7fb9e3527640 1 -- 172.21.15.132:0/2469263240 >> 172.21.15.132:0/2469263240 conn(0x7fb9dc072c60 msgr2=0x7fb9dc0b1da0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:18.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.609+0000 7fb9e3527640 1 -- 172.21.15.132:0/2469263240 shutdown_connections 2023-12-20T04:49:18.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.609+0000 7fb9e3527640 1 -- 172.21.15.132:0/2469263240 wait complete. 2023-12-20T04:49:18.623 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:49:18.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.720+0000 7f23ba096640 1 Processor -- start 2023-12-20T04:49:18.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.720+0000 7f23ba096640 1 -- start start 2023-12-20T04:49:18.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.721+0000 7f23ba096640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f23b40d0520 0x7f23b415e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.721+0000 7f23ba096640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23b415e570 0x7f23b406ad40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.721+0000 7f23ba096640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23b415b2e0 con 0x7f23b415af00 2023-12-20T04:49:18.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.721+0000 7f23ba096640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23b415dc10 con 0x7f23b40d0520 2023-12-20T04:49:18.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.721+0000 7f23ba096640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b40d09b0 con 0x7f23b415e570 2023-12-20T04:49:18.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.721+0000 7f23b2ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f23b40d0520 0x7f23b415e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.721+0000 7f23b2ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f23b40d0520 0x7f23b415e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50326/0 (socket says 172.21.15.132:50326) 2023-12-20T04:49:18.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.721+0000 7f23b37fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f23b415af00 0x7f23b4160e80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39988/0 (socket says 172.21.15.132:39988) 2023-12-20T04:49:18.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.721+0000 7f23b2ffd640 1 -- 172.21.15.132:0/3179182670 learned_addr learned my addr 172.21.15.132:0/3179182670 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:18.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.721+0000 7f23b3fff640 1 --2- 172.21.15.132:0/3179182670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23b415e570 0x7f23b406ad40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.721+0000 7f23b2ffd640 1 -- 172.21.15.132:0/3179182670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23b415e570 msgr2=0x7f23b406ad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:18.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.721+0000 7f23b2ffd640 1 --2- 172.21.15.132:0/3179182670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23b415e570 0x7f23b406ad40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.721+0000 7f23b2ffd640 1 -- 172.21.15.132:0/3179182670 >> v1:172.21.15.132:6789/0 conn(0x7f23b415af00 legacy=0x7f23b4160e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.721+0000 7f23b2ffd640 1 -- 172.21.15.132:0/3179182670 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23b4161660 con 0x7f23b40d0520 2023-12-20T04:49:18.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.722+0000 7f23b2ffd640 1 --2- 172.21.15.132:0/3179182670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b40d0520 0x7f23b415e030 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f23a80098a0 tx=0x7f23a802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eb8189455cce2a7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:18.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.722+0000 7f23b27fc640 1 -- 172.21.15.132:0/3179182670 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8031640 con 0x7f23b40d0520 2023-12-20T04:49:18.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.722+0000 7f23b27fc640 1 -- 172.21.15.132:0/3179182670 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23a80317a0 con 0x7f23b40d0520 2023-12-20T04:49:18.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.722+0000 7f23b27fc640 1 -- 172.21.15.132:0/3179182670 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23a8031b30 con 0x7f23b40d0520 2023-12-20T04:49:18.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.723+0000 7f23ba096640 1 -- 172.21.15.132:0/3179182670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b40d0520 msgr2=0x7f23b415e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.723+0000 7f23ba096640 1 --2- 172.21.15.132:0/3179182670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b40d0520 0x7f23b415e030 secure :-1 s=READY pgs=1438 cs=0 l=1 rev1=1 crypto rx=0x7f23a80098a0 tx=0x7f23a802b8f0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.723+0000 7f23ba096640 1 -- 172.21.15.132:0/3179182670 shutdown_connections 2023-12-20T04:49:18.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.723+0000 7f23ba096640 1 --2- 172.21.15.132:0/3179182670 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23b415e570 0x7f23b406ad40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.723+0000 7f23ba096640 1 --2- 172.21.15.132:0/3179182670 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b40d0520 0x7f23b415e030 unknown :-1 s=CLOSED pgs=1438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.723+0000 7f23ba096640 1 -- 172.21.15.132:0/3179182670 >> 172.21.15.132:0/3179182670 conn(0x7f23b406d640 msgr2=0x7f23b406da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:18.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.723+0000 7f23ba096640 1 -- 172.21.15.132:0/3179182670 shutdown_connections 2023-12-20T04:49:18.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.723+0000 7f23ba096640 1 -- 172.21.15.132:0/3179182670 wait complete. 2023-12-20T04:49:18.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.724+0000 7f23ba096640 1 Processor -- start 2023-12-20T04:49:18.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.724+0000 7f23ba096640 1 -- start start 2023-12-20T04:49:18.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.725+0000 7f23ba096640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23b40d0520 0x7f23b4149300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.725+0000 7f23ba096640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23b415af00 0x7f23b4148c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.725+0000 7f23ba096640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b415e570 0x7f23b41f61c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.725+0000 7f23ba096640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b40b1470 con 0x7f23b415e570 2023-12-20T04:49:18.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.725+0000 7f23ba096640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23b40af760 con 0x7f23b40d0520 2023-12-20T04:49:18.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.725+0000 7f23ba096640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23b40b0e20 con 0x7f23b415af00 2023-12-20T04:49:18.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.725+0000 7f23b3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b415e570 0x7f23b41f61c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.725+0000 7f23b3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b415e570 0x7f23b41f61c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50336/0 (socket says 172.21.15.132:50336) 2023-12-20T04:49:18.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.725+0000 7f23b3fff640 1 -- 172.21.15.132:0/2943249730 learned_addr learned my addr 172.21.15.132:0/2943249730 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:18.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.725+0000 7f23b37fe640 1 --2- 172.21.15.132:0/2943249730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23b40d0520 0x7f23b4149300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.725+0000 7f23b2ffd640 1 --2- 172.21.15.132:0/2943249730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23b415af00 0x7f23b4148c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.725+0000 7f23b3fff640 1 -- 172.21.15.132:0/2943249730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23b415af00 msgr2=0x7f23b4148c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.725+0000 7f23b3fff640 1 --2- 172.21.15.132:0/2943249730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23b415af00 0x7f23b4148c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.725+0000 7f23b3fff640 1 -- 172.21.15.132:0/2943249730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23b40d0520 msgr2=0x7f23b4149300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.725+0000 7f23b3fff640 1 --2- 172.21.15.132:0/2943249730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23b40d0520 0x7f23b4149300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.725+0000 7f23b3fff640 1 -- 172.21.15.132:0/2943249730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23a80094d0 con 0x7f23b415e570 2023-12-20T04:49:18.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.725+0000 7f23b3fff640 1 --2- 172.21.15.132:0/2943249730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b415e570 0x7f23b41f61c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f23ac007e60 tx=0x7f23ac00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:18.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.726+0000 7f239bfff640 1 -- 172.21.15.132:0/2943249730 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac014420 con 0x7f23b415e570 2023-12-20T04:49:18.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.726+0000 7f239bfff640 1 -- 172.21.15.132:0/2943249730 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f23ac0145a0 con 0x7f23b415e570 2023-12-20T04:49:18.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.726+0000 7f239bfff640 1 -- 172.21.15.132:0/2943249730 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f23ac014950 con 0x7f23b415e570 2023-12-20T04:49:18.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.726+0000 7f23ba096640 1 -- 172.21.15.132:0/2943249730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f23b40b1100 con 0x7f23b415e570 2023-12-20T04:49:18.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.726+0000 7f23ba096640 1 -- 172.21.15.132:0/2943249730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23b41f68e0 con 0x7f23b415e570 2023-12-20T04:49:18.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.727+0000 7f23ba096640 1 -- 172.21.15.132:0/2943249730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23b40b15e0 con 0x7f23b415e570 2023-12-20T04:49:18.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.727+0000 7f239bfff640 1 -- 172.21.15.132:0/2943249730 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f23ac014ab0 con 0x7f23b415e570 2023-12-20T04:49:18.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.727+0000 7f239bfff640 1 --2- 172.21.15.132:0/2943249730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f23a006a430 0x7f23a006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:18.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.728+0000 7f23b37fe640 1 --2- 172.21.15.132:0/2943249730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f23a006a430 0x7f23a006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:18.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.728+0000 7f239bfff640 1 -- 172.21.15.132:0/2943249730 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f23ac089290 con 0x7f23b415e570 2023-12-20T04:49:18.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.728+0000 7f23b37fe640 1 --2- 172.21.15.132:0/2943249730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f23a006a430 0x7f23a006c8f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f23a4000f60 tx=0x7f23a4007c80 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:18.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.732+0000 7f239bfff640 1 -- 172.21.15.132:0/2943249730 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f23ac054800 con 0x7f23b415e570 2023-12-20T04:49:18.911 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.909+0000 7f23ba096640 1 -- 172.21.15.132:0/2943249730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f23b404e840 con 0x7f23b415e570 2023-12-20T04:49:18.912 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.910+0000 7f239bfff640 1 -- 172.21.15.132:0/2943249730 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v140) v1 ==== 80+0+0 (secure 0 0 0) 0x7f23ac057e20 con 0x7f23b415e570 2023-12-20T04:49:18.912 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:49:18.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.911+0000 7f23ba096640 1 -- 172.21.15.132:0/2943249730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f23a006a430 msgr2=0x7f23a006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.911+0000 7f23ba096640 1 --2- 172.21.15.132:0/2943249730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f23a006a430 0x7f23a006c8f0 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f23a4000f60 tx=0x7f23a4007c80 comp rx=0 tx=0).stop 2023-12-20T04:49:18.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.911+0000 7f23ba096640 1 -- 172.21.15.132:0/2943249730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b415e570 msgr2=0x7f23b41f61c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:18.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.911+0000 7f23ba096640 1 --2- 172.21.15.132:0/2943249730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b415e570 0x7f23b41f61c0 secure :-1 s=READY pgs=1439 cs=0 l=1 rev1=1 crypto rx=0x7f23ac007e60 tx=0x7f23ac00e4b0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.911+0000 7f23ba096640 1 -- 172.21.15.132:0/2943249730 shutdown_connections 2023-12-20T04:49:18.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.911+0000 7f23ba096640 1 --2- 172.21.15.132:0/2943249730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f23a006a430 0x7f23a006c8f0 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.911+0000 7f23ba096640 1 --2- 172.21.15.132:0/2943249730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23b415e570 0x7f23b41f61c0 unknown :-1 s=CLOSED pgs=1439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.911+0000 7f23ba096640 1 --2- 172.21.15.132:0/2943249730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23b415af00 0x7f23b4148c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.911+0000 7f23ba096640 1 --2- 172.21.15.132:0/2943249730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23b40d0520 0x7f23b4149300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:18.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.911+0000 7f23ba096640 1 -- 172.21.15.132:0/2943249730 >> 172.21.15.132:0/2943249730 conn(0x7f23b406d640 msgr2=0x7f23b406da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:18.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.912+0000 7f23ba096640 1 -- 172.21.15.132:0/2943249730 shutdown_connections 2023-12-20T04:49:18.914 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:18.912+0000 7f23ba096640 1 -- 172.21.15.132:0/2943249730 wait complete. 2023-12-20T04:49:18.924 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi187.front.sepia.ceph.com... 2023-12-20T04:49:18.925 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:18.925 DEBUG:teuthology.orchestra.run.smithi187:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-20T04:49:18.955 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[90643]: fuse finished with error 0 and tester_r 0 2023-12-20T04:49:18.956 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:49:18.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:18.957 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-20T04:49:19.125 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:49:19.125 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:49:19.140 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:49:19.141 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:49:19.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:19.141 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-20T04:49:19.195 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:49:19.196 INFO:teuthology.orchestra.run.smithi132.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-20T04:49:19.196 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:49:19.196 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:49:19.213 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:49:19.214 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:49:19.214 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:19.214 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-20T04:49:19.270 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:49:19.270 INFO:teuthology.orchestra.run.smithi187.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-20T04:49:19.270 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:49:19.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.368+0000 7f01bd270640 1 Processor -- start 2023-12-20T04:49:19.370 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.368+0000 7f01bd270640 1 -- start start 2023-12-20T04:49:19.371 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.368+0000 7f01bd270640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f01b8160450 0x7f01b8160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:19.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.368+0000 7f01bd270640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f01b81611b0 0x7f01b80b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:19.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.368+0000 7f01bd270640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01b80b5300 con 0x7f01b80b4ec0 2023-12-20T04:49:19.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.368+0000 7f01bd270640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b80b5ec0 con 0x7f01b81611b0 2023-12-20T04:49:19.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.368+0000 7f01bd270640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01b81617e0 con 0x7f01b8160450 2023-12-20T04:49:19.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.369+0000 7f01b67fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f01b81611b0 0x7f01b80b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:19.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.369+0000 7f01b77fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f01b80b4ec0 0x7f01b806a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:39996/0 (socket says 172.21.15.132:39996) 2023-12-20T04:49:19.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.369+0000 7f01b77fe640 1 -- 172.21.15.132:0/1239187469 learned_addr learned my addr 172.21.15.132:0/1239187469 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:19.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.369+0000 7f01b6ffd640 1 --2- 172.21.15.132:0/1239187469 >> v2:172.21.15.187:3300/0 conn(0x7f01b8160450 0x7f01b8160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:19.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.369+0000 7f01b67fc640 1 -- 172.21.15.132:0/1239187469 >> v2:172.21.15.187:3300/0 conn(0x7f01b8160450 msgr2=0x7f01b8160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:19.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.369+0000 7f01b67fc640 1 --2- 172.21.15.132:0/1239187469 >> v2:172.21.15.187:3300/0 conn(0x7f01b8160450 0x7f01b8160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.369+0000 7f01b67fc640 1 -- 172.21.15.132:0/1239187469 >> v1:172.21.15.132:6789/0 conn(0x7f01b80b4ec0 legacy=0x7f01b806a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:19.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.369+0000 7f01b5ffb640 1 -- 172.21.15.132:0/1239187469 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1649574715 0 0) 0x7f01b80b5300 con 0x7f01b80b4ec0 2023-12-20T04:49:19.372 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.369+0000 7f01b67fc640 1 -- 172.21.15.132:0/1239187469 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01b80d0fc0 con 0x7f01b81611b0 2023-12-20T04:49:19.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.370+0000 7f01b67fc640 1 --2- 172.21.15.132:0/1239187469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b81611b0 0x7f01b80b4980 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f01b808b150 tx=0x7f01ac02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8c2a5b9c3158499 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:19.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.370+0000 7f01b5ffb640 1 -- 172.21.15.132:0/1239187469 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac030610 con 0x7f01b81611b0 2023-12-20T04:49:19.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.370+0000 7f01b5ffb640 1 -- 172.21.15.132:0/1239187469 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01ac030770 con 0x7f01b81611b0 2023-12-20T04:49:19.373 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.370+0000 7f01b5ffb640 1 -- 172.21.15.132:0/1239187469 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01ac030b00 con 0x7f01b81611b0 2023-12-20T04:49:19.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.370+0000 7f01bd270640 1 -- 172.21.15.132:0/1239187469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b81611b0 msgr2=0x7f01b80b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:19.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.370+0000 7f01bd270640 1 --2- 172.21.15.132:0/1239187469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b81611b0 0x7f01b80b4980 secure :-1 s=READY pgs=1441 cs=0 l=1 rev1=1 crypto rx=0x7f01b808b150 tx=0x7f01ac02b960 comp rx=0 tx=0).stop 2023-12-20T04:49:19.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.370+0000 7f01bd270640 1 -- 172.21.15.132:0/1239187469 shutdown_connections 2023-12-20T04:49:19.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.370+0000 7f01bd270640 1 --2- 172.21.15.132:0/1239187469 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b81611b0 0x7f01b80b4980 unknown :-1 s=CLOSED pgs=1441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.370+0000 7f01bd270640 1 --2- 172.21.15.132:0/1239187469 >> v2:172.21.15.187:3300/0 conn(0x7f01b8160450 0x7f01b8160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.370+0000 7f01bd270640 1 -- 172.21.15.132:0/1239187469 >> 172.21.15.132:0/1239187469 conn(0x7f01b80cf980 msgr2=0x7f01b80cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:19.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.370+0000 7f01bd270640 1 -- 172.21.15.132:0/1239187469 shutdown_connections 2023-12-20T04:49:19.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.370+0000 7f01bd270640 1 -- 172.21.15.132:0/1239187469 wait complete. 2023-12-20T04:49:19.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.372+0000 7f01bd270640 1 Processor -- start 2023-12-20T04:49:19.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.372+0000 7f01bd270640 1 -- start start 2023-12-20T04:49:19.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.372+0000 7f01bd270640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b80b4ec0 0x7f01b80c8bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:19.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.372+0000 7f01bd270640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01b8160450 0x7f01b80cac50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:19.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.372+0000 7f01bd270640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01b81611b0 0x7f01b80cb190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:19.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.372+0000 7f01bd270640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b80ca360 con 0x7f01b80b4ec0 2023-12-20T04:49:19.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.372+0000 7f01bd270640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01b80b76e0 con 0x7f01b81611b0 2023-12-20T04:49:19.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.372+0000 7f01bd270640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01b80b79c0 con 0x7f01b8160450 2023-12-20T04:49:19.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.372+0000 7f01b6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b80b4ec0 0x7f01b80c8bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:19.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.372+0000 7f01b6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b80b4ec0 0x7f01b80c8bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50364/0 (socket says 172.21.15.132:50364) 2023-12-20T04:49:19.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.372+0000 7f01b6ffd640 1 -- 172.21.15.132:0/2663225082 learned_addr learned my addr 172.21.15.132:0/2663225082 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:19.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.373+0000 7f01b67fc640 1 --2- 172.21.15.132:0/2663225082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01b8160450 0x7f01b80cac50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:19.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.373+0000 7f01b77fe640 1 --2- 172.21.15.132:0/2663225082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01b81611b0 0x7f01b80cb190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:19.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.373+0000 7f01b6ffd640 1 -- 172.21.15.132:0/2663225082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01b8160450 msgr2=0x7f01b80cac50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:19.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.373+0000 7f01b6ffd640 1 --2- 172.21.15.132:0/2663225082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01b8160450 0x7f01b80cac50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.373+0000 7f01b6ffd640 1 -- 172.21.15.132:0/2663225082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01b81611b0 msgr2=0x7f01b80cb190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:19.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.373+0000 7f01b6ffd640 1 --2- 172.21.15.132:0/2663225082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01b81611b0 0x7f01b80cb190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.373+0000 7f01b6ffd640 1 -- 172.21.15.132:0/2663225082 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01ac009400 con 0x7f01b80b4ec0 2023-12-20T04:49:19.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.373+0000 7f01b67fc640 1 --2- 172.21.15.132:0/2663225082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01b8160450 0x7f01b80cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:19.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.373+0000 7f01b77fe640 1 --2- 172.21.15.132:0/2663225082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01b81611b0 0x7f01b80cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:19.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.373+0000 7f01b6ffd640 1 --2- 172.21.15.132:0/2663225082 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b80b4ec0 0x7f01b80c8bf0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f01a800c7f0 tx=0x7f01a800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:19.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.373+0000 7f019f7fe640 1 -- 172.21.15.132:0/2663225082 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a8004220 con 0x7f01b80b4ec0 2023-12-20T04:49:19.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.373+0000 7f019f7fe640 1 -- 172.21.15.132:0/2663225082 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01a80043a0 con 0x7f01b80b4ec0 2023-12-20T04:49:19.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.373+0000 7f01bd270640 1 -- 172.21.15.132:0/2663225082 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01b80d22f0 con 0x7f01b80b4ec0 2023-12-20T04:49:19.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.373+0000 7f019f7fe640 1 -- 172.21.15.132:0/2663225082 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01a8007860 con 0x7f01b80b4ec0 2023-12-20T04:49:19.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.373+0000 7f01bd270640 1 -- 172.21.15.132:0/2663225082 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01b80d28b0 con 0x7f01b80b4ec0 2023-12-20T04:49:19.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.374+0000 7f01bd270640 1 -- 172.21.15.132:0/2663225082 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01b80d2ad0 con 0x7f01b80b4ec0 2023-12-20T04:49:19.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.374+0000 7f019f7fe640 1 -- 172.21.15.132:0/2663225082 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f01a8007bd0 con 0x7f01b80b4ec0 2023-12-20T04:49:19.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.375+0000 7f019f7fe640 1 --2- 172.21.15.132:0/2663225082 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f01a406a430 0x7f01a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:19.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.375+0000 7f01b67fc640 1 --2- 172.21.15.132:0/2663225082 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f01a406a430 0x7f01a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:19.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.375+0000 7f019f7fe640 1 -- 172.21.15.132:0/2663225082 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f01a8088830 con 0x7f01b80b4ec0 2023-12-20T04:49:19.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.375+0000 7f01b67fc640 1 --2- 172.21.15.132:0/2663225082 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f01a406a430 0x7f01a406c8f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f01ac036000 tx=0x7f01ac03b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:19.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.379+0000 7f019f7fe640 1 -- 172.21.15.132:0/2663225082 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f01a8053eb0 con 0x7f01b80b4ec0 2023-12-20T04:49:19.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.577+0000 7f01bd270640 1 -- 172.21.15.132:0/2663225082 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f01b804e840 con 0x7f01b80b4ec0 2023-12-20T04:49:19.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.578+0000 7f019f7fe640 1 -- 172.21.15.132:0/2663225082 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f01a801e020 con 0x7f01b80b4ec0 2023-12-20T04:49:19.580 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:19.580 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6763,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1413044191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1413044191},{"type":"v1","addr":"172.21.15.132:6837","nonce":1413044191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1584197959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1584197959},{"type":"v1","addr":"172.21.15.187:6834","nonce":1584197959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":7830,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/3080885824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3080885824},{"type":"v1","addr":"172.21.15.132:6836","nonce":3080885824}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:48:37.200402+0000","modified":"2023-12-20T04:48:39.207037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"d","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/1483131498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":1483131498},{"type":"v1","addr":"172.21.15.187:6835","nonce":1483131498}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-20T04:49:19.581 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 51 2023-12-20T04:49:19.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.580+0000 7f01bd270640 1 -- 172.21.15.132:0/2663225082 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f01a406a430 msgr2=0x7f01a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:19.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.580+0000 7f01bd270640 1 --2- 172.21.15.132:0/2663225082 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f01a406a430 0x7f01a406c8f0 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f01ac036000 tx=0x7f01ac03b040 comp rx=0 tx=0).stop 2023-12-20T04:49:19.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.580+0000 7f01bd270640 1 -- 172.21.15.132:0/2663225082 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b80b4ec0 msgr2=0x7f01b80c8bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:19.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.580+0000 7f01bd270640 1 --2- 172.21.15.132:0/2663225082 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b80b4ec0 0x7f01b80c8bf0 secure :-1 s=READY pgs=1442 cs=0 l=1 rev1=1 crypto rx=0x7f01a800c7f0 tx=0x7f01a800ccb0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.580+0000 7f01bd270640 1 -- 172.21.15.132:0/2663225082 shutdown_connections 2023-12-20T04:49:19.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.580+0000 7f01bd270640 1 --2- 172.21.15.132:0/2663225082 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f01a406a430 0x7f01a406c8f0 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.580+0000 7f01bd270640 1 --2- 172.21.15.132:0/2663225082 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01b81611b0 0x7f01b80cb190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.580+0000 7f01bd270640 1 --2- 172.21.15.132:0/2663225082 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01b8160450 0x7f01b80cac50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.580+0000 7f01bd270640 1 --2- 172.21.15.132:0/2663225082 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01b80b4ec0 0x7f01b80c8bf0 unknown :-1 s=CLOSED pgs=1442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.580+0000 7f01bd270640 1 -- 172.21.15.132:0/2663225082 >> 172.21.15.132:0/2663225082 conn(0x7f01b80cf980 msgr2=0x7f01b815f170 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:19.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.580+0000 7f01bd270640 1 -- 172.21.15.132:0/2663225082 shutdown_connections 2023-12-20T04:49:19.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.580+0000 7f01bd270640 1 -- 172.21.15.132:0/2663225082 wait complete. 2023-12-20T04:49:19.593 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:49:19.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.689+0000 7f0e71641640 1 Processor -- start 2023-12-20T04:49:19.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.689+0000 7f0e71641640 1 -- start start 2023-12-20T04:49:19.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.690+0000 7f0e71641640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c0b4980 0x7f0e6c0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:19.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.690+0000 7f0e71641640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0e6c0d1aa0 0x7f0e6c0d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:19.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.690+0000 7f0e71641640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e6c0b5320 con 0x7f0e6c160450 2023-12-20T04:49:19.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.690+0000 7f0e71641640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0e6c0b5ec0 con 0x7f0e6c0d1aa0 2023-12-20T04:49:19.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.690+0000 7f0e71641640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c1617e0 con 0x7f0e6c0b4980 2023-12-20T04:49:19.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.690+0000 7f0e6b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0e6c0d1aa0 0x7f0e6c0d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:19.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.690+0000 7f0e6b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0e6c0d1aa0 0x7f0e6c0d1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50366/0 (socket says 172.21.15.132:50366) 2023-12-20T04:49:19.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.690+0000 7f0e6b7fe640 1 -- 172.21.15.132:0/1263894257 learned_addr learned my addr 172.21.15.132:0/1263894257 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.690+0000 7f0e6a7fc640 1 --2- 172.21.15.132:0/1263894257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c0b4980 0x7f0e6c0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.691+0000 7f0e6b7fe640 1 -- 172.21.15.132:0/1263894257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c0b4980 msgr2=0x7f0e6c0b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.691+0000 7f0e6b7fe640 1 --2- 172.21.15.132:0/1263894257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c0b4980 0x7f0e6c0b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.691+0000 7f0e6b7fe640 1 -- 172.21.15.132:0/1263894257 >> v1:172.21.15.187:6789/0 conn(0x7f0e6c160450 legacy=0x7f0e6c160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.691+0000 7f0e6b7fe640 1 -- 172.21.15.132:0/1263894257 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e6c0d0fc0 con 0x7f0e6c0d1aa0 2023-12-20T04:49:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.691+0000 7f0e6a7fc640 1 --2- 172.21.15.132:0/1263894257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c0b4980 0x7f0e6c0b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.691+0000 7f0e6b7fe640 1 --2- 172.21.15.132:0/1263894257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e6c0d1aa0 0x7f0e6c0d1f30 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f0e64009870 tx=0x7f0e6402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a624751cae7a2759 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:19.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.691+0000 7f0e69ffb640 1 -- 172.21.15.132:0/1263894257 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e64030840 con 0x7f0e6c0d1aa0 2023-12-20T04:49:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.691+0000 7f0e69ffb640 1 -- 172.21.15.132:0/1263894257 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e640309a0 con 0x7f0e6c0d1aa0 2023-12-20T04:49:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.691+0000 7f0e69ffb640 1 -- 172.21.15.132:0/1263894257 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e64030d30 con 0x7f0e6c0d1aa0 2023-12-20T04:49:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.692+0000 7f0e71641640 1 -- 172.21.15.132:0/1263894257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e6c0d1aa0 msgr2=0x7f0e6c0d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.692+0000 7f0e71641640 1 --2- 172.21.15.132:0/1263894257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e6c0d1aa0 0x7f0e6c0d1f30 secure :-1 s=READY pgs=1443 cs=0 l=1 rev1=1 crypto rx=0x7f0e64009870 tx=0x7f0e6402b980 comp rx=0 tx=0).stop 2023-12-20T04:49:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.692+0000 7f0e71641640 1 -- 172.21.15.132:0/1263894257 shutdown_connections 2023-12-20T04:49:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.692+0000 7f0e71641640 1 --2- 172.21.15.132:0/1263894257 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e6c0d1aa0 0x7f0e6c0d1f30 unknown :-1 s=CLOSED pgs=1443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.692+0000 7f0e71641640 1 --2- 172.21.15.132:0/1263894257 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c0b4980 0x7f0e6c0b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.692+0000 7f0e71641640 1 -- 172.21.15.132:0/1263894257 >> 172.21.15.132:0/1263894257 conn(0x7f0e6c0cf980 msgr2=0x7f0e6c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:19.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.692+0000 7f0e71641640 1 -- 172.21.15.132:0/1263894257 shutdown_connections 2023-12-20T04:49:19.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.692+0000 7f0e71641640 1 -- 172.21.15.132:0/1263894257 wait complete. 2023-12-20T04:49:19.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.693+0000 7f0e71641640 1 Processor -- start 2023-12-20T04:49:19.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.693+0000 7f0e71641640 1 -- start start 2023-12-20T04:49:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.694+0000 7f0e71641640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c0b4980 0x7f0e6c152160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.694+0000 7f0e71641640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e6c0d1aa0 0x7f0e6c15da40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.694+0000 7f0e71641640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e6c160450 0x7f0e6c15df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.694+0000 7f0e71641640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c157600 con 0x7f0e6c160450 2023-12-20T04:49:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.694+0000 7f0e71641640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c0ca0e0 con 0x7f0e6c0d1aa0 2023-12-20T04:49:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.694+0000 7f0e71641640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e6c0cd000 con 0x7f0e6c0b4980 2023-12-20T04:49:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.694+0000 7f0e6b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e6c160450 0x7f0e6c15df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.694+0000 7f0e6b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e6c160450 0x7f0e6c15df80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50370/0 (socket says 172.21.15.132:50370) 2023-12-20T04:49:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.694+0000 7f0e6b7fe640 1 -- 172.21.15.132:0/983693427 learned_addr learned my addr 172.21.15.132:0/983693427 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.694+0000 7f0e6affd640 1 --2- 172.21.15.132:0/983693427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c0b4980 0x7f0e6c152160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.694+0000 7f0e6a7fc640 1 --2- 172.21.15.132:0/983693427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e6c0d1aa0 0x7f0e6c15da40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.695+0000 7f0e6b7fe640 1 -- 172.21.15.132:0/983693427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c0b4980 msgr2=0x7f0e6c152160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.695+0000 7f0e6b7fe640 1 --2- 172.21.15.132:0/983693427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c0b4980 0x7f0e6c152160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.695+0000 7f0e6b7fe640 1 -- 172.21.15.132:0/983693427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e6c0d1aa0 msgr2=0x7f0e6c15da40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:19.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.695+0000 7f0e6b7fe640 1 --2- 172.21.15.132:0/983693427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e6c0d1aa0 0x7f0e6c15da40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.695+0000 7f0e6b7fe640 1 -- 172.21.15.132:0/983693427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e640094d0 con 0x7f0e6c160450 2023-12-20T04:49:19.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.695+0000 7f0e6b7fe640 1 --2- 172.21.15.132:0/983693427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e6c160450 0x7f0e6c15df80 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f0e6402b9c0 tx=0x7f0e64004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:19.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.695+0000 7f0e637fe640 1 -- 172.21.15.132:0/983693427 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e64043400 con 0x7f0e6c160450 2023-12-20T04:49:19.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.695+0000 7f0e637fe640 1 -- 172.21.15.132:0/983693427 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e64043580 con 0x7f0e6c160450 2023-12-20T04:49:19.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.695+0000 7f0e637fe640 1 -- 172.21.15.132:0/983693427 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e64043930 con 0x7f0e6c160450 2023-12-20T04:49:19.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.695+0000 7f0e71641640 1 -- 172.21.15.132:0/983693427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e6c1f3320 con 0x7f0e6c160450 2023-12-20T04:49:19.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.695+0000 7f0e71641640 1 -- 172.21.15.132:0/983693427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e6c156f40 con 0x7f0e6c160450 2023-12-20T04:49:19.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.696+0000 7f0e71641640 1 -- 172.21.15.132:0/983693427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e6c04e840 con 0x7f0e6c160450 2023-12-20T04:49:19.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.696+0000 7f0e637fe640 1 -- 172.21.15.132:0/983693427 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0e64043a90 con 0x7f0e6c160450 2023-12-20T04:49:19.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.697+0000 7f0e637fe640 1 --2- 172.21.15.132:0/983693427 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e4c06a430 0x7f0e4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:19.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.697+0000 7f0e637fe640 1 -- 172.21.15.132:0/983693427 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(140..140 src has 1..140) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0e6403e070 con 0x7f0e6c160450 2023-12-20T04:49:19.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.697+0000 7f0e6affd640 1 --2- 172.21.15.132:0/983693427 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e4c06a430 0x7f0e4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:19.700 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.697+0000 7f0e6affd640 1 --2- 172.21.15.132:0/983693427 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e4c06a430 0x7f0e4c06c8f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c005520 tx=0x7f0e5c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:19.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.701+0000 7f0e637fe640 1 -- 172.21.15.132:0/983693427 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0e64077150 con 0x7f0e6c160450 2023-12-20T04:49:19.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.871+0000 7f0e71641640 1 -- 172.21.15.132:0/983693427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f0e6c0d0ad0 con 0x7f0e6c160450 2023-12-20T04:49:19.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.872+0000 7f0e637fe640 1 -- 172.21.15.132:0/983693427 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+16134 (secure 0 0 0) 0x7f0e64034090 con 0x7f0e6c160450 2023-12-20T04:49:19.874 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:19.874 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":141,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:49:19.858214+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:48:35.008751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-20T04:48:36.182609+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:49:19.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.874+0000 7f0e71641640 1 -- 172.21.15.132:0/983693427 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e4c06a430 msgr2=0x7f0e4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:19.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.874+0000 7f0e71641640 1 --2- 172.21.15.132:0/983693427 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e4c06a430 0x7f0e4c06c8f0 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f0e5c005520 tx=0x7f0e5c009040 comp rx=0 tx=0).stop 2023-12-20T04:49:19.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.874+0000 7f0e71641640 1 -- 172.21.15.132:0/983693427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e6c160450 msgr2=0x7f0e6c15df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:19.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.874+0000 7f0e71641640 1 --2- 172.21.15.132:0/983693427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e6c160450 0x7f0e6c15df80 secure :-1 s=READY pgs=1444 cs=0 l=1 rev1=1 crypto rx=0x7f0e6402b9c0 tx=0x7f0e64004730 comp rx=0 tx=0).stop 2023-12-20T04:49:19.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.874+0000 7f0e71641640 1 -- 172.21.15.132:0/983693427 shutdown_connections 2023-12-20T04:49:19.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.874+0000 7f0e71641640 1 --2- 172.21.15.132:0/983693427 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e4c06a430 0x7f0e4c06c8f0 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.874+0000 7f0e71641640 1 --2- 172.21.15.132:0/983693427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e6c160450 0x7f0e6c15df80 unknown :-1 s=CLOSED pgs=1444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.874+0000 7f0e71641640 1 --2- 172.21.15.132:0/983693427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e6c0d1aa0 0x7f0e6c15da40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.874+0000 7f0e71641640 1 --2- 172.21.15.132:0/983693427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e6c0b4980 0x7f0e6c152160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.874+0000 7f0e71641640 1 -- 172.21.15.132:0/983693427 >> 172.21.15.132:0/983693427 conn(0x7f0e6c0cf980 msgr2=0x7f0e6c0b75e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:19.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.874+0000 7f0e71641640 1 -- 172.21.15.132:0/983693427 shutdown_connections 2023-12-20T04:49:19.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.874+0000 7f0e71641640 1 -- 172.21.15.132:0/983693427 wait complete. 2023-12-20T04:49:19.887 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 16, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:48:35.008751+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '136', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 17, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:48:36.182609+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '141', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 1, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:49:19.887 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:49:19.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.989+0000 7f2a32c96640 1 Processor -- start 2023-12-20T04:49:19.991 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.989+0000 7f2a32c96640 1 -- start start 2023-12-20T04:49:19.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.990+0000 7f2a32c96640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a2c0cf880 0x7f2a2c0cfce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:19.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.990+0000 7f2a32c96640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2a2c0b60e0 0x7f2a2c0b6530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:19.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.990+0000 7f2a32c96640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2a2c0d0220 con 0x7f2a2c15d300 2023-12-20T04:49:19.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.990+0000 7f2a32c96640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2a2c0d1a90 con 0x7f2a2c0b60e0 2023-12-20T04:49:19.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.990+0000 7f2a32c96640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c0d1d70 con 0x7f2a2c0cf880 2023-12-20T04:49:19.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.990+0000 7f2a2bfff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a2c0cf880 0x7f2a2c0cfce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:19.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.990+0000 7f2a2bfff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a2c0cf880 0x7f2a2c0cfce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:35014/0 (socket says 172.21.15.132:35014) 2023-12-20T04:49:19.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.990+0000 7f2a2bfff640 1 -- 172.21.15.132:0/3367302571 learned_addr learned my addr 172.21.15.132:0/3367302571 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:19.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.990+0000 7f2a31233640 1 --2- 172.21.15.132:0/3367302571 >> v2:172.21.15.187:3300/0 conn(0x7f2a2c0b60e0 0x7f2a2c0b6530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:19.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.990+0000 7f2a31233640 1 -- 172.21.15.132:0/3367302571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a2c0cf880 msgr2=0x7f2a2c0cfce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:19.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.991+0000 7f2a31233640 1 --2- 172.21.15.132:0/3367302571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a2c0cf880 0x7f2a2c0cfce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.991+0000 7f2a31233640 1 -- 172.21.15.132:0/3367302571 >> v1:172.21.15.187:6789/0 conn(0x7f2a2c15d300 legacy=0x7f2a2c0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:19.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.991+0000 7f2a31233640 1 -- 172.21.15.132:0/3367302571 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a2c0d2050 con 0x7f2a2c0b60e0 2023-12-20T04:49:19.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.991+0000 7f2a2bfff640 1 --2- 172.21.15.132:0/3367302571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a2c0cf880 0x7f2a2c0cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:49:19.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.991+0000 7f2a31233640 1 --2- 172.21.15.132:0/3367302571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a2c0b60e0 0x7f2a2c0b6530 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009d90 tx=0x7f2a2402bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b4c95ec0cdb4ed6c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:19.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.991+0000 7f2a2b7fe640 1 -- 172.21.15.132:0/3367302571 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a2402cc50 con 0x7f2a2c0b60e0 2023-12-20T04:49:19.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.991+0000 7f2a2b7fe640 1 -- 172.21.15.132:0/3367302571 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a2402cdb0 con 0x7f2a2c0b60e0 2023-12-20T04:49:19.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.991+0000 7f2a2b7fe640 1 -- 172.21.15.132:0/3367302571 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a24034660 con 0x7f2a2c0b60e0 2023-12-20T04:49:19.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.992+0000 7f2a32c96640 1 -- 172.21.15.132:0/3367302571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a2c0b60e0 msgr2=0x7f2a2c0b6530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:19.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.992+0000 7f2a32c96640 1 --2- 172.21.15.132:0/3367302571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a2c0b60e0 0x7f2a2c0b6530 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f2a24009d90 tx=0x7f2a2402bea0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.992+0000 7f2a32c96640 1 -- 172.21.15.132:0/3367302571 shutdown_connections 2023-12-20T04:49:19.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.992+0000 7f2a32c96640 1 --2- 172.21.15.132:0/3367302571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a2c0b60e0 0x7f2a2c0b6530 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.992+0000 7f2a32c96640 1 --2- 172.21.15.132:0/3367302571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a2c0cf880 0x7f2a2c0cfce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.992+0000 7f2a32c96640 1 -- 172.21.15.132:0/3367302571 >> 172.21.15.132:0/3367302571 conn(0x7f2a2c06a3d0 msgr2=0x7f2a2c06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:19.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.992+0000 7f2a32c96640 1 -- 172.21.15.132:0/3367302571 shutdown_connections 2023-12-20T04:49:19.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.992+0000 7f2a32c96640 1 -- 172.21.15.132:0/3367302571 wait complete. 2023-12-20T04:49:19.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.993+0000 7f2a32c96640 1 Processor -- start 2023-12-20T04:49:19.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.993+0000 7f2a32c96640 1 -- start start 2023-12-20T04:49:19.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.994+0000 7f2a32c96640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a2c0b60e0 0x7f2a2c1f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:19.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.994+0000 7f2a32c96640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a2c0cf880 0x7f2a2c1f6820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:19.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.994+0000 7f2a32c96640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a2c15d300 0x7f2a2c0c8db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:19.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.994+0000 7f2a32c96640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c14c6f0 con 0x7f2a2c0b60e0 2023-12-20T04:49:19.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.994+0000 7f2a32c96640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c0cc440 con 0x7f2a2c0cf880 2023-12-20T04:49:19.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.994+0000 7f2a32c96640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2a2c0cc720 con 0x7f2a2c15d300 2023-12-20T04:49:19.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.994+0000 7f2a30a32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a2c0b60e0 0x7f2a2c1f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:19.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.994+0000 7f2a30a32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a2c0b60e0 0x7f2a2c1f62e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50376/0 (socket says 172.21.15.132:50376) 2023-12-20T04:49:19.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.994+0000 7f2a30a32640 1 -- 172.21.15.132:0/3053990596 learned_addr learned my addr 172.21.15.132:0/3053990596 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:19.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.994+0000 7f2a31233640 1 --2- 172.21.15.132:0/3053990596 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a2c15d300 0x7f2a2c0c8db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:19.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.994+0000 7f2a2bfff640 1 --2- 172.21.15.132:0/3053990596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a2c0cf880 0x7f2a2c1f6820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:19.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.994+0000 7f2a30a32640 1 -- 172.21.15.132:0/3053990596 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a2c15d300 msgr2=0x7f2a2c0c8db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:19.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.994+0000 7f2a30a32640 1 --2- 172.21.15.132:0/3053990596 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a2c15d300 0x7f2a2c0c8db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.994+0000 7f2a30a32640 1 -- 172.21.15.132:0/3053990596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a2c0cf880 msgr2=0x7f2a2c1f6820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:19.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.994+0000 7f2a30a32640 1 --2- 172.21.15.132:0/3053990596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a2c0cf880 0x7f2a2c1f6820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:19.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.995+0000 7f2a30a32640 1 -- 172.21.15.132:0/3053990596 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a18009460 con 0x7f2a2c0b60e0 2023-12-20T04:49:19.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.995+0000 7f2a31233640 1 --2- 172.21.15.132:0/3053990596 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a2c15d300 0x7f2a2c0c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:19.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.995+0000 7f2a30a32640 1 --2- 172.21.15.132:0/3053990596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a2c0b60e0 0x7f2a2c1f62e0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000c400 tx=0x7f2a2000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:19.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.995+0000 7f2a297fa640 1 -- 172.21.15.132:0/3053990596 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a200052d0 con 0x7f2a2c0b60e0 2023-12-20T04:49:19.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.995+0000 7f2a297fa640 1 -- 172.21.15.132:0/3053990596 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2a20005450 con 0x7f2a2c0b60e0 2023-12-20T04:49:19.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.995+0000 7f2a32c96640 1 -- 172.21.15.132:0/3053990596 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a24009a70 con 0x7f2a2c0b60e0 2023-12-20T04:49:19.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.995+0000 7f2a297fa640 1 -- 172.21.15.132:0/3053990596 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2a20007260 con 0x7f2a2c0b60e0 2023-12-20T04:49:19.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.995+0000 7f2a32c96640 1 -- 172.21.15.132:0/3053990596 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a2c14cbe0 con 0x7f2a2c0b60e0 2023-12-20T04:49:20.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.996+0000 7f2a32c96640 1 -- 172.21.15.132:0/3053990596 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a2c0b84d0 con 0x7f2a2c0b60e0 2023-12-20T04:49:20.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.996+0000 7f2a297fa640 1 -- 172.21.15.132:0/3053990596 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2a200073c0 con 0x7f2a2c0b60e0 2023-12-20T04:49:20.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.997+0000 7f2a297fa640 1 --2- 172.21.15.132:0/3053990596 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2a1006a430 0x7f2a1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.997+0000 7f2a297fa640 1 -- 172.21.15.132:0/3053990596 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2a20087d50 con 0x7f2a2c0b60e0 2023-12-20T04:49:20.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.997+0000 7f2a2bfff640 1 --2- 172.21.15.132:0/3053990596 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2a1006a430 0x7f2a1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.997+0000 7f2a297fa640 1 -- 172.21.15.132:0/3053990596 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=142}) v3 -- 0x7f2a10071f60 con 0x7f2a2c0b60e0 2023-12-20T04:49:20.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:19.997+0000 7f2a2bfff640 1 --2- 172.21.15.132:0/3053990596 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2a1006a430 0x7f2a1006c8f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0c6ac0 tx=0x7f2a18008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:20.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.001+0000 7f2a297fa640 1 -- 172.21.15.132:0/3053990596 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2a2008b030 con 0x7f2a2c0b60e0 2023-12-20T04:49:20.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.165+0000 7f2a32c96640 1 -- 172.21.15.132:0/3053990596 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f2a2c0d16f0 con 0x7f2a2c0b60e0 2023-12-20T04:49:20.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.165+0000 7f2a297fa640 1 -- 172.21.15.132:0/3053990596 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v141) v1 ==== 93+0+10 (secure 0 0 0) 0x7f2a20056dd0 con 0x7f2a2c0b60e0 2023-12-20T04:49:20.168 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:49:20.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.167+0000 7f2a32c96640 1 -- 172.21.15.132:0/3053990596 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2a1006a430 msgr2=0x7f2a1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.167+0000 7f2a32c96640 1 --2- 172.21.15.132:0/3053990596 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2a1006a430 0x7f2a1006c8f0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f2a2c0c6ac0 tx=0x7f2a18008040 comp rx=0 tx=0).stop 2023-12-20T04:49:20.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.167+0000 7f2a32c96640 1 -- 172.21.15.132:0/3053990596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a2c0b60e0 msgr2=0x7f2a2c1f62e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.167+0000 7f2a32c96640 1 --2- 172.21.15.132:0/3053990596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a2c0b60e0 0x7f2a2c1f62e0 secure :-1 s=READY pgs=1445 cs=0 l=1 rev1=1 crypto rx=0x7f2a2000c400 tx=0x7f2a2000c8c0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.167+0000 7f2a32c96640 1 -- 172.21.15.132:0/3053990596 shutdown_connections 2023-12-20T04:49:20.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.167+0000 7f2a32c96640 1 --2- 172.21.15.132:0/3053990596 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2a1006a430 0x7f2a1006c8f0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.167+0000 7f2a32c96640 1 --2- 172.21.15.132:0/3053990596 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2a2c15d300 0x7f2a2c0c8db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.167+0000 7f2a32c96640 1 --2- 172.21.15.132:0/3053990596 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2a2c0cf880 0x7f2a2c1f6820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.167+0000 7f2a32c96640 1 --2- 172.21.15.132:0/3053990596 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2a2c0b60e0 0x7f2a2c1f62e0 unknown :-1 s=CLOSED pgs=1445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.167+0000 7f2a32c96640 1 -- 172.21.15.132:0/3053990596 >> 172.21.15.132:0/3053990596 conn(0x7f2a2c06a3d0 msgr2=0x7f2a2c0cd8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:20.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.167+0000 7f2a32c96640 1 -- 172.21.15.132:0/3053990596 shutdown_connections 2023-12-20T04:49:20.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.167+0000 7f2a32c96640 1 -- 172.21.15.132:0/3053990596 wait complete. 2023-12-20T04:49:20.181 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:49:20.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.285+0000 7fa3d0da2640 1 Processor -- start 2023-12-20T04:49:20.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.285+0000 7fa3d0da2640 1 -- start start 2023-12-20T04:49:20.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.286+0000 7fa3d0da2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3cc0ce150 0x7fa3cc0b5e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.286+0000 7fa3d0da2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa3cc0d27f0 0x7fa3cc0b6350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.286+0000 7fa3d0da2640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3cc0d24d0 con 0x7fa3cc1607a0 2023-12-20T04:49:20.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.286+0000 7fa3d0da2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3cc0b8cc0 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.286+0000 7fa3d0da2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc0b89e0 con 0x7fa3cc0ce150 2023-12-20T04:49:20.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.286+0000 7fa3cbfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa3cc0d27f0 0x7fa3cc0b6350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.286+0000 7fa3cbfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa3cc0d27f0 0x7fa3cc0b6350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50380/0 (socket says 172.21.15.132:50380) 2023-12-20T04:49:20.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.286+0000 7fa3cbfff640 1 -- 172.21.15.132:0/3497356044 learned_addr learned my addr 172.21.15.132:0/3497356044 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:20.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.286+0000 7fa3caffd640 1 --2- 172.21.15.132:0/3497356044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3cc0ce150 0x7fa3cc0b5e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.286+0000 7fa3cbfff640 1 -- 172.21.15.132:0/3497356044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3cc0ce150 msgr2=0x7fa3cc0b5e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:20.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.286+0000 7fa3cbfff640 1 --2- 172.21.15.132:0/3497356044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3cc0ce150 0x7fa3cc0b5e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.286+0000 7fa3cbfff640 1 -- 172.21.15.132:0/3497356044 >> v1:172.21.15.187:6789/0 conn(0x7fa3cc1607a0 legacy=0x7fa3cc0cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.286+0000 7fa3cbfff640 1 -- 172.21.15.132:0/3497356044 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3cc0d19f0 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.287+0000 7fa3cbfff640 1 --2- 172.21.15.132:0/3497356044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3cc0d27f0 0x7fa3cc0b6350 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4009e50 tx=0x7fa3c402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=12d9c77ce408f61f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:20.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.287+0000 7fa3ca7fc640 1 -- 172.21.15.132:0/3497356044 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c402cb00 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.287+0000 7fa3ca7fc640 1 -- 172.21.15.132:0/3497356044 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c402cc60 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.287+0000 7fa3ca7fc640 1 -- 172.21.15.132:0/3497356044 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c40343f0 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.287+0000 7fa3d0da2640 1 -- 172.21.15.132:0/3497356044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3cc0d27f0 msgr2=0x7fa3cc0b6350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.287+0000 7fa3d0da2640 1 --2- 172.21.15.132:0/3497356044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3cc0d27f0 0x7fa3cc0b6350 secure :-1 s=READY pgs=1446 cs=0 l=1 rev1=1 crypto rx=0x7fa3c4009e50 tx=0x7fa3c402bf60 comp rx=0 tx=0).stop 2023-12-20T04:49:20.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.287+0000 7fa3d0da2640 1 -- 172.21.15.132:0/3497356044 shutdown_connections 2023-12-20T04:49:20.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.287+0000 7fa3d0da2640 1 --2- 172.21.15.132:0/3497356044 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3cc0d27f0 0x7fa3cc0b6350 unknown :-1 s=CLOSED pgs=1446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.287+0000 7fa3d0da2640 1 --2- 172.21.15.132:0/3497356044 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3cc0ce150 0x7fa3cc0b5e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.287+0000 7fa3d0da2640 1 -- 172.21.15.132:0/3497356044 >> 172.21.15.132:0/3497356044 conn(0x7fa3cc0cf6f0 msgr2=0x7fa3cc0cfb00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:20.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.287+0000 7fa3d0da2640 1 -- 172.21.15.132:0/3497356044 shutdown_connections 2023-12-20T04:49:20.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.287+0000 7fa3d0da2640 1 -- 172.21.15.132:0/3497356044 wait complete. 2023-12-20T04:49:20.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.288+0000 7fa3d0da2640 1 Processor -- start 2023-12-20T04:49:20.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.289+0000 7fa3d0da2640 1 -- start start 2023-12-20T04:49:20.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.289+0000 7fa3d0da2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3cc0ce150 0x7fa3cc0c5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.289+0000 7fa3d0da2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3cc0d27f0 0x7fa3cc0c8f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.289+0000 7fa3d0da2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3cc1607a0 0x7fa3cc0d0820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.289+0000 7fa3d0da2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc158310 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.289+0000 7fa3d0da2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc0c8a70 con 0x7fa3cc1607a0 2023-12-20T04:49:20.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.289+0000 7fa3d0da2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3cc0c7740 con 0x7fa3cc0ce150 2023-12-20T04:49:20.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.289+0000 7fa3caffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3cc0d27f0 0x7fa3cc0c8f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.289+0000 7fa3caffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3cc0d27f0 0x7fa3cc0c8f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50384/0 (socket says 172.21.15.132:50384) 2023-12-20T04:49:20.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.289+0000 7fa3caffd640 1 -- 172.21.15.132:0/725640482 learned_addr learned my addr 172.21.15.132:0/725640482 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:20.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.290+0000 7fa3cb7fe640 1 --2- 172.21.15.132:0/725640482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3cc0ce150 0x7fa3cc0c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.290+0000 7fa3cbfff640 1 --2- 172.21.15.132:0/725640482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3cc1607a0 0x7fa3cc0d0820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.290+0000 7fa3caffd640 1 -- 172.21.15.132:0/725640482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3cc0ce150 msgr2=0x7fa3cc0c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.290+0000 7fa3caffd640 1 --2- 172.21.15.132:0/725640482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3cc0ce150 0x7fa3cc0c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.290+0000 7fa3caffd640 1 -- 172.21.15.132:0/725640482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3cc1607a0 msgr2=0x7fa3cc0d0820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.290+0000 7fa3caffd640 1 --2- 172.21.15.132:0/725640482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3cc1607a0 0x7fa3cc0d0820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.290+0000 7fa3caffd640 1 -- 172.21.15.132:0/725640482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3c4009b30 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.290+0000 7fa3caffd640 1 --2- 172.21.15.132:0/725640482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3cc0d27f0 0x7fa3cc0c8f00 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000d5f0 tx=0x7fa3c000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:20.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.290+0000 7fa3b3fff640 1 -- 172.21.15.132:0/725640482 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c00125f0 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.290+0000 7fa3b3fff640 1 -- 172.21.15.132:0/725640482 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa3c0012750 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.290+0000 7fa3b3fff640 1 -- 172.21.15.132:0/725640482 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa3c0012b00 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.290+0000 7fa3d0da2640 1 -- 172.21.15.132:0/725640482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3cc0c8140 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.290+0000 7fa3d0da2640 1 -- 172.21.15.132:0/725640482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3cc0c8700 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.291+0000 7fa3d0da2640 1 -- 172.21.15.132:0/725640482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3cc0c8c00 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.292+0000 7fa3b3fff640 1 -- 172.21.15.132:0/725640482 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa3c0012c60 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.292+0000 7fa3b3fff640 1 --2- 172.21.15.132:0/725640482 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa3b806a460 0x7fa3b806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.292+0000 7fa3b3fff640 1 -- 172.21.15.132:0/725640482 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa3c0088bc0 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.292+0000 7fa3cb7fe640 1 --2- 172.21.15.132:0/725640482 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa3b806a460 0x7fa3b806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.292+0000 7fa3b3fff640 1 -- 172.21.15.132:0/725640482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=142}) v3 -- 0x7fa3b8071f90 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.292+0000 7fa3cb7fe640 1 --2- 172.21.15.132:0/725640482 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa3b806a460 0x7fa3b806c920 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc154850 tx=0x7fa3bc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:20.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.296+0000 7fa3b3fff640 1 -- 172.21.15.132:0/725640482 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa3c00542f0 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.462+0000 7fa3d0da2640 1 -- 172.21.15.132:0/725640482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fa3cc0673e0 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.462+0000 7fa3b3fff640 1 -- 172.21.15.132:0/725640482 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v141) v1 ==== 104+0+11 (secure 0 0 0) 0x7fa3c0057910 con 0x7fa3cc0d27f0 2023-12-20T04:49:20.464 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:49:20.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.464+0000 7fa3d0da2640 1 -- 172.21.15.132:0/725640482 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa3b806a460 msgr2=0x7fa3b806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.464+0000 7fa3d0da2640 1 --2- 172.21.15.132:0/725640482 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa3b806a460 0x7fa3b806c920 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7fa3cc154850 tx=0x7fa3bc009040 comp rx=0 tx=0).stop 2023-12-20T04:49:20.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.464+0000 7fa3d0da2640 1 -- 172.21.15.132:0/725640482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3cc0d27f0 msgr2=0x7fa3cc0c8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.464+0000 7fa3d0da2640 1 --2- 172.21.15.132:0/725640482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3cc0d27f0 0x7fa3cc0c8f00 secure :-1 s=READY pgs=1447 cs=0 l=1 rev1=1 crypto rx=0x7fa3c000d5f0 tx=0x7fa3c000dab0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.464+0000 7fa3d0da2640 1 -- 172.21.15.132:0/725640482 shutdown_connections 2023-12-20T04:49:20.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.464+0000 7fa3d0da2640 1 --2- 172.21.15.132:0/725640482 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa3b806a460 0x7fa3b806c920 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.464+0000 7fa3d0da2640 1 --2- 172.21.15.132:0/725640482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3cc1607a0 0x7fa3cc0d0820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.464+0000 7fa3d0da2640 1 --2- 172.21.15.132:0/725640482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa3cc0d27f0 0x7fa3cc0c8f00 unknown :-1 s=CLOSED pgs=1447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.464+0000 7fa3d0da2640 1 --2- 172.21.15.132:0/725640482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3cc0ce150 0x7fa3cc0c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.464+0000 7fa3d0da2640 1 -- 172.21.15.132:0/725640482 >> 172.21.15.132:0/725640482 conn(0x7fa3cc0cf6f0 msgr2=0x7fa3cc0b6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:20.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.464+0000 7fa3d0da2640 1 -- 172.21.15.132:0/725640482 shutdown_connections 2023-12-20T04:49:20.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.464+0000 7fa3d0da2640 1 -- 172.21.15.132:0/725640482 wait complete. 2023-12-20T04:49:20.477 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:49:20.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.578+0000 7f58caa96640 1 Processor -- start 2023-12-20T04:49:20.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.578+0000 7f58caa96640 1 -- start start 2023-12-20T04:49:20.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.579+0000 7f58caa96640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58c415d300 0x7f58c406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.579+0000 7f58caa96640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f58c40cd4b0 0x7f58c40cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.579+0000 7f58caa96640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58c406cc90 con 0x7f58c415cf20 2023-12-20T04:49:20.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.579+0000 7f58caa96640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58c40cde60 con 0x7f58c40cd4b0 2023-12-20T04:49:20.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.579+0000 7f58caa96640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40b2f30 con 0x7f58c415d300 2023-12-20T04:49:20.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.579+0000 7f58c9033640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f58c40cd4b0 0x7f58c40cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.579+0000 7f58c9033640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f58c40cd4b0 0x7f58c40cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50390/0 (socket says 172.21.15.132:50390) 2023-12-20T04:49:20.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.579+0000 7f58c9033640 1 -- 172.21.15.132:0/2865694421 learned_addr learned my addr 172.21.15.132:0/2865694421 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:20.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.580+0000 7f58c3fff640 1 --2- 172.21.15.132:0/2865694421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58c415d300 0x7f58c406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.580+0000 7f58c9033640 1 -- 172.21.15.132:0/2865694421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58c415d300 msgr2=0x7f58c406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:20.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.580+0000 7f58c9033640 1 --2- 172.21.15.132:0/2865694421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58c415d300 0x7f58c406c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.580+0000 7f58c9033640 1 -- 172.21.15.132:0/2865694421 >> v1:172.21.15.187:6789/0 conn(0x7f58c415cf20 legacy=0x7f58c4161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:20.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.580+0000 7f58c9033640 1 -- 172.21.15.132:0/2865694421 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58c40b3210 con 0x7f58c40cd4b0 2023-12-20T04:49:20.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.580+0000 7f58c3fff640 1 --2- 172.21.15.132:0/2865694421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58c415d300 0x7f58c406c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:20.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.580+0000 7f58c9033640 1 --2- 172.21.15.132:0/2865694421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58c40cd4b0 0x7f58c40cd920 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009e50 tx=0x7f58bc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b88ba59a4e1eb8a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:20.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.580+0000 7f58c37fe640 1 -- 172.21.15.132:0/2865694421 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc02ca70 con 0x7f58c40cd4b0 2023-12-20T04:49:20.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.581+0000 7f58c37fe640 1 -- 172.21.15.132:0/2865694421 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58bc02cbd0 con 0x7f58c40cd4b0 2023-12-20T04:49:20.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.581+0000 7f58c37fe640 1 -- 172.21.15.132:0/2865694421 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58bc0343f0 con 0x7f58c40cd4b0 2023-12-20T04:49:20.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.581+0000 7f58caa96640 1 -- 172.21.15.132:0/2865694421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58c40cd4b0 msgr2=0x7f58c40cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.581+0000 7f58caa96640 1 --2- 172.21.15.132:0/2865694421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58c40cd4b0 0x7f58c40cd920 secure :-1 s=READY pgs=1448 cs=0 l=1 rev1=1 crypto rx=0x7f58bc009e50 tx=0x7f58bc02bed0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.581+0000 7f58caa96640 1 -- 172.21.15.132:0/2865694421 shutdown_connections 2023-12-20T04:49:20.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.581+0000 7f58caa96640 1 --2- 172.21.15.132:0/2865694421 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58c40cd4b0 0x7f58c40cd920 unknown :-1 s=CLOSED pgs=1448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.581+0000 7f58caa96640 1 --2- 172.21.15.132:0/2865694421 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58c415d300 0x7f58c406c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.581+0000 7f58caa96640 1 -- 172.21.15.132:0/2865694421 >> 172.21.15.132:0/2865694421 conn(0x7f58c4072c60 msgr2=0x7f58c4073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:20.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.581+0000 7f58caa96640 1 -- 172.21.15.132:0/2865694421 shutdown_connections 2023-12-20T04:49:20.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.581+0000 7f58caa96640 1 -- 172.21.15.132:0/2865694421 wait complete. 2023-12-20T04:49:20.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.582+0000 7f58caa96640 1 Processor -- start 2023-12-20T04:49:20.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.582+0000 7f58caa96640 1 -- start start 2023-12-20T04:49:20.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.583+0000 7f58caa96640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58c40cd4b0 0x7f58c414c020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.583+0000 7f58caa96640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58c415cf20 0x7f58c40b1560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.583+0000 7f58caa96640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58c415d300 0x7f58c40b1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.583+0000 7f58caa96640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40b5880 con 0x7f58c40cd4b0 2023-12-20T04:49:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.583+0000 7f58caa96640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40b5b60 con 0x7f58c415cf20 2023-12-20T04:49:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.583+0000 7f58caa96640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58c40b5e40 con 0x7f58c415d300 2023-12-20T04:49:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.583+0000 7f58c8832640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58c40cd4b0 0x7f58c414c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.583+0000 7f58c8832640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58c40cd4b0 0x7f58c414c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50402/0 (socket says 172.21.15.132:50402) 2023-12-20T04:49:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.583+0000 7f58c8832640 1 -- 172.21.15.132:0/1580893654 learned_addr learned my addr 172.21.15.132:0/1580893654 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.583+0000 7f58c9033640 1 --2- 172.21.15.132:0/1580893654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58c415d300 0x7f58c40b1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.583+0000 7f58c3fff640 1 --2- 172.21.15.132:0/1580893654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58c415cf20 0x7f58c40b1560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.583+0000 7f58c8832640 1 -- 172.21.15.132:0/1580893654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58c415d300 msgr2=0x7f58c40b1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.583+0000 7f58c8832640 1 --2- 172.21.15.132:0/1580893654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58c415d300 0x7f58c40b1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.583+0000 7f58c8832640 1 -- 172.21.15.132:0/1580893654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58c415cf20 msgr2=0x7f58c40b1560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.583+0000 7f58c8832640 1 --2- 172.21.15.132:0/1580893654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58c415cf20 0x7f58c40b1560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.583+0000 7f58c8832640 1 -- 172.21.15.132:0/1580893654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58bc009b30 con 0x7f58c40cd4b0 2023-12-20T04:49:20.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.584+0000 7f58c3fff640 1 --2- 172.21.15.132:0/1580893654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58c415cf20 0x7f58c40b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:20.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.584+0000 7f58c8832640 1 --2- 172.21.15.132:0/1580893654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58c40cd4b0 0x7f58c414c020 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f58b400c430 tx=0x7f58b400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:20.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.584+0000 7f58c17fa640 1 -- 172.21.15.132:0/1580893654 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4011790 con 0x7f58c40cd4b0 2023-12-20T04:49:20.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.584+0000 7f58c17fa640 1 -- 172.21.15.132:0/1580893654 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58b40118f0 con 0x7f58c40cd4b0 2023-12-20T04:49:20.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.584+0000 7f58c17fa640 1 -- 172.21.15.132:0/1580893654 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58b4011ce0 con 0x7f58c40cd4b0 2023-12-20T04:49:20.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.584+0000 7f58caa96640 1 -- 172.21.15.132:0/1580893654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58c40b6120 con 0x7f58c40cd4b0 2023-12-20T04:49:20.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.584+0000 7f58caa96640 1 -- 172.21.15.132:0/1580893654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58c414c560 con 0x7f58c40cd4b0 2023-12-20T04:49:20.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.585+0000 7f58caa96640 1 -- 172.21.15.132:0/1580893654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58c40b6640 con 0x7f58c40cd4b0 2023-12-20T04:49:20.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.585+0000 7f58c17fa640 1 -- 172.21.15.132:0/1580893654 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f58b401c460 con 0x7f58c40cd4b0 2023-12-20T04:49:20.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.586+0000 7f58c17fa640 1 --2- 172.21.15.132:0/1580893654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f58b006a460 0x7f58b006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.586+0000 7f58c3fff640 1 --2- 172.21.15.132:0/1580893654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f58b006a460 0x7f58b006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.586+0000 7f58c17fa640 1 -- 172.21.15.132:0/1580893654 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f58b40887e0 con 0x7f58c40cd4b0 2023-12-20T04:49:20.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.586+0000 7f58c17fa640 1 -- 172.21.15.132:0/1580893654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=142}) v3 -- 0x7f58b0071f90 con 0x7f58c40cd4b0 2023-12-20T04:49:20.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.586+0000 7f58c3fff640 1 --2- 172.21.15.132:0/1580893654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f58b006a460 0x7f58b006c920 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f58c40c71f0 tx=0x7f58b8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:20.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.590+0000 7f58c17fa640 1 -- 172.21.15.132:0/1580893654 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f58b4053dd0 con 0x7f58c40cd4b0 2023-12-20T04:49:20.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.758+0000 7f58caa96640 1 -- 172.21.15.132:0/1580893654 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f58c404e840 con 0x7f58c40cd4b0 2023-12-20T04:49:20.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.759+0000 7f58c17fa640 1 -- 172.21.15.132:0/1580893654 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v141) v1 ==== 100+0+11 (secure 0 0 0) 0x7f58b40573f0 con 0x7f58c40cd4b0 2023-12-20T04:49:20.761 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:49:20.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.761+0000 7f58caa96640 1 -- 172.21.15.132:0/1580893654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f58b006a460 msgr2=0x7f58b006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.761+0000 7f58caa96640 1 --2- 172.21.15.132:0/1580893654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f58b006a460 0x7f58b006c920 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f58c40c71f0 tx=0x7f58b8008040 comp rx=0 tx=0).stop 2023-12-20T04:49:20.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.761+0000 7f58caa96640 1 -- 172.21.15.132:0/1580893654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58c40cd4b0 msgr2=0x7f58c414c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.761+0000 7f58caa96640 1 --2- 172.21.15.132:0/1580893654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58c40cd4b0 0x7f58c414c020 secure :-1 s=READY pgs=1449 cs=0 l=1 rev1=1 crypto rx=0x7f58b400c430 tx=0x7f58b400c8f0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.761+0000 7f58caa96640 1 -- 172.21.15.132:0/1580893654 shutdown_connections 2023-12-20T04:49:20.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.761+0000 7f58caa96640 1 --2- 172.21.15.132:0/1580893654 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f58b006a460 0x7f58b006c920 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.761+0000 7f58caa96640 1 --2- 172.21.15.132:0/1580893654 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58c415d300 0x7f58c40b1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.761+0000 7f58caa96640 1 --2- 172.21.15.132:0/1580893654 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58c415cf20 0x7f58c40b1560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.761+0000 7f58caa96640 1 --2- 172.21.15.132:0/1580893654 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58c40cd4b0 0x7f58c414c020 unknown :-1 s=CLOSED pgs=1449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.761+0000 7f58caa96640 1 -- 172.21.15.132:0/1580893654 >> 172.21.15.132:0/1580893654 conn(0x7f58c4072c60 msgr2=0x7f58c4160e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:20.763 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.761+0000 7f58caa96640 1 -- 172.21.15.132:0/1580893654 shutdown_connections 2023-12-20T04:49:20.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.761+0000 7f58caa96640 1 -- 172.21.15.132:0/1580893654 wait complete. 2023-12-20T04:49:20.774 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:49:20.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.872+0000 7f9bffed8640 1 Processor -- start 2023-12-20T04:49:20.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.872+0000 7f9bffed8640 1 -- start start 2023-12-20T04:49:20.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bffed8640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9bf806a340 0x7f9bf80708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bffed8640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf8141660 con 0x7f9bf813e690 2023-12-20T04:49:20.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bffed8640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9bf8140ae0 con 0x7f9bf813df60 2023-12-20T04:49:20.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bffed8640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9bf8155a30 con 0x7f9bf806a340 2023-12-20T04:49:20.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfd473640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9bf813e690 0x7f9bf8069c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40006/0 (socket says 172.21.15.132:40006) 2023-12-20T04:49:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfd473640 1 -- 172.21.15.132:0/439211951 learned_addr learned my addr 172.21.15.132:0/439211951 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfe475640 1 --2- 172.21.15.132:0/439211951 >> v2:172.21.15.187:3300/0 conn(0x7f9bf806a340 0x7f9bf80708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfcc72640 1 -- 172.21.15.132:0/439211951 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1235884216 0 0) 0x7f9bf8141660 con 0x7f9bf813e690 2023-12-20T04:49:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfcc72640 1 -- 172.21.15.132:0/439211951 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9be4003520 con 0x7f9bf813e690 2023-12-20T04:49:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfcc72640 1 -- 172.21.15.132:0/439211951 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2005388774 0 0) 0x7f9be4003520 con 0x7f9bf813e690 2023-12-20T04:49:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfcc72640 1 -- 172.21.15.132:0/439211951 >> v2:172.21.15.187:3300/0 conn(0x7f9bf806a340 msgr2=0x7f9bf80708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfcc72640 1 --2- 172.21.15.132:0/439211951 >> v2:172.21.15.187:3300/0 conn(0x7f9bf806a340 0x7f9bf80708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfcc72640 1 -- 172.21.15.132:0/439211951 >> v1:172.21.15.187:6789/0 conn(0x7f9bf813df60 legacy=0x7f9bf80caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfcc72640 1 -- 172.21.15.132:0/439211951 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf8140dc0 con 0x7f9bf813e690 2023-12-20T04:49:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfcc72640 1 -- 172.21.15.132:0/439211951 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f9bf4001670 con 0x7f9bf813e690 2023-12-20T04:49:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfe475640 1 --2- 172.21.15.132:0/439211951 >> v2:172.21.15.187:3300/0 conn(0x7f9bf806a340 0x7f9bf80708d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:49:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfcc72640 1 -- 172.21.15.132:0/439211951 >> v1:172.21.15.132:6789/0 conn(0x7f9bf813e690 legacy=0x7f9bf8069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfcc72640 1 --2- 172.21.15.132:0/439211951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9be4003970 0x7f9be4003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfcc72640 1 --2- 172.21.15.132:0/439211951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9be40047c0 0x7f9be4004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfcc72640 1 --2- 172.21.15.132:0/439211951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9be4005180 0x7f9be400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfcc72640 1 -- 172.21.15.132:0/439211951 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be400c0f0 con 0x7f9be4005180 2023-12-20T04:49:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfcc72640 1 -- 172.21.15.132:0/439211951 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9be400c260 con 0x7f9be40047c0 2023-12-20T04:49:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfcc72640 1 -- 172.21.15.132:0/439211951 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9be400c420 con 0x7f9be4003970 2023-12-20T04:49:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.873+0000 7f9bfe475640 1 --2- 172.21.15.132:0/439211951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9be4005180 0x7f9be400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.874+0000 7f9bfd473640 1 --2- 172.21.15.132:0/439211951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9be40047c0 0x7f9be4004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.874+0000 7f9bfdc74640 1 --2- 172.21.15.132:0/439211951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9be4003970 0x7f9be4003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.874+0000 7f9bfe475640 1 -- 172.21.15.132:0/439211951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9be4003970 msgr2=0x7f9be4003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.874+0000 7f9bfe475640 1 --2- 172.21.15.132:0/439211951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9be4003970 0x7f9be4003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.874+0000 7f9bfe475640 1 -- 172.21.15.132:0/439211951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9be40047c0 msgr2=0x7f9be4004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.874+0000 7f9bfe475640 1 --2- 172.21.15.132:0/439211951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9be40047c0 0x7f9be4004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.874+0000 7f9bfe475640 1 -- 172.21.15.132:0/439211951 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9be4003520 con 0x7f9be4005180 2023-12-20T04:49:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.874+0000 7f9bfe475640 1 -- 172.21.15.132:0/439211951 reap_dead start 2023-12-20T04:49:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.874+0000 7f9bfe475640 1 --2- 172.21.15.132:0/439211951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9be4005180 0x7f9be400b980 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000e320 tx=0x7f9be40057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e107dd6415153f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.875+0000 7f9bfcc72640 1 -- 172.21.15.132:0/439211951 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf002cde0 con 0x7f9be4005180 2023-12-20T04:49:20.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.875+0000 7f9bfcc72640 1 -- 172.21.15.132:0/439211951 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9bf000f040 con 0x7f9be4005180 2023-12-20T04:49:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.875+0000 7f9bfcc72640 1 -- 172.21.15.132:0/439211951 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9bf0003bd0 con 0x7f9be4005180 2023-12-20T04:49:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.875+0000 7f9bffed8640 1 -- 172.21.15.132:0/439211951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9be4005180 msgr2=0x7f9be400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.875+0000 7f9bffed8640 1 --2- 172.21.15.132:0/439211951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9be4005180 0x7f9be400b980 secure :-1 s=READY pgs=1451 cs=0 l=1 rev1=1 crypto rx=0x7f9bf000e320 tx=0x7f9be40057f0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.875+0000 7f9bffed8640 1 -- 172.21.15.132:0/439211951 shutdown_connections 2023-12-20T04:49:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.875+0000 7f9bffed8640 1 --2- 172.21.15.132:0/439211951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9be4005180 0x7f9be400b980 unknown :-1 s=CLOSED pgs=1451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.875+0000 7f9bffed8640 1 -- 172.21.15.132:0/439211951 >> 172.21.15.132:0/439211951 conn(0x7f9bf80cfbd0 msgr2=0x7f9bf80cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.875+0000 7f9bffed8640 1 -- 172.21.15.132:0/439211951 shutdown_connections 2023-12-20T04:49:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.875+0000 7f9bffed8640 1 -- 172.21.15.132:0/439211951 wait complete. 2023-12-20T04:49:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.876+0000 7f9bffed8640 1 Processor -- start 2023-12-20T04:49:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.876+0000 7f9bffed8640 1 -- start start 2023-12-20T04:49:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.877+0000 7f9bffed8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9be4005180 0x7f9bf81f0850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.877+0000 7f9bffed8640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bf80b4270 0x7f9bf80b46f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.877+0000 7f9bffed8640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bf8157810 0x7f9bf8157c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.877+0000 7f9bffed8640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf81584d0 con 0x7f9be4005180 2023-12-20T04:49:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.877+0000 7f9bffed8640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf80b4c30 con 0x7f9bf80b4270 2023-12-20T04:49:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.877+0000 7f9bffed8640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9bf80b2a70 con 0x7f9bf8157810 2023-12-20T04:49:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.877+0000 7f9bfdc74640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9be4005180 0x7f9bf81f0850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.877+0000 7f9bfdc74640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9be4005180 0x7f9bf81f0850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50416/0 (socket says 172.21.15.132:50416) 2023-12-20T04:49:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.877+0000 7f9bfdc74640 1 -- 172.21.15.132:0/2821659751 learned_addr learned my addr 172.21.15.132:0/2821659751 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.877+0000 7f9bfdc74640 1 -- 172.21.15.132:0/2821659751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bf8157810 msgr2=0x7f9bf8157c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.877+0000 7f9bfdc74640 1 --2- 172.21.15.132:0/2821659751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bf8157810 0x7f9bf8157c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.877+0000 7f9bfdc74640 1 -- 172.21.15.132:0/2821659751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bf80b4270 msgr2=0x7f9bf80b46f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.877+0000 7f9bfdc74640 1 --2- 172.21.15.132:0/2821659751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bf80b4270 0x7f9bf80b46f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.877+0000 7f9bfdc74640 1 -- 172.21.15.132:0/2821659751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9bf80b2d10 con 0x7f9be4005180 2023-12-20T04:49:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.878+0000 7f9bfdc74640 1 --2- 172.21.15.132:0/2821659751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9be4005180 0x7f9bf81f0850 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f9be800f4f0 tx=0x7f9be800f9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.878+0000 7f9bee7fc640 1 -- 172.21.15.132:0/2821659751 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be80052e0 con 0x7f9be4005180 2023-12-20T04:49:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.878+0000 7f9bee7fc640 1 -- 172.21.15.132:0/2821659751 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9be8005440 con 0x7f9be4005180 2023-12-20T04:49:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.878+0000 7f9bffed8640 1 -- 172.21.15.132:0/2821659751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9bf80b2ff0 con 0x7f9be4005180 2023-12-20T04:49:20.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.878+0000 7f9bee7fc640 1 -- 172.21.15.132:0/2821659751 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9be8003860 con 0x7f9be4005180 2023-12-20T04:49:20.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.878+0000 7f9bffed8640 1 -- 172.21.15.132:0/2821659751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9bf81581d0 con 0x7f9be4005180 2023-12-20T04:49:20.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.879+0000 7f9bffed8640 1 -- 172.21.15.132:0/2821659751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9bf804e840 con 0x7f9be4005180 2023-12-20T04:49:20.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.879+0000 7f9bee7fc640 1 -- 172.21.15.132:0/2821659751 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9be80039c0 con 0x7f9be4005180 2023-12-20T04:49:20.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.879+0000 7f9bee7fc640 1 --2- 172.21.15.132:0/2821659751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9bdc06a430 0x7f9bdc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:20.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.879+0000 7f9bee7fc640 1 -- 172.21.15.132:0/2821659751 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9be80887a0 con 0x7f9be4005180 2023-12-20T04:49:20.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.879+0000 7f9bfd473640 1 --2- 172.21.15.132:0/2821659751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9bdc06a430 0x7f9bdc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:20.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.880+0000 7f9bee7fc640 1 -- 172.21.15.132:0/2821659751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=142}) v3 -- 0x7f9bdc071f60 con 0x7f9be4005180 2023-12-20T04:49:20.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.880+0000 7f9bfd473640 1 --2- 172.21.15.132:0/2821659751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9bdc06a430 0x7f9bdc06c8f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4001050 tx=0x7f9bf4001b20 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:20.887 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:20.884+0000 7f9bee7fc640 1 -- 172.21.15.132:0/2821659751 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9be8053e40 con 0x7f9be4005180 2023-12-20T04:49:21.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.082+0000 7f9bffed8640 1 -- 172.21.15.132:0/2821659751 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9bf8141070 con 0x7f9be4005180 2023-12-20T04:49:21.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.083+0000 7f9bee7fc640 1 -- 172.21.15.132:0/2821659751 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f9be8057460 con 0x7f9be4005180 2023-12-20T04:49:21.085 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:21.085 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6763,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1413044191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1413044191},{"type":"v1","addr":"172.21.15.132:6837","nonce":1413044191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1584197959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1584197959},{"type":"v1","addr":"172.21.15.187:6834","nonce":1584197959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":7830,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/3080885824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3080885824},{"type":"v1","addr":"172.21.15.132:6836","nonce":3080885824}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:48:37.200402+0000","modified":"2023-12-20T04:48:39.207037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"d","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/1483131498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":1483131498},{"type":"v1","addr":"172.21.15.187:6835","nonce":1483131498}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-20T04:49:21.085 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 51 2023-12-20T04:49:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.084+0000 7f9bffed8640 1 -- 172.21.15.132:0/2821659751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9bdc06a430 msgr2=0x7f9bdc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.084+0000 7f9bffed8640 1 --2- 172.21.15.132:0/2821659751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9bdc06a430 0x7f9bdc06c8f0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f9bf4001050 tx=0x7f9bf4001b20 comp rx=0 tx=0).stop 2023-12-20T04:49:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.084+0000 7f9bffed8640 1 -- 172.21.15.132:0/2821659751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9be4005180 msgr2=0x7f9bf81f0850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.084+0000 7f9bffed8640 1 --2- 172.21.15.132:0/2821659751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9be4005180 0x7f9bf81f0850 secure :-1 s=READY pgs=1452 cs=0 l=1 rev1=1 crypto rx=0x7f9be800f4f0 tx=0x7f9be800f9b0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.085+0000 7f9bffed8640 1 -- 172.21.15.132:0/2821659751 shutdown_connections 2023-12-20T04:49:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.085+0000 7f9bffed8640 1 --2- 172.21.15.132:0/2821659751 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9bdc06a430 0x7f9bdc06c8f0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.085+0000 7f9bffed8640 1 --2- 172.21.15.132:0/2821659751 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9bf8157810 0x7f9bf8157c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.085+0000 7f9bffed8640 1 --2- 172.21.15.132:0/2821659751 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9bf80b4270 0x7f9bf80b46f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.085+0000 7f9bffed8640 1 --2- 172.21.15.132:0/2821659751 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9be4005180 0x7f9bf81f0850 unknown :-1 s=CLOSED pgs=1452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.085+0000 7f9bffed8640 1 -- 172.21.15.132:0/2821659751 >> 172.21.15.132:0/2821659751 conn(0x7f9bf80cfbd0 msgr2=0x7f9bf8159050 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.085+0000 7f9bffed8640 1 -- 172.21.15.132:0/2821659751 shutdown_connections 2023-12-20T04:49:21.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.085+0000 7f9bffed8640 1 -- 172.21.15.132:0/2821659751 wait complete. 2023-12-20T04:49:21.098 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:49:21.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.195+0000 7facbfc32640 1 Processor -- start 2023-12-20T04:49:21.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.195+0000 7facbfc32640 1 -- start start 2023-12-20T04:49:21.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.196+0000 7facbfc32640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7facb8160450 0x7facb8160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.196+0000 7facbfc32640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb81611b0 0x7facb80b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.196+0000 7facbfc32640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7facb80b4ec0 0x7facb806a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.196+0000 7facbfc32640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb80b5350 con 0x7facb8160450 2023-12-20T04:49:21.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.196+0000 7facbfc32640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7facb80b5ec0 con 0x7facb80b4ec0 2023-12-20T04:49:21.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.196+0000 7facbfc32640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb81617e0 con 0x7facb81611b0 2023-12-20T04:49:21.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.196+0000 7facbd9ce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7facb8160450 0x7facb8160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.196+0000 7facbd9ce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7facb8160450 0x7facb8160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50418/0 (socket says 172.21.15.132:50418) 2023-12-20T04:49:21.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.196+0000 7facbd9ce640 1 -- 172.21.15.132:0/1280858952 learned_addr learned my addr 172.21.15.132:0/1280858952 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:21.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.197+0000 7facbd1cd640 1 --2- 172.21.15.132:0/1280858952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb81611b0 0x7facb80b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.197+0000 7facbe1cf640 1 --2- 172.21.15.132:0/1280858952 >> v2:172.21.15.187:3300/0 conn(0x7facb80b4ec0 0x7facb806a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.197+0000 7facbd9ce640 1 -- 172.21.15.132:0/1280858952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb81611b0 msgr2=0x7facb80b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:21.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.197+0000 7facbd9ce640 1 --2- 172.21.15.132:0/1280858952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb81611b0 0x7facb80b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.197+0000 7facbd9ce640 1 -- 172.21.15.132:0/1280858952 >> v2:172.21.15.187:3300/0 conn(0x7facb80b4ec0 msgr2=0x7facb806a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:21.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.197+0000 7facbd9ce640 1 --2- 172.21.15.132:0/1280858952 >> v2:172.21.15.187:3300/0 conn(0x7facb80b4ec0 0x7facb806a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.197+0000 7facbd9ce640 1 -- 172.21.15.132:0/1280858952 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb80d0fc0 con 0x7facb8160450 2023-12-20T04:49:21.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.197+0000 7facbd1cd640 1 --2- 172.21.15.132:0/1280858952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb81611b0 0x7facb80b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:21.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.197+0000 7facbd9ce640 1 --2- 172.21.15.132:0/1280858952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facb8160450 0x7facb8160c70 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7facb80b59d0 tx=0x7facb402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b70f7c1dd73662 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:21.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.197+0000 7facbc9cc640 1 -- 172.21.15.132:0/1280858952 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb402cb00 con 0x7facb8160450 2023-12-20T04:49:21.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.198+0000 7facbc9cc640 1 -- 172.21.15.132:0/1280858952 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb402cc60 con 0x7facb8160450 2023-12-20T04:49:21.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.198+0000 7facbc9cc640 1 -- 172.21.15.132:0/1280858952 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb40343f0 con 0x7facb8160450 2023-12-20T04:49:21.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.198+0000 7facbfc32640 1 -- 172.21.15.132:0/1280858952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facb8160450 msgr2=0x7facb8160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:21.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.198+0000 7facbfc32640 1 --2- 172.21.15.132:0/1280858952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facb8160450 0x7facb8160c70 secure :-1 s=READY pgs=1453 cs=0 l=1 rev1=1 crypto rx=0x7facb80b59d0 tx=0x7facb402bf60 comp rx=0 tx=0).stop 2023-12-20T04:49:21.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.198+0000 7facbfc32640 1 -- 172.21.15.132:0/1280858952 shutdown_connections 2023-12-20T04:49:21.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.198+0000 7facbfc32640 1 --2- 172.21.15.132:0/1280858952 >> v2:172.21.15.187:3300/0 conn(0x7facb80b4ec0 0x7facb806a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.198+0000 7facbfc32640 1 --2- 172.21.15.132:0/1280858952 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb81611b0 0x7facb80b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.198+0000 7facbfc32640 1 --2- 172.21.15.132:0/1280858952 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facb8160450 0x7facb8160c70 unknown :-1 s=CLOSED pgs=1453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.198+0000 7facbfc32640 1 -- 172.21.15.132:0/1280858952 >> 172.21.15.132:0/1280858952 conn(0x7facb80cf980 msgr2=0x7facb80cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:21.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.198+0000 7facbfc32640 1 -- 172.21.15.132:0/1280858952 shutdown_connections 2023-12-20T04:49:21.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.198+0000 7facbfc32640 1 -- 172.21.15.132:0/1280858952 wait complete. 2023-12-20T04:49:21.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.199+0000 7facbfc32640 1 Processor -- start 2023-12-20T04:49:21.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.199+0000 7facbfc32640 1 -- start start 2023-12-20T04:49:21.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.200+0000 7facbfc32640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facb80b4ec0 0x7facb8155400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.200+0000 7facbfc32640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb8160450 0x7facb81590f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.200+0000 7facbfc32640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facb81611b0 0x7facb81f6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.200+0000 7facbfc32640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb815db60 con 0x7facb81611b0 2023-12-20T04:49:21.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.200+0000 7facbfc32640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7facb81f6b20 con 0x7facb80b4ec0 2023-12-20T04:49:21.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.200+0000 7facbfc32640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7facb81f6e00 con 0x7facb8160450 2023-12-20T04:49:21.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.200+0000 7facbe1cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facb81611b0 0x7facb81f6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.200+0000 7facbe1cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facb81611b0 0x7facb81f6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50426/0 (socket says 172.21.15.132:50426) 2023-12-20T04:49:21.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.200+0000 7facbe1cf640 1 -- 172.21.15.132:0/1290942531 learned_addr learned my addr 172.21.15.132:0/1290942531 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.200+0000 7facbd1cd640 1 --2- 172.21.15.132:0/1290942531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb8160450 0x7facb81590f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.200+0000 7facbd9ce640 1 --2- 172.21.15.132:0/1290942531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facb80b4ec0 0x7facb8155400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.200+0000 7facbe1cf640 1 -- 172.21.15.132:0/1290942531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb8160450 msgr2=0x7facb81590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.200+0000 7facbe1cf640 1 --2- 172.21.15.132:0/1290942531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb8160450 0x7facb81590f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.200+0000 7facbe1cf640 1 -- 172.21.15.132:0/1290942531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facb80b4ec0 msgr2=0x7facb8155400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.200+0000 7facbe1cf640 1 --2- 172.21.15.132:0/1290942531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facb80b4ec0 0x7facb8155400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.200+0000 7facbe1cf640 1 -- 172.21.15.132:0/1290942531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facb4009b30 con 0x7facb81611b0 2023-12-20T04:49:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.200+0000 7facbd9ce640 1 --2- 172.21.15.132:0/1290942531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facb80b4ec0 0x7facb8155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.201+0000 7facbe1cf640 1 --2- 172.21.15.132:0/1290942531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facb81611b0 0x7facb81f6060 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7facb000c7f0 tx=0x7facb000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.201+0000 7facae7fc640 1 -- 172.21.15.132:0/1290942531 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0004220 con 0x7facb81611b0 2023-12-20T04:49:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.201+0000 7facae7fc640 1 -- 172.21.15.132:0/1290942531 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7facb0004380 con 0x7facb81611b0 2023-12-20T04:49:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.201+0000 7facbfc32640 1 -- 172.21.15.132:0/1290942531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7facb815dd70 con 0x7facb81611b0 2023-12-20T04:49:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.201+0000 7facae7fc640 1 -- 172.21.15.132:0/1290942531 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7facb0007860 con 0x7facb81611b0 2023-12-20T04:49:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.201+0000 7facbfc32640 1 -- 172.21.15.132:0/1290942531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7facb815d750 con 0x7facb81611b0 2023-12-20T04:49:21.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.202+0000 7facbfc32640 1 -- 172.21.15.132:0/1290942531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7facb804e840 con 0x7facb81611b0 2023-12-20T04:49:21.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.202+0000 7facae7fc640 1 -- 172.21.15.132:0/1290942531 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7facb00079c0 con 0x7facb81611b0 2023-12-20T04:49:21.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.203+0000 7facae7fc640 1 --2- 172.21.15.132:0/1290942531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fac9c06a430 0x7fac9c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.203+0000 7facae7fc640 1 -- 172.21.15.132:0/1290942531 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5709+0+0 (secure 0 0 0) 0x7facb0088550 con 0x7facb81611b0 2023-12-20T04:49:21.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.203+0000 7facbd9ce640 1 --2- 172.21.15.132:0/1290942531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fac9c06a430 0x7fac9c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.203+0000 7facae7fc640 1 -- 172.21.15.132:0/1290942531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=142}) v3 -- 0x7fac9c071f60 con 0x7facb81611b0 2023-12-20T04:49:21.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.203+0000 7facbd9ce640 1 --2- 172.21.15.132:0/1290942531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fac9c06a430 0x7fac9c06c8f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7facb4035000 tx=0x7facb4030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:21.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.207+0000 7facae7fc640 1 -- 172.21.15.132:0/1290942531 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7facb0053c80 con 0x7facb81611b0 2023-12-20T04:49:21.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.373+0000 7facbfc32640 1 -- 172.21.15.132:0/1290942531 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7facb81f6fc0 con 0x7facb81611b0 2023-12-20T04:49:21.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.375+0000 7facae7fc640 1 -- 172.21.15.132:0/1290942531 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+16134 (secure 0 0 0) 0x7facb001e090 con 0x7facb81611b0 2023-12-20T04:49:21.377 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:21.377 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":141,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:49:19.858214+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:48:35.008751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-20T04:48:36.182609+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:49:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.377+0000 7facbfc32640 1 -- 172.21.15.132:0/1290942531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fac9c06a430 msgr2=0x7fac9c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.377+0000 7facbfc32640 1 --2- 172.21.15.132:0/1290942531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fac9c06a430 0x7fac9c06c8f0 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7facb4035000 tx=0x7facb4030000 comp rx=0 tx=0).stop 2023-12-20T04:49:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.377+0000 7facbfc32640 1 -- 172.21.15.132:0/1290942531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facb81611b0 msgr2=0x7facb81f6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.377+0000 7facbfc32640 1 --2- 172.21.15.132:0/1290942531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facb81611b0 0x7facb81f6060 secure :-1 s=READY pgs=1454 cs=0 l=1 rev1=1 crypto rx=0x7facb000c7f0 tx=0x7facb000ccb0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.377+0000 7facbfc32640 1 -- 172.21.15.132:0/1290942531 shutdown_connections 2023-12-20T04:49:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.377+0000 7facbfc32640 1 --2- 172.21.15.132:0/1290942531 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fac9c06a430 0x7fac9c06c8f0 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.377+0000 7facbfc32640 1 --2- 172.21.15.132:0/1290942531 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7facb81611b0 0x7facb81f6060 unknown :-1 s=CLOSED pgs=1454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.377+0000 7facbfc32640 1 --2- 172.21.15.132:0/1290942531 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7facb8160450 0x7facb81590f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.377+0000 7facbfc32640 1 --2- 172.21.15.132:0/1290942531 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7facb80b4ec0 0x7facb8155400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.377+0000 7facbfc32640 1 -- 172.21.15.132:0/1290942531 >> 172.21.15.132:0/1290942531 conn(0x7facb80cf980 msgr2=0x7facb80d3770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.377+0000 7facbfc32640 1 -- 172.21.15.132:0/1290942531 shutdown_connections 2023-12-20T04:49:21.379 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.377+0000 7facbfc32640 1 -- 172.21.15.132:0/1290942531 wait complete. 2023-12-20T04:49:21.390 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-20T04:49:21.390 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:49:21.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.488+0000 7f3017939640 1 Processor -- start 2023-12-20T04:49:21.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.489+0000 7f3017939640 1 -- start start 2023-12-20T04:49:21.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.489+0000 7f3017939640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f301015e530 0x7f301006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.489+0000 7f3017939640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f301006c240 0x7f301006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.489+0000 7f3017939640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30100ccf30 con 0x7f3010159b50 2023-12-20T04:49:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.489+0000 7f3017939640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f301006cc10 con 0x7f301006c240 2023-12-20T04:49:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.489+0000 7f3017939640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30100caa60 con 0x7f301015e530 2023-12-20T04:49:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.490+0000 7f3015ed6640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f301006c240 0x7f301006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.490+0000 7f3014ed4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f301015e530 0x7f301006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.490+0000 7f30156d5640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f3010159b50 0x7f30100c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:55168/0 (socket says 172.21.15.132:55168) 2023-12-20T04:49:21.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.490+0000 7f30156d5640 1 -- 172.21.15.132:0/222631054 learned_addr learned my addr 172.21.15.132:0/222631054 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:21.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.490+0000 7f3014ed4640 1 -- 172.21.15.132:0/222631054 >> v2:172.21.15.187:3300/0 conn(0x7f301006c240 msgr2=0x7f301006c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:21.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.490+0000 7f3014ed4640 1 --2- 172.21.15.132:0/222631054 >> v2:172.21.15.187:3300/0 conn(0x7f301006c240 0x7f301006c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.490+0000 7f3014ed4640 1 -- 172.21.15.132:0/222631054 >> v1:172.21.15.187:6789/0 conn(0x7f3010159b50 legacy=0x7f30100c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:21.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.490+0000 7f3014ed4640 1 -- 172.21.15.132:0/222631054 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30100ca1c0 con 0x7f301015e530 2023-12-20T04:49:21.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.490+0000 7f3015ed6640 1 --2- 172.21.15.132:0/222631054 >> v2:172.21.15.187:3300/0 conn(0x7f301006c240 0x7f301006c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:49:21.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.491+0000 7f3014ed4640 1 --2- 172.21.15.132:0/222631054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f301015e530 0x7f301006fd70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f30000097a0 tx=0x7f300002b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=53440ab86328ded7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:21.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.491+0000 7f3007fff640 1 -- 172.21.15.132:0/222631054 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000031830 con 0x7f301015e530 2023-12-20T04:49:21.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.491+0000 7f3007fff640 1 -- 172.21.15.132:0/222631054 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3000031990 con 0x7f301015e530 2023-12-20T04:49:21.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.491+0000 7f3007fff640 1 -- 172.21.15.132:0/222631054 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3000031d20 con 0x7f301015e530 2023-12-20T04:49:21.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.492+0000 7f3017939640 1 -- 172.21.15.132:0/222631054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f301015e530 msgr2=0x7f301006fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:21.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.492+0000 7f3017939640 1 --2- 172.21.15.132:0/222631054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f301015e530 0x7f301006fd70 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f30000097a0 tx=0x7f300002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.494 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.492+0000 7f3017939640 1 -- 172.21.15.132:0/222631054 shutdown_connections 2023-12-20T04:49:21.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.492+0000 7f3017939640 1 --2- 172.21.15.132:0/222631054 >> v2:172.21.15.187:3300/0 conn(0x7f301006c240 0x7f301006c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.492+0000 7f3017939640 1 --2- 172.21.15.132:0/222631054 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f301015e530 0x7f301006fd70 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.492+0000 7f3017939640 1 -- 172.21.15.132:0/222631054 >> 172.21.15.132:0/222631054 conn(0x7f30100ced10 msgr2=0x7f30100cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:21.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.492+0000 7f3017939640 1 -- 172.21.15.132:0/222631054 shutdown_connections 2023-12-20T04:49:21.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.492+0000 7f3017939640 1 -- 172.21.15.132:0/222631054 wait complete. 2023-12-20T04:49:21.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.493+0000 7f3017939640 1 Processor -- start 2023-12-20T04:49:21.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.493+0000 7f3017939640 1 -- start start 2023-12-20T04:49:21.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f3017939640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301006c240 0x7f3010151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f3017939640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3010159b50 0x7f30100c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f3017939640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f301015e530 0x7f3010157640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f3017939640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30101562a0 con 0x7f301006c240 2023-12-20T04:49:21.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f3017939640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3010151740 con 0x7f3010159b50 2023-12-20T04:49:21.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f3017939640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3010155990 con 0x7f301015e530 2023-12-20T04:49:21.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f30156d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301006c240 0x7f3010151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f30156d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301006c240 0x7f3010151200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50440/0 (socket says 172.21.15.132:50440) 2023-12-20T04:49:21.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f30156d5640 1 -- 172.21.15.132:0/3671800472 learned_addr learned my addr 172.21.15.132:0/3671800472 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:21.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f3015ed6640 1 --2- 172.21.15.132:0/3671800472 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f301015e530 0x7f3010157640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f3014ed4640 1 --2- 172.21.15.132:0/3671800472 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3010159b50 0x7f30100c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f30156d5640 1 -- 172.21.15.132:0/3671800472 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f301015e530 msgr2=0x7f3010157640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:21.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f30156d5640 1 --2- 172.21.15.132:0/3671800472 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f301015e530 0x7f3010157640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f30156d5640 1 -- 172.21.15.132:0/3671800472 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3010159b50 msgr2=0x7f30100c5d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:21.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f30156d5640 1 --2- 172.21.15.132:0/3671800472 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3010159b50 0x7f30100c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f30156d5640 1 -- 172.21.15.132:0/3671800472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f300c009400 con 0x7f301006c240 2023-12-20T04:49:21.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f3015ed6640 1 --2- 172.21.15.132:0/3671800472 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f301015e530 0x7f3010157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:21.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f30156d5640 1 --2- 172.21.15.132:0/3671800472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301006c240 0x7f3010151200 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f300800cba0 tx=0x7f300800a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:21.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f3005ffb640 1 -- 172.21.15.132:0/3671800472 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300800ad40 con 0x7f301006c240 2023-12-20T04:49:21.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f3005ffb640 1 -- 172.21.15.132:0/3671800472 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3008012400 con 0x7f301006c240 2023-12-20T04:49:21.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f3017939640 1 -- 172.21.15.132:0/3671800472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3000009400 con 0x7f301006c240 2023-12-20T04:49:21.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.494+0000 7f3005ffb640 1 -- 172.21.15.132:0/3671800472 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f300800aea0 con 0x7f301006c240 2023-12-20T04:49:21.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.495+0000 7f3017939640 1 -- 172.21.15.132:0/3671800472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3010155f30 con 0x7f301006c240 2023-12-20T04:49:21.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.496+0000 7f3017939640 1 -- 172.21.15.132:0/3671800472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f301004e840 con 0x7f301006c240 2023-12-20T04:49:21.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.496+0000 7f3005ffb640 1 -- 172.21.15.132:0/3671800472 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3008007070 con 0x7f301006c240 2023-12-20T04:49:21.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.496+0000 7f3005ffb640 1 --2- 172.21.15.132:0/3671800472 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ff406a430 0x7f2ff406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.496+0000 7f3005ffb640 1 -- 172.21.15.132:0/3671800472 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3008088810 con 0x7f301006c240 2023-12-20T04:49:21.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.496+0000 7f3014ed4640 1 --2- 172.21.15.132:0/3671800472 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ff406a430 0x7f2ff406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.497+0000 7f3005ffb640 1 -- 172.21.15.132:0/3671800472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=142}) v3 -- 0x7f2ff4071f60 con 0x7f301006c240 2023-12-20T04:49:21.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.497+0000 7f3014ed4640 1 --2- 172.21.15.132:0/3671800472 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ff406a430 0x7f2ff406c8f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3000036000 tx=0x7f300003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:21.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.501+0000 7f3005ffb640 1 -- 172.21.15.132:0/3671800472 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3008017020 con 0x7f301006c240 2023-12-20T04:49:21.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.701+0000 7f3017939640 1 -- 172.21.15.132:0/3671800472 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30100b4c90 con 0x7f301006c240 2023-12-20T04:49:21.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.702+0000 7f3005ffb640 1 -- 172.21.15.132:0/3671800472 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4723 (secure 0 0 0) 0x7f3008053eb0 con 0x7f301006c240 2023-12-20T04:49:21.704 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:21.704 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6763,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1413044191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1413044191},{"type":"v1","addr":"172.21.15.132:6837","nonce":1413044191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1584197959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1584197959},{"type":"v1","addr":"172.21.15.187:6834","nonce":1584197959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":7830,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/3080885824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3080885824},{"type":"v1","addr":"172.21.15.132:6836","nonce":3080885824}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:48:37.200402+0000","modified":"2023-12-20T04:48:39.207037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"d","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/1483131498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":1483131498},{"type":"v1","addr":"172.21.15.187:6835","nonce":1483131498}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-20T04:49:21.704 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 51 2023-12-20T04:49:21.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.704+0000 7f3017939640 1 -- 172.21.15.132:0/3671800472 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ff406a430 msgr2=0x7f2ff406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:21.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.704+0000 7f3017939640 1 --2- 172.21.15.132:0/3671800472 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ff406a430 0x7f2ff406c8f0 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f3000036000 tx=0x7f300003c040 comp rx=0 tx=0).stop 2023-12-20T04:49:21.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.704+0000 7f3017939640 1 -- 172.21.15.132:0/3671800472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301006c240 msgr2=0x7f3010151200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:21.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.704+0000 7f3017939640 1 --2- 172.21.15.132:0/3671800472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301006c240 0x7f3010151200 secure :-1 s=READY pgs=1455 cs=0 l=1 rev1=1 crypto rx=0x7f300800cba0 tx=0x7f300800a430 comp rx=0 tx=0).stop 2023-12-20T04:49:21.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.704+0000 7f3017939640 1 -- 172.21.15.132:0/3671800472 shutdown_connections 2023-12-20T04:49:21.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.704+0000 7f3017939640 1 --2- 172.21.15.132:0/3671800472 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2ff406a430 0x7f2ff406c8f0 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.704+0000 7f3017939640 1 --2- 172.21.15.132:0/3671800472 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f301015e530 0x7f3010157640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.704+0000 7f3017939640 1 --2- 172.21.15.132:0/3671800472 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3010159b50 0x7f30100c5d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.704+0000 7f3017939640 1 --2- 172.21.15.132:0/3671800472 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f301006c240 0x7f3010151200 unknown :-1 s=CLOSED pgs=1455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.704+0000 7f3017939640 1 -- 172.21.15.132:0/3671800472 >> 172.21.15.132:0/3671800472 conn(0x7f30100ced10 msgr2=0x7f301006b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:21.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.704+0000 7f3017939640 1 -- 172.21.15.132:0/3671800472 shutdown_connections 2023-12-20T04:49:21.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.704+0000 7f3017939640 1 -- 172.21.15.132:0/3671800472 wait complete. 2023-12-20T04:49:21.717 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:49:21.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.814+0000 7efceadd2640 1 Processor -- start 2023-12-20T04:49:21.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.814+0000 7efceadd2640 1 -- start start 2023-12-20T04:49:21.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.815+0000 7efceadd2640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7efce40d0370 0x7efce40b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.815+0000 7efceadd2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efce40cdc10 0x7efce406c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.815+0000 7efceadd2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efce40b2f90 con 0x7efce415d100 2023-12-20T04:49:21.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.815+0000 7efceadd2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce41613c0 con 0x7efce40cdc10 2023-12-20T04:49:21.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.815+0000 7efceadd2640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efce40d1b00 con 0x7efce40d0370 2023-12-20T04:49:21.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.815+0000 7efce936f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efce40cdc10 0x7efce406c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.815+0000 7efce8b6e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7efce415d100 0x7efce40cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40020/0 (socket says 172.21.15.132:40020) 2023-12-20T04:49:21.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.815+0000 7efce936f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efce40cdc10 0x7efce406c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50444/0 (socket says 172.21.15.132:50444) 2023-12-20T04:49:21.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.815+0000 7efce8b6e640 1 -- 172.21.15.132:0/809901803 learned_addr learned my addr 172.21.15.132:0/809901803 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:21.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.815+0000 7efce3fff640 1 --2- 172.21.15.132:0/809901803 >> v2:172.21.15.187:3300/0 conn(0x7efce40d0370 0x7efce40b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.815+0000 7efce936f640 1 -- 172.21.15.132:0/809901803 >> v2:172.21.15.187:3300/0 conn(0x7efce40d0370 msgr2=0x7efce40b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:21.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.815+0000 7efce936f640 1 --2- 172.21.15.132:0/809901803 >> v2:172.21.15.187:3300/0 conn(0x7efce40d0370 0x7efce40b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.815+0000 7efce936f640 1 -- 172.21.15.132:0/809901803 >> v1:172.21.15.132:6789/0 conn(0x7efce415d100 legacy=0x7efce40cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:21.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.815+0000 7efce936f640 1 -- 172.21.15.132:0/809901803 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efce40d0810 con 0x7efce40cdc10 2023-12-20T04:49:21.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.815+0000 7efce37fe640 1 -- 172.21.15.132:0/809901803 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2368939342 0 0) 0x7efcd8001110 con 0x7efce415d100 2023-12-20T04:49:21.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.815+0000 7efce3fff640 1 --2- 172.21.15.132:0/809901803 >> v2:172.21.15.187:3300/0 conn(0x7efce40d0370 0x7efce40b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:21.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.816+0000 7efce936f640 1 --2- 172.21.15.132:0/809901803 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce40cdc10 0x7efce406c190 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7efce406d6c0 tx=0x7efcdc02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac35f8d8e5f3b790 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:21.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.816+0000 7efce37fe640 1 -- 172.21.15.132:0/809901803 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc02cc80 con 0x7efce40cdc10 2023-12-20T04:49:21.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.816+0000 7efce37fe640 1 -- 172.21.15.132:0/809901803 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcdc02cde0 con 0x7efce40cdc10 2023-12-20T04:49:21.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.816+0000 7efce37fe640 1 -- 172.21.15.132:0/809901803 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcdc034660 con 0x7efce40cdc10 2023-12-20T04:49:21.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.817+0000 7efceadd2640 1 -- 172.21.15.132:0/809901803 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce40cdc10 msgr2=0x7efce406c190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:21.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.817+0000 7efceadd2640 1 --2- 172.21.15.132:0/809901803 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce40cdc10 0x7efce406c190 secure :-1 s=READY pgs=1457 cs=0 l=1 rev1=1 crypto rx=0x7efce406d6c0 tx=0x7efcdc02bed0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.817+0000 7efceadd2640 1 -- 172.21.15.132:0/809901803 shutdown_connections 2023-12-20T04:49:21.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.817+0000 7efceadd2640 1 --2- 172.21.15.132:0/809901803 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce40cdc10 0x7efce406c190 unknown :-1 s=CLOSED pgs=1457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.817+0000 7efceadd2640 1 --2- 172.21.15.132:0/809901803 >> v2:172.21.15.187:3300/0 conn(0x7efce40d0370 0x7efce40b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.817+0000 7efceadd2640 1 -- 172.21.15.132:0/809901803 >> 172.21.15.132:0/809901803 conn(0x7efce406d7c0 msgr2=0x7efce406dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:21.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.817+0000 7efceadd2640 1 -- 172.21.15.132:0/809901803 shutdown_connections 2023-12-20T04:49:21.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.817+0000 7efceadd2640 1 -- 172.21.15.132:0/809901803 wait complete. 2023-12-20T04:49:21.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.818+0000 7efceadd2640 1 Processor -- start 2023-12-20T04:49:21.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.818+0000 7efceadd2640 1 -- start start 2023-12-20T04:49:21.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efceadd2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efce40cdc10 0x7efce40c88e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efceadd2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce40d0370 0x7efce40b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efceadd2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efce415d100 0x7efce40b4280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efceadd2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce40b6970 con 0x7efce40d0370 2023-12-20T04:49:21.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efceadd2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efce40c9330 con 0x7efce415d100 2023-12-20T04:49:21.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efceadd2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efce40b63b0 con 0x7efce40cdc10 2023-12-20T04:49:21.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efce3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce40d0370 0x7efce40b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efce3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce40d0370 0x7efce40b3d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50454/0 (socket says 172.21.15.132:50454) 2023-12-20T04:49:21.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efce3fff640 1 -- 172.21.15.132:0/2675979604 learned_addr learned my addr 172.21.15.132:0/2675979604 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:21.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efce8b6e640 1 --2- 172.21.15.132:0/2675979604 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efce40cdc10 0x7efce40c88e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efce936f640 1 --2- 172.21.15.132:0/2675979604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efce415d100 0x7efce40b4280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efce3fff640 1 -- 172.21.15.132:0/2675979604 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efce40cdc10 msgr2=0x7efce40c88e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:21.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efce3fff640 1 --2- 172.21.15.132:0/2675979604 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efce40cdc10 0x7efce40c88e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efce3fff640 1 -- 172.21.15.132:0/2675979604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efce415d100 msgr2=0x7efce40b4280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:21.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efce3fff640 1 --2- 172.21.15.132:0/2675979604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efce415d100 0x7efce40b4280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:21.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efce3fff640 1 -- 172.21.15.132:0/2675979604 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcdc009a70 con 0x7efce40d0370 2023-12-20T04:49:21.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efce3fff640 1 --2- 172.21.15.132:0/2675979604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce40d0370 0x7efce40b3d40 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7efcd000e7e0 tx=0x7efcd000eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:21.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efce17fa640 1 -- 172.21.15.132:0/2675979604 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd0004030 con 0x7efce40d0370 2023-12-20T04:49:21.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efce17fa640 1 -- 172.21.15.132:0/2675979604 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efcd0004190 con 0x7efce40d0370 2023-12-20T04:49:21.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efceadd2640 1 -- 172.21.15.132:0/2675979604 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efce40b6690 con 0x7efce40d0370 2023-12-20T04:49:21.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efce17fa640 1 -- 172.21.15.132:0/2675979604 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efcd0004520 con 0x7efce40d0370 2023-12-20T04:49:21.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.819+0000 7efceadd2640 1 -- 172.21.15.132:0/2675979604 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efce40c8e20 con 0x7efce40d0370 2023-12-20T04:49:21.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.820+0000 7efceadd2640 1 -- 172.21.15.132:0/2675979604 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efce40c9040 con 0x7efce40d0370 2023-12-20T04:49:21.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.821+0000 7efce17fa640 1 -- 172.21.15.132:0/2675979604 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efcd000c6d0 con 0x7efce40d0370 2023-12-20T04:49:21.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.821+0000 7efce17fa640 1 --2- 172.21.15.132:0/2675979604 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efcc806a460 0x7efcc806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:21.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.821+0000 7efce8b6e640 1 --2- 172.21.15.132:0/2675979604 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efcc806a460 0x7efcc806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:21.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.821+0000 7efce17fa640 1 -- 172.21.15.132:0/2675979604 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efcd0088510 con 0x7efce40d0370 2023-12-20T04:49:21.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.822+0000 7efce17fa640 1 -- 172.21.15.132:0/2675979604 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=142}) v3 -- 0x7efcc8071f90 con 0x7efce40d0370 2023-12-20T04:49:21.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.822+0000 7efce8b6e640 1 --2- 172.21.15.132:0/2675979604 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efcc806a460 0x7efcc806c920 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7efcd8000f60 tx=0x7efcd8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:21.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:21.826+0000 7efce17fa640 1 -- 172.21.15.132:0/2675979604 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7efcd0086e60 con 0x7efce40d0370 2023-12-20T04:49:22.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.028+0000 7efceadd2640 1 -- 172.21.15.132:0/2675979604 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7efce404e840 con 0x7efce40d0370 2023-12-20T04:49:22.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.028+0000 7efce17fa640 1 -- 172.21.15.132:0/2675979604 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 51 v51) v1 ==== 94+0+4723 (secure 0 0 0) 0x7efcd0020090 con 0x7efce40d0370 2023-12-20T04:49:22.031 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:22.031 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":51,"default_fscid":8,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6763,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1413044191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1413044191},{"type":"v1","addr":"172.21.15.132:6837","nonce":1413044191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1584197959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1584197959},{"type":"v1","addr":"172.21.15.187:6834","nonce":1584197959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":7830,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/3080885824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3080885824},{"type":"v1","addr":"172.21.15.132:6836","nonce":3080885824}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[{"mdsmap":{"epoch":51,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:48:37.200402+0000","modified":"2023-12-20T04:48:39.207037+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":7845},"failed":[],"damaged":[],"stopped":[],"info":{"gid_7845":{"gid":7845,"name":"d","rank":0,"incarnation":49,"state":"up:active","state_seq":3,"addr":"172.21.15.187:6835/1483131498","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":1483131498},{"type":"v1","addr":"172.21.15.187:6835","nonce":1483131498}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[17],"metadata_pool":16,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":8}]} 2023-12-20T04:49:22.031 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 51 2023-12-20T04:49:22.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.031+0000 7efceadd2640 1 -- 172.21.15.132:0/2675979604 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efcc806a460 msgr2=0x7efcc806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.031+0000 7efceadd2640 1 --2- 172.21.15.132:0/2675979604 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efcc806a460 0x7efcc806c920 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7efcd8000f60 tx=0x7efcd8009040 comp rx=0 tx=0).stop 2023-12-20T04:49:22.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.031+0000 7efceadd2640 1 -- 172.21.15.132:0/2675979604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce40d0370 msgr2=0x7efce40b3d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.031+0000 7efceadd2640 1 --2- 172.21.15.132:0/2675979604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce40d0370 0x7efce40b3d40 secure :-1 s=READY pgs=1458 cs=0 l=1 rev1=1 crypto rx=0x7efcd000e7e0 tx=0x7efcd000eca0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.031+0000 7efceadd2640 1 -- 172.21.15.132:0/2675979604 shutdown_connections 2023-12-20T04:49:22.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.031+0000 7efceadd2640 1 --2- 172.21.15.132:0/2675979604 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efcc806a460 0x7efcc806c920 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.031+0000 7efceadd2640 1 --2- 172.21.15.132:0/2675979604 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efce415d100 0x7efce40b4280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.031+0000 7efceadd2640 1 --2- 172.21.15.132:0/2675979604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efce40d0370 0x7efce40b3d40 unknown :-1 s=CLOSED pgs=1458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.031+0000 7efceadd2640 1 --2- 172.21.15.132:0/2675979604 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efce40cdc10 0x7efce40c88e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.031+0000 7efceadd2640 1 -- 172.21.15.132:0/2675979604 >> 172.21.15.132:0/2675979604 conn(0x7efce406d7c0 msgr2=0x7efce40cb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:22.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.031+0000 7efceadd2640 1 -- 172.21.15.132:0/2675979604 shutdown_connections 2023-12-20T04:49:22.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.031+0000 7efceadd2640 1 -- 172.21.15.132:0/2675979604 wait complete. 2023-12-20T04:49:22.044 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:49:22.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.141+0000 7fcaa6cdb640 1 Processor -- start 2023-12-20T04:49:22.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.141+0000 7fcaa6cdb640 1 -- start start 2023-12-20T04:49:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.142+0000 7fcaa6cdb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcaa00cba90 0x7fcaa00cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.142+0000 7fcaa6cdb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcaa00ce2a0 0x7fcaa00cf540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.142+0000 7fcaa6cdb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcaa0161ff0 con 0x7fcaa0160ba0 2023-12-20T04:49:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.142+0000 7fcaa6cdb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa00cca40 con 0x7fcaa00cba90 2023-12-20T04:49:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.142+0000 7fcaa6cdb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcaa01613e0 con 0x7fcaa00ce2a0 2023-12-20T04:49:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.142+0000 7fca9ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcaa00cba90 0x7fcaa00cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.142+0000 7fca9ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcaa00cba90 0x7fcaa00cf000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50460/0 (socket says 172.21.15.132:50460) 2023-12-20T04:49:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.142+0000 7fca9ffff640 1 -- 172.21.15.132:0/3653414636 learned_addr learned my addr 172.21.15.132:0/3653414636 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.143+0000 7fca9ffff640 1 -- 172.21.15.132:0/3653414636 >> v2:172.21.15.187:3300/0 conn(0x7fcaa00ce2a0 msgr2=0x7fcaa00cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:22.146 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.143+0000 7fcaa5278640 1 --2- 172.21.15.132:0/3653414636 >> v2:172.21.15.187:3300/0 conn(0x7fcaa00ce2a0 0x7fcaa00cf540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.143+0000 7fca9ffff640 1 --2- 172.21.15.132:0/3653414636 >> v2:172.21.15.187:3300/0 conn(0x7fcaa00ce2a0 0x7fcaa00cf540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.143+0000 7fca9ffff640 1 -- 172.21.15.132:0/3653414636 >> v1:172.21.15.187:6789/0 conn(0x7fcaa0160ba0 legacy=0x7fcaa00cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.143+0000 7fca9ffff640 1 -- 172.21.15.132:0/3653414636 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcaa01616c0 con 0x7fcaa00cba90 2023-12-20T04:49:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.143+0000 7fcaa5278640 1 --2- 172.21.15.132:0/3653414636 >> v2:172.21.15.187:3300/0 conn(0x7fcaa00ce2a0 0x7fcaa00cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.143+0000 7fca9ffff640 1 --2- 172.21.15.132:0/3653414636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcaa00cba90 0x7fcaa00cf000 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fcaa00afaa0 tx=0x7fca8c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ad077bf1589926fc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.143+0000 7fca9f7fe640 1 -- 172.21.15.132:0/3653414636 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c0317e0 con 0x7fcaa00cba90 2023-12-20T04:49:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.143+0000 7fca9f7fe640 1 -- 172.21.15.132:0/3653414636 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca8c031940 con 0x7fcaa00cba90 2023-12-20T04:49:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.143+0000 7fca9f7fe640 1 -- 172.21.15.132:0/3653414636 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca8c031cd0 con 0x7fcaa00cba90 2023-12-20T04:49:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.144+0000 7fcaa6cdb640 1 -- 172.21.15.132:0/3653414636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcaa00cba90 msgr2=0x7fcaa00cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.144+0000 7fcaa6cdb640 1 --2- 172.21.15.132:0/3653414636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcaa00cba90 0x7fcaa00cf000 secure :-1 s=READY pgs=1459 cs=0 l=1 rev1=1 crypto rx=0x7fcaa00afaa0 tx=0x7fca8c02b880 comp rx=0 tx=0).stop 2023-12-20T04:49:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.144+0000 7fcaa6cdb640 1 -- 172.21.15.132:0/3653414636 shutdown_connections 2023-12-20T04:49:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.144+0000 7fcaa6cdb640 1 --2- 172.21.15.132:0/3653414636 >> v2:172.21.15.187:3300/0 conn(0x7fcaa00ce2a0 0x7fcaa00cf540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.144+0000 7fcaa6cdb640 1 --2- 172.21.15.132:0/3653414636 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcaa00cba90 0x7fcaa00cf000 unknown :-1 s=CLOSED pgs=1459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.144+0000 7fcaa6cdb640 1 -- 172.21.15.132:0/3653414636 >> 172.21.15.132:0/3653414636 conn(0x7fcaa00cd7b0 msgr2=0x7fcaa00cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:22.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.144+0000 7fcaa6cdb640 1 -- 172.21.15.132:0/3653414636 shutdown_connections 2023-12-20T04:49:22.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.144+0000 7fcaa6cdb640 1 -- 172.21.15.132:0/3653414636 wait complete. 2023-12-20T04:49:22.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.145+0000 7fcaa6cdb640 1 Processor -- start 2023-12-20T04:49:22.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.145+0000 7fcaa6cdb640 1 -- start start 2023-12-20T04:49:22.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.146+0000 7fcaa6cdb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcaa00cba90 0x7fcaa00af4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.146+0000 7fcaa6cdb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa00ce2a0 0x7fcaa0150d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.146+0000 7fcaa6cdb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa0160ba0 0x7fcaa00b0290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.146+0000 7fcaa6cdb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00d0cc0 con 0x7fcaa00cba90 2023-12-20T04:49:22.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.146+0000 7fcaa6cdb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa00b4680 con 0x7fcaa00ce2a0 2023-12-20T04:49:22.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.146+0000 7fcaa6cdb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcaa01f2950 con 0x7fcaa0160ba0 2023-12-20T04:49:22.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.146+0000 7fcaa4a77640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcaa00cba90 0x7fcaa00af4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:22.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.146+0000 7fcaa4a77640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcaa00cba90 0x7fcaa00af4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50476/0 (socket says 172.21.15.132:50476) 2023-12-20T04:49:22.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.146+0000 7fcaa4a77640 1 -- 172.21.15.132:0/2318350712 learned_addr learned my addr 172.21.15.132:0/2318350712 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:22.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.146+0000 7fcaa5278640 1 --2- 172.21.15.132:0/2318350712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa0160ba0 0x7fcaa00b0290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:22.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.146+0000 7fca9ffff640 1 --2- 172.21.15.132:0/2318350712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa00ce2a0 0x7fcaa0150d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:22.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.146+0000 7fcaa4a77640 1 -- 172.21.15.132:0/2318350712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa0160ba0 msgr2=0x7fcaa00b0290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.146+0000 7fcaa4a77640 1 --2- 172.21.15.132:0/2318350712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa0160ba0 0x7fcaa00b0290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.146+0000 7fcaa4a77640 1 -- 172.21.15.132:0/2318350712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa00ce2a0 msgr2=0x7fcaa0150d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.146+0000 7fcaa4a77640 1 --2- 172.21.15.132:0/2318350712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa00ce2a0 0x7fcaa0150d80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.147+0000 7fcaa4a77640 1 -- 172.21.15.132:0/2318350712 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca8c0094d0 con 0x7fcaa00cba90 2023-12-20T04:49:22.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.147+0000 7fca9ffff640 1 --2- 172.21.15.132:0/2318350712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa00ce2a0 0x7fcaa0150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:22.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.147+0000 7fcaa4a77640 1 --2- 172.21.15.132:0/2318350712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcaa00cba90 0x7fcaa00af4c0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fca9400b3f0 tx=0x7fca9400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:22.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.147+0000 7fca9d7fa640 1 -- 172.21.15.132:0/2318350712 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca94011830 con 0x7fcaa00cba90 2023-12-20T04:49:22.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.147+0000 7fca9d7fa640 1 -- 172.21.15.132:0/2318350712 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fca94011990 con 0x7fcaa00cba90 2023-12-20T04:49:22.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.147+0000 7fcaa6cdb640 1 -- 172.21.15.132:0/2318350712 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcaa00b48d0 con 0x7fcaa00cba90 2023-12-20T04:49:22.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.147+0000 7fca9d7fa640 1 -- 172.21.15.132:0/2318350712 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fca94011d40 con 0x7fcaa00cba90 2023-12-20T04:49:22.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.147+0000 7fcaa6cdb640 1 -- 172.21.15.132:0/2318350712 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcaa00b07d0 con 0x7fcaa00cba90 2023-12-20T04:49:22.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.148+0000 7fcaa6cdb640 1 -- 172.21.15.132:0/2318350712 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcaa00b4df0 con 0x7fcaa00cba90 2023-12-20T04:49:22.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.148+0000 7fca9d7fa640 1 -- 172.21.15.132:0/2318350712 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fca9401a400 con 0x7fcaa00cba90 2023-12-20T04:49:22.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.149+0000 7fca9d7fa640 1 --2- 172.21.15.132:0/2318350712 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca8406a460 0x7fca8406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.149+0000 7fca9ffff640 1 --2- 172.21.15.132:0/2318350712 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca8406a460 0x7fca8406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:22.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.149+0000 7fca9d7fa640 1 -- 172.21.15.132:0/2318350712 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fca94088770 con 0x7fcaa00cba90 2023-12-20T04:49:22.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.149+0000 7fca9d7fa640 1 -- 172.21.15.132:0/2318350712 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=142}) v3 -- 0x7fca84071f90 con 0x7fcaa00cba90 2023-12-20T04:49:22.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.149+0000 7fca9ffff640 1 --2- 172.21.15.132:0/2318350712 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca8406a460 0x7fca8406c920 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fca8c036000 tx=0x7fca8c03d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:22.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.153+0000 7fca9d7fa640 1 -- 172.21.15.132:0/2318350712 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fca94015060 con 0x7fcaa00cba90 2023-12-20T04:49:22.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.319+0000 7fcaa6cdb640 1 -- 172.21.15.132:0/2318350712 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcaa00d0a10 con 0x7fcaa00cba90 2023-12-20T04:49:22.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.320+0000 7fca9d7fa640 1 -- 172.21.15.132:0/2318350712 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v141) v1 ==== 74+0+16134 (secure 0 0 0) 0x7fca94053d60 con 0x7fcaa00cba90 2023-12-20T04:49:22.322 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:22.322 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":141,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:49:19.858214+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":16,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:48:35.008751+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"136","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":17,"pool_name":"cephfs_data","create_time":"2023-12-20T04:48:36.182609+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"141","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:49:22.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.322+0000 7fcaa6cdb640 1 -- 172.21.15.132:0/2318350712 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca8406a460 msgr2=0x7fca8406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.322+0000 7fcaa6cdb640 1 --2- 172.21.15.132:0/2318350712 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca8406a460 0x7fca8406c920 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7fca8c036000 tx=0x7fca8c03d040 comp rx=0 tx=0).stop 2023-12-20T04:49:22.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.322+0000 7fcaa6cdb640 1 -- 172.21.15.132:0/2318350712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcaa00cba90 msgr2=0x7fcaa00af4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.322+0000 7fcaa6cdb640 1 --2- 172.21.15.132:0/2318350712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcaa00cba90 0x7fcaa00af4c0 secure :-1 s=READY pgs=1460 cs=0 l=1 rev1=1 crypto rx=0x7fca9400b3f0 tx=0x7fca9400b8b0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.322+0000 7fcaa6cdb640 1 -- 172.21.15.132:0/2318350712 shutdown_connections 2023-12-20T04:49:22.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.322+0000 7fcaa6cdb640 1 --2- 172.21.15.132:0/2318350712 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fca8406a460 0x7fca8406c920 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.322+0000 7fcaa6cdb640 1 --2- 172.21.15.132:0/2318350712 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcaa0160ba0 0x7fcaa00b0290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.322+0000 7fcaa6cdb640 1 --2- 172.21.15.132:0/2318350712 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcaa00ce2a0 0x7fcaa0150d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.322+0000 7fcaa6cdb640 1 --2- 172.21.15.132:0/2318350712 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcaa00cba90 0x7fcaa00af4c0 unknown :-1 s=CLOSED pgs=1460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.322+0000 7fcaa6cdb640 1 -- 172.21.15.132:0/2318350712 >> 172.21.15.132:0/2318350712 conn(0x7fcaa00cd7b0 msgr2=0x7fcaa0158b60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:22.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.322+0000 7fcaa6cdb640 1 -- 172.21.15.132:0/2318350712 shutdown_connections 2023-12-20T04:49:22.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.322+0000 7fcaa6cdb640 1 -- 172.21.15.132:0/2318350712 wait complete. 2023-12-20T04:49:22.336 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-20T04:49:22.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.434+0000 7f6a87ccf640 1 Processor -- start 2023-12-20T04:49:22.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.435+0000 7f6a87ccf640 1 -- start start 2023-12-20T04:49:22.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.435+0000 7f6a87ccf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8015d2c0 0x7f6a800cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.435+0000 7f6a87ccf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a800d0cf0 con 0x7f6a800d30a0 2023-12-20T04:49:22.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.435+0000 7f6a87ccf640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6a800d0550 con 0x7f6a800d0060 2023-12-20T04:49:22.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.435+0000 7f6a87ccf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800cddc0 con 0x7f6a8015d2c0 2023-12-20T04:49:22.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.435+0000 7f6a85a6b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6a800d30a0 0x7f6a800d3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40022/0 (socket says 172.21.15.132:40022) 2023-12-20T04:49:22.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.435+0000 7f6a85a6b640 1 -- 172.21.15.132:0/1743087724 learned_addr learned my addr 172.21.15.132:0/1743087724 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:22.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a84a69640 1 -- 172.21.15.132:0/1743087724 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1182811389 0 0) 0x7f6a800d0cf0 con 0x7f6a800d30a0 2023-12-20T04:49:22.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a8526a640 1 --2- 172.21.15.132:0/1743087724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8015d2c0 0x7f6a800cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:22.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a84a69640 1 -- 172.21.15.132:0/1743087724 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6a6c003520 con 0x7f6a800d30a0 2023-12-20T04:49:22.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a84a69640 1 -- 172.21.15.132:0/1743087724 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1060854888 0 0) 0x7f6a6c003520 con 0x7f6a800d30a0 2023-12-20T04:49:22.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a84a69640 1 -- 172.21.15.132:0/1743087724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8015d2c0 msgr2=0x7f6a800cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:22.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a84a69640 1 --2- 172.21.15.132:0/1743087724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8015d2c0 0x7f6a800cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a84a69640 1 -- 172.21.15.132:0/1743087724 >> v1:172.21.15.187:6789/0 conn(0x7f6a800d0060 legacy=0x7f6a800d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a84a69640 1 -- 172.21.15.132:0/1743087724 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a800ce0a0 con 0x7f6a800d30a0 2023-12-20T04:49:22.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a84a69640 1 -- 172.21.15.132:0/1743087724 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f6a7c0019f0 con 0x7f6a800d30a0 2023-12-20T04:49:22.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a84a69640 1 -- 172.21.15.132:0/1743087724 >> v1:172.21.15.132:6789/0 conn(0x7f6a800d30a0 legacy=0x7f6a800d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a84a69640 1 --2- 172.21.15.132:0/1743087724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8015d2c0 0x7f6a6c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a84a69640 1 --2- 172.21.15.132:0/1743087724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a6c003f20 0x7f6a6c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a84a69640 1 --2- 172.21.15.132:0/1743087724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c004d00 0x7f6a6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a84a69640 1 -- 172.21.15.132:0/1743087724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800cddc0 con 0x7f6a6c004d00 2023-12-20T04:49:22.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a84a69640 1 -- 172.21.15.132:0/1743087724 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c00ba60 con 0x7f6a6c003f20 2023-12-20T04:49:22.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a84a69640 1 -- 172.21.15.132:0/1743087724 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a6c00bc20 con 0x7f6a8015d2c0 2023-12-20T04:49:22.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a8626c640 1 --2- 172.21.15.132:0/1743087724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c004d00 0x7f6a6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:22.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a85a6b640 1 --2- 172.21.15.132:0/1743087724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8015d2c0 0x7f6a6c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:22.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a8526a640 1 --2- 172.21.15.132:0/1743087724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a6c003f20 0x7f6a6c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:22.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a8626c640 1 -- 172.21.15.132:0/1743087724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8015d2c0 msgr2=0x7f6a6c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:22.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a8626c640 1 --2- 172.21.15.132:0/1743087724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a8015d2c0 0x7f6a6c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a8626c640 1 -- 172.21.15.132:0/1743087724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a6c003f20 msgr2=0x7f6a6c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:22.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a8626c640 1 --2- 172.21.15.132:0/1743087724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a6c003f20 0x7f6a6c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.436+0000 7f6a8626c640 1 -- 172.21.15.132:0/1743087724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a6c003520 con 0x7f6a6c004d00 2023-12-20T04:49:22.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.437+0000 7f6a8626c640 1 --2- 172.21.15.132:0/1743087724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c004d00 0x7f6a6c005180 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f6a78001750 tx=0x7f6a6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96967d178985954d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:22.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.437+0000 7f6a84a69640 1 -- 172.21.15.132:0/1743087724 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a780052d0 con 0x7f6a6c004d00 2023-12-20T04:49:22.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.437+0000 7f6a84a69640 1 -- 172.21.15.132:0/1743087724 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7802e050 con 0x7f6a6c004d00 2023-12-20T04:49:22.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.437+0000 7f6a84a69640 1 -- 172.21.15.132:0/1743087724 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a78003830 con 0x7f6a6c004d00 2023-12-20T04:49:22.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.438+0000 7f6a87ccf640 1 -- 172.21.15.132:0/1743087724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c004d00 msgr2=0x7f6a6c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.438+0000 7f6a87ccf640 1 --2- 172.21.15.132:0/1743087724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c004d00 0x7f6a6c005180 secure :-1 s=READY pgs=1462 cs=0 l=1 rev1=1 crypto rx=0x7f6a78001750 tx=0x7f6a6c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.438+0000 7f6a8626c640 1 -- 172.21.15.132:0/1743087724 reap_dead start 2023-12-20T04:49:22.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.438+0000 7f6a87ccf640 1 -- 172.21.15.132:0/1743087724 shutdown_connections 2023-12-20T04:49:22.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.438+0000 7f6a87ccf640 1 -- 172.21.15.132:0/1743087724 >> 172.21.15.132:0/1743087724 conn(0x7f6a80072e40 msgr2=0x7f6a80073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:22.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.438+0000 7f6a87ccf640 1 -- 172.21.15.132:0/1743087724 shutdown_connections 2023-12-20T04:49:22.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.438+0000 7f6a87ccf640 1 -- 172.21.15.132:0/1743087724 wait complete. 2023-12-20T04:49:22.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.439+0000 7f6a87ccf640 1 Processor -- start 2023-12-20T04:49:22.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.439+0000 7f6a87ccf640 1 -- start start 2023-12-20T04:49:22.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a87ccf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c004d00 0x7f6a8015ee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a87ccf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a80158470 0x7f6a800c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a87ccf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8015de00 0x7f6a8015e280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a87ccf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a8015e7c0 con 0x7f6a6c004d00 2023-12-20T04:49:22.445 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a87ccf640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a801588f0 con 0x7f6a8015de00 2023-12-20T04:49:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a87ccf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6a800c9f60 con 0x7f6a80158470 2023-12-20T04:49:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a85a6b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c004d00 0x7f6a8015ee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a85a6b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c004d00 0x7f6a8015ee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50494/0 (socket says 172.21.15.132:50494) 2023-12-20T04:49:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a85a6b640 1 -- 172.21.15.132:0/184559634 learned_addr learned my addr 172.21.15.132:0/184559634 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a85a6b640 1 -- 172.21.15.132:0/184559634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a80158470 msgr2=0x7f6a800c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a85a6b640 1 --2- 172.21.15.132:0/184559634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a80158470 0x7f6a800c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a85a6b640 1 -- 172.21.15.132:0/184559634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8015de00 msgr2=0x7f6a8015e280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a85a6b640 1 --2- 172.21.15.132:0/184559634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8015de00 0x7f6a8015e280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a85a6b640 1 -- 172.21.15.132:0/184559634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a800c8b20 con 0x7f6a6c004d00 2023-12-20T04:49:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a85a6b640 1 --2- 172.21.15.132:0/184559634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c004d00 0x7f6a8015ee40 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c007950 tx=0x7f6a7c00a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a767fc640 1 -- 172.21.15.132:0/184559634 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c007b00 con 0x7f6a6c004d00 2023-12-20T04:49:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a767fc640 1 -- 172.21.15.132:0/184559634 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6a7c0133f0 con 0x7f6a6c004d00 2023-12-20T04:49:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a87ccf640 1 -- 172.21.15.132:0/184559634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a800c8e00 con 0x7f6a6c004d00 2023-12-20T04:49:22.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a767fc640 1 -- 172.21.15.132:0/184559634 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6a7c0137a0 con 0x7f6a6c004d00 2023-12-20T04:49:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.440+0000 7f6a87ccf640 1 -- 172.21.15.132:0/184559634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a800c93c0 con 0x7f6a6c004d00 2023-12-20T04:49:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.441+0000 7f6a87ccf640 1 -- 172.21.15.132:0/184559634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a8004e840 con 0x7f6a6c004d00 2023-12-20T04:49:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.442+0000 7f6a767fc640 1 -- 172.21.15.132:0/184559634 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6a7c013900 con 0x7f6a6c004d00 2023-12-20T04:49:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.442+0000 7f6a767fc640 1 --2- 172.21.15.132:0/184559634 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6a6406a460 0x7f6a6406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.442+0000 7f6a767fc640 1 -- 172.21.15.132:0/184559634 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(141..141 src has 1..141) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6a7c089300 con 0x7f6a6c004d00 2023-12-20T04:49:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.442+0000 7f6a8526a640 1 --2- 172.21.15.132:0/184559634 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6a6406a460 0x7f6a6406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.442+0000 7f6a767fc640 1 -- 172.21.15.132:0/184559634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=142}) v3 -- 0x7f6a64071f90 con 0x7f6a6c004d00 2023-12-20T04:49:22.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.443+0000 7f6a8526a640 1 --2- 172.21.15.132:0/184559634 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6a6406a460 0x7f6a6406c920 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6a800ccd20 tx=0x7f6a700095d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:22.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.446+0000 7f6a767fc640 1 -- 172.21.15.132:0/184559634 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6a7c0548f0 con 0x7f6a6c004d00 2023-12-20T04:49:22.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.646+0000 7f6a87ccf640 1 -- 172.21.15.132:0/184559634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f6a800b7fd0 con 0x7f6a6c004d00 2023-12-20T04:49:22.648 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:49:22.647+0000 7f1a5cbbd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-20T04:49:22.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.648+0000 7f6a767fc640 1 -- 172.21.15.132:0/184559634 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(142..142 src has 1..142) v4 ==== 374+0+0 (secure 0 0 0) 0x7f6a7c0585b0 con 0x7f6a6c004d00 2023-12-20T04:49:22.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.648+0000 7f6a767fc640 1 -- 172.21.15.132:0/184559634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=143}) v3 -- 0x7f6a64072840 con 0x7f6a6c004d00 2023-12-20T04:49:22.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.655+0000 7f6a767fc640 1 -- 172.21.15.132:0/184559634 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v52) v1 ==== 161+0+0 (secure 0 0 0) 0x7f6a7c057f10 con 0x7f6a6c004d00 2023-12-20T04:49:22.657 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-20T04:49:22.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.658+0000 7f6a87ccf640 1 -- 172.21.15.132:0/184559634 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6a6406a460 msgr2=0x7f6a6406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.658+0000 7f6a87ccf640 1 --2- 172.21.15.132:0/184559634 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6a6406a460 0x7f6a6406c920 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7f6a800ccd20 tx=0x7f6a700095d0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.658+0000 7f6a87ccf640 1 -- 172.21.15.132:0/184559634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c004d00 msgr2=0x7f6a8015ee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.658+0000 7f6a87ccf640 1 --2- 172.21.15.132:0/184559634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c004d00 0x7f6a8015ee40 secure :-1 s=READY pgs=1463 cs=0 l=1 rev1=1 crypto rx=0x7f6a7c007950 tx=0x7f6a7c00a6e0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.658+0000 7f6a87ccf640 1 -- 172.21.15.132:0/184559634 shutdown_connections 2023-12-20T04:49:22.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.658+0000 7f6a87ccf640 1 --2- 172.21.15.132:0/184559634 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6a6406a460 0x7f6a6406c920 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.658+0000 7f6a87ccf640 1 --2- 172.21.15.132:0/184559634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6a8015de00 0x7f6a8015e280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.658+0000 7f6a87ccf640 1 --2- 172.21.15.132:0/184559634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6a80158470 0x7f6a800c81d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.658+0000 7f6a87ccf640 1 --2- 172.21.15.132:0/184559634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6a6c004d00 0x7f6a8015ee40 unknown :-1 s=CLOSED pgs=1463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.658+0000 7f6a87ccf640 1 -- 172.21.15.132:0/184559634 >> 172.21.15.132:0/184559634 conn(0x7f6a80072e40 msgr2=0x7f6a8015c560 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:22.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.658+0000 7f6a87ccf640 1 -- 172.21.15.132:0/184559634 shutdown_connections 2023-12-20T04:49:22.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.658+0000 7f6a87ccf640 1 -- 172.21.15.132:0/184559634 wait complete. 2023-12-20T04:49:22.662 INFO:tasks.ceph.mds.d.smithi187.stderr: -7886> 2023-12-20T04:48:42.753+0000 7fba6d047640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:49:22.671 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-20T04:49:22.695 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-12-20T04:49:22.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.770+0000 7f4e74296640 1 Processor -- start 2023-12-20T04:49:22.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.770+0000 7f4e74296640 1 -- start start 2023-12-20T04:49:22.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.771+0000 7f4e74296640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4e6c15d300 0x7f4e6c06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.771+0000 7f4e74296640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6c06cc90 con 0x7f4e6c0cd4b0 2023-12-20T04:49:22.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.771+0000 7f4e74296640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e6c0b2f30 con 0x7f4e6c15cf20 2023-12-20T04:49:22.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.771+0000 7f4e74296640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e6c0b3210 con 0x7f4e6c15d300 2023-12-20T04:49:22.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.771+0000 7f4e71831640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4e6c15d300 0x7f4e6c06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:22.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.771+0000 7f4e72833640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4e6c0cd4b0 0x7f4e6c0d0660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40030/0 (socket says 172.21.15.132:40030) 2023-12-20T04:49:22.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.771+0000 7f4e72833640 1 -- 172.21.15.132:0/3326934413 learned_addr learned my addr 172.21.15.132:0/3326934413 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:22.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.771+0000 7f4e71831640 1 -- 172.21.15.132:0/3326934413 >> v1:172.21.15.187:6789/0 conn(0x7f4e6c15cf20 legacy=0x7f4e6c161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.771+0000 7f4e71831640 1 -- 172.21.15.132:0/3326934413 >> v1:172.21.15.132:6789/0 conn(0x7f4e6c0cd4b0 legacy=0x7f4e6c0d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.771+0000 7f4e71831640 1 -- 172.21.15.132:0/3326934413 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6c0b34f0 con 0x7f4e6c15d300 2023-12-20T04:49:22.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.771+0000 7f4e71030640 1 -- 172.21.15.132:0/3326934413 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2942876481 0 0) 0x7f4e6c06cc90 con 0x7f4e6c0cd4b0 2023-12-20T04:49:22.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.772+0000 7f4e71831640 1 --2- 172.21.15.132:0/3326934413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e6c15d300 0x7f4e6c06c590 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0097a0 tx=0x7f4e5c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e99f2d41fc45690 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:22.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.772+0000 7f4e71030640 1 -- 172.21.15.132:0/3326934413 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c030610 con 0x7f4e6c15d300 2023-12-20T04:49:22.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.772+0000 7f4e71030640 1 -- 172.21.15.132:0/3326934413 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e5c030770 con 0x7f4e6c15d300 2023-12-20T04:49:22.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.772+0000 7f4e71030640 1 -- 172.21.15.132:0/3326934413 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e5c030b00 con 0x7f4e6c15d300 2023-12-20T04:49:22.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.773+0000 7f4e74296640 1 -- 172.21.15.132:0/3326934413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e6c15d300 msgr2=0x7f4e6c06c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.773+0000 7f4e74296640 1 --2- 172.21.15.132:0/3326934413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e6c15d300 0x7f4e6c06c590 secure :-1 s=READY pgs=1466 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c0097a0 tx=0x7f4e5c02b960 comp rx=0 tx=0).stop 2023-12-20T04:49:22.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.773+0000 7f4e74296640 1 -- 172.21.15.132:0/3326934413 shutdown_connections 2023-12-20T04:49:22.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.773+0000 7f4e74296640 1 --2- 172.21.15.132:0/3326934413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e6c15d300 0x7f4e6c06c590 unknown :-1 s=CLOSED pgs=1466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.773+0000 7f4e74296640 1 -- 172.21.15.132:0/3326934413 >> 172.21.15.132:0/3326934413 conn(0x7f4e6c072c60 msgr2=0x7f4e6c073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:22.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.773+0000 7f4e74296640 1 -- 172.21.15.132:0/3326934413 shutdown_connections 2023-12-20T04:49:22.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.773+0000 7f4e74296640 1 -- 172.21.15.132:0/3326934413 wait complete. 2023-12-20T04:49:22.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.774+0000 7f4e74296640 1 Processor -- start 2023-12-20T04:49:22.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.774+0000 7f4e74296640 1 -- start start 2023-12-20T04:49:22.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e74296640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e6c0cd4b0 0x7f4e6c0b1720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e74296640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e6c15cf20 0x7f4e6c0d0b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e74296640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e6c15d300 0x7f4e6c0b59b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e74296640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c0c76f0 con 0x7f4e6c0cd4b0 2023-12-20T04:49:22.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e74296640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c0c7410 con 0x7f4e6c15d300 2023-12-20T04:49:22.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e74296640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6c0c48a0 con 0x7f4e6c15cf20 2023-12-20T04:49:22.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e72032640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e6c0cd4b0 0x7f4e6c0b1720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:22.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e72032640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e6c0cd4b0 0x7f4e6c0b1720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50510/0 (socket says 172.21.15.132:50510) 2023-12-20T04:49:22.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e72032640 1 -- 172.21.15.132:0/3699102677 learned_addr learned my addr 172.21.15.132:0/3699102677 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:22.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e72032640 1 -- 172.21.15.132:0/3699102677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e6c15cf20 msgr2=0x7f4e6c0d0b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e72032640 1 --2- 172.21.15.132:0/3699102677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e6c15cf20 0x7f4e6c0d0b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e72833640 1 --2- 172.21.15.132:0/3699102677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e6c15d300 0x7f4e6c0b59b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:22.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e72032640 1 -- 172.21.15.132:0/3699102677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e6c15d300 msgr2=0x7f4e6c0b59b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:22.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e72032640 1 --2- 172.21.15.132:0/3699102677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e6c15d300 0x7f4e6c0b59b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:22.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e72032640 1 -- 172.21.15.132:0/3699102677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e5c009400 con 0x7f4e6c0cd4b0 2023-12-20T04:49:22.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e72032640 1 --2- 172.21.15.132:0/3699102677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e6c0cd4b0 0x7f4e6c0b1720 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800c450 tx=0x7f4e6800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:22.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e62ffd640 1 -- 172.21.15.132:0/3699102677 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e680052d0 con 0x7f4e6c0cd4b0 2023-12-20T04:49:22.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e62ffd640 1 -- 172.21.15.132:0/3699102677 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e68005430 con 0x7f4e6c0cd4b0 2023-12-20T04:49:22.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e74296640 1 -- 172.21.15.132:0/3699102677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6c0af120 con 0x7f4e6c0cd4b0 2023-12-20T04:49:22.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e62ffd640 1 -- 172.21.15.132:0/3699102677 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e68012870 con 0x7f4e6c0cd4b0 2023-12-20T04:49:22.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.775+0000 7f4e74296640 1 -- 172.21.15.132:0/3699102677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e6c0c4b80 con 0x7f4e6c0cd4b0 2023-12-20T04:49:22.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.776+0000 7f4e74296640 1 -- 172.21.15.132:0/3699102677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6c0c4710 con 0x7f4e6c0cd4b0 2023-12-20T04:49:22.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.777+0000 7f4e62ffd640 1 -- 172.21.15.132:0/3699102677 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4e680129d0 con 0x7f4e6c0cd4b0 2023-12-20T04:49:22.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.777+0000 7f4e62ffd640 1 --2- 172.21.15.132:0/3699102677 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e5006a460 0x7f4e5006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:22.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.777+0000 7f4e62ffd640 1 -- 172.21.15.132:0/3699102677 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f4e680884f0 con 0x7f4e6c0cd4b0 2023-12-20T04:49:22.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.777+0000 7f4e71831640 1 --2- 172.21.15.132:0/3699102677 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e5006a460 0x7f4e5006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:22.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.777+0000 7f4e62ffd640 1 -- 172.21.15.132:0/3699102677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=143}) v3 -- 0x7f4e500720a0 con 0x7f4e6c0cd4b0 2023-12-20T04:49:22.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.778+0000 7f4e71831640 1 --2- 172.21.15.132:0/3699102677 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e5006a460 0x7f4e5006c920 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c036000 tx=0x7f4e5c030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:22.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.781+0000 7f4e62ffd640 1 -- 172.21.15.132:0/3699102677 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4e680539f0 con 0x7f4e6c0cd4b0 2023-12-20T04:49:22.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:22.981+0000 7f4e74296640 1 -- 172.21.15.132:0/3699102677 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4e6c04e840 con 0x7f4e6c0cd4b0 2023-12-20T04:49:23.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.657+0000 7f4e62ffd640 1 -- 172.21.15.132:0/3699102677 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v53) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4e68057010 con 0x7f4e6c0cd4b0 2023-12-20T04:49:23.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.659+0000 7f4e74296640 1 -- 172.21.15.132:0/3699102677 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e5006a460 msgr2=0x7f4e5006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:23.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.659+0000 7f4e74296640 1 --2- 172.21.15.132:0/3699102677 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e5006a460 0x7f4e5006c920 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c036000 tx=0x7f4e5c030000 comp rx=0 tx=0).stop 2023-12-20T04:49:23.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.659+0000 7f4e74296640 1 -- 172.21.15.132:0/3699102677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e6c0cd4b0 msgr2=0x7f4e6c0b1720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:23.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.659+0000 7f4e74296640 1 --2- 172.21.15.132:0/3699102677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e6c0cd4b0 0x7f4e6c0b1720 secure :-1 s=READY pgs=1467 cs=0 l=1 rev1=1 crypto rx=0x7f4e6800c450 tx=0x7f4e6800c910 comp rx=0 tx=0).stop 2023-12-20T04:49:23.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.659+0000 7f4e74296640 1 -- 172.21.15.132:0/3699102677 shutdown_connections 2023-12-20T04:49:23.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.659+0000 7f4e74296640 1 --2- 172.21.15.132:0/3699102677 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e5006a460 0x7f4e5006c920 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:23.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.659+0000 7f4e74296640 1 --2- 172.21.15.132:0/3699102677 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e6c15d300 0x7f4e6c0b59b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:23.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.660+0000 7f4e74296640 1 --2- 172.21.15.132:0/3699102677 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e6c15cf20 0x7f4e6c0d0b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:23.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.660+0000 7f4e74296640 1 --2- 172.21.15.132:0/3699102677 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e6c0cd4b0 0x7f4e6c0b1720 unknown :-1 s=CLOSED pgs=1467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:23.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.660+0000 7f4e74296640 1 -- 172.21.15.132:0/3699102677 >> 172.21.15.132:0/3699102677 conn(0x7f4e6c072c60 msgr2=0x7f4e6c15d7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:23.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.660+0000 7f4e74296640 1 -- 172.21.15.132:0/3699102677 shutdown_connections 2023-12-20T04:49:23.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.660+0000 7f4e74296640 1 -- 172.21.15.132:0/3699102677 wait complete. 2023-12-20T04:49:23.675 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-20T04:49:23.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.781+0000 7f52c8484640 1 Processor -- start 2023-12-20T04:49:23.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.781+0000 7f52c8484640 1 -- start start 2023-12-20T04:49:23.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.782+0000 7f52c8484640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f52c0069ea0 0x7f52c00cd770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:23.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.782+0000 7f52c8484640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f52c0070890 0x7f52c00cf0d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:23.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.782+0000 7f52c8484640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f52c00cdcb0 con 0x7f52c0071510 2023-12-20T04:49:23.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.782+0000 7f52c8484640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f52c006e8b0 con 0x7f52c0070890 2023-12-20T04:49:23.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.782+0000 7f52c8484640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00aed40 con 0x7f52c0069ea0 2023-12-20T04:49:23.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.782+0000 7f52c6220640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f52c0069ea0 0x7f52c00cd770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:23.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.782+0000 7f52c6a21640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f52c0070890 0x7f52c00cf0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:23.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.782+0000 7f52c6220640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f52c0069ea0 0x7f52c00cd770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:35200/0 (socket says 172.21.15.132:35200) 2023-12-20T04:49:23.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.782+0000 7f52c6220640 1 -- 172.21.15.132:0/4116550104 learned_addr learned my addr 172.21.15.132:0/4116550104 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:23.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.783+0000 7f52c6220640 1 -- 172.21.15.132:0/4116550104 >> v2:172.21.15.187:3300/0 conn(0x7f52c0070890 msgr2=0x7f52c00cf0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:23.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.783+0000 7f52c6220640 1 --2- 172.21.15.132:0/4116550104 >> v2:172.21.15.187:3300/0 conn(0x7f52c0070890 0x7f52c00cf0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:23.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.783+0000 7f52c6220640 1 -- 172.21.15.132:0/4116550104 >> v1:172.21.15.187:6789/0 conn(0x7f52c0071510 legacy=0x7f52c006c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:23.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.783+0000 7f52c6220640 1 -- 172.21.15.132:0/4116550104 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52c00af020 con 0x7f52c0069ea0 2023-12-20T04:49:23.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.783+0000 7f52c6220640 1 --2- 172.21.15.132:0/4116550104 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f52c0069ea0 0x7f52c00cd770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009e50 tx=0x7f52bc02bf60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d67fa86fd41b6ce3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:23.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.783+0000 7f52c521e640 1 -- 172.21.15.132:0/4116550104 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc02cb00 con 0x7f52c0069ea0 2023-12-20T04:49:23.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.784+0000 7f52c521e640 1 -- 172.21.15.132:0/4116550104 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52bc02cc60 con 0x7f52c0069ea0 2023-12-20T04:49:23.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.784+0000 7f52c521e640 1 -- 172.21.15.132:0/4116550104 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52bc0343f0 con 0x7f52c0069ea0 2023-12-20T04:49:23.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.784+0000 7f52c8484640 1 -- 172.21.15.132:0/4116550104 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f52c0069ea0 msgr2=0x7f52c00cd770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:23.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.784+0000 7f52c8484640 1 --2- 172.21.15.132:0/4116550104 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f52c0069ea0 0x7f52c00cd770 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f52bc009e50 tx=0x7f52bc02bf60 comp rx=0 tx=0).stop 2023-12-20T04:49:23.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.784+0000 7f52c8484640 1 -- 172.21.15.132:0/4116550104 shutdown_connections 2023-12-20T04:49:23.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.784+0000 7f52c8484640 1 --2- 172.21.15.132:0/4116550104 >> v2:172.21.15.187:3300/0 conn(0x7f52c0070890 0x7f52c00cf0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:23.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.784+0000 7f52c8484640 1 --2- 172.21.15.132:0/4116550104 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f52c0069ea0 0x7f52c00cd770 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:23.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.784+0000 7f52c8484640 1 -- 172.21.15.132:0/4116550104 >> 172.21.15.132:0/4116550104 conn(0x7f52c00b16b0 msgr2=0x7f52c00b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:23.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.784+0000 7f52c8484640 1 -- 172.21.15.132:0/4116550104 shutdown_connections 2023-12-20T04:49:23.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.784+0000 7f52c8484640 1 -- 172.21.15.132:0/4116550104 wait complete. 2023-12-20T04:49:23.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.785+0000 7f52c8484640 1 Processor -- start 2023-12-20T04:49:23.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.785+0000 7f52c8484640 1 -- start start 2023-12-20T04:49:23.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.786+0000 7f52c8484640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f52c0069ea0 0x7f52c01562c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:23.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.786+0000 7f52c8484640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52c0070890 0x7f52c00b3d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:23.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.786+0000 7f52c8484640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f52c0071510 0x7f52c015ca80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:23.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.786+0000 7f52c8484640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c0157620 con 0x7f52c0070890 2023-12-20T04:49:23.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.786+0000 7f52c8484640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f52c00b47d0 con 0x7f52c0071510 2023-12-20T04:49:23.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.786+0000 7f52c8484640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f52c0156c80 con 0x7f52c0069ea0 2023-12-20T04:49:23.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.786+0000 7f52c5a1f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52c0070890 0x7f52c00b3d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:23.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.786+0000 7f52c5a1f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52c0070890 0x7f52c00b3d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50522/0 (socket says 172.21.15.132:50522) 2023-12-20T04:49:23.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.786+0000 7f52c5a1f640 1 -- 172.21.15.132:0/3430935139 learned_addr learned my addr 172.21.15.132:0/3430935139 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:23.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.786+0000 7f52c6a21640 1 --2- 172.21.15.132:0/3430935139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f52c0071510 0x7f52c015ca80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:23.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.786+0000 7f52c6220640 1 --2- 172.21.15.132:0/3430935139 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f52c0069ea0 0x7f52c01562c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:23.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.786+0000 7f52c5a1f640 1 -- 172.21.15.132:0/3430935139 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f52c0069ea0 msgr2=0x7f52c01562c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:23.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.786+0000 7f52c5a1f640 1 --2- 172.21.15.132:0/3430935139 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f52c0069ea0 0x7f52c01562c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:23.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.786+0000 7f52c5a1f640 1 -- 172.21.15.132:0/3430935139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f52c0071510 msgr2=0x7f52c015ca80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:23.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.786+0000 7f52c5a1f640 1 --2- 172.21.15.132:0/3430935139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f52c0071510 0x7f52c015ca80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:23.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.787+0000 7f52c5a1f640 1 -- 172.21.15.132:0/3430935139 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f52bc009b30 con 0x7f52c0070890 2023-12-20T04:49:23.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.787+0000 7f52c5a1f640 1 --2- 172.21.15.132:0/3430935139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52c0070890 0x7f52c00b3d30 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f52b000c390 tx=0x7f52b000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:23.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.787+0000 7f52b6ffd640 1 -- 172.21.15.132:0/3430935139 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b00052d0 con 0x7f52c0070890 2023-12-20T04:49:23.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.787+0000 7f52b6ffd640 1 -- 172.21.15.132:0/3430935139 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f52b0005430 con 0x7f52c0070890 2023-12-20T04:49:23.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.787+0000 7f52c8484640 1 -- 172.21.15.132:0/3430935139 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f52c0156f60 con 0x7f52c0070890 2023-12-20T04:49:23.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.787+0000 7f52b6ffd640 1 -- 172.21.15.132:0/3430935139 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f52b0003830 con 0x7f52c0070890 2023-12-20T04:49:23.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.787+0000 7f52c8484640 1 -- 172.21.15.132:0/3430935139 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f52c0159750 con 0x7f52c0070890 2023-12-20T04:49:23.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.788+0000 7f52c8484640 1 -- 172.21.15.132:0/3430935139 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f52c004e840 con 0x7f52c0070890 2023-12-20T04:49:23.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.788+0000 7f52b6ffd640 1 -- 172.21.15.132:0/3430935139 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f52b0003990 con 0x7f52c0070890 2023-12-20T04:49:23.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.789+0000 7f52b6ffd640 1 --2- 172.21.15.132:0/3430935139 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f52a406a460 0x7f52a406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:23.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.789+0000 7f52b6ffd640 1 -- 172.21.15.132:0/3430935139 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(142..142 src has 1..142) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f52b0087c50 con 0x7f52c0070890 2023-12-20T04:49:23.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.789+0000 7f52c6220640 1 --2- 172.21.15.132:0/3430935139 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f52a406a460 0x7f52a406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:23.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.789+0000 7f52b6ffd640 1 -- 172.21.15.132:0/3430935139 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=143}) v3 -- 0x7f52a40720a0 con 0x7f52c0070890 2023-12-20T04:49:23.792 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.789+0000 7f52c6220640 1 --2- 172.21.15.132:0/3430935139 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f52a406a460 0x7f52a406c920 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f52bc035000 tx=0x7f52bc030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:23.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.793+0000 7f52b6ffd640 1 -- 172.21.15.132:0/3430935139 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f52b008d020 con 0x7f52c0070890 2023-12-20T04:49:23.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:23.958+0000 7f52c8484640 1 -- 172.21.15.132:0/3430935139 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f52c00cdcb0 con 0x7f52c0070890 2023-12-20T04:49:24.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.657+0000 7f52b6ffd640 1 -- 172.21.15.132:0/3430935139 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(143..143 src has 1..143) v4 ==== 296+0+0 (secure 0 0 0) 0x7f52b008d020 con 0x7f52c0070890 2023-12-20T04:49:24.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.657+0000 7f52b6ffd640 1 -- 172.21.15.132:0/3430935139 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=144}) v3 -- 0x7f52a40704d0 con 0x7f52c0070890 2023-12-20T04:49:24.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.659+0000 7f52b6ffd640 1 -- 172.21.15.132:0/3430935139 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v143) v1 ==== 181+0+0 (secure 0 0 0) 0x7f52c00cdcb0 con 0x7f52c0070890 2023-12-20T04:49:24.662 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2023-12-20T04:49:24.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.664+0000 7f52c8484640 1 -- 172.21.15.132:0/3430935139 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f52a406a460 msgr2=0x7f52a406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:24.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.664+0000 7f52c8484640 1 --2- 172.21.15.132:0/3430935139 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f52a406a460 0x7f52a406c920 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7f52bc035000 tx=0x7f52bc030000 comp rx=0 tx=0).stop 2023-12-20T04:49:24.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.664+0000 7f52c8484640 1 -- 172.21.15.132:0/3430935139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52c0070890 msgr2=0x7f52c00b3d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:24.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.664+0000 7f52c8484640 1 --2- 172.21.15.132:0/3430935139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52c0070890 0x7f52c00b3d30 secure :-1 s=READY pgs=1468 cs=0 l=1 rev1=1 crypto rx=0x7f52b000c390 tx=0x7f52b000c850 comp rx=0 tx=0).stop 2023-12-20T04:49:24.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.664+0000 7f52c8484640 1 -- 172.21.15.132:0/3430935139 shutdown_connections 2023-12-20T04:49:24.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.664+0000 7f52c8484640 1 --2- 172.21.15.132:0/3430935139 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f52a406a460 0x7f52a406c920 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:24.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.664+0000 7f52c8484640 1 --2- 172.21.15.132:0/3430935139 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f52c0071510 0x7f52c015ca80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:24.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.664+0000 7f52c8484640 1 --2- 172.21.15.132:0/3430935139 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f52c0070890 0x7f52c00b3d30 unknown :-1 s=CLOSED pgs=1468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:24.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.664+0000 7f52c8484640 1 --2- 172.21.15.132:0/3430935139 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f52c0069ea0 0x7f52c01562c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:24.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.664+0000 7f52c8484640 1 -- 172.21.15.132:0/3430935139 >> 172.21.15.132:0/3430935139 conn(0x7f52c00b16b0 msgr2=0x7f52c00ad2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:24.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.665+0000 7f52c8484640 1 -- 172.21.15.132:0/3430935139 shutdown_connections 2023-12-20T04:49:24.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.665+0000 7f52c8484640 1 -- 172.21.15.132:0/3430935139 wait complete. 2023-12-20T04:49:24.679 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-20T04:49:24.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.782+0000 7fd8adec4640 1 Processor -- start 2023-12-20T04:49:24.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.783+0000 7fd8adec4640 1 -- start start 2023-12-20T04:49:24.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.783+0000 7fd8adec4640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd8a8159d20 0x7fd8a806fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:24.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.783+0000 7fd8adec4640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a80c9a50 con 0x7fd8a80ce130 2023-12-20T04:49:24.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.783+0000 7fd8adec4640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8a80c9d30 con 0x7fd8a80ce5c0 2023-12-20T04:49:24.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.783+0000 7fd8adec4640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8a8070080 con 0x7fd8a8159d20 2023-12-20T04:49:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a6ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd8a80ce130 0x7fd8a80cea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40040/0 (socket says 172.21.15.132:40040) 2023-12-20T04:49:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a6ffd640 1 -- 172.21.15.132:0/45658149 learned_addr learned my addr 172.21.15.132:0/45658149 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a77fe640 1 --2- 172.21.15.132:0/45658149 >> v2:172.21.15.187:3300/0 conn(0x7fd8a8159d20 0x7fd8a806fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a67fc640 1 -- 172.21.15.132:0/45658149 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2001408806 0 0) 0x7fd8a80c9a50 con 0x7fd8a80ce130 2023-12-20T04:49:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a67fc640 1 -- 172.21.15.132:0/45658149 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd890003520 con 0x7fd8a80ce130 2023-12-20T04:49:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a67fc640 1 -- 172.21.15.132:0/45658149 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1766082708 0 0) 0x7fd890003520 con 0x7fd8a80ce130 2023-12-20T04:49:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a67fc640 1 -- 172.21.15.132:0/45658149 >> v2:172.21.15.187:3300/0 conn(0x7fd8a8159d20 msgr2=0x7fd8a806fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a67fc640 1 --2- 172.21.15.132:0/45658149 >> v2:172.21.15.187:3300/0 conn(0x7fd8a8159d20 0x7fd8a806fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a67fc640 1 -- 172.21.15.132:0/45658149 >> v1:172.21.15.187:6789/0 conn(0x7fd8a80ce5c0 legacy=0x7fd8a815dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a67fc640 1 -- 172.21.15.132:0/45658149 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a80ca010 con 0x7fd8a80ce130 2023-12-20T04:49:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a67fc640 1 -- 172.21.15.132:0/45658149 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fd89c001670 con 0x7fd8a80ce130 2023-12-20T04:49:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a67fc640 1 -- 172.21.15.132:0/45658149 >> v1:172.21.15.132:6789/0 conn(0x7fd8a80ce130 legacy=0x7fd8a80cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a67fc640 1 --2- 172.21.15.132:0/45658149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd890003970 0x7fd890003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:24.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a67fc640 1 --2- 172.21.15.132:0/45658149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8900047c0 0x7fd890004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a67fc640 1 --2- 172.21.15.132:0/45658149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd890005180 0x7fd89000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a67fc640 1 -- 172.21.15.132:0/45658149 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a8070080 con 0x7fd890005180 2023-12-20T04:49:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a67fc640 1 -- 172.21.15.132:0/45658149 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd89000c020 con 0x7fd890003970 2023-12-20T04:49:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a67fc640 1 -- 172.21.15.132:0/45658149 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd89000c1e0 con 0x7fd8900047c0 2023-12-20T04:49:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a7fff640 1 --2- 172.21.15.132:0/45658149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd890005180 0x7fd89000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a77fe640 1 --2- 172.21.15.132:0/45658149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd890003970 0x7fd890003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.784+0000 7fd8a6ffd640 1 --2- 172.21.15.132:0/45658149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8900047c0 0x7fd890004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.785+0000 7fd8a7fff640 1 -- 172.21.15.132:0/45658149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8900047c0 msgr2=0x7fd890004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.785+0000 7fd8a7fff640 1 --2- 172.21.15.132:0/45658149 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8900047c0 0x7fd890004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.785+0000 7fd8a7fff640 1 -- 172.21.15.132:0/45658149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd890003970 msgr2=0x7fd890003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.785+0000 7fd8a7fff640 1 --2- 172.21.15.132:0/45658149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd890003970 0x7fd890003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.785+0000 7fd8a7fff640 1 -- 172.21.15.132:0/45658149 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd890003520 con 0x7fd890005180 2023-12-20T04:49:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.785+0000 7fd8a77fe640 1 --2- 172.21.15.132:0/45658149 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd890003970 0x7fd890003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:49:24.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.785+0000 7fd8a7fff640 1 -- 172.21.15.132:0/45658149 reap_dead start 2023-12-20T04:49:24.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.785+0000 7fd8a7fff640 1 --2- 172.21.15.132:0/45658149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd890005180 0x7fd89000b980 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0001e50 tx=0x7fd8900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6370d3607ac929a4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:24.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.785+0000 7fd8a67fc640 1 -- 172.21.15.132:0/45658149 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0003b70 con 0x7fd890005180 2023-12-20T04:49:24.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.785+0000 7fd8a67fc640 1 -- 172.21.15.132:0/45658149 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a0003d10 con 0x7fd890005180 2023-12-20T04:49:24.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.785+0000 7fd8a67fc640 1 -- 172.21.15.132:0/45658149 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0005310 con 0x7fd890005180 2023-12-20T04:49:24.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.786+0000 7fd8adec4640 1 -- 172.21.15.132:0/45658149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd890005180 msgr2=0x7fd89000b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:24.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.786+0000 7fd8adec4640 1 --2- 172.21.15.132:0/45658149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd890005180 0x7fd89000b980 secure :-1 s=READY pgs=1470 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0001e50 tx=0x7fd8900057f0 comp rx=0 tx=0).stop 2023-12-20T04:49:24.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.786+0000 7fd8adec4640 1 -- 172.21.15.132:0/45658149 shutdown_connections 2023-12-20T04:49:24.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.786+0000 7fd8adec4640 1 --2- 172.21.15.132:0/45658149 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd890005180 0x7fd89000b980 unknown :-1 s=CLOSED pgs=1470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:24.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.786+0000 7fd8adec4640 1 -- 172.21.15.132:0/45658149 >> 172.21.15.132:0/45658149 conn(0x7fd8a80b05c0 msgr2=0x7fd8a80b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:24.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.786+0000 7fd8adec4640 1 -- 172.21.15.132:0/45658149 shutdown_connections 2023-12-20T04:49:24.791 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.786+0000 7fd8adec4640 1 -- 172.21.15.132:0/45658149 wait complete. 2023-12-20T04:49:24.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.787+0000 7fd8adec4640 1 Processor -- start 2023-12-20T04:49:24.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.787+0000 7fd8adec4640 1 -- start start 2023-12-20T04:49:24.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.788+0000 7fd8adec4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd890005180 0x7fd8a80c8520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:24.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.788+0000 7fd8adec4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a80c6ff0 0x7fd8a815b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:24.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.788+0000 7fd8adec4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8a81f2350 0x7fd8a80ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:24.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.788+0000 7fd8adec4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a815bcc0 con 0x7fd8a81f2350 2023-12-20T04:49:24.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.788+0000 7fd8adec4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a80c8090 con 0x7fd890005180 2023-12-20T04:49:24.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.788+0000 7fd8adec4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8a80c4db0 con 0x7fd8a80c6ff0 2023-12-20T04:49:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.788+0000 7fd8a7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8a81f2350 0x7fd8a80ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.788+0000 7fd8a7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8a81f2350 0x7fd8a80ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50538/0 (socket says 172.21.15.132:50538) 2023-12-20T04:49:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.788+0000 7fd8a7fff640 1 -- 172.21.15.132:0/3501189730 learned_addr learned my addr 172.21.15.132:0/3501189730 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.788+0000 7fd8a77fe640 1 --2- 172.21.15.132:0/3501189730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd890005180 0x7fd8a80c8520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.788+0000 7fd8a6ffd640 1 --2- 172.21.15.132:0/3501189730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a80c6ff0 0x7fd8a815b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.788+0000 7fd8a7fff640 1 -- 172.21.15.132:0/3501189730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a80c6ff0 msgr2=0x7fd8a815b780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.788+0000 7fd8a7fff640 1 --2- 172.21.15.132:0/3501189730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a80c6ff0 0x7fd8a815b780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.788+0000 7fd8a7fff640 1 -- 172.21.15.132:0/3501189730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd890005180 msgr2=0x7fd8a80c8520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.788+0000 7fd8a7fff640 1 --2- 172.21.15.132:0/3501189730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd890005180 0x7fd8a80c8520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.788+0000 7fd8a7fff640 1 -- 172.21.15.132:0/3501189730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8a80c7480 con 0x7fd8a81f2350 2023-12-20T04:49:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.788+0000 7fd8a6ffd640 1 --2- 172.21.15.132:0/3501189730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a80c6ff0 0x7fd8a815b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.789+0000 7fd8a7fff640 1 --2- 172.21.15.132:0/3501189730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8a81f2350 0x7fd8a80ac8e0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0001f70 tx=0x7fd8a00014a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.789+0000 7fd88ffff640 1 -- 172.21.15.132:0/3501189730 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0006d50 con 0x7fd8a81f2350 2023-12-20T04:49:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.789+0000 7fd88ffff640 1 -- 172.21.15.132:0/3501189730 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8a0007030 con 0x7fd8a81f2350 2023-12-20T04:49:24.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.789+0000 7fd88ffff640 1 -- 172.21.15.132:0/3501189730 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8a0007420 con 0x7fd8a81f2350 2023-12-20T04:49:24.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.789+0000 7fd8adec4640 1 -- 172.21.15.132:0/3501189730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8a80c7760 con 0x7fd8a81f2350 2023-12-20T04:49:24.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.789+0000 7fd8adec4640 1 -- 172.21.15.132:0/3501189730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8a80c7d20 con 0x7fd8a81f2350 2023-12-20T04:49:24.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.790+0000 7fd8adec4640 1 -- 172.21.15.132:0/3501189730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8a80c7eb0 con 0x7fd8a81f2350 2023-12-20T04:49:24.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.790+0000 7fd88ffff640 1 -- 172.21.15.132:0/3501189730 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd8a0007580 con 0x7fd8a81f2350 2023-12-20T04:49:24.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.791+0000 7fd88ffff640 1 --2- 172.21.15.132:0/3501189730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd89406a430 0x7fd89406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:24.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.791+0000 7fd8a77fe640 1 --2- 172.21.15.132:0/3501189730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd89406a430 0x7fd89406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:24.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.791+0000 7fd88ffff640 1 -- 172.21.15.132:0/3501189730 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(143..143 src has 1..143) v4 ==== 5357+0+0 (secure 0 0 0) 0x7fd8a00aa400 con 0x7fd8a81f2350 2023-12-20T04:49:24.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.791+0000 7fd88ffff640 1 -- 172.21.15.132:0/3501189730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=144}) v3 -- 0x7fd894071200 con 0x7fd8a81f2350 2023-12-20T04:49:24.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.791+0000 7fd8a77fe640 1 --2- 172.21.15.132:0/3501189730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd89406a430 0x7fd89406c8f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd898009a80 tx=0x7fd898008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:24.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.796+0000 7fd88ffff640 1 -- 172.21.15.132:0/3501189730 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd8a0075b50 con 0x7fd8a81f2350 2023-12-20T04:49:24.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:24.963+0000 7fd8adec4640 1 -- 172.21.15.132:0/3501189730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fd8a804e840 con 0x7fd8a81f2350 2023-12-20T04:49:25.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.862+0000 7fd88ffff640 1 -- 172.21.15.132:0/3501189730 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(144..144 src has 1..144) v4 ==== 296+0+0 (secure 0 0 0) 0x7fd8a0079f10 con 0x7fd8a81f2350 2023-12-20T04:49:25.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.862+0000 7fd88ffff640 1 -- 172.21.15.132:0/3501189730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=145}) v3 -- 0x7fd89406ff90 con 0x7fd8a81f2350 2023-12-20T04:49:25.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.866+0000 7fd88ffff640 1 -- 172.21.15.132:0/3501189730 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v144) v1 ==== 169+0+0 (secure 0 0 0) 0x7fd8a0079170 con 0x7fd8a81f2350 2023-12-20T04:49:25.868 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2023-12-20T04:49:25.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.872+0000 7fd8adec4640 1 -- 172.21.15.132:0/3501189730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd89406a430 msgr2=0x7fd89406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:25.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.872+0000 7fd8adec4640 1 --2- 172.21.15.132:0/3501189730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd89406a430 0x7fd89406c8f0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7fd898009a80 tx=0x7fd898008040 comp rx=0 tx=0).stop 2023-12-20T04:49:25.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.872+0000 7fd8adec4640 1 -- 172.21.15.132:0/3501189730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8a81f2350 msgr2=0x7fd8a80ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:25.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.872+0000 7fd8adec4640 1 --2- 172.21.15.132:0/3501189730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8a81f2350 0x7fd8a80ac8e0 secure :-1 s=READY pgs=1471 cs=0 l=1 rev1=1 crypto rx=0x7fd8a0001f70 tx=0x7fd8a00014a0 comp rx=0 tx=0).stop 2023-12-20T04:49:25.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.872+0000 7fd8adec4640 1 -- 172.21.15.132:0/3501189730 shutdown_connections 2023-12-20T04:49:25.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.872+0000 7fd8adec4640 1 --2- 172.21.15.132:0/3501189730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd89406a430 0x7fd89406c8f0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:25.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.872+0000 7fd8adec4640 1 --2- 172.21.15.132:0/3501189730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8a81f2350 0x7fd8a80ac8e0 unknown :-1 s=CLOSED pgs=1471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:25.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.872+0000 7fd8adec4640 1 --2- 172.21.15.132:0/3501189730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8a80c6ff0 0x7fd8a815b780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:25.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.872+0000 7fd8adec4640 1 --2- 172.21.15.132:0/3501189730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd890005180 0x7fd8a80c8520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:25.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.872+0000 7fd8adec4640 1 -- 172.21.15.132:0/3501189730 >> 172.21.15.132:0/3501189730 conn(0x7fd8a80b05c0 msgr2=0x7fd8a80cc010 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:25.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.873+0000 7fd8adec4640 1 -- 172.21.15.132:0/3501189730 shutdown_connections 2023-12-20T04:49:25.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.873+0000 7fd8adec4640 1 -- 172.21.15.132:0/3501189730 wait complete. 2023-12-20T04:49:25.886 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-20T04:49:25.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.989+0000 7f9d8d428640 1 Processor -- start 2023-12-20T04:49:25.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.989+0000 7f9d8d428640 1 -- start start 2023-12-20T04:49:25.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.990+0000 7f9d8d428640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d8815d300 0x7f9d880d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:25.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.990+0000 7f9d8d428640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d880d2920 con 0x7f9d880cfea0 2023-12-20T04:49:25.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.990+0000 7f9d8d428640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d880d1d10 con 0x7f9d880d17d0 2023-12-20T04:49:25.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.990+0000 7f9d8d428640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9d880d1ff0 con 0x7f9d8815d300 2023-12-20T04:49:25.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.990+0000 7f9d86ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9d8815d300 0x7f9d880d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:25.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.990+0000 7f9d877fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9d880cfea0 0x7f9d880b6080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40048/0 (socket says 172.21.15.132:40048) 2023-12-20T04:49:25.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.990+0000 7f9d877fe640 1 -- 172.21.15.132:0/759268758 learned_addr learned my addr 172.21.15.132:0/759268758 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:25.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.990+0000 7f9d86ffd640 1 -- 172.21.15.132:0/759268758 >> v1:172.21.15.187:6789/0 conn(0x7f9d880d17d0 legacy=0x7f9d880cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:25.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.990+0000 7f9d86ffd640 1 -- 172.21.15.132:0/759268758 >> v1:172.21.15.132:6789/0 conn(0x7f9d880cfea0 legacy=0x7f9d880b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:25.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.990+0000 7f9d867fc640 1 -- 172.21.15.132:0/759268758 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 354871146 0 0) 0x7f9d880d2920 con 0x7f9d880cfea0 2023-12-20T04:49:25.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.990+0000 7f9d86ffd640 1 -- 172.21.15.132:0/759268758 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d880d22d0 con 0x7f9d8815d300 2023-12-20T04:49:25.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.991+0000 7f9d86ffd640 1 --2- 172.21.15.132:0/759268758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d8815d300 0x7f9d880d1290 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f9d780097a0 tx=0x7f9d7802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62c58d09a47c9f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:25.992 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.991+0000 7f9d867fc640 1 -- 172.21.15.132:0/759268758 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78031830 con 0x7f9d8815d300 2023-12-20T04:49:25.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.991+0000 7f9d867fc640 1 -- 172.21.15.132:0/759268758 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d78031990 con 0x7f9d8815d300 2023-12-20T04:49:25.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.991+0000 7f9d867fc640 1 -- 172.21.15.132:0/759268758 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d78031d20 con 0x7f9d8815d300 2023-12-20T04:49:25.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.992+0000 7f9d8d428640 1 -- 172.21.15.132:0/759268758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d8815d300 msgr2=0x7f9d880d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:25.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.992+0000 7f9d8d428640 1 --2- 172.21.15.132:0/759268758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d8815d300 0x7f9d880d1290 secure :-1 s=READY pgs=1473 cs=0 l=1 rev1=1 crypto rx=0x7f9d780097a0 tx=0x7f9d7802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:49:25.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.992+0000 7f9d8d428640 1 -- 172.21.15.132:0/759268758 shutdown_connections 2023-12-20T04:49:25.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.992+0000 7f9d8d428640 1 --2- 172.21.15.132:0/759268758 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d8815d300 0x7f9d880d1290 unknown :-1 s=CLOSED pgs=1473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:25.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.992+0000 7f9d8d428640 1 -- 172.21.15.132:0/759268758 >> 172.21.15.132:0/759268758 conn(0x7f9d8806a3d0 msgr2=0x7f9d8806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:25.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.992+0000 7f9d8d428640 1 -- 172.21.15.132:0/759268758 shutdown_connections 2023-12-20T04:49:25.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.992+0000 7f9d8d428640 1 -- 172.21.15.132:0/759268758 wait complete. 2023-12-20T04:49:25.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.993+0000 7f9d8d428640 1 Processor -- start 2023-12-20T04:49:25.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.993+0000 7f9d8d428640 1 -- start start 2023-12-20T04:49:25.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.993+0000 7f9d8d428640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d880cfea0 0x7f9d880caa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:25.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d8d428640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d880d17d0 0x7f9d881e83c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:25.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d8d428640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d8815d300 0x7f9d880c5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:25.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d8d428640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d880caf40 con 0x7f9d880d17d0 2023-12-20T04:49:25.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d8d428640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d881e97d0 con 0x7f9d8815d300 2023-12-20T04:49:25.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d8d428640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d881e8900 con 0x7f9d880cfea0 2023-12-20T04:49:25.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d7ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d880d17d0 0x7f9d881e83c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:25.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d7ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d880d17d0 0x7f9d881e83c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50552/0 (socket says 172.21.15.132:50552) 2023-12-20T04:49:25.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d7ffff640 1 -- 172.21.15.132:0/2024514878 learned_addr learned my addr 172.21.15.132:0/2024514878 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:25.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d7ffff640 1 -- 172.21.15.132:0/2024514878 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d880cfea0 msgr2=0x7f9d880caa00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:25.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d7ffff640 1 --2- 172.21.15.132:0/2024514878 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d880cfea0 0x7f9d880caa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:25.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d7ffff640 1 -- 172.21.15.132:0/2024514878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d8815d300 msgr2=0x7f9d880c5950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:25.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d877fe640 1 --2- 172.21.15.132:0/2024514878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d8815d300 0x7f9d880c5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:25.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d7ffff640 1 --2- 172.21.15.132:0/2024514878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d8815d300 0x7f9d880c5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:25.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d7ffff640 1 -- 172.21.15.132:0/2024514878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d78009400 con 0x7f9d880d17d0 2023-12-20T04:49:25.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d7ffff640 1 --2- 172.21.15.132:0/2024514878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d880d17d0 0x7f9d881e83c0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000c400 tx=0x7f9d7000c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:25.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d7f7fe640 1 -- 172.21.15.132:0/2024514878 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d700035f0 con 0x7f9d880d17d0 2023-12-20T04:49:25.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d7f7fe640 1 -- 172.21.15.132:0/2024514878 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d70003750 con 0x7f9d880d17d0 2023-12-20T04:49:25.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d8d428640 1 -- 172.21.15.132:0/2024514878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d881e8bc0 con 0x7f9d880d17d0 2023-12-20T04:49:25.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d7f7fe640 1 -- 172.21.15.132:0/2024514878 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d70003b00 con 0x7f9d880d17d0 2023-12-20T04:49:25.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.994+0000 7f9d8d428640 1 -- 172.21.15.132:0/2024514878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d881e9180 con 0x7f9d880d17d0 2023-12-20T04:49:25.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.995+0000 7f9d8d428640 1 -- 172.21.15.132:0/2024514878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d8804e840 con 0x7f9d880d17d0 2023-12-20T04:49:25.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.996+0000 7f9d7f7fe640 1 -- 172.21.15.132:0/2024514878 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9d70003c60 con 0x7f9d880d17d0 2023-12-20T04:49:25.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.996+0000 7f9d7f7fe640 1 --2- 172.21.15.132:0/2024514878 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9d6806a430 0x7f9d6806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:25.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.996+0000 7f9d7f7fe640 1 -- 172.21.15.132:0/2024514878 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9d70087b20 con 0x7f9d880d17d0 2023-12-20T04:49:25.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.996+0000 7f9d86ffd640 1 --2- 172.21.15.132:0/2024514878 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9d6806a430 0x7f9d6806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:25.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:25.996+0000 7f9d86ffd640 1 --2- 172.21.15.132:0/2024514878 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9d6806a430 0x7f9d6806c8f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9d78036000 tx=0x7f9d78030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:26.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.000+0000 7f9d7f7fe640 1 -- 172.21.15.132:0/2024514878 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9d700534c0 con 0x7f9d880d17d0 2023-12-20T04:49:26.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.167+0000 7f9d8d428640 1 -- 172.21.15.132:0/2024514878 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f9d880c97d0 con 0x7f9d880d17d0 2023-12-20T04:49:26.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.170+0000 7f9d7f7fe640 1 -- 172.21.15.132:0/2024514878 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v15) v1 ==== 104+0+0 (secure 0 0 0) 0x7f9d70056ae0 con 0x7f9d880d17d0 2023-12-20T04:49:26.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.172+0000 7f9d8d428640 1 -- 172.21.15.132:0/2024514878 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9d6806a430 msgr2=0x7f9d6806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:26.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.172+0000 7f9d8d428640 1 --2- 172.21.15.132:0/2024514878 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9d6806a430 0x7f9d6806c8f0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f9d78036000 tx=0x7f9d78030000 comp rx=0 tx=0).stop 2023-12-20T04:49:26.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.173+0000 7f9d8d428640 1 -- 172.21.15.132:0/2024514878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d880d17d0 msgr2=0x7f9d881e83c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:26.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.173+0000 7f9d8d428640 1 --2- 172.21.15.132:0/2024514878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d880d17d0 0x7f9d881e83c0 secure :-1 s=READY pgs=1474 cs=0 l=1 rev1=1 crypto rx=0x7f9d7000c400 tx=0x7f9d7000c8c0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.173+0000 7f9d8d428640 1 -- 172.21.15.132:0/2024514878 shutdown_connections 2023-12-20T04:49:26.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.173+0000 7f9d8d428640 1 --2- 172.21.15.132:0/2024514878 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9d6806a430 0x7f9d6806c8f0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.173+0000 7f9d8d428640 1 --2- 172.21.15.132:0/2024514878 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d8815d300 0x7f9d880c5950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.173+0000 7f9d8d428640 1 --2- 172.21.15.132:0/2024514878 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d880d17d0 0x7f9d881e83c0 unknown :-1 s=CLOSED pgs=1474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.173+0000 7f9d8d428640 1 --2- 172.21.15.132:0/2024514878 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d880cfea0 0x7f9d880caa00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.173+0000 7f9d8d428640 1 -- 172.21.15.132:0/2024514878 >> 172.21.15.132:0/2024514878 conn(0x7f9d8806a3d0 msgr2=0x7f9d880b6f30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:26.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.173+0000 7f9d8d428640 1 -- 172.21.15.132:0/2024514878 shutdown_connections 2023-12-20T04:49:26.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.173+0000 7f9d8d428640 1 -- 172.21.15.132:0/2024514878 wait complete. 2023-12-20T04:49:26.185 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file' 2023-12-20T04:49:26.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.284+0000 7f7ccba8b640 1 Processor -- start 2023-12-20T04:49:26.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.285+0000 7f7ccba8b640 1 -- start start 2023-12-20T04:49:26.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.285+0000 7f7ccba8b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7cc4069c30 0x7f7cc406a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:26.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.285+0000 7f7ccba8b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7cc40acbb0 0x7f7cc40acfe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:26.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.285+0000 7f7ccba8b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7cc40708d0 con 0x7f7cc415d050 2023-12-20T04:49:26.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.285+0000 7f7ccba8b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc406a600 con 0x7f7cc4069c30 2023-12-20T04:49:26.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.285+0000 7f7ccba8b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7cc4070bb0 con 0x7f7cc40acbb0 2023-12-20T04:49:26.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.286+0000 7f7cc9026640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7cc4069c30 0x7f7cc406a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:26.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.286+0000 7f7cc9026640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7cc4069c30 0x7f7cc406a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50566/0 (socket says 172.21.15.132:50566) 2023-12-20T04:49:26.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.286+0000 7f7cc9026640 1 -- 172.21.15.132:0/718529401 learned_addr learned my addr 172.21.15.132:0/718529401 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:26.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.286+0000 7f7cc9026640 1 -- 172.21.15.132:0/718529401 >> v2:172.21.15.187:3300/0 conn(0x7f7cc40acbb0 msgr2=0x7f7cc40acfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:26.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.286+0000 7f7cca028640 1 --2- 172.21.15.132:0/718529401 >> v2:172.21.15.187:3300/0 conn(0x7f7cc40acbb0 0x7f7cc40acfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:26.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.286+0000 7f7cc9026640 1 --2- 172.21.15.132:0/718529401 >> v2:172.21.15.187:3300/0 conn(0x7f7cc40acbb0 0x7f7cc40acfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.286+0000 7f7cc9026640 1 -- 172.21.15.132:0/718529401 >> v1:172.21.15.187:6789/0 conn(0x7f7cc415d050 legacy=0x7f7cc40c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:26.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.286+0000 7f7cc9026640 1 -- 172.21.15.132:0/718529401 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc4070e90 con 0x7f7cc4069c30 2023-12-20T04:49:26.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.286+0000 7f7cca028640 1 --2- 172.21.15.132:0/718529401 >> v2:172.21.15.187:3300/0 conn(0x7f7cc40acbb0 0x7f7cc40acfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.287+0000 7f7cc9026640 1 --2- 172.21.15.132:0/718529401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc4069c30 0x7f7cc406a0c0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40d08c0 tx=0x7f7cc002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98312b77a7776058 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.287+0000 7f7cc8825640 1 -- 172.21.15.132:0/718529401 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0031870 con 0x7f7cc4069c30 2023-12-20T04:49:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.287+0000 7f7cc8825640 1 -- 172.21.15.132:0/718529401 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc00319d0 con 0x7f7cc4069c30 2023-12-20T04:49:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.287+0000 7f7cc8825640 1 -- 172.21.15.132:0/718529401 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0031d60 con 0x7f7cc4069c30 2023-12-20T04:49:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.287+0000 7f7ccba8b640 1 -- 172.21.15.132:0/718529401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc4069c30 msgr2=0x7f7cc406a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.287+0000 7f7ccba8b640 1 --2- 172.21.15.132:0/718529401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc4069c30 0x7f7cc406a0c0 secure :-1 s=READY pgs=1475 cs=0 l=1 rev1=1 crypto rx=0x7f7cc40d08c0 tx=0x7f7cc002b910 comp rx=0 tx=0).stop 2023-12-20T04:49:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.287+0000 7f7ccba8b640 1 -- 172.21.15.132:0/718529401 shutdown_connections 2023-12-20T04:49:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.287+0000 7f7ccba8b640 1 --2- 172.21.15.132:0/718529401 >> v2:172.21.15.187:3300/0 conn(0x7f7cc40acbb0 0x7f7cc40acfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.287+0000 7f7ccba8b640 1 --2- 172.21.15.132:0/718529401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc4069c30 0x7f7cc406a0c0 unknown :-1 s=CLOSED pgs=1475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.287+0000 7f7ccba8b640 1 -- 172.21.15.132:0/718529401 >> 172.21.15.132:0/718529401 conn(0x7f7cc40cfb10 msgr2=0x7f7cc40cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:26.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.287+0000 7f7ccba8b640 1 -- 172.21.15.132:0/718529401 shutdown_connections 2023-12-20T04:49:26.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.287+0000 7f7ccba8b640 1 -- 172.21.15.132:0/718529401 wait complete. 2023-12-20T04:49:26.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.288+0000 7f7ccba8b640 1 Processor -- start 2023-12-20T04:49:26.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.288+0000 7f7ccba8b640 1 -- start start 2023-12-20T04:49:26.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.289+0000 7f7ccba8b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cc4069c30 0x7f7cc4157d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:26.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.289+0000 7f7ccba8b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc40acbb0 0x7f7cc406db00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:26.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.289+0000 7f7ccba8b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cc415d050 0x7f7cc406e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:26.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.289+0000 7f7ccba8b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc4154e10 con 0x7f7cc40acbb0 2023-12-20T04:49:26.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.289+0000 7f7ccba8b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc4154b30 con 0x7f7cc4069c30 2023-12-20T04:49:26.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.289+0000 7f7ccba8b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7cc40b2840 con 0x7f7cc415d050 2023-12-20T04:49:26.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.289+0000 7f7cc9026640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc40acbb0 0x7f7cc406db00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:26.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.289+0000 7f7cc9026640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc40acbb0 0x7f7cc406db00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50572/0 (socket says 172.21.15.132:50572) 2023-12-20T04:49:26.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.289+0000 7f7cc9026640 1 -- 172.21.15.132:0/1379797686 learned_addr learned my addr 172.21.15.132:0/1379797686 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:26.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.289+0000 7f7cc9026640 1 -- 172.21.15.132:0/1379797686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cc415d050 msgr2=0x7f7cc406e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:26.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.289+0000 7f7cc9026640 1 --2- 172.21.15.132:0/1379797686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cc415d050 0x7f7cc406e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.289+0000 7f7cc9026640 1 -- 172.21.15.132:0/1379797686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cc4069c30 msgr2=0x7f7cc4157d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:26.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.289+0000 7f7cc9827640 1 --2- 172.21.15.132:0/1379797686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cc4069c30 0x7f7cc4157d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:26.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.290+0000 7f7cc9026640 1 --2- 172.21.15.132:0/1379797686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cc4069c30 0x7f7cc4157d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.290+0000 7f7cc9026640 1 -- 172.21.15.132:0/1379797686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc00094d0 con 0x7f7cc40acbb0 2023-12-20T04:49:26.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.290+0000 7f7cc9026640 1 --2- 172.21.15.132:0/1379797686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc40acbb0 0x7f7cc406db00 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0000c00 tx=0x7f7cc00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:26.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.290+0000 7f7cba7fc640 1 -- 172.21.15.132:0/1379797686 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc0031840 con 0x7f7cc40acbb0 2023-12-20T04:49:26.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.290+0000 7f7cba7fc640 1 -- 172.21.15.132:0/1379797686 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7cc00443f0 con 0x7f7cc40acbb0 2023-12-20T04:49:26.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.290+0000 7f7cba7fc640 1 -- 172.21.15.132:0/1379797686 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7cc00447a0 con 0x7f7cc40acbb0 2023-12-20T04:49:26.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.290+0000 7f7ccba8b640 1 -- 172.21.15.132:0/1379797686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cc40b2b20 con 0x7f7cc40acbb0 2023-12-20T04:49:26.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.290+0000 7f7ccba8b640 1 -- 172.21.15.132:0/1379797686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cc4158270 con 0x7f7cc40acbb0 2023-12-20T04:49:26.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.291+0000 7f7ccba8b640 1 -- 172.21.15.132:0/1379797686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cc40b3040 con 0x7f7cc40acbb0 2023-12-20T04:49:26.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.291+0000 7f7cba7fc640 1 -- 172.21.15.132:0/1379797686 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7cc004d450 con 0x7f7cc40acbb0 2023-12-20T04:49:26.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.292+0000 7f7cba7fc640 1 --2- 172.21.15.132:0/1379797686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ca806a430 0x7f7ca806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:26.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.292+0000 7f7cc9827640 1 --2- 172.21.15.132:0/1379797686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ca806a430 0x7f7ca806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:26.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.292+0000 7f7cba7fc640 1 -- 172.21.15.132:0/1379797686 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7cc002d040 con 0x7f7cc40acbb0 2023-12-20T04:49:26.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.292+0000 7f7cc9827640 1 --2- 172.21.15.132:0/1379797686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ca806a430 0x7f7ca806c8f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400a750 tx=0x7f7cb4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:26.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.296+0000 7f7cba7fc640 1 -- 172.21.15.132:0/1379797686 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7cc40b3040 con 0x7f7cc40acbb0 2023-12-20T04:49:26.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.523+0000 7f7ccba8b640 1 -- 172.21.15.132:0/1379797686 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]} v 0) v1 -- 0x7f7cc40b3040 con 0x7f7cc40acbb0 2023-12-20T04:49:26.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.662+0000 7f7cba7fc640 1 -- 172.21.15.132:0/1379797686 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_different_file"]}]=0 v352) v1 ==== 140+0+0 (secure 0 0 0) 0x7f7cc40b3040 con 0x7f7cc40acbb0 2023-12-20T04:49:26.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.664+0000 7f7ccba8b640 1 -- 172.21.15.132:0/1379797686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ca806a430 msgr2=0x7f7ca806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:26.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.664+0000 7f7ccba8b640 1 --2- 172.21.15.132:0/1379797686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ca806a430 0x7f7ca806c8f0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f7cb400a750 tx=0x7f7cb4008040 comp rx=0 tx=0).stop 2023-12-20T04:49:26.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.664+0000 7f7ccba8b640 1 -- 172.21.15.132:0/1379797686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc40acbb0 msgr2=0x7f7cc406db00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:26.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.664+0000 7f7ccba8b640 1 --2- 172.21.15.132:0/1379797686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc40acbb0 0x7f7cc406db00 secure :-1 s=READY pgs=1476 cs=0 l=1 rev1=1 crypto rx=0x7f7cc0000c00 tx=0x7f7cc00046c0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.664+0000 7f7ccba8b640 1 -- 172.21.15.132:0/1379797686 shutdown_connections 2023-12-20T04:49:26.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.664+0000 7f7ccba8b640 1 --2- 172.21.15.132:0/1379797686 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7ca806a430 0x7f7ca806c8f0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.664+0000 7f7ccba8b640 1 --2- 172.21.15.132:0/1379797686 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7cc415d050 0x7f7cc406e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.664+0000 7f7ccba8b640 1 --2- 172.21.15.132:0/1379797686 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7cc40acbb0 0x7f7cc406db00 unknown :-1 s=CLOSED pgs=1476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.664+0000 7f7ccba8b640 1 --2- 172.21.15.132:0/1379797686 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7cc4069c30 0x7f7cc4157d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.664+0000 7f7ccba8b640 1 -- 172.21.15.132:0/1379797686 >> 172.21.15.132:0/1379797686 conn(0x7f7cc40cfb10 msgr2=0x7f7cc41585d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:26.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.664+0000 7f7ccba8b640 1 -- 172.21.15.132:0/1379797686 shutdown_connections 2023-12-20T04:49:26.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.664+0000 7f7ccba8b640 1 -- 172.21.15.132:0/1379797686 wait complete. 2023-12-20T04:49:26.676 INFO:tasks.cephfs_test_runner:test_full_different_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-12-20T04:49:26.676 INFO:tasks.cephfs_test_runner:Starting test: test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) 2023-12-20T04:49:26.677 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-12-20T04:49:26.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.775+0000 7f7f10399640 1 Processor -- start 2023-12-20T04:49:26.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.775+0000 7f7f10399640 1 -- start start 2023-12-20T04:49:26.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.776+0000 7f7f10399640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7f080b4de0 0x7f7f080d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:26.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.776+0000 7f7f10399640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f080b5ec0 con 0x7f7f080b4980 2023-12-20T04:49:26.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.776+0000 7f7f10399640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7f081617e0 con 0x7f7f08160450 2023-12-20T04:49:26.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.776+0000 7f7f10399640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7f080d0fc0 con 0x7f7f080b4de0 2023-12-20T04:49:26.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.776+0000 7f7f0e936640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7f080b4de0 0x7f7f080d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:26.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.776+0000 7f7f0e936640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7f080b4de0 0x7f7f080d21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50580/0 (socket says 172.21.15.132:50580) 2023-12-20T04:49:26.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.776+0000 7f7f0e936640 1 -- 172.21.15.132:0/274611808 learned_addr learned my addr 172.21.15.132:0/274611808 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:26.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.776+0000 7f7f0d934640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7f080b4980 0x7f7f080d1aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40058/0 (socket says 172.21.15.132:40058) 2023-12-20T04:49:26.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.777+0000 7f7f0e936640 1 -- 172.21.15.132:0/274611808 >> v1:172.21.15.187:6789/0 conn(0x7f7f08160450 legacy=0x7f7f08160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:26.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.777+0000 7f7f0e936640 1 -- 172.21.15.132:0/274611808 >> v1:172.21.15.132:6789/0 conn(0x7f7f080b4980 legacy=0x7f7f080d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:26.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.777+0000 7f7f0e936640 1 -- 172.21.15.132:0/274611808 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f080d12a0 con 0x7f7f080b4de0 2023-12-20T04:49:26.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.777+0000 7f7f0d133640 1 -- 172.21.15.132:0/274611808 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3235175651 0 0) 0x7f7f080b5ec0 con 0x7f7f080b4980 2023-12-20T04:49:26.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.777+0000 7f7f0e936640 1 --2- 172.21.15.132:0/274611808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080b4de0 0x7f7f080d21b0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009870 tx=0x7f7f0002bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b859eda64e9dafeb server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:26.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.777+0000 7f7f0d133640 1 -- 172.21.15.132:0/274611808 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0002d870 con 0x7f7f080b4de0 2023-12-20T04:49:26.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.778+0000 7f7f0d133640 1 -- 172.21.15.132:0/274611808 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f0002d9d0 con 0x7f7f080b4de0 2023-12-20T04:49:26.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.778+0000 7f7f0d133640 1 -- 172.21.15.132:0/274611808 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f0002dd60 con 0x7f7f080b4de0 2023-12-20T04:49:26.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.778+0000 7f7f10399640 1 -- 172.21.15.132:0/274611808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080b4de0 msgr2=0x7f7f080d21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:26.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.778+0000 7f7f10399640 1 --2- 172.21.15.132:0/274611808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080b4de0 0x7f7f080d21b0 secure :-1 s=READY pgs=1478 cs=0 l=1 rev1=1 crypto rx=0x7f7f00009870 tx=0x7f7f0002bab0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.778+0000 7f7f10399640 1 -- 172.21.15.132:0/274611808 shutdown_connections 2023-12-20T04:49:26.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.778+0000 7f7f10399640 1 --2- 172.21.15.132:0/274611808 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080b4de0 0x7f7f080d21b0 unknown :-1 s=CLOSED pgs=1478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.778+0000 7f7f10399640 1 -- 172.21.15.132:0/274611808 >> 172.21.15.132:0/274611808 conn(0x7f7f080cf980 msgr2=0x7f7f080cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:26.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.778+0000 7f7f10399640 1 -- 172.21.15.132:0/274611808 shutdown_connections 2023-12-20T04:49:26.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.778+0000 7f7f10399640 1 -- 172.21.15.132:0/274611808 wait complete. 2023-12-20T04:49:26.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.779+0000 7f7f10399640 1 Processor -- start 2023-12-20T04:49:26.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.779+0000 7f7f10399640 1 -- start start 2023-12-20T04:49:26.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.780+0000 7f7f10399640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080b4980 0x7f7f08156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:26.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.780+0000 7f7f10399640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f080b4de0 0x7f7f080ccc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:26.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.780+0000 7f7f10399640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f08160450 0x7f7f081580e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:26.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.780+0000 7f7f10399640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f080cd190 con 0x7f7f080b4980 2023-12-20T04:49:26.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.780+0000 7f7f10399640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f081575b0 con 0x7f7f080b4de0 2023-12-20T04:49:26.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.780+0000 7f7f10399640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7f08157890 con 0x7f7f08160450 2023-12-20T04:49:26.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.780+0000 7f7f0e135640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080b4980 0x7f7f08156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:26.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.780+0000 7f7f0e135640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080b4980 0x7f7f08156f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:50590/0 (socket says 172.21.15.132:50590) 2023-12-20T04:49:26.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.780+0000 7f7f0e135640 1 -- 172.21.15.132:0/276528627 learned_addr learned my addr 172.21.15.132:0/276528627 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:26.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.780+0000 7f7f0d934640 1 --2- 172.21.15.132:0/276528627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f080b4de0 0x7f7f080ccc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:26.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.780+0000 7f7f0e936640 1 --2- 172.21.15.132:0/276528627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f08160450 0x7f7f081580e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:26.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.780+0000 7f7f0e135640 1 -- 172.21.15.132:0/276528627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f08160450 msgr2=0x7f7f081580e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:26.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.780+0000 7f7f0e135640 1 --2- 172.21.15.132:0/276528627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f08160450 0x7f7f081580e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.780+0000 7f7f0e135640 1 -- 172.21.15.132:0/276528627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f080b4de0 msgr2=0x7f7f080ccc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:26.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.780+0000 7f7f0e135640 1 --2- 172.21.15.132:0/276528627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f080b4de0 0x7f7f080ccc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:26.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.780+0000 7f7f0e135640 1 -- 172.21.15.132:0/276528627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f000094d0 con 0x7f7f080b4980 2023-12-20T04:49:26.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.780+0000 7f7f0e936640 1 --2- 172.21.15.132:0/276528627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f08160450 0x7f7f081580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:26.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.781+0000 7f7f0e135640 1 --2- 172.21.15.132:0/276528627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080b4980 0x7f7f08156f40 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400c730 tx=0x7f7f0400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:26.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.781+0000 7f7efeffd640 1 -- 172.21.15.132:0/276528627 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04003b70 con 0x7f7f080b4980 2023-12-20T04:49:26.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.781+0000 7f7efeffd640 1 -- 172.21.15.132:0/276528627 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7f04003cf0 con 0x7f7f080b4980 2023-12-20T04:49:26.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.781+0000 7f7f10399640 1 -- 172.21.15.132:0/276528627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f08157b70 con 0x7f7f080b4980 2023-12-20T04:49:26.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.781+0000 7f7efeffd640 1 -- 172.21.15.132:0/276528627 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7f04003ea0 con 0x7f7f080b4980 2023-12-20T04:49:26.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.781+0000 7f7f10399640 1 -- 172.21.15.132:0/276528627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f08157e50 con 0x7f7f080b4980 2023-12-20T04:49:26.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.782+0000 7f7f10399640 1 -- 172.21.15.132:0/276528627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f0804e840 con 0x7f7f080b4980 2023-12-20T04:49:26.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.782+0000 7f7efeffd640 1 -- 172.21.15.132:0/276528627 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7f0400aa90 con 0x7f7f080b4980 2023-12-20T04:49:26.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.782+0000 7f7efeffd640 1 --2- 172.21.15.132:0/276528627 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7eec06a430 0x7f7eec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:26.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.782+0000 7f7efeffd640 1 -- 172.21.15.132:0/276528627 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f7f040883a0 con 0x7f7f080b4980 2023-12-20T04:49:26.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.782+0000 7f7f0d934640 1 --2- 172.21.15.132:0/276528627 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7eec06a430 0x7f7eec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:26.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.783+0000 7f7f0d934640 1 --2- 172.21.15.132:0/276528627 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7eec06a430 0x7f7eec06c8f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7f080ca420 tx=0x7f7ef8007b90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:26.787 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:26.787+0000 7f7efeffd640 1 -- 172.21.15.132:0/276528627 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7f04053d20 con 0x7f7f080b4980 2023-12-20T04:49:27.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.019+0000 7f7f10399640 1 -- 172.21.15.132:0/276528627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f7f08159f80 con 0x7f7f080b4980 2023-12-20T04:49:27.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.663+0000 7f7efeffd640 1 -- 172.21.15.132:0/276528627 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v353) v1 ==== 135+0+0 (secure 0 0 0) 0x7f7f04057340 con 0x7f7f080b4980 2023-12-20T04:49:27.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.665+0000 7f7f10399640 1 -- 172.21.15.132:0/276528627 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7eec06a430 msgr2=0x7f7eec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:27.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.665+0000 7f7f10399640 1 --2- 172.21.15.132:0/276528627 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7eec06a430 0x7f7eec06c8f0 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f7f080ca420 tx=0x7f7ef8007b90 comp rx=0 tx=0).stop 2023-12-20T04:49:27.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.665+0000 7f7f10399640 1 -- 172.21.15.132:0/276528627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080b4980 msgr2=0x7f7f08156f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:27.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.665+0000 7f7f10399640 1 --2- 172.21.15.132:0/276528627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080b4980 0x7f7f08156f40 secure :-1 s=READY pgs=1479 cs=0 l=1 rev1=1 crypto rx=0x7f7f0400c730 tx=0x7f7f0400cbf0 comp rx=0 tx=0).stop 2023-12-20T04:49:27.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.665+0000 7f7f10399640 1 -- 172.21.15.132:0/276528627 shutdown_connections 2023-12-20T04:49:27.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.665+0000 7f7f10399640 1 --2- 172.21.15.132:0/276528627 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7eec06a430 0x7f7eec06c8f0 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:27.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.665+0000 7f7f10399640 1 --2- 172.21.15.132:0/276528627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7f08160450 0x7f7f081580e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:27.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.665+0000 7f7f10399640 1 --2- 172.21.15.132:0/276528627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7f080b4de0 0x7f7f080ccc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:27.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.665+0000 7f7f10399640 1 --2- 172.21.15.132:0/276528627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7f080b4980 0x7f7f08156f40 unknown :-1 s=CLOSED pgs=1479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:27.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.665+0000 7f7f10399640 1 -- 172.21.15.132:0/276528627 >> 172.21.15.132:0/276528627 conn(0x7f7f080cf980 msgr2=0x7f7f0815e090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:27.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.665+0000 7f7f10399640 1 -- 172.21.15.132:0/276528627 shutdown_connections 2023-12-20T04:49:27.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.665+0000 7f7f10399640 1 -- 172.21.15.132:0/276528627 wait complete. 2023-12-20T04:49:27.678 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-20T04:49:27.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.781+0000 7ff0c97a9640 1 Processor -- start 2023-12-20T04:49:27.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.781+0000 7ff0c97a9640 1 -- start start 2023-12-20T04:49:27.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.781+0000 7ff0c97a9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0c415d300 0x7ff0c40d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:27.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.781+0000 7ff0c97a9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0c40d1550 0x7ff0c40cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:27.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.781+0000 7ff0c97a9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff0c40d1a90 con 0x7ff0c40cfdc0 2023-12-20T04:49:27.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.781+0000 7ff0c97a9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0c40d0230 con 0x7ff0c40d1550 2023-12-20T04:49:27.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.781+0000 7ff0c97a9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c40d1d70 con 0x7ff0c415d300 2023-12-20T04:49:27.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.781+0000 7ff0c27fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0c40d1550 0x7ff0c40cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:27.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.782+0000 7ff0c27fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0c40d1550 0x7ff0c40cf880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45052/0 (socket says 172.21.15.132:45052) 2023-12-20T04:49:27.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.782+0000 7ff0c37fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff0c40cfdc0 0x7ff0c40b48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34580/0 (socket says 172.21.15.132:34580) 2023-12-20T04:49:27.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.782+0000 7ff0c27fc640 1 -- 172.21.15.132:0/1564258990 learned_addr learned my addr 172.21.15.132:0/1564258990 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:27.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.782+0000 7ff0c2ffd640 1 --2- 172.21.15.132:0/1564258990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0c415d300 0x7ff0c40d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:27.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.782+0000 7ff0c27fc640 1 -- 172.21.15.132:0/1564258990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0c415d300 msgr2=0x7ff0c40d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:27.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.782+0000 7ff0c27fc640 1 --2- 172.21.15.132:0/1564258990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0c415d300 0x7ff0c40d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:27.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.782+0000 7ff0c27fc640 1 -- 172.21.15.132:0/1564258990 >> v1:172.21.15.132:6789/0 conn(0x7ff0c40cfdc0 legacy=0x7ff0c40b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:27.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.782+0000 7ff0c27fc640 1 -- 172.21.15.132:0/1564258990 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0c40d2050 con 0x7ff0c40d1550 2023-12-20T04:49:27.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.782+0000 7ff0c1ffb640 1 -- 172.21.15.132:0/1564258990 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2073843314 0 0) 0x7ff0c40d1a90 con 0x7ff0c40cfdc0 2023-12-20T04:49:27.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.782+0000 7ff0c2ffd640 1 --2- 172.21.15.132:0/1564258990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0c415d300 0x7ff0c40d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:27.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.783+0000 7ff0c27fc640 1 --2- 172.21.15.132:0/1564258990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c40d1550 0x7ff0c40cf880 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009850 tx=0x7ff0ac02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ddc808257824a48 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:27.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.783+0000 7ff0c1ffb640 1 -- 172.21.15.132:0/1564258990 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac004230 con 0x7ff0c40d1550 2023-12-20T04:49:27.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.783+0000 7ff0c1ffb640 1 -- 172.21.15.132:0/1564258990 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0ac004390 con 0x7ff0c40d1550 2023-12-20T04:49:27.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.783+0000 7ff0c1ffb640 1 -- 172.21.15.132:0/1564258990 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0ac003810 con 0x7ff0c40d1550 2023-12-20T04:49:27.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.783+0000 7ff0c97a9640 1 -- 172.21.15.132:0/1564258990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c40d1550 msgr2=0x7ff0c40cf880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:27.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.783+0000 7ff0c97a9640 1 --2- 172.21.15.132:0/1564258990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c40d1550 0x7ff0c40cf880 secure :-1 s=READY pgs=1481 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac009850 tx=0x7ff0ac02b960 comp rx=0 tx=0).stop 2023-12-20T04:49:27.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.783+0000 7ff0c97a9640 1 -- 172.21.15.132:0/1564258990 shutdown_connections 2023-12-20T04:49:27.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.783+0000 7ff0c97a9640 1 --2- 172.21.15.132:0/1564258990 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c40d1550 0x7ff0c40cf880 unknown :-1 s=CLOSED pgs=1481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:27.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.783+0000 7ff0c97a9640 1 --2- 172.21.15.132:0/1564258990 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0c415d300 0x7ff0c40d1010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:27.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.783+0000 7ff0c97a9640 1 -- 172.21.15.132:0/1564258990 >> 172.21.15.132:0/1564258990 conn(0x7ff0c406a3d0 msgr2=0x7ff0c406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:27.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.783+0000 7ff0c97a9640 1 -- 172.21.15.132:0/1564258990 shutdown_connections 2023-12-20T04:49:27.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.783+0000 7ff0c97a9640 1 -- 172.21.15.132:0/1564258990 wait complete. 2023-12-20T04:49:27.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.785+0000 7ff0c97a9640 1 Processor -- start 2023-12-20T04:49:27.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.785+0000 7ff0c97a9640 1 -- start start 2023-12-20T04:49:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.785+0000 7ff0c97a9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c40cfdc0 0x7ff0c414a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.785+0000 7ff0c97a9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0c40d1550 0x7ff0c40b4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.785+0000 7ff0c97a9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0c415d300 0x7ff0c40c8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.785+0000 7ff0c97a9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c40b52e0 con 0x7ff0c40cfdc0 2023-12-20T04:49:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.785+0000 7ff0c97a9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c40b4910 con 0x7ff0c415d300 2023-12-20T04:49:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.785+0000 7ff0c97a9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0c40b3d00 con 0x7ff0c40d1550 2023-12-20T04:49:27.788 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.785+0000 7ff0c2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c40cfdc0 0x7ff0c414a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:27.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.785+0000 7ff0c2ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c40cfdc0 0x7ff0c414a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45060/0 (socket says 172.21.15.132:45060) 2023-12-20T04:49:27.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.785+0000 7ff0c2ffd640 1 -- 172.21.15.132:0/1196046925 learned_addr learned my addr 172.21.15.132:0/1196046925 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:27.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.786+0000 7ff0c27fc640 1 --2- 172.21.15.132:0/1196046925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0c40d1550 0x7ff0c40b4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:27.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.786+0000 7ff0c37fe640 1 --2- 172.21.15.132:0/1196046925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0c415d300 0x7ff0c40c8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:27.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.786+0000 7ff0c2ffd640 1 -- 172.21.15.132:0/1196046925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0c40d1550 msgr2=0x7ff0c40b4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:27.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.786+0000 7ff0c2ffd640 1 --2- 172.21.15.132:0/1196046925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0c40d1550 0x7ff0c40b4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:27.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.786+0000 7ff0c2ffd640 1 -- 172.21.15.132:0/1196046925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0c415d300 msgr2=0x7ff0c40c8e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:27.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.786+0000 7ff0c2ffd640 1 --2- 172.21.15.132:0/1196046925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0c415d300 0x7ff0c40c8e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:27.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.786+0000 7ff0c2ffd640 1 -- 172.21.15.132:0/1196046925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0ac009460 con 0x7ff0c40cfdc0 2023-12-20T04:49:27.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.786+0000 7ff0c27fc640 1 --2- 172.21.15.132:0/1196046925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0c40d1550 0x7ff0c40b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:27.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.786+0000 7ff0c2ffd640 1 --2- 172.21.15.132:0/1196046925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c40cfdc0 0x7ff0c414a410 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400d100 tx=0x7ff0b400d5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:27.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.786+0000 7ff0bb7fe640 1 -- 172.21.15.132:0/1196046925 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4003b90 con 0x7ff0c40cfdc0 2023-12-20T04:49:27.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.786+0000 7ff0bb7fe640 1 -- 172.21.15.132:0/1196046925 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0b400f040 con 0x7ff0c40cfdc0 2023-12-20T04:49:27.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.786+0000 7ff0c97a9640 1 -- 172.21.15.132:0/1196046925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0c40b3fe0 con 0x7ff0c40cfdc0 2023-12-20T04:49:27.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.786+0000 7ff0bb7fe640 1 -- 172.21.15.132:0/1196046925 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff0b4004030 con 0x7ff0c40cfdc0 2023-12-20T04:49:27.789 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.786+0000 7ff0c97a9640 1 -- 172.21.15.132:0/1196046925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0c40b45a0 con 0x7ff0c40cfdc0 2023-12-20T04:49:27.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.787+0000 7ff0c97a9640 1 -- 172.21.15.132:0/1196046925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0c404e840 con 0x7ff0c40cfdc0 2023-12-20T04:49:27.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.787+0000 7ff0bb7fe640 1 -- 172.21.15.132:0/1196046925 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff0b4004190 con 0x7ff0c40cfdc0 2023-12-20T04:49:27.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.788+0000 7ff0bb7fe640 1 --2- 172.21.15.132:0/1196046925 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0a406a460 0x7ff0a406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:27.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.788+0000 7ff0bb7fe640 1 -- 172.21.15.132:0/1196046925 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff0b40888c0 con 0x7ff0c40cfdc0 2023-12-20T04:49:27.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.788+0000 7ff0c27fc640 1 --2- 172.21.15.132:0/1196046925 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0a406a460 0x7ff0a406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:27.790 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.788+0000 7ff0c27fc640 1 --2- 172.21.15.132:0/1196046925 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0a406a460 0x7ff0a406c920 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac035000 tx=0x7ff0ac008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:27.793 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.792+0000 7ff0bb7fe640 1 -- 172.21.15.132:0/1196046925 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff0b4054260 con 0x7ff0c40cfdc0 2023-12-20T04:49:27.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.956+0000 7ff0c97a9640 1 -- 172.21.15.132:0/1196046925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff0c4154940 con 0x7ff0c40cfdc0 2023-12-20T04:49:27.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.959+0000 7ff0bb7fe640 1 -- 172.21.15.132:0/1196046925 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v16)=0 v16) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff0b401a0c0 con 0x7ff0c40cfdc0 2023-12-20T04:49:27.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.961+0000 7ff0c97a9640 1 -- 172.21.15.132:0/1196046925 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0a406a460 msgr2=0x7ff0a406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:27.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.961+0000 7ff0c97a9640 1 --2- 172.21.15.132:0/1196046925 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0a406a460 0x7ff0a406c920 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7ff0ac035000 tx=0x7ff0ac008030 comp rx=0 tx=0).stop 2023-12-20T04:49:27.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.961+0000 7ff0c97a9640 1 -- 172.21.15.132:0/1196046925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c40cfdc0 msgr2=0x7ff0c414a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:27.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.961+0000 7ff0c97a9640 1 --2- 172.21.15.132:0/1196046925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c40cfdc0 0x7ff0c414a410 secure :-1 s=READY pgs=1482 cs=0 l=1 rev1=1 crypto rx=0x7ff0b400d100 tx=0x7ff0b400d5c0 comp rx=0 tx=0).stop 2023-12-20T04:49:27.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.961+0000 7ff0c97a9640 1 -- 172.21.15.132:0/1196046925 shutdown_connections 2023-12-20T04:49:27.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.961+0000 7ff0c97a9640 1 --2- 172.21.15.132:0/1196046925 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff0a406a460 0x7ff0a406c920 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:27.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.961+0000 7ff0c97a9640 1 --2- 172.21.15.132:0/1196046925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff0c415d300 0x7ff0c40c8e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:27.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.961+0000 7ff0c97a9640 1 --2- 172.21.15.132:0/1196046925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0c40d1550 0x7ff0c40b4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:27.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.961+0000 7ff0c97a9640 1 --2- 172.21.15.132:0/1196046925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0c40cfdc0 0x7ff0c414a410 unknown :-1 s=CLOSED pgs=1482 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:27.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.961+0000 7ff0c97a9640 1 -- 172.21.15.132:0/1196046925 >> 172.21.15.132:0/1196046925 conn(0x7ff0c406a3d0 msgr2=0x7ff0c40d3500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:27.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.961+0000 7ff0c97a9640 1 -- 172.21.15.132:0/1196046925 shutdown_connections 2023-12-20T04:49:27.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:27.961+0000 7ff0c97a9640 1 -- 172.21.15.132:0/1196046925 wait complete. 2023-12-20T04:49:27.973 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:49:27.973 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:49:28.029 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:49:28.076 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:49:28.076 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:49:28.076 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:49:28.091 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:49:28.091 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:49:28.092 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:49:28.108 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 none /run/credentials/systemd-tmpfiles-clean.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 2023-12-20T04:49:28.108 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:49:28.108 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:49:28.146 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:49:28.146 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:49:28.146 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:49:28.165 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:49:28.165 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-20T04:49:28.165 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:49:28.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.285+0000 7ff626d9f640 1 Processor -- start 2023-12-20T04:49:28.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.285+0000 7ff626d9f640 1 -- start start 2023-12-20T04:49:28.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff626d9f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff62006a340 0x7ff6200708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:28.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff626d9f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff620141660 con 0x7ff62013e690 2023-12-20T04:49:28.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff626d9f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff620140ae0 con 0x7ff62013df60 2023-12-20T04:49:28.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff626d9f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff620155a30 con 0x7ff62006a340 2023-12-20T04:49:28.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff62013e690 0x7ff620069c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34590/0 (socket says 172.21.15.132:34590) 2023-12-20T04:49:28.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61ffff640 1 -- 172.21.15.132:0/2828002491 learned_addr learned my addr 172.21.15.132:0/2828002491 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:28.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff62533c640 1 --2- 172.21.15.132:0/2828002491 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff62006a340 0x7ff6200708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:28.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61f7fe640 1 -- 172.21.15.132:0/2828002491 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2126715637 0 0) 0x7ff620141660 con 0x7ff62013e690 2023-12-20T04:49:28.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61f7fe640 1 -- 172.21.15.132:0/2828002491 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff610003520 con 0x7ff62013e690 2023-12-20T04:49:28.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61f7fe640 1 -- 172.21.15.132:0/2828002491 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4178831757 0 0) 0x7ff620140ae0 con 0x7ff62013df60 2023-12-20T04:49:28.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61f7fe640 1 -- 172.21.15.132:0/2828002491 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff620141660 con 0x7ff62013df60 2023-12-20T04:49:28.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61f7fe640 1 -- 172.21.15.132:0/2828002491 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3645259995 0 0) 0x7ff610003520 con 0x7ff62013e690 2023-12-20T04:49:28.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61f7fe640 1 -- 172.21.15.132:0/2828002491 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff62006a340 msgr2=0x7ff6200708d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:28.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61f7fe640 1 --2- 172.21.15.132:0/2828002491 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff62006a340 0x7ff6200708d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:28.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61f7fe640 1 -- 172.21.15.132:0/2828002491 >> v1:172.21.15.187:6789/0 conn(0x7ff62013df60 legacy=0x7ff6200caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:28.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61f7fe640 1 -- 172.21.15.132:0/2828002491 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff620140dc0 con 0x7ff62013e690 2023-12-20T04:49:28.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61f7fe640 1 -- 172.21.15.132:0/2828002491 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7ff60c001670 con 0x7ff62013e690 2023-12-20T04:49:28.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61f7fe640 1 -- 172.21.15.132:0/2828002491 >> v1:172.21.15.132:6789/0 conn(0x7ff62013e690 legacy=0x7ff620069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:28.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61f7fe640 1 --2- 172.21.15.132:0/2828002491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff610003b30 0x7ff610003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:28.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61f7fe640 1 --2- 172.21.15.132:0/2828002491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6100047c0 0x7ff610004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:28.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61f7fe640 1 --2- 172.21.15.132:0/2828002491 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff62006a340 0x7ff6100051a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:28.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61f7fe640 1 -- 172.21.15.132:0/2828002491 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61000ba90 con 0x7ff610003b30 2023-12-20T04:49:28.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61f7fe640 1 -- 172.21.15.132:0/2828002491 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff61000bc00 con 0x7ff6100047c0 2023-12-20T04:49:28.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61f7fe640 1 -- 172.21.15.132:0/2828002491 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff61000bdc0 con 0x7ff62006a340 2023-12-20T04:49:28.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff624b3b640 1 --2- 172.21.15.132:0/2828002491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff610003b30 0x7ff610003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:28.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff61ffff640 1 --2- 172.21.15.132:0/2828002491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6100047c0 0x7ff610004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:28.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.286+0000 7ff62533c640 1 --2- 172.21.15.132:0/2828002491 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff62006a340 0x7ff6100051a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:28.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.287+0000 7ff624b3b640 1 -- 172.21.15.132:0/2828002491 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff62006a340 msgr2=0x7ff6100051a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:28.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.287+0000 7ff624b3b640 1 --2- 172.21.15.132:0/2828002491 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff62006a340 0x7ff6100051a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:28.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.287+0000 7ff624b3b640 1 -- 172.21.15.132:0/2828002491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6100047c0 msgr2=0x7ff610004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:28.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.287+0000 7ff624b3b640 1 --2- 172.21.15.132:0/2828002491 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6100047c0 0x7ff610004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:28.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.287+0000 7ff624b3b640 1 -- 172.21.15.132:0/2828002491 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff610003520 con 0x7ff610003b30 2023-12-20T04:49:28.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.287+0000 7ff624b3b640 1 --2- 172.21.15.132:0/2828002491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff610003b30 0x7ff610003f30 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7ff6140018f0 tx=0x7ff6100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b42723549a6739e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:28.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.287+0000 7ff61f7fe640 1 -- 172.21.15.132:0/2828002491 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6140052d0 con 0x7ff610003b30 2023-12-20T04:49:28.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.287+0000 7ff61f7fe640 1 -- 172.21.15.132:0/2828002491 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff614005430 con 0x7ff610003b30 2023-12-20T04:49:28.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.287+0000 7ff61f7fe640 1 -- 172.21.15.132:0/2828002491 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff614003860 con 0x7ff610003b30 2023-12-20T04:49:28.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.288+0000 7ff626d9f640 1 -- 172.21.15.132:0/2828002491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff610003b30 msgr2=0x7ff610003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:28.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.288+0000 7ff626d9f640 1 --2- 172.21.15.132:0/2828002491 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff610003b30 0x7ff610003f30 secure :-1 s=READY pgs=1484 cs=0 l=1 rev1=1 crypto rx=0x7ff6140018f0 tx=0x7ff6100057f0 comp rx=0 tx=0).stop 2023-12-20T04:49:28.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.288+0000 7ff62533c640 1 -- 172.21.15.132:0/2828002491 reap_dead start 2023-12-20T04:49:28.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.288+0000 7ff626d9f640 1 -- 172.21.15.132:0/2828002491 shutdown_connections 2023-12-20T04:49:28.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.288+0000 7ff626d9f640 1 -- 172.21.15.132:0/2828002491 >> 172.21.15.132:0/2828002491 conn(0x7ff6200cfbd0 msgr2=0x7ff6200cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:28.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.288+0000 7ff626d9f640 1 -- 172.21.15.132:0/2828002491 shutdown_connections 2023-12-20T04:49:28.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.288+0000 7ff626d9f640 1 -- 172.21.15.132:0/2828002491 wait complete. 2023-12-20T04:49:28.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.289+0000 7ff626d9f640 1 Processor -- start 2023-12-20T04:49:28.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.289+0000 7ff626d9f640 1 -- start start 2023-12-20T04:49:28.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.290+0000 7ff626d9f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff610003b30 0x7ff620131de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:28.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.290+0000 7ff626d9f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6201314b0 0x7ff6200cd750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:28.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.290+0000 7ff626d9f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6200cdc90 0x7ff6200b28d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:28.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.290+0000 7ff626d9f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff62013c7f0 con 0x7ff6200cdc90 2023-12-20T04:49:28.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.290+0000 7ff626d9f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6200ce2c0 con 0x7ff610003b30 2023-12-20T04:49:28.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.290+0000 7ff626d9f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6200ce5a0 con 0x7ff6201314b0 2023-12-20T04:49:28.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.290+0000 7ff62533c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6200cdc90 0x7ff6200b28d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:28.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.290+0000 7ff62533c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6200cdc90 0x7ff6200b28d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45078/0 (socket says 172.21.15.132:45078) 2023-12-20T04:49:28.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.290+0000 7ff62533c640 1 -- 172.21.15.132:0/294283681 learned_addr learned my addr 172.21.15.132:0/294283681 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:28.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.290+0000 7ff624b3b640 1 --2- 172.21.15.132:0/294283681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff610003b30 0x7ff620131de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:28.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.290+0000 7ff61ffff640 1 --2- 172.21.15.132:0/294283681 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6201314b0 0x7ff6200cd750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:28.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.290+0000 7ff62533c640 1 -- 172.21.15.132:0/294283681 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6201314b0 msgr2=0x7ff6200cd750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:28.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.290+0000 7ff62533c640 1 --2- 172.21.15.132:0/294283681 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6201314b0 0x7ff6200cd750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:28.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.290+0000 7ff62533c640 1 -- 172.21.15.132:0/294283681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff610003b30 msgr2=0x7ff620131de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:28.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.290+0000 7ff62533c640 1 --2- 172.21.15.132:0/294283681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff610003b30 0x7ff620131de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:28.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.290+0000 7ff62533c640 1 -- 172.21.15.132:0/294283681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6200ce880 con 0x7ff6200cdc90 2023-12-20T04:49:28.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.290+0000 7ff624b3b640 1 --2- 172.21.15.132:0/294283681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff610003b30 0x7ff620131de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:28.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.291+0000 7ff62533c640 1 --2- 172.21.15.132:0/294283681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6200cdc90 0x7ff6200b28d0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7ff620070510 tx=0x7ff61800f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:28.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.291+0000 7ff61d7fa640 1 -- 172.21.15.132:0/294283681 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff61800e040 con 0x7ff6200cdc90 2023-12-20T04:49:28.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.291+0000 7ff61d7fa640 1 -- 172.21.15.132:0/294283681 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff61800f040 con 0x7ff6200cdc90 2023-12-20T04:49:28.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.291+0000 7ff626d9f640 1 -- 172.21.15.132:0/294283681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6200ceb60 con 0x7ff6200cdc90 2023-12-20T04:49:28.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.291+0000 7ff61d7fa640 1 -- 172.21.15.132:0/294283681 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff618015670 con 0x7ff6200cdc90 2023-12-20T04:49:28.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.291+0000 7ff626d9f640 1 -- 172.21.15.132:0/294283681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff620132320 con 0x7ff6200cdc90 2023-12-20T04:49:28.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.292+0000 7ff626d9f640 1 -- 172.21.15.132:0/294283681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6200cf080 con 0x7ff6200cdc90 2023-12-20T04:49:28.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.292+0000 7ff61d7fa640 1 -- 172.21.15.132:0/294283681 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff6180157d0 con 0x7ff6200cdc90 2023-12-20T04:49:28.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.292+0000 7ff61d7fa640 1 --2- 172.21.15.132:0/294283681 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff60406a460 0x7ff60406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:28.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.292+0000 7ff61d7fa640 1 -- 172.21.15.132:0/294283681 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(144..144 src has 1..144) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff618088dc0 con 0x7ff6200cdc90 2023-12-20T04:49:28.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.293+0000 7ff624b3b640 1 --2- 172.21.15.132:0/294283681 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff60406a460 0x7ff60406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:28.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.293+0000 7ff624b3b640 1 --2- 172.21.15.132:0/294283681 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff60406a460 0x7ff60406c920 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff614034000 tx=0x7ff614031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:28.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.297+0000 7ff61d7fa640 1 -- 172.21.15.132:0/294283681 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff6180546b0 con 0x7ff6200cdc90 2023-12-20T04:49:28.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.495+0000 7ff626d9f640 1 -- 172.21.15.132:0/294283681 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff62004e840 con 0x7ff6200cdc90 2023-12-20T04:49:28.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.496+0000 7ff61d7fa640 1 -- 172.21.15.132:0/294283681 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 53 v53) v1 ==== 94+0+3541 (secure 0 0 0) 0x7ff618057cd0 con 0x7ff6200cdc90 2023-12-20T04:49:28.497 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:28.497 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":53,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6763,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1413044191","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1413044191},{"type":"v1","addr":"172.21.15.132:6837","nonce":1413044191}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":6781,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1584197959","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1584197959},{"type":"v1","addr":"172.21.15.187:6834","nonce":1584197959}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48},{"gid":7036,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2679542920","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2679542920},{"type":"v1","addr":"172.21.15.187:6835","nonce":2679542920}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":53},{"gid":7830,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/3080885824","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3080885824},{"type":"v1","addr":"172.21.15.132:6836","nonce":3080885824}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":48}],"filesystems":[]} 2023-12-20T04:49:28.497 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 53 2023-12-20T04:49:28.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.497+0000 7ff626d9f640 1 -- 172.21.15.132:0/294283681 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff60406a460 msgr2=0x7ff60406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:28.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.497+0000 7ff626d9f640 1 --2- 172.21.15.132:0/294283681 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff60406a460 0x7ff60406c920 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7ff614034000 tx=0x7ff614031000 comp rx=0 tx=0).stop 2023-12-20T04:49:28.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.497+0000 7ff626d9f640 1 -- 172.21.15.132:0/294283681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6200cdc90 msgr2=0x7ff6200b28d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:28.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.497+0000 7ff626d9f640 1 --2- 172.21.15.132:0/294283681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6200cdc90 0x7ff6200b28d0 secure :-1 s=READY pgs=1485 cs=0 l=1 rev1=1 crypto rx=0x7ff620070510 tx=0x7ff61800f580 comp rx=0 tx=0).stop 2023-12-20T04:49:28.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.497+0000 7ff626d9f640 1 -- 172.21.15.132:0/294283681 shutdown_connections 2023-12-20T04:49:28.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.497+0000 7ff626d9f640 1 --2- 172.21.15.132:0/294283681 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff60406a460 0x7ff60406c920 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:28.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.497+0000 7ff626d9f640 1 --2- 172.21.15.132:0/294283681 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6200cdc90 0x7ff6200b28d0 unknown :-1 s=CLOSED pgs=1485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:28.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.498+0000 7ff626d9f640 1 --2- 172.21.15.132:0/294283681 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6201314b0 0x7ff6200cd750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:28.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.498+0000 7ff626d9f640 1 --2- 172.21.15.132:0/294283681 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff610003b30 0x7ff620131de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:28.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.498+0000 7ff626d9f640 1 -- 172.21.15.132:0/294283681 >> 172.21.15.132:0/294283681 conn(0x7ff6200cfbd0 msgr2=0x7ff620159df0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:28.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.498+0000 7ff626d9f640 1 -- 172.21.15.132:0/294283681 shutdown_connections 2023-12-20T04:49:28.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.498+0000 7ff626d9f640 1 -- 172.21.15.132:0/294283681 wait complete. 2023-12-20T04:49:28.510 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-20T04:49:28.510 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-20T04:49:28.510 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-20T04:49:28.510 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:49:28.510 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-20T04:49:28.510 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-20T04:49:28.511 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-20T04:49:28.511 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:49:28.511 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-20T04:49:28.511 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-20T04:49:28.511 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-20T04:49:28.511 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:49:28.511 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-20T04:49:28.511 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-20T04:49:28.512 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-20T04:49:28.512 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:49:28.519 INFO:tasks.ceph.mds.a:Stopped 2023-12-20T04:49:28.519 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-20T04:49:28.520 INFO:tasks.ceph.mds.c:Stopped 2023-12-20T04:49:28.520 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-20T04:49:28.521 INFO:tasks.ceph.mds.b:Stopped 2023-12-20T04:49:28.521 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-20T04:49:28.522 INFO:tasks.ceph.mds.d:Stopped 2023-12-20T04:49:28.522 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-20T04:49:28.562 INFO:tasks.ceph.mds.a:Started 2023-12-20T04:49:28.562 DEBUG:teuthology.parallel:result is None 2023-12-20T04:49:28.563 INFO:tasks.ceph.mds.c:Started 2023-12-20T04:49:28.563 DEBUG:teuthology.parallel:result is None 2023-12-20T04:49:28.564 INFO:tasks.ceph.mds.b:Started 2023-12-20T04:49:28.564 DEBUG:teuthology.parallel:result is None 2023-12-20T04:49:28.564 INFO:tasks.ceph.mds.d:Started 2023-12-20T04:49:28.565 DEBUG:teuthology.parallel:result is None 2023-12-20T04:49:28.565 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-20T04:49:28.639 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-12-20T04:49:28.639 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-12-20T04:49:28.643 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-12-20T04:49:28.643 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-12-20T04:49:28.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.671+0000 7f014dc2c640 1 Processor -- start 2023-12-20T04:49:28.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.672+0000 7f014dc2c640 1 -- start start 2023-12-20T04:49:28.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.672+0000 7f014dc2c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f014815d2c0 0x7f01480cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:28.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.672+0000 7f014dc2c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f01480d0060 0x7f01480d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:28.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.672+0000 7f014dc2c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f01480d0cf0 con 0x7f01480d30a0 2023-12-20T04:49:28.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.672+0000 7f014dc2c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01480d0550 con 0x7f01480d0060 2023-12-20T04:49:28.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.672+0000 7f014dc2c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01480cddc0 con 0x7f014815d2c0 2023-12-20T04:49:28.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.672+0000 7f01477fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f01480d30a0 0x7f01480d3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34624/0 (socket says 172.21.15.132:34624) 2023-12-20T04:49:28.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.672+0000 7f01477fe640 1 -- 172.21.15.132:0/3219234107 learned_addr learned my addr 172.21.15.132:0/3219234107 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:28.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.673+0000 7f0147fff640 1 --2- 172.21.15.132:0/3219234107 >> v2:172.21.15.187:3300/0 conn(0x7f01480d0060 0x7f01480d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:28.674 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.673+0000 7f0146ffd640 1 --2- 172.21.15.132:0/3219234107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f014815d2c0 0x7f01480cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:28.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.673+0000 7f0147fff640 1 -- 172.21.15.132:0/3219234107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f014815d2c0 msgr2=0x7f01480cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:28.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.673+0000 7f0147fff640 1 --2- 172.21.15.132:0/3219234107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f014815d2c0 0x7f01480cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:28.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.673+0000 7f0147fff640 1 -- 172.21.15.132:0/3219234107 >> v1:172.21.15.132:6789/0 conn(0x7f01480d30a0 legacy=0x7f01480d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:28.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.673+0000 7f0147fff640 1 -- 172.21.15.132:0/3219234107 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01480ce0a0 con 0x7f01480d0060 2023-12-20T04:49:28.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.673+0000 7f0146ffd640 1 --2- 172.21.15.132:0/3219234107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f014815d2c0 0x7f01480cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:49:28.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.674+0000 7f0147fff640 1 --2- 172.21.15.132:0/3219234107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01480d0060 0x7f01480d1180 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0140009d90 tx=0x7f014002bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d323184c7d9794ad server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:28.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.674+0000 7f01467fc640 1 -- 172.21.15.132:0/3219234107 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f014002cc50 con 0x7f01480d0060 2023-12-20T04:49:28.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.674+0000 7f01467fc640 1 -- 172.21.15.132:0/3219234107 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f014002cdb0 con 0x7f01480d0060 2023-12-20T04:49:28.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.674+0000 7f01467fc640 1 -- 172.21.15.132:0/3219234107 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140034660 con 0x7f01480d0060 2023-12-20T04:49:28.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.674+0000 7f014dc2c640 1 -- 172.21.15.132:0/3219234107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01480d0060 msgr2=0x7f01480d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:28.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.674+0000 7f014dc2c640 1 --2- 172.21.15.132:0/3219234107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01480d0060 0x7f01480d1180 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f0140009d90 tx=0x7f014002bea0 comp rx=0 tx=0).stop 2023-12-20T04:49:28.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.675+0000 7f014dc2c640 1 -- 172.21.15.132:0/3219234107 shutdown_connections 2023-12-20T04:49:28.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.675+0000 7f014dc2c640 1 --2- 172.21.15.132:0/3219234107 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01480d0060 0x7f01480d1180 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:28.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.675+0000 7f014dc2c640 1 --2- 172.21.15.132:0/3219234107 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f014815d2c0 0x7f01480cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:28.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.675+0000 7f014dc2c640 1 -- 172.21.15.132:0/3219234107 >> 172.21.15.132:0/3219234107 conn(0x7f0148072e40 msgr2=0x7f0148073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:28.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.675+0000 7f014dc2c640 1 -- 172.21.15.132:0/3219234107 shutdown_connections 2023-12-20T04:49:28.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.675+0000 7f014dc2c640 1 -- 172.21.15.132:0/3219234107 wait complete. 2023-12-20T04:49:28.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.676+0000 7f014dc2c640 1 Processor -- start 2023-12-20T04:49:28.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.676+0000 7f014dc2c640 1 -- start start 2023-12-20T04:49:28.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.677+0000 7f014dc2c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01480d0060 0x7f01481f55c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:28.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.677+0000 7f014dc2c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01480d30a0 0x7f01480c8ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:28.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.677+0000 7f014dc2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f014815d2c0 0x7f014814b780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:28.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.677+0000 7f014dc2c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01480c8a40 con 0x7f014815d2c0 2023-12-20T04:49:28.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.677+0000 7f014dc2c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01481f5b00 con 0x7f01480d0060 2023-12-20T04:49:28.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.677+0000 7f014dc2c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f014814c220 con 0x7f01480d30a0 2023-12-20T04:49:28.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.677+0000 7f0147fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f014815d2c0 0x7f014814b780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:28.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.677+0000 7f0147fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f014815d2c0 0x7f014814b780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45122/0 (socket says 172.21.15.132:45122) 2023-12-20T04:49:28.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.677+0000 7f0147fff640 1 -- 172.21.15.132:0/1183886080 learned_addr learned my addr 172.21.15.132:0/1183886080 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:28.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.677+0000 7f01477fe640 1 --2- 172.21.15.132:0/1183886080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01480d0060 0x7f01481f55c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:28.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.677+0000 7f0146ffd640 1 --2- 172.21.15.132:0/1183886080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01480d30a0 0x7f01480c8ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:28.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.677+0000 7f0147fff640 1 -- 172.21.15.132:0/1183886080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01480d30a0 msgr2=0x7f01480c8ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:28.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.677+0000 7f0147fff640 1 --2- 172.21.15.132:0/1183886080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01480d30a0 0x7f01480c8ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:28.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.677+0000 7f0147fff640 1 -- 172.21.15.132:0/1183886080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01480d0060 msgr2=0x7f01481f55c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:28.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.677+0000 7f0147fff640 1 --2- 172.21.15.132:0/1183886080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01480d0060 0x7f01481f55c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:28.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.677+0000 7f0147fff640 1 -- 172.21.15.132:0/1183886080 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0130009400 con 0x7f014815d2c0 2023-12-20T04:49:28.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.677+0000 7f0147fff640 1 --2- 172.21.15.132:0/1183886080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f014815d2c0 0x7f014814b780 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f0140009d90 tx=0x7f0140004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:28.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.682+0000 7f013ffff640 1 -- 172.21.15.132:0/1183886080 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0140040650 con 0x7f014815d2c0 2023-12-20T04:49:28.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.682+0000 7f014dc2c640 1 -- 172.21.15.132:0/1183886080 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0140009a70 con 0x7f014815d2c0 2023-12-20T04:49:28.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.682+0000 7f014dc2c640 1 -- 172.21.15.132:0/1183886080 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01480c86d0 con 0x7f014815d2c0 2023-12-20T04:49:28.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.682+0000 7f013ffff640 1 -- 172.21.15.132:0/1183886080 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0140009450 con 0x7f014815d2c0 2023-12-20T04:49:28.683 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.682+0000 7f013ffff640 1 -- 172.21.15.132:0/1183886080 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01400409b0 con 0x7f014815d2c0 2023-12-20T04:49:28.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.683+0000 7f014dc2c640 1 -- 172.21.15.132:0/1183886080 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01480b8e00 con 0x7f014815d2c0 2023-12-20T04:49:28.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.683+0000 7f013ffff640 1 -- 172.21.15.132:0/1183886080 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0140040b10 con 0x7f014815d2c0 2023-12-20T04:49:28.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.684+0000 7f013ffff640 1 --2- 172.21.15.132:0/1183886080 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f012806a430 0x7f012806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:28.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.684+0000 7f013ffff640 1 -- 172.21.15.132:0/1183886080 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(148..148 src has 1..148) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f01400aaf40 con 0x7f014815d2c0 2023-12-20T04:49:28.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.684+0000 7f01477fe640 1 --2- 172.21.15.132:0/1183886080 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f012806a430 0x7f012806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:28.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.684+0000 7f01477fe640 1 --2- 172.21.15.132:0/1183886080 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f012806a430 0x7f012806c8f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0138005880 tx=0x7f0138009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:28.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.688+0000 7f013ffff640 1 -- 172.21.15.132:0/1183886080 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0140076980 con 0x7f014815d2c0 2023-12-20T04:49:28.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:28.864+0000 7f014dc2c640 1 -- 172.21.15.132:0/1183886080 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f01480c8bf0 con 0x7f014815d2c0 2023-12-20T04:49:29.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.690+0000 7f013ffff640 1 -- 172.21.15.132:0/1183886080 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v149) v1 ==== 97+0+0 (secure 0 0 0) 0x7f01480c8bf0 con 0x7f014815d2c0 2023-12-20T04:49:29.693 INFO:teuthology.orchestra.run.smithi132.stderr: removed all blocklist entries 2023-12-20T04:49:29.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.692+0000 7f014dc2c640 1 -- 172.21.15.132:0/1183886080 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f012806a430 msgr2=0x7f012806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:29.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.692+0000 7f014dc2c640 1 --2- 172.21.15.132:0/1183886080 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f012806a430 0x7f012806c8f0 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7f0138005880 tx=0x7f0138009040 comp rx=0 tx=0).stop 2023-12-20T04:49:29.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.692+0000 7f014dc2c640 1 -- 172.21.15.132:0/1183886080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f014815d2c0 msgr2=0x7f014814b780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:29.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.692+0000 7f014dc2c640 1 --2- 172.21.15.132:0/1183886080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f014815d2c0 0x7f014814b780 secure :-1 s=READY pgs=1494 cs=0 l=1 rev1=1 crypto rx=0x7f0140009d90 tx=0x7f0140004a40 comp rx=0 tx=0).stop 2023-12-20T04:49:29.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.692+0000 7f014dc2c640 1 -- 172.21.15.132:0/1183886080 shutdown_connections 2023-12-20T04:49:29.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.692+0000 7f014dc2c640 1 --2- 172.21.15.132:0/1183886080 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f012806a430 0x7f012806c8f0 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:29.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.692+0000 7f014dc2c640 1 --2- 172.21.15.132:0/1183886080 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f014815d2c0 0x7f014814b780 unknown :-1 s=CLOSED pgs=1494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:29.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.692+0000 7f014dc2c640 1 --2- 172.21.15.132:0/1183886080 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01480d30a0 0x7f01480c8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:29.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.692+0000 7f014dc2c640 1 --2- 172.21.15.132:0/1183886080 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01480d0060 0x7f01481f55c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:29.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.692+0000 7f014dc2c640 1 -- 172.21.15.132:0/1183886080 >> 172.21.15.132:0/1183886080 conn(0x7f0148072e40 msgr2=0x7f01480d3480 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:29.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.693+0000 7f014dc2c640 1 -- 172.21.15.132:0/1183886080 shutdown_connections 2023-12-20T04:49:29.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.693+0000 7f014dc2c640 1 -- 172.21.15.132:0/1183886080 wait complete. 2023-12-20T04:49:29.706 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-20T04:49:29.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.803+0000 7f8de342b640 1 Processor -- start 2023-12-20T04:49:29.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.803+0000 7f8de342b640 1 -- start start 2023-12-20T04:49:29.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.804+0000 7f8de342b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8ddc0b4de0 0x7f8ddc0d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:29.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.804+0000 7f8de342b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ddc0b5ec0 con 0x7f8ddc0b4980 2023-12-20T04:49:29.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.804+0000 7f8de342b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ddc1617e0 con 0x7f8ddc160450 2023-12-20T04:49:29.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.804+0000 7f8de342b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ddc0d0fc0 con 0x7f8ddc0b4de0 2023-12-20T04:49:29.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.804+0000 7f8de19c8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8ddc0b4de0 0x7f8ddc0d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:29.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.804+0000 7f8de19c8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8ddc0b4de0 0x7f8ddc0d21b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45134/0 (socket says 172.21.15.132:45134) 2023-12-20T04:49:29.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.804+0000 7f8de19c8640 1 -- 172.21.15.132:0/2251168244 learned_addr learned my addr 172.21.15.132:0/2251168244 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:29.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.805+0000 7f8de19c8640 1 -- 172.21.15.132:0/2251168244 >> v1:172.21.15.187:6789/0 conn(0x7f8ddc160450 legacy=0x7f8ddc160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:29.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.805+0000 7f8de19c8640 1 -- 172.21.15.132:0/2251168244 >> v1:172.21.15.132:6789/0 conn(0x7f8ddc0b4980 legacy=0x7f8ddc0d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:29.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.805+0000 7f8de19c8640 1 -- 172.21.15.132:0/2251168244 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ddc0d12a0 con 0x7f8ddc0b4de0 2023-12-20T04:49:29.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.805+0000 7f8de19c8640 1 --2- 172.21.15.132:0/2251168244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ddc0b4de0 0x7f8ddc0d21b0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc009870 tx=0x7f8dcc02ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c158a4723fdf439 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:29.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.806+0000 7f8ddbfff640 1 -- 172.21.15.132:0/2251168244 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc02f840 con 0x7f8ddc0b4de0 2023-12-20T04:49:29.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.806+0000 7f8ddbfff640 1 -- 172.21.15.132:0/2251168244 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dcc02f9a0 con 0x7f8ddc0b4de0 2023-12-20T04:49:29.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.806+0000 7f8ddbfff640 1 -- 172.21.15.132:0/2251168244 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dcc02fd30 con 0x7f8ddc0b4de0 2023-12-20T04:49:29.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.806+0000 7f8de342b640 1 -- 172.21.15.132:0/2251168244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ddc0b4de0 msgr2=0x7f8ddc0d21b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:29.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.806+0000 7f8de342b640 1 --2- 172.21.15.132:0/2251168244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ddc0b4de0 0x7f8ddc0d21b0 secure :-1 s=READY pgs=1496 cs=0 l=1 rev1=1 crypto rx=0x7f8dcc009870 tx=0x7f8dcc02ba20 comp rx=0 tx=0).stop 2023-12-20T04:49:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.806+0000 7f8de342b640 1 -- 172.21.15.132:0/2251168244 shutdown_connections 2023-12-20T04:49:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.806+0000 7f8de342b640 1 --2- 172.21.15.132:0/2251168244 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ddc0b4de0 0x7f8ddc0d21b0 unknown :-1 s=CLOSED pgs=1496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.806+0000 7f8de342b640 1 -- 172.21.15.132:0/2251168244 >> 172.21.15.132:0/2251168244 conn(0x7f8ddc0cf980 msgr2=0x7f8ddc0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.806+0000 7f8de342b640 1 -- 172.21.15.132:0/2251168244 shutdown_connections 2023-12-20T04:49:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.806+0000 7f8de342b640 1 -- 172.21.15.132:0/2251168244 wait complete. 2023-12-20T04:49:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.807+0000 7f8de342b640 1 Processor -- start 2023-12-20T04:49:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.807+0000 7f8de342b640 1 -- start start 2023-12-20T04:49:29.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.808+0000 7f8de342b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ddc0b4980 0x7f8ddc0ccc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:29.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.808+0000 7f8de342b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ddc0b4de0 0x7f8ddc1585b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:29.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.808+0000 7f8de342b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ddc160450 0x7f8ddc1541d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:29.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.808+0000 7f8de342b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc1599f0 con 0x7f8ddc0b4de0 2023-12-20T04:49:29.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.808+0000 7f8de342b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc158de0 con 0x7f8ddc160450 2023-12-20T04:49:29.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.808+0000 7f8de342b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ddc1590c0 con 0x7f8ddc0b4980 2023-12-20T04:49:29.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.808+0000 7f8de09c6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ddc0b4de0 0x7f8ddc1585b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:29.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.808+0000 7f8de09c6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ddc0b4de0 0x7f8ddc1585b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45140/0 (socket says 172.21.15.132:45140) 2023-12-20T04:49:29.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.808+0000 7f8de09c6640 1 -- 172.21.15.132:0/2123361710 learned_addr learned my addr 172.21.15.132:0/2123361710 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:29.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.808+0000 7f8de19c8640 1 --2- 172.21.15.132:0/2123361710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ddc160450 0x7f8ddc1541d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:29.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.808+0000 7f8de11c7640 1 --2- 172.21.15.132:0/2123361710 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ddc0b4980 0x7f8ddc0ccc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:29.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.808+0000 7f8de09c6640 1 -- 172.21.15.132:0/2123361710 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ddc0b4980 msgr2=0x7f8ddc0ccc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:29.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.808+0000 7f8de09c6640 1 --2- 172.21.15.132:0/2123361710 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ddc0b4980 0x7f8ddc0ccc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:29.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.808+0000 7f8de09c6640 1 -- 172.21.15.132:0/2123361710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ddc160450 msgr2=0x7f8ddc1541d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:29.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.808+0000 7f8de09c6640 1 --2- 172.21.15.132:0/2123361710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ddc160450 0x7f8ddc1541d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:29.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.808+0000 7f8de09c6640 1 -- 172.21.15.132:0/2123361710 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dcc0094d0 con 0x7f8ddc0b4de0 2023-12-20T04:49:29.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.808+0000 7f8de19c8640 1 --2- 172.21.15.132:0/2123361710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ddc160450 0x7f8ddc1541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:29.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.809+0000 7f8de09c6640 1 --2- 172.21.15.132:0/2123361710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ddc0b4de0 0x7f8ddc1585b0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f8dd000c450 tx=0x7f8dd000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:29.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.809+0000 7f8dd9ffb640 1 -- 172.21.15.132:0/2123361710 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd00052d0 con 0x7f8ddc0b4de0 2023-12-20T04:49:29.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.809+0000 7f8dd9ffb640 1 -- 172.21.15.132:0/2123361710 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd0005430 con 0x7f8ddc0b4de0 2023-12-20T04:49:29.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.809+0000 7f8de342b640 1 -- 172.21.15.132:0/2123361710 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ddc1593a0 con 0x7f8ddc0b4de0 2023-12-20T04:49:29.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.809+0000 7f8dd9ffb640 1 -- 172.21.15.132:0/2123361710 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0012870 con 0x7f8ddc0b4de0 2023-12-20T04:49:29.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.809+0000 7f8de342b640 1 -- 172.21.15.132:0/2123361710 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ddc158af0 con 0x7f8ddc0b4de0 2023-12-20T04:49:29.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.810+0000 7f8de342b640 1 -- 172.21.15.132:0/2123361710 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ddc04e840 con 0x7f8ddc0b4de0 2023-12-20T04:49:29.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.810+0000 7f8dd9ffb640 1 -- 172.21.15.132:0/2123361710 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8dd00129d0 con 0x7f8ddc0b4de0 2023-12-20T04:49:29.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.811+0000 7f8dd9ffb640 1 --2- 172.21.15.132:0/2123361710 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8dc806a430 0x7f8dc806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:29.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.811+0000 7f8dd9ffb640 1 -- 172.21.15.132:0/2123361710 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f8dd00880c0 con 0x7f8ddc0b4de0 2023-12-20T04:49:29.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.811+0000 7f8de11c7640 1 --2- 172.21.15.132:0/2123361710 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8dc806a430 0x7f8dc806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:29.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.811+0000 7f8de11c7640 1 --2- 172.21.15.132:0/2123361710 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8dc806a430 0x7f8dc806c8f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009f20 tx=0x7f8dd40094d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:29.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:29.815+0000 7f8dd9ffb640 1 -- 172.21.15.132:0/2123361710 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8dd0053a00 con 0x7f8ddc0b4de0 2023-12-20T04:49:30.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.044+0000 7f8de342b640 1 -- 172.21.15.132:0/2123361710 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f8ddc0d0ad0 con 0x7f8ddc0b4de0 2023-12-20T04:49:30.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.044+0000 7f8dd9ffb640 1 -- 172.21.15.132:0/2123361710 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v19) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f8dd0057020 con 0x7f8ddc0b4de0 2023-12-20T04:49:30.046 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:30.046 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:49:30.046 INFO:teuthology.orchestra.run.smithi132.stdout: "auth_dump": [ 2023-12-20T04:49:30.046 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.046 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.a", 2023-12-20T04:49:30.046 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlbTdZOxAAUDz0Eno9DYvrYM1xg5jG/A==", 2023-12-20T04:49:30.047 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.047 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:49:30.047 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:49:30.047 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:49:30.047 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:49:30.047 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.047 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.047 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.b", 2023-12-20T04:49:30.047 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl43gVDBAA1qJwUU+Ii4BalGf3NtJnGA==", 2023-12-20T04:49:30.047 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.047 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:49:30.047 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:49:30.047 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:49:30.047 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:49:30.048 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.048 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.c", 2023-12-20T04:49:30.048 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlaSUVBxAA7HN3dSo9xfvkjvc6bwMxWg==", 2023-12-20T04:49:30.048 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.048 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:49:30.048 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:49:30.048 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:49:30.048 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:49:30.048 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.048 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.d", 2023-12-20T04:49:30.049 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl1DR4ExAANNOyGlf1Ayre/xZEb9JHYg==", 2023-12-20T04:49:30.049 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.049 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:49:30.049 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:49:30.049 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:49:30.049 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:49:30.049 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.049 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.049 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.049 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.0", 2023-12-20T04:49:30.049 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCucIJlwZfxORAAiT2g1poLu3OkmoyxNJQc8Q==", 2023-12-20T04:49:30.049 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.049 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:49:30.049 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:49:30.049 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:49:30.050 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.050 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.050 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.050 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.1", 2023-12-20T04:49:30.050 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlejHYBRAAKurKpW5gyOAQ+E4Su4xMSQ==", 2023-12-20T04:49:30.050 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.050 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:49:30.050 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:49:30.050 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:49:30.050 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.050 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.050 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.050 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.2", 2023-12-20T04:49:30.050 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlyfz8DBAA9a6tUjHF8IRIKeldwVFMcw==", 2023-12-20T04:49:30.050 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.051 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:49:30.051 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:49:30.051 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:49:30.051 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.051 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.051 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.051 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.3", 2023-12-20T04:49:30.051 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJllFEeFBAA6URrqUjQqHsrI5+qEBVs3g==", 2023-12-20T04:49:30.051 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.051 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:49:30.051 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:49:30.051 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:49:30.051 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.051 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.051 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.051 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.4", 2023-12-20T04:49:30.051 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlvGqcJhAAgn2wuSTwLT+TOHoE4iaVSg==", 2023-12-20T04:49:30.052 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.052 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:49:30.052 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:49:30.052 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:49:30.052 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.052 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.052 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.5", 2023-12-20T04:49:30.052 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlWrkTLhAA2KlpxTFPaiXLCvmURpg5rw==", 2023-12-20T04:49:30.052 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.052 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:49:30.052 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:49:30.052 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:49:30.052 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.053 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.053 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.6", 2023-12-20T04:49:30.053 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlnOQfNRAA//EVx0BZYQd7ovK2tFhgfA==", 2023-12-20T04:49:30.053 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.053 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:49:30.053 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:49:30.053 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:49:30.053 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.053 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.053 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.053 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.7", 2023-12-20T04:49:30.053 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCzcIJl4nfDABAAtBdl2qkzKcqhmzsukC7G5w==", 2023-12-20T04:49:30.053 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.053 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:49:30.053 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:49:30.054 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:49:30.054 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.054 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.054 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.054 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.0", 2023-12-20T04:49:30.054 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlm/nGFxAA6zndayizc50Il7l74BxkgQ==", 2023-12-20T04:49:30.054 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.054 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:49:30.054 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow r", 2023-12-20T04:49:30.054 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-20T04:49:30.054 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.054 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.054 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.054 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.1", 2023-12-20T04:49:30.054 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlppb6IBAArqCoSlSE5coxkj4+XjPoWg==", 2023-12-20T04:49:30.055 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.055 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:49:30.055 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:49:30.055 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:49:30.055 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:49:30.055 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.055 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.055 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.2", 2023-12-20T04:49:30.055 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlMgWUHRAAqSdmRGx+9J+3dO7ntaApdw==", 2023-12-20T04:49:30.055 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.055 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:49:30.055 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:49:30.055 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:49:30.055 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:49:30.056 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.056 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.056 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.3", 2023-12-20T04:49:30.056 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlcIe3JhAAjv9KfknxwySJURWdePN7vw==", 2023-12-20T04:49:30.056 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.056 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:49:30.056 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:49:30.056 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:49:30.056 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:49:30.056 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.056 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.056 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.admin", 2023-12-20T04:49:30.056 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJljrTdHhAAsAlaFaKctSv71GrifKs6zA==", 2023-12-20T04:49:30.056 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.056 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:49:30.057 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:49:30.057 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:49:30.057 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:49:30.057 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.057 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.057 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.057 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.x", 2023-12-20T04:49:30.057 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJl+KnxNxAAM/b3mubTMYlB9QUbfcPW8g==", 2023-12-20T04:49:30.057 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.057 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:49:30.057 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:49:30.057 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:49:30.057 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.057 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:30.058 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.058 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.y", 2023-12-20T04:49:30.058 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlMyAMNBAAWpoBNevgGIkZ7zKEdKn3Ag==", 2023-12-20T04:49:30.058 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:49:30.058 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:49:30.058 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:49:30.058 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:49:30.058 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.058 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.058 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:49:30.058 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:49:30.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.046+0000 7f8de342b640 1 -- 172.21.15.132:0/2123361710 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8dc806a430 msgr2=0x7f8dc806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.046+0000 7f8de342b640 1 --2- 172.21.15.132:0/2123361710 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8dc806a430 0x7f8dc806c8f0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f8dd4009f20 tx=0x7f8dd40094d0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.046+0000 7f8de342b640 1 -- 172.21.15.132:0/2123361710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ddc0b4de0 msgr2=0x7f8ddc1585b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.046+0000 7f8de342b640 1 --2- 172.21.15.132:0/2123361710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ddc0b4de0 0x7f8ddc1585b0 secure :-1 s=READY pgs=1497 cs=0 l=1 rev1=1 crypto rx=0x7f8dd000c450 tx=0x7f8dd000c910 comp rx=0 tx=0).stop 2023-12-20T04:49:30.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.046+0000 7f8de342b640 1 -- 172.21.15.132:0/2123361710 shutdown_connections 2023-12-20T04:49:30.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.046+0000 7f8de342b640 1 --2- 172.21.15.132:0/2123361710 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8dc806a430 0x7f8dc806c8f0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.046+0000 7f8de342b640 1 --2- 172.21.15.132:0/2123361710 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ddc160450 0x7f8ddc1541d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.046+0000 7f8de342b640 1 --2- 172.21.15.132:0/2123361710 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ddc0b4de0 0x7f8ddc1585b0 unknown :-1 s=CLOSED pgs=1497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.046+0000 7f8de342b640 1 --2- 172.21.15.132:0/2123361710 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ddc0b4980 0x7f8ddc0ccc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.046+0000 7f8de342b640 1 -- 172.21.15.132:0/2123361710 >> 172.21.15.132:0/2123361710 conn(0x7f8ddc0cf980 msgr2=0x7f8ddc15f040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:30.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.046+0000 7f8de342b640 1 -- 172.21.15.132:0/2123361710 shutdown_connections 2023-12-20T04:49:30.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.046+0000 7f8de342b640 1 -- 172.21.15.132:0/2123361710 wait complete. 2023-12-20T04:49:30.061 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:49:30.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.158+0000 7fa072d8b640 1 Processor -- start 2023-12-20T04:49:30.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.158+0000 7fa072d8b640 1 -- start start 2023-12-20T04:49:30.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.159+0000 7fa072d8b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa06c0b4de0 0x7fa06c0d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.159+0000 7fa072d8b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06c0b5ec0 con 0x7fa06c160450 2023-12-20T04:49:30.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.159+0000 7fa072d8b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa06c1617e0 con 0x7fa06c0b4980 2023-12-20T04:49:30.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.159+0000 7fa072d8b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa06c0d0fc0 con 0x7fa06c0b4de0 2023-12-20T04:49:30.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.159+0000 7fa070b27640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa06c160450 0x7fa06c160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34638/0 (socket says 172.21.15.132:34638) 2023-12-20T04:49:30.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.159+0000 7fa070b27640 1 -- 172.21.15.132:0/289036998 learned_addr learned my addr 172.21.15.132:0/289036998 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:30.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.159+0000 7fa071328640 1 --2- 172.21.15.132:0/289036998 >> v2:172.21.15.187:3300/0 conn(0x7fa06c0b4de0 0x7fa06c0d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.159+0000 7fa06b7fe640 1 -- 172.21.15.132:0/289036998 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1503247180 0 0) 0x7fa06c0b5ec0 con 0x7fa06c160450 2023-12-20T04:49:30.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06b7fe640 1 -- 172.21.15.132:0/289036998 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa054003520 con 0x7fa06c160450 2023-12-20T04:49:30.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06b7fe640 1 -- 172.21.15.132:0/289036998 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 939327991 0 0) 0x7fa054003520 con 0x7fa06c160450 2023-12-20T04:49:30.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06b7fe640 1 -- 172.21.15.132:0/289036998 >> v2:172.21.15.187:3300/0 conn(0x7fa06c0b4de0 msgr2=0x7fa06c0d21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:30.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06b7fe640 1 --2- 172.21.15.132:0/289036998 >> v2:172.21.15.187:3300/0 conn(0x7fa06c0b4de0 0x7fa06c0d21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06b7fe640 1 -- 172.21.15.132:0/289036998 >> v1:172.21.15.187:6789/0 conn(0x7fa06c0b4980 legacy=0x7fa06c0d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06b7fe640 1 -- 172.21.15.132:0/289036998 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c0d12a0 con 0x7fa06c160450 2023-12-20T04:49:30.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06b7fe640 1 -- 172.21.15.132:0/289036998 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fa05c001670 con 0x7fa06c160450 2023-12-20T04:49:30.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06b7fe640 1 -- 172.21.15.132:0/289036998 >> v1:172.21.15.132:6789/0 conn(0x7fa06c160450 legacy=0x7fa06c160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06b7fe640 1 --2- 172.21.15.132:0/289036998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa054003970 0x7fa054003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06b7fe640 1 --2- 172.21.15.132:0/289036998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0540047c0 0x7fa054004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06b7fe640 1 --2- 172.21.15.132:0/289036998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa054005180 0x7fa05400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06b7fe640 1 -- 172.21.15.132:0/289036998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c0d0fc0 con 0x7fa0540047c0 2023-12-20T04:49:30.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06b7fe640 1 -- 172.21.15.132:0/289036998 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa05400c030 con 0x7fa054003970 2023-12-20T04:49:30.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06b7fe640 1 -- 172.21.15.132:0/289036998 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa05400c1f0 con 0x7fa054005180 2023-12-20T04:49:30.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06bfff640 1 --2- 172.21.15.132:0/289036998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0540047c0 0x7fa054004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa070b27640 1 --2- 172.21.15.132:0/289036998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa054003970 0x7fa054003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa071328640 1 --2- 172.21.15.132:0/289036998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa054005180 0x7fa05400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06bfff640 1 -- 172.21.15.132:0/289036998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa054005180 msgr2=0x7fa05400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:30.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06bfff640 1 --2- 172.21.15.132:0/289036998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa054005180 0x7fa05400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06bfff640 1 -- 172.21.15.132:0/289036998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa054003970 msgr2=0x7fa054003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:30.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06bfff640 1 --2- 172.21.15.132:0/289036998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa054003970 0x7fa054003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa06bfff640 1 -- 172.21.15.132:0/289036998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa054003520 con 0x7fa0540047c0 2023-12-20T04:49:30.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.160+0000 7fa071328640 1 -- 172.21.15.132:0/289036998 reap_dead start 2023-12-20T04:49:30.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.161+0000 7fa06bfff640 1 --2- 172.21.15.132:0/289036998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0540047c0 0x7fa054004c40 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fa060001750 tx=0x7fa0540057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb905ef51855e10d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:30.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.161+0000 7fa06b7fe640 1 -- 172.21.15.132:0/289036998 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa0600052d0 con 0x7fa0540047c0 2023-12-20T04:49:30.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.161+0000 7fa06b7fe640 1 -- 172.21.15.132:0/289036998 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa06002e050 con 0x7fa0540047c0 2023-12-20T04:49:30.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.161+0000 7fa06b7fe640 1 -- 172.21.15.132:0/289036998 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa060003830 con 0x7fa0540047c0 2023-12-20T04:49:30.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.162+0000 7fa072d8b640 1 -- 172.21.15.132:0/289036998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0540047c0 msgr2=0x7fa054004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.162+0000 7fa072d8b640 1 --2- 172.21.15.132:0/289036998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0540047c0 0x7fa054004c40 secure :-1 s=READY pgs=1499 cs=0 l=1 rev1=1 crypto rx=0x7fa060001750 tx=0x7fa0540057f0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.162+0000 7fa072d8b640 1 -- 172.21.15.132:0/289036998 shutdown_connections 2023-12-20T04:49:30.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.162+0000 7fa072d8b640 1 --2- 172.21.15.132:0/289036998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa0540047c0 0x7fa054004c40 unknown :-1 s=CLOSED pgs=1499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.162+0000 7fa072d8b640 1 -- 172.21.15.132:0/289036998 >> 172.21.15.132:0/289036998 conn(0x7fa06c0cf980 msgr2=0x7fa06c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:30.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.162+0000 7fa072d8b640 1 -- 172.21.15.132:0/289036998 shutdown_connections 2023-12-20T04:49:30.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.162+0000 7fa072d8b640 1 -- 172.21.15.132:0/289036998 wait complete. 2023-12-20T04:49:30.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.163+0000 7fa072d8b640 1 Processor -- start 2023-12-20T04:49:30.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.163+0000 7fa072d8b640 1 -- start start 2023-12-20T04:49:30.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa072d8b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0540047c0 0x7fa06c14c090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa072d8b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa06c14b3c0 0x7fa06c1410e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa072d8b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa06c0cc6a0 0x7fa06c0d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa072d8b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c0cb340 con 0x7fa06c0cc6a0 2023-12-20T04:49:30.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa072d8b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c0cb600 con 0x7fa06c14b3c0 2023-12-20T04:49:30.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa072d8b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa06c0cb8e0 con 0x7fa0540047c0 2023-12-20T04:49:30.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa071328640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa06c0cc6a0 0x7fa06c0d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa071328640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa06c0cc6a0 0x7fa06c0d29f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45158/0 (socket says 172.21.15.132:45158) 2023-12-20T04:49:30.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa071328640 1 -- 172.21.15.132:0/3101013544 learned_addr learned my addr 172.21.15.132:0/3101013544 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:30.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa06bfff640 1 --2- 172.21.15.132:0/3101013544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa06c14b3c0 0x7fa06c1410e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa070b27640 1 --2- 172.21.15.132:0/3101013544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0540047c0 0x7fa06c14c090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa071328640 1 -- 172.21.15.132:0/3101013544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0540047c0 msgr2=0x7fa06c14c090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa071328640 1 --2- 172.21.15.132:0/3101013544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0540047c0 0x7fa06c14c090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa071328640 1 -- 172.21.15.132:0/3101013544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa06c14b3c0 msgr2=0x7fa06c1410e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa071328640 1 --2- 172.21.15.132:0/3101013544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa06c14b3c0 0x7fa06c1410e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa071328640 1 -- 172.21.15.132:0/3101013544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa06c0cbbc0 con 0x7fa06c0cc6a0 2023-12-20T04:49:30.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa071328640 1 --2- 172.21.15.132:0/3101013544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa06c0cc6a0 0x7fa06c0d29f0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0cec00 tx=0x7fa0640115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:30.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa0697fa640 1 -- 172.21.15.132:0/3101013544 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa06400e070 con 0x7fa06c0cc6a0 2023-12-20T04:49:30.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa0697fa640 1 -- 172.21.15.132:0/3101013544 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa064011db0 con 0x7fa06c0cc6a0 2023-12-20T04:49:30.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa072d8b640 1 -- 172.21.15.132:0/3101013544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa06c0cbea0 con 0x7fa06c0cc6a0 2023-12-20T04:49:30.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa0697fa640 1 -- 172.21.15.132:0/3101013544 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa064003990 con 0x7fa06c0cc6a0 2023-12-20T04:49:30.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.164+0000 7fa072d8b640 1 -- 172.21.15.132:0/3101013544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa06c141620 con 0x7fa06c0cc6a0 2023-12-20T04:49:30.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.166+0000 7fa072d8b640 1 -- 172.21.15.132:0/3101013544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa06c161ac0 con 0x7fa06c0cc6a0 2023-12-20T04:49:30.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.166+0000 7fa0697fa640 1 -- 172.21.15.132:0/3101013544 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa064003af0 con 0x7fa06c0cc6a0 2023-12-20T04:49:30.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.166+0000 7fa0697fa640 1 --2- 172.21.15.132:0/3101013544 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa05806a430 0x7fa05806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.166+0000 7fa0697fa640 1 -- 172.21.15.132:0/3101013544 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa064088ea0 con 0x7fa06c0cc6a0 2023-12-20T04:49:30.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.167+0000 7fa070b27640 1 --2- 172.21.15.132:0/3101013544 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa05806a430 0x7fa05806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.167+0000 7fa070b27640 1 --2- 172.21.15.132:0/3101013544 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa05806a430 0x7fa05806c8f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa05c007c40 tx=0x7fa05c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:30.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.171+0000 7fa0697fa640 1 -- 172.21.15.132:0/3101013544 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa064054750 con 0x7fa06c0cc6a0 2023-12-20T04:49:30.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.338+0000 7fa072d8b640 1 -- 172.21.15.132:0/3101013544 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa06c04e840 con 0x7fa06c0cc6a0 2023-12-20T04:49:30.341 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.339+0000 7fa0697fa640 1 -- 172.21.15.132:0/3101013544 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v149) v1 ==== 74+0+12448 (secure 0 0 0) 0x7fa064057d70 con 0x7fa06c0cc6a0 2023-12-20T04:49:30.341 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:30.341 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":149,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:49:29.688939+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":17,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":135,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:49:30.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.341+0000 7fa072d8b640 1 -- 172.21.15.132:0/3101013544 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa05806a430 msgr2=0x7fa05806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.341+0000 7fa072d8b640 1 --2- 172.21.15.132:0/3101013544 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa05806a430 0x7fa05806c8f0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7fa05c007c40 tx=0x7fa05c009040 comp rx=0 tx=0).stop 2023-12-20T04:49:30.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.341+0000 7fa072d8b640 1 -- 172.21.15.132:0/3101013544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa06c0cc6a0 msgr2=0x7fa06c0d29f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.341+0000 7fa072d8b640 1 --2- 172.21.15.132:0/3101013544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa06c0cc6a0 0x7fa06c0d29f0 secure :-1 s=READY pgs=1500 cs=0 l=1 rev1=1 crypto rx=0x7fa06c0cec00 tx=0x7fa0640115a0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.341+0000 7fa072d8b640 1 -- 172.21.15.132:0/3101013544 shutdown_connections 2023-12-20T04:49:30.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.341+0000 7fa072d8b640 1 --2- 172.21.15.132:0/3101013544 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa05806a430 0x7fa05806c8f0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.341+0000 7fa072d8b640 1 --2- 172.21.15.132:0/3101013544 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa06c0cc6a0 0x7fa06c0d29f0 unknown :-1 s=CLOSED pgs=1500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.341+0000 7fa072d8b640 1 --2- 172.21.15.132:0/3101013544 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa06c14b3c0 0x7fa06c1410e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.341+0000 7fa072d8b640 1 --2- 172.21.15.132:0/3101013544 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa0540047c0 0x7fa06c14c090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.341+0000 7fa072d8b640 1 -- 172.21.15.132:0/3101013544 >> 172.21.15.132:0/3101013544 conn(0x7fa06c0cf980 msgr2=0x7fa06c06a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:30.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.341+0000 7fa072d8b640 1 -- 172.21.15.132:0/3101013544 shutdown_connections 2023-12-20T04:49:30.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.341+0000 7fa072d8b640 1 -- 172.21.15.132:0/3101013544 wait complete. 2023-12-20T04:49:30.354 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:49:30.354 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:49:30.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.453+0000 7fe383469640 1 Processor -- start 2023-12-20T04:49:30.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.454+0000 7fe383469640 1 -- start start 2023-12-20T04:49:30.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.454+0000 7fe383469640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe37c15cf20 0x7fe37c06c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.454+0000 7fe383469640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37c06cc90 con 0x7fe37c0cd4b0 2023-12-20T04:49:30.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.454+0000 7fe383469640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe37c0b2f30 con 0x7fe37c15d300 2023-12-20T04:49:30.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.454+0000 7fe383469640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe37c0b3210 con 0x7fe37c15cf20 2023-12-20T04:49:30.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.454+0000 7fe381205640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe37c15cf20 0x7fe37c06c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.454+0000 7fe381205640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe37c15cf20 0x7fe37c06c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45174/0 (socket says 172.21.15.132:45174) 2023-12-20T04:49:30.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.455+0000 7fe381205640 1 -- 172.21.15.132:0/596046282 learned_addr learned my addr 172.21.15.132:0/596046282 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:30.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.455+0000 7fe381205640 1 -- 172.21.15.132:0/596046282 >> v1:172.21.15.187:6789/0 conn(0x7fe37c15d300 legacy=0x7fe37c161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.455+0000 7fe381205640 1 -- 172.21.15.132:0/596046282 >> v1:172.21.15.132:6789/0 conn(0x7fe37c0cd4b0 legacy=0x7fe37c0d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.455+0000 7fe381205640 1 -- 172.21.15.132:0/596046282 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe37c0b34f0 con 0x7fe37c15cf20 2023-12-20T04:49:30.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.456+0000 7fe381205640 1 --2- 172.21.15.132:0/596046282 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe37c15cf20 0x7fe37c06c590 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fe378009e50 tx=0x7fe37802c010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b351c450ad2df19 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:30.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.456+0000 7fe373fff640 1 -- 172.21.15.132:0/596046282 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe37802cbb0 con 0x7fe37c15cf20 2023-12-20T04:49:30.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.456+0000 7fe373fff640 1 -- 172.21.15.132:0/596046282 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe37802cd10 con 0x7fe37c15cf20 2023-12-20T04:49:30.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.456+0000 7fe373fff640 1 -- 172.21.15.132:0/596046282 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe378034610 con 0x7fe37c15cf20 2023-12-20T04:49:30.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.456+0000 7fe383469640 1 -- 172.21.15.132:0/596046282 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe37c15cf20 msgr2=0x7fe37c06c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.456+0000 7fe383469640 1 --2- 172.21.15.132:0/596046282 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe37c15cf20 0x7fe37c06c590 secure :-1 s=READY pgs=1502 cs=0 l=1 rev1=1 crypto rx=0x7fe378009e50 tx=0x7fe37802c010 comp rx=0 tx=0).stop 2023-12-20T04:49:30.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.456+0000 7fe383469640 1 -- 172.21.15.132:0/596046282 shutdown_connections 2023-12-20T04:49:30.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.456+0000 7fe383469640 1 --2- 172.21.15.132:0/596046282 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe37c15cf20 0x7fe37c06c590 unknown :-1 s=CLOSED pgs=1502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.456+0000 7fe383469640 1 -- 172.21.15.132:0/596046282 >> 172.21.15.132:0/596046282 conn(0x7fe37c072c60 msgr2=0x7fe37c073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:30.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.456+0000 7fe383469640 1 -- 172.21.15.132:0/596046282 shutdown_connections 2023-12-20T04:49:30.459 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.456+0000 7fe383469640 1 -- 172.21.15.132:0/596046282 wait complete. 2023-12-20T04:49:30.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.458+0000 7fe383469640 1 Processor -- start 2023-12-20T04:49:30.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.458+0000 7fe383469640 1 -- start start 2023-12-20T04:49:30.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.458+0000 7fe383469640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe37c0cd4b0 0x7fe37c15a170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.458+0000 7fe383469640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe37c15cf20 0x7fe37c0c62c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.461 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.458+0000 7fe383469640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe37c15d300 0x7fe37c0c6800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.458+0000 7fe383469640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c0c8c70 con 0x7fe37c15cf20 2023-12-20T04:49:30.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.458+0000 7fe383469640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c15a6b0 con 0x7fe37c0cd4b0 2023-12-20T04:49:30.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.458+0000 7fe383469640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe37c0ad9d0 con 0x7fe37c15d300 2023-12-20T04:49:30.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.458+0000 7fe380a04640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe37c15cf20 0x7fe37c0c62c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.458+0000 7fe380a04640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe37c15cf20 0x7fe37c0c62c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45180/0 (socket says 172.21.15.132:45180) 2023-12-20T04:49:30.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.458+0000 7fe380a04640 1 -- 172.21.15.132:0/2573021097 learned_addr learned my addr 172.21.15.132:0/2573021097 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:30.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.459+0000 7fe381205640 1 --2- 172.21.15.132:0/2573021097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe37c0cd4b0 0x7fe37c15a170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.459+0000 7fe381a06640 1 --2- 172.21.15.132:0/2573021097 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe37c15d300 0x7fe37c0c6800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.459+0000 7fe380a04640 1 -- 172.21.15.132:0/2573021097 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe37c15d300 msgr2=0x7fe37c0c6800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.459+0000 7fe380a04640 1 --2- 172.21.15.132:0/2573021097 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe37c15d300 0x7fe37c0c6800 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.459+0000 7fe380a04640 1 -- 172.21.15.132:0/2573021097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe37c0cd4b0 msgr2=0x7fe37c15a170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.459+0000 7fe380a04640 1 --2- 172.21.15.132:0/2573021097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe37c0cd4b0 0x7fe37c15a170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.459+0000 7fe380a04640 1 -- 172.21.15.132:0/2573021097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe378009b30 con 0x7fe37c15cf20 2023-12-20T04:49:30.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.459+0000 7fe380a04640 1 --2- 172.21.15.132:0/2573021097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe37c15cf20 0x7fe37c0c62c0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00c3f0 tx=0x7fe36c00c8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:30.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.459+0000 7fe371ffb640 1 -- 172.21.15.132:0/2573021097 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c0052d0 con 0x7fe37c15cf20 2023-12-20T04:49:30.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.459+0000 7fe371ffb640 1 -- 172.21.15.132:0/2573021097 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe36c005450 con 0x7fe37c15cf20 2023-12-20T04:49:30.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.459+0000 7fe383469640 1 -- 172.21.15.132:0/2573021097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe37c0adcb0 con 0x7fe37c15cf20 2023-12-20T04:49:30.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.459+0000 7fe371ffb640 1 -- 172.21.15.132:0/2573021097 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe36c007260 con 0x7fe37c15cf20 2023-12-20T04:49:30.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.459+0000 7fe383469640 1 -- 172.21.15.132:0/2573021097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe37c0ae270 con 0x7fe37c15cf20 2023-12-20T04:49:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.460+0000 7fe383469640 1 -- 172.21.15.132:0/2573021097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe37c0663d0 con 0x7fe37c15cf20 2023-12-20T04:49:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.460+0000 7fe371ffb640 1 -- 172.21.15.132:0/2573021097 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe36c0073c0 con 0x7fe37c15cf20 2023-12-20T04:49:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.461+0000 7fe371ffb640 1 --2- 172.21.15.132:0/2573021097 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe36006a430 0x7fe36006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.461+0000 7fe371ffb640 1 -- 172.21.15.132:0/2573021097 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fe36c087930 con 0x7fe37c15cf20 2023-12-20T04:49:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.461+0000 7fe381205640 1 --2- 172.21.15.132:0/2573021097 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe36006a430 0x7fe36006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.461+0000 7fe381205640 1 --2- 172.21.15.132:0/2573021097 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe36006a430 0x7fe36006c8f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe378035000 tx=0x7fe378030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:30.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.465+0000 7fe371ffb640 1 -- 172.21.15.132:0/2573021097 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe36c053270 con 0x7fe37c15cf20 2023-12-20T04:49:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.630+0000 7fe383469640 1 -- 172.21.15.132:0/2573021097 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe37c0ae430 con 0x7fe37c15cf20 2023-12-20T04:49:30.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.631+0000 7fe371ffb640 1 -- 172.21.15.132:0/2573021097 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v149) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe36c056890 con 0x7fe37c15cf20 2023-12-20T04:49:30.633 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:49:30.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.632+0000 7fe383469640 1 -- 172.21.15.132:0/2573021097 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe36006a430 msgr2=0x7fe36006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.633+0000 7fe383469640 1 --2- 172.21.15.132:0/2573021097 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe36006a430 0x7fe36006c8f0 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7fe378035000 tx=0x7fe378030000 comp rx=0 tx=0).stop 2023-12-20T04:49:30.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.633+0000 7fe383469640 1 -- 172.21.15.132:0/2573021097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe37c15cf20 msgr2=0x7fe37c0c62c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.633+0000 7fe383469640 1 --2- 172.21.15.132:0/2573021097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe37c15cf20 0x7fe37c0c62c0 secure :-1 s=READY pgs=1503 cs=0 l=1 rev1=1 crypto rx=0x7fe36c00c3f0 tx=0x7fe36c00c8b0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.633+0000 7fe383469640 1 -- 172.21.15.132:0/2573021097 shutdown_connections 2023-12-20T04:49:30.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.633+0000 7fe383469640 1 --2- 172.21.15.132:0/2573021097 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe36006a430 0x7fe36006c8f0 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.633+0000 7fe383469640 1 --2- 172.21.15.132:0/2573021097 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe37c15d300 0x7fe37c0c6800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.633+0000 7fe383469640 1 --2- 172.21.15.132:0/2573021097 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe37c15cf20 0x7fe37c0c62c0 unknown :-1 s=CLOSED pgs=1503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.633+0000 7fe383469640 1 --2- 172.21.15.132:0/2573021097 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe37c0cd4b0 0x7fe37c15a170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.633+0000 7fe383469640 1 -- 172.21.15.132:0/2573021097 >> 172.21.15.132:0/2573021097 conn(0x7fe37c072c60 msgr2=0x7fe37c15f8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:30.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.633+0000 7fe383469640 1 -- 172.21.15.132:0/2573021097 shutdown_connections 2023-12-20T04:49:30.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.633+0000 7fe383469640 1 -- 172.21.15.132:0/2573021097 wait complete. 2023-12-20T04:49:30.646 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-20T04:49:30.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.744+0000 7fcf31dea640 1 Processor -- start 2023-12-20T04:49:30.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.745+0000 7fcf31dea640 1 -- start start 2023-12-20T04:49:30.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.745+0000 7fcf31dea640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcf2c0b4f90 0x7fcf2c0b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.745+0000 7fcf31dea640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf2c0b1d10 0x7fcf2c0d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.745+0000 7fcf31dea640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf2c0cd660 con 0x7fcf2c15d110 2023-12-20T04:49:30.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.745+0000 7fcf31dea640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2c0cd940 con 0x7fcf2c0b1d10 2023-12-20T04:49:30.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.745+0000 7fcf31dea640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf2c160e60 con 0x7fcf2c0b4f90 2023-12-20T04:49:30.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.745+0000 7fcf2bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf2c0b1d10 0x7fcf2c0d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.745+0000 7fcf2bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcf2c0b1d10 0x7fcf2c0d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45184/0 (socket says 172.21.15.132:45184) 2023-12-20T04:49:30.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.746+0000 7fcf2bfff640 1 -- 172.21.15.132:0/2044632675 learned_addr learned my addr 172.21.15.132:0/2044632675 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:30.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.746+0000 7fcf2bfff640 1 -- 172.21.15.132:0/2044632675 >> v2:172.21.15.187:3300/0 conn(0x7fcf2c0b4f90 msgr2=0x7fcf2c0b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:30.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.746+0000 7fcf2bfff640 1 --2- 172.21.15.132:0/2044632675 >> v2:172.21.15.187:3300/0 conn(0x7fcf2c0b4f90 0x7fcf2c0b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.746+0000 7fcf2bfff640 1 -- 172.21.15.132:0/2044632675 >> v1:172.21.15.187:6789/0 conn(0x7fcf2c15d110 legacy=0x7fcf2c0b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:30.748 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.746+0000 7fcf2bfff640 1 -- 172.21.15.132:0/2044632675 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf2c161140 con 0x7fcf2c0b1d10 2023-12-20T04:49:30.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.746+0000 7fcf2bfff640 1 --2- 172.21.15.132:0/2044632675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf2c0b1d10 0x7fcf2c0d0f60 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c073c00 tx=0x7fcf2402bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df64dc8b30069876 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:30.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.747+0000 7fcf2a7fc640 1 -- 172.21.15.132:0/2044632675 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf2402ca80 con 0x7fcf2c0b1d10 2023-12-20T04:49:30.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.747+0000 7fcf2a7fc640 1 -- 172.21.15.132:0/2044632675 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf2402cbe0 con 0x7fcf2c0b1d10 2023-12-20T04:49:30.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.747+0000 7fcf2a7fc640 1 -- 172.21.15.132:0/2044632675 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf240343f0 con 0x7fcf2c0b1d10 2023-12-20T04:49:30.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.747+0000 7fcf31dea640 1 -- 172.21.15.132:0/2044632675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf2c0b1d10 msgr2=0x7fcf2c0d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.747+0000 7fcf31dea640 1 --2- 172.21.15.132:0/2044632675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf2c0b1d10 0x7fcf2c0d0f60 secure :-1 s=READY pgs=1504 cs=0 l=1 rev1=1 crypto rx=0x7fcf2c073c00 tx=0x7fcf2402bee0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.747+0000 7fcf31dea640 1 -- 172.21.15.132:0/2044632675 shutdown_connections 2023-12-20T04:49:30.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.747+0000 7fcf31dea640 1 --2- 172.21.15.132:0/2044632675 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf2c0b1d10 0x7fcf2c0d0f60 unknown :-1 s=CLOSED pgs=1504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.747+0000 7fcf31dea640 1 --2- 172.21.15.132:0/2044632675 >> v2:172.21.15.187:3300/0 conn(0x7fcf2c0b4f90 0x7fcf2c0b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.747+0000 7fcf31dea640 1 -- 172.21.15.132:0/2044632675 >> 172.21.15.132:0/2044632675 conn(0x7fcf2c0cf880 msgr2=0x7fcf2c0cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:30.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.747+0000 7fcf31dea640 1 -- 172.21.15.132:0/2044632675 shutdown_connections 2023-12-20T04:49:30.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.747+0000 7fcf31dea640 1 -- 172.21.15.132:0/2044632675 wait complete. 2023-12-20T04:49:30.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.748+0000 7fcf31dea640 1 Processor -- start 2023-12-20T04:49:30.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.749+0000 7fcf31dea640 1 -- start start 2023-12-20T04:49:30.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.749+0000 7fcf31dea640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf2c0b1d10 0x7fcf2c0aacd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.749+0000 7fcf31dea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf2c0b4f90 0x7fcf2c1f31a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.749+0000 7fcf31dea640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf2c15d110 0x7fcf2c15aa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.749+0000 7fcf31dea640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0a9c30 con 0x7fcf2c0b4f90 2023-12-20T04:49:30.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.749+0000 7fcf31dea640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0a9f10 con 0x7fcf2c15d110 2023-12-20T04:49:30.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.749+0000 7fcf31dea640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf2c0aa1f0 con 0x7fcf2c0b1d10 2023-12-20T04:49:30.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.749+0000 7fcf2affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf2c0b4f90 0x7fcf2c1f31a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.749+0000 7fcf2affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf2c0b4f90 0x7fcf2c1f31a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45192/0 (socket says 172.21.15.132:45192) 2023-12-20T04:49:30.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.749+0000 7fcf2affd640 1 -- 172.21.15.132:0/4025738140 learned_addr learned my addr 172.21.15.132:0/4025738140 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:30.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.750+0000 7fcf2b7fe640 1 --2- 172.21.15.132:0/4025738140 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf2c0b1d10 0x7fcf2c0aacd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.750+0000 7fcf2bfff640 1 --2- 172.21.15.132:0/4025738140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf2c15d110 0x7fcf2c15aa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.750+0000 7fcf2affd640 1 -- 172.21.15.132:0/4025738140 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf2c0b1d10 msgr2=0x7fcf2c0aacd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.750+0000 7fcf2affd640 1 --2- 172.21.15.132:0/4025738140 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf2c0b1d10 0x7fcf2c0aacd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.750+0000 7fcf2affd640 1 -- 172.21.15.132:0/4025738140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf2c15d110 msgr2=0x7fcf2c15aa30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.750+0000 7fcf2affd640 1 --2- 172.21.15.132:0/4025738140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf2c15d110 0x7fcf2c15aa30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.750+0000 7fcf2affd640 1 -- 172.21.15.132:0/4025738140 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf24009b30 con 0x7fcf2c0b4f90 2023-12-20T04:49:30.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.750+0000 7fcf2bfff640 1 --2- 172.21.15.132:0/4025738140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf2c15d110 0x7fcf2c15aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:30.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.750+0000 7fcf2affd640 1 --2- 172.21.15.132:0/4025738140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf2c0b4f90 0x7fcf2c1f31a0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000b4a0 tx=0x7fcf2000b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:30.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.750+0000 7fcf13fff640 1 -- 172.21.15.132:0/4025738140 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20010610 con 0x7fcf2c0b4f90 2023-12-20T04:49:30.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.750+0000 7fcf13fff640 1 -- 172.21.15.132:0/4025738140 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf20010770 con 0x7fcf2c0b4f90 2023-12-20T04:49:30.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.750+0000 7fcf31dea640 1 -- 172.21.15.132:0/4025738140 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf2c0aa4d0 con 0x7fcf2c0b4f90 2023-12-20T04:49:30.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.750+0000 7fcf13fff640 1 -- 172.21.15.132:0/4025738140 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf20010b20 con 0x7fcf2c0b4f90 2023-12-20T04:49:30.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.750+0000 7fcf31dea640 1 -- 172.21.15.132:0/4025738140 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf2c1f36e0 con 0x7fcf2c0b4f90 2023-12-20T04:49:30.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.751+0000 7fcf31dea640 1 -- 172.21.15.132:0/4025738140 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf2c0aa9f0 con 0x7fcf2c0b4f90 2023-12-20T04:49:30.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.751+0000 7fcf13fff640 1 -- 172.21.15.132:0/4025738140 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcf20010c80 con 0x7fcf2c0b4f90 2023-12-20T04:49:30.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.752+0000 7fcf13fff640 1 --2- 172.21.15.132:0/4025738140 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf1806a430 0x7fcf1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:30.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.752+0000 7fcf2b7fe640 1 --2- 172.21.15.132:0/4025738140 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf1806a430 0x7fcf1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:30.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.752+0000 7fcf13fff640 1 -- 172.21.15.132:0/4025738140 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcf20088130 con 0x7fcf2c0b4f90 2023-12-20T04:49:30.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.752+0000 7fcf2b7fe640 1 --2- 172.21.15.132:0/4025738140 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf1806a430 0x7fcf1806c8f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00a730 tx=0x7fcf1c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:30.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.756+0000 7fcf13fff640 1 -- 172.21.15.132:0/4025738140 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcf2c0aa9f0 con 0x7fcf2c0b4f90 2023-12-20T04:49:30.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.923+0000 7fcf31dea640 1 -- 172.21.15.132:0/4025738140 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fcf2c0aa9f0 con 0x7fcf2c0b4f90 2023-12-20T04:49:30.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.924+0000 7fcf13fff640 1 -- 172.21.15.132:0/4025738140 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v149) v1 ==== 84+0+65 (secure 0 0 0) 0x7fcf20014060 con 0x7fcf2c0b4f90 2023-12-20T04:49:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:30.926 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-12-20T04:49:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:49:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-12-20T04:49:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-12-20T04:49:30.926 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:30.926 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-12-20T04:49:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.926+0000 7fcf31dea640 1 -- 172.21.15.132:0/4025738140 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf1806a430 msgr2=0x7fcf1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.926+0000 7fcf31dea640 1 --2- 172.21.15.132:0/4025738140 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf1806a430 0x7fcf1806c8f0 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fcf1c00a730 tx=0x7fcf1c008040 comp rx=0 tx=0).stop 2023-12-20T04:49:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.926+0000 7fcf31dea640 1 -- 172.21.15.132:0/4025738140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf2c0b4f90 msgr2=0x7fcf2c1f31a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.926+0000 7fcf31dea640 1 --2- 172.21.15.132:0/4025738140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf2c0b4f90 0x7fcf2c1f31a0 secure :-1 s=READY pgs=1505 cs=0 l=1 rev1=1 crypto rx=0x7fcf2000b4a0 tx=0x7fcf2000b960 comp rx=0 tx=0).stop 2023-12-20T04:49:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.926+0000 7fcf31dea640 1 -- 172.21.15.132:0/4025738140 shutdown_connections 2023-12-20T04:49:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.926+0000 7fcf31dea640 1 --2- 172.21.15.132:0/4025738140 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf1806a430 0x7fcf1806c8f0 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.926+0000 7fcf31dea640 1 --2- 172.21.15.132:0/4025738140 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf2c15d110 0x7fcf2c15aa30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.926+0000 7fcf31dea640 1 --2- 172.21.15.132:0/4025738140 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf2c0b4f90 0x7fcf2c1f31a0 unknown :-1 s=CLOSED pgs=1505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.926+0000 7fcf31dea640 1 --2- 172.21.15.132:0/4025738140 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf2c0b1d10 0x7fcf2c0aacd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.926+0000 7fcf31dea640 1 -- 172.21.15.132:0/4025738140 >> 172.21.15.132:0/4025738140 conn(0x7fcf2c0cf880 msgr2=0x7fcf2c0b6e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.926+0000 7fcf31dea640 1 -- 172.21.15.132:0/4025738140 shutdown_connections 2023-12-20T04:49:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:30.926+0000 7fcf31dea640 1 -- 172.21.15.132:0/4025738140 wait complete. 2023-12-20T04:49:30.938 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-20T04:49:30.939 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-20T04:49:31.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.041+0000 7f561184a640 1 Processor -- start 2023-12-20T04:49:31.043 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.041+0000 7f561184a640 1 -- start start 2023-12-20T04:49:31.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.042+0000 7f561184a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f560c069c30 0x7f560c070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:31.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.042+0000 7f561184a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f560c0cbde0 0x7f560c0ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:31.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.042+0000 7f561184a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f560c0c4f40 con 0x7f560c15d360 2023-12-20T04:49:31.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.042+0000 7f561184a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c0af5b0 con 0x7f560c0cbde0 2023-12-20T04:49:31.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.042+0000 7f561184a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f560c070a40 con 0x7f560c069c30 2023-12-20T04:49:31.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.042+0000 7f560a7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f560c15d360 0x7f560c06a010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34656/0 (socket says 172.21.15.132:34656) 2023-12-20T04:49:31.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.042+0000 7f560a7fc640 1 -- 172.21.15.132:0/1788396889 learned_addr learned my addr 172.21.15.132:0/1788396889 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:31.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.042+0000 7f560b7fe640 1 --2- 172.21.15.132:0/1788396889 >> v2:172.21.15.132:3300/0 conn(0x7f560c0cbde0 0x7f560c0ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:31.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.043+0000 7f560affd640 1 --2- 172.21.15.132:0/1788396889 >> v2:172.21.15.187:3300/0 conn(0x7f560c069c30 0x7f560c070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:31.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.043+0000 7f560b7fe640 1 -- 172.21.15.132:0/1788396889 >> v2:172.21.15.187:3300/0 conn(0x7f560c069c30 msgr2=0x7f560c070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:31.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.043+0000 7f560b7fe640 1 --2- 172.21.15.132:0/1788396889 >> v2:172.21.15.187:3300/0 conn(0x7f560c069c30 0x7f560c070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:31.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.043+0000 7f560b7fe640 1 -- 172.21.15.132:0/1788396889 >> v1:172.21.15.132:6789/0 conn(0x7f560c15d360 legacy=0x7f560c06a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:31.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.043+0000 7f560b7fe640 1 -- 172.21.15.132:0/1788396889 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f560c070d20 con 0x7f560c0cbde0 2023-12-20T04:49:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.044+0000 7f560b7fe640 1 --2- 172.21.15.132:0/1788396889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c0cbde0 0x7f560c0ca170 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f560c071870 tx=0x7f560402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3352f97b4ba70825 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.044+0000 7f5609ffb640 1 -- 172.21.15.132:0/1788396889 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604031830 con 0x7f560c0cbde0 2023-12-20T04:49:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.044+0000 7f5609ffb640 1 -- 172.21.15.132:0/1788396889 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5604031990 con 0x7f560c0cbde0 2023-12-20T04:49:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.044+0000 7f5609ffb640 1 -- 172.21.15.132:0/1788396889 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5604031d20 con 0x7f560c0cbde0 2023-12-20T04:49:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.044+0000 7f561184a640 1 -- 172.21.15.132:0/1788396889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c0cbde0 msgr2=0x7f560c0ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.044+0000 7f561184a640 1 --2- 172.21.15.132:0/1788396889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c0cbde0 0x7f560c0ca170 secure :-1 s=READY pgs=1507 cs=0 l=1 rev1=1 crypto rx=0x7f560c071870 tx=0x7f560402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:49:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.044+0000 7f561184a640 1 -- 172.21.15.132:0/1788396889 shutdown_connections 2023-12-20T04:49:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.044+0000 7f561184a640 1 --2- 172.21.15.132:0/1788396889 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c0cbde0 0x7f560c0ca170 unknown :-1 s=CLOSED pgs=1507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.044+0000 7f561184a640 1 --2- 172.21.15.132:0/1788396889 >> v2:172.21.15.187:3300/0 conn(0x7f560c069c30 0x7f560c070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:31.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.044+0000 7f561184a640 1 -- 172.21.15.132:0/1788396889 >> 172.21.15.132:0/1788396889 conn(0x7f560c0cc630 msgr2=0x7f560c0cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.044+0000 7f561184a640 1 -- 172.21.15.132:0/1788396889 shutdown_connections 2023-12-20T04:49:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.044+0000 7f561184a640 1 -- 172.21.15.132:0/1788396889 wait complete. 2023-12-20T04:49:31.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.045+0000 7f561184a640 1 Processor -- start 2023-12-20T04:49:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.046+0000 7f561184a640 1 -- start start 2023-12-20T04:49:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.046+0000 7f561184a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c069c30 0x7f560c151070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.046+0000 7f561184a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f560c0cbde0 0x7f560c0c92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.046+0000 7f561184a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f560c15d360 0x7f560c1f5f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.046+0000 7f561184a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c1589c0 con 0x7f560c069c30 2023-12-20T04:49:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.046+0000 7f561184a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0c76a0 con 0x7f560c15d360 2023-12-20T04:49:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.046+0000 7f561184a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f560c0c7980 con 0x7f560c0cbde0 2023-12-20T04:49:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.046+0000 7f560affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c069c30 0x7f560c151070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:31.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.046+0000 7f560affd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c069c30 0x7f560c151070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45216/0 (socket says 172.21.15.132:45216) 2023-12-20T04:49:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.046+0000 7f560affd640 1 -- 172.21.15.132:0/4181076714 learned_addr learned my addr 172.21.15.132:0/4181076714 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.047+0000 7f560affd640 1 -- 172.21.15.132:0/4181076714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f560c0cbde0 msgr2=0x7f560c0c92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.047+0000 7f560affd640 1 --2- 172.21.15.132:0/4181076714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f560c0cbde0 0x7f560c0c92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.047+0000 7f560affd640 1 -- 172.21.15.132:0/4181076714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f560c15d360 msgr2=0x7f560c1f5f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.047+0000 7f560b7fe640 1 --2- 172.21.15.132:0/4181076714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f560c15d360 0x7f560c1f5f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.047+0000 7f560affd640 1 --2- 172.21.15.132:0/4181076714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f560c15d360 0x7f560c1f5f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.047+0000 7f560affd640 1 -- 172.21.15.132:0/4181076714 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5604009400 con 0x7f560c069c30 2023-12-20T04:49:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.047+0000 7f560b7fe640 1 --2- 172.21.15.132:0/4181076714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f560c15d360 0x7f560c1f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.047+0000 7f560affd640 1 --2- 172.21.15.132:0/4181076714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c069c30 0x7f560c151070 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00efc0 tx=0x7f55fc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.047+0000 7f55f3fff640 1 -- 172.21.15.132:0/4181076714 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc014480 con 0x7f560c069c30 2023-12-20T04:49:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.047+0000 7f55f3fff640 1 -- 172.21.15.132:0/4181076714 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f55fc00f040 con 0x7f560c069c30 2023-12-20T04:49:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.047+0000 7f561184a640 1 -- 172.21.15.132:0/4181076714 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f560c0c7c60 con 0x7f560c069c30 2023-12-20T04:49:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.047+0000 7f55f3fff640 1 -- 172.21.15.132:0/4181076714 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55fc014800 con 0x7f560c069c30 2023-12-20T04:49:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.047+0000 7f561184a640 1 -- 172.21.15.132:0/4181076714 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f560c1f6af0 con 0x7f560c069c30 2023-12-20T04:49:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.048+0000 7f561184a640 1 -- 172.21.15.132:0/4181076714 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f560c158c30 con 0x7f560c069c30 2023-12-20T04:49:31.051 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.048+0000 7f55f3fff640 1 -- 172.21.15.132:0/4181076714 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f55fc014960 con 0x7f560c069c30 2023-12-20T04:49:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.049+0000 7f55f3fff640 1 --2- 172.21.15.132:0/4181076714 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55f806a430 0x7f55f806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.049+0000 7f560a7fc640 1 --2- 172.21.15.132:0/4181076714 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55f806a430 0x7f55f806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.049+0000 7f55f3fff640 1 -- 172.21.15.132:0/4181076714 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(149..149 src has 1..149) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f55fc0894e0 con 0x7f560c069c30 2023-12-20T04:49:31.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.049+0000 7f560a7fc640 1 --2- 172.21.15.132:0/4181076714 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55f806a430 0x7f55f806c8f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f560c1515b0 tx=0x7f5600007a40 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:31.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.053+0000 7f55f3fff640 1 -- 172.21.15.132:0/4181076714 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f55fc054e20 con 0x7f560c069c30 2023-12-20T04:49:31.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.219+0000 7f561184a640 1 -- 172.21.15.132:0/4181076714 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7f560c066eb0 con 0x7f560c069c30 2023-12-20T04:49:31.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.867+0000 7f55f3fff640 1 -- 172.21.15.132:0/4181076714 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v150) v1 ==== 138+0+0 (secure 0 0 0) 0x7f55fc058440 con 0x7f560c069c30 2023-12-20T04:49:31.869 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2023-12-20T04:49:31.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.870+0000 7f561184a640 1 -- 172.21.15.132:0/4181076714 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55f806a430 msgr2=0x7f55f806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:31.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.870+0000 7f561184a640 1 --2- 172.21.15.132:0/4181076714 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55f806a430 0x7f55f806c8f0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f560c1515b0 tx=0x7f5600007a40 comp rx=0 tx=0).stop 2023-12-20T04:49:31.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.870+0000 7f561184a640 1 -- 172.21.15.132:0/4181076714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c069c30 msgr2=0x7f560c151070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:31.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.870+0000 7f561184a640 1 --2- 172.21.15.132:0/4181076714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c069c30 0x7f560c151070 secure :-1 s=READY pgs=1508 cs=0 l=1 rev1=1 crypto rx=0x7f55fc00efc0 tx=0x7f55fc00c490 comp rx=0 tx=0).stop 2023-12-20T04:49:31.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.870+0000 7f561184a640 1 -- 172.21.15.132:0/4181076714 shutdown_connections 2023-12-20T04:49:31.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.870+0000 7f561184a640 1 --2- 172.21.15.132:0/4181076714 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f55f806a430 0x7f55f806c8f0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:31.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.870+0000 7f561184a640 1 --2- 172.21.15.132:0/4181076714 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f560c15d360 0x7f560c1f5f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:31.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.870+0000 7f561184a640 1 --2- 172.21.15.132:0/4181076714 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f560c0cbde0 0x7f560c0c92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:31.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.870+0000 7f561184a640 1 --2- 172.21.15.132:0/4181076714 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f560c069c30 0x7f560c151070 unknown :-1 s=CLOSED pgs=1508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:31.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.870+0000 7f561184a640 1 -- 172.21.15.132:0/4181076714 >> 172.21.15.132:0/4181076714 conn(0x7f560c0cc630 msgr2=0x7f560c0c5930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:31.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.871+0000 7f561184a640 1 -- 172.21.15.132:0/4181076714 shutdown_connections 2023-12-20T04:49:31.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.871+0000 7f561184a640 1 -- 172.21.15.132:0/4181076714 wait complete. 2023-12-20T04:49:31.885 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-20T04:49:31.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.991+0000 7f6256eec640 1 Processor -- start 2023-12-20T04:49:31.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.991+0000 7f6256eec640 1 -- start start 2023-12-20T04:49:31.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.992+0000 7f6256eec640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f625015d300 0x7f625006c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:31.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.992+0000 7f6256eec640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62500cd4b0 0x7f62500cd960 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:31.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.992+0000 7f6256eec640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f625006cc90 con 0x7f625015cf20 2023-12-20T04:49:31.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.992+0000 7f6256eec640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f62500cdea0 con 0x7f625015d300 2023-12-20T04:49:31.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.992+0000 7f6256eec640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62500b2f30 con 0x7f62500cd4b0 2023-12-20T04:49:31.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.992+0000 7f6254c88640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f625015cf20 0x7f6250161700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34660/0 (socket says 172.21.15.132:34660) 2023-12-20T04:49:31.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.992+0000 7f6254c88640 1 -- 172.21.15.132:0/1735456995 learned_addr learned my addr 172.21.15.132:0/1735456995 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:31.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.992+0000 7f624f7fe640 1 -- 172.21.15.132:0/1735456995 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2541474169 0 0) 0x7f625006cc90 con 0x7f625015cf20 2023-12-20T04:49:31.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f624f7fe640 1 -- 172.21.15.132:0/1735456995 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6238003520 con 0x7f625015cf20 2023-12-20T04:49:31.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f6255489640 1 --2- 172.21.15.132:0/1735456995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62500cd4b0 0x7f62500cd960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:31.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f624ffff640 1 --2- 172.21.15.132:0/1735456995 >> v2:172.21.15.187:3300/0 conn(0x7f625015d300 0x7f625006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:31.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f624f7fe640 1 -- 172.21.15.132:0/1735456995 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 345925571 0 0) 0x7f6238003520 con 0x7f625015cf20 2023-12-20T04:49:31.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f624f7fe640 1 -- 172.21.15.132:0/1735456995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62500cd4b0 msgr2=0x7f62500cd960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:31.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f624f7fe640 1 --2- 172.21.15.132:0/1735456995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62500cd4b0 0x7f62500cd960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:31.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f624f7fe640 1 -- 172.21.15.132:0/1735456995 >> v2:172.21.15.187:3300/0 conn(0x7f625015d300 msgr2=0x7f625006c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:31.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f624f7fe640 1 --2- 172.21.15.132:0/1735456995 >> v2:172.21.15.187:3300/0 conn(0x7f625015d300 0x7f625006c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:31.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f624f7fe640 1 -- 172.21.15.132:0/1735456995 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62500b3210 con 0x7f625015cf20 2023-12-20T04:49:31.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f624f7fe640 1 -- 172.21.15.132:0/1735456995 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f6240001670 con 0x7f625015cf20 2023-12-20T04:49:31.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f624f7fe640 1 -- 172.21.15.132:0/1735456995 >> v1:172.21.15.132:6789/0 conn(0x7f625015cf20 legacy=0x7f6250161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:31.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f624f7fe640 1 --2- 172.21.15.132:0/1735456995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6238003970 0x7f6238003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:31.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f624f7fe640 1 --2- 172.21.15.132:0/1735456995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62380047c0 0x7f6238004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:31.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f624f7fe640 1 --2- 172.21.15.132:0/1735456995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62500cd4b0 0x7f6238005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:31.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f624f7fe640 1 -- 172.21.15.132:0/1735456995 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62500cdea0 con 0x7f6238003970 2023-12-20T04:49:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f624f7fe640 1 -- 172.21.15.132:0/1735456995 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62500b2f30 con 0x7f62380047c0 2023-12-20T04:49:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f624f7fe640 1 -- 172.21.15.132:0/1735456995 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f623800b980 con 0x7f62500cd4b0 2023-12-20T04:49:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f6254c88640 1 --2- 172.21.15.132:0/1735456995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6238003970 0x7f6238003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f6255489640 1 --2- 172.21.15.132:0/1735456995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62500cd4b0 0x7f6238005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f624ffff640 1 --2- 172.21.15.132:0/1735456995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62380047c0 0x7f6238004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f6254c88640 1 -- 172.21.15.132:0/1735456995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62500cd4b0 msgr2=0x7f6238005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f6254c88640 1 --2- 172.21.15.132:0/1735456995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62500cd4b0 0x7f6238005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f6254c88640 1 -- 172.21.15.132:0/1735456995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62380047c0 msgr2=0x7f6238004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f6254c88640 1 --2- 172.21.15.132:0/1735456995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62380047c0 0x7f6238004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f6254c88640 1 -- 172.21.15.132:0/1735456995 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6238003520 con 0x7f6238003970 2023-12-20T04:49:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.993+0000 7f6255489640 1 --2- 172.21.15.132:0/1735456995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62500cd4b0 0x7f6238005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.994+0000 7f6254c88640 1 --2- 172.21.15.132:0/1735456995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6238003970 0x7f6238003d90 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f624000c290 tx=0x7f62380057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa94ed70048fae8a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:32.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.994+0000 7f624f7fe640 1 -- 172.21.15.132:0/1735456995 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6240005ad0 con 0x7f6238003970 2023-12-20T04:49:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.994+0000 7f624f7fe640 1 -- 172.21.15.132:0/1735456995 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6240005c30 con 0x7f6238003970 2023-12-20T04:49:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.994+0000 7f624f7fe640 1 -- 172.21.15.132:0/1735456995 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624002c8d0 con 0x7f6238003970 2023-12-20T04:49:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.995+0000 7f6256eec640 1 -- 172.21.15.132:0/1735456995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6238003970 msgr2=0x7f6238003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.995+0000 7f6256eec640 1 --2- 172.21.15.132:0/1735456995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6238003970 0x7f6238003d90 secure :-1 s=READY pgs=1510 cs=0 l=1 rev1=1 crypto rx=0x7f624000c290 tx=0x7f62380057f0 comp rx=0 tx=0).stop 2023-12-20T04:49:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.995+0000 7f6255489640 1 -- 172.21.15.132:0/1735456995 reap_dead start 2023-12-20T04:49:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.995+0000 7f6256eec640 1 -- 172.21.15.132:0/1735456995 shutdown_connections 2023-12-20T04:49:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.995+0000 7f6256eec640 1 -- 172.21.15.132:0/1735456995 >> 172.21.15.132:0/1735456995 conn(0x7f6250072c60 msgr2=0x7f6250073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.995+0000 7f6256eec640 1 -- 172.21.15.132:0/1735456995 shutdown_connections 2023-12-20T04:49:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.995+0000 7f6256eec640 1 -- 172.21.15.132:0/1735456995 wait complete. 2023-12-20T04:49:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.996+0000 7f6256eec640 1 Processor -- start 2023-12-20T04:49:32.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.996+0000 7f6256eec640 1 -- start start 2023-12-20T04:49:32.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6256eec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6238003970 0x7f625014bf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:32.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6256eec640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62500ceb60 0x7f62500cefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6256eec640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62500ad930 0x7f62500addb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6256eec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62500cf520 con 0x7f6238003970 2023-12-20T04:49:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6256eec640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62500ae2f0 con 0x7f62500ceb60 2023-12-20T04:49:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6256eec640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f62500c5ab0 con 0x7f62500ad930 2023-12-20T04:49:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6254c88640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6238003970 0x7f625014bf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6254c88640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6238003970 0x7f625014bf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45228/0 (socket says 172.21.15.132:45228) 2023-12-20T04:49:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6254c88640 1 -- 172.21.15.132:0/2902084759 learned_addr learned my addr 172.21.15.132:0/2902084759 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f624ffff640 1 --2- 172.21.15.132:0/2902084759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62500ceb60 0x7f62500cefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6255489640 1 --2- 172.21.15.132:0/2902084759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62500ad930 0x7f62500addb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6254c88640 1 -- 172.21.15.132:0/2902084759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62500ad930 msgr2=0x7f62500addb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6254c88640 1 --2- 172.21.15.132:0/2902084759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62500ad930 0x7f62500addb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6254c88640 1 -- 172.21.15.132:0/2902084759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62500ceb60 msgr2=0x7f62500cefe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6254c88640 1 --2- 172.21.15.132:0/2902084759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62500ceb60 0x7f62500cefe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:32.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6254c88640 1 -- 172.21.15.132:0/2902084759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62500ae510 con 0x7f6238003970 2023-12-20T04:49:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f624ffff640 1 --2- 172.21.15.132:0/2902084759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62500ceb60 0x7f62500cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6254c88640 1 --2- 172.21.15.132:0/2902084759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6238003970 0x7f625014bf80 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f624002c540 tx=0x7f6240000fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f624d7fa640 1 -- 172.21.15.132:0/2902084759 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624002cce0 con 0x7f6238003970 2023-12-20T04:49:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f624d7fa640 1 -- 172.21.15.132:0/2902084759 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624002ce60 con 0x7f6238003970 2023-12-20T04:49:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6256eec640 1 -- 172.21.15.132:0/2902084759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62500ae7f0 con 0x7f6238003970 2023-12-20T04:49:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f624d7fa640 1 -- 172.21.15.132:0/2902084759 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62400072b0 con 0x7f6238003970 2023-12-20T04:49:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.997+0000 7f6256eec640 1 -- 172.21.15.132:0/2902084759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62500aedb0 con 0x7f6238003970 2023-12-20T04:49:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.998+0000 7f6256eec640 1 -- 172.21.15.132:0/2902084759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f625004e840 con 0x7f6238003970 2023-12-20T04:49:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.999+0000 7f624d7fa640 1 -- 172.21.15.132:0/2902084759 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6240032070 con 0x7f6238003970 2023-12-20T04:49:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.999+0000 7f624d7fa640 1 --2- 172.21.15.132:0/2902084759 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f623c06a430 0x7f623c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.999+0000 7f624d7fa640 1 -- 172.21.15.132:0/2902084759 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(150..150 src has 1..150) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f624003c040 con 0x7f6238003970 2023-12-20T04:49:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:31.999+0000 7f624ffff640 1 --2- 172.21.15.132:0/2902084759 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f623c06a430 0x7f623c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:32.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.000+0000 7f624ffff640 1 --2- 172.21.15.132:0/2902084759 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f623c06a430 0x7f623c06c8f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f62501f5c80 tx=0x7f6244008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:32.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.004+0000 7f624d7fa640 1 -- 172.21.15.132:0/2902084759 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6240075480 con 0x7f6238003970 2023-12-20T04:49:32.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.170+0000 7f6256eec640 1 -- 172.21.15.132:0/2902084759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f62500b2890 con 0x7f6238003970 2023-12-20T04:49:32.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.869+0000 7f624d7fa640 1 -- 172.21.15.132:0/2902084759 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v151) v1 ==== 170+0+0 (secure 0 0 0) 0x7f62400450d0 con 0x7f6238003970 2023-12-20T04:49:32.872 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2023-12-20T04:49:32.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.879+0000 7f6256eec640 1 -- 172.21.15.132:0/2902084759 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f623c06a430 msgr2=0x7f623c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:32.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.879+0000 7f6256eec640 1 --2- 172.21.15.132:0/2902084759 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f623c06a430 0x7f623c06c8f0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f62501f5c80 tx=0x7f6244008040 comp rx=0 tx=0).stop 2023-12-20T04:49:32.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.879+0000 7f6256eec640 1 -- 172.21.15.132:0/2902084759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6238003970 msgr2=0x7f625014bf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:32.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.879+0000 7f6256eec640 1 --2- 172.21.15.132:0/2902084759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6238003970 0x7f625014bf80 secure :-1 s=READY pgs=1511 cs=0 l=1 rev1=1 crypto rx=0x7f624002c540 tx=0x7f6240000fe0 comp rx=0 tx=0).stop 2023-12-20T04:49:32.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.880+0000 7f6256eec640 1 -- 172.21.15.132:0/2902084759 shutdown_connections 2023-12-20T04:49:32.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.880+0000 7f6256eec640 1 --2- 172.21.15.132:0/2902084759 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f623c06a430 0x7f623c06c8f0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:32.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.880+0000 7f6256eec640 1 --2- 172.21.15.132:0/2902084759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f62500ad930 0x7f62500addb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:32.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.880+0000 7f6256eec640 1 --2- 172.21.15.132:0/2902084759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f62500ceb60 0x7f62500cefe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:32.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.880+0000 7f6256eec640 1 --2- 172.21.15.132:0/2902084759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6238003970 0x7f625014bf80 unknown :-1 s=CLOSED pgs=1511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:32.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.880+0000 7f6256eec640 1 -- 172.21.15.132:0/2902084759 >> 172.21.15.132:0/2902084759 conn(0x7f6250072c60 msgr2=0x7f62500b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:32.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.880+0000 7f6256eec640 1 -- 172.21.15.132:0/2902084759 shutdown_connections 2023-12-20T04:49:32.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.880+0000 7f6256eec640 1 -- 172.21.15.132:0/2902084759 wait complete. 2023-12-20T04:49:32.895 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-20T04:49:33.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.998+0000 7f84f485c640 1 Processor -- start 2023-12-20T04:49:33.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.998+0000 7f84f485c640 1 -- start start 2023-12-20T04:49:33.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.999+0000 7f84f485c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84f00cb8b0 0x7f84f0159a00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.999+0000 7f84f485c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f84f0159f40 0x7f84f00c9280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.999+0000 7f84f485c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f84f00cb420 con 0x7f84f00cc940 2023-12-20T04:49:33.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.999+0000 7f84f485c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f84f0153ee0 con 0x7f84f0159f40 2023-12-20T04:49:33.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.999+0000 7f84f485c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f015a4f0 con 0x7f84f00cb8b0 2023-12-20T04:49:33.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.999+0000 7f84eed9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f84f0159f40 0x7f84f00c9280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.999+0000 7f84eed9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f84f0159f40 0x7f84f00c9280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45244/0 (socket says 172.21.15.132:45244) 2023-12-20T04:49:33.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.999+0000 7f84eed9d640 1 -- 172.21.15.132:0/3100903008 learned_addr learned my addr 172.21.15.132:0/3100903008 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:33.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.999+0000 7f84edd9b640 1 --2- 172.21.15.132:0/3100903008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84f00cb8b0 0x7f84f0159a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.999+0000 7f84eed9d640 1 -- 172.21.15.132:0/3100903008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84f00cb8b0 msgr2=0x7f84f0159a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:33.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.999+0000 7f84eed9d640 1 --2- 172.21.15.132:0/3100903008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84f00cb8b0 0x7f84f0159a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.999+0000 7f84eed9d640 1 -- 172.21.15.132:0/3100903008 >> v1:172.21.15.132:6789/0 conn(0x7f84f00cc940 legacy=0x7f84f00ccd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:32.999+0000 7f84eed9d640 1 -- 172.21.15.132:0/3100903008 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84f015a7d0 con 0x7f84f0159f40 2023-12-20T04:49:33.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.000+0000 7f84edd9b640 1 --2- 172.21.15.132:0/3100903008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84f00cb8b0 0x7f84f0159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:33.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.000+0000 7f84eed9d640 1 --2- 172.21.15.132:0/3100903008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f0159f40 0x7f84f00c9280 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009870 tx=0x7f84e802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8994bef0e2b6dd55 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:33.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.000+0000 7f84ed59a640 1 -- 172.21.15.132:0/3100903008 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e802f840 con 0x7f84f0159f40 2023-12-20T04:49:33.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.000+0000 7f84ed59a640 1 -- 172.21.15.132:0/3100903008 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e802f9a0 con 0x7f84f0159f40 2023-12-20T04:49:33.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.000+0000 7f84ed59a640 1 -- 172.21.15.132:0/3100903008 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e802fd30 con 0x7f84f0159f40 2023-12-20T04:49:33.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.001+0000 7f84f485c640 1 -- 172.21.15.132:0/3100903008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f0159f40 msgr2=0x7f84f00c9280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.001+0000 7f84f485c640 1 --2- 172.21.15.132:0/3100903008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f0159f40 0x7f84f00c9280 secure :-1 s=READY pgs=1513 cs=0 l=1 rev1=1 crypto rx=0x7f84e8009870 tx=0x7f84e802ba20 comp rx=0 tx=0).stop 2023-12-20T04:49:33.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.001+0000 7f84f485c640 1 -- 172.21.15.132:0/3100903008 shutdown_connections 2023-12-20T04:49:33.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.001+0000 7f84f485c640 1 --2- 172.21.15.132:0/3100903008 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f0159f40 0x7f84f00c9280 unknown :-1 s=CLOSED pgs=1513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.001+0000 7f84f485c640 1 --2- 172.21.15.132:0/3100903008 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84f00cb8b0 0x7f84f0159a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.001+0000 7f84f485c640 1 -- 172.21.15.132:0/3100903008 >> 172.21.15.132:0/3100903008 conn(0x7f84f006a260 msgr2=0x7f84f00b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:33.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.001+0000 7f84f485c640 1 -- 172.21.15.132:0/3100903008 shutdown_connections 2023-12-20T04:49:33.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.001+0000 7f84f485c640 1 -- 172.21.15.132:0/3100903008 wait complete. 2023-12-20T04:49:33.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.002+0000 7f84f485c640 1 Processor -- start 2023-12-20T04:49:33.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.002+0000 7f84f485c640 1 -- start start 2023-12-20T04:49:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.003+0000 7f84f485c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84f00cb8b0 0x7f84f0147800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.003+0000 7f84f485c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84f00cc940 0x7f84f006bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.003+0000 7f84f485c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f0159f40 0x7f84f006c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.003+0000 7f84f485c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f0070510 con 0x7f84f0159f40 2023-12-20T04:49:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.003+0000 7f84f485c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f84f0148bf0 con 0x7f84f00cb8b0 2023-12-20T04:49:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.003+0000 7f84f485c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f84f0148070 con 0x7f84f00cc940 2023-12-20T04:49:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.003+0000 7f84eed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f0159f40 0x7f84f006c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.003+0000 7f84eed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f0159f40 0x7f84f006c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45254/0 (socket says 172.21.15.132:45254) 2023-12-20T04:49:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.003+0000 7f84eed9d640 1 -- 172.21.15.132:0/3850669634 learned_addr learned my addr 172.21.15.132:0/3850669634 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.003+0000 7f84eed9d640 1 -- 172.21.15.132:0/3850669634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84f00cc940 msgr2=0x7f84f006bd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.003+0000 7f84eed9d640 1 --2- 172.21.15.132:0/3850669634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84f00cc940 0x7f84f006bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.003+0000 7f84eed9d640 1 -- 172.21.15.132:0/3850669634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84f00cb8b0 msgr2=0x7f84f0147800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.003+0000 7f84eed9d640 1 --2- 172.21.15.132:0/3850669634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84f00cb8b0 0x7f84f0147800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.003+0000 7f84eed9d640 1 -- 172.21.15.132:0/3850669634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f84e80094d0 con 0x7f84f0159f40 2023-12-20T04:49:33.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.004+0000 7f84eed9d640 1 --2- 172.21.15.132:0/3850669634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f0159f40 0x7f84f006c2c0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f84e802ba60 tx=0x7f84e8004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:33.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.004+0000 7f84deffd640 1 -- 172.21.15.132:0/3850669634 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e8037dd0 con 0x7f84f0159f40 2023-12-20T04:49:33.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.004+0000 7f84deffd640 1 -- 172.21.15.132:0/3850669634 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f84e8041400 con 0x7f84f0159f40 2023-12-20T04:49:33.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.004+0000 7f84f485c640 1 -- 172.21.15.132:0/3850669634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f84f0148350 con 0x7f84f0159f40 2023-12-20T04:49:33.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.004+0000 7f84deffd640 1 -- 172.21.15.132:0/3850669634 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f84e80417b0 con 0x7f84f0159f40 2023-12-20T04:49:33.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.004+0000 7f84f485c640 1 -- 172.21.15.132:0/3850669634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84f0148910 con 0x7f84f0159f40 2023-12-20T04:49:33.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.005+0000 7f84f485c640 1 -- 172.21.15.132:0/3850669634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f84f004e840 con 0x7f84f0159f40 2023-12-20T04:49:33.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.005+0000 7f84deffd640 1 -- 172.21.15.132:0/3850669634 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f84e8041910 con 0x7f84f0159f40 2023-12-20T04:49:33.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.006+0000 7f84deffd640 1 --2- 172.21.15.132:0/3850669634 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f84d006a430 0x7f84d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.006+0000 7f84deffd640 1 -- 172.21.15.132:0/3850669634 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(151..151 src has 1..151) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f84e803c070 con 0x7f84f0159f40 2023-12-20T04:49:33.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.006+0000 7f84ee59c640 1 --2- 172.21.15.132:0/3850669634 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f84d006a430 0x7f84d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.006+0000 7f84ee59c640 1 --2- 172.21.15.132:0/3850669634 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f84d006a430 0x7f84d006c8f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f84e00012e0 tx=0x7f84e0007d30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:33.012 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.010+0000 7f84deffd640 1 -- 172.21.15.132:0/3850669634 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f84e8076d20 con 0x7f84f0159f40 2023-12-20T04:49:33.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.210+0000 7f84f485c640 1 -- 172.21.15.132:0/3850669634 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f84f006b860 con 0x7f84f0159f40 2023-12-20T04:49:33.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.218+0000 7f84deffd640 1 -- 172.21.15.132:0/3850669634 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 18 and data pool 19 v55) v1 ==== 174+0+0 (secure 0 0 0) 0x7f84e807a340 con 0x7f84f0159f40 2023-12-20T04:49:33.222 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 18 and data pool 19 2023-12-20T04:49:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.225+0000 7f84f485c640 1 -- 172.21.15.132:0/3850669634 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f84d006a430 msgr2=0x7f84d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.225+0000 7f84f485c640 1 --2- 172.21.15.132:0/3850669634 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f84d006a430 0x7f84d006c8f0 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f84e00012e0 tx=0x7f84e0007d30 comp rx=0 tx=0).stop 2023-12-20T04:49:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.225+0000 7f84f485c640 1 -- 172.21.15.132:0/3850669634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f0159f40 msgr2=0x7f84f006c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.225+0000 7f84f485c640 1 --2- 172.21.15.132:0/3850669634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f0159f40 0x7f84f006c2c0 secure :-1 s=READY pgs=1514 cs=0 l=1 rev1=1 crypto rx=0x7f84e802ba60 tx=0x7f84e8004730 comp rx=0 tx=0).stop 2023-12-20T04:49:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.227+0000 7f84f485c640 1 -- 172.21.15.132:0/3850669634 shutdown_connections 2023-12-20T04:49:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.227+0000 7f84f485c640 1 --2- 172.21.15.132:0/3850669634 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f84d006a430 0x7f84d006c8f0 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.227+0000 7f84f485c640 1 --2- 172.21.15.132:0/3850669634 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f84f0159f40 0x7f84f006c2c0 unknown :-1 s=CLOSED pgs=1514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.227+0000 7f84f485c640 1 --2- 172.21.15.132:0/3850669634 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f84f00cc940 0x7f84f006bd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.227+0000 7f84f485c640 1 --2- 172.21.15.132:0/3850669634 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f84f00cb8b0 0x7f84f0147800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.227+0000 7f84f485c640 1 -- 172.21.15.132:0/3850669634 >> 172.21.15.132:0/3850669634 conn(0x7f84f006a260 msgr2=0x7f84f0157590 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.227+0000 7f84f485c640 1 -- 172.21.15.132:0/3850669634 shutdown_connections 2023-12-20T04:49:33.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.227+0000 7f84f485c640 1 -- 172.21.15.132:0/3850669634 wait complete. 2023-12-20T04:49:33.243 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:49:33.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.340+0000 7f19a695c640 1 Processor -- start 2023-12-20T04:49:33.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.340+0000 7f19a695c640 1 -- start start 2023-12-20T04:49:33.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.341+0000 7f19a695c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f19a0159d00 0x7f19a015da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.341+0000 7f19a695c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a015e4c0 con 0x7f19a006cc30 2023-12-20T04:49:33.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.341+0000 7f19a695c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f19a015e7a0 con 0x7f19a015df40 2023-12-20T04:49:33.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.341+0000 7f19a695c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f19a006c220 con 0x7f19a0159d00 2023-12-20T04:49:33.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.341+0000 7f19a4ef9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f19a006cc30 0x7f19a006dfc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34678/0 (socket says 172.21.15.132:34678) 2023-12-20T04:49:33.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.341+0000 7f19a4ef9640 1 -- 172.21.15.132:0/3780272562 learned_addr learned my addr 172.21.15.132:0/3780272562 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:33.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199effd640 1 -- 172.21.15.132:0/3780272562 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 696459431 0 0) 0x7f19a015e4c0 con 0x7f19a006cc30 2023-12-20T04:49:33.346 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199effd640 1 -- 172.21.15.132:0/3780272562 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1988003520 con 0x7f19a006cc30 2023-12-20T04:49:33.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199ffff640 1 --2- 172.21.15.132:0/3780272562 >> v2:172.21.15.187:3300/0 conn(0x7f19a0159d00 0x7f19a015da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199effd640 1 -- 172.21.15.132:0/3780272562 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 203903003 0 0) 0x7f1988003520 con 0x7f19a006cc30 2023-12-20T04:49:33.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199effd640 1 -- 172.21.15.132:0/3780272562 >> v2:172.21.15.187:3300/0 conn(0x7f19a0159d00 msgr2=0x7f19a015da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:33.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199effd640 1 --2- 172.21.15.132:0/3780272562 >> v2:172.21.15.187:3300/0 conn(0x7f19a0159d00 0x7f19a015da00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199effd640 1 -- 172.21.15.132:0/3780272562 >> v1:172.21.15.187:6789/0 conn(0x7f19a015df40 legacy=0x7f19a00caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:33.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199effd640 1 -- 172.21.15.132:0/3780272562 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a006c430 con 0x7f19a006cc30 2023-12-20T04:49:33.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199effd640 1 -- 172.21.15.132:0/3780272562 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f19980019f0 con 0x7f19a006cc30 2023-12-20T04:49:33.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199effd640 1 -- 172.21.15.132:0/3780272562 >> v1:172.21.15.132:6789/0 conn(0x7f19a006cc30 legacy=0x7f19a006dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199effd640 1 --2- 172.21.15.132:0/3780272562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1988003970 0x7f1988003d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199effd640 1 --2- 172.21.15.132:0/3780272562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19880047c0 0x7f1988004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199effd640 1 --2- 172.21.15.132:0/3780272562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1988005180 0x7f198800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199effd640 1 -- 172.21.15.132:0/3780272562 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a006c220 con 0x7f1988003970 2023-12-20T04:49:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199effd640 1 -- 172.21.15.132:0/3780272562 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f198800c0b0 con 0x7f1988005180 2023-12-20T04:49:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199effd640 1 -- 172.21.15.132:0/3780272562 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f198800c270 con 0x7f19880047c0 2023-12-20T04:49:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199ffff640 1 --2- 172.21.15.132:0/3780272562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1988003970 0x7f1988003d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199f7fe640 1 --2- 172.21.15.132:0/3780272562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19880047c0 0x7f1988004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f19a4ef9640 1 --2- 172.21.15.132:0/3780272562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1988005180 0x7f198800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199ffff640 1 -- 172.21.15.132:0/3780272562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19880047c0 msgr2=0x7f1988004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199ffff640 1 --2- 172.21.15.132:0/3780272562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f19880047c0 0x7f1988004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199ffff640 1 -- 172.21.15.132:0/3780272562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1988005180 msgr2=0x7f198800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199ffff640 1 --2- 172.21.15.132:0/3780272562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1988005180 0x7f198800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f199ffff640 1 -- 172.21.15.132:0/3780272562 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1988003520 con 0x7f1988003970 2023-12-20T04:49:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.342+0000 7f19a4ef9640 1 -- 172.21.15.132:0/3780272562 reap_dead start 2023-12-20T04:49:33.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.343+0000 7f199ffff640 1 --2- 172.21.15.132:0/3780272562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1988003970 0x7f1988003d70 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f199000ba00 tx=0x7f19880057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d282e990d7601f56 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.343+0000 7f199effd640 1 -- 172.21.15.132:0/3780272562 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990032620 con 0x7f1988003970 2023-12-20T04:49:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.343+0000 7f199effd640 1 -- 172.21.15.132:0/3780272562 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1990032780 con 0x7f1988003970 2023-12-20T04:49:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.343+0000 7f199effd640 1 -- 172.21.15.132:0/3780272562 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1990032b10 con 0x7f1988003970 2023-12-20T04:49:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.344+0000 7f19a695c640 1 -- 172.21.15.132:0/3780272562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1988003970 msgr2=0x7f1988003d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.344+0000 7f19a695c640 1 --2- 172.21.15.132:0/3780272562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1988003970 0x7f1988003d70 secure :-1 s=READY pgs=1516 cs=0 l=1 rev1=1 crypto rx=0x7f199000ba00 tx=0x7f19880057f0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.344+0000 7f19a695c640 1 -- 172.21.15.132:0/3780272562 shutdown_connections 2023-12-20T04:49:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.344+0000 7f19a695c640 1 --2- 172.21.15.132:0/3780272562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1988003970 0x7f1988003d70 unknown :-1 s=CLOSED pgs=1516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.344+0000 7f19a695c640 1 -- 172.21.15.132:0/3780272562 >> 172.21.15.132:0/3780272562 conn(0x7f19a00cfca0 msgr2=0x7f19a00d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.344+0000 7f19a695c640 1 -- 172.21.15.132:0/3780272562 shutdown_connections 2023-12-20T04:49:33.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.344+0000 7f19a695c640 1 -- 172.21.15.132:0/3780272562 wait complete. 2023-12-20T04:49:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.345+0000 7f19a695c640 1 Processor -- start 2023-12-20T04:49:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.345+0000 7f19a695c640 1 -- start start 2023-12-20T04:49:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.346+0000 7f19a695c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1988003970 0x7f19a01520b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.346+0000 7f19a695c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19a01f13b0 0x7f19a00c96c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.346+0000 7f19a695c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19a00caa90 0x7f19a00caf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.353 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.346+0000 7f19a695c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a01f0f90 con 0x7f19a01f13b0 2023-12-20T04:49:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.346+0000 7f19a695c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19a00cb480 con 0x7f19a00caa90 2023-12-20T04:49:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.346+0000 7f19a695c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f19a01525f0 con 0x7f1988003970 2023-12-20T04:49:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.346+0000 7f199f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19a01f13b0 0x7f19a00c96c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.346+0000 7f199f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19a01f13b0 0x7f19a00c96c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45276/0 (socket says 172.21.15.132:45276) 2023-12-20T04:49:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.346+0000 7f199f7fe640 1 -- 172.21.15.132:0/370725331 learned_addr learned my addr 172.21.15.132:0/370725331 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.346+0000 7f19a4ef9640 1 --2- 172.21.15.132:0/370725331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19a00caa90 0x7f19a00caf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.346+0000 7f199ffff640 1 --2- 172.21.15.132:0/370725331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1988003970 0x7f19a01520b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.346+0000 7f199f7fe640 1 -- 172.21.15.132:0/370725331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1988003970 msgr2=0x7f19a01520b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.346+0000 7f199f7fe640 1 --2- 172.21.15.132:0/370725331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1988003970 0x7f19a01520b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.354 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.346+0000 7f199f7fe640 1 -- 172.21.15.132:0/370725331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19a00caa90 msgr2=0x7f19a00caf40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.346+0000 7f199f7fe640 1 --2- 172.21.15.132:0/370725331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19a00caa90 0x7f19a00caf40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.346+0000 7f199f7fe640 1 -- 172.21.15.132:0/370725331 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19a01f0610 con 0x7f19a01f13b0 2023-12-20T04:49:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.346+0000 7f199f7fe640 1 --2- 172.21.15.132:0/370725331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19a01f13b0 0x7f19a00c96c0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f199400e4b0 tx=0x7f199400e970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.347+0000 7f199cff9640 1 -- 172.21.15.132:0/370725331 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f19940135f0 con 0x7f19a01f13b0 2023-12-20T04:49:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.347+0000 7f199cff9640 1 -- 172.21.15.132:0/370725331 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1994013770 con 0x7f19a01f13b0 2023-12-20T04:49:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.347+0000 7f19a695c640 1 -- 172.21.15.132:0/370725331 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19a00c6960 con 0x7f19a01f13b0 2023-12-20T04:49:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.347+0000 7f199cff9640 1 -- 172.21.15.132:0/370725331 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1994013b20 con 0x7f19a01f13b0 2023-12-20T04:49:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.347+0000 7f19a695c640 1 -- 172.21.15.132:0/370725331 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19a01f0bb0 con 0x7f19a01f13b0 2023-12-20T04:49:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.348+0000 7f19a695c640 1 -- 172.21.15.132:0/370725331 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19a01f10d0 con 0x7f19a01f13b0 2023-12-20T04:49:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.348+0000 7f199cff9640 1 -- 172.21.15.132:0/370725331 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1994013c80 con 0x7f19a01f13b0 2023-12-20T04:49:33.355 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.348+0000 7f199cff9640 1 --2- 172.21.15.132:0/370725331 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f198c06a430 0x7f198c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.349+0000 7f199cff9640 1 -- 172.21.15.132:0/370725331 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1994088a60 con 0x7f19a01f13b0 2023-12-20T04:49:33.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.349+0000 7f199ffff640 1 --2- 172.21.15.132:0/370725331 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f198c06a430 0x7f198c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.349+0000 7f199ffff640 1 --2- 172.21.15.132:0/370725331 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f198c06a430 0x7f198c06c8f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f19880057a0 tx=0x7f199003d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:33.356 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.353+0000 7f199cff9640 1 -- 172.21.15.132:0/370725331 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f19a01f10d0 con 0x7f19a01f13b0 2023-12-20T04:49:33.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.519+0000 7f19a695c640 1 -- 172.21.15.132:0/370725331 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f19a01f10d0 con 0x7f19a01f13b0 2023-12-20T04:49:33.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.520+0000 7f199cff9640 1 -- 172.21.15.132:0/370725331 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+16173 (secure 0 0 0) 0x7f19a01f10d0 con 0x7f19a01f13b0 2023-12-20T04:49:33.522 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:33.522 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":152,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:49:33.211592+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:49:31.238506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-20T04:49:32.189571+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:49:33.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.522+0000 7f19a695c640 1 -- 172.21.15.132:0/370725331 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f198c06a430 msgr2=0x7f198c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.522+0000 7f19a695c640 1 --2- 172.21.15.132:0/370725331 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f198c06a430 0x7f198c06c8f0 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7f19880057a0 tx=0x7f199003d040 comp rx=0 tx=0).stop 2023-12-20T04:49:33.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.522+0000 7f19a695c640 1 -- 172.21.15.132:0/370725331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19a01f13b0 msgr2=0x7f19a00c96c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.522+0000 7f19a695c640 1 --2- 172.21.15.132:0/370725331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19a01f13b0 0x7f19a00c96c0 secure :-1 s=READY pgs=1517 cs=0 l=1 rev1=1 crypto rx=0x7f199400e4b0 tx=0x7f199400e970 comp rx=0 tx=0).stop 2023-12-20T04:49:33.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.522+0000 7f19a695c640 1 -- 172.21.15.132:0/370725331 shutdown_connections 2023-12-20T04:49:33.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.522+0000 7f19a695c640 1 --2- 172.21.15.132:0/370725331 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f198c06a430 0x7f198c06c8f0 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.522+0000 7f19a695c640 1 --2- 172.21.15.132:0/370725331 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f19a00caa90 0x7f19a00caf40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.522+0000 7f19a695c640 1 --2- 172.21.15.132:0/370725331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f19a01f13b0 0x7f19a00c96c0 unknown :-1 s=CLOSED pgs=1517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.522+0000 7f19a695c640 1 --2- 172.21.15.132:0/370725331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1988003970 0x7f19a01520b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.522+0000 7f19a695c640 1 -- 172.21.15.132:0/370725331 >> 172.21.15.132:0/370725331 conn(0x7f19a00cfca0 msgr2=0x7f19a00afde0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:33.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.522+0000 7f19a695c640 1 -- 172.21.15.132:0/370725331 shutdown_connections 2023-12-20T04:49:33.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.522+0000 7f19a695c640 1 -- 172.21.15.132:0/370725331 wait complete. 2023-12-20T04:49:33.535 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:49:33.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.633+0000 7ff9caeec640 1 Processor -- start 2023-12-20T04:49:33.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.634+0000 7ff9caeec640 1 -- start start 2023-12-20T04:49:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.634+0000 7ff9caeec640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9c415ab70 0x7ff9c4160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.634+0000 7ff9caeec640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c406d530 con 0x7ff9c40cf280 2023-12-20T04:49:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.634+0000 7ff9caeec640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff9c4070540 con 0x7ff9c406a340 2023-12-20T04:49:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.634+0000 7ff9caeec640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c4070790 con 0x7ff9c415ab70 2023-12-20T04:49:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.635+0000 7ff9c3fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff9c40cf280 0x7ff9c4069c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34686/0 (socket says 172.21.15.132:34686) 2023-12-20T04:49:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.635+0000 7ff9c3fff640 1 -- 172.21.15.132:0/2841561946 learned_addr learned my addr 172.21.15.132:0/2841561946 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.635+0000 7ff9c8c88640 1 --2- 172.21.15.132:0/2841561946 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9c415ab70 0x7ff9c4160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.635+0000 7ff9c37fe640 1 -- 172.21.15.132:0/2841561946 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3682170333 0 0) 0x7ff9c406d530 con 0x7ff9c40cf280 2023-12-20T04:49:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.635+0000 7ff9c37fe640 1 -- 172.21.15.132:0/2841561946 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9ac003520 con 0x7ff9c40cf280 2023-12-20T04:49:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.635+0000 7ff9c37fe640 1 -- 172.21.15.132:0/2841561946 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3220187994 0 0) 0x7ff9c4070540 con 0x7ff9c406a340 2023-12-20T04:49:33.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.635+0000 7ff9c37fe640 1 -- 172.21.15.132:0/2841561946 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff9c406d530 con 0x7ff9c406a340 2023-12-20T04:49:33.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.635+0000 7ff9c8c88640 1 -- 172.21.15.132:0/2841561946 >> v1:172.21.15.187:6789/0 conn(0x7ff9c406a340 legacy=0x7ff9c415dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.635+0000 7ff9c8c88640 1 -- 172.21.15.132:0/2841561946 >> v1:172.21.15.132:6789/0 conn(0x7ff9c40cf280 legacy=0x7ff9c4069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.635+0000 7ff9c37fe640 1 -- 172.21.15.132:0/2841561946 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3464018857 0 0) 0x7ff9ac003520 con 0x7ff9c40cf280 2023-12-20T04:49:33.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.635+0000 7ff9c8c88640 1 -- 172.21.15.132:0/2841561946 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9c4070a70 con 0x7ff9c415ab70 2023-12-20T04:49:33.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.636+0000 7ff9c8c88640 1 --2- 172.21.15.132:0/2841561946 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9c415ab70 0x7ff9c4160d70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40097d0 tx=0x7ff9b402b930 comp rx=0 tx=0).ready entity=mon.2 client_cookie=3ee3fd9258aa07a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:33.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.636+0000 7ff9c37fe640 1 -- 172.21.15.132:0/2841561946 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4031890 con 0x7ff9c415ab70 2023-12-20T04:49:33.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.636+0000 7ff9c37fe640 1 -- 172.21.15.132:0/2841561946 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9b40319f0 con 0x7ff9c415ab70 2023-12-20T04:49:33.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.636+0000 7ff9c37fe640 1 -- 172.21.15.132:0/2841561946 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9b4031d60 con 0x7ff9c415ab70 2023-12-20T04:49:33.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.636+0000 7ff9caeec640 1 -- 172.21.15.132:0/2841561946 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9c415ab70 msgr2=0x7ff9c4160d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.636+0000 7ff9caeec640 1 --2- 172.21.15.132:0/2841561946 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9c415ab70 0x7ff9c4160d70 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7ff9b40097d0 tx=0x7ff9b402b930 comp rx=0 tx=0).stop 2023-12-20T04:49:33.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.636+0000 7ff9caeec640 1 -- 172.21.15.132:0/2841561946 shutdown_connections 2023-12-20T04:49:33.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.636+0000 7ff9caeec640 1 --2- 172.21.15.132:0/2841561946 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9c415ab70 0x7ff9c4160d70 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.636+0000 7ff9caeec640 1 -- 172.21.15.132:0/2841561946 >> 172.21.15.132:0/2841561946 conn(0x7ff9c40cfca0 msgr2=0x7ff9c40d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:33.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.637+0000 7ff9caeec640 1 -- 172.21.15.132:0/2841561946 shutdown_connections 2023-12-20T04:49:33.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.637+0000 7ff9caeec640 1 -- 172.21.15.132:0/2841561946 wait complete. 2023-12-20T04:49:33.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.638+0000 7ff9caeec640 1 Processor -- start 2023-12-20T04:49:33.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.638+0000 7ff9caeec640 1 -- start start 2023-12-20T04:49:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.638+0000 7ff9caeec640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9c406a340 0x7ff9c41594f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.638+0000 7ff9caeec640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9c40cf280 0x7ff9c40c7440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.638+0000 7ff9caeec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9c415ab70 0x7ff9c4160d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.638+0000 7ff9caeec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40adb20 con 0x7ff9c415ab70 2023-12-20T04:49:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.638+0000 7ff9caeec640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40ad690 con 0x7ff9c406a340 2023-12-20T04:49:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.638+0000 7ff9caeec640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff9c40aca80 con 0x7ff9c40cf280 2023-12-20T04:49:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.639+0000 7ff9c9489640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9c415ab70 0x7ff9c4160d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.639+0000 7ff9c9489640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9c415ab70 0x7ff9c4160d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45284/0 (socket says 172.21.15.132:45284) 2023-12-20T04:49:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.639+0000 7ff9c9489640 1 -- 172.21.15.132:0/356484657 learned_addr learned my addr 172.21.15.132:0/356484657 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.639+0000 7ff9c8c88640 1 --2- 172.21.15.132:0/356484657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9c406a340 0x7ff9c41594f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.639+0000 7ff9c3fff640 1 --2- 172.21.15.132:0/356484657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9c40cf280 0x7ff9c40c7440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.639+0000 7ff9c9489640 1 -- 172.21.15.132:0/356484657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9c40cf280 msgr2=0x7ff9c40c7440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.639+0000 7ff9c9489640 1 --2- 172.21.15.132:0/356484657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9c40cf280 0x7ff9c40c7440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.639+0000 7ff9c9489640 1 -- 172.21.15.132:0/356484657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9c406a340 msgr2=0x7ff9c41594f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.639+0000 7ff9c9489640 1 --2- 172.21.15.132:0/356484657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9c406a340 0x7ff9c41594f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.639+0000 7ff9c9489640 1 -- 172.21.15.132:0/356484657 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff9b4009400 con 0x7ff9c415ab70 2023-12-20T04:49:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.639+0000 7ff9c9489640 1 --2- 172.21.15.132:0/356484657 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9c415ab70 0x7ff9c4160d10 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00c7a0 tx=0x7ff9bc00cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.639+0000 7ff9c17fa640 1 -- 172.21.15.132:0/356484657 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc003b70 con 0x7ff9c415ab70 2023-12-20T04:49:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.639+0000 7ff9c17fa640 1 -- 172.21.15.132:0/356484657 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff9bc003cd0 con 0x7ff9c415ab70 2023-12-20T04:49:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.639+0000 7ff9caeec640 1 -- 172.21.15.132:0/356484657 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9c40acd60 con 0x7ff9c415ab70 2023-12-20T04:49:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.639+0000 7ff9c17fa640 1 -- 172.21.15.132:0/356484657 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff9bc00aa90 con 0x7ff9c415ab70 2023-12-20T04:49:33.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.639+0000 7ff9caeec640 1 -- 172.21.15.132:0/356484657 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9c40ad320 con 0x7ff9c415ab70 2023-12-20T04:49:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.641+0000 7ff9caeec640 1 -- 172.21.15.132:0/356484657 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff9c404e840 con 0x7ff9c415ab70 2023-12-20T04:49:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.641+0000 7ff9c17fa640 1 -- 172.21.15.132:0/356484657 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff9bc00abf0 con 0x7ff9c415ab70 2023-12-20T04:49:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.641+0000 7ff9c17fa640 1 --2- 172.21.15.132:0/356484657 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff9b006a430 0x7ff9b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.641+0000 7ff9c17fa640 1 -- 172.21.15.132:0/356484657 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff9bc088660 con 0x7ff9c415ab70 2023-12-20T04:49:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.641+0000 7ff9c8c88640 1 --2- 172.21.15.132:0/356484657 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff9b006a430 0x7ff9b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.642+0000 7ff9c8c88640 1 --2- 172.21.15.132:0/356484657 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff9b006a430 0x7ff9b006c8f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4036000 tx=0x7ff9b403c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:33.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.646+0000 7ff9c17fa640 1 -- 172.21.15.132:0/356484657 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff9bc053d10 con 0x7ff9c415ab70 2023-12-20T04:49:33.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.813+0000 7ff9caeec640 1 -- 172.21.15.132:0/356484657 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff9c40ad7d0 con 0x7ff9c415ab70 2023-12-20T04:49:33.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.814+0000 7ff9c17fa640 1 -- 172.21.15.132:0/356484657 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v152) v1 ==== 74+0+16173 (secure 0 0 0) 0x7ff9bc057330 con 0x7ff9c415ab70 2023-12-20T04:49:33.816 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:33.816 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":152,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:49:33.211592+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:49:31.238506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-20T04:49:32.189571+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:49:33.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.816+0000 7ff9caeec640 1 -- 172.21.15.132:0/356484657 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff9b006a430 msgr2=0x7ff9b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.816+0000 7ff9caeec640 1 --2- 172.21.15.132:0/356484657 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff9b006a430 0x7ff9b006c8f0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7ff9b4036000 tx=0x7ff9b403c040 comp rx=0 tx=0).stop 2023-12-20T04:49:33.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.816+0000 7ff9caeec640 1 -- 172.21.15.132:0/356484657 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9c415ab70 msgr2=0x7ff9c4160d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.816+0000 7ff9caeec640 1 --2- 172.21.15.132:0/356484657 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9c415ab70 0x7ff9c4160d10 secure :-1 s=READY pgs=1519 cs=0 l=1 rev1=1 crypto rx=0x7ff9bc00c7a0 tx=0x7ff9bc00cc60 comp rx=0 tx=0).stop 2023-12-20T04:49:33.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.816+0000 7ff9caeec640 1 -- 172.21.15.132:0/356484657 shutdown_connections 2023-12-20T04:49:33.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.816+0000 7ff9caeec640 1 --2- 172.21.15.132:0/356484657 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff9b006a430 0x7ff9b006c8f0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.816+0000 7ff9caeec640 1 --2- 172.21.15.132:0/356484657 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff9c415ab70 0x7ff9c4160d10 unknown :-1 s=CLOSED pgs=1519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.816+0000 7ff9caeec640 1 --2- 172.21.15.132:0/356484657 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff9c40cf280 0x7ff9c40c7440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.816+0000 7ff9caeec640 1 --2- 172.21.15.132:0/356484657 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff9c406a340 0x7ff9c41594f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.816+0000 7ff9caeec640 1 -- 172.21.15.132:0/356484657 >> 172.21.15.132:0/356484657 conn(0x7ff9c40cfca0 msgr2=0x7ff9c415c440 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:33.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.816+0000 7ff9caeec640 1 -- 172.21.15.132:0/356484657 shutdown_connections 2023-12-20T04:49:33.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.816+0000 7ff9caeec640 1 -- 172.21.15.132:0/356484657 wait complete. 2023-12-20T04:49:33.830 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-20T04:49:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.930+0000 7f0aba232640 1 Processor -- start 2023-12-20T04:49:33.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.930+0000 7f0aba232640 1 -- start start 2023-12-20T04:49:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.931+0000 7f0aba232640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0ab40ca170 0x7f0ab40ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.931+0000 7f0aba232640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0ab4069c30 0x7f0ab406a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.931+0000 7f0aba232640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ab406a5c0 con 0x7f0ab41447b0 2023-12-20T04:49:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.931+0000 7f0aba232640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab40c6380 con 0x7f0ab40ca170 2023-12-20T04:49:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.931+0000 7f0aba232640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ab40c4f40 con 0x7f0ab4069c30 2023-12-20T04:49:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.931+0000 7f0ab2ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0ab40ca170 0x7f0ab40ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.931+0000 7f0ab2ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0ab40ca170 0x7f0ab40ca5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45290/0 (socket says 172.21.15.132:45290) 2023-12-20T04:49:33.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.931+0000 7f0ab2ffd640 1 -- 172.21.15.132:0/798465440 learned_addr learned my addr 172.21.15.132:0/798465440 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.931+0000 7f0ab3fff640 1 --2- 172.21.15.132:0/798465440 >> v2:172.21.15.187:3300/0 conn(0x7f0ab4069c30 0x7f0ab406a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.931+0000 7f0ab2ffd640 1 -- 172.21.15.132:0/798465440 >> v2:172.21.15.187:3300/0 conn(0x7f0ab4069c30 msgr2=0x7f0ab406a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.931+0000 7f0ab2ffd640 1 --2- 172.21.15.132:0/798465440 >> v2:172.21.15.187:3300/0 conn(0x7f0ab4069c30 0x7f0ab406a080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.931+0000 7f0ab2ffd640 1 -- 172.21.15.132:0/798465440 >> v1:172.21.15.187:6789/0 conn(0x7f0ab41447b0 legacy=0x7f0ab40c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.931+0000 7f0ab2ffd640 1 -- 172.21.15.132:0/798465440 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ab4144b90 con 0x7f0ab40ca170 2023-12-20T04:49:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.932+0000 7f0ab2ffd640 1 --2- 172.21.15.132:0/798465440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ab40ca170 0x7f0ab40ca5d0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40cf990 tx=0x7f0aa802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c9978715cff06bfc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.932+0000 7f0ab27fc640 1 -- 172.21.15.132:0/798465440 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa80317e0 con 0x7f0ab40ca170 2023-12-20T04:49:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.932+0000 7f0ab27fc640 1 -- 172.21.15.132:0/798465440 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa8031940 con 0x7f0ab40ca170 2023-12-20T04:49:33.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.932+0000 7f0ab27fc640 1 -- 172.21.15.132:0/798465440 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa8031cd0 con 0x7f0ab40ca170 2023-12-20T04:49:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.933+0000 7f0aba232640 1 -- 172.21.15.132:0/798465440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ab40ca170 msgr2=0x7f0ab40ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.933+0000 7f0aba232640 1 --2- 172.21.15.132:0/798465440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ab40ca170 0x7f0ab40ca5d0 secure :-1 s=READY pgs=1520 cs=0 l=1 rev1=1 crypto rx=0x7f0ab40cf990 tx=0x7f0aa802b880 comp rx=0 tx=0).stop 2023-12-20T04:49:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.933+0000 7f0aba232640 1 -- 172.21.15.132:0/798465440 shutdown_connections 2023-12-20T04:49:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.933+0000 7f0aba232640 1 --2- 172.21.15.132:0/798465440 >> v2:172.21.15.187:3300/0 conn(0x7f0ab4069c30 0x7f0ab406a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.933+0000 7f0aba232640 1 --2- 172.21.15.132:0/798465440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ab40ca170 0x7f0ab40ca5d0 unknown :-1 s=CLOSED pgs=1520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.933+0000 7f0aba232640 1 -- 172.21.15.132:0/798465440 >> 172.21.15.132:0/798465440 conn(0x7f0ab40cc630 msgr2=0x7f0ab40cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:33.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.933+0000 7f0aba232640 1 -- 172.21.15.132:0/798465440 shutdown_connections 2023-12-20T04:49:33.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.933+0000 7f0aba232640 1 -- 172.21.15.132:0/798465440 wait complete. 2023-12-20T04:49:33.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.934+0000 7f0aba232640 1 Processor -- start 2023-12-20T04:49:33.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.934+0000 7f0aba232640 1 -- start start 2023-12-20T04:49:33.940 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0aba232640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ab4069c30 0x7f0ab4134520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0aba232640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ab40ca170 0x7f0ab406ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0aba232640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ab41447b0 0x7f0ab406d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0aba232640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40c89b0 con 0x7f0ab4069c30 2023-12-20T04:49:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0aba232640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40c7d30 con 0x7f0ab40ca170 2023-12-20T04:49:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0aba232640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ab40c8010 con 0x7f0ab41447b0 2023-12-20T04:49:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0ab37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ab4069c30 0x7f0ab4134520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0ab37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ab4069c30 0x7f0ab4134520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45298/0 (socket says 172.21.15.132:45298) 2023-12-20T04:49:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0ab37fe640 1 -- 172.21.15.132:0/947660344 learned_addr learned my addr 172.21.15.132:0/947660344 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0ab37fe640 1 -- 172.21.15.132:0/947660344 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ab41447b0 msgr2=0x7f0ab406d3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0ab37fe640 1 --2- 172.21.15.132:0/947660344 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ab41447b0 0x7f0ab406d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0ab37fe640 1 -- 172.21.15.132:0/947660344 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ab40ca170 msgr2=0x7f0ab406ce60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0ab37fe640 1 --2- 172.21.15.132:0/947660344 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ab40ca170 0x7f0ab406ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:33.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0ab37fe640 1 -- 172.21.15.132:0/947660344 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0aa80094d0 con 0x7f0ab4069c30 2023-12-20T04:49:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0ab37fe640 1 --2- 172.21.15.132:0/947660344 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ab4069c30 0x7f0ab4134520 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400c430 tx=0x7f0aa400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0a9bfff640 1 -- 172.21.15.132:0/947660344 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4011790 con 0x7f0ab4069c30 2023-12-20T04:49:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0a9bfff640 1 -- 172.21.15.132:0/947660344 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0aa40118f0 con 0x7f0ab4069c30 2023-12-20T04:49:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0a9bfff640 1 -- 172.21.15.132:0/947660344 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0aa4011ce0 con 0x7f0ab4069c30 2023-12-20T04:49:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.935+0000 7f0aba232640 1 -- 172.21.15.132:0/947660344 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ab40c82f0 con 0x7f0ab4069c30 2023-12-20T04:49:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.936+0000 7f0aba232640 1 -- 172.21.15.132:0/947660344 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ab40c8cb0 con 0x7f0ab4069c30 2023-12-20T04:49:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.936+0000 7f0aba232640 1 -- 172.21.15.132:0/947660344 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ab404e840 con 0x7f0ab4069c30 2023-12-20T04:49:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.937+0000 7f0a9bfff640 1 -- 172.21.15.132:0/947660344 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0aa401c460 con 0x7f0ab4069c30 2023-12-20T04:49:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.937+0000 7f0a9bfff640 1 --2- 172.21.15.132:0/947660344 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0aa006a460 0x7f0aa006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.937+0000 7f0a9bfff640 1 -- 172.21.15.132:0/947660344 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(152..152 src has 1..152) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0aa40888e0 con 0x7f0ab4069c30 2023-12-20T04:49:33.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.937+0000 7f0ab2ffd640 1 --2- 172.21.15.132:0/947660344 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0aa006a460 0x7f0aa006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:33.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.938+0000 7f0ab2ffd640 1 --2- 172.21.15.132:0/947660344 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0aa006a460 0x7f0aa006c920 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8036000 tx=0x7f0aa8030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:33.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:33.941+0000 7f0a9bfff640 1 -- 172.21.15.132:0/947660344 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0aa4053e50 con 0x7f0ab4069c30 2023-12-20T04:49:34.145 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.142+0000 7f0aba232640 1 -- 172.21.15.132:0/947660344 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f0ab406a760 con 0x7f0ab4069c30 2023-12-20T04:49:34.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.219+0000 7f0a9bfff640 1 -- 172.21.15.132:0/947660344 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v56) v1 ==== 118+0+0 (secure 0 0 0) 0x7f0aa4057470 con 0x7f0ab4069c30 2023-12-20T04:49:34.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.221+0000 7f0aba232640 1 -- 172.21.15.132:0/947660344 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0aa006a460 msgr2=0x7f0aa006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:34.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.221+0000 7f0aba232640 1 --2- 172.21.15.132:0/947660344 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0aa006a460 0x7f0aa006c920 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f0aa8036000 tx=0x7f0aa8030000 comp rx=0 tx=0).stop 2023-12-20T04:49:34.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.221+0000 7f0aba232640 1 -- 172.21.15.132:0/947660344 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ab4069c30 msgr2=0x7f0ab4134520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:34.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.221+0000 7f0aba232640 1 --2- 172.21.15.132:0/947660344 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ab4069c30 0x7f0ab4134520 secure :-1 s=READY pgs=1521 cs=0 l=1 rev1=1 crypto rx=0x7f0aa400c430 tx=0x7f0aa400c8f0 comp rx=0 tx=0).stop 2023-12-20T04:49:34.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.221+0000 7f0aba232640 1 -- 172.21.15.132:0/947660344 shutdown_connections 2023-12-20T04:49:34.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.221+0000 7f0aba232640 1 --2- 172.21.15.132:0/947660344 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0aa006a460 0x7f0aa006c920 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:34.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.221+0000 7f0aba232640 1 --2- 172.21.15.132:0/947660344 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ab41447b0 0x7f0ab406d3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:34.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.221+0000 7f0aba232640 1 --2- 172.21.15.132:0/947660344 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ab40ca170 0x7f0ab406ce60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:34.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.221+0000 7f0aba232640 1 --2- 172.21.15.132:0/947660344 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ab4069c30 0x7f0ab4134520 unknown :-1 s=CLOSED pgs=1521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:34.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.222+0000 7f0aba232640 1 -- 172.21.15.132:0/947660344 >> 172.21.15.132:0/947660344 conn(0x7f0ab40cc630 msgr2=0x7f0ab4065910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:34.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.222+0000 7f0aba232640 1 -- 172.21.15.132:0/947660344 shutdown_connections 2023-12-20T04:49:34.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.222+0000 7f0aba232640 1 -- 172.21.15.132:0/947660344 wait complete. 2023-12-20T04:49:34.234 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-20T04:49:34.234 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-20T04:49:34.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.335+0000 7fb55ce07640 1 Processor -- start 2023-12-20T04:49:34.337 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.335+0000 7fb55ce07640 1 -- start start 2023-12-20T04:49:34.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.336+0000 7fb55ce07640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb558069c30 0x7fb558070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:34.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.336+0000 7fb55ce07640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55815d360 0x7fb55806a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:34.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.336+0000 7fb55ce07640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb5580cbde0 0x7fb5580ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:34.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.336+0000 7fb55ce07640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5580c4f40 con 0x7fb5580cbde0 2023-12-20T04:49:34.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.336+0000 7fb55ce07640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb5580af5b0 con 0x7fb558069c30 2023-12-20T04:49:34.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.336+0000 7fb55ce07640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb55806a550 con 0x7fb55815d360 2023-12-20T04:49:34.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.336+0000 7fb556d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb5580cbde0 0x7fb5580ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:34.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.336+0000 7fb556d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb5580cbde0 0x7fb5580ca170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45312/0 (socket says 172.21.15.132:45312) 2023-12-20T04:49:34.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.336+0000 7fb556d9d640 1 -- 172.21.15.132:0/1757898992 learned_addr learned my addr 172.21.15.132:0/1757898992 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:34.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.336+0000 7fb55659c640 1 --2- 172.21.15.132:0/1757898992 >> v2:172.21.15.187:3300/0 conn(0x7fb558069c30 0x7fb558070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:34.339 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.336+0000 7fb54ffff640 1 --2- 172.21.15.132:0/1757898992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55815d360 0x7fb55806a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:34.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.336+0000 7fb556d9d640 1 -- 172.21.15.132:0/1757898992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55815d360 msgr2=0x7fb55806a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:34.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.336+0000 7fb556d9d640 1 --2- 172.21.15.132:0/1757898992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55815d360 0x7fb55806a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:34.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.336+0000 7fb556d9d640 1 -- 172.21.15.132:0/1757898992 >> v2:172.21.15.187:3300/0 conn(0x7fb558069c30 msgr2=0x7fb558070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:34.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.336+0000 7fb556d9d640 1 --2- 172.21.15.132:0/1757898992 >> v2:172.21.15.187:3300/0 conn(0x7fb558069c30 0x7fb558070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:34.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.336+0000 7fb556d9d640 1 -- 172.21.15.132:0/1757898992 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb558070a40 con 0x7fb5580cbde0 2023-12-20T04:49:34.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.337+0000 7fb556d9d640 1 --2- 172.21.15.132:0/1757898992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5580cbde0 0x7fb5580ca170 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fb558071870 tx=0x7fb55002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90f5f177c1aa94ed server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:34.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.337+0000 7fb555d9b640 1 -- 172.21.15.132:0/1757898992 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb55002ca70 con 0x7fb5580cbde0 2023-12-20T04:49:34.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.337+0000 7fb555d9b640 1 -- 172.21.15.132:0/1757898992 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb55002cbd0 con 0x7fb5580cbde0 2023-12-20T04:49:34.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.337+0000 7fb555d9b640 1 -- 172.21.15.132:0/1757898992 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb5500343f0 con 0x7fb5580cbde0 2023-12-20T04:49:34.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.337+0000 7fb55ce07640 1 -- 172.21.15.132:0/1757898992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5580cbde0 msgr2=0x7fb5580ca170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:34.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.337+0000 7fb55ce07640 1 --2- 172.21.15.132:0/1757898992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5580cbde0 0x7fb5580ca170 secure :-1 s=READY pgs=1522 cs=0 l=1 rev1=1 crypto rx=0x7fb558071870 tx=0x7fb55002bed0 comp rx=0 tx=0).stop 2023-12-20T04:49:34.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.337+0000 7fb55ce07640 1 -- 172.21.15.132:0/1757898992 shutdown_connections 2023-12-20T04:49:34.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.337+0000 7fb55ce07640 1 --2- 172.21.15.132:0/1757898992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5580cbde0 0x7fb5580ca170 unknown :-1 s=CLOSED pgs=1522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:34.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.337+0000 7fb55ce07640 1 --2- 172.21.15.132:0/1757898992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb55815d360 0x7fb55806a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:34.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.337+0000 7fb55ce07640 1 --2- 172.21.15.132:0/1757898992 >> v2:172.21.15.187:3300/0 conn(0x7fb558069c30 0x7fb558070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:34.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.337+0000 7fb55ce07640 1 -- 172.21.15.132:0/1757898992 >> 172.21.15.132:0/1757898992 conn(0x7fb5580cc630 msgr2=0x7fb5580cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:34.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.337+0000 7fb55ce07640 1 -- 172.21.15.132:0/1757898992 shutdown_connections 2023-12-20T04:49:34.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.337+0000 7fb55ce07640 1 -- 172.21.15.132:0/1757898992 wait complete. 2023-12-20T04:49:34.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.339+0000 7fb55ce07640 1 Processor -- start 2023-12-20T04:49:34.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.339+0000 7fb55ce07640 1 -- start start 2023-12-20T04:49:34.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.339+0000 7fb55ce07640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb558069c30 0x7fb55806e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:34.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.339+0000 7fb55ce07640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5580cbde0 0x7fb55815f180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:34.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.339+0000 7fb55ce07640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55815d360 0x7fb558151350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:34.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.339+0000 7fb55ce07640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55806dc60 con 0x7fb5580cbde0 2023-12-20T04:49:34.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.339+0000 7fb55ce07640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb55806d5c0 con 0x7fb55815d360 2023-12-20T04:49:34.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.339+0000 7fb55ce07640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb5580adce0 con 0x7fb558069c30 2023-12-20T04:49:34.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.340+0000 7fb54ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5580cbde0 0x7fb55815f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:34.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.340+0000 7fb54ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5580cbde0 0x7fb55815f180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45326/0 (socket says 172.21.15.132:45326) 2023-12-20T04:49:34.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.340+0000 7fb54ffff640 1 -- 172.21.15.132:0/1413064923 learned_addr learned my addr 172.21.15.132:0/1413064923 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:34.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.340+0000 7fb55659c640 1 --2- 172.21.15.132:0/1413064923 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb558069c30 0x7fb55806e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:34.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.340+0000 7fb556d9d640 1 --2- 172.21.15.132:0/1413064923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55815d360 0x7fb558151350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:34.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.340+0000 7fb54ffff640 1 -- 172.21.15.132:0/1413064923 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb558069c30 msgr2=0x7fb55806e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:34.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.340+0000 7fb54ffff640 1 --2- 172.21.15.132:0/1413064923 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb558069c30 0x7fb55806e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:34.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.340+0000 7fb54ffff640 1 -- 172.21.15.132:0/1413064923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55815d360 msgr2=0x7fb558151350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:34.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.340+0000 7fb54ffff640 1 --2- 172.21.15.132:0/1413064923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55815d360 0x7fb558151350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:34.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.340+0000 7fb54ffff640 1 -- 172.21.15.132:0/1413064923 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb550009b30 con 0x7fb5580cbde0 2023-12-20T04:49:34.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.340+0000 7fb54ffff640 1 --2- 172.21.15.132:0/1413064923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5580cbde0 0x7fb55815f180 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fb54000d800 tx=0x7fb54000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:34.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.340+0000 7fb54effd640 1 -- 172.21.15.132:0/1413064923 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000b6c0 con 0x7fb5580cbde0 2023-12-20T04:49:34.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.340+0000 7fb54effd640 1 -- 172.21.15.132:0/1413064923 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb54000b820 con 0x7fb5580cbde0 2023-12-20T04:49:34.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.340+0000 7fb55ce07640 1 -- 172.21.15.132:0/1413064923 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb55806d880 con 0x7fb5580cbde0 2023-12-20T04:49:34.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.340+0000 7fb54effd640 1 -- 172.21.15.132:0/1413064923 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb54000bbb0 con 0x7fb5580cbde0 2023-12-20T04:49:34.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.340+0000 7fb55ce07640 1 -- 172.21.15.132:0/1413064923 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb55815f8a0 con 0x7fb5580cbde0 2023-12-20T04:49:34.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.341+0000 7fb55ce07640 1 -- 172.21.15.132:0/1413064923 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb55806d410 con 0x7fb5580cbde0 2023-12-20T04:49:34.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.342+0000 7fb54effd640 1 -- 172.21.15.132:0/1413064923 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb54000bd10 con 0x7fb5580cbde0 2023-12-20T04:49:34.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.342+0000 7fb54effd640 1 --2- 172.21.15.132:0/1413064923 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb53806a430 0x7fb53806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:34.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.342+0000 7fb54effd640 1 -- 172.21.15.132:0/1413064923 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb540088a10 con 0x7fb5580cbde0 2023-12-20T04:49:34.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.342+0000 7fb55659c640 1 --2- 172.21.15.132:0/1413064923 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb53806a430 0x7fb53806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:34.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.342+0000 7fb55659c640 1 --2- 172.21.15.132:0/1413064923 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb53806a430 0x7fb53806c8f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb5480079a0 tx=0x7fb548008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:34.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.346+0000 7fb54effd640 1 -- 172.21.15.132:0/1413064923 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb540054140 con 0x7fb5580cbde0 2023-12-20T04:49:34.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:34.544+0000 7fb55ce07640 1 -- 172.21.15.132:0/1413064923 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7fb55815f8a0 con 0x7fb5580cbde0 2023-12-20T04:49:35.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.221+0000 7fb54effd640 1 -- 172.21.15.132:0/1413064923 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v57) v1 ==== 122+0+0 (secure 0 0 0) 0x7fb55815f8a0 con 0x7fb5580cbde0 2023-12-20T04:49:35.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.223+0000 7fb55ce07640 1 -- 172.21.15.132:0/1413064923 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb53806a430 msgr2=0x7fb53806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.223+0000 7fb55ce07640 1 --2- 172.21.15.132:0/1413064923 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb53806a430 0x7fb53806c8f0 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7fb5480079a0 tx=0x7fb548008040 comp rx=0 tx=0).stop 2023-12-20T04:49:35.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.223+0000 7fb55ce07640 1 -- 172.21.15.132:0/1413064923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5580cbde0 msgr2=0x7fb55815f180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.223+0000 7fb55ce07640 1 --2- 172.21.15.132:0/1413064923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5580cbde0 0x7fb55815f180 secure :-1 s=READY pgs=1523 cs=0 l=1 rev1=1 crypto rx=0x7fb54000d800 tx=0x7fb54000dcc0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.223+0000 7fb55ce07640 1 -- 172.21.15.132:0/1413064923 shutdown_connections 2023-12-20T04:49:35.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.223+0000 7fb55ce07640 1 --2- 172.21.15.132:0/1413064923 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb53806a430 0x7fb53806c8f0 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.223+0000 7fb55ce07640 1 --2- 172.21.15.132:0/1413064923 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb55815d360 0x7fb558151350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.223+0000 7fb55ce07640 1 --2- 172.21.15.132:0/1413064923 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb5580cbde0 0x7fb55815f180 unknown :-1 s=CLOSED pgs=1523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.223+0000 7fb55ce07640 1 --2- 172.21.15.132:0/1413064923 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb558069c30 0x7fb55806e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.223+0000 7fb55ce07640 1 -- 172.21.15.132:0/1413064923 >> 172.21.15.132:0/1413064923 conn(0x7fb5580cc630 msgr2=0x7fb5580af770 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:35.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.223+0000 7fb55ce07640 1 -- 172.21.15.132:0/1413064923 shutdown_connections 2023-12-20T04:49:35.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.223+0000 7fb55ce07640 1 -- 172.21.15.132:0/1413064923 wait complete. 2023-12-20T04:49:35.238 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-20T04:49:35.238 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:49:35.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.338+0000 7fa8e4817640 1 Processor -- start 2023-12-20T04:49:35.340 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.338+0000 7fa8e4817640 1 -- start start 2023-12-20T04:49:35.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.339+0000 7fa8e4817640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa8e015cef0 0x7fa8e00cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.339+0000 7fa8e4817640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8e015d2d0 0x7fa8e00ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.339+0000 7fa8e4817640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8e00add30 con 0x7fa8e00cd1e0 2023-12-20T04:49:35.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.339+0000 7fa8e4817640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8e00ae010 con 0x7fa8e015cef0 2023-12-20T04:49:35.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.339+0000 7fa8e4817640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e0072d00 con 0x7fa8e015d2d0 2023-12-20T04:49:35.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.339+0000 7fa8de59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa8e015cef0 0x7fa8e00cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.339+0000 7fa8de59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa8e015cef0 0x7fa8e00cecc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45342/0 (socket says 172.21.15.132:45342) 2023-12-20T04:49:35.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.339+0000 7fa8de59c640 1 -- 172.21.15.132:0/1719867172 learned_addr learned my addr 172.21.15.132:0/1719867172 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:35.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.339+0000 7fa8ddd9b640 1 --2- 172.21.15.132:0/1719867172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8e015d2d0 0x7fa8e00ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.339+0000 7fa8de59c640 1 -- 172.21.15.132:0/1719867172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8e015d2d0 msgr2=0x7fa8e00ad2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:35.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.339+0000 7fa8de59c640 1 --2- 172.21.15.132:0/1719867172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8e015d2d0 0x7fa8e00ad2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.339+0000 7fa8de59c640 1 -- 172.21.15.132:0/1719867172 >> v1:172.21.15.187:6789/0 conn(0x7fa8e00cd1e0 legacy=0x7fa8e006bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.339+0000 7fa8de59c640 1 -- 172.21.15.132:0/1719867172 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8e0072fe0 con 0x7fa8e015cef0 2023-12-20T04:49:35.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.340+0000 7fa8de59c640 1 --2- 172.21.15.132:0/1719867172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8e015cef0 0x7fa8e00cecc0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009e50 tx=0x7fa8d002bff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4c2d3d3f2ba847b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:35.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.340+0000 7fa8dd59a640 1 -- 172.21.15.132:0/1719867172 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d002cb90 con 0x7fa8e015cef0 2023-12-20T04:49:35.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.340+0000 7fa8dd59a640 1 -- 172.21.15.132:0/1719867172 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d002ccf0 con 0x7fa8e015cef0 2023-12-20T04:49:35.343 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.340+0000 7fa8dd59a640 1 -- 172.21.15.132:0/1719867172 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d0034610 con 0x7fa8e015cef0 2023-12-20T04:49:35.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.341+0000 7fa8e4817640 1 -- 172.21.15.132:0/1719867172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8e015cef0 msgr2=0x7fa8e00cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.341+0000 7fa8e4817640 1 --2- 172.21.15.132:0/1719867172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8e015cef0 0x7fa8e00cecc0 secure :-1 s=READY pgs=1524 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0009e50 tx=0x7fa8d002bff0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.341+0000 7fa8e4817640 1 -- 172.21.15.132:0/1719867172 shutdown_connections 2023-12-20T04:49:35.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.341+0000 7fa8e4817640 1 --2- 172.21.15.132:0/1719867172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8e015d2d0 0x7fa8e00ad2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.341+0000 7fa8e4817640 1 --2- 172.21.15.132:0/1719867172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8e015cef0 0x7fa8e00cecc0 unknown :-1 s=CLOSED pgs=1524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.344 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.341+0000 7fa8e4817640 1 -- 172.21.15.132:0/1719867172 >> 172.21.15.132:0/1719867172 conn(0x7fa8e00cf330 msgr2=0x7fa8e00cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:35.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.341+0000 7fa8e4817640 1 -- 172.21.15.132:0/1719867172 shutdown_connections 2023-12-20T04:49:35.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.341+0000 7fa8e4817640 1 -- 172.21.15.132:0/1719867172 wait complete. 2023-12-20T04:49:35.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.342+0000 7fa8e4817640 1 Processor -- start 2023-12-20T04:49:35.345 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.342+0000 7fa8e4817640 1 -- start start 2023-12-20T04:49:35.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.343+0000 7fa8e4817640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8e00cd1e0 0x7fa8e01f5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.343+0000 7fa8e4817640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8e015cef0 0x7fa8e01f3180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.343+0000 7fa8e4817640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8e015d2d0 0x7fa8e0156020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.343+0000 7fa8e4817640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e0153f10 con 0x7fa8e015d2d0 2023-12-20T04:49:35.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.343+0000 7fa8e4817640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e01f36c0 con 0x7fa8e015cef0 2023-12-20T04:49:35.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.343+0000 7fa8e4817640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8e0152a20 con 0x7fa8e00cd1e0 2023-12-20T04:49:35.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.343+0000 7fa8ded9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8e015d2d0 0x7fa8e0156020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.343+0000 7fa8ded9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8e015d2d0 0x7fa8e0156020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45352/0 (socket says 172.21.15.132:45352) 2023-12-20T04:49:35.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.343+0000 7fa8ded9d640 1 -- 172.21.15.132:0/114345178 learned_addr learned my addr 172.21.15.132:0/114345178 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:35.347 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.343+0000 7fa8ddd9b640 1 --2- 172.21.15.132:0/114345178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8e015cef0 0x7fa8e01f3180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.343+0000 7fa8de59c640 1 --2- 172.21.15.132:0/114345178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8e00cd1e0 0x7fa8e01f5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.343+0000 7fa8ded9d640 1 -- 172.21.15.132:0/114345178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8e00cd1e0 msgr2=0x7fa8e01f5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.343+0000 7fa8ded9d640 1 --2- 172.21.15.132:0/114345178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8e00cd1e0 0x7fa8e01f5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.343+0000 7fa8ded9d640 1 -- 172.21.15.132:0/114345178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8e015cef0 msgr2=0x7fa8e01f3180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.343+0000 7fa8ded9d640 1 --2- 172.21.15.132:0/114345178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8e015cef0 0x7fa8e01f3180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.343+0000 7fa8ded9d640 1 -- 172.21.15.132:0/114345178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8d0009b30 con 0x7fa8e015d2d0 2023-12-20T04:49:35.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.344+0000 7fa8ddd9b640 1 --2- 172.21.15.132:0/114345178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8e015cef0 0x7fa8e01f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:35.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.344+0000 7fa8ded9d640 1 --2- 172.21.15.132:0/114345178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8e015d2d0 0x7fa8e0156020 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8001eb0 tx=0x7fa8d800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:35.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.344+0000 7fa8ceffd640 1 -- 172.21.15.132:0/114345178 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d80052d0 con 0x7fa8e015d2d0 2023-12-20T04:49:35.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.344+0000 7fa8ceffd640 1 -- 172.21.15.132:0/114345178 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa8d8005430 con 0x7fa8e015d2d0 2023-12-20T04:49:35.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.344+0000 7fa8e4817640 1 -- 172.21.15.132:0/114345178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8e0152d00 con 0x7fa8e015d2d0 2023-12-20T04:49:35.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.344+0000 7fa8ceffd640 1 -- 172.21.15.132:0/114345178 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa8d8003810 con 0x7fa8e015d2d0 2023-12-20T04:49:35.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.344+0000 7fa8e4817640 1 -- 172.21.15.132:0/114345178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8e01532c0 con 0x7fa8e015d2d0 2023-12-20T04:49:35.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.345+0000 7fa8e4817640 1 -- 172.21.15.132:0/114345178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8e004e840 con 0x7fa8e015d2d0 2023-12-20T04:49:35.348 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.345+0000 7fa8ceffd640 1 -- 172.21.15.132:0/114345178 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa8d8003970 con 0x7fa8e015d2d0 2023-12-20T04:49:35.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.346+0000 7fa8ceffd640 1 --2- 172.21.15.132:0/114345178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa8c006a430 0x7fa8c006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.346+0000 7fa8de59c640 1 --2- 172.21.15.132:0/114345178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa8c006a430 0x7fa8c006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.346+0000 7fa8ceffd640 1 -- 172.21.15.132:0/114345178 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8d8087ec0 con 0x7fa8e015d2d0 2023-12-20T04:49:35.349 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.346+0000 7fa8de59c640 1 --2- 172.21.15.132:0/114345178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa8c006a430 0x7fa8c006c8f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0035000 tx=0x7fa8d0030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:35.351 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.350+0000 7fa8ceffd640 1 -- 172.21.15.132:0/114345178 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa8d80534b0 con 0x7fa8e015d2d0 2023-12-20T04:49:35.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.549+0000 7fa8e4817640 1 -- 172.21.15.132:0/114345178 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fa8e0153450 con 0x7fa8e015d2d0 2023-12-20T04:49:35.551 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.549+0000 7fa8ceffd640 1 -- 172.21.15.132:0/114345178 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fa8d8056ad0 con 0x7fa8e015d2d0 2023-12-20T04:49:35.552 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:35.552 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":57,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/756703470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":756703470},{"type":"v1","addr":"172.21.15.187:6834","nonce":756703470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2177183802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2177183802},{"type":"v1","addr":"172.21.15.187:6835","nonce":2177183802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":8337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/390345313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":390345313},{"type":"v1","addr":"172.21.15.132:6837","nonce":390345313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:49:33.211903+0000","modified":"2023-12-20T04:49:35.219491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8340":{"gid":8340,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/3157504695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3157504695},{"type":"v1","addr":"172.21.15.132:6836","nonce":3157504695}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-20T04:49:35.554 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 57 2023-12-20T04:49:35.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.551+0000 7fa8e4817640 1 -- 172.21.15.132:0/114345178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa8c006a430 msgr2=0x7fa8c006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.551+0000 7fa8e4817640 1 --2- 172.21.15.132:0/114345178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa8c006a430 0x7fa8c006c8f0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7fa8d0035000 tx=0x7fa8d0030000 comp rx=0 tx=0).stop 2023-12-20T04:49:35.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.551+0000 7fa8e4817640 1 -- 172.21.15.132:0/114345178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8e015d2d0 msgr2=0x7fa8e0156020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.551+0000 7fa8e4817640 1 --2- 172.21.15.132:0/114345178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8e015d2d0 0x7fa8e0156020 secure :-1 s=READY pgs=1525 cs=0 l=1 rev1=1 crypto rx=0x7fa8d8001eb0 tx=0x7fa8d800c890 comp rx=0 tx=0).stop 2023-12-20T04:49:35.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.551+0000 7fa8e4817640 1 -- 172.21.15.132:0/114345178 shutdown_connections 2023-12-20T04:49:35.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.551+0000 7fa8e4817640 1 --2- 172.21.15.132:0/114345178 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa8c006a430 0x7fa8c006c8f0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.551+0000 7fa8e4817640 1 --2- 172.21.15.132:0/114345178 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8e015d2d0 0x7fa8e0156020 unknown :-1 s=CLOSED pgs=1525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.551+0000 7fa8e4817640 1 --2- 172.21.15.132:0/114345178 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8e015cef0 0x7fa8e01f3180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.551+0000 7fa8e4817640 1 --2- 172.21.15.132:0/114345178 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa8e00cd1e0 0x7fa8e01f5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.551+0000 7fa8e4817640 1 -- 172.21.15.132:0/114345178 >> 172.21.15.132:0/114345178 conn(0x7fa8e00cf330 msgr2=0x7fa8e0157420 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:35.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.551+0000 7fa8e4817640 1 -- 172.21.15.132:0/114345178 shutdown_connections 2023-12-20T04:49:35.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.551+0000 7fa8e4817640 1 -- 172.21.15.132:0/114345178 wait complete. 2023-12-20T04:49:35.564 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:49:35.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.661+0000 7f33fc041640 1 Processor -- start 2023-12-20T04:49:35.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.662+0000 7f33fc041640 1 -- start start 2023-12-20T04:49:35.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.663+0000 7f33fc041640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f415cef0 0x7f33f40cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.663+0000 7f33fc041640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f33f40ad2f0 0x7f33f406bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.663+0000 7f33fc041640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33f40ad780 con 0x7f33f415d2d0 2023-12-20T04:49:35.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.663+0000 7f33fc041640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f33f40add30 con 0x7f33f40ad2f0 2023-12-20T04:49:35.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.663+0000 7f33fc041640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f40ae010 con 0x7f33f415cef0 2023-12-20T04:49:35.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.663+0000 7f33f9ddd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f415cef0 0x7f33f40cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.663+0000 7f33fa5de640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f33f40ad2f0 0x7f33f406bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.663+0000 7f33f95dc640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f33f415d2d0 0x7f33f40cd1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:40222/0 (socket says 172.21.15.132:40222) 2023-12-20T04:49:35.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.663+0000 7f33f95dc640 1 -- 172.21.15.132:0/2722542735 learned_addr learned my addr 172.21.15.132:0/2722542735 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:35.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.663+0000 7f33f9ddd640 1 -- 172.21.15.132:0/2722542735 >> v2:172.21.15.187:3300/0 conn(0x7f33f40ad2f0 msgr2=0x7f33f406bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:35.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.663+0000 7f33f9ddd640 1 --2- 172.21.15.132:0/2722542735 >> v2:172.21.15.187:3300/0 conn(0x7f33f40ad2f0 0x7f33f406bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.663+0000 7f33f9ddd640 1 -- 172.21.15.132:0/2722542735 >> v1:172.21.15.187:6789/0 conn(0x7f33f415d2d0 legacy=0x7f33f40cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.663+0000 7f33f9ddd640 1 -- 172.21.15.132:0/2722542735 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33f4072d00 con 0x7f33f415cef0 2023-12-20T04:49:35.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.663+0000 7f33fa5de640 1 --2- 172.21.15.132:0/2722542735 >> v2:172.21.15.187:3300/0 conn(0x7f33f40ad2f0 0x7f33f406bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:49:35.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.664+0000 7f33f9ddd640 1 --2- 172.21.15.132:0/2722542735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f415cef0 0x7f33f40cecc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f33f00097a0 tx=0x7f33f002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=76e09317c8318f1f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:35.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.664+0000 7f33f8ddb640 1 -- 172.21.15.132:0/2722542735 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0030610 con 0x7f33f415cef0 2023-12-20T04:49:35.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.664+0000 7f33f8ddb640 1 -- 172.21.15.132:0/2722542735 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33f0030770 con 0x7f33f415cef0 2023-12-20T04:49:35.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.664+0000 7f33f8ddb640 1 -- 172.21.15.132:0/2722542735 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33f0030b00 con 0x7f33f415cef0 2023-12-20T04:49:35.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.665+0000 7f33fc041640 1 -- 172.21.15.132:0/2722542735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f415cef0 msgr2=0x7f33f40cecc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.665+0000 7f33fc041640 1 --2- 172.21.15.132:0/2722542735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f415cef0 0x7f33f40cecc0 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f33f00097a0 tx=0x7f33f002b960 comp rx=0 tx=0).stop 2023-12-20T04:49:35.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.665+0000 7f33fc041640 1 -- 172.21.15.132:0/2722542735 shutdown_connections 2023-12-20T04:49:35.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.665+0000 7f33fc041640 1 --2- 172.21.15.132:0/2722542735 >> v2:172.21.15.187:3300/0 conn(0x7f33f40ad2f0 0x7f33f406bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.665+0000 7f33fc041640 1 --2- 172.21.15.132:0/2722542735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f415cef0 0x7f33f40cecc0 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.665+0000 7f33fc041640 1 -- 172.21.15.132:0/2722542735 >> 172.21.15.132:0/2722542735 conn(0x7f33f40cf330 msgr2=0x7f33f40cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:35.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.665+0000 7f33fc041640 1 -- 172.21.15.132:0/2722542735 shutdown_connections 2023-12-20T04:49:35.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.665+0000 7f33fc041640 1 -- 172.21.15.132:0/2722542735 wait complete. 2023-12-20T04:49:35.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.666+0000 7f33fc041640 1 Processor -- start 2023-12-20T04:49:35.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.666+0000 7f33fc041640 1 -- start start 2023-12-20T04:49:35.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.667+0000 7f33fc041640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f40ad2f0 0x7f33f415a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.667+0000 7f33fc041640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f415cef0 0x7f33f41f2110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.667+0000 7f33fc041640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33f415d2d0 0x7f33f40b49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.667+0000 7f33fc041640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f4159430 con 0x7f33f415cef0 2023-12-20T04:49:35.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.667+0000 7f33fc041640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33f41f2650 con 0x7f33f415d2d0 2023-12-20T04:49:35.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.667+0000 7f33fc041640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33f415ae90 con 0x7f33f40ad2f0 2023-12-20T04:49:35.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.667+0000 7f33f95dc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f415cef0 0x7f33f41f2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.667+0000 7f33f95dc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f415cef0 0x7f33f41f2110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45368/0 (socket says 172.21.15.132:45368) 2023-12-20T04:49:35.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.667+0000 7f33f95dc640 1 -- 172.21.15.132:0/386943734 learned_addr learned my addr 172.21.15.132:0/386943734 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:35.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.667+0000 7f33fa5de640 1 --2- 172.21.15.132:0/386943734 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33f415d2d0 0x7f33f40b49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.667+0000 7f33f9ddd640 1 --2- 172.21.15.132:0/386943734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f40ad2f0 0x7f33f415a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.667+0000 7f33f95dc640 1 -- 172.21.15.132:0/386943734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f40ad2f0 msgr2=0x7f33f415a840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.667+0000 7f33f95dc640 1 --2- 172.21.15.132:0/386943734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f40ad2f0 0x7f33f415a840 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.667+0000 7f33f95dc640 1 -- 172.21.15.132:0/386943734 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33f415d2d0 msgr2=0x7f33f40b49e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.667+0000 7f33f95dc640 1 --2- 172.21.15.132:0/386943734 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33f415d2d0 0x7f33f40b49e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.667+0000 7f33f95dc640 1 -- 172.21.15.132:0/386943734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33ec009a70 con 0x7f33f415cef0 2023-12-20T04:49:35.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.667+0000 7f33f95dc640 1 --2- 172.21.15.132:0/386943734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f415cef0 0x7f33f41f2110 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f33e400c3c0 tx=0x7f33e400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:35.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.668+0000 7f33ea7fc640 1 -- 172.21.15.132:0/386943734 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e4005ce0 con 0x7f33f415cef0 2023-12-20T04:49:35.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.668+0000 7f33ea7fc640 1 -- 172.21.15.132:0/386943734 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f33e4005e40 con 0x7f33f415cef0 2023-12-20T04:49:35.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.668+0000 7f33fc041640 1 -- 172.21.15.132:0/386943734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33f0009400 con 0x7f33f415cef0 2023-12-20T04:49:35.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.668+0000 7f33ea7fc640 1 -- 172.21.15.132:0/386943734 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f33e40072d0 con 0x7f33f415cef0 2023-12-20T04:49:35.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.668+0000 7f33fc041640 1 -- 172.21.15.132:0/386943734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33f415b730 con 0x7f33f415cef0 2023-12-20T04:49:35.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.669+0000 7f33fc041640 1 -- 172.21.15.132:0/386943734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33f415b290 con 0x7f33f415cef0 2023-12-20T04:49:35.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.669+0000 7f33ea7fc640 1 -- 172.21.15.132:0/386943734 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f33e4007430 con 0x7f33f415cef0 2023-12-20T04:49:35.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.669+0000 7f33ea7fc640 1 --2- 172.21.15.132:0/386943734 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33d806a430 0x7f33d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.669+0000 7f33ea7fc640 1 -- 172.21.15.132:0/386943734 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33e4087e60 con 0x7f33f415cef0 2023-12-20T04:49:35.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.669+0000 7f33f9ddd640 1 --2- 172.21.15.132:0/386943734 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33d806a430 0x7f33d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.670+0000 7f33f9ddd640 1 --2- 172.21.15.132:0/386943734 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33d806a430 0x7f33d806c8f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f33f0036000 tx=0x7f33f0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:35.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.673+0000 7f33ea7fc640 1 -- 172.21.15.132:0/386943734 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f33e40533f0 con 0x7f33f415cef0 2023-12-20T04:49:35.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.840+0000 7f33fc041640 1 -- 172.21.15.132:0/386943734 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f33f404e840 con 0x7f33f415cef0 2023-12-20T04:49:35.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.841+0000 7f33ea7fc640 1 -- 172.21.15.132:0/386943734 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v153) v1 ==== 74+0+16160 (secure 0 0 0) 0x7f33e4017020 con 0x7f33f415cef0 2023-12-20T04:49:35.843 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:35.843 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":153,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:49:34.213209+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:49:31.238506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-20T04:49:32.189571+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"153","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:49:35.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.843+0000 7f33fc041640 1 -- 172.21.15.132:0/386943734 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33d806a430 msgr2=0x7f33d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.843+0000 7f33fc041640 1 --2- 172.21.15.132:0/386943734 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33d806a430 0x7f33d806c8f0 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f33f0036000 tx=0x7f33f0008030 comp rx=0 tx=0).stop 2023-12-20T04:49:35.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.843+0000 7f33fc041640 1 -- 172.21.15.132:0/386943734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f415cef0 msgr2=0x7f33f41f2110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.843+0000 7f33fc041640 1 --2- 172.21.15.132:0/386943734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f415cef0 0x7f33f41f2110 secure :-1 s=READY pgs=1526 cs=0 l=1 rev1=1 crypto rx=0x7f33e400c3c0 tx=0x7f33e400c880 comp rx=0 tx=0).stop 2023-12-20T04:49:35.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.843+0000 7f33fc041640 1 -- 172.21.15.132:0/386943734 shutdown_connections 2023-12-20T04:49:35.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.843+0000 7f33fc041640 1 --2- 172.21.15.132:0/386943734 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f33d806a430 0x7f33d806c8f0 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.843+0000 7f33fc041640 1 --2- 172.21.15.132:0/386943734 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f33f415d2d0 0x7f33f40b49e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.843+0000 7f33fc041640 1 --2- 172.21.15.132:0/386943734 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33f415cef0 0x7f33f41f2110 unknown :-1 s=CLOSED pgs=1526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.843+0000 7f33fc041640 1 --2- 172.21.15.132:0/386943734 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33f40ad2f0 0x7f33f415a840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.843+0000 7f33fc041640 1 -- 172.21.15.132:0/386943734 >> 172.21.15.132:0/386943734 conn(0x7f33f40cf330 msgr2=0x7f33f40afd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:35.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.843+0000 7f33fc041640 1 -- 172.21.15.132:0/386943734 shutdown_connections 2023-12-20T04:49:35.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.843+0000 7f33fc041640 1 -- 172.21.15.132:0/386943734 wait complete. 2023-12-20T04:49:35.856 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-20T04:49:35.856 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:49:35.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.954+0000 7fdc3892e640 1 Processor -- start 2023-12-20T04:49:35.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.954+0000 7fdc3892e640 1 -- start start 2023-12-20T04:49:35.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.955+0000 7fdc3892e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdc3415d100 0x7fdc340b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.955+0000 7fdc3892e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc340cdc10 0x7fdc3406c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.955+0000 7fdc3892e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc340b2f90 con 0x7fdc340d0370 2023-12-20T04:49:35.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.955+0000 7fdc3892e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc341613c0 con 0x7fdc3415d100 2023-12-20T04:49:35.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.955+0000 7fdc3892e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340d1b00 con 0x7fdc340cdc10 2023-12-20T04:49:35.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.955+0000 7fdc31d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fdc340d0370 0x7fdc340cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:34690/0 (socket says 172.21.15.132:34690) 2023-12-20T04:49:35.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc31d9b640 1 -- 172.21.15.132:0/308674689 learned_addr learned my addr 172.21.15.132:0/308674689 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:35.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc32d9d640 1 --2- 172.21.15.132:0/308674689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc340cdc10 0x7fdc3406c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3259c640 1 --2- 172.21.15.132:0/308674689 >> v2:172.21.15.187:3300/0 conn(0x7fdc3415d100 0x7fdc340b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3159a640 1 -- 172.21.15.132:0/308674689 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4718669 0 0) 0x7fdc28001110 con 0x7fdc340d0370 2023-12-20T04:49:35.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3159a640 1 -- 172.21.15.132:0/308674689 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fdc1c003520 con 0x7fdc340d0370 2023-12-20T04:49:35.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3159a640 1 -- 172.21.15.132:0/308674689 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3392209226 0 0) 0x7fdc1c003520 con 0x7fdc340d0370 2023-12-20T04:49:35.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3159a640 1 -- 172.21.15.132:0/308674689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc340cdc10 msgr2=0x7fdc3406c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:35.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3159a640 1 --2- 172.21.15.132:0/308674689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc340cdc10 0x7fdc3406c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3159a640 1 -- 172.21.15.132:0/308674689 >> v2:172.21.15.187:3300/0 conn(0x7fdc3415d100 msgr2=0x7fdc340b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:35.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3159a640 1 --2- 172.21.15.132:0/308674689 >> v2:172.21.15.187:3300/0 conn(0x7fdc3415d100 0x7fdc340b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3159a640 1 -- 172.21.15.132:0/308674689 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc340d0810 con 0x7fdc340d0370 2023-12-20T04:49:35.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3159a640 1 -- 172.21.15.132:0/308674689 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fdc28001800 con 0x7fdc340d0370 2023-12-20T04:49:35.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3159a640 1 -- 172.21.15.132:0/308674689 >> v1:172.21.15.132:6789/0 conn(0x7fdc340d0370 legacy=0x7fdc340cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3159a640 1 --2- 172.21.15.132:0/308674689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc1c003970 0x7fdc1c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3159a640 1 --2- 172.21.15.132:0/308674689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc340cdc10 0x7fdc1c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3159a640 1 --2- 172.21.15.132:0/308674689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc1c004d00 0x7fdc1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3159a640 1 -- 172.21.15.132:0/308674689 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc341613c0 con 0x7fdc1c003970 2023-12-20T04:49:35.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3159a640 1 -- 172.21.15.132:0/308674689 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340d1b00 con 0x7fdc1c004d00 2023-12-20T04:49:35.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3159a640 1 -- 172.21.15.132:0/308674689 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc1c00b980 con 0x7fdc340cdc10 2023-12-20T04:49:35.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3259c640 1 --2- 172.21.15.132:0/308674689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc1c003970 0x7fdc1c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc31d9b640 1 --2- 172.21.15.132:0/308674689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc340cdc10 0x7fdc1c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc32d9d640 1 --2- 172.21.15.132:0/308674689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc1c004d00 0x7fdc1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3259c640 1 -- 172.21.15.132:0/308674689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc340cdc10 msgr2=0x7fdc1c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:35.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3259c640 1 --2- 172.21.15.132:0/308674689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc340cdc10 0x7fdc1c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3259c640 1 -- 172.21.15.132:0/308674689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc1c004d00 msgr2=0x7fdc1c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:35.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3259c640 1 --2- 172.21.15.132:0/308674689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc1c004d00 0x7fdc1c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.956+0000 7fdc3259c640 1 -- 172.21.15.132:0/308674689 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc1c003520 con 0x7fdc1c003970 2023-12-20T04:49:35.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.957+0000 7fdc31d9b640 1 --2- 172.21.15.132:0/308674689 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc340cdc10 0x7fdc1c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:35.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.957+0000 7fdc32d9d640 1 --2- 172.21.15.132:0/308674689 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc1c004d00 0x7fdc1c005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:35.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.957+0000 7fdc3259c640 1 --2- 172.21.15.132:0/308674689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc1c003970 0x7fdc1c003d90 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009fc0 tx=0x7fdc1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d875e42665d71527 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:35.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.957+0000 7fdc3159a640 1 -- 172.21.15.132:0/308674689 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2402cc60 con 0x7fdc1c003970 2023-12-20T04:49:35.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.957+0000 7fdc3159a640 1 -- 172.21.15.132:0/308674689 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2400f040 con 0x7fdc1c003970 2023-12-20T04:49:35.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.957+0000 7fdc3159a640 1 -- 172.21.15.132:0/308674689 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24034440 con 0x7fdc1c003970 2023-12-20T04:49:35.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.958+0000 7fdc3892e640 1 -- 172.21.15.132:0/308674689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc1c003970 msgr2=0x7fdc1c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.958+0000 7fdc3892e640 1 --2- 172.21.15.132:0/308674689 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc1c003970 0x7fdc1c003d90 secure :-1 s=READY pgs=1528 cs=0 l=1 rev1=1 crypto rx=0x7fdc24009fc0 tx=0x7fdc1c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.958+0000 7fdc32d9d640 1 -- 172.21.15.132:0/308674689 reap_dead start 2023-12-20T04:49:35.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.958+0000 7fdc3892e640 1 -- 172.21.15.132:0/308674689 shutdown_connections 2023-12-20T04:49:35.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.958+0000 7fdc3892e640 1 -- 172.21.15.132:0/308674689 >> 172.21.15.132:0/308674689 conn(0x7fdc3406d7c0 msgr2=0x7fdc3406dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:35.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.958+0000 7fdc3892e640 1 -- 172.21.15.132:0/308674689 shutdown_connections 2023-12-20T04:49:35.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.958+0000 7fdc3892e640 1 -- 172.21.15.132:0/308674689 wait complete. 2023-12-20T04:49:35.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.959+0000 7fdc3892e640 1 Processor -- start 2023-12-20T04:49:35.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.959+0000 7fdc3892e640 1 -- start start 2023-12-20T04:49:35.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.960+0000 7fdc3892e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc1c003970 0x7fdc34160030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.960+0000 7fdc3892e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc341e64d0 0x7fdc3415dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.960+0000 7fdc3892e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc340c6ad0 0x7fdc340c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.960+0000 7fdc3892e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340b55f0 con 0x7fdc341e64d0 2023-12-20T04:49:35.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.960+0000 7fdc3892e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340c7490 con 0x7fdc340c6ad0 2023-12-20T04:49:35.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.960+0000 7fdc3892e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc340b4690 con 0x7fdc1c003970 2023-12-20T04:49:35.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.960+0000 7fdc31d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc341e64d0 0x7fdc3415dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.960+0000 7fdc31d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc341e64d0 0x7fdc3415dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45390/0 (socket says 172.21.15.132:45390) 2023-12-20T04:49:35.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.960+0000 7fdc31d9b640 1 -- 172.21.15.132:0/2795303757 learned_addr learned my addr 172.21.15.132:0/2795303757 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:35.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.960+0000 7fdc3259c640 1 --2- 172.21.15.132:0/2795303757 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc1c003970 0x7fdc34160030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.960+0000 7fdc32d9d640 1 --2- 172.21.15.132:0/2795303757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc340c6ad0 0x7fdc340c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.960+0000 7fdc31d9b640 1 -- 172.21.15.132:0/2795303757 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc1c003970 msgr2=0x7fdc34160030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.960+0000 7fdc31d9b640 1 --2- 172.21.15.132:0/2795303757 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc1c003970 0x7fdc34160030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.960+0000 7fdc31d9b640 1 -- 172.21.15.132:0/2795303757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc340c6ad0 msgr2=0x7fdc340c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:35.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.960+0000 7fdc31d9b640 1 --2- 172.21.15.132:0/2795303757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc340c6ad0 0x7fdc340c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:35.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.960+0000 7fdc31d9b640 1 -- 172.21.15.132:0/2795303757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc340b4970 con 0x7fdc341e64d0 2023-12-20T04:49:35.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.961+0000 7fdc31d9b640 1 --2- 172.21.15.132:0/2795303757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc341e64d0 0x7fdc3415dca0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fdc28007300 tx=0x7fdc280077c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:35.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.961+0000 7fdc22ffd640 1 -- 172.21.15.132:0/2795303757 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2800e740 con 0x7fdc341e64d0 2023-12-20T04:49:35.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.961+0000 7fdc22ffd640 1 -- 172.21.15.132:0/2795303757 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2800e8a0 con 0x7fdc341e64d0 2023-12-20T04:49:35.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.961+0000 7fdc3892e640 1 -- 172.21.15.132:0/2795303757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc340b4c50 con 0x7fdc341e64d0 2023-12-20T04:49:35.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.961+0000 7fdc22ffd640 1 -- 172.21.15.132:0/2795303757 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2800ec10 con 0x7fdc341e64d0 2023-12-20T04:49:35.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.961+0000 7fdc3892e640 1 -- 172.21.15.132:0/2795303757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc340b5210 con 0x7fdc341e64d0 2023-12-20T04:49:35.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.962+0000 7fdc3892e640 1 -- 172.21.15.132:0/2795303757 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc340b5730 con 0x7fdc341e64d0 2023-12-20T04:49:35.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.962+0000 7fdc22ffd640 1 -- 172.21.15.132:0/2795303757 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdc2801d460 con 0x7fdc341e64d0 2023-12-20T04:49:35.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.962+0000 7fdc22ffd640 1 --2- 172.21.15.132:0/2795303757 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc1406a430 0x7fdc1406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:35.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.963+0000 7fdc22ffd640 1 -- 172.21.15.132:0/2795303757 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdc28088a40 con 0x7fdc341e64d0 2023-12-20T04:49:35.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.963+0000 7fdc3259c640 1 --2- 172.21.15.132:0/2795303757 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc1406a430 0x7fdc1406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:35.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.963+0000 7fdc3259c640 1 --2- 172.21.15.132:0/2795303757 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc1406a430 0x7fdc1406c8f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdc24036000 tx=0x7fdc2402e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:35.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:35.967+0000 7fdc22ffd640 1 -- 172.21.15.132:0/2795303757 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdc340b5730 con 0x7fdc341e64d0 2023-12-20T04:49:36.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.131+0000 7fdc3892e640 1 -- 172.21.15.132:0/2795303757 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdc34161050 con 0x7fdc1406a430 2023-12-20T04:49:36.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.137+0000 7fdc22ffd640 1 -- 172.21.15.132:0/2795303757 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+274005 (secure 0 0 0) 0x7fdc24045090 con 0x7fdc1406a430 2023-12-20T04:49:36.143 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:36.145 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:49:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.140+0000 7fdc3892e640 1 -- 172.21.15.132:0/2795303757 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc1406a430 msgr2=0x7fdc1406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.140+0000 7fdc3892e640 1 --2- 172.21.15.132:0/2795303757 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc1406a430 0x7fdc1406c8f0 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7fdc24036000 tx=0x7fdc2402e000 comp rx=0 tx=0).stop 2023-12-20T04:49:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.140+0000 7fdc3892e640 1 -- 172.21.15.132:0/2795303757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc341e64d0 msgr2=0x7fdc3415dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.140+0000 7fdc3892e640 1 --2- 172.21.15.132:0/2795303757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc341e64d0 0x7fdc3415dca0 secure :-1 s=READY pgs=1529 cs=0 l=1 rev1=1 crypto rx=0x7fdc28007300 tx=0x7fdc280077c0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.140+0000 7fdc3892e640 1 -- 172.21.15.132:0/2795303757 shutdown_connections 2023-12-20T04:49:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.140+0000 7fdc3892e640 1 --2- 172.21.15.132:0/2795303757 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc1406a430 0x7fdc1406c8f0 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.140+0000 7fdc3892e640 1 --2- 172.21.15.132:0/2795303757 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc340c6ad0 0x7fdc340c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.140+0000 7fdc3892e640 1 --2- 172.21.15.132:0/2795303757 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc341e64d0 0x7fdc3415dca0 unknown :-1 s=CLOSED pgs=1529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.140+0000 7fdc3892e640 1 --2- 172.21.15.132:0/2795303757 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc1c003970 0x7fdc34160030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.140+0000 7fdc3892e640 1 -- 172.21.15.132:0/2795303757 >> 172.21.15.132:0/2795303757 conn(0x7fdc3406d7c0 msgr2=0x7fdc340b21e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:36.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.141+0000 7fdc3892e640 1 -- 172.21.15.132:0/2795303757 shutdown_connections 2023-12-20T04:49:36.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.141+0000 7fdc3892e640 1 -- 172.21.15.132:0/2795303757 wait complete. 2023-12-20T04:49:36.153 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":354,"stamp":"2023-12-20T04:49:34.215577+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7602,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554897,"statfs":{"total":1600000000,"available":1592214808,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.037243"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:32.865135+0000","last_change":"2023-12-20T04:49:32.865135+0000","last_active":"2023-12-20T04:49:32.865135+0000","last_peered":"2023-12-20T04:49:32.865135+0000","last_clean":"2023-12-20T04:49:32.865135+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:32.865135+0000","last_undegraded":"2023-12-20T04:49:32.865135+0000","last_fullsized":"2023-12-20T04:49:32.865135+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"18.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:49:31.863103+0000","last_change":"2023-12-20T04:49:31.863103+0000","last_active":"2023-12-20T04:49:31.863103+0000","last_peered":"2023-12-20T04:49:31.863103+0000","last_clean":"2023-12-20T04:49:31.863103+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:49:31.863103+0000","last_undegraded":"2023-12-20T04:49:31.863103+0000","last_fullsized":"2023-12-20T04:49:31.863103+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":275,"reported_epoch":148,"state":"active+clean","last_fresh":"2023-12-20T04:49:29.017375+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:49:29.017375+0000","last_peered":"2023-12-20T04:49:29.017375+0000","last_clean":"2023-12-20T04:49:29.017375+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:49:29.017375+0000","last_undegraded":"2023-12-20T04:49:29.017375+0000","last_fullsized":"2023-12-20T04:49:29.017375+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574933,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1382,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193929,"statfs":{"total":200000000,"available":198584075,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.35999999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68700000000000006,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.40899999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67200000000000004,"5min":0.79200000000000004,"15min":0.86299999999999999},"last":0.55000000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.33100000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.73699999999999999,"5min":0.752,"15min":0.98799999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57999999999999996,"15min":0.57299999999999995},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":1.0269999999999999},"last":0.58399999999999996}]},{"osd":2,"last update":"Wed Dec 20 04:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.374},"max":{"1min":0.75900000000000001,"5min":0.97699999999999998,"15min":1.0069999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.629,"5min":0.74199999999999999,"15min":0.78000000000000003},"last":0.53000000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56299999999999994,"15min":0.55600000000000005},"min":{"1min":0.39900000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76600000000000001,"5min":1.048,"15min":1.048},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68899999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45600000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48699999999999999,"15min":0.48599999999999999},"min":{"1min":0.33100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71299999999999997,"5min":0.753,"15min":0.753},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.71399999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56200000000000006}]},{"osd":5,"last update":"Wed Dec 20 04:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.68000000000000005,"5min":0.68999999999999995,"15min":0.73799999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.54000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.73399999999999999,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.61699999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51400000000000001,"15min":0.54400000000000004},"min":{"1min":0.34899999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.67100000000000004,"5min":0.71599999999999997,"15min":0.89800000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.34000000000000002,"5min":0.33200000000000002,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.65300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":806,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174443,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:48:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52400000000000002,"15min":0.502},"min":{"1min":0.45700000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71099999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.504,"5min":0.52600000000000002,"15min":0.53300000000000003},"min":{"1min":0.36699999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.66700000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.51900000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:48:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55400000000000005,"15min":0.53200000000000003},"min":{"1min":0.32100000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.754,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71699999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.60499999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:48:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.50900000000000001},"min":{"1min":0.39800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63200000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.621},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.374,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64800000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52900000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:48:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54300000000000004,"15min":0.504},"min":{"1min":0.40899999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69799999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.41099999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:48:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47199999999999998,"15min":0.502},"min":{"1min":0.36299999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59299999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.34100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61799999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.375}]},{"osd":5,"last update":"Wed Dec 20 04:48:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.499,"15min":0.51300000000000001},"min":{"1min":0.35099999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53500000000000003,"15min":0.55300000000000005},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70499999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63800000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:48:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53400000000000003,"15min":0.54600000000000004},"min":{"1min":0.40400000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73099999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.48899999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.76300000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.59099999999999997}]}]},{"osd":5,"up_from":13,"seq":55834574933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":806,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174443,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53800000000000003,"15min":0.51200000000000001},"min":{"1min":0.38300000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69199999999999995,"5min":0.748,"15min":0.748},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75600000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.5}]},{"osd":1,"last update":"Wed Dec 20 04:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.40500000000000003,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67800000000000005,"5min":0.80600000000000005,"15min":0.82099999999999995},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.57699999999999996},"min":{"1min":0.41999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72799999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54300000000000004}]},{"osd":2,"last update":"Wed Dec 20 04:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52500000000000002,"15min":0.51300000000000001},"min":{"1min":0.34100000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63100000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53600000000000003,"15min":0.52000000000000002},"min":{"1min":0.40400000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63100000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.39000000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.80900000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.74199999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52400000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47099999999999997,"15min":0.501},"min":{"1min":0.308,"5min":0.249,"15min":0.249},"max":{"1min":0.73799999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.47699999999999998,"15min":0.48099999999999998},"min":{"1min":0.29799999999999999,"5min":0.29499999999999998,"15min":0.29399999999999998},"max":{"1min":0.67300000000000004,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.55300000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47899999999999998,"15min":0.505},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71299999999999997,"5min":0.75700000000000001,"15min":0.85299999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53000000000000003,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.31,"15min":0.31},"max":{"1min":0.70699999999999996,"5min":0.81200000000000006,"15min":0.83999999999999997},"last":0.56999999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.52600000000000002},"min":{"1min":0.35299999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68700000000000006,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.60599999999999998},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75700000000000001,"5min":0.80000000000000004,"15min":0.98599999999999999},"last":0.65000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":806,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174443,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.30599999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.64200000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.623},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53800000000000003,"15min":0.52300000000000002},"min":{"1min":0.379,"5min":0.251,"15min":0.251},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.48899999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53600000000000003,"15min":0.51500000000000001},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.315,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.45500000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.55300000000000005},"min":{"1min":0.36299999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.66300000000000003,"5min":0.76000000000000001,"15min":0.83899999999999997},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52800000000000002,"15min":0.54800000000000004},"min":{"1min":0.33300000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.55700000000000005}]},{"osd":3,"last update":"Wed Dec 20 04:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.35299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73399999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.41099999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72699999999999998,"5min":0.877,"15min":0.91000000000000003},"last":0.59699999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44,"15min":0.46999999999999997},"min":{"1min":0.27000000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.69199999999999995},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.49099999999999999,"15min":0.505},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.29199999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76700000000000002},"last":0.70799999999999996}]},{"osd":6,"last update":"Wed Dec 20 04:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48299999999999998,"15min":0.501},"min":{"1min":0.28799999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.82399999999999995},"last":0.72199999999999998},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.503,"15min":0.52800000000000002},"min":{"1min":0.35899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.73499999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.34200000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.747,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.751}]}]},{"osd":3,"up_from":13,"seq":55834574933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":806,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174443,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34999999999999998,"15min":0.33900000000000002},"min":{"1min":0.20599999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.49299999999999999,"5min":0.629,"15min":0.629},"last":0.29099999999999998},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.373,"15min":0.35499999999999998},"min":{"1min":0.25800000000000001,"5min":0.254,"15min":0.246},"max":{"1min":0.52000000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.39400000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.33000000000000002,"15min":0.32000000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.505,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.31},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.36399999999999999,"15min":0.33800000000000002},"min":{"1min":0.26900000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.44700000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.377}]},{"osd":2,"last update":"Wed Dec 20 04:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.22600000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.46700000000000003,"5min":0.53800000000000003,"15min":0.64900000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.372,"5min":0.39400000000000002,"15min":0.376},"min":{"1min":0.27200000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.53500000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.41399999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.54500000000000004},"min":{"1min":0.44500000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.63800000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58299999999999996,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.82099999999999995,"5min":0.872,"15min":0.872},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57799999999999996,"15min":0.55900000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.57399999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58699999999999997,"15min":0.56200000000000006},"min":{"1min":0.41299999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.754,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.622}]},{"osd":7,"last update":"Wed Dec 20 04:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.56799999999999995},"min":{"1min":0.47799999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84999999999999998,"5min":0.879,"15min":0.879},"last":0.65100000000000002},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59499999999999997,"15min":0.57999999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.59599999999999997}]}]},{"osd":2,"up_from":13,"seq":55834574933,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":806,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174443,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.33800000000000002,"15min":0.30199999999999999},"min":{"1min":0.22900000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.42399999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39900000000000002,"15min":0.34699999999999998},"min":{"1min":0.27500000000000002,"5min":0.23200000000000001,"15min":0.17699999999999999},"max":{"1min":0.50600000000000001,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.30099999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.35899999999999999,"15min":0.33200000000000002},"min":{"1min":0.25700000000000001,"5min":0.23300000000000001,"15min":0.17999999999999999},"max":{"1min":0.46200000000000002,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.28299999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.378,"15min":0.35199999999999998},"min":{"1min":0.23100000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.52600000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.32100000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.40400000000000003,"15min":0.36199999999999999},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.216},"max":{"1min":0.49399999999999999,"5min":0.995,"15min":0.995},"last":0.33700000000000002},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.39800000000000002,"15min":0.372},"min":{"1min":0.28999999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.47199999999999998,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.34999999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.378,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78800000000000003,"5min":2.347,"15min":2.347},"last":0.55300000000000005}]},{"osd":5,"last update":"Wed Dec 20 04:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84299999999999997,"5min":0.997,"15min":0.997},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.53600000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.72199999999999998,"5min":2.274,"15min":2.274},"last":0.61599999999999999},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58999999999999997,"15min":0.57599999999999996},"min":{"1min":0.439,"5min":0.38,"15min":0.373},"max":{"1min":0.89300000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.52300000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78600000000000003,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.81699999999999995,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.54400000000000004}]}]},{"osd":1,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":806,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194506,"statfs":{"total":200000000,"available":199174443,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:48:44 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32300000000000001,"15min":0.29299999999999998},"min":{"1min":0.20899999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.49299999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.30599999999999999},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.35699999999999998,"15min":0.33200000000000002},"min":{"1min":0.25,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.52200000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.34100000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:48:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33800000000000002,"15min":0.309},"min":{"1min":0.23000000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.50800000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.254},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.38100000000000001,"15min":0.35199999999999998},"min":{"1min":0.23499999999999999,"5min":0.22600000000000001,"15min":0.224},"max":{"1min":0.54100000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.35499999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:48:44 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39400000000000002,"15min":0.35999999999999999},"min":{"1min":0.26500000000000001,"5min":0.21299999999999999,"15min":0.191},"max":{"1min":0.51200000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.36099999999999999,"15min":0.35199999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.20399999999999999},"max":{"1min":0.56399999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.317}]},{"osd":4,"last update":"Wed Dec 20 04:48:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.36899999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.439},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57099999999999995,"15min":0.55000000000000004},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69299999999999995,"5min":1.002,"15min":1.002},"last":0.49199999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:48:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.40899999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.72199999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.77200000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.51600000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:48:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.39500000000000002,"5min":0.379,"15min":0.36899999999999999},"max":{"1min":0.75700000000000001,"5min":1.038,"15min":1.038},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.42199999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81000000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52800000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:48:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79200000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58899999999999997,"15min":0.60599999999999998},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.84899999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.504}]}]},{"osd":0,"up_from":13,"seq":55834574933,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1382,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193929,"statfs":{"total":200000000,"available":198584075,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.32100000000000001,"15min":0.309},"min":{"1min":0.189,"5min":0.189,"15min":0.184},"max":{"1min":0.46100000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.224},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.34000000000000002,"15min":0.314},"min":{"1min":0.25,"5min":0.217,"15min":0.184},"max":{"1min":0.42099999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.28599999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35899999999999999,"15min":0.35499999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.218},"max":{"1min":0.40999999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.254},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35899999999999999,"15min":0.34799999999999998},"min":{"1min":0.29899999999999999,"5min":0.23400000000000001,"15min":0.23100000000000001},"max":{"1min":0.505,"5min":0.622,"15min":0.622},"last":0.36599999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.35099999999999998,"15min":0.32600000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.42999999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.38600000000000001,"15min":0.36799999999999999},"min":{"1min":0.29999999999999999,"5min":0.29199999999999998,"15min":0.27400000000000002},"max":{"1min":0.497,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.27600000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55600000000000005,"15min":0.52400000000000002},"min":{"1min":0.41999999999999998,"5min":0.36899999999999999,"15min":0.35199999999999998},"max":{"1min":0.64700000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56000000000000005,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.33700000000000002},"max":{"1min":0.70999999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.43099999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55600000000000005,"15min":0.52300000000000002},"min":{"1min":0.42599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.65100000000000002,"5min":0.78700000000000003,"15min":0.81200000000000006},"last":0.376},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57599999999999996,"15min":0.54800000000000004},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73699999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.40000000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59499999999999997,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80900000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.35499999999999998},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59899999999999998,"15min":0.58399999999999996},"min":{"1min":0.45500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.68100000000000005,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.44600000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.438,"5min":0.375,"15min":0.375},"max":{"1min":0.69999999999999996,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58099999999999996,"15min":0.57399999999999995},"min":{"1min":0.46300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77000000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.40999999999999998}]}]}],"pool_statfs":[]}} 2023-12-20T04:49:36.158 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:49:36.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.291+0000 7f99a5eee640 1 Processor -- start 2023-12-20T04:49:36.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.291+0000 7f99a5eee640 1 -- start start 2023-12-20T04:49:36.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.292+0000 7f99a5eee640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f99a015ad70 0x7f99a006f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:36.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.292+0000 7f99a5eee640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f99a006b130 0x7f99a006b580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:36.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.292+0000 7f99a5eee640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99a00c9ab0 con 0x7f99a00c92d0 2023-12-20T04:49:36.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.292+0000 7f99a5eee640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a015ea40 con 0x7f99a015ad70 2023-12-20T04:49:36.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.292+0000 7f99a5eee640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99a006bac0 con 0x7f99a006b130 2023-12-20T04:49:36.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.292+0000 7f999f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f99a015ad70 0x7f99a006f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:36.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.292+0000 7f999f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f99a015ad70 0x7f99a006f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45394/0 (socket says 172.21.15.132:45394) 2023-12-20T04:49:36.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.292+0000 7f999f7fe640 1 -- 172.21.15.132:0/807322150 learned_addr learned my addr 172.21.15.132:0/807322150 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:36.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.292+0000 7f999f7fe640 1 -- 172.21.15.132:0/807322150 >> v2:172.21.15.187:3300/0 conn(0x7f99a006b130 msgr2=0x7f99a006b580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:36.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.292+0000 7f999ffff640 1 --2- 172.21.15.132:0/807322150 >> v2:172.21.15.187:3300/0 conn(0x7f99a006b130 0x7f99a006b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:36.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.292+0000 7f999f7fe640 1 --2- 172.21.15.132:0/807322150 >> v2:172.21.15.187:3300/0 conn(0x7f99a006b130 0x7f99a006b580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.292+0000 7f999f7fe640 1 -- 172.21.15.132:0/807322150 >> v1:172.21.15.187:6789/0 conn(0x7f99a00c92d0 legacy=0x7f99a015f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:36.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.292+0000 7f999f7fe640 1 -- 172.21.15.132:0/807322150 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99a00c9d90 con 0x7f99a015ad70 2023-12-20T04:49:36.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.292+0000 7f999ffff640 1 --2- 172.21.15.132:0/807322150 >> v2:172.21.15.187:3300/0 conn(0x7f99a006b130 0x7f99a006b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:36.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.293+0000 7f999f7fe640 1 --2- 172.21.15.132:0/807322150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a015ad70 0x7f99a006f560 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f99a006c2f0 tx=0x7f999002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3364aa1b5e58fe9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:36.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.293+0000 7f999e7fc640 1 -- 172.21.15.132:0/807322150 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990031870 con 0x7f99a015ad70 2023-12-20T04:49:36.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.293+0000 7f999e7fc640 1 -- 172.21.15.132:0/807322150 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99900319d0 con 0x7f99a015ad70 2023-12-20T04:49:36.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.293+0000 7f999e7fc640 1 -- 172.21.15.132:0/807322150 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9990031d60 con 0x7f99a015ad70 2023-12-20T04:49:36.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.294+0000 7f99a5eee640 1 -- 172.21.15.132:0/807322150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a015ad70 msgr2=0x7f99a006f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:36.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.294+0000 7f99a5eee640 1 --2- 172.21.15.132:0/807322150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a015ad70 0x7f99a006f560 secure :-1 s=READY pgs=1530 cs=0 l=1 rev1=1 crypto rx=0x7f99a006c2f0 tx=0x7f999002b910 comp rx=0 tx=0).stop 2023-12-20T04:49:36.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.294+0000 7f99a5eee640 1 -- 172.21.15.132:0/807322150 shutdown_connections 2023-12-20T04:49:36.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.294+0000 7f99a5eee640 1 --2- 172.21.15.132:0/807322150 >> v2:172.21.15.187:3300/0 conn(0x7f99a006b130 0x7f99a006b580 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.294+0000 7f99a5eee640 1 --2- 172.21.15.132:0/807322150 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a015ad70 0x7f99a006f560 unknown :-1 s=CLOSED pgs=1530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.294+0000 7f99a5eee640 1 -- 172.21.15.132:0/807322150 >> 172.21.15.132:0/807322150 conn(0x7f99a00ced10 msgr2=0x7f99a00cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:36.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.294+0000 7f99a5eee640 1 -- 172.21.15.132:0/807322150 shutdown_connections 2023-12-20T04:49:36.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.294+0000 7f99a5eee640 1 -- 172.21.15.132:0/807322150 wait complete. 2023-12-20T04:49:36.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.295+0000 7f99a5eee640 1 Processor -- start 2023-12-20T04:49:36.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.295+0000 7f99a5eee640 1 -- start start 2023-12-20T04:49:36.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f99a5eee640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99a006b130 0x7f99a00c7a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:36.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f99a5eee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a00c92d0 0x7f99a015d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:36.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f99a5eee640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99a015ad70 0x7f99a015d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:36.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f99a5eee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a01f1ae0 con 0x7f99a00c92d0 2023-12-20T04:49:36.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f99a5eee640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99a015dfd0 con 0x7f99a015ad70 2023-12-20T04:49:36.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f99a5eee640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f99a01f1db0 con 0x7f99a006b130 2023-12-20T04:49:36.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f999effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a00c92d0 0x7f99a015d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:36.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f999effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a00c92d0 0x7f99a015d270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45404/0 (socket says 172.21.15.132:45404) 2023-12-20T04:49:36.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f999effd640 1 -- 172.21.15.132:0/2145595975 learned_addr learned my addr 172.21.15.132:0/2145595975 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:36.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f999ffff640 1 --2- 172.21.15.132:0/2145595975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99a015ad70 0x7f99a015d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:36.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f999f7fe640 1 --2- 172.21.15.132:0/2145595975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99a006b130 0x7f99a00c7a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:36.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f999effd640 1 -- 172.21.15.132:0/2145595975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99a006b130 msgr2=0x7f99a00c7a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:36.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f999effd640 1 --2- 172.21.15.132:0/2145595975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99a006b130 0x7f99a00c7a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f999effd640 1 -- 172.21.15.132:0/2145595975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99a015ad70 msgr2=0x7f99a015d7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:36.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f999effd640 1 --2- 172.21.15.132:0/2145595975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99a015ad70 0x7f99a015d7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f999effd640 1 -- 172.21.15.132:0/2145595975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99900094d0 con 0x7f99a00c92d0 2023-12-20T04:49:36.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f999ffff640 1 --2- 172.21.15.132:0/2145595975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99a015ad70 0x7f99a015d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:36.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f999effd640 1 --2- 172.21.15.132:0/2145595975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a00c92d0 0x7f99a015d270 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f999400c430 tx=0x7f999400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:36.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f9987fff640 1 -- 172.21.15.132:0/2145595975 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994011790 con 0x7f99a00c92d0 2023-12-20T04:49:36.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f9987fff640 1 -- 172.21.15.132:0/2145595975 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99940118f0 con 0x7f99a00c92d0 2023-12-20T04:49:36.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f99a5eee640 1 -- 172.21.15.132:0/2145595975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f99a01f2090 con 0x7f99a00c92d0 2023-12-20T04:49:36.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f9987fff640 1 -- 172.21.15.132:0/2145595975 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9994011ce0 con 0x7f99a00c92d0 2023-12-20T04:49:36.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.296+0000 7f99a5eee640 1 -- 172.21.15.132:0/2145595975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f99a015dcf0 con 0x7f99a00c92d0 2023-12-20T04:49:36.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.297+0000 7f99a5eee640 1 -- 172.21.15.132:0/2145595975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f99a01f25b0 con 0x7f99a00c92d0 2023-12-20T04:49:36.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.298+0000 7f9987fff640 1 -- 172.21.15.132:0/2145595975 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f999401c460 con 0x7f99a00c92d0 2023-12-20T04:49:36.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.298+0000 7f9987fff640 1 --2- 172.21.15.132:0/2145595975 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f998c06a430 0x7f998c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:36.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.298+0000 7f9987fff640 1 -- 172.21.15.132:0/2145595975 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9994088850 con 0x7f99a00c92d0 2023-12-20T04:49:36.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.298+0000 7f999f7fe640 1 --2- 172.21.15.132:0/2145595975 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f998c06a430 0x7f998c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:36.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.299+0000 7f999f7fe640 1 --2- 172.21.15.132:0/2145595975 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f998c06a430 0x7f998c06c8f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9990036000 tx=0x7f999003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:36.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.302+0000 7f9987fff640 1 -- 172.21.15.132:0/2145595975 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f99a01f25b0 con 0x7f99a00c92d0 2023-12-20T04:49:36.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.464+0000 7f99a5eee640 1 -- 172.21.15.132:0/2145595975 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f99a015ec50 con 0x7f998c06a430 2023-12-20T04:49:36.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.471+0000 7f9987fff640 1 -- 172.21.15.132:0/2145595975 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285645 (secure 0 0 0) 0x7f9990031830 con 0x7f998c06a430 2023-12-20T04:49:36.476 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:36.477 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:49:36.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.474+0000 7f99a5eee640 1 -- 172.21.15.132:0/2145595975 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f998c06a430 msgr2=0x7f998c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:36.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.474+0000 7f99a5eee640 1 --2- 172.21.15.132:0/2145595975 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f998c06a430 0x7f998c06c8f0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f9990036000 tx=0x7f999003c040 comp rx=0 tx=0).stop 2023-12-20T04:49:36.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.474+0000 7f99a5eee640 1 -- 172.21.15.132:0/2145595975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a00c92d0 msgr2=0x7f99a015d270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:36.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.474+0000 7f99a5eee640 1 --2- 172.21.15.132:0/2145595975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a00c92d0 0x7f99a015d270 secure :-1 s=READY pgs=1531 cs=0 l=1 rev1=1 crypto rx=0x7f999400c430 tx=0x7f999400c8f0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.474+0000 7f99a5eee640 1 -- 172.21.15.132:0/2145595975 shutdown_connections 2023-12-20T04:49:36.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.474+0000 7f99a5eee640 1 --2- 172.21.15.132:0/2145595975 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f998c06a430 0x7f998c06c8f0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.474+0000 7f99a5eee640 1 --2- 172.21.15.132:0/2145595975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f99a015ad70 0x7f99a015d7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.474+0000 7f99a5eee640 1 --2- 172.21.15.132:0/2145595975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f99a00c92d0 0x7f99a015d270 unknown :-1 s=CLOSED pgs=1531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.474+0000 7f99a5eee640 1 --2- 172.21.15.132:0/2145595975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f99a006b130 0x7f99a00c7a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.474+0000 7f99a5eee640 1 -- 172.21.15.132:0/2145595975 >> 172.21.15.132:0/2145595975 conn(0x7f99a00ced10 msgr2=0x7f99a00b18c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:36.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.474+0000 7f99a5eee640 1 -- 172.21.15.132:0/2145595975 shutdown_connections 2023-12-20T04:49:36.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.474+0000 7f99a5eee640 1 -- 172.21.15.132:0/2145595975 wait complete. 2023-12-20T04:49:36.487 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":355,"stamp":"2023-12-20T04:49:36.179230+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":84,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":7779,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554720,"statfs":{"total":1600000000,"available":1592033948,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.313740"},"pg_stats":[{"pgid":"19.3f","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:35.024063+0000","last_change":"2023-12-20T04:49:33.219528+0000","last_active":"2023-12-20T04:49:35.024063+0000","last_peered":"2023-12-20T04:49:35.024063+0000","last_clean":"2023-12-20T04:49:35.024063+0000","last_became_active":"2023-12-20T04:49:33.219292+0000","last_became_peered":"2023-12-20T04:49:33.219292+0000","last_unstale":"2023-12-20T04:49:35.024063+0000","last_undegraded":"2023-12-20T04:49:35.024063+0000","last_fullsized":"2023-12-20T04:49:35.024063+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:59:38.297027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3e","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124056+0000","last_change":"2023-12-20T04:49:33.224873+0000","last_active":"2023-12-20T04:49:36.124056+0000","last_peered":"2023-12-20T04:49:36.124056+0000","last_clean":"2023-12-20T04:49:36.124056+0000","last_became_active":"2023-12-20T04:49:33.224673+0000","last_became_peered":"2023-12-20T04:49:33.224673+0000","last_unstale":"2023-12-20T04:49:36.124056+0000","last_undegraded":"2023-12-20T04:49:36.124056+0000","last_fullsized":"2023-12-20T04:49:36.124056+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:36:50.185613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3d","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124688+0000","last_change":"2023-12-20T04:49:33.230011+0000","last_active":"2023-12-20T04:49:36.124688+0000","last_peered":"2023-12-20T04:49:36.124688+0000","last_clean":"2023-12-20T04:49:36.124688+0000","last_became_active":"2023-12-20T04:49:33.229180+0000","last_became_peered":"2023-12-20T04:49:33.229180+0000","last_unstale":"2023-12-20T04:49:36.124688+0000","last_undegraded":"2023-12-20T04:49:36.124688+0000","last_fullsized":"2023-12-20T04:49:36.124688+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:48:35.112283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.3c","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:35.023619+0000","last_change":"2023-12-20T04:49:33.223883+0000","last_active":"2023-12-20T04:49:35.023619+0000","last_peered":"2023-12-20T04:49:35.023619+0000","last_clean":"2023-12-20T04:49:35.023619+0000","last_became_active":"2023-12-20T04:49:33.223663+0000","last_became_peered":"2023-12-20T04:49:33.223663+0000","last_unstale":"2023-12-20T04:49:35.023619+0000","last_undegraded":"2023-12-20T04:49:35.023619+0000","last_fullsized":"2023-12-20T04:49:35.023619+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:05:34.072099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.3b","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.218109+0000","last_change":"2023-12-20T04:49:33.224876+0000","last_active":"2023-12-20T04:49:34.218109+0000","last_peered":"2023-12-20T04:49:34.218109+0000","last_clean":"2023-12-20T04:49:34.218109+0000","last_became_active":"2023-12-20T04:49:33.224445+0000","last_became_peered":"2023-12-20T04:49:33.224445+0000","last_unstale":"2023-12-20T04:49:34.218109+0000","last_undegraded":"2023-12-20T04:49:34.218109+0000","last_fullsized":"2023-12-20T04:49:34.218109+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:57:09.675297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.3a","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125462+0000","last_change":"2023-12-20T04:49:33.228152+0000","last_active":"2023-12-20T04:49:36.125462+0000","last_peered":"2023-12-20T04:49:36.125462+0000","last_clean":"2023-12-20T04:49:36.125462+0000","last_became_active":"2023-12-20T04:49:33.224664+0000","last_became_peered":"2023-12-20T04:49:33.224664+0000","last_unstale":"2023-12-20T04:49:36.125462+0000","last_undegraded":"2023-12-20T04:49:36.125462+0000","last_fullsized":"2023-12-20T04:49:36.125462+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:11:55.799558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.39","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125049+0000","last_change":"2023-12-20T04:49:33.224945+0000","last_active":"2023-12-20T04:49:36.125049+0000","last_peered":"2023-12-20T04:49:36.125049+0000","last_clean":"2023-12-20T04:49:36.125049+0000","last_became_active":"2023-12-20T04:49:33.224699+0000","last_became_peered":"2023-12-20T04:49:33.224699+0000","last_unstale":"2023-12-20T04:49:36.125049+0000","last_undegraded":"2023-12-20T04:49:36.125049+0000","last_fullsized":"2023-12-20T04:49:36.125049+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:51:11.061890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.38","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125204+0000","last_change":"2023-12-20T04:49:33.230315+0000","last_active":"2023-12-20T04:49:36.125204+0000","last_peered":"2023-12-20T04:49:36.125204+0000","last_clean":"2023-12-20T04:49:36.125204+0000","last_became_active":"2023-12-20T04:49:33.229518+0000","last_became_peered":"2023-12-20T04:49:33.229518+0000","last_unstale":"2023-12-20T04:49:36.125204+0000","last_undegraded":"2023-12-20T04:49:36.125204+0000","last_fullsized":"2023-12-20T04:49:36.125204+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:11:55.799558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.37","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124945+0000","last_change":"2023-12-20T04:49:33.227670+0000","last_active":"2023-12-20T04:49:36.124945+0000","last_peered":"2023-12-20T04:49:36.124945+0000","last_clean":"2023-12-20T04:49:36.124945+0000","last_became_active":"2023-12-20T04:49:33.227464+0000","last_became_peered":"2023-12-20T04:49:33.227464+0000","last_unstale":"2023-12-20T04:49:36.124945+0000","last_undegraded":"2023-12-20T04:49:36.124945+0000","last_fullsized":"2023-12-20T04:49:36.124945+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:52:36.762168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.36","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124227+0000","last_change":"2023-12-20T04:49:33.221612+0000","last_active":"2023-12-20T04:49:36.124227+0000","last_peered":"2023-12-20T04:49:36.124227+0000","last_clean":"2023-12-20T04:49:36.124227+0000","last_became_active":"2023-12-20T04:49:33.221391+0000","last_became_peered":"2023-12-20T04:49:33.221391+0000","last_unstale":"2023-12-20T04:49:36.124227+0000","last_undegraded":"2023-12-20T04:49:36.124227+0000","last_fullsized":"2023-12-20T04:49:36.124227+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:33:04.779385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.35","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216653+0000","last_change":"2023-12-20T04:49:33.221133+0000","last_active":"2023-12-20T04:49:34.216653+0000","last_peered":"2023-12-20T04:49:34.216653+0000","last_clean":"2023-12-20T04:49:34.216653+0000","last_became_active":"2023-12-20T04:49:33.220855+0000","last_became_peered":"2023-12-20T04:49:33.220855+0000","last_unstale":"2023-12-20T04:49:34.216653+0000","last_undegraded":"2023-12-20T04:49:34.216653+0000","last_fullsized":"2023-12-20T04:49:34.216653+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:11:20.554681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.34","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125095+0000","last_change":"2023-12-20T04:49:33.228056+0000","last_active":"2023-12-20T04:49:36.125095+0000","last_peered":"2023-12-20T04:49:36.125095+0000","last_clean":"2023-12-20T04:49:36.125095+0000","last_became_active":"2023-12-20T04:49:33.227373+0000","last_became_peered":"2023-12-20T04:49:33.227373+0000","last_unstale":"2023-12-20T04:49:36.125095+0000","last_undegraded":"2023-12-20T04:49:36.125095+0000","last_fullsized":"2023-12-20T04:49:36.125095+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:36:50.185613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.33","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:35.023844+0000","last_change":"2023-12-20T04:49:33.224413+0000","last_active":"2023-12-20T04:49:35.023844+0000","last_peered":"2023-12-20T04:49:35.023844+0000","last_clean":"2023-12-20T04:49:35.023844+0000","last_became_active":"2023-12-20T04:49:33.224205+0000","last_became_peered":"2023-12-20T04:49:33.224205+0000","last_unstale":"2023-12-20T04:49:35.023844+0000","last_undegraded":"2023-12-20T04:49:35.023844+0000","last_fullsized":"2023-12-20T04:49:35.023844+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:46:05.865761+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.32","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.123986+0000","last_change":"2023-12-20T04:49:33.221085+0000","last_active":"2023-12-20T04:49:36.123986+0000","last_peered":"2023-12-20T04:49:36.123986+0000","last_clean":"2023-12-20T04:49:36.123986+0000","last_became_active":"2023-12-20T04:49:33.220877+0000","last_became_peered":"2023-12-20T04:49:33.220877+0000","last_unstale":"2023-12-20T04:49:36.123986+0000","last_undegraded":"2023-12-20T04:49:36.123986+0000","last_fullsized":"2023-12-20T04:49:36.123986+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:29:54.157749+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.31","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:35.023887+0000","last_change":"2023-12-20T04:49:33.223011+0000","last_active":"2023-12-20T04:49:35.023887+0000","last_peered":"2023-12-20T04:49:35.023887+0000","last_clean":"2023-12-20T04:49:35.023887+0000","last_became_active":"2023-12-20T04:49:33.222497+0000","last_became_peered":"2023-12-20T04:49:33.222497+0000","last_unstale":"2023-12-20T04:49:35.023887+0000","last_undegraded":"2023-12-20T04:49:35.023887+0000","last_fullsized":"2023-12-20T04:49:35.023887+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:10:09.274470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.30","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216603+0000","last_change":"2023-12-20T04:49:33.228711+0000","last_active":"2023-12-20T04:49:34.216603+0000","last_peered":"2023-12-20T04:49:34.216603+0000","last_clean":"2023-12-20T04:49:34.216603+0000","last_became_active":"2023-12-20T04:49:33.228510+0000","last_became_peered":"2023-12-20T04:49:33.228510+0000","last_unstale":"2023-12-20T04:49:34.216603+0000","last_undegraded":"2023-12-20T04:49:34.216603+0000","last_fullsized":"2023-12-20T04:49:34.216603+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:07:57.005215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2f","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125240+0000","last_change":"2023-12-20T04:49:33.222039+0000","last_active":"2023-12-20T04:49:36.125240+0000","last_peered":"2023-12-20T04:49:36.125240+0000","last_clean":"2023-12-20T04:49:36.125240+0000","last_became_active":"2023-12-20T04:49:33.221352+0000","last_became_peered":"2023-12-20T04:49:33.221352+0000","last_unstale":"2023-12-20T04:49:36.125240+0000","last_undegraded":"2023-12-20T04:49:36.125240+0000","last_fullsized":"2023-12-20T04:49:36.125240+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:52:36.762168+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.2e","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216345+0000","last_change":"2023-12-20T04:49:33.222856+0000","last_active":"2023-12-20T04:49:34.216345+0000","last_peered":"2023-12-20T04:49:34.216345+0000","last_clean":"2023-12-20T04:49:34.216345+0000","last_became_active":"2023-12-20T04:49:33.222668+0000","last_became_peered":"2023-12-20T04:49:33.222668+0000","last_unstale":"2023-12-20T04:49:34.216345+0000","last_undegraded":"2023-12-20T04:49:34.216345+0000","last_fullsized":"2023-12-20T04:49:34.216345+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:42:28.532036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2d","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216623+0000","last_change":"2023-12-20T04:49:33.222519+0000","last_active":"2023-12-20T04:49:34.216623+0000","last_peered":"2023-12-20T04:49:34.216623+0000","last_clean":"2023-12-20T04:49:34.216623+0000","last_became_active":"2023-12-20T04:49:33.222317+0000","last_became_peered":"2023-12-20T04:49:33.222317+0000","last_unstale":"2023-12-20T04:49:34.216623+0000","last_undegraded":"2023-12-20T04:49:34.216623+0000","last_fullsized":"2023-12-20T04:49:34.216623+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:25:18.841632+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2c","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216296+0000","last_change":"2023-12-20T04:49:33.225814+0000","last_active":"2023-12-20T04:49:34.216296+0000","last_peered":"2023-12-20T04:49:34.216296+0000","last_clean":"2023-12-20T04:49:34.216296+0000","last_became_active":"2023-12-20T04:49:33.224953+0000","last_became_peered":"2023-12-20T04:49:33.224953+0000","last_unstale":"2023-12-20T04:49:34.216296+0000","last_undegraded":"2023-12-20T04:49:34.216296+0000","last_fullsized":"2023-12-20T04:49:34.216296+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:27:18.752644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.2b","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.217889+0000","last_change":"2023-12-20T04:49:33.228284+0000","last_active":"2023-12-20T04:49:34.217889+0000","last_peered":"2023-12-20T04:49:34.217889+0000","last_clean":"2023-12-20T04:49:34.217889+0000","last_became_active":"2023-12-20T04:49:33.227829+0000","last_became_peered":"2023-12-20T04:49:33.227829+0000","last_unstale":"2023-12-20T04:49:34.217889+0000","last_undegraded":"2023-12-20T04:49:34.217889+0000","last_fullsized":"2023-12-20T04:49:34.217889+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:35:57.751263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.2a","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.217021+0000","last_change":"2023-12-20T04:49:33.224448+0000","last_active":"2023-12-20T04:49:34.217021+0000","last_peered":"2023-12-20T04:49:34.217021+0000","last_clean":"2023-12-20T04:49:34.217021+0000","last_became_active":"2023-12-20T04:49:33.223628+0000","last_became_peered":"2023-12-20T04:49:33.223628+0000","last_unstale":"2023-12-20T04:49:34.217021+0000","last_undegraded":"2023-12-20T04:49:34.217021+0000","last_fullsized":"2023-12-20T04:49:34.217021+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:25:45.495360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.29","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125590+0000","last_change":"2023-12-20T04:49:33.226180+0000","last_active":"2023-12-20T04:49:36.125590+0000","last_peered":"2023-12-20T04:49:36.125590+0000","last_clean":"2023-12-20T04:49:36.125590+0000","last_became_active":"2023-12-20T04:49:33.225391+0000","last_became_peered":"2023-12-20T04:49:33.225391+0000","last_unstale":"2023-12-20T04:49:36.125590+0000","last_undegraded":"2023-12-20T04:49:36.125590+0000","last_fullsized":"2023-12-20T04:49:36.125590+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:26:08.940916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.28","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216714+0000","last_change":"2023-12-20T04:49:33.219523+0000","last_active":"2023-12-20T04:49:34.216714+0000","last_peered":"2023-12-20T04:49:34.216714+0000","last_clean":"2023-12-20T04:49:34.216714+0000","last_became_active":"2023-12-20T04:49:33.219312+0000","last_became_peered":"2023-12-20T04:49:33.219312+0000","last_unstale":"2023-12-20T04:49:34.216714+0000","last_undegraded":"2023-12-20T04:49:34.216714+0000","last_fullsized":"2023-12-20T04:49:34.216714+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:07.244153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.27","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124275+0000","last_change":"2023-12-20T04:49:33.224185+0000","last_active":"2023-12-20T04:49:36.124275+0000","last_peered":"2023-12-20T04:49:36.124275+0000","last_clean":"2023-12-20T04:49:36.124275+0000","last_became_active":"2023-12-20T04:49:33.223695+0000","last_became_peered":"2023-12-20T04:49:33.223695+0000","last_unstale":"2023-12-20T04:49:36.124275+0000","last_undegraded":"2023-12-20T04:49:36.124275+0000","last_fullsized":"2023-12-20T04:49:36.124275+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:54:24.367376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.26","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216678+0000","last_change":"2023-12-20T04:49:33.229354+0000","last_active":"2023-12-20T04:49:34.216678+0000","last_peered":"2023-12-20T04:49:34.216678+0000","last_clean":"2023-12-20T04:49:34.216678+0000","last_became_active":"2023-12-20T04:49:33.229160+0000","last_became_peered":"2023-12-20T04:49:33.229160+0000","last_unstale":"2023-12-20T04:49:34.216678+0000","last_undegraded":"2023-12-20T04:49:34.216678+0000","last_fullsized":"2023-12-20T04:49:34.216678+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:51:11.061890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.25","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:35.023639+0000","last_change":"2023-12-20T04:49:33.225895+0000","last_active":"2023-12-20T04:49:35.023639+0000","last_peered":"2023-12-20T04:49:35.023639+0000","last_clean":"2023-12-20T04:49:35.023639+0000","last_became_active":"2023-12-20T04:49:33.225208+0000","last_became_peered":"2023-12-20T04:49:33.225208+0000","last_unstale":"2023-12-20T04:49:35.023639+0000","last_undegraded":"2023-12-20T04:49:35.023639+0000","last_fullsized":"2023-12-20T04:49:35.023639+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:06:47.202057+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.24","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125130+0000","last_change":"2023-12-20T04:49:33.224135+0000","last_active":"2023-12-20T04:49:36.125130+0000","last_peered":"2023-12-20T04:49:36.125130+0000","last_clean":"2023-12-20T04:49:36.125130+0000","last_became_active":"2023-12-20T04:49:33.223909+0000","last_became_peered":"2023-12-20T04:49:33.223909+0000","last_unstale":"2023-12-20T04:49:36.125130+0000","last_undegraded":"2023-12-20T04:49:36.125130+0000","last_fullsized":"2023-12-20T04:49:36.125130+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:05:03.198052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.23","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:35.023799+0000","last_change":"2023-12-20T04:49:33.222496+0000","last_active":"2023-12-20T04:49:35.023799+0000","last_peered":"2023-12-20T04:49:35.023799+0000","last_clean":"2023-12-20T04:49:35.023799+0000","last_became_active":"2023-12-20T04:49:33.222293+0000","last_became_peered":"2023-12-20T04:49:33.222293+0000","last_unstale":"2023-12-20T04:49:35.023799+0000","last_undegraded":"2023-12-20T04:49:35.023799+0000","last_fullsized":"2023-12-20T04:49:35.023799+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:27.437373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.22","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:35.023943+0000","last_change":"2023-12-20T04:49:33.222743+0000","last_active":"2023-12-20T04:49:35.023943+0000","last_peered":"2023-12-20T04:49:35.023943+0000","last_clean":"2023-12-20T04:49:35.023943+0000","last_became_active":"2023-12-20T04:49:33.222229+0000","last_became_peered":"2023-12-20T04:49:33.222229+0000","last_unstale":"2023-12-20T04:49:35.023943+0000","last_undegraded":"2023-12-20T04:49:35.023943+0000","last_fullsized":"2023-12-20T04:49:35.023943+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:11:20.479371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.21","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.217539+0000","last_change":"2023-12-20T04:49:33.231273+0000","last_active":"2023-12-20T04:49:34.217539+0000","last_peered":"2023-12-20T04:49:34.217539+0000","last_clean":"2023-12-20T04:49:34.217539+0000","last_became_active":"2023-12-20T04:49:33.229582+0000","last_became_peered":"2023-12-20T04:49:33.229582+0000","last_unstale":"2023-12-20T04:49:34.217539+0000","last_undegraded":"2023-12-20T04:49:34.217539+0000","last_fullsized":"2023-12-20T04:49:34.217539+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:42:28.532036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.20","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125144+0000","last_change":"2023-12-20T04:49:33.226704+0000","last_active":"2023-12-20T04:49:36.125144+0000","last_peered":"2023-12-20T04:49:36.125144+0000","last_clean":"2023-12-20T04:49:36.125144+0000","last_became_active":"2023-12-20T04:49:33.226247+0000","last_became_peered":"2023-12-20T04:49:33.226247+0000","last_unstale":"2023-12-20T04:49:36.125144+0000","last_undegraded":"2023-12-20T04:49:36.125144+0000","last_fullsized":"2023-12-20T04:49:36.125144+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:48:35.112283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.1e","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216215+0000","last_change":"2023-12-20T04:49:33.228657+0000","last_active":"2023-12-20T04:49:34.216215+0000","last_peered":"2023-12-20T04:49:34.216215+0000","last_clean":"2023-12-20T04:49:34.216215+0000","last_became_active":"2023-12-20T04:49:33.228273+0000","last_became_peered":"2023-12-20T04:49:33.228273+0000","last_unstale":"2023-12-20T04:49:34.216215+0000","last_undegraded":"2023-12-20T04:49:34.216215+0000","last_fullsized":"2023-12-20T04:49:34.216215+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:57:09.675297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1f","version":"152'4","reported_seq":15,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.217768+0000","last_change":"2023-12-20T04:49:32.879144+0000","last_active":"2023-12-20T04:49:34.217768+0000","last_peered":"2023-12-20T04:49:34.217768+0000","last_clean":"2023-12-20T04:49:34.217768+0000","last_became_active":"2023-12-20T04:49:32.878633+0000","last_became_peered":"2023-12-20T04:49:32.878633+0000","last_unstale":"2023-12-20T04:49:34.217768+0000","last_undegraded":"2023-12-20T04:49:34.217768+0000","last_fullsized":"2023-12-20T04:49:34.217768+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:22:36.685745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.1f","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125384+0000","last_change":"2023-12-20T04:49:33.226540+0000","last_active":"2023-12-20T04:49:36.125384+0000","last_peered":"2023-12-20T04:49:36.125384+0000","last_clean":"2023-12-20T04:49:36.125384+0000","last_became_active":"2023-12-20T04:49:33.225758+0000","last_became_peered":"2023-12-20T04:49:33.225758+0000","last_unstale":"2023-12-20T04:49:36.125384+0000","last_undegraded":"2023-12-20T04:49:36.125384+0000","last_fullsized":"2023-12-20T04:49:36.125384+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:50:35.269287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.1e","version":"152'1","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124833+0000","last_change":"2023-12-20T04:49:32.876852+0000","last_active":"2023-12-20T04:49:36.124833+0000","last_peered":"2023-12-20T04:49:36.124833+0000","last_clean":"2023-12-20T04:49:36.124833+0000","last_became_active":"2023-12-20T04:49:32.876610+0000","last_became_peered":"2023-12-20T04:49:32.876610+0000","last_unstale":"2023-12-20T04:49:36.124833+0000","last_undegraded":"2023-12-20T04:49:36.124833+0000","last_fullsized":"2023-12-20T04:49:36.124833+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:06:06.126999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.1c","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.217660+0000","last_change":"2023-12-20T04:49:33.231570+0000","last_active":"2023-12-20T04:49:34.217660+0000","last_peered":"2023-12-20T04:49:34.217660+0000","last_clean":"2023-12-20T04:49:34.217660+0000","last_became_active":"2023-12-20T04:49:33.231013+0000","last_became_peered":"2023-12-20T04:49:33.231013+0000","last_unstale":"2023-12-20T04:49:34.217660+0000","last_undegraded":"2023-12-20T04:49:34.217660+0000","last_fullsized":"2023-12-20T04:49:34.217660+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:58.686199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1d","version":"152'2","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216660+0000","last_change":"2023-12-20T04:49:32.876488+0000","last_active":"2023-12-20T04:49:34.216660+0000","last_peered":"2023-12-20T04:49:34.216660+0000","last_clean":"2023-12-20T04:49:34.216660+0000","last_became_active":"2023-12-20T04:49:32.876154+0000","last_became_peered":"2023-12-20T04:49:32.876154+0000","last_unstale":"2023-12-20T04:49:34.216660+0000","last_undegraded":"2023-12-20T04:49:34.216660+0000","last_fullsized":"2023-12-20T04:49:34.216660+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:28:45.391291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.1d","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.218196+0000","last_change":"2023-12-20T04:49:33.224693+0000","last_active":"2023-12-20T04:49:34.218196+0000","last_peered":"2023-12-20T04:49:34.218196+0000","last_clean":"2023-12-20T04:49:34.218196+0000","last_became_active":"2023-12-20T04:49:33.223931+0000","last_became_peered":"2023-12-20T04:49:33.223931+0000","last_unstale":"2023-12-20T04:49:34.218196+0000","last_undegraded":"2023-12-20T04:49:34.218196+0000","last_fullsized":"2023-12-20T04:49:34.218196+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:50:41.262475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.1c","version":"152'2","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124278+0000","last_change":"2023-12-20T04:49:32.876396+0000","last_active":"2023-12-20T04:49:36.124278+0000","last_peered":"2023-12-20T04:49:36.124278+0000","last_clean":"2023-12-20T04:49:36.124278+0000","last_became_active":"2023-12-20T04:49:32.875445+0000","last_became_peered":"2023-12-20T04:49:32.875445+0000","last_unstale":"2023-12-20T04:49:36.124278+0000","last_undegraded":"2023-12-20T04:49:36.124278+0000","last_fullsized":"2023-12-20T04:49:36.124278+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:04:27.902946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1a","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216431+0000","last_change":"2023-12-20T04:49:33.226744+0000","last_active":"2023-12-20T04:49:34.216431+0000","last_peered":"2023-12-20T04:49:34.216431+0000","last_clean":"2023-12-20T04:49:34.216431+0000","last_became_active":"2023-12-20T04:49:33.226362+0000","last_became_peered":"2023-12-20T04:49:33.226362+0000","last_unstale":"2023-12-20T04:49:34.216431+0000","last_undegraded":"2023-12-20T04:49:34.216431+0000","last_fullsized":"2023-12-20T04:49:34.216431+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:06:13.649751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1b","version":"152'1","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124214+0000","last_change":"2023-12-20T04:49:32.876466+0000","last_active":"2023-12-20T04:49:36.124214+0000","last_peered":"2023-12-20T04:49:36.124214+0000","last_clean":"2023-12-20T04:49:36.124214+0000","last_became_active":"2023-12-20T04:49:32.876233+0000","last_became_peered":"2023-12-20T04:49:32.876233+0000","last_unstale":"2023-12-20T04:49:36.124214+0000","last_undegraded":"2023-12-20T04:49:36.124214+0000","last_fullsized":"2023-12-20T04:49:36.124214+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:53:57.716233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.1b","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125337+0000","last_change":"2023-12-20T04:49:33.222647+0000","last_active":"2023-12-20T04:49:36.125337+0000","last_peered":"2023-12-20T04:49:36.125337+0000","last_clean":"2023-12-20T04:49:36.125337+0000","last_became_active":"2023-12-20T04:49:33.221713+0000","last_became_peered":"2023-12-20T04:49:33.221713+0000","last_unstale":"2023-12-20T04:49:36.125337+0000","last_undegraded":"2023-12-20T04:49:36.125337+0000","last_fullsized":"2023-12-20T04:49:36.125337+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:26:08.940916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.1a","version":"152'1","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216516+0000","last_change":"2023-12-20T04:49:32.879037+0000","last_active":"2023-12-20T04:49:34.216516+0000","last_peered":"2023-12-20T04:49:34.216516+0000","last_clean":"2023-12-20T04:49:34.216516+0000","last_became_active":"2023-12-20T04:49:32.878747+0000","last_became_peered":"2023-12-20T04:49:32.878747+0000","last_unstale":"2023-12-20T04:49:34.216516+0000","last_undegraded":"2023-12-20T04:49:34.216516+0000","last_fullsized":"2023-12-20T04:49:34.216516+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:22:36.685745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.18","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125524+0000","last_change":"2023-12-20T04:49:33.229997+0000","last_active":"2023-12-20T04:49:36.125524+0000","last_peered":"2023-12-20T04:49:36.125524+0000","last_clean":"2023-12-20T04:49:36.125524+0000","last_became_active":"2023-12-20T04:49:33.229688+0000","last_became_peered":"2023-12-20T04:49:33.229688+0000","last_unstale":"2023-12-20T04:49:36.125524+0000","last_undegraded":"2023-12-20T04:49:36.125524+0000","last_fullsized":"2023-12-20T04:49:36.125524+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:33:04.779385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.19","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125398+0000","last_change":"2023-12-20T04:49:32.878526+0000","last_active":"2023-12-20T04:49:36.125398+0000","last_peered":"2023-12-20T04:49:36.125398+0000","last_clean":"2023-12-20T04:49:36.125398+0000","last_became_active":"2023-12-20T04:49:32.878100+0000","last_became_peered":"2023-12-20T04:49:32.878100+0000","last_unstale":"2023-12-20T04:49:36.125398+0000","last_undegraded":"2023-12-20T04:49:36.125398+0000","last_fullsized":"2023-12-20T04:49:36.125398+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:57:49.763757+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.19","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124048+0000","last_change":"2023-12-20T04:49:33.225813+0000","last_active":"2023-12-20T04:49:36.124048+0000","last_peered":"2023-12-20T04:49:36.124048+0000","last_clean":"2023-12-20T04:49:36.124048+0000","last_became_active":"2023-12-20T04:49:33.225613+0000","last_became_peered":"2023-12-20T04:49:33.225613+0000","last_unstale":"2023-12-20T04:49:36.124048+0000","last_undegraded":"2023-12-20T04:49:36.124048+0000","last_fullsized":"2023-12-20T04:49:36.124048+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:22:37.687777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.18","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124357+0000","last_change":"2023-12-20T04:49:32.876082+0000","last_active":"2023-12-20T04:49:36.124357+0000","last_peered":"2023-12-20T04:49:36.124357+0000","last_clean":"2023-12-20T04:49:36.124357+0000","last_became_active":"2023-12-20T04:49:32.875869+0000","last_became_peered":"2023-12-20T04:49:32.875869+0000","last_unstale":"2023-12-20T04:49:36.124357+0000","last_undegraded":"2023-12-20T04:49:36.124357+0000","last_fullsized":"2023-12-20T04:49:36.124357+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:34:45.738842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.16","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:35.023804+0000","last_change":"2023-12-20T04:49:33.226902+0000","last_active":"2023-12-20T04:49:35.023804+0000","last_peered":"2023-12-20T04:49:35.023804+0000","last_clean":"2023-12-20T04:49:35.023804+0000","last_became_active":"2023-12-20T04:49:33.226172+0000","last_became_peered":"2023-12-20T04:49:33.226172+0000","last_unstale":"2023-12-20T04:49:35.023804+0000","last_undegraded":"2023-12-20T04:49:35.023804+0000","last_fullsized":"2023-12-20T04:49:35.023804+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:54:48.472645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.17","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125169+0000","last_change":"2023-12-20T04:49:32.880992+0000","last_active":"2023-12-20T04:49:36.125169+0000","last_peered":"2023-12-20T04:49:36.125169+0000","last_clean":"2023-12-20T04:49:36.125169+0000","last_became_active":"2023-12-20T04:49:32.879816+0000","last_became_peered":"2023-12-20T04:49:32.879816+0000","last_unstale":"2023-12-20T04:49:36.125169+0000","last_undegraded":"2023-12-20T04:49:36.125169+0000","last_fullsized":"2023-12-20T04:49:36.125169+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:46:14.069730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.17","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124849+0000","last_change":"2023-12-20T04:49:33.223495+0000","last_active":"2023-12-20T04:49:36.124849+0000","last_peered":"2023-12-20T04:49:36.124849+0000","last_clean":"2023-12-20T04:49:36.124849+0000","last_became_active":"2023-12-20T04:49:33.223257+0000","last_became_peered":"2023-12-20T04:49:33.223257+0000","last_unstale":"2023-12-20T04:49:36.124849+0000","last_undegraded":"2023-12-20T04:49:36.124849+0000","last_fullsized":"2023-12-20T04:49:36.124849+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:48:07.164857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.16","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216341+0000","last_change":"2023-12-20T04:49:32.875934+0000","last_active":"2023-12-20T04:49:34.216341+0000","last_peered":"2023-12-20T04:49:34.216341+0000","last_clean":"2023-12-20T04:49:34.216341+0000","last_became_active":"2023-12-20T04:49:32.875723+0000","last_became_peered":"2023-12-20T04:49:32.875723+0000","last_unstale":"2023-12-20T04:49:34.216341+0000","last_undegraded":"2023-12-20T04:49:34.216341+0000","last_fullsized":"2023-12-20T04:49:34.216341+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:51:04.971010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.14","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.217628+0000","last_change":"2023-12-20T04:49:33.229372+0000","last_active":"2023-12-20T04:49:34.217628+0000","last_peered":"2023-12-20T04:49:34.217628+0000","last_clean":"2023-12-20T04:49:34.217628+0000","last_became_active":"2023-12-20T04:49:33.229124+0000","last_became_peered":"2023-12-20T04:49:33.229124+0000","last_unstale":"2023-12-20T04:49:34.217628+0000","last_undegraded":"2023-12-20T04:49:34.217628+0000","last_fullsized":"2023-12-20T04:49:34.217628+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:05.671725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.15","version":"152'3","reported_seq":14,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125221+0000","last_change":"2023-12-20T04:49:32.876805+0000","last_active":"2023-12-20T04:49:36.125221+0000","last_peered":"2023-12-20T04:49:36.125221+0000","last_clean":"2023-12-20T04:49:36.125221+0000","last_became_active":"2023-12-20T04:49:32.876548+0000","last_became_peered":"2023-12-20T04:49:32.876548+0000","last_unstale":"2023-12-20T04:49:36.125221+0000","last_undegraded":"2023-12-20T04:49:36.125221+0000","last_fullsized":"2023-12-20T04:49:36.125221+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:53:25.433482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.15","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.217662+0000","last_change":"2023-12-20T04:49:33.225973+0000","last_active":"2023-12-20T04:49:34.217662+0000","last_peered":"2023-12-20T04:49:34.217662+0000","last_clean":"2023-12-20T04:49:34.217662+0000","last_became_active":"2023-12-20T04:49:33.223903+0000","last_became_peered":"2023-12-20T04:49:33.223903+0000","last_unstale":"2023-12-20T04:49:34.217662+0000","last_undegraded":"2023-12-20T04:49:34.217662+0000","last_fullsized":"2023-12-20T04:49:34.217662+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:26:47.163023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.14","version":"152'6","reported_seq":17,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125114+0000","last_change":"2023-12-20T04:49:32.877996+0000","last_active":"2023-12-20T04:49:36.125114+0000","last_peered":"2023-12-20T04:49:36.125114+0000","last_clean":"2023-12-20T04:49:36.125114+0000","last_became_active":"2023-12-20T04:49:32.877649+0000","last_became_peered":"2023-12-20T04:49:32.877649+0000","last_unstale":"2023-12-20T04:49:36.125114+0000","last_undegraded":"2023-12-20T04:49:36.125114+0000","last_fullsized":"2023-12-20T04:49:36.125114+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:51:14.439399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.13","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:35.024027+0000","last_change":"2023-12-20T04:49:33.220294+0000","last_active":"2023-12-20T04:49:35.024027+0000","last_peered":"2023-12-20T04:49:35.024027+0000","last_clean":"2023-12-20T04:49:35.024027+0000","last_became_active":"2023-12-20T04:49:33.220065+0000","last_became_peered":"2023-12-20T04:49:33.220065+0000","last_unstale":"2023-12-20T04:49:35.024027+0000","last_undegraded":"2023-12-20T04:49:35.024027+0000","last_fullsized":"2023-12-20T04:49:35.024027+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:10:13.760446+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.12","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:35.024113+0000","last_change":"2023-12-20T04:49:32.870526+0000","last_active":"2023-12-20T04:49:35.024113+0000","last_peered":"2023-12-20T04:49:35.024113+0000","last_clean":"2023-12-20T04:49:35.024113+0000","last_became_active":"2023-12-20T04:49:32.870314+0000","last_became_peered":"2023-12-20T04:49:32.870314+0000","last_unstale":"2023-12-20T04:49:35.024113+0000","last_undegraded":"2023-12-20T04:49:35.024113+0000","last_fullsized":"2023-12-20T04:49:35.024113+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:00:02.244305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.10","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124083+0000","last_change":"2023-12-20T04:49:33.227668+0000","last_active":"2023-12-20T04:49:36.124083+0000","last_peered":"2023-12-20T04:49:36.124083+0000","last_clean":"2023-12-20T04:49:36.124083+0000","last_became_active":"2023-12-20T04:49:33.227472+0000","last_became_peered":"2023-12-20T04:49:33.227472+0000","last_unstale":"2023-12-20T04:49:36.124083+0000","last_undegraded":"2023-12-20T04:49:36.124083+0000","last_fullsized":"2023-12-20T04:49:36.124083+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:50:35.269287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.11","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124262+0000","last_change":"2023-12-20T04:49:32.879798+0000","last_active":"2023-12-20T04:49:36.124262+0000","last_peered":"2023-12-20T04:49:36.124262+0000","last_clean":"2023-12-20T04:49:36.124262+0000","last_became_active":"2023-12-20T04:49:32.879581+0000","last_became_peered":"2023-12-20T04:49:32.879581+0000","last_unstale":"2023-12-20T04:49:36.124262+0000","last_undegraded":"2023-12-20T04:49:36.124262+0000","last_fullsized":"2023-12-20T04:49:36.124262+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:04:34.450964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.11","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125195+0000","last_change":"2023-12-20T04:49:33.227793+0000","last_active":"2023-12-20T04:49:36.125195+0000","last_peered":"2023-12-20T04:49:36.125195+0000","last_clean":"2023-12-20T04:49:36.125195+0000","last_became_active":"2023-12-20T04:49:33.227080+0000","last_became_peered":"2023-12-20T04:49:33.227080+0000","last_unstale":"2023-12-20T04:49:36.125195+0000","last_undegraded":"2023-12-20T04:49:36.125195+0000","last_fullsized":"2023-12-20T04:49:36.125195+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:33:47.728128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.10","version":"152'8","reported_seq":19,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125677+0000","last_change":"2023-12-20T04:49:32.878875+0000","last_active":"2023-12-20T04:49:36.125677+0000","last_peered":"2023-12-20T04:49:36.125677+0000","last_clean":"2023-12-20T04:49:36.125677+0000","last_became_active":"2023-12-20T04:49:32.878553+0000","last_became_peered":"2023-12-20T04:49:32.878553+0000","last_unstale":"2023-12-20T04:49:36.125677+0000","last_undegraded":"2023-12-20T04:49:36.125677+0000","last_fullsized":"2023-12-20T04:49:36.125677+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:37:13.354421+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"19.e","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125608+0000","last_change":"2023-12-20T04:49:33.223812+0000","last_active":"2023-12-20T04:49:36.125608+0000","last_peered":"2023-12-20T04:49:36.125608+0000","last_clean":"2023-12-20T04:49:36.125608+0000","last_became_active":"2023-12-20T04:49:33.223519+0000","last_became_peered":"2023-12-20T04:49:33.223519+0000","last_unstale":"2023-12-20T04:49:36.125608+0000","last_undegraded":"2023-12-20T04:49:36.125608+0000","last_fullsized":"2023-12-20T04:49:36.125608+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T04:54:24.367376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"18.f","version":"152'1","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124928+0000","last_change":"2023-12-20T04:49:32.880594+0000","last_active":"2023-12-20T04:49:36.124928+0000","last_peered":"2023-12-20T04:49:36.124928+0000","last_clean":"2023-12-20T04:49:36.124928+0000","last_became_active":"2023-12-20T04:49:32.878597+0000","last_became_peered":"2023-12-20T04:49:32.878597+0000","last_unstale":"2023-12-20T04:49:36.124928+0000","last_undegraded":"2023-12-20T04:49:36.124928+0000","last_fullsized":"2023-12-20T04:49:36.124928+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:23:48.913098+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.f","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124734+0000","last_change":"2023-12-20T04:49:33.226602+0000","last_active":"2023-12-20T04:49:36.124734+0000","last_peered":"2023-12-20T04:49:36.124734+0000","last_clean":"2023-12-20T04:49:36.124734+0000","last_became_active":"2023-12-20T04:49:33.226142+0000","last_became_peered":"2023-12-20T04:49:33.226142+0000","last_unstale":"2023-12-20T04:49:36.124734+0000","last_undegraded":"2023-12-20T04:49:36.124734+0000","last_fullsized":"2023-12-20T04:49:36.124734+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:51:34.358015+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.e","version":"152'2","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216755+0000","last_change":"2023-12-20T04:49:32.875270+0000","last_active":"2023-12-20T04:49:34.216755+0000","last_peered":"2023-12-20T04:49:34.216755+0000","last_clean":"2023-12-20T04:49:34.216755+0000","last_became_active":"2023-12-20T04:49:32.875044+0000","last_became_peered":"2023-12-20T04:49:32.875044+0000","last_unstale":"2023-12-20T04:49:34.216755+0000","last_undegraded":"2023-12-20T04:49:34.216755+0000","last_fullsized":"2023-12-20T04:49:34.216755+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:43:21.744221+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.c","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216209+0000","last_change":"2023-12-20T04:49:33.224946+0000","last_active":"2023-12-20T04:49:34.216209+0000","last_peered":"2023-12-20T04:49:34.216209+0000","last_clean":"2023-12-20T04:49:34.216209+0000","last_became_active":"2023-12-20T04:49:33.224678+0000","last_became_peered":"2023-12-20T04:49:33.224678+0000","last_unstale":"2023-12-20T04:49:34.216209+0000","last_undegraded":"2023-12-20T04:49:34.216209+0000","last_fullsized":"2023-12-20T04:49:34.216209+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:48:58.686199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.d","version":"152'1","reported_seq":12,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125579+0000","last_change":"2023-12-20T04:49:32.875798+0000","last_active":"2023-12-20T04:49:36.125579+0000","last_peered":"2023-12-20T04:49:36.125579+0000","last_clean":"2023-12-20T04:49:36.125579+0000","last_became_active":"2023-12-20T04:49:32.875419+0000","last_became_peered":"2023-12-20T04:49:32.875419+0000","last_unstale":"2023-12-20T04:49:36.125579+0000","last_undegraded":"2023-12-20T04:49:36.125579+0000","last_fullsized":"2023-12-20T04:49:36.125579+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:36.105723+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"19.d","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124363+0000","last_change":"2023-12-20T04:49:33.226987+0000","last_active":"2023-12-20T04:49:36.124363+0000","last_peered":"2023-12-20T04:49:36.124363+0000","last_clean":"2023-12-20T04:49:36.124363+0000","last_became_active":"2023-12-20T04:49:33.226395+0000","last_became_peered":"2023-12-20T04:49:33.226395+0000","last_unstale":"2023-12-20T04:49:36.124363+0000","last_undegraded":"2023-12-20T04:49:36.124363+0000","last_fullsized":"2023-12-20T04:49:36.124363+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:51:05.973042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.c","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125076+0000","last_change":"2023-12-20T04:49:32.877456+0000","last_active":"2023-12-20T04:49:36.125076+0000","last_peered":"2023-12-20T04:49:36.125076+0000","last_clean":"2023-12-20T04:49:36.125076+0000","last_became_active":"2023-12-20T04:49:32.877232+0000","last_became_peered":"2023-12-20T04:49:32.877232+0000","last_unstale":"2023-12-20T04:49:36.125076+0000","last_undegraded":"2023-12-20T04:49:36.125076+0000","last_fullsized":"2023-12-20T04:49:36.125076+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:46:04.863729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.a","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:35.023697+0000","last_change":"2023-12-20T04:49:33.228242+0000","last_active":"2023-12-20T04:49:35.023697+0000","last_peered":"2023-12-20T04:49:35.023697+0000","last_clean":"2023-12-20T04:49:35.023697+0000","last_became_active":"2023-12-20T04:49:33.228036+0000","last_became_peered":"2023-12-20T04:49:33.228036+0000","last_unstale":"2023-12-20T04:49:35.023697+0000","last_undegraded":"2023-12-20T04:49:35.023697+0000","last_fullsized":"2023-12-20T04:49:35.023697+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:23:49.915129+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.b","version":"152'2","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125327+0000","last_change":"2023-12-20T04:49:32.881459+0000","last_active":"2023-12-20T04:49:36.125327+0000","last_peered":"2023-12-20T04:49:36.125327+0000","last_clean":"2023-12-20T04:49:36.125327+0000","last_became_active":"2023-12-20T04:49:32.880096+0000","last_became_peered":"2023-12-20T04:49:32.880096+0000","last_unstale":"2023-12-20T04:49:36.125327+0000","last_undegraded":"2023-12-20T04:49:36.125327+0000","last_fullsized":"2023-12-20T04:49:36.125327+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:59:37.294995+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"19.b","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124836+0000","last_change":"2023-12-20T04:49:33.225359+0000","last_active":"2023-12-20T04:49:36.124836+0000","last_peered":"2023-12-20T04:49:36.124836+0000","last_clean":"2023-12-20T04:49:36.124836+0000","last_became_active":"2023-12-20T04:49:33.225077+0000","last_became_peered":"2023-12-20T04:49:33.225077+0000","last_unstale":"2023-12-20T04:49:36.124836+0000","last_undegraded":"2023-12-20T04:49:36.124836+0000","last_fullsized":"2023-12-20T04:49:36.124836+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:03:31.152106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.a","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216382+0000","last_change":"2023-12-20T04:49:32.880848+0000","last_active":"2023-12-20T04:49:34.216382+0000","last_peered":"2023-12-20T04:49:34.216382+0000","last_clean":"2023-12-20T04:49:34.216382+0000","last_became_active":"2023-12-20T04:49:32.880631+0000","last_became_peered":"2023-12-20T04:49:32.880631+0000","last_unstale":"2023-12-20T04:49:34.216382+0000","last_undegraded":"2023-12-20T04:49:34.216382+0000","last_fullsized":"2023-12-20T04:49:34.216382+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:33:46.726096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.8","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124189+0000","last_change":"2023-12-20T04:49:33.227160+0000","last_active":"2023-12-20T04:49:36.124189+0000","last_peered":"2023-12-20T04:49:36.124189+0000","last_clean":"2023-12-20T04:49:36.124189+0000","last_became_active":"2023-12-20T04:49:33.226676+0000","last_became_peered":"2023-12-20T04:49:33.226676+0000","last_unstale":"2023-12-20T04:49:36.124189+0000","last_undegraded":"2023-12-20T04:49:36.124189+0000","last_fullsized":"2023-12-20T04:49:36.124189+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:55:37.107754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.9","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216375+0000","last_change":"2023-12-20T04:49:32.878621+0000","last_active":"2023-12-20T04:49:34.216375+0000","last_peered":"2023-12-20T04:49:34.216375+0000","last_clean":"2023-12-20T04:49:34.216375+0000","last_became_active":"2023-12-20T04:49:32.877991+0000","last_became_peered":"2023-12-20T04:49:32.877991+0000","last_unstale":"2023-12-20T04:49:34.216375+0000","last_undegraded":"2023-12-20T04:49:34.216375+0000","last_fullsized":"2023-12-20T04:49:34.216375+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:29:53.155717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.9","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.218015+0000","last_change":"2023-12-20T04:49:33.227086+0000","last_active":"2023-12-20T04:49:34.218015+0000","last_peered":"2023-12-20T04:49:34.218015+0000","last_clean":"2023-12-20T04:49:34.218015+0000","last_became_active":"2023-12-20T04:49:33.226760+0000","last_became_peered":"2023-12-20T04:49:33.226760+0000","last_unstale":"2023-12-20T04:49:34.218015+0000","last_undegraded":"2023-12-20T04:49:34.218015+0000","last_fullsized":"2023-12-20T04:49:34.218015+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:27:18.752644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.8","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216725+0000","last_change":"2023-12-20T04:49:32.874167+0000","last_active":"2023-12-20T04:49:34.216725+0000","last_peered":"2023-12-20T04:49:34.216725+0000","last_clean":"2023-12-20T04:49:34.216725+0000","last_became_active":"2023-12-20T04:49:32.873948+0000","last_became_peered":"2023-12-20T04:49:32.873948+0000","last_unstale":"2023-12-20T04:49:34.216725+0000","last_undegraded":"2023-12-20T04:49:34.216725+0000","last_fullsized":"2023-12-20T04:49:34.216725+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:21:53.980902+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.6","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124930+0000","last_change":"2023-12-20T04:49:33.218324+0000","last_active":"2023-12-20T04:49:36.124930+0000","last_peered":"2023-12-20T04:49:36.124930+0000","last_clean":"2023-12-20T04:49:36.124930+0000","last_became_active":"2023-12-20T04:49:33.217601+0000","last_became_peered":"2023-12-20T04:49:33.217601+0000","last_unstale":"2023-12-20T04:49:36.124930+0000","last_undegraded":"2023-12-20T04:49:36.124930+0000","last_fullsized":"2023-12-20T04:49:36.124930+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:33:04.779385+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.7","version":"152'2","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:35.023972+0000","last_change":"2023-12-20T04:49:32.875047+0000","last_active":"2023-12-20T04:49:35.023972+0000","last_peered":"2023-12-20T04:49:35.023972+0000","last_clean":"2023-12-20T04:49:35.023972+0000","last_became_active":"2023-12-20T04:49:32.874684+0000","last_became_peered":"2023-12-20T04:49:32.874684+0000","last_unstale":"2023-12-20T04:49:35.023972+0000","last_undegraded":"2023-12-20T04:49:35.023972+0000","last_fullsized":"2023-12-20T04:49:35.023972+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:00:39.797375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"19.7","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:35.023888+0000","last_change":"2023-12-20T04:49:33.225413+0000","last_active":"2023-12-20T04:49:35.023888+0000","last_peered":"2023-12-20T04:49:35.023888+0000","last_clean":"2023-12-20T04:49:35.023888+0000","last_became_active":"2023-12-20T04:49:33.224902+0000","last_became_peered":"2023-12-20T04:49:33.224902+0000","last_unstale":"2023-12-20T04:49:35.023888+0000","last_undegraded":"2023-12-20T04:49:35.023888+0000","last_fullsized":"2023-12-20T04:49:35.023888+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:40:20.274291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"18.6","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.217908+0000","last_change":"2023-12-20T04:49:32.879280+0000","last_active":"2023-12-20T04:49:34.217908+0000","last_peered":"2023-12-20T04:49:34.217908+0000","last_clean":"2023-12-20T04:49:34.217908+0000","last_became_active":"2023-12-20T04:49:32.878921+0000","last_became_peered":"2023-12-20T04:49:32.878921+0000","last_unstale":"2023-12-20T04:49:34.217908+0000","last_undegraded":"2023-12-20T04:49:34.217908+0000","last_fullsized":"2023-12-20T04:49:34.217908+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:29:53.155717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.4","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124319+0000","last_change":"2023-12-20T04:49:33.225109+0000","last_active":"2023-12-20T04:49:36.124319+0000","last_peered":"2023-12-20T04:49:36.124319+0000","last_clean":"2023-12-20T04:49:36.124319+0000","last_became_active":"2023-12-20T04:49:33.223962+0000","last_became_peered":"2023-12-20T04:49:33.223962+0000","last_unstale":"2023-12-20T04:49:36.124319+0000","last_undegraded":"2023-12-20T04:49:36.124319+0000","last_fullsized":"2023-12-20T04:49:36.124319+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:33:47.728128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.5","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124146+0000","last_change":"2023-12-20T04:49:32.876897+0000","last_active":"2023-12-20T04:49:36.124146+0000","last_peered":"2023-12-20T04:49:36.124146+0000","last_clean":"2023-12-20T04:49:36.124146+0000","last_became_active":"2023-12-20T04:49:32.876687+0000","last_became_peered":"2023-12-20T04:49:32.876687+0000","last_unstale":"2023-12-20T04:49:36.124146+0000","last_undegraded":"2023-12-20T04:49:36.124146+0000","last_fullsized":"2023-12-20T04:49:36.124146+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:48:06.162825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.5","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.125321+0000","last_change":"2023-12-20T04:49:33.223730+0000","last_active":"2023-12-20T04:49:36.125321+0000","last_peered":"2023-12-20T04:49:36.125321+0000","last_clean":"2023-12-20T04:49:36.125321+0000","last_became_active":"2023-12-20T04:49:33.223457+0000","last_became_peered":"2023-12-20T04:49:33.223457+0000","last_unstale":"2023-12-20T04:49:36.125321+0000","last_undegraded":"2023-12-20T04:49:36.125321+0000","last_fullsized":"2023-12-20T04:49:36.125321+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:39:11.951653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"18.4","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216832+0000","last_change":"2023-12-20T04:49:32.871689+0000","last_active":"2023-12-20T04:49:34.216832+0000","last_peered":"2023-12-20T04:49:34.216832+0000","last_clean":"2023-12-20T04:49:34.216832+0000","last_became_active":"2023-12-20T04:49:32.871419+0000","last_became_peered":"2023-12-20T04:49:32.871419+0000","last_unstale":"2023-12-20T04:49:34.216832+0000","last_undegraded":"2023-12-20T04:49:34.216832+0000","last_fullsized":"2023-12-20T04:49:34.216832+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:41:28.070813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.2","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.217531+0000","last_change":"2023-12-20T04:49:33.225442+0000","last_active":"2023-12-20T04:49:34.217531+0000","last_peered":"2023-12-20T04:49:34.217531+0000","last_clean":"2023-12-20T04:49:34.217531+0000","last_became_active":"2023-12-20T04:49:33.224507+0000","last_became_peered":"2023-12-20T04:49:33.224507+0000","last_unstale":"2023-12-20T04:49:34.217531+0000","last_undegraded":"2023-12-20T04:49:34.217531+0000","last_fullsized":"2023-12-20T04:49:34.217531+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:06:13.649751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.3","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124433+0000","last_change":"2023-12-20T04:49:32.880810+0000","last_active":"2023-12-20T04:49:36.124433+0000","last_peered":"2023-12-20T04:49:36.124433+0000","last_clean":"2023-12-20T04:49:36.124433+0000","last_became_active":"2023-12-20T04:49:32.880335+0000","last_became_peered":"2023-12-20T04:49:32.880335+0000","last_unstale":"2023-12-20T04:49:36.124433+0000","last_undegraded":"2023-12-20T04:49:36.124433+0000","last_fullsized":"2023-12-20T04:49:36.124433+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:05:02.196021+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"19.3","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124949+0000","last_change":"2023-12-20T04:49:33.219384+0000","last_active":"2023-12-20T04:49:36.124949+0000","last_peered":"2023-12-20T04:49:36.124949+0000","last_clean":"2023-12-20T04:49:36.124949+0000","last_became_active":"2023-12-20T04:49:33.219114+0000","last_became_peered":"2023-12-20T04:49:33.219114+0000","last_unstale":"2023-12-20T04:49:36.124949+0000","last_undegraded":"2023-12-20T04:49:36.124949+0000","last_fullsized":"2023-12-20T04:49:36.124949+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:35:19.723797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"18.2","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.217705+0000","last_change":"2023-12-20T04:49:32.876832+0000","last_active":"2023-12-20T04:49:34.217705+0000","last_peered":"2023-12-20T04:49:34.217705+0000","last_clean":"2023-12-20T04:49:34.217705+0000","last_became_active":"2023-12-20T04:49:32.876625+0000","last_became_peered":"2023-12-20T04:49:32.876625+0000","last_unstale":"2023-12-20T04:49:34.217705+0000","last_undegraded":"2023-12-20T04:49:34.217705+0000","last_fullsized":"2023-12-20T04:49:34.217705+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:51:04.971010+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"19.0","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216307+0000","last_change":"2023-12-20T04:49:33.226955+0000","last_active":"2023-12-20T04:49:34.216307+0000","last_peered":"2023-12-20T04:49:34.216307+0000","last_clean":"2023-12-20T04:49:34.216307+0000","last_became_active":"2023-12-20T04:49:33.226740+0000","last_became_peered":"2023-12-20T04:49:33.226740+0000","last_unstale":"2023-12-20T04:49:34.216307+0000","last_undegraded":"2023-12-20T04:49:34.216307+0000","last_fullsized":"2023-12-20T04:49:34.216307+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:05.671725+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"18.1","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216592+0000","last_change":"2023-12-20T04:49:32.880341+0000","last_active":"2023-12-20T04:49:34.216592+0000","last_peered":"2023-12-20T04:49:34.216592+0000","last_clean":"2023-12-20T04:49:34.216592+0000","last_became_active":"2023-12-20T04:49:32.879986+0000","last_became_peered":"2023-12-20T04:49:32.879986+0000","last_unstale":"2023-12-20T04:49:34.216592+0000","last_undegraded":"2023-12-20T04:49:34.216592+0000","last_fullsized":"2023-12-20T04:49:34.216592+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:39:10.949621+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"19.1","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:36.124181+0000","last_change":"2023-12-20T04:49:33.222294+0000","last_active":"2023-12-20T04:49:36.124181+0000","last_peered":"2023-12-20T04:49:36.124181+0000","last_clean":"2023-12-20T04:49:36.124181+0000","last_became_active":"2023-12-20T04:49:33.222086+0000","last_became_peered":"2023-12-20T04:49:33.222086+0000","last_unstale":"2023-12-20T04:49:36.124181+0000","last_undegraded":"2023-12-20T04:49:36.124181+0000","last_fullsized":"2023-12-20T04:49:36.124181+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:39:11.951653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"18.0","version":"0'0","reported_seq":11,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.216774+0000","last_change":"2023-12-20T04:49:32.877574+0000","last_active":"2023-12-20T04:49:34.216774+0000","last_peered":"2023-12-20T04:49:34.216774+0000","last_clean":"2023-12-20T04:49:34.216774+0000","last_became_active":"2023-12-20T04:49:32.876974+0000","last_became_peered":"2023-12-20T04:49:32.876974+0000","last_unstale":"2023-12-20T04:49:34.216774+0000","last_undegraded":"2023-12-20T04:49:34.216774+0000","last_fullsized":"2023-12-20T04:49:34.216774+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:53:42.657682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"19.12","version":"0'0","reported_seq":10,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.217784+0000","last_change":"2023-12-20T04:49:33.231421+0000","last_active":"2023-12-20T04:49:34.217784+0000","last_peered":"2023-12-20T04:49:34.217784+0000","last_clean":"2023-12-20T04:49:34.217784+0000","last_became_active":"2023-12-20T04:49:33.230603+0000","last_became_peered":"2023-12-20T04:49:33.230603+0000","last_unstale":"2023-12-20T04:49:34.217784+0000","last_undegraded":"2023-12-20T04:49:34.217784+0000","last_fullsized":"2023-12-20T04:49:34.217784+0000","mapping_epoch":151,"log_start":"0'0","ondisk_log_start":"0'0","created":151,"last_epoch_clean":152,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:32.865135+0000","last_clean_scrub_stamp":"2023-12-20T04:49:32.865135+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:07:57.005215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"18.13","version":"152'2","reported_seq":13,"reported_epoch":153,"state":"active+clean","last_fresh":"2023-12-20T04:49:34.218281+0000","last_change":"2023-12-20T04:49:32.879665+0000","last_active":"2023-12-20T04:49:34.218281+0000","last_peered":"2023-12-20T04:49:34.218281+0000","last_clean":"2023-12-20T04:49:34.218281+0000","last_became_active":"2023-12-20T04:49:32.879427+0000","last_became_peered":"2023-12-20T04:49:32.879427+0000","last_unstale":"2023-12-20T04:49:34.218281+0000","last_undegraded":"2023-12-20T04:49:34.218281+0000","last_fullsized":"2023-12-20T04:49:34.218281+0000","mapping_epoch":150,"log_start":"0'0","ondisk_log_start":"0'0","created":150,"last_epoch_clean":151,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:49:31.863103+0000","last_clean_scrub_stamp":"2023-12-20T04:49:31.863103+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:54:22.764383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":279,"reported_epoch":152,"state":"active+clean","last_fresh":"2023-12-20T04:49:33.223024+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:49:33.223024+0000","last_peered":"2023-12-20T04:49:33.223024+0000","last_clean":"2023-12-20T04:49:33.223024+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:49:33.223024+0000","last_undegraded":"2023-12-20T04:49:33.223024+0000","last_fullsized":"2023-12-20T04:49:33.223024+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":19,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":18,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574934,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1409,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193903,"statfs":{"total":200000000,"available":198556706,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.55300000000000005,"15min":0.53400000000000003},"min":{"1min":0.35999999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.68700000000000006,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.52900000000000003,"15min":0.52100000000000002},"min":{"1min":0.40899999999999997,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.67200000000000004,"5min":0.79200000000000004,"15min":0.86299999999999999},"last":0.55000000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53300000000000003,"5min":0.54400000000000004,"15min":0.54500000000000004},"min":{"1min":0.33100000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.73699999999999999,"5min":0.752,"15min":0.98799999999999999},"last":0.57699999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.57999999999999996,"15min":0.57299999999999995},"min":{"1min":0.40699999999999997,"5min":0.374,"15min":0.374},"max":{"1min":0.72499999999999998,"5min":0.79700000000000004,"15min":1.0269999999999999},"last":0.58399999999999996}]},{"osd":2,"last update":"Wed Dec 20 04:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.55400000000000005,"15min":0.53400000000000003},"min":{"1min":0.38,"5min":0.38,"15min":0.374},"max":{"1min":0.75900000000000001,"5min":0.97699999999999998,"15min":1.0069999999999999},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.629,"5min":0.74199999999999999,"15min":0.78000000000000003},"last":0.53000000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.56299999999999994,"15min":0.55600000000000005},"min":{"1min":0.39900000000000002,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.76600000000000001,"5min":1.048,"15min":1.048},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.56200000000000006,"15min":0.56100000000000005},"min":{"1min":0.39200000000000002,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.68899999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45600000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48699999999999999,"15min":0.48599999999999999},"min":{"1min":0.33100000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.71299999999999997,"5min":0.753,"15min":0.753},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.27600000000000002,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.71399999999999997,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.56200000000000006}]},{"osd":5,"last update":"Wed Dec 20 04:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.47899999999999998,"15min":0.48899999999999999},"min":{"1min":0.255,"5min":0.255,"15min":0.255},"max":{"1min":0.68000000000000005,"5min":0.68999999999999995,"15min":0.73799999999999999},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.52100000000000002,"15min":0.54000000000000004},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.73399999999999999,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.61699999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:48:47 2023","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.51400000000000001,"15min":0.54400000000000004},"min":{"1min":0.34899999999999998,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.67100000000000004,"5min":0.71599999999999997,"15min":0.89800000000000002},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.54400000000000004,"5min":0.53900000000000003,"15min":0.53800000000000003},"min":{"1min":0.34000000000000002,"5min":0.33200000000000002,"15min":0.28899999999999998},"max":{"1min":0.73599999999999999,"5min":0.77700000000000002,"15min":0.77700000000000002},"last":0.65300000000000002}]}]},{"osd":6,"up_from":13,"seq":55834574935,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":826,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194486,"statfs":{"total":200000000,"available":199154012,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:48:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52400000000000002,"15min":0.502},"min":{"1min":0.45700000000000002,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71099999999999997,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.504,"5min":0.52600000000000002,"15min":0.53300000000000003},"min":{"1min":0.36699999999999999,"5min":0.314,"15min":0.314},"max":{"1min":0.66700000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.55500000000000005}]},{"osd":1,"last update":"Wed Dec 20 04:48:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55400000000000005,"15min":0.53200000000000003},"min":{"1min":0.32100000000000001,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.754,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56200000000000006,"15min":0.57499999999999996},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.71699999999999997,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53600000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:48:50 2023","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.52500000000000002,"15min":0.50900000000000001},"min":{"1min":0.39800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.63200000000000001,"5min":0.73199999999999998,"15min":0.73199999999999998},"last":0.62},{"interface":"front","average":{"1min":0.54100000000000004,"5min":0.53600000000000003,"15min":0.53700000000000003},"min":{"1min":0.374,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.64800000000000002,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.51100000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:48:50 2023","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.54300000000000004,"15min":0.504},"min":{"1min":0.40899999999999997,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73799999999999999,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.55200000000000005,"15min":0.55600000000000005},"min":{"1min":0.433,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.69799999999999995,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57399999999999995}]},{"osd":4,"last update":"Wed Dec 20 04:48:50 2023","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.47199999999999998,"15min":0.502},"min":{"1min":0.36299999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.59299999999999997,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.46600000000000003,"5min":0.498,"15min":0.49199999999999999},"min":{"1min":0.34100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.61799999999999999,"5min":0.73899999999999999,"15min":0.73899999999999999},"last":0.49399999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:48:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.499,"15min":0.51300000000000001},"min":{"1min":0.35099999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.67000000000000004,"5min":0.76000000000000001,"15min":0.76000000000000001},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53500000000000003,"15min":0.55300000000000005},"min":{"1min":0.38600000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.70499999999999996,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.59799999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:48:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52700000000000002,"5min":0.53400000000000003,"15min":0.54600000000000004},"min":{"1min":0.40400000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73099999999999998,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.58899999999999997},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.48899999999999999,"5min":0.375,"15min":0.375},"max":{"1min":0.76300000000000001,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.61099999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":824,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194487,"statfs":{"total":200000000,"available":199155464,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.53800000000000003,"15min":0.51200000000000001},"min":{"1min":0.38300000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69199999999999995,"5min":0.748,"15min":0.748},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.57699999999999996,"15min":0.56200000000000006},"min":{"1min":0.432,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.75600000000000001,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.5}]},{"osd":1,"last update":"Wed Dec 20 04:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":0.54000000000000004,"15min":0.54800000000000004},"min":{"1min":0.40500000000000003,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.67800000000000005,"5min":0.80600000000000005,"15min":0.82099999999999995},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.55700000000000005,"5min":0.58099999999999996,"15min":0.57699999999999996},"min":{"1min":0.41999999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72799999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.54300000000000004}]},{"osd":2,"last update":"Wed Dec 20 04:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52500000000000002,"15min":0.51300000000000001},"min":{"1min":0.34100000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.63100000000000001,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53600000000000003,"15min":0.52000000000000002},"min":{"1min":0.40400000000000003,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.76600000000000001,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.63100000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52600000000000002},"min":{"1min":0.39000000000000001,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.80900000000000005},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.55600000000000005,"15min":0.54400000000000004},"min":{"1min":0.40799999999999997,"5min":0.312,"15min":0.312},"max":{"1min":0.74199999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.52400000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.47099999999999997,"15min":0.501},"min":{"1min":0.308,"5min":0.249,"15min":0.249},"max":{"1min":0.73799999999999999,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.46999999999999997},{"interface":"front","average":{"1min":0.48599999999999999,"5min":0.47699999999999998,"15min":0.48099999999999998},"min":{"1min":0.29799999999999999,"5min":0.29499999999999998,"15min":0.29399999999999998},"max":{"1min":0.67300000000000004,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.55300000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.49299999999999999,"5min":0.47899999999999998,"15min":0.505},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.71299999999999997,"5min":0.75700000000000001,"15min":0.85299999999999998},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.53000000000000003,"15min":0.54300000000000004},"min":{"1min":0.378,"5min":0.31,"15min":0.31},"max":{"1min":0.70699999999999996,"5min":0.81200000000000006,"15min":0.83999999999999997},"last":0.56999999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:48:49 2023","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50800000000000001,"15min":0.52600000000000002},"min":{"1min":0.35299999999999998,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.68700000000000006,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57999999999999996,"15min":0.60599999999999998},"min":{"1min":0.36699999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.75700000000000001,"5min":0.80000000000000004,"15min":0.98599999999999999},"last":0.65000000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":824,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194487,"statfs":{"total":200000000,"available":199155506,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48799999999999999,"5min":0.51900000000000002,"15min":0.52100000000000002},"min":{"1min":0.30599999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.64200000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53800000000000003,"15min":0.52300000000000002},"min":{"1min":0.379,"5min":0.251,"15min":0.251},"max":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.77000000000000002},"last":0.57699999999999996}]},{"osd":1,"last update":"Wed Dec 20 04:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.53600000000000003,"15min":0.51500000000000001},"min":{"1min":0.30099999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.52700000000000002,"15min":0.52500000000000002},"min":{"1min":0.315,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72699999999999998,"5min":0.85699999999999998,"15min":0.85699999999999998},"last":0.71299999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53100000000000003,"15min":0.55300000000000005},"min":{"1min":0.36299999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.66300000000000003,"5min":0.76000000000000001,"15min":0.83899999999999997},"last":0.67400000000000004},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52800000000000002,"15min":0.54800000000000004},"min":{"1min":0.33300000000000002,"5min":0.23400000000000001,"15min":0.23400000000000001},"max":{"1min":0.746,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.69999999999999996}]},{"osd":3,"last update":"Wed Dec 20 04:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56899999999999995,"15min":0.55600000000000005},"min":{"1min":0.35299999999999998,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.73399999999999999,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.58799999999999997,"15min":0.58599999999999997},"min":{"1min":0.41099999999999998,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.72699999999999998,"5min":0.877,"15min":0.91000000000000003},"last":0.749}]},{"osd":5,"last update":"Wed Dec 20 04:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44,"15min":0.46999999999999997},"min":{"1min":0.27000000000000002,"5min":0.222,"15min":0.222},"max":{"1min":0.79100000000000004,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.50800000000000001,"5min":0.49099999999999999,"15min":0.505},"min":{"1min":0.33700000000000002,"5min":0.29699999999999999,"15min":0.29199999999999998},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76700000000000002},"last":0.68899999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48299999999999998,"15min":0.501},"min":{"1min":0.28799999999999998,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.82399999999999995},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.503,"15min":0.52800000000000002},"min":{"1min":0.35899999999999999,"5min":0.32600000000000001,"15min":0.32600000000000001},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.61499999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:48:46 2023","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.52000000000000002,"15min":0.51600000000000001},"min":{"1min":0.34200000000000003,"5min":0.316,"15min":0.316},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.65700000000000003},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53900000000000003,"15min":0.54600000000000004},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.747,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574934,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":830,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194481,"statfs":{"total":200000000,"available":199149116,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34999999999999998,"15min":0.33900000000000002},"min":{"1min":0.20599999999999999,"5min":0.193,"15min":0.193},"max":{"1min":0.49299999999999999,"5min":0.629,"15min":0.629},"last":0.224},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.373,"15min":0.35499999999999998},"min":{"1min":0.25800000000000001,"5min":0.254,"15min":0.246},"max":{"1min":0.52000000000000002,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.26500000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.30099999999999999,"5min":0.33000000000000002,"15min":0.32000000000000001},"min":{"1min":0.19600000000000001,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.505,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.23599999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.36399999999999999,"15min":0.33800000000000002},"min":{"1min":0.26900000000000002,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.44700000000000001,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.253}]},{"osd":2,"last update":"Wed Dec 20 04:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.33100000000000002,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.22600000000000001,"5min":0.21199999999999999,"15min":0.21199999999999999},"max":{"1min":0.46700000000000003,"5min":0.53800000000000003,"15min":0.64900000000000002},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.372,"5min":0.39400000000000002,"15min":0.376},"min":{"1min":0.27200000000000002,"5min":0.25,"15min":0.25},"max":{"1min":0.53500000000000003,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.28799999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.56299999999999994,"15min":0.54500000000000004},"min":{"1min":0.44500000000000001,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.436},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.57799999999999996,"15min":0.56100000000000005},"min":{"1min":0.40000000000000002,"5min":0.313,"15min":0.313},"max":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"last":0.40200000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58299999999999996,"15min":0.56299999999999994},"min":{"1min":0.40000000000000002,"5min":0.31,"15min":0.31},"max":{"1min":0.82099999999999995,"5min":0.872,"15min":0.872},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.57799999999999996,"15min":0.55900000000000005},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.91500000000000004,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.41899999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.57499999999999996,"15min":0.57999999999999996},"min":{"1min":0.40799999999999997,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.88200000000000001,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.42399999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.58699999999999997,"15min":0.56200000000000006},"min":{"1min":0.41299999999999998,"5min":0.37,"15min":0.37},"max":{"1min":0.754,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.47999999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:48:51 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.56799999999999995},"min":{"1min":0.47799999999999998,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.84999999999999998,"5min":0.879,"15min":0.879},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.59499999999999997,"15min":0.57999999999999996},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.96099999999999997,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.44500000000000001}]}]},{"osd":2,"up_from":13,"seq":55834574934,"num_pgs":29,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":831,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194481,"statfs":{"total":200000000,"available":199148660,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.31,"5min":0.33800000000000002,"15min":0.30199999999999999},"min":{"1min":0.22900000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.42399999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.215},{"interface":"front","average":{"1min":0.35099999999999998,"5min":0.39900000000000002,"15min":0.34699999999999998},"min":{"1min":0.27500000000000002,"5min":0.23200000000000001,"15min":0.17699999999999999},"max":{"1min":0.50600000000000001,"5min":2.0539999999999998,"15min":2.0539999999999998},"last":0.32900000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.33600000000000002,"5min":0.35899999999999999,"15min":0.33200000000000002},"min":{"1min":0.25700000000000001,"5min":0.23300000000000001,"15min":0.17999999999999999},"max":{"1min":0.46200000000000002,"5min":0.83099999999999996,"15min":0.83099999999999996},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.378,"15min":0.35199999999999998},"min":{"1min":0.23100000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.52600000000000002,"5min":0.58999999999999997,"15min":0.58999999999999997},"last":0.29299999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.40400000000000003,"15min":0.36199999999999999},"min":{"1min":0.29199999999999998,"5min":0.247,"15min":0.216},"max":{"1min":0.49399999999999999,"5min":0.995,"15min":0.995},"last":0.373},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.39800000000000002,"15min":0.372},"min":{"1min":0.28999999999999998,"5min":0.26600000000000001,"15min":0.26600000000000001},"max":{"1min":0.47199999999999998,"5min":0.76600000000000001,"15min":0.76600000000000001},"last":0.36699999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57099999999999995,"15min":0.57099999999999995},"min":{"1min":0.378,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.88100000000000001,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.59999999999999998,"15min":0.57199999999999995},"min":{"1min":0.39800000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.78800000000000003,"5min":2.347,"15min":2.347},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Dec 20 04:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57999999999999996,"15min":0.57999999999999996},"min":{"1min":0.45900000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.84299999999999997,"5min":0.997,"15min":0.997},"last":0.74299999999999999},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.56899999999999995,"15min":0.55300000000000005},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.60699999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.58999999999999997,"15min":0.57399999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.72199999999999998,"5min":2.274,"15min":2.274},"last":0.71499999999999997},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.58999999999999997,"15min":0.57599999999999996},"min":{"1min":0.439,"5min":0.38,"15min":0.373},"max":{"1min":0.89300000000000002,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":0.58599999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:48:48 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.59499999999999997,"15min":0.56999999999999995},"min":{"1min":0.41099999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.78600000000000003,"5min":2.3090000000000002,"15min":2.3090000000000002},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.59499999999999997,"15min":0.58099999999999996},"min":{"1min":0.40500000000000003,"5min":0.379,"15min":0.379},"max":{"1min":0.81699999999999995,"5min":1.0549999999999999,"15min":1.0549999999999999},"last":0.66200000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574935,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":824,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194487,"statfs":{"total":200000000,"available":199155576,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:48:44 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.32300000000000001,"15min":0.29299999999999998},"min":{"1min":0.20899999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.49299999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.34000000000000002,"5min":0.35699999999999998,"15min":0.33200000000000002},"min":{"1min":0.25,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.52200000000000002,"5min":0.55800000000000005,"15min":0.55800000000000005},"last":0.32500000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:48:44 2023","interfaces":[{"interface":"back","average":{"1min":0.32900000000000001,"5min":0.33800000000000002,"15min":0.309},"min":{"1min":0.23000000000000001,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.50800000000000001,"5min":0.57099999999999995,"15min":0.57099999999999995},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.35799999999999998,"5min":0.38100000000000001,"15min":0.35199999999999998},"min":{"1min":0.23499999999999999,"5min":0.22600000000000001,"15min":0.224},"max":{"1min":0.54100000000000004,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.30099999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:48:44 2023","interfaces":[{"interface":"back","average":{"1min":0.377,"5min":0.39400000000000002,"15min":0.35999999999999999},"min":{"1min":0.26500000000000001,"5min":0.21299999999999999,"15min":0.191},"max":{"1min":0.51200000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.33300000000000002,"5min":0.36099999999999999,"15min":0.35199999999999998},"min":{"1min":0.22500000000000001,"5min":0.22500000000000001,"15min":0.20399999999999999},"max":{"1min":0.56399999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.36899999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:48:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.55200000000000005,"15min":0.56200000000000006},"min":{"1min":0.36899999999999999,"5min":0.312,"15min":0.312},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.57099999999999995,"15min":0.55000000000000004},"min":{"1min":0.38900000000000001,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.69299999999999995,"5min":1.002,"15min":1.002},"last":0.59599999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:48:44 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.56399999999999995,"15min":0.55600000000000005},"min":{"1min":0.40899999999999997,"5min":0.318,"15min":0.318},"max":{"1min":0.72199999999999998,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.56999999999999995,"15min":0.54500000000000004},"min":{"1min":0.38300000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.77200000000000002,"5min":0.85599999999999998,"15min":0.85599999999999998},"last":0.50800000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:48:44 2023","interfaces":[{"interface":"back","average":{"1min":0.56899999999999995,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.39500000000000002,"5min":0.379,"15min":0.36899999999999999},"max":{"1min":0.75700000000000001,"5min":1.038,"15min":1.038},"last":0.496},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.57899999999999996,"15min":0.56499999999999995},"min":{"1min":0.42199999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.81000000000000005,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.53300000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:48:44 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.59599999999999997,"15min":0.59299999999999997},"min":{"1min":0.40799999999999997,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":0.79200000000000004,"5min":0.88900000000000001,"15min":0.88900000000000001},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.58899999999999997,"15min":0.60599999999999998},"min":{"1min":0.41899999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.84899999999999998,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.56299999999999994}]}]},{"osd":0,"up_from":13,"seq":55834574934,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1407,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193905,"statfs":{"total":200000000,"available":198558908,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.30199999999999999,"5min":0.32100000000000001,"15min":0.309},"min":{"1min":0.189,"5min":0.189,"15min":0.184},"max":{"1min":0.46100000000000002,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.39200000000000002},{"interface":"front","average":{"1min":0.30399999999999999,"5min":0.34000000000000002,"15min":0.314},"min":{"1min":0.25,"5min":0.217,"15min":0.184},"max":{"1min":0.42099999999999999,"5min":0.56999999999999995,"15min":0.56999999999999995},"last":0.27100000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32100000000000001,"5min":0.35899999999999999,"15min":0.35499999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.218},"max":{"1min":0.40999999999999998,"5min":0.55300000000000005,"15min":0.55300000000000005},"last":0.375},{"interface":"front","average":{"1min":0.34200000000000003,"5min":0.35899999999999999,"15min":0.34799999999999998},"min":{"1min":0.29899999999999999,"5min":0.23400000000000001,"15min":0.23100000000000001},"max":{"1min":0.505,"5min":0.622,"15min":0.622},"last":0.30599999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.35099999999999998,"15min":0.32600000000000001},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":0.42999999999999999,"5min":0.59499999999999997,"15min":0.59499999999999997},"last":0.32000000000000001},{"interface":"front","average":{"1min":0.35299999999999998,"5min":0.38600000000000001,"15min":0.36799999999999999},"min":{"1min":0.29999999999999999,"5min":0.29199999999999998,"15min":0.27400000000000002},"max":{"1min":0.497,"5min":0.53800000000000003,"15min":0.53800000000000003},"last":0.35199999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52800000000000002,"5min":0.55600000000000005,"15min":0.52400000000000002},"min":{"1min":0.41999999999999998,"5min":0.36899999999999999,"15min":0.35199999999999998},"max":{"1min":0.64700000000000002,"5min":0.78300000000000003,"15min":0.78300000000000003},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.56000000000000005,"15min":0.53800000000000003},"min":{"1min":0.36799999999999999,"5min":0.33900000000000002,"15min":0.33700000000000002},"max":{"1min":0.70999999999999996,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.436}]},{"osd":5,"last update":"Wed Dec 20 04:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.55600000000000005,"15min":0.52300000000000002},"min":{"1min":0.42599999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.65100000000000002,"5min":0.78700000000000003,"15min":0.81200000000000006},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.55900000000000005,"5min":0.57599999999999996,"15min":0.54800000000000004},"min":{"1min":0.42899999999999999,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.73699999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.50700000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.59499999999999997,"15min":0.58199999999999996},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.80900000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.59899999999999998,"15min":0.58399999999999996},"min":{"1min":0.45500000000000002,"5min":0.374,"15min":0.374},"max":{"1min":0.68100000000000005,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.503}]},{"osd":7,"last update":"Wed Dec 20 04:48:45 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.55200000000000005},"min":{"1min":0.438,"5min":0.375,"15min":0.375},"max":{"1min":0.69999999999999996,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.46200000000000002},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58099999999999996,"15min":0.57399999999999995},"min":{"1min":0.46300000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.77000000000000002,"5min":0.84499999999999997,"15min":0.84499999999999997},"last":0.52800000000000002}]}]}],"pool_statfs":[]}} 2023-12-20T04:49:36.492 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-20T04:49:36.492 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-20T04:49:36.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.633+0000 7f3d3cedb640 1 Processor -- start 2023-12-20T04:49:36.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.633+0000 7f3d3cedb640 1 -- start start 2023-12-20T04:49:36.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.634+0000 7f3d3cedb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3d380cf880 0x7f3d380cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:36.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.634+0000 7f3d3cedb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3d380b60e0 0x7f3d380b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:36.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.634+0000 7f3d3cedb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3d380d1a90 con 0x7f3d3815d300 2023-12-20T04:49:36.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.634+0000 7f3d3cedb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d380d0250 con 0x7f3d380b60e0 2023-12-20T04:49:36.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.634+0000 7f3d3cedb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3d380d1d70 con 0x7f3d380cf880 2023-12-20T04:49:36.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.634+0000 7f3d36d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3d380b60e0 0x7f3d380b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:36.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.634+0000 7f3d36d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3d380b60e0 0x7f3d380b64f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45408/0 (socket says 172.21.15.132:45408) 2023-12-20T04:49:36.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.634+0000 7f3d36d9d640 1 -- 172.21.15.132:0/1504241145 learned_addr learned my addr 172.21.15.132:0/1504241145 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:36.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.634+0000 7f3d36d9d640 1 -- 172.21.15.132:0/1504241145 >> v2:172.21.15.187:3300/0 conn(0x7f3d380cf880 msgr2=0x7f3d380cfd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:36.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.634+0000 7f3d36d9d640 1 --2- 172.21.15.132:0/1504241145 >> v2:172.21.15.187:3300/0 conn(0x7f3d380cf880 0x7f3d380cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.634+0000 7f3d36d9d640 1 -- 172.21.15.132:0/1504241145 >> v1:172.21.15.187:6789/0 conn(0x7f3d3815d300 legacy=0x7f3d380d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:36.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.634+0000 7f3d36d9d640 1 -- 172.21.15.132:0/1504241145 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d380d2050 con 0x7f3d380b60e0 2023-12-20T04:49:36.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.635+0000 7f3d36d9d640 1 --2- 172.21.15.132:0/1504241145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d380b60e0 0x7f3d380b64f0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f3d380d0560 tx=0x7f3d3002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=656ab08ae92f97ce server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:36.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.635+0000 7f3d35d9b640 1 -- 172.21.15.132:0/1504241145 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d3002ca80 con 0x7f3d380b60e0 2023-12-20T04:49:36.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.635+0000 7f3d35d9b640 1 -- 172.21.15.132:0/1504241145 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d3002cbe0 con 0x7f3d380b60e0 2023-12-20T04:49:36.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.635+0000 7f3d35d9b640 1 -- 172.21.15.132:0/1504241145 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d300343f0 con 0x7f3d380b60e0 2023-12-20T04:49:36.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.636+0000 7f3d3cedb640 1 -- 172.21.15.132:0/1504241145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d380b60e0 msgr2=0x7f3d380b64f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:36.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.636+0000 7f3d3cedb640 1 --2- 172.21.15.132:0/1504241145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d380b60e0 0x7f3d380b64f0 secure :-1 s=READY pgs=1532 cs=0 l=1 rev1=1 crypto rx=0x7f3d380d0560 tx=0x7f3d3002bee0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.636+0000 7f3d3cedb640 1 -- 172.21.15.132:0/1504241145 shutdown_connections 2023-12-20T04:49:36.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.636+0000 7f3d3cedb640 1 --2- 172.21.15.132:0/1504241145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d380b60e0 0x7f3d380b64f0 unknown :-1 s=CLOSED pgs=1532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.636+0000 7f3d3cedb640 1 --2- 172.21.15.132:0/1504241145 >> v2:172.21.15.187:3300/0 conn(0x7f3d380cf880 0x7f3d380cfd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.636+0000 7f3d3cedb640 1 -- 172.21.15.132:0/1504241145 >> 172.21.15.132:0/1504241145 conn(0x7f3d3806a3d0 msgr2=0x7f3d3806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:36.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.636+0000 7f3d3cedb640 1 -- 172.21.15.132:0/1504241145 shutdown_connections 2023-12-20T04:49:36.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.636+0000 7f3d3cedb640 1 -- 172.21.15.132:0/1504241145 wait complete. 2023-12-20T04:49:36.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.637+0000 7f3d3cedb640 1 Processor -- start 2023-12-20T04:49:36.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.637+0000 7f3d3cedb640 1 -- start start 2023-12-20T04:49:36.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d3cedb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d380b60e0 0x7f3d380cc730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:36.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d3cedb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d380cf880 0x7f3d381f20e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:36.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d3cedb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d3815d300 0x7f3d380c86a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:36.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d3cedb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d380b3610 con 0x7f3d380b60e0 2023-12-20T04:49:36.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d3cedb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3d380cb9d0 con 0x7f3d3815d300 2023-12-20T04:49:36.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d3cedb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3d380cae50 con 0x7f3d380cf880 2023-12-20T04:49:36.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d3659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d380b60e0 0x7f3d380cc730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:36.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d3659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d380b60e0 0x7f3d380cc730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45410/0 (socket says 172.21.15.132:45410) 2023-12-20T04:49:36.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d3659c640 1 -- 172.21.15.132:0/1060851790 learned_addr learned my addr 172.21.15.132:0/1060851790 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:36.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d3659c640 1 -- 172.21.15.132:0/1060851790 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d380cf880 msgr2=0x7f3d381f20e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:36.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d2ffff640 1 --2- 172.21.15.132:0/1060851790 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d380cf880 0x7f3d381f20e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:36.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d36d9d640 1 --2- 172.21.15.132:0/1060851790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d3815d300 0x7f3d380c86a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:36.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d3659c640 1 --2- 172.21.15.132:0/1060851790 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d380cf880 0x7f3d381f20e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d3659c640 1 -- 172.21.15.132:0/1060851790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d3815d300 msgr2=0x7f3d380c86a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:36.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d3659c640 1 --2- 172.21.15.132:0/1060851790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d3815d300 0x7f3d380c86a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d3659c640 1 -- 172.21.15.132:0/1060851790 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3d30009b30 con 0x7f3d380b60e0 2023-12-20T04:49:36.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d2ffff640 1 --2- 172.21.15.132:0/1060851790 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d380cf880 0x7f3d381f20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:36.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d36d9d640 1 --2- 172.21.15.132:0/1060851790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d3815d300 0x7f3d380c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:36.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d3659c640 1 --2- 172.21.15.132:0/1060851790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d380b60e0 0x7f3d380cc730 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800b3e0 tx=0x7f3d2800b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:36.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d2effd640 1 -- 172.21.15.132:0/1060851790 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28011830 con 0x7f3d380b60e0 2023-12-20T04:49:36.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d2effd640 1 -- 172.21.15.132:0/1060851790 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3d280119b0 con 0x7f3d380b60e0 2023-12-20T04:49:36.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d2effd640 1 -- 172.21.15.132:0/1060851790 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3d28011d60 con 0x7f3d380b60e0 2023-12-20T04:49:36.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d3cedb640 1 -- 172.21.15.132:0/1060851790 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3d380cb130 con 0x7f3d380b60e0 2023-12-20T04:49:36.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.638+0000 7f3d3cedb640 1 -- 172.21.15.132:0/1060851790 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3d380cb6f0 con 0x7f3d380b60e0 2023-12-20T04:49:36.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.639+0000 7f3d3cedb640 1 -- 172.21.15.132:0/1060851790 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3d380b3780 con 0x7f3d380b60e0 2023-12-20T04:49:36.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.640+0000 7f3d2effd640 1 -- 172.21.15.132:0/1060851790 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3d2801a400 con 0x7f3d380b60e0 2023-12-20T04:49:36.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.640+0000 7f3d2effd640 1 --2- 172.21.15.132:0/1060851790 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3d1806a430 0x7f3d1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:36.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.640+0000 7f3d2effd640 1 -- 172.21.15.132:0/1060851790 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3d28088a60 con 0x7f3d380b60e0 2023-12-20T04:49:36.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.640+0000 7f3d2ffff640 1 --2- 172.21.15.132:0/1060851790 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3d1806a430 0x7f3d1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:36.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.641+0000 7f3d2ffff640 1 --2- 172.21.15.132:0/1060851790 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3d1806a430 0x7f3d1806c8f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3d380b7ef0 tx=0x7f3d20008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:36.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.644+0000 7f3d2effd640 1 -- 172.21.15.132:0/1060851790 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3d280540e0 con 0x7f3d380b60e0 2023-12-20T04:49:36.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.877+0000 7f3d3cedb640 1 -- 172.21.15.132:0/1060851790 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f3d3804e840 con 0x7f3d380b60e0 2023-12-20T04:49:36.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.881+0000 7f3d2effd640 1 -- 172.21.15.132:0/1060851790 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v20) v1 ==== 190+0+0 (secure 0 0 0) 0x7f3d28015020 con 0x7f3d380b60e0 2023-12-20T04:49:36.883 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.0 2023-12-20T04:49:36.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.883+0000 7f3d3cedb640 1 -- 172.21.15.132:0/1060851790 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3d1806a430 msgr2=0x7f3d1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:36.885 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.883+0000 7f3d3cedb640 1 --2- 172.21.15.132:0/1060851790 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3d1806a430 0x7f3d1806c8f0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f3d380b7ef0 tx=0x7f3d20008040 comp rx=0 tx=0).stop 2023-12-20T04:49:36.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.883+0000 7f3d3cedb640 1 -- 172.21.15.132:0/1060851790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d380b60e0 msgr2=0x7f3d380cc730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:36.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.883+0000 7f3d3cedb640 1 --2- 172.21.15.132:0/1060851790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d380b60e0 0x7f3d380cc730 secure :-1 s=READY pgs=1533 cs=0 l=1 rev1=1 crypto rx=0x7f3d2800b3e0 tx=0x7f3d2800b8a0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.883+0000 7f3d3cedb640 1 -- 172.21.15.132:0/1060851790 shutdown_connections 2023-12-20T04:49:36.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.883+0000 7f3d3cedb640 1 --2- 172.21.15.132:0/1060851790 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3d1806a430 0x7f3d1806c8f0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.883+0000 7f3d3cedb640 1 --2- 172.21.15.132:0/1060851790 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3d3815d300 0x7f3d380c86a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.883+0000 7f3d3cedb640 1 --2- 172.21.15.132:0/1060851790 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3d380cf880 0x7f3d381f20e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.883+0000 7f3d3cedb640 1 --2- 172.21.15.132:0/1060851790 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3d380b60e0 0x7f3d380cc730 unknown :-1 s=CLOSED pgs=1533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.883+0000 7f3d3cedb640 1 -- 172.21.15.132:0/1060851790 >> 172.21.15.132:0/1060851790 conn(0x7f3d3806a3d0 msgr2=0x7f3d38159fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:36.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.883+0000 7f3d3cedb640 1 -- 172.21.15.132:0/1060851790 shutdown_connections 2023-12-20T04:49:36.886 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.883+0000 7f3d3cedb640 1 -- 172.21.15.132:0/1060851790 wait complete. 2023-12-20T04:49:36.896 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:49:36.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.992+0000 7fddf1843640 1 Processor -- start 2023-12-20T04:49:36.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.992+0000 7fddf1843640 1 -- start start 2023-12-20T04:49:36.994 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.993+0000 7fddf1843640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec0b4980 0x7fddec0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:36.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.993+0000 7fddf1843640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fddec0d1aa0 0x7fddec0d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:36.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.993+0000 7fddf1843640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fddec0b5320 con 0x7fddec160450 2023-12-20T04:49:36.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.993+0000 7fddf1843640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fddec0b5ec0 con 0x7fddec0d1aa0 2023-12-20T04:49:36.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.993+0000 7fddf1843640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec1617e0 con 0x7fddec0b4980 2023-12-20T04:49:36.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.993+0000 7fddea7fc640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec0b4980 0x7fddec0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:36.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.993+0000 7fddeb7fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fddec0d1aa0 0x7fddec0d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:36.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.993+0000 7fddeaffd640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fddec160450 0x7fddec160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:40242/0 (socket says 172.21.15.132:40242) 2023-12-20T04:49:36.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.993+0000 7fddea7fc640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec0b4980 0x7fddec0b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:35042/0 (socket says 172.21.15.132:35042) 2023-12-20T04:49:36.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.993+0000 7fddeaffd640 1 -- 172.21.15.132:0/1686042039 learned_addr learned my addr 172.21.15.132:0/1686042039 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:36.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.994+0000 7fddea7fc640 1 -- 172.21.15.132:0/1686042039 >> v2:172.21.15.187:3300/0 conn(0x7fddec0d1aa0 msgr2=0x7fddec0d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:36.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.994+0000 7fddea7fc640 1 --2- 172.21.15.132:0/1686042039 >> v2:172.21.15.187:3300/0 conn(0x7fddec0d1aa0 0x7fddec0d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.994+0000 7fddea7fc640 1 -- 172.21.15.132:0/1686042039 >> v1:172.21.15.187:6789/0 conn(0x7fddec160450 legacy=0x7fddec160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:36.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.994+0000 7fddea7fc640 1 -- 172.21.15.132:0/1686042039 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fddec0d0fc0 con 0x7fddec0b4980 2023-12-20T04:49:36.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.994+0000 7fddeb7fe640 1 --2- 172.21.15.132:0/1686042039 >> v2:172.21.15.187:3300/0 conn(0x7fddec0d1aa0 0x7fddec0d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:49:36.997 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.994+0000 7fddea7fc640 1 --2- 172.21.15.132:0/1686042039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec0b4980 0x7fddec0b4de0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdde00097a0 tx=0x7fdde002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e375616750c99839 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.994+0000 7fdde9ffb640 1 -- 172.21.15.132:0/1686042039 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0030610 con 0x7fddec0b4980 2023-12-20T04:49:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.995+0000 7fdde9ffb640 1 -- 172.21.15.132:0/1686042039 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde0030770 con 0x7fddec0b4980 2023-12-20T04:49:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.995+0000 7fdde9ffb640 1 -- 172.21.15.132:0/1686042039 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0030b00 con 0x7fddec0b4980 2023-12-20T04:49:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.995+0000 7fddf1843640 1 -- 172.21.15.132:0/1686042039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec0b4980 msgr2=0x7fddec0b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.995+0000 7fddf1843640 1 --2- 172.21.15.132:0/1686042039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec0b4980 0x7fddec0b4de0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fdde00097a0 tx=0x7fdde002b960 comp rx=0 tx=0).stop 2023-12-20T04:49:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.995+0000 7fddf1843640 1 -- 172.21.15.132:0/1686042039 shutdown_connections 2023-12-20T04:49:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.995+0000 7fddf1843640 1 --2- 172.21.15.132:0/1686042039 >> v2:172.21.15.187:3300/0 conn(0x7fddec0d1aa0 0x7fddec0d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.995+0000 7fddf1843640 1 --2- 172.21.15.132:0/1686042039 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec0b4980 0x7fddec0b4de0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.995+0000 7fddf1843640 1 -- 172.21.15.132:0/1686042039 >> 172.21.15.132:0/1686042039 conn(0x7fddec0cf980 msgr2=0x7fddec0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.995+0000 7fddf1843640 1 -- 172.21.15.132:0/1686042039 shutdown_connections 2023-12-20T04:49:36.998 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.995+0000 7fddf1843640 1 -- 172.21.15.132:0/1686042039 wait complete. 2023-12-20T04:49:37.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.996+0000 7fddf1843640 1 Processor -- start 2023-12-20T04:49:37.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.996+0000 7fddf1843640 1 -- start start 2023-12-20T04:49:37.000 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.997+0000 7fddf1843640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddec0b4980 0x7fddec0c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.997+0000 7fddf1843640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddec0d1aa0 0x7fddec159560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.997+0000 7fddf1843640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec160450 0x7fddec0d29f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.997+0000 7fddf1843640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0cbcd0 con 0x7fddec0d1aa0 2023-12-20T04:49:37.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.997+0000 7fddf1843640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0c96c0 con 0x7fddec0b4980 2023-12-20T04:49:37.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.997+0000 7fddf1843640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fddec0cb0c0 con 0x7fddec160450 2023-12-20T04:49:37.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.997+0000 7fddea7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddec0d1aa0 0x7fddec159560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.997+0000 7fddea7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddec0d1aa0 0x7fddec159560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:45414/0 (socket says 172.21.15.132:45414) 2023-12-20T04:49:37.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.997+0000 7fddea7fc640 1 -- 172.21.15.132:0/2770461340 learned_addr learned my addr 172.21.15.132:0/2770461340 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:37.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.997+0000 7fddeaffd640 1 --2- 172.21.15.132:0/2770461340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddec0b4980 0x7fddec0c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.998+0000 7fddeb7fe640 1 --2- 172.21.15.132:0/2770461340 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec160450 0x7fddec0d29f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.998+0000 7fddea7fc640 1 -- 172.21.15.132:0/2770461340 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec160450 msgr2=0x7fddec0d29f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:37.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.998+0000 7fddea7fc640 1 --2- 172.21.15.132:0/2770461340 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec160450 0x7fddec0d29f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.998+0000 7fddea7fc640 1 -- 172.21.15.132:0/2770461340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddec0b4980 msgr2=0x7fddec0c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:37.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.998+0000 7fddea7fc640 1 --2- 172.21.15.132:0/2770461340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddec0b4980 0x7fddec0c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.998+0000 7fddea7fc640 1 -- 172.21.15.132:0/2770461340 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdde4009400 con 0x7fddec0d1aa0 2023-12-20T04:49:37.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.998+0000 7fddeaffd640 1 --2- 172.21.15.132:0/2770461340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddec0b4980 0x7fddec0c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:37.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.998+0000 7fddeb7fe640 1 --2- 172.21.15.132:0/2770461340 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec160450 0x7fddec0d29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:37.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.998+0000 7fddea7fc640 1 --2- 172.21.15.132:0/2770461340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddec0d1aa0 0x7fddec159560 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fdde0009890 tx=0x7fdde00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:37.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.998+0000 7fddd3fff640 1 -- 172.21.15.132:0/2770461340 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde003e070 con 0x7fddec0d1aa0 2023-12-20T04:49:37.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.998+0000 7fddd3fff640 1 -- 172.21.15.132:0/2770461340 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdde0030e10 con 0x7fddec0d1aa0 2023-12-20T04:49:37.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.998+0000 7fddf1843640 1 -- 172.21.15.132:0/2770461340 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdde0009400 con 0x7fddec0d1aa0 2023-12-20T04:49:37.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.998+0000 7fddd3fff640 1 -- 172.21.15.132:0/2770461340 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdde0039c60 con 0x7fddec0d1aa0 2023-12-20T04:49:37.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.998+0000 7fddf1843640 1 -- 172.21.15.132:0/2770461340 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fddec0cb680 con 0x7fddec0d1aa0 2023-12-20T04:49:37.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.999+0000 7fddf1843640 1 -- 172.21.15.132:0/2770461340 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fddec04e840 con 0x7fddec0d1aa0 2023-12-20T04:49:37.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:36.999+0000 7fddd3fff640 1 -- 172.21.15.132:0/2770461340 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdde00423f0 con 0x7fddec0d1aa0 2023-12-20T04:49:37.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.000+0000 7fddd3fff640 1 --2- 172.21.15.132:0/2770461340 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fddd806a460 0x7fddd806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.000+0000 7fddd3fff640 1 -- 172.21.15.132:0/2770461340 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdde00aa2b0 con 0x7fddec0d1aa0 2023-12-20T04:49:37.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.000+0000 7fddeaffd640 1 --2- 172.21.15.132:0/2770461340 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fddd806a460 0x7fddd806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.000+0000 7fddeaffd640 1 --2- 172.21.15.132:0/2770461340 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fddd806a460 0x7fddd806c920 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fdddc005c00 tx=0x7fdddc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:37.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.004+0000 7fddd3fff640 1 -- 172.21.15.132:0/2770461340 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdde0075820 con 0x7fddec0d1aa0 2023-12-20T04:49:37.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.204+0000 7fddf1843640 1 -- 172.21.15.132:0/2770461340 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fddec0d0ad0 con 0x7fddec0d1aa0 2023-12-20T04:49:37.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.205+0000 7fddd3fff640 1 -- 172.21.15.132:0/2770461340 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fdde0078e40 con 0x7fddec0d1aa0 2023-12-20T04:49:37.210 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:37.211 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":57,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/756703470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":756703470},{"type":"v1","addr":"172.21.15.187:6834","nonce":756703470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2177183802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2177183802},{"type":"v1","addr":"172.21.15.187:6835","nonce":2177183802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":8337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/390345313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":390345313},{"type":"v1","addr":"172.21.15.132:6837","nonce":390345313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:49:33.211903+0000","modified":"2023-12-20T04:49:35.219491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8340":{"gid":8340,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/3157504695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3157504695},{"type":"v1","addr":"172.21.15.132:6836","nonce":3157504695}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-20T04:49:37.212 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 57 2023-12-20T04:49:37.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.207+0000 7fddf1843640 1 -- 172.21.15.132:0/2770461340 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fddd806a460 msgr2=0x7fddd806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:37.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.207+0000 7fddf1843640 1 --2- 172.21.15.132:0/2770461340 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fddd806a460 0x7fddd806c920 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fdddc005c00 tx=0x7fdddc009040 comp rx=0 tx=0).stop 2023-12-20T04:49:37.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.207+0000 7fddf1843640 1 -- 172.21.15.132:0/2770461340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddec0d1aa0 msgr2=0x7fddec159560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:37.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.207+0000 7fddf1843640 1 --2- 172.21.15.132:0/2770461340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddec0d1aa0 0x7fddec159560 secure :-1 s=READY pgs=1534 cs=0 l=1 rev1=1 crypto rx=0x7fdde0009890 tx=0x7fdde00046c0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.207+0000 7fddf1843640 1 -- 172.21.15.132:0/2770461340 shutdown_connections 2023-12-20T04:49:37.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.207+0000 7fddf1843640 1 --2- 172.21.15.132:0/2770461340 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fddd806a460 0x7fddd806c920 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.207+0000 7fddf1843640 1 --2- 172.21.15.132:0/2770461340 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fddec160450 0x7fddec0d29f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.207+0000 7fddf1843640 1 --2- 172.21.15.132:0/2770461340 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fddec0d1aa0 0x7fddec159560 unknown :-1 s=CLOSED pgs=1534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.207+0000 7fddf1843640 1 --2- 172.21.15.132:0/2770461340 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fddec0b4980 0x7fddec0c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.207+0000 7fddf1843640 1 -- 172.21.15.132:0/2770461340 >> 172.21.15.132:0/2770461340 conn(0x7fddec0cf980 msgr2=0x7fddec1553c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:37.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.207+0000 7fddf1843640 1 -- 172.21.15.132:0/2770461340 shutdown_connections 2023-12-20T04:49:37.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.207+0000 7fddf1843640 1 -- 172.21.15.132:0/2770461340 wait complete. 2023-12-20T04:49:37.622 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 57, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-20T04:49:33.211903+0000', 'modified': '2023-12-20T04:49:35.219491+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8340}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8340': {'gid': 8340, 'name': 'a', 'rank': 0, 'incarnation': 55, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6836/3157504695', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6834', 'nonce': 3157504695}, {'type': 'v1', 'addr': '172.21.15.132:6836', 'nonce': 3157504695}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [19], 'metadata_pool': 18, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-20T04:49:37.624 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-20T04:49:37.624 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-20T04:49:37.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.725+0000 7f577f7ea640 1 Processor -- start 2023-12-20T04:49:37.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.725+0000 7f577f7ea640 1 -- start start 2023-12-20T04:49:37.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.726+0000 7f577f7ea640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f57780b4f90 0x7f57780b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.726+0000 7f577f7ea640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f57780b1d10 0x7f57780d0f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.726+0000 7f577f7ea640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f57780cd660 con 0x7f577815d110 2023-12-20T04:49:37.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.726+0000 7f577f7ea640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f57780cd940 con 0x7f57780b1d10 2023-12-20T04:49:37.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.726+0000 7f577f7ea640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5778160e60 con 0x7f57780b4f90 2023-12-20T04:49:37.728 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.726+0000 7f577dd87640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f57780b1d10 0x7f57780d0f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.726+0000 7f577dd87640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f57780b1d10 0x7f57780d0f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42228/0 (socket says 172.21.15.132:42228) 2023-12-20T04:49:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.726+0000 7f577dd87640 1 -- 172.21.15.132:0/1707054092 learned_addr learned my addr 172.21.15.132:0/1707054092 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.726+0000 7f577cd85640 1 --2- 172.21.15.132:0/1707054092 >> v2:172.21.15.187:3300/0 conn(0x7f57780b4f90 0x7f57780b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.726+0000 7f577dd87640 1 -- 172.21.15.132:0/1707054092 >> v2:172.21.15.187:3300/0 conn(0x7f57780b4f90 msgr2=0x7f57780b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.726+0000 7f577dd87640 1 --2- 172.21.15.132:0/1707054092 >> v2:172.21.15.187:3300/0 conn(0x7f57780b4f90 0x7f57780b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.726+0000 7f577dd87640 1 -- 172.21.15.132:0/1707054092 >> v1:172.21.15.187:6789/0 conn(0x7f577815d110 legacy=0x7f57780b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:37.729 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.726+0000 7f577dd87640 1 -- 172.21.15.132:0/1707054092 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5778161140 con 0x7f57780b1d10 2023-12-20T04:49:37.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.727+0000 7f577dd87640 1 --2- 172.21.15.132:0/1707054092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57780b1d10 0x7f57780d0f60 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f5778073c00 tx=0x7f577002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e638857678a5f60a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:37.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.727+0000 7f576ffff640 1 -- 172.21.15.132:0/1707054092 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577002ca80 con 0x7f57780b1d10 2023-12-20T04:49:37.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.727+0000 7f576ffff640 1 -- 172.21.15.132:0/1707054092 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f577002cbe0 con 0x7f57780b1d10 2023-12-20T04:49:37.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.727+0000 7f576ffff640 1 -- 172.21.15.132:0/1707054092 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57700343f0 con 0x7f57780b1d10 2023-12-20T04:49:37.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.728+0000 7f577f7ea640 1 -- 172.21.15.132:0/1707054092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57780b1d10 msgr2=0x7f57780d0f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:37.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.728+0000 7f577f7ea640 1 --2- 172.21.15.132:0/1707054092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57780b1d10 0x7f57780d0f60 secure :-1 s=READY pgs=1535 cs=0 l=1 rev1=1 crypto rx=0x7f5778073c00 tx=0x7f577002bee0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.728+0000 7f577f7ea640 1 -- 172.21.15.132:0/1707054092 shutdown_connections 2023-12-20T04:49:37.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.728+0000 7f577f7ea640 1 --2- 172.21.15.132:0/1707054092 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57780b1d10 0x7f57780d0f60 unknown :-1 s=CLOSED pgs=1535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.728+0000 7f577f7ea640 1 --2- 172.21.15.132:0/1707054092 >> v2:172.21.15.187:3300/0 conn(0x7f57780b4f90 0x7f57780b21f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.728+0000 7f577f7ea640 1 -- 172.21.15.132:0/1707054092 >> 172.21.15.132:0/1707054092 conn(0x7f57780cf880 msgr2=0x7f57780cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:37.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.728+0000 7f577f7ea640 1 -- 172.21.15.132:0/1707054092 shutdown_connections 2023-12-20T04:49:37.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.728+0000 7f577f7ea640 1 -- 172.21.15.132:0/1707054092 wait complete. 2023-12-20T04:49:37.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.729+0000 7f577f7ea640 1 Processor -- start 2023-12-20T04:49:37.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.729+0000 7f577f7ea640 1 -- start start 2023-12-20T04:49:37.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.729+0000 7f577f7ea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57780b1d10 0x7f577815fc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.729+0000 7f577f7ea640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57780b4f90 0x7f57780cc6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.729+0000 7f577f7ea640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f577815d110 0x7f5778157590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.729+0000 7f577f7ea640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57780cc260 con 0x7f57780b1d10 2023-12-20T04:49:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.729+0000 7f577f7ea640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57780cb650 con 0x7f577815d110 2023-12-20T04:49:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.729+0000 7f577f7ea640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f57780cb930 con 0x7f57780b4f90 2023-12-20T04:49:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.730+0000 7f577d586640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57780b1d10 0x7f577815fc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.730+0000 7f577d586640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57780b1d10 0x7f577815fc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42242/0 (socket says 172.21.15.132:42242) 2023-12-20T04:49:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.730+0000 7f577d586640 1 -- 172.21.15.132:0/1220766027 learned_addr learned my addr 172.21.15.132:0/1220766027 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.730+0000 7f577dd87640 1 --2- 172.21.15.132:0/1220766027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f577815d110 0x7f5778157590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.730+0000 7f577cd85640 1 --2- 172.21.15.132:0/1220766027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57780b4f90 0x7f57780cc6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.730+0000 7f577d586640 1 -- 172.21.15.132:0/1220766027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57780b4f90 msgr2=0x7f57780cc6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.730+0000 7f577d586640 1 --2- 172.21.15.132:0/1220766027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57780b4f90 0x7f57780cc6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.734 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.730+0000 7f577d586640 1 -- 172.21.15.132:0/1220766027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f577815d110 msgr2=0x7f5778157590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.730+0000 7f577d586640 1 --2- 172.21.15.132:0/1220766027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f577815d110 0x7f5778157590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.730+0000 7f577d586640 1 -- 172.21.15.132:0/1220766027 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5770009b30 con 0x7f57780b1d10 2023-12-20T04:49:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.730+0000 7f577dd87640 1 --2- 172.21.15.132:0/1220766027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f577815d110 0x7f5778157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.730+0000 7f577d586640 1 --2- 172.21.15.132:0/1220766027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57780b1d10 0x7f577815fc80 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f577400b3f0 tx=0x7f577400b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.730+0000 7f576dffb640 1 -- 172.21.15.132:0/1220766027 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774011830 con 0x7f57780b1d10 2023-12-20T04:49:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.730+0000 7f576dffb640 1 -- 172.21.15.132:0/1220766027 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5774011990 con 0x7f57780b1d10 2023-12-20T04:49:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.730+0000 7f577f7ea640 1 -- 172.21.15.132:0/1220766027 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57780cbc10 con 0x7f57780b1d10 2023-12-20T04:49:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.730+0000 7f576dffb640 1 -- 172.21.15.132:0/1220766027 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5774011d40 con 0x7f57780b1d10 2023-12-20T04:49:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.730+0000 7f577f7ea640 1 -- 172.21.15.132:0/1220766027 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57780ccc30 con 0x7f57780b1d10 2023-12-20T04:49:37.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.732+0000 7f576dffb640 1 -- 172.21.15.132:0/1220766027 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f577401a400 con 0x7f57780b1d10 2023-12-20T04:49:37.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.732+0000 7f576dffb640 1 --2- 172.21.15.132:0/1220766027 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f575c06a430 0x7f575c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.732+0000 7f576dffb640 1 -- 172.21.15.132:0/1220766027 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5774088760 con 0x7f57780b1d10 2023-12-20T04:49:37.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.732+0000 7f577cd85640 1 --2- 172.21.15.132:0/1220766027 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f575c06a430 0x7f575c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.733+0000 7f577cd85640 1 --2- 172.21.15.132:0/1220766027 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f575c06a430 0x7f575c06c8f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f57780c9650 tx=0x7f5768008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:37.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.733+0000 7f5782435740 1 Processor -- start 2023-12-20T04:49:37.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.733+0000 7f5782435740 1 -- start start 2023-12-20T04:49:37.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.734+0000 7f5782435740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab390 0x55b9a597e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.734+0000 7f5782435740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59ab770 0x55b9a59ae120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.734+0000 7f5782435740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a597ea60 0x55b9a59ae660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.734+0000 7f5782435740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9a58ee0b0 con 0x55b9a59ab390 2023-12-20T04:49:37.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.734+0000 7f5782435740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9a58eb840 con 0x55b9a59ab770 2023-12-20T04:49:37.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.734+0000 7f5782435740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9a58e7130 con 0x55b9a597ea60 2023-12-20T04:49:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.734+0000 7f577d586640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab390 0x55b9a597e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.734+0000 7f577d586640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab390 0x55b9a597e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42248/0 (socket says 172.21.15.132:42248) 2023-12-20T04:49:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.734+0000 7f577d586640 1 -- 172.21.15.132:0/3616050031 learned_addr learned my addr 172.21.15.132:0/3616050031 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.734+0000 7f577d586640 1 -- 172.21.15.132:0/3616050031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a597ea60 msgr2=0x55b9a59ae660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.734+0000 7f577d586640 1 --2- 172.21.15.132:0/3616050031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a597ea60 0x55b9a59ae660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.734+0000 7f577d586640 1 -- 172.21.15.132:0/3616050031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59ab770 msgr2=0x55b9a59ae120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.734+0000 7f577d586640 1 --2- 172.21.15.132:0/3616050031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59ab770 0x55b9a59ae120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.734+0000 7f577d586640 1 -- 172.21.15.132:0/3616050031 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9a58a1c40 con 0x55b9a59ab390 2023-12-20T04:49:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.735+0000 7f577d586640 1 --2- 172.21.15.132:0/3616050031 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab390 0x55b9a597e520 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f577405f4c0 tx=0x7f57740581d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ba6b324abdcca3f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.735+0000 7f5762ffd640 1 -- 172.21.15.132:0/3616050031 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577405f9f0 con 0x55b9a59ab390 2023-12-20T04:49:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.735+0000 7f5762ffd640 1 -- 172.21.15.132:0/3616050031 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5774055db0 con 0x55b9a59ab390 2023-12-20T04:49:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.735+0000 7f5762ffd640 1 -- 172.21.15.132:0/3616050031 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577405f560 con 0x55b9a59ab390 2023-12-20T04:49:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.735+0000 7f5782435740 1 -- 172.21.15.132:0/3616050031 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab390 msgr2=0x55b9a597e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.735+0000 7f5782435740 1 --2- 172.21.15.132:0/3616050031 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab390 0x55b9a597e520 secure :-1 s=READY pgs=1537 cs=0 l=1 rev1=1 crypto rx=0x7f577405f4c0 tx=0x7f57740581d0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.739 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.735+0000 7f5782435740 1 -- 172.21.15.132:0/3616050031 shutdown_connections 2023-12-20T04:49:37.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.735+0000 7f5782435740 1 --2- 172.21.15.132:0/3616050031 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a597ea60 0x55b9a59ae660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.735+0000 7f5782435740 1 --2- 172.21.15.132:0/3616050031 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59ab770 0x55b9a59ae120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.735+0000 7f5782435740 1 --2- 172.21.15.132:0/3616050031 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab390 0x55b9a597e520 unknown :-1 s=CLOSED pgs=1537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.735+0000 7f5782435740 1 -- 172.21.15.132:0/3616050031 >> 172.21.15.132:0/3616050031 conn(0x55b9a5980830 msgr2=0x55b9a59c9120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:37.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.735+0000 7f5782435740 1 -- 172.21.15.132:0/3616050031 shutdown_connections 2023-12-20T04:49:37.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.735+0000 7f5782435740 1 -- 172.21.15.132:0/3616050031 wait complete. 2023-12-20T04:49:37.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.736+0000 7f5782435740 1 -- start start 2023-12-20T04:49:37.740 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.736+0000 7f5782435740 1 Processor -- start 2023-12-20T04:49:37.743 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f5782435740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab390 0x55b9a59c3750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f5782435740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a59ab770 0x55b9a599b0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f5782435740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59c9de0 0x55b9a599b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f5782435740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9a58a5840 con 0x55b9a59ab390 2023-12-20T04:49:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f5782435740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9a58a54e0 con 0x55b9a59c9de0 2023-12-20T04:49:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f5782435740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9a586b230 con 0x55b9a59ab770 2023-12-20T04:49:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f5782435740 10 client.0 _ll_register_callbacks cb 0x55b9a58bc6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:49:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f577d586640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab390 0x55b9a59c3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f577d586640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab390 0x55b9a59c3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42258/0 (socket says 172.21.15.132:42258) 2023-12-20T04:49:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f577d586640 1 -- 172.21.15.132:0/1031434087 learned_addr learned my addr 172.21.15.132:0/1031434087 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f577cd85640 1 --2- 172.21.15.132:0/1031434087 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a59ab770 0x55b9a599b0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f577dd87640 1 --2- 172.21.15.132:0/1031434087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59c9de0 0x55b9a599b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f577d586640 1 -- 172.21.15.132:0/1031434087 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a59ab770 msgr2=0x55b9a599b0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f577d586640 1 --2- 172.21.15.132:0/1031434087 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a59ab770 0x55b9a599b0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f577d586640 1 -- 172.21.15.132:0/1031434087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59c9de0 msgr2=0x55b9a599b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:37.744 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f577d586640 1 --2- 172.21.15.132:0/1031434087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59c9de0 0x55b9a599b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f577d586640 1 -- 172.21.15.132:0/1031434087 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57780ccc30 con 0x55b9a59ab390 2023-12-20T04:49:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f577dd87640 1 --2- 172.21.15.132:0/1031434087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59c9de0 0x55b9a599b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f577cd85640 1 --2- 172.21.15.132:0/1031434087 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a59ab770 0x55b9a599b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f577d586640 1 --2- 172.21.15.132:0/1031434087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab390 0x55b9a59c3750 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f57740582c0 tx=0x7f5774009300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8424362cba32c18 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.737+0000 7f5757fff640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:49:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.738+0000 7f5757fff640 1 -- 172.21.15.132:0/1031434087 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f577405f760 con 0x55b9a59ab390 2023-12-20T04:49:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.738+0000 7f5757fff640 1 -- 172.21.15.132:0/1031434087 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5774053800 con 0x55b9a59ab390 2023-12-20T04:49:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.738+0000 7f5782435740 1 -- 172.21.15.132:0/1031434087 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55b9a5910970 con 0x55b9a59ab390 2023-12-20T04:49:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.738+0000 7f5757fff640 1 -- 172.21.15.132:0/1031434087 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f57740539e0 con 0x55b9a59ab390 2023-12-20T04:49:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.738+0000 7f5782435740 10 client.8463 fetch_fsmap learned FSMap version 57 2023-12-20T04:49:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.738+0000 7f5782435740 1 -- 172.21.15.132:0/1031434087 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x55b9a58e57b0 con 0x55b9a59ab390 2023-12-20T04:49:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.738+0000 7f5757fff640 1 -- 172.21.15.132:0/1031434087 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55b9a5910970 con 0x55b9a59ab390 2023-12-20T04:49:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.738+0000 7f5757fff640 1 -- 172.21.15.132:0/1031434087 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 57) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5774021020 con 0x55b9a59ab390 2023-12-20T04:49:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.738+0000 7f5782435740 10 client.8463 fetch_fsmap finished waiting for FSMap version 57 2023-12-20T04:49:37.745 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.738+0000 7f5782435740 10 client.8463 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-20T04:49:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.738+0000 7f5782435740 20 client.8463 populate_metadata read hostname 'smithi132' 2023-12-20T04:49:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.738+0000 7f5782435740 1 --2- 172.21.15.132:0/1031434087 >> [v2:172.21.15.132:6834/3157504695,v1:172.21.15.132:6836/3157504695] conn(0x55b9a599a390 0x55b9a599a770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.738+0000 7f5782435740 4 client.8463 mds_command: new command op to 8340 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-20T04:49:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.738+0000 7f5782435740 1 -- 172.21.15.132:0/1031434087 --> [v2:172.21.15.132:6834/3157504695,v1:172.21.15.132:6836/3157504695] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55b9a58d8f00 con 0x55b9a599a390 2023-12-20T04:49:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.738+0000 7f577cd85640 1 --2- 172.21.15.132:0/1031434087 >> [v2:172.21.15.132:6834/3157504695,v1:172.21.15.132:6836/3157504695] conn(0x55b9a599a390 0x55b9a599a770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.738+0000 7f577cd85640 1 --2- 172.21.15.132:0/1031434087 >> [v2:172.21.15.132:6834/3157504695,v1:172.21.15.132:6836/3157504695] conn(0x55b9a599a390 0x55b9a599a770 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=c6f0acca2a00acf1 server_cookie=9c4b66a6c3558d23 in_seq=0 out_seq=0 2023-12-20T04:49:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.738+0000 7f5757fff640 10 client.8463 ms_handle_connect on v2:172.21.15.132:6834/3157504695 2023-12-20T04:49:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.739+0000 7f5757fff640 1 -- 172.21.15.132:0/1031434087 <== mds.0 v2:172.21.15.132:6834/3157504695 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55b9a58d8f00 con 0x55b9a599a390 2023-12-20T04:49:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.739+0000 7f5757fff640 10 client.8463 handle_command_reply: tid=0 2023-12-20T04:49:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.739+0000 7f5782435740 1 client.8463 shutdown 2023-12-20T04:49:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.739+0000 7f5782435740 1 -- 172.21.15.132:0/1031434087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab390 msgr2=0x55b9a59c3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.739+0000 7f5782435740 1 --2- 172.21.15.132:0/1031434087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab390 0x55b9a59c3750 secure :-1 s=READY pgs=1538 cs=0 l=1 rev1=1 crypto rx=0x7f57740582c0 tx=0x7f5774009300 comp rx=0 tx=0).stop 2023-12-20T04:49:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.739+0000 7f5782435740 1 -- 172.21.15.132:0/1031434087 shutdown_connections 2023-12-20T04:49:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.739+0000 7f5782435740 1 --2- 172.21.15.132:0/1031434087 >> [v2:172.21.15.132:6834/3157504695,v1:172.21.15.132:6836/3157504695] conn(0x55b9a599a390 0x55b9a599a770 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.739+0000 7f5782435740 1 --2- 172.21.15.132:0/1031434087 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59c9de0 0x55b9a599b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.746 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.739+0000 7f5782435740 1 --2- 172.21.15.132:0/1031434087 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a59ab770 0x55b9a599b0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.739+0000 7f5757fff640 0 client.8463 ms_handle_reset on v2:172.21.15.132:6834/3157504695 2023-12-20T04:49:37.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.739+0000 7f5782435740 1 --2- 172.21.15.132:0/1031434087 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab390 0x55b9a59c3750 unknown :-1 s=CLOSED pgs=1538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.739+0000 7f5782435740 1 -- 172.21.15.132:0/1031434087 >> 172.21.15.132:0/1031434087 conn(0x55b9a597ea60 msgr2=0x55b9a59cc630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:37.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.739+0000 7f5782435740 1 -- 172.21.15.132:0/1031434087 shutdown_connections 2023-12-20T04:49:37.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.739+0000 7f5782435740 1 -- 172.21.15.132:0/1031434087 wait complete. 2023-12-20T04:49:37.747 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.739+0000 7f5782435740 20 client.8463 trim_cache size 0 max 16384 2023-12-20T04:49:37.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.754+0000 7f5782435740 1 Processor -- start 2023-12-20T04:49:37.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.754+0000 7f5782435740 1 -- start start 2023-12-20T04:49:37.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f5782435740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59ab390 0x55b9a59798f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f5782435740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab770 0x55b9a5a25aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f5782435740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a5a25fe0 0x55b9a59986a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f5782435740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9a5979e30 con 0x55b9a59ab770 2023-12-20T04:49:37.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f5782435740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9a59c4630 con 0x55b9a59ab390 2023-12-20T04:49:37.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f5782435740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9a599f450 con 0x55b9a5a25fe0 2023-12-20T04:49:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f577cd85640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab770 0x55b9a5a25aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f577cd85640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab770 0x55b9a5a25aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42268/0 (socket says 172.21.15.132:42268) 2023-12-20T04:49:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f577cd85640 1 -- 172.21.15.132:0/3092154867 learned_addr learned my addr 172.21.15.132:0/3092154867 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f577cd85640 1 -- 172.21.15.132:0/3092154867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a5a25fe0 msgr2=0x55b9a59986a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f577cd85640 1 --2- 172.21.15.132:0/3092154867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a5a25fe0 0x55b9a59986a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f577cd85640 1 -- 172.21.15.132:0/3092154867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59ab390 msgr2=0x55b9a59798f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f577cd85640 1 --2- 172.21.15.132:0/3092154867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59ab390 0x55b9a59798f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f577cd85640 1 -- 172.21.15.132:0/3092154867 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55b9a5887be0 con 0x55b9a59ab770 2023-12-20T04:49:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f577cd85640 1 --2- 172.21.15.132:0/3092154867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab770 0x55b9a5a25aa0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x55b9a59cd3f0 tx=0x7f5768012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b9894d4ce44c500 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f57637fe640 1 -- 172.21.15.132:0/3092154867 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f57680251c0 con 0x55b9a59ab770 2023-12-20T04:49:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f57637fe640 1 -- 172.21.15.132:0/3092154867 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5768025320 con 0x55b9a59ab770 2023-12-20T04:49:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.755+0000 7f57637fe640 1 -- 172.21.15.132:0/3092154867 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5768015b60 con 0x55b9a59ab770 2023-12-20T04:49:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.756+0000 7f5782435740 1 -- 172.21.15.132:0/3092154867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab770 msgr2=0x55b9a5a25aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:37.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.756+0000 7f5782435740 1 --2- 172.21.15.132:0/3092154867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab770 0x55b9a5a25aa0 secure :-1 s=READY pgs=1539 cs=0 l=1 rev1=1 crypto rx=0x55b9a59cd3f0 tx=0x7f5768012000 comp rx=0 tx=0).stop 2023-12-20T04:49:37.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.756+0000 7f5782435740 1 -- 172.21.15.132:0/3092154867 shutdown_connections 2023-12-20T04:49:37.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.756+0000 7f5782435740 1 --2- 172.21.15.132:0/3092154867 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a5a25fe0 0x55b9a59986a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.756+0000 7f5782435740 1 --2- 172.21.15.132:0/3092154867 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a59ab770 0x55b9a5a25aa0 unknown :-1 s=CLOSED pgs=1539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.756+0000 7f5782435740 1 --2- 172.21.15.132:0/3092154867 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59ab390 0x55b9a59798f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.756+0000 7f5782435740 1 -- 172.21.15.132:0/3092154867 >> 172.21.15.132:0/3092154867 conn(0x55b9a597ea60 msgr2=0x55b9a59b1100 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:37.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.756+0000 7f5782435740 1 -- 172.21.15.132:0/3092154867 shutdown_connections 2023-12-20T04:49:37.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.756+0000 7f5782435740 1 -- 172.21.15.132:0/3092154867 wait complete. 2023-12-20T04:49:37.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.756+0000 7f5782435740 1 -- start start 2023-12-20T04:49:37.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.756+0000 7f5782435740 1 Processor -- start 2023-12-20T04:49:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.757+0000 7f5782435740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59ab390 0x55b9a59cca30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.757+0000 7f5782435740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a59ab770 0x55b9a597dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.757+0000 7f5782435740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a5a25fe0 0x55b9a59c5000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.757+0000 7f5782435740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9a59c5ad0 con 0x55b9a5a25fe0 2023-12-20T04:49:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.757+0000 7f5782435740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55b9a59c8e00 con 0x55b9a59ab390 2023-12-20T04:49:37.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.757+0000 7f5782435740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55b9a5979c70 con 0x55b9a59ab770 2023-12-20T04:49:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.757+0000 7f5782435740 10 client.0 _ll_register_callbacks cb 0x7f5774053d50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:49:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.757+0000 7f577dd87640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a5a25fe0 0x55b9a59c5000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f577dd87640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a5a25fe0 0x55b9a59c5000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42276/0 (socket says 172.21.15.132:42276) 2023-12-20T04:49:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f577dd87640 1 -- 172.21.15.132:0/97204719 learned_addr learned my addr 172.21.15.132:0/97204719 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f577cd85640 1 --2- 172.21.15.132:0/97204719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a59ab770 0x55b9a597dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f577d586640 1 --2- 172.21.15.132:0/97204719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59ab390 0x55b9a59cca30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f577dd87640 1 -- 172.21.15.132:0/97204719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a59ab770 msgr2=0x55b9a597dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f577dd87640 1 --2- 172.21.15.132:0/97204719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a59ab770 0x55b9a597dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f577dd87640 1 -- 172.21.15.132:0/97204719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59ab390 msgr2=0x55b9a59cca30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f577dd87640 1 --2- 172.21.15.132:0/97204719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59ab390 0x55b9a59cca30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f577dd87640 1 -- 172.21.15.132:0/97204719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f576801d040 con 0x55b9a5a25fe0 2023-12-20T04:49:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f577cd85640 1 --2- 172.21.15.132:0/97204719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a59ab770 0x55b9a597dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f577dd87640 1 --2- 172.21.15.132:0/97204719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a5a25fe0 0x55b9a59c5000 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f5770036040 tx=0x7f57700346d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4fbb9c960d93bb4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:37.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f5757fff640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:49:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f5757fff640 1 -- 172.21.15.132:0/97204719 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5770034c50 con 0x55b9a5a25fe0 2023-12-20T04:49:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f5757fff640 1 -- 172.21.15.132:0/97204719 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5770034db0 con 0x55b9a5a25fe0 2023-12-20T04:49:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f5782435740 1 -- 172.21.15.132:0/97204719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5774055db0 con 0x55b9a5a25fe0 2023-12-20T04:49:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f5757fff640 1 -- 172.21.15.132:0/97204719 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=57) v2 ==== 24+0+0 (secure 0 0 0) 0x7f577003d3f0 con 0x55b9a5a25fe0 2023-12-20T04:49:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f5782435740 10 client.8469 fetch_fsmap learned FSMap version 57 2023-12-20T04:49:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f5782435740 1 -- 172.21.15.132:0/97204719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=57,monmap=2+}) v3 -- 0x55b9a58ad2f0 con 0x55b9a5a25fe0 2023-12-20T04:49:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f5757fff640 1 -- 172.21.15.132:0/97204719 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5774055db0 con 0x55b9a5a25fe0 2023-12-20T04:49:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f5757fff640 1 -- 172.21.15.132:0/97204719 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 57) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5770045030 con 0x55b9a5a25fe0 2023-12-20T04:49:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f5782435740 10 client.8469 fetch_fsmap finished waiting for FSMap version 57 2023-12-20T04:49:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f5782435740 10 client.8469 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-20T04:49:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f5782435740 20 client.8469 populate_metadata read hostname 'smithi132' 2023-12-20T04:49:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f5782435740 1 --2- 172.21.15.132:0/97204719 >> [v2:172.21.15.132:6834/3157504695,v1:172.21.15.132:6836/3157504695] conn(0x55b9a59beab0 0x55b9a59bee90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f5782435740 4 client.8469 mds_command: new command op to 8340 tid=0[{"prefix": "status"}] 2023-12-20T04:49:37.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.758+0000 7f5782435740 1 -- 172.21.15.132:0/97204719 --> [v2:172.21.15.132:6834/3157504695,v1:172.21.15.132:6836/3157504695] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55b9a58e01b0 con 0x55b9a59beab0 2023-12-20T04:49:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f577d586640 1 --2- 172.21.15.132:0/97204719 >> [v2:172.21.15.132:6834/3157504695,v1:172.21.15.132:6836/3157504695] conn(0x55b9a59beab0 0x55b9a59bee90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f5757fff640 10 client.8469 ms_handle_connect on v2:172.21.15.132:6834/3157504695 2023-12-20T04:49:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f577d586640 1 --2- 172.21.15.132:0/97204719 >> [v2:172.21.15.132:6834/3157504695,v1:172.21.15.132:6836/3157504695] conn(0x55b9a59beab0 0x55b9a59bee90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b47e34e0c18ebc5 server_cookie=2edee8611d59826a in_seq=0 out_seq=0 2023-12-20T04:49:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f5757fff640 1 -- 172.21.15.132:0/97204719 <== mds.0 v2:172.21.15.132:6834/3157504695 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x55b9a58e01b0 con 0x55b9a59beab0 2023-12-20T04:49:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f5757fff640 10 client.8469 handle_command_reply: tid=0 2023-12-20T04:49:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f5782435740 1 client.8469 shutdown 2023-12-20T04:49:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f5782435740 1 -- 172.21.15.132:0/97204719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a5a25fe0 msgr2=0x55b9a59c5000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f5782435740 1 --2- 172.21.15.132:0/97204719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a5a25fe0 0x55b9a59c5000 secure :-1 s=READY pgs=1540 cs=0 l=1 rev1=1 crypto rx=0x7f5770036040 tx=0x7f57700346d0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f5782435740 1 -- 172.21.15.132:0/97204719 shutdown_connections 2023-12-20T04:49:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f5782435740 1 --2- 172.21.15.132:0/97204719 >> [v2:172.21.15.132:6834/3157504695,v1:172.21.15.132:6836/3157504695] conn(0x55b9a59beab0 0x55b9a59bee90 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f5782435740 1 --2- 172.21.15.132:0/97204719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55b9a5a25fe0 0x55b9a59c5000 unknown :-1 s=CLOSED pgs=1540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f5782435740 1 --2- 172.21.15.132:0/97204719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55b9a59ab770 0x55b9a597dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f5757fff640 0 client.8469 ms_handle_reset on v2:172.21.15.132:6834/3157504695 2023-12-20T04:49:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f5782435740 1 --2- 172.21.15.132:0/97204719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55b9a59ab390 0x55b9a59cca30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.767 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f5782435740 1 -- 172.21.15.132:0/97204719 >> 172.21.15.132:0/97204719 conn(0x55b9a597ea60 msgr2=0x55b9a5998d10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:37.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f5782435740 1 -- 172.21.15.132:0/97204719 shutdown_connections 2023-12-20T04:49:37.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f5782435740 1 -- 172.21.15.132:0/97204719 wait complete. 2023-12-20T04:49:37.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.759+0000 7f5782435740 20 client.8469 trim_cache size 0 max 16384 2023-12-20T04:49:37.768 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:49:37.768 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:49:37.768 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-12-20T04:49:37.768 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 8340, 2023-12-20T04:49:37.768 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-12-20T04:49:37.768 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-12-20T04:49:37.768 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-12-20T04:49:37.768 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 4.546979705, 2023-12-20T04:49:37.768 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 57, 2023-12-20T04:49:37.769 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 153, 2023-12-20T04:49:37.769 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 153, 2023-12-20T04:49:37.769 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 9.1202699949999992 2023-12-20T04:49:37.769 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:49:37.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.760+0000 7f577f7ea640 1 -- 172.21.15.132:0/1220766027 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f575c06a430 msgr2=0x7f575c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:37.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.760+0000 7f577f7ea640 1 --2- 172.21.15.132:0/1220766027 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f575c06a430 0x7f575c06c8f0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f57780c9650 tx=0x7f5768008040 comp rx=0 tx=0).stop 2023-12-20T04:49:37.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.760+0000 7f577f7ea640 1 -- 172.21.15.132:0/1220766027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57780b1d10 msgr2=0x7f577815fc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:37.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.760+0000 7f577f7ea640 1 --2- 172.21.15.132:0/1220766027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57780b1d10 0x7f577815fc80 secure :-1 s=READY pgs=1536 cs=0 l=1 rev1=1 crypto rx=0x7f577400b3f0 tx=0x7f577400b8b0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.760+0000 7f577f7ea640 1 -- 172.21.15.132:0/1220766027 shutdown_connections 2023-12-20T04:49:37.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.760+0000 7f577f7ea640 1 --2- 172.21.15.132:0/1220766027 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f575c06a430 0x7f575c06c8f0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.760+0000 7f577f7ea640 1 --2- 172.21.15.132:0/1220766027 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f577815d110 0x7f5778157590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.760+0000 7f577f7ea640 1 --2- 172.21.15.132:0/1220766027 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f57780b4f90 0x7f57780cc6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.760+0000 7f577f7ea640 1 --2- 172.21.15.132:0/1220766027 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f57780b1d10 0x7f577815fc80 unknown :-1 s=CLOSED pgs=1536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.760+0000 7f577f7ea640 1 -- 172.21.15.132:0/1220766027 >> 172.21.15.132:0/1220766027 conn(0x7f57780cf880 msgr2=0x7f57780b63a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:37.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.760+0000 7f577f7ea640 1 -- 172.21.15.132:0/1220766027 shutdown_connections 2023-12-20T04:49:37.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.760+0000 7f577f7ea640 1 -- 172.21.15.132:0/1220766027 wait complete. 2023-12-20T04:49:37.773 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:49:37.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.870+0000 7f0ceaf47640 1 Processor -- start 2023-12-20T04:49:37.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.871+0000 7f0ceaf47640 1 -- start start 2023-12-20T04:49:37.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.871+0000 7f0ceaf47640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0ce4160450 0x7f0ce4160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.871+0000 7f0ceaf47640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ce40b5090 0x7f0ce40d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.871+0000 7f0ceaf47640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0ce40b5ec0 con 0x7f0ce41611b0 2023-12-20T04:49:37.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.871+0000 7f0ceaf47640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0ce41617e0 con 0x7f0ce4160450 2023-12-20T04:49:37.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.871+0000 7f0ceaf47640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce40d0fc0 con 0x7f0ce40b5090 2023-12-20T04:49:37.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.872+0000 7f0ce94e4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ce40b5090 0x7f0ce40d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.872+0000 7f0ce8ce3640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0ce4160450 0x7f0ce4160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.872+0000 7f0ce94e4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ce40b5090 0x7f0ce40d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:49276/0 (socket says 172.21.15.132:49276) 2023-12-20T04:49:37.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.872+0000 7f0ce94e4640 1 -- 172.21.15.132:0/485870050 learned_addr learned my addr 172.21.15.132:0/485870050 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:37.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.872+0000 7f0ce8ce3640 1 -- 172.21.15.132:0/485870050 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ce40b5090 msgr2=0x7f0ce40d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:37.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.872+0000 7f0ce8ce3640 1 --2- 172.21.15.132:0/485870050 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ce40b5090 0x7f0ce40d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.872+0000 7f0ce8ce3640 1 -- 172.21.15.132:0/485870050 >> v1:172.21.15.187:6789/0 conn(0x7f0ce41611b0 legacy=0x7f0ce40b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:37.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.872+0000 7f0ce8ce3640 1 -- 172.21.15.132:0/485870050 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ce40d12a0 con 0x7f0ce4160450 2023-12-20T04:49:37.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.872+0000 7f0ce37fe640 1 -- 172.21.15.132:0/485870050 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3391478205 0 0) 0x7f0ce40b5ec0 con 0x7f0ce41611b0 2023-12-20T04:49:37.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.872+0000 7f0ce94e4640 1 --2- 172.21.15.132:0/485870050 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ce40b5090 0x7f0ce40d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:49:37.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.873+0000 7f0ce8ce3640 1 --2- 172.21.15.132:0/485870050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ce4160450 0x7f0ce4160c70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80097a0 tx=0x7f0cd802b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=125df046e11c1e04 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:37.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.873+0000 7f0ce37fe640 1 -- 172.21.15.132:0/485870050 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8030610 con 0x7f0ce4160450 2023-12-20T04:49:37.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.873+0000 7f0ce37fe640 1 -- 172.21.15.132:0/485870050 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd8030770 con 0x7f0ce4160450 2023-12-20T04:49:37.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.873+0000 7f0ce37fe640 1 -- 172.21.15.132:0/485870050 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd8030b00 con 0x7f0ce4160450 2023-12-20T04:49:37.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.873+0000 7f0ceaf47640 1 -- 172.21.15.132:0/485870050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ce4160450 msgr2=0x7f0ce4160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:37.879 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.873+0000 7f0ceaf47640 1 --2- 172.21.15.132:0/485870050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ce4160450 0x7f0ce4160c70 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f0cd80097a0 tx=0x7f0cd802b960 comp rx=0 tx=0).stop 2023-12-20T04:49:37.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.874+0000 7f0ceaf47640 1 -- 172.21.15.132:0/485870050 shutdown_connections 2023-12-20T04:49:37.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.874+0000 7f0ceaf47640 1 --2- 172.21.15.132:0/485870050 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ce40b5090 0x7f0ce40d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.874+0000 7f0ceaf47640 1 --2- 172.21.15.132:0/485870050 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ce4160450 0x7f0ce4160c70 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.874+0000 7f0ceaf47640 1 -- 172.21.15.132:0/485870050 >> 172.21.15.132:0/485870050 conn(0x7f0ce40cf980 msgr2=0x7f0ce40cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:37.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.874+0000 7f0ceaf47640 1 -- 172.21.15.132:0/485870050 shutdown_connections 2023-12-20T04:49:37.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.874+0000 7f0ceaf47640 1 -- 172.21.15.132:0/485870050 wait complete. 2023-12-20T04:49:37.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.875+0000 7f0ceaf47640 1 Processor -- start 2023-12-20T04:49:37.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.875+0000 7f0ceaf47640 1 -- start start 2023-12-20T04:49:37.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ceaf47640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ce40b5090 0x7f0ce40c9180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ceaf47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ce4160450 0x7f0ce4156f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ceaf47640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ce41611b0 0x7f0ce4157480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ceaf47640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce40c96c0 con 0x7f0ce4160450 2023-12-20T04:49:37.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ceaf47640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce415ba80 con 0x7f0ce40b5090 2023-12-20T04:49:37.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ceaf47640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0ce4157ab0 con 0x7f0ce41611b0 2023-12-20T04:49:37.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ce3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ce4160450 0x7f0ce4156f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ce3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ce4160450 0x7f0ce4156f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42280/0 (socket says 172.21.15.132:42280) 2023-12-20T04:49:37.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ce3fff640 1 -- 172.21.15.132:0/303944036 learned_addr learned my addr 172.21.15.132:0/303944036 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:37.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ce8ce3640 1 --2- 172.21.15.132:0/303944036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ce40b5090 0x7f0ce40c9180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ce94e4640 1 --2- 172.21.15.132:0/303944036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ce41611b0 0x7f0ce4157480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ce3fff640 1 -- 172.21.15.132:0/303944036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ce41611b0 msgr2=0x7f0ce4157480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:37.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ce3fff640 1 --2- 172.21.15.132:0/303944036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ce41611b0 0x7f0ce4157480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ce3fff640 1 -- 172.21.15.132:0/303944036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ce40b5090 msgr2=0x7f0ce40c9180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:37.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ce3fff640 1 --2- 172.21.15.132:0/303944036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ce40b5090 0x7f0ce40c9180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:37.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ce3fff640 1 -- 172.21.15.132:0/303944036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0cdc009b30 con 0x7f0ce4160450 2023-12-20T04:49:37.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ce94e4640 1 --2- 172.21.15.132:0/303944036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ce41611b0 0x7f0ce4157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:37.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ce3fff640 1 --2- 172.21.15.132:0/303944036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ce4160450 0x7f0ce4156f40 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000c410 tx=0x7f0cd000c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:37.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ce17fa640 1 -- 172.21.15.132:0/303944036 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd00035f0 con 0x7f0ce4160450 2023-12-20T04:49:37.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ce17fa640 1 -- 172.21.15.132:0/303944036 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0cd0003770 con 0x7f0ce4160450 2023-12-20T04:49:37.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ceaf47640 1 -- 172.21.15.132:0/303944036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0cd8009400 con 0x7f0ce4160450 2023-12-20T04:49:37.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ce17fa640 1 -- 172.21.15.132:0/303944036 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0cd0003b20 con 0x7f0ce4160450 2023-12-20T04:49:37.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.876+0000 7f0ceaf47640 1 -- 172.21.15.132:0/303944036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ce4158070 con 0x7f0ce4160450 2023-12-20T04:49:37.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.877+0000 7f0ceaf47640 1 -- 172.21.15.132:0/303944036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ce404e840 con 0x7f0ce4160450 2023-12-20T04:49:37.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.878+0000 7f0ce17fa640 1 -- 172.21.15.132:0/303944036 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0cd0003c80 con 0x7f0ce4160450 2023-12-20T04:49:37.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.878+0000 7f0ce17fa640 1 --2- 172.21.15.132:0/303944036 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0cc806a430 0x7f0cc806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:37.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.878+0000 7f0ce17fa640 1 -- 172.21.15.132:0/303944036 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0cd0087ea0 con 0x7f0ce4160450 2023-12-20T04:49:37.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.878+0000 7f0ce8ce3640 1 --2- 172.21.15.132:0/303944036 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0cc806a430 0x7f0cc806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:37.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.879+0000 7f0ce8ce3640 1 --2- 172.21.15.132:0/303944036 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0cc806a430 0x7f0cc806c8f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8036000 tx=0x7f0cd8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:37.884 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:37.882+0000 7f0ce17fa640 1 -- 172.21.15.132:0/303944036 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0cd0053540 con 0x7f0ce4160450 2023-12-20T04:49:38.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:38.089+0000 7f0ceaf47640 1 -- 172.21.15.132:0/303944036 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f0ce415fc70 con 0x7f0ce4160450 2023-12-20T04:49:38.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:38.090+0000 7f0ce17fa640 1 -- 172.21.15.132:0/303944036 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v57) v1 ==== 53+0+73 (secure 0 0 0) 0x7f0cd0017070 con 0x7f0ce4160450 2023-12-20T04:49:38.092 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:49:38.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:38.092+0000 7f0ceaf47640 1 -- 172.21.15.132:0/303944036 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0cc806a430 msgr2=0x7f0cc806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:38.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:38.092+0000 7f0ceaf47640 1 --2- 172.21.15.132:0/303944036 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0cc806a430 0x7f0cc806c8f0 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f0cd8036000 tx=0x7f0cd8008030 comp rx=0 tx=0).stop 2023-12-20T04:49:38.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:38.092+0000 7f0ceaf47640 1 -- 172.21.15.132:0/303944036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ce4160450 msgr2=0x7f0ce4156f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:38.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:38.092+0000 7f0ceaf47640 1 --2- 172.21.15.132:0/303944036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ce4160450 0x7f0ce4156f40 secure :-1 s=READY pgs=1541 cs=0 l=1 rev1=1 crypto rx=0x7f0cd000c410 tx=0x7f0cd000c8d0 comp rx=0 tx=0).stop 2023-12-20T04:49:38.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:38.092+0000 7f0ceaf47640 1 -- 172.21.15.132:0/303944036 shutdown_connections 2023-12-20T04:49:38.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:38.092+0000 7f0ceaf47640 1 --2- 172.21.15.132:0/303944036 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0cc806a430 0x7f0cc806c8f0 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:38.094 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:38.092+0000 7f0ceaf47640 1 --2- 172.21.15.132:0/303944036 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0ce41611b0 0x7f0ce4157480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:38.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:38.092+0000 7f0ceaf47640 1 --2- 172.21.15.132:0/303944036 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0ce4160450 0x7f0ce4156f40 unknown :-1 s=CLOSED pgs=1541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:38.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:38.092+0000 7f0ceaf47640 1 --2- 172.21.15.132:0/303944036 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0ce40b5090 0x7f0ce40c9180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:38.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:38.092+0000 7f0ceaf47640 1 -- 172.21.15.132:0/303944036 >> 172.21.15.132:0/303944036 conn(0x7f0ce40cf980 msgr2=0x7f0ce40d19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:38.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:38.092+0000 7f0ceaf47640 1 -- 172.21.15.132:0/303944036 shutdown_connections 2023-12-20T04:49:38.095 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:38.092+0000 7f0ceaf47640 1 -- 172.21.15.132:0/303944036 wait complete. 2023-12-20T04:49:38.105 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:49:38.105 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:49:38.105 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-12-20T04:49:38.105 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-20T04:49:38.105 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-20T04:49:38.105 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:49:38.105 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:49:38.105 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:49:38.105 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:49:38.106 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:38.106 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-12-20T04:49:38.121 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:49:38.121 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:49:38.121 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:49:38.121 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:49:38.121 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-20T04:49:38.121 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:49:38.121 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:49:38.121 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:49:38.121 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-12-20T04:49:38.122 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:49:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-12-20T04:49:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-12-20T04:49:38.122 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:49:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-12-20T04:49:38.122 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:49:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-12-20T04:49:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:49:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42296sec preferred_lft 42296sec 2023-12-20T04:49:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-12-20T04:49:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:49:38.122 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:49:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:49:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:49:38.122 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:49:38.123 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::60dd:37ff:fe28:558b/64 scope link 2023-12-20T04:49:38.123 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:49:38.123 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:49:38.123 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 86:13:fe:55:4c:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-20T04:49:38.123 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::8413:feff:fe55:4c04/64 scope link 2023-12-20T04:49:38.123 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:49:38.123 INFO:teuthology.orchestra.run.smithi132.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:49:38.123 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-20T04:49:38.123 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::839:72ff:fea7:b332/64 scope link 2023-12-20T04:49:38.123 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:49:38.123 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:38.123 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:49:38.187 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-20T04:49:38.189 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:38.189 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-12-20T04:49:38.244 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-12-20T04:49:38.244 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:49:38.244 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:49:38.244 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:49:38.244 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:49:38.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:38.245 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:49:38.245 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:49:38.245 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:49:38.245 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:49:38.245 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:49:38.245 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:49:38.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:38.340 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-20T04:49:38.354 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-20T04:49:38.354 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-20T04:49:38.354 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:49:38.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:38.354 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-12-20T04:49:38.421 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-20T04:49:38.421 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:49:38.422 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-20T04:49:38.476 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:49:38.476 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:49:38.476 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:49:38.530 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:49:38.598 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:49:38.598 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:49:38.663 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:49:38.664 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:49:38.665 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:38.665 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:49:38.719 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:49:38.719 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-20T04:49:38.762 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:49:38.788 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:49:38.788 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:49:38.847 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:2023-12-20T04:49:38.845+0000 7f2498f70480 -1 init, newargv = 0x55ead1624600 newargc=15 2023-12-20T04:49:38.847 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[117673]: starting ceph client 2023-12-20T04:49:38.850 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[117673]: starting fuse 2023-12-20T04:49:38.857 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:49:38.858 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:49:38.858 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:38.858 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:49:38.913 INFO:teuthology.orchestra.run.smithi132.stdout:41 2023-12-20T04:49:38.913 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:49:38.914 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:49:38.914 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:49:38.914 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:49:38.914 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:49:38.914 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:49:38.914 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:49:38.914 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:49:38.914 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:49:38.914 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:49:38.914 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:49:38.914 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:49:38.914 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:49:38.914 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:49:38.915 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:49:38.915 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:49:38.915 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:49:38.915 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:49:38.915 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:49:38.915 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:49:38.915 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:49:38.915 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:49:38.915 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:49:38.915 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:49:38.915 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:49:38.915 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:49:38.915 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:49:38.915 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:49:38.970 INFO:tasks.ceph.mds.a.smithi132.stderr:2023-12-20T04:49:38.968+0000 7f31788c6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:49:39.030 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.117673.asok 2023-12-20T04:49:39.215 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.117673.asok 2023-12-20T04:49:39.215 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:39.216 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.117673.asok status 2023-12-20T04:49:39.350 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:49:39.350 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:49:39.350 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:49:39.350 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:49:39.350 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:49:39.350 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:49:39.350 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:49:39.350 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "117673", 2023-12-20T04:49:39.350 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:49:39.350 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:39.350 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2023-12-20T04:49:39.351 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:49:39.351 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 8478, 2023-12-20T04:49:39.351 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:49:39.351 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:49:39.351 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:49:39.351 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 8478 2023-12-20T04:49:39.351 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:39.351 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:49:39.351 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:39.351 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:49:39.351 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 1852544534 2023-12-20T04:49:39.351 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:49:39.351 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:39.351 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:49:39.351 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:49:39.351 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:49:39.351 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 1852544534 2023-12-20T04:49:39.352 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:49:39.352 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.8478 192.168.0.1:0/1852544534", 2023-12-20T04:49:39.352 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/1852544534", 2023-12-20T04:49:39.352 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2023-12-20T04:49:39.352 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 57, 2023-12-20T04:49:39.352 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 153, 2023-12-20T04:49:39.352 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:49:39.352 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:49:39.352 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:49:39.352 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:49:39.358 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:39.358 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2023-12-20T04:49:39.359 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-20T04:49:39.374 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2023-12-20T04:49:39.374 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-20T04:49:39.374 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:39.374 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:49:39.442 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:49:39.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.580+0000 7fe691038640 1 Processor -- start 2023-12-20T04:49:39.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.580+0000 7fe691038640 1 -- start start 2023-12-20T04:49:39.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.581+0000 7fe691038640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe68c160450 0x7fe68c160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:39.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.581+0000 7fe691038640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe68c1611b0 0x7fe68c0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:39.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.581+0000 7fe691038640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe68c0b5300 con 0x7fe68c0b4ec0 2023-12-20T04:49:39.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.581+0000 7fe691038640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68c0b5ec0 con 0x7fe68c1611b0 2023-12-20T04:49:39.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.581+0000 7fe691038640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe68c1617e0 con 0x7fe68c160450 2023-12-20T04:49:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.581+0000 7fe68a59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe68c1611b0 0x7fe68c0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.581+0000 7fe68a59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe68c1611b0 0x7fe68c0b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42296/0 (socket says 172.21.15.132:42296) 2023-12-20T04:49:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.581+0000 7fe68a59c640 1 -- 172.21.15.132:0/480204439 learned_addr learned my addr 172.21.15.132:0/480204439 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.582+0000 7fe68a59c640 1 -- 172.21.15.132:0/480204439 >> v2:172.21.15.187:3300/0 conn(0x7fe68c160450 msgr2=0x7fe68c160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.582+0000 7fe68ad9d640 1 --2- 172.21.15.132:0/480204439 >> v2:172.21.15.187:3300/0 conn(0x7fe68c160450 0x7fe68c160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.582+0000 7fe68a59c640 1 --2- 172.21.15.132:0/480204439 >> v2:172.21.15.187:3300/0 conn(0x7fe68c160450 0x7fe68c160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.582+0000 7fe68a59c640 1 -- 172.21.15.132:0/480204439 >> v1:172.21.15.187:6789/0 conn(0x7fe68c0b4ec0 legacy=0x7fe68c06a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.582+0000 7fe68a59c640 1 -- 172.21.15.132:0/480204439 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe68c0d0fc0 con 0x7fe68c1611b0 2023-12-20T04:49:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.582+0000 7fe68ad9d640 1 --2- 172.21.15.132:0/480204439 >> v2:172.21.15.187:3300/0 conn(0x7fe68c160450 0x7fe68c160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:49:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.582+0000 7fe68a59c640 1 --2- 172.21.15.132:0/480204439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe68c1611b0 0x7fe68c0b4980 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fe68c08b150 tx=0x7fe68002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecc8a6441f18a0ac server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.582+0000 7fe689d9b640 1 -- 172.21.15.132:0/480204439 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe680030860 con 0x7fe68c1611b0 2023-12-20T04:49:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.583+0000 7fe689d9b640 1 -- 172.21.15.132:0/480204439 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6800309c0 con 0x7fe68c1611b0 2023-12-20T04:49:39.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.583+0000 7fe689d9b640 1 -- 172.21.15.132:0/480204439 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe680030d50 con 0x7fe68c1611b0 2023-12-20T04:49:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.583+0000 7fe691038640 1 -- 172.21.15.132:0/480204439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe68c1611b0 msgr2=0x7fe68c0b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.583+0000 7fe691038640 1 --2- 172.21.15.132:0/480204439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe68c1611b0 0x7fe68c0b4980 secure :-1 s=READY pgs=1544 cs=0 l=1 rev1=1 crypto rx=0x7fe68c08b150 tx=0x7fe68002b9a0 comp rx=0 tx=0).stop 2023-12-20T04:49:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.583+0000 7fe691038640 1 -- 172.21.15.132:0/480204439 shutdown_connections 2023-12-20T04:49:39.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.583+0000 7fe691038640 1 --2- 172.21.15.132:0/480204439 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe68c1611b0 0x7fe68c0b4980 unknown :-1 s=CLOSED pgs=1544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.583+0000 7fe691038640 1 --2- 172.21.15.132:0/480204439 >> v2:172.21.15.187:3300/0 conn(0x7fe68c160450 0x7fe68c160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.583+0000 7fe691038640 1 -- 172.21.15.132:0/480204439 >> 172.21.15.132:0/480204439 conn(0x7fe68c0cf980 msgr2=0x7fe68c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.583+0000 7fe691038640 1 -- 172.21.15.132:0/480204439 shutdown_connections 2023-12-20T04:49:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.583+0000 7fe691038640 1 -- 172.21.15.132:0/480204439 wait complete. 2023-12-20T04:49:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.584+0000 7fe691038640 1 Processor -- start 2023-12-20T04:49:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.585+0000 7fe691038640 1 -- start start 2023-12-20T04:49:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.585+0000 7fe691038640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe68c0b4ec0 0x7fe68c0ccdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.585+0000 7fe691038640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe68c160450 0x7fe68c157950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.585+0000 7fe691038640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe68c1611b0 0x7fe68c14ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.585+0000 7fe691038640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c0d3960 con 0x7fe68c1611b0 2023-12-20T04:49:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.585+0000 7fe691038640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c158c40 con 0x7fe68c0b4ec0 2023-12-20T04:49:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.585+0000 7fe691038640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe68c158030 con 0x7fe68c160450 2023-12-20T04:49:39.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.585+0000 7fe68b59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe68c1611b0 0x7fe68c14ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.585+0000 7fe68b59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe68c1611b0 0x7fe68c14ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42306/0 (socket says 172.21.15.132:42306) 2023-12-20T04:49:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.585+0000 7fe68b59e640 1 -- 172.21.15.132:0/4135339698 learned_addr learned my addr 172.21.15.132:0/4135339698 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.585+0000 7fe68ad9d640 1 --2- 172.21.15.132:0/4135339698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe68c0b4ec0 0x7fe68c0ccdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.586+0000 7fe68a59c640 1 --2- 172.21.15.132:0/4135339698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe68c160450 0x7fe68c157950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.586+0000 7fe68b59e640 1 -- 172.21.15.132:0/4135339698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe68c160450 msgr2=0x7fe68c157950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.586+0000 7fe68b59e640 1 --2- 172.21.15.132:0/4135339698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe68c160450 0x7fe68c157950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.586+0000 7fe68b59e640 1 -- 172.21.15.132:0/4135339698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe68c0b4ec0 msgr2=0x7fe68c0ccdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.586+0000 7fe68b59e640 1 --2- 172.21.15.132:0/4135339698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe68c0b4ec0 0x7fe68c0ccdf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.586+0000 7fe68b59e640 1 -- 172.21.15.132:0/4135339698 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6800094d0 con 0x7fe68c1611b0 2023-12-20T04:49:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.586+0000 7fe68ad9d640 1 --2- 172.21.15.132:0/4135339698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe68c0b4ec0 0x7fe68c0ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:49:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.586+0000 7fe68b59e640 1 --2- 172.21.15.132:0/4135339698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe68c1611b0 0x7fe68c14ef10 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fe68400c410 tx=0x7fe68400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.586+0000 7fe6737fe640 1 -- 172.21.15.132:0/4135339698 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe684011790 con 0x7fe68c1611b0 2023-12-20T04:49:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.586+0000 7fe6737fe640 1 -- 172.21.15.132:0/4135339698 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe6840118f0 con 0x7fe68c1611b0 2023-12-20T04:49:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.586+0000 7fe691038640 1 -- 172.21.15.132:0/4135339698 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe68c158310 con 0x7fe68c1611b0 2023-12-20T04:49:39.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.586+0000 7fe6737fe640 1 -- 172.21.15.132:0/4135339698 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe684011ce0 con 0x7fe68c1611b0 2023-12-20T04:49:39.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.586+0000 7fe691038640 1 -- 172.21.15.132:0/4135339698 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe68c1588d0 con 0x7fe68c1611b0 2023-12-20T04:49:39.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.587+0000 7fe691038640 1 -- 172.21.15.132:0/4135339698 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe68c04e840 con 0x7fe68c1611b0 2023-12-20T04:49:39.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.587+0000 7fe6737fe640 1 -- 172.21.15.132:0/4135339698 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe68401c460 con 0x7fe68c1611b0 2023-12-20T04:49:39.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.588+0000 7fe6737fe640 1 --2- 172.21.15.132:0/4135339698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe67806a460 0x7fe67806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:39.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.588+0000 7fe68ad9d640 1 --2- 172.21.15.132:0/4135339698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe67806a460 0x7fe67806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:39.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.588+0000 7fe6737fe640 1 -- 172.21.15.132:0/4135339698 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe6840884e0 con 0x7fe68c1611b0 2023-12-20T04:49:39.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.588+0000 7fe68ad9d640 1 --2- 172.21.15.132:0/4135339698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe67806a460 0x7fe67806c920 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe67c00e550 tx=0x7fe67c007ab0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:39.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.592+0000 7fe6737fe640 1 -- 172.21.15.132:0/4135339698 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe684053b60 con 0x7fe68c1611b0 2023-12-20T04:49:39.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.791+0000 7fe691038640 1 -- 172.21.15.132:0/4135339698 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fe68c0d0ad0 con 0x7fe68c1611b0 2023-12-20T04:49:39.794 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.792+0000 7fe6737fe640 1 -- 172.21.15.132:0/4135339698 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v57) v1 ==== 53+0+73 (secure 0 0 0) 0x7fe684057180 con 0x7fe68c1611b0 2023-12-20T04:49:39.794 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:49:39.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.794+0000 7fe691038640 1 -- 172.21.15.132:0/4135339698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe67806a460 msgr2=0x7fe67806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:39.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.794+0000 7fe691038640 1 --2- 172.21.15.132:0/4135339698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe67806a460 0x7fe67806c920 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x7fe67c00e550 tx=0x7fe67c007ab0 comp rx=0 tx=0).stop 2023-12-20T04:49:39.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.794+0000 7fe691038640 1 -- 172.21.15.132:0/4135339698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe68c1611b0 msgr2=0x7fe68c14ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:39.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.794+0000 7fe691038640 1 --2- 172.21.15.132:0/4135339698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe68c1611b0 0x7fe68c14ef10 secure :-1 s=READY pgs=1545 cs=0 l=1 rev1=1 crypto rx=0x7fe68400c410 tx=0x7fe68400c8d0 comp rx=0 tx=0).stop 2023-12-20T04:49:39.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.794+0000 7fe691038640 1 -- 172.21.15.132:0/4135339698 shutdown_connections 2023-12-20T04:49:39.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.794+0000 7fe691038640 1 --2- 172.21.15.132:0/4135339698 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe67806a460 0x7fe67806c920 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:39.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.794+0000 7fe691038640 1 --2- 172.21.15.132:0/4135339698 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe68c1611b0 0x7fe68c14ef10 unknown :-1 s=CLOSED pgs=1545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:39.796 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.794+0000 7fe691038640 1 --2- 172.21.15.132:0/4135339698 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe68c160450 0x7fe68c157950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:39.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.794+0000 7fe691038640 1 --2- 172.21.15.132:0/4135339698 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe68c0b4ec0 0x7fe68c0ccdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:39.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.794+0000 7fe691038640 1 -- 172.21.15.132:0/4135339698 >> 172.21.15.132:0/4135339698 conn(0x7fe68c0cf980 msgr2=0x7fe68c15f750 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:39.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.794+0000 7fe691038640 1 -- 172.21.15.132:0/4135339698 shutdown_connections 2023-12-20T04:49:39.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:39.794+0000 7fe691038640 1 -- 172.21.15.132:0/4135339698 wait complete. 2023-12-20T04:49:39.806 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:49:39.807 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:49:39.807 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-12-20T04:49:39.807 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-20T04:49:39.807 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-20T04:49:39.807 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:49:39.807 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:49:39.807 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:49:39.807 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:49:39.807 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:39.807 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-12-20T04:49:39.826 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:49:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:49:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:49:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:49:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-20T04:49:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:49:39.827 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:49:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:49:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-12-20T04:49:39.827 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:49:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:49:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-12-20T04:49:39.827 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:49:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:49:39.827 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:49:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:49:39.827 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:49:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42305sec preferred_lft 42305sec 2023-12-20T04:49:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-12-20T04:49:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:49:39.828 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:49:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:49:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:49:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:49:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::a8bc:1cff:fe40:54ea/64 scope link 2023-12-20T04:49:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:49:39.828 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:49:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-20T04:49:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c8e:c0ff:fe7a:bdc/64 scope link 2023-12-20T04:49:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:49:39.828 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:49:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether be:98:9a:6f:62:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-20T04:49:39.828 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::bc98:9aff:fe6f:6282/64 scope link 2023-12-20T04:49:39.829 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:49:39.829 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:39.829 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:49:39.896 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-12-20T04:49:39.898 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:39.898 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-12-20T04:49:39.956 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-12-20T04:49:39.956 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:49:39.956 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:49:39.956 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:49:39.956 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:49:39.957 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:39.957 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:49:39.957 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:49:39.957 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:49:39.957 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:49:39.957 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:49:39.957 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:49:40.055 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:40.056 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-20T04:49:40.071 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-20T04:49:40.071 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-20T04:49:40.071 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:49:40.071 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:40.072 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2023-12-20T04:49:40.139 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-20T04:49:40.140 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:49:40.140 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-20T04:49:40.194 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:49:40.194 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:49:40.194 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:49:40.249 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:49:40.316 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:49:40.317 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:49:40.382 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:49:40.383 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:49:40.383 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:40.383 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:49:40.438 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:49:40.438 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-20T04:49:40.481 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:49:40.507 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:49:40.507 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:49:40.565 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:2023-12-20T04:49:40.564+0000 7fbb6c640480 -1 init, newargv = 0x556ea0ab97a0 newargc=15 2023-12-20T04:49:40.565 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[91356]: starting ceph client 2023-12-20T04:49:40.569 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[91356]: starting fuse 2023-12-20T04:49:40.574 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:49:40.576 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:49:40.576 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:40.576 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:49:40.631 INFO:teuthology.orchestra.run.smithi187.stdout:41 2023-12-20T04:49:40.631 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:49:40.631 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:49:40.631 DEBUG:teuthology.orchestra.run.smithi187:> import glob 2023-12-20T04:49:40.631 DEBUG:teuthology.orchestra.run.smithi187:> import re 2023-12-20T04:49:40.631 DEBUG:teuthology.orchestra.run.smithi187:> import os 2023-12-20T04:49:40.631 DEBUG:teuthology.orchestra.run.smithi187:> import subprocess 2023-12-20T04:49:40.631 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:49:40.632 DEBUG:teuthology.orchestra.run.smithi187:> def _find_admin_socket(client_name): 2023-12-20T04:49:40.632 DEBUG:teuthology.orchestra.run.smithi187:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-20T04:49:40.632 DEBUG:teuthology.orchestra.run.smithi187:> files = glob.glob(asok_path) 2023-12-20T04:49:40.632 DEBUG:teuthology.orchestra.run.smithi187:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-20T04:49:40.632 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:49:40.632 DEBUG:teuthology.orchestra.run.smithi187:> # Given a non-glob path, it better be there 2023-12-20T04:49:40.632 DEBUG:teuthology.orchestra.run.smithi187:> if "*" not in asok_path: 2023-12-20T04:49:40.632 DEBUG:teuthology.orchestra.run.smithi187:> assert(len(files) == 1) 2023-12-20T04:49:40.632 DEBUG:teuthology.orchestra.run.smithi187:> return files[0] 2023-12-20T04:49:40.632 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:49:40.632 DEBUG:teuthology.orchestra.run.smithi187:> for f in files: 2023-12-20T04:49:40.632 DEBUG:teuthology.orchestra.run.smithi187:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:49:40.632 DEBUG:teuthology.orchestra.run.smithi187:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:49:40.632 DEBUG:teuthology.orchestra.run.smithi187:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:49:40.632 DEBUG:teuthology.orchestra.run.smithi187:> contents = proc_f.read() 2023-12-20T04:49:40.632 DEBUG:teuthology.orchestra.run.smithi187:> if mountpoint in contents: 2023-12-20T04:49:40.633 DEBUG:teuthology.orchestra.run.smithi187:> return f 2023-12-20T04:49:40.633 DEBUG:teuthology.orchestra.run.smithi187:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:49:40.633 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:49:40.633 DEBUG:teuthology.orchestra.run.smithi187:> print(_find_admin_socket("client.1")) 2023-12-20T04:49:40.633 DEBUG:teuthology.orchestra.run.smithi187:> ' 2023-12-20T04:49:40.746 INFO:teuthology.orchestra.run.smithi187.stdout:/var/run/ceph/ceph-client.1.91356.asok 2023-12-20T04:49:40.933 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.91356.asok 2023-12-20T04:49:40.934 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:40.934 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.91356.asok status 2023-12-20T04:49:41.069 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-12-20T04:49:41.069 INFO:teuthology.orchestra.run.smithi187.stdout: "metadata": { 2023-12-20T04:49:41.069 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:49:41.069 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:49:41.069 INFO:teuthology.orchestra.run.smithi187.stdout: "entity_id": "1", 2023-12-20T04:49:41.069 INFO:teuthology.orchestra.run.smithi187.stdout: "hostname": "smithi187", 2023-12-20T04:49:41.069 INFO:teuthology.orchestra.run.smithi187.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-20T04:49:41.069 INFO:teuthology.orchestra.run.smithi187.stdout: "pid": "91356", 2023-12-20T04:49:41.069 INFO:teuthology.orchestra.run.smithi187.stdout: "root": "/" 2023-12-20T04:49:41.069 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:49:41.069 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_count": 0, 2023-12-20T04:49:41.069 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_pinned_count": 0, 2023-12-20T04:49:41.069 INFO:teuthology.orchestra.run.smithi187.stdout: "id": 7210, 2023-12-20T04:49:41.070 INFO:teuthology.orchestra.run.smithi187.stdout: "inst": { 2023-12-20T04:49:41.070 INFO:teuthology.orchestra.run.smithi187.stdout: "name": { 2023-12-20T04:49:41.070 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "client", 2023-12-20T04:49:41.070 INFO:teuthology.orchestra.run.smithi187.stdout: "num": 7210 2023-12-20T04:49:41.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:49:41.070 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:49:41.070 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:49:41.070 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:49:41.070 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 3333228309 2023-12-20T04:49:41.070 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-12-20T04:49:41.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:49:41.070 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:49:41.070 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:49:41.070 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:49:41.070 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 3333228309 2023-12-20T04:49:41.070 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:49:41.071 INFO:teuthology.orchestra.run.smithi187.stdout: "inst_str": "client.7210 192.168.0.1:0/3333228309", 2023-12-20T04:49:41.071 INFO:teuthology.orchestra.run.smithi187.stdout: "addr_str": "192.168.0.1:0/3333228309", 2023-12-20T04:49:41.071 INFO:teuthology.orchestra.run.smithi187.stdout: "inode_count": 1, 2023-12-20T04:49:41.071 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_epoch": 57, 2023-12-20T04:49:41.071 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch": 153, 2023-12-20T04:49:41.071 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:49:41.071 INFO:teuthology.orchestra.run.smithi187.stdout: "blocklisted": false, 2023-12-20T04:49:41.071 INFO:teuthology.orchestra.run.smithi187.stdout: "fs_name": "cephfs" 2023-12-20T04:49:41.071 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-12-20T04:49:41.077 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:41.077 DEBUG:teuthology.orchestra.run.smithi187:> stat --file-system '--printf=%T 2023-12-20T04:49:41.077 DEBUG:teuthology.orchestra.run.smithi187:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-20T04:49:41.092 INFO:teuthology.orchestra.run.smithi187.stdout:fuseblk 2023-12-20T04:49:41.092 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-20T04:49:41.092 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:49:41.093 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:49:41.159 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:49:41.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.269+0000 7fad9a60b640 1 Processor -- start 2023-12-20T04:49:41.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.269+0000 7fad9a60b640 1 -- start start 2023-12-20T04:49:41.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.270+0000 7fad9a60b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad9415cef0 0x7fad940cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:41.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.270+0000 7fad9a60b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fad9415d2d0 0x7fad940ad2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:41.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.270+0000 7fad9a60b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fad940cd1e0 0x7fad9406bd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:41.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.270+0000 7fad9a60b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad940add30 con 0x7fad9415d2d0 2023-12-20T04:49:41.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.270+0000 7fad9a60b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fad940ae010 con 0x7fad940cd1e0 2023-12-20T04:49:41.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.270+0000 7fad9a60b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad94072d00 con 0x7fad9415cef0 2023-12-20T04:49:41.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.270+0000 7fad937fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fad9415d2d0 0x7fad940ad2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.270+0000 7fad937fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fad9415d2d0 0x7fad940ad2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42318/0 (socket says 172.21.15.132:42318) 2023-12-20T04:49:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.270+0000 7fad937fe640 1 -- 172.21.15.132:0/4210892949 learned_addr learned my addr 172.21.15.132:0/4210892949 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.270+0000 7fad98ba8640 1 --2- 172.21.15.132:0/4210892949 >> v2:172.21.15.187:3300/0 conn(0x7fad940cd1e0 0x7fad9406bd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.270+0000 7fad93fff640 1 --2- 172.21.15.132:0/4210892949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad9415cef0 0x7fad940cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.270+0000 7fad937fe640 1 -- 172.21.15.132:0/4210892949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad9415cef0 msgr2=0x7fad940cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.270+0000 7fad937fe640 1 --2- 172.21.15.132:0/4210892949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad9415cef0 0x7fad940cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.270+0000 7fad937fe640 1 -- 172.21.15.132:0/4210892949 >> v2:172.21.15.187:3300/0 conn(0x7fad940cd1e0 msgr2=0x7fad9406bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.270+0000 7fad937fe640 1 --2- 172.21.15.132:0/4210892949 >> v2:172.21.15.187:3300/0 conn(0x7fad940cd1e0 0x7fad9406bd00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.270+0000 7fad937fe640 1 -- 172.21.15.132:0/4210892949 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad94072fe0 con 0x7fad9415d2d0 2023-12-20T04:49:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.271+0000 7fad937fe640 1 --2- 172.21.15.132:0/4210892949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9415d2d0 0x7fad940ad2f0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fad940d01e0 tx=0x7fad8802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60119524c468f83 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.271+0000 7fad92ffd640 1 -- 172.21.15.132:0/4210892949 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88030860 con 0x7fad9415d2d0 2023-12-20T04:49:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.271+0000 7fad92ffd640 1 -- 172.21.15.132:0/4210892949 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad880309c0 con 0x7fad9415d2d0 2023-12-20T04:49:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.271+0000 7fad92ffd640 1 -- 172.21.15.132:0/4210892949 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad88030d50 con 0x7fad9415d2d0 2023-12-20T04:49:41.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.272+0000 7fad9a60b640 1 -- 172.21.15.132:0/4210892949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9415d2d0 msgr2=0x7fad940ad2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:41.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.272+0000 7fad9a60b640 1 --2- 172.21.15.132:0/4210892949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9415d2d0 0x7fad940ad2f0 secure :-1 s=READY pgs=1546 cs=0 l=1 rev1=1 crypto rx=0x7fad940d01e0 tx=0x7fad8802b9a0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.272+0000 7fad9a60b640 1 -- 172.21.15.132:0/4210892949 shutdown_connections 2023-12-20T04:49:41.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.272+0000 7fad9a60b640 1 --2- 172.21.15.132:0/4210892949 >> v2:172.21.15.187:3300/0 conn(0x7fad940cd1e0 0x7fad9406bd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.272+0000 7fad9a60b640 1 --2- 172.21.15.132:0/4210892949 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9415d2d0 0x7fad940ad2f0 unknown :-1 s=CLOSED pgs=1546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.272+0000 7fad9a60b640 1 --2- 172.21.15.132:0/4210892949 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad9415cef0 0x7fad940cecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.272+0000 7fad9a60b640 1 -- 172.21.15.132:0/4210892949 >> 172.21.15.132:0/4210892949 conn(0x7fad940cf330 msgr2=0x7fad940cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:41.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.272+0000 7fad9a60b640 1 -- 172.21.15.132:0/4210892949 shutdown_connections 2023-12-20T04:49:41.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.272+0000 7fad9a60b640 1 -- 172.21.15.132:0/4210892949 wait complete. 2023-12-20T04:49:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.273+0000 7fad9a60b640 1 Processor -- start 2023-12-20T04:49:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.273+0000 7fad9a60b640 1 -- start start 2023-12-20T04:49:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.274+0000 7fad9a60b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad940cd1e0 0x7fad94150ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.274+0000 7fad9a60b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad9415cef0 0x7fad9415d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.274+0000 7fad9a60b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9415d2d0 0x7fad94156050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.274+0000 7fad9a60b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad94151850 con 0x7fad9415d2d0 2023-12-20T04:49:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.274+0000 7fad9a60b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad940b3970 con 0x7fad9415cef0 2023-12-20T04:49:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.274+0000 7fad9a60b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad94155290 con 0x7fad940cd1e0 2023-12-20T04:49:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.274+0000 7fad98ba8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9415d2d0 0x7fad94156050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.274+0000 7fad98ba8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9415d2d0 0x7fad94156050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42330/0 (socket says 172.21.15.132:42330) 2023-12-20T04:49:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.274+0000 7fad98ba8640 1 -- 172.21.15.132:0/2461617719 learned_addr learned my addr 172.21.15.132:0/2461617719 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.274+0000 7fad937fe640 1 --2- 172.21.15.132:0/2461617719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad9415cef0 0x7fad9415d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.274+0000 7fad93fff640 1 --2- 172.21.15.132:0/2461617719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad940cd1e0 0x7fad94150ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.274+0000 7fad98ba8640 1 -- 172.21.15.132:0/2461617719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad940cd1e0 msgr2=0x7fad94150ca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.274+0000 7fad98ba8640 1 --2- 172.21.15.132:0/2461617719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad940cd1e0 0x7fad94150ca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.274+0000 7fad98ba8640 1 -- 172.21.15.132:0/2461617719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad9415cef0 msgr2=0x7fad9415d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.274+0000 7fad98ba8640 1 --2- 172.21.15.132:0/2461617719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad9415cef0 0x7fad9415d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.274+0000 7fad98ba8640 1 -- 172.21.15.132:0/2461617719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad880094d0 con 0x7fad9415d2d0 2023-12-20T04:49:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.275+0000 7fad98ba8640 1 --2- 172.21.15.132:0/2461617719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9415d2d0 0x7fad94156050 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00efc0 tx=0x7fad8c00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.275+0000 7fad90ff9640 1 -- 172.21.15.132:0/2461617719 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c014480 con 0x7fad9415d2d0 2023-12-20T04:49:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.275+0000 7fad90ff9640 1 -- 172.21.15.132:0/2461617719 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad8c00f040 con 0x7fad9415d2d0 2023-12-20T04:49:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.275+0000 7fad90ff9640 1 -- 172.21.15.132:0/2461617719 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad8c014820 con 0x7fad9415d2d0 2023-12-20T04:49:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.275+0000 7fad9a60b640 1 -- 172.21.15.132:0/2461617719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad94155570 con 0x7fad9415d2d0 2023-12-20T04:49:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.275+0000 7fad9a60b640 1 -- 172.21.15.132:0/2461617719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad94155b30 con 0x7fad9415d2d0 2023-12-20T04:49:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.276+0000 7fad9a60b640 1 -- 172.21.15.132:0/2461617719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad9404e840 con 0x7fad9415d2d0 2023-12-20T04:49:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.276+0000 7fad90ff9640 1 -- 172.21.15.132:0/2461617719 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fad8c014980 con 0x7fad9415d2d0 2023-12-20T04:49:41.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.277+0000 7fad90ff9640 1 --2- 172.21.15.132:0/2461617719 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fad8006a460 0x7fad8006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:41.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.277+0000 7fad90ff9640 1 -- 172.21.15.132:0/2461617719 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fad8c0893a0 con 0x7fad9415d2d0 2023-12-20T04:49:41.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.277+0000 7fad93fff640 1 --2- 172.21.15.132:0/2461617719 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fad8006a460 0x7fad8006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:41.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.277+0000 7fad93fff640 1 --2- 172.21.15.132:0/2461617719 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fad8006a460 0x7fad8006c920 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fad84009ac0 tx=0x7fad84009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:41.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.281+0000 7fad90ff9640 1 -- 172.21.15.132:0/2461617719 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fad8c0549b0 con 0x7fad9415d2d0 2023-12-20T04:49:41.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.480+0000 7fad9a60b640 1 -- 172.21.15.132:0/2461617719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fad940b52b0 con 0x7fad9415d2d0 2023-12-20T04:49:41.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.480+0000 7fad90ff9640 1 -- 172.21.15.132:0/2461617719 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fad8c057fd0 con 0x7fad9415d2d0 2023-12-20T04:49:41.482 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:49:41.482 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":57,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/756703470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":756703470},{"type":"v1","addr":"172.21.15.187:6834","nonce":756703470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2177183802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2177183802},{"type":"v1","addr":"172.21.15.187:6835","nonce":2177183802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":8337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/390345313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":390345313},{"type":"v1","addr":"172.21.15.132:6837","nonce":390345313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:49:33.211903+0000","modified":"2023-12-20T04:49:35.219491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8340":{"gid":8340,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/3157504695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3157504695},{"type":"v1","addr":"172.21.15.132:6836","nonce":3157504695}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-20T04:49:41.483 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 57 2023-12-20T04:49:41.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.482+0000 7fad9a60b640 1 -- 172.21.15.132:0/2461617719 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fad8006a460 msgr2=0x7fad8006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.482+0000 7fad9a60b640 1 --2- 172.21.15.132:0/2461617719 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fad8006a460 0x7fad8006c920 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7fad84009ac0 tx=0x7fad84009190 comp rx=0 tx=0).stop 2023-12-20T04:49:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.482+0000 7fad9a60b640 1 -- 172.21.15.132:0/2461617719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9415d2d0 msgr2=0x7fad94156050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.482+0000 7fad9a60b640 1 --2- 172.21.15.132:0/2461617719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9415d2d0 0x7fad94156050 secure :-1 s=READY pgs=1547 cs=0 l=1 rev1=1 crypto rx=0x7fad8c00efc0 tx=0x7fad8c00c490 comp rx=0 tx=0).stop 2023-12-20T04:49:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.482+0000 7fad9a60b640 1 -- 172.21.15.132:0/2461617719 shutdown_connections 2023-12-20T04:49:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.482+0000 7fad9a60b640 1 --2- 172.21.15.132:0/2461617719 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fad8006a460 0x7fad8006c920 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.482+0000 7fad9a60b640 1 --2- 172.21.15.132:0/2461617719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad9415d2d0 0x7fad94156050 unknown :-1 s=CLOSED pgs=1547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.482+0000 7fad9a60b640 1 --2- 172.21.15.132:0/2461617719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad9415cef0 0x7fad9415d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.482+0000 7fad9a60b640 1 --2- 172.21.15.132:0/2461617719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad940cd1e0 0x7fad94150ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.482+0000 7fad9a60b640 1 -- 172.21.15.132:0/2461617719 >> 172.21.15.132:0/2461617719 conn(0x7fad940cf330 msgr2=0x7fad94157540 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.482+0000 7fad9a60b640 1 -- 172.21.15.132:0/2461617719 shutdown_connections 2023-12-20T04:49:41.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.482+0000 7fad9a60b640 1 -- 172.21.15.132:0/2461617719 wait complete. 2023-12-20T04:49:41.495 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-20T04:49:41.610 INFO:teuthology.orchestra.run.smithi132.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":8340,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":8.3873676249999995,"mdsmap_epoch":57,"osdmap_epoch":153,"osdmap_epoch_barrier":153,"uptime":12.960659279} 2023-12-20T04:49:41.610 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 8340, "mdsmap_epoch": 57, "osdmap_epoch": 153, "osdmap_epoch_barrier": 153, "rank_uptime": 8.387367625, "state": "up:active", "uptime": 12.960659279, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:49:41.611 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-20T04:49:41.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.712+0000 7fcf1c9d9640 1 Processor -- start 2023-12-20T04:49:41.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.712+0000 7fcf1c9d9640 1 -- start start 2023-12-20T04:49:41.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.713+0000 7fcf1c9d9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcf1815b1a0 0x7fcf180cd690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:41.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.713+0000 7fcf1c9d9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf180cb210 con 0x7fcf1806fc50 2023-12-20T04:49:41.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.713+0000 7fcf1c9d9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf180cb4f0 con 0x7fcf180b0d40 2023-12-20T04:49:41.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.713+0000 7fcf1c9d9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf180cb7d0 con 0x7fcf1815b1a0 2023-12-20T04:49:41.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.713+0000 7fcf16d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcf1806fc50 0x7fcf180cdbd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:43168/0 (socket says 172.21.15.132:43168) 2023-12-20T04:49:41.718 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.713+0000 7fcf16d9d640 1 -- 172.21.15.132:0/2673673981 learned_addr learned my addr 172.21.15.132:0/2673673981 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:49:41.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.713+0000 7fcf0ffff640 1 --2- 172.21.15.132:0/2673673981 >> v2:172.21.15.187:3300/0 conn(0x7fcf1815b1a0 0x7fcf180cd690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:41.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.713+0000 7fcf15d9b640 1 -- 172.21.15.132:0/2673673981 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1745776149 0 0) 0x7fcf180cb210 con 0x7fcf1806fc50 2023-12-20T04:49:41.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.713+0000 7fcf15d9b640 1 -- 172.21.15.132:0/2673673981 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf04003520 con 0x7fcf1806fc50 2023-12-20T04:49:41.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.713+0000 7fcf15d9b640 1 -- 172.21.15.132:0/2673673981 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2119612122 0 0) 0x7fcf04003520 con 0x7fcf1806fc50 2023-12-20T04:49:41.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.713+0000 7fcf15d9b640 1 -- 172.21.15.132:0/2673673981 >> v2:172.21.15.187:3300/0 conn(0x7fcf1815b1a0 msgr2=0x7fcf180cd690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:41.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.713+0000 7fcf15d9b640 1 --2- 172.21.15.132:0/2673673981 >> v2:172.21.15.187:3300/0 conn(0x7fcf1815b1a0 0x7fcf180cd690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.713+0000 7fcf15d9b640 1 -- 172.21.15.132:0/2673673981 >> v1:172.21.15.187:6789/0 conn(0x7fcf180b0d40 legacy=0x7fcf180b1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:41.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.713+0000 7fcf15d9b640 1 -- 172.21.15.132:0/2673673981 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf180cce90 con 0x7fcf1806fc50 2023-12-20T04:49:41.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.713+0000 7fcf15d9b640 1 -- 172.21.15.132:0/2673673981 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fcf100019f0 con 0x7fcf1806fc50 2023-12-20T04:49:41.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.713+0000 7fcf15d9b640 1 -- 172.21.15.132:0/2673673981 >> v1:172.21.15.132:6789/0 conn(0x7fcf1806fc50 legacy=0x7fcf180cdbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:41.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.713+0000 7fcf15d9b640 1 --2- 172.21.15.132:0/2673673981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf04003970 0x7fcf04003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:41.719 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.714+0000 7fcf15d9b640 1 --2- 172.21.15.132:0/2673673981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf040047c0 0x7fcf04004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:41.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.714+0000 7fcf15d9b640 1 --2- 172.21.15.132:0/2673673981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf04005180 0x7fcf0400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:41.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.714+0000 7fcf15d9b640 1 -- 172.21.15.132:0/2673673981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf180cb7d0 con 0x7fcf04005180 2023-12-20T04:49:41.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.714+0000 7fcf15d9b640 1 -- 172.21.15.132:0/2673673981 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0400c020 con 0x7fcf04003970 2023-12-20T04:49:41.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.714+0000 7fcf15d9b640 1 -- 172.21.15.132:0/2673673981 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf0400c1e0 con 0x7fcf040047c0 2023-12-20T04:49:41.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.714+0000 7fcf1659c640 1 --2- 172.21.15.132:0/2673673981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf04003970 0x7fcf04003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:41.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.714+0000 7fcf16d9d640 1 --2- 172.21.15.132:0/2673673981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf04005180 0x7fcf0400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:41.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.714+0000 7fcf0ffff640 1 --2- 172.21.15.132:0/2673673981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf040047c0 0x7fcf04004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:41.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.714+0000 7fcf16d9d640 1 -- 172.21.15.132:0/2673673981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf040047c0 msgr2=0x7fcf04004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:41.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.714+0000 7fcf16d9d640 1 --2- 172.21.15.132:0/2673673981 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf040047c0 0x7fcf04004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.714+0000 7fcf16d9d640 1 -- 172.21.15.132:0/2673673981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf04003970 msgr2=0x7fcf04003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:49:41.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.714+0000 7fcf16d9d640 1 --2- 172.21.15.132:0/2673673981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf04003970 0x7fcf04003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.714+0000 7fcf16d9d640 1 -- 172.21.15.132:0/2673673981 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf04003520 con 0x7fcf04005180 2023-12-20T04:49:41.720 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.714+0000 7fcf1659c640 1 --2- 172.21.15.132:0/2673673981 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf04003970 0x7fcf04003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:49:41.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.715+0000 7fcf16d9d640 1 -- 172.21.15.132:0/2673673981 reap_dead start 2023-12-20T04:49:41.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.715+0000 7fcf16d9d640 1 --2- 172.21.15.132:0/2673673981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf04005180 0x7fcf0400b980 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000a830 tx=0x7fcf040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d12dc5f6e3aee5b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:41.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.715+0000 7fcf15d9b640 1 -- 172.21.15.132:0/2673673981 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf100072d0 con 0x7fcf04005180 2023-12-20T04:49:41.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.715+0000 7fcf15d9b640 1 -- 172.21.15.132:0/2673673981 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf1002f070 con 0x7fcf04005180 2023-12-20T04:49:41.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.715+0000 7fcf15d9b640 1 -- 172.21.15.132:0/2673673981 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf100076b0 con 0x7fcf04005180 2023-12-20T04:49:41.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.715+0000 7fcf1c9d9640 1 -- 172.21.15.132:0/2673673981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf04005180 msgr2=0x7fcf0400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:41.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.715+0000 7fcf1c9d9640 1 --2- 172.21.15.132:0/2673673981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf04005180 0x7fcf0400b980 secure :-1 s=READY pgs=1549 cs=0 l=1 rev1=1 crypto rx=0x7fcf1000a830 tx=0x7fcf040057f0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.715+0000 7fcf1c9d9640 1 -- 172.21.15.132:0/2673673981 shutdown_connections 2023-12-20T04:49:41.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.715+0000 7fcf1c9d9640 1 --2- 172.21.15.132:0/2673673981 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf04005180 0x7fcf0400b980 unknown :-1 s=CLOSED pgs=1549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.715+0000 7fcf1c9d9640 1 -- 172.21.15.132:0/2673673981 >> 172.21.15.132:0/2673673981 conn(0x7fcf180cbd40 msgr2=0x7fcf180cc150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:41.721 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.715+0000 7fcf1c9d9640 1 -- 172.21.15.132:0/2673673981 shutdown_connections 2023-12-20T04:49:41.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.715+0000 7fcf1c9d9640 1 -- 172.21.15.132:0/2673673981 wait complete. 2023-12-20T04:49:41.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.717+0000 7fcf1c9d9640 1 Processor -- start 2023-12-20T04:49:41.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.717+0000 7fcf1c9d9640 1 -- start start 2023-12-20T04:49:41.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.717+0000 7fcf1c9d9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf04005180 0x7fcf1809c350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:41.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.717+0000 7fcf1c9d9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf181f3e40 0x7fcf181f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:41.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.717+0000 7fcf1c9d9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf1814be40 0x7fcf1814c2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:41.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.717+0000 7fcf1c9d9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf181f4800 con 0x7fcf181f3e40 2023-12-20T04:49:41.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.717+0000 7fcf1c9d9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf180c5010 con 0x7fcf04005180 2023-12-20T04:49:41.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.717+0000 7fcf1c9d9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf180c52f0 con 0x7fcf1814be40 2023-12-20T04:49:41.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.717+0000 7fcf0ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf181f3e40 0x7fcf181f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:41.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.717+0000 7fcf0ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf181f3e40 0x7fcf181f42c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42348/0 (socket says 172.21.15.132:42348) 2023-12-20T04:49:41.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.717+0000 7fcf0ffff640 1 -- 172.21.15.132:0/3272555311 learned_addr learned my addr 172.21.15.132:0/3272555311 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:49:41.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.718+0000 7fcf16d9d640 1 --2- 172.21.15.132:0/3272555311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf1814be40 0x7fcf1814c2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:41.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.718+0000 7fcf1659c640 1 --2- 172.21.15.132:0/3272555311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf04005180 0x7fcf1809c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:41.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.718+0000 7fcf0ffff640 1 -- 172.21.15.132:0/3272555311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf1814be40 msgr2=0x7fcf1814c2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:41.725 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.718+0000 7fcf0ffff640 1 --2- 172.21.15.132:0/3272555311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf1814be40 0x7fcf1814c2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.718+0000 7fcf0ffff640 1 -- 172.21.15.132:0/3272555311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf04005180 msgr2=0x7fcf1809c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:41.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.718+0000 7fcf0ffff640 1 --2- 172.21.15.132:0/3272555311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf04005180 0x7fcf1809c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.718+0000 7fcf0ffff640 1 -- 172.21.15.132:0/3272555311 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf180c55d0 con 0x7fcf181f3e40 2023-12-20T04:49:41.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.718+0000 7fcf0ffff640 1 --2- 172.21.15.132:0/3272555311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf181f3e40 0x7fcf181f42c0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fcf000118e0 tx=0x7fcf00011da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:41.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.718+0000 7fcf0effd640 1 -- 172.21.15.132:0/3272555311 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf0000faf0 con 0x7fcf181f3e40 2023-12-20T04:49:41.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.718+0000 7fcf0effd640 1 -- 172.21.15.132:0/3272555311 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf0000fc50 con 0x7fcf181f3e40 2023-12-20T04:49:41.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.718+0000 7fcf1c9d9640 1 -- 172.21.15.132:0/3272555311 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf180c58b0 con 0x7fcf181f3e40 2023-12-20T04:49:41.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.718+0000 7fcf0effd640 1 -- 172.21.15.132:0/3272555311 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf00014440 con 0x7fcf181f3e40 2023-12-20T04:49:41.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.718+0000 7fcf1c9d9640 1 -- 172.21.15.132:0/3272555311 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf1809ca70 con 0x7fcf181f3e40 2023-12-20T04:49:41.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.719+0000 7fcf1c9d9640 1 -- 172.21.15.132:0/3272555311 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf1804e840 con 0x7fcf181f3e40 2023-12-20T04:49:41.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.719+0000 7fcf0effd640 1 -- 172.21.15.132:0/3272555311 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcf000145a0 con 0x7fcf181f3e40 2023-12-20T04:49:41.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.720+0000 7fcf0effd640 1 --2- 172.21.15.132:0/3272555311 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcef806a430 0x7fcef806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:49:41.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.720+0000 7fcf0effd640 1 -- 172.21.15.132:0/3272555311 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(153..153 src has 1..153) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcf00089090 con 0x7fcf181f3e40 2023-12-20T04:49:41.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.720+0000 7fcf1659c640 1 --2- 172.21.15.132:0/3272555311 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcef806a430 0x7fcef806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:49:41.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.720+0000 7fcf1659c640 1 --2- 172.21.15.132:0/3272555311 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcef806a430 0x7fcef806c8f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcf08000c00 tx=0x7fcf08009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:49:41.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.724+0000 7fcf0effd640 1 -- 172.21.15.132:0/3272555311 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcf00054730 con 0x7fcf181f3e40 2023-12-20T04:49:41.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.890+0000 7fcf1c9d9640 1 -- 172.21.15.132:0/3272555311 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7fcf181573b0 con 0x7fcf181f3e40 2023-12-20T04:49:41.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.920+0000 7fcf0effd640 1 -- 172.21.15.132:0/3272555311 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v154) v1 ==== 181+0+0 (secure 0 0 0) 0x7fcf00057d50 con 0x7fcf181f3e40 2023-12-20T04:49:41.922 INFO:teuthology.orchestra.run.smithi132.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-20T04:49:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.922+0000 7fcf1c9d9640 1 -- 172.21.15.132:0/3272555311 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcef806a430 msgr2=0x7fcef806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.922+0000 7fcf1c9d9640 1 --2- 172.21.15.132:0/3272555311 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcef806a430 0x7fcef806c8f0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7fcf08000c00 tx=0x7fcf08009040 comp rx=0 tx=0).stop 2023-12-20T04:49:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.922+0000 7fcf1c9d9640 1 -- 172.21.15.132:0/3272555311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf181f3e40 msgr2=0x7fcf181f42c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:49:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.922+0000 7fcf1c9d9640 1 --2- 172.21.15.132:0/3272555311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf181f3e40 0x7fcf181f42c0 secure :-1 s=READY pgs=1550 cs=0 l=1 rev1=1 crypto rx=0x7fcf000118e0 tx=0x7fcf00011da0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.922+0000 7fcf1c9d9640 1 -- 172.21.15.132:0/3272555311 shutdown_connections 2023-12-20T04:49:41.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.922+0000 7fcf1c9d9640 1 --2- 172.21.15.132:0/3272555311 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcef806a430 0x7fcef806c8f0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.922+0000 7fcf1c9d9640 1 --2- 172.21.15.132:0/3272555311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf1814be40 0x7fcf1814c2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.922+0000 7fcf1c9d9640 1 --2- 172.21.15.132:0/3272555311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf181f3e40 0x7fcf181f42c0 unknown :-1 s=CLOSED pgs=1550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.922+0000 7fcf1c9d9640 1 --2- 172.21.15.132:0/3272555311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf04005180 0x7fcf1809c350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:49:41.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.922+0000 7fcf1c9d9640 1 -- 172.21.15.132:0/3272555311 >> 172.21.15.132:0/3272555311 conn(0x7fcf180cbd40 msgr2=0x7fcf1815a300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:49:41.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.922+0000 7fcf1c9d9640 1 -- 172.21.15.132:0/3272555311 shutdown_connections 2023-12-20T04:49:41.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:49:41.922+0000 7fcf1c9d9640 1 -- 172.21.15.132:0/3272555311 wait complete. 2023-12-20T04:49:41.935 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-20T04:49:42.046 INFO:teuthology.orchestra.run.smithi132.stdout:{"osd_mon_report_interval":"5"} 2023-12-20T04:49:42.047 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-20T04:49:42.047 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-20T04:49:42.154 INFO:teuthology.orchestra.run.smithi132.stdout:{"mon_tick_interval":"5"} 2023-12-20T04:49:42.154 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-20T04:49:42.155 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-12-20T04:49:42.155 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:49:42.155 DEBUG:teuthology.orchestra.run.smithi132:> import time 2023-12-20T04:49:42.155 DEBUG:teuthology.orchestra.run.smithi132:> import datetime 2023-12-20T04:49:42.155 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:49:42.155 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:49:42.155 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:49:42.155 DEBUG:teuthology.orchestra.run.smithi132:> # Write some buffered data through before going full, all should be well 2023-12-20T04:49:42.155 DEBUG:teuthology.orchestra.run.smithi132:> print("writing some data through which we expect to succeed") 2023-12-20T04:49:42.155 DEBUG:teuthology.orchestra.run.smithi132:> bytes = 0 2023-12-20T04:49:42.155 DEBUG:teuthology.orchestra.run.smithi132:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-20T04:49:42.155 DEBUG:teuthology.orchestra.run.smithi132:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-20T04:49:42.155 DEBUG:teuthology.orchestra.run.smithi132:> bytes += os.write(f, b'"'"'a'"'"' * 512 * 1024) 2023-12-20T04:49:42.155 DEBUG:teuthology.orchestra.run.smithi132:> os.fsync(f) 2023-12-20T04:49:42.156 DEBUG:teuthology.orchestra.run.smithi132:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-20T04:49:42.156 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:49:42.156 DEBUG:teuthology.orchestra.run.smithi132:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-20T04:49:42.156 DEBUG:teuthology.orchestra.run.smithi132:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-20T04:49:42.156 DEBUG:teuthology.orchestra.run.smithi132:> # buffered IO, the error should always only appear from fsync and not 2023-12-20T04:49:42.156 DEBUG:teuthology.orchestra.run.smithi132:> # from write 2023-12-20T04:49:42.156 DEBUG:teuthology.orchestra.run.smithi132:> full = False 2023-12-20T04:49:42.156 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:49:42.156 DEBUG:teuthology.orchestra.run.smithi132:> for n in range(0, int(32 * 0.9)): 2023-12-20T04:49:42.156 DEBUG:teuthology.orchestra.run.smithi132:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-20T04:49:42.156 DEBUG:teuthology.orchestra.run.smithi132:> print("wrote {0} bytes via buffered write, may repeat".format(bytes)) 2023-12-20T04:49:42.156 DEBUG:teuthology.orchestra.run.smithi132:> print("done writing {0} bytes".format(bytes)) 2023-12-20T04:49:42.156 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:49:42.156 DEBUG:teuthology.orchestra.run.smithi132:> # OK, now we should sneak in under the full condition 2023-12-20T04:49:42.156 DEBUG:teuthology.orchestra.run.smithi132:> # due to the time it takes the OSDs to report to the 2023-12-20T04:49:42.156 DEBUG:teuthology.orchestra.run.smithi132:> # mons, and get a successful fsync on our full-making data 2023-12-20T04:49:42.156 DEBUG:teuthology.orchestra.run.smithi132:> os.fsync(f) 2023-12-20T04:49:42.157 DEBUG:teuthology.orchestra.run.smithi132:> print("successfully fsync'"'"'ed prior to getting full state reported") 2023-12-20T04:49:42.157 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:49:42.157 DEBUG:teuthology.orchestra.run.smithi132:> # buffered write, add more dirty data to the buffer 2023-12-20T04:49:42.157 DEBUG:teuthology.orchestra.run.smithi132:> print("starting buffered write") 2023-12-20T04:49:42.157 DEBUG:teuthology.orchestra.run.smithi132:> try: 2023-12-20T04:49:42.157 DEBUG:teuthology.orchestra.run.smithi132:> for n in range(0, int(32 * 0.2)): 2023-12-20T04:49:42.157 DEBUG:teuthology.orchestra.run.smithi132:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-20T04:49:42.157 DEBUG:teuthology.orchestra.run.smithi132:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-20T04:49:42.157 DEBUG:teuthology.orchestra.run.smithi132:> time.sleep(15.0) 2023-12-20T04:49:42.157 DEBUG:teuthology.orchestra.run.smithi132:> except OSError: 2023-12-20T04:49:42.157 DEBUG:teuthology.orchestra.run.smithi132:> pass; 2023-12-20T04:49:42.157 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:49:42.157 DEBUG:teuthology.orchestra.run.smithi132:> print("wrote, now waiting 30s and then doing a close we expect to fail") 2023-12-20T04:49:42.157 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:49:42.157 DEBUG:teuthology.orchestra.run.smithi132:> # Wait long enough for a background flush that should fail 2023-12-20T04:49:42.157 DEBUG:teuthology.orchestra.run.smithi132:> time.sleep(30) 2023-12-20T04:49:42.158 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:49:42.158 DEBUG:teuthology.orchestra.run.smithi132:> if True: 2023-12-20T04:49:42.158 DEBUG:teuthology.orchestra.run.smithi132:> # ...and check that the failed background flush is reflected in fclose 2023-12-20T04:49:42.158 DEBUG:teuthology.orchestra.run.smithi132:> try: 2023-12-20T04:49:42.158 DEBUG:teuthology.orchestra.run.smithi132:> os.close(f) 2023-12-20T04:49:42.158 DEBUG:teuthology.orchestra.run.smithi132:> except OSError: 2023-12-20T04:49:42.158 DEBUG:teuthology.orchestra.run.smithi132:> print("close() returned an error as expected") 2023-12-20T04:49:42.158 DEBUG:teuthology.orchestra.run.smithi132:> else: 2023-12-20T04:49:42.158 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("close() failed to raise error") 2023-12-20T04:49:42.158 DEBUG:teuthology.orchestra.run.smithi132:> else: 2023-12-20T04:49:42.158 DEBUG:teuthology.orchestra.run.smithi132:> # The kernel cephfs client does not raise errors on fclose 2023-12-20T04:49:42.158 DEBUG:teuthology.orchestra.run.smithi132:> os.close(f) 2023-12-20T04:49:42.158 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:49:42.158 DEBUG:teuthology.orchestra.run.smithi132:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-20T04:49:42.158 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:49:48.353 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:49:48.356 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:50:18.417 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:50:18.420 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:50:48.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:50:48.574 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:51:18.644 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:51:18.648 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:51:28.832 INFO:teuthology.orchestra.run.smithi132.stdout:writing some data through which we expect to succeed 2023-12-20T04:51:28.832 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-20T04:51:28.832 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 1572864 bytes via buffered write, may repeat 2023-12-20T04:51:28.832 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 2621440 bytes via buffered write, may repeat 2023-12-20T04:51:28.832 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 3670016 bytes via buffered write, may repeat 2023-12-20T04:51:28.832 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 4718592 bytes via buffered write, may repeat 2023-12-20T04:51:28.832 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 5767168 bytes via buffered write, may repeat 2023-12-20T04:51:28.832 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 6815744 bytes via buffered write, may repeat 2023-12-20T04:51:28.832 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 7864320 bytes via buffered write, may repeat 2023-12-20T04:51:28.832 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 8912896 bytes via buffered write, may repeat 2023-12-20T04:51:28.832 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 9961472 bytes via buffered write, may repeat 2023-12-20T04:51:28.833 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 11010048 bytes via buffered write, may repeat 2023-12-20T04:51:28.833 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 12058624 bytes via buffered write, may repeat 2023-12-20T04:51:28.833 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 13107200 bytes via buffered write, may repeat 2023-12-20T04:51:28.833 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 14155776 bytes via buffered write, may repeat 2023-12-20T04:51:28.833 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 15204352 bytes via buffered write, may repeat 2023-12-20T04:51:28.833 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 16252928 bytes via buffered write, may repeat 2023-12-20T04:51:28.833 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 17301504 bytes via buffered write, may repeat 2023-12-20T04:51:28.833 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 18350080 bytes via buffered write, may repeat 2023-12-20T04:51:28.833 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 19398656 bytes via buffered write, may repeat 2023-12-20T04:51:28.833 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 20447232 bytes via buffered write, may repeat 2023-12-20T04:51:28.833 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 21495808 bytes via buffered write, may repeat 2023-12-20T04:51:28.833 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 22544384 bytes via buffered write, may repeat 2023-12-20T04:51:28.833 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 23592960 bytes via buffered write, may repeat 2023-12-20T04:51:28.833 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 24641536 bytes via buffered write, may repeat 2023-12-20T04:51:28.833 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 25690112 bytes via buffered write, may repeat 2023-12-20T04:51:28.834 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 26738688 bytes via buffered write, may repeat 2023-12-20T04:51:28.834 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 27787264 bytes via buffered write, may repeat 2023-12-20T04:51:28.834 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 28835840 bytes via buffered write, may repeat 2023-12-20T04:51:28.834 INFO:teuthology.orchestra.run.smithi132.stdout:wrote 29884416 bytes via buffered write, may repeat 2023-12-20T04:51:28.834 INFO:teuthology.orchestra.run.smithi132.stdout:done writing 29884416 bytes 2023-12-20T04:51:28.834 INFO:teuthology.orchestra.run.smithi132.stdout:successfully fsync'ed prior to getting full state reported 2023-12-20T04:51:28.834 INFO:teuthology.orchestra.run.smithi132.stdout:starting buffered write 2023-12-20T04:51:28.834 INFO:teuthology.orchestra.run.smithi132.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-20T04:51:28.834 INFO:teuthology.orchestra.run.smithi132.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-20T04:51:28.834 INFO:teuthology.orchestra.run.smithi132.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-20T04:51:28.834 INFO:teuthology.orchestra.run.smithi132.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-20T04:51:28.834 INFO:teuthology.orchestra.run.smithi132.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-20T04:51:28.834 INFO:teuthology.orchestra.run.smithi132.stdout:wrote, now waiting 30s and then doing a close we expect to fail 2023-12-20T04:51:28.834 INFO:teuthology.orchestra.run.smithi132.stdout:close() returned an error as expected 2023-12-20T04:51:28.961 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:51:28.961 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:51:29.002 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:51:29.047 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:51:29.048 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:51:29.048 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:51:29.065 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:51:29.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.212+0000 7f4c985bf640 1 Processor -- start 2023-12-20T04:51:29.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.212+0000 7f4c985bf640 1 -- start start 2023-12-20T04:51:29.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.213+0000 7f4c985bf640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4c90159b50 0x7f4c900c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.213+0000 7f4c985bf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c9015e530 0x7f4c9006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.213+0000 7f4c985bf640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4c9006c240 0x7f4c9006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.213+0000 7f4c985bf640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c9006cc10 con 0x7f4c90159b50 2023-12-20T04:51:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.213+0000 7f4c985bf640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4c900caa60 con 0x7f4c9006c240 2023-12-20T04:51:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.213+0000 7f4c985bf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c900ccc90 con 0x7f4c9015e530 2023-12-20T04:51:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.213+0000 7f4c9635b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4c90159b50 0x7f4c900c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.213+0000 7f4c9635b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4c90159b50 0x7f4c900c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35294/0 (socket says 172.21.15.132:35294) 2023-12-20T04:51:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.213+0000 7f4c9635b640 1 -- 172.21.15.132:0/3871095358 learned_addr learned my addr 172.21.15.132:0/3871095358 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.213+0000 7f4c96b5c640 1 --2- 172.21.15.132:0/3871095358 >> v2:172.21.15.187:3300/0 conn(0x7f4c9006c240 0x7f4c9006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.213+0000 7f4c95b5a640 1 --2- 172.21.15.132:0/3871095358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c9015e530 0x7f4c9006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.213+0000 7f4c9635b640 1 -- 172.21.15.132:0/3871095358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c9015e530 msgr2=0x7f4c9006fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.213+0000 7f4c9635b640 1 --2- 172.21.15.132:0/3871095358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c9015e530 0x7f4c9006fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.213+0000 7f4c9635b640 1 -- 172.21.15.132:0/3871095358 >> v2:172.21.15.187:3300/0 conn(0x7f4c9006c240 msgr2=0x7f4c9006c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.213+0000 7f4c9635b640 1 --2- 172.21.15.132:0/3871095358 >> v2:172.21.15.187:3300/0 conn(0x7f4c9006c240 0x7f4c9006c6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.213+0000 7f4c9635b640 1 -- 172.21.15.132:0/3871095358 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c900ccf30 con 0x7f4c90159b50 2023-12-20T04:51:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.213+0000 7f4c96b5c640 1 --2- 172.21.15.132:0/3871095358 >> v2:172.21.15.187:3300/0 conn(0x7f4c9006c240 0x7f4c9006c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:29.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.214+0000 7f4c9635b640 1 --2- 172.21.15.132:0/3871095358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c90159b50 0x7f4c900c9930 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f4c900c5ce0 tx=0x7f4c8002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8aefd175e184482b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:29.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.214+0000 7f4c95359640 1 -- 172.21.15.132:0/3871095358 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c80031870 con 0x7f4c90159b50 2023-12-20T04:51:29.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.214+0000 7f4c95359640 1 -- 172.21.15.132:0/3871095358 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c800319d0 con 0x7f4c90159b50 2023-12-20T04:51:29.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.214+0000 7f4c95359640 1 -- 172.21.15.132:0/3871095358 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c80031d60 con 0x7f4c90159b50 2023-12-20T04:51:29.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.214+0000 7f4c985bf640 1 -- 172.21.15.132:0/3871095358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c90159b50 msgr2=0x7f4c900c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:29.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.214+0000 7f4c985bf640 1 --2- 172.21.15.132:0/3871095358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c90159b50 0x7f4c900c9930 secure :-1 s=READY pgs=1551 cs=0 l=1 rev1=1 crypto rx=0x7f4c900c5ce0 tx=0x7f4c8002b910 comp rx=0 tx=0).stop 2023-12-20T04:51:29.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.215+0000 7f4c985bf640 1 -- 172.21.15.132:0/3871095358 shutdown_connections 2023-12-20T04:51:29.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.215+0000 7f4c985bf640 1 --2- 172.21.15.132:0/3871095358 >> v2:172.21.15.187:3300/0 conn(0x7f4c9006c240 0x7f4c9006c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.215+0000 7f4c985bf640 1 --2- 172.21.15.132:0/3871095358 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c9015e530 0x7f4c9006fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.215+0000 7f4c985bf640 1 --2- 172.21.15.132:0/3871095358 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c90159b50 0x7f4c900c9930 unknown :-1 s=CLOSED pgs=1551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.215+0000 7f4c985bf640 1 -- 172.21.15.132:0/3871095358 >> 172.21.15.132:0/3871095358 conn(0x7f4c900ced10 msgr2=0x7f4c900cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:29.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.215+0000 7f4c985bf640 1 -- 172.21.15.132:0/3871095358 shutdown_connections 2023-12-20T04:51:29.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.215+0000 7f4c985bf640 1 -- 172.21.15.132:0/3871095358 wait complete. 2023-12-20T04:51:29.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.216+0000 7f4c985bf640 1 Processor -- start 2023-12-20T04:51:29.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.216+0000 7f4c985bf640 1 -- start start 2023-12-20T04:51:29.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c985bf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c9006c240 0x7f4c901f0ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c985bf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c90159b50 0x7f4c9014f9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c985bf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c9015e530 0x7f4c9014ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c985bf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c901f10e0 con 0x7f4c90159b50 2023-12-20T04:51:29.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c985bf640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9015b2d0 con 0x7f4c9015e530 2023-12-20T04:51:29.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c985bf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4c9015af80 con 0x7f4c9006c240 2023-12-20T04:51:29.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c95b5a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c90159b50 0x7f4c9014f9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:29.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c95b5a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c90159b50 0x7f4c9014f9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35304/0 (socket says 172.21.15.132:35304) 2023-12-20T04:51:29.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c95b5a640 1 -- 172.21.15.132:0/1922443833 learned_addr learned my addr 172.21.15.132:0/1922443833 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:29.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c9635b640 1 --2- 172.21.15.132:0/1922443833 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c9006c240 0x7f4c901f0ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:29.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c95b5a640 1 -- 172.21.15.132:0/1922443833 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c9006c240 msgr2=0x7f4c901f0ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:29.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c95b5a640 1 --2- 172.21.15.132:0/1922443833 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c9006c240 0x7f4c901f0ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c96b5c640 1 --2- 172.21.15.132:0/1922443833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c9015e530 0x7f4c9014ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:29.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c95b5a640 1 -- 172.21.15.132:0/1922443833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c9015e530 msgr2=0x7f4c9014ff30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:29.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c95b5a640 1 --2- 172.21.15.132:0/1922443833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c9015e530 0x7f4c9014ff30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c95b5a640 1 -- 172.21.15.132:0/1922443833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4c800094d0 con 0x7f4c90159b50 2023-12-20T04:51:29.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c95b5a640 1 --2- 172.21.15.132:0/1922443833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c90159b50 0x7f4c9014f9f0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00c7f0 tx=0x7f4c8c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:29.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c86ffd640 1 -- 172.21.15.132:0/1922443833 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c004220 con 0x7f4c90159b50 2023-12-20T04:51:29.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c86ffd640 1 -- 172.21.15.132:0/1922443833 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4c8c004380 con 0x7f4c90159b50 2023-12-20T04:51:29.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c985bf640 1 -- 172.21.15.132:0/1922443833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4c90152690 con 0x7f4c90159b50 2023-12-20T04:51:29.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c86ffd640 1 -- 172.21.15.132:0/1922443833 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4c8c007840 con 0x7f4c90159b50 2023-12-20T04:51:29.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.217+0000 7f4c985bf640 1 -- 172.21.15.132:0/1922443833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4c90152c50 con 0x7f4c90159b50 2023-12-20T04:51:29.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.219+0000 7f4c985bf640 1 -- 172.21.15.132:0/1922443833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4c9015b460 con 0x7f4c90159b50 2023-12-20T04:51:29.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.219+0000 7f4c86ffd640 1 -- 172.21.15.132:0/1922443833 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4c8c007bb0 con 0x7f4c90159b50 2023-12-20T04:51:29.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.219+0000 7f4c86ffd640 1 --2- 172.21.15.132:0/1922443833 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c7406a430 0x7f4c7406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.220+0000 7f4c9635b640 1 --2- 172.21.15.132:0/1922443833 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c7406a430 0x7f4c7406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:29.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.220+0000 7f4c86ffd640 1 -- 172.21.15.132:0/1922443833 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4c8c0887c0 con 0x7f4c90159b50 2023-12-20T04:51:29.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.220+0000 7f4c86ffd640 1 -- 172.21.15.132:0/1922443833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f4c74072020 con 0x7f4c90159b50 2023-12-20T04:51:29.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.220+0000 7f4c9635b640 1 --2- 172.21.15.132:0/1922443833 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c7406a430 0x7f4c7406c8f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4c80036000 tx=0x7f4c8003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:29.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.224+0000 7f4c86ffd640 1 -- 172.21.15.132:0/1922443833 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4c8c01e020 con 0x7f4c90159b50 2023-12-20T04:51:29.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.391+0000 7f4c985bf640 1 -- 172.21.15.132:0/1922443833 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4c9004e840 con 0x7f4c90159b50 2023-12-20T04:51:29.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.392+0000 7f4c86ffd640 1 -- 172.21.15.132:0/1922443833 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+16227 (secure 0 0 0) 0x7f4c8c053d70 con 0x7f4c90159b50 2023-12-20T04:51:29.394 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:29.394 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":157,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:50:39.874578+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:49:31.238506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-20T04:49:32.189571+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.3","mappings":[{"from":2,"to":0}]},{"pgid":"19.31","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:51:29.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.394+0000 7f4c985bf640 1 -- 172.21.15.132:0/1922443833 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c7406a430 msgr2=0x7f4c7406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:29.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.394+0000 7f4c985bf640 1 --2- 172.21.15.132:0/1922443833 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c7406a430 0x7f4c7406c8f0 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7f4c80036000 tx=0x7f4c8003c040 comp rx=0 tx=0).stop 2023-12-20T04:51:29.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.394+0000 7f4c985bf640 1 -- 172.21.15.132:0/1922443833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c90159b50 msgr2=0x7f4c9014f9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:29.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.394+0000 7f4c985bf640 1 --2- 172.21.15.132:0/1922443833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c90159b50 0x7f4c9014f9f0 secure :-1 s=READY pgs=1552 cs=0 l=1 rev1=1 crypto rx=0x7f4c8c00c7f0 tx=0x7f4c8c00ccb0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.394+0000 7f4c985bf640 1 -- 172.21.15.132:0/1922443833 shutdown_connections 2023-12-20T04:51:29.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.394+0000 7f4c985bf640 1 --2- 172.21.15.132:0/1922443833 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4c7406a430 0x7f4c7406c8f0 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.394+0000 7f4c985bf640 1 --2- 172.21.15.132:0/1922443833 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4c9015e530 0x7f4c9014ff30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.394+0000 7f4c985bf640 1 --2- 172.21.15.132:0/1922443833 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4c90159b50 0x7f4c9014f9f0 unknown :-1 s=CLOSED pgs=1552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.394+0000 7f4c985bf640 1 --2- 172.21.15.132:0/1922443833 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4c9006c240 0x7f4c901f0ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.394+0000 7f4c985bf640 1 -- 172.21.15.132:0/1922443833 >> 172.21.15.132:0/1922443833 conn(0x7f4c900ced10 msgr2=0x7f4c9006fd30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:29.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.394+0000 7f4c985bf640 1 -- 172.21.15.132:0/1922443833 shutdown_connections 2023-12-20T04:51:29.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.394+0000 7f4c985bf640 1 -- 172.21.15.132:0/1922443833 wait complete. 2023-12-20T04:51:29.407 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:49:31.238506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:49:32.189571+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:51:29.407 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:51:29.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.508+0000 7f6e9ffc9640 1 Processor -- start 2023-12-20T04:51:29.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.508+0000 7f6e9ffc9640 1 -- start start 2023-12-20T04:51:29.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.509+0000 7f6e9ffc9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6e980cb2b0 0x7f6e980cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.509+0000 7f6e9ffc9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e980ce000 con 0x7f6e980cdbb0 2023-12-20T04:51:29.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.509+0000 7f6e9ffc9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6e980d0130 con 0x7f6e9815aee0 2023-12-20T04:51:29.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.509+0000 7f6e9ffc9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6e9815f370 con 0x7f6e980cb2b0 2023-12-20T04:51:29.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.509+0000 7f6e9d564640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6e980cb2b0 0x7f6e980cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:29.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.509+0000 7f6e9e566640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6e980cdbb0 0x7f6e980d08a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53922/0 (socket says 172.21.15.132:53922) 2023-12-20T04:51:29.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.509+0000 7f6e9e566640 1 -- 172.21.15.132:0/2673429398 learned_addr learned my addr 172.21.15.132:0/2673429398 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:29.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.509+0000 7f6e9d564640 1 -- 172.21.15.132:0/2673429398 >> v1:172.21.15.187:6789/0 conn(0x7f6e9815aee0 legacy=0x7f6e9815eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:29.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.509+0000 7f6e9d564640 1 -- 172.21.15.132:0/2673429398 >> v1:172.21.15.132:6789/0 conn(0x7f6e980cdbb0 legacy=0x7f6e980d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:29.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.509+0000 7f6e9cd63640 1 -- 172.21.15.132:0/2673429398 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2802122680 0 0) 0x7f6e90001490 con 0x7f6e980cdbb0 2023-12-20T04:51:29.512 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.509+0000 7f6e9d564640 1 -- 172.21.15.132:0/2673429398 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e9815f650 con 0x7f6e980cb2b0 2023-12-20T04:51:29.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.510+0000 7f6e9d564640 1 --2- 172.21.15.132:0/2673429398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e980cb2b0 0x7f6e980cd670 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f6e880097d0 tx=0x7f6e8802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb2e0f8f2d4ac1c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:29.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.510+0000 7f6e9cd63640 1 -- 172.21.15.132:0/2673429398 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88030610 con 0x7f6e980cb2b0 2023-12-20T04:51:29.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.510+0000 7f6e9cd63640 1 -- 172.21.15.132:0/2673429398 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e88030770 con 0x7f6e980cb2b0 2023-12-20T04:51:29.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.510+0000 7f6e9cd63640 1 -- 172.21.15.132:0/2673429398 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88030b00 con 0x7f6e980cb2b0 2023-12-20T04:51:29.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.511+0000 7f6e9ffc9640 1 -- 172.21.15.132:0/2673429398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e980cb2b0 msgr2=0x7f6e980cd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:29.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.511+0000 7f6e9ffc9640 1 --2- 172.21.15.132:0/2673429398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e980cb2b0 0x7f6e980cd670 secure :-1 s=READY pgs=1554 cs=0 l=1 rev1=1 crypto rx=0x7f6e880097d0 tx=0x7f6e8802b960 comp rx=0 tx=0).stop 2023-12-20T04:51:29.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.511+0000 7f6e9ffc9640 1 -- 172.21.15.132:0/2673429398 shutdown_connections 2023-12-20T04:51:29.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.511+0000 7f6e9ffc9640 1 --2- 172.21.15.132:0/2673429398 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e980cb2b0 0x7f6e980cd670 unknown :-1 s=CLOSED pgs=1554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.511+0000 7f6e9ffc9640 1 -- 172.21.15.132:0/2673429398 >> 172.21.15.132:0/2673429398 conn(0x7f6e98072c60 msgr2=0x7f6e98073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:29.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.511+0000 7f6e9ffc9640 1 -- 172.21.15.132:0/2673429398 shutdown_connections 2023-12-20T04:51:29.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.511+0000 7f6e9ffc9640 1 -- 172.21.15.132:0/2673429398 wait complete. 2023-12-20T04:51:29.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.512+0000 7f6e9ffc9640 1 Processor -- start 2023-12-20T04:51:29.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.512+0000 7f6e9ffc9640 1 -- start start 2023-12-20T04:51:29.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9ffc9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e980cb2b0 0x7f6e9815d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9ffc9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e980cdbb0 0x7f6e98151cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9ffc9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e9815aee0 0x7f6e9815ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9ffc9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980ca450 con 0x7f6e980cdbb0 2023-12-20T04:51:29.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9ffc9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6e98152200 con 0x7f6e980cb2b0 2023-12-20T04:51:29.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9ffc9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6e980c97d0 con 0x7f6e9815aee0 2023-12-20T04:51:29.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9d564640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e980cdbb0 0x7f6e98151cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:29.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9d564640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e980cdbb0 0x7f6e98151cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35330/0 (socket says 172.21.15.132:35330) 2023-12-20T04:51:29.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9d564640 1 -- 172.21.15.132:0/708251234 learned_addr learned my addr 172.21.15.132:0/708251234 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:29.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9e566640 1 --2- 172.21.15.132:0/708251234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e9815aee0 0x7f6e9815ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:29.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9dd65640 1 --2- 172.21.15.132:0/708251234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e980cb2b0 0x7f6e9815d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:29.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9d564640 1 -- 172.21.15.132:0/708251234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e9815aee0 msgr2=0x7f6e9815ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:29.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9d564640 1 --2- 172.21.15.132:0/708251234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e9815aee0 0x7f6e9815ddb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9d564640 1 -- 172.21.15.132:0/708251234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e980cb2b0 msgr2=0x7f6e9815d170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:29.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9d564640 1 --2- 172.21.15.132:0/708251234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e980cb2b0 0x7f6e9815d170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9d564640 1 -- 172.21.15.132:0/708251234 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6e88009400 con 0x7f6e980cdbb0 2023-12-20T04:51:29.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9e566640 1 --2- 172.21.15.132:0/708251234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e9815aee0 0x7f6e9815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:29.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9dd65640 1 --2- 172.21.15.132:0/708251234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e980cb2b0 0x7f6e9815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:29.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.513+0000 7f6e9d564640 1 --2- 172.21.15.132:0/708251234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e980cdbb0 0x7f6e98151cc0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f6e880098f0 tx=0x7f6e880046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:29.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.514+0000 7f6e8e7fc640 1 -- 172.21.15.132:0/708251234 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e8803e070 con 0x7f6e980cdbb0 2023-12-20T04:51:29.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.514+0000 7f6e8e7fc640 1 -- 172.21.15.132:0/708251234 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6e88039a10 con 0x7f6e980cdbb0 2023-12-20T04:51:29.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.514+0000 7f6e9ffc9640 1 -- 172.21.15.132:0/708251234 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6e980c9ab0 con 0x7f6e980cdbb0 2023-12-20T04:51:29.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.514+0000 7f6e8e7fc640 1 -- 172.21.15.132:0/708251234 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6e88039dc0 con 0x7f6e980cdbb0 2023-12-20T04:51:29.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.514+0000 7f6e9ffc9640 1 -- 172.21.15.132:0/708251234 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6e980ca070 con 0x7f6e980cdbb0 2023-12-20T04:51:29.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.515+0000 7f6e9ffc9640 1 -- 172.21.15.132:0/708251234 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6e980ca590 con 0x7f6e980cdbb0 2023-12-20T04:51:29.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.515+0000 7f6e8e7fc640 1 -- 172.21.15.132:0/708251234 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6e880423f0 con 0x7f6e980cdbb0 2023-12-20T04:51:29.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.515+0000 7f6e8e7fc640 1 --2- 172.21.15.132:0/708251234 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6e7c06a460 0x7f6e7c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.515+0000 7f6e8e7fc640 1 -- 172.21.15.132:0/708251234 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f6e880aa870 con 0x7f6e980cdbb0 2023-12-20T04:51:29.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.515+0000 7f6e9dd65640 1 --2- 172.21.15.132:0/708251234 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6e7c06a460 0x7f6e7c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:29.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.516+0000 7f6e8e7fc640 1 -- 172.21.15.132:0/708251234 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f6e7c072050 con 0x7f6e980cdbb0 2023-12-20T04:51:29.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.516+0000 7f6e9dd65640 1 --2- 172.21.15.132:0/708251234 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6e7c06a460 0x7f6e7c06c920 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6e94007fd0 tx=0x7f6e94009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:29.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.519+0000 7f6e8e7fc640 1 -- 172.21.15.132:0/708251234 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6e88034060 con 0x7f6e980cdbb0 2023-12-20T04:51:29.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.684+0000 7f6e9ffc9640 1 -- 172.21.15.132:0/708251234 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f6e9804e840 con 0x7f6e980cdbb0 2023-12-20T04:51:29.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.684+0000 7f6e8e7fc640 1 -- 172.21.15.132:0/708251234 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v157) v1 ==== 93+0+10 (secure 0 0 0) 0x7f6e88048020 con 0x7f6e980cdbb0 2023-12-20T04:51:29.686 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:51:29.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.686+0000 7f6e9ffc9640 1 -- 172.21.15.132:0/708251234 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6e7c06a460 msgr2=0x7f6e7c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:29.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.686+0000 7f6e9ffc9640 1 --2- 172.21.15.132:0/708251234 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6e7c06a460 0x7f6e7c06c920 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 crypto rx=0x7f6e94007fd0 tx=0x7f6e94009040 comp rx=0 tx=0).stop 2023-12-20T04:51:29.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.686+0000 7f6e9ffc9640 1 -- 172.21.15.132:0/708251234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e980cdbb0 msgr2=0x7f6e98151cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:29.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.686+0000 7f6e9ffc9640 1 --2- 172.21.15.132:0/708251234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e980cdbb0 0x7f6e98151cc0 secure :-1 s=READY pgs=1555 cs=0 l=1 rev1=1 crypto rx=0x7f6e880098f0 tx=0x7f6e880046c0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.686+0000 7f6e9ffc9640 1 -- 172.21.15.132:0/708251234 shutdown_connections 2023-12-20T04:51:29.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.686+0000 7f6e9ffc9640 1 --2- 172.21.15.132:0/708251234 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6e7c06a460 0x7f6e7c06c920 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.686+0000 7f6e9ffc9640 1 --2- 172.21.15.132:0/708251234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6e9815aee0 0x7f6e9815ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.686+0000 7f6e9ffc9640 1 --2- 172.21.15.132:0/708251234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6e980cdbb0 0x7f6e98151cc0 unknown :-1 s=CLOSED pgs=1555 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.686+0000 7f6e9ffc9640 1 --2- 172.21.15.132:0/708251234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6e980cb2b0 0x7f6e9815d170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.686+0000 7f6e9ffc9640 1 -- 172.21.15.132:0/708251234 >> 172.21.15.132:0/708251234 conn(0x7f6e98072c60 msgr2=0x7f6e98158c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:29.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.686+0000 7f6e9ffc9640 1 -- 172.21.15.132:0/708251234 shutdown_connections 2023-12-20T04:51:29.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.686+0000 7f6e9ffc9640 1 -- 172.21.15.132:0/708251234 wait complete. 2023-12-20T04:51:29.699 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:51:29.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.799+0000 7fb2fdf73640 1 Processor -- start 2023-12-20T04:51:29.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.799+0000 7fb2fdf73640 1 -- start start 2023-12-20T04:51:29.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.800+0000 7fb2fdf73640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2f815aee0 0x7fb2f815eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.800+0000 7fb2fdf73640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb2f80cb2b0 0x7fb2f80cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.800+0000 7fb2fdf73640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2f80d0130 con 0x7fb2f80cdbb0 2023-12-20T04:51:29.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.800+0000 7fb2fdf73640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2f80ce040 con 0x7fb2f80cb2b0 2023-12-20T04:51:29.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.800+0000 7fb2fdf73640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f815f370 con 0x7fb2f815aee0 2023-12-20T04:51:29.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.800+0000 7fb2f6ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb2f80cb2b0 0x7fb2f80cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:29.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.800+0000 7fb2f7fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb2f80cdbb0 0x7fb2f80ceb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53928/0 (socket says 172.21.15.132:53928) 2023-12-20T04:51:29.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.800+0000 7fb2f6ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb2f80cb2b0 0x7fb2f80cd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35334/0 (socket says 172.21.15.132:35334) 2023-12-20T04:51:29.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.800+0000 7fb2f7fff640 1 -- 172.21.15.132:0/1309563939 learned_addr learned my addr 172.21.15.132:0/1309563939 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:29.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.800+0000 7fb2f6ffd640 1 -- 172.21.15.132:0/1309563939 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2f815aee0 msgr2=0x7fb2f815eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:29.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.800+0000 7fb2f6ffd640 1 --2- 172.21.15.132:0/1309563939 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2f815aee0 0x7fb2f815eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.800+0000 7fb2f6ffd640 1 -- 172.21.15.132:0/1309563939 >> v1:172.21.15.132:6789/0 conn(0x7fb2f80cdbb0 legacy=0x7fb2f80ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:29.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.800+0000 7fb2f6ffd640 1 -- 172.21.15.132:0/1309563939 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2f815f650 con 0x7fb2f80cb2b0 2023-12-20T04:51:29.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.800+0000 7fb2f67fc640 1 -- 172.21.15.132:0/1309563939 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3950727155 0 0) 0x7fb2f80d0130 con 0x7fb2f80cdbb0 2023-12-20T04:51:29.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.801+0000 7fb2f6ffd640 1 --2- 172.21.15.132:0/1309563939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2f80cb2b0 0x7fb2f80cd670 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0097a0 tx=0x7fb2ec02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=60e48b80f57750d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:29.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.801+0000 7fb2f67fc640 1 -- 172.21.15.132:0/1309563939 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec031830 con 0x7fb2f80cb2b0 2023-12-20T04:51:29.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.801+0000 7fb2f67fc640 1 -- 172.21.15.132:0/1309563939 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2ec031990 con 0x7fb2f80cb2b0 2023-12-20T04:51:29.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.801+0000 7fb2f67fc640 1 -- 172.21.15.132:0/1309563939 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2ec031d20 con 0x7fb2f80cb2b0 2023-12-20T04:51:29.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.802+0000 7fb2fdf73640 1 -- 172.21.15.132:0/1309563939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2f80cb2b0 msgr2=0x7fb2f80cd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:29.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.802+0000 7fb2fdf73640 1 --2- 172.21.15.132:0/1309563939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2f80cb2b0 0x7fb2f80cd670 secure :-1 s=READY pgs=1557 cs=0 l=1 rev1=1 crypto rx=0x7fb2ec0097a0 tx=0x7fb2ec02b8d0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.802+0000 7fb2fdf73640 1 -- 172.21.15.132:0/1309563939 shutdown_connections 2023-12-20T04:51:29.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.802+0000 7fb2fdf73640 1 --2- 172.21.15.132:0/1309563939 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2f80cb2b0 0x7fb2f80cd670 unknown :-1 s=CLOSED pgs=1557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.802+0000 7fb2fdf73640 1 --2- 172.21.15.132:0/1309563939 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2f815aee0 0x7fb2f815eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.802+0000 7fb2fdf73640 1 -- 172.21.15.132:0/1309563939 >> 172.21.15.132:0/1309563939 conn(0x7fb2f8072c60 msgr2=0x7fb2f8073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:29.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.802+0000 7fb2fdf73640 1 -- 172.21.15.132:0/1309563939 shutdown_connections 2023-12-20T04:51:29.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.802+0000 7fb2fdf73640 1 -- 172.21.15.132:0/1309563939 wait complete. 2023-12-20T04:51:29.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.803+0000 7fb2fdf73640 1 Processor -- start 2023-12-20T04:51:29.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.803+0000 7fb2fdf73640 1 -- start start 2023-12-20T04:51:29.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.804+0000 7fb2fdf73640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2f80cb2b0 0x7fb2f815b2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.804+0000 7fb2fdf73640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2f80cdbb0 0x7fb2f81f3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.804+0000 7fb2fdf73640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2f815aee0 0x7fb2f815d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.804+0000 7fb2fdf73640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f815c570 con 0x7fb2f815aee0 2023-12-20T04:51:29.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.804+0000 7fb2fdf73640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f81f11d0 con 0x7fb2f80cb2b0 2023-12-20T04:51:29.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.804+0000 7fb2fdf73640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2f815bcd0 con 0x7fb2f80cdbb0 2023-12-20T04:51:29.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.804+0000 7fb2f7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2f815aee0 0x7fb2f815d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:29.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.804+0000 7fb2f7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2f815aee0 0x7fb2f815d940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35344/0 (socket says 172.21.15.132:35344) 2023-12-20T04:51:29.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.804+0000 7fb2f7fff640 1 -- 172.21.15.132:0/3284490148 learned_addr learned my addr 172.21.15.132:0/3284490148 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:29.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.804+0000 7fb2f77fe640 1 --2- 172.21.15.132:0/3284490148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2f80cb2b0 0x7fb2f815b2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.804+0000 7fb2f6ffd640 1 --2- 172.21.15.132:0/3284490148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2f80cdbb0 0x7fb2f81f3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.804+0000 7fb2f7fff640 1 -- 172.21.15.132:0/3284490148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2f80cdbb0 msgr2=0x7fb2f81f3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.804+0000 7fb2f7fff640 1 --2- 172.21.15.132:0/3284490148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2f80cdbb0 0x7fb2f81f3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.804+0000 7fb2f7fff640 1 -- 172.21.15.132:0/3284490148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2f80cb2b0 msgr2=0x7fb2f815b2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.804+0000 7fb2f7fff640 1 --2- 172.21.15.132:0/3284490148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2f80cb2b0 0x7fb2f815b2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.804+0000 7fb2f7fff640 1 -- 172.21.15.132:0/3284490148 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2ec009400 con 0x7fb2f815aee0 2023-12-20T04:51:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.804+0000 7fb2f6ffd640 1 --2- 172.21.15.132:0/3284490148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2f80cdbb0 0x7fb2f81f3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.805+0000 7fb2f7fff640 1 --2- 172.21.15.132:0/3284490148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2f815aee0 0x7fb2f815d940 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000c780 tx=0x7fb2f000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.805+0000 7fb2dffff640 1 -- 172.21.15.132:0/3284490148 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000ce90 con 0x7fb2f815aee0 2023-12-20T04:51:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.805+0000 7fb2dffff640 1 -- 172.21.15.132:0/3284490148 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2f000a640 con 0x7fb2f815aee0 2023-12-20T04:51:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.805+0000 7fb2dffff640 1 -- 172.21.15.132:0/3284490148 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2f000a9d0 con 0x7fb2f815aee0 2023-12-20T04:51:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.805+0000 7fb2fdf73640 1 -- 172.21.15.132:0/3284490148 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2f815bfb0 con 0x7fb2f815aee0 2023-12-20T04:51:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.805+0000 7fb2fdf73640 1 -- 172.21.15.132:0/3284490148 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2f81f13e0 con 0x7fb2f815aee0 2023-12-20T04:51:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.806+0000 7fb2fdf73640 1 -- 172.21.15.132:0/3284490148 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb2f81f15d0 con 0x7fb2f815aee0 2023-12-20T04:51:29.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.806+0000 7fb2dffff640 1 -- 172.21.15.132:0/3284490148 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb2f000ab30 con 0x7fb2f815aee0 2023-12-20T04:51:29.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.807+0000 7fb2dffff640 1 --2- 172.21.15.132:0/3284490148 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb2e406a430 0x7fb2e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:29.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.807+0000 7fb2dffff640 1 -- 172.21.15.132:0/3284490148 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fb2f0087d70 con 0x7fb2f815aee0 2023-12-20T04:51:29.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.807+0000 7fb2f77fe640 1 --2- 172.21.15.132:0/3284490148 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb2e406a430 0x7fb2e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:29.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.807+0000 7fb2dffff640 1 -- 172.21.15.132:0/3284490148 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7fb2e4072020 con 0x7fb2f815aee0 2023-12-20T04:51:29.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.807+0000 7fb2f77fe640 1 --2- 172.21.15.132:0/3284490148 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb2e406a430 0x7fb2e406c8f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8158dd0 tx=0x7fb2e8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:29.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.811+0000 7fb2dffff640 1 -- 172.21.15.132:0/3284490148 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb2f0018060 con 0x7fb2f815aee0 2023-12-20T04:51:29.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.978+0000 7fb2fdf73640 1 -- 172.21.15.132:0/3284490148 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7fb2f804e840 con 0x7fb2f815aee0 2023-12-20T04:51:29.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.978+0000 7fb2dffff640 1 -- 172.21.15.132:0/3284490148 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v157) v1 ==== 104+0+11 (secure 0 0 0) 0x7fb2f0053320 con 0x7fb2f815aee0 2023-12-20T04:51:29.980 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:51:29.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.980+0000 7fb2fdf73640 1 -- 172.21.15.132:0/3284490148 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb2e406a430 msgr2=0x7fb2e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:29.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.980+0000 7fb2fdf73640 1 --2- 172.21.15.132:0/3284490148 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb2e406a430 0x7fb2e406c8f0 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7fb2f8158dd0 tx=0x7fb2e8008040 comp rx=0 tx=0).stop 2023-12-20T04:51:29.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.980+0000 7fb2fdf73640 1 -- 172.21.15.132:0/3284490148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2f815aee0 msgr2=0x7fb2f815d940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:29.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.980+0000 7fb2fdf73640 1 --2- 172.21.15.132:0/3284490148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2f815aee0 0x7fb2f815d940 secure :-1 s=READY pgs=1558 cs=0 l=1 rev1=1 crypto rx=0x7fb2f000c780 tx=0x7fb2f000cc40 comp rx=0 tx=0).stop 2023-12-20T04:51:29.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.980+0000 7fb2fdf73640 1 -- 172.21.15.132:0/3284490148 shutdown_connections 2023-12-20T04:51:29.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.980+0000 7fb2fdf73640 1 --2- 172.21.15.132:0/3284490148 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb2e406a430 0x7fb2e406c8f0 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.980+0000 7fb2fdf73640 1 --2- 172.21.15.132:0/3284490148 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2f815aee0 0x7fb2f815d940 unknown :-1 s=CLOSED pgs=1558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.980+0000 7fb2fdf73640 1 --2- 172.21.15.132:0/3284490148 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2f80cdbb0 0x7fb2f81f3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.980+0000 7fb2fdf73640 1 --2- 172.21.15.132:0/3284490148 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2f80cb2b0 0x7fb2f815b2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:29.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.980+0000 7fb2fdf73640 1 -- 172.21.15.132:0/3284490148 >> 172.21.15.132:0/3284490148 conn(0x7fb2f8072c60 msgr2=0x7fb2f815a110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:29.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.980+0000 7fb2fdf73640 1 -- 172.21.15.132:0/3284490148 shutdown_connections 2023-12-20T04:51:29.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:29.980+0000 7fb2fdf73640 1 -- 172.21.15.132:0/3284490148 wait complete. 2023-12-20T04:51:29.993 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:51:30.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.094+0000 7f12aaf20640 1 Processor -- start 2023-12-20T04:51:30.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.094+0000 7f12aaf20640 1 -- start start 2023-12-20T04:51:30.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.095+0000 7f12aaf20640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f12a415cf20 0x7f12a406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.095+0000 7f12aaf20640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12a415d300 0x7f12a4161700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.095+0000 7f12aaf20640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12a4161c40 con 0x7f12a40cd4b0 2023-12-20T04:51:30.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.095+0000 7f12aaf20640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12a406cc90 con 0x7f12a415cf20 2023-12-20T04:51:30.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.095+0000 7f12aaf20640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40b2f30 con 0x7f12a415d300 2023-12-20T04:51:30.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.095+0000 7f12a8cbc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f12a415cf20 0x7f12a406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.095+0000 7f12a8cbc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f12a415cf20 0x7f12a406c590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35360/0 (socket says 172.21.15.132:35360) 2023-12-20T04:51:30.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.095+0000 7f12a8cbc640 1 -- 172.21.15.132:0/2226245600 learned_addr learned my addr 172.21.15.132:0/2226245600 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:30.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.096+0000 7f12a8cbc640 1 -- 172.21.15.132:0/2226245600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12a415d300 msgr2=0x7f12a4161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:30.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.096+0000 7f12a8cbc640 1 --2- 172.21.15.132:0/2226245600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12a415d300 0x7f12a4161700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.096+0000 7f12a8cbc640 1 -- 172.21.15.132:0/2226245600 >> v1:172.21.15.187:6789/0 conn(0x7f12a40cd4b0 legacy=0x7f12a40ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:30.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.096+0000 7f12a8cbc640 1 -- 172.21.15.132:0/2226245600 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12a40b3210 con 0x7f12a415cf20 2023-12-20T04:51:30.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.096+0000 7f12a8cbc640 1 --2- 172.21.15.132:0/2226245600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12a415cf20 0x7f12a406c590 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f1294009870 tx=0x7f129402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecd268aaa06545d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:30.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.096+0000 7f12a37fe640 1 -- 172.21.15.132:0/2226245600 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294031640 con 0x7f12a415cf20 2023-12-20T04:51:30.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.097+0000 7f12a37fe640 1 -- 172.21.15.132:0/2226245600 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12940317a0 con 0x7f12a415cf20 2023-12-20T04:51:30.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.097+0000 7f12a37fe640 1 -- 172.21.15.132:0/2226245600 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294031b30 con 0x7f12a415cf20 2023-12-20T04:51:30.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.097+0000 7f12aaf20640 1 -- 172.21.15.132:0/2226245600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12a415cf20 msgr2=0x7f12a406c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:30.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.097+0000 7f12aaf20640 1 --2- 172.21.15.132:0/2226245600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12a415cf20 0x7f12a406c590 secure :-1 s=READY pgs=1559 cs=0 l=1 rev1=1 crypto rx=0x7f1294009870 tx=0x7f129402b8f0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.097+0000 7f12aaf20640 1 -- 172.21.15.132:0/2226245600 shutdown_connections 2023-12-20T04:51:30.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.097+0000 7f12aaf20640 1 --2- 172.21.15.132:0/2226245600 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12a415d300 0x7f12a4161700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.097+0000 7f12aaf20640 1 --2- 172.21.15.132:0/2226245600 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12a415cf20 0x7f12a406c590 unknown :-1 s=CLOSED pgs=1559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.097+0000 7f12aaf20640 1 -- 172.21.15.132:0/2226245600 >> 172.21.15.132:0/2226245600 conn(0x7f12a4072c60 msgr2=0x7f12a4073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:30.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.097+0000 7f12aaf20640 1 -- 172.21.15.132:0/2226245600 shutdown_connections 2023-12-20T04:51:30.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.097+0000 7f12aaf20640 1 -- 172.21.15.132:0/2226245600 wait complete. 2023-12-20T04:51:30.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.098+0000 7f12aaf20640 1 Processor -- start 2023-12-20T04:51:30.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.098+0000 7f12aaf20640 1 -- start start 2023-12-20T04:51:30.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.099+0000 7f12aaf20640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12a40cd4b0 0x7f12a40c8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.099+0000 7f12aaf20640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12a415cf20 0x7f12a41f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.099+0000 7f12aaf20640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12a415d300 0x7f12a40af990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.099+0000 7f12aaf20640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40aec60 con 0x7f12a40cd4b0 2023-12-20T04:51:30.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.099+0000 7f12aaf20640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40af500 con 0x7f12a415d300 2023-12-20T04:51:30.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.099+0000 7f12aaf20640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12a40c8e20 con 0x7f12a415cf20 2023-12-20T04:51:30.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.099+0000 7f12a8cbc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12a40cd4b0 0x7f12a40c8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.099+0000 7f12a8cbc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12a40cd4b0 0x7f12a40c8710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35364/0 (socket says 172.21.15.132:35364) 2023-12-20T04:51:30.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.099+0000 7f12a8cbc640 1 -- 172.21.15.132:0/633079376 learned_addr learned my addr 172.21.15.132:0/633079376 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:30.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.099+0000 7f12a94bd640 1 --2- 172.21.15.132:0/633079376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12a415d300 0x7f12a40af990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.099+0000 7f12a3fff640 1 --2- 172.21.15.132:0/633079376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12a415cf20 0x7f12a41f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.100+0000 7f12a8cbc640 1 -- 172.21.15.132:0/633079376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12a415cf20 msgr2=0x7f12a41f33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:30.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.100+0000 7f12a8cbc640 1 --2- 172.21.15.132:0/633079376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12a415cf20 0x7f12a41f33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.100+0000 7f12a8cbc640 1 -- 172.21.15.132:0/633079376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12a415d300 msgr2=0x7f12a40af990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:30.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.100+0000 7f12a8cbc640 1 --2- 172.21.15.132:0/633079376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12a415d300 0x7f12a40af990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.100+0000 7f12a8cbc640 1 -- 172.21.15.132:0/633079376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12940094d0 con 0x7f12a40cd4b0 2023-12-20T04:51:30.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.100+0000 7f12a3fff640 1 --2- 172.21.15.132:0/633079376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12a415cf20 0x7f12a41f33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:30.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.100+0000 7f12a8cbc640 1 --2- 172.21.15.132:0/633079376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12a40cd4b0 0x7f12a40c8710 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f1294000c00 tx=0x7f12940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:30.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.100+0000 7f12a17fa640 1 -- 172.21.15.132:0/633079376 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f129403ac60 con 0x7f12a40cd4b0 2023-12-20T04:51:30.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.100+0000 7f12a17fa640 1 -- 172.21.15.132:0/633079376 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f129403adc0 con 0x7f12a40cd4b0 2023-12-20T04:51:30.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.100+0000 7f12aaf20640 1 -- 172.21.15.132:0/633079376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12a40aeeb0 con 0x7f12a40cd4b0 2023-12-20T04:51:30.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.100+0000 7f12a17fa640 1 -- 172.21.15.132:0/633079376 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1294044630 con 0x7f12a40cd4b0 2023-12-20T04:51:30.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.100+0000 7f12aaf20640 1 -- 172.21.15.132:0/633079376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12a40afed0 con 0x7f12a40cd4b0 2023-12-20T04:51:30.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.101+0000 7f12aaf20640 1 -- 172.21.15.132:0/633079376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12a404e840 con 0x7f12a40cd4b0 2023-12-20T04:51:30.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.101+0000 7f12a17fa640 1 -- 172.21.15.132:0/633079376 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f129402f050 con 0x7f12a40cd4b0 2023-12-20T04:51:30.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.102+0000 7f12a17fa640 1 --2- 172.21.15.132:0/633079376 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f129006a430 0x7f129006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.102+0000 7f12a17fa640 1 -- 172.21.15.132:0/633079376 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f12940aa7e0 con 0x7f12a40cd4b0 2023-12-20T04:51:30.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.102+0000 7f12a3fff640 1 --2- 172.21.15.132:0/633079376 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f129006a430 0x7f129006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.102+0000 7f12a17fa640 1 -- 172.21.15.132:0/633079376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f1290072020 con 0x7f12a40cd4b0 2023-12-20T04:51:30.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.102+0000 7f12a3fff640 1 --2- 172.21.15.132:0/633079376 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f129006a430 0x7f129006c8f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f12a415c910 tx=0x7f1298008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:30.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.106+0000 7f12a17fa640 1 -- 172.21.15.132:0/633079376 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1294075e20 con 0x7f12a40cd4b0 2023-12-20T04:51:30.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.272+0000 7f12aaf20640 1 -- 172.21.15.132:0/633079376 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f12a40b2890 con 0x7f12a40cd4b0 2023-12-20T04:51:30.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.272+0000 7f12a17fa640 1 -- 172.21.15.132:0/633079376 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v157) v1 ==== 100+0+11 (secure 0 0 0) 0x7f1294031e60 con 0x7f12a40cd4b0 2023-12-20T04:51:30.275 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:51:30.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.274+0000 7f12aaf20640 1 -- 172.21.15.132:0/633079376 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f129006a430 msgr2=0x7f129006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:30.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.274+0000 7f12aaf20640 1 --2- 172.21.15.132:0/633079376 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f129006a430 0x7f129006c8f0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7f12a415c910 tx=0x7f1298008040 comp rx=0 tx=0).stop 2023-12-20T04:51:30.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.274+0000 7f12aaf20640 1 -- 172.21.15.132:0/633079376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12a40cd4b0 msgr2=0x7f12a40c8710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:30.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.274+0000 7f12aaf20640 1 --2- 172.21.15.132:0/633079376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12a40cd4b0 0x7f12a40c8710 secure :-1 s=READY pgs=1560 cs=0 l=1 rev1=1 crypto rx=0x7f1294000c00 tx=0x7f12940046c0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.274+0000 7f12aaf20640 1 -- 172.21.15.132:0/633079376 shutdown_connections 2023-12-20T04:51:30.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.274+0000 7f12aaf20640 1 --2- 172.21.15.132:0/633079376 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f129006a430 0x7f129006c8f0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.274+0000 7f12aaf20640 1 --2- 172.21.15.132:0/633079376 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12a415d300 0x7f12a40af990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.274+0000 7f12aaf20640 1 --2- 172.21.15.132:0/633079376 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12a415cf20 0x7f12a41f33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.274+0000 7f12aaf20640 1 --2- 172.21.15.132:0/633079376 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12a40cd4b0 0x7f12a40c8710 unknown :-1 s=CLOSED pgs=1560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.274+0000 7f12aaf20640 1 -- 172.21.15.132:0/633079376 >> 172.21.15.132:0/633079376 conn(0x7f12a4072c60 msgr2=0x7f12a40cfc00 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:30.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.274+0000 7f12aaf20640 1 -- 172.21.15.132:0/633079376 shutdown_connections 2023-12-20T04:51:30.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.274+0000 7f12aaf20640 1 -- 172.21.15.132:0/633079376 wait complete. 2023-12-20T04:51:30.287 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:51:30.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.386+0000 7f630edb1640 1 Processor -- start 2023-12-20T04:51:30.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.386+0000 7f630edb1640 1 -- start start 2023-12-20T04:51:30.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.386+0000 7f630edb1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6308144760 0x7f63080cea40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.386+0000 7f630edb1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6308069c30 0x7f630806a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.386+0000 7f630edb1640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f63080ca160 0x7f63080ca5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.386+0000 7f630edb1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f63080ce620 con 0x7f6308144760 2023-12-20T04:51:30.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.386+0000 7f630edb1640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6308144b40 con 0x7f63080ca160 2023-12-20T04:51:30.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.386+0000 7f630edb1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f630806a5d0 con 0x7f6308069c30 2023-12-20T04:51:30.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.387+0000 7f630cb4d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6308144760 0x7f63080cea40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.387+0000 7f630cb4d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6308144760 0x7f63080cea40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35372/0 (socket says 172.21.15.132:35372) 2023-12-20T04:51:30.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.387+0000 7f630cb4d640 1 -- 172.21.15.132:0/3528004185 learned_addr learned my addr 172.21.15.132:0/3528004185 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:30.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.387+0000 7f6307fff640 1 --2- 172.21.15.132:0/3528004185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6308069c30 0x7f630806a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.387+0000 7f630cb4d640 1 -- 172.21.15.132:0/3528004185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6308069c30 msgr2=0x7f630806a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:30.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.387+0000 7f630cb4d640 1 --2- 172.21.15.132:0/3528004185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6308069c30 0x7f630806a090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.387+0000 7f630d34e640 1 --2- 172.21.15.132:0/3528004185 >> v2:172.21.15.187:3300/0 conn(0x7f63080ca160 0x7f63080ca5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.387+0000 7f630cb4d640 1 -- 172.21.15.132:0/3528004185 >> v2:172.21.15.187:3300/0 conn(0x7f63080ca160 msgr2=0x7f63080ca5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:30.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.387+0000 7f630cb4d640 1 --2- 172.21.15.132:0/3528004185 >> v2:172.21.15.187:3300/0 conn(0x7f63080ca160 0x7f63080ca5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.387+0000 7f630cb4d640 1 -- 172.21.15.132:0/3528004185 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63080cda30 con 0x7f6308144760 2023-12-20T04:51:30.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.388+0000 7f630cb4d640 1 --2- 172.21.15.132:0/3528004185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6308144760 0x7f63080cea40 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f6308070480 tx=0x7f62f802b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a51fe2010be08ddb server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:30.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.388+0000 7f63077fe640 1 -- 172.21.15.132:0/3528004185 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f80317e0 con 0x7f6308144760 2023-12-20T04:51:30.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.388+0000 7f63077fe640 1 -- 172.21.15.132:0/3528004185 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f8031940 con 0x7f6308144760 2023-12-20T04:51:30.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.388+0000 7f63077fe640 1 -- 172.21.15.132:0/3528004185 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f8031cd0 con 0x7f6308144760 2023-12-20T04:51:30.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.388+0000 7f630edb1640 1 -- 172.21.15.132:0/3528004185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6308144760 msgr2=0x7f63080cea40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:30.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.388+0000 7f630edb1640 1 --2- 172.21.15.132:0/3528004185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6308144760 0x7f63080cea40 secure :-1 s=READY pgs=1561 cs=0 l=1 rev1=1 crypto rx=0x7f6308070480 tx=0x7f62f802b880 comp rx=0 tx=0).stop 2023-12-20T04:51:30.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.388+0000 7f630edb1640 1 -- 172.21.15.132:0/3528004185 shutdown_connections 2023-12-20T04:51:30.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.388+0000 7f630edb1640 1 --2- 172.21.15.132:0/3528004185 >> v2:172.21.15.187:3300/0 conn(0x7f63080ca160 0x7f63080ca5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.388+0000 7f630edb1640 1 --2- 172.21.15.132:0/3528004185 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6308069c30 0x7f630806a090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.388+0000 7f630edb1640 1 --2- 172.21.15.132:0/3528004185 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6308144760 0x7f63080cea40 unknown :-1 s=CLOSED pgs=1561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.388+0000 7f630edb1640 1 -- 172.21.15.132:0/3528004185 >> 172.21.15.132:0/3528004185 conn(0x7f63080cfb10 msgr2=0x7f63080cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:30.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.388+0000 7f630edb1640 1 -- 172.21.15.132:0/3528004185 shutdown_connections 2023-12-20T04:51:30.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.388+0000 7f630edb1640 1 -- 172.21.15.132:0/3528004185 wait complete. 2023-12-20T04:51:30.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.390+0000 7f630edb1640 1 Processor -- start 2023-12-20T04:51:30.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.390+0000 7f630edb1640 1 -- start start 2023-12-20T04:51:30.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.390+0000 7f630edb1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6308069c30 0x7f630815a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.390+0000 7f630edb1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63080ca160 0x7f63081f6110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.390+0000 7f630edb1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6308144760 0x7f63081f6650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f630edb1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63080c4ac0 con 0x7f6308069c30 2023-12-20T04:51:30.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f630edb1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f63080ad9d0 con 0x7f6308144760 2023-12-20T04:51:30.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f630edb1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f63080adcb0 con 0x7f63080ca160 2023-12-20T04:51:30.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f630cb4d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6308069c30 0x7f630815a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f630cb4d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6308069c30 0x7f630815a870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35386/0 (socket says 172.21.15.132:35386) 2023-12-20T04:51:30.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f630cb4d640 1 -- 172.21.15.132:0/2960775819 learned_addr learned my addr 172.21.15.132:0/2960775819 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:30.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f630d34e640 1 --2- 172.21.15.132:0/2960775819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6308144760 0x7f63081f6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f6307fff640 1 --2- 172.21.15.132:0/2960775819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63080ca160 0x7f63081f6110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f630cb4d640 1 -- 172.21.15.132:0/2960775819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63080ca160 msgr2=0x7f63081f6110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:30.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f630cb4d640 1 --2- 172.21.15.132:0/2960775819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63080ca160 0x7f63081f6110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f630cb4d640 1 -- 172.21.15.132:0/2960775819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6308144760 msgr2=0x7f63081f6650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:30.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f630cb4d640 1 --2- 172.21.15.132:0/2960775819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6308144760 0x7f63081f6650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f630cb4d640 1 -- 172.21.15.132:0/2960775819 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62f80094d0 con 0x7f6308069c30 2023-12-20T04:51:30.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f630d34e640 1 --2- 172.21.15.132:0/2960775819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6308144760 0x7f63081f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:30.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f630cb4d640 1 --2- 172.21.15.132:0/2960775819 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6308069c30 0x7f630815a870 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f62f802b8c0 tx=0x7f62f80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:30.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f63057fa640 1 -- 172.21.15.132:0/2960775819 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f80329c0 con 0x7f6308069c30 2023-12-20T04:51:30.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f63057fa640 1 -- 172.21.15.132:0/2960775819 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62f8032b40 con 0x7f6308069c30 2023-12-20T04:51:30.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f630edb1640 1 -- 172.21.15.132:0/2960775819 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f63080adf90 con 0x7f6308069c30 2023-12-20T04:51:30.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f63057fa640 1 -- 172.21.15.132:0/2960775819 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f62f80453f0 con 0x7f6308069c30 2023-12-20T04:51:30.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.391+0000 7f630edb1640 1 -- 172.21.15.132:0/2960775819 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f63080acc70 con 0x7f6308069c30 2023-12-20T04:51:30.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.392+0000 7f630edb1640 1 -- 172.21.15.132:0/2960775819 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f630804e840 con 0x7f6308069c30 2023-12-20T04:51:30.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.393+0000 7f63057fa640 1 -- 172.21.15.132:0/2960775819 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f62f804d3f0 con 0x7f6308069c30 2023-12-20T04:51:30.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.393+0000 7f63057fa640 1 --2- 172.21.15.132:0/2960775819 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62f406a430 0x7f62f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.393+0000 7f63057fa640 1 -- 172.21.15.132:0/2960775819 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f62f80aa7e0 con 0x7f6308069c30 2023-12-20T04:51:30.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.393+0000 7f6307fff640 1 --2- 172.21.15.132:0/2960775819 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62f406a430 0x7f62f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.393+0000 7f63057fa640 1 -- 172.21.15.132:0/2960775819 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f62f4072020 con 0x7f6308069c30 2023-12-20T04:51:30.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.393+0000 7f6307fff640 1 --2- 172.21.15.132:0/2960775819 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62f406a430 0x7f62f406c8f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f62fc006fd0 tx=0x7f62fc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:30.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.397+0000 7f63057fa640 1 -- 172.21.15.132:0/2960775819 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f62f8075ed0 con 0x7f6308069c30 2023-12-20T04:51:30.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.576+0000 7f630edb1640 1 -- 172.21.15.132:0/2960775819 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f63080cdf30 con 0x7f6308069c30 2023-12-20T04:51:30.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.577+0000 7f63057fa640 1 -- 172.21.15.132:0/2960775819 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v157) v1 ==== 80+0+0 (secure 0 0 0) 0x7f62f80794f0 con 0x7f6308069c30 2023-12-20T04:51:30.579 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:51:30.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.579+0000 7f630edb1640 1 -- 172.21.15.132:0/2960775819 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62f406a430 msgr2=0x7f62f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:30.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.579+0000 7f630edb1640 1 --2- 172.21.15.132:0/2960775819 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62f406a430 0x7f62f406c8f0 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x7f62fc006fd0 tx=0x7f62fc008040 comp rx=0 tx=0).stop 2023-12-20T04:51:30.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.579+0000 7f630edb1640 1 -- 172.21.15.132:0/2960775819 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6308069c30 msgr2=0x7f630815a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:30.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.579+0000 7f630edb1640 1 --2- 172.21.15.132:0/2960775819 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6308069c30 0x7f630815a870 secure :-1 s=READY pgs=1562 cs=0 l=1 rev1=1 crypto rx=0x7f62f802b8c0 tx=0x7f62f80046c0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.579+0000 7f630edb1640 1 -- 172.21.15.132:0/2960775819 shutdown_connections 2023-12-20T04:51:30.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.579+0000 7f630edb1640 1 --2- 172.21.15.132:0/2960775819 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f62f406a430 0x7f62f406c8f0 unknown :-1 s=CLOSED pgs=657 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.579+0000 7f630edb1640 1 --2- 172.21.15.132:0/2960775819 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6308144760 0x7f63081f6650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.579+0000 7f630edb1640 1 --2- 172.21.15.132:0/2960775819 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f63080ca160 0x7f63081f6110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.579+0000 7f630edb1640 1 --2- 172.21.15.132:0/2960775819 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6308069c30 0x7f630815a870 unknown :-1 s=CLOSED pgs=1562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.579+0000 7f630edb1640 1 -- 172.21.15.132:0/2960775819 >> 172.21.15.132:0/2960775819 conn(0x7f63080cfb10 msgr2=0x7f630806e470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:30.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.579+0000 7f630edb1640 1 -- 172.21.15.132:0/2960775819 shutdown_connections 2023-12-20T04:51:30.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.579+0000 7f630edb1640 1 -- 172.21.15.132:0/2960775819 wait complete. 2023-12-20T04:51:30.592 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2023-12-20T04:51:30.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:30.592 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-20T04:51:30.617 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[117673]: fuse finished with error 0 and tester_r 0 2023-12-20T04:51:30.619 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:51:30.619 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:30.619 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-20T04:51:30.784 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:51:30.784 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:51:30.803 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:51:30.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.923+0000 7f61aff3e640 1 Processor -- start 2023-12-20T04:51:30.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.923+0000 7f61aff3e640 1 -- start start 2023-12-20T04:51:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.924+0000 7f61aff3e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f61a815d2d0 0x7f61a80cecc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.924+0000 7f61aff3e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a80ad760 con 0x7f61a80ad2f0 2023-12-20T04:51:30.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.924+0000 7f61aff3e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f61a80add30 con 0x7f61a815cef0 2023-12-20T04:51:30.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.924+0000 7f61aff3e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f61a80ae010 con 0x7f61a815d2d0 2023-12-20T04:51:30.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.924+0000 7f61ae4db640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f61a80ad2f0 0x7f61a806bd00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53932/0 (socket says 172.21.15.132:53932) 2023-12-20T04:51:30.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.924+0000 7f61ae4db640 1 -- 172.21.15.132:0/3597081645 learned_addr learned my addr 172.21.15.132:0/3597081645 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:30.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.924+0000 7f61ad4d9640 1 --2- 172.21.15.132:0/3597081645 >> v2:172.21.15.187:3300/0 conn(0x7f61a815d2d0 0x7f61a80cecc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.924+0000 7f61accd8640 1 -- 172.21.15.132:0/3597081645 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3546348639 0 0) 0x7f61a80ad760 con 0x7f61a80ad2f0 2023-12-20T04:51:30.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.924+0000 7f61accd8640 1 -- 172.21.15.132:0/3597081645 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6194003520 con 0x7f61a80ad2f0 2023-12-20T04:51:30.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.924+0000 7f61accd8640 1 -- 172.21.15.132:0/3597081645 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 297129633 0 0) 0x7f6194003520 con 0x7f61a80ad2f0 2023-12-20T04:51:30.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.924+0000 7f61accd8640 1 -- 172.21.15.132:0/3597081645 >> v2:172.21.15.187:3300/0 conn(0x7f61a815d2d0 msgr2=0x7f61a80cecc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:30.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.924+0000 7f61accd8640 1 --2- 172.21.15.132:0/3597081645 >> v2:172.21.15.187:3300/0 conn(0x7f61a815d2d0 0x7f61a80cecc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.924+0000 7f61accd8640 1 -- 172.21.15.132:0/3597081645 >> v1:172.21.15.187:6789/0 conn(0x7f61a815cef0 legacy=0x7f61a80cd1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:30.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.924+0000 7f61accd8640 1 -- 172.21.15.132:0/3597081645 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a8072d00 con 0x7f61a80ad2f0 2023-12-20T04:51:30.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.924+0000 7f61accd8640 1 -- 172.21.15.132:0/3597081645 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f61a00019f0 con 0x7f61a80ad2f0 2023-12-20T04:51:30.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.925+0000 7f61accd8640 1 -- 172.21.15.132:0/3597081645 >> v1:172.21.15.132:6789/0 conn(0x7f61a80ad2f0 legacy=0x7f61a806bd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:30.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.925+0000 7f61accd8640 1 --2- 172.21.15.132:0/3597081645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194003970 0x7f6194003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.925+0000 7f61accd8640 1 --2- 172.21.15.132:0/3597081645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61940047c0 0x7f6194004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.925+0000 7f61accd8640 1 --2- 172.21.15.132:0/3597081645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6194005180 0x7f619400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.925+0000 7f61accd8640 1 -- 172.21.15.132:0/3597081645 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a80ae010 con 0x7f6194003970 2023-12-20T04:51:30.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.925+0000 7f61accd8640 1 -- 172.21.15.132:0/3597081645 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f619400c030 con 0x7f6194005180 2023-12-20T04:51:30.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.925+0000 7f61accd8640 1 -- 172.21.15.132:0/3597081645 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f619400c1f0 con 0x7f61940047c0 2023-12-20T04:51:30.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.925+0000 7f61adcda640 1 --2- 172.21.15.132:0/3597081645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194003970 0x7f6194003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.925+0000 7f61ae4db640 1 --2- 172.21.15.132:0/3597081645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6194005180 0x7f619400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.925+0000 7f61ad4d9640 1 --2- 172.21.15.132:0/3597081645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61940047c0 0x7f6194004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.925+0000 7f61adcda640 1 -- 172.21.15.132:0/3597081645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61940047c0 msgr2=0x7f6194004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:30.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.925+0000 7f61adcda640 1 --2- 172.21.15.132:0/3597081645 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61940047c0 0x7f6194004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.925+0000 7f61adcda640 1 -- 172.21.15.132:0/3597081645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6194005180 msgr2=0x7f619400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:30.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.925+0000 7f61adcda640 1 --2- 172.21.15.132:0/3597081645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6194005180 0x7f619400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.925+0000 7f61adcda640 1 -- 172.21.15.132:0/3597081645 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6194003520 con 0x7f6194003970 2023-12-20T04:51:30.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.925+0000 7f61ae4db640 1 --2- 172.21.15.132:0/3597081645 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6194005180 0x7f619400b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:30.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.925+0000 7f61ae4db640 1 -- 172.21.15.132:0/3597081645 reap_dead start 2023-12-20T04:51:30.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.926+0000 7f61adcda640 1 --2- 172.21.15.132:0/3597081645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194003970 0x7f6194003d90 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f61a4001750 tx=0x7f61940057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b806f8314307dcc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:30.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.926+0000 7f61accd8640 1 -- 172.21.15.132:0/3597081645 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a40052d0 con 0x7f6194003970 2023-12-20T04:51:30.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.926+0000 7f61accd8640 1 -- 172.21.15.132:0/3597081645 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a402e050 con 0x7f6194003970 2023-12-20T04:51:30.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.926+0000 7f61accd8640 1 -- 172.21.15.132:0/3597081645 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4003830 con 0x7f6194003970 2023-12-20T04:51:30.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.926+0000 7f61aff3e640 1 -- 172.21.15.132:0/3597081645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194003970 msgr2=0x7f6194003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:30.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.926+0000 7f61aff3e640 1 --2- 172.21.15.132:0/3597081645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194003970 0x7f6194003d90 secure :-1 s=READY pgs=1564 cs=0 l=1 rev1=1 crypto rx=0x7f61a4001750 tx=0x7f61940057f0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.926+0000 7f61aff3e640 1 -- 172.21.15.132:0/3597081645 shutdown_connections 2023-12-20T04:51:30.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.926+0000 7f61aff3e640 1 --2- 172.21.15.132:0/3597081645 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194003970 0x7f6194003d90 unknown :-1 s=CLOSED pgs=1564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.926+0000 7f61aff3e640 1 -- 172.21.15.132:0/3597081645 >> 172.21.15.132:0/3597081645 conn(0x7f61a80cf330 msgr2=0x7f61a80cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:30.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.926+0000 7f61aff3e640 1 -- 172.21.15.132:0/3597081645 shutdown_connections 2023-12-20T04:51:30.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.926+0000 7f61aff3e640 1 -- 172.21.15.132:0/3597081645 wait complete. 2023-12-20T04:51:30.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.928+0000 7f61aff3e640 1 Processor -- start 2023-12-20T04:51:30.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.928+0000 7f61aff3e640 1 -- start start 2023-12-20T04:51:30.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.928+0000 7f61aff3e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194003970 0x7f61a80c50d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.928+0000 7f61aff3e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61a815a460 0x7f61a81589e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.928+0000 7f61aff3e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61a8070b20 0x7f61a8070fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.928+0000 7f61aff3e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a815b7e0 con 0x7f6194003970 2023-12-20T04:51:30.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.928+0000 7f61aff3e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f61a80714e0 con 0x7f61a8070b20 2023-12-20T04:51:30.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.928+0000 7f61aff3e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f61a815a8e0 con 0x7f61a815a460 2023-12-20T04:51:30.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.928+0000 7f61adcda640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194003970 0x7f61a80c50d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.928+0000 7f61adcda640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194003970 0x7f61a80c50d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35396/0 (socket says 172.21.15.132:35396) 2023-12-20T04:51:30.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.928+0000 7f61adcda640 1 -- 172.21.15.132:0/568656389 learned_addr learned my addr 172.21.15.132:0/568656389 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:30.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.929+0000 7f61ad4d9640 1 --2- 172.21.15.132:0/568656389 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61a815a460 0x7f61a81589e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.929+0000 7f61ae4db640 1 --2- 172.21.15.132:0/568656389 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61a8070b20 0x7f61a8070fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.929+0000 7f61adcda640 1 -- 172.21.15.132:0/568656389 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61a815a460 msgr2=0x7f61a81589e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.929+0000 7f61adcda640 1 --2- 172.21.15.132:0/568656389 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61a815a460 0x7f61a81589e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.929+0000 7f61adcda640 1 -- 172.21.15.132:0/568656389 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61a8070b20 msgr2=0x7f61a8070fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.929+0000 7f61adcda640 1 --2- 172.21.15.132:0/568656389 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61a8070b20 0x7f61a8070fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.929+0000 7f61adcda640 1 -- 172.21.15.132:0/568656389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f61a815ab60 con 0x7f6194003970 2023-12-20T04:51:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.929+0000 7f61ad4d9640 1 --2- 172.21.15.132:0/568656389 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61a815a460 0x7f61a81589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.929+0000 7f61ae4db640 1 --2- 172.21.15.132:0/568656389 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61a8070b20 0x7f61a8070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.929+0000 7f61adcda640 1 --2- 172.21.15.132:0/568656389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194003970 0x7f61a80c50d0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f61a4005040 tx=0x7f61a4001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.929+0000 7f619e7fc640 1 -- 172.21.15.132:0/568656389 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4007a30 con 0x7f6194003970 2023-12-20T04:51:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.929+0000 7f619e7fc640 1 -- 172.21.15.132:0/568656389 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f61a40069e0 con 0x7f6194003970 2023-12-20T04:51:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.929+0000 7f619e7fc640 1 -- 172.21.15.132:0/568656389 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f61a4006d70 con 0x7f6194003970 2023-12-20T04:51:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.929+0000 7f61aff3e640 1 -- 172.21.15.132:0/568656389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f61a815ae40 con 0x7f6194003970 2023-12-20T04:51:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.929+0000 7f61aff3e640 1 -- 172.21.15.132:0/568656389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f61a815b400 con 0x7f6194003970 2023-12-20T04:51:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.930+0000 7f61aff3e640 1 -- 172.21.15.132:0/568656389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f61a815b590 con 0x7f6194003970 2023-12-20T04:51:30.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.930+0000 7f619e7fc640 1 -- 172.21.15.132:0/568656389 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f61a40035f0 con 0x7f6194003970 2023-12-20T04:51:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.931+0000 7f619e7fc640 1 --2- 172.21.15.132:0/568656389 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f618c06a430 0x7f618c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.931+0000 7f619e7fc640 1 -- 172.21.15.132:0/568656389 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f61a40aaa70 con 0x7f6194003970 2023-12-20T04:51:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.931+0000 7f61ad4d9640 1 --2- 172.21.15.132:0/568656389 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f618c06a430 0x7f618c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.931+0000 7f619e7fc640 1 -- 172.21.15.132:0/568656389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f618c072020 con 0x7f6194003970 2023-12-20T04:51:30.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.931+0000 7f61ad4d9640 1 --2- 172.21.15.132:0/568656389 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f618c06a430 0x7f618c06c8f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f61a815c140 tx=0x7f6198008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:30.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:30.935+0000 7f619e7fc640 1 -- 172.21.15.132:0/568656389 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f61a404b020 con 0x7f6194003970 2023-12-20T04:51:31.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.100+0000 7f61aff3e640 1 -- 172.21.15.132:0/568656389 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f61a804e840 con 0x7f6194003970 2023-12-20T04:51:31.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.102+0000 7f619e7fc640 1 -- 172.21.15.132:0/568656389 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+16227 (secure 0 0 0) 0x7f61a40761d0 con 0x7f6194003970 2023-12-20T04:51:31.104 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:31.104 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":157,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:50:39.874578+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:49:31.238506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-20T04:49:32.189571+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.3","mappings":[{"from":2,"to":0}]},{"pgid":"19.31","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:51:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.104+0000 7f61aff3e640 1 -- 172.21.15.132:0/568656389 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f618c06a430 msgr2=0x7f618c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.104+0000 7f61aff3e640 1 --2- 172.21.15.132:0/568656389 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f618c06a430 0x7f618c06c8f0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7f61a815c140 tx=0x7f6198008040 comp rx=0 tx=0).stop 2023-12-20T04:51:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.104+0000 7f61aff3e640 1 -- 172.21.15.132:0/568656389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194003970 msgr2=0x7f61a80c50d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.104+0000 7f61aff3e640 1 --2- 172.21.15.132:0/568656389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194003970 0x7f61a80c50d0 secure :-1 s=READY pgs=1565 cs=0 l=1 rev1=1 crypto rx=0x7f61a4005040 tx=0x7f61a4001120 comp rx=0 tx=0).stop 2023-12-20T04:51:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.104+0000 7f61aff3e640 1 -- 172.21.15.132:0/568656389 shutdown_connections 2023-12-20T04:51:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.104+0000 7f61aff3e640 1 --2- 172.21.15.132:0/568656389 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f618c06a430 0x7f618c06c8f0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.104+0000 7f61aff3e640 1 --2- 172.21.15.132:0/568656389 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f61a8070b20 0x7f61a8070fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.104+0000 7f61aff3e640 1 --2- 172.21.15.132:0/568656389 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f61a815a460 0x7f61a81589e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.104+0000 7f61aff3e640 1 --2- 172.21.15.132:0/568656389 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6194003970 0x7f61a80c50d0 unknown :-1 s=CLOSED pgs=1565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.104+0000 7f61aff3e640 1 -- 172.21.15.132:0/568656389 >> 172.21.15.132:0/568656389 conn(0x7f61a80cf330 msgr2=0x7f61a80b0390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:31.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.104+0000 7f61aff3e640 1 -- 172.21.15.132:0/568656389 shutdown_connections 2023-12-20T04:51:31.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.104+0000 7f61aff3e640 1 -- 172.21.15.132:0/568656389 wait complete. 2023-12-20T04:51:31.117 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:49:31.238506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:49:32.189571+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:51:31.117 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:51:31.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.218+0000 7f018068f640 1 Processor -- start 2023-12-20T04:51:31.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.218+0000 7f018068f640 1 -- start start 2023-12-20T04:51:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.219+0000 7f018068f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0178143510 0x7f01780c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.219+0000 7f018068f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f01780cb060 0x7f01780ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.219+0000 7f018068f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f01780c9a00 0x7f01780cd4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.219+0000 7f018068f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01780cabd0 con 0x7f01780cb060 2023-12-20T04:51:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.219+0000 7f018068f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01780c9fc0 con 0x7f01780c9a00 2023-12-20T04:51:31.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.219+0000 7f018068f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01780ca2a0 con 0x7f0178143510 2023-12-20T04:51:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.219+0000 7f017dc2a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f01780cb060 0x7f01780ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.219+0000 7f017dc2a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f01780cb060 0x7f01780ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35412/0 (socket says 172.21.15.132:35412) 2023-12-20T04:51:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.219+0000 7f017dc2a640 1 -- 172.21.15.132:0/1307074065 learned_addr learned my addr 172.21.15.132:0/1307074065 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.219+0000 7f017ec2c640 1 --2- 172.21.15.132:0/1307074065 >> v2:172.21.15.187:3300/0 conn(0x7f01780c9a00 0x7f01780cd4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.219+0000 7f017e42b640 1 --2- 172.21.15.132:0/1307074065 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0178143510 0x7f01780c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.219+0000 7f017dc2a640 1 -- 172.21.15.132:0/1307074065 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0178143510 msgr2=0x7f01780c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.219+0000 7f017dc2a640 1 --2- 172.21.15.132:0/1307074065 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0178143510 0x7f01780c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.219+0000 7f017dc2a640 1 -- 172.21.15.132:0/1307074065 >> v2:172.21.15.187:3300/0 conn(0x7f01780c9a00 msgr2=0x7f01780cd4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.219+0000 7f017dc2a640 1 --2- 172.21.15.132:0/1307074065 >> v2:172.21.15.187:3300/0 conn(0x7f01780c9a00 0x7f01780cd4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.219+0000 7f017dc2a640 1 -- 172.21.15.132:0/1307074065 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01780ca580 con 0x7f01780cb060 2023-12-20T04:51:31.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.220+0000 7f017dc2a640 1 --2- 172.21.15.132:0/1307074065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01780cb060 0x7f01780ccf80 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f01780ccbe0 tx=0x7f016802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63bf7e1352dfd90d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:31.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.220+0000 7f017d429640 1 -- 172.21.15.132:0/1307074065 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168031870 con 0x7f01780cb060 2023-12-20T04:51:31.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.220+0000 7f017d429640 1 -- 172.21.15.132:0/1307074065 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01680319d0 con 0x7f01780cb060 2023-12-20T04:51:31.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.220+0000 7f017d429640 1 -- 172.21.15.132:0/1307074065 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0168031d60 con 0x7f01780cb060 2023-12-20T04:51:31.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.221+0000 7f018068f640 1 -- 172.21.15.132:0/1307074065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01780cb060 msgr2=0x7f01780ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.221+0000 7f018068f640 1 --2- 172.21.15.132:0/1307074065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01780cb060 0x7f01780ccf80 secure :-1 s=READY pgs=1566 cs=0 l=1 rev1=1 crypto rx=0x7f01780ccbe0 tx=0x7f016802b910 comp rx=0 tx=0).stop 2023-12-20T04:51:31.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.221+0000 7f018068f640 1 -- 172.21.15.132:0/1307074065 shutdown_connections 2023-12-20T04:51:31.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.221+0000 7f018068f640 1 --2- 172.21.15.132:0/1307074065 >> v2:172.21.15.187:3300/0 conn(0x7f01780c9a00 0x7f01780cd4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.221+0000 7f018068f640 1 --2- 172.21.15.132:0/1307074065 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01780cb060 0x7f01780ccf80 unknown :-1 s=CLOSED pgs=1566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.221+0000 7f018068f640 1 --2- 172.21.15.132:0/1307074065 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0178143510 0x7f01780c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.221+0000 7f018068f640 1 -- 172.21.15.132:0/1307074065 >> 172.21.15.132:0/1307074065 conn(0x7f017806a260 msgr2=0x7f01780b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:31.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.221+0000 7f018068f640 1 -- 172.21.15.132:0/1307074065 shutdown_connections 2023-12-20T04:51:31.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.221+0000 7f018068f640 1 -- 172.21.15.132:0/1307074065 wait complete. 2023-12-20T04:51:31.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.222+0000 7f018068f640 1 Processor -- start 2023-12-20T04:51:31.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.222+0000 7f018068f640 1 -- start start 2023-12-20T04:51:31.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f018068f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01780c9a00 0x7f017813c100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f018068f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01780cb060 0x7f01780b3540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f018068f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0178143510 0x7f0178159510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f018068f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01780b4610 con 0x7f01780cb060 2023-12-20T04:51:31.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f018068f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01780b3d70 con 0x7f01780c9a00 2023-12-20T04:51:31.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f018068f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01780b4050 con 0x7f0178143510 2023-12-20T04:51:31.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f017dc2a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01780cb060 0x7f01780b3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f017dc2a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01780cb060 0x7f01780b3540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35428/0 (socket says 172.21.15.132:35428) 2023-12-20T04:51:31.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f017dc2a640 1 -- 172.21.15.132:0/2612733639 learned_addr learned my addr 172.21.15.132:0/2612733639 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:31.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f017e42b640 1 --2- 172.21.15.132:0/2612733639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01780c9a00 0x7f017813c100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f017ec2c640 1 --2- 172.21.15.132:0/2612733639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0178143510 0x7f0178159510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f017dc2a640 1 -- 172.21.15.132:0/2612733639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0178143510 msgr2=0x7f0178159510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f017dc2a640 1 --2- 172.21.15.132:0/2612733639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0178143510 0x7f0178159510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f017dc2a640 1 -- 172.21.15.132:0/2612733639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01780c9a00 msgr2=0x7f017813c100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f017dc2a640 1 --2- 172.21.15.132:0/2612733639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01780c9a00 0x7f017813c100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f017dc2a640 1 -- 172.21.15.132:0/2612733639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01680094d0 con 0x7f01780cb060 2023-12-20T04:51:31.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f017e42b640 1 --2- 172.21.15.132:0/2612733639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01780c9a00 0x7f017813c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:31.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f017ec2c640 1 --2- 172.21.15.132:0/2612733639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0178143510 0x7f0178159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:31.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f017dc2a640 1 --2- 172.21.15.132:0/2612733639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01780cb060 0x7f01780b3540 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f016802b950 tx=0x7f01680046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:31.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f016effd640 1 -- 172.21.15.132:0/2612733639 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f016803ac60 con 0x7f01780cb060 2023-12-20T04:51:31.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f016effd640 1 -- 172.21.15.132:0/2612733639 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f016803adc0 con 0x7f01780cb060 2023-12-20T04:51:31.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f016effd640 1 -- 172.21.15.132:0/2612733639 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01680445f0 con 0x7f01780cb060 2023-12-20T04:51:31.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f018068f640 1 -- 172.21.15.132:0/2612733639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01780b4330 con 0x7f01780cb060 2023-12-20T04:51:31.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.223+0000 7f018068f640 1 -- 172.21.15.132:0/2612733639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01780b3a80 con 0x7f01780cb060 2023-12-20T04:51:31.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.224+0000 7f018068f640 1 -- 172.21.15.132:0/2612733639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0178138f80 con 0x7f01780cb060 2023-12-20T04:51:31.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.225+0000 7f016effd640 1 -- 172.21.15.132:0/2612733639 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f016804d450 con 0x7f01780cb060 2023-12-20T04:51:31.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.225+0000 7f016effd640 1 --2- 172.21.15.132:0/2612733639 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f015c06a460 0x7f015c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.225+0000 7f016effd640 1 -- 172.21.15.132:0/2612733639 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f016802d040 con 0x7f01780cb060 2023-12-20T04:51:31.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.225+0000 7f017e42b640 1 --2- 172.21.15.132:0/2612733639 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f015c06a460 0x7f015c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.225+0000 7f016effd640 1 -- 172.21.15.132:0/2612733639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f015c072050 con 0x7f01780cb060 2023-12-20T04:51:31.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.226+0000 7f017e42b640 1 --2- 172.21.15.132:0/2612733639 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f015c06a460 0x7f015c06c920 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f017400b970 tx=0x7f0174008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:31.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.229+0000 7f016effd640 1 -- 172.21.15.132:0/2612733639 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0168035060 con 0x7f01780cb060 2023-12-20T04:51:31.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.398+0000 7f018068f640 1 -- 172.21.15.132:0/2612733639 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f017804e840 con 0x7f01780cb060 2023-12-20T04:51:31.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.399+0000 7f016effd640 1 -- 172.21.15.132:0/2612733639 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v157) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0178138f80 con 0x7f01780cb060 2023-12-20T04:51:31.401 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:51:31.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.401+0000 7f018068f640 1 -- 172.21.15.132:0/2612733639 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f015c06a460 msgr2=0x7f015c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.401+0000 7f018068f640 1 --2- 172.21.15.132:0/2612733639 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f015c06a460 0x7f015c06c920 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7f017400b970 tx=0x7f0174008040 comp rx=0 tx=0).stop 2023-12-20T04:51:31.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.401+0000 7f018068f640 1 -- 172.21.15.132:0/2612733639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01780cb060 msgr2=0x7f01780b3540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.401+0000 7f018068f640 1 --2- 172.21.15.132:0/2612733639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01780cb060 0x7f01780b3540 secure :-1 s=READY pgs=1567 cs=0 l=1 rev1=1 crypto rx=0x7f016802b950 tx=0x7f01680046c0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.401+0000 7f018068f640 1 -- 172.21.15.132:0/2612733639 shutdown_connections 2023-12-20T04:51:31.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.401+0000 7f018068f640 1 --2- 172.21.15.132:0/2612733639 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f015c06a460 0x7f015c06c920 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.401+0000 7f018068f640 1 --2- 172.21.15.132:0/2612733639 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0178143510 0x7f0178159510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.401+0000 7f018068f640 1 --2- 172.21.15.132:0/2612733639 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01780cb060 0x7f01780b3540 unknown :-1 s=CLOSED pgs=1567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.401+0000 7f018068f640 1 --2- 172.21.15.132:0/2612733639 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f01780c9a00 0x7f017813c100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.401+0000 7f018068f640 1 -- 172.21.15.132:0/2612733639 >> 172.21.15.132:0/2612733639 conn(0x7f017806a260 msgr2=0x7f017815d7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:31.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.401+0000 7f018068f640 1 -- 172.21.15.132:0/2612733639 shutdown_connections 2023-12-20T04:51:31.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.401+0000 7f018068f640 1 -- 172.21.15.132:0/2612733639 wait complete. 2023-12-20T04:51:31.413 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:51:31.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.514+0000 7f4f48ece640 1 Processor -- start 2023-12-20T04:51:31.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.514+0000 7f4f48ece640 1 -- start start 2023-12-20T04:51:31.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.515+0000 7f4f48ece640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4f440cf880 0x7f4f440cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.515+0000 7f4f48ece640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4f440b60e0 0x7f4f440b64f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.515+0000 7f4f48ece640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f440d1a90 con 0x7f4f4415d300 2023-12-20T04:51:31.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.515+0000 7f4f48ece640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f440d0250 con 0x7f4f440cf880 2023-12-20T04:51:31.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.515+0000 7f4f48ece640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f440d1d70 con 0x7f4f440b60e0 2023-12-20T04:51:31.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.515+0000 7f4f3bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4f440cf880 0x7f4f440cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.515+0000 7f4f3bfff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4f440cf880 0x7f4f440cfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35436/0 (socket says 172.21.15.132:35436) 2023-12-20T04:51:31.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.515+0000 7f4f3bfff640 1 -- 172.21.15.132:0/1975278201 learned_addr learned my addr 172.21.15.132:0/1975278201 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:31.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.515+0000 7f4f42d9d640 1 --2- 172.21.15.132:0/1975278201 >> v2:172.21.15.187:3300/0 conn(0x7f4f440b60e0 0x7f4f440b64f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.515+0000 7f4f3bfff640 1 -- 172.21.15.132:0/1975278201 >> v2:172.21.15.187:3300/0 conn(0x7f4f440b60e0 msgr2=0x7f4f440b64f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:31.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.515+0000 7f4f3bfff640 1 --2- 172.21.15.132:0/1975278201 >> v2:172.21.15.187:3300/0 conn(0x7f4f440b60e0 0x7f4f440b64f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.515+0000 7f4f3bfff640 1 -- 172.21.15.132:0/1975278201 >> v1:172.21.15.187:6789/0 conn(0x7f4f4415d300 legacy=0x7f4f440d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.515+0000 7f4f3bfff640 1 -- 172.21.15.132:0/1975278201 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f440d2050 con 0x7f4f440cf880 2023-12-20T04:51:31.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.516+0000 7f4f3bfff640 1 --2- 172.21.15.132:0/1975278201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f440cf880 0x7f4f440cfd10 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f4f440d07c0 tx=0x7f4f2c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2704b91ab24a47e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:31.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.516+0000 7f4f41d9b640 1 -- 172.21.15.132:0/1975278201 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c004230 con 0x7f4f440cf880 2023-12-20T04:51:31.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.516+0000 7f4f41d9b640 1 -- 172.21.15.132:0/1975278201 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c004390 con 0x7f4f440cf880 2023-12-20T04:51:31.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.516+0000 7f4f41d9b640 1 -- 172.21.15.132:0/1975278201 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c030840 con 0x7f4f440cf880 2023-12-20T04:51:31.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.517+0000 7f4f48ece640 1 -- 172.21.15.132:0/1975278201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f440cf880 msgr2=0x7f4f440cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.517+0000 7f4f48ece640 1 --2- 172.21.15.132:0/1975278201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f440cf880 0x7f4f440cfd10 secure :-1 s=READY pgs=1568 cs=0 l=1 rev1=1 crypto rx=0x7f4f440d07c0 tx=0x7f4f2c02b980 comp rx=0 tx=0).stop 2023-12-20T04:51:31.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.517+0000 7f4f48ece640 1 -- 172.21.15.132:0/1975278201 shutdown_connections 2023-12-20T04:51:31.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.517+0000 7f4f48ece640 1 --2- 172.21.15.132:0/1975278201 >> v2:172.21.15.187:3300/0 conn(0x7f4f440b60e0 0x7f4f440b64f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.517+0000 7f4f48ece640 1 --2- 172.21.15.132:0/1975278201 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f440cf880 0x7f4f440cfd10 unknown :-1 s=CLOSED pgs=1568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.517+0000 7f4f48ece640 1 -- 172.21.15.132:0/1975278201 >> 172.21.15.132:0/1975278201 conn(0x7f4f4406a3d0 msgr2=0x7f4f4406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:31.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.517+0000 7f4f48ece640 1 -- 172.21.15.132:0/1975278201 shutdown_connections 2023-12-20T04:51:31.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.517+0000 7f4f48ece640 1 -- 172.21.15.132:0/1975278201 wait complete. 2023-12-20T04:51:31.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.518+0000 7f4f48ece640 1 Processor -- start 2023-12-20T04:51:31.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.518+0000 7f4f48ece640 1 -- start start 2023-12-20T04:51:31.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f48ece640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f440b60e0 0x7f4f440b47e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f48ece640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f440cf880 0x7f4f441f3ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f48ece640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f4415d300 0x7f4f440cada0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f48ece640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f440b50a0 con 0x7f4f440cf880 2023-12-20T04:51:31.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f48ece640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f440c9fe0 con 0x7f4f4415d300 2023-12-20T04:51:31.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f48ece640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f440ca2c0 con 0x7f4f440b60e0 2023-12-20T04:51:31.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f3bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f440cf880 0x7f4f441f3ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f3bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f440cf880 0x7f4f441f3ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35444/0 (socket says 172.21.15.132:35444) 2023-12-20T04:51:31.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f3bfff640 1 -- 172.21.15.132:0/2485391858 learned_addr learned my addr 172.21.15.132:0/2485391858 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:31.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f4259c640 1 --2- 172.21.15.132:0/2485391858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f440b60e0 0x7f4f440b47e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f42d9d640 1 --2- 172.21.15.132:0/2485391858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f4415d300 0x7f4f440cada0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f3bfff640 1 -- 172.21.15.132:0/2485391858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f440b60e0 msgr2=0x7f4f440b47e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f3bfff640 1 --2- 172.21.15.132:0/2485391858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f440b60e0 0x7f4f440b47e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f3bfff640 1 -- 172.21.15.132:0/2485391858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f4415d300 msgr2=0x7f4f440cada0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f3bfff640 1 --2- 172.21.15.132:0/2485391858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f4415d300 0x7f4f440cada0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f3bfff640 1 -- 172.21.15.132:0/2485391858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f2c009460 con 0x7f4f440cf880 2023-12-20T04:51:31.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f3bfff640 1 --2- 172.21.15.132:0/2485391858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f440cf880 0x7f4f441f3ae0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c000c00 tx=0x7f4f2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:31.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f3affd640 1 -- 172.21.15.132:0/2485391858 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c03e070 con 0x7f4f440cf880 2023-12-20T04:51:31.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f3affd640 1 -- 172.21.15.132:0/2485391858 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f2c004500 con 0x7f4f440cf880 2023-12-20T04:51:31.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f48ece640 1 -- 172.21.15.132:0/2485391858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f440ca5a0 con 0x7f4f440cf880 2023-12-20T04:51:31.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f3affd640 1 -- 172.21.15.132:0/2485391858 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f2c030e40 con 0x7f4f440cf880 2023-12-20T04:51:31.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.519+0000 7f4f48ece640 1 -- 172.21.15.132:0/2485391858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f440b4d20 con 0x7f4f440cf880 2023-12-20T04:51:31.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.520+0000 7f4f48ece640 1 -- 172.21.15.132:0/2485391858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f4404e840 con 0x7f4f440cf880 2023-12-20T04:51:31.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.521+0000 7f4f3affd640 1 -- 172.21.15.132:0/2485391858 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4f2c003610 con 0x7f4f440cf880 2023-12-20T04:51:31.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.521+0000 7f4f3affd640 1 --2- 172.21.15.132:0/2485391858 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f2406a430 0x7f4f2406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.521+0000 7f4f3affd640 1 -- 172.21.15.132:0/2485391858 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f4f2c0aaa90 con 0x7f4f440cf880 2023-12-20T04:51:31.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.521+0000 7f4f4259c640 1 --2- 172.21.15.132:0/2485391858 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f2406a430 0x7f4f2406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.521+0000 7f4f3affd640 1 -- 172.21.15.132:0/2485391858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f4f24072020 con 0x7f4f440cf880 2023-12-20T04:51:31.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.522+0000 7f4f4259c640 1 --2- 172.21.15.132:0/2485391858 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f2406a430 0x7f4f2406c8f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4f34000f60 tx=0x7f4f34009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:31.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.525+0000 7f4f3affd640 1 -- 172.21.15.132:0/2485391858 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4f2c076040 con 0x7f4f440cf880 2023-12-20T04:51:31.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.689+0000 7f4f48ece640 1 -- 172.21.15.132:0/2485391858 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4f4415b6c0 con 0x7f4f440cf880 2023-12-20T04:51:31.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.689+0000 7f4f3affd640 1 -- 172.21.15.132:0/2485391858 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v157) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4f2c048070 con 0x7f4f440cf880 2023-12-20T04:51:31.691 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:51:31.693 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.691+0000 7f4f48ece640 1 -- 172.21.15.132:0/2485391858 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f2406a430 msgr2=0x7f4f2406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.691+0000 7f4f48ece640 1 --2- 172.21.15.132:0/2485391858 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f2406a430 0x7f4f2406c8f0 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7f4f34000f60 tx=0x7f4f34009040 comp rx=0 tx=0).stop 2023-12-20T04:51:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.691+0000 7f4f48ece640 1 -- 172.21.15.132:0/2485391858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f440cf880 msgr2=0x7f4f441f3ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.691+0000 7f4f48ece640 1 --2- 172.21.15.132:0/2485391858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f440cf880 0x7f4f441f3ae0 secure :-1 s=READY pgs=1569 cs=0 l=1 rev1=1 crypto rx=0x7f4f2c000c00 tx=0x7f4f2c0046c0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.691+0000 7f4f48ece640 1 -- 172.21.15.132:0/2485391858 shutdown_connections 2023-12-20T04:51:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.691+0000 7f4f48ece640 1 --2- 172.21.15.132:0/2485391858 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f2406a430 0x7f4f2406c8f0 unknown :-1 s=CLOSED pgs=660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.691+0000 7f4f48ece640 1 --2- 172.21.15.132:0/2485391858 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f4415d300 0x7f4f440cada0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.691+0000 7f4f48ece640 1 --2- 172.21.15.132:0/2485391858 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f440cf880 0x7f4f441f3ae0 unknown :-1 s=CLOSED pgs=1569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.691+0000 7f4f48ece640 1 --2- 172.21.15.132:0/2485391858 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f440b60e0 0x7f4f440b47e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.691+0000 7f4f48ece640 1 -- 172.21.15.132:0/2485391858 >> 172.21.15.132:0/2485391858 conn(0x7f4f4406a3d0 msgr2=0x7f4f441589e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.691+0000 7f4f48ece640 1 -- 172.21.15.132:0/2485391858 shutdown_connections 2023-12-20T04:51:31.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.691+0000 7f4f48ece640 1 -- 172.21.15.132:0/2485391858 wait complete. 2023-12-20T04:51:31.704 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:51:31.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.805+0000 7ff701a4a640 1 Processor -- start 2023-12-20T04:51:31.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.805+0000 7ff701a4a640 1 -- start start 2023-12-20T04:51:31.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.805+0000 7ff701a4a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff6fc0cfc40 0x7ff6fc0b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.805+0000 7ff701a4a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc0d2920 con 0x7ff6fc0cf790 2023-12-20T04:51:31.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.806+0000 7ff701a4a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6fc0d1d10 con 0x7ff6fc15d300 2023-12-20T04:51:31.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.806+0000 7ff701a4a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6fc0d1ff0 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.806+0000 7ff6fb7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff6fc0cfc40 0x7ff6fc0b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.806+0000 7ff6fa7fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff6fc0cf790 0x7ff6fc0b6080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53936/0 (socket says 172.21.15.132:53936) 2023-12-20T04:51:31.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.806+0000 7ff6fa7fc640 1 -- 172.21.15.132:0/62853567 learned_addr learned my addr 172.21.15.132:0/62853567 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:31.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.806+0000 7ff6fb7fe640 1 -- 172.21.15.132:0/62853567 >> v1:172.21.15.187:6789/0 conn(0x7ff6fc15d300 legacy=0x7ff6fc0d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.806+0000 7ff6fb7fe640 1 -- 172.21.15.132:0/62853567 >> v1:172.21.15.132:6789/0 conn(0x7ff6fc0cf790 legacy=0x7ff6fc0b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.806+0000 7ff6fb7fe640 1 -- 172.21.15.132:0/62853567 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6fc0d22d0 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.807+0000 7ff6fb7fe640 1 --2- 172.21.15.132:0/62853567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6fc0cfc40 0x7ff6fc0b6790 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009d90 tx=0x7ff6f402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=680d07953ea7230b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:31.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.807+0000 7ff6f9ffb640 1 -- 172.21.15.132:0/62853567 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f402cd00 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.807+0000 7ff6f9ffb640 1 -- 172.21.15.132:0/62853567 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f402ce60 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.807+0000 7ff6f9ffb640 1 -- 172.21.15.132:0/62853567 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f4034660 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.807+0000 7ff701a4a640 1 -- 172.21.15.132:0/62853567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6fc0cfc40 msgr2=0x7ff6fc0b6790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.807+0000 7ff701a4a640 1 --2- 172.21.15.132:0/62853567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6fc0cfc40 0x7ff6fc0b6790 secure :-1 s=READY pgs=1571 cs=0 l=1 rev1=1 crypto rx=0x7ff6f4009d90 tx=0x7ff6f402bf50 comp rx=0 tx=0).stop 2023-12-20T04:51:31.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.807+0000 7ff701a4a640 1 -- 172.21.15.132:0/62853567 shutdown_connections 2023-12-20T04:51:31.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.807+0000 7ff701a4a640 1 --2- 172.21.15.132:0/62853567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6fc0cfc40 0x7ff6fc0b6790 unknown :-1 s=CLOSED pgs=1571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.807+0000 7ff701a4a640 1 -- 172.21.15.132:0/62853567 >> 172.21.15.132:0/62853567 conn(0x7ff6fc06a3d0 msgr2=0x7ff6fc06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:31.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.807+0000 7ff701a4a640 1 -- 172.21.15.132:0/62853567 shutdown_connections 2023-12-20T04:51:31.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.807+0000 7ff701a4a640 1 -- 172.21.15.132:0/62853567 wait complete. 2023-12-20T04:51:31.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.809+0000 7ff701a4a640 1 Processor -- start 2023-12-20T04:51:31.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.809+0000 7ff701a4a640 1 -- start start 2023-12-20T04:51:31.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.809+0000 7ff701a4a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6fc0cf790 0x7ff6fc15f650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.809+0000 7ff701a4a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6fc0cfc40 0x7ff6fc15fb90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.809+0000 7ff701a4a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6fc15d300 0x7ff6fc1f6790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.809+0000 7ff701a4a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc0cc160 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.809+0000 7ff701a4a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc14aac0 con 0x7ff6fc15d300 2023-12-20T04:51:31.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.809+0000 7ff701a4a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6fc15ddd0 con 0x7ff6fc0cf790 2023-12-20T04:51:31.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.809+0000 7ff6fa7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6fc0cfc40 0x7ff6fc15fb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.810+0000 7ff6fa7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6fc0cfc40 0x7ff6fc15fb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35468/0 (socket says 172.21.15.132:35468) 2023-12-20T04:51:31.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.810+0000 7ff6fa7fc640 1 -- 172.21.15.132:0/3410750572 learned_addr learned my addr 172.21.15.132:0/3410750572 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.810+0000 7ff6fb7fe640 1 --2- 172.21.15.132:0/3410750572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6fc15d300 0x7ff6fc1f6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.810+0000 7ff6faffd640 1 --2- 172.21.15.132:0/3410750572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6fc0cf790 0x7ff6fc15f650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.810+0000 7ff6fa7fc640 1 -- 172.21.15.132:0/3410750572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6fc0cf790 msgr2=0x7ff6fc15f650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.810+0000 7ff6fa7fc640 1 --2- 172.21.15.132:0/3410750572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6fc0cf790 0x7ff6fc15f650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.810+0000 7ff6fa7fc640 1 -- 172.21.15.132:0/3410750572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6fc15d300 msgr2=0x7ff6fc1f6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.810+0000 7ff6fa7fc640 1 --2- 172.21.15.132:0/3410750572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6fc15d300 0x7ff6fc1f6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.810+0000 7ff6fa7fc640 1 -- 172.21.15.132:0/3410750572 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6f4009a70 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.810+0000 7ff6faffd640 1 --2- 172.21.15.132:0/3410750572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6fc0cf790 0x7ff6fc15f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.810+0000 7ff6fa7fc640 1 --2- 172.21.15.132:0/3410750572 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6fc0cfc40 0x7ff6fc15fb90 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000c480 tx=0x7ff6f000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.810+0000 7ff6e3fff640 1 -- 172.21.15.132:0/3410750572 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f0005ce0 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.810+0000 7ff6e3fff640 1 -- 172.21.15.132:0/3410750572 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6f0005e40 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.810+0000 7ff701a4a640 1 -- 172.21.15.132:0/3410750572 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6fc1f7370 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.810+0000 7ff6e3fff640 1 -- 172.21.15.132:0/3410750572 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6f00072d0 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.810+0000 7ff701a4a640 1 -- 172.21.15.132:0/3410750572 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6fc15d780 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.811+0000 7ff701a4a640 1 -- 172.21.15.132:0/3410750572 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6fc04e840 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.812+0000 7ff6e3fff640 1 -- 172.21.15.132:0/3410750572 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff6f00074f0 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.812+0000 7ff6e3fff640 1 --2- 172.21.15.132:0/3410750572 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6e806a430 0x7ff6e806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:31.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.812+0000 7ff6e3fff640 1 -- 172.21.15.132:0/3410750572 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ff6f0087db0 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.812+0000 7ff6faffd640 1 --2- 172.21.15.132:0/3410750572 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6e806a430 0x7ff6e806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:31.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.812+0000 7ff6e3fff640 1 -- 172.21.15.132:0/3410750572 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7ff6e8072020 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.815 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.812+0000 7ff6faffd640 1 --2- 172.21.15.132:0/3410750572 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6e806a430 0x7ff6e806c8f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc154b60 tx=0x7ff6ec009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:31.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.816+0000 7ff6e3fff640 1 -- 172.21.15.132:0/3410750572 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff6f0053420 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.980+0000 7ff701a4a640 1 -- 172.21.15.132:0/3410750572 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7ff6fc0cd7f0 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.981+0000 7ff6e3fff640 1 -- 172.21.15.132:0/3410750572 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v157) v1 ==== 100+0+11 (secure 0 0 0) 0x7ff6f0017070 con 0x7ff6fc0cfc40 2023-12-20T04:51:31.983 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:51:31.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.983+0000 7ff701a4a640 1 -- 172.21.15.132:0/3410750572 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6e806a430 msgr2=0x7ff6e806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.983+0000 7ff701a4a640 1 --2- 172.21.15.132:0/3410750572 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6e806a430 0x7ff6e806c8f0 secure :-1 s=READY pgs=661 cs=0 l=1 rev1=1 crypto rx=0x7ff6fc154b60 tx=0x7ff6ec009040 comp rx=0 tx=0).stop 2023-12-20T04:51:31.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.983+0000 7ff701a4a640 1 -- 172.21.15.132:0/3410750572 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6fc0cfc40 msgr2=0x7ff6fc15fb90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:31.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.983+0000 7ff701a4a640 1 --2- 172.21.15.132:0/3410750572 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6fc0cfc40 0x7ff6fc15fb90 secure :-1 s=READY pgs=1572 cs=0 l=1 rev1=1 crypto rx=0x7ff6f000c480 tx=0x7ff6f000c940 comp rx=0 tx=0).stop 2023-12-20T04:51:31.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.983+0000 7ff701a4a640 1 -- 172.21.15.132:0/3410750572 shutdown_connections 2023-12-20T04:51:31.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.983+0000 7ff701a4a640 1 --2- 172.21.15.132:0/3410750572 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6e806a430 0x7ff6e806c8f0 unknown :-1 s=CLOSED pgs=661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.983+0000 7ff701a4a640 1 --2- 172.21.15.132:0/3410750572 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6fc15d300 0x7ff6fc1f6790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.983+0000 7ff701a4a640 1 --2- 172.21.15.132:0/3410750572 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6fc0cfc40 0x7ff6fc15fb90 unknown :-1 s=CLOSED pgs=1572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.983+0000 7ff701a4a640 1 --2- 172.21.15.132:0/3410750572 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6fc0cf790 0x7ff6fc15f650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:31.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.983+0000 7ff701a4a640 1 -- 172.21.15.132:0/3410750572 >> 172.21.15.132:0/3410750572 conn(0x7ff6fc06a3d0 msgr2=0x7ff6fc0b6320 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:31.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.983+0000 7ff701a4a640 1 -- 172.21.15.132:0/3410750572 shutdown_connections 2023-12-20T04:51:31.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:31.983+0000 7ff701a4a640 1 -- 172.21.15.132:0/3410750572 wait complete. 2023-12-20T04:51:31.996 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:51:32.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.094+0000 7ffb4fa4a640 1 Processor -- start 2023-12-20T04:51:32.096 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.094+0000 7ffb4fa4a640 1 -- start start 2023-12-20T04:51:32.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.095+0000 7ffb4fa4a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb4815d2c0 0x7ffb480cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:32.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.095+0000 7ffb4fa4a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb480d0060 0x7ffb480d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:32.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.095+0000 7ffb4fa4a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ffb480d0cf0 con 0x7ffb480d30a0 2023-12-20T04:51:32.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.095+0000 7ffb4fa4a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ffb480d0550 con 0x7ffb4815d2c0 2023-12-20T04:51:32.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.095+0000 7ffb4fa4a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb480cddc0 con 0x7ffb480d0060 2023-12-20T04:51:32.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.095+0000 7ffb4cfe5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb4815d2c0 0x7ffb480cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:32.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.095+0000 7ffb4cfe5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ffb4815d2c0 0x7ffb480cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35484/0 (socket says 172.21.15.132:35484) 2023-12-20T04:51:32.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.095+0000 7ffb4d7e6640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ffb480d30a0 0x7ffb480d3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53948/0 (socket says 172.21.15.132:53948) 2023-12-20T04:51:32.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.095+0000 7ffb4cfe5640 1 -- 172.21.15.132:0/1989026306 learned_addr learned my addr 172.21.15.132:0/1989026306 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:32.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.096+0000 7ffb4dfe7640 1 --2- 172.21.15.132:0/1989026306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb480d0060 0x7ffb480d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:32.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.096+0000 7ffb4cfe5640 1 -- 172.21.15.132:0/1989026306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb480d0060 msgr2=0x7ffb480d1180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:32.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.096+0000 7ffb4cfe5640 1 --2- 172.21.15.132:0/1989026306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb480d0060 0x7ffb480d1180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.096+0000 7ffb4cfe5640 1 -- 172.21.15.132:0/1989026306 >> v1:172.21.15.132:6789/0 conn(0x7ffb480d30a0 legacy=0x7ffb480d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:32.099 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.096+0000 7ffb4cfe5640 1 -- 172.21.15.132:0/1989026306 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb480ce0a0 con 0x7ffb4815d2c0 2023-12-20T04:51:32.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.096+0000 7ffb4cfe5640 1 --2- 172.21.15.132:0/1989026306 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb4815d2c0 0x7ffb480cd5c0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7ffb38009870 tx=0x7ffb3802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=383d44799bc0b49b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:32.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.097+0000 7ffb3ffff640 1 -- 172.21.15.132:0/1989026306 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38030840 con 0x7ffb4815d2c0 2023-12-20T04:51:32.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.097+0000 7ffb3ffff640 1 -- 172.21.15.132:0/1989026306 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb380309a0 con 0x7ffb4815d2c0 2023-12-20T04:51:32.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.097+0000 7ffb3ffff640 1 -- 172.21.15.132:0/1989026306 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38030d30 con 0x7ffb4815d2c0 2023-12-20T04:51:32.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.097+0000 7ffb4fa4a640 1 -- 172.21.15.132:0/1989026306 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb4815d2c0 msgr2=0x7ffb480cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:32.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.097+0000 7ffb4fa4a640 1 --2- 172.21.15.132:0/1989026306 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb4815d2c0 0x7ffb480cd5c0 secure :-1 s=READY pgs=1574 cs=0 l=1 rev1=1 crypto rx=0x7ffb38009870 tx=0x7ffb3802b980 comp rx=0 tx=0).stop 2023-12-20T04:51:32.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.097+0000 7ffb4fa4a640 1 -- 172.21.15.132:0/1989026306 shutdown_connections 2023-12-20T04:51:32.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.097+0000 7ffb4fa4a640 1 --2- 172.21.15.132:0/1989026306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb480d0060 0x7ffb480d1180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.097+0000 7ffb4fa4a640 1 --2- 172.21.15.132:0/1989026306 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb4815d2c0 0x7ffb480cd5c0 unknown :-1 s=CLOSED pgs=1574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.097+0000 7ffb4fa4a640 1 -- 172.21.15.132:0/1989026306 >> 172.21.15.132:0/1989026306 conn(0x7ffb48072e40 msgr2=0x7ffb48073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:32.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.097+0000 7ffb4fa4a640 1 -- 172.21.15.132:0/1989026306 shutdown_connections 2023-12-20T04:51:32.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.097+0000 7ffb4fa4a640 1 -- 172.21.15.132:0/1989026306 wait complete. 2023-12-20T04:51:32.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.098+0000 7ffb4fa4a640 1 Processor -- start 2023-12-20T04:51:32.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.098+0000 7ffb4fa4a640 1 -- start start 2023-12-20T04:51:32.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.099+0000 7ffb4fa4a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb480d0060 0x7ffb480b74a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:32.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.099+0000 7ffb4fa4a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb480d30a0 0x7ffb4814b280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:32.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.099+0000 7ffb4fa4a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb4815d2c0 0x7ffb480b7af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:32.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.099+0000 7ffb4fa4a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb480b7010 con 0x7ffb480d30a0 2023-12-20T04:51:32.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.099+0000 7ffb4fa4a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb480b6400 con 0x7ffb480d0060 2023-12-20T04:51:32.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.099+0000 7ffb4fa4a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ffb480b66e0 con 0x7ffb4815d2c0 2023-12-20T04:51:32.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.099+0000 7ffb4cfe5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb480d30a0 0x7ffb4814b280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:32.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.099+0000 7ffb4cfe5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb480d30a0 0x7ffb4814b280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35500/0 (socket says 172.21.15.132:35500) 2023-12-20T04:51:32.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.099+0000 7ffb4cfe5640 1 -- 172.21.15.132:0/3147023305 learned_addr learned my addr 172.21.15.132:0/3147023305 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:32.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.099+0000 7ffb4d7e6640 1 --2- 172.21.15.132:0/3147023305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb480d0060 0x7ffb480b74a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:32.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.099+0000 7ffb4dfe7640 1 --2- 172.21.15.132:0/3147023305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb4815d2c0 0x7ffb480b7af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:32.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.100+0000 7ffb4cfe5640 1 -- 172.21.15.132:0/3147023305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb4815d2c0 msgr2=0x7ffb480b7af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:32.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.100+0000 7ffb4cfe5640 1 --2- 172.21.15.132:0/3147023305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb4815d2c0 0x7ffb480b7af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.100+0000 7ffb4cfe5640 1 -- 172.21.15.132:0/3147023305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb480d0060 msgr2=0x7ffb480b74a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:32.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.100+0000 7ffb4cfe5640 1 --2- 172.21.15.132:0/3147023305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb480d0060 0x7ffb480b74a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.100+0000 7ffb4cfe5640 1 -- 172.21.15.132:0/3147023305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffb380094d0 con 0x7ffb480d30a0 2023-12-20T04:51:32.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.100+0000 7ffb4cfe5640 1 --2- 172.21.15.132:0/3147023305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb480d30a0 0x7ffb4814b280 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7ffb38000c00 tx=0x7ffb38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:32.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.100+0000 7ffb3dffb640 1 -- 172.21.15.132:0/3147023305 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38039a90 con 0x7ffb480d30a0 2023-12-20T04:51:32.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.100+0000 7ffb3dffb640 1 -- 172.21.15.132:0/3147023305 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ffb38039bf0 con 0x7ffb480d30a0 2023-12-20T04:51:32.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.100+0000 7ffb4fa4a640 1 -- 172.21.15.132:0/3147023305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb480b69c0 con 0x7ffb480d30a0 2023-12-20T04:51:32.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.100+0000 7ffb3dffb640 1 -- 172.21.15.132:0/3147023305 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ffb38043410 con 0x7ffb480d30a0 2023-12-20T04:51:32.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.100+0000 7ffb4fa4a640 1 -- 172.21.15.132:0/3147023305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb4814b7c0 con 0x7ffb480d30a0 2023-12-20T04:51:32.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.101+0000 7ffb4fa4a640 1 -- 172.21.15.132:0/3147023305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb4804e840 con 0x7ffb480d30a0 2023-12-20T04:51:32.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.101+0000 7ffb3dffb640 1 -- 172.21.15.132:0/3147023305 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ffb3804c3b0 con 0x7ffb480d30a0 2023-12-20T04:51:32.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.102+0000 7ffb3dffb640 1 --2- 172.21.15.132:0/3147023305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ffb2c06a430 0x7ffb2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:32.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.102+0000 7ffb3dffb640 1 -- 172.21.15.132:0/3147023305 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7ffb380aaee0 con 0x7ffb480d30a0 2023-12-20T04:51:32.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.102+0000 7ffb4d7e6640 1 --2- 172.21.15.132:0/3147023305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ffb2c06a430 0x7ffb2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:32.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.102+0000 7ffb3dffb640 1 -- 172.21.15.132:0/3147023305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7ffb2c072020 con 0x7ffb480d30a0 2023-12-20T04:51:32.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.102+0000 7ffb4d7e6640 1 --2- 172.21.15.132:0/3147023305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ffb2c06a430 0x7ffb2c06c8f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ffb440012e0 tx=0x7ffb44005b70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:32.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.106+0000 7ffb3dffb640 1 -- 172.21.15.132:0/3147023305 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ffb38076490 con 0x7ffb480d30a0 2023-12-20T04:51:32.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.286+0000 7ffb4fa4a640 1 -- 172.21.15.132:0/3147023305 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7ffb480cdba0 con 0x7ffb480d30a0 2023-12-20T04:51:32.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.286+0000 7ffb3dffb640 1 -- 172.21.15.132:0/3147023305 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v157) v1 ==== 80+0+0 (secure 0 0 0) 0x7ffb38048080 con 0x7ffb480d30a0 2023-12-20T04:51:32.288 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:51:32.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.288+0000 7ffb4fa4a640 1 -- 172.21.15.132:0/3147023305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ffb2c06a430 msgr2=0x7ffb2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:32.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.288+0000 7ffb4fa4a640 1 --2- 172.21.15.132:0/3147023305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ffb2c06a430 0x7ffb2c06c8f0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ffb440012e0 tx=0x7ffb44005b70 comp rx=0 tx=0).stop 2023-12-20T04:51:32.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.288+0000 7ffb4fa4a640 1 -- 172.21.15.132:0/3147023305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb480d30a0 msgr2=0x7ffb4814b280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:32.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.288+0000 7ffb4fa4a640 1 --2- 172.21.15.132:0/3147023305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb480d30a0 0x7ffb4814b280 secure :-1 s=READY pgs=1575 cs=0 l=1 rev1=1 crypto rx=0x7ffb38000c00 tx=0x7ffb38004730 comp rx=0 tx=0).stop 2023-12-20T04:51:32.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.288+0000 7ffb4fa4a640 1 -- 172.21.15.132:0/3147023305 shutdown_connections 2023-12-20T04:51:32.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.288+0000 7ffb4fa4a640 1 --2- 172.21.15.132:0/3147023305 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ffb2c06a430 0x7ffb2c06c8f0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.288+0000 7ffb4fa4a640 1 --2- 172.21.15.132:0/3147023305 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ffb4815d2c0 0x7ffb480b7af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.288+0000 7ffb4fa4a640 1 --2- 172.21.15.132:0/3147023305 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ffb480d30a0 0x7ffb4814b280 unknown :-1 s=CLOSED pgs=1575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.288+0000 7ffb4fa4a640 1 --2- 172.21.15.132:0/3147023305 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ffb480d0060 0x7ffb480b74a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.288+0000 7ffb4fa4a640 1 -- 172.21.15.132:0/3147023305 >> 172.21.15.132:0/3147023305 conn(0x7ffb48072e40 msgr2=0x7ffb480b39c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:32.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.288+0000 7ffb4fa4a640 1 -- 172.21.15.132:0/3147023305 shutdown_connections 2023-12-20T04:51:32.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.288+0000 7ffb4fa4a640 1 -- 172.21.15.132:0/3147023305 wait complete. 2023-12-20T04:51:32.301 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi187.front.sepia.ceph.com... 2023-12-20T04:51:32.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:32.301 DEBUG:teuthology.orchestra.run.smithi187:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-20T04:51:32.331 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[91356]: fuse finished with error 0 and tester_r 0 2023-12-20T04:51:32.333 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:51:32.333 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:32.333 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-20T04:51:32.501 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:51:32.501 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:51:32.517 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:51:32.517 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:51:32.517 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:32.517 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-20T04:51:32.572 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:51:32.572 INFO:teuthology.orchestra.run.smithi132.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-20T04:51:32.573 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:51:32.573 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:51:32.590 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:51:32.591 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:51:32.591 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:32.591 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-20T04:51:32.647 INFO:teuthology.orchestra.run.smithi187.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-20T04:51:32.648 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:51:32.648 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:51:32.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.747+0000 7f9d31a5f640 1 Processor -- start 2023-12-20T04:51:32.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.747+0000 7f9d31a5f640 1 -- start start 2023-12-20T04:51:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d31a5f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c0b4980 0x7f9d2c0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d31a5f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2c0b5320 con 0x7f9d2c160450 2023-12-20T04:51:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d31a5f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9d2c0b5ec0 con 0x7f9d2c0d1aa0 2023-12-20T04:51:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d31a5f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c1617e0 con 0x7f9d2c0b4980 2023-12-20T04:51:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d2affd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9d2c160450 0x7f9d2c160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53956/0 (socket says 172.21.15.132:53956) 2023-12-20T04:51:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d2affd640 1 -- 172.21.15.132:0/154747649 learned_addr learned my addr 172.21.15.132:0/154747649 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d29ffb640 1 -- 172.21.15.132:0/154747649 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1550670298 0 0) 0x7f9d2c0b5320 con 0x7f9d2c160450 2023-12-20T04:51:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d2a7fc640 1 --2- 172.21.15.132:0/154747649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c0b4980 0x7f9d2c0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:32.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d29ffb640 1 -- 172.21.15.132:0/154747649 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9d14003520 con 0x7f9d2c160450 2023-12-20T04:51:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d29ffb640 1 -- 172.21.15.132:0/154747649 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2014391831 0 0) 0x7f9d14003520 con 0x7f9d2c160450 2023-12-20T04:51:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d29ffb640 1 -- 172.21.15.132:0/154747649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c0b4980 msgr2=0x7f9d2c0b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d29ffb640 1 --2- 172.21.15.132:0/154747649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c0b4980 0x7f9d2c0b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d29ffb640 1 -- 172.21.15.132:0/154747649 >> v1:172.21.15.187:6789/0 conn(0x7f9d2c0d1aa0 legacy=0x7f9d2c0d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d29ffb640 1 -- 172.21.15.132:0/154747649 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c0d0fc0 con 0x7f9d2c160450 2023-12-20T04:51:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d29ffb640 1 -- 172.21.15.132:0/154747649 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f9d1c001670 con 0x7f9d2c160450 2023-12-20T04:51:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d29ffb640 1 -- 172.21.15.132:0/154747649 >> v1:172.21.15.132:6789/0 conn(0x7f9d2c160450 legacy=0x7f9d2c160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d29ffb640 1 --2- 172.21.15.132:0/154747649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d140039a0 0x7f9d14003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:32.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d29ffb640 1 --2- 172.21.15.132:0/154747649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c0b4980 0x7f9d140047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d29ffb640 1 --2- 172.21.15.132:0/154747649 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d14004d00 0x7f9d14005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d29ffb640 1 -- 172.21.15.132:0/154747649 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c1617e0 con 0x7f9d140039a0 2023-12-20T04:51:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d29ffb640 1 -- 172.21.15.132:0/154747649 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1400bac0 con 0x7f9d14004d00 2023-12-20T04:51:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d29ffb640 1 -- 172.21.15.132:0/154747649 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d1400bc80 con 0x7f9d2c0b4980 2023-12-20T04:51:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d2affd640 1 --2- 172.21.15.132:0/154747649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d140039a0 0x7f9d14003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.748+0000 7f9d2a7fc640 1 --2- 172.21.15.132:0/154747649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c0b4980 0x7f9d140047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.749+0000 7f9d2b7fe640 1 --2- 172.21.15.132:0/154747649 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d14004d00 0x7f9d14005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.749+0000 7f9d2affd640 1 -- 172.21.15.132:0/154747649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c0b4980 msgr2=0x7f9d140047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.749+0000 7f9d2affd640 1 --2- 172.21.15.132:0/154747649 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c0b4980 0x7f9d140047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.749+0000 7f9d2affd640 1 -- 172.21.15.132:0/154747649 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d14004d00 msgr2=0x7f9d14005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.749+0000 7f9d2affd640 1 --2- 172.21.15.132:0/154747649 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d14004d00 0x7f9d14005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.749+0000 7f9d2affd640 1 -- 172.21.15.132:0/154747649 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d14003520 con 0x7f9d140039a0 2023-12-20T04:51:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.749+0000 7f9d2affd640 1 --2- 172.21.15.132:0/154747649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d140039a0 0x7f9d14003dc0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00c210 tx=0x7f9d140057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7388d7356bb054b8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.750+0000 7f9d29ffb640 1 -- 172.21.15.132:0/154747649 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c005ad0 con 0x7f9d140039a0 2023-12-20T04:51:32.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.750+0000 7f9d29ffb640 1 -- 172.21.15.132:0/154747649 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d1c005c30 con 0x7f9d140039a0 2023-12-20T04:51:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.750+0000 7f9d29ffb640 1 -- 172.21.15.132:0/154747649 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d1c02c890 con 0x7f9d140039a0 2023-12-20T04:51:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.750+0000 7f9d31a5f640 1 -- 172.21.15.132:0/154747649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d140039a0 msgr2=0x7f9d14003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.750+0000 7f9d31a5f640 1 --2- 172.21.15.132:0/154747649 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d140039a0 0x7f9d14003dc0 secure :-1 s=READY pgs=1577 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c00c210 tx=0x7f9d140057f0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.750+0000 7f9d2b7fe640 1 -- 172.21.15.132:0/154747649 reap_dead start 2023-12-20T04:51:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.750+0000 7f9d31a5f640 1 -- 172.21.15.132:0/154747649 shutdown_connections 2023-12-20T04:51:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.750+0000 7f9d31a5f640 1 -- 172.21.15.132:0/154747649 >> 172.21.15.132:0/154747649 conn(0x7f9d2c0cf980 msgr2=0x7f9d2c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.750+0000 7f9d31a5f640 1 -- 172.21.15.132:0/154747649 shutdown_connections 2023-12-20T04:51:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.750+0000 7f9d31a5f640 1 -- 172.21.15.132:0/154747649 wait complete. 2023-12-20T04:51:32.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.751+0000 7f9d31a5f640 1 Processor -- start 2023-12-20T04:51:32.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.751+0000 7f9d31a5f640 1 -- start start 2023-12-20T04:51:32.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.752+0000 7f9d31a5f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d140039a0 0x7f9d2c0c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:32.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.752+0000 7f9d31a5f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c157950 0x7f9d2c15ad30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:32.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.752+0000 7f9d31a5f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d2c0cb800 0x7f9d2c0cbc80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:32.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.752+0000 7f9d31a5f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c141e70 con 0x7f9d2c0cb800 2023-12-20T04:51:32.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.752+0000 7f9d31a5f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c0cc1c0 con 0x7f9d140039a0 2023-12-20T04:51:32.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.752+0000 7f9d31a5f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9d2c157db0 con 0x7f9d2c157950 2023-12-20T04:51:32.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.752+0000 7f9d2b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d2c0cb800 0x7f9d2c0cbc80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:32.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.752+0000 7f9d2b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d2c0cb800 0x7f9d2c0cbc80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35518/0 (socket says 172.21.15.132:35518) 2023-12-20T04:51:32.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.752+0000 7f9d2b7fe640 1 -- 172.21.15.132:0/3587067078 learned_addr learned my addr 172.21.15.132:0/3587067078 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:32.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.752+0000 7f9d2a7fc640 1 --2- 172.21.15.132:0/3587067078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c157950 0x7f9d2c15ad30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:32.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.752+0000 7f9d2affd640 1 --2- 172.21.15.132:0/3587067078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d140039a0 0x7f9d2c0c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:32.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.753+0000 7f9d2b7fe640 1 -- 172.21.15.132:0/3587067078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c157950 msgr2=0x7f9d2c15ad30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:32.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.753+0000 7f9d2b7fe640 1 --2- 172.21.15.132:0/3587067078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c157950 0x7f9d2c15ad30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.753+0000 7f9d2b7fe640 1 -- 172.21.15.132:0/3587067078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d140039a0 msgr2=0x7f9d2c0c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:32.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.753+0000 7f9d2b7fe640 1 --2- 172.21.15.132:0/3587067078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d140039a0 0x7f9d2c0c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.753+0000 7f9d2b7fe640 1 -- 172.21.15.132:0/3587067078 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9d2c1f27f0 con 0x7f9d2c0cb800 2023-12-20T04:51:32.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.753+0000 7f9d2b7fe640 1 --2- 172.21.15.132:0/3587067078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d2c0cb800 0x7f9d2c0cbc80 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0cec00 tx=0x7f9d2400fc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:32.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.753+0000 7f9d13fff640 1 -- 172.21.15.132:0/3587067078 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d2400fed0 con 0x7f9d2c0cb800 2023-12-20T04:51:32.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.753+0000 7f9d13fff640 1 -- 172.21.15.132:0/3587067078 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9d24006d60 con 0x7f9d2c0cb800 2023-12-20T04:51:32.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.753+0000 7f9d13fff640 1 -- 172.21.15.132:0/3587067078 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9d24003b90 con 0x7f9d2c0cb800 2023-12-20T04:51:32.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.753+0000 7f9d31a5f640 1 -- 172.21.15.132:0/3587067078 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9d2c15b270 con 0x7f9d2c0cb800 2023-12-20T04:51:32.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.753+0000 7f9d31a5f640 1 -- 172.21.15.132:0/3587067078 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9d2c15b820 con 0x7f9d2c0cb800 2023-12-20T04:51:32.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.754+0000 7f9d31a5f640 1 -- 172.21.15.132:0/3587067078 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9d2c141fb0 con 0x7f9d2c0cb800 2023-12-20T04:51:32.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.754+0000 7f9d13fff640 1 -- 172.21.15.132:0/3587067078 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9d24003cf0 con 0x7f9d2c0cb800 2023-12-20T04:51:32.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.755+0000 7f9d13fff640 1 --2- 172.21.15.132:0/3587067078 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9d1806a430 0x7f9d1806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:32.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.755+0000 7f9d13fff640 1 -- 172.21.15.132:0/3587067078 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f9d24087bc0 con 0x7f9d2c0cb800 2023-12-20T04:51:32.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.755+0000 7f9d2affd640 1 --2- 172.21.15.132:0/3587067078 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9d1806a430 0x7f9d1806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:32.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.755+0000 7f9d13fff640 1 -- 172.21.15.132:0/3587067078 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f9d18072020 con 0x7f9d2c0cb800 2023-12-20T04:51:32.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.755+0000 7f9d2affd640 1 --2- 172.21.15.132:0/3587067078 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9d1806a430 0x7f9d1806c8f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c034000 tx=0x7f9d1c009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:32.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.759+0000 7f9d13fff640 1 -- 172.21.15.132:0/3587067078 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9d2401a060 con 0x7f9d2c0cb800 2023-12-20T04:51:32.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.962+0000 7f9d31a5f640 1 -- 172.21.15.132:0/3587067078 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9d2c161ac0 con 0x7f9d2c0cb800 2023-12-20T04:51:32.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.962+0000 7f9d13fff640 1 -- 172.21.15.132:0/3587067078 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f9d2c141fb0 con 0x7f9d2c0cb800 2023-12-20T04:51:32.964 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:32.964 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":57,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/756703470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":756703470},{"type":"v1","addr":"172.21.15.187:6834","nonce":756703470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2177183802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2177183802},{"type":"v1","addr":"172.21.15.187:6835","nonce":2177183802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":8337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/390345313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":390345313},{"type":"v1","addr":"172.21.15.132:6837","nonce":390345313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:49:33.211903+0000","modified":"2023-12-20T04:49:35.219491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8340":{"gid":8340,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/3157504695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3157504695},{"type":"v1","addr":"172.21.15.132:6836","nonce":3157504695}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-20T04:51:32.964 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 57 2023-12-20T04:51:32.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.964+0000 7f9d31a5f640 1 -- 172.21.15.132:0/3587067078 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9d1806a430 msgr2=0x7f9d1806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:32.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.964+0000 7f9d31a5f640 1 --2- 172.21.15.132:0/3587067078 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9d1806a430 0x7f9d1806c8f0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f9d1c034000 tx=0x7f9d1c009030 comp rx=0 tx=0).stop 2023-12-20T04:51:32.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.964+0000 7f9d31a5f640 1 -- 172.21.15.132:0/3587067078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d2c0cb800 msgr2=0x7f9d2c0cbc80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:32.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.964+0000 7f9d31a5f640 1 --2- 172.21.15.132:0/3587067078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d2c0cb800 0x7f9d2c0cbc80 secure :-1 s=READY pgs=1578 cs=0 l=1 rev1=1 crypto rx=0x7f9d2c0cec00 tx=0x7f9d2400fc80 comp rx=0 tx=0).stop 2023-12-20T04:51:32.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.964+0000 7f9d31a5f640 1 -- 172.21.15.132:0/3587067078 shutdown_connections 2023-12-20T04:51:32.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.964+0000 7f9d31a5f640 1 --2- 172.21.15.132:0/3587067078 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9d1806a430 0x7f9d1806c8f0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.964+0000 7f9d31a5f640 1 --2- 172.21.15.132:0/3587067078 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9d2c0cb800 0x7f9d2c0cbc80 unknown :-1 s=CLOSED pgs=1578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.964+0000 7f9d31a5f640 1 --2- 172.21.15.132:0/3587067078 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9d2c157950 0x7f9d2c15ad30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.964+0000 7f9d31a5f640 1 --2- 172.21.15.132:0/3587067078 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9d140039a0 0x7f9d2c0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:32.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.964+0000 7f9d31a5f640 1 -- 172.21.15.132:0/3587067078 >> 172.21.15.132:0/3587067078 conn(0x7f9d2c0cf980 msgr2=0x7f9d2c0b6360 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:32.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.964+0000 7f9d31a5f640 1 -- 172.21.15.132:0/3587067078 shutdown_connections 2023-12-20T04:51:32.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:32.964+0000 7f9d31a5f640 1 -- 172.21.15.132:0/3587067078 wait complete. 2023-12-20T04:51:32.977 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:51:33.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.075+0000 7f56c87f0640 1 Processor -- start 2023-12-20T04:51:33.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.075+0000 7f56c87f0640 1 -- start start 2023-12-20T04:51:33.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.076+0000 7f56c87f0640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f56c015d100 0x7f56c00b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.076+0000 7f56c87f0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f56c00d0370 0x7f56c00cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.076+0000 7f56c87f0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56c0161850 0x7f56c00cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.076+0000 7f56c87f0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c00b2f90 con 0x7f56c00d0370 2023-12-20T04:51:33.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.076+0000 7f56c87f0640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56c01613c0 con 0x7f56c015d100 2023-12-20T04:51:33.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.076+0000 7f56c87f0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c00d0810 con 0x7f56c0161850 2023-12-20T04:51:33.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.076+0000 7f56c5d8b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f56c00d0370 0x7f56c00cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.076+0000 7f56c5d8b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f56c00d0370 0x7f56c00cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35524/0 (socket says 172.21.15.132:35524) 2023-12-20T04:51:33.079 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.076+0000 7f56c5d8b640 1 -- 172.21.15.132:0/336485669 learned_addr learned my addr 172.21.15.132:0/336485669 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:33.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.076+0000 7f56c658c640 1 --2- 172.21.15.132:0/336485669 >> v2:172.21.15.187:3300/0 conn(0x7f56c015d100 0x7f56c00b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.076+0000 7f56c6d8d640 1 --2- 172.21.15.132:0/336485669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56c0161850 0x7f56c00cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.076+0000 7f56c5d8b640 1 -- 172.21.15.132:0/336485669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56c0161850 msgr2=0x7f56c00cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:33.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.076+0000 7f56c5d8b640 1 --2- 172.21.15.132:0/336485669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56c0161850 0x7f56c00cda40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.076+0000 7f56c5d8b640 1 -- 172.21.15.132:0/336485669 >> v2:172.21.15.187:3300/0 conn(0x7f56c015d100 msgr2=0x7f56c00b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:33.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.076+0000 7f56c5d8b640 1 --2- 172.21.15.132:0/336485669 >> v2:172.21.15.187:3300/0 conn(0x7f56c015d100 0x7f56c00b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.076+0000 7f56c5d8b640 1 -- 172.21.15.132:0/336485669 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c0160d70 con 0x7f56c00d0370 2023-12-20T04:51:33.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.076+0000 7f56c6d8d640 1 --2- 172.21.15.132:0/336485669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56c0161850 0x7f56c00cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:33.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.077+0000 7f56c5d8b640 1 --2- 172.21.15.132:0/336485669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56c00d0370 0x7f56c00cd500 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f56c006e5e0 tx=0x7f56b002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09d9ca654bb900c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:33.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.077+0000 7f56c558a640 1 -- 172.21.15.132:0/336485669 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b0031870 con 0x7f56c00d0370 2023-12-20T04:51:33.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.077+0000 7f56c558a640 1 -- 172.21.15.132:0/336485669 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b00319d0 con 0x7f56c00d0370 2023-12-20T04:51:33.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.077+0000 7f56c558a640 1 -- 172.21.15.132:0/336485669 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b0031d60 con 0x7f56c00d0370 2023-12-20T04:51:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.078+0000 7f56c87f0640 1 -- 172.21.15.132:0/336485669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56c00d0370 msgr2=0x7f56c00cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.078+0000 7f56c87f0640 1 --2- 172.21.15.132:0/336485669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56c00d0370 0x7f56c00cd500 secure :-1 s=READY pgs=1579 cs=0 l=1 rev1=1 crypto rx=0x7f56c006e5e0 tx=0x7f56b002b910 comp rx=0 tx=0).stop 2023-12-20T04:51:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.078+0000 7f56c87f0640 1 -- 172.21.15.132:0/336485669 shutdown_connections 2023-12-20T04:51:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.078+0000 7f56c87f0640 1 --2- 172.21.15.132:0/336485669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56c0161850 0x7f56c00cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.078+0000 7f56c87f0640 1 --2- 172.21.15.132:0/336485669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56c00d0370 0x7f56c00cd500 unknown :-1 s=CLOSED pgs=1579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.078+0000 7f56c87f0640 1 --2- 172.21.15.132:0/336485669 >> v2:172.21.15.187:3300/0 conn(0x7f56c015d100 0x7f56c00b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.078+0000 7f56c87f0640 1 -- 172.21.15.132:0/336485669 >> 172.21.15.132:0/336485669 conn(0x7f56c006d7c0 msgr2=0x7f56c006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.078+0000 7f56c87f0640 1 -- 172.21.15.132:0/336485669 shutdown_connections 2023-12-20T04:51:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.078+0000 7f56c87f0640 1 -- 172.21.15.132:0/336485669 wait complete. 2023-12-20T04:51:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.079+0000 7f56c87f0640 1 Processor -- start 2023-12-20T04:51:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.079+0000 7f56c87f0640 1 -- start start 2023-12-20T04:51:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c87f0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56c00d0370 0x7f56c0157560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c87f0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56c015d100 0x7f56c015f9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c87f0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56c0161850 0x7f56c00ccf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c87f0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c00c9850 con 0x7f56c0161850 2023-12-20T04:51:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c87f0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56c0160410 con 0x7f56c015d100 2023-12-20T04:51:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c87f0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56c00c9aa0 con 0x7f56c00d0370 2023-12-20T04:51:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c6d8d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56c0161850 0x7f56c00ccf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c6d8d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56c0161850 0x7f56c00ccf80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35532/0 (socket says 172.21.15.132:35532) 2023-12-20T04:51:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c6d8d640 1 -- 172.21.15.132:0/1632692721 learned_addr learned my addr 172.21.15.132:0/1632692721 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c5d8b640 1 --2- 172.21.15.132:0/1632692721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56c015d100 0x7f56c015f9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c658c640 1 --2- 172.21.15.132:0/1632692721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56c00d0370 0x7f56c0157560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c6d8d640 1 -- 172.21.15.132:0/1632692721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56c00d0370 msgr2=0x7f56c0157560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c6d8d640 1 --2- 172.21.15.132:0/1632692721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56c00d0370 0x7f56c0157560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c6d8d640 1 -- 172.21.15.132:0/1632692721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56c015d100 msgr2=0x7f56c015f9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c6d8d640 1 --2- 172.21.15.132:0/1632692721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56c015d100 0x7f56c015f9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c6d8d640 1 -- 172.21.15.132:0/1632692721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56b00094d0 con 0x7f56c0161850 2023-12-20T04:51:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c5d8b640 1 --2- 172.21.15.132:0/1632692721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56c015d100 0x7f56c015f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c6d8d640 1 --2- 172.21.15.132:0/1632692721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56c0161850 0x7f56c00ccf80 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f56b8007df0 tx=0x7f56b800d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56b6ffd640 1 -- 172.21.15.132:0/1632692721 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b8003990 con 0x7f56c0161850 2023-12-20T04:51:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56b6ffd640 1 -- 172.21.15.132:0/1632692721 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56b800f040 con 0x7f56c0161850 2023-12-20T04:51:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c87f0640 1 -- 172.21.15.132:0/1632692721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56c00c9d80 con 0x7f56c0161850 2023-12-20T04:51:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56b6ffd640 1 -- 172.21.15.132:0/1632692721 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f56b8003d30 con 0x7f56c0161850 2023-12-20T04:51:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.080+0000 7f56c87f0640 1 -- 172.21.15.132:0/1632692721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56c00ca580 con 0x7f56c0161850 2023-12-20T04:51:33.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.081+0000 7f56c87f0640 1 -- 172.21.15.132:0/1632692721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56c00ca2a0 con 0x7f56c0161850 2023-12-20T04:51:33.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.082+0000 7f56b6ffd640 1 -- 172.21.15.132:0/1632692721 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f56b8004030 con 0x7f56c0161850 2023-12-20T04:51:33.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.082+0000 7f56b6ffd640 1 --2- 172.21.15.132:0/1632692721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f56a406a460 0x7f56a406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.082+0000 7f56b6ffd640 1 -- 172.21.15.132:0/1632692721 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f56b8088ce0 con 0x7f56c0161850 2023-12-20T04:51:33.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.082+0000 7f56c658c640 1 --2- 172.21.15.132:0/1632692721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f56a406a460 0x7f56a406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.082+0000 7f56b6ffd640 1 -- 172.21.15.132:0/1632692721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f56a4072050 con 0x7f56c0161850 2023-12-20T04:51:33.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.083+0000 7f56c658c640 1 --2- 172.21.15.132:0/1632692721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f56a406a460 0x7f56a406c920 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f56bc009a50 tx=0x7f56bc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:33.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.086+0000 7f56b6ffd640 1 -- 172.21.15.132:0/1632692721 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f56b801a020 con 0x7f56c0161850 2023-12-20T04:51:33.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.258+0000 7f56c87f0640 1 -- 172.21.15.132:0/1632692721 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f56c00ceb90 con 0x7f56c0161850 2023-12-20T04:51:33.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.259+0000 7f56b6ffd640 1 -- 172.21.15.132:0/1632692721 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+16227 (secure 0 0 0) 0x7f56b8054200 con 0x7f56c0161850 2023-12-20T04:51:33.261 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:33.261 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":157,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:50:39.874578+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:49:31.238506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-20T04:49:32.189571+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.3","mappings":[{"from":2,"to":0}]},{"pgid":"19.31","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:51:33.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.261+0000 7f56c87f0640 1 -- 172.21.15.132:0/1632692721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f56a406a460 msgr2=0x7f56a406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.261+0000 7f56c87f0640 1 --2- 172.21.15.132:0/1632692721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f56a406a460 0x7f56a406c920 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f56bc009a50 tx=0x7f56bc008040 comp rx=0 tx=0).stop 2023-12-20T04:51:33.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.261+0000 7f56c87f0640 1 -- 172.21.15.132:0/1632692721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56c0161850 msgr2=0x7f56c00ccf80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.261+0000 7f56c87f0640 1 --2- 172.21.15.132:0/1632692721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56c0161850 0x7f56c00ccf80 secure :-1 s=READY pgs=1580 cs=0 l=1 rev1=1 crypto rx=0x7f56b8007df0 tx=0x7f56b800d4a0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.261+0000 7f56c87f0640 1 -- 172.21.15.132:0/1632692721 shutdown_connections 2023-12-20T04:51:33.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.261+0000 7f56c87f0640 1 --2- 172.21.15.132:0/1632692721 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f56a406a460 0x7f56a406c920 unknown :-1 s=CLOSED pgs=664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.261+0000 7f56c87f0640 1 --2- 172.21.15.132:0/1632692721 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56c0161850 0x7f56c00ccf80 unknown :-1 s=CLOSED pgs=1580 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.261+0000 7f56c87f0640 1 --2- 172.21.15.132:0/1632692721 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56c015d100 0x7f56c015f9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.261+0000 7f56c87f0640 1 --2- 172.21.15.132:0/1632692721 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56c00d0370 0x7f56c0157560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.261+0000 7f56c87f0640 1 -- 172.21.15.132:0/1632692721 >> 172.21.15.132:0/1632692721 conn(0x7f56c006d7c0 msgr2=0x7f56c015afe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:33.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.261+0000 7f56c87f0640 1 -- 172.21.15.132:0/1632692721 shutdown_connections 2023-12-20T04:51:33.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.261+0000 7f56c87f0640 1 -- 172.21.15.132:0/1632692721 wait complete. 2023-12-20T04:51:33.274 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 18, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:49:31.238506+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '152', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 19, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:49:32.189571+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '157', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.25, 'score_stable': 1.25, 'optimal_score': 1, 'raw_score_acting': 1.25, 'raw_score_stable': 1.25, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:51:33.275 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:51:33.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.375+0000 7f0e5c13e640 1 Processor -- start 2023-12-20T04:51:33.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.375+0000 7f0e5c13e640 1 -- start start 2023-12-20T04:51:33.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.376+0000 7f0e5c13e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e540cdbc0 0x7f0e5406c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.376+0000 7f0e5c13e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e5406cc90 con 0x7f0e5415cf20 2023-12-20T04:51:33.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.376+0000 7f0e5c13e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e540b2f30 con 0x7f0e5415d300 2023-12-20T04:51:33.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.376+0000 7f0e5c13e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540b3210 con 0x7f0e540cdbc0 2023-12-20T04:51:33.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.376+0000 7f0e59eda640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0e5415cf20 0x7f0e54161700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53972/0 (socket says 172.21.15.132:53972) 2023-12-20T04:51:33.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.376+0000 7f0e59eda640 1 -- 172.21.15.132:0/1021032749 learned_addr learned my addr 172.21.15.132:0/1021032749 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:33.380 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e58ed8640 1 -- 172.21.15.132:0/1021032749 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1997773732 0 0) 0x7f0e5406cc90 con 0x7f0e5415cf20 2023-12-20T04:51:33.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e58ed8640 1 -- 172.21.15.132:0/1021032749 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e3c003520 con 0x7f0e5415cf20 2023-12-20T04:51:33.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e5a6db640 1 --2- 172.21.15.132:0/1021032749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e540cdbc0 0x7f0e5406c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e58ed8640 1 -- 172.21.15.132:0/1021032749 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1943307531 0 0) 0x7f0e3c003520 con 0x7f0e5415cf20 2023-12-20T04:51:33.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e58ed8640 1 -- 172.21.15.132:0/1021032749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e540cdbc0 msgr2=0x7f0e5406c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:33.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e58ed8640 1 --2- 172.21.15.132:0/1021032749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e540cdbc0 0x7f0e5406c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e58ed8640 1 -- 172.21.15.132:0/1021032749 >> v1:172.21.15.187:6789/0 conn(0x7f0e5415d300 legacy=0x7f0e540cd4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:33.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e58ed8640 1 -- 172.21.15.132:0/1021032749 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e540b34f0 con 0x7f0e5415cf20 2023-12-20T04:51:33.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e58ed8640 1 -- 172.21.15.132:0/1021032749 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f0e440019f0 con 0x7f0e5415cf20 2023-12-20T04:51:33.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e58ed8640 1 -- 172.21.15.132:0/1021032749 >> v1:172.21.15.132:6789/0 conn(0x7f0e5415cf20 legacy=0x7f0e54161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e58ed8640 1 --2- 172.21.15.132:0/1021032749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e540cdbc0 0x7f0e3c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e58ed8640 1 --2- 172.21.15.132:0/1021032749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e3c003fb0 0x7f0e3c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e58ed8640 1 --2- 172.21.15.132:0/1021032749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e3c004d00 0x7f0e3c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e58ed8640 1 -- 172.21.15.132:0/1021032749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540b3210 con 0x7f0e3c004d00 2023-12-20T04:51:33.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e58ed8640 1 -- 172.21.15.132:0/1021032749 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c00bb10 con 0x7f0e3c003fb0 2023-12-20T04:51:33.381 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e58ed8640 1 -- 172.21.15.132:0/1021032749 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e3c00bcd0 con 0x7f0e540cdbc0 2023-12-20T04:51:33.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e5a6db640 1 --2- 172.21.15.132:0/1021032749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e3c004d00 0x7f0e3c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e59eda640 1 --2- 172.21.15.132:0/1021032749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e540cdbc0 0x7f0e3c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e596d9640 1 --2- 172.21.15.132:0/1021032749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e3c003fb0 0x7f0e3c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e5a6db640 1 -- 172.21.15.132:0/1021032749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e540cdbc0 msgr2=0x7f0e3c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:33.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e5a6db640 1 --2- 172.21.15.132:0/1021032749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e540cdbc0 0x7f0e3c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e5a6db640 1 -- 172.21.15.132:0/1021032749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e3c003fb0 msgr2=0x7f0e3c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:33.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e5a6db640 1 --2- 172.21.15.132:0/1021032749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e3c003fb0 0x7f0e3c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e5a6db640 1 -- 172.21.15.132:0/1021032749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e3c003520 con 0x7f0e3c004d00 2023-12-20T04:51:33.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.377+0000 7f0e596d9640 1 --2- 172.21.15.132:0/1021032749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e3c003fb0 0x7f0e3c0047c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:33.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.378+0000 7f0e5a6db640 1 --2- 172.21.15.132:0/1021032749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e3c004d00 0x7f0e3c005180 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f0e54160c50 tx=0x7f0e3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb0626ab3593bd1b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:33.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.378+0000 7f0e58ed8640 1 -- 172.21.15.132:0/1021032749 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c033650 con 0x7f0e3c004d00 2023-12-20T04:51:33.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.378+0000 7f0e58ed8640 1 -- 172.21.15.132:0/1021032749 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e4c0337b0 con 0x7f0e3c004d00 2023-12-20T04:51:33.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.378+0000 7f0e58ed8640 1 -- 172.21.15.132:0/1021032749 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e4c033b40 con 0x7f0e3c004d00 2023-12-20T04:51:33.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.379+0000 7f0e5c13e640 1 -- 172.21.15.132:0/1021032749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e3c004d00 msgr2=0x7f0e3c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.379+0000 7f0e5c13e640 1 --2- 172.21.15.132:0/1021032749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e3c004d00 0x7f0e3c005180 secure :-1 s=READY pgs=1582 cs=0 l=1 rev1=1 crypto rx=0x7f0e54160c50 tx=0x7f0e3c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.379+0000 7f0e5a6db640 1 -- 172.21.15.132:0/1021032749 reap_dead start 2023-12-20T04:51:33.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.379+0000 7f0e5c13e640 1 -- 172.21.15.132:0/1021032749 shutdown_connections 2023-12-20T04:51:33.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.379+0000 7f0e5c13e640 1 -- 172.21.15.132:0/1021032749 >> 172.21.15.132:0/1021032749 conn(0x7f0e54072c60 msgr2=0x7f0e54073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:33.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.379+0000 7f0e5c13e640 1 -- 172.21.15.132:0/1021032749 shutdown_connections 2023-12-20T04:51:33.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.379+0000 7f0e5c13e640 1 -- 172.21.15.132:0/1021032749 wait complete. 2023-12-20T04:51:33.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.380+0000 7f0e5c13e640 1 Processor -- start 2023-12-20T04:51:33.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.380+0000 7f0e5c13e640 1 -- start start 2023-12-20T04:51:33.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e5c13e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e5415a190 0x7f0e540c61f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e5c13e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e5415a570 0x7f0e5415fa30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e5c13e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e540b4fc0 0x7f0e5415ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e5c13e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540ad460 con 0x7f0e5415a570 2023-12-20T04:51:33.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e5c13e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540b60b0 con 0x7f0e540b4fc0 2023-12-20T04:51:33.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e5c13e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e540b5530 con 0x7f0e5415a190 2023-12-20T04:51:33.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e596d9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e5415a570 0x7f0e5415fa30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e596d9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e5415a570 0x7f0e5415fa30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35548/0 (socket says 172.21.15.132:35548) 2023-12-20T04:51:33.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e596d9640 1 -- 172.21.15.132:0/3133856286 learned_addr learned my addr 172.21.15.132:0/3133856286 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:33.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e59eda640 1 --2- 172.21.15.132:0/3133856286 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e5415a190 0x7f0e540c61f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e5a6db640 1 --2- 172.21.15.132:0/3133856286 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e540b4fc0 0x7f0e5415ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e596d9640 1 -- 172.21.15.132:0/3133856286 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e5415a190 msgr2=0x7f0e540c61f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e596d9640 1 --2- 172.21.15.132:0/3133856286 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e5415a190 0x7f0e540c61f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e596d9640 1 -- 172.21.15.132:0/3133856286 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e540b4fc0 msgr2=0x7f0e5415ff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e596d9640 1 --2- 172.21.15.132:0/3133856286 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e540b4fc0 0x7f0e5415ff70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e596d9640 1 -- 172.21.15.132:0/3133856286 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e540b5810 con 0x7f0e5415a570 2023-12-20T04:51:33.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e59eda640 1 --2- 172.21.15.132:0/3133856286 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e5415a190 0x7f0e540c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:33.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e5a6db640 1 --2- 172.21.15.132:0/3133856286 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e540b4fc0 0x7f0e5415ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:33.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e596d9640 1 --2- 172.21.15.132:0/3133856286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e5415a570 0x7f0e5415fa30 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800e510 tx=0x7f0e480045b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:33.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e527fc640 1 -- 172.21.15.132:0/3133856286 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e48019070 con 0x7f0e5415a570 2023-12-20T04:51:33.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e527fc640 1 -- 172.21.15.132:0/3133856286 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e48007020 con 0x7f0e5415a570 2023-12-20T04:51:33.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e5c13e640 1 -- 172.21.15.132:0/3133856286 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e540b5af0 con 0x7f0e5415a570 2023-12-20T04:51:33.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e527fc640 1 -- 172.21.15.132:0/3133856286 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e480071d0 con 0x7f0e5415a570 2023-12-20T04:51:33.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.381+0000 7f0e5c13e640 1 -- 172.21.15.132:0/3133856286 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e540c6730 con 0x7f0e5415a570 2023-12-20T04:51:33.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.382+0000 7f0e5c13e640 1 -- 172.21.15.132:0/3133856286 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e540ad5f0 con 0x7f0e5415a570 2023-12-20T04:51:33.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.383+0000 7f0e527fc640 1 -- 172.21.15.132:0/3133856286 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0e48007330 con 0x7f0e5415a570 2023-12-20T04:51:33.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.383+0000 7f0e527fc640 1 --2- 172.21.15.132:0/3133856286 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e4006a430 0x7f0e4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.383+0000 7f0e59eda640 1 --2- 172.21.15.132:0/3133856286 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e4006a430 0x7f0e4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.383+0000 7f0e527fc640 1 -- 172.21.15.132:0/3133856286 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f0e48088650 con 0x7f0e5415a570 2023-12-20T04:51:33.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.383+0000 7f0e527fc640 1 -- 172.21.15.132:0/3133856286 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f0e40072020 con 0x7f0e5415a570 2023-12-20T04:51:33.388 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.384+0000 7f0e59eda640 1 --2- 172.21.15.132:0/3133856286 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e4006a430 0x7f0e4006c8f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0e44004bc0 tx=0x7f0e44006040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:33.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.387+0000 7f0e527fc640 1 -- 172.21.15.132:0/3133856286 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0e540ad5f0 con 0x7f0e5415a570 2023-12-20T04:51:33.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.551+0000 7f0e5c13e640 1 -- 172.21.15.132:0/3133856286 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e540ad5a0 con 0x7f0e5415a570 2023-12-20T04:51:33.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.551+0000 7f0e527fc640 1 -- 172.21.15.132:0/3133856286 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v157) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e48053c00 con 0x7f0e5415a570 2023-12-20T04:51:33.553 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:51:33.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.553+0000 7f0e5c13e640 1 -- 172.21.15.132:0/3133856286 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e4006a430 msgr2=0x7f0e4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.553+0000 7f0e5c13e640 1 --2- 172.21.15.132:0/3133856286 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e4006a430 0x7f0e4006c8f0 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f0e44004bc0 tx=0x7f0e44006040 comp rx=0 tx=0).stop 2023-12-20T04:51:33.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.553+0000 7f0e5c13e640 1 -- 172.21.15.132:0/3133856286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e5415a570 msgr2=0x7f0e5415fa30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.553+0000 7f0e5c13e640 1 --2- 172.21.15.132:0/3133856286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e5415a570 0x7f0e5415fa30 secure :-1 s=READY pgs=1583 cs=0 l=1 rev1=1 crypto rx=0x7f0e4800e510 tx=0x7f0e480045b0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.553+0000 7f0e5c13e640 1 -- 172.21.15.132:0/3133856286 shutdown_connections 2023-12-20T04:51:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.553+0000 7f0e5c13e640 1 --2- 172.21.15.132:0/3133856286 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e4006a430 0x7f0e4006c8f0 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.553+0000 7f0e5c13e640 1 --2- 172.21.15.132:0/3133856286 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e540b4fc0 0x7f0e5415ff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.553+0000 7f0e5c13e640 1 --2- 172.21.15.132:0/3133856286 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e5415a570 0x7f0e5415fa30 unknown :-1 s=CLOSED pgs=1583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.553+0000 7f0e5c13e640 1 --2- 172.21.15.132:0/3133856286 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e5415a190 0x7f0e540c61f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.553+0000 7f0e5c13e640 1 -- 172.21.15.132:0/3133856286 >> 172.21.15.132:0/3133856286 conn(0x7f0e54072c60 msgr2=0x7f0e5415c0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.553+0000 7f0e5c13e640 1 -- 172.21.15.132:0/3133856286 shutdown_connections 2023-12-20T04:51:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.553+0000 7f0e5c13e640 1 -- 172.21.15.132:0/3133856286 wait complete. 2023-12-20T04:51:33.566 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:51:33.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.667+0000 7f1bca0f7640 1 Processor -- start 2023-12-20T04:51:33.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.667+0000 7f1bca0f7640 1 -- start start 2023-12-20T04:51:33.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.668+0000 7f1bca0f7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1bc415aee0 0x7f1bc415eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.668+0000 7f1bca0f7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc40cb2b0 0x7f1bc40cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.668+0000 7f1bca0f7640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1bc40d0130 con 0x7f1bc40cdbb0 2023-12-20T04:51:33.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.668+0000 7f1bca0f7640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1bc40ce040 con 0x7f1bc415aee0 2023-12-20T04:51:33.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.668+0000 7f1bca0f7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc415f370 con 0x7f1bc40cb2b0 2023-12-20T04:51:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.668+0000 7f1bc37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1bc415aee0 0x7f1bc415eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.668+0000 7f1bc37fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1bc415aee0 0x7f1bc415eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35558/0 (socket says 172.21.15.132:35558) 2023-12-20T04:51:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.668+0000 7f1bc37fe640 1 -- 172.21.15.132:0/2639769281 learned_addr learned my addr 172.21.15.132:0/2639769281 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.668+0000 7f1bc2ffd640 1 --2- 172.21.15.132:0/2639769281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc40cb2b0 0x7f1bc40cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.668+0000 7f1bc37fe640 1 -- 172.21.15.132:0/2639769281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc40cb2b0 msgr2=0x7f1bc40cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.668+0000 7f1bc37fe640 1 --2- 172.21.15.132:0/2639769281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc40cb2b0 0x7f1bc40cd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.668+0000 7f1bc37fe640 1 -- 172.21.15.132:0/2639769281 >> v1:172.21.15.132:6789/0 conn(0x7f1bc40cdbb0 legacy=0x7f1bc40ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.668+0000 7f1bc37fe640 1 -- 172.21.15.132:0/2639769281 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc415f650 con 0x7f1bc415aee0 2023-12-20T04:51:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.669+0000 7f1bc37fe640 1 --2- 172.21.15.132:0/2639769281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc415aee0 0x7f1bc415eb40 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009870 tx=0x7f1bb402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49eed5f3168683ad server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.669+0000 7f1bc27fc640 1 -- 172.21.15.132:0/2639769281 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4030840 con 0x7f1bc415aee0 2023-12-20T04:51:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.669+0000 7f1bc27fc640 1 -- 172.21.15.132:0/2639769281 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb40309a0 con 0x7f1bc415aee0 2023-12-20T04:51:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.669+0000 7f1bc27fc640 1 -- 172.21.15.132:0/2639769281 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4030d30 con 0x7f1bc415aee0 2023-12-20T04:51:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.670+0000 7f1bca0f7640 1 -- 172.21.15.132:0/2639769281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc415aee0 msgr2=0x7f1bc415eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.670+0000 7f1bca0f7640 1 --2- 172.21.15.132:0/2639769281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc415aee0 0x7f1bc415eb40 secure :-1 s=READY pgs=1585 cs=0 l=1 rev1=1 crypto rx=0x7f1bb4009870 tx=0x7f1bb402b980 comp rx=0 tx=0).stop 2023-12-20T04:51:33.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.670+0000 7f1bca0f7640 1 -- 172.21.15.132:0/2639769281 shutdown_connections 2023-12-20T04:51:33.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.670+0000 7f1bca0f7640 1 --2- 172.21.15.132:0/2639769281 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc40cb2b0 0x7f1bc40cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.670+0000 7f1bca0f7640 1 --2- 172.21.15.132:0/2639769281 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc415aee0 0x7f1bc415eb40 unknown :-1 s=CLOSED pgs=1585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.670+0000 7f1bca0f7640 1 -- 172.21.15.132:0/2639769281 >> 172.21.15.132:0/2639769281 conn(0x7f1bc4072c60 msgr2=0x7f1bc4073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:33.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.670+0000 7f1bca0f7640 1 -- 172.21.15.132:0/2639769281 shutdown_connections 2023-12-20T04:51:33.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.670+0000 7f1bca0f7640 1 -- 172.21.15.132:0/2639769281 wait complete. 2023-12-20T04:51:33.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.671+0000 7f1bca0f7640 1 Processor -- start 2023-12-20T04:51:33.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.671+0000 7f1bca0f7640 1 -- start start 2023-12-20T04:51:33.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bca0f7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40cb2b0 0x7f1bc4155f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bca0f7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc40cdbb0 0x7f1bc4153010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bca0f7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc415aee0 0x7f1bc4154cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bca0f7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc414f730 con 0x7f1bc40cb2b0 2023-12-20T04:51:33.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bca0f7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc4153820 con 0x7f1bc415aee0 2023-12-20T04:51:33.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bca0f7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc406c6b0 con 0x7f1bc40cdbb0 2023-12-20T04:51:33.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bc37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40cb2b0 0x7f1bc4155f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bc37fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40cb2b0 0x7f1bc4155f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35566/0 (socket says 172.21.15.132:35566) 2023-12-20T04:51:33.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bc37fe640 1 -- 172.21.15.132:0/29561709 learned_addr learned my addr 172.21.15.132:0/29561709 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:33.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bc2ffd640 1 --2- 172.21.15.132:0/29561709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc40cdbb0 0x7f1bc4153010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bc3fff640 1 --2- 172.21.15.132:0/29561709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc415aee0 0x7f1bc4154cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bc37fe640 1 -- 172.21.15.132:0/29561709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc40cdbb0 msgr2=0x7f1bc4153010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bc37fe640 1 --2- 172.21.15.132:0/29561709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc40cdbb0 0x7f1bc4153010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bc37fe640 1 -- 172.21.15.132:0/29561709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc415aee0 msgr2=0x7f1bc4154cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bc37fe640 1 --2- 172.21.15.132:0/29561709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc415aee0 0x7f1bc4154cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bc37fe640 1 -- 172.21.15.132:0/29561709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bb40094d0 con 0x7f1bc40cb2b0 2023-12-20T04:51:33.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bc2ffd640 1 --2- 172.21.15.132:0/29561709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc40cdbb0 0x7f1bc4153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:33.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bc37fe640 1 --2- 172.21.15.132:0/29561709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40cb2b0 0x7f1bc4155f90 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f1bb402b9c0 tx=0x7f1bb4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:33.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1babfff640 1 -- 172.21.15.132:0/29561709 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4030810 con 0x7f1bc40cb2b0 2023-12-20T04:51:33.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1babfff640 1 -- 172.21.15.132:0/29561709 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bb4039d90 con 0x7f1bc40cb2b0 2023-12-20T04:51:33.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bca0f7640 1 -- 172.21.15.132:0/29561709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bc4153550 con 0x7f1bc40cb2b0 2023-12-20T04:51:33.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1babfff640 1 -- 172.21.15.132:0/29561709 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bb4043670 con 0x7f1bc40cb2b0 2023-12-20T04:51:33.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.672+0000 7f1bca0f7640 1 -- 172.21.15.132:0/29561709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bc406bbd0 con 0x7f1bc40cb2b0 2023-12-20T04:51:33.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.673+0000 7f1bca0f7640 1 -- 172.21.15.132:0/29561709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bc404e840 con 0x7f1bc40cb2b0 2023-12-20T04:51:33.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.674+0000 7f1babfff640 1 -- 172.21.15.132:0/29561709 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1bb402f390 con 0x7f1bc40cb2b0 2023-12-20T04:51:33.677 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.674+0000 7f1babfff640 1 --2- 172.21.15.132:0/29561709 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bb006a430 0x7f1bb006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.674+0000 7f1babfff640 1 -- 172.21.15.132:0/29561709 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f1bb40aacc0 con 0x7f1bc40cb2b0 2023-12-20T04:51:33.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.674+0000 7f1bc2ffd640 1 --2- 172.21.15.132:0/29561709 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bb006a430 0x7f1bb006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.674+0000 7f1babfff640 1 -- 172.21.15.132:0/29561709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f1bb0072020 con 0x7f1bc40cb2b0 2023-12-20T04:51:33.678 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.675+0000 7f1bc2ffd640 1 --2- 172.21.15.132:0/29561709 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bb006a430 0x7f1bb006c8f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8006fd0 tx=0x7f1bb8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:33.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.678+0000 7f1babfff640 1 -- 172.21.15.132:0/29561709 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1bb4076280 con 0x7f1bc40cb2b0 2023-12-20T04:51:33.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.842+0000 7f1bca0f7640 1 -- 172.21.15.132:0/29561709 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f1bc40b2890 con 0x7f1bc40cb2b0 2023-12-20T04:51:33.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.843+0000 7f1babfff640 1 -- 172.21.15.132:0/29561709 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v157) v1 ==== 104+0+11 (secure 0 0 0) 0x7f1bb40480a0 con 0x7f1bc40cb2b0 2023-12-20T04:51:33.845 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:51:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.845+0000 7f1bca0f7640 1 -- 172.21.15.132:0/29561709 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bb006a430 msgr2=0x7f1bb006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.845+0000 7f1bca0f7640 1 --2- 172.21.15.132:0/29561709 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bb006a430 0x7f1bb006c8f0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8006fd0 tx=0x7f1bb8008040 comp rx=0 tx=0).stop 2023-12-20T04:51:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.845+0000 7f1bca0f7640 1 -- 172.21.15.132:0/29561709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40cb2b0 msgr2=0x7f1bc4155f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.845+0000 7f1bca0f7640 1 --2- 172.21.15.132:0/29561709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40cb2b0 0x7f1bc4155f90 secure :-1 s=READY pgs=1586 cs=0 l=1 rev1=1 crypto rx=0x7f1bb402b9c0 tx=0x7f1bb4004730 comp rx=0 tx=0).stop 2023-12-20T04:51:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.845+0000 7f1bca0f7640 1 -- 172.21.15.132:0/29561709 shutdown_connections 2023-12-20T04:51:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.845+0000 7f1bca0f7640 1 --2- 172.21.15.132:0/29561709 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bb006a430 0x7f1bb006c8f0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.845+0000 7f1bca0f7640 1 --2- 172.21.15.132:0/29561709 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc415aee0 0x7f1bc4154cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.845+0000 7f1bca0f7640 1 --2- 172.21.15.132:0/29561709 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1bc40cdbb0 0x7f1bc4153010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.845+0000 7f1bca0f7640 1 --2- 172.21.15.132:0/29561709 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc40cb2b0 0x7f1bc4155f90 unknown :-1 s=CLOSED pgs=1586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.845+0000 7f1bca0f7640 1 -- 172.21.15.132:0/29561709 >> 172.21.15.132:0/29561709 conn(0x7f1bc4072c60 msgr2=0x7f1bc40cd0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:33.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.845+0000 7f1bca0f7640 1 -- 172.21.15.132:0/29561709 shutdown_connections 2023-12-20T04:51:33.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.845+0000 7f1bca0f7640 1 -- 172.21.15.132:0/29561709 wait complete. 2023-12-20T04:51:33.858 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:51:33.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.957+0000 7efd4ff8b640 1 Processor -- start 2023-12-20T04:51:33.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.957+0000 7efd4ff8b640 1 -- start start 2023-12-20T04:51:33.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.958+0000 7efd4ff8b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7efd48143610 0x7efd480caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.958+0000 7efd4ff8b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd480c41f0 0x7efd480cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.958+0000 7efd4ff8b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efd481439f0 con 0x7efd480cd780 2023-12-20T04:51:33.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.958+0000 7efd4ff8b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efd480cdc30 con 0x7efd48143610 2023-12-20T04:51:33.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.958+0000 7efd4ff8b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd480c46f0 con 0x7efd480c41f0 2023-12-20T04:51:33.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.959+0000 7efd4d526640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd480c41f0 0x7efd480cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.959+0000 7efd4dd27640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7efd48143610 0x7efd480caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.959+0000 7efd4d526640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd480c41f0 0x7efd480cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:56424/0 (socket says 172.21.15.132:56424) 2023-12-20T04:51:33.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.959+0000 7efd4d526640 1 -- 172.21.15.132:0/1832272702 learned_addr learned my addr 172.21.15.132:0/1832272702 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:33.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.959+0000 7efd4d526640 1 -- 172.21.15.132:0/1832272702 >> v2:172.21.15.187:3300/0 conn(0x7efd48143610 msgr2=0x7efd480caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:33.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.959+0000 7efd4d526640 1 --2- 172.21.15.132:0/1832272702 >> v2:172.21.15.187:3300/0 conn(0x7efd48143610 0x7efd480caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.959+0000 7efd4d526640 1 -- 172.21.15.132:0/1832272702 >> v1:172.21.15.187:6789/0 conn(0x7efd480cd780 legacy=0x7efd4815d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.959+0000 7efd4d526640 1 -- 172.21.15.132:0/1832272702 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd480c49d0 con 0x7efd480c41f0 2023-12-20T04:51:33.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.960+0000 7efd4d526640 1 --2- 172.21.15.132:0/1832272702 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd480c41f0 0x7efd480cd240 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efd38009870 tx=0x7efd3802b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=45b3dd423038092c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:33.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.960+0000 7efd4cd25640 1 -- 172.21.15.132:0/1832272702 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38030840 con 0x7efd480c41f0 2023-12-20T04:51:33.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.960+0000 7efd4cd25640 1 -- 172.21.15.132:0/1832272702 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd380309a0 con 0x7efd480c41f0 2023-12-20T04:51:33.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.960+0000 7efd4cd25640 1 -- 172.21.15.132:0/1832272702 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38030d30 con 0x7efd480c41f0 2023-12-20T04:51:33.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.960+0000 7efd4ff8b640 1 -- 172.21.15.132:0/1832272702 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd480c41f0 msgr2=0x7efd480cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.960+0000 7efd4ff8b640 1 --2- 172.21.15.132:0/1832272702 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd480c41f0 0x7efd480cd240 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7efd38009870 tx=0x7efd3802b980 comp rx=0 tx=0).stop 2023-12-20T04:51:33.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.960+0000 7efd4ff8b640 1 -- 172.21.15.132:0/1832272702 shutdown_connections 2023-12-20T04:51:33.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.960+0000 7efd4ff8b640 1 --2- 172.21.15.132:0/1832272702 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd480c41f0 0x7efd480cd240 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.960+0000 7efd4ff8b640 1 --2- 172.21.15.132:0/1832272702 >> v2:172.21.15.187:3300/0 conn(0x7efd48143610 0x7efd480caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.960+0000 7efd4ff8b640 1 -- 172.21.15.132:0/1832272702 >> 172.21.15.132:0/1832272702 conn(0x7efd4806a260 msgr2=0x7efd480b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:33.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.961+0000 7efd4ff8b640 1 -- 172.21.15.132:0/1832272702 shutdown_connections 2023-12-20T04:51:33.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.961+0000 7efd4ff8b640 1 -- 172.21.15.132:0/1832272702 wait complete. 2023-12-20T04:51:33.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.962+0000 7efd4ff8b640 1 Processor -- start 2023-12-20T04:51:33.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.962+0000 7efd4ff8b640 1 -- start start 2023-12-20T04:51:33.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.962+0000 7efd4ff8b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd480c41f0 0x7efd4813c250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.962+0000 7efd4ff8b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd480cd780 0x7efd48159770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.962+0000 7efd4ff8b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd48143610 0x7efd4813d240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.962+0000 7efd4ff8b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd480c5c90 con 0x7efd480cd780 2023-12-20T04:51:33.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.962+0000 7efd4ff8b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd480c5f60 con 0x7efd480c41f0 2023-12-20T04:51:33.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.962+0000 7efd4ff8b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efd4813dac0 con 0x7efd48143610 2023-12-20T04:51:33.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.963+0000 7efd4d526640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd480cd780 0x7efd48159770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.963+0000 7efd4d526640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd480cd780 0x7efd48159770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35568/0 (socket says 172.21.15.132:35568) 2023-12-20T04:51:33.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.963+0000 7efd4d526640 1 -- 172.21.15.132:0/1691832471 learned_addr learned my addr 172.21.15.132:0/1691832471 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:33.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.963+0000 7efd4dd27640 1 --2- 172.21.15.132:0/1691832471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd480c41f0 0x7efd4813c250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.963+0000 7efd4e528640 1 --2- 172.21.15.132:0/1691832471 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd48143610 0x7efd4813d240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.963+0000 7efd4d526640 1 -- 172.21.15.132:0/1691832471 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd48143610 msgr2=0x7efd4813d240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.963+0000 7efd4d526640 1 --2- 172.21.15.132:0/1691832471 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd48143610 0x7efd4813d240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.963+0000 7efd4d526640 1 -- 172.21.15.132:0/1691832471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd480c41f0 msgr2=0x7efd4813c250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:33.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.963+0000 7efd4d526640 1 --2- 172.21.15.132:0/1691832471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd480c41f0 0x7efd4813c250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:33.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.963+0000 7efd4d526640 1 -- 172.21.15.132:0/1691832471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd380094d0 con 0x7efd480cd780 2023-12-20T04:51:33.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.963+0000 7efd4d526640 1 --2- 172.21.15.132:0/1691832471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd480cd780 0x7efd48159770 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7efd38000c00 tx=0x7efd38004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:33.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.963+0000 7efd3e7fc640 1 -- 172.21.15.132:0/1691832471 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38039c90 con 0x7efd480cd780 2023-12-20T04:51:33.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.963+0000 7efd3e7fc640 1 -- 172.21.15.132:0/1691832471 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efd38039df0 con 0x7efd480cd780 2023-12-20T04:51:33.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.963+0000 7efd4ff8b640 1 -- 172.21.15.132:0/1691832471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd4813dda0 con 0x7efd480cd780 2023-12-20T04:51:33.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.963+0000 7efd3e7fc640 1 -- 172.21.15.132:0/1691832471 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efd38043640 con 0x7efd480cd780 2023-12-20T04:51:33.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.963+0000 7efd4ff8b640 1 -- 172.21.15.132:0/1691832471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd48159cb0 con 0x7efd480cd780 2023-12-20T04:51:33.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.964+0000 7efd4ff8b640 1 -- 172.21.15.132:0/1691832471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd4804e840 con 0x7efd480cd780 2023-12-20T04:51:33.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.965+0000 7efd3e7fc640 1 -- 172.21.15.132:0/1691832471 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efd380437a0 con 0x7efd480cd780 2023-12-20T04:51:33.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.965+0000 7efd3e7fc640 1 --2- 172.21.15.132:0/1691832471 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efd2c06a460 0x7efd2c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:33.968 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.965+0000 7efd3e7fc640 1 -- 172.21.15.132:0/1691832471 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7efd3803e070 con 0x7efd480cd780 2023-12-20T04:51:33.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.965+0000 7efd4dd27640 1 --2- 172.21.15.132:0/1691832471 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efd2c06a460 0x7efd2c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:33.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.965+0000 7efd3e7fc640 1 -- 172.21.15.132:0/1691832471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7efd2c072050 con 0x7efd480cd780 2023-12-20T04:51:33.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.966+0000 7efd4dd27640 1 --2- 172.21.15.132:0/1691832471 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efd2c06a460 0x7efd2c06c920 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7efd44011340 tx=0x7efd4400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:33.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:33.969+0000 7efd3e7fc640 1 -- 172.21.15.132:0/1691832471 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7efd38034070 con 0x7efd480cd780 2023-12-20T04:51:34.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.136+0000 7efd4ff8b640 1 -- 172.21.15.132:0/1691832471 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7efd480c3fd0 con 0x7efd480cd780 2023-12-20T04:51:34.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.136+0000 7efd3e7fc640 1 -- 172.21.15.132:0/1691832471 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v157) v1 ==== 100+0+11 (secure 0 0 0) 0x7efd38076e50 con 0x7efd480cd780 2023-12-20T04:51:34.138 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:51:34.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.138+0000 7efd4ff8b640 1 -- 172.21.15.132:0/1691832471 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efd2c06a460 msgr2=0x7efd2c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.138+0000 7efd4ff8b640 1 --2- 172.21.15.132:0/1691832471 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efd2c06a460 0x7efd2c06c920 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7efd44011340 tx=0x7efd4400b040 comp rx=0 tx=0).stop 2023-12-20T04:51:34.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.138+0000 7efd4ff8b640 1 -- 172.21.15.132:0/1691832471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd480cd780 msgr2=0x7efd48159770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.138+0000 7efd4ff8b640 1 --2- 172.21.15.132:0/1691832471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd480cd780 0x7efd48159770 secure :-1 s=READY pgs=1587 cs=0 l=1 rev1=1 crypto rx=0x7efd38000c00 tx=0x7efd38004730 comp rx=0 tx=0).stop 2023-12-20T04:51:34.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.138+0000 7efd4ff8b640 1 -- 172.21.15.132:0/1691832471 shutdown_connections 2023-12-20T04:51:34.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.138+0000 7efd4ff8b640 1 --2- 172.21.15.132:0/1691832471 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efd2c06a460 0x7efd2c06c920 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.138+0000 7efd4ff8b640 1 --2- 172.21.15.132:0/1691832471 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efd48143610 0x7efd4813d240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.138+0000 7efd4ff8b640 1 --2- 172.21.15.132:0/1691832471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efd480cd780 0x7efd48159770 unknown :-1 s=CLOSED pgs=1587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.138+0000 7efd4ff8b640 1 --2- 172.21.15.132:0/1691832471 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efd480c41f0 0x7efd4813c250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.138+0000 7efd4ff8b640 1 -- 172.21.15.132:0/1691832471 >> 172.21.15.132:0/1691832471 conn(0x7efd4806a260 msgr2=0x7efd480b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:34.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.138+0000 7efd4ff8b640 1 -- 172.21.15.132:0/1691832471 shutdown_connections 2023-12-20T04:51:34.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.138+0000 7efd4ff8b640 1 -- 172.21.15.132:0/1691832471 wait complete. 2023-12-20T04:51:34.151 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:51:34.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.249+0000 7f8ae9db1640 1 Processor -- start 2023-12-20T04:51:34.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.249+0000 7f8ae9db1640 1 -- start start 2023-12-20T04:51:34.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.250+0000 7f8ae9db1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8ae415e530 0x7f8ae406fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.250+0000 7f8ae9db1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ae406c240 0x7f8ae406c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.250+0000 7f8ae9db1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8ae40ccf30 con 0x7f8ae4159b50 2023-12-20T04:51:34.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.250+0000 7f8ae9db1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8ae406cc10 con 0x7f8ae415e530 2023-12-20T04:51:34.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.250+0000 7f8ae9db1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae40caa60 con 0x7f8ae406c240 2023-12-20T04:51:34.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.250+0000 7f8ae37fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8ae4159b50 0x7f8ae40c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:53992/0 (socket says 172.21.15.132:53992) 2023-12-20T04:51:34.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.250+0000 7f8ae37fe640 1 -- 172.21.15.132:0/2531388266 learned_addr learned my addr 172.21.15.132:0/2531388266 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:34.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.250+0000 7f8ae2ffd640 1 --2- 172.21.15.132:0/2531388266 >> v2:172.21.15.132:3300/0 conn(0x7f8ae415e530 0x7f8ae406fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.251+0000 7f8ae2ffd640 1 -- 172.21.15.132:0/2531388266 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ae406c240 msgr2=0x7f8ae406c6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:34.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.251+0000 7f8ae2ffd640 1 --2- 172.21.15.132:0/2531388266 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ae406c240 0x7f8ae406c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.251+0000 7f8ae2ffd640 1 -- 172.21.15.132:0/2531388266 >> v1:172.21.15.132:6789/0 conn(0x7f8ae4159b50 legacy=0x7f8ae40c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.251+0000 7f8ae2ffd640 1 -- 172.21.15.132:0/2531388266 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ae40ca1c0 con 0x7f8ae415e530 2023-12-20T04:51:34.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.251+0000 7f8ae2ffd640 1 --2- 172.21.15.132:0/2531388266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ae415e530 0x7f8ae406fd70 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80097a0 tx=0x7f8ad802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5332970ef028ae7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:34.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.251+0000 7f8ae27fc640 1 -- 172.21.15.132:0/2531388266 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8031830 con 0x7f8ae415e530 2023-12-20T04:51:34.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.251+0000 7f8ae27fc640 1 -- 172.21.15.132:0/2531388266 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ad8031990 con 0x7f8ae415e530 2023-12-20T04:51:34.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.251+0000 7f8ae27fc640 1 -- 172.21.15.132:0/2531388266 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ad8031d20 con 0x7f8ae415e530 2023-12-20T04:51:34.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.252+0000 7f8ae9db1640 1 -- 172.21.15.132:0/2531388266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ae415e530 msgr2=0x7f8ae406fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.252+0000 7f8ae9db1640 1 --2- 172.21.15.132:0/2531388266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ae415e530 0x7f8ae406fd70 secure :-1 s=READY pgs=1589 cs=0 l=1 rev1=1 crypto rx=0x7f8ad80097a0 tx=0x7f8ad802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.252+0000 7f8ae9db1640 1 -- 172.21.15.132:0/2531388266 shutdown_connections 2023-12-20T04:51:34.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.252+0000 7f8ae9db1640 1 --2- 172.21.15.132:0/2531388266 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ae406c240 0x7f8ae406c6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.252+0000 7f8ae9db1640 1 --2- 172.21.15.132:0/2531388266 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ae415e530 0x7f8ae406fd70 unknown :-1 s=CLOSED pgs=1589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.252+0000 7f8ae9db1640 1 -- 172.21.15.132:0/2531388266 >> 172.21.15.132:0/2531388266 conn(0x7f8ae40ced10 msgr2=0x7f8ae40cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:34.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.252+0000 7f8ae9db1640 1 -- 172.21.15.132:0/2531388266 shutdown_connections 2023-12-20T04:51:34.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.252+0000 7f8ae9db1640 1 -- 172.21.15.132:0/2531388266 wait complete. 2023-12-20T04:51:34.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.253+0000 7f8ae9db1640 1 Processor -- start 2023-12-20T04:51:34.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.253+0000 7f8ae9db1640 1 -- start start 2023-12-20T04:51:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.254+0000 7f8ae9db1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ae406c240 0x7f8ae41f3500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.254+0000 7f8ae9db1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ae4159b50 0x7f8ae406b130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.254+0000 7f8ae9db1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ae415e530 0x7f8ae406b670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.254+0000 7f8ae9db1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae4158780 con 0x7f8ae415e530 2023-12-20T04:51:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.254+0000 7f8ae9db1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae4151aa0 con 0x7f8ae4159b50 2023-12-20T04:51:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.254+0000 7f8ae9db1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8ae4157b20 con 0x7f8ae406c240 2023-12-20T04:51:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.254+0000 7f8ae3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ae415e530 0x7f8ae406b670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.254+0000 7f8ae3fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ae415e530 0x7f8ae406b670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35586/0 (socket says 172.21.15.132:35586) 2023-12-20T04:51:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.254+0000 7f8ae3fff640 1 -- 172.21.15.132:0/4289763180 learned_addr learned my addr 172.21.15.132:0/4289763180 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.254+0000 7f8ae3fff640 1 -- 172.21.15.132:0/4289763180 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ae406c240 msgr2=0x7f8ae41f3500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.254+0000 7f8ae2ffd640 1 --2- 172.21.15.132:0/4289763180 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ae4159b50 0x7f8ae406b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.254+0000 7f8ae37fe640 1 --2- 172.21.15.132:0/4289763180 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ae406c240 0x7f8ae41f3500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.254+0000 7f8ae3fff640 1 --2- 172.21.15.132:0/4289763180 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ae406c240 0x7f8ae41f3500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.254+0000 7f8ae3fff640 1 -- 172.21.15.132:0/4289763180 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ae4159b50 msgr2=0x7f8ae406b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.254+0000 7f8ae3fff640 1 --2- 172.21.15.132:0/4289763180 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ae4159b50 0x7f8ae406b130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.254+0000 7f8ae3fff640 1 -- 172.21.15.132:0/4289763180 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ad8009400 con 0x7f8ae415e530 2023-12-20T04:51:34.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.255+0000 7f8ae3fff640 1 --2- 172.21.15.132:0/4289763180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ae415e530 0x7f8ae406b670 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00b410 tx=0x7f8adc00b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:34.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.255+0000 7f8acbfff640 1 -- 172.21.15.132:0/4289763180 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc011830 con 0x7f8ae415e530 2023-12-20T04:51:34.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.255+0000 7f8acbfff640 1 -- 172.21.15.132:0/4289763180 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8adc0119b0 con 0x7f8ae415e530 2023-12-20T04:51:34.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.255+0000 7f8acbfff640 1 -- 172.21.15.132:0/4289763180 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8adc011d60 con 0x7f8ae415e530 2023-12-20T04:51:34.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.255+0000 7f8ae9db1640 1 -- 172.21.15.132:0/4289763180 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ae4157de0 con 0x7f8ae415e530 2023-12-20T04:51:34.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.255+0000 7f8ae9db1640 1 -- 172.21.15.132:0/4289763180 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ae41583a0 con 0x7f8ae415e530 2023-12-20T04:51:34.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.256+0000 7f8ae9db1640 1 -- 172.21.15.132:0/4289763180 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8ae41588c0 con 0x7f8ae415e530 2023-12-20T04:51:34.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.256+0000 7f8acbfff640 1 -- 172.21.15.132:0/4289763180 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8adc01a400 con 0x7f8ae415e530 2023-12-20T04:51:34.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.257+0000 7f8acbfff640 1 --2- 172.21.15.132:0/4289763180 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8ad006a430 0x7f8ad006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.257+0000 7f8acbfff640 1 -- 172.21.15.132:0/4289763180 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8adc0889f0 con 0x7f8ae415e530 2023-12-20T04:51:34.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.257+0000 7f8ae37fe640 1 --2- 172.21.15.132:0/4289763180 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8ad006a430 0x7f8ad006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.257+0000 7f8acbfff640 1 -- 172.21.15.132:0/4289763180 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f8ad0072020 con 0x7f8ae415e530 2023-12-20T04:51:34.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.257+0000 7f8ae37fe640 1 --2- 172.21.15.132:0/4289763180 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8ad006a430 0x7f8ad006c8f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4005c00 tx=0x7f8ad4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:34.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.261+0000 7f8acbfff640 1 -- 172.21.15.132:0/4289763180 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8adc015020 con 0x7f8ae415e530 2023-12-20T04:51:34.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.461+0000 7f8ae9db1640 1 -- 172.21.15.132:0/4289763180 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8ae404e840 con 0x7f8ae415e530 2023-12-20T04:51:34.464 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.462+0000 7f8acbfff640 1 -- 172.21.15.132:0/4289763180 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f8adc054030 con 0x7f8ae415e530 2023-12-20T04:51:34.464 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:34.464 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":57,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/756703470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":756703470},{"type":"v1","addr":"172.21.15.187:6834","nonce":756703470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2177183802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2177183802},{"type":"v1","addr":"172.21.15.187:6835","nonce":2177183802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":8337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/390345313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":390345313},{"type":"v1","addr":"172.21.15.132:6837","nonce":390345313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:49:33.211903+0000","modified":"2023-12-20T04:49:35.219491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8340":{"gid":8340,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/3157504695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3157504695},{"type":"v1","addr":"172.21.15.132:6836","nonce":3157504695}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-20T04:51:34.464 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 57 2023-12-20T04:51:34.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.464+0000 7f8ae9db1640 1 -- 172.21.15.132:0/4289763180 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8ad006a430 msgr2=0x7f8ad006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.464+0000 7f8ae9db1640 1 --2- 172.21.15.132:0/4289763180 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8ad006a430 0x7f8ad006c8f0 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7f8ad4005c00 tx=0x7f8ad4009040 comp rx=0 tx=0).stop 2023-12-20T04:51:34.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.464+0000 7f8ae9db1640 1 -- 172.21.15.132:0/4289763180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ae415e530 msgr2=0x7f8ae406b670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.464+0000 7f8ae9db1640 1 --2- 172.21.15.132:0/4289763180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ae415e530 0x7f8ae406b670 secure :-1 s=READY pgs=1590 cs=0 l=1 rev1=1 crypto rx=0x7f8adc00b410 tx=0x7f8adc00b8d0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.464+0000 7f8ae9db1640 1 -- 172.21.15.132:0/4289763180 shutdown_connections 2023-12-20T04:51:34.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.464+0000 7f8ae9db1640 1 --2- 172.21.15.132:0/4289763180 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8ad006a430 0x7f8ad006c8f0 unknown :-1 s=CLOSED pgs=668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.464+0000 7f8ae9db1640 1 --2- 172.21.15.132:0/4289763180 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8ae415e530 0x7f8ae406b670 unknown :-1 s=CLOSED pgs=1590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.464+0000 7f8ae9db1640 1 --2- 172.21.15.132:0/4289763180 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8ae4159b50 0x7f8ae406b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.464+0000 7f8ae9db1640 1 --2- 172.21.15.132:0/4289763180 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8ae406c240 0x7f8ae41f3500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.464+0000 7f8ae9db1640 1 -- 172.21.15.132:0/4289763180 >> 172.21.15.132:0/4289763180 conn(0x7f8ae40ced10 msgr2=0x7f8ae40b18d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:34.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.464+0000 7f8ae9db1640 1 -- 172.21.15.132:0/4289763180 shutdown_connections 2023-12-20T04:51:34.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.464+0000 7f8ae9db1640 1 -- 172.21.15.132:0/4289763180 wait complete. 2023-12-20T04:51:34.477 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:51:34.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.575+0000 7f75163bf640 1 Processor -- start 2023-12-20T04:51:34.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.575+0000 7f75163bf640 1 -- start start 2023-12-20T04:51:34.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.576+0000 7f75163bf640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f75100718e0 0x7f75100cb4a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.576+0000 7f75163bf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75100ca8e0 0x7f75100b2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.576+0000 7f75163bf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f75100cbba0 con 0x7f751006fd60 2023-12-20T04:51:34.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.576+0000 7f75163bf640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f751015b3f0 con 0x7f75100718e0 2023-12-20T04:51:34.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.576+0000 7f75163bf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f751006cde0 con 0x7f75100ca8e0 2023-12-20T04:51:34.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.576+0000 7f750f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f751006fd60 0x7f7510071cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54008/0 (socket says 172.21.15.132:54008) 2023-12-20T04:51:34.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.576+0000 7f750f7fe640 1 -- 172.21.15.132:0/4009065841 learned_addr learned my addr 172.21.15.132:0/4009065841 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:34.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.576+0000 7f750ffff640 1 --2- 172.21.15.132:0/4009065841 >> v2:172.21.15.187:3300/0 conn(0x7f75100718e0 0x7f75100cb4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.576+0000 7f751495c640 1 --2- 172.21.15.132:0/4009065841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75100ca8e0 0x7f75100b2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.576+0000 7f750effd640 1 -- 172.21.15.132:0/4009065841 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1924028604 0 0) 0x7f7504001110 con 0x7f751006fd60 2023-12-20T04:51:34.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.576+0000 7f750effd640 1 -- 172.21.15.132:0/4009065841 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f74f8003520 con 0x7f751006fd60 2023-12-20T04:51:34.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.577+0000 7f750effd640 1 -- 172.21.15.132:0/4009065841 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 478330200 0 0) 0x7f74f8003520 con 0x7f751006fd60 2023-12-20T04:51:34.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.577+0000 7f750ffff640 1 -- 172.21.15.132:0/4009065841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75100ca8e0 msgr2=0x7f75100b2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:34.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.577+0000 7f750ffff640 1 --2- 172.21.15.132:0/4009065841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75100ca8e0 0x7f75100b2180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.577+0000 7f750ffff640 1 -- 172.21.15.132:0/4009065841 >> v1:172.21.15.132:6789/0 conn(0x7f751006fd60 legacy=0x7f7510071cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.577+0000 7f750ffff640 1 -- 172.21.15.132:0/4009065841 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f75100c9b20 con 0x7f75100718e0 2023-12-20T04:51:34.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.577+0000 7f751495c640 1 --2- 172.21.15.132:0/4009065841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75100ca8e0 0x7f75100b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:51:34.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.578+0000 7f750ffff640 1 --2- 172.21.15.132:0/4009065841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75100718e0 0x7f75100cb4a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f75000097a0 tx=0x7f750002b710 comp rx=0 tx=0).ready entity=mon.1 client_cookie=38f6d547467dfae6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:34.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.578+0000 7f750effd640 1 -- 172.21.15.132:0/4009065841 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504001800 con 0x7f75100718e0 2023-12-20T04:51:34.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.578+0000 7f750effd640 1 -- 172.21.15.132:0/4009065841 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750002e050 con 0x7f75100718e0 2023-12-20T04:51:34.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.578+0000 7f750effd640 1 -- 172.21.15.132:0/4009065841 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7500030730 con 0x7f75100718e0 2023-12-20T04:51:34.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.578+0000 7f75163bf640 1 -- 172.21.15.132:0/4009065841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75100718e0 msgr2=0x7f75100cb4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.578+0000 7f75163bf640 1 --2- 172.21.15.132:0/4009065841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75100718e0 0x7f75100cb4a0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f75000097a0 tx=0x7f750002b710 comp rx=0 tx=0).stop 2023-12-20T04:51:34.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.578+0000 7f75163bf640 1 -- 172.21.15.132:0/4009065841 shutdown_connections 2023-12-20T04:51:34.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.578+0000 7f75163bf640 1 --2- 172.21.15.132:0/4009065841 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f75100ca8e0 0x7f75100b2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.578+0000 7f75163bf640 1 --2- 172.21.15.132:0/4009065841 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75100718e0 0x7f75100cb4a0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.578+0000 7f75163bf640 1 -- 172.21.15.132:0/4009065841 >> 172.21.15.132:0/4009065841 conn(0x7f75100cf330 msgr2=0x7f75100cf740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:34.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.578+0000 7f75163bf640 1 -- 172.21.15.132:0/4009065841 shutdown_connections 2023-12-20T04:51:34.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.578+0000 7f75163bf640 1 -- 172.21.15.132:0/4009065841 wait complete. 2023-12-20T04:51:34.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.579+0000 7f75163bf640 1 Processor -- start 2023-12-20T04:51:34.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.580+0000 7f75163bf640 1 -- start start 2023-12-20T04:51:34.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.580+0000 7f75163bf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f751006fd60 0x7f75101f2330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.580+0000 7f75163bf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100718e0 0x7f7510146bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.580+0000 7f75163bf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75100ca8e0 0x7f75100afc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.580+0000 7f75163bf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f75101efd60 con 0x7f75100718e0 2023-12-20T04:51:34.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.580+0000 7f75163bf640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7510147100 con 0x7f75100ca8e0 2023-12-20T04:51:34.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.580+0000 7f75163bf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f75101f2960 con 0x7f751006fd60 2023-12-20T04:51:34.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.580+0000 7f750f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100718e0 0x7f7510146bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.580+0000 7f750f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100718e0 0x7f7510146bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35592/0 (socket says 172.21.15.132:35592) 2023-12-20T04:51:34.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.580+0000 7f750f7fe640 1 -- 172.21.15.132:0/2552905075 learned_addr learned my addr 172.21.15.132:0/2552905075 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:34.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.581+0000 7f750ffff640 1 --2- 172.21.15.132:0/2552905075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f751006fd60 0x7f75101f2330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.581+0000 7f751495c640 1 --2- 172.21.15.132:0/2552905075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75100ca8e0 0x7f75100afc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.581+0000 7f750f7fe640 1 -- 172.21.15.132:0/2552905075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f751006fd60 msgr2=0x7f75101f2330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.581+0000 7f750f7fe640 1 --2- 172.21.15.132:0/2552905075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f751006fd60 0x7f75101f2330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.581+0000 7f750f7fe640 1 -- 172.21.15.132:0/2552905075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75100ca8e0 msgr2=0x7f75100afc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.581+0000 7f750f7fe640 1 --2- 172.21.15.132:0/2552905075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75100ca8e0 0x7f75100afc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.581+0000 7f750f7fe640 1 -- 172.21.15.132:0/2552905075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7508009a70 con 0x7f75100718e0 2023-12-20T04:51:34.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.581+0000 7f750f7fe640 1 --2- 172.21.15.132:0/2552905075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100718e0 0x7f7510146bc0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f750400c750 tx=0x7f750400cb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:34.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.581+0000 7f750cff9640 1 -- 172.21.15.132:0/2552905075 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504005ad0 con 0x7f75100718e0 2023-12-20T04:51:34.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.581+0000 7f750cff9640 1 -- 172.21.15.132:0/2552905075 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f750400ce90 con 0x7f75100718e0 2023-12-20T04:51:34.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.581+0000 7f75163bf640 1 -- 172.21.15.132:0/2552905075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7500009400 con 0x7f75100718e0 2023-12-20T04:51:34.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.581+0000 7f750cff9640 1 -- 172.21.15.132:0/2552905075 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7504005e90 con 0x7f75100718e0 2023-12-20T04:51:34.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.581+0000 7f75163bf640 1 -- 172.21.15.132:0/2552905075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f75101f2f20 con 0x7f75100718e0 2023-12-20T04:51:34.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.582+0000 7f75163bf640 1 -- 172.21.15.132:0/2552905075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f751004e840 con 0x7f75100718e0 2023-12-20T04:51:34.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.583+0000 7f750cff9640 1 -- 172.21.15.132:0/2552905075 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7504007070 con 0x7f75100718e0 2023-12-20T04:51:34.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.583+0000 7f750cff9640 1 --2- 172.21.15.132:0/2552905075 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f74fc06a430 0x7f74fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.583+0000 7f750cff9640 1 -- 172.21.15.132:0/2552905075 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f75040883a0 con 0x7f75100718e0 2023-12-20T04:51:34.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.583+0000 7f750ffff640 1 --2- 172.21.15.132:0/2552905075 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f74fc06a430 0x7f74fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.583+0000 7f750cff9640 1 -- 172.21.15.132:0/2552905075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f74fc072020 con 0x7f75100718e0 2023-12-20T04:51:34.587 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.584+0000 7f750ffff640 1 --2- 172.21.15.132:0/2552905075 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f74fc06a430 0x7f74fc06c8f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7500034000 tx=0x7f7500008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:34.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.587+0000 7f750cff9640 1 -- 172.21.15.132:0/2552905075 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7504053950 con 0x7f75100718e0 2023-12-20T04:51:34.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.755+0000 7f75163bf640 1 -- 172.21.15.132:0/2552905075 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f75100cbba0 con 0x7f75100718e0 2023-12-20T04:51:34.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.756+0000 7f750cff9640 1 -- 172.21.15.132:0/2552905075 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+16227 (secure 0 0 0) 0x7f75100cbba0 con 0x7f75100718e0 2023-12-20T04:51:34.758 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:34.759 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":157,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:50:39.874578+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:49:31.238506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-20T04:49:32.189571+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.3","mappings":[{"from":2,"to":0}]},{"pgid":"19.31","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:51:34.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.758+0000 7f75163bf640 1 -- 172.21.15.132:0/2552905075 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f74fc06a430 msgr2=0x7f74fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.758+0000 7f75163bf640 1 --2- 172.21.15.132:0/2552905075 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f74fc06a430 0x7f74fc06c8f0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7f7500034000 tx=0x7f7500008030 comp rx=0 tx=0).stop 2023-12-20T04:51:34.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.758+0000 7f75163bf640 1 -- 172.21.15.132:0/2552905075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100718e0 msgr2=0x7f7510146bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.758+0000 7f75163bf640 1 --2- 172.21.15.132:0/2552905075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100718e0 0x7f7510146bc0 secure :-1 s=READY pgs=1592 cs=0 l=1 rev1=1 crypto rx=0x7f750400c750 tx=0x7f750400cb50 comp rx=0 tx=0).stop 2023-12-20T04:51:34.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.758+0000 7f75163bf640 1 -- 172.21.15.132:0/2552905075 shutdown_connections 2023-12-20T04:51:34.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.758+0000 7f75163bf640 1 --2- 172.21.15.132:0/2552905075 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f74fc06a430 0x7f74fc06c8f0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.758+0000 7f75163bf640 1 --2- 172.21.15.132:0/2552905075 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f75100ca8e0 0x7f75100afc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.758+0000 7f75163bf640 1 --2- 172.21.15.132:0/2552905075 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f75100718e0 0x7f7510146bc0 unknown :-1 s=CLOSED pgs=1592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.758+0000 7f75163bf640 1 --2- 172.21.15.132:0/2552905075 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f751006fd60 0x7f75101f2330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.758+0000 7f75163bf640 1 -- 172.21.15.132:0/2552905075 >> 172.21.15.132:0/2552905075 conn(0x7f75100cf330 msgr2=0x7f7510071cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:34.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.758+0000 7f75163bf640 1 -- 172.21.15.132:0/2552905075 shutdown_connections 2023-12-20T04:51:34.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.758+0000 7f75163bf640 1 -- 172.21.15.132:0/2552905075 wait complete. 2023-12-20T04:51:34.772 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-20T04:51:34.772 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:51:34.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.869+0000 7fe7dbf4e640 1 Processor -- start 2023-12-20T04:51:34.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.869+0000 7fe7dbf4e640 1 -- start start 2023-12-20T04:51:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.870+0000 7fe7dbf4e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe7d4160450 0x7fe7d4160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.870+0000 7fe7dbf4e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40b5090 0x7fe7d40d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.870+0000 7fe7dbf4e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7d40b5ec0 con 0x7fe7d41611b0 2023-12-20T04:51:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.870+0000 7fe7dbf4e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7d41617e0 con 0x7fe7d4160450 2023-12-20T04:51:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.870+0000 7fe7dbf4e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d40d0fc0 con 0x7fe7d40b5090 2023-12-20T04:51:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.870+0000 7fe7d94e9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe7d41611b0 0x7fe7d40b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:54016/0 (socket says 172.21.15.132:54016) 2023-12-20T04:51:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.870+0000 7fe7d94e9640 1 -- 172.21.15.132:0/1214777094 learned_addr learned my addr 172.21.15.132:0/1214777094 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:34.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7da4eb640 1 --2- 172.21.15.132:0/1214777094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40b5090 0x7fe7d40d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d9cea640 1 --2- 172.21.15.132:0/1214777094 >> v2:172.21.15.187:3300/0 conn(0x7fe7d4160450 0x7fe7d4160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d8ce8640 1 -- 172.21.15.132:0/1214777094 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2336366601 0 0) 0x7fe7d40b5ec0 con 0x7fe7d41611b0 2023-12-20T04:51:34.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d8ce8640 1 -- 172.21.15.132:0/1214777094 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7c0003520 con 0x7fe7d41611b0 2023-12-20T04:51:34.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d8ce8640 1 -- 172.21.15.132:0/1214777094 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2666723907 0 0) 0x7fe7c0003520 con 0x7fe7d41611b0 2023-12-20T04:51:34.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d8ce8640 1 -- 172.21.15.132:0/1214777094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40b5090 msgr2=0x7fe7d40d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:34.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d8ce8640 1 --2- 172.21.15.132:0/1214777094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40b5090 0x7fe7d40d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d8ce8640 1 -- 172.21.15.132:0/1214777094 >> v2:172.21.15.187:3300/0 conn(0x7fe7d4160450 msgr2=0x7fe7d4160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:34.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d8ce8640 1 --2- 172.21.15.132:0/1214777094 >> v2:172.21.15.187:3300/0 conn(0x7fe7d4160450 0x7fe7d4160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d8ce8640 1 -- 172.21.15.132:0/1214777094 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d40d12a0 con 0x7fe7d41611b0 2023-12-20T04:51:34.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d8ce8640 1 -- 172.21.15.132:0/1214777094 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fe7c4001670 con 0x7fe7d41611b0 2023-12-20T04:51:34.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d8ce8640 1 -- 172.21.15.132:0/1214777094 >> v1:172.21.15.132:6789/0 conn(0x7fe7d41611b0 legacy=0x7fe7d40b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7da4eb640 1 --2- 172.21.15.132:0/1214777094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40b5090 0x7fe7d40d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:51:34.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d8ce8640 1 --2- 172.21.15.132:0/1214777094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c0003970 0x7fe7c0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d8ce8640 1 --2- 172.21.15.132:0/1214777094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c00047c0 0x7fe7c0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d8ce8640 1 --2- 172.21.15.132:0/1214777094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40b5090 0x7fe7c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d8ce8640 1 -- 172.21.15.132:0/1214777094 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d41617e0 con 0x7fe7c0003970 2023-12-20T04:51:34.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d8ce8640 1 -- 172.21.15.132:0/1214777094 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d40d0fc0 con 0x7fe7c00047c0 2023-12-20T04:51:34.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d8ce8640 1 -- 172.21.15.132:0/1214777094 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c000b980 con 0x7fe7d40b5090 2023-12-20T04:51:34.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d9cea640 1 --2- 172.21.15.132:0/1214777094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c0003970 0x7fe7c0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d94e9640 1 --2- 172.21.15.132:0/1214777094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c00047c0 0x7fe7c0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7da4eb640 1 --2- 172.21.15.132:0/1214777094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40b5090 0x7fe7c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d9cea640 1 -- 172.21.15.132:0/1214777094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40b5090 msgr2=0x7fe7c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:34.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d9cea640 1 --2- 172.21.15.132:0/1214777094 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40b5090 0x7fe7c0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d9cea640 1 -- 172.21.15.132:0/1214777094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c00047c0 msgr2=0x7fe7c0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:34.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d9cea640 1 --2- 172.21.15.132:0/1214777094 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c00047c0 0x7fe7c0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.871+0000 7fe7d9cea640 1 -- 172.21.15.132:0/1214777094 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7cc009400 con 0x7fe7c0003970 2023-12-20T04:51:34.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.872+0000 7fe7d9cea640 1 --2- 172.21.15.132:0/1214777094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c0003970 0x7fe7c0003d90 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009fc0 tx=0x7fe7c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86064ea3f812fc6d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:34.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.872+0000 7fe7d8ce8640 1 -- 172.21.15.132:0/1214777094 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d002cc60 con 0x7fe7c0003970 2023-12-20T04:51:34.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.872+0000 7fe7d8ce8640 1 -- 172.21.15.132:0/1214777094 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7d000f040 con 0x7fe7c0003970 2023-12-20T04:51:34.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.872+0000 7fe7d8ce8640 1 -- 172.21.15.132:0/1214777094 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7d0034440 con 0x7fe7c0003970 2023-12-20T04:51:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.873+0000 7fe7dbf4e640 1 -- 172.21.15.132:0/1214777094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c0003970 msgr2=0x7fe7c0003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.873+0000 7fe7dbf4e640 1 --2- 172.21.15.132:0/1214777094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c0003970 0x7fe7c0003d90 secure :-1 s=READY pgs=1594 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0009fc0 tx=0x7fe7c00057f0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.873+0000 7fe7da4eb640 1 -- 172.21.15.132:0/1214777094 reap_dead start 2023-12-20T04:51:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.873+0000 7fe7dbf4e640 1 -- 172.21.15.132:0/1214777094 shutdown_connections 2023-12-20T04:51:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.873+0000 7fe7dbf4e640 1 -- 172.21.15.132:0/1214777094 >> 172.21.15.132:0/1214777094 conn(0x7fe7d40cf980 msgr2=0x7fe7d40cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.873+0000 7fe7dbf4e640 1 -- 172.21.15.132:0/1214777094 shutdown_connections 2023-12-20T04:51:34.878 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.873+0000 7fe7dbf4e640 1 -- 172.21.15.132:0/1214777094 wait complete. 2023-12-20T04:51:34.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.874+0000 7fe7dbf4e640 1 Processor -- start 2023-12-20T04:51:34.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.874+0000 7fe7dbf4e640 1 -- start start 2023-12-20T04:51:34.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7dbf4e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c0003970 0x7fe7d41f3140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7dbf4e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d40c8950 0x7fe7d415cc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7dbf4e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40c8d90 0x7fe7d40b70e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7dbf4e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d4156440 con 0x7fe7d40c8950 2023-12-20T04:51:34.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7dbf4e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d415d570 con 0x7fe7c0003970 2023-12-20T04:51:34.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7dbf4e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7d4156690 con 0x7fe7d40c8d90 2023-12-20T04:51:34.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7d94e9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d40c8950 0x7fe7d415cc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7d94e9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d40c8950 0x7fe7d415cc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35608/0 (socket says 172.21.15.132:35608) 2023-12-20T04:51:34.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7d94e9640 1 -- 172.21.15.132:0/1469194454 learned_addr learned my addr 172.21.15.132:0/1469194454 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:34.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7d9cea640 1 --2- 172.21.15.132:0/1469194454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c0003970 0x7fe7d41f3140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7da4eb640 1 --2- 172.21.15.132:0/1469194454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40c8d90 0x7fe7d40b70e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7d94e9640 1 -- 172.21.15.132:0/1469194454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40c8d90 msgr2=0x7fe7d40b70e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7d94e9640 1 --2- 172.21.15.132:0/1469194454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40c8d90 0x7fe7d40b70e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7d94e9640 1 -- 172.21.15.132:0/1469194454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c0003970 msgr2=0x7fe7d41f3140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7d94e9640 1 --2- 172.21.15.132:0/1469194454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c0003970 0x7fe7d41f3140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7d94e9640 1 -- 172.21.15.132:0/1469194454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7d4156970 con 0x7fe7d40c8950 2023-12-20T04:51:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7d94e9640 1 --2- 172.21.15.132:0/1469194454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d40c8950 0x7fe7d415cc20 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4007310 tx=0x7fe7c40077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7ca7fc640 1 -- 172.21.15.132:0/1469194454 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c400f940 con 0x7fe7d40c8950 2023-12-20T04:51:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7ca7fc640 1 -- 172.21.15.132:0/1469194454 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c400fac0 con 0x7fe7d40c8950 2023-12-20T04:51:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7ca7fc640 1 -- 172.21.15.132:0/1469194454 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c400fe70 con 0x7fe7d40c8950 2023-12-20T04:51:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.875+0000 7fe7dbf4e640 1 -- 172.21.15.132:0/1469194454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7d4156c50 con 0x7fe7d40c8950 2023-12-20T04:51:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.876+0000 7fe7dbf4e640 1 -- 172.21.15.132:0/1469194454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7d415d340 con 0x7fe7d40c8950 2023-12-20T04:51:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.876+0000 7fe7dbf4e640 1 -- 172.21.15.132:0/1469194454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7d40ce560 con 0x7fe7d40c8950 2023-12-20T04:51:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.877+0000 7fe7ca7fc640 1 -- 172.21.15.132:0/1469194454 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe7c401d460 con 0x7fe7d40c8950 2023-12-20T04:51:34.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.877+0000 7fe7ca7fc640 1 --2- 172.21.15.132:0/1469194454 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe7b806a430 0x7fe7b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:34.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.877+0000 7fe7ca7fc640 1 -- 172.21.15.132:0/1469194454 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7fe7c4088b90 con 0x7fe7d40c8950 2023-12-20T04:51:34.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.877+0000 7fe7d9cea640 1 --2- 172.21.15.132:0/1469194454 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe7b806a430 0x7fe7b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:34.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.877+0000 7fe7ca7fc640 1 -- 172.21.15.132:0/1469194454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7fe7b8072020 con 0x7fe7d40c8950 2023-12-20T04:51:34.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.878+0000 7fe7d9cea640 1 --2- 172.21.15.132:0/1469194454 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe7b806a430 0x7fe7b806c8f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0036000 tx=0x7fe7d002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:34.883 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:34.882+0000 7fe7ca7fc640 1 -- 172.21.15.132:0/1469194454 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe7c40540b0 con 0x7fe7d40c8950 2023-12-20T04:51:35.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.080+0000 7fe7dbf4e640 1 -- 172.21.15.132:0/1469194454 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7d404e840 con 0x7fe7d40c8950 2023-12-20T04:51:35.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.081+0000 7fe7ca7fc640 1 -- 172.21.15.132:0/1469194454 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4717 (secure 0 0 0) 0x7fe7c40576d0 con 0x7fe7d40c8950 2023-12-20T04:51:35.083 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:35.083 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":57,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/756703470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":756703470},{"type":"v1","addr":"172.21.15.187:6834","nonce":756703470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2177183802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2177183802},{"type":"v1","addr":"172.21.15.187:6835","nonce":2177183802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":8337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/390345313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":390345313},{"type":"v1","addr":"172.21.15.132:6837","nonce":390345313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:49:33.211903+0000","modified":"2023-12-20T04:49:35.219491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8340":{"gid":8340,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/3157504695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3157504695},{"type":"v1","addr":"172.21.15.132:6836","nonce":3157504695}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-20T04:51:35.083 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 57 2023-12-20T04:51:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.083+0000 7fe7dbf4e640 1 -- 172.21.15.132:0/1469194454 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe7b806a430 msgr2=0x7fe7b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.083+0000 7fe7dbf4e640 1 --2- 172.21.15.132:0/1469194454 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe7b806a430 0x7fe7b806c8f0 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7fe7d0036000 tx=0x7fe7d002e000 comp rx=0 tx=0).stop 2023-12-20T04:51:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.083+0000 7fe7dbf4e640 1 -- 172.21.15.132:0/1469194454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d40c8950 msgr2=0x7fe7d415cc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.083+0000 7fe7dbf4e640 1 --2- 172.21.15.132:0/1469194454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d40c8950 0x7fe7d415cc20 secure :-1 s=READY pgs=1595 cs=0 l=1 rev1=1 crypto rx=0x7fe7c4007310 tx=0x7fe7c40077d0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.083+0000 7fe7dbf4e640 1 -- 172.21.15.132:0/1469194454 shutdown_connections 2023-12-20T04:51:35.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.083+0000 7fe7dbf4e640 1 --2- 172.21.15.132:0/1469194454 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe7b806a430 0x7fe7b806c8f0 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.083+0000 7fe7dbf4e640 1 --2- 172.21.15.132:0/1469194454 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7d40c8d90 0x7fe7d40b70e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.083+0000 7fe7dbf4e640 1 --2- 172.21.15.132:0/1469194454 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7d40c8950 0x7fe7d415cc20 unknown :-1 s=CLOSED pgs=1595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.083+0000 7fe7dbf4e640 1 --2- 172.21.15.132:0/1469194454 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c0003970 0x7fe7d41f3140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.083+0000 7fe7dbf4e640 1 -- 172.21.15.132:0/1469194454 >> 172.21.15.132:0/1469194454 conn(0x7fe7d40cf980 msgr2=0x7fe7d40d19a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.083+0000 7fe7dbf4e640 1 -- 172.21.15.132:0/1469194454 shutdown_connections 2023-12-20T04:51:35.086 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.083+0000 7fe7dbf4e640 1 -- 172.21.15.132:0/1469194454 wait complete. 2023-12-20T04:51:35.096 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:51:35.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.193+0000 7f8a17dea640 1 Processor -- start 2023-12-20T04:51:35.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.194+0000 7f8a17dea640 1 -- start start 2023-12-20T04:51:35.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.194+0000 7f8a17dea640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8a10160450 0x7f8a10160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.194+0000 7f8a17dea640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a101611b0 0x7f8a100b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.194+0000 7f8a17dea640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8a100b5ec0 con 0x7f8a100b4ec0 2023-12-20T04:51:35.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.194+0000 7f8a17dea640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8a100b5350 con 0x7f8a10160450 2023-12-20T04:51:35.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.194+0000 7f8a17dea640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a101617e0 con 0x7f8a101611b0 2023-12-20T04:51:35.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.195+0000 7f8a15b86640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8a10160450 0x7f8a10160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:35.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.195+0000 7f8a16387640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f8a100b4ec0 0x7f8a1006a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:36246/0 (socket says 172.21.15.132:36246) 2023-12-20T04:51:35.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.195+0000 7f8a16387640 1 -- 172.21.15.132:0/4034050827 learned_addr learned my addr 172.21.15.132:0/4034050827 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:35.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.195+0000 7f8a15385640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a101611b0 0x7f8a100b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:35.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.195+0000 7f8a15385640 1 -- 172.21.15.132:0/4034050827 >> v2:172.21.15.187:3300/0 conn(0x7f8a10160450 msgr2=0x7f8a10160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:35.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.195+0000 7f8a15385640 1 --2- 172.21.15.132:0/4034050827 >> v2:172.21.15.187:3300/0 conn(0x7f8a10160450 0x7f8a10160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.195+0000 7f8a15385640 1 -- 172.21.15.132:0/4034050827 >> v1:172.21.15.187:6789/0 conn(0x7f8a100b4ec0 legacy=0x7f8a1006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:35.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.195+0000 7f8a15385640 1 -- 172.21.15.132:0/4034050827 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a100d0fc0 con 0x7f8a101611b0 2023-12-20T04:51:35.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.195+0000 7f8a15b86640 1 --2- 172.21.15.132:0/4034050827 >> v2:172.21.15.187:3300/0 conn(0x7f8a10160450 0x7f8a10160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:51:35.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.196+0000 7f8a15385640 1 --2- 172.21.15.132:0/4034050827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a101611b0 0x7f8a100b4980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8a000097a0 tx=0x7f8a0002b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=cd65f06f8983f1e8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:35.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.196+0000 7f8a14b84640 1 -- 172.21.15.132:0/4034050827 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a00030610 con 0x7f8a101611b0 2023-12-20T04:51:35.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.196+0000 7f8a14b84640 1 -- 172.21.15.132:0/4034050827 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a00030770 con 0x7f8a101611b0 2023-12-20T04:51:35.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.196+0000 7f8a14b84640 1 -- 172.21.15.132:0/4034050827 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a00030b00 con 0x7f8a101611b0 2023-12-20T04:51:35.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.196+0000 7f8a17dea640 1 -- 172.21.15.132:0/4034050827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a101611b0 msgr2=0x7f8a100b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:35.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.196+0000 7f8a17dea640 1 --2- 172.21.15.132:0/4034050827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a101611b0 0x7f8a100b4980 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f8a000097a0 tx=0x7f8a0002b960 comp rx=0 tx=0).stop 2023-12-20T04:51:35.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.196+0000 7f8a17dea640 1 -- 172.21.15.132:0/4034050827 shutdown_connections 2023-12-20T04:51:35.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.196+0000 7f8a17dea640 1 --2- 172.21.15.132:0/4034050827 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a101611b0 0x7f8a100b4980 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.196+0000 7f8a17dea640 1 --2- 172.21.15.132:0/4034050827 >> v2:172.21.15.187:3300/0 conn(0x7f8a10160450 0x7f8a10160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.196+0000 7f8a17dea640 1 -- 172.21.15.132:0/4034050827 >> 172.21.15.132:0/4034050827 conn(0x7f8a100cf980 msgr2=0x7f8a100cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:35.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.196+0000 7f8a17dea640 1 -- 172.21.15.132:0/4034050827 shutdown_connections 2023-12-20T04:51:35.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.196+0000 7f8a17dea640 1 -- 172.21.15.132:0/4034050827 wait complete. 2023-12-20T04:51:35.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.198+0000 7f8a17dea640 1 Processor -- start 2023-12-20T04:51:35.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.198+0000 7f8a17dea640 1 -- start start 2023-12-20T04:51:35.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.198+0000 7f8a17dea640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a100b4ec0 0x7f8a100c92f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.198+0000 7f8a17dea640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a10160450 0x7f8a100d35d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.198+0000 7f8a17dea640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a101611b0 0x7f8a100b6300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.198+0000 7f8a17dea640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a100c9830 con 0x7f8a101611b0 2023-12-20T04:51:35.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.198+0000 7f8a17dea640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a101570c0 con 0x7f8a100b4ec0 2023-12-20T04:51:35.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.198+0000 7f8a17dea640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8a101573a0 con 0x7f8a10160450 2023-12-20T04:51:35.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.198+0000 7f8a16387640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a101611b0 0x7f8a100b6300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:35.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.198+0000 7f8a16387640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a101611b0 0x7f8a100b6300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35624/0 (socket says 172.21.15.132:35624) 2023-12-20T04:51:35.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.198+0000 7f8a16387640 1 -- 172.21.15.132:0/1807392392 learned_addr learned my addr 172.21.15.132:0/1807392392 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:35.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.198+0000 7f8a15b86640 1 --2- 172.21.15.132:0/1807392392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a100b4ec0 0x7f8a100c92f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:35.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.199+0000 7f8a15385640 1 --2- 172.21.15.132:0/1807392392 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a10160450 0x7f8a100d35d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:35.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.199+0000 7f8a16387640 1 -- 172.21.15.132:0/1807392392 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a10160450 msgr2=0x7f8a100d35d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:35.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.199+0000 7f8a16387640 1 --2- 172.21.15.132:0/1807392392 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a10160450 0x7f8a100d35d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.199+0000 7f8a16387640 1 -- 172.21.15.132:0/1807392392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a100b4ec0 msgr2=0x7f8a100c92f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:35.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.199+0000 7f8a16387640 1 --2- 172.21.15.132:0/1807392392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a100b4ec0 0x7f8a100c92f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.199+0000 7f8a16387640 1 -- 172.21.15.132:0/1807392392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a0c009a70 con 0x7f8a101611b0 2023-12-20T04:51:35.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.199+0000 7f8a16387640 1 --2- 172.21.15.132:0/1807392392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a101611b0 0x7f8a100b6300 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800c420 tx=0x7f8a0800c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:35.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.199+0000 7f8a067fc640 1 -- 172.21.15.132:0/1807392392 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a08005ce0 con 0x7f8a101611b0 2023-12-20T04:51:35.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.199+0000 7f8a067fc640 1 -- 172.21.15.132:0/1807392392 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8a08005e40 con 0x7f8a101611b0 2023-12-20T04:51:35.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.199+0000 7f8a17dea640 1 -- 172.21.15.132:0/1807392392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a00009400 con 0x7f8a101611b0 2023-12-20T04:51:35.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.199+0000 7f8a067fc640 1 -- 172.21.15.132:0/1807392392 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8a080072d0 con 0x7f8a101611b0 2023-12-20T04:51:35.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.199+0000 7f8a17dea640 1 -- 172.21.15.132:0/1807392392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a10157960 con 0x7f8a101611b0 2023-12-20T04:51:35.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.200+0000 7f8a17dea640 1 -- 172.21.15.132:0/1807392392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a1004e840 con 0x7f8a101611b0 2023-12-20T04:51:35.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.200+0000 7f8a067fc640 1 -- 172.21.15.132:0/1807392392 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8a080074f0 con 0x7f8a101611b0 2023-12-20T04:51:35.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.201+0000 7f8a067fc640 1 --2- 172.21.15.132:0/1807392392 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89f406a430 0x7f89f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.201+0000 7f8a067fc640 1 -- 172.21.15.132:0/1807392392 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f8a08087ea0 con 0x7f8a101611b0 2023-12-20T04:51:35.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.201+0000 7f8a15b86640 1 --2- 172.21.15.132:0/1807392392 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89f406a430 0x7f89f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:35.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.201+0000 7f8a067fc640 1 -- 172.21.15.132:0/1807392392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f89f4072020 con 0x7f8a101611b0 2023-12-20T04:51:35.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.201+0000 7f8a15b86640 1 --2- 172.21.15.132:0/1807392392 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89f406a430 0x7f89f406c8f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c007600 tx=0x7f8a0c00b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:35.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.205+0000 7f8a067fc640 1 -- 172.21.15.132:0/1807392392 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8a08017070 con 0x7f8a101611b0 2023-12-20T04:51:35.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.404+0000 7f8a17dea640 1 -- 172.21.15.132:0/1807392392 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f8a100d0ad0 con 0x7f8a101611b0 2023-12-20T04:51:35.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.404+0000 7f8a067fc640 1 -- 172.21.15.132:0/1807392392 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 57 v57) v1 ==== 94+0+4717 (secure 0 0 0) 0x7f8a08053470 con 0x7f8a101611b0 2023-12-20T04:51:35.406 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:35.407 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":57,"default_fscid":9,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/756703470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":756703470},{"type":"v1","addr":"172.21.15.187:6834","nonce":756703470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2177183802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2177183802},{"type":"v1","addr":"172.21.15.187:6835","nonce":2177183802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":8337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/390345313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":390345313},{"type":"v1","addr":"172.21.15.132:6837","nonce":390345313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54}],"filesystems":[{"mdsmap":{"epoch":57,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:49:33.211903+0000","modified":"2023-12-20T04:49:35.219491+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8340},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8340":{"gid":8340,"name":"a","rank":0,"incarnation":55,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6836/3157504695","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":3157504695},{"type":"v1","addr":"172.21.15.132:6836","nonce":3157504695}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[19],"metadata_pool":18,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":9}]} 2023-12-20T04:51:35.407 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 57 2023-12-20T04:51:35.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.406+0000 7f8a17dea640 1 -- 172.21.15.132:0/1807392392 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89f406a430 msgr2=0x7f89f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:35.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.406+0000 7f8a17dea640 1 --2- 172.21.15.132:0/1807392392 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89f406a430 0x7f89f406c8f0 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f8a0c007600 tx=0x7f8a0c00b040 comp rx=0 tx=0).stop 2023-12-20T04:51:35.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.406+0000 7f8a17dea640 1 -- 172.21.15.132:0/1807392392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a101611b0 msgr2=0x7f8a100b6300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:35.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.406+0000 7f8a17dea640 1 --2- 172.21.15.132:0/1807392392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a101611b0 0x7f8a100b6300 secure :-1 s=READY pgs=1596 cs=0 l=1 rev1=1 crypto rx=0x7f8a0800c420 tx=0x7f8a0800c8e0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.406+0000 7f8a17dea640 1 -- 172.21.15.132:0/1807392392 shutdown_connections 2023-12-20T04:51:35.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.406+0000 7f8a17dea640 1 --2- 172.21.15.132:0/1807392392 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f89f406a430 0x7f89f406c8f0 unknown :-1 s=CLOSED pgs=671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.406+0000 7f8a17dea640 1 --2- 172.21.15.132:0/1807392392 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8a101611b0 0x7f8a100b6300 unknown :-1 s=CLOSED pgs=1596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.406+0000 7f8a17dea640 1 --2- 172.21.15.132:0/1807392392 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8a10160450 0x7f8a100d35d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.406+0000 7f8a17dea640 1 --2- 172.21.15.132:0/1807392392 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8a100b4ec0 0x7f8a100c92f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.406+0000 7f8a17dea640 1 -- 172.21.15.132:0/1807392392 >> 172.21.15.132:0/1807392392 conn(0x7f8a100cf980 msgr2=0x7f8a100cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:35.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.406+0000 7f8a17dea640 1 -- 172.21.15.132:0/1807392392 shutdown_connections 2023-12-20T04:51:35.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.406+0000 7f8a17dea640 1 -- 172.21.15.132:0/1807392392 wait complete. 2023-12-20T04:51:35.419 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:51:35.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.516+0000 7f010f8ab640 1 Processor -- start 2023-12-20T04:51:35.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.517+0000 7f010f8ab640 1 -- start start 2023-12-20T04:51:35.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.517+0000 7f010f8ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0108160450 0x7f0108160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.517+0000 7f010f8ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01081611b0 0x7f01080b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.517+0000 7f010f8ab640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f01080b4ec0 0x7f010806a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.517+0000 7f010f8ab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01080b5350 con 0x7f0108160450 2023-12-20T04:51:35.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.517+0000 7f010f8ab640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01080b5ec0 con 0x7f01080b4ec0 2023-12-20T04:51:35.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.517+0000 7f010f8ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f01081617e0 con 0x7f01081611b0 2023-12-20T04:51:35.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.517+0000 7f010d647640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0108160450 0x7f0108160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:35.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.517+0000 7f010d647640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0108160450 0x7f0108160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35634/0 (socket says 172.21.15.132:35634) 2023-12-20T04:51:35.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.517+0000 7f010d647640 1 -- 172.21.15.132:0/69052007 learned_addr learned my addr 172.21.15.132:0/69052007 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:35.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.518+0000 7f010de48640 1 --2- 172.21.15.132:0/69052007 >> v2:172.21.15.187:3300/0 conn(0x7f01080b4ec0 0x7f010806a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:35.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.518+0000 7f010ce46640 1 --2- 172.21.15.132:0/69052007 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01081611b0 0x7f01080b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:35.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.518+0000 7f010d647640 1 -- 172.21.15.132:0/69052007 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01081611b0 msgr2=0x7f01080b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:35.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.518+0000 7f010d647640 1 --2- 172.21.15.132:0/69052007 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01081611b0 0x7f01080b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.518+0000 7f010d647640 1 -- 172.21.15.132:0/69052007 >> v2:172.21.15.187:3300/0 conn(0x7f01080b4ec0 msgr2=0x7f010806a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:35.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.518+0000 7f010d647640 1 --2- 172.21.15.132:0/69052007 >> v2:172.21.15.187:3300/0 conn(0x7f01080b4ec0 0x7f010806a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.518+0000 7f010d647640 1 -- 172.21.15.132:0/69052007 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01080d0fc0 con 0x7f0108160450 2023-12-20T04:51:35.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.518+0000 7f010ce46640 1 --2- 172.21.15.132:0/69052007 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01081611b0 0x7f01080b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:35.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.518+0000 7f010de48640 1 --2- 172.21.15.132:0/69052007 >> v2:172.21.15.187:3300/0 conn(0x7f01080b4ec0 0x7f010806a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:35.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.518+0000 7f010d647640 1 --2- 172.21.15.132:0/69052007 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0108160450 0x7f0108160c70 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f01080b59d0 tx=0x7f010402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86eb64b77497597b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:35.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.519+0000 7f00fffff640 1 -- 172.21.15.132:0/69052007 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010402cb00 con 0x7f0108160450 2023-12-20T04:51:35.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.519+0000 7f00fffff640 1 -- 172.21.15.132:0/69052007 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010402cc60 con 0x7f0108160450 2023-12-20T04:51:35.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.519+0000 7f00fffff640 1 -- 172.21.15.132:0/69052007 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f01040343f0 con 0x7f0108160450 2023-12-20T04:51:35.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.519+0000 7f010f8ab640 1 -- 172.21.15.132:0/69052007 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0108160450 msgr2=0x7f0108160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:35.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.519+0000 7f010f8ab640 1 --2- 172.21.15.132:0/69052007 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0108160450 0x7f0108160c70 secure :-1 s=READY pgs=1597 cs=0 l=1 rev1=1 crypto rx=0x7f01080b59d0 tx=0x7f010402bf60 comp rx=0 tx=0).stop 2023-12-20T04:51:35.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.519+0000 7f010f8ab640 1 -- 172.21.15.132:0/69052007 shutdown_connections 2023-12-20T04:51:35.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.519+0000 7f010f8ab640 1 --2- 172.21.15.132:0/69052007 >> v2:172.21.15.187:3300/0 conn(0x7f01080b4ec0 0x7f010806a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.519+0000 7f010f8ab640 1 --2- 172.21.15.132:0/69052007 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01081611b0 0x7f01080b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.519+0000 7f010f8ab640 1 --2- 172.21.15.132:0/69052007 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0108160450 0x7f0108160c70 unknown :-1 s=CLOSED pgs=1597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.519+0000 7f010f8ab640 1 -- 172.21.15.132:0/69052007 >> 172.21.15.132:0/69052007 conn(0x7f01080cf980 msgr2=0x7f01080cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:35.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.519+0000 7f010f8ab640 1 -- 172.21.15.132:0/69052007 shutdown_connections 2023-12-20T04:51:35.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.519+0000 7f010f8ab640 1 -- 172.21.15.132:0/69052007 wait complete. 2023-12-20T04:51:35.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.520+0000 7f010f8ab640 1 Processor -- start 2023-12-20T04:51:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.520+0000 7f010f8ab640 1 -- start start 2023-12-20T04:51:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.521+0000 7f010f8ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01080b4ec0 0x7f01081f2150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.521+0000 7f010f8ab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0108160450 0x7f0108154480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.521+0000 7f010f8ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01081611b0 0x7f01081549c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.521+0000 7f010f8ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0108147f10 con 0x7f01080b4ec0 2023-12-20T04:51:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.521+0000 7f010f8ab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0108142200 con 0x7f0108160450 2023-12-20T04:51:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.521+0000 7f010f8ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0108144a90 con 0x7f01081611b0 2023-12-20T04:51:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.521+0000 7f010d647640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01080b4ec0 0x7f01081f2150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.521+0000 7f010d647640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01080b4ec0 0x7f01081f2150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35644/0 (socket says 172.21.15.132:35644) 2023-12-20T04:51:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.521+0000 7f010d647640 1 -- 172.21.15.132:0/3888131559 learned_addr learned my addr 172.21.15.132:0/3888131559 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.521+0000 7f010d647640 1 -- 172.21.15.132:0/3888131559 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01081611b0 msgr2=0x7f01081549c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.521+0000 7f010d647640 1 --2- 172.21.15.132:0/3888131559 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01081611b0 0x7f01081549c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.521+0000 7f010d647640 1 -- 172.21.15.132:0/3888131559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0108160450 msgr2=0x7f0108154480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.521+0000 7f010d647640 1 --2- 172.21.15.132:0/3888131559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0108160450 0x7f0108154480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.521+0000 7f010d647640 1 -- 172.21.15.132:0/3888131559 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0104009b30 con 0x7f01080b4ec0 2023-12-20T04:51:35.525 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.522+0000 7f010d647640 1 --2- 172.21.15.132:0/3888131559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01080b4ec0 0x7f01081f2150 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f0104009f40 tx=0x7f0104004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:35.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.522+0000 7f00fdffb640 1 -- 172.21.15.132:0/3888131559 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0104043070 con 0x7f01080b4ec0 2023-12-20T04:51:35.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.522+0000 7f00fdffb640 1 -- 172.21.15.132:0/3888131559 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f010403f400 con 0x7f01080b4ec0 2023-12-20T04:51:35.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.522+0000 7f010f8ab640 1 -- 172.21.15.132:0/3888131559 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01081447b0 con 0x7f01080b4ec0 2023-12-20T04:51:35.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.522+0000 7f00fdffb640 1 -- 172.21.15.132:0/3888131559 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f010403f590 con 0x7f01080b4ec0 2023-12-20T04:51:35.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.522+0000 7f010f8ab640 1 -- 172.21.15.132:0/3888131559 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0108141e90 con 0x7f01080b4ec0 2023-12-20T04:51:35.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.523+0000 7f010f8ab640 1 -- 172.21.15.132:0/3888131559 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f010804e840 con 0x7f01080b4ec0 2023-12-20T04:51:35.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.523+0000 7f00fdffb640 1 -- 172.21.15.132:0/3888131559 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f010403f6f0 con 0x7f01080b4ec0 2023-12-20T04:51:35.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.524+0000 7f00fdffb640 1 --2- 172.21.15.132:0/3888131559 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f00ec06a460 0x7f00ec06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.524+0000 7f010ce46640 1 --2- 172.21.15.132:0/3888131559 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f00ec06a460 0x7f00ec06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:35.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.524+0000 7f00fdffb640 1 -- 172.21.15.132:0/3888131559 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f01040aaff0 con 0x7f01080b4ec0 2023-12-20T04:51:35.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.524+0000 7f00fdffb640 1 -- 172.21.15.132:0/3888131559 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f00ec072050 con 0x7f01080b4ec0 2023-12-20T04:51:35.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.524+0000 7f010ce46640 1 --2- 172.21.15.132:0/3888131559 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f00ec06a460 0x7f00ec06c920 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f00f8006b10 tx=0x7f00f8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:35.530 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.528+0000 7f00fdffb640 1 -- 172.21.15.132:0/3888131559 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0104076510 con 0x7f01080b4ec0 2023-12-20T04:51:35.695 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.693+0000 7f010f8ab640 1 -- 172.21.15.132:0/3888131559 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f01080d0ad0 con 0x7f01080b4ec0 2023-12-20T04:51:35.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.694+0000 7f00fdffb640 1 -- 172.21.15.132:0/3888131559 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v157) v1 ==== 74+0+16227 (secure 0 0 0) 0x7f0104079b30 con 0x7f01080b4ec0 2023-12-20T04:51:35.696 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:35.697 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":157,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:50:39.874578+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":18,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:49:31.238506+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"152","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":19,"pool_name":"cephfs_data","create_time":"2023-12-20T04:49:32.189571+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"157","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"19.3","mappings":[{"from":2,"to":0}]},{"pgid":"19.31","mappings":[{"from":2,"to":0}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:51:35.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.696+0000 7f010f8ab640 1 -- 172.21.15.132:0/3888131559 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f00ec06a460 msgr2=0x7f00ec06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:35.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.696+0000 7f010f8ab640 1 --2- 172.21.15.132:0/3888131559 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f00ec06a460 0x7f00ec06c920 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f00f8006b10 tx=0x7f00f8008040 comp rx=0 tx=0).stop 2023-12-20T04:51:35.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.696+0000 7f010f8ab640 1 -- 172.21.15.132:0/3888131559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01080b4ec0 msgr2=0x7f01081f2150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:35.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.696+0000 7f010f8ab640 1 --2- 172.21.15.132:0/3888131559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01080b4ec0 0x7f01081f2150 secure :-1 s=READY pgs=1598 cs=0 l=1 rev1=1 crypto rx=0x7f0104009f40 tx=0x7f0104004a40 comp rx=0 tx=0).stop 2023-12-20T04:51:35.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.696+0000 7f010f8ab640 1 -- 172.21.15.132:0/3888131559 shutdown_connections 2023-12-20T04:51:35.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.696+0000 7f010f8ab640 1 --2- 172.21.15.132:0/3888131559 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f00ec06a460 0x7f00ec06c920 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.696+0000 7f010f8ab640 1 --2- 172.21.15.132:0/3888131559 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01081611b0 0x7f01081549c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.696+0000 7f010f8ab640 1 --2- 172.21.15.132:0/3888131559 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0108160450 0x7f0108154480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.696+0000 7f010f8ab640 1 --2- 172.21.15.132:0/3888131559 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01080b4ec0 0x7f01081f2150 unknown :-1 s=CLOSED pgs=1598 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.696+0000 7f010f8ab640 1 -- 172.21.15.132:0/3888131559 >> 172.21.15.132:0/3888131559 conn(0x7f01080cf980 msgr2=0x7f01080d3700 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:35.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.696+0000 7f010f8ab640 1 -- 172.21.15.132:0/3888131559 shutdown_connections 2023-12-20T04:51:35.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.696+0000 7f010f8ab640 1 -- 172.21.15.132:0/3888131559 wait complete. 2023-12-20T04:51:35.710 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-20T04:51:35.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.808+0000 7f2d57373640 1 Processor -- start 2023-12-20T04:51:35.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.808+0000 7f2d57373640 1 -- start start 2023-12-20T04:51:35.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.809+0000 7f2d57373640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2d5015af00 0x7f2d500d0520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.809+0000 7f2d57373640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d5006ad40 0x7f2d5006b170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.809+0000 7f2d57373640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2d5006b6b0 con 0x7f2d50160e80 2023-12-20T04:51:35.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.809+0000 7f2d57373640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2d5015dc10 con 0x7f2d5015af00 2023-12-20T04:51:35.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.809+0000 7f2d57373640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d5015b2e0 con 0x7f2d5006ad40 2023-12-20T04:51:35.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.809+0000 7f2d5510f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2d5015af00 0x7f2d500d0520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:35.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.809+0000 7f2d5510f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2d5015af00 0x7f2d500d0520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35654/0 (socket says 172.21.15.132:35654) 2023-12-20T04:51:35.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.809+0000 7f2d5510f640 1 -- 172.21.15.132:0/2561146678 learned_addr learned my addr 172.21.15.132:0/2561146678 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:35.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.809+0000 7f2d55910640 1 --2- 172.21.15.132:0/2561146678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d5006ad40 0x7f2d5006b170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:35.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.809+0000 7f2d5510f640 1 -- 172.21.15.132:0/2561146678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d5006ad40 msgr2=0x7f2d5006b170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:35.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.809+0000 7f2d5510f640 1 --2- 172.21.15.132:0/2561146678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d5006ad40 0x7f2d5006b170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.809+0000 7f2d5510f640 1 -- 172.21.15.132:0/2561146678 >> v1:172.21.15.132:6789/0 conn(0x7f2d50160e80 legacy=0x7f2d5015e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:35.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.809+0000 7f2d5510f640 1 -- 172.21.15.132:0/2561146678 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d50161660 con 0x7f2d5015af00 2023-12-20T04:51:35.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.809+0000 7f2d55910640 1 --2- 172.21.15.132:0/2561146678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d5006ad40 0x7f2d5006b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:35.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.810+0000 7f2d5510f640 1 --2- 172.21.15.132:0/2561146678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5015af00 0x7f2d500d0520 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009e50 tx=0x7f2d4802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cdd5d583ec2bb59 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:35.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.810+0000 7f2d4ffff640 1 -- 172.21.15.132:0/2561146678 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4802ca70 con 0x7f2d5015af00 2023-12-20T04:51:35.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.810+0000 7f2d4ffff640 1 -- 172.21.15.132:0/2561146678 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4802cbd0 con 0x7f2d5015af00 2023-12-20T04:51:35.813 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.810+0000 7f2d4ffff640 1 -- 172.21.15.132:0/2561146678 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d480343f0 con 0x7f2d5015af00 2023-12-20T04:51:35.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.810+0000 7f2d57373640 1 -- 172.21.15.132:0/2561146678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5015af00 msgr2=0x7f2d500d0520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:35.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.810+0000 7f2d57373640 1 --2- 172.21.15.132:0/2561146678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5015af00 0x7f2d500d0520 secure :-1 s=READY pgs=1600 cs=0 l=1 rev1=1 crypto rx=0x7f2d48009e50 tx=0x7f2d4802bed0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.810+0000 7f2d57373640 1 -- 172.21.15.132:0/2561146678 shutdown_connections 2023-12-20T04:51:35.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.810+0000 7f2d57373640 1 --2- 172.21.15.132:0/2561146678 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d5006ad40 0x7f2d5006b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.810+0000 7f2d57373640 1 --2- 172.21.15.132:0/2561146678 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5015af00 0x7f2d500d0520 unknown :-1 s=CLOSED pgs=1600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.810+0000 7f2d57373640 1 -- 172.21.15.132:0/2561146678 >> 172.21.15.132:0/2561146678 conn(0x7f2d5006d640 msgr2=0x7f2d5006da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:35.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.811+0000 7f2d57373640 1 -- 172.21.15.132:0/2561146678 shutdown_connections 2023-12-20T04:51:35.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.811+0000 7f2d57373640 1 -- 172.21.15.132:0/2561146678 wait complete. 2023-12-20T04:51:35.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.812+0000 7f2d57373640 1 Processor -- start 2023-12-20T04:51:35.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.812+0000 7f2d57373640 1 -- start start 2023-12-20T04:51:35.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.812+0000 7f2d57373640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5006ad40 0x7f2d500c97b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.812+0000 7f2d57373640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d5015af00 0x7f2d501f2bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.812+0000 7f2d57373640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d50160e80 0x7f2d500c5770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.812+0000 7f2d57373640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d501f3bc0 con 0x7f2d5006ad40 2023-12-20T04:51:35.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.812+0000 7f2d57373640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2d500c9cf0 con 0x7f2d50160e80 2023-12-20T04:51:35.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.812+0000 7f2d57373640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2d501f3600 con 0x7f2d5015af00 2023-12-20T04:51:35.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.812+0000 7f2d5510f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5006ad40 0x7f2d500c97b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:35.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.812+0000 7f2d5510f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5006ad40 0x7f2d500c97b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35658/0 (socket says 172.21.15.132:35658) 2023-12-20T04:51:35.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.812+0000 7f2d5510f640 1 -- 172.21.15.132:0/516372132 learned_addr learned my addr 172.21.15.132:0/516372132 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:35.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.813+0000 7f2d55910640 1 --2- 172.21.15.132:0/516372132 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d50160e80 0x7f2d500c5770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:35.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.813+0000 7f2d5490e640 1 --2- 172.21.15.132:0/516372132 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d5015af00 0x7f2d501f2bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:35.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.813+0000 7f2d5510f640 1 -- 172.21.15.132:0/516372132 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d5015af00 msgr2=0x7f2d501f2bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:35.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.813+0000 7f2d5510f640 1 --2- 172.21.15.132:0/516372132 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d5015af00 0x7f2d501f2bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.813+0000 7f2d5510f640 1 -- 172.21.15.132:0/516372132 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d50160e80 msgr2=0x7f2d500c5770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:35.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.813+0000 7f2d5510f640 1 --2- 172.21.15.132:0/516372132 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d50160e80 0x7f2d500c5770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:35.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.813+0000 7f2d5510f640 1 -- 172.21.15.132:0/516372132 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2d48009b30 con 0x7f2d5006ad40 2023-12-20T04:51:35.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.813+0000 7f2d55910640 1 --2- 172.21.15.132:0/516372132 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d50160e80 0x7f2d500c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:35.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.813+0000 7f2d5510f640 1 --2- 172.21.15.132:0/516372132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5006ad40 0x7f2d500c97b0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f2d48000f80 tx=0x7f2d48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:35.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.813+0000 7f2d4dffb640 1 -- 172.21.15.132:0/516372132 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d48009510 con 0x7f2d5006ad40 2023-12-20T04:51:35.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.813+0000 7f2d4dffb640 1 -- 172.21.15.132:0/516372132 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2d4803e450 con 0x7f2d5006ad40 2023-12-20T04:51:35.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.813+0000 7f2d57373640 1 -- 172.21.15.132:0/516372132 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2d501f38e0 con 0x7f2d5006ad40 2023-12-20T04:51:35.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.813+0000 7f2d4dffb640 1 -- 172.21.15.132:0/516372132 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2d4803e800 con 0x7f2d5006ad40 2023-12-20T04:51:35.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.813+0000 7f2d57373640 1 -- 172.21.15.132:0/516372132 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2d500c8140 con 0x7f2d5006ad40 2023-12-20T04:51:35.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.814+0000 7f2d57373640 1 -- 172.21.15.132:0/516372132 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2d500c7cc0 con 0x7f2d5006ad40 2023-12-20T04:51:35.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.815+0000 7f2d4dffb640 1 -- 172.21.15.132:0/516372132 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2d4803e960 con 0x7f2d5006ad40 2023-12-20T04:51:35.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.815+0000 7f2d4dffb640 1 --2- 172.21.15.132:0/516372132 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d3c06a430 0x7f2d3c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:35.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.815+0000 7f2d4dffb640 1 -- 172.21.15.132:0/516372132 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(157..157 src has 1..157) v4 ==== 5767+0+0 (secure 0 0 0) 0x7f2d480ab740 con 0x7f2d5006ad40 2023-12-20T04:51:35.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.815+0000 7f2d5490e640 1 --2- 172.21.15.132:0/516372132 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d3c06a430 0x7f2d3c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:35.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.815+0000 7f2d4dffb640 1 -- 172.21.15.132:0/516372132 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=158}) v3 -- 0x7f2d3c072020 con 0x7f2d5006ad40 2023-12-20T04:51:35.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.815+0000 7f2d5490e640 1 --2- 172.21.15.132:0/516372132 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d3c06a430 0x7f2d3c06c8f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2d5015a6b0 tx=0x7f2d44009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:35.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:35.819+0000 7f2d4dffb640 1 -- 172.21.15.132:0/516372132 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2d500c7cc0 con 0x7f2d5006ad40 2023-12-20T04:51:36.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.021+0000 7f2d57373640 1 -- 172.21.15.132:0/516372132 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f2d500c7cc0 con 0x7f2d5006ad40 2023-12-20T04:51:36.024 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:51:36.022+0000 7f1a5cbbd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-20T04:51:36.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.025+0000 7f2d4dffb640 1 -- 172.21.15.132:0/516372132 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(158..158 src has 1..158) v4 ==== 374+0+0 (secure 0 0 0) 0x7f2d4807b0b0 con 0x7f2d5006ad40 2023-12-20T04:51:36.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.025+0000 7f2d4dffb640 1 -- 172.21.15.132:0/516372132 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=159}) v3 -- 0x7f2d3c0728d0 con 0x7f2d5006ad40 2023-12-20T04:51:36.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.030+0000 7f2d4dffb640 1 -- 172.21.15.132:0/516372132 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v58) v1 ==== 161+0+0 (secure 0 0 0) 0x7f2d500c7cc0 con 0x7f2d5006ad40 2023-12-20T04:51:36.032 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-20T04:51:36.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.032+0000 7f2d57373640 1 -- 172.21.15.132:0/516372132 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d3c06a430 msgr2=0x7f2d3c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:36.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.032+0000 7f2d57373640 1 --2- 172.21.15.132:0/516372132 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d3c06a430 0x7f2d3c06c8f0 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7f2d5015a6b0 tx=0x7f2d44009040 comp rx=0 tx=0).stop 2023-12-20T04:51:36.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.032+0000 7f2d57373640 1 -- 172.21.15.132:0/516372132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5006ad40 msgr2=0x7f2d500c97b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:36.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.032+0000 7f2d57373640 1 --2- 172.21.15.132:0/516372132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5006ad40 0x7f2d500c97b0 secure :-1 s=READY pgs=1601 cs=0 l=1 rev1=1 crypto rx=0x7f2d48000f80 tx=0x7f2d48004a40 comp rx=0 tx=0).stop 2023-12-20T04:51:36.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.032+0000 7f2d57373640 1 -- 172.21.15.132:0/516372132 shutdown_connections 2023-12-20T04:51:36.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.032+0000 7f2d57373640 1 --2- 172.21.15.132:0/516372132 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2d3c06a430 0x7f2d3c06c8f0 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:36.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.032+0000 7f2d57373640 1 --2- 172.21.15.132:0/516372132 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2d50160e80 0x7f2d500c5770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:36.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.032+0000 7f2d57373640 1 --2- 172.21.15.132:0/516372132 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2d5015af00 0x7f2d501f2bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:36.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.032+0000 7f2d57373640 1 --2- 172.21.15.132:0/516372132 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2d5006ad40 0x7f2d500c97b0 unknown :-1 s=CLOSED pgs=1601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:36.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.032+0000 7f2d57373640 1 -- 172.21.15.132:0/516372132 >> 172.21.15.132:0/516372132 conn(0x7f2d5006d640 msgr2=0x7f2d5015b4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:36.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.032+0000 7f2d57373640 1 -- 172.21.15.132:0/516372132 shutdown_connections 2023-12-20T04:51:36.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.033+0000 7f2d57373640 1 -- 172.21.15.132:0/516372132 wait complete. 2023-12-20T04:51:36.036 INFO:tasks.ceph.mds.a.smithi132.stderr: -8708> 2023-12-20T04:49:38.968+0000 7f31788c6640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:51:36.046 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-20T04:51:36.067 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-12-20T04:51:36.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.148+0000 7f4bc653e640 1 Processor -- start 2023-12-20T04:51:36.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.148+0000 7f4bc653e640 1 -- start start 2023-12-20T04:51:36.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.148+0000 7f4bc653e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4bc0069c30 0x7f4bc0070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:36.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.148+0000 7f4bc653e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4bc015d360 0x7f4bc006a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:36.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.148+0000 7f4bc653e640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4bc00c4f40 con 0x7f4bc00cbde0 2023-12-20T04:51:36.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.148+0000 7f4bc653e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc00af5b0 con 0x7f4bc015d360 2023-12-20T04:51:36.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.148+0000 7f4bc653e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4bc006a550 con 0x7f4bc0069c30 2023-12-20T04:51:36.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.149+0000 7f4bbf7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4bc015d360 0x7f4bc006a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:36.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.149+0000 7f4bbf7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4bc015d360 0x7f4bc006a010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35678/0 (socket says 172.21.15.132:35678) 2023-12-20T04:51:36.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.149+0000 7f4bbf7fe640 1 -- 172.21.15.132:0/147926109 learned_addr learned my addr 172.21.15.132:0/147926109 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:36.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.149+0000 7f4bbffff640 1 --2- 172.21.15.132:0/147926109 >> v2:172.21.15.187:3300/0 conn(0x7f4bc0069c30 0x7f4bc0070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:36.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.149+0000 7f4bbf7fe640 1 -- 172.21.15.132:0/147926109 >> v2:172.21.15.187:3300/0 conn(0x7f4bc0069c30 msgr2=0x7f4bc0070460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:36.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.149+0000 7f4bbf7fe640 1 --2- 172.21.15.132:0/147926109 >> v2:172.21.15.187:3300/0 conn(0x7f4bc0069c30 0x7f4bc0070460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:36.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.149+0000 7f4bbf7fe640 1 -- 172.21.15.132:0/147926109 >> v1:172.21.15.132:6789/0 conn(0x7f4bc00cbde0 legacy=0x7f4bc00ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:36.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.149+0000 7f4bbeffd640 1 -- 172.21.15.132:0/147926109 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3596560903 0 0) 0x7f4bc00c4f40 con 0x7f4bc00cbde0 2023-12-20T04:51:36.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.149+0000 7f4bbf7fe640 1 -- 172.21.15.132:0/147926109 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bc0070a40 con 0x7f4bc015d360 2023-12-20T04:51:36.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.150+0000 7f4bbf7fe640 1 --2- 172.21.15.132:0/147926109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bc015d360 0x7f4bc006a010 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0071870 tx=0x7f4bb402b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483799355379b8fe server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:36.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.150+0000 7f4bbeffd640 1 -- 172.21.15.132:0/147926109 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4030860 con 0x7f4bc015d360 2023-12-20T04:51:36.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.150+0000 7f4bbeffd640 1 -- 172.21.15.132:0/147926109 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb40309c0 con 0x7f4bc015d360 2023-12-20T04:51:36.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.150+0000 7f4bbeffd640 1 -- 172.21.15.132:0/147926109 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb4030d50 con 0x7f4bc015d360 2023-12-20T04:51:36.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.150+0000 7f4bc653e640 1 -- 172.21.15.132:0/147926109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bc015d360 msgr2=0x7f4bc006a010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:36.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.150+0000 7f4bc653e640 1 --2- 172.21.15.132:0/147926109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bc015d360 0x7f4bc006a010 secure :-1 s=READY pgs=1606 cs=0 l=1 rev1=1 crypto rx=0x7f4bc0071870 tx=0x7f4bb402b9a0 comp rx=0 tx=0).stop 2023-12-20T04:51:36.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.150+0000 7f4bc653e640 1 -- 172.21.15.132:0/147926109 shutdown_connections 2023-12-20T04:51:36.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.150+0000 7f4bc653e640 1 --2- 172.21.15.132:0/147926109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bc015d360 0x7f4bc006a010 unknown :-1 s=CLOSED pgs=1606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:36.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.150+0000 7f4bc653e640 1 --2- 172.21.15.132:0/147926109 >> v2:172.21.15.187:3300/0 conn(0x7f4bc0069c30 0x7f4bc0070460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:36.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.150+0000 7f4bc653e640 1 -- 172.21.15.132:0/147926109 >> 172.21.15.132:0/147926109 conn(0x7f4bc00cc630 msgr2=0x7f4bc00cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:36.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.150+0000 7f4bc653e640 1 -- 172.21.15.132:0/147926109 shutdown_connections 2023-12-20T04:51:36.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.150+0000 7f4bc653e640 1 -- 172.21.15.132:0/147926109 wait complete. 2023-12-20T04:51:36.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.152+0000 7f4bc653e640 1 Processor -- start 2023-12-20T04:51:36.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.152+0000 7f4bc653e640 1 -- start start 2023-12-20T04:51:36.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.152+0000 7f4bc653e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bc0069c30 0x7f4bc00c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:36.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.152+0000 7f4bc653e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bc00cbde0 0x7f4bc006d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:36.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.152+0000 7f4bc653e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bc015d360 0x7f4bc01f1d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:36.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.152+0000 7f4bc653e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc00c7420 con 0x7f4bc0069c30 2023-12-20T04:51:36.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.152+0000 7f4bc653e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc01f60d0 con 0x7f4bc015d360 2023-12-20T04:51:36.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.152+0000 7f4bc653e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4bc01f63b0 con 0x7f4bc00cbde0 2023-12-20T04:51:36.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.153+0000 7f4bbffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bc0069c30 0x7f4bc00c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:36.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.153+0000 7f4bbffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bc0069c30 0x7f4bc00c6bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35690/0 (socket says 172.21.15.132:35690) 2023-12-20T04:51:36.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.153+0000 7f4bbffff640 1 -- 172.21.15.132:0/2936741764 learned_addr learned my addr 172.21.15.132:0/2936741764 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:36.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.153+0000 7f4bbf7fe640 1 --2- 172.21.15.132:0/2936741764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bc00cbde0 0x7f4bc006d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:36.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.153+0000 7f4bc4adb640 1 --2- 172.21.15.132:0/2936741764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bc015d360 0x7f4bc01f1d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:36.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.153+0000 7f4bbffff640 1 -- 172.21.15.132:0/2936741764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bc00cbde0 msgr2=0x7f4bc006d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:36.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.153+0000 7f4bbffff640 1 --2- 172.21.15.132:0/2936741764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bc00cbde0 0x7f4bc006d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:36.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.153+0000 7f4bbffff640 1 -- 172.21.15.132:0/2936741764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bc015d360 msgr2=0x7f4bc01f1d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:36.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.153+0000 7f4bbffff640 1 --2- 172.21.15.132:0/2936741764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bc015d360 0x7f4bc01f1d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:36.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.153+0000 7f4bbffff640 1 -- 172.21.15.132:0/2936741764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bb40094d0 con 0x7f4bc0069c30 2023-12-20T04:51:36.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.153+0000 7f4bbffff640 1 --2- 172.21.15.132:0/2936741764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bc0069c30 0x7f4bc00c6bf0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000e9b0 tx=0x7f4bb000ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:36.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.153+0000 7f4bbcff9640 1 -- 172.21.15.132:0/2936741764 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb0009670 con 0x7f4bc0069c30 2023-12-20T04:51:36.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.153+0000 7f4bbcff9640 1 -- 172.21.15.132:0/2936741764 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4bb000c9a0 con 0x7f4bc0069c30 2023-12-20T04:51:36.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.153+0000 7f4bbcff9640 1 -- 172.21.15.132:0/2936741764 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4bb000cd50 con 0x7f4bc0069c30 2023-12-20T04:51:36.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.153+0000 7f4bc653e640 1 -- 172.21.15.132:0/2936741764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bc01f6690 con 0x7f4bc0069c30 2023-12-20T04:51:36.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.153+0000 7f4bc653e640 1 -- 172.21.15.132:0/2936741764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bc00c7700 con 0x7f4bc0069c30 2023-12-20T04:51:36.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.154+0000 7f4bc653e640 1 -- 172.21.15.132:0/2936741764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bc004e840 con 0x7f4bc0069c30 2023-12-20T04:51:36.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.155+0000 7f4bbcff9640 1 -- 172.21.15.132:0/2936741764 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4bb0013470 con 0x7f4bc0069c30 2023-12-20T04:51:36.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.155+0000 7f4bbcff9640 1 --2- 172.21.15.132:0/2936741764 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4bac06a430 0x7f4bac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:36.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.155+0000 7f4bbcff9640 1 -- 172.21.15.132:0/2936741764 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f4bb0088be0 con 0x7f4bc0069c30 2023-12-20T04:51:36.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.155+0000 7f4bbf7fe640 1 --2- 172.21.15.132:0/2936741764 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4bac06a430 0x7f4bac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:36.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.155+0000 7f4bbcff9640 1 -- 172.21.15.132:0/2936741764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=159}) v3 -- 0x7f4bac072130 con 0x7f4bc0069c30 2023-12-20T04:51:36.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.155+0000 7f4bbf7fe640 1 --2- 172.21.15.132:0/2936741764 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4bac06a430 0x7f4bac06c8f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4036000 tx=0x7f4bb403b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:36.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.159+0000 7f4bbcff9640 1 -- 172.21.15.132:0/2936741764 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4bb0017060 con 0x7f4bc0069c30 2023-12-20T04:51:36.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:36.359+0000 7f4bc653e640 1 -- 172.21.15.132:0/2936741764 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f4bc00b24a0 con 0x7f4bc0069c30 2023-12-20T04:51:37.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.032+0000 7f4bbcff9640 1 -- 172.21.15.132:0/2936741764 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v59) v1 ==== 104+0+0 (secure 0 0 0) 0x7f4bb0021020 con 0x7f4bc0069c30 2023-12-20T04:51:37.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.035+0000 7f4bc653e640 1 -- 172.21.15.132:0/2936741764 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4bac06a430 msgr2=0x7f4bac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:37.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.035+0000 7f4bc653e640 1 --2- 172.21.15.132:0/2936741764 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4bac06a430 0x7f4bac06c8f0 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7f4bb4036000 tx=0x7f4bb403b040 comp rx=0 tx=0).stop 2023-12-20T04:51:37.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.035+0000 7f4bc653e640 1 -- 172.21.15.132:0/2936741764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bc0069c30 msgr2=0x7f4bc00c6bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:37.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.035+0000 7f4bc653e640 1 --2- 172.21.15.132:0/2936741764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bc0069c30 0x7f4bc00c6bf0 secure :-1 s=READY pgs=1607 cs=0 l=1 rev1=1 crypto rx=0x7f4bb000e9b0 tx=0x7f4bb000ee70 comp rx=0 tx=0).stop 2023-12-20T04:51:37.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.035+0000 7f4bc653e640 1 -- 172.21.15.132:0/2936741764 shutdown_connections 2023-12-20T04:51:37.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.035+0000 7f4bc653e640 1 --2- 172.21.15.132:0/2936741764 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4bac06a430 0x7f4bac06c8f0 unknown :-1 s=CLOSED pgs=674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:37.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.035+0000 7f4bc653e640 1 --2- 172.21.15.132:0/2936741764 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4bc015d360 0x7f4bc01f1d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:37.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.035+0000 7f4bc653e640 1 --2- 172.21.15.132:0/2936741764 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4bc00cbde0 0x7f4bc006d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:37.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.035+0000 7f4bc653e640 1 --2- 172.21.15.132:0/2936741764 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4bc0069c30 0x7f4bc00c6bf0 unknown :-1 s=CLOSED pgs=1607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:37.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.035+0000 7f4bc653e640 1 -- 172.21.15.132:0/2936741764 >> 172.21.15.132:0/2936741764 conn(0x7f4bc00cc630 msgr2=0x7f4bc015b0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:37.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.035+0000 7f4bc653e640 1 -- 172.21.15.132:0/2936741764 shutdown_connections 2023-12-20T04:51:37.038 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.035+0000 7f4bc653e640 1 -- 172.21.15.132:0/2936741764 wait complete. 2023-12-20T04:51:37.050 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-20T04:51:37.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.196+0000 7f4f69f2e640 1 Processor -- start 2023-12-20T04:51:37.198 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.197+0000 7f4f69f2e640 1 -- start start 2023-12-20T04:51:37.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.197+0000 7f4f69f2e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4f6415d130 0x7f4f640d17c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:37.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.197+0000 7f4f69f2e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4f64161910 0x7f4f640b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:37.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.197+0000 7f4f69f2e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f640b27d0 con 0x7f4f64160d50 2023-12-20T04:51:37.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.197+0000 7f4f69f2e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f640d1ff0 con 0x7f4f6415d130 2023-12-20T04:51:37.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.197+0000 7f4f69f2e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f640b2a90 con 0x7f4f64161910 2023-12-20T04:51:37.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.198+0000 7f4f637fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4f6415d130 0x7f4f640d17c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:37.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.198+0000 7f4f637fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4f6415d130 0x7f4f640d17c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35700/0 (socket says 172.21.15.132:35700) 2023-12-20T04:51:37.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.198+0000 7f4f637fe640 1 -- 172.21.15.132:0/3404752646 learned_addr learned my addr 172.21.15.132:0/3404752646 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:37.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.198+0000 7f4f63fff640 1 --2- 172.21.15.132:0/3404752646 >> v2:172.21.15.187:3300/0 conn(0x7f4f64161910 0x7f4f640b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:37.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.198+0000 7f4f637fe640 1 -- 172.21.15.132:0/3404752646 >> v2:172.21.15.187:3300/0 conn(0x7f4f64161910 msgr2=0x7f4f640b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:37.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.198+0000 7f4f637fe640 1 --2- 172.21.15.132:0/3404752646 >> v2:172.21.15.187:3300/0 conn(0x7f4f64161910 0x7f4f640b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:37.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.198+0000 7f4f637fe640 1 -- 172.21.15.132:0/3404752646 >> v1:172.21.15.187:6789/0 conn(0x7f4f64160d50 legacy=0x7f4f64161200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:37.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.198+0000 7f4f637fe640 1 -- 172.21.15.132:0/3404752646 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f640b2d70 con 0x7f4f6415d130 2023-12-20T04:51:37.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.199+0000 7f4f637fe640 1 --2- 172.21.15.132:0/3404752646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6415d130 0x7f4f640d17c0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f4f64073c90 tx=0x7f4f5402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d2617110ad2161e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:37.202 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.199+0000 7f4f627fc640 1 -- 172.21.15.132:0/3404752646 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f540317e0 con 0x7f4f6415d130 2023-12-20T04:51:37.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.199+0000 7f4f627fc640 1 -- 172.21.15.132:0/3404752646 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f54031940 con 0x7f4f6415d130 2023-12-20T04:51:37.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.199+0000 7f4f627fc640 1 -- 172.21.15.132:0/3404752646 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f54031cd0 con 0x7f4f6415d130 2023-12-20T04:51:37.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.199+0000 7f4f69f2e640 1 -- 172.21.15.132:0/3404752646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6415d130 msgr2=0x7f4f640d17c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:37.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.199+0000 7f4f69f2e640 1 --2- 172.21.15.132:0/3404752646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6415d130 0x7f4f640d17c0 secure :-1 s=READY pgs=1608 cs=0 l=1 rev1=1 crypto rx=0x7f4f64073c90 tx=0x7f4f5402b880 comp rx=0 tx=0).stop 2023-12-20T04:51:37.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.199+0000 7f4f69f2e640 1 -- 172.21.15.132:0/3404752646 shutdown_connections 2023-12-20T04:51:37.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.199+0000 7f4f69f2e640 1 --2- 172.21.15.132:0/3404752646 >> v2:172.21.15.187:3300/0 conn(0x7f4f64161910 0x7f4f640b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:37.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.199+0000 7f4f69f2e640 1 --2- 172.21.15.132:0/3404752646 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f6415d130 0x7f4f640d17c0 unknown :-1 s=CLOSED pgs=1608 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:37.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.199+0000 7f4f69f2e640 1 -- 172.21.15.132:0/3404752646 >> 172.21.15.132:0/3404752646 conn(0x7f4f640d2eb0 msgr2=0x7f4f640d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:37.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.199+0000 7f4f69f2e640 1 -- 172.21.15.132:0/3404752646 shutdown_connections 2023-12-20T04:51:37.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.199+0000 7f4f69f2e640 1 -- 172.21.15.132:0/3404752646 wait complete. 2023-12-20T04:51:37.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.200+0000 7f4f69f2e640 1 Processor -- start 2023-12-20T04:51:37.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.201+0000 7f4f69f2e640 1 -- start start 2023-12-20T04:51:37.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.201+0000 7f4f69f2e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f6415d130 0x7f4f640cfd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:37.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.201+0000 7f4f69f2e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f64160d50 0x7f4f640cbe70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:37.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.201+0000 7f4f69f2e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f64161910 0x7f4f64159f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:37.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.201+0000 7f4f69f2e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640cb340 con 0x7f4f64160d50 2023-12-20T04:51:37.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.201+0000 7f4f69f2e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640b87e0 con 0x7f4f6415d130 2023-12-20T04:51:37.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.201+0000 7f4f69f2e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f640b7c60 con 0x7f4f64161910 2023-12-20T04:51:37.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.201+0000 7f4f62ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f64160d50 0x7f4f640cbe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:37.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.201+0000 7f4f62ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f64160d50 0x7f4f640cbe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:35706/0 (socket says 172.21.15.132:35706) 2023-12-20T04:51:37.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.201+0000 7f4f62ffd640 1 -- 172.21.15.132:0/1211204975 learned_addr learned my addr 172.21.15.132:0/1211204975 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:37.206 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.202+0000 7f4f637fe640 1 --2- 172.21.15.132:0/1211204975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f6415d130 0x7f4f640cfd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:37.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.202+0000 7f4f63fff640 1 --2- 172.21.15.132:0/1211204975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f64161910 0x7f4f64159f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:37.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.202+0000 7f4f62ffd640 1 -- 172.21.15.132:0/1211204975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f64161910 msgr2=0x7f4f64159f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:37.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.202+0000 7f4f62ffd640 1 --2- 172.21.15.132:0/1211204975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f64161910 0x7f4f64159f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:37.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.202+0000 7f4f62ffd640 1 -- 172.21.15.132:0/1211204975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f6415d130 msgr2=0x7f4f640cfd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:37.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.202+0000 7f4f62ffd640 1 --2- 172.21.15.132:0/1211204975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f6415d130 0x7f4f640cfd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:37.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.202+0000 7f4f62ffd640 1 -- 172.21.15.132:0/1211204975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f540094d0 con 0x7f4f64160d50 2023-12-20T04:51:37.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.202+0000 7f4f637fe640 1 --2- 172.21.15.132:0/1211204975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f6415d130 0x7f4f640cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:37.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.202+0000 7f4f63fff640 1 --2- 172.21.15.132:0/1211204975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f64161910 0x7f4f64159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:37.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.202+0000 7f4f62ffd640 1 --2- 172.21.15.132:0/1211204975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f64160d50 0x7f4f640cbe70 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800c430 tx=0x7f4f5800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:37.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.202+0000 7f4f4bfff640 1 -- 172.21.15.132:0/1211204975 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f58011790 con 0x7f4f64160d50 2023-12-20T04:51:37.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.202+0000 7f4f4bfff640 1 -- 172.21.15.132:0/1211204975 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f580118f0 con 0x7f4f64160d50 2023-12-20T04:51:37.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.202+0000 7f4f4bfff640 1 -- 172.21.15.132:0/1211204975 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f58011ce0 con 0x7f4f64160d50 2023-12-20T04:51:37.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.202+0000 7f4f69f2e640 1 -- 172.21.15.132:0/1211204975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f640b7f40 con 0x7f4f64160d50 2023-12-20T04:51:37.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.202+0000 7f4f69f2e640 1 -- 172.21.15.132:0/1211204975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f640b8500 con 0x7f4f64160d50 2023-12-20T04:51:37.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.203+0000 7f4f69f2e640 1 -- 172.21.15.132:0/1211204975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f640cdd40 con 0x7f4f64160d50 2023-12-20T04:51:37.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.203+0000 7f4f4bfff640 1 -- 172.21.15.132:0/1211204975 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4f5801c460 con 0x7f4f64160d50 2023-12-20T04:51:37.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.204+0000 7f4f4bfff640 1 --2- 172.21.15.132:0/1211204975 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5006a430 0x7f4f5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:37.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.204+0000 7f4f4bfff640 1 -- 172.21.15.132:0/1211204975 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(158..158 src has 1..158) v4 ==== 5853+0+0 (secure 0 0 0) 0x7f4f58088880 con 0x7f4f64160d50 2023-12-20T04:51:37.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.204+0000 7f4f637fe640 1 --2- 172.21.15.132:0/1211204975 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5006a430 0x7f4f5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:37.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.204+0000 7f4f4bfff640 1 -- 172.21.15.132:0/1211204975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=159}) v3 -- 0x7f4f50072130 con 0x7f4f64160d50 2023-12-20T04:51:37.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.204+0000 7f4f637fe640 1 --2- 172.21.15.132:0/1211204975 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5006a430 0x7f4f5006c8f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4f54036000 tx=0x7f4f5403d040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:37.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.208+0000 7f4f4bfff640 1 -- 172.21.15.132:0/1211204975 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4f640cdd40 con 0x7f4f64160d50 2023-12-20T04:51:37.376 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:37.374+0000 7f4f69f2e640 1 -- 172.21.15.132:0/1211204975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f4f640cdd40 con 0x7f4f64160d50 2023-12-20T04:51:38.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.137+0000 7f4f4bfff640 1 -- 172.21.15.132:0/1211204975 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(159..159 src has 1..159) v4 ==== 296+0+0 (secure 0 0 0) 0x7f4f58011e40 con 0x7f4f64160d50 2023-12-20T04:51:38.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.137+0000 7f4f4bfff640 1 -- 172.21.15.132:0/1211204975 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7f4f50070560 con 0x7f4f64160d50 2023-12-20T04:51:38.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.141+0000 7f4f4bfff640 1 -- 172.21.15.132:0/1211204975 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v159) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4f640cdd40 con 0x7f4f64160d50 2023-12-20T04:51:38.144 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2023-12-20T04:51:38.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.145+0000 7f4f69f2e640 1 -- 172.21.15.132:0/1211204975 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5006a430 msgr2=0x7f4f5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:38.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.145+0000 7f4f69f2e640 1 --2- 172.21.15.132:0/1211204975 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5006a430 0x7f4f5006c8f0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4f54036000 tx=0x7f4f5403d040 comp rx=0 tx=0).stop 2023-12-20T04:51:38.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.145+0000 7f4f69f2e640 1 -- 172.21.15.132:0/1211204975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f64160d50 msgr2=0x7f4f640cbe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:38.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.145+0000 7f4f69f2e640 1 --2- 172.21.15.132:0/1211204975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f64160d50 0x7f4f640cbe70 secure :-1 s=READY pgs=1609 cs=0 l=1 rev1=1 crypto rx=0x7f4f5800c430 tx=0x7f4f5800c8f0 comp rx=0 tx=0).stop 2023-12-20T04:51:38.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.145+0000 7f4f69f2e640 1 -- 172.21.15.132:0/1211204975 shutdown_connections 2023-12-20T04:51:38.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.145+0000 7f4f69f2e640 1 --2- 172.21.15.132:0/1211204975 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5006a430 0x7f4f5006c8f0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:38.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.145+0000 7f4f69f2e640 1 --2- 172.21.15.132:0/1211204975 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f64161910 0x7f4f64159f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:38.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.145+0000 7f4f69f2e640 1 --2- 172.21.15.132:0/1211204975 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f64160d50 0x7f4f640cbe70 unknown :-1 s=CLOSED pgs=1609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:38.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.145+0000 7f4f69f2e640 1 --2- 172.21.15.132:0/1211204975 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f6415d130 0x7f4f640cfd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:38.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.145+0000 7f4f69f2e640 1 -- 172.21.15.132:0/1211204975 >> 172.21.15.132:0/1211204975 conn(0x7f4f640d2eb0 msgr2=0x7f4f6415ace0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:38.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.145+0000 7f4f69f2e640 1 -- 172.21.15.132:0/1211204975 shutdown_connections 2023-12-20T04:51:38.148 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.145+0000 7f4f69f2e640 1 -- 172.21.15.132:0/1211204975 wait complete. 2023-12-20T04:51:38.160 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-20T04:51:38.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.265+0000 7f267ef00640 1 Processor -- start 2023-12-20T04:51:38.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.265+0000 7f267ef00640 1 -- start start 2023-12-20T04:51:38.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.266+0000 7f267ef00640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f26780ca170 0x7f26780ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:38.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.266+0000 7f267ef00640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2678069c30 0x7f267806a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:38.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.266+0000 7f267ef00640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f267806a5c0 con 0x7f26781447b0 2023-12-20T04:51:38.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.266+0000 7f267ef00640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26780c6380 con 0x7f26780ca170 2023-12-20T04:51:38.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.266+0000 7f267ef00640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26780c4f40 con 0x7f2678069c30 2023-12-20T04:51:38.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.266+0000 7f2677fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f26780ca170 0x7f26780ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:38.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.266+0000 7f2677fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f26780ca170 0x7f26780ca5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52052/0 (socket says 172.21.15.132:52052) 2023-12-20T04:51:38.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.266+0000 7f2677fff640 1 -- 172.21.15.132:0/2998695359 learned_addr learned my addr 172.21.15.132:0/2998695359 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:38.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.267+0000 7f2677fff640 1 -- 172.21.15.132:0/2998695359 >> v2:172.21.15.187:3300/0 conn(0x7f2678069c30 msgr2=0x7f267806a080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:38.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.267+0000 7f2677fff640 1 --2- 172.21.15.132:0/2998695359 >> v2:172.21.15.187:3300/0 conn(0x7f2678069c30 0x7f267806a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:38.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.267+0000 7f2677fff640 1 -- 172.21.15.132:0/2998695359 >> v1:172.21.15.187:6789/0 conn(0x7f26781447b0 legacy=0x7f26780c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:38.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.267+0000 7f2677fff640 1 -- 172.21.15.132:0/2998695359 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2678144b90 con 0x7f26780ca170 2023-12-20T04:51:38.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.267+0000 7f2677fff640 1 --2- 172.21.15.132:0/2998695359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26780ca170 0x7f26780ca5d0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f26780cf990 tx=0x7f266c02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36f5a67f9739f3d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:38.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.268+0000 7f26777fe640 1 -- 172.21.15.132:0/2998695359 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c0317e0 con 0x7f26780ca170 2023-12-20T04:51:38.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.268+0000 7f26777fe640 1 -- 172.21.15.132:0/2998695359 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f266c031940 con 0x7f26780ca170 2023-12-20T04:51:38.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.268+0000 7f26777fe640 1 -- 172.21.15.132:0/2998695359 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f266c031cd0 con 0x7f26780ca170 2023-12-20T04:51:38.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.268+0000 7f267ef00640 1 -- 172.21.15.132:0/2998695359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26780ca170 msgr2=0x7f26780ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:38.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.268+0000 7f267ef00640 1 --2- 172.21.15.132:0/2998695359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26780ca170 0x7f26780ca5d0 secure :-1 s=READY pgs=1610 cs=0 l=1 rev1=1 crypto rx=0x7f26780cf990 tx=0x7f266c02b880 comp rx=0 tx=0).stop 2023-12-20T04:51:38.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.268+0000 7f267ef00640 1 -- 172.21.15.132:0/2998695359 shutdown_connections 2023-12-20T04:51:38.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.268+0000 7f267ef00640 1 --2- 172.21.15.132:0/2998695359 >> v2:172.21.15.187:3300/0 conn(0x7f2678069c30 0x7f267806a080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:38.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.268+0000 7f267ef00640 1 --2- 172.21.15.132:0/2998695359 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26780ca170 0x7f26780ca5d0 unknown :-1 s=CLOSED pgs=1610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:38.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.268+0000 7f267ef00640 1 -- 172.21.15.132:0/2998695359 >> 172.21.15.132:0/2998695359 conn(0x7f26780cc630 msgr2=0x7f26780cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:38.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.268+0000 7f267ef00640 1 -- 172.21.15.132:0/2998695359 shutdown_connections 2023-12-20T04:51:38.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.268+0000 7f267ef00640 1 -- 172.21.15.132:0/2998695359 wait complete. 2023-12-20T04:51:38.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.269+0000 7f267ef00640 1 Processor -- start 2023-12-20T04:51:38.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.269+0000 7f267ef00640 1 -- start start 2023-12-20T04:51:38.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.270+0000 7f267ef00640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2678069c30 0x7f26780b57d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:38.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.270+0000 7f267ef00640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26780ca170 0x7f267815b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:38.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.270+0000 7f267ef00640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26781447b0 0x7f267815ba90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:38.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.270+0000 7f267ef00640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26780c9870 con 0x7f26781447b0 2023-12-20T04:51:38.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.270+0000 7f267ef00640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f267815bfd0 con 0x7f26780ca170 2023-12-20T04:51:38.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.270+0000 7f267ef00640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f267815ac80 con 0x7f2678069c30 2023-12-20T04:51:38.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.270+0000 7f267d49d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26781447b0 0x7f267815ba90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:38.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.270+0000 7f267d49d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26781447b0 0x7f267815ba90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52066/0 (socket says 172.21.15.132:52066) 2023-12-20T04:51:38.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.270+0000 7f267d49d640 1 -- 172.21.15.132:0/2890282380 learned_addr learned my addr 172.21.15.132:0/2890282380 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:38.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.271+0000 7f2677fff640 1 --2- 172.21.15.132:0/2890282380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26780ca170 0x7f267815b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:38.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.271+0000 7f267cc9c640 1 --2- 172.21.15.132:0/2890282380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2678069c30 0x7f26780b57d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:38.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.271+0000 7f267d49d640 1 -- 172.21.15.132:0/2890282380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2678069c30 msgr2=0x7f26780b57d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:38.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.271+0000 7f267d49d640 1 --2- 172.21.15.132:0/2890282380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2678069c30 0x7f26780b57d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:38.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.271+0000 7f267d49d640 1 -- 172.21.15.132:0/2890282380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26780ca170 msgr2=0x7f267815b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:38.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.271+0000 7f267d49d640 1 --2- 172.21.15.132:0/2890282380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26780ca170 0x7f267815b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:38.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.271+0000 7f267d49d640 1 -- 172.21.15.132:0/2890282380 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f266c0094d0 con 0x7f26781447b0 2023-12-20T04:51:38.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.271+0000 7f2677fff640 1 --2- 172.21.15.132:0/2890282380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26780ca170 0x7f267815b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:38.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.271+0000 7f267cc9c640 1 --2- 172.21.15.132:0/2890282380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2678069c30 0x7f26780b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:38.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.271+0000 7f267d49d640 1 --2- 172.21.15.132:0/2890282380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26781447b0 0x7f267815ba90 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f267000b970 tx=0x7f267000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:38.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.271+0000 7f26757fa640 1 -- 172.21.15.132:0/2890282380 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f267000cb40 con 0x7f26781447b0 2023-12-20T04:51:38.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.271+0000 7f26757fa640 1 -- 172.21.15.132:0/2890282380 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f267000ccc0 con 0x7f26781447b0 2023-12-20T04:51:38.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.271+0000 7f26757fa640 1 -- 172.21.15.132:0/2890282380 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2670014680 con 0x7f26781447b0 2023-12-20T04:51:38.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.271+0000 7f267ef00640 1 -- 172.21.15.132:0/2890282380 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26780b4730 con 0x7f26781447b0 2023-12-20T04:51:38.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.271+0000 7f267ef00640 1 -- 172.21.15.132:0/2890282380 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26780b4cf0 con 0x7f26781447b0 2023-12-20T04:51:38.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.272+0000 7f267ef00640 1 -- 172.21.15.132:0/2890282380 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f267804e840 con 0x7f26781447b0 2023-12-20T04:51:38.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.272+0000 7f26757fa640 1 -- 172.21.15.132:0/2890282380 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f267001d3b0 con 0x7f26781447b0 2023-12-20T04:51:38.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.273+0000 7f26757fa640 1 --2- 172.21.15.132:0/2890282380 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f266406a430 0x7f266406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:38.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.273+0000 7f26757fa640 1 -- 172.21.15.132:0/2890282380 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(159..159 src has 1..159) v4 ==== 5415+0+0 (secure 0 0 0) 0x7f2670088750 con 0x7f26781447b0 2023-12-20T04:51:38.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.273+0000 7f267cc9c640 1 --2- 172.21.15.132:0/2890282380 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f266406a430 0x7f266406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:38.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.273+0000 7f26757fa640 1 -- 172.21.15.132:0/2890282380 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=160}) v3 -- 0x7f26640712c0 con 0x7f26781447b0 2023-12-20T04:51:38.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.273+0000 7f267cc9c640 1 --2- 172.21.15.132:0/2890282380 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f266406a430 0x7f266406c8f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2668001750 tx=0x7f2668009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:38.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.277+0000 7f26757fa640 1 -- 172.21.15.132:0/2890282380 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2670019020 con 0x7f26781447b0 2023-12-20T04:51:38.443 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:38.442+0000 7f267ef00640 1 -- 172.21.15.132:0/2890282380 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f267806a760 con 0x7f26781447b0 2023-12-20T04:51:39.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.142+0000 7f26757fa640 1 -- 172.21.15.132:0/2890282380 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(160..160 src has 1..160) v4 ==== 330+0+0 (secure 0 0 0) 0x7f2670058220 con 0x7f26781447b0 2023-12-20T04:51:39.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.142+0000 7f26757fa640 1 -- 172.21.15.132:0/2890282380 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=161}) v3 -- 0x7f2664070050 con 0x7f26781447b0 2023-12-20T04:51:39.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.146+0000 7f26757fa640 1 -- 172.21.15.132:0/2890282380 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v160) v1 ==== 169+0+0 (secure 0 0 0) 0x7f2670053e60 con 0x7f26781447b0 2023-12-20T04:51:39.151 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2023-12-20T04:51:39.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.152+0000 7f267ef00640 1 -- 172.21.15.132:0/2890282380 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f266406a430 msgr2=0x7f266406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:39.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.152+0000 7f267ef00640 1 --2- 172.21.15.132:0/2890282380 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f266406a430 0x7f266406c8f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f2668001750 tx=0x7f2668009040 comp rx=0 tx=0).stop 2023-12-20T04:51:39.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.152+0000 7f267ef00640 1 -- 172.21.15.132:0/2890282380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26781447b0 msgr2=0x7f267815ba90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:39.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.152+0000 7f267ef00640 1 --2- 172.21.15.132:0/2890282380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26781447b0 0x7f267815ba90 secure :-1 s=READY pgs=1611 cs=0 l=1 rev1=1 crypto rx=0x7f267000b970 tx=0x7f267000be30 comp rx=0 tx=0).stop 2023-12-20T04:51:39.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.152+0000 7f267ef00640 1 -- 172.21.15.132:0/2890282380 shutdown_connections 2023-12-20T04:51:39.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.152+0000 7f267ef00640 1 --2- 172.21.15.132:0/2890282380 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f266406a430 0x7f266406c8f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.152+0000 7f267ef00640 1 --2- 172.21.15.132:0/2890282380 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26781447b0 0x7f267815ba90 unknown :-1 s=CLOSED pgs=1611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.152+0000 7f267ef00640 1 --2- 172.21.15.132:0/2890282380 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26780ca170 0x7f267815b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.152+0000 7f267ef00640 1 --2- 172.21.15.132:0/2890282380 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2678069c30 0x7f26780b57d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.152+0000 7f267ef00640 1 -- 172.21.15.132:0/2890282380 >> 172.21.15.132:0/2890282380 conn(0x7f26780cc630 msgr2=0x7f2678142740 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:39.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.153+0000 7f267ef00640 1 -- 172.21.15.132:0/2890282380 shutdown_connections 2023-12-20T04:51:39.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.153+0000 7f267ef00640 1 -- 172.21.15.132:0/2890282380 wait complete. 2023-12-20T04:51:39.168 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-20T04:51:39.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.271+0000 7f6ecf641640 1 Processor -- start 2023-12-20T04:51:39.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.271+0000 7f6ecf641640 1 -- start start 2023-12-20T04:51:39.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.272+0000 7f6ecf641640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6ec80ca170 0x7f6ec80ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.272+0000 7f6ecf641640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ec8069c30 0x7f6ec806a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.272+0000 7f6ecf641640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ec80c4f40 con 0x7f6ec81447b0 2023-12-20T04:51:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.272+0000 7f6ecf641640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6ec806a600 con 0x7f6ec80ca170 2023-12-20T04:51:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.272+0000 7f6ecf641640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80c6380 con 0x7f6ec8069c30 2023-12-20T04:51:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.272+0000 7f6eccbdc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6ec80ca170 0x7f6ec80ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.272+0000 7f6eccbdc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6ec80ca170 0x7f6ec80ca5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52070/0 (socket says 172.21.15.132:52070) 2023-12-20T04:51:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.272+0000 7f6eccbdc640 1 -- 172.21.15.132:0/602152992 learned_addr learned my addr 172.21.15.132:0/602152992 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.273+0000 7f6eccbdc640 1 -- 172.21.15.132:0/602152992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ec8069c30 msgr2=0x7f6ec806a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.273+0000 7f6eccbdc640 1 --2- 172.21.15.132:0/602152992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ec8069c30 0x7f6ec806a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.273+0000 7f6eccbdc640 1 -- 172.21.15.132:0/602152992 >> v1:172.21.15.187:6789/0 conn(0x7f6ec81447b0 legacy=0x7f6ec80c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:39.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.273+0000 7f6eccbdc640 1 -- 172.21.15.132:0/602152992 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ec8144b90 con 0x7f6ec80ca170 2023-12-20T04:51:39.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.273+0000 7f6eccbdc640 1 --2- 172.21.15.132:0/602152992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ec80ca170 0x7f6ec80ca5d0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80098a0 tx=0x7f6eb802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=507fdfe3348939c9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.273+0000 7f6ebffff640 1 -- 172.21.15.132:0/602152992 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb80317c0 con 0x7f6ec80ca170 2023-12-20T04:51:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.274+0000 7f6ebffff640 1 -- 172.21.15.132:0/602152992 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6eb8031920 con 0x7f6ec80ca170 2023-12-20T04:51:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.274+0000 7f6ebffff640 1 -- 172.21.15.132:0/602152992 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6eb8031cb0 con 0x7f6ec80ca170 2023-12-20T04:51:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.274+0000 7f6ecf641640 1 -- 172.21.15.132:0/602152992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ec80ca170 msgr2=0x7f6ec80ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.274+0000 7f6ecf641640 1 --2- 172.21.15.132:0/602152992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ec80ca170 0x7f6ec80ca5d0 secure :-1 s=READY pgs=1612 cs=0 l=1 rev1=1 crypto rx=0x7f6eb80098a0 tx=0x7f6eb802b860 comp rx=0 tx=0).stop 2023-12-20T04:51:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.274+0000 7f6ecf641640 1 -- 172.21.15.132:0/602152992 shutdown_connections 2023-12-20T04:51:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.274+0000 7f6ecf641640 1 --2- 172.21.15.132:0/602152992 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ec8069c30 0x7f6ec806a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.274+0000 7f6ecf641640 1 --2- 172.21.15.132:0/602152992 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ec80ca170 0x7f6ec80ca5d0 unknown :-1 s=CLOSED pgs=1612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.274+0000 7f6ecf641640 1 -- 172.21.15.132:0/602152992 >> 172.21.15.132:0/602152992 conn(0x7f6ec80cc630 msgr2=0x7f6ec80cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.274+0000 7f6ecf641640 1 -- 172.21.15.132:0/602152992 shutdown_connections 2023-12-20T04:51:39.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.274+0000 7f6ecf641640 1 -- 172.21.15.132:0/602152992 wait complete. 2023-12-20T04:51:39.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.275+0000 7f6ecf641640 1 Processor -- start 2023-12-20T04:51:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.275+0000 7f6ecf641640 1 -- start start 2023-12-20T04:51:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.276+0000 7f6ecf641640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ec8069c30 0x7f6ec80c6d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.276+0000 7f6ecf641640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ec80ca170 0x7f6ec81f4040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.276+0000 7f6ecf641640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ec81447b0 0x7f6ec815a4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.276+0000 7f6ecf641640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80c86f0 con 0x7f6ec81447b0 2023-12-20T04:51:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.276+0000 7f6ecf641640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80c7650 con 0x7f6ec80ca170 2023-12-20T04:51:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.276+0000 7f6ecf641640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec80c7930 con 0x7f6ec8069c30 2023-12-20T04:51:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.276+0000 7f6ecdbde640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ec81447b0 0x7f6ec815a4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.276+0000 7f6ecdbde640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ec81447b0 0x7f6ec815a4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52078/0 (socket says 172.21.15.132:52078) 2023-12-20T04:51:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.276+0000 7f6ecdbde640 1 -- 172.21.15.132:0/3716038704 learned_addr learned my addr 172.21.15.132:0/3716038704 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.276+0000 7f6eccbdc640 1 --2- 172.21.15.132:0/3716038704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ec80ca170 0x7f6ec81f4040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:39.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.276+0000 7f6ecd3dd640 1 --2- 172.21.15.132:0/3716038704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ec8069c30 0x7f6ec80c6d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.277+0000 7f6ecdbde640 1 -- 172.21.15.132:0/3716038704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ec8069c30 msgr2=0x7f6ec80c6d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.277+0000 7f6ecdbde640 1 --2- 172.21.15.132:0/3716038704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ec8069c30 0x7f6ec80c6d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.277+0000 7f6ecdbde640 1 -- 172.21.15.132:0/3716038704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ec80ca170 msgr2=0x7f6ec81f4040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.277+0000 7f6ecdbde640 1 --2- 172.21.15.132:0/3716038704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ec80ca170 0x7f6ec81f4040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.277+0000 7f6ecdbde640 1 -- 172.21.15.132:0/3716038704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb80094d0 con 0x7f6ec81447b0 2023-12-20T04:51:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.277+0000 7f6ecdbde640 1 --2- 172.21.15.132:0/3716038704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ec81447b0 0x7f6ec815a4c0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000b410 tx=0x7f6ec000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.277+0000 7f6ebdffb640 1 -- 172.21.15.132:0/3716038704 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0011830 con 0x7f6ec81447b0 2023-12-20T04:51:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.277+0000 7f6ebdffb640 1 -- 172.21.15.132:0/3716038704 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6ec00119b0 con 0x7f6ec81447b0 2023-12-20T04:51:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.277+0000 7f6ecf641640 1 -- 172.21.15.132:0/3716038704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec80c7c10 con 0x7f6ec81447b0 2023-12-20T04:51:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.277+0000 7f6ebdffb640 1 -- 172.21.15.132:0/3716038704 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6ec0011d60 con 0x7f6ec81447b0 2023-12-20T04:51:39.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.277+0000 7f6ecf641640 1 -- 172.21.15.132:0/3716038704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec80c81d0 con 0x7f6ec81447b0 2023-12-20T04:51:39.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.278+0000 7f6ecf641640 1 -- 172.21.15.132:0/3716038704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec80c83f0 con 0x7f6ec81447b0 2023-12-20T04:51:39.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.278+0000 7f6ebdffb640 1 -- 172.21.15.132:0/3716038704 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6ec001a400 con 0x7f6ec81447b0 2023-12-20T04:51:39.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.279+0000 7f6ebdffb640 1 --2- 172.21.15.132:0/3716038704 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6eac06a430 0x7f6eac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:39.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.279+0000 7f6ebdffb640 1 -- 172.21.15.132:0/3716038704 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f6ec00886f0 con 0x7f6ec81447b0 2023-12-20T04:51:39.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.279+0000 7f6ecd3dd640 1 --2- 172.21.15.132:0/3716038704 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6eac06a430 0x7f6eac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:39.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.279+0000 7f6ecd3dd640 1 --2- 172.21.15.132:0/3716038704 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6eac06a430 0x7f6eac06c8f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4005520 tx=0x7f6ec4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:39.285 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.283+0000 7f6ebdffb640 1 -- 172.21.15.132:0/3716038704 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6ec0054070 con 0x7f6ec81447b0 2023-12-20T04:51:39.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.449+0000 7f6ecf641640 1 -- 172.21.15.132:0/3716038704 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f6ec80c5160 con 0x7f6ec81447b0 2023-12-20T04:51:39.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.453+0000 7f6ebdffb640 1 -- 172.21.15.132:0/3716038704 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v17) v1 ==== 104+0+0 (secure 0 0 0) 0x7f6ec0057690 con 0x7f6ec81447b0 2023-12-20T04:51:39.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.455+0000 7f6ecf641640 1 -- 172.21.15.132:0/3716038704 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6eac06a430 msgr2=0x7f6eac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:39.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.455+0000 7f6ecf641640 1 --2- 172.21.15.132:0/3716038704 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6eac06a430 0x7f6eac06c8f0 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f6ec4005520 tx=0x7f6ec4009040 comp rx=0 tx=0).stop 2023-12-20T04:51:39.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.455+0000 7f6ecf641640 1 -- 172.21.15.132:0/3716038704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ec81447b0 msgr2=0x7f6ec815a4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:39.457 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.455+0000 7f6ecf641640 1 --2- 172.21.15.132:0/3716038704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ec81447b0 0x7f6ec815a4c0 secure :-1 s=READY pgs=1613 cs=0 l=1 rev1=1 crypto rx=0x7f6ec000b410 tx=0x7f6ec000b8d0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.455+0000 7f6ecf641640 1 -- 172.21.15.132:0/3716038704 shutdown_connections 2023-12-20T04:51:39.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.455+0000 7f6ecf641640 1 --2- 172.21.15.132:0/3716038704 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6eac06a430 0x7f6eac06c8f0 unknown :-1 s=CLOSED pgs=678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.455+0000 7f6ecf641640 1 --2- 172.21.15.132:0/3716038704 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ec81447b0 0x7f6ec815a4c0 unknown :-1 s=CLOSED pgs=1613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.455+0000 7f6ecf641640 1 --2- 172.21.15.132:0/3716038704 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6ec80ca170 0x7f6ec81f4040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.455+0000 7f6ecf641640 1 --2- 172.21.15.132:0/3716038704 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ec8069c30 0x7f6ec80c6d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.455+0000 7f6ecf641640 1 -- 172.21.15.132:0/3716038704 >> 172.21.15.132:0/3716038704 conn(0x7f6ec80cc630 msgr2=0x7f6ec80ccb80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:39.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.455+0000 7f6ecf641640 1 -- 172.21.15.132:0/3716038704 shutdown_connections 2023-12-20T04:51:39.458 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.455+0000 7f6ecf641640 1 -- 172.21.15.132:0/3716038704 wait complete. 2023-12-20T04:51:39.468 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose' 2023-12-20T04:51:39.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.566+0000 7f9a18ad5640 1 Processor -- start 2023-12-20T04:51:39.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.566+0000 7f9a18ad5640 1 -- start start 2023-12-20T04:51:39.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.566+0000 7f9a18ad5640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9a1415e2d0 0x7f9a140b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:39.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.566+0000 7f9a18ad5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9a140cf0b0 0x7f9a140d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:39.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.567+0000 7f9a18ad5640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9a140cd740 con 0x7f9a140cb420 2023-12-20T04:51:39.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.567+0000 7f9a18ad5640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a140ce230 con 0x7f9a140cf0b0 2023-12-20T04:51:39.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.567+0000 7f9a18ad5640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9a140cd990 con 0x7f9a1415e2d0 2023-12-20T04:51:39.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.567+0000 7f9a12d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9a140cf0b0 0x7f9a140d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:39.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.567+0000 7f9a12d9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9a140cf0b0 0x7f9a140d07f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52090/0 (socket says 172.21.15.132:52090) 2023-12-20T04:51:39.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.567+0000 7f9a12d9d640 1 -- 172.21.15.132:0/451235810 learned_addr learned my addr 172.21.15.132:0/451235810 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:39.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.567+0000 7f9a1259c640 1 --2- 172.21.15.132:0/451235810 >> v2:172.21.15.187:3300/0 conn(0x7f9a1415e2d0 0x7f9a140b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:39.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.567+0000 7f9a12d9d640 1 -- 172.21.15.132:0/451235810 >> v2:172.21.15.187:3300/0 conn(0x7f9a1415e2d0 msgr2=0x7f9a140b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:39.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.567+0000 7f9a12d9d640 1 --2- 172.21.15.132:0/451235810 >> v2:172.21.15.187:3300/0 conn(0x7f9a1415e2d0 0x7f9a140b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.567+0000 7f9a12d9d640 1 -- 172.21.15.132:0/451235810 >> v1:172.21.15.187:6789/0 conn(0x7f9a140cb420 legacy=0x7f9a140ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:39.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.567+0000 7f9a12d9d640 1 -- 172.21.15.132:0/451235810 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a140cdc70 con 0x7f9a140cf0b0 2023-12-20T04:51:39.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.568+0000 7f9a12d9d640 1 --2- 172.21.15.132:0/451235810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a140cf0b0 0x7f9a140d07f0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f9a1406d070 tx=0x7f9a0402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9329029c0632f796 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:39.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.568+0000 7f9a1159a640 1 -- 172.21.15.132:0/451235810 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04031870 con 0x7f9a140cf0b0 2023-12-20T04:51:39.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.568+0000 7f9a1159a640 1 -- 172.21.15.132:0/451235810 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a040319d0 con 0x7f9a140cf0b0 2023-12-20T04:51:39.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.568+0000 7f9a1159a640 1 -- 172.21.15.132:0/451235810 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a04031d60 con 0x7f9a140cf0b0 2023-12-20T04:51:39.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.568+0000 7f9a18ad5640 1 -- 172.21.15.132:0/451235810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a140cf0b0 msgr2=0x7f9a140d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:39.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.568+0000 7f9a18ad5640 1 --2- 172.21.15.132:0/451235810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a140cf0b0 0x7f9a140d07f0 secure :-1 s=READY pgs=1614 cs=0 l=1 rev1=1 crypto rx=0x7f9a1406d070 tx=0x7f9a0402b910 comp rx=0 tx=0).stop 2023-12-20T04:51:39.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.568+0000 7f9a18ad5640 1 -- 172.21.15.132:0/451235810 shutdown_connections 2023-12-20T04:51:39.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.568+0000 7f9a18ad5640 1 --2- 172.21.15.132:0/451235810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a140cf0b0 0x7f9a140d07f0 unknown :-1 s=CLOSED pgs=1614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.568+0000 7f9a18ad5640 1 --2- 172.21.15.132:0/451235810 >> v2:172.21.15.187:3300/0 conn(0x7f9a1415e2d0 0x7f9a140b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.568+0000 7f9a18ad5640 1 -- 172.21.15.132:0/451235810 >> 172.21.15.132:0/451235810 conn(0x7f9a1406d7c0 msgr2=0x7f9a1406dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:39.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.569+0000 7f9a18ad5640 1 -- 172.21.15.132:0/451235810 shutdown_connections 2023-12-20T04:51:39.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.569+0000 7f9a18ad5640 1 -- 172.21.15.132:0/451235810 wait complete. 2023-12-20T04:51:39.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.570+0000 7f9a18ad5640 1 Processor -- start 2023-12-20T04:51:39.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.570+0000 7f9a18ad5640 1 -- start start 2023-12-20T04:51:39.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.570+0000 7f9a18ad5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a140cb420 0x7f9a14154670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:39.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.570+0000 7f9a18ad5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a140cf0b0 0x7f9a141eff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:39.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.570+0000 7f9a18ad5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a1415e2d0 0x7f9a14156580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:39.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.570+0000 7f9a18ad5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a14153ab0 con 0x7f9a140cb420 2023-12-20T04:51:39.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.570+0000 7f9a18ad5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a140c9cd0 con 0x7f9a1415e2d0 2023-12-20T04:51:39.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.570+0000 7f9a18ad5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9a14154d70 con 0x7f9a140cf0b0 2023-12-20T04:51:39.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.571+0000 7f9a1259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a140cb420 0x7f9a14154670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:39.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.571+0000 7f9a1259c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a140cb420 0x7f9a14154670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52096/0 (socket says 172.21.15.132:52096) 2023-12-20T04:51:39.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.571+0000 7f9a1259c640 1 -- 172.21.15.132:0/96494117 learned_addr learned my addr 172.21.15.132:0/96494117 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:39.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.571+0000 7f9a12d9d640 1 --2- 172.21.15.132:0/96494117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a1415e2d0 0x7f9a14156580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:39.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.571+0000 7f9a1259c640 1 -- 172.21.15.132:0/96494117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a140cf0b0 msgr2=0x7f9a141eff70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:39.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.571+0000 7f9a11d9b640 1 --2- 172.21.15.132:0/96494117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a140cf0b0 0x7f9a141eff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:39.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.571+0000 7f9a1259c640 1 --2- 172.21.15.132:0/96494117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a140cf0b0 0x7f9a141eff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.571+0000 7f9a1259c640 1 -- 172.21.15.132:0/96494117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a1415e2d0 msgr2=0x7f9a14156580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:39.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.571+0000 7f9a1259c640 1 --2- 172.21.15.132:0/96494117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a1415e2d0 0x7f9a14156580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:39.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.571+0000 7f9a1259c640 1 -- 172.21.15.132:0/96494117 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a040094d0 con 0x7f9a140cb420 2023-12-20T04:51:39.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.571+0000 7f9a12d9d640 1 --2- 172.21.15.132:0/96494117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a1415e2d0 0x7f9a14156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:39.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.571+0000 7f9a1259c640 1 --2- 172.21.15.132:0/96494117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a140cb420 0x7f9a14154670 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00d800 tx=0x7f9a0c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:39.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.571+0000 7f9a02ffd640 1 -- 172.21.15.132:0/96494117 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c00b6c0 con 0x7f9a140cb420 2023-12-20T04:51:39.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.571+0000 7f9a02ffd640 1 -- 172.21.15.132:0/96494117 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9a0c00b820 con 0x7f9a140cb420 2023-12-20T04:51:39.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.571+0000 7f9a18ad5640 1 -- 172.21.15.132:0/96494117 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a141f3d90 con 0x7f9a140cb420 2023-12-20T04:51:39.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.571+0000 7f9a02ffd640 1 -- 172.21.15.132:0/96494117 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9a0c00bbb0 con 0x7f9a140cb420 2023-12-20T04:51:39.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.571+0000 7f9a18ad5640 1 -- 172.21.15.132:0/96494117 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a141f4350 con 0x7f9a140cb420 2023-12-20T04:51:39.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.572+0000 7f9a18ad5640 1 -- 172.21.15.132:0/96494117 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a14066480 con 0x7f9a140cb420 2023-12-20T04:51:39.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.573+0000 7f9a02ffd640 1 -- 172.21.15.132:0/96494117 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9a0c00bd10 con 0x7f9a140cb420 2023-12-20T04:51:39.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.573+0000 7f9a02ffd640 1 --2- 172.21.15.132:0/96494117 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99f406a430 0x7f99f406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:39.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.573+0000 7f9a02ffd640 1 -- 172.21.15.132:0/96494117 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f9a0c088ad0 con 0x7f9a140cb420 2023-12-20T04:51:39.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.573+0000 7f9a11d9b640 1 --2- 172.21.15.132:0/96494117 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99f406a430 0x7f99f406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:39.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.574+0000 7f9a11d9b640 1 --2- 172.21.15.132:0/96494117 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99f406a430 0x7f99f406c8f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9a140b46f0 tx=0x7f9a08009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:39.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.577+0000 7f9a02ffd640 1 -- 172.21.15.132:0/96494117 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9a0c054450 con 0x7f9a140cb420 2023-12-20T04:51:39.808 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:39.807+0000 7f9a18ad5640 1 -- 172.21.15.132:0/96494117 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]} v 0) v1 -- 0x7f9a141f4510 con 0x7f9a140cb420 2023-12-20T04:51:40.147 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.145+0000 7f9a02ffd640 1 -- 172.21.15.132:0/96494117 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fclose"]}]=0 v433) v1 ==== 132+0+0 (secure 0 0 0) 0x7f9a0c057a70 con 0x7f9a140cb420 2023-12-20T04:51:40.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.147+0000 7f9a18ad5640 1 -- 172.21.15.132:0/96494117 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99f406a430 msgr2=0x7f99f406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:40.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.147+0000 7f9a18ad5640 1 --2- 172.21.15.132:0/96494117 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99f406a430 0x7f99f406c8f0 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f9a140b46f0 tx=0x7f9a08009040 comp rx=0 tx=0).stop 2023-12-20T04:51:40.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.147+0000 7f9a18ad5640 1 -- 172.21.15.132:0/96494117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a140cb420 msgr2=0x7f9a14154670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:40.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.147+0000 7f9a18ad5640 1 --2- 172.21.15.132:0/96494117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a140cb420 0x7f9a14154670 secure :-1 s=READY pgs=1615 cs=0 l=1 rev1=1 crypto rx=0x7f9a0c00d800 tx=0x7f9a0c00dcc0 comp rx=0 tx=0).stop 2023-12-20T04:51:40.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.147+0000 7f9a18ad5640 1 -- 172.21.15.132:0/96494117 shutdown_connections 2023-12-20T04:51:40.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.147+0000 7f9a18ad5640 1 --2- 172.21.15.132:0/96494117 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f99f406a430 0x7f99f406c8f0 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:40.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.147+0000 7f9a18ad5640 1 --2- 172.21.15.132:0/96494117 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9a1415e2d0 0x7f9a14156580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:40.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.147+0000 7f9a18ad5640 1 --2- 172.21.15.132:0/96494117 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9a140cf0b0 0x7f9a141eff70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:40.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.147+0000 7f9a18ad5640 1 --2- 172.21.15.132:0/96494117 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9a140cb420 0x7f9a14154670 unknown :-1 s=CLOSED pgs=1615 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:40.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.147+0000 7f9a18ad5640 1 -- 172.21.15.132:0/96494117 >> 172.21.15.132:0/96494117 conn(0x7f9a1406d7c0 msgr2=0x7f9a140ce980 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:40.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.147+0000 7f9a18ad5640 1 -- 172.21.15.132:0/96494117 shutdown_connections 2023-12-20T04:51:40.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.147+0000 7f9a18ad5640 1 -- 172.21.15.132:0/96494117 wait complete. 2023-12-20T04:51:40.160 INFO:tasks.cephfs_test_runner:test_full_fclose (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-12-20T04:51:40.160 INFO:tasks.cephfs_test_runner:Starting test: test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) That when the full flag is encountered during asynchronous 2023-12-20T04:51:40.161 INFO:tasks.cephfs_test_runner:test_full_fsync (tasks.cephfs.test_full.TestQuotaFull) 2023-12-20T04:51:40.161 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-12-20T04:51:40.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.260+0000 7fe697111640 1 Processor -- start 2023-12-20T04:51:40.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.260+0000 7fe697111640 1 -- start start 2023-12-20T04:51:40.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.260+0000 7fe697111640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe69015e530 0x7fe69006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:40.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.260+0000 7fe697111640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe69006c240 0x7fe69006c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:40.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.260+0000 7fe697111640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe6900ccf30 con 0x7fe690159b50 2023-12-20T04:51:40.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.260+0000 7fe697111640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe69006cc10 con 0x7fe69006c240 2023-12-20T04:51:40.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.260+0000 7fe697111640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe6900caa60 con 0x7fe69015e530 2023-12-20T04:51:40.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.261+0000 7fe6956ae640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe69006c240 0x7fe69006c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:40.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.261+0000 7fe6956ae640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe69006c240 0x7fe69006c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52104/0 (socket says 172.21.15.132:52104) 2023-12-20T04:51:40.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.261+0000 7fe6956ae640 1 -- 172.21.15.132:0/1597385982 learned_addr learned my addr 172.21.15.132:0/1597385982 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:40.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.261+0000 7fe6956ae640 1 -- 172.21.15.132:0/1597385982 >> v2:172.21.15.187:3300/0 conn(0x7fe69015e530 msgr2=0x7fe69006fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:40.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.261+0000 7fe6956ae640 1 --2- 172.21.15.132:0/1597385982 >> v2:172.21.15.187:3300/0 conn(0x7fe69015e530 0x7fe69006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:40.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.261+0000 7fe6956ae640 1 -- 172.21.15.132:0/1597385982 >> v1:172.21.15.187:6789/0 conn(0x7fe690159b50 legacy=0x7fe6900c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:40.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.261+0000 7fe6956ae640 1 -- 172.21.15.132:0/1597385982 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe6900ca1c0 con 0x7fe69006c240 2023-12-20T04:51:40.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.262+0000 7fe6956ae640 1 --2- 172.21.15.132:0/1597385982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe69006c240 0x7fe69006c6d0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fe688009e50 tx=0x7fe68802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6689b70a9c7af9f5 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:40.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.262+0000 7fe68f7fe640 1 -- 172.21.15.132:0/1597385982 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe68802ca80 con 0x7fe69006c240 2023-12-20T04:51:40.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.262+0000 7fe68f7fe640 1 -- 172.21.15.132:0/1597385982 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe68802cbe0 con 0x7fe69006c240 2023-12-20T04:51:40.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.262+0000 7fe68f7fe640 1 -- 172.21.15.132:0/1597385982 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6880343f0 con 0x7fe69006c240 2023-12-20T04:51:40.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.262+0000 7fe697111640 1 -- 172.21.15.132:0/1597385982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe69006c240 msgr2=0x7fe69006c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:40.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.262+0000 7fe697111640 1 --2- 172.21.15.132:0/1597385982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe69006c240 0x7fe69006c6d0 secure :-1 s=READY pgs=1616 cs=0 l=1 rev1=1 crypto rx=0x7fe688009e50 tx=0x7fe68802bee0 comp rx=0 tx=0).stop 2023-12-20T04:51:40.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.262+0000 7fe697111640 1 -- 172.21.15.132:0/1597385982 shutdown_connections 2023-12-20T04:51:40.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.262+0000 7fe697111640 1 --2- 172.21.15.132:0/1597385982 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe69006c240 0x7fe69006c6d0 unknown :-1 s=CLOSED pgs=1616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:40.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.262+0000 7fe697111640 1 --2- 172.21.15.132:0/1597385982 >> v2:172.21.15.187:3300/0 conn(0x7fe69015e530 0x7fe69006fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:40.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.262+0000 7fe697111640 1 -- 172.21.15.132:0/1597385982 >> 172.21.15.132:0/1597385982 conn(0x7fe6900ced10 msgr2=0x7fe6900cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:40.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.262+0000 7fe697111640 1 -- 172.21.15.132:0/1597385982 shutdown_connections 2023-12-20T04:51:40.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.262+0000 7fe697111640 1 -- 172.21.15.132:0/1597385982 wait complete. 2023-12-20T04:51:40.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.263+0000 7fe697111640 1 Processor -- start 2023-12-20T04:51:40.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.264+0000 7fe697111640 1 -- start start 2023-12-20T04:51:40.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.264+0000 7fe697111640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe69006c240 0x7fe6900b2d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:40.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.264+0000 7fe697111640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe690159b50 0x7fe69014b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:40.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.264+0000 7fe697111640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe69015e530 0x7fe6900b0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:40.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.264+0000 7fe697111640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900b1c70 con 0x7fe69006c240 2023-12-20T04:51:40.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.264+0000 7fe697111640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900b1f50 con 0x7fe69015e530 2023-12-20T04:51:40.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.264+0000 7fe697111640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe6900b2230 con 0x7fe690159b50 2023-12-20T04:51:40.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.264+0000 7fe694ead640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe69006c240 0x7fe6900b2d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:40.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.264+0000 7fe694ead640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe69006c240 0x7fe6900b2d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52120/0 (socket says 172.21.15.132:52120) 2023-12-20T04:51:40.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.264+0000 7fe694ead640 1 -- 172.21.15.132:0/2191431985 learned_addr learned my addr 172.21.15.132:0/2191431985 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:40.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.265+0000 7fe6956ae640 1 --2- 172.21.15.132:0/2191431985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe69015e530 0x7fe6900b0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:40.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.265+0000 7fe694ead640 1 -- 172.21.15.132:0/2191431985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe690159b50 msgr2=0x7fe69014b1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:40.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.265+0000 7fe694ead640 1 --2- 172.21.15.132:0/2191431985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe690159b50 0x7fe69014b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:40.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.265+0000 7fe694ead640 1 -- 172.21.15.132:0/2191431985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe69015e530 msgr2=0x7fe6900b0d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:40.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.265+0000 7fe694ead640 1 --2- 172.21.15.132:0/2191431985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe69015e530 0x7fe6900b0d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:40.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.265+0000 7fe694ead640 1 -- 172.21.15.132:0/2191431985 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe688009b30 con 0x7fe69006c240 2023-12-20T04:51:40.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.265+0000 7fe6956ae640 1 --2- 172.21.15.132:0/2191431985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe69015e530 0x7fe6900b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:40.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.265+0000 7fe694ead640 1 --2- 172.21.15.132:0/2191431985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe69006c240 0x7fe6900b2d10 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fe68400c410 tx=0x7fe68400c8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:40.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.265+0000 7fe68d7fa640 1 -- 172.21.15.132:0/2191431985 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe6840035f0 con 0x7fe69006c240 2023-12-20T04:51:40.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.265+0000 7fe68d7fa640 1 -- 172.21.15.132:0/2191431985 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe684003750 con 0x7fe69006c240 2023-12-20T04:51:40.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.265+0000 7fe697111640 1 -- 172.21.15.132:0/2191431985 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe6900b2510 con 0x7fe69006c240 2023-12-20T04:51:40.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.265+0000 7fe68d7fa640 1 -- 172.21.15.132:0/2191431985 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe684003b40 con 0x7fe69006c240 2023-12-20T04:51:40.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.265+0000 7fe697111640 1 -- 172.21.15.132:0/2191431985 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe6900b1900 con 0x7fe69006c240 2023-12-20T04:51:40.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.266+0000 7fe697111640 1 -- 172.21.15.132:0/2191431985 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6900b2a30 con 0x7fe69006c240 2023-12-20T04:51:40.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.267+0000 7fe68d7fa640 1 -- 172.21.15.132:0/2191431985 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe684003ca0 con 0x7fe69006c240 2023-12-20T04:51:40.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.267+0000 7fe68d7fa640 1 --2- 172.21.15.132:0/2191431985 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe67406a430 0x7fe67406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:40.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.267+0000 7fe68d7fa640 1 -- 172.21.15.132:0/2191431985 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe6840877c0 con 0x7fe69006c240 2023-12-20T04:51:40.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.267+0000 7fe68ffff640 1 --2- 172.21.15.132:0/2191431985 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe67406a430 0x7fe67406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:40.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.267+0000 7fe68ffff640 1 --2- 172.21.15.132:0/2191431985 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe67406a430 0x7fe67406c8f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe69014fab0 tx=0x7fe67c006c90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:40.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.271+0000 7fe68d7fa640 1 -- 172.21.15.132:0/2191431985 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe684053140 con 0x7fe69006c240 2023-12-20T04:51:40.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:40.502+0000 7fe697111640 1 -- 172.21.15.132:0/2191431985 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7fe69004e840 con 0x7fe69006c240 2023-12-20T04:51:41.151 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.149+0000 7fe68d7fa640 1 -- 172.21.15.132:0/2191431985 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v434) v1 ==== 134+0+0 (secure 0 0 0) 0x7fe684056760 con 0x7fe69006c240 2023-12-20T04:51:41.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.151+0000 7fe697111640 1 -- 172.21.15.132:0/2191431985 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe67406a430 msgr2=0x7fe67406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:41.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.151+0000 7fe697111640 1 --2- 172.21.15.132:0/2191431985 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe67406a430 0x7fe67406c8f0 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7fe69014fab0 tx=0x7fe67c006c90 comp rx=0 tx=0).stop 2023-12-20T04:51:41.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.151+0000 7fe697111640 1 -- 172.21.15.132:0/2191431985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe69006c240 msgr2=0x7fe6900b2d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:41.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.151+0000 7fe697111640 1 --2- 172.21.15.132:0/2191431985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe69006c240 0x7fe6900b2d10 secure :-1 s=READY pgs=1617 cs=0 l=1 rev1=1 crypto rx=0x7fe68400c410 tx=0x7fe68400c8d0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.151+0000 7fe697111640 1 -- 172.21.15.132:0/2191431985 shutdown_connections 2023-12-20T04:51:41.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.151+0000 7fe697111640 1 --2- 172.21.15.132:0/2191431985 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe67406a430 0x7fe67406c8f0 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.151+0000 7fe697111640 1 --2- 172.21.15.132:0/2191431985 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe69015e530 0x7fe6900b0d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.151+0000 7fe697111640 1 --2- 172.21.15.132:0/2191431985 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe690159b50 0x7fe69014b1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.151+0000 7fe697111640 1 --2- 172.21.15.132:0/2191431985 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe69006c240 0x7fe6900b2d10 unknown :-1 s=CLOSED pgs=1617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.151+0000 7fe697111640 1 -- 172.21.15.132:0/2191431985 >> 172.21.15.132:0/2191431985 conn(0x7fe6900ced10 msgr2=0x7fe69015a520 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:41.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.151+0000 7fe697111640 1 -- 172.21.15.132:0/2191431985 shutdown_connections 2023-12-20T04:51:41.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.151+0000 7fe697111640 1 -- 172.21.15.132:0/2191431985 wait complete. 2023-12-20T04:51:41.165 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-20T04:51:41.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.267+0000 7f58fbd8b640 1 Processor -- start 2023-12-20T04:51:41.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.268+0000 7f58fbd8b640 1 -- start start 2023-12-20T04:51:41.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.268+0000 7f58fbd8b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f58f40cb2b0 0x7f58f40cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:41.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.268+0000 7f58fbd8b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f40cdbb0 0x7f58f40d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:41.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.268+0000 7f58fbd8b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f58f40d0130 con 0x7f58f415aee0 2023-12-20T04:51:41.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.268+0000 7f58fbd8b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f58f40ce040 con 0x7f58f40cb2b0 2023-12-20T04:51:41.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.268+0000 7f58fbd8b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f415f370 con 0x7f58f40cdbb0 2023-12-20T04:51:41.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f9b27640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f58f415aee0 0x7f58f415eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:42414/0 (socket says 172.21.15.132:42414) 2023-12-20T04:51:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f9b27640 1 -- 172.21.15.132:0/974855589 learned_addr learned my addr 172.21.15.132:0/974855589 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f9326640 1 --2- 172.21.15.132:0/974855589 >> v2:172.21.15.187:3300/0 conn(0x7f58f40cb2b0 0x7f58f40cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58fa328640 1 --2- 172.21.15.132:0/974855589 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f40cdbb0 0x7f58f40d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f8b25640 1 -- 172.21.15.132:0/974855589 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1719864983 0 0) 0x7f58f40d0130 con 0x7f58f415aee0 2023-12-20T04:51:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f8b25640 1 -- 172.21.15.132:0/974855589 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f58e0003520 con 0x7f58f415aee0 2023-12-20T04:51:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f8b25640 1 -- 172.21.15.132:0/974855589 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3630431969 0 0) 0x7f58e0003520 con 0x7f58f415aee0 2023-12-20T04:51:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f8b25640 1 -- 172.21.15.132:0/974855589 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f40cdbb0 msgr2=0x7f58f40d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f8b25640 1 --2- 172.21.15.132:0/974855589 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f40cdbb0 0x7f58f40d08a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f8b25640 1 -- 172.21.15.132:0/974855589 >> v2:172.21.15.187:3300/0 conn(0x7f58f40cb2b0 msgr2=0x7f58f40cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f8b25640 1 --2- 172.21.15.132:0/974855589 >> v2:172.21.15.187:3300/0 conn(0x7f58f40cb2b0 0x7f58f40cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f8b25640 1 -- 172.21.15.132:0/974855589 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f415f650 con 0x7f58f415aee0 2023-12-20T04:51:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f8b25640 1 -- 172.21.15.132:0/974855589 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f58ec0019f0 con 0x7f58f415aee0 2023-12-20T04:51:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f8b25640 1 -- 172.21.15.132:0/974855589 >> v1:172.21.15.132:6789/0 conn(0x7f58f415aee0 legacy=0x7f58f415eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:41.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f8b25640 1 --2- 172.21.15.132:0/974855589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58e0003970 0x7f58e0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:41.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f8b25640 1 --2- 172.21.15.132:0/974855589 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f40cdbb0 0x7f58e00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:41.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f8b25640 1 --2- 172.21.15.132:0/974855589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58e0004d00 0x7f58e0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:41.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f8b25640 1 -- 172.21.15.132:0/974855589 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f40ce040 con 0x7f58e0004d00 2023-12-20T04:51:41.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f8b25640 1 -- 172.21.15.132:0/974855589 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f415f370 con 0x7f58e0003970 2023-12-20T04:51:41.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f8b25640 1 -- 172.21.15.132:0/974855589 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58e000b980 con 0x7f58f40cdbb0 2023-12-20T04:51:41.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58fa328640 1 --2- 172.21.15.132:0/974855589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58e0004d00 0x7f58e0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:41.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f9b27640 1 --2- 172.21.15.132:0/974855589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58e0003970 0x7f58e0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:41.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.269+0000 7f58f9326640 1 --2- 172.21.15.132:0/974855589 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f40cdbb0 0x7f58e00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:41.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.270+0000 7f58fa328640 1 -- 172.21.15.132:0/974855589 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f40cdbb0 msgr2=0x7f58e00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:41.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.270+0000 7f58fa328640 1 --2- 172.21.15.132:0/974855589 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f40cdbb0 0x7f58e00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.270+0000 7f58fa328640 1 -- 172.21.15.132:0/974855589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58e0003970 msgr2=0x7f58e0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:41.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.270+0000 7f58fa328640 1 --2- 172.21.15.132:0/974855589 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58e0003970 0x7f58e0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.270+0000 7f58fa328640 1 -- 172.21.15.132:0/974855589 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58e0003520 con 0x7f58e0004d00 2023-12-20T04:51:41.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.270+0000 7f58fa328640 1 --2- 172.21.15.132:0/974855589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58e0004d00 0x7f58e0005180 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f58f0009ac0 tx=0x7f58e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71218c035e59ffcd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:41.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.270+0000 7f58f8b25640 1 -- 172.21.15.132:0/974855589 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f002c6b0 con 0x7f58e0004d00 2023-12-20T04:51:41.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.271+0000 7f58f8b25640 1 -- 172.21.15.132:0/974855589 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58f002c810 con 0x7f58e0004d00 2023-12-20T04:51:41.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.271+0000 7f58f8b25640 1 -- 172.21.15.132:0/974855589 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58f002cba0 con 0x7f58e0004d00 2023-12-20T04:51:41.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.271+0000 7f58fbd8b640 1 -- 172.21.15.132:0/974855589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58e0004d00 msgr2=0x7f58e0005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:41.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.271+0000 7f58fbd8b640 1 --2- 172.21.15.132:0/974855589 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58e0004d00 0x7f58e0005180 secure :-1 s=READY pgs=1619 cs=0 l=1 rev1=1 crypto rx=0x7f58f0009ac0 tx=0x7f58e00057f0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.271+0000 7f58fa328640 1 -- 172.21.15.132:0/974855589 reap_dead start 2023-12-20T04:51:41.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.271+0000 7f58fbd8b640 1 -- 172.21.15.132:0/974855589 shutdown_connections 2023-12-20T04:51:41.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.271+0000 7f58fbd8b640 1 -- 172.21.15.132:0/974855589 >> 172.21.15.132:0/974855589 conn(0x7f58f4072c60 msgr2=0x7f58f4073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:41.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.271+0000 7f58fbd8b640 1 -- 172.21.15.132:0/974855589 shutdown_connections 2023-12-20T04:51:41.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.271+0000 7f58fbd8b640 1 -- 172.21.15.132:0/974855589 wait complete. 2023-12-20T04:51:41.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.272+0000 7f58fbd8b640 1 Processor -- start 2023-12-20T04:51:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.272+0000 7f58fbd8b640 1 -- start start 2023-12-20T04:51:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.273+0000 7f58fbd8b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f41f3b70 0x7f58f41f0d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.273+0000 7f58fbd8b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f415c320 0x7f58f415bc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.273+0000 7f58fbd8b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58f415d930 0x7f58f415ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.273+0000 7f58fbd8b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f4156a00 con 0x7f58f41f3b70 2023-12-20T04:51:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.273+0000 7f58fbd8b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f58f415c890 con 0x7f58f415d930 2023-12-20T04:51:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.273+0000 7f58fbd8b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f58f415cb70 con 0x7f58f415c320 2023-12-20T04:51:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.273+0000 7f58f9b27640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f41f3b70 0x7f58f41f0d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.273+0000 7f58f9b27640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f41f3b70 0x7f58f41f0d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52142/0 (socket says 172.21.15.132:52142) 2023-12-20T04:51:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.273+0000 7f58f9b27640 1 -- 172.21.15.132:0/4212951873 learned_addr learned my addr 172.21.15.132:0/4212951873 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.273+0000 7f58f9b27640 1 -- 172.21.15.132:0/4212951873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f415c320 msgr2=0x7f58f415bc40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.273+0000 7f58f9b27640 1 --2- 172.21.15.132:0/4212951873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f415c320 0x7f58f415bc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.273+0000 7f58f9b27640 1 -- 172.21.15.132:0/4212951873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58f415d930 msgr2=0x7f58f415ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:41.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.273+0000 7f58f9b27640 1 --2- 172.21.15.132:0/4212951873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58f415d930 0x7f58f415ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.273+0000 7f58f9b27640 1 -- 172.21.15.132:0/4212951873 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f58f415ce50 con 0x7f58f41f3b70 2023-12-20T04:51:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.274+0000 7f58f9b27640 1 --2- 172.21.15.132:0/4212951873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f41f3b70 0x7f58f41f0d60 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00a570 tx=0x7f58ec00aa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.274+0000 7f58ea7fc640 1 -- 172.21.15.132:0/4212951873 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec013600 con 0x7f58f41f3b70 2023-12-20T04:51:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.274+0000 7f58ea7fc640 1 -- 172.21.15.132:0/4212951873 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f58ec013780 con 0x7f58f41f3b70 2023-12-20T04:51:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.274+0000 7f58ea7fc640 1 -- 172.21.15.132:0/4212951873 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f58ec013b30 con 0x7f58f41f3b70 2023-12-20T04:51:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.274+0000 7f58fbd8b640 1 -- 172.21.15.132:0/4212951873 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f58f415d130 con 0x7f58f41f3b70 2023-12-20T04:51:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.274+0000 7f58fbd8b640 1 -- 172.21.15.132:0/4212951873 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f58f41f3f50 con 0x7f58f41f3b70 2023-12-20T04:51:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.275+0000 7f58fbd8b640 1 -- 172.21.15.132:0/4212951873 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f58f404e840 con 0x7f58f41f3b70 2023-12-20T04:51:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.275+0000 7f58ea7fc640 1 -- 172.21.15.132:0/4212951873 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f58ec013c90 con 0x7f58f41f3b70 2023-12-20T04:51:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.275+0000 7f58ea7fc640 1 --2- 172.21.15.132:0/4212951873 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f58d806a460 0x7f58d806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.276+0000 7f58ea7fc640 1 -- 172.21.15.132:0/4212951873 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f58ec089720 con 0x7f58f41f3b70 2023-12-20T04:51:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.276+0000 7f58f9326640 1 --2- 172.21.15.132:0/4212951873 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f58d806a460 0x7f58d806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:41.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.276+0000 7f58f9326640 1 --2- 172.21.15.132:0/4212951873 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f58d806a460 0x7f58d806c920 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f58e4006e80 tx=0x7f58e4006df0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:41.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.280+0000 7f58ea7fc640 1 -- 172.21.15.132:0/4212951873 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f58ec055010 con 0x7f58f41f3b70 2023-12-20T04:51:41.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.447+0000 7f58fbd8b640 1 -- 172.21.15.132:0/4212951873 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7f58f415e850 con 0x7f58f41f3b70 2023-12-20T04:51:41.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.451+0000 7f58ea7fc640 1 -- 172.21.15.132:0/4212951873 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v18)=0 v18) v1 ==== 122+0+0 (secure 0 0 0) 0x7f58ec017070 con 0x7f58f41f3b70 2023-12-20T04:51:41.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.453+0000 7f58fbd8b640 1 -- 172.21.15.132:0/4212951873 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f58d806a460 msgr2=0x7f58d806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:41.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.453+0000 7f58fbd8b640 1 --2- 172.21.15.132:0/4212951873 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f58d806a460 0x7f58d806c920 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f58e4006e80 tx=0x7f58e4006df0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.453+0000 7f58fbd8b640 1 -- 172.21.15.132:0/4212951873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f41f3b70 msgr2=0x7f58f41f0d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:41.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.453+0000 7f58fbd8b640 1 --2- 172.21.15.132:0/4212951873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f41f3b70 0x7f58f41f0d60 secure :-1 s=READY pgs=1620 cs=0 l=1 rev1=1 crypto rx=0x7f58ec00a570 tx=0x7f58ec00aa30 comp rx=0 tx=0).stop 2023-12-20T04:51:41.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.453+0000 7f58fbd8b640 1 -- 172.21.15.132:0/4212951873 shutdown_connections 2023-12-20T04:51:41.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.453+0000 7f58fbd8b640 1 --2- 172.21.15.132:0/4212951873 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f58d806a460 0x7f58d806c920 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.453+0000 7f58fbd8b640 1 --2- 172.21.15.132:0/4212951873 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f58f415d930 0x7f58f415ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.453+0000 7f58fbd8b640 1 --2- 172.21.15.132:0/4212951873 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f58f415c320 0x7f58f415bc40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.453+0000 7f58fbd8b640 1 --2- 172.21.15.132:0/4212951873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f58f41f3b70 0x7f58f41f0d60 unknown :-1 s=CLOSED pgs=1620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.453+0000 7f58fbd8b640 1 -- 172.21.15.132:0/4212951873 >> 172.21.15.132:0/4212951873 conn(0x7f58f4072c60 msgr2=0x7f58f40b4380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:41.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.453+0000 7f58fbd8b640 1 -- 172.21.15.132:0/4212951873 shutdown_connections 2023-12-20T04:51:41.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.453+0000 7f58fbd8b640 1 -- 172.21.15.132:0/4212951873 wait complete. 2023-12-20T04:51:41.466 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:51:41.466 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:51:41.505 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:51:41.549 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:51:41.549 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:51:41.549 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:51:41.565 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:51:41.565 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:51:41.565 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:51:41.606 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:51:41.606 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:51:41.606 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:51:41.620 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:51:41.621 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:51:41.621 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:51:41.663 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:51:41.663 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-20T04:51:41.663 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:51:41.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.760+0000 7f3039bfa640 1 Processor -- start 2023-12-20T04:51:41.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.760+0000 7f3039bfa640 1 -- start start 2023-12-20T04:51:41.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.761+0000 7f3039bfa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f303415d100 0x7f30340b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:41.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.761+0000 7f3039bfa640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f30340d0370 0x7f30340cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:41.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.761+0000 7f3039bfa640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30340b2f90 con 0x7f3034161850 2023-12-20T04:51:41.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.761+0000 7f3039bfa640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30341613c0 con 0x7f303415d100 2023-12-20T04:51:41.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.761+0000 7f3039bfa640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f30340d1b00 con 0x7f30340d0370 2023-12-20T04:51:41.764 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.761+0000 7f30337fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f303415d100 0x7f30340b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:41.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.761+0000 7f30337fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f303415d100 0x7f30340b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52150/0 (socket says 172.21.15.132:52150) 2023-12-20T04:51:41.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.761+0000 7f30337fe640 1 -- 172.21.15.132:0/744606707 learned_addr learned my addr 172.21.15.132:0/744606707 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:41.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.761+0000 7f3033fff640 1 --1- 172.21.15.132:0/744606707 >> v1:172.21.15.132:6789/0 conn(0x7f3034161850 0x7f303406c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:42418/0 (socket says 172.21.15.132:42418) 2023-12-20T04:51:41.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.761+0000 7f3032ffd640 1 --2- 172.21.15.132:0/744606707 >> v2:172.21.15.187:3300/0 conn(0x7f30340d0370 0x7f30340cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:41.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.762+0000 7f30337fe640 1 -- 172.21.15.132:0/744606707 >> v2:172.21.15.187:3300/0 conn(0x7f30340d0370 msgr2=0x7f30340cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:41.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.762+0000 7f30337fe640 1 --2- 172.21.15.132:0/744606707 >> v2:172.21.15.187:3300/0 conn(0x7f30340d0370 0x7f30340cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.762+0000 7f30337fe640 1 -- 172.21.15.132:0/744606707 >> v1:172.21.15.132:6789/0 conn(0x7f3034161850 legacy=0x7f303406c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:41.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.762+0000 7f30337fe640 1 -- 172.21.15.132:0/744606707 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30340d0810 con 0x7f303415d100 2023-12-20T04:51:41.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.762+0000 7f30327fc640 1 -- 172.21.15.132:0/744606707 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1727141337 0 0) 0x7f302c001490 con 0x7f3034161850 2023-12-20T04:51:41.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.762+0000 7f30337fe640 1 --2- 172.21.15.132:0/744606707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f303415d100 0x7f30340b2a50 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f303406d6c0 tx=0x7f302402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31eafa042bdd07a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:41.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.762+0000 7f30327fc640 1 -- 172.21.15.132:0/744606707 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024031870 con 0x7f303415d100 2023-12-20T04:51:41.765 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.762+0000 7f30327fc640 1 -- 172.21.15.132:0/744606707 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f30240319d0 con 0x7f303415d100 2023-12-20T04:51:41.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.762+0000 7f30327fc640 1 -- 172.21.15.132:0/744606707 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024031d60 con 0x7f303415d100 2023-12-20T04:51:41.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.763+0000 7f3039bfa640 1 -- 172.21.15.132:0/744606707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f303415d100 msgr2=0x7f30340b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:41.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.763+0000 7f3039bfa640 1 --2- 172.21.15.132:0/744606707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f303415d100 0x7f30340b2a50 secure :-1 s=READY pgs=1622 cs=0 l=1 rev1=1 crypto rx=0x7f303406d6c0 tx=0x7f302402b910 comp rx=0 tx=0).stop 2023-12-20T04:51:41.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.763+0000 7f3039bfa640 1 -- 172.21.15.132:0/744606707 shutdown_connections 2023-12-20T04:51:41.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.763+0000 7f3039bfa640 1 --2- 172.21.15.132:0/744606707 >> v2:172.21.15.187:3300/0 conn(0x7f30340d0370 0x7f30340cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.763+0000 7f3039bfa640 1 --2- 172.21.15.132:0/744606707 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f303415d100 0x7f30340b2a50 unknown :-1 s=CLOSED pgs=1622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.763+0000 7f3039bfa640 1 -- 172.21.15.132:0/744606707 >> 172.21.15.132:0/744606707 conn(0x7f303406d7c0 msgr2=0x7f303406dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.763+0000 7f3039bfa640 1 -- 172.21.15.132:0/744606707 shutdown_connections 2023-12-20T04:51:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.763+0000 7f3039bfa640 1 -- 172.21.15.132:0/744606707 wait complete. 2023-12-20T04:51:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.764+0000 7f3039bfa640 1 Processor -- start 2023-12-20T04:51:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.764+0000 7f3039bfa640 1 -- start start 2023-12-20T04:51:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.765+0000 7f3039bfa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30340d0370 0x7f30340acce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.765+0000 7f3039bfa640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f303415d100 0x7f3034149fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.765+0000 7f3039bfa640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3034161850 0x7f303406b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.765+0000 7f3039bfa640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340b39f0 con 0x7f30340d0370 2023-12-20T04:51:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.765+0000 7f3039bfa640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30340ad220 con 0x7f303415d100 2023-12-20T04:51:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.765+0000 7f3039bfa640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30340b3c00 con 0x7f3034161850 2023-12-20T04:51:41.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.765+0000 7f30337fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30340d0370 0x7f30340acce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:41.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.765+0000 7f30337fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30340d0370 0x7f30340acce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52160/0 (socket says 172.21.15.132:52160) 2023-12-20T04:51:41.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.765+0000 7f30337fe640 1 -- 172.21.15.132:0/2090126719 learned_addr learned my addr 172.21.15.132:0/2090126719 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:41.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.765+0000 7f3032ffd640 1 --2- 172.21.15.132:0/2090126719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f303415d100 0x7f3034149fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:41.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.765+0000 7f30337fe640 1 -- 172.21.15.132:0/2090126719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3034161850 msgr2=0x7f303406b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:41.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.765+0000 7f30337fe640 1 --2- 172.21.15.132:0/2090126719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3034161850 0x7f303406b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.765+0000 7f30337fe640 1 -- 172.21.15.132:0/2090126719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f303415d100 msgr2=0x7f3034149fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:41.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.765+0000 7f30337fe640 1 --2- 172.21.15.132:0/2090126719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f303415d100 0x7f3034149fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.765+0000 7f30337fe640 1 -- 172.21.15.132:0/2090126719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30240094d0 con 0x7f30340d0370 2023-12-20T04:51:41.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.765+0000 7f3032ffd640 1 --2- 172.21.15.132:0/2090126719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f303415d100 0x7f3034149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:41.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.766+0000 7f30337fe640 1 --2- 172.21.15.132:0/2090126719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30340d0370 0x7f30340acce0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f3024000c00 tx=0x7f30240046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:41.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.766+0000 7f301bfff640 1 -- 172.21.15.132:0/2090126719 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f302403abe0 con 0x7f30340d0370 2023-12-20T04:51:41.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.766+0000 7f301bfff640 1 -- 172.21.15.132:0/2090126719 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f302403ad40 con 0x7f30340d0370 2023-12-20T04:51:41.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.766+0000 7f3039bfa640 1 -- 172.21.15.132:0/2090126719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30340b3ee0 con 0x7f30340d0370 2023-12-20T04:51:41.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.766+0000 7f301bfff640 1 -- 172.21.15.132:0/2090126719 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3024044610 con 0x7f30340d0370 2023-12-20T04:51:41.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.766+0000 7f3039bfa640 1 -- 172.21.15.132:0/2090126719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30340b44a0 con 0x7f30340d0370 2023-12-20T04:51:41.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.767+0000 7f3039bfa640 1 -- 172.21.15.132:0/2090126719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f303404e840 con 0x7f30340d0370 2023-12-20T04:51:41.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.767+0000 7f301bfff640 1 -- 172.21.15.132:0/2090126719 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f302404d450 con 0x7f30340d0370 2023-12-20T04:51:41.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.767+0000 7f301bfff640 1 --2- 172.21.15.132:0/2090126719 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f302006a460 0x7f302006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:41.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.768+0000 7f301bfff640 1 -- 172.21.15.132:0/2090126719 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(160..160 src has 1..160) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f302402d040 con 0x7f30340d0370 2023-12-20T04:51:41.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.768+0000 7f3032ffd640 1 --2- 172.21.15.132:0/2090126719 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f302006a460 0x7f302006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:41.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.768+0000 7f3032ffd640 1 --2- 172.21.15.132:0/2090126719 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f302006a460 0x7f302006c920 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3028006fd0 tx=0x7f3028008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:41.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.772+0000 7f301bfff640 1 -- 172.21.15.132:0/2090126719 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3024076550 con 0x7f30340d0370 2023-12-20T04:51:41.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.973+0000 7f3039bfa640 1 -- 172.21.15.132:0/2090126719 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f30340b6d50 con 0x7f30340d0370 2023-12-20T04:51:41.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.974+0000 7f301bfff640 1 -- 172.21.15.132:0/2090126719 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 59 v59) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f3024035070 con 0x7f30340d0370 2023-12-20T04:51:41.976 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:41.976 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":59,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6437,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/756703470","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":756703470},{"type":"v1","addr":"172.21.15.187:6834","nonce":756703470}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":6440,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2177183802","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2177183802},{"type":"v1","addr":"172.21.15.187:6835","nonce":2177183802}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":8337,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/390345313","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":390345313},{"type":"v1","addr":"172.21.15.132:6837","nonce":390345313}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":54},{"gid":8646,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2596602311","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2596602311},{"type":"v1","addr":"172.21.15.132:6836","nonce":2596602311}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":59}],"filesystems":[]} 2023-12-20T04:51:41.976 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 59 2023-12-20T04:51:41.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.976+0000 7f3039bfa640 1 -- 172.21.15.132:0/2090126719 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f302006a460 msgr2=0x7f302006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:41.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.976+0000 7f3039bfa640 1 --2- 172.21.15.132:0/2090126719 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f302006a460 0x7f302006c920 secure :-1 s=READY pgs=682 cs=0 l=1 rev1=1 crypto rx=0x7f3028006fd0 tx=0x7f3028008040 comp rx=0 tx=0).stop 2023-12-20T04:51:41.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.976+0000 7f3039bfa640 1 -- 172.21.15.132:0/2090126719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30340d0370 msgr2=0x7f30340acce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:41.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.976+0000 7f3039bfa640 1 --2- 172.21.15.132:0/2090126719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30340d0370 0x7f30340acce0 secure :-1 s=READY pgs=1623 cs=0 l=1 rev1=1 crypto rx=0x7f3024000c00 tx=0x7f30240046c0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.976+0000 7f3039bfa640 1 -- 172.21.15.132:0/2090126719 shutdown_connections 2023-12-20T04:51:41.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.976+0000 7f3039bfa640 1 --2- 172.21.15.132:0/2090126719 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f302006a460 0x7f302006c920 unknown :-1 s=CLOSED pgs=682 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.976+0000 7f3039bfa640 1 --2- 172.21.15.132:0/2090126719 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3034161850 0x7f303406b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.976+0000 7f3039bfa640 1 --2- 172.21.15.132:0/2090126719 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f303415d100 0x7f3034149fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.976+0000 7f3039bfa640 1 --2- 172.21.15.132:0/2090126719 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f30340d0370 0x7f30340acce0 unknown :-1 s=CLOSED pgs=1623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:41.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.976+0000 7f3039bfa640 1 -- 172.21.15.132:0/2090126719 >> 172.21.15.132:0/2090126719 conn(0x7f303406d7c0 msgr2=0x7f303406ad40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:41.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.976+0000 7f3039bfa640 1 -- 172.21.15.132:0/2090126719 shutdown_connections 2023-12-20T04:51:41.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:41.976+0000 7f3039bfa640 1 -- 172.21.15.132:0/2090126719 wait complete. 2023-12-20T04:51:41.989 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-20T04:51:41.989 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-20T04:51:41.989 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-20T04:51:41.989 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:51:41.990 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-20T04:51:41.990 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-20T04:51:41.990 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-20T04:51:41.990 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:51:41.990 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-20T04:51:41.990 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-20T04:51:41.990 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-20T04:51:41.991 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:51:41.991 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-20T04:51:41.991 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-20T04:51:41.991 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-20T04:51:41.991 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:51:41.998 INFO:tasks.ceph.mds.a:Stopped 2023-12-20T04:51:41.999 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-20T04:51:41.999 INFO:tasks.ceph.mds.c:Stopped 2023-12-20T04:51:42.000 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-20T04:51:42.002 INFO:tasks.ceph.mds.b:Stopped 2023-12-20T04:51:42.003 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-20T04:51:42.003 INFO:tasks.ceph.mds.d:Stopped 2023-12-20T04:51:42.003 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-20T04:51:42.041 INFO:tasks.ceph.mds.a:Started 2023-12-20T04:51:42.041 DEBUG:teuthology.parallel:result is None 2023-12-20T04:51:42.042 INFO:tasks.ceph.mds.c:Started 2023-12-20T04:51:42.042 DEBUG:teuthology.parallel:result is None 2023-12-20T04:51:42.045 INFO:tasks.ceph.mds.b:Started 2023-12-20T04:51:42.045 DEBUG:teuthology.parallel:result is None 2023-12-20T04:51:42.046 INFO:tasks.ceph.mds.d:Started 2023-12-20T04:51:42.046 DEBUG:teuthology.parallel:result is None 2023-12-20T04:51:42.046 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-20T04:51:42.117 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-12-20T04:51:42.117 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-12-20T04:51:42.127 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-12-20T04:51:42.128 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-12-20T04:51:42.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.151+0000 7f80bdcec640 1 Processor -- start 2023-12-20T04:51:42.154 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.151+0000 7f80bdcec640 1 -- start start 2023-12-20T04:51:42.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.152+0000 7f80bdcec640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f80b8143700 0x7f80b80704f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:42.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.152+0000 7f80bdcec640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80b815e1c0 0x7f80b80cb000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:42.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.152+0000 7f80bdcec640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f80b8143ae0 con 0x7f80b8070a30 2023-12-20T04:51:42.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.152+0000 7f80bdcec640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f80b8070ee0 con 0x7f80b8143700 2023-12-20T04:51:42.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.152+0000 7f80bdcec640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b815e7e0 con 0x7f80b815e1c0 2023-12-20T04:51:42.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.152+0000 7f80b7fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80b815e1c0 0x7f80b80cb000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:42.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.152+0000 7f80b77fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f80b8143700 0x7f80b80704f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:42.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.152+0000 7f80b6ffd640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f80b8070a30 0x7f80b815dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:33380/0 (socket says 172.21.15.132:33380) 2023-12-20T04:51:42.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.152+0000 7f80b7fff640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80b815e1c0 0x7f80b80cb000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:49042/0 (socket says 172.21.15.132:49042) 2023-12-20T04:51:42.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.152+0000 7f80b6ffd640 1 -- 172.21.15.132:0/616041145 learned_addr learned my addr 172.21.15.132:0/616041145 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:42.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.153+0000 7f80b67fc640 1 -- 172.21.15.132:0/616041145 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2407124027 0 0) 0x7f80b8143ae0 con 0x7f80b8070a30 2023-12-20T04:51:42.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.153+0000 7f80b7fff640 1 -- 172.21.15.132:0/616041145 >> v2:172.21.15.187:3300/0 conn(0x7f80b8143700 msgr2=0x7f80b80704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:42.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.153+0000 7f80b7fff640 1 --2- 172.21.15.132:0/616041145 >> v2:172.21.15.187:3300/0 conn(0x7f80b8143700 0x7f80b80704f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:42.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.153+0000 7f80b7fff640 1 -- 172.21.15.132:0/616041145 >> v1:172.21.15.187:6789/0 conn(0x7f80b8070a30 legacy=0x7f80b815dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:42.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.153+0000 7f80b7fff640 1 -- 172.21.15.132:0/616041145 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b80c4a30 con 0x7f80b815e1c0 2023-12-20T04:51:42.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.153+0000 7f80b7fff640 1 --2- 172.21.15.132:0/616041145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80b815e1c0 0x7f80b80cb000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009d90 tx=0x7f80b002bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=e2a473e9aaddb89c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:42.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.154+0000 7f80b67fc640 1 -- 172.21.15.132:0/616041145 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b002cc50 con 0x7f80b815e1c0 2023-12-20T04:51:42.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.154+0000 7f80b67fc640 1 -- 172.21.15.132:0/616041145 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80b002cdb0 con 0x7f80b815e1c0 2023-12-20T04:51:42.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.154+0000 7f80b67fc640 1 -- 172.21.15.132:0/616041145 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80b0034660 con 0x7f80b815e1c0 2023-12-20T04:51:42.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.154+0000 7f80bdcec640 1 -- 172.21.15.132:0/616041145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80b815e1c0 msgr2=0x7f80b80cb000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.154+0000 7f80bdcec640 1 --2- 172.21.15.132:0/616041145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80b815e1c0 0x7f80b80cb000 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f80b0009d90 tx=0x7f80b002bea0 comp rx=0 tx=0).stop 2023-12-20T04:51:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.154+0000 7f80bdcec640 1 -- 172.21.15.132:0/616041145 shutdown_connections 2023-12-20T04:51:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.154+0000 7f80bdcec640 1 --2- 172.21.15.132:0/616041145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80b815e1c0 0x7f80b80cb000 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.154+0000 7f80bdcec640 1 --2- 172.21.15.132:0/616041145 >> v2:172.21.15.187:3300/0 conn(0x7f80b8143700 0x7f80b80704f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.154+0000 7f80bdcec640 1 -- 172.21.15.132:0/616041145 >> 172.21.15.132:0/616041145 conn(0x7f80b80cfb10 msgr2=0x7f80b80cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.154+0000 7f80bdcec640 1 -- 172.21.15.132:0/616041145 shutdown_connections 2023-12-20T04:51:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.154+0000 7f80bdcec640 1 -- 172.21.15.132:0/616041145 wait complete. 2023-12-20T04:51:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.155+0000 7f80bdcec640 1 Processor -- start 2023-12-20T04:51:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.156+0000 7f80bdcec640 1 -- start start 2023-12-20T04:51:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.156+0000 7f80bdcec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80b8070a30 0x7f80b815b5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.156+0000 7f80bdcec640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80b8143700 0x7f80b813d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.156+0000 7f80bdcec640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80b815e1c0 0x7f80b815cc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:42.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.156+0000 7f80bdcec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b815bbb0 con 0x7f80b8070a30 2023-12-20T04:51:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.156+0000 7f80b77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80b8070a30 0x7f80b815b5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.156+0000 7f80b77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80b8070a30 0x7f80b815b5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52190/0 (socket says 172.21.15.132:52190) 2023-12-20T04:51:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.156+0000 7f80b77fe640 1 -- 172.21.15.132:0/637950736 learned_addr learned my addr 172.21.15.132:0/637950736 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.156+0000 7f80bdcec640 1 -- 172.21.15.132:0/637950736 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f80b815be90 con 0x7f80b8143700 2023-12-20T04:51:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.156+0000 7f80bdcec640 1 -- 172.21.15.132:0/637950736 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f80b815c170 con 0x7f80b815e1c0 2023-12-20T04:51:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.157+0000 7f80b6ffd640 1 --2- 172.21.15.132:0/637950736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80b8143700 0x7f80b813d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.157+0000 7f80b7fff640 1 --2- 172.21.15.132:0/637950736 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80b815e1c0 0x7f80b815cc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.157+0000 7f80b6ffd640 1 -- 172.21.15.132:0/637950736 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80b815e1c0 msgr2=0x7f80b815cc50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.157+0000 7f80b6ffd640 1 --2- 172.21.15.132:0/637950736 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80b815e1c0 0x7f80b815cc50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.157+0000 7f80b6ffd640 1 -- 172.21.15.132:0/637950736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80b8070a30 msgr2=0x7f80b815b5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.157+0000 7f80b6ffd640 1 --2- 172.21.15.132:0/637950736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80b8070a30 0x7f80b815b5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.157+0000 7f80b6ffd640 1 -- 172.21.15.132:0/637950736 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80b0009a70 con 0x7f80b8143700 2023-12-20T04:51:42.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.157+0000 7f80b6ffd640 1 --2- 172.21.15.132:0/637950736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80b8143700 0x7f80b813d9f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00c410 tx=0x7f80ac00c8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.157+0000 7f809ffff640 1 -- 172.21.15.132:0/637950736 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac0074e0 con 0x7f80b8143700 2023-12-20T04:51:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.157+0000 7f809ffff640 1 -- 172.21.15.132:0/637950736 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f80ac007640 con 0x7f80b8143700 2023-12-20T04:51:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.157+0000 7f809ffff640 1 -- 172.21.15.132:0/637950736 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f80ac004a20 con 0x7f80b8143700 2023-12-20T04:51:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.158+0000 7f80bdcec640 1 -- 172.21.15.132:0/637950736 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f80b815c450 con 0x7f80b8143700 2023-12-20T04:51:42.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.158+0000 7f80bdcec640 1 -- 172.21.15.132:0/637950736 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f80b8159c00 con 0x7f80b8143700 2023-12-20T04:51:42.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.159+0000 7f80bdcec640 1 -- 172.21.15.132:0/637950736 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f80b804e840 con 0x7f80b8143700 2023-12-20T04:51:42.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.159+0000 7f809ffff640 1 -- 172.21.15.132:0/637950736 <== mon.1 v2:172.21.15.187:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f80ac004b80 con 0x7f80b8143700 2023-12-20T04:51:42.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.159+0000 7f809ffff640 1 --2- 172.21.15.132:0/637950736 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f80a406a430 0x7f80a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:42.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.159+0000 7f809ffff640 1 -- 172.21.15.132:0/637950736 <== mon.1 v2:172.21.15.187:3300/0 5 ==== osd_map(164..164 src has 1..164) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f80ac0881f0 con 0x7f80b8143700 2023-12-20T04:51:42.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.159+0000 7f80b77fe640 1 --2- 172.21.15.132:0/637950736 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f80a406a430 0x7f80a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:42.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.160+0000 7f80b77fe640 1 --2- 172.21.15.132:0/637950736 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f80a406a430 0x7f80a406c8f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009c00 tx=0x7f80a8009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:42.166 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.164+0000 7f809ffff640 1 -- 172.21.15.132:0/637950736 <== mon.1 v2:172.21.15.187:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f80ac053ce0 con 0x7f80b8143700 2023-12-20T04:51:42.342 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:42.341+0000 7f80bdcec640 1 -- 172.21.15.132:0/637950736 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f80b815bfd0 con 0x7f80b8143700 2023-12-20T04:51:43.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.157+0000 7f809ffff640 1 -- 172.21.15.132:0/637950736 <== mon.1 v2:172.21.15.187:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v165) v1 ==== 97+0+0 (secure 0 0 0) 0x7f80b815bfd0 con 0x7f80b8143700 2023-12-20T04:51:43.160 INFO:teuthology.orchestra.run.smithi132.stderr: removed all blocklist entries 2023-12-20T04:51:43.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.160+0000 7f80bdcec640 1 -- 172.21.15.132:0/637950736 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f80a406a430 msgr2=0x7f80a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:43.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.160+0000 7f80bdcec640 1 --2- 172.21.15.132:0/637950736 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f80a406a430 0x7f80a406c8f0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f80a8009c00 tx=0x7f80a8009190 comp rx=0 tx=0).stop 2023-12-20T04:51:43.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.160+0000 7f80bdcec640 1 -- 172.21.15.132:0/637950736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80b8143700 msgr2=0x7f80b813d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:43.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.160+0000 7f80bdcec640 1 --2- 172.21.15.132:0/637950736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80b8143700 0x7f80b813d9f0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f80ac00c410 tx=0x7f80ac00c8d0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.160+0000 7f80bdcec640 1 -- 172.21.15.132:0/637950736 shutdown_connections 2023-12-20T04:51:43.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.160+0000 7f80bdcec640 1 --2- 172.21.15.132:0/637950736 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f80a406a430 0x7f80a406c8f0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.160+0000 7f80bdcec640 1 --2- 172.21.15.132:0/637950736 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f80b815e1c0 0x7f80b815cc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.160+0000 7f80bdcec640 1 --2- 172.21.15.132:0/637950736 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f80b8143700 0x7f80b813d9f0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.160+0000 7f80bdcec640 1 --2- 172.21.15.132:0/637950736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f80b8070a30 0x7f80b815b5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.160+0000 7f80bdcec640 1 -- 172.21.15.132:0/637950736 >> 172.21.15.132:0/637950736 conn(0x7f80b80cfb10 msgr2=0x7f80b806e7d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:43.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.160+0000 7f80bdcec640 1 -- 172.21.15.132:0/637950736 shutdown_connections 2023-12-20T04:51:43.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.160+0000 7f80bdcec640 1 -- 172.21.15.132:0/637950736 wait complete. 2023-12-20T04:51:43.175 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-20T04:51:43.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.275+0000 7f7650009640 1 Processor -- start 2023-12-20T04:51:43.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.276+0000 7f7650009640 1 -- start start 2023-12-20T04:51:43.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.276+0000 7f7650009640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7648160450 0x7f7648160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.276+0000 7f7650009640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76481611b0 0x7f76480b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.276+0000 7f7650009640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76480b4ec0 0x7f764806a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.276+0000 7f7650009640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76480b5350 con 0x7f76480b4ec0 2023-12-20T04:51:43.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.276+0000 7f7650009640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76480b5ec0 con 0x7f7648160450 2023-12-20T04:51:43.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.276+0000 7f7650009640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76481617e0 con 0x7f76481611b0 2023-12-20T04:51:43.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.277+0000 7f764e5a6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76480b4ec0 0x7f764806a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.277+0000 7f764e5a6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76480b4ec0 0x7f764806a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52204/0 (socket says 172.21.15.132:52204) 2023-12-20T04:51:43.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.277+0000 7f764e5a6640 1 -- 172.21.15.132:0/3401322783 learned_addr learned my addr 172.21.15.132:0/3401322783 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:43.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.277+0000 7f764e5a6640 1 -- 172.21.15.132:0/3401322783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76481611b0 msgr2=0x7f76480b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:43.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.277+0000 7f764e5a6640 1 --2- 172.21.15.132:0/3401322783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76481611b0 0x7f76480b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.277+0000 7f764e5a6640 1 -- 172.21.15.132:0/3401322783 >> v2:172.21.15.187:3300/0 conn(0x7f7648160450 msgr2=0x7f7648160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:43.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.277+0000 7f764dda5640 1 --2- 172.21.15.132:0/3401322783 >> v2:172.21.15.187:3300/0 conn(0x7f7648160450 0x7f7648160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.277+0000 7f764e5a6640 1 --2- 172.21.15.132:0/3401322783 >> v2:172.21.15.187:3300/0 conn(0x7f7648160450 0x7f7648160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.277+0000 7f764e5a6640 1 -- 172.21.15.132:0/3401322783 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76480d0fc0 con 0x7f76480b4ec0 2023-12-20T04:51:43.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.277+0000 7f764dda5640 1 --2- 172.21.15.132:0/3401322783 >> v2:172.21.15.187:3300/0 conn(0x7f7648160450 0x7f7648160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:43.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.278+0000 7f764e5a6640 1 --2- 172.21.15.132:0/3401322783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76480b4ec0 0x7f764806a1a0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f764808b150 tx=0x7f764002bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28bcab64524c3e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:43.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.278+0000 7f764cda3640 1 -- 172.21.15.132:0/3401322783 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764002cb00 con 0x7f76480b4ec0 2023-12-20T04:51:43.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.278+0000 7f764cda3640 1 -- 172.21.15.132:0/3401322783 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764002cc60 con 0x7f76480b4ec0 2023-12-20T04:51:43.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.278+0000 7f764cda3640 1 -- 172.21.15.132:0/3401322783 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76400343f0 con 0x7f76480b4ec0 2023-12-20T04:51:43.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.278+0000 7f7650009640 1 -- 172.21.15.132:0/3401322783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76480b4ec0 msgr2=0x7f764806a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:43.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.278+0000 7f7650009640 1 --2- 172.21.15.132:0/3401322783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76480b4ec0 0x7f764806a1a0 secure :-1 s=READY pgs=1629 cs=0 l=1 rev1=1 crypto rx=0x7f764808b150 tx=0x7f764002bf60 comp rx=0 tx=0).stop 2023-12-20T04:51:43.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.278+0000 7f7650009640 1 -- 172.21.15.132:0/3401322783 shutdown_connections 2023-12-20T04:51:43.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.278+0000 7f7650009640 1 --2- 172.21.15.132:0/3401322783 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76480b4ec0 0x7f764806a1a0 unknown :-1 s=CLOSED pgs=1629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.278+0000 7f7650009640 1 --2- 172.21.15.132:0/3401322783 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76481611b0 0x7f76480b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.278+0000 7f7650009640 1 --2- 172.21.15.132:0/3401322783 >> v2:172.21.15.187:3300/0 conn(0x7f7648160450 0x7f7648160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.278+0000 7f7650009640 1 -- 172.21.15.132:0/3401322783 >> 172.21.15.132:0/3401322783 conn(0x7f76480cf980 msgr2=0x7f76480cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:43.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.278+0000 7f7650009640 1 -- 172.21.15.132:0/3401322783 shutdown_connections 2023-12-20T04:51:43.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.278+0000 7f7650009640 1 -- 172.21.15.132:0/3401322783 wait complete. 2023-12-20T04:51:43.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.279+0000 7f7650009640 1 Processor -- start 2023-12-20T04:51:43.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.280+0000 7f7650009640 1 -- start start 2023-12-20T04:51:43.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.280+0000 7f7650009640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76480b4ec0 0x7f76480cb770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.280+0000 7f7650009640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7648160450 0x7f7648151af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.280+0000 7f7650009640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76481611b0 0x7f764815ba50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.280+0000 7f7650009640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f764815cf60 con 0x7f76481611b0 2023-12-20T04:51:43.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.280+0000 7f7650009640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7648152030 con 0x7f7648160450 2023-12-20T04:51:43.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.280+0000 7f7650009640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f764815c350 con 0x7f76480b4ec0 2023-12-20T04:51:43.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.280+0000 7f764e5a6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76481611b0 0x7f764815ba50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.280+0000 7f764e5a6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76481611b0 0x7f764815ba50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52214/0 (socket says 172.21.15.132:52214) 2023-12-20T04:51:43.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.280+0000 7f764e5a6640 1 -- 172.21.15.132:0/2728932508 learned_addr learned my addr 172.21.15.132:0/2728932508 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:43.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.280+0000 7f764dda5640 1 --2- 172.21.15.132:0/2728932508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76480b4ec0 0x7f76480cb770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.280+0000 7f764d5a4640 1 --2- 172.21.15.132:0/2728932508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7648160450 0x7f7648151af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.281+0000 7f764e5a6640 1 -- 172.21.15.132:0/2728932508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76480b4ec0 msgr2=0x7f76480cb770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:43.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.281+0000 7f764e5a6640 1 --2- 172.21.15.132:0/2728932508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76480b4ec0 0x7f76480cb770 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.281+0000 7f764e5a6640 1 -- 172.21.15.132:0/2728932508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7648160450 msgr2=0x7f7648151af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:43.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.281+0000 7f764e5a6640 1 --2- 172.21.15.132:0/2728932508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7648160450 0x7f7648151af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.281+0000 7f764e5a6640 1 -- 172.21.15.132:0/2728932508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7640009b30 con 0x7f76481611b0 2023-12-20T04:51:43.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.281+0000 7f764e5a6640 1 --2- 172.21.15.132:0/2728932508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76481611b0 0x7f764815ba50 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f7640009f40 tx=0x7f7640004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:43.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.281+0000 7f763e7fc640 1 -- 172.21.15.132:0/2728932508 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764003e450 con 0x7f76481611b0 2023-12-20T04:51:43.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.281+0000 7f763e7fc640 1 -- 172.21.15.132:0/2728932508 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f764003e5b0 con 0x7f76481611b0 2023-12-20T04:51:43.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.281+0000 7f763e7fc640 1 -- 172.21.15.132:0/2728932508 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f764003e960 con 0x7f76481611b0 2023-12-20T04:51:43.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.281+0000 7f7650009640 1 -- 172.21.15.132:0/2728932508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f764815c630 con 0x7f76481611b0 2023-12-20T04:51:43.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.281+0000 7f7650009640 1 -- 172.21.15.132:0/2728932508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f764815cbf0 con 0x7f76481611b0 2023-12-20T04:51:43.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.282+0000 7f7650009640 1 -- 172.21.15.132:0/2728932508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f764815cd80 con 0x7f76481611b0 2023-12-20T04:51:43.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.282+0000 7f763e7fc640 1 -- 172.21.15.132:0/2728932508 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f764003eac0 con 0x7f76481611b0 2023-12-20T04:51:43.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.283+0000 7f763e7fc640 1 --2- 172.21.15.132:0/2728932508 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f762c06a430 0x7f762c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.283+0000 7f763e7fc640 1 -- 172.21.15.132:0/2728932508 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f76400ab450 con 0x7f76481611b0 2023-12-20T04:51:43.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.283+0000 7f764dda5640 1 --2- 172.21.15.132:0/2728932508 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f762c06a430 0x7f762c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.283+0000 7f764dda5640 1 --2- 172.21.15.132:0/2728932508 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f762c06a430 0x7f762c06c8f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f763800ab60 tx=0x7f7638008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:43.292 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.287+0000 7f763e7fc640 1 -- 172.21.15.132:0/2728932508 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7640076ed0 con 0x7f76481611b0 2023-12-20T04:51:43.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.516+0000 7f7650009640 1 -- 172.21.15.132:0/2728932508 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7f764804e840 con 0x7f76481611b0 2023-12-20T04:51:43.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.517+0000 7f763e7fc640 1 -- 172.21.15.132:0/2728932508 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v21) v1 ==== 80+0+5304 (secure 0 0 0) 0x7f7640043090 con 0x7f76481611b0 2023-12-20T04:51:43.549 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:43.549 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:51:43.550 INFO:teuthology.orchestra.run.smithi132.stdout: "auth_dump": [ 2023-12-20T04:51:43.550 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.550 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.a", 2023-12-20T04:51:43.550 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlbTdZOxAAUDz0Eno9DYvrYM1xg5jG/A==", 2023-12-20T04:51:43.550 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.550 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:51:43.550 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:51:43.550 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:51:43.550 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:51:43.550 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.550 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.550 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.550 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.b", 2023-12-20T04:51:43.550 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl43gVDBAA1qJwUU+Ii4BalGf3NtJnGA==", 2023-12-20T04:51:43.550 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.551 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:51:43.551 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:51:43.551 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:51:43.551 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:51:43.551 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.551 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.551 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.551 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.c", 2023-12-20T04:51:43.551 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlaSUVBxAA7HN3dSo9xfvkjvc6bwMxWg==", 2023-12-20T04:51:43.551 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.551 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:51:43.551 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:51:43.551 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:51:43.551 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:51:43.551 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.552 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.d", 2023-12-20T04:51:43.552 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl1DR4ExAANNOyGlf1Ayre/xZEb9JHYg==", 2023-12-20T04:51:43.552 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.552 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:51:43.552 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:51:43.552 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:51:43.552 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:51:43.552 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.552 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.0", 2023-12-20T04:51:43.552 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCucIJlwZfxORAAiT2g1poLu3OkmoyxNJQc8Q==", 2023-12-20T04:51:43.553 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.553 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:51:43.553 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:51:43.553 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:51:43.553 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.553 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.553 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.1", 2023-12-20T04:51:43.553 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlejHYBRAAKurKpW5gyOAQ+E4Su4xMSQ==", 2023-12-20T04:51:43.553 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.553 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:51:43.553 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:51:43.553 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:51:43.553 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.554 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.554 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.554 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.2", 2023-12-20T04:51:43.554 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlyfz8DBAA9a6tUjHF8IRIKeldwVFMcw==", 2023-12-20T04:51:43.554 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.554 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:51:43.554 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:51:43.554 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:51:43.554 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.554 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.554 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.554 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.3", 2023-12-20T04:51:43.554 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJllFEeFBAA6URrqUjQqHsrI5+qEBVs3g==", 2023-12-20T04:51:43.554 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.554 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:51:43.555 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:51:43.555 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:51:43.555 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.555 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.555 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.555 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.4", 2023-12-20T04:51:43.555 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlvGqcJhAAgn2wuSTwLT+TOHoE4iaVSg==", 2023-12-20T04:51:43.555 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.555 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:51:43.555 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:51:43.555 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:51:43.555 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.555 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.555 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.555 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.5", 2023-12-20T04:51:43.555 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlWrkTLhAA2KlpxTFPaiXLCvmURpg5rw==", 2023-12-20T04:51:43.556 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.556 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:51:43.556 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:51:43.556 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:51:43.556 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.556 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.556 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.556 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.6", 2023-12-20T04:51:43.556 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlnOQfNRAA//EVx0BZYQd7ovK2tFhgfA==", 2023-12-20T04:51:43.556 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.556 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:51:43.556 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:51:43.556 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:51:43.556 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.557 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.557 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.557 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.7", 2023-12-20T04:51:43.557 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCzcIJl4nfDABAAtBdl2qkzKcqhmzsukC7G5w==", 2023-12-20T04:51:43.557 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.557 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:51:43.557 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:51:43.557 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:51:43.557 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.557 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.557 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.557 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.0", 2023-12-20T04:51:43.557 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlm/nGFxAA6zndayizc50Il7l74BxkgQ==", 2023-12-20T04:51:43.557 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.558 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:51:43.558 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow r", 2023-12-20T04:51:43.558 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-20T04:51:43.558 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.558 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.558 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.558 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.1", 2023-12-20T04:51:43.558 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlppb6IBAArqCoSlSE5coxkj4+XjPoWg==", 2023-12-20T04:51:43.558 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.558 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:51:43.558 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:51:43.558 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:51:43.558 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:51:43.558 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.558 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.558 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.559 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.2", 2023-12-20T04:51:43.559 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlMgWUHRAAqSdmRGx+9J+3dO7ntaApdw==", 2023-12-20T04:51:43.559 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.559 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:51:43.559 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:51:43.559 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:51:43.559 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:51:43.559 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.559 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.559 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.559 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.3", 2023-12-20T04:51:43.559 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlcIe3JhAAjv9KfknxwySJURWdePN7vw==", 2023-12-20T04:51:43.559 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.559 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:51:43.559 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:51:43.559 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:51:43.560 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:51:43.560 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.560 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.560 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.560 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.admin", 2023-12-20T04:51:43.560 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJljrTdHhAAsAlaFaKctSv71GrifKs6zA==", 2023-12-20T04:51:43.560 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.560 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:51:43.560 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:51:43.560 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:51:43.560 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:51:43.560 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.560 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.560 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.561 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.x", 2023-12-20T04:51:43.561 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJl+KnxNxAAM/b3mubTMYlB9QUbfcPW8g==", 2023-12-20T04:51:43.561 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.561 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:51:43.561 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:51:43.561 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:51:43.561 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.561 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:43.561 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:43.561 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.y", 2023-12-20T04:51:43.561 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlMyAMNBAAWpoBNevgGIkZ7zKEdKn3Ag==", 2023-12-20T04:51:43.561 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:51:43.561 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:51:43.561 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:51:43.562 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:51:43.562 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.562 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:43.562 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:51:43.562 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:51:43.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.518+0000 7f7650009640 1 -- 172.21.15.132:0/2728932508 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f762c06a430 msgr2=0x7f762c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:43.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.518+0000 7f7650009640 1 --2- 172.21.15.132:0/2728932508 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f762c06a430 0x7f762c06c8f0 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f763800ab60 tx=0x7f7638008040 comp rx=0 tx=0).stop 2023-12-20T04:51:43.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.518+0000 7f7650009640 1 -- 172.21.15.132:0/2728932508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76481611b0 msgr2=0x7f764815ba50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:43.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.518+0000 7f7650009640 1 --2- 172.21.15.132:0/2728932508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76481611b0 0x7f764815ba50 secure :-1 s=READY pgs=1630 cs=0 l=1 rev1=1 crypto rx=0x7f7640009f40 tx=0x7f7640004a40 comp rx=0 tx=0).stop 2023-12-20T04:51:43.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.518+0000 7f7650009640 1 -- 172.21.15.132:0/2728932508 shutdown_connections 2023-12-20T04:51:43.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.518+0000 7f7650009640 1 --2- 172.21.15.132:0/2728932508 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f762c06a430 0x7f762c06c8f0 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.518+0000 7f7650009640 1 --2- 172.21.15.132:0/2728932508 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76481611b0 0x7f764815ba50 unknown :-1 s=CLOSED pgs=1630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.518+0000 7f7650009640 1 --2- 172.21.15.132:0/2728932508 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7648160450 0x7f7648151af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.518+0000 7f7650009640 1 --2- 172.21.15.132:0/2728932508 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76480b4ec0 0x7f76480cb770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.518+0000 7f7650009640 1 -- 172.21.15.132:0/2728932508 >> 172.21.15.132:0/2728932508 conn(0x7f76480cf980 msgr2=0x7f764815f400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:43.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.518+0000 7f7650009640 1 -- 172.21.15.132:0/2728932508 shutdown_connections 2023-12-20T04:51:43.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.519+0000 7f7650009640 1 -- 172.21.15.132:0/2728932508 wait complete. 2023-12-20T04:51:43.565 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:51:43.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.662+0000 7fa9e297e640 1 Processor -- start 2023-12-20T04:51:43.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.662+0000 7fa9e297e640 1 -- start start 2023-12-20T04:51:43.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.662+0000 7fa9e297e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa9dc0c92d0 0x7fa9dc0c96b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.662+0000 7fa9e297e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa9dc15a3a0 0x7fa9dc06c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.662+0000 7fa9e297e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa9dc15aa30 con 0x7fa9dc13cce0 2023-12-20T04:51:43.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.662+0000 7fa9e297e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc0c9bf0 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.662+0000 7fa9e297e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa9dc15a780 con 0x7fa9dc0c92d0 2023-12-20T04:51:43.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.663+0000 7fa9e0f1b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa9dc15a3a0 0x7fa9dc06c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.663+0000 7fa9e0f1b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa9dc15a3a0 0x7fa9dc06c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52228/0 (socket says 172.21.15.132:52228) 2023-12-20T04:51:43.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.663+0000 7fa9e0f1b640 1 -- 172.21.15.132:0/4197575409 learned_addr learned my addr 172.21.15.132:0/4197575409 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:43.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.663+0000 7fa9e0f1b640 1 -- 172.21.15.132:0/4197575409 >> v2:172.21.15.187:3300/0 conn(0x7fa9dc0c92d0 msgr2=0x7fa9dc0c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:43.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.663+0000 7fa9dbfff640 1 --2- 172.21.15.132:0/4197575409 >> v2:172.21.15.187:3300/0 conn(0x7fa9dc0c92d0 0x7fa9dc0c96b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.663+0000 7fa9e0f1b640 1 --2- 172.21.15.132:0/4197575409 >> v2:172.21.15.187:3300/0 conn(0x7fa9dc0c92d0 0x7fa9dc0c96b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.663+0000 7fa9e0f1b640 1 -- 172.21.15.132:0/4197575409 >> v1:172.21.15.187:6789/0 conn(0x7fa9dc13cce0 legacy=0x7fa9dc159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:43.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.663+0000 7fa9e0f1b640 1 -- 172.21.15.132:0/4197575409 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9dc06b260 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.663+0000 7fa9dbfff640 1 --2- 172.21.15.132:0/4197575409 >> v2:172.21.15.187:3300/0 conn(0x7fa9dc0c92d0 0x7fa9dc0c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:43.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.664+0000 7fa9e0f1b640 1 --2- 172.21.15.132:0/4197575409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9dc15a3a0 0x7fa9dc06c020 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc06ceb0 tx=0x7fa9d402be50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd65b8ce6cfc7a5e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:43.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.664+0000 7fa9daffd640 1 -- 172.21.15.132:0/4197575409 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d402c9f0 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.664+0000 7fa9daffd640 1 -- 172.21.15.132:0/4197575409 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d402cb50 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.664+0000 7fa9daffd640 1 -- 172.21.15.132:0/4197575409 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d40343f0 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.664+0000 7fa9e297e640 1 -- 172.21.15.132:0/4197575409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9dc15a3a0 msgr2=0x7fa9dc06c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:43.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.664+0000 7fa9e297e640 1 --2- 172.21.15.132:0/4197575409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9dc15a3a0 0x7fa9dc06c020 secure :-1 s=READY pgs=1631 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc06ceb0 tx=0x7fa9d402be50 comp rx=0 tx=0).stop 2023-12-20T04:51:43.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.664+0000 7fa9e297e640 1 -- 172.21.15.132:0/4197575409 shutdown_connections 2023-12-20T04:51:43.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.664+0000 7fa9e297e640 1 --2- 172.21.15.132:0/4197575409 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9dc15a3a0 0x7fa9dc06c020 unknown :-1 s=CLOSED pgs=1631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.664+0000 7fa9e297e640 1 --2- 172.21.15.132:0/4197575409 >> v2:172.21.15.187:3300/0 conn(0x7fa9dc0c92d0 0x7fa9dc0c96b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.664+0000 7fa9e297e640 1 -- 172.21.15.132:0/4197575409 >> 172.21.15.132:0/4197575409 conn(0x7fa9dc0ced10 msgr2=0x7fa9dc0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:43.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.664+0000 7fa9e297e640 1 -- 172.21.15.132:0/4197575409 shutdown_connections 2023-12-20T04:51:43.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.664+0000 7fa9e297e640 1 -- 172.21.15.132:0/4197575409 wait complete. 2023-12-20T04:51:43.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.666+0000 7fa9e297e640 1 Processor -- start 2023-12-20T04:51:43.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.666+0000 7fa9e297e640 1 -- start start 2023-12-20T04:51:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.666+0000 7fa9e297e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9dc0c92d0 0x7fa9dc1f0660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.666+0000 7fa9e297e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9dc13cce0 0x7fa9dc0c7090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.666+0000 7fa9e297e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9dc15a3a0 0x7fa9dc0c5d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.666+0000 7fa9e297e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc1f0ba0 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.666+0000 7fa9e297e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc0c8400 con 0x7fa9dc0c92d0 2023-12-20T04:51:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.666+0000 7fa9e297e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa9dc0c75d0 con 0x7fa9dc13cce0 2023-12-20T04:51:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.667+0000 7fa9e0f1b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9dc15a3a0 0x7fa9dc0c5d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.667+0000 7fa9e0f1b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9dc15a3a0 0x7fa9dc0c5d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52234/0 (socket says 172.21.15.132:52234) 2023-12-20T04:51:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.667+0000 7fa9e0f1b640 1 -- 172.21.15.132:0/1898127749 learned_addr learned my addr 172.21.15.132:0/1898127749 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.667+0000 7fa9dbfff640 1 --2- 172.21.15.132:0/1898127749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9dc0c92d0 0x7fa9dc1f0660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.667+0000 7fa9db7fe640 1 --2- 172.21.15.132:0/1898127749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9dc13cce0 0x7fa9dc0c7090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.667+0000 7fa9e0f1b640 1 -- 172.21.15.132:0/1898127749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9dc13cce0 msgr2=0x7fa9dc0c7090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.667+0000 7fa9e0f1b640 1 --2- 172.21.15.132:0/1898127749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9dc13cce0 0x7fa9dc0c7090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.667+0000 7fa9e0f1b640 1 -- 172.21.15.132:0/1898127749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9dc0c92d0 msgr2=0x7fa9dc1f0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.667+0000 7fa9e0f1b640 1 --2- 172.21.15.132:0/1898127749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9dc0c92d0 0x7fa9dc1f0660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.667+0000 7fa9e0f1b640 1 -- 172.21.15.132:0/1898127749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa9d4009b30 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.667+0000 7fa9e0f1b640 1 --2- 172.21.15.132:0/1898127749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9dc15a3a0 0x7fa9dc0c5d50 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4036040 tx=0x7fa9d4004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.667+0000 7fa9d8ff9640 1 -- 172.21.15.132:0/1898127749 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4047680 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.667+0000 7fa9d8ff9640 1 -- 172.21.15.132:0/1898127749 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa9d4040070 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.667+0000 7fa9e297e640 1 -- 172.21.15.132:0/1898127749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9dc0c7880 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.667+0000 7fa9d8ff9640 1 -- 172.21.15.132:0/1898127749 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa9d4047a40 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.667+0000 7fa9e297e640 1 -- 172.21.15.132:0/1898127749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa9dc0c7e40 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.668+0000 7fa9e297e640 1 -- 172.21.15.132:0/1898127749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa9dc04e840 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.669+0000 7fa9d8ff9640 1 -- 172.21.15.132:0/1898127749 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa9d403b450 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.669+0000 7fa9d8ff9640 1 --2- 172.21.15.132:0/1898127749 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa9c806a460 0x7fa9c806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.669+0000 7fa9d8ff9640 1 -- 172.21.15.132:0/1898127749 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fa9d4042070 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.672 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.669+0000 7fa9dbfff640 1 --2- 172.21.15.132:0/1898127749 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa9c806a460 0x7fa9c806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.669+0000 7fa9dbfff640 1 --2- 172.21.15.132:0/1898127749 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa9c806a460 0x7fa9c806c920 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc15a340 tx=0x7fa9cc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:43.675 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.673+0000 7fa9d8ff9640 1 -- 172.21.15.132:0/1898127749 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa9d40786e0 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.840+0000 7fa9e297e640 1 -- 172.21.15.132:0/1898127749 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fa9dc04e840 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.841+0000 7fa9d8ff9640 1 -- 172.21.15.132:0/1898127749 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v165) v1 ==== 74+0+12448 (secure 0 0 0) 0x7fa9d407bd00 con 0x7fa9dc15a3a0 2023-12-20T04:51:43.843 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:43.843 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":165,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:51:43.150679+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":19,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":155,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":151,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:51:43.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.843+0000 7fa9e297e640 1 -- 172.21.15.132:0/1898127749 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa9c806a460 msgr2=0x7fa9c806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:43.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.843+0000 7fa9e297e640 1 --2- 172.21.15.132:0/1898127749 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa9c806a460 0x7fa9c806c920 secure :-1 s=READY pgs=689 cs=0 l=1 rev1=1 crypto rx=0x7fa9dc15a340 tx=0x7fa9cc008040 comp rx=0 tx=0).stop 2023-12-20T04:51:43.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.843+0000 7fa9e297e640 1 -- 172.21.15.132:0/1898127749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9dc15a3a0 msgr2=0x7fa9dc0c5d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:43.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.843+0000 7fa9e297e640 1 --2- 172.21.15.132:0/1898127749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9dc15a3a0 0x7fa9dc0c5d50 secure :-1 s=READY pgs=1632 cs=0 l=1 rev1=1 crypto rx=0x7fa9d4036040 tx=0x7fa9d4004a40 comp rx=0 tx=0).stop 2023-12-20T04:51:43.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.843+0000 7fa9e297e640 1 -- 172.21.15.132:0/1898127749 shutdown_connections 2023-12-20T04:51:43.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.843+0000 7fa9e297e640 1 --2- 172.21.15.132:0/1898127749 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa9c806a460 0x7fa9c806c920 unknown :-1 s=CLOSED pgs=689 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.843+0000 7fa9e297e640 1 --2- 172.21.15.132:0/1898127749 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa9dc15a3a0 0x7fa9dc0c5d50 unknown :-1 s=CLOSED pgs=1632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.843+0000 7fa9e297e640 1 --2- 172.21.15.132:0/1898127749 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa9dc13cce0 0x7fa9dc0c7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.843+0000 7fa9e297e640 1 --2- 172.21.15.132:0/1898127749 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa9dc0c92d0 0x7fa9dc1f0660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.843+0000 7fa9e297e640 1 -- 172.21.15.132:0/1898127749 >> 172.21.15.132:0/1898127749 conn(0x7fa9dc0ced10 msgr2=0x7fa9dc153140 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:43.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.843+0000 7fa9e297e640 1 -- 172.21.15.132:0/1898127749 shutdown_connections 2023-12-20T04:51:43.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.843+0000 7fa9e297e640 1 -- 172.21.15.132:0/1898127749 wait complete. 2023-12-20T04:51:43.856 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:51:43.856 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:51:43.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.956+0000 7f34fdb1b640 1 Processor -- start 2023-12-20T04:51:43.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.957+0000 7f34fdb1b640 1 -- start start 2023-12-20T04:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.957+0000 7f34fdb1b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f34f815d300 0x7f34f80d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.957+0000 7f34fdb1b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f34f80d17d0 0x7f34f80cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.957+0000 7f34fdb1b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f34f80d2920 con 0x7f34f80cfcd0 2023-12-20T04:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.957+0000 7f34fdb1b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f80d00e0 con 0x7f34f815d300 2023-12-20T04:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.957+0000 7f34fdb1b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f34f80d1d10 con 0x7f34f80d17d0 2023-12-20T04:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.957+0000 7f34f77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f34f815d300 0x7f34f80d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.957+0000 7f34f77fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f34f815d300 0x7f34f80d1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52246/0 (socket says 172.21.15.132:52246) 2023-12-20T04:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.957+0000 7f34f7fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f34f80cfcd0 0x7f34f80b48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:42434/0 (socket says 172.21.15.132:42434) 2023-12-20T04:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.957+0000 7f34f77fe640 1 -- 172.21.15.132:0/1288577377 learned_addr learned my addr 172.21.15.132:0/1288577377 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.958+0000 7f34f6ffd640 1 --2- 172.21.15.132:0/1288577377 >> v2:172.21.15.187:3300/0 conn(0x7f34f80d17d0 0x7f34f80cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.958+0000 7f34f77fe640 1 -- 172.21.15.132:0/1288577377 >> v2:172.21.15.187:3300/0 conn(0x7f34f80d17d0 msgr2=0x7f34f80cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:43.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.958+0000 7f34f77fe640 1 --2- 172.21.15.132:0/1288577377 >> v2:172.21.15.187:3300/0 conn(0x7f34f80d17d0 0x7f34f80cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.958+0000 7f34f77fe640 1 -- 172.21.15.132:0/1288577377 >> v1:172.21.15.132:6789/0 conn(0x7f34f80cfcd0 legacy=0x7f34f80b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:43.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.958+0000 7f34f77fe640 1 -- 172.21.15.132:0/1288577377 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34f80d1ff0 con 0x7f34f815d300 2023-12-20T04:51:43.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.958+0000 7f34f67fc640 1 -- 172.21.15.132:0/1288577377 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2919171374 0 0) 0x7f34f80d2920 con 0x7f34f80cfcd0 2023-12-20T04:51:43.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.958+0000 7f34f77fe640 1 --2- 172.21.15.132:0/1288577377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34f815d300 0x7f34f80d1290 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f34f80b5dc0 tx=0x7f34e802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a9ca1153fb49b9a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:43.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.959+0000 7f34f67fc640 1 -- 172.21.15.132:0/1288577377 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e802cb20 con 0x7f34f815d300 2023-12-20T04:51:43.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.959+0000 7f34f67fc640 1 -- 172.21.15.132:0/1288577377 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34e802cc80 con 0x7f34f815d300 2023-12-20T04:51:43.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.959+0000 7f34f67fc640 1 -- 172.21.15.132:0/1288577377 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34e80343f0 con 0x7f34f815d300 2023-12-20T04:51:43.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.959+0000 7f34fdb1b640 1 -- 172.21.15.132:0/1288577377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34f815d300 msgr2=0x7f34f80d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:43.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.959+0000 7f34fdb1b640 1 --2- 172.21.15.132:0/1288577377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34f815d300 0x7f34f80d1290 secure :-1 s=READY pgs=1634 cs=0 l=1 rev1=1 crypto rx=0x7f34f80b5dc0 tx=0x7f34e802bf80 comp rx=0 tx=0).stop 2023-12-20T04:51:43.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.959+0000 7f34fdb1b640 1 -- 172.21.15.132:0/1288577377 shutdown_connections 2023-12-20T04:51:43.962 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.959+0000 7f34fdb1b640 1 --2- 172.21.15.132:0/1288577377 >> v2:172.21.15.187:3300/0 conn(0x7f34f80d17d0 0x7f34f80cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.959+0000 7f34fdb1b640 1 --2- 172.21.15.132:0/1288577377 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34f815d300 0x7f34f80d1290 unknown :-1 s=CLOSED pgs=1634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.959+0000 7f34fdb1b640 1 -- 172.21.15.132:0/1288577377 >> 172.21.15.132:0/1288577377 conn(0x7f34f806a3d0 msgr2=0x7f34f806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:43.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.959+0000 7f34fdb1b640 1 -- 172.21.15.132:0/1288577377 shutdown_connections 2023-12-20T04:51:43.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.959+0000 7f34fdb1b640 1 -- 172.21.15.132:0/1288577377 wait complete. 2023-12-20T04:51:43.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.960+0000 7f34fdb1b640 1 Processor -- start 2023-12-20T04:51:43.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.961+0000 7f34fdb1b640 1 -- start start 2023-12-20T04:51:43.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.961+0000 7f34fdb1b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34f80cfcd0 0x7f34f8153260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.961+0000 7f34fdb1b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34f80d17d0 0x7f34f8155f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.961+0000 7f34fdb1b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34f815d300 0x7f34f8156470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.961+0000 7f34fdb1b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f80ca0d0 con 0x7f34f80d17d0 2023-12-20T04:51:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.961+0000 7f34fdb1b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f8154b00 con 0x7f34f80cfcd0 2023-12-20T04:51:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.961+0000 7f34fdb1b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f34f8154de0 con 0x7f34f815d300 2023-12-20T04:51:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.961+0000 7f34f6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34f80d17d0 0x7f34f8155f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.961+0000 7f34f6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34f80d17d0 0x7f34f8155f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52250/0 (socket says 172.21.15.132:52250) 2023-12-20T04:51:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.961+0000 7f34f6ffd640 1 -- 172.21.15.132:0/1213892145 learned_addr learned my addr 172.21.15.132:0/1213892145 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.961+0000 7f34f77fe640 1 --2- 172.21.15.132:0/1213892145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34f80cfcd0 0x7f34f8153260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.961+0000 7f34f7fff640 1 --2- 172.21.15.132:0/1213892145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34f815d300 0x7f34f8156470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.962+0000 7f34f6ffd640 1 -- 172.21.15.132:0/1213892145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34f815d300 msgr2=0x7f34f8156470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.962+0000 7f34f6ffd640 1 --2- 172.21.15.132:0/1213892145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34f815d300 0x7f34f8156470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.962+0000 7f34f6ffd640 1 -- 172.21.15.132:0/1213892145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34f80cfcd0 msgr2=0x7f34f8153260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.962+0000 7f34f6ffd640 1 --2- 172.21.15.132:0/1213892145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34f80cfcd0 0x7f34f8153260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.962+0000 7f34f6ffd640 1 -- 172.21.15.132:0/1213892145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e8009b30 con 0x7f34f80d17d0 2023-12-20T04:51:43.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.962+0000 7f34f6ffd640 1 --2- 172.21.15.132:0/1213892145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34f80d17d0 0x7f34f8155f30 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00d5c0 tx=0x7f34ec00da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:43.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.962+0000 7f34dffff640 1 -- 172.21.15.132:0/1213892145 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec0125f0 con 0x7f34f80d17d0 2023-12-20T04:51:43.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.962+0000 7f34dffff640 1 -- 172.21.15.132:0/1213892145 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f34ec012750 con 0x7f34f80d17d0 2023-12-20T04:51:43.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.962+0000 7f34dffff640 1 -- 172.21.15.132:0/1213892145 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f34ec012b00 con 0x7f34f80d17d0 2023-12-20T04:51:43.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.962+0000 7f34fdb1b640 1 -- 172.21.15.132:0/1213892145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f81550c0 con 0x7f34f80d17d0 2023-12-20T04:51:43.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.962+0000 7f34fdb1b640 1 -- 172.21.15.132:0/1213892145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f8155680 con 0x7f34f80d17d0 2023-12-20T04:51:43.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.963+0000 7f34fdb1b640 1 -- 172.21.15.132:0/1213892145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f8155810 con 0x7f34f80d17d0 2023-12-20T04:51:43.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.963+0000 7f34dffff640 1 -- 172.21.15.132:0/1213892145 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f34ec012c60 con 0x7f34f80d17d0 2023-12-20T04:51:43.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.964+0000 7f34dffff640 1 --2- 172.21.15.132:0/1213892145 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f34e406a430 0x7f34e406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:43.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.964+0000 7f34dffff640 1 -- 172.21.15.132:0/1213892145 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f34ec0889b0 con 0x7f34f80d17d0 2023-12-20T04:51:43.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.964+0000 7f34f77fe640 1 --2- 172.21.15.132:0/1213892145 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f34e406a430 0x7f34e406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:43.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.964+0000 7f34f77fe640 1 --2- 172.21.15.132:0/1213892145 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f34e406a430 0x7f34e406c8f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f34e8035000 tx=0x7f34e8030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:43.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:43.968+0000 7f34dffff640 1 -- 172.21.15.132:0/1213892145 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f34ec054380 con 0x7f34f80d17d0 2023-12-20T04:51:44.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.134+0000 7f34fdb1b640 1 -- 172.21.15.132:0/1213892145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f34f804e840 con 0x7f34f80d17d0 2023-12-20T04:51:44.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.135+0000 7f34dffff640 1 -- 172.21.15.132:0/1213892145 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v165) v1 ==== 93+0+10 (secure 0 0 0) 0x7f34ec0579a0 con 0x7f34f80d17d0 2023-12-20T04:51:44.137 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.137+0000 7f34fdb1b640 1 -- 172.21.15.132:0/1213892145 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f34e406a430 msgr2=0x7f34e406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.137+0000 7f34fdb1b640 1 --2- 172.21.15.132:0/1213892145 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f34e406a430 0x7f34e406c8f0 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f34e8035000 tx=0x7f34e8030000 comp rx=0 tx=0).stop 2023-12-20T04:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.137+0000 7f34fdb1b640 1 -- 172.21.15.132:0/1213892145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34f80d17d0 msgr2=0x7f34f8155f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.137+0000 7f34fdb1b640 1 --2- 172.21.15.132:0/1213892145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34f80d17d0 0x7f34f8155f30 secure :-1 s=READY pgs=1635 cs=0 l=1 rev1=1 crypto rx=0x7f34ec00d5c0 tx=0x7f34ec00da80 comp rx=0 tx=0).stop 2023-12-20T04:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.137+0000 7f34fdb1b640 1 -- 172.21.15.132:0/1213892145 shutdown_connections 2023-12-20T04:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.137+0000 7f34fdb1b640 1 --2- 172.21.15.132:0/1213892145 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f34e406a430 0x7f34e406c8f0 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.137+0000 7f34fdb1b640 1 --2- 172.21.15.132:0/1213892145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f34f815d300 0x7f34f8156470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.137+0000 7f34fdb1b640 1 --2- 172.21.15.132:0/1213892145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f34f80d17d0 0x7f34f8155f30 unknown :-1 s=CLOSED pgs=1635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.137+0000 7f34fdb1b640 1 --2- 172.21.15.132:0/1213892145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f34f80cfcd0 0x7f34f8153260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.137+0000 7f34fdb1b640 1 -- 172.21.15.132:0/1213892145 >> 172.21.15.132:0/1213892145 conn(0x7f34f806a3d0 msgr2=0x7f34f80cdd40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.137+0000 7f34fdb1b640 1 -- 172.21.15.132:0/1213892145 shutdown_connections 2023-12-20T04:51:44.140 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.137+0000 7f34fdb1b640 1 -- 172.21.15.132:0/1213892145 wait complete. 2023-12-20T04:51:44.150 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-20T04:51:44.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.248+0000 7fb360054640 1 Processor -- start 2023-12-20T04:51:44.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.249+0000 7fb360054640 1 -- start start 2023-12-20T04:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.249+0000 7fb360054640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb35815e1c0 0x7fb358164c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.249+0000 7fb360054640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb358143ae0 con 0x7fb358070c00 2023-12-20T04:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.249+0000 7fb360054640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb35815e7e0 con 0x7fb358143700 2023-12-20T04:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.249+0000 7fb360054640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb35815e5d0 con 0x7fb35815e1c0 2023-12-20T04:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.249+0000 7fb35d5ef640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb358070c00 0x7fb35815dab0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:42448/0 (socket says 172.21.15.132:42448) 2023-12-20T04:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.249+0000 7fb35d5ef640 1 -- 172.21.15.132:0/400819933 learned_addr learned my addr 172.21.15.132:0/400819933 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35e5f1640 1 --2- 172.21.15.132:0/400819933 >> v2:172.21.15.187:3300/0 conn(0x7fb35815e1c0 0x7fb358164c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35cdee640 1 -- 172.21.15.132:0/400819933 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3771943189 0 0) 0x7fb358143ae0 con 0x7fb358070c00 2023-12-20T04:51:44.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35cdee640 1 -- 172.21.15.132:0/400819933 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb344003520 con 0x7fb358070c00 2023-12-20T04:51:44.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35cdee640 1 -- 172.21.15.132:0/400819933 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2787310525 0 0) 0x7fb344003520 con 0x7fb358070c00 2023-12-20T04:51:44.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35cdee640 1 -- 172.21.15.132:0/400819933 >> v2:172.21.15.187:3300/0 conn(0x7fb35815e1c0 msgr2=0x7fb358164c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:44.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35cdee640 1 --2- 172.21.15.132:0/400819933 >> v2:172.21.15.187:3300/0 conn(0x7fb35815e1c0 0x7fb358164c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35cdee640 1 -- 172.21.15.132:0/400819933 >> v1:172.21.15.187:6789/0 conn(0x7fb358143700 legacy=0x7fb3580704f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:44.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35cdee640 1 -- 172.21.15.132:0/400819933 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3580c4a30 con 0x7fb358070c00 2023-12-20T04:51:44.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35cdee640 1 -- 172.21.15.132:0/400819933 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fb348001670 con 0x7fb358070c00 2023-12-20T04:51:44.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35cdee640 1 -- 172.21.15.132:0/400819933 >> v1:172.21.15.132:6789/0 conn(0x7fb358070c00 legacy=0x7fb35815dab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:44.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35cdee640 1 --2- 172.21.15.132:0/400819933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb344003970 0x7fb344003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:44.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35cdee640 1 --2- 172.21.15.132:0/400819933 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3440047c0 0x7fb344004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:44.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35cdee640 1 --2- 172.21.15.132:0/400819933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb344005180 0x7fb34400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:44.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35cdee640 1 -- 172.21.15.132:0/400819933 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35815e5d0 con 0x7fb344005180 2023-12-20T04:51:44.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35cdee640 1 -- 172.21.15.132:0/400819933 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb34400c020 con 0x7fb344003970 2023-12-20T04:51:44.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35cdee640 1 -- 172.21.15.132:0/400819933 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb34400c1e0 con 0x7fb3440047c0 2023-12-20T04:51:44.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35e5f1640 1 --2- 172.21.15.132:0/400819933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb344005180 0x7fb34400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:44.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35ddf0640 1 --2- 172.21.15.132:0/400819933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb344003970 0x7fb344003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:44.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35d5ef640 1 --2- 172.21.15.132:0/400819933 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3440047c0 0x7fb344004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:44.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35e5f1640 1 -- 172.21.15.132:0/400819933 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3440047c0 msgr2=0x7fb344004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:44.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35e5f1640 1 --2- 172.21.15.132:0/400819933 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb3440047c0 0x7fb344004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35e5f1640 1 -- 172.21.15.132:0/400819933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb344003970 msgr2=0x7fb344003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:44.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35e5f1640 1 --2- 172.21.15.132:0/400819933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb344003970 0x7fb344003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35e5f1640 1 -- 172.21.15.132:0/400819933 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb344003520 con 0x7fb344005180 2023-12-20T04:51:44.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.250+0000 7fb35ddf0640 1 --2- 172.21.15.132:0/400819933 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb344003970 0x7fb344003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:44.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.251+0000 7fb35e5f1640 1 -- 172.21.15.132:0/400819933 reap_dead start 2023-12-20T04:51:44.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.251+0000 7fb35e5f1640 1 --2- 172.21.15.132:0/400819933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb344005180 0x7fb34400b980 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fb350009ac0 tx=0x7fb3440057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3ebf59f60e5a2a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:44.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.251+0000 7fb35cdee640 1 -- 172.21.15.132:0/400819933 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb350004020 con 0x7fb344005180 2023-12-20T04:51:44.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.251+0000 7fb35cdee640 1 -- 172.21.15.132:0/400819933 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb350004180 con 0x7fb344005180 2023-12-20T04:51:44.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.251+0000 7fb35cdee640 1 -- 172.21.15.132:0/400819933 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb3500044f0 con 0x7fb344005180 2023-12-20T04:51:44.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.252+0000 7fb360054640 1 -- 172.21.15.132:0/400819933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb344005180 msgr2=0x7fb34400b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:44.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.252+0000 7fb360054640 1 --2- 172.21.15.132:0/400819933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb344005180 0x7fb34400b980 secure :-1 s=READY pgs=1637 cs=0 l=1 rev1=1 crypto rx=0x7fb350009ac0 tx=0x7fb3440057f0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.252+0000 7fb360054640 1 -- 172.21.15.132:0/400819933 shutdown_connections 2023-12-20T04:51:44.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.252+0000 7fb360054640 1 --2- 172.21.15.132:0/400819933 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb344005180 0x7fb34400b980 unknown :-1 s=CLOSED pgs=1637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.252+0000 7fb360054640 1 -- 172.21.15.132:0/400819933 >> 172.21.15.132:0/400819933 conn(0x7fb3580cfb10 msgr2=0x7fb3580cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:44.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.252+0000 7fb360054640 1 -- 172.21.15.132:0/400819933 shutdown_connections 2023-12-20T04:51:44.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.252+0000 7fb360054640 1 -- 172.21.15.132:0/400819933 wait complete. 2023-12-20T04:51:44.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.253+0000 7fb360054640 1 Processor -- start 2023-12-20T04:51:44.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.253+0000 7fb360054640 1 -- start start 2023-12-20T04:51:44.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb360054640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb344005180 0x7fb35815ae40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:44.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb360054640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb35815bbd0 0x7fb358069c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:44.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb360054640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb35806a170 0x7fb3580b37f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:44.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb360054640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb35806a600 con 0x7fb344005180 2023-12-20T04:51:44.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb360054640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3580b27e0 con 0x7fb35806a170 2023-12-20T04:51:44.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb360054640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb3580b2a30 con 0x7fb35815bbd0 2023-12-20T04:51:44.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb35ddf0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb344005180 0x7fb35815ae40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:44.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb35ddf0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb344005180 0x7fb35815ae40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52272/0 (socket says 172.21.15.132:52272) 2023-12-20T04:51:44.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb35ddf0640 1 -- 172.21.15.132:0/1026855127 learned_addr learned my addr 172.21.15.132:0/1026855127 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb35ddf0640 1 -- 172.21.15.132:0/1026855127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb35815bbd0 msgr2=0x7fb358069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb35ddf0640 1 --2- 172.21.15.132:0/1026855127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb35815bbd0 0x7fb358069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb35ddf0640 1 -- 172.21.15.132:0/1026855127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb35806a170 msgr2=0x7fb3580b37f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb35ddf0640 1 --2- 172.21.15.132:0/1026855127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb35806a170 0x7fb3580b37f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb35ddf0640 1 -- 172.21.15.132:0/1026855127 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3580b2d10 con 0x7fb344005180 2023-12-20T04:51:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb35ddf0640 1 --2- 172.21.15.132:0/1026855127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb344005180 0x7fb35815ae40 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fb354002230 tx=0x7fb35400ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb34e7fc640 1 -- 172.21.15.132:0/1026855127 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb354003b80 con 0x7fb344005180 2023-12-20T04:51:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb34e7fc640 1 -- 172.21.15.132:0/1026855127 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb354003ce0 con 0x7fb344005180 2023-12-20T04:51:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb34e7fc640 1 -- 172.21.15.132:0/1026855127 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb354005310 con 0x7fb344005180 2023-12-20T04:51:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb360054640 1 -- 172.21.15.132:0/1026855127 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3580b2ff0 con 0x7fb344005180 2023-12-20T04:51:44.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.254+0000 7fb360054640 1 -- 172.21.15.132:0/1026855127 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb35815b380 con 0x7fb344005180 2023-12-20T04:51:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.255+0000 7fb360054640 1 -- 172.21.15.132:0/1026855127 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb35815b540 con 0x7fb344005180 2023-12-20T04:51:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.256+0000 7fb34e7fc640 1 -- 172.21.15.132:0/1026855127 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb354005470 con 0x7fb344005180 2023-12-20T04:51:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.256+0000 7fb34e7fc640 1 --2- 172.21.15.132:0/1026855127 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb33c06a460 0x7fb33c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.257+0000 7fb34e7fc640 1 -- 172.21.15.132:0/1026855127 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fb354088640 con 0x7fb344005180 2023-12-20T04:51:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.257+0000 7fb35d5ef640 1 --2- 172.21.15.132:0/1026855127 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb33c06a460 0x7fb33c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.257+0000 7fb35d5ef640 1 --2- 172.21.15.132:0/1026855127 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb33c06a460 0x7fb33c06c920 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb35806a7e0 tx=0x7fb348000f30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:44.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.261+0000 7fb34e7fc640 1 -- 172.21.15.132:0/1026855127 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb354053f90 con 0x7fb344005180 2023-12-20T04:51:44.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.428+0000 7fb360054640 1 -- 172.21.15.132:0/1026855127 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7fb35804e840 con 0x7fb344005180 2023-12-20T04:51:44.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.428+0000 7fb34e7fc640 1 -- 172.21.15.132:0/1026855127 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v165) v1 ==== 84+0+65 (secure 0 0 0) 0x7fb3540575b0 con 0x7fb344005180 2023-12-20T04:51:44.430 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:44.430 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-12-20T04:51:44.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:51:44.431 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-12-20T04:51:44.431 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-12-20T04:51:44.431 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:44.431 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-12-20T04:51:44.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.430+0000 7fb360054640 1 -- 172.21.15.132:0/1026855127 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb33c06a460 msgr2=0x7fb33c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:44.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.430+0000 7fb360054640 1 --2- 172.21.15.132:0/1026855127 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb33c06a460 0x7fb33c06c920 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7fb35806a7e0 tx=0x7fb348000f30 comp rx=0 tx=0).stop 2023-12-20T04:51:44.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.430+0000 7fb360054640 1 -- 172.21.15.132:0/1026855127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb344005180 msgr2=0x7fb35815ae40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:44.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.430+0000 7fb360054640 1 --2- 172.21.15.132:0/1026855127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb344005180 0x7fb35815ae40 secure :-1 s=READY pgs=1638 cs=0 l=1 rev1=1 crypto rx=0x7fb354002230 tx=0x7fb35400ec80 comp rx=0 tx=0).stop 2023-12-20T04:51:44.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.430+0000 7fb360054640 1 -- 172.21.15.132:0/1026855127 shutdown_connections 2023-12-20T04:51:44.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.430+0000 7fb360054640 1 --2- 172.21.15.132:0/1026855127 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb33c06a460 0x7fb33c06c920 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.430+0000 7fb360054640 1 --2- 172.21.15.132:0/1026855127 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb35806a170 0x7fb3580b37f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.430+0000 7fb360054640 1 --2- 172.21.15.132:0/1026855127 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb35815bbd0 0x7fb358069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.430+0000 7fb360054640 1 --2- 172.21.15.132:0/1026855127 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb344005180 0x7fb35815ae40 unknown :-1 s=CLOSED pgs=1638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.430+0000 7fb360054640 1 -- 172.21.15.132:0/1026855127 >> 172.21.15.132:0/1026855127 conn(0x7fb3580cfb10 msgr2=0x7fb3580cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:44.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.430+0000 7fb360054640 1 -- 172.21.15.132:0/1026855127 shutdown_connections 2023-12-20T04:51:44.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.430+0000 7fb360054640 1 -- 172.21.15.132:0/1026855127 wait complete. 2023-12-20T04:51:44.443 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-20T04:51:44.443 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-20T04:51:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.544+0000 7fc06bfec640 1 Processor -- start 2023-12-20T04:51:44.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.544+0000 7fc06bfec640 1 -- start start 2023-12-20T04:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.545+0000 7fc06bfec640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc06406bdd0 0x7fc06406afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.545+0000 7fc06bfec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc0640cfab0 0x7fc06406dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.545+0000 7fc06bfec640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc0640d1b80 con 0x7fc06415d220 2023-12-20T04:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.545+0000 7fc06bfec640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc06415d600 con 0x7fc0640cfab0 2023-12-20T04:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.545+0000 7fc06bfec640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc0640d0020 con 0x7fc06406bdd0 2023-12-20T04:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.545+0000 7fc06a589640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc0640cfab0 0x7fc06406dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.545+0000 7fc06a589640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc0640cfab0 0x7fc06406dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52276/0 (socket says 172.21.15.132:52276) 2023-12-20T04:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.545+0000 7fc06a589640 1 -- 172.21.15.132:0/3549274702 learned_addr learned my addr 172.21.15.132:0/3549274702 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:44.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.545+0000 7fc069d88640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc06415d220 0x7fc06406b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:42454/0 (socket says 172.21.15.132:42454) 2023-12-20T04:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.545+0000 7fc06a589640 1 -- 172.21.15.132:0/3549274702 >> v2:172.21.15.187:3300/0 conn(0x7fc06406bdd0 msgr2=0x7fc06406afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.545+0000 7fc069587640 1 --2- 172.21.15.132:0/3549274702 >> v2:172.21.15.187:3300/0 conn(0x7fc06406bdd0 0x7fc06406afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.545+0000 7fc068d86640 1 -- 172.21.15.132:0/3549274702 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3549723962 0 0) 0x7fc0640d1b80 con 0x7fc06415d220 2023-12-20T04:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.545+0000 7fc06a589640 1 --2- 172.21.15.132:0/3549274702 >> v2:172.21.15.187:3300/0 conn(0x7fc06406bdd0 0x7fc06406afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.545+0000 7fc06a589640 1 -- 172.21.15.132:0/3549274702 >> v1:172.21.15.132:6789/0 conn(0x7fc06415d220 legacy=0x7fc06406b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.546+0000 7fc06a589640 1 -- 172.21.15.132:0/3549274702 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0640d0300 con 0x7fc0640cfab0 2023-12-20T04:51:44.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.546+0000 7fc069587640 1 --2- 172.21.15.132:0/3549274702 >> v2:172.21.15.187:3300/0 conn(0x7fc06406bdd0 0x7fc06406afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.546+0000 7fc06a589640 1 --2- 172.21.15.132:0/3549274702 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0640cfab0 0x7fc06406dda0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fc06409a5e0 tx=0x7fc05c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbff9dca25d70b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.546+0000 7fc068d86640 1 -- 172.21.15.132:0/3549274702 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c02ca80 con 0x7fc0640cfab0 2023-12-20T04:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.546+0000 7fc068d86640 1 -- 172.21.15.132:0/3549274702 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc05c02cbe0 con 0x7fc0640cfab0 2023-12-20T04:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.546+0000 7fc068d86640 1 -- 172.21.15.132:0/3549274702 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05c0343f0 con 0x7fc0640cfab0 2023-12-20T04:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.547+0000 7fc06bfec640 1 -- 172.21.15.132:0/3549274702 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0640cfab0 msgr2=0x7fc06406dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.547+0000 7fc06bfec640 1 --2- 172.21.15.132:0/3549274702 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0640cfab0 0x7fc06406dda0 secure :-1 s=READY pgs=1640 cs=0 l=1 rev1=1 crypto rx=0x7fc06409a5e0 tx=0x7fc05c02bee0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.547+0000 7fc06bfec640 1 -- 172.21.15.132:0/3549274702 shutdown_connections 2023-12-20T04:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.547+0000 7fc06bfec640 1 --2- 172.21.15.132:0/3549274702 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0640cfab0 0x7fc06406dda0 unknown :-1 s=CLOSED pgs=1640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.547+0000 7fc06bfec640 1 --2- 172.21.15.132:0/3549274702 >> v2:172.21.15.187:3300/0 conn(0x7fc06406bdd0 0x7fc06406afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.547+0000 7fc06bfec640 1 -- 172.21.15.132:0/3549274702 >> 172.21.15.132:0/3549274702 conn(0x7fc064099fa0 msgr2=0x7fc0640d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.547+0000 7fc06bfec640 1 -- 172.21.15.132:0/3549274702 shutdown_connections 2023-12-20T04:51:44.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.547+0000 7fc06bfec640 1 -- 172.21.15.132:0/3549274702 wait complete. 2023-12-20T04:51:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.548+0000 7fc06bfec640 1 Processor -- start 2023-12-20T04:51:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.548+0000 7fc06bfec640 1 -- start start 2023-12-20T04:51:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.549+0000 7fc06bfec640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc06406bdd0 0x7fc0640cc920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.549+0000 7fc06bfec640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0640cfab0 0x7fc0641f2120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:44.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.549+0000 7fc06bfec640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc06415d220 0x7fc0641f30c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:44.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.549+0000 7fc06bfec640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0641f3600 con 0x7fc0640cfab0 2023-12-20T04:51:44.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.549+0000 7fc06bfec640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640ccf20 con 0x7fc06406bdd0 2023-12-20T04:51:44.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.549+0000 7fc06bfec640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc0640cd200 con 0x7fc06415d220 2023-12-20T04:51:44.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.549+0000 7fc069587640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0640cfab0 0x7fc0641f2120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:44.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.549+0000 7fc069587640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0640cfab0 0x7fc0641f2120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52278/0 (socket says 172.21.15.132:52278) 2023-12-20T04:51:44.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.549+0000 7fc069587640 1 -- 172.21.15.132:0/2592737169 learned_addr learned my addr 172.21.15.132:0/2592737169 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:44.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.549+0000 7fc069587640 1 -- 172.21.15.132:0/2592737169 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc06415d220 msgr2=0x7fc0641f30c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:44.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.549+0000 7fc069587640 1 --2- 172.21.15.132:0/2592737169 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc06415d220 0x7fc0641f30c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.549+0000 7fc069587640 1 -- 172.21.15.132:0/2592737169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc06406bdd0 msgr2=0x7fc0640cc920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:44.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.549+0000 7fc069587640 1 --2- 172.21.15.132:0/2592737169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc06406bdd0 0x7fc0640cc920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:44.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.549+0000 7fc069587640 1 -- 172.21.15.132:0/2592737169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc05c009b30 con 0x7fc0640cfab0 2023-12-20T04:51:44.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.549+0000 7fc069587640 1 --2- 172.21.15.132:0/2592737169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0640cfab0 0x7fc0641f2120 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fc05400c7f0 tx=0x7fc05400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:44.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.550+0000 7fc05a7fc640 1 -- 172.21.15.132:0/2592737169 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc054007a30 con 0x7fc0640cfab0 2023-12-20T04:51:44.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.550+0000 7fc05a7fc640 1 -- 172.21.15.132:0/2592737169 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc054007b90 con 0x7fc0640cfab0 2023-12-20T04:51:44.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.550+0000 7fc06bfec640 1 -- 172.21.15.132:0/2592737169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc0640cd4e0 con 0x7fc0640cfab0 2023-12-20T04:51:44.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.550+0000 7fc05a7fc640 1 -- 172.21.15.132:0/2592737169 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc05400ce40 con 0x7fc0640cfab0 2023-12-20T04:51:44.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.550+0000 7fc06bfec640 1 -- 172.21.15.132:0/2592737169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc0640cdaa0 con 0x7fc0640cfab0 2023-12-20T04:51:44.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.551+0000 7fc06bfec640 1 -- 172.21.15.132:0/2592737169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc0640cdc90 con 0x7fc0640cfab0 2023-12-20T04:51:44.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.551+0000 7fc05a7fc640 1 -- 172.21.15.132:0/2592737169 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc0540113f0 con 0x7fc0640cfab0 2023-12-20T04:51:44.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.551+0000 7fc05a7fc640 1 --2- 172.21.15.132:0/2592737169 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc04806a430 0x7fc04806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:44.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.551+0000 7fc05a7fc640 1 -- 172.21.15.132:0/2592737169 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(165..165 src has 1..165) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fc054088790 con 0x7fc0640cfab0 2023-12-20T04:51:44.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.551+0000 7fc069d88640 1 --2- 172.21.15.132:0/2592737169 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc04806a430 0x7fc04806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:44.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.552+0000 7fc069d88640 1 --2- 172.21.15.132:0/2592737169 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc04806a430 0x7fc04806c8f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc060001020 tx=0x7fc060007990 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:44.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.556+0000 7fc05a7fc640 1 -- 172.21.15.132:0/2592737169 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc0540540d0 con 0x7fc0640cfab0 2023-12-20T04:51:44.722 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:44.720+0000 7fc06bfec640 1 -- 172.21.15.132:0/2592737169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fc06404e840 con 0x7fc0640cfab0 2023-12-20T04:51:45.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.166+0000 7fc05a7fc640 1 -- 172.21.15.132:0/2592737169 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v166) v1 ==== 138+0+0 (secure 0 0 0) 0x7fc0540576f0 con 0x7fc0640cfab0 2023-12-20T04:51:45.168 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2023-12-20T04:51:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.169+0000 7fc06bfec640 1 -- 172.21.15.132:0/2592737169 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc04806a430 msgr2=0x7fc04806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.169+0000 7fc06bfec640 1 --2- 172.21.15.132:0/2592737169 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc04806a430 0x7fc04806c8f0 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7fc060001020 tx=0x7fc060007990 comp rx=0 tx=0).stop 2023-12-20T04:51:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.169+0000 7fc06bfec640 1 -- 172.21.15.132:0/2592737169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0640cfab0 msgr2=0x7fc0641f2120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.169+0000 7fc06bfec640 1 --2- 172.21.15.132:0/2592737169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0640cfab0 0x7fc0641f2120 secure :-1 s=READY pgs=1641 cs=0 l=1 rev1=1 crypto rx=0x7fc05400c7f0 tx=0x7fc05400cbf0 comp rx=0 tx=0).stop 2023-12-20T04:51:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.169+0000 7fc06bfec640 1 -- 172.21.15.132:0/2592737169 shutdown_connections 2023-12-20T04:51:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.169+0000 7fc06bfec640 1 --2- 172.21.15.132:0/2592737169 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc04806a430 0x7fc04806c8f0 unknown :-1 s=CLOSED pgs=692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.169+0000 7fc06bfec640 1 --2- 172.21.15.132:0/2592737169 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc06415d220 0x7fc0641f30c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.169+0000 7fc06bfec640 1 --2- 172.21.15.132:0/2592737169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc0640cfab0 0x7fc0641f2120 unknown :-1 s=CLOSED pgs=1641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.169+0000 7fc06bfec640 1 --2- 172.21.15.132:0/2592737169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc06406bdd0 0x7fc0640cc920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.169+0000 7fc06bfec640 1 -- 172.21.15.132:0/2592737169 >> 172.21.15.132:0/2592737169 conn(0x7fc064099fa0 msgr2=0x7fc06406ad20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.170+0000 7fc06bfec640 1 -- 172.21.15.132:0/2592737169 shutdown_connections 2023-12-20T04:51:45.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.170+0000 7fc06bfec640 1 -- 172.21.15.132:0/2592737169 wait complete. 2023-12-20T04:51:45.183 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-20T04:51:45.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.289+0000 7efc82b89640 1 Processor -- start 2023-12-20T04:51:45.291 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.289+0000 7efc82b89640 1 -- start start 2023-12-20T04:51:45.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.290+0000 7efc82b89640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efc7c15d300 0x7efc7c0d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:45.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.290+0000 7efc82b89640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7efc7c0d1550 0x7efc7c0cf880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:45.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.290+0000 7efc82b89640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc7c0cfdc0 0x7efc7c0b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:45.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.290+0000 7efc82b89640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7c0d01f0 con 0x7efc7c15d300 2023-12-20T04:51:45.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.290+0000 7efc82b89640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efc7c0d1a90 con 0x7efc7c0d1550 2023-12-20T04:51:45.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.290+0000 7efc82b89640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0d1d70 con 0x7efc7c0cfdc0 2023-12-20T04:51:45.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.290+0000 7efc80925640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efc7c15d300 0x7efc7c0d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:45.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.290+0000 7efc80925640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7efc7c15d300 0x7efc7c0d1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52286/0 (socket says 172.21.15.132:52286) 2023-12-20T04:51:45.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.290+0000 7efc80925640 1 -- 172.21.15.132:0/624188164 learned_addr learned my addr 172.21.15.132:0/624188164 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:45.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.290+0000 7efc81126640 1 --2- 172.21.15.132:0/624188164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc7c0cfdc0 0x7efc7c0b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:45.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.290+0000 7efc80925640 1 -- 172.21.15.132:0/624188164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc7c0cfdc0 msgr2=0x7efc7c0b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:45.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.290+0000 7efc7bfff640 1 --2- 172.21.15.132:0/624188164 >> v2:172.21.15.187:3300/0 conn(0x7efc7c0d1550 0x7efc7c0cf880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:45.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.290+0000 7efc80925640 1 --2- 172.21.15.132:0/624188164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc7c0cfdc0 0x7efc7c0b48f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:45.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.290+0000 7efc80925640 1 -- 172.21.15.132:0/624188164 >> v2:172.21.15.187:3300/0 conn(0x7efc7c0d1550 msgr2=0x7efc7c0cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:45.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.291+0000 7efc80925640 1 --2- 172.21.15.132:0/624188164 >> v2:172.21.15.187:3300/0 conn(0x7efc7c0d1550 0x7efc7c0cf880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:45.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.291+0000 7efc80925640 1 -- 172.21.15.132:0/624188164 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc7c0d2050 con 0x7efc7c15d300 2023-12-20T04:51:45.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.291+0000 7efc81126640 1 --2- 172.21.15.132:0/624188164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc7c0cfdc0 0x7efc7c0b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:45.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.291+0000 7efc7bfff640 1 --2- 172.21.15.132:0/624188164 >> v2:172.21.15.187:3300/0 conn(0x7efc7c0d1550 0x7efc7c0cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:45.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.291+0000 7efc80925640 1 --2- 172.21.15.132:0/624188164 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc7c15d300 0x7efc7c0d1010 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7efc7c0d0560 tx=0x7efc6c02b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14e4ae820f674ea9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:45.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.291+0000 7efc7b7fe640 1 -- 172.21.15.132:0/624188164 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c031870 con 0x7efc7c15d300 2023-12-20T04:51:45.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.291+0000 7efc7b7fe640 1 -- 172.21.15.132:0/624188164 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc6c0319d0 con 0x7efc7c15d300 2023-12-20T04:51:45.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.291+0000 7efc7b7fe640 1 -- 172.21.15.132:0/624188164 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc6c031d60 con 0x7efc7c15d300 2023-12-20T04:51:45.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.292+0000 7efc82b89640 1 -- 172.21.15.132:0/624188164 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc7c15d300 msgr2=0x7efc7c0d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:45.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.292+0000 7efc82b89640 1 --2- 172.21.15.132:0/624188164 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc7c15d300 0x7efc7c0d1010 secure :-1 s=READY pgs=1642 cs=0 l=1 rev1=1 crypto rx=0x7efc7c0d0560 tx=0x7efc6c02b910 comp rx=0 tx=0).stop 2023-12-20T04:51:45.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.292+0000 7efc82b89640 1 -- 172.21.15.132:0/624188164 shutdown_connections 2023-12-20T04:51:45.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.292+0000 7efc82b89640 1 --2- 172.21.15.132:0/624188164 >> v2:172.21.15.187:3300/0 conn(0x7efc7c0d1550 0x7efc7c0cf880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:45.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.292+0000 7efc82b89640 1 --2- 172.21.15.132:0/624188164 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc7c0cfdc0 0x7efc7c0b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:45.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.292+0000 7efc82b89640 1 --2- 172.21.15.132:0/624188164 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc7c15d300 0x7efc7c0d1010 unknown :-1 s=CLOSED pgs=1642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:45.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.292+0000 7efc82b89640 1 -- 172.21.15.132:0/624188164 >> 172.21.15.132:0/624188164 conn(0x7efc7c06a3d0 msgr2=0x7efc7c06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:45.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.292+0000 7efc82b89640 1 -- 172.21.15.132:0/624188164 shutdown_connections 2023-12-20T04:51:45.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.292+0000 7efc82b89640 1 -- 172.21.15.132:0/624188164 wait complete. 2023-12-20T04:51:45.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.293+0000 7efc82b89640 1 Processor -- start 2023-12-20T04:51:45.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.293+0000 7efc82b89640 1 -- start start 2023-12-20T04:51:45.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.294+0000 7efc82b89640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc7c0cfdc0 0x7efc7c1f21d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:45.299 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.294+0000 7efc82b89640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc7c0d1550 0x7efc7c0c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:45.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.294+0000 7efc82b89640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc7c15d300 0x7efc7c0cc030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:45.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.294+0000 7efc82b89640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0cb480 con 0x7efc7c0d1550 2023-12-20T04:51:45.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.294+0000 7efc82b89640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0ca800 con 0x7efc7c0cfdc0 2023-12-20T04:51:45.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.294+0000 7efc82b89640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efc7c0caae0 con 0x7efc7c15d300 2023-12-20T04:51:45.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.294+0000 7efc7bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc7c0d1550 0x7efc7c0c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:45.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.294+0000 7efc7bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc7c0d1550 0x7efc7c0c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52288/0 (socket says 172.21.15.132:52288) 2023-12-20T04:51:45.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.294+0000 7efc7bfff640 1 -- 172.21.15.132:0/410323419 learned_addr learned my addr 172.21.15.132:0/410323419 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:45.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.294+0000 7efc81126640 1 --2- 172.21.15.132:0/410323419 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc7c15d300 0x7efc7c0cc030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:45.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.294+0000 7efc80925640 1 --2- 172.21.15.132:0/410323419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc7c0cfdc0 0x7efc7c1f21d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:45.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.294+0000 7efc7bfff640 1 -- 172.21.15.132:0/410323419 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc7c15d300 msgr2=0x7efc7c0cc030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:45.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.294+0000 7efc7bfff640 1 --2- 172.21.15.132:0/410323419 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc7c15d300 0x7efc7c0cc030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:45.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.294+0000 7efc7bfff640 1 -- 172.21.15.132:0/410323419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc7c0cfdc0 msgr2=0x7efc7c1f21d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:45.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.294+0000 7efc7bfff640 1 --2- 172.21.15.132:0/410323419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc7c0cfdc0 0x7efc7c1f21d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:45.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.294+0000 7efc7bfff640 1 -- 172.21.15.132:0/410323419 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc6c0094d0 con 0x7efc7c0d1550 2023-12-20T04:51:45.300 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.295+0000 7efc7bfff640 1 --2- 172.21.15.132:0/410323419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc7c0d1550 0x7efc7c0c9f40 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7efc7000c7f0 tx=0x7efc7000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:45.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.295+0000 7efc797fa640 1 -- 172.21.15.132:0/410323419 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc7000cea0 con 0x7efc7c0d1550 2023-12-20T04:51:45.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.295+0000 7efc797fa640 1 -- 172.21.15.132:0/410323419 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efc70005b90 con 0x7efc7c0d1550 2023-12-20T04:51:45.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.295+0000 7efc797fa640 1 -- 172.21.15.132:0/410323419 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efc70007830 con 0x7efc7c0d1550 2023-12-20T04:51:45.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.295+0000 7efc82b89640 1 -- 172.21.15.132:0/410323419 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc7c0cadc0 con 0x7efc7c0d1550 2023-12-20T04:51:45.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.295+0000 7efc82b89640 1 -- 172.21.15.132:0/410323419 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc7c0ca480 con 0x7efc7c0d1550 2023-12-20T04:51:45.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.296+0000 7efc82b89640 1 -- 172.21.15.132:0/410323419 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc7c0cb5c0 con 0x7efc7c0d1550 2023-12-20T04:51:45.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.296+0000 7efc797fa640 1 -- 172.21.15.132:0/410323419 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efc70007990 con 0x7efc7c0d1550 2023-12-20T04:51:45.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.296+0000 7efc797fa640 1 --2- 172.21.15.132:0/410323419 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efc6806a430 0x7efc6806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:45.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.297+0000 7efc797fa640 1 -- 172.21.15.132:0/410323419 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(166..166 src has 1..166) v4 ==== 5227+0+0 (secure 0 0 0) 0x7efc700885e0 con 0x7efc7c0d1550 2023-12-20T04:51:45.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.297+0000 7efc80925640 1 --2- 172.21.15.132:0/410323419 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efc6806a430 0x7efc6806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:45.302 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.297+0000 7efc80925640 1 --2- 172.21.15.132:0/410323419 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efc6806a430 0x7efc6806c8f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7efc6c036000 tx=0x7efc6c03c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:45.303 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.301+0000 7efc797fa640 1 -- 172.21.15.132:0/410323419 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7efc7c0cb5c0 con 0x7efc7c0d1550 2023-12-20T04:51:45.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:45.467+0000 7efc82b89640 1 -- 172.21.15.132:0/410323419 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7efc7c0cb5c0 con 0x7efc7c0d1550 2023-12-20T04:51:46.169 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.167+0000 7efc797fa640 1 -- 172.21.15.132:0/410323419 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v167) v1 ==== 170+0+0 (secure 0 0 0) 0x7efc7c0cb5c0 con 0x7efc7c0d1550 2023-12-20T04:51:46.173 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2023-12-20T04:51:46.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.173+0000 7efc82b89640 1 -- 172.21.15.132:0/410323419 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efc6806a430 msgr2=0x7efc6806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.173+0000 7efc82b89640 1 --2- 172.21.15.132:0/410323419 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efc6806a430 0x7efc6806c8f0 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7efc6c036000 tx=0x7efc6c03c040 comp rx=0 tx=0).stop 2023-12-20T04:51:46.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.173+0000 7efc82b89640 1 -- 172.21.15.132:0/410323419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc7c0d1550 msgr2=0x7efc7c0c9f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.175 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.173+0000 7efc82b89640 1 --2- 172.21.15.132:0/410323419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc7c0d1550 0x7efc7c0c9f40 secure :-1 s=READY pgs=1643 cs=0 l=1 rev1=1 crypto rx=0x7efc7000c7f0 tx=0x7efc7000ccb0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.175+0000 7efc82b89640 1 -- 172.21.15.132:0/410323419 shutdown_connections 2023-12-20T04:51:46.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.175+0000 7efc82b89640 1 --2- 172.21.15.132:0/410323419 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efc6806a430 0x7efc6806c8f0 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.175+0000 7efc82b89640 1 --2- 172.21.15.132:0/410323419 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efc7c15d300 0x7efc7c0cc030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.175+0000 7efc82b89640 1 --2- 172.21.15.132:0/410323419 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efc7c0d1550 0x7efc7c0c9f40 unknown :-1 s=CLOSED pgs=1643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.175+0000 7efc82b89640 1 --2- 172.21.15.132:0/410323419 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efc7c0cfdc0 0x7efc7c1f21d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.175+0000 7efc82b89640 1 -- 172.21.15.132:0/410323419 >> 172.21.15.132:0/410323419 conn(0x7efc7c06a3d0 msgr2=0x7efc7c15c490 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:46.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.176+0000 7efc82b89640 1 -- 172.21.15.132:0/410323419 shutdown_connections 2023-12-20T04:51:46.178 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.176+0000 7efc82b89640 1 -- 172.21.15.132:0/410323419 wait complete. 2023-12-20T04:51:46.191 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-20T04:51:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.293+0000 7fb785d41640 1 Processor -- start 2023-12-20T04:51:46.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.293+0000 7fb785d41640 1 -- start start 2023-12-20T04:51:46.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.294+0000 7fb785d41640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fb78006f450 0x7fb7800cb2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.294+0000 7fb785d41640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb78006b960 con 0x7fb78006f8d0 2023-12-20T04:51:46.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.294+0000 7fb785d41640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb7800c4390 con 0x7fb7800caee0 2023-12-20T04:51:46.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.294+0000 7fb785d41640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb7800c4c30 con 0x7fb78006f450 2023-12-20T04:51:46.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.294+0000 7fb77ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb78006f8d0 0x7fb78006bdf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:42456/0 (socket says 172.21.15.132:42456) 2023-12-20T04:51:46.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.294+0000 7fb77ffff640 1 -- 172.21.15.132:0/3240815085 learned_addr learned my addr 172.21.15.132:0/3240815085 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:46.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.294+0000 7fb77e7fc640 1 -- 172.21.15.132:0/3240815085 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3872472254 0 0) 0x7fb78006b960 con 0x7fb78006f8d0 2023-12-20T04:51:46.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.294+0000 7fb77e7fc640 1 -- 172.21.15.132:0/3240815085 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fb768003520 con 0x7fb78006f8d0 2023-12-20T04:51:46.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.294+0000 7fb77effd640 1 --2- 172.21.15.132:0/3240815085 >> v2:172.21.15.187:3300/0 conn(0x7fb78006f450 0x7fb7800cb2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77e7fc640 1 -- 172.21.15.132:0/3240815085 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1623568670 0 0) 0x7fb768003520 con 0x7fb78006f8d0 2023-12-20T04:51:46.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77e7fc640 1 -- 172.21.15.132:0/3240815085 >> v2:172.21.15.187:3300/0 conn(0x7fb78006f450 msgr2=0x7fb7800cb2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:46.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77e7fc640 1 --2- 172.21.15.132:0/3240815085 >> v2:172.21.15.187:3300/0 conn(0x7fb78006f450 0x7fb7800cb2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77e7fc640 1 -- 172.21.15.132:0/3240815085 >> v1:172.21.15.187:6789/0 conn(0x7fb7800caee0 legacy=0x7fb7800c5330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77e7fc640 1 -- 172.21.15.132:0/3240815085 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7800c4670 con 0x7fb78006f8d0 2023-12-20T04:51:46.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77e7fc640 1 -- 172.21.15.132:0/3240815085 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fb7780019f0 con 0x7fb78006f8d0 2023-12-20T04:51:46.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77e7fc640 1 -- 172.21.15.132:0/3240815085 >> v1:172.21.15.132:6789/0 conn(0x7fb78006f8d0 legacy=0x7fb78006bdf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77e7fc640 1 --2- 172.21.15.132:0/3240815085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb768003970 0x7fb768003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77e7fc640 1 --2- 172.21.15.132:0/3240815085 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7680047c0 0x7fb768004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77e7fc640 1 --2- 172.21.15.132:0/3240815085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb768005180 0x7fb76800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77e7fc640 1 -- 172.21.15.132:0/3240815085 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7800c4c30 con 0x7fb768005180 2023-12-20T04:51:46.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77e7fc640 1 -- 172.21.15.132:0/3240815085 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb76800c020 con 0x7fb7680047c0 2023-12-20T04:51:46.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77e7fc640 1 -- 172.21.15.132:0/3240815085 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb76800c1e0 con 0x7fb768003970 2023-12-20T04:51:46.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77ffff640 1 --2- 172.21.15.132:0/3240815085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb768005180 0x7fb76800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77effd640 1 --2- 172.21.15.132:0/3240815085 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7680047c0 0x7fb768004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77f7fe640 1 --2- 172.21.15.132:0/3240815085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb768003970 0x7fb768003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77ffff640 1 -- 172.21.15.132:0/3240815085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb768003970 msgr2=0x7fb768003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:46.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77ffff640 1 --2- 172.21.15.132:0/3240815085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb768003970 0x7fb768003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77ffff640 1 -- 172.21.15.132:0/3240815085 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7680047c0 msgr2=0x7fb768004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:46.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77ffff640 1 --2- 172.21.15.132:0/3240815085 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7680047c0 0x7fb768004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77ffff640 1 -- 172.21.15.132:0/3240815085 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb768003520 con 0x7fb768005180 2023-12-20T04:51:46.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.295+0000 7fb77f7fe640 1 --2- 172.21.15.132:0/3240815085 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb768003970 0x7fb768003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:46.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.296+0000 7fb77ffff640 1 -- 172.21.15.132:0/3240815085 reap_dead start 2023-12-20T04:51:46.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.296+0000 7fb77ffff640 1 --2- 172.21.15.132:0/3240815085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb768005180 0x7fb76800b980 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fb7780013d0 tx=0x7fb7680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fce90fdc5e93bf server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:46.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.296+0000 7fb77e7fc640 1 -- 172.21.15.132:0/3240815085 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb778034630 con 0x7fb768005180 2023-12-20T04:51:46.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.296+0000 7fb77e7fc640 1 -- 172.21.15.132:0/3240815085 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77802f070 con 0x7fb768005180 2023-12-20T04:51:46.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.296+0000 7fb77e7fc640 1 -- 172.21.15.132:0/3240815085 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb7780349d0 con 0x7fb768005180 2023-12-20T04:51:46.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.297+0000 7fb785d41640 1 -- 172.21.15.132:0/3240815085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb768005180 msgr2=0x7fb76800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.297+0000 7fb785d41640 1 --2- 172.21.15.132:0/3240815085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb768005180 0x7fb76800b980 secure :-1 s=READY pgs=1645 cs=0 l=1 rev1=1 crypto rx=0x7fb7780013d0 tx=0x7fb7680057f0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.297+0000 7fb785d41640 1 -- 172.21.15.132:0/3240815085 shutdown_connections 2023-12-20T04:51:46.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.297+0000 7fb785d41640 1 --2- 172.21.15.132:0/3240815085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb768005180 0x7fb76800b980 unknown :-1 s=CLOSED pgs=1645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.297+0000 7fb785d41640 1 -- 172.21.15.132:0/3240815085 >> 172.21.15.132:0/3240815085 conn(0x7fb78006a260 msgr2=0x7fb7800b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:46.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.297+0000 7fb785d41640 1 -- 172.21.15.132:0/3240815085 shutdown_connections 2023-12-20T04:51:46.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.297+0000 7fb785d41640 1 -- 172.21.15.132:0/3240815085 wait complete. 2023-12-20T04:51:46.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.298+0000 7fb785d41640 1 Processor -- start 2023-12-20T04:51:46.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.298+0000 7fb785d41640 1 -- start start 2023-12-20T04:51:46.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb785d41640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb768005180 0x7fb78013c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb785d41640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7801e46e0 0x7fb7801e4b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb785d41640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7801cfbe0 0x7fb7801d0060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb785d41640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7801e0300 con 0x7fb7801e46e0 2023-12-20T04:51:46.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb785d41640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7801e4250 con 0x7fb7801cfbe0 2023-12-20T04:51:46.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb785d41640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb7801e3640 con 0x7fb768005180 2023-12-20T04:51:46.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb77effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7801e46e0 0x7fb7801e4b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb77effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7801e46e0 0x7fb7801e4b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52300/0 (socket says 172.21.15.132:52300) 2023-12-20T04:51:46.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb77effd640 1 -- 172.21.15.132:0/871722733 learned_addr learned my addr 172.21.15.132:0/871722733 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:46.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb77ffff640 1 --2- 172.21.15.132:0/871722733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7801cfbe0 0x7fb7801d0060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb77f7fe640 1 --2- 172.21.15.132:0/871722733 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb768005180 0x7fb78013c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb77effd640 1 -- 172.21.15.132:0/871722733 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb768005180 msgr2=0x7fb78013c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb77effd640 1 --2- 172.21.15.132:0/871722733 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb768005180 0x7fb78013c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb77effd640 1 -- 172.21.15.132:0/871722733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7801cfbe0 msgr2=0x7fb7801d0060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb77effd640 1 --2- 172.21.15.132:0/871722733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7801cfbe0 0x7fb7801d0060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb77effd640 1 -- 172.21.15.132:0/871722733 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7801e3920 con 0x7fb7801e46e0 2023-12-20T04:51:46.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb77f7fe640 1 --2- 172.21.15.132:0/871722733 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb768005180 0x7fb78013c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:46.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb77effd640 1 --2- 172.21.15.132:0/871722733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7801e46e0 0x7fb7801e4b60 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fb774011910 tx=0x7fb774011dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:46.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb767fff640 1 -- 172.21.15.132:0/871722733 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb77400faf0 con 0x7fb7801e46e0 2023-12-20T04:51:46.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb767fff640 1 -- 172.21.15.132:0/871722733 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb77400fc50 con 0x7fb7801e46e0 2023-12-20T04:51:46.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb767fff640 1 -- 172.21.15.132:0/871722733 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb774014440 con 0x7fb7801e46e0 2023-12-20T04:51:46.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.299+0000 7fb785d41640 1 -- 172.21.15.132:0/871722733 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7801e3c00 con 0x7fb7801e46e0 2023-12-20T04:51:46.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.300+0000 7fb785d41640 1 -- 172.21.15.132:0/871722733 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb78013c970 con 0x7fb7801e46e0 2023-12-20T04:51:46.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.301+0000 7fb785d41640 1 -- 172.21.15.132:0/871722733 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7800c92a0 con 0x7fb7801e46e0 2023-12-20T04:51:46.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.301+0000 7fb767fff640 1 -- 172.21.15.132:0/871722733 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb7740145a0 con 0x7fb7801e46e0 2023-12-20T04:51:46.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.301+0000 7fb767fff640 1 --2- 172.21.15.132:0/871722733 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb76c06a460 0x7fb76c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.301+0000 7fb767fff640 1 -- 172.21.15.132:0/871722733 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(167..167 src has 1..167) v4 ==== 5609+0+0 (secure 0 0 0) 0x7fb774088f20 con 0x7fb7801e46e0 2023-12-20T04:51:46.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.301+0000 7fb77f7fe640 1 --2- 172.21.15.132:0/871722733 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb76c06a460 0x7fb76c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.302+0000 7fb77f7fe640 1 --2- 172.21.15.132:0/871722733 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb76c06a460 0x7fb76c06c920 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb770000c00 tx=0x7fb770009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:46.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.306+0000 7fb767fff640 1 -- 172.21.15.132:0/871722733 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb774054600 con 0x7fb7801e46e0 2023-12-20T04:51:46.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.506+0000 7fb785d41640 1 -- 172.21.15.132:0/871722733 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7fb78004e840 con 0x7fb7801e46e0 2023-12-20T04:51:46.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.511+0000 7fb767fff640 1 -- 172.21.15.132:0/871722733 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 20 and data pool 21 v61) v1 ==== 174+0+0 (secure 0 0 0) 0x7fb774057c20 con 0x7fb7801e46e0 2023-12-20T04:51:46.513 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 20 and data pool 21 2023-12-20T04:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.520+0000 7fb785d41640 1 -- 172.21.15.132:0/871722733 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb76c06a460 msgr2=0x7fb76c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.520+0000 7fb785d41640 1 --2- 172.21.15.132:0/871722733 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb76c06a460 0x7fb76c06c920 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7fb770000c00 tx=0x7fb770009040 comp rx=0 tx=0).stop 2023-12-20T04:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.520+0000 7fb785d41640 1 -- 172.21.15.132:0/871722733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7801e46e0 msgr2=0x7fb7801e4b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.520+0000 7fb785d41640 1 --2- 172.21.15.132:0/871722733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7801e46e0 0x7fb7801e4b60 secure :-1 s=READY pgs=1646 cs=0 l=1 rev1=1 crypto rx=0x7fb774011910 tx=0x7fb774011dd0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.520+0000 7fb785d41640 1 -- 172.21.15.132:0/871722733 shutdown_connections 2023-12-20T04:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.520+0000 7fb785d41640 1 --2- 172.21.15.132:0/871722733 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb76c06a460 0x7fb76c06c920 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.521+0000 7fb785d41640 1 --2- 172.21.15.132:0/871722733 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb7801cfbe0 0x7fb7801d0060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.521+0000 7fb785d41640 1 --2- 172.21.15.132:0/871722733 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb7801e46e0 0x7fb7801e4b60 unknown :-1 s=CLOSED pgs=1646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.521+0000 7fb785d41640 1 --2- 172.21.15.132:0/871722733 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb768005180 0x7fb78013c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.521+0000 7fb785d41640 1 -- 172.21.15.132:0/871722733 >> 172.21.15.132:0/871722733 conn(0x7fb78006a260 msgr2=0x7fb78006fcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.521+0000 7fb785d41640 1 -- 172.21.15.132:0/871722733 shutdown_connections 2023-12-20T04:51:46.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.521+0000 7fb785d41640 1 -- 172.21.15.132:0/871722733 wait complete. 2023-12-20T04:51:46.538 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:51:46.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.636+0000 7f636155c640 1 Processor -- start 2023-12-20T04:51:46.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.636+0000 7f636155c640 1 -- start start 2023-12-20T04:51:46.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.637+0000 7f636155c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f635c0d0370 0x7f635c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.637+0000 7f636155c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f635c0cdc10 0x7f635c06c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.637+0000 7f636155c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f635c0b2f90 con 0x7f635c15d100 2023-12-20T04:51:46.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.637+0000 7f636155c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f635c1613c0 con 0x7f635c0d0370 2023-12-20T04:51:46.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.637+0000 7f636155c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635c0d1b00 con 0x7f635c0cdc10 2023-12-20T04:51:46.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.637+0000 7f6353fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f635c0d0370 0x7f635c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.637+0000 7f6353fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f635c0d0370 0x7f635c0b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52308/0 (socket says 172.21.15.132:52308) 2023-12-20T04:51:46.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.637+0000 7f6353fff640 1 -- 172.21.15.132:0/1171978661 learned_addr learned my addr 172.21.15.132:0/1171978661 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:46.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.637+0000 7f635b7fe640 1 --2- 172.21.15.132:0/1171978661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f635c0cdc10 0x7f635c06c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.637+0000 7f6353fff640 1 -- 172.21.15.132:0/1171978661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f635c0cdc10 msgr2=0x7f635c06c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:46.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.637+0000 7f6353fff640 1 --2- 172.21.15.132:0/1171978661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f635c0cdc10 0x7f635c06c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.637+0000 7f6353fff640 1 -- 172.21.15.132:0/1171978661 >> v1:172.21.15.187:6789/0 conn(0x7f635c15d100 legacy=0x7f635c0cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:46.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.637+0000 7f6353fff640 1 -- 172.21.15.132:0/1171978661 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f635c0d0810 con 0x7f635c0d0370 2023-12-20T04:51:46.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.637+0000 7f635b7fe640 1 --2- 172.21.15.132:0/1171978661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f635c0cdc10 0x7f635c06c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.638+0000 7f6353fff640 1 --2- 172.21.15.132:0/1171978661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f635c0d0370 0x7f635c0b2a50 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f6344009870 tx=0x7f634402b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7858b4402e16ace server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.638+0000 7f635a7fc640 1 -- 172.21.15.132:0/1171978661 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344031640 con 0x7f635c0d0370 2023-12-20T04:51:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.638+0000 7f635a7fc640 1 -- 172.21.15.132:0/1171978661 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f63440317a0 con 0x7f635c0d0370 2023-12-20T04:51:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.638+0000 7f635a7fc640 1 -- 172.21.15.132:0/1171978661 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344031b30 con 0x7f635c0d0370 2023-12-20T04:51:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.639+0000 7f636155c640 1 -- 172.21.15.132:0/1171978661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f635c0d0370 msgr2=0x7f635c0b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.639+0000 7f636155c640 1 --2- 172.21.15.132:0/1171978661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f635c0d0370 0x7f635c0b2a50 secure :-1 s=READY pgs=1647 cs=0 l=1 rev1=1 crypto rx=0x7f6344009870 tx=0x7f634402b8f0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.639+0000 7f636155c640 1 -- 172.21.15.132:0/1171978661 shutdown_connections 2023-12-20T04:51:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.639+0000 7f636155c640 1 --2- 172.21.15.132:0/1171978661 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f635c0cdc10 0x7f635c06c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.639+0000 7f636155c640 1 --2- 172.21.15.132:0/1171978661 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f635c0d0370 0x7f635c0b2a50 unknown :-1 s=CLOSED pgs=1647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.639+0000 7f636155c640 1 -- 172.21.15.132:0/1171978661 >> 172.21.15.132:0/1171978661 conn(0x7f635c06d7c0 msgr2=0x7f635c06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.639+0000 7f636155c640 1 -- 172.21.15.132:0/1171978661 shutdown_connections 2023-12-20T04:51:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.639+0000 7f636155c640 1 -- 172.21.15.132:0/1171978661 wait complete. 2023-12-20T04:51:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.640+0000 7f636155c640 1 Processor -- start 2023-12-20T04:51:46.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.640+0000 7f636155c640 1 -- start start 2023-12-20T04:51:46.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f636155c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f635c0cdc10 0x7f635c156300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f636155c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f635c0d0370 0x7f635c0b4770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f636155c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f635c15d100 0x7f635c155bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f636155c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635c1560f0 con 0x7f635c0d0370 2023-12-20T04:51:46.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f636155c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f635c0b5f20 con 0x7f635c0cdc10 2023-12-20T04:51:46.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f636155c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f635c1e7130 con 0x7f635c15d100 2023-12-20T04:51:46.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f6353fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f635c0d0370 0x7f635c0b4770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f6353fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f635c0d0370 0x7f635c0b4770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52318/0 (socket says 172.21.15.132:52318) 2023-12-20T04:51:46.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f6353fff640 1 -- 172.21.15.132:0/894488775 learned_addr learned my addr 172.21.15.132:0/894488775 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:46.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f635b7fe640 1 --2- 172.21.15.132:0/894488775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f635c15d100 0x7f635c155bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f635affd640 1 --2- 172.21.15.132:0/894488775 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f635c0cdc10 0x7f635c156300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f6353fff640 1 -- 172.21.15.132:0/894488775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f635c15d100 msgr2=0x7f635c155bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f6353fff640 1 --2- 172.21.15.132:0/894488775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f635c15d100 0x7f635c155bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f6353fff640 1 -- 172.21.15.132:0/894488775 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f635c0cdc10 msgr2=0x7f635c156300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f6353fff640 1 --2- 172.21.15.132:0/894488775 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f635c0cdc10 0x7f635c156300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f6353fff640 1 -- 172.21.15.132:0/894488775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f63440094d0 con 0x7f635c0d0370 2023-12-20T04:51:46.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f6353fff640 1 --2- 172.21.15.132:0/894488775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f635c0d0370 0x7f635c0b4770 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f6344009870 tx=0x7f63440046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:46.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f63537fe640 1 -- 172.21.15.132:0/894488775 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f634403ac60 con 0x7f635c0d0370 2023-12-20T04:51:46.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f63537fe640 1 -- 172.21.15.132:0/894488775 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f634403ade0 con 0x7f635c0d0370 2023-12-20T04:51:46.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f636155c640 1 -- 172.21.15.132:0/894488775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f635c1e7410 con 0x7f635c0d0370 2023-12-20T04:51:46.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f63537fe640 1 -- 172.21.15.132:0/894488775 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6344044630 con 0x7f635c0d0370 2023-12-20T04:51:46.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.641+0000 7f636155c640 1 -- 172.21.15.132:0/894488775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f635c0c9300 con 0x7f635c0d0370 2023-12-20T04:51:46.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.642+0000 7f636155c640 1 -- 172.21.15.132:0/894488775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f635c0c94f0 con 0x7f635c0d0370 2023-12-20T04:51:46.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.643+0000 7f63537fe640 1 -- 172.21.15.132:0/894488775 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f634402f050 con 0x7f635c0d0370 2023-12-20T04:51:46.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.643+0000 7f63537fe640 1 --2- 172.21.15.132:0/894488775 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f633c06a460 0x7f633c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.643+0000 7f63537fe640 1 -- 172.21.15.132:0/894488775 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f63440aa8a0 con 0x7f635c0d0370 2023-12-20T04:51:46.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.643+0000 7f635affd640 1 --2- 172.21.15.132:0/894488775 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f633c06a460 0x7f633c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.643+0000 7f635affd640 1 --2- 172.21.15.132:0/894488775 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f633c06a460 0x7f633c06c920 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f635c0c7bd0 tx=0x7f634c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:46.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.647+0000 7f63537fe640 1 -- 172.21.15.132:0/894488775 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6344075fe0 con 0x7f635c0d0370 2023-12-20T04:51:46.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.814+0000 7f636155c640 1 -- 172.21.15.132:0/894488775 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f635c0b2f90 con 0x7f635c0d0370 2023-12-20T04:51:46.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.816+0000 7f63537fe640 1 -- 172.21.15.132:0/894488775 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+16173 (secure 0 0 0) 0x7f635c0b2f90 con 0x7f635c0d0370 2023-12-20T04:51:46.818 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:46.818 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":168,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:51:46.507827+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:51:44.739391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-20T04:51:45.486167+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:51:46.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.817+0000 7f636155c640 1 -- 172.21.15.132:0/894488775 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f633c06a460 msgr2=0x7f633c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.817+0000 7f636155c640 1 --2- 172.21.15.132:0/894488775 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f633c06a460 0x7f633c06c920 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f635c0c7bd0 tx=0x7f634c009040 comp rx=0 tx=0).stop 2023-12-20T04:51:46.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.817+0000 7f636155c640 1 -- 172.21.15.132:0/894488775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f635c0d0370 msgr2=0x7f635c0b4770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.817+0000 7f636155c640 1 --2- 172.21.15.132:0/894488775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f635c0d0370 0x7f635c0b4770 secure :-1 s=READY pgs=1648 cs=0 l=1 rev1=1 crypto rx=0x7f6344009870 tx=0x7f63440046c0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.818+0000 7f636155c640 1 -- 172.21.15.132:0/894488775 shutdown_connections 2023-12-20T04:51:46.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.818+0000 7f636155c640 1 --2- 172.21.15.132:0/894488775 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f633c06a460 0x7f633c06c920 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.818+0000 7f636155c640 1 --2- 172.21.15.132:0/894488775 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f635c15d100 0x7f635c155bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.818+0000 7f636155c640 1 --2- 172.21.15.132:0/894488775 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f635c0d0370 0x7f635c0b4770 unknown :-1 s=CLOSED pgs=1648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.818+0000 7f636155c640 1 --2- 172.21.15.132:0/894488775 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f635c0cdc10 0x7f635c156300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.818+0000 7f636155c640 1 -- 172.21.15.132:0/894488775 >> 172.21.15.132:0/894488775 conn(0x7f635c06d7c0 msgr2=0x7f635c0cc0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.818+0000 7f636155c640 1 -- 172.21.15.132:0/894488775 shutdown_connections 2023-12-20T04:51:46.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.818+0000 7f636155c640 1 -- 172.21.15.132:0/894488775 wait complete. 2023-12-20T04:51:46.831 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:51:46.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.928+0000 7efe875ae640 1 Processor -- start 2023-12-20T04:51:46.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.928+0000 7efe875ae640 1 -- start start 2023-12-20T04:51:46.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.929+0000 7efe875ae640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe80159b50 0x7efe800c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.929+0000 7efe875ae640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7efe8015e530 0x7efe8006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.929+0000 7efe875ae640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7efe800ccf30 con 0x7efe8006c240 2023-12-20T04:51:46.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.929+0000 7efe875ae640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7efe800caa60 con 0x7efe8015e530 2023-12-20T04:51:46.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.929+0000 7efe875ae640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe800ccc90 con 0x7efe80159b50 2023-12-20T04:51:46.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.929+0000 7efe8534a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe80159b50 0x7efe800c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.929+0000 7efe84b49640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7efe8015e530 0x7efe8006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.929+0000 7efe85b4b640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7efe8006c240 0x7efe800cd3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:33416/0 (socket says 172.21.15.132:33416) 2023-12-20T04:51:46.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.929+0000 7efe85b4b640 1 -- 172.21.15.132:0/3511461237 learned_addr learned my addr 172.21.15.132:0/3511461237 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:46.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.929+0000 7efe84b49640 1 --2- 172.21.15.132:0/3511461237 >> v2:172.21.15.187:3300/0 conn(0x7efe8015e530 0x7efe8006fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:50568/0 (socket says 172.21.15.132:50568) 2023-12-20T04:51:46.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.930+0000 7efe84b49640 1 -- 172.21.15.132:0/3511461237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe80159b50 msgr2=0x7efe800c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:46.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.930+0000 7efe84b49640 1 --2- 172.21.15.132:0/3511461237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe80159b50 0x7efe800c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.930+0000 7efe84b49640 1 -- 172.21.15.132:0/3511461237 >> v1:172.21.15.187:6789/0 conn(0x7efe8006c240 legacy=0x7efe800cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.930+0000 7efe77fff640 1 -- 172.21.15.132:0/3511461237 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2012708815 0 0) 0x7efe800ccf30 con 0x7efe8006c240 2023-12-20T04:51:46.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.930+0000 7efe84b49640 1 -- 172.21.15.132:0/3511461237 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe800ca1c0 con 0x7efe8015e530 2023-12-20T04:51:46.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.930+0000 7efe8534a640 1 --2- 172.21.15.132:0/3511461237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe80159b50 0x7efe800c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:51:46.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.931+0000 7efe84b49640 1 --2- 172.21.15.132:0/3511461237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe8015e530 0x7efe8006fd70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efe700097a0 tx=0x7efe7002b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9dab8a1ddb45b3f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:46.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.931+0000 7efe77fff640 1 -- 172.21.15.132:0/3511461237 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70031830 con 0x7efe8015e530 2023-12-20T04:51:46.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.931+0000 7efe77fff640 1 -- 172.21.15.132:0/3511461237 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70031990 con 0x7efe8015e530 2023-12-20T04:51:46.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.931+0000 7efe77fff640 1 -- 172.21.15.132:0/3511461237 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70031d20 con 0x7efe8015e530 2023-12-20T04:51:46.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.931+0000 7efe875ae640 1 -- 172.21.15.132:0/3511461237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe8015e530 msgr2=0x7efe8006fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.931+0000 7efe875ae640 1 --2- 172.21.15.132:0/3511461237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe8015e530 0x7efe8006fd70 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7efe700097a0 tx=0x7efe7002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.931+0000 7efe875ae640 1 -- 172.21.15.132:0/3511461237 shutdown_connections 2023-12-20T04:51:46.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.931+0000 7efe875ae640 1 --2- 172.21.15.132:0/3511461237 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe8015e530 0x7efe8006fd70 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.931+0000 7efe875ae640 1 --2- 172.21.15.132:0/3511461237 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe80159b50 0x7efe800c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.934 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.931+0000 7efe875ae640 1 -- 172.21.15.132:0/3511461237 >> 172.21.15.132:0/3511461237 conn(0x7efe800ced10 msgr2=0x7efe800cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:46.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.931+0000 7efe875ae640 1 -- 172.21.15.132:0/3511461237 shutdown_connections 2023-12-20T04:51:46.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.931+0000 7efe875ae640 1 -- 172.21.15.132:0/3511461237 wait complete. 2023-12-20T04:51:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.932+0000 7efe875ae640 1 Processor -- start 2023-12-20T04:51:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.933+0000 7efe875ae640 1 -- start start 2023-12-20T04:51:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.933+0000 7efe875ae640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe8006c240 0x7efe801583f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.933+0000 7efe875ae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe80159b50 0x7efe80152170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.933+0000 7efe875ae640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe8015e530 0x7efe8015a9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.933+0000 7efe875ae640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe80157350 con 0x7efe80159b50 2023-12-20T04:51:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.933+0000 7efe875ae640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe80157630 con 0x7efe8015e530 2023-12-20T04:51:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.933+0000 7efe875ae640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7efe80157910 con 0x7efe8006c240 2023-12-20T04:51:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.933+0000 7efe84b49640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe80159b50 0x7efe80152170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.933+0000 7efe84b49640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe80159b50 0x7efe80152170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52330/0 (socket says 172.21.15.132:52330) 2023-12-20T04:51:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.933+0000 7efe84b49640 1 -- 172.21.15.132:0/827510203 learned_addr learned my addr 172.21.15.132:0/827510203 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.934+0000 7efe85b4b640 1 --2- 172.21.15.132:0/827510203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe8015e530 0x7efe8015a9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.934+0000 7efe8534a640 1 --2- 172.21.15.132:0/827510203 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe8006c240 0x7efe801583f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.934+0000 7efe84b49640 1 -- 172.21.15.132:0/827510203 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe8006c240 msgr2=0x7efe801583f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.934+0000 7efe84b49640 1 --2- 172.21.15.132:0/827510203 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe8006c240 0x7efe801583f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.934+0000 7efe84b49640 1 -- 172.21.15.132:0/827510203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe8015e530 msgr2=0x7efe8015a9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.934+0000 7efe84b49640 1 --2- 172.21.15.132:0/827510203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe8015e530 0x7efe8015a9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.934+0000 7efe84b49640 1 -- 172.21.15.132:0/827510203 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe7c009400 con 0x7efe80159b50 2023-12-20T04:51:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.934+0000 7efe85b4b640 1 --2- 172.21.15.132:0/827510203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe8015e530 0x7efe8015a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.934+0000 7efe84b49640 1 --2- 172.21.15.132:0/827510203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe80159b50 0x7efe80152170 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7efe70000c00 tx=0x7efe700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.934+0000 7efe75ffb640 1 -- 172.21.15.132:0/827510203 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe70004230 con 0x7efe80159b50 2023-12-20T04:51:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.934+0000 7efe75ffb640 1 -- 172.21.15.132:0/827510203 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7efe70004390 con 0x7efe80159b50 2023-12-20T04:51:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.934+0000 7efe875ae640 1 -- 172.21.15.132:0/827510203 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe70009400 con 0x7efe80159b50 2023-12-20T04:51:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.934+0000 7efe75ffb640 1 -- 172.21.15.132:0/827510203 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7efe7003a880 con 0x7efe80159b50 2023-12-20T04:51:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.934+0000 7efe875ae640 1 -- 172.21.15.132:0/827510203 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe80157ed0 con 0x7efe80159b50 2023-12-20T04:51:46.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.935+0000 7efe875ae640 1 -- 172.21.15.132:0/827510203 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe8004e840 con 0x7efe80159b50 2023-12-20T04:51:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.936+0000 7efe75ffb640 1 -- 172.21.15.132:0/827510203 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7efe7003a9e0 con 0x7efe80159b50 2023-12-20T04:51:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.936+0000 7efe75ffb640 1 --2- 172.21.15.132:0/827510203 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efe6406a430 0x7efe6406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.936+0000 7efe75ffb640 1 -- 172.21.15.132:0/827510203 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5709+0+0 (secure 0 0 0) 0x7efe700aaf60 con 0x7efe80159b50 2023-12-20T04:51:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.936+0000 7efe8534a640 1 --2- 172.21.15.132:0/827510203 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efe6406a430 0x7efe6406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:46.939 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.936+0000 7efe8534a640 1 --2- 172.21.15.132:0/827510203 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efe6406a430 0x7efe6406c8f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7efe7c009b80 tx=0x7efe7c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:46.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:46.940+0000 7efe75ffb640 1 -- 172.21.15.132:0/827510203 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7efe70076700 con 0x7efe80159b50 2023-12-20T04:51:47.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.106+0000 7efe875ae640 1 -- 172.21.15.132:0/827510203 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7efe800b4c90 con 0x7efe80159b50 2023-12-20T04:51:47.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.108+0000 7efe75ffb640 1 -- 172.21.15.132:0/827510203 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v168) v1 ==== 74+0+16173 (secure 0 0 0) 0x7efe70079d20 con 0x7efe80159b50 2023-12-20T04:51:47.110 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:47.110 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":168,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:51:46.507827+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:51:44.739391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-20T04:51:45.486167+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:51:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.110+0000 7efe875ae640 1 -- 172.21.15.132:0/827510203 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efe6406a430 msgr2=0x7efe6406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.110+0000 7efe875ae640 1 --2- 172.21.15.132:0/827510203 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efe6406a430 0x7efe6406c8f0 secure :-1 s=READY pgs=696 cs=0 l=1 rev1=1 crypto rx=0x7efe7c009b80 tx=0x7efe7c008040 comp rx=0 tx=0).stop 2023-12-20T04:51:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.110+0000 7efe875ae640 1 -- 172.21.15.132:0/827510203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe80159b50 msgr2=0x7efe80152170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.110+0000 7efe875ae640 1 --2- 172.21.15.132:0/827510203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe80159b50 0x7efe80152170 secure :-1 s=READY pgs=1649 cs=0 l=1 rev1=1 crypto rx=0x7efe70000c00 tx=0x7efe700046c0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.110+0000 7efe875ae640 1 -- 172.21.15.132:0/827510203 shutdown_connections 2023-12-20T04:51:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.110+0000 7efe875ae640 1 --2- 172.21.15.132:0/827510203 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7efe6406a430 0x7efe6406c8f0 unknown :-1 s=CLOSED pgs=696 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.110+0000 7efe875ae640 1 --2- 172.21.15.132:0/827510203 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7efe8015e530 0x7efe8015a9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.110+0000 7efe875ae640 1 --2- 172.21.15.132:0/827510203 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7efe80159b50 0x7efe80152170 unknown :-1 s=CLOSED pgs=1649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.110+0000 7efe875ae640 1 --2- 172.21.15.132:0/827510203 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7efe8006c240 0x7efe801583f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.110+0000 7efe875ae640 1 -- 172.21.15.132:0/827510203 >> 172.21.15.132:0/827510203 conn(0x7efe800ced10 msgr2=0x7efe80070fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:47.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.110+0000 7efe875ae640 1 -- 172.21.15.132:0/827510203 shutdown_connections 2023-12-20T04:51:47.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.110+0000 7efe875ae640 1 -- 172.21.15.132:0/827510203 wait complete. 2023-12-20T04:51:47.123 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-20T04:51:47.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.224+0000 7f4aa044a640 1 Processor -- start 2023-12-20T04:51:47.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.224+0000 7f4aa044a640 1 -- start start 2023-12-20T04:51:47.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.225+0000 7f4aa044a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4a9815d300 0x7f4a9806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:47.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.225+0000 7f4aa044a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4a980cd4b0 0x7f4a980cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:47.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.225+0000 7f4aa044a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4a9806cc90 con 0x7f4a9815cf20 2023-12-20T04:51:47.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.225+0000 7f4aa044a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a980cde60 con 0x7f4a980cd4b0 2023-12-20T04:51:47.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.225+0000 7f4aa044a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4a980b2f30 con 0x7f4a9815d300 2023-12-20T04:51:47.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.226+0000 7f4a9e9e7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4a980cd4b0 0x7f4a980cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:47.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.226+0000 7f4a9e9e7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4a980cd4b0 0x7f4a980cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52344/0 (socket says 172.21.15.132:52344) 2023-12-20T04:51:47.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.226+0000 7f4a9e9e7640 1 -- 172.21.15.132:0/2520084270 learned_addr learned my addr 172.21.15.132:0/2520084270 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:47.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.226+0000 7f4a9d9e5640 1 --2- 172.21.15.132:0/2520084270 >> v2:172.21.15.187:3300/0 conn(0x7f4a9815d300 0x7f4a9806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:47.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.226+0000 7f4a9e9e7640 1 -- 172.21.15.132:0/2520084270 >> v2:172.21.15.187:3300/0 conn(0x7f4a9815d300 msgr2=0x7f4a9806c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:47.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.226+0000 7f4a9e9e7640 1 --2- 172.21.15.132:0/2520084270 >> v2:172.21.15.187:3300/0 conn(0x7f4a9815d300 0x7f4a9806c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.226+0000 7f4a9e9e7640 1 -- 172.21.15.132:0/2520084270 >> v1:172.21.15.187:6789/0 conn(0x7f4a9815cf20 legacy=0x7f4a98161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:47.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.226+0000 7f4a9e9e7640 1 -- 172.21.15.132:0/2520084270 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a980b3210 con 0x7f4a980cd4b0 2023-12-20T04:51:47.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.227+0000 7f4a9e9e7640 1 --2- 172.21.15.132:0/2520084270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a980cd4b0 0x7f4a980cd920 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f4a9806bd40 tx=0x7f4a9002bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be88c3ff8fd778a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:47.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.227+0000 7f4a9d1e4640 1 -- 172.21.15.132:0/2520084270 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a9002cb20 con 0x7f4a980cd4b0 2023-12-20T04:51:47.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.227+0000 7f4a9d1e4640 1 -- 172.21.15.132:0/2520084270 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a9002cc80 con 0x7f4a980cd4b0 2023-12-20T04:51:47.230 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.227+0000 7f4a9d1e4640 1 -- 172.21.15.132:0/2520084270 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a900343f0 con 0x7f4a980cd4b0 2023-12-20T04:51:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.227+0000 7f4aa044a640 1 -- 172.21.15.132:0/2520084270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a980cd4b0 msgr2=0x7f4a980cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.227+0000 7f4aa044a640 1 --2- 172.21.15.132:0/2520084270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a980cd4b0 0x7f4a980cd920 secure :-1 s=READY pgs=1650 cs=0 l=1 rev1=1 crypto rx=0x7f4a9806bd40 tx=0x7f4a9002bf80 comp rx=0 tx=0).stop 2023-12-20T04:51:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.227+0000 7f4aa044a640 1 -- 172.21.15.132:0/2520084270 shutdown_connections 2023-12-20T04:51:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.227+0000 7f4aa044a640 1 --2- 172.21.15.132:0/2520084270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a980cd4b0 0x7f4a980cd920 unknown :-1 s=CLOSED pgs=1650 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.227+0000 7f4aa044a640 1 --2- 172.21.15.132:0/2520084270 >> v2:172.21.15.187:3300/0 conn(0x7f4a9815d300 0x7f4a9806c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.227+0000 7f4aa044a640 1 -- 172.21.15.132:0/2520084270 >> 172.21.15.132:0/2520084270 conn(0x7f4a98072c60 msgr2=0x7f4a98073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.227+0000 7f4aa044a640 1 -- 172.21.15.132:0/2520084270 shutdown_connections 2023-12-20T04:51:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.227+0000 7f4aa044a640 1 -- 172.21.15.132:0/2520084270 wait complete. 2023-12-20T04:51:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.229+0000 7f4aa044a640 1 Processor -- start 2023-12-20T04:51:47.231 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.229+0000 7f4aa044a640 1 -- start start 2023-12-20T04:51:47.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.229+0000 7f4aa044a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a980cd4b0 0x7f4a9814c240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:47.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.229+0000 7f4aa044a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a9815cf20 0x7f4a980aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:47.233 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.229+0000 7f4aa044a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a9815d300 0x7f4a981e7720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.229+0000 7f4aa044a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a980ada60 con 0x7f4a980cd4b0 2023-12-20T04:51:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.229+0000 7f4aa044a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4a980add40 con 0x7f4a9815cf20 2023-12-20T04:51:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.229+0000 7f4aa044a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4a980ae020 con 0x7f4a9815d300 2023-12-20T04:51:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.229+0000 7f4a9e1e6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a980cd4b0 0x7f4a9814c240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.229+0000 7f4a9e1e6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a980cd4b0 0x7f4a9814c240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52356/0 (socket says 172.21.15.132:52356) 2023-12-20T04:51:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.229+0000 7f4a9e1e6640 1 -- 172.21.15.132:0/2702292880 learned_addr learned my addr 172.21.15.132:0/2702292880 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.230+0000 7f4a9d9e5640 1 --2- 172.21.15.132:0/2702292880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a9815cf20 0x7f4a980aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.230+0000 7f4a9e1e6640 1 -- 172.21.15.132:0/2702292880 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a9815d300 msgr2=0x7f4a981e7720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.230+0000 7f4a9e9e7640 1 --2- 172.21.15.132:0/2702292880 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a9815d300 0x7f4a981e7720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.230+0000 7f4a9e1e6640 1 --2- 172.21.15.132:0/2702292880 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a9815d300 0x7f4a981e7720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.230+0000 7f4a9e1e6640 1 -- 172.21.15.132:0/2702292880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a9815cf20 msgr2=0x7f4a980aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.230+0000 7f4a9e1e6640 1 --2- 172.21.15.132:0/2702292880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a9815cf20 0x7f4a980aeb00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.234 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.230+0000 7f4a9e1e6640 1 -- 172.21.15.132:0/2702292880 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4a90009b30 con 0x7f4a980cd4b0 2023-12-20T04:51:47.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.230+0000 7f4a9d9e5640 1 --2- 172.21.15.132:0/2702292880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a9815cf20 0x7f4a980aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:47.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.230+0000 7f4a9e1e6640 1 --2- 172.21.15.132:0/2702292880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a980cd4b0 0x7f4a9814c240 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800c450 tx=0x7f4a8800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:47.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.230+0000 7f4a8effd640 1 -- 172.21.15.132:0/2702292880 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a880052d0 con 0x7f4a980cd4b0 2023-12-20T04:51:47.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.230+0000 7f4a8effd640 1 -- 172.21.15.132:0/2702292880 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4a88005430 con 0x7f4a980cd4b0 2023-12-20T04:51:47.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.230+0000 7f4a8effd640 1 -- 172.21.15.132:0/2702292880 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4a88012870 con 0x7f4a980cd4b0 2023-12-20T04:51:47.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.230+0000 7f4aa044a640 1 -- 172.21.15.132:0/2702292880 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4a980ae300 con 0x7f4a980cd4b0 2023-12-20T04:51:47.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.230+0000 7f4aa044a640 1 -- 172.21.15.132:0/2702292880 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4a981f3a60 con 0x7f4a980cd4b0 2023-12-20T04:51:47.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.231+0000 7f4aa044a640 1 -- 172.21.15.132:0/2702292880 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4a9804e840 con 0x7f4a980cd4b0 2023-12-20T04:51:47.235 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.232+0000 7f4a8effd640 1 -- 172.21.15.132:0/2702292880 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4a880129d0 con 0x7f4a980cd4b0 2023-12-20T04:51:47.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.232+0000 7f4a8effd640 1 --2- 172.21.15.132:0/2702292880 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a7c06a430 0x7f4a7c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:47.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.232+0000 7f4a9d9e5640 1 --2- 172.21.15.132:0/2702292880 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a7c06a430 0x7f4a7c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:47.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.232+0000 7f4a8effd640 1 -- 172.21.15.132:0/2702292880 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(168..168 src has 1..168) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4a88088380 con 0x7f4a980cd4b0 2023-12-20T04:51:47.236 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.233+0000 7f4a9d9e5640 1 --2- 172.21.15.132:0/2702292880 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a7c06a430 0x7f4a7c06c8f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4a94006fd0 tx=0x7f4a94008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:47.238 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.236+0000 7f4a8effd640 1 -- 172.21.15.132:0/2702292880 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4a88053a00 con 0x7f4a980cd4b0 2023-12-20T04:51:47.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.439+0000 7f4aa044a640 1 -- 172.21.15.132:0/2702292880 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7f4a9815d7b0 con 0x7f4a980cd4b0 2023-12-20T04:51:47.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.515+0000 7f4a8effd640 1 -- 172.21.15.132:0/2702292880 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v62) v1 ==== 118+0+0 (secure 0 0 0) 0x7f4a88057020 con 0x7f4a980cd4b0 2023-12-20T04:51:47.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.517+0000 7f4aa044a640 1 -- 172.21.15.132:0/2702292880 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a7c06a430 msgr2=0x7f4a7c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.517+0000 7f4aa044a640 1 --2- 172.21.15.132:0/2702292880 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a7c06a430 0x7f4a7c06c8f0 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4a94006fd0 tx=0x7f4a94008040 comp rx=0 tx=0).stop 2023-12-20T04:51:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.517+0000 7f4aa044a640 1 -- 172.21.15.132:0/2702292880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a980cd4b0 msgr2=0x7f4a9814c240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.517+0000 7f4aa044a640 1 --2- 172.21.15.132:0/2702292880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a980cd4b0 0x7f4a9814c240 secure :-1 s=READY pgs=1651 cs=0 l=1 rev1=1 crypto rx=0x7f4a8800c450 tx=0x7f4a8800c910 comp rx=0 tx=0).stop 2023-12-20T04:51:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.517+0000 7f4aa044a640 1 -- 172.21.15.132:0/2702292880 shutdown_connections 2023-12-20T04:51:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.517+0000 7f4aa044a640 1 --2- 172.21.15.132:0/2702292880 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4a7c06a430 0x7f4a7c06c8f0 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.517+0000 7f4aa044a640 1 --2- 172.21.15.132:0/2702292880 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4a9815d300 0x7f4a981e7720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.517+0000 7f4aa044a640 1 --2- 172.21.15.132:0/2702292880 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4a9815cf20 0x7f4a980aeb00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.517+0000 7f4aa044a640 1 --2- 172.21.15.132:0/2702292880 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4a980cd4b0 0x7f4a9814c240 unknown :-1 s=CLOSED pgs=1651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.517+0000 7f4aa044a640 1 -- 172.21.15.132:0/2702292880 >> 172.21.15.132:0/2702292880 conn(0x7f4a98072c60 msgr2=0x7f4a9815bea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.517+0000 7f4aa044a640 1 -- 172.21.15.132:0/2702292880 shutdown_connections 2023-12-20T04:51:47.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.517+0000 7f4aa044a640 1 -- 172.21.15.132:0/2702292880 wait complete. 2023-12-20T04:51:47.530 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-20T04:51:47.531 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-20T04:51:47.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.631+0000 7f7c2684a640 1 Processor -- start 2023-12-20T04:51:47.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.631+0000 7f7c2684a640 1 -- start start 2023-12-20T04:51:47.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.632+0000 7f7c2684a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c2015d300 0x7f7c2006c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:47.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.632+0000 7f7c2684a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7c200cd4b0 0x7f7c200cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:47.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.632+0000 7f7c2684a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7c2006cc90 con 0x7f7c2015cf20 2023-12-20T04:51:47.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.632+0000 7f7c2684a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7c200cde60 con 0x7f7c200cd4b0 2023-12-20T04:51:47.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.632+0000 7f7c2684a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200b2f30 con 0x7f7c2015d300 2023-12-20T04:51:47.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.632+0000 7f7c1ffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7c2015cf20 0x7f7c20161700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47944/0 (socket says 172.21.15.132:47944) 2023-12-20T04:51:47.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.632+0000 7f7c1ffff640 1 -- 172.21.15.132:0/2853814973 learned_addr learned my addr 172.21.15.132:0/2853814973 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:47.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.632+0000 7f7c1effd640 1 -- 172.21.15.132:0/2853814973 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2584802908 0 0) 0x7f7c2006cc90 con 0x7f7c2015cf20 2023-12-20T04:51:47.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.632+0000 7f7c1effd640 1 -- 172.21.15.132:0/2853814973 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7c08003520 con 0x7f7c2015cf20 2023-12-20T04:51:47.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.632+0000 7f7c24de7640 1 --2- 172.21.15.132:0/2853814973 >> v2:172.21.15.187:3300/0 conn(0x7f7c200cd4b0 0x7f7c200cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:47.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1f7fe640 1 --2- 172.21.15.132:0/2853814973 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c2015d300 0x7f7c2006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:47.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1effd640 1 -- 172.21.15.132:0/2853814973 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1994942857 0 0) 0x7f7c08003520 con 0x7f7c2015cf20 2023-12-20T04:51:47.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1effd640 1 -- 172.21.15.132:0/2853814973 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c2015d300 msgr2=0x7f7c2006c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:47.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1effd640 1 --2- 172.21.15.132:0/2853814973 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c2015d300 0x7f7c2006c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1effd640 1 -- 172.21.15.132:0/2853814973 >> v2:172.21.15.187:3300/0 conn(0x7f7c200cd4b0 msgr2=0x7f7c200cd920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:47.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1effd640 1 --2- 172.21.15.132:0/2853814973 >> v2:172.21.15.187:3300/0 conn(0x7f7c200cd4b0 0x7f7c200cd920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1effd640 1 -- 172.21.15.132:0/2853814973 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c200b3210 con 0x7f7c2015cf20 2023-12-20T04:51:47.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1effd640 1 -- 172.21.15.132:0/2853814973 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f7c10001670 con 0x7f7c2015cf20 2023-12-20T04:51:47.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1f7fe640 1 --2- 172.21.15.132:0/2853814973 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c2015d300 0x7f7c2006c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:47.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1effd640 1 -- 172.21.15.132:0/2853814973 >> v1:172.21.15.132:6789/0 conn(0x7f7c2015cf20 legacy=0x7f7c20161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:47.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1effd640 1 --2- 172.21.15.132:0/2853814973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c08003970 0x7f7c08003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1effd640 1 --2- 172.21.15.132:0/2853814973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c080047c0 0x7f7c08004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1effd640 1 --2- 172.21.15.132:0/2853814973 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c2015d300 0x7f7c08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1effd640 1 -- 172.21.15.132:0/2853814973 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200cde60 con 0x7f7c080047c0 2023-12-20T04:51:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1effd640 1 -- 172.21.15.132:0/2853814973 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200b2f30 con 0x7f7c08003970 2023-12-20T04:51:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1effd640 1 -- 172.21.15.132:0/2853814973 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c0800b980 con 0x7f7c2015d300 2023-12-20T04:51:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1f7fe640 1 --2- 172.21.15.132:0/2853814973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c080047c0 0x7f7c08004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1ffff640 1 --2- 172.21.15.132:0/2853814973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c08003970 0x7f7c08003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c24de7640 1 --2- 172.21.15.132:0/2853814973 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c2015d300 0x7f7c08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1f7fe640 1 -- 172.21.15.132:0/2853814973 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c2015d300 msgr2=0x7f7c08005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1f7fe640 1 --2- 172.21.15.132:0/2853814973 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c2015d300 0x7f7c08005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1f7fe640 1 -- 172.21.15.132:0/2853814973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c08003970 msgr2=0x7f7c08003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1f7fe640 1 --2- 172.21.15.132:0/2853814973 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c08003970 0x7f7c08003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.633+0000 7f7c1f7fe640 1 -- 172.21.15.132:0/2853814973 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c08003520 con 0x7f7c080047c0 2023-12-20T04:51:47.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.634+0000 7f7c1f7fe640 1 --2- 172.21.15.132:0/2853814973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c080047c0 0x7f7c08004c40 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f7c140098d0 tx=0x7f7c080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22e8fdee514ad7e7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.634+0000 7f7c1effd640 1 -- 172.21.15.132:0/2853814973 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14004230 con 0x7f7c080047c0 2023-12-20T04:51:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.634+0000 7f7c1effd640 1 -- 172.21.15.132:0/2853814973 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c14004390 con 0x7f7c080047c0 2023-12-20T04:51:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.634+0000 7f7c1effd640 1 -- 172.21.15.132:0/2853814973 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14003830 con 0x7f7c080047c0 2023-12-20T04:51:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.635+0000 7f7c2684a640 1 -- 172.21.15.132:0/2853814973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c080047c0 msgr2=0x7f7c08004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.635+0000 7f7c2684a640 1 --2- 172.21.15.132:0/2853814973 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c080047c0 0x7f7c08004c40 secure :-1 s=READY pgs=1653 cs=0 l=1 rev1=1 crypto rx=0x7f7c140098d0 tx=0x7f7c080057f0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.635+0000 7f7c24de7640 1 -- 172.21.15.132:0/2853814973 reap_dead start 2023-12-20T04:51:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.635+0000 7f7c2684a640 1 -- 172.21.15.132:0/2853814973 shutdown_connections 2023-12-20T04:51:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.635+0000 7f7c2684a640 1 -- 172.21.15.132:0/2853814973 >> 172.21.15.132:0/2853814973 conn(0x7f7c20072c60 msgr2=0x7f7c20073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.635+0000 7f7c2684a640 1 -- 172.21.15.132:0/2853814973 shutdown_connections 2023-12-20T04:51:47.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.635+0000 7f7c2684a640 1 -- 172.21.15.132:0/2853814973 wait complete. 2023-12-20T04:51:47.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.636+0000 7f7c2684a640 1 Processor -- start 2023-12-20T04:51:47.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.636+0000 7f7c2684a640 1 -- start start 2023-12-20T04:51:47.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c2684a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c080047c0 0x7f7c200c57e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:47.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c2684a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c200c6ed0 0x7f7c200ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:47.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c2684a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c200ace20 0x7f7c200af220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:47.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c2684a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200ad2b0 con 0x7f7c200c6ed0 2023-12-20T04:51:47.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c2684a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200c5e50 con 0x7f7c200ace20 2023-12-20T04:51:47.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c2684a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7c200c6130 con 0x7f7c080047c0 2023-12-20T04:51:47.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c1f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c200c6ed0 0x7f7c200ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:47.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c1f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c200c6ed0 0x7f7c200ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42564/0 (socket says 172.21.15.132:42564) 2023-12-20T04:51:47.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c1f7fe640 1 -- 172.21.15.132:0/2440086373 learned_addr learned my addr 172.21.15.132:0/2440086373 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:47.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c24de7640 1 --2- 172.21.15.132:0/2440086373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c200ace20 0x7f7c200af220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:47.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c1ffff640 1 --2- 172.21.15.132:0/2440086373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c080047c0 0x7f7c200c57e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:47.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c1f7fe640 1 -- 172.21.15.132:0/2440086373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c080047c0 msgr2=0x7f7c200c57e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:47.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c1f7fe640 1 --2- 172.21.15.132:0/2440086373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c080047c0 0x7f7c200c57e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c1f7fe640 1 -- 172.21.15.132:0/2440086373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c200ace20 msgr2=0x7f7c200af220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:47.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c1f7fe640 1 --2- 172.21.15.132:0/2440086373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c200ace20 0x7f7c200af220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:47.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c1f7fe640 1 -- 172.21.15.132:0/2440086373 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c200c6410 con 0x7f7c200c6ed0 2023-12-20T04:51:47.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c1ffff640 1 --2- 172.21.15.132:0/2440086373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c080047c0 0x7f7c200c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:47.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c1f7fe640 1 --2- 172.21.15.132:0/2440086373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c200c6ed0 0x7f7c200ac8e0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f7c1402bea0 tx=0x7f7c14004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:47.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c1cff9640 1 -- 172.21.15.132:0/2440086373 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14030610 con 0x7f7c200c6ed0 2023-12-20T04:51:47.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c1cff9640 1 -- 172.21.15.132:0/2440086373 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7c14030770 con 0x7f7c200c6ed0 2023-12-20T04:51:47.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c2684a640 1 -- 172.21.15.132:0/2440086373 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c200c66f0 con 0x7f7c200c6ed0 2023-12-20T04:51:47.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c1cff9640 1 -- 172.21.15.132:0/2440086373 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7c14030b20 con 0x7f7c200c6ed0 2023-12-20T04:51:47.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.637+0000 7f7c2684a640 1 -- 172.21.15.132:0/2440086373 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c200af760 con 0x7f7c200c6ed0 2023-12-20T04:51:47.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.638+0000 7f7c2684a640 1 -- 172.21.15.132:0/2440086373 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c200ad230 con 0x7f7c200c6ed0 2023-12-20T04:51:47.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.639+0000 7f7c1cff9640 1 -- 172.21.15.132:0/2440086373 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7c14030c80 con 0x7f7c200c6ed0 2023-12-20T04:51:47.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.639+0000 7f7c1cff9640 1 --2- 172.21.15.132:0/2440086373 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c0c06a430 0x7f7c0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:47.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.639+0000 7f7c1cff9640 1 -- 172.21.15.132:0/2440086373 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7c140aa280 con 0x7f7c200c6ed0 2023-12-20T04:51:47.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.639+0000 7f7c1ffff640 1 --2- 172.21.15.132:0/2440086373 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c0c06a430 0x7f7c0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:47.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.640+0000 7f7c1ffff640 1 --2- 172.21.15.132:0/2440086373 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c0c06a430 0x7f7c0c06c8f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7c100015d0 tx=0x7f7c10009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:47.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.643+0000 7f7c1cff9640 1 -- 172.21.15.132:0/2440086373 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7c140759b0 con 0x7f7c200c6ed0 2023-12-20T04:51:47.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:47.848+0000 7f7c2684a640 1 -- 172.21.15.132:0/2440086373 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f7c2004e840 con 0x7f7c200c6ed0 2023-12-20T04:51:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.517+0000 7f7c1cff9640 1 -- 172.21.15.132:0/2440086373 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v63) v1 ==== 122+0+0 (secure 0 0 0) 0x7f7c14006e10 con 0x7f7c200c6ed0 2023-12-20T04:51:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.519+0000 7f7c2684a640 1 -- 172.21.15.132:0/2440086373 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c0c06a430 msgr2=0x7f7c0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.519+0000 7f7c2684a640 1 --2- 172.21.15.132:0/2440086373 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c0c06a430 0x7f7c0c06c8f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f7c100015d0 tx=0x7f7c10009040 comp rx=0 tx=0).stop 2023-12-20T04:51:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.519+0000 7f7c2684a640 1 -- 172.21.15.132:0/2440086373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c200c6ed0 msgr2=0x7f7c200ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.519+0000 7f7c2684a640 1 --2- 172.21.15.132:0/2440086373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c200c6ed0 0x7f7c200ac8e0 secure :-1 s=READY pgs=1654 cs=0 l=1 rev1=1 crypto rx=0x7f7c1402bea0 tx=0x7f7c14004730 comp rx=0 tx=0).stop 2023-12-20T04:51:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.519+0000 7f7c2684a640 1 -- 172.21.15.132:0/2440086373 shutdown_connections 2023-12-20T04:51:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.519+0000 7f7c2684a640 1 --2- 172.21.15.132:0/2440086373 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7c0c06a430 0x7f7c0c06c8f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.519+0000 7f7c2684a640 1 --2- 172.21.15.132:0/2440086373 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7c200ace20 0x7f7c200af220 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.519+0000 7f7c2684a640 1 --2- 172.21.15.132:0/2440086373 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7c200c6ed0 0x7f7c200ac8e0 unknown :-1 s=CLOSED pgs=1654 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.519+0000 7f7c2684a640 1 --2- 172.21.15.132:0/2440086373 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7c080047c0 0x7f7c200c57e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.519+0000 7f7c2684a640 1 -- 172.21.15.132:0/2440086373 >> 172.21.15.132:0/2440086373 conn(0x7f7c20072c60 msgr2=0x7f7c200b14a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.519+0000 7f7c2684a640 1 -- 172.21.15.132:0/2440086373 shutdown_connections 2023-12-20T04:51:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.519+0000 7f7c2684a640 1 -- 172.21.15.132:0/2440086373 wait complete. 2023-12-20T04:51:48.534 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-20T04:51:48.534 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:51:48.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.634+0000 7f05186a0640 1 Processor -- start 2023-12-20T04:51:48.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.634+0000 7f05186a0640 1 -- start start 2023-12-20T04:51:48.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.635+0000 7f05186a0640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f05100b4980 0x7f05100b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:48.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.635+0000 7f05186a0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05100d1aa0 0x7f05100d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:48.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.635+0000 7f05186a0640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f05100b5320 con 0x7f0510160450 2023-12-20T04:51:48.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.635+0000 7f05186a0640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f05100b5ec0 con 0x7f05100b4980 2023-12-20T04:51:48.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.635+0000 7f05186a0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05101617e0 con 0x7f05100d1aa0 2023-12-20T04:51:48.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.636+0000 7f0516c3d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05100d1aa0 0x7f05100d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:48.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.636+0000 7f0515c3b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f05100b4980 0x7f05100b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:48.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.636+0000 7f0516c3d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05100d1aa0 0x7f05100d1f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:37826/0 (socket says 172.21.15.132:37826) 2023-12-20T04:51:48.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.636+0000 7f0516c3d640 1 -- 172.21.15.132:0/4225795735 learned_addr learned my addr 172.21.15.132:0/4225795735 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:48.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.636+0000 7f051643c640 1 --1- 172.21.15.132:0/4225795735 >> v1:172.21.15.187:6789/0 conn(0x7f0510160450 0x7f0510160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:36114/0 (socket says 172.21.15.132:36114) 2023-12-20T04:51:48.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.636+0000 7f0516c3d640 1 -- 172.21.15.132:0/4225795735 >> v2:172.21.15.187:3300/0 conn(0x7f05100b4980 msgr2=0x7f05100b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:48.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.636+0000 7f0516c3d640 1 --2- 172.21.15.132:0/4225795735 >> v2:172.21.15.187:3300/0 conn(0x7f05100b4980 0x7f05100b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:48.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.636+0000 7f0516c3d640 1 -- 172.21.15.132:0/4225795735 >> v1:172.21.15.187:6789/0 conn(0x7f0510160450 legacy=0x7f0510160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:48.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.636+0000 7f0516c3d640 1 -- 172.21.15.132:0/4225795735 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f05100d0fc0 con 0x7f05100d1aa0 2023-12-20T04:51:48.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.636+0000 7f0515c3b640 1 --2- 172.21.15.132:0/4225795735 >> v2:172.21.15.187:3300/0 conn(0x7f05100b4980 0x7f05100b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:51:48.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.637+0000 7f0516c3d640 1 --2- 172.21.15.132:0/4225795735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05100d1aa0 0x7f05100d1f30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0500009870 tx=0x7f050002ba20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=781e52f9bd3badb9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:48.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.637+0000 7f051543a640 1 -- 172.21.15.132:0/4225795735 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050002f840 con 0x7f05100d1aa0 2023-12-20T04:51:48.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.637+0000 7f051543a640 1 -- 172.21.15.132:0/4225795735 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f050002f9a0 con 0x7f05100d1aa0 2023-12-20T04:51:48.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.637+0000 7f051543a640 1 -- 172.21.15.132:0/4225795735 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f050002fd30 con 0x7f05100d1aa0 2023-12-20T04:51:48.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.638+0000 7f05186a0640 1 -- 172.21.15.132:0/4225795735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05100d1aa0 msgr2=0x7f05100d1f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:48.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.638+0000 7f05186a0640 1 --2- 172.21.15.132:0/4225795735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05100d1aa0 0x7f05100d1f30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f0500009870 tx=0x7f050002ba20 comp rx=0 tx=0).stop 2023-12-20T04:51:48.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.638+0000 7f05186a0640 1 -- 172.21.15.132:0/4225795735 shutdown_connections 2023-12-20T04:51:48.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.638+0000 7f05186a0640 1 --2- 172.21.15.132:0/4225795735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f05100d1aa0 0x7f05100d1f30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:48.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.638+0000 7f05186a0640 1 --2- 172.21.15.132:0/4225795735 >> v2:172.21.15.187:3300/0 conn(0x7f05100b4980 0x7f05100b4de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:48.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.638+0000 7f05186a0640 1 -- 172.21.15.132:0/4225795735 >> 172.21.15.132:0/4225795735 conn(0x7f05100cf980 msgr2=0x7f05100cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:48.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.638+0000 7f05186a0640 1 -- 172.21.15.132:0/4225795735 shutdown_connections 2023-12-20T04:51:48.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.638+0000 7f05186a0640 1 -- 172.21.15.132:0/4225795735 wait complete. 2023-12-20T04:51:48.643 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.639+0000 7f05186a0640 1 Processor -- start 2023-12-20T04:51:48.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.639+0000 7f05186a0640 1 -- start start 2023-12-20T04:51:48.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f05186a0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05100b4980 0x7f051015e960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:48.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f05186a0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05100d1aa0 0x7f051014b6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:48.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f05186a0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0510160450 0x7f051015cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:48.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f05186a0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05100cac80 con 0x7f05100b4980 2023-12-20T04:51:48.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f05186a0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f05100ca070 con 0x7f05100d1aa0 2023-12-20T04:51:48.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f05186a0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f05100ca350 con 0x7f0510160450 2023-12-20T04:51:48.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f051643c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05100b4980 0x7f051015e960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:48.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f051643c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05100b4980 0x7f051015e960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42566/0 (socket says 172.21.15.132:42566) 2023-12-20T04:51:48.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f051643c640 1 -- 172.21.15.132:0/1734755299 learned_addr learned my addr 172.21.15.132:0/1734755299 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:48.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f051643c640 1 -- 172.21.15.132:0/1734755299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0510160450 msgr2=0x7f051015cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:48.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f0516c3d640 1 --2- 172.21.15.132:0/1734755299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0510160450 0x7f051015cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:48.644 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f0515c3b640 1 --2- 172.21.15.132:0/1734755299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05100d1aa0 0x7f051014b6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f051643c640 1 --2- 172.21.15.132:0/1734755299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0510160450 0x7f051015cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f051643c640 1 -- 172.21.15.132:0/1734755299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05100d1aa0 msgr2=0x7f051014b6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f051643c640 1 --2- 172.21.15.132:0/1734755299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05100d1aa0 0x7f051014b6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f051643c640 1 -- 172.21.15.132:0/1734755299 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0504009a70 con 0x7f05100b4980 2023-12-20T04:51:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f0516c3d640 1 --2- 172.21.15.132:0/1734755299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0510160450 0x7f051015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f0515c3b640 1 --2- 172.21.15.132:0/1734755299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05100d1aa0 0x7f051014b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f051643c640 1 --2- 172.21.15.132:0/1734755299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05100b4980 0x7f051015e960 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f050800c3c0 tx=0x7f050800c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f050effd640 1 -- 172.21.15.132:0/1734755299 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f05080074e0 con 0x7f05100b4980 2023-12-20T04:51:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f050effd640 1 -- 172.21.15.132:0/1734755299 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0508007640 con 0x7f05100b4980 2023-12-20T04:51:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f050effd640 1 -- 172.21.15.132:0/1734755299 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0508004a00 con 0x7f05100b4980 2023-12-20T04:51:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.640+0000 7f05186a0640 1 -- 172.21.15.132:0/1734755299 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f05000094d0 con 0x7f05100b4980 2023-12-20T04:51:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.641+0000 7f05186a0640 1 -- 172.21.15.132:0/1734755299 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05100ca910 con 0x7f05100b4980 2023-12-20T04:51:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.641+0000 7f05186a0640 1 -- 172.21.15.132:0/1734755299 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f05100caaa0 con 0x7f05100b4980 2023-12-20T04:51:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.642+0000 7f050effd640 1 -- 172.21.15.132:0/1734755299 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0508004b60 con 0x7f05100b4980 2023-12-20T04:51:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.642+0000 7f050effd640 1 --2- 172.21.15.132:0/1734755299 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f04fc06a430 0x7f04fc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.642+0000 7f050effd640 1 -- 172.21.15.132:0/1734755299 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0508088280 con 0x7f05100b4980 2023-12-20T04:51:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.642+0000 7f0515c3b640 1 --2- 172.21.15.132:0/1734755299 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f04fc06a430 0x7f04fc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.643+0000 7f0515c3b640 1 --2- 172.21.15.132:0/1734755299 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f04fc06a430 0x7f04fc06c8f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0504009fd0 tx=0x7f050400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:48.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.646+0000 7f050effd640 1 -- 172.21.15.132:0/1734755299 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0508053870 con 0x7f05100b4980 2023-12-20T04:51:48.789 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:51:48.792 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:51:48.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.849+0000 7f05186a0640 1 -- 172.21.15.132:0/1734755299 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f051004e840 con 0x7f05100b4980 2023-12-20T04:51:48.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.849+0000 7f050effd640 1 -- 172.21.15.132:0/1734755299 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4725 (secure 0 0 0) 0x7f0508056e90 con 0x7f05100b4980 2023-12-20T04:51:48.851 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:48.852 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":63,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6644,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1464403338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1464403338},{"type":"v1","addr":"172.21.15.187:6834","nonce":1464403338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2717050899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2717050899},{"type":"v1","addr":"172.21.15.187:6835","nonce":2717050899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8709,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2430423967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2430423967},{"type":"v1","addr":"172.21.15.132:6836","nonce":2430423967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:51:46.508144+0000","modified":"2023-12-20T04:51:48.515251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8712":{"gid":8712,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1841932991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1841932991},{"type":"v1","addr":"172.21.15.132:6837","nonce":1841932991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-20T04:51:48.852 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 63 2023-12-20T04:51:48.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.851+0000 7f05186a0640 1 -- 172.21.15.132:0/1734755299 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f04fc06a430 msgr2=0x7f04fc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:48.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.851+0000 7f05186a0640 1 --2- 172.21.15.132:0/1734755299 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f04fc06a430 0x7f04fc06c8f0 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x7f0504009fd0 tx=0x7f050400b040 comp rx=0 tx=0).stop 2023-12-20T04:51:48.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.851+0000 7f05186a0640 1 -- 172.21.15.132:0/1734755299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05100b4980 msgr2=0x7f051015e960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:48.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.851+0000 7f05186a0640 1 --2- 172.21.15.132:0/1734755299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05100b4980 0x7f051015e960 secure :-1 s=READY pgs=1655 cs=0 l=1 rev1=1 crypto rx=0x7f050800c3c0 tx=0x7f050800c880 comp rx=0 tx=0).stop 2023-12-20T04:51:48.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.851+0000 7f05186a0640 1 -- 172.21.15.132:0/1734755299 shutdown_connections 2023-12-20T04:51:48.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.851+0000 7f05186a0640 1 --2- 172.21.15.132:0/1734755299 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f04fc06a430 0x7f04fc06c8f0 unknown :-1 s=CLOSED pgs=699 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:48.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.851+0000 7f05186a0640 1 --2- 172.21.15.132:0/1734755299 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0510160450 0x7f051015cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:48.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.851+0000 7f05186a0640 1 --2- 172.21.15.132:0/1734755299 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f05100d1aa0 0x7f051014b6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:48.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.851+0000 7f05186a0640 1 --2- 172.21.15.132:0/1734755299 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f05100b4980 0x7f051015e960 unknown :-1 s=CLOSED pgs=1655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:48.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.851+0000 7f05186a0640 1 -- 172.21.15.132:0/1734755299 >> 172.21.15.132:0/1734755299 conn(0x7f05100cf980 msgr2=0x7f05100b7330 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:48.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.851+0000 7f05186a0640 1 -- 172.21.15.132:0/1734755299 shutdown_connections 2023-12-20T04:51:48.854 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:48.851+0000 7f05186a0640 1 -- 172.21.15.132:0/1734755299 wait complete. 2023-12-20T04:51:48.864 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:51:49.005 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.003+0000 7f7e8f070640 1 Processor -- start 2023-12-20T04:51:49.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.003+0000 7f7e8f070640 1 -- start start 2023-12-20T04:51:49.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.004+0000 7f7e8f070640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f7e8815d100 0x7f7e880b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.004+0000 7f7e8f070640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e880d0370 0x7f7e880cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.004+0000 7f7e8f070640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7e880b2f90 con 0x7f7e88161850 2023-12-20T04:51:49.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.004+0000 7f7e8f070640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7e881613c0 con 0x7f7e8815d100 2023-12-20T04:51:49.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.004+0000 7f7e8f070640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880d1b00 con 0x7f7e880d0370 2023-12-20T04:51:49.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.004+0000 7f7e8d60d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7e88161850 0x7f7e8806c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47960/0 (socket says 172.21.15.132:47960) 2023-12-20T04:51:49.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.004+0000 7f7e8d60d640 1 -- 172.21.15.132:0/743576121 learned_addr learned my addr 172.21.15.132:0/743576121 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:49.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.004+0000 7f7e8ce0c640 1 --2- 172.21.15.132:0/743576121 >> v2:172.21.15.187:3300/0 conn(0x7f7e8815d100 0x7f7e880b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.004+0000 7f7e87fff640 1 --2- 172.21.15.132:0/743576121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e880d0370 0x7f7e880cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.004+0000 7f7e877fe640 1 -- 172.21.15.132:0/743576121 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 424311567 0 0) 0x7f7e80001490 con 0x7f7e88161850 2023-12-20T04:51:49.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.004+0000 7f7e877fe640 1 -- 172.21.15.132:0/743576121 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7e74003520 con 0x7f7e88161850 2023-12-20T04:51:49.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e877fe640 1 -- 172.21.15.132:0/743576121 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 247279564 0 0) 0x7f7e74003520 con 0x7f7e88161850 2023-12-20T04:51:49.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e877fe640 1 -- 172.21.15.132:0/743576121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e880d0370 msgr2=0x7f7e880cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:49.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e877fe640 1 --2- 172.21.15.132:0/743576121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e880d0370 0x7f7e880cd500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e877fe640 1 -- 172.21.15.132:0/743576121 >> v2:172.21.15.187:3300/0 conn(0x7f7e8815d100 msgr2=0x7f7e880b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:49.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e877fe640 1 --2- 172.21.15.132:0/743576121 >> v2:172.21.15.187:3300/0 conn(0x7f7e8815d100 0x7f7e880b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e877fe640 1 -- 172.21.15.132:0/743576121 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e880d0810 con 0x7f7e88161850 2023-12-20T04:51:49.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e877fe640 1 -- 172.21.15.132:0/743576121 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f7e80001b80 con 0x7f7e88161850 2023-12-20T04:51:49.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e877fe640 1 -- 172.21.15.132:0/743576121 >> v1:172.21.15.132:6789/0 conn(0x7f7e88161850 legacy=0x7f7e8806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e877fe640 1 --2- 172.21.15.132:0/743576121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e880d0370 0x7f7e74003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e877fe640 1 --2- 172.21.15.132:0/743576121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e74003ef0 0x7f7e740047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e877fe640 1 --2- 172.21.15.132:0/743576121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e74004d00 0x7f7e74005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e877fe640 1 -- 172.21.15.132:0/743576121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e881613c0 con 0x7f7e74003ef0 2023-12-20T04:51:49.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e877fe640 1 -- 172.21.15.132:0/743576121 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880d1b00 con 0x7f7e74004d00 2023-12-20T04:51:49.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e877fe640 1 -- 172.21.15.132:0/743576121 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e7400b9d0 con 0x7f7e880d0370 2023-12-20T04:51:49.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e87fff640 1 --2- 172.21.15.132:0/743576121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e74003ef0 0x7f7e740047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e8ce0c640 1 --2- 172.21.15.132:0/743576121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e880d0370 0x7f7e74003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e8d60d640 1 --2- 172.21.15.132:0/743576121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e74004d00 0x7f7e74005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e87fff640 1 -- 172.21.15.132:0/743576121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e880d0370 msgr2=0x7f7e74003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:49.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e87fff640 1 --2- 172.21.15.132:0/743576121 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e880d0370 0x7f7e74003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e87fff640 1 -- 172.21.15.132:0/743576121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e74004d00 msgr2=0x7f7e74005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:49.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e87fff640 1 --2- 172.21.15.132:0/743576121 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e74004d00 0x7f7e74005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.005+0000 7f7e87fff640 1 -- 172.21.15.132:0/743576121 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e74003520 con 0x7f7e74003ef0 2023-12-20T04:51:49.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.006+0000 7f7e87fff640 1 --2- 172.21.15.132:0/743576121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e74003ef0 0x7f7e740047c0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009af0 tx=0x7f7e740057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e25f6ba3c3ad8219 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:49.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.006+0000 7f7e877fe640 1 -- 172.21.15.132:0/743576121 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7002c6b0 con 0x7f7e74003ef0 2023-12-20T04:51:49.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.006+0000 7f7e877fe640 1 -- 172.21.15.132:0/743576121 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e7002c810 con 0x7f7e74003ef0 2023-12-20T04:51:49.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.006+0000 7f7e877fe640 1 -- 172.21.15.132:0/743576121 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e7002cba0 con 0x7f7e74003ef0 2023-12-20T04:51:49.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.007+0000 7f7e8f070640 1 -- 172.21.15.132:0/743576121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e74003ef0 msgr2=0x7f7e740047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.007+0000 7f7e8f070640 1 --2- 172.21.15.132:0/743576121 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e74003ef0 0x7f7e740047c0 secure :-1 s=READY pgs=1657 cs=0 l=1 rev1=1 crypto rx=0x7f7e70009af0 tx=0x7f7e740057f0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.007+0000 7f7e8d60d640 1 -- 172.21.15.132:0/743576121 reap_dead start 2023-12-20T04:51:49.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.007+0000 7f7e8f070640 1 -- 172.21.15.132:0/743576121 shutdown_connections 2023-12-20T04:51:49.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.007+0000 7f7e8f070640 1 -- 172.21.15.132:0/743576121 >> 172.21.15.132:0/743576121 conn(0x7f7e8806d7c0 msgr2=0x7f7e8806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:49.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.007+0000 7f7e8f070640 1 -- 172.21.15.132:0/743576121 shutdown_connections 2023-12-20T04:51:49.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.007+0000 7f7e8f070640 1 -- 172.21.15.132:0/743576121 wait complete. 2023-12-20T04:51:49.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.008+0000 7f7e8f070640 1 Processor -- start 2023-12-20T04:51:49.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.008+0000 7f7e8f070640 1 -- start start 2023-12-20T04:51:49.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8f070640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e74003ef0 0x7f7e88159c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8f070640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e880c99b0 0x7f7e880aef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8f070640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e880af450 0x7f7e880ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8f070640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880c9520 con 0x7f7e880af450 2023-12-20T04:51:49.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8f070640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880c8950 con 0x7f7e74003ef0 2023-12-20T04:51:49.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8f070640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7e880c8bf0 con 0x7f7e880c99b0 2023-12-20T04:51:49.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8d60d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e880af450 0x7f7e880ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8d60d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e880af450 0x7f7e880ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42580/0 (socket says 172.21.15.132:42580) 2023-12-20T04:51:49.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8d60d640 1 -- 172.21.15.132:0/323535986 learned_addr learned my addr 172.21.15.132:0/323535986 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:49.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e87fff640 1 --2- 172.21.15.132:0/323535986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e880c99b0 0x7f7e880aef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8ce0c640 1 --2- 172.21.15.132:0/323535986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e74003ef0 0x7f7e88159c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8d60d640 1 -- 172.21.15.132:0/323535986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e880c99b0 msgr2=0x7f7e880aef10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8d60d640 1 --2- 172.21.15.132:0/323535986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e880c99b0 0x7f7e880aef10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8d60d640 1 -- 172.21.15.132:0/323535986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e74003ef0 msgr2=0x7f7e88159c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8d60d640 1 --2- 172.21.15.132:0/323535986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e74003ef0 0x7f7e88159c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8d60d640 1 -- 172.21.15.132:0/323535986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e880c8ed0 con 0x7f7e880af450 2023-12-20T04:51:49.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8d60d640 1 --2- 172.21.15.132:0/323535986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e880af450 0x7f7e880ac8e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f7e8806d6f0 tx=0x7f7e8000ae50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:49.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e857fa640 1 -- 172.21.15.132:0/323535986 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e800077c0 con 0x7f7e880af450 2023-12-20T04:51:49.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e857fa640 1 -- 172.21.15.132:0/323535986 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7e80007940 con 0x7f7e880af450 2023-12-20T04:51:49.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e857fa640 1 -- 172.21.15.132:0/323535986 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7e80013630 con 0x7f7e880af450 2023-12-20T04:51:49.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8f070640 1 -- 172.21.15.132:0/323535986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e880c91b0 con 0x7f7e880af450 2023-12-20T04:51:49.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.009+0000 7f7e8f070640 1 -- 172.21.15.132:0/323535986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e8815a1a0 con 0x7f7e880af450 2023-12-20T04:51:49.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.010+0000 7f7e8f070640 1 -- 172.21.15.132:0/323535986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e880c9690 con 0x7f7e880af450 2023-12-20T04:51:49.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.011+0000 7f7e857fa640 1 -- 172.21.15.132:0/323535986 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7e80013790 con 0x7f7e880af450 2023-12-20T04:51:49.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.011+0000 7f7e857fa640 1 --2- 172.21.15.132:0/323535986 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7e6806a430 0x7f7e6806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.011+0000 7f7e857fa640 1 -- 172.21.15.132:0/323535986 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7e80088d30 con 0x7f7e880af450 2023-12-20T04:51:49.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.011+0000 7f7e8ce0c640 1 --2- 172.21.15.132:0/323535986 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7e6806a430 0x7f7e6806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.012+0000 7f7e8ce0c640 1 --2- 172.21.15.132:0/323535986 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7e6806a430 0x7f7e6806c8f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009c40 tx=0x7f7e78009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:49.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.015+0000 7f7e857fa640 1 -- 172.21.15.132:0/323535986 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7e80054320 con 0x7f7e880af450 2023-12-20T04:51:49.185 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.184+0000 7f7e8f070640 1 -- 172.21.15.132:0/323535986 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7e880b2f90 con 0x7f7e880af450 2023-12-20T04:51:49.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.185+0000 7f7e857fa640 1 -- 172.21.15.132:0/323535986 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v169) v1 ==== 74+0+16160 (secure 0 0 0) 0x7f7e880b2f90 con 0x7f7e880af450 2023-12-20T04:51:49.187 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:49.187 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":169,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:51:47.509612+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:51:44.739391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-20T04:51:45.486167+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"169","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:51:49.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.187+0000 7f7e8f070640 1 -- 172.21.15.132:0/323535986 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7e6806a430 msgr2=0x7f7e6806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.187+0000 7f7e8f070640 1 --2- 172.21.15.132:0/323535986 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7e6806a430 0x7f7e6806c8f0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f7e78009c40 tx=0x7f7e78009190 comp rx=0 tx=0).stop 2023-12-20T04:51:49.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.187+0000 7f7e8f070640 1 -- 172.21.15.132:0/323535986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e880af450 msgr2=0x7f7e880ac8e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.187+0000 7f7e8f070640 1 --2- 172.21.15.132:0/323535986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e880af450 0x7f7e880ac8e0 secure :-1 s=READY pgs=1658 cs=0 l=1 rev1=1 crypto rx=0x7f7e8806d6f0 tx=0x7f7e8000ae50 comp rx=0 tx=0).stop 2023-12-20T04:51:49.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.187+0000 7f7e8f070640 1 -- 172.21.15.132:0/323535986 shutdown_connections 2023-12-20T04:51:49.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.187+0000 7f7e8f070640 1 --2- 172.21.15.132:0/323535986 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7e6806a430 0x7f7e6806c8f0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.187+0000 7f7e8f070640 1 --2- 172.21.15.132:0/323535986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7e880af450 0x7f7e880ac8e0 unknown :-1 s=CLOSED pgs=1658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.187+0000 7f7e8f070640 1 --2- 172.21.15.132:0/323535986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7e880c99b0 0x7f7e880aef10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.187+0000 7f7e8f070640 1 --2- 172.21.15.132:0/323535986 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7e74003ef0 0x7f7e88159c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.187+0000 7f7e8f070640 1 -- 172.21.15.132:0/323535986 >> 172.21.15.132:0/323535986 conn(0x7f7e8806d7c0 msgr2=0x7f7e880cbe90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:49.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.187+0000 7f7e8f070640 1 -- 172.21.15.132:0/323535986 shutdown_connections 2023-12-20T04:51:49.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.187+0000 7f7e8f070640 1 -- 172.21.15.132:0/323535986 wait complete. 2023-12-20T04:51:49.201 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-20T04:51:49.201 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:51:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.299+0000 7fa75ec43640 1 Processor -- start 2023-12-20T04:51:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.299+0000 7fa75ec43640 1 -- start start 2023-12-20T04:51:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.300+0000 7fa75ec43640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa75815d100 0x7fa7580b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.300+0000 7fa75ec43640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa7580d0370 0x7fa7580cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.300+0000 7fa75ec43640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa758161850 0x7fa7580cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.300+0000 7fa75ec43640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7580b2f90 con 0x7fa75815d100 2023-12-20T04:51:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.300+0000 7fa75ec43640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa7581613c0 con 0x7fa7580d0370 2023-12-20T04:51:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.300+0000 7fa75ec43640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa7580d0810 con 0x7fa758161850 2023-12-20T04:51:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.300+0000 7fa75c9df640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa75815d100 0x7fa7580b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.300+0000 7fa75c9df640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa75815d100 0x7fa7580b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42592/0 (socket says 172.21.15.132:42592) 2023-12-20T04:51:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.300+0000 7fa75c9df640 1 -- 172.21.15.132:0/3567375695 learned_addr learned my addr 172.21.15.132:0/3567375695 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.300+0000 7fa75d1e0640 1 --2- 172.21.15.132:0/3567375695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa758161850 0x7fa7580cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.300+0000 7fa74ffff640 1 --2- 172.21.15.132:0/3567375695 >> v2:172.21.15.187:3300/0 conn(0x7fa7580d0370 0x7fa7580cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.300+0000 7fa75c9df640 1 -- 172.21.15.132:0/3567375695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa758161850 msgr2=0x7fa7580cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.300+0000 7fa75c9df640 1 --2- 172.21.15.132:0/3567375695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa758161850 0x7fa7580cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.300+0000 7fa75c9df640 1 -- 172.21.15.132:0/3567375695 >> v2:172.21.15.187:3300/0 conn(0x7fa7580d0370 msgr2=0x7fa7580cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.300+0000 7fa75c9df640 1 --2- 172.21.15.132:0/3567375695 >> v2:172.21.15.187:3300/0 conn(0x7fa7580d0370 0x7fa7580cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.300+0000 7fa75c9df640 1 -- 172.21.15.132:0/3567375695 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa758160d70 con 0x7fa75815d100 2023-12-20T04:51:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.301+0000 7fa75c9df640 1 --2- 172.21.15.132:0/3567375695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa75815d100 0x7fa7580b2a50 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fa75806d6c0 tx=0x7fa75402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf64359e3a6e560 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.301+0000 7fa74f7fe640 1 -- 172.21.15.132:0/3567375695 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754031870 con 0x7fa75815d100 2023-12-20T04:51:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.301+0000 7fa74f7fe640 1 -- 172.21.15.132:0/3567375695 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa7540319d0 con 0x7fa75815d100 2023-12-20T04:51:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.301+0000 7fa74f7fe640 1 -- 172.21.15.132:0/3567375695 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa754031d60 con 0x7fa75815d100 2023-12-20T04:51:49.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.302+0000 7fa75ec43640 1 -- 172.21.15.132:0/3567375695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa75815d100 msgr2=0x7fa7580b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.302+0000 7fa75ec43640 1 --2- 172.21.15.132:0/3567375695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa75815d100 0x7fa7580b2a50 secure :-1 s=READY pgs=1659 cs=0 l=1 rev1=1 crypto rx=0x7fa75806d6c0 tx=0x7fa75402b910 comp rx=0 tx=0).stop 2023-12-20T04:51:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.302+0000 7fa75ec43640 1 -- 172.21.15.132:0/3567375695 shutdown_connections 2023-12-20T04:51:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.302+0000 7fa75ec43640 1 --2- 172.21.15.132:0/3567375695 >> v2:172.21.15.187:3300/0 conn(0x7fa7580d0370 0x7fa7580cd500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.302+0000 7fa75ec43640 1 --2- 172.21.15.132:0/3567375695 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa758161850 0x7fa7580cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.302+0000 7fa75ec43640 1 --2- 172.21.15.132:0/3567375695 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa75815d100 0x7fa7580b2a50 unknown :-1 s=CLOSED pgs=1659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.302+0000 7fa75ec43640 1 -- 172.21.15.132:0/3567375695 >> 172.21.15.132:0/3567375695 conn(0x7fa75806d7c0 msgr2=0x7fa75806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.302+0000 7fa75ec43640 1 -- 172.21.15.132:0/3567375695 shutdown_connections 2023-12-20T04:51:49.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.302+0000 7fa75ec43640 1 -- 172.21.15.132:0/3567375695 wait complete. 2023-12-20T04:51:49.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.303+0000 7fa75ec43640 1 Processor -- start 2023-12-20T04:51:49.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.303+0000 7fa75ec43640 1 -- start start 2023-12-20T04:51:49.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa75ec43640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7580d0370 0x7fa7580ca860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa75ec43640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa75815d100 0x7fa7581f2200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa75ec43640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa758161850 0x7fa7580c8790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa75ec43640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa758154b50 con 0x7fa75815d100 2023-12-20T04:51:49.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa75ec43640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa758158810 con 0x7fa7580d0370 2023-12-20T04:51:49.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa75ec43640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa75815ee90 con 0x7fa758161850 2023-12-20T04:51:49.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa74ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa75815d100 0x7fa7581f2200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa74ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa75815d100 0x7fa7581f2200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42604/0 (socket says 172.21.15.132:42604) 2023-12-20T04:51:49.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa74ffff640 1 -- 172.21.15.132:0/310074356 learned_addr learned my addr 172.21.15.132:0/310074356 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:49.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa75c9df640 1 --2- 172.21.15.132:0/310074356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7580d0370 0x7fa7580ca860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa75d1e0640 1 --2- 172.21.15.132:0/310074356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa758161850 0x7fa7580c8790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa74ffff640 1 -- 172.21.15.132:0/310074356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa758161850 msgr2=0x7fa7580c8790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa74ffff640 1 --2- 172.21.15.132:0/310074356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa758161850 0x7fa7580c8790 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa74ffff640 1 -- 172.21.15.132:0/310074356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7580d0370 msgr2=0x7fa7580ca860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa74ffff640 1 --2- 172.21.15.132:0/310074356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7580d0370 0x7fa7580ca860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa74ffff640 1 -- 172.21.15.132:0/310074356 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7540094d0 con 0x7fa75815d100 2023-12-20T04:51:49.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa75c9df640 1 --2- 172.21.15.132:0/310074356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7580d0370 0x7fa7580ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:49.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa74ffff640 1 --2- 172.21.15.132:0/310074356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa75815d100 0x7fa7581f2200 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fa74800c7f0 tx=0x7fa74800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:49.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa74d7fa640 1 -- 172.21.15.132:0/310074356 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748004220 con 0x7fa75815d100 2023-12-20T04:51:49.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa74d7fa640 1 -- 172.21.15.132:0/310074356 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa748004380 con 0x7fa75815d100 2023-12-20T04:51:49.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa75ec43640 1 -- 172.21.15.132:0/310074356 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa758160090 con 0x7fa75815d100 2023-12-20T04:51:49.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa74d7fa640 1 -- 172.21.15.132:0/310074356 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa748007860 con 0x7fa75815d100 2023-12-20T04:51:49.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.304+0000 7fa75ec43640 1 -- 172.21.15.132:0/310074356 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa758158a20 con 0x7fa75815d100 2023-12-20T04:51:49.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.306+0000 7fa75ec43640 1 -- 172.21.15.132:0/310074356 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa75804e840 con 0x7fa75815d100 2023-12-20T04:51:49.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.306+0000 7fa74d7fa640 1 -- 172.21.15.132:0/310074356 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa7480079c0 con 0x7fa75815d100 2023-12-20T04:51:49.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.306+0000 7fa74d7fa640 1 --2- 172.21.15.132:0/310074356 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa74406a430 0x7fa74406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.306+0000 7fa74d7fa640 1 -- 172.21.15.132:0/310074356 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa748088700 con 0x7fa75815d100 2023-12-20T04:51:49.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.306+0000 7fa75c9df640 1 --2- 172.21.15.132:0/310074356 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa74406a430 0x7fa74406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.307+0000 7fa75c9df640 1 --2- 172.21.15.132:0/310074356 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa74406a430 0x7fa74406c8f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa754036000 tx=0x7fa75403c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:49.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.311+0000 7fa74d7fa640 1 -- 172.21.15.132:0/310074356 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa748053c60 con 0x7fa75815d100 2023-12-20T04:51:49.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.475+0000 7fa75ec43640 1 -- 172.21.15.132:0/310074356 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fa758161050 con 0x7fa74406a430 2023-12-20T04:51:49.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.482+0000 7fa74d7fa640 1 -- 172.21.15.132:0/310074356 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276416 (secure 0 0 0) 0x7fa75403a420 con 0x7fa74406a430 2023-12-20T04:51:49.488 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:49.490 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:51:49.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.485+0000 7fa75ec43640 1 -- 172.21.15.132:0/310074356 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa74406a430 msgr2=0x7fa74406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.485+0000 7fa75ec43640 1 --2- 172.21.15.132:0/310074356 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa74406a430 0x7fa74406c8f0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7fa754036000 tx=0x7fa75403c040 comp rx=0 tx=0).stop 2023-12-20T04:51:49.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.485+0000 7fa75ec43640 1 -- 172.21.15.132:0/310074356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa75815d100 msgr2=0x7fa7581f2200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.485+0000 7fa75ec43640 1 --2- 172.21.15.132:0/310074356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa75815d100 0x7fa7581f2200 secure :-1 s=READY pgs=1660 cs=0 l=1 rev1=1 crypto rx=0x7fa74800c7f0 tx=0x7fa74800ccb0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.486+0000 7fa75ec43640 1 -- 172.21.15.132:0/310074356 shutdown_connections 2023-12-20T04:51:49.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.486+0000 7fa75ec43640 1 --2- 172.21.15.132:0/310074356 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa74406a430 0x7fa74406c8f0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.486+0000 7fa75ec43640 1 --2- 172.21.15.132:0/310074356 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa758161850 0x7fa7580c8790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.486+0000 7fa75ec43640 1 --2- 172.21.15.132:0/310074356 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa75815d100 0x7fa7581f2200 unknown :-1 s=CLOSED pgs=1660 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.486+0000 7fa75ec43640 1 --2- 172.21.15.132:0/310074356 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa7580d0370 0x7fa7580ca860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.486+0000 7fa75ec43640 1 -- 172.21.15.132:0/310074356 >> 172.21.15.132:0/310074356 conn(0x7fa75806d7c0 msgr2=0x7fa7580cbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:49.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.486+0000 7fa75ec43640 1 -- 172.21.15.132:0/310074356 shutdown_connections 2023-12-20T04:51:49.493 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.486+0000 7fa75ec43640 1 -- 172.21.15.132:0/310074356 wait complete. 2023-12-20T04:51:49.499 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":437,"stamp":"2023-12-20T04:51:48.212071+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554122,"statfs":{"total":1600000000,"available":1591421624,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000614"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166474+0000","last_change":"2023-12-20T04:51:45.166474+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166474+0000","last_undegraded":"2023-12-20T04:51:45.166474+0000","last_fullsized":"2023-12-20T04:51:45.166474+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:47.636801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.169853+0000","last_change":"2023-12-20T04:51:45.169853+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.169853+0000","last_undegraded":"2023-12-20T04:51:45.169853+0000","last_fullsized":"2023-12-20T04:51:45.169853+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:47.636801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.165411+0000","last_change":"2023-12-20T04:51:45.165411+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.165411+0000","last_undegraded":"2023-12-20T04:51:45.165411+0000","last_fullsized":"2023-12-20T04:51:45.165411+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:54:35.761511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164972+0000","last_change":"2023-12-20T04:51:45.164972+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164972+0000","last_undegraded":"2023-12-20T04:51:45.164972+0000","last_fullsized":"2023-12-20T04:51:45.164972+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:57:35.366758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168312+0000","last_change":"2023-12-20T04:51:45.168312+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168312+0000","last_undegraded":"2023-12-20T04:51:45.168312+0000","last_fullsized":"2023-12-20T04:51:45.168312+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:13:09.277528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168487+0000","last_change":"2023-12-20T04:51:45.168487+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168487+0000","last_undegraded":"2023-12-20T04:51:45.168487+0000","last_fullsized":"2023-12-20T04:51:45.168487+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:55:37.235060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168585+0000","last_change":"2023-12-20T04:51:45.168585+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168585+0000","last_undegraded":"2023-12-20T04:51:45.168585+0000","last_fullsized":"2023-12-20T04:51:45.168585+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:47:41.345193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164942+0000","last_change":"2023-12-20T04:51:45.164942+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164942+0000","last_undegraded":"2023-12-20T04:51:45.164942+0000","last_fullsized":"2023-12-20T04:51:45.164942+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:13:33.762273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.169378+0000","last_change":"2023-12-20T04:51:45.169378+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.169378+0000","last_undegraded":"2023-12-20T04:51:45.169378+0000","last_fullsized":"2023-12-20T04:51:45.169378+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:45:30.919915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166846+0000","last_change":"2023-12-20T04:51:45.166846+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166846+0000","last_undegraded":"2023-12-20T04:51:45.166846+0000","last_fullsized":"2023-12-20T04:51:45.166846+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:33:09.820546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164654+0000","last_change":"2023-12-20T04:51:45.164654+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164654+0000","last_undegraded":"2023-12-20T04:51:45.164654+0000","last_fullsized":"2023-12-20T04:51:45.164654+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:01:11.984641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166000+0000","last_change":"2023-12-20T04:51:45.166000+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166000+0000","last_undegraded":"2023-12-20T04:51:45.166000+0000","last_fullsized":"2023-12-20T04:51:45.166000+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:54:41.620584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166559+0000","last_change":"2023-12-20T04:51:45.166559+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166559+0000","last_undegraded":"2023-12-20T04:51:45.166559+0000","last_fullsized":"2023-12-20T04:51:45.166559+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:13:33.762273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.169059+0000","last_change":"2023-12-20T04:51:45.169059+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.169059+0000","last_undegraded":"2023-12-20T04:51:45.169059+0000","last_fullsized":"2023-12-20T04:51:45.169059+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:47:45.526934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168360+0000","last_change":"2023-12-20T04:51:45.168360+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168360+0000","last_undegraded":"2023-12-20T04:51:45.168360+0000","last_fullsized":"2023-12-20T04:51:45.168360+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:19:07.052276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168490+0000","last_change":"2023-12-20T04:51:45.168490+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168490+0000","last_undegraded":"2023-12-20T04:51:45.168490+0000","last_fullsized":"2023-12-20T04:51:45.168490+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:42:42.363620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168877+0000","last_change":"2023-12-20T04:51:45.168877+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168877+0000","last_undegraded":"2023-12-20T04:51:45.168877+0000","last_fullsized":"2023-12-20T04:51:45.168877+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:40:46.196430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168306+0000","last_change":"2023-12-20T04:51:45.168306+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168306+0000","last_undegraded":"2023-12-20T04:51:45.168306+0000","last_fullsized":"2023-12-20T04:51:45.168306+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:07.950388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168376+0000","last_change":"2023-12-20T04:51:45.168376+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168376+0000","last_undegraded":"2023-12-20T04:51:45.168376+0000","last_fullsized":"2023-12-20T04:51:45.168376+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:35:01.422172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164661+0000","last_change":"2023-12-20T04:51:45.164661+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164661+0000","last_undegraded":"2023-12-20T04:51:45.164661+0000","last_fullsized":"2023-12-20T04:51:45.164661+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:16:18.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.165957+0000","last_change":"2023-12-20T04:51:45.165957+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.165957+0000","last_undegraded":"2023-12-20T04:51:45.165957+0000","last_fullsized":"2023-12-20T04:51:45.165957+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:16:33.403901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166025+0000","last_change":"2023-12-20T04:51:45.166025+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166025+0000","last_undegraded":"2023-12-20T04:51:45.166025+0000","last_fullsized":"2023-12-20T04:51:45.166025+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:45:30.919915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166165+0000","last_change":"2023-12-20T04:51:45.166165+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166165+0000","last_undegraded":"2023-12-20T04:51:45.166165+0000","last_fullsized":"2023-12-20T04:51:45.166165+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:20:27.921265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166473+0000","last_change":"2023-12-20T04:51:45.166473+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166473+0000","last_undegraded":"2023-12-20T04:51:45.166473+0000","last_fullsized":"2023-12-20T04:51:45.166473+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:11:39.764510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168677+0000","last_change":"2023-12-20T04:51:45.168677+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168677+0000","last_undegraded":"2023-12-20T04:51:45.168677+0000","last_fullsized":"2023-12-20T04:51:45.168677+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:19:23.214753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168685+0000","last_change":"2023-12-20T04:51:45.168685+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168685+0000","last_undegraded":"2023-12-20T04:51:45.168685+0000","last_fullsized":"2023-12-20T04:51:45.168685+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:47.122533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168329+0000","last_change":"2023-12-20T04:51:45.168329+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168329+0000","last_undegraded":"2023-12-20T04:51:45.168329+0000","last_fullsized":"2023-12-20T04:51:45.168329+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:04:30.065153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164589+0000","last_change":"2023-12-20T04:51:45.164589+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164589+0000","last_undegraded":"2023-12-20T04:51:45.164589+0000","last_fullsized":"2023-12-20T04:51:45.164589+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:39:57.468608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166023+0000","last_change":"2023-12-20T04:51:45.166023+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166023+0000","last_undegraded":"2023-12-20T04:51:45.166023+0000","last_fullsized":"2023-12-20T04:51:45.166023+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:57.319453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166837+0000","last_change":"2023-12-20T04:51:45.166837+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166837+0000","last_undegraded":"2023-12-20T04:51:45.166837+0000","last_fullsized":"2023-12-20T04:51:45.166837+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:57:35.366758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168890+0000","last_change":"2023-12-20T04:51:45.168890+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168890+0000","last_undegraded":"2023-12-20T04:51:45.168890+0000","last_fullsized":"2023-12-20T04:51:45.168890+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:16:33.403901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.167245+0000","last_change":"2023-12-20T04:51:45.167245+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.167245+0000","last_undegraded":"2023-12-20T04:51:45.167245+0000","last_fullsized":"2023-12-20T04:51:45.167245+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:54:35.761511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":291,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-12-20T04:51:44.842001+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:51:44.842001+0000","last_peered":"2023-12-20T04:51:44.842001+0000","last_clean":"2023-12-20T04:51:44.842001+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:51:44.842001+0000","last_undegraded":"2023-12-20T04:51:44.842001+0000","last_fullsized":"2023-12-20T04:51:44.842001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574960,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1479,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193832,"statfs":{"total":200000000,"available":198484927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.40600000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74399999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53800000000000003,"15min":0.52600000000000002},"min":{"1min":0.42999999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70999999999999996,"5min":0.79200000000000004,"15min":0.86299999999999999},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.47799999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.98799999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.374,"15min":0.374},"max":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":1.0269999999999999},"last":0.58499999999999996}]},{"osd":2,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.70599999999999996,"5min":0.97699999999999998,"15min":1.0069999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.41099999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.78000000000000003},"last":0.50800000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.438,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72799999999999998,"5min":1.048,"15min":1.048},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.46700000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74199999999999999,"5min":0.753,"15min":0.76900000000000002},"last":0.56299999999999994}]},{"osd":4,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.28499999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":0.71299999999999997,"15min":0.753},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.29599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.77400000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.40899999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.48699999999999999},"min":{"1min":0.35099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73799999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.496}]},{"osd":6,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.44400000000000001,"5min":0.33300000000000002,"15min":0.32500000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.89800000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.33200000000000002,"15min":0.28899999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55600000000000005,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68400000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.50600000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.30099999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.47099999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.60299999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.29999999999999999,"15min":0.27000000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.36499999999999999,"5min":0.34599999999999997,"15min":0.32600000000000001},"max":{"1min":0.67600000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52600000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54900000000000004,"15min":0.51400000000000001},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73199999999999998,"5min":0.752,"15min":0.77800000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.45300000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71899999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57499999999999996}]},{"osd":4,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.46999999999999997,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66900000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.34899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59299999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48799999999999999,"15min":0.50900000000000001},"min":{"1min":0.34899999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52500000000000002,"15min":0.54900000000000004},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63100000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52600000000000002,"15min":0.54300000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.76500000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54900000000000004,"15min":0.52200000000000002},"min":{"1min":0.44,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.70299999999999996,"5min":0.748,"15min":0.748},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.56499999999999995},"min":{"1min":0.503,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70199999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53400000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.433,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71199999999999997,"5min":0.80600000000000005,"15min":0.82099999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72199999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59499999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.40600000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67800000000000005,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.52400000000000002},"min":{"1min":0.46200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72499999999999998,"5min":0.76600000000000001,"15min":0.77100000000000002},"last":0.48599999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.441,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.80900000000000005},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.39800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.73599999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.55700000000000005}]},{"osd":4,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45200000000000001,"15min":0.48899999999999999},"min":{"1min":0.31900000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.81899999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.32400000000000001,"5min":0.29799999999999999,"15min":0.29399999999999998},"max":{"1min":0.749,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.50900000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47299999999999998,"15min":0.497},"min":{"1min":0.311,"5min":0.254,"15min":0.254},"max":{"1min":0.70699999999999996,"5min":0.73299999999999998,"15min":0.85299999999999998},"last":0.629},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.31},"max":{"1min":0.77000000000000002,"5min":0.78600000000000003,"15min":0.83999999999999997},"last":0.61599999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.498,"15min":0.51800000000000002},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.78400000000000003,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56399999999999995,"15min":0.59499999999999997},"min":{"1min":0.35999999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.76100000000000001,"5min":0.77600000000000002,"15min":0.98599999999999999},"last":0.65200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.19700000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.32400000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.36599999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.442},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.35999999999999999,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.316,"5min":0.313,"15min":0.313},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.499},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.23400000000000001},"max":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.51000000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.91000000000000003},"last":0.45400000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44800000000000001,"15min":0.46500000000000002},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48999999999999999,"15min":0.5},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.38700000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.36899999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69999999999999996,"5min":0.73099999999999998,"15min":0.82399999999999995},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78200000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.57099999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.51800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76900000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.34999999999999998,"15min":0.34000000000000002},"min":{"1min":0.24099999999999999,"5min":0.19800000000000001,"15min":0.193},"max":{"1min":0.49199999999999999,"5min":0.629,"15min":0.629},"last":0.307},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.38,"15min":0.35999999999999999},"min":{"1min":0.33000000000000002,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.56799999999999995,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.32500000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.33900000000000002,"15min":0.32400000000000001},"min":{"1min":0.28999999999999998,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.56799999999999995},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.34300000000000003},"min":{"1min":0.28599999999999998,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55800000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.245}]},{"osd":2,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34899999999999998,"15min":0.34599999999999997},"min":{"1min":0.28999999999999998,"5min":0.22600000000000001,"15min":0.21199999999999999},"max":{"1min":0.49399999999999999,"5min":0.53100000000000003,"15min":0.64900000000000002},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39200000000000002,"15min":0.379},"min":{"1min":0.313,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55800000000000005,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.33700000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57199999999999995,"15min":0.55000000000000004},"min":{"1min":0.46300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80200000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58599999999999997,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.81699999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58899999999999997,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.31},"max":{"1min":0.77400000000000002,"5min":0.872,"15min":0.872},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.59099999999999997,"15min":0.56699999999999995},"min":{"1min":0.48999999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77900000000000003,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42799999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.45300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78100000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59499999999999997,"15min":0.56799999999999995},"min":{"1min":0.51000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.73599999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.44800000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.442,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78600000000000003,"5min":0.879,"15min":0.879},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.61699999999999999,"15min":0.58699999999999997},"min":{"1min":0.50800000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78000000000000003,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.41099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.34499999999999997,"15min":0.311},"min":{"1min":0.23599999999999999,"5min":0.20899999999999999,"15min":0.18099999999999999},"max":{"1min":0.54800000000000004,"5min":0.61499999999999999,"15min":0.72699999999999998},"last":0.311},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.376,"15min":0.35599999999999998},"min":{"1min":0.33700000000000002,"5min":0.25800000000000001,"15min":0.17699999999999999},"max":{"1min":0.53500000000000003,"5min":0.53700000000000003,"15min":2.0539999999999998},"last":0.40100000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.34100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.17999999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.83099999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.35999999999999999},"min":{"1min":0.30199999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58999999999999997},"last":0.25800000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.40400000000000003,"15min":0.372},"min":{"1min":0.36599999999999999,"5min":0.247,"15min":0.216},"max":{"1min":0.59199999999999997,"5min":0.68100000000000005,"15min":0.995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.40200000000000002,"15min":0.379},"min":{"1min":0.26100000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.57199999999999995,"5min":0.64400000000000002,"15min":0.76600000000000001},"last":0.34499999999999997}]},{"osd":4,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80700000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82499999999999996,"5min":0.94699999999999995,"15min":2.347},"last":0.73099999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.35399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83299999999999996,"5min":0.997,"15min":0.997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.55900000000000005},"min":{"1min":0.42499999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.75700000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.443,"5min":0.371,"15min":0.371},"max":{"1min":0.877,"5min":0.877,"15min":2.274},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.373},"max":{"1min":0.81000000000000005,"5min":0.91100000000000003,"15min":1.0289999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82499999999999996,"5min":0.82999999999999996,"15min":2.3090000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59199999999999997,"15min":0.58299999999999996},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.80800000000000005,"5min":0.86699999999999999,"15min":1.0549999999999999},"last":0.74399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.33300000000000002,"15min":0.30199999999999999},"min":{"1min":0.251,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.44700000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.254},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.36799999999999999,"15min":0.34100000000000003},"min":{"1min":0.32300000000000001,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.55800000000000005,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.30399999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.31900000000000001},"min":{"1min":0.308,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.48299999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.35999999999999999},"min":{"1min":0.24399999999999999,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":0.56200000000000006,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.27600000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.40899999999999997,"15min":0.371},"min":{"1min":0.36399999999999999,"5min":0.21299999999999999,"15min":0.191},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.221},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.36699999999999999,"15min":0.35699999999999998},"min":{"1min":0.32400000000000001,"5min":0.22500000000000001,"15min":0.20399999999999999},"max":{"1min":0.56399999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34200000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57099999999999995,"15min":0.56799999999999995},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57899999999999996,"15min":0.55800000000000005},"min":{"1min":0.40600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.82899999999999996,"15min":1.002},"last":0.49299999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":0.85799999999999998,"15min":0.86099999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59099999999999997,"15min":0.55600000000000005},"min":{"1min":0.436,"5min":0.317,"15min":0.317},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.85599999999999998},"last":0.55000000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57599999999999996,"15min":0.56399999999999995},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.36899999999999999},"max":{"1min":0.70999999999999996,"5min":0.92400000000000004,"15min":1.038},"last":0.503},{"interface":"front","average":{"1min":0.626,"5min":0.58299999999999996,"15min":0.56899999999999995},"min":{"1min":0.44400000000000001,"5min":0.40100000000000002,"15min":0.39100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.84199999999999997},"last":0.66200000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61499999999999999,"15min":0.59999999999999998},"min":{"1min":0.52300000000000002,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.80500000000000005,"5min":0.84399999999999997,"15min":0.88900000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.53100000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.81000000000000005,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.64900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1479,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193832,"statfs":{"total":200000000,"available":198484927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.317},"min":{"1min":0.221,"5min":0.189,"15min":0.184},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.32400000000000001},"min":{"1min":0.248,"5min":0.20699999999999999,"15min":0.184},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.33400000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.218},"max":{"1min":0.52100000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.376,"15min":0.35599999999999998},"min":{"1min":0.315,"5min":0.23400000000000001,"15min":0.23100000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.622},"last":0.29799999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.36199999999999999,"15min":0.33500000000000002},"min":{"1min":0.246,"5min":0.224,"15min":0.224},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.39500000000000002,"15min":0.376},"min":{"1min":0.32400000000000001,"5min":0.27600000000000002,"15min":0.27400000000000002},"max":{"1min":0.54700000000000004,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.39500000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.57099999999999995,"15min":0.53400000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80700000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47399999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.59699999999999998,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83299999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.51000000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.60899999999999999,"15min":0.58999999999999997},"min":{"1min":0.41099999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.60899999999999999,"15min":0.59099999999999997},"min":{"1min":0.36899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89500000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.67100000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.58999999999999997,"15min":0.56200000000000006},"min":{"1min":0.433,"5min":0.379,"15min":0.375},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.60099999999999998,"15min":0.58099999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.71499999999999997}]}]}],"pool_statfs":[]}} 2023-12-20T04:51:49.504 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:51:49.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.636+0000 7f8668221640 1 Processor -- start 2023-12-20T04:51:49.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.637+0000 7f8668221640 1 -- start start 2023-12-20T04:51:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.637+0000 7f8668221640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866015d110 0x7f8660069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.637+0000 7f8668221640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f866015d4f0 0x7f866006a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.637+0000 7f8668221640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f86600aeb00 0x7f86600aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.637+0000 7f8668221640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f86600af4d0 con 0x7f86600aeb00 2023-12-20T04:51:49.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.637+0000 7f8668221640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8660161ce0 con 0x7f866015d4f0 2023-12-20T04:51:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.637+0000 7f8668221640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86600aca50 con 0x7f866015d110 2023-12-20T04:51:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.638+0000 7f86667be640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f86600aeb00 0x7f86600aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.638+0000 7f86667be640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f86600aeb00 0x7f86600aef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42608/0 (socket says 172.21.15.132:42608) 2023-12-20T04:51:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.638+0000 7f86667be640 1 -- 172.21.15.132:0/2260796611 learned_addr learned my addr 172.21.15.132:0/2260796611 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.638+0000 7f86657bc640 1 --2- 172.21.15.132:0/2260796611 >> v2:172.21.15.187:3300/0 conn(0x7f866015d4f0 0x7f866006a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.638+0000 7f8665fbd640 1 --2- 172.21.15.132:0/2260796611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866015d110 0x7f8660069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.638+0000 7f86667be640 1 -- 172.21.15.132:0/2260796611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866015d110 msgr2=0x7f8660069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.638+0000 7f86667be640 1 --2- 172.21.15.132:0/2260796611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866015d110 0x7f8660069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.638+0000 7f86667be640 1 -- 172.21.15.132:0/2260796611 >> v2:172.21.15.187:3300/0 conn(0x7f866015d4f0 msgr2=0x7f866006a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.638+0000 7f86667be640 1 --2- 172.21.15.132:0/2260796611 >> v2:172.21.15.187:3300/0 conn(0x7f866015d4f0 0x7f866006a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.638+0000 7f86667be640 1 -- 172.21.15.132:0/2260796611 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8660160df0 con 0x7f86600aeb00 2023-12-20T04:51:49.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.638+0000 7f86657bc640 1 --2- 172.21.15.132:0/2260796611 >> v2:172.21.15.187:3300/0 conn(0x7f866015d4f0 0x7f866006a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:49.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.638+0000 7f8665fbd640 1 --2- 172.21.15.132:0/2260796611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866015d110 0x7f8660069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:49.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.639+0000 7f86667be640 1 --2- 172.21.15.132:0/2260796611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86600aeb00 0x7f86600aef90 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f866006ad10 tx=0x7f865c02bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2e01cbe4b7db900a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.639+0000 7f8664fbb640 1 -- 172.21.15.132:0/2260796611 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c02ca70 con 0x7f86600aeb00 2023-12-20T04:51:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.639+0000 7f8664fbb640 1 -- 172.21.15.132:0/2260796611 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f865c02cbd0 con 0x7f86600aeb00 2023-12-20T04:51:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.639+0000 7f8664fbb640 1 -- 172.21.15.132:0/2260796611 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865c0343f0 con 0x7f86600aeb00 2023-12-20T04:51:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.639+0000 7f8668221640 1 -- 172.21.15.132:0/2260796611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86600aeb00 msgr2=0x7f86600aef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.639+0000 7f8668221640 1 --2- 172.21.15.132:0/2260796611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86600aeb00 0x7f86600aef90 secure :-1 s=READY pgs=1661 cs=0 l=1 rev1=1 crypto rx=0x7f866006ad10 tx=0x7f865c02bed0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.639+0000 7f8668221640 1 -- 172.21.15.132:0/2260796611 shutdown_connections 2023-12-20T04:51:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.639+0000 7f8668221640 1 --2- 172.21.15.132:0/2260796611 >> v2:172.21.15.187:3300/0 conn(0x7f866015d4f0 0x7f866006a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.639+0000 7f8668221640 1 --2- 172.21.15.132:0/2260796611 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f86600aeb00 0x7f86600aef90 unknown :-1 s=CLOSED pgs=1661 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.639+0000 7f8668221640 1 --2- 172.21.15.132:0/2260796611 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f866015d110 0x7f8660069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.639+0000 7f8668221640 1 -- 172.21.15.132:0/2260796611 >> 172.21.15.132:0/2260796611 conn(0x7f86600cfbd0 msgr2=0x7f86600cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:49.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.639+0000 7f8668221640 1 -- 172.21.15.132:0/2260796611 shutdown_connections 2023-12-20T04:51:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.639+0000 7f8668221640 1 -- 172.21.15.132:0/2260796611 wait complete. 2023-12-20T04:51:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.641+0000 7f8668221640 1 Processor -- start 2023-12-20T04:51:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.641+0000 7f8668221640 1 -- start start 2023-12-20T04:51:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.641+0000 7f8668221640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86600aeb00 0x7f86600b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.641+0000 7f8668221640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f866015d110 0x7f8660158ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.641+0000 7f8668221640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f866015d4f0 0x7f86600b3490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.641+0000 7f8668221640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86600c93f0 con 0x7f866015d110 2023-12-20T04:51:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.641+0000 7f8668221640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86600c8b50 con 0x7f866015d4f0 2023-12-20T04:51:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.641+0000 7f8668221640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86600c8e30 con 0x7f86600aeb00 2023-12-20T04:51:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.641+0000 7f86657bc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f866015d110 0x7f8660158ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.641+0000 7f86657bc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f866015d110 0x7f8660158ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42610/0 (socket says 172.21.15.132:42610) 2023-12-20T04:51:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.641+0000 7f86657bc640 1 -- 172.21.15.132:0/345494809 learned_addr learned my addr 172.21.15.132:0/345494809 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:49.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.642+0000 7f86667be640 1 --2- 172.21.15.132:0/345494809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f866015d4f0 0x7f86600b3490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.642+0000 7f8665fbd640 1 --2- 172.21.15.132:0/345494809 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86600aeb00 0x7f86600b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.642+0000 7f86657bc640 1 -- 172.21.15.132:0/345494809 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86600aeb00 msgr2=0x7f86600b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.642+0000 7f86657bc640 1 --2- 172.21.15.132:0/345494809 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86600aeb00 0x7f86600b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.642+0000 7f86657bc640 1 -- 172.21.15.132:0/345494809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f866015d4f0 msgr2=0x7f86600b3490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.642+0000 7f86657bc640 1 --2- 172.21.15.132:0/345494809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f866015d4f0 0x7f86600b3490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.642+0000 7f86657bc640 1 -- 172.21.15.132:0/345494809 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f865c009b30 con 0x7f866015d110 2023-12-20T04:51:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.642+0000 7f86667be640 1 --2- 172.21.15.132:0/345494809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f866015d4f0 0x7f86600b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.642+0000 7f86657bc640 1 --2- 172.21.15.132:0/345494809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f866015d110 0x7f8660158ea0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f865000c7f0 tx=0x7f865000cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.642+0000 7f86567fc640 1 -- 172.21.15.132:0/345494809 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8650007a30 con 0x7f866015d110 2023-12-20T04:51:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.642+0000 7f86567fc640 1 -- 172.21.15.132:0/345494809 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8650007b90 con 0x7f866015d110 2023-12-20T04:51:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.642+0000 7f8668221640 1 -- 172.21.15.132:0/345494809 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86600c9110 con 0x7f866015d110 2023-12-20T04:51:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.642+0000 7f86567fc640 1 -- 172.21.15.132:0/345494809 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f865000ce40 con 0x7f866015d110 2023-12-20T04:51:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.642+0000 7f8668221640 1 -- 172.21.15.132:0/345494809 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86600b5670 con 0x7f866015d110 2023-12-20T04:51:49.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.643+0000 7f8668221640 1 -- 172.21.15.132:0/345494809 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f866006c5d0 con 0x7f866015d110 2023-12-20T04:51:49.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.643+0000 7f86567fc640 1 -- 172.21.15.132:0/345494809 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f86500113f0 con 0x7f866015d110 2023-12-20T04:51:49.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.644+0000 7f86567fc640 1 --2- 172.21.15.132:0/345494809 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f864406a430 0x7f864406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.644+0000 7f86567fc640 1 -- 172.21.15.132:0/345494809 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8650088ae0 con 0x7f866015d110 2023-12-20T04:51:49.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.644+0000 7f8665fbd640 1 --2- 172.21.15.132:0/345494809 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f864406a430 0x7f864406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.644+0000 7f8665fbd640 1 --2- 172.21.15.132:0/345494809 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f864406a430 0x7f864406c8f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8658006ab0 tx=0x7f8658008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:49.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.648+0000 7f86567fc640 1 -- 172.21.15.132:0/345494809 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f866006c5d0 con 0x7f866015d110 2023-12-20T04:51:49.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.812+0000 7f8668221640 1 -- 172.21.15.132:0/345494809 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f86601613b0 con 0x7f864406a430 2023-12-20T04:51:49.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.819+0000 7f86567fc640 1 -- 172.21.15.132:0/345494809 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276416 (secure 0 0 0) 0x7f865800c050 con 0x7f864406a430 2023-12-20T04:51:49.823 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:49.825 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:51:49.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.822+0000 7f8668221640 1 -- 172.21.15.132:0/345494809 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f864406a430 msgr2=0x7f864406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.822+0000 7f8668221640 1 --2- 172.21.15.132:0/345494809 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f864406a430 0x7f864406c8f0 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f8658006ab0 tx=0x7f8658008040 comp rx=0 tx=0).stop 2023-12-20T04:51:49.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.822+0000 7f8668221640 1 -- 172.21.15.132:0/345494809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f866015d110 msgr2=0x7f8660158ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.822+0000 7f8668221640 1 --2- 172.21.15.132:0/345494809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f866015d110 0x7f8660158ea0 secure :-1 s=READY pgs=1662 cs=0 l=1 rev1=1 crypto rx=0x7f865000c7f0 tx=0x7f865000cbf0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.822+0000 7f8668221640 1 -- 172.21.15.132:0/345494809 shutdown_connections 2023-12-20T04:51:49.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.822+0000 7f8668221640 1 --2- 172.21.15.132:0/345494809 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f864406a430 0x7f864406c8f0 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.822+0000 7f8668221640 1 --2- 172.21.15.132:0/345494809 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f866015d4f0 0x7f86600b3490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.822+0000 7f8668221640 1 --2- 172.21.15.132:0/345494809 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f866015d110 0x7f8660158ea0 unknown :-1 s=CLOSED pgs=1662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.822+0000 7f8668221640 1 --2- 172.21.15.132:0/345494809 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86600aeb00 0x7f86600b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.822+0000 7f8668221640 1 -- 172.21.15.132:0/345494809 >> 172.21.15.132:0/345494809 conn(0x7f86600cfbd0 msgr2=0x7f866015a7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:49.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.822+0000 7f8668221640 1 -- 172.21.15.132:0/345494809 shutdown_connections 2023-12-20T04:51:49.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.822+0000 7f8668221640 1 -- 172.21.15.132:0/345494809 wait complete. 2023-12-20T04:51:49.835 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":437,"stamp":"2023-12-20T04:51:48.212071+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554122,"statfs":{"total":1600000000,"available":1591421624,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000614"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166474+0000","last_change":"2023-12-20T04:51:45.166474+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166474+0000","last_undegraded":"2023-12-20T04:51:45.166474+0000","last_fullsized":"2023-12-20T04:51:45.166474+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:47.636801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.169853+0000","last_change":"2023-12-20T04:51:45.169853+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.169853+0000","last_undegraded":"2023-12-20T04:51:45.169853+0000","last_fullsized":"2023-12-20T04:51:45.169853+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:47.636801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.165411+0000","last_change":"2023-12-20T04:51:45.165411+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.165411+0000","last_undegraded":"2023-12-20T04:51:45.165411+0000","last_fullsized":"2023-12-20T04:51:45.165411+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:54:35.761511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164972+0000","last_change":"2023-12-20T04:51:45.164972+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164972+0000","last_undegraded":"2023-12-20T04:51:45.164972+0000","last_fullsized":"2023-12-20T04:51:45.164972+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:57:35.366758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168312+0000","last_change":"2023-12-20T04:51:45.168312+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168312+0000","last_undegraded":"2023-12-20T04:51:45.168312+0000","last_fullsized":"2023-12-20T04:51:45.168312+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:13:09.277528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168487+0000","last_change":"2023-12-20T04:51:45.168487+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168487+0000","last_undegraded":"2023-12-20T04:51:45.168487+0000","last_fullsized":"2023-12-20T04:51:45.168487+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:55:37.235060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168585+0000","last_change":"2023-12-20T04:51:45.168585+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168585+0000","last_undegraded":"2023-12-20T04:51:45.168585+0000","last_fullsized":"2023-12-20T04:51:45.168585+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:47:41.345193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164942+0000","last_change":"2023-12-20T04:51:45.164942+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164942+0000","last_undegraded":"2023-12-20T04:51:45.164942+0000","last_fullsized":"2023-12-20T04:51:45.164942+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:13:33.762273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.169378+0000","last_change":"2023-12-20T04:51:45.169378+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.169378+0000","last_undegraded":"2023-12-20T04:51:45.169378+0000","last_fullsized":"2023-12-20T04:51:45.169378+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:45:30.919915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166846+0000","last_change":"2023-12-20T04:51:45.166846+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166846+0000","last_undegraded":"2023-12-20T04:51:45.166846+0000","last_fullsized":"2023-12-20T04:51:45.166846+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:33:09.820546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164654+0000","last_change":"2023-12-20T04:51:45.164654+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164654+0000","last_undegraded":"2023-12-20T04:51:45.164654+0000","last_fullsized":"2023-12-20T04:51:45.164654+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:01:11.984641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166000+0000","last_change":"2023-12-20T04:51:45.166000+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166000+0000","last_undegraded":"2023-12-20T04:51:45.166000+0000","last_fullsized":"2023-12-20T04:51:45.166000+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:54:41.620584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166559+0000","last_change":"2023-12-20T04:51:45.166559+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166559+0000","last_undegraded":"2023-12-20T04:51:45.166559+0000","last_fullsized":"2023-12-20T04:51:45.166559+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:13:33.762273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.169059+0000","last_change":"2023-12-20T04:51:45.169059+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.169059+0000","last_undegraded":"2023-12-20T04:51:45.169059+0000","last_fullsized":"2023-12-20T04:51:45.169059+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:47:45.526934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168360+0000","last_change":"2023-12-20T04:51:45.168360+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168360+0000","last_undegraded":"2023-12-20T04:51:45.168360+0000","last_fullsized":"2023-12-20T04:51:45.168360+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:19:07.052276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168490+0000","last_change":"2023-12-20T04:51:45.168490+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168490+0000","last_undegraded":"2023-12-20T04:51:45.168490+0000","last_fullsized":"2023-12-20T04:51:45.168490+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:42:42.363620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168877+0000","last_change":"2023-12-20T04:51:45.168877+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168877+0000","last_undegraded":"2023-12-20T04:51:45.168877+0000","last_fullsized":"2023-12-20T04:51:45.168877+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:40:46.196430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168306+0000","last_change":"2023-12-20T04:51:45.168306+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168306+0000","last_undegraded":"2023-12-20T04:51:45.168306+0000","last_fullsized":"2023-12-20T04:51:45.168306+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:07.950388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168376+0000","last_change":"2023-12-20T04:51:45.168376+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168376+0000","last_undegraded":"2023-12-20T04:51:45.168376+0000","last_fullsized":"2023-12-20T04:51:45.168376+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:35:01.422172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164661+0000","last_change":"2023-12-20T04:51:45.164661+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164661+0000","last_undegraded":"2023-12-20T04:51:45.164661+0000","last_fullsized":"2023-12-20T04:51:45.164661+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:16:18.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.165957+0000","last_change":"2023-12-20T04:51:45.165957+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.165957+0000","last_undegraded":"2023-12-20T04:51:45.165957+0000","last_fullsized":"2023-12-20T04:51:45.165957+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:16:33.403901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166025+0000","last_change":"2023-12-20T04:51:45.166025+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166025+0000","last_undegraded":"2023-12-20T04:51:45.166025+0000","last_fullsized":"2023-12-20T04:51:45.166025+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:45:30.919915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166165+0000","last_change":"2023-12-20T04:51:45.166165+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166165+0000","last_undegraded":"2023-12-20T04:51:45.166165+0000","last_fullsized":"2023-12-20T04:51:45.166165+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:20:27.921265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166473+0000","last_change":"2023-12-20T04:51:45.166473+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166473+0000","last_undegraded":"2023-12-20T04:51:45.166473+0000","last_fullsized":"2023-12-20T04:51:45.166473+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:11:39.764510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168677+0000","last_change":"2023-12-20T04:51:45.168677+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168677+0000","last_undegraded":"2023-12-20T04:51:45.168677+0000","last_fullsized":"2023-12-20T04:51:45.168677+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:19:23.214753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168685+0000","last_change":"2023-12-20T04:51:45.168685+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168685+0000","last_undegraded":"2023-12-20T04:51:45.168685+0000","last_fullsized":"2023-12-20T04:51:45.168685+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:47.122533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168329+0000","last_change":"2023-12-20T04:51:45.168329+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168329+0000","last_undegraded":"2023-12-20T04:51:45.168329+0000","last_fullsized":"2023-12-20T04:51:45.168329+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:04:30.065153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164589+0000","last_change":"2023-12-20T04:51:45.164589+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164589+0000","last_undegraded":"2023-12-20T04:51:45.164589+0000","last_fullsized":"2023-12-20T04:51:45.164589+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:39:57.468608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166023+0000","last_change":"2023-12-20T04:51:45.166023+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166023+0000","last_undegraded":"2023-12-20T04:51:45.166023+0000","last_fullsized":"2023-12-20T04:51:45.166023+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:57.319453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166837+0000","last_change":"2023-12-20T04:51:45.166837+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166837+0000","last_undegraded":"2023-12-20T04:51:45.166837+0000","last_fullsized":"2023-12-20T04:51:45.166837+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:57:35.366758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168890+0000","last_change":"2023-12-20T04:51:45.168890+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168890+0000","last_undegraded":"2023-12-20T04:51:45.168890+0000","last_fullsized":"2023-12-20T04:51:45.168890+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:16:33.403901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.167245+0000","last_change":"2023-12-20T04:51:45.167245+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.167245+0000","last_undegraded":"2023-12-20T04:51:45.167245+0000","last_fullsized":"2023-12-20T04:51:45.167245+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:54:35.761511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":291,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-12-20T04:51:44.842001+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:51:44.842001+0000","last_peered":"2023-12-20T04:51:44.842001+0000","last_clean":"2023-12-20T04:51:44.842001+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:51:44.842001+0000","last_undegraded":"2023-12-20T04:51:44.842001+0000","last_fullsized":"2023-12-20T04:51:44.842001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574960,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1479,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193832,"statfs":{"total":200000000,"available":198484927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.40600000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74399999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53800000000000003,"15min":0.52600000000000002},"min":{"1min":0.42999999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70999999999999996,"5min":0.79200000000000004,"15min":0.86299999999999999},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.47799999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.98799999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.374,"15min":0.374},"max":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":1.0269999999999999},"last":0.58499999999999996}]},{"osd":2,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.70599999999999996,"5min":0.97699999999999998,"15min":1.0069999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.41099999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.78000000000000003},"last":0.50800000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.438,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72799999999999998,"5min":1.048,"15min":1.048},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.46700000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74199999999999999,"5min":0.753,"15min":0.76900000000000002},"last":0.56299999999999994}]},{"osd":4,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.28499999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":0.71299999999999997,"15min":0.753},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.29599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.77400000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.40899999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.48699999999999999},"min":{"1min":0.35099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73799999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.496}]},{"osd":6,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.44400000000000001,"5min":0.33300000000000002,"15min":0.32500000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.89800000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.33200000000000002,"15min":0.28899999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55600000000000005,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68400000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.50600000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.30099999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.47099999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.60299999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.29999999999999999,"15min":0.27000000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.36499999999999999,"5min":0.34599999999999997,"15min":0.32600000000000001},"max":{"1min":0.67600000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52600000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54900000000000004,"15min":0.51400000000000001},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73199999999999998,"5min":0.752,"15min":0.77800000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.45300000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71899999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57499999999999996}]},{"osd":4,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.46999999999999997,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66900000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.34899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59299999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48799999999999999,"15min":0.50900000000000001},"min":{"1min":0.34899999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52500000000000002,"15min":0.54900000000000004},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63100000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52600000000000002,"15min":0.54300000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.76500000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54900000000000004,"15min":0.52200000000000002},"min":{"1min":0.44,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.70299999999999996,"5min":0.748,"15min":0.748},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.56499999999999995},"min":{"1min":0.503,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70199999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53400000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.433,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71199999999999997,"5min":0.80600000000000005,"15min":0.82099999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72199999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59499999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.40600000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67800000000000005,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.52400000000000002},"min":{"1min":0.46200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72499999999999998,"5min":0.76600000000000001,"15min":0.77100000000000002},"last":0.48599999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.441,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.80900000000000005},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.39800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.73599999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.55700000000000005}]},{"osd":4,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45200000000000001,"15min":0.48899999999999999},"min":{"1min":0.31900000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.81899999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.32400000000000001,"5min":0.29799999999999999,"15min":0.29399999999999998},"max":{"1min":0.749,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.50900000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47299999999999998,"15min":0.497},"min":{"1min":0.311,"5min":0.254,"15min":0.254},"max":{"1min":0.70699999999999996,"5min":0.73299999999999998,"15min":0.85299999999999998},"last":0.629},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.31},"max":{"1min":0.77000000000000002,"5min":0.78600000000000003,"15min":0.83999999999999997},"last":0.61599999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.498,"15min":0.51800000000000002},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.78400000000000003,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56399999999999995,"15min":0.59499999999999997},"min":{"1min":0.35999999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.76100000000000001,"5min":0.77600000000000002,"15min":0.98599999999999999},"last":0.65200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.19700000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.32400000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.36599999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.442},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.35999999999999999,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.316,"5min":0.313,"15min":0.313},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.499},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.23400000000000001},"max":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.51000000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.91000000000000003},"last":0.45400000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44800000000000001,"15min":0.46500000000000002},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48999999999999999,"15min":0.5},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.38700000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.36899999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69999999999999996,"5min":0.73099999999999998,"15min":0.82399999999999995},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78200000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.57099999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.51800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76900000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.34999999999999998,"15min":0.34000000000000002},"min":{"1min":0.24099999999999999,"5min":0.19800000000000001,"15min":0.193},"max":{"1min":0.49199999999999999,"5min":0.629,"15min":0.629},"last":0.307},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.38,"15min":0.35999999999999999},"min":{"1min":0.33000000000000002,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.56799999999999995,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.32500000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.33900000000000002,"15min":0.32400000000000001},"min":{"1min":0.28999999999999998,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.56799999999999995},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.34300000000000003},"min":{"1min":0.28599999999999998,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55800000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.245}]},{"osd":2,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34899999999999998,"15min":0.34599999999999997},"min":{"1min":0.28999999999999998,"5min":0.22600000000000001,"15min":0.21199999999999999},"max":{"1min":0.49399999999999999,"5min":0.53100000000000003,"15min":0.64900000000000002},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39200000000000002,"15min":0.379},"min":{"1min":0.313,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55800000000000005,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.33700000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57199999999999995,"15min":0.55000000000000004},"min":{"1min":0.46300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80200000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58599999999999997,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.81699999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58899999999999997,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.31},"max":{"1min":0.77400000000000002,"5min":0.872,"15min":0.872},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.59099999999999997,"15min":0.56699999999999995},"min":{"1min":0.48999999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77900000000000003,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42799999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.45300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78100000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59499999999999997,"15min":0.56799999999999995},"min":{"1min":0.51000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.73599999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.44800000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.442,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78600000000000003,"5min":0.879,"15min":0.879},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.61699999999999999,"15min":0.58699999999999997},"min":{"1min":0.50800000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78000000000000003,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.41099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.34499999999999997,"15min":0.311},"min":{"1min":0.23599999999999999,"5min":0.20899999999999999,"15min":0.18099999999999999},"max":{"1min":0.54800000000000004,"5min":0.61499999999999999,"15min":0.72699999999999998},"last":0.311},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.376,"15min":0.35599999999999998},"min":{"1min":0.33700000000000002,"5min":0.25800000000000001,"15min":0.17699999999999999},"max":{"1min":0.53500000000000003,"5min":0.53700000000000003,"15min":2.0539999999999998},"last":0.40100000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.34100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.17999999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.83099999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.35999999999999999},"min":{"1min":0.30199999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58999999999999997},"last":0.25800000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.40400000000000003,"15min":0.372},"min":{"1min":0.36599999999999999,"5min":0.247,"15min":0.216},"max":{"1min":0.59199999999999997,"5min":0.68100000000000005,"15min":0.995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.40200000000000002,"15min":0.379},"min":{"1min":0.26100000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.57199999999999995,"5min":0.64400000000000002,"15min":0.76600000000000001},"last":0.34499999999999997}]},{"osd":4,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80700000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82499999999999996,"5min":0.94699999999999995,"15min":2.347},"last":0.73099999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.35399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83299999999999996,"5min":0.997,"15min":0.997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.55900000000000005},"min":{"1min":0.42499999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.75700000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.443,"5min":0.371,"15min":0.371},"max":{"1min":0.877,"5min":0.877,"15min":2.274},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.373},"max":{"1min":0.81000000000000005,"5min":0.91100000000000003,"15min":1.0289999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82499999999999996,"5min":0.82999999999999996,"15min":2.3090000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59199999999999997,"15min":0.58299999999999996},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.80800000000000005,"5min":0.86699999999999999,"15min":1.0549999999999999},"last":0.74399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.33300000000000002,"15min":0.30199999999999999},"min":{"1min":0.251,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.44700000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.254},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.36799999999999999,"15min":0.34100000000000003},"min":{"1min":0.32300000000000001,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.55800000000000005,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.30399999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.31900000000000001},"min":{"1min":0.308,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.48299999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.35999999999999999},"min":{"1min":0.24399999999999999,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":0.56200000000000006,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.27600000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.40899999999999997,"15min":0.371},"min":{"1min":0.36399999999999999,"5min":0.21299999999999999,"15min":0.191},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.221},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.36699999999999999,"15min":0.35699999999999998},"min":{"1min":0.32400000000000001,"5min":0.22500000000000001,"15min":0.20399999999999999},"max":{"1min":0.56399999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34200000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57099999999999995,"15min":0.56799999999999995},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57899999999999996,"15min":0.55800000000000005},"min":{"1min":0.40600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.82899999999999996,"15min":1.002},"last":0.49299999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":0.85799999999999998,"15min":0.86099999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59099999999999997,"15min":0.55600000000000005},"min":{"1min":0.436,"5min":0.317,"15min":0.317},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.85599999999999998},"last":0.55000000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57599999999999996,"15min":0.56399999999999995},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.36899999999999999},"max":{"1min":0.70999999999999996,"5min":0.92400000000000004,"15min":1.038},"last":0.503},{"interface":"front","average":{"1min":0.626,"5min":0.58299999999999996,"15min":0.56899999999999995},"min":{"1min":0.44400000000000001,"5min":0.40100000000000002,"15min":0.39100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.84199999999999997},"last":0.66200000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61499999999999999,"15min":0.59999999999999998},"min":{"1min":0.52300000000000002,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.80500000000000005,"5min":0.84399999999999997,"15min":0.88900000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.53100000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.81000000000000005,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.64900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1479,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193832,"statfs":{"total":200000000,"available":198484927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.317},"min":{"1min":0.221,"5min":0.189,"15min":0.184},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.32400000000000001},"min":{"1min":0.248,"5min":0.20699999999999999,"15min":0.184},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.33400000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.218},"max":{"1min":0.52100000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.376,"15min":0.35599999999999998},"min":{"1min":0.315,"5min":0.23400000000000001,"15min":0.23100000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.622},"last":0.29799999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.36199999999999999,"15min":0.33500000000000002},"min":{"1min":0.246,"5min":0.224,"15min":0.224},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.39500000000000002,"15min":0.376},"min":{"1min":0.32400000000000001,"5min":0.27600000000000002,"15min":0.27400000000000002},"max":{"1min":0.54700000000000004,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.39500000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.57099999999999995,"15min":0.53400000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80700000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47399999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.59699999999999998,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83299999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.51000000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.60899999999999999,"15min":0.58999999999999997},"min":{"1min":0.41099999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.60899999999999999,"15min":0.59099999999999997},"min":{"1min":0.36899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89500000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.67100000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.58999999999999997,"15min":0.56200000000000006},"min":{"1min":0.433,"5min":0.379,"15min":0.375},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.60099999999999998,"15min":0.58099999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.71499999999999997}]}]}],"pool_statfs":[]}} 2023-12-20T04:51:49.839 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:51:49.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.973+0000 7f4fa572a640 1 Processor -- start 2023-12-20T04:51:49.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.973+0000 7f4fa572a640 1 -- start start 2023-12-20T04:51:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.974+0000 7f4fa572a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4fa0160450 0x7f4fa0160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.974+0000 7f4fa572a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4fa00b5090 0x7f4fa00d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.974+0000 7f4fa572a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4fa00b5ec0 con 0x7f4fa01611b0 2023-12-20T04:51:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.974+0000 7f4fa572a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa01617e0 con 0x7f4fa00b5090 2023-12-20T04:51:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.974+0000 7f4fa572a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4fa00d0fc0 con 0x7f4fa0160450 2023-12-20T04:51:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.974+0000 7f4f9f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4fa00b5090 0x7f4fa00d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.974+0000 7f4f9f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4fa00b5090 0x7f4fa00d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42616/0 (socket says 172.21.15.132:42616) 2023-12-20T04:51:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.974+0000 7f4f9f7fe640 1 -- 172.21.15.132:0/1124538304 learned_addr learned my addr 172.21.15.132:0/1124538304 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.974+0000 7f4f9effd640 1 --2- 172.21.15.132:0/1124538304 >> v2:172.21.15.187:3300/0 conn(0x7f4fa0160450 0x7f4fa0160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.974+0000 7f4f9f7fe640 1 -- 172.21.15.132:0/1124538304 >> v2:172.21.15.187:3300/0 conn(0x7f4fa0160450 msgr2=0x7f4fa0160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.974+0000 7f4f9f7fe640 1 --2- 172.21.15.132:0/1124538304 >> v2:172.21.15.187:3300/0 conn(0x7f4fa0160450 0x7f4fa0160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.974+0000 7f4f9f7fe640 1 -- 172.21.15.132:0/1124538304 >> v1:172.21.15.187:6789/0 conn(0x7f4fa01611b0 legacy=0x7f4fa00b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.974+0000 7f4f9f7fe640 1 -- 172.21.15.132:0/1124538304 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4fa00d12a0 con 0x7f4fa00b5090 2023-12-20T04:51:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.975+0000 7f4f9f7fe640 1 --2- 172.21.15.132:0/1124538304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fa00b5090 0x7f4fa00d1aa0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f4fa008b150 tx=0x7f4f9802bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63049207f60dfc20 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.975+0000 7f4f9e7fc640 1 -- 172.21.15.132:0/1124538304 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f9802cb20 con 0x7f4fa00b5090 2023-12-20T04:51:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.975+0000 7f4f9e7fc640 1 -- 172.21.15.132:0/1124538304 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f9802cc80 con 0x7f4fa00b5090 2023-12-20T04:51:49.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.975+0000 7f4f9e7fc640 1 -- 172.21.15.132:0/1124538304 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f980343f0 con 0x7f4fa00b5090 2023-12-20T04:51:49.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.976+0000 7f4fa572a640 1 -- 172.21.15.132:0/1124538304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fa00b5090 msgr2=0x7f4fa00d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.976+0000 7f4fa572a640 1 --2- 172.21.15.132:0/1124538304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fa00b5090 0x7f4fa00d1aa0 secure :-1 s=READY pgs=1663 cs=0 l=1 rev1=1 crypto rx=0x7f4fa008b150 tx=0x7f4f9802bf80 comp rx=0 tx=0).stop 2023-12-20T04:51:49.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.976+0000 7f4fa572a640 1 -- 172.21.15.132:0/1124538304 shutdown_connections 2023-12-20T04:51:49.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.976+0000 7f4fa572a640 1 --2- 172.21.15.132:0/1124538304 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fa00b5090 0x7f4fa00d1aa0 unknown :-1 s=CLOSED pgs=1663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.976+0000 7f4fa572a640 1 --2- 172.21.15.132:0/1124538304 >> v2:172.21.15.187:3300/0 conn(0x7f4fa0160450 0x7f4fa0160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.976+0000 7f4fa572a640 1 -- 172.21.15.132:0/1124538304 >> 172.21.15.132:0/1124538304 conn(0x7f4fa00cf980 msgr2=0x7f4fa00cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:49.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.976+0000 7f4fa572a640 1 -- 172.21.15.132:0/1124538304 shutdown_connections 2023-12-20T04:51:49.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.976+0000 7f4fa572a640 1 -- 172.21.15.132:0/1124538304 wait complete. 2023-12-20T04:51:49.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.977+0000 7f4fa572a640 1 Processor -- start 2023-12-20T04:51:49.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.977+0000 7f4fa572a640 1 -- start start 2023-12-20T04:51:49.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4fa572a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fa00b5090 0x7f4fa00c87a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4fa572a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fa0160450 0x7f4fa00cc750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4fa572a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fa01611b0 0x7f4fa00ccc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4fa572a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa00cd2a0 con 0x7f4fa0160450 2023-12-20T04:51:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4fa572a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa01576b0 con 0x7f4fa01611b0 2023-12-20T04:51:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4fa572a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4fa0157990 con 0x7f4fa00b5090 2023-12-20T04:51:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4f97fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fa0160450 0x7f4fa00cc750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4f97fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fa0160450 0x7f4fa00cc750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42618/0 (socket says 172.21.15.132:42618) 2023-12-20T04:51:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4f97fff640 1 -- 172.21.15.132:0/1581728249 learned_addr learned my addr 172.21.15.132:0/1581728249 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4f97fff640 1 -- 172.21.15.132:0/1581728249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fa00b5090 msgr2=0x7f4fa00c87a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4f9effd640 1 --2- 172.21.15.132:0/1581728249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fa00b5090 0x7f4fa00c87a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4f9f7fe640 1 --2- 172.21.15.132:0/1581728249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fa01611b0 0x7f4fa00ccc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4f97fff640 1 --2- 172.21.15.132:0/1581728249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fa00b5090 0x7f4fa00c87a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4f97fff640 1 -- 172.21.15.132:0/1581728249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fa01611b0 msgr2=0x7f4fa00ccc90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4f97fff640 1 --2- 172.21.15.132:0/1581728249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fa01611b0 0x7f4fa00ccc90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4f97fff640 1 -- 172.21.15.132:0/1581728249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f98009b30 con 0x7f4fa0160450 2023-12-20T04:51:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4f9effd640 1 --2- 172.21.15.132:0/1581728249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fa00b5090 0x7f4fa00c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:49.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4f9f7fe640 1 --2- 172.21.15.132:0/1581728249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fa01611b0 0x7f4fa00ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:49.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4f97fff640 1 --2- 172.21.15.132:0/1581728249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fa0160450 0x7f4fa00cc750 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800b3f0 tx=0x7f4f8800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:49.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4f977fe640 1 -- 172.21.15.132:0/1581728249 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f88011830 con 0x7f4fa0160450 2023-12-20T04:51:49.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4f977fe640 1 -- 172.21.15.132:0/1581728249 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f88011990 con 0x7f4fa0160450 2023-12-20T04:51:49.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.978+0000 7f4fa572a640 1 -- 172.21.15.132:0/1581728249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4fa0157c70 con 0x7f4fa0160450 2023-12-20T04:51:49.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.979+0000 7f4f977fe640 1 -- 172.21.15.132:0/1581728249 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f88011d40 con 0x7f4fa0160450 2023-12-20T04:51:49.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.979+0000 7f4fa572a640 1 -- 172.21.15.132:0/1581728249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4fa00ca260 con 0x7f4fa0160450 2023-12-20T04:51:49.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.980+0000 7f4fa572a640 1 -- 172.21.15.132:0/1581728249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4fa0158190 con 0x7f4fa0160450 2023-12-20T04:51:49.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.980+0000 7f4f977fe640 1 -- 172.21.15.132:0/1581728249 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4f8801a400 con 0x7f4fa0160450 2023-12-20T04:51:49.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.980+0000 7f4f977fe640 1 --2- 172.21.15.132:0/1581728249 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f8006a430 0x7f4f8006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:49.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.981+0000 7f4f9effd640 1 --2- 172.21.15.132:0/1581728249 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f8006a430 0x7f4f8006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:49.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.981+0000 7f4f977fe640 1 -- 172.21.15.132:0/1581728249 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f880887a0 con 0x7f4fa0160450 2023-12-20T04:51:49.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.981+0000 7f4f9effd640 1 --2- 172.21.15.132:0/1581728249 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f8006a430 0x7f4f8006c8f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4f90006fd0 tx=0x7f4f90008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:49.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:49.985+0000 7f4f977fe640 1 -- 172.21.15.132:0/1581728249 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4fa0158190 con 0x7f4fa0160450 2023-12-20T04:51:50.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.147+0000 7f4fa572a640 1 -- 172.21.15.132:0/1581728249 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f4fa00b89d0 con 0x7f4f8006a430 2023-12-20T04:51:50.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.154+0000 7f4f977fe640 1 -- 172.21.15.132:0/1581728249 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276416 (secure 0 0 0) 0x7f4f90009e10 con 0x7f4f8006a430 2023-12-20T04:51:50.159 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:50.160 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.157+0000 7f4fa572a640 1 -- 172.21.15.132:0/1581728249 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f8006a430 msgr2=0x7f4f8006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.157+0000 7f4fa572a640 1 --2- 172.21.15.132:0/1581728249 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f8006a430 0x7f4f8006c8f0 secure :-1 s=READY pgs=703 cs=0 l=1 rev1=1 crypto rx=0x7f4f90006fd0 tx=0x7f4f90008040 comp rx=0 tx=0).stop 2023-12-20T04:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.157+0000 7f4fa572a640 1 -- 172.21.15.132:0/1581728249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fa0160450 msgr2=0x7f4fa00cc750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.157+0000 7f4fa572a640 1 --2- 172.21.15.132:0/1581728249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fa0160450 0x7f4fa00cc750 secure :-1 s=READY pgs=1664 cs=0 l=1 rev1=1 crypto rx=0x7f4f8800b3f0 tx=0x7f4f8800b8b0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.157+0000 7f4fa572a640 1 -- 172.21.15.132:0/1581728249 shutdown_connections 2023-12-20T04:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.157+0000 7f4fa572a640 1 --2- 172.21.15.132:0/1581728249 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f8006a430 0x7f4f8006c8f0 unknown :-1 s=CLOSED pgs=703 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.157+0000 7f4fa572a640 1 --2- 172.21.15.132:0/1581728249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4fa01611b0 0x7f4fa00ccc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.157+0000 7f4fa572a640 1 --2- 172.21.15.132:0/1581728249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4fa0160450 0x7f4fa00cc750 unknown :-1 s=CLOSED pgs=1664 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.157+0000 7f4fa572a640 1 --2- 172.21.15.132:0/1581728249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4fa00b5090 0x7f4fa00c87a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.157+0000 7f4fa572a640 1 -- 172.21.15.132:0/1581728249 >> 172.21.15.132:0/1581728249 conn(0x7f4fa00cf980 msgr2=0x7f4fa0155e80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.157+0000 7f4fa572a640 1 -- 172.21.15.132:0/1581728249 shutdown_connections 2023-12-20T04:51:50.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.157+0000 7f4fa572a640 1 -- 172.21.15.132:0/1581728249 wait complete. 2023-12-20T04:51:50.170 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":437,"stamp":"2023-12-20T04:51:48.212071+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554122,"statfs":{"total":1600000000,"available":1591421624,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.000614"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166474+0000","last_change":"2023-12-20T04:51:45.166474+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166474+0000","last_undegraded":"2023-12-20T04:51:45.166474+0000","last_fullsized":"2023-12-20T04:51:45.166474+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:47.636801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.169853+0000","last_change":"2023-12-20T04:51:45.169853+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.169853+0000","last_undegraded":"2023-12-20T04:51:45.169853+0000","last_fullsized":"2023-12-20T04:51:45.169853+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:47.636801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.165411+0000","last_change":"2023-12-20T04:51:45.165411+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.165411+0000","last_undegraded":"2023-12-20T04:51:45.165411+0000","last_fullsized":"2023-12-20T04:51:45.165411+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:54:35.761511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164972+0000","last_change":"2023-12-20T04:51:45.164972+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164972+0000","last_undegraded":"2023-12-20T04:51:45.164972+0000","last_fullsized":"2023-12-20T04:51:45.164972+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:57:35.366758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168312+0000","last_change":"2023-12-20T04:51:45.168312+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168312+0000","last_undegraded":"2023-12-20T04:51:45.168312+0000","last_fullsized":"2023-12-20T04:51:45.168312+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:13:09.277528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168487+0000","last_change":"2023-12-20T04:51:45.168487+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168487+0000","last_undegraded":"2023-12-20T04:51:45.168487+0000","last_fullsized":"2023-12-20T04:51:45.168487+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:55:37.235060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168585+0000","last_change":"2023-12-20T04:51:45.168585+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168585+0000","last_undegraded":"2023-12-20T04:51:45.168585+0000","last_fullsized":"2023-12-20T04:51:45.168585+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:47:41.345193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164942+0000","last_change":"2023-12-20T04:51:45.164942+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164942+0000","last_undegraded":"2023-12-20T04:51:45.164942+0000","last_fullsized":"2023-12-20T04:51:45.164942+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:13:33.762273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.169378+0000","last_change":"2023-12-20T04:51:45.169378+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.169378+0000","last_undegraded":"2023-12-20T04:51:45.169378+0000","last_fullsized":"2023-12-20T04:51:45.169378+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:45:30.919915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166846+0000","last_change":"2023-12-20T04:51:45.166846+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166846+0000","last_undegraded":"2023-12-20T04:51:45.166846+0000","last_fullsized":"2023-12-20T04:51:45.166846+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:33:09.820546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164654+0000","last_change":"2023-12-20T04:51:45.164654+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164654+0000","last_undegraded":"2023-12-20T04:51:45.164654+0000","last_fullsized":"2023-12-20T04:51:45.164654+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:01:11.984641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166000+0000","last_change":"2023-12-20T04:51:45.166000+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166000+0000","last_undegraded":"2023-12-20T04:51:45.166000+0000","last_fullsized":"2023-12-20T04:51:45.166000+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:54:41.620584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166559+0000","last_change":"2023-12-20T04:51:45.166559+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166559+0000","last_undegraded":"2023-12-20T04:51:45.166559+0000","last_fullsized":"2023-12-20T04:51:45.166559+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:13:33.762273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.169059+0000","last_change":"2023-12-20T04:51:45.169059+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.169059+0000","last_undegraded":"2023-12-20T04:51:45.169059+0000","last_fullsized":"2023-12-20T04:51:45.169059+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:47:45.526934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168360+0000","last_change":"2023-12-20T04:51:45.168360+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168360+0000","last_undegraded":"2023-12-20T04:51:45.168360+0000","last_fullsized":"2023-12-20T04:51:45.168360+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:19:07.052276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168490+0000","last_change":"2023-12-20T04:51:45.168490+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168490+0000","last_undegraded":"2023-12-20T04:51:45.168490+0000","last_fullsized":"2023-12-20T04:51:45.168490+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:42:42.363620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168877+0000","last_change":"2023-12-20T04:51:45.168877+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168877+0000","last_undegraded":"2023-12-20T04:51:45.168877+0000","last_fullsized":"2023-12-20T04:51:45.168877+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:40:46.196430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168306+0000","last_change":"2023-12-20T04:51:45.168306+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168306+0000","last_undegraded":"2023-12-20T04:51:45.168306+0000","last_fullsized":"2023-12-20T04:51:45.168306+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:07.950388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168376+0000","last_change":"2023-12-20T04:51:45.168376+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168376+0000","last_undegraded":"2023-12-20T04:51:45.168376+0000","last_fullsized":"2023-12-20T04:51:45.168376+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:35:01.422172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164661+0000","last_change":"2023-12-20T04:51:45.164661+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164661+0000","last_undegraded":"2023-12-20T04:51:45.164661+0000","last_fullsized":"2023-12-20T04:51:45.164661+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:16:18.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.165957+0000","last_change":"2023-12-20T04:51:45.165957+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.165957+0000","last_undegraded":"2023-12-20T04:51:45.165957+0000","last_fullsized":"2023-12-20T04:51:45.165957+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:16:33.403901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166025+0000","last_change":"2023-12-20T04:51:45.166025+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166025+0000","last_undegraded":"2023-12-20T04:51:45.166025+0000","last_fullsized":"2023-12-20T04:51:45.166025+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:45:30.919915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166165+0000","last_change":"2023-12-20T04:51:45.166165+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166165+0000","last_undegraded":"2023-12-20T04:51:45.166165+0000","last_fullsized":"2023-12-20T04:51:45.166165+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:20:27.921265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166473+0000","last_change":"2023-12-20T04:51:45.166473+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166473+0000","last_undegraded":"2023-12-20T04:51:45.166473+0000","last_fullsized":"2023-12-20T04:51:45.166473+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:11:39.764510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168677+0000","last_change":"2023-12-20T04:51:45.168677+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168677+0000","last_undegraded":"2023-12-20T04:51:45.168677+0000","last_fullsized":"2023-12-20T04:51:45.168677+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:19:23.214753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168685+0000","last_change":"2023-12-20T04:51:45.168685+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168685+0000","last_undegraded":"2023-12-20T04:51:45.168685+0000","last_fullsized":"2023-12-20T04:51:45.168685+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:47.122533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168329+0000","last_change":"2023-12-20T04:51:45.168329+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168329+0000","last_undegraded":"2023-12-20T04:51:45.168329+0000","last_fullsized":"2023-12-20T04:51:45.168329+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:04:30.065153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164589+0000","last_change":"2023-12-20T04:51:45.164589+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164589+0000","last_undegraded":"2023-12-20T04:51:45.164589+0000","last_fullsized":"2023-12-20T04:51:45.164589+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:39:57.468608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166023+0000","last_change":"2023-12-20T04:51:45.166023+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166023+0000","last_undegraded":"2023-12-20T04:51:45.166023+0000","last_fullsized":"2023-12-20T04:51:45.166023+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:57.319453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166837+0000","last_change":"2023-12-20T04:51:45.166837+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166837+0000","last_undegraded":"2023-12-20T04:51:45.166837+0000","last_fullsized":"2023-12-20T04:51:45.166837+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:57:35.366758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168890+0000","last_change":"2023-12-20T04:51:45.168890+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168890+0000","last_undegraded":"2023-12-20T04:51:45.168890+0000","last_fullsized":"2023-12-20T04:51:45.168890+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:16:33.403901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.167245+0000","last_change":"2023-12-20T04:51:45.167245+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.167245+0000","last_undegraded":"2023-12-20T04:51:45.167245+0000","last_fullsized":"2023-12-20T04:51:45.167245+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:54:35.761511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":291,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-12-20T04:51:44.842001+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:51:44.842001+0000","last_peered":"2023-12-20T04:51:44.842001+0000","last_clean":"2023-12-20T04:51:44.842001+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:51:44.842001+0000","last_undegraded":"2023-12-20T04:51:44.842001+0000","last_fullsized":"2023-12-20T04:51:44.842001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574960,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1479,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193832,"statfs":{"total":200000000,"available":198484927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.40600000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74399999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53800000000000003,"15min":0.52600000000000002},"min":{"1min":0.42999999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70999999999999996,"5min":0.79200000000000004,"15min":0.86299999999999999},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.47799999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.98799999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.374,"15min":0.374},"max":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":1.0269999999999999},"last":0.58499999999999996}]},{"osd":2,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.70599999999999996,"5min":0.97699999999999998,"15min":1.0069999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.41099999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.78000000000000003},"last":0.50800000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.438,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72799999999999998,"5min":1.048,"15min":1.048},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.46700000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74199999999999999,"5min":0.753,"15min":0.76900000000000002},"last":0.56299999999999994}]},{"osd":4,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.28499999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":0.71299999999999997,"15min":0.753},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.29599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.77400000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.40899999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.48699999999999999},"min":{"1min":0.35099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73799999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.496}]},{"osd":6,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.44400000000000001,"5min":0.33300000000000002,"15min":0.32500000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.89800000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.33200000000000002,"15min":0.28899999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55600000000000005,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68400000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.50600000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.30099999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.47099999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.60299999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.29999999999999999,"15min":0.27000000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.36499999999999999,"5min":0.34599999999999997,"15min":0.32600000000000001},"max":{"1min":0.67600000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52600000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54900000000000004,"15min":0.51400000000000001},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73199999999999998,"5min":0.752,"15min":0.77800000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.45300000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71899999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57499999999999996}]},{"osd":4,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.46999999999999997,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66900000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.34899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59299999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48799999999999999,"15min":0.50900000000000001},"min":{"1min":0.34899999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52500000000000002,"15min":0.54900000000000004},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63100000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52600000000000002,"15min":0.54300000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.76500000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54900000000000004,"15min":0.52200000000000002},"min":{"1min":0.44,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.70299999999999996,"5min":0.748,"15min":0.748},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.56499999999999995},"min":{"1min":0.503,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70199999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53400000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.433,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71199999999999997,"5min":0.80600000000000005,"15min":0.82099999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72199999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59499999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.40600000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67800000000000005,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.52400000000000002},"min":{"1min":0.46200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72499999999999998,"5min":0.76600000000000001,"15min":0.77100000000000002},"last":0.48599999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.441,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.80900000000000005},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.39800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.73599999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.55700000000000005}]},{"osd":4,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45200000000000001,"15min":0.48899999999999999},"min":{"1min":0.31900000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.81899999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.32400000000000001,"5min":0.29799999999999999,"15min":0.29399999999999998},"max":{"1min":0.749,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.50900000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47299999999999998,"15min":0.497},"min":{"1min":0.311,"5min":0.254,"15min":0.254},"max":{"1min":0.70699999999999996,"5min":0.73299999999999998,"15min":0.85299999999999998},"last":0.629},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.31},"max":{"1min":0.77000000000000002,"5min":0.78600000000000003,"15min":0.83999999999999997},"last":0.61599999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.498,"15min":0.51800000000000002},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.78400000000000003,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56399999999999995,"15min":0.59499999999999997},"min":{"1min":0.35999999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.76100000000000001,"5min":0.77600000000000002,"15min":0.98599999999999999},"last":0.65200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.19700000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.32400000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.36599999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.442},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.35999999999999999,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.316,"5min":0.313,"15min":0.313},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.499},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.23400000000000001},"max":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.51000000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.91000000000000003},"last":0.45400000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44800000000000001,"15min":0.46500000000000002},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48999999999999999,"15min":0.5},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.38700000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.36899999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69999999999999996,"5min":0.73099999999999998,"15min":0.82399999999999995},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78200000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.57099999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.51800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76900000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.34999999999999998,"15min":0.34000000000000002},"min":{"1min":0.24099999999999999,"5min":0.19800000000000001,"15min":0.193},"max":{"1min":0.49199999999999999,"5min":0.629,"15min":0.629},"last":0.307},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.38,"15min":0.35999999999999999},"min":{"1min":0.33000000000000002,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.56799999999999995,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.32500000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.33900000000000002,"15min":0.32400000000000001},"min":{"1min":0.28999999999999998,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.56799999999999995},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.34300000000000003},"min":{"1min":0.28599999999999998,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55800000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.245}]},{"osd":2,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34899999999999998,"15min":0.34599999999999997},"min":{"1min":0.28999999999999998,"5min":0.22600000000000001,"15min":0.21199999999999999},"max":{"1min":0.49399999999999999,"5min":0.53100000000000003,"15min":0.64900000000000002},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39200000000000002,"15min":0.379},"min":{"1min":0.313,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55800000000000005,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.33700000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57199999999999995,"15min":0.55000000000000004},"min":{"1min":0.46300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80200000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58599999999999997,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.81699999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58899999999999997,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.31},"max":{"1min":0.77400000000000002,"5min":0.872,"15min":0.872},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.59099999999999997,"15min":0.56699999999999995},"min":{"1min":0.48999999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77900000000000003,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42799999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.45300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78100000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59499999999999997,"15min":0.56799999999999995},"min":{"1min":0.51000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.73599999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.44800000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.442,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78600000000000003,"5min":0.879,"15min":0.879},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.61699999999999999,"15min":0.58699999999999997},"min":{"1min":0.50800000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78000000000000003,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.41099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.34499999999999997,"15min":0.311},"min":{"1min":0.23599999999999999,"5min":0.20899999999999999,"15min":0.18099999999999999},"max":{"1min":0.54800000000000004,"5min":0.61499999999999999,"15min":0.72699999999999998},"last":0.311},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.376,"15min":0.35599999999999998},"min":{"1min":0.33700000000000002,"5min":0.25800000000000001,"15min":0.17699999999999999},"max":{"1min":0.53500000000000003,"5min":0.53700000000000003,"15min":2.0539999999999998},"last":0.40100000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.34100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.17999999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.83099999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.35999999999999999},"min":{"1min":0.30199999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58999999999999997},"last":0.25800000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.40400000000000003,"15min":0.372},"min":{"1min":0.36599999999999999,"5min":0.247,"15min":0.216},"max":{"1min":0.59199999999999997,"5min":0.68100000000000005,"15min":0.995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.40200000000000002,"15min":0.379},"min":{"1min":0.26100000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.57199999999999995,"5min":0.64400000000000002,"15min":0.76600000000000001},"last":0.34499999999999997}]},{"osd":4,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80700000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82499999999999996,"5min":0.94699999999999995,"15min":2.347},"last":0.73099999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.35399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83299999999999996,"5min":0.997,"15min":0.997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.55900000000000005},"min":{"1min":0.42499999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.75700000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.443,"5min":0.371,"15min":0.371},"max":{"1min":0.877,"5min":0.877,"15min":2.274},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.373},"max":{"1min":0.81000000000000005,"5min":0.91100000000000003,"15min":1.0289999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82499999999999996,"5min":0.82999999999999996,"15min":2.3090000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59199999999999997,"15min":0.58299999999999996},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.80800000000000005,"5min":0.86699999999999999,"15min":1.0549999999999999},"last":0.74399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.33300000000000002,"15min":0.30199999999999999},"min":{"1min":0.251,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.44700000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.254},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.36799999999999999,"15min":0.34100000000000003},"min":{"1min":0.32300000000000001,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.55800000000000005,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.30399999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.31900000000000001},"min":{"1min":0.308,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.48299999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.35999999999999999},"min":{"1min":0.24399999999999999,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":0.56200000000000006,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.27600000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.40899999999999997,"15min":0.371},"min":{"1min":0.36399999999999999,"5min":0.21299999999999999,"15min":0.191},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.221},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.36699999999999999,"15min":0.35699999999999998},"min":{"1min":0.32400000000000001,"5min":0.22500000000000001,"15min":0.20399999999999999},"max":{"1min":0.56399999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34200000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57099999999999995,"15min":0.56799999999999995},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57899999999999996,"15min":0.55800000000000005},"min":{"1min":0.40600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.82899999999999996,"15min":1.002},"last":0.49299999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":0.85799999999999998,"15min":0.86099999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59099999999999997,"15min":0.55600000000000005},"min":{"1min":0.436,"5min":0.317,"15min":0.317},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.85599999999999998},"last":0.55000000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57599999999999996,"15min":0.56399999999999995},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.36899999999999999},"max":{"1min":0.70999999999999996,"5min":0.92400000000000004,"15min":1.038},"last":0.503},{"interface":"front","average":{"1min":0.626,"5min":0.58299999999999996,"15min":0.56899999999999995},"min":{"1min":0.44400000000000001,"5min":0.40100000000000002,"15min":0.39100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.84199999999999997},"last":0.66200000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61499999999999999,"15min":0.59999999999999998},"min":{"1min":0.52300000000000002,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.80500000000000005,"5min":0.84399999999999997,"15min":0.88900000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.53100000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.81000000000000005,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.64900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1479,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193832,"statfs":{"total":200000000,"available":198484927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.317},"min":{"1min":0.221,"5min":0.189,"15min":0.184},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.32400000000000001},"min":{"1min":0.248,"5min":0.20699999999999999,"15min":0.184},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.33400000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.218},"max":{"1min":0.52100000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.376,"15min":0.35599999999999998},"min":{"1min":0.315,"5min":0.23400000000000001,"15min":0.23100000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.622},"last":0.29799999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.36199999999999999,"15min":0.33500000000000002},"min":{"1min":0.246,"5min":0.224,"15min":0.224},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.39500000000000002,"15min":0.376},"min":{"1min":0.32400000000000001,"5min":0.27600000000000002,"15min":0.27400000000000002},"max":{"1min":0.54700000000000004,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.39500000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.57099999999999995,"15min":0.53400000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80700000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47399999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.59699999999999998,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83299999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.51000000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.60899999999999999,"15min":0.58999999999999997},"min":{"1min":0.41099999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.60899999999999999,"15min":0.59099999999999997},"min":{"1min":0.36899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89500000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.67100000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.58999999999999997,"15min":0.56200000000000006},"min":{"1min":0.433,"5min":0.379,"15min":0.375},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.60099999999999998,"15min":0.58099999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.71499999999999997}]}]}],"pool_statfs":[]}} 2023-12-20T04:51:50.175 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3f is not active+clean 2023-12-20T04:51:50.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3e is not active+clean 2023-12-20T04:51:50.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3d is not active+clean 2023-12-20T04:51:50.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3c is not active+clean 2023-12-20T04:51:50.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3b is not active+clean 2023-12-20T04:51:50.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.176 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3a is not active+clean 2023-12-20T04:51:50.176 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.39 is not active+clean 2023-12-20T04:51:50.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.39', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.38 is not active+clean 2023-12-20T04:51:50.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.38', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.37 is not active+clean 2023-12-20T04:51:50.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.37', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.36 is not active+clean 2023-12-20T04:51:50.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.36', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.177 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.35 is not active+clean 2023-12-20T04:51:50.177 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.35', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.34 is not active+clean 2023-12-20T04:51:50.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.34', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.33 is not active+clean 2023-12-20T04:51:50.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.33', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.32 is not active+clean 2023-12-20T04:51:50.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.32', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.31 is not active+clean 2023-12-20T04:51:50.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.31', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.30 is not active+clean 2023-12-20T04:51:50.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.30', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2f is not active+clean 2023-12-20T04:51:50.178 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.178 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2e is not active+clean 2023-12-20T04:51:50.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2d is not active+clean 2023-12-20T04:51:50.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2c is not active+clean 2023-12-20T04:51:50.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2b is not active+clean 2023-12-20T04:51:50.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2a is not active+clean 2023-12-20T04:51:50.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.29 is not active+clean 2023-12-20T04:51:50.179 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.29', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.179 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.28 is not active+clean 2023-12-20T04:51:50.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.28', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.27 is not active+clean 2023-12-20T04:51:50.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.27', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.26 is not active+clean 2023-12-20T04:51:50.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.26', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.25 is not active+clean 2023-12-20T04:51:50.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.25', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.24 is not active+clean 2023-12-20T04:51:50.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.24', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.180 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.23 is not active+clean 2023-12-20T04:51:50.180 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.23', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.22 is not active+clean 2023-12-20T04:51:50.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.22', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.21 is not active+clean 2023-12-20T04:51:50.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.21', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.20 is not active+clean 2023-12-20T04:51:50.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.20', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1e is not active+clean 2023-12-20T04:51:50.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1f is not active+clean 2023-12-20T04:51:50.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.166474+0000', 'last_change': '2023-12-20T04:51:45.166474+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.166474+0000', 'last_undegraded': '2023-12-20T04:51:45.166474+0000', 'last_fullsized': '2023-12-20T04:51:45.166474+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T05:33:47.636801+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:51:50.181 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1f is not active+clean 2023-12-20T04:51:50.181 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1e is not active+clean 2023-12-20T04:51:50.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.169853+0000', 'last_change': '2023-12-20T04:51:45.169853+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.169853+0000', 'last_undegraded': '2023-12-20T04:51:45.169853+0000', 'last_fullsized': '2023-12-20T04:51:45.169853+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T05:33:47.636801+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:51:50.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1c is not active+clean 2023-12-20T04:51:50.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1d is not active+clean 2023-12-20T04:51:50.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.165411+0000', 'last_change': '2023-12-20T04:51:45.165411+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.165411+0000', 'last_undegraded': '2023-12-20T04:51:45.165411+0000', 'last_fullsized': '2023-12-20T04:51:45.165411+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T07:54:35.761511+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 0], 'acting': [4, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:51:50.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1d is not active+clean 2023-12-20T04:51:50.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1c is not active+clean 2023-12-20T04:51:50.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.164972+0000', 'last_change': '2023-12-20T04:51:45.164972+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.164972+0000', 'last_undegraded': '2023-12-20T04:51:45.164972+0000', 'last_fullsized': '2023-12-20T04:51:45.164972+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:57:35.366758+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 1], 'acting': [4, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:51:50.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1a is not active+clean 2023-12-20T04:51:50.182 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.182 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1b is not active+clean 2023-12-20T04:51:50.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.168312+0000', 'last_change': '2023-12-20T04:51:45.168312+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.168312+0000', 'last_undegraded': '2023-12-20T04:51:45.168312+0000', 'last_fullsized': '2023-12-20T04:51:45.168312+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:13:09.277528+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:51:50.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1b is not active+clean 2023-12-20T04:51:50.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1a is not active+clean 2023-12-20T04:51:50.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.168487+0000', 'last_change': '2023-12-20T04:51:45.168487+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.168487+0000', 'last_undegraded': '2023-12-20T04:51:45.168487+0000', 'last_fullsized': '2023-12-20T04:51:45.168487+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T11:55:37.235060+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 7], 'acting': [5, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:51:50.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.18 is not active+clean 2023-12-20T04:51:50.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.18', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.19 is not active+clean 2023-12-20T04:51:50.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.19', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.168585+0000', 'last_change': '2023-12-20T04:51:45.168585+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.168585+0000', 'last_undegraded': '2023-12-20T04:51:45.168585+0000', 'last_fullsized': '2023-12-20T04:51:45.168585+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T12:47:41.345193+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 5], 'acting': [2, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:51:50.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.19 is not active+clean 2023-12-20T04:51:50.183 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.19', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.183 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.18 is not active+clean 2023-12-20T04:51:50.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.18', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.164942+0000', 'last_change': '2023-12-20T04:51:45.164942+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.164942+0000', 'last_undegraded': '2023-12-20T04:51:45.164942+0000', 'last_fullsized': '2023-12-20T04:51:45.164942+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T12:13:33.762273+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [4, 7], 'acting': [4, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 4, 'acting_primary': 4, 'purged_snaps': []} 2023-12-20T04:51:50.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.16 is not active+clean 2023-12-20T04:51:50.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.16', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.17 is not active+clean 2023-12-20T04:51:50.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.17', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.169378+0000', 'last_change': '2023-12-20T04:51:45.169378+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.169378+0000', 'last_undegraded': '2023-12-20T04:51:45.169378+0000', 'last_fullsized': '2023-12-20T04:51:45.169378+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:45:30.919915+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 1], 'acting': [3, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:51:50.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.17 is not active+clean 2023-12-20T04:51:50.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.17', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.16 is not active+clean 2023-12-20T04:51:50.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.16', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.166846+0000', 'last_change': '2023-12-20T04:51:45.166846+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.166846+0000', 'last_undegraded': '2023-12-20T04:51:45.166846+0000', 'last_fullsized': '2023-12-20T04:51:45.166846+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T14:33:09.820546+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 5], 'acting': [7, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:51:50.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.15 is not active+clean 2023-12-20T04:51:50.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.15', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.184 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.14 is not active+clean 2023-12-20T04:51:50.184 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.14', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.164654+0000', 'last_change': '2023-12-20T04:51:45.164654+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.164654+0000', 'last_undegraded': '2023-12-20T04:51:45.164654+0000', 'last_fullsized': '2023-12-20T04:51:45.164654+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T07:01:11.984641+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 2], 'acting': [0, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:51:50.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.12 is not active+clean 2023-12-20T04:51:50.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.12', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.13 is not active+clean 2023-12-20T04:51:50.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.13', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.166000+0000', 'last_change': '2023-12-20T04:51:45.166000+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.166000+0000', 'last_undegraded': '2023-12-20T04:51:45.166000+0000', 'last_fullsized': '2023-12-20T04:51:45.166000+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T12:54:41.620584+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:51:50.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.13 is not active+clean 2023-12-20T04:51:50.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.13', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.12 is not active+clean 2023-12-20T04:51:50.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.12', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.166559+0000', 'last_change': '2023-12-20T04:51:45.166559+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.166559+0000', 'last_undegraded': '2023-12-20T04:51:45.166559+0000', 'last_fullsized': '2023-12-20T04:51:45.166559+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T12:13:33.762273+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 5], 'acting': [6, 5], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:51:50.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.10 is not active+clean 2023-12-20T04:51:50.185 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.10', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.185 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.11 is not active+clean 2023-12-20T04:51:50.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.11', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.169059+0000', 'last_change': '2023-12-20T04:51:45.169059+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.169059+0000', 'last_undegraded': '2023-12-20T04:51:45.169059+0000', 'last_fullsized': '2023-12-20T04:51:45.169059+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T06:47:45.526934+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 0], 'acting': [1, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:51:50.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.11 is not active+clean 2023-12-20T04:51:50.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.11', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.10 is not active+clean 2023-12-20T04:51:50.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.10', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.168360+0000', 'last_change': '2023-12-20T04:51:45.168360+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.168360+0000', 'last_undegraded': '2023-12-20T04:51:45.168360+0000', 'last_fullsized': '2023-12-20T04:51:45.168360+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T07:19:07.052276+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 6], 'acting': [2, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:51:50.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.e is not active+clean 2023-12-20T04:51:50.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.e', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.f is not active+clean 2023-12-20T04:51:50.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.f', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.168490+0000', 'last_change': '2023-12-20T04:51:45.168490+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.168490+0000', 'last_undegraded': '2023-12-20T04:51:45.168490+0000', 'last_fullsized': '2023-12-20T04:51:45.168490+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T13:42:42.363620+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [5, 6], 'acting': [5, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 5, 'acting_primary': 5, 'purged_snaps': []} 2023-12-20T04:51:50.186 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.f is not active+clean 2023-12-20T04:51:50.186 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.f', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.e is not active+clean 2023-12-20T04:51:50.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.e', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.168877+0000', 'last_change': '2023-12-20T04:51:45.168877+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.168877+0000', 'last_undegraded': '2023-12-20T04:51:45.168877+0000', 'last_fullsized': '2023-12-20T04:51:45.168877+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T05:40:46.196430+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 6], 'acting': [3, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:51:50.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.c is not active+clean 2023-12-20T04:51:50.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.c', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.d is not active+clean 2023-12-20T04:51:50.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.d', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.168306+0000', 'last_change': '2023-12-20T04:51:45.168306+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.168306+0000', 'last_undegraded': '2023-12-20T04:51:45.168306+0000', 'last_fullsized': '2023-12-20T04:51:45.168306+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T05:12:07.950388+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [2, 7], 'acting': [2, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 2, 'acting_primary': 2, 'purged_snaps': []} 2023-12-20T04:51:50.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.d is not active+clean 2023-12-20T04:51:50.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.d', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.c is not active+clean 2023-12-20T04:51:50.187 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.c', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.168376+0000', 'last_change': '2023-12-20T04:51:45.168376+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.168376+0000', 'last_undegraded': '2023-12-20T04:51:45.168376+0000', 'last_fullsized': '2023-12-20T04:51:45.168376+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:35:01.422172+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 2], 'acting': [3, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:51:50.187 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.a is not active+clean 2023-12-20T04:51:50.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.a', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.b is not active+clean 2023-12-20T04:51:50.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.b', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.164661+0000', 'last_change': '2023-12-20T04:51:45.164661+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.164661+0000', 'last_undegraded': '2023-12-20T04:51:45.164661+0000', 'last_fullsized': '2023-12-20T04:51:45.164661+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T11:16:18.661350+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 6], 'acting': [0, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:51:50.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.b is not active+clean 2023-12-20T04:51:50.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.b', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.a is not active+clean 2023-12-20T04:51:50.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.a', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.165957+0000', 'last_change': '2023-12-20T04:51:45.165957+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.165957+0000', 'last_undegraded': '2023-12-20T04:51:45.165957+0000', 'last_fullsized': '2023-12-20T04:51:45.165957+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:16:33.403901+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 1], 'acting': [7, 1], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:51:50.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.8 is not active+clean 2023-12-20T04:51:50.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.8', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.9 is not active+clean 2023-12-20T04:51:50.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.9', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.166025+0000', 'last_change': '2023-12-20T04:51:45.166025+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.166025+0000', 'last_undegraded': '2023-12-20T04:51:45.166025+0000', 'last_fullsized': '2023-12-20T04:51:45.166025+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:45:30.919915+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 3], 'acting': [7, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:51:50.188 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.9 is not active+clean 2023-12-20T04:51:50.188 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.9', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.8 is not active+clean 2023-12-20T04:51:50.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.8', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.166165+0000', 'last_change': '2023-12-20T04:51:45.166165+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.166165+0000', 'last_undegraded': '2023-12-20T04:51:45.166165+0000', 'last_fullsized': '2023-12-20T04:51:45.166165+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:20:27.921265+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:51:50.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.6 is not active+clean 2023-12-20T04:51:50.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.6', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.7 is not active+clean 2023-12-20T04:51:50.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.7', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.166473+0000', 'last_change': '2023-12-20T04:51:45.166473+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.166473+0000', 'last_undegraded': '2023-12-20T04:51:45.166473+0000', 'last_fullsized': '2023-12-20T04:51:45.166473+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T06:11:39.764510+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:51:50.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.7 is not active+clean 2023-12-20T04:51:50.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.7', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.189 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.6 is not active+clean 2023-12-20T04:51:50.189 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.6', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.168677+0000', 'last_change': '2023-12-20T04:51:45.168677+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.168677+0000', 'last_undegraded': '2023-12-20T04:51:45.168677+0000', 'last_fullsized': '2023-12-20T04:51:45.168677+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T12:19:23.214753+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 7], 'acting': [1, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:51:50.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.4 is not active+clean 2023-12-20T04:51:50.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.4', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.5 is not active+clean 2023-12-20T04:51:50.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.5', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.168685+0000', 'last_change': '2023-12-20T04:51:45.168685+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.168685+0000', 'last_undegraded': '2023-12-20T04:51:45.168685+0000', 'last_fullsized': '2023-12-20T04:51:45.168685+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T15:25:47.122533+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:51:50.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.5 is not active+clean 2023-12-20T04:51:50.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.5', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.4 is not active+clean 2023-12-20T04:51:50.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.4', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.168329+0000', 'last_change': '2023-12-20T04:51:45.168329+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.168329+0000', 'last_undegraded': '2023-12-20T04:51:45.168329+0000', 'last_fullsized': '2023-12-20T04:51:45.168329+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T11:04:30.065153+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [1, 2], 'acting': [1, 2], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 1, 'acting_primary': 1, 'purged_snaps': []} 2023-12-20T04:51:50.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.2 is not active+clean 2023-12-20T04:51:50.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.2', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.190 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.3 is not active+clean 2023-12-20T04:51:50.190 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.3', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.164589+0000', 'last_change': '2023-12-20T04:51:45.164589+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.164589+0000', 'last_undegraded': '2023-12-20T04:51:45.164589+0000', 'last_fullsized': '2023-12-20T04:51:45.164589+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T07:39:57.468608+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [0, 4], 'acting': [0, 4], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 0, 'acting_primary': 0, 'purged_snaps': []} 2023-12-20T04:51:50.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.3 is not active+clean 2023-12-20T04:51:50.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.3', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.2 is not active+clean 2023-12-20T04:51:50.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.2', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.166023+0000', 'last_change': '2023-12-20T04:51:45.166023+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.166023+0000', 'last_undegraded': '2023-12-20T04:51:45.166023+0000', 'last_fullsized': '2023-12-20T04:51:45.166023+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T07:25:57.319453+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [7, 6], 'acting': [7, 6], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 7, 'acting_primary': 7, 'purged_snaps': []} 2023-12-20T04:51:50.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.0 is not active+clean 2023-12-20T04:51:50.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.0', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.1 is not active+clean 2023-12-20T04:51:50.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.1', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.166837+0000', 'last_change': '2023-12-20T04:51:45.166837+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.166837+0000', 'last_undegraded': '2023-12-20T04:51:45.166837+0000', 'last_fullsized': '2023-12-20T04:51:45.166837+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T10:57:35.366758+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 0], 'acting': [6, 0], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:51:50.191 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.1 is not active+clean 2023-12-20T04:51:50.191 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.1', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.0 is not active+clean 2023-12-20T04:51:50.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.0', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.168890+0000', 'last_change': '2023-12-20T04:51:45.168890+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.168890+0000', 'last_undegraded': '2023-12-20T04:51:45.168890+0000', 'last_fullsized': '2023-12-20T04:51:45.168890+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T09:16:33.403901+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [3, 7], 'acting': [3, 7], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 3, 'acting_primary': 3, 'purged_snaps': []} 2023-12-20T04:51:50.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 21.14 is not active+clean 2023-12-20T04:51:50.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '21.14', 'version': "0'0", 'reported_seq': 0, 'reported_epoch': 0, 'state': 'unknown', 'last_fresh': '2023-12-20T04:51:46.162726+0000', 'last_change': '2023-12-20T04:51:46.162726+0000', 'last_active': '2023-12-20T04:51:46.162726+0000', 'last_peered': '2023-12-20T04:51:46.162726+0000', 'last_clean': '2023-12-20T04:51:46.162726+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:46.162726+0000', 'last_undegraded': '2023-12-20T04:51:46.162726+0000', 'last_fullsized': '2023-12-20T04:51:46.162726+0000', 'mapping_epoch': 0, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 0, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:46.162726+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': '--', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [], 'acting': [], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': -1, 'acting_primary': -1, 'purged_snaps': []} 2023-12-20T04:51:50.192 INFO:tasks.cephfs.filesystem.ceph_manager:PG 20.15 is not active+clean 2023-12-20T04:51:50.192 INFO:tasks.cephfs.filesystem.ceph_manager:{'pgid': '20.15', 'version': "0'0", 'reported_seq': 1, 'reported_epoch': 166, 'state': 'creating+peering', 'last_fresh': '2023-12-20T04:51:45.167245+0000', 'last_change': '2023-12-20T04:51:45.167245+0000', 'last_active': '2023-12-20T04:51:45.156376+0000', 'last_peered': '2023-12-20T04:51:45.156376+0000', 'last_clean': '2023-12-20T04:51:45.156376+0000', 'last_became_active': '0.000000', 'last_became_peered': '0.000000', 'last_unstale': '2023-12-20T04:51:45.167245+0000', 'last_undegraded': '2023-12-20T04:51:45.167245+0000', 'last_fullsized': '2023-12-20T04:51:45.167245+0000', 'mapping_epoch': 166, 'log_start': "0'0", 'ondisk_log_start': "0'0", 'created': 166, 'last_epoch_clean': 0, 'parent': '0.0', 'parent_split_bits': 0, 'last_scrub': "0'0", 'last_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_deep_scrub': "0'0", 'last_deep_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'last_clean_scrub_stamp': '2023-12-20T04:51:45.156376+0000', 'objects_scrubbed': 0, 'log_size': 0, 'log_dups_size': 0, 'ondisk_log_size': 0, 'stats_invalid': False, 'dirty_stats_invalid': False, 'omap_stats_invalid': False, 'hitset_stats_invalid': False, 'hitset_bytes_stats_invalid': False, 'pin_stats_invalid': False, 'manifest_stats_invalid': False, 'snaptrimq_len': 0, 'last_scrub_duration': 0, 'scrub_schedule': 'periodic scrub scheduled @ 2023-12-21T07:54:35.761511+0000', 'scrub_duration': 0, 'objects_trimmed': 0, 'snaptrim_duration': 0, 'stat_sum': {'num_bytes': 0, 'num_objects': 0, 'num_object_clones': 0, 'num_object_copies': 0, 'num_objects_missing_on_primary': 0, 'num_objects_missing': 0, 'num_objects_degraded': 0, 'num_objects_misplaced': 0, 'num_objects_unfound': 0, 'num_objects_dirty': 0, 'num_whiteouts': 0, 'num_read': 0, 'num_read_kb': 0, 'num_write': 0, 'num_write_kb': 0, 'num_scrub_errors': 0, 'num_shallow_scrub_errors': 0, 'num_deep_scrub_errors': 0, 'num_objects_recovered': 0, 'num_bytes_recovered': 0, 'num_keys_recovered': 0, 'num_objects_omap': 0, 'num_objects_hit_set_archive': 0, 'num_bytes_hit_set_archive': 0, 'num_flush': 0, 'num_flush_kb': 0, 'num_evict': 0, 'num_evict_kb': 0, 'num_promote': 0, 'num_flush_mode_high': 0, 'num_flush_mode_low': 0, 'num_evict_mode_some': 0, 'num_evict_mode_full': 0, 'num_objects_pinned': 0, 'num_legacy_snapsets': 0, 'num_large_omap_objects': 0, 'num_objects_manifest': 0, 'num_omap_bytes': 0, 'num_omap_keys': 0, 'num_objects_repaired': 0}, 'up': [6, 3], 'acting': [6, 3], 'avail_no_missing': [], 'object_location_counts': [], 'blocked_by': [], 'up_primary': 6, 'acting_primary': 6, 'purged_snaps': []} 2023-12-20T04:51:50.192 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json 2023-12-20T04:51:50.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.307+0000 7f2b2a700640 1 Processor -- start 2023-12-20T04:51:50.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.307+0000 7f2b2a700640 1 -- start start 2023-12-20T04:51:50.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.307+0000 7f2b2a700640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b240b2e60 0x7f2b2406c1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:50.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.307+0000 7f2b2a700640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b240cb9f0 con 0x7f2b2406ad40 2023-12-20T04:51:50.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.307+0000 7f2b2a700640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f2b240d1a70 con 0x7f2b2415cdc0 2023-12-20T04:51:50.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.307+0000 7f2b2a700640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b240d1790 con 0x7f2b240b2e60 2023-12-20T04:51:50.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.308+0000 7f2b237fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f2b2406ad40 0x7f2b240b2750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47966/0 (socket says 172.21.15.132:47966) 2023-12-20T04:51:50.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.308+0000 7f2b237fe640 1 -- 172.21.15.132:0/3103701327 learned_addr learned my addr 172.21.15.132:0/3103701327 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:50.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.308+0000 7f2b28c9d640 1 --2- 172.21.15.132:0/3103701327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b240b2e60 0x7f2b2406c1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:50.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.308+0000 7f2b22ffd640 1 -- 172.21.15.132:0/3103701327 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4135569312 0 0) 0x7f2b240cb9f0 con 0x7f2b2406ad40 2023-12-20T04:51:50.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.308+0000 7f2b22ffd640 1 -- 172.21.15.132:0/3103701327 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b0c003520 con 0x7f2b2406ad40 2023-12-20T04:51:50.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.308+0000 7f2b22ffd640 1 -- 172.21.15.132:0/3103701327 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1476959214 0 0) 0x7f2b240d1a70 con 0x7f2b2415cdc0 2023-12-20T04:51:50.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.308+0000 7f2b22ffd640 1 -- 172.21.15.132:0/3103701327 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f2b240cb9f0 con 0x7f2b2415cdc0 2023-12-20T04:51:50.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.308+0000 7f2b28c9d640 1 -- 172.21.15.132:0/3103701327 >> v1:172.21.15.187:6789/0 conn(0x7f2b2415cdc0 legacy=0x7f2b240d0c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:50.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.308+0000 7f2b28c9d640 1 -- 172.21.15.132:0/3103701327 >> v1:172.21.15.132:6789/0 conn(0x7f2b2406ad40 legacy=0x7f2b240b2750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:50.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.308+0000 7f2b22ffd640 1 -- 172.21.15.132:0/3103701327 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3691742588 0 0) 0x7f2b0c003520 con 0x7f2b2406ad40 2023-12-20T04:51:50.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.308+0000 7f2b28c9d640 1 -- 172.21.15.132:0/3103701327 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b240cb3a0 con 0x7f2b240b2e60 2023-12-20T04:51:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.309+0000 7f2b28c9d640 1 --2- 172.21.15.132:0/3103701327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b240b2e60 0x7f2b2406c1a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009dc0 tx=0x7f2b1c02bde0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=a0b9dea092a92df3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.309+0000 7f2b22ffd640 1 -- 172.21.15.132:0/3103701327 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b14001670 con 0x7f2b240b2e60 2023-12-20T04:51:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.309+0000 7f2b22ffd640 1 -- 172.21.15.132:0/3103701327 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b1c02c910 con 0x7f2b240b2e60 2023-12-20T04:51:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.309+0000 7f2b22ffd640 1 -- 172.21.15.132:0/3103701327 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b1c02cc80 con 0x7f2b240b2e60 2023-12-20T04:51:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.310+0000 7f2b2a700640 1 -- 172.21.15.132:0/3103701327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b240b2e60 msgr2=0x7f2b2406c1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.310+0000 7f2b2a700640 1 --2- 172.21.15.132:0/3103701327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b240b2e60 0x7f2b2406c1a0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f2b1c009dc0 tx=0x7f2b1c02bde0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.310+0000 7f2b2a700640 1 -- 172.21.15.132:0/3103701327 shutdown_connections 2023-12-20T04:51:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.310+0000 7f2b2a700640 1 --2- 172.21.15.132:0/3103701327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b240b2e60 0x7f2b2406c1a0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.310+0000 7f2b2a700640 1 -- 172.21.15.132:0/3103701327 >> 172.21.15.132:0/3103701327 conn(0x7f2b24072c60 msgr2=0x7f2b24073070 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.310+0000 7f2b2a700640 1 -- 172.21.15.132:0/3103701327 shutdown_connections 2023-12-20T04:51:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.310+0000 7f2b2a700640 1 -- 172.21.15.132:0/3103701327 wait complete. 2023-12-20T04:51:50.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.311+0000 7f2b2a700640 1 Processor -- start 2023-12-20T04:51:50.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.311+0000 7f2b2a700640 1 -- start start 2023-12-20T04:51:50.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b2a700640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b2406ad40 0x7f2b241f5df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:50.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b2a700640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b240b2e60 0x7f2b241f2000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:50.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b2a700640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b2415cdc0 0x7f2b240aeab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:50.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b2a700640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b240c7d80 con 0x7f2b2406ad40 2023-12-20T04:51:50.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b2a700640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b241f6640 con 0x7f2b240b2e60 2023-12-20T04:51:50.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b2a700640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2b241f6920 con 0x7f2b2415cdc0 2023-12-20T04:51:50.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b23fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b2406ad40 0x7f2b241f5df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:50.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b23fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b2406ad40 0x7f2b241f5df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42622/0 (socket says 172.21.15.132:42622) 2023-12-20T04:51:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b23fff640 1 -- 172.21.15.132:0/3756299562 learned_addr learned my addr 172.21.15.132:0/3756299562 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b237fe640 1 --2- 172.21.15.132:0/3756299562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b240b2e60 0x7f2b241f2000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b28c9d640 1 --2- 172.21.15.132:0/3756299562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b2415cdc0 0x7f2b240aeab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b23fff640 1 -- 172.21.15.132:0/3756299562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b2415cdc0 msgr2=0x7f2b240aeab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b23fff640 1 --2- 172.21.15.132:0/3756299562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b2415cdc0 0x7f2b240aeab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b23fff640 1 -- 172.21.15.132:0/3756299562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b240b2e60 msgr2=0x7f2b241f2000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b23fff640 1 --2- 172.21.15.132:0/3756299562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b240b2e60 0x7f2b241f2000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b23fff640 1 -- 172.21.15.132:0/3756299562 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b1c009a70 con 0x7f2b2406ad40 2023-12-20T04:51:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b237fe640 1 --2- 172.21.15.132:0/3756299562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b240b2e60 0x7f2b241f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b23fff640 1 --2- 172.21.15.132:0/3756299562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b2406ad40 0x7f2b241f5df0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f2b1800c490 tx=0x7f2b1800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b20ff9640 1 -- 172.21.15.132:0/3756299562 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b180052d0 con 0x7f2b2406ad40 2023-12-20T04:51:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b20ff9640 1 -- 172.21.15.132:0/3756299562 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2b18005430 con 0x7f2b2406ad40 2023-12-20T04:51:50.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b2a700640 1 -- 172.21.15.132:0/3756299562 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b241f6c00 con 0x7f2b2406ad40 2023-12-20T04:51:50.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.312+0000 7f2b20ff9640 1 -- 172.21.15.132:0/3756299562 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2b18012870 con 0x7f2b2406ad40 2023-12-20T04:51:50.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.313+0000 7f2b2a700640 1 -- 172.21.15.132:0/3756299562 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b241f6330 con 0x7f2b2406ad40 2023-12-20T04:51:50.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.313+0000 7f2b2a700640 1 -- 172.21.15.132:0/3756299562 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b2404e840 con 0x7f2b2406ad40 2023-12-20T04:51:50.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.314+0000 7f2b20ff9640 1 -- 172.21.15.132:0/3756299562 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2b180129d0 con 0x7f2b2406ad40 2023-12-20T04:51:50.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.314+0000 7f2b20ff9640 1 --2- 172.21.15.132:0/3756299562 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b1006a430 0x7f2b1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:50.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.314+0000 7f2b20ff9640 1 -- 172.21.15.132:0/3756299562 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f2b180884f0 con 0x7f2b2406ad40 2023-12-20T04:51:50.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.314+0000 7f2b237fe640 1 --2- 172.21.15.132:0/3756299562 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b1006a430 0x7f2b1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:50.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.315+0000 7f2b237fe640 1 --2- 172.21.15.132:0/3756299562 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b1006a430 0x7f2b1006c8f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2b240cb190 tx=0x7f2b14009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:50.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.319+0000 7f2b20ff9640 1 -- 172.21.15.132:0/3756299562 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2b18053ae0 con 0x7f2b2406ad40 2023-12-20T04:51:50.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.547+0000 7f2b2a700640 1 -- 172.21.15.132:0/3756299562 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "status", "format": "json"} v 0) v1 -- 0x7f2b240cf130 con 0x7f2b2406ad40 2023-12-20T04:51:50.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.548+0000 7f2b20ff9640 1 -- 172.21.15.132:0/3756299562 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json"}]=0 v0) v1 ==== 72+0+1105 (secure 0 0 0) 0x7f2b18057100 con 0x7f2b2406ad40 2023-12-20T04:51:50.550 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:50.550 INFO:teuthology.orchestra.run.smithi132.stdout:{"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","health":{"status":"HEALTH_OK","checks":{},"mutes":[]},"election_epoch":4,"quorum":[0,1,2],"quorum_names":["a","b","c"],"quorum_age":560,"monmap":{"epoch":1,"min_mon_release_name":"reef","num_mons":3},"osdmap":{"epoch":169,"num_osds":8,"num_up_osds":8,"osd_up_since":1703047355,"num_in_osds":8,"osd_in_since":1703047352,"num_remapped_pgs":0},"pgmap":{"pgs_by_state":[{"state_name":"unknown","count":64},{"state_name":"creating+peering","count":32},{"state_name":"active+clean","count":1}],"num_pgs":97,"num_pools":3,"num_objects":2,"data_bytes":590368,"bytes_used":8578376,"bytes_avail":1591421624,"bytes_total":1600000000,"unknown_pgs_ratio":0.65979379415512085,"inactive_pgs_ratio":0.32989689707756042},"fsmap":{"epoch":63,"id":10,"up":1,"in":1,"max":1,"by_rank":[{"filesystem_id":10,"rank":0,"name":"a","status":"up:active","gid":8712}],"up:standby":3},"mgrmap":{"available":true,"num_standbys":1,"modules":["iostat","nfs","restful"],"services":{}},"servicemap":{"epoch":7,"modified":"2023-12-20T04:50:40.195777+0000","services":{}},"progress_events":{}} 2023-12-20T04:51:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.550+0000 7f2b2a700640 1 -- 172.21.15.132:0/3756299562 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b1006a430 msgr2=0x7f2b1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.550+0000 7f2b2a700640 1 --2- 172.21.15.132:0/3756299562 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b1006a430 0x7f2b1006c8f0 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7f2b240cb190 tx=0x7f2b14009040 comp rx=0 tx=0).stop 2023-12-20T04:51:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.550+0000 7f2b2a700640 1 -- 172.21.15.132:0/3756299562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b2406ad40 msgr2=0x7f2b241f5df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.550+0000 7f2b2a700640 1 --2- 172.21.15.132:0/3756299562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b2406ad40 0x7f2b241f5df0 secure :-1 s=READY pgs=1666 cs=0 l=1 rev1=1 crypto rx=0x7f2b1800c490 tx=0x7f2b1800c950 comp rx=0 tx=0).stop 2023-12-20T04:51:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.550+0000 7f2b2a700640 1 -- 172.21.15.132:0/3756299562 shutdown_connections 2023-12-20T04:51:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.550+0000 7f2b2a700640 1 --2- 172.21.15.132:0/3756299562 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2b1006a430 0x7f2b1006c8f0 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.550+0000 7f2b2a700640 1 --2- 172.21.15.132:0/3756299562 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2b2415cdc0 0x7f2b240aeab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.552 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.550+0000 7f2b2a700640 1 --2- 172.21.15.132:0/3756299562 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2b240b2e60 0x7f2b241f2000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.550+0000 7f2b2a700640 1 --2- 172.21.15.132:0/3756299562 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2b2406ad40 0x7f2b241f5df0 unknown :-1 s=CLOSED pgs=1666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.550+0000 7f2b2a700640 1 -- 172.21.15.132:0/3756299562 >> 172.21.15.132:0/3756299562 conn(0x7f2b24072c60 msgr2=0x7f2b2406b190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.550+0000 7f2b2a700640 1 -- 172.21.15.132:0/3756299562 shutdown_connections 2023-12-20T04:51:50.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.550+0000 7f2b2a700640 1 -- 172.21.15.132:0/3756299562 wait complete. 2023-12-20T04:51:50.563 INFO:tasks.cephfs.filesystem.ceph_manager:no progress seen, keeping timeout for now 2023-12-20T04:51:50.563 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:51:50.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.660+0000 7f26dd339640 1 Processor -- start 2023-12-20T04:51:50.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.660+0000 7f26dd339640 1 -- start start 2023-12-20T04:51:50.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.660+0000 7f26dd339640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f26d815d100 0x7f26d80b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:50.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.660+0000 7f26dd339640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26d80d0370 0x7f26d80cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:50.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.660+0000 7f26dd339640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f26d80b2f90 con 0x7f26d8161850 2023-12-20T04:51:50.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.660+0000 7f26dd339640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f26d81613c0 con 0x7f26d815d100 2023-12-20T04:51:50.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.660+0000 7f26dd339640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d80d1b00 con 0x7f26d80d0370 2023-12-20T04:51:50.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.661+0000 7f26d67fc640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26d80d0370 0x7f26d80cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:50.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.661+0000 7f26d6ffd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f26d815d100 0x7f26d80b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:50.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.661+0000 7f26d67fc640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26d80d0370 0x7f26d80cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:37930/0 (socket says 172.21.15.132:37930) 2023-12-20T04:51:50.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.661+0000 7f26d67fc640 1 -- 172.21.15.132:0/3249395710 learned_addr learned my addr 172.21.15.132:0/3249395710 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:50.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.661+0000 7f26d67fc640 1 -- 172.21.15.132:0/3249395710 >> v2:172.21.15.187:3300/0 conn(0x7f26d815d100 msgr2=0x7f26d80b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:50.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.661+0000 7f26d67fc640 1 --2- 172.21.15.132:0/3249395710 >> v2:172.21.15.187:3300/0 conn(0x7f26d815d100 0x7f26d80b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.661+0000 7f26d67fc640 1 -- 172.21.15.132:0/3249395710 >> v1:172.21.15.187:6789/0 conn(0x7f26d8161850 legacy=0x7f26d806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:50.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.661+0000 7f26d67fc640 1 -- 172.21.15.132:0/3249395710 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26d80d0810 con 0x7f26d80d0370 2023-12-20T04:51:50.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.662+0000 7f26d67fc640 1 --2- 172.21.15.132:0/3249395710 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26d80d0370 0x7f26d80cd500 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009870 tx=0x7f26c802b8f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=864174aa4da254b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:50.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.662+0000 7f26d5ffb640 1 -- 172.21.15.132:0/3249395710 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c8031640 con 0x7f26d80d0370 2023-12-20T04:51:50.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.662+0000 7f26d5ffb640 1 -- 172.21.15.132:0/3249395710 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26c80317a0 con 0x7f26d80d0370 2023-12-20T04:51:50.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.662+0000 7f26d5ffb640 1 -- 172.21.15.132:0/3249395710 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26c8031b30 con 0x7f26d80d0370 2023-12-20T04:51:50.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.663+0000 7f26dd339640 1 -- 172.21.15.132:0/3249395710 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26d80d0370 msgr2=0x7f26d80cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:50.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.663+0000 7f26dd339640 1 --2- 172.21.15.132:0/3249395710 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26d80d0370 0x7f26d80cd500 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f26c8009870 tx=0x7f26c802b8f0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.663+0000 7f26dd339640 1 -- 172.21.15.132:0/3249395710 shutdown_connections 2023-12-20T04:51:50.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.663+0000 7f26dd339640 1 --2- 172.21.15.132:0/3249395710 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26d80d0370 0x7f26d80cd500 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.663+0000 7f26dd339640 1 --2- 172.21.15.132:0/3249395710 >> v2:172.21.15.187:3300/0 conn(0x7f26d815d100 0x7f26d80b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.663+0000 7f26dd339640 1 -- 172.21.15.132:0/3249395710 >> 172.21.15.132:0/3249395710 conn(0x7f26d806d7c0 msgr2=0x7f26d806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:50.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.663+0000 7f26dd339640 1 -- 172.21.15.132:0/3249395710 shutdown_connections 2023-12-20T04:51:50.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.663+0000 7f26dd339640 1 -- 172.21.15.132:0/3249395710 wait complete. 2023-12-20T04:51:50.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.664+0000 7f26dd339640 1 Processor -- start 2023-12-20T04:51:50.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.664+0000 7f26dd339640 1 -- start start 2023-12-20T04:51:50.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26dd339640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26d80d0370 0x7f26d80b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:50.668 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26dd339640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26d815d100 0x7f26d8148900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26dd339640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26d8161850 0x7f26d8148e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26dd339640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d8149380 con 0x7f26d80d0370 2023-12-20T04:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26dd339640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f26d80b40b0 con 0x7f26d815d100 2023-12-20T04:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26dd339640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f26d80c99a0 con 0x7f26d8161850 2023-12-20T04:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26d6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26d80d0370 0x7f26d80b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26d6ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26d80d0370 0x7f26d80b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42636/0 (socket says 172.21.15.132:42636) 2023-12-20T04:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26d6ffd640 1 -- 172.21.15.132:0/272500182 learned_addr learned my addr 172.21.15.132:0/272500182 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26d67fc640 1 --2- 172.21.15.132:0/272500182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26d815d100 0x7f26d8148900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26d77fe640 1 --2- 172.21.15.132:0/272500182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26d8161850 0x7f26d8148e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26d6ffd640 1 -- 172.21.15.132:0/272500182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26d8161850 msgr2=0x7f26d8148e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26d6ffd640 1 --2- 172.21.15.132:0/272500182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26d8161850 0x7f26d8148e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26d6ffd640 1 -- 172.21.15.132:0/272500182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26d815d100 msgr2=0x7f26d8148900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26d6ffd640 1 --2- 172.21.15.132:0/272500182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26d815d100 0x7f26d8148900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26d6ffd640 1 -- 172.21.15.132:0/272500182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f26c80094d0 con 0x7f26d80d0370 2023-12-20T04:51:50.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26d6ffd640 1 --2- 172.21.15.132:0/272500182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26d80d0370 0x7f26d80b39f0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f26d000efc0 tx=0x7f26d000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26cf7fe640 1 -- 172.21.15.132:0/272500182 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0014480 con 0x7f26d80d0370 2023-12-20T04:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26cf7fe640 1 -- 172.21.15.132:0/272500182 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f26d000f040 con 0x7f26d80d0370 2023-12-20T04:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26dd339640 1 -- 172.21.15.132:0/272500182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26d80c9c80 con 0x7f26d80d0370 2023-12-20T04:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26cf7fe640 1 -- 172.21.15.132:0/272500182 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f26d0014800 con 0x7f26d80d0370 2023-12-20T04:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.665+0000 7f26dd339640 1 -- 172.21.15.132:0/272500182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26d80ca240 con 0x7f26d80d0370 2023-12-20T04:51:50.670 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.666+0000 7f26dd339640 1 -- 172.21.15.132:0/272500182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f26d804e840 con 0x7f26d80d0370 2023-12-20T04:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.667+0000 7f26cf7fe640 1 -- 172.21.15.132:0/272500182 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f26d0014960 con 0x7f26d80d0370 2023-12-20T04:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.667+0000 7f26cf7fe640 1 --2- 172.21.15.132:0/272500182 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f26b806a430 0x7f26b806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.667+0000 7f26cf7fe640 1 -- 172.21.15.132:0/272500182 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f26d0089720 con 0x7f26d80d0370 2023-12-20T04:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.667+0000 7f26d67fc640 1 --2- 172.21.15.132:0/272500182 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f26b806a430 0x7f26b806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:50.671 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.668+0000 7f26d67fc640 1 --2- 172.21.15.132:0/272500182 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f26b806a430 0x7f26b806c8f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f26c8036000 tx=0x7f26c803c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:50.673 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.672+0000 7f26cf7fe640 1 -- 172.21.15.132:0/272500182 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f26d0054d40 con 0x7f26d80d0370 2023-12-20T04:51:50.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.835+0000 7f26dd339640 1 -- 172.21.15.132:0/272500182 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f26d8161050 con 0x7f26b806a430 2023-12-20T04:51:50.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.842+0000 7f26cf7fe640 1 -- 172.21.15.132:0/272500182 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+276416 (secure 0 0 0) 0x7f26c8044400 con 0x7f26b806a430 2023-12-20T04:51:50.847 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:50.848 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:51:50.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.845+0000 7f26dd339640 1 -- 172.21.15.132:0/272500182 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f26b806a430 msgr2=0x7f26b806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:50.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.845+0000 7f26dd339640 1 --2- 172.21.15.132:0/272500182 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f26b806a430 0x7f26b806c8f0 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7f26c8036000 tx=0x7f26c803c040 comp rx=0 tx=0).stop 2023-12-20T04:51:50.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.845+0000 7f26dd339640 1 -- 172.21.15.132:0/272500182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26d80d0370 msgr2=0x7f26d80b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:50.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.845+0000 7f26dd339640 1 --2- 172.21.15.132:0/272500182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26d80d0370 0x7f26d80b39f0 secure :-1 s=READY pgs=1667 cs=0 l=1 rev1=1 crypto rx=0x7f26d000efc0 tx=0x7f26d000c490 comp rx=0 tx=0).stop 2023-12-20T04:51:50.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.845+0000 7f26dd339640 1 -- 172.21.15.132:0/272500182 shutdown_connections 2023-12-20T04:51:50.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.845+0000 7f26dd339640 1 --2- 172.21.15.132:0/272500182 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f26b806a430 0x7f26b806c8f0 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.845+0000 7f26dd339640 1 --2- 172.21.15.132:0/272500182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f26d8161850 0x7f26d8148e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.845+0000 7f26dd339640 1 --2- 172.21.15.132:0/272500182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f26d815d100 0x7f26d8148900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.845+0000 7f26dd339640 1 --2- 172.21.15.132:0/272500182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f26d80d0370 0x7f26d80b39f0 unknown :-1 s=CLOSED pgs=1667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:50.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.845+0000 7f26dd339640 1 -- 172.21.15.132:0/272500182 >> 172.21.15.132:0/272500182 conn(0x7f26d806d7c0 msgr2=0x7f26d80b1fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:50.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.845+0000 7f26dd339640 1 -- 172.21.15.132:0/272500182 shutdown_connections 2023-12-20T04:51:50.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:50.845+0000 7f26dd339640 1 -- 172.21.15.132:0/272500182 wait complete. 2023-12-20T04:51:50.858 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":438,"stamp":"2023-12-20T04:51:50.212365+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":66,"acting":66,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":20,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8377,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1554122,"statfs":{"total":1600000000,"available":1591421624,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.046938"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1f","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166474+0000","last_change":"2023-12-20T04:51:45.166474+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166474+0000","last_undegraded":"2023-12-20T04:51:45.166474+0000","last_fullsized":"2023-12-20T04:51:45.166474+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:47.636801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1e","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.169853+0000","last_change":"2023-12-20T04:51:45.169853+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.169853+0000","last_undegraded":"2023-12-20T04:51:45.169853+0000","last_fullsized":"2023-12-20T04:51:45.169853+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:47.636801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1d","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.165411+0000","last_change":"2023-12-20T04:51:45.165411+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.165411+0000","last_undegraded":"2023-12-20T04:51:45.165411+0000","last_fullsized":"2023-12-20T04:51:45.165411+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:54:35.761511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1c","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164972+0000","last_change":"2023-12-20T04:51:45.164972+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164972+0000","last_undegraded":"2023-12-20T04:51:45.164972+0000","last_fullsized":"2023-12-20T04:51:45.164972+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:57:35.366758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1b","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168312+0000","last_change":"2023-12-20T04:51:45.168312+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168312+0000","last_undegraded":"2023-12-20T04:51:45.168312+0000","last_fullsized":"2023-12-20T04:51:45.168312+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:13:09.277528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1a","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168487+0000","last_change":"2023-12-20T04:51:45.168487+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168487+0000","last_undegraded":"2023-12-20T04:51:45.168487+0000","last_fullsized":"2023-12-20T04:51:45.168487+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:55:37.235060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168585+0000","last_change":"2023-12-20T04:51:45.168585+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168585+0000","last_undegraded":"2023-12-20T04:51:45.168585+0000","last_fullsized":"2023-12-20T04:51:45.168585+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:47:41.345193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164942+0000","last_change":"2023-12-20T04:51:45.164942+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164942+0000","last_undegraded":"2023-12-20T04:51:45.164942+0000","last_fullsized":"2023-12-20T04:51:45.164942+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:13:33.762273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.169378+0000","last_change":"2023-12-20T04:51:45.169378+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.169378+0000","last_undegraded":"2023-12-20T04:51:45.169378+0000","last_fullsized":"2023-12-20T04:51:45.169378+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:45:30.919915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166846+0000","last_change":"2023-12-20T04:51:45.166846+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166846+0000","last_undegraded":"2023-12-20T04:51:45.166846+0000","last_fullsized":"2023-12-20T04:51:45.166846+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:33:09.820546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.14","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164654+0000","last_change":"2023-12-20T04:51:45.164654+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164654+0000","last_undegraded":"2023-12-20T04:51:45.164654+0000","last_fullsized":"2023-12-20T04:51:45.164654+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:01:11.984641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.13","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166000+0000","last_change":"2023-12-20T04:51:45.166000+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166000+0000","last_undegraded":"2023-12-20T04:51:45.166000+0000","last_fullsized":"2023-12-20T04:51:45.166000+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:54:41.620584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166559+0000","last_change":"2023-12-20T04:51:45.166559+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166559+0000","last_undegraded":"2023-12-20T04:51:45.166559+0000","last_fullsized":"2023-12-20T04:51:45.166559+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:13:33.762273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.169059+0000","last_change":"2023-12-20T04:51:45.169059+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.169059+0000","last_undegraded":"2023-12-20T04:51:45.169059+0000","last_fullsized":"2023-12-20T04:51:45.169059+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:47:45.526934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.10","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168360+0000","last_change":"2023-12-20T04:51:45.168360+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168360+0000","last_undegraded":"2023-12-20T04:51:45.168360+0000","last_fullsized":"2023-12-20T04:51:45.168360+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:19:07.052276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.f","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168490+0000","last_change":"2023-12-20T04:51:45.168490+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168490+0000","last_undegraded":"2023-12-20T04:51:45.168490+0000","last_fullsized":"2023-12-20T04:51:45.168490+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:42:42.363620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.e","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168877+0000","last_change":"2023-12-20T04:51:45.168877+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168877+0000","last_undegraded":"2023-12-20T04:51:45.168877+0000","last_fullsized":"2023-12-20T04:51:45.168877+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:40:46.196430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.d","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168306+0000","last_change":"2023-12-20T04:51:45.168306+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168306+0000","last_undegraded":"2023-12-20T04:51:45.168306+0000","last_fullsized":"2023-12-20T04:51:45.168306+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:07.950388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168376+0000","last_change":"2023-12-20T04:51:45.168376+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168376+0000","last_undegraded":"2023-12-20T04:51:45.168376+0000","last_fullsized":"2023-12-20T04:51:45.168376+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:35:01.422172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.b","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164661+0000","last_change":"2023-12-20T04:51:45.164661+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164661+0000","last_undegraded":"2023-12-20T04:51:45.164661+0000","last_fullsized":"2023-12-20T04:51:45.164661+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:16:18.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.165957+0000","last_change":"2023-12-20T04:51:45.165957+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.165957+0000","last_undegraded":"2023-12-20T04:51:45.165957+0000","last_fullsized":"2023-12-20T04:51:45.165957+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:16:33.403901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166025+0000","last_change":"2023-12-20T04:51:45.166025+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166025+0000","last_undegraded":"2023-12-20T04:51:45.166025+0000","last_fullsized":"2023-12-20T04:51:45.166025+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:45:30.919915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166165+0000","last_change":"2023-12-20T04:51:45.166165+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166165+0000","last_undegraded":"2023-12-20T04:51:45.166165+0000","last_fullsized":"2023-12-20T04:51:45.166165+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:20:27.921265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.7","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166473+0000","last_change":"2023-12-20T04:51:45.166473+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166473+0000","last_undegraded":"2023-12-20T04:51:45.166473+0000","last_fullsized":"2023-12-20T04:51:45.166473+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:11:39.764510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168677+0000","last_change":"2023-12-20T04:51:45.168677+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168677+0000","last_undegraded":"2023-12-20T04:51:45.168677+0000","last_fullsized":"2023-12-20T04:51:45.168677+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:19:23.214753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168685+0000","last_change":"2023-12-20T04:51:45.168685+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168685+0000","last_undegraded":"2023-12-20T04:51:45.168685+0000","last_fullsized":"2023-12-20T04:51:45.168685+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:47.122533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168329+0000","last_change":"2023-12-20T04:51:45.168329+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168329+0000","last_undegraded":"2023-12-20T04:51:45.168329+0000","last_fullsized":"2023-12-20T04:51:45.168329+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:04:30.065153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.164589+0000","last_change":"2023-12-20T04:51:45.164589+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.164589+0000","last_undegraded":"2023-12-20T04:51:45.164589+0000","last_fullsized":"2023-12-20T04:51:45.164589+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:39:57.468608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166023+0000","last_change":"2023-12-20T04:51:45.166023+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166023+0000","last_undegraded":"2023-12-20T04:51:45.166023+0000","last_fullsized":"2023-12-20T04:51:45.166023+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:57.319453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.166837+0000","last_change":"2023-12-20T04:51:45.166837+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.166837+0000","last_undegraded":"2023-12-20T04:51:45.166837+0000","last_fullsized":"2023-12-20T04:51:45.166837+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:57:35.366758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.168890+0000","last_change":"2023-12-20T04:51:45.168890+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.168890+0000","last_undegraded":"2023-12-20T04:51:45.168890+0000","last_fullsized":"2023-12-20T04:51:45.168890+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:16:33.403901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":0,"reported_epoch":0,"state":"unknown","last_fresh":"2023-12-20T04:51:46.162726+0000","last_change":"2023-12-20T04:51:46.162726+0000","last_active":"2023-12-20T04:51:46.162726+0000","last_peered":"2023-12-20T04:51:46.162726+0000","last_clean":"2023-12-20T04:51:46.162726+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:46.162726+0000","last_undegraded":"2023-12-20T04:51:46.162726+0000","last_fullsized":"2023-12-20T04:51:46.162726+0000","mapping_epoch":0,"log_start":"0'0","ondisk_log_start":"0'0","created":0,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"--","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[],"acting":[],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":-1,"acting_primary":-1,"purged_snaps":[]},{"pgid":"20.15","version":"0'0","reported_seq":1,"reported_epoch":166,"state":"creating+peering","last_fresh":"2023-12-20T04:51:45.167245+0000","last_change":"2023-12-20T04:51:45.167245+0000","last_active":"2023-12-20T04:51:45.156376+0000","last_peered":"2023-12-20T04:51:45.156376+0000","last_clean":"2023-12-20T04:51:45.156376+0000","last_became_active":"0.000000","last_became_peered":"0.000000","last_unstale":"2023-12-20T04:51:45.167245+0000","last_undegraded":"2023-12-20T04:51:45.167245+0000","last_fullsized":"2023-12-20T04:51:45.167245+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":0,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:54:35.761511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":291,"reported_epoch":165,"state":"active+clean","last_fresh":"2023-12-20T04:51:44.842001+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:51:44.842001+0000","last_peered":"2023-12-20T04:51:44.842001+0000","last_clean":"2023-12-20T04:51:44.842001+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:51:44.842001+0000","last_undegraded":"2023-12-20T04:51:44.842001+0000","last_fullsized":"2023-12-20T04:51:44.842001+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574960,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1479,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193832,"statfs":{"total":200000000,"available":198484927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.40600000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74399999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53800000000000003,"15min":0.52600000000000002},"min":{"1min":0.42999999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70999999999999996,"5min":0.79200000000000004,"15min":0.86299999999999999},"last":0.53800000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.47799999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.98799999999999999},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.374,"15min":0.374},"max":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":1.0269999999999999},"last":0.58499999999999996}]},{"osd":2,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.70599999999999996,"5min":0.97699999999999998,"15min":1.0069999999999999},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.41099999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.78000000000000003},"last":0.50800000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.438,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72799999999999998,"5min":1.048,"15min":1.048},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.46700000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74199999999999999,"5min":0.753,"15min":0.76900000000000002},"last":0.56299999999999994}]},{"osd":4,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.28499999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":0.71299999999999997,"15min":0.753},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.29599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.77400000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.40899999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.48699999999999999},"min":{"1min":0.35099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73799999999999999},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.496}]},{"osd":6,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.44400000000000001,"5min":0.33300000000000002,"15min":0.32500000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.89800000000000002},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.33200000000000002,"15min":0.28899999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.54800000000000004}]}]},{"osd":6,"up_from":13,"seq":55834574961,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55600000000000005,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68400000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.50600000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.30099999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.47099999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.60299999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.29999999999999999,"15min":0.27000000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.36499999999999999,"5min":0.34599999999999997,"15min":0.32600000000000001},"max":{"1min":0.67600000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.52600000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54900000000000004,"15min":0.51400000000000001},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73199999999999998,"5min":0.752,"15min":0.77800000000000002},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.45300000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71899999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57499999999999996}]},{"osd":4,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.46999999999999997,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66900000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.70499999999999996},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.34899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59299999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48799999999999999,"15min":0.50900000000000001},"min":{"1min":0.34899999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.68899999999999995},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52500000000000002,"15min":0.54900000000000004},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.63100000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52600000000000002,"15min":0.54300000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.76500000000000001},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.61799999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54900000000000004,"15min":0.52200000000000002},"min":{"1min":0.44,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.70299999999999996,"5min":0.748,"15min":0.748},"last":0.35699999999999998},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.56499999999999995},"min":{"1min":0.503,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70199999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.53400000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.433,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71199999999999997,"5min":0.80600000000000005,"15min":0.82099999999999995},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72199999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.59499999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.40600000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67800000000000005,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.41099999999999998},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.52400000000000002},"min":{"1min":0.46200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72499999999999998,"5min":0.76600000000000001,"15min":0.77100000000000002},"last":0.48599999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.441,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.80900000000000005},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.39800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.73599999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.55700000000000005}]},{"osd":4,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45200000000000001,"15min":0.48899999999999999},"min":{"1min":0.31900000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.81899999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.433,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.32400000000000001,"5min":0.29799999999999999,"15min":0.29399999999999998},"max":{"1min":0.749,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.50900000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47299999999999998,"15min":0.497},"min":{"1min":0.311,"5min":0.254,"15min":0.254},"max":{"1min":0.70699999999999996,"5min":0.73299999999999998,"15min":0.85299999999999998},"last":0.629},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.31},"max":{"1min":0.77000000000000002,"5min":0.78600000000000003,"15min":0.83999999999999997},"last":0.61599999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.498,"15min":0.51800000000000002},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.78400000000000003,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56399999999999995,"15min":0.59499999999999997},"min":{"1min":0.35999999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.76100000000000001,"5min":0.77600000000000002,"15min":0.98599999999999999},"last":0.65200000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.19700000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.32400000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.41799999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.36599999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.442},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.35999999999999999,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.42899999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.316,"5min":0.313,"15min":0.313},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.499},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.23400000000000001},"max":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.51000000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.35799999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.91000000000000003},"last":0.45400000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44800000000000001,"15min":0.46500000000000002},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48999999999999999,"15min":0.5},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.38700000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.36899999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69999999999999996,"5min":0.73099999999999998,"15min":0.82399999999999995},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.5,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78200000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.57099999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.51800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76900000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.48799999999999999},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.52300000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574960,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.34999999999999998,"15min":0.34000000000000002},"min":{"1min":0.24099999999999999,"5min":0.19800000000000001,"15min":0.193},"max":{"1min":0.49199999999999999,"5min":0.629,"15min":0.629},"last":0.307},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.38,"15min":0.35999999999999999},"min":{"1min":0.33000000000000002,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.56799999999999995,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.32500000000000001}]},{"osd":1,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.33900000000000002,"15min":0.32400000000000001},"min":{"1min":0.28999999999999998,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.56799999999999995},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.34300000000000003},"min":{"1min":0.28599999999999998,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55800000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.245}]},{"osd":2,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34899999999999998,"15min":0.34599999999999997},"min":{"1min":0.28999999999999998,"5min":0.22600000000000001,"15min":0.21199999999999999},"max":{"1min":0.49399999999999999,"5min":0.53100000000000003,"15min":0.64900000000000002},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39200000000000002,"15min":0.379},"min":{"1min":0.313,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55800000000000005,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.33700000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57199999999999995,"15min":0.55000000000000004},"min":{"1min":0.46300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80200000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58599999999999997,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.81699999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.45900000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58899999999999997,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.31},"max":{"1min":0.77400000000000002,"5min":0.872,"15min":0.872},"last":0.48199999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.59099999999999997,"15min":0.56699999999999995},"min":{"1min":0.48999999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77900000000000003,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.42799999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.45300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78100000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.50900000000000001},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59499999999999997,"15min":0.56799999999999995},"min":{"1min":0.51000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.73599999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.44800000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.442,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78600000000000003,"5min":0.879,"15min":0.879},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.61699999999999999,"15min":0.58699999999999997},"min":{"1min":0.50800000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78000000000000003,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.41099999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574960,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.34499999999999997,"15min":0.311},"min":{"1min":0.23599999999999999,"5min":0.20899999999999999,"15min":0.18099999999999999},"max":{"1min":0.54800000000000004,"5min":0.61499999999999999,"15min":0.72699999999999998},"last":0.311},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.376,"15min":0.35599999999999998},"min":{"1min":0.33700000000000002,"5min":0.25800000000000001,"15min":0.17699999999999999},"max":{"1min":0.53500000000000003,"5min":0.53700000000000003,"15min":2.0539999999999998},"last":0.40100000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.34100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.17999999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.83099999999999996},"last":0.33100000000000002},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.35999999999999999},"min":{"1min":0.30199999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58999999999999997},"last":0.25800000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.40400000000000003,"15min":0.372},"min":{"1min":0.36599999999999999,"5min":0.247,"15min":0.216},"max":{"1min":0.59199999999999997,"5min":0.68100000000000005,"15min":0.995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.40200000000000002,"15min":0.379},"min":{"1min":0.26100000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.57199999999999995,"5min":0.64400000000000002,"15min":0.76600000000000001},"last":0.34499999999999997}]},{"osd":4,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80700000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82499999999999996,"5min":0.94699999999999995,"15min":2.347},"last":0.73099999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.35399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83299999999999996,"5min":0.997,"15min":0.997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.55900000000000005},"min":{"1min":0.42499999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.75700000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.443,"5min":0.371,"15min":0.371},"max":{"1min":0.877,"5min":0.877,"15min":2.274},"last":0.76900000000000002},{"interface":"front","average":{"1min":0.622,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.373},"max":{"1min":0.81000000000000005,"5min":0.91100000000000003,"15min":1.0289999999999999},"last":0.69099999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82499999999999996,"5min":0.82999999999999996,"15min":2.3090000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59199999999999997,"15min":0.58299999999999996},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.80800000000000005,"5min":0.86699999999999999,"15min":1.0549999999999999},"last":0.74399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574961,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":903,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194409,"statfs":{"total":200000000,"available":199075295,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.33300000000000002,"15min":0.30199999999999999},"min":{"1min":0.251,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.44700000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"last":0.254},{"interface":"front","average":{"1min":0.41499999999999998,"5min":0.36799999999999999,"15min":0.34100000000000003},"min":{"1min":0.32300000000000001,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.55800000000000005,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.30399999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.39500000000000002,"5min":0.34999999999999998,"15min":0.31900000000000001},"min":{"1min":0.308,"5min":0.19500000000000001,"15min":0.19500000000000001},"max":{"1min":0.48299999999999998,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.23499999999999999},{"interface":"front","average":{"1min":0.42199999999999999,"5min":0.38800000000000001,"15min":0.35999999999999999},"min":{"1min":0.24399999999999999,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":0.56200000000000006,"5min":0.57299999999999995,"15min":0.57299999999999995},"last":0.27600000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.46000000000000002,"5min":0.40899999999999997,"15min":0.371},"min":{"1min":0.36399999999999999,"5min":0.21299999999999999,"15min":0.191},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.221},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.36699999999999999,"15min":0.35699999999999998},"min":{"1min":0.32400000000000001,"5min":0.22500000000000001,"15min":0.20399999999999999},"max":{"1min":0.56399999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.34200000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.57099999999999995,"15min":0.56799999999999995},"min":{"1min":0.35599999999999998,"5min":0.312,"15min":0.312},"max":{"1min":0.81399999999999995,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.69699999999999995},{"interface":"front","average":{"1min":0.60199999999999998,"5min":0.57899999999999996,"15min":0.55800000000000005},"min":{"1min":0.40600000000000003,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.80000000000000004,"5min":0.82899999999999996,"15min":1.002},"last":0.49299999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.57999999999999996,"15min":0.56299999999999994},"min":{"1min":0.42699999999999999,"5min":0.318,"15min":0.318},"max":{"1min":0.76100000000000001,"5min":0.85799999999999998,"15min":0.86099999999999999},"last":0.68799999999999994},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.59099999999999997,"15min":0.55600000000000005},"min":{"1min":0.436,"5min":0.317,"15min":0.317},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.85599999999999998},"last":0.55000000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59299999999999997,"5min":0.57599999999999996,"15min":0.56399999999999995},"min":{"1min":0.41599999999999998,"5min":0.38300000000000001,"15min":0.36899999999999999},"max":{"1min":0.70999999999999996,"5min":0.92400000000000004,"15min":1.038},"last":0.503},{"interface":"front","average":{"1min":0.626,"5min":0.58299999999999996,"15min":0.56899999999999995},"min":{"1min":0.44400000000000001,"5min":0.40100000000000002,"15min":0.39100000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.84199999999999997},"last":0.66200000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.66000000000000003,"5min":0.61499999999999999,"15min":0.59999999999999998},"min":{"1min":0.52300000000000002,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.80500000000000005,"5min":0.84399999999999997,"15min":0.88900000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.65800000000000003,"5min":0.61499999999999999,"15min":0.61099999999999999},"min":{"1min":0.53100000000000003,"5min":0.376,"15min":0.376},"max":{"1min":0.81000000000000005,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.64900000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574960,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1479,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193832,"statfs":{"total":200000000,"available":198484927,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.33500000000000002,"15min":0.317},"min":{"1min":0.221,"5min":0.189,"15min":0.184},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.32300000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.35199999999999998,"15min":0.32400000000000001},"min":{"1min":0.248,"5min":0.20699999999999999,"15min":0.184},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.33400000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.39400000000000002,"5min":0.36899999999999999,"15min":0.35899999999999999},"min":{"1min":0.27000000000000002,"5min":0.23699999999999999,"15min":0.218},"max":{"1min":0.52100000000000002,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.376,"15min":0.35599999999999998},"min":{"1min":0.315,"5min":0.23400000000000001,"15min":0.23100000000000001},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.622},"last":0.29799999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.36199999999999999,"15min":0.33500000000000002},"min":{"1min":0.246,"5min":0.224,"15min":0.224},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34999999999999998},{"interface":"front","average":{"1min":0.436,"5min":0.39500000000000002,"15min":0.376},"min":{"1min":0.32400000000000001,"5min":0.27600000000000002,"15min":0.27400000000000002},"max":{"1min":0.54700000000000004,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.39500000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.624,"5min":0.57099999999999995,"15min":0.53400000000000003},"min":{"1min":0.34599999999999997,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.80700000000000005,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61299999999999999},{"interface":"front","average":{"1min":0.63600000000000001,"5min":0.57399999999999995,"15min":0.54600000000000004},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"last":0.47399999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.628,"5min":0.56699999999999995,"15min":0.53300000000000003},"min":{"1min":0.36799999999999999,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.68300000000000005,"5min":0.59699999999999998,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83299999999999996,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.51000000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.60899999999999999,"15min":0.58999999999999997},"min":{"1min":0.41099999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.80700000000000005,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.53400000000000003},{"interface":"front","average":{"1min":0.68200000000000005,"5min":0.60899999999999999,"15min":0.59099999999999997},"min":{"1min":0.36899999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89500000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.67100000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:50:47 2023","interfaces":[{"interface":"back","average":{"1min":0.67300000000000004,"5min":0.58999999999999997,"15min":0.56200000000000006},"min":{"1min":0.433,"5min":0.379,"15min":0.375},"max":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.67900000000000005,"5min":0.60099999999999998,"15min":0.58099999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.86699999999999999,"5min":0.86699999999999999,"15min":0.86699999999999999},"last":0.71499999999999997}]}]}],"pool_statfs":[]}} 2023-12-20T04:51:52.458 INFO:tasks.ceph.mds.a.smithi132.stderr:2023-12-20T04:51:52.456+0000 7f134cc6b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:51:53.864 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:51:53.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.973+0000 7fdd5d59f640 1 Processor -- start 2023-12-20T04:51:53.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.973+0000 7fdd5d59f640 1 -- start start 2023-12-20T04:51:53.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd5d59f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd5815d110 0x7fdd58069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:53.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd5d59f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5815d4f0 0x7fdd5806a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:53.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd5d59f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fdd580aeb00 0x7fdd580aef90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:53.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd5d59f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd580af4d0 con 0x7fdd5815d110 2023-12-20T04:51:53.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd5d59f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdd58161ce0 con 0x7fdd580aeb00 2023-12-20T04:51:53.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd5d59f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd580aca50 con 0x7fdd5815d4f0 2023-12-20T04:51:53.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd56ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd5815d110 0x7fdd58069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:53.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd56ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdd5815d110 0x7fdd58069de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42642/0 (socket says 172.21.15.132:42642) 2023-12-20T04:51:53.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd56ffd640 1 -- 172.21.15.132:0/1647766890 learned_addr learned my addr 172.21.15.132:0/1647766890 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:53.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd567fc640 1 --2- 172.21.15.132:0/1647766890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5815d4f0 0x7fdd5806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:53.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd577fe640 1 --2- 172.21.15.132:0/1647766890 >> v2:172.21.15.187:3300/0 conn(0x7fdd580aeb00 0x7fdd580aef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:53.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd56ffd640 1 -- 172.21.15.132:0/1647766890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5815d4f0 msgr2=0x7fdd5806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:53.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd56ffd640 1 --2- 172.21.15.132:0/1647766890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5815d4f0 0x7fdd5806a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:53.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd56ffd640 1 -- 172.21.15.132:0/1647766890 >> v2:172.21.15.187:3300/0 conn(0x7fdd580aeb00 msgr2=0x7fdd580aef90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:53.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd56ffd640 1 --2- 172.21.15.132:0/1647766890 >> v2:172.21.15.187:3300/0 conn(0x7fdd580aeb00 0x7fdd580aef90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:53.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd56ffd640 1 -- 172.21.15.132:0/1647766890 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd58160df0 con 0x7fdd5815d110 2023-12-20T04:51:53.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd567fc640 1 --2- 172.21.15.132:0/1647766890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5815d4f0 0x7fdd5806a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:53.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.974+0000 7fdd577fe640 1 --2- 172.21.15.132:0/1647766890 >> v2:172.21.15.187:3300/0 conn(0x7fdd580aeb00 0x7fdd580aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:51:53.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.975+0000 7fdd56ffd640 1 --2- 172.21.15.132:0/1647766890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5815d110 0x7fdd58069de0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fdd580c64e0 tx=0x7fdd4802bf20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd0a1aa350913374 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:53.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.975+0000 7fdd55ffb640 1 -- 172.21.15.132:0/1647766890 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4802cac0 con 0x7fdd5815d110 2023-12-20T04:51:53.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.975+0000 7fdd55ffb640 1 -- 172.21.15.132:0/1647766890 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4802cc20 con 0x7fdd5815d110 2023-12-20T04:51:53.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.975+0000 7fdd55ffb640 1 -- 172.21.15.132:0/1647766890 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd480343f0 con 0x7fdd5815d110 2023-12-20T04:51:53.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.976+0000 7fdd5d59f640 1 -- 172.21.15.132:0/1647766890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5815d110 msgr2=0x7fdd58069de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:53.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.976+0000 7fdd5d59f640 1 --2- 172.21.15.132:0/1647766890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5815d110 0x7fdd58069de0 secure :-1 s=READY pgs=1668 cs=0 l=1 rev1=1 crypto rx=0x7fdd580c64e0 tx=0x7fdd4802bf20 comp rx=0 tx=0).stop 2023-12-20T04:51:53.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.976+0000 7fdd5d59f640 1 -- 172.21.15.132:0/1647766890 shutdown_connections 2023-12-20T04:51:53.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.976+0000 7fdd5d59f640 1 --2- 172.21.15.132:0/1647766890 >> v2:172.21.15.187:3300/0 conn(0x7fdd580aeb00 0x7fdd580aef90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:53.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.976+0000 7fdd5d59f640 1 --2- 172.21.15.132:0/1647766890 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5815d4f0 0x7fdd5806a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:53.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.976+0000 7fdd5d59f640 1 --2- 172.21.15.132:0/1647766890 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd5815d110 0x7fdd58069de0 unknown :-1 s=CLOSED pgs=1668 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:53.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.976+0000 7fdd5d59f640 1 -- 172.21.15.132:0/1647766890 >> 172.21.15.132:0/1647766890 conn(0x7fdd580cfbd0 msgr2=0x7fdd580cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:53.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.976+0000 7fdd5d59f640 1 -- 172.21.15.132:0/1647766890 shutdown_connections 2023-12-20T04:51:53.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.976+0000 7fdd5d59f640 1 -- 172.21.15.132:0/1647766890 wait complete. 2023-12-20T04:51:53.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.977+0000 7fdd5d59f640 1 Processor -- start 2023-12-20T04:51:53.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.977+0000 7fdd5d59f640 1 -- start start 2023-12-20T04:51:53.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.978+0000 7fdd5d59f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd580aeb00 0x7fdd5806dda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:53.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.978+0000 7fdd5d59f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5815d110 0x7fdd580c76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:53.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.978+0000 7fdd5d59f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd5815d4f0 0x7fdd581f23b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:53.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.978+0000 7fdd5d59f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd580c7bf0 con 0x7fdd580aeb00 2023-12-20T04:51:53.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.978+0000 7fdd5d59f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdd580c7e50 con 0x7fdd5815d4f0 2023-12-20T04:51:53.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.978+0000 7fdd5d59f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdd580c8130 con 0x7fdd5815d110 2023-12-20T04:51:53.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.978+0000 7fdd56ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd580aeb00 0x7fdd5806dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:53.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.978+0000 7fdd56ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd580aeb00 0x7fdd5806dda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42650/0 (socket says 172.21.15.132:42650) 2023-12-20T04:51:53.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.978+0000 7fdd56ffd640 1 -- 172.21.15.132:0/3288915499 learned_addr learned my addr 172.21.15.132:0/3288915499 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:53.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.978+0000 7fdd56ffd640 1 -- 172.21.15.132:0/3288915499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5815d110 msgr2=0x7fdd580c76b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:53.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.978+0000 7fdd56ffd640 1 --2- 172.21.15.132:0/3288915499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5815d110 0x7fdd580c76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:53.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.978+0000 7fdd56ffd640 1 -- 172.21.15.132:0/3288915499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd5815d4f0 msgr2=0x7fdd581f23b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:53.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.978+0000 7fdd56ffd640 1 --2- 172.21.15.132:0/3288915499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd5815d4f0 0x7fdd581f23b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:53.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.978+0000 7fdd56ffd640 1 -- 172.21.15.132:0/3288915499 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdd48009b30 con 0x7fdd580aeb00 2023-12-20T04:51:53.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.979+0000 7fdd56ffd640 1 --2- 172.21.15.132:0/3288915499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd580aeb00 0x7fdd5806dda0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fdd480093e0 tx=0x7fdd48004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:53.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.979+0000 7fdd3f7fe640 1 -- 172.21.15.132:0/3288915499 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4803e450 con 0x7fdd580aeb00 2023-12-20T04:51:53.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.979+0000 7fdd3f7fe640 1 -- 172.21.15.132:0/3288915499 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdd4803e5b0 con 0x7fdd580aeb00 2023-12-20T04:51:53.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.979+0000 7fdd5d59f640 1 -- 172.21.15.132:0/3288915499 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdd580c8410 con 0x7fdd580aeb00 2023-12-20T04:51:53.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.979+0000 7fdd3f7fe640 1 -- 172.21.15.132:0/3288915499 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdd4803e960 con 0x7fdd580aeb00 2023-12-20T04:51:53.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.979+0000 7fdd5d59f640 1 -- 172.21.15.132:0/3288915499 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdd580c89d0 con 0x7fdd580aeb00 2023-12-20T04:51:53.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.980+0000 7fdd5d59f640 1 -- 172.21.15.132:0/3288915499 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdd5804e840 con 0x7fdd580aeb00 2023-12-20T04:51:53.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.980+0000 7fdd3f7fe640 1 -- 172.21.15.132:0/3288915499 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdd4803eac0 con 0x7fdd580aeb00 2023-12-20T04:51:53.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.981+0000 7fdd3f7fe640 1 --2- 172.21.15.132:0/3288915499 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd4406a430 0x7fdd4406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:53.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.981+0000 7fdd3f7fe640 1 -- 172.21.15.132:0/3288915499 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fdd480ab8b0 con 0x7fdd580aeb00 2023-12-20T04:51:53.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.981+0000 7fdd567fc640 1 --2- 172.21.15.132:0/3288915499 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd4406a430 0x7fdd4406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:53.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.981+0000 7fdd567fc640 1 --2- 172.21.15.132:0/3288915499 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd4406a430 0x7fdd4406c8f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c006fd0 tx=0x7fdd4c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:53.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:53.985+0000 7fdd3f7fe640 1 -- 172.21.15.132:0/3288915499 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdd48076ea0 con 0x7fdd580aeb00 2023-12-20T04:51:54.149 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.147+0000 7fdd5d59f640 1 -- 172.21.15.132:0/3288915499 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fdd5815dd90 con 0x7fdd4406a430 2023-12-20T04:51:54.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.155+0000 7fdd3f7fe640 1 -- 172.21.15.132:0/3288915499 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285599 (secure 0 0 0) 0x7fdd5815dd90 con 0x7fdd4406a430 2023-12-20T04:51:54.159 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:54.161 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:51:54.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.158+0000 7fdd5d59f640 1 -- 172.21.15.132:0/3288915499 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd4406a430 msgr2=0x7fdd4406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:54.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.158+0000 7fdd5d59f640 1 --2- 172.21.15.132:0/3288915499 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd4406a430 0x7fdd4406c8f0 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fdd4c006fd0 tx=0x7fdd4c008040 comp rx=0 tx=0).stop 2023-12-20T04:51:54.162 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.158+0000 7fdd5d59f640 1 -- 172.21.15.132:0/3288915499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd580aeb00 msgr2=0x7fdd5806dda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:54.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.158+0000 7fdd5d59f640 1 --2- 172.21.15.132:0/3288915499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd580aeb00 0x7fdd5806dda0 secure :-1 s=READY pgs=1669 cs=0 l=1 rev1=1 crypto rx=0x7fdd480093e0 tx=0x7fdd48004a40 comp rx=0 tx=0).stop 2023-12-20T04:51:54.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.158+0000 7fdd5d59f640 1 -- 172.21.15.132:0/3288915499 shutdown_connections 2023-12-20T04:51:54.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.158+0000 7fdd5d59f640 1 --2- 172.21.15.132:0/3288915499 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdd4406a430 0x7fdd4406c8f0 unknown :-1 s=CLOSED pgs=706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.158+0000 7fdd5d59f640 1 --2- 172.21.15.132:0/3288915499 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdd5815d4f0 0x7fdd581f23b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.158+0000 7fdd5d59f640 1 --2- 172.21.15.132:0/3288915499 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdd5815d110 0x7fdd580c76b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.158+0000 7fdd5d59f640 1 --2- 172.21.15.132:0/3288915499 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdd580aeb00 0x7fdd5806dda0 unknown :-1 s=CLOSED pgs=1669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.158+0000 7fdd5d59f640 1 -- 172.21.15.132:0/3288915499 >> 172.21.15.132:0/3288915499 conn(0x7fdd580cfbd0 msgr2=0x7fdd5815c7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:54.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.158+0000 7fdd5d59f640 1 -- 172.21.15.132:0/3288915499 shutdown_connections 2023-12-20T04:51:54.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.158+0000 7fdd5d59f640 1 -- 172.21.15.132:0/3288915499 wait complete. 2023-12-20T04:51:54.171 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":439,"stamp":"2023-12-20T04:51:52.212720+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":203,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":155,"ondisk_log_size":155,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":8533,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553966,"statfs":{"total":1600000000,"available":1591262100,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.047518"},"pg_stats":[{"pgid":"21.3f","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939390+0000","last_change":"2023-12-20T04:51:46.525220+0000","last_active":"2023-12-20T04:51:47.939390+0000","last_peered":"2023-12-20T04:51:47.939390+0000","last_clean":"2023-12-20T04:51:47.939390+0000","last_became_active":"2023-12-20T04:51:46.525010+0000","last_became_peered":"2023-12-20T04:51:46.525010+0000","last_unstale":"2023-12-20T04:51:47.939390+0000","last_undegraded":"2023-12-20T04:51:47.939390+0000","last_fullsized":"2023-12-20T04:51:47.939390+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:58.325803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.3e","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.512433+0000","last_change":"2023-12-20T04:51:46.520924+0000","last_active":"2023-12-20T04:51:47.512433+0000","last_peered":"2023-12-20T04:51:47.512433+0000","last_clean":"2023-12-20T04:51:47.512433+0000","last_became_active":"2023-12-20T04:51:46.520390+0000","last_became_peered":"2023-12-20T04:51:46.520390+0000","last_unstale":"2023-12-20T04:51:47.512433+0000","last_undegraded":"2023-12-20T04:51:47.512433+0000","last_fullsized":"2023-12-20T04:51:47.512433+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:19:22.942973+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.3d","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.785968+0000","last_change":"2023-12-20T04:51:46.529583+0000","last_active":"2023-12-20T04:51:47.785968+0000","last_peered":"2023-12-20T04:51:47.785968+0000","last_clean":"2023-12-20T04:51:47.785968+0000","last_became_active":"2023-12-20T04:51:46.526212+0000","last_became_peered":"2023-12-20T04:51:46.526212+0000","last_unstale":"2023-12-20T04:51:47.785968+0000","last_undegraded":"2023-12-20T04:51:47.785968+0000","last_fullsized":"2023-12-20T04:51:47.785968+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:11:40.770860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.3c","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.513485+0000","last_change":"2023-12-20T04:51:46.529065+0000","last_active":"2023-12-20T04:51:47.513485+0000","last_peered":"2023-12-20T04:51:47.513485+0000","last_clean":"2023-12-20T04:51:47.513485+0000","last_became_active":"2023-12-20T04:51:46.528848+0000","last_became_peered":"2023-12-20T04:51:46.528848+0000","last_unstale":"2023-12-20T04:51:47.513485+0000","last_undegraded":"2023-12-20T04:51:47.513485+0000","last_fullsized":"2023-12-20T04:51:47.513485+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:33:45.804292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.3b","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939415+0000","last_change":"2023-12-20T04:51:46.523669+0000","last_active":"2023-12-20T04:51:47.939415+0000","last_peered":"2023-12-20T04:51:47.939415+0000","last_clean":"2023-12-20T04:51:47.939415+0000","last_became_active":"2023-12-20T04:51:46.523457+0000","last_became_peered":"2023-12-20T04:51:46.523457+0000","last_unstale":"2023-12-20T04:51:47.939415+0000","last_undegraded":"2023-12-20T04:51:47.939415+0000","last_fullsized":"2023-12-20T04:51:47.939415+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:28:31.974158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.3a","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939318+0000","last_change":"2023-12-20T04:51:46.523428+0000","last_active":"2023-12-20T04:51:47.939318+0000","last_peered":"2023-12-20T04:51:47.939318+0000","last_clean":"2023-12-20T04:51:47.939318+0000","last_became_active":"2023-12-20T04:51:46.523074+0000","last_became_peered":"2023-12-20T04:51:46.523074+0000","last_unstale":"2023-12-20T04:51:47.939318+0000","last_undegraded":"2023-12-20T04:51:47.939318+0000","last_fullsized":"2023-12-20T04:51:47.939318+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:16:34.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.39","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.513204+0000","last_change":"2023-12-20T04:51:46.525300+0000","last_active":"2023-12-20T04:51:47.513204+0000","last_peered":"2023-12-20T04:51:47.513204+0000","last_clean":"2023-12-20T04:51:47.513204+0000","last_became_active":"2023-12-20T04:51:46.525070+0000","last_became_peered":"2023-12-20T04:51:46.525070+0000","last_unstale":"2023-12-20T04:51:47.513204+0000","last_undegraded":"2023-12-20T04:51:47.513204+0000","last_fullsized":"2023-12-20T04:51:47.513204+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:45:54.044242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.38","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.938817+0000","last_change":"2023-12-20T04:51:46.519588+0000","last_active":"2023-12-20T04:51:47.938817+0000","last_peered":"2023-12-20T04:51:47.938817+0000","last_clean":"2023-12-20T04:51:47.938817+0000","last_became_active":"2023-12-20T04:51:46.519370+0000","last_became_peered":"2023-12-20T04:51:46.519370+0000","last_unstale":"2023-12-20T04:51:47.938817+0000","last_undegraded":"2023-12-20T04:51:47.938817+0000","last_fullsized":"2023-12-20T04:51:47.938817+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:24:02.413198+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.37","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.512401+0000","last_change":"2023-12-20T04:51:46.516368+0000","last_active":"2023-12-20T04:51:47.512401+0000","last_peered":"2023-12-20T04:51:47.512401+0000","last_clean":"2023-12-20T04:51:47.512401+0000","last_became_active":"2023-12-20T04:51:46.516158+0000","last_became_peered":"2023-12-20T04:51:46.516158+0000","last_unstale":"2023-12-20T04:51:47.512401+0000","last_undegraded":"2023-12-20T04:51:47.512401+0000","last_fullsized":"2023-12-20T04:51:47.512401+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:11:39.084159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.36","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939774+0000","last_change":"2023-12-20T04:51:46.531728+0000","last_active":"2023-12-20T04:51:47.939774+0000","last_peered":"2023-12-20T04:51:47.939774+0000","last_clean":"2023-12-20T04:51:47.939774+0000","last_became_active":"2023-12-20T04:51:46.531007+0000","last_became_peered":"2023-12-20T04:51:46.531007+0000","last_unstale":"2023-12-20T04:51:47.939774+0000","last_undegraded":"2023-12-20T04:51:47.939774+0000","last_fullsized":"2023-12-20T04:51:47.939774+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:01:12.990990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.35","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.938994+0000","last_change":"2023-12-20T04:51:46.520656+0000","last_active":"2023-12-20T04:51:47.938994+0000","last_peered":"2023-12-20T04:51:47.938994+0000","last_clean":"2023-12-20T04:51:47.938994+0000","last_became_active":"2023-12-20T04:51:46.519042+0000","last_became_peered":"2023-12-20T04:51:46.519042+0000","last_unstale":"2023-12-20T04:51:47.938994+0000","last_undegraded":"2023-12-20T04:51:47.938994+0000","last_fullsized":"2023-12-20T04:51:47.938994+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:35:37.766737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.34","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939578+0000","last_change":"2023-12-20T04:51:46.529464+0000","last_active":"2023-12-20T04:51:47.939578+0000","last_peered":"2023-12-20T04:51:47.939578+0000","last_clean":"2023-12-20T04:51:47.939578+0000","last_became_active":"2023-12-20T04:51:46.529124+0000","last_became_peered":"2023-12-20T04:51:46.529124+0000","last_unstale":"2023-12-20T04:51:47.939578+0000","last_undegraded":"2023-12-20T04:51:47.939578+0000","last_fullsized":"2023-12-20T04:51:47.939578+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:39:58.474958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.33","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939120+0000","last_change":"2023-12-20T04:51:46.528537+0000","last_active":"2023-12-20T04:51:47.939120+0000","last_peered":"2023-12-20T04:51:47.939120+0000","last_clean":"2023-12-20T04:51:47.939120+0000","last_became_active":"2023-12-20T04:51:46.527490+0000","last_became_peered":"2023-12-20T04:51:46.527490+0000","last_unstale":"2023-12-20T04:51:47.939120+0000","last_undegraded":"2023-12-20T04:51:47.939120+0000","last_fullsized":"2023-12-20T04:51:47.939120+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:43:06.788005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.32","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.513555+0000","last_change":"2023-12-20T04:51:46.530022+0000","last_active":"2023-12-20T04:51:47.513555+0000","last_peered":"2023-12-20T04:51:47.513555+0000","last_clean":"2023-12-20T04:51:47.513555+0000","last_became_active":"2023-12-20T04:51:46.529747+0000","last_became_peered":"2023-12-20T04:51:46.529747+0000","last_unstale":"2023-12-20T04:51:47.513555+0000","last_undegraded":"2023-12-20T04:51:47.513555+0000","last_fullsized":"2023-12-20T04:51:47.513555+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:25:09.378938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.31","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939879+0000","last_change":"2023-12-20T04:51:46.531582+0000","last_active":"2023-12-20T04:51:47.939879+0000","last_peered":"2023-12-20T04:51:47.939879+0000","last_clean":"2023-12-20T04:51:47.939879+0000","last_became_active":"2023-12-20T04:51:46.530665+0000","last_became_peered":"2023-12-20T04:51:46.530665+0000","last_unstale":"2023-12-20T04:51:47.939879+0000","last_undegraded":"2023-12-20T04:51:47.939879+0000","last_fullsized":"2023-12-20T04:51:47.939879+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:33:03.401904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.30","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.938984+0000","last_change":"2023-12-20T04:51:46.518622+0000","last_active":"2023-12-20T04:51:47.938984+0000","last_peered":"2023-12-20T04:51:47.938984+0000","last_clean":"2023-12-20T04:51:47.938984+0000","last_became_active":"2023-12-20T04:51:46.518312+0000","last_became_peered":"2023-12-20T04:51:46.518312+0000","last_unstale":"2023-12-20T04:51:47.938984+0000","last_undegraded":"2023-12-20T04:51:47.938984+0000","last_fullsized":"2023-12-20T04:51:47.938984+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:30:32.739283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2f","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939884+0000","last_change":"2023-12-20T04:51:46.530260+0000","last_active":"2023-12-20T04:51:47.939884+0000","last_peered":"2023-12-20T04:51:47.939884+0000","last_clean":"2023-12-20T04:51:47.939884+0000","last_became_active":"2023-12-20T04:51:46.530038+0000","last_became_peered":"2023-12-20T04:51:46.530038+0000","last_unstale":"2023-12-20T04:51:47.939884+0000","last_undegraded":"2023-12-20T04:51:47.939884+0000","last_fullsized":"2023-12-20T04:51:47.939884+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:28:56.740518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2e","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.785895+0000","last_change":"2023-12-20T04:51:46.527143+0000","last_active":"2023-12-20T04:51:47.785895+0000","last_peered":"2023-12-20T04:51:47.785895+0000","last_clean":"2023-12-20T04:51:47.785895+0000","last_became_active":"2023-12-20T04:51:46.525501+0000","last_became_peered":"2023-12-20T04:51:46.525501+0000","last_unstale":"2023-12-20T04:51:47.785895+0000","last_undegraded":"2023-12-20T04:51:47.785895+0000","last_fullsized":"2023-12-20T04:51:47.785895+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:58.325803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.2d","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939160+0000","last_change":"2023-12-20T04:51:46.520517+0000","last_active":"2023-12-20T04:51:47.939160+0000","last_peered":"2023-12-20T04:51:47.939160+0000","last_clean":"2023-12-20T04:51:47.939160+0000","last_became_active":"2023-12-20T04:51:46.519581+0000","last_became_peered":"2023-12-20T04:51:46.519581+0000","last_unstale":"2023-12-20T04:51:47.939160+0000","last_undegraded":"2023-12-20T04:51:47.939160+0000","last_fullsized":"2023-12-20T04:51:47.939160+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:40:47.202780+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2c","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939045+0000","last_change":"2023-12-20T04:51:46.516653+0000","last_active":"2023-12-20T04:51:47.939045+0000","last_peered":"2023-12-20T04:51:47.939045+0000","last_clean":"2023-12-20T04:51:47.939045+0000","last_became_active":"2023-12-20T04:51:46.516414+0000","last_became_peered":"2023-12-20T04:51:46.516414+0000","last_unstale":"2023-12-20T04:51:47.939045+0000","last_undegraded":"2023-12-20T04:51:47.939045+0000","last_fullsized":"2023-12-20T04:51:47.939045+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:44:52.003733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.2b","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939739+0000","last_change":"2023-12-20T04:51:46.531156+0000","last_active":"2023-12-20T04:51:47.939739+0000","last_peered":"2023-12-20T04:51:47.939739+0000","last_clean":"2023-12-20T04:51:47.939739+0000","last_became_active":"2023-12-20T04:51:46.530745+0000","last_became_peered":"2023-12-20T04:51:46.530745+0000","last_unstale":"2023-12-20T04:51:47.939739+0000","last_undegraded":"2023-12-20T04:51:47.939739+0000","last_fullsized":"2023-12-20T04:51:47.939739+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:14:29.689294+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.2a","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.513611+0000","last_change":"2023-12-20T04:51:46.524692+0000","last_active":"2023-12-20T04:51:47.513611+0000","last_peered":"2023-12-20T04:51:47.513611+0000","last_clean":"2023-12-20T04:51:47.513611+0000","last_became_active":"2023-12-20T04:51:46.524062+0000","last_became_peered":"2023-12-20T04:51:46.524062+0000","last_unstale":"2023-12-20T04:51:47.513611+0000","last_undegraded":"2023-12-20T04:51:47.513611+0000","last_fullsized":"2023-12-20T04:51:47.513611+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:48.643151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.29","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.513338+0000","last_change":"2023-12-20T04:51:46.525426+0000","last_active":"2023-12-20T04:51:47.513338+0000","last_peered":"2023-12-20T04:51:47.513338+0000","last_clean":"2023-12-20T04:51:47.513338+0000","last_became_active":"2023-12-20T04:51:46.524895+0000","last_became_peered":"2023-12-20T04:51:46.524895+0000","last_unstale":"2023-12-20T04:51:47.513338+0000","last_undegraded":"2023-12-20T04:51:47.513338+0000","last_fullsized":"2023-12-20T04:51:47.513338+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:16:34.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.28","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939449+0000","last_change":"2023-12-20T04:51:46.532995+0000","last_active":"2023-12-20T04:51:47.939449+0000","last_peered":"2023-12-20T04:51:47.939449+0000","last_clean":"2023-12-20T04:51:47.939449+0000","last_became_active":"2023-12-20T04:51:46.532390+0000","last_became_peered":"2023-12-20T04:51:46.532390+0000","last_unstale":"2023-12-20T04:51:47.939449+0000","last_undegraded":"2023-12-20T04:51:47.939449+0000","last_fullsized":"2023-12-20T04:51:47.939449+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:56:06.870966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.27","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939170+0000","last_change":"2023-12-20T04:51:46.518238+0000","last_active":"2023-12-20T04:51:47.939170+0000","last_peered":"2023-12-20T04:51:47.939170+0000","last_clean":"2023-12-20T04:51:47.939170+0000","last_became_active":"2023-12-20T04:51:46.518013+0000","last_became_peered":"2023-12-20T04:51:46.518013+0000","last_unstale":"2023-12-20T04:51:47.939170+0000","last_undegraded":"2023-12-20T04:51:47.939170+0000","last_fullsized":"2023-12-20T04:51:47.939170+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:14:20.124173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.26","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939053+0000","last_change":"2023-12-20T04:51:46.520815+0000","last_active":"2023-12-20T04:51:47.939053+0000","last_peered":"2023-12-20T04:51:47.939053+0000","last_clean":"2023-12-20T04:51:47.939053+0000","last_became_active":"2023-12-20T04:51:46.519335+0000","last_became_peered":"2023-12-20T04:51:46.519335+0000","last_unstale":"2023-12-20T04:51:47.939053+0000","last_undegraded":"2023-12-20T04:51:47.939053+0000","last_fullsized":"2023-12-20T04:51:47.939053+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:45:31.926264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.25","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939137+0000","last_change":"2023-12-20T04:51:46.519055+0000","last_active":"2023-12-20T04:51:47.939137+0000","last_peered":"2023-12-20T04:51:47.939137+0000","last_clean":"2023-12-20T04:51:47.939137+0000","last_became_active":"2023-12-20T04:51:46.518613+0000","last_became_peered":"2023-12-20T04:51:46.518613+0000","last_unstale":"2023-12-20T04:51:47.939137+0000","last_undegraded":"2023-12-20T04:51:47.939137+0000","last_fullsized":"2023-12-20T04:51:47.939137+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:46.089610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.24","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.513238+0000","last_change":"2023-12-20T04:51:46.520560+0000","last_active":"2023-12-20T04:51:47.513238+0000","last_peered":"2023-12-20T04:51:47.513238+0000","last_clean":"2023-12-20T04:51:47.513238+0000","last_became_active":"2023-12-20T04:51:46.520356+0000","last_became_peered":"2023-12-20T04:51:46.520356+0000","last_unstale":"2023-12-20T04:51:47.513238+0000","last_undegraded":"2023-12-20T04:51:47.513238+0000","last_fullsized":"2023-12-20T04:51:47.513238+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:26:18.052810+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.23","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.938919+0000","last_change":"2023-12-20T04:51:46.517757+0000","last_active":"2023-12-20T04:51:47.938919+0000","last_peered":"2023-12-20T04:51:47.938919+0000","last_clean":"2023-12-20T04:51:47.938919+0000","last_became_active":"2023-12-20T04:51:46.517556+0000","last_became_peered":"2023-12-20T04:51:46.517556+0000","last_unstale":"2023-12-20T04:51:47.938919+0000","last_undegraded":"2023-12-20T04:51:47.938919+0000","last_fullsized":"2023-12-20T04:51:47.938919+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:11:40.770860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.22","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.513587+0000","last_change":"2023-12-20T04:51:46.524602+0000","last_active":"2023-12-20T04:51:47.513587+0000","last_peered":"2023-12-20T04:51:47.513587+0000","last_clean":"2023-12-20T04:51:47.513587+0000","last_became_active":"2023-12-20T04:51:46.524115+0000","last_became_peered":"2023-12-20T04:51:46.524115+0000","last_unstale":"2023-12-20T04:51:47.513587+0000","last_undegraded":"2023-12-20T04:51:47.513587+0000","last_fullsized":"2023-12-20T04:51:47.513587+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:58.325803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.21","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.512453+0000","last_change":"2023-12-20T04:51:46.521758+0000","last_active":"2023-12-20T04:51:47.512453+0000","last_peered":"2023-12-20T04:51:47.512453+0000","last_clean":"2023-12-20T04:51:47.512453+0000","last_became_active":"2023-12-20T04:51:46.521562+0000","last_became_peered":"2023-12-20T04:51:46.521562+0000","last_unstale":"2023-12-20T04:51:47.512453+0000","last_undegraded":"2023-12-20T04:51:47.512453+0000","last_fullsized":"2023-12-20T04:51:47.512453+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:54:42.358347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.20","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939221+0000","last_change":"2023-12-20T04:51:46.517206+0000","last_active":"2023-12-20T04:51:47.939221+0000","last_peered":"2023-12-20T04:51:47.939221+0000","last_clean":"2023-12-20T04:51:47.939221+0000","last_became_active":"2023-12-20T04:51:46.516970+0000","last_became_peered":"2023-12-20T04:51:46.516970+0000","last_unstale":"2023-12-20T04:51:47.939221+0000","last_undegraded":"2023-12-20T04:51:47.939221+0000","last_fullsized":"2023-12-20T04:51:47.939221+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:54:39.908900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1e","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939573+0000","last_change":"2023-12-20T04:51:46.529662+0000","last_active":"2023-12-20T04:51:47.939573+0000","last_peered":"2023-12-20T04:51:47.939573+0000","last_clean":"2023-12-20T04:51:47.939573+0000","last_became_active":"2023-12-20T04:51:46.529426+0000","last_became_peered":"2023-12-20T04:51:46.529426+0000","last_unstale":"2023-12-20T04:51:47.939573+0000","last_undegraded":"2023-12-20T04:51:47.939573+0000","last_fullsized":"2023-12-20T04:51:47.939573+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:16:19.667699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1f","version":"168'4","reported_seq":15,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.533159+0000","last_change":"2023-12-20T04:51:46.178692+0000","last_active":"2023-12-20T04:51:46.533159+0000","last_peered":"2023-12-20T04:51:46.533159+0000","last_clean":"2023-12-20T04:51:46.533159+0000","last_became_active":"2023-12-20T04:51:46.178469+0000","last_became_peered":"2023-12-20T04:51:46.178469+0000","last_unstale":"2023-12-20T04:51:46.533159+0000","last_undegraded":"2023-12-20T04:51:46.533159+0000","last_fullsized":"2023-12-20T04:51:46.533159+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:47.636801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.1f","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.512445+0000","last_change":"2023-12-20T04:51:46.522315+0000","last_active":"2023-12-20T04:51:47.512445+0000","last_peered":"2023-12-20T04:51:47.512445+0000","last_clean":"2023-12-20T04:51:47.512445+0000","last_became_active":"2023-12-20T04:51:46.521107+0000","last_became_peered":"2023-12-20T04:51:46.521107+0000","last_unstale":"2023-12-20T04:51:47.512445+0000","last_undegraded":"2023-12-20T04:51:47.512445+0000","last_fullsized":"2023-12-20T04:51:47.512445+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:29:46.218019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1e","version":"168'1","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.528020+0000","last_change":"2023-12-20T04:51:46.175352+0000","last_active":"2023-12-20T04:51:46.528020+0000","last_peered":"2023-12-20T04:51:46.528020+0000","last_clean":"2023-12-20T04:51:46.528020+0000","last_became_active":"2023-12-20T04:51:46.175125+0000","last_became_peered":"2023-12-20T04:51:46.175125+0000","last_unstale":"2023-12-20T04:51:46.528020+0000","last_undegraded":"2023-12-20T04:51:46.528020+0000","last_fullsized":"2023-12-20T04:51:46.528020+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:47.636801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.1c","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939142+0000","last_change":"2023-12-20T04:51:46.524590+0000","last_active":"2023-12-20T04:51:47.939142+0000","last_peered":"2023-12-20T04:51:47.939142+0000","last_clean":"2023-12-20T04:51:47.939142+0000","last_became_active":"2023-12-20T04:51:46.524267+0000","last_became_peered":"2023-12-20T04:51:46.524267+0000","last_unstale":"2023-12-20T04:51:47.939142+0000","last_undegraded":"2023-12-20T04:51:47.939142+0000","last_fullsized":"2023-12-20T04:51:47.939142+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:48.643151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.1d","version":"168'2","reported_seq":13,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.528141+0000","last_change":"2023-12-20T04:51:46.170989+0000","last_active":"2023-12-20T04:51:46.528141+0000","last_peered":"2023-12-20T04:51:46.528141+0000","last_clean":"2023-12-20T04:51:46.528141+0000","last_became_active":"2023-12-20T04:51:46.170728+0000","last_became_peered":"2023-12-20T04:51:46.170728+0000","last_unstale":"2023-12-20T04:51:46.528141+0000","last_undegraded":"2023-12-20T04:51:46.528141+0000","last_fullsized":"2023-12-20T04:51:46.528141+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:54:35.761511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1d","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939982+0000","last_change":"2023-12-20T04:51:46.524864+0000","last_active":"2023-12-20T04:51:47.939982+0000","last_peered":"2023-12-20T04:51:47.939982+0000","last_clean":"2023-12-20T04:51:47.939982+0000","last_became_active":"2023-12-20T04:51:46.524493+0000","last_became_peered":"2023-12-20T04:51:46.524493+0000","last_unstale":"2023-12-20T04:51:47.939982+0000","last_undegraded":"2023-12-20T04:51:47.939982+0000","last_fullsized":"2023-12-20T04:51:47.939982+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:50:14.031044+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1c","version":"168'2","reported_seq":13,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.525788+0000","last_change":"2023-12-20T04:51:46.173772+0000","last_active":"2023-12-20T04:51:46.525788+0000","last_peered":"2023-12-20T04:51:46.525788+0000","last_clean":"2023-12-20T04:51:46.525788+0000","last_became_active":"2023-12-20T04:51:46.173562+0000","last_became_peered":"2023-12-20T04:51:46.173562+0000","last_unstale":"2023-12-20T04:51:46.525788+0000","last_undegraded":"2023-12-20T04:51:46.525788+0000","last_fullsized":"2023-12-20T04:51:46.525788+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:57:35.366758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.1a","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.512548+0000","last_change":"2023-12-20T04:51:46.522451+0000","last_active":"2023-12-20T04:51:47.512548+0000","last_peered":"2023-12-20T04:51:47.512548+0000","last_clean":"2023-12-20T04:51:47.512548+0000","last_became_active":"2023-12-20T04:51:46.521391+0000","last_became_peered":"2023-12-20T04:51:46.521391+0000","last_unstale":"2023-12-20T04:51:47.512548+0000","last_undegraded":"2023-12-20T04:51:47.512548+0000","last_fullsized":"2023-12-20T04:51:47.512548+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:58:28.982887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.1b","version":"168'1","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.530558+0000","last_change":"2023-12-20T04:51:46.176573+0000","last_active":"2023-12-20T04:51:46.530558+0000","last_peered":"2023-12-20T04:51:46.530558+0000","last_clean":"2023-12-20T04:51:46.530558+0000","last_became_active":"2023-12-20T04:51:46.176288+0000","last_became_peered":"2023-12-20T04:51:46.176288+0000","last_unstale":"2023-12-20T04:51:46.530558+0000","last_undegraded":"2023-12-20T04:51:46.530558+0000","last_fullsized":"2023-12-20T04:51:46.530558+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:13:09.277528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.1b","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.513709+0000","last_change":"2023-12-20T04:51:46.524379+0000","last_active":"2023-12-20T04:51:47.513709+0000","last_peered":"2023-12-20T04:51:47.513709+0000","last_clean":"2023-12-20T04:51:47.513709+0000","last_became_active":"2023-12-20T04:51:46.523704+0000","last_became_peered":"2023-12-20T04:51:46.523704+0000","last_unstale":"2023-12-20T04:51:47.513709+0000","last_undegraded":"2023-12-20T04:51:47.513709+0000","last_fullsized":"2023-12-20T04:51:47.513709+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:02:44.137235+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.1a","version":"168'1","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.527656+0000","last_change":"2023-12-20T04:51:46.175961+0000","last_active":"2023-12-20T04:51:46.527656+0000","last_peered":"2023-12-20T04:51:46.527656+0000","last_clean":"2023-12-20T04:51:46.527656+0000","last_became_active":"2023-12-20T04:51:46.174999+0000","last_became_peered":"2023-12-20T04:51:46.174999+0000","last_unstale":"2023-12-20T04:51:46.527656+0000","last_undegraded":"2023-12-20T04:51:46.527656+0000","last_fullsized":"2023-12-20T04:51:46.527656+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:55:37.235060+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.18","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.512748+0000","last_change":"2023-12-20T04:51:46.516967+0000","last_active":"2023-12-20T04:51:47.512748+0000","last_peered":"2023-12-20T04:51:47.512748+0000","last_clean":"2023-12-20T04:51:47.512748+0000","last_became_active":"2023-12-20T04:51:46.516750+0000","last_became_peered":"2023-12-20T04:51:46.516750+0000","last_unstale":"2023-12-20T04:51:47.512748+0000","last_undegraded":"2023-12-20T04:51:47.512748+0000","last_fullsized":"2023-12-20T04:51:47.512748+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:37:54.287715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.19","version":"0'0","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.511379+0000","last_change":"2023-12-20T04:51:46.175736+0000","last_active":"2023-12-20T04:51:46.511379+0000","last_peered":"2023-12-20T04:51:46.511379+0000","last_clean":"2023-12-20T04:51:46.511379+0000","last_became_active":"2023-12-20T04:51:46.175516+0000","last_became_peered":"2023-12-20T04:51:46.175516+0000","last_unstale":"2023-12-20T04:51:46.511379+0000","last_undegraded":"2023-12-20T04:51:46.511379+0000","last_fullsized":"2023-12-20T04:51:46.511379+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:47:41.345193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.19","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939233+0000","last_change":"2023-12-20T04:51:46.517388+0000","last_active":"2023-12-20T04:51:47.939233+0000","last_peered":"2023-12-20T04:51:47.939233+0000","last_clean":"2023-12-20T04:51:47.939233+0000","last_became_active":"2023-12-20T04:51:46.517159+0000","last_became_peered":"2023-12-20T04:51:46.517159+0000","last_unstale":"2023-12-20T04:51:47.939233+0000","last_undegraded":"2023-12-20T04:51:47.939233+0000","last_fullsized":"2023-12-20T04:51:47.939233+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:48.128882+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.18","version":"0'0","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.523367+0000","last_change":"2023-12-20T04:51:46.176671+0000","last_active":"2023-12-20T04:51:46.523367+0000","last_peered":"2023-12-20T04:51:46.523367+0000","last_clean":"2023-12-20T04:51:46.523367+0000","last_became_active":"2023-12-20T04:51:46.176453+0000","last_became_peered":"2023-12-20T04:51:46.176453+0000","last_unstale":"2023-12-20T04:51:46.523367+0000","last_undegraded":"2023-12-20T04:51:46.523367+0000","last_fullsized":"2023-12-20T04:51:46.523367+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:13:33.762273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"21.16","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939430+0000","last_change":"2023-12-20T04:51:46.518026+0000","last_active":"2023-12-20T04:51:47.939430+0000","last_peered":"2023-12-20T04:51:47.939430+0000","last_clean":"2023-12-20T04:51:47.939430+0000","last_became_active":"2023-12-20T04:51:46.517783+0000","last_became_peered":"2023-12-20T04:51:46.517783+0000","last_unstale":"2023-12-20T04:51:47.939430+0000","last_undegraded":"2023-12-20T04:51:47.939430+0000","last_fullsized":"2023-12-20T04:51:47.939430+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:43:44.714789+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.17","version":"0'0","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.513338+0000","last_change":"2023-12-20T04:51:46.173500+0000","last_active":"2023-12-20T04:51:46.513338+0000","last_peered":"2023-12-20T04:51:46.513338+0000","last_clean":"2023-12-20T04:51:46.513338+0000","last_became_active":"2023-12-20T04:51:46.173290+0000","last_became_peered":"2023-12-20T04:51:46.173290+0000","last_unstale":"2023-12-20T04:51:46.513338+0000","last_undegraded":"2023-12-20T04:51:46.513338+0000","last_fullsized":"2023-12-20T04:51:46.513338+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:45:30.919915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.17","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939802+0000","last_change":"2023-12-20T04:51:46.530517+0000","last_active":"2023-12-20T04:51:47.939802+0000","last_peered":"2023-12-20T04:51:47.939802+0000","last_clean":"2023-12-20T04:51:47.939802+0000","last_became_active":"2023-12-20T04:51:46.528258+0000","last_became_peered":"2023-12-20T04:51:46.528258+0000","last_unstale":"2023-12-20T04:51:47.939802+0000","last_undegraded":"2023-12-20T04:51:47.939802+0000","last_fullsized":"2023-12-20T04:51:47.939802+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:00:32.568729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.16","version":"0'0","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.523282+0000","last_change":"2023-12-20T04:51:46.178105+0000","last_active":"2023-12-20T04:51:46.523282+0000","last_peered":"2023-12-20T04:51:46.523282+0000","last_clean":"2023-12-20T04:51:46.523282+0000","last_became_active":"2023-12-20T04:51:46.177901+0000","last_became_peered":"2023-12-20T04:51:46.177901+0000","last_unstale":"2023-12-20T04:51:46.523282+0000","last_undegraded":"2023-12-20T04:51:46.523282+0000","last_fullsized":"2023-12-20T04:51:46.523282+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:33:09.820546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.15","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.938811+0000","last_change":"2023-12-20T04:51:46.519654+0000","last_active":"2023-12-20T04:51:47.938811+0000","last_peered":"2023-12-20T04:51:47.938811+0000","last_clean":"2023-12-20T04:51:47.938811+0000","last_became_active":"2023-12-20T04:51:46.519458+0000","last_became_peered":"2023-12-20T04:51:46.519458+0000","last_unstale":"2023-12-20T04:51:47.938811+0000","last_undegraded":"2023-12-20T04:51:47.938811+0000","last_fullsized":"2023-12-20T04:51:47.938811+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:48:06.942822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.14","version":"168'6","reported_seq":17,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.531517+0000","last_change":"2023-12-20T04:51:46.174403+0000","last_active":"2023-12-20T04:51:46.531517+0000","last_peered":"2023-12-20T04:51:46.531517+0000","last_clean":"2023-12-20T04:51:46.531517+0000","last_became_active":"2023-12-20T04:51:46.174165+0000","last_became_peered":"2023-12-20T04:51:46.174165+0000","last_unstale":"2023-12-20T04:51:46.531517+0000","last_undegraded":"2023-12-20T04:51:46.531517+0000","last_fullsized":"2023-12-20T04:51:46.531517+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:01:11.984641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.12","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.786006+0000","last_change":"2023-12-20T04:51:46.528948+0000","last_active":"2023-12-20T04:51:47.786006+0000","last_peered":"2023-12-20T04:51:47.786006+0000","last_clean":"2023-12-20T04:51:47.786006+0000","last_became_active":"2023-12-20T04:51:46.528710+0000","last_became_peered":"2023-12-20T04:51:46.528710+0000","last_unstale":"2023-12-20T04:51:47.786006+0000","last_undegraded":"2023-12-20T04:51:47.786006+0000","last_fullsized":"2023-12-20T04:51:47.786006+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:33:48.643151+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.13","version":"168'2","reported_seq":13,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.528825+0000","last_change":"2023-12-20T04:51:46.168748+0000","last_active":"2023-12-20T04:51:46.528825+0000","last_peered":"2023-12-20T04:51:46.528825+0000","last_clean":"2023-12-20T04:51:46.528825+0000","last_became_active":"2023-12-20T04:51:46.168511+0000","last_became_peered":"2023-12-20T04:51:46.168511+0000","last_unstale":"2023-12-20T04:51:46.528825+0000","last_undegraded":"2023-12-20T04:51:46.528825+0000","last_fullsized":"2023-12-20T04:51:46.528825+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:54:41.620584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.13","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.512617+0000","last_change":"2023-12-20T04:51:46.519529+0000","last_active":"2023-12-20T04:51:47.512617+0000","last_peered":"2023-12-20T04:51:47.512617+0000","last_clean":"2023-12-20T04:51:47.512617+0000","last_became_active":"2023-12-20T04:51:46.519307+0000","last_became_peered":"2023-12-20T04:51:46.519307+0000","last_unstale":"2023-12-20T04:51:47.512617+0000","last_undegraded":"2023-12-20T04:51:47.512617+0000","last_fullsized":"2023-12-20T04:51:47.512617+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:00:32.568729+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.12","version":"0'0","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.518655+0000","last_change":"2023-12-20T04:51:46.175019+0000","last_active":"2023-12-20T04:51:46.518655+0000","last_peered":"2023-12-20T04:51:46.518655+0000","last_clean":"2023-12-20T04:51:46.518655+0000","last_became_active":"2023-12-20T04:51:46.174727+0000","last_became_peered":"2023-12-20T04:51:46.174727+0000","last_unstale":"2023-12-20T04:51:46.518655+0000","last_undegraded":"2023-12-20T04:51:46.518655+0000","last_fullsized":"2023-12-20T04:51:46.518655+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:13:33.762273+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.10","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939225+0000","last_change":"2023-12-20T04:51:46.527836+0000","last_active":"2023-12-20T04:51:47.939225+0000","last_peered":"2023-12-20T04:51:47.939225+0000","last_clean":"2023-12-20T04:51:47.939225+0000","last_became_active":"2023-12-20T04:51:46.526812+0000","last_became_peered":"2023-12-20T04:51:46.526812+0000","last_unstale":"2023-12-20T04:51:47.939225+0000","last_undegraded":"2023-12-20T04:51:47.939225+0000","last_fullsized":"2023-12-20T04:51:47.939225+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:13:51.196158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.11","version":"0'0","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.513183+0000","last_change":"2023-12-20T04:51:46.167449+0000","last_active":"2023-12-20T04:51:46.513183+0000","last_peered":"2023-12-20T04:51:46.513183+0000","last_clean":"2023-12-20T04:51:46.513183+0000","last_became_active":"2023-12-20T04:51:46.167287+0000","last_became_peered":"2023-12-20T04:51:46.167287+0000","last_unstale":"2023-12-20T04:51:46.513183+0000","last_undegraded":"2023-12-20T04:51:46.513183+0000","last_fullsized":"2023-12-20T04:51:46.513183+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:47:45.526934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.11","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.786004+0000","last_change":"2023-12-20T04:51:46.523309+0000","last_active":"2023-12-20T04:51:47.786004+0000","last_peered":"2023-12-20T04:51:47.786004+0000","last_clean":"2023-12-20T04:51:47.786004+0000","last_became_active":"2023-12-20T04:51:46.522958+0000","last_became_peered":"2023-12-20T04:51:46.522958+0000","last_unstale":"2023-12-20T04:51:47.786004+0000","last_undegraded":"2023-12-20T04:51:47.786004+0000","last_fullsized":"2023-12-20T04:51:47.786004+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:54:49.253438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.10","version":"168'8","reported_seq":19,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.531017+0000","last_change":"2023-12-20T04:51:46.172692+0000","last_active":"2023-12-20T04:51:46.531017+0000","last_peered":"2023-12-20T04:51:46.531017+0000","last_clean":"2023-12-20T04:51:46.531017+0000","last_became_active":"2023-12-20T04:51:46.172122+0000","last_became_peered":"2023-12-20T04:51:46.172122+0000","last_unstale":"2023-12-20T04:51:46.531017+0000","last_undegraded":"2023-12-20T04:51:46.531017+0000","last_fullsized":"2023-12-20T04:51:46.531017+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:19:07.052276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.e","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.940077+0000","last_change":"2023-12-20T04:51:46.531876+0000","last_active":"2023-12-20T04:51:47.940077+0000","last_peered":"2023-12-20T04:51:47.940077+0000","last_clean":"2023-12-20T04:51:47.940077+0000","last_became_active":"2023-12-20T04:51:46.531356+0000","last_became_peered":"2023-12-20T04:51:46.531356+0000","last_unstale":"2023-12-20T04:51:47.940077+0000","last_undegraded":"2023-12-20T04:51:47.940077+0000","last_fullsized":"2023-12-20T04:51:47.940077+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:58:28.982887+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.f","version":"168'1","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.532228+0000","last_change":"2023-12-20T04:51:46.177732+0000","last_active":"2023-12-20T04:51:46.532228+0000","last_peered":"2023-12-20T04:51:46.532228+0000","last_clean":"2023-12-20T04:51:46.532228+0000","last_became_active":"2023-12-20T04:51:46.177477+0000","last_became_peered":"2023-12-20T04:51:46.177477+0000","last_unstale":"2023-12-20T04:51:46.532228+0000","last_undegraded":"2023-12-20T04:51:46.532228+0000","last_fullsized":"2023-12-20T04:51:46.532228+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:42:42.363620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"21.f","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.938892+0000","last_change":"2023-12-20T04:51:46.529305+0000","last_active":"2023-12-20T04:51:47.938892+0000","last_peered":"2023-12-20T04:51:47.938892+0000","last_clean":"2023-12-20T04:51:47.938892+0000","last_became_active":"2023-12-20T04:51:46.529142+0000","last_became_peered":"2023-12-20T04:51:46.529142+0000","last_unstale":"2023-12-20T04:51:47.938892+0000","last_undegraded":"2023-12-20T04:51:47.938892+0000","last_fullsized":"2023-12-20T04:51:47.938892+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:02:20.626674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.e","version":"168'2","reported_seq":13,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.527535+0000","last_change":"2023-12-20T04:51:46.177761+0000","last_active":"2023-12-20T04:51:46.527535+0000","last_peered":"2023-12-20T04:51:46.527535+0000","last_clean":"2023-12-20T04:51:46.527535+0000","last_became_active":"2023-12-20T04:51:46.177565+0000","last_became_peered":"2023-12-20T04:51:46.177565+0000","last_unstale":"2023-12-20T04:51:46.527535+0000","last_undegraded":"2023-12-20T04:51:46.527535+0000","last_fullsized":"2023-12-20T04:51:46.527535+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:40:46.196430+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.c","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.786106+0000","last_change":"2023-12-20T04:51:46.529125+0000","last_active":"2023-12-20T04:51:47.786106+0000","last_peered":"2023-12-20T04:51:47.786106+0000","last_clean":"2023-12-20T04:51:47.786106+0000","last_became_active":"2023-12-20T04:51:46.528483+0000","last_became_peered":"2023-12-20T04:51:46.528483+0000","last_unstale":"2023-12-20T04:51:47.786106+0000","last_undegraded":"2023-12-20T04:51:47.786106+0000","last_fullsized":"2023-12-20T04:51:47.786106+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:45:31.926264+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.d","version":"168'1","reported_seq":12,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.530686+0000","last_change":"2023-12-20T04:51:46.176746+0000","last_active":"2023-12-20T04:51:46.530686+0000","last_peered":"2023-12-20T04:51:46.530686+0000","last_clean":"2023-12-20T04:51:46.530686+0000","last_became_active":"2023-12-20T04:51:46.176256+0000","last_became_peered":"2023-12-20T04:51:46.176256+0000","last_unstale":"2023-12-20T04:51:46.530686+0000","last_undegraded":"2023-12-20T04:51:46.530686+0000","last_fullsized":"2023-12-20T04:51:46.530686+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:07.950388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"21.d","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939274+0000","last_change":"2023-12-20T04:51:46.523306+0000","last_active":"2023-12-20T04:51:47.939274+0000","last_peered":"2023-12-20T04:51:47.939274+0000","last_clean":"2023-12-20T04:51:47.939274+0000","last_became_active":"2023-12-20T04:51:46.522792+0000","last_became_peered":"2023-12-20T04:51:46.522792+0000","last_unstale":"2023-12-20T04:51:47.939274+0000","last_undegraded":"2023-12-20T04:51:47.939274+0000","last_fullsized":"2023-12-20T04:51:47.939274+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:35:02.428521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.c","version":"0'0","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.514379+0000","last_change":"2023-12-20T04:51:46.174309+0000","last_active":"2023-12-20T04:51:46.514379+0000","last_peered":"2023-12-20T04:51:46.514379+0000","last_clean":"2023-12-20T04:51:46.514379+0000","last_became_active":"2023-12-20T04:51:46.172937+0000","last_became_peered":"2023-12-20T04:51:46.172937+0000","last_unstale":"2023-12-20T04:51:46.514379+0000","last_undegraded":"2023-12-20T04:51:46.514379+0000","last_fullsized":"2023-12-20T04:51:46.514379+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:35:01.422172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.a","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.513639+0000","last_change":"2023-12-20T04:51:46.522805+0000","last_active":"2023-12-20T04:51:47.513639+0000","last_peered":"2023-12-20T04:51:47.513639+0000","last_clean":"2023-12-20T04:51:47.513639+0000","last_became_active":"2023-12-20T04:51:46.522303+0000","last_became_peered":"2023-12-20T04:51:46.522303+0000","last_unstale":"2023-12-20T04:51:47.513639+0000","last_undegraded":"2023-12-20T04:51:47.513639+0000","last_fullsized":"2023-12-20T04:51:47.513639+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:11:40.770860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.b","version":"168'2","reported_seq":13,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.527510+0000","last_change":"2023-12-20T04:51:46.170112+0000","last_active":"2023-12-20T04:51:46.527510+0000","last_peered":"2023-12-20T04:51:46.527510+0000","last_clean":"2023-12-20T04:51:46.527510+0000","last_became_active":"2023-12-20T04:51:46.169733+0000","last_became_peered":"2023-12-20T04:51:46.169733+0000","last_unstale":"2023-12-20T04:51:46.527510+0000","last_undegraded":"2023-12-20T04:51:46.527510+0000","last_fullsized":"2023-12-20T04:51:46.527510+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:16:18.661350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.b","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.513290+0000","last_change":"2023-12-20T04:51:46.523997+0000","last_active":"2023-12-20T04:51:47.513290+0000","last_peered":"2023-12-20T04:51:47.513290+0000","last_clean":"2023-12-20T04:51:47.513290+0000","last_became_active":"2023-12-20T04:51:46.523771+0000","last_became_peered":"2023-12-20T04:51:46.523771+0000","last_unstale":"2023-12-20T04:51:47.513290+0000","last_undegraded":"2023-12-20T04:51:47.513290+0000","last_fullsized":"2023-12-20T04:51:47.513290+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:06:28.710244+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.a","version":"0'0","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.525785+0000","last_change":"2023-12-20T04:51:46.179198+0000","last_active":"2023-12-20T04:51:46.525785+0000","last_peered":"2023-12-20T04:51:46.525785+0000","last_clean":"2023-12-20T04:51:46.525785+0000","last_became_active":"2023-12-20T04:51:46.178985+0000","last_became_peered":"2023-12-20T04:51:46.178985+0000","last_unstale":"2023-12-20T04:51:46.525785+0000","last_undegraded":"2023-12-20T04:51:46.525785+0000","last_fullsized":"2023-12-20T04:51:46.525785+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:16:33.403901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.8","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.513536+0000","last_change":"2023-12-20T04:51:46.522928+0000","last_active":"2023-12-20T04:51:47.513536+0000","last_peered":"2023-12-20T04:51:47.513536+0000","last_clean":"2023-12-20T04:51:47.513536+0000","last_became_active":"2023-12-20T04:51:46.522627+0000","last_became_peered":"2023-12-20T04:51:46.522627+0000","last_unstale":"2023-12-20T04:51:47.513536+0000","last_undegraded":"2023-12-20T04:51:47.513536+0000","last_fullsized":"2023-12-20T04:51:47.513536+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:33:10.826895+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"20.9","version":"0'0","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.522131+0000","last_change":"2023-12-20T04:51:46.178429+0000","last_active":"2023-12-20T04:51:46.522131+0000","last_peered":"2023-12-20T04:51:46.522131+0000","last_clean":"2023-12-20T04:51:46.522131+0000","last_became_active":"2023-12-20T04:51:46.177873+0000","last_became_peered":"2023-12-20T04:51:46.177873+0000","last_unstale":"2023-12-20T04:51:46.522131+0000","last_undegraded":"2023-12-20T04:51:46.522131+0000","last_fullsized":"2023-12-20T04:51:46.522131+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:45:30.919915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.9","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.513298+0000","last_change":"2023-12-20T04:51:46.525450+0000","last_active":"2023-12-20T04:51:47.513298+0000","last_peered":"2023-12-20T04:51:47.513298+0000","last_clean":"2023-12-20T04:51:47.513298+0000","last_became_active":"2023-12-20T04:51:46.525235+0000","last_became_peered":"2023-12-20T04:51:46.525235+0000","last_unstale":"2023-12-20T04:51:47.513298+0000","last_undegraded":"2023-12-20T04:51:47.513298+0000","last_fullsized":"2023-12-20T04:51:47.513298+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:28:36.652598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.8","version":"0'0","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.518749+0000","last_change":"2023-12-20T04:51:46.173593+0000","last_active":"2023-12-20T04:51:46.518749+0000","last_peered":"2023-12-20T04:51:46.518749+0000","last_clean":"2023-12-20T04:51:46.518749+0000","last_became_active":"2023-12-20T04:51:46.173361+0000","last_became_peered":"2023-12-20T04:51:46.173361+0000","last_unstale":"2023-12-20T04:51:46.518749+0000","last_undegraded":"2023-12-20T04:51:46.518749+0000","last_fullsized":"2023-12-20T04:51:46.518749+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:20:27.921265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.6","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939487+0000","last_change":"2023-12-20T04:51:46.528166+0000","last_active":"2023-12-20T04:51:47.939487+0000","last_peered":"2023-12-20T04:51:47.939487+0000","last_clean":"2023-12-20T04:51:47.939487+0000","last_became_active":"2023-12-20T04:51:46.527156+0000","last_became_peered":"2023-12-20T04:51:46.527156+0000","last_unstale":"2023-12-20T04:51:47.939487+0000","last_undegraded":"2023-12-20T04:51:47.939487+0000","last_fullsized":"2023-12-20T04:51:47.939487+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:51:08.346470+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.7","version":"168'2","reported_seq":13,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.532481+0000","last_change":"2023-12-20T04:51:46.176285+0000","last_active":"2023-12-20T04:51:46.532481+0000","last_peered":"2023-12-20T04:51:46.532481+0000","last_clean":"2023-12-20T04:51:46.532481+0000","last_became_active":"2023-12-20T04:51:46.175813+0000","last_became_peered":"2023-12-20T04:51:46.175813+0000","last_unstale":"2023-12-20T04:51:46.532481+0000","last_undegraded":"2023-12-20T04:51:46.532481+0000","last_fullsized":"2023-12-20T04:51:46.532481+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:11:39.764510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.7","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.786184+0000","last_change":"2023-12-20T04:51:46.528866+0000","last_active":"2023-12-20T04:51:47.786184+0000","last_peered":"2023-12-20T04:51:47.786184+0000","last_clean":"2023-12-20T04:51:47.786184+0000","last_became_active":"2023-12-20T04:51:46.528158+0000","last_became_peered":"2023-12-20T04:51:46.528158+0000","last_unstale":"2023-12-20T04:51:47.786184+0000","last_undegraded":"2023-12-20T04:51:47.786184+0000","last_fullsized":"2023-12-20T04:51:47.786184+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:16:34.410250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"20.6","version":"0'0","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.513643+0000","last_change":"2023-12-20T04:51:46.177075+0000","last_active":"2023-12-20T04:51:46.513643+0000","last_peered":"2023-12-20T04:51:46.513643+0000","last_clean":"2023-12-20T04:51:46.513643+0000","last_became_active":"2023-12-20T04:51:46.176857+0000","last_became_peered":"2023-12-20T04:51:46.176857+0000","last_unstale":"2023-12-20T04:51:46.513643+0000","last_undegraded":"2023-12-20T04:51:46.513643+0000","last_fullsized":"2023-12-20T04:51:46.513643+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:19:23.214753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.4","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.512700+0000","last_change":"2023-12-20T04:51:46.525044+0000","last_active":"2023-12-20T04:51:47.512700+0000","last_peered":"2023-12-20T04:51:47.512700+0000","last_clean":"2023-12-20T04:51:47.512700+0000","last_became_active":"2023-12-20T04:51:46.524838+0000","last_became_peered":"2023-12-20T04:51:46.524838+0000","last_unstale":"2023-12-20T04:51:47.512700+0000","last_undegraded":"2023-12-20T04:51:47.512700+0000","last_fullsized":"2023-12-20T04:51:47.512700+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:51:45.894139+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"20.5","version":"0'0","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.514811+0000","last_change":"2023-12-20T04:51:46.176737+0000","last_active":"2023-12-20T04:51:46.514811+0000","last_peered":"2023-12-20T04:51:46.514811+0000","last_clean":"2023-12-20T04:51:46.514811+0000","last_became_active":"2023-12-20T04:51:46.176526+0000","last_became_peered":"2023-12-20T04:51:46.176526+0000","last_unstale":"2023-12-20T04:51:46.514811+0000","last_undegraded":"2023-12-20T04:51:46.514811+0000","last_fullsized":"2023-12-20T04:51:46.514811+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:25:47.122533+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.5","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939014+0000","last_change":"2023-12-20T04:51:46.523767+0000","last_active":"2023-12-20T04:51:47.939014+0000","last_peered":"2023-12-20T04:51:47.939014+0000","last_clean":"2023-12-20T04:51:47.939014+0000","last_became_active":"2023-12-20T04:51:46.523529+0000","last_became_peered":"2023-12-20T04:51:46.523529+0000","last_unstale":"2023-12-20T04:51:47.939014+0000","last_undegraded":"2023-12-20T04:51:47.939014+0000","last_fullsized":"2023-12-20T04:51:47.939014+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:54:49.253438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"20.4","version":"0'0","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.516002+0000","last_change":"2023-12-20T04:51:46.174367+0000","last_active":"2023-12-20T04:51:46.516002+0000","last_peered":"2023-12-20T04:51:46.516002+0000","last_clean":"2023-12-20T04:51:46.516002+0000","last_became_active":"2023-12-20T04:51:46.174137+0000","last_became_peered":"2023-12-20T04:51:46.174137+0000","last_unstale":"2023-12-20T04:51:46.516002+0000","last_undegraded":"2023-12-20T04:51:46.516002+0000","last_fullsized":"2023-12-20T04:51:46.516002+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:04:30.065153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"21.2","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939303+0000","last_change":"2023-12-20T04:51:46.523888+0000","last_active":"2023-12-20T04:51:47.939303+0000","last_peered":"2023-12-20T04:51:47.939303+0000","last_clean":"2023-12-20T04:51:47.939303+0000","last_became_active":"2023-12-20T04:51:46.523531+0000","last_became_peered":"2023-12-20T04:51:46.523531+0000","last_unstale":"2023-12-20T04:51:47.939303+0000","last_undegraded":"2023-12-20T04:51:47.939303+0000","last_fullsized":"2023-12-20T04:51:47.939303+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:40:51.020509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"20.3","version":"0'0","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.516406+0000","last_change":"2023-12-20T04:51:46.171943+0000","last_active":"2023-12-20T04:51:46.516406+0000","last_peered":"2023-12-20T04:51:46.516406+0000","last_clean":"2023-12-20T04:51:46.516406+0000","last_became_active":"2023-12-20T04:51:46.171707+0000","last_became_peered":"2023-12-20T04:51:46.171707+0000","last_unstale":"2023-12-20T04:51:46.516406+0000","last_undegraded":"2023-12-20T04:51:46.516406+0000","last_fullsized":"2023-12-20T04:51:46.516406+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:39:57.468608+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"21.3","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939714+0000","last_change":"2023-12-20T04:51:46.520916+0000","last_active":"2023-12-20T04:51:47.939714+0000","last_peered":"2023-12-20T04:51:47.939714+0000","last_clean":"2023-12-20T04:51:47.939714+0000","last_became_active":"2023-12-20T04:51:46.520571+0000","last_became_peered":"2023-12-20T04:51:46.520571+0000","last_unstale":"2023-12-20T04:51:47.939714+0000","last_undegraded":"2023-12-20T04:51:47.939714+0000","last_fullsized":"2023-12-20T04:51:47.939714+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:19:24.221102+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.2","version":"0'0","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.523805+0000","last_change":"2023-12-20T04:51:46.179370+0000","last_active":"2023-12-20T04:51:46.523805+0000","last_peered":"2023-12-20T04:51:46.523805+0000","last_clean":"2023-12-20T04:51:46.523805+0000","last_became_active":"2023-12-20T04:51:46.179146+0000","last_became_peered":"2023-12-20T04:51:46.179146+0000","last_unstale":"2023-12-20T04:51:46.523805+0000","last_undegraded":"2023-12-20T04:51:46.523805+0000","last_fullsized":"2023-12-20T04:51:46.523805+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:25:57.319453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"21.0","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939701+0000","last_change":"2023-12-20T04:51:46.530453+0000","last_active":"2023-12-20T04:51:47.939701+0000","last_peered":"2023-12-20T04:51:47.939701+0000","last_clean":"2023-12-20T04:51:47.939701+0000","last_became_active":"2023-12-20T04:51:46.530176+0000","last_became_peered":"2023-12-20T04:51:46.530176+0000","last_unstale":"2023-12-20T04:51:47.939701+0000","last_undegraded":"2023-12-20T04:51:47.939701+0000","last_fullsized":"2023-12-20T04:51:47.939701+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:20:17.588804+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"20.1","version":"0'0","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.517736+0000","last_change":"2023-12-20T04:51:46.169350+0000","last_active":"2023-12-20T04:51:46.517736+0000","last_peered":"2023-12-20T04:51:46.517736+0000","last_clean":"2023-12-20T04:51:46.517736+0000","last_became_active":"2023-12-20T04:51:46.169123+0000","last_became_peered":"2023-12-20T04:51:46.169123+0000","last_unstale":"2023-12-20T04:51:46.517736+0000","last_undegraded":"2023-12-20T04:51:46.517736+0000","last_fullsized":"2023-12-20T04:51:46.517736+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:57:35.366758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"21.1","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.939578+0000","last_change":"2023-12-20T04:51:46.518553+0000","last_active":"2023-12-20T04:51:47.939578+0000","last_peered":"2023-12-20T04:51:47.939578+0000","last_clean":"2023-12-20T04:51:47.939578+0000","last_became_active":"2023-12-20T04:51:46.518323+0000","last_became_peered":"2023-12-20T04:51:46.518323+0000","last_unstale":"2023-12-20T04:51:47.939578+0000","last_undegraded":"2023-12-20T04:51:47.939578+0000","last_fullsized":"2023-12-20T04:51:47.939578+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:04:31.071502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"20.0","version":"0'0","reported_seq":11,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.513812+0000","last_change":"2023-12-20T04:51:46.176032+0000","last_active":"2023-12-20T04:51:46.513812+0000","last_peered":"2023-12-20T04:51:46.513812+0000","last_clean":"2023-12-20T04:51:46.513812+0000","last_became_active":"2023-12-20T04:51:46.175806+0000","last_became_peered":"2023-12-20T04:51:46.175806+0000","last_unstale":"2023-12-20T04:51:46.513812+0000","last_undegraded":"2023-12-20T04:51:46.513812+0000","last_fullsized":"2023-12-20T04:51:46.513812+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:16:33.403901+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"21.14","version":"0'0","reported_seq":10,"reported_epoch":169,"state":"active+clean","last_fresh":"2023-12-20T04:51:47.513086+0000","last_change":"2023-12-20T04:51:46.524634+0000","last_active":"2023-12-20T04:51:47.513086+0000","last_peered":"2023-12-20T04:51:47.513086+0000","last_clean":"2023-12-20T04:51:47.513086+0000","last_became_active":"2023-12-20T04:51:46.524426+0000","last_became_peered":"2023-12-20T04:51:46.524426+0000","last_unstale":"2023-12-20T04:51:47.513086+0000","last_undegraded":"2023-12-20T04:51:47.513086+0000","last_fullsized":"2023-12-20T04:51:47.513086+0000","mapping_epoch":167,"log_start":"0'0","ondisk_log_start":"0'0","created":167,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:46.162726+0000","last_clean_scrub_stamp":"2023-12-20T04:51:46.162726+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:39:51.926457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"20.15","version":"168'3","reported_seq":14,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.533262+0000","last_change":"2023-12-20T04:51:46.173707+0000","last_active":"2023-12-20T04:51:46.533262+0000","last_peered":"2023-12-20T04:51:46.533262+0000","last_clean":"2023-12-20T04:51:46.533262+0000","last_became_active":"2023-12-20T04:51:46.173005+0000","last_became_peered":"2023-12-20T04:51:46.173005+0000","last_unstale":"2023-12-20T04:51:46.533262+0000","last_undegraded":"2023-12-20T04:51:46.533262+0000","last_fullsized":"2023-12-20T04:51:46.533262+0000","mapping_epoch":166,"log_start":"0'0","ondisk_log_start":"0'0","created":166,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:51:45.156376+0000","last_clean_scrub_stamp":"2023-12-20T04:51:45.156376+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:54:35.761511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":294,"reported_epoch":168,"state":"active+clean","last_fresh":"2023-12-20T04:51:46.525879+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:51:46.525879+0000","last_peered":"2023-12-20T04:51:46.525879+0000","last_clean":"2023-12-20T04:51:46.525879+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:51:46.525879+0000","last_undegraded":"2023-12-20T04:51:46.525879+0000","last_fullsized":"2023-12-20T04:51:46.525879+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":21,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":20,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":44,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":38,"ondisk_log_size":38,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574961,"num_pgs":32,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1499,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193813,"statfs":{"total":200000000,"available":198464925,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.55800000000000005,"15min":0.54000000000000004},"min":{"1min":0.40600000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.74399999999999999,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.503},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.53800000000000003,"15min":0.52600000000000002},"min":{"1min":0.42999999999999999,"5min":0.25600000000000001,"15min":0.25600000000000001},"max":{"1min":0.70999999999999996,"5min":0.79200000000000004,"15min":0.86299999999999999},"last":0.54000000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59499999999999997,"5min":0.55500000000000005,"15min":0.55100000000000005},"min":{"1min":0.47799999999999998,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.98799999999999999},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.621,"5min":0.58999999999999997,"15min":0.57899999999999996},"min":{"1min":0.376,"5min":0.374,"15min":0.374},"max":{"1min":0.78500000000000003,"5min":0.79500000000000004,"15min":1.0269999999999999},"last":0.61899999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.55300000000000005,"15min":0.53900000000000003},"min":{"1min":0.40300000000000002,"5min":0.37,"15min":0.37},"max":{"1min":0.70599999999999996,"5min":0.97699999999999998,"15min":1.0069999999999999},"last":0.56699999999999995},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.54500000000000004,"15min":0.54500000000000004},"min":{"1min":0.41099999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.75700000000000001,"5min":0.75700000000000001,"15min":0.78000000000000003},"last":0.64100000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.438,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.72799999999999998,"5min":1.048,"15min":1.048},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.56999999999999995,"15min":0.56499999999999995},"min":{"1min":0.46700000000000003,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.74199999999999999,"5min":0.753,"15min":0.76900000000000002},"last":0.67900000000000005}]},{"osd":4,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.48099999999999998,"15min":0.48399999999999999},"min":{"1min":0.28499999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.68999999999999995,"5min":0.71299999999999997,"15min":0.753},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.51400000000000001,"5min":0.501,"15min":0.49399999999999999},"min":{"1min":0.29599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.77400000000000002,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.71799999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.47599999999999998,"15min":0.48699999999999999},"min":{"1min":0.35099999999999998,"5min":0.255,"15min":0.255},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73799999999999999},"last":0.69499999999999995},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.53000000000000003,"15min":0.53900000000000003},"min":{"1min":0.39100000000000001,"5min":0.313,"15min":0.313},"max":{"1min":0.78500000000000003,"5min":0.85299999999999998,"15min":0.85299999999999998},"last":0.75900000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.52500000000000002,"15min":0.54100000000000004},"min":{"1min":0.44400000000000001,"5min":0.33300000000000002,"15min":0.32500000000000001},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.89800000000000002},"last":0.73299999999999998},{"interface":"front","average":{"1min":0.57599999999999996,"5min":0.54900000000000004,"15min":0.54100000000000004},"min":{"1min":0.40000000000000002,"5min":0.33200000000000002,"15min":0.28899999999999998},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.747}]}]},{"osd":6,"up_from":13,"seq":55834574962,"num_pgs":27,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":922,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055799,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.55600000000000005,"15min":0.51200000000000001},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.70299999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68400000000000005,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.48199999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.56699999999999995,"15min":0.53900000000000003},"min":{"1min":0.376,"5min":0.32100000000000001,"15min":0.30099999999999999},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.60599999999999998,"5min":0.57999999999999996,"15min":0.57699999999999996},"min":{"1min":0.47099999999999997,"5min":0.315,"15min":0.315},"max":{"1min":0.746,"5min":0.78600000000000003,"15min":0.78600000000000003},"last":0.56699999999999995}]},{"osd":2,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.56000000000000005,"5min":0.54000000000000004,"15min":0.51700000000000002},"min":{"1min":0.38200000000000001,"5min":0.29999999999999999,"15min":0.27000000000000002},"max":{"1min":0.753,"5min":0.753,"15min":0.753},"last":0.45100000000000001},{"interface":"front","average":{"1min":0.53900000000000003,"5min":0.54300000000000004,"15min":0.53800000000000003},"min":{"1min":0.36499999999999999,"5min":0.34599999999999997,"15min":0.32600000000000001},"max":{"1min":0.67600000000000005,"5min":0.78400000000000003,"15min":0.78400000000000003},"last":0.66900000000000004}]},{"osd":3,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.54500000000000004,"5min":0.54900000000000004,"15min":0.51400000000000001},"min":{"1min":0.40000000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.73199999999999998,"5min":0.752,"15min":0.77800000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57299999999999995,"5min":0.55700000000000005,"15min":0.55800000000000005},"min":{"1min":0.45300000000000001,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.71899999999999997,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.502}]},{"osd":4,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.42799999999999999,"5min":0.46999999999999997,"15min":0.497},"min":{"1min":0.33100000000000002,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.66900000000000004,"5min":0.81899999999999995,"15min":0.81899999999999995},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.46400000000000002,"5min":0.48799999999999999,"15min":0.49199999999999999},"min":{"1min":0.34899999999999998,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.77400000000000002,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.68300000000000005}]},{"osd":5,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45000000000000001,"5min":0.48799999999999999,"15min":0.50900000000000001},"min":{"1min":0.34899999999999998,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.59799999999999998},{"interface":"front","average":{"1min":0.48299999999999998,"5min":0.52500000000000002,"15min":0.54900000000000004},"min":{"1min":0.377,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.68700000000000006,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.73699999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:50:51 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.52600000000000002,"15min":0.54300000000000004},"min":{"1min":0.32400000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.76500000000000001},"last":0.71399999999999997},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.57699999999999996,"15min":0.58099999999999996},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.79800000000000004,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.65500000000000003}]}]},{"osd":5,"up_from":13,"seq":55834574961,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":921,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055923,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.54900000000000004,"15min":0.52200000000000002},"min":{"1min":0.44,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.70299999999999996,"5min":0.748,"15min":0.748},"last":0.42899999999999999},{"interface":"front","average":{"1min":0.60299999999999998,"5min":0.57699999999999996,"15min":0.56499999999999995},"min":{"1min":0.503,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.70199999999999996,"5min":0.82299999999999995,"15min":0.82299999999999995},"last":0.55600000000000005}]},{"osd":1,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.59599999999999997,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.433,"5min":0.26000000000000001,"15min":0.26000000000000001},"max":{"1min":0.71199999999999997,"5min":0.80600000000000005,"15min":0.82099999999999995},"last":0.48299999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.57199999999999995,"15min":0.57699999999999996},"min":{"1min":0.441,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":0.72199999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.58299999999999996}]},{"osd":2,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.52700000000000002,"15min":0.51700000000000002},"min":{"1min":0.40600000000000003,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.67800000000000005,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.56299999999999994,"5min":0.53900000000000003,"15min":0.52400000000000002},"min":{"1min":0.46200000000000002,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.72499999999999998,"5min":0.76600000000000001,"15min":0.77100000000000002},"last":0.52400000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.52400000000000002,"15min":0.52800000000000002},"min":{"1min":0.441,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.80900000000000005},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.55500000000000005,"15min":0.54700000000000004},"min":{"1min":0.39800000000000002,"5min":0.312,"15min":0.312},"max":{"1min":0.73599999999999999,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.57099999999999995}]},{"osd":4,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.44,"5min":0.45200000000000001,"15min":0.48899999999999999},"min":{"1min":0.31900000000000001,"5min":0.249,"15min":0.249},"max":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.81899999999999995},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.433,"5min":0.46500000000000002,"15min":0.47599999999999998},"min":{"1min":0.32400000000000001,"5min":0.29799999999999999,"15min":0.29399999999999998},"max":{"1min":0.749,"5min":0.75700000000000001,"15min":0.75700000000000001},"last":0.35499999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.46100000000000002,"5min":0.47299999999999998,"15min":0.497},"min":{"1min":0.311,"5min":0.254,"15min":0.254},"max":{"1min":0.70699999999999996,"5min":0.73299999999999998,"15min":0.85299999999999998},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.51300000000000001,"15min":0.53400000000000003},"min":{"1min":0.33900000000000002,"5min":0.33900000000000002,"15min":0.31},"max":{"1min":0.77000000000000002,"5min":0.78600000000000003,"15min":0.83999999999999997},"last":0.39600000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:50:55 2023","interfaces":[{"interface":"back","average":{"1min":0.47599999999999998,"5min":0.498,"15min":0.51800000000000002},"min":{"1min":0.30099999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.78400000000000003,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.54100000000000004},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.56399999999999995,"15min":0.59499999999999997},"min":{"1min":0.35999999999999999,"5min":0.311,"15min":0.311},"max":{"1min":0.76100000000000001,"5min":0.77600000000000002,"15min":0.98599999999999999},"last":0.44900000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574961,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":921,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055945,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.51700000000000002,"15min":0.52100000000000002},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.19700000000000001},"max":{"1min":0.85799999999999998,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.433},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.54300000000000004,"15min":0.52500000000000002},"min":{"1min":0.32400000000000001,"5min":0.251,"15min":0.251},"max":{"1min":0.875,"5min":0.875,"15min":0.875},"last":0.35899999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.52900000000000003,"15min":0.51900000000000002},"min":{"1min":0.36599999999999999,"5min":0.246,"15min":0.246},"max":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.53300000000000003,"15min":0.52700000000000002},"min":{"1min":0.35999999999999999,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.50600000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.53600000000000003,"15min":0.55000000000000004},"min":{"1min":0.316,"5min":0.313,"15min":0.313},"max":{"1min":0.79400000000000004,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.58199999999999996,"5min":0.53700000000000003,"15min":0.54600000000000004},"min":{"1min":0.33300000000000002,"5min":0.33300000000000002,"15min":0.23400000000000001},"max":{"1min":0.74199999999999999,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.39500000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.63600000000000001,"5min":0.56899999999999995,"15min":0.55900000000000005},"min":{"1min":0.35099999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.92400000000000004,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.47399999999999998},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.58199999999999996,"15min":0.58499999999999996},"min":{"1min":0.34300000000000003,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.91000000000000003},"last":0.54000000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.44800000000000001,"15min":0.46500000000000002},"min":{"1min":0.23000000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.75900000000000001,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.49099999999999999},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48999999999999999,"15min":0.5},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.57799999999999996}]},{"osd":6,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.48199999999999998,"15min":0.497},"min":{"1min":0.36899999999999999,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.69999999999999996,"5min":0.73099999999999998,"15min":0.82399999999999995},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.51300000000000001,"15min":0.52400000000000002},"min":{"1min":0.28799999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.78200000000000003,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.55000000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:50:50 2023","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.51800000000000002},"min":{"1min":0.30599999999999999,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.76900000000000002,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53700000000000003,"15min":0.54300000000000004},"min":{"1min":0.34200000000000003,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.59199999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574961,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":922,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055855,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38,"5min":0.34999999999999998,"15min":0.34000000000000002},"min":{"1min":0.24099999999999999,"5min":0.19800000000000001,"15min":0.193},"max":{"1min":0.49199999999999999,"5min":0.629,"15min":0.629},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.41299999999999998,"5min":0.38,"15min":0.35999999999999999},"min":{"1min":0.33000000000000002,"5min":0.25800000000000001,"15min":0.246},"max":{"1min":0.56799999999999995,"5min":0.64000000000000001,"15min":0.64000000000000001},"last":0.34200000000000003}]},{"osd":1,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.39000000000000001,"5min":0.33900000000000002,"15min":0.32400000000000001},"min":{"1min":0.28999999999999998,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.53800000000000003,"5min":0.56399999999999995,"15min":0.56799999999999995},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.38900000000000001,"5min":0.36399999999999999,"15min":0.34300000000000003},"min":{"1min":0.28599999999999998,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.55800000000000005,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.32800000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.374,"5min":0.34899999999999998,"15min":0.34599999999999997},"min":{"1min":0.28999999999999998,"5min":0.22600000000000001,"15min":0.21199999999999999},"max":{"1min":0.49399999999999999,"5min":0.53100000000000003,"15min":0.64900000000000002},"last":0.314},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39200000000000002,"15min":0.379},"min":{"1min":0.313,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.55800000000000005,"5min":0.63600000000000001,"15min":0.63600000000000001},"last":0.28599999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.57199999999999995,"15min":0.55000000000000004},"min":{"1min":0.46300000000000002,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.80200000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.45300000000000001},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.58599999999999997,"15min":0.56599999999999995},"min":{"1min":0.42399999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.81699999999999995,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.49399999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.58899999999999997,"15min":0.56699999999999995},"min":{"1min":0.42099999999999999,"5min":0.40000000000000002,"15min":0.31},"max":{"1min":0.77400000000000002,"5min":0.872,"15min":0.872},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.59099999999999997,"15min":0.56699999999999995},"min":{"1min":0.48999999999999999,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.77900000000000003,"5min":0.91500000000000004,"15min":0.91500000000000004},"last":0.437}]},{"osd":6,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.64100000000000001,"5min":0.58999999999999997,"15min":0.58199999999999996},"min":{"1min":0.45300000000000001,"5min":0.33900000000000002,"15min":0.33900000000000002},"max":{"1min":0.78100000000000003,"5min":0.88200000000000001,"15min":0.88200000000000001},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.61899999999999999,"5min":0.59499999999999997,"15min":0.56799999999999995},"min":{"1min":0.51000000000000001,"5min":0.37,"15min":0.37},"max":{"1min":0.73599999999999999,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.53700000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.59899999999999998,"15min":0.57299999999999995},"min":{"1min":0.442,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.78600000000000003,"5min":0.879,"15min":0.879},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.66800000000000004,"5min":0.61699999999999999,"15min":0.58699999999999997},"min":{"1min":0.50800000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.78000000000000003,"5min":0.96099999999999997,"15min":0.96099999999999997},"last":0.53000000000000003}]}]},{"osd":2,"up_from":13,"seq":55834574961,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":923,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194388,"statfs":{"total":200000000,"available":199054311,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.34499999999999997,"15min":0.311},"min":{"1min":0.23599999999999999,"5min":0.20899999999999999,"15min":0.18099999999999999},"max":{"1min":0.54800000000000004,"5min":0.61499999999999999,"15min":0.72699999999999998},"last":0.28100000000000003},{"interface":"front","average":{"1min":0.41599999999999998,"5min":0.376,"15min":0.35599999999999998},"min":{"1min":0.33700000000000002,"5min":0.25800000000000001,"15min":0.17699999999999999},"max":{"1min":0.53500000000000003,"5min":0.53700000000000003,"15min":2.0539999999999998},"last":0.30099999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.36599999999999999,"15min":0.34100000000000003},"min":{"1min":0.23400000000000001,"5min":0.23400000000000001,"15min":0.17999999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.83099999999999996},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.42999999999999999,"5min":0.38500000000000001,"15min":0.35999999999999999},"min":{"1min":0.30199999999999999,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.58999999999999997},"last":0.315}]},{"osd":3,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.40400000000000003,"15min":0.372},"min":{"1min":0.36599999999999999,"5min":0.247,"15min":0.216},"max":{"1min":0.59199999999999997,"5min":0.68100000000000005,"15min":0.995},"last":0.26200000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.40200000000000002,"15min":0.379},"min":{"1min":0.26100000000000001,"5min":0.218,"15min":0.218},"max":{"1min":0.57199999999999995,"5min":0.64400000000000002,"15min":0.76600000000000001},"last":0.34499999999999997}]},{"osd":4,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.57999999999999996,"15min":0.57099999999999995},"min":{"1min":0.36899999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.80700000000000005,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.502},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.57799999999999996,"15min":0.57299999999999995},"min":{"1min":0.41599999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.82499999999999996,"5min":0.94699999999999995,"15min":2.347},"last":0.40899999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.58399999999999996,"15min":0.57899999999999996},"min":{"1min":0.35399999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.83299999999999996,"5min":0.997,"15min":0.997},"last":0.51500000000000001},{"interface":"front","average":{"1min":0.622,"5min":0.58099999999999996,"15min":0.55900000000000005},"min":{"1min":0.42499999999999999,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.83999999999999997,"15min":0.83999999999999997},"last":0.56100000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.60899999999999999,"5min":0.57499999999999996,"15min":0.57599999999999996},"min":{"1min":0.443,"5min":0.371,"15min":0.371},"max":{"1min":0.877,"5min":0.877,"15min":2.274},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.622,"5min":0.59199999999999997,"15min":0.57799999999999996},"min":{"1min":0.38,"5min":0.38,"15min":0.373},"max":{"1min":0.81000000000000005,"5min":0.91100000000000003,"15min":1.0289999999999999},"last":0.46400000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:50:54 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57699999999999996,"15min":0.57399999999999995},"min":{"1min":0.38900000000000001,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.82499999999999996,"5min":0.82999999999999996,"15min":2.3090000000000002},"last":0.56999999999999995},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.59199999999999997,"15min":0.58299999999999996},"min":{"1min":0.433,"5min":0.379,"15min":0.379},"max":{"1min":0.80800000000000005,"5min":0.86699999999999999,"15min":1.0549999999999999},"last":0.48699999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574962,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":922,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194390,"statfs":{"total":200000000,"available":199055363,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36799999999999999,"5min":0.34300000000000003,"15min":0.308},"min":{"1min":0.248,"5min":0.20899999999999999,"15min":0.16400000000000001},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.35099999999999998},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.379,"15min":0.34699999999999998},"min":{"1min":0.30399999999999999,"5min":0.23699999999999999,"15min":0.22700000000000001},"max":{"1min":0.53500000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.34300000000000003}]},{"osd":2,"last update":"Wed Dec 20 04:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.35499999999999998,"15min":0.32300000000000001},"min":{"1min":0.23499999999999999,"5min":0.20599999999999999,"15min":0.19500000000000001},"max":{"1min":0.55700000000000005,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.39200000000000002,"15min":0.36499999999999999},"min":{"1min":0.27600000000000002,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":0.57099999999999995,"5min":0.57099999999999995,"15min":0.57299999999999995},"last":0.372}]},{"osd":3,"last update":"Wed Dec 20 04:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.41399999999999998,"15min":0.377},"min":{"1min":0.221,"5min":0.221,"15min":0.191},"max":{"1min":0.60599999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.32200000000000001},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.375,"15min":0.36099999999999999},"min":{"1min":0.29299999999999998,"5min":0.22500000000000001,"15min":0.20399999999999999},"max":{"1min":0.58899999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.31}]},{"osd":4,"last update":"Wed Dec 20 04:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.61099999999999999,"5min":0.58999999999999997,"15min":0.57099999999999995},"min":{"1min":0.39500000000000002,"5min":0.35599999999999998,"15min":0.312},"max":{"1min":0.78700000000000003,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.63200000000000001,"5min":0.59099999999999997,"15min":0.56399999999999995},"min":{"1min":0.47199999999999998,"5min":0.38900000000000001,"15min":0.34899999999999998},"max":{"1min":0.90900000000000003,"5min":0.90900000000000003,"15min":1.002},"last":0.56200000000000006}]},{"osd":5,"last update":"Wed Dec 20 04:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.626,"5min":0.59399999999999997,"15min":0.56799999999999995},"min":{"1min":0.42599999999999999,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.78100000000000003,"5min":0.79200000000000004,"15min":0.86099999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.56200000000000006},"min":{"1min":0.45400000000000001,"5min":0.38300000000000001,"15min":0.317},"max":{"1min":0.89100000000000001,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.56899999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.627,"5min":0.59299999999999997,"15min":0.56899999999999995},"min":{"1min":0.46200000000000002,"5min":0.38300000000000001,"15min":0.36899999999999999},"max":{"1min":0.79800000000000004,"5min":0.92400000000000004,"15min":1.038},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.64400000000000002,"5min":0.59799999999999998,"15min":0.57499999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.39100000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.66300000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:51:50 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.63100000000000001,"15min":0.60399999999999998},"min":{"1min":0.51400000000000001,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.67100000000000004,"5min":0.63500000000000001,"15min":0.61499999999999999},"min":{"1min":0.47299999999999998,"5min":0.41899999999999998,"15min":0.376},"max":{"1min":0.878,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.68899999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574961,"num_pgs":21,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1500,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193812,"statfs":{"total":200000000,"available":198463979,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.34399999999999997,"15min":0.32000000000000001},"min":{"1min":0.254,"5min":0.189,"15min":0.184},"max":{"1min":0.51300000000000001,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.28599999999999998},{"interface":"front","average":{"1min":0.35699999999999998,"5min":0.35299999999999998,"15min":0.32800000000000001},"min":{"1min":0.21299999999999999,"5min":0.20699999999999999,"15min":0.184},"max":{"1min":0.57899999999999996,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.29999999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38500000000000001,"5min":0.373,"15min":0.36099999999999999},"min":{"1min":0.22800000000000001,"5min":0.22800000000000001,"15min":0.218},"max":{"1min":0.57399999999999995,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.371,"5min":0.38100000000000001,"15min":0.35799999999999998},"min":{"1min":0.27600000000000002,"5min":0.26500000000000001,"15min":0.23100000000000001},"max":{"1min":0.52800000000000002,"5min":0.56299999999999994,"15min":0.622},"last":0.247}]},{"osd":3,"last update":"Wed Dec 20 04:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.378,"5min":0.36699999999999999,"15min":0.34000000000000002},"min":{"1min":0.24399999999999999,"5min":0.224,"15min":0.224},"max":{"1min":0.56999999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.35399999999999998},{"interface":"front","average":{"1min":0.41899999999999998,"5min":0.40100000000000002,"15min":0.38},"min":{"1min":0.316,"5min":0.27600000000000002,"15min":0.27400000000000002},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.316}]},{"osd":4,"last update":"Wed Dec 20 04:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.56999999999999995,"5min":0.57099999999999995,"15min":0.53800000000000003},"min":{"1min":0.41899999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.81200000000000006,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.58099999999999996,"5min":0.57099999999999995,"15min":0.54900000000000004},"min":{"1min":0.377,"5min":0.317,"15min":0.317},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51500000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.57199999999999995,"15min":0.53800000000000003},"min":{"1min":0.40799999999999997,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":0.86499999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.59499999999999997,"15min":0.56299999999999994},"min":{"1min":0.42999999999999999,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.79300000000000004,"5min":0.83299999999999996,"15min":0.86199999999999999},"last":0.68300000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.60699999999999998,"15min":0.59199999999999997},"min":{"1min":0.46100000000000002,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.88100000000000001,"5min":0.88200000000000001,"15min":0.89600000000000002},"last":0.70799999999999996},{"interface":"front","average":{"1min":0.61499999999999999,"5min":0.61699999999999999,"15min":0.59399999999999997},"min":{"1min":0.48499999999999999,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84999999999999998,"5min":0.90000000000000002,"15min":0.90000000000000002},"last":0.56799999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:51:47 2023","interfaces":[{"interface":"back","average":{"1min":0.60299999999999998,"5min":0.59599999999999997,"15min":0.56599999999999995},"min":{"1min":0.44400000000000001,"5min":0.379,"15min":0.375},"max":{"1min":0.79100000000000004,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59899999999999998,"15min":0.58199999999999996},"min":{"1min":0.44400000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.61799999999999999}]}]}],"pool_statfs":[]}} 2023-12-20T04:51:54.176 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-20T04:51:54.176 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-20T04:51:54.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.316+0000 7f12d4896640 1 Processor -- start 2023-12-20T04:51:54.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.316+0000 7f12d4896640 1 -- start start 2023-12-20T04:51:54.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.316+0000 7f12d4896640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f12d015aee0 0x7f12d015eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:54.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.316+0000 7f12d4896640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f12d00cdd80 0x7f12d00d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:54.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.316+0000 7f12d4896640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f12d00d0130 con 0x7f12d00cb2b0 2023-12-20T04:51:54.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.316+0000 7f12d4896640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d015f370 con 0x7f12d00cdd80 2023-12-20T04:51:54.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.316+0000 7f12d4896640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f12d015f650 con 0x7f12d015aee0 2023-12-20T04:51:54.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.317+0000 7f12ced9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f12d00cdd80 0x7f12d00d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:54.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.317+0000 7f12ced9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f12d00cdd80 0x7f12d00d08a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42652/0 (socket says 172.21.15.132:42652) 2023-12-20T04:51:54.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.317+0000 7f12ced9d640 1 -- 172.21.15.132:0/2607236155 learned_addr learned my addr 172.21.15.132:0/2607236155 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:54.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.317+0000 7f12ce59c640 1 --2- 172.21.15.132:0/2607236155 >> v2:172.21.15.187:3300/0 conn(0x7f12d015aee0 0x7f12d015eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:54.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.317+0000 7f12ced9d640 1 -- 172.21.15.132:0/2607236155 >> v2:172.21.15.187:3300/0 conn(0x7f12d015aee0 msgr2=0x7f12d015eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:54.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.317+0000 7f12ced9d640 1 --2- 172.21.15.132:0/2607236155 >> v2:172.21.15.187:3300/0 conn(0x7f12d015aee0 0x7f12d015eb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.317+0000 7f12ced9d640 1 -- 172.21.15.132:0/2607236155 >> v1:172.21.15.187:6789/0 conn(0x7f12d00cb2b0 legacy=0x7f12d00cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:54.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.317+0000 7f12ced9d640 1 -- 172.21.15.132:0/2607236155 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12d015f930 con 0x7f12d00cdd80 2023-12-20T04:51:54.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.318+0000 7f12ced9d640 1 --2- 172.21.15.132:0/2607236155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d00cdd80 0x7f12d00d08a0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009e50 tx=0x7f12c802bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec880c75fdba0fc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:54.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.318+0000 7f12cdd9b640 1 -- 172.21.15.132:0/2607236155 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c802ca80 con 0x7f12d00cdd80 2023-12-20T04:51:54.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.318+0000 7f12cdd9b640 1 -- 172.21.15.132:0/2607236155 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12c802cbe0 con 0x7f12d00cdd80 2023-12-20T04:51:54.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.318+0000 7f12cdd9b640 1 -- 172.21.15.132:0/2607236155 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12c80343f0 con 0x7f12d00cdd80 2023-12-20T04:51:54.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.318+0000 7f12d4896640 1 -- 172.21.15.132:0/2607236155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d00cdd80 msgr2=0x7f12d00d08a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:54.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.318+0000 7f12d4896640 1 --2- 172.21.15.132:0/2607236155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d00cdd80 0x7f12d00d08a0 secure :-1 s=READY pgs=1670 cs=0 l=1 rev1=1 crypto rx=0x7f12c8009e50 tx=0x7f12c802bee0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.321 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.318+0000 7f12d4896640 1 -- 172.21.15.132:0/2607236155 shutdown_connections 2023-12-20T04:51:54.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.318+0000 7f12d4896640 1 --2- 172.21.15.132:0/2607236155 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d00cdd80 0x7f12d00d08a0 unknown :-1 s=CLOSED pgs=1670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.318+0000 7f12d4896640 1 --2- 172.21.15.132:0/2607236155 >> v2:172.21.15.187:3300/0 conn(0x7f12d015aee0 0x7f12d015eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.318+0000 7f12d4896640 1 -- 172.21.15.132:0/2607236155 >> 172.21.15.132:0/2607236155 conn(0x7f12d0072c60 msgr2=0x7f12d0073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:54.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.318+0000 7f12d4896640 1 -- 172.21.15.132:0/2607236155 shutdown_connections 2023-12-20T04:51:54.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.318+0000 7f12d4896640 1 -- 172.21.15.132:0/2607236155 wait complete. 2023-12-20T04:51:54.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.320+0000 7f12d4896640 1 Processor -- start 2023-12-20T04:51:54.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.320+0000 7f12d4896640 1 -- start start 2023-12-20T04:51:54.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.320+0000 7f12d4896640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12d00cb2b0 0x7f12d00a9e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:54.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.320+0000 7f12d4896640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d00cdd80 0x7f12d00a84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:54.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.320+0000 7f12d4896640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12d015aee0 0x7f12d0158e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:54.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.320+0000 7f12d4896640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d00a9a50 con 0x7f12d00cdd80 2023-12-20T04:51:54.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.320+0000 7f12d4896640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f12d00aa3b0 con 0x7f12d00cb2b0 2023-12-20T04:51:54.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.320+0000 7f12d4896640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f12d00a8dd0 con 0x7f12d015aee0 2023-12-20T04:51:54.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.320+0000 7f12c7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d00cdd80 0x7f12d00a84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:54.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.320+0000 7f12c7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d00cdd80 0x7f12d00a84d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42654/0 (socket says 172.21.15.132:42654) 2023-12-20T04:51:54.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.320+0000 7f12c7fff640 1 -- 172.21.15.132:0/3587368486 learned_addr learned my addr 172.21.15.132:0/3587368486 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:54.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.321+0000 7f12ce59c640 1 --2- 172.21.15.132:0/3587368486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12d00cb2b0 0x7f12d00a9e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:54.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.321+0000 7f12ced9d640 1 --2- 172.21.15.132:0/3587368486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12d015aee0 0x7f12d0158e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:54.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.321+0000 7f12c7fff640 1 -- 172.21.15.132:0/3587368486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12d015aee0 msgr2=0x7f12d0158e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:54.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.321+0000 7f12c7fff640 1 --2- 172.21.15.132:0/3587368486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12d015aee0 0x7f12d0158e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.321+0000 7f12c7fff640 1 -- 172.21.15.132:0/3587368486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12d00cb2b0 msgr2=0x7f12d00a9e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:54.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.321+0000 7f12c7fff640 1 --2- 172.21.15.132:0/3587368486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12d00cb2b0 0x7f12d00a9e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.321+0000 7f12c7fff640 1 -- 172.21.15.132:0/3587368486 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f12c8009b30 con 0x7f12d00cdd80 2023-12-20T04:51:54.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.321+0000 7f12ce59c640 1 --2- 172.21.15.132:0/3587368486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12d00cb2b0 0x7f12d00a9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:54.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.321+0000 7f12ced9d640 1 --2- 172.21.15.132:0/3587368486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12d015aee0 0x7f12d0158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:54.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.321+0000 7f12c7fff640 1 --2- 172.21.15.132:0/3587368486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d00cdd80 0x7f12d00a84d0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f12b800b3f0 tx=0x7f12b800b8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:54.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.321+0000 7f12c6ffd640 1 -- 172.21.15.132:0/3587368486 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b8011830 con 0x7f12d00cdd80 2023-12-20T04:51:54.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.321+0000 7f12c6ffd640 1 -- 172.21.15.132:0/3587368486 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f12b8011990 con 0x7f12d00cdd80 2023-12-20T04:51:54.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.321+0000 7f12c6ffd640 1 -- 172.21.15.132:0/3587368486 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f12b8011d40 con 0x7f12d00cdd80 2023-12-20T04:51:54.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.321+0000 7f12d4896640 1 -- 172.21.15.132:0/3587368486 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f12d00a90b0 con 0x7f12d00cdd80 2023-12-20T04:51:54.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.321+0000 7f12d4896640 1 -- 172.21.15.132:0/3587368486 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f12d00a9670 con 0x7f12d00cdd80 2023-12-20T04:51:54.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.322+0000 7f12d4896640 1 -- 172.21.15.132:0/3587368486 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f12d004e840 con 0x7f12d00cdd80 2023-12-20T04:51:54.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.322+0000 7f12c6ffd640 1 -- 172.21.15.132:0/3587368486 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f12b801a400 con 0x7f12d00cdd80 2023-12-20T04:51:54.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.323+0000 7f12c6ffd640 1 --2- 172.21.15.132:0/3587368486 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f12b006a430 0x7f12b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:54.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.323+0000 7f12c6ffd640 1 -- 172.21.15.132:0/3587368486 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f12b80887a0 con 0x7f12d00cdd80 2023-12-20T04:51:54.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.323+0000 7f12ce59c640 1 --2- 172.21.15.132:0/3587368486 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f12b006a430 0x7f12b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:54.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.323+0000 7f12ce59c640 1 --2- 172.21.15.132:0/3587368486 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f12b006a430 0x7f12b006c8f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f12c0006fd0 tx=0x7f12c0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:54.329 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.327+0000 7f12c6ffd640 1 -- 172.21.15.132:0/3587368486 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f12b8053d90 con 0x7f12d00cdd80 2023-12-20T04:51:54.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.557+0000 7f12d4896640 1 -- 172.21.15.132:0/3587368486 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7f12d00b2890 con 0x7f12d00cdd80 2023-12-20T04:51:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.561+0000 7f12c6ffd640 1 -- 172.21.15.132:0/3587368486 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v22) v1 ==== 190+0+0 (secure 0 0 0) 0x7f12b80573b0 con 0x7f12d00cdd80 2023-12-20T04:51:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.0 2023-12-20T04:51:54.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.563+0000 7f12d4896640 1 -- 172.21.15.132:0/3587368486 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f12b006a430 msgr2=0x7f12b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:54.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.563+0000 7f12d4896640 1 --2- 172.21.15.132:0/3587368486 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f12b006a430 0x7f12b006c8f0 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7f12c0006fd0 tx=0x7f12c0008040 comp rx=0 tx=0).stop 2023-12-20T04:51:54.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.563+0000 7f12d4896640 1 -- 172.21.15.132:0/3587368486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d00cdd80 msgr2=0x7f12d00a84d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:54.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.563+0000 7f12d4896640 1 --2- 172.21.15.132:0/3587368486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d00cdd80 0x7f12d00a84d0 secure :-1 s=READY pgs=1671 cs=0 l=1 rev1=1 crypto rx=0x7f12b800b3f0 tx=0x7f12b800b8b0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.563+0000 7f12d4896640 1 -- 172.21.15.132:0/3587368486 shutdown_connections 2023-12-20T04:51:54.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.563+0000 7f12d4896640 1 --2- 172.21.15.132:0/3587368486 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f12b006a430 0x7f12b006c8f0 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.563+0000 7f12d4896640 1 --2- 172.21.15.132:0/3587368486 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f12d015aee0 0x7f12d0158e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.563+0000 7f12d4896640 1 --2- 172.21.15.132:0/3587368486 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f12d00cdd80 0x7f12d00a84d0 unknown :-1 s=CLOSED pgs=1671 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.563+0000 7f12d4896640 1 --2- 172.21.15.132:0/3587368486 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f12d00cb2b0 0x7f12d00a9e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.563+0000 7f12d4896640 1 -- 172.21.15.132:0/3587368486 >> 172.21.15.132:0/3587368486 conn(0x7f12d0072c60 msgr2=0x7f12d00ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:54.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.563+0000 7f12d4896640 1 -- 172.21.15.132:0/3587368486 shutdown_connections 2023-12-20T04:51:54.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.563+0000 7f12d4896640 1 -- 172.21.15.132:0/3587368486 wait complete. 2023-12-20T04:51:54.576 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:51:54.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.674+0000 7f1be4ece640 1 Processor -- start 2023-12-20T04:51:54.676 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.674+0000 7f1be4ece640 1 -- start start 2023-12-20T04:51:54.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.675+0000 7f1be4ece640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1be015e530 0x7f1be006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:54.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.675+0000 7f1be4ece640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be00ccf30 con 0x7f1be006c240 2023-12-20T04:51:54.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.675+0000 7f1be4ece640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1be00ca1c0 con 0x7f1be0159b50 2023-12-20T04:51:54.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.675+0000 7f1be4ece640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be00caa60 con 0x7f1be015e530 2023-12-20T04:51:54.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.675+0000 7f1bded9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1be006c240 0x7f1be00cd3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47972/0 (socket says 172.21.15.132:47972) 2023-12-20T04:51:54.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.675+0000 7f1bded9d640 1 -- 172.21.15.132:0/3469307289 learned_addr learned my addr 172.21.15.132:0/3469307289 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:54.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.675+0000 7f1bddd9b640 1 --2- 172.21.15.132:0/3469307289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1be015e530 0x7f1be006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:54.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.675+0000 7f1bdd59a640 1 -- 172.21.15.132:0/3469307289 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4269510933 0 0) 0x7f1be00ccf30 con 0x7f1be006c240 2023-12-20T04:51:54.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.675+0000 7f1bdd59a640 1 -- 172.21.15.132:0/3469307289 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f1bc8003520 con 0x7f1be006c240 2023-12-20T04:51:54.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.675+0000 7f1bdd59a640 1 -- 172.21.15.132:0/3469307289 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 122977267 0 0) 0x7f1bc8003520 con 0x7f1be006c240 2023-12-20T04:51:54.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bdd59a640 1 -- 172.21.15.132:0/3469307289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1be015e530 msgr2=0x7f1be006fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:54.679 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bdd59a640 1 --2- 172.21.15.132:0/3469307289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1be015e530 0x7f1be006fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bdd59a640 1 -- 172.21.15.132:0/3469307289 >> v1:172.21.15.187:6789/0 conn(0x7f1be0159b50 legacy=0x7f1be00c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:54.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bdd59a640 1 -- 172.21.15.132:0/3469307289 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be00ca4a0 con 0x7f1be006c240 2023-12-20T04:51:54.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bdd59a640 1 -- 172.21.15.132:0/3469307289 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f1bd80019f0 con 0x7f1be006c240 2023-12-20T04:51:54.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bdd59a640 1 -- 172.21.15.132:0/3469307289 >> v1:172.21.15.132:6789/0 conn(0x7f1be006c240 legacy=0x7f1be00cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:54.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bdd59a640 1 --2- 172.21.15.132:0/3469307289 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc80039a0 0x7f1bc8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:54.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bdd59a640 1 --2- 172.21.15.132:0/3469307289 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc80047c0 0x7f1bc8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:54.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bdd59a640 1 --2- 172.21.15.132:0/3469307289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1be015e530 0x7f1bc8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:54.680 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bdd59a640 1 -- 172.21.15.132:0/3469307289 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be00caa60 con 0x7f1bc80047c0 2023-12-20T04:51:54.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bdd59a640 1 -- 172.21.15.132:0/3469307289 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc800ba30 con 0x7f1bc80039a0 2023-12-20T04:51:54.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bdd59a640 1 -- 172.21.15.132:0/3469307289 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1bc800bbf0 con 0x7f1be015e530 2023-12-20T04:51:54.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bddd9b640 1 --2- 172.21.15.132:0/3469307289 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc80047c0 0x7f1bc8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:54.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bded9d640 1 --2- 172.21.15.132:0/3469307289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1be015e530 0x7f1bc8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:54.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bde59c640 1 --2- 172.21.15.132:0/3469307289 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc80039a0 0x7f1bc8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:54.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bddd9b640 1 -- 172.21.15.132:0/3469307289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1be015e530 msgr2=0x7f1bc8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:54.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bddd9b640 1 --2- 172.21.15.132:0/3469307289 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1be015e530 0x7f1bc8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bddd9b640 1 -- 172.21.15.132:0/3469307289 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc80039a0 msgr2=0x7f1bc8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:54.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bddd9b640 1 --2- 172.21.15.132:0/3469307289 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc80039a0 0x7f1bc8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.676+0000 7f1bddd9b640 1 -- 172.21.15.132:0/3469307289 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bc8003520 con 0x7f1bc80047c0 2023-12-20T04:51:54.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.677+0000 7f1bddd9b640 1 --2- 172.21.15.132:0/3469307289 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc80047c0 0x7f1bc8004c40 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009a90 tx=0x7f1bc80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=713fb7465735ca4a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:54.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.677+0000 7f1bdd59a640 1 -- 172.21.15.132:0/3469307289 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd402c680 con 0x7f1bc80047c0 2023-12-20T04:51:54.681 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.677+0000 7f1bdd59a640 1 -- 172.21.15.132:0/3469307289 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd402c7e0 con 0x7f1bc80047c0 2023-12-20T04:51:54.682 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.677+0000 7f1bdd59a640 1 -- 172.21.15.132:0/3469307289 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd402cb70 con 0x7f1bc80047c0 2023-12-20T04:51:54.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.677+0000 7f1be4ece640 1 -- 172.21.15.132:0/3469307289 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc80047c0 msgr2=0x7f1bc8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:54.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.677+0000 7f1be4ece640 1 --2- 172.21.15.132:0/3469307289 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1bc80047c0 0x7f1bc8004c40 secure :-1 s=READY pgs=1673 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009a90 tx=0x7f1bc80057f0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.677+0000 7f1bded9d640 1 -- 172.21.15.132:0/3469307289 reap_dead start 2023-12-20T04:51:54.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.678+0000 7f1be4ece640 1 -- 172.21.15.132:0/3469307289 shutdown_connections 2023-12-20T04:51:54.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.678+0000 7f1be4ece640 1 -- 172.21.15.132:0/3469307289 >> 172.21.15.132:0/3469307289 conn(0x7f1be00ced10 msgr2=0x7f1be00cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:54.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.678+0000 7f1be4ece640 1 -- 172.21.15.132:0/3469307289 shutdown_connections 2023-12-20T04:51:54.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.678+0000 7f1be4ece640 1 -- 172.21.15.132:0/3469307289 wait complete. 2023-12-20T04:51:54.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.679+0000 7f1be4ece640 1 Processor -- start 2023-12-20T04:51:54.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.679+0000 7f1be4ece640 1 -- start start 2023-12-20T04:51:54.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1be4ece640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc80047c0 0x7f1be0154520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:54.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1be4ece640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be015ce90 0x7f1be0155d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:54.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1be4ece640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1be0156290 0x7f1be00c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:54.685 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1be4ece640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be01587a0 con 0x7f1be015ce90 2023-12-20T04:51:54.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1be4ece640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1be015acd0 con 0x7f1bc80047c0 2023-12-20T04:51:54.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1be4ece640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1be0156710 con 0x7f1be0156290 2023-12-20T04:51:54.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1bddd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be015ce90 0x7f1be0155d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:54.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1bddd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be015ce90 0x7f1be0155d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42672/0 (socket says 172.21.15.132:42672) 2023-12-20T04:51:54.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1bddd9b640 1 -- 172.21.15.132:0/3359399779 learned_addr learned my addr 172.21.15.132:0/3359399779 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:54.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1bde59c640 1 --2- 172.21.15.132:0/3359399779 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc80047c0 0x7f1be0154520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:54.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1bded9d640 1 --2- 172.21.15.132:0/3359399779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1be0156290 0x7f1be00c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:54.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1bddd9b640 1 -- 172.21.15.132:0/3359399779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1be0156290 msgr2=0x7f1be00c6d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:54.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1bddd9b640 1 --2- 172.21.15.132:0/3359399779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1be0156290 0x7f1be00c6d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1bddd9b640 1 -- 172.21.15.132:0/3359399779 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc80047c0 msgr2=0x7f1be0154520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:54.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1bddd9b640 1 --2- 172.21.15.132:0/3359399779 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc80047c0 0x7f1be0154520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1bddd9b640 1 -- 172.21.15.132:0/3359399779 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1be015bca0 con 0x7f1be015ce90 2023-12-20T04:51:54.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1bddd9b640 1 --2- 172.21.15.132:0/3359399779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be015ce90 0x7f1be0155d50 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009a90 tx=0x7f1bd4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1bceffd640 1 -- 172.21.15.132:0/3359399779 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd402dea0 con 0x7f1be015ce90 2023-12-20T04:51:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1bceffd640 1 -- 172.21.15.132:0/3359399779 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1bd4003810 con 0x7f1be015ce90 2023-12-20T04:51:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1be4ece640 1 -- 172.21.15.132:0/3359399779 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1be015aee0 con 0x7f1be015ce90 2023-12-20T04:51:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1bceffd640 1 -- 172.21.15.132:0/3359399779 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1bd4003ba0 con 0x7f1be015ce90 2023-12-20T04:51:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.680+0000 7f1be4ece640 1 -- 172.21.15.132:0/3359399779 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1be015b4a0 con 0x7f1be015ce90 2023-12-20T04:51:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.681+0000 7f1be4ece640 1 -- 172.21.15.132:0/3359399779 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1be004e840 con 0x7f1be015ce90 2023-12-20T04:51:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.682+0000 7f1bceffd640 1 -- 172.21.15.132:0/3359399779 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1bd4003d00 con 0x7f1be015ce90 2023-12-20T04:51:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.682+0000 7f1bceffd640 1 --2- 172.21.15.132:0/3359399779 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bc006a430 0x7f1bc006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.682+0000 7f1bde59c640 1 --2- 172.21.15.132:0/3359399779 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bc006a430 0x7f1bc006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.682+0000 7f1bceffd640 1 -- 172.21.15.132:0/3359399779 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f1bd40aaa90 con 0x7f1be015ce90 2023-12-20T04:51:54.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.683+0000 7f1bde59c640 1 --2- 172.21.15.132:0/3359399779 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bc006a430 0x7f1bc006c8f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0001760 tx=0x7f1bd0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:54.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.687+0000 7f1bceffd640 1 -- 172.21.15.132:0/3359399779 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1bd40761c0 con 0x7f1be015ce90 2023-12-20T04:51:54.888 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.887+0000 7f1be4ece640 1 -- 172.21.15.132:0/3359399779 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f1be0155b30 con 0x7f1be015ce90 2023-12-20T04:51:54.889 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.887+0000 7f1bceffd640 1 -- 172.21.15.132:0/3359399779 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4725 (secure 0 0 0) 0x7f1bd40044e0 con 0x7f1be015ce90 2023-12-20T04:51:54.889 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:54.889 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":63,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6644,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1464403338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1464403338},{"type":"v1","addr":"172.21.15.187:6834","nonce":1464403338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2717050899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2717050899},{"type":"v1","addr":"172.21.15.187:6835","nonce":2717050899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8709,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2430423967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2430423967},{"type":"v1","addr":"172.21.15.132:6836","nonce":2430423967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:51:46.508144+0000","modified":"2023-12-20T04:51:48.515251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8712":{"gid":8712,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1841932991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1841932991},{"type":"v1","addr":"172.21.15.132:6837","nonce":1841932991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-20T04:51:54.890 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 63 2023-12-20T04:51:54.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.889+0000 7f1be4ece640 1 -- 172.21.15.132:0/3359399779 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bc006a430 msgr2=0x7f1bc006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:54.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.889+0000 7f1be4ece640 1 --2- 172.21.15.132:0/3359399779 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bc006a430 0x7f1bc006c8f0 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7f1bd0001760 tx=0x7f1bd0009040 comp rx=0 tx=0).stop 2023-12-20T04:51:54.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.889+0000 7f1be4ece640 1 -- 172.21.15.132:0/3359399779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be015ce90 msgr2=0x7f1be0155d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:54.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.889+0000 7f1be4ece640 1 --2- 172.21.15.132:0/3359399779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be015ce90 0x7f1be0155d50 secure :-1 s=READY pgs=1674 cs=0 l=1 rev1=1 crypto rx=0x7f1bd4009a90 tx=0x7f1bd4004730 comp rx=0 tx=0).stop 2023-12-20T04:51:54.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.889+0000 7f1be4ece640 1 -- 172.21.15.132:0/3359399779 shutdown_connections 2023-12-20T04:51:54.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.889+0000 7f1be4ece640 1 --2- 172.21.15.132:0/3359399779 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1bc006a430 0x7f1bc006c8f0 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.889+0000 7f1be4ece640 1 --2- 172.21.15.132:0/3359399779 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1be0156290 0x7f1be00c6d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.889+0000 7f1be4ece640 1 --2- 172.21.15.132:0/3359399779 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1be015ce90 0x7f1be0155d50 unknown :-1 s=CLOSED pgs=1674 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.889+0000 7f1be4ece640 1 --2- 172.21.15.132:0/3359399779 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1bc80047c0 0x7f1be0154520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:54.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.889+0000 7f1be4ece640 1 -- 172.21.15.132:0/3359399779 >> 172.21.15.132:0/3359399779 conn(0x7f1be00ced10 msgr2=0x7f1be00c27b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:54.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.889+0000 7f1be4ece640 1 -- 172.21.15.132:0/3359399779 shutdown_connections 2023-12-20T04:51:54.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:54.889+0000 7f1be4ece640 1 -- 172.21.15.132:0/3359399779 wait complete. 2023-12-20T04:51:55.304 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 63, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-20T04:51:46.508144+0000', 'modified': '2023-12-20T04:51:48.515251+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 8712}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_8712': {'gid': 8712, 'name': 'a', 'rank': 0, 'incarnation': 61, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6837/1841932991', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6835', 'nonce': 1841932991}, {'type': 'v1', 'addr': '172.21.15.132:6837', 'nonce': 1841932991}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [21], 'metadata_pool': 20, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-20T04:51:55.305 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-20T04:51:55.305 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-20T04:51:55.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.406+0000 7f55503b9640 1 Processor -- start 2023-12-20T04:51:55.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.406+0000 7f55503b9640 1 -- start start 2023-12-20T04:51:55.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.407+0000 7f55503b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55480b4f90 0x7f55480b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.407+0000 7f55503b9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55480cd660 con 0x7f55480b1d10 2023-12-20T04:51:55.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.407+0000 7f55503b9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f55480cd940 con 0x7f554815d110 2023-12-20T04:51:55.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.407+0000 7f55503b9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5548160e60 con 0x7f55480b4f90 2023-12-20T04:51:55.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.407+0000 7f554e956640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f55480b1d10 0x7f55480d0f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47986/0 (socket says 172.21.15.132:47986) 2023-12-20T04:51:55.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.407+0000 7f554e956640 1 -- 172.21.15.132:0/1692812576 learned_addr learned my addr 172.21.15.132:0/1692812576 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:55.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.407+0000 7f554d153640 1 -- 172.21.15.132:0/1692812576 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3090767039 0 0) 0x7f55480cd660 con 0x7f55480b1d10 2023-12-20T04:51:55.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.407+0000 7f554d153640 1 -- 172.21.15.132:0/1692812576 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5534003520 con 0x7f55480b1d10 2023-12-20T04:51:55.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.407+0000 7f554d954640 1 --2- 172.21.15.132:0/1692812576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55480b4f90 0x7f55480b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d153640 1 -- 172.21.15.132:0/1692812576 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4226689845 0 0) 0x7f5534003520 con 0x7f55480b1d10 2023-12-20T04:51:55.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d153640 1 -- 172.21.15.132:0/1692812576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55480b4f90 msgr2=0x7f55480b21f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:55.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d153640 1 --2- 172.21.15.132:0/1692812576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55480b4f90 0x7f55480b21f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d153640 1 -- 172.21.15.132:0/1692812576 >> v1:172.21.15.187:6789/0 conn(0x7f554815d110 legacy=0x7f55480b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:55.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d153640 1 -- 172.21.15.132:0/1692812576 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5548161140 con 0x7f55480b1d10 2023-12-20T04:51:55.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d153640 1 -- 172.21.15.132:0/1692812576 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f55400019f0 con 0x7f55480b1d10 2023-12-20T04:51:55.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d153640 1 -- 172.21.15.132:0/1692812576 >> v1:172.21.15.132:6789/0 conn(0x7f55480b1d10 legacy=0x7f55480d0f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:55.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d153640 1 --2- 172.21.15.132:0/1692812576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55480b4f90 0x7f55340039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d153640 1 --2- 172.21.15.132:0/1692812576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5534003f20 0x7f55340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d153640 1 --2- 172.21.15.132:0/1692812576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5534004d00 0x7f5534005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d153640 1 -- 172.21.15.132:0/1692812576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5548160e60 con 0x7f5534003f20 2023-12-20T04:51:55.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d153640 1 -- 172.21.15.132:0/1692812576 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f553400ba60 con 0x7f5534004d00 2023-12-20T04:51:55.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d153640 1 -- 172.21.15.132:0/1692812576 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f553400bc20 con 0x7f55480b4f90 2023-12-20T04:51:55.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d954640 1 --2- 172.21.15.132:0/1692812576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5534003f20 0x7f55340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554e155640 1 --2- 172.21.15.132:0/1692812576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55480b4f90 0x7f55340039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554e956640 1 --2- 172.21.15.132:0/1692812576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5534004d00 0x7f5534005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d954640 1 -- 172.21.15.132:0/1692812576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55480b4f90 msgr2=0x7f55340039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:55.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d954640 1 --2- 172.21.15.132:0/1692812576 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55480b4f90 0x7f55340039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d954640 1 -- 172.21.15.132:0/1692812576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5534004d00 msgr2=0x7f5534005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:55.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d954640 1 --2- 172.21.15.132:0/1692812576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5534004d00 0x7f5534005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554d954640 1 -- 172.21.15.132:0/1692812576 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5534003520 con 0x7f5534003f20 2023-12-20T04:51:55.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.408+0000 7f554e956640 1 --2- 172.21.15.132:0/1692812576 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5534004d00 0x7f5534005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:55.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.409+0000 7f554d954640 1 --2- 172.21.15.132:0/1692812576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5534003f20 0x7f55340047c0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f5538009ac0 tx=0x7f55340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fb35dbd92d1c581 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:55.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.409+0000 7f554d153640 1 -- 172.21.15.132:0/1692812576 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553802c6b0 con 0x7f5534003f20 2023-12-20T04:51:55.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.409+0000 7f554d153640 1 -- 172.21.15.132:0/1692812576 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f553802c810 con 0x7f5534003f20 2023-12-20T04:51:55.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.409+0000 7f554d153640 1 -- 172.21.15.132:0/1692812576 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f553802cba0 con 0x7f5534003f20 2023-12-20T04:51:55.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.410+0000 7f55503b9640 1 -- 172.21.15.132:0/1692812576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5534003f20 msgr2=0x7f55340047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:55.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.410+0000 7f55503b9640 1 --2- 172.21.15.132:0/1692812576 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5534003f20 0x7f55340047c0 secure :-1 s=READY pgs=1676 cs=0 l=1 rev1=1 crypto rx=0x7f5538009ac0 tx=0x7f55340057f0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.410+0000 7f554e956640 1 -- 172.21.15.132:0/1692812576 reap_dead start 2023-12-20T04:51:55.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.410+0000 7f55503b9640 1 -- 172.21.15.132:0/1692812576 shutdown_connections 2023-12-20T04:51:55.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.410+0000 7f55503b9640 1 -- 172.21.15.132:0/1692812576 >> 172.21.15.132:0/1692812576 conn(0x7f55480cf880 msgr2=0x7f55480cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:55.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.410+0000 7f55503b9640 1 -- 172.21.15.132:0/1692812576 shutdown_connections 2023-12-20T04:51:55.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.410+0000 7f55503b9640 1 -- 172.21.15.132:0/1692812576 wait complete. 2023-12-20T04:51:55.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.411+0000 7f55503b9640 1 Processor -- start 2023-12-20T04:51:55.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.411+0000 7f55503b9640 1 -- start start 2023-12-20T04:51:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f55503b9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5534003f20 0x7f554815d670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f55503b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f554815e050 0x7f55480cc720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f55503b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55480b7000 0x7f55480b7490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f55503b9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55480b79d0 con 0x7f554815e050 2023-12-20T04:51:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f55503b9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f55481f2c00 con 0x7f5534003f20 2023-12-20T04:51:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f55503b9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f55481f2ee0 con 0x7f55480b7000 2023-12-20T04:51:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f554d954640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f554815e050 0x7f55480cc720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f554d954640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f554815e050 0x7f55480cc720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42682/0 (socket says 172.21.15.132:42682) 2023-12-20T04:51:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f554d954640 1 -- 172.21.15.132:0/3675757877 learned_addr learned my addr 172.21.15.132:0/3675757877 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f554e155640 1 --2- 172.21.15.132:0/3675757877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5534003f20 0x7f554815d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f554e956640 1 --2- 172.21.15.132:0/3675757877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55480b7000 0x7f55480b7490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f554d954640 1 -- 172.21.15.132:0/3675757877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55480b7000 msgr2=0x7f55480b7490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f554d954640 1 --2- 172.21.15.132:0/3675757877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55480b7000 0x7f55480b7490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f554d954640 1 -- 172.21.15.132:0/3675757877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5534003f20 msgr2=0x7f554815d670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f554d954640 1 --2- 172.21.15.132:0/3675757877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5534003f20 0x7f554815d670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f554d954640 1 -- 172.21.15.132:0/3675757877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f55481f31c0 con 0x7f554815e050 2023-12-20T04:51:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f554e155640 1 --2- 172.21.15.132:0/3675757877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5534003f20 0x7f554815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f554e956640 1 --2- 172.21.15.132:0/3675757877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55480b7000 0x7f55480b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f554d954640 1 --2- 172.21.15.132:0/3675757877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f554815e050 0x7f55480cc720 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f553802c250 tx=0x7f5538004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f553effd640 1 -- 172.21.15.132:0/3675757877 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538003810 con 0x7f554815e050 2023-12-20T04:51:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f553effd640 1 -- 172.21.15.132:0/3675757877 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5538003970 con 0x7f554815e050 2023-12-20T04:51:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f55503b9640 1 -- 172.21.15.132:0/3675757877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f55481f34a0 con 0x7f554815e050 2023-12-20T04:51:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f553effd640 1 -- 172.21.15.132:0/3675757877 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5538003ce0 con 0x7f554815e050 2023-12-20T04:51:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.412+0000 7f55503b9640 1 -- 172.21.15.132:0/3675757877 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554815dbb0 con 0x7f554815e050 2023-12-20T04:51:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.414+0000 7f553effd640 1 -- 172.21.15.132:0/3675757877 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5538034440 con 0x7f554815e050 2023-12-20T04:51:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.414+0000 7f553effd640 1 --2- 172.21.15.132:0/3675757877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f552c06a460 0x7f552c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.414+0000 7f553effd640 1 -- 172.21.15.132:0/3675757877 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f55380aab00 con 0x7f554815e050 2023-12-20T04:51:55.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.414+0000 7f554e155640 1 --2- 172.21.15.132:0/3675757877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f552c06a460 0x7f552c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.415+0000 7f554e155640 1 --2- 172.21.15.132:0/3675757877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f552c06a460 0x7f552c06c920 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f55440036b0 tx=0x7f5544009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:55.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.415+0000 7f5553006740 1 Processor -- start 2023-12-20T04:51:55.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.415+0000 7f5553006740 1 -- start start 2023-12-20T04:51:55.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.416+0000 7f5553006740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfcee390 0x559cdfcc1520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.416+0000 7f5553006740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee770 0x559cdfcf1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.416+0000 7f5553006740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfcc1a60 0x559cdfcf1660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.416+0000 7f5553006740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cdfc310b0 con 0x559cdfcc1a60 2023-12-20T04:51:55.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.416+0000 7f5553006740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cdfc2e840 con 0x559cdfcee770 2023-12-20T04:51:55.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.416+0000 7f5553006740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x559cdfc2a130 con 0x559cdfcee390 2023-12-20T04:51:55.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.416+0000 7f554e956640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfcc1a60 0x559cdfcf1660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.416+0000 7f554e956640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfcc1a60 0x559cdfcf1660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42688/0 (socket says 172.21.15.132:42688) 2023-12-20T04:51:55.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.416+0000 7f554e956640 1 -- 172.21.15.132:0/1080540126 learned_addr learned my addr 172.21.15.132:0/1080540126 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:55.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.416+0000 7f554e155640 1 --2- 172.21.15.132:0/1080540126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfcee390 0x559cdfcc1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.416+0000 7f554d954640 1 --2- 172.21.15.132:0/1080540126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee770 0x559cdfcf1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.417+0000 7f554e956640 1 -- 172.21.15.132:0/1080540126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfcee390 msgr2=0x559cdfcc1520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:55.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.417+0000 7f554e956640 1 --2- 172.21.15.132:0/1080540126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfcee390 0x559cdfcc1520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.417+0000 7f554e956640 1 -- 172.21.15.132:0/1080540126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee770 msgr2=0x559cdfcf1120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:55.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.417+0000 7f554e956640 1 --2- 172.21.15.132:0/1080540126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee770 0x559cdfcf1120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.417+0000 7f554e956640 1 -- 172.21.15.132:0/1080540126 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cdfbe4c40 con 0x559cdfcc1a60 2023-12-20T04:51:55.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.417+0000 7f554e956640 1 --2- 172.21.15.132:0/1080540126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfcc1a60 0x559cdfcf1660 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f55480b8810 tx=0x7f5540005f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90e88d2c6378f48c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:55.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.417+0000 7f552bfff640 1 -- 172.21.15.132:0/1080540126 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55400077e0 con 0x559cdfcc1a60 2023-12-20T04:51:55.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.417+0000 7f552bfff640 1 -- 172.21.15.132:0/1080540126 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5540007940 con 0x559cdfcc1a60 2023-12-20T04:51:55.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.417+0000 7f552bfff640 1 -- 172.21.15.132:0/1080540126 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5540014600 con 0x559cdfcc1a60 2023-12-20T04:51:55.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.417+0000 7f5553006740 1 -- 172.21.15.132:0/1080540126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfcc1a60 msgr2=0x559cdfcf1660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:55.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.417+0000 7f5553006740 1 --2- 172.21.15.132:0/1080540126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfcc1a60 0x559cdfcf1660 secure :-1 s=READY pgs=1678 cs=0 l=1 rev1=1 crypto rx=0x7f55480b8810 tx=0x7f5540005f40 comp rx=0 tx=0).stop 2023-12-20T04:51:55.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.417+0000 7f5553006740 1 -- 172.21.15.132:0/1080540126 shutdown_connections 2023-12-20T04:51:55.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.417+0000 7f5553006740 1 --2- 172.21.15.132:0/1080540126 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfcc1a60 0x559cdfcf1660 unknown :-1 s=CLOSED pgs=1678 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.417+0000 7f5553006740 1 --2- 172.21.15.132:0/1080540126 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee770 0x559cdfcf1120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.417+0000 7f5553006740 1 --2- 172.21.15.132:0/1080540126 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfcee390 0x559cdfcc1520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.417+0000 7f5553006740 1 -- 172.21.15.132:0/1080540126 >> 172.21.15.132:0/1080540126 conn(0x559cdfcc3830 msgr2=0x559cdfd0c120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:55.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.418+0000 7f5553006740 1 -- 172.21.15.132:0/1080540126 shutdown_connections 2023-12-20T04:51:55.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.418+0000 7f5553006740 1 -- 172.21.15.132:0/1080540126 wait complete. 2023-12-20T04:51:55.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.418+0000 7f5553006740 1 -- start start 2023-12-20T04:51:55.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.418+0000 7f5553006740 1 Processor -- start 2023-12-20T04:51:55.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.419+0000 7f5553006740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfcee390 0x559cdfd0c390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.419+0000 7f5553006740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee770 0x559cdfd1cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.419+0000 7f5553006740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfd1d0c0 0x559cdfd0e290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.419+0000 7f5553006740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cdfbe8840 con 0x559cdfcee390 2023-12-20T04:51:55.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.419+0000 7f5553006740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cdfbe84e0 con 0x559cdfcee770 2023-12-20T04:51:55.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.419+0000 7f5553006740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x559cdfbae230 con 0x559cdfd1d0c0 2023-12-20T04:51:55.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.419+0000 7f5553006740 10 client.0 _ll_register_callbacks cb 0x559cdfbff6d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:51:55.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.419+0000 7f554e155640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfcee390 0x559cdfd0c390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.419+0000 7f554e155640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfcee390 0x559cdfd0c390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42698/0 (socket says 172.21.15.132:42698) 2023-12-20T04:51:55.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.419+0000 7f554e155640 1 -- 172.21.15.132:0/1062657755 learned_addr learned my addr 172.21.15.132:0/1062657755 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:55.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.419+0000 7f554d954640 1 --2- 172.21.15.132:0/1062657755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee770 0x559cdfd1cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.419+0000 7f554e956640 1 --2- 172.21.15.132:0/1062657755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfd1d0c0 0x559cdfd0e290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.419+0000 7f554e155640 1 -- 172.21.15.132:0/1062657755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfd1d0c0 msgr2=0x559cdfd0e290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:55.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.419+0000 7f554e155640 1 --2- 172.21.15.132:0/1062657755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfd1d0c0 0x559cdfd0e290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.419+0000 7f554e155640 1 -- 172.21.15.132:0/1062657755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee770 msgr2=0x559cdfd1cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:55.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.419+0000 7f554e155640 1 --2- 172.21.15.132:0/1062657755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee770 0x559cdfd1cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.419+0000 7f554e155640 1 -- 172.21.15.132:0/1062657755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f554000f040 con 0x559cdfcee390 2023-12-20T04:51:55.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.420+0000 7f554e155640 1 --2- 172.21.15.132:0/1062657755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfcee390 0x559cdfd0c390 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f5544015750 tx=0x7f5544001120 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a275769191a36e64 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:55.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.420+0000 7f55297fa640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:51:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.420+0000 7f55297fa640 1 -- 172.21.15.132:0/1062657755 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f55440145e0 con 0x559cdfcee390 2023-12-20T04:51:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.420+0000 7f55297fa640 1 -- 172.21.15.132:0/1062657755 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f554401d070 con 0x559cdfcee390 2023-12-20T04:51:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.420+0000 7f5553006740 1 -- 172.21.15.132:0/1062657755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x559cdfc53970 con 0x559cdfcee390 2023-12-20T04:51:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.420+0000 7f55297fa640 1 -- 172.21.15.132:0/1062657755 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5544014740 con 0x559cdfcee390 2023-12-20T04:51:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.420+0000 7f5553006740 10 client.8862 fetch_fsmap learned FSMap version 63 2023-12-20T04:51:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.420+0000 7f5553006740 1 -- 172.21.15.132:0/1062657755 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x559cdfc287b0 con 0x559cdfcee390 2023-12-20T04:51:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.420+0000 7f55297fa640 1 -- 172.21.15.132:0/1062657755 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x559cdfc53970 con 0x559cdfcee390 2023-12-20T04:51:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.420+0000 7f55297fa640 1 -- 172.21.15.132:0/1062657755 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 63) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f55440148a0 con 0x559cdfcee390 2023-12-20T04:51:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.420+0000 7f5553006740 10 client.8862 fetch_fsmap finished waiting for FSMap version 63 2023-12-20T04:51:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.420+0000 7f5553006740 10 client.8862 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-20T04:51:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.420+0000 7f5553006740 20 client.8862 populate_metadata read hostname 'smithi132' 2023-12-20T04:51:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.420+0000 7f5553006740 1 --2- 172.21.15.132:0/1062657755 >> [v2:172.21.15.132:6835/1841932991,v1:172.21.15.132:6837/1841932991] conn(0x559cdfcf3160 0x559cdfcf3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.420+0000 7f5553006740 4 client.8862 mds_command: new command op to 8712 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-20T04:51:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.420+0000 7f5553006740 1 -- 172.21.15.132:0/1062657755 --> [v2:172.21.15.132:6835/1841932991,v1:172.21.15.132:6837/1841932991] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x559cdfc1bf00 con 0x559cdfcf3160 2023-12-20T04:51:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.420+0000 7f554d954640 1 --2- 172.21.15.132:0/1062657755 >> [v2:172.21.15.132:6835/1841932991,v1:172.21.15.132:6837/1841932991] conn(0x559cdfcf3160 0x559cdfcf3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.421+0000 7f55297fa640 10 client.8862 ms_handle_connect on v2:172.21.15.132:6835/1841932991 2023-12-20T04:51:55.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.421+0000 7f554d954640 1 --2- 172.21.15.132:0/1062657755 >> [v2:172.21.15.132:6835/1841932991,v1:172.21.15.132:6837/1841932991] conn(0x559cdfcf3160 0x559cdfcf3540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=54de404343227baa server_cookie=d5d7de33471e013a in_seq=0 out_seq=0 2023-12-20T04:51:55.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.421+0000 7f55297fa640 1 -- 172.21.15.132:0/1062657755 <== mds.0 v2:172.21.15.132:6835/1841932991 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x559cdfc1bf00 con 0x559cdfcf3160 2023-12-20T04:51:55.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.421+0000 7f55297fa640 10 client.8862 handle_command_reply: tid=0 2023-12-20T04:51:55.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.421+0000 7f5553006740 1 client.8862 shutdown 2023-12-20T04:51:55.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.421+0000 7f5553006740 1 -- 172.21.15.132:0/1062657755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfcee390 msgr2=0x559cdfd0c390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:55.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.421+0000 7f5553006740 1 --2- 172.21.15.132:0/1062657755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfcee390 0x559cdfd0c390 secure :-1 s=READY pgs=1679 cs=0 l=1 rev1=1 crypto rx=0x7f5544015750 tx=0x7f5544001120 comp rx=0 tx=0).stop 2023-12-20T04:51:55.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.421+0000 7f5553006740 1 -- 172.21.15.132:0/1062657755 shutdown_connections 2023-12-20T04:51:55.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.421+0000 7f5553006740 1 --2- 172.21.15.132:0/1062657755 >> [v2:172.21.15.132:6835/1841932991,v1:172.21.15.132:6837/1841932991] conn(0x559cdfcf3160 0x559cdfcf3540 crc :-1 s=READY pgs=13 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.421+0000 7f5553006740 1 --2- 172.21.15.132:0/1062657755 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfd1d0c0 0x559cdfd0e290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.421+0000 7f5553006740 1 --2- 172.21.15.132:0/1062657755 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee770 0x559cdfd1cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.421+0000 7f5553006740 1 --2- 172.21.15.132:0/1062657755 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfcee390 0x559cdfd0c390 unknown :-1 s=CLOSED pgs=1679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.421+0000 7f5553006740 1 -- 172.21.15.132:0/1062657755 >> 172.21.15.132:0/1062657755 conn(0x559cdfcc1a60 msgr2=0x559cdfcf1110 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:55.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.421+0000 7f55297fa640 0 client.8862 ms_handle_reset on v2:172.21.15.132:6835/1841932991 2023-12-20T04:51:55.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.421+0000 7f5553006740 1 -- 172.21.15.132:0/1062657755 shutdown_connections 2023-12-20T04:51:55.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.421+0000 7f5553006740 1 -- 172.21.15.132:0/1062657755 wait complete. 2023-12-20T04:51:55.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.422+0000 7f5553006740 20 client.8862 trim_cache size 0 max 16384 2023-12-20T04:51:55.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.436+0000 7f5553006740 1 Processor -- start 2023-12-20T04:51:55.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.436+0000 7f5553006740 1 -- start start 2023-12-20T04:51:55.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.437+0000 7f5553006740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee390 0x559cdfcc1ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.437+0000 7f5553006740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfcee770 0x559cdfcc0470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.437+0000 7f5553006740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfd1d0c0 0x559cdfcc09b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.437+0000 7f5553006740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cdfd0c750 con 0x559cdfd1d0c0 2023-12-20T04:51:55.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.437+0000 7f5553006740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cdfc5f410 con 0x559cdfcee390 2023-12-20T04:51:55.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.437+0000 7f5553006740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x559cdfd0cda0 con 0x559cdfcee770 2023-12-20T04:51:55.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.437+0000 7f554e956640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfd1d0c0 0x559cdfcc09b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.437+0000 7f554e956640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfd1d0c0 0x559cdfcc09b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42714/0 (socket says 172.21.15.132:42714) 2023-12-20T04:51:55.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.437+0000 7f554e956640 1 -- 172.21.15.132:0/1961083182 learned_addr learned my addr 172.21.15.132:0/1961083182 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:55.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.437+0000 7f554e956640 1 -- 172.21.15.132:0/1961083182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfcee770 msgr2=0x559cdfcc0470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:55.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.437+0000 7f554e956640 1 --2- 172.21.15.132:0/1961083182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfcee770 0x559cdfcc0470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.437+0000 7f554e956640 1 -- 172.21.15.132:0/1961083182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee390 msgr2=0x559cdfcc1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:55.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.437+0000 7f554e956640 1 --2- 172.21.15.132:0/1961083182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee390 0x559cdfcc1ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.437+0000 7f554e956640 1 -- 172.21.15.132:0/1961083182 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x559cdfbcabe0 con 0x559cdfd1d0c0 2023-12-20T04:51:55.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.437+0000 7f554e956640 1 --2- 172.21.15.132:0/1961083182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfd1d0c0 0x559cdfcc09b0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f5548067320 tx=0x7f554000e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2024fd34387637c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:55.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.438+0000 7f553cff9640 1 -- 172.21.15.132:0/1961083182 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554001f410 con 0x559cdfd1d0c0 2023-12-20T04:51:55.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.438+0000 7f553cff9640 1 -- 172.21.15.132:0/1961083182 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f554001f590 con 0x559cdfd1d0c0 2023-12-20T04:51:55.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.438+0000 7f553cff9640 1 -- 172.21.15.132:0/1961083182 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554001f940 con 0x559cdfd1d0c0 2023-12-20T04:51:55.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.438+0000 7f5553006740 1 -- 172.21.15.132:0/1961083182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfd1d0c0 msgr2=0x559cdfcc09b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:55.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.438+0000 7f5553006740 1 --2- 172.21.15.132:0/1961083182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfd1d0c0 0x559cdfcc09b0 secure :-1 s=READY pgs=1680 cs=0 l=1 rev1=1 crypto rx=0x7f5548067320 tx=0x7f554000e000 comp rx=0 tx=0).stop 2023-12-20T04:51:55.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.438+0000 7f5553006740 1 -- 172.21.15.132:0/1961083182 shutdown_connections 2023-12-20T04:51:55.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.438+0000 7f5553006740 1 --2- 172.21.15.132:0/1961083182 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfd1d0c0 0x559cdfcc09b0 unknown :-1 s=CLOSED pgs=1680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.438+0000 7f5553006740 1 --2- 172.21.15.132:0/1961083182 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfcee770 0x559cdfcc0470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.438+0000 7f5553006740 1 --2- 172.21.15.132:0/1961083182 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee390 0x559cdfcc1ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.438+0000 7f5553006740 1 -- 172.21.15.132:0/1961083182 >> 172.21.15.132:0/1961083182 conn(0x559cdfcc1a60 msgr2=0x559cdfd05ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:55.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.438+0000 7f5553006740 1 -- 172.21.15.132:0/1961083182 shutdown_connections 2023-12-20T04:51:55.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.438+0000 7f5553006740 1 -- 172.21.15.132:0/1961083182 wait complete. 2023-12-20T04:51:55.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.439+0000 7f5553006740 1 -- start start 2023-12-20T04:51:55.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.439+0000 7f5553006740 1 Processor -- start 2023-12-20T04:51:55.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f5553006740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee390 0x559cdfcf4820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f5553006740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfcee770 0x559cdfcf4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f5553006740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfd1d0c0 0x559cdfd7ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f5553006740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cdfcdca80 con 0x559cdfd1d0c0 2023-12-20T04:51:55.446 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f5553006740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x559cdfd7b9e0 con 0x559cdfcee390 2023-12-20T04:51:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f5553006740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x559cdfcdd560 con 0x559cdfcee770 2023-12-20T04:51:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f5553006740 10 client.0 _ll_register_callbacks cb 0x7f55400017b0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:51:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f554e956640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfd1d0c0 0x559cdfd7ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f554e956640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfd1d0c0 0x559cdfd7ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42730/0 (socket says 172.21.15.132:42730) 2023-12-20T04:51:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f554e956640 1 -- 172.21.15.132:0/2785573482 learned_addr learned my addr 172.21.15.132:0/2785573482 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f554e956640 1 -- 172.21.15.132:0/2785573482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfcee770 msgr2=0x559cdfcf4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f554e956640 1 --2- 172.21.15.132:0/2785573482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfcee770 0x559cdfcf4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f554e956640 1 -- 172.21.15.132:0/2785573482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee390 msgr2=0x559cdfcf4820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f554e155640 1 --2- 172.21.15.132:0/2785573482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee390 0x559cdfcf4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f554e956640 1 --2- 172.21.15.132:0/2785573482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee390 0x559cdfcf4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f554e956640 1 -- 172.21.15.132:0/2785573482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x559cdfbe4c40 con 0x559cdfd1d0c0 2023-12-20T04:51:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f554e956640 1 --2- 172.21.15.132:0/2785573482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfd1d0c0 0x559cdfd7ab30 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f5540001cb0 tx=0x7f5540001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=930685395611517a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f55297fa640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:51:55.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f55297fa640 1 -- 172.21.15.132:0/2785573482 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f554001f410 con 0x559cdfd1d0c0 2023-12-20T04:51:55.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f55297fa640 1 -- 172.21.15.132:0/2785573482 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5540028660 con 0x559cdfd1d0c0 2023-12-20T04:51:55.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f5553006740 1 -- 172.21.15.132:0/2785573482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7f5540007940 con 0x559cdfd1d0c0 2023-12-20T04:51:55.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f55297fa640 1 -- 172.21.15.132:0/2785573482 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=63) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5540028820 con 0x559cdfd1d0c0 2023-12-20T04:51:55.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f5553006740 10 client.8868 fetch_fsmap learned FSMap version 63 2023-12-20T04:51:55.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.440+0000 7f5553006740 1 -- 172.21.15.132:0/2785573482 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=63,monmap=2+}) v3 -- 0x559cdfbf02f0 con 0x559cdfd1d0c0 2023-12-20T04:51:55.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.441+0000 7f55297fa640 1 -- 172.21.15.132:0/2785573482 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5540007940 con 0x559cdfd1d0c0 2023-12-20T04:51:55.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.441+0000 7f55297fa640 1 -- 172.21.15.132:0/2785573482 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 63) v1 ==== 3114+0+0 (secure 0 0 0) 0x7f5540028980 con 0x559cdfd1d0c0 2023-12-20T04:51:55.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.441+0000 7f5553006740 10 client.8868 fetch_fsmap finished waiting for FSMap version 63 2023-12-20T04:51:55.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.441+0000 7f5553006740 10 client.8868 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-20T04:51:55.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.441+0000 7f5553006740 20 client.8868 populate_metadata read hostname 'smithi132' 2023-12-20T04:51:55.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.441+0000 7f5553006740 1 --2- 172.21.15.132:0/2785573482 >> [v2:172.21.15.132:6835/1841932991,v1:172.21.15.132:6837/1841932991] conn(0x559cdfd09d90 0x559cdfd7b070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.441+0000 7f5553006740 4 client.8868 mds_command: new command op to 8712 tid=0[{"prefix": "status"}] 2023-12-20T04:51:55.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.441+0000 7f5553006740 1 -- 172.21.15.132:0/2785573482 --> [v2:172.21.15.132:6835/1841932991,v1:172.21.15.132:6837/1841932991] -- command(tid 0: {"prefix": "status"}) v1 -- 0x559cdfc231b0 con 0x559cdfd09d90 2023-12-20T04:51:55.448 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.441+0000 7f554e155640 1 --2- 172.21.15.132:0/2785573482 >> [v2:172.21.15.132:6835/1841932991,v1:172.21.15.132:6837/1841932991] conn(0x559cdfd09d90 0x559cdfd7b070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.441+0000 7f55297fa640 10 client.8868 ms_handle_connect on v2:172.21.15.132:6835/1841932991 2023-12-20T04:51:55.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.441+0000 7f554e155640 1 --2- 172.21.15.132:0/2785573482 >> [v2:172.21.15.132:6835/1841932991,v1:172.21.15.132:6837/1841932991] conn(0x559cdfd09d90 0x559cdfd7b070 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=b0ddaef6109f37b8 server_cookie=b94195ee9cb16f4e in_seq=0 out_seq=0 2023-12-20T04:51:55.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.441+0000 7f55297fa640 1 -- 172.21.15.132:0/2785573482 <== mds.0 v2:172.21.15.132:6835/1841932991 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+326 (crc 0 0 0) 0x559cdfc231b0 con 0x559cdfd09d90 2023-12-20T04:51:55.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.441+0000 7f55297fa640 10 client.8868 handle_command_reply: tid=0 2023-12-20T04:51:55.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.441+0000 7f5553006740 1 client.8868 shutdown 2023-12-20T04:51:55.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.441+0000 7f5553006740 1 -- 172.21.15.132:0/2785573482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfd1d0c0 msgr2=0x559cdfd7ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:55.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.441+0000 7f5553006740 1 --2- 172.21.15.132:0/2785573482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfd1d0c0 0x559cdfd7ab30 secure :-1 s=READY pgs=1681 cs=0 l=1 rev1=1 crypto rx=0x7f5540001cb0 tx=0x7f5540001d80 comp rx=0 tx=0).stop 2023-12-20T04:51:55.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f5553006740 1 -- 172.21.15.132:0/2785573482 shutdown_connections 2023-12-20T04:51:55.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f5553006740 1 --2- 172.21.15.132:0/2785573482 >> [v2:172.21.15.132:6835/1841932991,v1:172.21.15.132:6837/1841932991] conn(0x559cdfd09d90 0x559cdfd7b070 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f5553006740 1 --2- 172.21.15.132:0/2785573482 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x559cdfd1d0c0 0x559cdfd7ab30 unknown :-1 s=CLOSED pgs=1681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f5553006740 1 --2- 172.21.15.132:0/2785573482 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x559cdfcee770 0x559cdfcf4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f5553006740 1 --2- 172.21.15.132:0/2785573482 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x559cdfcee390 0x559cdfcf4820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.449 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f55297fa640 0 client.8868 ms_handle_reset on v2:172.21.15.132:6835/1841932991 2023-12-20T04:51:55.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f5553006740 1 -- 172.21.15.132:0/2785573482 >> 172.21.15.132:0/2785573482 conn(0x559cdfcc1a60 msgr2=0x559cdfd1b930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:55.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f5553006740 1 -- 172.21.15.132:0/2785573482 shutdown_connections 2023-12-20T04:51:55.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f5553006740 1 -- 172.21.15.132:0/2785573482 wait complete. 2023-12-20T04:51:55.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f5553006740 20 client.8868 trim_cache size 0 max 16384 2023-12-20T04:51:55.450 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:51:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:51:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-12-20T04:51:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 8712, 2023-12-20T04:51:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-12-20T04:51:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-12-20T04:51:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-12-20T04:51:55.450 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 8.9327839099999995, 2023-12-20T04:51:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 63, 2023-12-20T04:51:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 169, 2023-12-20T04:51:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 169, 2023-12-20T04:51:55.451 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 13.32436433 2023-12-20T04:51:55.451 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:51:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f55503b9640 1 -- 172.21.15.132:0/3675757877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f552c06a460 msgr2=0x7f552c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f55503b9640 1 --2- 172.21.15.132:0/3675757877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f552c06a460 0x7f552c06c920 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7f55440036b0 tx=0x7f5544009040 comp rx=0 tx=0).stop 2023-12-20T04:51:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f55503b9640 1 -- 172.21.15.132:0/3675757877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f554815e050 msgr2=0x7f55480cc720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f55503b9640 1 --2- 172.21.15.132:0/3675757877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f554815e050 0x7f55480cc720 secure :-1 s=READY pgs=1677 cs=0 l=1 rev1=1 crypto rx=0x7f553802c250 tx=0x7f5538004730 comp rx=0 tx=0).stop 2023-12-20T04:51:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f55503b9640 1 -- 172.21.15.132:0/3675757877 shutdown_connections 2023-12-20T04:51:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f55503b9640 1 --2- 172.21.15.132:0/3675757877 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f552c06a460 0x7f552c06c920 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f55503b9640 1 --2- 172.21.15.132:0/3675757877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f55480b7000 0x7f55480b7490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f55503b9640 1 --2- 172.21.15.132:0/3675757877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f554815e050 0x7f55480cc720 unknown :-1 s=CLOSED pgs=1677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f55503b9640 1 --2- 172.21.15.132:0/3675757877 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5534003f20 0x7f554815d670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f55503b9640 1 -- 172.21.15.132:0/3675757877 >> 172.21.15.132:0/3675757877 conn(0x7f55480cf880 msgr2=0x7f55480b55c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f55503b9640 1 -- 172.21.15.132:0/3675757877 shutdown_connections 2023-12-20T04:51:55.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.442+0000 7f55503b9640 1 -- 172.21.15.132:0/3675757877 wait complete. 2023-12-20T04:51:55.455 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:51:55.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.552+0000 7fc54a470640 1 Processor -- start 2023-12-20T04:51:55.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.552+0000 7fc54a470640 1 -- start start 2023-12-20T04:51:55.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.553+0000 7fc54a470640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc54413e690 0x7fc544069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.553+0000 7fc54a470640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc54406a170 0x7fc5440708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.553+0000 7fc54a470640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc54406a5c0 con 0x7fc54413df60 2023-12-20T04:51:55.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.553+0000 7fc54a470640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc544155a30 con 0x7fc54406a170 2023-12-20T04:51:55.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.553+0000 7fc54a470640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc544141660 con 0x7fc54413e690 2023-12-20T04:51:55.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.553+0000 7fc548a0d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc54406a170 0x7fc5440708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.553+0000 7fc548a0d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc54406a170 0x7fc5440708d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42734/0 (socket says 172.21.15.132:42734) 2023-12-20T04:51:55.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.553+0000 7fc548a0d640 1 -- 172.21.15.132:0/4074446553 learned_addr learned my addr 172.21.15.132:0/4074446553 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:55.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.553+0000 7fc5437fe640 1 --2- 172.21.15.132:0/4074446553 >> v2:172.21.15.187:3300/0 conn(0x7fc54413e690 0x7fc544069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.553+0000 7fc548a0d640 1 -- 172.21.15.132:0/4074446553 >> v2:172.21.15.187:3300/0 conn(0x7fc54413e690 msgr2=0x7fc544069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:55.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.553+0000 7fc548a0d640 1 --2- 172.21.15.132:0/4074446553 >> v2:172.21.15.187:3300/0 conn(0x7fc54413e690 0x7fc544069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.553+0000 7fc548a0d640 1 -- 172.21.15.132:0/4074446553 >> v1:172.21.15.132:6789/0 conn(0x7fc54413df60 legacy=0x7fc5440caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:55.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.553+0000 7fc542ffd640 1 -- 172.21.15.132:0/4074446553 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 231981850 0 0) 0x7fc534001180 con 0x7fc54413df60 2023-12-20T04:51:55.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.553+0000 7fc548a0d640 1 -- 172.21.15.132:0/4074446553 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc544140ae0 con 0x7fc54406a170 2023-12-20T04:51:55.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.554+0000 7fc548a0d640 1 --2- 172.21.15.132:0/4074446553 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc54406a170 0x7fc5440708d0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fc5440740f0 tx=0x7fc53c02bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=11562e2e1c8b36bb server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.554+0000 7fc542ffd640 1 -- 172.21.15.132:0/4074446553 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c02ca80 con 0x7fc54406a170 2023-12-20T04:51:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.554+0000 7fc542ffd640 1 -- 172.21.15.132:0/4074446553 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c02cbe0 con 0x7fc54406a170 2023-12-20T04:51:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.554+0000 7fc542ffd640 1 -- 172.21.15.132:0/4074446553 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c0343f0 con 0x7fc54406a170 2023-12-20T04:51:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.555+0000 7fc54a470640 1 -- 172.21.15.132:0/4074446553 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc54406a170 msgr2=0x7fc5440708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.555+0000 7fc54a470640 1 --2- 172.21.15.132:0/4074446553 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc54406a170 0x7fc5440708d0 secure :-1 s=READY pgs=1683 cs=0 l=1 rev1=1 crypto rx=0x7fc5440740f0 tx=0x7fc53c02bee0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.555+0000 7fc54a470640 1 -- 172.21.15.132:0/4074446553 shutdown_connections 2023-12-20T04:51:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.555+0000 7fc54a470640 1 --2- 172.21.15.132:0/4074446553 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc54406a170 0x7fc5440708d0 unknown :-1 s=CLOSED pgs=1683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.555+0000 7fc54a470640 1 --2- 172.21.15.132:0/4074446553 >> v2:172.21.15.187:3300/0 conn(0x7fc54413e690 0x7fc544069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.555+0000 7fc54a470640 1 -- 172.21.15.132:0/4074446553 >> 172.21.15.132:0/4074446553 conn(0x7fc5440cfbd0 msgr2=0x7fc5440cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.555+0000 7fc54a470640 1 -- 172.21.15.132:0/4074446553 shutdown_connections 2023-12-20T04:51:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.555+0000 7fc54a470640 1 -- 172.21.15.132:0/4074446553 wait complete. 2023-12-20T04:51:55.558 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.556+0000 7fc54a470640 1 Processor -- start 2023-12-20T04:51:55.559 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.556+0000 7fc54a470640 1 -- start start 2023-12-20T04:51:55.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc54a470640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc54406a170 0x7fc544158a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc54a470640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc54413df60 0x7fc5440c75b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc54a470640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc54413e690 0x7fc5441ef7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc54a470640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5440c7af0 con 0x7fc54413e690 2023-12-20T04:51:55.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc54a470640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc5440c7d20 con 0x7fc54406a170 2023-12-20T04:51:55.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc54a470640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc5440b48e0 con 0x7fc54413df60 2023-12-20T04:51:55.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc548a0d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc54413e690 0x7fc5441ef7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc548a0d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc54413e690 0x7fc5441ef7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42736/0 (socket says 172.21.15.132:42736) 2023-12-20T04:51:55.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc548a0d640 1 -- 172.21.15.132:0/2960829470 learned_addr learned my addr 172.21.15.132:0/2960829470 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:55.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc5437fe640 1 --2- 172.21.15.132:0/2960829470 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc54413df60 0x7fc5440c75b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc543fff640 1 --2- 172.21.15.132:0/2960829470 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc54406a170 0x7fc544158a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc548a0d640 1 -- 172.21.15.132:0/2960829470 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc54413df60 msgr2=0x7fc5440c75b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc548a0d640 1 --2- 172.21.15.132:0/2960829470 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc54413df60 0x7fc5440c75b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc548a0d640 1 -- 172.21.15.132:0/2960829470 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc54406a170 msgr2=0x7fc544158a00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc548a0d640 1 --2- 172.21.15.132:0/2960829470 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc54406a170 0x7fc544158a00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc548a0d640 1 -- 172.21.15.132:0/2960829470 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc53c009b30 con 0x7fc54413e690 2023-12-20T04:51:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc543fff640 1 --2- 172.21.15.132:0/2960829470 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc54406a170 0x7fc544158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:51:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc548a0d640 1 --2- 172.21.15.132:0/2960829470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc54413e690 0x7fc5441ef7f0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fc53c036040 tx=0x7fc53c004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc540ff9640 1 -- 172.21.15.132:0/2960829470 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c009510 con 0x7fc54413e690 2023-12-20T04:51:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc540ff9640 1 -- 172.21.15.132:0/2960829470 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc53c03e450 con 0x7fc54413e690 2023-12-20T04:51:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc54a470640 1 -- 172.21.15.132:0/2960829470 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc5440b4bc0 con 0x7fc54413e690 2023-12-20T04:51:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc540ff9640 1 -- 172.21.15.132:0/2960829470 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc53c03e800 con 0x7fc54413e690 2023-12-20T04:51:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.557+0000 7fc54a470640 1 -- 172.21.15.132:0/2960829470 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc5440b5180 con 0x7fc54413e690 2023-12-20T04:51:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.558+0000 7fc54a470640 1 -- 172.21.15.132:0/2960829470 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc5440b5370 con 0x7fc54413e690 2023-12-20T04:51:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.559+0000 7fc540ff9640 1 -- 172.21.15.132:0/2960829470 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc53c02cd50 con 0x7fc54413e690 2023-12-20T04:51:55.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.559+0000 7fc540ff9640 1 --2- 172.21.15.132:0/2960829470 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc53006a430 0x7fc53006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:55.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.559+0000 7fc540ff9640 1 -- 172.21.15.132:0/2960829470 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc53c0ab430 con 0x7fc54413e690 2023-12-20T04:51:55.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.559+0000 7fc543fff640 1 --2- 172.21.15.132:0/2960829470 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc53006a430 0x7fc53006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:55.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.560+0000 7fc543fff640 1 --2- 172.21.15.132:0/2960829470 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc53006a430 0x7fc53006c8f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc5340013e0 tx=0x7fc534009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:55.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.563+0000 7fc540ff9640 1 -- 172.21.15.132:0/2960829470 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc53c076a20 con 0x7fc54413e690 2023-12-20T04:51:55.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.764+0000 7fc54a470640 1 -- 172.21.15.132:0/2960829470 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fc54404e840 con 0x7fc54413e690 2023-12-20T04:51:55.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.764+0000 7fc540ff9640 1 -- 172.21.15.132:0/2960829470 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v63) v1 ==== 53+0+73 (secure 0 0 0) 0x7fc53c07a040 con 0x7fc54413e690 2023-12-20T04:51:55.767 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:51:55.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.767+0000 7fc54a470640 1 -- 172.21.15.132:0/2960829470 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc53006a430 msgr2=0x7fc53006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:55.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.767+0000 7fc54a470640 1 --2- 172.21.15.132:0/2960829470 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc53006a430 0x7fc53006c8f0 secure :-1 s=READY pgs=710 cs=0 l=1 rev1=1 crypto rx=0x7fc5340013e0 tx=0x7fc534009040 comp rx=0 tx=0).stop 2023-12-20T04:51:55.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.767+0000 7fc54a470640 1 -- 172.21.15.132:0/2960829470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc54413e690 msgr2=0x7fc5441ef7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:55.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.767+0000 7fc54a470640 1 --2- 172.21.15.132:0/2960829470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc54413e690 0x7fc5441ef7f0 secure :-1 s=READY pgs=1684 cs=0 l=1 rev1=1 crypto rx=0x7fc53c036040 tx=0x7fc53c004a40 comp rx=0 tx=0).stop 2023-12-20T04:51:55.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.767+0000 7fc54a470640 1 -- 172.21.15.132:0/2960829470 shutdown_connections 2023-12-20T04:51:55.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.767+0000 7fc54a470640 1 --2- 172.21.15.132:0/2960829470 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc53006a430 0x7fc53006c8f0 unknown :-1 s=CLOSED pgs=710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.767+0000 7fc54a470640 1 --2- 172.21.15.132:0/2960829470 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc54413e690 0x7fc5441ef7f0 unknown :-1 s=CLOSED pgs=1684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.767+0000 7fc54a470640 1 --2- 172.21.15.132:0/2960829470 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc54413df60 0x7fc5440c75b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.767+0000 7fc54a470640 1 --2- 172.21.15.132:0/2960829470 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc54406a170 0x7fc544158a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:55.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.767+0000 7fc54a470640 1 -- 172.21.15.132:0/2960829470 >> 172.21.15.132:0/2960829470 conn(0x7fc5440cfbd0 msgr2=0x7fc5440ca670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:55.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.767+0000 7fc54a470640 1 -- 172.21.15.132:0/2960829470 shutdown_connections 2023-12-20T04:51:55.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:55.767+0000 7fc54a470640 1 -- 172.21.15.132:0/2960829470 wait complete. 2023-12-20T04:51:55.780 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:51:55.780 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:51:55.780 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-12-20T04:51:55.780 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-20T04:51:55.780 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-20T04:51:55.780 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:51:55.780 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:51:55.780 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:51:55.780 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:51:55.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:55.781 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-12-20T04:51:55.796 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:51:55.796 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:51:55.796 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:51:55.796 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:51:55.796 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-20T04:51:55.796 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:51:55.796 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:51:55.796 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:51:55.796 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-12-20T04:51:55.796 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:51:55.796 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-12-20T04:51:55.796 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-12-20T04:51:55.796 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:51:55.796 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-12-20T04:51:55.796 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:51:55.797 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-12-20T04:51:55.797 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:51:55.797 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42158sec preferred_lft 42158sec 2023-12-20T04:51:55.797 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-12-20T04:51:55.797 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:51:55.797 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:51:55.797 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:51:55.797 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:51:55.797 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:51:55.797 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::60dd:37ff:fe28:558b/64 scope link 2023-12-20T04:51:55.797 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:51:55.797 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:51:55.797 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 86:13:fe:55:4c:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-20T04:51:55.797 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::8413:feff:fe55:4c04/64 scope link 2023-12-20T04:51:55.797 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:51:55.797 INFO:teuthology.orchestra.run.smithi132.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:51:55.797 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-20T04:51:55.798 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::839:72ff:fea7:b332/64 scope link 2023-12-20T04:51:55.798 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:51:55.798 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:55.798 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:51:55.861 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-20T04:51:55.862 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:55.862 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-12-20T04:51:55.918 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-12-20T04:51:55.918 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:51:55.918 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:51:55.918 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:51:55.918 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:51:55.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:55.919 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:51:55.919 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:51:55.919 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:51:55.919 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:51:55.919 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:51:55.919 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:51:56.014 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:56.014 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-20T04:51:56.028 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-20T04:51:56.028 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-20T04:51:56.028 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:51:56.028 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:56.029 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-12-20T04:51:56.095 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-20T04:51:56.095 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:51:56.096 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-20T04:51:56.150 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:51:56.151 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:51:56.151 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:51:56.205 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:51:56.272 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:51:56.272 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:51:56.337 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:51:56.338 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:51:56.338 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:56.339 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:51:56.393 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:51:56.393 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-20T04:51:56.436 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:51:56.462 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:51:56.462 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:51:56.520 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:2023-12-20T04:51:56.518+0000 7f8df7f71480 -1 init, newargv = 0x5564e3e8a570 newargc=15 2023-12-20T04:51:56.520 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[120877]: starting ceph client 2023-12-20T04:51:56.524 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[120877]: starting fuse 2023-12-20T04:51:56.530 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:51:56.531 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:51:56.532 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:56.532 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:51:56.586 INFO:teuthology.orchestra.run.smithi132.stdout:41 2023-12-20T04:51:56.586 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:51:56.587 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:51:56.587 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:51:56.587 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:51:56.587 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:51:56.587 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:51:56.587 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:51:56.587 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:51:56.587 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:51:56.587 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:51:56.587 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:51:56.587 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:51:56.587 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:51:56.587 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:51:56.587 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:51:56.587 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:51:56.588 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:51:56.588 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:51:56.588 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:51:56.588 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:51:56.588 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:51:56.588 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:51:56.588 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:51:56.588 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:51:56.588 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:51:56.588 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:51:56.588 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:51:56.588 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:51:56.702 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.120877.asok 2023-12-20T04:51:56.888 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.120877.asok 2023-12-20T04:51:56.889 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:56.889 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.120877.asok status 2023-12-20T04:51:57.024 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:51:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:51:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:51:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:51:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:51:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:51:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:51:57.024 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "120877", 2023-12-20T04:51:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:51:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2023-12-20T04:51:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:51:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 8886, 2023-12-20T04:51:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:51:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:51:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:51:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 8886 2023-12-20T04:51:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:51:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:51:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:51:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 1548076934 2023-12-20T04:51:57.025 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:51:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:51:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:51:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:51:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 1548076934 2023-12-20T04:51:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:51:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.8886 192.168.0.1:0/1548076934", 2023-12-20T04:51:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/1548076934", 2023-12-20T04:51:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2023-12-20T04:51:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 63, 2023-12-20T04:51:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 169, 2023-12-20T04:51:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:51:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:51:57.026 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:51:57.027 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:51:57.033 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:57.033 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2023-12-20T04:51:57.033 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-20T04:51:57.048 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2023-12-20T04:51:57.048 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-20T04:51:57.048 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:57.048 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:51:57.115 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:51:57.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.253+0000 7fa83d6c7640 1 Processor -- start 2023-12-20T04:51:57.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.253+0000 7fa83d6c7640 1 -- start start 2023-12-20T04:51:57.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.253+0000 7fa83d6c7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa838160450 0x7fa838160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:57.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.253+0000 7fa83d6c7640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa8381611b0 0x7fa8380b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:57.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.253+0000 7fa83d6c7640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa8380b5ec0 con 0x7fa8380b4ec0 2023-12-20T04:51:57.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.253+0000 7fa83d6c7640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa8380b5350 con 0x7fa8381611b0 2023-12-20T04:51:57.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.253+0000 7fa83d6c7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa8381617e0 con 0x7fa838160450 2023-12-20T04:51:57.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.254+0000 7fa836ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa838160450 0x7fa838160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:57.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.254+0000 7fa8367fc640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa8381611b0 0x7fa8380b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:57.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.254+0000 7fa836ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa838160450 0x7fa838160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:38060/0 (socket says 172.21.15.132:38060) 2023-12-20T04:51:57.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.254+0000 7fa836ffd640 1 -- 172.21.15.132:0/2742669250 learned_addr learned my addr 172.21.15.132:0/2742669250 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:57.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.254+0000 7fa8377fe640 1 --1- 172.21.15.132:0/2742669250 >> v1:172.21.15.187:6789/0 conn(0x7fa8380b4ec0 0x7fa83806a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:36166/0 (socket says 172.21.15.132:36166) 2023-12-20T04:51:57.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.254+0000 7fa836ffd640 1 -- 172.21.15.132:0/2742669250 >> v2:172.21.15.187:3300/0 conn(0x7fa8381611b0 msgr2=0x7fa8380b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:57.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.254+0000 7fa836ffd640 1 --2- 172.21.15.132:0/2742669250 >> v2:172.21.15.187:3300/0 conn(0x7fa8381611b0 0x7fa8380b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:57.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.254+0000 7fa836ffd640 1 -- 172.21.15.132:0/2742669250 >> v1:172.21.15.187:6789/0 conn(0x7fa8380b4ec0 legacy=0x7fa83806a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:57.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.254+0000 7fa836ffd640 1 -- 172.21.15.132:0/2742669250 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8380d0fc0 con 0x7fa838160450 2023-12-20T04:51:57.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.255+0000 7fa836ffd640 1 --2- 172.21.15.132:0/2742669250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa838160450 0x7fa838160c70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa828009e50 tx=0x7fa82802bff0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b85beca354acdc0f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:57.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.255+0000 7fa835ffb640 1 -- 172.21.15.132:0/2742669250 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82802cb90 con 0x7fa838160450 2023-12-20T04:51:57.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.255+0000 7fa835ffb640 1 -- 172.21.15.132:0/2742669250 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82802ccf0 con 0x7fa838160450 2023-12-20T04:51:57.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.255+0000 7fa835ffb640 1 -- 172.21.15.132:0/2742669250 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828034610 con 0x7fa838160450 2023-12-20T04:51:57.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.255+0000 7fa83d6c7640 1 -- 172.21.15.132:0/2742669250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa838160450 msgr2=0x7fa838160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:57.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.255+0000 7fa83d6c7640 1 --2- 172.21.15.132:0/2742669250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa838160450 0x7fa838160c70 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fa828009e50 tx=0x7fa82802bff0 comp rx=0 tx=0).stop 2023-12-20T04:51:57.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.256+0000 7fa83d6c7640 1 -- 172.21.15.132:0/2742669250 shutdown_connections 2023-12-20T04:51:57.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.256+0000 7fa83d6c7640 1 --2- 172.21.15.132:0/2742669250 >> v2:172.21.15.187:3300/0 conn(0x7fa8381611b0 0x7fa8380b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:57.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.256+0000 7fa83d6c7640 1 --2- 172.21.15.132:0/2742669250 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa838160450 0x7fa838160c70 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:57.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.256+0000 7fa83d6c7640 1 -- 172.21.15.132:0/2742669250 >> 172.21.15.132:0/2742669250 conn(0x7fa8380cf980 msgr2=0x7fa8380cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:57.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.256+0000 7fa83d6c7640 1 -- 172.21.15.132:0/2742669250 shutdown_connections 2023-12-20T04:51:57.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.256+0000 7fa83d6c7640 1 -- 172.21.15.132:0/2742669250 wait complete. 2023-12-20T04:51:57.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.257+0000 7fa83d6c7640 1 Processor -- start 2023-12-20T04:51:57.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.257+0000 7fa83d6c7640 1 -- start start 2023-12-20T04:51:57.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa83d6c7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8380b4ec0 0x7fa83815a9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:57.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa83d6c7640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa838160450 0x7fa83815e370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:57.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa83d6c7640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8381611b0 0x7fa83815e8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:57.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa83d6c7640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa838147220 con 0x7fa8380b4ec0 2023-12-20T04:51:57.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa83d6c7640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8381465a0 con 0x7fa8381611b0 2023-12-20T04:51:57.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa83d6c7640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa838146880 con 0x7fa838160450 2023-12-20T04:51:57.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa836ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8380b4ec0 0x7fa83815a9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:57.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa836ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8380b4ec0 0x7fa83815a9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:42752/0 (socket says 172.21.15.132:42752) 2023-12-20T04:51:57.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa836ffd640 1 -- 172.21.15.132:0/19330778 learned_addr learned my addr 172.21.15.132:0/19330778 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:57.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa8377fe640 1 --2- 172.21.15.132:0/19330778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8381611b0 0x7fa83815e8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:57.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa8367fc640 1 --2- 172.21.15.132:0/19330778 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa838160450 0x7fa83815e370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:57.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa836ffd640 1 -- 172.21.15.132:0/19330778 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa838160450 msgr2=0x7fa83815e370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:57.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa836ffd640 1 --2- 172.21.15.132:0/19330778 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa838160450 0x7fa83815e370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:57.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa836ffd640 1 -- 172.21.15.132:0/19330778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8381611b0 msgr2=0x7fa83815e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:57.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa836ffd640 1 --2- 172.21.15.132:0/19330778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8381611b0 0x7fa83815e8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:57.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa836ffd640 1 -- 172.21.15.132:0/19330778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa828009b30 con 0x7fa8380b4ec0 2023-12-20T04:51:57.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa836ffd640 1 --2- 172.21.15.132:0/19330778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8380b4ec0 0x7fa83815a9f0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fa828000f80 tx=0x7fa828004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:57.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa81f7fe640 1 -- 172.21.15.132:0/19330778 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa828009510 con 0x7fa8380b4ec0 2023-12-20T04:51:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa81f7fe640 1 -- 172.21.15.132:0/19330778 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa82803e450 con 0x7fa8380b4ec0 2023-12-20T04:51:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa81f7fe640 1 -- 172.21.15.132:0/19330778 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa82803e800 con 0x7fa8380b4ec0 2023-12-20T04:51:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa83d6c7640 1 -- 172.21.15.132:0/19330778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa838146b60 con 0x7fa8380b4ec0 2023-12-20T04:51:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.258+0000 7fa83d6c7640 1 -- 172.21.15.132:0/19330778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa83815af30 con 0x7fa8380b4ec0 2023-12-20T04:51:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.259+0000 7fa83d6c7640 1 -- 172.21.15.132:0/19330778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa83815b120 con 0x7fa8380b4ec0 2023-12-20T04:51:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.260+0000 7fa81f7fe640 1 -- 172.21.15.132:0/19330778 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa82803e960 con 0x7fa8380b4ec0 2023-12-20T04:51:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.260+0000 7fa81f7fe640 1 --2- 172.21.15.132:0/19330778 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa82406a430 0x7fa82406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.260+0000 7fa81f7fe640 1 -- 172.21.15.132:0/19330778 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa8280ab370 con 0x7fa8380b4ec0 2023-12-20T04:51:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.260+0000 7fa8367fc640 1 --2- 172.21.15.132:0/19330778 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa82406a430 0x7fa82406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:57.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.261+0000 7fa8367fc640 1 --2- 172.21.15.132:0/19330778 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa82406a430 0x7fa82406c8f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa8380c9790 tx=0x7fa82c009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:57.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.264+0000 7fa81f7fe640 1 -- 172.21.15.132:0/19330778 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa828076a20 con 0x7fa8380b4ec0 2023-12-20T04:51:57.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.466+0000 7fa83d6c7640 1 -- 172.21.15.132:0/19330778 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fa83804e840 con 0x7fa8380b4ec0 2023-12-20T04:51:57.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.466+0000 7fa81f7fe640 1 -- 172.21.15.132:0/19330778 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v63) v1 ==== 53+0+73 (secure 0 0 0) 0x7fa82802ce60 con 0x7fa8380b4ec0 2023-12-20T04:51:57.468 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:51:57.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.468+0000 7fa83d6c7640 1 -- 172.21.15.132:0/19330778 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa82406a430 msgr2=0x7fa82406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:57.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.468+0000 7fa83d6c7640 1 --2- 172.21.15.132:0/19330778 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa82406a430 0x7fa82406c8f0 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7fa8380c9790 tx=0x7fa82c009190 comp rx=0 tx=0).stop 2023-12-20T04:51:57.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.468+0000 7fa83d6c7640 1 -- 172.21.15.132:0/19330778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8380b4ec0 msgr2=0x7fa83815a9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:57.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.468+0000 7fa83d6c7640 1 --2- 172.21.15.132:0/19330778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8380b4ec0 0x7fa83815a9f0 secure :-1 s=READY pgs=1688 cs=0 l=1 rev1=1 crypto rx=0x7fa828000f80 tx=0x7fa828004a40 comp rx=0 tx=0).stop 2023-12-20T04:51:57.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.468+0000 7fa83d6c7640 1 -- 172.21.15.132:0/19330778 shutdown_connections 2023-12-20T04:51:57.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.468+0000 7fa83d6c7640 1 --2- 172.21.15.132:0/19330778 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa82406a430 0x7fa82406c8f0 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:57.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.468+0000 7fa83d6c7640 1 --2- 172.21.15.132:0/19330778 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa8381611b0 0x7fa83815e8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:57.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.468+0000 7fa83d6c7640 1 --2- 172.21.15.132:0/19330778 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa838160450 0x7fa83815e370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:57.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.468+0000 7fa83d6c7640 1 --2- 172.21.15.132:0/19330778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa8380b4ec0 0x7fa83815a9f0 unknown :-1 s=CLOSED pgs=1688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:57.471 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.468+0000 7fa83d6c7640 1 -- 172.21.15.132:0/19330778 >> 172.21.15.132:0/19330778 conn(0x7fa8380cf980 msgr2=0x7fa8380cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:57.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.468+0000 7fa83d6c7640 1 -- 172.21.15.132:0/19330778 shutdown_connections 2023-12-20T04:51:57.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:57.469+0000 7fa83d6c7640 1 -- 172.21.15.132:0/19330778 wait complete. 2023-12-20T04:51:57.481 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:51:57.481 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:51:57.482 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-12-20T04:51:57.482 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-20T04:51:57.482 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-20T04:51:57.482 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:51:57.482 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:51:57.482 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:51:57.482 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:51:57.482 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:57.482 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-12-20T04:51:57.501 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:51:57.501 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:51:57.501 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:51:57.501 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:51:57.502 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-20T04:51:57.502 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:51:57.502 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:51:57.502 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:51:57.502 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-12-20T04:51:57.502 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:51:57.502 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:51:57.502 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-12-20T04:51:57.502 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:51:57.502 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:51:57.502 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:51:57.502 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:51:57.502 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:51:57.502 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42168sec preferred_lft 42168sec 2023-12-20T04:51:57.503 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-12-20T04:51:57.503 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:51:57.503 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:51:57.503 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:51:57.503 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:51:57.503 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:51:57.503 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::a8bc:1cff:fe40:54ea/64 scope link 2023-12-20T04:51:57.503 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:51:57.503 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:51:57.503 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-20T04:51:57.503 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c8e:c0ff:fe7a:bdc/64 scope link 2023-12-20T04:51:57.503 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:51:57.503 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:51:57.504 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether be:98:9a:6f:62:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-20T04:51:57.504 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::bc98:9aff:fe6f:6282/64 scope link 2023-12-20T04:51:57.504 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:51:57.504 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:57.504 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:51:57.571 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-12-20T04:51:57.573 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:57.573 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-12-20T04:51:57.631 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-12-20T04:51:57.631 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:51:57.631 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:51:57.631 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:51:57.631 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:51:57.632 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:57.632 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:51:57.632 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:51:57.632 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:51:57.632 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:51:57.632 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:51:57.632 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:51:57.733 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:57.733 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-20T04:51:57.748 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-20T04:51:57.748 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-20T04:51:57.749 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:51:57.749 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:57.749 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2023-12-20T04:51:57.816 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-20T04:51:57.816 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:51:57.816 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-20T04:51:57.872 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:51:57.872 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:51:57.872 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:51:57.927 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:51:57.995 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:51:57.995 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:51:58.061 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:51:58.063 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:51:58.063 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:58.063 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:51:58.118 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:51:58.118 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-20T04:51:58.161 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:51:58.187 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:51:58.187 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:51:58.244 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:2023-12-20T04:51:58.243+0000 7f6ecbed3480 -1 init, newargv = 0x55a3fa597f80 newargc=15 2023-12-20T04:51:58.245 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[92072]: starting ceph client 2023-12-20T04:51:58.248 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[92072]: starting fuse 2023-12-20T04:51:58.255 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:51:58.256 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:51:58.256 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:58.256 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:51:58.311 INFO:teuthology.orchestra.run.smithi187.stdout:41 2023-12-20T04:51:58.311 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:51:58.311 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:51:58.311 DEBUG:teuthology.orchestra.run.smithi187:> import glob 2023-12-20T04:51:58.311 DEBUG:teuthology.orchestra.run.smithi187:> import re 2023-12-20T04:51:58.311 DEBUG:teuthology.orchestra.run.smithi187:> import os 2023-12-20T04:51:58.312 DEBUG:teuthology.orchestra.run.smithi187:> import subprocess 2023-12-20T04:51:58.312 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:51:58.312 DEBUG:teuthology.orchestra.run.smithi187:> def _find_admin_socket(client_name): 2023-12-20T04:51:58.312 DEBUG:teuthology.orchestra.run.smithi187:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-20T04:51:58.312 DEBUG:teuthology.orchestra.run.smithi187:> files = glob.glob(asok_path) 2023-12-20T04:51:58.312 DEBUG:teuthology.orchestra.run.smithi187:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-20T04:51:58.312 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:51:58.312 DEBUG:teuthology.orchestra.run.smithi187:> # Given a non-glob path, it better be there 2023-12-20T04:51:58.312 DEBUG:teuthology.orchestra.run.smithi187:> if "*" not in asok_path: 2023-12-20T04:51:58.312 DEBUG:teuthology.orchestra.run.smithi187:> assert(len(files) == 1) 2023-12-20T04:51:58.312 DEBUG:teuthology.orchestra.run.smithi187:> return files[0] 2023-12-20T04:51:58.312 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:51:58.312 DEBUG:teuthology.orchestra.run.smithi187:> for f in files: 2023-12-20T04:51:58.312 DEBUG:teuthology.orchestra.run.smithi187:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:51:58.312 DEBUG:teuthology.orchestra.run.smithi187:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:51:58.312 DEBUG:teuthology.orchestra.run.smithi187:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:51:58.312 DEBUG:teuthology.orchestra.run.smithi187:> contents = proc_f.read() 2023-12-20T04:51:58.313 DEBUG:teuthology.orchestra.run.smithi187:> if mountpoint in contents: 2023-12-20T04:51:58.313 DEBUG:teuthology.orchestra.run.smithi187:> return f 2023-12-20T04:51:58.313 DEBUG:teuthology.orchestra.run.smithi187:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:51:58.313 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:51:58.313 DEBUG:teuthology.orchestra.run.smithi187:> print(_find_admin_socket("client.1")) 2023-12-20T04:51:58.313 DEBUG:teuthology.orchestra.run.smithi187:> ' 2023-12-20T04:51:58.426 INFO:teuthology.orchestra.run.smithi187.stdout:/var/run/ceph/ceph-client.1.92072.asok 2023-12-20T04:51:58.613 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.92072.asok 2023-12-20T04:51:58.613 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:58.613 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.92072.asok status 2023-12-20T04:51:58.747 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-12-20T04:51:58.747 INFO:teuthology.orchestra.run.smithi187.stdout: "metadata": { 2023-12-20T04:51:58.747 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:51:58.747 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:51:58.747 INFO:teuthology.orchestra.run.smithi187.stdout: "entity_id": "1", 2023-12-20T04:51:58.747 INFO:teuthology.orchestra.run.smithi187.stdout: "hostname": "smithi187", 2023-12-20T04:51:58.747 INFO:teuthology.orchestra.run.smithi187.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-20T04:51:58.747 INFO:teuthology.orchestra.run.smithi187.stdout: "pid": "92072", 2023-12-20T04:51:58.747 INFO:teuthology.orchestra.run.smithi187.stdout: "root": "/" 2023-12-20T04:51:58.747 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:51:58.747 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_count": 0, 2023-12-20T04:51:58.748 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_pinned_count": 0, 2023-12-20T04:51:58.748 INFO:teuthology.orchestra.run.smithi187.stdout: "id": 7510, 2023-12-20T04:51:58.748 INFO:teuthology.orchestra.run.smithi187.stdout: "inst": { 2023-12-20T04:51:58.748 INFO:teuthology.orchestra.run.smithi187.stdout: "name": { 2023-12-20T04:51:58.748 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "client", 2023-12-20T04:51:58.748 INFO:teuthology.orchestra.run.smithi187.stdout: "num": 7510 2023-12-20T04:51:58.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:51:58.748 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:51:58.748 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:51:58.748 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:51:58.748 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 176472466 2023-12-20T04:51:58.748 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-12-20T04:51:58.748 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:51:58.748 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:51:58.748 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:51:58.748 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:51:58.749 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 176472466 2023-12-20T04:51:58.749 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:51:58.749 INFO:teuthology.orchestra.run.smithi187.stdout: "inst_str": "client.7510 192.168.0.1:0/176472466", 2023-12-20T04:51:58.749 INFO:teuthology.orchestra.run.smithi187.stdout: "addr_str": "192.168.0.1:0/176472466", 2023-12-20T04:51:58.749 INFO:teuthology.orchestra.run.smithi187.stdout: "inode_count": 1, 2023-12-20T04:51:58.749 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_epoch": 63, 2023-12-20T04:51:58.749 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch": 169, 2023-12-20T04:51:58.749 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:51:58.749 INFO:teuthology.orchestra.run.smithi187.stdout: "blocklisted": false, 2023-12-20T04:51:58.749 INFO:teuthology.orchestra.run.smithi187.stdout: "fs_name": "cephfs" 2023-12-20T04:51:58.749 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-12-20T04:51:58.755 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:58.755 DEBUG:teuthology.orchestra.run.smithi187:> stat --file-system '--printf=%T 2023-12-20T04:51:58.755 DEBUG:teuthology.orchestra.run.smithi187:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-20T04:51:58.770 INFO:teuthology.orchestra.run.smithi187.stdout:fuseblk 2023-12-20T04:51:58.770 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-20T04:51:58.771 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:51:58.771 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:51:58.837 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:51:58.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.946+0000 7f0e06dd2640 1 Processor -- start 2023-12-20T04:51:58.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.946+0000 7f0e06dd2640 1 -- start start 2023-12-20T04:51:58.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.947+0000 7f0e06dd2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e0006cf00 0x7f0e000b4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:58.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.947+0000 7f0e06dd2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0006ea90 con 0x7f0e0006a340 2023-12-20T04:51:58.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.947+0000 7f0e06dd2640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e0006e160 con 0x7f0e001588e0 2023-12-20T04:51:58.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.947+0000 7f0e06dd2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e0006d520 con 0x7f0e0006cf00 2023-12-20T04:51:58.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.947+0000 7f0dfffff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0e0006a340 0x7f0e0006c7f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:44634/0 (socket says 172.21.15.132:44634) 2023-12-20T04:51:58.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.947+0000 7f0dfffff640 1 -- 172.21.15.132:0/3064823806 learned_addr learned my addr 172.21.15.132:0/3064823806 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:51:58.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.948+0000 7f0e0536f640 1 --2- 172.21.15.132:0/3064823806 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e0006cf00 0x7f0e000b4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:58.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.948+0000 7f0dff7fe640 1 -- 172.21.15.132:0/3064823806 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4098835868 0 0) 0x7f0e0006ea90 con 0x7f0e0006a340 2023-12-20T04:51:58.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.948+0000 7f0dff7fe640 1 -- 172.21.15.132:0/3064823806 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0de8003520 con 0x7f0e0006a340 2023-12-20T04:51:58.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.948+0000 7f0dff7fe640 1 -- 172.21.15.132:0/3064823806 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 63990740 0 0) 0x7f0e0006e160 con 0x7f0e001588e0 2023-12-20T04:51:58.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.948+0000 7f0dff7fe640 1 -- 172.21.15.132:0/3064823806 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e0006ea90 con 0x7f0e001588e0 2023-12-20T04:51:58.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.948+0000 7f0e0536f640 1 -- 172.21.15.132:0/3064823806 >> v1:172.21.15.187:6789/0 conn(0x7f0e001588e0 legacy=0x7f0e00069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:58.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.948+0000 7f0e0536f640 1 -- 172.21.15.132:0/3064823806 >> v1:172.21.15.132:6789/0 conn(0x7f0e0006a340 legacy=0x7f0e0006c7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:58.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.948+0000 7f0e0536f640 1 -- 172.21.15.132:0/3064823806 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e0006e440 con 0x7f0e0006cf00 2023-12-20T04:51:58.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.949+0000 7f0e0536f640 1 --2- 172.21.15.132:0/3064823806 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e0006cf00 0x7f0e000b4bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009dc0 tx=0x7f0df802bf20 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c1a7278b839127f4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:58.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.949+0000 7f0dff7fe640 1 -- 172.21.15.132:0/3064823806 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df802ccd0 con 0x7f0e0006cf00 2023-12-20T04:51:58.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.949+0000 7f0dff7fe640 1 -- 172.21.15.132:0/3064823806 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df802ce30 con 0x7f0e0006cf00 2023-12-20T04:51:58.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.949+0000 7f0dff7fe640 1 -- 172.21.15.132:0/3064823806 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df8034660 con 0x7f0e0006cf00 2023-12-20T04:51:58.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.949+0000 7f0e06dd2640 1 -- 172.21.15.132:0/3064823806 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e0006cf00 msgr2=0x7f0e000b4bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:58.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.949+0000 7f0e06dd2640 1 --2- 172.21.15.132:0/3064823806 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e0006cf00 0x7f0e000b4bb0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f0df8009dc0 tx=0x7f0df802bf20 comp rx=0 tx=0).stop 2023-12-20T04:51:58.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.949+0000 7f0e06dd2640 1 -- 172.21.15.132:0/3064823806 shutdown_connections 2023-12-20T04:51:58.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.949+0000 7f0e06dd2640 1 --2- 172.21.15.132:0/3064823806 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e0006cf00 0x7f0e000b4bb0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:58.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.949+0000 7f0e06dd2640 1 -- 172.21.15.132:0/3064823806 >> 172.21.15.132:0/3064823806 conn(0x7f0e000cfca0 msgr2=0x7f0e000d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:58.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.950+0000 7f0e06dd2640 1 -- 172.21.15.132:0/3064823806 shutdown_connections 2023-12-20T04:51:58.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.950+0000 7f0e06dd2640 1 -- 172.21.15.132:0/3064823806 wait complete. 2023-12-20T04:51:58.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.951+0000 7f0e06dd2640 1 Processor -- start 2023-12-20T04:51:58.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.951+0000 7f0e06dd2640 1 -- start start 2023-12-20T04:51:58.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0e06dd2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e0006a340 0x7f0e000aff10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:58.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0e06dd2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006cf00 0x7f0e000c91b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:58.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0e06dd2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e001588e0 0x7f0e0014cd70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:58.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0e06dd2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000c41f0 con 0x7f0e0006cf00 2023-12-20T04:51:58.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0e06dd2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000c44d0 con 0x7f0e001588e0 2023-12-20T04:51:58.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0e06dd2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e000c47b0 con 0x7f0e0006a340 2023-12-20T04:51:58.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0dfffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006cf00 0x7f0e000c91b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:58.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0dfffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006cf00 0x7f0e000c91b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48236/0 (socket says 172.21.15.132:48236) 2023-12-20T04:51:58.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0dfffff640 1 -- 172.21.15.132:0/3919508774 learned_addr learned my addr 172.21.15.132:0/3919508774 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:58.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0e0536f640 1 --2- 172.21.15.132:0/3919508774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e001588e0 0x7f0e0014cd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:58.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0e04b6e640 1 --2- 172.21.15.132:0/3919508774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e0006a340 0x7f0e000aff10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:58.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0dfffff640 1 -- 172.21.15.132:0/3919508774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e0006a340 msgr2=0x7f0e000aff10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:58.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0dfffff640 1 --2- 172.21.15.132:0/3919508774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e0006a340 0x7f0e000aff10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:58.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0dfffff640 1 -- 172.21.15.132:0/3919508774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e001588e0 msgr2=0x7f0e0014cd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:58.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0dfffff640 1 --2- 172.21.15.132:0/3919508774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e001588e0 0x7f0e0014cd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:58.956 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0dfffff640 1 -- 172.21.15.132:0/3919508774 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0df8009a70 con 0x7f0e0006cf00 2023-12-20T04:51:58.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0dfffff640 1 --2- 172.21.15.132:0/3919508774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006cf00 0x7f0e000c91b0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f0df400c3e0 tx=0x7f0df400c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:58.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0dfd7fa640 1 -- 172.21.15.132:0/3919508774 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4005ce0 con 0x7f0e0006cf00 2023-12-20T04:51:58.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0dfd7fa640 1 -- 172.21.15.132:0/3919508774 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0df4005e60 con 0x7f0e0006cf00 2023-12-20T04:51:58.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0e06dd2640 1 -- 172.21.15.132:0/3919508774 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e000c4a90 con 0x7f0e0006cf00 2023-12-20T04:51:58.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0dfd7fa640 1 -- 172.21.15.132:0/3919508774 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0df4007310 con 0x7f0e0006cf00 2023-12-20T04:51:58.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.952+0000 7f0e06dd2640 1 -- 172.21.15.132:0/3919508774 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e000b0450 con 0x7f0e0006cf00 2023-12-20T04:51:58.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.953+0000 7f0e06dd2640 1 -- 172.21.15.132:0/3919508774 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e000c4fb0 con 0x7f0e0006cf00 2023-12-20T04:51:58.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.954+0000 7f0dfd7fa640 1 -- 172.21.15.132:0/3919508774 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0df4007530 con 0x7f0e0006cf00 2023-12-20T04:51:58.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.954+0000 7f0dfd7fa640 1 --2- 172.21.15.132:0/3919508774 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0dec06a430 0x7f0dec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:58.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.954+0000 7f0dfd7fa640 1 -- 172.21.15.132:0/3919508774 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0df4087e60 con 0x7f0e0006cf00 2023-12-20T04:51:58.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.954+0000 7f0e04b6e640 1 --2- 172.21.15.132:0/3919508774 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0dec06a430 0x7f0dec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:58.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.955+0000 7f0e04b6e640 1 --2- 172.21.15.132:0/3919508774 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0dec06a430 0x7f0dec06c8f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0df00011e0 tx=0x7f0df0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:58.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:58.959+0000 7f0dfd7fa640 1 -- 172.21.15.132:0/3919508774 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0e000c4fb0 con 0x7f0e0006cf00 2023-12-20T04:51:59.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.159+0000 7f0e06dd2640 1 -- 172.21.15.132:0/3919508774 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f0e000c4fb0 con 0x7f0e0006cf00 2023-12-20T04:51:59.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.160+0000 7f0dfd7fa640 1 -- 172.21.15.132:0/3919508774 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4725 (secure 0 0 0) 0x7f0e000c4fb0 con 0x7f0e0006cf00 2023-12-20T04:51:59.162 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:51:59.162 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":63,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6644,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1464403338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1464403338},{"type":"v1","addr":"172.21.15.187:6834","nonce":1464403338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2717050899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2717050899},{"type":"v1","addr":"172.21.15.187:6835","nonce":2717050899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8709,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2430423967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2430423967},{"type":"v1","addr":"172.21.15.132:6836","nonce":2430423967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:51:46.508144+0000","modified":"2023-12-20T04:51:48.515251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8712":{"gid":8712,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1841932991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1841932991},{"type":"v1","addr":"172.21.15.132:6837","nonce":1841932991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-20T04:51:59.162 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 63 2023-12-20T04:51:59.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.162+0000 7f0e06dd2640 1 -- 172.21.15.132:0/3919508774 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0dec06a430 msgr2=0x7f0dec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:59.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.162+0000 7f0e06dd2640 1 --2- 172.21.15.132:0/3919508774 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0dec06a430 0x7f0dec06c8f0 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7f0df00011e0 tx=0x7f0df0009040 comp rx=0 tx=0).stop 2023-12-20T04:51:59.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.162+0000 7f0e06dd2640 1 -- 172.21.15.132:0/3919508774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006cf00 msgr2=0x7f0e000c91b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:59.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.162+0000 7f0e06dd2640 1 --2- 172.21.15.132:0/3919508774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006cf00 0x7f0e000c91b0 secure :-1 s=READY pgs=1690 cs=0 l=1 rev1=1 crypto rx=0x7f0df400c3e0 tx=0x7f0df400c8a0 comp rx=0 tx=0).stop 2023-12-20T04:51:59.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.162+0000 7f0e06dd2640 1 -- 172.21.15.132:0/3919508774 shutdown_connections 2023-12-20T04:51:59.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.162+0000 7f0e06dd2640 1 --2- 172.21.15.132:0/3919508774 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0dec06a430 0x7f0dec06c8f0 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:59.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.162+0000 7f0e06dd2640 1 --2- 172.21.15.132:0/3919508774 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e001588e0 0x7f0e0014cd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:59.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.162+0000 7f0e06dd2640 1 --2- 172.21.15.132:0/3919508774 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e0006cf00 0x7f0e000c91b0 unknown :-1 s=CLOSED pgs=1690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:59.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.162+0000 7f0e06dd2640 1 --2- 172.21.15.132:0/3919508774 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e0006a340 0x7f0e000aff10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:59.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.162+0000 7f0e06dd2640 1 -- 172.21.15.132:0/3919508774 >> 172.21.15.132:0/3919508774 conn(0x7f0e000cfca0 msgr2=0x7f0e0006c220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:59.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.162+0000 7f0e06dd2640 1 -- 172.21.15.132:0/3919508774 shutdown_connections 2023-12-20T04:51:59.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.162+0000 7f0e06dd2640 1 -- 172.21.15.132:0/3919508774 wait complete. 2023-12-20T04:51:59.175 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-20T04:51:59.289 INFO:teuthology.orchestra.run.smithi132.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":8712,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":12.770300543999999,"mdsmap_epoch":63,"osdmap_epoch":169,"osdmap_epoch_barrier":169,"uptime":17.161881701999999} 2023-12-20T04:51:59.290 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 8712, "mdsmap_epoch": 63, "osdmap_epoch": 169, "osdmap_epoch_barrier": 169, "rank_uptime": 12.770300544, "state": "up:active", "uptime": 17.161881702, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:51:59.290 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-20T04:51:59.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.392+0000 7f31158bd640 1 Processor -- start 2023-12-20T04:51:59.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.392+0000 7f31158bd640 1 -- start start 2023-12-20T04:51:59.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.392+0000 7f31158bd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f311015d510 0x7f311015d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:59.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.392+0000 7f31158bd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f311015df00 0x7f31100b3570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:59.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.392+0000 7f31158bd640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f31100b27d0 con 0x7f311015d130 2023-12-20T04:51:59.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.392+0000 7f31158bd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31100d1ff0 con 0x7f311015d510 2023-12-20T04:51:59.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.392+0000 7f31158bd640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f31100b2a90 con 0x7f311015df00 2023-12-20T04:51:59.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.393+0000 7f310e7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f311015d510 0x7f311015d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:59.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.393+0000 7f310e7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f311015d510 0x7f311015d9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48250/0 (socket says 172.21.15.132:48250) 2023-12-20T04:51:59.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.393+0000 7f310e7fc640 1 -- 172.21.15.132:0/1077743094 learned_addr learned my addr 172.21.15.132:0/1077743094 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:59.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.393+0000 7f310f7fe640 1 --2- 172.21.15.132:0/1077743094 >> v2:172.21.15.187:3300/0 conn(0x7f311015df00 0x7f31100b3570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:59.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.393+0000 7f310e7fc640 1 -- 172.21.15.132:0/1077743094 >> v2:172.21.15.187:3300/0 conn(0x7f311015df00 msgr2=0x7f31100b3570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:59.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.393+0000 7f310e7fc640 1 --2- 172.21.15.132:0/1077743094 >> v2:172.21.15.187:3300/0 conn(0x7f311015df00 0x7f31100b3570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:59.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.393+0000 7f310e7fc640 1 -- 172.21.15.132:0/1077743094 >> v1:172.21.15.187:6789/0 conn(0x7f311015d130 legacy=0x7f31100d17c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:51:59.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.393+0000 7f310e7fc640 1 -- 172.21.15.132:0/1077743094 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31100b2d70 con 0x7f311015d510 2023-12-20T04:51:59.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.394+0000 7f310e7fc640 1 --2- 172.21.15.132:0/1077743094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f311015d510 0x7f311015d9c0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f3110073c90 tx=0x7f310402b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a94f40f6ff29e742 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:59.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.394+0000 7f310dffb640 1 -- 172.21.15.132:0/1077743094 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f31040317e0 con 0x7f311015d510 2023-12-20T04:51:59.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.394+0000 7f310dffb640 1 -- 172.21.15.132:0/1077743094 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3104031940 con 0x7f311015d510 2023-12-20T04:51:59.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.394+0000 7f310dffb640 1 -- 172.21.15.132:0/1077743094 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104031cd0 con 0x7f311015d510 2023-12-20T04:51:59.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.394+0000 7f31158bd640 1 -- 172.21.15.132:0/1077743094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f311015d510 msgr2=0x7f311015d9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:59.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.394+0000 7f31158bd640 1 --2- 172.21.15.132:0/1077743094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f311015d510 0x7f311015d9c0 secure :-1 s=READY pgs=1691 cs=0 l=1 rev1=1 crypto rx=0x7f3110073c90 tx=0x7f310402b880 comp rx=0 tx=0).stop 2023-12-20T04:51:59.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.394+0000 7f31158bd640 1 -- 172.21.15.132:0/1077743094 shutdown_connections 2023-12-20T04:51:59.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.394+0000 7f31158bd640 1 --2- 172.21.15.132:0/1077743094 >> v2:172.21.15.187:3300/0 conn(0x7f311015df00 0x7f31100b3570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:59.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.394+0000 7f31158bd640 1 --2- 172.21.15.132:0/1077743094 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f311015d510 0x7f311015d9c0 unknown :-1 s=CLOSED pgs=1691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:59.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.394+0000 7f31158bd640 1 -- 172.21.15.132:0/1077743094 >> 172.21.15.132:0/1077743094 conn(0x7f31100d2eb0 msgr2=0x7f31100d32c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:59.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.394+0000 7f31158bd640 1 -- 172.21.15.132:0/1077743094 shutdown_connections 2023-12-20T04:51:59.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.394+0000 7f31158bd640 1 -- 172.21.15.132:0/1077743094 wait complete. 2023-12-20T04:51:59.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.395+0000 7f31158bd640 1 Processor -- start 2023-12-20T04:51:59.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.396+0000 7f31158bd640 1 -- start start 2023-12-20T04:51:59.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.396+0000 7f31158bd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f311015d130 0x7f311014cea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:59.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.396+0000 7f31158bd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f311015d510 0x7f31100ca990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:59.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.396+0000 7f31158bd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f311015df00 0x7f3110158fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:59.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.396+0000 7f31158bd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31101f29e0 con 0x7f311015d510 2023-12-20T04:51:59.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.396+0000 7f31158bd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31100cb1c0 con 0x7f311015d130 2023-12-20T04:51:59.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.396+0000 7f31158bd640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f31100cb4a0 con 0x7f311015df00 2023-12-20T04:51:59.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.396+0000 7f310e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f311015d510 0x7f31100ca990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:59.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.396+0000 7f310e7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f311015d510 0x7f31100ca990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:48262/0 (socket says 172.21.15.132:48262) 2023-12-20T04:51:59.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.396+0000 7f310e7fc640 1 -- 172.21.15.132:0/588692566 learned_addr learned my addr 172.21.15.132:0/588692566 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:51:59.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.397+0000 7f310f7fe640 1 --2- 172.21.15.132:0/588692566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f311015df00 0x7f3110158fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:59.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.397+0000 7f310effd640 1 --2- 172.21.15.132:0/588692566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f311015d130 0x7f311014cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:59.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.397+0000 7f310e7fc640 1 -- 172.21.15.132:0/588692566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f311015df00 msgr2=0x7f3110158fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:59.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.397+0000 7f310e7fc640 1 --2- 172.21.15.132:0/588692566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f311015df00 0x7f3110158fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:59.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.397+0000 7f310e7fc640 1 -- 172.21.15.132:0/588692566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f311015d130 msgr2=0x7f311014cea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:59.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.397+0000 7f310e7fc640 1 --2- 172.21.15.132:0/588692566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f311015d130 0x7f311014cea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:59.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.397+0000 7f310e7fc640 1 -- 172.21.15.132:0/588692566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31040094d0 con 0x7f311015d510 2023-12-20T04:51:59.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.397+0000 7f310e7fc640 1 --2- 172.21.15.132:0/588692566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f311015d510 0x7f31100ca990 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f310402b8c0 tx=0x7f31040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:59.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.397+0000 7f30f7fff640 1 -- 172.21.15.132:0/588692566 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104032880 con 0x7f311015d510 2023-12-20T04:51:59.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.397+0000 7f30f7fff640 1 -- 172.21.15.132:0/588692566 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f31040329e0 con 0x7f311015d510 2023-12-20T04:51:59.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.397+0000 7f31158bd640 1 -- 172.21.15.132:0/588692566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31100cb780 con 0x7f311015d510 2023-12-20T04:51:59.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.397+0000 7f30f7fff640 1 -- 172.21.15.132:0/588692566 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3104032d90 con 0x7f311015d510 2023-12-20T04:51:59.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.397+0000 7f31158bd640 1 -- 172.21.15.132:0/588692566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31100cbd40 con 0x7f311015d510 2023-12-20T04:51:59.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.398+0000 7f31158bd640 1 -- 172.21.15.132:0/588692566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f311004e840 con 0x7f311015d510 2023-12-20T04:51:59.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.399+0000 7f30f7fff640 1 -- 172.21.15.132:0/588692566 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f310404e450 con 0x7f311015d510 2023-12-20T04:51:59.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.399+0000 7f30f7fff640 1 --2- 172.21.15.132:0/588692566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f30fc06a460 0x7f30fc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:51:59.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.399+0000 7f30f7fff640 1 -- 172.21.15.132:0/588692566 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(169..169 src has 1..169) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f31040aa860 con 0x7f311015d510 2023-12-20T04:51:59.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.399+0000 7f310effd640 1 --2- 172.21.15.132:0/588692566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f30fc06a460 0x7f30fc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:51:59.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.399+0000 7f310effd640 1 --2- 172.21.15.132:0/588692566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f30fc06a460 0x7f30fc06c920 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3100004f60 tx=0x7f3100007e30 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:51:59.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.403+0000 7f30f7fff640 1 -- 172.21.15.132:0/588692566 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3104075f00 con 0x7f311015d510 2023-12-20T04:51:59.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.572+0000 7f31158bd640 1 -- 172.21.15.132:0/588692566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f31100b8e30 con 0x7f311015d510 2023-12-20T04:51:59.915 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.913+0000 7f30f7fff640 1 -- 172.21.15.132:0/588692566 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v170) v1 ==== 181+0+0 (secure 0 0 0) 0x7f3104079520 con 0x7f311015d510 2023-12-20T04:51:59.915 INFO:teuthology.orchestra.run.smithi132.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-20T04:51:59.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.916+0000 7f31158bd640 1 -- 172.21.15.132:0/588692566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f30fc06a460 msgr2=0x7f30fc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:59.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.916+0000 7f31158bd640 1 --2- 172.21.15.132:0/588692566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f30fc06a460 0x7f30fc06c920 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7f3100004f60 tx=0x7f3100007e30 comp rx=0 tx=0).stop 2023-12-20T04:51:59.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.916+0000 7f31158bd640 1 -- 172.21.15.132:0/588692566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f311015d510 msgr2=0x7f31100ca990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:51:59.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.916+0000 7f31158bd640 1 --2- 172.21.15.132:0/588692566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f311015d510 0x7f31100ca990 secure :-1 s=READY pgs=1692 cs=0 l=1 rev1=1 crypto rx=0x7f310402b8c0 tx=0x7f31040046c0 comp rx=0 tx=0).stop 2023-12-20T04:51:59.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.916+0000 7f31158bd640 1 -- 172.21.15.132:0/588692566 shutdown_connections 2023-12-20T04:51:59.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.916+0000 7f31158bd640 1 --2- 172.21.15.132:0/588692566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f30fc06a460 0x7f30fc06c920 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:59.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.916+0000 7f31158bd640 1 --2- 172.21.15.132:0/588692566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f311015df00 0x7f3110158fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:59.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.916+0000 7f31158bd640 1 --2- 172.21.15.132:0/588692566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f311015d510 0x7f31100ca990 unknown :-1 s=CLOSED pgs=1692 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:59.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.916+0000 7f31158bd640 1 --2- 172.21.15.132:0/588692566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f311015d130 0x7f311014cea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:51:59.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.916+0000 7f31158bd640 1 -- 172.21.15.132:0/588692566 >> 172.21.15.132:0/588692566 conn(0x7f31100d2eb0 msgr2=0x7f31100d3290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:51:59.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.916+0000 7f31158bd640 1 -- 172.21.15.132:0/588692566 shutdown_connections 2023-12-20T04:51:59.919 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:51:59.916+0000 7f31158bd640 1 -- 172.21.15.132:0/588692566 wait complete. 2023-12-20T04:51:59.930 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-20T04:52:00.042 INFO:teuthology.orchestra.run.smithi132.stdout:{"osd_mon_report_interval":"5"} 2023-12-20T04:52:00.043 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-20T04:52:00.043 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok --format=json config get mon_tick_interval 2023-12-20T04:52:00.149 INFO:teuthology.orchestra.run.smithi132.stdout:{"mon_tick_interval":"5"} 2023-12-20T04:52:00.149 DEBUG:tasks.cephfs.filesystem:_json_asok output { "mon_tick_interval": "5" } 2023-12-20T04:52:00.149 INFO:tasks.cephfs.test_full:pool capacity 33554432, 32MB should be enough to fill it 2023-12-20T04:52:00.149 DEBUG:teuthology.orchestra.run.smithi132:> adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> import time 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> import datetime 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> # Write some buffered data through before going full, all should be well 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> print("writing some data through which we expect to succeed") 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> bytes = 0 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> f = os.open("/home/ubuntu/cephtest/mnt.0/full_test_file", os.O_WRONLY | os.O_CREAT) 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> os.setxattr("/home/ubuntu/cephtest/mnt.0/full_test_file", '"'"'ceph.file.layout'"'"', b'"'"'stripe_unit=1048576 stripe_count=1 object_size=1048576'"'"') 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> bytes += os.write(f, b'"'"'a'"'"' * 4096) 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> os.fsync(f) 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> print("fsync'"'"'ed data successfully, will now attempt to fill fs") 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> # Okay, now we'"'"'re going to fill up the filesystem, and then keep 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> # writing until we see an error from fsync. As long as we'"'"'re doing 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> # buffered IO, the error should always only appear from fsync and not 2023-12-20T04:52:00.150 DEBUG:teuthology.orchestra.run.smithi132:> # from write 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> full = False 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> for n in range(0, int(32 * 1.1)): 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> try: 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> bytes += os.write(f, b'"'"'x'"'"' * 1024 * 1024) 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> print("wrote bytes via buffered write, moving on to fsync") 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> except OSError as e: 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> if True: 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> print("Unexpected error %s from write() instead of fsync()" % e) 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> raise 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> else: 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> full = True 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> break 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> try: 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> os.fsync(f) 2023-12-20T04:52:00.151 DEBUG:teuthology.orchestra.run.smithi132:> print("fsync'"'"'ed successfully") 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> except OSError as e: 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> print("Reached fullness after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> full = True 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> break 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> else: 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> print("Not full yet after %.2f MB" % (bytes / (1024.0 * 1024.0))) 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> if n > 32 * 0.9: 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> # Be cautious in the last region where we expect to hit 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> # the full condition, so that we don'"'"'t overshoot too dramatically 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> print("sleeping a bit as we'"'"'ve exceeded 90% of our expected full ratio") 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> time.sleep(15.0) 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> if not full: 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Failed to reach fullness after writing %d bytes" % bytes) 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> # close() should not raise an error because we already caught it in 2023-12-20T04:52:00.152 DEBUG:teuthology.orchestra.run.smithi132:> # fsync. There shouldn'"'"'t have been any more writeback errors 2023-12-20T04:52:00.153 DEBUG:teuthology.orchestra.run.smithi132:> # since then because all IOs got cancelled on the full flag. 2023-12-20T04:52:00.153 DEBUG:teuthology.orchestra.run.smithi132:> print("calling close") 2023-12-20T04:52:00.153 DEBUG:teuthology.orchestra.run.smithi132:> os.close(f) 2023-12-20T04:52:00.153 DEBUG:teuthology.orchestra.run.smithi132:> print("close() did not raise error") 2023-12-20T04:52:00.153 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:52:00.153 DEBUG:teuthology.orchestra.run.smithi132:> os.unlink("/home/ubuntu/cephtest/mnt.0/full_test_file") 2023-12-20T04:52:00.153 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:52:18.862 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:52:18.866 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:52:47.312 INFO:teuthology.orchestra.run.smithi132.stdout:writing some data through which we expect to succeed 2023-12-20T04:52:47.312 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed data successfully, will now attempt to fill fs 2023-12-20T04:52:47.312 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.313 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.313 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 1.00 MB 2023-12-20T04:52:47.313 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.313 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.313 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 2.00 MB 2023-12-20T04:52:47.313 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.313 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.313 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 3.00 MB 2023-12-20T04:52:47.313 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.313 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.313 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 4.00 MB 2023-12-20T04:52:47.313 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.314 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.314 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 5.00 MB 2023-12-20T04:52:47.314 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.314 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.314 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 6.00 MB 2023-12-20T04:52:47.314 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.314 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.314 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 7.00 MB 2023-12-20T04:52:47.314 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.314 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.314 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 8.00 MB 2023-12-20T04:52:47.314 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.314 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.314 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 9.00 MB 2023-12-20T04:52:47.315 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.315 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.315 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 10.00 MB 2023-12-20T04:52:47.315 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.315 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.315 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 11.00 MB 2023-12-20T04:52:47.315 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.315 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.315 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 12.00 MB 2023-12-20T04:52:47.315 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.315 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.315 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 13.00 MB 2023-12-20T04:52:47.315 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 14.00 MB 2023-12-20T04:52:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 15.00 MB 2023-12-20T04:52:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 16.00 MB 2023-12-20T04:52:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 17.00 MB 2023-12-20T04:52:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.316 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 18.00 MB 2023-12-20T04:52:47.317 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.317 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.317 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 19.00 MB 2023-12-20T04:52:47.317 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.317 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.317 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 20.00 MB 2023-12-20T04:52:47.317 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.317 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.317 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 21.00 MB 2023-12-20T04:52:47.317 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.317 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.317 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 22.00 MB 2023-12-20T04:52:47.317 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.317 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.318 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 23.00 MB 2023-12-20T04:52:47.318 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.318 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.318 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 24.00 MB 2023-12-20T04:52:47.318 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.318 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.318 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 25.00 MB 2023-12-20T04:52:47.318 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.318 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.318 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 26.00 MB 2023-12-20T04:52:47.318 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.318 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.318 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 27.00 MB 2023-12-20T04:52:47.318 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.319 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.319 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 28.00 MB 2023-12-20T04:52:47.319 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.319 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.319 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 29.00 MB 2023-12-20T04:52:47.319 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.319 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.319 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 30.00 MB 2023-12-20T04:52:47.319 INFO:teuthology.orchestra.run.smithi132.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-20T04:52:47.319 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.319 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.319 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 31.00 MB 2023-12-20T04:52:47.319 INFO:teuthology.orchestra.run.smithi132.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-20T04:52:47.320 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.320 INFO:teuthology.orchestra.run.smithi132.stdout:fsync'ed successfully 2023-12-20T04:52:47.320 INFO:teuthology.orchestra.run.smithi132.stdout:Not full yet after 32.00 MB 2023-12-20T04:52:47.320 INFO:teuthology.orchestra.run.smithi132.stdout:sleeping a bit as we've exceeded 90% of our expected full ratio 2023-12-20T04:52:47.320 INFO:teuthology.orchestra.run.smithi132.stdout:wrote bytes via buffered write, moving on to fsync 2023-12-20T04:52:47.320 INFO:teuthology.orchestra.run.smithi132.stdout:Reached fullness after 33.00 MB 2023-12-20T04:52:47.320 INFO:teuthology.orchestra.run.smithi132.stdout:calling close 2023-12-20T04:52:47.320 INFO:teuthology.orchestra.run.smithi132.stdout:close() did not raise error 2023-12-20T04:52:47.472 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:52:47.472 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:52:47.517 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:52:47.564 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:52:47.565 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:52:47.565 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:52:47.582 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:52:47.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.724+0000 7fbb8813c640 1 Processor -- start 2023-12-20T04:52:47.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.724+0000 7fbb8813c640 1 -- start start 2023-12-20T04:52:47.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb8813c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbb8015e2d0 0x7fbb800b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:47.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb8813c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb800cf0b0 0x7fbb800d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:47.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb8813c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbb800cd740 con 0x7fbb800cb420 2023-12-20T04:52:47.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb8813c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbb800ce230 con 0x7fbb8015e2d0 2023-12-20T04:52:47.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb8813c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800cd990 con 0x7fbb800cf0b0 2023-12-20T04:52:47.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb856d7640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbb800cb420 0x7fbb800ce9a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40562/0 (socket says 172.21.15.132:40562) 2023-12-20T04:52:47.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb856d7640 1 -- 172.21.15.132:0/450487488 learned_addr learned my addr 172.21.15.132:0/450487488 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:52:47.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb866d9640 1 --2- 172.21.15.132:0/450487488 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb800cf0b0 0x7fbb800d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:47.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb85ed8640 1 --2- 172.21.15.132:0/450487488 >> v2:172.21.15.187:3300/0 conn(0x7fbb8015e2d0 0x7fbb800b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:47.730 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb84ed6640 1 -- 172.21.15.132:0/450487488 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1577364888 0 0) 0x7fbb800cd740 con 0x7fbb800cb420 2023-12-20T04:52:47.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb84ed6640 1 -- 172.21.15.132:0/450487488 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fbb6c003520 con 0x7fbb800cb420 2023-12-20T04:52:47.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb84ed6640 1 -- 172.21.15.132:0/450487488 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2651231383 0 0) 0x7fbb6c003520 con 0x7fbb800cb420 2023-12-20T04:52:47.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb84ed6640 1 -- 172.21.15.132:0/450487488 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb800cf0b0 msgr2=0x7fbb800d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:47.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb84ed6640 1 --2- 172.21.15.132:0/450487488 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb800cf0b0 0x7fbb800d07f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:47.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb84ed6640 1 -- 172.21.15.132:0/450487488 >> v2:172.21.15.187:3300/0 conn(0x7fbb8015e2d0 msgr2=0x7fbb800b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:47.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb84ed6640 1 --2- 172.21.15.132:0/450487488 >> v2:172.21.15.187:3300/0 conn(0x7fbb8015e2d0 0x7fbb800b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:47.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb84ed6640 1 -- 172.21.15.132:0/450487488 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb800cdc70 con 0x7fbb800cb420 2023-12-20T04:52:47.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb84ed6640 1 -- 172.21.15.132:0/450487488 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fbb70001670 con 0x7fbb800cb420 2023-12-20T04:52:47.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.725+0000 7fbb84ed6640 1 -- 172.21.15.132:0/450487488 >> v1:172.21.15.132:6789/0 conn(0x7fbb800cb420 legacy=0x7fbb800ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:47.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.726+0000 7fbb84ed6640 1 --2- 172.21.15.132:0/450487488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb6c003970 0x7fbb6c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:47.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.726+0000 7fbb84ed6640 1 --2- 172.21.15.132:0/450487488 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb800cf0b0 0x7fbb6c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:47.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.726+0000 7fbb84ed6640 1 --2- 172.21.15.132:0/450487488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb6c004d00 0x7fbb6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:47.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.726+0000 7fbb84ed6640 1 -- 172.21.15.132:0/450487488 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800ce230 con 0x7fbb6c003970 2023-12-20T04:52:47.731 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.726+0000 7fbb84ed6640 1 -- 172.21.15.132:0/450487488 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800cd990 con 0x7fbb6c004d00 2023-12-20T04:52:47.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.726+0000 7fbb84ed6640 1 -- 172.21.15.132:0/450487488 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb6c00b9d0 con 0x7fbb800cf0b0 2023-12-20T04:52:47.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.726+0000 7fbb85ed8640 1 --2- 172.21.15.132:0/450487488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb6c003970 0x7fbb6c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:47.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.726+0000 7fbb866d9640 1 --2- 172.21.15.132:0/450487488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb6c004d00 0x7fbb6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:47.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.726+0000 7fbb856d7640 1 --2- 172.21.15.132:0/450487488 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb800cf0b0 0x7fbb6c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:47.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.726+0000 7fbb85ed8640 1 -- 172.21.15.132:0/450487488 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb800cf0b0 msgr2=0x7fbb6c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:47.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.726+0000 7fbb85ed8640 1 --2- 172.21.15.132:0/450487488 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb800cf0b0 0x7fbb6c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:47.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.726+0000 7fbb85ed8640 1 -- 172.21.15.132:0/450487488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb6c004d00 msgr2=0x7fbb6c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:47.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.726+0000 7fbb85ed8640 1 --2- 172.21.15.132:0/450487488 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb6c004d00 0x7fbb6c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:47.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.726+0000 7fbb85ed8640 1 -- 172.21.15.132:0/450487488 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb6c003520 con 0x7fbb6c003970 2023-12-20T04:52:47.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.727+0000 7fbb85ed8640 1 --2- 172.21.15.132:0/450487488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb6c003970 0x7fbb6c003d90 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009af0 tx=0x7fbb6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c68d8c39d3af5146 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:47.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.727+0000 7fbb84ed6640 1 -- 172.21.15.132:0/450487488 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c02c710 con 0x7fbb6c003970 2023-12-20T04:52:47.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.727+0000 7fbb84ed6640 1 -- 172.21.15.132:0/450487488 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7c02c870 con 0x7fbb6c003970 2023-12-20T04:52:47.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.727+0000 7fbb84ed6640 1 -- 172.21.15.132:0/450487488 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c02cc00 con 0x7fbb6c003970 2023-12-20T04:52:47.732 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.727+0000 7fbb8813c640 1 -- 172.21.15.132:0/450487488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb6c003970 msgr2=0x7fbb6c003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:47.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.727+0000 7fbb8813c640 1 --2- 172.21.15.132:0/450487488 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb6c003970 0x7fbb6c003d90 secure :-1 s=READY pgs=1694 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c009af0 tx=0x7fbb6c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:52:47.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.727+0000 7fbb866d9640 1 -- 172.21.15.132:0/450487488 reap_dead start 2023-12-20T04:52:47.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.727+0000 7fbb8813c640 1 -- 172.21.15.132:0/450487488 shutdown_connections 2023-12-20T04:52:47.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.727+0000 7fbb8813c640 1 -- 172.21.15.132:0/450487488 >> 172.21.15.132:0/450487488 conn(0x7fbb8006d7c0 msgr2=0x7fbb8006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:47.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.727+0000 7fbb8813c640 1 -- 172.21.15.132:0/450487488 shutdown_connections 2023-12-20T04:52:47.733 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.727+0000 7fbb8813c640 1 -- 172.21.15.132:0/450487488 wait complete. 2023-12-20T04:52:47.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.728+0000 7fbb8813c640 1 Processor -- start 2023-12-20T04:52:47.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.728+0000 7fbb8813c640 1 -- start start 2023-12-20T04:52:47.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.729+0000 7fbb8813c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb6c003970 0x7fbb800ace80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:47.735 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.729+0000 7fbb8813c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb801f3360 0x7fbb800aa6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.729+0000 7fbb8813c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb800ca610 0x7fbb800caa90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.729+0000 7fbb8813c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800ae180 con 0x7fbb6c003970 2023-12-20T04:52:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.729+0000 7fbb8813c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800cafd0 con 0x7fbb800ca610 2023-12-20T04:52:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.729+0000 7fbb8813c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbb800abb50 con 0x7fbb801f3360 2023-12-20T04:52:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.729+0000 7fbb85ed8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb6c003970 0x7fbb800ace80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.729+0000 7fbb85ed8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb6c003970 0x7fbb800ace80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52042/0 (socket says 172.21.15.132:52042) 2023-12-20T04:52:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.729+0000 7fbb85ed8640 1 -- 172.21.15.132:0/1486492438 learned_addr learned my addr 172.21.15.132:0/1486492438 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.730+0000 7fbb85ed8640 1 -- 172.21.15.132:0/1486492438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb801f3360 msgr2=0x7fbb800aa6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.730+0000 7fbb85ed8640 1 --2- 172.21.15.132:0/1486492438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb801f3360 0x7fbb800aa6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.730+0000 7fbb85ed8640 1 -- 172.21.15.132:0/1486492438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb800ca610 msgr2=0x7fbb800caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.730+0000 7fbb85ed8640 1 --2- 172.21.15.132:0/1486492438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb800ca610 0x7fbb800caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:47.736 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.730+0000 7fbb85ed8640 1 -- 172.21.15.132:0/1486492438 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb801f37e0 con 0x7fbb6c003970 2023-12-20T04:52:47.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.730+0000 7fbb85ed8640 1 --2- 172.21.15.132:0/1486492438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb6c003970 0x7fbb800ace80 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c037040 tx=0x7fbb7c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:47.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.730+0000 7fbb767fc640 1 -- 172.21.15.132:0/1486492438 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c003810 con 0x7fbb6c003970 2023-12-20T04:52:47.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.730+0000 7fbb767fc640 1 -- 172.21.15.132:0/1486492438 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbb7c02de90 con 0x7fbb6c003970 2023-12-20T04:52:47.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.730+0000 7fbb767fc640 1 -- 172.21.15.132:0/1486492438 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbb7c003b70 con 0x7fbb6c003970 2023-12-20T04:52:47.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.730+0000 7fbb8813c640 1 -- 172.21.15.132:0/1486492438 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb800aaf40 con 0x7fbb6c003970 2023-12-20T04:52:47.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.730+0000 7fbb8813c640 1 -- 172.21.15.132:0/1486492438 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb800ab500 con 0x7fbb6c003970 2023-12-20T04:52:47.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.731+0000 7fbb8813c640 1 -- 172.21.15.132:0/1486492438 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb8004e840 con 0x7fbb6c003970 2023-12-20T04:52:47.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.731+0000 7fbb767fc640 1 -- 172.21.15.132:0/1486492438 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbb7c003cd0 con 0x7fbb6c003970 2023-12-20T04:52:47.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.732+0000 7fbb767fc640 1 --2- 172.21.15.132:0/1486492438 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb6406a460 0x7fbb6406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:47.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.732+0000 7fbb767fc640 1 -- 172.21.15.132:0/1486492438 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fbb7c0aa770 con 0x7fbb6c003970 2023-12-20T04:52:47.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.732+0000 7fbb856d7640 1 --2- 172.21.15.132:0/1486492438 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb6406a460 0x7fbb6406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:47.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.732+0000 7fbb767fc640 1 -- 172.21.15.132:0/1486492438 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7fbb64071ff0 con 0x7fbb6c003970 2023-12-20T04:52:47.737 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.732+0000 7fbb856d7640 1 --2- 172.21.15.132:0/1486492438 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb6406a460 0x7fbb6406c920 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fbb70000f60 tx=0x7fbb70000ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:47.738 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.736+0000 7fbb767fc640 1 -- 172.21.15.132:0/1486492438 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbb7c04c060 con 0x7fbb6c003970 2023-12-20T04:52:47.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.902+0000 7fbb8813c640 1 -- 172.21.15.132:0/1486492438 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fbb800ce480 con 0x7fbb6c003970 2023-12-20T04:52:47.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.903+0000 7fbb767fc640 1 -- 172.21.15.132:0/1486492438 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+16236 (secure 0 0 0) 0x7fbb7c04c090 con 0x7fbb6c003970 2023-12-20T04:52:47.906 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:52:47.906 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":173,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:52:39.899511+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:51:44.739391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-20T04:51:45.486167+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.14","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:52:47.907 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.905+0000 7fbb8813c640 1 -- 172.21.15.132:0/1486492438 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb6406a460 msgr2=0x7fbb6406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:47.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.905+0000 7fbb8813c640 1 --2- 172.21.15.132:0/1486492438 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb6406a460 0x7fbb6406c920 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7fbb70000f60 tx=0x7fbb70000ed0 comp rx=0 tx=0).stop 2023-12-20T04:52:47.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.905+0000 7fbb8813c640 1 -- 172.21.15.132:0/1486492438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb6c003970 msgr2=0x7fbb800ace80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:47.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.905+0000 7fbb8813c640 1 --2- 172.21.15.132:0/1486492438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb6c003970 0x7fbb800ace80 secure :-1 s=READY pgs=1695 cs=0 l=1 rev1=1 crypto rx=0x7fbb7c037040 tx=0x7fbb7c004730 comp rx=0 tx=0).stop 2023-12-20T04:52:47.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.905+0000 7fbb8813c640 1 -- 172.21.15.132:0/1486492438 shutdown_connections 2023-12-20T04:52:47.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.905+0000 7fbb8813c640 1 --2- 172.21.15.132:0/1486492438 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbb6406a460 0x7fbb6406c920 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:47.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.905+0000 7fbb8813c640 1 --2- 172.21.15.132:0/1486492438 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbb800ca610 0x7fbb800caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:47.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.905+0000 7fbb8813c640 1 --2- 172.21.15.132:0/1486492438 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbb801f3360 0x7fbb800aa6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:47.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.905+0000 7fbb8813c640 1 --2- 172.21.15.132:0/1486492438 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbb6c003970 0x7fbb800ace80 unknown :-1 s=CLOSED pgs=1695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:47.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.905+0000 7fbb8813c640 1 -- 172.21.15.132:0/1486492438 >> 172.21.15.132:0/1486492438 conn(0x7fbb8006d7c0 msgr2=0x7fbb8015d550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:47.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.905+0000 7fbb8813c640 1 -- 172.21.15.132:0/1486492438 shutdown_connections 2023-12-20T04:52:47.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:47.905+0000 7fbb8813c640 1 -- 172.21.15.132:0/1486492438 wait complete. 2023-12-20T04:52:47.918 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:51:44.739391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '168', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:51:45.486167+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:52:47.919 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:52:48.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.020+0000 7f0ea00cf640 1 Processor -- start 2023-12-20T04:52:48.022 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.020+0000 7f0ea00cf640 1 -- start start 2023-12-20T04:52:48.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.021+0000 7f0ea00cf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e980cb780 0x7f0e980cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.021+0000 7f0ea00cf640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e980cf750 con 0x7f0e9815e0c0 2023-12-20T04:52:48.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.021+0000 7f0ea00cf640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0e980cf9e0 con 0x7f0e980cbb60 2023-12-20T04:52:48.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.021+0000 7f0ea00cf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980cfcc0 con 0x7f0e980cb780 2023-12-20T04:52:48.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.021+0000 7f0e9e66c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0e9815e0c0 0x7f0e980b1280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40564/0 (socket says 172.21.15.132:40564) 2023-12-20T04:52:48.026 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.021+0000 7f0e9e66c640 1 -- 172.21.15.132:0/3883397309 learned_addr learned my addr 172.21.15.132:0/3883397309 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:52:48.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9ce69640 1 -- 172.21.15.132:0/3883397309 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2501530670 0 0) 0x7f0e980cf750 con 0x7f0e9815e0c0 2023-12-20T04:52:48.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9ce69640 1 -- 172.21.15.132:0/3883397309 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0e84003520 con 0x7f0e9815e0c0 2023-12-20T04:52:48.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9de6b640 1 --2- 172.21.15.132:0/3883397309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e980cb780 0x7f0e980cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9ce69640 1 -- 172.21.15.132:0/3883397309 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3199935832 0 0) 0x7f0e84003520 con 0x7f0e9815e0c0 2023-12-20T04:52:48.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9ce69640 1 -- 172.21.15.132:0/3883397309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e980cb780 msgr2=0x7f0e980cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:48.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9ce69640 1 --2- 172.21.15.132:0/3883397309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e980cb780 0x7f0e980cd3e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9ce69640 1 -- 172.21.15.132:0/3883397309 >> v1:172.21.15.187:6789/0 conn(0x7f0e980cbb60 legacy=0x7f0e980cf040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9ce69640 1 -- 172.21.15.132:0/3883397309 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e980cffa0 con 0x7f0e9815e0c0 2023-12-20T04:52:48.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9ce69640 1 -- 172.21.15.132:0/3883397309 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f0e90001670 con 0x7f0e9815e0c0 2023-12-20T04:52:48.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9ce69640 1 -- 172.21.15.132:0/3883397309 >> v1:172.21.15.132:6789/0 conn(0x7f0e9815e0c0 legacy=0x7f0e980b1280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9ce69640 1 --2- 172.21.15.132:0/3883397309 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e840039a0 0x7f0e84003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9ce69640 1 --2- 172.21.15.132:0/3883397309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e980cb780 0x7f0e840047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9ce69640 1 --2- 172.21.15.132:0/3883397309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e84004d00 0x7f0e84005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9ce69640 1 -- 172.21.15.132:0/3883397309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980cfcc0 con 0x7f0e84004d00 2023-12-20T04:52:48.027 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9ce69640 1 -- 172.21.15.132:0/3883397309 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8400ba30 con 0x7f0e840039a0 2023-12-20T04:52:48.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9ce69640 1 -- 172.21.15.132:0/3883397309 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e8400bbf0 con 0x7f0e980cb780 2023-12-20T04:52:48.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9e66c640 1 --2- 172.21.15.132:0/3883397309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e84004d00 0x7f0e84005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9de6b640 1 --2- 172.21.15.132:0/3883397309 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e840039a0 0x7f0e84003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9d66a640 1 --2- 172.21.15.132:0/3883397309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e980cb780 0x7f0e840047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9e66c640 1 -- 172.21.15.132:0/3883397309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e980cb780 msgr2=0x7f0e840047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:48.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9e66c640 1 --2- 172.21.15.132:0/3883397309 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e980cb780 0x7f0e840047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9e66c640 1 -- 172.21.15.132:0/3883397309 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e840039a0 msgr2=0x7f0e84003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:48.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9e66c640 1 --2- 172.21.15.132:0/3883397309 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e840039a0 0x7f0e84003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.022+0000 7f0e9e66c640 1 -- 172.21.15.132:0/3883397309 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e84003520 con 0x7f0e84004d00 2023-12-20T04:52:48.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.023+0000 7f0e9e66c640 1 --2- 172.21.15.132:0/3883397309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e84004d00 0x7f0e84005180 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f0e90007fd0 tx=0x7f0e840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=659d4bca5d41f6dd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:48.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.023+0000 7f0e9ce69640 1 -- 172.21.15.132:0/3883397309 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e90005ad0 con 0x7f0e84004d00 2023-12-20T04:52:48.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.023+0000 7f0e9ce69640 1 -- 172.21.15.132:0/3883397309 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e90005c30 con 0x7f0e84004d00 2023-12-20T04:52:48.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.023+0000 7f0e9ce69640 1 -- 172.21.15.132:0/3883397309 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e9002c870 con 0x7f0e84004d00 2023-12-20T04:52:48.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.024+0000 7f0ea00cf640 1 -- 172.21.15.132:0/3883397309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e84004d00 msgr2=0x7f0e84005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.024+0000 7f0ea00cf640 1 --2- 172.21.15.132:0/3883397309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e84004d00 0x7f0e84005180 secure :-1 s=READY pgs=1697 cs=0 l=1 rev1=1 crypto rx=0x7f0e90007fd0 tx=0x7f0e840057f0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.024+0000 7f0e9e66c640 1 -- 172.21.15.132:0/3883397309 reap_dead start 2023-12-20T04:52:48.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.024+0000 7f0ea00cf640 1 -- 172.21.15.132:0/3883397309 shutdown_connections 2023-12-20T04:52:48.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.024+0000 7f0ea00cf640 1 -- 172.21.15.132:0/3883397309 >> 172.21.15.132:0/3883397309 conn(0x7f0e9806bfc0 msgr2=0x7f0e9806c3d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:48.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.024+0000 7f0ea00cf640 1 -- 172.21.15.132:0/3883397309 shutdown_connections 2023-12-20T04:52:48.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.024+0000 7f0ea00cf640 1 -- 172.21.15.132:0/3883397309 wait complete. 2023-12-20T04:52:48.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.025+0000 7f0ea00cf640 1 Processor -- start 2023-12-20T04:52:48.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.025+0000 7f0ea00cf640 1 -- start start 2023-12-20T04:52:48.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0ea00cf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e98157dd0 0x7f0e98160280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0ea00cf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e9815e5e0 0x7f0e980ca1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0ea00cf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e980ca730 0x7f0e981f27f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0ea00cf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980b54c0 con 0x7f0e9815e5e0 2023-12-20T04:52:48.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0ea00cf640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0e980cabb0 con 0x7f0e980ca730 2023-12-20T04:52:48.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0ea00cf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0e981587c0 con 0x7f0e98157dd0 2023-12-20T04:52:48.032 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0e9d66a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e9815e5e0 0x7f0e980ca1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0e9d66a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e9815e5e0 0x7f0e980ca1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52052/0 (socket says 172.21.15.132:52052) 2023-12-20T04:52:48.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0e9d66a640 1 -- 172.21.15.132:0/2887588290 learned_addr learned my addr 172.21.15.132:0/2887588290 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:48.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0e9de6b640 1 --2- 172.21.15.132:0/2887588290 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e98157dd0 0x7f0e98160280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0e9e66c640 1 --2- 172.21.15.132:0/2887588290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e980ca730 0x7f0e981f27f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0e9d66a640 1 -- 172.21.15.132:0/2887588290 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e98157dd0 msgr2=0x7f0e98160280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0e9d66a640 1 --2- 172.21.15.132:0/2887588290 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e98157dd0 0x7f0e98160280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0e9d66a640 1 -- 172.21.15.132:0/2887588290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e980ca730 msgr2=0x7f0e981f27f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0e9d66a640 1 --2- 172.21.15.132:0/2887588290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e980ca730 0x7f0e981f27f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0e9d66a640 1 -- 172.21.15.132:0/2887588290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0e98160940 con 0x7f0e9815e5e0 2023-12-20T04:52:48.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0e9de6b640 1 --2- 172.21.15.132:0/2887588290 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e98157dd0 0x7f0e98160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:52:48.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0e9d66a640 1 --2- 172.21.15.132:0/2887588290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e9815e5e0 0x7f0e980ca1f0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800f820 tx=0x7f0e8800fce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:48.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0e8e7fc640 1 -- 172.21.15.132:0/2887588290 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e880050d0 con 0x7f0e9815e5e0 2023-12-20T04:52:48.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0e8e7fc640 1 -- 172.21.15.132:0/2887588290 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0e88005230 con 0x7f0e9815e5e0 2023-12-20T04:52:48.033 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0ea00cf640 1 -- 172.21.15.132:0/2887588290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0e98160c20 con 0x7f0e9815e5e0 2023-12-20T04:52:48.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0e8e7fc640 1 -- 172.21.15.132:0/2887588290 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0e8800d730 con 0x7f0e9815e5e0 2023-12-20T04:52:48.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.026+0000 7f0ea00cf640 1 -- 172.21.15.132:0/2887588290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0e981611e0 con 0x7f0e9815e5e0 2023-12-20T04:52:48.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.027+0000 7f0ea00cf640 1 -- 172.21.15.132:0/2887588290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0e9804e840 con 0x7f0e9815e5e0 2023-12-20T04:52:48.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.028+0000 7f0e8e7fc640 1 -- 172.21.15.132:0/2887588290 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0e8800d890 con 0x7f0e9815e5e0 2023-12-20T04:52:48.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.028+0000 7f0e8e7fc640 1 --2- 172.21.15.132:0/2887588290 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e7c06a430 0x7f0e7c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.028+0000 7f0e8e7fc640 1 -- 172.21.15.132:0/2887588290 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f0e880888b0 con 0x7f0e9815e5e0 2023-12-20T04:52:48.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.028+0000 7f0e9de6b640 1 --2- 172.21.15.132:0/2887588290 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e7c06a430 0x7f0e7c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.028+0000 7f0e8e7fc640 1 -- 172.21.15.132:0/2887588290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7f0e7c071fc0 con 0x7f0e9815e5e0 2023-12-20T04:52:48.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.029+0000 7f0e9de6b640 1 --2- 172.21.15.132:0/2887588290 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e7c06a430 0x7f0e7c06c8f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0e940074d0 tx=0x7f0e9400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:48.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.032+0000 7f0e8e7fc640 1 -- 172.21.15.132:0/2887588290 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0e88053e70 con 0x7f0e9815e5e0 2023-12-20T04:52:48.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.199+0000 7f0ea00cf640 1 -- 172.21.15.132:0/2887588290 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f0e980cc3f0 con 0x7f0e9815e5e0 2023-12-20T04:52:48.201 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.199+0000 7f0e8e7fc640 1 -- 172.21.15.132:0/2887588290 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v173) v1 ==== 93+0+10 (secure 0 0 0) 0x7f0e88057490 con 0x7f0e9815e5e0 2023-12-20T04:52:48.201 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:52:48.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.201+0000 7f0ea00cf640 1 -- 172.21.15.132:0/2887588290 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e7c06a430 msgr2=0x7f0e7c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.203 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.201+0000 7f0ea00cf640 1 --2- 172.21.15.132:0/2887588290 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e7c06a430 0x7f0e7c06c8f0 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7f0e940074d0 tx=0x7f0e9400b040 comp rx=0 tx=0).stop 2023-12-20T04:52:48.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.201+0000 7f0ea00cf640 1 -- 172.21.15.132:0/2887588290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e9815e5e0 msgr2=0x7f0e980ca1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.201+0000 7f0ea00cf640 1 --2- 172.21.15.132:0/2887588290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e9815e5e0 0x7f0e980ca1f0 secure :-1 s=READY pgs=1698 cs=0 l=1 rev1=1 crypto rx=0x7f0e8800f820 tx=0x7f0e8800fce0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.201+0000 7f0ea00cf640 1 -- 172.21.15.132:0/2887588290 shutdown_connections 2023-12-20T04:52:48.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.201+0000 7f0ea00cf640 1 --2- 172.21.15.132:0/2887588290 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0e7c06a430 0x7f0e7c06c8f0 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.201+0000 7f0ea00cf640 1 --2- 172.21.15.132:0/2887588290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0e980ca730 0x7f0e981f27f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.201+0000 7f0ea00cf640 1 --2- 172.21.15.132:0/2887588290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0e9815e5e0 0x7f0e980ca1f0 unknown :-1 s=CLOSED pgs=1698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.201+0000 7f0ea00cf640 1 --2- 172.21.15.132:0/2887588290 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0e98157dd0 0x7f0e98160280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.201+0000 7f0ea00cf640 1 -- 172.21.15.132:0/2887588290 >> 172.21.15.132:0/2887588290 conn(0x7f0e9806bfc0 msgr2=0x7f0e9815c8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:48.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.201+0000 7f0ea00cf640 1 -- 172.21.15.132:0/2887588290 shutdown_connections 2023-12-20T04:52:48.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.201+0000 7f0ea00cf640 1 -- 172.21.15.132:0/2887588290 wait complete. 2023-12-20T04:52:48.214 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:52:48.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.313+0000 7f3fffda3640 1 Processor -- start 2023-12-20T04:52:48.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.314+0000 7f3fffda3640 1 -- start start 2023-12-20T04:52:48.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.314+0000 7f3fffda3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3ff8070460 0x7f3ff80708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.314+0000 7f3fffda3640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3ff80cd7d0 0x7f3ff80cdbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.314+0000 7f3fffda3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3ff80cb6b0 con 0x7f3ff80cf1d0 2023-12-20T04:52:48.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.314+0000 7f3fffda3640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff8070e30 con 0x7f3ff8070460 2023-12-20T04:52:48.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.314+0000 7f3fffda3640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3ff80cb990 con 0x7f3ff80cd7d0 2023-12-20T04:52:48.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.315+0000 7f3ffd33e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3ff8070460 0x7f3ff80708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.315+0000 7f3ffdb3f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3ff80cf1d0 0x7f3ff815e200 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40568/0 (socket says 172.21.15.132:40568) 2023-12-20T04:52:48.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.315+0000 7f3ffdb3f640 1 -- 172.21.15.132:0/3070722530 learned_addr learned my addr 172.21.15.132:0/3070722530 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:52:48.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.315+0000 7f3ffd33e640 1 -- 172.21.15.132:0/3070722530 >> v2:172.21.15.187:3300/0 conn(0x7f3ff80cd7d0 msgr2=0x7f3ff80cdbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:48.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.315+0000 7f3ffe340640 1 --2- 172.21.15.132:0/3070722530 >> v2:172.21.15.187:3300/0 conn(0x7f3ff80cd7d0 0x7f3ff80cdbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.315+0000 7f3ffd33e640 1 --2- 172.21.15.132:0/3070722530 >> v2:172.21.15.187:3300/0 conn(0x7f3ff80cd7d0 0x7f3ff80cdbb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.315+0000 7f3ffcb3d640 1 -- 172.21.15.132:0/3070722530 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2664666941 0 0) 0x7f3ff80cb6b0 con 0x7f3ff80cf1d0 2023-12-20T04:52:48.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.315+0000 7f3ffd33e640 1 -- 172.21.15.132:0/3070722530 >> v1:172.21.15.132:6789/0 conn(0x7f3ff80cf1d0 legacy=0x7f3ff815e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.315+0000 7f3ffd33e640 1 -- 172.21.15.132:0/3070722530 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ff80cbc70 con 0x7f3ff8070460 2023-12-20T04:52:48.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.316+0000 7f3ffd33e640 1 --2- 172.21.15.132:0/3070722530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ff8070460 0x7f3ff80708f0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80cd670 tx=0x7f3fe802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5304e88b026bb4ef server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:48.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.316+0000 7f3ffcb3d640 1 -- 172.21.15.132:0/3070722530 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8031830 con 0x7f3ff8070460 2023-12-20T04:52:48.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.316+0000 7f3ffcb3d640 1 -- 172.21.15.132:0/3070722530 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3fe8031990 con 0x7f3ff8070460 2023-12-20T04:52:48.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.316+0000 7f3ffcb3d640 1 -- 172.21.15.132:0/3070722530 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3fe8031d20 con 0x7f3ff8070460 2023-12-20T04:52:48.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.316+0000 7f3fffda3640 1 -- 172.21.15.132:0/3070722530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ff8070460 msgr2=0x7f3ff80708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.316+0000 7f3fffda3640 1 --2- 172.21.15.132:0/3070722530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ff8070460 0x7f3ff80708f0 secure :-1 s=READY pgs=1700 cs=0 l=1 rev1=1 crypto rx=0x7f3ff80cd670 tx=0x7f3fe802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.316+0000 7f3fffda3640 1 -- 172.21.15.132:0/3070722530 shutdown_connections 2023-12-20T04:52:48.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.316+0000 7f3fffda3640 1 --2- 172.21.15.132:0/3070722530 >> v2:172.21.15.187:3300/0 conn(0x7f3ff80cd7d0 0x7f3ff80cdbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.316+0000 7f3fffda3640 1 --2- 172.21.15.132:0/3070722530 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ff8070460 0x7f3ff80708f0 unknown :-1 s=CLOSED pgs=1700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.316+0000 7f3fffda3640 1 -- 172.21.15.132:0/3070722530 >> 172.21.15.132:0/3070722530 conn(0x7f3ff80cc630 msgr2=0x7f3ff80cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:48.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.316+0000 7f3fffda3640 1 -- 172.21.15.132:0/3070722530 shutdown_connections 2023-12-20T04:52:48.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.316+0000 7f3fffda3640 1 -- 172.21.15.132:0/3070722530 wait complete. 2023-12-20T04:52:48.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.317+0000 7f3fffda3640 1 Processor -- start 2023-12-20T04:52:48.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.318+0000 7f3fffda3640 1 -- start start 2023-12-20T04:52:48.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.318+0000 7f3fffda3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ff8070460 0x7f3ff8155550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.318+0000 7f3fffda3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ff80cd7d0 0x7f3ff80c7b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.318+0000 7f3fffda3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ff80cf1d0 0x7f3ff80c6bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.318+0000 7f3fffda3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80c8040 con 0x7f3ff8070460 2023-12-20T04:52:48.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.318+0000 7f3fffda3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff80c8c70 con 0x7f3ff80cd7d0 2023-12-20T04:52:48.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.318+0000 7f3fffda3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3ff815cc30 con 0x7f3ff80cf1d0 2023-12-20T04:52:48.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.318+0000 7f3ffdb3f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ff8070460 0x7f3ff8155550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.318+0000 7f3ffdb3f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ff8070460 0x7f3ff8155550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52068/0 (socket says 172.21.15.132:52068) 2023-12-20T04:52:48.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.318+0000 7f3ffdb3f640 1 -- 172.21.15.132:0/2353952109 learned_addr learned my addr 172.21.15.132:0/2353952109 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:48.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.319+0000 7f3ffdb3f640 1 -- 172.21.15.132:0/2353952109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ff80cf1d0 msgr2=0x7f3ff80c6bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.319+0000 7f3ffdb3f640 1 --2- 172.21.15.132:0/2353952109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ff80cf1d0 0x7f3ff80c6bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.319+0000 7f3ffdb3f640 1 -- 172.21.15.132:0/2353952109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ff80cd7d0 msgr2=0x7f3ff80c7b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.319+0000 7f3ffd33e640 1 --2- 172.21.15.132:0/2353952109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ff80cd7d0 0x7f3ff80c7b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.319+0000 7f3ffdb3f640 1 --2- 172.21.15.132:0/2353952109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ff80cd7d0 0x7f3ff80c7b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.323 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.319+0000 7f3ffdb3f640 1 -- 172.21.15.132:0/2353952109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fe8009400 con 0x7f3ff8070460 2023-12-20T04:52:48.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.319+0000 7f3ffdb3f640 1 --2- 172.21.15.132:0/2353952109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ff8070460 0x7f3ff8155550 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400c430 tx=0x7f3ff400c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:48.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.319+0000 7f3fee7fc640 1 -- 172.21.15.132:0/2353952109 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff40074e0 con 0x7f3ff8070460 2023-12-20T04:52:48.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.319+0000 7f3fee7fc640 1 -- 172.21.15.132:0/2353952109 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff4007660 con 0x7f3ff8070460 2023-12-20T04:52:48.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.319+0000 7f3fee7fc640 1 -- 172.21.15.132:0/2353952109 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff4004a20 con 0x7f3ff8070460 2023-12-20T04:52:48.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.319+0000 7f3fffda3640 1 -- 172.21.15.132:0/2353952109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ff815cf10 con 0x7f3ff8070460 2023-12-20T04:52:48.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.319+0000 7f3fffda3640 1 -- 172.21.15.132:0/2353952109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ff815e3b0 con 0x7f3ff8070460 2023-12-20T04:52:48.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.320+0000 7f3fffda3640 1 -- 172.21.15.132:0/2353952109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ff815d0a0 con 0x7f3ff8070460 2023-12-20T04:52:48.324 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.320+0000 7f3fee7fc640 1 -- 172.21.15.132:0/2353952109 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3ff4004b80 con 0x7f3ff8070460 2023-12-20T04:52:48.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.321+0000 7f3fee7fc640 1 --2- 172.21.15.132:0/2353952109 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3fdc06a430 0x7f3fdc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.321+0000 7f3ffd33e640 1 --2- 172.21.15.132:0/2353952109 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3fdc06a430 0x7f3fdc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.321+0000 7f3fee7fc640 1 -- 172.21.15.132:0/2353952109 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f3ff4088720 con 0x7f3ff8070460 2023-12-20T04:52:48.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.321+0000 7f3fee7fc640 1 -- 172.21.15.132:0/2353952109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7f3fdc071fc0 con 0x7f3ff8070460 2023-12-20T04:52:48.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.321+0000 7f3ffd33e640 1 --2- 172.21.15.132:0/2353952109 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3fdc06a430 0x7f3fdc06c8f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8036000 tx=0x7f3fe8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:48.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.325+0000 7f3fee7fc640 1 -- 172.21.15.132:0/2353952109 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3ff4053d80 con 0x7f3ff8070460 2023-12-20T04:52:48.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.490+0000 7f3fffda3640 1 -- 172.21.15.132:0/2353952109 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f3ff804e840 con 0x7f3ff8070460 2023-12-20T04:52:48.492 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.491+0000 7f3fee7fc640 1 -- 172.21.15.132:0/2353952109 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v173) v1 ==== 104+0+11 (secure 0 0 0) 0x7f3ff40573a0 con 0x7f3ff8070460 2023-12-20T04:52:48.492 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:52:48.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.492+0000 7f3fffda3640 1 -- 172.21.15.132:0/2353952109 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3fdc06a430 msgr2=0x7f3fdc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.492+0000 7f3fffda3640 1 --2- 172.21.15.132:0/2353952109 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3fdc06a430 0x7f3fdc06c8f0 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7f3fe8036000 tx=0x7f3fe8008030 comp rx=0 tx=0).stop 2023-12-20T04:52:48.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.492+0000 7f3fffda3640 1 -- 172.21.15.132:0/2353952109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ff8070460 msgr2=0x7f3ff8155550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.492+0000 7f3fffda3640 1 --2- 172.21.15.132:0/2353952109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ff8070460 0x7f3ff8155550 secure :-1 s=READY pgs=1701 cs=0 l=1 rev1=1 crypto rx=0x7f3ff400c430 tx=0x7f3ff400c8f0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.492+0000 7f3fffda3640 1 -- 172.21.15.132:0/2353952109 shutdown_connections 2023-12-20T04:52:48.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.492+0000 7f3fffda3640 1 --2- 172.21.15.132:0/2353952109 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3fdc06a430 0x7f3fdc06c8f0 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.492+0000 7f3fffda3640 1 --2- 172.21.15.132:0/2353952109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3ff80cf1d0 0x7f3ff80c6bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.492+0000 7f3fffda3640 1 --2- 172.21.15.132:0/2353952109 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3ff80cd7d0 0x7f3ff80c7b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.492+0000 7f3fffda3640 1 --2- 172.21.15.132:0/2353952109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3ff8070460 0x7f3ff8155550 unknown :-1 s=CLOSED pgs=1701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.492+0000 7f3fffda3640 1 -- 172.21.15.132:0/2353952109 >> 172.21.15.132:0/2353952109 conn(0x7f3ff80cc630 msgr2=0x7f3ff80ce7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:48.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.492+0000 7f3fffda3640 1 -- 172.21.15.132:0/2353952109 shutdown_connections 2023-12-20T04:52:48.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.493+0000 7f3fffda3640 1 -- 172.21.15.132:0/2353952109 wait complete. 2023-12-20T04:52:48.505 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:52:48.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.605+0000 7f8cdcd16640 1 Processor -- start 2023-12-20T04:52:48.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.605+0000 7f8cdcd16640 1 -- start start 2023-12-20T04:52:48.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.606+0000 7f8cdcd16640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd80cfc40 0x7f8cd80b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.606+0000 7f8cdcd16640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd80d2920 con 0x7f8cd80cf790 2023-12-20T04:52:48.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.606+0000 7f8cdcd16640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8cd80d1d10 con 0x7f8cd815d300 2023-12-20T04:52:48.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.606+0000 7f8cdcd16640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80d1ff0 con 0x7f8cd80cfc40 2023-12-20T04:52:48.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.606+0000 7f8cd5d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8cd80cf790 0x7f8cd80b6080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40574/0 (socket says 172.21.15.132:40574) 2023-12-20T04:52:48.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.606+0000 7f8cd5d9b640 1 -- 172.21.15.132:0/4176119207 learned_addr learned my addr 172.21.15.132:0/4176119207 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:52:48.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd6d9d640 1 --2- 172.21.15.132:0/4176119207 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd80cfc40 0x7f8cd80b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd559a640 1 -- 172.21.15.132:0/4176119207 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2349955751 0 0) 0x7f8cd80d2920 con 0x7f8cd80cf790 2023-12-20T04:52:48.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd559a640 1 -- 172.21.15.132:0/4176119207 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8cc0003520 con 0x7f8cd80cf790 2023-12-20T04:52:48.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd559a640 1 -- 172.21.15.132:0/4176119207 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2302215982 0 0) 0x7f8cc0003520 con 0x7f8cd80cf790 2023-12-20T04:52:48.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd559a640 1 -- 172.21.15.132:0/4176119207 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd80cfc40 msgr2=0x7f8cd80b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:48.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd559a640 1 --2- 172.21.15.132:0/4176119207 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd80cfc40 0x7f8cd80b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd559a640 1 -- 172.21.15.132:0/4176119207 >> v1:172.21.15.187:6789/0 conn(0x7f8cd815d300 legacy=0x7f8cd80d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd559a640 1 -- 172.21.15.132:0/4176119207 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd80d22d0 con 0x7f8cd80cf790 2023-12-20T04:52:48.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd559a640 1 -- 172.21.15.132:0/4176119207 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f8ccc001670 con 0x7f8cd80cf790 2023-12-20T04:52:48.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd559a640 1 -- 172.21.15.132:0/4176119207 >> v1:172.21.15.132:6789/0 conn(0x7f8cd80cf790 legacy=0x7f8cd80b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd559a640 1 --2- 172.21.15.132:0/4176119207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cc00039a0 0x7f8cc0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd559a640 1 --2- 172.21.15.132:0/4176119207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cc00047c0 0x7f8cc0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd559a640 1 --2- 172.21.15.132:0/4176119207 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd80cfc40 0x7f8cc0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd559a640 1 -- 172.21.15.132:0/4176119207 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd80d1ff0 con 0x7f8cc00039a0 2023-12-20T04:52:48.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd559a640 1 -- 172.21.15.132:0/4176119207 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc000ba30 con 0x7f8cc00047c0 2023-12-20T04:52:48.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd559a640 1 -- 172.21.15.132:0/4176119207 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cc000bbf0 con 0x7f8cd80cfc40 2023-12-20T04:52:48.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd659c640 1 --2- 172.21.15.132:0/4176119207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cc00039a0 0x7f8cc0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd5d9b640 1 --2- 172.21.15.132:0/4176119207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cc00047c0 0x7f8cc0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd6d9d640 1 --2- 172.21.15.132:0/4176119207 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd80cfc40 0x7f8cc0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd659c640 1 -- 172.21.15.132:0/4176119207 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd80cfc40 msgr2=0x7f8cc0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:48.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd659c640 1 --2- 172.21.15.132:0/4176119207 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd80cfc40 0x7f8cc0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd659c640 1 -- 172.21.15.132:0/4176119207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cc00047c0 msgr2=0x7f8cc0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:48.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd659c640 1 --2- 172.21.15.132:0/4176119207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cc00047c0 0x7f8cc0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd659c640 1 -- 172.21.15.132:0/4176119207 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cc0003520 con 0x7f8cc00039a0 2023-12-20T04:52:48.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.607+0000 7f8cd5d9b640 1 --2- 172.21.15.132:0/4176119207 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cc00047c0 0x7f8cc0004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:52:48.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.608+0000 7f8cd659c640 1 --2- 172.21.15.132:0/4176119207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cc00039a0 0x7f8cc0003dc0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8001e20 tx=0x7f8cc00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9812acd3843ea8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:48.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.608+0000 7f8cd559a640 1 -- 172.21.15.132:0/4176119207 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8003b70 con 0x7f8cc00039a0 2023-12-20T04:52:48.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.608+0000 7f8cd559a640 1 -- 172.21.15.132:0/4176119207 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8cc8003cd0 con 0x7f8cc00039a0 2023-12-20T04:52:48.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.608+0000 7f8cd559a640 1 -- 172.21.15.132:0/4176119207 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8cc8005310 con 0x7f8cc00039a0 2023-12-20T04:52:48.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.609+0000 7f8cdcd16640 1 -- 172.21.15.132:0/4176119207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cc00039a0 msgr2=0x7f8cc0003dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.609+0000 7f8cdcd16640 1 --2- 172.21.15.132:0/4176119207 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cc00039a0 0x7f8cc0003dc0 secure :-1 s=READY pgs=1703 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8001e20 tx=0x7f8cc00057f0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.609+0000 7f8cd6d9d640 1 -- 172.21.15.132:0/4176119207 reap_dead start 2023-12-20T04:52:48.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.609+0000 7f8cdcd16640 1 -- 172.21.15.132:0/4176119207 shutdown_connections 2023-12-20T04:52:48.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.609+0000 7f8cdcd16640 1 -- 172.21.15.132:0/4176119207 >> 172.21.15.132:0/4176119207 conn(0x7f8cd806a3d0 msgr2=0x7f8cd806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:48.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.609+0000 7f8cdcd16640 1 -- 172.21.15.132:0/4176119207 shutdown_connections 2023-12-20T04:52:48.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.609+0000 7f8cdcd16640 1 -- 172.21.15.132:0/4176119207 wait complete. 2023-12-20T04:52:48.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.610+0000 7f8cdcd16640 1 Processor -- start 2023-12-20T04:52:48.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.610+0000 7f8cdcd16640 1 -- start start 2023-12-20T04:52:48.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.611+0000 7f8cdcd16640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cc00039a0 0x7f8cd80b5440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.611+0000 7f8cdcd16640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cd80caf80 0x7f8cd815fd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.611+0000 7f8cdcd16640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd8145250 0x7f8cd81456d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.611+0000 7f8cdcd16640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8144dc0 con 0x7f8cd80caf80 2023-12-20T04:52:48.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.611+0000 7f8cdcd16640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd81441b0 con 0x7f8cc00039a0 2023-12-20T04:52:48.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.611+0000 7f8cdcd16640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd8144490 con 0x7f8cd8145250 2023-12-20T04:52:48.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.611+0000 7f8cd5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cd80caf80 0x7f8cd815fd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.611+0000 7f8cd5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cd80caf80 0x7f8cd815fd50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52074/0 (socket says 172.21.15.132:52074) 2023-12-20T04:52:48.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.611+0000 7f8cd5d9b640 1 -- 172.21.15.132:0/2902597214 learned_addr learned my addr 172.21.15.132:0/2902597214 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:48.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.611+0000 7f8cd659c640 1 --2- 172.21.15.132:0/2902597214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cc00039a0 0x7f8cd80b5440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.611+0000 7f8cd6d9d640 1 --2- 172.21.15.132:0/2902597214 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd8145250 0x7f8cd81456d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.611+0000 7f8cd5d9b640 1 -- 172.21.15.132:0/2902597214 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd8145250 msgr2=0x7f8cd81456d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.617 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.611+0000 7f8cd5d9b640 1 --2- 172.21.15.132:0/2902597214 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd8145250 0x7f8cd81456d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.611+0000 7f8cd5d9b640 1 -- 172.21.15.132:0/2902597214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cc00039a0 msgr2=0x7f8cd80b5440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.611+0000 7f8cd5d9b640 1 --2- 172.21.15.132:0/2902597214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cc00039a0 0x7f8cd80b5440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.611+0000 7f8cd5d9b640 1 -- 172.21.15.132:0/2902597214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd8144770 con 0x7f8cd80caf80 2023-12-20T04:52:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.612+0000 7f8cd5d9b640 1 --2- 172.21.15.132:0/2902597214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cd80caf80 0x7f8cd815fd50 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc001bd0 tx=0x7f8ccc00ebd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.612+0000 7f8cc6ffd640 1 -- 172.21.15.132:0/2902597214 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc00ee20 con 0x7f8cd80caf80 2023-12-20T04:52:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.612+0000 7f8cc6ffd640 1 -- 172.21.15.132:0/2902597214 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8ccc00c8d0 con 0x7f8cd80caf80 2023-12-20T04:52:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.612+0000 7f8cdcd16640 1 -- 172.21.15.132:0/2902597214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd8144a50 con 0x7f8cd80caf80 2023-12-20T04:52:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.612+0000 7f8cc6ffd640 1 -- 172.21.15.132:0/2902597214 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8ccc00cc40 con 0x7f8cd80caf80 2023-12-20T04:52:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.612+0000 7f8cdcd16640 1 -- 172.21.15.132:0/2902597214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd80cb5c0 con 0x7f8cd80caf80 2023-12-20T04:52:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.613+0000 7f8cdcd16640 1 -- 172.21.15.132:0/2902597214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd8144f30 con 0x7f8cd80caf80 2023-12-20T04:52:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.613+0000 7f8cc6ffd640 1 -- 172.21.15.132:0/2902597214 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8ccc01d460 con 0x7f8cd80caf80 2023-12-20T04:52:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.614+0000 7f8cc6ffd640 1 --2- 172.21.15.132:0/2902597214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cb806a430 0x7f8cb806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.614+0000 7f8cc6ffd640 1 -- 172.21.15.132:0/2902597214 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8ccc088720 con 0x7f8cd80caf80 2023-12-20T04:52:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.614+0000 7f8cd659c640 1 --2- 172.21.15.132:0/2902597214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cb806a430 0x7f8cb806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.614+0000 7f8cc6ffd640 1 -- 172.21.15.132:0/2902597214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7f8cb8071fc0 con 0x7f8cd80caf80 2023-12-20T04:52:48.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.614+0000 7f8cd659c640 1 --2- 172.21.15.132:0/2902597214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cb806a430 0x7f8cb806c8f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8034000 tx=0x7f8cc803b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:48.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.618+0000 7f8cc6ffd640 1 -- 172.21.15.132:0/2902597214 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8ccc053e30 con 0x7f8cd80caf80 2023-12-20T04:52:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.781+0000 7f8cdcd16640 1 -- 172.21.15.132:0/2902597214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f8cd804e840 con 0x7f8cd80caf80 2023-12-20T04:52:48.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.781+0000 7f8cc6ffd640 1 -- 172.21.15.132:0/2902597214 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v173) v1 ==== 100+0+11 (secure 0 0 0) 0x7f8ccc057450 con 0x7f8cd80caf80 2023-12-20T04:52:48.783 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:52:48.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.783+0000 7f8cdcd16640 1 -- 172.21.15.132:0/2902597214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cb806a430 msgr2=0x7f8cb806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.783+0000 7f8cdcd16640 1 --2- 172.21.15.132:0/2902597214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cb806a430 0x7f8cb806c8f0 secure :-1 s=READY pgs=717 cs=0 l=1 rev1=1 crypto rx=0x7f8cc8034000 tx=0x7f8cc803b040 comp rx=0 tx=0).stop 2023-12-20T04:52:48.785 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.783+0000 7f8cdcd16640 1 -- 172.21.15.132:0/2902597214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cd80caf80 msgr2=0x7f8cd815fd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.783+0000 7f8cdcd16640 1 --2- 172.21.15.132:0/2902597214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cd80caf80 0x7f8cd815fd50 secure :-1 s=READY pgs=1704 cs=0 l=1 rev1=1 crypto rx=0x7f8ccc001bd0 tx=0x7f8ccc00ebd0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.783+0000 7f8cdcd16640 1 -- 172.21.15.132:0/2902597214 shutdown_connections 2023-12-20T04:52:48.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.783+0000 7f8cdcd16640 1 --2- 172.21.15.132:0/2902597214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8cb806a430 0x7f8cb806c8f0 unknown :-1 s=CLOSED pgs=717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.783+0000 7f8cdcd16640 1 --2- 172.21.15.132:0/2902597214 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8cd8145250 0x7f8cd81456d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.783+0000 7f8cdcd16640 1 --2- 172.21.15.132:0/2902597214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8cd80caf80 0x7f8cd815fd50 unknown :-1 s=CLOSED pgs=1704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.783+0000 7f8cdcd16640 1 --2- 172.21.15.132:0/2902597214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8cc00039a0 0x7f8cd80b5440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.783+0000 7f8cdcd16640 1 -- 172.21.15.132:0/2902597214 >> 172.21.15.132:0/2902597214 conn(0x7f8cd806a3d0 msgr2=0x7f8cd815aa40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:48.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.783+0000 7f8cdcd16640 1 -- 172.21.15.132:0/2902597214 shutdown_connections 2023-12-20T04:52:48.786 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.783+0000 7f8cdcd16640 1 -- 172.21.15.132:0/2902597214 wait complete. 2023-12-20T04:52:48.796 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:52:48.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.894+0000 7fcd88773640 1 Processor -- start 2023-12-20T04:52:48.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.894+0000 7fcd88773640 1 -- start start 2023-12-20T04:52:48.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.895+0000 7fcd88773640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcd801444f0 0x7fcd800b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.895+0000 7fcd88773640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcd800ce7c0 0x7fcd800cec10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.895+0000 7fcd88773640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcd800cb800 con 0x7fcd800b2700 2023-12-20T04:52:48.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.895+0000 7fcd88773640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd8015b630 con 0x7fcd801444f0 2023-12-20T04:52:48.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.895+0000 7fcd88773640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcd800cb240 con 0x7fcd800ce7c0 2023-12-20T04:52:48.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.895+0000 7fcd85d0e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcd801444f0 0x7fcd800b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.895+0000 7fcd85d0e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcd801444f0 0x7fcd800b31f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52080/0 (socket says 172.21.15.132:52080) 2023-12-20T04:52:48.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.895+0000 7fcd85d0e640 1 -- 172.21.15.132:0/2608322019 learned_addr learned my addr 172.21.15.132:0/2608322019 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:48.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.895+0000 7fcd86d10640 1 --2- 172.21.15.132:0/2608322019 >> v2:172.21.15.187:3300/0 conn(0x7fcd800ce7c0 0x7fcd800cec10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.896+0000 7fcd85d0e640 1 -- 172.21.15.132:0/2608322019 >> v2:172.21.15.187:3300/0 conn(0x7fcd800ce7c0 msgr2=0x7fcd800cec10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:48.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.896+0000 7fcd85d0e640 1 --2- 172.21.15.132:0/2608322019 >> v2:172.21.15.187:3300/0 conn(0x7fcd800ce7c0 0x7fcd800cec10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.896+0000 7fcd85d0e640 1 -- 172.21.15.132:0/2608322019 >> v1:172.21.15.187:6789/0 conn(0x7fcd800b2700 legacy=0x7fcd800b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.896+0000 7fcd85d0e640 1 -- 172.21.15.132:0/2608322019 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd800cb520 con 0x7fcd801444f0 2023-12-20T04:52:48.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.896+0000 7fcd85d0e640 1 --2- 172.21.15.132:0/2608322019 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd801444f0 0x7fcd800b31f0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fcd80145020 tx=0x7fcd7002b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=517e0d2d8f2f71d7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:48.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.896+0000 7fcd8550d640 1 -- 172.21.15.132:0/2608322019 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd70031870 con 0x7fcd801444f0 2023-12-20T04:52:48.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.897+0000 7fcd8550d640 1 -- 172.21.15.132:0/2608322019 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd700319d0 con 0x7fcd801444f0 2023-12-20T04:52:48.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.897+0000 7fcd8550d640 1 -- 172.21.15.132:0/2608322019 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd70031d60 con 0x7fcd801444f0 2023-12-20T04:52:48.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.897+0000 7fcd88773640 1 -- 172.21.15.132:0/2608322019 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd801444f0 msgr2=0x7fcd800b31f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.897+0000 7fcd88773640 1 --2- 172.21.15.132:0/2608322019 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd801444f0 0x7fcd800b31f0 secure :-1 s=READY pgs=1705 cs=0 l=1 rev1=1 crypto rx=0x7fcd80145020 tx=0x7fcd7002b910 comp rx=0 tx=0).stop 2023-12-20T04:52:48.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.897+0000 7fcd88773640 1 -- 172.21.15.132:0/2608322019 shutdown_connections 2023-12-20T04:52:48.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.897+0000 7fcd88773640 1 --2- 172.21.15.132:0/2608322019 >> v2:172.21.15.187:3300/0 conn(0x7fcd800ce7c0 0x7fcd800cec10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.897+0000 7fcd88773640 1 --2- 172.21.15.132:0/2608322019 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd801444f0 0x7fcd800b31f0 unknown :-1 s=CLOSED pgs=1705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.897+0000 7fcd88773640 1 -- 172.21.15.132:0/2608322019 >> 172.21.15.132:0/2608322019 conn(0x7fcd8006d640 msgr2=0x7fcd8006da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:48.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.897+0000 7fcd88773640 1 -- 172.21.15.132:0/2608322019 shutdown_connections 2023-12-20T04:52:48.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.897+0000 7fcd88773640 1 -- 172.21.15.132:0/2608322019 wait complete. 2023-12-20T04:52:48.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.898+0000 7fcd88773640 1 Processor -- start 2023-12-20T04:52:48.901 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.898+0000 7fcd88773640 1 -- start start 2023-12-20T04:52:48.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.899+0000 7fcd88773640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd800b2700 0x7fcd8006df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.899+0000 7fcd88773640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd800ce7c0 0x7fcd801f1970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.899+0000 7fcd88773640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd801444f0 0x7fcd800c8190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.899+0000 7fcd88773640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd800c9030 con 0x7fcd801444f0 2023-12-20T04:52:48.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.899+0000 7fcd88773640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd800ca980 con 0x7fcd800b2700 2023-12-20T04:52:48.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.899+0000 7fcd88773640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcd801f1eb0 con 0x7fcd800ce7c0 2023-12-20T04:52:48.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.899+0000 7fcd86d10640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd801444f0 0x7fcd800c8190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.899+0000 7fcd86d10640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd801444f0 0x7fcd800c8190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52090/0 (socket says 172.21.15.132:52090) 2023-12-20T04:52:48.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.899+0000 7fcd86d10640 1 -- 172.21.15.132:0/3146513279 learned_addr learned my addr 172.21.15.132:0/3146513279 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:48.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.899+0000 7fcd8650f640 1 --2- 172.21.15.132:0/3146513279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd800b2700 0x7fcd8006df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.899+0000 7fcd85d0e640 1 --2- 172.21.15.132:0/3146513279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd800ce7c0 0x7fcd801f1970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.899+0000 7fcd86d10640 1 -- 172.21.15.132:0/3146513279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd800ce7c0 msgr2=0x7fcd801f1970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.899+0000 7fcd86d10640 1 --2- 172.21.15.132:0/3146513279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd800ce7c0 0x7fcd801f1970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.899+0000 7fcd86d10640 1 -- 172.21.15.132:0/3146513279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd800b2700 msgr2=0x7fcd8006df30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:48.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.899+0000 7fcd86d10640 1 --2- 172.21.15.132:0/3146513279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd800b2700 0x7fcd8006df30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.899+0000 7fcd86d10640 1 -- 172.21.15.132:0/3146513279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd700094d0 con 0x7fcd801444f0 2023-12-20T04:52:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.900+0000 7fcd86d10640 1 --2- 172.21.15.132:0/3146513279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd801444f0 0x7fcd800c8190 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800d5d0 tx=0x7fcd7800da90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.900+0000 7fcd76ffd640 1 -- 172.21.15.132:0/3146513279 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd780125f0 con 0x7fcd801444f0 2023-12-20T04:52:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.900+0000 7fcd76ffd640 1 -- 172.21.15.132:0/3146513279 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcd78012770 con 0x7fcd801444f0 2023-12-20T04:52:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.900+0000 7fcd88773640 1 -- 172.21.15.132:0/3146513279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd8015c980 con 0x7fcd801444f0 2023-12-20T04:52:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.900+0000 7fcd76ffd640 1 -- 172.21.15.132:0/3146513279 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcd78012b20 con 0x7fcd801444f0 2023-12-20T04:52:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.900+0000 7fcd88773640 1 -- 172.21.15.132:0/3146513279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd8015cf40 con 0x7fcd801444f0 2023-12-20T04:52:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.901+0000 7fcd88773640 1 -- 172.21.15.132:0/3146513279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8004e840 con 0x7fcd801444f0 2023-12-20T04:52:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.901+0000 7fcd76ffd640 1 -- 172.21.15.132:0/3146513279 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcd78012c80 con 0x7fcd801444f0 2023-12-20T04:52:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.902+0000 7fcd76ffd640 1 --2- 172.21.15.132:0/3146513279 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcd6406a430 0x7fcd6406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.902+0000 7fcd8650f640 1 --2- 172.21.15.132:0/3146513279 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcd6406a430 0x7fcd6406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.902+0000 7fcd76ffd640 1 -- 172.21.15.132:0/3146513279 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fcd78088db0 con 0x7fcd801444f0 2023-12-20T04:52:48.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.902+0000 7fcd76ffd640 1 -- 172.21.15.132:0/3146513279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7fcd64071fc0 con 0x7fcd801444f0 2023-12-20T04:52:48.906 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.902+0000 7fcd8650f640 1 --2- 172.21.15.132:0/3146513279 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcd6406a430 0x7fcd6406c8f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fcd800cbcc0 tx=0x7fcd7c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:48.908 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:48.906+0000 7fcd76ffd640 1 -- 172.21.15.132:0/3146513279 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcd78054390 con 0x7fcd801444f0 2023-12-20T04:52:48.933 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:52:48.935 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:52:49.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.087+0000 7fcd88773640 1 -- 172.21.15.132:0/3146513279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fcd800cfec0 con 0x7fcd801444f0 2023-12-20T04:52:49.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.088+0000 7fcd76ffd640 1 -- 172.21.15.132:0/3146513279 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v173) v1 ==== 80+0+0 (secure 0 0 0) 0x7fcd780579b0 con 0x7fcd801444f0 2023-12-20T04:52:49.090 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:52:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.090+0000 7fcd88773640 1 -- 172.21.15.132:0/3146513279 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcd6406a430 msgr2=0x7fcd6406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.090+0000 7fcd88773640 1 --2- 172.21.15.132:0/3146513279 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcd6406a430 0x7fcd6406c8f0 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7fcd800cbcc0 tx=0x7fcd7c009040 comp rx=0 tx=0).stop 2023-12-20T04:52:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.090+0000 7fcd88773640 1 -- 172.21.15.132:0/3146513279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd801444f0 msgr2=0x7fcd800c8190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.090+0000 7fcd88773640 1 --2- 172.21.15.132:0/3146513279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd801444f0 0x7fcd800c8190 secure :-1 s=READY pgs=1706 cs=0 l=1 rev1=1 crypto rx=0x7fcd7800d5d0 tx=0x7fcd7800da90 comp rx=0 tx=0).stop 2023-12-20T04:52:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.090+0000 7fcd88773640 1 -- 172.21.15.132:0/3146513279 shutdown_connections 2023-12-20T04:52:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.090+0000 7fcd88773640 1 --2- 172.21.15.132:0/3146513279 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcd6406a430 0x7fcd6406c8f0 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.090+0000 7fcd88773640 1 --2- 172.21.15.132:0/3146513279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcd801444f0 0x7fcd800c8190 unknown :-1 s=CLOSED pgs=1706 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.090+0000 7fcd88773640 1 --2- 172.21.15.132:0/3146513279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcd800ce7c0 0x7fcd801f1970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.090+0000 7fcd88773640 1 --2- 172.21.15.132:0/3146513279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcd800b2700 0x7fcd8006df30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.090+0000 7fcd88773640 1 -- 172.21.15.132:0/3146513279 >> 172.21.15.132:0/3146513279 conn(0x7fcd8006d640 msgr2=0x7fcd800b4dc0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:49.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.090+0000 7fcd88773640 1 -- 172.21.15.132:0/3146513279 shutdown_connections 2023-12-20T04:52:49.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.090+0000 7fcd88773640 1 -- 172.21.15.132:0/3146513279 wait complete. 2023-12-20T04:52:49.102 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2023-12-20T04:52:49.102 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:52:49.102 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-20T04:52:49.127 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[120877]: fuse finished with error 0 and tester_r 0 2023-12-20T04:52:49.129 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:52:49.129 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:52:49.129 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-20T04:52:49.184 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:52:49.184 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:52:49.202 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:52:49.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.320+0000 7f4e6ed16640 1 Processor -- start 2023-12-20T04:52:49.322 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.320+0000 7f4e6ed16640 1 -- start start 2023-12-20T04:52:49.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.321+0000 7f4e6ed16640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4e6815d110 0x7f4e68069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.321+0000 7f4e6ed16640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e680af210 0x7f4e6806a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.321+0000 7f4e6ed16640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e68161ce0 con 0x7f4e6815d4f0 2023-12-20T04:52:49.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.321+0000 7f4e6ed16640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e680aca50 con 0x7f4e6815d110 2023-12-20T04:52:49.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.321+0000 7f4e6ed16640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68160df0 con 0x7f4e680af210 2023-12-20T04:52:49.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.321+0000 7f4e67fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4e6815d4f0 0x7f4e680aeb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40586/0 (socket says 172.21.15.132:40586) 2023-12-20T04:52:49.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.321+0000 7f4e67fff640 1 -- 172.21.15.132:0/640362731 learned_addr learned my addr 172.21.15.132:0/640362731 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:52:49.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.321+0000 7f4e6cab2640 1 --2- 172.21.15.132:0/640362731 >> v2:172.21.15.187:3300/0 conn(0x7f4e6815d110 0x7f4e68069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.321+0000 7f4e6d2b3640 1 --2- 172.21.15.132:0/640362731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e680af210 0x7f4e6806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.321+0000 7f4e677fe640 1 -- 172.21.15.132:0/640362731 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1057949031 0 0) 0x7f4e68161ce0 con 0x7f4e6815d4f0 2023-12-20T04:52:49.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.321+0000 7f4e677fe640 1 -- 172.21.15.132:0/640362731 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e50003520 con 0x7f4e6815d4f0 2023-12-20T04:52:49.325 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e677fe640 1 -- 172.21.15.132:0/640362731 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2722722411 0 0) 0x7f4e50003520 con 0x7f4e6815d4f0 2023-12-20T04:52:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e677fe640 1 -- 172.21.15.132:0/640362731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e680af210 msgr2=0x7f4e6806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e677fe640 1 --2- 172.21.15.132:0/640362731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e680af210 0x7f4e6806a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e677fe640 1 -- 172.21.15.132:0/640362731 >> v2:172.21.15.187:3300/0 conn(0x7f4e6815d110 msgr2=0x7f4e68069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e677fe640 1 --2- 172.21.15.132:0/640362731 >> v2:172.21.15.187:3300/0 conn(0x7f4e6815d110 0x7f4e68069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e677fe640 1 -- 172.21.15.132:0/640362731 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e681610d0 con 0x7f4e6815d4f0 2023-12-20T04:52:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e677fe640 1 -- 172.21.15.132:0/640362731 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f4e5c001670 con 0x7f4e6815d4f0 2023-12-20T04:52:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e677fe640 1 -- 172.21.15.132:0/640362731 >> v1:172.21.15.132:6789/0 conn(0x7f4e6815d4f0 legacy=0x7f4e680aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e677fe640 1 --2- 172.21.15.132:0/640362731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e50003970 0x7f4e50003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e677fe640 1 --2- 172.21.15.132:0/640362731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e680af210 0x7f4e500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e677fe640 1 --2- 172.21.15.132:0/640362731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e50004d00 0x7f4e50005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e677fe640 1 -- 172.21.15.132:0/640362731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680aca50 con 0x7f4e50003970 2023-12-20T04:52:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e677fe640 1 -- 172.21.15.132:0/640362731 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e68160df0 con 0x7f4e50004d00 2023-12-20T04:52:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e677fe640 1 -- 172.21.15.132:0/640362731 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5000b980 con 0x7f4e680af210 2023-12-20T04:52:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e6cab2640 1 --2- 172.21.15.132:0/640362731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e50003970 0x7f4e50003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e67fff640 1 --2- 172.21.15.132:0/640362731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e680af210 0x7f4e500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.326 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e6d2b3640 1 --2- 172.21.15.132:0/640362731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e50004d00 0x7f4e50005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e6cab2640 1 -- 172.21.15.132:0/640362731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e680af210 msgr2=0x7f4e500047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:49.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e6cab2640 1 --2- 172.21.15.132:0/640362731 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e680af210 0x7f4e500047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e6cab2640 1 -- 172.21.15.132:0/640362731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e50004d00 msgr2=0x7f4e50005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:49.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e6cab2640 1 --2- 172.21.15.132:0/640362731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e50004d00 0x7f4e50005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e6cab2640 1 -- 172.21.15.132:0/640362731 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e50003520 con 0x7f4e50003970 2023-12-20T04:52:49.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.322+0000 7f4e6d2b3640 1 --2- 172.21.15.132:0/640362731 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e50004d00 0x7f4e50005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:52:49.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.323+0000 7f4e6cab2640 1 --2- 172.21.15.132:0/640362731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e50003970 0x7f4e50003d90 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009ae0 tx=0x7f4e500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7b6911f870e2a2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:49.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.323+0000 7f4e677fe640 1 -- 172.21.15.132:0/640362731 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58005990 con 0x7f4e50003970 2023-12-20T04:52:49.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.323+0000 7f4e677fe640 1 -- 172.21.15.132:0/640362731 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e58005af0 con 0x7f4e50003970 2023-12-20T04:52:49.327 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.323+0000 7f4e677fe640 1 -- 172.21.15.132:0/640362731 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58005ea0 con 0x7f4e50003970 2023-12-20T04:52:49.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.323+0000 7f4e6ed16640 1 -- 172.21.15.132:0/640362731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e50003970 msgr2=0x7f4e50003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.323+0000 7f4e6ed16640 1 --2- 172.21.15.132:0/640362731 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e50003970 0x7f4e50003d90 secure :-1 s=READY pgs=1708 cs=0 l=1 rev1=1 crypto rx=0x7f4e58009ae0 tx=0x7f4e500057f0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.323+0000 7f4e6d2b3640 1 -- 172.21.15.132:0/640362731 reap_dead start 2023-12-20T04:52:49.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.323+0000 7f4e6ed16640 1 -- 172.21.15.132:0/640362731 shutdown_connections 2023-12-20T04:52:49.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.323+0000 7f4e6ed16640 1 -- 172.21.15.132:0/640362731 >> 172.21.15.132:0/640362731 conn(0x7f4e680cfbd0 msgr2=0x7f4e680cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:49.330 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.323+0000 7f4e6ed16640 1 -- 172.21.15.132:0/640362731 shutdown_connections 2023-12-20T04:52:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.324+0000 7f4e6ed16640 1 -- 172.21.15.132:0/640362731 wait complete. 2023-12-20T04:52:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.325+0000 7f4e6ed16640 1 Processor -- start 2023-12-20T04:52:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.325+0000 7f4e6ed16640 1 -- start start 2023-12-20T04:52:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.325+0000 7f4e6ed16640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e50003970 0x7f4e680ca360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.325+0000 7f4e6ed16640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e68151710 0x7f4e680caa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.325+0000 7f4e6ed16640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e680caf80 0x7f4e680cb430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e6ed16640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680c81e0 con 0x7f4e50003970 2023-12-20T04:52:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e6ed16640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e680ca8a0 con 0x7f4e680caf80 2023-12-20T04:52:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e6ed16640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e6806cf90 con 0x7f4e68151710 2023-12-20T04:52:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e6cab2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e50003970 0x7f4e680ca360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e6cab2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e50003970 0x7f4e680ca360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52112/0 (socket says 172.21.15.132:52112) 2023-12-20T04:52:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e6cab2640 1 -- 172.21.15.132:0/556908209 learned_addr learned my addr 172.21.15.132:0/556908209 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e6d2b3640 1 --2- 172.21.15.132:0/556908209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e680caf80 0x7f4e680cb430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e67fff640 1 --2- 172.21.15.132:0/556908209 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e68151710 0x7f4e680caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e6cab2640 1 -- 172.21.15.132:0/556908209 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e68151710 msgr2=0x7f4e680caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.331 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e6cab2640 1 --2- 172.21.15.132:0/556908209 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e68151710 0x7f4e680caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e6cab2640 1 -- 172.21.15.132:0/556908209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e680caf80 msgr2=0x7f4e680cb430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e6cab2640 1 --2- 172.21.15.132:0/556908209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e680caf80 0x7f4e680cb430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e6cab2640 1 -- 172.21.15.132:0/556908209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6806d230 con 0x7f4e50003970 2023-12-20T04:52:49.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e67fff640 1 --2- 172.21.15.132:0/556908209 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e68151710 0x7f4e680caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:52:49.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e6d2b3640 1 --2- 172.21.15.132:0/556908209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e680caf80 0x7f4e680cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:52:49.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e6cab2640 1 --2- 172.21.15.132:0/556908209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e50003970 0x7f4e680ca360 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f4e58036040 tx=0x7f4e58004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:49.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e657fa640 1 -- 172.21.15.132:0/556908209 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e58005e70 con 0x7f4e50003970 2023-12-20T04:52:49.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e657fa640 1 -- 172.21.15.132:0/556908209 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e58004030 con 0x7f4e50003970 2023-12-20T04:52:49.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e6ed16640 1 -- 172.21.15.132:0/556908209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e6806d510 con 0x7f4e50003970 2023-12-20T04:52:49.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e657fa640 1 -- 172.21.15.132:0/556908209 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e580043e0 con 0x7f4e50003970 2023-12-20T04:52:49.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.326+0000 7f4e6ed16640 1 -- 172.21.15.132:0/556908209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e6806dad0 con 0x7f4e50003970 2023-12-20T04:52:49.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.327+0000 7f4e6ed16640 1 -- 172.21.15.132:0/556908209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e6806dc60 con 0x7f4e50003970 2023-12-20T04:52:49.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.328+0000 7f4e657fa640 1 -- 172.21.15.132:0/556908209 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4e58003610 con 0x7f4e50003970 2023-12-20T04:52:49.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.328+0000 7f4e657fa640 1 --2- 172.21.15.132:0/556908209 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e5406a460 0x7f4e5406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.328+0000 7f4e657fa640 1 -- 172.21.15.132:0/556908209 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4e580aafe0 con 0x7f4e50003970 2023-12-20T04:52:49.332 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.328+0000 7f4e67fff640 1 --2- 172.21.15.132:0/556908209 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e5406a460 0x7f4e5406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.328+0000 7f4e657fa640 1 -- 172.21.15.132:0/556908209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7f4e54071ff0 con 0x7f4e50003970 2023-12-20T04:52:49.333 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.329+0000 7f4e67fff640 1 --2- 172.21.15.132:0/556908209 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e5406a460 0x7f4e5406c920 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c000fb0 tx=0x7f4e5c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:49.334 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.332+0000 7f4e657fa640 1 -- 172.21.15.132:0/556908209 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4e5804c060 con 0x7f4e50003970 2023-12-20T04:52:49.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.499+0000 7f4e6ed16640 1 -- 172.21.15.132:0/556908209 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e6804e840 con 0x7f4e50003970 2023-12-20T04:52:49.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.500+0000 7f4e657fa640 1 -- 172.21.15.132:0/556908209 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+16236 (secure 0 0 0) 0x7f4e5804c070 con 0x7f4e50003970 2023-12-20T04:52:49.502 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:52:49.502 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":173,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:52:39.899511+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:51:44.739391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-20T04:51:45.486167+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.14","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:52:49.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.502+0000 7f4e6ed16640 1 -- 172.21.15.132:0/556908209 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e5406a460 msgr2=0x7f4e5406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.502+0000 7f4e6ed16640 1 --2- 172.21.15.132:0/556908209 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e5406a460 0x7f4e5406c920 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f4e5c000fb0 tx=0x7f4e5c009040 comp rx=0 tx=0).stop 2023-12-20T04:52:49.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.502+0000 7f4e6ed16640 1 -- 172.21.15.132:0/556908209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e50003970 msgr2=0x7f4e680ca360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.504 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.502+0000 7f4e6ed16640 1 --2- 172.21.15.132:0/556908209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e50003970 0x7f4e680ca360 secure :-1 s=READY pgs=1709 cs=0 l=1 rev1=1 crypto rx=0x7f4e58036040 tx=0x7f4e58004730 comp rx=0 tx=0).stop 2023-12-20T04:52:49.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.502+0000 7f4e6ed16640 1 -- 172.21.15.132:0/556908209 shutdown_connections 2023-12-20T04:52:49.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.502+0000 7f4e6ed16640 1 --2- 172.21.15.132:0/556908209 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e5406a460 0x7f4e5406c920 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.502+0000 7f4e6ed16640 1 --2- 172.21.15.132:0/556908209 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e680caf80 0x7f4e680cb430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.502+0000 7f4e6ed16640 1 --2- 172.21.15.132:0/556908209 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e68151710 0x7f4e680caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.502+0000 7f4e6ed16640 1 --2- 172.21.15.132:0/556908209 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e50003970 0x7f4e680ca360 unknown :-1 s=CLOSED pgs=1709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.502+0000 7f4e6ed16640 1 -- 172.21.15.132:0/556908209 >> 172.21.15.132:0/556908209 conn(0x7f4e680cfbd0 msgr2=0x7f4e6815b7a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:49.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.502+0000 7f4e6ed16640 1 -- 172.21.15.132:0/556908209 shutdown_connections 2023-12-20T04:52:49.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.502+0000 7f4e6ed16640 1 -- 172.21.15.132:0/556908209 wait complete. 2023-12-20T04:52:49.515 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:51:44.739391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '168', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:51:45.486167+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:52:49.516 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:52:49.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.618+0000 7fdc345c9640 1 Processor -- start 2023-12-20T04:52:49.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.618+0000 7fdc345c9640 1 -- start start 2023-12-20T04:52:49.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.619+0000 7fdc345c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc2c0ca170 0x7fdc2c0ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.619+0000 7fdc345c9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdc2c069c30 0x7fdc2c06a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.619+0000 7fdc345c9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdc2c0c4f40 con 0x7fdc2c1447b0 2023-12-20T04:52:49.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.619+0000 7fdc345c9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdc2c06a600 con 0x7fdc2c069c30 2023-12-20T04:52:49.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.619+0000 7fdc345c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c0c6380 con 0x7fdc2c0ca170 2023-12-20T04:52:49.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.619+0000 7fdc32b66640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdc2c069c30 0x7fdc2c06a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.619+0000 7fdc32b66640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdc2c069c30 0x7fdc2c06a0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52122/0 (socket says 172.21.15.132:52122) 2023-12-20T04:52:49.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.619+0000 7fdc32b66640 1 -- 172.21.15.132:0/412427323 learned_addr learned my addr 172.21.15.132:0/412427323 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:49.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.620+0000 7fdc31b64640 1 --2- 172.21.15.132:0/412427323 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc2c0ca170 0x7fdc2c0ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.620+0000 7fdc32b66640 1 -- 172.21.15.132:0/412427323 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc2c0ca170 msgr2=0x7fdc2c0ca5d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:49.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.620+0000 7fdc32b66640 1 --2- 172.21.15.132:0/412427323 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc2c0ca170 0x7fdc2c0ca5d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.620+0000 7fdc32b66640 1 -- 172.21.15.132:0/412427323 >> v1:172.21.15.187:6789/0 conn(0x7fdc2c1447b0 legacy=0x7fdc2c0c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:49.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.620+0000 7fdc32b66640 1 -- 172.21.15.132:0/412427323 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc2c144b90 con 0x7fdc2c069c30 2023-12-20T04:52:49.623 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.620+0000 7fdc31b64640 1 --2- 172.21.15.132:0/412427323 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc2c0ca170 0x7fdc2c0ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:52:49.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.620+0000 7fdc32b66640 1 --2- 172.21.15.132:0/412427323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc2c069c30 0x7fdc2c06a0c0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fdc240098a0 tx=0x7fdc2402b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86efa9bfa5605a6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:49.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.621+0000 7fdc31363640 1 -- 172.21.15.132:0/412427323 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc240317c0 con 0x7fdc2c069c30 2023-12-20T04:52:49.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.621+0000 7fdc31363640 1 -- 172.21.15.132:0/412427323 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc24031920 con 0x7fdc2c069c30 2023-12-20T04:52:49.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.621+0000 7fdc31363640 1 -- 172.21.15.132:0/412427323 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc24031cb0 con 0x7fdc2c069c30 2023-12-20T04:52:49.624 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.621+0000 7fdc345c9640 1 -- 172.21.15.132:0/412427323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc2c069c30 msgr2=0x7fdc2c06a0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.621+0000 7fdc345c9640 1 --2- 172.21.15.132:0/412427323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc2c069c30 0x7fdc2c06a0c0 secure :-1 s=READY pgs=1710 cs=0 l=1 rev1=1 crypto rx=0x7fdc240098a0 tx=0x7fdc2402b860 comp rx=0 tx=0).stop 2023-12-20T04:52:49.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.621+0000 7fdc345c9640 1 -- 172.21.15.132:0/412427323 shutdown_connections 2023-12-20T04:52:49.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.621+0000 7fdc345c9640 1 --2- 172.21.15.132:0/412427323 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc2c069c30 0x7fdc2c06a0c0 unknown :-1 s=CLOSED pgs=1710 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.621+0000 7fdc345c9640 1 --2- 172.21.15.132:0/412427323 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc2c0ca170 0x7fdc2c0ca5d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.621+0000 7fdc345c9640 1 -- 172.21.15.132:0/412427323 >> 172.21.15.132:0/412427323 conn(0x7fdc2c0cc630 msgr2=0x7fdc2c0cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:49.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.621+0000 7fdc345c9640 1 -- 172.21.15.132:0/412427323 shutdown_connections 2023-12-20T04:52:49.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.621+0000 7fdc345c9640 1 -- 172.21.15.132:0/412427323 wait complete. 2023-12-20T04:52:49.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.622+0000 7fdc345c9640 1 Processor -- start 2023-12-20T04:52:49.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.622+0000 7fdc345c9640 1 -- start start 2023-12-20T04:52:49.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.623+0000 7fdc345c9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc2c069c30 0x7fdc2c1f0eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.623+0000 7fdc345c9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc2c0ca170 0x7fdc2c0b28c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.623+0000 7fdc345c9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc2c1447b0 0x7fdc2c15a4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.623+0000 7fdc345c9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c0b50e0 con 0x7fdc2c069c30 2023-12-20T04:52:49.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.623+0000 7fdc345c9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c0b2e00 con 0x7fdc2c1447b0 2023-12-20T04:52:49.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.623+0000 7fdc345c9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdc2c0b3080 con 0x7fdc2c0ca170 2023-12-20T04:52:49.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.623+0000 7fdc32365640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc2c069c30 0x7fdc2c1f0eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.623+0000 7fdc32365640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc2c069c30 0x7fdc2c1f0eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52134/0 (socket says 172.21.15.132:52134) 2023-12-20T04:52:49.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.623+0000 7fdc32365640 1 -- 172.21.15.132:0/3256654311 learned_addr learned my addr 172.21.15.132:0/3256654311 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:49.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.623+0000 7fdc31b64640 1 --2- 172.21.15.132:0/3256654311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc2c0ca170 0x7fdc2c0b28c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.623+0000 7fdc32b66640 1 --2- 172.21.15.132:0/3256654311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc2c1447b0 0x7fdc2c15a4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.623+0000 7fdc32365640 1 -- 172.21.15.132:0/3256654311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc2c0ca170 msgr2=0x7fdc2c0b28c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.623+0000 7fdc32365640 1 --2- 172.21.15.132:0/3256654311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc2c0ca170 0x7fdc2c0b28c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.623+0000 7fdc32365640 1 -- 172.21.15.132:0/3256654311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc2c1447b0 msgr2=0x7fdc2c15a4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.623+0000 7fdc32365640 1 --2- 172.21.15.132:0/3256654311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc2c1447b0 0x7fdc2c15a4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.623+0000 7fdc32365640 1 -- 172.21.15.132:0/3256654311 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc240094d0 con 0x7fdc2c069c30 2023-12-20T04:52:49.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.623+0000 7fdc32b66640 1 --2- 172.21.15.132:0/3256654311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc2c1447b0 0x7fdc2c15a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:52:49.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.624+0000 7fdc32365640 1 --2- 172.21.15.132:0/3256654311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc2c069c30 0x7fdc2c1f0eb0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fdc2800c7f0 tx=0x7fdc2800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:49.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.624+0000 7fdc22ffd640 1 -- 172.21.15.132:0/3256654311 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc2800aa50 con 0x7fdc2c069c30 2023-12-20T04:52:49.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.624+0000 7fdc22ffd640 1 -- 172.21.15.132:0/3256654311 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdc2800abb0 con 0x7fdc2c069c30 2023-12-20T04:52:49.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.624+0000 7fdc345c9640 1 -- 172.21.15.132:0/3256654311 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc2c0b3360 con 0x7fdc2c069c30 2023-12-20T04:52:49.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.624+0000 7fdc22ffd640 1 -- 172.21.15.132:0/3256654311 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdc28012420 con 0x7fdc2c069c30 2023-12-20T04:52:49.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.624+0000 7fdc345c9640 1 -- 172.21.15.132:0/3256654311 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc2c0b4d70 con 0x7fdc2c069c30 2023-12-20T04:52:49.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.625+0000 7fdc345c9640 1 -- 172.21.15.132:0/3256654311 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc2c0b48f0 con 0x7fdc2c069c30 2023-12-20T04:52:49.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.625+0000 7fdc22ffd640 1 -- 172.21.15.132:0/3256654311 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdc28012580 con 0x7fdc2c069c30 2023-12-20T04:52:49.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.626+0000 7fdc22ffd640 1 --2- 172.21.15.132:0/3256654311 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc1006a430 0x7fdc1006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.626+0000 7fdc22ffd640 1 -- 172.21.15.132:0/3256654311 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fdc28088830 con 0x7fdc2c069c30 2023-12-20T04:52:49.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.626+0000 7fdc31b64640 1 --2- 172.21.15.132:0/3256654311 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc1006a430 0x7fdc1006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.626+0000 7fdc22ffd640 1 -- 172.21.15.132:0/3256654311 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7fdc10071fc0 con 0x7fdc2c069c30 2023-12-20T04:52:49.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.626+0000 7fdc31b64640 1 --2- 172.21.15.132:0/3256654311 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc1006a430 0x7fdc1006c8f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c1f4950 tx=0x7fdc1c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:49.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.630+0000 7fdc22ffd640 1 -- 172.21.15.132:0/3256654311 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdc28016020 con 0x7fdc2c069c30 2023-12-20T04:52:49.797 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.796+0000 7fdc345c9640 1 -- 172.21.15.132:0/3256654311 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fdc2c04e840 con 0x7fdc2c069c30 2023-12-20T04:52:49.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.796+0000 7fdc22ffd640 1 -- 172.21.15.132:0/3256654311 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v173) v1 ==== 93+0+10 (secure 0 0 0) 0x7fdc2c0b48f0 con 0x7fdc2c069c30 2023-12-20T04:52:49.798 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:52:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.798+0000 7fdc345c9640 1 -- 172.21.15.132:0/3256654311 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc1006a430 msgr2=0x7fdc1006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.798+0000 7fdc345c9640 1 --2- 172.21.15.132:0/3256654311 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc1006a430 0x7fdc1006c8f0 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c1f4950 tx=0x7fdc1c008040 comp rx=0 tx=0).stop 2023-12-20T04:52:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.798+0000 7fdc345c9640 1 -- 172.21.15.132:0/3256654311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc2c069c30 msgr2=0x7fdc2c1f0eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.798+0000 7fdc345c9640 1 --2- 172.21.15.132:0/3256654311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc2c069c30 0x7fdc2c1f0eb0 secure :-1 s=READY pgs=1711 cs=0 l=1 rev1=1 crypto rx=0x7fdc2800c7f0 tx=0x7fdc2800ccb0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.798+0000 7fdc345c9640 1 -- 172.21.15.132:0/3256654311 shutdown_connections 2023-12-20T04:52:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.798+0000 7fdc345c9640 1 --2- 172.21.15.132:0/3256654311 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc1006a430 0x7fdc1006c8f0 unknown :-1 s=CLOSED pgs=720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.798+0000 7fdc345c9640 1 --2- 172.21.15.132:0/3256654311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdc2c1447b0 0x7fdc2c15a4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.798+0000 7fdc345c9640 1 --2- 172.21.15.132:0/3256654311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdc2c0ca170 0x7fdc2c0b28c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.798+0000 7fdc345c9640 1 --2- 172.21.15.132:0/3256654311 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdc2c069c30 0x7fdc2c1f0eb0 unknown :-1 s=CLOSED pgs=1711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.798+0000 7fdc345c9640 1 -- 172.21.15.132:0/3256654311 >> 172.21.15.132:0/3256654311 conn(0x7fdc2c0cc630 msgr2=0x7fdc2c1439f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.798+0000 7fdc345c9640 1 -- 172.21.15.132:0/3256654311 shutdown_connections 2023-12-20T04:52:49.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.798+0000 7fdc345c9640 1 -- 172.21.15.132:0/3256654311 wait complete. 2023-12-20T04:52:49.811 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:52:49.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.911+0000 7f4dadf39640 1 Processor -- start 2023-12-20T04:52:49.913 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.911+0000 7f4dadf39640 1 -- start start 2023-12-20T04:52:49.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.912+0000 7f4dadf39640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4da815cf20 0x7f4da806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.912+0000 7f4dadf39640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da806cc90 con 0x7f4da815d300 2023-12-20T04:52:49.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.912+0000 7f4dadf39640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4da80b2f30 con 0x7f4da80cd4b0 2023-12-20T04:52:49.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.912+0000 7f4dadf39640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4da80b3210 con 0x7f4da815cf20 2023-12-20T04:52:49.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.912+0000 7f4da6ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4da815d300 0x7f4da8161700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40596/0 (socket says 172.21.15.132:40596) 2023-12-20T04:52:49.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.912+0000 7f4da6ffd640 1 -- 172.21.15.132:0/2921902926 learned_addr learned my addr 172.21.15.132:0/2921902926 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:52:49.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.912+0000 7f4da67fc640 1 -- 172.21.15.132:0/2921902926 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1834005482 0 0) 0x7f4da806cc90 con 0x7f4da815d300 2023-12-20T04:52:49.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.912+0000 7f4da67fc640 1 -- 172.21.15.132:0/2921902926 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4d90003520 con 0x7f4da815d300 2023-12-20T04:52:49.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da77fe640 1 --2- 172.21.15.132:0/2921902926 >> v2:172.21.15.187:3300/0 conn(0x7f4da815cf20 0x7f4da806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.916 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da67fc640 1 -- 172.21.15.132:0/2921902926 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2070201579 0 0) 0x7f4d90003520 con 0x7f4da815d300 2023-12-20T04:52:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da67fc640 1 -- 172.21.15.132:0/2921902926 >> v2:172.21.15.187:3300/0 conn(0x7f4da815cf20 msgr2=0x7f4da806c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da67fc640 1 --2- 172.21.15.132:0/2921902926 >> v2:172.21.15.187:3300/0 conn(0x7f4da815cf20 0x7f4da806c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da67fc640 1 -- 172.21.15.132:0/2921902926 >> v1:172.21.15.187:6789/0 conn(0x7f4da80cd4b0 legacy=0x7f4da80d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da67fc640 1 -- 172.21.15.132:0/2921902926 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da80b34f0 con 0x7f4da815d300 2023-12-20T04:52:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da67fc640 1 -- 172.21.15.132:0/2921902926 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f4d9c001670 con 0x7f4da815d300 2023-12-20T04:52:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da67fc640 1 -- 172.21.15.132:0/2921902926 >> v1:172.21.15.132:6789/0 conn(0x7f4da815d300 legacy=0x7f4da8161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da67fc640 1 --2- 172.21.15.132:0/2921902926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d90003970 0x7f4d90003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da67fc640 1 --2- 172.21.15.132:0/2921902926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d900047c0 0x7f4d90004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da67fc640 1 --2- 172.21.15.132:0/2921902926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d90005180 0x7f4d9000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da67fc640 1 -- 172.21.15.132:0/2921902926 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da80b3210 con 0x7f4d900047c0 2023-12-20T04:52:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da67fc640 1 -- 172.21.15.132:0/2921902926 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9000c0d0 con 0x7f4d90005180 2023-12-20T04:52:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da67fc640 1 -- 172.21.15.132:0/2921902926 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d9000c290 con 0x7f4d90003970 2023-12-20T04:52:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da6ffd640 1 --2- 172.21.15.132:0/2921902926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d900047c0 0x7f4d90004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da77fe640 1 --2- 172.21.15.132:0/2921902926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d90003970 0x7f4d90003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.917 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da7fff640 1 --2- 172.21.15.132:0/2921902926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d90005180 0x7f4d9000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da6ffd640 1 -- 172.21.15.132:0/2921902926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d90003970 msgr2=0x7f4d90003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:49.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da6ffd640 1 --2- 172.21.15.132:0/2921902926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d90003970 0x7f4d90003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da6ffd640 1 -- 172.21.15.132:0/2921902926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d90005180 msgr2=0x7f4d9000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:49.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da6ffd640 1 --2- 172.21.15.132:0/2921902926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d90005180 0x7f4d9000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da6ffd640 1 -- 172.21.15.132:0/2921902926 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d90003520 con 0x7f4d900047c0 2023-12-20T04:52:49.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da77fe640 1 --2- 172.21.15.132:0/2921902926 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d90003970 0x7f4d90003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:52:49.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da7fff640 1 --2- 172.21.15.132:0/2921902926 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d90005180 0x7f4d9000b980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:52:49.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.913+0000 7f4da7fff640 1 -- 172.21.15.132:0/2921902926 reap_dead start 2023-12-20T04:52:49.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.914+0000 7f4da6ffd640 1 --2- 172.21.15.132:0/2921902926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d900047c0 0x7f4d90004c40 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00c240 tx=0x7f4d900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64be06c65c66f6d0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:49.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.914+0000 7f4da67fc640 1 -- 172.21.15.132:0/2921902926 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c005ad0 con 0x7f4d900047c0 2023-12-20T04:52:49.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.914+0000 7f4da67fc640 1 -- 172.21.15.132:0/2921902926 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d9c005c30 con 0x7f4d900047c0 2023-12-20T04:52:49.918 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.914+0000 7f4da67fc640 1 -- 172.21.15.132:0/2921902926 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d9c02caf0 con 0x7f4d900047c0 2023-12-20T04:52:49.921 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.914+0000 7f4dadf39640 1 -- 172.21.15.132:0/2921902926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d900047c0 msgr2=0x7f4d90004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.914+0000 7f4dadf39640 1 --2- 172.21.15.132:0/2921902926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d900047c0 0x7f4d90004c40 secure :-1 s=READY pgs=1713 cs=0 l=1 rev1=1 crypto rx=0x7f4d9c00c240 tx=0x7f4d900057f0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.914+0000 7f4dadf39640 1 -- 172.21.15.132:0/2921902926 shutdown_connections 2023-12-20T04:52:49.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.915+0000 7f4dadf39640 1 --2- 172.21.15.132:0/2921902926 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d900047c0 0x7f4d90004c40 unknown :-1 s=CLOSED pgs=1713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.915+0000 7f4dadf39640 1 -- 172.21.15.132:0/2921902926 >> 172.21.15.132:0/2921902926 conn(0x7f4da8072c60 msgr2=0x7f4da8073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:49.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.915+0000 7f4dadf39640 1 -- 172.21.15.132:0/2921902926 shutdown_connections 2023-12-20T04:52:49.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.915+0000 7f4dadf39640 1 -- 172.21.15.132:0/2921902926 wait complete. 2023-12-20T04:52:49.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.916+0000 7f4dadf39640 1 Processor -- start 2023-12-20T04:52:49.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.916+0000 7f4dadf39640 1 -- start start 2023-12-20T04:52:49.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.916+0000 7f4dadf39640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d900047c0 0x7f4da8156e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4dadf39640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4da80d1280 0x7f4da80b17e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4dadf39640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4da80b1d20 0x7f4da80ad930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4dadf39640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da80cffc0 con 0x7f4da80b1d20 2023-12-20T04:52:49.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4dadf39640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4da80b21a0 con 0x7f4da80d1280 2023-12-20T04:52:49.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4dadf39640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4da81577c0 con 0x7f4d900047c0 2023-12-20T04:52:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4da7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4da80b1d20 0x7f4da80ad930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4da7fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4da80b1d20 0x7f4da80ad930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52148/0 (socket says 172.21.15.132:52148) 2023-12-20T04:52:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4da7fff640 1 -- 172.21.15.132:0/2768553951 learned_addr learned my addr 172.21.15.132:0/2768553951 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4da77fe640 1 --2- 172.21.15.132:0/2768553951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d900047c0 0x7f4da8156e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4da6ffd640 1 --2- 172.21.15.132:0/2768553951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4da80d1280 0x7f4da80b17e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4da7fff640 1 -- 172.21.15.132:0/2768553951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d900047c0 msgr2=0x7f4da8156e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4da7fff640 1 --2- 172.21.15.132:0/2768553951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d900047c0 0x7f4da8156e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4da7fff640 1 -- 172.21.15.132:0/2768553951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4da80d1280 msgr2=0x7f4da80b17e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4da7fff640 1 --2- 172.21.15.132:0/2768553951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4da80d1280 0x7f4da80b17e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4da7fff640 1 -- 172.21.15.132:0/2768553951 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4da80cef20 con 0x7f4da80b1d20 2023-12-20T04:52:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4da7fff640 1 --2- 172.21.15.132:0/2768553951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4da80b1d20 0x7f4da80ad930 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f4da8071330 tx=0x7f4da000eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4d8ffff640 1 -- 172.21.15.132:0/2768553951 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da000eed0 con 0x7f4da80b1d20 2023-12-20T04:52:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4d8ffff640 1 -- 172.21.15.132:0/2768553951 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4da0003970 con 0x7f4da80b1d20 2023-12-20T04:52:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4dadf39640 1 -- 172.21.15.132:0/2768553951 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4da80cf200 con 0x7f4da80b1d20 2023-12-20T04:52:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4d8ffff640 1 -- 172.21.15.132:0/2768553951 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4da0003d20 con 0x7f4da80b1d20 2023-12-20T04:52:49.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.917+0000 7f4dadf39640 1 -- 172.21.15.132:0/2768553951 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4da80cf7c0 con 0x7f4da80b1d20 2023-12-20T04:52:49.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.918+0000 7f4dadf39640 1 -- 172.21.15.132:0/2768553951 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4da804e840 con 0x7f4da80b1d20 2023-12-20T04:52:49.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.919+0000 7f4d8ffff640 1 -- 172.21.15.132:0/2768553951 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4da00050d0 con 0x7f4da80b1d20 2023-12-20T04:52:49.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.919+0000 7f4d8ffff640 1 --2- 172.21.15.132:0/2768553951 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d9406a460 0x7f4d9406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:49.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.919+0000 7f4da77fe640 1 --2- 172.21.15.132:0/2768553951 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d9406a460 0x7f4d9406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:49.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.919+0000 7f4d8ffff640 1 -- 172.21.15.132:0/2768553951 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4da0088530 con 0x7f4da80b1d20 2023-12-20T04:52:49.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.919+0000 7f4d8ffff640 1 -- 172.21.15.132:0/2768553951 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7f4d94071ff0 con 0x7f4da80b1d20 2023-12-20T04:52:49.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.919+0000 7f4da77fe640 1 --2- 172.21.15.132:0/2768553951 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d9406a460 0x7f4d9406c920 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4da8072810 tx=0x7f4d98008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:49.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:49.923+0000 7f4d8ffff640 1 -- 172.21.15.132:0/2768553951 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4da0086e60 con 0x7f4da80b1d20 2023-12-20T04:52:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.088+0000 7f4dadf39640 1 -- 172.21.15.132:0/2768553951 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f4da80b2890 con 0x7f4da80b1d20 2023-12-20T04:52:50.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.088+0000 7f4d8ffff640 1 -- 172.21.15.132:0/2768553951 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v173) v1 ==== 104+0+11 (secure 0 0 0) 0x7f4da0053bc0 con 0x7f4da80b1d20 2023-12-20T04:52:50.090 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:52:50.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.090+0000 7f4dadf39640 1 -- 172.21.15.132:0/2768553951 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d9406a460 msgr2=0x7f4d9406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:50.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.090+0000 7f4dadf39640 1 --2- 172.21.15.132:0/2768553951 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d9406a460 0x7f4d9406c920 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f4da8072810 tx=0x7f4d98008040 comp rx=0 tx=0).stop 2023-12-20T04:52:50.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.090+0000 7f4dadf39640 1 -- 172.21.15.132:0/2768553951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4da80b1d20 msgr2=0x7f4da80ad930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:50.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.090+0000 7f4dadf39640 1 --2- 172.21.15.132:0/2768553951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4da80b1d20 0x7f4da80ad930 secure :-1 s=READY pgs=1714 cs=0 l=1 rev1=1 crypto rx=0x7f4da8071330 tx=0x7f4da000eb90 comp rx=0 tx=0).stop 2023-12-20T04:52:50.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.090+0000 7f4dadf39640 1 -- 172.21.15.132:0/2768553951 shutdown_connections 2023-12-20T04:52:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.090+0000 7f4dadf39640 1 --2- 172.21.15.132:0/2768553951 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d9406a460 0x7f4d9406c920 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.090+0000 7f4dadf39640 1 --2- 172.21.15.132:0/2768553951 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4da80b1d20 0x7f4da80ad930 unknown :-1 s=CLOSED pgs=1714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.090+0000 7f4dadf39640 1 --2- 172.21.15.132:0/2768553951 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4da80d1280 0x7f4da80b17e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.090+0000 7f4dadf39640 1 --2- 172.21.15.132:0/2768553951 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d900047c0 0x7f4da8156e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.090+0000 7f4dadf39640 1 -- 172.21.15.132:0/2768553951 >> 172.21.15.132:0/2768553951 conn(0x7f4da8072c60 msgr2=0x7f4da815f820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.090+0000 7f4dadf39640 1 -- 172.21.15.132:0/2768553951 shutdown_connections 2023-12-20T04:52:50.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.090+0000 7f4dadf39640 1 -- 172.21.15.132:0/2768553951 wait complete. 2023-12-20T04:52:50.103 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:52:50.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.205+0000 7fc344051640 1 Processor -- start 2023-12-20T04:52:50.207 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.205+0000 7fc344051640 1 -- start start 2023-12-20T04:52:50.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.206+0000 7fc344051640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc33c0cb2b0 0x7fc33c0cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:50.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.206+0000 7fc344051640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc33c0cdbb0 0x7fc33c0d08a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:50.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.206+0000 7fc344051640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc33c0d0130 con 0x7fc33c15aee0 2023-12-20T04:52:50.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.206+0000 7fc344051640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc33c0ce040 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.206+0000 7fc344051640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c15f370 con 0x7fc33c0cdbb0 2023-12-20T04:52:50.208 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.206+0000 7fc3415ec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc33c0cb2b0 0x7fc33c0cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:50.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.206+0000 7fc3415ec640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc33c0cb2b0 0x7fc33c0cd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52162/0 (socket says 172.21.15.132:52162) 2023-12-20T04:52:50.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.206+0000 7fc341ded640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc33c15aee0 0x7fc33c15eb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40604/0 (socket says 172.21.15.132:40604) 2023-12-20T04:52:50.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.206+0000 7fc3415ec640 1 -- 172.21.15.132:0/585456402 learned_addr learned my addr 172.21.15.132:0/585456402 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:50.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.206+0000 7fc3415ec640 1 -- 172.21.15.132:0/585456402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc33c0cdbb0 msgr2=0x7fc33c0d08a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:50.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.206+0000 7fc3415ec640 1 --2- 172.21.15.132:0/585456402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc33c0cdbb0 0x7fc33c0d08a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.206+0000 7fc3415ec640 1 -- 172.21.15.132:0/585456402 >> v1:172.21.15.132:6789/0 conn(0x7fc33c15aee0 legacy=0x7fc33c15eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:50.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.206+0000 7fc3415ec640 1 -- 172.21.15.132:0/585456402 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc33c15f650 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.209 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.206+0000 7fc340deb640 1 -- 172.21.15.132:0/585456402 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2815469251 0 0) 0x7fc33c0d0130 con 0x7fc33c15aee0 2023-12-20T04:52:50.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.207+0000 7fc3415ec640 1 --2- 172.21.15.132:0/585456402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc33c0cb2b0 0x7fc33c0cd670 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0098a0 tx=0x7fc32c02b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9b1172cac1a3a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:50.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.207+0000 7fc340deb640 1 -- 172.21.15.132:0/585456402 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c030840 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.207+0000 7fc340deb640 1 -- 172.21.15.132:0/585456402 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc32c0309a0 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.207+0000 7fc340deb640 1 -- 172.21.15.132:0/585456402 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc32c030d30 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.208+0000 7fc344051640 1 -- 172.21.15.132:0/585456402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc33c0cb2b0 msgr2=0x7fc33c0cd670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:50.210 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.208+0000 7fc344051640 1 --2- 172.21.15.132:0/585456402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc33c0cb2b0 0x7fc33c0cd670 secure :-1 s=READY pgs=1716 cs=0 l=1 rev1=1 crypto rx=0x7fc32c0098a0 tx=0x7fc32c02b980 comp rx=0 tx=0).stop 2023-12-20T04:52:50.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.208+0000 7fc344051640 1 -- 172.21.15.132:0/585456402 shutdown_connections 2023-12-20T04:52:50.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.208+0000 7fc344051640 1 --2- 172.21.15.132:0/585456402 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc33c0cdbb0 0x7fc33c0d08a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.208+0000 7fc344051640 1 --2- 172.21.15.132:0/585456402 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc33c0cb2b0 0x7fc33c0cd670 unknown :-1 s=CLOSED pgs=1716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.208+0000 7fc344051640 1 -- 172.21.15.132:0/585456402 >> 172.21.15.132:0/585456402 conn(0x7fc33c072c60 msgr2=0x7fc33c073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:50.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.208+0000 7fc344051640 1 -- 172.21.15.132:0/585456402 shutdown_connections 2023-12-20T04:52:50.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.208+0000 7fc344051640 1 -- 172.21.15.132:0/585456402 wait complete. 2023-12-20T04:52:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.209+0000 7fc344051640 1 Processor -- start 2023-12-20T04:52:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.209+0000 7fc344051640 1 -- start start 2023-12-20T04:52:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc344051640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc33c0cb2b0 0x7fc33c0c95a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc344051640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc33c0cdbb0 0x7fc33c0d0b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc344051640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc33c15aee0 0x7fc33c15d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc344051640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c15e4c0 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc344051640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c0c87e0 con 0x7fc33c0cdbb0 2023-12-20T04:52:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc344051640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc33c0c8ac0 con 0x7fc33c15aee0 2023-12-20T04:52:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc341ded640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc33c0cb2b0 0x7fc33c0c95a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc341ded640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc33c0cb2b0 0x7fc33c0c95a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52172/0 (socket says 172.21.15.132:52172) 2023-12-20T04:52:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc341ded640 1 -- 172.21.15.132:0/2413563844 learned_addr learned my addr 172.21.15.132:0/2413563844 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc341ded640 1 -- 172.21.15.132:0/2413563844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc33c15aee0 msgr2=0x7fc33c15d9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:50.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc3425ee640 1 --2- 172.21.15.132:0/2413563844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc33c15aee0 0x7fc33c15d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:50.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc341ded640 1 --2- 172.21.15.132:0/2413563844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc33c15aee0 0x7fc33c15d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc341ded640 1 -- 172.21.15.132:0/2413563844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc33c0cdbb0 msgr2=0x7fc33c0d0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:50.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc341ded640 1 --2- 172.21.15.132:0/2413563844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc33c0cdbb0 0x7fc33c0d0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc341ded640 1 -- 172.21.15.132:0/2413563844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc32c0094d0 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc341ded640 1 --2- 172.21.15.132:0/2413563844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc33c0cb2b0 0x7fc33c0c95a0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fc33800c430 tx=0x7fc33800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:50.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc3327fc640 1 -- 172.21.15.132:0/2413563844 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3380074e0 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc3327fc640 1 -- 172.21.15.132:0/2413563844 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc338007660 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc3327fc640 1 -- 172.21.15.132:0/2413563844 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc338004a20 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc344051640 1 -- 172.21.15.132:0/2413563844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc33c0c8da0 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.210+0000 7fc344051640 1 -- 172.21.15.132:0/2413563844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc33c0c9ae0 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.211+0000 7fc344051640 1 -- 172.21.15.132:0/2413563844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc33c0c92c0 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.212+0000 7fc3327fc640 1 -- 172.21.15.132:0/2413563844 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc338004b80 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.212+0000 7fc3327fc640 1 --2- 172.21.15.132:0/2413563844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc32006a430 0x7fc32006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:50.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.212+0000 7fc3327fc640 1 -- 172.21.15.132:0/2413563844 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fc338088770 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.212+0000 7fc3415ec640 1 --2- 172.21.15.132:0/2413563844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc32006a430 0x7fc32006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:50.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.212+0000 7fc3327fc640 1 -- 172.21.15.132:0/2413563844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7fc320071fc0 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.213+0000 7fc3415ec640 1 --2- 172.21.15.132:0/2413563844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc32006a430 0x7fc32006c8f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc32c036000 tx=0x7fc32c03b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:50.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.216+0000 7fc3327fc640 1 -- 172.21.15.132:0/2413563844 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc338053d40 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.380+0000 7fc344051640 1 -- 172.21.15.132:0/2413563844 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc33c04e840 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.382 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.380+0000 7fc3327fc640 1 -- 172.21.15.132:0/2413563844 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v173) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc338057360 con 0x7fc33c0cb2b0 2023-12-20T04:52:50.382 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:52:50.384 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.382+0000 7fc344051640 1 -- 172.21.15.132:0/2413563844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc32006a430 msgr2=0x7fc32006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.382+0000 7fc344051640 1 --2- 172.21.15.132:0/2413563844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc32006a430 0x7fc32006c8f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x7fc32c036000 tx=0x7fc32c03b040 comp rx=0 tx=0).stop 2023-12-20T04:52:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.382+0000 7fc344051640 1 -- 172.21.15.132:0/2413563844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc33c0cb2b0 msgr2=0x7fc33c0c95a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.382+0000 7fc344051640 1 --2- 172.21.15.132:0/2413563844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc33c0cb2b0 0x7fc33c0c95a0 secure :-1 s=READY pgs=1717 cs=0 l=1 rev1=1 crypto rx=0x7fc33800c430 tx=0x7fc33800c8f0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.382+0000 7fc344051640 1 -- 172.21.15.132:0/2413563844 shutdown_connections 2023-12-20T04:52:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.382+0000 7fc344051640 1 --2- 172.21.15.132:0/2413563844 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc32006a430 0x7fc32006c8f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.382+0000 7fc344051640 1 --2- 172.21.15.132:0/2413563844 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc33c15aee0 0x7fc33c15d9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.382+0000 7fc344051640 1 --2- 172.21.15.132:0/2413563844 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc33c0cdbb0 0x7fc33c0d0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.382+0000 7fc344051640 1 --2- 172.21.15.132:0/2413563844 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc33c0cb2b0 0x7fc33c0c95a0 unknown :-1 s=CLOSED pgs=1717 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.382+0000 7fc344051640 1 -- 172.21.15.132:0/2413563844 >> 172.21.15.132:0/2413563844 conn(0x7fc33c072c60 msgr2=0x7fc33c159f80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.382+0000 7fc344051640 1 -- 172.21.15.132:0/2413563844 shutdown_connections 2023-12-20T04:52:50.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.382+0000 7fc344051640 1 -- 172.21.15.132:0/2413563844 wait complete. 2023-12-20T04:52:50.395 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:52:50.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.493+0000 7f4863bd2640 1 Processor -- start 2023-12-20T04:52:50.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.493+0000 7f4863bd2640 1 -- start start 2023-12-20T04:52:50.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.494+0000 7f4863bd2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f485c069c30 0x7f485c06a090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:50.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.494+0000 7f4863bd2640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f485c0705f0 0x7f485c070a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:50.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.494+0000 7f4863bd2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f485c06a5d0 con 0x7f485c15d090 2023-12-20T04:52:50.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.494+0000 7f4863bd2640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f485c161a70 con 0x7f485c0705f0 2023-12-20T04:52:50.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.494+0000 7f4863bd2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c160e60 con 0x7f485c069c30 2023-12-20T04:52:50.496 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.494+0000 7f486196e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f485c15d090 0x7f485c0c60c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40616/0 (socket says 172.21.15.132:40616) 2023-12-20T04:52:50.497 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.494+0000 7f486196e640 1 -- 172.21.15.132:0/796056447 learned_addr learned my addr 172.21.15.132:0/796056447 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:52:50.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486096c640 1 -- 172.21.15.132:0/796056447 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1862125534 0 0) 0x7f485c06a5d0 con 0x7f485c15d090 2023-12-20T04:52:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486116d640 1 --2- 172.21.15.132:0/796056447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f485c069c30 0x7f485c06a090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486096c640 1 -- 172.21.15.132:0/796056447 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4848003520 con 0x7f485c15d090 2023-12-20T04:52:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486216f640 1 --2- 172.21.15.132:0/796056447 >> v2:172.21.15.187:3300/0 conn(0x7f485c0705f0 0x7f485c070a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486096c640 1 -- 172.21.15.132:0/796056447 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 12160441 0 0) 0x7f4848003520 con 0x7f485c15d090 2023-12-20T04:52:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486096c640 1 -- 172.21.15.132:0/796056447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f485c069c30 msgr2=0x7f485c06a090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486096c640 1 --2- 172.21.15.132:0/796056447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f485c069c30 0x7f485c06a090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486096c640 1 -- 172.21.15.132:0/796056447 >> v2:172.21.15.187:3300/0 conn(0x7f485c0705f0 msgr2=0x7f485c070a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486096c640 1 --2- 172.21.15.132:0/796056447 >> v2:172.21.15.187:3300/0 conn(0x7f485c0705f0 0x7f485c070a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486096c640 1 -- 172.21.15.132:0/796056447 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c161140 con 0x7f485c15d090 2023-12-20T04:52:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486096c640 1 -- 172.21.15.132:0/796056447 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f48580019f0 con 0x7f485c15d090 2023-12-20T04:52:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486096c640 1 -- 172.21.15.132:0/796056447 >> v1:172.21.15.132:6789/0 conn(0x7f485c15d090 legacy=0x7f485c0c60c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:50.500 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486096c640 1 --2- 172.21.15.132:0/796056447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4848003970 0x7f4848003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486096c640 1 --2- 172.21.15.132:0/796056447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48480047c0 0x7f4848004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486096c640 1 --2- 172.21.15.132:0/796056447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f485c069c30 0x7f4848005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486096c640 1 -- 172.21.15.132:0/796056447 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c161a70 con 0x7f48480047c0 2023-12-20T04:52:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486096c640 1 -- 172.21.15.132:0/796056447 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c160e60 con 0x7f4848003970 2023-12-20T04:52:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486096c640 1 -- 172.21.15.132:0/796056447 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f484800b980 con 0x7f485c069c30 2023-12-20T04:52:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486116d640 1 --2- 172.21.15.132:0/796056447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48480047c0 0x7f4848004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486196e640 1 --2- 172.21.15.132:0/796056447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4848003970 0x7f4848003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486216f640 1 --2- 172.21.15.132:0/796056447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f485c069c30 0x7f4848005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486116d640 1 -- 172.21.15.132:0/796056447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f485c069c30 msgr2=0x7f4848005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486116d640 1 --2- 172.21.15.132:0/796056447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f485c069c30 0x7f4848005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486116d640 1 -- 172.21.15.132:0/796056447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4848003970 msgr2=0x7f4848003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486116d640 1 --2- 172.21.15.132:0/796056447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4848003970 0x7f4848003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486116d640 1 -- 172.21.15.132:0/796056447 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4848003520 con 0x7f48480047c0 2023-12-20T04:52:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486196e640 1 --2- 172.21.15.132:0/796056447 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4848003970 0x7f4848003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:52:50.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.495+0000 7f486216f640 1 --2- 172.21.15.132:0/796056447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f485c069c30 0x7f4848005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:52:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.496+0000 7f486116d640 1 --2- 172.21.15.132:0/796056447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48480047c0 0x7f4848004c40 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f484c009af0 tx=0x7f48480057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f29c2d680c7cfc6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.496+0000 7f486096c640 1 -- 172.21.15.132:0/796056447 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c02c6b0 con 0x7f48480047c0 2023-12-20T04:52:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.496+0000 7f486096c640 1 -- 172.21.15.132:0/796056447 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f484c02c810 con 0x7f48480047c0 2023-12-20T04:52:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.496+0000 7f486096c640 1 -- 172.21.15.132:0/796056447 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f484c02cba0 con 0x7f48480047c0 2023-12-20T04:52:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.497+0000 7f4863bd2640 1 -- 172.21.15.132:0/796056447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48480047c0 msgr2=0x7f4848004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.497+0000 7f4863bd2640 1 --2- 172.21.15.132:0/796056447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f48480047c0 0x7f4848004c40 secure :-1 s=READY pgs=1719 cs=0 l=1 rev1=1 crypto rx=0x7f484c009af0 tx=0x7f48480057f0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.497+0000 7f486216f640 1 -- 172.21.15.132:0/796056447 reap_dead start 2023-12-20T04:52:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.497+0000 7f4863bd2640 1 -- 172.21.15.132:0/796056447 shutdown_connections 2023-12-20T04:52:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.497+0000 7f4863bd2640 1 -- 172.21.15.132:0/796056447 >> 172.21.15.132:0/796056447 conn(0x7f485c0cfb10 msgr2=0x7f485c0cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.497+0000 7f4863bd2640 1 -- 172.21.15.132:0/796056447 shutdown_connections 2023-12-20T04:52:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.497+0000 7f4863bd2640 1 -- 172.21.15.132:0/796056447 wait complete. 2023-12-20T04:52:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.498+0000 7f4863bd2640 1 Processor -- start 2023-12-20T04:52:50.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.498+0000 7f4863bd2640 1 -- start start 2023-12-20T04:52:50.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f4863bd2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48480047c0 0x7f485c1459f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:50.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f4863bd2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f485c0c5630 0x7f485c0c5ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:50.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f4863bd2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f485c15ec50 0x7f485c15f0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:50.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f4863bd2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c1f25a0 con 0x7f485c15ec50 2023-12-20T04:52:50.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f4863bd2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f485c0c5ff0 con 0x7f48480047c0 2023-12-20T04:52:50.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f4863bd2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f485c1602e0 con 0x7f485c0c5630 2023-12-20T04:52:50.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f486216f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f485c15ec50 0x7f485c15f0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:50.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f486216f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f485c15ec50 0x7f485c15f0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52186/0 (socket says 172.21.15.132:52186) 2023-12-20T04:52:50.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f486216f640 1 -- 172.21.15.132:0/1309230057 learned_addr learned my addr 172.21.15.132:0/1309230057 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:50.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f486216f640 1 -- 172.21.15.132:0/1309230057 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f485c0c5630 msgr2=0x7f485c0c5ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:50.505 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f486216f640 1 --2- 172.21.15.132:0/1309230057 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f485c0c5630 0x7f485c0c5ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f486216f640 1 -- 172.21.15.132:0/1309230057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48480047c0 msgr2=0x7f485c1459f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f486216f640 1 --2- 172.21.15.132:0/1309230057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48480047c0 0x7f485c1459f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f486216f640 1 -- 172.21.15.132:0/1309230057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f485c15fa40 con 0x7f485c15ec50 2023-12-20T04:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f486216f640 1 --2- 172.21.15.132:0/1309230057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f485c15ec50 0x7f485c15f0d0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f485c066650 tx=0x7f4854009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f48527fc640 1 -- 172.21.15.132:0/1309230057 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4854004440 con 0x7f485c15ec50 2023-12-20T04:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f48527fc640 1 -- 172.21.15.132:0/1309230057 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4854003610 con 0x7f485c15ec50 2023-12-20T04:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f4863bd2640 1 -- 172.21.15.132:0/1309230057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f485c15fd20 con 0x7f485c15ec50 2023-12-20T04:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f48527fc640 1 -- 172.21.15.132:0/1309230057 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f48540039c0 con 0x7f485c15ec50 2023-12-20T04:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.499+0000 7f4863bd2640 1 -- 172.21.15.132:0/1309230057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f485c1430e0 con 0x7f485c15ec50 2023-12-20T04:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.500+0000 7f4863bd2640 1 -- 172.21.15.132:0/1309230057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f485c1606d0 con 0x7f485c15ec50 2023-12-20T04:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.501+0000 7f48527fc640 1 -- 172.21.15.132:0/1309230057 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4854003b20 con 0x7f485c15ec50 2023-12-20T04:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.501+0000 7f48527fc640 1 --2- 172.21.15.132:0/1309230057 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f484006a430 0x7f484006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.501+0000 7f48527fc640 1 -- 172.21.15.132:0/1309230057 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4854088e40 con 0x7f485c15ec50 2023-12-20T04:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.501+0000 7f486196e640 1 --2- 172.21.15.132:0/1309230057 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f484006a430 0x7f484006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.501+0000 7f48527fc640 1 -- 172.21.15.132:0/1309230057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7f4840071fc0 con 0x7f485c15ec50 2023-12-20T04:52:50.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.502+0000 7f486196e640 1 --2- 172.21.15.132:0/1309230057 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f484006a430 0x7f484006c8f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4858001f90 tx=0x7f4858001f00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:50.507 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.505+0000 7f48527fc640 1 -- 172.21.15.132:0/1309230057 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4854054550 con 0x7f485c15ec50 2023-12-20T04:52:50.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.686+0000 7f4863bd2640 1 -- 172.21.15.132:0/1309230057 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f485c0b1070 con 0x7f485c15ec50 2023-12-20T04:52:50.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.686+0000 7f48527fc640 1 -- 172.21.15.132:0/1309230057 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v173) v1 ==== 80+0+0 (secure 0 0 0) 0x7f4854019070 con 0x7f485c15ec50 2023-12-20T04:52:50.688 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:52:50.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.688+0000 7f4863bd2640 1 -- 172.21.15.132:0/1309230057 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f484006a430 msgr2=0x7f484006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:50.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.688+0000 7f4863bd2640 1 --2- 172.21.15.132:0/1309230057 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f484006a430 0x7f484006c8f0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f4858001f90 tx=0x7f4858001f00 comp rx=0 tx=0).stop 2023-12-20T04:52:50.690 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.688+0000 7f4863bd2640 1 -- 172.21.15.132:0/1309230057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f485c15ec50 msgr2=0x7f485c15f0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.688+0000 7f4863bd2640 1 --2- 172.21.15.132:0/1309230057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f485c15ec50 0x7f485c15f0d0 secure :-1 s=READY pgs=1720 cs=0 l=1 rev1=1 crypto rx=0x7f485c066650 tx=0x7f4854009f90 comp rx=0 tx=0).stop 2023-12-20T04:52:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.688+0000 7f4863bd2640 1 -- 172.21.15.132:0/1309230057 shutdown_connections 2023-12-20T04:52:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.688+0000 7f4863bd2640 1 --2- 172.21.15.132:0/1309230057 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f484006a430 0x7f484006c8f0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.688+0000 7f4863bd2640 1 --2- 172.21.15.132:0/1309230057 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f485c15ec50 0x7f485c15f0d0 unknown :-1 s=CLOSED pgs=1720 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.688+0000 7f4863bd2640 1 --2- 172.21.15.132:0/1309230057 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f485c0c5630 0x7f485c0c5ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.688+0000 7f4863bd2640 1 --2- 172.21.15.132:0/1309230057 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f48480047c0 0x7f485c1459f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.688+0000 7f4863bd2640 1 -- 172.21.15.132:0/1309230057 >> 172.21.15.132:0/1309230057 conn(0x7f485c0cfb10 msgr2=0x7f485c06e670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.688+0000 7f4863bd2640 1 -- 172.21.15.132:0/1309230057 shutdown_connections 2023-12-20T04:52:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:50.688+0000 7f4863bd2640 1 -- 172.21.15.132:0/1309230057 wait complete. 2023-12-20T04:52:50.701 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi187.front.sepia.ceph.com... 2023-12-20T04:52:50.701 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:52:50.701 DEBUG:teuthology.orchestra.run.smithi187:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-20T04:52:50.732 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[92072]: fuse finished with error 0 and tester_r 0 2023-12-20T04:52:50.734 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:52:50.734 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:52:50.734 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-20T04:52:50.903 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:52:50.903 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:52:50.918 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:52:50.918 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:52:50.918 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:52:50.918 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-20T04:52:50.972 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:52:50.972 INFO:teuthology.orchestra.run.smithi132.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-20T04:52:50.973 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:52:50.973 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:52:50.991 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:52:50.991 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:52:50.992 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:52:50.992 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-20T04:52:51.049 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:52:51.049 INFO:teuthology.orchestra.run.smithi187.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-20T04:52:51.049 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:52:51.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.147+0000 7f9c21677640 1 Processor -- start 2023-12-20T04:52:51.150 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.147+0000 7f9c21677640 1 -- start start 2023-12-20T04:52:51.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.148+0000 7f9c21677640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c1c0cba90 0x7f9c1c0cf000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:51.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.148+0000 7f9c21677640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1c161ff0 con 0x7f9c1c160ba0 2023-12-20T04:52:51.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.148+0000 7f9c21677640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9c1c1613e0 con 0x7f9c1c0ce2a0 2023-12-20T04:52:51.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.148+0000 7f9c21677640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c0cca40 con 0x7f9c1c0cba90 2023-12-20T04:52:51.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.148+0000 7f9c1affd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9c1c160ba0 0x7f9c1c0cb380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40618/0 (socket says 172.21.15.132:40618) 2023-12-20T04:52:51.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.148+0000 7f9c1affd640 1 -- 172.21.15.132:0/1207192864 learned_addr learned my addr 172.21.15.132:0/1207192864 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:52:51.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.149+0000 7f9c13fff640 1 --2- 172.21.15.132:0/1207192864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c1c0cba90 0x7f9c1c0cf000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:51.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.149+0000 7f9c1a7fc640 1 -- 172.21.15.132:0/1207192864 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2834433240 0 0) 0x7f9c1c161ff0 con 0x7f9c1c160ba0 2023-12-20T04:52:51.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.149+0000 7f9c1a7fc640 1 -- 172.21.15.132:0/1207192864 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c08003520 con 0x7f9c1c160ba0 2023-12-20T04:52:51.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.149+0000 7f9c1a7fc640 1 -- 172.21.15.132:0/1207192864 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4065820628 0 0) 0x7f9c1c1613e0 con 0x7f9c1c0ce2a0 2023-12-20T04:52:51.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.149+0000 7f9c1a7fc640 1 -- 172.21.15.132:0/1207192864 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9c1c161ff0 con 0x7f9c1c0ce2a0 2023-12-20T04:52:51.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.149+0000 7f9c13fff640 1 -- 172.21.15.132:0/1207192864 >> v1:172.21.15.187:6789/0 conn(0x7f9c1c0ce2a0 legacy=0x7f9c1c0cf540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.149+0000 7f9c13fff640 1 -- 172.21.15.132:0/1207192864 >> v1:172.21.15.132:6789/0 conn(0x7f9c1c160ba0 legacy=0x7f9c1c0cb380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.149+0000 7f9c13fff640 1 -- 172.21.15.132:0/1207192864 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c1c1616c0 con 0x7f9c1c0cba90 2023-12-20T04:52:51.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.150+0000 7f9c13fff640 1 --2- 172.21.15.132:0/1207192864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c1c0cba90 0x7f9c1c0cf000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c040097d0 tx=0x7f9c0402b8a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d79d20953b1b595f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:51.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.150+0000 7f9c1a7fc640 1 -- 172.21.15.132:0/1207192864 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c04031800 con 0x7f9c1c0cba90 2023-12-20T04:52:51.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.150+0000 7f9c1a7fc640 1 -- 172.21.15.132:0/1207192864 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c04031960 con 0x7f9c1c0cba90 2023-12-20T04:52:51.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.150+0000 7f9c1a7fc640 1 -- 172.21.15.132:0/1207192864 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c04031cd0 con 0x7f9c1c0cba90 2023-12-20T04:52:51.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.150+0000 7f9c21677640 1 -- 172.21.15.132:0/1207192864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c1c0cba90 msgr2=0x7f9c1c0cf000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.150+0000 7f9c21677640 1 --2- 172.21.15.132:0/1207192864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c1c0cba90 0x7f9c1c0cf000 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f9c040097d0 tx=0x7f9c0402b8a0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.150+0000 7f9c21677640 1 -- 172.21.15.132:0/1207192864 shutdown_connections 2023-12-20T04:52:51.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.150+0000 7f9c21677640 1 --2- 172.21.15.132:0/1207192864 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c1c0cba90 0x7f9c1c0cf000 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.150+0000 7f9c21677640 1 -- 172.21.15.132:0/1207192864 >> 172.21.15.132:0/1207192864 conn(0x7f9c1c0cd7b0 msgr2=0x7f9c1c0cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:51.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.150+0000 7f9c21677640 1 -- 172.21.15.132:0/1207192864 shutdown_connections 2023-12-20T04:52:51.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.150+0000 7f9c21677640 1 -- 172.21.15.132:0/1207192864 wait complete. 2023-12-20T04:52:51.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.152+0000 7f9c21677640 1 Processor -- start 2023-12-20T04:52:51.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.152+0000 7f9c21677640 1 -- start start 2023-12-20T04:52:51.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.152+0000 7f9c21677640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c1c0cba90 0x7f9c1c0ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:51.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.152+0000 7f9c21677640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c1c0ce2a0 0x7f9c1c1593a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:51.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.152+0000 7f9c21677640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c1c160ba0 0x7f9c1c06f0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:51.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.152+0000 7f9c21677640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c0ace20 con 0x7f9c1c0ce2a0 2023-12-20T04:52:51.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.152+0000 7f9c21677640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c157450 con 0x7f9c1c0cba90 2023-12-20T04:52:51.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.152+0000 7f9c21677640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9c1c0af2f0 con 0x7f9c1c160ba0 2023-12-20T04:52:51.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.152+0000 7f9c13fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c1c0ce2a0 0x7f9c1c1593a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:51.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.152+0000 7f9c13fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c1c0ce2a0 0x7f9c1c1593a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52202/0 (socket says 172.21.15.132:52202) 2023-12-20T04:52:51.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.152+0000 7f9c13fff640 1 -- 172.21.15.132:0/3479321012 learned_addr learned my addr 172.21.15.132:0/3479321012 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:51.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.152+0000 7f9c1affd640 1 --2- 172.21.15.132:0/3479321012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c1c0cba90 0x7f9c1c0ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:51.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.152+0000 7f9c1b7fe640 1 --2- 172.21.15.132:0/3479321012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c1c160ba0 0x7f9c1c06f0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:51.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.153+0000 7f9c13fff640 1 -- 172.21.15.132:0/3479321012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c1c160ba0 msgr2=0x7f9c1c06f0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.157 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.153+0000 7f9c13fff640 1 --2- 172.21.15.132:0/3479321012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c1c160ba0 0x7f9c1c06f0e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.153+0000 7f9c13fff640 1 -- 172.21.15.132:0/3479321012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c1c0cba90 msgr2=0x7f9c1c0ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.153+0000 7f9c13fff640 1 --2- 172.21.15.132:0/3479321012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c1c0cba90 0x7f9c1c0ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.153+0000 7f9c13fff640 1 -- 172.21.15.132:0/3479321012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c04009400 con 0x7f9c1c0ce2a0 2023-12-20T04:52:51.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.153+0000 7f9c13fff640 1 --2- 172.21.15.132:0/3479321012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c1c0ce2a0 0x7f9c1c1593a0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f9c0402b8e0 tx=0x7f9c040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:51.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.153+0000 7f9c137fe640 1 -- 172.21.15.132:0/3479321012 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c0403ac60 con 0x7f9c1c0ce2a0 2023-12-20T04:52:51.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.153+0000 7f9c137fe640 1 -- 172.21.15.132:0/3479321012 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c0403adc0 con 0x7f9c1c0ce2a0 2023-12-20T04:52:51.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.153+0000 7f9c21677640 1 -- 172.21.15.132:0/3479321012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c1c0ad030 con 0x7f9c1c0ce2a0 2023-12-20T04:52:51.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.153+0000 7f9c137fe640 1 -- 172.21.15.132:0/3479321012 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c04044600 con 0x7f9c1c0ce2a0 2023-12-20T04:52:51.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.153+0000 7f9c21677640 1 -- 172.21.15.132:0/3479321012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c1c0ad5f0 con 0x7f9c1c0ce2a0 2023-12-20T04:52:51.158 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.154+0000 7f9c21677640 1 -- 172.21.15.132:0/3479321012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c1c157610 con 0x7f9c1c0ce2a0 2023-12-20T04:52:51.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.154+0000 7f9c137fe640 1 -- 172.21.15.132:0/3479321012 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9c0404d440 con 0x7f9c1c0ce2a0 2023-12-20T04:52:51.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.155+0000 7f9c137fe640 1 --2- 172.21.15.132:0/3479321012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9bfc06a430 0x7f9bfc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:51.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.155+0000 7f9c137fe640 1 -- 172.21.15.132:0/3479321012 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f9c0402e070 con 0x7f9c1c0ce2a0 2023-12-20T04:52:51.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.155+0000 7f9c1affd640 1 --2- 172.21.15.132:0/3479321012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9bfc06a430 0x7f9bfc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:51.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.155+0000 7f9c137fe640 1 -- 172.21.15.132:0/3479321012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7f9bfc071fc0 con 0x7f9c1c0ce2a0 2023-12-20T04:52:51.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.155+0000 7f9c1affd640 1 --2- 172.21.15.132:0/3479321012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9bfc06a430 0x7f9bfc06c8f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c000f60 tx=0x7f9c0c007d70 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:51.161 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.159+0000 7f9c137fe640 1 -- 172.21.15.132:0/3479321012 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9c04035060 con 0x7f9c1c0ce2a0 2023-12-20T04:52:51.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.361+0000 7f9c21677640 1 -- 172.21.15.132:0/3479321012 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f9c1c04e840 con 0x7f9c1c0ce2a0 2023-12-20T04:52:51.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.361+0000 7f9c137fe640 1 -- 172.21.15.132:0/3479321012 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4725 (secure 0 0 0) 0x7f9c04076080 con 0x7f9c1c0ce2a0 2023-12-20T04:52:51.363 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:52:51.364 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":63,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6644,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1464403338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1464403338},{"type":"v1","addr":"172.21.15.187:6834","nonce":1464403338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2717050899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2717050899},{"type":"v1","addr":"172.21.15.187:6835","nonce":2717050899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8709,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2430423967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2430423967},{"type":"v1","addr":"172.21.15.132:6836","nonce":2430423967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:51:46.508144+0000","modified":"2023-12-20T04:51:48.515251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8712":{"gid":8712,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1841932991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1841932991},{"type":"v1","addr":"172.21.15.132:6837","nonce":1841932991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-20T04:52:51.364 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 63 2023-12-20T04:52:51.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.363+0000 7f9c21677640 1 -- 172.21.15.132:0/3479321012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9bfc06a430 msgr2=0x7f9bfc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.363+0000 7f9c21677640 1 --2- 172.21.15.132:0/3479321012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9bfc06a430 0x7f9bfc06c8f0 secure :-1 s=READY pgs=724 cs=0 l=1 rev1=1 crypto rx=0x7f9c0c000f60 tx=0x7f9c0c007d70 comp rx=0 tx=0).stop 2023-12-20T04:52:51.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.363+0000 7f9c21677640 1 -- 172.21.15.132:0/3479321012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c1c0ce2a0 msgr2=0x7f9c1c1593a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.363+0000 7f9c21677640 1 --2- 172.21.15.132:0/3479321012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c1c0ce2a0 0x7f9c1c1593a0 secure :-1 s=READY pgs=1722 cs=0 l=1 rev1=1 crypto rx=0x7f9c0402b8e0 tx=0x7f9c040046c0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.363+0000 7f9c21677640 1 -- 172.21.15.132:0/3479321012 shutdown_connections 2023-12-20T04:52:51.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.363+0000 7f9c21677640 1 --2- 172.21.15.132:0/3479321012 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9bfc06a430 0x7f9bfc06c8f0 unknown :-1 s=CLOSED pgs=724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.363+0000 7f9c21677640 1 --2- 172.21.15.132:0/3479321012 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9c1c160ba0 0x7f9c1c06f0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.363+0000 7f9c21677640 1 --2- 172.21.15.132:0/3479321012 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9c1c0ce2a0 0x7f9c1c1593a0 unknown :-1 s=CLOSED pgs=1722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.363+0000 7f9c21677640 1 --2- 172.21.15.132:0/3479321012 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9c1c0cba90 0x7f9c1c0ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.363+0000 7f9c21677640 1 -- 172.21.15.132:0/3479321012 >> 172.21.15.132:0/3479321012 conn(0x7f9c1c0cd7b0 msgr2=0x7f9c1c06bf90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:51.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.364+0000 7f9c21677640 1 -- 172.21.15.132:0/3479321012 shutdown_connections 2023-12-20T04:52:51.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.364+0000 7f9c21677640 1 -- 172.21.15.132:0/3479321012 wait complete. 2023-12-20T04:52:51.377 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:52:51.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.475+0000 7f6b52511640 1 Processor -- start 2023-12-20T04:52:51.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.475+0000 7f6b52511640 1 -- start start 2023-12-20T04:52:51.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.476+0000 7f6b52511640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b4c13cce0 0x7f6b4c159c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:51.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.476+0000 7f6b52511640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b4c15a1d0 0x7f6b4c06c020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:51.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.476+0000 7f6b52511640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6b4c15aa30 con 0x7f6b4c0c92d0 2023-12-20T04:52:51.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.476+0000 7f6b52511640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f6b4c06b260 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.476+0000 7f6b52511640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c06b540 con 0x7f6b4c13cce0 2023-12-20T04:52:51.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.476+0000 7f6b50aae640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b4c15a1d0 0x7f6b4c06c020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:51.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.476+0000 7f6b50aae640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f6b4c15a1d0 0x7f6b4c06c020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52208/0 (socket says 172.21.15.132:52208) 2023-12-20T04:52:51.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.476+0000 7f6b4bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6b4c0c92d0 0x7f6b4c0c96b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40626/0 (socket says 172.21.15.132:40626) 2023-12-20T04:52:51.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.476+0000 7f6b50aae640 1 -- 172.21.15.132:0/879024577 learned_addr learned my addr 172.21.15.132:0/879024577 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:51.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.476+0000 7f6b4b7fe640 1 --2- 172.21.15.132:0/879024577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b4c13cce0 0x7f6b4c159c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:51.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.476+0000 7f6b50aae640 1 -- 172.21.15.132:0/879024577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b4c13cce0 msgr2=0x7f6b4c159c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:51.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.476+0000 7f6b50aae640 1 --2- 172.21.15.132:0/879024577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b4c13cce0 0x7f6b4c159c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.476+0000 7f6b50aae640 1 -- 172.21.15.132:0/879024577 >> v1:172.21.15.132:6789/0 conn(0x7f6b4c0c92d0 legacy=0x7f6b4c0c96b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.476+0000 7f6b50aae640 1 -- 172.21.15.132:0/879024577 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b4c06b820 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.476+0000 7f6b4affd640 1 -- 172.21.15.132:0/879024577 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 535952108 0 0) 0x7f6b4c15aa30 con 0x7f6b4c0c92d0 2023-12-20T04:52:51.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.477+0000 7f6b50aae640 1 --2- 172.21.15.132:0/879024577 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b4c15a1d0 0x7f6b4c06c020 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009e50 tx=0x7f6b4402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=40c00a3efcc23a94 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:51.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.477+0000 7f6b4affd640 1 -- 172.21.15.132:0/879024577 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4402ca70 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.477+0000 7f6b4affd640 1 -- 172.21.15.132:0/879024577 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4402cbd0 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.477+0000 7f6b4affd640 1 -- 172.21.15.132:0/879024577 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b440343f0 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.477+0000 7f6b52511640 1 -- 172.21.15.132:0/879024577 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b4c15a1d0 msgr2=0x7f6b4c06c020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.477+0000 7f6b52511640 1 --2- 172.21.15.132:0/879024577 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b4c15a1d0 0x7f6b4c06c020 secure :-1 s=READY pgs=1724 cs=0 l=1 rev1=1 crypto rx=0x7f6b44009e50 tx=0x7f6b4402bed0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.477+0000 7f6b52511640 1 -- 172.21.15.132:0/879024577 shutdown_connections 2023-12-20T04:52:51.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.477+0000 7f6b52511640 1 --2- 172.21.15.132:0/879024577 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b4c15a1d0 0x7f6b4c06c020 unknown :-1 s=CLOSED pgs=1724 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.477+0000 7f6b52511640 1 --2- 172.21.15.132:0/879024577 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b4c13cce0 0x7f6b4c159c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.477+0000 7f6b52511640 1 -- 172.21.15.132:0/879024577 >> 172.21.15.132:0/879024577 conn(0x7f6b4c0ced10 msgr2=0x7f6b4c0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:51.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.478+0000 7f6b52511640 1 -- 172.21.15.132:0/879024577 shutdown_connections 2023-12-20T04:52:51.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.478+0000 7f6b52511640 1 -- 172.21.15.132:0/879024577 wait complete. 2023-12-20T04:52:51.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.479+0000 7f6b52511640 1 Processor -- start 2023-12-20T04:52:51.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.479+0000 7f6b52511640 1 -- start start 2023-12-20T04:52:51.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.479+0000 7f6b52511640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b4c0c92d0 0x7f6b4c0c49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:51.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.479+0000 7f6b52511640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b4c13cce0 0x7f6b4c1578b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:51.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.479+0000 7f6b52511640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b4c15a1d0 0x7f6b4c0cd9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:51.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b52511640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c15cd20 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b52511640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c0c5d50 con 0x7f6b4c13cce0 2023-12-20T04:52:51.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b52511640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6b4c15c680 con 0x7f6b4c0c92d0 2023-12-20T04:52:51.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b50aae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b4c15a1d0 0x7f6b4c0cd9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:51.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b50aae640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b4c15a1d0 0x7f6b4c0cd9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52216/0 (socket says 172.21.15.132:52216) 2023-12-20T04:52:51.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b50aae640 1 -- 172.21.15.132:0/928143602 learned_addr learned my addr 172.21.15.132:0/928143602 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:51.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b4bfff640 1 --2- 172.21.15.132:0/928143602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b4c0c92d0 0x7f6b4c0c49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:51.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b50aae640 1 -- 172.21.15.132:0/928143602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b4c0c92d0 msgr2=0x7f6b4c0c49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b50aae640 1 --2- 172.21.15.132:0/928143602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b4c0c92d0 0x7f6b4c0c49b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b50aae640 1 -- 172.21.15.132:0/928143602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b4c13cce0 msgr2=0x7f6b4c1578b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b4b7fe640 1 --2- 172.21.15.132:0/928143602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b4c13cce0 0x7f6b4c1578b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:51.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b50aae640 1 --2- 172.21.15.132:0/928143602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b4c13cce0 0x7f6b4c1578b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b50aae640 1 -- 172.21.15.132:0/928143602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b44009b30 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b50aae640 1 --2- 172.21.15.132:0/928143602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b4c15a1d0 0x7f6b4c0cd9d0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f6b44036040 tx=0x7f6b44004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:51.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b48ff9640 1 -- 172.21.15.132:0/928143602 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b44009510 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b48ff9640 1 -- 172.21.15.132:0/928143602 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6b4403e450 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b48ff9640 1 -- 172.21.15.132:0/928143602 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6b4403e7e0 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b52511640 1 -- 172.21.15.132:0/928143602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b4c15bb40 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.480+0000 7f6b52511640 1 -- 172.21.15.132:0/928143602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b4c0c4ef0 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.481+0000 7f6b52511640 1 -- 172.21.15.132:0/928143602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b4c04e840 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.482+0000 7f6b48ff9640 1 -- 172.21.15.132:0/928143602 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6b4403e940 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.482+0000 7f6b48ff9640 1 --2- 172.21.15.132:0/928143602 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b3806a430 0x7f6b3806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:51.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.482+0000 7f6b48ff9640 1 -- 172.21.15.132:0/928143602 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f6b440ab800 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.482+0000 7f6b4bfff640 1 --2- 172.21.15.132:0/928143602 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b3806a430 0x7f6b3806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:51.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.482+0000 7f6b48ff9640 1 -- 172.21.15.132:0/928143602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7f6b38071fc0 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.482+0000 7f6b4bfff640 1 --2- 172.21.15.132:0/928143602 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b3806a430 0x7f6b3806c8f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c007fd0 tx=0x7f6b3c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:51.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.486+0000 7f6b48ff9640 1 -- 172.21.15.132:0/928143602 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6b44043020 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.655 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.653+0000 7f6b52511640 1 -- 172.21.15.132:0/928143602 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6b4c13eb50 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.654+0000 7f6b48ff9640 1 -- 172.21.15.132:0/928143602 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+16236 (secure 0 0 0) 0x7f6b44076d40 con 0x7f6b4c15a1d0 2023-12-20T04:52:51.656 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:52:51.657 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":173,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:52:39.899511+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:51:44.739391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-20T04:51:45.486167+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.14","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:52:51.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.656+0000 7f6b52511640 1 -- 172.21.15.132:0/928143602 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b3806a430 msgr2=0x7f6b3806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.656+0000 7f6b52511640 1 --2- 172.21.15.132:0/928143602 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b3806a430 0x7f6b3806c8f0 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7f6b3c007fd0 tx=0x7f6b3c009040 comp rx=0 tx=0).stop 2023-12-20T04:52:51.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.656+0000 7f6b52511640 1 -- 172.21.15.132:0/928143602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b4c15a1d0 msgr2=0x7f6b4c0cd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.656+0000 7f6b52511640 1 --2- 172.21.15.132:0/928143602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b4c15a1d0 0x7f6b4c0cd9d0 secure :-1 s=READY pgs=1725 cs=0 l=1 rev1=1 crypto rx=0x7f6b44036040 tx=0x7f6b44004a40 comp rx=0 tx=0).stop 2023-12-20T04:52:51.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.656+0000 7f6b52511640 1 -- 172.21.15.132:0/928143602 shutdown_connections 2023-12-20T04:52:51.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.656+0000 7f6b52511640 1 --2- 172.21.15.132:0/928143602 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6b3806a430 0x7f6b3806c8f0 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.656+0000 7f6b52511640 1 --2- 172.21.15.132:0/928143602 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6b4c15a1d0 0x7f6b4c0cd9d0 unknown :-1 s=CLOSED pgs=1725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.656+0000 7f6b52511640 1 --2- 172.21.15.132:0/928143602 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6b4c13cce0 0x7f6b4c1578b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.656+0000 7f6b52511640 1 --2- 172.21.15.132:0/928143602 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6b4c0c92d0 0x7f6b4c0c49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.656+0000 7f6b52511640 1 -- 172.21.15.132:0/928143602 >> 172.21.15.132:0/928143602 conn(0x7f6b4c0ced10 msgr2=0x7f6b4c0c51b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:51.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.656+0000 7f6b52511640 1 -- 172.21.15.132:0/928143602 shutdown_connections 2023-12-20T04:52:51.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.656+0000 7f6b52511640 1 -- 172.21.15.132:0/928143602 wait complete. 2023-12-20T04:52:51.669 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 20, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:51:44.739391+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '168', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 21, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:51:45.486167+0000', 'flags': 1027, 'flags_names': 'hashpspool,full,full_quota', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '173', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:52:51.670 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:52:51.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.770+0000 7fbc65f55640 1 Processor -- start 2023-12-20T04:52:51.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.770+0000 7fbc65f55640 1 -- start start 2023-12-20T04:52:51.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.771+0000 7fbc65f55640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbc6015cf20 0x7fbc6006c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:51.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.771+0000 7fbc65f55640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc6006cc90 con 0x7fbc6015d300 2023-12-20T04:52:51.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.771+0000 7fbc65f55640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc600b2f30 con 0x7fbc600cd4b0 2023-12-20T04:52:51.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.771+0000 7fbc65f55640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc600b3210 con 0x7fbc6015cf20 2023-12-20T04:52:51.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.771+0000 7fbc5f7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbc6015cf20 0x7fbc6006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:51.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.771+0000 7fbc5effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fbc6015d300 0x7fbc60161700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40638/0 (socket says 172.21.15.132:40638) 2023-12-20T04:52:51.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.771+0000 7fbc5effd640 1 -- 172.21.15.132:0/3658473181 learned_addr learned my addr 172.21.15.132:0/3658473181 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:52:51.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.771+0000 7fbc5f7fe640 1 -- 172.21.15.132:0/3658473181 >> v1:172.21.15.187:6789/0 conn(0x7fbc600cd4b0 legacy=0x7fbc600d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:51.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.771+0000 7fbc5f7fe640 1 -- 172.21.15.132:0/3658473181 >> v1:172.21.15.132:6789/0 conn(0x7fbc6015d300 legacy=0x7fbc60161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.771+0000 7fbc5f7fe640 1 -- 172.21.15.132:0/3658473181 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc600b34f0 con 0x7fbc6015cf20 2023-12-20T04:52:51.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.771+0000 7fbc5e7fc640 1 -- 172.21.15.132:0/3658473181 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 749949392 0 0) 0x7fbc6006cc90 con 0x7fbc6015d300 2023-12-20T04:52:51.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.772+0000 7fbc5f7fe640 1 --2- 172.21.15.132:0/3658473181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc6015cf20 0x7fbc6006c590 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fbc500097a0 tx=0x7fbc5002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf8c11ef0bad8f67 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:51.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.772+0000 7fbc5e7fc640 1 -- 172.21.15.132:0/3658473181 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50031830 con 0x7fbc6015cf20 2023-12-20T04:52:51.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.772+0000 7fbc5e7fc640 1 -- 172.21.15.132:0/3658473181 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc50031990 con 0x7fbc6015cf20 2023-12-20T04:52:51.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.772+0000 7fbc5e7fc640 1 -- 172.21.15.132:0/3658473181 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc50031d20 con 0x7fbc6015cf20 2023-12-20T04:52:51.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.773+0000 7fbc65f55640 1 -- 172.21.15.132:0/3658473181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc6015cf20 msgr2=0x7fbc6006c590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.773+0000 7fbc65f55640 1 --2- 172.21.15.132:0/3658473181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc6015cf20 0x7fbc6006c590 secure :-1 s=READY pgs=1727 cs=0 l=1 rev1=1 crypto rx=0x7fbc500097a0 tx=0x7fbc5002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.773+0000 7fbc65f55640 1 -- 172.21.15.132:0/3658473181 shutdown_connections 2023-12-20T04:52:51.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.773+0000 7fbc65f55640 1 --2- 172.21.15.132:0/3658473181 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc6015cf20 0x7fbc6006c590 unknown :-1 s=CLOSED pgs=1727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.773+0000 7fbc65f55640 1 -- 172.21.15.132:0/3658473181 >> 172.21.15.132:0/3658473181 conn(0x7fbc60072c60 msgr2=0x7fbc60073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:51.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.773+0000 7fbc65f55640 1 -- 172.21.15.132:0/3658473181 shutdown_connections 2023-12-20T04:52:51.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.773+0000 7fbc65f55640 1 -- 172.21.15.132:0/3658473181 wait complete. 2023-12-20T04:52:51.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.774+0000 7fbc65f55640 1 Processor -- start 2023-12-20T04:52:51.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.774+0000 7fbc65f55640 1 -- start start 2023-12-20T04:52:51.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc65f55640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc600cd4b0 0x7fbc600af180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:51.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc65f55640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc6015cf20 0x7fbc601f6210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:51.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc65f55640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc6015d300 0x7fbc601f6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:51.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc65f55640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600aff20 con 0x7fbc6015d300 2023-12-20T04:52:51.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc65f55640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600afc40 con 0x7fbc6015cf20 2023-12-20T04:52:51.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc65f55640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc600c5910 con 0x7fbc600cd4b0 2023-12-20T04:52:51.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc5ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc6015d300 0x7fbc601f6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:51.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc5ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc6015d300 0x7fbc601f6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52224/0 (socket says 172.21.15.132:52224) 2023-12-20T04:52:51.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc5ffff640 1 -- 172.21.15.132:0/407118294 learned_addr learned my addr 172.21.15.132:0/407118294 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:51.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc5f7fe640 1 --2- 172.21.15.132:0/407118294 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc600cd4b0 0x7fbc600af180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:51.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc5effd640 1 --2- 172.21.15.132:0/407118294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc6015cf20 0x7fbc601f6210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:51.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc5ffff640 1 -- 172.21.15.132:0/407118294 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc600cd4b0 msgr2=0x7fbc600af180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc5ffff640 1 --2- 172.21.15.132:0/407118294 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc600cd4b0 0x7fbc600af180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc5ffff640 1 -- 172.21.15.132:0/407118294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc6015cf20 msgr2=0x7fbc601f6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc5ffff640 1 --2- 172.21.15.132:0/407118294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc6015cf20 0x7fbc601f6210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc5ffff640 1 -- 172.21.15.132:0/407118294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc50009400 con 0x7fbc6015d300 2023-12-20T04:52:51.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc5ffff640 1 --2- 172.21.15.132:0/407118294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc6015d300 0x7fbc601f6750 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800c780 tx=0x7fbc5800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:51.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc47fff640 1 -- 172.21.15.132:0/407118294 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc58004b60 con 0x7fbc6015d300 2023-12-20T04:52:51.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc47fff640 1 -- 172.21.15.132:0/407118294 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc5800ce90 con 0x7fbc6015d300 2023-12-20T04:52:51.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc47fff640 1 -- 172.21.15.132:0/407118294 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc5800a850 con 0x7fbc6015d300 2023-12-20T04:52:51.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc65f55640 1 -- 172.21.15.132:0/407118294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc600c5bf0 con 0x7fbc6015d300 2023-12-20T04:52:51.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.775+0000 7fbc65f55640 1 -- 172.21.15.132:0/407118294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc6014c940 con 0x7fbc6015d300 2023-12-20T04:52:51.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.776+0000 7fbc65f55640 1 -- 172.21.15.132:0/407118294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc600c6110 con 0x7fbc6015d300 2023-12-20T04:52:51.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.777+0000 7fbc47fff640 1 -- 172.21.15.132:0/407118294 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbc5800a9b0 con 0x7fbc6015d300 2023-12-20T04:52:51.780 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.777+0000 7fbc47fff640 1 --2- 172.21.15.132:0/407118294 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc4c06a430 0x7fbc4c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:51.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.777+0000 7fbc47fff640 1 -- 172.21.15.132:0/407118294 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fbc58088a50 con 0x7fbc6015d300 2023-12-20T04:52:51.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.777+0000 7fbc5f7fe640 1 --2- 172.21.15.132:0/407118294 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc4c06a430 0x7fbc4c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:51.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.777+0000 7fbc47fff640 1 -- 172.21.15.132:0/407118294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7fbc4c071fc0 con 0x7fbc6015d300 2023-12-20T04:52:51.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.778+0000 7fbc5f7fe640 1 --2- 172.21.15.132:0/407118294 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc4c06a430 0x7fbc4c06c8f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fbc50036000 tx=0x7fbc5003c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:51.783 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.781+0000 7fbc47fff640 1 -- 172.21.15.132:0/407118294 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbc600c6110 con 0x7fbc6015d300 2023-12-20T04:52:51.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.945+0000 7fbc65f55640 1 -- 172.21.15.132:0/407118294 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fbc600c6110 con 0x7fbc6015d300 2023-12-20T04:52:51.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.946+0000 7fbc47fff640 1 -- 172.21.15.132:0/407118294 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v173) v1 ==== 93+0+10 (secure 0 0 0) 0x7fbc600c6110 con 0x7fbc6015d300 2023-12-20T04:52:51.948 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:52:51.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.948+0000 7fbc65f55640 1 -- 172.21.15.132:0/407118294 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc4c06a430 msgr2=0x7fbc4c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.948+0000 7fbc65f55640 1 --2- 172.21.15.132:0/407118294 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc4c06a430 0x7fbc4c06c8f0 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fbc50036000 tx=0x7fbc5003c040 comp rx=0 tx=0).stop 2023-12-20T04:52:51.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.948+0000 7fbc65f55640 1 -- 172.21.15.132:0/407118294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc6015d300 msgr2=0x7fbc601f6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:51.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.948+0000 7fbc65f55640 1 --2- 172.21.15.132:0/407118294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc6015d300 0x7fbc601f6750 secure :-1 s=READY pgs=1728 cs=0 l=1 rev1=1 crypto rx=0x7fbc5800c780 tx=0x7fbc5800cc40 comp rx=0 tx=0).stop 2023-12-20T04:52:51.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.948+0000 7fbc65f55640 1 -- 172.21.15.132:0/407118294 shutdown_connections 2023-12-20T04:52:51.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.948+0000 7fbc65f55640 1 --2- 172.21.15.132:0/407118294 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc4c06a430 0x7fbc4c06c8f0 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.948+0000 7fbc65f55640 1 --2- 172.21.15.132:0/407118294 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc6015d300 0x7fbc601f6750 unknown :-1 s=CLOSED pgs=1728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.950 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.948+0000 7fbc65f55640 1 --2- 172.21.15.132:0/407118294 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc6015cf20 0x7fbc601f6210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.948+0000 7fbc65f55640 1 --2- 172.21.15.132:0/407118294 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc600cd4b0 0x7fbc600af180 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:51.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.948+0000 7fbc65f55640 1 -- 172.21.15.132:0/407118294 >> 172.21.15.132:0/407118294 conn(0x7fbc60072c60 msgr2=0x7fbc601610f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:51.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.948+0000 7fbc65f55640 1 -- 172.21.15.132:0/407118294 shutdown_connections 2023-12-20T04:52:51.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:51.948+0000 7fbc65f55640 1 -- 172.21.15.132:0/407118294 wait complete. 2023-12-20T04:52:51.961 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:52:52.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.062+0000 7f9cfc700640 1 Processor -- start 2023-12-20T04:52:52.064 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.062+0000 7f9cfc700640 1 -- start start 2023-12-20T04:52:52.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.063+0000 7f9cfc700640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cf40ce580 0x7f9cf40c39f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.063+0000 7f9cfc700640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9cf40c3f30 0x7f9cf415d620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.063+0000 7f9cfc700640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9cf4161820 con 0x7f9cf4153fa0 2023-12-20T04:52:52.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.063+0000 7f9cfc700640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cf4160c10 con 0x7f9cf40c3f30 2023-12-20T04:52:52.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.063+0000 7f9cfc700640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf4160ef0 con 0x7f9cf40ce580 2023-12-20T04:52:52.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.063+0000 7f9cf9c9b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cf40ce580 0x7f9cf40c39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.063+0000 7f9cfac9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9cf40c3f30 0x7f9cf415d620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.063+0000 7f9cfa49c640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f9cf4153fa0 0x7f9cf40cde70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:47598/0 (socket says 172.21.15.132:47598) 2023-12-20T04:52:52.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.063+0000 7f9cfac9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9cf40c3f30 0x7f9cf415d620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:35816/0 (socket says 172.21.15.132:35816) 2023-12-20T04:52:52.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.063+0000 7f9cf9c9b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cf40ce580 0x7f9cf40c39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:50418/0 (socket says 172.21.15.132:50418) 2023-12-20T04:52:52.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.063+0000 7f9cfa49c640 1 -- 172.21.15.132:0/3847526391 learned_addr learned my addr 172.21.15.132:0/3847526391 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:52:52.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.064+0000 7f9cfac9d640 1 -- 172.21.15.132:0/3847526391 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cf40ce580 msgr2=0x7f9cf40c39f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:52.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.064+0000 7f9cfac9d640 1 --2- 172.21.15.132:0/3847526391 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cf40ce580 0x7f9cf40c39f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.064+0000 7f9cfac9d640 1 -- 172.21.15.132:0/3847526391 >> v1:172.21.15.187:6789/0 conn(0x7f9cf4153fa0 legacy=0x7f9cf40cde70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.064+0000 7f9cfac9d640 1 -- 172.21.15.132:0/3847526391 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cf41611d0 con 0x7f9cf40c3f30 2023-12-20T04:52:52.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.064+0000 7f9cf949a640 1 -- 172.21.15.132:0/3847526391 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2170726551 0 0) 0x7f9cf4161820 con 0x7f9cf4153fa0 2023-12-20T04:52:52.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.064+0000 7f9cf9c9b640 1 --2- 172.21.15.132:0/3847526391 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cf40ce580 0x7f9cf40c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:52:52.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.064+0000 7f9cfac9d640 1 --2- 172.21.15.132:0/3847526391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cf40c3f30 0x7f9cf415d620 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009d90 tx=0x7f9cec02bd80 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dea5a67aa016856d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:52.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.064+0000 7f9cf949a640 1 -- 172.21.15.132:0/3847526391 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec02cb30 con 0x7f9cf40c3f30 2023-12-20T04:52:52.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.064+0000 7f9cf949a640 1 -- 172.21.15.132:0/3847526391 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cec02cc90 con 0x7f9cf40c3f30 2023-12-20T04:52:52.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.065+0000 7f9cf949a640 1 -- 172.21.15.132:0/3847526391 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cec034440 con 0x7f9cf40c3f30 2023-12-20T04:52:52.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.065+0000 7f9cfc700640 1 -- 172.21.15.132:0/3847526391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cf40c3f30 msgr2=0x7f9cf415d620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.065+0000 7f9cfc700640 1 --2- 172.21.15.132:0/3847526391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cf40c3f30 0x7f9cf415d620 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7f9cec009d90 tx=0x7f9cec02bd80 comp rx=0 tx=0).stop 2023-12-20T04:52:52.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.065+0000 7f9cfc700640 1 -- 172.21.15.132:0/3847526391 shutdown_connections 2023-12-20T04:52:52.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.065+0000 7f9cfc700640 1 --2- 172.21.15.132:0/3847526391 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cf40c3f30 0x7f9cf415d620 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.065+0000 7f9cfc700640 1 --2- 172.21.15.132:0/3847526391 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cf40ce580 0x7f9cf40c39f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.065+0000 7f9cfc700640 1 -- 172.21.15.132:0/3847526391 >> 172.21.15.132:0/3847526391 conn(0x7f9cf406a260 msgr2=0x7f9cf40b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:52.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.065+0000 7f9cfc700640 1 -- 172.21.15.132:0/3847526391 shutdown_connections 2023-12-20T04:52:52.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.065+0000 7f9cfc700640 1 -- 172.21.15.132:0/3847526391 wait complete. 2023-12-20T04:52:52.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.066+0000 7f9cfc700640 1 Processor -- start 2023-12-20T04:52:52.069 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.066+0000 7f9cfc700640 1 -- start start 2023-12-20T04:52:52.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.067+0000 7f9cfc700640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cf40c3f30 0x7f9cf40b4190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.067+0000 7f9cfc700640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cf40ce580 0x7f9cf41573c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.067+0000 7f9cfc700640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cf4153fa0 0x7f9cf40b21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.067+0000 7f9cfc700640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf40b1da0 con 0x7f9cf40c3f30 2023-12-20T04:52:52.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.067+0000 7f9cfc700640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf4154ad0 con 0x7f9cf4153fa0 2023-12-20T04:52:52.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.067+0000 7f9cfc700640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cf41550b0 con 0x7f9cf40ce580 2023-12-20T04:52:52.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.067+0000 7f9cfa49c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cf40c3f30 0x7f9cf40b4190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.067+0000 7f9cfa49c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cf40c3f30 0x7f9cf40b4190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52232/0 (socket says 172.21.15.132:52232) 2023-12-20T04:52:52.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.067+0000 7f9cfa49c640 1 -- 172.21.15.132:0/2128947772 learned_addr learned my addr 172.21.15.132:0/2128947772 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:52.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.067+0000 7f9cfac9d640 1 --2- 172.21.15.132:0/2128947772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cf4153fa0 0x7f9cf40b21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.067+0000 7f9cf9c9b640 1 --2- 172.21.15.132:0/2128947772 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cf40ce580 0x7f9cf41573c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.067+0000 7f9cfa49c640 1 -- 172.21.15.132:0/2128947772 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cf40ce580 msgr2=0x7f9cf41573c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.067+0000 7f9cfa49c640 1 --2- 172.21.15.132:0/2128947772 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cf40ce580 0x7f9cf41573c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.067+0000 7f9cfa49c640 1 -- 172.21.15.132:0/2128947772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cf4153fa0 msgr2=0x7f9cf40b21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.067+0000 7f9cfa49c640 1 --2- 172.21.15.132:0/2128947772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cf4153fa0 0x7f9cf40b21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.067+0000 7f9cfa49c640 1 -- 172.21.15.132:0/2128947772 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce4009400 con 0x7f9cf40c3f30 2023-12-20T04:52:52.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.068+0000 7f9cfa49c640 1 --2- 172.21.15.132:0/2128947772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cf40c3f30 0x7f9cf40b4190 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000c4d0 tx=0x7f9cf000c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:52.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.068+0000 7f9ceaffd640 1 -- 172.21.15.132:0/2128947772 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf00074e0 con 0x7f9cf40c3f30 2023-12-20T04:52:52.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.068+0000 7f9ceaffd640 1 -- 172.21.15.132:0/2128947772 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cf0007660 con 0x7f9cf40c3f30 2023-12-20T04:52:52.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.068+0000 7f9cfc700640 1 -- 172.21.15.132:0/2128947772 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cec009a70 con 0x7f9cf40c3f30 2023-12-20T04:52:52.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.068+0000 7f9ceaffd640 1 -- 172.21.15.132:0/2128947772 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cf0004a20 con 0x7f9cf40c3f30 2023-12-20T04:52:52.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.068+0000 7f9cfc700640 1 -- 172.21.15.132:0/2128947772 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cf40b46d0 con 0x7f9cf40c3f30 2023-12-20T04:52:52.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.069+0000 7f9cfc700640 1 -- 172.21.15.132:0/2128947772 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cf40b2010 con 0x7f9cf40c3f30 2023-12-20T04:52:52.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.069+0000 7f9ceaffd640 1 -- 172.21.15.132:0/2128947772 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9cf0004b80 con 0x7f9cf40c3f30 2023-12-20T04:52:52.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.069+0000 7f9ceaffd640 1 --2- 172.21.15.132:0/2128947772 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cd806a460 0x7f9cd806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.070+0000 7f9ceaffd640 1 -- 172.21.15.132:0/2128947772 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f9cf0087ca0 con 0x7f9cf40c3f30 2023-12-20T04:52:52.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.070+0000 7f9cf9c9b640 1 --2- 172.21.15.132:0/2128947772 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cd806a460 0x7f9cd806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.070+0000 7f9ceaffd640 1 -- 172.21.15.132:0/2128947772 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7f9cd8071ff0 con 0x7f9cf40c3f30 2023-12-20T04:52:52.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.070+0000 7f9cf9c9b640 1 --2- 172.21.15.132:0/2128947772 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cd806a460 0x7f9cd806c920 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4160200 tx=0x7f9ce4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:52.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.074+0000 7f9ceaffd640 1 -- 172.21.15.132:0/2128947772 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9cf0018060 con 0x7f9cf40c3f30 2023-12-20T04:52:52.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.239+0000 7f9cfc700640 1 -- 172.21.15.132:0/2128947772 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f9cf4067140 con 0x7f9cf40c3f30 2023-12-20T04:52:52.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.240+0000 7f9ceaffd640 1 -- 172.21.15.132:0/2128947772 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v173) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9cf00533b0 con 0x7f9cf40c3f30 2023-12-20T04:52:52.242 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:52:52.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.241+0000 7f9cfc700640 1 -- 172.21.15.132:0/2128947772 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cd806a460 msgr2=0x7f9cd806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.241+0000 7f9cfc700640 1 --2- 172.21.15.132:0/2128947772 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cd806a460 0x7f9cd806c920 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7f9cf4160200 tx=0x7f9ce4009190 comp rx=0 tx=0).stop 2023-12-20T04:52:52.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.241+0000 7f9cfc700640 1 -- 172.21.15.132:0/2128947772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cf40c3f30 msgr2=0x7f9cf40b4190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.241+0000 7f9cfc700640 1 --2- 172.21.15.132:0/2128947772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cf40c3f30 0x7f9cf40b4190 secure :-1 s=READY pgs=1729 cs=0 l=1 rev1=1 crypto rx=0x7f9cf000c4d0 tx=0x7f9cf000c990 comp rx=0 tx=0).stop 2023-12-20T04:52:52.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.242+0000 7f9cfc700640 1 -- 172.21.15.132:0/2128947772 shutdown_connections 2023-12-20T04:52:52.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.242+0000 7f9cfc700640 1 --2- 172.21.15.132:0/2128947772 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cd806a460 0x7f9cd806c920 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.242+0000 7f9cfc700640 1 --2- 172.21.15.132:0/2128947772 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cf4153fa0 0x7f9cf40b21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.242+0000 7f9cfc700640 1 --2- 172.21.15.132:0/2128947772 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cf40ce580 0x7f9cf41573c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.242+0000 7f9cfc700640 1 --2- 172.21.15.132:0/2128947772 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cf40c3f30 0x7f9cf40b4190 unknown :-1 s=CLOSED pgs=1729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.242+0000 7f9cfc700640 1 -- 172.21.15.132:0/2128947772 >> 172.21.15.132:0/2128947772 conn(0x7f9cf406a260 msgr2=0x7f9cf40b0090 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:52.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.242+0000 7f9cfc700640 1 -- 172.21.15.132:0/2128947772 shutdown_connections 2023-12-20T04:52:52.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.242+0000 7f9cfc700640 1 -- 172.21.15.132:0/2128947772 wait complete. 2023-12-20T04:52:52.255 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:52:52.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.355+0000 7f76fed99640 1 Processor -- start 2023-12-20T04:52:52.357 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.355+0000 7f76fed99640 1 -- start start 2023-12-20T04:52:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.356+0000 7f76fed99640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f76f80cf1d0 0x7f76f815e200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.356+0000 7f76fed99640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76f80ce7e0 0x7f76f80708f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.356+0000 7f76fed99640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76f815e740 con 0x7f76f8070460 2023-12-20T04:52:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.356+0000 7f76fed99640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f8070e30 con 0x7f76f80ce7e0 2023-12-20T04:52:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.356+0000 7f76fed99640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76f80cb6b0 con 0x7f76f80cf1d0 2023-12-20T04:52:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.356+0000 7f76fd336640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76f80ce7e0 0x7f76f80708f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.356+0000 7f76f7fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f76f8070460 0x7f76f80c4a70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40644/0 (socket says 172.21.15.132:40644) 2023-12-20T04:52:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.356+0000 7f76f7fff640 1 -- 172.21.15.132:0/1901969224 learned_addr learned my addr 172.21.15.132:0/1901969224 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:52:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.357+0000 7f76fcb35640 1 --2- 172.21.15.132:0/1901969224 >> v2:172.21.15.187:3300/0 conn(0x7f76f80cf1d0 0x7f76f815e200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.357+0000 7f76fd336640 1 -- 172.21.15.132:0/1901969224 >> v2:172.21.15.187:3300/0 conn(0x7f76f80cf1d0 msgr2=0x7f76f815e200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.357+0000 7f76fd336640 1 --2- 172.21.15.132:0/1901969224 >> v2:172.21.15.187:3300/0 conn(0x7f76f80cf1d0 0x7f76f815e200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.357+0000 7f76fd336640 1 -- 172.21.15.132:0/1901969224 >> v1:172.21.15.132:6789/0 conn(0x7f76f8070460 legacy=0x7f76f80c4a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.359 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.357+0000 7f76fd336640 1 -- 172.21.15.132:0/1901969224 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f80cb990 con 0x7f76f80ce7e0 2023-12-20T04:52:52.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.357+0000 7f76f77fe640 1 -- 172.21.15.132:0/1901969224 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 704714478 0 0) 0x7f76f815e740 con 0x7f76f8070460 2023-12-20T04:52:52.360 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.357+0000 7f76fcb35640 1 --2- 172.21.15.132:0/1901969224 >> v2:172.21.15.187:3300/0 conn(0x7f76f80cf1d0 0x7f76f815e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:52:52.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.357+0000 7f76fd336640 1 --2- 172.21.15.132:0/1901969224 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f80ce7e0 0x7f76f80708f0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f76f8073ad0 tx=0x7f76f002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fbc9857a67921951 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:52.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.358+0000 7f76f77fe640 1 -- 172.21.15.132:0/1901969224 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f002cc80 con 0x7f76f80ce7e0 2023-12-20T04:52:52.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.358+0000 7f76f77fe640 1 -- 172.21.15.132:0/1901969224 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f002cde0 con 0x7f76f80ce7e0 2023-12-20T04:52:52.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.358+0000 7f76f77fe640 1 -- 172.21.15.132:0/1901969224 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0034660 con 0x7f76f80ce7e0 2023-12-20T04:52:52.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.358+0000 7f76fed99640 1 -- 172.21.15.132:0/1901969224 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f80ce7e0 msgr2=0x7f76f80708f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.358+0000 7f76fed99640 1 --2- 172.21.15.132:0/1901969224 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f80ce7e0 0x7f76f80708f0 secure :-1 s=READY pgs=1731 cs=0 l=1 rev1=1 crypto rx=0x7f76f8073ad0 tx=0x7f76f002bed0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.358+0000 7f76fed99640 1 -- 172.21.15.132:0/1901969224 shutdown_connections 2023-12-20T04:52:52.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.358+0000 7f76fed99640 1 --2- 172.21.15.132:0/1901969224 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f80ce7e0 0x7f76f80708f0 unknown :-1 s=CLOSED pgs=1731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.358+0000 7f76fed99640 1 --2- 172.21.15.132:0/1901969224 >> v2:172.21.15.187:3300/0 conn(0x7f76f80cf1d0 0x7f76f815e200 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.358+0000 7f76fed99640 1 -- 172.21.15.132:0/1901969224 >> 172.21.15.132:0/1901969224 conn(0x7f76f80cc630 msgr2=0x7f76f80cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:52.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.358+0000 7f76fed99640 1 -- 172.21.15.132:0/1901969224 shutdown_connections 2023-12-20T04:52:52.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.358+0000 7f76fed99640 1 -- 172.21.15.132:0/1901969224 wait complete. 2023-12-20T04:52:52.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.359+0000 7f76fed99640 1 Processor -- start 2023-12-20T04:52:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.359+0000 7f76fed99640 1 -- start start 2023-12-20T04:52:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.360+0000 7f76fed99640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76f8070460 0x7f76f81596e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.360+0000 7f76fed99640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76f80ce7e0 0x7f76f815ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.360+0000 7f76fed99640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f80cf1d0 0x7f76f815b140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.360+0000 7f76fed99640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f80b2330 con 0x7f76f80cf1d0 2023-12-20T04:52:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.360+0000 7f76fed99640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76f8159c20 con 0x7f76f80ce7e0 2023-12-20T04:52:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.360+0000 7f76fed99640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76f806e1d0 con 0x7f76f8070460 2023-12-20T04:52:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.360+0000 7f76fd336640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f80cf1d0 0x7f76f815b140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.360+0000 7f76fd336640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f80cf1d0 0x7f76f815b140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52248/0 (socket says 172.21.15.132:52248) 2023-12-20T04:52:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.360+0000 7f76fd336640 1 -- 172.21.15.132:0/83196441 learned_addr learned my addr 172.21.15.132:0/83196441 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.361+0000 7f76fd336640 1 -- 172.21.15.132:0/83196441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76f8070460 msgr2=0x7f76f81596e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.361+0000 7f76fd336640 1 --2- 172.21.15.132:0/83196441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76f8070460 0x7f76f81596e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.361+0000 7f76fd336640 1 -- 172.21.15.132:0/83196441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76f80ce7e0 msgr2=0x7f76f815ac00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.361+0000 7f76fd336640 1 --2- 172.21.15.132:0/83196441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76f80ce7e0 0x7f76f815ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.361+0000 7f76fd336640 1 -- 172.21.15.132:0/83196441 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76f0009a70 con 0x7f76f80cf1d0 2023-12-20T04:52:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.361+0000 7f76fd336640 1 --2- 172.21.15.132:0/83196441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f80cf1d0 0x7f76f815b140 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009e80 tx=0x7f76f0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.361+0000 7f76f57fa640 1 -- 172.21.15.132:0/83196441 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0040650 con 0x7f76f80cf1d0 2023-12-20T04:52:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.361+0000 7f76f57fa640 1 -- 172.21.15.132:0/83196441 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76f00407b0 con 0x7f76f80cf1d0 2023-12-20T04:52:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.361+0000 7f76f57fa640 1 -- 172.21.15.132:0/83196441 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76f0040b60 con 0x7f76f80cf1d0 2023-12-20T04:52:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.361+0000 7f76fed99640 1 -- 172.21.15.132:0/83196441 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76f806dc10 con 0x7f76f80cf1d0 2023-12-20T04:52:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.361+0000 7f76fed99640 1 -- 172.21.15.132:0/83196441 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76f813e930 con 0x7f76f80cf1d0 2023-12-20T04:52:52.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.362+0000 7f76fed99640 1 -- 172.21.15.132:0/83196441 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76f813e790 con 0x7f76f80cf1d0 2023-12-20T04:52:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.362+0000 7f76f57fa640 1 -- 172.21.15.132:0/83196441 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f76f0040cc0 con 0x7f76f80cf1d0 2023-12-20T04:52:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.363+0000 7f76f57fa640 1 --2- 172.21.15.132:0/83196441 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f76e406a460 0x7f76e406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.363+0000 7f76f57fa640 1 -- 172.21.15.132:0/83196441 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f76f00ab650 con 0x7f76f80cf1d0 2023-12-20T04:52:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.363+0000 7f76fcb35640 1 --2- 172.21.15.132:0/83196441 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f76e406a460 0x7f76e406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.363+0000 7f76f57fa640 1 -- 172.21.15.132:0/83196441 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7f76e4071ff0 con 0x7f76f80cf1d0 2023-12-20T04:52:52.366 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.363+0000 7f76fcb35640 1 --2- 172.21.15.132:0/83196441 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f76e406a460 0x7f76e406c920 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f76e8006e80 tx=0x7f76e8008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:52.369 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.367+0000 7f76f57fa640 1 -- 172.21.15.132:0/83196441 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f76f813e790 con 0x7f76f80cf1d0 2023-12-20T04:52:52.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.535+0000 7f76fed99640 1 -- 172.21.15.132:0/83196441 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f76f813e790 con 0x7f76f80cf1d0 2023-12-20T04:52:52.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.535+0000 7f76f57fa640 1 -- 172.21.15.132:0/83196441 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v173) v1 ==== 100+0+11 (secure 0 0 0) 0x7f76f813e790 con 0x7f76f80cf1d0 2023-12-20T04:52:52.538 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:52:52.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.537+0000 7f76fed99640 1 -- 172.21.15.132:0/83196441 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f76e406a460 msgr2=0x7f76e406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.537+0000 7f76fed99640 1 --2- 172.21.15.132:0/83196441 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f76e406a460 0x7f76e406c920 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7f76e8006e80 tx=0x7f76e8008040 comp rx=0 tx=0).stop 2023-12-20T04:52:52.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.537+0000 7f76fed99640 1 -- 172.21.15.132:0/83196441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f80cf1d0 msgr2=0x7f76f815b140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.537+0000 7f76fed99640 1 --2- 172.21.15.132:0/83196441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f80cf1d0 0x7f76f815b140 secure :-1 s=READY pgs=1732 cs=0 l=1 rev1=1 crypto rx=0x7f76f0009e80 tx=0x7f76f0004a40 comp rx=0 tx=0).stop 2023-12-20T04:52:52.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.538+0000 7f76fed99640 1 -- 172.21.15.132:0/83196441 shutdown_connections 2023-12-20T04:52:52.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.538+0000 7f76fed99640 1 --2- 172.21.15.132:0/83196441 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f76e406a460 0x7f76e406c920 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.538+0000 7f76fed99640 1 --2- 172.21.15.132:0/83196441 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76f80cf1d0 0x7f76f815b140 unknown :-1 s=CLOSED pgs=1732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.538+0000 7f76fed99640 1 --2- 172.21.15.132:0/83196441 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76f80ce7e0 0x7f76f815ac00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.538+0000 7f76fed99640 1 --2- 172.21.15.132:0/83196441 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76f8070460 0x7f76f81596e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.538+0000 7f76fed99640 1 -- 172.21.15.132:0/83196441 >> 172.21.15.132:0/83196441 conn(0x7f76f80cc630 msgr2=0x7f76f80cd6f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:52.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.538+0000 7f76fed99640 1 -- 172.21.15.132:0/83196441 shutdown_connections 2023-12-20T04:52:52.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.538+0000 7f76fed99640 1 -- 172.21.15.132:0/83196441 wait complete. 2023-12-20T04:52:52.551 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:52:52.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.648+0000 7ff88da4d640 1 Processor -- start 2023-12-20T04:52:52.650 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.648+0000 7ff88da4d640 1 -- start start 2023-12-20T04:52:52.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.649+0000 7ff88da4d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff88815cf00 0x7ff888161440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.649+0000 7ff88da4d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff8880cfdd0 0x7ff8880d15c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.649+0000 7ff88da4d640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff8880b8e20 con 0x7ff8880b1a00 2023-12-20T04:52:52.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.649+0000 7ff88da4d640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff8880cdff0 con 0x7ff8880cfdd0 2023-12-20T04:52:52.651 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.649+0000 7ff88da4d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8880ce2d0 con 0x7ff88815cf00 2023-12-20T04:52:52.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.649+0000 7ff886ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff88815cf00 0x7ff888161440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.649+0000 7ff8877fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff8880cfdd0 0x7ff8880d15c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.649+0000 7ff87ffff640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7ff8880b1a00 0x7ff8880cf6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:47612/0 (socket says 172.21.15.132:47612) 2023-12-20T04:52:52.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.649+0000 7ff87ffff640 1 -- 172.21.15.132:0/3613004673 learned_addr learned my addr 172.21.15.132:0/3613004673 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:52:52.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.649+0000 7ff8877fe640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff8880cfdd0 0x7ff8880d15c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:35858/0 (socket says 172.21.15.132:35858) 2023-12-20T04:52:52.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.650+0000 7ff886ffd640 1 -- 172.21.15.132:0/3613004673 >> v2:172.21.15.187:3300/0 conn(0x7ff8880cfdd0 msgr2=0x7ff8880d15c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:52.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.650+0000 7ff886ffd640 1 --2- 172.21.15.132:0/3613004673 >> v2:172.21.15.187:3300/0 conn(0x7ff8880cfdd0 0x7ff8880d15c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.650+0000 7ff886ffd640 1 -- 172.21.15.132:0/3613004673 >> v1:172.21.15.187:6789/0 conn(0x7ff8880b1a00 legacy=0x7ff8880cf6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.650+0000 7ff8867fc640 1 -- 172.21.15.132:0/3613004673 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3560381596 0 0) 0x7ff8880b8e20 con 0x7ff8880b1a00 2023-12-20T04:52:52.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.650+0000 7ff886ffd640 1 -- 172.21.15.132:0/3613004673 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff8880ce5b0 con 0x7ff88815cf00 2023-12-20T04:52:52.652 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.650+0000 7ff8877fe640 1 --2- 172.21.15.132:0/3613004673 >> v2:172.21.15.187:3300/0 conn(0x7ff8880cfdd0 0x7ff8880d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:52:52.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.650+0000 7ff886ffd640 1 --2- 172.21.15.132:0/3613004673 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff88815cf00 0x7ff888161440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff8780097a0 tx=0x7ff87802b8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4104395c7493f1e1 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:52.653 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.651+0000 7ff8867fc640 1 -- 172.21.15.132:0/3613004673 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff878031830 con 0x7ff88815cf00 2023-12-20T04:52:52.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.651+0000 7ff8867fc640 1 -- 172.21.15.132:0/3613004673 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff878031990 con 0x7ff88815cf00 2023-12-20T04:52:52.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.651+0000 7ff8867fc640 1 -- 172.21.15.132:0/3613004673 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff878031d20 con 0x7ff88815cf00 2023-12-20T04:52:52.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.651+0000 7ff88da4d640 1 -- 172.21.15.132:0/3613004673 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff88815cf00 msgr2=0x7ff888161440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.651+0000 7ff88da4d640 1 --2- 172.21.15.132:0/3613004673 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff88815cf00 0x7ff888161440 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7ff8780097a0 tx=0x7ff87802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.651+0000 7ff88da4d640 1 -- 172.21.15.132:0/3613004673 shutdown_connections 2023-12-20T04:52:52.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.651+0000 7ff88da4d640 1 --2- 172.21.15.132:0/3613004673 >> v2:172.21.15.187:3300/0 conn(0x7ff8880cfdd0 0x7ff8880d15c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.651+0000 7ff88da4d640 1 --2- 172.21.15.132:0/3613004673 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff88815cf00 0x7ff888161440 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.651+0000 7ff88da4d640 1 -- 172.21.15.132:0/3613004673 >> 172.21.15.132:0/3613004673 conn(0x7ff88806a290 msgr2=0x7ff88806a6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:52.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.651+0000 7ff88da4d640 1 -- 172.21.15.132:0/3613004673 shutdown_connections 2023-12-20T04:52:52.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.651+0000 7ff88da4d640 1 -- 172.21.15.132:0/3613004673 wait complete. 2023-12-20T04:52:52.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.652+0000 7ff88da4d640 1 Processor -- start 2023-12-20T04:52:52.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.652+0000 7ff88da4d640 1 -- start start 2023-12-20T04:52:52.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.653+0000 7ff88da4d640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8880b1a00 0x7ff888157fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.653+0000 7ff88da4d640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8880cfdd0 0x7ff888159c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.653+0000 7ff88da4d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff88815cf00 0x7ff88815a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.653+0000 7ff88da4d640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8881f5c50 con 0x7ff88815cf00 2023-12-20T04:52:52.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.653+0000 7ff88da4d640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8881f5f30 con 0x7ff8880b1a00 2023-12-20T04:52:52.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.653+0000 7ff88da4d640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff8881f6210 con 0x7ff8880cfdd0 2023-12-20T04:52:52.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.653+0000 7ff8877fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff88815cf00 0x7ff88815a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.653+0000 7ff8877fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff88815cf00 0x7ff88815a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52260/0 (socket says 172.21.15.132:52260) 2023-12-20T04:52:52.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.653+0000 7ff8877fe640 1 -- 172.21.15.132:0/1648214545 learned_addr learned my addr 172.21.15.132:0/1648214545 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:52.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.653+0000 7ff886ffd640 1 --2- 172.21.15.132:0/1648214545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8880b1a00 0x7ff888157fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.653+0000 7ff87ffff640 1 --2- 172.21.15.132:0/1648214545 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8880cfdd0 0x7ff888159c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.653+0000 7ff8877fe640 1 -- 172.21.15.132:0/1648214545 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8880cfdd0 msgr2=0x7ff888159c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.654+0000 7ff8877fe640 1 --2- 172.21.15.132:0/1648214545 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8880cfdd0 0x7ff888159c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.654+0000 7ff8877fe640 1 -- 172.21.15.132:0/1648214545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8880b1a00 msgr2=0x7ff888157fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.654+0000 7ff8877fe640 1 --2- 172.21.15.132:0/1648214545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8880b1a00 0x7ff888157fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.654+0000 7ff8877fe640 1 -- 172.21.15.132:0/1648214545 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff880009a70 con 0x7ff88815cf00 2023-12-20T04:52:52.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.654+0000 7ff8877fe640 1 --2- 172.21.15.132:0/1648214545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff88815cf00 0x7ff88815a160 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7ff88000efc0 tx=0x7ff880009f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:52.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.654+0000 7ff884ff9640 1 -- 172.21.15.132:0/1648214545 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880009d70 con 0x7ff88815cf00 2023-12-20T04:52:52.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.654+0000 7ff88da4d640 1 -- 172.21.15.132:0/1648214545 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff878009400 con 0x7ff88815cf00 2023-12-20T04:52:52.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.654+0000 7ff884ff9640 1 -- 172.21.15.132:0/1648214545 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff88000f040 con 0x7ff88815cf00 2023-12-20T04:52:52.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.654+0000 7ff884ff9640 1 -- 172.21.15.132:0/1648214545 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff880003990 con 0x7ff88815cf00 2023-12-20T04:52:52.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.654+0000 7ff88da4d640 1 -- 172.21.15.132:0/1648214545 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff888158510 con 0x7ff88815cf00 2023-12-20T04:52:52.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.655+0000 7ff88da4d640 1 -- 172.21.15.132:0/1648214545 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff8881f6730 con 0x7ff88815cf00 2023-12-20T04:52:52.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.655+0000 7ff884ff9640 1 -- 172.21.15.132:0/1648214545 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff8800144a0 con 0x7ff88815cf00 2023-12-20T04:52:52.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.656+0000 7ff884ff9640 1 --2- 172.21.15.132:0/1648214545 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff86806a430 0x7ff86806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.656+0000 7ff886ffd640 1 --2- 172.21.15.132:0/1648214545 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff86806a430 0x7ff86806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.656+0000 7ff884ff9640 1 -- 172.21.15.132:0/1648214545 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7ff8800896f0 con 0x7ff88815cf00 2023-12-20T04:52:52.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.656+0000 7ff884ff9640 1 -- 172.21.15.132:0/1648214545 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7ff868071fc0 con 0x7ff88815cf00 2023-12-20T04:52:52.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.656+0000 7ff886ffd640 1 --2- 172.21.15.132:0/1648214545 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff86806a430 0x7ff86806c8f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff878036000 tx=0x7ff878008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:52.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.660+0000 7ff884ff9640 1 -- 172.21.15.132:0/1648214545 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff8881f6730 con 0x7ff88815cf00 2023-12-20T04:52:52.861 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.859+0000 7ff88da4d640 1 -- 172.21.15.132:0/1648214545 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff8881f6730 con 0x7ff88815cf00 2023-12-20T04:52:52.862 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.860+0000 7ff884ff9640 1 -- 172.21.15.132:0/1648214545 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4725 (secure 0 0 0) 0x7ff8881f6730 con 0x7ff88815cf00 2023-12-20T04:52:52.862 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:52:52.862 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":63,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6644,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1464403338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1464403338},{"type":"v1","addr":"172.21.15.187:6834","nonce":1464403338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2717050899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2717050899},{"type":"v1","addr":"172.21.15.187:6835","nonce":2717050899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8709,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2430423967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2430423967},{"type":"v1","addr":"172.21.15.132:6836","nonce":2430423967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:51:46.508144+0000","modified":"2023-12-20T04:51:48.515251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8712":{"gid":8712,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1841932991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1841932991},{"type":"v1","addr":"172.21.15.132:6837","nonce":1841932991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-20T04:52:52.862 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 63 2023-12-20T04:52:52.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.861+0000 7ff88da4d640 1 -- 172.21.15.132:0/1648214545 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff86806a430 msgr2=0x7ff86806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.861+0000 7ff88da4d640 1 --2- 172.21.15.132:0/1648214545 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff86806a430 0x7ff86806c8f0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x7ff878036000 tx=0x7ff878008030 comp rx=0 tx=0).stop 2023-12-20T04:52:52.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.861+0000 7ff88da4d640 1 -- 172.21.15.132:0/1648214545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff88815cf00 msgr2=0x7ff88815a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.861+0000 7ff88da4d640 1 --2- 172.21.15.132:0/1648214545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff88815cf00 0x7ff88815a160 secure :-1 s=READY pgs=1733 cs=0 l=1 rev1=1 crypto rx=0x7ff88000efc0 tx=0x7ff880009f90 comp rx=0 tx=0).stop 2023-12-20T04:52:52.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.862+0000 7ff88da4d640 1 -- 172.21.15.132:0/1648214545 shutdown_connections 2023-12-20T04:52:52.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.862+0000 7ff88da4d640 1 --2- 172.21.15.132:0/1648214545 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff86806a430 0x7ff86806c8f0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.862+0000 7ff88da4d640 1 --2- 172.21.15.132:0/1648214545 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff88815cf00 0x7ff88815a160 unknown :-1 s=CLOSED pgs=1733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.862+0000 7ff88da4d640 1 --2- 172.21.15.132:0/1648214545 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff8880cfdd0 0x7ff888159c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.862+0000 7ff88da4d640 1 --2- 172.21.15.132:0/1648214545 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff8880b1a00 0x7ff888157fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.864 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.862+0000 7ff88da4d640 1 -- 172.21.15.132:0/1648214545 >> 172.21.15.132:0/1648214545 conn(0x7ff88806a290 msgr2=0x7ff88806a670 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:52.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.862+0000 7ff88da4d640 1 -- 172.21.15.132:0/1648214545 shutdown_connections 2023-12-20T04:52:52.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.862+0000 7ff88da4d640 1 -- 172.21.15.132:0/1648214545 wait complete. 2023-12-20T04:52:52.875 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:52:52.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.974+0000 7fe5a1c36640 1 Processor -- start 2023-12-20T04:52:52.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.974+0000 7fe5a1c36640 1 -- start start 2023-12-20T04:52:52.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.975+0000 7fe5a1c36640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe59c15e530 0x7fe59c06fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.975+0000 7fe5a1c36640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c0ccf30 con 0x7fe59c159b50 2023-12-20T04:52:52.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.975+0000 7fe5a1c36640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe59c0ca1c0 con 0x7fe59c06c240 2023-12-20T04:52:52.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.975+0000 7fe5a1c36640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe59c0caa60 con 0x7fe59c15e530 2023-12-20T04:52:52.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.975+0000 7fe59b7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe59c159b50 0x7fe59c0c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40646/0 (socket says 172.21.15.132:40646) 2023-12-20T04:52:52.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.975+0000 7fe59b7fe640 1 -- 172.21.15.132:0/717529048 learned_addr learned my addr 172.21.15.132:0/717529048 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:52:52.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.975+0000 7fe59a7fc640 1 -- 172.21.15.132:0/717529048 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 416942608 0 0) 0x7fe59c0ccf30 con 0x7fe59c159b50 2023-12-20T04:52:52.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.975+0000 7fe59a7fc640 1 -- 172.21.15.132:0/717529048 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe584003520 con 0x7fe59c159b50 2023-12-20T04:52:52.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.975+0000 7fe59affd640 1 --2- 172.21.15.132:0/717529048 >> v2:172.21.15.187:3300/0 conn(0x7fe59c15e530 0x7fe59c06fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.975+0000 7fe59a7fc640 1 -- 172.21.15.132:0/717529048 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3504139338 0 0) 0x7fe584003520 con 0x7fe59c159b50 2023-12-20T04:52:52.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.975+0000 7fe59a7fc640 1 -- 172.21.15.132:0/717529048 >> v2:172.21.15.187:3300/0 conn(0x7fe59c15e530 msgr2=0x7fe59c06fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:52.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.975+0000 7fe59a7fc640 1 --2- 172.21.15.132:0/717529048 >> v2:172.21.15.187:3300/0 conn(0x7fe59c15e530 0x7fe59c06fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.975+0000 7fe59a7fc640 1 -- 172.21.15.132:0/717529048 >> v1:172.21.15.187:6789/0 conn(0x7fe59c06c240 legacy=0x7fe59c0cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.975+0000 7fe59a7fc640 1 -- 172.21.15.132:0/717529048 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c0ca4a0 con 0x7fe59c159b50 2023-12-20T04:52:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59a7fc640 1 -- 172.21.15.132:0/717529048 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fe58c001670 con 0x7fe59c159b50 2023-12-20T04:52:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59a7fc640 1 -- 172.21.15.132:0/717529048 >> v1:172.21.15.132:6789/0 conn(0x7fe59c159b50 legacy=0x7fe59c0c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59a7fc640 1 --2- 172.21.15.132:0/717529048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe584003970 0x7fe584003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59a7fc640 1 --2- 172.21.15.132:0/717529048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5840047c0 0x7fe584004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59a7fc640 1 --2- 172.21.15.132:0/717529048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe584005180 0x7fe58400ff90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59a7fc640 1 -- 172.21.15.132:0/717529048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c0caa60 con 0x7fe5840047c0 2023-12-20T04:52:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59a7fc640 1 -- 172.21.15.132:0/717529048 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5840104d0 con 0x7fe584005180 2023-12-20T04:52:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59a7fc640 1 -- 172.21.15.132:0/717529048 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe584010610 con 0x7fe584003970 2023-12-20T04:52:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59affd640 1 --2- 172.21.15.132:0/717529048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5840047c0 0x7fe584004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59b7fe640 1 --2- 172.21.15.132:0/717529048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe584003970 0x7fe584003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59bfff640 1 --2- 172.21.15.132:0/717529048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe584005180 0x7fe58400ff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59affd640 1 -- 172.21.15.132:0/717529048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe584003970 msgr2=0x7fe584003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59affd640 1 --2- 172.21.15.132:0/717529048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe584003970 0x7fe584003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.980 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59affd640 1 -- 172.21.15.132:0/717529048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe584005180 msgr2=0x7fe58400ff90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:52.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59affd640 1 --2- 172.21.15.132:0/717529048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe584005180 0x7fe58400ff90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59affd640 1 -- 172.21.15.132:0/717529048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe584003520 con 0x7fe5840047c0 2023-12-20T04:52:52.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59bfff640 1 --2- 172.21.15.132:0/717529048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe584005180 0x7fe58400ff90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:52:52.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.976+0000 7fe59bfff640 1 -- 172.21.15.132:0/717529048 reap_dead start 2023-12-20T04:52:52.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.977+0000 7fe59affd640 1 --2- 172.21.15.132:0/717529048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5840047c0 0x7fe584004c40 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fe590009ac0 tx=0x7fe5840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87270ebc0dd6cc85 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:52.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.977+0000 7fe59a7fc640 1 -- 172.21.15.132:0/717529048 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59002c6b0 con 0x7fe5840047c0 2023-12-20T04:52:52.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.977+0000 7fe59a7fc640 1 -- 172.21.15.132:0/717529048 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe59002c810 con 0x7fe5840047c0 2023-12-20T04:52:52.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.977+0000 7fe59a7fc640 1 -- 172.21.15.132:0/717529048 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe59002cba0 con 0x7fe5840047c0 2023-12-20T04:52:52.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.977+0000 7fe5a1c36640 1 -- 172.21.15.132:0/717529048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5840047c0 msgr2=0x7fe584004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.977+0000 7fe5a1c36640 1 --2- 172.21.15.132:0/717529048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5840047c0 0x7fe584004c40 secure :-1 s=READY pgs=1735 cs=0 l=1 rev1=1 crypto rx=0x7fe590009ac0 tx=0x7fe5840057f0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.977+0000 7fe5a1c36640 1 -- 172.21.15.132:0/717529048 shutdown_connections 2023-12-20T04:52:52.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.977+0000 7fe5a1c36640 1 --2- 172.21.15.132:0/717529048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe5840047c0 0x7fe584004c40 unknown :-1 s=CLOSED pgs=1735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.977+0000 7fe5a1c36640 1 -- 172.21.15.132:0/717529048 >> 172.21.15.132:0/717529048 conn(0x7fe59c0ced10 msgr2=0x7fe59c0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:52.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.977+0000 7fe5a1c36640 1 -- 172.21.15.132:0/717529048 shutdown_connections 2023-12-20T04:52:52.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.977+0000 7fe5a1c36640 1 -- 172.21.15.132:0/717529048 wait complete. 2023-12-20T04:52:52.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.979+0000 7fe5a1c36640 1 Processor -- start 2023-12-20T04:52:52.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.979+0000 7fe5a1c36640 1 -- start start 2023-12-20T04:52:52.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.979+0000 7fe5a1c36640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5840047c0 0x7fe59c15aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.979+0000 7fe5a1c36640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe59c14fd60 0x7fe59c14f700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.979+0000 7fe5a1c36640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe59c15c010 0x7fe59c154240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.979+0000 7fe5a1c36640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c15aa10 con 0x7fe59c15c010 2023-12-20T04:52:52.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.979+0000 7fe5a1c36640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c15c860 con 0x7fe59c14fd60 2023-12-20T04:52:52.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.979+0000 7fe5a1c36640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe59c15a3c0 con 0x7fe5840047c0 2023-12-20T04:52:52.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.979+0000 7fe59bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe59c15c010 0x7fe59c154240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.979+0000 7fe59bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe59c15c010 0x7fe59c154240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52288/0 (socket says 172.21.15.132:52288) 2023-12-20T04:52:52.985 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.980+0000 7fe59bfff640 1 -- 172.21.15.132:0/1007900708 learned_addr learned my addr 172.21.15.132:0/1007900708 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:52.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.980+0000 7fe59affd640 1 --2- 172.21.15.132:0/1007900708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe59c14fd60 0x7fe59c14f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.980+0000 7fe59b7fe640 1 --2- 172.21.15.132:0/1007900708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5840047c0 0x7fe59c15aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.980+0000 7fe59bfff640 1 -- 172.21.15.132:0/1007900708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5840047c0 msgr2=0x7fe59c15aea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.980+0000 7fe59bfff640 1 --2- 172.21.15.132:0/1007900708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5840047c0 0x7fe59c15aea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.980+0000 7fe59bfff640 1 -- 172.21.15.132:0/1007900708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe59c14fd60 msgr2=0x7fe59c14f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:52.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.980+0000 7fe59bfff640 1 --2- 172.21.15.132:0/1007900708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe59c14fd60 0x7fe59c14f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:52.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.980+0000 7fe59bfff640 1 -- 172.21.15.132:0/1007900708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe59c15a6a0 con 0x7fe59c15c010 2023-12-20T04:52:52.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.980+0000 7fe59bfff640 1 --2- 172.21.15.132:0/1007900708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe59c15c010 0x7fe59c154240 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fe59c06fb00 tx=0x7fe59400e960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:52.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.980+0000 7fe583fff640 1 -- 172.21.15.132:0/1007900708 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe594003b80 con 0x7fe59c15c010 2023-12-20T04:52:52.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.980+0000 7fe583fff640 1 -- 172.21.15.132:0/1007900708 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe594003ce0 con 0x7fe59c15c010 2023-12-20T04:52:52.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.980+0000 7fe5a1c36640 1 -- 172.21.15.132:0/1007900708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe59c15cb40 con 0x7fe59c15c010 2023-12-20T04:52:52.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.980+0000 7fe583fff640 1 -- 172.21.15.132:0/1007900708 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe594005310 con 0x7fe59c15c010 2023-12-20T04:52:52.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.980+0000 7fe5a1c36640 1 -- 172.21.15.132:0/1007900708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe59c154780 con 0x7fe59c15c010 2023-12-20T04:52:52.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.981+0000 7fe5a1c36640 1 -- 172.21.15.132:0/1007900708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe59c15a830 con 0x7fe59c15c010 2023-12-20T04:52:52.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.981+0000 7fe583fff640 1 -- 172.21.15.132:0/1007900708 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe594005470 con 0x7fe59c15c010 2023-12-20T04:52:52.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.982+0000 7fe583fff640 1 --2- 172.21.15.132:0/1007900708 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe58806a460 0x7fe58806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:52.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.982+0000 7fe583fff640 1 -- 172.21.15.132:0/1007900708 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe594088130 con 0x7fe59c15c010 2023-12-20T04:52:52.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.982+0000 7fe59b7fe640 1 --2- 172.21.15.132:0/1007900708 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe58806a460 0x7fe58806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:52.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.982+0000 7fe583fff640 1 -- 172.21.15.132:0/1007900708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7fe588071fe0 con 0x7fe59c15c010 2023-12-20T04:52:52.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.982+0000 7fe59b7fe640 1 --2- 172.21.15.132:0/1007900708 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe58806a460 0x7fe58806c920 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe58c001c90 tx=0x7fe58c001470 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:52.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:52.986+0000 7fe583fff640 1 -- 172.21.15.132:0/1007900708 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe594019060 con 0x7fe59c15c010 2023-12-20T04:52:53.155 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.153+0000 7fe5a1c36640 1 -- 172.21.15.132:0/1007900708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fe59c04e840 con 0x7fe59c15c010 2023-12-20T04:52:53.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.154+0000 7fe583fff640 1 -- 172.21.15.132:0/1007900708 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+16236 (secure 0 0 0) 0x7fe594053790 con 0x7fe59c15c010 2023-12-20T04:52:53.156 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:52:53.157 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":173,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:52:39.899511+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:51:44.739391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-20T04:51:45.486167+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.14","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:52:53.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.156+0000 7fe5a1c36640 1 -- 172.21.15.132:0/1007900708 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe58806a460 msgr2=0x7fe58806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.156+0000 7fe5a1c36640 1 --2- 172.21.15.132:0/1007900708 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe58806a460 0x7fe58806c920 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fe58c001c90 tx=0x7fe58c001470 comp rx=0 tx=0).stop 2023-12-20T04:52:53.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.156+0000 7fe5a1c36640 1 -- 172.21.15.132:0/1007900708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe59c15c010 msgr2=0x7fe59c154240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.156+0000 7fe5a1c36640 1 --2- 172.21.15.132:0/1007900708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe59c15c010 0x7fe59c154240 secure :-1 s=READY pgs=1736 cs=0 l=1 rev1=1 crypto rx=0x7fe59c06fb00 tx=0x7fe59400e960 comp rx=0 tx=0).stop 2023-12-20T04:52:53.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.156+0000 7fe5a1c36640 1 -- 172.21.15.132:0/1007900708 shutdown_connections 2023-12-20T04:52:53.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.156+0000 7fe5a1c36640 1 --2- 172.21.15.132:0/1007900708 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe58806a460 0x7fe58806c920 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.156+0000 7fe5a1c36640 1 --2- 172.21.15.132:0/1007900708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe59c15c010 0x7fe59c154240 unknown :-1 s=CLOSED pgs=1736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.156+0000 7fe5a1c36640 1 --2- 172.21.15.132:0/1007900708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe59c14fd60 0x7fe59c14f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.156+0000 7fe5a1c36640 1 --2- 172.21.15.132:0/1007900708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe5840047c0 0x7fe59c15aea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.156+0000 7fe5a1c36640 1 -- 172.21.15.132:0/1007900708 >> 172.21.15.132:0/1007900708 conn(0x7fe59c0ced10 msgr2=0x7fe59c0c24b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:53.159 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.156+0000 7fe5a1c36640 1 -- 172.21.15.132:0/1007900708 shutdown_connections 2023-12-20T04:52:53.160 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.156+0000 7fe5a1c36640 1 -- 172.21.15.132:0/1007900708 wait complete. 2023-12-20T04:52:53.170 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-20T04:52:53.170 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:52:53.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.267+0000 7f4ae8fab640 1 Processor -- start 2023-12-20T04:52:53.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.268+0000 7f4ae8fab640 1 -- start start 2023-12-20T04:52:53.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.268+0000 7f4ae8fab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ae40b4980 0x7f4ae40b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.268+0000 7f4ae8fab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae40b5320 con 0x7f4ae40d1aa0 2023-12-20T04:52:53.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.268+0000 7f4ae8fab640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4ae40b5ec0 con 0x7f4ae4160450 2023-12-20T04:52:53.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.268+0000 7f4ae8fab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae41617e0 con 0x7f4ae40b4980 2023-12-20T04:52:53.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae2d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4ae40d1aa0 0x7f4ae40d1f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40662/0 (socket says 172.21.15.132:40662) 2023-12-20T04:52:53.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae2d9d640 1 -- 172.21.15.132:0/2792940529 learned_addr learned my addr 172.21.15.132:0/2792940529 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:52:53.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4adbfff640 1 --2- 172.21.15.132:0/2792940529 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ae40b4980 0x7f4ae40b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae1d9b640 1 -- 172.21.15.132:0/2792940529 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2463564050 0 0) 0x7f4ae40b5320 con 0x7f4ae40d1aa0 2023-12-20T04:52:53.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae1d9b640 1 -- 172.21.15.132:0/2792940529 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ad0003520 con 0x7f4ae40d1aa0 2023-12-20T04:52:53.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae1d9b640 1 -- 172.21.15.132:0/2792940529 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1737585473 0 0) 0x7f4ae40b5ec0 con 0x7f4ae4160450 2023-12-20T04:52:53.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae1d9b640 1 -- 172.21.15.132:0/2792940529 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4ae40b5320 con 0x7f4ae4160450 2023-12-20T04:52:53.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae1d9b640 1 -- 172.21.15.132:0/2792940529 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4153858818 0 0) 0x7f4ad0003520 con 0x7f4ae40d1aa0 2023-12-20T04:52:53.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae1d9b640 1 -- 172.21.15.132:0/2792940529 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ae40b4980 msgr2=0x7f4ae40b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:53.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae1d9b640 1 --2- 172.21.15.132:0/2792940529 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ae40b4980 0x7f4ae40b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae1d9b640 1 -- 172.21.15.132:0/2792940529 >> v1:172.21.15.187:6789/0 conn(0x7f4ae4160450 legacy=0x7f4ae4160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae1d9b640 1 -- 172.21.15.132:0/2792940529 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae40d0fc0 con 0x7f4ae40d1aa0 2023-12-20T04:52:53.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae1d9b640 1 -- 172.21.15.132:0/2792940529 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f4adc0019f0 con 0x7f4ae40d1aa0 2023-12-20T04:52:53.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae1d9b640 1 -- 172.21.15.132:0/2792940529 >> v1:172.21.15.132:6789/0 conn(0x7f4ae40d1aa0 legacy=0x7f4ae40d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae1d9b640 1 --2- 172.21.15.132:0/2792940529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ad0003b30 0x7f4ad0003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae1d9b640 1 --2- 172.21.15.132:0/2792940529 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ae40b4980 0x7f4ad00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae1d9b640 1 --2- 172.21.15.132:0/2792940529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ad0004d00 0x7f4ad0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae1d9b640 1 -- 172.21.15.132:0/2792940529 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae41617e0 con 0x7f4ad0003b30 2023-12-20T04:52:53.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae1d9b640 1 -- 172.21.15.132:0/2792940529 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad000ba30 con 0x7f4ad0004d00 2023-12-20T04:52:53.274 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae1d9b640 1 -- 172.21.15.132:0/2792940529 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad000bba0 con 0x7f4ae40b4980 2023-12-20T04:52:53.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae259c640 1 --2- 172.21.15.132:0/2792940529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ad0003b30 0x7f4ad0003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae2d9d640 1 --2- 172.21.15.132:0/2792940529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ad0004d00 0x7f4ad0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4adbfff640 1 --2- 172.21.15.132:0/2792940529 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ae40b4980 0x7f4ad00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae259c640 1 -- 172.21.15.132:0/2792940529 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ae40b4980 msgr2=0x7f4ad00047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:53.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae259c640 1 --2- 172.21.15.132:0/2792940529 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ae40b4980 0x7f4ad00047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae259c640 1 -- 172.21.15.132:0/2792940529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ad0004d00 msgr2=0x7f4ad0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:53.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae259c640 1 --2- 172.21.15.132:0/2792940529 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ad0004d00 0x7f4ad0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.269+0000 7f4ae259c640 1 -- 172.21.15.132:0/2792940529 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ad0003520 con 0x7f4ad0003b30 2023-12-20T04:52:53.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.270+0000 7f4ae259c640 1 --2- 172.21.15.132:0/2792940529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ad0003b30 0x7f4ad0003f30 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40018d0 tx=0x7f4ad00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c13a7dd2c964393 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:53.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.270+0000 7f4ae1d9b640 1 -- 172.21.15.132:0/2792940529 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad40052d0 con 0x7f4ad0003b30 2023-12-20T04:52:53.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.270+0000 7f4ae1d9b640 1 -- 172.21.15.132:0/2792940529 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4ad4005430 con 0x7f4ad0003b30 2023-12-20T04:52:53.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.270+0000 7f4ae1d9b640 1 -- 172.21.15.132:0/2792940529 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4ad4003810 con 0x7f4ad0003b30 2023-12-20T04:52:53.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.271+0000 7f4ae8fab640 1 -- 172.21.15.132:0/2792940529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ad0003b30 msgr2=0x7f4ad0003f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.271+0000 7f4ae8fab640 1 --2- 172.21.15.132:0/2792940529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ad0003b30 0x7f4ad0003f30 secure :-1 s=READY pgs=1738 cs=0 l=1 rev1=1 crypto rx=0x7f4ad40018d0 tx=0x7f4ad00057f0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.271+0000 7f4ae2d9d640 1 -- 172.21.15.132:0/2792940529 reap_dead start 2023-12-20T04:52:53.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.271+0000 7f4ae8fab640 1 -- 172.21.15.132:0/2792940529 shutdown_connections 2023-12-20T04:52:53.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.271+0000 7f4ae8fab640 1 -- 172.21.15.132:0/2792940529 >> 172.21.15.132:0/2792940529 conn(0x7f4ae40cf980 msgr2=0x7f4ae40cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:53.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.271+0000 7f4ae8fab640 1 -- 172.21.15.132:0/2792940529 shutdown_connections 2023-12-20T04:52:53.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.271+0000 7f4ae8fab640 1 -- 172.21.15.132:0/2792940529 wait complete. 2023-12-20T04:52:53.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.272+0000 7f4ae8fab640 1 Processor -- start 2023-12-20T04:52:53.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.272+0000 7f4ae8fab640 1 -- start start 2023-12-20T04:52:53.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4ae8fab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad0003b30 0x7f4ae40ccaa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4ae8fab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ae4155eb0 0x7f4ae4153340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4ae8fab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ae4155160 0x7f4ae41555e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4ae8fab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae41f3860 con 0x7f4ae4155eb0 2023-12-20T04:52:53.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4ae8fab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae40ccfe0 con 0x7f4ae4155160 2023-12-20T04:52:53.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4ae8fab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4ae41f2ce0 con 0x7f4ad0003b30 2023-12-20T04:52:53.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4adbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ae4155eb0 0x7f4ae4153340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4adbfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ae4155eb0 0x7f4ae4153340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52308/0 (socket says 172.21.15.132:52308) 2023-12-20T04:52:53.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4adbfff640 1 -- 172.21.15.132:0/2214856413 learned_addr learned my addr 172.21.15.132:0/2214856413 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:53.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4ae2d9d640 1 --2- 172.21.15.132:0/2214856413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ae4155160 0x7f4ae41555e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4ae259c640 1 --2- 172.21.15.132:0/2214856413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad0003b30 0x7f4ae40ccaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4adbfff640 1 -- 172.21.15.132:0/2214856413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad0003b30 msgr2=0x7f4ae40ccaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4adbfff640 1 --2- 172.21.15.132:0/2214856413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad0003b30 0x7f4ae40ccaa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4adbfff640 1 -- 172.21.15.132:0/2214856413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ae4155160 msgr2=0x7f4ae41555e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4adbfff640 1 --2- 172.21.15.132:0/2214856413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ae4155160 0x7f4ae41555e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4adbfff640 1 -- 172.21.15.132:0/2214856413 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ae41f2fc0 con 0x7f4ae4155eb0 2023-12-20T04:52:53.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4ae259c640 1 --2- 172.21.15.132:0/2214856413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad0003b30 0x7f4ae40ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:52:53.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.273+0000 7f4adbfff640 1 --2- 172.21.15.132:0/2214856413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ae4155eb0 0x7f4ae4153340 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0119a0 tx=0x7f4acc011e60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:53.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.274+0000 7f4adaffd640 1 -- 172.21.15.132:0/2214856413 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc00faf0 con 0x7f4ae4155eb0 2023-12-20T04:52:53.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.274+0000 7f4adaffd640 1 -- 172.21.15.132:0/2214856413 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4acc00fc50 con 0x7f4ae4155eb0 2023-12-20T04:52:53.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.274+0000 7f4ae8fab640 1 -- 172.21.15.132:0/2214856413 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ae41f32a0 con 0x7f4ae4155eb0 2023-12-20T04:52:53.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.274+0000 7f4adaffd640 1 -- 172.21.15.132:0/2214856413 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4acc014440 con 0x7f4ae4155eb0 2023-12-20T04:52:53.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.274+0000 7f4ae8fab640 1 -- 172.21.15.132:0/2214856413 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ae41579e0 con 0x7f4ae4155eb0 2023-12-20T04:52:53.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.275+0000 7f4ae8fab640 1 -- 172.21.15.132:0/2214856413 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ae404e840 con 0x7f4ae4155eb0 2023-12-20T04:52:53.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.275+0000 7f4adaffd640 1 -- 172.21.15.132:0/2214856413 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4acc01d400 con 0x7f4ae4155eb0 2023-12-20T04:52:53.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.275+0000 7f4adaffd640 1 --2- 172.21.15.132:0/2214856413 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4ac406a430 0x7f4ac406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.275+0000 7f4adaffd640 1 -- 172.21.15.132:0/2214856413 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f4acc0891d0 con 0x7f4ae4155eb0 2023-12-20T04:52:53.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.275+0000 7f4ae259c640 1 --2- 172.21.15.132:0/2214856413 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4ac406a430 0x7f4ac406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.276+0000 7f4adaffd640 1 -- 172.21.15.132:0/2214856413 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7f4ac4071fc0 con 0x7f4ae4155eb0 2023-12-20T04:52:53.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.276+0000 7f4ae259c640 1 --2- 172.21.15.132:0/2214856413 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4ac406a430 0x7f4ac406c8f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4034000 tx=0x7f4ad4031000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:53.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.280+0000 7f4adaffd640 1 -- 172.21.15.132:0/2214856413 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4acc0547a0 con 0x7f4ae4155eb0 2023-12-20T04:52:53.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.481+0000 7f4ae8fab640 1 -- 172.21.15.132:0/2214856413 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f4ae4154d80 con 0x7f4ae4155eb0 2023-12-20T04:52:53.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.481+0000 7f4adaffd640 1 -- 172.21.15.132:0/2214856413 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4725 (secure 0 0 0) 0x7f4acc057dc0 con 0x7f4ae4155eb0 2023-12-20T04:52:53.483 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:52:53.483 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":63,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6644,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1464403338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1464403338},{"type":"v1","addr":"172.21.15.187:6834","nonce":1464403338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2717050899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2717050899},{"type":"v1","addr":"172.21.15.187:6835","nonce":2717050899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8709,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2430423967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2430423967},{"type":"v1","addr":"172.21.15.132:6836","nonce":2430423967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:51:46.508144+0000","modified":"2023-12-20T04:51:48.515251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8712":{"gid":8712,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1841932991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1841932991},{"type":"v1","addr":"172.21.15.132:6837","nonce":1841932991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-20T04:52:53.483 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 63 2023-12-20T04:52:53.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.483+0000 7f4ae8fab640 1 -- 172.21.15.132:0/2214856413 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4ac406a430 msgr2=0x7f4ac406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.483+0000 7f4ae8fab640 1 --2- 172.21.15.132:0/2214856413 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4ac406a430 0x7f4ac406c8f0 secure :-1 s=READY pgs=731 cs=0 l=1 rev1=1 crypto rx=0x7f4ad4034000 tx=0x7f4ad4031000 comp rx=0 tx=0).stop 2023-12-20T04:52:53.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.483+0000 7f4ae8fab640 1 -- 172.21.15.132:0/2214856413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ae4155eb0 msgr2=0x7f4ae4153340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.483+0000 7f4ae8fab640 1 --2- 172.21.15.132:0/2214856413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ae4155eb0 0x7f4ae4153340 secure :-1 s=READY pgs=1739 cs=0 l=1 rev1=1 crypto rx=0x7f4acc0119a0 tx=0x7f4acc011e60 comp rx=0 tx=0).stop 2023-12-20T04:52:53.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.483+0000 7f4ae8fab640 1 -- 172.21.15.132:0/2214856413 shutdown_connections 2023-12-20T04:52:53.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.483+0000 7f4ae8fab640 1 --2- 172.21.15.132:0/2214856413 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4ac406a430 0x7f4ac406c8f0 unknown :-1 s=CLOSED pgs=731 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.483+0000 7f4ae8fab640 1 --2- 172.21.15.132:0/2214856413 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4ae4155160 0x7f4ae41555e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.483+0000 7f4ae8fab640 1 --2- 172.21.15.132:0/2214856413 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4ae4155eb0 0x7f4ae4153340 unknown :-1 s=CLOSED pgs=1739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.483+0000 7f4ae8fab640 1 --2- 172.21.15.132:0/2214856413 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4ad0003b30 0x7f4ae40ccaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.483+0000 7f4ae8fab640 1 -- 172.21.15.132:0/2214856413 >> 172.21.15.132:0/2214856413 conn(0x7f4ae40cf980 msgr2=0x7f4ae40cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:53.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.483+0000 7f4ae8fab640 1 -- 172.21.15.132:0/2214856413 shutdown_connections 2023-12-20T04:52:53.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.483+0000 7f4ae8fab640 1 -- 172.21.15.132:0/2214856413 wait complete. 2023-12-20T04:52:53.497 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:52:53.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.595+0000 7fd45a7cb640 1 Processor -- start 2023-12-20T04:52:53.597 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.595+0000 7fd45a7cb640 1 -- start start 2023-12-20T04:52:53.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.595+0000 7fd45a7cb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd4540b4980 0x7fd4540b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.595+0000 7fd45a7cb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4540b5320 con 0x7fd4540d1aa0 2023-12-20T04:52:53.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.595+0000 7fd45a7cb640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd4540b5ec0 con 0x7fd454160450 2023-12-20T04:52:53.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.595+0000 7fd45a7cb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd4541617e0 con 0x7fd4540b4980 2023-12-20T04:52:53.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd458d68640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd4540d1aa0 0x7fd4540d1ee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40676/0 (socket says 172.21.15.132:40676) 2023-12-20T04:52:53.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd458d68640 1 -- 172.21.15.132:0/4054072853 learned_addr learned my addr 172.21.15.132:0/4054072853 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:52:53.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd4537fe640 1 --2- 172.21.15.132:0/4054072853 >> v2:172.21.15.187:3300/0 conn(0x7fd4540b4980 0x7fd4540b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd452ffd640 1 -- 172.21.15.132:0/4054072853 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020696796 0 0) 0x7fd4540b5320 con 0x7fd4540d1aa0 2023-12-20T04:52:53.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd452ffd640 1 -- 172.21.15.132:0/4054072853 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd43c003520 con 0x7fd4540d1aa0 2023-12-20T04:52:53.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd452ffd640 1 -- 172.21.15.132:0/4054072853 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 60766552 0 0) 0x7fd4540b5ec0 con 0x7fd454160450 2023-12-20T04:52:53.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd452ffd640 1 -- 172.21.15.132:0/4054072853 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fd4540b5320 con 0x7fd454160450 2023-12-20T04:52:53.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd452ffd640 1 -- 172.21.15.132:0/4054072853 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1838902512 0 0) 0x7fd43c003520 con 0x7fd4540d1aa0 2023-12-20T04:52:53.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd452ffd640 1 -- 172.21.15.132:0/4054072853 >> v2:172.21.15.187:3300/0 conn(0x7fd4540b4980 msgr2=0x7fd4540b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:53.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd452ffd640 1 --2- 172.21.15.132:0/4054072853 >> v2:172.21.15.187:3300/0 conn(0x7fd4540b4980 0x7fd4540b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd452ffd640 1 -- 172.21.15.132:0/4054072853 >> v1:172.21.15.187:6789/0 conn(0x7fd454160450 legacy=0x7fd454160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd452ffd640 1 -- 172.21.15.132:0/4054072853 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4540d0fc0 con 0x7fd4540d1aa0 2023-12-20T04:52:53.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd452ffd640 1 -- 172.21.15.132:0/4054072853 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fd44c0019f0 con 0x7fd4540d1aa0 2023-12-20T04:52:53.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd452ffd640 1 -- 172.21.15.132:0/4054072853 >> v1:172.21.15.132:6789/0 conn(0x7fd4540d1aa0 legacy=0x7fd4540d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd452ffd640 1 --2- 172.21.15.132:0/4054072853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd43c003b00 0x7fd43c003f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd452ffd640 1 --2- 172.21.15.132:0/4054072853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd43c0047c0 0x7fd43c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd452ffd640 1 --2- 172.21.15.132:0/4054072853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43c005180 0x7fd43c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd452ffd640 1 -- 172.21.15.132:0/4054072853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4541617e0 con 0x7fd43c005180 2023-12-20T04:52:53.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd452ffd640 1 -- 172.21.15.132:0/4054072853 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c00bf70 con 0x7fd43c0047c0 2023-12-20T04:52:53.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd452ffd640 1 -- 172.21.15.132:0/4054072853 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd43c00c130 con 0x7fd43c003b00 2023-12-20T04:52:53.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd458d68640 1 --2- 172.21.15.132:0/4054072853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43c005180 0x7fd43c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd4537fe640 1 --2- 172.21.15.132:0/4054072853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd43c0047c0 0x7fd43c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.596+0000 7fd453fff640 1 --2- 172.21.15.132:0/4054072853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd43c003b00 0x7fd43c003f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.597+0000 7fd458d68640 1 -- 172.21.15.132:0/4054072853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd43c003b00 msgr2=0x7fd43c003f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:53.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.597+0000 7fd458d68640 1 --2- 172.21.15.132:0/4054072853 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd43c003b00 0x7fd43c003f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.597+0000 7fd458d68640 1 -- 172.21.15.132:0/4054072853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd43c0047c0 msgr2=0x7fd43c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:53.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.597+0000 7fd458d68640 1 --2- 172.21.15.132:0/4054072853 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd43c0047c0 0x7fd43c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.597+0000 7fd458d68640 1 -- 172.21.15.132:0/4054072853 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd43c003520 con 0x7fd43c005180 2023-12-20T04:52:53.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.597+0000 7fd458d68640 1 -- 172.21.15.132:0/4054072853 reap_dead start 2023-12-20T04:52:53.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.597+0000 7fd458d68640 1 --2- 172.21.15.132:0/4054072853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43c005180 0x7fd43c00b980 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fd44c002230 tx=0x7fd43c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=55313ca0d245d81 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:53.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.597+0000 7fd452ffd640 1 -- 172.21.15.132:0/4054072853 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c034630 con 0x7fd43c005180 2023-12-20T04:52:53.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.597+0000 7fd452ffd640 1 -- 172.21.15.132:0/4054072853 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c02f070 con 0x7fd43c005180 2023-12-20T04:52:53.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.597+0000 7fd452ffd640 1 -- 172.21.15.132:0/4054072853 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c0349f0 con 0x7fd43c005180 2023-12-20T04:52:53.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.598+0000 7fd45a7cb640 1 -- 172.21.15.132:0/4054072853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43c005180 msgr2=0x7fd43c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.598+0000 7fd45a7cb640 1 --2- 172.21.15.132:0/4054072853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43c005180 0x7fd43c00b980 secure :-1 s=READY pgs=1741 cs=0 l=1 rev1=1 crypto rx=0x7fd44c002230 tx=0x7fd43c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.598+0000 7fd45a7cb640 1 -- 172.21.15.132:0/4054072853 shutdown_connections 2023-12-20T04:52:53.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.598+0000 7fd45a7cb640 1 --2- 172.21.15.132:0/4054072853 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd43c005180 0x7fd43c00b980 unknown :-1 s=CLOSED pgs=1741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.598+0000 7fd45a7cb640 1 -- 172.21.15.132:0/4054072853 >> 172.21.15.132:0/4054072853 conn(0x7fd4540cf980 msgr2=0x7fd4540cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:53.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.598+0000 7fd45a7cb640 1 -- 172.21.15.132:0/4054072853 shutdown_connections 2023-12-20T04:52:53.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.598+0000 7fd45a7cb640 1 -- 172.21.15.132:0/4054072853 wait complete. 2023-12-20T04:52:53.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.599+0000 7fd45a7cb640 1 Processor -- start 2023-12-20T04:52:53.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.599+0000 7fd45a7cb640 1 -- start start 2023-12-20T04:52:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd45a7cb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd43c005180 0x7fd4540c8350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd45a7cb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4540cc1d0 0x7fd45415c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd45a7cb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4540cc650 0x7fd45415cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd45a7cb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4540cb130 con 0x7fd4540cc650 2023-12-20T04:52:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd45a7cb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4540cb410 con 0x7fd43c005180 2023-12-20T04:52:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd45a7cb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd4540cb6f0 con 0x7fd4540cc1d0 2023-12-20T04:52:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd458d68640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4540cc650 0x7fd45415cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd458d68640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4540cc650 0x7fd45415cac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52328/0 (socket says 172.21.15.132:52328) 2023-12-20T04:52:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd458d68640 1 -- 172.21.15.132:0/8515466 learned_addr learned my addr 172.21.15.132:0/8515466 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd453fff640 1 --2- 172.21.15.132:0/8515466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd43c005180 0x7fd4540c8350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd4537fe640 1 --2- 172.21.15.132:0/8515466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4540cc1d0 0x7fd45415c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd458d68640 1 -- 172.21.15.132:0/8515466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4540cc1d0 msgr2=0x7fd45415c580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd458d68640 1 --2- 172.21.15.132:0/8515466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4540cc1d0 0x7fd45415c580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd458d68640 1 -- 172.21.15.132:0/8515466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd43c005180 msgr2=0x7fd4540c8350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd458d68640 1 --2- 172.21.15.132:0/8515466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd43c005180 0x7fd4540c8350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd458d68640 1 -- 172.21.15.132:0/8515466 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4540cb9d0 con 0x7fd4540cc650 2023-12-20T04:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd4537fe640 1 --2- 172.21.15.132:0/8515466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4540cc1d0 0x7fd45415c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.600+0000 7fd458d68640 1 --2- 172.21.15.132:0/8515466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4540cc650 0x7fd45415cac0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fd44c002230 tx=0x7fd44c001d00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.601+0000 7fd450ff9640 1 -- 172.21.15.132:0/8515466 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c040680 con 0x7fd4540cc650 2023-12-20T04:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.601+0000 7fd450ff9640 1 -- 172.21.15.132:0/8515466 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd44c0407e0 con 0x7fd4540cc650 2023-12-20T04:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.601+0000 7fd45a7cb640 1 -- 172.21.15.132:0/8515466 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4540cbcb0 con 0x7fd4540cc650 2023-12-20T04:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.601+0000 7fd450ff9640 1 -- 172.21.15.132:0/8515466 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd44c040b50 con 0x7fd4540cc650 2023-12-20T04:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.601+0000 7fd45a7cb640 1 -- 172.21.15.132:0/8515466 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd45414fec0 con 0x7fd4540cc650 2023-12-20T04:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.602+0000 7fd45a7cb640 1 -- 172.21.15.132:0/8515466 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd45404e840 con 0x7fd4540cc650 2023-12-20T04:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.602+0000 7fd450ff9640 1 -- 172.21.15.132:0/8515466 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd44c031030 con 0x7fd4540cc650 2023-12-20T04:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.602+0000 7fd450ff9640 1 --2- 172.21.15.132:0/8515466 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd44006a460 0x7fd44006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.602+0000 7fd450ff9640 1 -- 172.21.15.132:0/8515466 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fd44c0aa510 con 0x7fd4540cc650 2023-12-20T04:52:53.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.602+0000 7fd453fff640 1 --2- 172.21.15.132:0/8515466 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd44006a460 0x7fd44006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.603+0000 7fd450ff9640 1 -- 172.21.15.132:0/8515466 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7fd440071ff0 con 0x7fd4540cc650 2023-12-20T04:52:53.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.603+0000 7fd453fff640 1 --2- 172.21.15.132:0/8515466 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd44006a460 0x7fd44006c920 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd444000c00 tx=0x7fd444009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:53.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.607+0000 7fd450ff9640 1 -- 172.21.15.132:0/8515466 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd44c045020 con 0x7fd4540cc650 2023-12-20T04:52:53.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.807+0000 7fd45a7cb640 1 -- 172.21.15.132:0/8515466 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fd4540d0ad0 con 0x7fd4540cc650 2023-12-20T04:52:53.809 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.807+0000 7fd450ff9640 1 -- 172.21.15.132:0/8515466 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 63 v63) v1 ==== 94+0+4725 (secure 0 0 0) 0x7fd44c075b70 con 0x7fd4540cc650 2023-12-20T04:52:53.809 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:52:53.809 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":63,"default_fscid":10,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6644,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1464403338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1464403338},{"type":"v1","addr":"172.21.15.187:6834","nonce":1464403338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2717050899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2717050899},{"type":"v1","addr":"172.21.15.187:6835","nonce":2717050899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8709,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2430423967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2430423967},{"type":"v1","addr":"172.21.15.132:6836","nonce":2430423967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60}],"filesystems":[{"mdsmap":{"epoch":63,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:51:46.508144+0000","modified":"2023-12-20T04:51:48.515251+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":8712},"failed":[],"damaged":[],"stopped":[],"info":{"gid_8712":{"gid":8712,"name":"a","rank":0,"incarnation":61,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/1841932991","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1841932991},{"type":"v1","addr":"172.21.15.132:6837","nonce":1841932991}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[21],"metadata_pool":20,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":10}]} 2023-12-20T04:52:53.810 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 63 2023-12-20T04:52:53.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.809+0000 7fd45a7cb640 1 -- 172.21.15.132:0/8515466 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd44006a460 msgr2=0x7fd44006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.809+0000 7fd45a7cb640 1 --2- 172.21.15.132:0/8515466 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd44006a460 0x7fd44006c920 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7fd444000c00 tx=0x7fd444009040 comp rx=0 tx=0).stop 2023-12-20T04:52:53.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.809+0000 7fd45a7cb640 1 -- 172.21.15.132:0/8515466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4540cc650 msgr2=0x7fd45415cac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.811 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.809+0000 7fd45a7cb640 1 --2- 172.21.15.132:0/8515466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4540cc650 0x7fd45415cac0 secure :-1 s=READY pgs=1742 cs=0 l=1 rev1=1 crypto rx=0x7fd44c002230 tx=0x7fd44c001d00 comp rx=0 tx=0).stop 2023-12-20T04:52:53.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.809+0000 7fd45a7cb640 1 -- 172.21.15.132:0/8515466 shutdown_connections 2023-12-20T04:52:53.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.809+0000 7fd45a7cb640 1 --2- 172.21.15.132:0/8515466 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd44006a460 0x7fd44006c920 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.809+0000 7fd45a7cb640 1 --2- 172.21.15.132:0/8515466 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd4540cc650 0x7fd45415cac0 unknown :-1 s=CLOSED pgs=1742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.809+0000 7fd45a7cb640 1 --2- 172.21.15.132:0/8515466 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd4540cc1d0 0x7fd45415c580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.809+0000 7fd45a7cb640 1 --2- 172.21.15.132:0/8515466 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd43c005180 0x7fd4540c8350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.809+0000 7fd45a7cb640 1 -- 172.21.15.132:0/8515466 >> 172.21.15.132:0/8515466 conn(0x7fd4540cf980 msgr2=0x7fd4540cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:53.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.809+0000 7fd45a7cb640 1 -- 172.21.15.132:0/8515466 shutdown_connections 2023-12-20T04:52:53.812 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.809+0000 7fd45a7cb640 1 -- 172.21.15.132:0/8515466 wait complete. 2023-12-20T04:52:53.822 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:52:53.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.920+0000 7f8ea0f27640 1 Processor -- start 2023-12-20T04:52:53.922 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.920+0000 7f8ea0f27640 1 -- start start 2023-12-20T04:52:53.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.921+0000 7f8ea0f27640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8e9c15d100 0x7f8e9c0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.921+0000 7f8ea0f27640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8e9c0d0370 0x7f8e9c0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.921+0000 7f8ea0f27640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9c161850 0x7f8e9c0cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.921+0000 7f8ea0f27640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e9c0b2f90 con 0x7f8e9c0d0370 2023-12-20T04:52:53.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.921+0000 7f8ea0f27640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e9c1613c0 con 0x7f8e9c15d100 2023-12-20T04:52:53.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.921+0000 7f8ea0f27640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0d0810 con 0x7f8e9c161850 2023-12-20T04:52:53.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.921+0000 7f8e93fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8e9c0d0370 0x7f8e9c0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.921+0000 7f8e93fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8e9c0d0370 0x7f8e9c0cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52330/0 (socket says 172.21.15.132:52330) 2023-12-20T04:52:53.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.921+0000 7f8e93fff640 1 -- 172.21.15.132:0/814467290 learned_addr learned my addr 172.21.15.132:0/814467290 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:53.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.921+0000 7f8e93fff640 1 -- 172.21.15.132:0/814467290 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9c161850 msgr2=0x7f8e9c0cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:53.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.921+0000 7f8e93fff640 1 --2- 172.21.15.132:0/814467290 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9c161850 0x7f8e9c0cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.921+0000 7f8e93fff640 1 -- 172.21.15.132:0/814467290 >> v2:172.21.15.187:3300/0 conn(0x7f8e9c15d100 msgr2=0x7f8e9c0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:53.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.921+0000 7f8e93fff640 1 --2- 172.21.15.132:0/814467290 >> v2:172.21.15.187:3300/0 conn(0x7f8e9c15d100 0x7f8e9c0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.921+0000 7f8e93fff640 1 -- 172.21.15.132:0/814467290 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9c160d70 con 0x7f8e9c0d0370 2023-12-20T04:52:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.922+0000 7f8e93fff640 1 --2- 172.21.15.132:0/814467290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e9c0d0370 0x7f8e9c0cd500 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c06e5e0 tx=0x7f8e8402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4afc1ac1ae9213f2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.922+0000 7f8e99d9b640 1 -- 172.21.15.132:0/814467290 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84031870 con 0x7f8e9c0d0370 2023-12-20T04:52:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.922+0000 7f8e99d9b640 1 -- 172.21.15.132:0/814467290 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e840319d0 con 0x7f8e9c0d0370 2023-12-20T04:52:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.922+0000 7f8e99d9b640 1 -- 172.21.15.132:0/814467290 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e84031d60 con 0x7f8e9c0d0370 2023-12-20T04:52:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.923+0000 7f8ea0f27640 1 -- 172.21.15.132:0/814467290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e9c0d0370 msgr2=0x7f8e9c0cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.923+0000 7f8ea0f27640 1 --2- 172.21.15.132:0/814467290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e9c0d0370 0x7f8e9c0cd500 secure :-1 s=READY pgs=1743 cs=0 l=1 rev1=1 crypto rx=0x7f8e9c06e5e0 tx=0x7f8e8402b910 comp rx=0 tx=0).stop 2023-12-20T04:52:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.923+0000 7f8ea0f27640 1 -- 172.21.15.132:0/814467290 shutdown_connections 2023-12-20T04:52:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.923+0000 7f8ea0f27640 1 --2- 172.21.15.132:0/814467290 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9c161850 0x7f8e9c0cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.923+0000 7f8ea0f27640 1 --2- 172.21.15.132:0/814467290 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e9c0d0370 0x7f8e9c0cd500 unknown :-1 s=CLOSED pgs=1743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.923+0000 7f8ea0f27640 1 --2- 172.21.15.132:0/814467290 >> v2:172.21.15.187:3300/0 conn(0x7f8e9c15d100 0x7f8e9c0b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.923+0000 7f8ea0f27640 1 -- 172.21.15.132:0/814467290 >> 172.21.15.132:0/814467290 conn(0x7f8e9c06d7c0 msgr2=0x7f8e9c06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.923+0000 7f8ea0f27640 1 -- 172.21.15.132:0/814467290 shutdown_connections 2023-12-20T04:52:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.923+0000 7f8ea0f27640 1 -- 172.21.15.132:0/814467290 wait complete. 2023-12-20T04:52:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.924+0000 7f8ea0f27640 1 Processor -- start 2023-12-20T04:52:53.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.924+0000 7f8ea0f27640 1 -- start start 2023-12-20T04:52:53.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8ea0f27640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e9c15d100 0x7f8e9c156330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8ea0f27640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e9c161850 0x7f8e9c0b3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8ea0f27640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9c0b3fc0 0x7f8e9c0b5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8ea0f27640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c156870 con 0x7f8e9c15d100 2023-12-20T04:52:53.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8ea0f27640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0b4540 con 0x7f8e9c161850 2023-12-20T04:52:53.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8ea0f27640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9c0c9270 con 0x7f8e9c0b3fc0 2023-12-20T04:52:53.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8e9a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e9c15d100 0x7f8e9c156330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8e9a59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e9c15d100 0x7f8e9c156330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52336/0 (socket says 172.21.15.132:52336) 2023-12-20T04:52:53.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8e9a59c640 1 -- 172.21.15.132:0/3316001728 learned_addr learned my addr 172.21.15.132:0/3316001728 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:53.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8e93fff640 1 --2- 172.21.15.132:0/3316001728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e9c161850 0x7f8e9c0b3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8e9ad9d640 1 --2- 172.21.15.132:0/3316001728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9c0b3fc0 0x7f8e9c0b5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8e9a59c640 1 -- 172.21.15.132:0/3316001728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9c0b3fc0 msgr2=0x7f8e9c0b5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8e9a59c640 1 --2- 172.21.15.132:0/3316001728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9c0b3fc0 0x7f8e9c0b5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8e9a59c640 1 -- 172.21.15.132:0/3316001728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e9c161850 msgr2=0x7f8e9c0b3a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:53.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8e9a59c640 1 --2- 172.21.15.132:0/3316001728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e9c161850 0x7f8e9c0b3a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:53.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8e9a59c640 1 -- 172.21.15.132:0/3316001728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e840094d0 con 0x7f8e9c15d100 2023-12-20T04:52:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8e9a59c640 1 --2- 172.21.15.132:0/3316001728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e9c15d100 0x7f8e9c156330 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c00b4a0 tx=0x7f8e8c00b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.925+0000 7f8e92ffd640 1 -- 172.21.15.132:0/3316001728 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c010610 con 0x7f8e9c15d100 2023-12-20T04:52:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.926+0000 7f8e92ffd640 1 -- 172.21.15.132:0/3316001728 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e8c010770 con 0x7f8e9c15d100 2023-12-20T04:52:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.926+0000 7f8ea0f27640 1 -- 172.21.15.132:0/3316001728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e9c0c9550 con 0x7f8e9c15d100 2023-12-20T04:52:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.926+0000 7f8e92ffd640 1 -- 172.21.15.132:0/3316001728 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8c010b20 con 0x7f8e9c15d100 2023-12-20T04:52:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.926+0000 7f8ea0f27640 1 -- 172.21.15.132:0/3316001728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9c0b4820 con 0x7f8e9c15d100 2023-12-20T04:52:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.927+0000 7f8ea0f27640 1 -- 172.21.15.132:0/3316001728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e9c0c9a70 con 0x7f8e9c15d100 2023-12-20T04:52:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.927+0000 7f8e92ffd640 1 -- 172.21.15.132:0/3316001728 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8e8c010c80 con 0x7f8e9c15d100 2023-12-20T04:52:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.927+0000 7f8e92ffd640 1 --2- 172.21.15.132:0/3316001728 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8e7c06a460 0x7f8e7c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.927+0000 7f8e92ffd640 1 -- 172.21.15.132:0/3316001728 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7f8e8c0884c0 con 0x7f8e9c15d100 2023-12-20T04:52:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.927+0000 7f8e93fff640 1 --2- 172.21.15.132:0/3316001728 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8e7c06a460 0x7f8e7c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.927+0000 7f8e92ffd640 1 -- 172.21.15.132:0/3316001728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7f8e7c071ff0 con 0x7f8e9c15d100 2023-12-20T04:52:53.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.928+0000 7f8e93fff640 1 --2- 172.21.15.132:0/3316001728 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8e7c06a460 0x7f8e7c06c920 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8e84036000 tx=0x7f8e84008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:53.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:53.931+0000 7f8e92ffd640 1 -- 172.21.15.132:0/3316001728 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8e9c0c9a70 con 0x7f8e9c15d100 2023-12-20T04:52:54.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.099+0000 7f8ea0f27640 1 -- 172.21.15.132:0/3316001728 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f8e9c0c9a70 con 0x7f8e9c15d100 2023-12-20T04:52:54.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.100+0000 7f8e92ffd640 1 -- 172.21.15.132:0/3316001728 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v173) v1 ==== 74+0+16236 (secure 0 0 0) 0x7f8e8c014090 con 0x7f8e9c15d100 2023-12-20T04:52:54.102 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:52:54.102 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":173,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:52:39.899511+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":20,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:51:44.739391+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"168","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":21,"pool_name":"cephfs_data","create_time":"2023-12-20T04:51:45.486167+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"173","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"21.14","mappings":[{"from":4,"to":3}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:52:54.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.101+0000 7f8ea0f27640 1 -- 172.21.15.132:0/3316001728 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8e7c06a460 msgr2=0x7f8e7c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:54.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.101+0000 7f8ea0f27640 1 --2- 172.21.15.132:0/3316001728 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8e7c06a460 0x7f8e7c06c920 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f8e84036000 tx=0x7f8e84008030 comp rx=0 tx=0).stop 2023-12-20T04:52:54.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.101+0000 7f8ea0f27640 1 -- 172.21.15.132:0/3316001728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e9c15d100 msgr2=0x7f8e9c156330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:54.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.101+0000 7f8ea0f27640 1 --2- 172.21.15.132:0/3316001728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e9c15d100 0x7f8e9c156330 secure :-1 s=READY pgs=1744 cs=0 l=1 rev1=1 crypto rx=0x7f8e8c00b4a0 tx=0x7f8e8c00b960 comp rx=0 tx=0).stop 2023-12-20T04:52:54.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.101+0000 7f8ea0f27640 1 -- 172.21.15.132:0/3316001728 shutdown_connections 2023-12-20T04:52:54.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.102+0000 7f8ea0f27640 1 --2- 172.21.15.132:0/3316001728 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8e7c06a460 0x7f8e7c06c920 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.102+0000 7f8ea0f27640 1 --2- 172.21.15.132:0/3316001728 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9c0b3fc0 0x7f8e9c0b5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.102+0000 7f8ea0f27640 1 --2- 172.21.15.132:0/3316001728 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e9c161850 0x7f8e9c0b3a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.104 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.102+0000 7f8ea0f27640 1 --2- 172.21.15.132:0/3316001728 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e9c15d100 0x7f8e9c156330 unknown :-1 s=CLOSED pgs=1744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.102+0000 7f8ea0f27640 1 -- 172.21.15.132:0/3316001728 >> 172.21.15.132:0/3316001728 conn(0x7f8e9c06d7c0 msgr2=0x7f8e9c0cb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:54.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.102+0000 7f8ea0f27640 1 -- 172.21.15.132:0/3316001728 shutdown_connections 2023-12-20T04:52:54.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.102+0000 7f8ea0f27640 1 -- 172.21.15.132:0/3316001728 wait complete. 2023-12-20T04:52:54.115 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-20T04:52:54.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.215+0000 7fe1e9a41640 1 Processor -- start 2023-12-20T04:52:54.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.215+0000 7fe1e9a41640 1 -- start start 2023-12-20T04:52:54.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.215+0000 7fe1e9a41640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe1e40d30a0 0x7fe1e40cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:54.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.215+0000 7fe1e9a41640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe1e415d2c0 0x7fe1e40d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:54.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.215+0000 7fe1e9a41640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1e40d0060 0x7fe1e4160c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:54.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.215+0000 7fe1e9a41640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e40d0cf0 con 0x7fe1e40d30a0 2023-12-20T04:52:54.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.215+0000 7fe1e9a41640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe1e40d39c0 con 0x7fe1e415d2c0 2023-12-20T04:52:54.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.215+0000 7fe1e9a41640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40d0550 con 0x7fe1e40d0060 2023-12-20T04:52:54.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.216+0000 7fe1e2ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe1e40d30a0 0x7fe1e40cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:54.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.216+0000 7fe1e2ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe1e40d30a0 0x7fe1e40cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52348/0 (socket says 172.21.15.132:52348) 2023-12-20T04:52:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.216+0000 7fe1e2ffd640 1 -- 172.21.15.132:0/1419997996 learned_addr learned my addr 172.21.15.132:0/1419997996 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.216+0000 7fe1e27fc640 1 --2- 172.21.15.132:0/1419997996 >> v2:172.21.15.187:3300/0 conn(0x7fe1e415d2c0 0x7fe1e40d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.216+0000 7fe1e37fe640 1 --2- 172.21.15.132:0/1419997996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1e40d0060 0x7fe1e4160c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.216+0000 7fe1e2ffd640 1 -- 172.21.15.132:0/1419997996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1e40d0060 msgr2=0x7fe1e4160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.216+0000 7fe1e2ffd640 1 --2- 172.21.15.132:0/1419997996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1e40d0060 0x7fe1e4160c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.216+0000 7fe1e2ffd640 1 -- 172.21.15.132:0/1419997996 >> v2:172.21.15.187:3300/0 conn(0x7fe1e415d2c0 msgr2=0x7fe1e40d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.216+0000 7fe1e2ffd640 1 --2- 172.21.15.132:0/1419997996 >> v2:172.21.15.187:3300/0 conn(0x7fe1e415d2c0 0x7fe1e40d3480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.216+0000 7fe1e2ffd640 1 -- 172.21.15.132:0/1419997996 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1e40cddc0 con 0x7fe1e40d30a0 2023-12-20T04:52:54.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.217+0000 7fe1e2ffd640 1 --2- 172.21.15.132:0/1419997996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e40d30a0 0x7fe1e40cd5c0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40c9dc0 tx=0x7fe1d402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df4cf557edce68fa server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:54.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.217+0000 7fe1e1ffb640 1 -- 172.21.15.132:0/1419997996 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d402ca70 con 0x7fe1e40d30a0 2023-12-20T04:52:54.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.217+0000 7fe1e1ffb640 1 -- 172.21.15.132:0/1419997996 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d402cbd0 con 0x7fe1e40d30a0 2023-12-20T04:52:54.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.217+0000 7fe1e1ffb640 1 -- 172.21.15.132:0/1419997996 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d40343f0 con 0x7fe1e40d30a0 2023-12-20T04:52:54.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.217+0000 7fe1e9a41640 1 -- 172.21.15.132:0/1419997996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e40d30a0 msgr2=0x7fe1e40cd5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:54.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.217+0000 7fe1e9a41640 1 --2- 172.21.15.132:0/1419997996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e40d30a0 0x7fe1e40cd5c0 secure :-1 s=READY pgs=1745 cs=0 l=1 rev1=1 crypto rx=0x7fe1e40c9dc0 tx=0x7fe1d402bed0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.217+0000 7fe1e9a41640 1 -- 172.21.15.132:0/1419997996 shutdown_connections 2023-12-20T04:52:54.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.217+0000 7fe1e9a41640 1 --2- 172.21.15.132:0/1419997996 >> v2:172.21.15.187:3300/0 conn(0x7fe1e415d2c0 0x7fe1e40d3480 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.217+0000 7fe1e9a41640 1 --2- 172.21.15.132:0/1419997996 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1e40d0060 0x7fe1e4160c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.217+0000 7fe1e9a41640 1 --2- 172.21.15.132:0/1419997996 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e40d30a0 0x7fe1e40cd5c0 unknown :-1 s=CLOSED pgs=1745 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.217+0000 7fe1e9a41640 1 -- 172.21.15.132:0/1419997996 >> 172.21.15.132:0/1419997996 conn(0x7fe1e4072e40 msgr2=0x7fe1e4073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.217+0000 7fe1e9a41640 1 -- 172.21.15.132:0/1419997996 shutdown_connections 2023-12-20T04:52:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.217+0000 7fe1e9a41640 1 -- 172.21.15.132:0/1419997996 wait complete. 2023-12-20T04:52:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.218+0000 7fe1e9a41640 1 Processor -- start 2023-12-20T04:52:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.219+0000 7fe1e9a41640 1 -- start start 2023-12-20T04:52:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.219+0000 7fe1e9a41640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1e40d0060 0x7fe1e414a570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.219+0000 7fe1e9a41640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e40d30a0 0x7fe1e40b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.219+0000 7fe1e9a41640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1e415d2c0 0x7fe1e40b7540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.219+0000 7fe1e9a41640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e414aab0 con 0x7fe1e40d30a0 2023-12-20T04:52:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.219+0000 7fe1e9a41640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40cc760 con 0x7fe1e40d0060 2023-12-20T04:52:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.219+0000 7fe1e9a41640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe1e40cbb50 con 0x7fe1e415d2c0 2023-12-20T04:52:54.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.219+0000 7fe1e27fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e40d30a0 0x7fe1e40b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.219+0000 7fe1e27fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e40d30a0 0x7fe1e40b7000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52350/0 (socket says 172.21.15.132:52350) 2023-12-20T04:52:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.219+0000 7fe1e27fc640 1 -- 172.21.15.132:0/2137179 learned_addr learned my addr 172.21.15.132:0/2137179 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.220+0000 7fe1e2ffd640 1 --2- 172.21.15.132:0/2137179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1e40d0060 0x7fe1e414a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.220+0000 7fe1e37fe640 1 --2- 172.21.15.132:0/2137179 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1e415d2c0 0x7fe1e40b7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.220+0000 7fe1e27fc640 1 -- 172.21.15.132:0/2137179 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1e415d2c0 msgr2=0x7fe1e40b7540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.220+0000 7fe1e27fc640 1 --2- 172.21.15.132:0/2137179 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1e415d2c0 0x7fe1e40b7540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.220+0000 7fe1e27fc640 1 -- 172.21.15.132:0/2137179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1e40d0060 msgr2=0x7fe1e414a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.220+0000 7fe1e27fc640 1 --2- 172.21.15.132:0/2137179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1e40d0060 0x7fe1e414a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.220+0000 7fe1e27fc640 1 -- 172.21.15.132:0/2137179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1d4009b30 con 0x7fe1e40d30a0 2023-12-20T04:52:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.220+0000 7fe1e27fc640 1 --2- 172.21.15.132:0/2137179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e40d30a0 0x7fe1e40b7000 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800d5c0 tx=0x7fe1d800da80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.220+0000 7fe1cbfff640 1 -- 172.21.15.132:0/2137179 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d80125f0 con 0x7fe1e40d30a0 2023-12-20T04:52:54.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.220+0000 7fe1cbfff640 1 -- 172.21.15.132:0/2137179 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe1d8012750 con 0x7fe1e40d30a0 2023-12-20T04:52:54.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.220+0000 7fe1e9a41640 1 -- 172.21.15.132:0/2137179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1e40cbe30 con 0x7fe1e40d30a0 2023-12-20T04:52:54.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.220+0000 7fe1cbfff640 1 -- 172.21.15.132:0/2137179 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe1d8012b00 con 0x7fe1e40d30a0 2023-12-20T04:52:54.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.220+0000 7fe1e9a41640 1 -- 172.21.15.132:0/2137179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1e40cc3f0 con 0x7fe1e40d30a0 2023-12-20T04:52:54.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.221+0000 7fe1e9a41640 1 -- 172.21.15.132:0/2137179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1e40ce050 con 0x7fe1e40d30a0 2023-12-20T04:52:54.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.222+0000 7fe1cbfff640 1 -- 172.21.15.132:0/2137179 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe1d8012c60 con 0x7fe1e40d30a0 2023-12-20T04:52:54.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.222+0000 7fe1cbfff640 1 --2- 172.21.15.132:0/2137179 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1d006a430 0x7fe1d006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:54.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.222+0000 7fe1e2ffd640 1 --2- 172.21.15.132:0/2137179 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1d006a430 0x7fe1d006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:54.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.222+0000 7fe1cbfff640 1 -- 172.21.15.132:0/2137179 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(173..173 src has 1..173) v4 ==== 5738+0+0 (secure 0 0 0) 0x7fe1d8088b50 con 0x7fe1e40d30a0 2023-12-20T04:52:54.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.222+0000 7fe1cbfff640 1 -- 172.21.15.132:0/2137179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=174}) v3 -- 0x7fe1d0071fc0 con 0x7fe1e40d30a0 2023-12-20T04:52:54.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.223+0000 7fe1e2ffd640 1 --2- 172.21.15.132:0/2137179 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1d006a430 0x7fe1d006c8f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4035000 tx=0x7fe1d4030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:54.228 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.226+0000 7fe1cbfff640 1 -- 172.21.15.132:0/2137179 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe1d8054260 con 0x7fe1e40d30a0 2023-12-20T04:52:54.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.424+0000 7fe1e9a41640 1 -- 172.21.15.132:0/2137179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7fe1e404e840 con 0x7fe1e40d30a0 2023-12-20T04:52:54.427 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:52:54.425+0000 7f1a5cbbd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-20T04:52:54.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.426+0000 7fe1cbfff640 1 -- 172.21.15.132:0/2137179 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(174..174 src has 1..174) v4 ==== 374+0+0 (secure 0 0 0) 0x7fe1d805bca0 con 0x7fe1e40d30a0 2023-12-20T04:52:54.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.426+0000 7fe1cbfff640 1 -- 172.21.15.132:0/2137179 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=175}) v3 -- 0x7fe1d0072870 con 0x7fe1e40d30a0 2023-12-20T04:52:54.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.435+0000 7fe1cbfff640 1 -- 172.21.15.132:0/2137179 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v64) v1 ==== 161+0+0 (secure 0 0 0) 0x7fe1d8057880 con 0x7fe1e40d30a0 2023-12-20T04:52:54.437 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-20T04:52:54.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.437+0000 7fe1e9a41640 1 -- 172.21.15.132:0/2137179 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1d006a430 msgr2=0x7fe1d006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:54.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.437+0000 7fe1e9a41640 1 --2- 172.21.15.132:0/2137179 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1d006a430 0x7fe1d006c8f0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7fe1d4035000 tx=0x7fe1d4030000 comp rx=0 tx=0).stop 2023-12-20T04:52:54.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.437+0000 7fe1e9a41640 1 -- 172.21.15.132:0/2137179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e40d30a0 msgr2=0x7fe1e40b7000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:54.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.437+0000 7fe1e9a41640 1 --2- 172.21.15.132:0/2137179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e40d30a0 0x7fe1e40b7000 secure :-1 s=READY pgs=1746 cs=0 l=1 rev1=1 crypto rx=0x7fe1d800d5c0 tx=0x7fe1d800da80 comp rx=0 tx=0).stop 2023-12-20T04:52:54.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.437+0000 7fe1e9a41640 1 -- 172.21.15.132:0/2137179 shutdown_connections 2023-12-20T04:52:54.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.437+0000 7fe1e9a41640 1 --2- 172.21.15.132:0/2137179 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe1d006a430 0x7fe1d006c8f0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.437+0000 7fe1e9a41640 1 --2- 172.21.15.132:0/2137179 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe1e415d2c0 0x7fe1e40b7540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.437+0000 7fe1e9a41640 1 --2- 172.21.15.132:0/2137179 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe1e40d30a0 0x7fe1e40b7000 unknown :-1 s=CLOSED pgs=1746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.437+0000 7fe1e9a41640 1 --2- 172.21.15.132:0/2137179 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe1e40d0060 0x7fe1e414a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.437+0000 7fe1e9a41640 1 -- 172.21.15.132:0/2137179 >> 172.21.15.132:0/2137179 conn(0x7fe1e4072e40 msgr2=0x7fe1e4073220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:54.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.437+0000 7fe1e9a41640 1 -- 172.21.15.132:0/2137179 shutdown_connections 2023-12-20T04:52:54.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.437+0000 7fe1e9a41640 1 -- 172.21.15.132:0/2137179 wait complete. 2023-12-20T04:52:54.441 INFO:tasks.ceph.mds.a.smithi132.stderr: -8074> 2023-12-20T04:51:52.456+0000 7f134cc6b640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:52:54.451 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-20T04:52:54.473 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-12-20T04:52:54.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.551+0000 7f96d3f8e640 1 Processor -- start 2023-12-20T04:52:54.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.551+0000 7f96d3f8e640 1 -- start start 2023-12-20T04:52:54.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.552+0000 7f96d3f8e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f96cc1447b0 0x7f96cc0c5c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:54.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.552+0000 7f96d3f8e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f96cc0ca170 0x7f96cc0ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:54.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.552+0000 7f96d3f8e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f96cc0c4f40 con 0x7f96cc069c30 2023-12-20T04:52:54.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.552+0000 7f96d3f8e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc144b90 con 0x7f96cc0ca170 2023-12-20T04:52:54.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.552+0000 7f96d3f8e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f96cc0cac30 con 0x7f96cc1447b0 2023-12-20T04:52:54.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.552+0000 7f96d1529640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f96cc0ca170 0x7f96cc0ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:54.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.552+0000 7f96d1529640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f96cc0ca170 0x7f96cc0ca5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52370/0 (socket says 172.21.15.132:52370) 2023-12-20T04:52:54.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.552+0000 7f96d1529640 1 -- 172.21.15.132:0/130633603 learned_addr learned my addr 172.21.15.132:0/130633603 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:54.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.552+0000 7f96d1d2a640 1 --2- 172.21.15.132:0/130633603 >> v2:172.21.15.187:3300/0 conn(0x7f96cc1447b0 0x7f96cc0c5c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:54.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.552+0000 7f96d1529640 1 -- 172.21.15.132:0/130633603 >> v2:172.21.15.187:3300/0 conn(0x7f96cc1447b0 msgr2=0x7f96cc0c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:54.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.552+0000 7f96d1529640 1 --2- 172.21.15.132:0/130633603 >> v2:172.21.15.187:3300/0 conn(0x7f96cc1447b0 0x7f96cc0c5c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.552+0000 7f96d1529640 1 -- 172.21.15.132:0/130633603 >> v1:172.21.15.187:6789/0 conn(0x7f96cc069c30 legacy=0x7f96cc06c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:54.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.552+0000 7f96d1529640 1 -- 172.21.15.132:0/130633603 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96cc0c5190 con 0x7f96cc0ca170 2023-12-20T04:52:54.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.552+0000 7f96d1d2a640 1 --2- 172.21.15.132:0/130633603 >> v2:172.21.15.187:3300/0 conn(0x7f96cc1447b0 0x7f96cc0c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:52:54.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.553+0000 7f96d1529640 1 --2- 172.21.15.132:0/130633603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96cc0ca170 0x7f96cc0ca5d0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0cc560 tx=0x7f96bc02b880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71ffbdd252115387 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:54.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.553+0000 7f96d0d28640 1 -- 172.21.15.132:0/130633603 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc0317e0 con 0x7f96cc0ca170 2023-12-20T04:52:54.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.553+0000 7f96d0d28640 1 -- 172.21.15.132:0/130633603 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96bc031940 con 0x7f96cc0ca170 2023-12-20T04:52:54.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.553+0000 7f96d0d28640 1 -- 172.21.15.132:0/130633603 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96bc031cd0 con 0x7f96cc0ca170 2023-12-20T04:52:54.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.554+0000 7f96d3f8e640 1 -- 172.21.15.132:0/130633603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96cc0ca170 msgr2=0x7f96cc0ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:54.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.554+0000 7f96d3f8e640 1 --2- 172.21.15.132:0/130633603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96cc0ca170 0x7f96cc0ca5d0 secure :-1 s=READY pgs=1749 cs=0 l=1 rev1=1 crypto rx=0x7f96cc0cc560 tx=0x7f96bc02b880 comp rx=0 tx=0).stop 2023-12-20T04:52:54.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.554+0000 7f96d3f8e640 1 -- 172.21.15.132:0/130633603 shutdown_connections 2023-12-20T04:52:54.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.554+0000 7f96d3f8e640 1 --2- 172.21.15.132:0/130633603 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96cc0ca170 0x7f96cc0ca5d0 unknown :-1 s=CLOSED pgs=1749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.554+0000 7f96d3f8e640 1 --2- 172.21.15.132:0/130633603 >> v2:172.21.15.187:3300/0 conn(0x7f96cc1447b0 0x7f96cc0c5c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.554+0000 7f96d3f8e640 1 -- 172.21.15.132:0/130633603 >> 172.21.15.132:0/130633603 conn(0x7f96cc0cc630 msgr2=0x7f96cc0cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:54.561 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.554+0000 7f96d3f8e640 1 -- 172.21.15.132:0/130633603 shutdown_connections 2023-12-20T04:52:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.554+0000 7f96d3f8e640 1 -- 172.21.15.132:0/130633603 wait complete. 2023-12-20T04:52:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.555+0000 7f96d3f8e640 1 Processor -- start 2023-12-20T04:52:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.555+0000 7f96d3f8e640 1 -- start start 2023-12-20T04:52:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d3f8e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f96cc069c30 0x7f96cc142b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d3f8e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96cc0ca170 0x7f96cc13d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d3f8e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96cc1447b0 0x7f96cc0c5b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d3f8e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc143050 con 0x7f96cc1447b0 2023-12-20T04:52:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d3f8e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0c6f60 con 0x7f96cc0ca170 2023-12-20T04:52:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d3f8e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f96cc0c7240 con 0x7f96cc069c30 2023-12-20T04:52:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d252b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96cc1447b0 0x7f96cc0c5b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d252b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96cc1447b0 0x7f96cc0c5b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52386/0 (socket says 172.21.15.132:52386) 2023-12-20T04:52:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d252b640 1 -- 172.21.15.132:0/2422919557 learned_addr learned my addr 172.21.15.132:0/2422919557 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d1d2a640 1 --2- 172.21.15.132:0/2422919557 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f96cc069c30 0x7f96cc142b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:54.562 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d1529640 1 --2- 172.21.15.132:0/2422919557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96cc0ca170 0x7f96cc13d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d252b640 1 -- 172.21.15.132:0/2422919557 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f96cc069c30 msgr2=0x7f96cc142b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d252b640 1 --2- 172.21.15.132:0/2422919557 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f96cc069c30 0x7f96cc142b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d252b640 1 -- 172.21.15.132:0/2422919557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96cc0ca170 msgr2=0x7f96cc13d410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d252b640 1 --2- 172.21.15.132:0/2422919557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96cc0ca170 0x7f96cc13d410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d252b640 1 -- 172.21.15.132:0/2422919557 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f96bc0094d0 con 0x7f96cc1447b0 2023-12-20T04:52:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d1d2a640 1 --2- 172.21.15.132:0/2422919557 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f96cc069c30 0x7f96cc142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:52:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96d252b640 1 --2- 172.21.15.132:0/2422919557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96cc1447b0 0x7f96cc0c5b70 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f96c400b410 tx=0x7f96c400b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.556+0000 7f96c27fc640 1 -- 172.21.15.132:0/2422919557 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4004020 con 0x7f96cc1447b0 2023-12-20T04:52:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.557+0000 7f96c27fc640 1 -- 172.21.15.132:0/2422919557 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f96c4004180 con 0x7f96cc1447b0 2023-12-20T04:52:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.557+0000 7f96d3f8e640 1 -- 172.21.15.132:0/2422919557 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f96cc0c7520 con 0x7f96cc1447b0 2023-12-20T04:52:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.557+0000 7f96c27fc640 1 -- 172.21.15.132:0/2422919557 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f96c4011630 con 0x7f96cc1447b0 2023-12-20T04:52:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.557+0000 7f96d3f8e640 1 -- 172.21.15.132:0/2422919557 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96cc0c6bf0 con 0x7f96cc1447b0 2023-12-20T04:52:54.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.557+0000 7f96d3f8e640 1 -- 172.21.15.132:0/2422919557 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f96cc04e840 con 0x7f96cc1447b0 2023-12-20T04:52:54.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.558+0000 7f96c27fc640 1 -- 172.21.15.132:0/2422919557 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f96c4011790 con 0x7f96cc1447b0 2023-12-20T04:52:54.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.558+0000 7f96c27fc640 1 --2- 172.21.15.132:0/2422919557 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96b006a430 0x7f96b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:54.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.558+0000 7f96c27fc640 1 -- 172.21.15.132:0/2422919557 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(174..174 src has 1..174) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f96c4088690 con 0x7f96cc1447b0 2023-12-20T04:52:54.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.558+0000 7f96d1d2a640 1 --2- 172.21.15.132:0/2422919557 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96b006a430 0x7f96b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:54.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.559+0000 7f96c27fc640 1 -- 172.21.15.132:0/2422919557 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=175}) v3 -- 0x7f96b00720d0 con 0x7f96cc1447b0 2023-12-20T04:52:54.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.559+0000 7f96d1d2a640 1 --2- 172.21.15.132:0/2422919557 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96b006a430 0x7f96b006c8f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f96c800e550 tx=0x7f96c8007ab0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:54.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.563+0000 7f96c27fc640 1 -- 172.21.15.132:0/2422919557 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f96c4053c10 con 0x7f96cc1447b0 2023-12-20T04:52:54.766 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.764+0000 7f96d3f8e640 1 -- 172.21.15.132:0/2422919557 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7f96cc06a760 con 0x7f96cc1447b0 2023-12-20T04:52:54.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.903+0000 7f96c27fc640 1 -- 172.21.15.132:0/2422919557 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(175..175 src has 1..175) v4 ==== 679+0+0 (secure 0 0 0) 0x7f96c4057fd0 con 0x7f96cc1447b0 2023-12-20T04:52:54.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:54.903+0000 7f96c27fc640 1 -- 172.21.15.132:0/2422919557 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=176}) v3 -- 0x7f96b0072c60 con 0x7f96cc1447b0 2023-12-20T04:52:55.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.439+0000 7f96c27fc640 1 -- 172.21.15.132:0/2422919557 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v65) v1 ==== 104+0+0 (secure 0 0 0) 0x7f96c40150a0 con 0x7f96cc1447b0 2023-12-20T04:52:55.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.441+0000 7f96d3f8e640 1 -- 172.21.15.132:0/2422919557 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96b006a430 msgr2=0x7f96b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:55.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.441+0000 7f96d3f8e640 1 --2- 172.21.15.132:0/2422919557 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96b006a430 0x7f96b006c8f0 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f96c800e550 tx=0x7f96c8007ab0 comp rx=0 tx=0).stop 2023-12-20T04:52:55.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.441+0000 7f96d3f8e640 1 -- 172.21.15.132:0/2422919557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96cc1447b0 msgr2=0x7f96cc0c5b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:55.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.441+0000 7f96d3f8e640 1 --2- 172.21.15.132:0/2422919557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96cc1447b0 0x7f96cc0c5b70 secure :-1 s=READY pgs=1750 cs=0 l=1 rev1=1 crypto rx=0x7f96c400b410 tx=0x7f96c400b8d0 comp rx=0 tx=0).stop 2023-12-20T04:52:55.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.441+0000 7f96d3f8e640 1 -- 172.21.15.132:0/2422919557 shutdown_connections 2023-12-20T04:52:55.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.441+0000 7f96d3f8e640 1 --2- 172.21.15.132:0/2422919557 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96b006a430 0x7f96b006c8f0 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:55.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.441+0000 7f96d3f8e640 1 --2- 172.21.15.132:0/2422919557 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f96cc1447b0 0x7f96cc0c5b70 unknown :-1 s=CLOSED pgs=1750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:55.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.441+0000 7f96d3f8e640 1 --2- 172.21.15.132:0/2422919557 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f96cc0ca170 0x7f96cc13d410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:55.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.441+0000 7f96d3f8e640 1 --2- 172.21.15.132:0/2422919557 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f96cc069c30 0x7f96cc142b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:55.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.441+0000 7f96d3f8e640 1 -- 172.21.15.132:0/2422919557 >> 172.21.15.132:0/2422919557 conn(0x7f96cc0cc630 msgr2=0x7f96cc143760 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:55.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.442+0000 7f96d3f8e640 1 -- 172.21.15.132:0/2422919557 shutdown_connections 2023-12-20T04:52:55.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.442+0000 7f96d3f8e640 1 -- 172.21.15.132:0/2422919557 wait complete. 2023-12-20T04:52:55.457 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-20T04:52:55.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.604+0000 7f97140ce640 1 Processor -- start 2023-12-20T04:52:55.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.605+0000 7f97140ce640 1 -- start start 2023-12-20T04:52:55.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.605+0000 7f97140ce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f970c15ad50 0x7f970c06f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:55.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.605+0000 7f97140ce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f970c0cbca0 0x7f970c0ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:55.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.605+0000 7f97140ce640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f970c0cb810 con 0x7f970c15b130 2023-12-20T04:52:55.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.605+0000 7f97140ce640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f970c0cac00 con 0x7f970c0cbca0 2023-12-20T04:52:55.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.605+0000 7f97140ce640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c0caee0 con 0x7f970c15ad50 2023-12-20T04:52:55.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.606+0000 7f9711669640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f970c0cbca0 0x7f970c0ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:55.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.606+0000 7f9711669640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f970c0cbca0 0x7f970c0ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52396/0 (socket says 172.21.15.132:52396) 2023-12-20T04:52:55.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.606+0000 7f971266b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f970c15b130 0x7f970c0cea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40702/0 (socket says 172.21.15.132:40702) 2023-12-20T04:52:55.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.606+0000 7f9711669640 1 -- 172.21.15.132:0/1950571877 learned_addr learned my addr 172.21.15.132:0/1950571877 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:55.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.606+0000 7f9711e6a640 1 --2- 172.21.15.132:0/1950571877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f970c15ad50 0x7f970c06f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:55.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.606+0000 7f9711669640 1 -- 172.21.15.132:0/1950571877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f970c15ad50 msgr2=0x7f970c06f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:55.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.606+0000 7f9711669640 1 --2- 172.21.15.132:0/1950571877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f970c15ad50 0x7f970c06f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:55.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.606+0000 7f9711669640 1 -- 172.21.15.132:0/1950571877 >> v1:172.21.15.132:6789/0 conn(0x7f970c15b130 legacy=0x7f970c0cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:55.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.606+0000 7f9711669640 1 -- 172.21.15.132:0/1950571877 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f970c0cb1c0 con 0x7f970c0cbca0 2023-12-20T04:52:55.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.606+0000 7f9710e68640 1 -- 172.21.15.132:0/1950571877 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3360653304 0 0) 0x7f970c0cb810 con 0x7f970c15b130 2023-12-20T04:52:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.607+0000 7f9711669640 1 --2- 172.21.15.132:0/1950571877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f970c0cbca0 0x7f970c0ca500 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f9708009870 tx=0x7f970802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=49335e847238717c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.607+0000 7f9710e68640 1 -- 172.21.15.132:0/1950571877 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708030840 con 0x7f970c0cbca0 2023-12-20T04:52:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.607+0000 7f9710e68640 1 -- 172.21.15.132:0/1950571877 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97080309a0 con 0x7f970c0cbca0 2023-12-20T04:52:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.607+0000 7f9710e68640 1 -- 172.21.15.132:0/1950571877 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9708030d30 con 0x7f970c0cbca0 2023-12-20T04:52:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.607+0000 7f97140ce640 1 -- 172.21.15.132:0/1950571877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f970c0cbca0 msgr2=0x7f970c0ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.607+0000 7f97140ce640 1 --2- 172.21.15.132:0/1950571877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f970c0cbca0 0x7f970c0ca500 secure :-1 s=READY pgs=1752 cs=0 l=1 rev1=1 crypto rx=0x7f9708009870 tx=0x7f970802b980 comp rx=0 tx=0).stop 2023-12-20T04:52:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.607+0000 7f97140ce640 1 -- 172.21.15.132:0/1950571877 shutdown_connections 2023-12-20T04:52:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.607+0000 7f97140ce640 1 --2- 172.21.15.132:0/1950571877 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f970c0cbca0 0x7f970c0ca500 unknown :-1 s=CLOSED pgs=1752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.607+0000 7f97140ce640 1 --2- 172.21.15.132:0/1950571877 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f970c15ad50 0x7f970c06f3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.607+0000 7f97140ce640 1 -- 172.21.15.132:0/1950571877 >> 172.21.15.132:0/1950571877 conn(0x7f970c0b05c0 msgr2=0x7f970c0b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.607+0000 7f97140ce640 1 -- 172.21.15.132:0/1950571877 shutdown_connections 2023-12-20T04:52:55.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.608+0000 7f97140ce640 1 -- 172.21.15.132:0/1950571877 wait complete. 2023-12-20T04:52:55.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.609+0000 7f97140ce640 1 Processor -- start 2023-12-20T04:52:55.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.609+0000 7f97140ce640 1 -- start start 2023-12-20T04:52:55.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.609+0000 7f97140ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f970c0cbca0 0x7f970c0cd070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:55.614 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.609+0000 7f97140ce640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f970c15ad50 0x7f970c0c91a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.609+0000 7f97140ce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f970c15b130 0x7f970c157ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.609+0000 7f97140ce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c0ce170 con 0x7f970c0cbca0 2023-12-20T04:52:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.609+0000 7f97140ce640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f970c15ba80 con 0x7f970c15ad50 2023-12-20T04:52:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.609+0000 7f97140ce640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f970c0cdbb0 con 0x7f970c15b130 2023-12-20T04:52:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.609+0000 7f9711e6a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f970c0cbca0 0x7f970c0cd070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.609+0000 7f9711e6a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f970c0cbca0 0x7f970c0cd070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52398/0 (socket says 172.21.15.132:52398) 2023-12-20T04:52:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.609+0000 7f9711e6a640 1 -- 172.21.15.132:0/3196002003 learned_addr learned my addr 172.21.15.132:0/3196002003 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.610+0000 7f971266b640 1 --2- 172.21.15.132:0/3196002003 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f970c15b130 0x7f970c157ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.610+0000 7f9711669640 1 --2- 172.21.15.132:0/3196002003 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f970c15ad50 0x7f970c0c91a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.610+0000 7f9711e6a640 1 -- 172.21.15.132:0/3196002003 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f970c15b130 msgr2=0x7f970c157ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.610+0000 7f9711e6a640 1 --2- 172.21.15.132:0/3196002003 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f970c15b130 0x7f970c157ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.610+0000 7f9711e6a640 1 -- 172.21.15.132:0/3196002003 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f970c15ad50 msgr2=0x7f970c0c91a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.610+0000 7f9711e6a640 1 --2- 172.21.15.132:0/3196002003 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f970c15ad50 0x7f970c0c91a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.610+0000 7f9711e6a640 1 -- 172.21.15.132:0/3196002003 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f97080094d0 con 0x7f970c0cbca0 2023-12-20T04:52:55.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.610+0000 7f9711e6a640 1 --2- 172.21.15.132:0/3196002003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f970c0cbca0 0x7f970c0cd070 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f970000c7f0 tx=0x7f970000ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.610+0000 7f96fe7fc640 1 -- 172.21.15.132:0/3196002003 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9700004220 con 0x7f970c0cbca0 2023-12-20T04:52:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.610+0000 7f96fe7fc640 1 -- 172.21.15.132:0/3196002003 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f97000043a0 con 0x7f970c0cbca0 2023-12-20T04:52:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.610+0000 7f96fe7fc640 1 -- 172.21.15.132:0/3196002003 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9700007860 con 0x7f970c0cbca0 2023-12-20T04:52:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.610+0000 7f97140ce640 1 -- 172.21.15.132:0/3196002003 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f970c0cde90 con 0x7f970c0cbca0 2023-12-20T04:52:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.610+0000 7f97140ce640 1 -- 172.21.15.132:0/3196002003 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f970c0cd8b0 con 0x7f970c0cbca0 2023-12-20T04:52:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.611+0000 7f97140ce640 1 -- 172.21.15.132:0/3196002003 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f970c15b570 con 0x7f970c0cbca0 2023-12-20T04:52:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.612+0000 7f96fe7fc640 1 -- 172.21.15.132:0/3196002003 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9700007bd0 con 0x7f970c0cbca0 2023-12-20T04:52:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.612+0000 7f96fe7fc640 1 --2- 172.21.15.132:0/3196002003 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96f006a430 0x7f96f006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.612+0000 7f96fe7fc640 1 -- 172.21.15.132:0/3196002003 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(175..175 src has 1..175) v4 ==== 5824+0+0 (secure 0 0 0) 0x7f9700088940 con 0x7f970c0cbca0 2023-12-20T04:52:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.612+0000 7f9711669640 1 --2- 172.21.15.132:0/3196002003 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96f006a430 0x7f96f006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:55.616 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.612+0000 7f9711669640 1 --2- 172.21.15.132:0/3196002003 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96f006a430 0x7f96f006c8f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9708036000 tx=0x7f9708008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:55.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.616+0000 7f96fe7fc640 1 -- 172.21.15.132:0/3196002003 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f970c15b570 con 0x7f970c0cbca0 2023-12-20T04:52:55.784 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:55.782+0000 7f97140ce640 1 -- 172.21.15.132:0/3196002003 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f970c15b570 con 0x7f970c0cbca0 2023-12-20T04:52:56.445 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2023-12-20T04:52:56.447 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.443+0000 7f96fe7fc640 1 -- 172.21.15.132:0/3196002003 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v176) v1 ==== 181+0+0 (secure 0 0 0) 0x7f970c15b570 con 0x7f970c0cbca0 2023-12-20T04:52:56.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.447+0000 7f97140ce640 1 -- 172.21.15.132:0/3196002003 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96f006a430 msgr2=0x7f96f006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:56.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.447+0000 7f97140ce640 1 --2- 172.21.15.132:0/3196002003 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96f006a430 0x7f96f006c8f0 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f9708036000 tx=0x7f9708008030 comp rx=0 tx=0).stop 2023-12-20T04:52:56.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.447+0000 7f97140ce640 1 -- 172.21.15.132:0/3196002003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f970c0cbca0 msgr2=0x7f970c0cd070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:56.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.447+0000 7f97140ce640 1 --2- 172.21.15.132:0/3196002003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f970c0cbca0 0x7f970c0cd070 secure :-1 s=READY pgs=1753 cs=0 l=1 rev1=1 crypto rx=0x7f970000c7f0 tx=0x7f970000ccb0 comp rx=0 tx=0).stop 2023-12-20T04:52:56.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.447+0000 7f97140ce640 1 -- 172.21.15.132:0/3196002003 shutdown_connections 2023-12-20T04:52:56.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.447+0000 7f97140ce640 1 --2- 172.21.15.132:0/3196002003 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f96f006a430 0x7f96f006c8f0 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:56.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.447+0000 7f97140ce640 1 --2- 172.21.15.132:0/3196002003 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f970c15b130 0x7f970c157ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:56.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.447+0000 7f97140ce640 1 --2- 172.21.15.132:0/3196002003 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f970c15ad50 0x7f970c0c91a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:56.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.447+0000 7f97140ce640 1 --2- 172.21.15.132:0/3196002003 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f970c0cbca0 0x7f970c0cd070 unknown :-1 s=CLOSED pgs=1753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:56.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.447+0000 7f97140ce640 1 -- 172.21.15.132:0/3196002003 >> 172.21.15.132:0/3196002003 conn(0x7f970c0b05c0 msgr2=0x7f970c0b34e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:56.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.447+0000 7f97140ce640 1 -- 172.21.15.132:0/3196002003 shutdown_connections 2023-12-20T04:52:56.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.447+0000 7f97140ce640 1 -- 172.21.15.132:0/3196002003 wait complete. 2023-12-20T04:52:56.462 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-20T04:52:56.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.568+0000 7fdcb64af640 1 Processor -- start 2023-12-20T04:52:56.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.568+0000 7fdcb64af640 1 -- start start 2023-12-20T04:52:56.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.569+0000 7fdcb64af640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdcb006eba0 0x7fdcb00cdde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:56.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.569+0000 7fdcb64af640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb006e230 con 0x7fdcb00cf800 2023-12-20T04:52:56.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.569+0000 7fdcb64af640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fdcb00d1b80 con 0x7fdcb00cea10 2023-12-20T04:52:56.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.569+0000 7fdcb64af640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fdcb00cc660 con 0x7fdcb006eba0 2023-12-20T04:52:56.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.569+0000 7fdcaffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdcb006eba0 0x7fdcb00cdde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:56.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.569+0000 7fdcaffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fdcb006eba0 0x7fdcb00cdde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52406/0 (socket says 172.21.15.132:52406) 2023-12-20T04:52:56.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.569+0000 7fdcaffff640 1 -- 172.21.15.132:0/3787760173 learned_addr learned my addr 172.21.15.132:0/3787760173 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:56.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.569+0000 7fdcb4a4c640 1 --1- 172.21.15.132:0/3787760173 >> v1:172.21.15.132:6789/0 conn(0x7fdcb00cf800 0x7fdcb015a880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40716/0 (socket says 172.21.15.132:40716) 2023-12-20T04:52:56.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.569+0000 7fdcaffff640 1 -- 172.21.15.132:0/3787760173 >> v1:172.21.15.187:6789/0 conn(0x7fdcb00cea10 legacy=0x7fdcb00cf0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:56.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.569+0000 7fdcaffff640 1 -- 172.21.15.132:0/3787760173 >> v1:172.21.15.132:6789/0 conn(0x7fdcb00cf800 legacy=0x7fdcb015a880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:56.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.569+0000 7fdcaeffd640 1 -- 172.21.15.132:0/3787760173 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1177463026 0 0) 0x7fdcb006e230 con 0x7fdcb00cf800 2023-12-20T04:52:56.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.569+0000 7fdcaffff640 1 -- 172.21.15.132:0/3787760173 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcb00ceea0 con 0x7fdcb006eba0 2023-12-20T04:52:56.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.570+0000 7fdcaffff640 1 --2- 172.21.15.132:0/3787760173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb006eba0 0x7fdcb00cdde0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009850 tx=0x7fdca002b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a6eed61a78a8391 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:56.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.570+0000 7fdcaeffd640 1 -- 172.21.15.132:0/3787760173 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0004230 con 0x7fdcb006eba0 2023-12-20T04:52:56.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.570+0000 7fdcaeffd640 1 -- 172.21.15.132:0/3787760173 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca0004390 con 0x7fdcb006eba0 2023-12-20T04:52:56.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.570+0000 7fdcaeffd640 1 -- 172.21.15.132:0/3787760173 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0003810 con 0x7fdcb006eba0 2023-12-20T04:52:56.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.570+0000 7fdcb64af640 1 -- 172.21.15.132:0/3787760173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb006eba0 msgr2=0x7fdcb00cdde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:56.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.570+0000 7fdcb64af640 1 --2- 172.21.15.132:0/3787760173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb006eba0 0x7fdcb00cdde0 secure :-1 s=READY pgs=1755 cs=0 l=1 rev1=1 crypto rx=0x7fdca0009850 tx=0x7fdca002b8f0 comp rx=0 tx=0).stop 2023-12-20T04:52:56.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.571+0000 7fdcb64af640 1 -- 172.21.15.132:0/3787760173 shutdown_connections 2023-12-20T04:52:56.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.571+0000 7fdcb64af640 1 --2- 172.21.15.132:0/3787760173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb006eba0 0x7fdcb00cdde0 unknown :-1 s=CLOSED pgs=1755 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:56.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.571+0000 7fdcb64af640 1 -- 172.21.15.132:0/3787760173 >> 172.21.15.132:0/3787760173 conn(0x7fdcb0099fa0 msgr2=0x7fdcb00d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:56.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.571+0000 7fdcb64af640 1 -- 172.21.15.132:0/3787760173 shutdown_connections 2023-12-20T04:52:56.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.571+0000 7fdcb64af640 1 -- 172.21.15.132:0/3787760173 wait complete. 2023-12-20T04:52:56.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.572+0000 7fdcb64af640 1 Processor -- start 2023-12-20T04:52:56.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.572+0000 7fdcb64af640 1 -- start start 2023-12-20T04:52:56.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcb64af640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb006eba0 0x7fdcb00c4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:56.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcb64af640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcb00cea10 0x7fdcb00c8610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:56.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcb64af640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcb00cf800 0x7fdcb00ca270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:56.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcb64af640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb0154700 con 0x7fdcb006eba0 2023-12-20T04:52:56.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcb64af640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00c6ee0 con 0x7fdcb00cf800 2023-12-20T04:52:56.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcb64af640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fdcb00c7780 con 0x7fdcb00cea10 2023-12-20T04:52:56.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcaffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb006eba0 0x7fdcb00c4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:56.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcaffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb006eba0 0x7fdcb00c4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:52416/0 (socket says 172.21.15.132:52416) 2023-12-20T04:52:56.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcaffff640 1 -- 172.21.15.132:0/4155143567 learned_addr learned my addr 172.21.15.132:0/4155143567 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:56.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcb4a4c640 1 --2- 172.21.15.132:0/4155143567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcb00cf800 0x7fdcb00ca270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:56.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcaf7fe640 1 --2- 172.21.15.132:0/4155143567 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcb00cea10 0x7fdcb00c8610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:56.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcaffff640 1 -- 172.21.15.132:0/4155143567 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcb00cea10 msgr2=0x7fdcb00c8610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:56.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcaffff640 1 --2- 172.21.15.132:0/4155143567 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcb00cea10 0x7fdcb00c8610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:56.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcaffff640 1 -- 172.21.15.132:0/4155143567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcb00cf800 msgr2=0x7fdcb00ca270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:56.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcaffff640 1 --2- 172.21.15.132:0/4155143567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcb00cf800 0x7fdcb00ca270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:56.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcaffff640 1 -- 172.21.15.132:0/4155143567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdca0009460 con 0x7fdcb006eba0 2023-12-20T04:52:56.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcaffff640 1 --2- 172.21.15.132:0/4155143567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb006eba0 0x7fdcb00c4760 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fdca00090b0 tx=0x7fdca00046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:56.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcacff9640 1 -- 172.21.15.132:0/4155143567 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0003c40 con 0x7fdcb006eba0 2023-12-20T04:52:56.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcacff9640 1 -- 172.21.15.132:0/4155143567 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fdca003f070 con 0x7fdcb006eba0 2023-12-20T04:52:56.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcacff9640 1 -- 172.21.15.132:0/4155143567 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fdca0006040 con 0x7fdcb006eba0 2023-12-20T04:52:56.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcb64af640 1 -- 172.21.15.132:0/4155143567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdcb00c4d40 con 0x7fdcb006eba0 2023-12-20T04:52:56.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.573+0000 7fdcb64af640 1 -- 172.21.15.132:0/4155143567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdcb00c7410 con 0x7fdcb006eba0 2023-12-20T04:52:56.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.574+0000 7fdcb64af640 1 -- 172.21.15.132:0/4155143567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdcb004e840 con 0x7fdcb006eba0 2023-12-20T04:52:56.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.575+0000 7fdcacff9640 1 -- 172.21.15.132:0/4155143567 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fdca0041030 con 0x7fdcb006eba0 2023-12-20T04:52:56.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.575+0000 7fdcacff9640 1 --2- 172.21.15.132:0/4155143567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc9c06a430 0x7fdc9c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:56.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.575+0000 7fdcacff9640 1 -- 172.21.15.132:0/4155143567 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(176..176 src has 1..176) v4 ==== 5386+0+0 (secure 0 0 0) 0x7fdca00aab80 con 0x7fdcb006eba0 2023-12-20T04:52:56.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.575+0000 7fdcaf7fe640 1 --2- 172.21.15.132:0/4155143567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc9c06a430 0x7fdc9c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:56.579 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.576+0000 7fdcaf7fe640 1 --2- 172.21.15.132:0/4155143567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc9c06a430 0x7fdc9c06c8f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fdcb01548f0 tx=0x7fdca4009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:56.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.579+0000 7fdcacff9640 1 -- 172.21.15.132:0/4155143567 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fdca0076340 con 0x7fdcb006eba0 2023-12-20T04:52:56.750 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:56.748+0000 7fdcb64af640 1 -- 172.21.15.132:0/4155143567 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7fdcb004e840 con 0x7fdcb006eba0 2023-12-20T04:52:57.450 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.448+0000 7fdcacff9640 1 -- 172.21.15.132:0/4155143567 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v177) v1 ==== 169+0+0 (secure 0 0 0) 0x7fdca00061a0 con 0x7fdcb006eba0 2023-12-20T04:52:57.450 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2023-12-20T04:52:57.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.452+0000 7fdcb64af640 1 -- 172.21.15.132:0/4155143567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc9c06a430 msgr2=0x7fdc9c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:57.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.452+0000 7fdcb64af640 1 --2- 172.21.15.132:0/4155143567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc9c06a430 0x7fdc9c06c8f0 secure :-1 s=READY pgs=738 cs=0 l=1 rev1=1 crypto rx=0x7fdcb01548f0 tx=0x7fdca4009040 comp rx=0 tx=0).stop 2023-12-20T04:52:57.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.452+0000 7fdcb64af640 1 -- 172.21.15.132:0/4155143567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb006eba0 msgr2=0x7fdcb00c4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:57.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.452+0000 7fdcb64af640 1 --2- 172.21.15.132:0/4155143567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb006eba0 0x7fdcb00c4760 secure :-1 s=READY pgs=1756 cs=0 l=1 rev1=1 crypto rx=0x7fdca00090b0 tx=0x7fdca00046c0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.452+0000 7fdcb64af640 1 -- 172.21.15.132:0/4155143567 shutdown_connections 2023-12-20T04:52:57.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.452+0000 7fdcb64af640 1 --2- 172.21.15.132:0/4155143567 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fdc9c06a430 0x7fdc9c06c8f0 unknown :-1 s=CLOSED pgs=738 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.452+0000 7fdcb64af640 1 --2- 172.21.15.132:0/4155143567 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fdcb00cf800 0x7fdcb00ca270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.452+0000 7fdcb64af640 1 --2- 172.21.15.132:0/4155143567 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fdcb00cea10 0x7fdcb00c8610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.452+0000 7fdcb64af640 1 --2- 172.21.15.132:0/4155143567 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fdcb006eba0 0x7fdcb00c4760 unknown :-1 s=CLOSED pgs=1756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.452+0000 7fdcb64af640 1 -- 172.21.15.132:0/4155143567 >> 172.21.15.132:0/4155143567 conn(0x7fdcb0099fa0 msgr2=0x7fdcb006d220 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:57.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.452+0000 7fdcb64af640 1 -- 172.21.15.132:0/4155143567 shutdown_connections 2023-12-20T04:52:57.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.452+0000 7fdcb64af640 1 -- 172.21.15.132:0/4155143567 wait complete. 2023-12-20T04:52:57.467 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-20T04:52:57.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.571+0000 7fc28a85b640 1 Processor -- start 2023-12-20T04:52:57.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.571+0000 7fc28a85b640 1 -- start start 2023-12-20T04:52:57.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.571+0000 7fc28a85b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc2840cf880 0x7fc2840cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:57.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.572+0000 7fc28a85b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2840b60e0 0x7fc2840b6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:57.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.572+0000 7fc28a85b640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc2840d1a90 con 0x7fc28415d300 2023-12-20T04:52:57.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.572+0000 7fc28a85b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc2840d0250 con 0x7fc2840cf880 2023-12-20T04:52:57.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.572+0000 7fc28a85b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2840d1d70 con 0x7fc2840b60e0 2023-12-20T04:52:57.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.572+0000 7fc2837fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc2840cf880 0x7fc2840cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:57.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.572+0000 7fc283fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc28415d300 0x7fc2840d1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38572/0 (socket says 172.21.15.132:38572) 2023-12-20T04:52:57.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.572+0000 7fc283fff640 1 -- 172.21.15.132:0/821367109 learned_addr learned my addr 172.21.15.132:0/821367109 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:52:57.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.572+0000 7fc2837fe640 1 -- 172.21.15.132:0/821367109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2840b60e0 msgr2=0x7fc2840b6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:57.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.572+0000 7fc2837fe640 1 --2- 172.21.15.132:0/821367109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2840b60e0 0x7fc2840b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.572+0000 7fc2837fe640 1 -- 172.21.15.132:0/821367109 >> v1:172.21.15.132:6789/0 conn(0x7fc28415d300 legacy=0x7fc2840d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:57.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.572+0000 7fc282ffd640 1 -- 172.21.15.132:0/821367109 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1805148328 0 0) 0x7fc2840d1a90 con 0x7fc28415d300 2023-12-20T04:52:57.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.572+0000 7fc2837fe640 1 -- 172.21.15.132:0/821367109 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2840d2050 con 0x7fc2840cf880 2023-12-20T04:52:57.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.573+0000 7fc2837fe640 1 --2- 172.21.15.132:0/821367109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2840cf880 0x7fc2840cfd10 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fc278009790 tx=0x7fc27802b8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcafb833ba15b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:57.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.573+0000 7fc282ffd640 1 -- 172.21.15.132:0/821367109 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc278031800 con 0x7fc2840cf880 2023-12-20T04:52:57.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.573+0000 7fc282ffd640 1 -- 172.21.15.132:0/821367109 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc278031960 con 0x7fc2840cf880 2023-12-20T04:52:57.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.573+0000 7fc282ffd640 1 -- 172.21.15.132:0/821367109 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc278031cf0 con 0x7fc2840cf880 2023-12-20T04:52:57.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.573+0000 7fc28a85b640 1 -- 172.21.15.132:0/821367109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2840cf880 msgr2=0x7fc2840cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:57.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.573+0000 7fc28a85b640 1 --2- 172.21.15.132:0/821367109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2840cf880 0x7fc2840cfd10 secure :-1 s=READY pgs=1758 cs=0 l=1 rev1=1 crypto rx=0x7fc278009790 tx=0x7fc27802b8a0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.573+0000 7fc28a85b640 1 -- 172.21.15.132:0/821367109 shutdown_connections 2023-12-20T04:52:57.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.573+0000 7fc28a85b640 1 --2- 172.21.15.132:0/821367109 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2840b60e0 0x7fc2840b6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.573+0000 7fc28a85b640 1 --2- 172.21.15.132:0/821367109 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc2840cf880 0x7fc2840cfd10 unknown :-1 s=CLOSED pgs=1758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.573+0000 7fc28a85b640 1 -- 172.21.15.132:0/821367109 >> 172.21.15.132:0/821367109 conn(0x7fc28406a3d0 msgr2=0x7fc28406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:57.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.573+0000 7fc28a85b640 1 -- 172.21.15.132:0/821367109 shutdown_connections 2023-12-20T04:52:57.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.573+0000 7fc28a85b640 1 -- 172.21.15.132:0/821367109 wait complete. 2023-12-20T04:52:57.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.575+0000 7fc28a85b640 1 Processor -- start 2023-12-20T04:52:57.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.575+0000 7fc28a85b640 1 -- start start 2023-12-20T04:52:57.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.575+0000 7fc28a85b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc2840b60e0 0x7fc2841f2310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:57.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.575+0000 7fc28a85b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2840cf880 0x7fc2840c6860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:57.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.575+0000 7fc28a85b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc28415d300 0x7fc2840c41a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:57.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.575+0000 7fc28a85b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2841e74a0 con 0x7fc28415d300 2023-12-20T04:52:57.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.575+0000 7fc28a85b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2841e6400 con 0x7fc2840b60e0 2023-12-20T04:52:57.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.575+0000 7fc28a85b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc2841e66e0 con 0x7fc2840cf880 2023-12-20T04:52:57.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.576+0000 7fc288df8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc28415d300 0x7fc2840c41a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:57.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.576+0000 7fc288df8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc28415d300 0x7fc2840c41a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59088/0 (socket says 172.21.15.132:59088) 2023-12-20T04:52:57.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.576+0000 7fc288df8640 1 -- 172.21.15.132:0/1079574492 learned_addr learned my addr 172.21.15.132:0/1079574492 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:57.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.576+0000 7fc2837fe640 1 --2- 172.21.15.132:0/1079574492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2840cf880 0x7fc2840c6860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:57.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.576+0000 7fc283fff640 1 --2- 172.21.15.132:0/1079574492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc2840b60e0 0x7fc2841f2310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:57.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.576+0000 7fc288df8640 1 -- 172.21.15.132:0/1079574492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2840cf880 msgr2=0x7fc2840c6860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:57.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.576+0000 7fc288df8640 1 --2- 172.21.15.132:0/1079574492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2840cf880 0x7fc2840c6860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.576+0000 7fc288df8640 1 -- 172.21.15.132:0/1079574492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc2840b60e0 msgr2=0x7fc2841f2310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:57.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.576+0000 7fc288df8640 1 --2- 172.21.15.132:0/1079574492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc2840b60e0 0x7fc2841f2310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.576+0000 7fc288df8640 1 -- 172.21.15.132:0/1079574492 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc2780093a0 con 0x7fc28415d300 2023-12-20T04:52:57.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.576+0000 7fc288df8640 1 --2- 172.21.15.132:0/1079574492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc28415d300 0x7fc2840c41a0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00b970 tx=0x7fc27c00be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:57.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.576+0000 7fc280ff9640 1 -- 172.21.15.132:0/1079574492 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c00cb40 con 0x7fc28415d300 2023-12-20T04:52:57.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.576+0000 7fc280ff9640 1 -- 172.21.15.132:0/1079574492 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc27c00ccc0 con 0x7fc28415d300 2023-12-20T04:52:57.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.576+0000 7fc280ff9640 1 -- 172.21.15.132:0/1079574492 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc27c014680 con 0x7fc28415d300 2023-12-20T04:52:57.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.576+0000 7fc28a85b640 1 -- 172.21.15.132:0/1079574492 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2841e69c0 con 0x7fc28415d300 2023-12-20T04:52:57.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.576+0000 7fc28a85b640 1 -- 172.21.15.132:0/1079574492 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2841e6f80 con 0x7fc28415d300 2023-12-20T04:52:57.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.577+0000 7fc28a85b640 1 -- 172.21.15.132:0/1079574492 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2841e7170 con 0x7fc28415d300 2023-12-20T04:52:57.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.578+0000 7fc280ff9640 1 -- 172.21.15.132:0/1079574492 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc27c01d3b0 con 0x7fc28415d300 2023-12-20T04:52:57.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.578+0000 7fc280ff9640 1 --2- 172.21.15.132:0/1079574492 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc27006a430 0x7fc27006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:57.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.578+0000 7fc280ff9640 1 -- 172.21.15.132:0/1079574492 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc27c088550 con 0x7fc28415d300 2023-12-20T04:52:57.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.578+0000 7fc283fff640 1 --2- 172.21.15.132:0/1079574492 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc27006a430 0x7fc27006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:57.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.578+0000 7fc283fff640 1 --2- 172.21.15.132:0/1079574492 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc27006a430 0x7fc27006c8f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc274007fd0 tx=0x7fc274007de0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:57.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.582+0000 7fc280ff9640 1 -- 172.21.15.132:0/1079574492 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc27c053e60 con 0x7fc28415d300 2023-12-20T04:52:57.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.751+0000 7fc28a85b640 1 -- 172.21.15.132:0/1079574492 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7fc28404e840 con 0x7fc28415d300 2023-12-20T04:52:57.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.755+0000 7fc280ff9640 1 -- 172.21.15.132:0/1079574492 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v19) v1 ==== 104+0+0 (secure 0 0 0) 0x7fc27c0190a0 con 0x7fc28415d300 2023-12-20T04:52:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.757+0000 7fc28a85b640 1 -- 172.21.15.132:0/1079574492 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc27006a430 msgr2=0x7fc27006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.757+0000 7fc28a85b640 1 --2- 172.21.15.132:0/1079574492 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc27006a430 0x7fc27006c8f0 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7fc274007fd0 tx=0x7fc274007de0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.757+0000 7fc28a85b640 1 -- 172.21.15.132:0/1079574492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc28415d300 msgr2=0x7fc2840c41a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.757+0000 7fc28a85b640 1 --2- 172.21.15.132:0/1079574492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc28415d300 0x7fc2840c41a0 secure :-1 s=READY pgs=1759 cs=0 l=1 rev1=1 crypto rx=0x7fc27c00b970 tx=0x7fc27c00be30 comp rx=0 tx=0).stop 2023-12-20T04:52:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.757+0000 7fc28a85b640 1 -- 172.21.15.132:0/1079574492 shutdown_connections 2023-12-20T04:52:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.757+0000 7fc28a85b640 1 --2- 172.21.15.132:0/1079574492 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc27006a430 0x7fc27006c8f0 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.757+0000 7fc28a85b640 1 --2- 172.21.15.132:0/1079574492 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc28415d300 0x7fc2840c41a0 unknown :-1 s=CLOSED pgs=1759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.757+0000 7fc28a85b640 1 --2- 172.21.15.132:0/1079574492 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc2840cf880 0x7fc2840c6860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.757+0000 7fc28a85b640 1 --2- 172.21.15.132:0/1079574492 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc2840b60e0 0x7fc2841f2310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.757+0000 7fc28a85b640 1 -- 172.21.15.132:0/1079574492 >> 172.21.15.132:0/1079574492 conn(0x7fc28406a3d0 msgr2=0x7fc2841594d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.758+0000 7fc28a85b640 1 -- 172.21.15.132:0/1079574492 shutdown_connections 2023-12-20T04:52:57.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.758+0000 7fc28a85b640 1 -- 172.21.15.132:0/1079574492 wait complete. 2023-12-20T04:52:57.771 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync' 2023-12-20T04:52:57.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.869+0000 7f8694c4a640 1 Processor -- start 2023-12-20T04:52:57.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.869+0000 7f8694c4a640 1 -- start start 2023-12-20T04:52:57.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.869+0000 7f8694c4a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86900b4980 0x7f86900b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:57.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.869+0000 7f8694c4a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86900b5320 con 0x7f86900d1aa0 2023-12-20T04:52:57.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.869+0000 7f8694c4a640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f86900b5ec0 con 0x7f8690160450 2023-12-20T04:52:57.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.869+0000 7f8694c4a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f86901617e0 con 0x7f86900b4980 2023-12-20T04:52:57.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868ed9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f86900d1aa0 0x7f86900d1f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38574/0 (socket says 172.21.15.132:38574) 2023-12-20T04:52:57.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868ed9d640 1 -- 172.21.15.132:0/3838305546 learned_addr learned my addr 172.21.15.132:0/3838305546 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:52:57.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f8687fff640 1 --2- 172.21.15.132:0/3838305546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86900b4980 0x7f86900b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:57.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868dd9b640 1 -- 172.21.15.132:0/3838305546 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 518029370 0 0) 0x7f86900b5320 con 0x7f86900d1aa0 2023-12-20T04:52:57.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868dd9b640 1 -- 172.21.15.132:0/3838305546 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f867c003520 con 0x7f86900d1aa0 2023-12-20T04:52:57.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868dd9b640 1 -- 172.21.15.132:0/3838305546 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3818899453 0 0) 0x7f86900b5ec0 con 0x7f8690160450 2023-12-20T04:52:57.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868dd9b640 1 -- 172.21.15.132:0/3838305546 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f86900b5320 con 0x7f8690160450 2023-12-20T04:52:57.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868dd9b640 1 -- 172.21.15.132:0/3838305546 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 918837282 0 0) 0x7f867c003520 con 0x7f86900d1aa0 2023-12-20T04:52:57.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868dd9b640 1 -- 172.21.15.132:0/3838305546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86900b4980 msgr2=0x7f86900b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:57.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868dd9b640 1 --2- 172.21.15.132:0/3838305546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86900b4980 0x7f86900b4de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868dd9b640 1 -- 172.21.15.132:0/3838305546 >> v1:172.21.15.187:6789/0 conn(0x7f8690160450 legacy=0x7f8690160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:57.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868dd9b640 1 -- 172.21.15.132:0/3838305546 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86900d0fc0 con 0x7f86900d1aa0 2023-12-20T04:52:57.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868dd9b640 1 -- 172.21.15.132:0/3838305546 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f86880019f0 con 0x7f86900d1aa0 2023-12-20T04:52:57.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868dd9b640 1 -- 172.21.15.132:0/3838305546 >> v1:172.21.15.132:6789/0 conn(0x7f86900d1aa0 legacy=0x7f86900d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:57.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868dd9b640 1 --2- 172.21.15.132:0/3838305546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f867c003b30 0x7f867c003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:57.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868dd9b640 1 --2- 172.21.15.132:0/3838305546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f867c0047c0 0x7f867c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:57.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868dd9b640 1 --2- 172.21.15.132:0/3838305546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86900b4980 0x7f867c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:57.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868dd9b640 1 -- 172.21.15.132:0/3838305546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86901617e0 con 0x7f867c0047c0 2023-12-20T04:52:57.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868dd9b640 1 -- 172.21.15.132:0/3838305546 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f867c00ba30 con 0x7f867c003b30 2023-12-20T04:52:57.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868dd9b640 1 -- 172.21.15.132:0/3838305546 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f867c00bbf0 con 0x7f86900b4980 2023-12-20T04:52:57.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f8687fff640 1 --2- 172.21.15.132:0/3838305546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f867c0047c0 0x7f867c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:57.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868e59c640 1 --2- 172.21.15.132:0/3838305546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f867c003b30 0x7f867c003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:57.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.870+0000 7f868ed9d640 1 --2- 172.21.15.132:0/3838305546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86900b4980 0x7f867c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:57.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.871+0000 7f8687fff640 1 -- 172.21.15.132:0/3838305546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86900b4980 msgr2=0x7f867c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:57.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.871+0000 7f8687fff640 1 --2- 172.21.15.132:0/3838305546 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f86900b4980 0x7f867c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.871+0000 7f8687fff640 1 -- 172.21.15.132:0/3838305546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f867c003b30 msgr2=0x7f867c003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:57.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.871+0000 7f8687fff640 1 --2- 172.21.15.132:0/3838305546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f867c003b30 0x7f867c003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.871+0000 7f8687fff640 1 -- 172.21.15.132:0/3838305546 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f867c003520 con 0x7f867c0047c0 2023-12-20T04:52:57.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.871+0000 7f868e59c640 1 --2- 172.21.15.132:0/3838305546 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f867c003b30 0x7f867c003f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:52:57.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.871+0000 7f8687fff640 1 --2- 172.21.15.132:0/3838305546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f867c0047c0 0x7f867c004c40 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f8678009ac0 tx=0x7f867c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfc93df6eae42050 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:57.876 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.871+0000 7f868dd9b640 1 -- 172.21.15.132:0/3838305546 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867802c6b0 con 0x7f867c0047c0 2023-12-20T04:52:57.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.871+0000 7f868dd9b640 1 -- 172.21.15.132:0/3838305546 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f867802c810 con 0x7f867c0047c0 2023-12-20T04:52:57.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.871+0000 7f868dd9b640 1 -- 172.21.15.132:0/3838305546 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f867802cba0 con 0x7f867c0047c0 2023-12-20T04:52:57.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.872+0000 7f8694c4a640 1 -- 172.21.15.132:0/3838305546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f867c0047c0 msgr2=0x7f867c004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:57.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.872+0000 7f8694c4a640 1 --2- 172.21.15.132:0/3838305546 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f867c0047c0 0x7f867c004c40 secure :-1 s=READY pgs=1761 cs=0 l=1 rev1=1 crypto rx=0x7f8678009ac0 tx=0x7f867c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.872+0000 7f868ed9d640 1 -- 172.21.15.132:0/3838305546 reap_dead start 2023-12-20T04:52:57.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.872+0000 7f8694c4a640 1 -- 172.21.15.132:0/3838305546 shutdown_connections 2023-12-20T04:52:57.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.872+0000 7f8694c4a640 1 -- 172.21.15.132:0/3838305546 >> 172.21.15.132:0/3838305546 conn(0x7f86900cf980 msgr2=0x7f86900cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:57.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.872+0000 7f8694c4a640 1 -- 172.21.15.132:0/3838305546 shutdown_connections 2023-12-20T04:52:57.877 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.872+0000 7f8694c4a640 1 -- 172.21.15.132:0/3838305546 wait complete. 2023-12-20T04:52:57.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.873+0000 7f8694c4a640 1 Processor -- start 2023-12-20T04:52:57.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.873+0000 7f8694c4a640 1 -- start start 2023-12-20T04:52:57.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.874+0000 7f8694c4a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f867c0047c0 0x7f869015e3b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:57.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.874+0000 7f8694c4a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8690157a40 0x7f86901f21c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:57.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.874+0000 7f8694c4a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f869015a9f0 0x7f869015ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:57.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.874+0000 7f8694c4a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f869015b3b0 con 0x7f867c0047c0 2023-12-20T04:52:57.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.874+0000 7f8694c4a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8690157ec0 con 0x7f8690157a40 2023-12-20T04:52:57.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.874+0000 7f8694c4a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f869015f610 con 0x7f869015a9f0 2023-12-20T04:52:57.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.874+0000 7f868e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f867c0047c0 0x7f869015e3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:57.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.874+0000 7f868e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f867c0047c0 0x7f869015e3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59096/0 (socket says 172.21.15.132:59096) 2023-12-20T04:52:57.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.874+0000 7f868e59c640 1 -- 172.21.15.132:0/484876468 learned_addr learned my addr 172.21.15.132:0/484876468 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:57.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.874+0000 7f868ed9d640 1 --2- 172.21.15.132:0/484876468 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f869015a9f0 0x7f869015ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:57.880 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.874+0000 7f8687fff640 1 --2- 172.21.15.132:0/484876468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8690157a40 0x7f86901f21c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.874+0000 7f868e59c640 1 -- 172.21.15.132:0/484876468 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f869015a9f0 msgr2=0x7f869015ae70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.874+0000 7f868e59c640 1 --2- 172.21.15.132:0/484876468 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f869015a9f0 0x7f869015ae70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.874+0000 7f868e59c640 1 -- 172.21.15.132:0/484876468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8690157a40 msgr2=0x7f86901f21c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.874+0000 7f868e59c640 1 --2- 172.21.15.132:0/484876468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8690157a40 0x7f86901f21c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.874+0000 7f868e59c640 1 -- 172.21.15.132:0/484876468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86901f2700 con 0x7f867c0047c0 2023-12-20T04:52:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.875+0000 7f868e59c640 1 --2- 172.21.15.132:0/484876468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f867c0047c0 0x7f869015e3b0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f868000e780 tx=0x7f868000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.875+0000 7f8686ffd640 1 -- 172.21.15.132:0/484876468 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680017070 con 0x7f867c0047c0 2023-12-20T04:52:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.875+0000 7f8686ffd640 1 -- 172.21.15.132:0/484876468 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f86800050d0 con 0x7f867c0047c0 2023-12-20T04:52:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.875+0000 7f8686ffd640 1 -- 172.21.15.132:0/484876468 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8680005240 con 0x7f867c0047c0 2023-12-20T04:52:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.875+0000 7f8694c4a640 1 -- 172.21.15.132:0/484876468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8690149980 con 0x7f867c0047c0 2023-12-20T04:52:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.875+0000 7f8694c4a640 1 -- 172.21.15.132:0/484876468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f869015ece0 con 0x7f867c0047c0 2023-12-20T04:52:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.876+0000 7f8694c4a640 1 -- 172.21.15.132:0/484876468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f869004e840 con 0x7f867c0047c0 2023-12-20T04:52:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.876+0000 7f8686ffd640 1 -- 172.21.15.132:0/484876468 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8680007020 con 0x7f867c0047c0 2023-12-20T04:52:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.877+0000 7f8686ffd640 1 --2- 172.21.15.132:0/484876468 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f867006a430 0x7f867006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:57.881 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.877+0000 7f8686ffd640 1 -- 172.21.15.132:0/484876468 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8680087eb0 con 0x7f867c0047c0 2023-12-20T04:52:57.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.877+0000 7f8687fff640 1 --2- 172.21.15.132:0/484876468 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f867006a430 0x7f867006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:57.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.877+0000 7f8687fff640 1 --2- 172.21.15.132:0/484876468 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f867006a430 0x7f867006c8f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8678036000 tx=0x7f8678030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:57.882 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:57.881+0000 7f8686ffd640 1 -- 172.21.15.132:0/484876468 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f86800537a0 con 0x7f867c0047c0 2023-12-20T04:52:58.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.109+0000 7f8694c4a640 1 -- 172.21.15.132:0/484876468 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]} v 0) v1 -- 0x7f86900d0ad0 con 0x7f867c0047c0 2023-12-20T04:52:58.451 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.449+0000 7f8686ffd640 1 -- 172.21.15.132:0/484876468 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_fsync"]}]=0 v486) v1 ==== 131+0+0 (secure 0 0 0) 0x7f8680056dc0 con 0x7f867c0047c0 2023-12-20T04:52:58.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.451+0000 7f8694c4a640 1 -- 172.21.15.132:0/484876468 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f867006a430 msgr2=0x7f867006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:58.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.451+0000 7f8694c4a640 1 --2- 172.21.15.132:0/484876468 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f867006a430 0x7f867006c8f0 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8678036000 tx=0x7f8678030000 comp rx=0 tx=0).stop 2023-12-20T04:52:58.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.451+0000 7f8694c4a640 1 -- 172.21.15.132:0/484876468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f867c0047c0 msgr2=0x7f869015e3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:58.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.451+0000 7f8694c4a640 1 --2- 172.21.15.132:0/484876468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f867c0047c0 0x7f869015e3b0 secure :-1 s=READY pgs=1762 cs=0 l=1 rev1=1 crypto rx=0x7f868000e780 tx=0x7f868000ec40 comp rx=0 tx=0).stop 2023-12-20T04:52:58.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.451+0000 7f8694c4a640 1 -- 172.21.15.132:0/484876468 shutdown_connections 2023-12-20T04:52:58.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.451+0000 7f8694c4a640 1 --2- 172.21.15.132:0/484876468 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f867006a430 0x7f867006c8f0 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:58.453 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.451+0000 7f8694c4a640 1 --2- 172.21.15.132:0/484876468 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f869015a9f0 0x7f869015ae70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:58.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.451+0000 7f8694c4a640 1 --2- 172.21.15.132:0/484876468 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8690157a40 0x7f86901f21c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:58.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.451+0000 7f8694c4a640 1 --2- 172.21.15.132:0/484876468 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f867c0047c0 0x7f869015e3b0 unknown :-1 s=CLOSED pgs=1762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:58.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.451+0000 7f8694c4a640 1 -- 172.21.15.132:0/484876468 >> 172.21.15.132:0/484876468 conn(0x7f86900cf980 msgr2=0x7f86900b79c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:58.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.451+0000 7f8694c4a640 1 -- 172.21.15.132:0/484876468 shutdown_connections 2023-12-20T04:52:58.454 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.451+0000 7f8694c4a640 1 -- 172.21.15.132:0/484876468 wait complete. 2023-12-20T04:52:58.464 INFO:tasks.cephfs_test_runner:That when the full flag is encountered during asynchronous ... ok 2023-12-20T04:52:58.465 INFO:tasks.cephfs_test_runner:Starting test: test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) 2023-12-20T04:52:58.465 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-12-20T04:52:58.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.563+0000 7f2c2133e640 1 Processor -- start 2023-12-20T04:52:58.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.563+0000 7f2c2133e640 1 -- start start 2023-12-20T04:52:58.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.564+0000 7f2c2133e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f2c1c15d050 0x7f2c1c0c6150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:58.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.564+0000 7f2c2133e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c1c0c6690 0x7f2c1c069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:58.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.564+0000 7f2c2133e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2c1c06a170 0x7f2c1c0c4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.564+0000 7f2c2133e640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1c06a600 con 0x7f2c1c06a170 2023-12-20T04:52:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.564+0000 7f2c2133e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f2c1c0708d0 con 0x7f2c1c15d050 2023-12-20T04:52:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.564+0000 7f2c2133e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c070bb0 con 0x7f2c1c0c6690 2023-12-20T04:52:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.564+0000 7f2c1b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2c1c06a170 0x7f2c1c0c4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.564+0000 7f2c1b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f2c1c06a170 0x7f2c1c0c4ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59106/0 (socket says 172.21.15.132:59106) 2023-12-20T04:52:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.564+0000 7f2c1b7fe640 1 -- 172.21.15.132:0/3452785048 learned_addr learned my addr 172.21.15.132:0/3452785048 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.564+0000 7f2c1affd640 1 --2- 172.21.15.132:0/3452785048 >> v2:172.21.15.187:3300/0 conn(0x7f2c1c15d050 0x7f2c1c0c6150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.564+0000 7f2c127fc640 1 --2- 172.21.15.132:0/3452785048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c1c0c6690 0x7f2c1c069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.565+0000 7f2c1b7fe640 1 -- 172.21.15.132:0/3452785048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c1c0c6690 msgr2=0x7f2c1c069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.565+0000 7f2c1b7fe640 1 --2- 172.21.15.132:0/3452785048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c1c0c6690 0x7f2c1c069c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.565+0000 7f2c1b7fe640 1 -- 172.21.15.132:0/3452785048 >> v2:172.21.15.187:3300/0 conn(0x7f2c1c15d050 msgr2=0x7f2c1c0c6150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.565+0000 7f2c1b7fe640 1 --2- 172.21.15.132:0/3452785048 >> v2:172.21.15.187:3300/0 conn(0x7f2c1c15d050 0x7f2c1c0c6150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.565+0000 7f2c1b7fe640 1 -- 172.21.15.132:0/3452785048 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c1c070e90 con 0x7f2c1c06a170 2023-12-20T04:52:58.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.565+0000 7f2c1affd640 1 --2- 172.21.15.132:0/3452785048 >> v2:172.21.15.187:3300/0 conn(0x7f2c1c15d050 0x7f2c1c0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:52:58.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.565+0000 7f2c127fc640 1 --2- 172.21.15.132:0/3452785048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c1c0c6690 0x7f2c1c069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:52:58.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.565+0000 7f2c1b7fe640 1 --2- 172.21.15.132:0/3452785048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c1c06a170 0x7f2c1c0c4ea0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c071970 tx=0x7f2c1402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6d77fb2a0a36d0ac server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:58.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.565+0000 7f2c1a7fc640 1 -- 172.21.15.132:0/3452785048 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c1402ca70 con 0x7f2c1c06a170 2023-12-20T04:52:58.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.566+0000 7f2c1a7fc640 1 -- 172.21.15.132:0/3452785048 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c1402cbd0 con 0x7f2c1c06a170 2023-12-20T04:52:58.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.566+0000 7f2c1a7fc640 1 -- 172.21.15.132:0/3452785048 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c140343f0 con 0x7f2c1c06a170 2023-12-20T04:52:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.566+0000 7f2c2133e640 1 -- 172.21.15.132:0/3452785048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c1c06a170 msgr2=0x7f2c1c0c4ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.566+0000 7f2c2133e640 1 --2- 172.21.15.132:0/3452785048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c1c06a170 0x7f2c1c0c4ea0 secure :-1 s=READY pgs=1763 cs=0 l=1 rev1=1 crypto rx=0x7f2c1c071970 tx=0x7f2c1402bed0 comp rx=0 tx=0).stop 2023-12-20T04:52:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.566+0000 7f2c2133e640 1 -- 172.21.15.132:0/3452785048 shutdown_connections 2023-12-20T04:52:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.566+0000 7f2c2133e640 1 --2- 172.21.15.132:0/3452785048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c1c06a170 0x7f2c1c0c4ea0 unknown :-1 s=CLOSED pgs=1763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.566+0000 7f2c2133e640 1 --2- 172.21.15.132:0/3452785048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c1c0c6690 0x7f2c1c069c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.566+0000 7f2c2133e640 1 --2- 172.21.15.132:0/3452785048 >> v2:172.21.15.187:3300/0 conn(0x7f2c1c15d050 0x7f2c1c0c6150 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.566+0000 7f2c2133e640 1 -- 172.21.15.132:0/3452785048 >> 172.21.15.132:0/3452785048 conn(0x7f2c1c0cfb10 msgr2=0x7f2c1c0cfef0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.566+0000 7f2c2133e640 1 -- 172.21.15.132:0/3452785048 shutdown_connections 2023-12-20T04:52:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.566+0000 7f2c2133e640 1 -- 172.21.15.132:0/3452785048 wait complete. 2023-12-20T04:52:58.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.567+0000 7f2c2133e640 1 Processor -- start 2023-12-20T04:52:58.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.567+0000 7f2c2133e640 1 -- start start 2023-12-20T04:52:58.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c2133e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c1c06a170 0x7f2c1c0b31b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:58.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c2133e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c1c0c6690 0x7f2c1c1501f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:58.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c2133e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c1c15d050 0x7f2c1c0b4ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:58.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c2133e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c0b53e0 con 0x7f2c1c0c6690 2023-12-20T04:52:58.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c2133e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c150860 con 0x7f2c1c15d050 2023-12-20T04:52:58.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c2133e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f2c1c152c20 con 0x7f2c1c06a170 2023-12-20T04:52:58.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c127fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c1c0c6690 0x7f2c1c1501f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:58.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c127fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c1c0c6690 0x7f2c1c1501f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59118/0 (socket says 172.21.15.132:59118) 2023-12-20T04:52:58.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c127fc640 1 -- 172.21.15.132:0/1281982030 learned_addr learned my addr 172.21.15.132:0/1281982030 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:58.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c1affd640 1 --2- 172.21.15.132:0/1281982030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c1c06a170 0x7f2c1c0b31b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:58.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c127fc640 1 -- 172.21.15.132:0/1281982030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c1c06a170 msgr2=0x7f2c1c0b31b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:58.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c1b7fe640 1 --2- 172.21.15.132:0/1281982030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c1c15d050 0x7f2c1c0b4ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:58.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c127fc640 1 --2- 172.21.15.132:0/1281982030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c1c06a170 0x7f2c1c0b31b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:58.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c127fc640 1 -- 172.21.15.132:0/1281982030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c1c15d050 msgr2=0x7f2c1c0b4ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:58.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c127fc640 1 --2- 172.21.15.132:0/1281982030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c1c15d050 0x7f2c1c0b4ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:58.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c127fc640 1 -- 172.21.15.132:0/1281982030 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c14009b30 con 0x7f2c1c0c6690 2023-12-20T04:52:58.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c1affd640 1 --2- 172.21.15.132:0/1281982030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c1c06a170 0x7f2c1c0b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:52:58.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.568+0000 7f2c1b7fe640 1 --2- 172.21.15.132:0/1281982030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c1c15d050 0x7f2c1c0b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:52:58.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.569+0000 7f2c127fc640 1 --2- 172.21.15.132:0/1281982030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c1c0c6690 0x7f2c1c1501f0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400e810 tx=0x7f2c0400ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:58.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.569+0000 7f2c13fff640 1 -- 172.21.15.132:0/1281982030 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04004030 con 0x7f2c1c0c6690 2023-12-20T04:52:58.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.569+0000 7f2c13fff640 1 -- 172.21.15.132:0/1281982030 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2c04004190 con 0x7f2c1c0c6690 2023-12-20T04:52:58.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.569+0000 7f2c2133e640 1 -- 172.21.15.132:0/1281982030 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c1c0b3870 con 0x7f2c1c0c6690 2023-12-20T04:52:58.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.569+0000 7f2c13fff640 1 -- 172.21.15.132:0/1281982030 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2c04004520 con 0x7f2c1c0c6690 2023-12-20T04:52:58.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.569+0000 7f2c2133e640 1 -- 172.21.15.132:0/1281982030 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c1c0b3e30 con 0x7f2c1c0c6690 2023-12-20T04:52:58.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.570+0000 7f2c2133e640 1 -- 172.21.15.132:0/1281982030 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c1c0704f0 con 0x7f2c1c0c6690 2023-12-20T04:52:58.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.570+0000 7f2c13fff640 1 -- 172.21.15.132:0/1281982030 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2c0400c6d0 con 0x7f2c1c0c6690 2023-12-20T04:52:58.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.570+0000 7f2c13fff640 1 --2- 172.21.15.132:0/1281982030 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2bfc06a430 0x7f2bfc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:58.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.571+0000 7f2c13fff640 1 -- 172.21.15.132:0/1281982030 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f2c040881e0 con 0x7f2c1c0c6690 2023-12-20T04:52:58.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.571+0000 7f2c1affd640 1 --2- 172.21.15.132:0/1281982030 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2bfc06a430 0x7f2bfc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:58.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.571+0000 7f2c1affd640 1 --2- 172.21.15.132:0/1281982030 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2bfc06a430 0x7f2bfc06c8f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c006fd0 tx=0x7f2c0c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:58.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.575+0000 7f2c13fff640 1 -- 172.21.15.132:0/1281982030 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f2c04053a50 con 0x7f2c1c0c6690 2023-12-20T04:52:58.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:58.802+0000 7f2c2133e640 1 -- 172.21.15.132:0/1281982030 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f2c1c04e840 con 0x7f2c1c0c6690 2023-12-20T04:52:59.452 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.450+0000 7f2c13fff640 1 -- 172.21.15.132:0/1281982030 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Starting test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v487) v1 ==== 138+0+0 (secure 0 0 0) 0x7f2c04057070 con 0x7f2c1c0c6690 2023-12-20T04:52:59.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.452+0000 7f2c2133e640 1 -- 172.21.15.132:0/1281982030 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2bfc06a430 msgr2=0x7f2bfc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:59.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.452+0000 7f2c2133e640 1 --2- 172.21.15.132:0/1281982030 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2bfc06a430 0x7f2bfc06c8f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f2c0c006fd0 tx=0x7f2c0c008040 comp rx=0 tx=0).stop 2023-12-20T04:52:59.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.453+0000 7f2c2133e640 1 -- 172.21.15.132:0/1281982030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c1c0c6690 msgr2=0x7f2c1c1501f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:59.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.453+0000 7f2c2133e640 1 --2- 172.21.15.132:0/1281982030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c1c0c6690 0x7f2c1c1501f0 secure :-1 s=READY pgs=1764 cs=0 l=1 rev1=1 crypto rx=0x7f2c0400e810 tx=0x7f2c0400ecd0 comp rx=0 tx=0).stop 2023-12-20T04:52:59.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.453+0000 7f2c2133e640 1 -- 172.21.15.132:0/1281982030 shutdown_connections 2023-12-20T04:52:59.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.453+0000 7f2c2133e640 1 --2- 172.21.15.132:0/1281982030 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f2bfc06a430 0x7f2bfc06c8f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:59.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.453+0000 7f2c2133e640 1 --2- 172.21.15.132:0/1281982030 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f2c1c15d050 0x7f2c1c0b4ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:59.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.453+0000 7f2c2133e640 1 --2- 172.21.15.132:0/1281982030 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f2c1c0c6690 0x7f2c1c1501f0 unknown :-1 s=CLOSED pgs=1764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:59.455 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.453+0000 7f2c2133e640 1 --2- 172.21.15.132:0/1281982030 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f2c1c06a170 0x7f2c1c0b31b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:59.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.453+0000 7f2c2133e640 1 -- 172.21.15.132:0/1281982030 >> 172.21.15.132:0/1281982030 conn(0x7f2c1c0cfb10 msgr2=0x7f2c1c0c4ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:59.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.453+0000 7f2c2133e640 1 -- 172.21.15.132:0/1281982030 shutdown_connections 2023-12-20T04:52:59.456 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.453+0000 7f2c2133e640 1 -- 172.21.15.132:0/1281982030 wait complete. 2023-12-20T04:52:59.468 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mon mon_allow_pool_delete True 2023-12-20T04:52:59.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.572+0000 7ff138ffd640 1 Processor -- start 2023-12-20T04:52:59.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.572+0000 7ff138ffd640 1 -- start start 2023-12-20T04:52:59.576 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.573+0000 7ff138ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff134143610 0x7ff1340caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:59.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.573+0000 7ff138ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff1340c41f0 0x7ff1340cd240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:59.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.573+0000 7ff138ffd640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff1341439f0 con 0x7ff1340cd780 2023-12-20T04:52:59.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.573+0000 7ff138ffd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff1340cdc30 con 0x7ff1340c41f0 2023-12-20T04:52:59.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.573+0000 7ff138ffd640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff1340c46f0 con 0x7ff134143610 2023-12-20T04:52:59.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.573+0000 7ff131d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff1340c41f0 0x7ff1340cd240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:59.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.573+0000 7ff131d9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff1340c41f0 0x7ff1340cd240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59124/0 (socket says 172.21.15.132:59124) 2023-12-20T04:52:59.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.573+0000 7ff132d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff1340cd780 0x7ff13415d890 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38582/0 (socket says 172.21.15.132:38582) 2023-12-20T04:52:59.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.573+0000 7ff131d9b640 1 -- 172.21.15.132:0/3337040986 learned_addr learned my addr 172.21.15.132:0/3337040986 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:59.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.574+0000 7ff13259c640 1 --2- 172.21.15.132:0/3337040986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff134143610 0x7ff1340caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:59.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.574+0000 7ff131d9b640 1 -- 172.21.15.132:0/3337040986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff134143610 msgr2=0x7ff1340caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:52:59.577 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.574+0000 7ff131d9b640 1 --2- 172.21.15.132:0/3337040986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff134143610 0x7ff1340caa40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:59.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.574+0000 7ff131d9b640 1 -- 172.21.15.132:0/3337040986 >> v1:172.21.15.132:6789/0 conn(0x7ff1340cd780 legacy=0x7ff13415d890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:59.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.574+0000 7ff131d9b640 1 -- 172.21.15.132:0/3337040986 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1340c49d0 con 0x7ff1340c41f0 2023-12-20T04:52:59.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.574+0000 7ff13159a640 1 -- 172.21.15.132:0/3337040986 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3274578717 0 0) 0x7ff1341439f0 con 0x7ff1340cd780 2023-12-20T04:52:59.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.574+0000 7ff13259c640 1 --2- 172.21.15.132:0/3337040986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff134143610 0x7ff1340caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:52:59.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.574+0000 7ff131d9b640 1 --2- 172.21.15.132:0/3337040986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340c41f0 0x7ff1340cd240 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7ff128009870 tx=0x7ff12802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6aafb74cc1c5762 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:59.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.575+0000 7ff13159a640 1 -- 172.21.15.132:0/3337040986 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128030840 con 0x7ff1340c41f0 2023-12-20T04:52:59.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.575+0000 7ff13159a640 1 -- 172.21.15.132:0/3337040986 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff1280309a0 con 0x7ff1340c41f0 2023-12-20T04:52:59.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.575+0000 7ff13159a640 1 -- 172.21.15.132:0/3337040986 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128030d30 con 0x7ff1340c41f0 2023-12-20T04:52:59.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.575+0000 7ff138ffd640 1 -- 172.21.15.132:0/3337040986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340c41f0 msgr2=0x7ff1340cd240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:59.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.575+0000 7ff138ffd640 1 --2- 172.21.15.132:0/3337040986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340c41f0 0x7ff1340cd240 secure :-1 s=READY pgs=1766 cs=0 l=1 rev1=1 crypto rx=0x7ff128009870 tx=0x7ff12802b980 comp rx=0 tx=0).stop 2023-12-20T04:52:59.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.575+0000 7ff138ffd640 1 -- 172.21.15.132:0/3337040986 shutdown_connections 2023-12-20T04:52:59.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.575+0000 7ff138ffd640 1 --2- 172.21.15.132:0/3337040986 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340c41f0 0x7ff1340cd240 unknown :-1 s=CLOSED pgs=1766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:59.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.575+0000 7ff138ffd640 1 --2- 172.21.15.132:0/3337040986 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff134143610 0x7ff1340caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:59.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.575+0000 7ff138ffd640 1 -- 172.21.15.132:0/3337040986 >> 172.21.15.132:0/3337040986 conn(0x7ff13406a260 msgr2=0x7ff1340b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:59.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.575+0000 7ff138ffd640 1 -- 172.21.15.132:0/3337040986 shutdown_connections 2023-12-20T04:52:59.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.575+0000 7ff138ffd640 1 -- 172.21.15.132:0/3337040986 wait complete. 2023-12-20T04:52:59.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.577+0000 7ff138ffd640 1 Processor -- start 2023-12-20T04:52:59.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.577+0000 7ff138ffd640 1 -- start start 2023-12-20T04:52:59.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.577+0000 7ff138ffd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1340c41f0 0x7ff134071300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:59.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.577+0000 7ff138ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340cd780 0x7ff13413c830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:59.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.577+0000 7ff138ffd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff134143610 0x7ff13406f350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:59.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.577+0000 7ff138ffd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff134158da0 con 0x7ff1340cd780 2023-12-20T04:52:59.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.577+0000 7ff138ffd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff134158190 con 0x7ff1340c41f0 2023-12-20T04:52:59.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.577+0000 7ff138ffd640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff134158470 con 0x7ff134143610 2023-12-20T04:52:59.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.577+0000 7ff131d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340cd780 0x7ff13413c830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:59.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.577+0000 7ff131d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340cd780 0x7ff13413c830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59136/0 (socket says 172.21.15.132:59136) 2023-12-20T04:52:59.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.577+0000 7ff131d9b640 1 -- 172.21.15.132:0/1542162701 learned_addr learned my addr 172.21.15.132:0/1542162701 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:52:59.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.578+0000 7ff132d9d640 1 --2- 172.21.15.132:0/1542162701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff134143610 0x7ff13406f350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:59.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.578+0000 7ff13259c640 1 --2- 172.21.15.132:0/1542162701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1340c41f0 0x7ff134071300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:59.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.578+0000 7ff131d9b640 1 -- 172.21.15.132:0/1542162701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff134143610 msgr2=0x7ff13406f350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:59.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.578+0000 7ff131d9b640 1 --2- 172.21.15.132:0/1542162701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff134143610 0x7ff13406f350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:59.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.578+0000 7ff131d9b640 1 -- 172.21.15.132:0/1542162701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1340c41f0 msgr2=0x7ff134071300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:59.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.578+0000 7ff131d9b640 1 --2- 172.21.15.132:0/1542162701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1340c41f0 0x7ff134071300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:59.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.578+0000 7ff131d9b640 1 -- 172.21.15.132:0/1542162701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1280094d0 con 0x7ff1340cd780 2023-12-20T04:52:59.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.578+0000 7ff131d9b640 1 --2- 172.21.15.132:0/1542162701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340cd780 0x7ff13413c830 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7ff128000c00 tx=0x7ff128004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:59.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.578+0000 7ff122ffd640 1 -- 172.21.15.132:0/1542162701 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff128030810 con 0x7ff1340cd780 2023-12-20T04:52:59.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.578+0000 7ff122ffd640 1 -- 172.21.15.132:0/1542162701 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff128043400 con 0x7ff1340cd780 2023-12-20T04:52:59.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.578+0000 7ff122ffd640 1 -- 172.21.15.132:0/1542162701 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff1280437d0 con 0x7ff1340cd780 2023-12-20T04:52:59.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.578+0000 7ff138ffd640 1 -- 172.21.15.132:0/1542162701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff134158750 con 0x7ff1340cd780 2023-12-20T04:52:59.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.578+0000 7ff138ffd640 1 -- 172.21.15.132:0/1542162701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1340c7b80 con 0x7ff1340cd780 2023-12-20T04:52:59.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.579+0000 7ff138ffd640 1 -- 172.21.15.132:0/1542162701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff134158f50 con 0x7ff1340cd780 2023-12-20T04:52:59.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.579+0000 7ff122ffd640 1 -- 172.21.15.132:0/1542162701 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff128043930 con 0x7ff1340cd780 2023-12-20T04:52:59.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.580+0000 7ff122ffd640 1 --2- 172.21.15.132:0/1542162701 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff11406a430 0x7ff11406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:52:59.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.580+0000 7ff13259c640 1 --2- 172.21.15.132:0/1542162701 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff11406a430 0x7ff11406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:52:59.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.580+0000 7ff122ffd640 1 -- 172.21.15.132:0/1542162701 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff12803e070 con 0x7ff1340cd780 2023-12-20T04:52:59.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.580+0000 7ff13259c640 1 --2- 172.21.15.132:0/1542162701 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff11406a430 0x7ff11406c8f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff124007510 tx=0x7ff1240074a0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:52:59.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.584+0000 7ff122ffd640 1 -- 172.21.15.132:0/1542162701 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff134158f50 con 0x7ff1340cd780 2023-12-20T04:52:59.751 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.749+0000 7ff138ffd640 1 -- 172.21.15.132:0/1542162701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_allow_pool_delete}] v 0) v1 -- 0x7ff13404e840 con 0x7ff1340cd780 2023-12-20T04:52:59.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.753+0000 7ff122ffd640 1 -- 172.21.15.132:0/1542162701 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_allow_pool_delete}]=0 v20)=0 v20) v1 ==== 122+0+0 (secure 0 0 0) 0x7ff128077280 con 0x7ff1340cd780 2023-12-20T04:52:59.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.755+0000 7ff138ffd640 1 -- 172.21.15.132:0/1542162701 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff11406a430 msgr2=0x7ff11406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:59.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.755+0000 7ff138ffd640 1 --2- 172.21.15.132:0/1542162701 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff11406a430 0x7ff11406c8f0 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7ff124007510 tx=0x7ff1240074a0 comp rx=0 tx=0).stop 2023-12-20T04:52:59.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.755+0000 7ff138ffd640 1 -- 172.21.15.132:0/1542162701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340cd780 msgr2=0x7ff13413c830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:52:59.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.755+0000 7ff138ffd640 1 --2- 172.21.15.132:0/1542162701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340cd780 0x7ff13413c830 secure :-1 s=READY pgs=1767 cs=0 l=1 rev1=1 crypto rx=0x7ff128000c00 tx=0x7ff128004730 comp rx=0 tx=0).stop 2023-12-20T04:52:59.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.755+0000 7ff138ffd640 1 -- 172.21.15.132:0/1542162701 shutdown_connections 2023-12-20T04:52:59.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.755+0000 7ff138ffd640 1 --2- 172.21.15.132:0/1542162701 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff11406a430 0x7ff11406c8f0 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:59.757 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.755+0000 7ff138ffd640 1 --2- 172.21.15.132:0/1542162701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff134143610 0x7ff13406f350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:59.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.755+0000 7ff138ffd640 1 --2- 172.21.15.132:0/1542162701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff1340cd780 0x7ff13413c830 unknown :-1 s=CLOSED pgs=1767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:59.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.755+0000 7ff138ffd640 1 --2- 172.21.15.132:0/1542162701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff1340c41f0 0x7ff134071300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:52:59.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.755+0000 7ff138ffd640 1 -- 172.21.15.132:0/1542162701 >> 172.21.15.132:0/1542162701 conn(0x7ff13406a260 msgr2=0x7ff1340b06f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:52:59.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.755+0000 7ff138ffd640 1 -- 172.21.15.132:0/1542162701 shutdown_connections 2023-12-20T04:52:59.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:52:59.755+0000 7ff138ffd640 1 -- 172.21.15.132:0/1542162701 wait complete. 2023-12-20T04:52:59.768 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:52:59.768 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:52:59.813 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:52:59.862 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:52:59.862 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:52:59.862 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:52:59.878 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:52:59.878 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:52:59.878 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:52:59.895 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:52:59.895 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:52:59.895 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:52:59.935 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:52:59.935 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:52:59.935 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:52:59.952 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:52:59.953 INFO:tasks.cephfs.cephfs_test_case:[, , , ] 2023-12-20T04:52:59.953 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:53:00.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.071+0000 7ff04765f640 1 Processor -- start 2023-12-20T04:53:00.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.072+0000 7ff04765f640 1 -- start start 2023-12-20T04:53:00.075 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.072+0000 7ff04765f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff040160450 0x7ff040160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:00.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.072+0000 7ff04765f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0401611b0 0x7ff0400b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:00.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.072+0000 7ff04765f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff0400b4ec0 0x7ff04006a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:00.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.072+0000 7ff04765f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0400b5350 con 0x7ff0401611b0 2023-12-20T04:53:00.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.072+0000 7ff04765f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff0400b5ec0 con 0x7ff0400b4ec0 2023-12-20T04:53:00.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.072+0000 7ff04765f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0401617e0 con 0x7ff040160450 2023-12-20T04:53:00.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.072+0000 7ff044bfa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0401611b0 0x7ff0400b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:00.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.073+0000 7ff044bfa640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff0401611b0 0x7ff0400b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59152/0 (socket says 172.21.15.132:59152) 2023-12-20T04:53:00.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.073+0000 7ff044bfa640 1 -- 172.21.15.132:0/3333632322 learned_addr learned my addr 172.21.15.132:0/3333632322 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:00.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.073+0000 7ff045bfc640 1 --2- 172.21.15.132:0/3333632322 >> v2:172.21.15.187:3300/0 conn(0x7ff0400b4ec0 0x7ff04006a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:00.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.073+0000 7ff0453fb640 1 --2- 172.21.15.132:0/3333632322 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff040160450 0x7ff040160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:00.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.073+0000 7ff044bfa640 1 -- 172.21.15.132:0/3333632322 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff040160450 msgr2=0x7ff040160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:00.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.073+0000 7ff044bfa640 1 --2- 172.21.15.132:0/3333632322 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff040160450 0x7ff040160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.073+0000 7ff044bfa640 1 -- 172.21.15.132:0/3333632322 >> v2:172.21.15.187:3300/0 conn(0x7ff0400b4ec0 msgr2=0x7ff04006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:00.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.073+0000 7ff044bfa640 1 --2- 172.21.15.132:0/3333632322 >> v2:172.21.15.187:3300/0 conn(0x7ff0400b4ec0 0x7ff04006a1a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.073+0000 7ff044bfa640 1 -- 172.21.15.132:0/3333632322 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0400d0fc0 con 0x7ff0401611b0 2023-12-20T04:53:00.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.073+0000 7ff0453fb640 1 --2- 172.21.15.132:0/3333632322 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff040160450 0x7ff040160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:00.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.074+0000 7ff044bfa640 1 --2- 172.21.15.132:0/3333632322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0401611b0 0x7ff0400b4980 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7ff0400b59d0 tx=0x7ff03002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483b835ed56ea581 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:00.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.074+0000 7ff037fff640 1 -- 172.21.15.132:0/3333632322 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030030860 con 0x7ff0401611b0 2023-12-20T04:53:00.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.074+0000 7ff037fff640 1 -- 172.21.15.132:0/3333632322 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff0300309c0 con 0x7ff0401611b0 2023-12-20T04:53:00.077 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.074+0000 7ff037fff640 1 -- 172.21.15.132:0/3333632322 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff030030d50 con 0x7ff0401611b0 2023-12-20T04:53:00.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.074+0000 7ff04765f640 1 -- 172.21.15.132:0/3333632322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0401611b0 msgr2=0x7ff0400b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:00.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.074+0000 7ff04765f640 1 --2- 172.21.15.132:0/3333632322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0401611b0 0x7ff0400b4980 secure :-1 s=READY pgs=1768 cs=0 l=1 rev1=1 crypto rx=0x7ff0400b59d0 tx=0x7ff03002b9a0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.074+0000 7ff04765f640 1 -- 172.21.15.132:0/3333632322 shutdown_connections 2023-12-20T04:53:00.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.074+0000 7ff04765f640 1 --2- 172.21.15.132:0/3333632322 >> v2:172.21.15.187:3300/0 conn(0x7ff0400b4ec0 0x7ff04006a1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.074+0000 7ff04765f640 1 --2- 172.21.15.132:0/3333632322 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0401611b0 0x7ff0400b4980 unknown :-1 s=CLOSED pgs=1768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.074+0000 7ff04765f640 1 --2- 172.21.15.132:0/3333632322 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff040160450 0x7ff040160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.074+0000 7ff04765f640 1 -- 172.21.15.132:0/3333632322 >> 172.21.15.132:0/3333632322 conn(0x7ff0400cf980 msgr2=0x7ff0400cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:00.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.074+0000 7ff04765f640 1 -- 172.21.15.132:0/3333632322 shutdown_connections 2023-12-20T04:53:00.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.074+0000 7ff04765f640 1 -- 172.21.15.132:0/3333632322 wait complete. 2023-12-20T04:53:00.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.075+0000 7ff04765f640 1 Processor -- start 2023-12-20T04:53:00.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.075+0000 7ff04765f640 1 -- start start 2023-12-20T04:53:00.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.076+0000 7ff04765f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0400b4ec0 0x7ff0400ccdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:00.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.076+0000 7ff04765f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff040160450 0x7ff0400d3760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:00.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.076+0000 7ff04765f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0401611b0 0x7ff0400b6ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:00.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.076+0000 7ff04765f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0401f6120 con 0x7ff0401611b0 2023-12-20T04:53:00.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.076+0000 7ff04765f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff0401f6400 con 0x7ff040160450 2023-12-20T04:53:00.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.076+0000 7ff04765f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff0401f66e0 con 0x7ff0400b4ec0 2023-12-20T04:53:00.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.076+0000 7ff045bfc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0401611b0 0x7ff0400b6ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:00.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.076+0000 7ff045bfc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0401611b0 0x7ff0400b6ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59168/0 (socket says 172.21.15.132:59168) 2023-12-20T04:53:00.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.076+0000 7ff045bfc640 1 -- 172.21.15.132:0/881556907 learned_addr learned my addr 172.21.15.132:0/881556907 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:00.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.076+0000 7ff044bfa640 1 --2- 172.21.15.132:0/881556907 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff040160450 0x7ff0400d3760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:00.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.076+0000 7ff0453fb640 1 --2- 172.21.15.132:0/881556907 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0400b4ec0 0x7ff0400ccdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:00.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.077+0000 7ff045bfc640 1 -- 172.21.15.132:0/881556907 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0400b4ec0 msgr2=0x7ff0400ccdc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:00.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.077+0000 7ff045bfc640 1 --2- 172.21.15.132:0/881556907 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0400b4ec0 0x7ff0400ccdc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.077+0000 7ff045bfc640 1 -- 172.21.15.132:0/881556907 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff040160450 msgr2=0x7ff0400d3760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:00.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.077+0000 7ff045bfc640 1 --2- 172.21.15.132:0/881556907 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff040160450 0x7ff0400d3760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.077+0000 7ff045bfc640 1 -- 172.21.15.132:0/881556907 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff0300094d0 con 0x7ff0401611b0 2023-12-20T04:53:00.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.077+0000 7ff045bfc640 1 --2- 172.21.15.132:0/881556907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0401611b0 0x7ff0400b6ac0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7ff03c007e40 tx=0x7ff03c00e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:00.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.077+0000 7ff035ffb640 1 -- 172.21.15.132:0/881556907 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c014620 con 0x7ff0401611b0 2023-12-20T04:53:00.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.077+0000 7ff035ffb640 1 -- 172.21.15.132:0/881556907 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff03c00ee90 con 0x7ff0401611b0 2023-12-20T04:53:00.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.077+0000 7ff04765f640 1 -- 172.21.15.132:0/881556907 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff0401f69c0 con 0x7ff0401611b0 2023-12-20T04:53:00.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.077+0000 7ff035ffb640 1 -- 172.21.15.132:0/881556907 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff03c0149e0 con 0x7ff0401611b0 2023-12-20T04:53:00.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.077+0000 7ff04765f640 1 -- 172.21.15.132:0/881556907 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff0400d19a0 con 0x7ff0401611b0 2023-12-20T04:53:00.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.078+0000 7ff04765f640 1 -- 172.21.15.132:0/881556907 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff0401f6ee0 con 0x7ff0401611b0 2023-12-20T04:53:00.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.078+0000 7ff035ffb640 1 -- 172.21.15.132:0/881556907 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff03c014b40 con 0x7ff0401611b0 2023-12-20T04:53:00.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.079+0000 7ff035ffb640 1 --2- 172.21.15.132:0/881556907 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff02406a430 0x7ff02406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:00.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.079+0000 7ff035ffb640 1 -- 172.21.15.132:0/881556907 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(177..177 src has 1..177) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff03c088df0 con 0x7ff0401611b0 2023-12-20T04:53:00.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.079+0000 7ff0453fb640 1 --2- 172.21.15.132:0/881556907 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff02406a430 0x7ff02406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:00.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.079+0000 7ff0453fb640 1 --2- 172.21.15.132:0/881556907 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff02406a430 0x7ff02406c8f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff03800aae0 tx=0x7ff038008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:00.085 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.083+0000 7ff035ffb640 1 -- 172.21.15.132:0/881556907 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff0401f6ee0 con 0x7ff0401611b0 2023-12-20T04:53:00.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.281+0000 7ff04765f640 1 -- 172.21.15.132:0/881556907 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7ff0401f6ee0 con 0x7ff0401611b0 2023-12-20T04:53:00.284 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.282+0000 7ff035ffb640 1 -- 172.21.15.132:0/881556907 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 65 v65) v1 ==== 94+0+3541 (secure 0 0 0) 0x7ff0401f6ee0 con 0x7ff0401611b0 2023-12-20T04:53:00.284 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:00.284 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":65,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6644,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6834/1464403338","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":1464403338},{"type":"v1","addr":"172.21.15.187:6834","nonce":1464403338}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":7366,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/2717050899","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6833","nonce":2717050899},{"type":"v1","addr":"172.21.15.187:6835","nonce":2717050899}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":8709,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/2430423967","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":2430423967},{"type":"v1","addr":"172.21.15.132:6836","nonce":2430423967}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":60},{"gid":9042,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/1331629383","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":1331629383},{"type":"v1","addr":"172.21.15.132:6837","nonce":1331629383}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":65}],"filesystems":[]} 2023-12-20T04:53:00.284 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 65 2023-12-20T04:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.284+0000 7ff04765f640 1 -- 172.21.15.132:0/881556907 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff02406a430 msgr2=0x7ff02406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.284+0000 7ff04765f640 1 --2- 172.21.15.132:0/881556907 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff02406a430 0x7ff02406c8f0 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7ff03800aae0 tx=0x7ff038008040 comp rx=0 tx=0).stop 2023-12-20T04:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.284+0000 7ff04765f640 1 -- 172.21.15.132:0/881556907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0401611b0 msgr2=0x7ff0400b6ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.284+0000 7ff04765f640 1 --2- 172.21.15.132:0/881556907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0401611b0 0x7ff0400b6ac0 secure :-1 s=READY pgs=1769 cs=0 l=1 rev1=1 crypto rx=0x7ff03c007e40 tx=0x7ff03c00e4b0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.284+0000 7ff04765f640 1 -- 172.21.15.132:0/881556907 shutdown_connections 2023-12-20T04:53:00.286 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.284+0000 7ff04765f640 1 --2- 172.21.15.132:0/881556907 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff02406a430 0x7ff02406c8f0 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.284+0000 7ff04765f640 1 --2- 172.21.15.132:0/881556907 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff0401611b0 0x7ff0400b6ac0 unknown :-1 s=CLOSED pgs=1769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.284+0000 7ff04765f640 1 --2- 172.21.15.132:0/881556907 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff040160450 0x7ff0400d3760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.284+0000 7ff04765f640 1 --2- 172.21.15.132:0/881556907 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff0400b4ec0 0x7ff0400ccdc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.284+0000 7ff04765f640 1 -- 172.21.15.132:0/881556907 >> 172.21.15.132:0/881556907 conn(0x7ff0400cf980 msgr2=0x7ff04015f570 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.284+0000 7ff04765f640 1 -- 172.21.15.132:0/881556907 shutdown_connections 2023-12-20T04:53:00.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.284+0000 7ff04765f640 1 -- 172.21.15.132:0/881556907 wait complete. 2023-12-20T04:53:00.297 INFO:tasks.ceph.mds.a:Restarting daemon 2023-12-20T04:53:00.297 INFO:tasks.ceph.mds.a:Stopping old one... 2023-12-20T04:53:00.297 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-20T04:53:00.297 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:53:00.298 INFO:tasks.ceph.mds.c:Restarting daemon 2023-12-20T04:53:00.298 INFO:tasks.ceph.mds.c:Stopping old one... 2023-12-20T04:53:00.298 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-20T04:53:00.298 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:53:00.298 INFO:tasks.ceph.mds.b:Restarting daemon 2023-12-20T04:53:00.298 INFO:tasks.ceph.mds.b:Stopping old one... 2023-12-20T04:53:00.298 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-20T04:53:00.298 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:53:00.299 INFO:tasks.ceph.mds.d:Restarting daemon 2023-12-20T04:53:00.299 INFO:tasks.ceph.mds.d:Stopping old one... 2023-12-20T04:53:00.299 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-20T04:53:00.299 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:53:00.307 INFO:tasks.ceph.mds.a:Stopped 2023-12-20T04:53:00.307 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2023-12-20T04:53:00.308 INFO:tasks.ceph.mds.c:Stopped 2023-12-20T04:53:00.308 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2023-12-20T04:53:00.310 INFO:tasks.ceph.mds.b:Stopped 2023-12-20T04:53:00.311 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2023-12-20T04:53:00.311 INFO:tasks.ceph.mds.d:Stopped 2023-12-20T04:53:00.312 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2023-12-20T04:53:00.349 INFO:tasks.ceph.mds.a:Started 2023-12-20T04:53:00.349 DEBUG:teuthology.parallel:result is None 2023-12-20T04:53:00.350 INFO:tasks.ceph.mds.c:Started 2023-12-20T04:53:00.350 DEBUG:teuthology.parallel:result is None 2023-12-20T04:53:00.353 INFO:tasks.ceph.mds.b:Started 2023-12-20T04:53:00.354 DEBUG:teuthology.parallel:result is None 2023-12-20T04:53:00.355 INFO:tasks.ceph.mds.d:Started 2023-12-20T04:53:00.355 DEBUG:teuthology.parallel:result is None 2023-12-20T04:53:00.355 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist clear 2023-12-20T04:53:00.425 INFO:tasks.ceph.mds.c.smithi132.stdout:starting mds.c at 2023-12-20T04:53:00.426 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-12-20T04:53:00.438 INFO:tasks.ceph.mds.d.smithi187.stdout:starting mds.d at 2023-12-20T04:53:00.440 INFO:tasks.ceph.mds.b.smithi187.stdout:starting mds.b at 2023-12-20T04:53:00.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.461+0000 7f06dc399640 1 Processor -- start 2023-12-20T04:53:00.463 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.461+0000 7f06dc399640 1 -- start start 2023-12-20T04:53:00.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.462+0000 7f06dc399640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06d415d2c0 0x7f06d40cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:00.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.462+0000 7f06dc399640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f06d40d0060 0x7f06d40d1180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:00.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.462+0000 7f06dc399640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f06d40d0cf0 con 0x7f06d40d30a0 2023-12-20T04:53:00.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.462+0000 7f06dc399640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f06d40d0550 con 0x7f06d40d0060 2023-12-20T04:53:00.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.462+0000 7f06dc399640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d40cddc0 con 0x7f06d415d2c0 2023-12-20T04:53:00.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.462+0000 7f06d9934640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06d415d2c0 0x7f06d40cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:00.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.462+0000 7f06da936640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f06d40d0060 0x7f06d40d1180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:00.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.462+0000 7f06da135640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f06d40d30a0 0x7f06d40d3480 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:55270/0 (socket says 172.21.15.132:55270) 2023-12-20T04:53:00.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.462+0000 7f06d9934640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06d415d2c0 0x7f06d40cd5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:60822/0 (socket says 172.21.15.132:60822) 2023-12-20T04:53:00.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.462+0000 7f06da135640 1 -- 172.21.15.132:0/1110782944 learned_addr learned my addr 172.21.15.132:0/1110782944 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:00.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.462+0000 7f06da936640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f06d40d0060 0x7f06d40d1180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:57442/0 (socket says 172.21.15.132:57442) 2023-12-20T04:53:00.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.462+0000 7f06da936640 1 -- 172.21.15.132:0/1110782944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06d415d2c0 msgr2=0x7f06d40cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:00.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.462+0000 7f06da936640 1 --2- 172.21.15.132:0/1110782944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06d415d2c0 0x7f06d40cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.462+0000 7f06da936640 1 -- 172.21.15.132:0/1110782944 >> v1:172.21.15.187:6789/0 conn(0x7f06d40d30a0 legacy=0x7f06d40d3480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:00.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.462+0000 7f06da936640 1 -- 172.21.15.132:0/1110782944 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06d40ce0a0 con 0x7f06d40d0060 2023-12-20T04:53:00.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.463+0000 7f06da936640 1 --2- 172.21.15.132:0/1110782944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06d40d0060 0x7f06d40d1180 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009d90 tx=0x7f06cc02bea0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1612caa17f1f8f7a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:00.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.466+0000 7f06d9133640 1 -- 172.21.15.132:0/1110782944 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc02cc50 con 0x7f06d40d0060 2023-12-20T04:53:00.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.466+0000 7f06d9133640 1 -- 172.21.15.132:0/1110782944 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06cc02cdb0 con 0x7f06d40d0060 2023-12-20T04:53:00.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.466+0000 7f06d9133640 1 -- 172.21.15.132:0/1110782944 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06cc034660 con 0x7f06d40d0060 2023-12-20T04:53:00.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.467+0000 7f06dc399640 1 -- 172.21.15.132:0/1110782944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06d40d0060 msgr2=0x7f06d40d1180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:00.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.467+0000 7f06dc399640 1 --2- 172.21.15.132:0/1110782944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06d40d0060 0x7f06d40d1180 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f06cc009d90 tx=0x7f06cc02bea0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.467+0000 7f06dc399640 1 -- 172.21.15.132:0/1110782944 shutdown_connections 2023-12-20T04:53:00.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.467+0000 7f06dc399640 1 --2- 172.21.15.132:0/1110782944 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06d40d0060 0x7f06d40d1180 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.467+0000 7f06dc399640 1 --2- 172.21.15.132:0/1110782944 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06d415d2c0 0x7f06d40cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.467+0000 7f06dc399640 1 -- 172.21.15.132:0/1110782944 >> 172.21.15.132:0/1110782944 conn(0x7f06d4072e40 msgr2=0x7f06d4073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:00.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.467+0000 7f06dc399640 1 -- 172.21.15.132:0/1110782944 shutdown_connections 2023-12-20T04:53:00.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.467+0000 7f06dc399640 1 -- 172.21.15.132:0/1110782944 wait complete. 2023-12-20T04:53:00.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.468+0000 7f06dc399640 1 Processor -- start 2023-12-20T04:53:00.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.468+0000 7f06dc399640 1 -- start start 2023-12-20T04:53:00.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.469+0000 7f06dc399640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06d40d0060 0x7f06d40c6750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:00.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.469+0000 7f06dc399640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06d40d30a0 0x7f06d4153a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:00.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.469+0000 7f06dc399640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06d415d2c0 0x7f06d415e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:00.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.469+0000 7f06dc399640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d4160450 con 0x7f06d40d0060 2023-12-20T04:53:00.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.469+0000 7f06da135640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06d40d0060 0x7f06d40c6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:00.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.469+0000 7f06dc399640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f06d415fbf0 con 0x7f06d40d30a0 2023-12-20T04:53:00.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.469+0000 7f06dc399640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f06d415fe90 con 0x7f06d415d2c0 2023-12-20T04:53:00.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.469+0000 7f06da135640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06d40d0060 0x7f06d40c6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59200/0 (socket says 172.21.15.132:59200) 2023-12-20T04:53:00.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.469+0000 7f06da135640 1 -- 172.21.15.132:0/3723337925 learned_addr learned my addr 172.21.15.132:0/3723337925 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:00.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.469+0000 7f06d9934640 1 --2- 172.21.15.132:0/3723337925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06d40d30a0 0x7f06d4153a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:00.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.469+0000 7f06da936640 1 --2- 172.21.15.132:0/3723337925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06d415d2c0 0x7f06d415e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:00.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.469+0000 7f06da135640 1 -- 172.21.15.132:0/3723337925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06d415d2c0 msgr2=0x7f06d415e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:00.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.469+0000 7f06da135640 1 --2- 172.21.15.132:0/3723337925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06d415d2c0 0x7f06d415e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.469+0000 7f06da135640 1 -- 172.21.15.132:0/3723337925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06d40d30a0 msgr2=0x7f06d4153a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:00.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.469+0000 7f06da135640 1 --2- 172.21.15.132:0/3723337925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06d40d30a0 0x7f06d4153a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:00.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.469+0000 7f06da135640 1 -- 172.21.15.132:0/3723337925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f06cc009a70 con 0x7f06d40d0060 2023-12-20T04:53:00.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.469+0000 7f06da936640 1 --2- 172.21.15.132:0/3723337925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06d415d2c0 0x7f06d415e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:00.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.470+0000 7f06da135640 1 --2- 172.21.15.132:0/3723337925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06d40d0060 0x7f06d40c6750 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f06d000c4a0 tx=0x7f06d000c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:00.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.472+0000 7f06caffd640 1 -- 172.21.15.132:0/3723337925 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0005ce0 con 0x7f06d40d0060 2023-12-20T04:53:00.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.473+0000 7f06caffd640 1 -- 172.21.15.132:0/3723337925 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f06d0005e40 con 0x7f06d40d0060 2023-12-20T04:53:00.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.473+0000 7f06dc399640 1 -- 172.21.15.132:0/3723337925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f06d4160170 con 0x7f06d40d0060 2023-12-20T04:53:00.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.473+0000 7f06caffd640 1 -- 172.21.15.132:0/3723337925 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f06d0007270 con 0x7f06d40d0060 2023-12-20T04:53:00.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.473+0000 7f06dc399640 1 -- 172.21.15.132:0/3723337925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f06d40cb9b0 con 0x7f06d40d0060 2023-12-20T04:53:00.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.474+0000 7f06dc399640 1 -- 172.21.15.132:0/3723337925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f06d40ce360 con 0x7f06d40d0060 2023-12-20T04:53:00.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.474+0000 7f06caffd640 1 -- 172.21.15.132:0/3723337925 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f06d00073d0 con 0x7f06d40d0060 2023-12-20T04:53:00.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.474+0000 7f06caffd640 1 --2- 172.21.15.132:0/3723337925 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06b806a460 0x7f06b806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:00.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.474+0000 7f06d9934640 1 --2- 172.21.15.132:0/3723337925 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06b806a460 0x7f06b806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:00.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.475+0000 7f06caffd640 1 -- 172.21.15.132:0/3723337925 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(181..181 src has 1..181) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f06d005cf10 con 0x7f06d40d0060 2023-12-20T04:53:00.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.475+0000 7f06d9934640 1 --2- 172.21.15.132:0/3723337925 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06b806a460 0x7f06b806c920 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f06d40c9750 tx=0x7f06c4009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:00.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.479+0000 7f06caffd640 1 -- 172.21.15.132:0/3723337925 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f06d40ce360 con 0x7f06d40d0060 2023-12-20T04:53:00.514 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b is failed for ~0s 2023-12-20T04:53:00.514 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d is failed for ~0s 2023-12-20T04:53:00.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:00.658+0000 7f06dc399640 1 -- 172.21.15.132:0/3723337925 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist clear"} v 0) v1 -- 0x7f06d40ce360 con 0x7f06d40d0060 2023-12-20T04:53:01.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.481+0000 7f06caffd640 1 -- 172.21.15.132:0/3723337925 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist clear"}]=0 removed all blocklist entries v182) v1 ==== 97+0+0 (secure 0 0 0) 0x7f06d40ce360 con 0x7f06d40d0060 2023-12-20T04:53:01.483 INFO:teuthology.orchestra.run.smithi132.stderr: removed all blocklist entries 2023-12-20T04:53:01.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.483+0000 7f06dc399640 1 -- 172.21.15.132:0/3723337925 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06b806a460 msgr2=0x7f06b806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:01.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.483+0000 7f06dc399640 1 --2- 172.21.15.132:0/3723337925 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06b806a460 0x7f06b806c920 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f06d40c9750 tx=0x7f06c4009190 comp rx=0 tx=0).stop 2023-12-20T04:53:01.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.483+0000 7f06dc399640 1 -- 172.21.15.132:0/3723337925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06d40d0060 msgr2=0x7f06d40c6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:01.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.483+0000 7f06dc399640 1 --2- 172.21.15.132:0/3723337925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06d40d0060 0x7f06d40c6750 secure :-1 s=READY pgs=1775 cs=0 l=1 rev1=1 crypto rx=0x7f06d000c4a0 tx=0x7f06d000c960 comp rx=0 tx=0).stop 2023-12-20T04:53:01.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.483+0000 7f06dc399640 1 -- 172.21.15.132:0/3723337925 shutdown_connections 2023-12-20T04:53:01.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.483+0000 7f06dc399640 1 --2- 172.21.15.132:0/3723337925 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f06b806a460 0x7f06b806c920 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.483+0000 7f06dc399640 1 --2- 172.21.15.132:0/3723337925 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f06d415d2c0 0x7f06d415e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.483+0000 7f06dc399640 1 --2- 172.21.15.132:0/3723337925 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f06d40d30a0 0x7f06d4153a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.483+0000 7f06dc399640 1 --2- 172.21.15.132:0/3723337925 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f06d40d0060 0x7f06d40c6750 unknown :-1 s=CLOSED pgs=1775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.483+0000 7f06dc399640 1 -- 172.21.15.132:0/3723337925 >> 172.21.15.132:0/3723337925 conn(0x7f06d4072e40 msgr2=0x7f06d41614c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:01.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.484+0000 7f06dc399640 1 -- 172.21.15.132:0/3723337925 shutdown_connections 2023-12-20T04:53:01.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.484+0000 7f06dc399640 1 -- 172.21.15.132:0/3723337925 wait complete. 2023-12-20T04:53:01.499 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth ls --format=json-pretty 2023-12-20T04:53:01.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.600+0000 7fd70430a640 1 Processor -- start 2023-12-20T04:53:01.602 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.600+0000 7fd70430a640 1 -- start start 2023-12-20T04:53:01.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.601+0000 7fd70430a640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6fc160450 0x7fd6fc160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:01.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.601+0000 7fd70430a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fd6fc1611b0 0x7fd6fc0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:01.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.601+0000 7fd70430a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd6fc0b5300 con 0x7fd6fc0b4ec0 2023-12-20T04:53:01.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.601+0000 7fd70430a640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6fc0b5ec0 con 0x7fd6fc160450 2023-12-20T04:53:01.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.601+0000 7fd70430a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd6fc1617e0 con 0x7fd6fc1611b0 2023-12-20T04:53:01.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.601+0000 7fd7020a6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6fc160450 0x7fd6fc160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:01.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.601+0000 7fd7028a7640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fd6fc0b4ec0 0x7fd6fc06a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38598/0 (socket says 172.21.15.132:38598) 2023-12-20T04:53:01.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.601+0000 7fd7020a6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd6fc160450 0x7fd6fc160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59204/0 (socket says 172.21.15.132:59204) 2023-12-20T04:53:01.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.601+0000 7fd7028a7640 1 -- 172.21.15.132:0/2092056086 learned_addr learned my addr 172.21.15.132:0/2092056086 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:01.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.602+0000 7fd7018a5640 1 --2- 172.21.15.132:0/2092056086 >> v2:172.21.15.187:3300/0 conn(0x7fd6fc1611b0 0x7fd6fc0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:01.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.602+0000 7fd7020a6640 1 -- 172.21.15.132:0/2092056086 >> v2:172.21.15.187:3300/0 conn(0x7fd6fc1611b0 msgr2=0x7fd6fc0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:01.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.602+0000 7fd7020a6640 1 --2- 172.21.15.132:0/2092056086 >> v2:172.21.15.187:3300/0 conn(0x7fd6fc1611b0 0x7fd6fc0b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.602+0000 7fd7020a6640 1 -- 172.21.15.132:0/2092056086 >> v1:172.21.15.132:6789/0 conn(0x7fd6fc0b4ec0 legacy=0x7fd6fc06a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:01.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.602+0000 7fd7020a6640 1 -- 172.21.15.132:0/2092056086 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6fc0d0fc0 con 0x7fd6fc160450 2023-12-20T04:53:01.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.602+0000 7fd7010a4640 1 -- 172.21.15.132:0/2092056086 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2370362432 0 0) 0x7fd6fc0b5300 con 0x7fd6fc0b4ec0 2023-12-20T04:53:01.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.602+0000 7fd7018a5640 1 --2- 172.21.15.132:0/2092056086 >> v2:172.21.15.187:3300/0 conn(0x7fd6fc1611b0 0x7fd6fc0b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:01.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.602+0000 7fd7020a6640 1 --2- 172.21.15.132:0/2092056086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6fc160450 0x7fd6fc160c70 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc08b100 tx=0x7fd6f802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c1a5747fa486779 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:01.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.603+0000 7fd7010a4640 1 -- 172.21.15.132:0/2092056086 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8030610 con 0x7fd6fc160450 2023-12-20T04:53:01.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.603+0000 7fd7010a4640 1 -- 172.21.15.132:0/2092056086 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6f8030770 con 0x7fd6fc160450 2023-12-20T04:53:01.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.603+0000 7fd7010a4640 1 -- 172.21.15.132:0/2092056086 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6f8030b00 con 0x7fd6fc160450 2023-12-20T04:53:01.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.603+0000 7fd70430a640 1 -- 172.21.15.132:0/2092056086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6fc160450 msgr2=0x7fd6fc160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:01.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.603+0000 7fd70430a640 1 --2- 172.21.15.132:0/2092056086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6fc160450 0x7fd6fc160c70 secure :-1 s=READY pgs=1777 cs=0 l=1 rev1=1 crypto rx=0x7fd6fc08b100 tx=0x7fd6f802b960 comp rx=0 tx=0).stop 2023-12-20T04:53:01.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.603+0000 7fd70430a640 1 -- 172.21.15.132:0/2092056086 shutdown_connections 2023-12-20T04:53:01.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.603+0000 7fd70430a640 1 --2- 172.21.15.132:0/2092056086 >> v2:172.21.15.187:3300/0 conn(0x7fd6fc1611b0 0x7fd6fc0b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.603+0000 7fd70430a640 1 --2- 172.21.15.132:0/2092056086 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6fc160450 0x7fd6fc160c70 unknown :-1 s=CLOSED pgs=1777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.603+0000 7fd70430a640 1 -- 172.21.15.132:0/2092056086 >> 172.21.15.132:0/2092056086 conn(0x7fd6fc0cf980 msgr2=0x7fd6fc0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:01.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.603+0000 7fd70430a640 1 -- 172.21.15.132:0/2092056086 shutdown_connections 2023-12-20T04:53:01.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.603+0000 7fd70430a640 1 -- 172.21.15.132:0/2092056086 wait complete. 2023-12-20T04:53:01.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.604+0000 7fd70430a640 1 Processor -- start 2023-12-20T04:53:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.604+0000 7fd70430a640 1 -- start start 2023-12-20T04:53:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.605+0000 7fd70430a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6fc0b4ec0 0x7fd6fc1f1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.605+0000 7fd70430a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6fc160450 0x7fd6fc0cb5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.605+0000 7fd70430a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6fc1611b0 0x7fd6fc0cbb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.605+0000 7fd70430a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc147cf0 con 0x7fd6fc160450 2023-12-20T04:53:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.605+0000 7fd70430a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc0c92f0 con 0x7fd6fc0b4ec0 2023-12-20T04:53:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.605+0000 7fd70430a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd6fc1f68b0 con 0x7fd6fc1611b0 2023-12-20T04:53:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.605+0000 7fd7018a5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6fc160450 0x7fd6fc0cb5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.605+0000 7fd7018a5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6fc160450 0x7fd6fc0cb5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59214/0 (socket says 172.21.15.132:59214) 2023-12-20T04:53:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.605+0000 7fd7018a5640 1 -- 172.21.15.132:0/1289459997 learned_addr learned my addr 172.21.15.132:0/1289459997 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.605+0000 7fd7020a6640 1 --2- 172.21.15.132:0/1289459997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6fc0b4ec0 0x7fd6fc1f1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:01.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.605+0000 7fd7028a7640 1 --2- 172.21.15.132:0/1289459997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6fc1611b0 0x7fd6fc0cbb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.605+0000 7fd7018a5640 1 -- 172.21.15.132:0/1289459997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6fc1611b0 msgr2=0x7fd6fc0cbb20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.605+0000 7fd7018a5640 1 --2- 172.21.15.132:0/1289459997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6fc1611b0 0x7fd6fc0cbb20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.606+0000 7fd7018a5640 1 -- 172.21.15.132:0/1289459997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6fc0b4ec0 msgr2=0x7fd6fc1f1e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.606+0000 7fd7018a5640 1 --2- 172.21.15.132:0/1289459997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6fc0b4ec0 0x7fd6fc1f1e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.606+0000 7fd7018a5640 1 -- 172.21.15.132:0/1289459997 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6f8009400 con 0x7fd6fc160450 2023-12-20T04:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.606+0000 7fd7018a5640 1 --2- 172.21.15.132:0/1289459997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6fc160450 0x7fd6fc0cb5e0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00c7f0 tx=0x7fd6ec00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.606+0000 7fd6f2ffd640 1 -- 172.21.15.132:0/1289459997 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec007820 con 0x7fd6fc160450 2023-12-20T04:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.606+0000 7fd6f2ffd640 1 -- 172.21.15.132:0/1289459997 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd6ec007980 con 0x7fd6fc160450 2023-12-20T04:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.606+0000 7fd6f2ffd640 1 -- 172.21.15.132:0/1289459997 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd6ec007cf0 con 0x7fd6fc160450 2023-12-20T04:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.606+0000 7fd70430a640 1 -- 172.21.15.132:0/1289459997 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd6fc1f6b90 con 0x7fd6fc160450 2023-12-20T04:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.606+0000 7fd70430a640 1 -- 172.21.15.132:0/1289459997 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd6fc15dbc0 con 0x7fd6fc160450 2023-12-20T04:53:01.610 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.607+0000 7fd70430a640 1 -- 172.21.15.132:0/1289459997 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd6fc04e840 con 0x7fd6fc160450 2023-12-20T04:53:01.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.607+0000 7fd6f2ffd640 1 -- 172.21.15.132:0/1289459997 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd6ec0113f0 con 0x7fd6fc160450 2023-12-20T04:53:01.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.607+0000 7fd6f2ffd640 1 --2- 172.21.15.132:0/1289459997 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6e006a430 0x7fd6e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:01.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.608+0000 7fd7020a6640 1 --2- 172.21.15.132:0/1289459997 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6e006a430 0x7fd6e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:01.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.608+0000 7fd6f2ffd640 1 -- 172.21.15.132:0/1289459997 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fd6ec088840 con 0x7fd6fc160450 2023-12-20T04:53:01.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.608+0000 7fd7020a6640 1 --2- 172.21.15.132:0/1289459997 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6e006a430 0x7fd6e006c8f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8036000 tx=0x7fd6f8008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:01.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.612+0000 7fd6f2ffd640 1 -- 172.21.15.132:0/1289459997 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd6ec054230 con 0x7fd6fc160450 2023-12-20T04:53:01.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.841+0000 7fd70430a640 1 -- 172.21.15.132:0/1289459997 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth ls", "format": "json-pretty"} v 0) v1 -- 0x7fd6fc0d0ad0 con 0x7fd6fc160450 2023-12-20T04:53:01.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.841+0000 7fd6f2ffd640 1 -- 172.21.15.132:0/1289459997 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth ls", "format": "json-pretty"}]=0 v22) v1 ==== 80+0+5304 (secure 0 0 0) 0x7fd6ec01f090 con 0x7fd6fc160450 2023-12-20T04:53:01.843 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:01.844 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:01.844 INFO:teuthology.orchestra.run.smithi132.stdout: "auth_dump": [ 2023-12-20T04:53:01.844 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.844 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.a", 2023-12-20T04:53:01.844 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlbTdZOxAAUDz0Eno9DYvrYM1xg5jG/A==", 2023-12-20T04:53:01.844 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.844 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:53:01.844 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:53:01.844 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:53:01.844 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:53:01.844 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.844 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.845 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.b", 2023-12-20T04:53:01.845 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl43gVDBAA1qJwUU+Ii4BalGf3NtJnGA==", 2023-12-20T04:53:01.845 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.845 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:53:01.845 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:53:01.845 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:53:01.845 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:53:01.845 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.845 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.845 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.845 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.c", 2023-12-20T04:53:01.845 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlaSUVBxAA7HN3dSo9xfvkjvc6bwMxWg==", 2023-12-20T04:53:01.846 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.846 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:53:01.846 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:53:01.846 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:53:01.846 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:53:01.846 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.846 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.846 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.846 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mds.d", 2023-12-20T04:53:01.846 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJl1DR4ExAANNOyGlf1Ayre/xZEb9JHYg==", 2023-12-20T04:53:01.846 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.846 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:53:01.846 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:53:01.846 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:53:01.846 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:53:01.847 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.847 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.0", 2023-12-20T04:53:01.847 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCucIJlwZfxORAAiT2g1poLu3OkmoyxNJQc8Q==", 2023-12-20T04:53:01.847 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.847 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:53:01.847 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:53:01.847 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:53:01.847 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.847 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.847 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.847 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.1", 2023-12-20T04:53:01.847 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlejHYBRAAKurKpW5gyOAQ+E4Su4xMSQ==", 2023-12-20T04:53:01.847 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.848 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:53:01.848 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:53:01.848 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:53:01.848 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.848 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.2", 2023-12-20T04:53:01.848 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJlyfz8DBAA9a6tUjHF8IRIKeldwVFMcw==", 2023-12-20T04:53:01.848 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.848 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:53:01.848 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:53:01.848 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:53:01.848 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.848 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.848 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.849 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.3", 2023-12-20T04:53:01.849 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCvcIJllFEeFBAA6URrqUjQqHsrI5+qEBVs3g==", 2023-12-20T04:53:01.849 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.849 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:53:01.849 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:53:01.849 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:53:01.849 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.849 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.849 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.849 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.4", 2023-12-20T04:53:01.849 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlvGqcJhAAgn2wuSTwLT+TOHoE4iaVSg==", 2023-12-20T04:53:01.849 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.849 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:53:01.849 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:53:01.850 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:53:01.850 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.850 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.850 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.5", 2023-12-20T04:53:01.850 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlWrkTLhAA2KlpxTFPaiXLCvmURpg5rw==", 2023-12-20T04:53:01.850 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.850 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:53:01.850 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:53:01.850 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:53:01.850 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.850 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.851 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.851 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.6", 2023-12-20T04:53:01.851 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCycIJlnOQfNRAA//EVx0BZYQd7ovK2tFhgfA==", 2023-12-20T04:53:01.851 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.851 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:53:01.851 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:53:01.851 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:53:01.851 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.851 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.851 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.851 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "osd.7", 2023-12-20T04:53:01.851 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCzcIJl4nfDABAAtBdl2qkzKcqhmzsukC7G5w==", 2023-12-20T04:53:01.851 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.851 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow profile osd", 2023-12-20T04:53:01.852 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile osd", 2023-12-20T04:53:01.852 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:53:01.852 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.852 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.0", 2023-12-20T04:53:01.852 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlm/nGFxAA6zndayizc50Il7l74BxkgQ==", 2023-12-20T04:53:01.852 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.852 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:53:01.852 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow r", 2023-12-20T04:53:01.852 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rw tag cephfs data=cephfs" 2023-12-20T04:53:01.852 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.852 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.852 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.853 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.1", 2023-12-20T04:53:01.853 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlppb6IBAArqCoSlSE5coxkj4+XjPoWg==", 2023-12-20T04:53:01.853 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.853 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:53:01.853 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:53:01.853 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:53:01.853 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:53:01.853 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.853 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.853 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.853 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.2", 2023-12-20T04:53:01.853 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlMgWUHRAAqSdmRGx+9J+3dO7ntaApdw==", 2023-12-20T04:53:01.853 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.853 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:53:01.854 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:53:01.854 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:53:01.854 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:53:01.854 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.854 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.854 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.854 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.3", 2023-12-20T04:53:01.854 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCrcIJlcIe3JhAAjv9KfknxwySJURWdePN7vw==", 2023-12-20T04:53:01.854 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.854 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow", 2023-12-20T04:53:01.854 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow r", 2023-12-20T04:53:01.854 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow rw", 2023-12-20T04:53:01.854 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow rwx" 2023-12-20T04:53:01.855 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.855 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "client.admin", 2023-12-20T04:53:01.855 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJljrTdHhAAsAlaFaKctSv71GrifKs6zA==", 2023-12-20T04:53:01.855 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.855 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:53:01.855 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": "allow *", 2023-12-20T04:53:01.855 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow *", 2023-12-20T04:53:01.855 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:53:01.855 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.855 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.855 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.855 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.x", 2023-12-20T04:53:01.855 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJl+KnxNxAAM/b3mubTMYlB9QUbfcPW8g==", 2023-12-20T04:53:01.856 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.856 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:53:01.856 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:53:01.856 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:53:01.856 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.856 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:01.856 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:01.856 INFO:teuthology.orchestra.run.smithi132.stdout: "entity": "mgr.y", 2023-12-20T04:53:01.856 INFO:teuthology.orchestra.run.smithi132.stdout: "key": "AQCqcIJlMyAMNBAAWpoBNevgGIkZ7zKEdKn3Ag==", 2023-12-20T04:53:01.856 INFO:teuthology.orchestra.run.smithi132.stdout: "caps": { 2023-12-20T04:53:01.856 INFO:teuthology.orchestra.run.smithi132.stdout: "mds": "allow *", 2023-12-20T04:53:01.856 INFO:teuthology.orchestra.run.smithi132.stdout: "mon": "allow profile mgr", 2023-12-20T04:53:01.856 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": "allow *" 2023-12-20T04:53:01.856 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.856 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:01.857 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:01.857 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:01.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.843+0000 7fd70430a640 1 -- 172.21.15.132:0/1289459997 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6e006a430 msgr2=0x7fd6e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:01.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.843+0000 7fd70430a640 1 --2- 172.21.15.132:0/1289459997 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6e006a430 0x7fd6e006c8f0 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7fd6f8036000 tx=0x7fd6f8008030 comp rx=0 tx=0).stop 2023-12-20T04:53:01.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.843+0000 7fd70430a640 1 -- 172.21.15.132:0/1289459997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6fc160450 msgr2=0x7fd6fc0cb5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:01.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.843+0000 7fd70430a640 1 --2- 172.21.15.132:0/1289459997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6fc160450 0x7fd6fc0cb5e0 secure :-1 s=READY pgs=1778 cs=0 l=1 rev1=1 crypto rx=0x7fd6ec00c7f0 tx=0x7fd6ec00ccb0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.843+0000 7fd70430a640 1 -- 172.21.15.132:0/1289459997 shutdown_connections 2023-12-20T04:53:01.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.843+0000 7fd70430a640 1 --2- 172.21.15.132:0/1289459997 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd6e006a430 0x7fd6e006c8f0 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.843+0000 7fd70430a640 1 --2- 172.21.15.132:0/1289459997 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd6fc1611b0 0x7fd6fc0cbb20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.843+0000 7fd70430a640 1 --2- 172.21.15.132:0/1289459997 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd6fc160450 0x7fd6fc0cb5e0 unknown :-1 s=CLOSED pgs=1778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.843+0000 7fd70430a640 1 --2- 172.21.15.132:0/1289459997 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd6fc0b4ec0 0x7fd6fc1f1e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.843+0000 7fd70430a640 1 -- 172.21.15.132:0/1289459997 >> 172.21.15.132:0/1289459997 conn(0x7fd6fc0cf980 msgr2=0x7fd6fc154f90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:01.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.843+0000 7fd70430a640 1 -- 172.21.15.132:0/1289459997 shutdown_connections 2023-12-20T04:53:01.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.843+0000 7fd70430a640 1 -- 172.21.15.132:0/1289459997 wait complete. 2023-12-20T04:53:01.860 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:53:01.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.958+0000 7fab2b3c3640 1 Processor -- start 2023-12-20T04:53:01.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.958+0000 7fab2b3c3640 1 -- start start 2023-12-20T04:53:01.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.959+0000 7fab2b3c3640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fab2415d110 0x7fab24069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:01.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.959+0000 7fab2b3c3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab24161ce0 con 0x7fab2415d4f0 2023-12-20T04:53:01.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.959+0000 7fab2b3c3640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fab240aca50 con 0x7fab240af210 2023-12-20T04:53:01.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.959+0000 7fab2b3c3640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fab24160df0 con 0x7fab2415d110 2023-12-20T04:53:01.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.959+0000 7fab2895e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fab2415d4f0 0x7fab240aeb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38612/0 (socket says 172.21.15.132:38612) 2023-12-20T04:53:01.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.959+0000 7fab2895e640 1 -- 172.21.15.132:0/1111522404 learned_addr learned my addr 172.21.15.132:0/1111522404 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:01.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.959+0000 7fab1bfff640 1 -- 172.21.15.132:0/1111522404 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543958208 0 0) 0x7fab24161ce0 con 0x7fab2415d4f0 2023-12-20T04:53:01.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.959+0000 7fab2915f640 1 --2- 172.21.15.132:0/1111522404 >> v2:172.21.15.187:3300/0 conn(0x7fab2415d110 0x7fab24069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:01.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab1bfff640 1 -- 172.21.15.132:0/1111522404 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fab10003520 con 0x7fab2415d4f0 2023-12-20T04:53:01.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab1bfff640 1 -- 172.21.15.132:0/1111522404 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 303517145 0 0) 0x7fab10003520 con 0x7fab2415d4f0 2023-12-20T04:53:01.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab1bfff640 1 -- 172.21.15.132:0/1111522404 >> v2:172.21.15.187:3300/0 conn(0x7fab2415d110 msgr2=0x7fab24069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:01.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab1bfff640 1 --2- 172.21.15.132:0/1111522404 >> v2:172.21.15.187:3300/0 conn(0x7fab2415d110 0x7fab24069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab1bfff640 1 -- 172.21.15.132:0/1111522404 >> v1:172.21.15.187:6789/0 conn(0x7fab240af210 legacy=0x7fab240c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:01.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab1bfff640 1 -- 172.21.15.132:0/1111522404 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab241610d0 con 0x7fab2415d4f0 2023-12-20T04:53:01.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab1bfff640 1 -- 172.21.15.132:0/1111522404 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fab14001670 con 0x7fab2415d4f0 2023-12-20T04:53:01.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab1bfff640 1 -- 172.21.15.132:0/1111522404 >> v1:172.21.15.132:6789/0 conn(0x7fab2415d4f0 legacy=0x7fab240aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:01.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab1bfff640 1 --2- 172.21.15.132:0/1111522404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab10003970 0x7fab10003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:01.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab1bfff640 1 --2- 172.21.15.132:0/1111522404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100047c0 0x7fab10004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:01.966 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab1bfff640 1 --2- 172.21.15.132:0/1111522404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab10005180 0x7fab1000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:01.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab1bfff640 1 -- 172.21.15.132:0/1111522404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab24160df0 con 0x7fab100047c0 2023-12-20T04:53:01.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab1bfff640 1 -- 172.21.15.132:0/1111522404 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab1000c020 con 0x7fab10003970 2023-12-20T04:53:01.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab1bfff640 1 -- 172.21.15.132:0/1111522404 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab1000c1e0 con 0x7fab10005180 2023-12-20T04:53:01.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab2895e640 1 --2- 172.21.15.132:0/1111522404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100047c0 0x7fab10004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:01.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab2915f640 1 --2- 172.21.15.132:0/1111522404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab10003970 0x7fab10003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:01.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab29960640 1 --2- 172.21.15.132:0/1111522404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab10005180 0x7fab1000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:01.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab2895e640 1 -- 172.21.15.132:0/1111522404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab10005180 msgr2=0x7fab1000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:01.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab2895e640 1 --2- 172.21.15.132:0/1111522404 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab10005180 0x7fab1000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab2895e640 1 -- 172.21.15.132:0/1111522404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab10003970 msgr2=0x7fab10003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:01.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab2895e640 1 --2- 172.21.15.132:0/1111522404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab10003970 0x7fab10003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab29960640 1 -- 172.21.15.132:0/1111522404 reap_dead start 2023-12-20T04:53:01.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab2895e640 1 -- 172.21.15.132:0/1111522404 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab10003520 con 0x7fab100047c0 2023-12-20T04:53:01.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.960+0000 7fab2915f640 1 --2- 172.21.15.132:0/1111522404 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab10003970 0x7fab10003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:01.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.961+0000 7fab2895e640 1 --2- 172.21.15.132:0/1111522404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100047c0 0x7fab10004c40 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fab1400c240 tx=0x7fab100057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb9a12c5f24892 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:01.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.961+0000 7fab1bfff640 1 -- 172.21.15.132:0/1111522404 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab14005ad0 con 0x7fab100047c0 2023-12-20T04:53:01.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.961+0000 7fab1bfff640 1 -- 172.21.15.132:0/1111522404 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab14005c30 con 0x7fab100047c0 2023-12-20T04:53:01.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.961+0000 7fab1bfff640 1 -- 172.21.15.132:0/1111522404 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab1402caf0 con 0x7fab100047c0 2023-12-20T04:53:01.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.961+0000 7fab2b3c3640 1 -- 172.21.15.132:0/1111522404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100047c0 msgr2=0x7fab10004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:01.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.961+0000 7fab2b3c3640 1 --2- 172.21.15.132:0/1111522404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100047c0 0x7fab10004c40 secure :-1 s=READY pgs=1780 cs=0 l=1 rev1=1 crypto rx=0x7fab1400c240 tx=0x7fab100057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.962+0000 7fab2b3c3640 1 -- 172.21.15.132:0/1111522404 shutdown_connections 2023-12-20T04:53:01.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.962+0000 7fab2b3c3640 1 --2- 172.21.15.132:0/1111522404 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100047c0 0x7fab10004c40 unknown :-1 s=CLOSED pgs=1780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.962+0000 7fab2b3c3640 1 -- 172.21.15.132:0/1111522404 >> 172.21.15.132:0/1111522404 conn(0x7fab240cfbd0 msgr2=0x7fab240cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:01.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.962+0000 7fab2b3c3640 1 -- 172.21.15.132:0/1111522404 shutdown_connections 2023-12-20T04:53:01.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.962+0000 7fab2b3c3640 1 -- 172.21.15.132:0/1111522404 wait complete. 2023-12-20T04:53:01.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.963+0000 7fab2b3c3640 1 Processor -- start 2023-12-20T04:53:01.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.963+0000 7fab2b3c3640 1 -- start start 2023-12-20T04:53:01.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.963+0000 7fab2b3c3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100047c0 0x7fab24160060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:01.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.963+0000 7fab2b3c3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab240c6ca0 0x7fab2406d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:01.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.963+0000 7fab2b3c3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab241502f0 0x7fab24150770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:01.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.963+0000 7fab2b3c3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab24150cb0 con 0x7fab100047c0 2023-12-20T04:53:01.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.963+0000 7fab2b3c3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab240c7de0 con 0x7fab241502f0 2023-12-20T04:53:01.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.963+0000 7fab2b3c3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fab240c71d0 con 0x7fab240c6ca0 2023-12-20T04:53:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.964+0000 7fab2915f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100047c0 0x7fab24160060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.964+0000 7fab2915f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100047c0 0x7fab24160060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59226/0 (socket says 172.21.15.132:59226) 2023-12-20T04:53:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.964+0000 7fab2915f640 1 -- 172.21.15.132:0/2237832043 learned_addr learned my addr 172.21.15.132:0/2237832043 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.964+0000 7fab2895e640 1 --2- 172.21.15.132:0/2237832043 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab240c6ca0 0x7fab2406d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.964+0000 7fab29960640 1 --2- 172.21.15.132:0/2237832043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab241502f0 0x7fab24150770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.964+0000 7fab2915f640 1 -- 172.21.15.132:0/2237832043 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab240c6ca0 msgr2=0x7fab2406d9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.964+0000 7fab2915f640 1 --2- 172.21.15.132:0/2237832043 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab240c6ca0 0x7fab2406d9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.964+0000 7fab2915f640 1 -- 172.21.15.132:0/2237832043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab241502f0 msgr2=0x7fab24150770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.964+0000 7fab2915f640 1 --2- 172.21.15.132:0/2237832043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab241502f0 0x7fab24150770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.964+0000 7fab2915f640 1 -- 172.21.15.132:0/2237832043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab240c74b0 con 0x7fab100047c0 2023-12-20T04:53:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.964+0000 7fab2895e640 1 --2- 172.21.15.132:0/2237832043 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab240c6ca0 0x7fab2406d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.964+0000 7fab2915f640 1 --2- 172.21.15.132:0/2237832043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100047c0 0x7fab24160060 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fab20007f30 tx=0x7fab20010650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.964+0000 7fab19ffb640 1 -- 172.21.15.132:0/2237832043 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab2000e050 con 0x7fab100047c0 2023-12-20T04:53:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.964+0000 7fab19ffb640 1 -- 172.21.15.132:0/2237832043 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fab2000f040 con 0x7fab100047c0 2023-12-20T04:53:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.964+0000 7fab2b3c3640 1 -- 172.21.15.132:0/2237832043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab240c7790 con 0x7fab100047c0 2023-12-20T04:53:01.976 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.964+0000 7fab19ffb640 1 -- 172.21.15.132:0/2237832043 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fab20003bd0 con 0x7fab100047c0 2023-12-20T04:53:01.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.964+0000 7fab2b3c3640 1 -- 172.21.15.132:0/2237832043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab241605a0 con 0x7fab100047c0 2023-12-20T04:53:01.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.965+0000 7fab2b3c3640 1 -- 172.21.15.132:0/2237832043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab2404e840 con 0x7fab100047c0 2023-12-20T04:53:01.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.966+0000 7fab19ffb640 1 -- 172.21.15.132:0/2237832043 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fab20003d30 con 0x7fab100047c0 2023-12-20T04:53:01.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.966+0000 7fab19ffb640 1 --2- 172.21.15.132:0/2237832043 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab0806a430 0x7fab0806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:01.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.966+0000 7fab19ffb640 1 -- 172.21.15.132:0/2237832043 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fab20089400 con 0x7fab100047c0 2023-12-20T04:53:01.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.966+0000 7fab2895e640 1 --2- 172.21.15.132:0/2237832043 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab0806a430 0x7fab0806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:01.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.967+0000 7fab2895e640 1 --2- 172.21.15.132:0/2237832043 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab0806a430 0x7fab0806c8f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fab14034000 tx=0x7fab14009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:01.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:01.970+0000 7fab19ffb640 1 -- 172.21.15.132:0/2237832043 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fab20054d40 con 0x7fab100047c0 2023-12-20T04:53:02.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.137+0000 7fab2b3c3640 1 -- 172.21.15.132:0/2237832043 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fab24160b30 con 0x7fab100047c0 2023-12-20T04:53:02.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.137+0000 7fab19ffb640 1 -- 172.21.15.132:0/2237832043 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v182) v1 ==== 74+0+12448 (secure 0 0 0) 0x7fab20058360 con 0x7fab100047c0 2023-12-20T04:53:02.139 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:02.140 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":182,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:53:01.474697+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":21,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":171,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":167,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:53:02.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.139+0000 7fab2b3c3640 1 -- 172.21.15.132:0/2237832043 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab0806a430 msgr2=0x7fab0806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:02.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.139+0000 7fab2b3c3640 1 --2- 172.21.15.132:0/2237832043 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab0806a430 0x7fab0806c8f0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7fab14034000 tx=0x7fab14009030 comp rx=0 tx=0).stop 2023-12-20T04:53:02.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.139+0000 7fab2b3c3640 1 -- 172.21.15.132:0/2237832043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100047c0 msgr2=0x7fab24160060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:02.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.139+0000 7fab2b3c3640 1 --2- 172.21.15.132:0/2237832043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100047c0 0x7fab24160060 secure :-1 s=READY pgs=1781 cs=0 l=1 rev1=1 crypto rx=0x7fab20007f30 tx=0x7fab20010650 comp rx=0 tx=0).stop 2023-12-20T04:53:02.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.139+0000 7fab2b3c3640 1 -- 172.21.15.132:0/2237832043 shutdown_connections 2023-12-20T04:53:02.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.139+0000 7fab2b3c3640 1 --2- 172.21.15.132:0/2237832043 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fab0806a430 0x7fab0806c8f0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.139+0000 7fab2b3c3640 1 --2- 172.21.15.132:0/2237832043 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fab241502f0 0x7fab24150770 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.139+0000 7fab2b3c3640 1 --2- 172.21.15.132:0/2237832043 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fab240c6ca0 0x7fab2406d9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.139+0000 7fab2b3c3640 1 --2- 172.21.15.132:0/2237832043 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fab100047c0 0x7fab24160060 unknown :-1 s=CLOSED pgs=1781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.139+0000 7fab2b3c3640 1 -- 172.21.15.132:0/2237832043 >> 172.21.15.132:0/2237832043 conn(0x7fab240cfbd0 msgr2=0x7fab240caf30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:02.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.139+0000 7fab2b3c3640 1 -- 172.21.15.132:0/2237832043 shutdown_connections 2023-12-20T04:53:02.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.139+0000 7fab2b3c3640 1 -- 172.21.15.132:0/2237832043 wait complete. 2023-12-20T04:53:02.153 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:53:02.153 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:53:02.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.254+0000 7f1c9d969640 1 Processor -- start 2023-12-20T04:53:02.256 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.254+0000 7f1c9d969640 1 -- start start 2023-12-20T04:53:02.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.255+0000 7f1c9d969640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c9815d300 0x7f1c980d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.255+0000 7f1c9d969640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c980d17d0 0x7f1c980cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.255+0000 7f1c9d969640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c980d2920 con 0x7f1c980cfcd0 2023-12-20T04:53:02.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.255+0000 7f1c9d969640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c980d0160 con 0x7f1c9815d300 2023-12-20T04:53:02.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.255+0000 7f1c9d969640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c980d1d10 con 0x7f1c980d17d0 2023-12-20T04:53:02.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.255+0000 7f1c96ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c9815d300 0x7f1c980d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.255+0000 7f1c96ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c9815d300 0x7f1c980d1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59238/0 (socket says 172.21.15.132:59238) 2023-12-20T04:53:02.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.255+0000 7f1c96ffd640 1 -- 172.21.15.132:0/3988302597 learned_addr learned my addr 172.21.15.132:0/3988302597 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:02.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.255+0000 7f1c967fc640 1 --2- 172.21.15.132:0/3988302597 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c980d17d0 0x7f1c980cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.255+0000 7f1c96ffd640 1 -- 172.21.15.132:0/3988302597 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c980d17d0 msgr2=0x7f1c980cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:02.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.255+0000 7f1c96ffd640 1 --2- 172.21.15.132:0/3988302597 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c980d17d0 0x7f1c980cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.255+0000 7f1c96ffd640 1 -- 172.21.15.132:0/3988302597 >> v1:172.21.15.187:6789/0 conn(0x7f1c980cfcd0 legacy=0x7f1c980b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:02.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.255+0000 7f1c96ffd640 1 -- 172.21.15.132:0/3988302597 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c980d1ff0 con 0x7f1c9815d300 2023-12-20T04:53:02.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.256+0000 7f1c96ffd640 1 --2- 172.21.15.132:0/3988302597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9815d300 0x7f1c980d1290 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009870 tx=0x7f1c8802b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42abef6141332006 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:02.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.256+0000 7f1c95ffb640 1 -- 172.21.15.132:0/3988302597 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c88030840 con 0x7f1c9815d300 2023-12-20T04:53:02.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.256+0000 7f1c95ffb640 1 -- 172.21.15.132:0/3988302597 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c880309a0 con 0x7f1c9815d300 2023-12-20T04:53:02.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.256+0000 7f1c95ffb640 1 -- 172.21.15.132:0/3988302597 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c88030d30 con 0x7f1c9815d300 2023-12-20T04:53:02.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.256+0000 7f1c9d969640 1 -- 172.21.15.132:0/3988302597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9815d300 msgr2=0x7f1c980d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:02.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.256+0000 7f1c9d969640 1 --2- 172.21.15.132:0/3988302597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9815d300 0x7f1c980d1290 secure :-1 s=READY pgs=1782 cs=0 l=1 rev1=1 crypto rx=0x7f1c88009870 tx=0x7f1c8802b980 comp rx=0 tx=0).stop 2023-12-20T04:53:02.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.256+0000 7f1c9d969640 1 -- 172.21.15.132:0/3988302597 shutdown_connections 2023-12-20T04:53:02.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.256+0000 7f1c9d969640 1 --2- 172.21.15.132:0/3988302597 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c980d17d0 0x7f1c980cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.256+0000 7f1c9d969640 1 --2- 172.21.15.132:0/3988302597 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9815d300 0x7f1c980d1290 unknown :-1 s=CLOSED pgs=1782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.256+0000 7f1c9d969640 1 -- 172.21.15.132:0/3988302597 >> 172.21.15.132:0/3988302597 conn(0x7f1c9806a3d0 msgr2=0x7f1c9806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:02.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.257+0000 7f1c9d969640 1 -- 172.21.15.132:0/3988302597 shutdown_connections 2023-12-20T04:53:02.260 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.257+0000 7f1c9d969640 1 -- 172.21.15.132:0/3988302597 wait complete. 2023-12-20T04:53:02.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.258+0000 7f1c9d969640 1 Processor -- start 2023-12-20T04:53:02.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.258+0000 7f1c9d969640 1 -- start start 2023-12-20T04:53:02.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.258+0000 7f1c9d969640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c980cfcd0 0x7f1c9815d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.258+0000 7f1c9d969640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c980d17d0 0x7f1c981f31f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.258+0000 7f1c9d969640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9815d300 0x7f1c9815f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.258+0000 7f1c9d969640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c981f3730 con 0x7f1c9815d300 2023-12-20T04:53:02.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.258+0000 7f1c9d969640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9815dcc0 con 0x7f1c980cfcd0 2023-12-20T04:53:02.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.258+0000 7f1c9d969640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c9815dfa0 con 0x7f1c980d17d0 2023-12-20T04:53:02.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.259+0000 7f1c977fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9815d300 0x7f1c9815f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.259+0000 7f1c977fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9815d300 0x7f1c9815f100 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59250/0 (socket says 172.21.15.132:59250) 2023-12-20T04:53:02.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.259+0000 7f1c977fe640 1 -- 172.21.15.132:0/1134377110 learned_addr learned my addr 172.21.15.132:0/1134377110 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:02.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.259+0000 7f1c967fc640 1 --2- 172.21.15.132:0/1134377110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c980d17d0 0x7f1c981f31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.259+0000 7f1c96ffd640 1 --2- 172.21.15.132:0/1134377110 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c980cfcd0 0x7f1c9815d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.259+0000 7f1c977fe640 1 -- 172.21.15.132:0/1134377110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c980d17d0 msgr2=0x7f1c981f31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:02.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.259+0000 7f1c977fe640 1 --2- 172.21.15.132:0/1134377110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c980d17d0 0x7f1c981f31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.259+0000 7f1c977fe640 1 -- 172.21.15.132:0/1134377110 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c980cfcd0 msgr2=0x7f1c9815d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:02.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.259+0000 7f1c977fe640 1 --2- 172.21.15.132:0/1134377110 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c980cfcd0 0x7f1c9815d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.259+0000 7f1c977fe640 1 -- 172.21.15.132:0/1134377110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c880094d0 con 0x7f1c9815d300 2023-12-20T04:53:02.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.259+0000 7f1c977fe640 1 --2- 172.21.15.132:0/1134377110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9815d300 0x7f1c9815f100 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000c6b0 tx=0x7f1c9000cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:02.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.259+0000 7f1c7ffff640 1 -- 172.21.15.132:0/1134377110 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90003b70 con 0x7f1c9815d300 2023-12-20T04:53:02.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.259+0000 7f1c7ffff640 1 -- 172.21.15.132:0/1134377110 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c90003cf0 con 0x7f1c9815d300 2023-12-20T04:53:02.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.259+0000 7f1c9d969640 1 -- 172.21.15.132:0/1134377110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c9815e280 con 0x7f1c9815d300 2023-12-20T04:53:02.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.259+0000 7f1c7ffff640 1 -- 172.21.15.132:0/1134377110 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c90003ea0 con 0x7f1c9815d300 2023-12-20T04:53:02.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.259+0000 7f1c9d969640 1 -- 172.21.15.132:0/1134377110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c9815e840 con 0x7f1c9815d300 2023-12-20T04:53:02.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.260+0000 7f1c9d969640 1 -- 172.21.15.132:0/1134377110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c9804e840 con 0x7f1c9815d300 2023-12-20T04:53:02.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.261+0000 7f1c7ffff640 1 -- 172.21.15.132:0/1134377110 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1c90005310 con 0x7f1c9815d300 2023-12-20T04:53:02.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.261+0000 7f1c7ffff640 1 --2- 172.21.15.132:0/1134377110 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c8406a430 0x7f1c8406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.261+0000 7f1c7ffff640 1 -- 172.21.15.132:0/1134377110 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f1c90088200 con 0x7f1c9815d300 2023-12-20T04:53:02.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.261+0000 7f1c96ffd640 1 --2- 172.21.15.132:0/1134377110 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c8406a430 0x7f1c8406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.265 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.261+0000 7f1c96ffd640 1 --2- 172.21.15.132:0/1134377110 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c8406a430 0x7f1c8406c8f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1c88036000 tx=0x7f1c88008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:02.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.265+0000 7f1c7ffff640 1 -- 172.21.15.132:0/1134377110 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1c90053bf0 con 0x7f1c9815d300 2023-12-20T04:53:02.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.431+0000 7f1c9d969640 1 -- 172.21.15.132:0/1134377110 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f1c980b5750 con 0x7f1c9815d300 2023-12-20T04:53:02.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.431+0000 7f1c7ffff640 1 -- 172.21.15.132:0/1134377110 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v182) v1 ==== 93+0+10 (secure 0 0 0) 0x7f1c90057210 con 0x7f1c9815d300 2023-12-20T04:53:02.433 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:53:02.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.433+0000 7f1c9d969640 1 -- 172.21.15.132:0/1134377110 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c8406a430 msgr2=0x7f1c8406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:02.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.433+0000 7f1c9d969640 1 --2- 172.21.15.132:0/1134377110 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c8406a430 0x7f1c8406c8f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f1c88036000 tx=0x7f1c88008030 comp rx=0 tx=0).stop 2023-12-20T04:53:02.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.433+0000 7f1c9d969640 1 -- 172.21.15.132:0/1134377110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9815d300 msgr2=0x7f1c9815f100 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:02.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.433+0000 7f1c9d969640 1 --2- 172.21.15.132:0/1134377110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9815d300 0x7f1c9815f100 secure :-1 s=READY pgs=1783 cs=0 l=1 rev1=1 crypto rx=0x7f1c9000c6b0 tx=0x7f1c9000cb70 comp rx=0 tx=0).stop 2023-12-20T04:53:02.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.433+0000 7f1c9d969640 1 -- 172.21.15.132:0/1134377110 shutdown_connections 2023-12-20T04:53:02.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.433+0000 7f1c9d969640 1 --2- 172.21.15.132:0/1134377110 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c8406a430 0x7f1c8406c8f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.433+0000 7f1c9d969640 1 --2- 172.21.15.132:0/1134377110 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c9815d300 0x7f1c9815f100 unknown :-1 s=CLOSED pgs=1783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.433+0000 7f1c9d969640 1 --2- 172.21.15.132:0/1134377110 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c980d17d0 0x7f1c981f31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.433+0000 7f1c9d969640 1 --2- 172.21.15.132:0/1134377110 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c980cfcd0 0x7f1c9815d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.433+0000 7f1c9d969640 1 -- 172.21.15.132:0/1134377110 >> 172.21.15.132:0/1134377110 conn(0x7f1c9806a3d0 msgr2=0x7f1c980b7cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:02.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.433+0000 7f1c9d969640 1 -- 172.21.15.132:0/1134377110 shutdown_connections 2023-12-20T04:53:02.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.433+0000 7f1c9d969640 1 -- 172.21.15.132:0/1134377110 wait complete. 2023-12-20T04:53:02.447 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2023-12-20T04:53:02.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.543+0000 7f568fbf0640 1 Processor -- start 2023-12-20T04:53:02.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.544+0000 7f568fbf0640 1 -- start start 2023-12-20T04:53:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.544+0000 7f568fbf0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56880d30a0 0x7f56880cd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.544+0000 7f568fbf0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f568815d2c0 0x7f56880d3480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.544+0000 7f568fbf0640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f56880d0cf0 con 0x7f56880d0060 2023-12-20T04:53:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.544+0000 7f568fbf0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f56880d39c0 con 0x7f568815d2c0 2023-12-20T04:53:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.544+0000 7f568fbf0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f56880d0550 con 0x7f56880d30a0 2023-12-20T04:53:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.545+0000 7f568d18b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f568815d2c0 0x7f56880d3480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.545+0000 7f568d18b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f568815d2c0 0x7f56880d3480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59256/0 (socket says 172.21.15.132:59256) 2023-12-20T04:53:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.545+0000 7f568d18b640 1 -- 172.21.15.132:0/3080949400 learned_addr learned my addr 172.21.15.132:0/3080949400 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:02.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.545+0000 7f568d98c640 1 --2- 172.21.15.132:0/3080949400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56880d30a0 0x7f56880cd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.545+0000 7f568d18b640 1 -- 172.21.15.132:0/3080949400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56880d30a0 msgr2=0x7f56880cd5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:02.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.545+0000 7f568d18b640 1 --2- 172.21.15.132:0/3080949400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56880d30a0 0x7f56880cd5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.545+0000 7f568d18b640 1 -- 172.21.15.132:0/3080949400 >> v1:172.21.15.187:6789/0 conn(0x7f56880d0060 legacy=0x7f5688160c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:02.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.545+0000 7f568d18b640 1 -- 172.21.15.132:0/3080949400 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56880cddc0 con 0x7f568815d2c0 2023-12-20T04:53:02.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.546+0000 7f568d18b640 1 --2- 172.21.15.132:0/3080949400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f568815d2c0 0x7f56880d3480 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f5678009870 tx=0x7f567802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b77242d37f3c54ff server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:02.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.546+0000 7f568c98a640 1 -- 172.21.15.132:0/3080949400 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678031640 con 0x7f568815d2c0 2023-12-20T04:53:02.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.546+0000 7f568c98a640 1 -- 172.21.15.132:0/3080949400 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f56780317a0 con 0x7f568815d2c0 2023-12-20T04:53:02.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.546+0000 7f568c98a640 1 -- 172.21.15.132:0/3080949400 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678031b30 con 0x7f568815d2c0 2023-12-20T04:53:02.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.546+0000 7f568fbf0640 1 -- 172.21.15.132:0/3080949400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f568815d2c0 msgr2=0x7f56880d3480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:02.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.546+0000 7f568fbf0640 1 --2- 172.21.15.132:0/3080949400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f568815d2c0 0x7f56880d3480 secure :-1 s=READY pgs=1784 cs=0 l=1 rev1=1 crypto rx=0x7f5678009870 tx=0x7f567802b8f0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.546+0000 7f568fbf0640 1 -- 172.21.15.132:0/3080949400 shutdown_connections 2023-12-20T04:53:02.549 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.546+0000 7f568fbf0640 1 --2- 172.21.15.132:0/3080949400 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f568815d2c0 0x7f56880d3480 unknown :-1 s=CLOSED pgs=1784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.546+0000 7f568fbf0640 1 --2- 172.21.15.132:0/3080949400 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f56880d30a0 0x7f56880cd5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.546+0000 7f568fbf0640 1 -- 172.21.15.132:0/3080949400 >> 172.21.15.132:0/3080949400 conn(0x7f5688072e40 msgr2=0x7f5688073250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:02.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.546+0000 7f568fbf0640 1 -- 172.21.15.132:0/3080949400 shutdown_connections 2023-12-20T04:53:02.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.546+0000 7f568fbf0640 1 -- 172.21.15.132:0/3080949400 wait complete. 2023-12-20T04:53:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.548+0000 7f568fbf0640 1 Processor -- start 2023-12-20T04:53:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.548+0000 7f568fbf0640 1 -- start start 2023-12-20T04:53:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.548+0000 7f568fbf0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56880d0060 0x7f56880c6480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.548+0000 7f568fbf0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880d30a0 0x7f5688159f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.548+0000 7f568fbf0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f568815d2c0 0x7f56880b7000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.548+0000 7f568fbf0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568815aae0 con 0x7f56880d30a0 2023-12-20T04:53:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.548+0000 7f568fbf0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f568815da60 con 0x7f56880d0060 2023-12-20T04:53:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.548+0000 7f568fbf0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f568815dd40 con 0x7f568815d2c0 2023-12-20T04:53:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.548+0000 7f568d18b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880d30a0 0x7f5688159f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.548+0000 7f568d18b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880d30a0 0x7f5688159f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59272/0 (socket says 172.21.15.132:59272) 2023-12-20T04:53:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.548+0000 7f568d18b640 1 -- 172.21.15.132:0/3788927913 learned_addr learned my addr 172.21.15.132:0/3788927913 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:02.553 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.549+0000 7f568d98c640 1 --2- 172.21.15.132:0/3788927913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56880d0060 0x7f56880c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.549+0000 7f568e18d640 1 --2- 172.21.15.132:0/3788927913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f568815d2c0 0x7f56880b7000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.549+0000 7f568d18b640 1 -- 172.21.15.132:0/3788927913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f568815d2c0 msgr2=0x7f56880b7000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.549+0000 7f568d18b640 1 --2- 172.21.15.132:0/3788927913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f568815d2c0 0x7f56880b7000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.549+0000 7f568d18b640 1 -- 172.21.15.132:0/3788927913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56880d0060 msgr2=0x7f56880c6480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.549+0000 7f568d18b640 1 --2- 172.21.15.132:0/3788927913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56880d0060 0x7f56880c6480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.549+0000 7f568d18b640 1 -- 172.21.15.132:0/3788927913 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56780094d0 con 0x7f56880d30a0 2023-12-20T04:53:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.549+0000 7f568e18d640 1 --2- 172.21.15.132:0/3788927913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f568815d2c0 0x7f56880b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.549+0000 7f568d18b640 1 --2- 172.21.15.132:0/3788927913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880d30a0 0x7f5688159f40 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f5678009870 tx=0x7f56780046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.549+0000 7f567e7fc640 1 -- 172.21.15.132:0/3788927913 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f567803ac60 con 0x7f56880d30a0 2023-12-20T04:53:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.549+0000 7f567e7fc640 1 -- 172.21.15.132:0/3788927913 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f567803ade0 con 0x7f56880d30a0 2023-12-20T04:53:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.549+0000 7f568fbf0640 1 -- 172.21.15.132:0/3788927913 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f568815e020 con 0x7f56880d30a0 2023-12-20T04:53:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.549+0000 7f567e7fc640 1 -- 172.21.15.132:0/3788927913 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5678044630 con 0x7f56880d30a0 2023-12-20T04:53:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.549+0000 7f568fbf0640 1 -- 172.21.15.132:0/3788927913 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f568815e5e0 con 0x7f56880d30a0 2023-12-20T04:53:02.554 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.550+0000 7f568fbf0640 1 -- 172.21.15.132:0/3788927913 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f568804e840 con 0x7f56880d30a0 2023-12-20T04:53:02.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.550+0000 7f567e7fc640 1 -- 172.21.15.132:0/3788927913 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f567802f050 con 0x7f56880d30a0 2023-12-20T04:53:02.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.551+0000 7f567e7fc640 1 --2- 172.21.15.132:0/3788927913 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f566c06a430 0x7f566c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.551+0000 7f567e7fc640 1 -- 172.21.15.132:0/3788927913 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4857+0+0 (secure 0 0 0) 0x7f56780aa530 con 0x7f56880d30a0 2023-12-20T04:53:02.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.551+0000 7f568d98c640 1 --2- 172.21.15.132:0/3788927913 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f566c06a430 0x7f566c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.551+0000 7f568d98c640 1 --2- 172.21.15.132:0/3788927913 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f566c06a430 0x7f566c06c8f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5684006fd0 tx=0x7f5684008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:02.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.555+0000 7f567e7fc640 1 -- 172.21.15.132:0/3788927913 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5678075e70 con 0x7f56880d30a0 2023-12-20T04:53:02.723 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.721+0000 7f568fbf0640 1 -- 172.21.15.132:0/3788927913 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) v1 -- 0x7f56880cdba0 con 0x7f56880d30a0 2023-12-20T04:53:02.724 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.722+0000 7f567e7fc640 1 -- 172.21.15.132:0/3788927913 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v182) v1 ==== 84+0+65 (secure 0 0 0) 0x7f5678031e60 con 0x7f56880d30a0 2023-12-20T04:53:02.724 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:02.724 INFO:teuthology.orchestra.run.smithi132.stdout:[ 2023-12-20T04:53:02.724 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:02.724 INFO:teuthology.orchestra.run.smithi132.stdout: "poolnum": 1, 2023-12-20T04:53:02.725 INFO:teuthology.orchestra.run.smithi132.stdout: "poolname": ".mgr" 2023-12-20T04:53:02.725 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:02.725 INFO:teuthology.orchestra.run.smithi132.stdout:] 2023-12-20T04:53:02.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.724+0000 7f568fbf0640 1 -- 172.21.15.132:0/3788927913 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f566c06a430 msgr2=0x7f566c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:02.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.724+0000 7f568fbf0640 1 --2- 172.21.15.132:0/3788927913 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f566c06a430 0x7f566c06c8f0 secure :-1 s=READY pgs=752 cs=0 l=1 rev1=1 crypto rx=0x7f5684006fd0 tx=0x7f5684008040 comp rx=0 tx=0).stop 2023-12-20T04:53:02.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.724+0000 7f568fbf0640 1 -- 172.21.15.132:0/3788927913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880d30a0 msgr2=0x7f5688159f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:02.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.724+0000 7f568fbf0640 1 --2- 172.21.15.132:0/3788927913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880d30a0 0x7f5688159f40 secure :-1 s=READY pgs=1785 cs=0 l=1 rev1=1 crypto rx=0x7f5678009870 tx=0x7f56780046c0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.724+0000 7f568fbf0640 1 -- 172.21.15.132:0/3788927913 shutdown_connections 2023-12-20T04:53:02.726 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.724+0000 7f568fbf0640 1 --2- 172.21.15.132:0/3788927913 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f566c06a430 0x7f566c06c8f0 unknown :-1 s=CLOSED pgs=752 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.724+0000 7f568fbf0640 1 --2- 172.21.15.132:0/3788927913 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f568815d2c0 0x7f56880b7000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.724+0000 7f568fbf0640 1 --2- 172.21.15.132:0/3788927913 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f56880d30a0 0x7f5688159f40 unknown :-1 s=CLOSED pgs=1785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.724+0000 7f568fbf0640 1 --2- 172.21.15.132:0/3788927913 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f56880d0060 0x7f56880c6480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.724+0000 7f568fbf0640 1 -- 172.21.15.132:0/3788927913 >> 172.21.15.132:0/3788927913 conn(0x7f5688072e40 msgr2=0x7f56880b3380 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:02.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.724+0000 7f568fbf0640 1 -- 172.21.15.132:0/3788927913 shutdown_connections 2023-12-20T04:53:02.727 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.724+0000 7f568fbf0640 1 -- 172.21.15.132:0/3788927913 wait complete. 2023-12-20T04:53:02.737 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2023-12-20T04:53:02.737 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2023-12-20T04:53:02.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.838+0000 7fcf4c73c640 1 Processor -- start 2023-12-20T04:53:02.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.838+0000 7fcf4c73c640 1 -- start start 2023-12-20T04:53:02.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.839+0000 7fcf4c73c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcf440cf590 0x7fcf4415d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.839+0000 7fcf4c73c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf4415d800 0x7fcf44069c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.839+0000 7fcf4c73c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcf4406cbe0 con 0x7fcf4415cee0 2023-12-20T04:53:02.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.839+0000 7fcf4c73c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcf440cfa20 con 0x7fcf440cf590 2023-12-20T04:53:02.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.839+0000 7fcf4c73c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf4415de00 con 0x7fcf4415d800 2023-12-20T04:53:02.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.839+0000 7fcf49cd7640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcf440cf590 0x7fcf4415d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.839+0000 7fcf4acd9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf4415d800 0x7fcf44069c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.839+0000 7fcf4a4d8640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7fcf4415cee0 0x7fcf4406c4d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:55304/0 (socket says 172.21.15.132:55304) 2023-12-20T04:53:02.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.839+0000 7fcf49cd7640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcf440cf590 0x7fcf4415d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:57512/0 (socket says 172.21.15.132:57512) 2023-12-20T04:53:02.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.839+0000 7fcf4a4d8640 1 -- 172.21.15.132:0/695728158 learned_addr learned my addr 172.21.15.132:0/695728158 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:02.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.840+0000 7fcf494d6640 1 -- 172.21.15.132:0/695728158 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2450464034 0 0) 0x7fcf4406cbe0 con 0x7fcf4415cee0 2023-12-20T04:53:02.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.840+0000 7fcf494d6640 1 -- 172.21.15.132:0/695728158 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcf30003520 con 0x7fcf4415cee0 2023-12-20T04:53:02.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.840+0000 7fcf4acd9640 1 -- 172.21.15.132:0/695728158 >> v2:172.21.15.187:3300/0 conn(0x7fcf440cf590 msgr2=0x7fcf4415d2c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:02.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.840+0000 7fcf4acd9640 1 --2- 172.21.15.132:0/695728158 >> v2:172.21.15.187:3300/0 conn(0x7fcf440cf590 0x7fcf4415d2c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.840+0000 7fcf4acd9640 1 -- 172.21.15.132:0/695728158 >> v1:172.21.15.187:6789/0 conn(0x7fcf4415cee0 legacy=0x7fcf4406c4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:02.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.840+0000 7fcf4acd9640 1 -- 172.21.15.132:0/695728158 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf4415e0e0 con 0x7fcf4415d800 2023-12-20T04:53:02.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.840+0000 7fcf49cd7640 1 --2- 172.21.15.132:0/695728158 >> v2:172.21.15.187:3300/0 conn(0x7fcf440cf590 0x7fcf4415d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:53:02.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.841+0000 7fcf4acd9640 1 --2- 172.21.15.132:0/695728158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf4415d800 0x7fcf44069c30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009d90 tx=0x7fcf3c02bea0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ed201ea87afcdb93 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:02.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.841+0000 7fcf494d6640 1 -- 172.21.15.132:0/695728158 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c02cc50 con 0x7fcf4415d800 2023-12-20T04:53:02.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.841+0000 7fcf494d6640 1 -- 172.21.15.132:0/695728158 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3c02cdb0 con 0x7fcf4415d800 2023-12-20T04:53:02.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.841+0000 7fcf494d6640 1 -- 172.21.15.132:0/695728158 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3c034640 con 0x7fcf4415d800 2023-12-20T04:53:02.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.841+0000 7fcf4c73c640 1 -- 172.21.15.132:0/695728158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf4415d800 msgr2=0x7fcf44069c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:02.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.841+0000 7fcf4c73c640 1 --2- 172.21.15.132:0/695728158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf4415d800 0x7fcf44069c30 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcf3c009d90 tx=0x7fcf3c02bea0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.841+0000 7fcf4c73c640 1 -- 172.21.15.132:0/695728158 shutdown_connections 2023-12-20T04:53:02.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.841+0000 7fcf4c73c640 1 --2- 172.21.15.132:0/695728158 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf4415d800 0x7fcf44069c30 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.841+0000 7fcf4c73c640 1 --2- 172.21.15.132:0/695728158 >> v2:172.21.15.187:3300/0 conn(0x7fcf440cf590 0x7fcf4415d2c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.841+0000 7fcf4c73c640 1 -- 172.21.15.132:0/695728158 >> 172.21.15.132:0/695728158 conn(0x7fcf440b16b0 msgr2=0x7fcf440b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:02.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.841+0000 7fcf4c73c640 1 -- 172.21.15.132:0/695728158 shutdown_connections 2023-12-20T04:53:02.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.841+0000 7fcf4c73c640 1 -- 172.21.15.132:0/695728158 wait complete. 2023-12-20T04:53:02.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.842+0000 7fcf4c73c640 1 Processor -- start 2023-12-20T04:53:02.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.843+0000 7fcf4c73c640 1 -- start start 2023-12-20T04:53:02.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.843+0000 7fcf4c73c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf440cf590 0x7fcf440cb6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.843+0000 7fcf4c73c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf4415cee0 0x7fcf440c5c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.843+0000 7fcf4c73c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf4415d800 0x7fcf4415fba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.843+0000 7fcf4c73c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440b2d40 con 0x7fcf4415cee0 2023-12-20T04:53:02.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.843+0000 7fcf4c73c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440b3020 con 0x7fcf4415d800 2023-12-20T04:53:02.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.843+0000 7fcf4c73c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcf440b3300 con 0x7fcf440cf590 2023-12-20T04:53:02.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.843+0000 7fcf49cd7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf4415cee0 0x7fcf440c5c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.843+0000 7fcf49cd7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf4415cee0 0x7fcf440c5c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59278/0 (socket says 172.21.15.132:59278) 2023-12-20T04:53:02.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.843+0000 7fcf49cd7640 1 -- 172.21.15.132:0/1019059040 learned_addr learned my addr 172.21.15.132:0/1019059040 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:02.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.843+0000 7fcf4acd9640 1 --2- 172.21.15.132:0/1019059040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf4415d800 0x7fcf4415fba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.844+0000 7fcf4a4d8640 1 --2- 172.21.15.132:0/1019059040 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf440cf590 0x7fcf440cb6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.844+0000 7fcf49cd7640 1 -- 172.21.15.132:0/1019059040 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf440cf590 msgr2=0x7fcf440cb6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:02.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.844+0000 7fcf49cd7640 1 --2- 172.21.15.132:0/1019059040 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf440cf590 0x7fcf440cb6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.844+0000 7fcf49cd7640 1 -- 172.21.15.132:0/1019059040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf4415d800 msgr2=0x7fcf4415fba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:02.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.844+0000 7fcf49cd7640 1 --2- 172.21.15.132:0/1019059040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf4415d800 0x7fcf4415fba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:02.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.844+0000 7fcf49cd7640 1 -- 172.21.15.132:0/1019059040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcf34009400 con 0x7fcf4415cee0 2023-12-20T04:53:02.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.844+0000 7fcf49cd7640 1 --2- 172.21.15.132:0/1019059040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf4415cee0 0x7fcf440c5c80 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400ebe0 tx=0x7fcf3400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:02.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.844+0000 7fcf3affd640 1 -- 172.21.15.132:0/1019059040 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf34009760 con 0x7fcf4415cee0 2023-12-20T04:53:02.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.844+0000 7fcf3affd640 1 -- 172.21.15.132:0/1019059040 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcf3400cc30 con 0x7fcf4415cee0 2023-12-20T04:53:02.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.844+0000 7fcf4c73c640 1 -- 172.21.15.132:0/1019059040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcf3c009a70 con 0x7fcf4415cee0 2023-12-20T04:53:02.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.844+0000 7fcf3affd640 1 -- 172.21.15.132:0/1019059040 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcf3400eee0 con 0x7fcf4415cee0 2023-12-20T04:53:02.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.844+0000 7fcf4c73c640 1 -- 172.21.15.132:0/1019059040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcf440b38c0 con 0x7fcf4415cee0 2023-12-20T04:53:02.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.845+0000 7fcf4c73c640 1 -- 172.21.15.132:0/1019059040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcf440b3a80 con 0x7fcf4415cee0 2023-12-20T04:53:02.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.845+0000 7fcf3affd640 1 -- 172.21.15.132:0/1019059040 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcf34013470 con 0x7fcf4415cee0 2023-12-20T04:53:02.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.846+0000 7fcf3affd640 1 --2- 172.21.15.132:0/1019059040 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf2806a430 0x7fcf2806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:02.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.846+0000 7fcf3affd640 1 -- 172.21.15.132:0/1019059040 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(182..182 src has 1..182) v4 ==== 4857+0+0 (secure 0 0 0) 0x7fcf34088840 con 0x7fcf4415cee0 2023-12-20T04:53:02.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.846+0000 7fcf4a4d8640 1 --2- 172.21.15.132:0/1019059040 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf2806a430 0x7fcf2806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:02.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.846+0000 7fcf4a4d8640 1 --2- 172.21.15.132:0/1019059040 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf2806a430 0x7fcf2806c8f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fcf40000f60 tx=0x7fcf40009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:02.852 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:02.850+0000 7fcf3affd640 1 -- 172.21.15.132:0/1019059040 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcf34054210 con 0x7fcf4415cee0 2023-12-20T04:53:03.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.015+0000 7fcf4c73c640 1 -- 172.21.15.132:0/1019059040 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) v1 -- 0x7fcf4406a140 con 0x7fcf4415cee0 2023-12-20T04:53:03.495 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.492+0000 7fcf3affd640 1 -- 172.21.15.132:0/1019059040 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v183) v1 ==== 138+0+0 (secure 0 0 0) 0x7fcf34057830 con 0x7fcf4415cee0 2023-12-20T04:53:03.495 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' created 2023-12-20T04:53:03.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.496+0000 7fcf4c73c640 1 -- 172.21.15.132:0/1019059040 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf2806a430 msgr2=0x7fcf2806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:03.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.496+0000 7fcf4c73c640 1 --2- 172.21.15.132:0/1019059040 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf2806a430 0x7fcf2806c8f0 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7fcf40000f60 tx=0x7fcf40009040 comp rx=0 tx=0).stop 2023-12-20T04:53:03.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.496+0000 7fcf4c73c640 1 -- 172.21.15.132:0/1019059040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf4415cee0 msgr2=0x7fcf440c5c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:03.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.496+0000 7fcf4c73c640 1 --2- 172.21.15.132:0/1019059040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf4415cee0 0x7fcf440c5c80 secure :-1 s=READY pgs=1786 cs=0 l=1 rev1=1 crypto rx=0x7fcf3400ebe0 tx=0x7fcf3400c520 comp rx=0 tx=0).stop 2023-12-20T04:53:03.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.496+0000 7fcf4c73c640 1 -- 172.21.15.132:0/1019059040 shutdown_connections 2023-12-20T04:53:03.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.496+0000 7fcf4c73c640 1 --2- 172.21.15.132:0/1019059040 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcf2806a430 0x7fcf2806c8f0 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:03.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.496+0000 7fcf4c73c640 1 --2- 172.21.15.132:0/1019059040 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcf4415d800 0x7fcf4415fba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:03.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.496+0000 7fcf4c73c640 1 --2- 172.21.15.132:0/1019059040 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcf4415cee0 0x7fcf440c5c80 unknown :-1 s=CLOSED pgs=1786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:03.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.496+0000 7fcf4c73c640 1 --2- 172.21.15.132:0/1019059040 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcf440cf590 0x7fcf440cb6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:03.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.496+0000 7fcf4c73c640 1 -- 172.21.15.132:0/1019059040 >> 172.21.15.132:0/1019059040 conn(0x7fcf440b16b0 msgr2=0x7fcf440b1a90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:03.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.497+0000 7fcf4c73c640 1 -- 172.21.15.132:0/1019059040 shutdown_connections 2023-12-20T04:53:03.499 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.497+0000 7fcf4c73c640 1 -- 172.21.15.132:0/1019059040 wait complete. 2023-12-20T04:53:03.510 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.9 2023-12-20T04:53:03.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.616+0000 7f1e7385c640 1 Processor -- start 2023-12-20T04:53:03.618 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.616+0000 7f1e7385c640 1 -- start start 2023-12-20T04:53:03.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.617+0000 7f1e7385c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1e6c15aee0 0x7f1e6c15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:03.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.617+0000 7f1e7385c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f1e6c0cb2b0 0x7f1e6c0cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:03.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.617+0000 7f1e7385c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1e6c0ce000 con 0x7f1e6c0cdbb0 2023-12-20T04:53:03.619 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.617+0000 7f1e7385c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c0d0130 con 0x7f1e6c15aee0 2023-12-20T04:53:03.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.617+0000 7f1e7385c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1e6c15f370 con 0x7f1e6c0cb2b0 2023-12-20T04:53:03.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.617+0000 7f1e715f8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1e6c15aee0 0x7f1e6c15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:03.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.617+0000 7f1e715f8640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1e6c15aee0 0x7f1e6c15eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59282/0 (socket says 172.21.15.132:59282) 2023-12-20T04:53:03.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.617+0000 7f1e71df9640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1e6c0cdbb0 0x7f1e6c0ceb60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38616/0 (socket says 172.21.15.132:38616) 2023-12-20T04:53:03.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.617+0000 7f1e715f8640 1 -- 172.21.15.132:0/3075301601 learned_addr learned my addr 172.21.15.132:0/3075301601 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:03.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.617+0000 7f1e70df7640 1 --2- 172.21.15.132:0/3075301601 >> v2:172.21.15.187:3300/0 conn(0x7f1e6c0cb2b0 0x7f1e6c0cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:03.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.617+0000 7f1e715f8640 1 -- 172.21.15.132:0/3075301601 >> v2:172.21.15.187:3300/0 conn(0x7f1e6c0cb2b0 msgr2=0x7f1e6c0cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:03.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.617+0000 7f1e715f8640 1 --2- 172.21.15.132:0/3075301601 >> v2:172.21.15.187:3300/0 conn(0x7f1e6c0cb2b0 0x7f1e6c0cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:03.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.617+0000 7f1e715f8640 1 -- 172.21.15.132:0/3075301601 >> v1:172.21.15.132:6789/0 conn(0x7f1e6c0cdbb0 legacy=0x7f1e6c0ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:03.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.617+0000 7f1e715f8640 1 -- 172.21.15.132:0/3075301601 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e6c15f650 con 0x7f1e6c15aee0 2023-12-20T04:53:03.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.617+0000 7f1e63fff640 1 -- 172.21.15.132:0/3075301601 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4225480931 0 0) 0x7f1e64001490 con 0x7f1e6c0cdbb0 2023-12-20T04:53:03.620 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.617+0000 7f1e70df7640 1 --2- 172.21.15.132:0/3075301601 >> v2:172.21.15.187:3300/0 conn(0x7f1e6c0cb2b0 0x7f1e6c0cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:03.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.618+0000 7f1e715f8640 1 --2- 172.21.15.132:0/3075301601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e6c15aee0 0x7f1e6c15eb40 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009870 tx=0x7f1e5c02b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a8d9a8a8305e533 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:03.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.618+0000 7f1e63fff640 1 -- 172.21.15.132:0/3075301601 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c030860 con 0x7f1e6c15aee0 2023-12-20T04:53:03.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.618+0000 7f1e63fff640 1 -- 172.21.15.132:0/3075301601 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e5c0309c0 con 0x7f1e6c15aee0 2023-12-20T04:53:03.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.618+0000 7f1e63fff640 1 -- 172.21.15.132:0/3075301601 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e5c030d50 con 0x7f1e6c15aee0 2023-12-20T04:53:03.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.619+0000 7f1e7385c640 1 -- 172.21.15.132:0/3075301601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e6c15aee0 msgr2=0x7f1e6c15eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:03.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.619+0000 7f1e7385c640 1 --2- 172.21.15.132:0/3075301601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e6c15aee0 0x7f1e6c15eb40 secure :-1 s=READY pgs=1788 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c009870 tx=0x7f1e5c02b9a0 comp rx=0 tx=0).stop 2023-12-20T04:53:03.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.619+0000 7f1e7385c640 1 -- 172.21.15.132:0/3075301601 shutdown_connections 2023-12-20T04:53:03.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.619+0000 7f1e7385c640 1 --2- 172.21.15.132:0/3075301601 >> v2:172.21.15.187:3300/0 conn(0x7f1e6c0cb2b0 0x7f1e6c0cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:03.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.619+0000 7f1e7385c640 1 --2- 172.21.15.132:0/3075301601 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e6c15aee0 0x7f1e6c15eb40 unknown :-1 s=CLOSED pgs=1788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:03.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.619+0000 7f1e7385c640 1 -- 172.21.15.132:0/3075301601 >> 172.21.15.132:0/3075301601 conn(0x7f1e6c072c60 msgr2=0x7f1e6c073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:03.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.619+0000 7f1e7385c640 1 -- 172.21.15.132:0/3075301601 shutdown_connections 2023-12-20T04:53:03.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.619+0000 7f1e7385c640 1 -- 172.21.15.132:0/3075301601 wait complete. 2023-12-20T04:53:03.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.620+0000 7f1e7385c640 1 Processor -- start 2023-12-20T04:53:03.622 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.620+0000 7f1e7385c640 1 -- start start 2023-12-20T04:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e7385c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e6c0cb2b0 0x7f1e6c158bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e7385c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e6c0cdbb0 0x7f1e6c1f3cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e7385c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e6c15aee0 0x7f1e6c152470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e7385c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c14ffa0 con 0x7f1e6c0cdbb0 2023-12-20T04:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e7385c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c14bb80 con 0x7f1e6c15aee0 2023-12-20T04:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e7385c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1e6c1f4510 con 0x7f1e6c0cb2b0 2023-12-20T04:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e70df7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e6c0cdbb0 0x7f1e6c1f3cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e70df7640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e6c0cdbb0 0x7f1e6c1f3cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59288/0 (socket says 172.21.15.132:59288) 2023-12-20T04:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e70df7640 1 -- 172.21.15.132:0/1677762968 learned_addr learned my addr 172.21.15.132:0/1677762968 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e71df9640 1 --2- 172.21.15.132:0/1677762968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e6c15aee0 0x7f1e6c152470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e715f8640 1 --2- 172.21.15.132:0/1677762968 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e6c0cb2b0 0x7f1e6c158bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e70df7640 1 -- 172.21.15.132:0/1677762968 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e6c0cb2b0 msgr2=0x7f1e6c158bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:03.625 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e70df7640 1 --2- 172.21.15.132:0/1677762968 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e6c0cb2b0 0x7f1e6c158bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e70df7640 1 -- 172.21.15.132:0/1677762968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e6c15aee0 msgr2=0x7f1e6c152470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e70df7640 1 --2- 172.21.15.132:0/1677762968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e6c15aee0 0x7f1e6c152470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e70df7640 1 -- 172.21.15.132:0/1677762968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1e5c0094d0 con 0x7f1e6c0cdbb0 2023-12-20T04:53:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e70df7640 1 --2- 172.21.15.132:0/1677762968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e6c0cdbb0 0x7f1e6c1f3cc0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800c7f0 tx=0x7f1e6800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e61ffb640 1 -- 172.21.15.132:0/1677762968 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e68007820 con 0x7f1e6c0cdbb0 2023-12-20T04:53:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e61ffb640 1 -- 172.21.15.132:0/1677762968 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1e68007980 con 0x7f1e6c0cdbb0 2023-12-20T04:53:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e7385c640 1 -- 172.21.15.132:0/1677762968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1e6c1f47f0 con 0x7f1e6c0cdbb0 2023-12-20T04:53:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e61ffb640 1 -- 172.21.15.132:0/1677762968 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1e68007cf0 con 0x7f1e6c0cdbb0 2023-12-20T04:53:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.621+0000 7f1e7385c640 1 -- 172.21.15.132:0/1677762968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1e6c14fbc0 con 0x7f1e6c0cdbb0 2023-12-20T04:53:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.622+0000 7f1e7385c640 1 -- 172.21.15.132:0/1677762968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1e6c15f060 con 0x7f1e6c0cdbb0 2023-12-20T04:53:03.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.623+0000 7f1e61ffb640 1 -- 172.21.15.132:0/1677762968 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1e680113f0 con 0x7f1e6c0cdbb0 2023-12-20T04:53:03.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.623+0000 7f1e61ffb640 1 --2- 172.21.15.132:0/1677762968 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1e5006a430 0x7f1e5006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:03.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.623+0000 7f1e61ffb640 1 -- 172.21.15.132:0/1677762968 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(183..183 src has 1..183) v4 ==== 5227+0+0 (secure 0 0 0) 0x7f1e68088a90 con 0x7f1e6c0cdbb0 2023-12-20T04:53:03.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.623+0000 7f1e715f8640 1 --2- 172.21.15.132:0/1677762968 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1e5006a430 0x7f1e5006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:03.627 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.624+0000 7f1e715f8640 1 --2- 172.21.15.132:0/1677762968 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1e5006a430 0x7f1e5006c8f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c036000 tx=0x7f1e5c008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:03.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.628+0000 7f1e61ffb640 1 -- 172.21.15.132:0/1677762968 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1e6c15f060 con 0x7f1e6c0cdbb0 2023-12-20T04:53:03.795 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:03.793+0000 7f1e7385c640 1 -- 172.21.15.132:0/1677762968 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9} v 0) v1 -- 0x7f1e6c15f060 con 0x7f1e6c0cdbb0 2023-12-20T04:53:04.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.500+0000 7f1e61ffb640 1 -- 172.21.15.132:0/1677762968 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data' created v184) v1 ==== 170+0+0 (secure 0 0 0) 0x7f1e6c15f060 con 0x7f1e6c0cdbb0 2023-12-20T04:53:04.504 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' created 2023-12-20T04:53:04.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.506+0000 7f1e7385c640 1 -- 172.21.15.132:0/1677762968 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1e5006a430 msgr2=0x7f1e5006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:04.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.506+0000 7f1e7385c640 1 --2- 172.21.15.132:0/1677762968 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1e5006a430 0x7f1e5006c8f0 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f1e5c036000 tx=0x7f1e5c008030 comp rx=0 tx=0).stop 2023-12-20T04:53:04.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.506+0000 7f1e7385c640 1 -- 172.21.15.132:0/1677762968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e6c0cdbb0 msgr2=0x7f1e6c1f3cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:04.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.506+0000 7f1e7385c640 1 --2- 172.21.15.132:0/1677762968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e6c0cdbb0 0x7f1e6c1f3cc0 secure :-1 s=READY pgs=1789 cs=0 l=1 rev1=1 crypto rx=0x7f1e6800c7f0 tx=0x7f1e6800ccb0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.507+0000 7f1e7385c640 1 -- 172.21.15.132:0/1677762968 shutdown_connections 2023-12-20T04:53:04.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.507+0000 7f1e7385c640 1 --2- 172.21.15.132:0/1677762968 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1e5006a430 0x7f1e5006c8f0 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.507+0000 7f1e7385c640 1 --2- 172.21.15.132:0/1677762968 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1e6c15aee0 0x7f1e6c152470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.507+0000 7f1e7385c640 1 --2- 172.21.15.132:0/1677762968 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1e6c0cdbb0 0x7f1e6c1f3cc0 unknown :-1 s=CLOSED pgs=1789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.507+0000 7f1e7385c640 1 --2- 172.21.15.132:0/1677762968 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1e6c0cb2b0 0x7f1e6c158bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.507+0000 7f1e7385c640 1 -- 172.21.15.132:0/1677762968 >> 172.21.15.132:0/1677762968 conn(0x7f1e6c072c60 msgr2=0x7f1e6c0ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:04.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.508+0000 7f1e7385c640 1 -- 172.21.15.132:0/1677762968 shutdown_connections 2023-12-20T04:53:04.510 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.508+0000 7f1e7385c640 1 -- 172.21.15.132:0/1677762968 wait complete. 2023-12-20T04:53:04.523 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2023-12-20T04:53:04.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.624+0000 7f9ce88b9640 1 Processor -- start 2023-12-20T04:53:04.626 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.624+0000 7f9ce88b9640 1 -- start start 2023-12-20T04:53:04.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.625+0000 7f9ce88b9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9ce415d300 0x7f9ce40d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:04.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.625+0000 7f9ce88b9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9ce40d17d0 0x7f9ce40cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:04.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.625+0000 7f9ce88b9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9ce40d2920 con 0x7f9ce40cfcd0 2023-12-20T04:53:04.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.625+0000 7f9ce88b9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce40d00e0 con 0x7f9ce415d300 2023-12-20T04:53:04.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.625+0000 7f9ce88b9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9ce40d1d10 con 0x7f9ce40d17d0 2023-12-20T04:53:04.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.625+0000 7f9ce259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9ce415d300 0x7f9ce40d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:04.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.625+0000 7f9ce2d9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f9ce40cfcd0 0x7f9ce40b48f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38632/0 (socket says 172.21.15.132:38632) 2023-12-20T04:53:04.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.625+0000 7f9ce2d9d640 1 -- 172.21.15.132:0/2837246459 learned_addr learned my addr 172.21.15.132:0/2837246459 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:04.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.625+0000 7f9ce259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9ce415d300 0x7f9ce40d1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59300/0 (socket says 172.21.15.132:59300) 2023-12-20T04:53:04.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.626+0000 7f9ce1d9b640 1 --2- 172.21.15.132:0/2837246459 >> v2:172.21.15.187:3300/0 conn(0x7f9ce40d17d0 0x7f9ce40cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:04.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.626+0000 7f9ce259c640 1 -- 172.21.15.132:0/2837246459 >> v2:172.21.15.187:3300/0 conn(0x7f9ce40d17d0 msgr2=0x7f9ce40cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:04.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.626+0000 7f9ce259c640 1 --2- 172.21.15.132:0/2837246459 >> v2:172.21.15.187:3300/0 conn(0x7f9ce40d17d0 0x7f9ce40cf790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.626+0000 7f9ce259c640 1 -- 172.21.15.132:0/2837246459 >> v1:172.21.15.132:6789/0 conn(0x7f9ce40cfcd0 legacy=0x7f9ce40b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:04.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.626+0000 7f9ce259c640 1 -- 172.21.15.132:0/2837246459 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ce40d1ff0 con 0x7f9ce415d300 2023-12-20T04:53:04.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.626+0000 7f9ce159a640 1 -- 172.21.15.132:0/2837246459 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2204242637 0 0) 0x7f9ce40d2920 con 0x7f9ce40cfcd0 2023-12-20T04:53:04.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.626+0000 7f9ce259c640 1 --2- 172.21.15.132:0/2837246459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce415d300 0x7f9ce40d1290 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40b5dc0 tx=0x7f9cd402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a200263d679ef7fe server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:04.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.627+0000 7f9ce159a640 1 -- 172.21.15.132:0/2837246459 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd402cc80 con 0x7f9ce415d300 2023-12-20T04:53:04.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.627+0000 7f9ce159a640 1 -- 172.21.15.132:0/2837246459 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd402cde0 con 0x7f9ce415d300 2023-12-20T04:53:04.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.627+0000 7f9ce159a640 1 -- 172.21.15.132:0/2837246459 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd4034660 con 0x7f9ce415d300 2023-12-20T04:53:04.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.627+0000 7f9ce88b9640 1 -- 172.21.15.132:0/2837246459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce415d300 msgr2=0x7f9ce40d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:04.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.627+0000 7f9ce88b9640 1 --2- 172.21.15.132:0/2837246459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce415d300 0x7f9ce40d1290 secure :-1 s=READY pgs=1791 cs=0 l=1 rev1=1 crypto rx=0x7f9ce40b5dc0 tx=0x7f9cd402bed0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.627+0000 7f9ce88b9640 1 -- 172.21.15.132:0/2837246459 shutdown_connections 2023-12-20T04:53:04.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.627+0000 7f9ce88b9640 1 --2- 172.21.15.132:0/2837246459 >> v2:172.21.15.187:3300/0 conn(0x7f9ce40d17d0 0x7f9ce40cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.627+0000 7f9ce88b9640 1 --2- 172.21.15.132:0/2837246459 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce415d300 0x7f9ce40d1290 unknown :-1 s=CLOSED pgs=1791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.627+0000 7f9ce88b9640 1 -- 172.21.15.132:0/2837246459 >> 172.21.15.132:0/2837246459 conn(0x7f9ce406a3d0 msgr2=0x7f9ce406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:04.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.627+0000 7f9ce88b9640 1 -- 172.21.15.132:0/2837246459 shutdown_connections 2023-12-20T04:53:04.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.627+0000 7f9ce88b9640 1 -- 172.21.15.132:0/2837246459 wait complete. 2023-12-20T04:53:04.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.628+0000 7f9ce88b9640 1 Processor -- start 2023-12-20T04:53:04.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.629+0000 7f9ce88b9640 1 -- start start 2023-12-20T04:53:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.629+0000 7f9ce88b9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce40cfcd0 0x7f9ce415d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.629+0000 7f9ce88b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce40d17d0 0x7f9ce41f21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.629+0000 7f9ce88b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ce415d300 0x7f9ce4160150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.629+0000 7f9ce88b9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce40c94f0 con 0x7f9ce40d17d0 2023-12-20T04:53:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.629+0000 7f9ce88b9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce4149930 con 0x7f9ce40cfcd0 2023-12-20T04:53:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.629+0000 7f9ce88b9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9ce4160690 con 0x7f9ce415d300 2023-12-20T04:53:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.629+0000 7f9ce1d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce40d17d0 0x7f9ce41f21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.629+0000 7f9ce1d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce40d17d0 0x7f9ce41f21e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59304/0 (socket says 172.21.15.132:59304) 2023-12-20T04:53:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.629+0000 7f9ce1d9b640 1 -- 172.21.15.132:0/1143741561 learned_addr learned my addr 172.21.15.132:0/1143741561 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.629+0000 7f9ce2d9d640 1 --2- 172.21.15.132:0/1143741561 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ce415d300 0x7f9ce4160150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.629+0000 7f9ce259c640 1 --2- 172.21.15.132:0/1143741561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce40cfcd0 0x7f9ce415d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.630+0000 7f9ce1d9b640 1 -- 172.21.15.132:0/1143741561 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ce415d300 msgr2=0x7f9ce4160150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:04.634 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.630+0000 7f9ce1d9b640 1 --2- 172.21.15.132:0/1143741561 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ce415d300 0x7f9ce4160150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.630+0000 7f9ce1d9b640 1 -- 172.21.15.132:0/1143741561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce40cfcd0 msgr2=0x7f9ce415d6e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.630+0000 7f9ce1d9b640 1 --2- 172.21.15.132:0/1143741561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce40cfcd0 0x7f9ce415d6e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.630+0000 7f9ce1d9b640 1 -- 172.21.15.132:0/1143741561 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cd4009a70 con 0x7f9ce40d17d0 2023-12-20T04:53:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.630+0000 7f9ce2d9d640 1 --2- 172.21.15.132:0/1143741561 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ce415d300 0x7f9ce4160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.630+0000 7f9ce259c640 1 --2- 172.21.15.132:0/1143741561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce40cfcd0 0x7f9ce415d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.630+0000 7f9ce1d9b640 1 --2- 172.21.15.132:0/1143741561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce40d17d0 0x7f9ce41f21e0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800d7d0 tx=0x7f9cd800dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.630+0000 7f9cd2ffd640 1 -- 172.21.15.132:0/1143741561 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd800b6c0 con 0x7f9ce40d17d0 2023-12-20T04:53:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.630+0000 7f9cd2ffd640 1 -- 172.21.15.132:0/1143741561 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9cd800b820 con 0x7f9ce40d17d0 2023-12-20T04:53:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.630+0000 7f9cd2ffd640 1 -- 172.21.15.132:0/1143741561 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9cd800bbb0 con 0x7f9ce40d17d0 2023-12-20T04:53:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.630+0000 7f9ce88b9640 1 -- 172.21.15.132:0/1143741561 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ce40c8870 con 0x7f9ce40d17d0 2023-12-20T04:53:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.630+0000 7f9ce88b9640 1 -- 172.21.15.132:0/1143741561 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ce40c8e30 con 0x7f9ce40d17d0 2023-12-20T04:53:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.631+0000 7f9ce88b9640 1 -- 172.21.15.132:0/1143741561 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ce404e840 con 0x7f9ce40d17d0 2023-12-20T04:53:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.631+0000 7f9cd2ffd640 1 -- 172.21.15.132:0/1143741561 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9cd800bd10 con 0x7f9ce40d17d0 2023-12-20T04:53:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.632+0000 7f9cd2ffd640 1 --2- 172.21.15.132:0/1143741561 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc406a430 0x7f9cc406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:04.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.632+0000 7f9cd2ffd640 1 -- 172.21.15.132:0/1143741561 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(184..184 src has 1..184) v4 ==== 5609+0+0 (secure 0 0 0) 0x7f9cd8088d30 con 0x7f9ce40d17d0 2023-12-20T04:53:04.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.632+0000 7f9ce259c640 1 --2- 172.21.15.132:0/1143741561 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc406a430 0x7f9cc406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:04.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.632+0000 7f9ce259c640 1 --2- 172.21.15.132:0/1143741561 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc406a430 0x7f9cc406c8f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4036000 tx=0x7f9cd4030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:04.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.636+0000 7f9cd2ffd640 1 -- 172.21.15.132:0/1143741561 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9cd8054410 con 0x7f9ce40d17d0 2023-12-20T04:53:04.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.836+0000 7f9ce88b9640 1 -- 172.21.15.132:0/1143741561 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) v1 -- 0x7f9ce4159030 con 0x7f9ce40d17d0 2023-12-20T04:53:04.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.846+0000 7f9cd2ffd640 1 -- 172.21.15.132:0/1143741561 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 22 and data pool 23 v67) v1 ==== 174+0+0 (secure 0 0 0) 0x7f9cd8057a30 con 0x7f9ce40d17d0 2023-12-20T04:53:04.854 INFO:teuthology.orchestra.run.smithi132.stderr:new fs with metadata pool 22 and data pool 23 2023-12-20T04:53:04.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.855+0000 7f9ce88b9640 1 -- 172.21.15.132:0/1143741561 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc406a430 msgr2=0x7f9cc406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:04.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.855+0000 7f9ce88b9640 1 --2- 172.21.15.132:0/1143741561 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc406a430 0x7f9cc406c8f0 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4036000 tx=0x7f9cd4030000 comp rx=0 tx=0).stop 2023-12-20T04:53:04.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.855+0000 7f9ce88b9640 1 -- 172.21.15.132:0/1143741561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce40d17d0 msgr2=0x7f9ce41f21e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:04.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.855+0000 7f9ce88b9640 1 --2- 172.21.15.132:0/1143741561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce40d17d0 0x7f9ce41f21e0 secure :-1 s=READY pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800d7d0 tx=0x7f9cd800dc90 comp rx=0 tx=0).stop 2023-12-20T04:53:04.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.855+0000 7f9ce88b9640 1 -- 172.21.15.132:0/1143741561 shutdown_connections 2023-12-20T04:53:04.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.855+0000 7f9ce88b9640 1 --2- 172.21.15.132:0/1143741561 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9cc406a430 0x7f9cc406c8f0 secure :-1 s=CLOSED pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f9cd4036000 tx=0x7f9cd4030000 comp rx=0 tx=0).stop 2023-12-20T04:53:04.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.855+0000 7f9ce88b9640 1 --2- 172.21.15.132:0/1143741561 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9ce415d300 0x7f9ce4160150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.855+0000 7f9ce88b9640 1 --2- 172.21.15.132:0/1143741561 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9ce40d17d0 0x7f9ce41f21e0 secure :-1 s=CLOSED pgs=1792 cs=0 l=1 rev1=1 crypto rx=0x7f9cd800d7d0 tx=0x7f9cd800dc90 comp rx=0 tx=0).stop 2023-12-20T04:53:04.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.855+0000 7f9ce88b9640 1 --2- 172.21.15.132:0/1143741561 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9ce40cfcd0 0x7f9ce415d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.858 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.855+0000 7f9ce88b9640 1 -- 172.21.15.132:0/1143741561 >> 172.21.15.132:0/1143741561 conn(0x7f9ce406a3d0 msgr2=0x7f9ce40b7160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:04.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.856+0000 7f9ce88b9640 1 -- 172.21.15.132:0/1143741561 shutdown_connections 2023-12-20T04:53:04.859 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.856+0000 7f9ce88b9640 1 -- 172.21.15.132:0/1143741561 wait complete. 2023-12-20T04:53:04.870 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:53:04.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.968+0000 7fd8c8d05640 1 Processor -- start 2023-12-20T04:53:04.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.969+0000 7fd8c8d05640 1 -- start start 2023-12-20T04:53:04.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.969+0000 7fd8c8d05640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd8c4159d00 0x7fd8c415da00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:04.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.969+0000 7fd8c8d05640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c415df40 0x7fd8c40caa90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:04.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.969+0000 7fd8c8d05640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd8c415e4c0 con 0x7fd8c40cafd0 2023-12-20T04:53:04.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.969+0000 7fd8c8d05640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd8c406c220 con 0x7fd8c4159d00 2023-12-20T04:53:04.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.969+0000 7fd8c8d05640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c415e7a0 con 0x7fd8c415df40 2023-12-20T04:53:04.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.970+0000 7fd8c259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd8c4159d00 0x7fd8c415da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:04.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.970+0000 7fd8c259c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd8c4159d00 0x7fd8c415da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59314/0 (socket says 172.21.15.132:59314) 2023-12-20T04:53:04.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.970+0000 7fd8c259c640 1 -- 172.21.15.132:0/1036257317 learned_addr learned my addr 172.21.15.132:0/1036257317 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:04.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.970+0000 7fd8c259c640 1 -- 172.21.15.132:0/1036257317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c415df40 msgr2=0x7fd8c40caa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:04.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.970+0000 7fd8c259c640 1 --2- 172.21.15.132:0/1036257317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c415df40 0x7fd8c40caa90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.970+0000 7fd8c259c640 1 -- 172.21.15.132:0/1036257317 >> v1:172.21.15.187:6789/0 conn(0x7fd8c40cafd0 legacy=0x7fd8c406cc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:04.973 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.970+0000 7fd8c259c640 1 -- 172.21.15.132:0/1036257317 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8c406c430 con 0x7fd8c4159d00 2023-12-20T04:53:04.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.971+0000 7fd8c259c640 1 --2- 172.21.15.132:0/1036257317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c4159d00 0x7fd8c415da00 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009870 tx=0x7fd8b802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae11669db88d01c4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:04.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.971+0000 7fd8c159a640 1 -- 172.21.15.132:0/1036257317 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8031640 con 0x7fd8c4159d00 2023-12-20T04:53:04.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.971+0000 7fd8c159a640 1 -- 172.21.15.132:0/1036257317 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8b80317a0 con 0x7fd8c4159d00 2023-12-20T04:53:04.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.971+0000 7fd8c159a640 1 -- 172.21.15.132:0/1036257317 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8b8031b30 con 0x7fd8c4159d00 2023-12-20T04:53:04.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.971+0000 7fd8c8d05640 1 -- 172.21.15.132:0/1036257317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c4159d00 msgr2=0x7fd8c415da00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:04.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.971+0000 7fd8c8d05640 1 --2- 172.21.15.132:0/1036257317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c4159d00 0x7fd8c415da00 secure :-1 s=READY pgs=1793 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8009870 tx=0x7fd8b802b8f0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.971+0000 7fd8c8d05640 1 -- 172.21.15.132:0/1036257317 shutdown_connections 2023-12-20T04:53:04.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.971+0000 7fd8c8d05640 1 --2- 172.21.15.132:0/1036257317 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c415df40 0x7fd8c40caa90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.971+0000 7fd8c8d05640 1 --2- 172.21.15.132:0/1036257317 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c4159d00 0x7fd8c415da00 unknown :-1 s=CLOSED pgs=1793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.974 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.971+0000 7fd8c8d05640 1 -- 172.21.15.132:0/1036257317 >> 172.21.15.132:0/1036257317 conn(0x7fd8c40cfca0 msgr2=0x7fd8c40d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:04.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.971+0000 7fd8c8d05640 1 -- 172.21.15.132:0/1036257317 shutdown_connections 2023-12-20T04:53:04.975 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.971+0000 7fd8c8d05640 1 -- 172.21.15.132:0/1036257317 wait complete. 2023-12-20T04:53:04.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.973+0000 7fd8c8d05640 1 Processor -- start 2023-12-20T04:53:04.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.973+0000 7fd8c8d05640 1 -- start start 2023-12-20T04:53:04.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.973+0000 7fd8c8d05640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40cafd0 0x7fd8c40c8be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:04.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.973+0000 7fd8c8d05640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8c4159d00 0x7fd8c414fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:04.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.973+0000 7fd8c8d05640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415df40 0x7fd8c4154090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:04.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.973+0000 7fd8c8d05640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c414bc60 con 0x7fd8c415df40 2023-12-20T04:53:04.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.973+0000 7fd8c8d05640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c41502c0 con 0x7fd8c4159d00 2023-12-20T04:53:04.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.973+0000 7fd8c8d05640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c40b2980 con 0x7fd8c40cafd0 2023-12-20T04:53:04.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.974+0000 7fd8c2d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415df40 0x7fd8c4154090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:04.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.974+0000 7fd8c2d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415df40 0x7fd8c4154090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59316/0 (socket says 172.21.15.132:59316) 2023-12-20T04:53:04.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.974+0000 7fd8c2d9d640 1 -- 172.21.15.132:0/666302270 learned_addr learned my addr 172.21.15.132:0/666302270 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:04.977 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.974+0000 7fd8c259c640 1 --2- 172.21.15.132:0/666302270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40cafd0 0x7fd8c40c8be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:04.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.974+0000 7fd8c1d9b640 1 --2- 172.21.15.132:0/666302270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8c4159d00 0x7fd8c414fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:04.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.974+0000 7fd8c2d9d640 1 -- 172.21.15.132:0/666302270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40cafd0 msgr2=0x7fd8c40c8be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:04.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.974+0000 7fd8c2d9d640 1 --2- 172.21.15.132:0/666302270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40cafd0 0x7fd8c40c8be0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.974+0000 7fd8c2d9d640 1 -- 172.21.15.132:0/666302270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8c4159d00 msgr2=0x7fd8c414fd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:04.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.974+0000 7fd8c2d9d640 1 --2- 172.21.15.132:0/666302270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8c4159d00 0x7fd8c414fd80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:04.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.974+0000 7fd8c2d9d640 1 -- 172.21.15.132:0/666302270 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b80094d0 con 0x7fd8c415df40 2023-12-20T04:53:04.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.974+0000 7fd8c2d9d640 1 --2- 172.21.15.132:0/666302270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415df40 0x7fd8c4154090 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00c780 tx=0x7fd8bc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:04.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.974+0000 7fd8b2ffd640 1 -- 172.21.15.132:0/666302270 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc003d80 con 0x7fd8c415df40 2023-12-20T04:53:04.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.974+0000 7fd8b2ffd640 1 -- 172.21.15.132:0/666302270 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd8bc00ce90 con 0x7fd8c415df40 2023-12-20T04:53:04.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.974+0000 7fd8b2ffd640 1 -- 172.21.15.132:0/666302270 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd8bc0052b0 con 0x7fd8c415df40 2023-12-20T04:53:04.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.974+0000 7fd8c8d05640 1 -- 172.21.15.132:0/666302270 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c415a710 con 0x7fd8c415df40 2023-12-20T04:53:04.978 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.974+0000 7fd8c8d05640 1 -- 172.21.15.132:0/666302270 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c40b2bd0 con 0x7fd8c415df40 2023-12-20T04:53:04.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.975+0000 7fd8c8d05640 1 -- 172.21.15.132:0/666302270 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c404e840 con 0x7fd8c415df40 2023-12-20T04:53:04.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.976+0000 7fd8b2ffd640 1 -- 172.21.15.132:0/666302270 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd8bc005410 con 0x7fd8c415df40 2023-12-20T04:53:04.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.976+0000 7fd8b2ffd640 1 --2- 172.21.15.132:0/666302270 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8a406a430 0x7fd8a406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:04.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.976+0000 7fd8c259c640 1 --2- 172.21.15.132:0/666302270 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8a406a430 0x7fd8a406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:04.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.976+0000 7fd8b2ffd640 1 -- 172.21.15.132:0/666302270 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fd8bc087da0 con 0x7fd8c415df40 2023-12-20T04:53:04.979 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.977+0000 7fd8c259c640 1 --2- 172.21.15.132:0/666302270 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8a406a430 0x7fd8a406c8f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8036000 tx=0x7fd8b803c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:04.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:04.981+0000 7fd8b2ffd640 1 -- 172.21.15.132:0/666302270 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd8bc0533c0 con 0x7fd8c415df40 2023-12-20T04:53:05.152 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.150+0000 7fd8c8d05640 1 -- 172.21.15.132:0/666302270 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd8c40afa70 con 0x7fd8c415df40 2023-12-20T04:53:05.153 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.151+0000 7fd8b2ffd640 1 -- 172.21.15.132:0/666302270 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) v1 ==== 74+0+16165 (secure 0 0 0) 0x7fd8bc0569e0 con 0x7fd8c415df40 2023-12-20T04:53:05.154 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:05.154 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":185,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:53:04.837786+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:53:03.034230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-20T04:53:03.812892+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:53:05.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.153+0000 7fd8c8d05640 1 -- 172.21.15.132:0/666302270 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8a406a430 msgr2=0x7fd8a406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:05.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.153+0000 7fd8c8d05640 1 --2- 172.21.15.132:0/666302270 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8a406a430 0x7fd8a406c8f0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7fd8b8036000 tx=0x7fd8b803c040 comp rx=0 tx=0).stop 2023-12-20T04:53:05.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.153+0000 7fd8c8d05640 1 -- 172.21.15.132:0/666302270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415df40 msgr2=0x7fd8c4154090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:05.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.153+0000 7fd8c8d05640 1 --2- 172.21.15.132:0/666302270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415df40 0x7fd8c4154090 secure :-1 s=READY pgs=1794 cs=0 l=1 rev1=1 crypto rx=0x7fd8bc00c780 tx=0x7fd8bc00cc40 comp rx=0 tx=0).stop 2023-12-20T04:53:05.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.153+0000 7fd8c8d05640 1 -- 172.21.15.132:0/666302270 shutdown_connections 2023-12-20T04:53:05.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.153+0000 7fd8c8d05640 1 --2- 172.21.15.132:0/666302270 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd8a406a430 0x7fd8a406c8f0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.153+0000 7fd8c8d05640 1 --2- 172.21.15.132:0/666302270 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd8c415df40 0x7fd8c4154090 unknown :-1 s=CLOSED pgs=1794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.153+0000 7fd8c8d05640 1 --2- 172.21.15.132:0/666302270 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd8c4159d00 0x7fd8c414fd80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.153+0000 7fd8c8d05640 1 --2- 172.21.15.132:0/666302270 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd8c40cafd0 0x7fd8c40c8be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.153+0000 7fd8c8d05640 1 -- 172.21.15.132:0/666302270 >> 172.21.15.132:0/666302270 conn(0x7fd8c40cfca0 msgr2=0x7fd8c4152f60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:05.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.154+0000 7fd8c8d05640 1 -- 172.21.15.132:0/666302270 shutdown_connections 2023-12-20T04:53:05.156 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.154+0000 7fd8c8d05640 1 -- 172.21.15.132:0/666302270 wait complete. 2023-12-20T04:53:05.167 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:53:05.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.264+0000 7ff4dd1fb640 1 Processor -- start 2023-12-20T04:53:05.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.264+0000 7ff4dd1fb640 1 -- start start 2023-12-20T04:53:05.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4dd1fb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7ff4d815d110 0x7ff4d8069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:05.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4dd1fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d815d4f0 0x7ff4d806a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:05.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4dd1fb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff4d8161ce0 con 0x7ff4d80aeb00 2023-12-20T04:53:05.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4dd1fb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff4d80aca50 con 0x7ff4d815d110 2023-12-20T04:53:05.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4dd1fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d8160df0 con 0x7ff4d815d4f0 2023-12-20T04:53:05.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4d759e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff4d80aeb00 0x7ff4d8070560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38634/0 (socket says 172.21.15.132:38634) 2023-12-20T04:53:05.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4d759e640 1 -- 172.21.15.132:0/717757234 learned_addr learned my addr 172.21.15.132:0/717757234 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:05.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4d5d9b640 1 -- 172.21.15.132:0/717757234 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2789924284 0 0) 0x7ff4d8161ce0 con 0x7ff4d80aeb00 2023-12-20T04:53:05.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4d6d9d640 1 --2- 172.21.15.132:0/717757234 >> v2:172.21.15.187:3300/0 conn(0x7ff4d815d110 0x7ff4d8069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:05.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4d659c640 1 --2- 172.21.15.132:0/717757234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d815d4f0 0x7ff4d806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:05.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4d5d9b640 1 -- 172.21.15.132:0/717757234 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff4c0003520 con 0x7ff4d80aeb00 2023-12-20T04:53:05.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4d5d9b640 1 -- 172.21.15.132:0/717757234 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4264464208 0 0) 0x7ff4c0003520 con 0x7ff4d80aeb00 2023-12-20T04:53:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4d5d9b640 1 -- 172.21.15.132:0/717757234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d815d4f0 msgr2=0x7ff4d806a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4d5d9b640 1 --2- 172.21.15.132:0/717757234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d815d4f0 0x7ff4d806a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4d5d9b640 1 -- 172.21.15.132:0/717757234 >> v2:172.21.15.187:3300/0 conn(0x7ff4d815d110 msgr2=0x7ff4d8069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4d5d9b640 1 --2- 172.21.15.132:0/717757234 >> v2:172.21.15.187:3300/0 conn(0x7ff4d815d110 0x7ff4d8069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4d5d9b640 1 -- 172.21.15.132:0/717757234 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d81610d0 con 0x7ff4d80aeb00 2023-12-20T04:53:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.265+0000 7ff4d5d9b640 1 -- 172.21.15.132:0/717757234 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7ff4d0001670 con 0x7ff4d80aeb00 2023-12-20T04:53:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.266+0000 7ff4d5d9b640 1 -- 172.21.15.132:0/717757234 >> v1:172.21.15.132:6789/0 conn(0x7ff4d80aeb00 legacy=0x7ff4d8070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.266+0000 7ff4d5d9b640 1 --2- 172.21.15.132:0/717757234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d815d4f0 0x7ff4c0003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.266+0000 7ff4d5d9b640 1 --2- 172.21.15.132:0/717757234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4c0003ef0 0x7ff4c00047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.266+0000 7ff4d5d9b640 1 --2- 172.21.15.132:0/717757234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4c0004d00 0x7ff4c0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.266+0000 7ff4d5d9b640 1 -- 172.21.15.132:0/717757234 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d80aca50 con 0x7ff4c0003ef0 2023-12-20T04:53:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.266+0000 7ff4d5d9b640 1 -- 172.21.15.132:0/717757234 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d8160df0 con 0x7ff4c0004d00 2023-12-20T04:53:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.266+0000 7ff4d5d9b640 1 -- 172.21.15.132:0/717757234 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4c000b980 con 0x7ff4d815d4f0 2023-12-20T04:53:05.271 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.266+0000 7ff4d659c640 1 --2- 172.21.15.132:0/717757234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4c0003ef0 0x7ff4c00047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.266+0000 7ff4d6d9d640 1 --2- 172.21.15.132:0/717757234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d815d4f0 0x7ff4c0003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.266+0000 7ff4d759e640 1 --2- 172.21.15.132:0/717757234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4c0004d00 0x7ff4c0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.266+0000 7ff4d659c640 1 -- 172.21.15.132:0/717757234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d815d4f0 msgr2=0x7ff4c0003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.266+0000 7ff4d659c640 1 --2- 172.21.15.132:0/717757234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d815d4f0 0x7ff4c0003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.266+0000 7ff4d659c640 1 -- 172.21.15.132:0/717757234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4c0004d00 msgr2=0x7ff4c0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.266+0000 7ff4d659c640 1 --2- 172.21.15.132:0/717757234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4c0004d00 0x7ff4c0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.266+0000 7ff4d659c640 1 -- 172.21.15.132:0/717757234 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4c0003520 con 0x7ff4c0003ef0 2023-12-20T04:53:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.266+0000 7ff4d6d9d640 1 --2- 172.21.15.132:0/717757234 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d815d4f0 0x7ff4c0003970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.266+0000 7ff4d759e640 1 --2- 172.21.15.132:0/717757234 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4c0004d00 0x7ff4c0005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.267+0000 7ff4d659c640 1 --2- 172.21.15.132:0/717757234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4c0003ef0 0x7ff4c00047c0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc009ac0 tx=0x7ff4c00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5f29e57072864c3b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.267+0000 7ff4d5d9b640 1 -- 172.21.15.132:0/717757234 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc02c6b0 con 0x7ff4c0003ef0 2023-12-20T04:53:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.267+0000 7ff4d5d9b640 1 -- 172.21.15.132:0/717757234 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc02c810 con 0x7ff4c0003ef0 2023-12-20T04:53:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.267+0000 7ff4d5d9b640 1 -- 172.21.15.132:0/717757234 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc02cba0 con 0x7ff4c0003ef0 2023-12-20T04:53:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.267+0000 7ff4dd1fb640 1 -- 172.21.15.132:0/717757234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4c0003ef0 msgr2=0x7ff4c00047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:05.272 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.267+0000 7ff4dd1fb640 1 --2- 172.21.15.132:0/717757234 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4c0003ef0 0x7ff4c00047c0 secure :-1 s=READY pgs=1796 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc009ac0 tx=0x7ff4c00057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.267+0000 7ff4d759e640 1 -- 172.21.15.132:0/717757234 reap_dead start 2023-12-20T04:53:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.267+0000 7ff4dd1fb640 1 -- 172.21.15.132:0/717757234 shutdown_connections 2023-12-20T04:53:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.267+0000 7ff4dd1fb640 1 -- 172.21.15.132:0/717757234 >> 172.21.15.132:0/717757234 conn(0x7ff4d80cfbd0 msgr2=0x7ff4d80cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.267+0000 7ff4dd1fb640 1 -- 172.21.15.132:0/717757234 shutdown_connections 2023-12-20T04:53:05.273 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.267+0000 7ff4dd1fb640 1 -- 172.21.15.132:0/717757234 wait complete. 2023-12-20T04:53:05.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.269+0000 7ff4dd1fb640 1 Processor -- start 2023-12-20T04:53:05.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.269+0000 7ff4dd1fb640 1 -- start start 2023-12-20T04:53:05.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4dd1fb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4c0003ef0 0x7ff4d806def0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:05.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4dd1fb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4d80c81c0 0x7ff4d80af6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:05.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4dd1fb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d81f5f20 0x7ff4d81f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:05.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4dd1fb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d81f68f0 con 0x7ff4d80c81c0 2023-12-20T04:53:05.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4dd1fb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d80b0010 con 0x7ff4c0003ef0 2023-12-20T04:53:05.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4dd1fb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4d80b02f0 con 0x7ff4d81f5f20 2023-12-20T04:53:05.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4d659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4d80c81c0 0x7ff4d80af6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:05.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4d659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4d80c81c0 0x7ff4d80af6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59334/0 (socket says 172.21.15.132:59334) 2023-12-20T04:53:05.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4d659c640 1 -- 172.21.15.132:0/545327623 learned_addr learned my addr 172.21.15.132:0/545327623 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:05.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4d6d9d640 1 --2- 172.21.15.132:0/545327623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4c0003ef0 0x7ff4d806def0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:05.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4d759e640 1 --2- 172.21.15.132:0/545327623 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d81f5f20 0x7ff4d81f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:05.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4d659c640 1 -- 172.21.15.132:0/545327623 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d81f5f20 msgr2=0x7ff4d81f63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:05.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4d659c640 1 --2- 172.21.15.132:0/545327623 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d81f5f20 0x7ff4d81f63b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4d659c640 1 -- 172.21.15.132:0/545327623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4c0003ef0 msgr2=0x7ff4d806def0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:05.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4d659c640 1 --2- 172.21.15.132:0/545327623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4c0003ef0 0x7ff4d806def0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4d659c640 1 -- 172.21.15.132:0/545327623 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff4d80b05d0 con 0x7ff4d80c81c0 2023-12-20T04:53:05.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4d659c640 1 --2- 172.21.15.132:0/545327623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4d80c81c0 0x7ff4d80af6a0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc02c2b0 tx=0x7ff4cc004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:05.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4bf7fe640 1 -- 172.21.15.132:0/545327623 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc003810 con 0x7ff4d80c81c0 2023-12-20T04:53:05.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4bf7fe640 1 -- 172.21.15.132:0/545327623 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff4cc003970 con 0x7ff4d80c81c0 2023-12-20T04:53:05.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4dd1fb640 1 -- 172.21.15.132:0/545327623 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4d80b08b0 con 0x7ff4d80c81c0 2023-12-20T04:53:05.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4bf7fe640 1 -- 172.21.15.132:0/545327623 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff4cc003ce0 con 0x7ff4d80c81c0 2023-12-20T04:53:05.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.270+0000 7ff4dd1fb640 1 -- 172.21.15.132:0/545327623 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4d806e430 con 0x7ff4d80c81c0 2023-12-20T04:53:05.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.271+0000 7ff4dd1fb640 1 -- 172.21.15.132:0/545327623 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4d804e840 con 0x7ff4d80c81c0 2023-12-20T04:53:05.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.272+0000 7ff4bf7fe640 1 -- 172.21.15.132:0/545327623 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff4cc034440 con 0x7ff4d80c81c0 2023-12-20T04:53:05.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.272+0000 7ff4bf7fe640 1 --2- 172.21.15.132:0/545327623 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4c406a460 0x7ff4c406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:05.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.272+0000 7ff4bf7fe640 1 -- 172.21.15.132:0/545327623 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5709+0+0 (secure 0 0 0) 0x7ff4cc0aaab0 con 0x7ff4d80c81c0 2023-12-20T04:53:05.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.272+0000 7ff4d6d9d640 1 --2- 172.21.15.132:0/545327623 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4c406a460 0x7ff4c406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:05.277 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.273+0000 7ff4d6d9d640 1 --2- 172.21.15.132:0/545327623 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4c406a460 0x7ff4c406c920 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff4d81f0520 tx=0x7ff4c800b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:05.278 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.277+0000 7ff4bf7fe640 1 -- 172.21.15.132:0/545327623 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff4cc076150 con 0x7ff4d80c81c0 2023-12-20T04:53:05.444 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.443+0000 7ff4dd1fb640 1 -- 172.21.15.132:0/545327623 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff4d80d0940 con 0x7ff4d80c81c0 2023-12-20T04:53:05.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.444+0000 7ff4bf7fe640 1 -- 172.21.15.132:0/545327623 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v185) v1 ==== 74+0+16165 (secure 0 0 0) 0x7ff4cc039090 con 0x7ff4d80c81c0 2023-12-20T04:53:05.483 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:05.483 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":185,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:53:04.837786+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:53:03.034230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-20T04:53:03.812892+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:53:05.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.446+0000 7ff4dd1fb640 1 -- 172.21.15.132:0/545327623 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4c406a460 msgr2=0x7ff4c406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:05.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.446+0000 7ff4dd1fb640 1 --2- 172.21.15.132:0/545327623 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4c406a460 0x7ff4c406c920 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7ff4d81f0520 tx=0x7ff4c800b040 comp rx=0 tx=0).stop 2023-12-20T04:53:05.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.446+0000 7ff4dd1fb640 1 -- 172.21.15.132:0/545327623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4d80c81c0 msgr2=0x7ff4d80af6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:05.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.446+0000 7ff4dd1fb640 1 --2- 172.21.15.132:0/545327623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4d80c81c0 0x7ff4d80af6a0 secure :-1 s=READY pgs=1797 cs=0 l=1 rev1=1 crypto rx=0x7ff4cc02c2b0 tx=0x7ff4cc004730 comp rx=0 tx=0).stop 2023-12-20T04:53:05.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.446+0000 7ff4dd1fb640 1 -- 172.21.15.132:0/545327623 shutdown_connections 2023-12-20T04:53:05.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.446+0000 7ff4dd1fb640 1 --2- 172.21.15.132:0/545327623 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff4c406a460 0x7ff4c406c920 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.446+0000 7ff4dd1fb640 1 --2- 172.21.15.132:0/545327623 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff4d81f5f20 0x7ff4d81f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.446+0000 7ff4dd1fb640 1 --2- 172.21.15.132:0/545327623 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4d80c81c0 0x7ff4d80af6a0 unknown :-1 s=CLOSED pgs=1797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.446+0000 7ff4dd1fb640 1 --2- 172.21.15.132:0/545327623 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff4c0003ef0 0x7ff4d806def0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.446+0000 7ff4dd1fb640 1 -- 172.21.15.132:0/545327623 >> 172.21.15.132:0/545327623 conn(0x7ff4d80cfbd0 msgr2=0x7ff4d80ca6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:05.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.446+0000 7ff4dd1fb640 1 -- 172.21.15.132:0/545327623 shutdown_connections 2023-12-20T04:53:05.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.446+0000 7ff4dd1fb640 1 -- 172.21.15.132:0/545327623 wait complete. 2023-12-20T04:53:05.486 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2023-12-20T04:53:05.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.587+0000 7fedc8f89640 1 Processor -- start 2023-12-20T04:53:05.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.587+0000 7fedc8f89640 1 -- start start 2023-12-20T04:53:05.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc8f89640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fedc40cfc40 0x7fedc40b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:05.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc8f89640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc40d2920 con 0x7fedc415d300 2023-12-20T04:53:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc8f89640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fedc40d1d10 con 0x7fedc40cf790 2023-12-20T04:53:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc8f89640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fedc40d1ff0 con 0x7fedc40cfc40 2023-12-20T04:53:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc259c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fedc415d300 0x7fedc40d1290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:38648/0 (socket says 172.21.15.132:38648) 2023-12-20T04:53:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc259c640 1 -- 172.21.15.132:0/2664466170 learned_addr learned my addr 172.21.15.132:0/2664466170 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc2d9d640 1 --2- 172.21.15.132:0/2664466170 >> v2:172.21.15.187:3300/0 conn(0x7fedc40cfc40 0x7fedc40b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc1d9b640 1 -- 172.21.15.132:0/2664466170 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2582048212 0 0) 0x7fedc40d2920 con 0x7fedc415d300 2023-12-20T04:53:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc1d9b640 1 -- 172.21.15.132:0/2664466170 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fedb0003520 con 0x7fedc415d300 2023-12-20T04:53:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc1d9b640 1 -- 172.21.15.132:0/2664466170 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2704551625 0 0) 0x7fedb0003520 con 0x7fedc415d300 2023-12-20T04:53:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc1d9b640 1 -- 172.21.15.132:0/2664466170 >> v2:172.21.15.187:3300/0 conn(0x7fedc40cfc40 msgr2=0x7fedc40b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc1d9b640 1 --2- 172.21.15.132:0/2664466170 >> v2:172.21.15.187:3300/0 conn(0x7fedc40cfc40 0x7fedc40b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc1d9b640 1 -- 172.21.15.132:0/2664466170 >> v1:172.21.15.187:6789/0 conn(0x7fedc40cf790 legacy=0x7fedc40b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc1d9b640 1 -- 172.21.15.132:0/2664466170 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc40d22d0 con 0x7fedc415d300 2023-12-20T04:53:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc1d9b640 1 -- 172.21.15.132:0/2664466170 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fedb4001670 con 0x7fedc415d300 2023-12-20T04:53:05.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc1d9b640 1 -- 172.21.15.132:0/2664466170 >> v1:172.21.15.132:6789/0 conn(0x7fedc415d300 legacy=0x7fedc40d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:05.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc1d9b640 1 --2- 172.21.15.132:0/2664466170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb0003970 0x7fedb0003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:05.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc1d9b640 1 --2- 172.21.15.132:0/2664466170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedb00047c0 0x7fedb0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:05.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc1d9b640 1 --2- 172.21.15.132:0/2664466170 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fedb0005180 0x7fedb000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:05.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc1d9b640 1 -- 172.21.15.132:0/2664466170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc40d1ff0 con 0x7fedb00047c0 2023-12-20T04:53:05.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc1d9b640 1 -- 172.21.15.132:0/2664466170 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb000c020 con 0x7fedb0003970 2023-12-20T04:53:05.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedc1d9b640 1 -- 172.21.15.132:0/2664466170 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedb000c1e0 con 0x7fedb0005180 2023-12-20T04:53:05.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.588+0000 7fedbbfff640 1 --2- 172.21.15.132:0/2664466170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedb00047c0 0x7fedb0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:05.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.589+0000 7fedc259c640 1 --2- 172.21.15.132:0/2664466170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb0003970 0x7fedb0003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:05.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.589+0000 7fedc2d9d640 1 --2- 172.21.15.132:0/2664466170 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fedb0005180 0x7fedb000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:05.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.589+0000 7fedbbfff640 1 -- 172.21.15.132:0/2664466170 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fedb0005180 msgr2=0x7fedb000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:05.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.589+0000 7fedbbfff640 1 --2- 172.21.15.132:0/2664466170 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fedb0005180 0x7fedb000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.589+0000 7fedbbfff640 1 -- 172.21.15.132:0/2664466170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb0003970 msgr2=0x7fedb0003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:05.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.589+0000 7fedbbfff640 1 --2- 172.21.15.132:0/2664466170 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb0003970 0x7fedb0003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.594 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.589+0000 7fedbbfff640 1 -- 172.21.15.132:0/2664466170 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedb0003520 con 0x7fedb00047c0 2023-12-20T04:53:05.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.589+0000 7fedc2d9d640 1 -- 172.21.15.132:0/2664466170 reap_dead start 2023-12-20T04:53:05.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.589+0000 7fedbbfff640 1 --2- 172.21.15.132:0/2664466170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedb00047c0 0x7fedb0004c40 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fedac001750 tx=0x7fedb00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79e67a572d3be914 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:05.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.590+0000 7fedc1d9b640 1 -- 172.21.15.132:0/2664466170 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac0052d0 con 0x7fedb00047c0 2023-12-20T04:53:05.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.590+0000 7fedc1d9b640 1 -- 172.21.15.132:0/2664466170 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedac02e050 con 0x7fedb00047c0 2023-12-20T04:53:05.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.590+0000 7fedc1d9b640 1 -- 172.21.15.132:0/2664466170 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedac003830 con 0x7fedb00047c0 2023-12-20T04:53:05.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.590+0000 7fedc8f89640 1 -- 172.21.15.132:0/2664466170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedb00047c0 msgr2=0x7fedb0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:05.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.590+0000 7fedc8f89640 1 --2- 172.21.15.132:0/2664466170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedb00047c0 0x7fedb0004c40 secure :-1 s=READY pgs=1799 cs=0 l=1 rev1=1 crypto rx=0x7fedac001750 tx=0x7fedb00057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.590+0000 7fedc8f89640 1 -- 172.21.15.132:0/2664466170 shutdown_connections 2023-12-20T04:53:05.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.590+0000 7fedc8f89640 1 --2- 172.21.15.132:0/2664466170 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedb00047c0 0x7fedb0004c40 unknown :-1 s=CLOSED pgs=1799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.590+0000 7fedc8f89640 1 -- 172.21.15.132:0/2664466170 >> 172.21.15.132:0/2664466170 conn(0x7fedc406a3d0 msgr2=0x7fedc406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:05.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.590+0000 7fedc8f89640 1 -- 172.21.15.132:0/2664466170 shutdown_connections 2023-12-20T04:53:05.595 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.590+0000 7fedc8f89640 1 -- 172.21.15.132:0/2664466170 wait complete. 2023-12-20T04:53:05.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.591+0000 7fedc8f89640 1 Processor -- start 2023-12-20T04:53:05.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.591+0000 7fedc8f89640 1 -- start start 2023-12-20T04:53:05.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.592+0000 7fedc8f89640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb00047c0 0x7fedc41553b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:05.598 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.592+0000 7fedc8f89640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fedc415fd00 0x7fedc40c88c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:05.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.592+0000 7fedc8f89640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedc415e0f0 0x7fedc40b4d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:05.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.592+0000 7fedc8f89640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc41558f0 con 0x7fedc415e0f0 2023-12-20T04:53:05.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.592+0000 7fedc8f89640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedc415ea60 con 0x7fedb00047c0 2023-12-20T04:53:05.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.592+0000 7fedc8f89640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fedc40b2950 con 0x7fedc415fd00 2023-12-20T04:53:05.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.592+0000 7fedc2d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedc415e0f0 0x7fedc40b4d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:05.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.592+0000 7fedc2d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedc415e0f0 0x7fedc40b4d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59350/0 (socket says 172.21.15.132:59350) 2023-12-20T04:53:05.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.592+0000 7fedc2d9d640 1 -- 172.21.15.132:0/1275176249 learned_addr learned my addr 172.21.15.132:0/1275176249 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:05.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.592+0000 7fedc259c640 1 --2- 172.21.15.132:0/1275176249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb00047c0 0x7fedc41553b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:05.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.592+0000 7fedbbfff640 1 --2- 172.21.15.132:0/1275176249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fedc415fd00 0x7fedc40c88c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:05.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.593+0000 7fedc2d9d640 1 -- 172.21.15.132:0/1275176249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fedc415fd00 msgr2=0x7fedc40c88c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:05.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.593+0000 7fedc2d9d640 1 --2- 172.21.15.132:0/1275176249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fedc415fd00 0x7fedc40c88c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.593+0000 7fedc2d9d640 1 -- 172.21.15.132:0/1275176249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb00047c0 msgr2=0x7fedc41553b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:05.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.593+0000 7fedc2d9d640 1 --2- 172.21.15.132:0/1275176249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb00047c0 0x7fedc41553b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:05.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.593+0000 7fedc2d9d640 1 -- 172.21.15.132:0/1275176249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedc40b2c30 con 0x7fedc415e0f0 2023-12-20T04:53:05.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.593+0000 7fedbbfff640 1 --2- 172.21.15.132:0/1275176249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fedc415fd00 0x7fedc40c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:05.599 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.593+0000 7fedc2d9d640 1 --2- 172.21.15.132:0/1275176249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedc415e0f0 0x7fedc40b4d30 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fedc40d2890 tx=0x7fedbc00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:05.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.593+0000 7fedbaffd640 1 -- 172.21.15.132:0/1275176249 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc00e040 con 0x7fedc415e0f0 2023-12-20T04:53:05.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.593+0000 7fedbaffd640 1 -- 172.21.15.132:0/1275176249 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fedbc00f040 con 0x7fedc415e0f0 2023-12-20T04:53:05.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.593+0000 7fedc8f89640 1 -- 172.21.15.132:0/1275176249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedc40b2f10 con 0x7fedc415e0f0 2023-12-20T04:53:05.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.593+0000 7fedbaffd640 1 -- 172.21.15.132:0/1275176249 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fedbc015430 con 0x7fedc415e0f0 2023-12-20T04:53:05.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.593+0000 7fedc8f89640 1 -- 172.21.15.132:0/1275176249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedc40c8e00 con 0x7fedc415e0f0 2023-12-20T04:53:05.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.594+0000 7fedc8f89640 1 -- 172.21.15.132:0/1275176249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedc404e840 con 0x7fedc415e0f0 2023-12-20T04:53:05.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.594+0000 7fedbaffd640 1 -- 172.21.15.132:0/1275176249 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fedbc015590 con 0x7fedc415e0f0 2023-12-20T04:53:05.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.595+0000 7fedbaffd640 1 --2- 172.21.15.132:0/1275176249 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feda406a430 0x7feda406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:05.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.595+0000 7fedbaffd640 1 -- 172.21.15.132:0/1275176249 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(185..185 src has 1..185) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fedbc088fc0 con 0x7fedc415e0f0 2023-12-20T04:53:05.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.595+0000 7fedc259c640 1 --2- 172.21.15.132:0/1275176249 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feda406a430 0x7feda406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:05.600 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.595+0000 7fedc259c640 1 --2- 172.21.15.132:0/1275176249 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feda406a430 0x7feda406c8f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fedb4001c90 tx=0x7fedb4000ed0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:05.601 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.599+0000 7fedbaffd640 1 -- 172.21.15.132:0/1275176249 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fedbc0545b0 con 0x7fedc415e0f0 2023-12-20T04:53:05.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:05.800+0000 7fedc8f89640 1 -- 172.21.15.132:0/1275176249 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) v1 -- 0x7fedc415c5a0 con 0x7fedc415e0f0 2023-12-20T04:53:05.918 INFO:tasks.ceph.mds.a.smithi132.stderr:2023-12-20T04:53:05.916+0000 7f963b456640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:53:06.508 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.506+0000 7fedbaffd640 1 -- 172.21.15.132:0/1275176249 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v69) v1 ==== 118+0+0 (secure 0 0 0) 0x7fedbc057bd0 con 0x7fedc415e0f0 2023-12-20T04:53:06.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.508+0000 7fedc8f89640 1 -- 172.21.15.132:0/1275176249 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feda406a430 msgr2=0x7feda406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:06.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.508+0000 7fedc8f89640 1 --2- 172.21.15.132:0/1275176249 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feda406a430 0x7feda406c8f0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7fedb4001c90 tx=0x7fedb4000ed0 comp rx=0 tx=0).stop 2023-12-20T04:53:06.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.508+0000 7fedc8f89640 1 -- 172.21.15.132:0/1275176249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedc415e0f0 msgr2=0x7fedc40b4d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:06.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.508+0000 7fedc8f89640 1 --2- 172.21.15.132:0/1275176249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedc415e0f0 0x7fedc40b4d30 secure :-1 s=READY pgs=1800 cs=0 l=1 rev1=1 crypto rx=0x7fedc40d2890 tx=0x7fedbc00f1b0 comp rx=0 tx=0).stop 2023-12-20T04:53:06.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.508+0000 7fedc8f89640 1 -- 172.21.15.132:0/1275176249 shutdown_connections 2023-12-20T04:53:06.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.508+0000 7fedc8f89640 1 --2- 172.21.15.132:0/1275176249 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7feda406a430 0x7feda406c8f0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:06.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.508+0000 7fedc8f89640 1 --2- 172.21.15.132:0/1275176249 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fedc415e0f0 0x7fedc40b4d30 unknown :-1 s=CLOSED pgs=1800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:06.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.508+0000 7fedc8f89640 1 --2- 172.21.15.132:0/1275176249 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fedc415fd00 0x7fedc40c88c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:06.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.508+0000 7fedc8f89640 1 --2- 172.21.15.132:0/1275176249 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fedb00047c0 0x7fedc41553b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:06.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.508+0000 7fedc8f89640 1 -- 172.21.15.132:0/1275176249 >> 172.21.15.132:0/1275176249 conn(0x7fedc406a3d0 msgr2=0x7fedc40b6530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:06.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.508+0000 7fedc8f89640 1 -- 172.21.15.132:0/1275176249 shutdown_connections 2023-12-20T04:53:06.511 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.508+0000 7fedc8f89640 1 -- 172.21.15.132:0/1275176249 wait complete. 2023-12-20T04:53:06.523 DEBUG:tasks.cephfs.filesystem:fs_config: {} 2023-12-20T04:53:06.523 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2023-12-20T04:53:06.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.627+0000 7f45aec70640 1 Processor -- start 2023-12-20T04:53:06.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.627+0000 7f45aec70640 1 -- start start 2023-12-20T04:53:06.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.628+0000 7f45aec70640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f45a8069c30 0x7f45a8070460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:06.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.628+0000 7f45aec70640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f45a815d360 0x7f45a806a010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:06.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.628+0000 7f45aec70640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45a80cbde0 0x7f45a80ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:06.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.628+0000 7f45aec70640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a80c4f40 con 0x7f45a8069c30 2023-12-20T04:53:06.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.628+0000 7f45aec70640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45a80af5b0 con 0x7f45a815d360 2023-12-20T04:53:06.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.628+0000 7f45aec70640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a806a550 con 0x7f45a80cbde0 2023-12-20T04:53:06.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.628+0000 7f45aca0c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f45a8069c30 0x7f45a8070460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:06.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.628+0000 7f45aca0c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f45a8069c30 0x7f45a8070460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59360/0 (socket says 172.21.15.132:59360) 2023-12-20T04:53:06.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.628+0000 7f45aca0c640 1 -- 172.21.15.132:0/2516490089 learned_addr learned my addr 172.21.15.132:0/2516490089 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:06.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.629+0000 7f45a7fff640 1 --2- 172.21.15.132:0/2516490089 >> v2:172.21.15.187:3300/0 conn(0x7f45a815d360 0x7f45a806a010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:06.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.629+0000 7f45ad20d640 1 --2- 172.21.15.132:0/2516490089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45a80cbde0 0x7f45a80ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:06.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.629+0000 7f45aca0c640 1 -- 172.21.15.132:0/2516490089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45a80cbde0 msgr2=0x7f45a80ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:06.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.629+0000 7f45aca0c640 1 --2- 172.21.15.132:0/2516490089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45a80cbde0 0x7f45a80ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:06.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.629+0000 7f45aca0c640 1 -- 172.21.15.132:0/2516490089 >> v2:172.21.15.187:3300/0 conn(0x7f45a815d360 msgr2=0x7f45a806a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:06.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.629+0000 7f45aca0c640 1 --2- 172.21.15.132:0/2516490089 >> v2:172.21.15.187:3300/0 conn(0x7f45a815d360 0x7f45a806a010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:06.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.629+0000 7f45aca0c640 1 -- 172.21.15.132:0/2516490089 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a8070a40 con 0x7f45a8069c30 2023-12-20T04:53:06.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.629+0000 7f45a7fff640 1 --2- 172.21.15.132:0/2516490089 >> v2:172.21.15.187:3300/0 conn(0x7f45a815d360 0x7f45a806a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:06.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.629+0000 7f45ad20d640 1 --2- 172.21.15.132:0/2516490089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45a80cbde0 0x7f45a80ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:06.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.629+0000 7f45aca0c640 1 --2- 172.21.15.132:0/2516490089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45a8069c30 0x7f45a8070460 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f45a80b5dc0 tx=0x7f45a002bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5486874fc6226a6d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:06.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.629+0000 7f45a77fe640 1 -- 172.21.15.132:0/2516490089 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a002ca70 con 0x7f45a8069c30 2023-12-20T04:53:06.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.630+0000 7f45a77fe640 1 -- 172.21.15.132:0/2516490089 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45a002cbd0 con 0x7f45a8069c30 2023-12-20T04:53:06.633 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.630+0000 7f45a77fe640 1 -- 172.21.15.132:0/2516490089 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45a00343f0 con 0x7f45a8069c30 2023-12-20T04:53:06.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.630+0000 7f45aec70640 1 -- 172.21.15.132:0/2516490089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45a8069c30 msgr2=0x7f45a8070460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:06.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.630+0000 7f45aec70640 1 --2- 172.21.15.132:0/2516490089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45a8069c30 0x7f45a8070460 secure :-1 s=READY pgs=1801 cs=0 l=1 rev1=1 crypto rx=0x7f45a80b5dc0 tx=0x7f45a002bed0 comp rx=0 tx=0).stop 2023-12-20T04:53:06.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.630+0000 7f45aec70640 1 -- 172.21.15.132:0/2516490089 shutdown_connections 2023-12-20T04:53:06.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.630+0000 7f45aec70640 1 --2- 172.21.15.132:0/2516490089 >> v2:172.21.15.187:3300/0 conn(0x7f45a815d360 0x7f45a806a010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:06.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.630+0000 7f45aec70640 1 --2- 172.21.15.132:0/2516490089 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45a80cbde0 0x7f45a80ca170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:06.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.630+0000 7f45aec70640 1 --2- 172.21.15.132:0/2516490089 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45a8069c30 0x7f45a8070460 unknown :-1 s=CLOSED pgs=1801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:06.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.630+0000 7f45aec70640 1 -- 172.21.15.132:0/2516490089 >> 172.21.15.132:0/2516490089 conn(0x7f45a80cc630 msgr2=0x7f45a80cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:06.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.630+0000 7f45aec70640 1 -- 172.21.15.132:0/2516490089 shutdown_connections 2023-12-20T04:53:06.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.630+0000 7f45aec70640 1 -- 172.21.15.132:0/2516490089 wait complete. 2023-12-20T04:53:06.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.631+0000 7f45aec70640 1 Processor -- start 2023-12-20T04:53:06.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.631+0000 7f45aec70640 1 -- start start 2023-12-20T04:53:06.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.632+0000 7f45aec70640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45a8069c30 0x7f45a815a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:06.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.632+0000 7f45aec70640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45a80cbde0 0x7f45a80b28f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:06.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.632+0000 7f45aec70640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45a815d360 0x7f45a80b0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:06.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.632+0000 7f45aec70640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a815bc40 con 0x7f45a815d360 2023-12-20T04:53:06.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.632+0000 7f45aec70640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45a81f2600 con 0x7f45a8069c30 2023-12-20T04:53:06.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.632+0000 7f45aec70640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45a80b58f0 con 0x7f45a80cbde0 2023-12-20T04:53:06.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.632+0000 7f45ad20d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45a815d360 0x7f45a80b0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:06.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.632+0000 7f45ad20d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45a815d360 0x7f45a80b0990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:59364/0 (socket says 172.21.15.132:59364) 2023-12-20T04:53:06.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.632+0000 7f45ad20d640 1 -- 172.21.15.132:0/499583897 learned_addr learned my addr 172.21.15.132:0/499583897 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:06.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.632+0000 7f45a7fff640 1 --2- 172.21.15.132:0/499583897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45a80cbde0 0x7f45a80b28f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:06.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.632+0000 7f45aca0c640 1 --2- 172.21.15.132:0/499583897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45a8069c30 0x7f45a815a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:06.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.633+0000 7f45ad20d640 1 -- 172.21.15.132:0/499583897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45a80cbde0 msgr2=0x7f45a80b28f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:06.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.633+0000 7f45ad20d640 1 --2- 172.21.15.132:0/499583897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45a80cbde0 0x7f45a80b28f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:06.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.633+0000 7f45ad20d640 1 -- 172.21.15.132:0/499583897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45a8069c30 msgr2=0x7f45a815a5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:06.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.633+0000 7f45ad20d640 1 --2- 172.21.15.132:0/499583897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45a8069c30 0x7f45a815a5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:06.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.633+0000 7f45ad20d640 1 -- 172.21.15.132:0/499583897 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45a0009b30 con 0x7f45a815d360 2023-12-20T04:53:06.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.633+0000 7f45ad20d640 1 --2- 172.21.15.132:0/499583897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45a815d360 0x7f45a80b0990 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f459800c820 tx=0x7f459800cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:06.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.633+0000 7f45a57fa640 1 -- 172.21.15.132:0/499583897 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4598007a30 con 0x7f45a815d360 2023-12-20T04:53:06.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.633+0000 7f45a57fa640 1 -- 172.21.15.132:0/499583897 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4598007b90 con 0x7f45a815d360 2023-12-20T04:53:06.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.633+0000 7f45a57fa640 1 -- 172.21.15.132:0/499583897 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f459800ce10 con 0x7f45a815d360 2023-12-20T04:53:06.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.633+0000 7f45aec70640 1 -- 172.21.15.132:0/499583897 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45a81602e0 con 0x7f45a815d360 2023-12-20T04:53:06.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.633+0000 7f45aec70640 1 -- 172.21.15.132:0/499583897 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f45a815b580 con 0x7f45a815d360 2023-12-20T04:53:06.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.634+0000 7f45aec70640 1 -- 172.21.15.132:0/499583897 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45a815bd80 con 0x7f45a815d360 2023-12-20T04:53:06.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.634+0000 7f45a57fa640 1 -- 172.21.15.132:0/499583897 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f45980113f0 con 0x7f45a815d360 2023-12-20T04:53:06.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.635+0000 7f45a57fa640 1 --2- 172.21.15.132:0/499583897 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f459406a430 0x7f459406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:06.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.635+0000 7f45a57fa640 1 -- 172.21.15.132:0/499583897 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f45980888f0 con 0x7f45a815d360 2023-12-20T04:53:06.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.635+0000 7f45aca0c640 1 --2- 172.21.15.132:0/499583897 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f459406a430 0x7f459406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:06.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.635+0000 7f45aca0c640 1 --2- 172.21.15.132:0/499583897 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f459406a430 0x7f459406c8f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f45a0035000 tx=0x7f45a0030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:06.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.639+0000 7f45a57fa640 1 -- 172.21.15.132:0/499583897 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f45a815bd80 con 0x7f45a815d360 2023-12-20T04:53:06.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:06.838+0000 7f45aec70640 1 -- 172.21.15.132:0/499583897 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f45a815bd80 con 0x7f45a815d360 2023-12-20T04:53:07.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.b has been restored 2023-12-20T04:53:07.227 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mds.d has been restored 2023-12-20T04:53:07.509 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.508+0000 7f45a57fa640 1 -- 172.21.15.132:0/499583897 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v70) v1 ==== 122+0+0 (secure 0 0 0) 0x7f45a815bd80 con 0x7f45a815d360 2023-12-20T04:53:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.510+0000 7f45aec70640 1 -- 172.21.15.132:0/499583897 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f459406a430 msgr2=0x7f459406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.510+0000 7f45aec70640 1 --2- 172.21.15.132:0/499583897 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f459406a430 0x7f459406c8f0 secure :-1 s=READY pgs=759 cs=0 l=1 rev1=1 crypto rx=0x7f45a0035000 tx=0x7f45a0030000 comp rx=0 tx=0).stop 2023-12-20T04:53:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.510+0000 7f45aec70640 1 -- 172.21.15.132:0/499583897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45a815d360 msgr2=0x7f45a80b0990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.510+0000 7f45aec70640 1 --2- 172.21.15.132:0/499583897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45a815d360 0x7f45a80b0990 secure :-1 s=READY pgs=1802 cs=0 l=1 rev1=1 crypto rx=0x7f459800c820 tx=0x7f459800cce0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.511+0000 7f45aec70640 1 -- 172.21.15.132:0/499583897 shutdown_connections 2023-12-20T04:53:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.511+0000 7f45aec70640 1 --2- 172.21.15.132:0/499583897 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f459406a430 0x7f459406c8f0 unknown :-1 s=CLOSED pgs=759 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.511+0000 7f45aec70640 1 --2- 172.21.15.132:0/499583897 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45a815d360 0x7f45a80b0990 unknown :-1 s=CLOSED pgs=1802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.513 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.511+0000 7f45aec70640 1 --2- 172.21.15.132:0/499583897 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f45a80cbde0 0x7f45a80b28f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.511+0000 7f45aec70640 1 --2- 172.21.15.132:0/499583897 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45a8069c30 0x7f45a815a5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.511+0000 7f45aec70640 1 -- 172.21.15.132:0/499583897 >> 172.21.15.132:0/499583897 conn(0x7f45a80cc630 msgr2=0x7f45a80acf20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:07.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.511+0000 7f45aec70640 1 -- 172.21.15.132:0/499583897 shutdown_connections 2023-12-20T04:53:07.514 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.511+0000 7f45aec70640 1 -- 172.21.15.132:0/499583897 wait complete. 2023-12-20T04:53:07.525 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2023-12-20T04:53:07.526 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:53:07.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.626+0000 7fc47b2bd640 1 Processor -- start 2023-12-20T04:53:07.628 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.626+0000 7fc47b2bd640 1 -- start start 2023-12-20T04:53:07.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.627+0000 7fc47b2bd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc47415d110 0x7fc474069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:07.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.627+0000 7fc47b2bd640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc4740af210 0x7fc47406a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:07.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.627+0000 7fc47b2bd640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc474161ce0 con 0x7fc47415d4f0 2023-12-20T04:53:07.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.627+0000 7fc47b2bd640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4740aca50 con 0x7fc47415d110 2023-12-20T04:53:07.629 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.627+0000 7fc47b2bd640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc474160df0 con 0x7fc4740af210 2023-12-20T04:53:07.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.627+0000 7fc479059640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc47415d110 0x7fc474069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:07.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.627+0000 7fc479059640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc47415d110 0x7fc474069de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33062/0 (socket says 172.21.15.132:33062) 2023-12-20T04:53:07.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.627+0000 7fc479059640 1 -- 172.21.15.132:0/3976893291 learned_addr learned my addr 172.21.15.132:0/3976893291 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:07.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.627+0000 7fc47985a640 1 --2- 172.21.15.132:0/3976893291 >> v2:172.21.15.187:3300/0 conn(0x7fc4740af210 0x7fc47406a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:07.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.627+0000 7fc479059640 1 -- 172.21.15.132:0/3976893291 >> v2:172.21.15.187:3300/0 conn(0x7fc4740af210 msgr2=0x7fc47406a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:07.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.627+0000 7fc479059640 1 --2- 172.21.15.132:0/3976893291 >> v2:172.21.15.187:3300/0 conn(0x7fc4740af210 0x7fc47406a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.627+0000 7fc479059640 1 -- 172.21.15.132:0/3976893291 >> v1:172.21.15.132:6789/0 conn(0x7fc47415d4f0 legacy=0x7fc4740aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:07.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.627+0000 7fc46bfff640 1 -- 172.21.15.132:0/3976893291 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1690455476 0 0) 0x7fc474161ce0 con 0x7fc47415d4f0 2023-12-20T04:53:07.630 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.627+0000 7fc479059640 1 -- 172.21.15.132:0/3976893291 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4741610d0 con 0x7fc47415d110 2023-12-20T04:53:07.631 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.628+0000 7fc479059640 1 --2- 172.21.15.132:0/3976893291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc47415d110 0x7fc474069de0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fc4740704f0 tx=0x7fc47002b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=380a010d516ef32f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:07.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.628+0000 7fc46bfff640 1 -- 172.21.15.132:0/3976893291 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470004230 con 0x7fc47415d110 2023-12-20T04:53:07.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.628+0000 7fc46bfff640 1 -- 172.21.15.132:0/3976893291 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc470004390 con 0x7fc47415d110 2023-12-20T04:53:07.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.628+0000 7fc46bfff640 1 -- 172.21.15.132:0/3976893291 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470030840 con 0x7fc47415d110 2023-12-20T04:53:07.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.628+0000 7fc47b2bd640 1 -- 172.21.15.132:0/3976893291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc47415d110 msgr2=0x7fc474069de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:07.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.628+0000 7fc47b2bd640 1 --2- 172.21.15.132:0/3976893291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc47415d110 0x7fc474069de0 secure :-1 s=READY pgs=1804 cs=0 l=1 rev1=1 crypto rx=0x7fc4740704f0 tx=0x7fc47002b980 comp rx=0 tx=0).stop 2023-12-20T04:53:07.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.629+0000 7fc47b2bd640 1 -- 172.21.15.132:0/3976893291 shutdown_connections 2023-12-20T04:53:07.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.629+0000 7fc47b2bd640 1 --2- 172.21.15.132:0/3976893291 >> v2:172.21.15.187:3300/0 conn(0x7fc4740af210 0x7fc47406a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.629+0000 7fc47b2bd640 1 --2- 172.21.15.132:0/3976893291 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc47415d110 0x7fc474069de0 unknown :-1 s=CLOSED pgs=1804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.629+0000 7fc47b2bd640 1 -- 172.21.15.132:0/3976893291 >> 172.21.15.132:0/3976893291 conn(0x7fc4740cfbd0 msgr2=0x7fc4740cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:07.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.629+0000 7fc47b2bd640 1 -- 172.21.15.132:0/3976893291 shutdown_connections 2023-12-20T04:53:07.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.629+0000 7fc47b2bd640 1 -- 172.21.15.132:0/3976893291 wait complete. 2023-12-20T04:53:07.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.630+0000 7fc47b2bd640 1 Processor -- start 2023-12-20T04:53:07.632 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.630+0000 7fc47b2bd640 1 -- start start 2023-12-20T04:53:07.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.630+0000 7fc47b2bd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4740af210 0x7fc474151810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:07.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.630+0000 7fc47b2bd640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc47415d110 0x7fc47406cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:07.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.630+0000 7fc47b2bd640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc47415d4f0 0x7fc4741f6100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:07.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.630+0000 7fc47b2bd640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc474151d50 con 0x7fc4740af210 2023-12-20T04:53:07.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.630+0000 7fc47b2bd640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc47406df20 con 0x7fc47415d110 2023-12-20T04:53:07.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.630+0000 7fc47b2bd640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4740c6dd0 con 0x7fc47415d4f0 2023-12-20T04:53:07.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.631+0000 7fc479059640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4740af210 0x7fc474151810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:07.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.631+0000 7fc479059640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4740af210 0x7fc474151810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33072/0 (socket says 172.21.15.132:33072) 2023-12-20T04:53:07.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.631+0000 7fc479059640 1 -- 172.21.15.132:0/364347427 learned_addr learned my addr 172.21.15.132:0/364347427 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:07.635 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.631+0000 7fc478858640 1 --2- 172.21.15.132:0/364347427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc47415d110 0x7fc47406cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:07.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.631+0000 7fc47985a640 1 --2- 172.21.15.132:0/364347427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc47415d4f0 0x7fc4741f6100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:07.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.631+0000 7fc479059640 1 -- 172.21.15.132:0/364347427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc47415d4f0 msgr2=0x7fc4741f6100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:07.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.631+0000 7fc479059640 1 --2- 172.21.15.132:0/364347427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc47415d4f0 0x7fc4741f6100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.631+0000 7fc479059640 1 -- 172.21.15.132:0/364347427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc47415d110 msgr2=0x7fc47406cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:07.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.631+0000 7fc479059640 1 --2- 172.21.15.132:0/364347427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc47415d110 0x7fc47406cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.631+0000 7fc479059640 1 -- 172.21.15.132:0/364347427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc470009460 con 0x7fc4740af210 2023-12-20T04:53:07.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.631+0000 7fc479059640 1 --2- 172.21.15.132:0/364347427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4740af210 0x7fc474151810 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fc470000c00 tx=0x7fc4700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:07.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.631+0000 7fc469ffb640 1 -- 172.21.15.132:0/364347427 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc47003d070 con 0x7fc4740af210 2023-12-20T04:53:07.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.631+0000 7fc469ffb640 1 -- 172.21.15.132:0/364347427 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc470004500 con 0x7fc4740af210 2023-12-20T04:53:07.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.631+0000 7fc47b2bd640 1 -- 172.21.15.132:0/364347427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47406d960 con 0x7fc4740af210 2023-12-20T04:53:07.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.631+0000 7fc469ffb640 1 -- 172.21.15.132:0/364347427 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc470030e40 con 0x7fc4740af210 2023-12-20T04:53:07.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.631+0000 7fc47b2bd640 1 -- 172.21.15.132:0/364347427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4740c7070 con 0x7fc4740af210 2023-12-20T04:53:07.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.632+0000 7fc47b2bd640 1 -- 172.21.15.132:0/364347427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47404e840 con 0x7fc4740af210 2023-12-20T04:53:07.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.633+0000 7fc469ffb640 1 -- 172.21.15.132:0/364347427 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc470003610 con 0x7fc4740af210 2023-12-20T04:53:07.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.633+0000 7fc469ffb640 1 --2- 172.21.15.132:0/364347427 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc45806a430 0x7fc45806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:07.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.633+0000 7fc478858640 1 --2- 172.21.15.132:0/364347427 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc45806a430 0x7fc45806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:07.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.633+0000 7fc469ffb640 1 -- 172.21.15.132:0/364347427 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc4700aa8c0 con 0x7fc4740af210 2023-12-20T04:53:07.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.634+0000 7fc478858640 1 --2- 172.21.15.132:0/364347427 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc45806a430 0x7fc45806c8f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc4740c53b0 tx=0x7fc464009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:07.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.637+0000 7fc469ffb640 1 -- 172.21.15.132:0/364347427 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc470075ff0 con 0x7fc4740af210 2023-12-20T04:53:07.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.838+0000 7fc47b2bd640 1 -- 172.21.15.132:0/364347427 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fc4740d0940 con 0x7fc4740af210 2023-12-20T04:53:07.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.839+0000 7fc469ffb640 1 -- 172.21.15.132:0/364347427 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4722 (secure 0 0 0) 0x7fc470079610 con 0x7fc4740af210 2023-12-20T04:53:07.841 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:07.842 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":70,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3443409957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3443409957},{"type":"v1","addr":"172.21.15.187:6833","nonce":3443409957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/321445180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":321445180},{"type":"v1","addr":"172.21.15.187:6835","nonce":321445180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1166803529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1166803529},{"type":"v1","addr":"172.21.15.132:6836","nonce":1166803529}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:53:04.838088+0000","modified":"2023-12-20T04:53:07.506024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9117":{"gid":9117,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/2356846201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2356846201},{"type":"v1","addr":"172.21.15.132:6837","nonce":2356846201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-20T04:53:07.842 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 70 2023-12-20T04:53:07.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.841+0000 7fc47b2bd640 1 -- 172.21.15.132:0/364347427 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc45806a430 msgr2=0x7fc45806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:07.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.841+0000 7fc47b2bd640 1 --2- 172.21.15.132:0/364347427 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc45806a430 0x7fc45806c8f0 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7fc4740c53b0 tx=0x7fc464009040 comp rx=0 tx=0).stop 2023-12-20T04:53:07.843 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.841+0000 7fc47b2bd640 1 -- 172.21.15.132:0/364347427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4740af210 msgr2=0x7fc474151810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:07.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.841+0000 7fc47b2bd640 1 --2- 172.21.15.132:0/364347427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4740af210 0x7fc474151810 secure :-1 s=READY pgs=1805 cs=0 l=1 rev1=1 crypto rx=0x7fc470000c00 tx=0x7fc4700046c0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.841+0000 7fc47b2bd640 1 -- 172.21.15.132:0/364347427 shutdown_connections 2023-12-20T04:53:07.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.841+0000 7fc47b2bd640 1 --2- 172.21.15.132:0/364347427 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc45806a430 0x7fc45806c8f0 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.841+0000 7fc47b2bd640 1 --2- 172.21.15.132:0/364347427 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc47415d4f0 0x7fc4741f6100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.841+0000 7fc47b2bd640 1 --2- 172.21.15.132:0/364347427 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc47415d110 0x7fc47406cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.841+0000 7fc47b2bd640 1 --2- 172.21.15.132:0/364347427 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4740af210 0x7fc474151810 unknown :-1 s=CLOSED pgs=1805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.841+0000 7fc47b2bd640 1 -- 172.21.15.132:0/364347427 >> 172.21.15.132:0/364347427 conn(0x7fc4740cfbd0 msgr2=0x7fc47406ead0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:07.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.841+0000 7fc47b2bd640 1 -- 172.21.15.132:0/364347427 shutdown_connections 2023-12-20T04:53:07.844 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.841+0000 7fc47b2bd640 1 -- 172.21.15.132:0/364347427 wait complete. 2023-12-20T04:53:07.855 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:53:07.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.952+0000 7fcee0e96640 1 Processor -- start 2023-12-20T04:53:07.955 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.952+0000 7fcee0e96640 1 -- start start 2023-12-20T04:53:07.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.953+0000 7fcee0e96640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcedc06a340 0x7fcedc15dad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:07.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.953+0000 7fcee0e96640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcedc161220 con 0x7fcedc160d70 2023-12-20T04:53:07.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.953+0000 7fcee0e96640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcedc06d530 con 0x7fcedc15ab70 2023-12-20T04:53:07.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.953+0000 7fcee0e96640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc070540 con 0x7fcedc06a340 2023-12-20T04:53:07.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.953+0000 7fced1d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcedc160d70 0x7fcedc069c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:51214/0 (socket says 172.21.15.132:51214) 2023-12-20T04:53:07.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.953+0000 7fced1d9b640 1 -- 172.21.15.132:0/1292947700 learned_addr learned my addr 172.21.15.132:0/1292947700 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:07.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fced9d9b640 1 -- 172.21.15.132:0/1292947700 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2178101780 0 0) 0x7fcedc161220 con 0x7fcedc160d70 2023-12-20T04:53:07.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fced9d9b640 1 -- 172.21.15.132:0/1292947700 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fcec8003520 con 0x7fcedc160d70 2023-12-20T04:53:07.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fcedad9d640 1 --2- 172.21.15.132:0/1292947700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcedc06a340 0x7fcedc15dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:07.958 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fced9d9b640 1 -- 172.21.15.132:0/1292947700 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 617652642 0 0) 0x7fcec8003520 con 0x7fcedc160d70 2023-12-20T04:53:07.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fced9d9b640 1 -- 172.21.15.132:0/1292947700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcedc06a340 msgr2=0x7fcedc15dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:07.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fced9d9b640 1 --2- 172.21.15.132:0/1292947700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcedc06a340 0x7fcedc15dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fced9d9b640 1 -- 172.21.15.132:0/1292947700 >> v1:172.21.15.187:6789/0 conn(0x7fcedc15ab70 legacy=0x7fcedc0cf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:07.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fced9d9b640 1 -- 172.21.15.132:0/1292947700 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc070790 con 0x7fcedc160d70 2023-12-20T04:53:07.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fced9d9b640 1 -- 172.21.15.132:0/1292947700 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fcec4001670 con 0x7fcedc160d70 2023-12-20T04:53:07.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fcedad9d640 1 --2- 172.21.15.132:0/1292947700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcedc06a340 0x7fcedc15dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:07.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fced9d9b640 1 -- 172.21.15.132:0/1292947700 >> v1:172.21.15.132:6789/0 conn(0x7fcedc160d70 legacy=0x7fcedc069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:07.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fced9d9b640 1 --2- 172.21.15.132:0/1292947700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcec80039a0 0x7fcec8003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:07.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fced9d9b640 1 --2- 172.21.15.132:0/1292947700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcedc06a340 0x7fcec80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:07.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fced9d9b640 1 --2- 172.21.15.132:0/1292947700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8004d00 0x7fcec8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:07.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fced9d9b640 1 -- 172.21.15.132:0/1292947700 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc070540 con 0x7fcec8004d00 2023-12-20T04:53:07.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fced9d9b640 1 -- 172.21.15.132:0/1292947700 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcec800bac0 con 0x7fcec80039a0 2023-12-20T04:53:07.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fced9d9b640 1 -- 172.21.15.132:0/1292947700 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcec800bc80 con 0x7fcedc06a340 2023-12-20T04:53:07.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fcedad9d640 1 --2- 172.21.15.132:0/1292947700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8004d00 0x7fcec8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:07.959 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fceda59c640 1 --2- 172.21.15.132:0/1292947700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcec80039a0 0x7fcec8003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fced1d9b640 1 --2- 172.21.15.132:0/1292947700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcedc06a340 0x7fcec80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fcedad9d640 1 -- 172.21.15.132:0/1292947700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcedc06a340 msgr2=0x7fcec80047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fcedad9d640 1 --2- 172.21.15.132:0/1292947700 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcedc06a340 0x7fcec80047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fcedad9d640 1 -- 172.21.15.132:0/1292947700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcec80039a0 msgr2=0x7fcec8003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fcedad9d640 1 --2- 172.21.15.132:0/1292947700 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcec80039a0 0x7fcec8003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.954+0000 7fcedad9d640 1 -- 172.21.15.132:0/1292947700 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcec8003520 con 0x7fcec8004d00 2023-12-20T04:53:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.955+0000 7fcedad9d640 1 --2- 172.21.15.132:0/1292947700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8004d00 0x7fcec8005180 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fced40073b0 tx=0x7fcec80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31ecffc63564f7be server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.955+0000 7fced9d9b640 1 -- 172.21.15.132:0/1292947700 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced402cd30 con 0x7fcec8004d00 2023-12-20T04:53:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.955+0000 7fced9d9b640 1 -- 172.21.15.132:0/1292947700 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fced402ce90 con 0x7fcec8004d00 2023-12-20T04:53:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.955+0000 7fced9d9b640 1 -- 172.21.15.132:0/1292947700 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fced4034640 con 0x7fcec8004d00 2023-12-20T04:53:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.956+0000 7fcee0e96640 1 -- 172.21.15.132:0/1292947700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8004d00 msgr2=0x7fcec8005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.956+0000 7fcee0e96640 1 --2- 172.21.15.132:0/1292947700 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcec8004d00 0x7fcec8005180 secure :-1 s=READY pgs=1807 cs=0 l=1 rev1=1 crypto rx=0x7fced40073b0 tx=0x7fcec80057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.956+0000 7fcedad9d640 1 -- 172.21.15.132:0/1292947700 reap_dead start 2023-12-20T04:53:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.956+0000 7fcee0e96640 1 -- 172.21.15.132:0/1292947700 shutdown_connections 2023-12-20T04:53:07.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.956+0000 7fcee0e96640 1 -- 172.21.15.132:0/1292947700 >> 172.21.15.132:0/1292947700 conn(0x7fcedc0cfca0 msgr2=0x7fcedc0d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:07.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.956+0000 7fcee0e96640 1 -- 172.21.15.132:0/1292947700 shutdown_connections 2023-12-20T04:53:07.961 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.956+0000 7fcee0e96640 1 -- 172.21.15.132:0/1292947700 wait complete. 2023-12-20T04:53:07.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.957+0000 7fcee0e96640 1 Processor -- start 2023-12-20T04:53:07.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.957+0000 7fcee0e96640 1 -- start start 2023-12-20T04:53:07.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fcee0e96640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcec8004d00 0x7fcedc0b0200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:07.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fcee0e96640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcedc1f6cb0 0x7fcedc1f6310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:07.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fcee0e96640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcedc15f220 0x7fcedc15f6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:07.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fcee0e96640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc0af190 con 0x7fcedc1f6cb0 2023-12-20T04:53:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fcee0e96640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc0ada30 con 0x7fcedc15f220 2023-12-20T04:53:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fcee0e96640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcedc0add10 con 0x7fcec8004d00 2023-12-20T04:53:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fced1d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcedc1f6cb0 0x7fcedc1f6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fced1d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcedc1f6cb0 0x7fcedc1f6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33096/0 (socket says 172.21.15.132:33096) 2023-12-20T04:53:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fced1d9b640 1 -- 172.21.15.132:0/4045373735 learned_addr learned my addr 172.21.15.132:0/4045373735 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fceda59c640 1 --2- 172.21.15.132:0/4045373735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcec8004d00 0x7fcedc0b0200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fcedad9d640 1 --2- 172.21.15.132:0/4045373735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcedc15f220 0x7fcedc15f6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fced1d9b640 1 -- 172.21.15.132:0/4045373735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcec8004d00 msgr2=0x7fcedc0b0200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fced1d9b640 1 --2- 172.21.15.132:0/4045373735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcec8004d00 0x7fcedc0b0200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fced1d9b640 1 -- 172.21.15.132:0/4045373735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcedc15f220 msgr2=0x7fcedc15f6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fced1d9b640 1 --2- 172.21.15.132:0/4045373735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcedc15f220 0x7fcedc15f6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fced1d9b640 1 -- 172.21.15.132:0/4045373735 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcedc0aedb0 con 0x7fcedc1f6cb0 2023-12-20T04:53:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fcedad9d640 1 --2- 172.21.15.132:0/4045373735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcedc15f220 0x7fcedc15f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:07.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.958+0000 7fced1d9b640 1 --2- 172.21.15.132:0/4045373735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcedc1f6cb0 0x7fcedc1f6310 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fcec40072c0 tx=0x7fcec4007780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.959+0000 7fced37fe640 1 -- 172.21.15.132:0/4045373735 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec4001570 con 0x7fcedc1f6cb0 2023-12-20T04:53:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.959+0000 7fced37fe640 1 -- 172.21.15.132:0/4045373735 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcec400fa20 con 0x7fcedc1f6cb0 2023-12-20T04:53:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.959+0000 7fced37fe640 1 -- 172.21.15.132:0/4045373735 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcec400fdd0 con 0x7fcedc1f6cb0 2023-12-20T04:53:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.959+0000 7fcee0e96640 1 -- 172.21.15.132:0/4045373735 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcedc0b0740 con 0x7fcedc1f6cb0 2023-12-20T04:53:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.959+0000 7fcee0e96640 1 -- 172.21.15.132:0/4045373735 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcedc1f6a30 con 0x7fcedc1f6cb0 2023-12-20T04:53:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.960+0000 7fcee0e96640 1 -- 172.21.15.132:0/4045373735 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcedc04e840 con 0x7fcedc1f6cb0 2023-12-20T04:53:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.960+0000 7fced37fe640 1 -- 172.21.15.132:0/4045373735 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcec401d460 con 0x7fcedc1f6cb0 2023-12-20T04:53:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.960+0000 7fced37fe640 1 --2- 172.21.15.132:0/4045373735 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcebc06a430 0x7fcebc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.961+0000 7fceda59c640 1 --2- 172.21.15.132:0/4045373735 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcebc06a430 0x7fcebc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.961+0000 7fced37fe640 1 -- 172.21.15.132:0/4045373735 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcec40888b0 con 0x7fcedc1f6cb0 2023-12-20T04:53:07.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.961+0000 7fceda59c640 1 --2- 172.21.15.132:0/4045373735 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcebc06a430 0x7fcebc06c8f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcecc000c00 tx=0x7fcecc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:07.967 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:07.965+0000 7fced37fe640 1 -- 172.21.15.132:0/4045373735 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcec4053f30 con 0x7fcedc1f6cb0 2023-12-20T04:53:08.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.130+0000 7fcee0e96640 1 -- 172.21.15.132:0/4045373735 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fcedc1f6a30 con 0x7fcedc1f6cb0 2023-12-20T04:53:08.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.131+0000 7fced37fe640 1 -- 172.21.15.132:0/4045373735 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v186) v1 ==== 74+0+16152 (secure 0 0 0) 0x7fcedc1f6a30 con 0x7fcedc1f6cb0 2023-12-20T04:53:08.133 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:08.134 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":186,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:53:05.839842+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:53:03.034230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-20T04:53:03.812892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"186","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:53:08.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.133+0000 7fcee0e96640 1 -- 172.21.15.132:0/4045373735 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcebc06a430 msgr2=0x7fcebc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.133+0000 7fcee0e96640 1 --2- 172.21.15.132:0/4045373735 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcebc06a430 0x7fcebc06c8f0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7fcecc000c00 tx=0x7fcecc009040 comp rx=0 tx=0).stop 2023-12-20T04:53:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.133+0000 7fcee0e96640 1 -- 172.21.15.132:0/4045373735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcedc1f6cb0 msgr2=0x7fcedc1f6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.133+0000 7fcee0e96640 1 --2- 172.21.15.132:0/4045373735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcedc1f6cb0 0x7fcedc1f6310 secure :-1 s=READY pgs=1808 cs=0 l=1 rev1=1 crypto rx=0x7fcec40072c0 tx=0x7fcec4007780 comp rx=0 tx=0).stop 2023-12-20T04:53:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.133+0000 7fcee0e96640 1 -- 172.21.15.132:0/4045373735 shutdown_connections 2023-12-20T04:53:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.133+0000 7fcee0e96640 1 --2- 172.21.15.132:0/4045373735 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcebc06a430 0x7fcebc06c8f0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.133+0000 7fcee0e96640 1 --2- 172.21.15.132:0/4045373735 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcedc15f220 0x7fcedc15f6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.133+0000 7fcee0e96640 1 --2- 172.21.15.132:0/4045373735 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcedc1f6cb0 0x7fcedc1f6310 unknown :-1 s=CLOSED pgs=1808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.133+0000 7fcee0e96640 1 --2- 172.21.15.132:0/4045373735 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcec8004d00 0x7fcedc0b0200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.133+0000 7fcee0e96640 1 -- 172.21.15.132:0/4045373735 >> 172.21.15.132:0/4045373735 conn(0x7fcedc0cfca0 msgr2=0x7fcedc0c6530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.133+0000 7fcee0e96640 1 -- 172.21.15.132:0/4045373735 shutdown_connections 2023-12-20T04:53:08.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.133+0000 7fcee0e96640 1 -- 172.21.15.132:0/4045373735 wait complete. 2023-12-20T04:53:08.147 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2023-12-20T04:53:08.147 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:53:08.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.244+0000 7f0f801b1640 1 Processor -- start 2023-12-20T04:53:08.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.244+0000 7f0f801b1640 1 -- start start 2023-12-20T04:53:08.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.245+0000 7f0f801b1640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0f7815d100 0x7f0f780b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:08.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.245+0000 7f0f801b1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f780b2f90 con 0x7f0f780d0370 2023-12-20T04:53:08.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.245+0000 7f0f801b1640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0f781613c0 con 0x7f0f780cdc10 2023-12-20T04:53:08.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.245+0000 7f0f801b1640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0f780d1b00 con 0x7f0f7815d100 2023-12-20T04:53:08.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.245+0000 7f0f7df4d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f0f7815d100 0x7f0f780b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:08.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.245+0000 7f0f7d74c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f0f780d0370 0x7f0f780cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:51222/0 (socket says 172.21.15.132:51222) 2023-12-20T04:53:08.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.245+0000 7f0f7d74c640 1 -- 172.21.15.132:0/3774223736 learned_addr learned my addr 172.21.15.132:0/3774223736 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:08.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.245+0000 7f0f7df4d640 1 -- 172.21.15.132:0/3774223736 >> v1:172.21.15.187:6789/0 conn(0x7f0f780cdc10 legacy=0x7f0f7806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:08.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.245+0000 7f0f7df4d640 1 -- 172.21.15.132:0/3774223736 >> v1:172.21.15.132:6789/0 conn(0x7f0f780d0370 legacy=0x7f0f780cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.245+0000 7f0f7df4d640 1 -- 172.21.15.132:0/3774223736 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f780d0810 con 0x7f0f7815d100 2023-12-20T04:53:08.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.245+0000 7f0f7cf4b640 1 -- 172.21.15.132:0/3774223736 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3212073738 0 0) 0x7f0f68001110 con 0x7f0f780d0370 2023-12-20T04:53:08.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.246+0000 7f0f7df4d640 1 --2- 172.21.15.132:0/3774223736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f7815d100 0x7f0f780b2a50 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009d90 tx=0x7f0f7402bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=422573abc9057c85 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:08.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.246+0000 7f0f7cf4b640 1 -- 172.21.15.132:0/3774223736 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7402cd00 con 0x7f0f7815d100 2023-12-20T04:53:08.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.246+0000 7f0f7cf4b640 1 -- 172.21.15.132:0/3774223736 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7402ce60 con 0x7f0f7815d100 2023-12-20T04:53:08.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.246+0000 7f0f7cf4b640 1 -- 172.21.15.132:0/3774223736 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f74034660 con 0x7f0f7815d100 2023-12-20T04:53:08.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.247+0000 7f0f801b1640 1 -- 172.21.15.132:0/3774223736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f7815d100 msgr2=0x7f0f780b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.247+0000 7f0f801b1640 1 --2- 172.21.15.132:0/3774223736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f7815d100 0x7f0f780b2a50 secure :-1 s=READY pgs=1810 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009d90 tx=0x7f0f7402bf50 comp rx=0 tx=0).stop 2023-12-20T04:53:08.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.247+0000 7f0f801b1640 1 -- 172.21.15.132:0/3774223736 shutdown_connections 2023-12-20T04:53:08.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.247+0000 7f0f801b1640 1 --2- 172.21.15.132:0/3774223736 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f7815d100 0x7f0f780b2a50 unknown :-1 s=CLOSED pgs=1810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.247+0000 7f0f801b1640 1 -- 172.21.15.132:0/3774223736 >> 172.21.15.132:0/3774223736 conn(0x7f0f7806d7c0 msgr2=0x7f0f7806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:08.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.247+0000 7f0f801b1640 1 -- 172.21.15.132:0/3774223736 shutdown_connections 2023-12-20T04:53:08.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.247+0000 7f0f801b1640 1 -- 172.21.15.132:0/3774223736 wait complete. 2023-12-20T04:53:08.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.248+0000 7f0f801b1640 1 Processor -- start 2023-12-20T04:53:08.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.248+0000 7f0f801b1640 1 -- start start 2023-12-20T04:53:08.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.249+0000 7f0f801b1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f780cdc10 0x7f0f78152e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:08.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.249+0000 7f0f801b1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f780d0370 0x7f0f780b1880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:08.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.249+0000 7f0f801b1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f7815d100 0x7f0f780b1dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:08.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.249+0000 7f0f801b1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f78159c00 con 0x7f0f780cdc10 2023-12-20T04:53:08.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.249+0000 7f0f801b1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f780ca0c0 con 0x7f0f780d0370 2023-12-20T04:53:08.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.249+0000 7f0f801b1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0f78153a10 con 0x7f0f7815d100 2023-12-20T04:53:08.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.249+0000 7f0f7df4d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f780cdc10 0x7f0f78152e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:08.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.249+0000 7f0f7df4d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f780cdc10 0x7f0f78152e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33108/0 (socket says 172.21.15.132:33108) 2023-12-20T04:53:08.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.249+0000 7f0f7df4d640 1 -- 172.21.15.132:0/1690466440 learned_addr learned my addr 172.21.15.132:0/1690466440 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:08.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.249+0000 7f0f7df4d640 1 -- 172.21.15.132:0/1690466440 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f7815d100 msgr2=0x7f0f780b1dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.249+0000 7f0f7df4d640 1 --2- 172.21.15.132:0/1690466440 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f7815d100 0x7f0f780b1dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.249+0000 7f0f7df4d640 1 -- 172.21.15.132:0/1690466440 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f780d0370 msgr2=0x7f0f780b1880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.249+0000 7f0f7df4d640 1 --2- 172.21.15.132:0/1690466440 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f780d0370 0x7f0f780b1880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.249+0000 7f0f7df4d640 1 -- 172.21.15.132:0/1690466440 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f74009a70 con 0x7f0f780cdc10 2023-12-20T04:53:08.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.249+0000 7f0f7df4d640 1 --2- 172.21.15.132:0/1690466440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f780cdc10 0x7f0f78152e40 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009d90 tx=0x7f0f74004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:08.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.250+0000 7f0f6e7fc640 1 -- 172.21.15.132:0/1690466440 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7403d600 con 0x7f0f780cdc10 2023-12-20T04:53:08.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.250+0000 7f0f6e7fc640 1 -- 172.21.15.132:0/1690466440 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f7403d760 con 0x7f0f780cdc10 2023-12-20T04:53:08.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.250+0000 7f0f801b1640 1 -- 172.21.15.132:0/1690466440 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f7815a090 con 0x7f0f780cdc10 2023-12-20T04:53:08.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.250+0000 7f0f6e7fc640 1 -- 172.21.15.132:0/1690466440 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f7403db10 con 0x7f0f780cdc10 2023-12-20T04:53:08.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.250+0000 7f0f801b1640 1 -- 172.21.15.132:0/1690466440 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f781595b0 con 0x7f0f780cdc10 2023-12-20T04:53:08.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.250+0000 7f0f801b1640 1 -- 172.21.15.132:0/1690466440 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f780ceb80 con 0x7f0f780cdc10 2023-12-20T04:53:08.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.251+0000 7f0f6e7fc640 1 -- 172.21.15.132:0/1690466440 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0f7403b040 con 0x7f0f780cdc10 2023-12-20T04:53:08.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.251+0000 7f0f6e7fc640 1 --2- 172.21.15.132:0/1690466440 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f5c06a430 0x7f0f5c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:08.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.251+0000 7f0f6e7fc640 1 -- 172.21.15.132:0/1690466440 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f740aa980 con 0x7f0f780cdc10 2023-12-20T04:53:08.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.251+0000 7f0f7d74c640 1 --2- 172.21.15.132:0/1690466440 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f5c06a430 0x7f0f5c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:08.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.252+0000 7f0f7d74c640 1 --2- 172.21.15.132:0/1690466440 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f5c06a430 0x7f0f5c06c8f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0f68007fd0 tx=0x7f0f68001300 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:08.257 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.255+0000 7f0f6e7fc640 1 -- 172.21.15.132:0/1690466440 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0f74075f70 con 0x7f0f780cdc10 2023-12-20T04:53:08.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.417+0000 7f0f801b1640 1 -- 172.21.15.132:0/1690466440 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0f78161050 con 0x7f0f5c06a430 2023-12-20T04:53:08.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.424+0000 7f0f6e7fc640 1 -- 172.21.15.132:0/1690466440 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285691 (secure 0 0 0) 0x7f0f680070d0 con 0x7f0f5c06a430 2023-12-20T04:53:08.429 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:08.431 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:53:08.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.427+0000 7f0f801b1640 1 -- 172.21.15.132:0/1690466440 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f5c06a430 msgr2=0x7f0f5c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.427+0000 7f0f801b1640 1 --2- 172.21.15.132:0/1690466440 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f5c06a430 0x7f0f5c06c8f0 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x7f0f68007fd0 tx=0x7f0f68001300 comp rx=0 tx=0).stop 2023-12-20T04:53:08.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.427+0000 7f0f801b1640 1 -- 172.21.15.132:0/1690466440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f780cdc10 msgr2=0x7f0f78152e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.427+0000 7f0f801b1640 1 --2- 172.21.15.132:0/1690466440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f780cdc10 0x7f0f78152e40 secure :-1 s=READY pgs=1811 cs=0 l=1 rev1=1 crypto rx=0x7f0f74009d90 tx=0x7f0f74004a40 comp rx=0 tx=0).stop 2023-12-20T04:53:08.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.427+0000 7f0f801b1640 1 -- 172.21.15.132:0/1690466440 shutdown_connections 2023-12-20T04:53:08.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.427+0000 7f0f801b1640 1 --2- 172.21.15.132:0/1690466440 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f5c06a430 0x7f0f5c06c8f0 unknown :-1 s=CLOSED pgs=762 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.427+0000 7f0f801b1640 1 --2- 172.21.15.132:0/1690466440 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0f7815d100 0x7f0f780b1dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.427+0000 7f0f801b1640 1 --2- 172.21.15.132:0/1690466440 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0f780d0370 0x7f0f780b1880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.427+0000 7f0f801b1640 1 --2- 172.21.15.132:0/1690466440 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0f780cdc10 0x7f0f78152e40 unknown :-1 s=CLOSED pgs=1811 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.427+0000 7f0f801b1640 1 -- 172.21.15.132:0/1690466440 >> 172.21.15.132:0/1690466440 conn(0x7f0f7806d7c0 msgr2=0x7f0f781552f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:08.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.427+0000 7f0f801b1640 1 -- 172.21.15.132:0/1690466440 shutdown_connections 2023-12-20T04:53:08.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.427+0000 7f0f801b1640 1 -- 172.21.15.132:0/1690466440 wait complete. 2023-12-20T04:53:08.440 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":494,"stamp":"2023-12-20T04:53:08.231542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9280,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553219,"statfs":{"total":1600000000,"available":1590497224,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.739117"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.844102+0000","last_change":"2023-12-20T04:53:04.852027+0000","last_active":"2023-12-20T04:53:05.844102+0000","last_peered":"2023-12-20T04:53:05.844102+0000","last_clean":"2023-12-20T04:53:05.844102+0000","last_became_active":"2023-12-20T04:53:04.851507+0000","last_became_peered":"2023-12-20T04:53:04.851507+0000","last_unstale":"2023-12-20T04:53:05.844102+0000","last_undegraded":"2023-12-20T04:53:05.844102+0000","last_fullsized":"2023-12-20T04:53:05.844102+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:03:03.009432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049698+0000","last_change":"2023-12-20T04:53:04.856637+0000","last_active":"2023-12-20T04:53:06.049698+0000","last_peered":"2023-12-20T04:53:06.049698+0000","last_clean":"2023-12-20T04:53:06.049698+0000","last_became_active":"2023-12-20T04:53:04.856076+0000","last_became_peered":"2023-12-20T04:53:04.856076+0000","last_unstale":"2023-12-20T04:53:06.049698+0000","last_undegraded":"2023-12-20T04:53:06.049698+0000","last_fullsized":"2023-12-20T04:53:06.049698+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:28:25.986363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049632+0000","last_change":"2023-12-20T04:53:04.853652+0000","last_active":"2023-12-20T04:53:06.049632+0000","last_peered":"2023-12-20T04:53:06.049632+0000","last_clean":"2023-12-20T04:53:06.049632+0000","last_became_active":"2023-12-20T04:53:04.853443+0000","last_became_peered":"2023-12-20T04:53:04.853443+0000","last_unstale":"2023-12-20T04:53:06.049632+0000","last_undegraded":"2023-12-20T04:53:06.049632+0000","last_fullsized":"2023-12-20T04:53:06.049632+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:11:15.383242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048443+0000","last_change":"2023-12-20T04:53:04.850407+0000","last_active":"2023-12-20T04:53:06.048443+0000","last_peered":"2023-12-20T04:53:06.048443+0000","last_clean":"2023-12-20T04:53:06.048443+0000","last_became_active":"2023-12-20T04:53:04.850146+0000","last_became_peered":"2023-12-20T04:53:04.850146+0000","last_unstale":"2023-12-20T04:53:06.048443+0000","last_undegraded":"2023-12-20T04:53:06.048443+0000","last_fullsized":"2023-12-20T04:53:06.048443+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:05:04.817033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049784+0000","last_change":"2023-12-20T04:53:04.852097+0000","last_active":"2023-12-20T04:53:06.049784+0000","last_peered":"2023-12-20T04:53:06.049784+0000","last_clean":"2023-12-20T04:53:06.049784+0000","last_became_active":"2023-12-20T04:53:04.851734+0000","last_became_peered":"2023-12-20T04:53:04.851734+0000","last_unstale":"2023-12-20T04:53:06.049784+0000","last_undegraded":"2023-12-20T04:53:06.049784+0000","last_fullsized":"2023-12-20T04:53:06.049784+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:46:48.937355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048500+0000","last_change":"2023-12-20T04:53:04.846641+0000","last_active":"2023-12-20T04:53:06.048500+0000","last_peered":"2023-12-20T04:53:06.048500+0000","last_clean":"2023-12-20T04:53:06.048500+0000","last_became_active":"2023-12-20T04:53:04.846383+0000","last_became_peered":"2023-12-20T04:53:04.846383+0000","last_unstale":"2023-12-20T04:53:06.048500+0000","last_undegraded":"2023-12-20T04:53:06.048500+0000","last_fullsized":"2023-12-20T04:53:06.048500+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:07:56.940883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843798+0000","last_change":"2023-12-20T04:53:04.844868+0000","last_active":"2023-12-20T04:53:05.843798+0000","last_peered":"2023-12-20T04:53:05.843798+0000","last_clean":"2023-12-20T04:53:05.843798+0000","last_became_active":"2023-12-20T04:53:04.844670+0000","last_became_peered":"2023-12-20T04:53:04.844670+0000","last_unstale":"2023-12-20T04:53:05.843798+0000","last_undegraded":"2023-12-20T04:53:05.843798+0000","last_fullsized":"2023-12-20T04:53:05.843798+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:17:12.710733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049698+0000","last_change":"2023-12-20T04:53:04.853059+0000","last_active":"2023-12-20T04:53:06.049698+0000","last_peered":"2023-12-20T04:53:06.049698+0000","last_clean":"2023-12-20T04:53:06.049698+0000","last_became_active":"2023-12-20T04:53:04.852804+0000","last_became_peered":"2023-12-20T04:53:04.852804+0000","last_unstale":"2023-12-20T04:53:06.049698+0000","last_undegraded":"2023-12-20T04:53:06.049698+0000","last_fullsized":"2023-12-20T04:53:06.049698+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:22:09.545774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049323+0000","last_change":"2023-12-20T04:53:04.851067+0000","last_active":"2023-12-20T04:53:06.049323+0000","last_peered":"2023-12-20T04:53:06.049323+0000","last_clean":"2023-12-20T04:53:06.049323+0000","last_became_active":"2023-12-20T04:53:04.850799+0000","last_became_peered":"2023-12-20T04:53:04.850799+0000","last_unstale":"2023-12-20T04:53:06.049323+0000","last_undegraded":"2023-12-20T04:53:06.049323+0000","last_fullsized":"2023-12-20T04:53:06.049323+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:46:09.712695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049878+0000","last_change":"2023-12-20T04:53:04.851954+0000","last_active":"2023-12-20T04:53:06.049878+0000","last_peered":"2023-12-20T04:53:06.049878+0000","last_clean":"2023-12-20T04:53:06.049878+0000","last_became_active":"2023-12-20T04:53:04.851442+0000","last_became_peered":"2023-12-20T04:53:04.851442+0000","last_unstale":"2023-12-20T04:53:06.049878+0000","last_undegraded":"2023-12-20T04:53:06.049878+0000","last_fullsized":"2023-12-20T04:53:06.049878+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:09:45.926143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049612+0000","last_change":"2023-12-20T04:53:04.853074+0000","last_active":"2023-12-20T04:53:06.049612+0000","last_peered":"2023-12-20T04:53:06.049612+0000","last_clean":"2023-12-20T04:53:06.049612+0000","last_became_active":"2023-12-20T04:53:04.852851+0000","last_became_peered":"2023-12-20T04:53:04.852851+0000","last_unstale":"2023-12-20T04:53:06.049612+0000","last_undegraded":"2023-12-20T04:53:06.049612+0000","last_fullsized":"2023-12-20T04:53:06.049612+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:41:56.678169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049823+0000","last_change":"2023-12-20T04:53:04.856304+0000","last_active":"2023-12-20T04:53:06.049823+0000","last_peered":"2023-12-20T04:53:06.049823+0000","last_clean":"2023-12-20T04:53:06.049823+0000","last_became_active":"2023-12-20T04:53:04.855262+0000","last_became_peered":"2023-12-20T04:53:04.855262+0000","last_unstale":"2023-12-20T04:53:06.049823+0000","last_undegraded":"2023-12-20T04:53:06.049823+0000","last_fullsized":"2023-12-20T04:53:06.049823+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:37:07.178462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049347+0000","last_change":"2023-12-20T04:53:04.850223+0000","last_active":"2023-12-20T04:53:06.049347+0000","last_peered":"2023-12-20T04:53:06.049347+0000","last_clean":"2023-12-20T04:53:06.049347+0000","last_became_active":"2023-12-20T04:53:04.849715+0000","last_became_peered":"2023-12-20T04:53:04.849715+0000","last_unstale":"2023-12-20T04:53:06.049347+0000","last_undegraded":"2023-12-20T04:53:06.049347+0000","last_fullsized":"2023-12-20T04:53:06.049347+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:13:00.830694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049049+0000","last_change":"2023-12-20T04:53:04.851911+0000","last_active":"2023-12-20T04:53:06.049049+0000","last_peered":"2023-12-20T04:53:06.049049+0000","last_clean":"2023-12-20T04:53:06.049049+0000","last_became_active":"2023-12-20T04:53:04.850895+0000","last_became_peered":"2023-12-20T04:53:04.850895+0000","last_unstale":"2023-12-20T04:53:06.049049+0000","last_undegraded":"2023-12-20T04:53:06.049049+0000","last_fullsized":"2023-12-20T04:53:06.049049+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:08.234734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.844051+0000","last_change":"2023-12-20T04:53:04.851930+0000","last_active":"2023-12-20T04:53:05.844051+0000","last_peered":"2023-12-20T04:53:05.844051+0000","last_clean":"2023-12-20T04:53:05.844051+0000","last_became_active":"2023-12-20T04:53:04.851561+0000","last_became_peered":"2023-12-20T04:53:04.851561+0000","last_unstale":"2023-12-20T04:53:05.844051+0000","last_undegraded":"2023-12-20T04:53:05.844051+0000","last_fullsized":"2023-12-20T04:53:05.844051+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:40:07.703896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843742+0000","last_change":"2023-12-20T04:53:04.851568+0000","last_active":"2023-12-20T04:53:05.843742+0000","last_peered":"2023-12-20T04:53:05.843742+0000","last_clean":"2023-12-20T04:53:05.843742+0000","last_became_active":"2023-12-20T04:53:04.850330+0000","last_became_peered":"2023-12-20T04:53:04.850330+0000","last_unstale":"2023-12-20T04:53:05.843742+0000","last_undegraded":"2023-12-20T04:53:05.843742+0000","last_fullsized":"2023-12-20T04:53:05.843742+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:10:24.881387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048738+0000","last_change":"2023-12-20T04:53:04.850838+0000","last_active":"2023-12-20T04:53:06.048738+0000","last_peered":"2023-12-20T04:53:06.048738+0000","last_clean":"2023-12-20T04:53:06.048738+0000","last_became_active":"2023-12-20T04:53:04.850633+0000","last_became_peered":"2023-12-20T04:53:04.850633+0000","last_unstale":"2023-12-20T04:53:06.048738+0000","last_undegraded":"2023-12-20T04:53:06.048738+0000","last_fullsized":"2023-12-20T04:53:06.048738+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:43:48.356023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845151+0000","last_change":"2023-12-20T04:53:04.853045+0000","last_active":"2023-12-20T04:53:05.845151+0000","last_peered":"2023-12-20T04:53:05.845151+0000","last_clean":"2023-12-20T04:53:05.845151+0000","last_became_active":"2023-12-20T04:53:04.852794+0000","last_became_peered":"2023-12-20T04:53:04.852794+0000","last_unstale":"2023-12-20T04:53:05.845151+0000","last_undegraded":"2023-12-20T04:53:05.845151+0000","last_fullsized":"2023-12-20T04:53:05.845151+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:48:12.265420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048841+0000","last_change":"2023-12-20T04:53:04.843610+0000","last_active":"2023-12-20T04:53:06.048841+0000","last_peered":"2023-12-20T04:53:06.048841+0000","last_clean":"2023-12-20T04:53:06.048841+0000","last_became_active":"2023-12-20T04:53:04.843410+0000","last_became_peered":"2023-12-20T04:53:04.843410+0000","last_unstale":"2023-12-20T04:53:06.048841+0000","last_undegraded":"2023-12-20T04:53:06.048841+0000","last_fullsized":"2023-12-20T04:53:06.048841+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:40:30.887367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049168+0000","last_change":"2023-12-20T04:53:04.850610+0000","last_active":"2023-12-20T04:53:06.049168+0000","last_peered":"2023-12-20T04:53:06.049168+0000","last_clean":"2023-12-20T04:53:06.049168+0000","last_became_active":"2023-12-20T04:53:04.850249+0000","last_became_peered":"2023-12-20T04:53:04.850249+0000","last_unstale":"2023-12-20T04:53:06.049168+0000","last_undegraded":"2023-12-20T04:53:06.049168+0000","last_fullsized":"2023-12-20T04:53:06.049168+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:26:12.672188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048601+0000","last_change":"2023-12-20T04:53:04.847978+0000","last_active":"2023-12-20T04:53:06.048601+0000","last_peered":"2023-12-20T04:53:06.048601+0000","last_clean":"2023-12-20T04:53:06.048601+0000","last_became_active":"2023-12-20T04:53:04.847766+0000","last_became_peered":"2023-12-20T04:53:04.847766+0000","last_unstale":"2023-12-20T04:53:06.048601+0000","last_undegraded":"2023-12-20T04:53:06.048601+0000","last_fullsized":"2023-12-20T04:53:06.048601+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:31:40.163557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049924+0000","last_change":"2023-12-20T04:53:04.856465+0000","last_active":"2023-12-20T04:53:06.049924+0000","last_peered":"2023-12-20T04:53:06.049924+0000","last_clean":"2023-12-20T04:53:06.049924+0000","last_became_active":"2023-12-20T04:53:04.855556+0000","last_became_peered":"2023-12-20T04:53:04.855556+0000","last_unstale":"2023-12-20T04:53:06.049924+0000","last_undegraded":"2023-12-20T04:53:06.049924+0000","last_fullsized":"2023-12-20T04:53:06.049924+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:05:16.314223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048872+0000","last_change":"2023-12-20T04:53:04.851132+0000","last_active":"2023-12-20T04:53:06.048872+0000","last_peered":"2023-12-20T04:53:06.048872+0000","last_clean":"2023-12-20T04:53:06.048872+0000","last_became_active":"2023-12-20T04:53:04.850902+0000","last_became_peered":"2023-12-20T04:53:04.850902+0000","last_unstale":"2023-12-20T04:53:06.048872+0000","last_undegraded":"2023-12-20T04:53:06.048872+0000","last_fullsized":"2023-12-20T04:53:06.048872+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:17:15.209940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048942+0000","last_change":"2023-12-20T04:53:04.854881+0000","last_active":"2023-12-20T04:53:06.048942+0000","last_peered":"2023-12-20T04:53:06.048942+0000","last_clean":"2023-12-20T04:53:06.048942+0000","last_became_active":"2023-12-20T04:53:04.854649+0000","last_became_peered":"2023-12-20T04:53:04.854649+0000","last_unstale":"2023-12-20T04:53:06.048942+0000","last_undegraded":"2023-12-20T04:53:06.048942+0000","last_fullsized":"2023-12-20T04:53:06.048942+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:05:55.398320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049461+0000","last_change":"2023-12-20T04:53:04.852210+0000","last_active":"2023-12-20T04:53:06.049461+0000","last_peered":"2023-12-20T04:53:06.049461+0000","last_clean":"2023-12-20T04:53:06.049461+0000","last_became_active":"2023-12-20T04:53:04.851992+0000","last_became_peered":"2023-12-20T04:53:04.851992+0000","last_unstale":"2023-12-20T04:53:06.049461+0000","last_undegraded":"2023-12-20T04:53:06.049461+0000","last_fullsized":"2023-12-20T04:53:06.049461+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:59:49.501548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843692+0000","last_change":"2023-12-20T04:53:04.850573+0000","last_active":"2023-12-20T04:53:05.843692+0000","last_peered":"2023-12-20T04:53:05.843692+0000","last_clean":"2023-12-20T04:53:05.843692+0000","last_became_active":"2023-12-20T04:53:04.850056+0000","last_became_peered":"2023-12-20T04:53:04.850056+0000","last_unstale":"2023-12-20T04:53:05.843692+0000","last_undegraded":"2023-12-20T04:53:05.843692+0000","last_fullsized":"2023-12-20T04:53:05.843692+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:09:45.036468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049119+0000","last_change":"2023-12-20T04:53:04.851874+0000","last_active":"2023-12-20T04:53:06.049119+0000","last_peered":"2023-12-20T04:53:06.049119+0000","last_clean":"2023-12-20T04:53:06.049119+0000","last_became_active":"2023-12-20T04:53:04.851653+0000","last_became_peered":"2023-12-20T04:53:04.851653+0000","last_unstale":"2023-12-20T04:53:06.049119+0000","last_undegraded":"2023-12-20T04:53:06.049119+0000","last_fullsized":"2023-12-20T04:53:06.049119+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:00:24.704428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048478+0000","last_change":"2023-12-20T04:53:04.849336+0000","last_active":"2023-12-20T04:53:06.048478+0000","last_peered":"2023-12-20T04:53:06.048478+0000","last_clean":"2023-12-20T04:53:06.048478+0000","last_became_active":"2023-12-20T04:53:04.849135+0000","last_became_peered":"2023-12-20T04:53:04.849135+0000","last_unstale":"2023-12-20T04:53:06.048478+0000","last_undegraded":"2023-12-20T04:53:06.048478+0000","last_fullsized":"2023-12-20T04:53:06.048478+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:39:58.504822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049148+0000","last_change":"2023-12-20T04:53:04.852384+0000","last_active":"2023-12-20T04:53:06.049148+0000","last_peered":"2023-12-20T04:53:06.049148+0000","last_clean":"2023-12-20T04:53:06.049148+0000","last_became_active":"2023-12-20T04:53:04.852173+0000","last_became_peered":"2023-12-20T04:53:04.852173+0000","last_unstale":"2023-12-20T04:53:06.049148+0000","last_undegraded":"2023-12-20T04:53:06.049148+0000","last_fullsized":"2023-12-20T04:53:06.049148+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:07:00.683099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049605+0000","last_change":"2023-12-20T04:53:04.851722+0000","last_active":"2023-12-20T04:53:06.049605+0000","last_peered":"2023-12-20T04:53:06.049605+0000","last_clean":"2023-12-20T04:53:06.049605+0000","last_became_active":"2023-12-20T04:53:04.851512+0000","last_became_peered":"2023-12-20T04:53:04.851512+0000","last_unstale":"2023-12-20T04:53:06.049605+0000","last_undegraded":"2023-12-20T04:53:06.049605+0000","last_fullsized":"2023-12-20T04:53:06.049605+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:31:53.662833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049958+0000","last_change":"2023-12-20T04:53:04.847234+0000","last_active":"2023-12-20T04:53:06.049958+0000","last_peered":"2023-12-20T04:53:06.049958+0000","last_clean":"2023-12-20T04:53:06.049958+0000","last_became_active":"2023-12-20T04:53:04.846631+0000","last_became_peered":"2023-12-20T04:53:04.846631+0000","last_unstale":"2023-12-20T04:53:06.049958+0000","last_undegraded":"2023-12-20T04:53:06.049958+0000","last_fullsized":"2023-12-20T04:53:06.049958+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:06:50.325153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.844985+0000","last_change":"2023-12-20T04:53:04.852727+0000","last_active":"2023-12-20T04:53:05.844985+0000","last_peered":"2023-12-20T04:53:05.844985+0000","last_clean":"2023-12-20T04:53:05.844985+0000","last_became_active":"2023-12-20T04:53:04.851943+0000","last_became_peered":"2023-12-20T04:53:04.851943+0000","last_unstale":"2023-12-20T04:53:05.844985+0000","last_undegraded":"2023-12-20T04:53:05.844985+0000","last_fullsized":"2023-12-20T04:53:05.844985+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:25:23.424519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843523+0000","last_change":"2023-12-20T04:53:04.847399+0000","last_active":"2023-12-20T04:53:05.843523+0000","last_peered":"2023-12-20T04:53:05.843523+0000","last_clean":"2023-12-20T04:53:05.843523+0000","last_became_active":"2023-12-20T04:53:04.847202+0000","last_became_peered":"2023-12-20T04:53:04.847202+0000","last_unstale":"2023-12-20T04:53:05.843523+0000","last_undegraded":"2023-12-20T04:53:05.843523+0000","last_fullsized":"2023-12-20T04:53:05.843523+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:45:15.231394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"185'4","reported_seq":15,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843937+0000","last_change":"2023-12-20T04:53:04.507799+0000","last_active":"2023-12-20T04:53:05.843937+0000","last_peered":"2023-12-20T04:53:05.843937+0000","last_clean":"2023-12-20T04:53:05.843937+0000","last_became_active":"2023-12-20T04:53:04.507496+0000","last_became_peered":"2023-12-20T04:53:04.507496+0000","last_unstale":"2023-12-20T04:53:05.843937+0000","last_undegraded":"2023-12-20T04:53:05.843937+0000","last_fullsized":"2023-12-20T04:53:05.843937+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:40:35.033957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049931+0000","last_change":"2023-12-20T04:53:04.849290+0000","last_active":"2023-12-20T04:53:06.049931+0000","last_peered":"2023-12-20T04:53:06.049931+0000","last_clean":"2023-12-20T04:53:06.049931+0000","last_became_active":"2023-12-20T04:53:04.849024+0000","last_became_peered":"2023-12-20T04:53:04.849024+0000","last_unstale":"2023-12-20T04:53:06.049931+0000","last_undegraded":"2023-12-20T04:53:06.049931+0000","last_fullsized":"2023-12-20T04:53:06.049931+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:26:43.712317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"185'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048919+0000","last_change":"2023-12-20T04:53:04.505773+0000","last_active":"2023-12-20T04:53:06.048919+0000","last_peered":"2023-12-20T04:53:06.048919+0000","last_clean":"2023-12-20T04:53:06.048919+0000","last_became_active":"2023-12-20T04:53:04.505558+0000","last_became_peered":"2023-12-20T04:53:04.505558+0000","last_unstale":"2023-12-20T04:53:06.048919+0000","last_undegraded":"2023-12-20T04:53:06.048919+0000","last_fullsized":"2023-12-20T04:53:06.048919+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:37:06.170946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048694+0000","last_change":"2023-12-20T04:53:04.850440+0000","last_active":"2023-12-20T04:53:06.048694+0000","last_peered":"2023-12-20T04:53:06.048694+0000","last_clean":"2023-12-20T04:53:06.048694+0000","last_became_active":"2023-12-20T04:53:04.850237+0000","last_became_peered":"2023-12-20T04:53:04.850237+0000","last_unstale":"2023-12-20T04:53:06.048694+0000","last_undegraded":"2023-12-20T04:53:06.048694+0000","last_fullsized":"2023-12-20T04:53:06.048694+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:22:00.719145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"185'2","reported_seq":13,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048923+0000","last_change":"2023-12-20T04:53:04.505011+0000","last_active":"2023-12-20T04:53:06.048923+0000","last_peered":"2023-12-20T04:53:06.048923+0000","last_clean":"2023-12-20T04:53:06.048923+0000","last_became_active":"2023-12-20T04:53:04.504804+0000","last_became_peered":"2023-12-20T04:53:04.504804+0000","last_unstale":"2023-12-20T04:53:06.048923+0000","last_undegraded":"2023-12-20T04:53:06.048923+0000","last_fullsized":"2023-12-20T04:53:06.048923+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:44:23.022262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049545+0000","last_change":"2023-12-20T04:53:04.852948+0000","last_active":"2023-12-20T04:53:06.049545+0000","last_peered":"2023-12-20T04:53:06.049545+0000","last_clean":"2023-12-20T04:53:06.049545+0000","last_became_active":"2023-12-20T04:53:04.852733+0000","last_became_peered":"2023-12-20T04:53:04.852733+0000","last_unstale":"2023-12-20T04:53:06.049545+0000","last_undegraded":"2023-12-20T04:53:06.049545+0000","last_fullsized":"2023-12-20T04:53:06.049545+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:58.309580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"185'2","reported_seq":13,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048610+0000","last_change":"2023-12-20T04:53:04.506780+0000","last_active":"2023-12-20T04:53:06.048610+0000","last_peered":"2023-12-20T04:53:06.048610+0000","last_clean":"2023-12-20T04:53:06.048610+0000","last_became_active":"2023-12-20T04:53:04.506568+0000","last_became_peered":"2023-12-20T04:53:04.506568+0000","last_unstale":"2023-12-20T04:53:06.048610+0000","last_undegraded":"2023-12-20T04:53:06.048610+0000","last_fullsized":"2023-12-20T04:53:06.048610+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:50:32.357538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843540+0000","last_change":"2023-12-20T04:53:04.849164+0000","last_active":"2023-12-20T04:53:05.843540+0000","last_peered":"2023-12-20T04:53:05.843540+0000","last_clean":"2023-12-20T04:53:05.843540+0000","last_became_active":"2023-12-20T04:53:04.848950+0000","last_became_peered":"2023-12-20T04:53:04.848950+0000","last_unstale":"2023-12-20T04:53:05.843540+0000","last_undegraded":"2023-12-20T04:53:05.843540+0000","last_fullsized":"2023-12-20T04:53:05.843540+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:23:25.113166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"185'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049428+0000","last_change":"2023-12-20T04:53:04.505222+0000","last_active":"2023-12-20T04:53:06.049428+0000","last_peered":"2023-12-20T04:53:06.049428+0000","last_clean":"2023-12-20T04:53:06.049428+0000","last_became_active":"2023-12-20T04:53:04.504672+0000","last_became_peered":"2023-12-20T04:53:04.504672+0000","last_unstale":"2023-12-20T04:53:06.049428+0000","last_undegraded":"2023-12-20T04:53:06.049428+0000","last_fullsized":"2023-12-20T04:53:06.049428+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:34:37.856782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048440+0000","last_change":"2023-12-20T04:53:04.854417+0000","last_active":"2023-12-20T04:53:06.048440+0000","last_peered":"2023-12-20T04:53:06.048440+0000","last_clean":"2023-12-20T04:53:06.048440+0000","last_became_active":"2023-12-20T04:53:04.853735+0000","last_became_peered":"2023-12-20T04:53:04.853735+0000","last_unstale":"2023-12-20T04:53:06.048440+0000","last_undegraded":"2023-12-20T04:53:06.048440+0000","last_fullsized":"2023-12-20T04:53:06.048440+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:31:53.662833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"185'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048625+0000","last_change":"2023-12-20T04:53:04.503561+0000","last_active":"2023-12-20T04:53:06.048625+0000","last_peered":"2023-12-20T04:53:06.048625+0000","last_clean":"2023-12-20T04:53:06.048625+0000","last_became_active":"2023-12-20T04:53:04.503320+0000","last_became_peered":"2023-12-20T04:53:04.503320+0000","last_unstale":"2023-12-20T04:53:06.048625+0000","last_undegraded":"2023-12-20T04:53:06.048625+0000","last_fullsized":"2023-12-20T04:53:06.048625+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:11:14.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048729+0000","last_change":"2023-12-20T04:53:04.850834+0000","last_active":"2023-12-20T04:53:06.048729+0000","last_peered":"2023-12-20T04:53:06.048729+0000","last_clean":"2023-12-20T04:53:06.048729+0000","last_became_active":"2023-12-20T04:53:04.850629+0000","last_became_peered":"2023-12-20T04:53:04.850629+0000","last_unstale":"2023-12-20T04:53:06.048729+0000","last_undegraded":"2023-12-20T04:53:06.048729+0000","last_fullsized":"2023-12-20T04:53:06.048729+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:06:50.325153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049225+0000","last_change":"2023-12-20T04:53:04.505637+0000","last_active":"2023-12-20T04:53:06.049225+0000","last_peered":"2023-12-20T04:53:06.049225+0000","last_clean":"2023-12-20T04:53:06.049225+0000","last_became_active":"2023-12-20T04:53:04.505142+0000","last_became_peered":"2023-12-20T04:53:04.505142+0000","last_unstale":"2023-12-20T04:53:06.049225+0000","last_undegraded":"2023-12-20T04:53:06.049225+0000","last_fullsized":"2023-12-20T04:53:06.049225+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:07.227219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048898+0000","last_change":"2023-12-20T04:53:04.845336+0000","last_active":"2023-12-20T04:53:06.048898+0000","last_peered":"2023-12-20T04:53:06.048898+0000","last_clean":"2023-12-20T04:53:06.048898+0000","last_became_active":"2023-12-20T04:53:04.845126+0000","last_became_peered":"2023-12-20T04:53:04.845126+0000","last_unstale":"2023-12-20T04:53:06.048898+0000","last_undegraded":"2023-12-20T04:53:06.048898+0000","last_fullsized":"2023-12-20T04:53:06.048898+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:03:55.171331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843694+0000","last_change":"2023-12-20T04:53:04.502366+0000","last_active":"2023-12-20T04:53:05.843694+0000","last_peered":"2023-12-20T04:53:05.843694+0000","last_clean":"2023-12-20T04:53:05.843694+0000","last_became_active":"2023-12-20T04:53:04.502163+0000","last_became_peered":"2023-12-20T04:53:04.502163+0000","last_unstale":"2023-12-20T04:53:05.843694+0000","last_undegraded":"2023-12-20T04:53:05.843694+0000","last_fullsized":"2023-12-20T04:53:05.843694+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:00:30.874432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845015+0000","last_change":"2023-12-20T04:53:04.852508+0000","last_active":"2023-12-20T04:53:05.845015+0000","last_peered":"2023-12-20T04:53:05.845015+0000","last_clean":"2023-12-20T04:53:05.845015+0000","last_became_active":"2023-12-20T04:53:04.852297+0000","last_became_peered":"2023-12-20T04:53:04.852297+0000","last_unstale":"2023-12-20T04:53:05.845015+0000","last_undegraded":"2023-12-20T04:53:05.845015+0000","last_fullsized":"2023-12-20T04:53:05.845015+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:00:31.881948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048840+0000","last_change":"2023-12-20T04:53:04.511872+0000","last_active":"2023-12-20T04:53:06.048840+0000","last_peered":"2023-12-20T04:53:06.048840+0000","last_clean":"2023-12-20T04:53:06.048840+0000","last_became_active":"2023-12-20T04:53:04.511662+0000","last_became_peered":"2023-12-20T04:53:04.511662+0000","last_unstale":"2023-12-20T04:53:06.048840+0000","last_undegraded":"2023-12-20T04:53:06.048840+0000","last_fullsized":"2023-12-20T04:53:06.048840+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:28:26.852900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.844972+0000","last_change":"2023-12-20T04:53:04.852028+0000","last_active":"2023-12-20T04:53:05.844972+0000","last_peered":"2023-12-20T04:53:05.844972+0000","last_clean":"2023-12-20T04:53:05.844972+0000","last_became_active":"2023-12-20T04:53:04.851790+0000","last_became_peered":"2023-12-20T04:53:04.851790+0000","last_unstale":"2023-12-20T04:53:05.844972+0000","last_undegraded":"2023-12-20T04:53:05.844972+0000","last_fullsized":"2023-12-20T04:53:05.844972+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:40:07.703896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"185'3","reported_seq":14,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048953+0000","last_change":"2023-12-20T04:53:04.505835+0000","last_active":"2023-12-20T04:53:06.048953+0000","last_peered":"2023-12-20T04:53:06.048953+0000","last_clean":"2023-12-20T04:53:06.048953+0000","last_became_active":"2023-12-20T04:53:04.505608+0000","last_became_peered":"2023-12-20T04:53:04.505608+0000","last_unstale":"2023-12-20T04:53:06.048953+0000","last_undegraded":"2023-12-20T04:53:06.048953+0000","last_fullsized":"2023-12-20T04:53:06.048953+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:48:16.623311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.050024+0000","last_change":"2023-12-20T04:53:04.850246+0000","last_active":"2023-12-20T04:53:06.050024+0000","last_peered":"2023-12-20T04:53:06.050024+0000","last_clean":"2023-12-20T04:53:06.050024+0000","last_became_active":"2023-12-20T04:53:04.849997+0000","last_became_peered":"2023-12-20T04:53:04.849997+0000","last_unstale":"2023-12-20T04:53:06.050024+0000","last_undegraded":"2023-12-20T04:53:06.050024+0000","last_fullsized":"2023-12-20T04:53:06.050024+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:14:54.610746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"185'6","reported_seq":17,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049024+0000","last_change":"2023-12-20T04:53:04.505200+0000","last_active":"2023-12-20T04:53:06.049024+0000","last_peered":"2023-12-20T04:53:06.049024+0000","last_clean":"2023-12-20T04:53:06.049024+0000","last_became_active":"2023-12-20T04:53:04.504966+0000","last_became_peered":"2023-12-20T04:53:04.504966+0000","last_unstale":"2023-12-20T04:53:06.049024+0000","last_undegraded":"2023-12-20T04:53:06.049024+0000","last_fullsized":"2023-12-20T04:53:06.049024+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:44:23.022262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845115+0000","last_change":"2023-12-20T04:53:04.848589+0000","last_active":"2023-12-20T04:53:05.845115+0000","last_peered":"2023-12-20T04:53:05.845115+0000","last_clean":"2023-12-20T04:53:05.845115+0000","last_became_active":"2023-12-20T04:53:04.848377+0000","last_became_peered":"2023-12-20T04:53:04.848377+0000","last_unstale":"2023-12-20T04:53:05.845115+0000","last_undegraded":"2023-12-20T04:53:05.845115+0000","last_fullsized":"2023-12-20T04:53:05.845115+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:56:18.000382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"185'2","reported_seq":13,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048966+0000","last_change":"2023-12-20T04:53:04.507791+0000","last_active":"2023-12-20T04:53:06.048966+0000","last_peered":"2023-12-20T04:53:06.048966+0000","last_clean":"2023-12-20T04:53:06.048966+0000","last_became_active":"2023-12-20T04:53:04.507551+0000","last_became_peered":"2023-12-20T04:53:04.507551+0000","last_unstale":"2023-12-20T04:53:06.048966+0000","last_undegraded":"2023-12-20T04:53:06.048966+0000","last_fullsized":"2023-12-20T04:53:06.048966+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:50.046765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843608+0000","last_change":"2023-12-20T04:53:04.847889+0000","last_active":"2023-12-20T04:53:05.843608+0000","last_peered":"2023-12-20T04:53:05.843608+0000","last_clean":"2023-12-20T04:53:05.843608+0000","last_became_active":"2023-12-20T04:53:04.846786+0000","last_became_peered":"2023-12-20T04:53:04.846786+0000","last_unstale":"2023-12-20T04:53:05.843608+0000","last_undegraded":"2023-12-20T04:53:05.843608+0000","last_fullsized":"2023-12-20T04:53:05.843608+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:22:34.527782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845241+0000","last_change":"2023-12-20T04:53:04.505891+0000","last_active":"2023-12-20T04:53:05.845241+0000","last_peered":"2023-12-20T04:53:05.845241+0000","last_clean":"2023-12-20T04:53:05.845241+0000","last_became_active":"2023-12-20T04:53:04.505680+0000","last_became_peered":"2023-12-20T04:53:04.505680+0000","last_unstale":"2023-12-20T04:53:05.845241+0000","last_undegraded":"2023-12-20T04:53:05.845241+0000","last_fullsized":"2023-12-20T04:53:05.845241+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:28:24.978847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048385+0000","last_change":"2023-12-20T04:53:04.855789+0000","last_active":"2023-12-20T04:53:06.048385+0000","last_peered":"2023-12-20T04:53:06.048385+0000","last_clean":"2023-12-20T04:53:06.048385+0000","last_became_active":"2023-12-20T04:53:04.855567+0000","last_became_peered":"2023-12-20T04:53:04.855567+0000","last_unstale":"2023-12-20T04:53:06.048385+0000","last_undegraded":"2023-12-20T04:53:06.048385+0000","last_fullsized":"2023-12-20T04:53:06.048385+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:40:36.041473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048701+0000","last_change":"2023-12-20T04:53:04.510128+0000","last_active":"2023-12-20T04:53:06.048701+0000","last_peered":"2023-12-20T04:53:06.048701+0000","last_clean":"2023-12-20T04:53:06.048701+0000","last_became_active":"2023-12-20T04:53:04.509922+0000","last_became_peered":"2023-12-20T04:53:04.509922+0000","last_unstale":"2023-12-20T04:53:06.048701+0000","last_undegraded":"2023-12-20T04:53:06.048701+0000","last_fullsized":"2023-12-20T04:53:06.048701+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:09:44.918628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049271+0000","last_change":"2023-12-20T04:53:04.848988+0000","last_active":"2023-12-20T04:53:06.049271+0000","last_peered":"2023-12-20T04:53:06.049271+0000","last_clean":"2023-12-20T04:53:06.049271+0000","last_became_active":"2023-12-20T04:53:04.848761+0000","last_became_peered":"2023-12-20T04:53:04.848761+0000","last_unstale":"2023-12-20T04:53:06.049271+0000","last_undegraded":"2023-12-20T04:53:06.049271+0000","last_fullsized":"2023-12-20T04:53:06.049271+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:02:48.609557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"185'8","reported_seq":19,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.050163+0000","last_change":"2023-12-20T04:53:04.506209+0000","last_active":"2023-12-20T04:53:06.050163+0000","last_peered":"2023-12-20T04:53:06.050163+0000","last_clean":"2023-12-20T04:53:06.050163+0000","last_became_active":"2023-12-20T04:53:04.506003+0000","last_became_peered":"2023-12-20T04:53:04.506003+0000","last_unstale":"2023-12-20T04:53:06.050163+0000","last_undegraded":"2023-12-20T04:53:06.050163+0000","last_fullsized":"2023-12-20T04:53:06.050163+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:09:44.918628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048875+0000","last_change":"2023-12-20T04:53:04.854135+0000","last_active":"2023-12-20T04:53:06.048875+0000","last_peered":"2023-12-20T04:53:06.048875+0000","last_clean":"2023-12-20T04:53:06.048875+0000","last_became_active":"2023-12-20T04:53:04.852900+0000","last_became_peered":"2023-12-20T04:53:04.852900+0000","last_unstale":"2023-12-20T04:53:06.048875+0000","last_undegraded":"2023-12-20T04:53:06.048875+0000","last_fullsized":"2023-12-20T04:53:06.048875+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:14:54.610746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"185'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049331+0000","last_change":"2023-12-20T04:53:04.511750+0000","last_active":"2023-12-20T04:53:06.049331+0000","last_peered":"2023-12-20T04:53:06.049331+0000","last_clean":"2023-12-20T04:53:06.049331+0000","last_became_active":"2023-12-20T04:53:04.511531+0000","last_became_peered":"2023-12-20T04:53:04.511531+0000","last_unstale":"2023-12-20T04:53:06.049331+0000","last_undegraded":"2023-12-20T04:53:06.049331+0000","last_fullsized":"2023-12-20T04:53:06.049331+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:54:49.167920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845055+0000","last_change":"2023-12-20T04:53:04.847785+0000","last_active":"2023-12-20T04:53:05.845055+0000","last_peered":"2023-12-20T04:53:05.845055+0000","last_clean":"2023-12-20T04:53:05.845055+0000","last_became_active":"2023-12-20T04:53:04.847230+0000","last_became_peered":"2023-12-20T04:53:04.847230+0000","last_unstale":"2023-12-20T04:53:05.845055+0000","last_undegraded":"2023-12-20T04:53:05.845055+0000","last_fullsized":"2023-12-20T04:53:05.845055+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:07:12.533795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"185'2","reported_seq":13,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049732+0000","last_change":"2023-12-20T04:53:04.507093+0000","last_active":"2023-12-20T04:53:06.049732+0000","last_peered":"2023-12-20T04:53:06.049732+0000","last_clean":"2023-12-20T04:53:06.049732+0000","last_became_active":"2023-12-20T04:53:04.506411+0000","last_became_peered":"2023-12-20T04:53:04.506411+0000","last_unstale":"2023-12-20T04:53:06.049732+0000","last_undegraded":"2023-12-20T04:53:06.049732+0000","last_fullsized":"2023-12-20T04:53:06.049732+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:47:36.460519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048621+0000","last_change":"2023-12-20T04:53:04.855232+0000","last_active":"2023-12-20T04:53:06.048621+0000","last_peered":"2023-12-20T04:53:06.048621+0000","last_clean":"2023-12-20T04:53:06.048621+0000","last_became_active":"2023-12-20T04:53:04.853995+0000","last_became_peered":"2023-12-20T04:53:04.853995+0000","last_unstale":"2023-12-20T04:53:06.048621+0000","last_undegraded":"2023-12-20T04:53:06.048621+0000","last_fullsized":"2023-12-20T04:53:06.048621+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:05:55.398320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"185'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.844183+0000","last_change":"2023-12-20T04:53:04.510687+0000","last_active":"2023-12-20T04:53:05.844183+0000","last_peered":"2023-12-20T04:53:05.844183+0000","last_clean":"2023-12-20T04:53:05.844183+0000","last_became_active":"2023-12-20T04:53:04.509210+0000","last_became_peered":"2023-12-20T04:53:04.509210+0000","last_unstale":"2023-12-20T04:53:05.844183+0000","last_undegraded":"2023-12-20T04:53:05.844183+0000","last_fullsized":"2023-12-20T04:53:05.844183+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:34:15.067323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843789+0000","last_change":"2023-12-20T04:53:04.845347+0000","last_active":"2023-12-20T04:53:05.843789+0000","last_peered":"2023-12-20T04:53:05.843789+0000","last_clean":"2023-12-20T04:53:05.843789+0000","last_became_active":"2023-12-20T04:53:04.845128+0000","last_became_peered":"2023-12-20T04:53:04.845128+0000","last_unstale":"2023-12-20T04:53:05.843789+0000","last_undegraded":"2023-12-20T04:53:05.843789+0000","last_fullsized":"2023-12-20T04:53:05.843789+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:23:30.869082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843887+0000","last_change":"2023-12-20T04:53:04.509254+0000","last_active":"2023-12-20T04:53:05.843887+0000","last_peered":"2023-12-20T04:53:05.843887+0000","last_clean":"2023-12-20T04:53:05.843887+0000","last_became_active":"2023-12-20T04:53:04.509030+0000","last_became_peered":"2023-12-20T04:53:04.509030+0000","last_unstale":"2023-12-20T04:53:05.843887+0000","last_undegraded":"2023-12-20T04:53:05.843887+0000","last_fullsized":"2023-12-20T04:53:05.843887+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:35:11.325106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049238+0000","last_change":"2023-12-20T04:53:04.848638+0000","last_active":"2023-12-20T04:53:06.049238+0000","last_peered":"2023-12-20T04:53:06.049238+0000","last_clean":"2023-12-20T04:53:06.049238+0000","last_became_active":"2023-12-20T04:53:04.848427+0000","last_became_peered":"2023-12-20T04:53:04.848427+0000","last_unstale":"2023-12-20T04:53:06.049238+0000","last_undegraded":"2023-12-20T04:53:06.049238+0000","last_fullsized":"2023-12-20T04:53:06.049238+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:13:52.806515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"185'2","reported_seq":13,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048713+0000","last_change":"2023-12-20T04:53:04.509911+0000","last_active":"2023-12-20T04:53:06.048713+0000","last_peered":"2023-12-20T04:53:06.048713+0000","last_clean":"2023-12-20T04:53:06.048713+0000","last_became_active":"2023-12-20T04:53:04.509706+0000","last_became_peered":"2023-12-20T04:53:04.509706+0000","last_unstale":"2023-12-20T04:53:06.048713+0000","last_undegraded":"2023-12-20T04:53:06.048713+0000","last_fullsized":"2023-12-20T04:53:06.048713+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:55:31.799146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843597+0000","last_change":"2023-12-20T04:53:04.851431+0000","last_active":"2023-12-20T04:53:05.843597+0000","last_peered":"2023-12-20T04:53:05.843597+0000","last_clean":"2023-12-20T04:53:05.843597+0000","last_became_active":"2023-12-20T04:53:04.851223+0000","last_became_peered":"2023-12-20T04:53:04.851223+0000","last_unstale":"2023-12-20T04:53:05.843597+0000","last_undegraded":"2023-12-20T04:53:05.843597+0000","last_fullsized":"2023-12-20T04:53:05.843597+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:28:26.363143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.844007+0000","last_change":"2023-12-20T04:53:04.508116+0000","last_active":"2023-12-20T04:53:05.844007+0000","last_peered":"2023-12-20T04:53:05.844007+0000","last_clean":"2023-12-20T04:53:05.844007+0000","last_became_active":"2023-12-20T04:53:04.507842+0000","last_became_peered":"2023-12-20T04:53:04.507842+0000","last_unstale":"2023-12-20T04:53:05.844007+0000","last_undegraded":"2023-12-20T04:53:05.844007+0000","last_fullsized":"2023-12-20T04:53:05.844007+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:36:20.654691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843987+0000","last_change":"2023-12-20T04:53:04.853131+0000","last_active":"2023-12-20T04:53:05.843987+0000","last_peered":"2023-12-20T04:53:05.843987+0000","last_clean":"2023-12-20T04:53:05.843987+0000","last_became_active":"2023-12-20T04:53:04.852900+0000","last_became_peered":"2023-12-20T04:53:04.852900+0000","last_unstale":"2023-12-20T04:53:05.843987+0000","last_undegraded":"2023-12-20T04:53:05.843987+0000","last_fullsized":"2023-12-20T04:53:05.843987+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:22:09.986281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049004+0000","last_change":"2023-12-20T04:53:04.511776+0000","last_active":"2023-12-20T04:53:06.049004+0000","last_peered":"2023-12-20T04:53:06.049004+0000","last_clean":"2023-12-20T04:53:06.049004+0000","last_became_active":"2023-12-20T04:53:04.511520+0000","last_became_peered":"2023-12-20T04:53:04.511520+0000","last_unstale":"2023-12-20T04:53:06.049004+0000","last_undegraded":"2023-12-20T04:53:06.049004+0000","last_fullsized":"2023-12-20T04:53:06.049004+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:44:58.923478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048682+0000","last_change":"2023-12-20T04:53:04.849441+0000","last_active":"2023-12-20T04:53:06.048682+0000","last_peered":"2023-12-20T04:53:06.048682+0000","last_clean":"2023-12-20T04:53:06.048682+0000","last_became_active":"2023-12-20T04:53:04.849190+0000","last_became_peered":"2023-12-20T04:53:04.849190+0000","last_unstale":"2023-12-20T04:53:06.048682+0000","last_undegraded":"2023-12-20T04:53:06.048682+0000","last_fullsized":"2023-12-20T04:53:06.048682+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:39:53.163372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.844257+0000","last_change":"2023-12-20T04:53:04.510862+0000","last_active":"2023-12-20T04:53:05.844257+0000","last_peered":"2023-12-20T04:53:05.844257+0000","last_clean":"2023-12-20T04:53:05.844257+0000","last_became_active":"2023-12-20T04:53:04.510097+0000","last_became_peered":"2023-12-20T04:53:04.510097+0000","last_unstale":"2023-12-20T04:53:05.844257+0000","last_undegraded":"2023-12-20T04:53:05.844257+0000","last_fullsized":"2023-12-20T04:53:05.844257+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:59:51.314369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845219+0000","last_change":"2023-12-20T04:53:04.851053+0000","last_active":"2023-12-20T04:53:05.845219+0000","last_peered":"2023-12-20T04:53:05.845219+0000","last_clean":"2023-12-20T04:53:05.845219+0000","last_became_active":"2023-12-20T04:53:04.850674+0000","last_became_peered":"2023-12-20T04:53:04.850674+0000","last_unstale":"2023-12-20T04:53:05.845219+0000","last_undegraded":"2023-12-20T04:53:05.845219+0000","last_fullsized":"2023-12-20T04:53:05.845219+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:03:03.009432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"185'2","reported_seq":13,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845297+0000","last_change":"2023-12-20T04:53:04.508697+0000","last_active":"2023-12-20T04:53:05.845297+0000","last_peered":"2023-12-20T04:53:05.845297+0000","last_clean":"2023-12-20T04:53:05.845297+0000","last_became_active":"2023-12-20T04:53:04.508498+0000","last_became_peered":"2023-12-20T04:53:04.508498+0000","last_unstale":"2023-12-20T04:53:05.845297+0000","last_undegraded":"2023-12-20T04:53:05.845297+0000","last_fullsized":"2023-12-20T04:53:05.845297+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:22:08.538258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843877+0000","last_change":"2023-12-20T04:53:04.857466+0000","last_active":"2023-12-20T04:53:05.843877+0000","last_peered":"2023-12-20T04:53:05.843877+0000","last_clean":"2023-12-20T04:53:05.843877+0000","last_became_active":"2023-12-20T04:53:04.857027+0000","last_became_peered":"2023-12-20T04:53:04.857027+0000","last_unstale":"2023-12-20T04:53:05.843877+0000","last_undegraded":"2023-12-20T04:53:05.843877+0000","last_fullsized":"2023-12-20T04:53:05.843877+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:32:46.780328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"185'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049711+0000","last_change":"2023-12-20T04:53:04.506056+0000","last_active":"2023-12-20T04:53:06.049711+0000","last_peered":"2023-12-20T04:53:06.049711+0000","last_clean":"2023-12-20T04:53:06.049711+0000","last_became_active":"2023-12-20T04:53:04.504233+0000","last_became_peered":"2023-12-20T04:53:04.504233+0000","last_unstale":"2023-12-20T04:53:06.049711+0000","last_undegraded":"2023-12-20T04:53:06.049711+0000","last_fullsized":"2023-12-20T04:53:06.049711+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:12:16.046112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048778+0000","last_change":"2023-12-20T04:53:04.849956+0000","last_active":"2023-12-20T04:53:06.048778+0000","last_peered":"2023-12-20T04:53:06.048778+0000","last_clean":"2023-12-20T04:53:06.048778+0000","last_became_active":"2023-12-20T04:53:04.849667+0000","last_became_peered":"2023-12-20T04:53:04.849667+0000","last_unstale":"2023-12-20T04:53:06.048778+0000","last_undegraded":"2023-12-20T04:53:06.048778+0000","last_fullsized":"2023-12-20T04:53:06.048778+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:31:03.740412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049547+0000","last_change":"2023-12-20T04:53:04.505779+0000","last_active":"2023-12-20T04:53:06.049547+0000","last_peered":"2023-12-20T04:53:06.049547+0000","last_clean":"2023-12-20T04:53:06.049547+0000","last_became_active":"2023-12-20T04:53:04.505422+0000","last_became_peered":"2023-12-20T04:53:04.505422+0000","last_unstale":"2023-12-20T04:53:06.049547+0000","last_undegraded":"2023-12-20T04:53:06.049547+0000","last_fullsized":"2023-12-20T04:53:06.049547+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:57.302064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845144+0000","last_change":"2023-12-20T04:53:04.850039+0000","last_active":"2023-12-20T04:53:05.845144+0000","last_peered":"2023-12-20T04:53:05.845144+0000","last_clean":"2023-12-20T04:53:05.845144+0000","last_became_active":"2023-12-20T04:53:04.849843+0000","last_became_peered":"2023-12-20T04:53:04.849843+0000","last_unstale":"2023-12-20T04:53:05.845144+0000","last_undegraded":"2023-12-20T04:53:05.845144+0000","last_fullsized":"2023-12-20T04:53:05.845144+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:40:36.041473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845168+0000","last_change":"2023-12-20T04:53:04.508621+0000","last_active":"2023-12-20T04:53:05.845168+0000","last_peered":"2023-12-20T04:53:05.845168+0000","last_clean":"2023-12-20T04:53:05.845168+0000","last_became_active":"2023-12-20T04:53:04.508328+0000","last_became_peered":"2023-12-20T04:53:04.508328+0000","last_unstale":"2023-12-20T04:53:05.845168+0000","last_undegraded":"2023-12-20T04:53:05.845168+0000","last_fullsized":"2023-12-20T04:53:05.845168+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:05:15.306707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845223+0000","last_change":"2023-12-20T04:53:04.852859+0000","last_active":"2023-12-20T04:53:05.845223+0000","last_peered":"2023-12-20T04:53:05.845223+0000","last_clean":"2023-12-20T04:53:05.845223+0000","last_became_active":"2023-12-20T04:53:04.852222+0000","last_became_peered":"2023-12-20T04:53:04.852222+0000","last_unstale":"2023-12-20T04:53:05.845223+0000","last_undegraded":"2023-12-20T04:53:05.845223+0000","last_fullsized":"2023-12-20T04:53:05.845223+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:26:43.712317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.050223+0000","last_change":"2023-12-20T04:53:04.503956+0000","last_active":"2023-12-20T04:53:06.050223+0000","last_peered":"2023-12-20T04:53:06.050223+0000","last_clean":"2023-12-20T04:53:06.050223+0000","last_became_active":"2023-12-20T04:53:04.503738+0000","last_became_peered":"2023-12-20T04:53:04.503738+0000","last_unstale":"2023-12-20T04:53:06.050223+0000","last_undegraded":"2023-12-20T04:53:06.050223+0000","last_fullsized":"2023-12-20T04:53:06.050223+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:55:31.799146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.050044+0000","last_change":"2023-12-20T04:53:04.847024+0000","last_active":"2023-12-20T04:53:06.050044+0000","last_peered":"2023-12-20T04:53:06.050044+0000","last_clean":"2023-12-20T04:53:06.050044+0000","last_became_active":"2023-12-20T04:53:04.846321+0000","last_became_peered":"2023-12-20T04:53:04.846321+0000","last_unstale":"2023-12-20T04:53:06.050044+0000","last_undegraded":"2023-12-20T04:53:06.050044+0000","last_fullsized":"2023-12-20T04:53:06.050044+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:39:39.946891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048779+0000","last_change":"2023-12-20T04:53:04.509231+0000","last_active":"2023-12-20T04:53:06.048779+0000","last_peered":"2023-12-20T04:53:06.048779+0000","last_clean":"2023-12-20T04:53:06.048779+0000","last_became_active":"2023-12-20T04:53:04.508985+0000","last_became_peered":"2023-12-20T04:53:04.508985+0000","last_unstale":"2023-12-20T04:53:06.048779+0000","last_undegraded":"2023-12-20T04:53:06.048779+0000","last_fullsized":"2023-12-20T04:53:06.048779+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:59:48.494033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843620+0000","last_change":"2023-12-20T04:53:04.853655+0000","last_active":"2023-12-20T04:53:05.843620+0000","last_peered":"2023-12-20T04:53:05.843620+0000","last_clean":"2023-12-20T04:53:05.843620+0000","last_became_active":"2023-12-20T04:53:04.853441+0000","last_became_peered":"2023-12-20T04:53:04.853441+0000","last_unstale":"2023-12-20T04:53:05.843620+0000","last_undegraded":"2023-12-20T04:53:05.843620+0000","last_fullsized":"2023-12-20T04:53:05.843620+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:26.687658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049843+0000","last_change":"2023-12-20T04:53:04.509865+0000","last_active":"2023-12-20T04:53:06.049843+0000","last_peered":"2023-12-20T04:53:06.049843+0000","last_clean":"2023-12-20T04:53:06.049843+0000","last_became_active":"2023-12-20T04:53:04.509639+0000","last_became_peered":"2023-12-20T04:53:04.509639+0000","last_unstale":"2023-12-20T04:53:06.049843+0000","last_undegraded":"2023-12-20T04:53:06.049843+0000","last_fullsized":"2023-12-20T04:53:06.049843+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:48:49.105756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049428+0000","last_change":"2023-12-20T04:53:04.850347+0000","last_active":"2023-12-20T04:53:06.049428+0000","last_peered":"2023-12-20T04:53:06.049428+0000","last_clean":"2023-12-20T04:53:06.049428+0000","last_became_active":"2023-12-20T04:53:04.850023+0000","last_became_peered":"2023-12-20T04:53:04.850023+0000","last_unstale":"2023-12-20T04:53:06.049428+0000","last_undegraded":"2023-12-20T04:53:06.049428+0000","last_fullsized":"2023-12-20T04:53:06.049428+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:48:50.113272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049201+0000","last_change":"2023-12-20T04:53:04.507946+0000","last_active":"2023-12-20T04:53:06.049201+0000","last_peered":"2023-12-20T04:53:06.049201+0000","last_clean":"2023-12-20T04:53:06.049201+0000","last_became_active":"2023-12-20T04:53:04.507741+0000","last_became_peered":"2023-12-20T04:53:04.507741+0000","last_unstale":"2023-12-20T04:53:06.049201+0000","last_undegraded":"2023-12-20T04:53:06.049201+0000","last_fullsized":"2023-12-20T04:53:06.049201+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:50.046765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845073+0000","last_change":"2023-12-20T04:53:04.852989+0000","last_active":"2023-12-20T04:53:05.845073+0000","last_peered":"2023-12-20T04:53:05.845073+0000","last_clean":"2023-12-20T04:53:05.845073+0000","last_became_active":"2023-12-20T04:53:04.852524+0000","last_became_peered":"2023-12-20T04:53:04.852524+0000","last_unstale":"2023-12-20T04:53:05.845073+0000","last_undegraded":"2023-12-20T04:53:05.845073+0000","last_fullsized":"2023-12-20T04:53:05.845073+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:22:09.986281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.050136+0000","last_change":"2023-12-20T04:53:04.506756+0000","last_active":"2023-12-20T04:53:06.050136+0000","last_peered":"2023-12-20T04:53:06.050136+0000","last_clean":"2023-12-20T04:53:06.050136+0000","last_became_active":"2023-12-20T04:53:04.506529+0000","last_became_peered":"2023-12-20T04:53:04.506529+0000","last_unstale":"2023-12-20T04:53:06.050136+0000","last_undegraded":"2023-12-20T04:53:06.050136+0000","last_fullsized":"2023-12-20T04:53:06.050136+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:50:32.357538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":310,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-12-20T04:53:04.847275+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:53:04.847275+0000","last_peered":"2023-12-20T04:53:04.847275+0000","last_clean":"2023-12-20T04:53:04.847275+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:53:04.847275+0000","last_undegraded":"2023-12-20T04:53:04.847275+0000","last_fullsized":"2023-12-20T04:53:04.847275+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574976,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1597,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193714,"statfs":{"total":200000000,"available":198363724,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.43099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70299999999999996,"5min":0.77700000000000002,"15min":1.0860000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.25600000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.86299999999999999},"last":0.67200000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.33100000000000002,"15min":0.26900000000000002},"max":{"1min":0.71699999999999997,"5min":0.76500000000000001,"15min":0.98799999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.45700000000000002,"5min":0.376,"15min":0.374},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":1.0269999999999999},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.375,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65100000000000002,"5min":0.75900000000000001,"15min":1.0069999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.47599999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67100000000000004,"5min":0.75700000000000001,"15min":0.78000000000000003},"last":0.54900000000000004}]},{"osd":3,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65800000000000003,"5min":0.78300000000000003,"15min":1.048},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.34599999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.79600000000000004}]},{"osd":4,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.46999999999999997,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.28499999999999998,"15min":0.26700000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.89700000000000002},"last":0.61199999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46300000000000002,"15min":0.47999999999999998},"min":{"1min":0.33600000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.70399999999999996,"5min":0.73099999999999998,"15min":0.73799999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51900000000000002,"15min":0.53100000000000003},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.78200000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51900000000000002,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.33300000000000002,"15min":0.32500000000000001},"max":{"1min":0.755,"5min":0.77800000000000002,"15min":0.89800000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.628}]}]},{"osd":6,"up_from":13,"seq":55834574977,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962676,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55800000000000005,"15min":0.51900000000000002},"min":{"1min":0.36499999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.71099999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51900000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56699999999999995,"15min":0.54600000000000004},"min":{"1min":0.40000000000000002,"5min":0.32100000000000001,"15min":0.30099999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54300000000000004}]},{"osd":2,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55000000000000004,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.38200000000000001,"15min":0.27000000000000002},"max":{"1min":0.72599999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.376,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.50700000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.33700000000000002},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.77800000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.43099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.749,"5min":0.77200000000000002,"15min":0.78900000000000003},"last":0.47799999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.32100000000000001,"5min":0.313,"15min":0.28499999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.81899999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.374}]},{"osd":5,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49099999999999999,"15min":0.50700000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.755,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.438},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.54600000000000004},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.32000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.85499999999999998},"last":0.33100000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52900000000000003,"15min":0.54000000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.49299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194298,"statfs":{"total":200000000,"available":198962094,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56499999999999995,"15min":0.53200000000000003},"min":{"1min":0.38200000000000001,"5min":0.32200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69099999999999995,"5min":0.747,"15min":0.748},"last":0.502},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58899999999999997,"15min":0.57199999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74299999999999999,"5min":0.78700000000000003,"15min":0.82299999999999995},"last":0.629}]},{"osd":1,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57299999999999995,"15min":0.55600000000000005},"min":{"1min":0.437,"5min":0.39800000000000002,"15min":0.26000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.82099999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.59099999999999997,"15min":0.58399999999999996},"min":{"1min":0.443,"5min":0.41799999999999998,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.84899999999999998},"last":0.71199999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53800000000000003,"15min":0.52300000000000002},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.28199999999999997},"max":{"1min":0.69399999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.438,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":0.76600000000000001,"15min":0.77100000000000002},"last":0.53100000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.42699999999999999,"5min":0.34699999999999998,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.80900000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.46500000000000002,"5min":0.38400000000000001,"15min":0.312},"max":{"1min":0.71199999999999997,"5min":0.74199999999999999,"15min":0.77400000000000002},"last":0.57799999999999996}]},{"osd":4,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.47999999999999998},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.249},"max":{"1min":0.68799999999999994,"5min":0.80400000000000005,"15min":0.81899999999999995},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.32900000000000001,"5min":0.29799999999999999,"15min":0.29399999999999998},"max":{"1min":0.64200000000000002,"5min":0.749,"15min":0.75700000000000001},"last":0.59099999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.48899999999999999},"min":{"1min":0.35799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.64900000000000002,"5min":0.75600000000000001,"15min":0.85299999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.50900000000000001,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33900000000000002,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.82599999999999996,"15min":0.83999999999999997},"last":0.752}]},{"osd":7,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.495,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66900000000000004,"5min":0.78400000000000003,"15min":0.79800000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.311,"15min":0.311},"max":{"1min":0.67800000000000005,"5min":0.77700000000000002,"15min":0.98599999999999999},"last":0.64900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574976,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1014,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194297,"statfs":{"total":200000000,"available":198961064,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.46800000000000003,"5min":0.25700000000000001,"15min":0.19700000000000001},"max":{"1min":0.74199999999999999,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.251},"max":{"1min":0.76200000000000001,"5min":0.875,"15min":0.875},"last":0.55100000000000005}]},{"osd":1,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52500000000000002},"min":{"1min":0.41499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.69399999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.50800000000000001,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.77000000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.374}]},{"osd":2,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.316,"15min":0.313},"max":{"1min":0.73199999999999998,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.40400000000000003,"5min":0.33300000000000002,"15min":0.23400000000000001},"max":{"1min":0.69599999999999995,"5min":0.746,"15min":0.80400000000000005},"last":0.39900000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.56499999999999995},"min":{"1min":0.46000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.746,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.44800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.88800000000000001,"15min":0.91000000000000003},"last":0.496}]},{"osd":5,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46000000000000002,"15min":0.46300000000000002},"min":{"1min":0.314,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":0.68799999999999994,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.33800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60699999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.44700000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38200000000000001,"5min":0.28799999999999998,"15min":0.26400000000000001},"max":{"1min":0.61399999999999999,"5min":0.73099999999999998,"15min":0.82399999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70399999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.53300000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.34899999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69699999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.432,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78000000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1019,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194293,"statfs":{"total":200000000,"available":198956364,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.25600000000000001,"5min":0.19800000000000001,"15min":0.193},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.629},"last":0.253},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.36699999999999999},"min":{"1min":0.28399999999999997,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":0.54100000000000004,"5min":0.58199999999999996,"15min":0.64000000000000001},"last":0.33300000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.34300000000000003,"15min":0.33000000000000002},"min":{"1min":0.24299999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.499,"5min":0.62,"15min":0.62},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.36599999999999999,"15min":0.35099999999999998},"min":{"1min":0.29399999999999998,"5min":0.24099999999999999,"15min":0.20399999999999999},"max":{"1min":0.48199999999999998,"5min":0.55800000000000005,"15min":0.61699999999999999},"last":0.28599999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.35799999999999998,"15min":0.34999999999999998},"min":{"1min":0.253,"5min":0.22600000000000001,"15min":0.21199999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.64900000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.38600000000000001},"min":{"1min":0.32300000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52500000000000002,"5min":0.59399999999999997,"15min":0.63600000000000001},"last":0.32000000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.436,"5min":0.36599999999999999,"15min":0.35199999999999998},"max":{"1min":0.80200000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59099999999999997,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.42299999999999999,"5min":0.40000000000000002,"15min":0.31},"max":{"1min":0.71299999999999997,"5min":0.82399999999999995,"15min":0.872},"last":0.628},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60599999999999998,"15min":0.57599999999999996},"min":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.878,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.68600000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60799999999999998,"15min":0.58899999999999997},"min":{"1min":0.442,"5min":0.375,"15min":0.33900000000000002},"max":{"1min":0.83899999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.37},"max":{"1min":0.75600000000000001,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70599999999999996}]},{"osd":7,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.38500000000000001},"max":{"1min":0.82799999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.623,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79200000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.73199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962608,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34899999999999998,"15min":0.32200000000000001},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.45300000000000001,"5min":0.57299999999999995,"15min":0.72699999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.39600000000000002,"15min":0.37},"min":{"1min":0.28399999999999997,"5min":0.27500000000000002,"15min":0.17699999999999999},"max":{"1min":0.52000000000000002,"5min":0.54100000000000004,"15min":2.0539999999999998},"last":0.40799999999999997}]},{"osd":1,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.378,"15min":0.35099999999999998},"min":{"1min":0.23699999999999999,"5min":0.22600000000000001,"15min":0.17999999999999999},"max":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.83099999999999996},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.40300000000000002,"15min":0.372},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.20000000000000001},"max":{"1min":0.57099999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.46600000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.41399999999999998,"15min":0.38500000000000001},"min":{"1min":0.29799999999999999,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.56299999999999994,"5min":0.60399999999999998,"15min":0.995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.41599999999999998,"15min":0.39100000000000001},"min":{"1min":0.308,"5min":0.218,"15min":0.218},"max":{"1min":0.57199999999999995,"5min":0.64400000000000002,"15min":0.76600000000000001},"last":0.44400000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.57899999999999996},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.32500000000000001},"max":{"1min":0.76900000000000002,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.38200000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83999999999999997,"5min":0.878,"15min":2.347},"last":0.54000000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":0.997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59899999999999998,"15min":0.57099999999999995},"min":{"1min":0.45300000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.68799999999999994}]},{"osd":6,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60199999999999998,"15min":0.58699999999999997},"min":{"1min":0.46500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84999999999999998,"5min":0.877,"15min":2.274},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61299999999999999,"15min":0.58899999999999997},"min":{"1min":0.503,"5min":0.38,"15min":0.373},"max":{"1min":0.84599999999999997,"5min":0.89300000000000002,"15min":1.0289999999999999},"last":0.69499999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.442,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85699999999999998,"5min":0.89800000000000002,"15min":2.3090000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.61699999999999999,"15min":0.59399999999999997},"min":{"1min":0.45200000000000001,"5min":0.40500000000000003,"15min":0.379},"max":{"1min":0.82299999999999995,"5min":0.873,"15min":1.0549999999999999},"last":0.627}]}]},{"osd":1,"up_from":13,"seq":55834574977,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962664,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.314},"min":{"1min":0.23599999999999999,"5min":0.20899999999999999,"15min":0.16400000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.37},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38700000000000001,"15min":0.35299999999999998},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.22700000000000001},"max":{"1min":0.53600000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.316}]},{"osd":2,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.32900000000000001},"min":{"1min":0.24099999999999999,"5min":0.23000000000000001,"15min":0.19500000000000001},"max":{"1min":0.57899999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.40100000000000002,"15min":0.372},"min":{"1min":0.307,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":0.53700000000000003,"5min":0.57099999999999995,"15min":0.57299999999999995},"last":0.34300000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42199999999999999,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.191},"max":{"1min":0.60399999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.36399999999999999},"min":{"1min":0.28000000000000003,"5min":0.22500000000000001,"15min":0.20399999999999999},"max":{"1min":0.56499999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.27100000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60699999999999998,"15min":0.57499999999999996},"min":{"1min":0.498,"5min":0.35599999999999998,"15min":0.312},"max":{"1min":0.79100000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.90900000000000003,"15min":1.002},"last":0.53800000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.79200000000000004,"15min":0.86099999999999999},"last":0.505},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61099999999999999,"15min":0.56799999999999995},"min":{"1min":0.48199999999999998,"5min":0.38300000000000001,"15min":0.317},"max":{"1min":0.81599999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.623}]},{"osd":6,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60299999999999998,"15min":0.57399999999999995},"min":{"1min":0.51000000000000001,"5min":0.38300000000000001,"15min":0.36899999999999999},"max":{"1min":0.72099999999999997,"5min":0.92400000000000004,"15min":1.038},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.57899999999999996},"min":{"1min":0.45900000000000002,"5min":0.40600000000000003,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.52400000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64200000000000002,"15min":0.60899999999999999},"min":{"1min":0.52500000000000002,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.80600000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64200000000000002,"15min":0.61599999999999999},"min":{"1min":0.52900000000000003,"5min":0.41899999999999998,"15min":0.376},"max":{"1min":0.82199999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574976,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1595,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193716,"statfs":{"total":200000000,"available":198366030,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.32600000000000001},"min":{"1min":0.214,"5min":0.189,"15min":0.184},"max":{"1min":0.51700000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.35799999999999998,"15min":0.33300000000000002},"min":{"1min":0.20999999999999999,"5min":0.20699999999999999,"15min":0.184},"max":{"1min":0.57399999999999995,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.33800000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.376,"15min":0.36499999999999999},"min":{"1min":0.248,"5min":0.22800000000000001,"15min":0.218},"max":{"1min":0.55600000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38400000000000001,"15min":0.36199999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.23100000000000001},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.622},"last":0.27800000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.376,"15min":0.34599999999999997},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.58899999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40699999999999997,"15min":0.38400000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27400000000000002},"max":{"1min":0.60799999999999998,"5min":0.625,"15min":0.625},"last":0.35499999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57499999999999996,"15min":0.54500000000000004},"min":{"1min":0.437,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.55400000000000005},"min":{"1min":0.46500000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74199999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.52700000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57399999999999995,"15min":0.54400000000000004},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":0.85999999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.59999999999999998,"15min":0.56899999999999995},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.86199999999999999},"last":0.66700000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61399999999999999,"15min":0.59699999999999998},"min":{"1min":0.49199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82499999999999996,"5min":0.88100000000000001,"15min":0.89600000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.62,"15min":0.59899999999999998},"min":{"1min":0.51100000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84599999999999997,"5min":0.89500000000000002,"15min":0.90000000000000002},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59999999999999998,"15min":0.57099999999999995},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.375},"max":{"1min":0.76400000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.60599999999999998,"15min":0.58599999999999997},"min":{"1min":0.48999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79800000000000004,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.56899999999999995}]}]}],"pool_statfs":[]}} 2023-12-20T04:53:08.446 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:53:08.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.579+0000 7f0fa8a8b640 1 Processor -- start 2023-12-20T04:53:08.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.579+0000 7f0fa8a8b640 1 -- start start 2023-12-20T04:53:08.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.580+0000 7f0fa8a8b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fa4160450 0x7f0fa4160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:08.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.580+0000 7f0fa8a8b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0fa40b5090 0x7f0fa40d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:08.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.580+0000 7f0fa8a8b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0fa40b5ec0 con 0x7f0fa41611b0 2023-12-20T04:53:08.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.580+0000 7f0fa8a8b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0fa41617e0 con 0x7f0fa40b5090 2023-12-20T04:53:08.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.580+0000 7f0fa8a8b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa40d0fc0 con 0x7f0fa4160450 2023-12-20T04:53:08.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.581+0000 7f0fa2d9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0fa40b5090 0x7f0fa40d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:08.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.581+0000 7f0fa259c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fa4160450 0x7f0fa4160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:08.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.581+0000 7f0fa2d9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f0fa40b5090 0x7f0fa40d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:48224/0 (socket says 172.21.15.132:48224) 2023-12-20T04:53:08.583 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.581+0000 7f0fa2d9d640 1 -- 172.21.15.132:0/3856850112 learned_addr learned my addr 172.21.15.132:0/3856850112 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:08.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.581+0000 7f0fa259c640 1 -- 172.21.15.132:0/3856850112 >> v2:172.21.15.187:3300/0 conn(0x7f0fa40b5090 msgr2=0x7f0fa40d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:08.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.581+0000 7f0fa259c640 1 --2- 172.21.15.132:0/3856850112 >> v2:172.21.15.187:3300/0 conn(0x7f0fa40b5090 0x7f0fa40d1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.581+0000 7f0fa259c640 1 -- 172.21.15.132:0/3856850112 >> v1:172.21.15.187:6789/0 conn(0x7f0fa41611b0 legacy=0x7f0fa40b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.581+0000 7f0fa259c640 1 -- 172.21.15.132:0/3856850112 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0fa40d12a0 con 0x7f0fa4160450 2023-12-20T04:53:08.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.581+0000 7f0fa2d9d640 1 --2- 172.21.15.132:0/3856850112 >> v2:172.21.15.187:3300/0 conn(0x7f0fa40b5090 0x7f0fa40d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:53:08.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.582+0000 7f0fa259c640 1 --2- 172.21.15.132:0/3856850112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fa4160450 0x7f0fa4160c70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0f940097a0 tx=0x7f0f9402b960 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ae7a61f80f84f9d9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:08.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.582+0000 7f0fa1d9b640 1 -- 172.21.15.132:0/3856850112 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94030610 con 0x7f0fa4160450 2023-12-20T04:53:08.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.582+0000 7f0fa1d9b640 1 -- 172.21.15.132:0/3856850112 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f94030770 con 0x7f0fa4160450 2023-12-20T04:53:08.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.582+0000 7f0fa1d9b640 1 -- 172.21.15.132:0/3856850112 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f94030b00 con 0x7f0fa4160450 2023-12-20T04:53:08.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.582+0000 7f0fa8a8b640 1 -- 172.21.15.132:0/3856850112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fa4160450 msgr2=0x7f0fa4160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.582+0000 7f0fa8a8b640 1 --2- 172.21.15.132:0/3856850112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fa4160450 0x7f0fa4160c70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f0f940097a0 tx=0x7f0f9402b960 comp rx=0 tx=0).stop 2023-12-20T04:53:08.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.583+0000 7f0fa8a8b640 1 -- 172.21.15.132:0/3856850112 shutdown_connections 2023-12-20T04:53:08.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.583+0000 7f0fa8a8b640 1 --2- 172.21.15.132:0/3856850112 >> v2:172.21.15.187:3300/0 conn(0x7f0fa40b5090 0x7f0fa40d1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.583+0000 7f0fa8a8b640 1 --2- 172.21.15.132:0/3856850112 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fa4160450 0x7f0fa4160c70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.583+0000 7f0fa8a8b640 1 -- 172.21.15.132:0/3856850112 >> 172.21.15.132:0/3856850112 conn(0x7f0fa40cf980 msgr2=0x7f0fa40cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:08.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.583+0000 7f0fa8a8b640 1 -- 172.21.15.132:0/3856850112 shutdown_connections 2023-12-20T04:53:08.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.583+0000 7f0fa8a8b640 1 -- 172.21.15.132:0/3856850112 wait complete. 2023-12-20T04:53:08.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.584+0000 7f0fa8a8b640 1 Processor -- start 2023-12-20T04:53:08.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.584+0000 7f0fa8a8b640 1 -- start start 2023-12-20T04:53:08.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.584+0000 7f0fa8a8b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fa40b5090 0x7f0fa41546e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:08.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.584+0000 7f0fa8a8b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fa4160450 0x7f0fa40c8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:08.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0fa8a8b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa41611b0 0x7f0fa415e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:08.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0fa8a8b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa41544e0 con 0x7f0fa4160450 2023-12-20T04:53:08.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0fa8a8b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa4157790 con 0x7f0fa41611b0 2023-12-20T04:53:08.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0fa8a8b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0fa41571d0 con 0x7f0fa40b5090 2023-12-20T04:53:08.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0f9bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fa4160450 0x7f0fa40c8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:08.588 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0f9bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fa4160450 0x7f0fa40c8f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33118/0 (socket says 172.21.15.132:33118) 2023-12-20T04:53:08.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0f9bfff640 1 -- 172.21.15.132:0/4199153187 learned_addr learned my addr 172.21.15.132:0/4199153187 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:08.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0fa2d9d640 1 --2- 172.21.15.132:0/4199153187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa41611b0 0x7f0fa415e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:08.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0fa259c640 1 --2- 172.21.15.132:0/4199153187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fa40b5090 0x7f0fa41546e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:08.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0f9bfff640 1 -- 172.21.15.132:0/4199153187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fa40b5090 msgr2=0x7f0fa41546e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0f9bfff640 1 --2- 172.21.15.132:0/4199153187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fa40b5090 0x7f0fa41546e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0f9bfff640 1 -- 172.21.15.132:0/4199153187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa41611b0 msgr2=0x7f0fa415e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0f9bfff640 1 --2- 172.21.15.132:0/4199153187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa41611b0 0x7f0fa415e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0f9bfff640 1 -- 172.21.15.132:0/4199153187 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f9c009b30 con 0x7f0fa4160450 2023-12-20T04:53:08.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0fa2d9d640 1 --2- 172.21.15.132:0/4199153187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa41611b0 0x7f0fa415e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:08.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0f9bfff640 1 --2- 172.21.15.132:0/4199153187 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fa4160450 0x7f0fa40c8f30 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00c400 tx=0x7f0f8c00c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:08.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0f9affd640 1 -- 172.21.15.132:0/4199153187 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c0052d0 con 0x7f0fa4160450 2023-12-20T04:53:08.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0f9affd640 1 -- 172.21.15.132:0/4199153187 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0f8c005430 con 0x7f0fa4160450 2023-12-20T04:53:08.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0fa8a8b640 1 -- 172.21.15.132:0/4199153187 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f94009400 con 0x7f0fa4160450 2023-12-20T04:53:08.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0f9affd640 1 -- 172.21.15.132:0/4199153187 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0f8c003830 con 0x7f0fa4160450 2023-12-20T04:53:08.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.585+0000 7f0fa8a8b640 1 -- 172.21.15.132:0/4199153187 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0fa415dfc0 con 0x7f0fa4160450 2023-12-20T04:53:08.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.586+0000 7f0fa8a8b640 1 -- 172.21.15.132:0/4199153187 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0fa404e840 con 0x7f0fa4160450 2023-12-20T04:53:08.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.587+0000 7f0f9affd640 1 -- 172.21.15.132:0/4199153187 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0f8c003990 con 0x7f0fa4160450 2023-12-20T04:53:08.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.587+0000 7f0f9affd640 1 --2- 172.21.15.132:0/4199153187 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f8406a430 0x7f0f8406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:08.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.587+0000 7f0f9affd640 1 -- 172.21.15.132:0/4199153187 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0f8c087e30 con 0x7f0fa4160450 2023-12-20T04:53:08.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.587+0000 7f0fa259c640 1 --2- 172.21.15.132:0/4199153187 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f8406a430 0x7f0f8406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:08.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.588+0000 7f0fa259c640 1 --2- 172.21.15.132:0/4199153187 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f8406a430 0x7f0f8406c8f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0f94036000 tx=0x7f0f94008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:08.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.592+0000 7f0f9affd640 1 -- 172.21.15.132:0/4199153187 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0f8c0534b0 con 0x7f0fa4160450 2023-12-20T04:53:08.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.753+0000 7f0fa8a8b640 1 -- 172.21.15.132:0/4199153187 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f0fa40b89d0 con 0x7f0f8406a430 2023-12-20T04:53:08.762 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.760+0000 7f0f9affd640 1 -- 172.21.15.132:0/4199153187 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+285691 (secure 0 0 0) 0x7f0f94044470 con 0x7f0f8406a430 2023-12-20T04:53:08.765 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:08.767 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:53:08.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.763+0000 7f0fa8a8b640 1 -- 172.21.15.132:0/4199153187 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f8406a430 msgr2=0x7f0f8406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.763+0000 7f0fa8a8b640 1 --2- 172.21.15.132:0/4199153187 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f8406a430 0x7f0f8406c8f0 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f0f94036000 tx=0x7f0f94008030 comp rx=0 tx=0).stop 2023-12-20T04:53:08.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.763+0000 7f0fa8a8b640 1 -- 172.21.15.132:0/4199153187 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fa4160450 msgr2=0x7f0fa40c8f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.763+0000 7f0fa8a8b640 1 --2- 172.21.15.132:0/4199153187 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fa4160450 0x7f0fa40c8f30 secure :-1 s=READY pgs=1812 cs=0 l=1 rev1=1 crypto rx=0x7f0f8c00c400 tx=0x7f0f8c00c8c0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.763+0000 7f0fa8a8b640 1 -- 172.21.15.132:0/4199153187 shutdown_connections 2023-12-20T04:53:08.768 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.763+0000 7f0fa8a8b640 1 --2- 172.21.15.132:0/4199153187 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f0f8406a430 0x7f0f8406c8f0 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.763+0000 7f0fa8a8b640 1 --2- 172.21.15.132:0/4199153187 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0fa41611b0 0x7f0fa415e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.763+0000 7f0fa8a8b640 1 --2- 172.21.15.132:0/4199153187 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0fa4160450 0x7f0fa40c8f30 unknown :-1 s=CLOSED pgs=1812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.763+0000 7f0fa8a8b640 1 --2- 172.21.15.132:0/4199153187 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0fa40b5090 0x7f0fa41546e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.763+0000 7f0fa8a8b640 1 -- 172.21.15.132:0/4199153187 >> 172.21.15.132:0/4199153187 conn(0x7f0fa40cf980 msgr2=0x7f0fa40b6a20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:08.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.763+0000 7f0fa8a8b640 1 -- 172.21.15.132:0/4199153187 shutdown_connections 2023-12-20T04:53:08.769 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.763+0000 7f0fa8a8b640 1 -- 172.21.15.132:0/4199153187 wait complete. 2023-12-20T04:53:08.777 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":494,"stamp":"2023-12-20T04:53:08.231542+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":592730,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":204,"num_write_kb":2430,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":156,"ondisk_log_size":156,"up":194,"acting":194,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":57,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9280,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1553219,"statfs":{"total":1600000000,"available":1590497224,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.739117"},"pg_stats":[{"pgid":"23.3f","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.844102+0000","last_change":"2023-12-20T04:53:04.852027+0000","last_active":"2023-12-20T04:53:05.844102+0000","last_peered":"2023-12-20T04:53:05.844102+0000","last_clean":"2023-12-20T04:53:05.844102+0000","last_became_active":"2023-12-20T04:53:04.851507+0000","last_became_peered":"2023-12-20T04:53:04.851507+0000","last_unstale":"2023-12-20T04:53:05.844102+0000","last_undegraded":"2023-12-20T04:53:05.844102+0000","last_fullsized":"2023-12-20T04:53:05.844102+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:03:03.009432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.3e","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049698+0000","last_change":"2023-12-20T04:53:04.856637+0000","last_active":"2023-12-20T04:53:06.049698+0000","last_peered":"2023-12-20T04:53:06.049698+0000","last_clean":"2023-12-20T04:53:06.049698+0000","last_became_active":"2023-12-20T04:53:04.856076+0000","last_became_peered":"2023-12-20T04:53:04.856076+0000","last_unstale":"2023-12-20T04:53:06.049698+0000","last_undegraded":"2023-12-20T04:53:06.049698+0000","last_fullsized":"2023-12-20T04:53:06.049698+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:28:25.986363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3d","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049632+0000","last_change":"2023-12-20T04:53:04.853652+0000","last_active":"2023-12-20T04:53:06.049632+0000","last_peered":"2023-12-20T04:53:06.049632+0000","last_clean":"2023-12-20T04:53:06.049632+0000","last_became_active":"2023-12-20T04:53:04.853443+0000","last_became_peered":"2023-12-20T04:53:04.853443+0000","last_unstale":"2023-12-20T04:53:06.049632+0000","last_undegraded":"2023-12-20T04:53:06.049632+0000","last_fullsized":"2023-12-20T04:53:06.049632+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:11:15.383242+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.3c","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048443+0000","last_change":"2023-12-20T04:53:04.850407+0000","last_active":"2023-12-20T04:53:06.048443+0000","last_peered":"2023-12-20T04:53:06.048443+0000","last_clean":"2023-12-20T04:53:06.048443+0000","last_became_active":"2023-12-20T04:53:04.850146+0000","last_became_peered":"2023-12-20T04:53:04.850146+0000","last_unstale":"2023-12-20T04:53:06.048443+0000","last_undegraded":"2023-12-20T04:53:06.048443+0000","last_fullsized":"2023-12-20T04:53:06.048443+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:05:04.817033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.3b","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049784+0000","last_change":"2023-12-20T04:53:04.852097+0000","last_active":"2023-12-20T04:53:06.049784+0000","last_peered":"2023-12-20T04:53:06.049784+0000","last_clean":"2023-12-20T04:53:06.049784+0000","last_became_active":"2023-12-20T04:53:04.851734+0000","last_became_peered":"2023-12-20T04:53:04.851734+0000","last_unstale":"2023-12-20T04:53:06.049784+0000","last_undegraded":"2023-12-20T04:53:06.049784+0000","last_fullsized":"2023-12-20T04:53:06.049784+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:46:48.937355+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.3a","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048500+0000","last_change":"2023-12-20T04:53:04.846641+0000","last_active":"2023-12-20T04:53:06.048500+0000","last_peered":"2023-12-20T04:53:06.048500+0000","last_clean":"2023-12-20T04:53:06.048500+0000","last_became_active":"2023-12-20T04:53:04.846383+0000","last_became_peered":"2023-12-20T04:53:04.846383+0000","last_unstale":"2023-12-20T04:53:06.048500+0000","last_undegraded":"2023-12-20T04:53:06.048500+0000","last_fullsized":"2023-12-20T04:53:06.048500+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:07:56.940883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.39","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843798+0000","last_change":"2023-12-20T04:53:04.844868+0000","last_active":"2023-12-20T04:53:05.843798+0000","last_peered":"2023-12-20T04:53:05.843798+0000","last_clean":"2023-12-20T04:53:05.843798+0000","last_became_active":"2023-12-20T04:53:04.844670+0000","last_became_peered":"2023-12-20T04:53:04.844670+0000","last_unstale":"2023-12-20T04:53:05.843798+0000","last_undegraded":"2023-12-20T04:53:05.843798+0000","last_fullsized":"2023-12-20T04:53:05.843798+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:17:12.710733+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.38","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049698+0000","last_change":"2023-12-20T04:53:04.853059+0000","last_active":"2023-12-20T04:53:06.049698+0000","last_peered":"2023-12-20T04:53:06.049698+0000","last_clean":"2023-12-20T04:53:06.049698+0000","last_became_active":"2023-12-20T04:53:04.852804+0000","last_became_peered":"2023-12-20T04:53:04.852804+0000","last_unstale":"2023-12-20T04:53:06.049698+0000","last_undegraded":"2023-12-20T04:53:06.049698+0000","last_fullsized":"2023-12-20T04:53:06.049698+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:22:09.545774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.37","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049323+0000","last_change":"2023-12-20T04:53:04.851067+0000","last_active":"2023-12-20T04:53:06.049323+0000","last_peered":"2023-12-20T04:53:06.049323+0000","last_clean":"2023-12-20T04:53:06.049323+0000","last_became_active":"2023-12-20T04:53:04.850799+0000","last_became_peered":"2023-12-20T04:53:04.850799+0000","last_unstale":"2023-12-20T04:53:06.049323+0000","last_undegraded":"2023-12-20T04:53:06.049323+0000","last_fullsized":"2023-12-20T04:53:06.049323+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:46:09.712695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.36","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049878+0000","last_change":"2023-12-20T04:53:04.851954+0000","last_active":"2023-12-20T04:53:06.049878+0000","last_peered":"2023-12-20T04:53:06.049878+0000","last_clean":"2023-12-20T04:53:06.049878+0000","last_became_active":"2023-12-20T04:53:04.851442+0000","last_became_peered":"2023-12-20T04:53:04.851442+0000","last_unstale":"2023-12-20T04:53:06.049878+0000","last_undegraded":"2023-12-20T04:53:06.049878+0000","last_fullsized":"2023-12-20T04:53:06.049878+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:09:45.926143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.35","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049612+0000","last_change":"2023-12-20T04:53:04.853074+0000","last_active":"2023-12-20T04:53:06.049612+0000","last_peered":"2023-12-20T04:53:06.049612+0000","last_clean":"2023-12-20T04:53:06.049612+0000","last_became_active":"2023-12-20T04:53:04.852851+0000","last_became_peered":"2023-12-20T04:53:04.852851+0000","last_unstale":"2023-12-20T04:53:06.049612+0000","last_undegraded":"2023-12-20T04:53:06.049612+0000","last_fullsized":"2023-12-20T04:53:06.049612+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:41:56.678169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.34","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049823+0000","last_change":"2023-12-20T04:53:04.856304+0000","last_active":"2023-12-20T04:53:06.049823+0000","last_peered":"2023-12-20T04:53:06.049823+0000","last_clean":"2023-12-20T04:53:06.049823+0000","last_became_active":"2023-12-20T04:53:04.855262+0000","last_became_peered":"2023-12-20T04:53:04.855262+0000","last_unstale":"2023-12-20T04:53:06.049823+0000","last_undegraded":"2023-12-20T04:53:06.049823+0000","last_fullsized":"2023-12-20T04:53:06.049823+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:37:07.178462+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.33","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049347+0000","last_change":"2023-12-20T04:53:04.850223+0000","last_active":"2023-12-20T04:53:06.049347+0000","last_peered":"2023-12-20T04:53:06.049347+0000","last_clean":"2023-12-20T04:53:06.049347+0000","last_became_active":"2023-12-20T04:53:04.849715+0000","last_became_peered":"2023-12-20T04:53:04.849715+0000","last_unstale":"2023-12-20T04:53:06.049347+0000","last_undegraded":"2023-12-20T04:53:06.049347+0000","last_fullsized":"2023-12-20T04:53:06.049347+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:13:00.830694+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.32","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049049+0000","last_change":"2023-12-20T04:53:04.851911+0000","last_active":"2023-12-20T04:53:06.049049+0000","last_peered":"2023-12-20T04:53:06.049049+0000","last_clean":"2023-12-20T04:53:06.049049+0000","last_became_active":"2023-12-20T04:53:04.850895+0000","last_became_peered":"2023-12-20T04:53:04.850895+0000","last_unstale":"2023-12-20T04:53:06.049049+0000","last_undegraded":"2023-12-20T04:53:06.049049+0000","last_fullsized":"2023-12-20T04:53:06.049049+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:08.234734+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.31","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.844051+0000","last_change":"2023-12-20T04:53:04.851930+0000","last_active":"2023-12-20T04:53:05.844051+0000","last_peered":"2023-12-20T04:53:05.844051+0000","last_clean":"2023-12-20T04:53:05.844051+0000","last_became_active":"2023-12-20T04:53:04.851561+0000","last_became_peered":"2023-12-20T04:53:04.851561+0000","last_unstale":"2023-12-20T04:53:05.844051+0000","last_undegraded":"2023-12-20T04:53:05.844051+0000","last_fullsized":"2023-12-20T04:53:05.844051+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:40:07.703896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.30","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843742+0000","last_change":"2023-12-20T04:53:04.851568+0000","last_active":"2023-12-20T04:53:05.843742+0000","last_peered":"2023-12-20T04:53:05.843742+0000","last_clean":"2023-12-20T04:53:05.843742+0000","last_became_active":"2023-12-20T04:53:04.850330+0000","last_became_peered":"2023-12-20T04:53:04.850330+0000","last_unstale":"2023-12-20T04:53:05.843742+0000","last_undegraded":"2023-12-20T04:53:05.843742+0000","last_fullsized":"2023-12-20T04:53:05.843742+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:10:24.881387+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.2f","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048738+0000","last_change":"2023-12-20T04:53:04.850838+0000","last_active":"2023-12-20T04:53:06.048738+0000","last_peered":"2023-12-20T04:53:06.048738+0000","last_clean":"2023-12-20T04:53:06.048738+0000","last_became_active":"2023-12-20T04:53:04.850633+0000","last_became_peered":"2023-12-20T04:53:04.850633+0000","last_unstale":"2023-12-20T04:53:06.048738+0000","last_undegraded":"2023-12-20T04:53:06.048738+0000","last_fullsized":"2023-12-20T04:53:06.048738+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:43:48.356023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2e","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845151+0000","last_change":"2023-12-20T04:53:04.853045+0000","last_active":"2023-12-20T04:53:05.845151+0000","last_peered":"2023-12-20T04:53:05.845151+0000","last_clean":"2023-12-20T04:53:05.845151+0000","last_became_active":"2023-12-20T04:53:04.852794+0000","last_became_peered":"2023-12-20T04:53:04.852794+0000","last_unstale":"2023-12-20T04:53:05.845151+0000","last_undegraded":"2023-12-20T04:53:05.845151+0000","last_fullsized":"2023-12-20T04:53:05.845151+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:48:12.265420+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2d","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048841+0000","last_change":"2023-12-20T04:53:04.843610+0000","last_active":"2023-12-20T04:53:06.048841+0000","last_peered":"2023-12-20T04:53:06.048841+0000","last_clean":"2023-12-20T04:53:06.048841+0000","last_became_active":"2023-12-20T04:53:04.843410+0000","last_became_peered":"2023-12-20T04:53:04.843410+0000","last_unstale":"2023-12-20T04:53:06.048841+0000","last_undegraded":"2023-12-20T04:53:06.048841+0000","last_fullsized":"2023-12-20T04:53:06.048841+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:40:30.887367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2c","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049168+0000","last_change":"2023-12-20T04:53:04.850610+0000","last_active":"2023-12-20T04:53:06.049168+0000","last_peered":"2023-12-20T04:53:06.049168+0000","last_clean":"2023-12-20T04:53:06.049168+0000","last_became_active":"2023-12-20T04:53:04.850249+0000","last_became_peered":"2023-12-20T04:53:04.850249+0000","last_unstale":"2023-12-20T04:53:06.049168+0000","last_undegraded":"2023-12-20T04:53:06.049168+0000","last_fullsized":"2023-12-20T04:53:06.049168+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:26:12.672188+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.2b","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048601+0000","last_change":"2023-12-20T04:53:04.847978+0000","last_active":"2023-12-20T04:53:06.048601+0000","last_peered":"2023-12-20T04:53:06.048601+0000","last_clean":"2023-12-20T04:53:06.048601+0000","last_became_active":"2023-12-20T04:53:04.847766+0000","last_became_peered":"2023-12-20T04:53:04.847766+0000","last_unstale":"2023-12-20T04:53:06.048601+0000","last_undegraded":"2023-12-20T04:53:06.048601+0000","last_fullsized":"2023-12-20T04:53:06.048601+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:31:40.163557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.2a","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049924+0000","last_change":"2023-12-20T04:53:04.856465+0000","last_active":"2023-12-20T04:53:06.049924+0000","last_peered":"2023-12-20T04:53:06.049924+0000","last_clean":"2023-12-20T04:53:06.049924+0000","last_became_active":"2023-12-20T04:53:04.855556+0000","last_became_peered":"2023-12-20T04:53:04.855556+0000","last_unstale":"2023-12-20T04:53:06.049924+0000","last_undegraded":"2023-12-20T04:53:06.049924+0000","last_fullsized":"2023-12-20T04:53:06.049924+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:05:16.314223+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.29","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048872+0000","last_change":"2023-12-20T04:53:04.851132+0000","last_active":"2023-12-20T04:53:06.048872+0000","last_peered":"2023-12-20T04:53:06.048872+0000","last_clean":"2023-12-20T04:53:06.048872+0000","last_became_active":"2023-12-20T04:53:04.850902+0000","last_became_peered":"2023-12-20T04:53:04.850902+0000","last_unstale":"2023-12-20T04:53:06.048872+0000","last_undegraded":"2023-12-20T04:53:06.048872+0000","last_fullsized":"2023-12-20T04:53:06.048872+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:17:15.209940+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.28","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048942+0000","last_change":"2023-12-20T04:53:04.854881+0000","last_active":"2023-12-20T04:53:06.048942+0000","last_peered":"2023-12-20T04:53:06.048942+0000","last_clean":"2023-12-20T04:53:06.048942+0000","last_became_active":"2023-12-20T04:53:04.854649+0000","last_became_peered":"2023-12-20T04:53:04.854649+0000","last_unstale":"2023-12-20T04:53:06.048942+0000","last_undegraded":"2023-12-20T04:53:06.048942+0000","last_fullsized":"2023-12-20T04:53:06.048942+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:05:55.398320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.27","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049461+0000","last_change":"2023-12-20T04:53:04.852210+0000","last_active":"2023-12-20T04:53:06.049461+0000","last_peered":"2023-12-20T04:53:06.049461+0000","last_clean":"2023-12-20T04:53:06.049461+0000","last_became_active":"2023-12-20T04:53:04.851992+0000","last_became_peered":"2023-12-20T04:53:04.851992+0000","last_unstale":"2023-12-20T04:53:06.049461+0000","last_undegraded":"2023-12-20T04:53:06.049461+0000","last_fullsized":"2023-12-20T04:53:06.049461+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:59:49.501548+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.26","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843692+0000","last_change":"2023-12-20T04:53:04.850573+0000","last_active":"2023-12-20T04:53:05.843692+0000","last_peered":"2023-12-20T04:53:05.843692+0000","last_clean":"2023-12-20T04:53:05.843692+0000","last_became_active":"2023-12-20T04:53:04.850056+0000","last_became_peered":"2023-12-20T04:53:04.850056+0000","last_unstale":"2023-12-20T04:53:05.843692+0000","last_undegraded":"2023-12-20T04:53:05.843692+0000","last_fullsized":"2023-12-20T04:53:05.843692+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:09:45.036468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.25","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049119+0000","last_change":"2023-12-20T04:53:04.851874+0000","last_active":"2023-12-20T04:53:06.049119+0000","last_peered":"2023-12-20T04:53:06.049119+0000","last_clean":"2023-12-20T04:53:06.049119+0000","last_became_active":"2023-12-20T04:53:04.851653+0000","last_became_peered":"2023-12-20T04:53:04.851653+0000","last_unstale":"2023-12-20T04:53:06.049119+0000","last_undegraded":"2023-12-20T04:53:06.049119+0000","last_fullsized":"2023-12-20T04:53:06.049119+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:00:24.704428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.24","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048478+0000","last_change":"2023-12-20T04:53:04.849336+0000","last_active":"2023-12-20T04:53:06.048478+0000","last_peered":"2023-12-20T04:53:06.048478+0000","last_clean":"2023-12-20T04:53:06.048478+0000","last_became_active":"2023-12-20T04:53:04.849135+0000","last_became_peered":"2023-12-20T04:53:04.849135+0000","last_unstale":"2023-12-20T04:53:06.048478+0000","last_undegraded":"2023-12-20T04:53:06.048478+0000","last_fullsized":"2023-12-20T04:53:06.048478+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:39:58.504822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.23","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049148+0000","last_change":"2023-12-20T04:53:04.852384+0000","last_active":"2023-12-20T04:53:06.049148+0000","last_peered":"2023-12-20T04:53:06.049148+0000","last_clean":"2023-12-20T04:53:06.049148+0000","last_became_active":"2023-12-20T04:53:04.852173+0000","last_became_peered":"2023-12-20T04:53:04.852173+0000","last_unstale":"2023-12-20T04:53:06.049148+0000","last_undegraded":"2023-12-20T04:53:06.049148+0000","last_fullsized":"2023-12-20T04:53:06.049148+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:07:00.683099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.22","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049605+0000","last_change":"2023-12-20T04:53:04.851722+0000","last_active":"2023-12-20T04:53:06.049605+0000","last_peered":"2023-12-20T04:53:06.049605+0000","last_clean":"2023-12-20T04:53:06.049605+0000","last_became_active":"2023-12-20T04:53:04.851512+0000","last_became_peered":"2023-12-20T04:53:04.851512+0000","last_unstale":"2023-12-20T04:53:06.049605+0000","last_undegraded":"2023-12-20T04:53:06.049605+0000","last_fullsized":"2023-12-20T04:53:06.049605+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:31:53.662833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.21","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049958+0000","last_change":"2023-12-20T04:53:04.847234+0000","last_active":"2023-12-20T04:53:06.049958+0000","last_peered":"2023-12-20T04:53:06.049958+0000","last_clean":"2023-12-20T04:53:06.049958+0000","last_became_active":"2023-12-20T04:53:04.846631+0000","last_became_peered":"2023-12-20T04:53:04.846631+0000","last_unstale":"2023-12-20T04:53:06.049958+0000","last_undegraded":"2023-12-20T04:53:06.049958+0000","last_fullsized":"2023-12-20T04:53:06.049958+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:06:50.325153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.20","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.844985+0000","last_change":"2023-12-20T04:53:04.852727+0000","last_active":"2023-12-20T04:53:05.844985+0000","last_peered":"2023-12-20T04:53:05.844985+0000","last_clean":"2023-12-20T04:53:05.844985+0000","last_became_active":"2023-12-20T04:53:04.851943+0000","last_became_peered":"2023-12-20T04:53:04.851943+0000","last_unstale":"2023-12-20T04:53:05.844985+0000","last_undegraded":"2023-12-20T04:53:05.844985+0000","last_fullsized":"2023-12-20T04:53:05.844985+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:25:23.424519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.1e","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843523+0000","last_change":"2023-12-20T04:53:04.847399+0000","last_active":"2023-12-20T04:53:05.843523+0000","last_peered":"2023-12-20T04:53:05.843523+0000","last_clean":"2023-12-20T04:53:05.843523+0000","last_became_active":"2023-12-20T04:53:04.847202+0000","last_became_peered":"2023-12-20T04:53:04.847202+0000","last_unstale":"2023-12-20T04:53:05.843523+0000","last_undegraded":"2023-12-20T04:53:05.843523+0000","last_fullsized":"2023-12-20T04:53:05.843523+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:45:15.231394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1f","version":"185'4","reported_seq":15,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843937+0000","last_change":"2023-12-20T04:53:04.507799+0000","last_active":"2023-12-20T04:53:05.843937+0000","last_peered":"2023-12-20T04:53:05.843937+0000","last_clean":"2023-12-20T04:53:05.843937+0000","last_became_active":"2023-12-20T04:53:04.507496+0000","last_became_peered":"2023-12-20T04:53:04.507496+0000","last_unstale":"2023-12-20T04:53:05.843937+0000","last_undegraded":"2023-12-20T04:53:05.843937+0000","last_fullsized":"2023-12-20T04:53:05.843937+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:40:35.033957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.1f","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049931+0000","last_change":"2023-12-20T04:53:04.849290+0000","last_active":"2023-12-20T04:53:06.049931+0000","last_peered":"2023-12-20T04:53:06.049931+0000","last_clean":"2023-12-20T04:53:06.049931+0000","last_became_active":"2023-12-20T04:53:04.849024+0000","last_became_peered":"2023-12-20T04:53:04.849024+0000","last_unstale":"2023-12-20T04:53:06.049931+0000","last_undegraded":"2023-12-20T04:53:06.049931+0000","last_fullsized":"2023-12-20T04:53:06.049931+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:26:43.712317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.1e","version":"185'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048919+0000","last_change":"2023-12-20T04:53:04.505773+0000","last_active":"2023-12-20T04:53:06.048919+0000","last_peered":"2023-12-20T04:53:06.048919+0000","last_clean":"2023-12-20T04:53:06.048919+0000","last_became_active":"2023-12-20T04:53:04.505558+0000","last_became_peered":"2023-12-20T04:53:04.505558+0000","last_unstale":"2023-12-20T04:53:06.048919+0000","last_undegraded":"2023-12-20T04:53:06.048919+0000","last_fullsized":"2023-12-20T04:53:06.048919+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:37:06.170946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.1c","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048694+0000","last_change":"2023-12-20T04:53:04.850440+0000","last_active":"2023-12-20T04:53:06.048694+0000","last_peered":"2023-12-20T04:53:06.048694+0000","last_clean":"2023-12-20T04:53:06.048694+0000","last_became_active":"2023-12-20T04:53:04.850237+0000","last_became_peered":"2023-12-20T04:53:04.850237+0000","last_unstale":"2023-12-20T04:53:06.048694+0000","last_undegraded":"2023-12-20T04:53:06.048694+0000","last_fullsized":"2023-12-20T04:53:06.048694+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:22:00.719145+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.1d","version":"185'2","reported_seq":13,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048923+0000","last_change":"2023-12-20T04:53:04.505011+0000","last_active":"2023-12-20T04:53:06.048923+0000","last_peered":"2023-12-20T04:53:06.048923+0000","last_clean":"2023-12-20T04:53:06.048923+0000","last_became_active":"2023-12-20T04:53:04.504804+0000","last_became_peered":"2023-12-20T04:53:04.504804+0000","last_unstale":"2023-12-20T04:53:06.048923+0000","last_undegraded":"2023-12-20T04:53:06.048923+0000","last_fullsized":"2023-12-20T04:53:06.048923+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:44:23.022262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1d","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049545+0000","last_change":"2023-12-20T04:53:04.852948+0000","last_active":"2023-12-20T04:53:06.049545+0000","last_peered":"2023-12-20T04:53:06.049545+0000","last_clean":"2023-12-20T04:53:06.049545+0000","last_became_active":"2023-12-20T04:53:04.852733+0000","last_became_peered":"2023-12-20T04:53:04.852733+0000","last_unstale":"2023-12-20T04:53:06.049545+0000","last_undegraded":"2023-12-20T04:53:06.049545+0000","last_fullsized":"2023-12-20T04:53:06.049545+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:58.309580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.1c","version":"185'2","reported_seq":13,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048610+0000","last_change":"2023-12-20T04:53:04.506780+0000","last_active":"2023-12-20T04:53:06.048610+0000","last_peered":"2023-12-20T04:53:06.048610+0000","last_clean":"2023-12-20T04:53:06.048610+0000","last_became_active":"2023-12-20T04:53:04.506568+0000","last_became_peered":"2023-12-20T04:53:04.506568+0000","last_unstale":"2023-12-20T04:53:06.048610+0000","last_undegraded":"2023-12-20T04:53:06.048610+0000","last_fullsized":"2023-12-20T04:53:06.048610+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:50:32.357538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.1a","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843540+0000","last_change":"2023-12-20T04:53:04.849164+0000","last_active":"2023-12-20T04:53:05.843540+0000","last_peered":"2023-12-20T04:53:05.843540+0000","last_clean":"2023-12-20T04:53:05.843540+0000","last_became_active":"2023-12-20T04:53:04.848950+0000","last_became_peered":"2023-12-20T04:53:04.848950+0000","last_unstale":"2023-12-20T04:53:05.843540+0000","last_undegraded":"2023-12-20T04:53:05.843540+0000","last_fullsized":"2023-12-20T04:53:05.843540+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:23:25.113166+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1b","version":"185'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049428+0000","last_change":"2023-12-20T04:53:04.505222+0000","last_active":"2023-12-20T04:53:06.049428+0000","last_peered":"2023-12-20T04:53:06.049428+0000","last_clean":"2023-12-20T04:53:06.049428+0000","last_became_active":"2023-12-20T04:53:04.504672+0000","last_became_peered":"2023-12-20T04:53:04.504672+0000","last_unstale":"2023-12-20T04:53:06.049428+0000","last_undegraded":"2023-12-20T04:53:06.049428+0000","last_fullsized":"2023-12-20T04:53:06.049428+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:34:37.856782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.1b","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048440+0000","last_change":"2023-12-20T04:53:04.854417+0000","last_active":"2023-12-20T04:53:06.048440+0000","last_peered":"2023-12-20T04:53:06.048440+0000","last_clean":"2023-12-20T04:53:06.048440+0000","last_became_active":"2023-12-20T04:53:04.853735+0000","last_became_peered":"2023-12-20T04:53:04.853735+0000","last_unstale":"2023-12-20T04:53:06.048440+0000","last_undegraded":"2023-12-20T04:53:06.048440+0000","last_fullsized":"2023-12-20T04:53:06.048440+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:31:53.662833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.1a","version":"185'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048625+0000","last_change":"2023-12-20T04:53:04.503561+0000","last_active":"2023-12-20T04:53:06.048625+0000","last_peered":"2023-12-20T04:53:06.048625+0000","last_clean":"2023-12-20T04:53:06.048625+0000","last_became_active":"2023-12-20T04:53:04.503320+0000","last_became_peered":"2023-12-20T04:53:04.503320+0000","last_unstale":"2023-12-20T04:53:06.048625+0000","last_undegraded":"2023-12-20T04:53:06.048625+0000","last_fullsized":"2023-12-20T04:53:06.048625+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:11:14.375726+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.18","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048729+0000","last_change":"2023-12-20T04:53:04.850834+0000","last_active":"2023-12-20T04:53:06.048729+0000","last_peered":"2023-12-20T04:53:06.048729+0000","last_clean":"2023-12-20T04:53:06.048729+0000","last_became_active":"2023-12-20T04:53:04.850629+0000","last_became_peered":"2023-12-20T04:53:04.850629+0000","last_unstale":"2023-12-20T04:53:06.048729+0000","last_undegraded":"2023-12-20T04:53:06.048729+0000","last_fullsized":"2023-12-20T04:53:06.048729+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:06:50.325153+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.19","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049225+0000","last_change":"2023-12-20T04:53:04.505637+0000","last_active":"2023-12-20T04:53:06.049225+0000","last_peered":"2023-12-20T04:53:06.049225+0000","last_clean":"2023-12-20T04:53:06.049225+0000","last_became_active":"2023-12-20T04:53:04.505142+0000","last_became_peered":"2023-12-20T04:53:04.505142+0000","last_unstale":"2023-12-20T04:53:06.049225+0000","last_undegraded":"2023-12-20T04:53:06.049225+0000","last_fullsized":"2023-12-20T04:53:06.049225+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:52:07.227219+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.19","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048898+0000","last_change":"2023-12-20T04:53:04.845336+0000","last_active":"2023-12-20T04:53:06.048898+0000","last_peered":"2023-12-20T04:53:06.048898+0000","last_clean":"2023-12-20T04:53:06.048898+0000","last_became_active":"2023-12-20T04:53:04.845126+0000","last_became_peered":"2023-12-20T04:53:04.845126+0000","last_unstale":"2023-12-20T04:53:06.048898+0000","last_undegraded":"2023-12-20T04:53:06.048898+0000","last_fullsized":"2023-12-20T04:53:06.048898+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:03:55.171331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.18","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843694+0000","last_change":"2023-12-20T04:53:04.502366+0000","last_active":"2023-12-20T04:53:05.843694+0000","last_peered":"2023-12-20T04:53:05.843694+0000","last_clean":"2023-12-20T04:53:05.843694+0000","last_became_active":"2023-12-20T04:53:04.502163+0000","last_became_peered":"2023-12-20T04:53:04.502163+0000","last_unstale":"2023-12-20T04:53:05.843694+0000","last_undegraded":"2023-12-20T04:53:05.843694+0000","last_fullsized":"2023-12-20T04:53:05.843694+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:00:30.874432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"23.17","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845015+0000","last_change":"2023-12-20T04:53:04.852508+0000","last_active":"2023-12-20T04:53:05.845015+0000","last_peered":"2023-12-20T04:53:05.845015+0000","last_clean":"2023-12-20T04:53:05.845015+0000","last_became_active":"2023-12-20T04:53:04.852297+0000","last_became_peered":"2023-12-20T04:53:04.852297+0000","last_unstale":"2023-12-20T04:53:05.845015+0000","last_undegraded":"2023-12-20T04:53:05.845015+0000","last_fullsized":"2023-12-20T04:53:05.845015+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:00:31.881948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.16","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048840+0000","last_change":"2023-12-20T04:53:04.511872+0000","last_active":"2023-12-20T04:53:06.048840+0000","last_peered":"2023-12-20T04:53:06.048840+0000","last_clean":"2023-12-20T04:53:06.048840+0000","last_became_active":"2023-12-20T04:53:04.511662+0000","last_became_peered":"2023-12-20T04:53:04.511662+0000","last_unstale":"2023-12-20T04:53:06.048840+0000","last_undegraded":"2023-12-20T04:53:06.048840+0000","last_fullsized":"2023-12-20T04:53:06.048840+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:28:26.852900+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.14","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.844972+0000","last_change":"2023-12-20T04:53:04.852028+0000","last_active":"2023-12-20T04:53:05.844972+0000","last_peered":"2023-12-20T04:53:05.844972+0000","last_clean":"2023-12-20T04:53:05.844972+0000","last_became_active":"2023-12-20T04:53:04.851790+0000","last_became_peered":"2023-12-20T04:53:04.851790+0000","last_unstale":"2023-12-20T04:53:05.844972+0000","last_undegraded":"2023-12-20T04:53:05.844972+0000","last_fullsized":"2023-12-20T04:53:05.844972+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T14:40:07.703896+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.15","version":"185'3","reported_seq":14,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048953+0000","last_change":"2023-12-20T04:53:04.505835+0000","last_active":"2023-12-20T04:53:06.048953+0000","last_peered":"2023-12-20T04:53:06.048953+0000","last_clean":"2023-12-20T04:53:06.048953+0000","last_became_active":"2023-12-20T04:53:04.505608+0000","last_became_peered":"2023-12-20T04:53:04.505608+0000","last_unstale":"2023-12-20T04:53:06.048953+0000","last_undegraded":"2023-12-20T04:53:06.048953+0000","last_fullsized":"2023-12-20T04:53:06.048953+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:48:16.623311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"23.15","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.050024+0000","last_change":"2023-12-20T04:53:04.850246+0000","last_active":"2023-12-20T04:53:06.050024+0000","last_peered":"2023-12-20T04:53:06.050024+0000","last_clean":"2023-12-20T04:53:06.050024+0000","last_became_active":"2023-12-20T04:53:04.849997+0000","last_became_peered":"2023-12-20T04:53:04.849997+0000","last_unstale":"2023-12-20T04:53:06.050024+0000","last_undegraded":"2023-12-20T04:53:06.050024+0000","last_fullsized":"2023-12-20T04:53:06.050024+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:14:54.610746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.14","version":"185'6","reported_seq":17,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049024+0000","last_change":"2023-12-20T04:53:04.505200+0000","last_active":"2023-12-20T04:53:06.049024+0000","last_peered":"2023-12-20T04:53:06.049024+0000","last_clean":"2023-12-20T04:53:06.049024+0000","last_became_active":"2023-12-20T04:53:04.504966+0000","last_became_peered":"2023-12-20T04:53:04.504966+0000","last_unstale":"2023-12-20T04:53:06.049024+0000","last_undegraded":"2023-12-20T04:53:06.049024+0000","last_fullsized":"2023-12-20T04:53:06.049024+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:44:23.022262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1564,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.12","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845115+0000","last_change":"2023-12-20T04:53:04.848589+0000","last_active":"2023-12-20T04:53:05.845115+0000","last_peered":"2023-12-20T04:53:05.845115+0000","last_clean":"2023-12-20T04:53:05.845115+0000","last_became_active":"2023-12-20T04:53:04.848377+0000","last_became_peered":"2023-12-20T04:53:04.848377+0000","last_unstale":"2023-12-20T04:53:05.845115+0000","last_undegraded":"2023-12-20T04:53:05.845115+0000","last_fullsized":"2023-12-20T04:53:05.845115+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:56:18.000382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.13","version":"185'2","reported_seq":13,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048966+0000","last_change":"2023-12-20T04:53:04.507791+0000","last_active":"2023-12-20T04:53:06.048966+0000","last_peered":"2023-12-20T04:53:06.048966+0000","last_clean":"2023-12-20T04:53:06.048966+0000","last_became_active":"2023-12-20T04:53:04.507551+0000","last_became_peered":"2023-12-20T04:53:04.507551+0000","last_unstale":"2023-12-20T04:53:06.048966+0000","last_undegraded":"2023-12-20T04:53:06.048966+0000","last_fullsized":"2023-12-20T04:53:06.048966+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:50.046765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.13","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843608+0000","last_change":"2023-12-20T04:53:04.847889+0000","last_active":"2023-12-20T04:53:05.843608+0000","last_peered":"2023-12-20T04:53:05.843608+0000","last_clean":"2023-12-20T04:53:05.843608+0000","last_became_active":"2023-12-20T04:53:04.846786+0000","last_became_peered":"2023-12-20T04:53:04.846786+0000","last_unstale":"2023-12-20T04:53:05.843608+0000","last_undegraded":"2023-12-20T04:53:05.843608+0000","last_fullsized":"2023-12-20T04:53:05.843608+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:22:34.527782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.12","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845241+0000","last_change":"2023-12-20T04:53:04.505891+0000","last_active":"2023-12-20T04:53:05.845241+0000","last_peered":"2023-12-20T04:53:05.845241+0000","last_clean":"2023-12-20T04:53:05.845241+0000","last_became_active":"2023-12-20T04:53:04.505680+0000","last_became_peered":"2023-12-20T04:53:04.505680+0000","last_unstale":"2023-12-20T04:53:05.845241+0000","last_undegraded":"2023-12-20T04:53:05.845241+0000","last_fullsized":"2023-12-20T04:53:05.845241+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:28:24.978847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.10","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048385+0000","last_change":"2023-12-20T04:53:04.855789+0000","last_active":"2023-12-20T04:53:06.048385+0000","last_peered":"2023-12-20T04:53:06.048385+0000","last_clean":"2023-12-20T04:53:06.048385+0000","last_became_active":"2023-12-20T04:53:04.855567+0000","last_became_peered":"2023-12-20T04:53:04.855567+0000","last_unstale":"2023-12-20T04:53:06.048385+0000","last_undegraded":"2023-12-20T04:53:06.048385+0000","last_fullsized":"2023-12-20T04:53:06.048385+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:40:36.041473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.11","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048701+0000","last_change":"2023-12-20T04:53:04.510128+0000","last_active":"2023-12-20T04:53:06.048701+0000","last_peered":"2023-12-20T04:53:06.048701+0000","last_clean":"2023-12-20T04:53:06.048701+0000","last_became_active":"2023-12-20T04:53:04.509922+0000","last_became_peered":"2023-12-20T04:53:04.509922+0000","last_unstale":"2023-12-20T04:53:06.048701+0000","last_undegraded":"2023-12-20T04:53:06.048701+0000","last_fullsized":"2023-12-20T04:53:06.048701+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:09:44.918628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.11","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049271+0000","last_change":"2023-12-20T04:53:04.848988+0000","last_active":"2023-12-20T04:53:06.049271+0000","last_peered":"2023-12-20T04:53:06.049271+0000","last_clean":"2023-12-20T04:53:06.049271+0000","last_became_active":"2023-12-20T04:53:04.848761+0000","last_became_peered":"2023-12-20T04:53:04.848761+0000","last_unstale":"2023-12-20T04:53:06.049271+0000","last_undegraded":"2023-12-20T04:53:06.049271+0000","last_fullsized":"2023-12-20T04:53:06.049271+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:02:48.609557+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.10","version":"185'8","reported_seq":19,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.050163+0000","last_change":"2023-12-20T04:53:04.506209+0000","last_active":"2023-12-20T04:53:06.050163+0000","last_peered":"2023-12-20T04:53:06.050163+0000","last_clean":"2023-12-20T04:53:06.050163+0000","last_became_active":"2023-12-20T04:53:04.506003+0000","last_became_peered":"2023-12-20T04:53:04.506003+0000","last_unstale":"2023-12-20T04:53:06.050163+0000","last_undegraded":"2023-12-20T04:53:06.050163+0000","last_fullsized":"2023-12-20T04:53:06.050163+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:09:44.918628+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.e","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048875+0000","last_change":"2023-12-20T04:53:04.854135+0000","last_active":"2023-12-20T04:53:06.048875+0000","last_peered":"2023-12-20T04:53:06.048875+0000","last_clean":"2023-12-20T04:53:06.048875+0000","last_became_active":"2023-12-20T04:53:04.852900+0000","last_became_peered":"2023-12-20T04:53:04.852900+0000","last_unstale":"2023-12-20T04:53:06.048875+0000","last_undegraded":"2023-12-20T04:53:06.048875+0000","last_fullsized":"2023-12-20T04:53:06.048875+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:14:54.610746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.f","version":"185'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049331+0000","last_change":"2023-12-20T04:53:04.511750+0000","last_active":"2023-12-20T04:53:06.049331+0000","last_peered":"2023-12-20T04:53:06.049331+0000","last_clean":"2023-12-20T04:53:06.049331+0000","last_became_active":"2023-12-20T04:53:04.511531+0000","last_became_peered":"2023-12-20T04:53:04.511531+0000","last_unstale":"2023-12-20T04:53:06.049331+0000","last_undegraded":"2023-12-20T04:53:06.049331+0000","last_fullsized":"2023-12-20T04:53:06.049331+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T12:54:49.167920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.f","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845055+0000","last_change":"2023-12-20T04:53:04.847785+0000","last_active":"2023-12-20T04:53:05.845055+0000","last_peered":"2023-12-20T04:53:05.845055+0000","last_clean":"2023-12-20T04:53:05.845055+0000","last_became_active":"2023-12-20T04:53:04.847230+0000","last_became_peered":"2023-12-20T04:53:04.847230+0000","last_unstale":"2023-12-20T04:53:05.845055+0000","last_undegraded":"2023-12-20T04:53:05.845055+0000","last_fullsized":"2023-12-20T04:53:05.845055+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:07:12.533795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.e","version":"185'2","reported_seq":13,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049732+0000","last_change":"2023-12-20T04:53:04.507093+0000","last_active":"2023-12-20T04:53:06.049732+0000","last_peered":"2023-12-20T04:53:06.049732+0000","last_clean":"2023-12-20T04:53:06.049732+0000","last_became_active":"2023-12-20T04:53:04.506411+0000","last_became_peered":"2023-12-20T04:53:04.506411+0000","last_unstale":"2023-12-20T04:53:06.049732+0000","last_undegraded":"2023-12-20T04:53:06.049732+0000","last_fullsized":"2023-12-20T04:53:06.049732+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:47:36.460519+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.c","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048621+0000","last_change":"2023-12-20T04:53:04.855232+0000","last_active":"2023-12-20T04:53:06.048621+0000","last_peered":"2023-12-20T04:53:06.048621+0000","last_clean":"2023-12-20T04:53:06.048621+0000","last_became_active":"2023-12-20T04:53:04.853995+0000","last_became_peered":"2023-12-20T04:53:04.853995+0000","last_unstale":"2023-12-20T04:53:06.048621+0000","last_undegraded":"2023-12-20T04:53:06.048621+0000","last_fullsized":"2023-12-20T04:53:06.048621+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:05:55.398320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"22.d","version":"185'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.844183+0000","last_change":"2023-12-20T04:53:04.510687+0000","last_active":"2023-12-20T04:53:05.844183+0000","last_peered":"2023-12-20T04:53:05.844183+0000","last_clean":"2023-12-20T04:53:05.844183+0000","last_became_active":"2023-12-20T04:53:04.509210+0000","last_became_peered":"2023-12-20T04:53:04.509210+0000","last_unstale":"2023-12-20T04:53:05.844183+0000","last_undegraded":"2023-12-20T04:53:05.844183+0000","last_fullsized":"2023-12-20T04:53:05.844183+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:34:15.067323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.d","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843789+0000","last_change":"2023-12-20T04:53:04.845347+0000","last_active":"2023-12-20T04:53:05.843789+0000","last_peered":"2023-12-20T04:53:05.843789+0000","last_clean":"2023-12-20T04:53:05.843789+0000","last_became_active":"2023-12-20T04:53:04.845128+0000","last_became_peered":"2023-12-20T04:53:04.845128+0000","last_unstale":"2023-12-20T04:53:05.843789+0000","last_undegraded":"2023-12-20T04:53:05.843789+0000","last_fullsized":"2023-12-20T04:53:05.843789+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:23:30.869082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.c","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843887+0000","last_change":"2023-12-20T04:53:04.509254+0000","last_active":"2023-12-20T04:53:05.843887+0000","last_peered":"2023-12-20T04:53:05.843887+0000","last_clean":"2023-12-20T04:53:05.843887+0000","last_became_active":"2023-12-20T04:53:04.509030+0000","last_became_peered":"2023-12-20T04:53:04.509030+0000","last_unstale":"2023-12-20T04:53:05.843887+0000","last_undegraded":"2023-12-20T04:53:05.843887+0000","last_fullsized":"2023-12-20T04:53:05.843887+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T10:35:11.325106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.a","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049238+0000","last_change":"2023-12-20T04:53:04.848638+0000","last_active":"2023-12-20T04:53:06.049238+0000","last_peered":"2023-12-20T04:53:06.049238+0000","last_clean":"2023-12-20T04:53:06.049238+0000","last_became_active":"2023-12-20T04:53:04.848427+0000","last_became_peered":"2023-12-20T04:53:04.848427+0000","last_unstale":"2023-12-20T04:53:06.049238+0000","last_undegraded":"2023-12-20T04:53:06.049238+0000","last_fullsized":"2023-12-20T04:53:06.049238+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:13:52.806515+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.b","version":"185'2","reported_seq":13,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048713+0000","last_change":"2023-12-20T04:53:04.509911+0000","last_active":"2023-12-20T04:53:06.048713+0000","last_peered":"2023-12-20T04:53:06.048713+0000","last_clean":"2023-12-20T04:53:06.048713+0000","last_became_active":"2023-12-20T04:53:04.509706+0000","last_became_peered":"2023-12-20T04:53:04.509706+0000","last_unstale":"2023-12-20T04:53:06.048713+0000","last_undegraded":"2023-12-20T04:53:06.048713+0000","last_fullsized":"2023-12-20T04:53:06.048713+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:55:31.799146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.b","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843597+0000","last_change":"2023-12-20T04:53:04.851431+0000","last_active":"2023-12-20T04:53:05.843597+0000","last_peered":"2023-12-20T04:53:05.843597+0000","last_clean":"2023-12-20T04:53:05.843597+0000","last_became_active":"2023-12-20T04:53:04.851223+0000","last_became_peered":"2023-12-20T04:53:04.851223+0000","last_unstale":"2023-12-20T04:53:05.843597+0000","last_undegraded":"2023-12-20T04:53:05.843597+0000","last_fullsized":"2023-12-20T04:53:05.843597+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:28:26.363143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.a","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.844007+0000","last_change":"2023-12-20T04:53:04.508116+0000","last_active":"2023-12-20T04:53:05.844007+0000","last_peered":"2023-12-20T04:53:05.844007+0000","last_clean":"2023-12-20T04:53:05.844007+0000","last_became_active":"2023-12-20T04:53:04.507842+0000","last_became_peered":"2023-12-20T04:53:04.507842+0000","last_unstale":"2023-12-20T04:53:05.844007+0000","last_undegraded":"2023-12-20T04:53:05.844007+0000","last_fullsized":"2023-12-20T04:53:05.844007+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:36:20.654691+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.8","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843987+0000","last_change":"2023-12-20T04:53:04.853131+0000","last_active":"2023-12-20T04:53:05.843987+0000","last_peered":"2023-12-20T04:53:05.843987+0000","last_clean":"2023-12-20T04:53:05.843987+0000","last_became_active":"2023-12-20T04:53:04.852900+0000","last_became_peered":"2023-12-20T04:53:04.852900+0000","last_unstale":"2023-12-20T04:53:05.843987+0000","last_undegraded":"2023-12-20T04:53:05.843987+0000","last_fullsized":"2023-12-20T04:53:05.843987+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:22:09.986281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"22.9","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049004+0000","last_change":"2023-12-20T04:53:04.511776+0000","last_active":"2023-12-20T04:53:06.049004+0000","last_peered":"2023-12-20T04:53:06.049004+0000","last_clean":"2023-12-20T04:53:06.049004+0000","last_became_active":"2023-12-20T04:53:04.511520+0000","last_became_peered":"2023-12-20T04:53:04.511520+0000","last_unstale":"2023-12-20T04:53:06.049004+0000","last_undegraded":"2023-12-20T04:53:06.049004+0000","last_fullsized":"2023-12-20T04:53:06.049004+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:44:58.923478+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.9","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048682+0000","last_change":"2023-12-20T04:53:04.849441+0000","last_active":"2023-12-20T04:53:06.048682+0000","last_peered":"2023-12-20T04:53:06.048682+0000","last_clean":"2023-12-20T04:53:06.048682+0000","last_became_active":"2023-12-20T04:53:04.849190+0000","last_became_peered":"2023-12-20T04:53:04.849190+0000","last_unstale":"2023-12-20T04:53:06.048682+0000","last_undegraded":"2023-12-20T04:53:06.048682+0000","last_fullsized":"2023-12-20T04:53:06.048682+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T06:39:53.163372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.8","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.844257+0000","last_change":"2023-12-20T04:53:04.510862+0000","last_active":"2023-12-20T04:53:05.844257+0000","last_peered":"2023-12-20T04:53:05.844257+0000","last_clean":"2023-12-20T04:53:05.844257+0000","last_became_active":"2023-12-20T04:53:04.510097+0000","last_became_peered":"2023-12-20T04:53:04.510097+0000","last_unstale":"2023-12-20T04:53:05.844257+0000","last_undegraded":"2023-12-20T04:53:05.844257+0000","last_fullsized":"2023-12-20T04:53:05.844257+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:59:51.314369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"23.6","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845219+0000","last_change":"2023-12-20T04:53:04.851053+0000","last_active":"2023-12-20T04:53:05.845219+0000","last_peered":"2023-12-20T04:53:05.845219+0000","last_clean":"2023-12-20T04:53:05.845219+0000","last_became_active":"2023-12-20T04:53:04.850674+0000","last_became_peered":"2023-12-20T04:53:04.850674+0000","last_unstale":"2023-12-20T04:53:05.845219+0000","last_undegraded":"2023-12-20T04:53:05.845219+0000","last_fullsized":"2023-12-20T04:53:05.845219+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:03:03.009432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.7","version":"185'2","reported_seq":13,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845297+0000","last_change":"2023-12-20T04:53:04.508697+0000","last_active":"2023-12-20T04:53:05.845297+0000","last_peered":"2023-12-20T04:53:05.845297+0000","last_clean":"2023-12-20T04:53:05.845297+0000","last_became_active":"2023-12-20T04:53:04.508498+0000","last_became_peered":"2023-12-20T04:53:04.508498+0000","last_unstale":"2023-12-20T04:53:05.845297+0000","last_undegraded":"2023-12-20T04:53:05.845297+0000","last_fullsized":"2023-12-20T04:53:05.845297+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T07:22:08.538258+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.7","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843877+0000","last_change":"2023-12-20T04:53:04.857466+0000","last_active":"2023-12-20T04:53:05.843877+0000","last_peered":"2023-12-20T04:53:05.843877+0000","last_clean":"2023-12-20T04:53:05.843877+0000","last_became_active":"2023-12-20T04:53:04.857027+0000","last_became_peered":"2023-12-20T04:53:04.857027+0000","last_unstale":"2023-12-20T04:53:05.843877+0000","last_undegraded":"2023-12-20T04:53:05.843877+0000","last_fullsized":"2023-12-20T04:53:05.843877+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:32:46.780328+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.6","version":"185'1","reported_seq":12,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049711+0000","last_change":"2023-12-20T04:53:04.506056+0000","last_active":"2023-12-20T04:53:06.049711+0000","last_peered":"2023-12-20T04:53:06.049711+0000","last_clean":"2023-12-20T04:53:06.049711+0000","last_became_active":"2023-12-20T04:53:04.504233+0000","last_became_peered":"2023-12-20T04:53:04.504233+0000","last_unstale":"2023-12-20T04:53:06.049711+0000","last_undegraded":"2023-12-20T04:53:06.049711+0000","last_fullsized":"2023-12-20T04:53:06.049711+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T11:12:16.046112+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"23.4","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048778+0000","last_change":"2023-12-20T04:53:04.849956+0000","last_active":"2023-12-20T04:53:06.048778+0000","last_peered":"2023-12-20T04:53:06.048778+0000","last_clean":"2023-12-20T04:53:06.048778+0000","last_became_active":"2023-12-20T04:53:04.849667+0000","last_became_peered":"2023-12-20T04:53:04.849667+0000","last_unstale":"2023-12-20T04:53:06.048778+0000","last_undegraded":"2023-12-20T04:53:06.048778+0000","last_fullsized":"2023-12-20T04:53:06.048778+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:31:03.740412+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"22.5","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049547+0000","last_change":"2023-12-20T04:53:04.505779+0000","last_active":"2023-12-20T04:53:06.049547+0000","last_peered":"2023-12-20T04:53:06.049547+0000","last_clean":"2023-12-20T04:53:06.049547+0000","last_became_active":"2023-12-20T04:53:04.505422+0000","last_became_peered":"2023-12-20T04:53:04.505422+0000","last_unstale":"2023-12-20T04:53:06.049547+0000","last_undegraded":"2023-12-20T04:53:06.049547+0000","last_fullsized":"2023-12-20T04:53:06.049547+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T05:12:57.302064+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.5","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845144+0000","last_change":"2023-12-20T04:53:04.850039+0000","last_active":"2023-12-20T04:53:05.845144+0000","last_peered":"2023-12-20T04:53:05.845144+0000","last_clean":"2023-12-20T04:53:05.845144+0000","last_became_active":"2023-12-20T04:53:04.849843+0000","last_became_peered":"2023-12-20T04:53:04.849843+0000","last_unstale":"2023-12-20T04:53:05.845144+0000","last_undegraded":"2023-12-20T04:53:05.845144+0000","last_fullsized":"2023-12-20T04:53:05.845144+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T13:40:36.041473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.4","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845168+0000","last_change":"2023-12-20T04:53:04.508621+0000","last_active":"2023-12-20T04:53:05.845168+0000","last_peered":"2023-12-20T04:53:05.845168+0000","last_clean":"2023-12-20T04:53:05.845168+0000","last_became_active":"2023-12-20T04:53:04.508328+0000","last_became_peered":"2023-12-20T04:53:04.508328+0000","last_unstale":"2023-12-20T04:53:05.845168+0000","last_undegraded":"2023-12-20T04:53:05.845168+0000","last_fullsized":"2023-12-20T04:53:05.845168+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T08:05:15.306707+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"23.2","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845223+0000","last_change":"2023-12-20T04:53:04.852859+0000","last_active":"2023-12-20T04:53:05.845223+0000","last_peered":"2023-12-20T04:53:05.845223+0000","last_clean":"2023-12-20T04:53:05.845223+0000","last_became_active":"2023-12-20T04:53:04.852222+0000","last_became_peered":"2023-12-20T04:53:04.852222+0000","last_unstale":"2023-12-20T04:53:05.845223+0000","last_undegraded":"2023-12-20T04:53:05.845223+0000","last_fullsized":"2023-12-20T04:53:05.845223+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:26:43.712317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.3","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.050223+0000","last_change":"2023-12-20T04:53:04.503956+0000","last_active":"2023-12-20T04:53:06.050223+0000","last_peered":"2023-12-20T04:53:06.050223+0000","last_clean":"2023-12-20T04:53:06.050223+0000","last_became_active":"2023-12-20T04:53:04.503738+0000","last_became_peered":"2023-12-20T04:53:04.503738+0000","last_unstale":"2023-12-20T04:53:06.050223+0000","last_undegraded":"2023-12-20T04:53:06.050223+0000","last_fullsized":"2023-12-20T04:53:06.050223+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:55:31.799146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.3","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.050044+0000","last_change":"2023-12-20T04:53:04.847024+0000","last_active":"2023-12-20T04:53:06.050044+0000","last_peered":"2023-12-20T04:53:06.050044+0000","last_clean":"2023-12-20T04:53:06.050044+0000","last_became_active":"2023-12-20T04:53:04.846321+0000","last_became_peered":"2023-12-20T04:53:04.846321+0000","last_unstale":"2023-12-20T04:53:06.050044+0000","last_undegraded":"2023-12-20T04:53:06.050044+0000","last_fullsized":"2023-12-20T04:53:06.050044+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:39:39.946891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"22.2","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.048779+0000","last_change":"2023-12-20T04:53:04.509231+0000","last_active":"2023-12-20T04:53:06.048779+0000","last_peered":"2023-12-20T04:53:06.048779+0000","last_clean":"2023-12-20T04:53:06.048779+0000","last_became_active":"2023-12-20T04:53:04.508985+0000","last_became_peered":"2023-12-20T04:53:04.508985+0000","last_unstale":"2023-12-20T04:53:06.048779+0000","last_undegraded":"2023-12-20T04:53:06.048779+0000","last_fullsized":"2023-12-20T04:53:06.048779+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:59:48.494033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"23.0","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.843620+0000","last_change":"2023-12-20T04:53:04.853655+0000","last_active":"2023-12-20T04:53:05.843620+0000","last_peered":"2023-12-20T04:53:05.843620+0000","last_clean":"2023-12-20T04:53:05.843620+0000","last_became_active":"2023-12-20T04:53:04.853441+0000","last_became_peered":"2023-12-20T04:53:04.853441+0000","last_unstale":"2023-12-20T04:53:05.843620+0000","last_undegraded":"2023-12-20T04:53:05.843620+0000","last_fullsized":"2023-12-20T04:53:05.843620+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:40:26.687658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"22.1","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049843+0000","last_change":"2023-12-20T04:53:04.509865+0000","last_active":"2023-12-20T04:53:06.049843+0000","last_peered":"2023-12-20T04:53:06.049843+0000","last_clean":"2023-12-20T04:53:06.049843+0000","last_became_active":"2023-12-20T04:53:04.509639+0000","last_became_peered":"2023-12-20T04:53:04.509639+0000","last_unstale":"2023-12-20T04:53:06.049843+0000","last_undegraded":"2023-12-20T04:53:06.049843+0000","last_fullsized":"2023-12-20T04:53:06.049843+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:48:49.105756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"23.1","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049428+0000","last_change":"2023-12-20T04:53:04.850347+0000","last_active":"2023-12-20T04:53:06.049428+0000","last_peered":"2023-12-20T04:53:06.049428+0000","last_clean":"2023-12-20T04:53:06.049428+0000","last_became_active":"2023-12-20T04:53:04.850023+0000","last_became_peered":"2023-12-20T04:53:04.850023+0000","last_unstale":"2023-12-20T04:53:06.049428+0000","last_undegraded":"2023-12-20T04:53:06.049428+0000","last_fullsized":"2023-12-20T04:53:06.049428+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:48:50.113272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"22.0","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.049201+0000","last_change":"2023-12-20T04:53:04.507946+0000","last_active":"2023-12-20T04:53:06.049201+0000","last_peered":"2023-12-20T04:53:06.049201+0000","last_clean":"2023-12-20T04:53:06.049201+0000","last_became_active":"2023-12-20T04:53:04.507741+0000","last_became_peered":"2023-12-20T04:53:04.507741+0000","last_unstale":"2023-12-20T04:53:06.049201+0000","last_undegraded":"2023-12-20T04:53:06.049201+0000","last_fullsized":"2023-12-20T04:53:06.049201+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T09:49:50.046765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"23.16","version":"0'0","reported_seq":10,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:05.845073+0000","last_change":"2023-12-20T04:53:04.852989+0000","last_active":"2023-12-20T04:53:05.845073+0000","last_peered":"2023-12-20T04:53:05.845073+0000","last_clean":"2023-12-20T04:53:05.845073+0000","last_became_active":"2023-12-20T04:53:04.852524+0000","last_became_peered":"2023-12-20T04:53:04.852524+0000","last_unstale":"2023-12-20T04:53:05.845073+0000","last_undegraded":"2023-12-20T04:53:05.845073+0000","last_fullsized":"2023-12-20T04:53:05.845073+0000","mapping_epoch":184,"log_start":"0'0","ondisk_log_start":"0'0","created":184,"last_epoch_clean":185,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:04.492518+0000","last_clean_scrub_stamp":"2023-12-20T04:53:04.492518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:22:09.986281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"22.17","version":"0'0","reported_seq":11,"reported_epoch":186,"state":"active+clean","last_fresh":"2023-12-20T04:53:06.050136+0000","last_change":"2023-12-20T04:53:04.506756+0000","last_active":"2023-12-20T04:53:06.050136+0000","last_peered":"2023-12-20T04:53:06.050136+0000","last_clean":"2023-12-20T04:53:06.050136+0000","last_became_active":"2023-12-20T04:53:04.506529+0000","last_became_peered":"2023-12-20T04:53:04.506529+0000","last_unstale":"2023-12-20T04:53:06.050136+0000","last_undegraded":"2023-12-20T04:53:06.050136+0000","last_fullsized":"2023-12-20T04:53:06.050136+0000","mapping_epoch":183,"log_start":"0'0","ondisk_log_start":"0'0","created":183,"last_epoch_clean":184,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:53:03.485002+0000","last_clean_scrub_stamp":"2023-12-20T04:53:03.485002+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T16:50:32.357538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":310,"reported_epoch":185,"state":"active+clean","last_fresh":"2023-12-20T04:53:04.847275+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:53:04.847275+0000","last_peered":"2023-12-20T04:53:04.847275+0000","last_clean":"2023-12-20T04:53:04.847275+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:53:04.847275+0000","last_undegraded":"2023-12-20T04:53:04.847275+0000","last_fullsized":"2023-12-20T04:53:04.847275+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":23,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":0},{"poolid":22,"num_pg":32,"stat_sum":{"num_bytes":2362,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":45,"num_write_kb":14,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":39,"ondisk_log_size":39,"up":64,"acting":64,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574976,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1597,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193714,"statfs":{"total":200000000,"available":198363724,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.43099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70299999999999996,"5min":0.77700000000000002,"15min":1.0860000000000001},"last":0.64400000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.25600000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.86299999999999999},"last":0.67200000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.33100000000000002,"15min":0.26900000000000002},"max":{"1min":0.71699999999999997,"5min":0.76500000000000001,"15min":0.98799999999999999},"last":0.51400000000000001},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.45700000000000002,"5min":0.376,"15min":0.374},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":1.0269999999999999},"last":0.72099999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.375,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65100000000000002,"5min":0.75900000000000001,"15min":1.0069999999999999},"last":0.45000000000000001},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.47599999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67100000000000004,"5min":0.75700000000000001,"15min":0.78000000000000003},"last":0.54900000000000004}]},{"osd":3,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65800000000000003,"5min":0.78300000000000003,"15min":1.048},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.34599999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.79600000000000004}]},{"osd":4,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.46999999999999997,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.28499999999999998,"15min":0.26700000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.76600000000000001},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.89700000000000002},"last":0.61199999999999999}]},{"osd":5,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46300000000000002,"15min":0.47999999999999998},"min":{"1min":0.33600000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.70399999999999996,"5min":0.73099999999999998,"15min":0.73799999999999999},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51900000000000002,"15min":0.53100000000000003},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.78200000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51900000000000002,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.33300000000000002,"15min":0.32500000000000001},"max":{"1min":0.755,"5min":0.77800000000000002,"15min":0.89800000000000002},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.628}]}]},{"osd":6,"up_from":13,"seq":55834574977,"num_pgs":18,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962676,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55800000000000005,"15min":0.51900000000000002},"min":{"1min":0.36499999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.71099999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.51900000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56699999999999995,"15min":0.54600000000000004},"min":{"1min":0.40000000000000002,"5min":0.32100000000000001,"15min":0.30099999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.54300000000000004}]},{"osd":2,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55000000000000004,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.38200000000000001,"15min":0.27000000000000002},"max":{"1min":0.72599999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.376,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.50700000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.33700000000000002},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.77800000000000002},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.43099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.749,"5min":0.77200000000000002,"15min":0.78900000000000003},"last":0.47799999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.32100000000000001,"5min":0.313,"15min":0.28499999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.81899999999999995},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.374}]},{"osd":5,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49099999999999999,"15min":0.50700000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.755,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.438},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.54600000000000004},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.32000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.85499999999999998},"last":0.33100000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52900000000000003,"15min":0.54000000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.49299999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194298,"statfs":{"total":200000000,"available":198962094,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56499999999999995,"15min":0.53200000000000003},"min":{"1min":0.38200000000000001,"5min":0.32200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69099999999999995,"5min":0.747,"15min":0.748},"last":0.502},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58899999999999997,"15min":0.57199999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74299999999999999,"5min":0.78700000000000003,"15min":0.82299999999999995},"last":0.629}]},{"osd":1,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57299999999999995,"15min":0.55600000000000005},"min":{"1min":0.437,"5min":0.39800000000000002,"15min":0.26000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.82099999999999995},"last":0.47899999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.59099999999999997,"15min":0.58399999999999996},"min":{"1min":0.443,"5min":0.41799999999999998,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.84899999999999998},"last":0.71199999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53800000000000003,"15min":0.52300000000000002},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.28199999999999997},"max":{"1min":0.69399999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.438,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":0.76600000000000001,"15min":0.77100000000000002},"last":0.53100000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.42699999999999999,"5min":0.34699999999999998,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.80900000000000005},"last":0.68200000000000005},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.46500000000000002,"5min":0.38400000000000001,"15min":0.312},"max":{"1min":0.71199999999999997,"5min":0.74199999999999999,"15min":0.77400000000000002},"last":0.57799999999999996}]},{"osd":4,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.47999999999999998},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.249},"max":{"1min":0.68799999999999994,"5min":0.80400000000000005,"15min":0.81899999999999995},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.32900000000000001,"5min":0.29799999999999999,"15min":0.29399999999999998},"max":{"1min":0.64200000000000002,"5min":0.749,"15min":0.75700000000000001},"last":0.59099999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.48899999999999999},"min":{"1min":0.35799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.64900000000000002,"5min":0.75600000000000001,"15min":0.85299999999999998},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.50900000000000001,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33900000000000002,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.82599999999999996,"15min":0.83999999999999997},"last":0.752}]},{"osd":7,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.495,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66900000000000004,"5min":0.78400000000000003,"15min":0.79800000000000004},"last":0.66100000000000003},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.311,"15min":0.311},"max":{"1min":0.67800000000000005,"5min":0.77700000000000002,"15min":0.98599999999999999},"last":0.64900000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574976,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1014,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194297,"statfs":{"total":200000000,"available":198961064,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.46800000000000003,"5min":0.25700000000000001,"15min":0.19700000000000001},"max":{"1min":0.74199999999999999,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.251},"max":{"1min":0.76200000000000001,"5min":0.875,"15min":0.875},"last":0.55100000000000005}]},{"osd":1,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52500000000000002},"min":{"1min":0.41499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.69399999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.627,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.50800000000000001,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.77000000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.374}]},{"osd":2,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.316,"15min":0.313},"max":{"1min":0.73199999999999998,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.40400000000000003,"5min":0.33300000000000002,"15min":0.23400000000000001},"max":{"1min":0.69599999999999995,"5min":0.746,"15min":0.80400000000000005},"last":0.39900000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.56499999999999995},"min":{"1min":0.46000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.746,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.44800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.88800000000000001,"15min":0.91000000000000003},"last":0.496}]},{"osd":5,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46000000000000002,"15min":0.46300000000000002},"min":{"1min":0.314,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":0.68799999999999994,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.47099999999999997},{"interface":"front","average":{"1min":0.503,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.33800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60699999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.44700000000000001}]},{"osd":6,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38200000000000001,"5min":0.28799999999999998,"15min":0.26400000000000001},"max":{"1min":0.61399999999999999,"5min":0.73099999999999998,"15min":0.82399999999999995},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70399999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.53300000000000003}]},{"osd":7,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.34899999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69699999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.432,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78000000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.56399999999999995}]}]},{"osd":3,"up_from":13,"seq":55834574976,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1019,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194293,"statfs":{"total":200000000,"available":198956364,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.25600000000000001,"5min":0.19800000000000001,"15min":0.193},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.629},"last":0.253},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.36699999999999999},"min":{"1min":0.28399999999999997,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":0.54100000000000004,"5min":0.58199999999999996,"15min":0.64000000000000001},"last":0.33300000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.34300000000000003,"15min":0.33000000000000002},"min":{"1min":0.24299999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.499,"5min":0.62,"15min":0.62},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.36599999999999999,"15min":0.35099999999999998},"min":{"1min":0.29399999999999998,"5min":0.24099999999999999,"15min":0.20399999999999999},"max":{"1min":0.48199999999999998,"5min":0.55800000000000005,"15min":0.61699999999999999},"last":0.28599999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.35799999999999998,"15min":0.34999999999999998},"min":{"1min":0.253,"5min":0.22600000000000001,"15min":0.21199999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.64900000000000002},"last":0.35899999999999999},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.38600000000000001},"min":{"1min":0.32300000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52500000000000002,"5min":0.59399999999999997,"15min":0.63600000000000001},"last":0.32000000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.436,"5min":0.36599999999999999,"15min":0.35199999999999998},"max":{"1min":0.80200000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59099999999999997,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.60499999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.42299999999999999,"5min":0.40000000000000002,"15min":0.31},"max":{"1min":0.71299999999999997,"5min":0.82399999999999995,"15min":0.872},"last":0.628},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60599999999999998,"15min":0.57599999999999996},"min":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.878,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.68600000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60799999999999998,"15min":0.58899999999999997},"min":{"1min":0.442,"5min":0.375,"15min":0.33900000000000002},"max":{"1min":0.83899999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.63900000000000001},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.37},"max":{"1min":0.75600000000000001,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.70599999999999996}]},{"osd":7,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.38500000000000001},"max":{"1min":0.82799999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.623,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79200000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.73199999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574976,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962608,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34899999999999998,"15min":0.32200000000000001},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.45300000000000001,"5min":0.57299999999999995,"15min":0.72699999999999998},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.39600000000000002,"15min":0.37},"min":{"1min":0.28399999999999997,"5min":0.27500000000000002,"15min":0.17699999999999999},"max":{"1min":0.52000000000000002,"5min":0.54100000000000004,"15min":2.0539999999999998},"last":0.40799999999999997}]},{"osd":1,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.378,"15min":0.35099999999999998},"min":{"1min":0.23699999999999999,"5min":0.22600000000000001,"15min":0.17999999999999999},"max":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.83099999999999996},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.40300000000000002,"15min":0.372},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.20000000000000001},"max":{"1min":0.57099999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.46600000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.41399999999999998,"15min":0.38500000000000001},"min":{"1min":0.29799999999999999,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.56299999999999994,"5min":0.60399999999999998,"15min":0.995},"last":0.45600000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.41599999999999998,"15min":0.39100000000000001},"min":{"1min":0.308,"5min":0.218,"15min":0.218},"max":{"1min":0.57199999999999995,"5min":0.64400000000000002,"15min":0.76600000000000001},"last":0.44400000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.57899999999999996},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.32500000000000001},"max":{"1min":0.76900000000000002,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.38200000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83999999999999997,"5min":0.878,"15min":2.347},"last":0.54000000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":0.997},"last":0.61099999999999999},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59899999999999998,"15min":0.57099999999999995},"min":{"1min":0.45300000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.68799999999999994}]},{"osd":6,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60199999999999998,"15min":0.58699999999999997},"min":{"1min":0.46500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84999999999999998,"5min":0.877,"15min":2.274},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61299999999999999,"15min":0.58899999999999997},"min":{"1min":0.503,"5min":0.38,"15min":0.373},"max":{"1min":0.84599999999999997,"5min":0.89300000000000002,"15min":1.0289999999999999},"last":0.69499999999999995}]},{"osd":7,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.442,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85699999999999998,"5min":0.89800000000000002,"15min":2.3090000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.61699999999999999,"15min":0.59399999999999997},"min":{"1min":0.45200000000000001,"5min":0.40500000000000003,"15min":0.379},"max":{"1min":0.82299999999999995,"5min":0.873,"15min":1.0549999999999999},"last":0.627}]}]},{"osd":1,"up_from":13,"seq":55834574977,"num_pgs":8,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1013,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194299,"statfs":{"total":200000000,"available":198962664,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.314},"min":{"1min":0.23599999999999999,"5min":0.20899999999999999,"15min":0.16400000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.37},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38700000000000001,"15min":0.35299999999999998},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.22700000000000001},"max":{"1min":0.53600000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.316}]},{"osd":2,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.32900000000000001},"min":{"1min":0.24099999999999999,"5min":0.23000000000000001,"15min":0.19500000000000001},"max":{"1min":0.57899999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.40100000000000002,"15min":0.372},"min":{"1min":0.307,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":0.53700000000000003,"5min":0.57099999999999995,"15min":0.57299999999999995},"last":0.34300000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42199999999999999,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.191},"max":{"1min":0.60399999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.36399999999999999},"min":{"1min":0.28000000000000003,"5min":0.22500000000000001,"15min":0.20399999999999999},"max":{"1min":0.56499999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.27100000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60699999999999998,"15min":0.57499999999999996},"min":{"1min":0.498,"5min":0.35599999999999998,"15min":0.312},"max":{"1min":0.79100000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.90900000000000003,"15min":1.002},"last":0.53800000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.79200000000000004,"15min":0.86099999999999999},"last":0.505},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61099999999999999,"15min":0.56799999999999995},"min":{"1min":0.48199999999999998,"5min":0.38300000000000001,"15min":0.317},"max":{"1min":0.81599999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.623}]},{"osd":6,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60299999999999998,"15min":0.57399999999999995},"min":{"1min":0.51000000000000001,"5min":0.38300000000000001,"15min":0.36899999999999999},"max":{"1min":0.72099999999999997,"5min":0.92400000000000004,"15min":1.038},"last":0.58499999999999996},{"interface":"front","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.57899999999999996},"min":{"1min":0.45900000000000002,"5min":0.40600000000000003,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.52400000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64200000000000002,"15min":0.60899999999999999},"min":{"1min":0.52500000000000002,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.80600000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.59599999999999997},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64200000000000002,"15min":0.61599999999999999},"min":{"1min":0.52900000000000003,"5min":0.41899999999999998,"15min":0.376},"max":{"1min":0.82199999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.61299999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574976,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1595,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193716,"statfs":{"total":200000000,"available":198366030,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.32600000000000001},"min":{"1min":0.214,"5min":0.189,"15min":0.184},"max":{"1min":0.51700000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.35799999999999998,"15min":0.33300000000000002},"min":{"1min":0.20999999999999999,"5min":0.20699999999999999,"15min":0.184},"max":{"1min":0.57399999999999995,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.33800000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.376,"15min":0.36499999999999999},"min":{"1min":0.248,"5min":0.22800000000000001,"15min":0.218},"max":{"1min":0.55600000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38400000000000001,"15min":0.36199999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.23100000000000001},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.622},"last":0.27800000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.376,"15min":0.34599999999999997},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.58899999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.30299999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40699999999999997,"15min":0.38400000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27400000000000002},"max":{"1min":0.60799999999999998,"5min":0.625,"15min":0.625},"last":0.35499999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57499999999999996,"15min":0.54500000000000004},"min":{"1min":0.437,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.55400000000000005},"min":{"1min":0.46500000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74199999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.52700000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57399999999999995,"15min":0.54400000000000004},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":0.85999999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.62,"5min":0.59999999999999998,"15min":0.56899999999999995},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.86199999999999999},"last":0.66700000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61399999999999999,"15min":0.59699999999999998},"min":{"1min":0.49199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82499999999999996,"5min":0.88100000000000001,"15min":0.89600000000000002},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.62,"15min":0.59899999999999998},"min":{"1min":0.51100000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84599999999999997,"5min":0.89500000000000002,"15min":0.90000000000000002},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59999999999999998,"15min":0.57099999999999995},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.375},"max":{"1min":0.76400000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.58399999999999996},{"interface":"front","average":{"1min":0.629,"5min":0.60599999999999998,"15min":0.58599999999999997},"min":{"1min":0.48999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79800000000000004,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.56899999999999995}]}]}],"pool_statfs":[]}} 2023-12-20T04:53:08.781 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2023-12-20T04:53:08.781 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph auth caps client.0 mon 'allow r' osd 'allow rw tag cephfs data=cephfs' mds allow 2023-12-20T04:53:08.923 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.921+0000 7faa2d8e9640 1 Processor -- start 2023-12-20T04:53:08.924 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.922+0000 7faa2d8e9640 1 -- start start 2023-12-20T04:53:08.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.922+0000 7faa2d8e9640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7faa2815d300 0x7faa280d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:08.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.922+0000 7faa2d8e9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa280d2920 con 0x7faa280d17d0 2023-12-20T04:53:08.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.922+0000 7faa2d8e9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7faa280d1d10 con 0x7faa280cfea0 2023-12-20T04:53:08.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.922+0000 7faa2d8e9640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7faa280d1ff0 con 0x7faa2815d300 2023-12-20T04:53:08.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.923+0000 7faa267fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7faa280d17d0 0x7faa280cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:51234/0 (socket says 172.21.15.132:51234) 2023-12-20T04:53:08.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.923+0000 7faa267fc640 1 -- 172.21.15.132:0/2760581469 learned_addr learned my addr 172.21.15.132:0/2760581469 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:08.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.923+0000 7faa26ffd640 1 --2- 172.21.15.132:0/2760581469 >> v2:172.21.15.187:3300/0 conn(0x7faa2815d300 0x7faa280d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:08.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.923+0000 7faa25ffb640 1 -- 172.21.15.132:0/2760581469 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3849299859 0 0) 0x7faa280d2920 con 0x7faa280d17d0 2023-12-20T04:53:08.925 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.923+0000 7faa25ffb640 1 -- 172.21.15.132:0/2760581469 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7faa10003520 con 0x7faa280d17d0 2023-12-20T04:53:08.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.923+0000 7faa26ffd640 1 -- 172.21.15.132:0/2760581469 >> v1:172.21.15.187:6789/0 conn(0x7faa280cfea0 legacy=0x7faa280b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.923+0000 7faa26ffd640 1 -- 172.21.15.132:0/2760581469 >> v1:172.21.15.132:6789/0 conn(0x7faa280d17d0 legacy=0x7faa280cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.923+0000 7faa26ffd640 1 -- 172.21.15.132:0/2760581469 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa280d22d0 con 0x7faa2815d300 2023-12-20T04:53:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.924+0000 7faa26ffd640 1 --2- 172.21.15.132:0/2760581469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa2815d300 0x7faa280d1290 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7faa18009d90 tx=0x7faa1802bf50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=60e5e848a853ea18 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.924+0000 7faa25ffb640 1 -- 172.21.15.132:0/2760581469 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1802cd00 con 0x7faa2815d300 2023-12-20T04:53:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.924+0000 7faa25ffb640 1 -- 172.21.15.132:0/2760581469 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1802ce60 con 0x7faa2815d300 2023-12-20T04:53:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.924+0000 7faa25ffb640 1 -- 172.21.15.132:0/2760581469 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa18034660 con 0x7faa2815d300 2023-12-20T04:53:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.924+0000 7faa2d8e9640 1 -- 172.21.15.132:0/2760581469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa2815d300 msgr2=0x7faa280d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.924+0000 7faa2d8e9640 1 --2- 172.21.15.132:0/2760581469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa2815d300 0x7faa280d1290 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 crypto rx=0x7faa18009d90 tx=0x7faa1802bf50 comp rx=0 tx=0).stop 2023-12-20T04:53:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.924+0000 7faa2d8e9640 1 -- 172.21.15.132:0/2760581469 shutdown_connections 2023-12-20T04:53:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.924+0000 7faa2d8e9640 1 --2- 172.21.15.132:0/2760581469 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa2815d300 0x7faa280d1290 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.927 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.924+0000 7faa2d8e9640 1 -- 172.21.15.132:0/2760581469 >> 172.21.15.132:0/2760581469 conn(0x7faa2806a3d0 msgr2=0x7faa2806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:08.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.925+0000 7faa2d8e9640 1 -- 172.21.15.132:0/2760581469 shutdown_connections 2023-12-20T04:53:08.928 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.925+0000 7faa2d8e9640 1 -- 172.21.15.132:0/2760581469 wait complete. 2023-12-20T04:53:08.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.926+0000 7faa2d8e9640 1 Processor -- start 2023-12-20T04:53:08.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.926+0000 7faa2d8e9640 1 -- start start 2023-12-20T04:53:08.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.926+0000 7faa2d8e9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa280cfea0 0x7faa281502c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:08.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa2d8e9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa280d17d0 0x7faa280cbee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:08.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa2d8e9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa2815d300 0x7faa280b4400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:08.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa2d8e9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2815d880 con 0x7faa280d17d0 2023-12-20T04:53:08.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa2d8e9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2815db20 con 0x7faa2815d300 2023-12-20T04:53:08.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa2d8e9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7faa2815de00 con 0x7faa280cfea0 2023-12-20T04:53:08.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa267fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa280d17d0 0x7faa280cbee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:08.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa267fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa280d17d0 0x7faa280cbee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33134/0 (socket says 172.21.15.132:33134) 2023-12-20T04:53:08.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa267fc640 1 -- 172.21.15.132:0/38063274 learned_addr learned my addr 172.21.15.132:0/38063274 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:08.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa26ffd640 1 --2- 172.21.15.132:0/38063274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa280cfea0 0x7faa281502c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:08.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa277fe640 1 --2- 172.21.15.132:0/38063274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa2815d300 0x7faa280b4400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:08.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa267fc640 1 -- 172.21.15.132:0/38063274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa280cfea0 msgr2=0x7faa281502c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa267fc640 1 --2- 172.21.15.132:0/38063274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa280cfea0 0x7faa281502c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa267fc640 1 -- 172.21.15.132:0/38063274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa2815d300 msgr2=0x7faa280b4400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:08.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa267fc640 1 --2- 172.21.15.132:0/38063274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa2815d300 0x7faa280b4400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:08.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa267fc640 1 -- 172.21.15.132:0/38063274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa18009a70 con 0x7faa280d17d0 2023-12-20T04:53:08.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa277fe640 1 --2- 172.21.15.132:0/38063274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa2815d300 0x7faa280b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:08.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa267fc640 1 --2- 172.21.15.132:0/38063274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa280d17d0 0x7faa280cbee0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00c4d0 tx=0x7faa1c00c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:08.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa0ffff640 1 -- 172.21.15.132:0/38063274 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c005ce0 con 0x7faa280d17d0 2023-12-20T04:53:08.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa0ffff640 1 -- 172.21.15.132:0/38063274 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7faa1c005e40 con 0x7faa280d17d0 2023-12-20T04:53:08.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa0ffff640 1 -- 172.21.15.132:0/38063274 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7faa1c007270 con 0x7faa280d17d0 2023-12-20T04:53:08.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa2d8e9640 1 -- 172.21.15.132:0/38063274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa2815e0e0 con 0x7faa280d17d0 2023-12-20T04:53:08.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.927+0000 7faa2d8e9640 1 -- 172.21.15.132:0/38063274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa28150800 con 0x7faa280d17d0 2023-12-20T04:53:08.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.928+0000 7faa2d8e9640 1 -- 172.21.15.132:0/38063274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa2815e600 con 0x7faa280d17d0 2023-12-20T04:53:08.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.929+0000 7faa0ffff640 1 -- 172.21.15.132:0/38063274 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7faa1c0073d0 con 0x7faa280d17d0 2023-12-20T04:53:08.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.929+0000 7faa0ffff640 1 --2- 172.21.15.132:0/38063274 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa1406a460 0x7faa1406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:08.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.929+0000 7faa0ffff640 1 -- 172.21.15.132:0/38063274 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5709+0+0 (secure 0 0 0) 0x7faa1c087d00 con 0x7faa280d17d0 2023-12-20T04:53:08.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.929+0000 7faa26ffd640 1 --2- 172.21.15.132:0/38063274 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa1406a460 0x7faa1406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:08.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.930+0000 7faa26ffd640 1 --2- 172.21.15.132:0/38063274 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa1406a460 0x7faa1406c920 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7faa18036000 tx=0x7faa18030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:08.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:08.933+0000 7faa0ffff640 1 -- 172.21.15.132:0/38063274 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7faa2815e600 con 0x7faa280d17d0 2023-12-20T04:53:09.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.165+0000 7faa2d8e9640 1 -- 172.21.15.132:0/38063274 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]} v 0) v1 -- 0x7faa2815e600 con 0x7faa280d17d0 2023-12-20T04:53:09.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.169+0000 7faa0ffff640 1 -- 172.21.15.132:0/38063274 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "auth caps", "entity": "client.0", "caps": ["mon", "allow r", "osd", "allow rw tag cephfs data=cephfs", "mds", "allow"]}]=0 updated caps for client.0 v23) v1 ==== 190+0+0 (secure 0 0 0) 0x7faa2815e600 con 0x7faa280d17d0 2023-12-20T04:53:09.171 INFO:teuthology.orchestra.run.smithi132.stderr:updated caps for client.0 2023-12-20T04:53:09.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.171+0000 7faa2d8e9640 1 -- 172.21.15.132:0/38063274 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa1406a460 msgr2=0x7faa1406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:09.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.171+0000 7faa2d8e9640 1 --2- 172.21.15.132:0/38063274 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa1406a460 0x7faa1406c920 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7faa18036000 tx=0x7faa18030000 comp rx=0 tx=0).stop 2023-12-20T04:53:09.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.171+0000 7faa2d8e9640 1 -- 172.21.15.132:0/38063274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa280d17d0 msgr2=0x7faa280cbee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:09.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.171+0000 7faa2d8e9640 1 --2- 172.21.15.132:0/38063274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa280d17d0 0x7faa280cbee0 secure :-1 s=READY pgs=1814 cs=0 l=1 rev1=1 crypto rx=0x7faa1c00c4d0 tx=0x7faa1c00c990 comp rx=0 tx=0).stop 2023-12-20T04:53:09.173 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.171+0000 7faa2d8e9640 1 -- 172.21.15.132:0/38063274 shutdown_connections 2023-12-20T04:53:09.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.171+0000 7faa2d8e9640 1 --2- 172.21.15.132:0/38063274 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7faa1406a460 0x7faa1406c920 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:09.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.171+0000 7faa2d8e9640 1 --2- 172.21.15.132:0/38063274 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7faa2815d300 0x7faa280b4400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:09.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.171+0000 7faa2d8e9640 1 --2- 172.21.15.132:0/38063274 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7faa280d17d0 0x7faa280cbee0 unknown :-1 s=CLOSED pgs=1814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:09.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.171+0000 7faa2d8e9640 1 --2- 172.21.15.132:0/38063274 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7faa280cfea0 0x7faa281502c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:09.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.171+0000 7faa2d8e9640 1 -- 172.21.15.132:0/38063274 >> 172.21.15.132:0/38063274 conn(0x7faa2806a3d0 msgr2=0x7faa2815c1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:09.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.171+0000 7faa2d8e9640 1 -- 172.21.15.132:0/38063274 shutdown_connections 2023-12-20T04:53:09.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.171+0000 7faa2d8e9640 1 -- 172.21.15.132:0/38063274 wait complete. 2023-12-20T04:53:09.184 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:53:09.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.281+0000 7f5a4f421640 1 Processor -- start 2023-12-20T04:53:09.283 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.282+0000 7f5a4f421640 1 -- start start 2023-12-20T04:53:09.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.282+0000 7f5a4f421640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a4815b7d0 0x7f5a4815bc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:09.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.282+0000 7f5a4f421640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4806f750 con 0x7f5a480d08c0 2023-12-20T04:53:09.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.282+0000 7f5a4f421640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a4806fa30 con 0x7f5a4806f0e0 2023-12-20T04:53:09.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.282+0000 7f5a4f421640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4815f060 con 0x7f5a4815b7d0 2023-12-20T04:53:09.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.282+0000 7f5a4d1bd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5a480d08c0 0x7f5a480cd030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:51246/0 (socket says 172.21.15.132:51246) 2023-12-20T04:53:09.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.282+0000 7f5a4d1bd640 1 -- 172.21.15.132:0/608313711 learned_addr learned my addr 172.21.15.132:0/608313711 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:09.287 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a4d9be640 1 --2- 172.21.15.132:0/608313711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a4815b7d0 0x7f5a4815bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:09.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a3ffff640 1 -- 172.21.15.132:0/608313711 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3543935646 0 0) 0x7f5a4806f750 con 0x7f5a480d08c0 2023-12-20T04:53:09.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a3ffff640 1 -- 172.21.15.132:0/608313711 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a34003520 con 0x7f5a480d08c0 2023-12-20T04:53:09.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a3ffff640 1 -- 172.21.15.132:0/608313711 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 462877565 0 0) 0x7f5a34003520 con 0x7f5a480d08c0 2023-12-20T04:53:09.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a3ffff640 1 -- 172.21.15.132:0/608313711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a4815b7d0 msgr2=0x7f5a4815bc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:09.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a3ffff640 1 --2- 172.21.15.132:0/608313711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a4815b7d0 0x7f5a4815bc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:09.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a3ffff640 1 -- 172.21.15.132:0/608313711 >> v1:172.21.15.187:6789/0 conn(0x7f5a4806f0e0 legacy=0x7f5a4815f480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:09.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a3ffff640 1 -- 172.21.15.132:0/608313711 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a4806fd10 con 0x7f5a480d08c0 2023-12-20T04:53:09.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a3ffff640 1 -- 172.21.15.132:0/608313711 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f5a44001670 con 0x7f5a480d08c0 2023-12-20T04:53:09.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a3ffff640 1 -- 172.21.15.132:0/608313711 >> v1:172.21.15.132:6789/0 conn(0x7f5a480d08c0 legacy=0x7f5a480cd030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:09.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a3ffff640 1 --2- 172.21.15.132:0/608313711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a4815b7d0 0x7f5a340039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:09.288 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a3ffff640 1 --2- 172.21.15.132:0/608313711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a34003f20 0x7f5a340047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:09.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a3ffff640 1 --2- 172.21.15.132:0/608313711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a34004d00 0x7f5a34005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:09.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a3ffff640 1 -- 172.21.15.132:0/608313711 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a4815f060 con 0x7f5a34004d00 2023-12-20T04:53:09.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a3ffff640 1 -- 172.21.15.132:0/608313711 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3400bbc0 con 0x7f5a34003f20 2023-12-20T04:53:09.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a3ffff640 1 -- 172.21.15.132:0/608313711 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a3400bd80 con 0x7f5a4815b7d0 2023-12-20T04:53:09.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a4d9be640 1 --2- 172.21.15.132:0/608313711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a34004d00 0x7f5a34005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:09.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a4d1bd640 1 --2- 172.21.15.132:0/608313711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a4815b7d0 0x7f5a340039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:09.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a4c9bc640 1 --2- 172.21.15.132:0/608313711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a34003f20 0x7f5a340047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:09.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a4d9be640 1 -- 172.21.15.132:0/608313711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a4815b7d0 msgr2=0x7f5a340039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:09.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a4d9be640 1 --2- 172.21.15.132:0/608313711 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a4815b7d0 0x7f5a340039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:09.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a4d9be640 1 -- 172.21.15.132:0/608313711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a34003f20 msgr2=0x7f5a340047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:09.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a4d9be640 1 --2- 172.21.15.132:0/608313711 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a34003f20 0x7f5a340047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:09.289 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.283+0000 7f5a4d9be640 1 -- 172.21.15.132:0/608313711 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a34003520 con 0x7f5a34004d00 2023-12-20T04:53:09.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.284+0000 7f5a4d9be640 1 --2- 172.21.15.132:0/608313711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a34004d00 0x7f5a34005180 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009fc0 tx=0x7f5a340057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=92873d990f9f7b12 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:09.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.284+0000 7f5a3ffff640 1 -- 172.21.15.132:0/608313711 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4002cc20 con 0x7f5a34004d00 2023-12-20T04:53:09.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.284+0000 7f5a3ffff640 1 -- 172.21.15.132:0/608313711 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4000f040 con 0x7f5a34004d00 2023-12-20T04:53:09.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.284+0000 7f5a3ffff640 1 -- 172.21.15.132:0/608313711 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a40034440 con 0x7f5a34004d00 2023-12-20T04:53:09.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.285+0000 7f5a4f421640 1 -- 172.21.15.132:0/608313711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a34004d00 msgr2=0x7f5a34005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:09.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.285+0000 7f5a4f421640 1 --2- 172.21.15.132:0/608313711 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a34004d00 0x7f5a34005180 secure :-1 s=READY pgs=1816 cs=0 l=1 rev1=1 crypto rx=0x7f5a40009fc0 tx=0x7f5a340057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:09.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.285+0000 7f5a4d9be640 1 -- 172.21.15.132:0/608313711 reap_dead start 2023-12-20T04:53:09.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.285+0000 7f5a4f421640 1 -- 172.21.15.132:0/608313711 shutdown_connections 2023-12-20T04:53:09.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.285+0000 7f5a4f421640 1 -- 172.21.15.132:0/608313711 >> 172.21.15.132:0/608313711 conn(0x7f5a480cd7b0 msgr2=0x7f5a480cdb90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:09.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.285+0000 7f5a4f421640 1 -- 172.21.15.132:0/608313711 shutdown_connections 2023-12-20T04:53:09.290 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.285+0000 7f5a4f421640 1 -- 172.21.15.132:0/608313711 wait complete. 2023-12-20T04:53:09.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.286+0000 7f5a4f421640 1 Processor -- start 2023-12-20T04:53:09.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.286+0000 7f5a4f421640 1 -- start start 2023-12-20T04:53:09.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4f421640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a481f00f0 0x7f5a4815c580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:09.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4f421640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a480b5e00 0x7f5a4815cac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:09.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4f421640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a480c5bc0 0x7f5a480c6070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:09.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4f421640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a48150cc0 con 0x7f5a481f00f0 2023-12-20T04:53:09.293 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4f421640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480b4df0 con 0x7f5a480b5e00 2023-12-20T04:53:09.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4f421640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a480b5040 con 0x7f5a480c5bc0 2023-12-20T04:53:09.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4d1bd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a481f00f0 0x7f5a4815c580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:09.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4d1bd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a481f00f0 0x7f5a4815c580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33142/0 (socket says 172.21.15.132:33142) 2023-12-20T04:53:09.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4d1bd640 1 -- 172.21.15.132:0/3951812320 learned_addr learned my addr 172.21.15.132:0/3951812320 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:09.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4c9bc640 1 --2- 172.21.15.132:0/3951812320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a480b5e00 0x7f5a4815cac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:09.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4d9be640 1 --2- 172.21.15.132:0/3951812320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a480c5bc0 0x7f5a480c6070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:09.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4d1bd640 1 -- 172.21.15.132:0/3951812320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a480c5bc0 msgr2=0x7f5a480c6070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:09.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4d1bd640 1 --2- 172.21.15.132:0/3951812320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a480c5bc0 0x7f5a480c6070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:09.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4d1bd640 1 -- 172.21.15.132:0/3951812320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a480b5e00 msgr2=0x7f5a4815cac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:09.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4d1bd640 1 --2- 172.21.15.132:0/3951812320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a480b5e00 0x7f5a4815cac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:09.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4d1bd640 1 -- 172.21.15.132:0/3951812320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a480b5320 con 0x7f5a481f00f0 2023-12-20T04:53:09.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4c9bc640 1 --2- 172.21.15.132:0/3951812320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a480b5e00 0x7f5a4815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:09.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a4d1bd640 1 --2- 172.21.15.132:0/3951812320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a481f00f0 0x7f5a4815c580 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f5a440010e0 tx=0x7f5a44007720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:09.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a3dffb640 1 -- 172.21.15.132:0/3951812320 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a4400f9c0 con 0x7f5a481f00f0 2023-12-20T04:53:09.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.287+0000 7f5a3dffb640 1 -- 172.21.15.132:0/3951812320 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a4400fb40 con 0x7f5a481f00f0 2023-12-20T04:53:09.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.288+0000 7f5a4f421640 1 -- 172.21.15.132:0/3951812320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a480b5600 con 0x7f5a481f00f0 2023-12-20T04:53:09.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.288+0000 7f5a3dffb640 1 -- 172.21.15.132:0/3951812320 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a440133f0 con 0x7f5a481f00f0 2023-12-20T04:53:09.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.288+0000 7f5a4f421640 1 -- 172.21.15.132:0/3951812320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a480c65b0 con 0x7f5a481f00f0 2023-12-20T04:53:09.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.289+0000 7f5a4f421640 1 -- 172.21.15.132:0/3951812320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a480b5b20 con 0x7f5a481f00f0 2023-12-20T04:53:09.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.289+0000 7f5a3dffb640 1 -- 172.21.15.132:0/3951812320 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5a44013550 con 0x7f5a481f00f0 2023-12-20T04:53:09.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.289+0000 7f5a3dffb640 1 --2- 172.21.15.132:0/3951812320 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5a2c06a460 0x7f5a2c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:09.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.290+0000 7f5a3dffb640 1 -- 172.21.15.132:0/3951812320 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5a440889f0 con 0x7f5a481f00f0 2023-12-20T04:53:09.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.290+0000 7f5a4c9bc640 1 --2- 172.21.15.132:0/3951812320 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5a2c06a460 0x7f5a2c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:09.295 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.290+0000 7f5a4c9bc640 1 --2- 172.21.15.132:0/3951812320 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5a2c06a460 0x7f5a2c06c920 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f5a48158660 tx=0x7f5a38009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:09.296 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.294+0000 7f5a3dffb640 1 -- 172.21.15.132:0/3951812320 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5a480b5b20 con 0x7f5a481f00f0 2023-12-20T04:53:09.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.496+0000 7f5a4f421640 1 -- 172.21.15.132:0/3951812320 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f5a480b5b20 con 0x7f5a481f00f0 2023-12-20T04:53:09.498 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.496+0000 7f5a3dffb640 1 -- 172.21.15.132:0/3951812320 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4722 (secure 0 0 0) 0x7f5a480b5b20 con 0x7f5a481f00f0 2023-12-20T04:53:09.498 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:09.499 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":70,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3443409957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3443409957},{"type":"v1","addr":"172.21.15.187:6833","nonce":3443409957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/321445180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":321445180},{"type":"v1","addr":"172.21.15.187:6835","nonce":321445180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1166803529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1166803529},{"type":"v1","addr":"172.21.15.132:6836","nonce":1166803529}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:53:04.838088+0000","modified":"2023-12-20T04:53:07.506024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9117":{"gid":9117,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/2356846201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2356846201},{"type":"v1","addr":"172.21.15.132:6837","nonce":2356846201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-20T04:53:09.499 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 70 2023-12-20T04:53:09.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.498+0000 7f5a4f421640 1 -- 172.21.15.132:0/3951812320 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5a2c06a460 msgr2=0x7f5a2c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:09.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.498+0000 7f5a4f421640 1 --2- 172.21.15.132:0/3951812320 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5a2c06a460 0x7f5a2c06c920 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f5a48158660 tx=0x7f5a38009040 comp rx=0 tx=0).stop 2023-12-20T04:53:09.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.498+0000 7f5a4f421640 1 -- 172.21.15.132:0/3951812320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a481f00f0 msgr2=0x7f5a4815c580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:09.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.498+0000 7f5a4f421640 1 --2- 172.21.15.132:0/3951812320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a481f00f0 0x7f5a4815c580 secure :-1 s=READY pgs=1817 cs=0 l=1 rev1=1 crypto rx=0x7f5a440010e0 tx=0x7f5a44007720 comp rx=0 tx=0).stop 2023-12-20T04:53:09.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.498+0000 7f5a4f421640 1 -- 172.21.15.132:0/3951812320 shutdown_connections 2023-12-20T04:53:09.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.498+0000 7f5a4f421640 1 --2- 172.21.15.132:0/3951812320 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5a2c06a460 0x7f5a2c06c920 unknown :-1 s=CLOSED pgs=765 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:09.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.498+0000 7f5a4f421640 1 --2- 172.21.15.132:0/3951812320 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a480c5bc0 0x7f5a480c6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:09.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.498+0000 7f5a4f421640 1 --2- 172.21.15.132:0/3951812320 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a480b5e00 0x7f5a4815cac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:09.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.498+0000 7f5a4f421640 1 --2- 172.21.15.132:0/3951812320 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a481f00f0 0x7f5a4815c580 unknown :-1 s=CLOSED pgs=1817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:09.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.498+0000 7f5a4f421640 1 -- 172.21.15.132:0/3951812320 >> 172.21.15.132:0/3951812320 conn(0x7f5a480cd7b0 msgr2=0x7f5a48157250 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:09.501 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.498+0000 7f5a4f421640 1 -- 172.21.15.132:0/3951812320 shutdown_connections 2023-12-20T04:53:09.502 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:09.498+0000 7f5a4f421640 1 -- 172.21.15.132:0/3951812320 wait complete. 2023-12-20T04:53:09.914 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 70, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2023-12-20T04:53:04.838088+0000', 'modified': '2023-12-20T04:53:07.506024+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 9117}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_9117': {'gid': 9117, 'name': 'a', 'rank': 0, 'incarnation': 67, 'state': 'up:active', 'state_seq': 3, 'addr': '172.21.15.132:6837/2356846201', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.132:6835', 'nonce': 2356846201}, {'type': 'v1', 'addr': '172.21.15.132:6837', 'nonce': 2356846201}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540138322906710015, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2'}}}}, 'data_pools': [23], 'metadata_pool': 22, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0} 2023-12-20T04:53:09.914 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2023-12-20T04:53:09.914 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2023-12-20T04:53:10.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.014+0000 7fc45ce5f640 1 Processor -- start 2023-12-20T04:53:10.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.014+0000 7fc45ce5f640 1 -- start start 2023-12-20T04:53:10.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.015+0000 7fc45ce5f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc45806b600 0x7fc45806b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.015+0000 7fc45ce5f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4580c98e0 con 0x7fc4580ce950 2023-12-20T04:53:10.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.015+0000 7fc45ce5f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc4580b20e0 con 0x7fc4580ca610 2023-12-20T04:53:10.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.015+0000 7fc45ce5f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc4580b1420 con 0x7fc45806b600 2023-12-20T04:53:10.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.015+0000 7fc45659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc45806b600 0x7fc45806b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.015+0000 7fc455d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc4580ce950 0x7fc4580b0d10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:51250/0 (socket says 172.21.15.132:51250) 2023-12-20T04:53:10.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.015+0000 7fc45659c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc45806b600 0x7fc45806b9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33144/0 (socket says 172.21.15.132:33144) 2023-12-20T04:53:10.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.015+0000 7fc455d9b640 1 -- 172.21.15.132:0/1352187730 learned_addr learned my addr 172.21.15.132:0/1352187730 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:10.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.015+0000 7fc45659c640 1 -- 172.21.15.132:0/1352187730 >> v1:172.21.15.187:6789/0 conn(0x7fc4580ca610 legacy=0x7fc4580caaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:10.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.015+0000 7fc45659c640 1 -- 172.21.15.132:0/1352187730 >> v1:172.21.15.132:6789/0 conn(0x7fc4580ce950 legacy=0x7fc4580b0d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:10.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.016+0000 7fc45659c640 1 -- 172.21.15.132:0/1352187730 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45806bf20 con 0x7fc45806b600 2023-12-20T04:53:10.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.016+0000 7fc45659c640 1 --2- 172.21.15.132:0/1352187730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc45806b600 0x7fc45806b9e0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fc4480097d0 tx=0x7fc44802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6bb25a8c65e5c8d4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:10.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.016+0000 7fc45559a640 1 -- 172.21.15.132:0/1352187730 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448031830 con 0x7fc45806b600 2023-12-20T04:53:10.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.016+0000 7fc45559a640 1 -- 172.21.15.132:0/1352187730 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc448031990 con 0x7fc45806b600 2023-12-20T04:53:10.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.016+0000 7fc45559a640 1 -- 172.21.15.132:0/1352187730 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc448031d20 con 0x7fc45806b600 2023-12-20T04:53:10.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.017+0000 7fc45ce5f640 1 -- 172.21.15.132:0/1352187730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc45806b600 msgr2=0x7fc45806b9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:10.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.017+0000 7fc45ce5f640 1 --2- 172.21.15.132:0/1352187730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc45806b600 0x7fc45806b9e0 secure :-1 s=READY pgs=1819 cs=0 l=1 rev1=1 crypto rx=0x7fc4480097d0 tx=0x7fc44802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.017+0000 7fc45ce5f640 1 -- 172.21.15.132:0/1352187730 shutdown_connections 2023-12-20T04:53:10.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.017+0000 7fc45ce5f640 1 --2- 172.21.15.132:0/1352187730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc45806b600 0x7fc45806b9e0 unknown :-1 s=CLOSED pgs=1819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.017+0000 7fc45ce5f640 1 -- 172.21.15.132:0/1352187730 >> 172.21.15.132:0/1352187730 conn(0x7fc4580cbd10 msgr2=0x7fc4580cc0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:10.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.017+0000 7fc45ce5f640 1 -- 172.21.15.132:0/1352187730 shutdown_connections 2023-12-20T04:53:10.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.017+0000 7fc45ce5f640 1 -- 172.21.15.132:0/1352187730 wait complete. 2023-12-20T04:53:10.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.018+0000 7fc45ce5f640 1 Processor -- start 2023-12-20T04:53:10.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.018+0000 7fc45ce5f640 1 -- start start 2023-12-20T04:53:10.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.019+0000 7fc45ce5f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc45806b600 0x7fc45815ba60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.019+0000 7fc45ce5f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4580ca610 0x7fc45815c110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.019+0000 7fc45ce5f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4580ce950 0x7fc45815c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.019+0000 7fc45ce5f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4580c6360 con 0x7fc4580ce950 2023-12-20T04:53:10.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.019+0000 7fc45ce5f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc45815bfa0 con 0x7fc4580ca610 2023-12-20T04:53:10.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.019+0000 7fc45ce5f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc4580c2dc0 con 0x7fc45806b600 2023-12-20T04:53:10.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.019+0000 7fc456d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4580ce950 0x7fc45815c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.019+0000 7fc456d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4580ce950 0x7fc45815c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33158/0 (socket says 172.21.15.132:33158) 2023-12-20T04:53:10.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.019+0000 7fc456d9d640 1 -- 172.21.15.132:0/1801239223 learned_addr learned my addr 172.21.15.132:0/1801239223 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:10.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.019+0000 7fc45659c640 1 --2- 172.21.15.132:0/1801239223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc45806b600 0x7fc45815ba60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.023 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.019+0000 7fc455d9b640 1 --2- 172.21.15.132:0/1801239223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4580ca610 0x7fc45815c110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.019+0000 7fc456d9d640 1 -- 172.21.15.132:0/1801239223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc45806b600 msgr2=0x7fc45815ba60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:10.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.019+0000 7fc456d9d640 1 --2- 172.21.15.132:0/1801239223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc45806b600 0x7fc45815ba60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.019+0000 7fc456d9d640 1 -- 172.21.15.132:0/1801239223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4580ca610 msgr2=0x7fc45815c110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:10.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.019+0000 7fc456d9d640 1 --2- 172.21.15.132:0/1801239223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4580ca610 0x7fc45815c110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.020+0000 7fc456d9d640 1 -- 172.21.15.132:0/1801239223 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc448009400 con 0x7fc4580ce950 2023-12-20T04:53:10.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.020+0000 7fc45659c640 1 --2- 172.21.15.132:0/1801239223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc45806b600 0x7fc45815ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:10.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.020+0000 7fc456d9d640 1 --2- 172.21.15.132:0/1801239223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4580ce950 0x7fc45815c650 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fc45000c780 tx=0x7fc45000cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:10.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.020+0000 7fc446ffd640 1 -- 172.21.15.132:0/1801239223 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450004b60 con 0x7fc4580ce950 2023-12-20T04:53:10.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.020+0000 7fc446ffd640 1 -- 172.21.15.132:0/1801239223 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45000ce90 con 0x7fc4580ce950 2023-12-20T04:53:10.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.020+0000 7fc45ce5f640 1 -- 172.21.15.132:0/1801239223 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4580c93c0 con 0x7fc4580ce950 2023-12-20T04:53:10.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.020+0000 7fc446ffd640 1 -- 172.21.15.132:0/1801239223 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc45000a7f0 con 0x7fc4580ce950 2023-12-20T04:53:10.024 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.020+0000 7fc45ce5f640 1 -- 172.21.15.132:0/1801239223 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4580b3f10 con 0x7fc4580ce950 2023-12-20T04:53:10.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.021+0000 7fc446ffd640 1 -- 172.21.15.132:0/1801239223 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc45000a950 con 0x7fc4580ce950 2023-12-20T04:53:10.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.022+0000 7fc446ffd640 1 --2- 172.21.15.132:0/1801239223 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc43806a430 0x7fc43806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.022+0000 7fc446ffd640 1 -- 172.21.15.132:0/1801239223 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc450088a90 con 0x7fc4580ce950 2023-12-20T04:53:10.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.022+0000 7fc45659c640 1 --2- 172.21.15.132:0/1801239223 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc43806a430 0x7fc43806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.022+0000 7fc45659c640 1 --2- 172.21.15.132:0/1801239223 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc43806a430 0x7fc43806c8f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc448036000 tx=0x7fc448008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:10.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.023+0000 7fc45f9d3740 1 Processor -- start 2023-12-20T04:53:10.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.023+0000 7fc45f9d3740 1 -- start start 2023-12-20T04:53:10.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc45f9d3740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcbd3390 0x55d8dcba6520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc45f9d3740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3770 0x55d8dcbd6120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc45f9d3740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcba6a60 0x55d8dcbd6660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.028 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc45f9d3740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8dcb160b0 con 0x55d8dcba6a60 2023-12-20T04:53:10.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc45f9d3740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8dcb13840 con 0x55d8dcbd3390 2023-12-20T04:53:10.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc45f9d3740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8dcb0f130 con 0x55d8dcbd3770 2023-12-20T04:53:10.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc456d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcba6a60 0x55d8dcbd6660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc456d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcba6a60 0x55d8dcbd6660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33172/0 (socket says 172.21.15.132:33172) 2023-12-20T04:53:10.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc456d9d640 1 -- 172.21.15.132:0/2988939995 learned_addr learned my addr 172.21.15.132:0/2988939995 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:10.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc455d9b640 1 --2- 172.21.15.132:0/2988939995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3770 0x55d8dcbd6120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc45659c640 1 --2- 172.21.15.132:0/2988939995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcbd3390 0x55d8dcba6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc456d9d640 1 -- 172.21.15.132:0/2988939995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3770 msgr2=0x55d8dcbd6120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:10.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc456d9d640 1 --2- 172.21.15.132:0/2988939995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3770 0x55d8dcbd6120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc456d9d640 1 -- 172.21.15.132:0/2988939995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcbd3390 msgr2=0x55d8dcba6520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:10.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc456d9d640 1 --2- 172.21.15.132:0/2988939995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcbd3390 0x55d8dcba6520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc456d9d640 1 -- 172.21.15.132:0/2988939995 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8dcac9c40 con 0x55d8dcba6a60 2023-12-20T04:53:10.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc455d9b640 1 --2- 172.21.15.132:0/2988939995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3770 0x55d8dcbd6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:10.029 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc456d9d640 1 --2- 172.21.15.132:0/2988939995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcba6a60 0x55d8dcbd6660 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fc450003b20 tx=0x7fc450057dd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28fc7c5d0ca03739 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:10.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc437fff640 1 -- 172.21.15.132:0/2988939995 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450055f10 con 0x55d8dcba6a60 2023-12-20T04:53:10.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc437fff640 1 -- 172.21.15.132:0/2988939995 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc450056170 con 0x55d8dcba6a60 2023-12-20T04:53:10.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.024+0000 7fc437fff640 1 -- 172.21.15.132:0/2988939995 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450058030 con 0x55d8dcba6a60 2023-12-20T04:53:10.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.025+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2988939995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcba6a60 msgr2=0x55d8dcbd6660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:10.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.025+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/2988939995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcba6a60 0x55d8dcbd6660 secure :-1 s=READY pgs=1821 cs=0 l=1 rev1=1 crypto rx=0x7fc450003b20 tx=0x7fc450057dd0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.025+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2988939995 shutdown_connections 2023-12-20T04:53:10.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.025+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/2988939995 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcba6a60 0x55d8dcbd6660 unknown :-1 s=CLOSED pgs=1821 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.025+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/2988939995 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3770 0x55d8dcbd6120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.025+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/2988939995 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcbd3390 0x55d8dcba6520 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.025+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2988939995 >> 172.21.15.132:0/2988939995 conn(0x55d8dcba8830 msgr2=0x55d8dcbf1120 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:10.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.025+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2988939995 shutdown_connections 2023-12-20T04:53:10.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.025+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2988939995 wait complete. 2023-12-20T04:53:10.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.026+0000 7fc45f9d3740 1 -- start start 2023-12-20T04:53:10.030 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.026+0000 7fc45f9d3740 1 Processor -- start 2023-12-20T04:53:10.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc45f9d3740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3390 0x55d8dcbcecd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc45f9d3740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcbd3770 0x55d8dcc00890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc45f9d3740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcc00dd0 0x55d8dcc01250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc45f9d3740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8dcacd840 con 0x55d8dcbd3770 2023-12-20T04:53:10.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc45f9d3740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8dcacd4e0 con 0x55d8dcc00dd0 2023-12-20T04:53:10.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc45f9d3740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8dca93230 con 0x55d8dcbd3390 2023-12-20T04:53:10.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc45f9d3740 10 client.0 _ll_register_callbacks cb 0x55d8dcae46d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:53:10.034 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc455d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcbd3770 0x55d8dcc00890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc455d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcbd3770 0x55d8dcc00890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33174/0 (socket says 172.21.15.132:33174) 2023-12-20T04:53:10.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc455d9b640 1 -- 172.21.15.132:0/2008722550 learned_addr learned my addr 172.21.15.132:0/2008722550 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:10.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc45659c640 1 --2- 172.21.15.132:0/2008722550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3390 0x55d8dcbcecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc456d9d640 1 --2- 172.21.15.132:0/2008722550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcc00dd0 0x55d8dcc01250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc455d9b640 1 -- 172.21.15.132:0/2008722550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3390 msgr2=0x55d8dcbcecd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:10.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc455d9b640 1 --2- 172.21.15.132:0/2008722550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3390 0x55d8dcbcecd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc455d9b640 1 -- 172.21.15.132:0/2008722550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcc00dd0 msgr2=0x55d8dcc01250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:10.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc455d9b640 1 --2- 172.21.15.132:0/2008722550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcc00dd0 0x55d8dcc01250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc455d9b640 1 -- 172.21.15.132:0/2008722550 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4580b3f10 con 0x55d8dcbd3770 2023-12-20T04:53:10.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc456d9d640 1 --2- 172.21.15.132:0/2008722550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcc00dd0 0x55d8dcc01250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:10.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc455d9b640 1 --2- 172.21.15.132:0/2008722550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcbd3770 0x55d8dcc00890 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fc44c007fd0 tx=0x7fc44c00f5a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5c1e85363f2fc54 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:10.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc4357fa640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:53:10.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc4357fa640 1 -- 172.21.15.132:0/2008722550 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c0058b0 con 0x55d8dcbd3770 2023-12-20T04:53:10.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc4357fa640 1 -- 172.21.15.132:0/2008722550 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(186..186 src has 1..186) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc44c005a10 con 0x55d8dcbd3770 2023-12-20T04:53:10.035 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2008722550 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x55d8dcb38970 con 0x55d8dcbd3770 2023-12-20T04:53:10.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc4357fa640 1 -- 172.21.15.132:0/2008722550 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc44c005bd0 con 0x55d8dcbd3770 2023-12-20T04:53:10.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc45f9d3740 10 client.9255 fetch_fsmap learned FSMap version 70 2023-12-20T04:53:10.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.027+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2008722550 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x55d8dcb0d7b0 con 0x55d8dcbd3770 2023-12-20T04:53:10.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.028+0000 7fc4357fa640 1 -- 172.21.15.132:0/2008722550 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x55d8dcb38970 con 0x55d8dcbd3770 2023-12-20T04:53:10.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.028+0000 7fc4357fa640 1 -- 172.21.15.132:0/2008722550 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc44c012070 con 0x55d8dcbd3770 2023-12-20T04:53:10.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.028+0000 7fc45f9d3740 10 client.9255 fetch_fsmap finished waiting for FSMap version 70 2023-12-20T04:53:10.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.028+0000 7fc45f9d3740 10 client.9255 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-20T04:53:10.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.028+0000 7fc45f9d3740 20 client.9255 populate_metadata read hostname 'smithi132' 2023-12-20T04:53:10.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.028+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/2008722550 >> [v2:172.21.15.132:6835/2356846201,v1:172.21.15.132:6837/2356846201] conn(0x55d8dcc0c610 0x55d8dcc0ea00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.028+0000 7fc45f9d3740 4 client.9255 mds_command: new command op to 9117 tid=0[{"prefix": "get_command_descriptions"}] 2023-12-20T04:53:10.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.028+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2008722550 --> [v2:172.21.15.132:6835/2356846201,v1:172.21.15.132:6837/2356846201] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x55d8dcb00f00 con 0x55d8dcc0c610 2023-12-20T04:53:10.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.028+0000 7fc45659c640 1 --2- 172.21.15.132:0/2008722550 >> [v2:172.21.15.132:6835/2356846201,v1:172.21.15.132:6837/2356846201] conn(0x55d8dcc0c610 0x55d8dcc0ea00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.028+0000 7fc45659c640 1 --2- 172.21.15.132:0/2008722550 >> [v2:172.21.15.132:6835/2356846201,v1:172.21.15.132:6837/2356846201] conn(0x55d8dcc0c610 0x55d8dcc0ea00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ba0dca61d68f725d server_cookie=31b4c5c1df74265d in_seq=0 out_seq=0 2023-12-20T04:53:10.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.028+0000 7fc4357fa640 10 client.9255 ms_handle_connect on v2:172.21.15.132:6835/2356846201 2023-12-20T04:53:10.036 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.029+0000 7fc4357fa640 1 -- 172.21.15.132:0/2008722550 <== mds.0 v2:172.21.15.132:6835/2356846201 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+17819 (crc 0 0 0) 0x55d8dcb00f00 con 0x55d8dcc0c610 2023-12-20T04:53:10.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.029+0000 7fc4357fa640 10 client.9255 handle_command_reply: tid=0 2023-12-20T04:53:10.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.029+0000 7fc45f9d3740 1 client.9255 shutdown 2023-12-20T04:53:10.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.029+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2008722550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcbd3770 msgr2=0x55d8dcc00890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:10.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.029+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/2008722550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcbd3770 0x55d8dcc00890 secure :-1 s=READY pgs=1822 cs=0 l=1 rev1=1 crypto rx=0x7fc44c007fd0 tx=0x7fc44c00f5a0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.029+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2008722550 shutdown_connections 2023-12-20T04:53:10.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.029+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/2008722550 >> [v2:172.21.15.132:6835/2356846201,v1:172.21.15.132:6837/2356846201] conn(0x55d8dcc0c610 0x55d8dcc0ea00 crc :-1 s=READY pgs=11 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.029+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/2008722550 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcc00dd0 0x55d8dcc01250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.029+0000 7fc4357fa640 0 client.9255 ms_handle_reset on v2:172.21.15.132:6835/2356846201 2023-12-20T04:53:10.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.029+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/2008722550 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcbd3770 0x55d8dcc00890 unknown :-1 s=CLOSED pgs=1822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.029+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/2008722550 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3390 0x55d8dcbcecd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.029+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2008722550 >> 172.21.15.132:0/2008722550 conn(0x55d8dcba6a60 msgr2=0x55d8dcbaa210 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:10.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.029+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2008722550 shutdown_connections 2023-12-20T04:53:10.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.029+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2008722550 wait complete. 2023-12-20T04:53:10.037 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.029+0000 7fc45f9d3740 20 client.9255 trim_cache size 0 max 16384 2023-12-20T04:53:10.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.044+0000 7fc45f9d3740 1 Processor -- start 2023-12-20T04:53:10.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.044+0000 7fc45f9d3740 1 -- start start 2023-12-20T04:53:10.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc45f9d3740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3390 0x55d8dcbce120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc45f9d3740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcbd3770 0x55d8dcc09240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc45f9d3740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcc00dd0 0x55d8dcc09780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc45f9d3740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8dcbcf920 con 0x55d8dcc00dd0 2023-12-20T04:53:10.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc45f9d3740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8dcbf47d0 con 0x55d8dcbd3770 2023-12-20T04:53:10.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc45f9d3740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8dcbd05a0 con 0x55d8dcbd3390 2023-12-20T04:53:10.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc456d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcc00dd0 0x55d8dcc09780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc456d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcc00dd0 0x55d8dcc09780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33176/0 (socket says 172.21.15.132:33176) 2023-12-20T04:53:10.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc456d9d640 1 -- 172.21.15.132:0/2895899753 learned_addr learned my addr 172.21.15.132:0/2895899753 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:10.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc456d9d640 1 -- 172.21.15.132:0/2895899753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3390 msgr2=0x55d8dcbce120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:10.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc456d9d640 1 --2- 172.21.15.132:0/2895899753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3390 0x55d8dcbce120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc456d9d640 1 -- 172.21.15.132:0/2895899753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcbd3770 msgr2=0x55d8dcc09240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:10.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc456d9d640 1 --2- 172.21.15.132:0/2895899753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcbd3770 0x55d8dcc09240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc456d9d640 1 -- 172.21.15.132:0/2895899753 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x55d8dcbd06f0 con 0x55d8dcc00dd0 2023-12-20T04:53:10.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc456d9d640 1 --2- 172.21.15.132:0/2895899753 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcc00dd0 0x55d8dcc09780 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fc45005b010 tx=0x7fc45006c000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c256a2820236d769 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:10.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc444ff9640 1 -- 172.21.15.132:0/2895899753 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450074070 con 0x55d8dcc00dd0 2023-12-20T04:53:10.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc444ff9640 1 -- 172.21.15.132:0/2895899753 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc45005fdb0 con 0x55d8dcc00dd0 2023-12-20T04:53:10.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.045+0000 7fc444ff9640 1 -- 172.21.15.132:0/2895899753 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc450086fc0 con 0x55d8dcc00dd0 2023-12-20T04:53:10.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.046+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2895899753 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcc00dd0 msgr2=0x55d8dcc09780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:10.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.046+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/2895899753 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcc00dd0 0x55d8dcc09780 secure :-1 s=READY pgs=1823 cs=0 l=1 rev1=1 crypto rx=0x7fc45005b010 tx=0x7fc45006c000 comp rx=0 tx=0).stop 2023-12-20T04:53:10.049 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.046+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2895899753 shutdown_connections 2023-12-20T04:53:10.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.046+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/2895899753 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcc00dd0 0x55d8dcc09780 unknown :-1 s=CLOSED pgs=1823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.046+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/2895899753 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcbd3770 0x55d8dcc09240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.046+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/2895899753 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3390 0x55d8dcbce120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.046+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2895899753 >> 172.21.15.132:0/2895899753 conn(0x55d8dcba6a60 msgr2=0x55d8dcba1880 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:10.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.046+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2895899753 shutdown_connections 2023-12-20T04:53:10.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.046+0000 7fc45f9d3740 1 -- 172.21.15.132:0/2895899753 wait complete. 2023-12-20T04:53:10.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.046+0000 7fc45f9d3740 1 -- start start 2023-12-20T04:53:10.050 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.046+0000 7fc45f9d3740 1 Processor -- start 2023-12-20T04:53:10.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.047+0000 7fc45f9d3740 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3390 0x55d8dcc59fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.047+0000 7fc45f9d3740 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcbd3770 0x55d8dcbca520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.047+0000 7fc45f9d3740 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcc00dd0 0x55d8dcc0da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.047+0000 7fc45f9d3740 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8dcc0d1c0 con 0x55d8dcbd3770 2023-12-20T04:53:10.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.047+0000 7fc45f9d3740 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x55d8dcc108d0 con 0x55d8dcc00dd0 2023-12-20T04:53:10.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.047+0000 7fc45f9d3740 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x55d8dcc0e4f0 con 0x55d8dcbd3390 2023-12-20T04:53:10.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.047+0000 7fc45f9d3740 10 client.0 _ll_register_callbacks cb 0x7fc450057910 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2023-12-20T04:53:10.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.047+0000 7fc455d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcbd3770 0x55d8dcbca520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.047+0000 7fc455d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcbd3770 0x55d8dcbca520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33192/0 (socket says 172.21.15.132:33192) 2023-12-20T04:53:10.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.047+0000 7fc455d9b640 1 -- 172.21.15.132:0/3480737901 learned_addr learned my addr 172.21.15.132:0/3480737901 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:10.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc456d9d640 1 --2- 172.21.15.132:0/3480737901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcc00dd0 0x55d8dcc0da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.047+0000 7fc45659c640 1 --2- 172.21.15.132:0/3480737901 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3390 0x55d8dcc59fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc455d9b640 1 -- 172.21.15.132:0/3480737901 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3390 msgr2=0x55d8dcc59fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:10.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc455d9b640 1 --2- 172.21.15.132:0/3480737901 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3390 0x55d8dcc59fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc455d9b640 1 -- 172.21.15.132:0/3480737901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcc00dd0 msgr2=0x55d8dcc0da90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:10.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc455d9b640 1 --2- 172.21.15.132:0/3480737901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcc00dd0 0x55d8dcc0da90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc455d9b640 1 -- 172.21.15.132:0/3480737901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x55d8dcac9c40 con 0x55d8dcbd3770 2023-12-20T04:53:10.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc456d9d640 1 --2- 172.21.15.132:0/3480737901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcc00dd0 0x55d8dcc0da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:10.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc455d9b640 1 --2- 172.21.15.132:0/3480737901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcbd3770 0x55d8dcbca520 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fc44c007900 tx=0x7fc44c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cb576aca82f341c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:10.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc4357fa640 10 client.0 ms_handle_connect on v2:172.21.15.132:3300/0 2023-12-20T04:53:10.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc4357fa640 1 -- 172.21.15.132:0/3480737901 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc44c005860 con 0x55d8dcbd3770 2023-12-20T04:53:10.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc4357fa640 1 -- 172.21.15.132:0/3480737901 <== mon.0 v2:172.21.15.132:3300/0 2 ==== osd_map(186..186 src has 1..186) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc44c0059c0 con 0x55d8dcbd3770 2023-12-20T04:53:10.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc45f9d3740 1 -- 172.21.15.132:0/3480737901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=fsmap handle=1) v1 -- 0x7fc450056170 con 0x55d8dcbd3770 2023-12-20T04:53:10.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc4357fa640 1 -- 172.21.15.132:0/3480737901 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_get_version_reply(handle=1 version=70) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc44c005b80 con 0x55d8dcbd3770 2023-12-20T04:53:10.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc45f9d3740 10 client.9261 fetch_fsmap learned FSMap version 70 2023-12-20T04:53:10.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc45f9d3740 1 -- 172.21.15.132:0/3480737901 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,fsmap=70,monmap=2+}) v3 -- 0x7fc45809b930 con 0x55d8dcbd3770 2023-12-20T04:53:10.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc4357fa640 1 -- 172.21.15.132:0/3480737901 <== mon.0 v2:172.21.15.132:3300/0 4 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc450056170 con 0x55d8dcbd3770 2023-12-20T04:53:10.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc4357fa640 1 -- 172.21.15.132:0/3480737901 <== mon.0 v2:172.21.15.132:3300/0 5 ==== fsmap(e 70) v1 ==== 3114+0+0 (secure 0 0 0) 0x7fc44c02c070 con 0x55d8dcbd3770 2023-12-20T04:53:10.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc45f9d3740 10 client.9261 fetch_fsmap finished waiting for FSMap version 70 2023-12-20T04:53:10.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc45f9d3740 10 client.9261 resolve_mds: resolved name 'a' to daemon mds.a 2023-12-20T04:53:10.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc45f9d3740 20 client.9261 populate_metadata read hostname 'smithi132' 2023-12-20T04:53:10.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/3480737901 >> [v2:172.21.15.132:6835/2356846201,v1:172.21.15.132:6837/2356846201] conn(0x55d8dcc09300 0x55d8dcc096e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc45f9d3740 4 client.9261 mds_command: new command op to 9117 tid=0[{"prefix": "status"}] 2023-12-20T04:53:10.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc45f9d3740 1 -- 172.21.15.132:0/3480737901 --> [v2:172.21.15.132:6835/2356846201,v1:172.21.15.132:6837/2356846201] -- command(tid 0: {"prefix": "status"}) v1 -- 0x55d8dcb081b0 con 0x55d8dcc09300 2023-12-20T04:53:10.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.048+0000 7fc45659c640 1 --2- 172.21.15.132:0/3480737901 >> [v2:172.21.15.132:6835/2356846201,v1:172.21.15.132:6837/2356846201] conn(0x55d8dcc09300 0x55d8dcc096e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.049+0000 7fc4357fa640 10 client.9261 ms_handle_connect on v2:172.21.15.132:6835/2356846201 2023-12-20T04:53:10.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.049+0000 7fc45659c640 1 --2- 172.21.15.132:0/3480737901 >> [v2:172.21.15.132:6835/2356846201,v1:172.21.15.132:6837/2356846201] conn(0x55d8dcc09300 0x55d8dcc096e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6841f69ae4444cfe server_cookie=3b0e8e2e04f7632c in_seq=0 out_seq=0 2023-12-20T04:53:10.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.049+0000 7fc4357fa640 1 -- 172.21.15.132:0/3480737901 <== mds.0 v2:172.21.15.132:6835/2356846201 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+333 (crc 0 0 0) 0x55d8dcb081b0 con 0x55d8dcc09300 2023-12-20T04:53:10.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.049+0000 7fc4357fa640 10 client.9261 handle_command_reply: tid=0 2023-12-20T04:53:10.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.049+0000 7fc45f9d3740 1 client.9261 shutdown 2023-12-20T04:53:10.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.049+0000 7fc45f9d3740 1 -- 172.21.15.132:0/3480737901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcbd3770 msgr2=0x55d8dcbca520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:10.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.049+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/3480737901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcbd3770 0x55d8dcbca520 secure :-1 s=READY pgs=1824 cs=0 l=1 rev1=1 crypto rx=0x7fc44c007900 tx=0x7fc44c000ed0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.049+0000 7fc45f9d3740 1 -- 172.21.15.132:0/3480737901 shutdown_connections 2023-12-20T04:53:10.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.049+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/3480737901 >> [v2:172.21.15.132:6835/2356846201,v1:172.21.15.132:6837/2356846201] conn(0x55d8dcc09300 0x55d8dcc096e0 crc :-1 s=READY pgs=12 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.049+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/3480737901 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x55d8dcc00dd0 0x55d8dcc0da90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.049+0000 7fc4357fa640 0 client.9261 ms_handle_reset on v2:172.21.15.132:6835/2356846201 2023-12-20T04:53:10.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.049+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/3480737901 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x55d8dcbd3770 0x55d8dcbca520 unknown :-1 s=CLOSED pgs=1824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.049+0000 7fc45f9d3740 1 --2- 172.21.15.132:0/3480737901 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x55d8dcbd3390 0x55d8dcc59fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.049+0000 7fc45f9d3740 1 -- 172.21.15.132:0/3480737901 >> 172.21.15.132:0/3480737901 conn(0x55d8dcba6a60 msgr2=0x55d8dcbcc400 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:10.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.049+0000 7fc45f9d3740 1 -- 172.21.15.132:0/3480737901 shutdown_connections 2023-12-20T04:53:10.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.049+0000 7fc45f9d3740 1 -- 172.21.15.132:0/3480737901 wait complete. 2023-12-20T04:53:10.057 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.049+0000 7fc45f9d3740 20 client.9261 trim_cache size 0 max 16384 2023-12-20T04:53:10.058 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:53:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "whoami": 0, 2023-12-20T04:53:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 9117, 2023-12-20T04:53:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "want_state": "up:active", 2023-12-20T04:53:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "state": "up:active", 2023-12-20T04:53:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs", 2023-12-20T04:53:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "rank_uptime": 5.2102716530000004, 2023-12-20T04:53:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "mdsmap_epoch": 70, 2023-12-20T04:53:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch": 186, 2023-12-20T04:53:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "osdmap_epoch_barrier": 186, 2023-12-20T04:53:10.058 INFO:teuthology.orchestra.run.smithi132.stdout: "uptime": 9.6243645139999998 2023-12-20T04:53:10.058 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:10.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.050+0000 7fc45ce5f640 1 -- 172.21.15.132:0/1801239223 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc43806a430 msgr2=0x7fc43806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:10.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.050+0000 7fc45ce5f640 1 --2- 172.21.15.132:0/1801239223 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc43806a430 0x7fc43806c8f0 secure :-1 s=READY pgs=766 cs=0 l=1 rev1=1 crypto rx=0x7fc448036000 tx=0x7fc448008030 comp rx=0 tx=0).stop 2023-12-20T04:53:10.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.050+0000 7fc45ce5f640 1 -- 172.21.15.132:0/1801239223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4580ce950 msgr2=0x7fc45815c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:10.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.050+0000 7fc45ce5f640 1 --2- 172.21.15.132:0/1801239223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4580ce950 0x7fc45815c650 secure :-1 s=READY pgs=1820 cs=0 l=1 rev1=1 crypto rx=0x7fc45000c780 tx=0x7fc45000cc40 comp rx=0 tx=0).stop 2023-12-20T04:53:10.059 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.050+0000 7fc45ce5f640 1 -- 172.21.15.132:0/1801239223 shutdown_connections 2023-12-20T04:53:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.050+0000 7fc45ce5f640 1 --2- 172.21.15.132:0/1801239223 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc43806a430 0x7fc43806c8f0 unknown :-1 s=CLOSED pgs=766 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.050+0000 7fc45ce5f640 1 --2- 172.21.15.132:0/1801239223 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc4580ce950 0x7fc45815c650 unknown :-1 s=CLOSED pgs=1820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.050+0000 7fc45ce5f640 1 --2- 172.21.15.132:0/1801239223 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc4580ca610 0x7fc45815c110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.050+0000 7fc45ce5f640 1 --2- 172.21.15.132:0/1801239223 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc45806b600 0x7fc45815ba60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.050+0000 7fc45ce5f640 1 -- 172.21.15.132:0/1801239223 >> 172.21.15.132:0/1801239223 conn(0x7fc4580cbd10 msgr2=0x7fc4580703f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.050+0000 7fc45ce5f640 1 -- 172.21.15.132:0/1801239223 shutdown_connections 2023-12-20T04:53:10.060 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.050+0000 7fc45ce5f640 1 -- 172.21.15.132:0/1801239223 wait complete. 2023-12-20T04:53:10.063 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:53:10.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.161+0000 7fbc50638640 1 Processor -- start 2023-12-20T04:53:10.163 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.161+0000 7fbc50638640 1 -- start start 2023-12-20T04:53:10.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.162+0000 7fbc50638640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc4815d100 0x7fbc480b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.164 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.162+0000 7fbc50638640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbc480d0370 0x7fbc480cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.162+0000 7fbc50638640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbc480b2f90 con 0x7fbc48161850 2023-12-20T04:53:10.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.162+0000 7fbc50638640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbc481613c0 con 0x7fbc480d0370 2023-12-20T04:53:10.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.162+0000 7fbc50638640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc480d1b00 con 0x7fbc4815d100 2023-12-20T04:53:10.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.162+0000 7fbc4dbd3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbc480d0370 0x7fbc480cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.162+0000 7fbc4dbd3640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbc480d0370 0x7fbc480cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33206/0 (socket says 172.21.15.132:33206) 2023-12-20T04:53:10.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.162+0000 7fbc4dbd3640 1 -- 172.21.15.132:0/4264324778 learned_addr learned my addr 172.21.15.132:0/4264324778 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:10.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.162+0000 7fbc4e3d4640 1 --2- 172.21.15.132:0/4264324778 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc4815d100 0x7fbc480b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.162+0000 7fbc4dbd3640 1 -- 172.21.15.132:0/4264324778 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc4815d100 msgr2=0x7fbc480b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:10.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.162+0000 7fbc4dbd3640 1 --2- 172.21.15.132:0/4264324778 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc4815d100 0x7fbc480b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.162+0000 7fbc4dbd3640 1 -- 172.21.15.132:0/4264324778 >> v1:172.21.15.187:6789/0 conn(0x7fbc48161850 legacy=0x7fbc4806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:10.165 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.162+0000 7fbc4dbd3640 1 -- 172.21.15.132:0/4264324778 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc480d0810 con 0x7fbc480d0370 2023-12-20T04:53:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.163+0000 7fbc4dbd3640 1 --2- 172.21.15.132:0/4264324778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc480d0370 0x7fbc480cd500 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009870 tx=0x7fbc3802b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74312c103fc4edb3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.163+0000 7fbc4d3d2640 1 -- 172.21.15.132:0/4264324778 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc380317c0 con 0x7fbc480d0370 2023-12-20T04:53:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.163+0000 7fbc4d3d2640 1 -- 172.21.15.132:0/4264324778 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc38031920 con 0x7fbc480d0370 2023-12-20T04:53:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.163+0000 7fbc4d3d2640 1 -- 172.21.15.132:0/4264324778 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc38031cb0 con 0x7fbc480d0370 2023-12-20T04:53:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.164+0000 7fbc50638640 1 -- 172.21.15.132:0/4264324778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc480d0370 msgr2=0x7fbc480cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.164+0000 7fbc50638640 1 --2- 172.21.15.132:0/4264324778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc480d0370 0x7fbc480cd500 secure :-1 s=READY pgs=1825 cs=0 l=1 rev1=1 crypto rx=0x7fbc38009870 tx=0x7fbc3802b860 comp rx=0 tx=0).stop 2023-12-20T04:53:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.164+0000 7fbc50638640 1 -- 172.21.15.132:0/4264324778 shutdown_connections 2023-12-20T04:53:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.164+0000 7fbc50638640 1 --2- 172.21.15.132:0/4264324778 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc480d0370 0x7fbc480cd500 unknown :-1 s=CLOSED pgs=1825 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.164+0000 7fbc50638640 1 --2- 172.21.15.132:0/4264324778 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc4815d100 0x7fbc480b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.164+0000 7fbc50638640 1 -- 172.21.15.132:0/4264324778 >> 172.21.15.132:0/4264324778 conn(0x7fbc4806d7c0 msgr2=0x7fbc4806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:10.167 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.164+0000 7fbc50638640 1 -- 172.21.15.132:0/4264324778 shutdown_connections 2023-12-20T04:53:10.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.164+0000 7fbc50638640 1 -- 172.21.15.132:0/4264324778 wait complete. 2023-12-20T04:53:10.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.165+0000 7fbc50638640 1 Processor -- start 2023-12-20T04:53:10.168 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.165+0000 7fbc50638640 1 -- start start 2023-12-20T04:53:10.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc50638640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc480d0370 0x7fbc4814d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc50638640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc4815d100 0x7fbc4815e220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc50638640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc48161850 0x7fbc4815e760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.170 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc50638640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc481504f0 con 0x7fbc4815d100 2023-12-20T04:53:10.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc50638640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4814f8e0 con 0x7fbc480d0370 2023-12-20T04:53:10.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc50638640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4814fbc0 con 0x7fbc48161850 2023-12-20T04:53:10.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc4dbd3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc4815d100 0x7fbc4815e220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc4dbd3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc4815d100 0x7fbc4815e220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33218/0 (socket says 172.21.15.132:33218) 2023-12-20T04:53:10.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc4dbd3640 1 -- 172.21.15.132:0/3201626912 learned_addr learned my addr 172.21.15.132:0/3201626912 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:10.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc4dbd3640 1 -- 172.21.15.132:0/3201626912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc48161850 msgr2=0x7fbc4815e760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:10.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc4ebd5640 1 --2- 172.21.15.132:0/3201626912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc48161850 0x7fbc4815e760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc4dbd3640 1 --2- 172.21.15.132:0/3201626912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc48161850 0x7fbc4815e760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc4e3d4640 1 --2- 172.21.15.132:0/3201626912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc480d0370 0x7fbc4814d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc4dbd3640 1 -- 172.21.15.132:0/3201626912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc480d0370 msgr2=0x7fbc4814d1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:10.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc4dbd3640 1 --2- 172.21.15.132:0/3201626912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc480d0370 0x7fbc4814d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc4dbd3640 1 -- 172.21.15.132:0/3201626912 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc380094d0 con 0x7fbc4815d100 2023-12-20T04:53:10.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc4dbd3640 1 --2- 172.21.15.132:0/3201626912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc4815d100 0x7fbc4815e220 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fbc38000c00 tx=0x7fbc380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:10.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc3effd640 1 -- 172.21.15.132:0/3201626912 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc38032860 con 0x7fbc4815d100 2023-12-20T04:53:10.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.166+0000 7fbc3effd640 1 -- 172.21.15.132:0/3201626912 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbc380329c0 con 0x7fbc4815d100 2023-12-20T04:53:10.171 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.167+0000 7fbc3effd640 1 -- 172.21.15.132:0/3201626912 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbc38032d70 con 0x7fbc4815d100 2023-12-20T04:53:10.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.167+0000 7fbc50638640 1 -- 172.21.15.132:0/3201626912 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4814fea0 con 0x7fbc4815d100 2023-12-20T04:53:10.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.167+0000 7fbc50638640 1 -- 172.21.15.132:0/3201626912 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4814d6e0 con 0x7fbc4815d100 2023-12-20T04:53:10.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.167+0000 7fbc50638640 1 -- 172.21.15.132:0/3201626912 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc48150660 con 0x7fbc4815d100 2023-12-20T04:53:10.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.168+0000 7fbc3effd640 1 -- 172.21.15.132:0/3201626912 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbc3804e450 con 0x7fbc4815d100 2023-12-20T04:53:10.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.168+0000 7fbc3effd640 1 --2- 172.21.15.132:0/3201626912 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc2c06a430 0x7fbc2c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:10.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.168+0000 7fbc3effd640 1 -- 172.21.15.132:0/3201626912 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbc380aa980 con 0x7fbc4815d100 2023-12-20T04:53:10.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.168+0000 7fbc4e3d4640 1 --2- 172.21.15.132:0/3201626912 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc2c06a430 0x7fbc2c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:10.172 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.169+0000 7fbc4e3d4640 1 --2- 172.21.15.132:0/3201626912 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc2c06a430 0x7fbc2c06c8f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbc44006fd0 tx=0x7fbc44008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:10.174 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.173+0000 7fbc3effd640 1 -- 172.21.15.132:0/3201626912 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbc38076020 con 0x7fbc4815d100 2023-12-20T04:53:10.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.373+0000 7fbc50638640 1 -- 172.21.15.132:0/3201626912 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7fbc480b2f90 con 0x7fbc4815d100 2023-12-20T04:53:10.375 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.373+0000 7fbc3effd640 1 -- 172.21.15.132:0/3201626912 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+73 (secure 0 0 0) 0x7fbc480b2f90 con 0x7fbc4815d100 2023-12-20T04:53:10.375 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:53:10.377 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.375+0000 7fbc50638640 1 -- 172.21.15.132:0/3201626912 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc2c06a430 msgr2=0x7fbc2c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:10.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.375+0000 7fbc50638640 1 --2- 172.21.15.132:0/3201626912 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc2c06a430 0x7fbc2c06c8f0 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7fbc44006fd0 tx=0x7fbc44008040 comp rx=0 tx=0).stop 2023-12-20T04:53:10.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.375+0000 7fbc50638640 1 -- 172.21.15.132:0/3201626912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc4815d100 msgr2=0x7fbc4815e220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:10.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.375+0000 7fbc50638640 1 --2- 172.21.15.132:0/3201626912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc4815d100 0x7fbc4815e220 secure :-1 s=READY pgs=1826 cs=0 l=1 rev1=1 crypto rx=0x7fbc38000c00 tx=0x7fbc380046c0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.375+0000 7fbc50638640 1 -- 172.21.15.132:0/3201626912 shutdown_connections 2023-12-20T04:53:10.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.375+0000 7fbc50638640 1 --2- 172.21.15.132:0/3201626912 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbc2c06a430 0x7fbc2c06c8f0 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.375+0000 7fbc50638640 1 --2- 172.21.15.132:0/3201626912 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbc48161850 0x7fbc4815e760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.375+0000 7fbc50638640 1 --2- 172.21.15.132:0/3201626912 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbc4815d100 0x7fbc4815e220 unknown :-1 s=CLOSED pgs=1826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.375+0000 7fbc50638640 1 --2- 172.21.15.132:0/3201626912 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbc480d0370 0x7fbc4814d1a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:10.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.375+0000 7fbc50638640 1 -- 172.21.15.132:0/3201626912 >> 172.21.15.132:0/3201626912 conn(0x7fbc4806d7c0 msgr2=0x7fbc480b1800 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:10.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.375+0000 7fbc50638640 1 -- 172.21.15.132:0/3201626912 shutdown_connections 2023-12-20T04:53:10.378 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:10.375+0000 7fbc50638640 1 -- 172.21.15.132:0/3201626912 wait complete. 2023-12-20T04:53:10.388 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:53:10.388 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:53:10.388 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi132.front.sepia.ceph.com 2023-12-20T04:53:10.388 INFO:tasks.cephfs.mount:self.client.name = client.0 2023-12-20T04:53:10.388 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2023-12-20T04:53:10.388 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:53:10.388 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:53:10.388 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:53:10.389 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:53:10.389 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:10.389 DEBUG:teuthology.orchestra.run.smithi132:> ip addr 2023-12-20T04:53:10.404 INFO:teuthology.orchestra.run.smithi132.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:53:10.404 INFO:teuthology.orchestra.run.smithi132.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:53:10.404 INFO:teuthology.orchestra.run.smithi132.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:53:10.404 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:53:10.404 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 ::1/128 scope host 2023-12-20T04:53:10.404 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:53:10.405 INFO:teuthology.orchestra.run.smithi132.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:53:10.405 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:53:10.405 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f0 2023-12-20T04:53:10.405 INFO:teuthology.orchestra.run.smithi132.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:53:10.405 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:d9:35:cd brd ff:ff:ff:ff:ff:ff 2023-12-20T04:53:10.405 INFO:teuthology.orchestra.run.smithi132.stdout: altname enp7s0f1 2023-12-20T04:53:10.405 INFO:teuthology.orchestra.run.smithi132.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:53:10.405 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3e brd ff:ff:ff:ff:ff:ff 2023-12-20T04:53:10.405 INFO:teuthology.orchestra.run.smithi132.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:53:10.405 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0c:c4:7a:88:77:3f brd ff:ff:ff:ff:ff:ff 2023-12-20T04:53:10.405 INFO:teuthology.orchestra.run.smithi132.stdout: inet 172.21.15.132/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:53:10.405 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft 42084sec preferred_lft 42084sec 2023-12-20T04:53:10.405 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::ec4:7aff:fe88:773f/64 scope link 2023-12-20T04:53:10.405 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:53:10.405 INFO:teuthology.orchestra.run.smithi132.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:53:10.405 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:53:10.406 INFO:teuthology.orchestra.run.smithi132.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:53:10.406 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:53:10.406 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::60dd:37ff:fe28:558b/64 scope link 2023-12-20T04:53:10.406 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:53:10.406 INFO:teuthology.orchestra.run.smithi132.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:53:10.406 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 86:13:fe:55:4c:04 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-20T04:53:10.406 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::8413:feff:fe55:4c04/64 scope link 2023-12-20T04:53:10.406 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:53:10.406 INFO:teuthology.orchestra.run.smithi132.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:53:10.406 INFO:teuthology.orchestra.run.smithi132.stdout: link/ether 0a:39:72:a7:b3:32 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-20T04:53:10.406 INFO:teuthology.orchestra.run.smithi132.stdout: inet6 fe80::839:72ff:fea7:b332/64 scope link 2023-12-20T04:53:10.406 INFO:teuthology.orchestra.run.smithi132.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:53:10.406 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:10.407 DEBUG:teuthology.orchestra.run.smithi132:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:53:10.470 INFO:teuthology.orchestra.run.smithi132.stdout:1 2023-12-20T04:53:10.471 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:10.471 DEBUG:teuthology.orchestra.run.smithi132:> route 2023-12-20T04:53:10.527 INFO:teuthology.orchestra.run.smithi132.stdout:Kernel IP routing table 2023-12-20T04:53:10.527 INFO:teuthology.orchestra.run.smithi132.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:53:10.527 INFO:teuthology.orchestra.run.smithi132.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:53:10.527 INFO:teuthology.orchestra.run.smithi132.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:53:10.528 INFO:teuthology.orchestra.run.smithi132.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:53:10.528 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:10.528 DEBUG:teuthology.orchestra.run.smithi132:> (cd / && exec bash -c ' 2023-12-20T04:53:10.528 DEBUG:teuthology.orchestra.run.smithi132:> set -e 2023-12-20T04:53:10.528 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:53:10.528 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:53:10.528 DEBUG:teuthology.orchestra.run.smithi132:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:53:10.528 DEBUG:teuthology.orchestra.run.smithi132:> ') 2023-12-20T04:53:10.623 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:10.623 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-20T04:53:10.637 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-20T04:53:10.637 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-20T04:53:10.638 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.0' netns for '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:53:10.638 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:10.638 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link set brx.0 up 2023-12-20T04:53:10.704 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2023-12-20T04:53:10.704 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:53:10.704 DEBUG:teuthology.orchestra.run.smithi132:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2023-12-20T04:53:10.759 INFO:teuthology.orchestra.run.smithi132.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2023-12-20T04:53:10.760 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:53:10.760 DEBUG:teuthology.orchestra.run.smithi132:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:53:10.813 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:53:10.880 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:53:10.880 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:53:10.947 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:53:10.948 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:53:10.948 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:10.948 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:53:11.003 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:53:11.003 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2023-12-20T04:53:11.046 DEBUG:teuthology.orchestra.run.smithi132:> sudo modprobe fuse 2023-12-20T04:53:11.071 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:53:11.071 DEBUG:teuthology.orchestra.run.smithi132:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:53:11.130 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:2023-12-20T04:53:11.128+0000 7f8f0f4f6480 -1 init, newargv = 0x556a0c68f6e0 newargc=15 2023-12-20T04:53:11.131 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[123846]: starting ceph client 2023-12-20T04:53:11.134 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[123846]: starting fuse 2023-12-20T04:53:11.140 INFO:teuthology.orchestra.run.smithi132.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:53:11.140 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:53:11.141 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:11.141 DEBUG:teuthology.orchestra.run.smithi132:> ls /sys/fs/fuse/connections 2023-12-20T04:53:11.195 INFO:teuthology.orchestra.run.smithi132.stdout:41 2023-12-20T04:53:11.195 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:53:11.195 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:53:11.196 DEBUG:teuthology.orchestra.run.smithi132:> import glob 2023-12-20T04:53:11.196 DEBUG:teuthology.orchestra.run.smithi132:> import re 2023-12-20T04:53:11.196 DEBUG:teuthology.orchestra.run.smithi132:> import os 2023-12-20T04:53:11.196 DEBUG:teuthology.orchestra.run.smithi132:> import subprocess 2023-12-20T04:53:11.196 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:53:11.196 DEBUG:teuthology.orchestra.run.smithi132:> def _find_admin_socket(client_name): 2023-12-20T04:53:11.196 DEBUG:teuthology.orchestra.run.smithi132:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2023-12-20T04:53:11.196 DEBUG:teuthology.orchestra.run.smithi132:> files = glob.glob(asok_path) 2023-12-20T04:53:11.196 DEBUG:teuthology.orchestra.run.smithi132:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2023-12-20T04:53:11.196 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:53:11.196 DEBUG:teuthology.orchestra.run.smithi132:> # Given a non-glob path, it better be there 2023-12-20T04:53:11.196 DEBUG:teuthology.orchestra.run.smithi132:> if "*" not in asok_path: 2023-12-20T04:53:11.196 DEBUG:teuthology.orchestra.run.smithi132:> assert(len(files) == 1) 2023-12-20T04:53:11.196 DEBUG:teuthology.orchestra.run.smithi132:> return files[0] 2023-12-20T04:53:11.196 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:53:11.197 DEBUG:teuthology.orchestra.run.smithi132:> for f in files: 2023-12-20T04:53:11.197 DEBUG:teuthology.orchestra.run.smithi132:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:53:11.197 DEBUG:teuthology.orchestra.run.smithi132:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:53:11.197 DEBUG:teuthology.orchestra.run.smithi132:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:53:11.197 DEBUG:teuthology.orchestra.run.smithi132:> contents = proc_f.read() 2023-12-20T04:53:11.197 DEBUG:teuthology.orchestra.run.smithi132:> if mountpoint in contents: 2023-12-20T04:53:11.197 DEBUG:teuthology.orchestra.run.smithi132:> return f 2023-12-20T04:53:11.197 DEBUG:teuthology.orchestra.run.smithi132:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:53:11.197 DEBUG:teuthology.orchestra.run.smithi132:> 2023-12-20T04:53:11.197 DEBUG:teuthology.orchestra.run.smithi132:> print(_find_admin_socket("client.0")) 2023-12-20T04:53:11.197 DEBUG:teuthology.orchestra.run.smithi132:> ' 2023-12-20T04:53:11.311 INFO:teuthology.orchestra.run.smithi132.stdout:/var/run/ceph/ceph-client.0.123846.asok 2023-12-20T04:53:11.497 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.123846.asok 2023-12-20T04:53:11.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:11.498 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.123846.asok status 2023-12-20T04:53:11.631 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:11.631 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": { 2023-12-20T04:53:11.631 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:53:11.632 INFO:teuthology.orchestra.run.smithi132.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:53:11.632 INFO:teuthology.orchestra.run.smithi132.stdout: "entity_id": "0", 2023-12-20T04:53:11.632 INFO:teuthology.orchestra.run.smithi132.stdout: "hostname": "smithi132", 2023-12-20T04:53:11.632 INFO:teuthology.orchestra.run.smithi132.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2023-12-20T04:53:11.632 INFO:teuthology.orchestra.run.smithi132.stdout: "pid": "123846", 2023-12-20T04:53:11.632 INFO:teuthology.orchestra.run.smithi132.stdout: "root": "/" 2023-12-20T04:53:11.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:11.632 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_count": 0, 2023-12-20T04:53:11.632 INFO:teuthology.orchestra.run.smithi132.stdout: "dentry_pinned_count": 0, 2023-12-20T04:53:11.632 INFO:teuthology.orchestra.run.smithi132.stdout: "id": 9276, 2023-12-20T04:53:11.632 INFO:teuthology.orchestra.run.smithi132.stdout: "inst": { 2023-12-20T04:53:11.632 INFO:teuthology.orchestra.run.smithi132.stdout: "name": { 2023-12-20T04:53:11.632 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "client", 2023-12-20T04:53:11.632 INFO:teuthology.orchestra.run.smithi132.stdout: "num": 9276 2023-12-20T04:53:11.632 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:11.632 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:53:11.633 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:11.633 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:53:11.633 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 316304784 2023-12-20T04:53:11.633 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:11.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:11.633 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": { 2023-12-20T04:53:11.633 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:11.633 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:53:11.633 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 316304784 2023-12-20T04:53:11.633 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:11.633 INFO:teuthology.orchestra.run.smithi132.stdout: "inst_str": "client.9276 192.168.0.1:0/316304784", 2023-12-20T04:53:11.633 INFO:teuthology.orchestra.run.smithi132.stdout: "addr_str": "192.168.0.1:0/316304784", 2023-12-20T04:53:11.633 INFO:teuthology.orchestra.run.smithi132.stdout: "inode_count": 1, 2023-12-20T04:53:11.633 INFO:teuthology.orchestra.run.smithi132.stdout: "mds_epoch": 70, 2023-12-20T04:53:11.633 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch": 186, 2023-12-20T04:53:11.634 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:53:11.634 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklisted": false, 2023-12-20T04:53:11.634 INFO:teuthology.orchestra.run.smithi132.stdout: "fs_name": "cephfs" 2023-12-20T04:53:11.634 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:11.640 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:11.640 DEBUG:teuthology.orchestra.run.smithi132:> stat --file-system '--printf=%T 2023-12-20T04:53:11.640 DEBUG:teuthology.orchestra.run.smithi132:> ' -- /home/ubuntu/cephtest/mnt.0 2023-12-20T04:53:11.655 INFO:teuthology.orchestra.run.smithi132.stdout:fuseblk 2023-12-20T04:53:11.655 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2023-12-20T04:53:11.655 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:11.655 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2023-12-20T04:53:11.723 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2023-12-20T04:53:11.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.861+0000 7f985e716640 1 Processor -- start 2023-12-20T04:53:11.863 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.861+0000 7f985e716640 1 -- start start 2023-12-20T04:53:11.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f985e716640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985815d100 0x7f98580b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:11.865 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f985e716640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98580b2f90 con 0x7f98580d0370 2023-12-20T04:53:11.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f985e716640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f98581613c0 con 0x7f98580cdc10 2023-12-20T04:53:11.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f985e716640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98580d1b00 con 0x7f985815d100 2023-12-20T04:53:11.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f98577fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f98580d0370 0x7f98580cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:51252/0 (socket says 172.21.15.132:51252) 2023-12-20T04:53:11.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f98577fe640 1 -- 172.21.15.132:0/402151226 learned_addr learned my addr 172.21.15.132:0/402151226 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:11.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f9856ffd640 1 -- 172.21.15.132:0/402151226 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3644396371 0 0) 0x7f984c001110 con 0x7f98580d0370 2023-12-20T04:53:11.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f9857fff640 1 --2- 172.21.15.132:0/402151226 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985815d100 0x7f98580b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:11.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f9856ffd640 1 -- 172.21.15.132:0/402151226 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9840003520 con 0x7f98580d0370 2023-12-20T04:53:11.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f9856ffd640 1 -- 172.21.15.132:0/402151226 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2802241971 0 0) 0x7f9840003520 con 0x7f98580d0370 2023-12-20T04:53:11.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f9856ffd640 1 -- 172.21.15.132:0/402151226 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985815d100 msgr2=0x7f98580b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:11.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f9856ffd640 1 --2- 172.21.15.132:0/402151226 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985815d100 0x7f98580b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:11.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f9856ffd640 1 -- 172.21.15.132:0/402151226 >> v1:172.21.15.187:6789/0 conn(0x7f98580cdc10 legacy=0x7f985806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:11.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f9856ffd640 1 -- 172.21.15.132:0/402151226 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98580d0810 con 0x7f98580d0370 2023-12-20T04:53:11.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f9856ffd640 1 -- 172.21.15.132:0/402151226 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f984c001800 con 0x7f98580d0370 2023-12-20T04:53:11.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f9856ffd640 1 -- 172.21.15.132:0/402151226 >> v1:172.21.15.132:6789/0 conn(0x7f98580d0370 legacy=0x7f98580cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:11.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f9856ffd640 1 --2- 172.21.15.132:0/402151226 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985815d100 0x7f98400039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:11.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f9856ffd640 1 --2- 172.21.15.132:0/402151226 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9840003fd0 0x7f98400047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:11.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f9856ffd640 1 --2- 172.21.15.132:0/402151226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9840004d00 0x7f9840005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:11.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f9856ffd640 1 -- 172.21.15.132:0/402151226 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98580d1b00 con 0x7f9840003fd0 2023-12-20T04:53:11.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f9856ffd640 1 -- 172.21.15.132:0/402151226 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f984000bbc0 con 0x7f9840004d00 2023-12-20T04:53:11.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.862+0000 7f9856ffd640 1 -- 172.21.15.132:0/402151226 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f984000bd80 con 0x7f985815d100 2023-12-20T04:53:11.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.863+0000 7f98577fe640 1 --2- 172.21.15.132:0/402151226 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9840003fd0 0x7f98400047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:11.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.863+0000 7f9857fff640 1 --2- 172.21.15.132:0/402151226 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985815d100 0x7f98400039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:11.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.863+0000 7f985ccb3640 1 --2- 172.21.15.132:0/402151226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9840004d00 0x7f9840005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:11.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.863+0000 7f98577fe640 1 -- 172.21.15.132:0/402151226 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985815d100 msgr2=0x7f98400039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:11.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.863+0000 7f98577fe640 1 --2- 172.21.15.132:0/402151226 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f985815d100 0x7f98400039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:11.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.863+0000 7f98577fe640 1 -- 172.21.15.132:0/402151226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9840004d00 msgr2=0x7f9840005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:11.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.863+0000 7f98577fe640 1 --2- 172.21.15.132:0/402151226 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9840004d00 0x7f9840005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:11.867 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.863+0000 7f98577fe640 1 -- 172.21.15.132:0/402151226 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9840003520 con 0x7f9840003fd0 2023-12-20T04:53:11.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.864+0000 7f98577fe640 1 --2- 172.21.15.132:0/402151226 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9840003fd0 0x7f98400047c0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f984c00c240 tx=0x7f98400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b3c084a179bb4d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:11.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.864+0000 7f9856ffd640 1 -- 172.21.15.132:0/402151226 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c005ad0 con 0x7f9840003fd0 2023-12-20T04:53:11.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.864+0000 7f9856ffd640 1 -- 172.21.15.132:0/402151226 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f984c005c50 con 0x7f9840003fd0 2023-12-20T04:53:11.868 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.864+0000 7f9856ffd640 1 -- 172.21.15.132:0/402151226 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f984c02c8b0 con 0x7f9840003fd0 2023-12-20T04:53:11.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.864+0000 7f985e716640 1 -- 172.21.15.132:0/402151226 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9840003fd0 msgr2=0x7f98400047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:11.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.864+0000 7f985e716640 1 --2- 172.21.15.132:0/402151226 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9840003fd0 0x7f98400047c0 secure :-1 s=READY pgs=1831 cs=0 l=1 rev1=1 crypto rx=0x7f984c00c240 tx=0x7f98400057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:11.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.864+0000 7f985ccb3640 1 -- 172.21.15.132:0/402151226 reap_dead start 2023-12-20T04:53:11.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.864+0000 7f985e716640 1 -- 172.21.15.132:0/402151226 shutdown_connections 2023-12-20T04:53:11.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.864+0000 7f985e716640 1 -- 172.21.15.132:0/402151226 >> 172.21.15.132:0/402151226 conn(0x7f985806d7c0 msgr2=0x7f985806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:11.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.864+0000 7f985e716640 1 -- 172.21.15.132:0/402151226 shutdown_connections 2023-12-20T04:53:11.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.864+0000 7f985e716640 1 -- 172.21.15.132:0/402151226 wait complete. 2023-12-20T04:53:11.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.865+0000 7f985e716640 1 Processor -- start 2023-12-20T04:53:11.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.866+0000 7f985e716640 1 -- start start 2023-12-20T04:53:11.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.866+0000 7f985e716640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9840003fd0 0x7f9858154170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:11.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.866+0000 7f985e716640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98580ca780 0x7f985806bd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:11.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.866+0000 7f985e716640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985806c2d0 0x7f9858159200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:11.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.866+0000 7f985e716640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f985806c750 con 0x7f985806c2d0 2023-12-20T04:53:11.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.866+0000 7f985e716640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98580c8e90 con 0x7f98580ca780 2023-12-20T04:53:11.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.866+0000 7f985e716640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f98580c8280 con 0x7f9840003fd0 2023-12-20T04:53:11.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.866+0000 7f985ccb3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985806c2d0 0x7f9858159200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:11.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.866+0000 7f985ccb3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985806c2d0 0x7f9858159200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33236/0 (socket says 172.21.15.132:33236) 2023-12-20T04:53:11.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.866+0000 7f985ccb3640 1 -- 172.21.15.132:0/390083932 learned_addr learned my addr 172.21.15.132:0/390083932 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:11.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.866+0000 7f98577fe640 1 --2- 172.21.15.132:0/390083932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98580ca780 0x7f985806bd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:11.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.867+0000 7f9857fff640 1 --2- 172.21.15.132:0/390083932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9840003fd0 0x7f9858154170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:11.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.867+0000 7f985ccb3640 1 -- 172.21.15.132:0/390083932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9840003fd0 msgr2=0x7f9858154170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:11.872 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.867+0000 7f985ccb3640 1 --2- 172.21.15.132:0/390083932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9840003fd0 0x7f9858154170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:11.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.867+0000 7f985ccb3640 1 -- 172.21.15.132:0/390083932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98580ca780 msgr2=0x7f985806bd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:11.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.867+0000 7f985ccb3640 1 --2- 172.21.15.132:0/390083932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98580ca780 0x7f985806bd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:11.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.867+0000 7f985ccb3640 1 -- 172.21.15.132:0/390083932 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98580c8560 con 0x7f985806c2d0 2023-12-20T04:53:11.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.867+0000 7f98577fe640 1 --2- 172.21.15.132:0/390083932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98580ca780 0x7f985806bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:11.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.867+0000 7f985ccb3640 1 --2- 172.21.15.132:0/390083932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985806c2d0 0x7f9858159200 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f98580b0680 tx=0x7f985000fd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:11.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.867+0000 7f9854ff9640 1 -- 172.21.15.132:0/390083932 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850003b80 con 0x7f985806c2d0 2023-12-20T04:53:11.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.867+0000 7f9854ff9640 1 -- 172.21.15.132:0/390083932 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9850003d00 con 0x7f985806c2d0 2023-12-20T04:53:11.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.867+0000 7f985e716640 1 -- 172.21.15.132:0/390083932 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98580c8840 con 0x7f985806c2d0 2023-12-20T04:53:11.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.867+0000 7f9854ff9640 1 -- 172.21.15.132:0/390083932 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9850005310 con 0x7f985806c2d0 2023-12-20T04:53:11.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.867+0000 7f985e716640 1 -- 172.21.15.132:0/390083932 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9858154a70 con 0x7f985806c2d0 2023-12-20T04:53:11.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.868+0000 7f985e716640 1 -- 172.21.15.132:0/390083932 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f985804e840 con 0x7f985806c2d0 2023-12-20T04:53:11.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.868+0000 7f9854ff9640 1 -- 172.21.15.132:0/390083932 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9850005470 con 0x7f985806c2d0 2023-12-20T04:53:11.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.869+0000 7f9854ff9640 1 --2- 172.21.15.132:0/390083932 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f984406a460 0x7f984406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:11.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.869+0000 7f9854ff9640 1 -- 172.21.15.132:0/390083932 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9850088810 con 0x7f985806c2d0 2023-12-20T04:53:11.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.869+0000 7f9857fff640 1 --2- 172.21.15.132:0/390083932 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f984406a460 0x7f984406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:11.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.869+0000 7f9857fff640 1 --2- 172.21.15.132:0/390083932 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f984406a460 0x7f984406c920 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9848006fd0 tx=0x7f9848008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:11.875 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:11.873+0000 7f9854ff9640 1 -- 172.21.15.132:0/390083932 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9850053e00 con 0x7f985806c2d0 2023-12-20T04:53:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:12.073+0000 7f985e716640 1 -- 172.21.15.132:0/390083932 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f98580c8fd0 con 0x7f985806c2d0 2023-12-20T04:53:12.076 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:12.074+0000 7f9854ff9640 1 -- 172.21.15.132:0/390083932 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v70) v1 ==== 53+0+73 (secure 0 0 0) 0x7f9850057420 con 0x7f985806c2d0 2023-12-20T04:53:12.076 INFO:teuthology.orchestra.run.smithi132.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data ] 2023-12-20T04:53:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:12.075+0000 7f985e716640 1 -- 172.21.15.132:0/390083932 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f984406a460 msgr2=0x7f984406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:12.076+0000 7f985e716640 1 --2- 172.21.15.132:0/390083932 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f984406a460 0x7f984406c920 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f9848006fd0 tx=0x7f9848008040 comp rx=0 tx=0).stop 2023-12-20T04:53:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:12.076+0000 7f985e716640 1 -- 172.21.15.132:0/390083932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985806c2d0 msgr2=0x7f9858159200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:12.076+0000 7f985e716640 1 --2- 172.21.15.132:0/390083932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985806c2d0 0x7f9858159200 secure :-1 s=READY pgs=1832 cs=0 l=1 rev1=1 crypto rx=0x7f98580b0680 tx=0x7f985000fd40 comp rx=0 tx=0).stop 2023-12-20T04:53:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:12.076+0000 7f985e716640 1 -- 172.21.15.132:0/390083932 shutdown_connections 2023-12-20T04:53:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:12.076+0000 7f985e716640 1 --2- 172.21.15.132:0/390083932 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f984406a460 0x7f984406c920 unknown :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:12.076+0000 7f985e716640 1 --2- 172.21.15.132:0/390083932 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f985806c2d0 0x7f9858159200 unknown :-1 s=CLOSED pgs=1832 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:12.076+0000 7f985e716640 1 --2- 172.21.15.132:0/390083932 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f98580ca780 0x7f985806bd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:12.076+0000 7f985e716640 1 --2- 172.21.15.132:0/390083932 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9840003fd0 0x7f9858154170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:12.076+0000 7f985e716640 1 -- 172.21.15.132:0/390083932 >> 172.21.15.132:0/390083932 conn(0x7f985806d7c0 msgr2=0x7f98580cb3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:12.076+0000 7f985e716640 1 -- 172.21.15.132:0/390083932 shutdown_connections 2023-12-20T04:53:12.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:12.076+0000 7f985e716640 1 -- 172.21.15.132:0/390083932 wait complete. 2023-12-20T04:53:12.089 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2023-12-20T04:53:12.089 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2023-12-20T04:53:12.089 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi187.front.sepia.ceph.com 2023-12-20T04:53:12.089 INFO:tasks.cephfs.mount:self.client.name = client.1 2023-12-20T04:53:12.089 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2023-12-20T04:53:12.089 INFO:tasks.cephfs.mount:self.cephfs_name = None 2023-12-20T04:53:12.089 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2023-12-20T04:53:12.089 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2023-12-20T04:53:12.089 INFO:tasks.cephfs.mount:Setting the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:53:12.089 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:12.089 DEBUG:teuthology.orchestra.run.smithi187:> ip addr 2023-12-20T04:53:12.108 INFO:teuthology.orchestra.run.smithi187.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2023-12-20T04:53:12.108 INFO:teuthology.orchestra.run.smithi187.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2023-12-20T04:53:12.108 INFO:teuthology.orchestra.run.smithi187.stdout: inet 127.0.0.1/8 scope host lo 2023-12-20T04:53:12.109 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:53:12.109 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 ::1/128 scope host 2023-12-20T04:53:12.109 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:53:12.109 INFO:teuthology.orchestra.run.smithi187.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:53:12.109 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:78 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:53:12.109 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f0 2023-12-20T04:53:12.109 INFO:teuthology.orchestra.run.smithi187.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:53:12.109 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:d9:36:79 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:53:12.109 INFO:teuthology.orchestra.run.smithi187.stdout: altname enp7s0f1 2023-12-20T04:53:12.109 INFO:teuthology.orchestra.run.smithi187.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2023-12-20T04:53:12.109 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b0 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:53:12.109 INFO:teuthology.orchestra.run.smithi187.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2023-12-20T04:53:12.109 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 0c:c4:7a:88:77:b1 brd ff:ff:ff:ff:ff:ff 2023-12-20T04:53:12.109 INFO:teuthology.orchestra.run.smithi187.stdout: inet 172.21.15.187/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2023-12-20T04:53:12.109 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft 42093sec preferred_lft 42093sec 2023-12-20T04:53:12.109 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::ec4:7aff:fe88:77b1/64 scope link 2023-12-20T04:53:12.110 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:53:12.110 INFO:teuthology.orchestra.run.smithi187.stdout:6: ceph-brx: mtu 1500 qdisc noqueue state UP group default qlen 1000 2023-12-20T04:53:12.110 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff 2023-12-20T04:53:12.110 INFO:teuthology.orchestra.run.smithi187.stdout: inet 192.168.255.254/16 brd 192.168.255.255 scope global ceph-brx 2023-12-20T04:53:12.110 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:53:12.110 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::a8bc:1cff:fe40:54ea/64 scope link 2023-12-20T04:53:12.110 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:53:12.110 INFO:teuthology.orchestra.run.smithi187.stdout:7: brx.0@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:53:12.110 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether 8e:8e:c0:7a:0b:dc brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-20T04:53:12.110 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::8c8e:c0ff:fe7a:bdc/64 scope link 2023-12-20T04:53:12.110 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:53:12.110 INFO:teuthology.orchestra.run.smithi187.stdout:8: brx.1@if2: mtu 1500 qdisc noqueue master ceph-brx state UP group default qlen 1000 2023-12-20T04:53:12.110 INFO:teuthology.orchestra.run.smithi187.stdout: link/ether be:98:9a:6f:62:82 brd ff:ff:ff:ff:ff:ff link-netns ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-20T04:53:12.110 INFO:teuthology.orchestra.run.smithi187.stdout: inet6 fe80::bc98:9aff:fe6f:6282/64 scope link 2023-12-20T04:53:12.110 INFO:teuthology.orchestra.run.smithi187.stdout: valid_lft forever preferred_lft forever 2023-12-20T04:53:12.111 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:12.111 DEBUG:teuthology.orchestra.run.smithi187:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2023-12-20T04:53:12.178 INFO:teuthology.orchestra.run.smithi187.stdout:1 2023-12-20T04:53:12.180 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:12.180 DEBUG:teuthology.orchestra.run.smithi187:> route 2023-12-20T04:53:12.239 INFO:teuthology.orchestra.run.smithi187.stdout:Kernel IP routing table 2023-12-20T04:53:12.239 INFO:teuthology.orchestra.run.smithi187.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2023-12-20T04:53:12.239 INFO:teuthology.orchestra.run.smithi187.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2023-12-20T04:53:12.239 INFO:teuthology.orchestra.run.smithi187.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2023-12-20T04:53:12.239 INFO:teuthology.orchestra.run.smithi187.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2023-12-20T04:53:12.239 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:12.239 DEBUG:teuthology.orchestra.run.smithi187:> (cd / && exec bash -c ' 2023-12-20T04:53:12.239 DEBUG:teuthology.orchestra.run.smithi187:> set -e 2023-12-20T04:53:12.240 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2023-12-20T04:53:12.240 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2023-12-20T04:53:12.240 DEBUG:teuthology.orchestra.run.smithi187:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2023-12-20T04:53:12.240 DEBUG:teuthology.orchestra.run.smithi187:> ') 2023-12-20T04:53:12.339 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:12.339 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-20T04:53:12.354 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-20T04:53:12.354 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-20T04:53:12.354 INFO:tasks.cephfs.mount:Resuming the 'ceph-ns--home-ubuntu-cephtest-mnt.1' netns for '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:53:12.354 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:12.355 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link set brx.0 up 2023-12-20T04:53:12.424 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2023-12-20T04:53:12.424 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:53:12.424 DEBUG:teuthology.orchestra.run.smithi187:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2023-12-20T04:53:12.480 INFO:teuthology.orchestra.run.smithi187.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2023-12-20T04:53:12.480 INFO:teuthology.orchestra.run:Running command with timeout 60 2023-12-20T04:53:12.481 DEBUG:teuthology.orchestra.run.smithi187:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:53:12.535 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:53:12.603 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:53:12.603 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:53:12.669 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:53:12.670 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:53:12.671 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:12.671 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:53:12.726 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2023-12-20T04:53:12.726 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2023-12-20T04:53:12.769 DEBUG:teuthology.orchestra.run.smithi187:> sudo modprobe fuse 2023-12-20T04:53:12.795 INFO:teuthology.orchestra.run:Running command with timeout 30 2023-12-20T04:53:12.795 DEBUG:teuthology.orchestra.run.smithi187:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2023-12-20T04:53:12.855 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:2023-12-20T04:53:12.853+0000 7fc389a39480 -1 init, newargv = 0x555fc03016d0 newargc=15 2023-12-20T04:53:12.855 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[92721]: starting ceph client 2023-12-20T04:53:12.860 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[92721]: starting fuse 2023-12-20T04:53:12.864 INFO:teuthology.orchestra.run.smithi187.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2023-12-20T04:53:12.865 DEBUG:teuthology.orchestra.run:got remote process result: 32 2023-12-20T04:53:12.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:12.866 DEBUG:teuthology.orchestra.run.smithi187:> ls /sys/fs/fuse/connections 2023-12-20T04:53:12.921 INFO:teuthology.orchestra.run.smithi187.stdout:41 2023-12-20T04:53:12.922 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [41] 2023-12-20T04:53:12.922 DEBUG:teuthology.orchestra.run.smithi187:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2023-12-20T04:53:12.922 DEBUG:teuthology.orchestra.run.smithi187:> import glob 2023-12-20T04:53:12.922 DEBUG:teuthology.orchestra.run.smithi187:> import re 2023-12-20T04:53:12.922 DEBUG:teuthology.orchestra.run.smithi187:> import os 2023-12-20T04:53:12.922 DEBUG:teuthology.orchestra.run.smithi187:> import subprocess 2023-12-20T04:53:12.922 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:53:12.922 DEBUG:teuthology.orchestra.run.smithi187:> def _find_admin_socket(client_name): 2023-12-20T04:53:12.922 DEBUG:teuthology.orchestra.run.smithi187:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2023-12-20T04:53:12.922 DEBUG:teuthology.orchestra.run.smithi187:> files = glob.glob(asok_path) 2023-12-20T04:53:12.922 DEBUG:teuthology.orchestra.run.smithi187:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2023-12-20T04:53:12.922 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:53:12.922 DEBUG:teuthology.orchestra.run.smithi187:> # Given a non-glob path, it better be there 2023-12-20T04:53:12.922 DEBUG:teuthology.orchestra.run.smithi187:> if "*" not in asok_path: 2023-12-20T04:53:12.923 DEBUG:teuthology.orchestra.run.smithi187:> assert(len(files) == 1) 2023-12-20T04:53:12.923 DEBUG:teuthology.orchestra.run.smithi187:> return files[0] 2023-12-20T04:53:12.923 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:53:12.923 DEBUG:teuthology.orchestra.run.smithi187:> for f in files: 2023-12-20T04:53:12.923 DEBUG:teuthology.orchestra.run.smithi187:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2023-12-20T04:53:12.923 DEBUG:teuthology.orchestra.run.smithi187:> if os.path.exists("/proc/{0}".format(pid)): 2023-12-20T04:53:12.923 DEBUG:teuthology.orchestra.run.smithi187:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2023-12-20T04:53:12.923 DEBUG:teuthology.orchestra.run.smithi187:> contents = proc_f.read() 2023-12-20T04:53:12.923 DEBUG:teuthology.orchestra.run.smithi187:> if mountpoint in contents: 2023-12-20T04:53:12.923 DEBUG:teuthology.orchestra.run.smithi187:> return f 2023-12-20T04:53:12.923 DEBUG:teuthology.orchestra.run.smithi187:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2023-12-20T04:53:12.923 DEBUG:teuthology.orchestra.run.smithi187:> 2023-12-20T04:53:12.923 DEBUG:teuthology.orchestra.run.smithi187:> print(_find_admin_socket("client.1")) 2023-12-20T04:53:12.923 DEBUG:teuthology.orchestra.run.smithi187:> ' 2023-12-20T04:53:13.037 INFO:teuthology.orchestra.run.smithi187.stdout:/var/run/ceph/ceph-client.1.92721.asok 2023-12-20T04:53:13.223 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.92721.asok 2023-12-20T04:53:13.223 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:13.224 DEBUG:teuthology.orchestra.run.smithi187:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.92721.asok status 2023-12-20T04:53:13.358 INFO:teuthology.orchestra.run.smithi187.stdout:{ 2023-12-20T04:53:13.358 INFO:teuthology.orchestra.run.smithi187.stdout: "metadata": { 2023-12-20T04:53:13.358 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_sha1": "568df92b7e50b2108bce4c77c393ff294d6a5e5e", 2023-12-20T04:53:13.358 INFO:teuthology.orchestra.run.smithi187.stdout: "ceph_version": "ceph version 18.2.1-132-g568df92b (568df92b7e50b2108bce4c77c393ff294d6a5e5e) reef (stable)", 2023-12-20T04:53:13.358 INFO:teuthology.orchestra.run.smithi187.stdout: "entity_id": "1", 2023-12-20T04:53:13.358 INFO:teuthology.orchestra.run.smithi187.stdout: "hostname": "smithi187", 2023-12-20T04:53:13.358 INFO:teuthology.orchestra.run.smithi187.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2023-12-20T04:53:13.359 INFO:teuthology.orchestra.run.smithi187.stdout: "pid": "92721", 2023-12-20T04:53:13.359 INFO:teuthology.orchestra.run.smithi187.stdout: "root": "/" 2023-12-20T04:53:13.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:53:13.359 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_count": 0, 2023-12-20T04:53:13.359 INFO:teuthology.orchestra.run.smithi187.stdout: "dentry_pinned_count": 0, 2023-12-20T04:53:13.359 INFO:teuthology.orchestra.run.smithi187.stdout: "id": 6953, 2023-12-20T04:53:13.359 INFO:teuthology.orchestra.run.smithi187.stdout: "inst": { 2023-12-20T04:53:13.359 INFO:teuthology.orchestra.run.smithi187.stdout: "name": { 2023-12-20T04:53:13.359 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "client", 2023-12-20T04:53:13.359 INFO:teuthology.orchestra.run.smithi187.stdout: "num": 6953 2023-12-20T04:53:13.359 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:53:13.359 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:53:13.359 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:53:13.359 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:53:13.360 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 1018972620 2023-12-20T04:53:13.360 INFO:teuthology.orchestra.run.smithi187.stdout: } 2023-12-20T04:53:13.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:53:13.360 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": { 2023-12-20T04:53:13.360 INFO:teuthology.orchestra.run.smithi187.stdout: "type": "v1", 2023-12-20T04:53:13.360 INFO:teuthology.orchestra.run.smithi187.stdout: "addr": "192.168.0.1:0", 2023-12-20T04:53:13.360 INFO:teuthology.orchestra.run.smithi187.stdout: "nonce": 1018972620 2023-12-20T04:53:13.360 INFO:teuthology.orchestra.run.smithi187.stdout: }, 2023-12-20T04:53:13.360 INFO:teuthology.orchestra.run.smithi187.stdout: "inst_str": "client.6953 192.168.0.1:0/1018972620", 2023-12-20T04:53:13.360 INFO:teuthology.orchestra.run.smithi187.stdout: "addr_str": "192.168.0.1:0/1018972620", 2023-12-20T04:53:13.360 INFO:teuthology.orchestra.run.smithi187.stdout: "inode_count": 1, 2023-12-20T04:53:13.360 INFO:teuthology.orchestra.run.smithi187.stdout: "mds_epoch": 70, 2023-12-20T04:53:13.360 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch": 186, 2023-12-20T04:53:13.360 INFO:teuthology.orchestra.run.smithi187.stdout: "osd_epoch_barrier": 0, 2023-12-20T04:53:13.361 INFO:teuthology.orchestra.run.smithi187.stdout: "blocklisted": false, 2023-12-20T04:53:13.361 INFO:teuthology.orchestra.run.smithi187.stdout: "fs_name": "cephfs" 2023-12-20T04:53:13.361 INFO:teuthology.orchestra.run.smithi187.stdout:} 2023-12-20T04:53:13.368 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:13.368 DEBUG:teuthology.orchestra.run.smithi187:> stat --file-system '--printf=%T 2023-12-20T04:53:13.369 DEBUG:teuthology.orchestra.run.smithi187:> ' -- /home/ubuntu/cephtest/mnt.1 2023-12-20T04:53:13.384 INFO:teuthology.orchestra.run.smithi187.stdout:fuseblk 2023-12-20T04:53:13.384 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2023-12-20T04:53:13.384 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:13.384 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2023-12-20T04:53:13.451 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:53:13.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.561+0000 7fcb14dcb640 1 Processor -- start 2023-12-20T04:53:13.563 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.561+0000 7fcb14dcb640 1 -- start start 2023-12-20T04:53:13.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.562+0000 7fcb14dcb640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcb100d0370 0x7fcb100b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:13.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.562+0000 7fcb14dcb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fcb100cdc10 0x7fcb1006c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:13.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.562+0000 7fcb14dcb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fcb100b2f90 con 0x7fcb1015d100 2023-12-20T04:53:13.564 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.562+0000 7fcb14dcb640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb101613c0 con 0x7fcb100d0370 2023-12-20T04:53:13.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.562+0000 7fcb14dcb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fcb100d1b00 con 0x7fcb100cdc10 2023-12-20T04:53:13.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.562+0000 7fcb0dd9b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fcb100d0370 0x7fcb100b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:13.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.562+0000 7fcb0e59c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fcb1015d100 0x7fcb100cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:51258/0 (socket says 172.21.15.132:51258) 2023-12-20T04:53:13.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.562+0000 7fcb0e59c640 1 -- 172.21.15.132:0/2523979797 learned_addr learned my addr 172.21.15.132:0/2523979797 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:13.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.562+0000 7fcb0ed9d640 1 --2- 172.21.15.132:0/2523979797 >> v2:172.21.15.187:3300/0 conn(0x7fcb100cdc10 0x7fcb1006c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:13.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.562+0000 7fcb0dd9b640 1 -- 172.21.15.132:0/2523979797 >> v2:172.21.15.187:3300/0 conn(0x7fcb100cdc10 msgr2=0x7fcb1006c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:13.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.562+0000 7fcb0dd9b640 1 --2- 172.21.15.132:0/2523979797 >> v2:172.21.15.187:3300/0 conn(0x7fcb100cdc10 0x7fcb1006c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:13.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.562+0000 7fcb0dd9b640 1 -- 172.21.15.132:0/2523979797 >> v1:172.21.15.132:6789/0 conn(0x7fcb1015d100 legacy=0x7fcb100cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:13.565 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.562+0000 7fcb0dd9b640 1 -- 172.21.15.132:0/2523979797 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb100d0810 con 0x7fcb100d0370 2023-12-20T04:53:13.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.563+0000 7fcb0dd9b640 1 --2- 172.21.15.132:0/2523979797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb100d0370 0x7fcb100b2a50 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fcb10161330 tx=0x7fcb0402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc57de9da854a62e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:13.566 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.563+0000 7fcb0d59a640 1 -- 172.21.15.132:0/2523979797 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04031830 con 0x7fcb100d0370 2023-12-20T04:53:13.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.563+0000 7fcb0d59a640 1 -- 172.21.15.132:0/2523979797 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb04031990 con 0x7fcb100d0370 2023-12-20T04:53:13.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.563+0000 7fcb0d59a640 1 -- 172.21.15.132:0/2523979797 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04031d20 con 0x7fcb100d0370 2023-12-20T04:53:13.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.564+0000 7fcb14dcb640 1 -- 172.21.15.132:0/2523979797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb100d0370 msgr2=0x7fcb100b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:13.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.564+0000 7fcb14dcb640 1 --2- 172.21.15.132:0/2523979797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb100d0370 0x7fcb100b2a50 secure :-1 s=READY pgs=1834 cs=0 l=1 rev1=1 crypto rx=0x7fcb10161330 tx=0x7fcb0402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:53:13.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.564+0000 7fcb14dcb640 1 -- 172.21.15.132:0/2523979797 shutdown_connections 2023-12-20T04:53:13.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.564+0000 7fcb14dcb640 1 --2- 172.21.15.132:0/2523979797 >> v2:172.21.15.187:3300/0 conn(0x7fcb100cdc10 0x7fcb1006c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:13.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.564+0000 7fcb14dcb640 1 --2- 172.21.15.132:0/2523979797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb100d0370 0x7fcb100b2a50 unknown :-1 s=CLOSED pgs=1834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:13.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.564+0000 7fcb14dcb640 1 -- 172.21.15.132:0/2523979797 >> 172.21.15.132:0/2523979797 conn(0x7fcb1006d7c0 msgr2=0x7fcb1006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:13.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.564+0000 7fcb14dcb640 1 -- 172.21.15.132:0/2523979797 shutdown_connections 2023-12-20T04:53:13.567 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.564+0000 7fcb14dcb640 1 -- 172.21.15.132:0/2523979797 wait complete. 2023-12-20T04:53:13.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.565+0000 7fcb14dcb640 1 Processor -- start 2023-12-20T04:53:13.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.565+0000 7fcb14dcb640 1 -- start start 2023-12-20T04:53:13.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb14dcb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb100cdc10 0x7fcb100c6ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:13.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb14dcb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb100d0370 0x7fcb100b39f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:13.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb14dcb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb1015d100 0x7fcb100b3f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:13.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb14dcb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb100acfb0 con 0x7fcb100d0370 2023-12-20T04:53:13.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb14dcb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb10156800 con 0x7fcb100cdc10 2023-12-20T04:53:13.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb14dcb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fcb100b6700 con 0x7fcb1015d100 2023-12-20T04:53:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb0dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb100d0370 0x7fcb100b39f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb0dd9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb100d0370 0x7fcb100b39f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33246/0 (socket says 172.21.15.132:33246) 2023-12-20T04:53:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb0dd9b640 1 -- 172.21.15.132:0/3037145367 learned_addr learned my addr 172.21.15.132:0/3037145367 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb0e59c640 1 --2- 172.21.15.132:0/3037145367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb100cdc10 0x7fcb100c6ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb0ed9d640 1 --2- 172.21.15.132:0/3037145367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb1015d100 0x7fcb100b3f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb0dd9b640 1 -- 172.21.15.132:0/3037145367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb1015d100 msgr2=0x7fcb100b3f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb0dd9b640 1 --2- 172.21.15.132:0/3037145367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb1015d100 0x7fcb100b3f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb0dd9b640 1 -- 172.21.15.132:0/3037145367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb100cdc10 msgr2=0x7fcb100c6ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb0dd9b640 1 --2- 172.21.15.132:0/3037145367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb100cdc10 0x7fcb100c6ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb0dd9b640 1 -- 172.21.15.132:0/3037145367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb04009400 con 0x7fcb100d0370 2023-12-20T04:53:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb0e59c640 1 --2- 172.21.15.132:0/3037145367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb100cdc10 0x7fcb100c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.566+0000 7fcb0ed9d640 1 --2- 172.21.15.132:0/3037145367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb1015d100 0x7fcb100b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:13.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.567+0000 7fcb0dd9b640 1 --2- 172.21.15.132:0/3037145367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb100d0370 0x7fcb100b39f0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009890 tx=0x7fcb040046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:13.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.567+0000 7fcafeffd640 1 -- 172.21.15.132:0/3037145367 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb0403ba70 con 0x7fcb100d0370 2023-12-20T04:53:13.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.567+0000 7fcafeffd640 1 -- 172.21.15.132:0/3037145367 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fcb0403bbf0 con 0x7fcb100d0370 2023-12-20T04:53:13.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.567+0000 7fcb14dcb640 1 -- 172.21.15.132:0/3037145367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb100ad1c0 con 0x7fcb100d0370 2023-12-20T04:53:13.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.567+0000 7fcafeffd640 1 -- 172.21.15.132:0/3037145367 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fcb04045400 con 0x7fcb100d0370 2023-12-20T04:53:13.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.567+0000 7fcb14dcb640 1 -- 172.21.15.132:0/3037145367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb100ad780 con 0x7fcb100d0370 2023-12-20T04:53:13.572 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.568+0000 7fcb14dcb640 1 -- 172.21.15.132:0/3037145367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb1004e840 con 0x7fcb100d0370 2023-12-20T04:53:13.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.568+0000 7fcafeffd640 1 -- 172.21.15.132:0/3037145367 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fcb0404e440 con 0x7fcb100d0370 2023-12-20T04:53:13.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.569+0000 7fcafeffd640 1 --2- 172.21.15.132:0/3037145367 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcaf006a430 0x7fcaf006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:13.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.569+0000 7fcafeffd640 1 -- 172.21.15.132:0/3037145367 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fcb040aacd0 con 0x7fcb100d0370 2023-12-20T04:53:13.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.569+0000 7fcb0e59c640 1 --2- 172.21.15.132:0/3037145367 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcaf006a430 0x7fcaf006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:13.573 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.569+0000 7fcb0e59c640 1 --2- 172.21.15.132:0/3037145367 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcaf006a430 0x7fcaf006c8f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcb00005880 tx=0x7fcb00009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:13.575 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.573+0000 7fcafeffd640 1 -- 172.21.15.132:0/3037145367 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fcb040763e0 con 0x7fcb100d0370 2023-12-20T04:53:13.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.772+0000 7fcb14dcb640 1 -- 172.21.15.132:0/3037145367 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fcb100b37d0 con 0x7fcb100d0370 2023-12-20T04:53:13.774 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.772+0000 7fcafeffd640 1 -- 172.21.15.132:0/3037145367 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4722 (secure 0 0 0) 0x7fcb04079a00 con 0x7fcb100d0370 2023-12-20T04:53:13.775 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:13.775 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":70,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3443409957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3443409957},{"type":"v1","addr":"172.21.15.187:6833","nonce":3443409957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/321445180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":321445180},{"type":"v1","addr":"172.21.15.187:6835","nonce":321445180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1166803529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1166803529},{"type":"v1","addr":"172.21.15.132:6836","nonce":1166803529}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:53:04.838088+0000","modified":"2023-12-20T04:53:07.506024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9117":{"gid":9117,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/2356846201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2356846201},{"type":"v1","addr":"172.21.15.132:6837","nonce":2356846201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-20T04:53:13.775 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 70 2023-12-20T04:53:13.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.774+0000 7fcb14dcb640 1 -- 172.21.15.132:0/3037145367 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcaf006a430 msgr2=0x7fcaf006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:13.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.774+0000 7fcb14dcb640 1 --2- 172.21.15.132:0/3037145367 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcaf006a430 0x7fcaf006c8f0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x7fcb00005880 tx=0x7fcb00009040 comp rx=0 tx=0).stop 2023-12-20T04:53:13.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.774+0000 7fcb14dcb640 1 -- 172.21.15.132:0/3037145367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb100d0370 msgr2=0x7fcb100b39f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:13.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.774+0000 7fcb14dcb640 1 --2- 172.21.15.132:0/3037145367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb100d0370 0x7fcb100b39f0 secure :-1 s=READY pgs=1835 cs=0 l=1 rev1=1 crypto rx=0x7fcb04009890 tx=0x7fcb040046c0 comp rx=0 tx=0).stop 2023-12-20T04:53:13.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.774+0000 7fcb14dcb640 1 -- 172.21.15.132:0/3037145367 shutdown_connections 2023-12-20T04:53:13.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.774+0000 7fcb14dcb640 1 --2- 172.21.15.132:0/3037145367 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fcaf006a430 0x7fcaf006c8f0 unknown :-1 s=CLOSED pgs=769 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:13.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.774+0000 7fcb14dcb640 1 --2- 172.21.15.132:0/3037145367 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fcb1015d100 0x7fcb100b3f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:13.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.774+0000 7fcb14dcb640 1 --2- 172.21.15.132:0/3037145367 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fcb100d0370 0x7fcb100b39f0 unknown :-1 s=CLOSED pgs=1835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:13.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.774+0000 7fcb14dcb640 1 --2- 172.21.15.132:0/3037145367 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fcb100cdc10 0x7fcb100c6ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:13.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.774+0000 7fcb14dcb640 1 -- 172.21.15.132:0/3037145367 >> 172.21.15.132:0/3037145367 conn(0x7fcb1006d7c0 msgr2=0x7fcb100b0830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:13.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.774+0000 7fcb14dcb640 1 -- 172.21.15.132:0/3037145367 shutdown_connections 2023-12-20T04:53:13.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:13.774+0000 7fcb14dcb640 1 -- 172.21.15.132:0/3037145367 wait complete. 2023-12-20T04:53:13.787 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-20T04:53:13.903 INFO:teuthology.orchestra.run.smithi132.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":9117,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":9.0529556109999998,"mdsmap_epoch":70,"osdmap_epoch":186,"osdmap_epoch_barrier":186,"uptime":13.467050473} 2023-12-20T04:53:13.903 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 9117, "mdsmap_epoch": 70, "osdmap_epoch": 186, "osdmap_epoch_barrier": 186, "rank_uptime": 9.052955611, "state": "up:active", "uptime": 13.467050473, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:53:13.903 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set-quota cephfs_data max_bytes 33554432 2023-12-20T04:53:14.006 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.005+0000 7f4b72b48640 1 Processor -- start 2023-12-20T04:53:14.007 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.005+0000 7f4b72b48640 1 -- start start 2023-12-20T04:53:14.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.005+0000 7f4b72b48640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4b6c0cfab0 0x7f4b6c06afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:14.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.005+0000 7f4b72b48640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6c0d1b80 con 0x7f4b6c15d220 2023-12-20T04:53:14.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.005+0000 7f4b72b48640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4b6c15d600 con 0x7f4b6c06bdd0 2023-12-20T04:53:14.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.005+0000 7f4b72b48640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4b6c0d0020 con 0x7f4b6c0cfab0 2023-12-20T04:53:14.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.006+0000 7f4b710e5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4b6c0cfab0 0x7f4b6c06afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:14.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.006+0000 7f4b708e4640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4b6c15d220 0x7f4b6c06b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:51266/0 (socket says 172.21.15.132:51266) 2023-12-20T04:53:14.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.006+0000 7f4b710e5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4b6c0cfab0 0x7f4b6c06afe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33250/0 (socket says 172.21.15.132:33250) 2023-12-20T04:53:14.008 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.006+0000 7f4b708e4640 1 -- 172.21.15.132:0/2805852085 learned_addr learned my addr 172.21.15.132:0/2805852085 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:14.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.006+0000 7f4b710e5640 1 -- 172.21.15.132:0/2805852085 >> v1:172.21.15.187:6789/0 conn(0x7f4b6c06bdd0 legacy=0x7f4b6c06dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:14.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.006+0000 7f4b710e5640 1 -- 172.21.15.132:0/2805852085 >> v1:172.21.15.132:6789/0 conn(0x7f4b6c15d220 legacy=0x7f4b6c06b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:14.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.006+0000 7f4b6b7fe640 1 -- 172.21.15.132:0/2805852085 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3041218934 0 0) 0x7f4b6c0d1b80 con 0x7f4b6c15d220 2023-12-20T04:53:14.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.006+0000 7f4b710e5640 1 -- 172.21.15.132:0/2805852085 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b6c0d0300 con 0x7f4b6c0cfab0 2023-12-20T04:53:14.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.007+0000 7f4b710e5640 1 --2- 172.21.15.132:0/2805852085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b6c0cfab0 0x7f4b6c06afe0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009d90 tx=0x7f4b6402be20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee0dd795e555d9ae server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:14.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.007+0000 7f4b6b7fe640 1 -- 172.21.15.132:0/2805852085 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6402cbd0 con 0x7f4b6c0cfab0 2023-12-20T04:53:14.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.007+0000 7f4b6b7fe640 1 -- 172.21.15.132:0/2805852085 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b6402cd30 con 0x7f4b6c0cfab0 2023-12-20T04:53:14.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.007+0000 7f4b6b7fe640 1 -- 172.21.15.132:0/2805852085 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b6402cea0 con 0x7f4b6c0cfab0 2023-12-20T04:53:14.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.007+0000 7f4b72b48640 1 -- 172.21.15.132:0/2805852085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b6c0cfab0 msgr2=0x7f4b6c06afe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:14.010 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.007+0000 7f4b72b48640 1 --2- 172.21.15.132:0/2805852085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b6c0cfab0 0x7f4b6c06afe0 secure :-1 s=READY pgs=1837 cs=0 l=1 rev1=1 crypto rx=0x7f4b64009d90 tx=0x7f4b6402be20 comp rx=0 tx=0).stop 2023-12-20T04:53:14.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.007+0000 7f4b72b48640 1 -- 172.21.15.132:0/2805852085 shutdown_connections 2023-12-20T04:53:14.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.007+0000 7f4b72b48640 1 --2- 172.21.15.132:0/2805852085 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b6c0cfab0 0x7f4b6c06afe0 unknown :-1 s=CLOSED pgs=1837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:14.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.007+0000 7f4b72b48640 1 -- 172.21.15.132:0/2805852085 >> 172.21.15.132:0/2805852085 conn(0x7f4b6c099fa0 msgr2=0x7f4b6c0d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:14.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.007+0000 7f4b72b48640 1 -- 172.21.15.132:0/2805852085 shutdown_connections 2023-12-20T04:53:14.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.007+0000 7f4b72b48640 1 -- 172.21.15.132:0/2805852085 wait complete. 2023-12-20T04:53:14.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.008+0000 7f4b72b48640 1 Processor -- start 2023-12-20T04:53:14.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.008+0000 7f4b72b48640 1 -- start start 2023-12-20T04:53:14.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.009+0000 7f4b72b48640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b6c06bdd0 0x7f4b6c1f2340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:14.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.009+0000 7f4b72b48640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b6c0cfab0 0x7f4b6c0c6930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:14.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.009+0000 7f4b72b48640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c15d220 0x7f4b6c0c6e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:14.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.009+0000 7f4b72b48640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c0ccad0 con 0x7f4b6c06bdd0 2023-12-20T04:53:14.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.009+0000 7f4b72b48640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c1f2880 con 0x7f4b6c15d220 2023-12-20T04:53:14.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.009+0000 7f4b72b48640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4b6c1f6eb0 con 0x7f4b6c0cfab0 2023-12-20T04:53:14.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.009+0000 7f4b708e4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b6c06bdd0 0x7f4b6c1f2340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:14.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.009+0000 7f4b708e4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b6c06bdd0 0x7f4b6c1f2340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33256/0 (socket says 172.21.15.132:33256) 2023-12-20T04:53:14.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.009+0000 7f4b708e4640 1 -- 172.21.15.132:0/2543477116 learned_addr learned my addr 172.21.15.132:0/2543477116 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:14.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.010+0000 7f4b710e5640 1 --2- 172.21.15.132:0/2543477116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c15d220 0x7f4b6c0c6e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:14.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.010+0000 7f4b6bfff640 1 --2- 172.21.15.132:0/2543477116 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b6c0cfab0 0x7f4b6c0c6930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:14.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.010+0000 7f4b708e4640 1 -- 172.21.15.132:0/2543477116 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b6c0cfab0 msgr2=0x7f4b6c0c6930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:14.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.010+0000 7f4b708e4640 1 --2- 172.21.15.132:0/2543477116 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b6c0cfab0 0x7f4b6c0c6930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:14.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.010+0000 7f4b708e4640 1 -- 172.21.15.132:0/2543477116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c15d220 msgr2=0x7f4b6c0c6e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:14.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.010+0000 7f4b708e4640 1 --2- 172.21.15.132:0/2543477116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c15d220 0x7f4b6c0c6e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:14.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.010+0000 7f4b708e4640 1 -- 172.21.15.132:0/2543477116 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4b64009a70 con 0x7f4b6c06bdd0 2023-12-20T04:53:14.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.010+0000 7f4b710e5640 1 --2- 172.21.15.132:0/2543477116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c15d220 0x7f4b6c0c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:14.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.010+0000 7f4b708e4640 1 --2- 172.21.15.132:0/2543477116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b6c06bdd0 0x7f4b6c1f2340 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00c440 tx=0x7f4b5c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:14.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.010+0000 7f4b697fa640 1 -- 172.21.15.132:0/2543477116 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c007480 con 0x7f4b6c06bdd0 2023-12-20T04:53:14.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.010+0000 7f4b697fa640 1 -- 172.21.15.132:0/2543477116 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4b5c007600 con 0x7f4b6c06bdd0 2023-12-20T04:53:14.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.010+0000 7f4b697fa640 1 -- 172.21.15.132:0/2543477116 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4b5c0059e0 con 0x7f4b6c06bdd0 2023-12-20T04:53:14.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.010+0000 7f4b72b48640 1 -- 172.21.15.132:0/2543477116 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4b6c1f6bd0 con 0x7f4b6c06bdd0 2023-12-20T04:53:14.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.010+0000 7f4b72b48640 1 -- 172.21.15.132:0/2543477116 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4b6c0c8160 con 0x7f4b6c06bdd0 2023-12-20T04:53:14.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.011+0000 7f4b72b48640 1 -- 172.21.15.132:0/2543477116 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4b6c04e840 con 0x7f4b6c06bdd0 2023-12-20T04:53:14.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.011+0000 7f4b697fa640 1 -- 172.21.15.132:0/2543477116 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4b5c005c00 con 0x7f4b6c06bdd0 2023-12-20T04:53:14.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.012+0000 7f4b697fa640 1 --2- 172.21.15.132:0/2543477116 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4b5806a430 0x7f4b5806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:14.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.012+0000 7f4b6bfff640 1 --2- 172.21.15.132:0/2543477116 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4b5806a430 0x7f4b5806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:14.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.012+0000 7f4b697fa640 1 -- 172.21.15.132:0/2543477116 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(186..186 src has 1..186) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4b5c087da0 con 0x7f4b6c06bdd0 2023-12-20T04:53:14.016 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.012+0000 7f4b6bfff640 1 --2- 172.21.15.132:0/2543477116 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4b5806a430 0x7f4b5806c8f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0ce210 tx=0x7f4b60009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:14.018 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.016+0000 7f4b697fa640 1 -- 172.21.15.132:0/2543477116 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4b5c053420 con 0x7f4b6c06bdd0 2023-12-20T04:53:14.183 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.181+0000 7f4b72b48640 1 -- 172.21.15.132:0/2543477116 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"} v 0) v1 -- 0x7f4b6c159850 con 0x7f4b6c06bdd0 2023-12-20T04:53:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.924+0000 7f4b697fa640 1 -- 172.21.15.132:0/2543477116 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set-quota", "pool": "cephfs_data", "field": "max_bytes", "val": "33554432"}]=0 set-quota max_bytes = 33554432 for pool cephfs_data v187) v1 ==== 181+0+0 (secure 0 0 0) 0x7f4b5c017020 con 0x7f4b6c06bdd0 2023-12-20T04:53:14.926 INFO:teuthology.orchestra.run.smithi132.stderr:set-quota max_bytes = 33554432 for pool cephfs_data 2023-12-20T04:53:14.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.927+0000 7f4b72b48640 1 -- 172.21.15.132:0/2543477116 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4b5806a430 msgr2=0x7f4b5806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:14.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.927+0000 7f4b72b48640 1 --2- 172.21.15.132:0/2543477116 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4b5806a430 0x7f4b5806c8f0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f4b6c0ce210 tx=0x7f4b60009040 comp rx=0 tx=0).stop 2023-12-20T04:53:14.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.927+0000 7f4b72b48640 1 -- 172.21.15.132:0/2543477116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b6c06bdd0 msgr2=0x7f4b6c1f2340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:14.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.927+0000 7f4b72b48640 1 --2- 172.21.15.132:0/2543477116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b6c06bdd0 0x7f4b6c1f2340 secure :-1 s=READY pgs=1838 cs=0 l=1 rev1=1 crypto rx=0x7f4b5c00c440 tx=0x7f4b5c00c900 comp rx=0 tx=0).stop 2023-12-20T04:53:14.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.927+0000 7f4b72b48640 1 -- 172.21.15.132:0/2543477116 shutdown_connections 2023-12-20T04:53:14.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.927+0000 7f4b72b48640 1 --2- 172.21.15.132:0/2543477116 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4b5806a430 0x7f4b5806c8f0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:14.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.927+0000 7f4b72b48640 1 --2- 172.21.15.132:0/2543477116 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4b6c15d220 0x7f4b6c0c6e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:14.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.927+0000 7f4b72b48640 1 --2- 172.21.15.132:0/2543477116 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4b6c0cfab0 0x7f4b6c0c6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:14.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.927+0000 7f4b72b48640 1 --2- 172.21.15.132:0/2543477116 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4b6c06bdd0 0x7f4b6c1f2340 unknown :-1 s=CLOSED pgs=1838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:14.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.927+0000 7f4b72b48640 1 -- 172.21.15.132:0/2543477116 >> 172.21.15.132:0/2543477116 conn(0x7f4b6c099fa0 msgr2=0x7f4b6c0d0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:14.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.927+0000 7f4b72b48640 1 -- 172.21.15.132:0/2543477116 shutdown_connections 2023-12-20T04:53:14.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:14.927+0000 7f4b72b48640 1 -- 172.21.15.132:0/2543477116 wait complete. 2023-12-20T04:53:14.943 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok --format=json config get osd_mon_report_interval 2023-12-20T04:53:15.060 INFO:teuthology.orchestra.run.smithi132.stdout:{"osd_mon_report_interval":"5"} 2023-12-20T04:53:15.060 DEBUG:tasks.cephfs.filesystem:_json_asok output { "osd_mon_report_interval": "5" } 2023-12-20T04:53:15.060 INFO:tasks.cephfs.test_full:Writing 32MB should fill this cluster 2023-12-20T04:53:15.060 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:53:15.060 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:53:15.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:15.076 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_a bs=1M conv=fdatasync count=16 seek=0) 2023-12-20T04:53:15.211 INFO:teuthology.orchestra.run.smithi132.stderr:16+0 records in 2023-12-20T04:53:15.211 INFO:teuthology.orchestra.run.smithi132.stderr:16+0 records out 2023-12-20T04:53:15.212 INFO:teuthology.orchestra.run.smithi132.stderr:16777216 bytes (17 MB, 16 MiB) copied, 0.0782248 s, 214 MB/s 2023-12-20T04:53:15.213 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:53:15.213 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:53:15.228 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:15.228 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=17 seek=0) 2023-12-20T04:53:15.360 INFO:teuthology.orchestra.run.smithi132.stderr:17+0 records in 2023-12-20T04:53:15.360 INFO:teuthology.orchestra.run.smithi132.stderr:17+0 records out 2023-12-20T04:53:15.360 INFO:teuthology.orchestra.run.smithi132.stderr:17825792 bytes (18 MB, 17 MiB) copied, 0.0750593 s, 237 MB/s 2023-12-20T04:53:15.361 INFO:tasks.cephfs.test_full:Writing file B succeeded (full status will happen soon) 2023-12-20T04:53:15.361 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:53:15.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.460+0000 7f4f757e3640 1 Processor -- start 2023-12-20T04:53:15.462 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.460+0000 7f4f757e3640 1 -- start start 2023-12-20T04:53:15.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f757e3640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4f700b4980 0x7f4f700b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:15.466 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f757e3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f700d1aa0 0x7f4f700d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:15.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f757e3640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4f700b5320 con 0x7f4f70160450 2023-12-20T04:53:15.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f757e3640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4f700b5ec0 con 0x7f4f700b4980 2023-12-20T04:53:15.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f757e3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f701617e0 con 0x7f4f700d1aa0 2023-12-20T04:53:15.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f6effd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4f70160450 0x7f4f70160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:51270/0 (socket says 172.21.15.132:51270) 2023-12-20T04:53:15.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f6effd640 1 -- 172.21.15.132:0/4261202310 learned_addr learned my addr 172.21.15.132:0/4261202310 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:15.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f6dffb640 1 -- 172.21.15.132:0/4261202310 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1283917358 0 0) 0x7f4f700b5320 con 0x7f4f70160450 2023-12-20T04:53:15.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f6dffb640 1 -- 172.21.15.132:0/4261202310 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4f58003520 con 0x7f4f70160450 2023-12-20T04:53:15.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f6f7fe640 1 --2- 172.21.15.132:0/4261202310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f700d1aa0 0x7f4f700d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:15.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f6e7fc640 1 --2- 172.21.15.132:0/4261202310 >> v2:172.21.15.187:3300/0 conn(0x7f4f700b4980 0x7f4f700b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:15.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f6dffb640 1 -- 172.21.15.132:0/4261202310 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3233472103 0 0) 0x7f4f58003520 con 0x7f4f70160450 2023-12-20T04:53:15.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f6dffb640 1 -- 172.21.15.132:0/4261202310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f700d1aa0 msgr2=0x7f4f700d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:15.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f6dffb640 1 --2- 172.21.15.132:0/4261202310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f700d1aa0 0x7f4f700d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:15.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f6dffb640 1 -- 172.21.15.132:0/4261202310 >> v2:172.21.15.187:3300/0 conn(0x7f4f700b4980 msgr2=0x7f4f700b4de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:15.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f6dffb640 1 --2- 172.21.15.132:0/4261202310 >> v2:172.21.15.187:3300/0 conn(0x7f4f700b4980 0x7f4f700b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:15.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f6dffb640 1 -- 172.21.15.132:0/4261202310 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f700d0fc0 con 0x7f4f70160450 2023-12-20T04:53:15.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f6dffb640 1 -- 172.21.15.132:0/4261202310 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f4f60001690 con 0x7f4f70160450 2023-12-20T04:53:15.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f6dffb640 1 -- 172.21.15.132:0/4261202310 >> v1:172.21.15.132:6789/0 conn(0x7f4f70160450 legacy=0x7f4f70160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:15.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f6dffb640 1 --2- 172.21.15.132:0/4261202310 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f58003970 0x7f4f58003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:15.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.461+0000 7f4f6dffb640 1 --2- 172.21.15.132:0/4261202310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f700d1aa0 0x7f4f580047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:15.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.462+0000 7f4f6dffb640 1 --2- 172.21.15.132:0/4261202310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f58004d00 0x7f4f58005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:15.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.462+0000 7f4f6dffb640 1 -- 172.21.15.132:0/4261202310 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f700b5ec0 con 0x7f4f58003970 2023-12-20T04:53:15.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.462+0000 7f4f6dffb640 1 -- 172.21.15.132:0/4261202310 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f701617e0 con 0x7f4f58004d00 2023-12-20T04:53:15.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.462+0000 7f4f6dffb640 1 -- 172.21.15.132:0/4261202310 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f5800bba0 con 0x7f4f700d1aa0 2023-12-20T04:53:15.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.462+0000 7f4f6effd640 1 --2- 172.21.15.132:0/4261202310 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f58003970 0x7f4f58003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:15.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.462+0000 7f4f6e7fc640 1 --2- 172.21.15.132:0/4261202310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f700d1aa0 0x7f4f580047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:15.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.462+0000 7f4f6f7fe640 1 --2- 172.21.15.132:0/4261202310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f58004d00 0x7f4f58005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:15.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.462+0000 7f4f6effd640 1 -- 172.21.15.132:0/4261202310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f700d1aa0 msgr2=0x7f4f580047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:15.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.462+0000 7f4f6effd640 1 --2- 172.21.15.132:0/4261202310 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f700d1aa0 0x7f4f580047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:15.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.462+0000 7f4f6effd640 1 -- 172.21.15.132:0/4261202310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f58004d00 msgr2=0x7f4f58005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:15.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.462+0000 7f4f6effd640 1 --2- 172.21.15.132:0/4261202310 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f58004d00 0x7f4f58005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:15.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.462+0000 7f4f6effd640 1 -- 172.21.15.132:0/4261202310 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f58003520 con 0x7f4f58003970 2023-12-20T04:53:15.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.463+0000 7f4f6effd640 1 --2- 172.21.15.132:0/4261202310 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f58003970 0x7f4f58003d90 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000c210 tx=0x7f4f580057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a23427f6138922ae server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:15.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.463+0000 7f4f6dffb640 1 -- 172.21.15.132:0/4261202310 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f60005ad0 con 0x7f4f58003970 2023-12-20T04:53:15.469 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.463+0000 7f4f6dffb640 1 -- 172.21.15.132:0/4261202310 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f60005c50 con 0x7f4f58003970 2023-12-20T04:53:15.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.463+0000 7f4f6dffb640 1 -- 172.21.15.132:0/4261202310 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6002c810 con 0x7f4f58003970 2023-12-20T04:53:15.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.463+0000 7f4f757e3640 1 -- 172.21.15.132:0/4261202310 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f58003970 msgr2=0x7f4f58003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:15.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.463+0000 7f4f757e3640 1 --2- 172.21.15.132:0/4261202310 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f58003970 0x7f4f58003d90 secure :-1 s=READY pgs=1840 cs=0 l=1 rev1=1 crypto rx=0x7f4f6000c210 tx=0x7f4f580057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:15.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.463+0000 7f4f6f7fe640 1 -- 172.21.15.132:0/4261202310 reap_dead start 2023-12-20T04:53:15.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.463+0000 7f4f757e3640 1 -- 172.21.15.132:0/4261202310 shutdown_connections 2023-12-20T04:53:15.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.463+0000 7f4f757e3640 1 -- 172.21.15.132:0/4261202310 >> 172.21.15.132:0/4261202310 conn(0x7f4f700cf980 msgr2=0x7f4f700cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:15.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.463+0000 7f4f757e3640 1 -- 172.21.15.132:0/4261202310 shutdown_connections 2023-12-20T04:53:15.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.463+0000 7f4f757e3640 1 -- 172.21.15.132:0/4261202310 wait complete. 2023-12-20T04:53:15.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.465+0000 7f4f757e3640 1 Processor -- start 2023-12-20T04:53:15.470 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.465+0000 7f4f757e3640 1 -- start start 2023-12-20T04:53:15.472 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.465+0000 7f4f757e3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f58003970 0x7f4f7014c480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:15.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.465+0000 7f4f757e3640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f7014b420 0x7f4f7014f630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:15.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.465+0000 7f4f757e3640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f701f2b10 0x7f4f701f2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:15.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.465+0000 7f4f757e3640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7014fb70 con 0x7f4f58003970 2023-12-20T04:53:15.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.465+0000 7f4f757e3640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4f701f3500 con 0x7f4f701f2b10 2023-12-20T04:53:15.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.465+0000 7f4f757e3640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4f7014b8a0 con 0x7f4f7014b420 2023-12-20T04:53:15.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.465+0000 7f4f6effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f58003970 0x7f4f7014c480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:15.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.465+0000 7f4f6effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f58003970 0x7f4f7014c480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:33274/0 (socket says 172.21.15.132:33274) 2023-12-20T04:53:15.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.465+0000 7f4f6effd640 1 -- 172.21.15.132:0/683986410 learned_addr learned my addr 172.21.15.132:0/683986410 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:15.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.465+0000 7f4f6e7fc640 1 --2- 172.21.15.132:0/683986410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f7014b420 0x7f4f7014f630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:15.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.465+0000 7f4f6f7fe640 1 --2- 172.21.15.132:0/683986410 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f701f2b10 0x7f4f701f2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:15.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.466+0000 7f4f6effd640 1 -- 172.21.15.132:0/683986410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f7014b420 msgr2=0x7f4f7014f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:15.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.466+0000 7f4f6effd640 1 --2- 172.21.15.132:0/683986410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f7014b420 0x7f4f7014f630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:15.473 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.466+0000 7f4f6effd640 1 -- 172.21.15.132:0/683986410 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f701f2b10 msgr2=0x7f4f701f2fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:15.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.466+0000 7f4f6effd640 1 --2- 172.21.15.132:0/683986410 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f701f2b10 0x7f4f701f2fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:15.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.466+0000 7f4f6effd640 1 -- 172.21.15.132:0/683986410 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4f70151ee0 con 0x7f4f58003970 2023-12-20T04:53:15.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.466+0000 7f4f6effd640 1 --2- 172.21.15.132:0/683986410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f58003970 0x7f4f7014c480 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f4f60001950 tx=0x7f4f60001a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:15.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.466+0000 7f4f577fe640 1 -- 172.21.15.132:0/683986410 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f60039070 con 0x7f4f58003970 2023-12-20T04:53:15.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.466+0000 7f4f577fe640 1 -- 172.21.15.132:0/683986410 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4f6002dd30 con 0x7f4f58003970 2023-12-20T04:53:15.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.466+0000 7f4f757e3640 1 -- 172.21.15.132:0/683986410 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4f701521c0 con 0x7f4f58003970 2023-12-20T04:53:15.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.466+0000 7f4f577fe640 1 -- 172.21.15.132:0/683986410 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4f6002dea0 con 0x7f4f58003970 2023-12-20T04:53:15.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.466+0000 7f4f757e3640 1 -- 172.21.15.132:0/683986410 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4f70152780 con 0x7f4f58003970 2023-12-20T04:53:15.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.467+0000 7f4f757e3640 1 -- 172.21.15.132:0/683986410 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4f70152910 con 0x7f4f58003970 2023-12-20T04:53:15.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.467+0000 7f4f577fe640 1 -- 172.21.15.132:0/683986410 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4f60032070 con 0x7f4f58003970 2023-12-20T04:53:15.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.468+0000 7f4f577fe640 1 --2- 172.21.15.132:0/683986410 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5c06a460 0x7f4f5c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:15.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.468+0000 7f4f577fe640 1 -- 172.21.15.132:0/683986410 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(187..187 src has 1..187) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4f6003c040 con 0x7f4f58003970 2023-12-20T04:53:15.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.468+0000 7f4f6e7fc640 1 --2- 172.21.15.132:0/683986410 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5c06a460 0x7f4f5c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:15.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.468+0000 7f4f6e7fc640 1 --2- 172.21.15.132:0/683986410 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5c06a460 0x7f4f5c06c920 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f4f64006fd0 tx=0x7f4f64008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:15.475 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.472+0000 7f4f577fe640 1 -- 172.21.15.132:0/683986410 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4f600755c0 con 0x7f4f58003970 2023-12-20T04:53:15.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.638+0000 7f4f757e3640 1 -- 172.21.15.132:0/683986410 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4f7004e840 con 0x7f4f58003970 2023-12-20T04:53:15.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.640+0000 7f4f577fe640 1 -- 172.21.15.132:0/683986410 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v187) v1 ==== 81+0+33594 (secure 0 0 0) 0x7f4f60045020 con 0x7f4f58003970 2023-12-20T04:53:15.642 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:15.642 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:15.643 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 187, 2023-12-20T04:53:15.643 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:53:15.643 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:53:15.643 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:53:14.918495+0000", 2023-12-20T04:53:15.643 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:53:15.643 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:53:15.643 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:53:15.643 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:53:15.643 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:53:15.643 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:53:15.643 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:53:15.643 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:53:15.644 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:53:15.644 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:15.644 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:53:15.644 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:53:15.644 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:53:15.644 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:53:15.644 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:53:15.644 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 23, 2023-12-20T04:53:15.644 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:53:15.644 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:53:15.644 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:53:15.644 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:53:15.644 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:53:15.645 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:53:15.645 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.645 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:53:15.645 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:53:15.645 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:53:15.645 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:53:15.645 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:53:15.645 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:15.645 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:15.645 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:15.645 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:15.645 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:15.645 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:15.646 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:15.646 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:15.646 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:15.646 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:15.646 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:53:15.646 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:53:15.646 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:53:15.646 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:53:15.646 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:53:15.646 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:15.646 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:15.646 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:15.646 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:15.646 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:15.646 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:15.647 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:15.647 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.647 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:53:15.647 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:15.647 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:15.647 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:15.647 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:15.647 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:15.647 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:15.647 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:15.647 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:15.647 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:15.647 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:53:15.648 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:15.648 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:15.648 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:15.648 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:15.648 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:15.648 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:15.648 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:15.648 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:15.648 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:15.648 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:15.648 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:15.648 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:15.648 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:15.648 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:15.648 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:15.649 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:15.649 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.649 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:15.649 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:15.649 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:15.649 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:15.649 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:15.649 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:15.649 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:15.649 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:15.649 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:15.649 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:15.649 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:15.649 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:15.650 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:53:15.650 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:53:15.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.650 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:15.650 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:53:15.650 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.650 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:15.650 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:53:15.650 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:53:15.650 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:53:15.650 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:53:15.650 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:53:15.650 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:15.650 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:15.651 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:15.651 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.651 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.651 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.651 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 22, 2023-12-20T04:53:15.651 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:53:15.651 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:53:03.034230+0000", 2023-12-20T04:53:15.651 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:53:15.651 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:53:15.651 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:15.651 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:15.651 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:15.651 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:15.651 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:15.651 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:15.652 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:15.652 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:15.652 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:15.652 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:15.652 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:53:15.652 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:53:15.652 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:53:15.652 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:53:15.652 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:53:15.652 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:15.652 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:15.652 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:15.652 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:15.652 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:15.652 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:15.653 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:15.653 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.653 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "185", 2023-12-20T04:53:15.653 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:15.653 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:15.653 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:15.653 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:15.653 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:15.653 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:15.653 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:15.653 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:15.653 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:15.653 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:53:15.654 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:15.654 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:15.654 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:15.654 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:15.654 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:15.654 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:15.654 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:15.654 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:15.654 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:15.654 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:15.654 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:15.654 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:15.654 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:15.655 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:15.655 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:15.655 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:15.655 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.655 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:15.655 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:15.655 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:15.655 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:15.655 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:15.655 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:15.655 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:15.655 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:15.655 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:15.655 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:15.656 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:15.656 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:15.656 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:53:15.656 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:53:15.656 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:53:15.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.656 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:15.656 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:53:15.656 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:53:15.656 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.656 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.656 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:15.656 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 2, 2023-12-20T04:53:15.656 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 2, 2023-12-20T04:53:15.656 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:53:15.656 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:53:15.657 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:53:15.657 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:15.657 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:15.657 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:15.657 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.657 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.657 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.657 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 23, 2023-12-20T04:53:15.657 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:53:15.657 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:53:03.812892+0000", 2023-12-20T04:53:15.657 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:53:15.657 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:53:15.657 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:15.658 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:15.658 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:15.658 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:15.658 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:15.658 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:15.658 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:15.658 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:15.658 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:15.658 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:15.658 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:53:15.658 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:53:15.658 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:53:15.658 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:53:15.658 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:53:15.658 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:15.658 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:15.659 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:15.659 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:15.659 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:15.659 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:15.659 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:15.659 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.659 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "187", 2023-12-20T04:53:15.659 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:15.659 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:15.659 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:15.659 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:15.659 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:15.659 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:15.659 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:15.659 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:15.660 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:15.660 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 33554432, 2023-12-20T04:53:15.660 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:15.660 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:15.660 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:15.660 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:15.660 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:15.660 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:15.660 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:15.660 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:15.660 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:15.660 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:15.660 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:15.660 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:15.660 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:15.661 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:15.661 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:15.661 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:15.661 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.661 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:15.661 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:15.661 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:15.661 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:15.661 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:15.661 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:15.661 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:15.661 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:15.661 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:15.661 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:15.661 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:15.662 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:15.662 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:53:15.662 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:53:15.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.662 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:15.662 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:53:15.662 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:53:15.662 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.662 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.662 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:15.662 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.3799999952316284, 2023-12-20T04:53:15.662 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.3799999952316284, 2023-12-20T04:53:15.662 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:53:15.662 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-20T04:53:15.662 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-20T04:53:15.663 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:15.663 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:15.663 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:15.663 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.663 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.663 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:15.663 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:53:15.663 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.663 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:53:15.663 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:15.663 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:15.663 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:15.663 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:15.663 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:15.663 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:15.663 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:15.664 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:15.664 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:15.664 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:15.664 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:15.664 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:15.664 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.664 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.664 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:53:15.664 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:15.664 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.664 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.664 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.664 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:53:15.665 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:15.665 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.665 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.665 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:15.665 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.665 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.665 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:53:15.665 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:15.665 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.665 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.665 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.666 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:53:15.666 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:15.666 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.666 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.666 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.666 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:15.666 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.666 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.666 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.666 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:53:15.666 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:15.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.668 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.668 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.668 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:53:15.668 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:15.668 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.668 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.668 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.669 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:15.669 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.669 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.669 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:53:15.669 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:15.669 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.669 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.669 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.669 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:53:15.669 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:15.669 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.669 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.670 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:53:15.670 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:53:15.670 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:53:15.670 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:53:15.670 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:15.670 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:15.670 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:15.670 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.670 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.670 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.670 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:53:15.670 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:15.670 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:15.670 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:15.671 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:15.671 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:15.671 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:15.671 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:15.671 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:15.671 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:15.671 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:15.671 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:15.671 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:15.671 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.671 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.671 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.671 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:53:15.671 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:15.671 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.672 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.672 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:53:15.672 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:15.672 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.672 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.672 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:15.672 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.672 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.672 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:53:15.672 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:15.672 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.672 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.672 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.672 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:53:15.673 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:15.673 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.673 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.673 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:15.673 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.673 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.673 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:53:15.673 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:15.673 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.673 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.673 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.673 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:53:15.673 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:15.674 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.674 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.674 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:15.674 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.674 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.674 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:53:15.674 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:15.674 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.674 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.674 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.674 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:53:15.674 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:15.674 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.675 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.675 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:53:15.675 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:53:15.675 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:53:15.675 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:53:15.675 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:15.675 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:15.675 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:15.675 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.675 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.675 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.675 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:53:15.675 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:15.675 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:15.676 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:15.676 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:15.676 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:15.676 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:15.676 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:15.676 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:15.676 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:15.676 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:15.676 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:15.676 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:15.676 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.676 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.676 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.676 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:53:15.676 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:15.676 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.677 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.677 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:53:15.677 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:15.677 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.677 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.677 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:15.677 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.677 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.677 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:53:15.677 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:15.677 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.677 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.678 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.678 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:53:15.678 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:15.678 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.678 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.678 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:15.678 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.678 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.678 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:53:15.678 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:15.678 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.678 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.678 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.679 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:53:15.679 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:15.679 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.679 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.679 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:15.679 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.679 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.679 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:53:15.679 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:15.679 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.679 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.679 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.679 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:53:15.679 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:15.679 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.680 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.680 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:53:15.680 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:53:15.680 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:53:15.680 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:53:15.680 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:15.680 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:15.680 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:15.680 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.680 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.680 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.680 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:53:15.680 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:15.680 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:15.680 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:15.681 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:15.681 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:15.681 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:15.681 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:15.681 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:15.681 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:15.681 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:15.681 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:15.681 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:15.681 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.681 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.681 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.681 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:53:15.681 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:15.681 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.682 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.682 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:53:15.682 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:15.682 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.682 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.682 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:15.682 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.682 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.682 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:53:15.682 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:15.682 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.682 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.682 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.683 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:53:15.683 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:15.683 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.683 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.683 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:15.683 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.683 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.683 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:53:15.683 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:15.683 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.683 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.683 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.683 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:53:15.683 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:15.683 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.684 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.684 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:15.684 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.684 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.684 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:53:15.684 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:15.684 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.684 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.684 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.684 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:53:15.684 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:15.685 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.685 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.685 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:53:15.685 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:53:15.685 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:53:15.685 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:53:15.685 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:15.685 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:15.685 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:15.685 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.685 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.685 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.685 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:53:15.685 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:15.686 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:15.686 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:15.686 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:15.686 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:15.686 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:15.686 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:15.686 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:15.686 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:15.686 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:15.686 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:15.686 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:15.686 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.686 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.686 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.686 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:53:15.686 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:15.686 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.687 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.687 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:53:15.687 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:15.687 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.687 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.687 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:15.687 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.687 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.687 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:53:15.687 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:15.687 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.687 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.687 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.688 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:53:15.688 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:15.688 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.688 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.688 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:15.688 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.688 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.688 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:53:15.688 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:15.688 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.688 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.688 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.688 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:53:15.688 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:15.688 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.689 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.689 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:15.689 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.689 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.689 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:53:15.689 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:15.689 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.689 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.689 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.689 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:53:15.689 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:15.689 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.689 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.690 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:53:15.690 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:53:15.690 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:53:15.690 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:53:15.690 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:15.690 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:15.690 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:15.690 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.690 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.690 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.690 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:53:15.690 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:15.690 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:15.690 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:15.690 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:15.691 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:15.691 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:15.691 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:15.691 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:15.691 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:15.691 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:15.691 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:15.691 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:15.691 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.691 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.691 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:53:15.691 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:15.691 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.691 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.691 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.691 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:53:15.692 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:15.692 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.692 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.692 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:15.692 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.692 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.692 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:53:15.692 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:15.692 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.692 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.692 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.692 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:53:15.692 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:15.692 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.692 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.693 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:15.693 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.693 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.693 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:53:15.693 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:15.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.693 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.693 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.693 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:53:15.693 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:15.693 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.693 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.693 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.694 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:15.694 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.694 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.694 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:53:15.694 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:15.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.694 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.694 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.694 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:53:15.694 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:15.694 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.694 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.694 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.694 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:53:15.694 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:53:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:53:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:53:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:53:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:15.695 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:15.696 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:15.696 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:15.696 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:15.696 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:15.696 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.696 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.696 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:53:15.696 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:15.696 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.696 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.696 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.696 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:53:15.696 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:15.696 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.697 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.697 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:15.697 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.697 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.697 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:53:15.697 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:15.697 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.697 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.697 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.697 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:53:15.697 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:15.697 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.697 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.698 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:15.698 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.698 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.698 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:53:15.698 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:15.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.698 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.698 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.698 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:53:15.698 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:15.698 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.698 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.698 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.698 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:15.699 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.699 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.699 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:53:15.699 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:15.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.699 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.699 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.699 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:53:15.699 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:15.699 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.699 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.699 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.699 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:53:15.699 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:53:15.699 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:53:15.700 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:53:15.700 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:15.700 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:15.700 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:15.700 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.700 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.700 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.700 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:53:15.700 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:15.700 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:15.700 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:15.700 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:15.700 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:15.700 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:15.700 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:15.700 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:15.701 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:15.701 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:15.701 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:15.701 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:15.701 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.701 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.701 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:53:15.701 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:15.701 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.701 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.701 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.701 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:53:15.701 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:15.701 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.702 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.702 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:15.702 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.702 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.702 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:53:15.702 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:15.702 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.702 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.702 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.702 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:53:15.702 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:15.702 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.702 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.703 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:15.703 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.703 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.703 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:53:15.703 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:15.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.703 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.703 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.703 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:53:15.703 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:15.703 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.703 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.703 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.703 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:15.703 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:15.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.704 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:15.704 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:53:15.704 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:15.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.704 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.704 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:15.704 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:53:15.704 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:15.704 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.704 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.704 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.704 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:53:15.704 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:53:15.704 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:53:15.705 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:53:15.705 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:15.705 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:15.705 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:15.705 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:15.705 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.705 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:15.705 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:53:15.705 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.705 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:53:15.705 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:15.705 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:15.705 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:15.705 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:15.706 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:15.706 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:53:15.706 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:15.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.706 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:53:15.706 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:15.706 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:15.706 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:15.706 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:15.706 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:15.706 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:53:15.706 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:15.706 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.706 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.706 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:53:15.706 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:15.707 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:15.707 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:15.707 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:15.707 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:15.707 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:53:15.707 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:15.707 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.707 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.707 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:53:15.707 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:15.707 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:15.707 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:15.707 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:15.707 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:15.707 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:53:15.707 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:15.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.708 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:53:15.708 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:15.708 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:15.708 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:15.708 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:15.708 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:15.708 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:53:15.708 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:15.708 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.708 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.708 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:53:15.708 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:15.708 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:15.708 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:15.709 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:15.709 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:15.709 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:53:15.709 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:15.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.709 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.709 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:53:15.709 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:15.709 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:15.709 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:15.709 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:15.709 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:15.709 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:53:15.709 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:15.709 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.710 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:15.710 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:53:15.710 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:15.710 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:15.710 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:15.710 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:15.710 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:15.710 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:53:15.710 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:15.710 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.710 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:15.710 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:53:15.710 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:53:15.710 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:53:15.710 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:53:15.711 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:53:15.711 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:53:15.711 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:53:15.711 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:53:15.711 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:53:15.711 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:53:15.711 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:53:15.711 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:53:15.711 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:53:15.711 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:53:15.711 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.711 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:15.711 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:53:15.711 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:53:15.711 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:53:15.711 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:53:15.711 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:53:15.712 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:53:15.712 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:53:15.712 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:53:15.712 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:53:15.712 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:53:15.712 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:53:15.712 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:15.712 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:15.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.642+0000 7f4f757e3640 1 -- 172.21.15.132:0/683986410 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5c06a460 msgr2=0x7f4f5c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:15.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.642+0000 7f4f757e3640 1 --2- 172.21.15.132:0/683986410 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5c06a460 0x7f4f5c06c920 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f4f64006fd0 tx=0x7f4f64008040 comp rx=0 tx=0).stop 2023-12-20T04:53:15.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.642+0000 7f4f757e3640 1 -- 172.21.15.132:0/683986410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f58003970 msgr2=0x7f4f7014c480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:15.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.642+0000 7f4f757e3640 1 --2- 172.21.15.132:0/683986410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f58003970 0x7f4f7014c480 secure :-1 s=READY pgs=1841 cs=0 l=1 rev1=1 crypto rx=0x7f4f60001950 tx=0x7f4f60001a20 comp rx=0 tx=0).stop 2023-12-20T04:53:15.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.642+0000 7f4f757e3640 1 -- 172.21.15.132:0/683986410 shutdown_connections 2023-12-20T04:53:15.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.642+0000 7f4f757e3640 1 --2- 172.21.15.132:0/683986410 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4f5c06a460 0x7f4f5c06c920 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:15.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.642+0000 7f4f757e3640 1 --2- 172.21.15.132:0/683986410 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4f701f2b10 0x7f4f701f2fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:15.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.642+0000 7f4f757e3640 1 --2- 172.21.15.132:0/683986410 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4f7014b420 0x7f4f7014f630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:15.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.642+0000 7f4f757e3640 1 --2- 172.21.15.132:0/683986410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4f58003970 0x7f4f7014c480 unknown :-1 s=CLOSED pgs=1841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:15.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.642+0000 7f4f757e3640 1 -- 172.21.15.132:0/683986410 >> 172.21.15.132:0/683986410 conn(0x7f4f700cf980 msgr2=0x7f4f7006a1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:15.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.642+0000 7f4f757e3640 1 -- 172.21.15.132:0/683986410 shutdown_connections 2023-12-20T04:53:15.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:15.642+0000 7f4f757e3640 1 -- 172.21.15.132:0/683986410 wait complete. 2023-12-20T04:53:15.715 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-20T04:53:19.055 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:53:19.059 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:53:20.716 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:53:20.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.826+0000 7f3f3f9b9640 1 Processor -- start 2023-12-20T04:53:20.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.826+0000 7f3f3f9b9640 1 -- start start 2023-12-20T04:53:20.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.827+0000 7f3f3f9b9640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f3815d100 0x7f3f380b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:20.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.827+0000 7f3f3f9b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f380cdc10 0x7f3f3806c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:20.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.827+0000 7f3f3f9b9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3f380b2f90 con 0x7f3f380d0370 2023-12-20T04:53:20.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.827+0000 7f3f3f9b9640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3f381613c0 con 0x7f3f3815d100 2023-12-20T04:53:20.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.827+0000 7f3f3f9b9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f380d1b00 con 0x7f3f380cdc10 2023-12-20T04:53:20.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.827+0000 7f3f3d755640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f3815d100 0x7f3f380b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:20.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.827+0000 7f3f3d755640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f3f3815d100 0x7f3f380b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58540/0 (socket says 172.21.15.132:58540) 2023-12-20T04:53:20.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.827+0000 7f3f3d755640 1 -- 172.21.15.132:0/3609338368 learned_addr learned my addr 172.21.15.132:0/3609338368 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:20.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.827+0000 7f3f3df56640 1 --2- 172.21.15.132:0/3609338368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f380cdc10 0x7f3f3806c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:20.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.827+0000 7f3f3d755640 1 -- 172.21.15.132:0/3609338368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f380cdc10 msgr2=0x7f3f3806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:20.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.827+0000 7f3f3d755640 1 --2- 172.21.15.132:0/3609338368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f380cdc10 0x7f3f3806c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:20.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.828+0000 7f3f3d755640 1 -- 172.21.15.132:0/3609338368 >> v1:172.21.15.187:6789/0 conn(0x7f3f380d0370 legacy=0x7f3f380cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:20.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.828+0000 7f3f3d755640 1 -- 172.21.15.132:0/3609338368 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f380d0810 con 0x7f3f3815d100 2023-12-20T04:53:20.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.828+0000 7f3f3d755640 1 --2- 172.21.15.132:0/3609338368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3815d100 0x7f3f380b2a50 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009870 tx=0x7f3f3402b980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8f65ed0b9bc5c675 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:20.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.828+0000 7f3f2ffff640 1 -- 172.21.15.132:0/3609338368 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34030840 con 0x7f3f3815d100 2023-12-20T04:53:20.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.828+0000 7f3f2ffff640 1 -- 172.21.15.132:0/3609338368 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f340309a0 con 0x7f3f3815d100 2023-12-20T04:53:20.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.828+0000 7f3f2ffff640 1 -- 172.21.15.132:0/3609338368 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f34030d30 con 0x7f3f3815d100 2023-12-20T04:53:20.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.829+0000 7f3f3f9b9640 1 -- 172.21.15.132:0/3609338368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3815d100 msgr2=0x7f3f380b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:20.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.829+0000 7f3f3f9b9640 1 --2- 172.21.15.132:0/3609338368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3815d100 0x7f3f380b2a50 secure :-1 s=READY pgs=1842 cs=0 l=1 rev1=1 crypto rx=0x7f3f34009870 tx=0x7f3f3402b980 comp rx=0 tx=0).stop 2023-12-20T04:53:20.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.829+0000 7f3f3f9b9640 1 -- 172.21.15.132:0/3609338368 shutdown_connections 2023-12-20T04:53:20.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.829+0000 7f3f3f9b9640 1 --2- 172.21.15.132:0/3609338368 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f380cdc10 0x7f3f3806c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:20.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.829+0000 7f3f3f9b9640 1 --2- 172.21.15.132:0/3609338368 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f3815d100 0x7f3f380b2a50 unknown :-1 s=CLOSED pgs=1842 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:20.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.829+0000 7f3f3f9b9640 1 -- 172.21.15.132:0/3609338368 >> 172.21.15.132:0/3609338368 conn(0x7f3f3806d7c0 msgr2=0x7f3f3806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:20.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.829+0000 7f3f3f9b9640 1 -- 172.21.15.132:0/3609338368 shutdown_connections 2023-12-20T04:53:20.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.829+0000 7f3f3f9b9640 1 -- 172.21.15.132:0/3609338368 wait complete. 2023-12-20T04:53:20.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.830+0000 7f3f3f9b9640 1 Processor -- start 2023-12-20T04:53:20.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.830+0000 7f3f3f9b9640 1 -- start start 2023-12-20T04:53:20.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.831+0000 7f3f3f9b9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f380cdc10 0x7f3f380c9900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:20.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.831+0000 7f3f3f9b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f380d0370 0x7f3f3815c180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:20.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.831+0000 7f3f3f9b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f3815d100 0x7f3f3815f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:20.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.831+0000 7f3f3f9b9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f380b3b20 con 0x7f3f380d0370 2023-12-20T04:53:20.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.831+0000 7f3f3f9b9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f380b3dc0 con 0x7f3f380cdc10 2023-12-20T04:53:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.831+0000 7f3f3f9b9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3f380b40a0 con 0x7f3f3815d100 2023-12-20T04:53:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.831+0000 7f3f3cf54640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f380d0370 0x7f3f3815c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.831+0000 7f3f3cf54640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f380d0370 0x7f3f3815c180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58552/0 (socket says 172.21.15.132:58552) 2023-12-20T04:53:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.831+0000 7f3f3cf54640 1 -- 172.21.15.132:0/1602808954 learned_addr learned my addr 172.21.15.132:0/1602808954 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.831+0000 7f3f3df56640 1 --2- 172.21.15.132:0/1602808954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f3815d100 0x7f3f3815f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.831+0000 7f3f3d755640 1 --2- 172.21.15.132:0/1602808954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f380cdc10 0x7f3f380c9900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.831+0000 7f3f3cf54640 1 -- 172.21.15.132:0/1602808954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f3815d100 msgr2=0x7f3f3815f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.831+0000 7f3f3cf54640 1 --2- 172.21.15.132:0/1602808954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f3815d100 0x7f3f3815f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.831+0000 7f3f3cf54640 1 -- 172.21.15.132:0/1602808954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f380cdc10 msgr2=0x7f3f380c9900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.831+0000 7f3f3cf54640 1 --2- 172.21.15.132:0/1602808954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f380cdc10 0x7f3f380c9900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.831+0000 7f3f3cf54640 1 -- 172.21.15.132:0/1602808954 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f340094d0 con 0x7f3f380d0370 2023-12-20T04:53:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.832+0000 7f3f3cf54640 1 --2- 172.21.15.132:0/1602808954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f380d0370 0x7f3f3815c180 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800c480 tx=0x7f3f2800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.832+0000 7f3f2dffb640 1 -- 172.21.15.132:0/1602808954 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f280052d0 con 0x7f3f380d0370 2023-12-20T04:53:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.832+0000 7f3f2dffb640 1 -- 172.21.15.132:0/1602808954 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3f28005430 con 0x7f3f380d0370 2023-12-20T04:53:20.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.832+0000 7f3f3f9b9640 1 -- 172.21.15.132:0/1602808954 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f380b4380 con 0x7f3f380d0370 2023-12-20T04:53:20.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.832+0000 7f3f2dffb640 1 -- 172.21.15.132:0/1602808954 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3f28012870 con 0x7f3f380d0370 2023-12-20T04:53:20.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.832+0000 7f3f3f9b9640 1 -- 172.21.15.132:0/1602808954 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f380ca790 con 0x7f3f380d0370 2023-12-20T04:53:20.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.833+0000 7f3f3f9b9640 1 -- 172.21.15.132:0/1602808954 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f380b48a0 con 0x7f3f380d0370 2023-12-20T04:53:20.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.833+0000 7f3f2dffb640 1 -- 172.21.15.132:0/1602808954 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3f280129d0 con 0x7f3f380d0370 2023-12-20T04:53:20.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.834+0000 7f3f2dffb640 1 --2- 172.21.15.132:0/1602808954 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3f1c06a430 0x7f3f1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:20.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.834+0000 7f3f2dffb640 1 -- 172.21.15.132:0/1602808954 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3f28088370 con 0x7f3f380d0370 2023-12-20T04:53:20.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.834+0000 7f3f3d755640 1 --2- 172.21.15.132:0/1602808954 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3f1c06a430 0x7f3f1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:20.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.834+0000 7f3f2dffb640 1 -- 172.21.15.132:0/1602808954 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=189}) v3 -- 0x7f3f1c071f60 con 0x7f3f380d0370 2023-12-20T04:53:20.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.834+0000 7f3f3d755640 1 --2- 172.21.15.132:0/1602808954 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3f1c06a430 0x7f3f1c06c8f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3f34036000 tx=0x7f3f34008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:20.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:20.838+0000 7f3f2dffb640 1 -- 172.21.15.132:0/1602808954 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3f380b48a0 con 0x7f3f380d0370 2023-12-20T04:53:21.009 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.008+0000 7f3f3f9b9640 1 -- 172.21.15.132:0/1602808954 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f3f380b2f90 con 0x7f3f380d0370 2023-12-20T04:53:21.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.009+0000 7f3f2dffb640 1 -- 172.21.15.132:0/1602808954 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v188) v1 ==== 81+0+33613 (secure 0 0 0) 0x7f3f380b2f90 con 0x7f3f380d0370 2023-12-20T04:53:21.012 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:21.012 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:21.012 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 188, 2023-12-20T04:53:21.012 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:53:21.012 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:53:21.012 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:53:19.907593+0000", 2023-12-20T04:53:21.013 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:53:21.013 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:53:21.013 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:53:21.013 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:53:21.013 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:53:21.013 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:53:21.014 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:53:21.014 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:53:21.014 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:53:21.014 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:21.014 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:53:21.014 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:53:21.014 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:53:21.014 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:53:21.014 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:53:21.014 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 23, 2023-12-20T04:53:21.014 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:53:21.014 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:53:21.015 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:53:21.015 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:53:21.015 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:53:21.015 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:53:21.015 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.015 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:53:21.015 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:53:21.015 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:53:21.015 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:53:21.015 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:53:21.015 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:21.015 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:21.015 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:21.015 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:21.015 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:21.015 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:21.016 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:21.016 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:21.016 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:21.016 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:21.016 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:53:21.016 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:53:21.016 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:53:21.016 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:53:21.016 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:53:21.016 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:21.016 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:21.016 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:21.016 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:21.016 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:21.016 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:21.016 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:21.016 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.017 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:53:21.017 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:21.017 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:21.017 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:21.017 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:21.017 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:21.017 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:21.017 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:21.017 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:21.017 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:21.017 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:53:21.017 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:21.017 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:21.017 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:21.017 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:21.018 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:21.018 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:21.018 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:21.018 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:21.018 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:21.018 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:21.018 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:21.018 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:21.018 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:21.018 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:21.018 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:21.018 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:21.018 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.018 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:21.018 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:21.018 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:21.019 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:21.019 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:21.019 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:21.019 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:21.019 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:21.019 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:21.019 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:21.019 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:21.019 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:21.019 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:53:21.019 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:53:21.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.019 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:21.019 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:53:21.019 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.019 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:21.020 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:53:21.020 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:53:21.020 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:53:21.020 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:53:21.020 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:53:21.020 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:21.020 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:21.020 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:21.020 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.020 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.020 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.021 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 22, 2023-12-20T04:53:21.021 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:53:21.021 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:53:03.034230+0000", 2023-12-20T04:53:21.021 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:53:21.021 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:53:21.021 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:21.021 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:21.021 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:21.021 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:21.021 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:21.021 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:21.021 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:21.021 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:21.021 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:21.021 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:21.021 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:53:21.022 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:53:21.022 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:53:21.022 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:53:21.022 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:53:21.022 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:21.022 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:21.022 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:21.022 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:21.022 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:21.022 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:21.022 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:21.022 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.022 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "185", 2023-12-20T04:53:21.022 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:21.022 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:21.023 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:21.023 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:21.023 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:21.023 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:21.023 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:21.023 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:21.023 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:21.023 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:53:21.023 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:21.023 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:21.023 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:21.023 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:21.023 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:21.023 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:21.023 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:21.023 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:21.024 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:21.024 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:21.024 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:21.024 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:21.024 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:21.024 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:21.024 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:21.024 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:21.024 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.024 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:21.024 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:21.024 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:21.024 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:21.024 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:21.024 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:21.024 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:21.025 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:21.025 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:21.025 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:21.025 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:21.025 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:21.025 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:53:21.025 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:53:21.025 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:53:21.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.025 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:21.025 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:53:21.025 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:53:21.025 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.025 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.025 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:21.026 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 2, 2023-12-20T04:53:21.026 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 2, 2023-12-20T04:53:21.026 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:53:21.026 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:53:21.026 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:53:21.026 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:21.026 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:21.026 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:21.026 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.026 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.026 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.026 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 23, 2023-12-20T04:53:21.026 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:53:21.027 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:53:03.812892+0000", 2023-12-20T04:53:21.027 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1027, 2023-12-20T04:53:21.027 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-20T04:53:21.027 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:21.027 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:21.027 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:21.027 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:21.027 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:21.027 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:21.027 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:21.027 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:21.027 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:21.027 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:21.027 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:53:21.027 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:53:21.027 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:53:21.027 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:53:21.028 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:53:21.028 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:21.028 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:21.028 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:21.028 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:21.028 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:21.028 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:21.028 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:21.028 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.028 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "188", 2023-12-20T04:53:21.028 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:21.028 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:21.028 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:21.028 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:21.028 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:21.029 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:21.029 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:21.029 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:21.029 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:21.029 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 33554432, 2023-12-20T04:53:21.029 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:21.029 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:21.029 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:21.029 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:21.029 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:21.029 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:21.029 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:21.029 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:21.029 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:21.029 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:21.030 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:21.030 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:21.030 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:21.030 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:21.030 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:21.030 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:21.030 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.030 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:21.030 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:21.030 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:21.030 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:21.030 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:21.030 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:21.030 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:21.030 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:21.031 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:21.031 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:21.031 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:21.031 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:21.031 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:53:21.031 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:53:21.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.031 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:21.031 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:53:21.031 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:53:21.031 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.031 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.031 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:21.032 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.3799999952316284, 2023-12-20T04:53:21.032 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.3799999952316284, 2023-12-20T04:53:21.032 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:53:21.032 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-20T04:53:21.032 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-20T04:53:21.032 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:21.032 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:21.032 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:21.032 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.032 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.032 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:21.032 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:53:21.032 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.032 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:53:21.032 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:21.033 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:21.033 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:21.033 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:21.033 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:21.033 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:21.033 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:21.033 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:21.033 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:21.033 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:21.033 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:21.033 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:21.033 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.033 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.033 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.033 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:53:21.034 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:21.034 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.034 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.034 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.034 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:53:21.034 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:21.034 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.034 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.034 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.034 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:21.034 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.034 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.034 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.034 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:53:21.034 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:21.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.035 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.035 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:53:21.035 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:21.035 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.035 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.035 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:21.035 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.035 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.035 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:53:21.035 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:21.035 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.035 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.036 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.036 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:53:21.036 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:21.036 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.036 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.036 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:21.036 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.036 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.036 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:53:21.036 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:21.036 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.036 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.036 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.036 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:53:21.036 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:21.037 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.037 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.037 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.037 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:53:21.037 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:53:21.037 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:53:21.037 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:53:21.037 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:21.037 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:21.037 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:21.037 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.037 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.037 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.037 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:53:21.037 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:21.038 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:21.038 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:21.038 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:21.038 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:21.038 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:21.038 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:21.038 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:21.038 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:21.038 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:21.038 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:21.038 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:21.038 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.038 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.038 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.039 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:53:21.039 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:21.039 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.039 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.039 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.039 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:53:21.039 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:21.039 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.039 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.039 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.039 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:21.039 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.039 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.039 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.039 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:53:21.039 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:21.039 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.040 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.040 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:53:21.040 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:21.040 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.040 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.040 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.040 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:21.040 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.040 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.040 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.040 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:53:21.040 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:21.041 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.041 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.041 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.041 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:53:21.041 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:21.041 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.041 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.041 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.041 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:21.041 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.041 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.041 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.041 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:53:21.041 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:21.041 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.042 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.042 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.042 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:53:21.042 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:21.042 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.042 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.042 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.043 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:53:21.043 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:53:21.043 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:53:21.043 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:53:21.043 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:21.043 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:21.044 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:21.044 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.044 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.044 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.044 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:53:21.044 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:21.045 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:21.045 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:21.045 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:21.045 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:21.045 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:21.045 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:21.045 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:21.045 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:21.046 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:21.046 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:21.046 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:21.046 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.046 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.046 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.046 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:53:21.046 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:21.046 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.046 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.046 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.046 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:53:21.046 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:21.046 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.047 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.047 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:21.047 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.047 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.047 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.047 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:53:21.047 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:21.047 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.047 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.047 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.047 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:53:21.047 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:21.048 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.048 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.048 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:21.048 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.048 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.048 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:53:21.048 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:21.048 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.048 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.048 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.048 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:53:21.048 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:21.049 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.049 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.049 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.049 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:21.049 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.049 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.049 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.049 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:53:21.049 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:21.049 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.049 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.049 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.049 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:53:21.049 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:21.049 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.050 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.050 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.050 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:53:21.050 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:53:21.050 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:53:21.050 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:53:21.050 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:21.050 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:21.050 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:21.050 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.050 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.050 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.050 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:53:21.051 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:21.051 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:21.051 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:21.051 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:21.051 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:21.051 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:21.051 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:21.051 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:21.051 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:21.051 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:21.051 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:21.051 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:21.051 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.051 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.051 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.052 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:53:21.052 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:21.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.052 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.052 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.052 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:53:21.052 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:21.052 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.052 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.052 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.052 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:21.052 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.052 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.053 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.053 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:53:21.053 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:21.053 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.053 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.053 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.053 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:53:21.053 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:21.053 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.053 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.053 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.053 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:21.053 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.053 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.054 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.054 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:53:21.054 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:21.054 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.054 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.054 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.054 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:53:21.054 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:21.054 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.054 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.054 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.054 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:21.054 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.055 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.055 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.055 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:53:21.055 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:21.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.055 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.055 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.055 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:53:21.055 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:21.055 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.055 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.055 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.055 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:53:21.055 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:53:21.055 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:53:21.055 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:53:21.055 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:21.056 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:21.056 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:21.056 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.056 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.056 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.056 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:53:21.056 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:21.056 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:21.056 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:21.056 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:21.056 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:21.056 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:21.056 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:21.056 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:21.056 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:21.056 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:21.057 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:21.057 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:21.057 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.057 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.057 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.057 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:53:21.057 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:21.057 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.057 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.057 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.057 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:53:21.057 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:21.057 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.057 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.057 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.058 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:21.058 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.058 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.058 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.058 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:53:21.058 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:21.058 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.058 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.058 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.058 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:53:21.058 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:21.058 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.058 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.058 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.058 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:21.058 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.059 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.059 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.059 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:53:21.059 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:21.059 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.059 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.059 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.059 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:53:21.059 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:21.060 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.060 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.060 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.060 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:21.060 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.060 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.061 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.061 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:53:21.061 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:21.061 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.061 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.061 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.062 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:53:21.062 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:21.062 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.062 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.062 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.062 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:53:21.062 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:53:21.062 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:53:21.062 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:53:21.062 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:21.062 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:21.063 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:21.063 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.063 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.063 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.063 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:53:21.063 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:21.063 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:21.063 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:21.063 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:21.063 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:21.063 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:21.063 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:21.063 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:21.063 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:21.063 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:21.063 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:21.064 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:21.064 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.064 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.064 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.064 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:53:21.064 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:21.064 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.064 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.064 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.064 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:53:21.064 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:21.064 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.064 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.064 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.064 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:21.064 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.065 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.065 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.065 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:53:21.065 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:21.065 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.065 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.065 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.065 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:53:21.065 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:21.065 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.065 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.065 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.065 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:21.066 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.066 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.066 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.066 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:53:21.066 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:21.066 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.066 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.066 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.066 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:53:21.066 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:21.066 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.066 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.066 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.066 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:21.066 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.067 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.067 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.067 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:53:21.067 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:21.067 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.067 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.067 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.067 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:53:21.067 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:21.067 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.067 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.067 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.067 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:53:21.067 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:53:21.067 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:53:21.067 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:53:21.068 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:21.068 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:21.068 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:21.068 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.068 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.068 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.068 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:53:21.068 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:21.068 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:21.068 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:21.068 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:21.068 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:21.068 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:21.068 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:21.068 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:21.068 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:21.068 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:21.069 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:21.069 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:21.069 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.069 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.069 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.069 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:53:21.069 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:21.069 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.069 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.069 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.069 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:53:21.069 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:21.069 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.069 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.070 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.070 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:21.070 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.070 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.070 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.070 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:53:21.070 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:21.070 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.070 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.070 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.070 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:53:21.070 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:21.071 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.071 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.071 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.071 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:21.071 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.071 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.071 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.071 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:53:21.071 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:21.071 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.071 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.071 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.071 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:53:21.071 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:21.071 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.071 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.072 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.072 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:21.072 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.072 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.072 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.072 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:53:21.072 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:21.072 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.072 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.072 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.072 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:53:21.072 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:21.072 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.073 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.073 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.073 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:53:21.073 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:53:21.073 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:53:21.073 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:53:21.073 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:21.073 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:21.073 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:21.073 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.073 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.073 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.073 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:53:21.073 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:21.074 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:21.074 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:21.074 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:21.074 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:21.074 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:21.074 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:21.074 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:21.074 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:21.074 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:21.074 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:21.074 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:21.074 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.074 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.074 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.074 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:53:21.074 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:21.075 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.075 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.075 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.075 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:53:21.075 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:21.075 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.075 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.075 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.075 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:21.075 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.075 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.075 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.075 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:53:21.075 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:21.075 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.076 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.076 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.076 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:53:21.076 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:21.076 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.076 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.076 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.076 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:21.076 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.076 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.076 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.076 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:53:21.076 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:21.076 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.076 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.076 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.076 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:53:21.077 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:21.077 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.077 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.077 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.077 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:21.077 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.077 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.077 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.077 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:53:21.077 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:21.077 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.077 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.077 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.077 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:53:21.077 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:21.078 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.078 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.078 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.078 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:53:21.078 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:53:21.078 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:53:21.078 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:53:21.078 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:21.078 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:21.078 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:21.078 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.078 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.078 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:21.078 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:53:21.078 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.078 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:53:21.079 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:21.079 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:21.079 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:21.079 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:21.079 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:21.079 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:53:21.079 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:21.079 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.079 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.079 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:53:21.079 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:21.079 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:21.079 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:21.079 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:21.079 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:21.080 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:53:21.080 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:21.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.080 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.080 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:53:21.080 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:21.080 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:21.080 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:21.080 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:21.080 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:21.080 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:53:21.080 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:21.080 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.080 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.080 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:53:21.080 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:21.081 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:21.081 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:21.081 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:21.081 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:21.081 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:53:21.081 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:21.081 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.081 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.081 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:53:21.081 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:21.081 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:21.081 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:21.081 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:21.081 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:21.082 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:53:21.082 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:21.082 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.082 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.082 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:53:21.082 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:21.082 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:21.082 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:21.082 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:21.082 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:21.082 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:53:21.082 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:21.082 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.082 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.082 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:53:21.082 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:21.083 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:21.083 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:21.083 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:21.083 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:21.083 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:53:21.083 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:21.083 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.083 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.083 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:53:21.083 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:21.083 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:21.083 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:21.083 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:21.083 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:21.083 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:53:21.084 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:21.084 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.084 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:21.084 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:53:21.084 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:53:21.084 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:53:21.084 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:53:21.084 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:53:21.084 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:53:21.084 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:53:21.084 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:53:21.084 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:53:21.084 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:53:21.084 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:53:21.084 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:53:21.085 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:53:21.085 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:53:21.085 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.085 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.085 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:53:21.085 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:53:21.085 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:53:21.085 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:53:21.085 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:53:21.085 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:53:21.085 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:53:21.085 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:53:21.085 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:53:21.085 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:53:21.086 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:53:21.086 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.086 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.011+0000 7f3f3f9b9640 1 -- 172.21.15.132:0/1602808954 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3f1c06a430 msgr2=0x7f3f1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.011+0000 7f3f3f9b9640 1 --2- 172.21.15.132:0/1602808954 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3f1c06a430 0x7f3f1c06c8f0 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f3f34036000 tx=0x7f3f34008030 comp rx=0 tx=0).stop 2023-12-20T04:53:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.011+0000 7f3f3f9b9640 1 -- 172.21.15.132:0/1602808954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f380d0370 msgr2=0x7f3f3815c180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.011+0000 7f3f3f9b9640 1 --2- 172.21.15.132:0/1602808954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f380d0370 0x7f3f3815c180 secure :-1 s=READY pgs=1843 cs=0 l=1 rev1=1 crypto rx=0x7f3f2800c480 tx=0x7f3f2800c940 comp rx=0 tx=0).stop 2023-12-20T04:53:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.011+0000 7f3f3f9b9640 1 -- 172.21.15.132:0/1602808954 shutdown_connections 2023-12-20T04:53:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.011+0000 7f3f3f9b9640 1 --2- 172.21.15.132:0/1602808954 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3f1c06a430 0x7f3f1c06c8f0 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.087 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.011+0000 7f3f3f9b9640 1 --2- 172.21.15.132:0/1602808954 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3f3815d100 0x7f3f3815f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.011+0000 7f3f3f9b9640 1 --2- 172.21.15.132:0/1602808954 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3f380d0370 0x7f3f3815c180 unknown :-1 s=CLOSED pgs=1843 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.011+0000 7f3f3f9b9640 1 --2- 172.21.15.132:0/1602808954 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3f380cdc10 0x7f3f380c9900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.011+0000 7f3f3f9b9640 1 -- 172.21.15.132:0/1602808954 >> 172.21.15.132:0/1602808954 conn(0x7f3f3806d7c0 msgr2=0x7f3f380b1720 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:21.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.011+0000 7f3f3f9b9640 1 -- 172.21.15.132:0/1602808954 shutdown_connections 2023-12-20T04:53:21.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.011+0000 7f3f3f9b9640 1 -- 172.21.15.132:0/1602808954 wait complete. 2023-12-20T04:53:21.088 DEBUG:tasks.ceph_test_case:wait_until_true: success in 5s and 0 retries 2023-12-20T04:53:21.089 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:53:21.089 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:53:21.104 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:21.105 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file_b bs=1M conv=fdatasync count=50 seek=16) 2023-12-20T04:53:21.205 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:53:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:dd: error writing 'large_file_b': No space left on device 2023-12-20T04:53:21.205 INFO:teuthology.orchestra.run.smithi132.stderr:dd: closing output file 'large_file_b': No space left on device 2023-12-20T04:53:21.206 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:53:21.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.304+0000 7f62547d2640 1 Processor -- start 2023-12-20T04:53:21.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.305+0000 7f62547d2640 1 -- start start 2023-12-20T04:53:21.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.305+0000 7f62547d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f624c160450 0x7f624c160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:21.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.305+0000 7f62547d2640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f624c1611b0 0x7f624c0b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:21.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.305+0000 7f62547d2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f624c0b4ec0 0x7f624c06a1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:21.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.305+0000 7f62547d2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624c0b5350 con 0x7f624c0b4ec0 2023-12-20T04:53:21.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.305+0000 7f62547d2640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f624c0b5ec0 con 0x7f624c1611b0 2023-12-20T04:53:21.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.305+0000 7f62547d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c1617e0 con 0x7f624c160450 2023-12-20T04:53:21.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.306+0000 7f6252d6f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f624c0b4ec0 0x7f624c06a1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:21.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.306+0000 7f6252d6f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f624c0b4ec0 0x7f624c06a1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58566/0 (socket says 172.21.15.132:58566) 2023-12-20T04:53:21.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.306+0000 7f6252d6f640 1 -- 172.21.15.132:0/293701219 learned_addr learned my addr 172.21.15.132:0/293701219 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:21.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.306+0000 7f6251d6d640 1 --2- 172.21.15.132:0/293701219 >> v2:172.21.15.187:3300/0 conn(0x7f624c1611b0 0x7f624c0b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:21.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.306+0000 7f625256e640 1 --2- 172.21.15.132:0/293701219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f624c160450 0x7f624c160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:21.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.306+0000 7f6252d6f640 1 -- 172.21.15.132:0/293701219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f624c160450 msgr2=0x7f624c160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:21.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.306+0000 7f6252d6f640 1 --2- 172.21.15.132:0/293701219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f624c160450 0x7f624c160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.306+0000 7f6252d6f640 1 -- 172.21.15.132:0/293701219 >> v2:172.21.15.187:3300/0 conn(0x7f624c1611b0 msgr2=0x7f624c0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:21.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.306+0000 7f6252d6f640 1 --2- 172.21.15.132:0/293701219 >> v2:172.21.15.187:3300/0 conn(0x7f624c1611b0 0x7f624c0b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.306+0000 7f6252d6f640 1 -- 172.21.15.132:0/293701219 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f624c0d0fc0 con 0x7f624c0b4ec0 2023-12-20T04:53:21.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.306+0000 7f6251d6d640 1 --2- 172.21.15.132:0/293701219 >> v2:172.21.15.187:3300/0 conn(0x7f624c1611b0 0x7f624c0b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:21.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.306+0000 7f625256e640 1 --2- 172.21.15.132:0/293701219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f624c160450 0x7f624c160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:21.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.307+0000 7f6252d6f640 1 --2- 172.21.15.132:0/293701219 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b4ec0 0x7f624c06a1a0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f624c06b4a0 tx=0x7f624802b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=981262acddd1748a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:21.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.307+0000 7f625156c640 1 -- 172.21.15.132:0/293701219 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248030860 con 0x7f624c0b4ec0 2023-12-20T04:53:21.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.307+0000 7f625156c640 1 -- 172.21.15.132:0/293701219 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f62480309c0 con 0x7f624c0b4ec0 2023-12-20T04:53:21.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.307+0000 7f625156c640 1 -- 172.21.15.132:0/293701219 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6248030d50 con 0x7f624c0b4ec0 2023-12-20T04:53:21.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.307+0000 7f62547d2640 1 -- 172.21.15.132:0/293701219 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b4ec0 msgr2=0x7f624c06a1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:21.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.307+0000 7f62547d2640 1 --2- 172.21.15.132:0/293701219 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b4ec0 0x7f624c06a1a0 secure :-1 s=READY pgs=1844 cs=0 l=1 rev1=1 crypto rx=0x7f624c06b4a0 tx=0x7f624802b9a0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.307+0000 7f62547d2640 1 -- 172.21.15.132:0/293701219 shutdown_connections 2023-12-20T04:53:21.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.307+0000 7f62547d2640 1 --2- 172.21.15.132:0/293701219 >> v2:172.21.15.187:3300/0 conn(0x7f624c1611b0 0x7f624c0b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.307+0000 7f62547d2640 1 --2- 172.21.15.132:0/293701219 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b4ec0 0x7f624c06a1a0 unknown :-1 s=CLOSED pgs=1844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.307+0000 7f62547d2640 1 --2- 172.21.15.132:0/293701219 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f624c160450 0x7f624c160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.307+0000 7f62547d2640 1 -- 172.21.15.132:0/293701219 >> 172.21.15.132:0/293701219 conn(0x7f624c0cf980 msgr2=0x7f624c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:21.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.307+0000 7f62547d2640 1 -- 172.21.15.132:0/293701219 shutdown_connections 2023-12-20T04:53:21.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.307+0000 7f62547d2640 1 -- 172.21.15.132:0/293701219 wait complete. 2023-12-20T04:53:21.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.309+0000 7f62547d2640 1 Processor -- start 2023-12-20T04:53:21.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.309+0000 7f62547d2640 1 -- start start 2023-12-20T04:53:21.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.309+0000 7f62547d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b4ec0 0x7f624c1f3b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.309+0000 7f62547d2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f624c160450 0x7f624c15ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.309+0000 7f62547d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f624c1611b0 0x7f624c15bd20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.309+0000 7f62547d2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c15c8e0 con 0x7f624c0b4ec0 2023-12-20T04:53:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.309+0000 7f62547d2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f624c15cbc0 con 0x7f624c160450 2023-12-20T04:53:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.309+0000 7f62547d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f624c15cea0 con 0x7f624c1611b0 2023-12-20T04:53:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.309+0000 7f625256e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b4ec0 0x7f624c1f3b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.309+0000 7f625256e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b4ec0 0x7f624c1f3b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58582/0 (socket says 172.21.15.132:58582) 2023-12-20T04:53:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.309+0000 7f625256e640 1 -- 172.21.15.132:0/3555193103 learned_addr learned my addr 172.21.15.132:0/3555193103 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.310+0000 7f625256e640 1 -- 172.21.15.132:0/3555193103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f624c1611b0 msgr2=0x7f624c15bd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.310+0000 7f625256e640 1 --2- 172.21.15.132:0/3555193103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f624c1611b0 0x7f624c15bd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.310+0000 7f625256e640 1 -- 172.21.15.132:0/3555193103 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f624c160450 msgr2=0x7f624c15ebc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.310+0000 7f625256e640 1 --2- 172.21.15.132:0/3555193103 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f624c160450 0x7f624c15ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.310+0000 7f625256e640 1 -- 172.21.15.132:0/3555193103 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62480094d0 con 0x7f624c0b4ec0 2023-12-20T04:53:21.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.310+0000 7f625256e640 1 --2- 172.21.15.132:0/3555193103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b4ec0 0x7f624c1f3b00 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f624400cf60 tx=0x7f624400cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.310+0000 7f6242ffd640 1 -- 172.21.15.132:0/3555193103 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624400d840 con 0x7f624c0b4ec0 2023-12-20T04:53:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.310+0000 7f6242ffd640 1 -- 172.21.15.132:0/3555193103 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f624400d9a0 con 0x7f624c0b4ec0 2023-12-20T04:53:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.310+0000 7f62547d2640 1 -- 172.21.15.132:0/3555193103 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f624c15d180 con 0x7f624c0b4ec0 2023-12-20T04:53:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.310+0000 7f6242ffd640 1 -- 172.21.15.132:0/3555193103 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f624400dd30 con 0x7f624c0b4ec0 2023-12-20T04:53:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.310+0000 7f62547d2640 1 -- 172.21.15.132:0/3555193103 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f624c1f4040 con 0x7f624c0b4ec0 2023-12-20T04:53:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.311+0000 7f62547d2640 1 -- 172.21.15.132:0/3555193103 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f624c04e840 con 0x7f624c0b4ec0 2023-12-20T04:53:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.311+0000 7f6242ffd640 1 -- 172.21.15.132:0/3555193103 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6244015440 con 0x7f624c0b4ec0 2023-12-20T04:53:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.312+0000 7f6242ffd640 1 --2- 172.21.15.132:0/3555193103 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f623006a430 0x7f623006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.312+0000 7f6242ffd640 1 -- 172.21.15.132:0/3555193103 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6244089300 con 0x7f624c0b4ec0 2023-12-20T04:53:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.312+0000 7f6251d6d640 1 --2- 172.21.15.132:0/3555193103 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f623006a430 0x7f623006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.312+0000 7f6242ffd640 1 -- 172.21.15.132:0/3555193103 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=189}) v3 -- 0x7f6230071f60 con 0x7f624c0b4ec0 2023-12-20T04:53:21.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.312+0000 7f6251d6d640 1 --2- 172.21.15.132:0/3555193103 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f623006a430 0x7f623006c8f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f623c006b10 tx=0x7f623c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:21.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.316+0000 7f6242ffd640 1 -- 172.21.15.132:0/3555193103 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f624401a060 con 0x7f624c0b4ec0 2023-12-20T04:53:21.485 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.484+0000 7f62547d2640 1 -- 172.21.15.132:0/3555193103 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f624c15ca20 con 0x7f624c0b4ec0 2023-12-20T04:53:21.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.486+0000 7f6242ffd640 1 -- 172.21.15.132:0/3555193103 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v188) v1 ==== 81+0+33613 (secure 0 0 0) 0x7f624c15ca20 con 0x7f624c0b4ec0 2023-12-20T04:53:21.487 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:21.487 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:21.487 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 188, 2023-12-20T04:53:21.487 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:53:21.487 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:53:21.487 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:53:19.907593+0000", 2023-12-20T04:53:21.488 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:53:21.488 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:53:21.488 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:53:21.488 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:53:21.488 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:53:21.488 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:53:21.488 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:53:21.488 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:53:21.488 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:53:21.488 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:21.488 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:53:21.488 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:53:21.488 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:53:21.488 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:53:21.488 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:53:21.489 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 23, 2023-12-20T04:53:21.489 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:53:21.489 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:53:21.489 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:53:21.489 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:53:21.489 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:53:21.489 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:53:21.489 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.489 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:53:21.489 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:53:21.489 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:53:21.489 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:53:21.489 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:53:21.489 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:21.489 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:21.490 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:21.490 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:21.490 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:21.490 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:21.490 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:21.490 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:21.490 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:21.490 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:21.490 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:53:21.490 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:53:21.490 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:53:21.490 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:53:21.490 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:53:21.490 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:21.491 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:21.491 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:21.491 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:21.491 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:21.491 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:21.491 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:21.491 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.491 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:53:21.491 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:21.491 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:21.491 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:21.491 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:21.491 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:21.491 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:21.491 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:21.492 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:21.492 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:21.492 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:53:21.492 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:21.492 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:21.492 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:21.492 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:21.492 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:21.492 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:21.492 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:21.492 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:21.492 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:21.492 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:21.492 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:21.492 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:21.492 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:21.493 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:21.493 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:21.493 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:21.493 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.493 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:21.493 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:21.493 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:21.493 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:21.493 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:21.493 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:21.493 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:21.493 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:21.493 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:21.493 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:21.494 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:21.494 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:21.494 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:53:21.494 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:53:21.494 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.494 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:21.494 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:53:21.494 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.494 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:21.494 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:53:21.494 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:53:21.494 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:53:21.494 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:53:21.494 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:53:21.494 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:21.494 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:21.495 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:21.495 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.495 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.495 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.495 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 22, 2023-12-20T04:53:21.495 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:53:21.495 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:53:03.034230+0000", 2023-12-20T04:53:21.495 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:53:21.495 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:53:21.495 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:21.495 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:21.495 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:21.495 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:21.495 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:21.495 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:21.495 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:21.496 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:21.496 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:21.496 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:21.496 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:53:21.496 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:53:21.496 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:53:21.496 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:53:21.496 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:53:21.496 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:21.496 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:21.496 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:21.496 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:21.496 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:21.496 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:21.496 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:21.496 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.497 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "185", 2023-12-20T04:53:21.497 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:21.497 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:21.497 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:21.497 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:21.497 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:21.497 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:21.497 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:21.497 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:21.497 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:21.497 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:53:21.497 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:21.497 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:21.497 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:21.498 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:21.498 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:21.498 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:21.498 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:21.498 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:21.498 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:21.498 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:21.498 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:21.498 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:21.498 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:21.498 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:21.498 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:21.498 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:21.498 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.498 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:21.499 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:21.499 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:21.499 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:21.499 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:21.499 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:21.499 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:21.499 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:21.499 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:21.499 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:21.499 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:21.499 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:21.499 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:53:21.499 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:53:21.499 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:53:21.499 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.500 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:21.500 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:53:21.500 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:53:21.500 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.500 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.500 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:21.500 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 2, 2023-12-20T04:53:21.500 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 2, 2023-12-20T04:53:21.500 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:53:21.500 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:53:21.500 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:53:21.500 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:21.500 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:21.500 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:21.500 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.501 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.501 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.501 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 23, 2023-12-20T04:53:21.501 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:53:21.501 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:53:03.812892+0000", 2023-12-20T04:53:21.501 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1027, 2023-12-20T04:53:21.501 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-20T04:53:21.501 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:21.501 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:21.501 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:21.501 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:21.501 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:21.501 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:21.501 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:21.501 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:21.502 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:21.502 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:21.502 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:53:21.502 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:53:21.502 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:53:21.502 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:53:21.502 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:53:21.502 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:21.502 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:21.502 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:21.502 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:21.502 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:21.502 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:21.502 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:21.502 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.502 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "188", 2023-12-20T04:53:21.503 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:21.503 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:21.503 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:21.503 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:21.503 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:21.503 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:21.503 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:21.503 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:21.503 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:21.503 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 33554432, 2023-12-20T04:53:21.503 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:21.503 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:21.503 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:21.503 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:21.503 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:21.504 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:21.504 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:21.504 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:21.504 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:21.504 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:21.504 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:21.504 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:21.504 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:21.504 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:21.504 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:21.504 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:21.504 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.504 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:21.504 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:21.504 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:21.505 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:21.505 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:21.505 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:21.505 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:21.505 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:21.505 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:21.505 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:21.505 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:21.505 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:21.505 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:53:21.505 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:53:21.505 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.505 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:21.506 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:53:21.506 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:53:21.506 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.506 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.506 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:21.506 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.3799999952316284, 2023-12-20T04:53:21.506 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.3799999952316284, 2023-12-20T04:53:21.506 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:53:21.506 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-20T04:53:21.506 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-20T04:53:21.506 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:21.506 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:21.506 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:21.506 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.506 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.506 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:21.507 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:53:21.507 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.507 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:53:21.507 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:21.507 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:21.507 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:21.507 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:21.507 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:21.507 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:21.507 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:21.507 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:21.507 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:21.507 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:21.507 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:21.507 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:21.508 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.508 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.508 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.508 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:53:21.508 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:21.508 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.508 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.508 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.508 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:53:21.508 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:21.508 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.508 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.508 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.508 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:21.508 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.509 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.509 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.509 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:53:21.509 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:21.509 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.509 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.509 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.509 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:53:21.509 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:21.509 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.509 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.509 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.509 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:21.509 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.509 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.510 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.510 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:53:21.510 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:21.510 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.510 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.510 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.510 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:53:21.510 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:21.510 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.510 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.510 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.510 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:21.510 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.510 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.510 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.511 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:53:21.511 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:21.511 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.511 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.511 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.511 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:53:21.511 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:21.511 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.511 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.511 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.511 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:53:21.511 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:53:21.511 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:53:21.511 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:53:21.511 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:21.511 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:21.512 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:21.512 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.512 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.512 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.512 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:53:21.512 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:21.512 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:21.512 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:21.512 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:21.512 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:21.512 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:21.512 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:21.512 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:21.512 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:21.512 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:21.513 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:21.513 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:21.513 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.513 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.513 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.513 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:53:21.513 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:21.513 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.513 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.513 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.513 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:53:21.513 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:21.513 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.513 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.514 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.514 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:21.514 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.514 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.514 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.514 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:53:21.514 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:21.514 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.514 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.514 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.514 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:53:21.514 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:21.514 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.514 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.514 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.515 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:21.515 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.515 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.515 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.515 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:53:21.515 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:21.515 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.515 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.515 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.515 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:53:21.515 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:21.515 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.515 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.515 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.515 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:21.515 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.515 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.516 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.516 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:53:21.516 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:21.516 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.516 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.516 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.516 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:53:21.516 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:21.516 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.516 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.516 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.516 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:53:21.516 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:53:21.516 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:53:21.516 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:53:21.516 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:21.516 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:21.517 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:21.517 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.517 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.517 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.517 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:53:21.517 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:21.517 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:21.517 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:21.517 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:21.517 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:21.517 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:21.517 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:21.517 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:21.517 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:21.517 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:21.517 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:21.518 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:21.518 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.518 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.518 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.518 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:53:21.518 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:21.518 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.518 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.518 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.518 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:53:21.518 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:21.518 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.518 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.518 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.518 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:21.518 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.519 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.519 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.519 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:53:21.519 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:21.519 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.519 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.519 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.519 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:53:21.519 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:21.519 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.519 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.519 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.519 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:21.519 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.519 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.520 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.520 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:53:21.520 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:21.520 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.520 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.520 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.520 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:53:21.520 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:21.520 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.520 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.520 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.520 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:21.520 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.520 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.520 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.521 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:53:21.521 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:21.521 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.521 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.521 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.521 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:53:21.521 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:21.521 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.521 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.521 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.521 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:53:21.521 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:53:21.521 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:53:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:53:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:53:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:21.522 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:53:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:53:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:21.523 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:53:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:53:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.524 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.525 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.525 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:21.525 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.525 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.525 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.525 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:53:21.525 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:21.525 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.525 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.525 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.525 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:53:21.525 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:21.525 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.525 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.526 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.526 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:21.526 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.526 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.526 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.526 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:53:21.526 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:21.526 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.526 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.526 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.526 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:53:21.526 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:21.526 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.526 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.526 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.526 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:53:21.526 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:53:21.527 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:53:21.527 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:53:21.527 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:21.527 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:21.527 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:21.527 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.527 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.527 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.527 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:53:21.527 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:21.527 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:21.527 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:21.527 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:21.527 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:21.527 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:21.527 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:21.527 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:21.528 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:21.528 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:21.528 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:21.528 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:21.528 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.528 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.528 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.528 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:53:21.528 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:21.528 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.528 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.528 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.528 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:53:21.528 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:21.528 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.529 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.529 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.529 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:21.529 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.529 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.529 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.529 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:53:21.529 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:21.529 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.529 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.529 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.529 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:53:21.529 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:21.529 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.530 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.530 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.530 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:21.530 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.530 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.530 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.530 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:53:21.530 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:21.530 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.530 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.530 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.530 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:53:21.530 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:21.530 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.530 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.531 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.531 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:21.531 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.531 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.531 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.531 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:53:21.531 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:21.531 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.531 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.531 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.531 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:53:21.531 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:21.531 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.531 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.531 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.532 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:53:21.532 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:53:21.532 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:53:21.532 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:53:21.532 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:21.532 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:21.532 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:21.532 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.532 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.532 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.532 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:53:21.532 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:21.532 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:21.532 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:21.533 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:21.533 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:21.533 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:21.533 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:21.533 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:21.533 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:21.533 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:21.533 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:21.533 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:21.533 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.533 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.533 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.533 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:53:21.533 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:21.533 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.534 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.534 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.534 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:53:21.534 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:21.534 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.534 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.534 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.534 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:21.534 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.534 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.534 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.534 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:53:21.534 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:21.534 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.534 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.535 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.535 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:53:21.535 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:21.535 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.535 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.535 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.535 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:21.535 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.535 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.535 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.535 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:53:21.535 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:21.535 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.535 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.535 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.535 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:53:21.536 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:21.536 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.536 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.536 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:21.536 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.536 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.536 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.536 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:53:21.536 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:21.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.536 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.536 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.536 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:53:21.536 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:21.537 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.537 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.537 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:53:21.537 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:53:21.537 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:53:21.537 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:53:21.537 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:21.537 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:21.537 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:21.537 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.537 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.537 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:53:21.538 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:21.538 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:21.538 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:21.538 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:21.538 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:21.538 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:21.538 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:21.538 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:21.538 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:21.538 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:21.538 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:21.538 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:21.538 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.538 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.538 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.538 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:53:21.539 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:21.539 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.539 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.539 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.539 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:53:21.539 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:21.539 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.539 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.539 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.539 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:21.539 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.539 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.539 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.539 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:53:21.539 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:21.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.540 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.540 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.540 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:53:21.540 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:21.540 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.540 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.540 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:21.540 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.540 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.540 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.540 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:53:21.540 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:21.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.541 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.541 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:53:21.541 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:21.541 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.541 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.541 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:21.541 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.541 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.541 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:53:21.541 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:21.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.542 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.542 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:53:21.542 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:21.542 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.542 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.542 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.542 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:53:21.542 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:53:21.542 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:53:21.542 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:53:21.542 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:21.542 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:21.542 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:21.542 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.542 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.543 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.543 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:53:21.543 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:21.543 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:21.543 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:21.543 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:21.543 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:21.543 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:21.543 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:21.543 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:21.543 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:21.543 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:21.543 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:21.543 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:21.543 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:53:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:53:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.544 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:53:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:53:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.545 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:53:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:53:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:21.546 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:53:21.547 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:21.547 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.547 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.547 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:21.547 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:53:21.547 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:21.547 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.547 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.547 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.547 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:53:21.547 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:53:21.547 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:53:21.547 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:53:21.547 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:21.547 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:21.548 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:21.548 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:21.548 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.548 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:21.548 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:53:21.548 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.548 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:53:21.548 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:21.548 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:21.548 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:21.548 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:21.548 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:21.548 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:53:21.548 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:21.548 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.548 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.549 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:53:21.549 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:21.549 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:21.549 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:21.549 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:21.549 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:21.549 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:53:21.549 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:21.549 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.549 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.549 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:53:21.549 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:21.549 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:21.549 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:21.549 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:21.550 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:21.550 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:53:21.550 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:21.550 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.550 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.550 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:53:21.550 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:21.550 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:21.550 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:21.550 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:21.550 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:21.550 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:53:21.550 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:21.550 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.550 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.551 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:53:21.551 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:21.551 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:21.551 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:21.551 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:21.551 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:21.551 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:53:21.551 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:21.551 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.551 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.551 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:53:21.551 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:21.551 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:21.551 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:21.551 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:21.552 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:21.552 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:53:21.552 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:21.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.552 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:53:21.552 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:21.552 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:21.552 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:21.552 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:21.552 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:21.552 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:53:21.552 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:21.552 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.552 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:21.552 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:53:21.552 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:21.553 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:21.553 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:21.553 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:21.553 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:21.553 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:53:21.553 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:21.553 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.553 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:21.553 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:53:21.553 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:53:21.553 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:53:21.553 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:53:21.553 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:53:21.554 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:53:21.554 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:53:21.554 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:53:21.554 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:53:21.554 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:53:21.554 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:53:21.554 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:53:21.554 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:53:21.554 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:53:21.554 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.554 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:21.554 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:53:21.554 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:53:21.554 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:53:21.554 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:53:21.554 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:53:21.554 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:53:21.555 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:53:21.555 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:53:21.555 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:53:21.555 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:53:21.555 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:53:21.555 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:21.555 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:21.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.488+0000 7f62547d2640 1 -- 172.21.15.132:0/3555193103 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f623006a430 msgr2=0x7f623006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:21.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.488+0000 7f62547d2640 1 --2- 172.21.15.132:0/3555193103 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f623006a430 0x7f623006c8f0 secure :-1 s=READY pgs=773 cs=0 l=1 rev1=1 crypto rx=0x7f623c006b10 tx=0x7f623c008040 comp rx=0 tx=0).stop 2023-12-20T04:53:21.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.488+0000 7f62547d2640 1 -- 172.21.15.132:0/3555193103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b4ec0 msgr2=0x7f624c1f3b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:21.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.488+0000 7f62547d2640 1 --2- 172.21.15.132:0/3555193103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b4ec0 0x7f624c1f3b00 secure :-1 s=READY pgs=1845 cs=0 l=1 rev1=1 crypto rx=0x7f624400cf60 tx=0x7f624400cf90 comp rx=0 tx=0).stop 2023-12-20T04:53:21.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.488+0000 7f62547d2640 1 -- 172.21.15.132:0/3555193103 shutdown_connections 2023-12-20T04:53:21.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.488+0000 7f62547d2640 1 --2- 172.21.15.132:0/3555193103 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f623006a430 0x7f623006c8f0 unknown :-1 s=CLOSED pgs=773 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.488+0000 7f62547d2640 1 --2- 172.21.15.132:0/3555193103 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f624c1611b0 0x7f624c15bd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.488+0000 7f62547d2640 1 --2- 172.21.15.132:0/3555193103 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f624c160450 0x7f624c15ebc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.488+0000 7f62547d2640 1 --2- 172.21.15.132:0/3555193103 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f624c0b4ec0 0x7f624c1f3b00 unknown :-1 s=CLOSED pgs=1845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.488+0000 7f62547d2640 1 -- 172.21.15.132:0/3555193103 >> 172.21.15.132:0/3555193103 conn(0x7f624c0cf980 msgr2=0x7f624c160830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:21.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.488+0000 7f62547d2640 1 -- 172.21.15.132:0/3555193103 shutdown_connections 2023-12-20T04:53:21.557 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.488+0000 7f62547d2640 1 -- 172.21.15.132:0/3555193103 wait complete. 2023-12-20T04:53:21.558 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:53:21.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.657+0000 7f76b2d77640 1 Processor -- start 2023-12-20T04:53:21.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.657+0000 7f76b2d77640 1 -- start start 2023-12-20T04:53:21.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.658+0000 7f76b2d77640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76ac15e2d0 0x7f76ac0b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:21.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.658+0000 7f76b2d77640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ac0cd740 con 0x7f76ac0cf0b0 2023-12-20T04:53:21.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.658+0000 7f76b2d77640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76ac0ce230 con 0x7f76ac0cb420 2023-12-20T04:53:21.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.658+0000 7f76b2d77640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76ac0cd990 con 0x7f76ac15e2d0 2023-12-20T04:53:21.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.658+0000 7f76b0b13640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76ac15e2d0 0x7f76ac0b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:21.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.658+0000 7f76b1314640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f76ac0cf0b0 0x7f76ac0d07f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:40746/0 (socket says 172.21.15.132:40746) 2023-12-20T04:53:21.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.658+0000 7f76b1314640 1 -- 172.21.15.132:0/1478457208 learned_addr learned my addr 172.21.15.132:0/1478457208 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:21.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.658+0000 7f76b0b13640 1 -- 172.21.15.132:0/1478457208 >> v1:172.21.15.187:6789/0 conn(0x7f76ac0cb420 legacy=0x7f76ac0ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:21.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.658+0000 7f76b0b13640 1 -- 172.21.15.132:0/1478457208 >> v1:172.21.15.132:6789/0 conn(0x7f76ac0cf0b0 legacy=0x7f76ac0d07f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:21.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.658+0000 7f76b0b13640 1 -- 172.21.15.132:0/1478457208 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76ac0cdc70 con 0x7f76ac15e2d0 2023-12-20T04:53:21.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.658+0000 7f76a37fe640 1 -- 172.21.15.132:0/1478457208 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2243241773 0 0) 0x7f76ac0cd740 con 0x7f76ac0cf0b0 2023-12-20T04:53:21.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.659+0000 7f76b0b13640 1 --2- 172.21.15.132:0/1478457208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76ac15e2d0 0x7f76ac0b3330 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f76a80097a0 tx=0x7f76a802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ca889f72783341 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:21.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.659+0000 7f76a37fe640 1 -- 172.21.15.132:0/1478457208 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8031830 con 0x7f76ac15e2d0 2023-12-20T04:53:21.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.659+0000 7f76a37fe640 1 -- 172.21.15.132:0/1478457208 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a8031990 con 0x7f76ac15e2d0 2023-12-20T04:53:21.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.659+0000 7f76a37fe640 1 -- 172.21.15.132:0/1478457208 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8031d20 con 0x7f76ac15e2d0 2023-12-20T04:53:21.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.660+0000 7f76b2d77640 1 -- 172.21.15.132:0/1478457208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76ac15e2d0 msgr2=0x7f76ac0b3330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:21.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.660+0000 7f76b2d77640 1 --2- 172.21.15.132:0/1478457208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76ac15e2d0 0x7f76ac0b3330 secure :-1 s=READY pgs=1847 cs=0 l=1 rev1=1 crypto rx=0x7f76a80097a0 tx=0x7f76a802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.660+0000 7f76b2d77640 1 -- 172.21.15.132:0/1478457208 shutdown_connections 2023-12-20T04:53:21.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.660+0000 7f76b2d77640 1 --2- 172.21.15.132:0/1478457208 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76ac15e2d0 0x7f76ac0b3330 unknown :-1 s=CLOSED pgs=1847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.660+0000 7f76b2d77640 1 -- 172.21.15.132:0/1478457208 >> 172.21.15.132:0/1478457208 conn(0x7f76ac06d7c0 msgr2=0x7f76ac06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:21.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.660+0000 7f76b2d77640 1 -- 172.21.15.132:0/1478457208 shutdown_connections 2023-12-20T04:53:21.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.660+0000 7f76b2d77640 1 -- 172.21.15.132:0/1478457208 wait complete. 2023-12-20T04:53:21.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.661+0000 7f76b2d77640 1 Processor -- start 2023-12-20T04:53:21.662 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.661+0000 7f76b2d77640 1 -- start start 2023-12-20T04:53:21.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76b2d77640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76ac0cb420 0x7f76ac0a8960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:21.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76b2d77640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76ac0cf0b0 0x7f76ac14e690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:21.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76b2d77640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76ac15e2d0 0x7f76ac0ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:21.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76b2d77640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac14fb60 con 0x7f76ac0cb420 2023-12-20T04:53:21.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76b2d77640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac14eee0 con 0x7f76ac15e2d0 2023-12-20T04:53:21.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76b2d77640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f76ac14f1c0 con 0x7f76ac0cf0b0 2023-12-20T04:53:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76b0b13640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76ac0cb420 0x7f76ac0a8960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76b0b13640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76ac0cb420 0x7f76ac0a8960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58594/0 (socket says 172.21.15.132:58594) 2023-12-20T04:53:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76b0b13640 1 -- 172.21.15.132:0/1579674571 learned_addr learned my addr 172.21.15.132:0/1579674571 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76a3fff640 1 --2- 172.21.15.132:0/1579674571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76ac0cf0b0 0x7f76ac14e690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76b1314640 1 --2- 172.21.15.132:0/1579674571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76ac15e2d0 0x7f76ac0ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76b0b13640 1 -- 172.21.15.132:0/1579674571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76ac0cf0b0 msgr2=0x7f76ac14e690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76b0b13640 1 --2- 172.21.15.132:0/1579674571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76ac0cf0b0 0x7f76ac14e690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76b0b13640 1 -- 172.21.15.132:0/1579674571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76ac15e2d0 msgr2=0x7f76ac0ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76b0b13640 1 --2- 172.21.15.132:0/1579674571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76ac15e2d0 0x7f76ac0ca2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76b0b13640 1 -- 172.21.15.132:0/1579674571 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a8009400 con 0x7f76ac0cb420 2023-12-20T04:53:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76a3fff640 1 --2- 172.21.15.132:0/1579674571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76ac0cf0b0 0x7f76ac14e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76b1314640 1 --2- 172.21.15.132:0/1579674571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76ac15e2d0 0x7f76ac0ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.662+0000 7f76b0b13640 1 --2- 172.21.15.132:0/1579674571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76ac0cb420 0x7f76ac0a8960 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f76a80097a0 tx=0x7f76a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:21.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.663+0000 7f76a17fa640 1 -- 172.21.15.132:0/1579674571 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a8004030 con 0x7f76ac0cb420 2023-12-20T04:53:21.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.663+0000 7f76a17fa640 1 -- 172.21.15.132:0/1579674571 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f76a80041b0 con 0x7f76ac0cb420 2023-12-20T04:53:21.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.663+0000 7f76b2d77640 1 -- 172.21.15.132:0/1579674571 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76ac14f4a0 con 0x7f76ac0cb420 2023-12-20T04:53:21.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.663+0000 7f76a17fa640 1 -- 172.21.15.132:0/1579674571 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f76a803b7e0 con 0x7f76ac0cb420 2023-12-20T04:53:21.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.663+0000 7f76b2d77640 1 -- 172.21.15.132:0/1579674571 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76ac14ebd0 con 0x7f76ac0cb420 2023-12-20T04:53:21.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.664+0000 7f76b2d77640 1 -- 172.21.15.132:0/1579674571 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76ac14f300 con 0x7f76ac0cb420 2023-12-20T04:53:21.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.664+0000 7f76a17fa640 1 -- 172.21.15.132:0/1579674571 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f76a8043070 con 0x7f76ac0cb420 2023-12-20T04:53:21.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.664+0000 7f76a17fa640 1 --2- 172.21.15.132:0/1579674571 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f769806a430 0x7f769806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:21.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.664+0000 7f76a17fa640 1 -- 172.21.15.132:0/1579674571 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f76a80aa660 con 0x7f76ac0cb420 2023-12-20T04:53:21.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.664+0000 7f76a3fff640 1 --2- 172.21.15.132:0/1579674571 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f769806a430 0x7f769806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:21.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.665+0000 7f76a17fa640 1 -- 172.21.15.132:0/1579674571 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=189}) v3 -- 0x7f7698071f60 con 0x7f76ac0cb420 2023-12-20T04:53:21.667 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.665+0000 7f76a3fff640 1 --2- 172.21.15.132:0/1579674571 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f769806a430 0x7f769806c8f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0cded0 tx=0x7f769c009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:21.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.669+0000 7f76a17fa640 1 -- 172.21.15.132:0/1579674571 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f76a8035020 con 0x7f76ac0cb420 2023-12-20T04:53:21.870 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.869+0000 7f76b2d77640 1 -- 172.21.15.132:0/1579674571 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f76ac04e840 con 0x7f76ac0cb420 2023-12-20T04:53:21.871 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.870+0000 7f76a17fa640 1 -- 172.21.15.132:0/1579674571 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4722 (secure 0 0 0) 0x7f76ac14f300 con 0x7f76ac0cb420 2023-12-20T04:53:21.871 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:21.871 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":70,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3443409957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3443409957},{"type":"v1","addr":"172.21.15.187:6833","nonce":3443409957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/321445180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":321445180},{"type":"v1","addr":"172.21.15.187:6835","nonce":321445180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1166803529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1166803529},{"type":"v1","addr":"172.21.15.132:6836","nonce":1166803529}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:53:04.838088+0000","modified":"2023-12-20T04:53:07.506024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9117":{"gid":9117,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/2356846201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2356846201},{"type":"v1","addr":"172.21.15.132:6837","nonce":2356846201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-20T04:53:21.871 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 70 2023-12-20T04:53:21.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.872+0000 7f76b2d77640 1 -- 172.21.15.132:0/1579674571 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f769806a430 msgr2=0x7f769806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:21.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.872+0000 7f76b2d77640 1 --2- 172.21.15.132:0/1579674571 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f769806a430 0x7f769806c8f0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f76ac0cded0 tx=0x7f769c009040 comp rx=0 tx=0).stop 2023-12-20T04:53:21.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.872+0000 7f76b2d77640 1 -- 172.21.15.132:0/1579674571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76ac0cb420 msgr2=0x7f76ac0a8960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:21.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.872+0000 7f76b2d77640 1 --2- 172.21.15.132:0/1579674571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76ac0cb420 0x7f76ac0a8960 secure :-1 s=READY pgs=1848 cs=0 l=1 rev1=1 crypto rx=0x7f76a80097a0 tx=0x7f76a80046c0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.872+0000 7f76b2d77640 1 -- 172.21.15.132:0/1579674571 shutdown_connections 2023-12-20T04:53:21.873 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.872+0000 7f76b2d77640 1 --2- 172.21.15.132:0/1579674571 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f769806a430 0x7f769806c8f0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.872+0000 7f76b2d77640 1 --2- 172.21.15.132:0/1579674571 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f76ac15e2d0 0x7f76ac0ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.872+0000 7f76b2d77640 1 --2- 172.21.15.132:0/1579674571 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76ac0cf0b0 0x7f76ac14e690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.872+0000 7f76b2d77640 1 --2- 172.21.15.132:0/1579674571 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76ac0cb420 0x7f76ac0a8960 unknown :-1 s=CLOSED pgs=1848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:21.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.872+0000 7f76b2d77640 1 -- 172.21.15.132:0/1579674571 >> 172.21.15.132:0/1579674571 conn(0x7f76ac06d7c0 msgr2=0x7f76ac0b1240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:21.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.872+0000 7f76b2d77640 1 -- 172.21.15.132:0/1579674571 shutdown_connections 2023-12-20T04:53:21.874 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:21.872+0000 7f76b2d77640 1 -- 172.21.15.132:0/1579674571 wait complete. 2023-12-20T04:53:21.884 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-20T04:53:22.000 INFO:teuthology.orchestra.run.smithi132.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":9117,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":17.149866536000001,"mdsmap_epoch":70,"osdmap_epoch":188,"osdmap_epoch_barrier":186,"uptime":21.563963757} 2023-12-20T04:53:22.000 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 9117, "mdsmap_epoch": 70, "osdmap_epoch": 188, "osdmap_epoch_barrier": 186, "rank_uptime": 17.149866536, "state": "up:active", "uptime": 21.563963757, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:53:22.000 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-20T04:53:22.001 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:22.001 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_b) 2023-12-20T04:53:22.018 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:22.018 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec rm -f large_file_a) 2023-12-20T04:53:22.077 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:53:22.217 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.217+0000 7f5b2540b640 1 Processor -- start 2023-12-20T04:53:22.218 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.217+0000 7f5b2540b640 1 -- start start 2023-12-20T04:53:22.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.217+0000 7f5b2540b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5b20160450 0x7f5b20160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:22.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.217+0000 7f5b2540b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5b201611b0 0x7f5b200b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:22.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.217+0000 7f5b2540b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b200b5300 con 0x7f5b200b4ec0 2023-12-20T04:53:22.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.217+0000 7f5b2540b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b200b5ec0 con 0x7f5b20160450 2023-12-20T04:53:22.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.217+0000 7f5b2540b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5b201617e0 con 0x7f5b201611b0 2023-12-20T04:53:22.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.218+0000 7f5b1effd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5b20160450 0x7f5b20160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:22.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.218+0000 7f5b1effd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5b20160450 0x7f5b20160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58608/0 (socket says 172.21.15.132:58608) 2023-12-20T04:53:22.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.218+0000 7f5b1effd640 1 -- 172.21.15.132:0/2830892462 learned_addr learned my addr 172.21.15.132:0/2830892462 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:22.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.218+0000 7f5b1effd640 1 -- 172.21.15.132:0/2830892462 >> v2:172.21.15.187:3300/0 conn(0x7f5b201611b0 msgr2=0x7f5b200b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:22.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.218+0000 7f5b1effd640 1 --2- 172.21.15.132:0/2830892462 >> v2:172.21.15.187:3300/0 conn(0x7f5b201611b0 0x7f5b200b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:22.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.218+0000 7f5b1effd640 1 -- 172.21.15.132:0/2830892462 >> v1:172.21.15.187:6789/0 conn(0x7f5b200b4ec0 legacy=0x7f5b2006a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:22.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.218+0000 7f5b1effd640 1 -- 172.21.15.132:0/2830892462 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b200d0fc0 con 0x7f5b20160450 2023-12-20T04:53:22.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.219+0000 7f5b1effd640 1 --2- 172.21.15.132:0/2830892462 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b20160450 0x7f5b20160c70 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f5b2008b100 tx=0x7f5b1002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e351990476e7441c server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:22.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.219+0000 7f5b1dffb640 1 -- 172.21.15.132:0/2830892462 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10030860 con 0x7f5b20160450 2023-12-20T04:53:22.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.219+0000 7f5b1dffb640 1 -- 172.21.15.132:0/2830892462 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b100309c0 con 0x7f5b20160450 2023-12-20T04:53:22.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.219+0000 7f5b1dffb640 1 -- 172.21.15.132:0/2830892462 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b10030d50 con 0x7f5b20160450 2023-12-20T04:53:22.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.219+0000 7f5b2540b640 1 -- 172.21.15.132:0/2830892462 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b20160450 msgr2=0x7f5b20160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:22.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.219+0000 7f5b2540b640 1 --2- 172.21.15.132:0/2830892462 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b20160450 0x7f5b20160c70 secure :-1 s=READY pgs=1849 cs=0 l=1 rev1=1 crypto rx=0x7f5b2008b100 tx=0x7f5b1002b9a0 comp rx=0 tx=0).stop 2023-12-20T04:53:22.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.219+0000 7f5b2540b640 1 -- 172.21.15.132:0/2830892462 shutdown_connections 2023-12-20T04:53:22.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.219+0000 7f5b2540b640 1 --2- 172.21.15.132:0/2830892462 >> v2:172.21.15.187:3300/0 conn(0x7f5b201611b0 0x7f5b200b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:22.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.219+0000 7f5b2540b640 1 --2- 172.21.15.132:0/2830892462 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b20160450 0x7f5b20160c70 unknown :-1 s=CLOSED pgs=1849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:22.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.219+0000 7f5b2540b640 1 -- 172.21.15.132:0/2830892462 >> 172.21.15.132:0/2830892462 conn(0x7f5b200cf980 msgr2=0x7f5b200cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:22.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.219+0000 7f5b2540b640 1 -- 172.21.15.132:0/2830892462 shutdown_connections 2023-12-20T04:53:22.222 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.219+0000 7f5b2540b640 1 -- 172.21.15.132:0/2830892462 wait complete. 2023-12-20T04:53:22.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.220+0000 7f5b2540b640 1 Processor -- start 2023-12-20T04:53:22.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.220+0000 7f5b2540b640 1 -- start start 2023-12-20T04:53:22.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.221+0000 7f5b2540b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b200b4ec0 0x7f5b2015c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:22.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.221+0000 7f5b2540b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b20160450 0x7f5b2015e730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:22.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.221+0000 7f5b2540b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b201611b0 0x7f5b20159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:22.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.221+0000 7f5b2540b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2015c9f0 con 0x7f5b201611b0 2023-12-20T04:53:22.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.221+0000 7f5b2540b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2015ccd0 con 0x7f5b20160450 2023-12-20T04:53:22.224 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.221+0000 7f5b2540b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b2015cfb0 con 0x7f5b200b4ec0 2023-12-20T04:53:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.221+0000 7f5b1f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b201611b0 0x7f5b20159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.221+0000 7f5b1f7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b201611b0 0x7f5b20159c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:58618/0 (socket says 172.21.15.132:58618) 2023-12-20T04:53:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.221+0000 7f5b1f7fe640 1 -- 172.21.15.132:0/1153933834 learned_addr learned my addr 172.21.15.132:0/1153933834 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.221+0000 7f5b1e7fc640 1 --2- 172.21.15.132:0/1153933834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b20160450 0x7f5b2015e730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.221+0000 7f5b1effd640 1 --2- 172.21.15.132:0/1153933834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b200b4ec0 0x7f5b2015c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.222+0000 7f5b1f7fe640 1 -- 172.21.15.132:0/1153933834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b200b4ec0 msgr2=0x7f5b2015c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.222+0000 7f5b1f7fe640 1 --2- 172.21.15.132:0/1153933834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b200b4ec0 0x7f5b2015c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.222+0000 7f5b1f7fe640 1 -- 172.21.15.132:0/1153933834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b20160450 msgr2=0x7f5b2015e730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.222+0000 7f5b1f7fe640 1 --2- 172.21.15.132:0/1153933834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b20160450 0x7f5b2015e730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.222+0000 7f5b1f7fe640 1 -- 172.21.15.132:0/1153933834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b100094d0 con 0x7f5b201611b0 2023-12-20T04:53:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.222+0000 7f5b1f7fe640 1 --2- 172.21.15.132:0/1153933834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b201611b0 0x7f5b20159c50 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f5b1800c780 tx=0x7f5b1800cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.222+0000 7f5b077fe640 1 -- 172.21.15.132:0/1153933834 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b18003d80 con 0x7f5b201611b0 2023-12-20T04:53:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.222+0000 7f5b077fe640 1 -- 172.21.15.132:0/1153933834 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b1800ce90 con 0x7f5b201611b0 2023-12-20T04:53:22.225 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.222+0000 7f5b2540b640 1 -- 172.21.15.132:0/1153933834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b2015d290 con 0x7f5b201611b0 2023-12-20T04:53:22.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.222+0000 7f5b077fe640 1 -- 172.21.15.132:0/1153933834 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b180052b0 con 0x7f5b201611b0 2023-12-20T04:53:22.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.222+0000 7f5b2540b640 1 -- 172.21.15.132:0/1153933834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b2015c630 con 0x7f5b201611b0 2023-12-20T04:53:22.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.223+0000 7f5b2540b640 1 -- 172.21.15.132:0/1153933834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b2015d7b0 con 0x7f5b201611b0 2023-12-20T04:53:22.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.223+0000 7f5b077fe640 1 -- 172.21.15.132:0/1153933834 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5b18005410 con 0x7f5b201611b0 2023-12-20T04:53:22.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.224+0000 7f5b077fe640 1 --2- 172.21.15.132:0/1153933834 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5b0c06a430 0x7f5b0c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:22.226 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.224+0000 7f5b077fe640 1 -- 172.21.15.132:0/1153933834 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b180880a0 con 0x7f5b201611b0 2023-12-20T04:53:22.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.224+0000 7f5b1effd640 1 --2- 172.21.15.132:0/1153933834 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5b0c06a430 0x7f5b0c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:22.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.224+0000 7f5b077fe640 1 -- 172.21.15.132:0/1153933834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=189}) v3 -- 0x7f5b0c071f60 con 0x7f5b201611b0 2023-12-20T04:53:22.227 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.224+0000 7f5b1effd640 1 --2- 172.21.15.132:0/1153933834 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5b0c06a430 0x7f5b0c06c8f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5b10036000 tx=0x7f5b10008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:22.229 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.228+0000 7f5b077fe640 1 -- 172.21.15.132:0/1153933834 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5b18017020 con 0x7f5b201611b0 2023-12-20T04:53:22.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.395+0000 7f5b2540b640 1 -- 172.21.15.132:0/1153933834 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f5b2004e840 con 0x7f5b201611b0 2023-12-20T04:53:22.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.396+0000 7f5b077fe640 1 -- 172.21.15.132:0/1153933834 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v188) v1 ==== 81+0+33613 (secure 0 0 0) 0x7f5b2015d7b0 con 0x7f5b201611b0 2023-12-20T04:53:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:22.398 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 188, 2023-12-20T04:53:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:53:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:53:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:53:19.907593+0000", 2023-12-20T04:53:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:53:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:53:22.398 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:53:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:53:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:53:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:53:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:53:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:53:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:53:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:53:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:53:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:53:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:53:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:53:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 23, 2023-12-20T04:53:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:53:22.399 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:53:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:53:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:53:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:53:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:53:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:53:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:53:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:53:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:53:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:53:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:22.400 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:53:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:53:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:53:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:53:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:53:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:22.401 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:53:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:53:22.402 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:22.403 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:22.404 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:53:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:53:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:53:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:53:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:53:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:53:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:53:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:53:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:22.405 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 22, 2023-12-20T04:53:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:53:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:53:03.034230+0000", 2023-12-20T04:53:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:53:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:53:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:22.406 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:53:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:53:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:53:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:53:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:53:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.407 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "185", 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:22.408 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:22.409 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:53:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:53:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:53:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:53:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:53:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.410 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 2, 2023-12-20T04:53:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 2, 2023-12-20T04:53:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:53:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:53:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:53:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 23, 2023-12-20T04:53:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:53:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:53:03.812892+0000", 2023-12-20T04:53:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1027, 2023-12-20T04:53:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-20T04:53:22.411 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:53:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:53:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:53:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:53:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:53:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:22.412 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "188", 2023-12-20T04:53:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 33554432, 2023-12-20T04:53:22.413 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:22.414 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:22.415 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:53:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:53:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:53:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:53:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.3799999952316284, 2023-12-20T04:53:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.3799999952316284, 2023-12-20T04:53:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:53:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-20T04:53:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-20T04:53:22.416 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:53:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:53:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:22.417 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:53:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:53:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.418 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:53:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:53:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.419 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:53:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.420 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:53:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:53:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:53:22.421 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:53:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:53:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:53:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:53:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:53:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:22.422 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.423 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:53:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:53:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:53:22.424 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:53:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:53:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.425 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:53:22.426 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:53:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:53:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:53:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:22.427 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:53:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:53:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.428 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:53:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:53:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:22.429 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:53:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:53:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.430 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:53:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:53:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:53:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:53:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:53:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:53:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:22.431 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:53:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:22.432 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:53:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:53:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.433 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:53:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:53:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.434 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:53:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:53:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:53:22.435 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:53:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:53:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:53:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:53:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:53:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.436 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:53:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:22.437 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.438 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.438 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.438 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:53:22.438 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:22.438 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.438 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.438 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.438 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:53:22.438 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:22.438 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.438 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.438 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.438 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:22.438 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.438 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.438 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.439 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:53:22.439 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:22.439 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.439 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.439 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.439 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:53:22.439 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:22.439 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.439 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.439 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.439 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:22.439 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.439 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.439 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.440 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:53:22.440 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:22.440 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.440 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.440 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.440 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:53:22.440 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:22.440 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.440 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.440 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.440 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:22.440 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.440 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.440 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.440 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:53:22.440 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:22.441 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.441 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.441 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.441 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:53:22.441 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:22.441 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.441 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.441 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.441 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:53:22.441 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:53:22.441 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:53:22.441 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:53:22.441 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:22.441 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:22.441 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:22.441 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.442 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.442 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.442 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:53:22.442 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:22.442 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:22.442 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:22.442 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:22.442 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:22.442 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:22.442 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:22.442 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:22.442 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:22.442 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:22.442 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:22.442 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:22.442 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:53:22.443 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:22.444 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.444 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.444 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.444 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:53:22.444 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:22.444 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.444 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.444 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.444 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:22.444 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.444 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.444 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.444 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:53:22.444 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:22.444 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.444 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.444 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.445 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:53:22.445 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:22.445 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.445 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.445 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.445 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:22.445 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.445 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.445 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.445 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:53:22.445 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:22.446 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.446 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.446 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.446 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:53:22.446 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:22.446 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.446 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.446 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.446 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:53:22.446 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:53:22.446 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:53:22.446 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:53:22.446 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:22.446 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:22.446 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:22.447 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.447 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.447 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.447 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:53:22.447 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:22.447 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:22.447 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:22.447 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:22.447 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:22.447 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:22.447 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:22.447 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:22.447 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:22.447 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:22.447 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:22.448 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:22.448 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.448 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.448 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.448 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:53:22.448 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:22.448 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.448 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.448 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.448 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:53:22.448 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:22.448 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.448 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.448 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.448 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:22.449 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.449 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.449 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.449 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:53:22.449 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:22.449 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.449 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.449 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.449 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:53:22.449 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:22.449 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.449 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.449 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.449 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:22.450 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.450 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.450 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.450 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:53:22.450 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:22.450 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.450 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.450 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.450 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:53:22.450 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:22.450 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.450 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.450 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.451 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:22.451 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.451 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.451 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.451 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:53:22.451 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:22.451 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.451 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.451 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.451 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:53:22.451 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:22.451 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.451 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.451 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.451 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:53:22.452 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:53:22.452 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:53:22.452 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:53:22.452 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:22.452 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:22.452 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:22.452 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.452 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.452 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.452 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:53:22.452 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:22.452 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:22.452 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:22.452 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:22.452 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:22.453 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:22.453 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:22.453 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:22.453 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:22.453 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:22.453 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:22.453 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:22.453 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.453 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.453 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.453 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:53:22.453 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:22.453 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.453 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.454 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.454 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:53:22.454 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:22.454 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.454 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.454 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.454 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:22.454 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.454 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.454 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.454 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:53:22.454 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:22.454 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.454 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.454 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.454 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:53:22.455 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:22.455 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.455 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.455 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.455 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:22.455 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.455 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.455 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.455 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:53:22.455 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:22.455 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.455 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.455 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.455 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:53:22.455 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:22.456 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.456 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.456 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:22.456 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:22.456 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.456 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:22.456 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:53:22.456 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:22.456 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.456 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.456 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:22.456 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:53:22.457 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:22.457 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.457 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.457 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.457 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:53:22.457 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:53:22.457 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:53:22.457 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:53:22.457 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:22.457 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:22.457 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:22.457 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:22.457 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.457 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:22.458 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:53:22.458 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.458 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:53:22.458 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:22.458 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:22.458 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:22.458 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:22.458 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:22.458 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:53:22.458 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:22.458 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.458 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.458 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:53:22.458 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:22.459 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:22.459 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:22.459 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:22.459 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:22.459 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:53:22.459 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:22.459 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.459 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.459 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:53:22.459 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:22.459 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:22.459 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:22.459 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:22.459 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:22.459 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:53:22.460 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:22.460 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.460 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.460 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:53:22.460 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:22.460 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:22.460 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:22.460 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:22.460 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:22.460 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:53:22.460 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:22.460 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.460 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.460 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:53:22.461 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:22.461 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:22.461 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:22.461 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:22.461 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:22.461 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:53:22.461 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:22.461 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.461 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.461 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:53:22.461 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:22.461 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:22.461 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:22.461 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:22.462 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:22.462 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:53:22.462 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:22.462 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.462 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.462 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:53:22.462 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:22.462 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:22.462 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:22.462 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:22.462 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:22.462 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:53:22.462 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:22.462 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.462 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:22.463 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:53:22.463 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:22.463 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:22.463 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:22.463 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:22.463 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:22.463 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:53:22.463 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:22.463 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.463 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:22.463 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:53:22.463 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:53:22.463 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:53:22.463 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:53:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:53:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:53:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:53:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:53:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:53:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:53:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:53:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:53:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:53:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:53:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:53:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:53:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:53:22.464 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:53:22.465 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:53:22.465 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:53:22.465 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:53:22.465 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:53:22.465 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:53:22.465 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:53:22.465 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:53:22.465 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:22.465 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:22.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.398+0000 7f5b2540b640 1 -- 172.21.15.132:0/1153933834 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5b0c06a430 msgr2=0x7f5b0c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:22.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.398+0000 7f5b2540b640 1 --2- 172.21.15.132:0/1153933834 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5b0c06a430 0x7f5b0c06c8f0 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f5b10036000 tx=0x7f5b10008030 comp rx=0 tx=0).stop 2023-12-20T04:53:22.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.398+0000 7f5b2540b640 1 -- 172.21.15.132:0/1153933834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b201611b0 msgr2=0x7f5b20159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:22.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.398+0000 7f5b2540b640 1 --2- 172.21.15.132:0/1153933834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b201611b0 0x7f5b20159c50 secure :-1 s=READY pgs=1850 cs=0 l=1 rev1=1 crypto rx=0x7f5b1800c780 tx=0x7f5b1800cc40 comp rx=0 tx=0).stop 2023-12-20T04:53:22.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.398+0000 7f5b2540b640 1 -- 172.21.15.132:0/1153933834 shutdown_connections 2023-12-20T04:53:22.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.398+0000 7f5b2540b640 1 --2- 172.21.15.132:0/1153933834 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5b0c06a430 0x7f5b0c06c8f0 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:22.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.398+0000 7f5b2540b640 1 --2- 172.21.15.132:0/1153933834 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b201611b0 0x7f5b20159c50 unknown :-1 s=CLOSED pgs=1850 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:22.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.398+0000 7f5b2540b640 1 --2- 172.21.15.132:0/1153933834 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5b20160450 0x7f5b2015e730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:22.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.398+0000 7f5b2540b640 1 --2- 172.21.15.132:0/1153933834 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b200b4ec0 0x7f5b2015c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:22.467 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.398+0000 7f5b2540b640 1 -- 172.21.15.132:0/1153933834 >> 172.21.15.132:0/1153933834 conn(0x7f5b200cf980 msgr2=0x7f5b200d2660 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:22.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.399+0000 7f5b2540b640 1 -- 172.21.15.132:0/1153933834 shutdown_connections 2023-12-20T04:53:22.468 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:22.399+0000 7f5b2540b640 1 -- 172.21.15.132:0/1153933834 wait complete. 2023-12-20T04:53:22.468 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-20T04:53:27.469 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:53:27.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.579+0000 7f4e5b038640 1 Processor -- start 2023-12-20T04:53:27.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.579+0000 7f4e5b038640 1 -- start start 2023-12-20T04:53:27.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.579+0000 7f4e5b038640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f4e540b4de0 0x7f4e540d21b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:27.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.579+0000 7f4e5b038640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e540b5ec0 con 0x7f4e540b4980 2023-12-20T04:53:27.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.579+0000 7f4e5b038640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4e541617e0 con 0x7f4e54160450 2023-12-20T04:53:27.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.579+0000 7f4e5b038640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4e540d0fc0 con 0x7f4e540b4de0 2023-12-20T04:53:27.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e53fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f4e540b4980 0x7f4e540d1aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33828/0 (socket says 172.21.15.132:33828) 2023-12-20T04:53:27.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e53fff640 1 -- 172.21.15.132:0/1977332920 learned_addr learned my addr 172.21.15.132:0/1977332920 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:27.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e595d5640 1 --2- 172.21.15.132:0/1977332920 >> v2:172.21.15.187:3300/0 conn(0x7f4e540b4de0 0x7f4e540d21b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:27.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e537fe640 1 -- 172.21.15.132:0/1977332920 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1784742224 0 0) 0x7f4e540b5ec0 con 0x7f4e540b4980 2023-12-20T04:53:27.582 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e537fe640 1 -- 172.21.15.132:0/1977332920 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4e3c003520 con 0x7f4e540b4980 2023-12-20T04:53:27.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e537fe640 1 -- 172.21.15.132:0/1977332920 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 913623489 0 0) 0x7f4e3c003520 con 0x7f4e540b4980 2023-12-20T04:53:27.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e537fe640 1 -- 172.21.15.132:0/1977332920 >> v2:172.21.15.187:3300/0 conn(0x7f4e540b4de0 msgr2=0x7f4e540d21b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:27.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e537fe640 1 --2- 172.21.15.132:0/1977332920 >> v2:172.21.15.187:3300/0 conn(0x7f4e540b4de0 0x7f4e540d21b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:27.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e537fe640 1 -- 172.21.15.132:0/1977332920 >> v1:172.21.15.187:6789/0 conn(0x7f4e54160450 legacy=0x7f4e54160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:27.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e537fe640 1 -- 172.21.15.132:0/1977332920 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e540d12a0 con 0x7f4e540b4980 2023-12-20T04:53:27.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e537fe640 1 -- 172.21.15.132:0/1977332920 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f4e48001670 con 0x7f4e540b4980 2023-12-20T04:53:27.584 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e537fe640 1 -- 172.21.15.132:0/1977332920 >> v1:172.21.15.132:6789/0 conn(0x7f4e540b4980 legacy=0x7f4e540d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:27.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e537fe640 1 --2- 172.21.15.132:0/1977332920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e3c003970 0x7f4e3c003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:27.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e537fe640 1 --2- 172.21.15.132:0/1977332920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e3c0047c0 0x7f4e3c004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:27.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e537fe640 1 --2- 172.21.15.132:0/1977332920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e3c005180 0x7f4e3c00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:27.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e537fe640 1 -- 172.21.15.132:0/1977332920 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e540d0fc0 con 0x7f4e3c005180 2023-12-20T04:53:27.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e537fe640 1 -- 172.21.15.132:0/1977332920 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c00c030 con 0x7f4e3c0047c0 2023-12-20T04:53:27.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e537fe640 1 -- 172.21.15.132:0/1977332920 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3c00c1f0 con 0x7f4e3c003970 2023-12-20T04:53:27.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e595d5640 1 --2- 172.21.15.132:0/1977332920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e3c005180 0x7f4e3c00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:27.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e53fff640 1 --2- 172.21.15.132:0/1977332920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e3c0047c0 0x7f4e3c004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:27.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.580+0000 7f4e58dd4640 1 --2- 172.21.15.132:0/1977332920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e3c003970 0x7f4e3c003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:27.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.581+0000 7f4e595d5640 1 -- 172.21.15.132:0/1977332920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e3c003970 msgr2=0x7f4e3c003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:27.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.581+0000 7f4e595d5640 1 --2- 172.21.15.132:0/1977332920 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e3c003970 0x7f4e3c003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:27.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.581+0000 7f4e595d5640 1 -- 172.21.15.132:0/1977332920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e3c0047c0 msgr2=0x7f4e3c004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:27.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.581+0000 7f4e595d5640 1 --2- 172.21.15.132:0/1977332920 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e3c0047c0 0x7f4e3c004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:27.585 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.581+0000 7f4e595d5640 1 -- 172.21.15.132:0/1977332920 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e3c003520 con 0x7f4e3c005180 2023-12-20T04:53:27.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.581+0000 7f4e595d5640 1 -- 172.21.15.132:0/1977332920 reap_dead start 2023-12-20T04:53:27.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.581+0000 7f4e595d5640 1 --2- 172.21.15.132:0/1977332920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e3c005180 0x7f4e3c00b980 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c009fc0 tx=0x7f4e3c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=646501e4b52cac2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:27.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.581+0000 7f4e537fe640 1 -- 172.21.15.132:0/1977332920 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c003b90 con 0x7f4e3c005180 2023-12-20T04:53:27.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.581+0000 7f4e537fe640 1 -- 172.21.15.132:0/1977332920 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c00f040 con 0x7f4e3c005180 2023-12-20T04:53:27.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.581+0000 7f4e537fe640 1 -- 172.21.15.132:0/1977332920 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c004020 con 0x7f4e3c005180 2023-12-20T04:53:27.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.582+0000 7f4e5b038640 1 -- 172.21.15.132:0/1977332920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e3c005180 msgr2=0x7f4e3c00b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:27.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.582+0000 7f4e5b038640 1 --2- 172.21.15.132:0/1977332920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e3c005180 0x7f4e3c00b980 secure :-1 s=READY pgs=1852 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c009fc0 tx=0x7f4e3c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:27.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.582+0000 7f4e5b038640 1 -- 172.21.15.132:0/1977332920 shutdown_connections 2023-12-20T04:53:27.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.582+0000 7f4e5b038640 1 --2- 172.21.15.132:0/1977332920 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e3c005180 0x7f4e3c00b980 unknown :-1 s=CLOSED pgs=1852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:27.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.582+0000 7f4e5b038640 1 -- 172.21.15.132:0/1977332920 >> 172.21.15.132:0/1977332920 conn(0x7f4e540cf980 msgr2=0x7f4e540cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:27.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.582+0000 7f4e5b038640 1 -- 172.21.15.132:0/1977332920 shutdown_connections 2023-12-20T04:53:27.586 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.582+0000 7f4e5b038640 1 -- 172.21.15.132:0/1977332920 wait complete. 2023-12-20T04:53:27.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.583+0000 7f4e5b038640 1 Processor -- start 2023-12-20T04:53:27.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.583+0000 7f4e5b038640 1 -- start start 2023-12-20T04:53:27.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.584+0000 7f4e5b038640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e3c005180 0x7f4e540b7c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:27.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.584+0000 7f4e5b038640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e540b8170 0x7f4e54156080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:27.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.584+0000 7f4e5b038640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e541565c0 0x7f4e540cbdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:27.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.584+0000 7f4e5b038640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e54156a70 con 0x7f4e541565c0 2023-12-20T04:53:27.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.584+0000 7f4e5b038640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e541f1990 con 0x7f4e540b8170 2023-12-20T04:53:27.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.584+0000 7f4e5b038640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4e541f1c70 con 0x7f4e3c005180 2023-12-20T04:53:27.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.584+0000 7f4e595d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e541565c0 0x7f4e540cbdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:27.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.584+0000 7f4e595d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e541565c0 0x7f4e540cbdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40918/0 (socket says 172.21.15.132:40918) 2023-12-20T04:53:27.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.584+0000 7f4e595d5640 1 -- 172.21.15.132:0/1748499676 learned_addr learned my addr 172.21.15.132:0/1748499676 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:27.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.584+0000 7f4e53fff640 1 --2- 172.21.15.132:0/1748499676 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e540b8170 0x7f4e54156080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:27.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.585+0000 7f4e58dd4640 1 --2- 172.21.15.132:0/1748499676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e3c005180 0x7f4e540b7c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:27.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.585+0000 7f4e595d5640 1 -- 172.21.15.132:0/1748499676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e3c005180 msgr2=0x7f4e540b7c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:27.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.585+0000 7f4e595d5640 1 --2- 172.21.15.132:0/1748499676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e3c005180 0x7f4e540b7c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:27.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.585+0000 7f4e595d5640 1 -- 172.21.15.132:0/1748499676 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e540b8170 msgr2=0x7f4e54156080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:27.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.585+0000 7f4e595d5640 1 --2- 172.21.15.132:0/1748499676 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e540b8170 0x7f4e54156080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:27.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.585+0000 7f4e595d5640 1 -- 172.21.15.132:0/1748499676 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e541f1f50 con 0x7f4e541565c0 2023-12-20T04:53:27.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.585+0000 7f4e595d5640 1 --2- 172.21.15.132:0/1748499676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e541565c0 0x7f4e540cbdb0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c034ea0 tx=0x7f4e4c009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:27.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.585+0000 7f4e517fa640 1 -- 172.21.15.132:0/1748499676 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c03be40 con 0x7f4e541565c0 2023-12-20T04:53:27.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.585+0000 7f4e517fa640 1 -- 172.21.15.132:0/1748499676 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4e4c046470 con 0x7f4e541565c0 2023-12-20T04:53:27.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.585+0000 7f4e5b038640 1 -- 172.21.15.132:0/1748499676 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e541f2230 con 0x7f4e541565c0 2023-12-20T04:53:27.590 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.585+0000 7f4e517fa640 1 -- 172.21.15.132:0/1748499676 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4e4c0468a0 con 0x7f4e541565c0 2023-12-20T04:53:27.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.585+0000 7f4e5b038640 1 -- 172.21.15.132:0/1748499676 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e540cc2f0 con 0x7f4e541565c0 2023-12-20T04:53:27.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.586+0000 7f4e5b038640 1 -- 172.21.15.132:0/1748499676 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e54156a70 con 0x7f4e541565c0 2023-12-20T04:53:27.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.586+0000 7f4e517fa640 1 -- 172.21.15.132:0/1748499676 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4e4c046a00 con 0x7f4e541565c0 2023-12-20T04:53:27.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.587+0000 7f4e517fa640 1 --2- 172.21.15.132:0/1748499676 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e4006a430 0x7f4e4006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:27.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.587+0000 7f4e517fa640 1 -- 172.21.15.132:0/1748499676 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(188..188 src has 1..188) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4e4c0b3830 con 0x7f4e541565c0 2023-12-20T04:53:27.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.587+0000 7f4e58dd4640 1 --2- 172.21.15.132:0/1748499676 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e4006a430 0x7f4e4006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:27.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.587+0000 7f4e517fa640 1 -- 172.21.15.132:0/1748499676 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=189}) v3 -- 0x7f4e40071f60 con 0x7f4e541565c0 2023-12-20T04:53:27.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.587+0000 7f4e58dd4640 1 --2- 172.21.15.132:0/1748499676 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e4006a430 0x7f4e4006c8f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4e44000c00 tx=0x7f4e44009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:27.593 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.591+0000 7f4e517fa640 1 -- 172.21.15.132:0/1748499676 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4e4c04a060 con 0x7f4e541565c0 2023-12-20T04:53:27.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.756+0000 7f4e5b038640 1 -- 172.21.15.132:0/1748499676 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4e541f2750 con 0x7f4e541565c0 2023-12-20T04:53:27.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.757+0000 7f4e517fa640 1 -- 172.21.15.132:0/1748499676 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v188) v1 ==== 81+0+33613 (secure 0 0 0) 0x7f4e541f2750 con 0x7f4e541565c0 2023-12-20T04:53:27.760 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:27.760 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:27.760 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 188, 2023-12-20T04:53:27.760 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:53:27.760 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:53:27.760 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:53:19.907593+0000", 2023-12-20T04:53:27.760 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:53:27.760 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:53:27.760 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:53:27.760 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:53:27.760 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:53:27.760 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:53:27.760 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:53:27.761 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:53:27.761 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:53:27.761 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:27.761 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:53:27.761 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:53:27.761 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:53:27.761 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:53:27.761 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:53:27.761 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 23, 2023-12-20T04:53:27.761 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:53:27.761 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:53:27.761 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:53:27.761 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:53:27.761 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:53:27.762 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:53:27.762 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.762 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:53:27.762 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:53:27.762 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:53:27.762 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:53:27.762 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:53:27.762 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:27.762 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:27.762 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:27.762 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:27.762 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:27.762 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:27.762 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:27.762 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:27.763 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:27.763 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:27.763 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:53:27.763 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:53:27.763 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:53:27.763 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:53:27.763 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:53:27.763 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:27.763 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:27.763 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:27.763 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:27.763 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:27.763 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:27.763 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:27.764 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.764 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:53:27.764 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:27.764 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:27.764 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:27.764 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:27.764 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:27.764 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:27.764 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:27.764 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:27.764 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:27.764 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:53:27.764 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:27.764 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:27.764 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:27.764 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:27.765 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:27.765 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:27.765 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:27.765 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:27.765 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:27.765 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:27.765 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:27.765 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:27.765 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:27.765 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:27.765 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:27.765 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:27.766 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.766 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:27.766 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:27.766 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:27.766 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:27.766 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:27.766 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:27.766 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:27.766 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:27.766 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:27.766 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:27.766 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:27.766 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:27.766 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:53:27.766 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:53:27.766 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.767 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:27.767 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:53:27.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.767 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:27.767 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:53:27.767 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:53:27.767 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:53:27.767 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:53:27.767 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:53:27.767 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:27.767 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:27.767 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:27.767 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.767 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.767 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 22, 2023-12-20T04:53:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:53:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:53:03.034230+0000", 2023-12-20T04:53:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:53:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:53:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:27.768 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:53:27.769 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:53:27.769 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:53:27.769 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:53:27.769 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:53:27.769 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:27.769 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:27.769 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:27.769 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:27.769 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:27.769 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:27.769 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:27.769 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.769 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "185", 2023-12-20T04:53:27.769 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:27.770 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:27.770 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:27.770 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:27.770 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:27.770 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:27.770 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:27.770 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:27.770 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:27.770 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:53:27.770 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:27.770 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:27.770 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:27.770 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:27.770 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:27.770 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:27.771 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:27.771 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:27.771 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:27.771 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:27.771 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:27.771 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:27.771 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:27.771 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:27.771 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:27.771 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:27.771 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.771 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:27.771 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:27.771 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:27.771 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:27.771 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:27.772 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:27.772 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:27.772 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:27.772 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:27.772 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:27.772 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:27.772 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:27.772 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:53:27.772 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:53:27.772 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:53:27.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.772 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:27.772 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:53:27.772 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:53:27.772 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.772 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.773 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:27.773 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 2, 2023-12-20T04:53:27.773 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 2, 2023-12-20T04:53:27.773 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:53:27.773 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:53:27.773 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:53:27.773 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:27.773 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:27.773 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:27.773 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.773 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.773 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.773 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 23, 2023-12-20T04:53:27.773 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:53:27.774 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:53:03.812892+0000", 2023-12-20T04:53:27.774 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1027, 2023-12-20T04:53:27.774 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool,full,full_quota", 2023-12-20T04:53:27.774 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:27.774 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:27.774 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:27.774 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:27.774 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:27.774 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:27.774 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:27.774 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:27.774 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:27.774 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:27.774 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:53:27.774 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:53:27.774 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:53:27.775 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:53:27.775 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:53:27.775 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:27.775 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:27.775 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:27.775 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:27.775 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:27.775 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:27.775 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:27.775 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.775 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "188", 2023-12-20T04:53:27.775 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:27.775 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:27.775 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:27.775 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:27.775 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:27.776 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:27.776 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:27.776 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:27.776 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:27.776 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 33554432, 2023-12-20T04:53:27.776 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:27.776 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:27.776 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:27.776 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:27.776 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:27.776 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:27.776 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:27.776 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:27.776 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:27.776 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:27.776 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:27.777 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:27.777 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:27.777 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:27.777 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:27.777 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:27.777 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.777 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:27.777 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:27.777 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:27.777 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:27.777 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:27.777 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:27.777 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:27.777 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:27.778 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:27.778 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:27.778 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:27.778 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:27.778 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:53:27.778 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:53:27.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.778 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:27.778 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:53:27.778 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:53:27.778 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.778 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.778 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:27.778 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.3799999952316284, 2023-12-20T04:53:27.778 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.3799999952316284, 2023-12-20T04:53:27.778 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:53:27.779 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-20T04:53:27.779 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-20T04:53:27.779 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:27.779 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:27.779 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:27.779 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.779 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.779 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:27.779 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:53:27.779 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.779 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:53:27.779 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:27.779 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:27.779 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:27.780 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:27.780 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:27.780 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:27.780 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:27.780 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:27.780 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:27.780 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:27.780 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:27.780 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:27.780 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.780 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.780 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.780 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:53:27.780 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:27.780 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.781 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.781 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:53:27.781 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:27.781 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.781 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.781 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:27.781 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.781 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.781 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.781 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:53:27.781 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:27.781 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.782 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.782 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:53:27.782 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:27.782 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.782 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.782 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:27.782 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.782 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.782 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:53:27.782 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:27.782 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.782 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.782 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.783 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:53:27.783 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:27.783 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.783 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.783 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:27.783 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.783 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.783 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:53:27.783 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:27.783 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.783 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.783 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.783 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:53:27.783 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:27.784 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.784 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.784 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:53:27.784 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:53:27.784 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:53:27.784 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:53:27.784 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:27.784 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:27.784 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:27.784 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.784 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.784 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.784 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:53:27.784 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:27.784 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:27.785 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:27.785 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:27.785 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:27.785 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:27.785 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:27.785 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:27.785 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:27.785 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:27.785 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:27.785 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:27.785 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.785 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.785 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.785 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:53:27.786 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:27.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.786 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.786 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:53:27.786 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:27.786 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.786 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.786 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.786 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:27.786 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.786 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.786 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.786 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:53:27.787 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:27.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.787 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.787 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:53:27.787 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:27.787 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.787 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.787 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:27.787 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.787 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.787 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:53:27.787 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:27.787 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.787 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.788 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.788 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:53:27.788 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:27.788 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.788 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.788 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:27.788 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.788 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.788 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:53:27.788 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:27.788 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.788 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.788 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.789 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:53:27.789 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:27.789 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.789 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.789 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:53:27.789 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:53:27.789 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:53:27.789 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:53:27.789 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:27.789 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:27.789 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:27.789 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.789 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.789 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.790 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:53:27.790 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:27.790 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:27.790 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:27.790 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:27.790 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:27.790 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:27.790 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:27.790 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:27.790 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:27.790 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:27.790 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:27.790 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:27.790 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.791 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.791 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:53:27.791 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:27.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.791 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.791 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:53:27.791 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:27.791 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.791 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.791 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.791 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:27.791 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.791 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.791 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.792 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:53:27.792 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:27.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.792 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.792 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:53:27.792 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:27.792 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.792 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.792 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.792 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:27.792 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.792 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.792 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.792 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:53:27.793 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:27.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.793 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.793 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:53:27.793 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:27.793 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.793 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.793 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.793 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:27.793 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.793 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.793 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.793 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:53:27.793 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:27.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.794 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.794 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.794 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:53:27.794 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:27.794 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.794 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.794 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.794 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:53:27.794 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:53:27.794 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:53:27.794 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:53:27.794 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:27.794 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:27.794 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:27.795 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.795 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.795 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.795 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:53:27.795 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:27.795 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:27.795 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:27.795 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:27.795 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:27.795 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:27.795 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:27.795 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:27.795 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:27.795 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:27.795 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:27.795 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:27.796 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.796 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.796 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:53:27.796 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:27.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.796 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.796 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:53:27.796 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:27.796 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.796 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.796 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.796 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:27.796 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.796 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.797 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.797 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:53:27.797 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:27.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.797 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.797 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.797 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:53:27.797 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:27.797 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.797 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.797 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.797 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:27.797 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.798 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.798 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:53:27.798 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:27.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.798 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.798 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:53:27.798 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:27.798 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.798 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.798 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.798 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:27.798 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.798 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.798 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.799 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:53:27.799 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:27.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.799 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.799 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.799 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:53:27.799 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:27.799 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.799 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.799 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.799 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:53:27.799 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:53:27.799 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:53:27.799 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:53:27.800 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:27.800 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:27.800 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:27.800 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.800 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.800 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.800 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:53:27.800 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:27.800 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:27.800 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:27.800 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:27.800 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:27.800 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:27.800 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:27.801 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:27.801 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:27.801 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:27.801 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:27.801 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:27.801 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.801 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.801 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.801 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:53:27.801 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:27.801 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.802 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.802 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:53:27.802 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:27.802 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.802 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.802 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:27.802 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.802 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.802 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:53:27.802 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:27.802 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.802 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.803 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.803 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:53:27.803 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:27.803 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.803 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.803 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.803 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:27.803 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.803 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.803 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.803 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:53:27.803 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:27.803 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.803 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.803 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.804 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:53:27.804 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:27.804 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.804 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.804 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:27.804 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.804 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.804 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.804 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:53:27.804 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:27.804 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.804 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.804 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.804 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:53:27.804 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:27.804 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.805 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.805 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:53:27.805 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:53:27.805 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:53:27.805 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:53:27.805 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:27.805 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:27.805 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:27.805 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.805 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.805 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.805 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:53:27.805 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:27.806 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:27.806 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:27.806 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:27.806 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:27.806 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:27.806 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:27.806 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:27.806 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:27.806 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:27.806 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:27.806 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:27.806 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.806 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.806 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.806 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:53:27.806 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:27.806 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:53:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:53:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.807 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.808 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:53:27.808 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:27.808 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.808 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.808 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:27.808 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.808 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.808 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.808 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:53:27.808 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:27.808 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.808 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.808 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.808 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:53:27.808 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:27.809 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.809 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.809 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.809 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:27.809 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.809 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.809 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.809 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:53:27.809 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:27.809 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.809 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.809 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.809 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:53:27.810 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:27.810 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.810 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.810 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.810 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:53:27.810 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:53:27.810 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:53:27.810 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:53:27.810 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:27.810 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:27.810 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:27.810 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.810 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.810 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.810 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:53:27.811 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:27.811 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:27.811 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:27.811 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:27.811 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:27.811 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:27.811 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:27.811 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:27.811 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:27.811 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:27.811 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:27.811 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:27.811 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.811 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.811 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.812 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:53:27.812 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:27.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.812 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.812 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:53:27.812 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:27.812 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.812 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.812 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:27.812 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.812 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.812 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.812 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:53:27.812 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:27.812 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.813 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.813 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.813 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:53:27.813 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:27.813 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.813 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.813 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:27.813 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.813 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.813 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.813 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:53:27.813 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:27.813 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.814 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.814 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.814 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:53:27.814 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:27.814 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.814 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.814 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.814 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:27.814 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.814 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.814 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.814 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:53:27.814 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:27.814 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.814 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.814 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.815 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:53:27.815 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:27.815 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.815 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.815 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:53:27.815 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:53:27.815 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:53:27.815 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:53:27.815 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:27.815 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:27.815 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:27.815 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.815 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.815 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.815 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:53:27.815 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:27.816 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:27.816 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:27.816 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:27.816 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:27.816 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:27.816 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:27.816 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:27.816 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:27.816 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:27.816 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:27.816 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:27.816 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.816 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.816 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.816 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:53:27.816 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:27.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.817 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.817 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:53:27.817 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:27.817 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.817 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.817 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:27.817 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.817 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.817 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.817 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:53:27.817 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:27.817 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.818 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.818 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.818 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:53:27.818 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:27.818 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.818 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.818 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:27.818 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.818 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.818 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.818 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:53:27.818 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:27.818 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.818 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.818 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.819 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:53:27.819 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:27.819 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.819 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.819 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.819 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:27.819 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:27.819 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.819 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:27.819 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:53:27.819 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:27.819 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.819 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.819 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:27.819 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:53:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:53:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:53:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:53:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:53:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:27.820 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:53:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:53:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:53:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:53:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:27.821 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:53:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:53:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:53:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.822 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:53:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:53:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:53:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:27.823 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:53:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:53:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:53:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:53:27.824 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:53:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:53:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:27.825 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:53:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:53:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:53:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:53:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:53:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:53:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:53:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:53:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:53:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:53:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:53:27.826 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:53:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:53:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:53:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:53:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:53:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:53:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:53:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:53:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:53:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:53:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:53:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:53:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:53:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:53:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:53:27.827 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:27.828 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:27.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.759+0000 7f4e5b038640 1 -- 172.21.15.132:0/1748499676 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e4006a430 msgr2=0x7f4e4006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:27.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.759+0000 7f4e5b038640 1 --2- 172.21.15.132:0/1748499676 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e4006a430 0x7f4e4006c8f0 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4e44000c00 tx=0x7f4e44009040 comp rx=0 tx=0).stop 2023-12-20T04:53:27.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.759+0000 7f4e5b038640 1 -- 172.21.15.132:0/1748499676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e541565c0 msgr2=0x7f4e540cbdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:27.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.759+0000 7f4e5b038640 1 --2- 172.21.15.132:0/1748499676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e541565c0 0x7f4e540cbdb0 secure :-1 s=READY pgs=1853 cs=0 l=1 rev1=1 crypto rx=0x7f4e4c034ea0 tx=0x7f4e4c009750 comp rx=0 tx=0).stop 2023-12-20T04:53:27.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.759+0000 7f4e5b038640 1 -- 172.21.15.132:0/1748499676 shutdown_connections 2023-12-20T04:53:27.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.759+0000 7f4e5b038640 1 --2- 172.21.15.132:0/1748499676 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4e4006a430 0x7f4e4006c8f0 unknown :-1 s=CLOSED pgs=776 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:27.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.759+0000 7f4e5b038640 1 --2- 172.21.15.132:0/1748499676 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4e541565c0 0x7f4e540cbdb0 unknown :-1 s=CLOSED pgs=1853 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:27.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.759+0000 7f4e5b038640 1 --2- 172.21.15.132:0/1748499676 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4e540b8170 0x7f4e54156080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:27.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.759+0000 7f4e5b038640 1 --2- 172.21.15.132:0/1748499676 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4e3c005180 0x7f4e540b7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:27.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.759+0000 7f4e5b038640 1 -- 172.21.15.132:0/1748499676 >> 172.21.15.132:0/1748499676 conn(0x7f4e540cf980 msgr2=0x7f4e540d29c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:27.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.759+0000 7f4e5b038640 1 -- 172.21.15.132:0/1748499676 shutdown_connections 2023-12-20T04:53:27.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:27.759+0000 7f4e5b038640 1 -- 172.21.15.132:0/1748499676 wait complete. 2023-12-20T04:53:27.830 DEBUG:tasks.ceph_test_case:wait_until_true: waiting (timeout=600 retry_count=0)... 2023-12-20T04:53:32.832 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:53:32.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.942+0000 7f400ecaf640 1 Processor -- start 2023-12-20T04:53:32.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.942+0000 7f400ecaf640 1 -- start start 2023-12-20T04:53:32.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.943+0000 7f400ecaf640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f400815e530 0x7f400806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:32.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.943+0000 7f400ecaf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f400806c240 0x7f400806c6d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:32.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.943+0000 7f400ecaf640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f40080ccf30 con 0x7f4008159b50 2023-12-20T04:53:32.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.943+0000 7f400ecaf640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f400806cc10 con 0x7f400815e530 2023-12-20T04:53:32.945 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.943+0000 7f400ecaf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f40080caa60 con 0x7f400806c240 2023-12-20T04:53:32.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.943+0000 7f4007fff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f400815e530 0x7f400806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:32.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.943+0000 7f400d24c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f400806c240 0x7f400806c6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:32.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.944+0000 7f400d24c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f400806c240 0x7f400806c6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:34346/0 (socket says 172.21.15.132:34346) 2023-12-20T04:53:32.946 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.944+0000 7f400ca4b640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f4008159b50 0x7f40080c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:42056/0 (socket says 172.21.15.132:42056) 2023-12-20T04:53:32.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.944+0000 7f4007fff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f400815e530 0x7f400806fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:38626/0 (socket says 172.21.15.132:38626) 2023-12-20T04:53:32.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.944+0000 7f400d24c640 1 -- 172.21.15.132:0/3644857934 learned_addr learned my addr 172.21.15.132:0/3644857934 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:32.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.944+0000 7f400d24c640 1 -- 172.21.15.132:0/3644857934 >> v2:172.21.15.187:3300/0 conn(0x7f400815e530 msgr2=0x7f400806fd70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:32.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.944+0000 7f400d24c640 1 --2- 172.21.15.132:0/3644857934 >> v2:172.21.15.187:3300/0 conn(0x7f400815e530 0x7f400806fd70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:32.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.944+0000 7f400d24c640 1 -- 172.21.15.132:0/3644857934 >> v1:172.21.15.187:6789/0 conn(0x7f4008159b50 legacy=0x7f40080c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:32.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.944+0000 7f400d24c640 1 -- 172.21.15.132:0/3644857934 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f40080ca1c0 con 0x7f400806c240 2023-12-20T04:53:32.947 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.944+0000 7f4007fff640 1 --2- 172.21.15.132:0/3644857934 >> v2:172.21.15.187:3300/0 conn(0x7f400815e530 0x7f400806fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:53:32.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.945+0000 7f400d24c640 1 --2- 172.21.15.132:0/3644857934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f400806c240 0x7f400806c6d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f400000d150 tx=0x7f400002e160 comp rx=0 tx=0).ready entity=mon.2 client_cookie=317ab2f3170ac94b server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.945+0000 7f40077fe640 1 -- 172.21.15.132:0/3644857934 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f400000b0d0 con 0x7f400806c240 2023-12-20T04:53:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.945+0000 7f40077fe640 1 -- 172.21.15.132:0/3644857934 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f400000b230 con 0x7f400806c240 2023-12-20T04:53:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.945+0000 7f40077fe640 1 -- 172.21.15.132:0/3644857934 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4000009600 con 0x7f400806c240 2023-12-20T04:53:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.945+0000 7f400ecaf640 1 -- 172.21.15.132:0/3644857934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f400806c240 msgr2=0x7f400806c6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.945+0000 7f400ecaf640 1 --2- 172.21.15.132:0/3644857934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f400806c240 0x7f400806c6d0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f400000d150 tx=0x7f400002e160 comp rx=0 tx=0).stop 2023-12-20T04:53:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.946+0000 7f400ecaf640 1 -- 172.21.15.132:0/3644857934 shutdown_connections 2023-12-20T04:53:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.946+0000 7f400ecaf640 1 --2- 172.21.15.132:0/3644857934 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f400806c240 0x7f400806c6d0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.946+0000 7f400ecaf640 1 --2- 172.21.15.132:0/3644857934 >> v2:172.21.15.187:3300/0 conn(0x7f400815e530 0x7f400806fd70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.946+0000 7f400ecaf640 1 -- 172.21.15.132:0/3644857934 >> 172.21.15.132:0/3644857934 conn(0x7f40080ced10 msgr2=0x7f40080cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.946+0000 7f400ecaf640 1 -- 172.21.15.132:0/3644857934 shutdown_connections 2023-12-20T04:53:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.946+0000 7f400ecaf640 1 -- 172.21.15.132:0/3644857934 wait complete. 2023-12-20T04:53:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.947+0000 7f400ecaf640 1 Processor -- start 2023-12-20T04:53:32.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.947+0000 7f400ecaf640 1 -- start start 2023-12-20T04:53:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f400ecaf640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f400806c240 0x7f4008158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f400ecaf640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4008159b50 0x7f40080c9610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f400ecaf640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f400815e530 0x7f4008153d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f400ecaf640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4008152490 con 0x7f400806c240 2023-12-20T04:53:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f400ecaf640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4008152d30 con 0x7f400815e530 2023-12-20T04:53:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f400ecaf640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4008158bf0 con 0x7f4008159b50 2023-12-20T04:53:32.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f400ca4b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f400806c240 0x7f4008158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f400ca4b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f400806c240 0x7f4008158610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40924/0 (socket says 172.21.15.132:40924) 2023-12-20T04:53:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f400ca4b640 1 -- 172.21.15.132:0/3190104145 learned_addr learned my addr 172.21.15.132:0/3190104145 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f4007fff640 1 --2- 172.21.15.132:0/3190104145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4008159b50 0x7f40080c9610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f400d24c640 1 --2- 172.21.15.132:0/3190104145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f400815e530 0x7f4008153d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f400ca4b640 1 -- 172.21.15.132:0/3190104145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4008159b50 msgr2=0x7f40080c9610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f400ca4b640 1 --2- 172.21.15.132:0/3190104145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4008159b50 0x7f40080c9610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f400ca4b640 1 -- 172.21.15.132:0/3190104145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f400815e530 msgr2=0x7f4008153d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f400ca4b640 1 --2- 172.21.15.132:0/3190104145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f400815e530 0x7f4008153d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f400ca4b640 1 -- 172.21.15.132:0/3190104145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ffc009400 con 0x7f400806c240 2023-12-20T04:53:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f400ca4b640 1 --2- 172.21.15.132:0/3190104145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f400806c240 0x7f4008158610 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800c500 tx=0x7f3ff800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f40057fa640 1 -- 172.21.15.132:0/3190104145 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff8007500 con 0x7f400806c240 2023-12-20T04:53:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f40057fa640 1 -- 172.21.15.132:0/3190104145 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3ff8007660 con 0x7f400806c240 2023-12-20T04:53:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.948+0000 7f400ecaf640 1 -- 172.21.15.132:0/3190104145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f400000bd40 con 0x7f400806c240 2023-12-20T04:53:32.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.949+0000 7f40057fa640 1 -- 172.21.15.132:0/3190104145 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3ff80049e0 con 0x7f400806c240 2023-12-20T04:53:32.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.949+0000 7f400ecaf640 1 -- 172.21.15.132:0/3190104145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40081529c0 con 0x7f400806c240 2023-12-20T04:53:32.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.950+0000 7f400ecaf640 1 -- 172.21.15.132:0/3190104145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f400804e840 con 0x7f400806c240 2023-12-20T04:53:32.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.950+0000 7f40057fa640 1 -- 172.21.15.132:0/3190104145 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3ff8004b40 con 0x7f400806c240 2023-12-20T04:53:32.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.950+0000 7f40057fa640 1 --2- 172.21.15.132:0/3190104145 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ff406a430 0x7f3ff406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:32.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.951+0000 7f40057fa640 1 -- 172.21.15.132:0/3190104145 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3ff8087a00 con 0x7f400806c240 2023-12-20T04:53:32.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.951+0000 7f4007fff640 1 --2- 172.21.15.132:0/3190104145 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ff406a430 0x7f3ff406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:32.954 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.951+0000 7f4007fff640 1 --2- 172.21.15.132:0/3190104145 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ff406a430 0x7f3ff406c8f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f40081f7230 tx=0x7f3ffc009190 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:32.957 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:32.955+0000 7f40057fa640 1 -- 172.21.15.132:0/3190104145 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3ff80530b0 con 0x7f400806c240 2023-12-20T04:53:33.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.123+0000 7f400ecaf640 1 -- 172.21.15.132:0/3190104145 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f4008152e70 con 0x7f400806c240 2023-12-20T04:53:33.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.124+0000 7f40057fa640 1 -- 172.21.15.132:0/3190104145 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v189) v1 ==== 81+0+33594 (secure 0 0 0) 0x7f3ff8018090 con 0x7f400806c240 2023-12-20T04:53:33.126 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:33.126 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:33.126 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 189, 2023-12-20T04:53:33.126 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:53:33.127 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:53:33.127 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:53:29.910371+0000", 2023-12-20T04:53:33.127 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:53:33.127 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:53:33.127 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:53:33.127 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:53:33.127 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:53:33.127 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:53:33.127 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:53:33.127 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:53:33.127 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:53:33.127 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:33.127 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:53:33.127 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:53:33.127 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:53:33.127 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:53:33.128 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:53:33.128 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 23, 2023-12-20T04:53:33.128 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:53:33.128 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:53:33.128 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:53:33.128 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:53:33.128 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:53:33.128 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:53:33.128 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.128 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:53:33.128 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:53:33.128 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:53:33.128 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:53:33.128 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:53:33.128 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:33.129 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:33.129 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:33.129 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:33.129 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:33.129 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:33.129 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:33.129 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:33.129 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:33.129 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:33.129 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:53:33.129 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:53:33.129 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:53:33.129 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:53:33.129 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:53:33.130 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:33.130 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:33.130 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:33.130 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:33.130 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:33.130 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:33.130 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:33.130 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.130 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:53:33.130 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:33.130 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:33.130 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:33.130 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:33.130 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:33.131 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:33.131 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:33.131 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:33.131 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:33.131 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:53:33.131 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:33.131 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:33.131 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:33.131 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:33.131 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:33.131 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:33.131 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:33.131 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:33.131 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:33.131 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:33.132 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:33.132 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:33.132 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:33.132 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:33.132 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:33.132 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:33.132 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.132 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:33.132 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:33.132 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:33.132 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:33.132 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:33.132 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:33.132 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:33.132 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:33.132 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:33.132 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:33.133 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:33.133 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:33.133 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:53:33.133 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:53:33.133 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.133 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:33.133 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:53:33.133 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.133 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:33.133 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:53:33.133 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:53:33.133 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:53:33.133 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:53:33.133 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:53:33.133 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:33.134 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:33.134 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:33.134 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.134 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.134 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.134 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 22, 2023-12-20T04:53:33.134 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:53:33.134 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:53:03.034230+0000", 2023-12-20T04:53:33.134 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:53:33.134 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:53:33.134 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:33.134 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:33.134 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:33.134 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:33.134 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:33.134 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:33.135 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:33.135 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:33.135 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:33.135 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:33.135 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:53:33.135 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:53:33.135 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:53:33.135 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:53:33.135 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:53:33.135 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:33.135 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:33.135 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:33.135 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:33.135 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:33.135 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:33.136 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:33.136 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.136 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "185", 2023-12-20T04:53:33.136 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:33.136 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:33.136 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:33.136 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:33.136 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:33.136 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:33.136 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:33.136 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:33.136 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:33.136 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:53:33.136 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:33.137 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:33.137 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:33.137 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:33.137 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:33.137 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:33.137 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:33.137 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:33.137 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:33.137 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:33.137 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:33.137 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:33.137 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:33.137 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:33.137 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:33.138 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:33.138 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.138 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:33.138 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:33.138 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:33.138 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:33.138 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:33.138 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:33.138 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:33.138 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:33.138 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:33.138 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:33.138 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:33.138 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:33.138 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:53:33.139 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:53:33.139 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:53:33.139 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.139 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:33.139 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:53:33.139 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:53:33.139 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.139 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.139 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:33.139 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 2, 2023-12-20T04:53:33.139 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 2, 2023-12-20T04:53:33.139 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:53:33.139 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:53:33.139 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:53:33.140 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:33.140 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:33.140 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:33.140 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.140 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.140 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.140 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 23, 2023-12-20T04:53:33.140 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:53:33.140 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:53:03.812892+0000", 2023-12-20T04:53:33.140 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:53:33.140 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:53:33.140 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:33.140 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:33.140 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:33.141 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:33.141 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:33.141 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:33.141 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:33.141 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:33.141 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:33.141 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:33.141 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:53:33.141 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:53:33.141 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:53:33.141 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:53:33.141 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:53:33.141 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:33.141 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:33.141 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:33.142 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:33.142 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:33.142 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:33.142 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:33.142 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.142 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "189", 2023-12-20T04:53:33.142 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:33.142 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:33.142 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:33.142 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:33.142 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:33.142 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:33.142 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:33.143 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:33.143 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:33.143 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 33554432, 2023-12-20T04:53:33.143 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:33.143 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:33.143 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:33.143 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:33.143 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:33.143 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:33.143 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:33.143 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:33.143 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:33.143 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:33.143 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:33.143 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:33.144 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:33.144 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:33.144 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:33.144 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:33.144 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.144 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:33.144 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:33.144 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:33.144 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:33.144 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:33.144 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:33.144 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:33.144 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:33.144 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:33.144 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:33.145 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:33.145 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:33.145 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:53:33.145 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:53:33.145 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.145 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:33.145 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:53:33.145 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:53:33.145 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.145 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.145 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:33.145 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.3799999952316284, 2023-12-20T04:53:33.145 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.3799999952316284, 2023-12-20T04:53:33.146 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:53:33.146 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-20T04:53:33.146 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-20T04:53:33.146 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:33.146 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:33.146 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:33.146 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.146 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.146 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:33.146 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:53:33.146 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.146 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:53:33.146 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:33.146 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:33.146 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:33.147 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:33.147 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:33.147 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:33.147 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:33.147 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:33.147 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:33.147 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:33.147 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:33.147 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:33.147 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.147 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.147 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.147 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:53:33.147 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:33.147 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.148 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.148 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.148 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:53:33.148 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:33.148 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.148 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.148 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.148 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:33.148 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.148 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.148 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.148 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:53:33.148 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:33.148 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.149 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.149 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.149 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:53:33.149 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:33.149 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.149 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.149 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.149 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:33.149 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.149 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.149 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.149 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:53:33.149 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:33.150 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.150 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.150 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.150 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:53:33.150 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:33.150 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.150 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.150 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.150 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:33.150 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.150 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.150 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.150 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:53:33.150 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:33.151 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.151 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.151 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.151 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:53:33.151 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:33.151 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.151 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.151 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.151 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:53:33.151 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:53:33.151 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:53:33.151 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:53:33.151 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:33.151 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:33.152 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:33.152 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.152 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.152 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.152 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:53:33.152 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:33.152 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:33.152 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:33.152 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:33.152 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:33.153 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:33.153 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:33.153 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:33.153 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:33.153 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:33.153 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:33.153 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:33.153 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.153 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.153 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.153 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:53:33.153 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:33.153 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.153 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.154 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.154 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:53:33.154 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:33.154 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.154 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.154 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.154 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:33.154 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.154 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.154 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.154 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:53:33.154 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:33.154 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.154 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.154 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.154 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:53:33.155 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:33.155 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.155 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.155 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.155 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:33.155 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.155 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.155 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.155 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:53:33.155 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:33.155 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.155 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.155 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.155 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:53:33.155 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:33.156 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.156 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.156 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.156 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:33.156 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.156 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.156 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.156 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:53:33.156 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:33.156 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.157 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.157 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.157 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:53:33.157 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:33.157 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.157 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.157 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.157 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:53:33.157 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:53:33.157 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:53:33.157 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:53:33.157 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:33.158 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.159 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.160 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.160 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:33.160 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.160 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.160 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.160 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:53:33.160 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:33.160 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.160 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.160 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.160 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:53:33.160 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:33.160 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.160 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.161 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.161 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:33.161 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.161 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.161 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:53:33.161 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:33.161 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.161 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.161 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.161 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:53:33.161 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:33.161 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.161 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.162 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:33.162 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.162 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.162 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:53:33.162 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:33.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.162 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.162 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.162 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:53:33.162 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:33.162 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.162 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.162 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.162 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:53:33.163 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:53:33.163 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:53:33.163 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:53:33.163 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:33.163 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:33.163 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:33.163 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.163 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.163 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.163 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:53:33.163 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:33.163 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:33.163 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:33.163 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:33.163 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:33.164 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:33.164 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:33.164 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:33.164 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:33.164 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:33.164 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:33.164 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:33.164 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.164 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.164 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.164 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:53:33.164 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:33.164 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.164 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.164 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.165 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:53:33.165 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:33.165 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.165 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.165 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:33.165 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.165 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.165 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.165 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:53:33.165 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:33.165 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.165 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.165 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.166 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:53:33.166 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:33.166 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.166 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.166 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.166 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:33.166 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.166 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.166 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.166 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:53:33.166 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:33.166 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.166 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.166 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.167 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:53:33.167 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:33.167 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.167 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.167 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:33.167 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.167 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.167 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:53:33.167 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:33.167 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.167 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.167 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.167 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:53:33.167 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:33.168 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.168 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.168 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:53:33.168 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:53:33.168 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:53:33.168 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:53:33.168 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:33.168 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:33.168 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:33.168 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.168 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.168 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.168 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:53:33.168 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:33.168 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:33.169 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:33.169 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:33.169 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:33.169 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:33.169 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:33.169 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:33.169 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:33.169 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:33.169 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:33.169 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:33.169 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.169 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.169 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.169 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:53:33.170 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:33.170 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.170 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.170 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.170 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:53:33.170 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:33.170 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.170 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.170 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.170 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:33.170 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.170 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.170 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.170 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:53:33.171 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:33.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.171 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.171 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.171 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:53:33.171 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:33.171 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.171 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.171 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.171 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:33.171 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.171 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.171 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.171 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:53:33.171 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:33.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.172 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.172 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:53:33.172 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:33.172 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.172 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.172 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:33.172 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.172 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.172 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.172 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:53:33.172 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:33.172 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.173 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.173 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.173 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:53:33.173 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:33.173 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.173 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.173 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.173 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:53:33.173 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:53:33.173 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:53:33.173 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:53:33.173 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:33.173 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:33.174 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:33.174 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.174 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.174 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.174 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:53:33.174 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:33.174 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:33.174 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:33.174 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:33.174 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:33.174 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:33.174 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:33.174 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:33.174 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:33.174 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:33.175 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:33.175 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:33.175 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.175 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.175 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.175 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:53:33.175 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:33.175 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.175 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.175 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.176 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:53:33.176 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:33.176 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.176 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.176 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.176 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:33.176 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.177 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.177 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:53:33.177 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:33.177 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.177 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.177 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.178 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:53:33.178 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:33.178 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.178 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.178 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.178 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:33.178 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.178 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.178 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.179 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:53:33.179 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:33.179 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.179 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.179 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.179 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:53:33.179 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:33.179 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.179 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.180 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.180 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:33.180 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.180 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.180 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.180 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:53:33.180 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:33.180 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.181 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.181 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.181 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:53:33.181 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:33.181 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.181 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.181 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.182 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:53:33.182 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:53:33.182 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:53:33.182 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:53:33.182 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:33.182 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:33.182 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:33.182 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.183 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.183 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.183 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:53:33.183 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:33.183 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:33.183 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:33.183 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:33.183 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:33.183 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:33.184 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:33.184 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:33.184 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:33.184 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:33.184 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:33.184 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:33.184 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.184 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.185 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.185 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:53:33.185 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:33.185 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.185 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.185 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.185 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:53:33.185 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:33.186 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.186 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.186 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.186 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:33.186 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.186 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.186 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.186 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:53:33.186 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:53:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:53:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:33.187 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:53:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:53:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.188 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:53:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:53:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:53:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:53:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:53:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:33.189 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:53:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:33.190 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:53:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:53:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.191 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:53:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:53:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.192 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:53:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:53:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.193 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:53:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:53:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:53:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:53:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:53:33.194 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:53:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:53:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:53:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:33.195 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:53:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:53:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:53:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:53:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:33.196 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:53:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:53:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:33.197 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:53:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:53:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:53:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:53:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:33.198 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:53:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:53:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:53:33.199 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:53:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:53:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:53:33.200 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:53:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:53:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:53:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:53:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:53:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:53:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:53:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:53:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:53:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:53:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:53:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:53:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:53:33.201 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:53:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:53:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:53:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:53:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:53:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:53:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:53:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:53:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:53:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:53:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:53:33.202 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.202 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:33.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.126+0000 7f400ecaf640 1 -- 172.21.15.132:0/3190104145 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ff406a430 msgr2=0x7f3ff406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:33.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.126+0000 7f400ecaf640 1 --2- 172.21.15.132:0/3190104145 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ff406a430 0x7f3ff406c8f0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f40081f7230 tx=0x7f3ffc009190 comp rx=0 tx=0).stop 2023-12-20T04:53:33.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.126+0000 7f400ecaf640 1 -- 172.21.15.132:0/3190104145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f400806c240 msgr2=0x7f4008158610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:33.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.126+0000 7f400ecaf640 1 --2- 172.21.15.132:0/3190104145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f400806c240 0x7f4008158610 secure :-1 s=READY pgs=1854 cs=0 l=1 rev1=1 crypto rx=0x7f3ff800c500 tx=0x7f3ff800c9c0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.204 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.126+0000 7f400ecaf640 1 -- 172.21.15.132:0/3190104145 shutdown_connections 2023-12-20T04:53:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.126+0000 7f400ecaf640 1 --2- 172.21.15.132:0/3190104145 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3ff406a430 0x7f3ff406c8f0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.126+0000 7f400ecaf640 1 --2- 172.21.15.132:0/3190104145 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f400815e530 0x7f4008153d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.126+0000 7f400ecaf640 1 --2- 172.21.15.132:0/3190104145 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4008159b50 0x7f40080c9610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.126+0000 7f400ecaf640 1 --2- 172.21.15.132:0/3190104145 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f400806c240 0x7f4008158610 unknown :-1 s=CLOSED pgs=1854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.126+0000 7f400ecaf640 1 -- 172.21.15.132:0/3190104145 >> 172.21.15.132:0/3190104145 conn(0x7f40080ced10 msgr2=0x7f4008070550 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.126+0000 7f400ecaf640 1 -- 172.21.15.132:0/3190104145 shutdown_connections 2023-12-20T04:53:33.205 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.126+0000 7f400ecaf640 1 -- 172.21.15.132:0/3190104145 wait complete. 2023-12-20T04:53:33.206 DEBUG:tasks.ceph_test_case:wait_until_true: success in 10s and 0 retries 2023-12-20T04:53:33.206 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json-pretty 2023-12-20T04:53:33.306 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.304+0000 7f7aaef16640 1 Processor -- start 2023-12-20T04:53:33.307 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.304+0000 7f7aaef16640 1 -- start start 2023-12-20T04:53:33.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.305+0000 7f7aaef16640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7aa815e530 0x7f7aa806fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:33.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.305+0000 7f7aaef16640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa80ccf30 con 0x7f7aa8159b50 2023-12-20T04:53:33.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.305+0000 7f7aaef16640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f7aa80ca1c0 con 0x7f7aa806c240 2023-12-20T04:53:33.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.305+0000 7f7aaef16640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f7aa80caa60 con 0x7f7aa815e530 2023-12-20T04:53:33.308 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.305+0000 7f7aa7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7aa815e530 0x7f7aa806fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:33.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.305+0000 7f7aaccb2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7aa8159b50 0x7f7aa80c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33838/0 (socket says 172.21.15.132:33838) 2023-12-20T04:53:33.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.305+0000 7f7aa7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f7aa815e530 0x7f7aa806fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40932/0 (socket says 172.21.15.132:40932) 2023-12-20T04:53:33.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.305+0000 7f7aaccb2640 1 -- 172.21.15.132:0/3829305192 learned_addr learned my addr 172.21.15.132:0/3829305192 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:33.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.306+0000 7f7aa7fff640 1 -- 172.21.15.132:0/3829305192 >> v1:172.21.15.187:6789/0 conn(0x7f7aa806c240 legacy=0x7f7aa80cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:33.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.306+0000 7f7aa7fff640 1 -- 172.21.15.132:0/3829305192 >> v1:172.21.15.132:6789/0 conn(0x7f7aa8159b50 legacy=0x7f7aa80c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:33.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.306+0000 7f7aa7fff640 1 -- 172.21.15.132:0/3829305192 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aa80ca4a0 con 0x7f7aa815e530 2023-12-20T04:53:33.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.306+0000 7f7aa77fe640 1 -- 172.21.15.132:0/3829305192 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2758235838 0 0) 0x7f7aa80ccf30 con 0x7f7aa8159b50 2023-12-20T04:53:33.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.306+0000 7f7aa7fff640 1 --2- 172.21.15.132:0/3829305192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7aa815e530 0x7f7aa806fd70 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0097d0 tx=0x7f7a9c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=80760d530af3a24e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:33.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.306+0000 7f7aa77fe640 1 -- 172.21.15.132:0/3829305192 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c030610 con 0x7f7aa815e530 2023-12-20T04:53:33.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.307+0000 7f7aa77fe640 1 -- 172.21.15.132:0/3829305192 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7a9c030770 con 0x7f7aa815e530 2023-12-20T04:53:33.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.307+0000 7f7aa77fe640 1 -- 172.21.15.132:0/3829305192 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7a9c030b00 con 0x7f7aa815e530 2023-12-20T04:53:33.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.307+0000 7f7aaef16640 1 -- 172.21.15.132:0/3829305192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7aa815e530 msgr2=0x7f7aa806fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:33.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.307+0000 7f7aaef16640 1 --2- 172.21.15.132:0/3829305192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7aa815e530 0x7f7aa806fd70 secure :-1 s=READY pgs=1856 cs=0 l=1 rev1=1 crypto rx=0x7f7a9c0097d0 tx=0x7f7a9c02b960 comp rx=0 tx=0).stop 2023-12-20T04:53:33.310 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.307+0000 7f7aaef16640 1 -- 172.21.15.132:0/3829305192 shutdown_connections 2023-12-20T04:53:33.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.307+0000 7f7aaef16640 1 --2- 172.21.15.132:0/3829305192 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7aa815e530 0x7f7aa806fd70 unknown :-1 s=CLOSED pgs=1856 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.307+0000 7f7aaef16640 1 -- 172.21.15.132:0/3829305192 >> 172.21.15.132:0/3829305192 conn(0x7f7aa80ced10 msgr2=0x7f7aa80cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:33.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.307+0000 7f7aaef16640 1 -- 172.21.15.132:0/3829305192 shutdown_connections 2023-12-20T04:53:33.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.307+0000 7f7aaef16640 1 -- 172.21.15.132:0/3829305192 wait complete. 2023-12-20T04:53:33.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.308+0000 7f7aaef16640 1 Processor -- start 2023-12-20T04:53:33.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.308+0000 7f7aaef16640 1 -- start start 2023-12-20T04:53:33.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.309+0000 7f7aaef16640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7aa806c240 0x7f7aa814fcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:33.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.309+0000 7f7aaef16640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7aa8159b50 0x7f7aa80c4b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:33.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.309+0000 7f7aaef16640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7aa815e530 0x7f7aa815b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:33.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.309+0000 7f7aaef16640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8150290 con 0x7f7aa815e530 2023-12-20T04:53:33.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.309+0000 7f7aaef16640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8150570 con 0x7f7aa8159b50 2023-12-20T04:53:33.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.309+0000 7f7aaef16640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f7aa8150850 con 0x7f7aa806c240 2023-12-20T04:53:33.313 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.309+0000 7f7aad4b3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7aa815e530 0x7f7aa815b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:33.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.309+0000 7f7aad4b3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7aa815e530 0x7f7aa815b220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40936/0 (socket says 172.21.15.132:40936) 2023-12-20T04:53:33.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.309+0000 7f7aad4b3640 1 -- 172.21.15.132:0/469970991 learned_addr learned my addr 172.21.15.132:0/469970991 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:33.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.309+0000 7f7aaccb2640 1 --2- 172.21.15.132:0/469970991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7aa806c240 0x7f7aa814fcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:33.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.309+0000 7f7aa7fff640 1 --2- 172.21.15.132:0/469970991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7aa8159b50 0x7f7aa80c4b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:33.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.310+0000 7f7aad4b3640 1 -- 172.21.15.132:0/469970991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7aa806c240 msgr2=0x7f7aa814fcb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:33.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.310+0000 7f7aad4b3640 1 --2- 172.21.15.132:0/469970991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7aa806c240 0x7f7aa814fcb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.310+0000 7f7aad4b3640 1 -- 172.21.15.132:0/469970991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7aa8159b50 msgr2=0x7f7aa80c4b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:33.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.310+0000 7f7aad4b3640 1 --2- 172.21.15.132:0/469970991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7aa8159b50 0x7f7aa80c4b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.310+0000 7f7aad4b3640 1 -- 172.21.15.132:0/469970991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a9c009400 con 0x7f7aa815e530 2023-12-20T04:53:33.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.310+0000 7f7aa7fff640 1 --2- 172.21.15.132:0/469970991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7aa8159b50 0x7f7aa80c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:33.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.310+0000 7f7aad4b3640 1 --2- 172.21.15.132:0/469970991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7aa815e530 0x7f7aa815b220 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000c7a0 tx=0x7f7aa000cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:33.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.310+0000 7f7aa57fa640 1 -- 172.21.15.132:0/469970991 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0003b70 con 0x7f7aa815e530 2023-12-20T04:53:33.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.310+0000 7f7aa57fa640 1 -- 172.21.15.132:0/469970991 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7aa0003cf0 con 0x7f7aa815e530 2023-12-20T04:53:33.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.310+0000 7f7aaef16640 1 -- 172.21.15.132:0/469970991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7aa8150b30 con 0x7f7aa815e530 2023-12-20T04:53:33.314 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.310+0000 7f7aa57fa640 1 -- 172.21.15.132:0/469970991 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7aa0003ea0 con 0x7f7aa815e530 2023-12-20T04:53:33.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.310+0000 7f7aaef16640 1 -- 172.21.15.132:0/469970991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7aa815cee0 con 0x7f7aa815e530 2023-12-20T04:53:33.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.311+0000 7f7aaef16640 1 -- 172.21.15.132:0/469970991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7aa8151050 con 0x7f7aa815e530 2023-12-20T04:53:33.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.311+0000 7f7aa57fa640 1 -- 172.21.15.132:0/469970991 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7aa000aa90 con 0x7f7aa815e530 2023-12-20T04:53:33.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.312+0000 7f7aa57fa640 1 --2- 172.21.15.132:0/469970991 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a9406a430 0x7f7a9406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:33.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.312+0000 7f7aa57fa640 1 -- 172.21.15.132:0/469970991 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f7aa0088760 con 0x7f7aa815e530 2023-12-20T04:53:33.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.312+0000 7f7aaccb2640 1 --2- 172.21.15.132:0/469970991 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a9406a430 0x7f7a9406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:33.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.312+0000 7f7aaccb2640 1 --2- 172.21.15.132:0/469970991 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a9406a430 0x7f7a9406c8f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7a98000f60 tx=0x7f7a98007bb0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:33.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.316+0000 7f7aa57fa640 1 -- 172.21.15.132:0/469970991 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f7aa8151050 con 0x7f7aa815e530 2023-12-20T04:53:33.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.481+0000 7f7aaef16640 1 -- 172.21.15.132:0/469970991 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json-pretty"} v 0) v1 -- 0x7f7aa8151050 con 0x7f7aa815e530 2023-12-20T04:53:33.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.482+0000 7f7aa57fa640 1 -- 172.21.15.132:0/469970991 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json-pretty"}]=0 v189) v1 ==== 81+0+33594 (secure 0 0 0) 0x7f7aa8151050 con 0x7f7aa815e530 2023-12-20T04:53:33.485 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:33.485 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:33.485 INFO:teuthology.orchestra.run.smithi132.stdout: "epoch": 189, 2023-12-20T04:53:33.485 INFO:teuthology.orchestra.run.smithi132.stdout: "fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", 2023-12-20T04:53:33.485 INFO:teuthology.orchestra.run.smithi132.stdout: "created": "2023-12-20T04:42:30.055119+0000", 2023-12-20T04:53:33.485 INFO:teuthology.orchestra.run.smithi132.stdout: "modified": "2023-12-20T04:53:29.910371+0000", 2023-12-20T04:53:33.485 INFO:teuthology.orchestra.run.smithi132.stdout: "last_up_change": "2023-12-20T04:42:35.653517+0000", 2023-12-20T04:53:33.485 INFO:teuthology.orchestra.run.smithi132.stdout: "last_in_change": "2023-12-20T04:42:32.646555+0000", 2023-12-20T04:53:33.485 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": "sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2023-12-20T04:53:33.486 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_num": 5799936, 2023-12-20T04:53:33.486 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_set": [ 2023-12-20T04:53:33.486 INFO:teuthology.orchestra.run.smithi132.stdout: "pglog_hardlimit", 2023-12-20T04:53:33.486 INFO:teuthology.orchestra.run.smithi132.stdout: "purged_snapdirs", 2023-12-20T04:53:33.486 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_deletes", 2023-12-20T04:53:33.486 INFO:teuthology.orchestra.run.smithi132.stdout: "sortbitwise" 2023-12-20T04:53:33.486 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:33.486 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_version": 4, 2023-12-20T04:53:33.486 INFO:teuthology.orchestra.run.smithi132.stdout: "full_ratio": 0.69999998807907104, 2023-12-20T04:53:33.486 INFO:teuthology.orchestra.run.smithi132.stdout: "backfillfull_ratio": 0.60000002384185791, 2023-12-20T04:53:33.486 INFO:teuthology.orchestra.run.smithi132.stdout: "nearfull_ratio": 0.60000002384185791, 2023-12-20T04:53:33.486 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_snapshot": "", 2023-12-20T04:53:33.486 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_max": 23, 2023-12-20T04:53:33.486 INFO:teuthology.orchestra.run.smithi132.stdout: "max_osd": 8, 2023-12-20T04:53:33.487 INFO:teuthology.orchestra.run.smithi132.stdout: "require_min_compat_client": "luminous", 2023-12-20T04:53:33.487 INFO:teuthology.orchestra.run.smithi132.stdout: "min_compat_client": "jewel", 2023-12-20T04:53:33.487 INFO:teuthology.orchestra.run.smithi132.stdout: "require_osd_release": "reef", 2023-12-20T04:53:33.487 INFO:teuthology.orchestra.run.smithi132.stdout: "allow_crimson": false, 2023-12-20T04:53:33.487 INFO:teuthology.orchestra.run.smithi132.stdout: "pools": [ 2023-12-20T04:53:33.487 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.487 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 1, 2023-12-20T04:53:33.487 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": ".mgr", 2023-12-20T04:53:33.487 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:42:36.131368+0000", 2023-12-20T04:53:33.487 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:53:33.487 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:53:33.487 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:33.487 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:33.487 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:33.487 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:33.488 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:33.488 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:33.488 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:33.488 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:33.488 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:33.488 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:33.488 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 1, 2023-12-20T04:53:33.488 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 1, 2023-12-20T04:53:33.488 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 1, 2023-12-20T04:53:33.488 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 1, 2023-12-20T04:53:33.488 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 1, 2023-12-20T04:53:33.488 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:33.488 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:33.488 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:33.488 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:33.488 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:33.489 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:33.489 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:33.489 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.489 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "110", 2023-12-20T04:53:33.489 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:33.489 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:33.489 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:33.489 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:33.489 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:33.489 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:33.489 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:33.489 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:33.489 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:33.489 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:53:33.490 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:33.490 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:33.490 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:33.490 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:33.490 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:33.490 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:33.490 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:33.490 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:33.490 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:33.490 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:33.490 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:33.490 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:33.490 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:33.490 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:33.491 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:33.491 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:33.491 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.491 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:33.491 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:33.491 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:33.491 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:33.491 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:33.491 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:33.491 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:33.491 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:33.491 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:33.491 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:33.491 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:33.491 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:33.492 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_max": 32, 2023-12-20T04:53:33.492 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 1 2023-12-20T04:53:33.492 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.492 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:33.492 INFO:teuthology.orchestra.run.smithi132.stdout: "mgr": {} 2023-12-20T04:53:33.492 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.492 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:33.492 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 8, 2023-12-20T04:53:33.492 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 8, 2023-12-20T04:53:33.492 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 0.25, 2023-12-20T04:53:33.492 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:53:33.492 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:53:33.492 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:33.492 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:33.492 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:33.493 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.493 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.493 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.493 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 22, 2023-12-20T04:53:33.493 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_metadata", 2023-12-20T04:53:33.493 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:53:03.034230+0000", 2023-12-20T04:53:33.493 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:53:33.493 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:53:33.493 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:33.493 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:33.493 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:33.493 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:33.493 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:33.493 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:33.494 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:33.494 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:33.494 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:33.494 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:33.494 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 32, 2023-12-20T04:53:33.494 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 32, 2023-12-20T04:53:33.494 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 32, 2023-12-20T04:53:33.494 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 32, 2023-12-20T04:53:33.494 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 32, 2023-12-20T04:53:33.494 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:33.494 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:33.494 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:33.494 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:33.494 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:33.494 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:33.495 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:33.495 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.495 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "185", 2023-12-20T04:53:33.495 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:33.495 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:33.495 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:33.495 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:33.495 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:33.495 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:33.495 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:33.495 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:33.495 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:33.495 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 0, 2023-12-20T04:53:33.495 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:33.495 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:33.496 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:33.496 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:33.496 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:33.496 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:33.496 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:33.496 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:33.496 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:33.496 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:33.496 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:33.496 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:33.496 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:33.496 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:33.496 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:33.496 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:33.497 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.497 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:33.497 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:33.497 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:33.497 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:33.497 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:33.497 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:33.497 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:33.497 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:33.497 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:33.497 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:33.497 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:33.497 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:33.497 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_bias": 4, 2023-12-20T04:53:33.497 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 16, 2023-12-20T04:53:33.498 INFO:teuthology.orchestra.run.smithi132.stdout: "recovery_priority": 5 2023-12-20T04:53:33.498 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.498 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:33.498 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:53:33.498 INFO:teuthology.orchestra.run.smithi132.stdout: "metadata": "cephfs" 2023-12-20T04:53:33.498 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.498 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.498 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:33.498 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 2, 2023-12-20T04:53:33.498 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 2, 2023-12-20T04:53:33.498 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:53:33.498 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 2, 2023-12-20T04:53:33.498 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 2, 2023-12-20T04:53:33.498 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:33.498 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:33.499 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:33.499 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.499 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.499 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.499 INFO:teuthology.orchestra.run.smithi132.stdout: "pool": 23, 2023-12-20T04:53:33.499 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_name": "cephfs_data", 2023-12-20T04:53:33.499 INFO:teuthology.orchestra.run.smithi132.stdout: "create_time": "2023-12-20T04:53:03.812892+0000", 2023-12-20T04:53:33.499 INFO:teuthology.orchestra.run.smithi132.stdout: "flags": 1, 2023-12-20T04:53:33.499 INFO:teuthology.orchestra.run.smithi132.stdout: "flags_names": "hashpspool", 2023-12-20T04:53:33.499 INFO:teuthology.orchestra.run.smithi132.stdout: "type": 1, 2023-12-20T04:53:33.499 INFO:teuthology.orchestra.run.smithi132.stdout: "size": 2, 2023-12-20T04:53:33.499 INFO:teuthology.orchestra.run.smithi132.stdout: "min_size": 1, 2023-12-20T04:53:33.499 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_rule": 0, 2023-12-20T04:53:33.499 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_count": 0, 2023-12-20T04:53:33.500 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_target": 0, 2023-12-20T04:53:33.500 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_barrier": 0, 2023-12-20T04:53:33.500 INFO:teuthology.orchestra.run.smithi132.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2023-12-20T04:53:33.500 INFO:teuthology.orchestra.run.smithi132.stdout: "object_hash": 2, 2023-12-20T04:53:33.500 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_autoscale_mode": "off", 2023-12-20T04:53:33.500 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num": 64, 2023-12-20T04:53:33.500 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num": 64, 2023-12-20T04:53:33.500 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_placement_num_target": 64, 2023-12-20T04:53:33.500 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_target": 64, 2023-12-20T04:53:33.500 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_pending": 64, 2023-12-20T04:53:33.500 INFO:teuthology.orchestra.run.smithi132.stdout: "last_pg_merge_meta": { 2023-12-20T04:53:33.500 INFO:teuthology.orchestra.run.smithi132.stdout: "source_pgid": "0.0", 2023-12-20T04:53:33.500 INFO:teuthology.orchestra.run.smithi132.stdout: "ready_epoch": 0, 2023-12-20T04:53:33.500 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_started": 0, 2023-12-20T04:53:33.500 INFO:teuthology.orchestra.run.smithi132.stdout: "last_epoch_clean": 0, 2023-12-20T04:53:33.501 INFO:teuthology.orchestra.run.smithi132.stdout: "source_version": "0'0", 2023-12-20T04:53:33.501 INFO:teuthology.orchestra.run.smithi132.stdout: "target_version": "0'0" 2023-12-20T04:53:33.501 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.501 INFO:teuthology.orchestra.run.smithi132.stdout: "last_change": "189", 2023-12-20T04:53:33.501 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend": "0", 2023-12-20T04:53:33.501 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_prenautilus": "0", 2023-12-20T04:53:33.501 INFO:teuthology.orchestra.run.smithi132.stdout: "last_force_op_resend_preluminous": "0", 2023-12-20T04:53:33.501 INFO:teuthology.orchestra.run.smithi132.stdout: "auid": 0, 2023-12-20T04:53:33.501 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_mode": "selfmanaged", 2023-12-20T04:53:33.501 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_seq": 0, 2023-12-20T04:53:33.501 INFO:teuthology.orchestra.run.smithi132.stdout: "snap_epoch": 0, 2023-12-20T04:53:33.501 INFO:teuthology.orchestra.run.smithi132.stdout: "pool_snaps": [], 2023-12-20T04:53:33.501 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps": "[]", 2023-12-20T04:53:33.502 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_bytes": 33554432, 2023-12-20T04:53:33.502 INFO:teuthology.orchestra.run.smithi132.stdout: "quota_max_objects": 0, 2023-12-20T04:53:33.502 INFO:teuthology.orchestra.run.smithi132.stdout: "tiers": [], 2023-12-20T04:53:33.502 INFO:teuthology.orchestra.run.smithi132.stdout: "tier_of": -1, 2023-12-20T04:53:33.502 INFO:teuthology.orchestra.run.smithi132.stdout: "read_tier": -1, 2023-12-20T04:53:33.502 INFO:teuthology.orchestra.run.smithi132.stdout: "write_tier": -1, 2023-12-20T04:53:33.502 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_mode": "none", 2023-12-20T04:53:33.502 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_bytes": 0, 2023-12-20T04:53:33.502 INFO:teuthology.orchestra.run.smithi132.stdout: "target_max_objects": 0, 2023-12-20T04:53:33.502 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_ratio_micro": 400000, 2023-12-20T04:53:33.502 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2023-12-20T04:53:33.502 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_target_full_ratio_micro": 800000, 2023-12-20T04:53:33.502 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_flush_age": 0, 2023-12-20T04:53:33.502 INFO:teuthology.orchestra.run.smithi132.stdout: "cache_min_evict_age": 0, 2023-12-20T04:53:33.502 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profile": "", 2023-12-20T04:53:33.502 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_params": { 2023-12-20T04:53:33.503 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "none" 2023-12-20T04:53:33.503 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.503 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_period": 0, 2023-12-20T04:53:33.503 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_count": 0, 2023-12-20T04:53:33.503 INFO:teuthology.orchestra.run.smithi132.stdout: "use_gmt_hitset": true, 2023-12-20T04:53:33.503 INFO:teuthology.orchestra.run.smithi132.stdout: "min_read_recency_for_promote": 0, 2023-12-20T04:53:33.503 INFO:teuthology.orchestra.run.smithi132.stdout: "min_write_recency_for_promote": 0, 2023-12-20T04:53:33.503 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_grade_decay_rate": 0, 2023-12-20T04:53:33.503 INFO:teuthology.orchestra.run.smithi132.stdout: "hit_set_search_last_n": 0, 2023-12-20T04:53:33.503 INFO:teuthology.orchestra.run.smithi132.stdout: "grade_table": [], 2023-12-20T04:53:33.503 INFO:teuthology.orchestra.run.smithi132.stdout: "stripe_width": 0, 2023-12-20T04:53:33.503 INFO:teuthology.orchestra.run.smithi132.stdout: "expected_num_objects": 0, 2023-12-20T04:53:33.503 INFO:teuthology.orchestra.run.smithi132.stdout: "fast_read": false, 2023-12-20T04:53:33.503 INFO:teuthology.orchestra.run.smithi132.stdout: "options": { 2023-12-20T04:53:33.503 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_num_min": 64, 2023-12-20T04:53:33.504 INFO:teuthology.orchestra.run.smithi132.stdout: "target_size_ratio": 0.89999997615814209 2023-12-20T04:53:33.504 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.504 INFO:teuthology.orchestra.run.smithi132.stdout: "application_metadata": { 2023-12-20T04:53:33.504 INFO:teuthology.orchestra.run.smithi132.stdout: "cephfs": { 2023-12-20T04:53:33.504 INFO:teuthology.orchestra.run.smithi132.stdout: "data": "cephfs" 2023-12-20T04:53:33.504 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.504 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.504 INFO:teuthology.orchestra.run.smithi132.stdout: "read_balance": { 2023-12-20T04:53:33.504 INFO:teuthology.orchestra.run.smithi132.stdout: "score_acting": 1.3799999952316284, 2023-12-20T04:53:33.504 INFO:teuthology.orchestra.run.smithi132.stdout: "score_stable": 1.3799999952316284, 2023-12-20T04:53:33.504 INFO:teuthology.orchestra.run.smithi132.stdout: "optimal_score": 1, 2023-12-20T04:53:33.504 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_acting": 1.3799999952316284, 2023-12-20T04:53:33.504 INFO:teuthology.orchestra.run.smithi132.stdout: "raw_score_stable": 1.3799999952316284, 2023-12-20T04:53:33.504 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity_weighted": 1, 2023-12-20T04:53:33.505 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity": 1, 2023-12-20T04:53:33.505 INFO:teuthology.orchestra.run.smithi132.stdout: "average_primary_affinity_weighted": 1 2023-12-20T04:53:33.505 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.505 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.505 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:33.505 INFO:teuthology.orchestra.run.smithi132.stdout: "osds": [ 2023-12-20T04:53:33.505 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.505 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:53:33.505 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:33.505 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:33.505 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:33.505 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:33.505 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:33.505 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6800", 2023-12-20T04:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.506 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6801", 2023-12-20T04:53:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6802", 2023-12-20T04:53:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6803", 2023-12-20T04:53:33.507 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6806", 2023-12-20T04:53:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6807", 2023-12-20T04:53:33.508 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6804", 2023-12-20T04:53:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6805", 2023-12-20T04:53:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84977 2023-12-20T04:53:33.509 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.510 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.510 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.510 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6801/84977", 2023-12-20T04:53:33.510 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6803/84977", 2023-12-20T04:53:33.510 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6807/84977", 2023-12-20T04:53:33.510 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6805/84977", 2023-12-20T04:53:33.510 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:33.510 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:33.510 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:33.510 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.510 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.510 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.510 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:53:33.510 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:33.511 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:33.511 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:33.511 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:33.511 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:33.511 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:33.511 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:33.511 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:33.511 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:33.511 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:33.511 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:33.511 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:33.511 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.511 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.511 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.511 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6818", 2023-12-20T04:53:33.512 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:33.512 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.512 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.512 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.512 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6821", 2023-12-20T04:53:33.512 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:33.512 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.512 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.512 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.512 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:33.512 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.512 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.512 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.512 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6823", 2023-12-20T04:53:33.512 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:33.512 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.513 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.513 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.513 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6825", 2023-12-20T04:53:33.513 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:33.513 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.513 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.513 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.513 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:33.513 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.513 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.513 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.513 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6830", 2023-12-20T04:53:33.513 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:33.513 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.513 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.514 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.514 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6831", 2023-12-20T04:53:33.514 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:33.514 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.514 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.514 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.514 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:33.514 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.514 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.514 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.514 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6827", 2023-12-20T04:53:33.514 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:33.514 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.514 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.514 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.515 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6829", 2023-12-20T04:53:33.515 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84981 2023-12-20T04:53:33.515 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.515 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.515 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.515 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6821/84981", 2023-12-20T04:53:33.515 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6825/84981", 2023-12-20T04:53:33.515 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6831/84981", 2023-12-20T04:53:33.515 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6829/84981", 2023-12-20T04:53:33.515 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:33.515 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:33.515 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:33.515 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.515 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.515 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.515 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:53:33.516 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:33.516 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:33.516 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:33.516 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:33.516 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:33.516 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:33.516 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:33.516 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:33.516 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:33.516 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:33.516 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:33.516 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:33.516 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.516 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.516 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.516 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6808", 2023-12-20T04:53:33.517 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:33.517 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.517 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.517 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.517 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6809", 2023-12-20T04:53:33.517 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:33.517 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.517 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.517 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.517 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:33.517 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.517 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.517 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.517 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6810", 2023-12-20T04:53:33.517 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:33.518 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.518 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.518 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.518 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6811", 2023-12-20T04:53:33.518 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:33.518 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.518 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.518 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.518 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:33.518 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.518 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.518 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.518 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6814", 2023-12-20T04:53:33.518 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:33.519 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.519 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.519 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.519 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6815", 2023-12-20T04:53:33.519 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:33.519 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.519 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.519 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.519 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:33.519 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.519 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.519 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.519 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6812", 2023-12-20T04:53:33.519 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:33.519 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.520 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.520 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.520 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6813", 2023-12-20T04:53:33.520 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84979 2023-12-20T04:53:33.520 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.520 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.520 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.520 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6809/84979", 2023-12-20T04:53:33.520 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6811/84979", 2023-12-20T04:53:33.520 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6815/84979", 2023-12-20T04:53:33.520 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6813/84979", 2023-12-20T04:53:33.520 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:33.520 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:33.520 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:33.520 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.521 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.521 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.521 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:53:33.521 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:33.521 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:33.521 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:33.521 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:33.521 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:33.521 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:33.521 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:33.521 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:33.522 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:33.522 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:33.522 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:33.522 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:33.522 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.522 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.522 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.522 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6816", 2023-12-20T04:53:33.522 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:33.522 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.522 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.522 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.522 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6817", 2023-12-20T04:53:33.522 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:33.522 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.523 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.523 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.523 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:33.523 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.523 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.523 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.523 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6819", 2023-12-20T04:53:33.523 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:33.523 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.523 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.523 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.523 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6820", 2023-12-20T04:53:33.523 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:33.523 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.523 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.524 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:33.524 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.524 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.524 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.524 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6826", 2023-12-20T04:53:33.524 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:33.524 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.524 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.524 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.524 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6828", 2023-12-20T04:53:33.524 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:33.524 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.524 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.525 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.525 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:33.525 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.525 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.525 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.525 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6822", 2023-12-20T04:53:33.525 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:33.525 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.525 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.525 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.525 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.132:6824", 2023-12-20T04:53:33.525 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84982 2023-12-20T04:53:33.525 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.525 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.526 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.526 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.132:6817/84982", 2023-12-20T04:53:33.526 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.132:6820/84982", 2023-12-20T04:53:33.526 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.132:6828/84982", 2023-12-20T04:53:33.526 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.132:6824/84982", 2023-12-20T04:53:33.526 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:33.526 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:33.526 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:33.526 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.526 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.526 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.527 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:53:33.527 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:33.527 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:33.527 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:33.527 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:33.527 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:33.527 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:33.527 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:33.527 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:33.527 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:33.527 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:33.527 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:33.527 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:33.527 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.527 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.527 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.528 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6800", 2023-12-20T04:53:33.528 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:33.528 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.528 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.528 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.528 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6801", 2023-12-20T04:53:33.528 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:33.528 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.528 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.528 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.528 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:33.528 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.528 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.528 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.528 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6802", 2023-12-20T04:53:33.529 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:33.529 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.529 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.529 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.529 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6804", 2023-12-20T04:53:33.529 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:33.529 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.529 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.529 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.529 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:33.529 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.529 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.529 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.529 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6814", 2023-12-20T04:53:33.529 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:33.530 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.530 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.530 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.530 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6818", 2023-12-20T04:53:33.530 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:33.530 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.530 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.530 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.530 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:33.530 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.530 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.530 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.530 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6807", 2023-12-20T04:53:33.530 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:33.530 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.530 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.531 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.531 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6811", 2023-12-20T04:53:33.531 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84618 2023-12-20T04:53:33.531 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.531 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.531 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.531 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6801/84618", 2023-12-20T04:53:33.531 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6804/84618", 2023-12-20T04:53:33.531 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6818/84618", 2023-12-20T04:53:33.531 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6811/84618", 2023-12-20T04:53:33.531 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:33.531 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:33.531 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:33.531 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.531 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.531 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.532 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:53:33.532 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:33.532 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:33.532 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:33.532 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:33.532 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:33.532 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:33.532 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:33.532 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:33.532 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:33.532 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:33.532 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:33.532 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:33.532 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.533 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.533 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.533 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6803", 2023-12-20T04:53:33.533 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:33.533 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.533 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.533 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.533 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6805", 2023-12-20T04:53:33.533 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:33.533 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.533 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.533 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.533 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:33.533 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.534 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.534 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.534 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6808", 2023-12-20T04:53:33.534 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:33.534 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.534 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.534 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.534 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6810", 2023-12-20T04:53:33.534 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:33.534 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.534 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.534 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.534 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:33.534 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.534 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.535 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.535 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6817", 2023-12-20T04:53:33.535 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:33.535 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.535 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.535 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.535 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6820", 2023-12-20T04:53:33.535 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:33.535 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.535 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.535 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.535 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:33.535 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.535 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.535 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.536 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6813", 2023-12-20T04:53:33.536 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:33.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.536 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.536 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.536 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6815", 2023-12-20T04:53:33.536 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84620 2023-12-20T04:53:33.536 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.536 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.536 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.536 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6805/84620", 2023-12-20T04:53:33.536 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6810/84620", 2023-12-20T04:53:33.536 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6820/84620", 2023-12-20T04:53:33.536 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6815/84620", 2023-12-20T04:53:33.536 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:33.536 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:33.537 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:33.537 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.537 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.537 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.537 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:53:33.537 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:33.537 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:33.537 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:33.537 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:33.537 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:33.537 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:33.537 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:33.537 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:33.537 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:33.537 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:33.537 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:33.538 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:33.538 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.538 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.538 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.538 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6806", 2023-12-20T04:53:33.538 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:33.538 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.538 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.538 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.538 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6809", 2023-12-20T04:53:33.538 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:33.538 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.538 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.539 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.539 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:33.539 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.539 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.539 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.539 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6812", 2023-12-20T04:53:33.539 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:33.539 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.539 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.539 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.539 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6816", 2023-12-20T04:53:33.539 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:33.539 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.539 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.540 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:33.540 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.540 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.540 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.540 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6822", 2023-12-20T04:53:33.540 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:33.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.540 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.540 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.540 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6823", 2023-12-20T04:53:33.540 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:33.540 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.540 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.540 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.540 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:33.541 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.541 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.541 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6819", 2023-12-20T04:53:33.541 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:33.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.541 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.541 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.541 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6821", 2023-12-20T04:53:33.541 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84619 2023-12-20T04:53:33.541 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.541 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.541 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.541 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6809/84619", 2023-12-20T04:53:33.541 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6816/84619", 2023-12-20T04:53:33.542 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6823/84619", 2023-12-20T04:53:33.542 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6821/84619", 2023-12-20T04:53:33.542 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:33.542 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:33.542 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:33.542 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.542 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.542 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.542 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:53:33.542 INFO:teuthology.orchestra.run.smithi132.stdout: "uuid": "00000000-0000-0000-0000-000000000000", 2023-12-20T04:53:33.542 INFO:teuthology.orchestra.run.smithi132.stdout: "up": 1, 2023-12-20T04:53:33.542 INFO:teuthology.orchestra.run.smithi132.stdout: "in": 1, 2023-12-20T04:53:33.542 INFO:teuthology.orchestra.run.smithi132.stdout: "weight": 1, 2023-12-20T04:53:33.542 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_affinity": 1, 2023-12-20T04:53:33.542 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_begin": 0, 2023-12-20T04:53:33.542 INFO:teuthology.orchestra.run.smithi132.stdout: "last_clean_end": 0, 2023-12-20T04:53:33.543 INFO:teuthology.orchestra.run.smithi132.stdout: "up_from": 13, 2023-12-20T04:53:33.543 INFO:teuthology.orchestra.run.smithi132.stdout: "up_thru": 184, 2023-12-20T04:53:33.543 INFO:teuthology.orchestra.run.smithi132.stdout: "down_at": 0, 2023-12-20T04:53:33.543 INFO:teuthology.orchestra.run.smithi132.stdout: "lost_at": 0, 2023-12-20T04:53:33.543 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addrs": { 2023-12-20T04:53:33.543 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.543 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.543 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.543 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6824", 2023-12-20T04:53:33.543 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:33.543 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.543 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.543 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.543 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6825", 2023-12-20T04:53:33.543 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:33.544 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.544 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.544 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addrs": { 2023-12-20T04:53:33.544 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.544 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.544 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.544 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6826", 2023-12-20T04:53:33.544 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:33.544 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.544 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.544 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.544 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6827", 2023-12-20T04:53:33.544 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:33.544 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.545 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.545 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.545 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addrs": { 2023-12-20T04:53:33.545 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.545 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.545 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.545 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6830", 2023-12-20T04:53:33.545 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:33.545 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.545 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.545 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.545 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6831", 2023-12-20T04:53:33.545 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:33.545 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.545 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.546 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addrs": { 2023-12-20T04:53:33.546 INFO:teuthology.orchestra.run.smithi132.stdout: "addrvec": [ 2023-12-20T04:53:33.546 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.546 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v2", 2023-12-20T04:53:33.546 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6828", 2023-12-20T04:53:33.546 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:33.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.546 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.546 INFO:teuthology.orchestra.run.smithi132.stdout: "type": "v1", 2023-12-20T04:53:33.546 INFO:teuthology.orchestra.run.smithi132.stdout: "addr": "172.21.15.187:6829", 2023-12-20T04:53:33.546 INFO:teuthology.orchestra.run.smithi132.stdout: "nonce": 84651 2023-12-20T04:53:33.546 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.546 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.546 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.546 INFO:teuthology.orchestra.run.smithi132.stdout: "public_addr": "172.21.15.187:6825/84651", 2023-12-20T04:53:33.547 INFO:teuthology.orchestra.run.smithi132.stdout: "cluster_addr": "172.21.15.187:6827/84651", 2023-12-20T04:53:33.547 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_back_addr": "172.21.15.187:6831/84651", 2023-12-20T04:53:33.547 INFO:teuthology.orchestra.run.smithi132.stdout: "heartbeat_front_addr": "172.21.15.187:6829/84651", 2023-12-20T04:53:33.547 INFO:teuthology.orchestra.run.smithi132.stdout: "state": [ 2023-12-20T04:53:33.547 INFO:teuthology.orchestra.run.smithi132.stdout: "exists", 2023-12-20T04:53:33.547 INFO:teuthology.orchestra.run.smithi132.stdout: "up" 2023-12-20T04:53:33.547 INFO:teuthology.orchestra.run.smithi132.stdout: ] 2023-12-20T04:53:33.547 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.547 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:33.547 INFO:teuthology.orchestra.run.smithi132.stdout: "osd_xinfo": [ 2023-12-20T04:53:33.547 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.547 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 0, 2023-12-20T04:53:33.547 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:33.547 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:33.547 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:33.547 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:33.547 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:33.548 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.719129+0000", 2023-12-20T04:53:33.548 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:33.548 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.548 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.548 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 1, 2023-12-20T04:53:33.548 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:33.548 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:33.548 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:33.548 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:33.548 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:33.548 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.774912+0000", 2023-12-20T04:53:33.548 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:33.548 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.548 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.548 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 2, 2023-12-20T04:53:33.549 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:33.549 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:33.549 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:33.549 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:33.549 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:33.549 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.821494+0000", 2023-12-20T04:53:33.549 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:33.549 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.549 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.549 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 3, 2023-12-20T04:53:33.549 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:33.549 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:33.549 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:33.549 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:33.549 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:33.549 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.792514+0000", 2023-12-20T04:53:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 4, 2023-12-20T04:53:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.804186+0000", 2023-12-20T04:53:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 5, 2023-12-20T04:53:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:33.550 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.805109+0000", 2023-12-20T04:53:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 6, 2023-12-20T04:53:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.825801+0000", 2023-12-20T04:53:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: { 2023-12-20T04:53:33.551 INFO:teuthology.orchestra.run.smithi132.stdout: "osd": 7, 2023-12-20T04:53:33.552 INFO:teuthology.orchestra.run.smithi132.stdout: "down_stamp": "0.000000", 2023-12-20T04:53:33.552 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_probability": 0, 2023-12-20T04:53:33.552 INFO:teuthology.orchestra.run.smithi132.stdout: "laggy_interval": 0, 2023-12-20T04:53:33.552 INFO:teuthology.orchestra.run.smithi132.stdout: "features": 4540138322906710015, 2023-12-20T04:53:33.552 INFO:teuthology.orchestra.run.smithi132.stdout: "old_weight": 0, 2023-12-20T04:53:33.552 INFO:teuthology.orchestra.run.smithi132.stdout: "last_purged_snaps_scrub": "2023-12-20T04:42:33.836291+0000", 2023-12-20T04:53:33.552 INFO:teuthology.orchestra.run.smithi132.stdout: "dead_epoch": 0 2023-12-20T04:53:33.552 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.552 INFO:teuthology.orchestra.run.smithi132.stdout: ], 2023-12-20T04:53:33.552 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap": [], 2023-12-20T04:53:33.552 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_items": [], 2023-12-20T04:53:33.552 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_upmap_primaries": [], 2023-12-20T04:53:33.552 INFO:teuthology.orchestra.run.smithi132.stdout: "pg_temp": [], 2023-12-20T04:53:33.552 INFO:teuthology.orchestra.run.smithi132.stdout: "primary_temp": [], 2023-12-20T04:53:33.552 INFO:teuthology.orchestra.run.smithi132.stdout: "blocklist": {}, 2023-12-20T04:53:33.552 INFO:teuthology.orchestra.run.smithi132.stdout: "range_blocklist": {}, 2023-12-20T04:53:33.553 INFO:teuthology.orchestra.run.smithi132.stdout: "erasure_code_profiles": { 2023-12-20T04:53:33.553 INFO:teuthology.orchestra.run.smithi132.stdout: "default": { 2023-12-20T04:53:33.553 INFO:teuthology.orchestra.run.smithi132.stdout: "crush-failure-domain": "osd", 2023-12-20T04:53:33.553 INFO:teuthology.orchestra.run.smithi132.stdout: "k": "2", 2023-12-20T04:53:33.553 INFO:teuthology.orchestra.run.smithi132.stdout: "m": "1", 2023-12-20T04:53:33.553 INFO:teuthology.orchestra.run.smithi132.stdout: "plugin": "jerasure", 2023-12-20T04:53:33.553 INFO:teuthology.orchestra.run.smithi132.stdout: "technique": "reed_sol_van" 2023-12-20T04:53:33.553 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.553 INFO:teuthology.orchestra.run.smithi132.stdout: }, 2023-12-20T04:53:33.553 INFO:teuthology.orchestra.run.smithi132.stdout: "removed_snaps_queue": [], 2023-12-20T04:53:33.553 INFO:teuthology.orchestra.run.smithi132.stdout: "new_removed_snaps": [], 2023-12-20T04:53:33.553 INFO:teuthology.orchestra.run.smithi132.stdout: "new_purged_snaps": [], 2023-12-20T04:53:33.553 INFO:teuthology.orchestra.run.smithi132.stdout: "crush_node_flags": {}, 2023-12-20T04:53:33.553 INFO:teuthology.orchestra.run.smithi132.stdout: "device_class_flags": {}, 2023-12-20T04:53:33.553 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode": { 2023-12-20T04:53:33.553 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_enabled": false, 2023-12-20T04:53:33.554 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_bucket_count": 0, 2023-12-20T04:53:33.554 INFO:teuthology.orchestra.run.smithi132.stdout: "degraded_stretch_mode": 0, 2023-12-20T04:53:33.554 INFO:teuthology.orchestra.run.smithi132.stdout: "recovering_stretch_mode": 0, 2023-12-20T04:53:33.554 INFO:teuthology.orchestra.run.smithi132.stdout: "stretch_mode_bucket": 0 2023-12-20T04:53:33.554 INFO:teuthology.orchestra.run.smithi132.stdout: } 2023-12-20T04:53:33.554 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:33.555 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.484+0000 7f7aaef16640 1 -- 172.21.15.132:0/469970991 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a9406a430 msgr2=0x7f7a9406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.484+0000 7f7aaef16640 1 --2- 172.21.15.132:0/469970991 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a9406a430 0x7f7a9406c8f0 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f7a98000f60 tx=0x7f7a98007bb0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.484+0000 7f7aaef16640 1 -- 172.21.15.132:0/469970991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7aa815e530 msgr2=0x7f7aa815b220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.484+0000 7f7aaef16640 1 --2- 172.21.15.132:0/469970991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7aa815e530 0x7f7aa815b220 secure :-1 s=READY pgs=1857 cs=0 l=1 rev1=1 crypto rx=0x7f7aa000c7a0 tx=0x7f7aa000cc60 comp rx=0 tx=0).stop 2023-12-20T04:53:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.484+0000 7f7aaef16640 1 -- 172.21.15.132:0/469970991 shutdown_connections 2023-12-20T04:53:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.484+0000 7f7aaef16640 1 --2- 172.21.15.132:0/469970991 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f7a9406a430 0x7f7a9406c8f0 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.484+0000 7f7aaef16640 1 --2- 172.21.15.132:0/469970991 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f7aa815e530 0x7f7aa815b220 unknown :-1 s=CLOSED pgs=1857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.484+0000 7f7aaef16640 1 --2- 172.21.15.132:0/469970991 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7aa8159b50 0x7f7aa80c4b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.484+0000 7f7aaef16640 1 --2- 172.21.15.132:0/469970991 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f7aa806c240 0x7f7aa814fcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.484+0000 7f7aaef16640 1 -- 172.21.15.132:0/469970991 >> 172.21.15.132:0/469970991 conn(0x7f7aa80ced10 msgr2=0x7f7aa80705b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.484+0000 7f7aaef16640 1 -- 172.21.15.132:0/469970991 shutdown_connections 2023-12-20T04:53:33.556 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.484+0000 7f7aaef16640 1 -- 172.21.15.132:0/469970991 wait complete. 2023-12-20T04:53:33.557 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:53:33.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.655+0000 7fe7ccaee640 1 Processor -- start 2023-12-20T04:53:33.657 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.655+0000 7fe7ccaee640 1 -- start start 2023-12-20T04:53:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.656+0000 7fe7ccaee640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fe7c806a340 0x7fe7c80708d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.656+0000 7fe7ccaee640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c8141660 con 0x7fe7c813df60 2023-12-20T04:53:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.656+0000 7fe7ccaee640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe7c8140ae0 con 0x7fe7c813e690 2023-12-20T04:53:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.656+0000 7fe7ccaee640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe7c8155a30 con 0x7fe7c806a340 2023-12-20T04:53:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.656+0000 7fe7c659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fe7c813df60 0x7fe7c80caa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33842/0 (socket says 172.21.15.132:33842) 2023-12-20T04:53:33.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.656+0000 7fe7c659c640 1 -- 172.21.15.132:0/3300585296 learned_addr learned my addr 172.21.15.132:0/3300585296 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.656+0000 7fe7c6d9d640 1 --2- 172.21.15.132:0/3300585296 >> v2:172.21.15.187:3300/0 conn(0x7fe7c806a340 0x7fe7c80708d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.656+0000 7fe7c5d9b640 1 -- 172.21.15.132:0/3300585296 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 878429804 0 0) 0x7fe7c8141660 con 0x7fe7c813df60 2023-12-20T04:53:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.656+0000 7fe7c5d9b640 1 -- 172.21.15.132:0/3300585296 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fe7b4003520 con 0x7fe7c813df60 2023-12-20T04:53:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.656+0000 7fe7c5d9b640 1 -- 172.21.15.132:0/3300585296 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1920147211 0 0) 0x7fe7b4003520 con 0x7fe7c813df60 2023-12-20T04:53:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.656+0000 7fe7c6d9d640 1 -- 172.21.15.132:0/3300585296 >> v1:172.21.15.187:6789/0 conn(0x7fe7c813e690 legacy=0x7fe7c8069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.656+0000 7fe7c6d9d640 1 -- 172.21.15.132:0/3300585296 >> v1:172.21.15.132:6789/0 conn(0x7fe7c813df60 legacy=0x7fe7c80caa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:33.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.656+0000 7fe7c6d9d640 1 -- 172.21.15.132:0/3300585296 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c8140dc0 con 0x7fe7c806a340 2023-12-20T04:53:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.657+0000 7fe7c6d9d640 1 --2- 172.21.15.132:0/3300585296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c806a340 0x7fe7c80708d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009d90 tx=0x7fe7c002bbe0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=36d30f8dd9f967f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.657+0000 7fe7c5d9b640 1 -- 172.21.15.132:0/3300585296 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7b80017f0 con 0x7fe7c806a340 2023-12-20T04:53:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.657+0000 7fe7c5d9b640 1 -- 172.21.15.132:0/3300585296 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c002d720 con 0x7fe7c806a340 2023-12-20T04:53:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.657+0000 7fe7c5d9b640 1 -- 172.21.15.132:0/3300585296 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c002dab0 con 0x7fe7c806a340 2023-12-20T04:53:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.658+0000 7fe7ccaee640 1 -- 172.21.15.132:0/3300585296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c806a340 msgr2=0x7fe7c80708d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:33.660 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.658+0000 7fe7ccaee640 1 --2- 172.21.15.132:0/3300585296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c806a340 0x7fe7c80708d0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009d90 tx=0x7fe7c002bbe0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.658+0000 7fe7ccaee640 1 -- 172.21.15.132:0/3300585296 shutdown_connections 2023-12-20T04:53:33.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.658+0000 7fe7ccaee640 1 --2- 172.21.15.132:0/3300585296 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c806a340 0x7fe7c80708d0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.658+0000 7fe7ccaee640 1 -- 172.21.15.132:0/3300585296 >> 172.21.15.132:0/3300585296 conn(0x7fe7c80cfbd0 msgr2=0x7fe7c80cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:33.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.658+0000 7fe7ccaee640 1 -- 172.21.15.132:0/3300585296 shutdown_connections 2023-12-20T04:53:33.661 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.658+0000 7fe7ccaee640 1 -- 172.21.15.132:0/3300585296 wait complete. 2023-12-20T04:53:33.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.659+0000 7fe7ccaee640 1 Processor -- start 2023-12-20T04:53:33.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.659+0000 7fe7ccaee640 1 -- start start 2023-12-20T04:53:33.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7ccaee640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7c806a340 0x7fe7c80c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:33.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7ccaee640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c813df60 0x7fe7c813d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:33.663 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7ccaee640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c813e690 0x7fe7c80ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7ccaee640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80c6e20 con 0x7fe7c813e690 2023-12-20T04:53:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7ccaee640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80c7100 con 0x7fe7c813df60 2023-12-20T04:53:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7ccaee640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe7c80c73e0 con 0x7fe7c806a340 2023-12-20T04:53:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7c6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c813e690 0x7fe7c80ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7c6d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c813e690 0x7fe7c80ce990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40944/0 (socket says 172.21.15.132:40944) 2023-12-20T04:53:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7c6d9d640 1 -- 172.21.15.132:0/3612473980 learned_addr learned my addr 172.21.15.132:0/3612473980 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7c659c640 1 --2- 172.21.15.132:0/3612473980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7c806a340 0x7fe7c80c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7bffff640 1 --2- 172.21.15.132:0/3612473980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c813df60 0x7fe7c813d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7c6d9d640 1 -- 172.21.15.132:0/3612473980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7c806a340 msgr2=0x7fe7c80c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7c6d9d640 1 --2- 172.21.15.132:0/3612473980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7c806a340 0x7fe7c80c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7c6d9d640 1 -- 172.21.15.132:0/3612473980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c813df60 msgr2=0x7fe7c813d480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7c6d9d640 1 --2- 172.21.15.132:0/3612473980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c813df60 0x7fe7c813d480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7c6d9d640 1 -- 172.21.15.132:0/3612473980 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7c0009a70 con 0x7fe7c813e690 2023-12-20T04:53:33.664 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7bffff640 1 --2- 172.21.15.132:0/3612473980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c813df60 0x7fe7c813d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.660+0000 7fe7c6d9d640 1 --2- 172.21.15.132:0/3612473980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c813e690 0x7fe7c80ce990 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009d90 tx=0x7fe7c0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.661+0000 7fe7beffd640 1 -- 172.21.15.132:0/3612473980 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c0035c60 con 0x7fe7c813e690 2023-12-20T04:53:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.661+0000 7fe7beffd640 1 -- 172.21.15.132:0/3612473980 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe7c0035dc0 con 0x7fe7c813e690 2023-12-20T04:53:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.661+0000 7fe7ccaee640 1 -- 172.21.15.132:0/3612473980 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7c80c76c0 con 0x7fe7c813e690 2023-12-20T04:53:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.661+0000 7fe7beffd640 1 -- 172.21.15.132:0/3612473980 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe7c003f670 con 0x7fe7c813e690 2023-12-20T04:53:33.665 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.661+0000 7fe7ccaee640 1 -- 172.21.15.132:0/3612473980 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7c80c8c30 con 0x7fe7c813e690 2023-12-20T04:53:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.662+0000 7fe7ccaee640 1 -- 172.21.15.132:0/3612473980 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7c804e840 con 0x7fe7c813e690 2023-12-20T04:53:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.662+0000 7fe7beffd640 1 -- 172.21.15.132:0/3612473980 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe7c003f7d0 con 0x7fe7c813e690 2023-12-20T04:53:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.662+0000 7fe7beffd640 1 --2- 172.21.15.132:0/3612473980 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe7a806a430 0x7fe7a806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.663+0000 7fe7beffd640 1 -- 172.21.15.132:0/3612473980 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fe7c0031070 con 0x7fe7c813e690 2023-12-20T04:53:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.663+0000 7fe7c659c640 1 --2- 172.21.15.132:0/3612473980 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe7a806a430 0x7fe7a806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:33.666 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.663+0000 7fe7c659c640 1 --2- 172.21.15.132:0/3612473980 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe7a806a430 0x7fe7a806c8f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8001eb0 tx=0x7fe7b8009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:33.669 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.667+0000 7fe7beffd640 1 -- 172.21.15.132:0/3612473980 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe7c0076e70 con 0x7fe7c813e690 2023-12-20T04:53:33.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.864+0000 7fe7ccaee640 1 -- 172.21.15.132:0/3612473980 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe7c80b15e0 con 0x7fe7c813e690 2023-12-20T04:53:33.866 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.864+0000 7fe7beffd640 1 -- 172.21.15.132:0/3612473980 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4722 (secure 0 0 0) 0x7fe7c007a490 con 0x7fe7c813e690 2023-12-20T04:53:33.867 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:33.867 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":70,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3443409957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3443409957},{"type":"v1","addr":"172.21.15.187:6833","nonce":3443409957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/321445180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":321445180},{"type":"v1","addr":"172.21.15.187:6835","nonce":321445180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1166803529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1166803529},{"type":"v1","addr":"172.21.15.132:6836","nonce":1166803529}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:53:04.838088+0000","modified":"2023-12-20T04:53:07.506024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9117":{"gid":9117,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/2356846201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2356846201},{"type":"v1","addr":"172.21.15.132:6837","nonce":2356846201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-20T04:53:33.867 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 70 2023-12-20T04:53:33.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.866+0000 7fe7ccaee640 1 -- 172.21.15.132:0/3612473980 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe7a806a430 msgr2=0x7fe7a806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:33.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.866+0000 7fe7ccaee640 1 --2- 172.21.15.132:0/3612473980 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe7a806a430 0x7fe7a806c8f0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7fe7b8001eb0 tx=0x7fe7b8009040 comp rx=0 tx=0).stop 2023-12-20T04:53:33.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.866+0000 7fe7ccaee640 1 -- 172.21.15.132:0/3612473980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c813e690 msgr2=0x7fe7c80ce990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:33.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.866+0000 7fe7ccaee640 1 --2- 172.21.15.132:0/3612473980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c813e690 0x7fe7c80ce990 secure :-1 s=READY pgs=1859 cs=0 l=1 rev1=1 crypto rx=0x7fe7c0009d90 tx=0x7fe7c0004a40 comp rx=0 tx=0).stop 2023-12-20T04:53:33.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.866+0000 7fe7ccaee640 1 -- 172.21.15.132:0/3612473980 shutdown_connections 2023-12-20T04:53:33.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.866+0000 7fe7ccaee640 1 --2- 172.21.15.132:0/3612473980 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe7a806a430 0x7fe7a806c8f0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.866+0000 7fe7ccaee640 1 --2- 172.21.15.132:0/3612473980 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe7c813e690 0x7fe7c80ce990 unknown :-1 s=CLOSED pgs=1859 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.866+0000 7fe7ccaee640 1 --2- 172.21.15.132:0/3612473980 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe7c813df60 0x7fe7c813d480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.866+0000 7fe7ccaee640 1 --2- 172.21.15.132:0/3612473980 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe7c806a340 0x7fe7c80c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:33.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.866+0000 7fe7ccaee640 1 -- 172.21.15.132:0/3612473980 >> 172.21.15.132:0/3612473980 conn(0x7fe7c80cfbd0 msgr2=0x7fe7c80c9ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:33.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.866+0000 7fe7ccaee640 1 -- 172.21.15.132:0/3612473980 shutdown_connections 2023-12-20T04:53:33.869 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:33.866+0000 7fe7ccaee640 1 -- 172.21.15.132:0/3612473980 wait complete. 2023-12-20T04:53:33.880 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 300 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mds.a.asok --format=json status 2023-12-20T04:53:33.997 INFO:teuthology.orchestra.run.smithi132.stdout:{"cluster_fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","whoami":0,"id":9117,"want_state":"up:active","state":"up:active","fs_name":"cephfs","rank_uptime":29.147496704000002,"mdsmap_epoch":70,"osdmap_epoch":189,"osdmap_epoch_barrier":188,"uptime":33.561590709000001} 2023-12-20T04:53:33.998 DEBUG:tasks.cephfs.filesystem:_json_asok output { "cluster_fsid": "b146884a-3712-4b4e-ac9f-636a781b2cda", "fs_name": "cephfs", "id": 9117, "mdsmap_epoch": 70, "osdmap_epoch": 189, "osdmap_epoch_barrier": 188, "rank_uptime": 29.147496704, "state": "up:active", "uptime": 33.561590709, "want_state": "up:active", "whoami": 0 } 2023-12-20T04:53:33.998 DEBUG:tasks.ceph_test_case:wait_until_true: success in 0s and 0 retries 2023-12-20T04:53:33.998 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:53:33.998 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:53:34.013 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:34.013 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest/mnt.0 && exec dd if=/dev/urandom of=large_file bs=1M conv=fdatasync count=50 seek=0) 2023-12-20T04:53:34.278 INFO:teuthology.orchestra.run.smithi132.stderr:50+0 records in 2023-12-20T04:53:34.278 INFO:teuthology.orchestra.run.smithi132.stderr:50+0 records out 2023-12-20T04:53:34.278 INFO:teuthology.orchestra.run.smithi132.stderr:52428800 bytes (52 MB, 50 MiB) copied, 0.20829 s, 252 MB/s 2023-12-20T04:53:34.278 INFO:teuthology.nuke.actions:Clearing teuthology firewall rules... 2023-12-20T04:53:34.278 DEBUG:teuthology.orchestra.run.smithi132:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:53:34.320 DEBUG:teuthology.orchestra.run.smithi187:> sudo sh -c 'iptables-save | grep -v teuthology | iptables-restore' 2023-12-20T04:53:34.368 INFO:teuthology.nuke.actions:Cleared teuthology firewall rules. 2023-12-20T04:53:34.368 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:53:34.368 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:53:34.383 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:53:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.522+0000 7f4d9159f640 1 Processor -- start 2023-12-20T04:53:34.524 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.522+0000 7f4d9159f640 1 -- start start 2023-12-20T04:53:34.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.522+0000 7f4d9159f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d8c160450 0x7f4d8c160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:34.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.522+0000 7f4d9159f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4d8c0b5090 0x7f4d8c0d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:34.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.522+0000 7f4d9159f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f4d8c0b5ec0 con 0x7f4d8c1611b0 2023-12-20T04:53:34.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.522+0000 7f4d9159f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f4d8c1617e0 con 0x7f4d8c0b5090 2023-12-20T04:53:34.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.522+0000 7f4d9159f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0d0fc0 con 0x7f4d8c160450 2023-12-20T04:53:34.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.523+0000 7f4d8b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4d8c0b5090 0x7f4d8c0d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:34.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.523+0000 7f4d8b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4d8c0b5090 0x7f4d8c0d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40948/0 (socket says 172.21.15.132:40948) 2023-12-20T04:53:34.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.523+0000 7f4d8b7fe640 1 -- 172.21.15.132:0/2696012737 learned_addr learned my addr 172.21.15.132:0/2696012737 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:34.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.523+0000 7f4d8b7fe640 1 -- 172.21.15.132:0/2696012737 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d8c160450 msgr2=0x7f4d8c160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:34.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.523+0000 7f4d8affd640 1 --2- 172.21.15.132:0/2696012737 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d8c160450 0x7f4d8c160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:34.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.523+0000 7f4d8b7fe640 1 --2- 172.21.15.132:0/2696012737 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d8c160450 0x7f4d8c160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:34.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.523+0000 7f4d8b7fe640 1 -- 172.21.15.132:0/2696012737 >> v1:172.21.15.187:6789/0 conn(0x7f4d8c1611b0 legacy=0x7f4d8c0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:34.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.523+0000 7f4d8b7fe640 1 -- 172.21.15.132:0/2696012737 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d8c0d12a0 con 0x7f4d8c0b5090 2023-12-20T04:53:34.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.523+0000 7f4d8affd640 1 --2- 172.21.15.132:0/2696012737 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d8c160450 0x7f4d8c160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:34.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.524+0000 7f4d8b7fe640 1 --2- 172.21.15.132:0/2696012737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d8c0b5090 0x7f4d8c0d1aa0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009e50 tx=0x7f4d8402bf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4191df739983fbbe server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:34.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.524+0000 7f4d89ffb640 1 -- 172.21.15.132:0/2696012737 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8402cb00 con 0x7f4d8c0b5090 2023-12-20T04:53:34.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.524+0000 7f4d89ffb640 1 -- 172.21.15.132:0/2696012737 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8402cc60 con 0x7f4d8c0b5090 2023-12-20T04:53:34.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.524+0000 7f4d89ffb640 1 -- 172.21.15.132:0/2696012737 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d840343f0 con 0x7f4d8c0b5090 2023-12-20T04:53:34.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.524+0000 7f4d9159f640 1 -- 172.21.15.132:0/2696012737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d8c0b5090 msgr2=0x7f4d8c0d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:34.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.524+0000 7f4d9159f640 1 --2- 172.21.15.132:0/2696012737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d8c0b5090 0x7f4d8c0d1aa0 secure :-1 s=READY pgs=1860 cs=0 l=1 rev1=1 crypto rx=0x7f4d84009e50 tx=0x7f4d8402bf60 comp rx=0 tx=0).stop 2023-12-20T04:53:34.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.524+0000 7f4d9159f640 1 -- 172.21.15.132:0/2696012737 shutdown_connections 2023-12-20T04:53:34.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.524+0000 7f4d9159f640 1 --2- 172.21.15.132:0/2696012737 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d8c0b5090 0x7f4d8c0d1aa0 unknown :-1 s=CLOSED pgs=1860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:34.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.524+0000 7f4d9159f640 1 --2- 172.21.15.132:0/2696012737 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d8c160450 0x7f4d8c160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:34.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.524+0000 7f4d9159f640 1 -- 172.21.15.132:0/2696012737 >> 172.21.15.132:0/2696012737 conn(0x7f4d8c0cf980 msgr2=0x7f4d8c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:34.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.524+0000 7f4d9159f640 1 -- 172.21.15.132:0/2696012737 shutdown_connections 2023-12-20T04:53:34.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.524+0000 7f4d9159f640 1 -- 172.21.15.132:0/2696012737 wait complete. 2023-12-20T04:53:34.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.526+0000 7f4d9159f640 1 Processor -- start 2023-12-20T04:53:34.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.526+0000 7f4d9159f640 1 -- start start 2023-12-20T04:53:34.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.526+0000 7f4d9159f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d8c0b5090 0x7f4d8c15b8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:34.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.526+0000 7f4d9159f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d8c160450 0x7f4d8c1f5fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:34.531 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.526+0000 7f4d9159f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d8c1611b0 0x7f4d8c1f6510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:34.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.526+0000 7f4d9159f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c0cd0b0 con 0x7f4d8c1611b0 2023-12-20T04:53:34.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.526+0000 7f4d9159f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c1f6e90 con 0x7f4d8c0b5090 2023-12-20T04:53:34.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.526+0000 7f4d9159f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f4d8c158710 con 0x7f4d8c160450 2023-12-20T04:53:34.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.526+0000 7f4d8b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d8c1611b0 0x7f4d8c1f6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:34.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.527+0000 7f4d8b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d8c1611b0 0x7f4d8c1f6510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40960/0 (socket says 172.21.15.132:40960) 2023-12-20T04:53:34.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.527+0000 7f4d8b7fe640 1 -- 172.21.15.132:0/2634415169 learned_addr learned my addr 172.21.15.132:0/2634415169 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:34.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.527+0000 7f4d8affd640 1 --2- 172.21.15.132:0/2634415169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d8c0b5090 0x7f4d8c15b8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:34.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.527+0000 7f4d8a7fc640 1 --2- 172.21.15.132:0/2634415169 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d8c160450 0x7f4d8c1f5fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:34.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.527+0000 7f4d8b7fe640 1 -- 172.21.15.132:0/2634415169 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d8c160450 msgr2=0x7f4d8c1f5fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:34.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.527+0000 7f4d8b7fe640 1 --2- 172.21.15.132:0/2634415169 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d8c160450 0x7f4d8c1f5fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:34.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.527+0000 7f4d8b7fe640 1 -- 172.21.15.132:0/2634415169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d8c0b5090 msgr2=0x7f4d8c15b8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:34.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.527+0000 7f4d8b7fe640 1 --2- 172.21.15.132:0/2634415169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d8c0b5090 0x7f4d8c15b8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:34.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.527+0000 7f4d8b7fe640 1 -- 172.21.15.132:0/2634415169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d84009b30 con 0x7f4d8c1611b0 2023-12-20T04:53:34.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.527+0000 7f4d8b7fe640 1 --2- 172.21.15.132:0/2634415169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d8c1611b0 0x7f4d8c1f6510 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f4d84036040 tx=0x7f4d84004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:34.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.527+0000 7f4d737fe640 1 -- 172.21.15.132:0/2634415169 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8403e450 con 0x7f4d8c1611b0 2023-12-20T04:53:34.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.527+0000 7f4d737fe640 1 -- 172.21.15.132:0/2634415169 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4d8403e5d0 con 0x7f4d8c1611b0 2023-12-20T04:53:34.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.527+0000 7f4d737fe640 1 -- 172.21.15.132:0/2634415169 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4d8403e980 con 0x7f4d8c1611b0 2023-12-20T04:53:34.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.527+0000 7f4d9159f640 1 -- 172.21.15.132:0/2634415169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d8c1f6bb0 con 0x7f4d8c1611b0 2023-12-20T04:53:34.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.527+0000 7f4d9159f640 1 -- 172.21.15.132:0/2634415169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d8c1583a0 con 0x7f4d8c1611b0 2023-12-20T04:53:34.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.528+0000 7f4d9159f640 1 -- 172.21.15.132:0/2634415169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d8c04e840 con 0x7f4d8c1611b0 2023-12-20T04:53:34.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.529+0000 7f4d737fe640 1 -- 172.21.15.132:0/2634415169 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4d8403eae0 con 0x7f4d8c1611b0 2023-12-20T04:53:34.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.529+0000 7f4d737fe640 1 --2- 172.21.15.132:0/2634415169 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d7806a430 0x7f4d7806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:34.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.529+0000 7f4d737fe640 1 -- 172.21.15.132:0/2634415169 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f4d840ab610 con 0x7f4d8c1611b0 2023-12-20T04:53:34.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.529+0000 7f4d8affd640 1 --2- 172.21.15.132:0/2634415169 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d7806a430 0x7f4d7806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:34.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.529+0000 7f4d8affd640 1 --2- 172.21.15.132:0/2634415169 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d7806a430 0x7f4d7806c8f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0d3ce0 tx=0x7f4d7c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:34.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.533+0000 7f4d737fe640 1 -- 172.21.15.132:0/2634415169 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4d84076d40 con 0x7f4d8c1611b0 2023-12-20T04:53:34.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.701+0000 7f4d9159f640 1 -- 172.21.15.132:0/2634415169 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4d8c0d0ad0 con 0x7f4d8c1611b0 2023-12-20T04:53:34.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.702+0000 7f4d737fe640 1 -- 172.21.15.132:0/2634415169 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+16159 (secure 0 0 0) 0x7f4d8407a360 con 0x7f4d8c1611b0 2023-12-20T04:53:34.704 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:34.704 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":189,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:53:29.910371+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:53:03.034230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-20T04:53:03.812892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:53:34.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.704+0000 7f4d9159f640 1 -- 172.21.15.132:0/2634415169 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d7806a430 msgr2=0x7f4d7806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:34.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.704+0000 7f4d9159f640 1 --2- 172.21.15.132:0/2634415169 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d7806a430 0x7f4d7806c8f0 secure :-1 s=READY pgs=780 cs=0 l=1 rev1=1 crypto rx=0x7f4d8c0d3ce0 tx=0x7f4d7c008040 comp rx=0 tx=0).stop 2023-12-20T04:53:34.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.704+0000 7f4d9159f640 1 -- 172.21.15.132:0/2634415169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d8c1611b0 msgr2=0x7f4d8c1f6510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:34.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.704+0000 7f4d9159f640 1 --2- 172.21.15.132:0/2634415169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d8c1611b0 0x7f4d8c1f6510 secure :-1 s=READY pgs=1861 cs=0 l=1 rev1=1 crypto rx=0x7f4d84036040 tx=0x7f4d84004a40 comp rx=0 tx=0).stop 2023-12-20T04:53:34.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.704+0000 7f4d9159f640 1 -- 172.21.15.132:0/2634415169 shutdown_connections 2023-12-20T04:53:34.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.704+0000 7f4d9159f640 1 --2- 172.21.15.132:0/2634415169 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f4d7806a430 0x7f4d7806c8f0 unknown :-1 s=CLOSED pgs=780 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:34.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.704+0000 7f4d9159f640 1 --2- 172.21.15.132:0/2634415169 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4d8c1611b0 0x7f4d8c1f6510 unknown :-1 s=CLOSED pgs=1861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:34.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.704+0000 7f4d9159f640 1 --2- 172.21.15.132:0/2634415169 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4d8c160450 0x7f4d8c1f5fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:34.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.704+0000 7f4d9159f640 1 --2- 172.21.15.132:0/2634415169 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4d8c0b5090 0x7f4d8c15b8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:34.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.704+0000 7f4d9159f640 1 -- 172.21.15.132:0/2634415169 >> 172.21.15.132:0/2634415169 conn(0x7f4d8c0cf980 msgr2=0x7f4d8c15eb40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:34.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.704+0000 7f4d9159f640 1 -- 172.21.15.132:0/2634415169 shutdown_connections 2023-12-20T04:53:34.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.704+0000 7f4d9159f640 1 -- 172.21.15.132:0/2634415169 wait complete. 2023-12-20T04:53:34.717 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:53:03.034230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '185', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:53:03.812892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '189', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:53:34.718 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:53:34.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.818+0000 7f796f621640 1 Processor -- start 2023-12-20T04:53:34.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.818+0000 7f796f621640 1 -- start start 2023-12-20T04:53:34.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.819+0000 7f796f621640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f796815d300 0x7f796806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:34.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.819+0000 7f796f621640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f79680cd4b0 0x7f79680cd920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:34.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.819+0000 7f796f621640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f796806cc90 con 0x7f796815cf20 2023-12-20T04:53:34.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.819+0000 7f796f621640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79680cde60 con 0x7f79680cd4b0 2023-12-20T04:53:34.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.819+0000 7f796f621640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f79680b2f30 con 0x7f796815d300 2023-12-20T04:53:34.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.819+0000 7f796dbbe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f79680cd4b0 0x7f79680cd920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:34.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.819+0000 7f796dbbe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f79680cd4b0 0x7f79680cd920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40968/0 (socket says 172.21.15.132:40968) 2023-12-20T04:53:34.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.819+0000 7f796dbbe640 1 -- 172.21.15.132:0/2264903970 learned_addr learned my addr 172.21.15.132:0/2264903970 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:34.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.819+0000 7f796cbbc640 1 --2- 172.21.15.132:0/2264903970 >> v2:172.21.15.187:3300/0 conn(0x7f796815d300 0x7f796806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:34.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.819+0000 7f796dbbe640 1 -- 172.21.15.132:0/2264903970 >> v2:172.21.15.187:3300/0 conn(0x7f796815d300 msgr2=0x7f796806c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:34.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.819+0000 7f796dbbe640 1 --2- 172.21.15.132:0/2264903970 >> v2:172.21.15.187:3300/0 conn(0x7f796815d300 0x7f796806c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:34.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.819+0000 7f796dbbe640 1 -- 172.21.15.132:0/2264903970 >> v1:172.21.15.187:6789/0 conn(0x7f796815cf20 legacy=0x7f7968161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:34.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.819+0000 7f796dbbe640 1 -- 172.21.15.132:0/2264903970 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f79680b3210 con 0x7f79680cd4b0 2023-12-20T04:53:34.822 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.819+0000 7f796cbbc640 1 --2- 172.21.15.132:0/2264903970 >> v2:172.21.15.187:3300/0 conn(0x7f796815d300 0x7f796806c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:34.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.820+0000 7f796dbbe640 1 --2- 172.21.15.132:0/2264903970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79680cd4b0 0x7f79680cd920 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f796806bd40 tx=0x7f796002bee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7367706b4aa7aae server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:34.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.820+0000 7f795ffff640 1 -- 172.21.15.132:0/2264903970 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796002ca80 con 0x7f79680cd4b0 2023-12-20T04:53:34.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.820+0000 7f795ffff640 1 -- 172.21.15.132:0/2264903970 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796002cbe0 con 0x7f79680cd4b0 2023-12-20T04:53:34.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.820+0000 7f795ffff640 1 -- 172.21.15.132:0/2264903970 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f79600343f0 con 0x7f79680cd4b0 2023-12-20T04:53:34.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.821+0000 7f796f621640 1 -- 172.21.15.132:0/2264903970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79680cd4b0 msgr2=0x7f79680cd920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:34.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.821+0000 7f796f621640 1 --2- 172.21.15.132:0/2264903970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79680cd4b0 0x7f79680cd920 secure :-1 s=READY pgs=1862 cs=0 l=1 rev1=1 crypto rx=0x7f796806bd40 tx=0x7f796002bee0 comp rx=0 tx=0).stop 2023-12-20T04:53:34.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.821+0000 7f796f621640 1 -- 172.21.15.132:0/2264903970 shutdown_connections 2023-12-20T04:53:34.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.821+0000 7f796f621640 1 --2- 172.21.15.132:0/2264903970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f79680cd4b0 0x7f79680cd920 unknown :-1 s=CLOSED pgs=1862 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:34.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.821+0000 7f796f621640 1 --2- 172.21.15.132:0/2264903970 >> v2:172.21.15.187:3300/0 conn(0x7f796815d300 0x7f796806c590 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:34.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.821+0000 7f796f621640 1 -- 172.21.15.132:0/2264903970 >> 172.21.15.132:0/2264903970 conn(0x7f7968072c60 msgr2=0x7f7968073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:34.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.821+0000 7f796f621640 1 -- 172.21.15.132:0/2264903970 shutdown_connections 2023-12-20T04:53:34.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.821+0000 7f796f621640 1 -- 172.21.15.132:0/2264903970 wait complete. 2023-12-20T04:53:34.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.822+0000 7f796f621640 1 Processor -- start 2023-12-20T04:53:34.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.822+0000 7f796f621640 1 -- start start 2023-12-20T04:53:34.827 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796f621640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79680cd4b0 0x7f796814e8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796f621640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f796815cf20 0x7f79680d0e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796f621640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f796815d300 0x7f796814dca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796f621640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79680b4b60 con 0x7f796815d300 2023-12-20T04:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796f621640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f79680b4e40 con 0x7f79680cd4b0 2023-12-20T04:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796f621640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f79680b5120 con 0x7f796815cf20 2023-12-20T04:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796dbbe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f796815d300 0x7f796814dca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796dbbe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f796815d300 0x7f796814dca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40972/0 (socket says 172.21.15.132:40972) 2023-12-20T04:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796dbbe640 1 -- 172.21.15.132:0/1462439214 learned_addr learned my addr 172.21.15.132:0/1462439214 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796cbbc640 1 --2- 172.21.15.132:0/1462439214 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f796815cf20 0x7f79680d0e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796d3bd640 1 --2- 172.21.15.132:0/1462439214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79680cd4b0 0x7f796814e8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796dbbe640 1 -- 172.21.15.132:0/1462439214 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f796815cf20 msgr2=0x7f79680d0e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796dbbe640 1 --2- 172.21.15.132:0/1462439214 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f796815cf20 0x7f79680d0e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796dbbe640 1 -- 172.21.15.132:0/1462439214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79680cd4b0 msgr2=0x7f796814e8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796dbbe640 1 --2- 172.21.15.132:0/1462439214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79680cd4b0 0x7f796814e8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:34.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796dbbe640 1 -- 172.21.15.132:0/1462439214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7960009b30 con 0x7f796815d300 2023-12-20T04:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796dbbe640 1 --2- 172.21.15.132:0/1462439214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f796815d300 0x7f796814dca0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f7960036040 tx=0x7f7960004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f795dffb640 1 -- 172.21.15.132:0/1462439214 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796003e450 con 0x7f796815d300 2023-12-20T04:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f795dffb640 1 -- 172.21.15.132:0/1462439214 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f796003e5d0 con 0x7f796815d300 2023-12-20T04:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796f621640 1 -- 172.21.15.132:0/1462439214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f79680b5400 con 0x7f796815d300 2023-12-20T04:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f795dffb640 1 -- 172.21.15.132:0/1462439214 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f796003e980 con 0x7f796815d300 2023-12-20T04:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.823+0000 7f796f621640 1 -- 172.21.15.132:0/1462439214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f796814ee30 con 0x7f796815d300 2023-12-20T04:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.824+0000 7f796f621640 1 -- 172.21.15.132:0/1462439214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f79680b5920 con 0x7f796815d300 2023-12-20T04:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.825+0000 7f795dffb640 1 -- 172.21.15.132:0/1462439214 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f796002cd50 con 0x7f796815d300 2023-12-20T04:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.825+0000 7f795dffb640 1 --2- 172.21.15.132:0/1462439214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f794c06a460 0x7f794c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.825+0000 7f795dffb640 1 -- 172.21.15.132:0/1462439214 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f79600ab240 con 0x7f796815d300 2023-12-20T04:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.825+0000 7f796d3bd640 1 --2- 172.21.15.132:0/1462439214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f794c06a460 0x7f794c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:34.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.826+0000 7f796d3bd640 1 --2- 172.21.15.132:0/1462439214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f794c06a460 0x7f794c06c920 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7964007fd0 tx=0x7f7964009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:34.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.829+0000 7f795dffb640 1 -- 172.21.15.132:0/1462439214 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f79680b5920 con 0x7f796815d300 2023-12-20T04:53:34.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.996+0000 7f796f621640 1 -- 172.21.15.132:0/1462439214 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f79680b5920 con 0x7f796815d300 2023-12-20T04:53:34.999 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.997+0000 7f795dffb640 1 -- 172.21.15.132:0/1462439214 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v189) v1 ==== 93+0+10 (secure 0 0 0) 0x7f79680b5920 con 0x7f796815d300 2023-12-20T04:53:34.999 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:53:35.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.999+0000 7f796f621640 1 -- 172.21.15.132:0/1462439214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f794c06a460 msgr2=0x7f794c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.999+0000 7f796f621640 1 --2- 172.21.15.132:0/1462439214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f794c06a460 0x7f794c06c920 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f7964007fd0 tx=0x7f7964009040 comp rx=0 tx=0).stop 2023-12-20T04:53:35.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.999+0000 7f796f621640 1 -- 172.21.15.132:0/1462439214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f796815d300 msgr2=0x7f796814dca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.999+0000 7f796f621640 1 --2- 172.21.15.132:0/1462439214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f796815d300 0x7f796814dca0 secure :-1 s=READY pgs=1863 cs=0 l=1 rev1=1 crypto rx=0x7f7960036040 tx=0x7f7960004a40 comp rx=0 tx=0).stop 2023-12-20T04:53:35.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.999+0000 7f796f621640 1 -- 172.21.15.132:0/1462439214 shutdown_connections 2023-12-20T04:53:35.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.999+0000 7f796f621640 1 --2- 172.21.15.132:0/1462439214 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f794c06a460 0x7f794c06c920 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.999+0000 7f796f621640 1 --2- 172.21.15.132:0/1462439214 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f796815d300 0x7f796814dca0 unknown :-1 s=CLOSED pgs=1863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.999+0000 7f796f621640 1 --2- 172.21.15.132:0/1462439214 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f796815cf20 0x7f79680d0e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.999+0000 7f796f621640 1 --2- 172.21.15.132:0/1462439214 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f79680cd4b0 0x7f796814e8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.999+0000 7f796f621640 1 -- 172.21.15.132:0/1462439214 >> 172.21.15.132:0/1462439214 conn(0x7f7968072c60 msgr2=0x7f79680b20b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:35.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.999+0000 7f796f621640 1 -- 172.21.15.132:0/1462439214 shutdown_connections 2023-12-20T04:53:35.002 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:34.999+0000 7f796f621640 1 -- 172.21.15.132:0/1462439214 wait complete. 2023-12-20T04:53:35.012 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:53:35.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.111+0000 7f5b1348f640 1 Processor -- start 2023-12-20T04:53:35.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.112+0000 7f5b1348f640 1 -- start start 2023-12-20T04:53:35.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.112+0000 7f5b1348f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b0c0cfc40 0x7f5b0c0b6790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.112+0000 7f5b1348f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0c0d2920 con 0x7f5b0c0cf790 2023-12-20T04:53:35.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.112+0000 7f5b1348f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5b0c0d1d10 con 0x7f5b0c15d300 2023-12-20T04:53:35.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.112+0000 7f5b1348f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0d1ff0 con 0x7f5b0c0cfc40 2023-12-20T04:53:35.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b10a2a640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5b0c0cf790 0x7f5b0c0b6080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33850/0 (socket says 172.21.15.132:33850) 2023-12-20T04:53:35.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b10a2a640 1 -- 172.21.15.132:0/938277871 learned_addr learned my addr 172.21.15.132:0/938277871 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:35.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b03fff640 1 -- 172.21.15.132:0/938277871 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3163984537 0 0) 0x7f5b0c0d2920 con 0x7f5b0c0cf790 2023-12-20T04:53:35.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b03fff640 1 -- 172.21.15.132:0/938277871 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5af8003520 con 0x7f5b0c0cf790 2023-12-20T04:53:35.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b11a2c640 1 --2- 172.21.15.132:0/938277871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b0c0cfc40 0x7f5b0c0b6790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b03fff640 1 -- 172.21.15.132:0/938277871 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 290579500 0 0) 0x7f5af8003520 con 0x7f5b0c0cf790 2023-12-20T04:53:35.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b03fff640 1 -- 172.21.15.132:0/938277871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b0c0cfc40 msgr2=0x7f5b0c0b6790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:35.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b03fff640 1 --2- 172.21.15.132:0/938277871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b0c0cfc40 0x7f5b0c0b6790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b03fff640 1 -- 172.21.15.132:0/938277871 >> v1:172.21.15.187:6789/0 conn(0x7f5b0c15d300 legacy=0x7f5b0c0d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b03fff640 1 -- 172.21.15.132:0/938277871 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c0d22d0 con 0x7f5b0c0cf790 2023-12-20T04:53:35.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b03fff640 1 -- 172.21.15.132:0/938277871 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f5b08001670 con 0x7f5b0c0cf790 2023-12-20T04:53:35.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b03fff640 1 -- 172.21.15.132:0/938277871 >> v1:172.21.15.132:6789/0 conn(0x7f5b0c0cf790 legacy=0x7f5b0c0b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b03fff640 1 --2- 172.21.15.132:0/938277871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b0c0cfc40 0x7f5af80039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b03fff640 1 --2- 172.21.15.132:0/938277871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5af8003f20 0x7f5af80047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b03fff640 1 --2- 172.21.15.132:0/938277871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5af8004d00 0x7f5af8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b03fff640 1 -- 172.21.15.132:0/938277871 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0d1ff0 con 0x7f5af8003f20 2023-12-20T04:53:35.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b03fff640 1 -- 172.21.15.132:0/938277871 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5af800ba60 con 0x7f5af8004d00 2023-12-20T04:53:35.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b03fff640 1 -- 172.21.15.132:0/938277871 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5af800bc20 con 0x7f5b0c0cfc40 2023-12-20T04:53:35.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b10a2a640 1 --2- 172.21.15.132:0/938277871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5af8003f20 0x7f5af80047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b1122b640 1 --2- 172.21.15.132:0/938277871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b0c0cfc40 0x7f5af80039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.113+0000 7f5b11a2c640 1 --2- 172.21.15.132:0/938277871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5af8004d00 0x7f5af8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.114+0000 7f5b10a2a640 1 -- 172.21.15.132:0/938277871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b0c0cfc40 msgr2=0x7f5af80039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:35.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.114+0000 7f5b10a2a640 1 --2- 172.21.15.132:0/938277871 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b0c0cfc40 0x7f5af80039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.114+0000 7f5b10a2a640 1 -- 172.21.15.132:0/938277871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5af8004d00 msgr2=0x7f5af8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:35.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.114+0000 7f5b10a2a640 1 --2- 172.21.15.132:0/938277871 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5af8004d00 0x7f5af8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.114+0000 7f5b10a2a640 1 -- 172.21.15.132:0/938277871 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5af8003520 con 0x7f5af8003f20 2023-12-20T04:53:35.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.114+0000 7f5b10a2a640 1 --2- 172.21.15.132:0/938277871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5af8003f20 0x7f5af80047c0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800c240 tx=0x7f5af80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e7fa8652412fec7 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:35.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.114+0000 7f5b03fff640 1 -- 172.21.15.132:0/938277871 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b08005ad0 con 0x7f5af8003f20 2023-12-20T04:53:35.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.114+0000 7f5b03fff640 1 -- 172.21.15.132:0/938277871 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b08005c30 con 0x7f5af8003f20 2023-12-20T04:53:35.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.114+0000 7f5b03fff640 1 -- 172.21.15.132:0/938277871 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0802caf0 con 0x7f5af8003f20 2023-12-20T04:53:35.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.115+0000 7f5b1348f640 1 -- 172.21.15.132:0/938277871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5af8003f20 msgr2=0x7f5af80047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.115+0000 7f5b1348f640 1 --2- 172.21.15.132:0/938277871 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5af8003f20 0x7f5af80047c0 secure :-1 s=READY pgs=1865 cs=0 l=1 rev1=1 crypto rx=0x7f5b0800c240 tx=0x7f5af80057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.115+0000 7f5b11a2c640 1 -- 172.21.15.132:0/938277871 reap_dead start 2023-12-20T04:53:35.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.115+0000 7f5b1348f640 1 -- 172.21.15.132:0/938277871 shutdown_connections 2023-12-20T04:53:35.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.115+0000 7f5b1348f640 1 -- 172.21.15.132:0/938277871 >> 172.21.15.132:0/938277871 conn(0x7f5b0c06a3d0 msgr2=0x7f5b0c06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:35.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.115+0000 7f5b1348f640 1 -- 172.21.15.132:0/938277871 shutdown_connections 2023-12-20T04:53:35.120 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.115+0000 7f5b1348f640 1 -- 172.21.15.132:0/938277871 wait complete. 2023-12-20T04:53:35.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.116+0000 7f5b1348f640 1 Processor -- start 2023-12-20T04:53:35.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.116+0000 7f5b1348f640 1 -- start start 2023-12-20T04:53:35.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b1348f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5af8003f20 0x7f5b0c0b3400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b1348f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b0c152ec0 0x7f5b0c0b40d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b1348f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b0c1e69d0 0x7f5b0c1e6e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b1348f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c1e73c0 con 0x7f5b0c1e69d0 2023-12-20T04:53:35.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b1348f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c153340 con 0x7f5af8003f20 2023-12-20T04:53:35.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b1348f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5b0c0b49e0 con 0x7f5b0c152ec0 2023-12-20T04:53:35.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b11a2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b0c1e69d0 0x7f5b0c1e6e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b11a2c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b0c1e69d0 0x7f5b0c1e6e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:40984/0 (socket says 172.21.15.132:40984) 2023-12-20T04:53:35.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b11a2c640 1 -- 172.21.15.132:0/1715625477 learned_addr learned my addr 172.21.15.132:0/1715625477 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:35.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b1122b640 1 --2- 172.21.15.132:0/1715625477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5af8003f20 0x7f5b0c0b3400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.123 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b11a2c640 1 -- 172.21.15.132:0/1715625477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b0c152ec0 msgr2=0x7f5b0c0b40d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b10a2a640 1 --2- 172.21.15.132:0/1715625477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b0c152ec0 0x7f5b0c0b40d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b11a2c640 1 --2- 172.21.15.132:0/1715625477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b0c152ec0 0x7f5b0c0b40d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b11a2c640 1 -- 172.21.15.132:0/1715625477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5af8003f20 msgr2=0x7f5b0c0b3400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b11a2c640 1 --2- 172.21.15.132:0/1715625477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5af8003f20 0x7f5b0c0b3400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b11a2c640 1 -- 172.21.15.132:0/1715625477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b0c0b4cc0 con 0x7f5b0c1e69d0 2023-12-20T04:53:35.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b1122b640 1 --2- 172.21.15.132:0/1715625477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5af8003f20 0x7f5b0c0b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:35.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b10a2a640 1 --2- 172.21.15.132:0/1715625477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b0c152ec0 0x7f5b0c0b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:35.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.117+0000 7f5b11a2c640 1 --2- 172.21.15.132:0/1715625477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b0c1e69d0 0x7f5b0c1e6e80 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0b8fe0 tx=0x7f5b0400f580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:35.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.118+0000 7f5b01ffb640 1 -- 172.21.15.132:0/1715625477 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b0400e040 con 0x7f5b0c1e69d0 2023-12-20T04:53:35.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.118+0000 7f5b01ffb640 1 -- 172.21.15.132:0/1715625477 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5b0400f040 con 0x7f5b0c1e69d0 2023-12-20T04:53:35.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.118+0000 7f5b1348f640 1 -- 172.21.15.132:0/1715625477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b0c0b4fa0 con 0x7f5b0c1e69d0 2023-12-20T04:53:35.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.118+0000 7f5b01ffb640 1 -- 172.21.15.132:0/1715625477 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5b04015430 con 0x7f5b0c1e69d0 2023-12-20T04:53:35.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.118+0000 7f5b1348f640 1 -- 172.21.15.132:0/1715625477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b0c0c6860 con 0x7f5b0c1e69d0 2023-12-20T04:53:35.124 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.119+0000 7f5b1348f640 1 -- 172.21.15.132:0/1715625477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b0c0c6a80 con 0x7f5b0c1e69d0 2023-12-20T04:53:35.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.119+0000 7f5b01ffb640 1 -- 172.21.15.132:0/1715625477 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5b04015590 con 0x7f5b0c1e69d0 2023-12-20T04:53:35.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.120+0000 7f5b01ffb640 1 --2- 172.21.15.132:0/1715625477 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5af006a430 0x7f5af006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.120+0000 7f5b01ffb640 1 -- 172.21.15.132:0/1715625477 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f5b04089320 con 0x7f5b0c1e69d0 2023-12-20T04:53:35.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.120+0000 7f5b1122b640 1 --2- 172.21.15.132:0/1715625477 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5af006a430 0x7f5af006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.120+0000 7f5b1122b640 1 --2- 172.21.15.132:0/1715625477 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5af006a430 0x7f5af006c8f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0035f0 tx=0x7f5afc009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:35.126 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.124+0000 7f5b01ffb640 1 -- 172.21.15.132:0/1715625477 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5b040549a0 con 0x7f5b0c1e69d0 2023-12-20T04:53:35.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.292+0000 7f5b1348f640 1 -- 172.21.15.132:0/1715625477 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f5b0c04e840 con 0x7f5b0c1e69d0 2023-12-20T04:53:35.294 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.292+0000 7f5b01ffb640 1 -- 172.21.15.132:0/1715625477 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v189) v1 ==== 104+0+11 (secure 0 0 0) 0x7f5b04057fc0 con 0x7f5b0c1e69d0 2023-12-20T04:53:35.294 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:53:35.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.294+0000 7f5b1348f640 1 -- 172.21.15.132:0/1715625477 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5af006a430 msgr2=0x7f5af006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.294+0000 7f5b1348f640 1 --2- 172.21.15.132:0/1715625477 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5af006a430 0x7f5af006c8f0 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f5afc0035f0 tx=0x7f5afc009040 comp rx=0 tx=0).stop 2023-12-20T04:53:35.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.294+0000 7f5b1348f640 1 -- 172.21.15.132:0/1715625477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b0c1e69d0 msgr2=0x7f5b0c1e6e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.294+0000 7f5b1348f640 1 --2- 172.21.15.132:0/1715625477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b0c1e69d0 0x7f5b0c1e6e80 secure :-1 s=READY pgs=1866 cs=0 l=1 rev1=1 crypto rx=0x7f5b0c0b8fe0 tx=0x7f5b0400f580 comp rx=0 tx=0).stop 2023-12-20T04:53:35.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.295+0000 7f5b1348f640 1 -- 172.21.15.132:0/1715625477 shutdown_connections 2023-12-20T04:53:35.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.295+0000 7f5b1348f640 1 --2- 172.21.15.132:0/1715625477 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5af006a430 0x7f5af006c8f0 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.295+0000 7f5b1348f640 1 --2- 172.21.15.132:0/1715625477 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5b0c1e69d0 0x7f5b0c1e6e80 unknown :-1 s=CLOSED pgs=1866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.297 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.295+0000 7f5b1348f640 1 --2- 172.21.15.132:0/1715625477 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5b0c152ec0 0x7f5b0c0b40d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.295+0000 7f5b1348f640 1 --2- 172.21.15.132:0/1715625477 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5af8003f20 0x7f5b0c0b3400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.295+0000 7f5b1348f640 1 -- 172.21.15.132:0/1715625477 >> 172.21.15.132:0/1715625477 conn(0x7f5b0c06a3d0 msgr2=0x7f5b0c1e7d90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:35.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.295+0000 7f5b1348f640 1 -- 172.21.15.132:0/1715625477 shutdown_connections 2023-12-20T04:53:35.298 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.295+0000 7f5b1348f640 1 -- 172.21.15.132:0/1715625477 wait complete. 2023-12-20T04:53:35.307 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:53:35.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.409+0000 7fc960b99640 1 Processor -- start 2023-12-20T04:53:35.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.409+0000 7fc960b99640 1 -- start start 2023-12-20T04:53:35.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.410+0000 7fc960b99640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc95c143610 0x7fc95c0caa40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.410+0000 7fc960b99640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc95c0cd950 0x7fc95c06b450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.410+0000 7fc960b99640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc95c1439f0 con 0x7fc95c0c41f0 2023-12-20T04:53:35.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.410+0000 7fc960b99640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc95c0c46f0 con 0x7fc95c0cd950 2023-12-20T04:53:35.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.410+0000 7fc960b99640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc95c0c49d0 con 0x7fc95c143610 2023-12-20T04:53:35.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.410+0000 7fc95ad9d640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc95c0cd950 0x7fc95c06b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.410+0000 7fc953fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc95c0c41f0 0x7fc95c0cd240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33860/0 (socket says 172.21.15.132:33860) 2023-12-20T04:53:35.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.410+0000 7fc953fff640 1 -- 172.21.15.132:0/4234856873 learned_addr learned my addr 172.21.15.132:0/4234856873 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:35.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.410+0000 7fc95ad9d640 1 -- 172.21.15.132:0/4234856873 >> v2:172.21.15.187:3300/0 conn(0x7fc95c143610 msgr2=0x7fc95c0caa40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:35.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.410+0000 7fc95ad9d640 1 --2- 172.21.15.132:0/4234856873 >> v2:172.21.15.187:3300/0 conn(0x7fc95c143610 0x7fc95c0caa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.410+0000 7fc95ad9d640 1 -- 172.21.15.132:0/4234856873 >> v1:172.21.15.132:6789/0 conn(0x7fc95c0c41f0 legacy=0x7fc95c0cd240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.410+0000 7fc95ad9d640 1 -- 172.21.15.132:0/4234856873 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc95c0c4cb0 con 0x7fc95c0cd950 2023-12-20T04:53:35.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.410+0000 7fc959d9b640 1 -- 172.21.15.132:0/4234856873 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1779627116 0 0) 0x7fc95c1439f0 con 0x7fc95c0c41f0 2023-12-20T04:53:35.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.411+0000 7fc95ad9d640 1 --2- 172.21.15.132:0/4234856873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc95c0cd950 0x7fc95c06b450 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0b17d0 tx=0x7fc95402bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d53005f2b2f07c69 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:35.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.411+0000 7fc959d9b640 1 -- 172.21.15.132:0/4234856873 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc95402cc80 con 0x7fc95c0cd950 2023-12-20T04:53:35.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.411+0000 7fc959d9b640 1 -- 172.21.15.132:0/4234856873 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc95402cde0 con 0x7fc95c0cd950 2023-12-20T04:53:35.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.411+0000 7fc959d9b640 1 -- 172.21.15.132:0/4234856873 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954034660 con 0x7fc95c0cd950 2023-12-20T04:53:35.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.411+0000 7fc960b99640 1 -- 172.21.15.132:0/4234856873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc95c0cd950 msgr2=0x7fc95c06b450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.411+0000 7fc960b99640 1 --2- 172.21.15.132:0/4234856873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc95c0cd950 0x7fc95c06b450 secure :-1 s=READY pgs=1868 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0b17d0 tx=0x7fc95402bed0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.411+0000 7fc960b99640 1 -- 172.21.15.132:0/4234856873 shutdown_connections 2023-12-20T04:53:35.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.411+0000 7fc960b99640 1 --2- 172.21.15.132:0/4234856873 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc95c0cd950 0x7fc95c06b450 unknown :-1 s=CLOSED pgs=1868 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.411+0000 7fc960b99640 1 --2- 172.21.15.132:0/4234856873 >> v2:172.21.15.187:3300/0 conn(0x7fc95c143610 0x7fc95c0caa40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.411+0000 7fc960b99640 1 -- 172.21.15.132:0/4234856873 >> 172.21.15.132:0/4234856873 conn(0x7fc95c06a260 msgr2=0x7fc95c0b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:35.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.412+0000 7fc960b99640 1 -- 172.21.15.132:0/4234856873 shutdown_connections 2023-12-20T04:53:35.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.412+0000 7fc960b99640 1 -- 172.21.15.132:0/4234856873 wait complete. 2023-12-20T04:53:35.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.413+0000 7fc960b99640 1 Processor -- start 2023-12-20T04:53:35.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.413+0000 7fc960b99640 1 -- start start 2023-12-20T04:53:35.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.413+0000 7fc960b99640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc95c0c41f0 0x7fc95c1f1fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc960b99640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc95c0cd950 0x7fc95c0adb10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc960b99640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc95c143610 0x7fc95c070a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc960b99640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c1f2510 con 0x7fc95c143610 2023-12-20T04:53:35.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc960b99640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c0aca70 con 0x7fc95c0cd950 2023-12-20T04:53:35.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc960b99640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc95c0acd50 con 0x7fc95c0c41f0 2023-12-20T04:53:35.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc95ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc95c143610 0x7fc95c070a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc95ad9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc95c143610 0x7fc95c070a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41004/0 (socket says 172.21.15.132:41004) 2023-12-20T04:53:35.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc95ad9d640 1 -- 172.21.15.132:0/4044421998 learned_addr learned my addr 172.21.15.132:0/4044421998 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:35.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc95a59c640 1 --2- 172.21.15.132:0/4044421998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc95c0c41f0 0x7fc95c1f1fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc953fff640 1 --2- 172.21.15.132:0/4044421998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc95c0cd950 0x7fc95c0adb10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc95ad9d640 1 -- 172.21.15.132:0/4044421998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc95c0c41f0 msgr2=0x7fc95c1f1fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc95ad9d640 1 --2- 172.21.15.132:0/4044421998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc95c0c41f0 0x7fc95c1f1fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc95ad9d640 1 -- 172.21.15.132:0/4044421998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc95c0cd950 msgr2=0x7fc95c0adb10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc95ad9d640 1 --2- 172.21.15.132:0/4044421998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc95c0cd950 0x7fc95c0adb10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc95ad9d640 1 -- 172.21.15.132:0/4044421998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc954009a70 con 0x7fc95c143610 2023-12-20T04:53:35.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc95a59c640 1 --2- 172.21.15.132:0/4044421998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc95c0c41f0 0x7fc95c1f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:35.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc953fff640 1 --2- 172.21.15.132:0/4044421998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc95c0cd950 0x7fc95c0adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:35.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc95ad9d640 1 --2- 172.21.15.132:0/4044421998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc95c143610 0x7fc95c070a90 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fc95402c4e0 tx=0x7fc954004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:35.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc952ffd640 1 -- 172.21.15.132:0/4044421998 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954003990 con 0x7fc95c143610 2023-12-20T04:53:35.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc952ffd640 1 -- 172.21.15.132:0/4044421998 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc954003af0 con 0x7fc95c143610 2023-12-20T04:53:35.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc960b99640 1 -- 172.21.15.132:0/4044421998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc95c0ad030 con 0x7fc95c143610 2023-12-20T04:53:35.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc952ffd640 1 -- 172.21.15.132:0/4044421998 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc954003e80 con 0x7fc95c143610 2023-12-20T04:53:35.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.414+0000 7fc960b99640 1 -- 172.21.15.132:0/4044421998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc95c0ad5f0 con 0x7fc95c143610 2023-12-20T04:53:35.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.415+0000 7fc960b99640 1 -- 172.21.15.132:0/4044421998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc95c0ad810 con 0x7fc95c143610 2023-12-20T04:53:35.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.416+0000 7fc952ffd640 1 -- 172.21.15.132:0/4044421998 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc954004000 con 0x7fc95c143610 2023-12-20T04:53:35.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.416+0000 7fc952ffd640 1 --2- 172.21.15.132:0/4044421998 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc93c06a430 0x7fc93c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.416+0000 7fc952ffd640 1 -- 172.21.15.132:0/4044421998 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fc9540ab820 con 0x7fc95c143610 2023-12-20T04:53:35.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.416+0000 7fc95a59c640 1 --2- 172.21.15.132:0/4044421998 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc93c06a430 0x7fc93c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.417+0000 7fc95a59c640 1 --2- 172.21.15.132:0/4044421998 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc93c06a430 0x7fc93c06c8f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0b44b0 tx=0x7fc94c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:35.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.420+0000 7fc952ffd640 1 -- 172.21.15.132:0/4044421998 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc954076fc0 con 0x7fc95c143610 2023-12-20T04:53:35.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.587+0000 7fc960b99640 1 -- 172.21.15.132:0/4044421998 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fc95c04e840 con 0x7fc95c143610 2023-12-20T04:53:35.589 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.587+0000 7fc952ffd640 1 -- 172.21.15.132:0/4044421998 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v189) v1 ==== 100+0+11 (secure 0 0 0) 0x7fc954039020 con 0x7fc95c143610 2023-12-20T04:53:35.589 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:53:35.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.589+0000 7fc960b99640 1 -- 172.21.15.132:0/4044421998 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc93c06a430 msgr2=0x7fc93c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.589+0000 7fc960b99640 1 --2- 172.21.15.132:0/4044421998 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc93c06a430 0x7fc93c06c8f0 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7fc95c0b44b0 tx=0x7fc94c008040 comp rx=0 tx=0).stop 2023-12-20T04:53:35.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.589+0000 7fc960b99640 1 -- 172.21.15.132:0/4044421998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc95c143610 msgr2=0x7fc95c070a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.589+0000 7fc960b99640 1 --2- 172.21.15.132:0/4044421998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc95c143610 0x7fc95c070a90 secure :-1 s=READY pgs=1869 cs=0 l=1 rev1=1 crypto rx=0x7fc95402c4e0 tx=0x7fc954004a40 comp rx=0 tx=0).stop 2023-12-20T04:53:35.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.589+0000 7fc960b99640 1 -- 172.21.15.132:0/4044421998 shutdown_connections 2023-12-20T04:53:35.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.589+0000 7fc960b99640 1 --2- 172.21.15.132:0/4044421998 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc93c06a430 0x7fc93c06c8f0 unknown :-1 s=CLOSED pgs=783 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.591 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.589+0000 7fc960b99640 1 --2- 172.21.15.132:0/4044421998 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc95c143610 0x7fc95c070a90 unknown :-1 s=CLOSED pgs=1869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.589+0000 7fc960b99640 1 --2- 172.21.15.132:0/4044421998 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc95c0cd950 0x7fc95c0adb10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.589+0000 7fc960b99640 1 --2- 172.21.15.132:0/4044421998 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc95c0c41f0 0x7fc95c1f1fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.589+0000 7fc960b99640 1 -- 172.21.15.132:0/4044421998 >> 172.21.15.132:0/4044421998 conn(0x7fc95c06a260 msgr2=0x7fc95c0cd240 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:35.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.589+0000 7fc960b99640 1 -- 172.21.15.132:0/4044421998 shutdown_connections 2023-12-20T04:53:35.592 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.589+0000 7fc960b99640 1 -- 172.21.15.132:0/4044421998 wait complete. 2023-12-20T04:53:35.602 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:53:35.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.700+0000 7fa2f7927640 1 Processor -- start 2023-12-20T04:53:35.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.700+0000 7fa2f7927640 1 -- start start 2023-12-20T04:53:35.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2f7927640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fa2f01444f0 0x7fa2f00b31f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2f7927640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2f00ce7c0 0x7fa2f00cec50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2f7927640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa2f00cb800 con 0x7fa2f00b2700 2023-12-20T04:53:35.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2f7927640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa2f015b630 con 0x7fa2f01444f0 2023-12-20T04:53:35.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2f7927640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00cb240 con 0x7fa2f00ce7c0 2023-12-20T04:53:35.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2f56c3640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa2f00b2700 0x7fa2f00b2ae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33872/0 (socket says 172.21.15.132:33872) 2023-12-20T04:53:35.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2f56c3640 1 -- 172.21.15.132:0/3353642607 learned_addr learned my addr 172.21.15.132:0/3353642607 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:35.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2e7fff640 1 -- 172.21.15.132:0/3353642607 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2617838358 0 0) 0x7fa2f00cb800 con 0x7fa2f00b2700 2023-12-20T04:53:35.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2e7fff640 1 -- 172.21.15.132:0/3353642607 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fa2dc003520 con 0x7fa2f00b2700 2023-12-20T04:53:35.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2f5ec4640 1 --2- 172.21.15.132:0/3353642607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2f00ce7c0 0x7fa2f00cec50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2f4ec2640 1 --2- 172.21.15.132:0/3353642607 >> v2:172.21.15.187:3300/0 conn(0x7fa2f01444f0 0x7fa2f00b31f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2e7fff640 1 -- 172.21.15.132:0/3353642607 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3494600012 0 0) 0x7fa2dc003520 con 0x7fa2f00b2700 2023-12-20T04:53:35.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2e7fff640 1 -- 172.21.15.132:0/3353642607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2f00ce7c0 msgr2=0x7fa2f00cec50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:35.706 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2e7fff640 1 --2- 172.21.15.132:0/3353642607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2f00ce7c0 0x7fa2f00cec50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2e7fff640 1 -- 172.21.15.132:0/3353642607 >> v2:172.21.15.187:3300/0 conn(0x7fa2f01444f0 msgr2=0x7fa2f00b31f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2e7fff640 1 --2- 172.21.15.132:0/3353642607 >> v2:172.21.15.187:3300/0 conn(0x7fa2f01444f0 0x7fa2f00b31f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2e7fff640 1 -- 172.21.15.132:0/3353642607 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f00cb520 con 0x7fa2f00b2700 2023-12-20T04:53:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2e7fff640 1 -- 172.21.15.132:0/3353642607 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fa2ec001670 con 0x7fa2f00b2700 2023-12-20T04:53:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2e7fff640 1 -- 172.21.15.132:0/3353642607 >> v1:172.21.15.132:6789/0 conn(0x7fa2f00b2700 legacy=0x7fa2f00b2ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2e7fff640 1 --2- 172.21.15.132:0/3353642607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2dc003970 0x7fa2dc003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2e7fff640 1 --2- 172.21.15.132:0/3353642607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2dc0047c0 0x7fa2dc004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2e7fff640 1 --2- 172.21.15.132:0/3353642607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2dc005180 0x7fa2dc00b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2e7fff640 1 -- 172.21.15.132:0/3353642607 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f015b630 con 0x7fa2dc003970 2023-12-20T04:53:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2e7fff640 1 -- 172.21.15.132:0/3353642607 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00cb240 con 0x7fa2dc0047c0 2023-12-20T04:53:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2e7fff640 1 -- 172.21.15.132:0/3353642607 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2dc00c050 con 0x7fa2dc005180 2023-12-20T04:53:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2f5ec4640 1 --2- 172.21.15.132:0/3353642607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2f00ce7c0 0x7fa2f00cec50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:35.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2f4ec2640 1 --2- 172.21.15.132:0/3353642607 >> v2:172.21.15.187:3300/0 conn(0x7fa2f01444f0 0x7fa2f00b31f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.701+0000 7fa2f56c3640 1 --2- 172.21.15.132:0/3353642607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2dc003970 0x7fa2dc003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.702+0000 7fa2f5ec4640 1 --2- 172.21.15.132:0/3353642607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2dc005180 0x7fa2dc00b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.702+0000 7fa2f4ec2640 1 --2- 172.21.15.132:0/3353642607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2dc0047c0 0x7fa2dc004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.702+0000 7fa2f56c3640 1 -- 172.21.15.132:0/3353642607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2dc005180 msgr2=0x7fa2dc00b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.702+0000 7fa2f56c3640 1 --2- 172.21.15.132:0/3353642607 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2dc005180 0x7fa2dc00b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.702+0000 7fa2f56c3640 1 -- 172.21.15.132:0/3353642607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2dc0047c0 msgr2=0x7fa2dc004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.702+0000 7fa2f56c3640 1 --2- 172.21.15.132:0/3353642607 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2dc0047c0 0x7fa2dc004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.702+0000 7fa2f56c3640 1 -- 172.21.15.132:0/3353642607 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc003520 con 0x7fa2dc003970 2023-12-20T04:53:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.702+0000 7fa2f56c3640 1 --2- 172.21.15.132:0/3353642607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2dc003970 0x7fa2dc003d90 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00c270 tx=0x7fa2dc0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a06384f949d28caf server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.703+0000 7fa2e7fff640 1 -- 172.21.15.132:0/3353642607 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec02cae0 con 0x7fa2dc003970 2023-12-20T04:53:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.703+0000 7fa2e7fff640 1 -- 172.21.15.132:0/3353642607 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec02cc40 con 0x7fa2dc003970 2023-12-20T04:53:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.703+0000 7fa2e7fff640 1 -- 172.21.15.132:0/3353642607 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec0058d0 con 0x7fa2dc003970 2023-12-20T04:53:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.703+0000 7fa2f7927640 1 -- 172.21.15.132:0/3353642607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2dc003970 msgr2=0x7fa2dc003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.708 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.703+0000 7fa2f7927640 1 --2- 172.21.15.132:0/3353642607 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2dc003970 0x7fa2dc003d90 secure :-1 s=READY pgs=1871 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00c270 tx=0x7fa2dc0057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.703+0000 7fa2f5ec4640 1 -- 172.21.15.132:0/3353642607 reap_dead start 2023-12-20T04:53:35.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.703+0000 7fa2f7927640 1 -- 172.21.15.132:0/3353642607 shutdown_connections 2023-12-20T04:53:35.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.703+0000 7fa2f7927640 1 -- 172.21.15.132:0/3353642607 >> 172.21.15.132:0/3353642607 conn(0x7fa2f006d640 msgr2=0x7fa2f006da20 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:35.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.703+0000 7fa2f7927640 1 -- 172.21.15.132:0/3353642607 shutdown_connections 2023-12-20T04:53:35.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.703+0000 7fa2f7927640 1 -- 172.21.15.132:0/3353642607 wait complete. 2023-12-20T04:53:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.704+0000 7fa2f7927640 1 Processor -- start 2023-12-20T04:53:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.704+0000 7fa2f7927640 1 -- start start 2023-12-20T04:53:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.705+0000 7fa2f7927640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2dc003970 0x7fa2f00c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.705+0000 7fa2f7927640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2f01f1820 0x7fa2f00c66b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.705+0000 7fa2f7927640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2f00b5980 0x7fa2f00b5e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.705+0000 7fa2f7927640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00b6340 con 0x7fa2dc003970 2023-12-20T04:53:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.705+0000 7fa2f7927640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f01f1ca0 con 0x7fa2f01f1820 2023-12-20T04:53:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.705+0000 7fa2f7927640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa2f00c8670 con 0x7fa2f00b5980 2023-12-20T04:53:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.705+0000 7fa2f56c3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2dc003970 0x7fa2f00c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.705+0000 7fa2f56c3640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2dc003970 0x7fa2f00c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41026/0 (socket says 172.21.15.132:41026) 2023-12-20T04:53:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.705+0000 7fa2f56c3640 1 -- 172.21.15.132:0/1169054930 learned_addr learned my addr 172.21.15.132:0/1169054930 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:35.712 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.705+0000 7fa2f4ec2640 1 --2- 172.21.15.132:0/1169054930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2f01f1820 0x7fa2f00c66b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.705+0000 7fa2f5ec4640 1 --2- 172.21.15.132:0/1169054930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2f00b5980 0x7fa2f00b5e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.705+0000 7fa2f56c3640 1 -- 172.21.15.132:0/1169054930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2f00b5980 msgr2=0x7fa2f00b5e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.705+0000 7fa2f56c3640 1 --2- 172.21.15.132:0/1169054930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2f00b5980 0x7fa2f00b5e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.705+0000 7fa2f56c3640 1 -- 172.21.15.132:0/1169054930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2f01f1820 msgr2=0x7fa2f00c66b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.705+0000 7fa2f56c3640 1 --2- 172.21.15.132:0/1169054930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2f01f1820 0x7fa2f00c66b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.705+0000 7fa2f56c3640 1 -- 172.21.15.132:0/1169054930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2f00c8950 con 0x7fa2dc003970 2023-12-20T04:53:35.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.706+0000 7fa2f56c3640 1 --2- 172.21.15.132:0/1169054930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2dc003970 0x7fa2f00c7f60 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00c210 tx=0x7fa2ec001a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:35.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.706+0000 7fa2e5ffb640 1 -- 172.21.15.132:0/1169054930 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec039030 con 0x7fa2dc003970 2023-12-20T04:53:35.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.706+0000 7fa2e5ffb640 1 -- 172.21.15.132:0/1169054930 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa2ec004bf0 con 0x7fa2dc003970 2023-12-20T04:53:35.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.706+0000 7fa2f7927640 1 -- 172.21.15.132:0/1169054930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2f00c8c30 con 0x7fa2dc003970 2023-12-20T04:53:35.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.706+0000 7fa2e5ffb640 1 -- 172.21.15.132:0/1169054930 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa2ec03c040 con 0x7fa2dc003970 2023-12-20T04:53:35.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.706+0000 7fa2f7927640 1 -- 172.21.15.132:0/1169054930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2f00c8f10 con 0x7fa2dc003970 2023-12-20T04:53:35.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.707+0000 7fa2f7927640 1 -- 172.21.15.132:0/1169054930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2f00ce450 con 0x7fa2dc003970 2023-12-20T04:53:35.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.707+0000 7fa2e5ffb640 1 -- 172.21.15.132:0/1169054930 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa2ec032070 con 0x7fa2dc003970 2023-12-20T04:53:35.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.708+0000 7fa2e5ffb640 1 --2- 172.21.15.132:0/1169054930 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2d406a430 0x7fa2d406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:35.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.708+0000 7fa2e5ffb640 1 -- 172.21.15.132:0/1169054930 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fa2ec0a9bd0 con 0x7fa2dc003970 2023-12-20T04:53:35.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.708+0000 7fa2f4ec2640 1 --2- 172.21.15.132:0/1169054930 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2d406a430 0x7fa2d406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:35.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.708+0000 7fa2f4ec2640 1 --2- 172.21.15.132:0/1169054930 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2d406a430 0x7fa2d406c8f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0151280 tx=0x7fa2e0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:35.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.712+0000 7fa2e5ffb640 1 -- 172.21.15.132:0/1169054930 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa2ec075250 con 0x7fa2dc003970 2023-12-20T04:53:35.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.890+0000 7fa2f7927640 1 -- 172.21.15.132:0/1169054930 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7fa2f004e840 con 0x7fa2dc003970 2023-12-20T04:53:35.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.891+0000 7fa2e5ffb640 1 -- 172.21.15.132:0/1169054930 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v189) v1 ==== 80+0+0 (secure 0 0 0) 0x7fa2ec078870 con 0x7fa2dc003970 2023-12-20T04:53:35.893 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:53:35.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.893+0000 7fa2f7927640 1 -- 172.21.15.132:0/1169054930 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2d406a430 msgr2=0x7fa2d406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.893+0000 7fa2f7927640 1 --2- 172.21.15.132:0/1169054930 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2d406a430 0x7fa2d406c8f0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7fa2f0151280 tx=0x7fa2e0008040 comp rx=0 tx=0).stop 2023-12-20T04:53:35.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.893+0000 7fa2f7927640 1 -- 172.21.15.132:0/1169054930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2dc003970 msgr2=0x7fa2f00c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:35.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.893+0000 7fa2f7927640 1 --2- 172.21.15.132:0/1169054930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2dc003970 0x7fa2f00c7f60 secure :-1 s=READY pgs=1872 cs=0 l=1 rev1=1 crypto rx=0x7fa2ec00c210 tx=0x7fa2ec001a00 comp rx=0 tx=0).stop 2023-12-20T04:53:35.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.893+0000 7fa2f7927640 1 -- 172.21.15.132:0/1169054930 shutdown_connections 2023-12-20T04:53:35.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.893+0000 7fa2f7927640 1 --2- 172.21.15.132:0/1169054930 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa2d406a430 0x7fa2d406c8f0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.893+0000 7fa2f7927640 1 --2- 172.21.15.132:0/1169054930 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa2f00b5980 0x7fa2f00b5e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.893+0000 7fa2f7927640 1 --2- 172.21.15.132:0/1169054930 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa2f01f1820 0x7fa2f00c66b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.893+0000 7fa2f7927640 1 --2- 172.21.15.132:0/1169054930 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa2dc003970 0x7fa2f00c7f60 unknown :-1 s=CLOSED pgs=1872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:35.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.893+0000 7fa2f7927640 1 -- 172.21.15.132:0/1169054930 >> 172.21.15.132:0/1169054930 conn(0x7fa2f006d640 msgr2=0x7fa2f01e6300 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:35.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.893+0000 7fa2f7927640 1 -- 172.21.15.132:0/1169054930 shutdown_connections 2023-12-20T04:53:35.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:35.893+0000 7fa2f7927640 1 -- 172.21.15.132:0/1169054930 wait complete. 2023-12-20T04:53:35.906 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi132.front.sepia.ceph.com... 2023-12-20T04:53:35.906 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:35.906 DEBUG:teuthology.orchestra.run.smithi132:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2023-12-20T04:53:35.931 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi132.stderr:ceph-fuse[123846]: fuse finished with error 0 and tester_r 0 2023-12-20T04:53:35.936 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:53:35.936 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:35.937 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2023-12-20T04:53:36.101 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:53:36.101 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:53:36.119 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:53:36.240 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.238+0000 7f306e2e5640 1 Processor -- start 2023-12-20T04:53:36.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.238+0000 7f306e2e5640 1 -- start start 2023-12-20T04:53:36.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.239+0000 7f306e2e5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30680cdc10 0x7f306806c8a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.239+0000 7f306e2e5640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30681613c0 con 0x7f30680d0370 2023-12-20T04:53:36.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.239+0000 7f306e2e5640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f30680d1b00 con 0x7f306815d100 2023-12-20T04:53:36.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.239+0000 7f306e2e5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f306806cde0 con 0x7f30680cdc10 2023-12-20T04:53:36.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.239+0000 7f30677fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f30680d0370 0x7f306806c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33886/0 (socket says 172.21.15.132:33886) 2023-12-20T04:53:36.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.239+0000 7f30677fe640 1 -- 172.21.15.132:0/21870558 learned_addr learned my addr 172.21.15.132:0/21870558 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:36.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f306c882640 1 --2- 172.21.15.132:0/21870558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30680cdc10 0x7f306806c8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f3066ffd640 1 -- 172.21.15.132:0/21870558 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3227073733 0 0) 0x7f30681613c0 con 0x7f30680d0370 2023-12-20T04:53:36.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f3066ffd640 1 -- 172.21.15.132:0/21870558 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3050003520 con 0x7f30680d0370 2023-12-20T04:53:36.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f3066ffd640 1 -- 172.21.15.132:0/21870558 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3671654074 0 0) 0x7f3050003520 con 0x7f30680d0370 2023-12-20T04:53:36.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f3066ffd640 1 -- 172.21.15.132:0/21870558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30680cdc10 msgr2=0x7f306806c8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:36.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f3066ffd640 1 --2- 172.21.15.132:0/21870558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30680cdc10 0x7f306806c8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f3066ffd640 1 -- 172.21.15.132:0/21870558 >> v1:172.21.15.187:6789/0 conn(0x7f306815d100 legacy=0x7f30680cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f3066ffd640 1 -- 172.21.15.132:0/21870558 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30680d0810 con 0x7f30680d0370 2023-12-20T04:53:36.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f3066ffd640 1 -- 172.21.15.132:0/21870558 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f305c001670 con 0x7f30680d0370 2023-12-20T04:53:36.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f3066ffd640 1 -- 172.21.15.132:0/21870558 >> v1:172.21.15.132:6789/0 conn(0x7f30680d0370 legacy=0x7f306806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f3066ffd640 1 --2- 172.21.15.132:0/21870558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30680cdc10 0x7f30500039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f3066ffd640 1 --2- 172.21.15.132:0/21870558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3050003f20 0x7f30500047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f3066ffd640 1 --2- 172.21.15.132:0/21870558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3050004d00 0x7f3050005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f3066ffd640 1 -- 172.21.15.132:0/21870558 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306806cde0 con 0x7f3050003f20 2023-12-20T04:53:36.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f3066ffd640 1 -- 172.21.15.132:0/21870558 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f305000ba60 con 0x7f3050004d00 2023-12-20T04:53:36.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f3066ffd640 1 -- 172.21.15.132:0/21870558 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f305000bc20 con 0x7f30680cdc10 2023-12-20T04:53:36.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f30677fe640 1 --2- 172.21.15.132:0/21870558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3050003f20 0x7f30500047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f3067fff640 1 --2- 172.21.15.132:0/21870558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30680cdc10 0x7f30500039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f306c882640 1 --2- 172.21.15.132:0/21870558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3050004d00 0x7f3050005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f30677fe640 1 -- 172.21.15.132:0/21870558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30680cdc10 msgr2=0x7f30500039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:36.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f30677fe640 1 --2- 172.21.15.132:0/21870558 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f30680cdc10 0x7f30500039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f30677fe640 1 -- 172.21.15.132:0/21870558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3050004d00 msgr2=0x7f3050005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:36.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f30677fe640 1 --2- 172.21.15.132:0/21870558 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3050004d00 0x7f3050005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.240+0000 7f30677fe640 1 -- 172.21.15.132:0/21870558 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3050003520 con 0x7f3050003f20 2023-12-20T04:53:36.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.241+0000 7f30677fe640 1 --2- 172.21.15.132:0/21870558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3050003f20 0x7f30500047c0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f305c00c240 tx=0x7f30500057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e546beabfa08df09 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:36.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.241+0000 7f3066ffd640 1 -- 172.21.15.132:0/21870558 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c005ad0 con 0x7f3050003f20 2023-12-20T04:53:36.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.241+0000 7f3066ffd640 1 -- 172.21.15.132:0/21870558 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f305c005c50 con 0x7f3050003f20 2023-12-20T04:53:36.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.241+0000 7f3066ffd640 1 -- 172.21.15.132:0/21870558 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f305c02c8b0 con 0x7f3050003f20 2023-12-20T04:53:36.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.242+0000 7f306e2e5640 1 -- 172.21.15.132:0/21870558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3050003f20 msgr2=0x7f30500047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.242+0000 7f306e2e5640 1 --2- 172.21.15.132:0/21870558 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3050003f20 0x7f30500047c0 secure :-1 s=READY pgs=1874 cs=0 l=1 rev1=1 crypto rx=0x7f305c00c240 tx=0x7f30500057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.242+0000 7f306c882640 1 -- 172.21.15.132:0/21870558 reap_dead start 2023-12-20T04:53:36.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.242+0000 7f306e2e5640 1 -- 172.21.15.132:0/21870558 shutdown_connections 2023-12-20T04:53:36.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.242+0000 7f306e2e5640 1 -- 172.21.15.132:0/21870558 >> 172.21.15.132:0/21870558 conn(0x7f306806d7c0 msgr2=0x7f306806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:36.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.242+0000 7f306e2e5640 1 -- 172.21.15.132:0/21870558 shutdown_connections 2023-12-20T04:53:36.248 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.242+0000 7f306e2e5640 1 -- 172.21.15.132:0/21870558 wait complete. 2023-12-20T04:53:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.243+0000 7f306e2e5640 1 Processor -- start 2023-12-20T04:53:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.243+0000 7f306e2e5640 1 -- start start 2023-12-20T04:53:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f306e2e5640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3050003f20 0x7f30680ca700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f306e2e5640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f306815d4e0 0x7f306815d960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f306e2e5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f306815dea0 0x7f30680c8d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f306e2e5640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f306815e320 con 0x7f306815dea0 2023-12-20T04:53:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f306e2e5640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3068158a60 con 0x7f306815d4e0 2023-12-20T04:53:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f306e2e5640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f30680b6850 con 0x7f3050003f20 2023-12-20T04:53:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f306c882640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f306815dea0 0x7f30680c8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f306c882640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f306815dea0 0x7f30680c8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41038/0 (socket says 172.21.15.132:41038) 2023-12-20T04:53:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f306c882640 1 -- 172.21.15.132:0/3249066566 learned_addr learned my addr 172.21.15.132:0/3249066566 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:36.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f306c882640 1 -- 172.21.15.132:0/3249066566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3050003f20 msgr2=0x7f30680ca700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f306c882640 1 --2- 172.21.15.132:0/3249066566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3050003f20 0x7f30680ca700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f306c882640 1 -- 172.21.15.132:0/3249066566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f306815d4e0 msgr2=0x7f306815d960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f306c882640 1 --2- 172.21.15.132:0/3249066566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f306815d4e0 0x7f306815d960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f306c882640 1 -- 172.21.15.132:0/3249066566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30680c7f40 con 0x7f306815dea0 2023-12-20T04:53:36.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f306c882640 1 --2- 172.21.15.132:0/3249066566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f306815dea0 0x7f30680c8d00 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f30680cb380 tx=0x7f30600115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:36.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f3064ff9640 1 -- 172.21.15.132:0/3249066566 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f306000e070 con 0x7f306815dea0 2023-12-20T04:53:36.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f3064ff9640 1 -- 172.21.15.132:0/3249066566 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3060011e10 con 0x7f306815dea0 2023-12-20T04:53:36.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f3064ff9640 1 -- 172.21.15.132:0/3249066566 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3060003990 con 0x7f306815dea0 2023-12-20T04:53:36.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.244+0000 7f306e2e5640 1 -- 172.21.15.132:0/3249066566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30680c8220 con 0x7f306815dea0 2023-12-20T04:53:36.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.245+0000 7f306e2e5640 1 -- 172.21.15.132:0/3249066566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30680c87e0 con 0x7f306815dea0 2023-12-20T04:53:36.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.245+0000 7f306e2e5640 1 -- 172.21.15.132:0/3249066566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f306804e840 con 0x7f306815dea0 2023-12-20T04:53:36.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.246+0000 7f3064ff9640 1 -- 172.21.15.132:0/3249066566 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3060003af0 con 0x7f306815dea0 2023-12-20T04:53:36.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.246+0000 7f3064ff9640 1 --2- 172.21.15.132:0/3249066566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f305406a460 0x7f305406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.252 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.246+0000 7f3064ff9640 1 -- 172.21.15.132:0/3249066566 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f3060088f90 con 0x7f306815dea0 2023-12-20T04:53:36.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.246+0000 7f3067fff640 1 --2- 172.21.15.132:0/3249066566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f305406a460 0x7f305406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.247+0000 7f3067fff640 1 --2- 172.21.15.132:0/3249066566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f305406a460 0x7f305406c920 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3058001750 tx=0x7f3058009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:36.253 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.251+0000 7f3064ff9640 1 -- 172.21.15.132:0/3249066566 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3060054580 con 0x7f306815dea0 2023-12-20T04:53:36.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.418+0000 7f306e2e5640 1 -- 172.21.15.132:0/3249066566 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f30680b37d0 con 0x7f306815dea0 2023-12-20T04:53:36.421 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.419+0000 7f3064ff9640 1 -- 172.21.15.132:0/3249066566 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+16159 (secure 0 0 0) 0x7f3060057ba0 con 0x7f306815dea0 2023-12-20T04:53:36.421 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:36.421 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":189,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:53:29.910371+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:53:03.034230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-20T04:53:03.812892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:53:36.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.421+0000 7f306e2e5640 1 -- 172.21.15.132:0/3249066566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f305406a460 msgr2=0x7f305406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.421+0000 7f306e2e5640 1 --2- 172.21.15.132:0/3249066566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f305406a460 0x7f305406c920 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3058001750 tx=0x7f3058009040 comp rx=0 tx=0).stop 2023-12-20T04:53:36.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.421+0000 7f306e2e5640 1 -- 172.21.15.132:0/3249066566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f306815dea0 msgr2=0x7f30680c8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.421+0000 7f306e2e5640 1 --2- 172.21.15.132:0/3249066566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f306815dea0 0x7f30680c8d00 secure :-1 s=READY pgs=1875 cs=0 l=1 rev1=1 crypto rx=0x7f30680cb380 tx=0x7f30600115a0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.421+0000 7f306e2e5640 1 -- 172.21.15.132:0/3249066566 shutdown_connections 2023-12-20T04:53:36.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.421+0000 7f306e2e5640 1 --2- 172.21.15.132:0/3249066566 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f305406a460 0x7f305406c920 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.421+0000 7f306e2e5640 1 --2- 172.21.15.132:0/3249066566 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f306815dea0 0x7f30680c8d00 unknown :-1 s=CLOSED pgs=1875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.421+0000 7f306e2e5640 1 --2- 172.21.15.132:0/3249066566 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f306815d4e0 0x7f306815d960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.421+0000 7f306e2e5640 1 --2- 172.21.15.132:0/3249066566 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3050003f20 0x7f30680ca700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.421+0000 7f306e2e5640 1 -- 172.21.15.132:0/3249066566 >> 172.21.15.132:0/3249066566 conn(0x7f306806d7c0 msgr2=0x7f3068065910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:36.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.421+0000 7f306e2e5640 1 -- 172.21.15.132:0/3249066566 shutdown_connections 2023-12-20T04:53:36.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.421+0000 7f306e2e5640 1 -- 172.21.15.132:0/3249066566 wait complete. 2023-12-20T04:53:36.434 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:53:03.034230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '185', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:53:03.812892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '189', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:53:36.435 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:53:36.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.536+0000 7f3349473640 1 Processor -- start 2023-12-20T04:53:36.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.536+0000 7f3349473640 1 -- start start 2023-12-20T04:53:36.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.537+0000 7f3349473640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33440ca170 0x7f33440ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.537+0000 7f3349473640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f33440c4f40 con 0x7f3344069c30 2023-12-20T04:53:36.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.537+0000 7f3349473640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3344144b90 con 0x7f33441447b0 2023-12-20T04:53:36.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.537+0000 7f3349473640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33440c6380 con 0x7f33440ca170 2023-12-20T04:53:36.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.537+0000 7f33437fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3344069c30 0x7f334406c610 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33896/0 (socket says 172.21.15.132:33896) 2023-12-20T04:53:36.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.537+0000 7f33437fe640 1 -- 172.21.15.132:0/809571899 learned_addr learned my addr 172.21.15.132:0/809571899 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:36.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.538+0000 7f33427fc640 1 --2- 172.21.15.132:0/809571899 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33440ca170 0x7f33440ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.538+0000 7f3341ffb640 1 -- 172.21.15.132:0/809571899 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3108010476 0 0) 0x7f33440c4f40 con 0x7f3344069c30 2023-12-20T04:53:36.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.538+0000 7f3341ffb640 1 -- 172.21.15.132:0/809571899 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f332c003520 con 0x7f3344069c30 2023-12-20T04:53:36.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.538+0000 7f3341ffb640 1 -- 172.21.15.132:0/809571899 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 578239245 0 0) 0x7f3344144b90 con 0x7f33441447b0 2023-12-20T04:53:36.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.538+0000 7f3341ffb640 1 -- 172.21.15.132:0/809571899 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f33440c4f40 con 0x7f33441447b0 2023-12-20T04:53:36.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.538+0000 7f3341ffb640 1 -- 172.21.15.132:0/809571899 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 693581466 0 0) 0x7f332c003520 con 0x7f3344069c30 2023-12-20T04:53:36.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.538+0000 7f33427fc640 1 -- 172.21.15.132:0/809571899 >> v1:172.21.15.187:6789/0 conn(0x7f33441447b0 legacy=0x7f33440c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.538+0000 7f33427fc640 1 -- 172.21.15.132:0/809571899 >> v1:172.21.15.132:6789/0 conn(0x7f3344069c30 legacy=0x7f334406c610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.538+0000 7f33427fc640 1 -- 172.21.15.132:0/809571899 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33440cac30 con 0x7f33440ca170 2023-12-20T04:53:36.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.539+0000 7f33427fc640 1 --2- 172.21.15.132:0/809571899 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33440ca170 0x7f33440ca5d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33380097d0 tx=0x7f333802b770 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5857b59ceb4b3799 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:36.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.539+0000 7f3341ffb640 1 -- 172.21.15.132:0/809571899 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333c001670 con 0x7f33440ca170 2023-12-20T04:53:36.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.539+0000 7f3341ffb640 1 -- 172.21.15.132:0/809571899 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333802e050 con 0x7f33440ca170 2023-12-20T04:53:36.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.539+0000 7f3341ffb640 1 -- 172.21.15.132:0/809571899 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338030710 con 0x7f33440ca170 2023-12-20T04:53:36.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.539+0000 7f3349473640 1 -- 172.21.15.132:0/809571899 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33440ca170 msgr2=0x7f33440ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.539+0000 7f3349473640 1 --2- 172.21.15.132:0/809571899 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33440ca170 0x7f33440ca5d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f33380097d0 tx=0x7f333802b770 comp rx=0 tx=0).stop 2023-12-20T04:53:36.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.539+0000 7f3349473640 1 -- 172.21.15.132:0/809571899 shutdown_connections 2023-12-20T04:53:36.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.539+0000 7f3349473640 1 --2- 172.21.15.132:0/809571899 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33440ca170 0x7f33440ca5d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.539+0000 7f3349473640 1 -- 172.21.15.132:0/809571899 >> 172.21.15.132:0/809571899 conn(0x7f33440cc630 msgr2=0x7f33440cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:36.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.540+0000 7f3349473640 1 -- 172.21.15.132:0/809571899 shutdown_connections 2023-12-20T04:53:36.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.540+0000 7f3349473640 1 -- 172.21.15.132:0/809571899 wait complete. 2023-12-20T04:53:36.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.541+0000 7f3349473640 1 Processor -- start 2023-12-20T04:53:36.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.541+0000 7f3349473640 1 -- start start 2023-12-20T04:53:36.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.541+0000 7f3349473640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3344069c30 0x7f33440c6e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.541+0000 7f3349473640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33440ca170 0x7f33441f5da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.541+0000 7f3349473640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33441447b0 0x7f33441f62e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.541+0000 7f3349473640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33440c98a0 con 0x7f33440ca170 2023-12-20T04:53:36.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.541+0000 7f3349473640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33440c8980 con 0x7f3344069c30 2023-12-20T04:53:36.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.541+0000 7f3349473640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f33440c8c20 con 0x7f33441447b0 2023-12-20T04:53:36.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f33427fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33440ca170 0x7f33441f5da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f33427fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33440ca170 0x7f33441f5da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41052/0 (socket says 172.21.15.132:41052) 2023-12-20T04:53:36.545 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f33427fc640 1 -- 172.21.15.132:0/1778834970 learned_addr learned my addr 172.21.15.132:0/1778834970 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:36.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f33437fe640 1 --2- 172.21.15.132:0/1778834970 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33441447b0 0x7f33441f62e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f3342ffd640 1 --2- 172.21.15.132:0/1778834970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3344069c30 0x7f33440c6e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f33427fc640 1 -- 172.21.15.132:0/1778834970 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33441447b0 msgr2=0x7f33441f62e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f33427fc640 1 --2- 172.21.15.132:0/1778834970 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33441447b0 0x7f33441f62e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f33427fc640 1 -- 172.21.15.132:0/1778834970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3344069c30 msgr2=0x7f33440c6e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f33427fc640 1 --2- 172.21.15.132:0/1778834970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3344069c30 0x7f33440c6e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f33427fc640 1 -- 172.21.15.132:0/1778834970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3338009400 con 0x7f33440ca170 2023-12-20T04:53:36.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f33437fe640 1 --2- 172.21.15.132:0/1778834970 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33441447b0 0x7f33441f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:36.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f3342ffd640 1 --2- 172.21.15.132:0/1778834970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3344069c30 0x7f33440c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:36.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f33427fc640 1 --2- 172.21.15.132:0/1778834970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33440ca170 0x7f33441f5da0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f3338000c00 tx=0x7f33380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:36.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f332b7fe640 1 -- 172.21.15.132:0/1778834970 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3338006e10 con 0x7f33440ca170 2023-12-20T04:53:36.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f332b7fe640 1 -- 172.21.15.132:0/1778834970 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f333803c620 con 0x7f33440ca170 2023-12-20T04:53:36.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f3349473640 1 -- 172.21.15.132:0/1778834970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33440c8f00 con 0x7f33440ca170 2023-12-20T04:53:36.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f332b7fe640 1 -- 172.21.15.132:0/1778834970 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f333803c9d0 con 0x7f33440ca170 2023-12-20T04:53:36.546 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.542+0000 7f3349473640 1 -- 172.21.15.132:0/1778834970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33440c94c0 con 0x7f33440ca170 2023-12-20T04:53:36.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.543+0000 7f3349473640 1 -- 172.21.15.132:0/1778834970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33440c99e0 con 0x7f33440ca170 2023-12-20T04:53:36.547 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.544+0000 7f332b7fe640 1 -- 172.21.15.132:0/1778834970 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3338039070 con 0x7f33440ca170 2023-12-20T04:53:36.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.544+0000 7f332b7fe640 1 --2- 172.21.15.132:0/1778834970 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f333006a430 0x7f333006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.544+0000 7f332b7fe640 1 -- 172.21.15.132:0/1778834970 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f33380aa050 con 0x7f33440ca170 2023-12-20T04:53:36.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.544+0000 7f3342ffd640 1 --2- 172.21.15.132:0/1778834970 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f333006a430 0x7f333006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.548 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.544+0000 7f3342ffd640 1 --2- 172.21.15.132:0/1778834970 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f333006a430 0x7f333006c8f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3334001e10 tx=0x7f3334009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:36.550 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.548+0000 7f332b7fe640 1 -- 172.21.15.132:0/1778834970 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f33440c99e0 con 0x7f33440ca170 2023-12-20T04:53:36.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.711+0000 7f3349473640 1 -- 172.21.15.132:0/1778834970 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f33440c99e0 con 0x7f33440ca170 2023-12-20T04:53:36.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.712+0000 7f332b7fe640 1 -- 172.21.15.132:0/1778834970 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v189) v1 ==== 93+0+10 (secure 0 0 0) 0x7f33440c99e0 con 0x7f33440ca170 2023-12-20T04:53:36.714 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:53:36.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.713+0000 7f3349473640 1 -- 172.21.15.132:0/1778834970 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f333006a430 msgr2=0x7f333006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.713+0000 7f3349473640 1 --2- 172.21.15.132:0/1778834970 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f333006a430 0x7f333006c8f0 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3334001e10 tx=0x7f3334009040 comp rx=0 tx=0).stop 2023-12-20T04:53:36.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.713+0000 7f3349473640 1 -- 172.21.15.132:0/1778834970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33440ca170 msgr2=0x7f33441f5da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.713+0000 7f3349473640 1 --2- 172.21.15.132:0/1778834970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33440ca170 0x7f33441f5da0 secure :-1 s=READY pgs=1877 cs=0 l=1 rev1=1 crypto rx=0x7f3338000c00 tx=0x7f33380046c0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.713+0000 7f3349473640 1 -- 172.21.15.132:0/1778834970 shutdown_connections 2023-12-20T04:53:36.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.713+0000 7f3349473640 1 --2- 172.21.15.132:0/1778834970 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f333006a430 0x7f333006c8f0 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.713+0000 7f3349473640 1 --2- 172.21.15.132:0/1778834970 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f33441447b0 0x7f33441f62e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.713+0000 7f3349473640 1 --2- 172.21.15.132:0/1778834970 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f33440ca170 0x7f33441f5da0 unknown :-1 s=CLOSED pgs=1877 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.713+0000 7f3349473640 1 --2- 172.21.15.132:0/1778834970 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3344069c30 0x7f33440c6e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.713+0000 7f3349473640 1 -- 172.21.15.132:0/1778834970 >> 172.21.15.132:0/1778834970 conn(0x7f33440cc630 msgr2=0x7f33440cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:36.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.714+0000 7f3349473640 1 -- 172.21.15.132:0/1778834970 shutdown_connections 2023-12-20T04:53:36.716 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.714+0000 7f3349473640 1 -- 172.21.15.132:0/1778834970 wait complete. 2023-12-20T04:53:36.726 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:53:36.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.826+0000 7f99228ab640 1 Processor -- start 2023-12-20T04:53:36.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.826+0000 7f99228ab640 1 -- start start 2023-12-20T04:53:36.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.826+0000 7f99228ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f991c143510 0x7f991c0c52a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.826+0000 7f99228ab640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c0cabd0 con 0x7f991c0cd690 2023-12-20T04:53:36.831 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.826+0000 7f99228ab640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f991c0c9fc0 con 0x7f991c0cb060 2023-12-20T04:53:36.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.826+0000 7f99228ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0ca2a0 con 0x7f991c143510 2023-12-20T04:53:36.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f9920e48640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f991c0cd690 0x7f991c06b450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:33912/0 (socket says 172.21.15.132:33912) 2023-12-20T04:53:36.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f9920e48640 1 -- 172.21.15.132:0/1984813211 learned_addr learned my addr 172.21.15.132:0/1984813211 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:36.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991bfff640 1 --2- 172.21.15.132:0/1984813211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f991c143510 0x7f991c0c52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991affd640 1 -- 172.21.15.132:0/1984813211 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 405438168 0 0) 0x7f991c0cabd0 con 0x7f991c0cd690 2023-12-20T04:53:36.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991affd640 1 -- 172.21.15.132:0/1984813211 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f9904003520 con 0x7f991c0cd690 2023-12-20T04:53:36.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991affd640 1 -- 172.21.15.132:0/1984813211 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3304887733 0 0) 0x7f991c0c9fc0 con 0x7f991c0cb060 2023-12-20T04:53:36.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991affd640 1 -- 172.21.15.132:0/1984813211 --> v1:172.21.15.187:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f991c0cabd0 con 0x7f991c0cb060 2023-12-20T04:53:36.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991affd640 1 -- 172.21.15.132:0/1984813211 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 40737896 0 0) 0x7f9904003520 con 0x7f991c0cd690 2023-12-20T04:53:36.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991affd640 1 -- 172.21.15.132:0/1984813211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f991c143510 msgr2=0x7f991c0c52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:36.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991affd640 1 --2- 172.21.15.132:0/1984813211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f991c143510 0x7f991c0c52a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991affd640 1 -- 172.21.15.132:0/1984813211 >> v1:172.21.15.187:6789/0 conn(0x7f991c0cb060 legacy=0x7f991c0ccf80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.832 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991affd640 1 -- 172.21.15.132:0/1984813211 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c0ca580 con 0x7f991c0cd690 2023-12-20T04:53:36.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991affd640 1 -- 172.21.15.132:0/1984813211 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f99140019f0 con 0x7f991c0cd690 2023-12-20T04:53:36.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991bfff640 1 --2- 172.21.15.132:0/1984813211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f991c143510 0x7f991c0c52a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:53:36.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991affd640 1 -- 172.21.15.132:0/1984813211 >> v1:172.21.15.132:6789/0 conn(0x7f991c0cd690 legacy=0x7f991c06b450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991affd640 1 --2- 172.21.15.132:0/1984813211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9904003b30 0x7f9904003f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991affd640 1 --2- 172.21.15.132:0/1984813211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f991c143510 0x7f99040047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991affd640 1 --2- 172.21.15.132:0/1984813211 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9904004d00 0x7f9904005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991affd640 1 -- 172.21.15.132:0/1984813211 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c0ca2a0 con 0x7f9904004d00 2023-12-20T04:53:36.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991affd640 1 -- 172.21.15.132:0/1984813211 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f990400ba30 con 0x7f9904003b30 2023-12-20T04:53:36.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991affd640 1 -- 172.21.15.132:0/1984813211 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f990400bb70 con 0x7f991c143510 2023-12-20T04:53:36.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f9920e48640 1 --2- 172.21.15.132:0/1984813211 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9904004d00 0x7f9904005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991b7fe640 1 --2- 172.21.15.132:0/1984813211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f991c143510 0x7f99040047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.827+0000 7f991bfff640 1 --2- 172.21.15.132:0/1984813211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9904003b30 0x7f9904003f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.833 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.828+0000 7f9920e48640 1 -- 172.21.15.132:0/1984813211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f991c143510 msgr2=0x7f99040047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:36.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.828+0000 7f9920e48640 1 --2- 172.21.15.132:0/1984813211 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f991c143510 0x7f99040047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.828+0000 7f9920e48640 1 -- 172.21.15.132:0/1984813211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9904003b30 msgr2=0x7f9904003f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:36.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.828+0000 7f9920e48640 1 --2- 172.21.15.132:0/1984813211 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9904003b30 0x7f9904003f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.828+0000 7f9920e48640 1 -- 172.21.15.132:0/1984813211 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f990c009400 con 0x7f9904004d00 2023-12-20T04:53:36.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.828+0000 7f9920e48640 1 --2- 172.21.15.132:0/1984813211 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9904004d00 0x7f9904005180 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f991400a7b0 tx=0x7f99040057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f6b76ab22ca1fe4e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:36.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.828+0000 7f991affd640 1 -- 172.21.15.132:0/1984813211 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914034630 con 0x7f9904004d00 2023-12-20T04:53:36.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.829+0000 7f991affd640 1 -- 172.21.15.132:0/1984813211 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991402f070 con 0x7f9904004d00 2023-12-20T04:53:36.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.829+0000 7f991affd640 1 -- 172.21.15.132:0/1984813211 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f99140349d0 con 0x7f9904004d00 2023-12-20T04:53:36.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.829+0000 7f99228ab640 1 -- 172.21.15.132:0/1984813211 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9904004d00 msgr2=0x7f9904005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.829+0000 7f99228ab640 1 --2- 172.21.15.132:0/1984813211 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9904004d00 0x7f9904005180 secure :-1 s=READY pgs=1879 cs=0 l=1 rev1=1 crypto rx=0x7f991400a7b0 tx=0x7f99040057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.829+0000 7f9920e48640 1 -- 172.21.15.132:0/1984813211 reap_dead start 2023-12-20T04:53:36.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.829+0000 7f99228ab640 1 -- 172.21.15.132:0/1984813211 shutdown_connections 2023-12-20T04:53:36.834 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.829+0000 7f99228ab640 1 -- 172.21.15.132:0/1984813211 >> 172.21.15.132:0/1984813211 conn(0x7f991c06a260 msgr2=0x7f991c0b0710 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:36.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.829+0000 7f99228ab640 1 -- 172.21.15.132:0/1984813211 shutdown_connections 2023-12-20T04:53:36.835 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.829+0000 7f99228ab640 1 -- 172.21.15.132:0/1984813211 wait complete. 2023-12-20T04:53:36.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.830+0000 7f99228ab640 1 Processor -- start 2023-12-20T04:53:36.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.830+0000 7f99228ab640 1 -- start start 2023-12-20T04:53:36.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f99228ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f991c15b200 0x7f991c1ef6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f99228ab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f991c1efc00 0x7f991c13d270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f99228ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f991c15cdc0 0x7f991c13d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f99228ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c1f0660 con 0x7f991c15cdc0 2023-12-20T04:53:36.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f99228ab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f991c1f0d20 con 0x7f991c1efc00 2023-12-20T04:53:36.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f99228ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f991c1f00a0 con 0x7f991c15b200 2023-12-20T04:53:36.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f9920e48640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f991c15cdc0 0x7f991c13d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f9920e48640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f991c15cdc0 0x7f991c13d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41074/0 (socket says 172.21.15.132:41074) 2023-12-20T04:53:36.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f9920e48640 1 -- 172.21.15.132:0/3165984173 learned_addr learned my addr 172.21.15.132:0/3165984173 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:36.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f991bfff640 1 --2- 172.21.15.132:0/3165984173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f991c15b200 0x7f991c1ef6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f991b7fe640 1 --2- 172.21.15.132:0/3165984173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f991c1efc00 0x7f991c13d270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f9920e48640 1 -- 172.21.15.132:0/3165984173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f991c15b200 msgr2=0x7f991c1ef6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f9920e48640 1 --2- 172.21.15.132:0/3165984173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f991c15b200 0x7f991c1ef6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f9920e48640 1 -- 172.21.15.132:0/3165984173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f991c1efc00 msgr2=0x7f991c13d270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:36.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f9920e48640 1 --2- 172.21.15.132:0/3165984173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f991c1efc00 0x7f991c13d270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:36.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f9920e48640 1 -- 172.21.15.132:0/3165984173 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c1f0380 con 0x7f991c15cdc0 2023-12-20T04:53:36.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f991bfff640 1 --2- 172.21.15.132:0/3165984173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f991c15b200 0x7f991c1ef6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:36.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.831+0000 7f991b7fe640 1 --2- 172.21.15.132:0/3165984173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f991c1efc00 0x7f991c13d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:36.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.832+0000 7f9920e48640 1 --2- 172.21.15.132:0/3165984173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f991c15cdc0 0x7f991c13d7b0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f991400a7b0 tx=0x7f991c0cab40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:36.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.832+0000 7f9918ff9640 1 -- 172.21.15.132:0/3165984173 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914034840 con 0x7f991c15cdc0 2023-12-20T04:53:36.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.832+0000 7f9918ff9640 1 -- 172.21.15.132:0/3165984173 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f99140349a0 con 0x7f991c15cdc0 2023-12-20T04:53:36.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.832+0000 7f9918ff9640 1 -- 172.21.15.132:0/3165984173 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9914034d10 con 0x7f991c15cdc0 2023-12-20T04:53:36.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.832+0000 7f99228ab640 1 -- 172.21.15.132:0/3165984173 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f991c1f09b0 con 0x7f991c15cdc0 2023-12-20T04:53:36.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.832+0000 7f99228ab640 1 -- 172.21.15.132:0/3165984173 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f991c15b7c0 con 0x7f991c15cdc0 2023-12-20T04:53:36.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.833+0000 7f99228ab640 1 -- 172.21.15.132:0/3165984173 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f991c04e840 con 0x7f991c15cdc0 2023-12-20T04:53:36.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.833+0000 7f9918ff9640 1 -- 172.21.15.132:0/3165984173 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9914031030 con 0x7f991c15cdc0 2023-12-20T04:53:36.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.833+0000 7f9918ff9640 1 --2- 172.21.15.132:0/3165984173 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f990806a430 0x7f990806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:36.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.834+0000 7f9918ff9640 1 -- 172.21.15.132:0/3165984173 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f99140ac290 con 0x7f991c15cdc0 2023-12-20T04:53:36.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.834+0000 7f991bfff640 1 --2- 172.21.15.132:0/3165984173 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f990806a430 0x7f990806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:36.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.834+0000 7f991bfff640 1 --2- 172.21.15.132:0/3165984173 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f990806a430 0x7f990806c8f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f991c15ca20 tx=0x7f990c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:36.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:36.838+0000 7f9918ff9640 1 -- 172.21.15.132:0/3165984173 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9914077910 con 0x7f991c15cdc0 2023-12-20T04:53:37.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.009+0000 7f99228ab640 1 -- 172.21.15.132:0/3165984173 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f991c1f0e60 con 0x7f991c15cdc0 2023-12-20T04:53:37.011 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.009+0000 7f9918ff9640 1 -- 172.21.15.132:0/3165984173 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v189) v1 ==== 104+0+11 (secure 0 0 0) 0x7f9914001f40 con 0x7f991c15cdc0 2023-12-20T04:53:37.011 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:53:37.013 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.011+0000 7f99228ab640 1 -- 172.21.15.132:0/3165984173 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f990806a430 msgr2=0x7f990806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:37.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.011+0000 7f99228ab640 1 --2- 172.21.15.132:0/3165984173 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f990806a430 0x7f990806c8f0 secure :-1 s=READY pgs=787 cs=0 l=1 rev1=1 crypto rx=0x7f991c15ca20 tx=0x7f990c008040 comp rx=0 tx=0).stop 2023-12-20T04:53:37.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.011+0000 7f99228ab640 1 -- 172.21.15.132:0/3165984173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f991c15cdc0 msgr2=0x7f991c13d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:37.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.011+0000 7f99228ab640 1 --2- 172.21.15.132:0/3165984173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f991c15cdc0 0x7f991c13d7b0 secure :-1 s=READY pgs=1880 cs=0 l=1 rev1=1 crypto rx=0x7f991400a7b0 tx=0x7f991c0cab40 comp rx=0 tx=0).stop 2023-12-20T04:53:37.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.011+0000 7f99228ab640 1 -- 172.21.15.132:0/3165984173 shutdown_connections 2023-12-20T04:53:37.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.011+0000 7f99228ab640 1 --2- 172.21.15.132:0/3165984173 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f990806a430 0x7f990806c8f0 unknown :-1 s=CLOSED pgs=787 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.011+0000 7f99228ab640 1 --2- 172.21.15.132:0/3165984173 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f991c15cdc0 0x7f991c13d7b0 unknown :-1 s=CLOSED pgs=1880 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.011+0000 7f99228ab640 1 --2- 172.21.15.132:0/3165984173 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f991c1efc00 0x7f991c13d270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.011+0000 7f99228ab640 1 --2- 172.21.15.132:0/3165984173 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f991c15b200 0x7f991c1ef6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.011+0000 7f99228ab640 1 -- 172.21.15.132:0/3165984173 >> 172.21.15.132:0/3165984173 conn(0x7f991c06a260 msgr2=0x7f991c15dcf0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:37.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.011+0000 7f99228ab640 1 -- 172.21.15.132:0/3165984173 shutdown_connections 2023-12-20T04:53:37.015 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.011+0000 7f99228ab640 1 -- 172.21.15.132:0/3165984173 wait complete. 2023-12-20T04:53:37.024 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:53:37.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.123+0000 7fbbf42c4640 1 Processor -- start 2023-12-20T04:53:37.125 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.123+0000 7fbbf42c4640 1 -- start start 2023-12-20T04:53:37.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.124+0000 7fbbf42c4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbbec15aee0 0x7fbbec15eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.124+0000 7fbbf42c4640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fbbec0cb2b0 0x7fbbec0cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.124+0000 7fbbf42c4640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fbbec0ce000 con 0x7fbbec0cdbb0 2023-12-20T04:53:37.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.124+0000 7fbbf42c4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbec0d0130 con 0x7fbbec15aee0 2023-12-20T04:53:37.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.124+0000 7fbbf42c4640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fbbec15f370 con 0x7fbbec0cb2b0 2023-12-20T04:53:37.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.124+0000 7fbbf2060640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbbec15aee0 0x7fbbec15eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.124+0000 7fbbf2060640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fbbec15aee0 0x7fbbec15eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41076/0 (socket says 172.21.15.132:41076) 2023-12-20T04:53:37.127 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.124+0000 7fbbf2060640 1 -- 172.21.15.132:0/1505051604 learned_addr learned my addr 172.21.15.132:0/1505051604 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:37.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.124+0000 7fbbf185f640 1 --2- 172.21.15.132:0/1505051604 >> v2:172.21.15.187:3300/0 conn(0x7fbbec0cb2b0 0x7fbbec0cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.124+0000 7fbbf2060640 1 -- 172.21.15.132:0/1505051604 >> v2:172.21.15.187:3300/0 conn(0x7fbbec0cb2b0 msgr2=0x7fbbec0cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:37.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.124+0000 7fbbf2060640 1 --2- 172.21.15.132:0/1505051604 >> v2:172.21.15.187:3300/0 conn(0x7fbbec0cb2b0 0x7fbbec0cd670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.124+0000 7fbbf2060640 1 -- 172.21.15.132:0/1505051604 >> v1:172.21.15.187:6789/0 conn(0x7fbbec0cdbb0 legacy=0x7fbbec0ceb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:37.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.124+0000 7fbbf2060640 1 -- 172.21.15.132:0/1505051604 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbec15f650 con 0x7fbbec15aee0 2023-12-20T04:53:37.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.125+0000 7fbbf2060640 1 --2- 172.21.15.132:0/1505051604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbec15aee0 0x7fbbec15eb40 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009870 tx=0x7fbbe802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6759008c6b03c05e server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:37.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.125+0000 7fbbf105e640 1 -- 172.21.15.132:0/1505051604 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8031870 con 0x7fbbec15aee0 2023-12-20T04:53:37.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.125+0000 7fbbf105e640 1 -- 172.21.15.132:0/1505051604 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe80319d0 con 0x7fbbec15aee0 2023-12-20T04:53:37.128 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.125+0000 7fbbf105e640 1 -- 172.21.15.132:0/1505051604 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8031d60 con 0x7fbbec15aee0 2023-12-20T04:53:37.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.126+0000 7fbbf42c4640 1 -- 172.21.15.132:0/1505051604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbec15aee0 msgr2=0x7fbbec15eb40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:37.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.126+0000 7fbbf42c4640 1 --2- 172.21.15.132:0/1505051604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbec15aee0 0x7fbbec15eb40 secure :-1 s=READY pgs=1881 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009870 tx=0x7fbbe802b910 comp rx=0 tx=0).stop 2023-12-20T04:53:37.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.126+0000 7fbbf42c4640 1 -- 172.21.15.132:0/1505051604 shutdown_connections 2023-12-20T04:53:37.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.126+0000 7fbbf42c4640 1 --2- 172.21.15.132:0/1505051604 >> v2:172.21.15.187:3300/0 conn(0x7fbbec0cb2b0 0x7fbbec0cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.126+0000 7fbbf42c4640 1 --2- 172.21.15.132:0/1505051604 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbec15aee0 0x7fbbec15eb40 unknown :-1 s=CLOSED pgs=1881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.126+0000 7fbbf42c4640 1 -- 172.21.15.132:0/1505051604 >> 172.21.15.132:0/1505051604 conn(0x7fbbec072c60 msgr2=0x7fbbec073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:37.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.126+0000 7fbbf42c4640 1 -- 172.21.15.132:0/1505051604 shutdown_connections 2023-12-20T04:53:37.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.126+0000 7fbbf42c4640 1 -- 172.21.15.132:0/1505051604 wait complete. 2023-12-20T04:53:37.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.127+0000 7fbbf42c4640 1 Processor -- start 2023-12-20T04:53:37.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.127+0000 7fbbf42c4640 1 -- start start 2023-12-20T04:53:37.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf42c4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbec0cb2b0 0x7fbbec1f2d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf42c4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbec0cdbb0 0x7fbbec1581c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf42c4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbec15aee0 0x7fbbec0b5610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf42c4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec15d8c0 con 0x7fbbec0cb2b0 2023-12-20T04:53:37.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf42c4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec06b210 con 0x7fbbec15aee0 2023-12-20T04:53:37.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf42c4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fbbec06aee0 con 0x7fbbec0cdbb0 2023-12-20T04:53:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf2060640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbec0cb2b0 0x7fbbec1f2d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf2060640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbec0cb2b0 0x7fbbec1f2d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41084/0 (socket says 172.21.15.132:41084) 2023-12-20T04:53:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf2060640 1 -- 172.21.15.132:0/3922361129 learned_addr learned my addr 172.21.15.132:0/3922361129 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf185f640 1 --2- 172.21.15.132:0/3922361129 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbec0cdbb0 0x7fbbec1581c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf2861640 1 --2- 172.21.15.132:0/3922361129 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbec15aee0 0x7fbbec0b5610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf2060640 1 -- 172.21.15.132:0/3922361129 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbec0cdbb0 msgr2=0x7fbbec1581c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf2060640 1 --2- 172.21.15.132:0/3922361129 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbec0cdbb0 0x7fbbec1581c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf2060640 1 -- 172.21.15.132:0/3922361129 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbec15aee0 msgr2=0x7fbbec0b5610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf2060640 1 --2- 172.21.15.132:0/3922361129 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbec15aee0 0x7fbbec0b5610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf2060640 1 -- 172.21.15.132:0/3922361129 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbbe80094d0 con 0x7fbbec0cb2b0 2023-12-20T04:53:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf2060640 1 --2- 172.21.15.132:0/3922361129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbec0cb2b0 0x7fbbec1f2d20 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009870 tx=0x7fbbe80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbe2ffd640 1 -- 172.21.15.132:0/3922361129 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe803ac60 con 0x7fbbec0cb2b0 2023-12-20T04:53:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbe2ffd640 1 -- 172.21.15.132:0/3922361129 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fbbe803adc0 con 0x7fbbec0cb2b0 2023-12-20T04:53:37.133 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf42c4640 1 -- 172.21.15.132:0/3922361129 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbbec15d300 con 0x7fbbec0cb2b0 2023-12-20T04:53:37.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbe2ffd640 1 -- 172.21.15.132:0/3922361129 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fbbe8044610 con 0x7fbbec0cb2b0 2023-12-20T04:53:37.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.128+0000 7fbbf42c4640 1 -- 172.21.15.132:0/3922361129 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbbec158700 con 0x7fbbec0cb2b0 2023-12-20T04:53:37.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.129+0000 7fbbf42c4640 1 -- 172.21.15.132:0/3922361129 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbbec06ad40 con 0x7fbbec0cb2b0 2023-12-20T04:53:37.134 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.130+0000 7fbbe2ffd640 1 -- 172.21.15.132:0/3922361129 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fbbe804d450 con 0x7fbbec0cb2b0 2023-12-20T04:53:37.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.130+0000 7fbbe2ffd640 1 --2- 172.21.15.132:0/3922361129 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbbd006a430 0x7fbbd006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.130+0000 7fbbe2ffd640 1 -- 172.21.15.132:0/3922361129 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fbbe802d040 con 0x7fbbec0cb2b0 2023-12-20T04:53:37.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.130+0000 7fbbf185f640 1 --2- 172.21.15.132:0/3922361129 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbbd006a430 0x7fbbd006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.131+0000 7fbbf185f640 1 --2- 172.21.15.132:0/3922361129 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbbd006a430 0x7fbbd006c8f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc006fd0 tx=0x7fbbdc008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:37.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.135+0000 7fbbe2ffd640 1 -- 172.21.15.132:0/3922361129 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fbbec06ad40 con 0x7fbbec0cb2b0 2023-12-20T04:53:37.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.299+0000 7fbbf42c4640 1 -- 172.21.15.132:0/3922361129 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7fbbec15f910 con 0x7fbbec0cb2b0 2023-12-20T04:53:37.301 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.299+0000 7fbbe2ffd640 1 -- 172.21.15.132:0/3922361129 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v189) v1 ==== 100+0+11 (secure 0 0 0) 0x7fbbec15f910 con 0x7fbbec0cb2b0 2023-12-20T04:53:37.301 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:53:37.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.301+0000 7fbbf42c4640 1 -- 172.21.15.132:0/3922361129 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbbd006a430 msgr2=0x7fbbd006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:37.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.301+0000 7fbbf42c4640 1 --2- 172.21.15.132:0/3922361129 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbbd006a430 0x7fbbd006c8f0 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7fbbdc006fd0 tx=0x7fbbdc008040 comp rx=0 tx=0).stop 2023-12-20T04:53:37.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.301+0000 7fbbf42c4640 1 -- 172.21.15.132:0/3922361129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbec0cb2b0 msgr2=0x7fbbec1f2d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:37.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.301+0000 7fbbf42c4640 1 --2- 172.21.15.132:0/3922361129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbec0cb2b0 0x7fbbec1f2d20 secure :-1 s=READY pgs=1882 cs=0 l=1 rev1=1 crypto rx=0x7fbbe8009870 tx=0x7fbbe80046c0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.301+0000 7fbbf42c4640 1 -- 172.21.15.132:0/3922361129 shutdown_connections 2023-12-20T04:53:37.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.301+0000 7fbbf42c4640 1 --2- 172.21.15.132:0/3922361129 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fbbd006a430 0x7fbbd006c8f0 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.301+0000 7fbbf42c4640 1 --2- 172.21.15.132:0/3922361129 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fbbec15aee0 0x7fbbec0b5610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.301+0000 7fbbf42c4640 1 --2- 172.21.15.132:0/3922361129 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fbbec0cdbb0 0x7fbbec1581c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.301+0000 7fbbf42c4640 1 --2- 172.21.15.132:0/3922361129 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fbbec0cb2b0 0x7fbbec1f2d20 unknown :-1 s=CLOSED pgs=1882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.301+0000 7fbbf42c4640 1 -- 172.21.15.132:0/3922361129 >> 172.21.15.132:0/3922361129 conn(0x7fbbec072c60 msgr2=0x7fbbec0ceb60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:37.304 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.301+0000 7fbbf42c4640 1 -- 172.21.15.132:0/3922361129 shutdown_connections 2023-12-20T04:53:37.305 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.301+0000 7fbbf42c4640 1 -- 172.21.15.132:0/3922361129 wait complete. 2023-12-20T04:53:37.314 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2023-12-20T04:53:37.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.413+0000 7f032ee0b640 1 Processor -- start 2023-12-20T04:53:37.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.413+0000 7f032ee0b640 1 -- start start 2023-12-20T04:53:37.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.413+0000 7f032ee0b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f032815d110 0x7f03280b21f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.413+0000 7f032ee0b640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f03280b1d10 0x7f03280b4880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.413+0000 7f032ee0b640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f03280cd660 con 0x7f0328161940 2023-12-20T04:53:37.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.413+0000 7f032ee0b640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f03280cd940 con 0x7f032815d110 2023-12-20T04:53:37.416 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.413+0000 7f032ee0b640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0328160e60 con 0x7f03280b1d10 2023-12-20T04:53:37.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.414+0000 7f032cba7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f032815d110 0x7f03280b21f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.414+0000 7f032cba7640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f032815d110 0x7f03280b21f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41094/0 (socket says 172.21.15.132:41094) 2023-12-20T04:53:37.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.414+0000 7f032cba7640 1 -- 172.21.15.132:0/3895713355 learned_addr learned my addr 172.21.15.132:0/3895713355 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:37.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.414+0000 7f0327fff640 1 --2- 172.21.15.132:0/3895713355 >> v2:172.21.15.187:3300/0 conn(0x7f03280b1d10 0x7f03280b4880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.414+0000 7f032cba7640 1 -- 172.21.15.132:0/3895713355 >> v2:172.21.15.187:3300/0 conn(0x7f03280b1d10 msgr2=0x7f03280b4880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:37.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.414+0000 7f032cba7640 1 --2- 172.21.15.132:0/3895713355 >> v2:172.21.15.187:3300/0 conn(0x7f03280b1d10 0x7f03280b4880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.414+0000 7f032cba7640 1 -- 172.21.15.132:0/3895713355 >> v1:172.21.15.187:6789/0 conn(0x7f0328161940 legacy=0x7f032806bcc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:37.417 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.414+0000 7f032cba7640 1 -- 172.21.15.132:0/3895713355 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0328161140 con 0x7f032815d110 2023-12-20T04:53:37.418 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.415+0000 7f032cba7640 1 --2- 172.21.15.132:0/3895713355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f032815d110 0x7f03280b21f0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f032806ccf0 tx=0x7f031802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5548b6b8dcc0cf2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:37.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.415+0000 7f03277fe640 1 -- 172.21.15.132:0/3895713355 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0318031640 con 0x7f032815d110 2023-12-20T04:53:37.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.415+0000 7f03277fe640 1 -- 172.21.15.132:0/3895713355 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f03180317a0 con 0x7f032815d110 2023-12-20T04:53:37.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.415+0000 7f03277fe640 1 -- 172.21.15.132:0/3895713355 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0318031b30 con 0x7f032815d110 2023-12-20T04:53:37.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.415+0000 7f032ee0b640 1 -- 172.21.15.132:0/3895713355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f032815d110 msgr2=0x7f03280b21f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:37.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.415+0000 7f032ee0b640 1 --2- 172.21.15.132:0/3895713355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f032815d110 0x7f03280b21f0 secure :-1 s=READY pgs=1883 cs=0 l=1 rev1=1 crypto rx=0x7f032806ccf0 tx=0x7f031802b8f0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.415+0000 7f032ee0b640 1 -- 172.21.15.132:0/3895713355 shutdown_connections 2023-12-20T04:53:37.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.415+0000 7f032ee0b640 1 --2- 172.21.15.132:0/3895713355 >> v2:172.21.15.187:3300/0 conn(0x7f03280b1d10 0x7f03280b4880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.415+0000 7f032ee0b640 1 --2- 172.21.15.132:0/3895713355 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f032815d110 0x7f03280b21f0 unknown :-1 s=CLOSED pgs=1883 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.415+0000 7f032ee0b640 1 -- 172.21.15.132:0/3895713355 >> 172.21.15.132:0/3895713355 conn(0x7f03280cf880 msgr2=0x7f03280cfc60 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:37.419 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.415+0000 7f032ee0b640 1 -- 172.21.15.132:0/3895713355 shutdown_connections 2023-12-20T04:53:37.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.415+0000 7f032ee0b640 1 -- 172.21.15.132:0/3895713355 wait complete. 2023-12-20T04:53:37.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.417+0000 7f032ee0b640 1 Processor -- start 2023-12-20T04:53:37.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.417+0000 7f032ee0b640 1 -- start start 2023-12-20T04:53:37.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.417+0000 7f032ee0b640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03280b1d10 0x7f0328160120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.417+0000 7f032ee0b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f032815d110 0x7f032815e310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.417+0000 7f032ee0b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0328161940 0x7f0328150ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.417+0000 7f032ee0b640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03280cc090 con 0x7f0328161940 2023-12-20T04:53:37.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.417+0000 7f032ee0b640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f032815d9f0 con 0x7f03280b1d10 2023-12-20T04:53:37.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.417+0000 7f032ee0b640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f032815dcd0 con 0x7f032815d110 2023-12-20T04:53:37.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.418+0000 7f032d3a8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0328161940 0x7f0328150ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.418+0000 7f032d3a8640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0328161940 0x7f0328150ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:41108/0 (socket says 172.21.15.132:41108) 2023-12-20T04:53:37.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.418+0000 7f032d3a8640 1 -- 172.21.15.132:0/3639090797 learned_addr learned my addr 172.21.15.132:0/3639090797 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:37.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.418+0000 7f032cba7640 1 --2- 172.21.15.132:0/3639090797 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03280b1d10 0x7f0328160120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.418+0000 7f0327fff640 1 --2- 172.21.15.132:0/3639090797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f032815d110 0x7f032815e310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.418+0000 7f032d3a8640 1 -- 172.21.15.132:0/3639090797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f032815d110 msgr2=0x7f032815e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:37.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.418+0000 7f032d3a8640 1 --2- 172.21.15.132:0/3639090797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f032815d110 0x7f032815e310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.418+0000 7f032d3a8640 1 -- 172.21.15.132:0/3639090797 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03280b1d10 msgr2=0x7f0328160120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:37.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.418+0000 7f032d3a8640 1 --2- 172.21.15.132:0/3639090797 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03280b1d10 0x7f0328160120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.418+0000 7f032d3a8640 1 -- 172.21.15.132:0/3639090797 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03180094d0 con 0x7f0328161940 2023-12-20T04:53:37.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.418+0000 7f032d3a8640 1 --2- 172.21.15.132:0/3639090797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0328161940 0x7f0328150ee0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f032000b970 tx=0x7f032000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:37.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.418+0000 7f03257fa640 1 -- 172.21.15.132:0/3639090797 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f032000cb40 con 0x7f0328161940 2023-12-20T04:53:37.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.418+0000 7f03257fa640 1 -- 172.21.15.132:0/3639090797 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f032000cca0 con 0x7f0328161940 2023-12-20T04:53:37.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.418+0000 7f032ee0b640 1 -- 172.21.15.132:0/3639090797 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03280cba40 con 0x7f0328161940 2023-12-20T04:53:37.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.418+0000 7f03257fa640 1 -- 172.21.15.132:0/3639090797 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0320014680 con 0x7f0328161940 2023-12-20T04:53:37.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.418+0000 7f032ee0b640 1 -- 172.21.15.132:0/3639090797 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0328160660 con 0x7f0328161940 2023-12-20T04:53:37.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.419+0000 7f032ee0b640 1 -- 172.21.15.132:0/3639090797 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03280cc240 con 0x7f0328161940 2023-12-20T04:53:37.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.420+0000 7f03257fa640 1 -- 172.21.15.132:0/3639090797 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f032001d3b0 con 0x7f0328161940 2023-12-20T04:53:37.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.420+0000 7f03257fa640 1 --2- 172.21.15.132:0/3639090797 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f030806a430 0x7f030806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.420+0000 7f03257fa640 1 -- 172.21.15.132:0/3639090797 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0320088600 con 0x7f0328161940 2023-12-20T04:53:37.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.420+0000 7f032cba7640 1 --2- 172.21.15.132:0/3639090797 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f030806a430 0x7f030806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.420+0000 7f032cba7640 1 --2- 172.21.15.132:0/3639090797 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f030806a430 0x7f030806c8f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0318036000 tx=0x7f031803c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:37.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.424+0000 7f03257fa640 1 -- 172.21.15.132:0/3639090797 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f03280cc240 con 0x7f0328161940 2023-12-20T04:53:37.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.601+0000 7f032ee0b640 1 -- 172.21.15.132:0/3639090797 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f032804e840 con 0x7f0328161940 2023-12-20T04:53:37.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.602+0000 7f03257fa640 1 -- 172.21.15.132:0/3639090797 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v189) v1 ==== 80+0+0 (secure 0 0 0) 0x7f0320053d30 con 0x7f0328161940 2023-12-20T04:53:37.604 INFO:teuthology.orchestra.run.smithi132.stderr:listed 0 entries 2023-12-20T04:53:37.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.604+0000 7f032ee0b640 1 -- 172.21.15.132:0/3639090797 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f030806a430 msgr2=0x7f030806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:37.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.604+0000 7f032ee0b640 1 --2- 172.21.15.132:0/3639090797 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f030806a430 0x7f030806c8f0 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0318036000 tx=0x7f031803c040 comp rx=0 tx=0).stop 2023-12-20T04:53:37.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.604+0000 7f032ee0b640 1 -- 172.21.15.132:0/3639090797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0328161940 msgr2=0x7f0328150ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:37.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.604+0000 7f032ee0b640 1 --2- 172.21.15.132:0/3639090797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0328161940 0x7f0328150ee0 secure :-1 s=READY pgs=1884 cs=0 l=1 rev1=1 crypto rx=0x7f032000b970 tx=0x7f032000be30 comp rx=0 tx=0).stop 2023-12-20T04:53:37.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.604+0000 7f032ee0b640 1 -- 172.21.15.132:0/3639090797 shutdown_connections 2023-12-20T04:53:37.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.604+0000 7f032ee0b640 1 --2- 172.21.15.132:0/3639090797 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f030806a430 0x7f030806c8f0 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.604+0000 7f032ee0b640 1 --2- 172.21.15.132:0/3639090797 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0328161940 0x7f0328150ee0 unknown :-1 s=CLOSED pgs=1884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.604+0000 7f032ee0b640 1 --2- 172.21.15.132:0/3639090797 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f032815d110 0x7f032815e310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.604+0000 7f032ee0b640 1 --2- 172.21.15.132:0/3639090797 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f03280b1d10 0x7f0328160120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.604+0000 7f032ee0b640 1 -- 172.21.15.132:0/3639090797 >> 172.21.15.132:0/3639090797 conn(0x7f03280cf880 msgr2=0x7f03280cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:37.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.604+0000 7f032ee0b640 1 -- 172.21.15.132:0/3639090797 shutdown_connections 2023-12-20T04:53:37.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.604+0000 7f032ee0b640 1 -- 172.21.15.132:0/3639090797 wait complete. 2023-12-20T04:53:37.617 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi187.front.sepia.ceph.com... 2023-12-20T04:53:37.617 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:37.617 DEBUG:teuthology.orchestra.run.smithi187:> sudo fusermount -u /home/ubuntu/cephtest/mnt.1 2023-12-20T04:53:37.647 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi187.stderr:ceph-fuse[92721]: fuse finished with error 0 and tester_r 0 2023-12-20T04:53:37.649 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:53:37.649 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:37.649 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.1) 2023-12-20T04:53:37.734 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:53:37.734 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:53:37.750 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:53:37.750 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:53:37.750 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:37.750 DEBUG:teuthology.orchestra.run.smithi132:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.2) 2023-12-20T04:53:37.804 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:53:37.804 INFO:teuthology.orchestra.run.smithi132.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.2': No such file or directory 2023-12-20T04:53:37.805 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:53:37.805 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:53:37.821 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:53:37.821 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:53:37.822 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:37.822 DEBUG:teuthology.orchestra.run.smithi187:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.3) 2023-12-20T04:53:37.878 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:53:37.878 INFO:teuthology.orchestra.run.smithi187.stderr:rmdir: failed to remove '/home/ubuntu/cephtest/mnt.3': No such file or directory 2023-12-20T04:53:37.878 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:53:37.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.979+0000 7f602bf5f640 1 Processor -- start 2023-12-20T04:53:37.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.979+0000 7f602bf5f640 1 -- start start 2023-12-20T04:53:37.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.980+0000 7f602bf5f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f60240d0370 0x7f60240b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.980+0000 7f602bf5f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60240cdc10 0x7f602406c190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.980+0000 7f602bf5f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f60240b2f90 con 0x7f602415d100 2023-12-20T04:53:37.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.980+0000 7f602bf5f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60241613c0 con 0x7f60240d0370 2023-12-20T04:53:37.982 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.980+0000 7f602bf5f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f60240d1b00 con 0x7f60240cdc10 2023-12-20T04:53:37.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.980+0000 7f60294fa640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f60240d0370 0x7f60240b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.980+0000 7f602a4fc640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60240cdc10 0x7f602406c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.980+0000 7f6029cfb640 1 --1- >> v1:172.21.15.187:6789/0 conn(0x7f602415d100 0x7f60240cd500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:41626/0 (socket says 172.21.15.132:41626) 2023-12-20T04:53:37.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.980+0000 7f60294fa640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f60240d0370 0x7f60240b2a50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:42368/0 (socket says 172.21.15.132:42368) 2023-12-20T04:53:37.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.980+0000 7f602a4fc640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60240cdc10 0x7f602406c190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:36168/0 (socket says 172.21.15.132:36168) 2023-12-20T04:53:37.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.980+0000 7f6029cfb640 1 -- 172.21.15.132:0/2974183311 learned_addr learned my addr 172.21.15.132:0/2974183311 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:37.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.980+0000 7f60294fa640 1 -- 172.21.15.132:0/2974183311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60240cdc10 msgr2=0x7f602406c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:37.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.981+0000 7f60294fa640 1 --2- 172.21.15.132:0/2974183311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60240cdc10 0x7f602406c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.981+0000 7f60294fa640 1 -- 172.21.15.132:0/2974183311 >> v1:172.21.15.187:6789/0 conn(0x7f602415d100 legacy=0x7f60240cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:37.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.981+0000 7f6028cf9640 1 -- 172.21.15.132:0/2974183311 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 384496614 0 0) 0x7f6020001490 con 0x7f602415d100 2023-12-20T04:53:37.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.981+0000 7f60294fa640 1 -- 172.21.15.132:0/2974183311 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60240d0810 con 0x7f60240d0370 2023-12-20T04:53:37.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.981+0000 7f602a4fc640 1 --2- 172.21.15.132:0/2974183311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60240cdc10 0x7f602406c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:53:37.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.981+0000 7f60294fa640 1 --2- 172.21.15.132:0/2974183311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60240d0370 0x7f60240b2a50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f60140097a0 tx=0x7f601402b8d0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b0679fb904b2989d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:37.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.981+0000 7f6028cf9640 1 -- 172.21.15.132:0/2974183311 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014031830 con 0x7f60240d0370 2023-12-20T04:53:37.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.982+0000 7f6028cf9640 1 -- 172.21.15.132:0/2974183311 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6014031990 con 0x7f60240d0370 2023-12-20T04:53:37.984 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.982+0000 7f6028cf9640 1 -- 172.21.15.132:0/2974183311 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014031d20 con 0x7f60240d0370 2023-12-20T04:53:37.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.982+0000 7f602bf5f640 1 -- 172.21.15.132:0/2974183311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60240d0370 msgr2=0x7f60240b2a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:37.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.982+0000 7f602bf5f640 1 --2- 172.21.15.132:0/2974183311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60240d0370 0x7f60240b2a50 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7f60140097a0 tx=0x7f601402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.982+0000 7f602bf5f640 1 -- 172.21.15.132:0/2974183311 shutdown_connections 2023-12-20T04:53:37.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.982+0000 7f602bf5f640 1 --2- 172.21.15.132:0/2974183311 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60240cdc10 0x7f602406c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.982+0000 7f602bf5f640 1 --2- 172.21.15.132:0/2974183311 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60240d0370 0x7f60240b2a50 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.982+0000 7f602bf5f640 1 -- 172.21.15.132:0/2974183311 >> 172.21.15.132:0/2974183311 conn(0x7f602406d7c0 msgr2=0x7f602406dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:37.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.982+0000 7f602bf5f640 1 -- 172.21.15.132:0/2974183311 shutdown_connections 2023-12-20T04:53:37.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.982+0000 7f602bf5f640 1 -- 172.21.15.132:0/2974183311 wait complete. 2023-12-20T04:53:37.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.983+0000 7f602bf5f640 1 Processor -- start 2023-12-20T04:53:37.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.983+0000 7f602bf5f640 1 -- start start 2023-12-20T04:53:37.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.984+0000 7f602bf5f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60240cdc10 0x7f60240ca6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.984+0000 7f602bf5f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60240d0370 0x7f6024158ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.984+0000 7f602bf5f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f602415d100 0x7f602415d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.984+0000 7f602bf5f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60240c88f0 con 0x7f60240d0370 2023-12-20T04:53:37.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.984+0000 7f602bf5f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6024159e40 con 0x7f60240cdc10 2023-12-20T04:53:37.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.984+0000 7f602bf5f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6024159880 con 0x7f602415d100 2023-12-20T04:53:37.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.984+0000 7f60294fa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60240d0370 0x7f6024158ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.984+0000 7f60294fa640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60240d0370 0x7f6024158ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37510/0 (socket says 172.21.15.132:37510) 2023-12-20T04:53:37.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.984+0000 7f60294fa640 1 -- 172.21.15.132:0/996507732 learned_addr learned my addr 172.21.15.132:0/996507732 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:37.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.984+0000 7f6029cfb640 1 --2- 172.21.15.132:0/996507732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60240cdc10 0x7f60240ca6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.984+0000 7f602a4fc640 1 --2- 172.21.15.132:0/996507732 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f602415d100 0x7f602415d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.984+0000 7f60294fa640 1 -- 172.21.15.132:0/996507732 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f602415d100 msgr2=0x7f602415d4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:37.988 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.984+0000 7f60294fa640 1 --2- 172.21.15.132:0/996507732 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f602415d100 0x7f602415d4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.984+0000 7f60294fa640 1 -- 172.21.15.132:0/996507732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60240cdc10 msgr2=0x7f60240ca6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:37.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.984+0000 7f60294fa640 1 --2- 172.21.15.132:0/996507732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60240cdc10 0x7f60240ca6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:37.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.984+0000 7f60294fa640 1 -- 172.21.15.132:0/996507732 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f601c009400 con 0x7f60240d0370 2023-12-20T04:53:37.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.984+0000 7f6029cfb640 1 --2- 172.21.15.132:0/996507732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60240cdc10 0x7f60240ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:37.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.985+0000 7f60294fa640 1 --2- 172.21.15.132:0/996507732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60240d0370 0x7f6024158ee0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f6014000c00 tx=0x7f60140046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:37.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.985+0000 7f601a7fc640 1 -- 172.21.15.132:0/996507732 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6014004230 con 0x7f60240d0370 2023-12-20T04:53:37.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.985+0000 7f601a7fc640 1 -- 172.21.15.132:0/996507732 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6014004390 con 0x7f60240d0370 2023-12-20T04:53:37.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.985+0000 7f602bf5f640 1 -- 172.21.15.132:0/996507732 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6014009400 con 0x7f60240d0370 2023-12-20T04:53:37.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.985+0000 7f601a7fc640 1 -- 172.21.15.132:0/996507732 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601403a880 con 0x7f60240d0370 2023-12-20T04:53:37.989 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.985+0000 7f602bf5f640 1 -- 172.21.15.132:0/996507732 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60240c8580 con 0x7f60240d0370 2023-12-20T04:53:37.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.986+0000 7f602bf5f640 1 -- 172.21.15.132:0/996507732 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60240c8a60 con 0x7f60240d0370 2023-12-20T04:53:37.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.986+0000 7f601a7fc640 1 -- 172.21.15.132:0/996507732 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f601403a9e0 con 0x7f60240d0370 2023-12-20T04:53:37.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.986+0000 7f601a7fc640 1 --2- 172.21.15.132:0/996507732 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f600806a430 0x7f600806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:37.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.987+0000 7f601a7fc640 1 -- 172.21.15.132:0/996507732 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60140ab090 con 0x7f60240d0370 2023-12-20T04:53:37.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.987+0000 7f6029cfb640 1 --2- 172.21.15.132:0/996507732 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f600806a430 0x7f600806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:37.990 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.987+0000 7f6029cfb640 1 --2- 172.21.15.132:0/996507732 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f600806a430 0x7f600806c8f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f60200012e0 tx=0x7f6020005b90 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:37.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:37.991+0000 7f601a7fc640 1 -- 172.21.15.132:0/996507732 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6014076700 con 0x7f60240d0370 2023-12-20T04:53:38.196 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.194+0000 7f602bf5f640 1 -- 172.21.15.132:0/996507732 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f602404e840 con 0x7f60240d0370 2023-12-20T04:53:38.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.195+0000 7f601a7fc640 1 -- 172.21.15.132:0/996507732 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4722 (secure 0 0 0) 0x7f6014079d20 con 0x7f60240d0370 2023-12-20T04:53:38.197 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:38.197 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":70,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3443409957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3443409957},{"type":"v1","addr":"172.21.15.187:6833","nonce":3443409957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/321445180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":321445180},{"type":"v1","addr":"172.21.15.187:6835","nonce":321445180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1166803529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1166803529},{"type":"v1","addr":"172.21.15.132:6836","nonce":1166803529}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:53:04.838088+0000","modified":"2023-12-20T04:53:07.506024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9117":{"gid":9117,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/2356846201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2356846201},{"type":"v1","addr":"172.21.15.132:6837","nonce":2356846201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-20T04:53:38.197 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 70 2023-12-20T04:53:38.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.196+0000 7f602bf5f640 1 -- 172.21.15.132:0/996507732 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f600806a430 msgr2=0x7f600806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.196+0000 7f602bf5f640 1 --2- 172.21.15.132:0/996507732 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f600806a430 0x7f600806c8f0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f60200012e0 tx=0x7f6020005b90 comp rx=0 tx=0).stop 2023-12-20T04:53:38.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.196+0000 7f602bf5f640 1 -- 172.21.15.132:0/996507732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60240d0370 msgr2=0x7f6024158ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.196+0000 7f602bf5f640 1 --2- 172.21.15.132:0/996507732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60240d0370 0x7f6024158ee0 secure :-1 s=READY pgs=1885 cs=0 l=1 rev1=1 crypto rx=0x7f6014000c00 tx=0x7f60140046c0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.197+0000 7f602bf5f640 1 -- 172.21.15.132:0/996507732 shutdown_connections 2023-12-20T04:53:38.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.197+0000 7f602bf5f640 1 --2- 172.21.15.132:0/996507732 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f600806a430 0x7f600806c8f0 unknown :-1 s=CLOSED pgs=790 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.197+0000 7f602bf5f640 1 --2- 172.21.15.132:0/996507732 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f602415d100 0x7f602415d4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.197+0000 7f602bf5f640 1 --2- 172.21.15.132:0/996507732 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60240d0370 0x7f6024158ee0 unknown :-1 s=CLOSED pgs=1885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.199 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.197+0000 7f602bf5f640 1 --2- 172.21.15.132:0/996507732 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60240cdc10 0x7f60240ca6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.197+0000 7f602bf5f640 1 -- 172.21.15.132:0/996507732 >> 172.21.15.132:0/996507732 conn(0x7f602406d7c0 msgr2=0x7f602406c6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:38.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.197+0000 7f602bf5f640 1 -- 172.21.15.132:0/996507732 shutdown_connections 2023-12-20T04:53:38.200 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.197+0000 7f602bf5f640 1 -- 172.21.15.132:0/996507732 wait complete. 2023-12-20T04:53:38.210 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:53:38.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.307+0000 7f99273d0640 1 Processor -- start 2023-12-20T04:53:38.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.307+0000 7f99273d0640 1 -- start start 2023-12-20T04:53:38.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.308+0000 7f99273d0640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9920159b50 0x7f99200c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.308+0000 7f99273d0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f992015e530 0x7f992006fd70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.308+0000 7f99273d0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f99200ccf30 con 0x7f992006c240 2023-12-20T04:53:38.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.308+0000 7f99273d0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99200caa60 con 0x7f992015e530 2023-12-20T04:53:38.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.308+0000 7f99273d0640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f99200ccc90 con 0x7f9920159b50 2023-12-20T04:53:38.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.308+0000 7f992496b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f992015e530 0x7f992006fd70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.308+0000 7f992596d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f992006c240 0x7f99200cd3c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36588/0 (socket says 172.21.15.132:36588) 2023-12-20T04:53:38.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.308+0000 7f992496b640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f992015e530 0x7f992006fd70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37516/0 (socket says 172.21.15.132:37516) 2023-12-20T04:53:38.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.308+0000 7f992596d640 1 -- 172.21.15.132:0/864030253 learned_addr learned my addr 172.21.15.132:0/864030253 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:38.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.308+0000 7f992516c640 1 --2- 172.21.15.132:0/864030253 >> v2:172.21.15.187:3300/0 conn(0x7f9920159b50 0x7f99200c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.308+0000 7f992496b640 1 -- 172.21.15.132:0/864030253 >> v2:172.21.15.187:3300/0 conn(0x7f9920159b50 msgr2=0x7f99200c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:38.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.308+0000 7f992496b640 1 --2- 172.21.15.132:0/864030253 >> v2:172.21.15.187:3300/0 conn(0x7f9920159b50 0x7f99200c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.308+0000 7f9917fff640 1 -- 172.21.15.132:0/864030253 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1144962397 0 0) 0x7f99200ccf30 con 0x7f992006c240 2023-12-20T04:53:38.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.308+0000 7f992496b640 1 -- 172.21.15.132:0/864030253 >> v1:172.21.15.132:6789/0 conn(0x7f992006c240 legacy=0x7f99200cd3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.308+0000 7f992496b640 1 -- 172.21.15.132:0/864030253 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f99200ca1c0 con 0x7f992015e530 2023-12-20T04:53:38.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.309+0000 7f992496b640 1 --2- 172.21.15.132:0/864030253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f992015e530 0x7f992006fd70 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f99100097a0 tx=0x7f991002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86daa04edb78568 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:38.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.309+0000 7f9917fff640 1 -- 172.21.15.132:0/864030253 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910031830 con 0x7f992015e530 2023-12-20T04:53:38.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.309+0000 7f9917fff640 1 -- 172.21.15.132:0/864030253 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9910031990 con 0x7f992015e530 2023-12-20T04:53:38.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.309+0000 7f9917fff640 1 -- 172.21.15.132:0/864030253 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9910031d20 con 0x7f992015e530 2023-12-20T04:53:38.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.309+0000 7f99273d0640 1 -- 172.21.15.132:0/864030253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f992015e530 msgr2=0x7f992006fd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.309+0000 7f99273d0640 1 --2- 172.21.15.132:0/864030253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f992015e530 0x7f992006fd70 secure :-1 s=READY pgs=1887 cs=0 l=1 rev1=1 crypto rx=0x7f99100097a0 tx=0x7f991002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.309+0000 7f99273d0640 1 -- 172.21.15.132:0/864030253 shutdown_connections 2023-12-20T04:53:38.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.309+0000 7f99273d0640 1 --2- 172.21.15.132:0/864030253 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f992015e530 0x7f992006fd70 unknown :-1 s=CLOSED pgs=1887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.309+0000 7f99273d0640 1 --2- 172.21.15.132:0/864030253 >> v2:172.21.15.187:3300/0 conn(0x7f9920159b50 0x7f99200c9930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.309+0000 7f99273d0640 1 -- 172.21.15.132:0/864030253 >> 172.21.15.132:0/864030253 conn(0x7f99200ced10 msgr2=0x7f99200cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:38.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.310+0000 7f99273d0640 1 -- 172.21.15.132:0/864030253 shutdown_connections 2023-12-20T04:53:38.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.310+0000 7f99273d0640 1 -- 172.21.15.132:0/864030253 wait complete. 2023-12-20T04:53:38.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.311+0000 7f99273d0640 1 Processor -- start 2023-12-20T04:53:38.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.311+0000 7f99273d0640 1 -- start start 2023-12-20T04:53:38.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.311+0000 7f99273d0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f992006c240 0x7f99200c4820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.311+0000 7f99273d0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9920159b50 0x7f9920147fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.311+0000 7f99273d0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f992015e530 0x7f9920150620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.311+0000 7f99273d0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9920145700 con 0x7f992006c240 2023-12-20T04:53:38.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.311+0000 7f99273d0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f99201495e0 con 0x7f992015e530 2023-12-20T04:53:38.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.311+0000 7f99273d0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9920148a60 con 0x7f9920159b50 2023-12-20T04:53:38.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.311+0000 7f992516c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f992006c240 0x7f99200c4820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.311+0000 7f992516c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f992006c240 0x7f99200c4820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37524/0 (socket says 172.21.15.132:37524) 2023-12-20T04:53:38.316 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.311+0000 7f992516c640 1 -- 172.21.15.132:0/891385724 learned_addr learned my addr 172.21.15.132:0/891385724 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:38.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.312+0000 7f992516c640 1 -- 172.21.15.132:0/891385724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9920159b50 msgr2=0x7f9920147fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.312+0000 7f992516c640 1 --2- 172.21.15.132:0/891385724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9920159b50 0x7f9920147fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.312+0000 7f992516c640 1 -- 172.21.15.132:0/891385724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f992015e530 msgr2=0x7f9920150620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.312+0000 7f992516c640 1 --2- 172.21.15.132:0/891385724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f992015e530 0x7f9920150620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.312+0000 7f992516c640 1 -- 172.21.15.132:0/891385724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9910009400 con 0x7f992006c240 2023-12-20T04:53:38.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.312+0000 7f992516c640 1 --2- 172.21.15.132:0/891385724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f992006c240 0x7f99200c4820 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f991c00c7f0 tx=0x7f991c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:38.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.312+0000 7f9915ffb640 1 -- 172.21.15.132:0/891385724 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c004220 con 0x7f992006c240 2023-12-20T04:53:38.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.312+0000 7f9915ffb640 1 -- 172.21.15.132:0/891385724 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f991c0043a0 con 0x7f992006c240 2023-12-20T04:53:38.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.312+0000 7f9915ffb640 1 -- 172.21.15.132:0/891385724 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f991c007860 con 0x7f992006c240 2023-12-20T04:53:38.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.312+0000 7f99273d0640 1 -- 172.21.15.132:0/891385724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9920148d40 con 0x7f992006c240 2023-12-20T04:53:38.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.312+0000 7f99273d0640 1 -- 172.21.15.132:0/891385724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9920149300 con 0x7f992006c240 2023-12-20T04:53:38.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.313+0000 7f99273d0640 1 -- 172.21.15.132:0/891385724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9920145890 con 0x7f992006c240 2023-12-20T04:53:38.317 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.313+0000 7f9915ffb640 1 -- 172.21.15.132:0/891385724 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f991c007bd0 con 0x7f992006c240 2023-12-20T04:53:38.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.314+0000 7f9915ffb640 1 --2- 172.21.15.132:0/891385724 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f990406a430 0x7f990406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.314+0000 7f992496b640 1 --2- 172.21.15.132:0/891385724 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f990406a430 0x7f990406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.314+0000 7f9915ffb640 1 -- 172.21.15.132:0/891385724 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f991c088910 con 0x7f992006c240 2023-12-20T04:53:38.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.314+0000 7f992496b640 1 --2- 172.21.15.132:0/891385724 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f990406a430 0x7f990406c8f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9910036000 tx=0x7f9910030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:38.320 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.318+0000 7f9915ffb640 1 -- 172.21.15.132:0/891385724 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9920145890 con 0x7f992006c240 2023-12-20T04:53:38.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.484+0000 7f99273d0640 1 -- 172.21.15.132:0/891385724 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9920145840 con 0x7f992006c240 2023-12-20T04:53:38.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.486+0000 7f9915ffb640 1 -- 172.21.15.132:0/891385724 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v189) v1 ==== 74+0+16159 (secure 0 0 0) 0x7f991c01e020 con 0x7f992006c240 2023-12-20T04:53:38.488 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:38.488 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":189,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:53:29.910371+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:53:03.034230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-20T04:53:03.812892+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"189","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:53:38.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.487+0000 7f99273d0640 1 -- 172.21.15.132:0/891385724 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f990406a430 msgr2=0x7f990406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.487+0000 7f99273d0640 1 --2- 172.21.15.132:0/891385724 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f990406a430 0x7f990406c8f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f9910036000 tx=0x7f9910030000 comp rx=0 tx=0).stop 2023-12-20T04:53:38.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.487+0000 7f99273d0640 1 -- 172.21.15.132:0/891385724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f992006c240 msgr2=0x7f99200c4820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.487+0000 7f99273d0640 1 --2- 172.21.15.132:0/891385724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f992006c240 0x7f99200c4820 secure :-1 s=READY pgs=1888 cs=0 l=1 rev1=1 crypto rx=0x7f991c00c7f0 tx=0x7f991c00ccb0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.487+0000 7f99273d0640 1 -- 172.21.15.132:0/891385724 shutdown_connections 2023-12-20T04:53:38.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.487+0000 7f99273d0640 1 --2- 172.21.15.132:0/891385724 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f990406a430 0x7f990406c8f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.487+0000 7f99273d0640 1 --2- 172.21.15.132:0/891385724 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f992015e530 0x7f9920150620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.487+0000 7f99273d0640 1 --2- 172.21.15.132:0/891385724 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9920159b50 0x7f9920147fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.487+0000 7f99273d0640 1 --2- 172.21.15.132:0/891385724 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f992006c240 0x7f99200c4820 unknown :-1 s=CLOSED pgs=1888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.488+0000 7f99273d0640 1 -- 172.21.15.132:0/891385724 >> 172.21.15.132:0/891385724 conn(0x7f99200ced10 msgr2=0x7f99200b3830 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:38.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.488+0000 7f99273d0640 1 -- 172.21.15.132:0/891385724 shutdown_connections 2023-12-20T04:53:38.491 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.488+0000 7f99273d0640 1 -- 172.21.15.132:0/891385724 wait complete. 2023-12-20T04:53:38.501 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2023-12-20T04:42:36.131368+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '110', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 22, 'pool_name': 'cephfs_metadata', 'create_time': '2023-12-20T04:53:03.034230+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '185', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 2, 'score_stable': 2, 'optimal_score': 1, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 23, 'pool_name': 'cephfs_data', 'create_time': '2023-12-20T04:53:03.812892+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '189', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 33554432, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2023-12-20T04:53:38.501 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2023-12-20T04:53:38.603 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.602+0000 7f6025084640 1 Processor -- start 2023-12-20T04:53:38.604 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.602+0000 7f6025084640 1 -- start start 2023-12-20T04:53:38.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.602+0000 7f6025084640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f602015aee0 0x7f602015eb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.602+0000 7f6025084640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f60200cb2b0 0x7f60200cd670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.602+0000 7f6025084640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60200cdbb0 0x7f60200ceb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.602+0000 7f6025084640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60200ce040 con 0x7f60200cdbb0 2023-12-20T04:53:38.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.602+0000 7f6025084640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f60200d0130 con 0x7f60200cb2b0 2023-12-20T04:53:38.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.602+0000 7f6025084640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f602015f370 con 0x7f602015aee0 2023-12-20T04:53:38.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.603+0000 7f601f59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60200cdbb0 0x7f60200ceb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.605 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.603+0000 7f601f59e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f60200cdbb0 0x7f60200ceb60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37526/0 (socket says 172.21.15.132:37526) 2023-12-20T04:53:38.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.603+0000 7f601f59e640 1 -- 172.21.15.132:0/1690155471 learned_addr learned my addr 172.21.15.132:0/1690155471 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:38.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.603+0000 7f6017fff640 1 --2- 172.21.15.132:0/1690155471 >> v2:172.21.15.187:3300/0 conn(0x7f60200cb2b0 0x7f60200cd670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.603+0000 7f601ed9d640 1 --2- 172.21.15.132:0/1690155471 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f602015aee0 0x7f602015eb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.603+0000 7f601f59e640 1 -- 172.21.15.132:0/1690155471 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f602015aee0 msgr2=0x7f602015eb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:38.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.603+0000 7f601f59e640 1 --2- 172.21.15.132:0/1690155471 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f602015aee0 0x7f602015eb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.603+0000 7f601f59e640 1 -- 172.21.15.132:0/1690155471 >> v2:172.21.15.187:3300/0 conn(0x7f60200cb2b0 msgr2=0x7f60200cd670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:38.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.603+0000 7f601f59e640 1 --2- 172.21.15.132:0/1690155471 >> v2:172.21.15.187:3300/0 conn(0x7f60200cb2b0 0x7f60200cd670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.606 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.603+0000 7f601f59e640 1 -- 172.21.15.132:0/1690155471 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f602015f650 con 0x7f60200cdbb0 2023-12-20T04:53:38.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.604+0000 7f601f59e640 1 --2- 172.21.15.132:0/1690155471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60200cdbb0 0x7f60200ceb60 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f60200ce7e0 tx=0x7f601802bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d4a9b2044f2e901 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:38.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.604+0000 7f601e59c640 1 -- 172.21.15.132:0/1690155471 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601802ca70 con 0x7f60200cdbb0 2023-12-20T04:53:38.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.604+0000 7f601e59c640 1 -- 172.21.15.132:0/1690155471 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601802cbd0 con 0x7f60200cdbb0 2023-12-20T04:53:38.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.604+0000 7f601e59c640 1 -- 172.21.15.132:0/1690155471 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f60180343f0 con 0x7f60200cdbb0 2023-12-20T04:53:38.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.604+0000 7f6025084640 1 -- 172.21.15.132:0/1690155471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60200cdbb0 msgr2=0x7f60200ceb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.604+0000 7f6025084640 1 --2- 172.21.15.132:0/1690155471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60200cdbb0 0x7f60200ceb60 secure :-1 s=READY pgs=1889 cs=0 l=1 rev1=1 crypto rx=0x7f60200ce7e0 tx=0x7f601802bed0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.604+0000 7f6025084640 1 -- 172.21.15.132:0/1690155471 shutdown_connections 2023-12-20T04:53:38.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.604+0000 7f6025084640 1 --2- 172.21.15.132:0/1690155471 >> v2:172.21.15.187:3300/0 conn(0x7f60200cb2b0 0x7f60200cd670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.604+0000 7f6025084640 1 --2- 172.21.15.132:0/1690155471 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f60200cdbb0 0x7f60200ceb60 unknown :-1 s=CLOSED pgs=1889 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.604+0000 7f6025084640 1 --2- 172.21.15.132:0/1690155471 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f602015aee0 0x7f602015eb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.608 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.604+0000 7f6025084640 1 -- 172.21.15.132:0/1690155471 >> 172.21.15.132:0/1690155471 conn(0x7f6020072c60 msgr2=0x7f6020073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:38.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.604+0000 7f6025084640 1 -- 172.21.15.132:0/1690155471 shutdown_connections 2023-12-20T04:53:38.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.604+0000 7f6025084640 1 -- 172.21.15.132:0/1690155471 wait complete. 2023-12-20T04:53:38.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.606+0000 7f6025084640 1 Processor -- start 2023-12-20T04:53:38.609 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.606+0000 7f6025084640 1 -- start start 2023-12-20T04:53:38.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.606+0000 7f6025084640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60200cb2b0 0x7f6020155db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.606+0000 7f6025084640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60200cdbb0 0x7f6020151b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.606+0000 7f6025084640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f602015aee0 0x7f6020153280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.606+0000 7f6025084640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60201562f0 con 0x7f602015aee0 2023-12-20T04:53:38.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.606+0000 7f6025084640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6020150a80 con 0x7f60200cdbb0 2023-12-20T04:53:38.611 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.606+0000 7f6025084640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6020150d60 con 0x7f60200cb2b0 2023-12-20T04:53:38.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.606+0000 7f601f59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f602015aee0 0x7f6020153280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.606+0000 7f601f59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f602015aee0 0x7f6020153280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37540/0 (socket says 172.21.15.132:37540) 2023-12-20T04:53:38.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.606+0000 7f601f59e640 1 -- 172.21.15.132:0/1532106095 learned_addr learned my addr 172.21.15.132:0/1532106095 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:38.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.607+0000 7f601f59e640 1 -- 172.21.15.132:0/1532106095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60200cb2b0 msgr2=0x7f6020155db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.607+0000 7f601f59e640 1 --2- 172.21.15.132:0/1532106095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60200cb2b0 0x7f6020155db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.607+0000 7f601f59e640 1 -- 172.21.15.132:0/1532106095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60200cdbb0 msgr2=0x7f6020151b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.607+0000 7f6017fff640 1 --2- 172.21.15.132:0/1532106095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60200cdbb0 0x7f6020151b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.607+0000 7f601f59e640 1 --2- 172.21.15.132:0/1532106095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60200cdbb0 0x7f6020151b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.607+0000 7f601f59e640 1 -- 172.21.15.132:0/1532106095 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6018009b30 con 0x7f602015aee0 2023-12-20T04:53:38.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.607+0000 7f601f59e640 1 --2- 172.21.15.132:0/1532106095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f602015aee0 0x7f6020153280 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f6018036040 tx=0x7f6018004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:38.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.607+0000 7f60177fe640 1 -- 172.21.15.132:0/1532106095 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601803e450 con 0x7f602015aee0 2023-12-20T04:53:38.612 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.607+0000 7f60177fe640 1 -- 172.21.15.132:0/1532106095 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f601803e5d0 con 0x7f602015aee0 2023-12-20T04:53:38.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.607+0000 7f6025084640 1 -- 172.21.15.132:0/1532106095 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6020151040 con 0x7f602015aee0 2023-12-20T04:53:38.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.607+0000 7f60177fe640 1 -- 172.21.15.132:0/1532106095 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f601803e980 con 0x7f602015aee0 2023-12-20T04:53:38.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.607+0000 7f6025084640 1 -- 172.21.15.132:0/1532106095 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6020151600 con 0x7f602015aee0 2023-12-20T04:53:38.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.608+0000 7f6025084640 1 -- 172.21.15.132:0/1532106095 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602004e840 con 0x7f602015aee0 2023-12-20T04:53:38.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.608+0000 7f60177fe640 1 -- 172.21.15.132:0/1532106095 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f601803eae0 con 0x7f602015aee0 2023-12-20T04:53:38.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.609+0000 7f60177fe640 1 --2- 172.21.15.132:0/1532106095 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f600006a430 0x7f600006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.609+0000 7f60177fe640 1 -- 172.21.15.132:0/1532106095 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f60180ab7b0 con 0x7f602015aee0 2023-12-20T04:53:38.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.609+0000 7f601ed9d640 1 --2- 172.21.15.132:0/1532106095 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f600006a430 0x7f600006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.613 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.609+0000 7f601ed9d640 1 --2- 172.21.15.132:0/1532106095 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f600006a430 0x7f600006c8f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f601000a810 tx=0x7f6010008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:38.615 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.613+0000 7f60177fe640 1 -- 172.21.15.132:0/1532106095 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6018076e30 con 0x7f602015aee0 2023-12-20T04:53:38.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.776+0000 7f6025084640 1 -- 172.21.15.132:0/1532106095 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f60200c4f80 con 0x7f602015aee0 2023-12-20T04:53:38.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.777+0000 7f60177fe640 1 -- 172.21.15.132:0/1532106095 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v189) v1 ==== 93+0+10 (secure 0 0 0) 0x7f601807a450 con 0x7f602015aee0 2023-12-20T04:53:38.779 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 1 2023-12-20T04:53:38.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.779+0000 7f6025084640 1 -- 172.21.15.132:0/1532106095 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f600006a430 msgr2=0x7f600006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.779+0000 7f6025084640 1 --2- 172.21.15.132:0/1532106095 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f600006a430 0x7f600006c8f0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f601000a810 tx=0x7f6010008040 comp rx=0 tx=0).stop 2023-12-20T04:53:38.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.779+0000 7f6025084640 1 -- 172.21.15.132:0/1532106095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f602015aee0 msgr2=0x7f6020153280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.779+0000 7f6025084640 1 --2- 172.21.15.132:0/1532106095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f602015aee0 0x7f6020153280 secure :-1 s=READY pgs=1890 cs=0 l=1 rev1=1 crypto rx=0x7f6018036040 tx=0x7f6018004a40 comp rx=0 tx=0).stop 2023-12-20T04:53:38.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.779+0000 7f6025084640 1 -- 172.21.15.132:0/1532106095 shutdown_connections 2023-12-20T04:53:38.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.779+0000 7f6025084640 1 --2- 172.21.15.132:0/1532106095 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f600006a430 0x7f600006c8f0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.779+0000 7f6025084640 1 --2- 172.21.15.132:0/1532106095 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f602015aee0 0x7f6020153280 unknown :-1 s=CLOSED pgs=1890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.779+0000 7f6025084640 1 --2- 172.21.15.132:0/1532106095 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f60200cdbb0 0x7f6020151b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.779+0000 7f6025084640 1 --2- 172.21.15.132:0/1532106095 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f60200cb2b0 0x7f6020155db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.779+0000 7f6025084640 1 -- 172.21.15.132:0/1532106095 >> 172.21.15.132:0/1532106095 conn(0x7f6020072c60 msgr2=0x7f60200cb690 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:38.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.779+0000 7f6025084640 1 -- 172.21.15.132:0/1532106095 shutdown_connections 2023-12-20T04:53:38.782 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.779+0000 7f6025084640 1 -- 172.21.15.132:0/1532106095 wait complete. 2023-12-20T04:53:38.792 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2023-12-20T04:53:38.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.891+0000 7f8e9c927640 1 Processor -- start 2023-12-20T04:53:38.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.891+0000 7f8e9c927640 1 -- start start 2023-12-20T04:53:38.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.892+0000 7f8e9c927640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8e98070460 0x7f8e980ca170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.896 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.892+0000 7f8e9c927640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e980c4f40 con 0x7f8e98069c30 2023-12-20T04:53:38.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.892+0000 7f8e9c927640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f8e980af5b0 con 0x7f8e9815d360 2023-12-20T04:53:38.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.892+0000 7f8e9c927640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8e98070a40 con 0x7f8e98070460 2023-12-20T04:53:38.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.892+0000 7f8e9659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f8e98069c30 0x7f8e9806a010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36596/0 (socket says 172.21.15.132:36596) 2023-12-20T04:53:38.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.892+0000 7f8e9659c640 1 -- 172.21.15.132:0/4124279059 learned_addr learned my addr 172.21.15.132:0/4124279059 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:38.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.892+0000 7f8e96d9d640 1 --2- 172.21.15.132:0/4124279059 >> v2:172.21.15.187:3300/0 conn(0x7f8e98070460 0x7f8e980ca170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.892+0000 7f8e95d9b640 1 -- 172.21.15.132:0/4124279059 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 126146728 0 0) 0x7f8e980c4f40 con 0x7f8e98069c30 2023-12-20T04:53:38.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.892+0000 7f8e95d9b640 1 -- 172.21.15.132:0/4124279059 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f8e84003520 con 0x7f8e98069c30 2023-12-20T04:53:38.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.892+0000 7f8e95d9b640 1 -- 172.21.15.132:0/4124279059 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1319639893 0 0) 0x7f8e84003520 con 0x7f8e98069c30 2023-12-20T04:53:38.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.892+0000 7f8e95d9b640 1 -- 172.21.15.132:0/4124279059 >> v2:172.21.15.187:3300/0 conn(0x7f8e98070460 msgr2=0x7f8e980ca170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:38.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.892+0000 7f8e95d9b640 1 --2- 172.21.15.132:0/4124279059 >> v2:172.21.15.187:3300/0 conn(0x7f8e98070460 0x7f8e980ca170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.892+0000 7f8e95d9b640 1 -- 172.21.15.132:0/4124279059 >> v1:172.21.15.187:6789/0 conn(0x7f8e9815d360 legacy=0x7f8e980cbde0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.892+0000 7f8e95d9b640 1 -- 172.21.15.132:0/4124279059 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e98070d20 con 0x7f8e98069c30 2023-12-20T04:53:38.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.892+0000 7f8e95d9b640 1 -- 172.21.15.132:0/4124279059 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f8e88001670 con 0x7f8e98069c30 2023-12-20T04:53:38.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.893+0000 7f8e95d9b640 1 -- 172.21.15.132:0/4124279059 >> v1:172.21.15.132:6789/0 conn(0x7f8e98069c30 legacy=0x7f8e9806a010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.893+0000 7f8e95d9b640 1 --2- 172.21.15.132:0/4124279059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e84003970 0x7f8e84003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.893+0000 7f8e95d9b640 1 --2- 172.21.15.132:0/4124279059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e840047c0 0x7f8e84004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.893+0000 7f8e95d9b640 1 --2- 172.21.15.132:0/4124279059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e84005180 0x7f8e8400b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.893+0000 7f8e95d9b640 1 -- 172.21.15.132:0/4124279059 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e98070a40 con 0x7f8e84003970 2023-12-20T04:53:38.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.893+0000 7f8e95d9b640 1 -- 172.21.15.132:0/4124279059 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8400c020 con 0x7f8e84005180 2023-12-20T04:53:38.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.893+0000 7f8e95d9b640 1 -- 172.21.15.132:0/4124279059 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e8400c1e0 con 0x7f8e840047c0 2023-12-20T04:53:38.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.893+0000 7f8e9659c640 1 --2- 172.21.15.132:0/4124279059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e84003970 0x7f8e84003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.893+0000 7f8e96d9d640 1 --2- 172.21.15.132:0/4124279059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e84005180 0x7f8e8400b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.893+0000 7f8e8ffff640 1 --2- 172.21.15.132:0/4124279059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e840047c0 0x7f8e84004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.893+0000 7f8e9659c640 1 -- 172.21.15.132:0/4124279059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e840047c0 msgr2=0x7f8e84004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:38.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.893+0000 7f8e9659c640 1 --2- 172.21.15.132:0/4124279059 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e840047c0 0x7f8e84004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.893+0000 7f8e9659c640 1 -- 172.21.15.132:0/4124279059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e84005180 msgr2=0x7f8e8400b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:38.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.893+0000 7f8e9659c640 1 --2- 172.21.15.132:0/4124279059 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e84005180 0x7f8e8400b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.893+0000 7f8e96d9d640 1 -- 172.21.15.132:0/4124279059 reap_dead start 2023-12-20T04:53:38.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.893+0000 7f8e9659c640 1 -- 172.21.15.132:0/4124279059 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e84003520 con 0x7f8e84003970 2023-12-20T04:53:38.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.894+0000 7f8e9659c640 1 --2- 172.21.15.132:0/4124279059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e84003970 0x7f8e84003d90 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f8e8800c240 tx=0x7f8e840057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c33aab5f74bcf5f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:38.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.894+0000 7f8e95d9b640 1 -- 172.21.15.132:0/4124279059 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e88005ad0 con 0x7f8e84003970 2023-12-20T04:53:38.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.894+0000 7f8e95d9b640 1 -- 172.21.15.132:0/4124279059 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e88005c30 con 0x7f8e84003970 2023-12-20T04:53:38.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.894+0000 7f8e95d9b640 1 -- 172.21.15.132:0/4124279059 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e8802ca90 con 0x7f8e84003970 2023-12-20T04:53:38.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.894+0000 7f8e9c927640 1 -- 172.21.15.132:0/4124279059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e84003970 msgr2=0x7f8e84003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.894+0000 7f8e9c927640 1 --2- 172.21.15.132:0/4124279059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e84003970 0x7f8e84003d90 secure :-1 s=READY pgs=1892 cs=0 l=1 rev1=1 crypto rx=0x7f8e8800c240 tx=0x7f8e840057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.894+0000 7f8e9c927640 1 -- 172.21.15.132:0/4124279059 shutdown_connections 2023-12-20T04:53:38.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.894+0000 7f8e9c927640 1 --2- 172.21.15.132:0/4124279059 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e84003970 0x7f8e84003d90 unknown :-1 s=CLOSED pgs=1892 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.894+0000 7f8e9c927640 1 -- 172.21.15.132:0/4124279059 >> 172.21.15.132:0/4124279059 conn(0x7f8e980cc630 msgr2=0x7f8e980cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:38.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.894+0000 7f8e9c927640 1 -- 172.21.15.132:0/4124279059 shutdown_connections 2023-12-20T04:53:38.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.894+0000 7f8e9c927640 1 -- 172.21.15.132:0/4124279059 wait complete. 2023-12-20T04:53:38.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.896+0000 7f8e9c927640 1 Processor -- start 2023-12-20T04:53:38.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.896+0000 7f8e9c927640 1 -- start start 2023-12-20T04:53:38.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.896+0000 7f8e9c927640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e84003970 0x7f8e98159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.896+0000 7f8e9c927640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9815e120 0x7f8e980b0ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.896+0000 7f8e9c927640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e980ae870 0x7f8e980b1000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.896+0000 7f8e9c927640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e980b2a90 con 0x7f8e980ae870 2023-12-20T04:53:38.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.896+0000 7f8e9c927640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e9815a190 con 0x7f8e84003970 2023-12-20T04:53:38.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.896+0000 7f8e9c927640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8e981606b0 con 0x7f8e9815e120 2023-12-20T04:53:38.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.897+0000 7f8e96d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e980ae870 0x7f8e980b1000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.902 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.897+0000 7f8e96d9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e980ae870 0x7f8e980b1000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37558/0 (socket says 172.21.15.132:37558) 2023-12-20T04:53:38.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.897+0000 7f8e96d9d640 1 -- 172.21.15.132:0/3974820891 learned_addr learned my addr 172.21.15.132:0/3974820891 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:38.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.897+0000 7f8e9659c640 1 --2- 172.21.15.132:0/3974820891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e84003970 0x7f8e98159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.897+0000 7f8e8ffff640 1 --2- 172.21.15.132:0/3974820891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9815e120 0x7f8e980b0ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.897+0000 7f8e96d9d640 1 -- 172.21.15.132:0/3974820891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9815e120 msgr2=0x7f8e980b0ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.897+0000 7f8e96d9d640 1 --2- 172.21.15.132:0/3974820891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9815e120 0x7f8e980b0ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.897+0000 7f8e96d9d640 1 -- 172.21.15.132:0/3974820891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e84003970 msgr2=0x7f8e98159c50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:38.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.897+0000 7f8e96d9d640 1 --2- 172.21.15.132:0/3974820891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e84003970 0x7f8e98159c50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:38.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.897+0000 7f8e96d9d640 1 -- 172.21.15.132:0/3974820891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e9815fe10 con 0x7f8e980ae870 2023-12-20T04:53:38.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.897+0000 7f8e96d9d640 1 --2- 172.21.15.132:0/3974820891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e980ae870 0x7f8e980b1000 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f8e98071820 tx=0x7f8e9000f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:38.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.897+0000 7f8e8effd640 1 -- 172.21.15.132:0/3974820891 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e9000e040 con 0x7f8e980ae870 2023-12-20T04:53:38.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.897+0000 7f8e8effd640 1 -- 172.21.15.132:0/3974820891 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8e9000f040 con 0x7f8e980ae870 2023-12-20T04:53:38.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.897+0000 7f8e9c927640 1 -- 172.21.15.132:0/3974820891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e981600f0 con 0x7f8e980ae870 2023-12-20T04:53:38.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.897+0000 7f8e8effd640 1 -- 172.21.15.132:0/3974820891 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8e90015430 con 0x7f8e980ae870 2023-12-20T04:53:38.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.897+0000 7f8e9c927640 1 -- 172.21.15.132:0/3974820891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e9815f880 con 0x7f8e980ae870 2023-12-20T04:53:38.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.898+0000 7f8e9c927640 1 -- 172.21.15.132:0/3974820891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e980b2bd0 con 0x7f8e980ae870 2023-12-20T04:53:38.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.899+0000 7f8e8effd640 1 -- 172.21.15.132:0/3974820891 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8e90015590 con 0x7f8e980ae870 2023-12-20T04:53:38.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.899+0000 7f8e8effd640 1 --2- 172.21.15.132:0/3974820891 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8e7806a460 0x7f8e7806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:38.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.899+0000 7f8e8effd640 1 -- 172.21.15.132:0/3974820891 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f8e90088e70 con 0x7f8e980ae870 2023-12-20T04:53:38.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.899+0000 7f8e9659c640 1 --2- 172.21.15.132:0/3974820891 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8e7806a460 0x7f8e7806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:38.904 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.899+0000 7f8e9659c640 1 --2- 172.21.15.132:0/3974820891 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8e7806a460 0x7f8e7806c920 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8e88034000 tx=0x7f8e88009030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:38.905 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:38.903+0000 7f8e8effd640 1 -- 172.21.15.132:0/3974820891 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8e980b2bd0 con 0x7f8e980ae870 2023-12-20T04:53:39.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.068+0000 7f8e9c927640 1 -- 172.21.15.132:0/3974820891 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) v1 -- 0x7f8e980b2bd0 con 0x7f8e980ae870 2023-12-20T04:53:39.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.068+0000 7f8e8effd640 1 -- 172.21.15.132:0/3974820891 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v189) v1 ==== 104+0+11 (secure 0 0 0) 0x7f8e980b2bd0 con 0x7f8e980ae870 2023-12-20T04:53:39.070 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 32 2023-12-20T04:53:39.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.070+0000 7f8e9c927640 1 -- 172.21.15.132:0/3974820891 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8e7806a460 msgr2=0x7f8e7806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.070+0000 7f8e9c927640 1 --2- 172.21.15.132:0/3974820891 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8e7806a460 0x7f8e7806c920 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f8e88034000 tx=0x7f8e88009030 comp rx=0 tx=0).stop 2023-12-20T04:53:39.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.070+0000 7f8e9c927640 1 -- 172.21.15.132:0/3974820891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e980ae870 msgr2=0x7f8e980b1000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.070+0000 7f8e9c927640 1 --2- 172.21.15.132:0/3974820891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e980ae870 0x7f8e980b1000 secure :-1 s=READY pgs=1893 cs=0 l=1 rev1=1 crypto rx=0x7f8e98071820 tx=0x7f8e9000f1b0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.070+0000 7f8e9c927640 1 -- 172.21.15.132:0/3974820891 shutdown_connections 2023-12-20T04:53:39.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.070+0000 7f8e9c927640 1 --2- 172.21.15.132:0/3974820891 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8e7806a460 0x7f8e7806c920 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.070+0000 7f8e9c927640 1 --2- 172.21.15.132:0/3974820891 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8e980ae870 0x7f8e980b1000 unknown :-1 s=CLOSED pgs=1893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.070+0000 7f8e9c927640 1 --2- 172.21.15.132:0/3974820891 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8e9815e120 0x7f8e980b0ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.070+0000 7f8e9c927640 1 --2- 172.21.15.132:0/3974820891 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8e84003970 0x7f8e98159c50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.070+0000 7f8e9c927640 1 -- 172.21.15.132:0/3974820891 >> 172.21.15.132:0/3974820891 conn(0x7f8e980cc630 msgr2=0x7f8e9806e820 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:39.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.070+0000 7f8e9c927640 1 -- 172.21.15.132:0/3974820891 shutdown_connections 2023-12-20T04:53:39.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.070+0000 7f8e9c927640 1 -- 172.21.15.132:0/3974820891 wait complete. 2023-12-20T04:53:39.083 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2023-12-20T04:53:39.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.184+0000 7f448ddce640 1 Processor -- start 2023-12-20T04:53:39.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.184+0000 7f448ddce640 1 -- start start 2023-12-20T04:53:39.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.184+0000 7f448ddce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f44880ca170 0x7f44880ca5d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.184+0000 7f448ddce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4488069c30 0x7f448806a0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.185+0000 7f448ddce640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f44880c4f40 con 0x7f44881447b0 2023-12-20T04:53:39.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.185+0000 7f448ddce640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f448806a600 con 0x7f44880ca170 2023-12-20T04:53:39.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.185+0000 7f448ddce640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f44880c6380 con 0x7f4488069c30 2023-12-20T04:53:39.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.185+0000 7f4486ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f44880ca170 0x7f44880ca5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:39.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.185+0000 7f4486ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f44880ca170 0x7f44880ca5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37570/0 (socket says 172.21.15.132:37570) 2023-12-20T04:53:39.187 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.185+0000 7f4486ffd640 1 -- 172.21.15.132:0/3457082280 learned_addr learned my addr 172.21.15.132:0/3457082280 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:39.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.185+0000 7f44877fe640 1 --1- 172.21.15.132:0/3457082280 >> v1:172.21.15.132:6789/0 conn(0x7f44881447b0 0x7f44880c5c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36598/0 (socket says 172.21.15.132:36598) 2023-12-20T04:53:39.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.185+0000 7f4486ffd640 1 -- 172.21.15.132:0/3457082280 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4488069c30 msgr2=0x7f448806a0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:39.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.185+0000 7f4486ffd640 1 --2- 172.21.15.132:0/3457082280 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4488069c30 0x7f448806a0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.185+0000 7f4486ffd640 1 -- 172.21.15.132:0/3457082280 >> v1:172.21.15.132:6789/0 conn(0x7f44881447b0 legacy=0x7f44880c5c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.185+0000 7f4486ffd640 1 -- 172.21.15.132:0/3457082280 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4488144b90 con 0x7f44880ca170 2023-12-20T04:53:39.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.185+0000 7f44867fc640 1 -- 172.21.15.132:0/3457082280 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2911141659 0 0) 0x7f44880c4f40 con 0x7f44881447b0 2023-12-20T04:53:39.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.186+0000 7f4486ffd640 1 --2- 172.21.15.132:0/3457082280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44880ca170 0x7f44880ca5d0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f447c0098a0 tx=0x7f447c02b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec5c49ed8c85abbc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:39.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.186+0000 7f44867fc640 1 -- 172.21.15.132:0/3457082280 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c031640 con 0x7f44880ca170 2023-12-20T04:53:39.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.186+0000 7f44867fc640 1 -- 172.21.15.132:0/3457082280 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c0317a0 con 0x7f44880ca170 2023-12-20T04:53:39.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.186+0000 7f44867fc640 1 -- 172.21.15.132:0/3457082280 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c031b30 con 0x7f44880ca170 2023-12-20T04:53:39.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.186+0000 7f448ddce640 1 -- 172.21.15.132:0/3457082280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44880ca170 msgr2=0x7f44880ca5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.186+0000 7f448ddce640 1 --2- 172.21.15.132:0/3457082280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44880ca170 0x7f44880ca5d0 secure :-1 s=READY pgs=1895 cs=0 l=1 rev1=1 crypto rx=0x7f447c0098a0 tx=0x7f447c02b8f0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.186+0000 7f448ddce640 1 -- 172.21.15.132:0/3457082280 shutdown_connections 2023-12-20T04:53:39.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.186+0000 7f448ddce640 1 --2- 172.21.15.132:0/3457082280 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4488069c30 0x7f448806a0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.186+0000 7f448ddce640 1 --2- 172.21.15.132:0/3457082280 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44880ca170 0x7f44880ca5d0 unknown :-1 s=CLOSED pgs=1895 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.186+0000 7f448ddce640 1 -- 172.21.15.132:0/3457082280 >> 172.21.15.132:0/3457082280 conn(0x7f44880cc630 msgr2=0x7f44880cca10 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:39.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.186+0000 7f448ddce640 1 -- 172.21.15.132:0/3457082280 shutdown_connections 2023-12-20T04:53:39.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.186+0000 7f448ddce640 1 -- 172.21.15.132:0/3457082280 wait complete. 2023-12-20T04:53:39.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.187+0000 7f448ddce640 1 Processor -- start 2023-12-20T04:53:39.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.188+0000 7f448ddce640 1 -- start start 2023-12-20T04:53:39.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.188+0000 7f448ddce640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4488069c30 0x7f448815a6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.188+0000 7f448ddce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44880ca170 0x7f448815d410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.188+0000 7f448ddce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44881447b0 0x7f44880b3240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.188+0000 7f448ddce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44880b2db0 con 0x7f44880ca170 2023-12-20T04:53:39.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.188+0000 7f448ddce640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f448815deb0 con 0x7f4488069c30 2023-12-20T04:53:39.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.188+0000 7f448ddce640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f448815e190 con 0x7f44881447b0 2023-12-20T04:53:39.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.188+0000 7f4486ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44880ca170 0x7f448815d410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:39.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.189+0000 7f4486ffd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44880ca170 0x7f448815d410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37584/0 (socket says 172.21.15.132:37584) 2023-12-20T04:53:39.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.189+0000 7f4486ffd640 1 -- 172.21.15.132:0/1783817415 learned_addr learned my addr 172.21.15.132:0/1783817415 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:39.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.189+0000 7f44877fe640 1 --2- 172.21.15.132:0/1783817415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4488069c30 0x7f448815a6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:39.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.189+0000 7f4487fff640 1 --2- 172.21.15.132:0/1783817415 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44881447b0 0x7f44880b3240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:39.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.189+0000 7f4486ffd640 1 -- 172.21.15.132:0/1783817415 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44881447b0 msgr2=0x7f44880b3240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.189+0000 7f4486ffd640 1 --2- 172.21.15.132:0/1783817415 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44881447b0 0x7f44880b3240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.189+0000 7f4486ffd640 1 -- 172.21.15.132:0/1783817415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4488069c30 msgr2=0x7f448815a6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.189+0000 7f4486ffd640 1 --2- 172.21.15.132:0/1783817415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4488069c30 0x7f448815a6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.189+0000 7f4486ffd640 1 -- 172.21.15.132:0/1783817415 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f447c0094d0 con 0x7f44880ca170 2023-12-20T04:53:39.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.189+0000 7f44877fe640 1 --2- 172.21.15.132:0/1783817415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4488069c30 0x7f448815a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:39.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.189+0000 7f4487fff640 1 --2- 172.21.15.132:0/1783817415 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44881447b0 0x7f44880b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:39.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.189+0000 7f4486ffd640 1 --2- 172.21.15.132:0/1783817415 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44880ca170 0x7f448815d410 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f447c000c00 tx=0x7f447c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:39.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.189+0000 7f446ffff640 1 -- 172.21.15.132:0/1783817415 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c03ac60 con 0x7f44880ca170 2023-12-20T04:53:39.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.189+0000 7f446ffff640 1 -- 172.21.15.132:0/1783817415 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f447c03adc0 con 0x7f44880ca170 2023-12-20T04:53:39.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.189+0000 7f448ddce640 1 -- 172.21.15.132:0/1783817415 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44880b2a40 con 0x7f44880ca170 2023-12-20T04:53:39.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.189+0000 7f446ffff640 1 -- 172.21.15.132:0/1783817415 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f447c044630 con 0x7f44880ca170 2023-12-20T04:53:39.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.189+0000 7f448ddce640 1 -- 172.21.15.132:0/1783817415 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f448815abe0 con 0x7f44880ca170 2023-12-20T04:53:39.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.190+0000 7f448ddce640 1 -- 172.21.15.132:0/1783817415 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f448804e840 con 0x7f44880ca170 2023-12-20T04:53:39.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.190+0000 7f446ffff640 1 -- 172.21.15.132:0/1783817415 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f447c02f050 con 0x7f44880ca170 2023-12-20T04:53:39.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.191+0000 7f446ffff640 1 --2- 172.21.15.132:0/1783817415 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f447406a430 0x7f447406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.191+0000 7f44877fe640 1 --2- 172.21.15.132:0/1783817415 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f447406a430 0x7f447406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:39.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.191+0000 7f446ffff640 1 -- 172.21.15.132:0/1783817415 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f447c0aa960 con 0x7f44880ca170 2023-12-20T04:53:39.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.191+0000 7f44877fe640 1 --2- 172.21.15.132:0/1783817415 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f447406a430 0x7f447406c8f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4478000f60 tx=0x7f4478007c10 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:39.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.195+0000 7f446ffff640 1 -- 172.21.15.132:0/1783817415 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f447c075f50 con 0x7f44880ca170 2023-12-20T04:53:39.361 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.359+0000 7f448ddce640 1 -- 172.21.15.132:0/1783817415 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) v1 -- 0x7f448815e350 con 0x7f44880ca170 2023-12-20T04:53:39.362 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.360+0000 7f446ffff640 1 -- 172.21.15.132:0/1783817415 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v189) v1 ==== 100+0+11 (secure 0 0 0) 0x7f447c031e60 con 0x7f44880ca170 2023-12-20T04:53:39.362 INFO:teuthology.orchestra.run.smithi132.stdout:pg_num: 64 2023-12-20T04:53:39.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.361+0000 7f448ddce640 1 -- 172.21.15.132:0/1783817415 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f447406a430 msgr2=0x7f447406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.361+0000 7f448ddce640 1 --2- 172.21.15.132:0/1783817415 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f447406a430 0x7f447406c8f0 secure :-1 s=READY pgs=794 cs=0 l=1 rev1=1 crypto rx=0x7f4478000f60 tx=0x7f4478007c10 comp rx=0 tx=0).stop 2023-12-20T04:53:39.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.361+0000 7f448ddce640 1 -- 172.21.15.132:0/1783817415 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44880ca170 msgr2=0x7f448815d410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.361+0000 7f448ddce640 1 --2- 172.21.15.132:0/1783817415 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44880ca170 0x7f448815d410 secure :-1 s=READY pgs=1896 cs=0 l=1 rev1=1 crypto rx=0x7f447c000c00 tx=0x7f447c0046c0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.361+0000 7f448ddce640 1 -- 172.21.15.132:0/1783817415 shutdown_connections 2023-12-20T04:53:39.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.361+0000 7f448ddce640 1 --2- 172.21.15.132:0/1783817415 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f447406a430 0x7f447406c8f0 unknown :-1 s=CLOSED pgs=794 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.361+0000 7f448ddce640 1 --2- 172.21.15.132:0/1783817415 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f44881447b0 0x7f44880b3240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.361+0000 7f448ddce640 1 --2- 172.21.15.132:0/1783817415 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f44880ca170 0x7f448815d410 unknown :-1 s=CLOSED pgs=1896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.361+0000 7f448ddce640 1 --2- 172.21.15.132:0/1783817415 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4488069c30 0x7f448815a6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.362+0000 7f448ddce640 1 -- 172.21.15.132:0/1783817415 >> 172.21.15.132:0/1783817415 conn(0x7f44880cc630 msgr2=0x7f44880c5c70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:39.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.362+0000 7f448ddce640 1 -- 172.21.15.132:0/1783817415 shutdown_connections 2023-12-20T04:53:39.364 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.362+0000 7f448ddce640 1 -- 172.21.15.132:0/1783817415 wait complete. 2023-12-20T04:53:39.375 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:53:39.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.472+0000 7f495f100640 1 Processor -- start 2023-12-20T04:53:39.474 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.472+0000 7f495f100640 1 -- start start 2023-12-20T04:53:39.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.473+0000 7f495f100640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4958160450 0x7f4958160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.473+0000 7f495f100640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49581611b0 0x7f49580b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.473+0000 7f495f100640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f49580b5ec0 con 0x7f49580b4ec0 2023-12-20T04:53:39.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.473+0000 7f495f100640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f49580b5350 con 0x7f4958160450 2023-12-20T04:53:39.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.473+0000 7f495f100640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49581617e0 con 0x7f49581611b0 2023-12-20T04:53:39.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.473+0000 7f495ce9c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4958160450 0x7f4958160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:39.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.473+0000 7f495ce9c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f4958160450 0x7f4958160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37586/0 (socket says 172.21.15.132:37586) 2023-12-20T04:53:39.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.473+0000 7f495ce9c640 1 -- 172.21.15.132:0/3762884963 learned_addr learned my addr 172.21.15.132:0/3762884963 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:39.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.473+0000 7f495d69d640 1 --1- 172.21.15.132:0/3762884963 >> v1:172.21.15.132:6789/0 conn(0x7f49580b4ec0 0x7f495806a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36608/0 (socket says 172.21.15.132:36608) 2023-12-20T04:53:39.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.474+0000 7f4957fff640 1 --2- 172.21.15.132:0/3762884963 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49581611b0 0x7f49580b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:39.476 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.474+0000 7f495ce9c640 1 -- 172.21.15.132:0/3762884963 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49581611b0 msgr2=0x7f49580b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:39.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.474+0000 7f495ce9c640 1 --2- 172.21.15.132:0/3762884963 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49581611b0 0x7f49580b4980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.474+0000 7f495ce9c640 1 -- 172.21.15.132:0/3762884963 >> v1:172.21.15.132:6789/0 conn(0x7f49580b4ec0 legacy=0x7f495806a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.474+0000 7f49577fe640 1 -- 172.21.15.132:0/3762884963 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 187198687 0 0) 0x7f49580b5ec0 con 0x7f49580b4ec0 2023-12-20T04:53:39.477 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.474+0000 7f495ce9c640 1 -- 172.21.15.132:0/3762884963 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49580d0fc0 con 0x7f4958160450 2023-12-20T04:53:39.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.474+0000 7f495ce9c640 1 --2- 172.21.15.132:0/3762884963 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4958160450 0x7f4958160c70 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f4948009870 tx=0x7f494802ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d53aee92cb426dc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:39.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.475+0000 7f49577fe640 1 -- 172.21.15.132:0/3762884963 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494802f840 con 0x7f4958160450 2023-12-20T04:53:39.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.475+0000 7f49577fe640 1 -- 172.21.15.132:0/3762884963 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f494802f9a0 con 0x7f4958160450 2023-12-20T04:53:39.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.475+0000 7f49577fe640 1 -- 172.21.15.132:0/3762884963 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f494802fd30 con 0x7f4958160450 2023-12-20T04:53:39.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.475+0000 7f495f100640 1 -- 172.21.15.132:0/3762884963 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4958160450 msgr2=0x7f4958160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.475+0000 7f495f100640 1 --2- 172.21.15.132:0/3762884963 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4958160450 0x7f4958160c70 secure :-1 s=READY pgs=1898 cs=0 l=1 rev1=1 crypto rx=0x7f4948009870 tx=0x7f494802ba20 comp rx=0 tx=0).stop 2023-12-20T04:53:39.478 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.475+0000 7f495f100640 1 -- 172.21.15.132:0/3762884963 shutdown_connections 2023-12-20T04:53:39.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.475+0000 7f495f100640 1 --2- 172.21.15.132:0/3762884963 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49581611b0 0x7f49580b4980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.475+0000 7f495f100640 1 --2- 172.21.15.132:0/3762884963 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4958160450 0x7f4958160c70 unknown :-1 s=CLOSED pgs=1898 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.475+0000 7f495f100640 1 -- 172.21.15.132:0/3762884963 >> 172.21.15.132:0/3762884963 conn(0x7f49580cf980 msgr2=0x7f49580cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:39.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.475+0000 7f495f100640 1 -- 172.21.15.132:0/3762884963 shutdown_connections 2023-12-20T04:53:39.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.475+0000 7f495f100640 1 -- 172.21.15.132:0/3762884963 wait complete. 2023-12-20T04:53:39.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.476+0000 7f495f100640 1 Processor -- start 2023-12-20T04:53:39.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.476+0000 7f495f100640 1 -- start start 2023-12-20T04:53:39.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.477+0000 7f495f100640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49580b4ec0 0x7f4958157b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.477+0000 7f495f100640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4958160450 0x7f49580cb300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.477+0000 7f495f100640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49581611b0 0x7f495815a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.477+0000 7f495f100640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49580cb840 con 0x7f49580b4ec0 2023-12-20T04:53:39.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.477+0000 7f495f100640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4958141f40 con 0x7f4958160450 2023-12-20T04:53:39.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.477+0000 7f495f100640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f49580cbaa0 con 0x7f49581611b0 2023-12-20T04:53:39.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.477+0000 7f495ce9c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49580b4ec0 0x7f4958157b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:39.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.477+0000 7f495ce9c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49580b4ec0 0x7f4958157b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37596/0 (socket says 172.21.15.132:37596) 2023-12-20T04:53:39.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.477+0000 7f495ce9c640 1 -- 172.21.15.132:0/3256403083 learned_addr learned my addr 172.21.15.132:0/3256403083 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:39.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.477+0000 7f495d69d640 1 --2- 172.21.15.132:0/3256403083 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49581611b0 0x7f495815a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:39.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.477+0000 7f4957fff640 1 --2- 172.21.15.132:0/3256403083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4958160450 0x7f49580cb300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:39.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.478+0000 7f495ce9c640 1 -- 172.21.15.132:0/3256403083 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49581611b0 msgr2=0x7f495815a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.478+0000 7f495ce9c640 1 --2- 172.21.15.132:0/3256403083 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49581611b0 0x7f495815a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.478+0000 7f495ce9c640 1 -- 172.21.15.132:0/3256403083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4958160450 msgr2=0x7f49580cb300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.478+0000 7f495ce9c640 1 --2- 172.21.15.132:0/3256403083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4958160450 0x7f49580cb300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.478+0000 7f495ce9c640 1 -- 172.21.15.132:0/3256403083 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49480094d0 con 0x7f49580b4ec0 2023-12-20T04:53:39.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.478+0000 7f495d69d640 1 --2- 172.21.15.132:0/3256403083 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49581611b0 0x7f495815a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:39.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.478+0000 7f495ce9c640 1 --2- 172.21.15.132:0/3256403083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49580b4ec0 0x7f4958157b40 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f4948000c00 tx=0x7f4948004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:39.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.478+0000 7f49557fa640 1 -- 172.21.15.132:0/3256403083 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948037c40 con 0x7f49580b4ec0 2023-12-20T04:53:39.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.478+0000 7f49557fa640 1 -- 172.21.15.132:0/3256403083 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f4948037da0 con 0x7f49580b4ec0 2023-12-20T04:53:39.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.478+0000 7f495f100640 1 -- 172.21.15.132:0/3256403083 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49580cbd80 con 0x7f49580b4ec0 2023-12-20T04:53:39.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.478+0000 7f49557fa640 1 -- 172.21.15.132:0/3256403083 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4948041640 con 0x7f49580b4ec0 2023-12-20T04:53:39.482 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.478+0000 7f495f100640 1 -- 172.21.15.132:0/3256403083 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49580cc340 con 0x7f49580b4ec0 2023-12-20T04:53:39.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.479+0000 7f495f100640 1 -- 172.21.15.132:0/3256403083 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f495804e840 con 0x7f49580b4ec0 2023-12-20T04:53:39.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.480+0000 7f49557fa640 1 -- 172.21.15.132:0/3256403083 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f49480417a0 con 0x7f49580b4ec0 2023-12-20T04:53:39.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.480+0000 7f49557fa640 1 --2- 172.21.15.132:0/3256403083 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f494406a430 0x7f494406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.480+0000 7f49557fa640 1 -- 172.21.15.132:0/3256403083 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f494803c070 con 0x7f49580b4ec0 2023-12-20T04:53:39.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.480+0000 7f4957fff640 1 --2- 172.21.15.132:0/3256403083 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f494406a430 0x7f494406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:39.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.480+0000 7f4957fff640 1 --2- 172.21.15.132:0/3256403083 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f494406a430 0x7f494406c8f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4958160cf0 tx=0x7f494c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:39.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.484+0000 7f49557fa640 1 -- 172.21.15.132:0/3256403083 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f4948076be0 con 0x7f49580b4ec0 2023-12-20T04:53:39.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.684+0000 7f495f100640 1 -- 172.21.15.132:0/3256403083 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f49580d0ad0 con 0x7f49580b4ec0 2023-12-20T04:53:39.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.684+0000 7f49557fa640 1 -- 172.21.15.132:0/3256403083 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4722 (secure 0 0 0) 0x7f494807a200 con 0x7f49580b4ec0 2023-12-20T04:53:39.687 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:39.687 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":70,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3443409957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3443409957},{"type":"v1","addr":"172.21.15.187:6833","nonce":3443409957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/321445180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":321445180},{"type":"v1","addr":"172.21.15.187:6835","nonce":321445180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1166803529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1166803529},{"type":"v1","addr":"172.21.15.132:6836","nonce":1166803529}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:53:04.838088+0000","modified":"2023-12-20T04:53:07.506024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9117":{"gid":9117,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/2356846201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2356846201},{"type":"v1","addr":"172.21.15.132:6837","nonce":2356846201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-20T04:53:39.687 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 70 2023-12-20T04:53:39.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.686+0000 7f495f100640 1 -- 172.21.15.132:0/3256403083 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f494406a430 msgr2=0x7f494406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.686+0000 7f495f100640 1 --2- 172.21.15.132:0/3256403083 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f494406a430 0x7f494406c8f0 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f4958160cf0 tx=0x7f494c008040 comp rx=0 tx=0).stop 2023-12-20T04:53:39.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.686+0000 7f495f100640 1 -- 172.21.15.132:0/3256403083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49580b4ec0 msgr2=0x7f4958157b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.686+0000 7f495f100640 1 --2- 172.21.15.132:0/3256403083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49580b4ec0 0x7f4958157b40 secure :-1 s=READY pgs=1899 cs=0 l=1 rev1=1 crypto rx=0x7f4948000c00 tx=0x7f4948004730 comp rx=0 tx=0).stop 2023-12-20T04:53:39.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.686+0000 7f495f100640 1 -- 172.21.15.132:0/3256403083 shutdown_connections 2023-12-20T04:53:39.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.686+0000 7f495f100640 1 --2- 172.21.15.132:0/3256403083 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f494406a430 0x7f494406c8f0 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.686+0000 7f495f100640 1 --2- 172.21.15.132:0/3256403083 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f49581611b0 0x7f495815a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.686+0000 7f495f100640 1 --2- 172.21.15.132:0/3256403083 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4958160450 0x7f49580cb300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.686+0000 7f495f100640 1 --2- 172.21.15.132:0/3256403083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f49580b4ec0 0x7f4958157b40 unknown :-1 s=CLOSED pgs=1899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.686+0000 7f495f100640 1 -- 172.21.15.132:0/3256403083 >> 172.21.15.132:0/3256403083 conn(0x7f49580cf980 msgr2=0x7f4958155190 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:39.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.687+0000 7f495f100640 1 -- 172.21.15.132:0/3256403083 shutdown_connections 2023-12-20T04:53:39.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.687+0000 7f495f100640 1 -- 172.21.15.132:0/3256403083 wait complete. 2023-12-20T04:53:39.700 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:53:39.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.796+0000 7f9cb11ab640 1 Processor -- start 2023-12-20T04:53:39.798 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.796+0000 7f9cb11ab640 1 -- start start 2023-12-20T04:53:39.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.797+0000 7f9cb11ab640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9cac15d100 0x7f9cac0b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.799 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.797+0000 7f9cb11ab640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9cac0d0370 0x7f9cac0cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.797+0000 7f9cb11ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cac161850 0x7f9cac0cda40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.797+0000 7f9cb11ab640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cac0b2f90 con 0x7f9cac0d0370 2023-12-20T04:53:39.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.797+0000 7f9cb11ab640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9cac1613c0 con 0x7f9cac15d100 2023-12-20T04:53:39.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.797+0000 7f9cb11ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac0d0810 con 0x7f9cac161850 2023-12-20T04:53:39.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.797+0000 7f9ca3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9cac0d0370 0x7f9cac0cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:39.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.797+0000 7f9ca3fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9cac0d0370 0x7f9cac0cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37598/0 (socket says 172.21.15.132:37598) 2023-12-20T04:53:39.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.797+0000 7f9ca3fff640 1 -- 172.21.15.132:0/393721206 learned_addr learned my addr 172.21.15.132:0/393721206 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:39.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.797+0000 7f9cab59e640 1 --2- 172.21.15.132:0/393721206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cac161850 0x7f9cac0cda40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:39.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.797+0000 7f9ca3fff640 1 -- 172.21.15.132:0/393721206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cac161850 msgr2=0x7f9cac0cda40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:39.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.797+0000 7f9caad9d640 1 --2- 172.21.15.132:0/393721206 >> v2:172.21.15.187:3300/0 conn(0x7f9cac15d100 0x7f9cac0b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:39.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.797+0000 7f9ca3fff640 1 --2- 172.21.15.132:0/393721206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cac161850 0x7f9cac0cda40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.797+0000 7f9ca3fff640 1 -- 172.21.15.132:0/393721206 >> v2:172.21.15.187:3300/0 conn(0x7f9cac15d100 msgr2=0x7f9cac0b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:39.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.797+0000 7f9ca3fff640 1 --2- 172.21.15.132:0/393721206 >> v2:172.21.15.187:3300/0 conn(0x7f9cac15d100 0x7f9cac0b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.800 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.797+0000 7f9ca3fff640 1 -- 172.21.15.132:0/393721206 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9cac160d70 con 0x7f9cac0d0370 2023-12-20T04:53:39.801 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.797+0000 7f9caad9d640 1 --2- 172.21.15.132:0/393721206 >> v2:172.21.15.187:3300/0 conn(0x7f9cac15d100 0x7f9cac0b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:39.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.798+0000 7f9ca3fff640 1 --2- 172.21.15.132:0/393721206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cac0d0370 0x7f9cac0cd500 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f9cac06e5e0 tx=0x7f9c9402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d25e40f90a8dea6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:39.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.798+0000 7f9caa59c640 1 -- 172.21.15.132:0/393721206 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94031870 con 0x7f9cac0d0370 2023-12-20T04:53:39.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.798+0000 7f9caa59c640 1 -- 172.21.15.132:0/393721206 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9c940319d0 con 0x7f9cac0d0370 2023-12-20T04:53:39.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.798+0000 7f9caa59c640 1 -- 172.21.15.132:0/393721206 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9c94031d60 con 0x7f9cac0d0370 2023-12-20T04:53:39.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.799+0000 7f9cb11ab640 1 -- 172.21.15.132:0/393721206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cac0d0370 msgr2=0x7f9cac0cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.802 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.799+0000 7f9cb11ab640 1 --2- 172.21.15.132:0/393721206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cac0d0370 0x7f9cac0cd500 secure :-1 s=READY pgs=1900 cs=0 l=1 rev1=1 crypto rx=0x7f9cac06e5e0 tx=0x7f9c9402b910 comp rx=0 tx=0).stop 2023-12-20T04:53:39.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.799+0000 7f9cb11ab640 1 -- 172.21.15.132:0/393721206 shutdown_connections 2023-12-20T04:53:39.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.799+0000 7f9cb11ab640 1 --2- 172.21.15.132:0/393721206 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cac161850 0x7f9cac0cda40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.799+0000 7f9cb11ab640 1 --2- 172.21.15.132:0/393721206 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cac0d0370 0x7f9cac0cd500 unknown :-1 s=CLOSED pgs=1900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.799+0000 7f9cb11ab640 1 --2- 172.21.15.132:0/393721206 >> v2:172.21.15.187:3300/0 conn(0x7f9cac15d100 0x7f9cac0b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.799+0000 7f9cb11ab640 1 -- 172.21.15.132:0/393721206 >> 172.21.15.132:0/393721206 conn(0x7f9cac06d7c0 msgr2=0x7f9cac06dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:39.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.799+0000 7f9cb11ab640 1 -- 172.21.15.132:0/393721206 shutdown_connections 2023-12-20T04:53:39.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.799+0000 7f9cb11ab640 1 -- 172.21.15.132:0/393721206 wait complete. 2023-12-20T04:53:39.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.800+0000 7f9cb11ab640 1 Processor -- start 2023-12-20T04:53:39.803 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.800+0000 7f9cb11ab640 1 -- start start 2023-12-20T04:53:39.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.801+0000 7f9cb11ab640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cac0d0370 0x7f9cac1f2420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.801+0000 7f9cb11ab640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cac15d100 0x7f9cac156830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.801+0000 7f9cb11ab640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cac161850 0x7f9cac15f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.801+0000 7f9cb11ab640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac155bf0 con 0x7f9cac161850 2023-12-20T04:53:39.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.801+0000 7f9cb11ab640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac1571a0 con 0x7f9cac0d0370 2023-12-20T04:53:39.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.801+0000 7f9cb11ab640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9cac157480 con 0x7f9cac15d100 2023-12-20T04:53:39.805 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.801+0000 7f9cab59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cac161850 0x7f9cac15f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:39.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.801+0000 7f9cab59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cac161850 0x7f9cac15f2a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37614/0 (socket says 172.21.15.132:37614) 2023-12-20T04:53:39.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.801+0000 7f9cab59e640 1 -- 172.21.15.132:0/4110711375 learned_addr learned my addr 172.21.15.132:0/4110711375 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:39.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.801+0000 7f9caad9d640 1 --2- 172.21.15.132:0/4110711375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cac0d0370 0x7f9cac1f2420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:39.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.801+0000 7f9cab59e640 1 -- 172.21.15.132:0/4110711375 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cac15d100 msgr2=0x7f9cac156830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.801+0000 7f9cab59e640 1 --2- 172.21.15.132:0/4110711375 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cac15d100 0x7f9cac156830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.801+0000 7f9cab59e640 1 -- 172.21.15.132:0/4110711375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cac0d0370 msgr2=0x7f9cac1f2420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.801+0000 7f9cab59e640 1 --2- 172.21.15.132:0/4110711375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cac0d0370 0x7f9cac1f2420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.801+0000 7f9cab59e640 1 -- 172.21.15.132:0/4110711375 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c940094d0 con 0x7f9cac161850 2023-12-20T04:53:39.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.801+0000 7f9caad9d640 1 --2- 172.21.15.132:0/4110711375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cac0d0370 0x7f9cac1f2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:39.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.801+0000 7f9cab59e640 1 --2- 172.21.15.132:0/4110711375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cac161850 0x7f9cac15f2a0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400cc30 tx=0x7f9ca400a5c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:39.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.802+0000 7f9ca37fe640 1 -- 172.21.15.132:0/4110711375 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca400ce40 con 0x7f9cac161850 2023-12-20T04:53:39.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.802+0000 7f9ca37fe640 1 -- 172.21.15.132:0/4110711375 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9ca4003990 con 0x7f9cac161850 2023-12-20T04:53:39.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.802+0000 7f9cb11ab640 1 -- 172.21.15.132:0/4110711375 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9cac157760 con 0x7f9cac161850 2023-12-20T04:53:39.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.802+0000 7f9ca37fe640 1 -- 172.21.15.132:0/4110711375 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9ca4003d20 con 0x7f9cac161850 2023-12-20T04:53:39.806 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.802+0000 7f9cb11ab640 1 -- 172.21.15.132:0/4110711375 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9cac0c89b0 con 0x7f9cac161850 2023-12-20T04:53:39.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.803+0000 7f9cb11ab640 1 -- 172.21.15.132:0/4110711375 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9cac04e840 con 0x7f9cac161850 2023-12-20T04:53:39.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.803+0000 7f9ca37fe640 1 -- 172.21.15.132:0/4110711375 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9ca4003e80 con 0x7f9cac161850 2023-12-20T04:53:39.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.803+0000 7f9ca37fe640 1 --2- 172.21.15.132:0/4110711375 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c8c06a430 0x7f9c8c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:39.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.804+0000 7f9caad9d640 1 --2- 172.21.15.132:0/4110711375 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c8c06a430 0x7f9c8c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:39.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.804+0000 7f9ca37fe640 1 -- 172.21.15.132:0/4110711375 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(189..189 src has 1..189) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9ca4088c90 con 0x7f9cac161850 2023-12-20T04:53:39.807 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.804+0000 7f9caad9d640 1 --2- 172.21.15.132:0/4110711375 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c8c06a430 0x7f9c8c06c8f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0c4340 tx=0x7f9c9c008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:39.810 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.808+0000 7f9ca37fe640 1 -- 172.21.15.132:0/4110711375 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9ca4054310 con 0x7f9cac161850 2023-12-20T04:53:39.981 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.979+0000 7f9cb11ab640 1 -- 172.21.15.132:0/4110711375 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9cac0b37d0 con 0x7f9cac161850 2023-12-20T04:53:39.983 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.981+0000 7f9ca37fe640 1 -- 172.21.15.132:0/4110711375 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+16178 (secure 0 0 0) 0x7f9ca401d020 con 0x7f9cac161850 2023-12-20T04:53:39.983 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:39.984 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":190,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:53:39.912327+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:53:03.034230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-20T04:53:03.812892+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:53:39.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.983+0000 7f9cb11ab640 1 -- 172.21.15.132:0/4110711375 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c8c06a430 msgr2=0x7f9c8c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.983+0000 7f9cb11ab640 1 --2- 172.21.15.132:0/4110711375 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c8c06a430 0x7f9c8c06c8f0 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f9cac0c4340 tx=0x7f9c9c008040 comp rx=0 tx=0).stop 2023-12-20T04:53:39.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.983+0000 7f9cb11ab640 1 -- 172.21.15.132:0/4110711375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cac161850 msgr2=0x7f9cac15f2a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:39.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.983+0000 7f9cb11ab640 1 --2- 172.21.15.132:0/4110711375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cac161850 0x7f9cac15f2a0 secure :-1 s=READY pgs=1901 cs=0 l=1 rev1=1 crypto rx=0x7f9ca400cc30 tx=0x7f9ca400a5c0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.984+0000 7f9cb11ab640 1 -- 172.21.15.132:0/4110711375 shutdown_connections 2023-12-20T04:53:39.986 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.984+0000 7f9cb11ab640 1 --2- 172.21.15.132:0/4110711375 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9c8c06a430 0x7f9c8c06c8f0 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.984+0000 7f9cb11ab640 1 --2- 172.21.15.132:0/4110711375 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9cac161850 0x7f9cac15f2a0 unknown :-1 s=CLOSED pgs=1901 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.984+0000 7f9cb11ab640 1 --2- 172.21.15.132:0/4110711375 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9cac15d100 0x7f9cac156830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.984+0000 7f9cb11ab640 1 --2- 172.21.15.132:0/4110711375 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9cac0d0370 0x7f9cac1f2420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:39.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.984+0000 7f9cb11ab640 1 -- 172.21.15.132:0/4110711375 >> 172.21.15.132:0/4110711375 conn(0x7f9cac06d7c0 msgr2=0x7f9cac0cc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:39.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.984+0000 7f9cb11ab640 1 -- 172.21.15.132:0/4110711375 shutdown_connections 2023-12-20T04:53:39.987 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:39.984+0000 7f9cb11ab640 1 -- 172.21.15.132:0/4110711375 wait complete. 2023-12-20T04:53:39.997 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-20T04:53:39.997 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:53:40.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.095+0000 7f07afb05640 1 Processor -- start 2023-12-20T04:53:40.097 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.095+0000 7f07afb05640 1 -- start start 2023-12-20T04:53:40.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.095+0000 7f07afb05640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f07a80d0370 0x7f07a80b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07afb05640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a80b2f90 con 0x7f07a80cdc10 2023-12-20T04:53:40.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07afb05640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f07a81613c0 con 0x7f07a815d100 2023-12-20T04:53:40.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07afb05640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f07a80d1b00 con 0x7f07a80d0370 2023-12-20T04:53:40.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ae0a2640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f07a80cdc10 0x7f07a806c190 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36624/0 (socket says 172.21.15.132:36624) 2023-12-20T04:53:40.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ae0a2640 1 -- 172.21.15.132:0/1707412918 learned_addr learned my addr 172.21.15.132:0/1707412918 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ac89f640 1 -- 172.21.15.132:0/1707412918 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1884945040 0 0) 0x7f0798001110 con 0x7f07a80cdc10 2023-12-20T04:53:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ac89f640 1 -- 172.21.15.132:0/1707412918 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0790003520 con 0x7f07a80cdc10 2023-12-20T04:53:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ad0a0640 1 --2- 172.21.15.132:0/1707412918 >> v2:172.21.15.187:3300/0 conn(0x7f07a80d0370 0x7f07a80b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ac89f640 1 -- 172.21.15.132:0/1707412918 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2789639072 0 0) 0x7f0790003520 con 0x7f07a80cdc10 2023-12-20T04:53:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ac89f640 1 -- 172.21.15.132:0/1707412918 >> v2:172.21.15.187:3300/0 conn(0x7f07a80d0370 msgr2=0x7f07a80b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ac89f640 1 --2- 172.21.15.132:0/1707412918 >> v2:172.21.15.187:3300/0 conn(0x7f07a80d0370 0x7f07a80b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ac89f640 1 -- 172.21.15.132:0/1707412918 >> v1:172.21.15.187:6789/0 conn(0x7f07a815d100 legacy=0x7f07a80cd500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ac89f640 1 -- 172.21.15.132:0/1707412918 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a80d0810 con 0x7f07a80cdc10 2023-12-20T04:53:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ac89f640 1 -- 172.21.15.132:0/1707412918 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f0798001800 con 0x7f07a80cdc10 2023-12-20T04:53:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ac89f640 1 -- 172.21.15.132:0/1707412918 >> v1:172.21.15.132:6789/0 conn(0x7f07a80cdc10 legacy=0x7f07a806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ac89f640 1 --2- 172.21.15.132:0/1707412918 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0790003970 0x7f0790003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ac89f640 1 --2- 172.21.15.132:0/1707412918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07900047c0 0x7f0790004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ac89f640 1 --2- 172.21.15.132:0/1707412918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0790005180 0x7f079000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ac89f640 1 -- 172.21.15.132:0/1707412918 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a80d1b00 con 0x7f07900047c0 2023-12-20T04:53:40.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ac89f640 1 -- 172.21.15.132:0/1707412918 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079000c020 con 0x7f0790003970 2023-12-20T04:53:40.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ac89f640 1 -- 172.21.15.132:0/1707412918 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f079000c1e0 con 0x7f0790005180 2023-12-20T04:53:40.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ad0a0640 1 --2- 172.21.15.132:0/1707412918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07900047c0 0x7f0790004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ad8a1640 1 --2- 172.21.15.132:0/1707412918 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0790003970 0x7f0790003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.096+0000 7f07ae0a2640 1 --2- 172.21.15.132:0/1707412918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0790005180 0x7f079000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.097+0000 7f07ad0a0640 1 -- 172.21.15.132:0/1707412918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0790005180 msgr2=0x7f079000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:40.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.097+0000 7f07ad0a0640 1 --2- 172.21.15.132:0/1707412918 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f0790005180 0x7f079000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.097+0000 7f07ad0a0640 1 -- 172.21.15.132:0/1707412918 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0790003970 msgr2=0x7f0790003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:40.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.097+0000 7f07ad0a0640 1 --2- 172.21.15.132:0/1707412918 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0790003970 0x7f0790003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.097+0000 7f07ad0a0640 1 -- 172.21.15.132:0/1707412918 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0790003520 con 0x7f07900047c0 2023-12-20T04:53:40.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.097+0000 7f07ad8a1640 1 --2- 172.21.15.132:0/1707412918 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0790003970 0x7f0790003d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:40.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.097+0000 7f07ae0a2640 1 -- 172.21.15.132:0/1707412918 reap_dead start 2023-12-20T04:53:40.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.097+0000 7f07ad0a0640 1 --2- 172.21.15.132:0/1707412918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07900047c0 0x7f0790004c40 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f079c009ac0 tx=0x7f07900057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c52e57a4b641ddcc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:40.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.097+0000 7f07ac89f640 1 -- 172.21.15.132:0/1707412918 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c02c6b0 con 0x7f07900047c0 2023-12-20T04:53:40.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.097+0000 7f07ac89f640 1 -- 172.21.15.132:0/1707412918 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079c02c810 con 0x7f07900047c0 2023-12-20T04:53:40.102 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.097+0000 7f07ac89f640 1 -- 172.21.15.132:0/1707412918 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079c02cba0 con 0x7f07900047c0 2023-12-20T04:53:40.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.098+0000 7f07afb05640 1 -- 172.21.15.132:0/1707412918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07900047c0 msgr2=0x7f0790004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.098+0000 7f07afb05640 1 --2- 172.21.15.132:0/1707412918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07900047c0 0x7f0790004c40 secure :-1 s=READY pgs=1903 cs=0 l=1 rev1=1 crypto rx=0x7f079c009ac0 tx=0x7f07900057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.098+0000 7f07afb05640 1 -- 172.21.15.132:0/1707412918 shutdown_connections 2023-12-20T04:53:40.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.098+0000 7f07afb05640 1 --2- 172.21.15.132:0/1707412918 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07900047c0 0x7f0790004c40 unknown :-1 s=CLOSED pgs=1903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.098+0000 7f07afb05640 1 -- 172.21.15.132:0/1707412918 >> 172.21.15.132:0/1707412918 conn(0x7f07a806d7c0 msgr2=0x7f07a806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:40.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.098+0000 7f07afb05640 1 -- 172.21.15.132:0/1707412918 shutdown_connections 2023-12-20T04:53:40.103 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.098+0000 7f07afb05640 1 -- 172.21.15.132:0/1707412918 wait complete. 2023-12-20T04:53:40.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.099+0000 7f07afb05640 1 Processor -- start 2023-12-20T04:53:40.105 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.099+0000 7f07afb05640 1 -- start start 2023-12-20T04:53:40.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.100+0000 7f07afb05640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07900047c0 0x7f07a80ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.100+0000 7f07afb05640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a8151140 0x7f07a80ae640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.100+0000 7f07afb05640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a80ccbd0 0x7f07a80cd050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.100+0000 7f07afb05640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a80cd590 con 0x7f07a80ccbd0 2023-12-20T04:53:40.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.100+0000 7f07afb05640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07a80adad0 con 0x7f07900047c0 2023-12-20T04:53:40.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.100+0000 7f07afb05640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f07a81515c0 con 0x7f07a8151140 2023-12-20T04:53:40.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.100+0000 7f07ae0a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a80ccbd0 0x7f07a80cd050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.100+0000 7f07ae0a2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a80ccbd0 0x7f07a80cd050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37630/0 (socket says 172.21.15.132:37630) 2023-12-20T04:53:40.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.100+0000 7f07ae0a2640 1 -- 172.21.15.132:0/3107145431 learned_addr learned my addr 172.21.15.132:0/3107145431 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:40.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.100+0000 7f07ae0a2640 1 -- 172.21.15.132:0/3107145431 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a8151140 msgr2=0x7f07a80ae640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.100+0000 7f07ad0a0640 1 --2- 172.21.15.132:0/3107145431 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a8151140 0x7f07a80ae640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.100+0000 7f07ad8a1640 1 --2- 172.21.15.132:0/3107145431 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07900047c0 0x7f07a80ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.100+0000 7f07ae0a2640 1 --2- 172.21.15.132:0/3107145431 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a8151140 0x7f07a80ae640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.106 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.100+0000 7f07ae0a2640 1 -- 172.21.15.132:0/3107145431 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07900047c0 msgr2=0x7f07a80ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.100+0000 7f07ae0a2640 1 --2- 172.21.15.132:0/3107145431 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07900047c0 0x7f07a80ac8e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.100+0000 7f07ae0a2640 1 -- 172.21.15.132:0/3107145431 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f07a80aeb80 con 0x7f07a80ccbd0 2023-12-20T04:53:40.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.100+0000 7f07ae0a2640 1 --2- 172.21.15.132:0/3107145431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a80ccbd0 0x7f07a80cd050 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f07a80b0660 tx=0x7f079800eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:40.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.101+0000 7f07a67fc640 1 -- 172.21.15.132:0/3107145431 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079800eed0 con 0x7f07a80ccbd0 2023-12-20T04:53:40.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.101+0000 7f07a67fc640 1 -- 172.21.15.132:0/3107145431 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f079800c690 con 0x7f07a80ccbd0 2023-12-20T04:53:40.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.101+0000 7f07afb05640 1 -- 172.21.15.132:0/3107145431 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07a80acec0 con 0x7f07a80ccbd0 2023-12-20T04:53:40.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.101+0000 7f07a67fc640 1 -- 172.21.15.132:0/3107145431 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f079800ca40 con 0x7f07a80ccbd0 2023-12-20T04:53:40.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.101+0000 7f07afb05640 1 -- 172.21.15.132:0/3107145431 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07a80ad480 con 0x7f07a80ccbd0 2023-12-20T04:53:40.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.102+0000 7f07afb05640 1 -- 172.21.15.132:0/3107145431 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f07a804e840 con 0x7f07a80ccbd0 2023-12-20T04:53:40.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.102+0000 7f07a67fc640 1 -- 172.21.15.132:0/3107145431 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f079800cba0 con 0x7f07a80ccbd0 2023-12-20T04:53:40.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.102+0000 7f07a67fc640 1 --2- 172.21.15.132:0/3107145431 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f079406a430 0x7f079406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.102+0000 7f07a67fc640 1 -- 172.21.15.132:0/3107145431 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f0798088330 con 0x7f07a80ccbd0 2023-12-20T04:53:40.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.103+0000 7f07ad8a1640 1 --2- 172.21.15.132:0/3107145431 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f079406a430 0x7f079406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.103+0000 7f07a67fc640 1 -- 172.21.15.132:0/3107145431 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=191}) v3 -- 0x7f0794071f60 con 0x7f07a80ccbd0 2023-12-20T04:53:40.107 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.103+0000 7f07ad8a1640 1 --2- 172.21.15.132:0/3107145431 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f079406a430 0x7f079406c8f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f07a0000f80 tx=0x7f07a0009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:40.108 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.107+0000 7f07a67fc640 1 -- 172.21.15.132:0/3107145431 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f07980539b0 con 0x7f07a80ccbd0 2023-12-20T04:53:40.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.307+0000 7f07afb05640 1 -- 172.21.15.132:0/3107145431 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f07a80b2f90 con 0x7f07a80ccbd0 2023-12-20T04:53:40.309 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.307+0000 7f07a67fc640 1 -- 172.21.15.132:0/3107145431 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4722 (secure 0 0 0) 0x7f07a80b2f90 con 0x7f07a80ccbd0 2023-12-20T04:53:40.310 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:40.310 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":70,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3443409957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3443409957},{"type":"v1","addr":"172.21.15.187:6833","nonce":3443409957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/321445180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":321445180},{"type":"v1","addr":"172.21.15.187:6835","nonce":321445180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1166803529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1166803529},{"type":"v1","addr":"172.21.15.132:6836","nonce":1166803529}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:53:04.838088+0000","modified":"2023-12-20T04:53:07.506024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9117":{"gid":9117,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/2356846201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2356846201},{"type":"v1","addr":"172.21.15.132:6837","nonce":2356846201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-20T04:53:40.310 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 70 2023-12-20T04:53:40.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.309+0000 7f07afb05640 1 -- 172.21.15.132:0/3107145431 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f079406a430 msgr2=0x7f079406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.309+0000 7f07afb05640 1 --2- 172.21.15.132:0/3107145431 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f079406a430 0x7f079406c8f0 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x7f07a0000f80 tx=0x7f07a0009040 comp rx=0 tx=0).stop 2023-12-20T04:53:40.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.309+0000 7f07afb05640 1 -- 172.21.15.132:0/3107145431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a80ccbd0 msgr2=0x7f07a80cd050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.309+0000 7f07afb05640 1 --2- 172.21.15.132:0/3107145431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a80ccbd0 0x7f07a80cd050 secure :-1 s=READY pgs=1904 cs=0 l=1 rev1=1 crypto rx=0x7f07a80b0660 tx=0x7f079800eb90 comp rx=0 tx=0).stop 2023-12-20T04:53:40.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.309+0000 7f07afb05640 1 -- 172.21.15.132:0/3107145431 shutdown_connections 2023-12-20T04:53:40.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.309+0000 7f07afb05640 1 --2- 172.21.15.132:0/3107145431 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f079406a430 0x7f079406c8f0 unknown :-1 s=CLOSED pgs=797 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.309+0000 7f07afb05640 1 --2- 172.21.15.132:0/3107145431 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f07a80ccbd0 0x7f07a80cd050 unknown :-1 s=CLOSED pgs=1904 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.309+0000 7f07afb05640 1 --2- 172.21.15.132:0/3107145431 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f07a8151140 0x7f07a80ae640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.309+0000 7f07afb05640 1 --2- 172.21.15.132:0/3107145431 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f07900047c0 0x7f07a80ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.309+0000 7f07afb05640 1 -- 172.21.15.132:0/3107145431 >> 172.21.15.132:0/3107145431 conn(0x7f07a806d7c0 msgr2=0x7f07a80cb600 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:40.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.309+0000 7f07afb05640 1 -- 172.21.15.132:0/3107145431 shutdown_connections 2023-12-20T04:53:40.312 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.309+0000 7f07afb05640 1 -- 172.21.15.132:0/3107145431 wait complete. 2023-12-20T04:53:40.322 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:53:40.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.420+0000 7fb9d4b63640 1 Processor -- start 2023-12-20T04:53:40.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.420+0000 7fb9d4b63640 1 -- start start 2023-12-20T04:53:40.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.421+0000 7fb9d4b63640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb9d0160450 0x7fb9d0160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.421+0000 7fb9d4b63640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d00b5ec0 con 0x7fb9d00b5090 2023-12-20T04:53:40.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.421+0000 7fb9d4b63640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb9d01617e0 con 0x7fb9d01611b0 2023-12-20T04:53:40.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.421+0000 7fb9d4b63640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb9d00d0fc0 con 0x7fb9d0160450 2023-12-20T04:53:40.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.421+0000 7fb9ce59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb9d0160450 0x7fb9d0160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.421+0000 7fb9ce59c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb9d0160450 0x7fb9d0160c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37644/0 (socket says 172.21.15.132:37644) 2023-12-20T04:53:40.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.421+0000 7fb9ced9d640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb9d00b5090 0x7fb9d00d1aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36638/0 (socket says 172.21.15.132:36638) 2023-12-20T04:53:40.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.421+0000 7fb9ce59c640 1 -- 172.21.15.132:0/2083674896 learned_addr learned my addr 172.21.15.132:0/2083674896 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:40.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.421+0000 7fb9ce59c640 1 -- 172.21.15.132:0/2083674896 >> v1:172.21.15.187:6789/0 conn(0x7fb9d01611b0 legacy=0x7fb9d00b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:40.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.421+0000 7fb9ce59c640 1 -- 172.21.15.132:0/2083674896 >> v1:172.21.15.132:6789/0 conn(0x7fb9d00b5090 legacy=0x7fb9d00d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.421+0000 7fb9cd59a640 1 -- 172.21.15.132:0/2083674896 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2846831552 0 0) 0x7fb9d00b5ec0 con 0x7fb9d00b5090 2023-12-20T04:53:40.424 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.421+0000 7fb9ce59c640 1 -- 172.21.15.132:0/2083674896 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9d00d12a0 con 0x7fb9d0160450 2023-12-20T04:53:40.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.422+0000 7fb9ce59c640 1 --2- 172.21.15.132:0/2083674896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d0160450 0x7fb9d0160c70 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0009870 tx=0x7fb9c002ba20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=458750d157799d54 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:40.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.422+0000 7fb9cd59a640 1 -- 172.21.15.132:0/2083674896 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c002f840 con 0x7fb9d0160450 2023-12-20T04:53:40.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.422+0000 7fb9cd59a640 1 -- 172.21.15.132:0/2083674896 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c002f9a0 con 0x7fb9d0160450 2023-12-20T04:53:40.425 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.422+0000 7fb9cd59a640 1 -- 172.21.15.132:0/2083674896 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c002fd30 con 0x7fb9d0160450 2023-12-20T04:53:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.423+0000 7fb9d4b63640 1 -- 172.21.15.132:0/2083674896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d0160450 msgr2=0x7fb9d0160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.423+0000 7fb9d4b63640 1 --2- 172.21.15.132:0/2083674896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d0160450 0x7fb9d0160c70 secure :-1 s=READY pgs=1906 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0009870 tx=0x7fb9c002ba20 comp rx=0 tx=0).stop 2023-12-20T04:53:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.423+0000 7fb9d4b63640 1 -- 172.21.15.132:0/2083674896 shutdown_connections 2023-12-20T04:53:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.423+0000 7fb9d4b63640 1 --2- 172.21.15.132:0/2083674896 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d0160450 0x7fb9d0160c70 unknown :-1 s=CLOSED pgs=1906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.423+0000 7fb9d4b63640 1 -- 172.21.15.132:0/2083674896 >> 172.21.15.132:0/2083674896 conn(0x7fb9d00cf980 msgr2=0x7fb9d00cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.423+0000 7fb9d4b63640 1 -- 172.21.15.132:0/2083674896 shutdown_connections 2023-12-20T04:53:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.423+0000 7fb9d4b63640 1 -- 172.21.15.132:0/2083674896 wait complete. 2023-12-20T04:53:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.424+0000 7fb9d4b63640 1 Processor -- start 2023-12-20T04:53:40.426 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.424+0000 7fb9d4b63640 1 -- start start 2023-12-20T04:53:40.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.425+0000 7fb9d4b63640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9d00b5090 0x7fb9d015f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.425+0000 7fb9d4b63640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9d0160450 0x7fb9d015d840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.425+0000 7fb9d4b63640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d01611b0 0x7fb9d0143ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.425+0000 7fb9d4b63640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d015c7a0 con 0x7fb9d01611b0 2023-12-20T04:53:40.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.425+0000 7fb9d4b63640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d015ca80 con 0x7fb9d00b5090 2023-12-20T04:53:40.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.425+0000 7fb9d4b63640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb9d015cd60 con 0x7fb9d0160450 2023-12-20T04:53:40.428 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.425+0000 7fb9ced9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d01611b0 0x7fb9d0143ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.425+0000 7fb9ced9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d01611b0 0x7fb9d0143ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37660/0 (socket says 172.21.15.132:37660) 2023-12-20T04:53:40.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.425+0000 7fb9ced9d640 1 -- 172.21.15.132:0/1830826659 learned_addr learned my addr 172.21.15.132:0/1830826659 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:40.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.425+0000 7fb9cdd9b640 1 --2- 172.21.15.132:0/1830826659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9d0160450 0x7fb9d015d840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.425+0000 7fb9ce59c640 1 --2- 172.21.15.132:0/1830826659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9d00b5090 0x7fb9d015f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.425+0000 7fb9ced9d640 1 -- 172.21.15.132:0/1830826659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9d0160450 msgr2=0x7fb9d015d840 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.425+0000 7fb9ced9d640 1 --2- 172.21.15.132:0/1830826659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9d0160450 0x7fb9d015d840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.425+0000 7fb9ced9d640 1 -- 172.21.15.132:0/1830826659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9d00b5090 msgr2=0x7fb9d015f070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.425+0000 7fb9ced9d640 1 --2- 172.21.15.132:0/1830826659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9d00b5090 0x7fb9d015f070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.425+0000 7fb9ced9d640 1 -- 172.21.15.132:0/1830826659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb9c00094d0 con 0x7fb9d01611b0 2023-12-20T04:53:40.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.425+0000 7fb9ce59c640 1 --2- 172.21.15.132:0/1830826659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9d00b5090 0x7fb9d015f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:40.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.426+0000 7fb9ced9d640 1 --2- 172.21.15.132:0/1830826659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d01611b0 0x7fb9d0143ac0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800c7e0 tx=0x7fb9c800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:40.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.426+0000 7fb9beffd640 1 -- 172.21.15.132:0/1830826659 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c800a640 con 0x7fb9d01611b0 2023-12-20T04:53:40.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.426+0000 7fb9beffd640 1 -- 172.21.15.132:0/1830826659 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb9c800a7c0 con 0x7fb9d01611b0 2023-12-20T04:53:40.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.426+0000 7fb9d4b63640 1 -- 172.21.15.132:0/1830826659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9d015d040 con 0x7fb9d01611b0 2023-12-20T04:53:40.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.426+0000 7fb9beffd640 1 -- 172.21.15.132:0/1830826659 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb9c800ab70 con 0x7fb9d01611b0 2023-12-20T04:53:40.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.426+0000 7fb9d4b63640 1 -- 172.21.15.132:0/1830826659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9d015f5b0 con 0x7fb9d01611b0 2023-12-20T04:53:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.427+0000 7fb9d4b63640 1 -- 172.21.15.132:0/1830826659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9d015d560 con 0x7fb9d01611b0 2023-12-20T04:53:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.427+0000 7fb9beffd640 1 -- 172.21.15.132:0/1830826659 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb9c800acd0 con 0x7fb9d01611b0 2023-12-20T04:53:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.427+0000 7fb9beffd640 1 --2- 172.21.15.132:0/1830826659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb9b006a430 0x7fb9b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.427+0000 7fb9beffd640 1 -- 172.21.15.132:0/1830826659 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7fb9c80880b0 con 0x7fb9d01611b0 2023-12-20T04:53:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.427+0000 7fb9ce59c640 1 --2- 172.21.15.132:0/1830826659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb9b006a430 0x7fb9b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.428+0000 7fb9beffd640 1 -- 172.21.15.132:0/1830826659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=191}) v3 -- 0x7fb9b0071f60 con 0x7fb9d01611b0 2023-12-20T04:53:40.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.428+0000 7fb9ce59c640 1 --2- 172.21.15.132:0/1830826659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb9b006a430 0x7fb9b006c8f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0036000 tx=0x7fb9c0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:40.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.432+0000 7fb9beffd640 1 -- 172.21.15.132:0/1830826659 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fb9c8018060 con 0x7fb9d01611b0 2023-12-20T04:53:40.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.634+0000 7fb9d4b63640 1 -- 172.21.15.132:0/1830826659 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb9d004e840 con 0x7fb9d01611b0 2023-12-20T04:53:40.636 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.634+0000 7fb9beffd640 1 -- 172.21.15.132:0/1830826659 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 70 v70) v1 ==== 94+0+4722 (secure 0 0 0) 0x7fb9d015d560 con 0x7fb9d01611b0 2023-12-20T04:53:40.637 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:40.637 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":70,"default_fscid":11,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3443409957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3443409957},{"type":"v1","addr":"172.21.15.187:6833","nonce":3443409957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/321445180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":321445180},{"type":"v1","addr":"172.21.15.187:6835","nonce":321445180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1166803529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1166803529},{"type":"v1","addr":"172.21.15.132:6836","nonce":1166803529}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[{"mdsmap":{"epoch":70,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2023-12-20T04:53:04.838088+0000","modified":"2023-12-20T04:53:07.506024+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":1,"in":[0],"up":{"mds_0":9117},"failed":[],"damaged":[],"stopped":[],"info":{"gid_9117":{"gid":9117,"name":"a","rank":0,"incarnation":67,"state":"up:active","state_seq":3,"addr":"172.21.15.132:6837/2356846201","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":2356846201},{"type":"v1","addr":"172.21.15.132:6837","nonce":2356846201}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[23],"metadata_pool":22,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0},"id":11}]} 2023-12-20T04:53:40.637 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 70 2023-12-20T04:53:40.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.636+0000 7fb9d4b63640 1 -- 172.21.15.132:0/1830826659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb9b006a430 msgr2=0x7fb9b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.636+0000 7fb9d4b63640 1 --2- 172.21.15.132:0/1830826659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb9b006a430 0x7fb9b006c8f0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7fb9c0036000 tx=0x7fb9c0008030 comp rx=0 tx=0).stop 2023-12-20T04:53:40.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.636+0000 7fb9d4b63640 1 -- 172.21.15.132:0/1830826659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d01611b0 msgr2=0x7fb9d0143ac0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.636+0000 7fb9d4b63640 1 --2- 172.21.15.132:0/1830826659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d01611b0 0x7fb9d0143ac0 secure :-1 s=READY pgs=1907 cs=0 l=1 rev1=1 crypto rx=0x7fb9c800c7e0 tx=0x7fb9c800cca0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.636+0000 7fb9d4b63640 1 -- 172.21.15.132:0/1830826659 shutdown_connections 2023-12-20T04:53:40.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.636+0000 7fb9d4b63640 1 --2- 172.21.15.132:0/1830826659 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb9b006a430 0x7fb9b006c8f0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.636+0000 7fb9d4b63640 1 --2- 172.21.15.132:0/1830826659 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb9d01611b0 0x7fb9d0143ac0 unknown :-1 s=CLOSED pgs=1907 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.636+0000 7fb9d4b63640 1 --2- 172.21.15.132:0/1830826659 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb9d0160450 0x7fb9d015d840 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.636+0000 7fb9d4b63640 1 --2- 172.21.15.132:0/1830826659 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb9d00b5090 0x7fb9d015f070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.636+0000 7fb9d4b63640 1 -- 172.21.15.132:0/1830826659 >> 172.21.15.132:0/1830826659 conn(0x7fb9d00cf980 msgr2=0x7fb9d00cc500 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:40.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.636+0000 7fb9d4b63640 1 -- 172.21.15.132:0/1830826659 shutdown_connections 2023-12-20T04:53:40.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.636+0000 7fb9d4b63640 1 -- 172.21.15.132:0/1830826659 wait complete. 2023-12-20T04:53:40.650 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:53:40.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.747+0000 7f6cebe5f640 1 Processor -- start 2023-12-20T04:53:40.749 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.747+0000 7f6cebe5f640 1 -- start start 2023-12-20T04:53:40.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6cebe5f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ce4160450 0x7f6ce4160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6cebe5f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce40b5ec0 con 0x7f6ce40b5090 2023-12-20T04:53:40.752 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6cebe5f640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f6ce41617e0 con 0x7f6ce41611b0 2023-12-20T04:53:40.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6cebe5f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40d0fc0 con 0x7f6ce4160450 2023-12-20T04:53:40.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6cea3fc640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f6ce40b5090 0x7f6ce40d1aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36652/0 (socket says 172.21.15.132:36652) 2023-12-20T04:53:40.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6cea3fc640 1 -- 172.21.15.132:0/2579624798 learned_addr learned my addr 172.21.15.132:0/2579624798 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:40.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6ce8bf9640 1 -- 172.21.15.132:0/2579624798 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3441368348 0 0) 0x7f6ce40b5ec0 con 0x7f6ce40b5090 2023-12-20T04:53:40.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6ce9bfb640 1 --2- 172.21.15.132:0/2579624798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ce4160450 0x7f6ce4160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6ce8bf9640 1 -- 172.21.15.132:0/2579624798 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f6cd0003520 con 0x7f6ce40b5090 2023-12-20T04:53:40.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6ce8bf9640 1 -- 172.21.15.132:0/2579624798 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4110164558 0 0) 0x7f6cd0003520 con 0x7f6ce40b5090 2023-12-20T04:53:40.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6ce8bf9640 1 -- 172.21.15.132:0/2579624798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ce4160450 msgr2=0x7f6ce4160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:40.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6ce8bf9640 1 --2- 172.21.15.132:0/2579624798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ce4160450 0x7f6ce4160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6ce8bf9640 1 -- 172.21.15.132:0/2579624798 >> v1:172.21.15.187:6789/0 conn(0x7f6ce41611b0 legacy=0x7f6ce40b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6ce8bf9640 1 -- 172.21.15.132:0/2579624798 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce40d12a0 con 0x7f6ce40b5090 2023-12-20T04:53:40.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6ce8bf9640 1 -- 172.21.15.132:0/2579624798 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f6cdc0019f0 con 0x7f6ce40b5090 2023-12-20T04:53:40.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6ce8bf9640 1 -- 172.21.15.132:0/2579624798 >> v1:172.21.15.132:6789/0 conn(0x7f6ce40b5090 legacy=0x7f6ce40d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.753 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6ce8bf9640 1 --2- 172.21.15.132:0/2579624798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cd00039a0 0x7f6cd0003dc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6ce8bf9640 1 --2- 172.21.15.132:0/2579624798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cd00047c0 0x7f6cd0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6ce8bf9640 1 --2- 172.21.15.132:0/2579624798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ce4160450 0x7f6cd0005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6ce8bf9640 1 -- 172.21.15.132:0/2579624798 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40d0fc0 con 0x7f6cd00047c0 2023-12-20T04:53:40.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6ce8bf9640 1 -- 172.21.15.132:0/2579624798 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd000bac0 con 0x7f6cd00039a0 2023-12-20T04:53:40.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6ce8bf9640 1 -- 172.21.15.132:0/2579624798 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6cd000bc80 con 0x7f6ce4160450 2023-12-20T04:53:40.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.748+0000 7f6ce93fa640 1 --2- 172.21.15.132:0/2579624798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cd00047c0 0x7f6cd0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.749+0000 7f6ce9bfb640 1 --2- 172.21.15.132:0/2579624798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cd00039a0 0x7f6cd0003dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.749+0000 7f6cea3fc640 1 --2- 172.21.15.132:0/2579624798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ce4160450 0x7f6cd0005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.749+0000 7f6ce93fa640 1 -- 172.21.15.132:0/2579624798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ce4160450 msgr2=0x7f6cd0005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:40.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.749+0000 7f6ce93fa640 1 --2- 172.21.15.132:0/2579624798 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ce4160450 0x7f6cd0005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.749+0000 7f6ce93fa640 1 -- 172.21.15.132:0/2579624798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cd00039a0 msgr2=0x7f6cd0003dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:40.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.749+0000 7f6ce93fa640 1 --2- 172.21.15.132:0/2579624798 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cd00039a0 0x7f6cd0003dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.749+0000 7f6ce93fa640 1 -- 172.21.15.132:0/2579624798 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6cd0003520 con 0x7f6cd00047c0 2023-12-20T04:53:40.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.749+0000 7f6ce93fa640 1 --2- 172.21.15.132:0/2579624798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cd00047c0 0x7f6cd0004c40 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4001720 tx=0x7f6cd00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e85c8bfc866a876 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:40.754 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.750+0000 7f6ce8bf9640 1 -- 172.21.15.132:0/2579624798 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd40052d0 con 0x7f6cd00047c0 2023-12-20T04:53:40.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.750+0000 7f6ce8bf9640 1 -- 172.21.15.132:0/2579624798 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cd402e050 con 0x7f6cd00047c0 2023-12-20T04:53:40.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.750+0000 7f6ce8bf9640 1 -- 172.21.15.132:0/2579624798 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cd40035f0 con 0x7f6cd00047c0 2023-12-20T04:53:40.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.750+0000 7f6cebe5f640 1 -- 172.21.15.132:0/2579624798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cd00047c0 msgr2=0x7f6cd0004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.750+0000 7f6cebe5f640 1 --2- 172.21.15.132:0/2579624798 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6cd00047c0 0x7f6cd0004c40 secure :-1 s=READY pgs=1909 cs=0 l=1 rev1=1 crypto rx=0x7f6cd4001720 tx=0x7f6cd00057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.750+0000 7f6cea3fc640 1 -- 172.21.15.132:0/2579624798 reap_dead start 2023-12-20T04:53:40.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.750+0000 7f6cebe5f640 1 -- 172.21.15.132:0/2579624798 shutdown_connections 2023-12-20T04:53:40.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.750+0000 7f6cebe5f640 1 -- 172.21.15.132:0/2579624798 >> 172.21.15.132:0/2579624798 conn(0x7f6ce40cf980 msgr2=0x7f6ce40cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:40.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.750+0000 7f6cebe5f640 1 -- 172.21.15.132:0/2579624798 shutdown_connections 2023-12-20T04:53:40.755 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.750+0000 7f6cebe5f640 1 -- 172.21.15.132:0/2579624798 wait complete. 2023-12-20T04:53:40.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.751+0000 7f6cebe5f640 1 Processor -- start 2023-12-20T04:53:40.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.751+0000 7f6cebe5f640 1 -- start start 2023-12-20T04:53:40.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.752+0000 7f6cebe5f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cd00047c0 0x7f6ce41f36f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.752+0000 7f6cebe5f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ce4154be0 0x7f6ce41513f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.752+0000 7f6cebe5f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ce40b6e40 0x7f6ce40b72c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.752+0000 7f6cebe5f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce40b7800 con 0x7f6ce40b6e40 2023-12-20T04:53:40.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.752+0000 7f6cebe5f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce41f3c30 con 0x7f6cd00047c0 2023-12-20T04:53:40.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.752+0000 7f6cebe5f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f6ce4151930 con 0x7f6ce4154be0 2023-12-20T04:53:40.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.752+0000 7f6cea3fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ce40b6e40 0x7f6ce40b72c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.752+0000 7f6cea3fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ce40b6e40 0x7f6ce40b72c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37684/0 (socket says 172.21.15.132:37684) 2023-12-20T04:53:40.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.752+0000 7f6cea3fc640 1 -- 172.21.15.132:0/2793892708 learned_addr learned my addr 172.21.15.132:0/2793892708 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:40.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.752+0000 7f6cea3fc640 1 -- 172.21.15.132:0/2793892708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ce4154be0 msgr2=0x7f6ce41513f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.758 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.752+0000 7f6cea3fc640 1 --2- 172.21.15.132:0/2793892708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ce4154be0 0x7f6ce41513f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.752+0000 7f6cea3fc640 1 -- 172.21.15.132:0/2793892708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cd00047c0 msgr2=0x7f6ce41f36f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.752+0000 7f6ce9bfb640 1 --2- 172.21.15.132:0/2793892708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cd00047c0 0x7f6ce41f36f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.752+0000 7f6cea3fc640 1 --2- 172.21.15.132:0/2793892708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cd00047c0 0x7f6ce41f36f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.753+0000 7f6cea3fc640 1 -- 172.21.15.132:0/2793892708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce415d2b0 con 0x7f6ce40b6e40 2023-12-20T04:53:40.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.753+0000 7f6cea3fc640 1 --2- 172.21.15.132:0/2793892708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ce40b6e40 0x7f6ce40b72c0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40b5a00 tx=0x7f6cdc00a6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:40.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.753+0000 7f6cda7fc640 1 -- 172.21.15.132:0/2793892708 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc00ac60 con 0x7f6ce40b6e40 2023-12-20T04:53:40.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.753+0000 7f6cda7fc640 1 -- 172.21.15.132:0/2793892708 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f6cdc00ae00 con 0x7f6ce40b6e40 2023-12-20T04:53:40.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.753+0000 7f6cebe5f640 1 -- 172.21.15.132:0/2793892708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ce415c210 con 0x7f6ce40b6e40 2023-12-20T04:53:40.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.753+0000 7f6cda7fc640 1 -- 172.21.15.132:0/2793892708 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f6cdc013630 con 0x7f6ce40b6e40 2023-12-20T04:53:40.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.753+0000 7f6cebe5f640 1 -- 172.21.15.132:0/2793892708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ce415c7d0 con 0x7f6ce40b6e40 2023-12-20T04:53:40.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.754+0000 7f6cebe5f640 1 -- 172.21.15.132:0/2793892708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ce404e840 con 0x7f6ce40b6e40 2023-12-20T04:53:40.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.754+0000 7f6cda7fc640 1 -- 172.21.15.132:0/2793892708 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f6cdc013790 con 0x7f6ce40b6e40 2023-12-20T04:53:40.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.754+0000 7f6cda7fc640 1 --2- 172.21.15.132:0/2793892708 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6cc806a430 0x7f6cc806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:40.759 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.755+0000 7f6cda7fc640 1 -- 172.21.15.132:0/2793892708 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f6cdc0890e0 con 0x7f6ce40b6e40 2023-12-20T04:53:40.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.755+0000 7f6ce9bfb640 1 --2- 172.21.15.132:0/2793892708 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6cc806a430 0x7f6cc806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:40.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.755+0000 7f6cda7fc640 1 -- 172.21.15.132:0/2793892708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=191}) v3 -- 0x7f6cc8071f60 con 0x7f6ce40b6e40 2023-12-20T04:53:40.760 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.755+0000 7f6ce9bfb640 1 --2- 172.21.15.132:0/2793892708 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6cc806a430 0x7f6cc806c8f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0009980 tx=0x7f6ce0008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:40.761 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.759+0000 7f6cda7fc640 1 -- 172.21.15.132:0/2793892708 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f6cdc0546d0 con 0x7f6ce40b6e40 2023-12-20T04:53:40.929 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.927+0000 7f6cebe5f640 1 -- 172.21.15.132:0/2793892708 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f6ce40d0ad0 con 0x7f6ce40b6e40 2023-12-20T04:53:40.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.928+0000 7f6cda7fc640 1 -- 172.21.15.132:0/2793892708 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v190) v1 ==== 74+0+16178 (secure 0 0 0) 0x7f6cdc057cf0 con 0x7f6ce40b6e40 2023-12-20T04:53:40.930 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:40.930 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":190,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:53:39.912327+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":22,"pool_name":"cephfs_metadata","create_time":"2023-12-20T04:53:03.034230+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"185","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":2,"score_stable":2,"optimal_score":1,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":23,"pool_name":"cephfs_data","create_time":"2023-12-20T04:53:03.812892+0000","flags":1027,"flags_names":"hashpspool,full,full_quota","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"190","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":33554432,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:53:40.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.930+0000 7f6cebe5f640 1 -- 172.21.15.132:0/2793892708 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6cc806a430 msgr2=0x7f6cc806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.932 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.930+0000 7f6cebe5f640 1 --2- 172.21.15.132:0/2793892708 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6cc806a430 0x7f6cc806c8f0 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f6ce0009980 tx=0x7f6ce0008040 comp rx=0 tx=0).stop 2023-12-20T04:53:40.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.930+0000 7f6cebe5f640 1 -- 172.21.15.132:0/2793892708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ce40b6e40 msgr2=0x7f6ce40b72c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:40.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.930+0000 7f6cebe5f640 1 --2- 172.21.15.132:0/2793892708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ce40b6e40 0x7f6ce40b72c0 secure :-1 s=READY pgs=1910 cs=0 l=1 rev1=1 crypto rx=0x7f6ce40b5a00 tx=0x7f6cdc00a6e0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.930+0000 7f6cebe5f640 1 -- 172.21.15.132:0/2793892708 shutdown_connections 2023-12-20T04:53:40.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.930+0000 7f6cebe5f640 1 --2- 172.21.15.132:0/2793892708 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f6cc806a430 0x7f6cc806c8f0 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.930+0000 7f6cebe5f640 1 --2- 172.21.15.132:0/2793892708 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f6ce40b6e40 0x7f6ce40b72c0 unknown :-1 s=CLOSED pgs=1910 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.930+0000 7f6cebe5f640 1 --2- 172.21.15.132:0/2793892708 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f6ce4154be0 0x7f6ce41513f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.930+0000 7f6cebe5f640 1 --2- 172.21.15.132:0/2793892708 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f6cd00047c0 0x7f6ce41f36f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:40.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.930+0000 7f6cebe5f640 1 -- 172.21.15.132:0/2793892708 >> 172.21.15.132:0/2793892708 conn(0x7f6ce40cf980 msgr2=0x7f6ce40ccd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:40.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.930+0000 7f6cebe5f640 1 -- 172.21.15.132:0/2793892708 shutdown_connections 2023-12-20T04:53:40.933 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:40.930+0000 7f6cebe5f640 1 -- 172.21.15.132:0/2793892708 wait complete. 2023-12-20T04:53:40.943 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2023-12-20T04:53:41.044 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.042+0000 7f9e35f9f640 1 Processor -- start 2023-12-20T04:53:41.045 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.042+0000 7f9e35f9f640 1 -- start start 2023-12-20T04:53:41.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.043+0000 7f9e35f9f640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f9e30159bb0 0x7f9e3006f3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:41.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.043+0000 7f9e35f9f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9e3006bba0 0x7f9e300ca510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:41.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.043+0000 7f9e35f9f640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f9e3006c8e0 con 0x7f9e300ad720 2023-12-20T04:53:41.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.043+0000 7f9e35f9f640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3015e420 con 0x7f9e3006bba0 2023-12-20T04:53:41.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.043+0000 7f9e35f9f640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f9e3015e700 con 0x7f9e30159bb0 2023-12-20T04:53:41.046 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.043+0000 7f9e2ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9e3006bba0 0x7f9e300ca510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:41.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.043+0000 7f9e2ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f9e3006bba0 0x7f9e300ca510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37692/0 (socket says 172.21.15.132:37692) 2023-12-20T04:53:41.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.043+0000 7f9e2ffff640 1 -- 172.21.15.132:0/3360837083 learned_addr learned my addr 172.21.15.132:0/3360837083 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:41.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.043+0000 7f9e2effd640 1 --1- 172.21.15.132:0/3360837083 >> v1:172.21.15.132:6789/0 conn(0x7f9e300ad720 0x7f9e3006b490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36656/0 (socket says 172.21.15.132:36656) 2023-12-20T04:53:41.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.044+0000 7f9e2ffff640 1 -- 172.21.15.132:0/3360837083 >> v2:172.21.15.187:3300/0 conn(0x7f9e30159bb0 msgr2=0x7f9e3006f3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:41.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.044+0000 7f9e2ffff640 1 --2- 172.21.15.132:0/3360837083 >> v2:172.21.15.187:3300/0 conn(0x7f9e30159bb0 0x7f9e3006f3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:41.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.044+0000 7f9e2ffff640 1 -- 172.21.15.132:0/3360837083 >> v1:172.21.15.132:6789/0 conn(0x7f9e300ad720 legacy=0x7f9e3006b490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:41.047 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.044+0000 7f9e2ffff640 1 -- 172.21.15.132:0/3360837083 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e300c9d10 con 0x7f9e3006bba0 2023-12-20T04:53:41.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.044+0000 7f9e2ffff640 1 --2- 172.21.15.132:0/3360837083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e3006bba0 0x7f9e300ca510 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f9e3006d5c0 tx=0x7f9e2802e180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc14b5bc76ffd2b2 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:41.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.044+0000 7f9e2e7fc640 1 -- 172.21.15.132:0/3360837083 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e2800b0d0 con 0x7f9e3006bba0 2023-12-20T04:53:41.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.044+0000 7f9e2e7fc640 1 -- 172.21.15.132:0/3360837083 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e2800b230 con 0x7f9e3006bba0 2023-12-20T04:53:41.048 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.044+0000 7f9e2e7fc640 1 -- 172.21.15.132:0/3360837083 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e28009600 con 0x7f9e3006bba0 2023-12-20T04:53:41.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.045+0000 7f9e35f9f640 1 -- 172.21.15.132:0/3360837083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e3006bba0 msgr2=0x7f9e300ca510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:41.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.045+0000 7f9e35f9f640 1 --2- 172.21.15.132:0/3360837083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e3006bba0 0x7f9e300ca510 secure :-1 s=READY pgs=1912 cs=0 l=1 rev1=1 crypto rx=0x7f9e3006d5c0 tx=0x7f9e2802e180 comp rx=0 tx=0).stop 2023-12-20T04:53:41.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.045+0000 7f9e35f9f640 1 -- 172.21.15.132:0/3360837083 shutdown_connections 2023-12-20T04:53:41.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.045+0000 7f9e35f9f640 1 --2- 172.21.15.132:0/3360837083 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e3006bba0 0x7f9e300ca510 unknown :-1 s=CLOSED pgs=1912 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:41.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.045+0000 7f9e35f9f640 1 --2- 172.21.15.132:0/3360837083 >> v2:172.21.15.187:3300/0 conn(0x7f9e30159bb0 0x7f9e3006f3e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:41.052 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.045+0000 7f9e35f9f640 1 -- 172.21.15.132:0/3360837083 >> 172.21.15.132:0/3360837083 conn(0x7f9e3006a260 msgr2=0x7f9e300b0630 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:41.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.045+0000 7f9e35f9f640 1 -- 172.21.15.132:0/3360837083 shutdown_connections 2023-12-20T04:53:41.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.045+0000 7f9e35f9f640 1 -- 172.21.15.132:0/3360837083 wait complete. 2023-12-20T04:53:41.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.046+0000 7f9e35f9f640 1 Processor -- start 2023-12-20T04:53:41.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.046+0000 7f9e35f9f640 1 -- start start 2023-12-20T04:53:41.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e35f9f640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e3006bba0 0x7f9e300b34b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:41.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e35f9f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e300ad720 0x7f9e30154560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:41.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e35f9f640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e30159bb0 0x7f9e30158490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:41.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e35f9f640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e30158070 con 0x7f9e300ad720 2023-12-20T04:53:41.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e35f9f640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e300b4690 con 0x7f9e3006bba0 2023-12-20T04:53:41.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e35f9f640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f9e301571a0 con 0x7f9e30159bb0 2023-12-20T04:53:41.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e2effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e300ad720 0x7f9e30154560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:41.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e2effd640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e300ad720 0x7f9e30154560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37704/0 (socket says 172.21.15.132:37704) 2023-12-20T04:53:41.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e2effd640 1 -- 172.21.15.132:0/1408735048 learned_addr learned my addr 172.21.15.132:0/1408735048 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:41.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e2f7fe640 1 --2- 172.21.15.132:0/1408735048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e3006bba0 0x7f9e300b34b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:41.053 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e2ffff640 1 --2- 172.21.15.132:0/1408735048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e30159bb0 0x7f9e30158490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:41.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e2effd640 1 -- 172.21.15.132:0/1408735048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e30159bb0 msgr2=0x7f9e30158490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:41.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e2effd640 1 --2- 172.21.15.132:0/1408735048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e30159bb0 0x7f9e30158490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:41.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e2effd640 1 -- 172.21.15.132:0/1408735048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e3006bba0 msgr2=0x7f9e300b34b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:41.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e2effd640 1 --2- 172.21.15.132:0/1408735048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e3006bba0 0x7f9e300b34b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:41.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e2effd640 1 -- 172.21.15.132:0/1408735048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e2800bd40 con 0x7f9e300ad720 2023-12-20T04:53:41.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e2f7fe640 1 --2- 172.21.15.132:0/1408735048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e3006bba0 0x7f9e300b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:41.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.047+0000 7f9e2ffff640 1 --2- 172.21.15.132:0/1408735048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e30159bb0 0x7f9e30158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:41.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.048+0000 7f9e2effd640 1 --2- 172.21.15.132:0/1408735048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e300ad720 0x7f9e30154560 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400c4d0 tx=0x7f9e2400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:41.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.048+0000 7f9e17fff640 1 -- 172.21.15.132:0/1408735048 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e24007480 con 0x7f9e300ad720 2023-12-20T04:53:41.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.048+0000 7f9e17fff640 1 -- 172.21.15.132:0/1408735048 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f9e240075e0 con 0x7f9e300ad720 2023-12-20T04:53:41.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.048+0000 7f9e35f9f640 1 -- 172.21.15.132:0/1408735048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e30154aa0 con 0x7f9e300ad720 2023-12-20T04:53:41.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.048+0000 7f9e17fff640 1 -- 172.21.15.132:0/1408735048 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f9e240049e0 con 0x7f9e300ad720 2023-12-20T04:53:41.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.048+0000 7f9e35f9f640 1 -- 172.21.15.132:0/1408735048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e301576d0 con 0x7f9e300ad720 2023-12-20T04:53:41.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.049+0000 7f9e35f9f640 1 -- 172.21.15.132:0/1408735048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e3004e840 con 0x7f9e300ad720 2023-12-20T04:53:41.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.049+0000 7f9e17fff640 1 -- 172.21.15.132:0/1408735048 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f9e24004b40 con 0x7f9e300ad720 2023-12-20T04:53:41.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.049+0000 7f9e17fff640 1 --2- 172.21.15.132:0/1408735048 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9e1c06a430 0x7f9e1c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:41.054 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.050+0000 7f9e17fff640 1 -- 172.21.15.132:0/1408735048 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(190..190 src has 1..190) v4 ==== 5709+0+0 (secure 0 0 0) 0x7f9e24087910 con 0x7f9e300ad720 2023-12-20T04:53:41.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.050+0000 7f9e2f7fe640 1 --2- 172.21.15.132:0/1408735048 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9e1c06a430 0x7f9e1c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:41.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.050+0000 7f9e17fff640 1 -- 172.21.15.132:0/1408735048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=191}) v3 -- 0x7f9e1c071f60 con 0x7f9e300ad720 2023-12-20T04:53:41.055 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.050+0000 7f9e2f7fe640 1 --2- 172.21.15.132:0/1408735048 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9e1c06a430 0x7f9e1c06c8f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9e2000a870 tx=0x7f9e20008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:41.056 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.054+0000 7f9e17fff640 1 -- 172.21.15.132:0/1408735048 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f9e24018070 con 0x7f9e300ad720 2023-12-20T04:53:41.255 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.254+0000 7f9e35f9f640 1 -- 172.21.15.132:0/1408735048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) v1 -- 0x7f9e3006c450 con 0x7f9e300ad720 2023-12-20T04:53:41.256 INFO:tasks.ceph.mon.a.smithi132.stderr:2023-12-20T04:53:41.254+0000 7f1a5cbbd640 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2023-12-20T04:53:41.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.256+0000 7f9e17fff640 1 -- 172.21.15.132:0/1408735048 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(191..191 src has 1..191) v4 ==== 374+0+0 (secure 0 0 0) 0x7f9e2405aa80 con 0x7f9e300ad720 2023-12-20T04:53:41.258 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.256+0000 7f9e17fff640 1 -- 172.21.15.132:0/1408735048 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=192}) v3 -- 0x7f9e1c072810 con 0x7f9e300ad720 2023-12-20T04:53:41.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.262+0000 7f9e17fff640 1 -- 172.21.15.132:0/1408735048 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v71) v1 ==== 161+0+0 (secure 0 0 0) 0x7f9e24053040 con 0x7f9e300ad720 2023-12-20T04:53:41.264 INFO:teuthology.orchestra.run.smithi132.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2023-12-20T04:53:41.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.265+0000 7f9e35f9f640 1 -- 172.21.15.132:0/1408735048 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9e1c06a430 msgr2=0x7f9e1c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:41.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.265+0000 7f9e35f9f640 1 --2- 172.21.15.132:0/1408735048 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9e1c06a430 0x7f9e1c06c8f0 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f9e2000a870 tx=0x7f9e20008040 comp rx=0 tx=0).stop 2023-12-20T04:53:41.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.265+0000 7f9e35f9f640 1 -- 172.21.15.132:0/1408735048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e300ad720 msgr2=0x7f9e30154560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:41.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.265+0000 7f9e35f9f640 1 --2- 172.21.15.132:0/1408735048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e300ad720 0x7f9e30154560 secure :-1 s=READY pgs=1913 cs=0 l=1 rev1=1 crypto rx=0x7f9e2400c4d0 tx=0x7f9e2400c990 comp rx=0 tx=0).stop 2023-12-20T04:53:41.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.265+0000 7f9e35f9f640 1 -- 172.21.15.132:0/1408735048 shutdown_connections 2023-12-20T04:53:41.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.265+0000 7f9e35f9f640 1 --2- 172.21.15.132:0/1408735048 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f9e1c06a430 0x7f9e1c06c8f0 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:41.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.265+0000 7f9e35f9f640 1 --2- 172.21.15.132:0/1408735048 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f9e30159bb0 0x7f9e30158490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:41.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.265+0000 7f9e35f9f640 1 --2- 172.21.15.132:0/1408735048 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f9e300ad720 0x7f9e30154560 unknown :-1 s=CLOSED pgs=1913 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:41.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.265+0000 7f9e35f9f640 1 --2- 172.21.15.132:0/1408735048 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f9e3006bba0 0x7f9e300b34b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:41.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.265+0000 7f9e35f9f640 1 -- 172.21.15.132:0/1408735048 >> 172.21.15.132:0/1408735048 conn(0x7f9e3006a260 msgr2=0x7f9e300b0610 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:41.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.265+0000 7f9e35f9f640 1 -- 172.21.15.132:0/1408735048 shutdown_connections 2023-12-20T04:53:41.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.265+0000 7f9e35f9f640 1 -- 172.21.15.132:0/1408735048 wait complete. 2023-12-20T04:53:41.269 INFO:tasks.ceph.mds.a.smithi132.stderr: -7758> 2023-12-20T04:53:05.916+0000 7f963b456640 -1 mds.pinger is_rank_lagging: rank=0 was never sent ping request. 2023-12-20T04:53:41.282 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2023-12-20T04:53:41.305 INFO:tasks.ceph.mds.a.smithi132.stdout:starting mds.a at 2023-12-20T04:53:41.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.383+0000 7fa359669640 1 Processor -- start 2023-12-20T04:53:41.385 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.383+0000 7fa359669640 1 -- start start 2023-12-20T04:53:41.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.384+0000 7fa359669640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa35415d300 0x7fa3540d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:41.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.384+0000 7fa359669640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3540d2920 con 0x7fa3540cfea0 2023-12-20T04:53:41.386 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.384+0000 7fa359669640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fa3540d1d10 con 0x7fa3540d17d0 2023-12-20T04:53:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.384+0000 7fa359669640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fa3540d1ff0 con 0x7fa35415d300 2023-12-20T04:53:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.384+0000 7fa352ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa35415d300 0x7fa3540d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.384+0000 7fa3537fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fa3540cfea0 0x7fa3540b6080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36658/0 (socket says 172.21.15.132:36658) 2023-12-20T04:53:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.384+0000 7fa352ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fa35415d300 0x7fa3540d1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37728/0 (socket says 172.21.15.132:37728) 2023-12-20T04:53:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.384+0000 7fa3537fe640 1 -- 172.21.15.132:0/483787534 learned_addr learned my addr 172.21.15.132:0/483787534 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.384+0000 7fa352ffd640 1 -- 172.21.15.132:0/483787534 >> v1:172.21.15.187:6789/0 conn(0x7fa3540d17d0 legacy=0x7fa3540cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.384+0000 7fa352ffd640 1 -- 172.21.15.132:0/483787534 >> v1:172.21.15.132:6789/0 conn(0x7fa3540cfea0 legacy=0x7fa3540b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.384+0000 7fa352ffd640 1 -- 172.21.15.132:0/483787534 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa3540d22d0 con 0x7fa35415d300 2023-12-20T04:53:41.387 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.384+0000 7fa3527fc640 1 -- 172.21.15.132:0/483787534 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 277014396 0 0) 0x7fa3540d2920 con 0x7fa3540cfea0 2023-12-20T04:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.385+0000 7fa352ffd640 1 --2- 172.21.15.132:0/483787534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35415d300 0x7fa3540d1290 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fa3440097a0 tx=0x7fa34402b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c5f069a53db641a server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.385+0000 7fa3527fc640 1 -- 172.21.15.132:0/483787534 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa344031830 con 0x7fa35415d300 2023-12-20T04:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.385+0000 7fa3527fc640 1 -- 172.21.15.132:0/483787534 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa344031990 con 0x7fa35415d300 2023-12-20T04:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.385+0000 7fa3527fc640 1 -- 172.21.15.132:0/483787534 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa344031d20 con 0x7fa35415d300 2023-12-20T04:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.386+0000 7fa359669640 1 -- 172.21.15.132:0/483787534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35415d300 msgr2=0x7fa3540d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.386+0000 7fa359669640 1 --2- 172.21.15.132:0/483787534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35415d300 0x7fa3540d1290 secure :-1 s=READY pgs=1915 cs=0 l=1 rev1=1 crypto rx=0x7fa3440097a0 tx=0x7fa34402b8d0 comp rx=0 tx=0).stop 2023-12-20T04:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.386+0000 7fa359669640 1 -- 172.21.15.132:0/483787534 shutdown_connections 2023-12-20T04:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.386+0000 7fa359669640 1 --2- 172.21.15.132:0/483787534 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35415d300 0x7fa3540d1290 unknown :-1 s=CLOSED pgs=1915 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.386+0000 7fa359669640 1 -- 172.21.15.132:0/483787534 >> 172.21.15.132:0/483787534 conn(0x7fa35406a3d0 msgr2=0x7fa35406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:41.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.386+0000 7fa359669640 1 -- 172.21.15.132:0/483787534 shutdown_connections 2023-12-20T04:53:41.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.386+0000 7fa359669640 1 -- 172.21.15.132:0/483787534 wait complete. 2023-12-20T04:53:41.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.387+0000 7fa359669640 1 Processor -- start 2023-12-20T04:53:41.390 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.387+0000 7fa359669640 1 -- start start 2023-12-20T04:53:41.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa359669640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3540cfea0 0x7fa354154f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa359669640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3540d17d0 0x7fa3541f2210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa359669640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35415d300 0x7fa3540c9080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa359669640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540c6860 con 0x7fa35415d300 2023-12-20T04:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa359669640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa354155480 con 0x7fa3540d17d0 2023-12-20T04:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa359669640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fa3540c7370 con 0x7fa3540cfea0 2023-12-20T04:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa3537fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35415d300 0x7fa3540c9080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa3537fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35415d300 0x7fa3540c9080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37730/0 (socket says 172.21.15.132:37730) 2023-12-20T04:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa3537fe640 1 -- 172.21.15.132:0/505076627 learned_addr learned my addr 172.21.15.132:0/505076627 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa3537fe640 1 -- 172.21.15.132:0/505076627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3540cfea0 msgr2=0x7fa354154f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa3537fe640 1 --2- 172.21.15.132:0/505076627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3540cfea0 0x7fa354154f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa3537fe640 1 -- 172.21.15.132:0/505076627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3540d17d0 msgr2=0x7fa3541f2210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa3537fe640 1 --2- 172.21.15.132:0/505076627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3540d17d0 0x7fa3541f2210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa3537fe640 1 -- 172.21.15.132:0/505076627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa344009400 con 0x7fa35415d300 2023-12-20T04:53:41.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa3537fe640 1 --2- 172.21.15.132:0/505076627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35415d300 0x7fa3540c9080 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00c780 tx=0x7fa34c00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa34b7fe640 1 -- 172.21.15.132:0/505076627 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c00ce90 con 0x7fa35415d300 2023-12-20T04:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa34b7fe640 1 -- 172.21.15.132:0/505076627 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fa34c00a640 con 0x7fa35415d300 2023-12-20T04:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa359669640 1 -- 172.21.15.132:0/505076627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3541f2750 con 0x7fa35415d300 2023-12-20T04:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa34b7fe640 1 -- 172.21.15.132:0/505076627 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fa34c00aa30 con 0x7fa35415d300 2023-12-20T04:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.388+0000 7fa359669640 1 -- 172.21.15.132:0/505076627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3540c6d20 con 0x7fa35415d300 2023-12-20T04:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.389+0000 7fa359669640 1 -- 172.21.15.132:0/505076627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa35404e840 con 0x7fa35415d300 2023-12-20T04:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.390+0000 7fa34b7fe640 1 -- 172.21.15.132:0/505076627 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fa34c00ab90 con 0x7fa35415d300 2023-12-20T04:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.390+0000 7fa34b7fe640 1 --2- 172.21.15.132:0/505076627 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa33406a430 0x7fa33406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.390+0000 7fa34b7fe640 1 -- 172.21.15.132:0/505076627 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5795+0+0 (secure 0 0 0) 0x7fa34c0880a0 con 0x7fa35415d300 2023-12-20T04:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.390+0000 7fa352ffd640 1 --2- 172.21.15.132:0/505076627 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa33406a430 0x7fa33406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.390+0000 7fa34b7fe640 1 -- 172.21.15.132:0/505076627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=192}) v3 -- 0x7fa334072070 con 0x7fa35415d300 2023-12-20T04:53:41.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.390+0000 7fa352ffd640 1 --2- 172.21.15.132:0/505076627 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa33406a430 0x7fa33406c8f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa344036000 tx=0x7fa344030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:41.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.394+0000 7fa34b7fe640 1 -- 172.21.15.132:0/505076627 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fa34c018060 con 0x7fa35415d300 2023-12-20T04:53:41.596 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:41.594+0000 7fa359669640 1 -- 172.21.15.132:0/505076627 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) v1 -- 0x7fa3540c74e0 con 0x7fa35415d300 2023-12-20T04:53:42.266 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.264+0000 7fa34b7fe640 1 -- 172.21.15.132:0/505076627 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v72) v1 ==== 104+0+0 (secure 0 0 0) 0x7fa34c018070 con 0x7fa35415d300 2023-12-20T04:53:42.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.266+0000 7fa359669640 1 -- 172.21.15.132:0/505076627 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa33406a430 msgr2=0x7fa33406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:42.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.266+0000 7fa359669640 1 --2- 172.21.15.132:0/505076627 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa33406a430 0x7fa33406c8f0 secure :-1 s=READY pgs=801 cs=0 l=1 rev1=1 crypto rx=0x7fa344036000 tx=0x7fa344030000 comp rx=0 tx=0).stop 2023-12-20T04:53:42.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.266+0000 7fa359669640 1 -- 172.21.15.132:0/505076627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35415d300 msgr2=0x7fa3540c9080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:42.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.266+0000 7fa359669640 1 --2- 172.21.15.132:0/505076627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35415d300 0x7fa3540c9080 secure :-1 s=READY pgs=1916 cs=0 l=1 rev1=1 crypto rx=0x7fa34c00c780 tx=0x7fa34c00cc40 comp rx=0 tx=0).stop 2023-12-20T04:53:42.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.266+0000 7fa359669640 1 -- 172.21.15.132:0/505076627 shutdown_connections 2023-12-20T04:53:42.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.266+0000 7fa359669640 1 --2- 172.21.15.132:0/505076627 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fa33406a430 0x7fa33406c8f0 unknown :-1 s=CLOSED pgs=801 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:42.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.266+0000 7fa359669640 1 --2- 172.21.15.132:0/505076627 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fa35415d300 0x7fa3540c9080 unknown :-1 s=CLOSED pgs=1916 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:42.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.266+0000 7fa359669640 1 --2- 172.21.15.132:0/505076627 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fa3540d17d0 0x7fa3541f2210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:42.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.266+0000 7fa359669640 1 --2- 172.21.15.132:0/505076627 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fa3540cfea0 0x7fa354154f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:42.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.266+0000 7fa359669640 1 -- 172.21.15.132:0/505076627 >> 172.21.15.132:0/505076627 conn(0x7fa35406a3d0 msgr2=0x7fa3540ce150 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:42.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.267+0000 7fa359669640 1 -- 172.21.15.132:0/505076627 shutdown_connections 2023-12-20T04:53:42.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.267+0000 7fa359669640 1 -- 172.21.15.132:0/505076627 wait complete. 2023-12-20T04:53:42.282 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2023-12-20T04:53:42.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.427+0000 7f45863b1640 1 Processor -- start 2023-12-20T04:53:42.430 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.428+0000 7f45863b1640 1 -- start start 2023-12-20T04:53:42.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.428+0000 7f45863b1640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f458015d300 0x7f458006c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:42.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.428+0000 7f45863b1640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f458006cc90 con 0x7f45800cd4b0 2023-12-20T04:53:42.433 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.428+0000 7f45863b1640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f45800b2f30 con 0x7f458015cf20 2023-12-20T04:53:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.428+0000 7f45863b1640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f45800b3210 con 0x7f458015d300 2023-12-20T04:53:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.428+0000 7f458494e640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f45800cd4b0 0x7f45800d0660 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36670/0 (socket says 172.21.15.132:36670) 2023-12-20T04:53:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.428+0000 7f458494e640 1 -- 172.21.15.132:0/251108062 learned_addr learned my addr 172.21.15.132:0/251108062 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457f7fe640 1 --2- 172.21.15.132:0/251108062 >> v2:172.21.15.187:3300/0 conn(0x7f458015d300 0x7f458006c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457effd640 1 -- 172.21.15.132:0/251108062 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 744621123 0 0) 0x7f458006cc90 con 0x7f45800cd4b0 2023-12-20T04:53:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457effd640 1 -- 172.21.15.132:0/251108062 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f4568003520 con 0x7f45800cd4b0 2023-12-20T04:53:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457effd640 1 -- 172.21.15.132:0/251108062 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3272834683 0 0) 0x7f4568003520 con 0x7f45800cd4b0 2023-12-20T04:53:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457effd640 1 -- 172.21.15.132:0/251108062 >> v2:172.21.15.187:3300/0 conn(0x7f458015d300 msgr2=0x7f458006c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457effd640 1 --2- 172.21.15.132:0/251108062 >> v2:172.21.15.187:3300/0 conn(0x7f458015d300 0x7f458006c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457effd640 1 -- 172.21.15.132:0/251108062 >> v1:172.21.15.187:6789/0 conn(0x7f458015cf20 legacy=0x7f4580161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457effd640 1 -- 172.21.15.132:0/251108062 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45800b34f0 con 0x7f45800cd4b0 2023-12-20T04:53:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457effd640 1 -- 172.21.15.132:0/251108062 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f45780019f0 con 0x7f45800cd4b0 2023-12-20T04:53:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457effd640 1 -- 172.21.15.132:0/251108062 >> v1:172.21.15.132:6789/0 conn(0x7f45800cd4b0 legacy=0x7f45800d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457effd640 1 --2- 172.21.15.132:0/251108062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4568003970 0x7f4568003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:42.434 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457effd640 1 --2- 172.21.15.132:0/251108062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45680047c0 0x7f4568004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:42.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457effd640 1 --2- 172.21.15.132:0/251108062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4568005180 0x7f456800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:42.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457effd640 1 -- 172.21.15.132:0/251108062 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45800b3210 con 0x7f4568005180 2023-12-20T04:53:42.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457effd640 1 -- 172.21.15.132:0/251108062 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f456800c020 con 0x7f45680047c0 2023-12-20T04:53:42.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457effd640 1 -- 172.21.15.132:0/251108062 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f456800c1e0 con 0x7f4568003970 2023-12-20T04:53:42.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f458494e640 1 --2- 172.21.15.132:0/251108062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4568005180 0x7f456800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:42.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457ffff640 1 --2- 172.21.15.132:0/251108062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4568003970 0x7f4568003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:42.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.429+0000 7f457f7fe640 1 --2- 172.21.15.132:0/251108062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45680047c0 0x7f4568004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:42.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.430+0000 7f458494e640 1 -- 172.21.15.132:0/251108062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4568003970 msgr2=0x7f4568003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:42.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.430+0000 7f458494e640 1 --2- 172.21.15.132:0/251108062 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f4568003970 0x7f4568003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:42.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.430+0000 7f458494e640 1 -- 172.21.15.132:0/251108062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45680047c0 msgr2=0x7f4568004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:42.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.430+0000 7f458494e640 1 --2- 172.21.15.132:0/251108062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45680047c0 0x7f4568004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:42.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.430+0000 7f458494e640 1 -- 172.21.15.132:0/251108062 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4568003520 con 0x7f4568005180 2023-12-20T04:53:42.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.430+0000 7f457f7fe640 1 --2- 172.21.15.132:0/251108062 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f45680047c0 0x7f4568004c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:42.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.430+0000 7f458494e640 1 -- 172.21.15.132:0/251108062 reap_dead start 2023-12-20T04:53:42.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.430+0000 7f458494e640 1 --2- 172.21.15.132:0/251108062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4568005180 0x7f456800b980 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f457800a830 tx=0x7f45680057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7b7f9b29ff844eb server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:42.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.430+0000 7f457effd640 1 -- 172.21.15.132:0/251108062 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45780072d0 con 0x7f4568005180 2023-12-20T04:53:42.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.430+0000 7f457effd640 1 -- 172.21.15.132:0/251108062 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f457802f070 con 0x7f4568005180 2023-12-20T04:53:42.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.430+0000 7f457effd640 1 -- 172.21.15.132:0/251108062 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f45780076b0 con 0x7f4568005180 2023-12-20T04:53:42.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.431+0000 7f45863b1640 1 -- 172.21.15.132:0/251108062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4568005180 msgr2=0x7f456800b980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:42.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.431+0000 7f45863b1640 1 --2- 172.21.15.132:0/251108062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4568005180 0x7f456800b980 secure :-1 s=READY pgs=1918 cs=0 l=1 rev1=1 crypto rx=0x7f457800a830 tx=0x7f45680057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:42.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.431+0000 7f45863b1640 1 -- 172.21.15.132:0/251108062 shutdown_connections 2023-12-20T04:53:42.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.431+0000 7f45863b1640 1 --2- 172.21.15.132:0/251108062 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f4568005180 0x7f456800b980 unknown :-1 s=CLOSED pgs=1918 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:42.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.431+0000 7f45863b1640 1 -- 172.21.15.132:0/251108062 >> 172.21.15.132:0/251108062 conn(0x7f4580072c60 msgr2=0x7f4580073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:42.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.431+0000 7f45863b1640 1 -- 172.21.15.132:0/251108062 shutdown_connections 2023-12-20T04:53:42.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.431+0000 7f45863b1640 1 -- 172.21.15.132:0/251108062 wait complete. 2023-12-20T04:53:42.439 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.432+0000 7f45863b1640 1 Processor -- start 2023-12-20T04:53:42.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.432+0000 7f45863b1640 1 -- start start 2023-12-20T04:53:42.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.433+0000 7f45863b1640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4568005180 0x7f4580149a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:42.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.433+0000 7f45863b1640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f458014a360 0x7f45800ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:42.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.433+0000 7f45863b1640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45800ace20 0x7f45800aee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:42.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.433+0000 7f45863b1640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45800ad2d0 con 0x7f45800ace20 2023-12-20T04:53:42.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.433+0000 7f45863b1640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f45800afba0 con 0x7f4568005180 2023-12-20T04:53:42.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.433+0000 7f45863b1640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f45800c5880 con 0x7f458014a360 2023-12-20T04:53:42.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.433+0000 7f458494e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45800ace20 0x7f45800aee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:42.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.433+0000 7f458494e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45800ace20 0x7f45800aee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37744/0 (socket says 172.21.15.132:37744) 2023-12-20T04:53:42.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.433+0000 7f458494e640 1 -- 172.21.15.132:0/2728187273 learned_addr learned my addr 172.21.15.132:0/2728187273 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:42.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.433+0000 7f457ffff640 1 --2- 172.21.15.132:0/2728187273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4568005180 0x7f4580149a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:42.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.433+0000 7f458494e640 1 -- 172.21.15.132:0/2728187273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f458014a360 msgr2=0x7f45800ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:42.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.433+0000 7f458494e640 1 --2- 172.21.15.132:0/2728187273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f458014a360 0x7f45800ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:42.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.433+0000 7f458494e640 1 -- 172.21.15.132:0/2728187273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4568005180 msgr2=0x7f4580149a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:42.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.433+0000 7f458494e640 1 --2- 172.21.15.132:0/2728187273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4568005180 0x7f4580149a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:42.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.433+0000 7f458494e640 1 -- 172.21.15.132:0/2728187273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f45800c5b60 con 0x7f45800ace20 2023-12-20T04:53:42.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.434+0000 7f458494e640 1 --2- 172.21.15.132:0/2728187273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45800ace20 0x7f45800aee70 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f457802cc40 tx=0x7f4578001d80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:42.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.434+0000 7f457cff9640 1 -- 172.21.15.132:0/2728187273 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578044070 con 0x7f45800ace20 2023-12-20T04:53:42.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.434+0000 7f457cff9640 1 -- 172.21.15.132:0/2728187273 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f45780019c0 con 0x7f45800ace20 2023-12-20T04:53:42.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.434+0000 7f45863b1640 1 -- 172.21.15.132:0/2728187273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f45800c5e40 con 0x7f45800ace20 2023-12-20T04:53:42.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.434+0000 7f457cff9640 1 -- 172.21.15.132:0/2728187273 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f4578007670 con 0x7f45800ace20 2023-12-20T04:53:42.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.434+0000 7f45863b1640 1 -- 172.21.15.132:0/2728187273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4580149f50 con 0x7f45800ace20 2023-12-20T04:53:42.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.435+0000 7f45863b1640 1 -- 172.21.15.132:0/2728187273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f45800c6080 con 0x7f45800ace20 2023-12-20T04:53:42.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.435+0000 7f457cff9640 1 -- 172.21.15.132:0/2728187273 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f4578031030 con 0x7f45800ace20 2023-12-20T04:53:42.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.435+0000 7f457cff9640 1 --2- 172.21.15.132:0/2728187273 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f456c06a460 0x7f456c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:42.441 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.436+0000 7f457cff9640 1 -- 172.21.15.132:0/2728187273 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(191..191 src has 1..191) v4 ==== 5795+0+0 (secure 0 0 0) 0x7f45780aa210 con 0x7f45800ace20 2023-12-20T04:53:42.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.436+0000 7f457ffff640 1 --2- 172.21.15.132:0/2728187273 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f456c06a460 0x7f456c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:42.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.436+0000 7f457cff9640 1 -- 172.21.15.132:0/2728187273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=192}) v3 -- 0x7f456c0720a0 con 0x7f45800ace20 2023-12-20T04:53:42.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.436+0000 7f457ffff640 1 --2- 172.21.15.132:0/2728187273 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f456c06a460 0x7f456c06c920 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4570000c00 tx=0x7f4570009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:42.442 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.440+0000 7f457cff9640 1 -- 172.21.15.132:0/2728187273 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f45800c6080 con 0x7f45800ace20 2023-12-20T04:53:42.607 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:42.605+0000 7f45863b1640 1 -- 172.21.15.132:0/2728187273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f45800c6080 con 0x7f45800ace20 2023-12-20T04:53:43.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.266+0000 7f457cff9640 1 -- 172.21.15.132:0/2728187273 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(192..192 src has 1..192) v4 ==== 296+0+0 (secure 0 0 0) 0x7f4578079bf0 con 0x7f45800ace20 2023-12-20T04:53:43.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.266+0000 7f457cff9640 1 -- 172.21.15.132:0/2728187273 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f456c0704d0 con 0x7f45800ace20 2023-12-20T04:53:43.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.268+0000 7f457cff9640 1 -- 172.21.15.132:0/2728187273 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v192) v1 ==== 181+0+0 (secure 0 0 0) 0x7f45800c6080 con 0x7f45800ace20 2023-12-20T04:53:43.270 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_metadata' removed 2023-12-20T04:53:43.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.273+0000 7f45863b1640 1 -- 172.21.15.132:0/2728187273 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f456c06a460 msgr2=0x7f456c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:43.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.273+0000 7f45863b1640 1 --2- 172.21.15.132:0/2728187273 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f456c06a460 0x7f456c06c920 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f4570000c00 tx=0x7f4570009040 comp rx=0 tx=0).stop 2023-12-20T04:53:43.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.273+0000 7f45863b1640 1 -- 172.21.15.132:0/2728187273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45800ace20 msgr2=0x7f45800aee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:43.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.273+0000 7f45863b1640 1 --2- 172.21.15.132:0/2728187273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45800ace20 0x7f45800aee70 secure :-1 s=READY pgs=1919 cs=0 l=1 rev1=1 crypto rx=0x7f457802cc40 tx=0x7f4578001d80 comp rx=0 tx=0).stop 2023-12-20T04:53:43.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.273+0000 7f45863b1640 1 -- 172.21.15.132:0/2728187273 shutdown_connections 2023-12-20T04:53:43.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.273+0000 7f45863b1640 1 --2- 172.21.15.132:0/2728187273 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f456c06a460 0x7f456c06c920 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:43.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.273+0000 7f45863b1640 1 --2- 172.21.15.132:0/2728187273 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f45800ace20 0x7f45800aee70 unknown :-1 s=CLOSED pgs=1919 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:43.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.273+0000 7f45863b1640 1 --2- 172.21.15.132:0/2728187273 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f458014a360 0x7f45800ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:43.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.273+0000 7f45863b1640 1 --2- 172.21.15.132:0/2728187273 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f4568005180 0x7f4580149a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:43.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.273+0000 7f45863b1640 1 -- 172.21.15.132:0/2728187273 >> 172.21.15.132:0/2728187273 conn(0x7f4580072c60 msgr2=0x7f45800b1910 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:43.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.273+0000 7f45863b1640 1 -- 172.21.15.132:0/2728187273 shutdown_connections 2023-12-20T04:53:43.276 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.273+0000 7f45863b1640 1 -- 172.21.15.132:0/2728187273 wait complete. 2023-12-20T04:53:43.287 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2023-12-20T04:53:43.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.390+0000 7f5a8864a640 1 Processor -- start 2023-12-20T04:53:43.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.390+0000 7f5a8864a640 1 -- start start 2023-12-20T04:53:43.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a8864a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a8006bdd0 0x7f5a8006afe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:43.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a8864a640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f5a800cfab0 0x7f5a8006dda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:43.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a8864a640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a800d1b80 con 0x7f5a8015d220 2023-12-20T04:53:43.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a8864a640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a8015d600 con 0x7f5a800cfab0 2023-12-20T04:53:43.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a8864a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a800d0020 con 0x7f5a8006bdd0 2023-12-20T04:53:43.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a863e6640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5a8015d220 0x7f5a8006b6c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36684/0 (socket says 172.21.15.132:36684) 2023-12-20T04:53:43.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a863e6640 1 -- 172.21.15.132:0/578234701 learned_addr learned my addr 172.21.15.132:0/578234701 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:43.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a85be5640 1 --2- 172.21.15.132:0/578234701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a8006bdd0 0x7f5a8006afe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:43.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a86be7640 1 --2- 172.21.15.132:0/578234701 >> v2:172.21.15.187:3300/0 conn(0x7f5a800cfab0 0x7f5a8006dda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:43.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a853e4640 1 -- 172.21.15.132:0/578234701 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2510511085 0 0) 0x7f5a800d1b80 con 0x7f5a8015d220 2023-12-20T04:53:43.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a853e4640 1 -- 172.21.15.132:0/578234701 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f5a6c003520 con 0x7f5a8015d220 2023-12-20T04:53:43.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a853e4640 1 -- 172.21.15.132:0/578234701 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3269293338 0 0) 0x7f5a6c003520 con 0x7f5a8015d220 2023-12-20T04:53:43.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a853e4640 1 -- 172.21.15.132:0/578234701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a8006bdd0 msgr2=0x7f5a8006afe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:43.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a853e4640 1 --2- 172.21.15.132:0/578234701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a8006bdd0 0x7f5a8006afe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:43.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a853e4640 1 -- 172.21.15.132:0/578234701 >> v2:172.21.15.187:3300/0 conn(0x7f5a800cfab0 msgr2=0x7f5a8006dda0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:43.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a853e4640 1 --2- 172.21.15.132:0/578234701 >> v2:172.21.15.187:3300/0 conn(0x7f5a800cfab0 0x7f5a8006dda0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:43.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a853e4640 1 -- 172.21.15.132:0/578234701 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a800d0300 con 0x7f5a8015d220 2023-12-20T04:53:43.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a853e4640 1 -- 172.21.15.132:0/578234701 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f5a7c0017f0 con 0x7f5a8015d220 2023-12-20T04:53:43.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a85be5640 1 --2- 172.21.15.132:0/578234701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a8006bdd0 0x7f5a8006afe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:53:43.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a853e4640 1 -- 172.21.15.132:0/578234701 >> v1:172.21.15.132:6789/0 conn(0x7f5a8015d220 legacy=0x7f5a8006b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:43.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a853e4640 1 --2- 172.21.15.132:0/578234701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a8006bdd0 0x7f5a6c003970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:43.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a853e4640 1 --2- 172.21.15.132:0/578234701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a6c003f00 0x7f5a6c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:43.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a853e4640 1 --2- 172.21.15.132:0/578234701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a6c004d00 0x7f5a6c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:43.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a853e4640 1 -- 172.21.15.132:0/578234701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a8015d600 con 0x7f5a6c004d00 2023-12-20T04:53:43.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a853e4640 1 -- 172.21.15.132:0/578234701 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a800d0020 con 0x7f5a6c003f00 2023-12-20T04:53:43.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a853e4640 1 -- 172.21.15.132:0/578234701 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a6c00b9d0 con 0x7f5a8006bdd0 2023-12-20T04:53:43.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.391+0000 7f5a86be7640 1 --2- 172.21.15.132:0/578234701 >> v2:172.21.15.187:3300/0 conn(0x7f5a800cfab0 0x7f5a8006dda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:53:43.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.392+0000 7f5a863e6640 1 --2- 172.21.15.132:0/578234701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a8006bdd0 0x7f5a6c003970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:43.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.392+0000 7f5a86be7640 1 --2- 172.21.15.132:0/578234701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a6c004d00 0x7f5a6c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:43.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.392+0000 7f5a85be5640 1 --2- 172.21.15.132:0/578234701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a6c003f00 0x7f5a6c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:43.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.392+0000 7f5a86be7640 1 -- 172.21.15.132:0/578234701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a8006bdd0 msgr2=0x7f5a6c003970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:43.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.392+0000 7f5a86be7640 1 --2- 172.21.15.132:0/578234701 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a8006bdd0 0x7f5a6c003970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:43.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.392+0000 7f5a86be7640 1 -- 172.21.15.132:0/578234701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a6c003f00 msgr2=0x7f5a6c0047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:43.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.392+0000 7f5a86be7640 1 --2- 172.21.15.132:0/578234701 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a6c003f00 0x7f5a6c0047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:43.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.392+0000 7f5a86be7640 1 -- 172.21.15.132:0/578234701 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a70009400 con 0x7f5a6c004d00 2023-12-20T04:53:43.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.393+0000 7f5a86be7640 1 --2- 172.21.15.132:0/578234701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a6c004d00 0x7f5a6c005180 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800e350 tx=0x7f5a6c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=557c14393438a368 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:43.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.393+0000 7f5a853e4640 1 -- 172.21.15.132:0/578234701 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7802cde0 con 0x7f5a6c004d00 2023-12-20T04:53:43.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.393+0000 7f5a853e4640 1 -- 172.21.15.132:0/578234701 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7800f040 con 0x7f5a6c004d00 2023-12-20T04:53:43.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.393+0000 7f5a853e4640 1 -- 172.21.15.132:0/578234701 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a78003b90 con 0x7f5a6c004d00 2023-12-20T04:53:43.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.393+0000 7f5a8864a640 1 -- 172.21.15.132:0/578234701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a6c004d00 msgr2=0x7f5a6c005180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:43.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.393+0000 7f5a8864a640 1 --2- 172.21.15.132:0/578234701 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a6c004d00 0x7f5a6c005180 secure :-1 s=READY pgs=1921 cs=0 l=1 rev1=1 crypto rx=0x7f5a7800e350 tx=0x7f5a6c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:43.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.393+0000 7f5a86be7640 1 -- 172.21.15.132:0/578234701 reap_dead start 2023-12-20T04:53:43.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.393+0000 7f5a8864a640 1 -- 172.21.15.132:0/578234701 shutdown_connections 2023-12-20T04:53:43.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.393+0000 7f5a8864a640 1 -- 172.21.15.132:0/578234701 >> 172.21.15.132:0/578234701 conn(0x7f5a80099fa0 msgr2=0x7f5a800d0c30 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:43.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.393+0000 7f5a8864a640 1 -- 172.21.15.132:0/578234701 shutdown_connections 2023-12-20T04:53:43.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.393+0000 7f5a8864a640 1 -- 172.21.15.132:0/578234701 wait complete. 2023-12-20T04:53:43.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.395+0000 7f5a8864a640 1 Processor -- start 2023-12-20T04:53:43.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.395+0000 7f5a8864a640 1 -- start start 2023-12-20T04:53:43.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.395+0000 7f5a8864a640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a6c004d00 0x7f5a801f25f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:43.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.395+0000 7f5a8864a640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a800b1da0 0x7f5a800b21e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:43.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.395+0000 7f5a8864a640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a800b38c0 0x7f5a800b3d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:43.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.395+0000 7f5a8864a640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a800b6ae0 con 0x7f5a6c004d00 2023-12-20T04:53:43.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.395+0000 7f5a8864a640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a800b6650 con 0x7f5a800b1da0 2023-12-20T04:53:43.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.395+0000 7f5a8864a640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a800b2720 con 0x7f5a800b38c0 2023-12-20T04:53:43.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.395+0000 7f5a863e6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a6c004d00 0x7f5a801f25f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:43.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.395+0000 7f5a863e6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a6c004d00 0x7f5a801f25f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37762/0 (socket says 172.21.15.132:37762) 2023-12-20T04:53:43.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.395+0000 7f5a863e6640 1 -- 172.21.15.132:0/4289384870 learned_addr learned my addr 172.21.15.132:0/4289384870 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:43.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.396+0000 7f5a85be5640 1 --2- 172.21.15.132:0/4289384870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a800b1da0 0x7f5a800b21e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:43.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.396+0000 7f5a86be7640 1 --2- 172.21.15.132:0/4289384870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a800b38c0 0x7f5a800b3d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:43.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.396+0000 7f5a863e6640 1 -- 172.21.15.132:0/4289384870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a800b38c0 msgr2=0x7f5a800b3d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:43.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.396+0000 7f5a863e6640 1 --2- 172.21.15.132:0/4289384870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a800b38c0 0x7f5a800b3d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:43.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.396+0000 7f5a863e6640 1 -- 172.21.15.132:0/4289384870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a800b1da0 msgr2=0x7f5a800b21e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:43.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.396+0000 7f5a863e6640 1 --2- 172.21.15.132:0/4289384870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a800b1da0 0x7f5a800b21e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:43.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.396+0000 7f5a863e6640 1 -- 172.21.15.132:0/4289384870 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a800b5d20 con 0x7f5a6c004d00 2023-12-20T04:53:43.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.396+0000 7f5a85be5640 1 --2- 172.21.15.132:0/4289384870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a800b1da0 0x7f5a800b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:43.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.396+0000 7f5a86be7640 1 --2- 172.21.15.132:0/4289384870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a800b38c0 0x7f5a800b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:43.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.396+0000 7f5a863e6640 1 --2- 172.21.15.132:0/4289384870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a6c004d00 0x7f5a801f25f0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00fb90 tx=0x7f5a7c00ff90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:43.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.396+0000 7f5a76ffd640 1 -- 172.21.15.132:0/4289384870 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c0015d0 con 0x7f5a6c004d00 2023-12-20T04:53:43.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.396+0000 7f5a76ffd640 1 -- 172.21.15.132:0/4289384870 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a7c0072e0 con 0x7f5a6c004d00 2023-12-20T04:53:43.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.396+0000 7f5a8864a640 1 -- 172.21.15.132:0/4289384870 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a800b6000 con 0x7f5a6c004d00 2023-12-20T04:53:43.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.396+0000 7f5a76ffd640 1 -- 172.21.15.132:0/4289384870 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a7c00d7f0 con 0x7f5a6c004d00 2023-12-20T04:53:43.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.396+0000 7f5a8864a640 1 -- 172.21.15.132:0/4289384870 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a800b4280 con 0x7f5a6c004d00 2023-12-20T04:53:43.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.397+0000 7f5a8864a640 1 -- 172.21.15.132:0/4289384870 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a8004e840 con 0x7f5a6c004d00 2023-12-20T04:53:43.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.397+0000 7f5a76ffd640 1 -- 172.21.15.132:0/4289384870 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5a7c00d950 con 0x7f5a6c004d00 2023-12-20T04:53:43.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.398+0000 7f5a76ffd640 1 --2- 172.21.15.132:0/4289384870 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5a6406a460 0x7f5a6406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:43.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.398+0000 7f5a76ffd640 1 -- 172.21.15.132:0/4289384870 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(192..192 src has 1..192) v4 ==== 5357+0+0 (secure 0 0 0) 0x7f5a7c088a60 con 0x7f5a6c004d00 2023-12-20T04:53:43.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.398+0000 7f5a85be5640 1 --2- 172.21.15.132:0/4289384870 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5a6406a460 0x7f5a6406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:43.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.398+0000 7f5a76ffd640 1 -- 172.21.15.132:0/4289384870 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=193}) v3 -- 0x7f5a64071230 con 0x7f5a6c004d00 2023-12-20T04:53:43.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.398+0000 7f5a85be5640 1 --2- 172.21.15.132:0/4289384870 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5a6406a460 0x7f5a6406c920 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f5a70006b10 tx=0x7f5a70008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:43.404 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.402+0000 7f5a76ffd640 1 -- 172.21.15.132:0/4289384870 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f5a7c0541b0 con 0x7f5a6c004d00 2023-12-20T04:53:43.569 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:43.567+0000 7f5a8864a640 1 -- 172.21.15.132:0/4289384870 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) v1 -- 0x7f5a800b2e40 con 0x7f5a6c004d00 2023-12-20T04:53:44.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.267+0000 7f5a76ffd640 1 -- 172.21.15.132:0/4289384870 <== mon.0 v2:172.21.15.132:3300/0 7 ==== osd_map(193..193 src has 1..193) v4 ==== 296+0+0 (secure 0 0 0) 0x7f5a7c058570 con 0x7f5a6c004d00 2023-12-20T04:53:44.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.267+0000 7f5a76ffd640 1 -- 172.21.15.132:0/4289384870 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=194}) v3 -- 0x7f5a6406ffc0 con 0x7f5a6c004d00 2023-12-20T04:53:44.275 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.274+0000 7f5a76ffd640 1 -- 172.21.15.132:0/4289384870 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v193) v1 ==== 169+0+0 (secure 0 0 0) 0x7f5a7c0577d0 con 0x7f5a6c004d00 2023-12-20T04:53:44.276 INFO:teuthology.orchestra.run.smithi132.stderr:pool 'cephfs_data' removed 2023-12-20T04:53:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.278+0000 7f5a8864a640 1 -- 172.21.15.132:0/4289384870 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5a6406a460 msgr2=0x7f5a6406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:44.280 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.278+0000 7f5a8864a640 1 --2- 172.21.15.132:0/4289384870 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5a6406a460 0x7f5a6406c920 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f5a70006b10 tx=0x7f5a70008040 comp rx=0 tx=0).stop 2023-12-20T04:53:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.278+0000 7f5a8864a640 1 -- 172.21.15.132:0/4289384870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a6c004d00 msgr2=0x7f5a801f25f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.278+0000 7f5a8864a640 1 --2- 172.21.15.132:0/4289384870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a6c004d00 0x7f5a801f25f0 secure :-1 s=READY pgs=1922 cs=0 l=1 rev1=1 crypto rx=0x7f5a7c00fb90 tx=0x7f5a7c00ff90 comp rx=0 tx=0).stop 2023-12-20T04:53:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.278+0000 7f5a8864a640 1 -- 172.21.15.132:0/4289384870 shutdown_connections 2023-12-20T04:53:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.278+0000 7f5a8864a640 1 --2- 172.21.15.132:0/4289384870 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5a6406a460 0x7f5a6406c920 unknown :-1 s=CLOSED pgs=804 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.278+0000 7f5a8864a640 1 --2- 172.21.15.132:0/4289384870 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a800b38c0 0x7f5a800b3d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.278+0000 7f5a8864a640 1 --2- 172.21.15.132:0/4289384870 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a800b1da0 0x7f5a800b21e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.278+0000 7f5a8864a640 1 --2- 172.21.15.132:0/4289384870 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a6c004d00 0x7f5a801f25f0 unknown :-1 s=CLOSED pgs=1922 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.278+0000 7f5a8864a640 1 -- 172.21.15.132:0/4289384870 >> 172.21.15.132:0/4289384870 conn(0x7f5a80099fa0 msgr2=0x7f5a8015d8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:44.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.279+0000 7f5a8864a640 1 -- 172.21.15.132:0/4289384870 shutdown_connections 2023-12-20T04:53:44.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.279+0000 7f5a8864a640 1 -- 172.21.15.132:0/4289384870 wait complete. 2023-12-20T04:53:44.293 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mon mon_allow_pool_delete 2023-12-20T04:53:44.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.395+0000 7f8ded2ce640 1 Processor -- start 2023-12-20T04:53:44.397 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.395+0000 7f8ded2ce640 1 -- start start 2023-12-20T04:53:44.398 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.396+0000 7f8ded2ce640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8de815d300 0x7f8de80d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.396+0000 7f8ded2ce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8de80d17d0 0x7f8de80cf790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.396+0000 7f8ded2ce640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f8de80cfcd0 0x7f8de80b48f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.396+0000 7f8ded2ce640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de80d0160 con 0x7f8de815d300 2023-12-20T04:53:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.396+0000 7f8ded2ce640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f8de80d2920 con 0x7f8de80cfcd0 2023-12-20T04:53:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.396+0000 7f8ded2ce640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de80d1d10 con 0x7f8de80d17d0 2023-12-20T04:53:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.396+0000 7f8de6ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8de815d300 0x7f8de80d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.396+0000 7f8de6ffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f8de815d300 0x7f8de80d1290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37770/0 (socket says 172.21.15.132:37770) 2023-12-20T04:53:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.396+0000 7f8de6ffd640 1 -- 172.21.15.132:0/331892447 learned_addr learned my addr 172.21.15.132:0/331892447 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.396+0000 7f8de6ffd640 1 -- 172.21.15.132:0/331892447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8de80d17d0 msgr2=0x7f8de80cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.396+0000 7f8de6ffd640 1 --2- 172.21.15.132:0/331892447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8de80d17d0 0x7f8de80cf790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.396+0000 7f8de6ffd640 1 -- 172.21.15.132:0/331892447 >> v2:172.21.15.187:3300/0 conn(0x7f8de80cfcd0 msgr2=0x7f8de80b48f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:44.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.396+0000 7f8de6ffd640 1 --2- 172.21.15.132:0/331892447 >> v2:172.21.15.187:3300/0 conn(0x7f8de80cfcd0 0x7f8de80b48f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.396+0000 7f8de6ffd640 1 -- 172.21.15.132:0/331892447 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8de80d1ff0 con 0x7f8de815d300 2023-12-20T04:53:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.397+0000 7f8de6ffd640 1 --2- 172.21.15.132:0/331892447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8de815d300 0x7f8de80d1290 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f8de80b5e50 tx=0x7f8dd802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76c0bb8873aed103 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.397+0000 7f8de67fc640 1 -- 172.21.15.132:0/331892447 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8031870 con 0x7f8de815d300 2023-12-20T04:53:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.397+0000 7f8de67fc640 1 -- 172.21.15.132:0/331892447 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd80319d0 con 0x7f8de815d300 2023-12-20T04:53:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.397+0000 7f8de67fc640 1 -- 172.21.15.132:0/331892447 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd8031d60 con 0x7f8de815d300 2023-12-20T04:53:44.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.398+0000 7f8ded2ce640 1 -- 172.21.15.132:0/331892447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8de815d300 msgr2=0x7f8de80d1290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.398+0000 7f8ded2ce640 1 --2- 172.21.15.132:0/331892447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8de815d300 0x7f8de80d1290 secure :-1 s=READY pgs=1923 cs=0 l=1 rev1=1 crypto rx=0x7f8de80b5e50 tx=0x7f8dd802b910 comp rx=0 tx=0).stop 2023-12-20T04:53:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.398+0000 7f8ded2ce640 1 -- 172.21.15.132:0/331892447 shutdown_connections 2023-12-20T04:53:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.398+0000 7f8ded2ce640 1 --2- 172.21.15.132:0/331892447 >> v2:172.21.15.187:3300/0 conn(0x7f8de80cfcd0 0x7f8de80b48f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.398+0000 7f8ded2ce640 1 --2- 172.21.15.132:0/331892447 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8de80d17d0 0x7f8de80cf790 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.398+0000 7f8ded2ce640 1 --2- 172.21.15.132:0/331892447 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8de815d300 0x7f8de80d1290 unknown :-1 s=CLOSED pgs=1923 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.398+0000 7f8ded2ce640 1 -- 172.21.15.132:0/331892447 >> 172.21.15.132:0/331892447 conn(0x7f8de806a3d0 msgr2=0x7f8de806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.398+0000 7f8ded2ce640 1 -- 172.21.15.132:0/331892447 shutdown_connections 2023-12-20T04:53:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.398+0000 7f8ded2ce640 1 -- 172.21.15.132:0/331892447 wait complete. 2023-12-20T04:53:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.399+0000 7f8ded2ce640 1 Processor -- start 2023-12-20T04:53:44.402 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.399+0000 7f8ded2ce640 1 -- start start 2023-12-20T04:53:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.400+0000 7f8ded2ce640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8de80cfcd0 0x7f8de80c9450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.400+0000 7f8ded2ce640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8de80d17d0 0x7f8de81527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.400+0000 7f8ded2ce640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8de815d300 0x7f8de81f5670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.400+0000 7f8ded2ce640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de81532f0 con 0x7f8de80d17d0 2023-12-20T04:53:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.400+0000 7f8ded2ce640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8de8153010 con 0x7f8de80cfcd0 2023-12-20T04:53:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.400+0000 7f8ded2ce640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f8de80c6900 con 0x7f8de815d300 2023-12-20T04:53:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.400+0000 7f8dde7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8de80d17d0 0x7f8de81527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.400+0000 7f8dde7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8de80d17d0 0x7f8de81527f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37772/0 (socket says 172.21.15.132:37772) 2023-12-20T04:53:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.400+0000 7f8dde7fc640 1 -- 172.21.15.132:0/3899617829 learned_addr learned my addr 172.21.15.132:0/3899617829 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.400+0000 7f8de77fe640 1 --2- 172.21.15.132:0/3899617829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8de815d300 0x7f8de81f5670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.400+0000 7f8de6ffd640 1 --2- 172.21.15.132:0/3899617829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8de80cfcd0 0x7f8de80c9450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:44.405 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.400+0000 7f8dde7fc640 1 -- 172.21.15.132:0/3899617829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8de815d300 msgr2=0x7f8de81f5670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.400+0000 7f8dde7fc640 1 --2- 172.21.15.132:0/3899617829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8de815d300 0x7f8de81f5670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.400+0000 7f8dde7fc640 1 -- 172.21.15.132:0/3899617829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8de80cfcd0 msgr2=0x7f8de80c9450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.400+0000 7f8dde7fc640 1 --2- 172.21.15.132:0/3899617829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8de80cfcd0 0x7f8de80c9450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.400+0000 7f8dde7fc640 1 -- 172.21.15.132:0/3899617829 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8dd80094d0 con 0x7f8de80d17d0 2023-12-20T04:53:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.400+0000 7f8dde7fc640 1 --2- 172.21.15.132:0/3899617829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8de80d17d0 0x7f8de81527f0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f8dd000b410 tx=0x7f8dd000b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.401+0000 7f8ddffff640 1 -- 172.21.15.132:0/3899617829 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0011830 con 0x7f8de80d17d0 2023-12-20T04:53:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.401+0000 7f8ddffff640 1 -- 172.21.15.132:0/3899617829 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f8dd00119b0 con 0x7f8de80d17d0 2023-12-20T04:53:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.401+0000 7f8ddffff640 1 -- 172.21.15.132:0/3899617829 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f8dd0011d60 con 0x7f8de80d17d0 2023-12-20T04:53:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.401+0000 7f8ded2ce640 1 -- 172.21.15.132:0/3899617829 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8de80c6be0 con 0x7f8de80d17d0 2023-12-20T04:53:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.401+0000 7f8ded2ce640 1 -- 172.21.15.132:0/3899617829 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8de8152d30 con 0x7f8de80d17d0 2023-12-20T04:53:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.402+0000 7f8ded2ce640 1 -- 172.21.15.132:0/3899617829 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8de804e840 con 0x7f8de80d17d0 2023-12-20T04:53:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.402+0000 7f8ddffff640 1 -- 172.21.15.132:0/3899617829 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f8dd001a400 con 0x7f8de80d17d0 2023-12-20T04:53:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.402+0000 7f8ddffff640 1 --2- 172.21.15.132:0/3899617829 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8dc806a430 0x7f8dc806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.403+0000 7f8ddffff640 1 -- 172.21.15.132:0/3899617829 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f8dd0088780 con 0x7f8de80d17d0 2023-12-20T04:53:44.406 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.403+0000 7f8de6ffd640 1 --2- 172.21.15.132:0/3899617829 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8dc806a430 0x7f8dc806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:44.407 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.403+0000 7f8de6ffd640 1 --2- 172.21.15.132:0/3899617829 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8dc806a430 0x7f8dc806c8f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8036000 tx=0x7f8dd803c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:44.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.407+0000 7f8ddffff640 1 -- 172.21.15.132:0/3899617829 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f8dd0054070 con 0x7f8de80d17d0 2023-12-20T04:53:44.574 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.572+0000 7f8ded2ce640 1 -- 172.21.15.132:0/3899617829 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"} v 0) v1 -- 0x7f8de8159220 con 0x7f8de80d17d0 2023-12-20T04:53:44.578 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.576+0000 7f8ddffff640 1 -- 172.21.15.132:0/3899617829 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "config rm", "who": "mon", "name": "mon_allow_pool_delete"}]=0 v21) v1 ==== 104+0+0 (secure 0 0 0) 0x7f8dd0057690 con 0x7f8de80d17d0 2023-12-20T04:53:44.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.578+0000 7f8ded2ce640 1 -- 172.21.15.132:0/3899617829 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8dc806a430 msgr2=0x7f8dc806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:44.580 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.578+0000 7f8ded2ce640 1 --2- 172.21.15.132:0/3899617829 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8dc806a430 0x7f8dc806c8f0 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f8dd8036000 tx=0x7f8dd803c040 comp rx=0 tx=0).stop 2023-12-20T04:53:44.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.578+0000 7f8ded2ce640 1 -- 172.21.15.132:0/3899617829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8de80d17d0 msgr2=0x7f8de81527f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:44.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.578+0000 7f8ded2ce640 1 --2- 172.21.15.132:0/3899617829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8de80d17d0 0x7f8de81527f0 secure :-1 s=READY pgs=1924 cs=0 l=1 rev1=1 crypto rx=0x7f8dd000b410 tx=0x7f8dd000b8d0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.578+0000 7f8ded2ce640 1 -- 172.21.15.132:0/3899617829 shutdown_connections 2023-12-20T04:53:44.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.578+0000 7f8ded2ce640 1 --2- 172.21.15.132:0/3899617829 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f8dc806a430 0x7f8dc806c8f0 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.578+0000 7f8ded2ce640 1 --2- 172.21.15.132:0/3899617829 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f8de815d300 0x7f8de81f5670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.578+0000 7f8ded2ce640 1 --2- 172.21.15.132:0/3899617829 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f8de80d17d0 0x7f8de81527f0 unknown :-1 s=CLOSED pgs=1924 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.578+0000 7f8ded2ce640 1 --2- 172.21.15.132:0/3899617829 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f8de80cfcd0 0x7f8de80c9450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.578+0000 7f8ded2ce640 1 -- 172.21.15.132:0/3899617829 >> 172.21.15.132:0/3899617829 conn(0x7f8de806a3d0 msgr2=0x7f8de80cdbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:44.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.578+0000 7f8ded2ce640 1 -- 172.21.15.132:0/3899617829 shutdown_connections 2023-12-20T04:53:44.581 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.578+0000 7f8ded2ce640 1 -- 172.21.15.132:0/3899617829 wait complete. 2023-12-20T04:53:44.591 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph log 'Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file' 2023-12-20T04:53:44.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.690+0000 7f84131cb640 1 Processor -- start 2023-12-20T04:53:44.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.690+0000 7f84131cb640 1 -- start start 2023-12-20T04:53:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.690+0000 7f84131cb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f840c15ad70 0x7f840c06f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.690+0000 7f84131cb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f840c0c92d0 0x7f840c15f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.690+0000 7f84131cb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f840c0c9ab0 con 0x7f840c15f6b0 2023-12-20T04:53:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.690+0000 7f84131cb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f840c15ea40 con 0x7f840c15ad70 2023-12-20T04:53:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.690+0000 7f84131cb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c0c9d90 con 0x7f840c0c92d0 2023-12-20T04:53:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f8411768640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f840c15f6b0 0x7f840c06b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36694/0 (socket says 172.21.15.132:36694) 2023-12-20T04:53:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f8411768640 1 -- 172.21.15.132:0/1358672937 learned_addr learned my addr 172.21.15.132:0/1358672937 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840b7fe640 1 -- 172.21.15.132:0/1358672937 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3398972930 0 0) 0x7f840c0c9ab0 con 0x7f840c15f6b0 2023-12-20T04:53:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840bfff640 1 --2- 172.21.15.132:0/1358672937 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f840c0c92d0 0x7f840c15f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f8410f67640 1 --2- 172.21.15.132:0/1358672937 >> v2:172.21.15.187:3300/0 conn(0x7f840c15ad70 0x7f840c06f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:44.696 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840b7fe640 1 -- 172.21.15.132:0/1358672937 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f83f8003520 con 0x7f840c15f6b0 2023-12-20T04:53:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840b7fe640 1 -- 172.21.15.132:0/1358672937 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2311730446 0 0) 0x7f83f8003520 con 0x7f840c15f6b0 2023-12-20T04:53:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840b7fe640 1 -- 172.21.15.132:0/1358672937 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f840c0c92d0 msgr2=0x7f840c15f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840b7fe640 1 --2- 172.21.15.132:0/1358672937 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f840c0c92d0 0x7f840c15f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840b7fe640 1 -- 172.21.15.132:0/1358672937 >> v2:172.21.15.187:3300/0 conn(0x7f840c15ad70 msgr2=0x7f840c06f560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840b7fe640 1 --2- 172.21.15.132:0/1358672937 >> v2:172.21.15.187:3300/0 conn(0x7f840c15ad70 0x7f840c06f560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840b7fe640 1 -- 172.21.15.132:0/1358672937 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c0ca070 con 0x7f840c15f6b0 2023-12-20T04:53:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840b7fe640 1 -- 172.21.15.132:0/1358672937 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f83fc001670 con 0x7f840c15f6b0 2023-12-20T04:53:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840b7fe640 1 -- 172.21.15.132:0/1358672937 >> v1:172.21.15.132:6789/0 conn(0x7f840c15f6b0 legacy=0x7f840c06b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840b7fe640 1 --2- 172.21.15.132:0/1358672937 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83f8003970 0x7f83f8003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840b7fe640 1 --2- 172.21.15.132:0/1358672937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83f80047c0 0x7f83f8004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840b7fe640 1 --2- 172.21.15.132:0/1358672937 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f840c0c92d0 0x7f83f8005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840b7fe640 1 -- 172.21.15.132:0/1358672937 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c15ea40 con 0x7f83f80047c0 2023-12-20T04:53:44.697 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840b7fe640 1 -- 172.21.15.132:0/1358672937 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c0c9d90 con 0x7f83f8003970 2023-12-20T04:53:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840b7fe640 1 -- 172.21.15.132:0/1358672937 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f83f800b980 con 0x7f840c0c92d0 2023-12-20T04:53:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f840bfff640 1 --2- 172.21.15.132:0/1358672937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83f80047c0 0x7f83f8004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f8410f67640 1 --2- 172.21.15.132:0/1358672937 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83f8003970 0x7f83f8003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.691+0000 7f8411768640 1 --2- 172.21.15.132:0/1358672937 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f840c0c92d0 0x7f83f8005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.692+0000 7f840bfff640 1 -- 172.21.15.132:0/1358672937 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f840c0c92d0 msgr2=0x7f83f8005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.692+0000 7f840bfff640 1 --2- 172.21.15.132:0/1358672937 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f840c0c92d0 0x7f83f8005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.692+0000 7f840bfff640 1 -- 172.21.15.132:0/1358672937 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83f8003970 msgr2=0x7f83f8003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.692+0000 7f840bfff640 1 --2- 172.21.15.132:0/1358672937 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83f8003970 0x7f83f8003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.692+0000 7f840bfff640 1 -- 172.21.15.132:0/1358672937 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f83f8003520 con 0x7f83f80047c0 2023-12-20T04:53:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.692+0000 7f840bfff640 1 --2- 172.21.15.132:0/1358672937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83f80047c0 0x7f83f8004c40 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009ac0 tx=0x7f83f80057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=93ee64d1c082fdfd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.692+0000 7f840b7fe640 1 -- 172.21.15.132:0/1358672937 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f402c6b0 con 0x7f83f80047c0 2023-12-20T04:53:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.692+0000 7f840b7fe640 1 -- 172.21.15.132:0/1358672937 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f402c810 con 0x7f83f80047c0 2023-12-20T04:53:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.692+0000 7f840b7fe640 1 -- 172.21.15.132:0/1358672937 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f402cba0 con 0x7f83f80047c0 2023-12-20T04:53:44.698 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.693+0000 7f84131cb640 1 -- 172.21.15.132:0/1358672937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83f80047c0 msgr2=0x7f83f8004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.693+0000 7f84131cb640 1 --2- 172.21.15.132:0/1358672937 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f83f80047c0 0x7f83f8004c40 secure :-1 s=READY pgs=1926 cs=0 l=1 rev1=1 crypto rx=0x7f83f4009ac0 tx=0x7f83f80057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.693+0000 7f8411768640 1 -- 172.21.15.132:0/1358672937 reap_dead start 2023-12-20T04:53:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.693+0000 7f84131cb640 1 -- 172.21.15.132:0/1358672937 shutdown_connections 2023-12-20T04:53:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.693+0000 7f84131cb640 1 -- 172.21.15.132:0/1358672937 >> 172.21.15.132:0/1358672937 conn(0x7f840c0ced10 msgr2=0x7f840c0cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.693+0000 7f84131cb640 1 -- 172.21.15.132:0/1358672937 shutdown_connections 2023-12-20T04:53:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.693+0000 7f84131cb640 1 -- 172.21.15.132:0/1358672937 wait complete. 2023-12-20T04:53:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.694+0000 7f84131cb640 1 Processor -- start 2023-12-20T04:53:44.699 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.694+0000 7f84131cb640 1 -- start start 2023-12-20T04:53:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f84131cb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83f80047c0 0x7f840c1593b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f84131cb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f840c155cd0 0x7f840c156150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:44.701 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f84131cb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f840c157890 0x7f840c157d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f84131cb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c0a8cc0 con 0x7f840c155cd0 2023-12-20T04:53:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f84131cb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f840c156690 con 0x7f83f80047c0 2023-12-20T04:53:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f84131cb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f840c158870 con 0x7f840c157890 2023-12-20T04:53:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f840bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f840c155cd0 0x7f840c156150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f840bfff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f840c155cd0 0x7f840c156150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37798/0 (socket says 172.21.15.132:37798) 2023-12-20T04:53:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f840bfff640 1 -- 172.21.15.132:0/65111337 learned_addr learned my addr 172.21.15.132:0/65111337 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f8411768640 1 --2- 172.21.15.132:0/65111337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f840c157890 0x7f840c157d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f8410f67640 1 --2- 172.21.15.132:0/65111337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83f80047c0 0x7f840c1593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f840bfff640 1 -- 172.21.15.132:0/65111337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f840c157890 msgr2=0x7f840c157d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f840bfff640 1 --2- 172.21.15.132:0/65111337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f840c157890 0x7f840c157d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f840bfff640 1 -- 172.21.15.132:0/65111337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83f80047c0 msgr2=0x7f840c1593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f840bfff640 1 --2- 172.21.15.132:0/65111337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83f80047c0 0x7f840c1593b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f840bfff640 1 -- 172.21.15.132:0/65111337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f840c158590 con 0x7f840c155cd0 2023-12-20T04:53:44.702 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f8411768640 1 --2- 172.21.15.132:0/65111337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f840c157890 0x7f840c157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.695+0000 7f8410f67640 1 --2- 172.21.15.132:0/65111337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83f80047c0 0x7f840c1593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.696+0000 7f840bfff640 1 --2- 172.21.15.132:0/65111337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f840c155cd0 0x7f840c156150 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f83f4037040 tx=0x7f83f4004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.696+0000 7f84097fa640 1 -- 172.21.15.132:0/65111337 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4003810 con 0x7f840c155cd0 2023-12-20T04:53:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.696+0000 7f84097fa640 1 -- 172.21.15.132:0/65111337 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f83f4003970 con 0x7f840c155cd0 2023-12-20T04:53:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.696+0000 7f84097fa640 1 -- 172.21.15.132:0/65111337 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f83f4003d00 con 0x7f840c155cd0 2023-12-20T04:53:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.696+0000 7f84131cb640 1 -- 172.21.15.132:0/65111337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f840c0a8600 con 0x7f840c155cd0 2023-12-20T04:53:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.696+0000 7f84131cb640 1 -- 172.21.15.132:0/65111337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f840c158250 con 0x7f840c155cd0 2023-12-20T04:53:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.697+0000 7f84131cb640 1 -- 172.21.15.132:0/65111337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f840c0a8e00 con 0x7f840c155cd0 2023-12-20T04:53:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.697+0000 7f84097fa640 1 -- 172.21.15.132:0/65111337 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f83f4040450 con 0x7f840c155cd0 2023-12-20T04:53:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.697+0000 7f84097fa640 1 --2- 172.21.15.132:0/65111337 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f83ec06a430 0x7f83ec06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.698+0000 7f84097fa640 1 -- 172.21.15.132:0/65111337 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f83f40aa440 con 0x7f840c155cd0 2023-12-20T04:53:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.698+0000 7f8410f67640 1 --2- 172.21.15.132:0/65111337 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f83ec06a430 0x7f83ec06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:44.703 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.698+0000 7f8410f67640 1 --2- 172.21.15.132:0/65111337 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f83ec06a430 0x7f83ec06c8f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f8404007440 tx=0x7f840400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:44.704 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.702+0000 7f84097fa640 1 -- 172.21.15.132:0/65111337 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f840c0a8e00 con 0x7f840c155cd0 2023-12-20T04:53:44.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.934+0000 7f84131cb640 1 -- 172.21.15.132:0/65111337 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]} v 0) v1 -- 0x7f840c0a8e00 con 0x7f840c155cd0 2023-12-20T04:53:45.001 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:44.999+0000 7f84097fa640 1 -- 172.21.15.132:0/65111337 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "log", "logtext": ["Ended test tasks.cephfs.test_full.TestQuotaFull.test_full_same_file"]}]=0 v524) v1 ==== 135+0+0 (secure 0 0 0) 0x7f840c0a8e00 con 0x7f840c155cd0 2023-12-20T04:53:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.001+0000 7f84131cb640 1 -- 172.21.15.132:0/65111337 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f83ec06a430 msgr2=0x7f83ec06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.001+0000 7f84131cb640 1 --2- 172.21.15.132:0/65111337 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f83ec06a430 0x7f83ec06c8f0 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f8404007440 tx=0x7f840400b040 comp rx=0 tx=0).stop 2023-12-20T04:53:45.003 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.001+0000 7f84131cb640 1 -- 172.21.15.132:0/65111337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f840c155cd0 msgr2=0x7f840c156150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:45.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.001+0000 7f84131cb640 1 --2- 172.21.15.132:0/65111337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f840c155cd0 0x7f840c156150 secure :-1 s=READY pgs=1927 cs=0 l=1 rev1=1 crypto rx=0x7f83f4037040 tx=0x7f83f4004730 comp rx=0 tx=0).stop 2023-12-20T04:53:45.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.001+0000 7f84131cb640 1 -- 172.21.15.132:0/65111337 shutdown_connections 2023-12-20T04:53:45.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.001+0000 7f84131cb640 1 --2- 172.21.15.132:0/65111337 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f83ec06a430 0x7f83ec06c8f0 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:45.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.001+0000 7f84131cb640 1 --2- 172.21.15.132:0/65111337 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f840c157890 0x7f840c157d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:45.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.001+0000 7f84131cb640 1 --2- 172.21.15.132:0/65111337 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f840c155cd0 0x7f840c156150 unknown :-1 s=CLOSED pgs=1927 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:45.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.001+0000 7f84131cb640 1 --2- 172.21.15.132:0/65111337 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f83f80047c0 0x7f840c1593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:45.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.001+0000 7f84131cb640 1 -- 172.21.15.132:0/65111337 >> 172.21.15.132:0/65111337 conn(0x7f840c0ced10 msgr2=0x7f840c0c61f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:45.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.001+0000 7f84131cb640 1 -- 172.21.15.132:0/65111337 shutdown_connections 2023-12-20T04:53:45.004 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.001+0000 7f84131cb640 1 -- 172.21.15.132:0/65111337 wait complete. 2023-12-20T04:53:45.014 INFO:tasks.cephfs_test_runner:test_full_same_file (tasks.cephfs.test_full.TestQuotaFull) ... ok 2023-12-20T04:53:45.014 INFO:tasks.cephfs_test_runner: 2023-12-20T04:53:45.015 INFO:tasks.cephfs_test_runner:---------------------------------------------------------------------- 2023-12-20T04:53:45.015 INFO:tasks.cephfs_test_runner:Ran 10 tests in 627.789s 2023-12-20T04:53:45.015 INFO:tasks.cephfs_test_runner: 2023-12-20T04:53:45.015 INFO:tasks.cephfs_test_runner:OK 2023-12-20T04:53:45.015 DEBUG:teuthology.run_tasks:Unwinding manager cephfs_test_runner 2023-12-20T04:53:45.025 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2023-12-20T04:53:45.086 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2023-12-20T04:53:45.086 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:53:45.086 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:53:45.102 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:53:45.102 DEBUG:teuthology.orchestra.run.smithi132:> set -ex 2023-12-20T04:53:45.102 DEBUG:teuthology.orchestra.run.smithi132:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:53:45.157 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056383,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=20619 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248864k,nr_inodes=812216,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-0 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-1 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-2 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497732k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.2 nsfs rw 0 0 2023-12-20T04:53:45.157 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:53:45.157 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:53:45.175 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:53:45.175 DEBUG:teuthology.orchestra.run.smithi187:> set -ex 2023-12-20T04:53:45.176 DEBUG:teuthology.orchestra.run.smithi187:> dd if=/proc/self/mounts of=/dev/stdout 2023-12-20T04:53:45.233 DEBUG:tasks.cephfs.mount:not mounted; /proc/self/mounts is: proc /proc proc rw,nosuid,nodev,noexec,relatime 0 0 sysfs /sys sysfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 devtmpfs /dev devtmpfs rw,seclabel,nosuid,size=4096k,nr_inodes=4056368,mode=755,inode64 0 0 securityfs /sys/kernel/security securityfs rw,nosuid,nodev,noexec,relatime 0 0 tmpfs /dev/shm tmpfs rw,seclabel,nosuid,nodev,inode64 0 0 devpts /dev/pts devpts rw,seclabel,nosuid,noexec,relatime,gid=5,mode=620,ptmxmode=000 0 0 tmpfs /run tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 cgroup2 /sys/fs/cgroup cgroup2 rw,seclabel,nosuid,nodev,noexec,relatime,nsdelegate,memory_recursiveprot 0 0 pstore /sys/fs/pstore pstore rw,seclabel,nosuid,nodev,noexec,relatime 0 0 bpf /sys/fs/bpf bpf rw,nosuid,nodev,noexec,relatime,mode=700 0 0 /dev/sda1 / ext4 rw,seclabel,relatime 0 0 selinuxfs /sys/fs/selinux selinuxfs rw,nosuid,noexec,relatime 0 0 systemd-1 /proc/sys/fs/binfmt_misc autofs rw,relatime,fd=29,pgrp=1,timeout=0,minproto=5,maxproto=5,direct,pipe_ino=14785 0 0 hugetlbfs /dev/hugepages hugetlbfs rw,seclabel,relatime,pagesize=2M 0 0 mqueue /dev/mqueue mqueue rw,seclabel,nosuid,nodev,noexec,relatime 0 0 debugfs /sys/kernel/debug debugfs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 tracefs /sys/kernel/tracing tracefs rw,seclabel,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup-dev.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 fusectl /sys/fs/fuse/connections fusectl rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-sysctl.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 configfs /sys/kernel/config configfs rw,nosuid,nodev,noexec,relatime 0 0 none /run/credentials/systemd-tmpfiles-setup.service ramfs ro,seclabel,nosuid,nodev,noexec,relatime,mode=700 0 0 sunrpc /var/lib/nfs/rpc_pipefs rpc_pipefs rw,relatime 0 0 tmpfs /run/user/1000 tmpfs rw,seclabel,nosuid,nodev,relatime,size=3248852k,nr_inodes=812213,mode=700,uid=1000,gid=1301,inode64 0 0 /dev/mapper/vg_nvme-lv_5 /var/lib/ceph xfs rw,seclabel,relatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_1 /var/lib/ceph/osd/ceph-4 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-6 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-7 xfs rw,seclabel,noatime,attr2,inode64,logbufs=8,logbsize=32k,noquota 0 0 tmpfs /run/netns tmpfs rw,seclabel,nosuid,nodev,size=6497708k,nr_inodes=819200,mode=755,inode64 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 nsfs /run/netns/ceph-ns--home-ubuntu-cephtest-mnt.3 nsfs rw 0 0 2023-12-20T04:53:45.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:45.233 DEBUG:teuthology.orchestra.run.smithi187:> ip netns list 2023-12-20T04:53:45.291 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.3 (id: 1) 2023-12-20T04:53:45.291 INFO:teuthology.orchestra.run.smithi187.stdout:ceph-ns--home-ubuntu-cephtest-mnt.1 (id: 0) 2023-12-20T04:53:45.291 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:45.291 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.3 2023-12-20T04:53:45.362 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:45.362 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.1 2023-12-20T04:53:45.434 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:45.435 DEBUG:teuthology.orchestra.run.smithi187:> sudo ip link delete ceph-brx 2023-12-20T04:53:45.530 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:45.531 DEBUG:teuthology.orchestra.run.smithi132:> ip netns list 2023-12-20T04:53:45.546 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.2 (id: 1) 2023-12-20T04:53:45.546 INFO:teuthology.orchestra.run.smithi132.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2023-12-20T04:53:45.546 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:45.546 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.2 2023-12-20T04:53:45.614 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:45.614 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2023-12-20T04:53:45.683 INFO:teuthology.orchestra.run:Running command with timeout 300 2023-12-20T04:53:45.683 DEBUG:teuthology.orchestra.run.smithi132:> sudo ip link delete ceph-brx 2023-12-20T04:53:45.781 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2023-12-20T04:53:45.791 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2023-12-20T04:53:45.791 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:53:45.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.889+0000 7f1c864e0640 1 Processor -- start 2023-12-20T04:53:45.891 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.889+0000 7f1c864e0640 1 -- start start 2023-12-20T04:53:45.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.890+0000 7f1c864e0640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c8015d060 0x7f1c8006b470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:45.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.890+0000 7f1c864e0640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c800ad4b0 con 0x7f1c8006b9b0 2023-12-20T04:53:45.892 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.890+0000 7f1c864e0640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f1c800ac8e0 con 0x7f1c800c91c0 2023-12-20T04:53:45.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.890+0000 7f1c864e0640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f1c8015d440 con 0x7f1c8015d060 2023-12-20T04:53:45.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.890+0000 7f1c7ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c8015d060 0x7f1c8006b470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:45.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.890+0000 7f1c7f7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f1c8006b9b0 0x7f1c800ad940 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36696/0 (socket says 172.21.15.132:36696) 2023-12-20T04:53:45.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.890+0000 7f1c7ffff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f1c8015d060 0x7f1c8006b470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37804/0 (socket says 172.21.15.132:37804) 2023-12-20T04:53:45.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.890+0000 7f1c7f7fe640 1 -- 172.21.15.132:0/2438331309 learned_addr learned my addr 172.21.15.132:0/2438331309 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:45.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.890+0000 7f1c7ffff640 1 -- 172.21.15.132:0/2438331309 >> v1:172.21.15.187:6789/0 conn(0x7f1c800c91c0 legacy=0x7f1c800cc860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:45.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.890+0000 7f1c7ffff640 1 -- 172.21.15.132:0/2438331309 >> v1:172.21.15.132:6789/0 conn(0x7f1c8006b9b0 legacy=0x7f1c800ad940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:45.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.890+0000 7f1c7ffff640 1 -- 172.21.15.132:0/2438331309 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c800acb80 con 0x7f1c8015d060 2023-12-20T04:53:45.893 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.890+0000 7f1c7effd640 1 -- 172.21.15.132:0/2438331309 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3524709073 0 0) 0x7f1c800ad4b0 con 0x7f1c8006b9b0 2023-12-20T04:53:45.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.891+0000 7f1c7ffff640 1 --2- 172.21.15.132:0/2438331309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8015d060 0x7f1c8006b470 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f1c700097a0 tx=0x7f1c7002b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=502ac5d08f983899 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:45.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.891+0000 7f1c7effd640 1 -- 172.21.15.132:0/2438331309 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70031830 con 0x7f1c8015d060 2023-12-20T04:53:45.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.891+0000 7f1c7effd640 1 -- 172.21.15.132:0/2438331309 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c70031990 con 0x7f1c8015d060 2023-12-20T04:53:45.894 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.891+0000 7f1c7effd640 1 -- 172.21.15.132:0/2438331309 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c70031d20 con 0x7f1c8015d060 2023-12-20T04:53:45.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.892+0000 7f1c864e0640 1 -- 172.21.15.132:0/2438331309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8015d060 msgr2=0x7f1c8006b470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:45.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.892+0000 7f1c864e0640 1 --2- 172.21.15.132:0/2438331309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8015d060 0x7f1c8006b470 secure :-1 s=READY pgs=1929 cs=0 l=1 rev1=1 crypto rx=0x7f1c700097a0 tx=0x7f1c7002b8d0 comp rx=0 tx=0).stop 2023-12-20T04:53:45.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.892+0000 7f1c864e0640 1 -- 172.21.15.132:0/2438331309 shutdown_connections 2023-12-20T04:53:45.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.892+0000 7f1c864e0640 1 --2- 172.21.15.132:0/2438331309 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8015d060 0x7f1c8006b470 unknown :-1 s=CLOSED pgs=1929 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:45.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.892+0000 7f1c864e0640 1 -- 172.21.15.132:0/2438331309 >> 172.21.15.132:0/2438331309 conn(0x7f1c800ceb70 msgr2=0x7f1c800cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:45.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.892+0000 7f1c864e0640 1 -- 172.21.15.132:0/2438331309 shutdown_connections 2023-12-20T04:53:45.895 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.892+0000 7f1c864e0640 1 -- 172.21.15.132:0/2438331309 wait complete. 2023-12-20T04:53:45.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.893+0000 7f1c864e0640 1 Processor -- start 2023-12-20T04:53:45.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.893+0000 7f1c864e0640 1 -- start start 2023-12-20T04:53:45.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.894+0000 7f1c864e0640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8006b9b0 0x7f1c8014df00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:45.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.894+0000 7f1c864e0640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c800c91c0 0x7f1c8006f910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:45.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.894+0000 7f1c864e0640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c8015d060 0x7f1c8006fe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:45.897 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.894+0000 7f1c864e0640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8015ed40 con 0x7f1c8006b9b0 2023-12-20T04:53:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.894+0000 7f1c864e0640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8015e9f0 con 0x7f1c800c91c0 2023-12-20T04:53:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.894+0000 7f1c864e0640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f1c8014e820 con 0x7f1c8015d060 2023-12-20T04:53:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.894+0000 7f1c7ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8006b9b0 0x7f1c8014df00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.894+0000 7f1c7ffff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8006b9b0 0x7f1c8014df00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37808/0 (socket says 172.21.15.132:37808) 2023-12-20T04:53:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.894+0000 7f1c7ffff640 1 -- 172.21.15.132:0/1421972810 learned_addr learned my addr 172.21.15.132:0/1421972810 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.894+0000 7f1c7ffff640 1 -- 172.21.15.132:0/1421972810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c8015d060 msgr2=0x7f1c8006fe50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.894+0000 7f1c84a7d640 1 --2- 172.21.15.132:0/1421972810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c8015d060 0x7f1c8006fe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.894+0000 7f1c7ffff640 1 --2- 172.21.15.132:0/1421972810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c8015d060 0x7f1c8006fe50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.894+0000 7f1c7f7fe640 1 --2- 172.21.15.132:0/1421972810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c800c91c0 0x7f1c8006f910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.894+0000 7f1c7ffff640 1 -- 172.21.15.132:0/1421972810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c800c91c0 msgr2=0x7f1c8006f910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.894+0000 7f1c7ffff640 1 --2- 172.21.15.132:0/1421972810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c800c91c0 0x7f1c8006f910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.894+0000 7f1c7ffff640 1 -- 172.21.15.132:0/1421972810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c70009400 con 0x7f1c8006b9b0 2023-12-20T04:53:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.895+0000 7f1c7ffff640 1 --2- 172.21.15.132:0/1421972810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8006b9b0 0x7f1c8014df00 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f1c700097a0 tx=0x7f1c700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.895+0000 7f1c7cff9640 1 -- 172.21.15.132:0/1421972810 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c7003aa60 con 0x7f1c8006b9b0 2023-12-20T04:53:45.898 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.895+0000 7f1c7cff9640 1 -- 172.21.15.132:0/1421972810 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1c7003abc0 con 0x7f1c8006b9b0 2023-12-20T04:53:45.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.895+0000 7f1c864e0640 1 -- 172.21.15.132:0/1421972810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c800c69e0 con 0x7f1c8006b9b0 2023-12-20T04:53:45.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.895+0000 7f1c7cff9640 1 -- 172.21.15.132:0/1421972810 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1c700443f0 con 0x7f1c8006b9b0 2023-12-20T04:53:45.899 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.895+0000 7f1c864e0640 1 -- 172.21.15.132:0/1421972810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c800c6fa0 con 0x7f1c8006b9b0 2023-12-20T04:53:45.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.896+0000 7f1c864e0640 1 -- 172.21.15.132:0/1421972810 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c8004e840 con 0x7f1c8006b9b0 2023-12-20T04:53:45.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.896+0000 7f1c7cff9640 1 -- 172.21.15.132:0/1421972810 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f1c7004d450 con 0x7f1c8006b9b0 2023-12-20T04:53:45.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.896+0000 7f1c7cff9640 1 --2- 172.21.15.132:0/1421972810 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c6c06a460 0x7f1c6c06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:45.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.897+0000 7f1c7cff9640 1 -- 172.21.15.132:0/1421972810 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1c700aa790 con 0x7f1c8006b9b0 2023-12-20T04:53:45.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.897+0000 7f1c7f7fe640 1 --2- 172.21.15.132:0/1421972810 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c6c06a460 0x7f1c6c06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:45.900 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.897+0000 7f1c7f7fe640 1 --2- 172.21.15.132:0/1421972810 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c6c06a460 0x7f1c6c06c920 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f1c8015a330 tx=0x7f1c74009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:45.903 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:45.901+0000 7f1c7cff9640 1 -- 172.21.15.132:0/1421972810 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f1c70076110 con 0x7f1c8006b9b0 2023-12-20T04:53:46.068 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.067+0000 7f1c864e0640 1 -- 172.21.15.132:0/1421972810 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f1c800ad140 con 0x7f1c6c06a460 2023-12-20T04:53:46.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.069+0000 7f1c7cff9640 1 -- 172.21.15.132:0/1421972810 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50297 (secure 0 0 0) 0x7f1c74001c70 con 0x7f1c6c06a460 2023-12-20T04:53:46.071 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:46.071 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:53:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.071+0000 7f1c864e0640 1 -- 172.21.15.132:0/1421972810 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c6c06a460 msgr2=0x7f1c6c06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.071+0000 7f1c864e0640 1 --2- 172.21.15.132:0/1421972810 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c6c06a460 0x7f1c6c06c920 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f1c8015a330 tx=0x7f1c74009040 comp rx=0 tx=0).stop 2023-12-20T04:53:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.071+0000 7f1c864e0640 1 -- 172.21.15.132:0/1421972810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8006b9b0 msgr2=0x7f1c8014df00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.071+0000 7f1c864e0640 1 --2- 172.21.15.132:0/1421972810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8006b9b0 0x7f1c8014df00 secure :-1 s=READY pgs=1930 cs=0 l=1 rev1=1 crypto rx=0x7f1c700097a0 tx=0x7f1c700046c0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.071+0000 7f1c864e0640 1 -- 172.21.15.132:0/1421972810 shutdown_connections 2023-12-20T04:53:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.071+0000 7f1c864e0640 1 --2- 172.21.15.132:0/1421972810 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f1c6c06a460 0x7f1c6c06c920 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.071+0000 7f1c864e0640 1 --2- 172.21.15.132:0/1421972810 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f1c8015d060 0x7f1c8006fe50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.071+0000 7f1c864e0640 1 --2- 172.21.15.132:0/1421972810 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f1c800c91c0 0x7f1c8006f910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.071+0000 7f1c864e0640 1 --2- 172.21.15.132:0/1421972810 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f1c8006b9b0 0x7f1c8014df00 unknown :-1 s=CLOSED pgs=1930 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.071+0000 7f1c864e0640 1 -- 172.21.15.132:0/1421972810 >> 172.21.15.132:0/1421972810 conn(0x7f1c800ceb70 msgr2=0x7f1c800c53f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.071+0000 7f1c864e0640 1 -- 172.21.15.132:0/1421972810 shutdown_connections 2023-12-20T04:53:46.074 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.071+0000 7f1c864e0640 1 -- 172.21.15.132:0/1421972810 wait complete. 2023-12-20T04:53:46.084 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":519,"stamp":"2023-12-20T04:53:44.268598+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":194,"num_osds":8,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":112017,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1450482,"statfs":{"total":1600000000,"available":1485294490,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52487038,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-120,"num_write_kb":-85082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.354114"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":314,"reported_epoch":189,"state":"active+clean","last_fresh":"2023-12-20T04:53:29.915230+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:53:29.915230+0000","last_peered":"2023-12-20T04:53:29.915230+0000","last_clean":"2023-12-20T04:53:29.915230+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:53:29.915230+0000","last_undegraded":"2023-12-20T04:53:29.915230+0000","last_fullsized":"2023-12-20T04:53:29.915230+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574983,"num_pgs":25,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9869,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185443,"statfs":{"total":200000000,"available":189894101,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.43099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70299999999999996,"5min":0.77700000000000002,"15min":1.0860000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.25600000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.86299999999999999},"last":0.54900000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.33100000000000002,"15min":0.26900000000000002},"max":{"1min":0.71699999999999997,"5min":0.76500000000000001,"15min":0.98799999999999999},"last":0.58999999999999997},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.45700000000000002,"5min":0.376,"15min":0.374},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":1.0269999999999999},"last":0.60699999999999998}]},{"osd":2,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.375,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65100000000000002,"5min":0.75900000000000001,"15min":1.0069999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.47599999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67100000000000004,"5min":0.75700000000000001,"15min":0.78000000000000003},"last":0.624}]},{"osd":3,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65800000000000003,"5min":0.78300000000000003,"15min":1.048},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.34599999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.70299999999999996}]},{"osd":4,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.46999999999999997,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.28499999999999998,"15min":0.26700000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.89700000000000002},"last":0.63800000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46300000000000002,"15min":0.47999999999999998},"min":{"1min":0.33600000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.70399999999999996,"5min":0.73099999999999998,"15min":0.73799999999999999},"last":0.67000000000000004},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51900000000000002,"15min":0.53100000000000003},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.72699999999999998}]},{"osd":6,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51900000000000002,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.33300000000000002,"15min":0.32500000000000001},"max":{"1min":0.755,"5min":0.77800000000000002,"15min":0.89800000000000002},"last":0.71699999999999997},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.68799999999999994}]}]},{"osd":6,"up_from":13,"seq":55834574984,"num_pgs":23,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":19475,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":175836,"statfs":{"total":200000000,"available":180056606,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55800000000000005,"15min":0.51900000000000002},"min":{"1min":0.36499999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.71099999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.433},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.47299999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56699999999999995,"15min":0.54600000000000004},"min":{"1min":0.40000000000000002,"5min":0.32100000000000001,"15min":0.30099999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.50600000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55000000000000004,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.38200000000000001,"15min":0.27000000000000002},"max":{"1min":0.72599999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.63},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.376,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55900000000000005}]},{"osd":3,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.33700000000000002},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.77800000000000002},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.43099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.749,"5min":0.77200000000000002,"15min":0.78900000000000003},"last":0.58499999999999996}]},{"osd":4,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.32100000000000001,"5min":0.313,"15min":0.28499999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.81899999999999995},"last":0.60999999999999999},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.59899999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49099999999999999,"15min":0.50700000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.755,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.67600000000000005},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.54600000000000004},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.32000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.85499999999999998},"last":0.64700000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52900000000000003,"15min":0.54000000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.65800000000000003},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.69399999999999995}]}]},{"osd":5,"up_from":13,"seq":55834574983,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21524,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173788,"statfs":{"total":200000000,"available":177959074,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56499999999999995,"15min":0.53200000000000003},"min":{"1min":0.38200000000000001,"5min":0.32200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69099999999999995,"5min":0.747,"15min":0.748},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58899999999999997,"15min":0.57199999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74299999999999999,"5min":0.78700000000000003,"15min":0.82299999999999995},"last":0.55000000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57299999999999995,"15min":0.55600000000000005},"min":{"1min":0.437,"5min":0.39800000000000002,"15min":0.26000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.82099999999999995},"last":0.46600000000000003},{"interface":"front","average":{"1min":0.62,"5min":0.59099999999999997,"15min":0.58399999999999996},"min":{"1min":0.443,"5min":0.41799999999999998,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.84899999999999998},"last":0.52700000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53800000000000003,"15min":0.52300000000000002},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.28199999999999997},"max":{"1min":0.69399999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.51000000000000001},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.438,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":0.76600000000000001,"15min":0.77100000000000002},"last":0.57899999999999996}]},{"osd":3,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.42699999999999999,"5min":0.34699999999999998,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.80900000000000005},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.46500000000000002,"5min":0.38400000000000001,"15min":0.312},"max":{"1min":0.71199999999999997,"5min":0.74199999999999999,"15min":0.77400000000000002},"last":0.53700000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.47999999999999998},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.249},"max":{"1min":0.68799999999999994,"5min":0.80400000000000005,"15min":0.81899999999999995},"last":0.36799999999999999},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.32900000000000001,"5min":0.29799999999999999,"15min":0.29399999999999998},"max":{"1min":0.64200000000000002,"5min":0.749,"15min":0.75700000000000001},"last":0.55900000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.48899999999999999},"min":{"1min":0.35799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.64900000000000002,"5min":0.75600000000000001,"15min":0.85299999999999998},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.50900000000000001,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33900000000000002,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.82599999999999996,"15min":0.83999999999999997},"last":0.435}]},{"osd":7,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.495,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66900000000000004,"5min":0.78400000000000003,"15min":0.79800000000000004},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.311,"15min":0.311},"max":{"1min":0.67800000000000005,"5min":0.77700000000000002,"15min":0.98599999999999999},"last":0.60699999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574983,"num_pgs":26,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":7243,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":188068,"statfs":{"total":200000000,"available":192582293,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.46800000000000003,"5min":0.25700000000000001,"15min":0.19700000000000001},"max":{"1min":0.74199999999999999,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.39700000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.251},"max":{"1min":0.76200000000000001,"5min":0.875,"15min":0.875},"last":0.54800000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52500000000000002},"min":{"1min":0.41499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.69399999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.627,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.50800000000000001,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.77000000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.443}]},{"osd":2,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.316,"15min":0.313},"max":{"1min":0.73199999999999998,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.40400000000000003,"5min":0.33300000000000002,"15min":0.23400000000000001},"max":{"1min":0.69599999999999995,"5min":0.746,"15min":0.80400000000000005},"last":0.432}]},{"osd":3,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.56499999999999995},"min":{"1min":0.46000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.746,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.51600000000000001},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.44800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.88800000000000001,"15min":0.91000000000000003},"last":0.56100000000000005}]},{"osd":5,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46000000000000002,"15min":0.46300000000000002},"min":{"1min":0.314,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":0.68799999999999994,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.50600000000000001},{"interface":"front","average":{"1min":0.503,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.33800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60699999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.57899999999999996}]},{"osd":6,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38200000000000001,"5min":0.28799999999999998,"15min":0.26400000000000001},"max":{"1min":0.61399999999999999,"5min":0.73099999999999998,"15min":0.82399999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70399999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.47299999999999998}]},{"osd":7,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.34899999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69699999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.432,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78000000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.59099999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574983,"num_pgs":24,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9235,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":186076,"statfs":{"total":200000000,"available":190542354,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.25600000000000001,"5min":0.19800000000000001,"15min":0.193},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.629},"last":0.252},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.36699999999999999},"min":{"1min":0.28399999999999997,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":0.54100000000000004,"5min":0.58199999999999996,"15min":0.64000000000000001},"last":0.313}]},{"osd":1,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.34300000000000003,"15min":0.33000000000000002},"min":{"1min":0.24299999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.499,"5min":0.62,"15min":0.62},"last":0.28000000000000003},{"interface":"front","average":{"1min":0.376,"5min":0.36599999999999999,"15min":0.35099999999999998},"min":{"1min":0.29399999999999998,"5min":0.24099999999999999,"15min":0.20399999999999999},"max":{"1min":0.48199999999999998,"5min":0.55800000000000005,"15min":0.61699999999999999},"last":0.33200000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.35799999999999998,"15min":0.34999999999999998},"min":{"1min":0.253,"5min":0.22600000000000001,"15min":0.21199999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.64900000000000002},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.38600000000000001},"min":{"1min":0.32300000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52500000000000002,"5min":0.59399999999999997,"15min":0.63600000000000001},"last":0.35499999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.436,"5min":0.36599999999999999,"15min":0.35199999999999998},"max":{"1min":0.80200000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59099999999999997,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.51800000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.42299999999999999,"5min":0.40000000000000002,"15min":0.31},"max":{"1min":0.71299999999999997,"5min":0.82399999999999995,"15min":0.872},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60599999999999998,"15min":0.57599999999999996},"min":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.878,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52900000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60799999999999998,"15min":0.58899999999999997},"min":{"1min":0.442,"5min":0.375,"15min":0.33900000000000002},"max":{"1min":0.83899999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.57799999999999996},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.37},"max":{"1min":0.75600000000000001,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.49099999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.38500000000000001},"max":{"1min":0.82799999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.55000000000000004},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.623,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79200000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.47899999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574983,"num_pgs":20,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":21523,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":173788,"statfs":{"total":200000000,"available":177959588,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34899999999999998,"15min":0.32200000000000001},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.45300000000000001,"5min":0.57299999999999995,"15min":0.72699999999999998},"last":0.27400000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.39600000000000002,"15min":0.37},"min":{"1min":0.28399999999999997,"5min":0.27500000000000002,"15min":0.17699999999999999},"max":{"1min":0.52000000000000002,"5min":0.54100000000000004,"15min":2.0539999999999998},"last":0.214}]},{"osd":1,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.378,"15min":0.35099999999999998},"min":{"1min":0.23699999999999999,"5min":0.22600000000000001,"15min":0.17999999999999999},"max":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.83099999999999996},"last":0.252},{"interface":"front","average":{"1min":0.439,"5min":0.40300000000000002,"15min":0.372},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.20000000000000001},"max":{"1min":0.57099999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.316}]},{"osd":3,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.41399999999999998,"15min":0.38500000000000001},"min":{"1min":0.29799999999999999,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.56299999999999994,"5min":0.60399999999999998,"15min":0.995},"last":0.29399999999999998},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.41599999999999998,"15min":0.39100000000000001},"min":{"1min":0.308,"5min":0.218,"15min":0.218},"max":{"1min":0.57199999999999995,"5min":0.64400000000000002,"15min":0.76600000000000001},"last":0.30099999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.57899999999999996},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.32500000000000001},"max":{"1min":0.76900000000000002,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.68100000000000005},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.38200000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83999999999999997,"5min":0.878,"15min":2.347},"last":0.54200000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":0.997},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59899999999999998,"15min":0.57099999999999995},"min":{"1min":0.45300000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.65100000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60199999999999998,"15min":0.58699999999999997},"min":{"1min":0.46500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84999999999999998,"5min":0.877,"15min":2.274},"last":0.52000000000000002},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61299999999999999,"15min":0.58899999999999997},"min":{"1min":0.503,"5min":0.38,"15min":0.373},"max":{"1min":0.84599999999999997,"5min":0.89300000000000002,"15min":1.0289999999999999},"last":0.67300000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.442,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85699999999999998,"5min":0.89800000000000002,"15min":2.3090000000000002},"last":0.68999999999999995},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.61699999999999999,"15min":0.59399999999999997},"min":{"1min":0.45200000000000001,"5min":0.40500000000000003,"15min":0.379},"max":{"1min":0.82299999999999995,"5min":0.873,"15min":1.0549999999999999},"last":0.51100000000000001}]}]},{"osd":1,"up_from":13,"seq":55834574984,"num_pgs":28,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":13331,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":181980,"statfs":{"total":200000000,"available":186348252,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.314},"min":{"1min":0.23599999999999999,"5min":0.20899999999999999,"15min":0.16400000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.25},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38700000000000001,"15min":0.35299999999999998},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.22700000000000001},"max":{"1min":0.53600000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.36599999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.32900000000000001},"min":{"1min":0.24099999999999999,"5min":0.23000000000000001,"15min":0.19500000000000001},"max":{"1min":0.57899999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.26500000000000001},{"interface":"front","average":{"1min":0.435,"5min":0.40100000000000002,"15min":0.372},"min":{"1min":0.307,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":0.53700000000000003,"5min":0.57099999999999995,"15min":0.57299999999999995},"last":0.318}]},{"osd":3,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42199999999999999,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.191},"max":{"1min":0.60399999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.35299999999999998},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.36399999999999999},"min":{"1min":0.28000000000000003,"5min":0.22500000000000001,"15min":0.20399999999999999},"max":{"1min":0.56499999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.33300000000000002}]},{"osd":4,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60699999999999998,"15min":0.57499999999999996},"min":{"1min":0.498,"5min":0.35599999999999998,"15min":0.312},"max":{"1min":0.79100000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.60599999999999998},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.90900000000000003,"15min":1.002},"last":0.52200000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.79200000000000004,"15min":0.86099999999999999},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61099999999999999,"15min":0.56799999999999995},"min":{"1min":0.48199999999999998,"5min":0.38300000000000001,"15min":0.317},"max":{"1min":0.81599999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.46700000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60299999999999998,"15min":0.57399999999999995},"min":{"1min":0.51000000000000001,"5min":0.38300000000000001,"15min":0.36899999999999999},"max":{"1min":0.72099999999999997,"5min":0.92400000000000004,"15min":1.038},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.57899999999999996},"min":{"1min":0.45900000000000002,"5min":0.40600000000000003,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.56000000000000005}]},{"osd":7,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64200000000000002,"15min":0.60899999999999999},"min":{"1min":0.52500000000000002,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.80600000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64200000000000002,"15min":0.61599999999999999},"min":{"1min":0.52900000000000003,"5min":0.41899999999999998,"15min":0.376},"max":{"1min":0.82199999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.45700000000000002}]}]},{"osd":0,"up_from":13,"seq":55834574983,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":9812,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":185500,"statfs":{"total":200000000,"available":189952222,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.32600000000000001},"min":{"1min":0.214,"5min":0.189,"15min":0.184},"max":{"1min":0.51700000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.28799999999999998},{"interface":"front","average":{"1min":0.376,"5min":0.35799999999999998,"15min":0.33300000000000002},"min":{"1min":0.20999999999999999,"5min":0.20699999999999999,"15min":0.184},"max":{"1min":0.57399999999999995,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.38700000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.376,"15min":0.36499999999999999},"min":{"1min":0.248,"5min":0.22800000000000001,"15min":0.218},"max":{"1min":0.55600000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.34799999999999998},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38400000000000001,"15min":0.36199999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.23100000000000001},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.622},"last":0.318}]},{"osd":3,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.376,"15min":0.34599999999999997},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.58899999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34000000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40699999999999997,"15min":0.38400000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27400000000000002},"max":{"1min":0.60799999999999998,"5min":0.625,"15min":0.625},"last":0.372}]},{"osd":4,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57499999999999996,"15min":0.54500000000000004},"min":{"1min":0.437,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.55400000000000005},"min":{"1min":0.46500000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74199999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.53200000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57399999999999995,"15min":0.54400000000000004},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":0.85999999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.68600000000000005},{"interface":"front","average":{"1min":0.62,"5min":0.59999999999999998,"15min":0.56899999999999995},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.86199999999999999},"last":0.54500000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61399999999999999,"15min":0.59699999999999998},"min":{"1min":0.49199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82499999999999996,"5min":0.88100000000000001,"15min":0.89600000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.62,"15min":0.59899999999999998},"min":{"1min":0.51100000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84599999999999997,"5min":0.89500000000000002,"15min":0.90000000000000002},"last":0.63900000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59999999999999998,"15min":0.57099999999999995},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.375},"max":{"1min":0.76400000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.67700000000000005},{"interface":"front","average":{"1min":0.629,"5min":0.60599999999999998,"15min":0.58599999999999997},"min":{"1min":0.48999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79800000000000004,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.58399999999999996}]}]}],"pool_statfs":[]}} 2023-12-20T04:53:46.085 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:53:46.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.184+0000 7f7184438640 1 Processor -- start 2023-12-20T04:53:46.186 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.184+0000 7f7184438640 1 -- start start 2023-12-20T04:53:46.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.185+0000 7f7184438640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f717c160450 0x7f717c160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:46.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.185+0000 7f7184438640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f717c0b5090 0x7f717c0d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:46.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.185+0000 7f7184438640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f717c0b5ec0 con 0x7f717c1611b0 2023-12-20T04:53:46.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.185+0000 7f7184438640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717c1617e0 con 0x7f717c0b5090 2023-12-20T04:53:46.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.185+0000 7f7184438640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f717c0d0fc0 con 0x7f717c160450 2023-12-20T04:53:46.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.185+0000 7f71829d5640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f717c0b5090 0x7f717c0d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:46.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.185+0000 7f71819d3640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f717c1611b0 0x7f717c0b4980 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36704/0 (socket says 172.21.15.132:36704) 2023-12-20T04:53:46.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.185+0000 7f71819d3640 1 -- 172.21.15.132:0/2421977849 learned_addr learned my addr 172.21.15.132:0/2421977849 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:46.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.186+0000 7f71821d4640 1 --2- 172.21.15.132:0/2421977849 >> v2:172.21.15.187:3300/0 conn(0x7f717c160450 0x7f717c160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:46.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.186+0000 7f71829d5640 1 -- 172.21.15.132:0/2421977849 >> v2:172.21.15.187:3300/0 conn(0x7f717c160450 msgr2=0x7f717c160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:46.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.186+0000 7f71829d5640 1 --2- 172.21.15.132:0/2421977849 >> v2:172.21.15.187:3300/0 conn(0x7f717c160450 0x7f717c160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.188 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.186+0000 7f71829d5640 1 -- 172.21.15.132:0/2421977849 >> v1:172.21.15.132:6789/0 conn(0x7f717c1611b0 legacy=0x7f717c0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.186+0000 7f71829d5640 1 -- 172.21.15.132:0/2421977849 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f717c0d12a0 con 0x7f717c0b5090 2023-12-20T04:53:46.189 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.186+0000 7f71811d2640 1 -- 172.21.15.132:0/2421977849 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2709738479 0 0) 0x7f717c0b5ec0 con 0x7f717c1611b0 2023-12-20T04:53:46.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.186+0000 7f71829d5640 1 --2- 172.21.15.132:0/2421977849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f717c0b5090 0x7f717c0d1aa0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f717c08b150 tx=0x7f717402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d4dc31ba36ae95 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:46.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.186+0000 7f71811d2640 1 -- 172.21.15.132:0/2421977849 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174030610 con 0x7f717c0b5090 2023-12-20T04:53:46.190 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.187+0000 7f71811d2640 1 -- 172.21.15.132:0/2421977849 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7174030770 con 0x7f717c0b5090 2023-12-20T04:53:46.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.187+0000 7f71811d2640 1 -- 172.21.15.132:0/2421977849 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174030b00 con 0x7f717c0b5090 2023-12-20T04:53:46.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.187+0000 7f7184438640 1 -- 172.21.15.132:0/2421977849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f717c0b5090 msgr2=0x7f717c0d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.187+0000 7f7184438640 1 --2- 172.21.15.132:0/2421977849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f717c0b5090 0x7f717c0d1aa0 secure :-1 s=READY pgs=1932 cs=0 l=1 rev1=1 crypto rx=0x7f717c08b150 tx=0x7f717402b960 comp rx=0 tx=0).stop 2023-12-20T04:53:46.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.187+0000 7f7184438640 1 -- 172.21.15.132:0/2421977849 shutdown_connections 2023-12-20T04:53:46.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.187+0000 7f7184438640 1 --2- 172.21.15.132:0/2421977849 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f717c0b5090 0x7f717c0d1aa0 unknown :-1 s=CLOSED pgs=1932 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.187+0000 7f7184438640 1 --2- 172.21.15.132:0/2421977849 >> v2:172.21.15.187:3300/0 conn(0x7f717c160450 0x7f717c160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.187+0000 7f7184438640 1 -- 172.21.15.132:0/2421977849 >> 172.21.15.132:0/2421977849 conn(0x7f717c0cf980 msgr2=0x7f717c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:46.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.187+0000 7f7184438640 1 -- 172.21.15.132:0/2421977849 shutdown_connections 2023-12-20T04:53:46.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.187+0000 7f7184438640 1 -- 172.21.15.132:0/2421977849 wait complete. 2023-12-20T04:53:46.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.188+0000 7f7184438640 1 Processor -- start 2023-12-20T04:53:46.191 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.188+0000 7f7184438640 1 -- start start 2023-12-20T04:53:46.193 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.189+0000 7f7184438640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f717c0b5090 0x7f717c155330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:46.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.189+0000 7f7184438640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f717c160450 0x7f717c0cd780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:46.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.189+0000 7f7184438640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f717c1611b0 0x7f717c0cdcc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:46.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.189+0000 7f7184438640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c1f6ee0 con 0x7f717c1611b0 2023-12-20T04:53:46.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.189+0000 7f7184438640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f717c0d3dd0 con 0x7f717c160450 2023-12-20T04:53:46.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.189+0000 7f7184438640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f717c1f6160 con 0x7f717c0b5090 2023-12-20T04:53:46.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.189+0000 7f71829d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f717c1611b0 0x7f717c0cdcc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:46.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.189+0000 7f71829d5640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f717c1611b0 0x7f717c0cdcc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37820/0 (socket says 172.21.15.132:37820) 2023-12-20T04:53:46.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.189+0000 7f71829d5640 1 -- 172.21.15.132:0/1976666888 learned_addr learned my addr 172.21.15.132:0/1976666888 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:46.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.189+0000 7f71829d5640 1 -- 172.21.15.132:0/1976666888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f717c0b5090 msgr2=0x7f717c155330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.189+0000 7f71829d5640 1 --2- 172.21.15.132:0/1976666888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f717c0b5090 0x7f717c155330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.189+0000 7f71829d5640 1 -- 172.21.15.132:0/1976666888 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f717c160450 msgr2=0x7f717c0cd780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.189+0000 7f71829d5640 1 --2- 172.21.15.132:0/1976666888 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f717c160450 0x7f717c0cd780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.189+0000 7f71829d5640 1 -- 172.21.15.132:0/1976666888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7174009400 con 0x7f717c1611b0 2023-12-20T04:53:46.194 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.190+0000 7f71829d5640 1 --2- 172.21.15.132:0/1976666888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f717c1611b0 0x7f717c0cdcc0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f7174009860 tx=0x7f7174004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.190+0000 7f7172ffd640 1 -- 172.21.15.132:0/1976666888 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f717403e040 con 0x7f717c1611b0 2023-12-20T04:53:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.190+0000 7f7172ffd640 1 -- 172.21.15.132:0/1976666888 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f7174039c60 con 0x7f717c1611b0 2023-12-20T04:53:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.190+0000 7f7184438640 1 -- 172.21.15.132:0/1976666888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f717c0c9fd0 con 0x7f717c1611b0 2023-12-20T04:53:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.190+0000 7f7172ffd640 1 -- 172.21.15.132:0/1976666888 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f7174006e10 con 0x7f717c1611b0 2023-12-20T04:53:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.190+0000 7f7184438640 1 -- 172.21.15.132:0/1976666888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f717c1f66e0 con 0x7f717c1611b0 2023-12-20T04:53:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.191+0000 7f7184438640 1 -- 172.21.15.132:0/1976666888 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f717c160830 con 0x7f717c1611b0 2023-12-20T04:53:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.191+0000 7f7172ffd640 1 -- 172.21.15.132:0/1976666888 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f7174043440 con 0x7f717c1611b0 2023-12-20T04:53:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.191+0000 7f7172ffd640 1 --2- 172.21.15.132:0/1976666888 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f716006a430 0x7f716006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.192+0000 7f71821d4640 1 --2- 172.21.15.132:0/1976666888 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f716006a430 0x7f716006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.192+0000 7f7172ffd640 1 -- 172.21.15.132:0/1976666888 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f71740aa8b0 con 0x7f717c1611b0 2023-12-20T04:53:46.195 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.192+0000 7f71821d4640 1 --2- 172.21.15.132:0/1976666888 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f716006a430 0x7f716006c8f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f71780070b0 tx=0x7f7178007040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:46.197 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.196+0000 7f7172ffd640 1 -- 172.21.15.132:0/1976666888 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f71740761a0 con 0x7f717c1611b0 2023-12-20T04:53:46.363 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.361+0000 7f7184438640 1 -- 172.21.15.132:0/1976666888 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f717c0b89d0 con 0x7f716006a430 2023-12-20T04:53:46.365 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.363+0000 7f7172ffd640 1 -- 172.21.15.132:0/1976666888 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50303 (secure 0 0 0) 0x7f7178009bb0 con 0x7f716006a430 2023-12-20T04:53:46.365 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:46.366 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:53:46.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.365+0000 7f7184438640 1 -- 172.21.15.132:0/1976666888 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f716006a430 msgr2=0x7f716006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.365+0000 7f7184438640 1 --2- 172.21.15.132:0/1976666888 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f716006a430 0x7f716006c8f0 secure :-1 s=READY pgs=808 cs=0 l=1 rev1=1 crypto rx=0x7f71780070b0 tx=0x7f7178007040 comp rx=0 tx=0).stop 2023-12-20T04:53:46.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.365+0000 7f7184438640 1 -- 172.21.15.132:0/1976666888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f717c1611b0 msgr2=0x7f717c0cdcc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.367 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.365+0000 7f7184438640 1 --2- 172.21.15.132:0/1976666888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f717c1611b0 0x7f717c0cdcc0 secure :-1 s=READY pgs=1933 cs=0 l=1 rev1=1 crypto rx=0x7f7174009860 tx=0x7f7174004730 comp rx=0 tx=0).stop 2023-12-20T04:53:46.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.365+0000 7f7184438640 1 -- 172.21.15.132:0/1976666888 shutdown_connections 2023-12-20T04:53:46.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.365+0000 7f7184438640 1 --2- 172.21.15.132:0/1976666888 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f716006a430 0x7f716006c8f0 unknown :-1 s=CLOSED pgs=808 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.365+0000 7f7184438640 1 --2- 172.21.15.132:0/1976666888 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f717c1611b0 0x7f717c0cdcc0 unknown :-1 s=CLOSED pgs=1933 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.365+0000 7f7184438640 1 --2- 172.21.15.132:0/1976666888 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f717c160450 0x7f717c0cd780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.365+0000 7f7184438640 1 --2- 172.21.15.132:0/1976666888 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f717c0b5090 0x7f717c155330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.365+0000 7f7184438640 1 -- 172.21.15.132:0/1976666888 >> 172.21.15.132:0/1976666888 conn(0x7f717c0cf980 msgr2=0x7f717c15da40 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:46.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.365+0000 7f7184438640 1 -- 172.21.15.132:0/1976666888 shutdown_connections 2023-12-20T04:53:46.368 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.365+0000 7f7184438640 1 -- 172.21.15.132:0/1976666888 wait complete. 2023-12-20T04:53:46.378 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":520,"stamp":"2023-12-20T04:53:46.239867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9640,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552859,"statfs":{"total":1600000000,"available":1590127656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52487038,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-120,"num_write_kb":-85082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001254"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":317,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-20T04:53:43.274738+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:53:43.274738+0000","last_peered":"2023-12-20T04:53:43.274738+0000","last_clean":"2023-12-20T04:53:43.274738+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:53:43.274738+0000","last_undegraded":"2023-12-20T04:53:43.274738+0000","last_fullsized":"2023-12-20T04:53:43.274738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574984,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193674,"statfs":{"total":200000000,"available":198323181,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.43099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70299999999999996,"5min":0.77700000000000002,"15min":1.0860000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.25600000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.86299999999999999},"last":0.54200000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.33100000000000002,"15min":0.26900000000000002},"max":{"1min":0.71699999999999997,"5min":0.76500000000000001,"15min":0.98799999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.45700000000000002,"5min":0.376,"15min":0.374},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":1.0269999999999999},"last":0.63200000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.375,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65100000000000002,"5min":0.75900000000000001,"15min":1.0069999999999999},"last":0.623},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.47599999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67100000000000004,"5min":0.75700000000000001,"15min":0.78000000000000003},"last":0.55600000000000005}]},{"osd":3,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65800000000000003,"5min":0.78300000000000003,"15min":1.048},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.34599999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.60299999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.46999999999999997,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.28499999999999998,"15min":0.26700000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.89700000000000002},"last":0.58599999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46300000000000002,"15min":0.47999999999999998},"min":{"1min":0.33600000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.70399999999999996,"5min":0.73099999999999998,"15min":0.73799999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51900000000000002,"15min":0.53100000000000003},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56499999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51900000000000002,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.33300000000000002,"15min":0.32500000000000001},"max":{"1min":0.755,"5min":0.77800000000000002,"15min":0.89800000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.498}]}]},{"osd":6,"up_from":13,"seq":55834574985,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55800000000000005,"15min":0.51900000000000002},"min":{"1min":0.36499999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.71099999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.622},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.57699999999999996}]},{"osd":1,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56699999999999995,"15min":0.54600000000000004},"min":{"1min":0.40000000000000002,"5min":0.32100000000000001,"15min":0.30099999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59199999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55000000000000004,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.38200000000000001,"15min":0.27000000000000002},"max":{"1min":0.72599999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.376,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55600000000000005}]},{"osd":3,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.33700000000000002},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.77800000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.43099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.749,"5min":0.77200000000000002,"15min":0.78900000000000003},"last":0.65800000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.32100000000000001,"5min":0.313,"15min":0.28499999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.81899999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.67300000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49099999999999999,"15min":0.50700000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.755,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.54600000000000004},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.32000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.85499999999999998},"last":0.64800000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52900000000000003,"15min":0.54000000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.72499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574984,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56499999999999995,"15min":0.53200000000000003},"min":{"1min":0.38200000000000001,"5min":0.32200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69099999999999995,"5min":0.747,"15min":0.748},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58899999999999997,"15min":0.57199999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74299999999999999,"5min":0.78700000000000003,"15min":0.82299999999999995},"last":0.56599999999999995}]},{"osd":1,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57299999999999995,"15min":0.55600000000000005},"min":{"1min":0.437,"5min":0.39800000000000002,"15min":0.26000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.82099999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.59099999999999997,"15min":0.58399999999999996},"min":{"1min":0.443,"5min":0.41799999999999998,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.84899999999999998},"last":0.54300000000000004}]},{"osd":2,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53800000000000003,"15min":0.52300000000000002},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.28199999999999997},"max":{"1min":0.69399999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.438,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":0.76600000000000001,"15min":0.77100000000000002},"last":0.53000000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.42699999999999999,"5min":0.34699999999999998,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.80900000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.46500000000000002,"5min":0.38400000000000001,"15min":0.312},"max":{"1min":0.71199999999999997,"5min":0.74199999999999999,"15min":0.77400000000000002},"last":0.47799999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.47999999999999998},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.249},"max":{"1min":0.68799999999999994,"5min":0.80400000000000005,"15min":0.81899999999999995},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.32900000000000001,"5min":0.29799999999999999,"15min":0.29399999999999998},"max":{"1min":0.64200000000000002,"5min":0.749,"15min":0.75700000000000001},"last":0.42099999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.48899999999999999},"min":{"1min":0.35799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.64900000000000002,"5min":0.75600000000000001,"15min":0.85299999999999998},"last":0.436},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.50900000000000001,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33900000000000002,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.82599999999999996,"15min":0.83999999999999997},"last":0.40300000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.495,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66900000000000004,"5min":0.78400000000000003,"15min":0.79800000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.311,"15min":0.311},"max":{"1min":0.67800000000000005,"5min":0.77700000000000002,"15min":0.98599999999999999},"last":0.55500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.46800000000000003,"5min":0.25700000000000001,"15min":0.19700000000000001},"max":{"1min":0.74199999999999999,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.251},"max":{"1min":0.76200000000000001,"5min":0.875,"15min":0.875},"last":0.46300000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52500000000000002},"min":{"1min":0.41499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.69399999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.374},{"interface":"front","average":{"1min":0.627,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.50800000000000001,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.77000000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.38200000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.316,"15min":0.313},"max":{"1min":0.73199999999999998,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.40400000000000003,"5min":0.33300000000000002,"15min":0.23400000000000001},"max":{"1min":0.69599999999999995,"5min":0.746,"15min":0.80400000000000005},"last":0.42999999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.56499999999999995},"min":{"1min":0.46000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.746,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.44800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.88800000000000001,"15min":0.91000000000000003},"last":0.45200000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46000000000000002,"15min":0.46300000000000002},"min":{"1min":0.314,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":0.68799999999999994,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.33800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60699999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.44}]},{"osd":6,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38200000000000001,"5min":0.28799999999999998,"15min":0.26400000000000001},"max":{"1min":0.61399999999999999,"5min":0.73099999999999998,"15min":0.82399999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70399999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35899999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.34899999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69699999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.432,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78000000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.41999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574984,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.25600000000000001,"5min":0.19800000000000001,"15min":0.193},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.629},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.36699999999999999},"min":{"1min":0.28399999999999997,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":0.54100000000000004,"5min":0.58199999999999996,"15min":0.64000000000000001},"last":0.30399999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.34300000000000003,"15min":0.33000000000000002},"min":{"1min":0.24299999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.499,"5min":0.62,"15min":0.62},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.36599999999999999,"15min":0.35099999999999998},"min":{"1min":0.29399999999999998,"5min":0.24099999999999999,"15min":0.20399999999999999},"max":{"1min":0.48199999999999998,"5min":0.55800000000000005,"15min":0.61699999999999999},"last":0.246}]},{"osd":2,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.35799999999999998,"15min":0.34999999999999998},"min":{"1min":0.253,"5min":0.22600000000000001,"15min":0.21199999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.64900000000000002},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.38600000000000001},"min":{"1min":0.32300000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52500000000000002,"5min":0.59399999999999997,"15min":0.63600000000000001},"last":0.28999999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.436,"5min":0.36599999999999999,"15min":0.35199999999999998},"max":{"1min":0.80200000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59099999999999997,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.65400000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.42299999999999999,"5min":0.40000000000000002,"15min":0.31},"max":{"1min":0.71299999999999997,"5min":0.82399999999999995,"15min":0.872},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60599999999999998,"15min":0.57599999999999996},"min":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.878,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52700000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60799999999999998,"15min":0.58899999999999997},"min":{"1min":0.442,"5min":0.375,"15min":0.33900000000000002},"max":{"1min":0.83899999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.37},"max":{"1min":0.75600000000000001,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.38500000000000001},"max":{"1min":0.82799999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.498},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.623,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79200000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574984,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34899999999999998,"15min":0.32200000000000001},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.45300000000000001,"5min":0.57299999999999995,"15min":0.72699999999999998},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.39600000000000002,"15min":0.37},"min":{"1min":0.28399999999999997,"5min":0.27500000000000002,"15min":0.17699999999999999},"max":{"1min":0.52000000000000002,"5min":0.54100000000000004,"15min":2.0539999999999998},"last":0.253}]},{"osd":1,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.378,"15min":0.35099999999999998},"min":{"1min":0.23699999999999999,"5min":0.22600000000000001,"15min":0.17999999999999999},"max":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.83099999999999996},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.40300000000000002,"15min":0.372},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.20000000000000001},"max":{"1min":0.57099999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.28299999999999997}]},{"osd":3,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.41399999999999998,"15min":0.38500000000000001},"min":{"1min":0.29799999999999999,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.56299999999999994,"5min":0.60399999999999998,"15min":0.995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.41599999999999998,"15min":0.39100000000000001},"min":{"1min":0.308,"5min":0.218,"15min":0.218},"max":{"1min":0.57199999999999995,"5min":0.64400000000000002,"15min":0.76600000000000001},"last":0.313}]},{"osd":4,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.57899999999999996},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.32500000000000001},"max":{"1min":0.76900000000000002,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.38200000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83999999999999997,"5min":0.878,"15min":2.347},"last":0.51900000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":0.997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59899999999999998,"15min":0.57099999999999995},"min":{"1min":0.45300000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60199999999999998,"15min":0.58699999999999997},"min":{"1min":0.46500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84999999999999998,"5min":0.877,"15min":2.274},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61299999999999999,"15min":0.58899999999999997},"min":{"1min":0.503,"5min":0.38,"15min":0.373},"max":{"1min":0.84599999999999997,"5min":0.89300000000000002,"15min":1.0289999999999999},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.442,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85699999999999998,"5min":0.89800000000000002,"15min":2.3090000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.61699999999999999,"15min":0.59399999999999997},"min":{"1min":0.45200000000000001,"5min":0.40500000000000003,"15min":0.379},"max":{"1min":0.82299999999999995,"5min":0.873,"15min":1.0549999999999999},"last":0.56999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.314},"min":{"1min":0.23599999999999999,"5min":0.20899999999999999,"15min":0.16400000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38700000000000001,"15min":0.35299999999999998},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.22700000000000001},"max":{"1min":0.53600000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.26900000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.32900000000000001},"min":{"1min":0.24099999999999999,"5min":0.23000000000000001,"15min":0.19500000000000001},"max":{"1min":0.57899999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.40100000000000002,"15min":0.372},"min":{"1min":0.307,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":0.53700000000000003,"5min":0.57099999999999995,"15min":0.57299999999999995},"last":0.29499999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42199999999999999,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.191},"max":{"1min":0.60399999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.317},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.36399999999999999},"min":{"1min":0.28000000000000003,"5min":0.22500000000000001,"15min":0.20399999999999999},"max":{"1min":0.56499999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.32700000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60699999999999998,"15min":0.57499999999999996},"min":{"1min":0.498,"5min":0.35599999999999998,"15min":0.312},"max":{"1min":0.79100000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.90900000000000003,"15min":1.002},"last":0.53600000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.79200000000000004,"15min":0.86099999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61099999999999999,"15min":0.56799999999999995},"min":{"1min":0.48199999999999998,"5min":0.38300000000000001,"15min":0.317},"max":{"1min":0.81599999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.504}]},{"osd":6,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60299999999999998,"15min":0.57399999999999995},"min":{"1min":0.51000000000000001,"5min":0.38300000000000001,"15min":0.36899999999999999},"max":{"1min":0.72099999999999997,"5min":0.92400000000000004,"15min":1.038},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.57899999999999996},"min":{"1min":0.45900000000000002,"5min":0.40600000000000003,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.49399999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64200000000000002,"15min":0.60899999999999999},"min":{"1min":0.52500000000000002,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.80600000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64200000000000002,"15min":0.61599999999999999},"min":{"1min":0.52900000000000003,"5min":0.41899999999999998,"15min":0.376},"max":{"1min":0.82199999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.57399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574984,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193674,"statfs":{"total":200000000,"available":198323181,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.32600000000000001},"min":{"1min":0.214,"5min":0.189,"15min":0.184},"max":{"1min":0.51700000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.35799999999999998,"15min":0.33300000000000002},"min":{"1min":0.20999999999999999,"5min":0.20699999999999999,"15min":0.184},"max":{"1min":0.57399999999999995,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.245}]},{"osd":2,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.376,"15min":0.36499999999999999},"min":{"1min":0.248,"5min":0.22800000000000001,"15min":0.218},"max":{"1min":0.55600000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38400000000000001,"15min":0.36199999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.23100000000000001},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.622},"last":0.32000000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.376,"15min":0.34599999999999997},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.58899999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40699999999999997,"15min":0.38400000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27400000000000002},"max":{"1min":0.60799999999999998,"5min":0.625,"15min":0.625},"last":0.29199999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57499999999999996,"15min":0.54500000000000004},"min":{"1min":0.437,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.55400000000000005},"min":{"1min":0.46500000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74199999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51200000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57399999999999995,"15min":0.54400000000000004},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":0.85999999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.438},{"interface":"front","average":{"1min":0.62,"5min":0.59999999999999998,"15min":0.56899999999999995},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.86199999999999999},"last":0.55800000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61399999999999999,"15min":0.59699999999999998},"min":{"1min":0.49199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82499999999999996,"5min":0.88100000000000001,"15min":0.89600000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.62,"15min":0.59899999999999998},"min":{"1min":0.51100000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84599999999999997,"5min":0.89500000000000002,"15min":0.90000000000000002},"last":0.54300000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59999999999999998,"15min":0.57099999999999995},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.375},"max":{"1min":0.76400000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.60599999999999998,"15min":0.58599999999999997},"min":{"1min":0.48999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79800000000000004,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.47899999999999998}]}]}],"pool_statfs":[]}} 2023-12-20T04:53:46.379 INFO:tasks.ceph.ceph_manager.ceph:clean! 2023-12-20T04:53:46.379 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:53:46.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.477+0000 7fe04fd99640 1 Processor -- start 2023-12-20T04:53:46.479 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.477+0000 7fe04fd99640 1 -- start start 2023-12-20T04:53:46.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.478+0000 7fe04fd99640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe04815d100 0x7fe0480b2a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:46.480 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.478+0000 7fe04fd99640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0480d0370 0x7fe0480cd500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:46.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.478+0000 7fe04fd99640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fe0480b2f90 con 0x7fe048161850 2023-12-20T04:53:46.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.478+0000 7fe04fd99640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fe0481613c0 con 0x7fe0480d0370 2023-12-20T04:53:46.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.478+0000 7fe04fd99640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0480d1b00 con 0x7fe04815d100 2023-12-20T04:53:46.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.478+0000 7fe04d334640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0480d0370 0x7fe0480cd500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:46.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.478+0000 7fe04d334640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fe0480d0370 0x7fe0480cd500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37830/0 (socket says 172.21.15.132:37830) 2023-12-20T04:53:46.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.478+0000 7fe04d334640 1 -- 172.21.15.132:0/3953509331 learned_addr learned my addr 172.21.15.132:0/3953509331 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:46.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.478+0000 7fe04db35640 1 --2- 172.21.15.132:0/3953509331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe04815d100 0x7fe0480b2a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:46.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.478+0000 7fe04d334640 1 -- 172.21.15.132:0/3953509331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe04815d100 msgr2=0x7fe0480b2a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:46.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.478+0000 7fe04d334640 1 --2- 172.21.15.132:0/3953509331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe04815d100 0x7fe0480b2a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.478+0000 7fe04d334640 1 -- 172.21.15.132:0/3953509331 >> v1:172.21.15.187:6789/0 conn(0x7fe048161850 legacy=0x7fe04806c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.478+0000 7fe04d334640 1 -- 172.21.15.132:0/3953509331 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0480d0810 con 0x7fe0480d0370 2023-12-20T04:53:46.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.478+0000 7fe04db35640 1 --2- 172.21.15.132:0/3953509331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe04815d100 0x7fe0480b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:46.481 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.479+0000 7fe04d334640 1 --2- 172.21.15.132:0/3953509331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0480d0370 0x7fe0480cd500 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fe038009870 tx=0x7fe03802b8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7f26edf22d05aa45 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:46.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.479+0000 7fe04cb33640 1 -- 172.21.15.132:0/3953509331 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038031640 con 0x7fe0480d0370 2023-12-20T04:53:46.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.479+0000 7fe04cb33640 1 -- 172.21.15.132:0/3953509331 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe0380317a0 con 0x7fe0480d0370 2023-12-20T04:53:46.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.479+0000 7fe04cb33640 1 -- 172.21.15.132:0/3953509331 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe038031b30 con 0x7fe0480d0370 2023-12-20T04:53:46.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.479+0000 7fe04fd99640 1 -- 172.21.15.132:0/3953509331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0480d0370 msgr2=0x7fe0480cd500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.479+0000 7fe04fd99640 1 --2- 172.21.15.132:0/3953509331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0480d0370 0x7fe0480cd500 secure :-1 s=READY pgs=1934 cs=0 l=1 rev1=1 crypto rx=0x7fe038009870 tx=0x7fe03802b8f0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.479+0000 7fe04fd99640 1 -- 172.21.15.132:0/3953509331 shutdown_connections 2023-12-20T04:53:46.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.479+0000 7fe04fd99640 1 --2- 172.21.15.132:0/3953509331 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe0480d0370 0x7fe0480cd500 unknown :-1 s=CLOSED pgs=1934 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.479+0000 7fe04fd99640 1 --2- 172.21.15.132:0/3953509331 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe04815d100 0x7fe0480b2a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.480+0000 7fe04fd99640 1 -- 172.21.15.132:0/3953509331 >> 172.21.15.132:0/3953509331 conn(0x7fe04806d7c0 msgr2=0x7fe04806dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:46.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.480+0000 7fe04fd99640 1 -- 172.21.15.132:0/3953509331 shutdown_connections 2023-12-20T04:53:46.483 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.480+0000 7fe04fd99640 1 -- 172.21.15.132:0/3953509331 wait complete. 2023-12-20T04:53:46.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.481+0000 7fe04fd99640 1 Processor -- start 2023-12-20T04:53:46.484 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.481+0000 7fe04fd99640 1 -- start start 2023-12-20T04:53:46.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.481+0000 7fe04fd99640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0480d0370 0x7fe0481e6a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:46.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.481+0000 7fe04fd99640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe04815d100 0x7fe0481f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:46.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.481+0000 7fe04fd99640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe048161850 0x7fe0480b5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:46.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.481+0000 7fe04fd99640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0480b5ee0 con 0x7fe048161850 2023-12-20T04:53:46.486 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.481+0000 7fe04fd99640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0481f28e0 con 0x7fe04815d100 2023-12-20T04:53:46.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.481+0000 7fe04fd99640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fe0480c8970 con 0x7fe0480d0370 2023-12-20T04:53:46.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe04e336640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe048161850 0x7fe0480b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:46.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe04e336640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe048161850 0x7fe0480b5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37842/0 (socket says 172.21.15.132:37842) 2023-12-20T04:53:46.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe04e336640 1 -- 172.21.15.132:0/2781575543 learned_addr learned my addr 172.21.15.132:0/2781575543 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:46.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe04db35640 1 --2- 172.21.15.132:0/2781575543 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0480d0370 0x7fe0481e6a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:46.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe04d334640 1 --2- 172.21.15.132:0/2781575543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe04815d100 0x7fe0481f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:46.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe04e336640 1 -- 172.21.15.132:0/2781575543 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0480d0370 msgr2=0x7fe0481e6a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe04e336640 1 --2- 172.21.15.132:0/2781575543 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0480d0370 0x7fe0481e6a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe04e336640 1 -- 172.21.15.132:0/2781575543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe04815d100 msgr2=0x7fe0481f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe04e336640 1 --2- 172.21.15.132:0/2781575543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe04815d100 0x7fe0481f23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe04e336640 1 -- 172.21.15.132:0/2781575543 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0380094d0 con 0x7fe048161850 2023-12-20T04:53:46.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe04d334640 1 --2- 172.21.15.132:0/2781575543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe04815d100 0x7fe0481f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:46.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe04db35640 1 --2- 172.21.15.132:0/2781575543 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0480d0370 0x7fe0481e6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:46.487 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe04e336640 1 --2- 172.21.15.132:0/2781575543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe048161850 0x7fe0480b5590 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fe04000c7d0 tx=0x7fe04000cc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:46.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe03e7fc640 1 -- 172.21.15.132:0/2781575543 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe040003b70 con 0x7fe048161850 2023-12-20T04:53:46.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe03e7fc640 1 -- 172.21.15.132:0/2781575543 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fe040003cf0 con 0x7fe048161850 2023-12-20T04:53:46.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe03e7fc640 1 -- 172.21.15.132:0/2781575543 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fe04000aa30 con 0x7fe048161850 2023-12-20T04:53:46.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe04fd99640 1 -- 172.21.15.132:0/2781575543 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0480c8040 con 0x7fe048161850 2023-12-20T04:53:46.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.482+0000 7fe04fd99640 1 -- 172.21.15.132:0/2781575543 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0480c8600 con 0x7fe048161850 2023-12-20T04:53:46.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.483+0000 7fe04fd99640 1 -- 172.21.15.132:0/2781575543 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0480c8790 con 0x7fe048161850 2023-12-20T04:53:46.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.483+0000 7fe03e7fc640 1 -- 172.21.15.132:0/2781575543 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fe04000ab90 con 0x7fe048161850 2023-12-20T04:53:46.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.484+0000 7fe03e7fc640 1 --2- 172.21.15.132:0/2781575543 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe02c06a400 0x7fe02c06c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:46.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.484+0000 7fe04db35640 1 --2- 172.21.15.132:0/2781575543 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe02c06a400 0x7fe02c06c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:46.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.484+0000 7fe03e7fc640 1 -- 172.21.15.132:0/2781575543 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fe040088220 con 0x7fe048161850 2023-12-20T04:53:46.488 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.484+0000 7fe04db35640 1 --2- 172.21.15.132:0/2781575543 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe02c06a400 0x7fe02c06c8c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe044006fd0 tx=0x7fe044008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:46.490 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.488+0000 7fe03e7fc640 1 -- 172.21.15.132:0/2781575543 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fe040053b10 con 0x7fe048161850 2023-12-20T04:53:46.654 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.652+0000 7fe04fd99640 1 -- 172.21.15.132:0/2781575543 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fe048161050 con 0x7fe02c06a400 2023-12-20T04:53:46.656 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.654+0000 7fe03e7fc640 1 -- 172.21.15.132:0/2781575543 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50303 (secure 0 0 0) 0x7fe044009600 con 0x7fe02c06a400 2023-12-20T04:53:46.656 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:46.657 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:53:46.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.655+0000 7fe04fd99640 1 -- 172.21.15.132:0/2781575543 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe02c06a400 msgr2=0x7fe02c06c8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.655+0000 7fe04fd99640 1 --2- 172.21.15.132:0/2781575543 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe02c06a400 0x7fe02c06c8c0 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7fe044006fd0 tx=0x7fe044008040 comp rx=0 tx=0).stop 2023-12-20T04:53:46.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.655+0000 7fe04fd99640 1 -- 172.21.15.132:0/2781575543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe048161850 msgr2=0x7fe0480b5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.655+0000 7fe04fd99640 1 --2- 172.21.15.132:0/2781575543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe048161850 0x7fe0480b5590 secure :-1 s=READY pgs=1935 cs=0 l=1 rev1=1 crypto rx=0x7fe04000c7d0 tx=0x7fe04000cc90 comp rx=0 tx=0).stop 2023-12-20T04:53:46.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.656+0000 7fe04fd99640 1 -- 172.21.15.132:0/2781575543 shutdown_connections 2023-12-20T04:53:46.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.656+0000 7fe04fd99640 1 --2- 172.21.15.132:0/2781575543 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fe02c06a400 0x7fe02c06c8c0 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.656+0000 7fe04fd99640 1 --2- 172.21.15.132:0/2781575543 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fe048161850 0x7fe0480b5590 unknown :-1 s=CLOSED pgs=1935 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.658 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.656+0000 7fe04fd99640 1 --2- 172.21.15.132:0/2781575543 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fe04815d100 0x7fe0481f23a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.656+0000 7fe04fd99640 1 --2- 172.21.15.132:0/2781575543 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fe0480d0370 0x7fe0481e6a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.656+0000 7fe04fd99640 1 -- 172.21.15.132:0/2781575543 >> 172.21.15.132:0/2781575543 conn(0x7fe04806d7c0 msgr2=0x7fe0480cc040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.656+0000 7fe04fd99640 1 -- 172.21.15.132:0/2781575543 shutdown_connections 2023-12-20T04:53:46.659 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.656+0000 7fe04fd99640 1 -- 172.21.15.132:0/2781575543 wait complete. 2023-12-20T04:53:46.669 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":520,"stamp":"2023-12-20T04:53:46.239867+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9640,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552859,"statfs":{"total":1600000000,"available":1590127656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52487038,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-120,"num_write_kb":-85082,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001254"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":317,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-20T04:53:43.274738+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:53:43.274738+0000","last_peered":"2023-12-20T04:53:43.274738+0000","last_clean":"2023-12-20T04:53:43.274738+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:53:43.274738+0000","last_undegraded":"2023-12-20T04:53:43.274738+0000","last_fullsized":"2023-12-20T04:53:43.274738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574984,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193674,"statfs":{"total":200000000,"available":198323181,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.43099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70299999999999996,"5min":0.77700000000000002,"15min":1.0860000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.25600000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.86299999999999999},"last":0.54200000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.33100000000000002,"15min":0.26900000000000002},"max":{"1min":0.71699999999999997,"5min":0.76500000000000001,"15min":0.98799999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.45700000000000002,"5min":0.376,"15min":0.374},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":1.0269999999999999},"last":0.63200000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.375,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65100000000000002,"5min":0.75900000000000001,"15min":1.0069999999999999},"last":0.623},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.47599999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67100000000000004,"5min":0.75700000000000001,"15min":0.78000000000000003},"last":0.55600000000000005}]},{"osd":3,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65800000000000003,"5min":0.78300000000000003,"15min":1.048},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.34599999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.60299999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.46999999999999997,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.28499999999999998,"15min":0.26700000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.89700000000000002},"last":0.58599999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46300000000000002,"15min":0.47999999999999998},"min":{"1min":0.33600000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.70399999999999996,"5min":0.73099999999999998,"15min":0.73799999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51900000000000002,"15min":0.53100000000000003},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56499999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51900000000000002,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.33300000000000002,"15min":0.32500000000000001},"max":{"1min":0.755,"5min":0.77800000000000002,"15min":0.89800000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.498}]}]},{"osd":6,"up_from":13,"seq":55834574985,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55800000000000005,"15min":0.51900000000000002},"min":{"1min":0.36499999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.71099999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.622},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.57699999999999996}]},{"osd":1,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56699999999999995,"15min":0.54600000000000004},"min":{"1min":0.40000000000000002,"5min":0.32100000000000001,"15min":0.30099999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59199999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55000000000000004,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.38200000000000001,"15min":0.27000000000000002},"max":{"1min":0.72599999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.376,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55600000000000005}]},{"osd":3,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.33700000000000002},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.77800000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.43099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.749,"5min":0.77200000000000002,"15min":0.78900000000000003},"last":0.65800000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.32100000000000001,"5min":0.313,"15min":0.28499999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.81899999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.67300000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49099999999999999,"15min":0.50700000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.755,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.54600000000000004},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.32000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.85499999999999998},"last":0.64800000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52900000000000003,"15min":0.54000000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.72499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574984,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56499999999999995,"15min":0.53200000000000003},"min":{"1min":0.38200000000000001,"5min":0.32200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69099999999999995,"5min":0.747,"15min":0.748},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58899999999999997,"15min":0.57199999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74299999999999999,"5min":0.78700000000000003,"15min":0.82299999999999995},"last":0.56599999999999995}]},{"osd":1,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57299999999999995,"15min":0.55600000000000005},"min":{"1min":0.437,"5min":0.39800000000000002,"15min":0.26000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.82099999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.59099999999999997,"15min":0.58399999999999996},"min":{"1min":0.443,"5min":0.41799999999999998,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.84899999999999998},"last":0.54300000000000004}]},{"osd":2,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53800000000000003,"15min":0.52300000000000002},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.28199999999999997},"max":{"1min":0.69399999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.438,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":0.76600000000000001,"15min":0.77100000000000002},"last":0.53000000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.42699999999999999,"5min":0.34699999999999998,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.80900000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.46500000000000002,"5min":0.38400000000000001,"15min":0.312},"max":{"1min":0.71199999999999997,"5min":0.74199999999999999,"15min":0.77400000000000002},"last":0.47799999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.47999999999999998},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.249},"max":{"1min":0.68799999999999994,"5min":0.80400000000000005,"15min":0.81899999999999995},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.32900000000000001,"5min":0.29799999999999999,"15min":0.29399999999999998},"max":{"1min":0.64200000000000002,"5min":0.749,"15min":0.75700000000000001},"last":0.42099999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.48899999999999999},"min":{"1min":0.35799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.64900000000000002,"5min":0.75600000000000001,"15min":0.85299999999999998},"last":0.436},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.50900000000000001,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33900000000000002,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.82599999999999996,"15min":0.83999999999999997},"last":0.40300000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.495,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66900000000000004,"5min":0.78400000000000003,"15min":0.79800000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.311,"15min":0.311},"max":{"1min":0.67800000000000005,"5min":0.77700000000000002,"15min":0.98599999999999999},"last":0.55500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.46800000000000003,"5min":0.25700000000000001,"15min":0.19700000000000001},"max":{"1min":0.74199999999999999,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.251},"max":{"1min":0.76200000000000001,"5min":0.875,"15min":0.875},"last":0.46300000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52500000000000002},"min":{"1min":0.41499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.69399999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.374},{"interface":"front","average":{"1min":0.627,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.50800000000000001,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.77000000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.38200000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.316,"15min":0.313},"max":{"1min":0.73199999999999998,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.40400000000000003,"5min":0.33300000000000002,"15min":0.23400000000000001},"max":{"1min":0.69599999999999995,"5min":0.746,"15min":0.80400000000000005},"last":0.42999999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.56499999999999995},"min":{"1min":0.46000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.746,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.44800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.88800000000000001,"15min":0.91000000000000003},"last":0.45200000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46000000000000002,"15min":0.46300000000000002},"min":{"1min":0.314,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":0.68799999999999994,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.33800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60699999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.44}]},{"osd":6,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38200000000000001,"5min":0.28799999999999998,"15min":0.26400000000000001},"max":{"1min":0.61399999999999999,"5min":0.73099999999999998,"15min":0.82399999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70399999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35899999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.34899999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69699999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.432,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78000000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.41999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574984,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.25600000000000001,"5min":0.19800000000000001,"15min":0.193},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.629},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.36699999999999999},"min":{"1min":0.28399999999999997,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":0.54100000000000004,"5min":0.58199999999999996,"15min":0.64000000000000001},"last":0.30399999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.34300000000000003,"15min":0.33000000000000002},"min":{"1min":0.24299999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.499,"5min":0.62,"15min":0.62},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.36599999999999999,"15min":0.35099999999999998},"min":{"1min":0.29399999999999998,"5min":0.24099999999999999,"15min":0.20399999999999999},"max":{"1min":0.48199999999999998,"5min":0.55800000000000005,"15min":0.61699999999999999},"last":0.246}]},{"osd":2,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.35799999999999998,"15min":0.34999999999999998},"min":{"1min":0.253,"5min":0.22600000000000001,"15min":0.21199999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.64900000000000002},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.38600000000000001},"min":{"1min":0.32300000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52500000000000002,"5min":0.59399999999999997,"15min":0.63600000000000001},"last":0.28999999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.436,"5min":0.36599999999999999,"15min":0.35199999999999998},"max":{"1min":0.80200000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59099999999999997,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.65400000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.42299999999999999,"5min":0.40000000000000002,"15min":0.31},"max":{"1min":0.71299999999999997,"5min":0.82399999999999995,"15min":0.872},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60599999999999998,"15min":0.57599999999999996},"min":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.878,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52700000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60799999999999998,"15min":0.58899999999999997},"min":{"1min":0.442,"5min":0.375,"15min":0.33900000000000002},"max":{"1min":0.83899999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.37},"max":{"1min":0.75600000000000001,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.38500000000000001},"max":{"1min":0.82799999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.498},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.623,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79200000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574984,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34899999999999998,"15min":0.32200000000000001},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.45300000000000001,"5min":0.57299999999999995,"15min":0.72699999999999998},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.39600000000000002,"15min":0.37},"min":{"1min":0.28399999999999997,"5min":0.27500000000000002,"15min":0.17699999999999999},"max":{"1min":0.52000000000000002,"5min":0.54100000000000004,"15min":2.0539999999999998},"last":0.253}]},{"osd":1,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.378,"15min":0.35099999999999998},"min":{"1min":0.23699999999999999,"5min":0.22600000000000001,"15min":0.17999999999999999},"max":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.83099999999999996},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.40300000000000002,"15min":0.372},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.20000000000000001},"max":{"1min":0.57099999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.28299999999999997}]},{"osd":3,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.41399999999999998,"15min":0.38500000000000001},"min":{"1min":0.29799999999999999,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.56299999999999994,"5min":0.60399999999999998,"15min":0.995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.41599999999999998,"15min":0.39100000000000001},"min":{"1min":0.308,"5min":0.218,"15min":0.218},"max":{"1min":0.57199999999999995,"5min":0.64400000000000002,"15min":0.76600000000000001},"last":0.313}]},{"osd":4,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.57899999999999996},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.32500000000000001},"max":{"1min":0.76900000000000002,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.38200000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83999999999999997,"5min":0.878,"15min":2.347},"last":0.51900000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":0.997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59899999999999998,"15min":0.57099999999999995},"min":{"1min":0.45300000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60199999999999998,"15min":0.58699999999999997},"min":{"1min":0.46500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84999999999999998,"5min":0.877,"15min":2.274},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61299999999999999,"15min":0.58899999999999997},"min":{"1min":0.503,"5min":0.38,"15min":0.373},"max":{"1min":0.84599999999999997,"5min":0.89300000000000002,"15min":1.0289999999999999},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.442,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85699999999999998,"5min":0.89800000000000002,"15min":2.3090000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.61699999999999999,"15min":0.59399999999999997},"min":{"1min":0.45200000000000001,"5min":0.40500000000000003,"15min":0.379},"max":{"1min":0.82299999999999995,"5min":0.873,"15min":1.0549999999999999},"last":0.56999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.314},"min":{"1min":0.23599999999999999,"5min":0.20899999999999999,"15min":0.16400000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38700000000000001,"15min":0.35299999999999998},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.22700000000000001},"max":{"1min":0.53600000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.26900000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.32900000000000001},"min":{"1min":0.24099999999999999,"5min":0.23000000000000001,"15min":0.19500000000000001},"max":{"1min":0.57899999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.40100000000000002,"15min":0.372},"min":{"1min":0.307,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":0.53700000000000003,"5min":0.57099999999999995,"15min":0.57299999999999995},"last":0.29499999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42199999999999999,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.191},"max":{"1min":0.60399999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.317},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.36399999999999999},"min":{"1min":0.28000000000000003,"5min":0.22500000000000001,"15min":0.20399999999999999},"max":{"1min":0.56499999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.32700000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60699999999999998,"15min":0.57499999999999996},"min":{"1min":0.498,"5min":0.35599999999999998,"15min":0.312},"max":{"1min":0.79100000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.90900000000000003,"15min":1.002},"last":0.53600000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.79200000000000004,"15min":0.86099999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61099999999999999,"15min":0.56799999999999995},"min":{"1min":0.48199999999999998,"5min":0.38300000000000001,"15min":0.317},"max":{"1min":0.81599999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.504}]},{"osd":6,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60299999999999998,"15min":0.57399999999999995},"min":{"1min":0.51000000000000001,"5min":0.38300000000000001,"15min":0.36899999999999999},"max":{"1min":0.72099999999999997,"5min":0.92400000000000004,"15min":1.038},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.57899999999999996},"min":{"1min":0.45900000000000002,"5min":0.40600000000000003,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.49399999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64200000000000002,"15min":0.60899999999999999},"min":{"1min":0.52500000000000002,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.80600000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64200000000000002,"15min":0.61599999999999999},"min":{"1min":0.52900000000000003,"5min":0.41899999999999998,"15min":0.376},"max":{"1min":0.82199999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.57399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574984,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193674,"statfs":{"total":200000000,"available":198323181,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.32600000000000001},"min":{"1min":0.214,"5min":0.189,"15min":0.184},"max":{"1min":0.51700000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.35799999999999998,"15min":0.33300000000000002},"min":{"1min":0.20999999999999999,"5min":0.20699999999999999,"15min":0.184},"max":{"1min":0.57399999999999995,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.245}]},{"osd":2,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.376,"15min":0.36499999999999999},"min":{"1min":0.248,"5min":0.22800000000000001,"15min":0.218},"max":{"1min":0.55600000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38400000000000001,"15min":0.36199999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.23100000000000001},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.622},"last":0.32000000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.376,"15min":0.34599999999999997},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.58899999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40699999999999997,"15min":0.38400000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27400000000000002},"max":{"1min":0.60799999999999998,"5min":0.625,"15min":0.625},"last":0.29199999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57499999999999996,"15min":0.54500000000000004},"min":{"1min":0.437,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.55400000000000005},"min":{"1min":0.46500000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74199999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51200000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57399999999999995,"15min":0.54400000000000004},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":0.85999999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.438},{"interface":"front","average":{"1min":0.62,"5min":0.59999999999999998,"15min":0.56899999999999995},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.86199999999999999},"last":0.55800000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61399999999999999,"15min":0.59699999999999998},"min":{"1min":0.49199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82499999999999996,"5min":0.88100000000000001,"15min":0.89600000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.62,"15min":0.59899999999999998},"min":{"1min":0.51100000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84599999999999997,"5min":0.89500000000000002,"15min":0.90000000000000002},"last":0.54300000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59999999999999998,"15min":0.57099999999999995},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.375},"max":{"1min":0.76400000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.60599999999999998,"15min":0.58599999999999997},"min":{"1min":0.48999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79800000000000004,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.47899999999999998}]}]}],"pool_statfs":[]}} 2023-12-20T04:53:46.670 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2023-12-20T04:53:46.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.768+0000 7f767d973640 1 Processor -- start 2023-12-20T04:53:46.770 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.768+0000 7f767d973640 1 -- start start 2023-12-20T04:53:46.771 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.768+0000 7f767d973640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76780b4980 0x7f76780b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:46.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.768+0000 7f767d973640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76780b5320 con 0x7f7678160450 2023-12-20T04:53:46.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.768+0000 7f767d973640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f76780b5ec0 con 0x7f76780d1aa0 2023-12-20T04:53:46.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.768+0000 7f767d973640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f76781617e0 con 0x7f76780b4980 2023-12-20T04:53:46.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.768+0000 7f7676ffd640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f7678160450 0x7f7678160c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36718/0 (socket says 172.21.15.132:36718) 2023-12-20T04:53:46.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.768+0000 7f76767fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f76780b4980 0x7f76780b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:46.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.768+0000 7f7676ffd640 1 -- 172.21.15.132:0/4042069410 learned_addr learned my addr 172.21.15.132:0/4042069410 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:46.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.769+0000 7f7675ffb640 1 -- 172.21.15.132:0/4042069410 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1718339521 0 0) 0x7f76780b5320 con 0x7f7678160450 2023-12-20T04:53:46.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.769+0000 7f7675ffb640 1 -- 172.21.15.132:0/4042069410 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f7660003520 con 0x7f7678160450 2023-12-20T04:53:46.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.769+0000 7f76767fc640 1 -- 172.21.15.132:0/4042069410 >> v1:172.21.15.187:6789/0 conn(0x7f76780d1aa0 legacy=0x7f76780d1ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:46.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.769+0000 7f76767fc640 1 -- 172.21.15.132:0/4042069410 >> v1:172.21.15.132:6789/0 conn(0x7f7678160450 legacy=0x7f7678160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.769+0000 7f76767fc640 1 -- 172.21.15.132:0/4042069410 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76780d0fc0 con 0x7f76780b4980 2023-12-20T04:53:46.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.770+0000 7f76767fc640 1 --2- 172.21.15.132:0/4042069410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76780b4980 0x7f76780b4de0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f766c0097a0 tx=0x7f766c02b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99612fbc9187aadc server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:46.772 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.770+0000 7f7675ffb640 1 -- 172.21.15.132:0/4042069410 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c030610 con 0x7f76780b4980 2023-12-20T04:53:46.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.770+0000 7f7675ffb640 1 -- 172.21.15.132:0/4042069410 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c030770 con 0x7f76780b4980 2023-12-20T04:53:46.773 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.770+0000 7f7675ffb640 1 -- 172.21.15.132:0/4042069410 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c030ae0 con 0x7f76780b4980 2023-12-20T04:53:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.770+0000 7f767d973640 1 -- 172.21.15.132:0/4042069410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76780b4980 msgr2=0x7f76780b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.770+0000 7f767d973640 1 --2- 172.21.15.132:0/4042069410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76780b4980 0x7f76780b4de0 secure :-1 s=READY pgs=1937 cs=0 l=1 rev1=1 crypto rx=0x7f766c0097a0 tx=0x7f766c02b960 comp rx=0 tx=0).stop 2023-12-20T04:53:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.770+0000 7f767d973640 1 -- 172.21.15.132:0/4042069410 shutdown_connections 2023-12-20T04:53:46.775 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.770+0000 7f767d973640 1 --2- 172.21.15.132:0/4042069410 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76780b4980 0x7f76780b4de0 unknown :-1 s=CLOSED pgs=1937 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.770+0000 7f767d973640 1 -- 172.21.15.132:0/4042069410 >> 172.21.15.132:0/4042069410 conn(0x7f76780cf980 msgr2=0x7f76780cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:46.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.770+0000 7f767d973640 1 -- 172.21.15.132:0/4042069410 shutdown_connections 2023-12-20T04:53:46.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.770+0000 7f767d973640 1 -- 172.21.15.132:0/4042069410 wait complete. 2023-12-20T04:53:46.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.771+0000 7f767d973640 1 Processor -- start 2023-12-20T04:53:46.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.772+0000 7f767d973640 1 -- start start 2023-12-20T04:53:46.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.772+0000 7f767d973640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76780b4980 0x7f767815b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:46.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.772+0000 7f767d973640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76780d1aa0 0x7f7678144a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:46.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.772+0000 7f767d973640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7678160450 0x7f7678153550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:46.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.772+0000 7f767d973640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f767815cb50 con 0x7f76780d1aa0 2023-12-20T04:53:46.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.772+0000 7f767d973640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7678144f50 con 0x7f7678160450 2023-12-20T04:53:46.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.772+0000 7f767d973640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f767815bfd0 con 0x7f76780b4980 2023-12-20T04:53:46.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.772+0000 7f76767fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76780d1aa0 0x7f7678144a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:46.776 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.772+0000 7f76767fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76780d1aa0 0x7f7678144a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:37860/0 (socket says 172.21.15.132:37860) 2023-12-20T04:53:46.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.772+0000 7f76767fc640 1 -- 172.21.15.132:0/1692330306 learned_addr learned my addr 172.21.15.132:0/1692330306 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:46.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.773+0000 7f76767fc640 1 -- 172.21.15.132:0/1692330306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76780b4980 msgr2=0x7f767815b9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.773+0000 7f76767fc640 1 --2- 172.21.15.132:0/1692330306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76780b4980 0x7f767815b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.773+0000 7f76767fc640 1 -- 172.21.15.132:0/1692330306 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7678160450 msgr2=0x7f7678153550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.773+0000 7f76767fc640 1 --2- 172.21.15.132:0/1692330306 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7678160450 0x7f7678153550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.773+0000 7f76767fc640 1 -- 172.21.15.132:0/1692330306 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f766c009400 con 0x7f76780d1aa0 2023-12-20T04:53:46.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.773+0000 7f76767fc640 1 --2- 172.21.15.132:0/1692330306 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76780d1aa0 0x7f7678144a10 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f766c02b9a0 tx=0x7f766c004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:46.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.773+0000 7f765ffff640 1 -- 172.21.15.132:0/1692330306 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c03e040 con 0x7f76780d1aa0 2023-12-20T04:53:46.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.773+0000 7f765ffff640 1 -- 172.21.15.132:0/1692330306 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f766c039c90 con 0x7f76780d1aa0 2023-12-20T04:53:46.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.773+0000 7f767d973640 1 -- 172.21.15.132:0/1692330306 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f767815c2b0 con 0x7f76780d1aa0 2023-12-20T04:53:46.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.773+0000 7f765ffff640 1 -- 172.21.15.132:0/1692330306 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f766c030e10 con 0x7f76780d1aa0 2023-12-20T04:53:46.777 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.773+0000 7f767d973640 1 -- 172.21.15.132:0/1692330306 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f767815c870 con 0x7f76780d1aa0 2023-12-20T04:53:46.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.774+0000 7f767d973640 1 -- 172.21.15.132:0/1692330306 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f767804e840 con 0x7f76780d1aa0 2023-12-20T04:53:46.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.774+0000 7f765ffff640 1 -- 172.21.15.132:0/1692330306 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f766c04d3b0 con 0x7f76780d1aa0 2023-12-20T04:53:46.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.775+0000 7f765ffff640 1 --2- 172.21.15.132:0/1692330306 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f766406a430 0x7f766406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:46.778 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.775+0000 7f765ffff640 1 -- 172.21.15.132:0/1692330306 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f766c0aab50 con 0x7f76780d1aa0 2023-12-20T04:53:46.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.775+0000 7f7676ffd640 1 --2- 172.21.15.132:0/1692330306 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f766406a430 0x7f766406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:46.779 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.775+0000 7f7676ffd640 1 --2- 172.21.15.132:0/1692330306 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f766406a430 0x7f766406c8f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f76680012e0 tx=0x7f76680015b0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:46.781 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.779+0000 7f765ffff640 1 -- 172.21.15.132:0/1692330306 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f766c0763a0 con 0x7f76780d1aa0 2023-12-20T04:53:46.948 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.946+0000 7f767d973640 1 -- 172.21.15.132:0/1692330306 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f76780d0ad0 con 0x7f76780d1aa0 2023-12-20T04:53:46.949 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.947+0000 7f765ffff640 1 -- 172.21.15.132:0/1692330306 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v193) v1 ==== 74+0+12579 (secure 0 0 0) 0x7f766c0799c0 con 0x7f76780d1aa0 2023-12-20T04:53:46.949 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:46.949 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":193,"fsid":"b146884a-3712-4b4e-ac9f-636a781b2cda","created":"2023-12-20T04:42:30.055119+0000","modified":"2023-12-20T04:53:44.266729+0000","last_up_change":"2023-12-20T04:42:35.653517+0000","last_in_change":"2023-12-20T04:42:32.646555+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.69999998807907104,"backfillfull_ratio":0.60000002384185791,"nearfull_ratio":0.60000002384185791,"cluster_snapshot":"","pool_max":23,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2023-12-20T04:42:36.131368+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"110","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6800","nonce":84977},{"type":"v1","addr":"172.21.15.132:6801","nonce":84977}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6802","nonce":84977},{"type":"v1","addr":"172.21.15.132:6803","nonce":84977}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6806","nonce":84977},{"type":"v1","addr":"172.21.15.132:6807","nonce":84977}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6804","nonce":84977},{"type":"v1","addr":"172.21.15.132:6805","nonce":84977}]},"public_addr":"172.21.15.132:6801/84977","cluster_addr":"172.21.15.132:6803/84977","heartbeat_back_addr":"172.21.15.132:6807/84977","heartbeat_front_addr":"172.21.15.132:6805/84977","state":["exists","up"]},{"osd":1,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6818","nonce":84981},{"type":"v1","addr":"172.21.15.132:6821","nonce":84981}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6823","nonce":84981},{"type":"v1","addr":"172.21.15.132:6825","nonce":84981}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6830","nonce":84981},{"type":"v1","addr":"172.21.15.132:6831","nonce":84981}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6827","nonce":84981},{"type":"v1","addr":"172.21.15.132:6829","nonce":84981}]},"public_addr":"172.21.15.132:6821/84981","cluster_addr":"172.21.15.132:6825/84981","heartbeat_back_addr":"172.21.15.132:6831/84981","heartbeat_front_addr":"172.21.15.132:6829/84981","state":["exists","up"]},{"osd":2,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6808","nonce":84979},{"type":"v1","addr":"172.21.15.132:6809","nonce":84979}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6810","nonce":84979},{"type":"v1","addr":"172.21.15.132:6811","nonce":84979}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6814","nonce":84979},{"type":"v1","addr":"172.21.15.132:6815","nonce":84979}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6812","nonce":84979},{"type":"v1","addr":"172.21.15.132:6813","nonce":84979}]},"public_addr":"172.21.15.132:6809/84979","cluster_addr":"172.21.15.132:6811/84979","heartbeat_back_addr":"172.21.15.132:6815/84979","heartbeat_front_addr":"172.21.15.132:6813/84979","state":["exists","up"]},{"osd":3,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6816","nonce":84982},{"type":"v1","addr":"172.21.15.132:6817","nonce":84982}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6819","nonce":84982},{"type":"v1","addr":"172.21.15.132:6820","nonce":84982}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6826","nonce":84982},{"type":"v1","addr":"172.21.15.132:6828","nonce":84982}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6822","nonce":84982},{"type":"v1","addr":"172.21.15.132:6824","nonce":84982}]},"public_addr":"172.21.15.132:6817/84982","cluster_addr":"172.21.15.132:6820/84982","heartbeat_back_addr":"172.21.15.132:6828/84982","heartbeat_front_addr":"172.21.15.132:6824/84982","state":["exists","up"]},{"osd":4,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6800","nonce":84618},{"type":"v1","addr":"172.21.15.187:6801","nonce":84618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6802","nonce":84618},{"type":"v1","addr":"172.21.15.187:6804","nonce":84618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6814","nonce":84618},{"type":"v1","addr":"172.21.15.187:6818","nonce":84618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6807","nonce":84618},{"type":"v1","addr":"172.21.15.187:6811","nonce":84618}]},"public_addr":"172.21.15.187:6801/84618","cluster_addr":"172.21.15.187:6804/84618","heartbeat_back_addr":"172.21.15.187:6818/84618","heartbeat_front_addr":"172.21.15.187:6811/84618","state":["exists","up"]},{"osd":5,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6803","nonce":84620},{"type":"v1","addr":"172.21.15.187:6805","nonce":84620}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6808","nonce":84620},{"type":"v1","addr":"172.21.15.187:6810","nonce":84620}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6817","nonce":84620},{"type":"v1","addr":"172.21.15.187:6820","nonce":84620}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6813","nonce":84620},{"type":"v1","addr":"172.21.15.187:6815","nonce":84620}]},"public_addr":"172.21.15.187:6805/84620","cluster_addr":"172.21.15.187:6810/84620","heartbeat_back_addr":"172.21.15.187:6820/84620","heartbeat_front_addr":"172.21.15.187:6815/84620","state":["exists","up"]},{"osd":6,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6806","nonce":84619},{"type":"v1","addr":"172.21.15.187:6809","nonce":84619}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6812","nonce":84619},{"type":"v1","addr":"172.21.15.187:6816","nonce":84619}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6822","nonce":84619},{"type":"v1","addr":"172.21.15.187:6823","nonce":84619}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6819","nonce":84619},{"type":"v1","addr":"172.21.15.187:6821","nonce":84619}]},"public_addr":"172.21.15.187:6809/84619","cluster_addr":"172.21.15.187:6816/84619","heartbeat_back_addr":"172.21.15.187:6823/84619","heartbeat_front_addr":"172.21.15.187:6821/84619","state":["exists","up"]},{"osd":7,"uuid":"00000000-0000-0000-0000-000000000000","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":184,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6824","nonce":84651},{"type":"v1","addr":"172.21.15.187:6825","nonce":84651}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6826","nonce":84651},{"type":"v1","addr":"172.21.15.187:6827","nonce":84651}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6830","nonce":84651},{"type":"v1","addr":"172.21.15.187:6831","nonce":84651}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6828","nonce":84651},{"type":"v1","addr":"172.21.15.187:6829","nonce":84651}]},"public_addr":"172.21.15.187:6825/84651","cluster_addr":"172.21.15.187:6827/84651","heartbeat_back_addr":"172.21.15.187:6831/84651","heartbeat_front_addr":"172.21.15.187:6829/84651","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.719129+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.774912+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.821494+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.792514+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.804186+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.805109+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.825801+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2023-12-20T04:42:33.836291+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.132:6837/2356846201":"2023-12-21T04:53:41.255464+0000","172.21.15.132:6835/2356846201":"2023-12-21T04:53:41.255464+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2023-12-20T04:53:46.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.949+0000 7f767d973640 1 -- 172.21.15.132:0/1692330306 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f766406a430 msgr2=0x7f766406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.949+0000 7f767d973640 1 --2- 172.21.15.132:0/1692330306 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f766406a430 0x7f766406c8f0 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f76680012e0 tx=0x7f76680015b0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.949+0000 7f767d973640 1 -- 172.21.15.132:0/1692330306 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76780d1aa0 msgr2=0x7f7678144a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:46.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.949+0000 7f767d973640 1 --2- 172.21.15.132:0/1692330306 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76780d1aa0 0x7f7678144a10 secure :-1 s=READY pgs=1938 cs=0 l=1 rev1=1 crypto rx=0x7f766c02b9a0 tx=0x7f766c004730 comp rx=0 tx=0).stop 2023-12-20T04:53:46.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.949+0000 7f767d973640 1 -- 172.21.15.132:0/1692330306 shutdown_connections 2023-12-20T04:53:46.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.949+0000 7f767d973640 1 --2- 172.21.15.132:0/1692330306 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f766406a430 0x7f766406c8f0 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.949+0000 7f767d973640 1 --2- 172.21.15.132:0/1692330306 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f7678160450 0x7f7678153550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.949+0000 7f767d973640 1 --2- 172.21.15.132:0/1692330306 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f76780d1aa0 0x7f7678144a10 unknown :-1 s=CLOSED pgs=1938 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.949+0000 7f767d973640 1 --2- 172.21.15.132:0/1692330306 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f76780b4980 0x7f767815b9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:46.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.949+0000 7f767d973640 1 -- 172.21.15.132:0/1692330306 >> 172.21.15.132:0/1692330306 conn(0x7f76780cf980 msgr2=0x7f76780cd530 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:46.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.949+0000 7f767d973640 1 -- 172.21.15.132:0/1692330306 shutdown_connections 2023-12-20T04:53:46.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:46.949+0000 7f767d973640 1 -- 172.21.15.132:0/1692330306 wait complete. 2023-12-20T04:53:47.963 INFO:tasks.ceph:Scrubbing osd.0 2023-12-20T04:53:47.964 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2023-12-20T04:53:48.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.076+0000 7f22cfac4640 1 Processor -- start 2023-12-20T04:53:48.078 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.076+0000 7f22cfac4640 1 -- start start 2023-12-20T04:53:48.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.077+0000 7f22cfac4640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f22c815d300 0x7f22c80d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.077+0000 7f22cfac4640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f22c80cff90 0x7f22c80b60e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.077+0000 7f22cfac4640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f22c80d1a90 con 0x7f22c80d1550 2023-12-20T04:53:48.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.077+0000 7f22cfac4640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c80d1d70 con 0x7f22c815d300 2023-12-20T04:53:48.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.077+0000 7f22cfac4640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f22c80d2050 con 0x7f22c80cff90 2023-12-20T04:53:48.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.077+0000 7f22cd860640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f22c815d300 0x7f22c80d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.077+0000 7f22cd860640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f22c815d300 0x7f22c80d1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56244/0 (socket says 172.21.15.132:56244) 2023-12-20T04:53:48.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.077+0000 7f22cd860640 1 -- 172.21.15.132:0/3334932051 learned_addr learned my addr 172.21.15.132:0/3334932051 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:48.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.078+0000 7f22cd860640 1 -- 172.21.15.132:0/3334932051 >> v2:172.21.15.187:3300/0 conn(0x7f22c80cff90 msgr2=0x7f22c80b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:48.080 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.078+0000 7f22cd860640 1 --2- 172.21.15.132:0/3334932051 >> v2:172.21.15.187:3300/0 conn(0x7f22c80cff90 0x7f22c80b60e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.078+0000 7f22cd860640 1 -- 172.21.15.132:0/3334932051 >> v1:172.21.15.187:6789/0 conn(0x7f22c80d1550 legacy=0x7f22c80cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:48.081 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.078+0000 7f22cd860640 1 -- 172.21.15.132:0/3334932051 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c80d2330 con 0x7f22c815d300 2023-12-20T04:53:48.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.078+0000 7f22cd860640 1 --2- 172.21.15.132:0/3334932051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22c815d300 0x7f22c80d1010 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f22c80d07c0 tx=0x7f22c402b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb9e2a502b634101 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.078+0000 7f22cc85e640 1 -- 172.21.15.132:0/3334932051 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c4031870 con 0x7f22c815d300 2023-12-20T04:53:48.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.078+0000 7f22cc85e640 1 -- 172.21.15.132:0/3334932051 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c40319d0 con 0x7f22c815d300 2023-12-20T04:53:48.082 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.078+0000 7f22cc85e640 1 -- 172.21.15.132:0/3334932051 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c4031d60 con 0x7f22c815d300 2023-12-20T04:53:48.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.079+0000 7f22cfac4640 1 -- 172.21.15.132:0/3334932051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22c815d300 msgr2=0x7f22c80d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.079+0000 7f22cfac4640 1 --2- 172.21.15.132:0/3334932051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22c815d300 0x7f22c80d1010 secure :-1 s=READY pgs=1939 cs=0 l=1 rev1=1 crypto rx=0x7f22c80d07c0 tx=0x7f22c402b910 comp rx=0 tx=0).stop 2023-12-20T04:53:48.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.079+0000 7f22cfac4640 1 -- 172.21.15.132:0/3334932051 shutdown_connections 2023-12-20T04:53:48.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.079+0000 7f22cfac4640 1 --2- 172.21.15.132:0/3334932051 >> v2:172.21.15.187:3300/0 conn(0x7f22c80cff90 0x7f22c80b60e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.079+0000 7f22cfac4640 1 --2- 172.21.15.132:0/3334932051 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22c815d300 0x7f22c80d1010 unknown :-1 s=CLOSED pgs=1939 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.079+0000 7f22cfac4640 1 -- 172.21.15.132:0/3334932051 >> 172.21.15.132:0/3334932051 conn(0x7f22c806a3d0 msgr2=0x7f22c806a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:48.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.079+0000 7f22cfac4640 1 -- 172.21.15.132:0/3334932051 shutdown_connections 2023-12-20T04:53:48.083 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.079+0000 7f22cfac4640 1 -- 172.21.15.132:0/3334932051 wait complete. 2023-12-20T04:53:48.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.080+0000 7f22cfac4640 1 Processor -- start 2023-12-20T04:53:48.084 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.080+0000 7f22cfac4640 1 -- start start 2023-12-20T04:53:48.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.081+0000 7f22cfac4640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22c80cff90 0x7f22c81f3160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.081+0000 7f22cfac4640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22c80d1550 0x7f22c80c9f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.081+0000 7f22cfac4640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22c815d300 0x7f22c8157310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.081+0000 7f22cfac4640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c80ca9c0 con 0x7f22c815d300 2023-12-20T04:53:48.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.081+0000 7f22cfac4640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f22c80caca0 con 0x7f22c80cff90 2023-12-20T04:53:48.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.081+0000 7f22cfac4640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f22c80caf80 con 0x7f22c80d1550 2023-12-20T04:53:48.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.081+0000 7f22ce061640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22c815d300 0x7f22c8157310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.088 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.081+0000 7f22ce061640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22c815d300 0x7f22c8157310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56258/0 (socket says 172.21.15.132:56258) 2023-12-20T04:53:48.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.081+0000 7f22ce061640 1 -- 172.21.15.132:0/1369021869 learned_addr learned my addr 172.21.15.132:0/1369021869 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:48.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.081+0000 7f22cd860640 1 --2- 172.21.15.132:0/1369021869 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22c80cff90 0x7f22c81f3160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.081+0000 7f22ce061640 1 -- 172.21.15.132:0/1369021869 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22c80d1550 msgr2=0x7f22c80c9f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.081+0000 7f22cd05f640 1 --2- 172.21.15.132:0/1369021869 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22c80d1550 0x7f22c80c9f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.081+0000 7f22ce061640 1 --2- 172.21.15.132:0/1369021869 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f22c80d1550 0x7f22c80c9f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.089 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.081+0000 7f22ce061640 1 -- 172.21.15.132:0/1369021869 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22c80cff90 msgr2=0x7f22c81f3160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.081+0000 7f22ce061640 1 --2- 172.21.15.132:0/1369021869 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22c80cff90 0x7f22c81f3160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.081+0000 7f22ce061640 1 -- 172.21.15.132:0/1369021869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f22c40094d0 con 0x7f22c815d300 2023-12-20T04:53:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.081+0000 7f22cd860640 1 --2- 172.21.15.132:0/1369021869 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f22c80cff90 0x7f22c81f3160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.082+0000 7f22ce061640 1 --2- 172.21.15.132:0/1369021869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22c815d300 0x7f22c8157310 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f22c000b970 tx=0x7f22c000be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.090 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.082+0000 7f22be7fc640 1 -- 172.21.15.132:0/1369021869 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c000cb40 con 0x7f22c815d300 2023-12-20T04:53:48.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.082+0000 7f22be7fc640 1 -- 172.21.15.132:0/1369021869 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f22c000ccc0 con 0x7f22c815d300 2023-12-20T04:53:48.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.082+0000 7f22cfac4640 1 -- 172.21.15.132:0/1369021869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f22c80cb260 con 0x7f22c815d300 2023-12-20T04:53:48.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.082+0000 7f22be7fc640 1 -- 172.21.15.132:0/1369021869 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f22c0014680 con 0x7f22c815d300 2023-12-20T04:53:48.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.082+0000 7f22cfac4640 1 -- 172.21.15.132:0/1369021869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f22c81f36a0 con 0x7f22c815d300 2023-12-20T04:53:48.091 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.083+0000 7f22cfac4640 1 -- 172.21.15.132:0/1369021869 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f22c80cd8f0 con 0x7f22c815d300 2023-12-20T04:53:48.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.083+0000 7f22be7fc640 1 -- 172.21.15.132:0/1369021869 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f22c001d3b0 con 0x7f22c815d300 2023-12-20T04:53:48.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.084+0000 7f22be7fc640 1 --2- 172.21.15.132:0/1369021869 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f22ac06a430 0x7f22ac06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.084+0000 7f22be7fc640 1 -- 172.21.15.132:0/1369021869 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f22c0088570 con 0x7f22c815d300 2023-12-20T04:53:48.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.084+0000 7f22cd860640 1 --2- 172.21.15.132:0/1369021869 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f22ac06a430 0x7f22ac06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.084+0000 7f22be7fc640 1 --2- 172.21.15.132:0/1369021869 >> [v2:172.21.15.132:6800/84977,v1:172.21.15.132:6801/84977] conn(0x7f22ac070290 0x7f22ac0726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.092 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.084+0000 7f22be7fc640 1 -- 172.21.15.132:0/1369021869 --> [v2:172.21.15.132:6800/84977,v1:172.21.15.132:6801/84977] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f22ac072d60 con 0x7f22ac070290 2023-12-20T04:53:48.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.084+0000 7f22be7fc640 1 -- 172.21.15.132:0/1369021869 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=193) v2 ==== 24+0+0 (secure 0 0 0) 0x7f22c008ac30 con 0x7f22c815d300 2023-12-20T04:53:48.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.084+0000 7f22cd05f640 1 --2- 172.21.15.132:0/1369021869 >> [v2:172.21.15.132:6800/84977,v1:172.21.15.132:6801/84977] conn(0x7f22ac070290 0x7f22ac0726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.084+0000 7f22cd05f640 1 --2- 172.21.15.132:0/1369021869 >> [v2:172.21.15.132:6800/84977,v1:172.21.15.132:6801/84977] conn(0x7f22ac070290 0x7f22ac0726b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.084+0000 7f22cd860640 1 --2- 172.21.15.132:0/1369021869 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f22ac06a430 0x7f22ac06c8f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f22c4036000 tx=0x7f22c403c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.093 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.085+0000 7f22be7fc640 1 -- 172.21.15.132:0/1369021869 <== osd.0 v2:172.21.15.132:6800/84977 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f22ac072d60 con 0x7f22ac070290 2023-12-20T04:53:48.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.096+0000 7f22cfac4640 1 -- 172.21.15.132:0/1369021869 --> [v2:172.21.15.132:6800/84977,v1:172.21.15.132:6801/84977] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f22c80d2b30 con 0x7f22ac070290 2023-12-20T04:53:48.098 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.096+0000 7f22be7fc640 1 -- 172.21.15.132:0/1369021869 <== osd.0 v2:172.21.15.132:6800/84977 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f22b8005370 con 0x7f22ac070290 2023-12-20T04:53:48.099 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:48.099 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-20T04:53:48.099 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:48.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.097+0000 7f22cfac4640 1 -- 172.21.15.132:0/1369021869 >> [v2:172.21.15.132:6800/84977,v1:172.21.15.132:6801/84977] conn(0x7f22ac070290 msgr2=0x7f22ac0726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.097+0000 7f22cfac4640 1 --2- 172.21.15.132:0/1369021869 >> [v2:172.21.15.132:6800/84977,v1:172.21.15.132:6801/84977] conn(0x7f22ac070290 0x7f22ac0726b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.097+0000 7f22cfac4640 1 -- 172.21.15.132:0/1369021869 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f22ac06a430 msgr2=0x7f22ac06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.097+0000 7f22cfac4640 1 --2- 172.21.15.132:0/1369021869 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f22ac06a430 0x7f22ac06c8f0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f22c4036000 tx=0x7f22c403c040 comp rx=0 tx=0).stop 2023-12-20T04:53:48.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.097+0000 7f22cfac4640 1 -- 172.21.15.132:0/1369021869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22c815d300 msgr2=0x7f22c8157310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.097+0000 7f22cfac4640 1 --2- 172.21.15.132:0/1369021869 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f22c815d300 0x7f22c8157310 secure :-1 s=READY pgs=1940 cs=0 l=1 rev1=1 crypto rx=0x7f22c000b970 tx=0x7f22c000be30 comp rx=0 tx=0).stop 2023-12-20T04:53:48.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.097+0000 7f22ce061640 1 -- 172.21.15.132:0/1369021869 reap_dead start 2023-12-20T04:53:48.100 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.097+0000 7f22cfac4640 1 -- 172.21.15.132:0/1369021869 shutdown_connections 2023-12-20T04:53:48.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.097+0000 7f22cfac4640 1 -- 172.21.15.132:0/1369021869 >> 172.21.15.132:0/1369021869 conn(0x7f22c806a3d0 msgr2=0x7f22c80b6d70 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:48.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.097+0000 7f22cfac4640 1 -- 172.21.15.132:0/1369021869 shutdown_connections 2023-12-20T04:53:48.101 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.097+0000 7f22cfac4640 1 -- 172.21.15.132:0/1369021869 wait complete. 2023-12-20T04:53:48.110 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2023-12-20T04:53:48.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.209+0000 7ff6c9477640 1 Processor -- start 2023-12-20T04:53:48.211 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.209+0000 7ff6c9477640 1 -- start start 2023-12-20T04:53:48.212 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.210+0000 7ff6c9477640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c4160450 0x7ff6c4160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.210+0000 7ff6c9477640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff6c41611b0 0x7ff6c40b4980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.210+0000 7ff6c9477640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff6c40b5ec0 con 0x7ff6c40b4ec0 2023-12-20T04:53:48.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.210+0000 7ff6c9477640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff6c40b5350 con 0x7ff6c41611b0 2023-12-20T04:53:48.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.210+0000 7ff6c9477640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c41617e0 con 0x7ff6c4160450 2023-12-20T04:53:48.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.210+0000 7ff6c27fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff6c41611b0 0x7ff6c40b4980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.210+0000 7ff6c37fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff6c40b4ec0 0x7ff6c406a1a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47164/0 (socket says 172.21.15.132:47164) 2023-12-20T04:53:48.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.210+0000 7ff6c37fe640 1 -- 172.21.15.132:0/2555251615 learned_addr learned my addr 172.21.15.132:0/2555251615 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:48.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.210+0000 7ff6c27fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff6c41611b0 0x7ff6c40b4980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56270/0 (socket says 172.21.15.132:56270) 2023-12-20T04:53:48.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.210+0000 7ff6c2ffd640 1 --2- 172.21.15.132:0/2555251615 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c4160450 0x7ff6c4160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.210+0000 7ff6c1ffb640 1 -- 172.21.15.132:0/2555251615 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 301964114 0 0) 0x7ff6c40b5ec0 con 0x7ff6c40b4ec0 2023-12-20T04:53:48.213 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.210+0000 7ff6c27fc640 1 -- 172.21.15.132:0/2555251615 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c4160450 msgr2=0x7ff6c4160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:48.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.210+0000 7ff6c27fc640 1 --2- 172.21.15.132:0/2555251615 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c4160450 0x7ff6c4160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.210+0000 7ff6c27fc640 1 -- 172.21.15.132:0/2555251615 >> v1:172.21.15.132:6789/0 conn(0x7ff6c40b4ec0 legacy=0x7ff6c406a1a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.214 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.210+0000 7ff6c27fc640 1 -- 172.21.15.132:0/2555251615 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6c40d0fc0 con 0x7ff6c41611b0 2023-12-20T04:53:48.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.211+0000 7ff6c27fc640 1 --2- 172.21.15.132:0/2555251615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6c41611b0 0x7ff6c40b4980 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80097a0 tx=0x7ff6b802b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbcfa3f4aaeee3b9 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.211+0000 7ff6c1ffb640 1 -- 172.21.15.132:0/2555251615 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8030610 con 0x7ff6c41611b0 2023-12-20T04:53:48.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.211+0000 7ff6c1ffb640 1 -- 172.21.15.132:0/2555251615 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b8030770 con 0x7ff6c41611b0 2023-12-20T04:53:48.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.211+0000 7ff6c1ffb640 1 -- 172.21.15.132:0/2555251615 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8030b00 con 0x7ff6c41611b0 2023-12-20T04:53:48.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.212+0000 7ff6c9477640 1 -- 172.21.15.132:0/2555251615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6c41611b0 msgr2=0x7ff6c40b4980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.215 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.212+0000 7ff6c9477640 1 --2- 172.21.15.132:0/2555251615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6c41611b0 0x7ff6c40b4980 secure :-1 s=READY pgs=1942 cs=0 l=1 rev1=1 crypto rx=0x7ff6b80097a0 tx=0x7ff6b802b960 comp rx=0 tx=0).stop 2023-12-20T04:53:48.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.212+0000 7ff6c9477640 1 -- 172.21.15.132:0/2555251615 shutdown_connections 2023-12-20T04:53:48.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.212+0000 7ff6c9477640 1 --2- 172.21.15.132:0/2555251615 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6c41611b0 0x7ff6c40b4980 unknown :-1 s=CLOSED pgs=1942 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.212+0000 7ff6c9477640 1 --2- 172.21.15.132:0/2555251615 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c4160450 0x7ff6c4160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.212+0000 7ff6c9477640 1 -- 172.21.15.132:0/2555251615 >> 172.21.15.132:0/2555251615 conn(0x7ff6c40cf980 msgr2=0x7ff6c40cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:48.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.212+0000 7ff6c9477640 1 -- 172.21.15.132:0/2555251615 shutdown_connections 2023-12-20T04:53:48.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.212+0000 7ff6c9477640 1 -- 172.21.15.132:0/2555251615 wait complete. 2023-12-20T04:53:48.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.213+0000 7ff6c9477640 1 Processor -- start 2023-12-20T04:53:48.216 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.213+0000 7ff6c9477640 1 -- start start 2023-12-20T04:53:48.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c9477640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6c40b4ec0 0x7ff6c40cc980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c9477640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6c4160450 0x7ff6c414d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c9477640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c41611b0 0x7ff6c40b6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c9477640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c40ccec0 con 0x7ff6c4160450 2023-12-20T04:53:48.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c9477640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c414d750 con 0x7ff6c40b4ec0 2023-12-20T04:53:48.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c9477640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff6c40cb8e0 con 0x7ff6c41611b0 2023-12-20T04:53:48.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c27fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6c4160450 0x7ff6c414d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c27fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6c4160450 0x7ff6c414d210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56276/0 (socket says 172.21.15.132:56276) 2023-12-20T04:53:48.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c27fc640 1 -- 172.21.15.132:0/768353551 learned_addr learned my addr 172.21.15.132:0/768353551 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:48.219 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c2ffd640 1 --2- 172.21.15.132:0/768353551 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6c40b4ec0 0x7ff6c40cc980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c37fe640 1 --2- 172.21.15.132:0/768353551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c41611b0 0x7ff6c40b6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c27fc640 1 -- 172.21.15.132:0/768353551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c41611b0 msgr2=0x7ff6c40b6fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c27fc640 1 --2- 172.21.15.132:0/768353551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c41611b0 0x7ff6c40b6fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c27fc640 1 -- 172.21.15.132:0/768353551 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6c40b4ec0 msgr2=0x7ff6c40cc980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c27fc640 1 --2- 172.21.15.132:0/768353551 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6c40b4ec0 0x7ff6c40cc980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c27fc640 1 -- 172.21.15.132:0/768353551 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff6b8009400 con 0x7ff6c4160450 2023-12-20T04:53:48.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c37fe640 1 --2- 172.21.15.132:0/768353551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c41611b0 0x7ff6c40b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:48.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.214+0000 7ff6c27fc640 1 --2- 172.21.15.132:0/768353551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6c4160450 0x7ff6c414d210 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7ff6b802bf70 tx=0x7ff6b80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.215+0000 7ff6ab7fe640 1 -- 172.21.15.132:0/768353551 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b803e070 con 0x7ff6c4160450 2023-12-20T04:53:48.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.215+0000 7ff6ab7fe640 1 -- 172.21.15.132:0/768353551 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff6b8030e10 con 0x7ff6c4160450 2023-12-20T04:53:48.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.215+0000 7ff6c9477640 1 -- 172.21.15.132:0/768353551 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff6c40cbbc0 con 0x7ff6c4160450 2023-12-20T04:53:48.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.215+0000 7ff6ab7fe640 1 -- 172.21.15.132:0/768353551 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff6b8039c30 con 0x7ff6c4160450 2023-12-20T04:53:48.220 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.215+0000 7ff6c9477640 1 -- 172.21.15.132:0/768353551 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff6c40cc180 con 0x7ff6c4160450 2023-12-20T04:53:48.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.216+0000 7ff6c9477640 1 -- 172.21.15.132:0/768353551 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff6c4158cb0 con 0x7ff6c4160450 2023-12-20T04:53:48.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.216+0000 7ff6ab7fe640 1 -- 172.21.15.132:0/768353551 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff6b80423f0 con 0x7ff6c4160450 2023-12-20T04:53:48.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.216+0000 7ff6ab7fe640 1 --2- 172.21.15.132:0/768353551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6b006a430 0x7ff6b006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.216+0000 7ff6ab7fe640 1 -- 172.21.15.132:0/768353551 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff6b80aa0a0 con 0x7ff6c4160450 2023-12-20T04:53:48.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.217+0000 7ff6c2ffd640 1 --2- 172.21.15.132:0/768353551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6b006a430 0x7ff6b006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.221 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.217+0000 7ff6c2ffd640 1 --2- 172.21.15.132:0/768353551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6b006a430 0x7ff6b006c8f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40113e0 tx=0x7ff6b400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.223 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.221+0000 7ff6ab7fe640 1 -- 172.21.15.132:0/768353551 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff6b8075a40 con 0x7ff6c4160450 2023-12-20T04:53:48.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.387+0000 7ff6c9477640 1 -- 172.21.15.132:0/768353551 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) v1 -- 0x7ff6c40d1580 con 0x7ff6b006a430 2023-12-20T04:53:48.389 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.387+0000 7ff6ab7fe640 1 -- 172.21.15.132:0/768353551 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff6b400f040 con 0x7ff6b006a430 2023-12-20T04:53:48.389 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 0 to deep-scrub 2023-12-20T04:53:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.389+0000 7ff6c9477640 1 -- 172.21.15.132:0/768353551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6b006a430 msgr2=0x7ff6b006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.389+0000 7ff6c9477640 1 --2- 172.21.15.132:0/768353551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6b006a430 0x7ff6b006c8f0 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7ff6b40113e0 tx=0x7ff6b400b040 comp rx=0 tx=0).stop 2023-12-20T04:53:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.389+0000 7ff6c9477640 1 -- 172.21.15.132:0/768353551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6c4160450 msgr2=0x7ff6c414d210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.389+0000 7ff6c9477640 1 --2- 172.21.15.132:0/768353551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6c4160450 0x7ff6c414d210 secure :-1 s=READY pgs=1943 cs=0 l=1 rev1=1 crypto rx=0x7ff6b802bf70 tx=0x7ff6b80046c0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.389+0000 7ff6c9477640 1 -- 172.21.15.132:0/768353551 shutdown_connections 2023-12-20T04:53:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.389+0000 7ff6c9477640 1 --2- 172.21.15.132:0/768353551 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff6b006a430 0x7ff6b006c8f0 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.389+0000 7ff6c9477640 1 --2- 172.21.15.132:0/768353551 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff6c41611b0 0x7ff6c40b6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.389+0000 7ff6c9477640 1 --2- 172.21.15.132:0/768353551 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff6c4160450 0x7ff6c414d210 unknown :-1 s=CLOSED pgs=1943 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.389+0000 7ff6c9477640 1 --2- 172.21.15.132:0/768353551 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff6c40b4ec0 0x7ff6c40cc980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.389+0000 7ff6c9477640 1 -- 172.21.15.132:0/768353551 >> 172.21.15.132:0/768353551 conn(0x7ff6c40cf980 msgr2=0x7ff6c41585a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:48.392 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.389+0000 7ff6c9477640 1 -- 172.21.15.132:0/768353551 shutdown_connections 2023-12-20T04:53:48.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.389+0000 7ff6c9477640 1 -- 172.21.15.132:0/768353551 wait complete. 2023-12-20T04:53:48.402 INFO:tasks.ceph:Scrubbing osd.1 2023-12-20T04:53:48.402 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2023-12-20T04:53:48.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.504+0000 7f2367ace640 1 Processor -- start 2023-12-20T04:53:48.506 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.504+0000 7f2367ace640 1 -- start start 2023-12-20T04:53:48.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.505+0000 7f2367ace640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f23600cf880 0x7f23600cfd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.505+0000 7f2367ace640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23600b60e0 0x7f23600b6510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.505+0000 7f2367ace640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f23600d1a90 con 0x7f236015d300 2023-12-20T04:53:48.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.505+0000 7f2367ace640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f23600d0250 con 0x7f23600cf880 2023-12-20T04:53:48.516 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.505+0000 7f2367ace640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23600d1d70 con 0x7f23600b60e0 2023-12-20T04:53:48.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.506+0000 7f2365069640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f23600cf880 0x7f23600cfd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.506+0000 7f236606b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23600b60e0 0x7f23600b6510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.506+0000 7f2365069640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f23600cf880 0x7f23600cfd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3300/0 says I am v2:172.21.15.132:35588/0 (socket says 172.21.15.132:35588) 2023-12-20T04:53:48.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.506+0000 7f2365069640 1 -- 172.21.15.132:0/532907789 learned_addr learned my addr 172.21.15.132:0/532907789 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:48.517 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.506+0000 7f236586a640 1 --1- 172.21.15.132:0/532907789 >> v1:172.21.15.187:6789/0 conn(0x7f236015d300 0x7f23600d1010 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.187:6789/0 says I am v1:172.21.15.132:57510/0 (socket says 172.21.15.132:57510) 2023-12-20T04:53:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.506+0000 7f2365069640 1 -- 172.21.15.132:0/532907789 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23600b60e0 msgr2=0x7f23600b6510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.506+0000 7f2365069640 1 --2- 172.21.15.132:0/532907789 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23600b60e0 0x7f23600b6510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.506+0000 7f2365069640 1 -- 172.21.15.132:0/532907789 >> v1:172.21.15.187:6789/0 conn(0x7f236015d300 legacy=0x7f23600d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.506+0000 7f2365069640 1 -- 172.21.15.132:0/532907789 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f23600d2050 con 0x7f23600cf880 2023-12-20T04:53:48.518 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.506+0000 7f2364868640 1 -- 172.21.15.132:0/532907789 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3692242183 0 0) 0x7f23600d1a90 con 0x7f236015d300 2023-12-20T04:53:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.506+0000 7f236606b640 1 --2- 172.21.15.132:0/532907789 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23600b60e0 0x7f23600b6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:53:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.507+0000 7f2365069640 1 --2- 172.21.15.132:0/532907789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23600cf880 0x7f23600cfd10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2350009850 tx=0x7f235002b960 comp rx=0 tx=0).ready entity=mon.1 client_cookie=fa02ddc53c53fe2d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.507+0000 7f2364868640 1 -- 172.21.15.132:0/532907789 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2350004230 con 0x7f23600cf880 2023-12-20T04:53:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.507+0000 7f2364868640 1 -- 172.21.15.132:0/532907789 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2350004390 con 0x7f23600cf880 2023-12-20T04:53:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.507+0000 7f2364868640 1 -- 172.21.15.132:0/532907789 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2350003810 con 0x7f23600cf880 2023-12-20T04:53:48.519 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.508+0000 7f2367ace640 1 -- 172.21.15.132:0/532907789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23600cf880 msgr2=0x7f23600cfd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.508+0000 7f2367ace640 1 --2- 172.21.15.132:0/532907789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23600cf880 0x7f23600cfd10 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f2350009850 tx=0x7f235002b960 comp rx=0 tx=0).stop 2023-12-20T04:53:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.508+0000 7f2367ace640 1 -- 172.21.15.132:0/532907789 shutdown_connections 2023-12-20T04:53:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.508+0000 7f2367ace640 1 --2- 172.21.15.132:0/532907789 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f23600b60e0 0x7f23600b6510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.508+0000 7f2367ace640 1 --2- 172.21.15.132:0/532907789 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23600cf880 0x7f23600cfd10 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.508+0000 7f2367ace640 1 -- 172.21.15.132:0/532907789 >> 172.21.15.132:0/532907789 conn(0x7f236006a3d0 msgr2=0x7f236006a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.508+0000 7f2367ace640 1 -- 172.21.15.132:0/532907789 shutdown_connections 2023-12-20T04:53:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.508+0000 7f2367ace640 1 -- 172.21.15.132:0/532907789 wait complete. 2023-12-20T04:53:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.509+0000 7f2367ace640 1 Processor -- start 2023-12-20T04:53:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.509+0000 7f2367ace640 1 -- start start 2023-12-20T04:53:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f2367ace640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23600b60e0 0x7f23600b5260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f2367ace640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23600cf880 0x7f23601f6b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.520 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f2367ace640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f236015d300 0x7f23601f23a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f2367ace640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23601f7050 con 0x7f23600cf880 2023-12-20T04:53:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f2367ace640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23600cbe00 con 0x7f23600b60e0 2023-12-20T04:53:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f2367ace640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f23600cc0e0 con 0x7f236015d300 2023-12-20T04:53:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f2365069640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23600cf880 0x7f23601f6b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f2365069640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23600cf880 0x7f23601f6b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56290/0 (socket says 172.21.15.132:56290) 2023-12-20T04:53:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f2365069640 1 -- 172.21.15.132:0/2258153279 learned_addr learned my addr 172.21.15.132:0/2258153279 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f236586a640 1 --2- 172.21.15.132:0/2258153279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23600b60e0 0x7f23600b5260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f236606b640 1 --2- 172.21.15.132:0/2258153279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f236015d300 0x7f23601f23a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f2365069640 1 -- 172.21.15.132:0/2258153279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f236015d300 msgr2=0x7f23601f23a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f2365069640 1 --2- 172.21.15.132:0/2258153279 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f236015d300 0x7f23601f23a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f2365069640 1 -- 172.21.15.132:0/2258153279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23600b60e0 msgr2=0x7f23600b5260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.521 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f2365069640 1 --2- 172.21.15.132:0/2258153279 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f23600b60e0 0x7f23600b5260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f2365069640 1 -- 172.21.15.132:0/2258153279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2358009400 con 0x7f23600cf880 2023-12-20T04:53:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f2365069640 1 --2- 172.21.15.132:0/2258153279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23600cf880 0x7f23601f6b10 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f235002b9a0 tx=0x7f23500046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f23567fc640 1 -- 172.21.15.132:0/2258153279 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f235003e070 con 0x7f23600cf880 2023-12-20T04:53:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f23567fc640 1 -- 172.21.15.132:0/2258153279 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f2350004500 con 0x7f23600cf880 2023-12-20T04:53:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f2367ace640 1 -- 172.21.15.132:0/2258153279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2350009460 con 0x7f23600cf880 2023-12-20T04:53:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f23567fc640 1 -- 172.21.15.132:0/2258153279 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f2350003e10 con 0x7f23600cf880 2023-12-20T04:53:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.510+0000 7f2367ace640 1 -- 172.21.15.132:0/2258153279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f23600cc6a0 con 0x7f23600cf880 2023-12-20T04:53:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.511+0000 7f2367ace640 1 -- 172.21.15.132:0/2258153279 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f23600d2610 con 0x7f23600cf880 2023-12-20T04:53:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.512+0000 7f23567fc640 1 -- 172.21.15.132:0/2258153279 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f2350006040 con 0x7f23600cf880 2023-12-20T04:53:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.512+0000 7f23567fc640 1 --2- 172.21.15.132:0/2258153279 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f234406a430 0x7f234406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.512+0000 7f23567fc640 1 -- 172.21.15.132:0/2258153279 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f23500aa350 con 0x7f23600cf880 2023-12-20T04:53:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.512+0000 7f236586a640 1 --2- 172.21.15.132:0/2258153279 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f234406a430 0x7f234406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.522 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.512+0000 7f23567fc640 1 --2- 172.21.15.132:0/2258153279 >> [v2:172.21.15.132:6818/84981,v1:172.21.15.132:6821/84981] conn(0x7f2344070290 0x7f23440726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.512+0000 7f23567fc640 1 -- 172.21.15.132:0/2258153279 --> [v2:172.21.15.132:6818/84981,v1:172.21.15.132:6821/84981] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2344072d60 con 0x7f2344070290 2023-12-20T04:53:48.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.512+0000 7f23567fc640 1 -- 172.21.15.132:0/2258153279 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=193) v2 ==== 24+0+0 (secure 0 0 0) 0x7f23500aca10 con 0x7f23600cf880 2023-12-20T04:53:48.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.512+0000 7f236606b640 1 --2- 172.21.15.132:0/2258153279 >> [v2:172.21.15.132:6818/84981,v1:172.21.15.132:6821/84981] conn(0x7f2344070290 0x7f23440726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.513+0000 7f236586a640 1 --2- 172.21.15.132:0/2258153279 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f234406a430 0x7f234406c8f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f235c007ed0 tx=0x7f235c007e60 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.513+0000 7f236606b640 1 --2- 172.21.15.132:0/2258153279 >> [v2:172.21.15.132:6818/84981,v1:172.21.15.132:6821/84981] conn(0x7f2344070290 0x7f23440726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.523 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.513+0000 7f23567fc640 1 -- 172.21.15.132:0/2258153279 <== osd.1 v2:172.21.15.132:6818/84981 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f2344072d60 con 0x7f2344070290 2023-12-20T04:53:48.526 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.524+0000 7f2367ace640 1 -- 172.21.15.132:0/2258153279 --> [v2:172.21.15.132:6818/84981,v1:172.21.15.132:6821/84981] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f23600d2330 con 0x7f2344070290 2023-12-20T04:53:48.527 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.525+0000 7f23567fc640 1 -- 172.21.15.132:0/2258153279 <== osd.1 v2:172.21.15.132:6818/84981 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f23580098b0 con 0x7f2344070290 2023-12-20T04:53:48.527 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:48.527 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-20T04:53:48.527 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:48.528 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.525+0000 7f2367ace640 1 -- 172.21.15.132:0/2258153279 >> [v2:172.21.15.132:6818/84981,v1:172.21.15.132:6821/84981] conn(0x7f2344070290 msgr2=0x7f23440726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.525+0000 7f2367ace640 1 --2- 172.21.15.132:0/2258153279 >> [v2:172.21.15.132:6818/84981,v1:172.21.15.132:6821/84981] conn(0x7f2344070290 0x7f23440726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.525+0000 7f2367ace640 1 -- 172.21.15.132:0/2258153279 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f234406a430 msgr2=0x7f234406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.525+0000 7f2367ace640 1 --2- 172.21.15.132:0/2258153279 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f234406a430 0x7f234406c8f0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f235c007ed0 tx=0x7f235c007e60 comp rx=0 tx=0).stop 2023-12-20T04:53:48.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.525+0000 7f2367ace640 1 -- 172.21.15.132:0/2258153279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23600cf880 msgr2=0x7f23601f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.525+0000 7f2367ace640 1 --2- 172.21.15.132:0/2258153279 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f23600cf880 0x7f23601f6b10 secure :-1 s=READY pgs=1944 cs=0 l=1 rev1=1 crypto rx=0x7f235002b9a0 tx=0x7f23500046c0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.525+0000 7f236606b640 1 -- 172.21.15.132:0/2258153279 reap_dead start 2023-12-20T04:53:48.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.525+0000 7f2367ace640 1 -- 172.21.15.132:0/2258153279 shutdown_connections 2023-12-20T04:53:48.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.525+0000 7f2367ace640 1 -- 172.21.15.132:0/2258153279 >> 172.21.15.132:0/2258153279 conn(0x7f236006a3d0 msgr2=0x7f23600cd890 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:48.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.525+0000 7f2367ace640 1 -- 172.21.15.132:0/2258153279 shutdown_connections 2023-12-20T04:53:48.529 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.525+0000 7f2367ace640 1 -- 172.21.15.132:0/2258153279 wait complete. 2023-12-20T04:53:48.538 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2023-12-20T04:53:48.637 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.635+0000 7ff437e70640 1 Processor -- start 2023-12-20T04:53:48.638 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.635+0000 7ff437e70640 1 -- start start 2023-12-20T04:53:48.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.636+0000 7ff437e70640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff43015ab70 0x7ff430160d70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.636+0000 7ff437e70640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff43006d530 con 0x7ff4300cf280 2023-12-20T04:53:48.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.636+0000 7ff437e70640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff430070540 con 0x7ff43006a340 2023-12-20T04:53:48.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.636+0000 7ff437e70640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff430070790 con 0x7ff43015ab70 2023-12-20T04:53:48.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.636+0000 7ff435c0c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff43015ab70 0x7ff430160d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.636+0000 7ff43540b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff4300cf280 0x7ff430069c30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47178/0 (socket says 172.21.15.132:47178) 2023-12-20T04:53:48.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.636+0000 7ff43540b640 1 -- 172.21.15.132:0/2707146699 learned_addr learned my addr 172.21.15.132:0/2707146699 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:48.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.637+0000 7ff434c0a640 1 -- 172.21.15.132:0/2707146699 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3753259116 0 0) 0x7ff43006d530 con 0x7ff4300cf280 2023-12-20T04:53:48.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.637+0000 7ff434c0a640 1 -- 172.21.15.132:0/2707146699 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7ff41c003520 con 0x7ff4300cf280 2023-12-20T04:53:48.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.637+0000 7ff435c0c640 1 -- 172.21.15.132:0/2707146699 >> v1:172.21.15.187:6789/0 conn(0x7ff43006a340 legacy=0x7ff43015dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.637+0000 7ff435c0c640 1 -- 172.21.15.132:0/2707146699 >> v1:172.21.15.132:6789/0 conn(0x7ff4300cf280 legacy=0x7ff430069c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.640 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.637+0000 7ff435c0c640 1 -- 172.21.15.132:0/2707146699 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff430070a70 con 0x7ff43015ab70 2023-12-20T04:53:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.637+0000 7ff435c0c640 1 --2- 172.21.15.132:0/2707146699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff43015ab70 0x7ff430160d70 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009d90 tx=0x7ff42c02bf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8fa856baab4a6bf server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.638+0000 7ff434c0a640 1 -- 172.21.15.132:0/2707146699 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c02cd00 con 0x7ff43015ab70 2023-12-20T04:53:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.638+0000 7ff434c0a640 1 -- 172.21.15.132:0/2707146699 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff42c02ce60 con 0x7ff43015ab70 2023-12-20T04:53:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.638+0000 7ff434c0a640 1 -- 172.21.15.132:0/2707146699 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff42c034660 con 0x7ff43015ab70 2023-12-20T04:53:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.638+0000 7ff437e70640 1 -- 172.21.15.132:0/2707146699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff43015ab70 msgr2=0x7ff430160d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.638+0000 7ff437e70640 1 --2- 172.21.15.132:0/2707146699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff43015ab70 0x7ff430160d70 secure :-1 s=READY pgs=1946 cs=0 l=1 rev1=1 crypto rx=0x7ff42c009d90 tx=0x7ff42c02bf50 comp rx=0 tx=0).stop 2023-12-20T04:53:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.638+0000 7ff437e70640 1 -- 172.21.15.132:0/2707146699 shutdown_connections 2023-12-20T04:53:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.638+0000 7ff437e70640 1 --2- 172.21.15.132:0/2707146699 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff43015ab70 0x7ff430160d70 unknown :-1 s=CLOSED pgs=1946 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.645 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.638+0000 7ff437e70640 1 -- 172.21.15.132:0/2707146699 >> 172.21.15.132:0/2707146699 conn(0x7ff4300cfca0 msgr2=0x7ff4300d00b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.638+0000 7ff437e70640 1 -- 172.21.15.132:0/2707146699 shutdown_connections 2023-12-20T04:53:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.638+0000 7ff437e70640 1 -- 172.21.15.132:0/2707146699 wait complete. 2023-12-20T04:53:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.639+0000 7ff437e70640 1 Processor -- start 2023-12-20T04:53:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.639+0000 7ff437e70640 1 -- start start 2023-12-20T04:53:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.640+0000 7ff437e70640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff43006a340 0x7ff430157340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.640+0000 7ff437e70640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4300cf280 0x7ff4301f2d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.640+0000 7ff437e70640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff43015ab70 0x7ff43015ee50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.640+0000 7ff437e70640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4300aeac0 con 0x7ff4300cf280 2023-12-20T04:53:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.640+0000 7ff437e70640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4300aded0 con 0x7ff43015ab70 2023-12-20T04:53:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.640+0000 7ff437e70640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff4300ae190 con 0x7ff43006a340 2023-12-20T04:53:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.640+0000 7ff43540b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4300cf280 0x7ff4301f2d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.640+0000 7ff43540b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4300cf280 0x7ff4301f2d30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56300/0 (socket says 172.21.15.132:56300) 2023-12-20T04:53:48.646 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.640+0000 7ff43540b640 1 -- 172.21.15.132:0/940336669 learned_addr learned my addr 172.21.15.132:0/940336669 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:48.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.640+0000 7ff43540b640 1 -- 172.21.15.132:0/940336669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff43006a340 msgr2=0x7ff430157340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.640+0000 7ff43540b640 1 --2- 172.21.15.132:0/940336669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff43006a340 0x7ff430157340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.640+0000 7ff43540b640 1 -- 172.21.15.132:0/940336669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff43015ab70 msgr2=0x7ff43015ee50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.640+0000 7ff43540b640 1 --2- 172.21.15.132:0/940336669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff43015ab70 0x7ff43015ee50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.640+0000 7ff43540b640 1 -- 172.21.15.132:0/940336669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff42c009a70 con 0x7ff4300cf280 2023-12-20T04:53:48.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.641+0000 7ff43540b640 1 --2- 172.21.15.132:0/940336669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4300cf280 0x7ff4301f2d30 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7ff42000c500 tx=0x7ff42000c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.641+0000 7ff4267fc640 1 -- 172.21.15.132:0/940336669 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420005ce0 con 0x7ff4300cf280 2023-12-20T04:53:48.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.641+0000 7ff4267fc640 1 -- 172.21.15.132:0/940336669 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff420005e40 con 0x7ff4300cf280 2023-12-20T04:53:48.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.641+0000 7ff437e70640 1 -- 172.21.15.132:0/940336669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4300ae470 con 0x7ff4300cf280 2023-12-20T04:53:48.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.641+0000 7ff4267fc640 1 -- 172.21.15.132:0/940336669 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff420007330 con 0x7ff4300cf280 2023-12-20T04:53:48.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.641+0000 7ff437e70640 1 -- 172.21.15.132:0/940336669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff430157880 con 0x7ff4300cf280 2023-12-20T04:53:48.647 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.642+0000 7ff437e70640 1 -- 172.21.15.132:0/940336669 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff43004e840 con 0x7ff4300cf280 2023-12-20T04:53:48.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.642+0000 7ff4267fc640 1 -- 172.21.15.132:0/940336669 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff420007490 con 0x7ff4300cf280 2023-12-20T04:53:48.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.643+0000 7ff4267fc640 1 --2- 172.21.15.132:0/940336669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff41406a460 0x7ff41406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.643+0000 7ff435c0c640 1 --2- 172.21.15.132:0/940336669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff41406a460 0x7ff41406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.643+0000 7ff4267fc640 1 -- 172.21.15.132:0/940336669 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff420087ba0 con 0x7ff4300cf280 2023-12-20T04:53:48.648 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.643+0000 7ff435c0c640 1 --2- 172.21.15.132:0/940336669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff41406a460 0x7ff41406c920 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff42c036000 tx=0x7ff42c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.649 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.647+0000 7ff4267fc640 1 -- 172.21.15.132:0/940336669 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff4200535e0 con 0x7ff4300cf280 2023-12-20T04:53:48.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.812+0000 7ff437e70640 1 -- 172.21.15.132:0/940336669 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) v1 -- 0x7ff430071030 con 0x7ff41406a460 2023-12-20T04:53:48.814 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.812+0000 7ff4267fc640 1 -- 172.21.15.132:0/940336669 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7ff42c034440 con 0x7ff41406a460 2023-12-20T04:53:48.814 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 1 to deep-scrub 2023-12-20T04:53:48.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.814+0000 7ff437e70640 1 -- 172.21.15.132:0/940336669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff41406a460 msgr2=0x7ff41406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.814+0000 7ff437e70640 1 --2- 172.21.15.132:0/940336669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff41406a460 0x7ff41406c920 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7ff42c036000 tx=0x7ff42c02e000 comp rx=0 tx=0).stop 2023-12-20T04:53:48.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.814+0000 7ff437e70640 1 -- 172.21.15.132:0/940336669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4300cf280 msgr2=0x7ff4301f2d30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.814+0000 7ff437e70640 1 --2- 172.21.15.132:0/940336669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4300cf280 0x7ff4301f2d30 secure :-1 s=READY pgs=1947 cs=0 l=1 rev1=1 crypto rx=0x7ff42000c500 tx=0x7ff42000c9c0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.816 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.814+0000 7ff437e70640 1 -- 172.21.15.132:0/940336669 shutdown_connections 2023-12-20T04:53:48.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.814+0000 7ff437e70640 1 --2- 172.21.15.132:0/940336669 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff41406a460 0x7ff41406c920 unknown :-1 s=CLOSED pgs=814 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.814+0000 7ff437e70640 1 --2- 172.21.15.132:0/940336669 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff43015ab70 0x7ff43015ee50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.814+0000 7ff437e70640 1 --2- 172.21.15.132:0/940336669 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff4300cf280 0x7ff4301f2d30 unknown :-1 s=CLOSED pgs=1947 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.814+0000 7ff437e70640 1 --2- 172.21.15.132:0/940336669 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff43006a340 0x7ff430157340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.814+0000 7ff437e70640 1 -- 172.21.15.132:0/940336669 >> 172.21.15.132:0/940336669 conn(0x7ff4300cfca0 msgr2=0x7ff43015c970 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:48.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.814+0000 7ff437e70640 1 -- 172.21.15.132:0/940336669 shutdown_connections 2023-12-20T04:53:48.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.814+0000 7ff437e70640 1 -- 172.21.15.132:0/940336669 wait complete. 2023-12-20T04:53:48.826 INFO:tasks.ceph:Scrubbing osd.2 2023-12-20T04:53:48.827 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2023-12-20T04:53:48.930 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.928+0000 7fc3fcd47640 1 Processor -- start 2023-12-20T04:53:48.931 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.928+0000 7fc3fcd47640 1 -- start start 2023-12-20T04:53:48.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.929+0000 7fc3fcd47640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc3f815cf20 0x7fc3f806c590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.929+0000 7fc3fcd47640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f806cc90 con 0x7fc3f815d300 2023-12-20T04:53:48.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.929+0000 7fc3fcd47640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fc3f80b2f30 con 0x7fc3f80cd4b0 2023-12-20T04:53:48.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.929+0000 7fc3fcd47640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc3f80b3210 con 0x7fc3f815cf20 2023-12-20T04:53:48.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.929+0000 7fc3f5d9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fc3f815d300 0x7fc3f8161700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47186/0 (socket says 172.21.15.132:47186) 2023-12-20T04:53:48.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.929+0000 7fc3f5d9b640 1 -- 172.21.15.132:0/709634759 learned_addr learned my addr 172.21.15.132:0/709634759 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:48.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.929+0000 7fc3f659c640 1 --2- 172.21.15.132:0/709634759 >> v2:172.21.15.187:3300/0 conn(0x7fc3f815cf20 0x7fc3f806c590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.935 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.929+0000 7fc3f559a640 1 -- 172.21.15.132:0/709634759 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 239633382 0 0) 0x7fc3f806cc90 con 0x7fc3f815d300 2023-12-20T04:53:48.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f559a640 1 -- 172.21.15.132:0/709634759 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fc3e0003520 con 0x7fc3f815d300 2023-12-20T04:53:48.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f559a640 1 -- 172.21.15.132:0/709634759 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 4013531707 0 0) 0x7fc3e0003520 con 0x7fc3f815d300 2023-12-20T04:53:48.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f559a640 1 -- 172.21.15.132:0/709634759 >> v2:172.21.15.187:3300/0 conn(0x7fc3f815cf20 msgr2=0x7fc3f806c590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:48.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f559a640 1 --2- 172.21.15.132:0/709634759 >> v2:172.21.15.187:3300/0 conn(0x7fc3f815cf20 0x7fc3f806c590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f559a640 1 -- 172.21.15.132:0/709634759 >> v1:172.21.15.187:6789/0 conn(0x7fc3f80cd4b0 legacy=0x7fc3f80d0660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f559a640 1 -- 172.21.15.132:0/709634759 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f80b34f0 con 0x7fc3f815d300 2023-12-20T04:53:48.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f559a640 1 -- 172.21.15.132:0/709634759 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fc3e8001670 con 0x7fc3f815d300 2023-12-20T04:53:48.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f559a640 1 -- 172.21.15.132:0/709634759 >> v1:172.21.15.132:6789/0 conn(0x7fc3f815d300 legacy=0x7fc3f8161700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f559a640 1 --2- 172.21.15.132:0/709634759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3e0003970 0x7fc3e0003d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f559a640 1 --2- 172.21.15.132:0/709634759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3e00047c0 0x7fc3e0004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f559a640 1 --2- 172.21.15.132:0/709634759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3e0005180 0x7fc3e000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f559a640 1 -- 172.21.15.132:0/709634759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f80b3210 con 0x7fc3e0003970 2023-12-20T04:53:48.936 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f559a640 1 -- 172.21.15.132:0/709634759 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e000bfd0 con 0x7fc3e00047c0 2023-12-20T04:53:48.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f559a640 1 -- 172.21.15.132:0/709634759 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3e000c190 con 0x7fc3e0005180 2023-12-20T04:53:48.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f659c640 1 --2- 172.21.15.132:0/709634759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3e0003970 0x7fc3e0003d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f5d9b640 1 --2- 172.21.15.132:0/709634759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3e00047c0 0x7fc3e0004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f6d9d640 1 --2- 172.21.15.132:0/709634759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3e0005180 0x7fc3e000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f659c640 1 -- 172.21.15.132:0/709634759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3e0005180 msgr2=0x7fc3e000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:48.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f659c640 1 --2- 172.21.15.132:0/709634759 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3e0005180 0x7fc3e000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f659c640 1 -- 172.21.15.132:0/709634759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3e00047c0 msgr2=0x7fc3e0004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:48.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f659c640 1 --2- 172.21.15.132:0/709634759 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3e00047c0 0x7fc3e0004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f659c640 1 -- 172.21.15.132:0/709634759 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3e0003520 con 0x7fc3e0003970 2023-12-20T04:53:48.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.930+0000 7fc3f6d9d640 1 -- 172.21.15.132:0/709634759 reap_dead start 2023-12-20T04:53:48.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.931+0000 7fc3f659c640 1 --2- 172.21.15.132:0/709634759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3e0003970 0x7fc3e0003d50 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009ac0 tx=0x7fc3e00057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bccf0a7286346b75 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.931+0000 7fc3f559a640 1 -- 172.21.15.132:0/709634759 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec02c6b0 con 0x7fc3e0003970 2023-12-20T04:53:48.937 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.931+0000 7fc3f559a640 1 -- 172.21.15.132:0/709634759 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3ec02c810 con 0x7fc3e0003970 2023-12-20T04:53:48.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.931+0000 7fc3f559a640 1 -- 172.21.15.132:0/709634759 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3ec02cba0 con 0x7fc3e0003970 2023-12-20T04:53:48.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.931+0000 7fc3fcd47640 1 -- 172.21.15.132:0/709634759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3e0003970 msgr2=0x7fc3e0003d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.931+0000 7fc3fcd47640 1 --2- 172.21.15.132:0/709634759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3e0003970 0x7fc3e0003d50 secure :-1 s=READY pgs=1949 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec009ac0 tx=0x7fc3e00057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.932+0000 7fc3fcd47640 1 -- 172.21.15.132:0/709634759 shutdown_connections 2023-12-20T04:53:48.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.932+0000 7fc3fcd47640 1 --2- 172.21.15.132:0/709634759 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3e0003970 0x7fc3e0003d50 unknown :-1 s=CLOSED pgs=1949 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.932+0000 7fc3fcd47640 1 -- 172.21.15.132:0/709634759 >> 172.21.15.132:0/709634759 conn(0x7fc3f8072c60 msgr2=0x7fc3f8073040 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:48.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.932+0000 7fc3fcd47640 1 -- 172.21.15.132:0/709634759 shutdown_connections 2023-12-20T04:53:48.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.932+0000 7fc3fcd47640 1 -- 172.21.15.132:0/709634759 wait complete. 2023-12-20T04:53:48.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.933+0000 7fc3fcd47640 1 Processor -- start 2023-12-20T04:53:48.938 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.933+0000 7fc3fcd47640 1 -- start start 2023-12-20T04:53:48.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3fcd47640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3e0003970 0x7fc3f80ac8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3fcd47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3f80af9b0 0x7fc3f8154850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.941 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3fcd47640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3f80b14e0 0x7fc3f80b1960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3fcd47640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f80b1ea0 con 0x7fc3f80af9b0 2023-12-20T04:53:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3fcd47640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f80c5950 con 0x7fc3e0003970 2023-12-20T04:53:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3fcd47640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc3f80acec0 con 0x7fc3f80b14e0 2023-12-20T04:53:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3f5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3f80af9b0 0x7fc3f8154850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3f5d9b640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3f80af9b0 0x7fc3f8154850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56320/0 (socket says 172.21.15.132:56320) 2023-12-20T04:53:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3f5d9b640 1 -- 172.21.15.132:0/4111447342 learned_addr learned my addr 172.21.15.132:0/4111447342 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3f659c640 1 --2- 172.21.15.132:0/4111447342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3e0003970 0x7fc3f80ac8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3f6d9d640 1 --2- 172.21.15.132:0/4111447342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3f80b14e0 0x7fc3f80b1960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3f5d9b640 1 -- 172.21.15.132:0/4111447342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3f80b14e0 msgr2=0x7fc3f80b1960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3f5d9b640 1 --2- 172.21.15.132:0/4111447342 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc3f80b14e0 0x7fc3f80b1960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3f5d9b640 1 -- 172.21.15.132:0/4111447342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3e0003970 msgr2=0x7fc3f80ac8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3f5d9b640 1 --2- 172.21.15.132:0/4111447342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3e0003970 0x7fc3f80ac8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.942 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3f5d9b640 1 -- 172.21.15.132:0/4111447342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc3f80ad300 con 0x7fc3f80af9b0 2023-12-20T04:53:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3f659c640 1 --2- 172.21.15.132:0/4111447342 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc3e0003970 0x7fc3f80ac8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3f5d9b640 1 --2- 172.21.15.132:0/4111447342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3f80af9b0 0x7fc3f8154850 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8001050 tx=0x7fc3e800ec80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3e6ffd640 1 -- 172.21.15.132:0/4111447342 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e800c7f0 con 0x7fc3f80af9b0 2023-12-20T04:53:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3e6ffd640 1 -- 172.21.15.132:0/4111447342 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc3e800c950 con 0x7fc3f80af9b0 2023-12-20T04:53:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3fcd47640 1 -- 172.21.15.132:0/4111447342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc3f80ad5e0 con 0x7fc3f80af9b0 2023-12-20T04:53:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3e6ffd640 1 -- 172.21.15.132:0/4111447342 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc3e800cd00 con 0x7fc3f80af9b0 2023-12-20T04:53:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.934+0000 7fc3fcd47640 1 -- 172.21.15.132:0/4111447342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc3f80afe30 con 0x7fc3f80af9b0 2023-12-20T04:53:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.935+0000 7fc3fcd47640 1 -- 172.21.15.132:0/4111447342 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fc3f804e840 con 0x7fc3f80af9b0 2023-12-20T04:53:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.936+0000 7fc3e6ffd640 1 -- 172.21.15.132:0/4111447342 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc3e801d460 con 0x7fc3f80af9b0 2023-12-20T04:53:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.936+0000 7fc3e6ffd640 1 --2- 172.21.15.132:0/4111447342 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc3d806a430 0x7fc3d806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.936+0000 7fc3e6ffd640 1 -- 172.21.15.132:0/4111447342 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc3e8088580 con 0x7fc3f80af9b0 2023-12-20T04:53:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.936+0000 7fc3f659c640 1 --2- 172.21.15.132:0/4111447342 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc3d806a430 0x7fc3d806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.943 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.936+0000 7fc3e6ffd640 1 --2- 172.21.15.132:0/4111447342 >> [v2:172.21.15.132:6808/84979,v1:172.21.15.132:6809/84979] conn(0x7fc3d8070290 0x7fc3d80726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.936+0000 7fc3e6ffd640 1 -- 172.21.15.132:0/4111447342 --> [v2:172.21.15.132:6808/84979,v1:172.21.15.132:6809/84979] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fc3d8072d60 con 0x7fc3d8070290 2023-12-20T04:53:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.936+0000 7fc3e6ffd640 1 -- 172.21.15.132:0/4111447342 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=193) v2 ==== 24+0+0 (secure 0 0 0) 0x7fc3e808ac40 con 0x7fc3f80af9b0 2023-12-20T04:53:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.936+0000 7fc3f6d9d640 1 --2- 172.21.15.132:0/4111447342 >> [v2:172.21.15.132:6808/84979,v1:172.21.15.132:6809/84979] conn(0x7fc3d8070290 0x7fc3d80726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.937+0000 7fc3f659c640 1 --2- 172.21.15.132:0/4111447342 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc3d806a430 0x7fc3d806c8f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec036000 tx=0x7fc3ec030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.937+0000 7fc3f6d9d640 1 --2- 172.21.15.132:0/4111447342 >> [v2:172.21.15.132:6808/84979,v1:172.21.15.132:6809/84979] conn(0x7fc3d8070290 0x7fc3d80726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:48.944 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.937+0000 7fc3e6ffd640 1 -- 172.21.15.132:0/4111447342 <== osd.2 v2:172.21.15.132:6808/84979 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fc3d8072d60 con 0x7fc3d8070290 2023-12-20T04:53:48.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.948+0000 7fc3fcd47640 1 -- 172.21.15.132:0/4111447342 --> [v2:172.21.15.132:6808/84979,v1:172.21.15.132:6809/84979] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fc3f80b2890 con 0x7fc3d8070290 2023-12-20T04:53:48.951 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.949+0000 7fc3e6ffd640 1 -- 172.21.15.132:0/4111447342 <== osd.2 v2:172.21.15.132:6808/84979 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7fc3f80b2890 con 0x7fc3d8070290 2023-12-20T04:53:48.951 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:48.951 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-20T04:53:48.951 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:48.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.949+0000 7fc3fcd47640 1 -- 172.21.15.132:0/4111447342 >> [v2:172.21.15.132:6808/84979,v1:172.21.15.132:6809/84979] conn(0x7fc3d8070290 msgr2=0x7fc3d80726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.952 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.949+0000 7fc3fcd47640 1 --2- 172.21.15.132:0/4111447342 >> [v2:172.21.15.132:6808/84979,v1:172.21.15.132:6809/84979] conn(0x7fc3d8070290 0x7fc3d80726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.949+0000 7fc3fcd47640 1 -- 172.21.15.132:0/4111447342 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc3d806a430 msgr2=0x7fc3d806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.949+0000 7fc3fcd47640 1 --2- 172.21.15.132:0/4111447342 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc3d806a430 0x7fc3d806c8f0 secure :-1 s=READY pgs=815 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec036000 tx=0x7fc3ec030000 comp rx=0 tx=0).stop 2023-12-20T04:53:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.949+0000 7fc3fcd47640 1 -- 172.21.15.132:0/4111447342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3f80af9b0 msgr2=0x7fc3f8154850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.949+0000 7fc3fcd47640 1 --2- 172.21.15.132:0/4111447342 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc3f80af9b0 0x7fc3f8154850 secure :-1 s=READY pgs=1950 cs=0 l=1 rev1=1 crypto rx=0x7fc3e8001050 tx=0x7fc3e800ec80 comp rx=0 tx=0).stop 2023-12-20T04:53:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.949+0000 7fc3f6d9d640 1 -- 172.21.15.132:0/4111447342 reap_dead start 2023-12-20T04:53:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.949+0000 7fc3fcd47640 1 -- 172.21.15.132:0/4111447342 shutdown_connections 2023-12-20T04:53:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.949+0000 7fc3fcd47640 1 -- 172.21.15.132:0/4111447342 >> 172.21.15.132:0/4111447342 conn(0x7fc3f8072c60 msgr2=0x7fc3f80b05c0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.949+0000 7fc3fcd47640 1 -- 172.21.15.132:0/4111447342 shutdown_connections 2023-12-20T04:53:48.953 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:48.949+0000 7fc3fcd47640 1 -- 172.21.15.132:0/4111447342 wait complete. 2023-12-20T04:53:48.962 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2023-12-20T04:53:49.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.060+0000 7f17939d2640 1 Processor -- start 2023-12-20T04:53:49.062 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.060+0000 7f17939d2640 1 -- start start 2023-12-20T04:53:49.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.061+0000 7f17939d2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f178c15d110 0x7f178c069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.061+0000 7f17939d2640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f178c15d4f0 0x7f178c06a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.061+0000 7f17939d2640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f178c161ce0 con 0x7f178c0aeb00 2023-12-20T04:53:49.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.061+0000 7f17939d2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178c0aca50 con 0x7f178c15d110 2023-12-20T04:53:49.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.061+0000 7f17939d2640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f178c160df0 con 0x7f178c15d4f0 2023-12-20T04:53:49.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.061+0000 7f179176e640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f178c15d110 0x7f178c069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.061+0000 7f1791f6f640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f178c0aeb00 0x7f178c070560 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47202/0 (socket says 172.21.15.132:47202) 2023-12-20T04:53:49.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.061+0000 7f1791f6f640 1 -- 172.21.15.132:0/2672758485 learned_addr learned my addr 172.21.15.132:0/2672758485 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:49.065 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.061+0000 7f179176e640 1 -- 172.21.15.132:0/2672758485 >> v2:172.21.15.187:3300/0 conn(0x7f178c15d4f0 msgr2=0x7f178c06a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.061+0000 7f179176e640 1 --2- 172.21.15.132:0/2672758485 >> v2:172.21.15.187:3300/0 conn(0x7f178c15d4f0 0x7f178c06a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.061+0000 7f179176e640 1 -- 172.21.15.132:0/2672758485 >> v1:172.21.15.132:6789/0 conn(0x7f178c0aeb00 legacy=0x7f178c070560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.061+0000 7f179176e640 1 -- 172.21.15.132:0/2672758485 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f178c1610d0 con 0x7f178c15d110 2023-12-20T04:53:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.061+0000 7f1783fff640 1 -- 172.21.15.132:0/2672758485 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2810535084 0 0) 0x7f178c161ce0 con 0x7f178c0aeb00 2023-12-20T04:53:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.062+0000 7f179176e640 1 --2- 172.21.15.132:0/2672758485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f178c15d110 0x7f178c069de0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f178c0740f0 tx=0x7f178802b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1437d54aea495f12 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.062+0000 7f1783fff640 1 -- 172.21.15.132:0/2672758485 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788031830 con 0x7f178c15d110 2023-12-20T04:53:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.062+0000 7f1783fff640 1 -- 172.21.15.132:0/2672758485 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f1788031990 con 0x7f178c15d110 2023-12-20T04:53:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.062+0000 7f1783fff640 1 -- 172.21.15.132:0/2672758485 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f1788031d20 con 0x7f178c15d110 2023-12-20T04:53:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.062+0000 7f17939d2640 1 -- 172.21.15.132:0/2672758485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f178c15d110 msgr2=0x7f178c069de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.062+0000 7f17939d2640 1 --2- 172.21.15.132:0/2672758485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f178c15d110 0x7f178c069de0 secure :-1 s=READY pgs=1952 cs=0 l=1 rev1=1 crypto rx=0x7f178c0740f0 tx=0x7f178802b8d0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.066 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.063+0000 7f17939d2640 1 -- 172.21.15.132:0/2672758485 shutdown_connections 2023-12-20T04:53:49.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.063+0000 7f17939d2640 1 --2- 172.21.15.132:0/2672758485 >> v2:172.21.15.187:3300/0 conn(0x7f178c15d4f0 0x7f178c06a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.063+0000 7f17939d2640 1 --2- 172.21.15.132:0/2672758485 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f178c15d110 0x7f178c069de0 unknown :-1 s=CLOSED pgs=1952 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.063+0000 7f17939d2640 1 -- 172.21.15.132:0/2672758485 >> 172.21.15.132:0/2672758485 conn(0x7f178c0cfbd0 msgr2=0x7f178c0cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:49.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.063+0000 7f17939d2640 1 -- 172.21.15.132:0/2672758485 shutdown_connections 2023-12-20T04:53:49.067 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.063+0000 7f17939d2640 1 -- 172.21.15.132:0/2672758485 wait complete. 2023-12-20T04:53:49.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.064+0000 7f17939d2640 1 Processor -- start 2023-12-20T04:53:49.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.064+0000 7f17939d2640 1 -- start start 2023-12-20T04:53:49.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.064+0000 7f17939d2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f178c0aeb00 0x7f178c1f6760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.064+0000 7f17939d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f178c15d110 0x7f178c0c8e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.064+0000 7f17939d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f178c15d4f0 0x7f178c15ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.064+0000 7f17939d2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0c7130 con 0x7f178c15d4f0 2023-12-20T04:53:49.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.064+0000 7f17939d2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0c93d0 con 0x7f178c0aeb00 2023-12-20T04:53:49.070 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.064+0000 7f17939d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f178c0c9650 con 0x7f178c15d110 2023-12-20T04:53:49.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.065+0000 7f1791f6f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f178c15d4f0 0x7f178c15ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.065+0000 7f1791f6f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f178c15d4f0 0x7f178c15ec80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56328/0 (socket says 172.21.15.132:56328) 2023-12-20T04:53:49.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.065+0000 7f1791f6f640 1 -- 172.21.15.132:0/1924736635 learned_addr learned my addr 172.21.15.132:0/1924736635 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:49.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.065+0000 7f179176e640 1 --2- 172.21.15.132:0/1924736635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f178c0aeb00 0x7f178c1f6760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.065+0000 7f1790f6d640 1 --2- 172.21.15.132:0/1924736635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f178c15d110 0x7f178c0c8e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.065+0000 7f1791f6f640 1 -- 172.21.15.132:0/1924736635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f178c15d110 msgr2=0x7f178c0c8e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.065+0000 7f1791f6f640 1 --2- 172.21.15.132:0/1924736635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f178c15d110 0x7f178c0c8e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.065+0000 7f1791f6f640 1 -- 172.21.15.132:0/1924736635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f178c0aeb00 msgr2=0x7f178c1f6760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.065+0000 7f1791f6f640 1 --2- 172.21.15.132:0/1924736635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f178c0aeb00 0x7f178c1f6760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.065+0000 7f1791f6f640 1 -- 172.21.15.132:0/1924736635 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17880093a0 con 0x7f178c15d4f0 2023-12-20T04:53:49.071 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.065+0000 7f1791f6f640 1 --2- 172.21.15.132:0/1924736635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f178c15d4f0 0x7f178c15ec80 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f178400c7b0 tx=0x7f178400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:49.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.065+0000 7f1781ffb640 1 -- 172.21.15.132:0/1924736635 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178400a640 con 0x7f178c15d4f0 2023-12-20T04:53:49.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.065+0000 7f1781ffb640 1 -- 172.21.15.132:0/1924736635 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f178400a7c0 con 0x7f178c15d4f0 2023-12-20T04:53:49.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.065+0000 7f17939d2640 1 -- 172.21.15.132:0/1924736635 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f178c0c9930 con 0x7f178c15d4f0 2023-12-20T04:53:49.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.065+0000 7f1781ffb640 1 -- 172.21.15.132:0/1924736635 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f178400ab70 con 0x7f178c15d4f0 2023-12-20T04:53:49.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.065+0000 7f17939d2640 1 -- 172.21.15.132:0/1924736635 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f178c0c7660 con 0x7f178c15d4f0 2023-12-20T04:53:49.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.066+0000 7f17939d2640 1 -- 172.21.15.132:0/1924736635 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f178c04e840 con 0x7f178c15d4f0 2023-12-20T04:53:49.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.067+0000 7f1781ffb640 1 -- 172.21.15.132:0/1924736635 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f178400acd0 con 0x7f178c15d4f0 2023-12-20T04:53:49.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.067+0000 7f1781ffb640 1 --2- 172.21.15.132:0/1924736635 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f177006a430 0x7f177006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.067+0000 7f1781ffb640 1 -- 172.21.15.132:0/1924736635 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f1784087d20 con 0x7f178c15d4f0 2023-12-20T04:53:49.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.067+0000 7f179176e640 1 --2- 172.21.15.132:0/1924736635 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f177006a430 0x7f177006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.072 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.068+0000 7f179176e640 1 --2- 172.21.15.132:0/1924736635 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f177006a430 0x7f177006c8f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1788036000 tx=0x7f178803c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:49.073 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.072+0000 7f1781ffb640 1 -- 172.21.15.132:0/1924736635 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f17840536a0 con 0x7f178c15d4f0 2023-12-20T04:53:49.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.239+0000 7f17939d2640 1 -- 172.21.15.132:0/1924736635 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) v1 -- 0x7f178c161690 con 0x7f177006a430 2023-12-20T04:53:49.241 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.239+0000 7f1781ffb640 1 -- 172.21.15.132:0/1924736635 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f1788031d20 con 0x7f177006a430 2023-12-20T04:53:49.242 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 2 to deep-scrub 2023-12-20T04:53:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.241+0000 7f17939d2640 1 -- 172.21.15.132:0/1924736635 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f177006a430 msgr2=0x7f177006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.241+0000 7f17939d2640 1 --2- 172.21.15.132:0/1924736635 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f177006a430 0x7f177006c8f0 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f1788036000 tx=0x7f178803c040 comp rx=0 tx=0).stop 2023-12-20T04:53:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.241+0000 7f17939d2640 1 -- 172.21.15.132:0/1924736635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f178c15d4f0 msgr2=0x7f178c15ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.241+0000 7f17939d2640 1 --2- 172.21.15.132:0/1924736635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f178c15d4f0 0x7f178c15ec80 secure :-1 s=READY pgs=1953 cs=0 l=1 rev1=1 crypto rx=0x7f178400c7b0 tx=0x7f178400cc70 comp rx=0 tx=0).stop 2023-12-20T04:53:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.241+0000 7f17939d2640 1 -- 172.21.15.132:0/1924736635 shutdown_connections 2023-12-20T04:53:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.241+0000 7f17939d2640 1 --2- 172.21.15.132:0/1924736635 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f177006a430 0x7f177006c8f0 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.241+0000 7f17939d2640 1 --2- 172.21.15.132:0/1924736635 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f178c15d4f0 0x7f178c15ec80 unknown :-1 s=CLOSED pgs=1953 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.241+0000 7f17939d2640 1 --2- 172.21.15.132:0/1924736635 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f178c15d110 0x7f178c0c8e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.241+0000 7f17939d2640 1 --2- 172.21.15.132:0/1924736635 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f178c0aeb00 0x7f178c1f6760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.241+0000 7f17939d2640 1 -- 172.21.15.132:0/1924736635 >> 172.21.15.132:0/1924736635 conn(0x7f178c0cfbd0 msgr2=0x7f178c0ca1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:49.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.241+0000 7f17939d2640 1 -- 172.21.15.132:0/1924736635 shutdown_connections 2023-12-20T04:53:49.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.241+0000 7f17939d2640 1 -- 172.21.15.132:0/1924736635 wait complete. 2023-12-20T04:53:49.252 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:53:49.255 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:53:49.256 INFO:tasks.ceph:Scrubbing osd.3 2023-12-20T04:53:49.256 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2023-12-20T04:53:49.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.397+0000 7fad331b9640 1 Processor -- start 2023-12-20T04:53:49.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.397+0000 7fad331b9640 1 -- start start 2023-12-20T04:53:49.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad331b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad2c0cfd10 0x7fad2c0b67f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad331b9640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2c0d1a90 con 0x7fad2c0cf880 2023-12-20T04:53:49.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad331b9640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fad2c0d1d70 con 0x7fad2c15d300 2023-12-20T04:53:49.408 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad331b9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c0d2050 con 0x7fad2c0cfd10 2023-12-20T04:53:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fad2c0cf880 0x7fad2c0b60e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47204/0 (socket says 172.21.15.132:47204) 2023-12-20T04:53:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2bfff640 1 -- 172.21.15.132:0/3275469060 learned_addr learned my addr 172.21.15.132:0/3275469060 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad31756640 1 --2- 172.21.15.132:0/3275469060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad2c0cfd10 0x7fad2c0b67f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2b7fe640 1 -- 172.21.15.132:0/3275469060 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2918002728 0 0) 0x7fad2c0d1a90 con 0x7fad2c0cf880 2023-12-20T04:53:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2b7fe640 1 -- 172.21.15.132:0/3275469060 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fad1c003520 con 0x7fad2c0cf880 2023-12-20T04:53:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2b7fe640 1 -- 172.21.15.132:0/3275469060 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 1713798244 0 0) 0x7fad1c003520 con 0x7fad2c0cf880 2023-12-20T04:53:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2b7fe640 1 -- 172.21.15.132:0/3275469060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad2c0cfd10 msgr2=0x7fad2c0b67f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2b7fe640 1 --2- 172.21.15.132:0/3275469060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad2c0cfd10 0x7fad2c0b67f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2b7fe640 1 -- 172.21.15.132:0/3275469060 >> v1:172.21.15.187:6789/0 conn(0x7fad2c15d300 legacy=0x7fad2c0d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.409 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2b7fe640 1 -- 172.21.15.132:0/3275469060 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c0d2330 con 0x7fad2c0cf880 2023-12-20T04:53:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2b7fe640 1 -- 172.21.15.132:0/3275469060 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fad180017f0 con 0x7fad2c0cf880 2023-12-20T04:53:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2b7fe640 1 -- 172.21.15.132:0/3275469060 >> v1:172.21.15.132:6789/0 conn(0x7fad2c0cf880 legacy=0x7fad2c0b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2b7fe640 1 --2- 172.21.15.132:0/3275469060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad2c0cfd10 0x7fad1c0039a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2b7fe640 1 --2- 172.21.15.132:0/3275469060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad1c003ee0 0x7fad1c0047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2b7fe640 1 --2- 172.21.15.132:0/3275469060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad1c004d00 0x7fad1c005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2b7fe640 1 -- 172.21.15.132:0/3275469060 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c0d2050 con 0x7fad1c003ee0 2023-12-20T04:53:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2b7fe640 1 -- 172.21.15.132:0/3275469060 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c00b9e0 con 0x7fad1c004d00 2023-12-20T04:53:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2b7fe640 1 -- 172.21.15.132:0/3275469060 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad1c00bba0 con 0x7fad2c0cfd10 2023-12-20T04:53:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.398+0000 7fad2bfff640 1 --2- 172.21.15.132:0/3275469060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad1c003ee0 0x7fad1c0047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.410 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.399+0000 7fad30f55640 1 --2- 172.21.15.132:0/3275469060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad2c0cfd10 0x7fad1c0039a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.399+0000 7fad31756640 1 --2- 172.21.15.132:0/3275469060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad1c004d00 0x7fad1c005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.399+0000 7fad2bfff640 1 -- 172.21.15.132:0/3275469060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad2c0cfd10 msgr2=0x7fad1c0039a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.399+0000 7fad2bfff640 1 --2- 172.21.15.132:0/3275469060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad2c0cfd10 0x7fad1c0039a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.399+0000 7fad2bfff640 1 -- 172.21.15.132:0/3275469060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad1c004d00 msgr2=0x7fad1c005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.399+0000 7fad2bfff640 1 --2- 172.21.15.132:0/3275469060 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad1c004d00 0x7fad1c005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.399+0000 7fad2bfff640 1 -- 172.21.15.132:0/3275469060 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad1c003520 con 0x7fad1c003ee0 2023-12-20T04:53:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.399+0000 7fad30f55640 1 --2- 172.21.15.132:0/3275469060 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad2c0cfd10 0x7fad1c0039a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.399+0000 7fad2bfff640 1 --2- 172.21.15.132:0/3275469060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad1c003ee0 0x7fad1c0047c0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fad1800c240 tx=0x7fad1c0057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d2992a3bc0e651db server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.399+0000 7fad2b7fe640 1 -- 172.21.15.132:0/3275469060 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad18007270 con 0x7fad1c003ee0 2023-12-20T04:53:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.400+0000 7fad2b7fe640 1 -- 172.21.15.132:0/3275469060 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad180073d0 con 0x7fad1c003ee0 2023-12-20T04:53:49.411 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.400+0000 7fad2b7fe640 1 -- 172.21.15.132:0/3275469060 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad1802c7e0 con 0x7fad1c003ee0 2023-12-20T04:53:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.400+0000 7fad331b9640 1 -- 172.21.15.132:0/3275469060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad1c003ee0 msgr2=0x7fad1c0047c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.400+0000 7fad331b9640 1 --2- 172.21.15.132:0/3275469060 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad1c003ee0 0x7fad1c0047c0 secure :-1 s=READY pgs=1955 cs=0 l=1 rev1=1 crypto rx=0x7fad1800c240 tx=0x7fad1c0057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.400+0000 7fad31756640 1 -- 172.21.15.132:0/3275469060 reap_dead start 2023-12-20T04:53:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.400+0000 7fad331b9640 1 -- 172.21.15.132:0/3275469060 shutdown_connections 2023-12-20T04:53:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.400+0000 7fad331b9640 1 -- 172.21.15.132:0/3275469060 >> 172.21.15.132:0/3275469060 conn(0x7fad2c06a3d0 msgr2=0x7fad2c06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.400+0000 7fad331b9640 1 -- 172.21.15.132:0/3275469060 shutdown_connections 2023-12-20T04:53:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.400+0000 7fad331b9640 1 -- 172.21.15.132:0/3275469060 wait complete. 2023-12-20T04:53:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.401+0000 7fad331b9640 1 Processor -- start 2023-12-20T04:53:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.401+0000 7fad331b9640 1 -- start start 2023-12-20T04:53:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.402+0000 7fad331b9640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad1c003ee0 0x7fad2c0b5370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.412 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.402+0000 7fad331b9640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad2c0ce290 0x7fad2c0ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.402+0000 7fad331b9640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad2c0b2ca0 0x7fad2c0b3120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.402+0000 7fad331b9640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c0cec50 con 0x7fad2c0b2ca0 2023-12-20T04:53:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.402+0000 7fad331b9640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c0cab60 con 0x7fad2c0ce290 2023-12-20T04:53:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.402+0000 7fad331b9640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fad2c0cadb0 con 0x7fad1c003ee0 2023-12-20T04:53:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.402+0000 7fad31756640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad2c0b2ca0 0x7fad2c0b3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.402+0000 7fad31756640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad2c0b2ca0 0x7fad2c0b3120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56348/0 (socket says 172.21.15.132:56348) 2023-12-20T04:53:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.402+0000 7fad31756640 1 -- 172.21.15.132:0/711842452 learned_addr learned my addr 172.21.15.132:0/711842452 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.402+0000 7fad30f55640 1 --2- 172.21.15.132:0/711842452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad1c003ee0 0x7fad2c0b5370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.402+0000 7fad31756640 1 -- 172.21.15.132:0/711842452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad1c003ee0 msgr2=0x7fad2c0b5370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.413 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.402+0000 7fad31756640 1 --2- 172.21.15.132:0/711842452 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fad1c003ee0 0x7fad2c0b5370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.402+0000 7fad31756640 1 -- 172.21.15.132:0/711842452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad2c0ce290 msgr2=0x7fad2c0ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.402+0000 7fad2bfff640 1 --2- 172.21.15.132:0/711842452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad2c0ce290 0x7fad2c0ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.402+0000 7fad31756640 1 --2- 172.21.15.132:0/711842452 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fad2c0ce290 0x7fad2c0ce710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.403+0000 7fad31756640 1 -- 172.21.15.132:0/711842452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad2c0cb090 con 0x7fad2c0b2ca0 2023-12-20T04:53:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.403+0000 7fad31756640 1 --2- 172.21.15.132:0/711842452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad2c0b2ca0 0x7fad2c0b3120 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fad2c08c2a0 tx=0x7fad240115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.403+0000 7fad297fa640 1 -- 172.21.15.132:0/711842452 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad2400e070 con 0x7fad2c0b2ca0 2023-12-20T04:53:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.403+0000 7fad297fa640 1 -- 172.21.15.132:0/711842452 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fad24011de0 con 0x7fad2c0b2ca0 2023-12-20T04:53:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.403+0000 7fad331b9640 1 -- 172.21.15.132:0/711842452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2c0cb370 con 0x7fad2c0b2ca0 2023-12-20T04:53:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.403+0000 7fad297fa640 1 -- 172.21.15.132:0/711842452 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fad24003990 con 0x7fad2c0b2ca0 2023-12-20T04:53:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.403+0000 7fad331b9640 1 -- 172.21.15.132:0/711842452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad2c0b3660 con 0x7fad2c0b2ca0 2023-12-20T04:53:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.404+0000 7fad331b9640 1 -- 172.21.15.132:0/711842452 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fad2c0d0140 con 0x7fad2c0b2ca0 2023-12-20T04:53:49.414 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.404+0000 7fad297fa640 1 -- 172.21.15.132:0/711842452 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fad24003af0 con 0x7fad2c0b2ca0 2023-12-20T04:53:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.405+0000 7fad297fa640 1 --2- 172.21.15.132:0/711842452 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fad1006a460 0x7fad1006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.405+0000 7fad297fa640 1 -- 172.21.15.132:0/711842452 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fad24089a50 con 0x7fad2c0b2ca0 2023-12-20T04:53:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.405+0000 7fad30f55640 1 --2- 172.21.15.132:0/711842452 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fad1006a460 0x7fad1006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.405+0000 7fad297fa640 1 --2- 172.21.15.132:0/711842452 >> [v2:172.21.15.132:6816/84982,v1:172.21.15.132:6817/84982] conn(0x7fad100702c0 0x7fad100726e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.405+0000 7fad297fa640 1 -- 172.21.15.132:0/711842452 --> [v2:172.21.15.132:6816/84982,v1:172.21.15.132:6817/84982] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fad10072d90 con 0x7fad100702c0 2023-12-20T04:53:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.405+0000 7fad297fa640 1 -- 172.21.15.132:0/711842452 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=193) v2 ==== 24+0+0 (secure 0 0 0) 0x7fad24089ea0 con 0x7fad2c0b2ca0 2023-12-20T04:53:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.405+0000 7fad2bfff640 1 --2- 172.21.15.132:0/711842452 >> [v2:172.21.15.132:6816/84982,v1:172.21.15.132:6817/84982] conn(0x7fad100702c0 0x7fad100726e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.405+0000 7fad30f55640 1 --2- 172.21.15.132:0/711842452 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fad1006a460 0x7fad1006c920 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fad20007fd0 tx=0x7fad20009040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.405+0000 7fad2bfff640 1 --2- 172.21.15.132:0/711842452 >> [v2:172.21.15.132:6816/84982,v1:172.21.15.132:6817/84982] conn(0x7fad100702c0 0x7fad100726e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:49.415 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.406+0000 7fad297fa640 1 -- 172.21.15.132:0/711842452 <== osd.3 v2:172.21.15.132:6816/84982 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fad10072d90 con 0x7fad100702c0 2023-12-20T04:53:49.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.417+0000 7fad331b9640 1 -- 172.21.15.132:0/711842452 --> [v2:172.21.15.132:6816/84982,v1:172.21.15.132:6817/84982] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fad2c0d2610 con 0x7fad100702c0 2023-12-20T04:53:49.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.418+0000 7fad297fa640 1 -- 172.21.15.132:0/711842452 <== osd.3 v2:172.21.15.132:6816/84982 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7fad18000f70 con 0x7fad100702c0 2023-12-20T04:53:49.420 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:49.420 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-20T04:53:49.420 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.418+0000 7fad331b9640 1 -- 172.21.15.132:0/711842452 >> [v2:172.21.15.132:6816/84982,v1:172.21.15.132:6817/84982] conn(0x7fad100702c0 msgr2=0x7fad100726e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.418+0000 7fad331b9640 1 --2- 172.21.15.132:0/711842452 >> [v2:172.21.15.132:6816/84982,v1:172.21.15.132:6817/84982] conn(0x7fad100702c0 0x7fad100726e0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.418+0000 7fad331b9640 1 -- 172.21.15.132:0/711842452 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fad1006a460 msgr2=0x7fad1006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.418+0000 7fad331b9640 1 --2- 172.21.15.132:0/711842452 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fad1006a460 0x7fad1006c920 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7fad20007fd0 tx=0x7fad20009040 comp rx=0 tx=0).stop 2023-12-20T04:53:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.418+0000 7fad331b9640 1 -- 172.21.15.132:0/711842452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad2c0b2ca0 msgr2=0x7fad2c0b3120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.418+0000 7fad331b9640 1 --2- 172.21.15.132:0/711842452 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fad2c0b2ca0 0x7fad2c0b3120 secure :-1 s=READY pgs=1956 cs=0 l=1 rev1=1 crypto rx=0x7fad2c08c2a0 tx=0x7fad240115a0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.418+0000 7fad31756640 1 -- 172.21.15.132:0/711842452 reap_dead start 2023-12-20T04:53:49.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.418+0000 7fad331b9640 1 -- 172.21.15.132:0/711842452 shutdown_connections 2023-12-20T04:53:49.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.418+0000 7fad331b9640 1 -- 172.21.15.132:0/711842452 >> 172.21.15.132:0/711842452 conn(0x7fad2c06a3d0 msgr2=0x7fad2c0c9280 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:49.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.418+0000 7fad331b9640 1 -- 172.21.15.132:0/711842452 shutdown_connections 2023-12-20T04:53:49.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.418+0000 7fad331b9640 1 -- 172.21.15.132:0/711842452 wait complete. 2023-12-20T04:53:49.431 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2023-12-20T04:53:49.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.530+0000 7f085cdcb640 1 Processor -- start 2023-12-20T04:53:49.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.530+0000 7f085cdcb640 1 -- start start 2023-12-20T04:53:49.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085cdcb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b16b0 0x7f085806c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085cdcb640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f08580cb180 0x7f08580cb5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085cdcb640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f085815f3a0 con 0x7f085815aed0 2023-12-20T04:53:49.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085cdcb640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0858071c90 con 0x7f08580cb180 2023-12-20T04:53:49.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085cdcb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f085815eae0 con 0x7f08580b16b0 2023-12-20T04:53:49.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085659c640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f085815aed0 0x7f08580b0fa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47208/0 (socket says 172.21.15.132:47208) 2023-12-20T04:53:49.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085659c640 1 -- 172.21.15.132:0/3746956522 learned_addr learned my addr 172.21.15.132:0/3746956522 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:49.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085559a640 1 -- 172.21.15.132:0/3746956522 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 1095623213 0 0) 0x7f085815f3a0 con 0x7f085815aed0 2023-12-20T04:53:49.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f0855d9b640 1 --2- 172.21.15.132:0/3746956522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b16b0 0x7f085806c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085559a640 1 -- 172.21.15.132:0/3746956522 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f0840003520 con 0x7f085815aed0 2023-12-20T04:53:49.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f0856d9d640 1 --2- 172.21.15.132:0/3746956522 >> v2:172.21.15.187:3300/0 conn(0x7f08580cb180 0x7f08580cb5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085559a640 1 -- 172.21.15.132:0/3746956522 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3029546783 0 0) 0x7f0840003520 con 0x7f085815aed0 2023-12-20T04:53:49.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085559a640 1 -- 172.21.15.132:0/3746956522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b16b0 msgr2=0x7f085806c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:49.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085559a640 1 --2- 172.21.15.132:0/3746956522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b16b0 0x7f085806c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085559a640 1 -- 172.21.15.132:0/3746956522 >> v2:172.21.15.187:3300/0 conn(0x7f08580cb180 msgr2=0x7f08580cb5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:49.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085559a640 1 --2- 172.21.15.132:0/3746956522 >> v2:172.21.15.187:3300/0 conn(0x7f08580cb180 0x7f08580cb5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085559a640 1 -- 172.21.15.132:0/3746956522 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f085815ed50 con 0x7f085815aed0 2023-12-20T04:53:49.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085559a640 1 -- 172.21.15.132:0/3746956522 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f0848001670 con 0x7f085815aed0 2023-12-20T04:53:49.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085559a640 1 -- 172.21.15.132:0/3746956522 >> v1:172.21.15.132:6789/0 conn(0x7f085815aed0 legacy=0x7f08580b0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085559a640 1 --2- 172.21.15.132:0/3746956522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0840003970 0x7f0840003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085559a640 1 --2- 172.21.15.132:0/3746956522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08400047c0 0x7f0840004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085559a640 1 --2- 172.21.15.132:0/3746956522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b16b0 0x7f0840005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085559a640 1 -- 172.21.15.132:0/3746956522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0858071c90 con 0x7f08400047c0 2023-12-20T04:53:49.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085559a640 1 -- 172.21.15.132:0/3746956522 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085815eae0 con 0x7f0840003970 2023-12-20T04:53:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f085559a640 1 -- 172.21.15.132:0/3746956522 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f084000b980 con 0x7f08580b16b0 2023-12-20T04:53:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.531+0000 7f0855d9b640 1 --2- 172.21.15.132:0/3746956522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08400047c0 0x7f0840004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.532+0000 7f085659c640 1 --2- 172.21.15.132:0/3746956522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0840003970 0x7f0840003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.532+0000 7f0856d9d640 1 --2- 172.21.15.132:0/3746956522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b16b0 0x7f0840005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.532+0000 7f0855d9b640 1 -- 172.21.15.132:0/3746956522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b16b0 msgr2=0x7f0840005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.532+0000 7f0855d9b640 1 --2- 172.21.15.132:0/3746956522 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f08580b16b0 0x7f0840005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.532+0000 7f0855d9b640 1 -- 172.21.15.132:0/3746956522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0840003970 msgr2=0x7f0840003d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.532+0000 7f0855d9b640 1 --2- 172.21.15.132:0/3746956522 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f0840003970 0x7f0840003d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.532+0000 7f0855d9b640 1 -- 172.21.15.132:0/3746956522 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0840003520 con 0x7f08400047c0 2023-12-20T04:53:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.532+0000 7f0855d9b640 1 --2- 172.21.15.132:0/3746956522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08400047c0 0x7f0840004c40 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f084c009ac0 tx=0x7f08400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4486b19e3bd47e8f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.533+0000 7f085559a640 1 -- 172.21.15.132:0/3746956522 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c02c6b0 con 0x7f08400047c0 2023-12-20T04:53:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.533+0000 7f085559a640 1 -- 172.21.15.132:0/3746956522 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084c02c810 con 0x7f08400047c0 2023-12-20T04:53:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.533+0000 7f085559a640 1 -- 172.21.15.132:0/3746956522 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084c02cba0 con 0x7f08400047c0 2023-12-20T04:53:49.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.533+0000 7f085cdcb640 1 -- 172.21.15.132:0/3746956522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08400047c0 msgr2=0x7f0840004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.533+0000 7f085cdcb640 1 --2- 172.21.15.132:0/3746956522 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08400047c0 0x7f0840004c40 secure :-1 s=READY pgs=1958 cs=0 l=1 rev1=1 crypto rx=0x7f084c009ac0 tx=0x7f08400057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.533+0000 7f0856d9d640 1 -- 172.21.15.132:0/3746956522 reap_dead start 2023-12-20T04:53:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.533+0000 7f085cdcb640 1 -- 172.21.15.132:0/3746956522 shutdown_connections 2023-12-20T04:53:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.533+0000 7f085cdcb640 1 -- 172.21.15.132:0/3746956522 >> 172.21.15.132:0/3746956522 conn(0x7f085806a050 msgr2=0x7f085806a460 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.533+0000 7f085cdcb640 1 -- 172.21.15.132:0/3746956522 shutdown_connections 2023-12-20T04:53:49.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.533+0000 7f085cdcb640 1 -- 172.21.15.132:0/3746956522 wait complete. 2023-12-20T04:53:49.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.534+0000 7f085cdcb640 1 Processor -- start 2023-12-20T04:53:49.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.535+0000 7f085cdcb640 1 -- start start 2023-12-20T04:53:49.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.535+0000 7f085cdcb640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08400047c0 0x7f08581535f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.535+0000 7f085cdcb640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f085814e030 0x7f085814e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.535+0000 7f085cdcb640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f085814e9f0 0x7f08580cd580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.535+0000 7f085cdcb640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08581f24f0 con 0x7f08400047c0 2023-12-20T04:53:49.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.535+0000 7f085cdcb640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f085814ee70 con 0x7f085814e030 2023-12-20T04:53:49.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.535+0000 7f085cdcb640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0858156470 con 0x7f085814e9f0 2023-12-20T04:53:49.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.535+0000 7f085659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08400047c0 0x7f08581535f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.535+0000 7f085659c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08400047c0 0x7f08581535f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56360/0 (socket says 172.21.15.132:56360) 2023-12-20T04:53:49.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.535+0000 7f085659c640 1 -- 172.21.15.132:0/2076414730 learned_addr learned my addr 172.21.15.132:0/2076414730 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:49.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.536+0000 7f0855d9b640 1 --2- 172.21.15.132:0/2076414730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f085814e030 0x7f085814e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.536+0000 7f0856d9d640 1 --2- 172.21.15.132:0/2076414730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f085814e9f0 0x7f08580cd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.542 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.536+0000 7f085659c640 1 -- 172.21.15.132:0/2076414730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f085814e9f0 msgr2=0x7f08580cd580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.536+0000 7f085659c640 1 --2- 172.21.15.132:0/2076414730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f085814e9f0 0x7f08580cd580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.536+0000 7f085659c640 1 -- 172.21.15.132:0/2076414730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f085814e030 msgr2=0x7f085814e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.536+0000 7f085659c640 1 --2- 172.21.15.132:0/2076414730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f085814e030 0x7f085814e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.536+0000 7f085659c640 1 -- 172.21.15.132:0/2076414730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0858156750 con 0x7f08400047c0 2023-12-20T04:53:49.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.536+0000 7f085659c640 1 --2- 172.21.15.132:0/2076414730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08400047c0 0x7f08581535f0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f0848007310 tx=0x7f08480077d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:49.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.536+0000 7f0846ffd640 1 -- 172.21.15.132:0/2076414730 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084800f940 con 0x7f08400047c0 2023-12-20T04:53:49.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.536+0000 7f0846ffd640 1 -- 172.21.15.132:0/2076414730 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f084800fac0 con 0x7f08400047c0 2023-12-20T04:53:49.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.536+0000 7f085cdcb640 1 -- 172.21.15.132:0/2076414730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08580ccd80 con 0x7f08400047c0 2023-12-20T04:53:49.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.536+0000 7f0846ffd640 1 -- 172.21.15.132:0/2076414730 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f084800fe70 con 0x7f08400047c0 2023-12-20T04:53:49.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.536+0000 7f085cdcb640 1 -- 172.21.15.132:0/2076414730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f08581587e0 con 0x7f08400047c0 2023-12-20T04:53:49.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.537+0000 7f085cdcb640 1 -- 172.21.15.132:0/2076414730 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0858158970 con 0x7f08400047c0 2023-12-20T04:53:49.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.537+0000 7f0846ffd640 1 -- 172.21.15.132:0/2076414730 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f084801c410 con 0x7f08400047c0 2023-12-20T04:53:49.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.538+0000 7f0846ffd640 1 --2- 172.21.15.132:0/2076414730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f083806a460 0x7f083806c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.543 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.538+0000 7f0846ffd640 1 -- 172.21.15.132:0/2076414730 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0848088480 con 0x7f08400047c0 2023-12-20T04:53:49.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.538+0000 7f0855d9b640 1 --2- 172.21.15.132:0/2076414730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f083806a460 0x7f083806c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.538+0000 7f0855d9b640 1 --2- 172.21.15.132:0/2076414730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f083806a460 0x7f083806c920 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f084c036000 tx=0x7f084c030000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:49.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.542+0000 7f0846ffd640 1 -- 172.21.15.132:0/2076414730 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0848053d70 con 0x7f08400047c0 2023-12-20T04:53:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.709+0000 7f085cdcb640 1 -- 172.21.15.132:0/2076414730 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) v1 -- 0x7f085815b2b0 con 0x7f083806a460 2023-12-20T04:53:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.709+0000 7f0846ffd640 1 -- 172.21.15.132:0/2076414730 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f084c004020 con 0x7f083806a460 2023-12-20T04:53:49.711 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 3 to deep-scrub 2023-12-20T04:53:49.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.711+0000 7f085cdcb640 1 -- 172.21.15.132:0/2076414730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f083806a460 msgr2=0x7f083806c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.713 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.711+0000 7f085cdcb640 1 --2- 172.21.15.132:0/2076414730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f083806a460 0x7f083806c920 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f084c036000 tx=0x7f084c030000 comp rx=0 tx=0).stop 2023-12-20T04:53:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.711+0000 7f085cdcb640 1 -- 172.21.15.132:0/2076414730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08400047c0 msgr2=0x7f08581535f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.711+0000 7f085cdcb640 1 --2- 172.21.15.132:0/2076414730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08400047c0 0x7f08581535f0 secure :-1 s=READY pgs=1959 cs=0 l=1 rev1=1 crypto rx=0x7f0848007310 tx=0x7f08480077d0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.711+0000 7f085cdcb640 1 -- 172.21.15.132:0/2076414730 shutdown_connections 2023-12-20T04:53:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.711+0000 7f085cdcb640 1 --2- 172.21.15.132:0/2076414730 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f083806a460 0x7f083806c920 unknown :-1 s=CLOSED pgs=818 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.711+0000 7f085cdcb640 1 --2- 172.21.15.132:0/2076414730 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f085814e9f0 0x7f08580cd580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.711+0000 7f085cdcb640 1 --2- 172.21.15.132:0/2076414730 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f085814e030 0x7f085814e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.711+0000 7f085cdcb640 1 --2- 172.21.15.132:0/2076414730 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f08400047c0 0x7f08581535f0 unknown :-1 s=CLOSED pgs=1959 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.711+0000 7f085cdcb640 1 -- 172.21.15.132:0/2076414730 >> 172.21.15.132:0/2076414730 conn(0x7f085806a050 msgr2=0x7f085815a230 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.711+0000 7f085cdcb640 1 -- 172.21.15.132:0/2076414730 shutdown_connections 2023-12-20T04:53:49.714 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.711+0000 7f085cdcb640 1 -- 172.21.15.132:0/2076414730 wait complete. 2023-12-20T04:53:49.724 INFO:tasks.ceph:Scrubbing osd.4 2023-12-20T04:53:49.724 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2023-12-20T04:53:49.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.826+0000 7fb2dfd39640 1 Processor -- start 2023-12-20T04:53:49.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.826+0000 7fb2dfd39640 1 -- start start 2023-12-20T04:53:49.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.827+0000 7fb2dfd39640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2d8159d20 0x7fb2d806fb40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.827+0000 7fb2dfd39640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb2d80ce590 0x7fb2d815dab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.829 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.827+0000 7fb2dfd39640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fb2d80c9a50 con 0x7fb2d80ce130 2023-12-20T04:53:49.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.827+0000 7fb2dfd39640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fb2d8070080 con 0x7fb2d80ce590 2023-12-20T04:53:49.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.827+0000 7fb2dfd39640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80c9860 con 0x7fb2d8159d20 2023-12-20T04:53:49.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.827+0000 7fb2de2d6640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fb2d80ce590 0x7fb2d815dab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.827+0000 7fb2dd2d4640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fb2d80ce130 0x7fb2d80cea20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47210/0 (socket says 172.21.15.132:47210) 2023-12-20T04:53:49.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.827+0000 7fb2dd2d4640 1 -- 172.21.15.132:0/1573936905 learned_addr learned my addr 172.21.15.132:0/1573936905 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:49.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.827+0000 7fb2ddad5640 1 --2- 172.21.15.132:0/1573936905 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2d8159d20 0x7fb2d806fb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.827+0000 7fb2de2d6640 1 -- 172.21.15.132:0/1573936905 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2d8159d20 msgr2=0x7fb2d806fb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:49.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.827+0000 7fb2de2d6640 1 --2- 172.21.15.132:0/1573936905 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2d8159d20 0x7fb2d806fb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.827+0000 7fb2de2d6640 1 -- 172.21.15.132:0/1573936905 >> v1:172.21.15.132:6789/0 conn(0x7fb2d80ce130 legacy=0x7fb2d80cea20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.827+0000 7fb2de2d6640 1 -- 172.21.15.132:0/1573936905 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d80c9d30 con 0x7fb2d80ce590 2023-12-20T04:53:49.830 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.827+0000 7fb2dcad3640 1 -- 172.21.15.132:0/1573936905 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2271939127 0 0) 0x7fb2d80c9a50 con 0x7fb2d80ce130 2023-12-20T04:53:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.828+0000 7fb2de2d6640 1 --2- 172.21.15.132:0/1573936905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2d80ce590 0x7fb2d815dab0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009d90 tx=0x7fb2d002bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=914c1963f0ffe37d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.828+0000 7fb2dcad3640 1 -- 172.21.15.132:0/1573936905 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d002cc50 con 0x7fb2d80ce590 2023-12-20T04:53:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.828+0000 7fb2dcad3640 1 -- 172.21.15.132:0/1573936905 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d002cdb0 con 0x7fb2d80ce590 2023-12-20T04:53:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.828+0000 7fb2dcad3640 1 -- 172.21.15.132:0/1573936905 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0034660 con 0x7fb2d80ce590 2023-12-20T04:53:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.828+0000 7fb2dfd39640 1 -- 172.21.15.132:0/1573936905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2d80ce590 msgr2=0x7fb2d815dab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.828+0000 7fb2dfd39640 1 --2- 172.21.15.132:0/1573936905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2d80ce590 0x7fb2d815dab0 secure :-1 s=READY pgs=1961 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009d90 tx=0x7fb2d002bea0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.828+0000 7fb2dfd39640 1 -- 172.21.15.132:0/1573936905 shutdown_connections 2023-12-20T04:53:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.828+0000 7fb2dfd39640 1 --2- 172.21.15.132:0/1573936905 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2d80ce590 0x7fb2d815dab0 unknown :-1 s=CLOSED pgs=1961 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.828+0000 7fb2dfd39640 1 --2- 172.21.15.132:0/1573936905 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2d8159d20 0x7fb2d806fb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.828+0000 7fb2dfd39640 1 -- 172.21.15.132:0/1573936905 >> 172.21.15.132:0/1573936905 conn(0x7fb2d80b05c0 msgr2=0x7fb2d80b09a0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:49.836 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.829+0000 7fb2dfd39640 1 -- 172.21.15.132:0/1573936905 shutdown_connections 2023-12-20T04:53:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.829+0000 7fb2dfd39640 1 -- 172.21.15.132:0/1573936905 wait complete. 2023-12-20T04:53:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.830+0000 7fb2dfd39640 1 Processor -- start 2023-12-20T04:53:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.830+0000 7fb2dfd39640 1 -- start start 2023-12-20T04:53:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.830+0000 7fb2dfd39640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2d80ce130 0x7fb2d814c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.830+0000 7fb2dfd39640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2d80ce590 0x7fb2d80b15b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.830+0000 7fb2dfd39640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2d8159d20 0x7fb2d80c3a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.830+0000 7fb2dfd39640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d814c6d0 con 0x7fb2d8159d20 2023-12-20T04:53:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.830+0000 7fb2dfd39640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80c2650 con 0x7fb2d80ce590 2023-12-20T04:53:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.830+0000 7fb2dfd39640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fb2d80b1af0 con 0x7fb2d80ce130 2023-12-20T04:53:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2de2d6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2d8159d20 0x7fb2d80c3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2de2d6640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2d8159d20 0x7fb2d80c3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56384/0 (socket says 172.21.15.132:56384) 2023-12-20T04:53:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2de2d6640 1 -- 172.21.15.132:0/3519089828 learned_addr learned my addr 172.21.15.132:0/3519089828 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2ddad5640 1 --2- 172.21.15.132:0/3519089828 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2d80ce130 0x7fb2d814c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.837 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2dd2d4640 1 --2- 172.21.15.132:0/3519089828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2d80ce590 0x7fb2d80b15b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2de2d6640 1 -- 172.21.15.132:0/3519089828 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2d80ce130 msgr2=0x7fb2d814c190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2de2d6640 1 --2- 172.21.15.132:0/3519089828 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2d80ce130 0x7fb2d814c190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2de2d6640 1 -- 172.21.15.132:0/3519089828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2d80ce590 msgr2=0x7fb2d80b15b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2de2d6640 1 --2- 172.21.15.132:0/3519089828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2d80ce590 0x7fb2d80b15b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2de2d6640 1 -- 172.21.15.132:0/3519089828 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb2d0009a70 con 0x7fb2d8159d20 2023-12-20T04:53:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2dd2d4640 1 --2- 172.21.15.132:0/3519089828 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fb2d80ce590 0x7fb2d80b15b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2ddad5640 1 --2- 172.21.15.132:0/3519089828 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fb2d80ce130 0x7fb2d814c190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2de2d6640 1 --2- 172.21.15.132:0/3519089828 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2d8159d20 0x7fb2d80c3a80 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009d90 tx=0x7fb2d0004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2ce7fc640 1 -- 172.21.15.132:0/3519089828 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0040650 con 0x7fb2d8159d20 2023-12-20T04:53:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2ce7fc640 1 -- 172.21.15.132:0/3519089828 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb2d00407d0 con 0x7fb2d8159d20 2023-12-20T04:53:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2dfd39640 1 -- 172.21.15.132:0/3519089828 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2d81f0960 con 0x7fb2d8159d20 2023-12-20T04:53:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2ce7fc640 1 -- 172.21.15.132:0/3519089828 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fb2d0040b80 con 0x7fb2d8159d20 2023-12-20T04:53:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.831+0000 7fb2dfd39640 1 -- 172.21.15.132:0/3519089828 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2d81f0f20 con 0x7fb2d8159d20 2023-12-20T04:53:49.838 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.832+0000 7fb2dfd39640 1 -- 172.21.15.132:0/3519089828 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fb2d80ca2f0 con 0x7fb2d8159d20 2023-12-20T04:53:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.833+0000 7fb2ce7fc640 1 -- 172.21.15.132:0/3519089828 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fb2d0040ce0 con 0x7fb2d8159d20 2023-12-20T04:53:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.833+0000 7fb2ce7fc640 1 --2- 172.21.15.132:0/3519089828 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb2bc06a430 0x7fb2bc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.833+0000 7fb2ce7fc640 1 -- 172.21.15.132:0/3519089828 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fb2d00ab490 con 0x7fb2d8159d20 2023-12-20T04:53:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.833+0000 7fb2ddad5640 1 --2- 172.21.15.132:0/3519089828 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb2bc06a430 0x7fb2bc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.833+0000 7fb2ce7fc640 1 --2- 172.21.15.132:0/3519089828 >> [v2:172.21.15.187:6800/84618,v1:172.21.15.187:6801/84618] conn(0x7fb2bc070290 0x7fb2bc0726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.833+0000 7fb2ce7fc640 1 -- 172.21.15.132:0/3519089828 --> [v2:172.21.15.187:6800/84618,v1:172.21.15.187:6801/84618] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fb2bc072d60 con 0x7fb2bc070290 2023-12-20T04:53:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.833+0000 7fb2ce7fc640 1 -- 172.21.15.132:0/3519089828 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=193) v2 ==== 24+0+0 (secure 0 0 0) 0x7fb2d00adb50 con 0x7fb2d8159d20 2023-12-20T04:53:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.833+0000 7fb2dd2d4640 1 --2- 172.21.15.132:0/3519089828 >> [v2:172.21.15.187:6800/84618,v1:172.21.15.187:6801/84618] conn(0x7fb2bc070290 0x7fb2bc0726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.833+0000 7fb2ddad5640 1 --2- 172.21.15.132:0/3519089828 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb2bc06a430 0x7fb2bc06c8f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4006fd0 tx=0x7fb2d4008040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:49.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.834+0000 7fb2dd2d4640 1 --2- 172.21.15.132:0/3519089828 >> [v2:172.21.15.187:6800/84618,v1:172.21.15.187:6801/84618] conn(0x7fb2bc070290 0x7fb2bc0726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:49.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.834+0000 7fb2ce7fc640 1 -- 172.21.15.132:0/3519089828 <== osd.4 v2:172.21.15.187:6800/84618 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fb2bc072d60 con 0x7fb2bc070290 2023-12-20T04:53:49.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.846+0000 7fb2dfd39640 1 -- 172.21.15.132:0/3519089828 --> [v2:172.21.15.187:6800/84618,v1:172.21.15.187:6801/84618] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fb2d80ca010 con 0x7fb2bc070290 2023-12-20T04:53:49.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.846+0000 7fb2ce7fc640 1 -- 172.21.15.132:0/3519089828 <== osd.4 v2:172.21.15.187:6800/84618 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7fb2c80047e0 con 0x7fb2bc070290 2023-12-20T04:53:49.849 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:49.849 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-20T04:53:49.849 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.847+0000 7fb2dfd39640 1 -- 172.21.15.132:0/3519089828 >> [v2:172.21.15.187:6800/84618,v1:172.21.15.187:6801/84618] conn(0x7fb2bc070290 msgr2=0x7fb2bc0726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.847+0000 7fb2dfd39640 1 --2- 172.21.15.132:0/3519089828 >> [v2:172.21.15.187:6800/84618,v1:172.21.15.187:6801/84618] conn(0x7fb2bc070290 0x7fb2bc0726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.847+0000 7fb2dfd39640 1 -- 172.21.15.132:0/3519089828 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb2bc06a430 msgr2=0x7fb2bc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.847+0000 7fb2dfd39640 1 --2- 172.21.15.132:0/3519089828 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fb2bc06a430 0x7fb2bc06c8f0 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7fb2d4006fd0 tx=0x7fb2d4008040 comp rx=0 tx=0).stop 2023-12-20T04:53:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.847+0000 7fb2dfd39640 1 -- 172.21.15.132:0/3519089828 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2d8159d20 msgr2=0x7fb2d80c3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.847+0000 7fb2dfd39640 1 --2- 172.21.15.132:0/3519089828 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fb2d8159d20 0x7fb2d80c3a80 secure :-1 s=READY pgs=1962 cs=0 l=1 rev1=1 crypto rx=0x7fb2d0009d90 tx=0x7fb2d0004a40 comp rx=0 tx=0).stop 2023-12-20T04:53:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.847+0000 7fb2de2d6640 1 -- 172.21.15.132:0/3519089828 reap_dead start 2023-12-20T04:53:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.847+0000 7fb2dfd39640 1 -- 172.21.15.132:0/3519089828 shutdown_connections 2023-12-20T04:53:49.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.847+0000 7fb2dfd39640 1 -- 172.21.15.132:0/3519089828 >> 172.21.15.132:0/3519089828 conn(0x7fb2d80b05c0 msgr2=0x7fb2d80cf2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.847+0000 7fb2dfd39640 1 -- 172.21.15.132:0/3519089828 shutdown_connections 2023-12-20T04:53:49.851 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.847+0000 7fb2dfd39640 1 -- 172.21.15.132:0/3519089828 wait complete. 2023-12-20T04:53:49.859 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2023-12-20T04:53:49.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.958+0000 7fea94f5c640 1 Processor -- start 2023-12-20T04:53:49.960 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.958+0000 7fea94f5c640 1 -- start start 2023-12-20T04:53:49.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.959+0000 7fea94f5c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fea9015d110 0x7fea90069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.959+0000 7fea94f5c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea90161ce0 con 0x7fea9015d4f0 2023-12-20T04:53:49.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.959+0000 7fea94f5c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fea900aca50 con 0x7fea900af210 2023-12-20T04:53:49.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.959+0000 7fea94f5c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fea90160df0 con 0x7fea9015d110 2023-12-20T04:53:49.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.959+0000 7fea8dd9b640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fea9015d4f0 0x7fea900aeb00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47218/0 (socket says 172.21.15.132:47218) 2023-12-20T04:53:49.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.959+0000 7fea8dd9b640 1 -- 172.21.15.132:0/826495720 learned_addr learned my addr 172.21.15.132:0/826495720 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:49.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.959+0000 7fea8d59a640 1 -- 172.21.15.132:0/826495720 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 2020780029 0 0) 0x7fea90161ce0 con 0x7fea9015d4f0 2023-12-20T04:53:49.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.959+0000 7fea8d59a640 1 -- 172.21.15.132:0/826495720 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fea78003520 con 0x7fea9015d4f0 2023-12-20T04:53:49.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.959+0000 7fea8e59c640 1 --2- 172.21.15.132:0/826495720 >> v2:172.21.15.187:3300/0 conn(0x7fea9015d110 0x7fea90069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.963 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8d59a640 1 -- 172.21.15.132:0/826495720 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 2314525421 0 0) 0x7fea78003520 con 0x7fea9015d4f0 2023-12-20T04:53:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8d59a640 1 -- 172.21.15.132:0/826495720 >> v2:172.21.15.187:3300/0 conn(0x7fea9015d110 msgr2=0x7fea90069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8d59a640 1 --2- 172.21.15.132:0/826495720 >> v2:172.21.15.187:3300/0 conn(0x7fea9015d110 0x7fea90069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8d59a640 1 -- 172.21.15.132:0/826495720 >> v1:172.21.15.187:6789/0 conn(0x7fea900af210 legacy=0x7fea900c4f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8d59a640 1 -- 172.21.15.132:0/826495720 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea901610d0 con 0x7fea9015d4f0 2023-12-20T04:53:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8d59a640 1 -- 172.21.15.132:0/826495720 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fea84001670 con 0x7fea9015d4f0 2023-12-20T04:53:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8d59a640 1 -- 172.21.15.132:0/826495720 >> v1:172.21.15.132:6789/0 conn(0x7fea9015d4f0 legacy=0x7fea900aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8d59a640 1 --2- 172.21.15.132:0/826495720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea78003970 0x7fea78003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8d59a640 1 --2- 172.21.15.132:0/826495720 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea780047c0 0x7fea78004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8d59a640 1 --2- 172.21.15.132:0/826495720 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea78005180 0x7fea7800b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8d59a640 1 -- 172.21.15.132:0/826495720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea90160df0 con 0x7fea78003970 2023-12-20T04:53:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8d59a640 1 -- 172.21.15.132:0/826495720 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea7800c020 con 0x7fea78005180 2023-12-20T04:53:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8d59a640 1 -- 172.21.15.132:0/826495720 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea7800c1e0 con 0x7fea780047c0 2023-12-20T04:53:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8e59c640 1 --2- 172.21.15.132:0/826495720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea78003970 0x7fea78003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.964 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8dd9b640 1 --2- 172.21.15.132:0/826495720 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea780047c0 0x7fea78004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8ed9d640 1 --2- 172.21.15.132:0/826495720 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea78005180 0x7fea7800b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8e59c640 1 -- 172.21.15.132:0/826495720 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea780047c0 msgr2=0x7fea78004c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:49.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8e59c640 1 --2- 172.21.15.132:0/826495720 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea780047c0 0x7fea78004c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8e59c640 1 -- 172.21.15.132:0/826495720 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea78005180 msgr2=0x7fea7800b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:49.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8e59c640 1 --2- 172.21.15.132:0/826495720 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea78005180 0x7fea7800b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8e59c640 1 -- 172.21.15.132:0/826495720 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea78003520 con 0x7fea78003970 2023-12-20T04:53:49.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.960+0000 7fea8ed9d640 1 -- 172.21.15.132:0/826495720 reap_dead start 2023-12-20T04:53:49.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.961+0000 7fea8e59c640 1 --2- 172.21.15.132:0/826495720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea78003970 0x7fea78003d90 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7fea8000e170 tx=0x7fea780057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=684b1faa16ecd85d server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:49.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.961+0000 7fea8d59a640 1 -- 172.21.15.132:0/826495720 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea8002cc60 con 0x7fea78003970 2023-12-20T04:53:49.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.961+0000 7fea8d59a640 1 -- 172.21.15.132:0/826495720 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea8000f040 con 0x7fea78003970 2023-12-20T04:53:49.965 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.961+0000 7fea8d59a640 1 -- 172.21.15.132:0/826495720 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea80034440 con 0x7fea78003970 2023-12-20T04:53:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.961+0000 7fea94f5c640 1 -- 172.21.15.132:0/826495720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea78003970 msgr2=0x7fea78003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.961+0000 7fea94f5c640 1 --2- 172.21.15.132:0/826495720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea78003970 0x7fea78003d90 secure :-1 s=READY pgs=1964 cs=0 l=1 rev1=1 crypto rx=0x7fea8000e170 tx=0x7fea780057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.962+0000 7fea94f5c640 1 -- 172.21.15.132:0/826495720 shutdown_connections 2023-12-20T04:53:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.962+0000 7fea94f5c640 1 --2- 172.21.15.132:0/826495720 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea78003970 0x7fea78003d90 unknown :-1 s=CLOSED pgs=1964 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.962+0000 7fea94f5c640 1 -- 172.21.15.132:0/826495720 >> 172.21.15.132:0/826495720 conn(0x7fea900cfbd0 msgr2=0x7fea900cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.962+0000 7fea94f5c640 1 -- 172.21.15.132:0/826495720 shutdown_connections 2023-12-20T04:53:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.962+0000 7fea94f5c640 1 -- 172.21.15.132:0/826495720 wait complete. 2023-12-20T04:53:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.963+0000 7fea94f5c640 1 Processor -- start 2023-12-20T04:53:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.963+0000 7fea94f5c640 1 -- start start 2023-12-20T04:53:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea94f5c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea78003970 0x7fea9015d8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea94f5c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea90159710 0x7fea90159b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.969 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea94f5c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea9006deb0 0x7fea9006e330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea94f5c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9006cbc0 con 0x7fea9006deb0 2023-12-20T04:53:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea94f5c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea9006ce10 con 0x7fea90159710 2023-12-20T04:53:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea94f5c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fea9006d0f0 con 0x7fea78003970 2023-12-20T04:53:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea8ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea9006deb0 0x7fea9006e330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea8ed9d640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea9006deb0 0x7fea9006e330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56406/0 (socket says 172.21.15.132:56406) 2023-12-20T04:53:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea8ed9d640 1 -- 172.21.15.132:0/2202006881 learned_addr learned my addr 172.21.15.132:0/2202006881 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea8e59c640 1 --2- 172.21.15.132:0/2202006881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea78003970 0x7fea9015d8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea8dd9b640 1 --2- 172.21.15.132:0/2202006881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea90159710 0x7fea90159b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea8ed9d640 1 -- 172.21.15.132:0/2202006881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea78003970 msgr2=0x7fea9015d8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea8ed9d640 1 --2- 172.21.15.132:0/2202006881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea78003970 0x7fea9015d8f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea8ed9d640 1 -- 172.21.15.132:0/2202006881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea90159710 msgr2=0x7fea90159b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea8ed9d640 1 --2- 172.21.15.132:0/2202006881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea90159710 0x7fea90159b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:49.970 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea8ed9d640 1 -- 172.21.15.132:0/2202006881 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea9006d3d0 con 0x7fea9006deb0 2023-12-20T04:53:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea8ed9d640 1 --2- 172.21.15.132:0/2202006881 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea9006deb0 0x7fea9006e330 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fea9006a970 tx=0x7fea8800e5f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea7effd640 1 -- 172.21.15.132:0/2202006881 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea88005110 con 0x7fea9006deb0 2023-12-20T04:53:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea7effd640 1 -- 172.21.15.132:0/2202006881 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fea88005290 con 0x7fea9006deb0 2023-12-20T04:53:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea94f5c640 1 -- 172.21.15.132:0/2202006881 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea9006d6b0 con 0x7fea9006deb0 2023-12-20T04:53:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea7effd640 1 -- 172.21.15.132:0/2202006881 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fea88007030 con 0x7fea9006deb0 2023-12-20T04:53:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.964+0000 7fea94f5c640 1 -- 172.21.15.132:0/2202006881 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea9014e060 con 0x7fea9006deb0 2023-12-20T04:53:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.965+0000 7fea94f5c640 1 -- 172.21.15.132:0/2202006881 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea9006dbd0 con 0x7fea9006deb0 2023-12-20T04:53:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.966+0000 7fea7effd640 1 -- 172.21.15.132:0/2202006881 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fea880071b0 con 0x7fea9006deb0 2023-12-20T04:53:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.966+0000 7fea7effd640 1 --2- 172.21.15.132:0/2202006881 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fea7006a460 0x7fea7006c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.966+0000 7fea7effd640 1 -- 172.21.15.132:0/2202006881 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fea88087800 con 0x7fea9006deb0 2023-12-20T04:53:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.966+0000 7fea8e59c640 1 --2- 172.21.15.132:0/2202006881 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fea7006a460 0x7fea7006c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:49.971 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.967+0000 7fea8e59c640 1 --2- 172.21.15.132:0/2202006881 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fea7006a460 0x7fea7006c920 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fea80036000 tx=0x7fea8002e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:49.972 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:49.971+0000 7fea7effd640 1 -- 172.21.15.132:0/2202006881 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fea9006dbd0 con 0x7fea9006deb0 2023-12-20T04:53:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.139+0000 7fea94f5c640 1 -- 172.21.15.132:0/2202006881 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fea90161690 con 0x7fea7006a460 2023-12-20T04:53:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.139+0000 7fea7effd640 1 -- 172.21.15.132:0/2202006881 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fea8002ce50 con 0x7fea7006a460 2023-12-20T04:53:50.141 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 4 to deep-scrub 2023-12-20T04:53:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.141+0000 7fea94f5c640 1 -- 172.21.15.132:0/2202006881 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fea7006a460 msgr2=0x7fea7006c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.141+0000 7fea94f5c640 1 --2- 172.21.15.132:0/2202006881 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fea7006a460 0x7fea7006c920 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7fea80036000 tx=0x7fea8002e000 comp rx=0 tx=0).stop 2023-12-20T04:53:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.141+0000 7fea94f5c640 1 -- 172.21.15.132:0/2202006881 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea9006deb0 msgr2=0x7fea9006e330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.141+0000 7fea94f5c640 1 --2- 172.21.15.132:0/2202006881 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea9006deb0 0x7fea9006e330 secure :-1 s=READY pgs=1965 cs=0 l=1 rev1=1 crypto rx=0x7fea9006a970 tx=0x7fea8800e5f0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.141+0000 7fea94f5c640 1 -- 172.21.15.132:0/2202006881 shutdown_connections 2023-12-20T04:53:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.141+0000 7fea94f5c640 1 --2- 172.21.15.132:0/2202006881 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fea7006a460 0x7fea7006c920 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.141+0000 7fea94f5c640 1 --2- 172.21.15.132:0/2202006881 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fea9006deb0 0x7fea9006e330 unknown :-1 s=CLOSED pgs=1965 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.141+0000 7fea94f5c640 1 --2- 172.21.15.132:0/2202006881 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fea90159710 0x7fea90159b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.141+0000 7fea94f5c640 1 --2- 172.21.15.132:0/2202006881 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fea78003970 0x7fea9015d8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.141+0000 7fea94f5c640 1 -- 172.21.15.132:0/2202006881 >> 172.21.15.132:0/2202006881 conn(0x7fea900cfbd0 msgr2=0x7fea900ca390 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.141+0000 7fea94f5c640 1 -- 172.21.15.132:0/2202006881 shutdown_connections 2023-12-20T04:53:50.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.141+0000 7fea94f5c640 1 -- 172.21.15.132:0/2202006881 wait complete. 2023-12-20T04:53:50.154 INFO:tasks.ceph:Scrubbing osd.5 2023-12-20T04:53:50.155 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2023-12-20T04:53:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.257+0000 7fde59270640 1 Processor -- start 2023-12-20T04:53:50.259 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.257+0000 7fde59270640 1 -- start start 2023-12-20T04:53:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.257+0000 7fde59270640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fde5415d300 0x7fde540d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.261 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.257+0000 7fde59270640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde540d1a90 con 0x7fde540d1550 2023-12-20T04:53:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.257+0000 7fde59270640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fde540d1d70 con 0x7fde540cff90 2023-12-20T04:53:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.257+0000 7fde59270640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fde540d2050 con 0x7fde5415d300 2023-12-20T04:53:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde4bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7fde540d1550 0x7fde540cf880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47224/0 (socket says 172.21.15.132:47224) 2023-12-20T04:53:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde4bfff640 1 -- 172.21.15.132:0/2113969354 learned_addr learned my addr 172.21.15.132:0/2113969354 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde527fc640 1 -- 172.21.15.132:0/2113969354 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4080430460 0 0) 0x7fde540d1a90 con 0x7fde540d1550 2023-12-20T04:53:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde52ffd640 1 --2- 172.21.15.132:0/2113969354 >> v2:172.21.15.187:3300/0 conn(0x7fde5415d300 0x7fde540d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde527fc640 1 -- 172.21.15.132:0/2113969354 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7fde40003520 con 0x7fde540d1550 2023-12-20T04:53:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde527fc640 1 -- 172.21.15.132:0/2113969354 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 151330501 0 0) 0x7fde40003520 con 0x7fde540d1550 2023-12-20T04:53:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde527fc640 1 -- 172.21.15.132:0/2113969354 >> v2:172.21.15.187:3300/0 conn(0x7fde5415d300 msgr2=0x7fde540d1010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde527fc640 1 --2- 172.21.15.132:0/2113969354 >> v2:172.21.15.187:3300/0 conn(0x7fde5415d300 0x7fde540d1010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde527fc640 1 -- 172.21.15.132:0/2113969354 >> v1:172.21.15.187:6789/0 conn(0x7fde540cff90 legacy=0x7fde540b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde527fc640 1 -- 172.21.15.132:0/2113969354 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde540d2330 con 0x7fde540d1550 2023-12-20T04:53:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde527fc640 1 -- 172.21.15.132:0/2113969354 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7fde3c0017f0 con 0x7fde540d1550 2023-12-20T04:53:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde527fc640 1 -- 172.21.15.132:0/2113969354 >> v1:172.21.15.132:6789/0 conn(0x7fde540d1550 legacy=0x7fde540cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.262 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde527fc640 1 --2- 172.21.15.132:0/2113969354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde400039c0 0x7fde40003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde527fc640 1 --2- 172.21.15.132:0/2113969354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde400047c0 0x7fde40004c40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde527fc640 1 --2- 172.21.15.132:0/2113969354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde40005180 0x7fde4000b980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde527fc640 1 -- 172.21.15.132:0/2113969354 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde540d2050 con 0x7fde400047c0 2023-12-20T04:53:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde527fc640 1 -- 172.21.15.132:0/2113969354 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde4000c080 con 0x7fde400039c0 2023-12-20T04:53:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde527fc640 1 -- 172.21.15.132:0/2113969354 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde4000c240 con 0x7fde40005180 2023-12-20T04:53:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde4bfff640 1 --2- 172.21.15.132:0/2113969354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde400047c0 0x7fde40004c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde52ffd640 1 --2- 172.21.15.132:0/2113969354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde400039c0 0x7fde40003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.258+0000 7fde537fe640 1 --2- 172.21.15.132:0/2113969354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde40005180 0x7fde4000b980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.259+0000 7fde4bfff640 1 -- 172.21.15.132:0/2113969354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde40005180 msgr2=0x7fde4000b980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.259+0000 7fde4bfff640 1 --2- 172.21.15.132:0/2113969354 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde40005180 0x7fde4000b980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.259+0000 7fde4bfff640 1 -- 172.21.15.132:0/2113969354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde400039c0 msgr2=0x7fde40003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.259+0000 7fde4bfff640 1 --2- 172.21.15.132:0/2113969354 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde400039c0 0x7fde40003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.259+0000 7fde4bfff640 1 -- 172.21.15.132:0/2113969354 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde40003520 con 0x7fde400047c0 2023-12-20T04:53:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.259+0000 7fde537fe640 1 -- 172.21.15.132:0/2113969354 reap_dead start 2023-12-20T04:53:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.259+0000 7fde4bfff640 1 --2- 172.21.15.132:0/2113969354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde400047c0 0x7fde40004c40 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fde3c007fb0 tx=0x7fde400057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c9206e37bbcc738 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:50.263 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.259+0000 7fde527fc640 1 -- 172.21.15.132:0/2113969354 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c007270 con 0x7fde400047c0 2023-12-20T04:53:50.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.259+0000 7fde527fc640 1 -- 172.21.15.132:0/2113969354 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde3c0073d0 con 0x7fde400047c0 2023-12-20T04:53:50.264 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.259+0000 7fde527fc640 1 -- 172.21.15.132:0/2113969354 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde3c02c7c0 con 0x7fde400047c0 2023-12-20T04:53:50.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.260+0000 7fde59270640 1 -- 172.21.15.132:0/2113969354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde400047c0 msgr2=0x7fde40004c40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.260+0000 7fde59270640 1 --2- 172.21.15.132:0/2113969354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde400047c0 0x7fde40004c40 secure :-1 s=READY pgs=1967 cs=0 l=1 rev1=1 crypto rx=0x7fde3c007fb0 tx=0x7fde400057f0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.260+0000 7fde59270640 1 -- 172.21.15.132:0/2113969354 shutdown_connections 2023-12-20T04:53:50.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.260+0000 7fde59270640 1 --2- 172.21.15.132:0/2113969354 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde400047c0 0x7fde40004c40 unknown :-1 s=CLOSED pgs=1967 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.260+0000 7fde59270640 1 -- 172.21.15.132:0/2113969354 >> 172.21.15.132:0/2113969354 conn(0x7fde5406a3d0 msgr2=0x7fde5406a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:50.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.260+0000 7fde59270640 1 -- 172.21.15.132:0/2113969354 shutdown_connections 2023-12-20T04:53:50.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.260+0000 7fde59270640 1 -- 172.21.15.132:0/2113969354 wait complete. 2023-12-20T04:53:50.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.261+0000 7fde59270640 1 Processor -- start 2023-12-20T04:53:50.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.261+0000 7fde59270640 1 -- start start 2023-12-20T04:53:50.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.262+0000 7fde59270640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde400047c0 0x7fde5415bca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.262+0000 7fde59270640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde540b4a70 0x7fde540b4ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.267 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.262+0000 7fde59270640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde540c7700 0x7fde540c7b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.262+0000 7fde59270640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde540b5430 con 0x7fde540c7700 2023-12-20T04:53:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.262+0000 7fde59270640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fde540c80c0 con 0x7fde400047c0 2023-12-20T04:53:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.262+0000 7fde59270640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fde540b3cf0 con 0x7fde540b4a70 2023-12-20T04:53:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.262+0000 7fde537fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde540c7700 0x7fde540c7b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.262+0000 7fde537fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde540c7700 0x7fde540c7b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56410/0 (socket says 172.21.15.132:56410) 2023-12-20T04:53:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.262+0000 7fde537fe640 1 -- 172.21.15.132:0/3233071908 learned_addr learned my addr 172.21.15.132:0/3233071908 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.262+0000 7fde537fe640 1 -- 172.21.15.132:0/3233071908 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde540b4a70 msgr2=0x7fde540b4ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.262+0000 7fde537fe640 1 --2- 172.21.15.132:0/3233071908 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fde540b4a70 0x7fde540b4ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.262+0000 7fde537fe640 1 -- 172.21.15.132:0/3233071908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde400047c0 msgr2=0x7fde5415bca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.262+0000 7fde537fe640 1 --2- 172.21.15.132:0/3233071908 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fde400047c0 0x7fde5415bca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.262+0000 7fde537fe640 1 -- 172.21.15.132:0/3233071908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fde540b37c0 con 0x7fde540c7700 2023-12-20T04:53:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.262+0000 7fde537fe640 1 --2- 172.21.15.132:0/3233071908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde540c7700 0x7fde540c7b80 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7fde4c007fd0 tx=0x7fde4c00eb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.263+0000 7fde4b7fe640 1 -- 172.21.15.132:0/3233071908 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c00eed0 con 0x7fde540c7700 2023-12-20T04:53:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.263+0000 7fde4b7fe640 1 -- 172.21.15.132:0/3233071908 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fde4c003970 con 0x7fde540c7700 2023-12-20T04:53:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.263+0000 7fde59270640 1 -- 172.21.15.132:0/3233071908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fde540b3f90 con 0x7fde540c7700 2023-12-20T04:53:50.268 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.263+0000 7fde4b7fe640 1 -- 172.21.15.132:0/3233071908 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fde4c003d00 con 0x7fde540c7700 2023-12-20T04:53:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.263+0000 7fde59270640 1 -- 172.21.15.132:0/3233071908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fde540b4550 con 0x7fde540c7700 2023-12-20T04:53:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.263+0000 7fde59270640 1 -- 172.21.15.132:0/3233071908 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fde540cd8f0 con 0x7fde540c7700 2023-12-20T04:53:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.264+0000 7fde4b7fe640 1 -- 172.21.15.132:0/3233071908 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fde4c0050d0 con 0x7fde540c7700 2023-12-20T04:53:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.264+0000 7fde4b7fe640 1 --2- 172.21.15.132:0/3233071908 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fde3406a460 0x7fde3406c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.264+0000 7fde4b7fe640 1 -- 172.21.15.132:0/3233071908 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fde4c0882d0 con 0x7fde540c7700 2023-12-20T04:53:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.264+0000 7fde52ffd640 1 --2- 172.21.15.132:0/3233071908 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fde3406a460 0x7fde3406c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.264+0000 7fde4b7fe640 1 --2- 172.21.15.132:0/3233071908 >> [v2:172.21.15.187:6803/84620,v1:172.21.15.187:6805/84620] conn(0x7fde34070150 0x7fde34072570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.264+0000 7fde4b7fe640 1 -- 172.21.15.132:0/3233071908 --> [v2:172.21.15.187:6803/84620,v1:172.21.15.187:6805/84620] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fde34072c20 con 0x7fde34070150 2023-12-20T04:53:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.264+0000 7fde4b7fe640 1 -- 172.21.15.132:0/3233071908 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=193) v2 ==== 24+0+0 (secure 0 0 0) 0x7fde4c08a990 con 0x7fde540c7700 2023-12-20T04:53:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.265+0000 7fde4bfff640 1 --2- 172.21.15.132:0/3233071908 >> [v2:172.21.15.187:6803/84620,v1:172.21.15.187:6805/84620] conn(0x7fde34070150 0x7fde34072570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.265+0000 7fde52ffd640 1 --2- 172.21.15.132:0/3233071908 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fde3406a460 0x7fde3406c920 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fde44006e80 tx=0x7fde44006df0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:50.269 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.265+0000 7fde4bfff640 1 --2- 172.21.15.132:0/3233071908 >> [v2:172.21.15.187:6803/84620,v1:172.21.15.187:6805/84620] conn(0x7fde34070150 0x7fde34072570 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:50.270 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.266+0000 7fde4b7fe640 1 -- 172.21.15.132:0/3233071908 <== osd.5 v2:172.21.15.187:6803/84620 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7fde34072c20 con 0x7fde34070150 2023-12-20T04:53:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.277+0000 7fde59270640 1 -- 172.21.15.132:0/3233071908 --> [v2:172.21.15.187:6803/84620,v1:172.21.15.187:6805/84620] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7fde540d2610 con 0x7fde34070150 2023-12-20T04:53:50.279 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.278+0000 7fde4b7fe640 1 -- 172.21.15.132:0/3233071908 <== osd.5 v2:172.21.15.187:6803/84620 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7fde3c000f70 con 0x7fde34070150 2023-12-20T04:53:50.280 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:50.280 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-20T04:53:50.280 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.278+0000 7fde59270640 1 -- 172.21.15.132:0/3233071908 >> [v2:172.21.15.187:6803/84620,v1:172.21.15.187:6805/84620] conn(0x7fde34070150 msgr2=0x7fde34072570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.278+0000 7fde59270640 1 --2- 172.21.15.132:0/3233071908 >> [v2:172.21.15.187:6803/84620,v1:172.21.15.187:6805/84620] conn(0x7fde34070150 0x7fde34072570 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.278+0000 7fde59270640 1 -- 172.21.15.132:0/3233071908 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fde3406a460 msgr2=0x7fde3406c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.278+0000 7fde59270640 1 --2- 172.21.15.132:0/3233071908 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fde3406a460 0x7fde3406c920 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7fde44006e80 tx=0x7fde44006df0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.278+0000 7fde59270640 1 -- 172.21.15.132:0/3233071908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde540c7700 msgr2=0x7fde540c7b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.278+0000 7fde59270640 1 --2- 172.21.15.132:0/3233071908 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fde540c7700 0x7fde540c7b80 secure :-1 s=READY pgs=1968 cs=0 l=1 rev1=1 crypto rx=0x7fde4c007fd0 tx=0x7fde4c00eb90 comp rx=0 tx=0).stop 2023-12-20T04:53:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.278+0000 7fde537fe640 1 -- 172.21.15.132:0/3233071908 reap_dead start 2023-12-20T04:53:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.278+0000 7fde59270640 1 -- 172.21.15.132:0/3233071908 shutdown_connections 2023-12-20T04:53:50.281 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.278+0000 7fde59270640 1 -- 172.21.15.132:0/3233071908 >> 172.21.15.132:0/3233071908 conn(0x7fde5406a3d0 msgr2=0x7fde54151ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.278+0000 7fde59270640 1 -- 172.21.15.132:0/3233071908 shutdown_connections 2023-12-20T04:53:50.282 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.278+0000 7fde59270640 1 -- 172.21.15.132:0/3233071908 wait complete. 2023-12-20T04:53:50.290 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2023-12-20T04:53:50.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.389+0000 7f013f3d2640 1 Processor -- start 2023-12-20T04:53:50.391 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.389+0000 7f013f3d2640 1 -- start start 2023-12-20T04:53:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.390+0000 7f013f3d2640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f013815d110 0x7f0138069de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.390+0000 7f013f3d2640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f01380af210 0x7f013806a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.390+0000 7f013f3d2640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f0138161ce0 con 0x7f013815d4f0 2023-12-20T04:53:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.390+0000 7f013f3d2640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f01380aca50 con 0x7f01380af210 2023-12-20T04:53:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.390+0000 7f013f3d2640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0138160df0 con 0x7f013815d110 2023-12-20T04:53:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.390+0000 7f013d96f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f01380af210 0x7f013806a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.390+0000 7f013d96f640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f01380af210 0x7f013806a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56412/0 (socket says 172.21.15.132:56412) 2023-12-20T04:53:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.390+0000 7f013d96f640 1 -- 172.21.15.132:0/3962993101 learned_addr learned my addr 172.21.15.132:0/3962993101 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.390+0000 7f013d16e640 1 --2- 172.21.15.132:0/3962993101 >> v2:172.21.15.187:3300/0 conn(0x7f013815d110 0x7f0138069de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.390+0000 7f013d96f640 1 -- 172.21.15.132:0/3962993101 >> v2:172.21.15.187:3300/0 conn(0x7f013815d110 msgr2=0x7f0138069de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.390+0000 7f013d96f640 1 --2- 172.21.15.132:0/3962993101 >> v2:172.21.15.187:3300/0 conn(0x7f013815d110 0x7f0138069de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.393 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.390+0000 7f013d96f640 1 -- 172.21.15.132:0/3962993101 >> v1:172.21.15.187:6789/0 conn(0x7f013815d4f0 legacy=0x7f01380aeb00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.394 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.390+0000 7f013d96f640 1 -- 172.21.15.132:0/3962993101 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01381610d0 con 0x7f01380af210 2023-12-20T04:53:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.391+0000 7f013d96f640 1 --2- 172.21.15.132:0/3962993101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01380af210 0x7f013806a320 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f01380c62b0 tx=0x7f013002b9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8ab9523deea9d9c3 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.391+0000 7f012ffff640 1 -- 172.21.15.132:0/3962993101 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130030860 con 0x7f01380af210 2023-12-20T04:53:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.391+0000 7f012ffff640 1 -- 172.21.15.132:0/3962993101 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f01300309c0 con 0x7f01380af210 2023-12-20T04:53:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.391+0000 7f012ffff640 1 -- 172.21.15.132:0/3962993101 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130030d50 con 0x7f01380af210 2023-12-20T04:53:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.392+0000 7f013f3d2640 1 -- 172.21.15.132:0/3962993101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01380af210 msgr2=0x7f013806a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.392+0000 7f013f3d2640 1 --2- 172.21.15.132:0/3962993101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01380af210 0x7f013806a320 secure :-1 s=READY pgs=1969 cs=0 l=1 rev1=1 crypto rx=0x7f01380c62b0 tx=0x7f013002b9a0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.392+0000 7f013f3d2640 1 -- 172.21.15.132:0/3962993101 shutdown_connections 2023-12-20T04:53:50.395 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.392+0000 7f013f3d2640 1 --2- 172.21.15.132:0/3962993101 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f01380af210 0x7f013806a320 unknown :-1 s=CLOSED pgs=1969 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.392+0000 7f013f3d2640 1 --2- 172.21.15.132:0/3962993101 >> v2:172.21.15.187:3300/0 conn(0x7f013815d110 0x7f0138069de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.392+0000 7f013f3d2640 1 -- 172.21.15.132:0/3962993101 >> 172.21.15.132:0/3962993101 conn(0x7f01380cfbd0 msgr2=0x7f01380cffb0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:50.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.392+0000 7f013f3d2640 1 -- 172.21.15.132:0/3962993101 shutdown_connections 2023-12-20T04:53:50.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.392+0000 7f013f3d2640 1 -- 172.21.15.132:0/3962993101 wait complete. 2023-12-20T04:53:50.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.393+0000 7f013f3d2640 1 Processor -- start 2023-12-20T04:53:50.396 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.393+0000 7f013f3d2640 1 -- start start 2023-12-20T04:53:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.394+0000 7f013f3d2640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01380af210 0x7f0138151910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.394+0000 7f013f3d2640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f013815d110 0x7f01380c52f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.394+0000 7f013f3d2640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f013815d4f0 0x7f01380c5830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.394+0000 7f013f3d2640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013806e600 con 0x7f013815d4f0 2023-12-20T04:53:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.394+0000 7f013f3d2640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f013806d9f0 con 0x7f013815d110 2023-12-20T04:53:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.394+0000 7f013f3d2640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f013806dcd0 con 0x7f01380af210 2023-12-20T04:53:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.394+0000 7f013d96f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f013815d4f0 0x7f01380c5830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.394+0000 7f013d96f640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f013815d4f0 0x7f01380c5830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56420/0 (socket says 172.21.15.132:56420) 2023-12-20T04:53:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.394+0000 7f013d96f640 1 -- 172.21.15.132:0/3540259093 learned_addr learned my addr 172.21.15.132:0/3540259093 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.394+0000 7f013d16e640 1 --2- 172.21.15.132:0/3540259093 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01380af210 0x7f0138151910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.394+0000 7f013c96d640 1 --2- 172.21.15.132:0/3540259093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f013815d110 0x7f01380c52f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.394+0000 7f013d96f640 1 -- 172.21.15.132:0/3540259093 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01380af210 msgr2=0x7f0138151910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.399 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.394+0000 7f013d96f640 1 --2- 172.21.15.132:0/3540259093 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01380af210 0x7f0138151910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.394+0000 7f013d96f640 1 -- 172.21.15.132:0/3540259093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f013815d110 msgr2=0x7f01380c52f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.394+0000 7f013d96f640 1 --2- 172.21.15.132:0/3540259093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f013815d110 0x7f01380c52f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.394+0000 7f013d96f640 1 -- 172.21.15.132:0/3540259093 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f01300094d0 con 0x7f013815d4f0 2023-12-20T04:53:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.394+0000 7f013d96f640 1 --2- 172.21.15.132:0/3540259093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f013815d4f0 0x7f01380c5830 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f01300090b0 tx=0x7f0130004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.395+0000 7f012dffb640 1 -- 172.21.15.132:0/3540259093 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130039a90 con 0x7f013815d4f0 2023-12-20T04:53:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.395+0000 7f012dffb640 1 -- 172.21.15.132:0/3540259093 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f0130039bf0 con 0x7f013815d4f0 2023-12-20T04:53:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.395+0000 7f013f3d2640 1 -- 172.21.15.132:0/3540259093 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f013806dfb0 con 0x7f013815d4f0 2023-12-20T04:53:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.395+0000 7f012dffb640 1 -- 172.21.15.132:0/3540259093 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0130043410 con 0x7f013815d4f0 2023-12-20T04:53:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.395+0000 7f013f3d2640 1 -- 172.21.15.132:0/3540259093 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f013806cc80 con 0x7f013815d4f0 2023-12-20T04:53:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.396+0000 7f013f3d2640 1 -- 172.21.15.132:0/3540259093 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f013804e840 con 0x7f013815d4f0 2023-12-20T04:53:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.396+0000 7f012dffb640 1 -- 172.21.15.132:0/3540259093 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f013004c3b0 con 0x7f013815d4f0 2023-12-20T04:53:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.397+0000 7f012dffb640 1 --2- 172.21.15.132:0/3540259093 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f011c06a430 0x7f011c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.397+0000 7f012dffb640 1 -- 172.21.15.132:0/3540259093 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f01300aaae0 con 0x7f013815d4f0 2023-12-20T04:53:50.400 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.397+0000 7f013d16e640 1 --2- 172.21.15.132:0/3540259093 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f011c06a430 0x7f011c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.401 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.397+0000 7f013d16e640 1 --2- 172.21.15.132:0/3540259093 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f011c06a430 0x7f011c06c8f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0134009fb0 tx=0x7f013400b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:50.403 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.401+0000 7f012dffb640 1 -- 172.21.15.132:0/3540259093 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f0130076460 con 0x7f013815d4f0 2023-12-20T04:53:50.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.566+0000 7f013f3d2640 1 -- 172.21.15.132:0/3540259093 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) v1 -- 0x7f0138161690 con 0x7f011c06a430 2023-12-20T04:53:50.568 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.566+0000 7f012dffb640 1 -- 172.21.15.132:0/3540259093 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f0134009c50 con 0x7f011c06a430 2023-12-20T04:53:50.568 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 5 to deep-scrub 2023-12-20T04:53:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.568+0000 7f013f3d2640 1 -- 172.21.15.132:0/3540259093 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f011c06a430 msgr2=0x7f011c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.568+0000 7f013f3d2640 1 --2- 172.21.15.132:0/3540259093 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f011c06a430 0x7f011c06c8f0 secure :-1 s=READY pgs=822 cs=0 l=1 rev1=1 crypto rx=0x7f0134009fb0 tx=0x7f013400b040 comp rx=0 tx=0).stop 2023-12-20T04:53:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.568+0000 7f013f3d2640 1 -- 172.21.15.132:0/3540259093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f013815d4f0 msgr2=0x7f01380c5830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.568+0000 7f013f3d2640 1 --2- 172.21.15.132:0/3540259093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f013815d4f0 0x7f01380c5830 secure :-1 s=READY pgs=1970 cs=0 l=1 rev1=1 crypto rx=0x7f01300090b0 tx=0x7f0130004730 comp rx=0 tx=0).stop 2023-12-20T04:53:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.568+0000 7f013f3d2640 1 -- 172.21.15.132:0/3540259093 shutdown_connections 2023-12-20T04:53:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.568+0000 7f013f3d2640 1 --2- 172.21.15.132:0/3540259093 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f011c06a430 0x7f011c06c8f0 unknown :-1 s=CLOSED pgs=822 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.568+0000 7f013f3d2640 1 --2- 172.21.15.132:0/3540259093 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f013815d4f0 0x7f01380c5830 unknown :-1 s=CLOSED pgs=1970 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.570 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.568+0000 7f013f3d2640 1 --2- 172.21.15.132:0/3540259093 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f013815d110 0x7f01380c52f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.568+0000 7f013f3d2640 1 --2- 172.21.15.132:0/3540259093 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f01380af210 0x7f0138151910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.568+0000 7f013f3d2640 1 -- 172.21.15.132:0/3540259093 >> 172.21.15.132:0/3540259093 conn(0x7f01380cfbd0 msgr2=0x7f01380ca160 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.568+0000 7f013f3d2640 1 -- 172.21.15.132:0/3540259093 shutdown_connections 2023-12-20T04:53:50.571 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.568+0000 7f013f3d2640 1 -- 172.21.15.132:0/3540259093 wait complete. 2023-12-20T04:53:50.580 INFO:tasks.ceph:Scrubbing osd.6 2023-12-20T04:53:50.581 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2023-12-20T04:53:50.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.683+0000 7f003f59e640 1 Processor -- start 2023-12-20T04:53:50.684 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.683+0000 7f003f59e640 1 -- start start 2023-12-20T04:53:50.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.683+0000 7f003f59e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f004015cee0 0x7f00400c9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.683+0000 7f003f59e640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f004006e7e0 0x7f00400ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.683+0000 7f003f59e640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f00400709c0 con 0x7f0040070400 2023-12-20T04:53:50.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.683+0000 7f003f59e640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f0040070ca0 con 0x7f004006e7e0 2023-12-20T04:53:50.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.683+0000 7f003f59e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f0040070f80 con 0x7f004015cee0 2023-12-20T04:53:50.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.684+0000 7f003e59c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f004015cee0 0x7f00400c9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.684+0000 7f0037fff640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f004006e7e0 0x7f00400ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.684+0000 7f003e59c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f004015cee0 0x7f00400c9fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:58832/0 (socket says 172.21.15.132:58832) 2023-12-20T04:53:50.686 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.684+0000 7f003e59c640 1 -- 172.21.15.132:0/1673309567 learned_addr learned my addr 172.21.15.132:0/1673309567 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:50.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.684+0000 7f003e59c640 1 -- 172.21.15.132:0/1673309567 >> v2:172.21.15.187:3300/0 conn(0x7f004006e7e0 msgr2=0x7f00400ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:50.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.684+0000 7f003e59c640 1 --2- 172.21.15.132:0/1673309567 >> v2:172.21.15.187:3300/0 conn(0x7f004006e7e0 0x7f00400ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.684+0000 7f003e59c640 1 -- 172.21.15.132:0/1673309567 >> v1:172.21.15.187:6789/0 conn(0x7f0040070400 legacy=0x7f00401608f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.687 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.684+0000 7f003e59c640 1 -- 172.21.15.132:0/1673309567 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0040071260 con 0x7f004015cee0 2023-12-20T04:53:50.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.685+0000 7f003e59c640 1 --2- 172.21.15.132:0/1673309567 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f004015cee0 0x7f00400c9fc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0030009870 tx=0x7f003002b980 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dfd887fa823035a8 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:50.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.685+0000 7f003dd9b640 1 -- 172.21.15.132:0/1673309567 <== mon.2 v2:172.21.15.187:3301/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0030030840 con 0x7f004015cee0 2023-12-20T04:53:50.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.685+0000 7f003dd9b640 1 -- 172.21.15.132:0/1673309567 <== mon.2 v2:172.21.15.187:3301/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f00300309a0 con 0x7f004015cee0 2023-12-20T04:53:50.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.685+0000 7f003dd9b640 1 -- 172.21.15.132:0/1673309567 <== mon.2 v2:172.21.15.187:3301/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0030030d30 con 0x7f004015cee0 2023-12-20T04:53:50.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.686+0000 7f003f59e640 1 -- 172.21.15.132:0/1673309567 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f004015cee0 msgr2=0x7f00400c9fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.686+0000 7f003f59e640 1 --2- 172.21.15.132:0/1673309567 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f004015cee0 0x7f00400c9fc0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f0030009870 tx=0x7f003002b980 comp rx=0 tx=0).stop 2023-12-20T04:53:50.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.686+0000 7f003f59e640 1 -- 172.21.15.132:0/1673309567 shutdown_connections 2023-12-20T04:53:50.688 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.686+0000 7f003f59e640 1 --2- 172.21.15.132:0/1673309567 >> v2:172.21.15.187:3300/0 conn(0x7f004006e7e0 0x7f00400ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.686+0000 7f003f59e640 1 --2- 172.21.15.132:0/1673309567 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f004015cee0 0x7f00400c9fc0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.686+0000 7f003f59e640 1 -- 172.21.15.132:0/1673309567 >> 172.21.15.132:0/1673309567 conn(0x7f00400cf970 msgr2=0x7f00400cfd80 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:50.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.686+0000 7f003f59e640 1 -- 172.21.15.132:0/1673309567 shutdown_connections 2023-12-20T04:53:50.689 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.686+0000 7f003f59e640 1 -- 172.21.15.132:0/1673309567 wait complete. 2023-12-20T04:53:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.687+0000 7f003f59e640 1 Processor -- start 2023-12-20T04:53:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.687+0000 7f003f59e640 1 -- start start 2023-12-20T04:53:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f003f59e640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f004006e7e0 0x7f0040147c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f003f59e640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0040070400 0x7f00400b2d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f003f59e640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f004015cee0 0x7f00400b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f003f59e640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00400b2a80 con 0x7f0040070400 2023-12-20T04:53:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f003f59e640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f00400b2550 con 0x7f004015cee0 2023-12-20T04:53:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f003f59e640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f00400b27a0 con 0x7f004006e7e0 2023-12-20T04:53:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f0037fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0040070400 0x7f00400b2d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f0037fff640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0040070400 0x7f00400b2d60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56422/0 (socket says 172.21.15.132:56422) 2023-12-20T04:53:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f0037fff640 1 -- 172.21.15.132:0/415340519 learned_addr learned my addr 172.21.15.132:0/415340519 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:50.691 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f003e59c640 1 --2- 172.21.15.132:0/415340519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f004006e7e0 0x7f0040147c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f003ed9d640 1 --2- 172.21.15.132:0/415340519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f004015cee0 0x7f00400b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f0037fff640 1 -- 172.21.15.132:0/415340519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f004006e7e0 msgr2=0x7f0040147c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f0037fff640 1 --2- 172.21.15.132:0/415340519 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f004006e7e0 0x7f0040147c60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f0037fff640 1 -- 172.21.15.132:0/415340519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f004015cee0 msgr2=0x7f00400b32a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f0037fff640 1 --2- 172.21.15.132:0/415340519 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f004015cee0 0x7f00400b32a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f0037fff640 1 -- 172.21.15.132:0/415340519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f00300094d0 con 0x7f0040070400 2023-12-20T04:53:50.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f0037fff640 1 --2- 172.21.15.132:0/415340519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0040070400 0x7f00400b2d60 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f002800e9b0 tx=0x7f002800ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:50.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f0036ffd640 1 -- 172.21.15.132:0/415340519 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f0028009670 con 0x7f0040070400 2023-12-20T04:53:50.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f0036ffd640 1 -- 172.21.15.132:0/415340519 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f002800c9a0 con 0x7f0040070400 2023-12-20T04:53:50.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f003f59e640 1 -- 172.21.15.132:0/415340519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0040149390 con 0x7f0040070400 2023-12-20T04:53:50.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.688+0000 7f0036ffd640 1 -- 172.21.15.132:0/415340519 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f002800cd50 con 0x7f0040070400 2023-12-20T04:53:50.692 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.689+0000 7f003f59e640 1 -- 172.21.15.132:0/415340519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f00400b11f0 con 0x7f0040070400 2023-12-20T04:53:50.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.689+0000 7f003f59e640 1 -- 172.21.15.132:0/415340519 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f00400cf620 con 0x7f0040070400 2023-12-20T04:53:50.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.690+0000 7f0036ffd640 1 -- 172.21.15.132:0/415340519 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f0028013470 con 0x7f0040070400 2023-12-20T04:53:50.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.690+0000 7f0036ffd640 1 --2- 172.21.15.132:0/415340519 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f002006a430 0x7f002006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.690+0000 7f0036ffd640 1 -- 172.21.15.132:0/415340519 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f0028088a80 con 0x7f0040070400 2023-12-20T04:53:50.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.690+0000 7f003e59c640 1 --2- 172.21.15.132:0/415340519 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f002006a430 0x7f002006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.690+0000 7f0036ffd640 1 --2- 172.21.15.132:0/415340519 >> [v2:172.21.15.187:6806/84619,v1:172.21.15.187:6809/84619] conn(0x7f0020070290 0x7f00200726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.691+0000 7f0036ffd640 1 -- 172.21.15.132:0/415340519 --> [v2:172.21.15.187:6806/84619,v1:172.21.15.187:6809/84619] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f0020072d60 con 0x7f0020070290 2023-12-20T04:53:50.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.691+0000 7f0036ffd640 1 -- 172.21.15.132:0/415340519 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=193) v2 ==== 24+0+0 (secure 0 0 0) 0x7f0028088ed0 con 0x7f0040070400 2023-12-20T04:53:50.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.691+0000 7f003ed9d640 1 --2- 172.21.15.132:0/415340519 >> [v2:172.21.15.187:6806/84619,v1:172.21.15.187:6809/84619] conn(0x7f0020070290 0x7f00200726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.691+0000 7f003e59c640 1 --2- 172.21.15.132:0/415340519 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f002006a430 0x7f002006c8f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0030036000 tx=0x7f003003b040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:50.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.691+0000 7f003ed9d640 1 --2- 172.21.15.132:0/415340519 >> [v2:172.21.15.187:6806/84619,v1:172.21.15.187:6809/84619] conn(0x7f0020070290 0x7f00200726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:50.694 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.692+0000 7f0036ffd640 1 -- 172.21.15.132:0/415340519 <== osd.6 v2:172.21.15.187:6806/84619 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f0020072d60 con 0x7f0020070290 2023-12-20T04:53:50.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.703+0000 7f003f59e640 1 -- 172.21.15.132:0/415340519 --> [v2:172.21.15.187:6806/84619,v1:172.21.15.187:6809/84619] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f0040071540 con 0x7f0020070290 2023-12-20T04:53:50.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.704+0000 7f0036ffd640 1 -- 172.21.15.132:0/415340519 <== osd.6 v2:172.21.15.187:6806/84619 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f0038001b20 con 0x7f0020070290 2023-12-20T04:53:50.706 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:50.706 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-20T04:53:50.706 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:50.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.704+0000 7f003f59e640 1 -- 172.21.15.132:0/415340519 >> [v2:172.21.15.187:6806/84619,v1:172.21.15.187:6809/84619] conn(0x7f0020070290 msgr2=0x7f00200726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.704+0000 7f003f59e640 1 --2- 172.21.15.132:0/415340519 >> [v2:172.21.15.187:6806/84619,v1:172.21.15.187:6809/84619] conn(0x7f0020070290 0x7f00200726b0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.704+0000 7f003f59e640 1 -- 172.21.15.132:0/415340519 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f002006a430 msgr2=0x7f002006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.704+0000 7f003f59e640 1 --2- 172.21.15.132:0/415340519 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f002006a430 0x7f002006c8f0 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f0030036000 tx=0x7f003003b040 comp rx=0 tx=0).stop 2023-12-20T04:53:50.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.704+0000 7f003f59e640 1 -- 172.21.15.132:0/415340519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0040070400 msgr2=0x7f00400b2d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.704+0000 7f003f59e640 1 --2- 172.21.15.132:0/415340519 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f0040070400 0x7f00400b2d60 secure :-1 s=READY pgs=1971 cs=0 l=1 rev1=1 crypto rx=0x7f002800e9b0 tx=0x7f002800ee70 comp rx=0 tx=0).stop 2023-12-20T04:53:50.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.704+0000 7f003ed9d640 1 -- 172.21.15.132:0/415340519 reap_dead start 2023-12-20T04:53:50.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.704+0000 7f003f59e640 1 -- 172.21.15.132:0/415340519 shutdown_connections 2023-12-20T04:53:50.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.704+0000 7f003f59e640 1 -- 172.21.15.132:0/415340519 >> 172.21.15.132:0/415340519 conn(0x7f00400cf970 msgr2=0x7f00400cd930 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:50.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.704+0000 7f003f59e640 1 -- 172.21.15.132:0/415340519 shutdown_connections 2023-12-20T04:53:50.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.704+0000 7f003f59e640 1 -- 172.21.15.132:0/415340519 wait complete. 2023-12-20T04:53:50.716 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2023-12-20T04:53:50.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.814+0000 7fd36135c640 1 Processor -- start 2023-12-20T04:53:50.817 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.815+0000 7fd36135c640 1 -- start start 2023-12-20T04:53:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.815+0000 7fd36135c640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd35c0b4980 0x7fd35c0b4de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.815+0000 7fd36135c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0d1aa0 0x7fd35c0d1f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.815+0000 7fd36135c640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7fd35c0b5320 con 0x7fd35c160450 2023-12-20T04:53:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.815+0000 7fd36135c640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fd35c0b5ec0 con 0x7fd35c0b4980 2023-12-20T04:53:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.815+0000 7fd36135c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c1617e0 con 0x7fd35c0d1aa0 2023-12-20T04:53:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.815+0000 7fd35a7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd35c0b4980 0x7fd35c0b4de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.816+0000 7fd35a7fc640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fd35c0b4980 0x7fd35c0b4de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56428/0 (socket says 172.21.15.132:56428) 2023-12-20T04:53:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.816+0000 7fd35a7fc640 1 -- 172.21.15.132:0/314048625 learned_addr learned my addr 172.21.15.132:0/314048625 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:50.818 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.816+0000 7fd35b7fe640 1 --2- 172.21.15.132:0/314048625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0d1aa0 0x7fd35c0d1f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.816+0000 7fd35a7fc640 1 -- 172.21.15.132:0/314048625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0d1aa0 msgr2=0x7fd35c0d1f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:50.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.816+0000 7fd35a7fc640 1 --2- 172.21.15.132:0/314048625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0d1aa0 0x7fd35c0d1f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.816+0000 7fd35a7fc640 1 -- 172.21.15.132:0/314048625 >> v1:172.21.15.187:6789/0 conn(0x7fd35c160450 legacy=0x7fd35c160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:50.819 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.816+0000 7fd35a7fc640 1 -- 172.21.15.132:0/314048625 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd35c0d0fc0 con 0x7fd35c0b4980 2023-12-20T04:53:50.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.817+0000 7fd35a7fc640 1 --2- 172.21.15.132:0/314048625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd35c0b4980 0x7fd35c0b4de0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7fd35c08b100 tx=0x7fd34402b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5c344fcf6c22fc4 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:50.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.817+0000 7fd359ffb640 1 -- 172.21.15.132:0/314048625 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344030610 con 0x7fd35c0b4980 2023-12-20T04:53:50.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.817+0000 7fd359ffb640 1 -- 172.21.15.132:0/314048625 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd344030770 con 0x7fd35c0b4980 2023-12-20T04:53:50.820 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.817+0000 7fd359ffb640 1 -- 172.21.15.132:0/314048625 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344030b00 con 0x7fd35c0b4980 2023-12-20T04:53:50.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.817+0000 7fd36135c640 1 -- 172.21.15.132:0/314048625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd35c0b4980 msgr2=0x7fd35c0b4de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.817+0000 7fd36135c640 1 --2- 172.21.15.132:0/314048625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd35c0b4980 0x7fd35c0b4de0 secure :-1 s=READY pgs=1972 cs=0 l=1 rev1=1 crypto rx=0x7fd35c08b100 tx=0x7fd34402b960 comp rx=0 tx=0).stop 2023-12-20T04:53:50.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.817+0000 7fd36135c640 1 -- 172.21.15.132:0/314048625 shutdown_connections 2023-12-20T04:53:50.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.817+0000 7fd36135c640 1 --2- 172.21.15.132:0/314048625 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0d1aa0 0x7fd35c0d1f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.817+0000 7fd36135c640 1 --2- 172.21.15.132:0/314048625 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd35c0b4980 0x7fd35c0b4de0 unknown :-1 s=CLOSED pgs=1972 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.817+0000 7fd36135c640 1 -- 172.21.15.132:0/314048625 >> 172.21.15.132:0/314048625 conn(0x7fd35c0cf980 msgr2=0x7fd35c0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:50.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.817+0000 7fd36135c640 1 -- 172.21.15.132:0/314048625 shutdown_connections 2023-12-20T04:53:50.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.817+0000 7fd36135c640 1 -- 172.21.15.132:0/314048625 wait complete. 2023-12-20T04:53:50.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.819+0000 7fd36135c640 1 Processor -- start 2023-12-20T04:53:50.821 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.819+0000 7fd36135c640 1 -- start start 2023-12-20T04:53:50.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.819+0000 7fd36135c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0b4980 0x7fd35c06a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.819+0000 7fd36135c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd35c0d1aa0 0x7fd35c15bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.819+0000 7fd36135c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35c160450 0x7fd35c15c0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.823 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.819+0000 7fd36135c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c1f6820 con 0x7fd35c0d1aa0 2023-12-20T04:53:50.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.819+0000 7fd36135c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c0c9fd0 con 0x7fd35c160450 2023-12-20T04:53:50.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.819+0000 7fd36135c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fd35c15c790 con 0x7fd35c0b4980 2023-12-20T04:53:50.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.819+0000 7fd35a7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd35c0d1aa0 0x7fd35c15bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.819+0000 7fd35a7fc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd35c0d1aa0 0x7fd35c15bb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56432/0 (socket says 172.21.15.132:56432) 2023-12-20T04:53:50.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.819+0000 7fd35a7fc640 1 -- 172.21.15.132:0/4127418370 learned_addr learned my addr 172.21.15.132:0/4127418370 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:50.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.820+0000 7fd35affd640 1 --2- 172.21.15.132:0/4127418370 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0b4980 0x7fd35c06a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.820+0000 7fd35b7fe640 1 --2- 172.21.15.132:0/4127418370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35c160450 0x7fd35c15c0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.820+0000 7fd35a7fc640 1 -- 172.21.15.132:0/4127418370 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0b4980 msgr2=0x7fd35c06a410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.820+0000 7fd35a7fc640 1 --2- 172.21.15.132:0/4127418370 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0b4980 0x7fd35c06a410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.820+0000 7fd35a7fc640 1 -- 172.21.15.132:0/4127418370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35c160450 msgr2=0x7fd35c15c0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.820+0000 7fd35a7fc640 1 --2- 172.21.15.132:0/4127418370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35c160450 0x7fd35c15c0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.820+0000 7fd35a7fc640 1 -- 172.21.15.132:0/4127418370 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3440094d0 con 0x7fd35c0d1aa0 2023-12-20T04:53:50.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.820+0000 7fd35b7fe640 1 --2- 172.21.15.132:0/4127418370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35c160450 0x7fd35c15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2023-12-20T04:53:50.824 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.820+0000 7fd35a7fc640 1 --2- 172.21.15.132:0/4127418370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd35c0d1aa0 0x7fd35c15bb80 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7fd344000c00 tx=0x7fd344004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:50.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.820+0000 7fd3537fe640 1 -- 172.21.15.132:0/4127418370 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344039c90 con 0x7fd35c0d1aa0 2023-12-20T04:53:50.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.820+0000 7fd3537fe640 1 -- 172.21.15.132:0/4127418370 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fd344039df0 con 0x7fd35c0d1aa0 2023-12-20T04:53:50.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.820+0000 7fd36135c640 1 -- 172.21.15.132:0/4127418370 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd35c15ca70 con 0x7fd35c0d1aa0 2023-12-20T04:53:50.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.820+0000 7fd3537fe640 1 -- 172.21.15.132:0/4127418370 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fd344043620 con 0x7fd35c0d1aa0 2023-12-20T04:53:50.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.820+0000 7fd36135c640 1 -- 172.21.15.132:0/4127418370 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd35c0ca500 con 0x7fd35c0d1aa0 2023-12-20T04:53:50.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.821+0000 7fd36135c640 1 -- 172.21.15.132:0/4127418370 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd35c0ca6f0 con 0x7fd35c0d1aa0 2023-12-20T04:53:50.825 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.821+0000 7fd3537fe640 1 -- 172.21.15.132:0/4127418370 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fd344043780 con 0x7fd35c0d1aa0 2023-12-20T04:53:50.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.822+0000 7fd3537fe640 1 --2- 172.21.15.132:0/4127418370 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd33c06a430 0x7fd33c06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:50.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.822+0000 7fd3537fe640 1 -- 172.21.15.132:0/4127418370 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fd34403e070 con 0x7fd35c0d1aa0 2023-12-20T04:53:50.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.822+0000 7fd35affd640 1 --2- 172.21.15.132:0/4127418370 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd33c06a430 0x7fd33c06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:50.826 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.822+0000 7fd35affd640 1 --2- 172.21.15.132:0/4127418370 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd33c06a430 0x7fd33c06c8f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009f20 tx=0x7fd34c0094d0 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:50.828 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.826+0000 7fd3537fe640 1 -- 172.21.15.132:0/4127418370 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fd344076d60 con 0x7fd35c0d1aa0 2023-12-20T04:53:50.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.991+0000 7fd36135c640 1 -- 172.21.15.132:0/4127418370 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) v1 -- 0x7fd35c0d1580 con 0x7fd33c06a430 2023-12-20T04:53:50.993 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.991+0000 7fd3537fe640 1 -- 172.21.15.132:0/4127418370 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7fd34c009680 con 0x7fd33c06a430 2023-12-20T04:53:50.993 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 6 to deep-scrub 2023-12-20T04:53:50.995 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.993+0000 7fd36135c640 1 -- 172.21.15.132:0/4127418370 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd33c06a430 msgr2=0x7fd33c06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.993+0000 7fd36135c640 1 --2- 172.21.15.132:0/4127418370 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd33c06a430 0x7fd33c06c8f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7fd34c009f20 tx=0x7fd34c0094d0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.993+0000 7fd36135c640 1 -- 172.21.15.132:0/4127418370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd35c0d1aa0 msgr2=0x7fd35c15bb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:50.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.993+0000 7fd36135c640 1 --2- 172.21.15.132:0/4127418370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd35c0d1aa0 0x7fd35c15bb80 secure :-1 s=READY pgs=1973 cs=0 l=1 rev1=1 crypto rx=0x7fd344000c00 tx=0x7fd344004730 comp rx=0 tx=0).stop 2023-12-20T04:53:50.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.993+0000 7fd36135c640 1 -- 172.21.15.132:0/4127418370 shutdown_connections 2023-12-20T04:53:50.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.993+0000 7fd36135c640 1 --2- 172.21.15.132:0/4127418370 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fd33c06a430 0x7fd33c06c8f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.993+0000 7fd36135c640 1 --2- 172.21.15.132:0/4127418370 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fd35c160450 0x7fd35c15c0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.993+0000 7fd36135c640 1 --2- 172.21.15.132:0/4127418370 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fd35c0d1aa0 0x7fd35c15bb80 unknown :-1 s=CLOSED pgs=1973 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.993+0000 7fd36135c640 1 --2- 172.21.15.132:0/4127418370 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fd35c0b4980 0x7fd35c06a410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:50.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.993+0000 7fd36135c640 1 -- 172.21.15.132:0/4127418370 >> 172.21.15.132:0/4127418370 conn(0x7fd35c0cf980 msgr2=0x7fd35c155b50 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:50.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.993+0000 7fd36135c640 1 -- 172.21.15.132:0/4127418370 shutdown_connections 2023-12-20T04:53:50.996 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:50.993+0000 7fd36135c640 1 -- 172.21.15.132:0/4127418370 wait complete. 2023-12-20T04:53:51.006 INFO:tasks.ceph:Scrubbing osd.7 2023-12-20T04:53:51.006 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2023-12-20T04:53:51.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.108+0000 7f5a21c69640 1 Processor -- start 2023-12-20T04:53:51.110 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.108+0000 7f5a21c69640 1 -- start start 2023-12-20T04:53:51.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.109+0000 7f5a21c69640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5a1c15d300 0x7f5a1c0d1010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:51.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.109+0000 7f5a21c69640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a1c0d1a90 con 0x7f5a1c0cff90 2023-12-20T04:53:51.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.109+0000 7f5a21c69640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f5a1c0d1d70 con 0x7f5a1c0d1550 2023-12-20T04:53:51.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.109+0000 7f5a21c69640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f5a1c0d2050 con 0x7f5a1c15d300 2023-12-20T04:53:51.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.109+0000 7f5a1b7fe640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f5a1c15d300 0x7f5a1c0d1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:51.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.109+0000 7f5a1bfff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f5a1c0cff90 0x7f5a1c0b60e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47240/0 (socket says 172.21.15.132:47240) 2023-12-20T04:53:51.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.109+0000 7f5a1bfff640 1 -- 172.21.15.132:0/2178083325 learned_addr learned my addr 172.21.15.132:0/2178083325 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:51.111 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.109+0000 7f5a1b7fe640 1 -- 172.21.15.132:0/2178083325 >> v1:172.21.15.187:6789/0 conn(0x7f5a1c0d1550 legacy=0x7f5a1c0cf880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:51.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.109+0000 7f5a1b7fe640 1 -- 172.21.15.132:0/2178083325 >> v1:172.21.15.132:6789/0 conn(0x7f5a1c0cff90 legacy=0x7f5a1c0b60e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.109+0000 7f5a1a7fc640 1 -- 172.21.15.132:0/2178083325 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3184768559 0 0) 0x7f5a1c0d1a90 con 0x7f5a1c0cff90 2023-12-20T04:53:51.112 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.109+0000 7f5a1b7fe640 1 -- 172.21.15.132:0/2178083325 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a1c0d2330 con 0x7f5a1c15d300 2023-12-20T04:53:51.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.110+0000 7f5a1b7fe640 1 --2- 172.21.15.132:0/2178083325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a1c15d300 0x7f5a1c0d1010 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0097a0 tx=0x7f5a0c02b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cbae52b314d4943 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:51.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.110+0000 7f5a1a7fc640 1 -- 172.21.15.132:0/2178083325 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c031830 con 0x7f5a1c15d300 2023-12-20T04:53:51.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.110+0000 7f5a1a7fc640 1 -- 172.21.15.132:0/2178083325 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0c031990 con 0x7f5a1c15d300 2023-12-20T04:53:51.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.110+0000 7f5a1a7fc640 1 -- 172.21.15.132:0/2178083325 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c031d20 con 0x7f5a1c15d300 2023-12-20T04:53:51.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.111+0000 7f5a21c69640 1 -- 172.21.15.132:0/2178083325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a1c15d300 msgr2=0x7f5a1c0d1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.111+0000 7f5a21c69640 1 --2- 172.21.15.132:0/2178083325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a1c15d300 0x7f5a1c0d1010 secure :-1 s=READY pgs=1975 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c0097a0 tx=0x7f5a0c02b8d0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.111+0000 7f5a21c69640 1 -- 172.21.15.132:0/2178083325 shutdown_connections 2023-12-20T04:53:51.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.111+0000 7f5a21c69640 1 --2- 172.21.15.132:0/2178083325 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a1c15d300 0x7f5a1c0d1010 unknown :-1 s=CLOSED pgs=1975 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.111+0000 7f5a21c69640 1 -- 172.21.15.132:0/2178083325 >> 172.21.15.132:0/2178083325 conn(0x7f5a1c06a3d0 msgr2=0x7f5a1c06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:51.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.111+0000 7f5a21c69640 1 -- 172.21.15.132:0/2178083325 shutdown_connections 2023-12-20T04:53:51.113 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.111+0000 7f5a21c69640 1 -- 172.21.15.132:0/2178083325 wait complete. 2023-12-20T04:53:51.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.112+0000 7f5a21c69640 1 Processor -- start 2023-12-20T04:53:51.114 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.112+0000 7f5a21c69640 1 -- start start 2023-12-20T04:53:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a21c69640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a1c0cff90 0x7f5a1c1513a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a21c69640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a1c0d1550 0x7f5a1c0cc110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a21c69640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a1c15d300 0x7f5a1c0cc650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a21c69640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c0c74e0 con 0x7f5a1c0cff90 2023-12-20T04:53:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a21c69640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c0c6860 con 0x7f5a1c15d300 2023-12-20T04:53:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a21c69640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f5a1c0c6b40 con 0x7f5a1c0d1550 2023-12-20T04:53:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a1b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a1c0cff90 0x7f5a1c1513a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a1b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a1c0cff90 0x7f5a1c1513a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56444/0 (socket says 172.21.15.132:56444) 2023-12-20T04:53:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a1b7fe640 1 -- 172.21.15.132:0/1540086172 learned_addr learned my addr 172.21.15.132:0/1540086172 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a1b7fe640 1 -- 172.21.15.132:0/1540086172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a1c0d1550 msgr2=0x7f5a1c0cc110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a1b7fe640 1 --2- 172.21.15.132:0/1540086172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f5a1c0d1550 0x7f5a1c0cc110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.116 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a1b7fe640 1 -- 172.21.15.132:0/1540086172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a1c15d300 msgr2=0x7f5a1c0cc650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a1b7fe640 1 --2- 172.21.15.132:0/1540086172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f5a1c15d300 0x7f5a1c0cc650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a1b7fe640 1 -- 172.21.15.132:0/1540086172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a0c009400 con 0x7f5a1c0cff90 2023-12-20T04:53:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a1b7fe640 1 --2- 172.21.15.132:0/1540086172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a1c0cff90 0x7f5a1c1513a0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c000c00 tx=0x7f5a0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a03fff640 1 -- 172.21.15.132:0/1540086172 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c03aa60 con 0x7f5a1c0cff90 2023-12-20T04:53:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a03fff640 1 -- 172.21.15.132:0/1540086172 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f5a0c03abc0 con 0x7f5a1c0cff90 2023-12-20T04:53:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a21c69640 1 -- 172.21.15.132:0/1540086172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a1c0c6e20 con 0x7f5a1c0cff90 2023-12-20T04:53:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.113+0000 7f5a03fff640 1 -- 172.21.15.132:0/1540086172 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f5a0c0443f0 con 0x7f5a1c0cff90 2023-12-20T04:53:51.117 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.114+0000 7f5a21c69640 1 -- 172.21.15.132:0/1540086172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a1c153ba0 con 0x7f5a1c0cff90 2023-12-20T04:53:51.118 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.114+0000 7f5a21c69640 1 -- 172.21.15.132:0/1540086172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f5a1c0cd8f0 con 0x7f5a1c0cff90 2023-12-20T04:53:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.115+0000 7f5a03fff640 1 -- 172.21.15.132:0/1540086172 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f5a0c04d450 con 0x7f5a1c0cff90 2023-12-20T04:53:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.115+0000 7f5a03fff640 1 --2- 172.21.15.132:0/1540086172 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5a0806a430 0x7f5a0806c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.115+0000 7f5a03fff640 1 -- 172.21.15.132:0/1540086172 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f5a0c0aa790 con 0x7f5a1c0cff90 2023-12-20T04:53:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.115+0000 7f5a1affd640 1 --2- 172.21.15.132:0/1540086172 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5a0806a430 0x7f5a0806c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.115+0000 7f5a03fff640 1 --2- 172.21.15.132:0/1540086172 >> [v2:172.21.15.187:6824/84651,v1:172.21.15.187:6825/84651] conn(0x7f5a08070290 0x7f5a080726b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.115+0000 7f5a03fff640 1 -- 172.21.15.132:0/1540086172 --> [v2:172.21.15.187:6824/84651,v1:172.21.15.187:6825/84651] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f5a08072d60 con 0x7f5a08070290 2023-12-20T04:53:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.115+0000 7f5a03fff640 1 -- 172.21.15.132:0/1540086172 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_get_version_reply(handle=1 version=193) v2 ==== 24+0+0 (secure 0 0 0) 0x7f5a0c0ace50 con 0x7f5a1c0cff90 2023-12-20T04:53:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.116+0000 7f5a1affd640 1 --2- 172.21.15.132:0/1540086172 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5a0806a430 0x7f5a0806c8f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c0cf0c0 tx=0x7f5a10007a00 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.116+0000 7f5a1bfff640 1 --2- 172.21.15.132:0/1540086172 >> [v2:172.21.15.187:6824/84651,v1:172.21.15.187:6825/84651] conn(0x7f5a08070290 0x7f5a080726b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.116+0000 7f5a1bfff640 1 --2- 172.21.15.132:0/1540086172 >> [v2:172.21.15.187:6824/84651,v1:172.21.15.187:6825/84651] conn(0x7f5a08070290 0x7f5a080726b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:51.119 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.117+0000 7f5a03fff640 1 -- 172.21.15.132:0/1540086172 <== osd.7 v2:172.21.15.187:6824/84651 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23447 (crc 0 0 0) 0x7f5a08072d60 con 0x7f5a08070290 2023-12-20T04:53:51.130 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.128+0000 7f5a21c69640 1 -- 172.21.15.132:0/1540086172 --> [v2:172.21.15.187:6824/84651,v1:172.21.15.187:6825/84651] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) v1 -- 0x7f5a1c0d2610 con 0x7f5a08070290 2023-12-20T04:53:51.131 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.129+0000 7f5a03fff640 1 -- 172.21.15.132:0/1540086172 <== osd.7 v2:172.21.15.187:6824/84651 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+757 (crc 0 0 0) 0x7f5a14001e10 con 0x7f5a08070290 2023-12-20T04:53:51.131 INFO:teuthology.orchestra.run.smithi132.stdout:{ 2023-12-20T04:53:51.131 INFO:teuthology.orchestra.run.smithi132.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) osd_delete_sleep = '0.000000' osd_delete_sleep_hdd = '0.000000' osd_delete_sleep_hybrid = '0.000000' osd_delete_sleep_ssd = '0.000000' osd_max_backfills = '1' osd_pg_delete_cost = '15728640' (not observed, change may require restart) osd_recovery_max_active = '0' osd_recovery_max_active_hdd = '3' osd_recovery_max_active_ssd = '10' osd_recovery_sleep = '0.000000' osd_recovery_sleep_hdd = '0.000000' osd_recovery_sleep_hybrid = '0.000000' osd_recovery_sleep_ssd = '0.000000' osd_scrub_sleep = '0.000000' osd_snap_trim_sleep = '0.000000' osd_snap_trim_sleep_hdd = '0.000000' osd_snap_trim_sleep_hybrid = '0.000000' osd_snap_trim_sleep_ssd = '0.000000' " 2023-12-20T04:53:51.131 INFO:teuthology.orchestra.run.smithi132.stdout:} 2023-12-20T04:53:51.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.129+0000 7f5a21c69640 1 -- 172.21.15.132:0/1540086172 >> [v2:172.21.15.187:6824/84651,v1:172.21.15.187:6825/84651] conn(0x7f5a08070290 msgr2=0x7f5a080726b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.129+0000 7f5a21c69640 1 --2- 172.21.15.132:0/1540086172 >> [v2:172.21.15.187:6824/84651,v1:172.21.15.187:6825/84651] conn(0x7f5a08070290 0x7f5a080726b0 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.129+0000 7f5a21c69640 1 -- 172.21.15.132:0/1540086172 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5a0806a430 msgr2=0x7f5a0806c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.129+0000 7f5a21c69640 1 --2- 172.21.15.132:0/1540086172 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f5a0806a430 0x7f5a0806c8f0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x7f5a1c0cf0c0 tx=0x7f5a10007a00 comp rx=0 tx=0).stop 2023-12-20T04:53:51.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.129+0000 7f5a21c69640 1 -- 172.21.15.132:0/1540086172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a1c0cff90 msgr2=0x7f5a1c1513a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.129+0000 7f5a21c69640 1 --2- 172.21.15.132:0/1540086172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f5a1c0cff90 0x7f5a1c1513a0 secure :-1 s=READY pgs=1976 cs=0 l=1 rev1=1 crypto rx=0x7f5a0c000c00 tx=0x7f5a0c0046c0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.129+0000 7f5a1bfff640 1 -- 172.21.15.132:0/1540086172 reap_dead start 2023-12-20T04:53:51.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.129+0000 7f5a21c69640 1 -- 172.21.15.132:0/1540086172 shutdown_connections 2023-12-20T04:53:51.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.129+0000 7f5a21c69640 1 -- 172.21.15.132:0/1540086172 >> 172.21.15.132:0/1540086172 conn(0x7f5a1c06a3d0 msgr2=0x7f5a1c160130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:51.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.129+0000 7f5a21c69640 1 -- 172.21.15.132:0/1540086172 shutdown_connections 2023-12-20T04:53:51.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.129+0000 7f5a21c69640 1 -- 172.21.15.132:0/1540086172 wait complete. 2023-12-20T04:53:51.142 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2023-12-20T04:53:51.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.240+0000 7f3c54f47640 1 Processor -- start 2023-12-20T04:53:51.242 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.240+0000 7f3c54f47640 1 -- start start 2023-12-20T04:53:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.241+0000 7f3c54f47640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c500cf0b0 0x7f3c500b3330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.241+0000 7f3c54f47640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3c500cb420 0x7f3c500d07f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.241+0000 7f3c54f47640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3c500cd740 con 0x7f3c5015e2d0 2023-12-20T04:53:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.241+0000 7f3c54f47640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3c500ce230 con 0x7f3c500cb420 2023-12-20T04:53:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.241+0000 7f3c54f47640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c500cd990 con 0x7f3c500cf0b0 2023-12-20T04:53:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.242+0000 7f3c4dd9b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c500cf0b0 0x7f3c500b3330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.242+0000 7f3c4ed9d640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3c500cb420 0x7f3c500d07f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:51.244 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.242+0000 7f3c4dd9b640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c500cf0b0 0x7f3c500b3330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.187:3301/0 says I am v2:172.21.15.132:58888/0 (socket says 172.21.15.132:58888) 2023-12-20T04:53:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.242+0000 7f3c4dd9b640 1 -- 172.21.15.132:0/279867290 learned_addr learned my addr 172.21.15.132:0/279867290 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.242+0000 7f3c4ed9d640 1 -- 172.21.15.132:0/279867290 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c500cf0b0 msgr2=0x7f3c500b3330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:53:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.242+0000 7f3c4ed9d640 1 --2- 172.21.15.132:0/279867290 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c500cf0b0 0x7f3c500b3330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.242+0000 7f3c4ed9d640 1 -- 172.21.15.132:0/279867290 >> v1:172.21.15.187:6789/0 conn(0x7f3c5015e2d0 legacy=0x7f3c500ce9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.242+0000 7f3c4ed9d640 1 -- 172.21.15.132:0/279867290 --> v2:172.21.15.187:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c500cdc70 con 0x7f3c500cb420 2023-12-20T04:53:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.242+0000 7f3c4d59a640 1 -- 172.21.15.132:0/279867290 <== mon.1 v1:172.21.15.187:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 3100962916 0 0) 0x7f3c500cd740 con 0x7f3c5015e2d0 2023-12-20T04:53:51.245 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.242+0000 7f3c4dd9b640 1 --2- 172.21.15.132:0/279867290 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c500cf0b0 0x7f3c500b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2023-12-20T04:53:51.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.243+0000 7f3c4ed9d640 1 --2- 172.21.15.132:0/279867290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c500cb420 0x7f3c500d07f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009d90 tx=0x7f3c4802be10 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea5333044f2b8da6 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:51.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.243+0000 7f3c4d59a640 1 -- 172.21.15.132:0/279867290 <== mon.1 v2:172.21.15.187:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c4802cbc0 con 0x7f3c500cb420 2023-12-20T04:53:51.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.243+0000 7f3c4d59a640 1 -- 172.21.15.132:0/279867290 <== mon.1 v2:172.21.15.187:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c4802cd20 con 0x7f3c500cb420 2023-12-20T04:53:51.246 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.243+0000 7f3c4d59a640 1 -- 172.21.15.132:0/279867290 <== mon.1 v2:172.21.15.187:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c48034660 con 0x7f3c500cb420 2023-12-20T04:53:51.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.243+0000 7f3c54f47640 1 -- 172.21.15.132:0/279867290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c500cb420 msgr2=0x7f3c500d07f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.243+0000 7f3c54f47640 1 --2- 172.21.15.132:0/279867290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c500cb420 0x7f3c500d07f0 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f3c48009d90 tx=0x7f3c4802be10 comp rx=0 tx=0).stop 2023-12-20T04:53:51.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.244+0000 7f3c54f47640 1 -- 172.21.15.132:0/279867290 shutdown_connections 2023-12-20T04:53:51.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.244+0000 7f3c54f47640 1 --2- 172.21.15.132:0/279867290 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c500cb420 0x7f3c500d07f0 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.244+0000 7f3c54f47640 1 --2- 172.21.15.132:0/279867290 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c500cf0b0 0x7f3c500b3330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.244+0000 7f3c54f47640 1 -- 172.21.15.132:0/279867290 >> 172.21.15.132:0/279867290 conn(0x7f3c5006d7c0 msgr2=0x7f3c5006dba0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:51.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.244+0000 7f3c54f47640 1 -- 172.21.15.132:0/279867290 shutdown_connections 2023-12-20T04:53:51.247 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.244+0000 7f3c54f47640 1 -- 172.21.15.132:0/279867290 wait complete. 2023-12-20T04:53:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.245+0000 7f3c54f47640 1 Processor -- start 2023-12-20T04:53:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.245+0000 7f3c54f47640 1 -- start start 2023-12-20T04:53:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c54f47640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c500cb420 0x7f3c501f4900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c54f47640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c500cf0b0 0x7f3c501478f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c54f47640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c5015e2d0 0x7f3c500ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c54f47640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c5014e0a0 con 0x7f3c500cb420 2023-12-20T04:53:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c54f47640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c501f4e40 con 0x7f3c500cf0b0 2023-12-20T04:53:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c54f47640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3c500c9460 con 0x7f3c5015e2d0 2023-12-20T04:53:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c4e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c500cb420 0x7f3c501f4900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c4e59c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c500cb420 0x7f3c501f4900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56454/0 (socket says 172.21.15.132:56454) 2023-12-20T04:53:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c4e59c640 1 -- 172.21.15.132:0/593237172 learned_addr learned my addr 172.21.15.132:0/593237172 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:51.249 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c4dd9b640 1 --2- 172.21.15.132:0/593237172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c500cf0b0 0x7f3c501478f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c4ed9d640 1 --2- 172.21.15.132:0/593237172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c5015e2d0 0x7f3c500ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c4e59c640 1 -- 172.21.15.132:0/593237172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c5015e2d0 msgr2=0x7f3c500ca500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c4e59c640 1 --2- 172.21.15.132:0/593237172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c5015e2d0 0x7f3c500ca500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c4e59c640 1 -- 172.21.15.132:0/593237172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c500cf0b0 msgr2=0x7f3c501478f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c4e59c640 1 --2- 172.21.15.132:0/593237172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c500cf0b0 0x7f3c501478f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c4e59c640 1 -- 172.21.15.132:0/593237172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c440094d0 con 0x7f3c500cb420 2023-12-20T04:53:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c4e59c640 1 --2- 172.21.15.132:0/593237172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c500cb420 0x7f3c501f4900 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000c4b0 tx=0x7f3c4000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c3effd640 1 -- 172.21.15.132:0/593237172 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c40005480 con 0x7f3c500cb420 2023-12-20T04:53:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c3effd640 1 -- 172.21.15.132:0/593237172 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3c400035f0 con 0x7f3c500cb420 2023-12-20T04:53:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c54f47640 1 -- 172.21.15.132:0/593237172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c48009a70 con 0x7f3c500cb420 2023-12-20T04:53:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c3effd640 1 -- 172.21.15.132:0/593237172 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3c400039e0 con 0x7f3c500cb420 2023-12-20T04:53:51.250 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.246+0000 7f3c54f47640 1 -- 172.21.15.132:0/593237172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c500c9a20 con 0x7f3c500cb420 2023-12-20T04:53:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.247+0000 7f3c54f47640 1 -- 172.21.15.132:0/593237172 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c500cdf30 con 0x7f3c500cb420 2023-12-20T04:53:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.248+0000 7f3c3effd640 1 -- 172.21.15.132:0/593237172 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3c40003b40 con 0x7f3c500cb420 2023-12-20T04:53:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.248+0000 7f3c3effd640 1 --2- 172.21.15.132:0/593237172 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3c3006a430 0x7f3c3006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.248+0000 7f3c4dd9b640 1 --2- 172.21.15.132:0/593237172 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3c3006a430 0x7f3c3006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.248+0000 7f3c3effd640 1 -- 172.21.15.132:0/593237172 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3c40087b90 con 0x7f3c500cb420 2023-12-20T04:53:51.251 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.249+0000 7f3c4dd9b640 1 --2- 172.21.15.132:0/593237172 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3c3006a430 0x7f3c3006c8f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3c5015ed50 tx=0x7f3c44009240 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:51.254 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.252+0000 7f3c3effd640 1 -- 172.21.15.132:0/593237172 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3c500cdf30 con 0x7f3c500cb420 2023-12-20T04:53:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.418+0000 7f3c54f47640 1 -- 172.21.15.132:0/593237172 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) v1 -- 0x7f3c500d02d0 con 0x7f3c3006a430 2023-12-20T04:53:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.418+0000 7f3c3effd640 1 -- 172.21.15.132:0/593237172 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) v1 ==== 41+0+0 (secure 0 0 0) 0x7f3c440099e0 con 0x7f3c3006a430 2023-12-20T04:53:51.420 INFO:teuthology.orchestra.run.smithi132.stderr:instructed osd(s) 7 to deep-scrub 2023-12-20T04:53:51.422 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.420+0000 7f3c54f47640 1 -- 172.21.15.132:0/593237172 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3c3006a430 msgr2=0x7f3c3006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.420+0000 7f3c54f47640 1 --2- 172.21.15.132:0/593237172 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3c3006a430 0x7f3c3006c8f0 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f3c5015ed50 tx=0x7f3c44009240 comp rx=0 tx=0).stop 2023-12-20T04:53:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.420+0000 7f3c54f47640 1 -- 172.21.15.132:0/593237172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c500cb420 msgr2=0x7f3c501f4900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.420+0000 7f3c54f47640 1 --2- 172.21.15.132:0/593237172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c500cb420 0x7f3c501f4900 secure :-1 s=READY pgs=1977 cs=0 l=1 rev1=1 crypto rx=0x7f3c4000c4b0 tx=0x7f3c4000c970 comp rx=0 tx=0).stop 2023-12-20T04:53:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.420+0000 7f3c54f47640 1 -- 172.21.15.132:0/593237172 shutdown_connections 2023-12-20T04:53:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.420+0000 7f3c54f47640 1 --2- 172.21.15.132:0/593237172 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3c3006a430 0x7f3c3006c8f0 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.420+0000 7f3c54f47640 1 --2- 172.21.15.132:0/593237172 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3c5015e2d0 0x7f3c500ca500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.420+0000 7f3c54f47640 1 --2- 172.21.15.132:0/593237172 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3c500cf0b0 0x7f3c501478f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.420+0000 7f3c54f47640 1 --2- 172.21.15.132:0/593237172 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3c500cb420 0x7f3c501f4900 unknown :-1 s=CLOSED pgs=1977 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.420+0000 7f3c54f47640 1 -- 172.21.15.132:0/593237172 >> 172.21.15.132:0/593237172 conn(0x7f3c5006d7c0 msgr2=0x7f3c5015d470 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.420+0000 7f3c54f47640 1 -- 172.21.15.132:0/593237172 shutdown_connections 2023-12-20T04:53:51.423 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.420+0000 7f3c54f47640 1 -- 172.21.15.132:0/593237172 wait complete. 2023-12-20T04:53:51.433 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:53:51.532 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.531+0000 7ff2d5696640 1 Processor -- start 2023-12-20T04:53:51.533 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.531+0000 7ff2d5696640 1 -- start start 2023-12-20T04:53:51.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.531+0000 7ff2d5696640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff2d0160450 0x7ff2d0160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:51.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.531+0000 7ff2d5696640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d00b5ec0 con 0x7ff2d00b5090 2023-12-20T04:53:51.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.531+0000 7ff2d5696640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7ff2d01617e0 con 0x7ff2d01611b0 2023-12-20T04:53:51.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.531+0000 7ff2d5696640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7ff2d00d0fc0 con 0x7ff2d0160450 2023-12-20T04:53:51.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.532+0000 7ff2ceffd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7ff2d0160450 0x7ff2d0160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:51.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.532+0000 7ff2cf7fe640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7ff2d00b5090 0x7ff2d00d1aa0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:47246/0 (socket says 172.21.15.132:47246) 2023-12-20T04:53:51.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.532+0000 7ff2cf7fe640 1 -- 172.21.15.132:0/761037830 learned_addr learned my addr 172.21.15.132:0/761037830 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:53:51.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.532+0000 7ff2ceffd640 1 -- 172.21.15.132:0/761037830 >> v1:172.21.15.187:6789/0 conn(0x7ff2d01611b0 legacy=0x7ff2d00b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.532+0000 7ff2ceffd640 1 -- 172.21.15.132:0/761037830 >> v1:172.21.15.132:6789/0 conn(0x7ff2d00b5090 legacy=0x7ff2d00d1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.532+0000 7ff2ceffd640 1 -- 172.21.15.132:0/761037830 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2d00d12a0 con 0x7ff2d0160450 2023-12-20T04:53:51.534 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.532+0000 7ff2cdffb640 1 -- 172.21.15.132:0/761037830 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 226240038 0 0) 0x7ff2d00b5ec0 con 0x7ff2d00b5090 2023-12-20T04:53:51.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.533+0000 7ff2ceffd640 1 --2- 172.21.15.132:0/761037830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2d0160450 0x7ff2d0160c70 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00097a0 tx=0x7ff2c002b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a91a5ca4df09f158 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:51.535 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.533+0000 7ff2cdffb640 1 -- 172.21.15.132:0/761037830 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c002f810 con 0x7ff2d0160450 2023-12-20T04:53:51.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.533+0000 7ff2cdffb640 1 -- 172.21.15.132:0/761037830 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c002f970 con 0x7ff2d0160450 2023-12-20T04:53:51.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.533+0000 7ff2cdffb640 1 -- 172.21.15.132:0/761037830 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c002fd00 con 0x7ff2d0160450 2023-12-20T04:53:51.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.533+0000 7ff2d5696640 1 -- 172.21.15.132:0/761037830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2d0160450 msgr2=0x7ff2d0160c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.533+0000 7ff2d5696640 1 --2- 172.21.15.132:0/761037830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2d0160450 0x7ff2d0160c70 secure :-1 s=READY pgs=1979 cs=0 l=1 rev1=1 crypto rx=0x7ff2c00097a0 tx=0x7ff2c002b9f0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.533+0000 7ff2d5696640 1 -- 172.21.15.132:0/761037830 shutdown_connections 2023-12-20T04:53:51.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.533+0000 7ff2d5696640 1 --2- 172.21.15.132:0/761037830 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2d0160450 0x7ff2d0160c70 unknown :-1 s=CLOSED pgs=1979 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.533+0000 7ff2d5696640 1 -- 172.21.15.132:0/761037830 >> 172.21.15.132:0/761037830 conn(0x7ff2d00cf980 msgr2=0x7ff2d00cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:51.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.533+0000 7ff2d5696640 1 -- 172.21.15.132:0/761037830 shutdown_connections 2023-12-20T04:53:51.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.533+0000 7ff2d5696640 1 -- 172.21.15.132:0/761037830 wait complete. 2023-12-20T04:53:51.536 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.535+0000 7ff2d5696640 1 Processor -- start 2023-12-20T04:53:51.537 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.535+0000 7ff2d5696640 1 -- start start 2023-12-20T04:53:51.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.535+0000 7ff2d5696640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2d00b5090 0x7ff2d00c89f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:51.538 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.535+0000 7ff2d5696640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2d0160450 0x7ff2d0144340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:51.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.535+0000 7ff2d5696640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2d01611b0 0x7ff2d00d2fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:51.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.535+0000 7ff2d5696640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d00c8f30 con 0x7ff2d01611b0 2023-12-20T04:53:51.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.535+0000 7ff2d5696640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d01f4830 con 0x7ff2d0160450 2023-12-20T04:53:51.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.535+0000 7ff2d5696640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7ff2d01f3c20 con 0x7ff2d00b5090 2023-12-20T04:53:51.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.535+0000 7ff2cf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2d01611b0 0x7ff2d00d2fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:51.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.535+0000 7ff2cf7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2d01611b0 0x7ff2d00d2fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:56470/0 (socket says 172.21.15.132:56470) 2023-12-20T04:53:51.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.535+0000 7ff2cf7fe640 1 -- 172.21.15.132:0/871189227 learned_addr learned my addr 172.21.15.132:0/871189227 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:53:51.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.536+0000 7ff2ce7fc640 1 --2- 172.21.15.132:0/871189227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2d0160450 0x7ff2d0144340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:51.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.536+0000 7ff2ceffd640 1 --2- 172.21.15.132:0/871189227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2d00b5090 0x7ff2d00c89f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:51.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.536+0000 7ff2cf7fe640 1 -- 172.21.15.132:0/871189227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2d00b5090 msgr2=0x7ff2d00c89f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.536+0000 7ff2cf7fe640 1 --2- 172.21.15.132:0/871189227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2d00b5090 0x7ff2d00c89f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.536+0000 7ff2cf7fe640 1 -- 172.21.15.132:0/871189227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2d0160450 msgr2=0x7ff2d0144340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.536+0000 7ff2cf7fe640 1 --2- 172.21.15.132:0/871189227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2d0160450 0x7ff2d0144340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.536+0000 7ff2cf7fe640 1 -- 172.21.15.132:0/871189227 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2c0009400 con 0x7ff2d01611b0 2023-12-20T04:53:51.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.536+0000 7ff2ceffd640 1 --2- 172.21.15.132:0/871189227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2d00b5090 0x7ff2d00c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:53:51.539 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.536+0000 7ff2cf7fe640 1 --2- 172.21.15.132:0/871189227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2d01611b0 0x7ff2d00d2fc0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800c7e0 tx=0x7ff2c800cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:51.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.536+0000 7ff2b77fe640 1 -- 172.21.15.132:0/871189227 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c800a640 con 0x7ff2d01611b0 2023-12-20T04:53:51.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.536+0000 7ff2b77fe640 1 -- 172.21.15.132:0/871189227 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7ff2c800a7c0 con 0x7ff2d01611b0 2023-12-20T04:53:51.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.536+0000 7ff2d5696640 1 -- 172.21.15.132:0/871189227 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2d01f3f00 con 0x7ff2d01611b0 2023-12-20T04:53:51.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.536+0000 7ff2b77fe640 1 -- 172.21.15.132:0/871189227 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7ff2c800ab70 con 0x7ff2d01611b0 2023-12-20T04:53:51.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.536+0000 7ff2d5696640 1 -- 172.21.15.132:0/871189227 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2d01f44c0 con 0x7ff2d01611b0 2023-12-20T04:53:51.540 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.537+0000 7ff2d5696640 1 -- 172.21.15.132:0/871189227 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff2d004e840 con 0x7ff2d01611b0 2023-12-20T04:53:51.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.537+0000 7ff2b77fe640 1 -- 172.21.15.132:0/871189227 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7ff2c800acd0 con 0x7ff2d01611b0 2023-12-20T04:53:51.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.538+0000 7ff2b77fe640 1 --2- 172.21.15.132:0/871189227 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff2bc06a460 0x7ff2bc06c920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:53:51.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.538+0000 7ff2b77fe640 1 -- 172.21.15.132:0/871189227 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7ff2c8087990 con 0x7ff2d01611b0 2023-12-20T04:53:51.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.538+0000 7ff2ceffd640 1 --2- 172.21.15.132:0/871189227 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff2bc06a460 0x7ff2bc06c920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:53:51.541 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.538+0000 7ff2ceffd640 1 --2- 172.21.15.132:0/871189227 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff2bc06a460 0x7ff2bc06c920 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0036000 tx=0x7ff2c0008030 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:53:51.544 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.542+0000 7ff2b77fe640 1 -- 172.21.15.132:0/871189227 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7ff2c80533c0 con 0x7ff2d01611b0 2023-12-20T04:53:51.705 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.703+0000 7ff2d5696640 1 -- 172.21.15.132:0/871189227 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7ff2d00b89d0 con 0x7ff2bc06a460 2023-12-20T04:53:51.707 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.705+0000 7ff2b77fe640 1 -- 172.21.15.132:0/871189227 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50303 (secure 0 0 0) 0x7ff2c002f7f0 con 0x7ff2bc06a460 2023-12-20T04:53:51.708 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:53:51.708 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:53:51.709 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.707+0000 7ff2d5696640 1 -- 172.21.15.132:0/871189227 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff2bc06a460 msgr2=0x7ff2bc06c920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.707+0000 7ff2d5696640 1 --2- 172.21.15.132:0/871189227 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff2bc06a460 0x7ff2bc06c920 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7ff2c0036000 tx=0x7ff2c0008030 comp rx=0 tx=0).stop 2023-12-20T04:53:51.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.707+0000 7ff2d5696640 1 -- 172.21.15.132:0/871189227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2d01611b0 msgr2=0x7ff2d00d2fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:53:51.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.707+0000 7ff2d5696640 1 --2- 172.21.15.132:0/871189227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2d01611b0 0x7ff2d00d2fc0 secure :-1 s=READY pgs=1980 cs=0 l=1 rev1=1 crypto rx=0x7ff2c800c7e0 tx=0x7ff2c800cca0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.707+0000 7ff2d5696640 1 -- 172.21.15.132:0/871189227 shutdown_connections 2023-12-20T04:53:51.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.707+0000 7ff2d5696640 1 --2- 172.21.15.132:0/871189227 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7ff2bc06a460 0x7ff2bc06c920 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.707+0000 7ff2d5696640 1 --2- 172.21.15.132:0/871189227 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7ff2d01611b0 0x7ff2d00d2fc0 unknown :-1 s=CLOSED pgs=1980 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.707+0000 7ff2d5696640 1 --2- 172.21.15.132:0/871189227 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7ff2d0160450 0x7ff2d0144340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.707+0000 7ff2d5696640 1 --2- 172.21.15.132:0/871189227 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7ff2d00b5090 0x7ff2d00c89f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:53:51.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.707+0000 7ff2d5696640 1 -- 172.21.15.132:0/871189227 >> 172.21.15.132:0/871189227 conn(0x7ff2d00cf980 msgr2=0x7ff2d0152cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:53:51.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.707+0000 7ff2d5696640 1 -- 172.21.15.132:0/871189227 shutdown_connections 2023-12-20T04:53:51.710 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:53:51.708+0000 7ff2d5696640 1 -- 172.21.15.132:0/871189227 wait complete. 2023-12-20T04:53:51.720 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":522,"stamp":"2023-12-20T04:53:50.240489+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":108,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9640,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552859,"statfs":{"total":1600000000,"available":1590127656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-52487179,"num_objects":-36,"num_object_clones":0,"num_object_copies":-72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-36,"num_whiteouts":0,"num_read":-2,"num_read_kb":-2,"num_write":-124,"num_write_kb":-85084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":-14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.001515"},"pg_stats":[{"pgid":"1.0","version":"15'117","reported_seq":317,"reported_epoch":192,"state":"active+clean","last_fresh":"2023-12-20T04:53:43.274738+0000","last_change":"2023-12-20T04:42:37.672206+0000","last_active":"2023-12-20T04:53:43.274738+0000","last_peered":"2023-12-20T04:53:43.274738+0000","last_clean":"2023-12-20T04:53:43.274738+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:53:43.274738+0000","last_undegraded":"2023-12-20T04:53:43.274738+0000","last_fullsized":"2023-12-20T04:53:43.274738+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2023-12-20T04:42:36.662454+0000","last_clean_scrub_stamp":"2023-12-20T04:42:36.662454+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:52:39.381486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574984,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193674,"statfs":{"total":200000000,"available":198323181,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54000000000000004,"5min":0.56000000000000005,"15min":0.54400000000000004},"min":{"1min":0.43099999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.70299999999999996,"5min":0.77700000000000002,"15min":1.0860000000000001},"last":0.65500000000000003},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.54200000000000004,"15min":0.53000000000000003},"min":{"1min":0.38100000000000001,"5min":0.378,"15min":0.25600000000000001},"max":{"1min":0.81899999999999995,"5min":0.81899999999999995,"15min":0.86299999999999999},"last":0.54200000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.56799999999999995,"15min":0.55300000000000005},"min":{"1min":0.34899999999999998,"5min":0.33100000000000002,"15min":0.26900000000000002},"max":{"1min":0.71699999999999997,"5min":0.76500000000000001,"15min":0.98799999999999999},"last":0.52800000000000002},{"interface":"front","average":{"1min":0.58999999999999997,"5min":0.59699999999999998,"15min":0.58399999999999996},"min":{"1min":0.45700000000000002,"5min":0.376,"15min":0.374},"max":{"1min":0.77400000000000002,"5min":0.79500000000000004,"15min":1.0269999999999999},"last":0.63200000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.53800000000000003,"5min":0.55300000000000005,"15min":0.54300000000000004},"min":{"1min":0.375,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.65100000000000002,"5min":0.75900000000000001,"15min":1.0069999999999999},"last":0.623},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.54300000000000004,"15min":0.54600000000000004},"min":{"1min":0.47599999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.67100000000000004,"5min":0.75700000000000001,"15min":0.78000000000000003},"last":0.55600000000000005}]},{"osd":3,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56699999999999995,"15min":0.56000000000000005},"min":{"1min":0.41599999999999998,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.65800000000000003,"5min":0.78300000000000003,"15min":1.048},"last":0.68300000000000005},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.56799999999999995,"15min":0.56599999999999995},"min":{"1min":0.42499999999999999,"5min":0.39200000000000002,"15min":0.34599999999999997},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.60299999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.43099999999999999,"5min":0.46999999999999997,"15min":0.47999999999999998},"min":{"1min":0.32800000000000001,"5min":0.28499999999999998,"15min":0.26700000000000002},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.48099999999999998},{"interface":"front","average":{"1min":0.44400000000000001,"5min":0.48699999999999999,"15min":0.48899999999999999},"min":{"1min":0.30599999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.79300000000000004,"5min":0.79300000000000004,"15min":0.89700000000000002},"last":0.58599999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.42199999999999999,"5min":0.46300000000000002,"15min":0.47999999999999998},"min":{"1min":0.33600000000000002,"5min":0.255,"15min":0.255},"max":{"1min":0.70399999999999996,"5min":0.73099999999999998,"15min":0.73799999999999999},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.47799999999999998,"5min":0.51900000000000002,"15min":0.53100000000000003},"min":{"1min":0.36499999999999999,"5min":0.313,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.56499999999999995}]},{"osd":6,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.51900000000000002,"15min":0.53200000000000003},"min":{"1min":0.35299999999999998,"5min":0.33300000000000002,"15min":0.32500000000000001},"max":{"1min":0.755,"5min":0.77800000000000002,"15min":0.89800000000000002},"last":0.57599999999999996},{"interface":"front","average":{"1min":0.46700000000000003,"5min":0.53400000000000003,"15min":0.53600000000000003},"min":{"1min":0.34999999999999998,"5min":0.34000000000000002,"15min":0.28899999999999998},"max":{"1min":0.74299999999999999,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.498}]}]},{"osd":6,"up_from":13,"seq":55834574985,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53200000000000003,"5min":0.55800000000000005,"15min":0.51900000000000002},"min":{"1min":0.36499999999999999,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.71099999999999997,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.622},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.53900000000000003,"15min":0.53600000000000003},"min":{"1min":0.35899999999999999,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.57699999999999996}]},{"osd":1,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58799999999999997,"5min":0.56699999999999995,"15min":0.54600000000000004},"min":{"1min":0.40000000000000002,"5min":0.32100000000000001,"15min":0.30099999999999999},"max":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.59999999999999998,"5min":0.58399999999999996,"15min":0.57799999999999996},"min":{"1min":0.40100000000000002,"5min":0.315,"15min":0.315},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.59199999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55000000000000004,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.38200000000000001,"15min":0.27000000000000002},"max":{"1min":0.72599999999999998,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.55400000000000005,"15min":0.54200000000000004},"min":{"1min":0.376,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":0.84899999999999998,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.55600000000000005}]},{"osd":3,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.55000000000000004,"15min":0.52200000000000002},"min":{"1min":0.38800000000000001,"5min":0.38800000000000001,"15min":0.33700000000000002},"max":{"1min":0.73299999999999998,"5min":0.752,"15min":0.77800000000000002},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.43099999999999999,"5min":0.309,"15min":0.309},"max":{"1min":0.749,"5min":0.77200000000000002,"15min":0.78900000000000003},"last":0.65800000000000003}]},{"osd":4,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.48199999999999998,"15min":0.49399999999999999},"min":{"1min":0.32100000000000001,"5min":0.313,"15min":0.28499999999999998},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.81899999999999995},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48699999999999999,"15min":0.49299999999999999},"min":{"1min":0.26700000000000002,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.67600000000000005,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.67300000000000004}]},{"osd":5,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49199999999999999,"5min":0.49099999999999999,"15min":0.50700000000000001},"min":{"1min":0.29399999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.755,"5min":0.76300000000000001,"15min":0.76300000000000001},"last":0.45400000000000001},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.53400000000000003,"15min":0.54600000000000004},"min":{"1min":0.38400000000000001,"5min":0.34399999999999997,"15min":0.32000000000000001},"max":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.85499999999999998},"last":0.64800000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:52:54 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52900000000000003,"15min":0.54000000000000004},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.86599999999999999,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.70199999999999996},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.58299999999999996,"15min":0.58299999999999996},"min":{"1min":0.33700000000000002,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"last":0.72499999999999998}]}]},{"osd":5,"up_from":13,"seq":55834574984,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.56499999999999995,"15min":0.53200000000000003},"min":{"1min":0.38200000000000001,"5min":0.32200000000000001,"15min":0.23200000000000001},"max":{"1min":0.69099999999999995,"5min":0.747,"15min":0.748},"last":0.52100000000000002},{"interface":"front","average":{"1min":0.60399999999999998,"5min":0.58899999999999997,"15min":0.57199999999999995},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.74299999999999999,"5min":0.78700000000000003,"15min":0.82299999999999995},"last":0.56599999999999995}]},{"osd":1,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.59999999999999998,"5min":0.57299999999999995,"15min":0.55600000000000005},"min":{"1min":0.437,"5min":0.39800000000000002,"15min":0.26000000000000001},"max":{"1min":0.755,"5min":0.755,"15min":0.82099999999999995},"last":0.57499999999999996},{"interface":"front","average":{"1min":0.62,"5min":0.59099999999999997,"15min":0.58399999999999996},"min":{"1min":0.443,"5min":0.41799999999999998,"15min":0.34100000000000003},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.84899999999999998},"last":0.54300000000000004}]},{"osd":2,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56100000000000005,"5min":0.53800000000000003,"15min":0.52300000000000002},"min":{"1min":0.45000000000000001,"5min":0.34100000000000003,"15min":0.28199999999999997},"max":{"1min":0.69399999999999995,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.54900000000000004,"15min":0.53100000000000003},"min":{"1min":0.438,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.73499999999999999,"5min":0.76600000000000001,"15min":0.77100000000000002},"last":0.53000000000000003}]},{"osd":3,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53300000000000003,"15min":0.52900000000000003},"min":{"1min":0.42699999999999999,"5min":0.34699999999999998,"15min":0.29899999999999999},"max":{"1min":0.71499999999999997,"5min":0.71699999999999997,"15min":0.80900000000000005},"last":0.50800000000000001},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.56399999999999995,"15min":0.55300000000000005},"min":{"1min":0.46500000000000002,"5min":0.38400000000000001,"15min":0.312},"max":{"1min":0.71199999999999997,"5min":0.74199999999999999,"15min":0.77400000000000002},"last":0.47799999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.47999999999999998},"min":{"1min":0.31900000000000001,"5min":0.28299999999999997,"15min":0.249},"max":{"1min":0.68799999999999994,"5min":0.80400000000000005,"15min":0.81899999999999995},"last":0.45700000000000002},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.45900000000000002,"15min":0.47299999999999998},"min":{"1min":0.32900000000000001,"5min":0.29799999999999999,"15min":0.29399999999999998},"max":{"1min":0.64200000000000002,"5min":0.749,"15min":0.75700000000000001},"last":0.42099999999999999}]},{"osd":6,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.441,"5min":0.46400000000000002,"15min":0.48899999999999999},"min":{"1min":0.35799999999999998,"5min":0.254,"15min":0.254},"max":{"1min":0.64900000000000002,"5min":0.75600000000000001,"15min":0.85299999999999998},"last":0.436},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.50900000000000001,"15min":0.52900000000000003},"min":{"1min":0.36899999999999999,"5min":0.33900000000000002,"15min":0.31},"max":{"1min":0.66800000000000004,"5min":0.82599999999999996,"15min":0.83999999999999997},"last":0.40300000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.495,"15min":0.51500000000000001},"min":{"1min":0.313,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66900000000000004,"5min":0.78400000000000003,"15min":0.79800000000000004},"last":0.36899999999999999},{"interface":"front","average":{"1min":0.54500000000000004,"5min":0.55600000000000005,"15min":0.58599999999999997},"min":{"1min":0.437,"5min":0.311,"15min":0.311},"max":{"1min":0.67800000000000005,"5min":0.77700000000000002,"15min":0.98599999999999999},"last":0.55500000000000005}]}]},{"osd":4,"up_from":13,"seq":55834574984,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.52600000000000002,"15min":0.52400000000000002},"min":{"1min":0.46800000000000003,"5min":0.25700000000000001,"15min":0.19700000000000001},"max":{"1min":0.74199999999999999,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.54600000000000004,"15min":0.53100000000000003},"min":{"1min":0.38600000000000001,"5min":0.309,"15min":0.251},"max":{"1min":0.76200000000000001,"5min":0.875,"15min":0.875},"last":0.46300000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.53700000000000003,"15min":0.52500000000000002},"min":{"1min":0.41499999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.69399999999999995,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.374},{"interface":"front","average":{"1min":0.627,"5min":0.55100000000000005,"15min":0.53500000000000003},"min":{"1min":0.50800000000000001,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.77000000000000002,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.38200000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.55300000000000005,"15min":0.55200000000000005},"min":{"1min":0.378,"5min":0.316,"15min":0.313},"max":{"1min":0.73199999999999998,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.47299999999999998},{"interface":"front","average":{"1min":0.57099999999999995,"5min":0.54300000000000004,"15min":0.54500000000000004},"min":{"1min":0.40400000000000003,"5min":0.33300000000000002,"15min":0.23400000000000001},"max":{"1min":0.69599999999999995,"5min":0.746,"15min":0.80400000000000005},"last":0.42999999999999999}]},{"osd":3,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.621,"5min":0.57999999999999996,"15min":0.56499999999999995},"min":{"1min":0.46000000000000002,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.746,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.61799999999999999,"5min":0.58599999999999997,"15min":0.58799999999999997},"min":{"1min":0.44800000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.75700000000000001,"5min":0.88800000000000001,"15min":0.91000000000000003},"last":0.45200000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.45200000000000001,"5min":0.46000000000000002,"15min":0.46300000000000002},"min":{"1min":0.314,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":0.68799999999999994,"5min":0.79100000000000004,"15min":0.79100000000000004},"last":0.29999999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.48899999999999999,"15min":0.498},"min":{"1min":0.33800000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.60699999999999998,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.44}]},{"osd":6,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.48299999999999998,"5min":0.48399999999999999,"15min":0.49399999999999999},"min":{"1min":0.38200000000000001,"5min":0.28799999999999998,"15min":0.26400000000000001},"max":{"1min":0.61399999999999999,"5min":0.73099999999999998,"15min":0.82399999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51200000000000001,"15min":0.52000000000000002},"min":{"1min":0.35399999999999998,"5min":0.28799999999999998,"15min":0.28799999999999998},"max":{"1min":0.70399999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.35899999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:52:56 2023","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.52700000000000002,"15min":0.51900000000000002},"min":{"1min":0.34899999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.69699999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.34699999999999998},{"interface":"front","average":{"1min":0.54300000000000004,"5min":0.54200000000000004,"15min":0.54400000000000004},"min":{"1min":0.432,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78000000000000003,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.41999999999999998}]}]},{"osd":3,"up_from":13,"seq":55834574984,"num_pgs":24,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.34899999999999998,"15min":0.34499999999999997},"min":{"1min":0.25600000000000001,"5min":0.19800000000000001,"15min":0.193},"max":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.629},"last":0.21199999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.38200000000000001,"15min":0.36699999999999999},"min":{"1min":0.28399999999999997,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":0.54100000000000004,"5min":0.58199999999999996,"15min":0.64000000000000001},"last":0.30399999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.34300000000000003,"15min":0.33000000000000002},"min":{"1min":0.24299999999999999,"5min":0.19600000000000001,"15min":0.19600000000000001},"max":{"1min":0.499,"5min":0.62,"15min":0.62},"last":0.22800000000000001},{"interface":"front","average":{"1min":0.376,"5min":0.36599999999999999,"15min":0.35099999999999998},"min":{"1min":0.29399999999999998,"5min":0.24099999999999999,"15min":0.20399999999999999},"max":{"1min":0.48199999999999998,"5min":0.55800000000000005,"15min":0.61699999999999999},"last":0.246}]},{"osd":2,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.35799999999999998,"15min":0.34999999999999998},"min":{"1min":0.253,"5min":0.22600000000000001,"15min":0.21199999999999999},"max":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.64900000000000002},"last":0.27200000000000002},{"interface":"front","average":{"1min":0.41799999999999998,"5min":0.39600000000000002,"15min":0.38600000000000001},"min":{"1min":0.32300000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.52500000000000002,"5min":0.59399999999999997,"15min":0.63600000000000001},"last":0.28999999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.58199999999999996,"15min":0.55900000000000005},"min":{"1min":0.436,"5min":0.36599999999999999,"15min":0.35199999999999998},"max":{"1min":0.80200000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"last":0.55300000000000005},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.59099999999999997,"15min":0.57299999999999995},"min":{"1min":0.40799999999999997,"5min":0.39400000000000002,"15min":0.313},"max":{"1min":0.86599999999999999,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.65400000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.58499999999999996,"15min":0.57099999999999995},"min":{"1min":0.42299999999999999,"5min":0.40000000000000002,"15min":0.31},"max":{"1min":0.71299999999999997,"5min":0.82399999999999995,"15min":0.872},"last":0.60299999999999998},{"interface":"front","average":{"1min":0.58799999999999997,"5min":0.60599999999999998,"15min":0.57599999999999996},"min":{"1min":0.40699999999999997,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.878,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.52700000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.60799999999999998,"15min":0.58899999999999997},"min":{"1min":0.442,"5min":0.375,"15min":0.33900000000000002},"max":{"1min":0.83899999999999997,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.51900000000000002},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.37},"max":{"1min":0.75600000000000001,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.63200000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:52:59 2023","interfaces":[{"interface":"back","average":{"1min":0.57999999999999996,"5min":0.59499999999999997,"15min":0.57899999999999996},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.38500000000000001},"max":{"1min":0.82799999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.498},{"interface":"front","average":{"1min":0.59699999999999998,"5min":0.623,"15min":0.59499999999999997},"min":{"1min":0.44900000000000001,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":0.79200000000000004,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.68799999999999994}]}]},{"osd":2,"up_from":13,"seq":55834574984,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35599999999999998,"5min":0.34899999999999998,"15min":0.32200000000000001},"min":{"1min":0.17899999999999999,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.45300000000000001,"5min":0.57299999999999995,"15min":0.72699999999999998},"last":0.20599999999999999},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.39600000000000002,"15min":0.37},"min":{"1min":0.28399999999999997,"5min":0.27500000000000002,"15min":0.17699999999999999},"max":{"1min":0.52000000000000002,"5min":0.54100000000000004,"15min":2.0539999999999998},"last":0.253}]},{"osd":1,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.378,"15min":0.35099999999999998},"min":{"1min":0.23699999999999999,"5min":0.22600000000000001,"15min":0.17999999999999999},"max":{"1min":0.51300000000000001,"5min":0.56299999999999994,"15min":0.83099999999999996},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.439,"5min":0.40300000000000002,"15min":0.372},"min":{"1min":0.27000000000000002,"5min":0.23100000000000001,"15min":0.20000000000000001},"max":{"1min":0.57099999999999995,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.28299999999999997}]},{"osd":3,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.438,"5min":0.41399999999999998,"15min":0.38500000000000001},"min":{"1min":0.29799999999999999,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.56299999999999994,"5min":0.60399999999999998,"15min":0.995},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.45200000000000001,"5min":0.41599999999999998,"15min":0.39100000000000001},"min":{"1min":0.308,"5min":0.218,"15min":0.218},"max":{"1min":0.57199999999999995,"5min":0.64400000000000002,"15min":0.76600000000000001},"last":0.313}]},{"osd":4,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.63800000000000001,"5min":0.59799999999999998,"15min":0.57899999999999996},"min":{"1min":0.41099999999999998,"5min":0.36899999999999999,"15min":0.32500000000000001},"max":{"1min":0.76900000000000002,"5min":0.88100000000000001,"15min":0.88100000000000001},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.65500000000000003,"5min":0.60099999999999998,"15min":0.58499999999999996},"min":{"1min":0.38200000000000001,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.83999999999999997,"5min":0.878,"15min":2.347},"last":0.51900000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.60399999999999998,"15min":0.58699999999999997},"min":{"1min":0.375,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.79000000000000004,"5min":0.84299999999999997,"15min":0.997},"last":0.54600000000000004},{"interface":"front","average":{"1min":0.64000000000000001,"5min":0.59899999999999998,"15min":0.57099999999999995},"min":{"1min":0.45300000000000001,"5min":0.371,"15min":0.371},"max":{"1min":0.83999999999999997,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.66200000000000003}]},{"osd":6,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64400000000000002,"5min":0.60199999999999998,"15min":0.58699999999999997},"min":{"1min":0.46500000000000002,"5min":0.371,"15min":0.371},"max":{"1min":0.84999999999999998,"5min":0.877,"15min":2.274},"last":0.67300000000000004},{"interface":"front","average":{"1min":0.65900000000000003,"5min":0.61299999999999999,"15min":0.58899999999999997},"min":{"1min":0.503,"5min":0.38,"15min":0.373},"max":{"1min":0.84599999999999997,"5min":0.89300000000000002,"15min":1.0289999999999999},"last":0.59599999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:52:58 2023","interfaces":[{"interface":"back","average":{"1min":0.65300000000000002,"5min":0.60299999999999998,"15min":0.58599999999999997},"min":{"1min":0.442,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.85699999999999998,"5min":0.89800000000000002,"15min":2.3090000000000002},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.66600000000000004,"5min":0.61699999999999999,"15min":0.59399999999999997},"min":{"1min":0.45200000000000001,"5min":0.40500000000000003,"15min":0.379},"max":{"1min":0.82299999999999995,"5min":0.873,"15min":1.0549999999999999},"last":0.56999999999999995}]}]},{"osd":1,"up_from":13,"seq":55834574985,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36599999999999999,"5min":0.34899999999999998,"15min":0.314},"min":{"1min":0.23599999999999999,"5min":0.20899999999999999,"15min":0.16400000000000001},"max":{"1min":0.65100000000000002,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.25700000000000001},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.38700000000000001,"15min":0.35299999999999998},"min":{"1min":0.29599999999999999,"5min":0.25,"15min":0.22700000000000001},"max":{"1min":0.53600000000000003,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.26900000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.36199999999999999,"15min":0.32900000000000001},"min":{"1min":0.24099999999999999,"5min":0.23000000000000001,"15min":0.19500000000000001},"max":{"1min":0.57899999999999996,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.24099999999999999},{"interface":"front","average":{"1min":0.435,"5min":0.40100000000000002,"15min":0.372},"min":{"1min":0.307,"5min":0.23499999999999999,"15min":0.224},"max":{"1min":0.53700000000000003,"5min":0.57099999999999995,"15min":0.57299999999999995},"last":0.29499999999999998}]},{"osd":3,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.42199999999999999,"15min":0.38400000000000001},"min":{"1min":0.26900000000000002,"5min":0.221,"15min":0.191},"max":{"1min":0.60399999999999998,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.317},{"interface":"front","average":{"1min":0.40000000000000002,"5min":0.38200000000000001,"15min":0.36399999999999999},"min":{"1min":0.28000000000000003,"5min":0.22500000000000001,"15min":0.20399999999999999},"max":{"1min":0.56499999999999995,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.32700000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.64200000000000002,"5min":0.60699999999999998,"15min":0.57499999999999996},"min":{"1min":0.498,"5min":0.35599999999999998,"15min":0.312},"max":{"1min":0.79100000000000004,"5min":0.89700000000000002,"15min":0.89700000000000002},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.59999999999999998,"15min":0.56899999999999995},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.34899999999999998},"max":{"1min":0.78900000000000003,"5min":0.90900000000000003,"15min":1.002},"last":0.53600000000000003}]},{"osd":5,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.59899999999999998,"15min":0.57199999999999995},"min":{"1min":0.434,"5min":0.40899999999999997,"15min":0.318},"max":{"1min":0.74299999999999999,"5min":0.79200000000000004,"15min":0.86099999999999999},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.61399999999999999,"5min":0.61099999999999999,"15min":0.56799999999999995},"min":{"1min":0.48199999999999998,"5min":0.38300000000000001,"15min":0.317},"max":{"1min":0.81599999999999995,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.504}]},{"osd":6,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.629,"5min":0.60299999999999998,"15min":0.57399999999999995},"min":{"1min":0.51000000000000001,"5min":0.38300000000000001,"15min":0.36899999999999999},"max":{"1min":0.72099999999999997,"5min":0.92400000000000004,"15min":1.038},"last":0.54700000000000004},{"interface":"front","average":{"1min":0.623,"5min":0.60599999999999998,"15min":0.57899999999999996},"min":{"1min":0.45900000000000002,"5min":0.40600000000000003,"15min":0.39100000000000001},"max":{"1min":0.80200000000000005,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.49399999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:52:51 2023","interfaces":[{"interface":"back","average":{"1min":0.65800000000000003,"5min":0.64200000000000002,"15min":0.60899999999999999},"min":{"1min":0.52500000000000002,"5min":0.40799999999999997,"15min":0.36899999999999999},"max":{"1min":0.80600000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.63800000000000001,"5min":0.64200000000000002,"15min":0.61599999999999999},"min":{"1min":0.52900000000000003,"5min":0.41899999999999998,"15min":0.376},"max":{"1min":0.82199999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.57399999999999995}]}]},{"osd":0,"up_from":13,"seq":55834574984,"num_pgs":22,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193674,"statfs":{"total":200000000,"available":198323181,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.35099999999999998,"15min":0.32600000000000001},"min":{"1min":0.214,"5min":0.189,"15min":0.184},"max":{"1min":0.51700000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.36399999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.35799999999999998,"15min":0.33300000000000002},"min":{"1min":0.20999999999999999,"5min":0.20699999999999999,"15min":0.184},"max":{"1min":0.57399999999999995,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.245}]},{"osd":2,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.40200000000000002,"5min":0.376,"15min":0.36499999999999999},"min":{"1min":0.248,"5min":0.22800000000000001,"15min":0.218},"max":{"1min":0.55600000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.26400000000000001},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.38400000000000001,"15min":0.36199999999999999},"min":{"1min":0.247,"5min":0.247,"15min":0.23100000000000001},"max":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.622},"last":0.32000000000000001}]},{"osd":3,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.41199999999999998,"5min":0.376,"15min":0.34599999999999997},"min":{"1min":0.25900000000000001,"5min":0.224,"15min":0.224},"max":{"1min":0.58899999999999997,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.40699999999999997,"15min":0.38400000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27400000000000002},"max":{"1min":0.60799999999999998,"5min":0.625,"15min":0.625},"last":0.29199999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.61799999999999999,"5min":0.57499999999999996,"15min":0.54500000000000004},"min":{"1min":0.437,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.872,"5min":0.872,"15min":0.872},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.59199999999999997,"5min":0.57699999999999996,"15min":0.55400000000000005},"min":{"1min":0.46500000000000002,"5min":0.317,"15min":0.317},"max":{"1min":0.74199999999999999,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.51200000000000001}]},{"osd":5,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.59899999999999998,"5min":0.57399999999999995,"15min":0.54400000000000004},"min":{"1min":0.42599999999999999,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":0.85999999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.438},{"interface":"front","average":{"1min":0.62,"5min":0.59999999999999998,"15min":0.56899999999999995},"min":{"1min":0.45300000000000001,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.86199999999999999},"last":0.55800000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.65000000000000002,"5min":0.61399999999999999,"15min":0.59699999999999998},"min":{"1min":0.49199999999999999,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.82499999999999996,"5min":0.88100000000000001,"15min":0.89600000000000002},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.65300000000000002,"5min":0.62,"15min":0.59899999999999998},"min":{"1min":0.51100000000000001,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.84599999999999997,"5min":0.89500000000000002,"15min":0.90000000000000002},"last":0.54300000000000004}]},{"osd":7,"last update":"Wed Dec 20 04:52:47 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.59999999999999998,"15min":0.57099999999999995},"min":{"1min":0.47199999999999998,"5min":0.379,"15min":0.375},"max":{"1min":0.76400000000000001,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.49199999999999999},{"interface":"front","average":{"1min":0.629,"5min":0.60599999999999998,"15min":0.58599999999999997},"min":{"1min":0.48999999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.79800000000000004,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.47899999999999998}]}]}],"pool_statfs":[]}} 2023-12-20T04:53:51.725 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2023-12-20T04:42:36.662454+0000 time.struct_time(tm_year=2023, tm_mon=12, tm_mday=20, tm_hour=4, tm_min=42, tm_sec=36, tm_wday=2, tm_yday=354, tm_isdst=-1) <= time.struct_time(tm_year=2023, tm_mon=12, tm_mday=20, tm_hour=4, tm_min=53, tm_sec=46, tm_wday=2, tm_yday=354, tm_isdst=0) 2023-12-20T04:53:51.725 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2023-12-20T04:54:11.727 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2023-12-20T04:54:11.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.837+0000 7fc9ce282640 1 Processor -- start 2023-12-20T04:54:11.839 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.837+0000 7fc9ce282640 1 -- start start 2023-12-20T04:54:11.840 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.837+0000 7fc9ce282640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc9c815ad70 0x7fc9c806f560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:11.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.837+0000 7fc9ce282640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9c80c92d0 0x7fc9c815f170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:11.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.837+0000 7fc9ce282640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7fc9c815f6b0 0x7fc9c806b130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:11.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.837+0000 7fc9ce282640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c815ea40 con 0x7fc9c815ad70 2023-12-20T04:54:11.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.837+0000 7fc9ce282640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7fc9c80c9ab0 con 0x7fc9c815f6b0 2023-12-20T04:54:11.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.837+0000 7fc9ce282640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c80c9d90 con 0x7fc9c80c92d0 2023-12-20T04:54:11.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.838+0000 7fc9c7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc9c815ad70 0x7fc9c806f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:11.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.838+0000 7fc9c7fff640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7fc9c815ad70 0x7fc9c806f560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34222/0 (socket says 172.21.15.132:34222) 2023-12-20T04:54:11.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.838+0000 7fc9c7fff640 1 -- 172.21.15.132:0/1288384498 learned_addr learned my addr 172.21.15.132:0/1288384498 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:54:11.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.838+0000 7fc9cc81f640 1 --2- 172.21.15.132:0/1288384498 >> v2:172.21.15.187:3300/0 conn(0x7fc9c815f6b0 0x7fc9c806b130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:11.841 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.838+0000 7fc9c77fe640 1 --2- 172.21.15.132:0/1288384498 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9c80c92d0 0x7fc9c815f170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:11.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.838+0000 7fc9c7fff640 1 -- 172.21.15.132:0/1288384498 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9c80c92d0 msgr2=0x7fc9c815f170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:54:11.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.838+0000 7fc9c7fff640 1 --2- 172.21.15.132:0/1288384498 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9c80c92d0 0x7fc9c815f170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:11.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.838+0000 7fc9c7fff640 1 -- 172.21.15.132:0/1288384498 >> v2:172.21.15.187:3300/0 conn(0x7fc9c815f6b0 msgr2=0x7fc9c806b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:54:11.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.838+0000 7fc9c7fff640 1 --2- 172.21.15.132:0/1288384498 >> v2:172.21.15.187:3300/0 conn(0x7fc9c815f6b0 0x7fc9c806b130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:11.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.838+0000 7fc9c7fff640 1 -- 172.21.15.132:0/1288384498 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9c80ca070 con 0x7fc9c815ad70 2023-12-20T04:54:11.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.839+0000 7fc9c7fff640 1 --2- 172.21.15.132:0/1288384498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9c815ad70 0x7fc9c806f560 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7fc9c806c580 tx=0x7fc9b802b910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2b42629e79a84cfd server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:54:11.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.839+0000 7fc9c6ffd640 1 -- 172.21.15.132:0/1288384498 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8031870 con 0x7fc9c815ad70 2023-12-20T04:54:11.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.839+0000 7fc9c6ffd640 1 -- 172.21.15.132:0/1288384498 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9b80319d0 con 0x7fc9c815ad70 2023-12-20T04:54:11.842 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.839+0000 7fc9c6ffd640 1 -- 172.21.15.132:0/1288384498 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9b8031d60 con 0x7fc9c815ad70 2023-12-20T04:54:11.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.839+0000 7fc9ce282640 1 -- 172.21.15.132:0/1288384498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9c815ad70 msgr2=0x7fc9c806f560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:54:11.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.839+0000 7fc9ce282640 1 --2- 172.21.15.132:0/1288384498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9c815ad70 0x7fc9c806f560 secure :-1 s=READY pgs=1981 cs=0 l=1 rev1=1 crypto rx=0x7fc9c806c580 tx=0x7fc9b802b910 comp rx=0 tx=0).stop 2023-12-20T04:54:11.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.839+0000 7fc9ce282640 1 -- 172.21.15.132:0/1288384498 shutdown_connections 2023-12-20T04:54:11.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.839+0000 7fc9ce282640 1 --2- 172.21.15.132:0/1288384498 >> v2:172.21.15.187:3300/0 conn(0x7fc9c815f6b0 0x7fc9c806b130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:11.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.839+0000 7fc9ce282640 1 --2- 172.21.15.132:0/1288384498 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9c80c92d0 0x7fc9c815f170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:11.845 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.839+0000 7fc9ce282640 1 --2- 172.21.15.132:0/1288384498 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9c815ad70 0x7fc9c806f560 unknown :-1 s=CLOSED pgs=1981 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:11.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.839+0000 7fc9ce282640 1 -- 172.21.15.132:0/1288384498 >> 172.21.15.132:0/1288384498 conn(0x7fc9c80ced10 msgr2=0x7fc9c80cf0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:54:11.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.839+0000 7fc9ce282640 1 -- 172.21.15.132:0/1288384498 shutdown_connections 2023-12-20T04:54:11.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.839+0000 7fc9ce282640 1 -- 172.21.15.132:0/1288384498 wait complete. 2023-12-20T04:54:11.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.841+0000 7fc9ce282640 1 Processor -- start 2023-12-20T04:54:11.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.841+0000 7fc9ce282640 1 -- start start 2023-12-20T04:54:11.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9ce282640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9c80c92d0 0x7fc9c80c5270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:11.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9ce282640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9c815ad70 0x7fc9c80c7f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:11.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9ce282640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9c815f6b0 0x7fc9c80c84d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:11.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9ce282640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c81f3be0 con 0x7fc9c815ad70 2023-12-20T04:54:11.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9ce282640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c81f3ec0 con 0x7fc9c815f6b0 2023-12-20T04:54:11.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9ce282640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7fc9c81f41a0 con 0x7fc9c80c92d0 2023-12-20T04:54:11.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9c77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9c815ad70 0x7fc9c80c7f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:11.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9c77fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9c815ad70 0x7fc9c80c7f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34232/0 (socket says 172.21.15.132:34232) 2023-12-20T04:54:11.846 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9c77fe640 1 -- 172.21.15.132:0/2504659401 learned_addr learned my addr 172.21.15.132:0/2504659401 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:54:11.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9c7fff640 1 --2- 172.21.15.132:0/2504659401 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9c80c92d0 0x7fc9c80c5270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:11.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9cc81f640 1 --2- 172.21.15.132:0/2504659401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9c815f6b0 0x7fc9c80c84d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:11.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9c77fe640 1 -- 172.21.15.132:0/2504659401 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9c80c92d0 msgr2=0x7fc9c80c5270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:54:11.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9c77fe640 1 --2- 172.21.15.132:0/2504659401 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9c80c92d0 0x7fc9c80c5270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:11.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9c77fe640 1 -- 172.21.15.132:0/2504659401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9c815f6b0 msgr2=0x7fc9c80c84d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:54:11.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9c77fe640 1 --2- 172.21.15.132:0/2504659401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9c815f6b0 0x7fc9c80c84d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:11.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9c77fe640 1 -- 172.21.15.132:0/2504659401 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc9b80094d0 con 0x7fc9c815ad70 2023-12-20T04:54:11.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9c7fff640 1 --2- 172.21.15.132:0/2504659401 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9c80c92d0 0x7fc9c80c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:54:11.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9c77fe640 1 --2- 172.21.15.132:0/2504659401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9c815ad70 0x7fc9c80c7f90 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00d800 tx=0x7fc9bc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:54:11.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9c4ff9640 1 -- 172.21.15.132:0/2504659401 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc0096a0 con 0x7fc9c815ad70 2023-12-20T04:54:11.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9c4ff9640 1 -- 172.21.15.132:0/2504659401 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fc9bc009800 con 0x7fc9c815ad70 2023-12-20T04:54:11.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9ce282640 1 -- 172.21.15.132:0/2504659401 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc9c81f4480 con 0x7fc9c815ad70 2023-12-20T04:54:11.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9c4ff9640 1 -- 172.21.15.132:0/2504659401 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7fc9bc009990 con 0x7fc9c815ad70 2023-12-20T04:54:11.847 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.842+0000 7fc9ce282640 1 -- 172.21.15.132:0/2504659401 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc9c815cb70 con 0x7fc9c815ad70 2023-12-20T04:54:11.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.844+0000 7fc9ce282640 1 -- 172.21.15.132:0/2504659401 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc9c804e840 con 0x7fc9c815ad70 2023-12-20T04:54:11.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.844+0000 7fc9c4ff9640 1 -- 172.21.15.132:0/2504659401 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7fc9bc009af0 con 0x7fc9c815ad70 2023-12-20T04:54:11.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.844+0000 7fc9c4ff9640 1 --2- 172.21.15.132:0/2504659401 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc9b406a430 0x7fc9b406c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:11.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.844+0000 7fc9c4ff9640 1 -- 172.21.15.132:0/2504659401 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7fc9bc088960 con 0x7fc9c815ad70 2023-12-20T04:54:11.848 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.844+0000 7fc9c7fff640 1 --2- 172.21.15.132:0/2504659401 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc9b406a430 0x7fc9b406c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:11.849 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.845+0000 7fc9c7fff640 1 --2- 172.21.15.132:0/2504659401 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc9b406a430 0x7fc9b406c8f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8036000 tx=0x7fc9b803c040 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:54:11.850 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:11.849+0000 7fc9c4ff9640 1 -- 172.21.15.132:0/2504659401 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7fc9bc0543a0 con 0x7fc9c815ad70 2023-12-20T04:54:12.014 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.013+0000 7fc9ce282640 1 -- 172.21.15.132:0/2504659401 --> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7fc9c80c9730 con 0x7fc9b406a430 2023-12-20T04:54:12.017 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.015+0000 7fc9c4ff9640 1 -- 172.21.15.132:0/2504659401 <== mgr.4098 v2:172.21.15.132:6832/84767 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+50275 (secure 0 0 0) 0x7fc9b8031cc0 con 0x7fc9b406a430 2023-12-20T04:54:12.017 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:54:12.017 INFO:teuthology.orchestra.run.smithi132.stderr:dumped all 2023-12-20T04:54:12.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.017+0000 7fc9ce282640 1 -- 172.21.15.132:0/2504659401 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc9b406a430 msgr2=0x7fc9b406c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:54:12.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.017+0000 7fc9ce282640 1 --2- 172.21.15.132:0/2504659401 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc9b406a430 0x7fc9b406c8f0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7fc9b8036000 tx=0x7fc9b803c040 comp rx=0 tx=0).stop 2023-12-20T04:54:12.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.017+0000 7fc9ce282640 1 -- 172.21.15.132:0/2504659401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9c815ad70 msgr2=0x7fc9c80c7f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:54:12.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.017+0000 7fc9ce282640 1 --2- 172.21.15.132:0/2504659401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9c815ad70 0x7fc9c80c7f90 secure :-1 s=READY pgs=1982 cs=0 l=1 rev1=1 crypto rx=0x7fc9bc00d800 tx=0x7fc9bc00dcc0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.019 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.017+0000 7fc9ce282640 1 -- 172.21.15.132:0/2504659401 shutdown_connections 2023-12-20T04:54:12.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.017+0000 7fc9ce282640 1 --2- 172.21.15.132:0/2504659401 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7fc9b406a430 0x7fc9b406c8f0 unknown :-1 s=CLOSED pgs=828 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.017+0000 7fc9ce282640 1 --2- 172.21.15.132:0/2504659401 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7fc9c815f6b0 0x7fc9c80c84d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.017+0000 7fc9ce282640 1 --2- 172.21.15.132:0/2504659401 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7fc9c815ad70 0x7fc9c80c7f90 unknown :-1 s=CLOSED pgs=1982 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.017+0000 7fc9ce282640 1 --2- 172.21.15.132:0/2504659401 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7fc9c80c92d0 0x7fc9c80c5270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.017+0000 7fc9ce282640 1 -- 172.21.15.132:0/2504659401 >> 172.21.15.132:0/2504659401 conn(0x7fc9c80ced10 msgr2=0x7fc9c806b130 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:54:12.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.017+0000 7fc9ce282640 1 -- 172.21.15.132:0/2504659401 shutdown_connections 2023-12-20T04:54:12.020 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.017+0000 7fc9ce282640 1 -- 172.21.15.132:0/2504659401 wait complete. 2023-12-20T04:54:12.030 INFO:teuthology.orchestra.run.smithi132.stdout:{"pg_ready":true,"pg_map":{"version":532,"stamp":"2023-12-20T04:54:10.244358+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":6,"num_per_pool_omap_osds":0,"kb":1562500,"kb_used":9640,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":1552859,"statfs":{"total":1600000000,"available":1590127656,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002349"},"pg_stats":[{"pgid":"1.0","version":"193'119","reported_seq":331,"reported_epoch":193,"state":"active+clean","last_fresh":"2023-12-20T04:53:55.709494+0000","last_change":"2023-12-20T04:53:55.709556+0000","last_active":"2023-12-20T04:53:55.709494+0000","last_peered":"2023-12-20T04:53:55.709494+0000","last_clean":"2023-12-20T04:53:55.709494+0000","last_became_active":"2023-12-20T04:42:37.672036+0000","last_became_peered":"2023-12-20T04:42:37.672036+0000","last_unstale":"2023-12-20T04:53:55.709494+0000","last_undegraded":"2023-12-20T04:53:55.709494+0000","last_fullsized":"2023-12-20T04:53:55.709494+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"193'119","last_scrub_stamp":"2023-12-20T04:53:55.709471+0000","last_deep_scrub":"193'119","last_deep_scrub_stamp":"2023-12-20T04:53:55.709471+0000","last_clean_scrub_stamp":"2023-12-20T04:53:55.709471+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2023-12-21T15:06:27.171783+0000","scrub_duration":0.003112854,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574988,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193674,"statfs":{"total":200000000,"available":198323181,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.56200000000000006,"15min":0.54700000000000004},"min":{"1min":0.41899999999999998,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68700000000000006,"5min":0.77700000000000002,"15min":1.0860000000000001},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55100000000000005,"15min":0.53200000000000003},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.25600000000000001},"max":{"1min":0.67200000000000004,"5min":0.81899999999999995,"15min":0.86299999999999999},"last":0.60099999999999998}]},{"osd":1,"last update":"Wed Dec 20 04:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.56999999999999995,"15min":0.55300000000000005},"min":{"1min":0.35299999999999998,"5min":0.34899999999999998,"15min":0.26900000000000002},"max":{"1min":0.71099999999999997,"5min":0.76500000000000001,"15min":0.98799999999999999},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.60699999999999998,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.376,"15min":0.374},"max":{"1min":0.73499999999999999,"5min":0.79500000000000004,"15min":1.0269999999999999},"last":0.71199999999999997}]},{"osd":2,"last update":"Wed Dec 20 04:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.55200000000000005,"15min":0.54300000000000004},"min":{"1min":0.35699999999999998,"5min":0.35399999999999998,"15min":0.35399999999999998},"max":{"1min":0.68899999999999995,"5min":0.72399999999999998,"15min":1.0069999999999999},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.39500000000000002,"5min":0.35199999999999998,"15min":0.29499999999999998},"max":{"1min":0.71499999999999997,"5min":0.75700000000000001,"15min":0.78000000000000003},"last":0.56000000000000005}]},{"osd":3,"last update":"Wed Dec 20 04:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.57699999999999996,"5min":0.56899999999999995,"15min":0.56200000000000006},"min":{"1min":0.39900000000000002,"5min":0.33300000000000002,"15min":0.33300000000000002},"max":{"1min":0.748,"5min":0.78300000000000003,"15min":1.048},"last":0.72599999999999998},{"interface":"front","average":{"1min":0.56000000000000005,"5min":0.57399999999999995,"15min":0.56599999999999995},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.34599999999999997},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.57299999999999995}]},{"osd":4,"last update":"Wed Dec 20 04:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.46600000000000003,"15min":0.47899999999999998},"min":{"1min":0.317,"5min":0.28499999999999998,"15min":0.26700000000000002},"max":{"1min":0.76600000000000001,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.503,"5min":0.48299999999999998,"15min":0.48999999999999999},"min":{"1min":0.33800000000000002,"5min":0.29599999999999999,"15min":0.27600000000000002},"max":{"1min":0.65500000000000003,"5min":0.79300000000000004,"15min":0.89700000000000002},"last":0.39800000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.46400000000000002,"15min":0.47899999999999998},"min":{"1min":0.35999999999999999,"5min":0.314,"15min":0.255},"max":{"1min":0.70799999999999996,"5min":0.73099999999999998,"15min":0.73799999999999999},"last":0.497},{"interface":"front","average":{"1min":0.52500000000000002,"5min":0.51700000000000002,"15min":0.52900000000000003},"min":{"1min":0.35899999999999999,"5min":0.316,"15min":0.313},"max":{"1min":0.78200000000000003,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.46999999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:54:02 2023","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.52900000000000003},"min":{"1min":0.34000000000000002,"5min":0.33300000000000002,"15min":0.32500000000000001},"max":{"1min":0.71699999999999997,"5min":0.77800000000000002,"15min":0.89800000000000002},"last":0.44500000000000001},{"interface":"front","average":{"1min":0.54900000000000004,"5min":0.53500000000000003,"15min":0.53700000000000003},"min":{"1min":0.38100000000000001,"5min":0.34999999999999998,"15min":0.28899999999999998},"max":{"1min":0.72099999999999997,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.439}]}]},{"osd":6,"up_from":13,"seq":55834574989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:53:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.55100000000000005,"15min":0.52200000000000002},"min":{"1min":0.39000000000000001,"5min":0.27600000000000002,"15min":0.27600000000000002},"max":{"1min":0.70499999999999996,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.54800000000000004,"5min":0.54800000000000004,"15min":0.53700000000000003},"min":{"1min":0.40600000000000003,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.68600000000000005,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.54000000000000004}]},{"osd":1,"last update":"Wed Dec 20 04:53:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.57799999999999996,"15min":0.55100000000000005},"min":{"1min":0.46899999999999997,"5min":0.371,"15min":0.30099999999999999},"max":{"1min":0.72099999999999997,"5min":0.81599999999999995,"15min":0.81599999999999995},"last":0.66700000000000004},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.58699999999999997,"15min":0.57699999999999996},"min":{"1min":0.47199999999999998,"5min":0.34699999999999998,"15min":0.315},"max":{"1min":0.68500000000000005,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.61799999999999999}]},{"osd":2,"last update":"Wed Dec 20 04:53:54 2023","interfaces":[{"interface":"back","average":{"1min":0.54800000000000004,"5min":0.55700000000000005,"15min":0.52800000000000002},"min":{"1min":0.38700000000000001,"5min":0.38200000000000001,"15min":0.27000000000000002},"max":{"1min":0.66600000000000004,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.55000000000000004,"5min":0.55600000000000005,"15min":0.54300000000000004},"min":{"1min":0.43099999999999999,"5min":0.35499999999999998,"15min":0.32600000000000001},"max":{"1min":0.63300000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.496}]},{"osd":3,"last update":"Wed Dec 20 04:53:54 2023","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.55300000000000005,"15min":0.52700000000000002},"min":{"1min":0.42099999999999999,"5min":0.38800000000000001,"15min":0.33700000000000002},"max":{"1min":0.73499999999999999,"5min":0.752,"15min":0.77800000000000002},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.56699999999999995,"15min":0.55900000000000005},"min":{"1min":0.41599999999999998,"5min":0.309,"15min":0.309},"max":{"1min":0.73099999999999998,"5min":0.77200000000000002,"15min":0.78900000000000003},"last":0.625}]},{"osd":4,"last update":"Wed Dec 20 04:53:54 2023","interfaces":[{"interface":"back","average":{"1min":0.47799999999999998,"5min":0.48399999999999999,"15min":0.49099999999999999},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.749,"5min":0.77300000000000002,"15min":0.81899999999999995},"last":0.39300000000000002},{"interface":"front","average":{"1min":0.501,"5min":0.49399999999999999,"15min":0.49399999999999999},"min":{"1min":0.29299999999999998,"5min":0.26700000000000002,"15min":0.26700000000000002},"max":{"1min":0.70999999999999996,"5min":0.77400000000000002,"15min":0.77400000000000002},"last":0.376}]},{"osd":5,"last update":"Wed Dec 20 04:53:54 2023","interfaces":[{"interface":"back","average":{"1min":0.49099999999999999,"5min":0.498,"15min":0.505},"min":{"1min":0.32400000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.50900000000000001,"5min":0.53100000000000003,"15min":0.54300000000000004},"min":{"1min":0.32600000000000001,"5min":0.32600000000000001,"15min":0.32000000000000001},"max":{"1min":0.76200000000000001,"5min":0.80600000000000005,"15min":0.85499999999999998},"last":0.45600000000000002}]},{"osd":7,"last update":"Wed Dec 20 04:53:54 2023","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.53200000000000003,"15min":0.53900000000000003},"min":{"1min":0.33100000000000002,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.77800000000000002,"5min":0.86599999999999999,"15min":0.86599999999999999},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.59799999999999998,"5min":0.58599999999999997,"15min":0.58399999999999996},"min":{"1min":0.35699999999999998,"5min":0.33700000000000002,"15min":0.33700000000000002},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":0.89600000000000002},"last":0.51300000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:54:00 2023","interfaces":[{"interface":"back","average":{"1min":0.53400000000000003,"5min":0.56599999999999995,"15min":0.53500000000000003},"min":{"1min":0.35299999999999998,"5min":0.32200000000000001,"15min":0.23200000000000001},"max":{"1min":0.752,"5min":0.752,"15min":0.752},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.58599999999999997,"15min":0.57299999999999995},"min":{"1min":0.38700000000000001,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.76600000000000001,"5min":0.78700000000000003,"15min":0.82299999999999995},"last":0.52200000000000002}]},{"osd":1,"last update":"Wed Dec 20 04:54:00 2023","interfaces":[{"interface":"back","average":{"1min":0.51800000000000002,"5min":0.56999999999999995,"15min":0.55400000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.26000000000000001},"max":{"1min":0.625,"5min":0.755,"15min":0.82099999999999995},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.56399999999999995,"5min":0.59299999999999997,"15min":0.58299999999999996},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.34100000000000003},"max":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.84899999999999998},"last":0.56799999999999995}]},{"osd":2,"last update":"Wed Dec 20 04:54:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48899999999999999,"5min":0.53100000000000003,"15min":0.52100000000000002},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.28199999999999997},"max":{"1min":0.66400000000000003,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.54900000000000004,"15min":0.53200000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.315},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.45900000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:54:00 2023","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.54100000000000004,"15min":0.53000000000000003},"min":{"1min":0.34899999999999998,"5min":0.34699999999999998,"15min":0.29899999999999999},"max":{"1min":0.71999999999999997,"5min":0.71999999999999997,"15min":0.80900000000000005},"last":0.59499999999999997},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.56000000000000005,"15min":0.55100000000000005},"min":{"1min":0.39800000000000002,"5min":0.38400000000000001,"15min":0.312},"max":{"1min":0.69099999999999995,"5min":0.73599999999999999,"15min":0.77400000000000002},"last":0.48099999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:54:00 2023","interfaces":[{"interface":"back","average":{"1min":0.45800000000000002,"5min":0.443,"15min":0.47699999999999998},"min":{"1min":0.253,"5min":0.253,"15min":0.249},"max":{"1min":0.73199999999999998,"5min":0.80400000000000005,"15min":0.81899999999999995},"last":0.38600000000000001},{"interface":"front","average":{"1min":0.47199999999999998,"5min":0.45600000000000002,"15min":0.47199999999999998},"min":{"1min":0.29799999999999999,"5min":0.29799999999999999,"15min":0.29399999999999998},"max":{"1min":0.77800000000000002,"5min":0.77800000000000002,"15min":0.77800000000000002},"last":0.311}]},{"osd":6,"last update":"Wed Dec 20 04:54:00 2023","interfaces":[{"interface":"back","average":{"1min":0.48999999999999999,"5min":0.46300000000000002,"15min":0.48699999999999999},"min":{"1min":0.31,"5min":0.254,"15min":0.254},"max":{"1min":0.73899999999999999,"5min":0.75600000000000001,"15min":0.85299999999999998},"last":0.32900000000000001},{"interface":"front","average":{"1min":0.49099999999999999,"5min":0.495,"15min":0.52500000000000002},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.752,"5min":0.82599999999999996,"15min":0.83999999999999997},"last":0.34399999999999997}]},{"osd":7,"last update":"Wed Dec 20 04:54:00 2023","interfaces":[{"interface":"back","average":{"1min":0.46700000000000003,"5min":0.48799999999999999,"15min":0.51000000000000001},"min":{"1min":0.27400000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66100000000000003,"5min":0.78400000000000003,"15min":0.79800000000000004},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.58299999999999996,"5min":0.55300000000000005,"15min":0.58399999999999996},"min":{"1min":0.34100000000000003,"5min":0.311,"15min":0.311},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.98599999999999999},"last":0.39800000000000002}]}]},{"osd":4,"up_from":13,"seq":55834574988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.496,"5min":0.52700000000000002,"15min":0.52300000000000002},"min":{"1min":0.35599999999999998,"5min":0.25700000000000001,"15min":0.19700000000000001},"max":{"1min":0.68100000000000005,"5min":0.85799999999999998,"15min":0.85799999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.53700000000000003,"5min":0.54300000000000004,"15min":0.53200000000000003},"min":{"1min":0.38100000000000001,"5min":0.309,"15min":0.251},"max":{"1min":0.747,"5min":0.875,"15min":0.875},"last":0.57199999999999995}]},{"osd":1,"last update":"Wed Dec 20 04:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.53500000000000003,"5min":0.54200000000000004,"15min":0.52700000000000002},"min":{"1min":0.374,"5min":0.246,"15min":0.246},"max":{"1min":0.74299999999999999,"5min":0.84099999999999997,"15min":0.84099999999999997},"last":0.66300000000000003},{"interface":"front","average":{"1min":0.51500000000000001,"5min":0.55100000000000005,"15min":0.53400000000000003},"min":{"1min":0.315,"5min":0.315,"15min":0.26200000000000001},"max":{"1min":0.73299999999999998,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.52100000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":0.55900000000000005,"15min":0.55100000000000005},"min":{"1min":0.41699999999999998,"5min":0.316,"15min":0.313},"max":{"1min":0.74099999999999999,"5min":0.79400000000000004,"15min":0.83899999999999997},"last":0.497},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.37,"5min":0.33300000000000002,"15min":0.23400000000000001},"max":{"1min":0.71699999999999997,"5min":0.74199999999999999,"15min":0.80400000000000005},"last":0.64700000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.57599999999999996,"15min":0.56499999999999995},"min":{"1min":0.38400000000000001,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.72199999999999998,"5min":0.92400000000000004,"15min":0.92400000000000004},"last":0.61399999999999999},{"interface":"front","average":{"1min":0.59299999999999997,"5min":0.59099999999999997,"15min":0.58799999999999997},"min":{"1min":0.45200000000000001,"5min":0.34300000000000003,"15min":0.34300000000000003},"max":{"1min":0.76300000000000001,"5min":0.88800000000000001,"15min":0.91000000000000003},"last":0.60099999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.44400000000000001,"5min":0.45500000000000002,"15min":0.46000000000000002},"min":{"1min":0.253,"5min":0.23000000000000001,"15min":0.222},"max":{"1min":0.63800000000000001,"5min":0.75900000000000001,"15min":0.79100000000000004},"last":0.315},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.48199999999999998,"15min":0.495},"min":{"1min":0.29199999999999998,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.68899999999999995,"5min":0.76900000000000002,"15min":0.76900000000000002},"last":0.34399999999999997}]},{"osd":6,"last update":"Wed Dec 20 04:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.47199999999999998,"5min":0.48099999999999998,"15min":0.49099999999999999},"min":{"1min":0.30199999999999999,"5min":0.29199999999999998,"15min":0.26400000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.82399999999999995},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.48099999999999998,"5min":0.50600000000000001,"15min":0.51600000000000001},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.629,"5min":0.78200000000000003,"15min":0.83499999999999996},"last":0.38300000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.52100000000000002,"5min":0.52500000000000002,"15min":0.52000000000000002},"min":{"1min":0.34699999999999998,"5min":0.30599999999999999,"15min":0.30599999999999999},"max":{"1min":0.71599999999999997,"5min":0.76900000000000002,"15min":0.81599999999999995},"last":0.41999999999999998},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.53800000000000003,"15min":0.54200000000000004},"min":{"1min":0.33100000000000002,"5min":0.32700000000000001,"15min":0.32500000000000001},"max":{"1min":0.73599999999999999,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.40100000000000002}]}]},{"osd":3,"up_from":13,"seq":55834574988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.34899999999999998,"15min":0.34399999999999997},"min":{"1min":0.21099999999999999,"5min":0.19800000000000001,"15min":0.193},"max":{"1min":0.48499999999999999,"5min":0.55700000000000005,"15min":0.629},"last":0.38500000000000001},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.38600000000000001,"15min":0.36799999999999999},"min":{"1min":0.26500000000000001,"5min":0.25600000000000001,"15min":0.246},"max":{"1min":0.54800000000000004,"5min":0.58199999999999996,"15min":0.64000000000000001},"last":0.36099999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.313,"5min":0.34599999999999997,"15min":0.33000000000000002},"min":{"1min":0.20100000000000001,"5min":0.20100000000000001,"15min":0.19600000000000001},"max":{"1min":0.44,"5min":0.62,"15min":0.62},"last":0.29899999999999999},{"interface":"front","average":{"1min":0.34300000000000003,"5min":0.36599999999999999,"15min":0.35199999999999998},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.20399999999999999},"max":{"1min":0.53800000000000003,"5min":0.55800000000000005,"15min":0.61699999999999999},"last":0.33200000000000002}]},{"osd":2,"last update":"Wed Dec 20 04:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.33800000000000002,"5min":0.35899999999999999,"15min":0.34999999999999998},"min":{"1min":0.217,"5min":0.217,"15min":0.21199999999999999},"max":{"1min":0.501,"5min":0.56999999999999995,"15min":0.64900000000000002},"last":0.314},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39800000000000002,"15min":0.38600000000000001},"min":{"1min":0.23100000000000001,"5min":0.22900000000000001,"15min":0.22900000000000001},"max":{"1min":0.58699999999999997,"5min":0.59399999999999997,"15min":0.63600000000000001},"last":0.41299999999999998}]},{"osd":4,"last update":"Wed Dec 20 04:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.57999999999999996,"15min":0.55900000000000005},"min":{"1min":0.38400000000000001,"5min":0.36599999999999999,"15min":0.35199999999999998},"max":{"1min":0.70899999999999996,"5min":0.872,"15min":0.93400000000000005},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.59099999999999997,"15min":0.57399999999999995},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.313},"max":{"1min":0.80800000000000005,"5min":0.88400000000000001,"15min":0.88400000000000001},"last":0.68200000000000005}]},{"osd":5,"last update":"Wed Dec 20 04:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56699999999999995,"5min":0.57999999999999996,"15min":0.57199999999999995},"min":{"1min":0.42699999999999999,"5min":0.42099999999999999,"15min":0.31},"max":{"1min":0.73899999999999999,"5min":0.82399999999999995,"15min":0.872},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.60099999999999998,"15min":0.57599999999999996},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.85399999999999998,"5min":0.91800000000000004,"15min":0.91800000000000004},"last":0.66600000000000004}]},{"osd":6,"last update":"Wed Dec 20 04:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.56599999999999995,"5min":0.60499999999999998,"15min":0.58699999999999997},"min":{"1min":0.39900000000000002,"5min":0.375,"15min":0.33900000000000002},"max":{"1min":0.72399999999999998,"5min":0.93100000000000005,"15min":0.93100000000000005},"last":0.76100000000000001},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.58699999999999997,"15min":0.57399999999999995},"min":{"1min":0.39700000000000002,"5min":0.39500000000000002,"15min":0.37},"max":{"1min":0.77200000000000002,"5min":0.90300000000000002,"15min":0.90300000000000002},"last":0.623}]},{"osd":7,"last update":"Wed Dec 20 04:53:59 2023","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.58699999999999997,"15min":0.57899999999999996},"min":{"1min":0.41999999999999998,"5min":0.39900000000000002,"15min":0.38500000000000001},"max":{"1min":0.83199999999999996,"5min":0.89200000000000002,"15min":0.89200000000000002},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.58599999999999997,"5min":0.62,"15min":0.59599999999999997},"min":{"1min":0.41199999999999998,"5min":0.40500000000000003,"15min":0.40300000000000002},"max":{"1min":0.76100000000000001,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.72699999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574988,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35499999999999998,"5min":0.35799999999999998,"15min":0.32600000000000001},"min":{"1min":0.20300000000000001,"5min":0.17899999999999999,"15min":0.17899999999999999},"max":{"1min":0.64200000000000002,"5min":0.64200000000000002,"15min":0.72699999999999998},"last":0.371},{"interface":"front","average":{"1min":0.35899999999999999,"5min":0.39700000000000002,"15min":0.372},"min":{"1min":0.214,"5min":0.214,"15min":0.17699999999999999},"max":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":2.0539999999999998},"last":0.42599999999999999}]},{"osd":1,"last update":"Wed Dec 20 04:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.35199999999999998,"5min":0.38200000000000001,"15min":0.35299999999999998},"min":{"1min":0.215,"5min":0.215,"15min":0.17999999999999999},"max":{"1min":0.58499999999999996,"5min":0.58499999999999996,"15min":0.83099999999999996},"last":0.33000000000000002},{"interface":"front","average":{"1min":0.38200000000000001,"5min":0.40799999999999997,"15min":0.375},"min":{"1min":0.248,"5min":0.248,"15min":0.20000000000000001},"max":{"1min":0.54200000000000004,"5min":0.61099999999999999,"15min":0.61099999999999999},"last":0.45500000000000002}]},{"osd":3,"last update":"Wed Dec 20 04:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.41899999999999998,"15min":0.38800000000000001},"min":{"1min":0.28899999999999998,"5min":0.23200000000000001,"15min":0.216},"max":{"1min":0.61599999999999999,"5min":0.61599999999999999,"15min":0.995},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.42299999999999999,"15min":0.39300000000000002},"min":{"1min":0.27700000000000002,"5min":0.218,"15min":0.218},"max":{"1min":0.60599999999999998,"5min":0.64400000000000002,"15min":0.76600000000000001},"last":0.56599999999999995}]},{"osd":4,"last update":"Wed Dec 20 04:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.64000000000000001,"5min":0.61099999999999999,"15min":0.58399999999999996},"min":{"1min":0.45500000000000002,"5min":0.36899999999999999,"15min":0.32500000000000001},"max":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.59999999999999998,"15min":0.58599999999999997},"min":{"1min":0.438,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.89600000000000002,"5min":0.89600000000000002,"15min":2.347},"last":0.52100000000000002}]},{"osd":5,"last update":"Wed Dec 20 04:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.59799999999999998,"5min":0.60299999999999998,"15min":0.58799999999999997},"min":{"1min":0.45800000000000002,"5min":0.35399999999999998,"15min":0.35199999999999998},"max":{"1min":0.88300000000000001,"5min":0.88300000000000001,"15min":0.997},"last":0.59099999999999997},{"interface":"front","average":{"1min":0.63,"5min":0.61599999999999999,"15min":0.57699999999999996},"min":{"1min":0.41699999999999998,"5min":0.38,"15min":0.371},"max":{"1min":0.76400000000000001,"5min":0.86399999999999999,"15min":0.86399999999999999},"last":0.64500000000000002}]},{"osd":6,"last update":"Wed Dec 20 04:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.60499999999999998,"5min":0.61199999999999999,"15min":0.58899999999999997},"min":{"1min":0.443,"5min":0.38700000000000001,"15min":0.371},"max":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":2.274},"last":0.60199999999999998},{"interface":"front","average":{"1min":0.62,"5min":0.61799999999999999,"15min":0.59199999999999997},"min":{"1min":0.47999999999999998,"5min":0.38,"15min":0.373},"max":{"1min":0.78300000000000003,"5min":0.85199999999999998,"15min":1.0289999999999999},"last":0.51100000000000001}]},{"osd":7,"last update":"Wed Dec 20 04:53:58 2023","interfaces":[{"interface":"back","average":{"1min":0.623,"5min":0.61899999999999999,"15min":0.58999999999999997},"min":{"1min":0.497,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.95099999999999996,"5min":0.95099999999999996,"15min":2.3090000000000002},"last":0.628},{"interface":"front","average":{"1min":0.60699999999999998,"5min":0.61899999999999999,"15min":0.59599999999999997},"min":{"1min":0.435,"5min":0.41299999999999998,"15min":0.379},"max":{"1min":0.752,"5min":0.873,"15min":1.0549999999999999},"last":0.53300000000000003}]}]},{"osd":1,"up_from":13,"seq":55834574989,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1060,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":194251,"statfs":{"total":200000000,"available":198913549,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Dec 20 04:53:54 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.35199999999999998,"15min":0.317},"min":{"1min":0.186,"5min":0.186,"15min":0.16400000000000001},"max":{"1min":0.53800000000000003,"5min":0.65100000000000002,"15min":0.65100000000000002},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.34899999999999998,"5min":0.38900000000000001,"15min":0.35499999999999998},"min":{"1min":0.23999999999999999,"5min":0.23999999999999999,"15min":0.22700000000000001},"max":{"1min":0.46300000000000002,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.45100000000000001}]},{"osd":2,"last update":"Wed Dec 20 04:53:54 2023","interfaces":[{"interface":"back","average":{"1min":0.32700000000000001,"5min":0.36099999999999999,"15min":0.33100000000000002},"min":{"1min":0.20200000000000001,"5min":0.20200000000000001,"15min":0.19500000000000001},"max":{"1min":0.501,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.41599999999999998},{"interface":"front","average":{"1min":0.375,"5min":0.40400000000000003,"15min":0.374},"min":{"1min":0.223,"5min":0.223,"15min":0.223},"max":{"1min":0.52800000000000002,"5min":0.57099999999999995,"15min":0.57299999999999995},"last":0.434}]},{"osd":3,"last update":"Wed Dec 20 04:53:54 2023","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.42299999999999999,"15min":0.38700000000000001},"min":{"1min":0.29799999999999999,"5min":0.221,"15min":0.191},"max":{"1min":0.502,"5min":0.64200000000000002,"15min":0.64200000000000002},"last":0.48899999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.39200000000000002,"15min":0.36699999999999999},"min":{"1min":0.25600000000000001,"5min":0.23799999999999999,"15min":0.20399999999999999},"max":{"1min":0.53500000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.51300000000000001}]},{"osd":4,"last update":"Wed Dec 20 04:53:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58599999999999997,"5min":0.61099999999999999,"15min":0.57699999999999996},"min":{"1min":0.36799999999999999,"5min":0.35599999999999998,"15min":0.312},"max":{"1min":0.78600000000000003,"5min":0.81399999999999995,"15min":0.89700000000000002},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60499999999999998,"15min":0.57199999999999995},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.34899999999999998},"max":{"1min":0.69299999999999995,"5min":0.90900000000000003,"15min":1.002},"last":0.59699999999999998}]},{"osd":5,"last update":"Wed Dec 20 04:53:54 2023","interfaces":[{"interface":"back","average":{"1min":0.56299999999999994,"5min":0.60099999999999998,"15min":0.57199999999999995},"min":{"1min":0.42799999999999999,"5min":0.42599999999999999,"15min":0.318},"max":{"1min":0.71999999999999997,"5min":0.79200000000000004,"15min":0.86099999999999999},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.57699999999999996,"5min":0.60899999999999999,"15min":0.57099999999999995},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.317},"max":{"1min":0.71599999999999997,"5min":0.89100000000000001,"15min":0.89100000000000001},"last":0.58299999999999996}]},{"osd":6,"last update":"Wed Dec 20 04:53:54 2023","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.60699999999999998,"15min":0.57599999999999996},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.70899999999999996,"5min":0.92400000000000004,"15min":1.038},"last":0.65000000000000002},{"interface":"front","average":{"1min":0.56999999999999995,"5min":0.60399999999999998,"15min":0.57999999999999996},"min":{"1min":0.38700000000000001,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.71899999999999997,"5min":0.84899999999999998,"15min":0.84899999999999998},"last":0.63}]},{"osd":7,"last update":"Wed Dec 20 04:53:54 2023","interfaces":[{"interface":"back","average":{"1min":0.61199999999999999,"5min":0.64300000000000002,"15min":0.60999999999999999},"min":{"1min":0.34399999999999997,"5min":0.34399999999999997,"15min":0.34399999999999997},"max":{"1min":0.81699999999999995,"5min":0.92900000000000005,"15min":0.92900000000000005},"last":0.60799999999999998},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.64300000000000002,"15min":0.61599999999999999},"min":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.376},"max":{"1min":0.75700000000000001,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.61699999999999999}]}]},{"osd":0,"up_from":13,"seq":55834574988,"num_pgs":1,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":195312,"kb_used":1637,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":193674,"statfs":{"total":200000000,"available":198323181,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Dec 20 04:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34300000000000003,"5min":0.35999999999999999,"15min":0.32800000000000001},"min":{"1min":0.215,"5min":0.214,"15min":0.184},"max":{"1min":0.54000000000000004,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.48399999999999999},{"interface":"front","average":{"1min":0.34399999999999997,"5min":0.36599999999999999,"15min":0.33600000000000002},"min":{"1min":0.245,"5min":0.20699999999999999,"15min":0.184},"max":{"1min":0.52400000000000002,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.379}]},{"osd":2,"last update":"Wed Dec 20 04:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.36899999999999999,"5min":0.38600000000000001,"15min":0.36599999999999999},"min":{"1min":0.26400000000000001,"5min":0.22800000000000001,"15min":0.218},"max":{"1min":0.47499999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38800000000000001,"15min":0.36299999999999999},"min":{"1min":0.27800000000000002,"5min":0.247,"15min":0.23100000000000001},"max":{"1min":0.52100000000000002,"5min":0.57499999999999996,"15min":0.622},"last":0.438}]},{"osd":3,"last update":"Wed Dec 20 04:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.34799999999999998,"5min":0.38100000000000001,"15min":0.34799999999999998},"min":{"1min":0.27400000000000002,"5min":0.22500000000000001,"15min":0.224},"max":{"1min":0.501,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.46700000000000003},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.41699999999999998,"15min":0.38700000000000001},"min":{"1min":0.29199999999999998,"5min":0.27500000000000002,"15min":0.27400000000000002},"max":{"1min":0.57399999999999995,"5min":0.625,"15min":0.625},"last":0.42799999999999999}]},{"osd":4,"last update":"Wed Dec 20 04:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58199999999999996,"5min":0.58599999999999997,"15min":0.55000000000000004},"min":{"1min":0.41199999999999998,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.77000000000000002,"5min":0.872,"15min":0.872},"last":0.70099999999999996},{"interface":"front","average":{"1min":0.55300000000000005,"5min":0.57999999999999996,"15min":0.55600000000000005},"min":{"1min":0.38800000000000001,"5min":0.317,"15min":0.317},"max":{"1min":0.78800000000000003,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.58899999999999997}]},{"osd":5,"last update":"Wed Dec 20 04:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.58499999999999996,"15min":0.54900000000000004},"min":{"1min":0.40600000000000003,"5min":0.35699999999999998,"15min":0.32500000000000001},"max":{"1min":0.78100000000000003,"5min":0.86899999999999999,"15min":0.86899999999999999},"last":0.63700000000000001},{"interface":"front","average":{"1min":0.59599999999999997,"5min":0.60699999999999998,"15min":0.57299999999999995},"min":{"1min":0.41499999999999998,"5min":0.35099999999999998,"15min":0.35099999999999998},"max":{"1min":0.82799999999999996,"5min":0.83899999999999997,"15min":0.86199999999999999},"last":0.67900000000000005}]},{"osd":6,"last update":"Wed Dec 20 04:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.61499999999999999,"5min":0.628,"15min":0.59899999999999998},"min":{"1min":0.44500000000000001,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"last":0.57399999999999995},{"interface":"front","average":{"1min":0.61199999999999999,"5min":0.627,"15min":0.60099999999999998},"min":{"1min":0.40999999999999998,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.89700000000000002,"5min":0.89700000000000002,"15min":0.90000000000000002},"last":0.73399999999999999}]},{"osd":7,"last update":"Wed Dec 20 04:53:51 2023","interfaces":[{"interface":"back","average":{"1min":0.58299999999999996,"5min":0.60799999999999998,"15min":0.57399999999999995},"min":{"1min":0.433,"5min":0.379,"15min":0.375},"max":{"1min":0.73399999999999999,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.755},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.60899999999999999,"15min":0.58699999999999997},"min":{"1min":0.42599999999999999,"5min":0.38700000000000001,"15min":0.38700000000000001},"max":{"1min":0.75900000000000001,"5min":0.89800000000000002,"15min":0.89800000000000002},"last":0.71899999999999997}]}]}],"pool_statfs":[]}} 2023-12-20T04:54:12.031 DEBUG:teuthology.orchestra.run.smithi132:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2023-12-20T04:54:12.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.130+0000 7f3e2135c640 1 Processor -- start 2023-12-20T04:54:12.132 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.130+0000 7f3e2135c640 1 -- start start 2023-12-20T04:54:12.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e2135c640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f3e1c15d300 0x7f3e1c0d1290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:12.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e2135c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e1c0cfea0 0x7f3e1c0b6080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:12.135 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e2135c640 1 -- --> v1:172.21.15.132:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f3e1c0d2920 con 0x7f3e1c0d17d0 2023-12-20T04:54:12.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e2135c640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f3e1c0d1d10 con 0x7f3e1c15d300 2023-12-20T04:54:12.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e2135c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c0d1ff0 con 0x7f3e1c0cfea0 2023-12-20T04:54:12.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e13fff640 1 --1- >> v1:172.21.15.132:6789/0 conn(0x7f3e1c0d17d0 0x7f3e1c0cf790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.132:6789/0 says I am v1:172.21.15.132:36404/0 (socket says 172.21.15.132:36404) 2023-12-20T04:54:12.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e13fff640 1 -- 172.21.15.132:0/3813451875 learned_addr learned my addr 172.21.15.132:0/3813451875 (peer_addr_for_me v1:172.21.15.132:0/0) 2023-12-20T04:54:12.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1a7fc640 1 -- 172.21.15.132:0/3813451875 <== mon.0 v1:172.21.15.132:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 33+0+0 (unknown 4226299390 0 0) 0x7f3e1c0d2920 con 0x7f3e1c0d17d0 2023-12-20T04:54:12.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1a7fc640 1 -- 172.21.15.132:0/3813451875 --> v1:172.21.15.132:6789/0 -- auth(proto 2 36 bytes epoch 0) v1 -- 0x7f3e08003520 con 0x7f3e1c0d17d0 2023-12-20T04:54:12.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1affd640 1 --2- 172.21.15.132:0/3813451875 >> v2:172.21.15.187:3300/0 conn(0x7f3e1c15d300 0x7f3e1c0d1290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:12.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1b7fe640 1 --2- 172.21.15.132:0/3813451875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e1c0cfea0 0x7f3e1c0b6080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:12.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1a7fc640 1 -- 172.21.15.132:0/3813451875 <== mon.0 v1:172.21.15.132:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 214+0+0 (unknown 3392952869 0 0) 0x7f3e08003520 con 0x7f3e1c0d17d0 2023-12-20T04:54:12.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1a7fc640 1 -- 172.21.15.132:0/3813451875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e1c0cfea0 msgr2=0x7f3e1c0b6080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:54:12.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1a7fc640 1 --2- 172.21.15.132:0/3813451875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e1c0cfea0 0x7f3e1c0b6080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1a7fc640 1 -- 172.21.15.132:0/3813451875 >> v2:172.21.15.187:3300/0 conn(0x7f3e1c15d300 msgr2=0x7f3e1c0d1290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:54:12.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1a7fc640 1 --2- 172.21.15.132:0/3813451875 >> v2:172.21.15.187:3300/0 conn(0x7f3e1c15d300 0x7f3e1c0d1290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1a7fc640 1 -- 172.21.15.132:0/3813451875 --> v1:172.21.15.132:6789/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c0d22d0 con 0x7f3e1c0d17d0 2023-12-20T04:54:12.136 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1a7fc640 1 -- 172.21.15.132:0/3813451875 <== mon.0 v1:172.21.15.132:6789/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (unknown 804379845 0 0) 0x7f3e04001670 con 0x7f3e1c0d17d0 2023-12-20T04:54:12.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1a7fc640 1 -- 172.21.15.132:0/3813451875 >> v1:172.21.15.132:6789/0 conn(0x7f3e1c0d17d0 legacy=0x7f3e1c0cf790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:54:12.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1a7fc640 1 --2- 172.21.15.132:0/3813451875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e08003970 0x7f3e08003d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:12.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1a7fc640 1 --2- 172.21.15.132:0/3813451875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e1c0cfea0 0x7f3e080047c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:12.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1a7fc640 1 --2- 172.21.15.132:0/3813451875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e08004d00 0x7f3e08005180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:12.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1a7fc640 1 -- 172.21.15.132:0/3813451875 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c0d1d10 con 0x7f3e08003970 2023-12-20T04:54:12.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1a7fc640 1 -- 172.21.15.132:0/3813451875 --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c0d1ff0 con 0x7f3e08004d00 2023-12-20T04:54:12.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1a7fc640 1 -- 172.21.15.132:0/3813451875 --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e0800b980 con 0x7f3e1c0cfea0 2023-12-20T04:54:12.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.131+0000 7f3e1affd640 1 --2- 172.21.15.132:0/3813451875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e08003970 0x7f3e08003d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:12.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.132+0000 7f3e13fff640 1 --2- 172.21.15.132:0/3813451875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e1c0cfea0 0x7f3e080047c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:12.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.132+0000 7f3e1b7fe640 1 --2- 172.21.15.132:0/3813451875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e08004d00 0x7f3e08005180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:12.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.132+0000 7f3e1affd640 1 -- 172.21.15.132:0/3813451875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e1c0cfea0 msgr2=0x7f3e080047c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:54:12.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.132+0000 7f3e1affd640 1 --2- 172.21.15.132:0/3813451875 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e1c0cfea0 0x7f3e080047c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.137 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.132+0000 7f3e1affd640 1 -- 172.21.15.132:0/3813451875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e08004d00 msgr2=0x7f3e08005180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:54:12.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.132+0000 7f3e1affd640 1 --2- 172.21.15.132:0/3813451875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e08004d00 0x7f3e08005180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.132+0000 7f3e1affd640 1 -- 172.21.15.132:0/3813451875 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e08003520 con 0x7f3e08003970 2023-12-20T04:54:12.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.132+0000 7f3e1b7fe640 1 --2- 172.21.15.132:0/3813451875 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e08004d00 0x7f3e08005180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2023-12-20T04:54:12.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.132+0000 7f3e1affd640 1 --2- 172.21.15.132:0/3813451875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e08003970 0x7f3e08003d90 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009ac0 tx=0x7f3e080057f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4021de8b5eacbd8f server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:54:12.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.133+0000 7f3e1a7fc640 1 -- 172.21.15.132:0/3813451875 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c02c710 con 0x7f3e08003970 2023-12-20T04:54:12.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.133+0000 7f3e1a7fc640 1 -- 172.21.15.132:0/3813451875 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e0c02c870 con 0x7f3e08003970 2023-12-20T04:54:12.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.133+0000 7f3e1a7fc640 1 -- 172.21.15.132:0/3813451875 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e0c02cc00 con 0x7f3e08003970 2023-12-20T04:54:12.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.133+0000 7f3e2135c640 1 -- 172.21.15.132:0/3813451875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e08003970 msgr2=0x7f3e08003d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:54:12.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.133+0000 7f3e2135c640 1 --2- 172.21.15.132:0/3813451875 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e08003970 0x7f3e08003d90 secure :-1 s=READY pgs=1984 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c009ac0 tx=0x7f3e080057f0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.133+0000 7f3e1b7fe640 1 -- 172.21.15.132:0/3813451875 reap_dead start 2023-12-20T04:54:12.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.133+0000 7f3e2135c640 1 -- 172.21.15.132:0/3813451875 shutdown_connections 2023-12-20T04:54:12.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.133+0000 7f3e2135c640 1 -- 172.21.15.132:0/3813451875 >> 172.21.15.132:0/3813451875 conn(0x7f3e1c06a3d0 msgr2=0x7f3e1c06a7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:54:12.138 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.133+0000 7f3e2135c640 1 -- 172.21.15.132:0/3813451875 shutdown_connections 2023-12-20T04:54:12.139 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.133+0000 7f3e2135c640 1 -- 172.21.15.132:0/3813451875 wait complete. 2023-12-20T04:54:12.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.134+0000 7f3e2135c640 1 Processor -- start 2023-12-20T04:54:12.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.134+0000 7f3e2135c640 1 -- start start 2023-12-20T04:54:12.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.135+0000 7f3e2135c640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e08003970 0x7f3e1c1507a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:12.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.135+0000 7f3e2135c640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e1c0cc530 0x7f3e1c0cc9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:12.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.135+0000 7f3e2135c640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1c15bb30 0x7f3e1c15bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:12.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.135+0000 7f3e2135c640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c150ce0 con 0x7f3e1c15bb30 2023-12-20T04:54:12.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.135+0000 7f3e2135c640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c15aa90 con 0x7f3e1c0cc530 2023-12-20T04:54:12.141 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.135+0000 7f3e2135c640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f3e1c15ad70 con 0x7f3e08003970 2023-12-20T04:54:12.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.135+0000 7f3e1b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1c15bb30 0x7f3e1c15bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:12.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.135+0000 7f3e1b7fe640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1c15bb30 0x7f3e1c15bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34246/0 (socket says 172.21.15.132:34246) 2023-12-20T04:54:12.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.135+0000 7f3e1b7fe640 1 -- 172.21.15.132:0/1422079327 learned_addr learned my addr 172.21.15.132:0/1422079327 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:54:12.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.135+0000 7f3e1b7fe640 1 -- 172.21.15.132:0/1422079327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e08003970 msgr2=0x7f3e1c1507a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:54:12.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.135+0000 7f3e1b7fe640 1 --2- 172.21.15.132:0/1422079327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e08003970 0x7f3e1c1507a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.135+0000 7f3e1b7fe640 1 -- 172.21.15.132:0/1422079327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e1c0cc530 msgr2=0x7f3e1c0cc9b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:54:12.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.135+0000 7f3e1b7fe640 1 --2- 172.21.15.132:0/1422079327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e1c0cc530 0x7f3e1c0cc9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.135+0000 7f3e1b7fe640 1 -- 172.21.15.132:0/1422079327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e1c15b050 con 0x7f3e1c15bb30 2023-12-20T04:54:12.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.136+0000 7f3e1b7fe640 1 --2- 172.21.15.132:0/1422079327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1c15bb30 0x7f3e1c15bfb0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0d02b0 tx=0x7f3e140115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:54:12.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.136+0000 7f3e137fe640 1 -- 172.21.15.132:0/1422079327 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e1400e030 con 0x7f3e1c15bb30 2023-12-20T04:54:12.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.136+0000 7f3e137fe640 1 -- 172.21.15.132:0/1422079327 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f3e14007e60 con 0x7f3e1c15bb30 2023-12-20T04:54:12.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.136+0000 7f3e2135c640 1 -- 172.21.15.132:0/1422079327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e1c15b330 con 0x7f3e1c15bb30 2023-12-20T04:54:12.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.136+0000 7f3e137fe640 1 -- 172.21.15.132:0/1422079327 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f3e14016470 con 0x7f3e1c15bb30 2023-12-20T04:54:12.142 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.136+0000 7f3e2135c640 1 -- 172.21.15.132:0/1422079327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e1c151610 con 0x7f3e1c15bb30 2023-12-20T04:54:12.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.137+0000 7f3e2135c640 1 -- 172.21.15.132:0/1422079327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e1c04e840 con 0x7f3e1c15bb30 2023-12-20T04:54:12.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.137+0000 7f3e137fe640 1 -- 172.21.15.132:0/1422079327 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f3e140165f0 con 0x7f3e1c15bb30 2023-12-20T04:54:12.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.138+0000 7f3e137fe640 1 --2- 172.21.15.132:0/1422079327 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3dfc06a430 0x7f3dfc06c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:12.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.138+0000 7f3e137fe640 1 -- 172.21.15.132:0/1422079327 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f3e1400f070 con 0x7f3e1c15bb30 2023-12-20T04:54:12.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.138+0000 7f3e1affd640 1 --2- 172.21.15.132:0/1422079327 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3dfc06a430 0x7f3dfc06c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:12.143 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.138+0000 7f3e1affd640 1 --2- 172.21.15.132:0/1422079327 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3dfc06a430 0x7f3dfc06c8f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c036000 tx=0x7f3e0c02e000 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:54:12.144 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.142+0000 7f3e137fe640 1 -- 172.21.15.132:0/1422079327 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f3e14054710 con 0x7f3e1c15bb30 2023-12-20T04:54:12.311 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.309+0000 7f3e2135c640 1 -- 172.21.15.132:0/1422079327 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) v1 -- 0x7f3e1c0b5300 con 0x7f3e1c15bb30 2023-12-20T04:54:12.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.313+0000 7f3e137fe640 1 -- 172.21.15.132:0/1422079327 <== mon.0 v2:172.21.15.132:3300/0 7 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f3e14054710 con 0x7f3e1c15bb30 2023-12-20T04:54:12.315 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.313+0000 7f3e137fe640 1 -- 172.21.15.132:0/1422079327 <== mon.0 v2:172.21.15.132:3300/0 8 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v22)=0 v22) v1 ==== 123+0+0 (secure 0 0 0) 0x7f3e14057d30 con 0x7f3e1c15bb30 2023-12-20T04:54:12.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.316+0000 7f3e2135c640 1 -- 172.21.15.132:0/1422079327 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3dfc06a430 msgr2=0x7f3dfc06c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:54:12.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.316+0000 7f3e2135c640 1 --2- 172.21.15.132:0/1422079327 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3dfc06a430 0x7f3dfc06c8f0 secure :-1 s=READY pgs=829 cs=0 l=1 rev1=1 crypto rx=0x7f3e0c036000 tx=0x7f3e0c02e000 comp rx=0 tx=0).stop 2023-12-20T04:54:12.318 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.316+0000 7f3e2135c640 1 -- 172.21.15.132:0/1422079327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1c15bb30 msgr2=0x7f3e1c15bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:54:12.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.316+0000 7f3e2135c640 1 --2- 172.21.15.132:0/1422079327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1c15bb30 0x7f3e1c15bfb0 secure :-1 s=READY pgs=1985 cs=0 l=1 rev1=1 crypto rx=0x7f3e1c0d02b0 tx=0x7f3e140115a0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.316+0000 7f3e2135c640 1 -- 172.21.15.132:0/1422079327 shutdown_connections 2023-12-20T04:54:12.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.316+0000 7f3e2135c640 1 --2- 172.21.15.132:0/1422079327 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f3dfc06a430 0x7f3dfc06c8f0 unknown :-1 s=CLOSED pgs=829 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.316+0000 7f3e2135c640 1 --2- 172.21.15.132:0/1422079327 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f3e1c15bb30 0x7f3e1c15bfb0 unknown :-1 s=CLOSED pgs=1985 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.316+0000 7f3e2135c640 1 --2- 172.21.15.132:0/1422079327 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f3e1c0cc530 0x7f3e1c0cc9b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.316+0000 7f3e2135c640 1 --2- 172.21.15.132:0/1422079327 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f3e08003970 0x7f3e1c1507a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.316+0000 7f3e2135c640 1 -- 172.21.15.132:0/1422079327 >> 172.21.15.132:0/1422079327 conn(0x7f3e1c06a3d0 msgr2=0x7f3e1c153290 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:54:12.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.316+0000 7f3e2135c640 1 -- 172.21.15.132:0/1422079327 shutdown_connections 2023-12-20T04:54:12.319 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.316+0000 7f3e2135c640 1 -- 172.21.15.132:0/1422079327 wait complete. 2023-12-20T04:54:12.329 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2023-12-20T04:54:12.330 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2023-12-20T04:54:12.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.427+0000 7f1803920640 1 Processor -- start 2023-12-20T04:54:12.429 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.427+0000 7f1803920640 1 -- start start 2023-12-20T04:54:12.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.428+0000 7f1803920640 1 --2- >> v2:172.21.15.187:3300/0 conn(0x7f17fc160450 0x7f17fc160c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:12.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.428+0000 7f1803920640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f17fc0b5090 0x7f17fc0d1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:12.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.428+0000 7f1803920640 1 -- --> v1:172.21.15.187:6789/0 -- auth(proto 0 30 bytes epoch 0) v1 -- 0x7f17fc0b5ec0 con 0x7f17fc1611b0 2023-12-20T04:54:12.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.428+0000 7f1803920640 1 -- --> v2:172.21.15.132:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17fc1617e0 con 0x7f17fc0b5090 2023-12-20T04:54:12.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.428+0000 7f1803920640 1 -- --> v2:172.21.15.187:3300/0 -- mon_getmap magic: 0 v1 -- 0x7f17fc0d0fc0 con 0x7f17fc160450 2023-12-20T04:54:12.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.428+0000 7f1801ebd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f17fc0b5090 0x7f17fc0d1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:12.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.428+0000 7f1801ebd640 1 --2- >> v2:172.21.15.132:3300/0 conn(0x7f17fc0b5090 0x7f17fc0d1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34260/0 (socket says 172.21.15.132:34260) 2023-12-20T04:54:12.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.428+0000 7f1801ebd640 1 -- 172.21.15.132:0/4118983529 learned_addr learned my addr 172.21.15.132:0/4118983529 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:54:12.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.428+0000 7f18016bc640 1 --2- 172.21.15.132:0/4118983529 >> v2:172.21.15.187:3300/0 conn(0x7f17fc160450 0x7f17fc160c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:12.431 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.428+0000 7f1801ebd640 1 -- 172.21.15.132:0/4118983529 >> v2:172.21.15.187:3300/0 conn(0x7f17fc160450 msgr2=0x7f17fc160c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:54:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.428+0000 7f1801ebd640 1 --2- 172.21.15.132:0/4118983529 >> v2:172.21.15.187:3300/0 conn(0x7f17fc160450 0x7f17fc160c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.428+0000 7f1801ebd640 1 -- 172.21.15.132:0/4118983529 >> v1:172.21.15.187:6789/0 conn(0x7f17fc1611b0 legacy=0x7f17fc0b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2023-12-20T04:54:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.428+0000 7f1801ebd640 1 -- 172.21.15.132:0/4118983529 --> v2:172.21.15.132:3300/0 -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17fc0d12a0 con 0x7f17fc0b5090 2023-12-20T04:54:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.429+0000 7f1801ebd640 1 --2- 172.21.15.132:0/4118983529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17fc0b5090 0x7f17fc0d1aa0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f17fc08b150 tx=0x7f17f402bf80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf1b9e630032d12 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:54:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.429+0000 7f17f3fff640 1 -- 172.21.15.132:0/4118983529 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f402cb20 con 0x7f17fc0b5090 2023-12-20T04:54:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.429+0000 7f17f3fff640 1 -- 172.21.15.132:0/4118983529 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f17f402cc80 con 0x7f17fc0b5090 2023-12-20T04:54:12.432 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.429+0000 7f17f3fff640 1 -- 172.21.15.132:0/4118983529 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f40343f0 con 0x7f17fc0b5090 2023-12-20T04:54:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.429+0000 7f1803920640 1 -- 172.21.15.132:0/4118983529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17fc0b5090 msgr2=0x7f17fc0d1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:54:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.429+0000 7f1803920640 1 --2- 172.21.15.132:0/4118983529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17fc0b5090 0x7f17fc0d1aa0 secure :-1 s=READY pgs=1986 cs=0 l=1 rev1=1 crypto rx=0x7f17fc08b150 tx=0x7f17f402bf80 comp rx=0 tx=0).stop 2023-12-20T04:54:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.430+0000 7f1803920640 1 -- 172.21.15.132:0/4118983529 shutdown_connections 2023-12-20T04:54:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.430+0000 7f1803920640 1 --2- 172.21.15.132:0/4118983529 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17fc0b5090 0x7f17fc0d1aa0 unknown :-1 s=CLOSED pgs=1986 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.430+0000 7f1803920640 1 --2- 172.21.15.132:0/4118983529 >> v2:172.21.15.187:3300/0 conn(0x7f17fc160450 0x7f17fc160c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.430+0000 7f1803920640 1 -- 172.21.15.132:0/4118983529 >> 172.21.15.132:0/4118983529 conn(0x7f17fc0cf980 msgr2=0x7f17fc0cfd90 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:54:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.430+0000 7f1803920640 1 -- 172.21.15.132:0/4118983529 shutdown_connections 2023-12-20T04:54:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.430+0000 7f1803920640 1 -- 172.21.15.132:0/4118983529 wait complete. 2023-12-20T04:54:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.431+0000 7f1803920640 1 Processor -- start 2023-12-20T04:54:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.431+0000 7f1803920640 1 -- start start 2023-12-20T04:54:12.435 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.431+0000 7f1803920640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17fc0b5090 0x7f17fc157050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.431+0000 7f1803920640 1 --2- >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17fc160450 0x7f17fc152300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.431+0000 7f1803920640 1 --2- >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17fc1611b0 0x7f17fc0c9fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.431+0000 7f1803920640 1 -- --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc0ca940 con 0x7f17fc0b5090 2023-12-20T04:54:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.431+0000 7f1803920640 1 -- --> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc0cac20 con 0x7f17fc160450 2023-12-20T04:54:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.431+0000 7f1803920640 1 -- --> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] -- mon_getmap magic: 0 v1 -- 0x7f17fc0d1a40 con 0x7f17fc1611b0 2023-12-20T04:54:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.432+0000 7f18016bc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17fc0b5090 0x7f17fc157050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.432+0000 7f18016bc640 1 --2- >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17fc0b5090 0x7f17fc157050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.132:3300/0 says I am v2:172.21.15.132:34274/0 (socket says 172.21.15.132:34274) 2023-12-20T04:54:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.432+0000 7f18016bc640 1 -- 172.21.15.132:0/2602750528 learned_addr learned my addr 172.21.15.132:0/2602750528 (peer_addr_for_me v2:172.21.15.132:0/0) 2023-12-20T04:54:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.432+0000 7f1800ebb640 1 --2- 172.21.15.132:0/2602750528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17fc160450 0x7f17fc152300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.432+0000 7f1801ebd640 1 --2- 172.21.15.132:0/2602750528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17fc1611b0 0x7f17fc0c9fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.432+0000 7f18016bc640 1 -- 172.21.15.132:0/2602750528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17fc1611b0 msgr2=0x7f17fc0c9fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:54:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.432+0000 7f18016bc640 1 --2- 172.21.15.132:0/2602750528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17fc1611b0 0x7f17fc0c9fd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.432+0000 7f18016bc640 1 -- 172.21.15.132:0/2602750528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17fc160450 msgr2=0x7f17fc152300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:54:12.436 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.432+0000 7f18016bc640 1 --2- 172.21.15.132:0/2602750528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17fc160450 0x7f17fc152300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.432+0000 7f18016bc640 1 -- 172.21.15.132:0/2602750528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f17f4009b30 con 0x7f17fc0b5090 2023-12-20T04:54:12.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.432+0000 7f18016bc640 1 --2- 172.21.15.132:0/2602750528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17fc0b5090 0x7f17fc157050 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f17f800d800 tx=0x7f17f800dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:54:12.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.432+0000 7f17f1ffb640 1 -- 172.21.15.132:0/2602750528 <== mon.0 v2:172.21.15.132:3300/0 1 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f800b6c0 con 0x7f17fc0b5090 2023-12-20T04:54:12.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.432+0000 7f17f1ffb640 1 -- 172.21.15.132:0/2602750528 <== mon.0 v2:172.21.15.132:3300/0 2 ==== config(1 keys) v1 ==== 35+0+0 (secure 0 0 0) 0x7f17f800b820 con 0x7f17fc0b5090 2023-12-20T04:54:12.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.432+0000 7f1803920640 1 -- 172.21.15.132:0/2602750528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f17fc0d1d20 con 0x7f17fc0b5090 2023-12-20T04:54:12.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.432+0000 7f17f1ffb640 1 -- 172.21.15.132:0/2602750528 <== mon.0 v2:172.21.15.132:3300/0 3 ==== mon_map magic: 0 v1 ==== 413+0+0 (secure 0 0 0) 0x7f17f800bbd0 con 0x7f17fc0b5090 2023-12-20T04:54:12.437 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.432+0000 7f1803920640 1 -- 172.21.15.132:0/2602750528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f17fc0caf00 con 0x7f17fc0b5090 2023-12-20T04:54:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.433+0000 7f1803920640 1 -- 172.21.15.132:0/2602750528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f17fc04e840 con 0x7f17fc0b5090 2023-12-20T04:54:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.434+0000 7f17f1ffb640 1 -- 172.21.15.132:0/2602750528 <== mon.0 v2:172.21.15.132:3300/0 4 ==== mgrmap(e 5) v1 ==== 88607+0+0 (secure 0 0 0) 0x7f17f800bd30 con 0x7f17fc0b5090 2023-12-20T04:54:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.434+0000 7f17f1ffb640 1 --2- 172.21.15.132:0/2602750528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f17e006a430 0x7f17e006c8f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2023-12-20T04:54:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.434+0000 7f1800ebb640 1 --2- 172.21.15.132:0/2602750528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f17e006a430 0x7f17e006c8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2023-12-20T04:54:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.434+0000 7f17f1ffb640 1 -- 172.21.15.132:0/2602750528 <== mon.0 v2:172.21.15.132:3300/0 5 ==== osd_map(193..193 src has 1..193) v4 ==== 4943+0+0 (secure 0 0 0) 0x7f17f8088b60 con 0x7f17fc0b5090 2023-12-20T04:54:12.438 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.435+0000 7f1800ebb640 1 --2- 172.21.15.132:0/2602750528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f17e006a430 0x7f17e006c8f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0b7c80 tx=0x7f17ec009060 comp rx=0 tx=0).ready entity=mgr.4098 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2023-12-20T04:54:12.440 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.439+0000 7f17f1ffb640 1 -- 172.21.15.132:0/2602750528 <== mon.0 v2:172.21.15.132:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+179343 (secure 0 0 0) 0x7f17f80543e0 con 0x7f17fc0b5090 2023-12-20T04:54:12.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.637+0000 7f1803920640 1 -- 172.21.15.132:0/2602750528 --> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f17fc0d0ad0 con 0x7f17fc0b5090 2023-12-20T04:54:12.639 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.637+0000 7f17f1ffb640 1 -- 172.21.15.132:0/2602750528 <== mon.0 v2:172.21.15.132:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 72 v72) v1 ==== 94+0+3535 (secure 0 0 0) 0x7f17f8056310 con 0x7f17fc0b5090 2023-12-20T04:54:12.639 INFO:teuthology.orchestra.run.smithi132.stdout: 2023-12-20T04:54:12.640 INFO:teuthology.orchestra.run.smithi132.stdout:{"epoch":72,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":6863,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6833/3443409957","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6832","nonce":3443409957},{"type":"v1","addr":"172.21.15.187:6833","nonce":3443409957}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":7046,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6837/693115161","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6835","nonce":693115161},{"type":"v1","addr":"172.21.15.132:6837","nonce":693115161}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":72},{"gid":7678,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.187:6835/321445180","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.187:6834","nonce":321445180},{"type":"v1","addr":"172.21.15.187:6835","nonce":321445180}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66},{"gid":9114,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.132:6836/1166803529","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.132:6834","nonce":1166803529},{"type":"v1","addr":"172.21.15.132:6836","nonce":1166803529}]},"join_fscid":-1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":66}],"filesystems":[]} 2023-12-20T04:54:12.640 INFO:teuthology.orchestra.run.smithi132.stderr:dumped fsmap epoch 72 2023-12-20T04:54:12.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.639+0000 7f1803920640 1 -- 172.21.15.132:0/2602750528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f17e006a430 msgr2=0x7f17e006c8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:54:12.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.639+0000 7f1803920640 1 --2- 172.21.15.132:0/2602750528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f17e006a430 0x7f17e006c8f0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7f17fc0b7c80 tx=0x7f17ec009060 comp rx=0 tx=0).stop 2023-12-20T04:54:12.641 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.639+0000 7f1803920640 1 -- 172.21.15.132:0/2602750528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17fc0b5090 msgr2=0x7f17fc157050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2023-12-20T04:54:12.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.639+0000 7f1803920640 1 --2- 172.21.15.132:0/2602750528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17fc0b5090 0x7f17fc157050 secure :-1 s=READY pgs=1987 cs=0 l=1 rev1=1 crypto rx=0x7f17f800d800 tx=0x7f17f800dcc0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.639+0000 7f1803920640 1 -- 172.21.15.132:0/2602750528 shutdown_connections 2023-12-20T04:54:12.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.639+0000 7f1803920640 1 --2- 172.21.15.132:0/2602750528 >> [v2:172.21.15.132:6832/84767,v1:172.21.15.132:6833/84767] conn(0x7f17e006a430 0x7f17e006c8f0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.639+0000 7f1803920640 1 --2- 172.21.15.132:0/2602750528 >> [v2:172.21.15.187:3301/0,v1:172.21.15.187:6790/0] conn(0x7f17fc1611b0 0x7f17fc0c9fd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.639+0000 7f1803920640 1 --2- 172.21.15.132:0/2602750528 >> [v2:172.21.15.187:3300/0,v1:172.21.15.187:6789/0] conn(0x7f17fc160450 0x7f17fc152300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.639+0000 7f1803920640 1 --2- 172.21.15.132:0/2602750528 >> [v2:172.21.15.132:3300/0,v1:172.21.15.132:6789/0] conn(0x7f17fc0b5090 0x7f17fc157050 unknown :-1 s=CLOSED pgs=1987 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2023-12-20T04:54:12.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.639+0000 7f1803920640 1 -- 172.21.15.132:0/2602750528 >> 172.21.15.132:0/2602750528 conn(0x7f17fc0cf980 msgr2=0x7f17fc0cd780 unknown :-1 s=STATE_NONE l=0).mark_down 2023-12-20T04:54:12.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.639+0000 7f1803920640 1 -- 172.21.15.132:0/2602750528 shutdown_connections 2023-12-20T04:54:12.642 INFO:teuthology.orchestra.run.smithi132.stderr:2023-12-20T04:54:12.639+0000 7f1803920640 1 -- 172.21.15.132:0/2602750528 wait complete. 2023-12-20T04:54:12.652 DEBUG:tasks.cephfs.filesystem:already dead... 2023-12-20T04:54:12.652 INFO:teuthology.misc:Shutting down mds daemons... 2023-12-20T04:54:12.652 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2023-12-20T04:54:12.653 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:54:12.661 INFO:tasks.ceph.mds.a:Stopped 2023-12-20T04:54:12.661 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2023-12-20T04:54:12.661 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:54:12.711 INFO:tasks.ceph.mds.c:Stopped 2023-12-20T04:54:12.711 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2023-12-20T04:54:12.711 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:54:12.723 INFO:tasks.ceph.mds.b:Stopped 2023-12-20T04:54:12.723 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2023-12-20T04:54:12.723 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:54:12.774 INFO:tasks.ceph.mds.d:Stopped 2023-12-20T04:54:12.774 INFO:teuthology.misc:Shutting down osd daemons... 2023-12-20T04:54:12.774 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2023-12-20T04:54:12.774 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:54:12.794 INFO:tasks.ceph.osd.0:Stopped 2023-12-20T04:54:12.794 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2023-12-20T04:54:12.794 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:54:12.858 INFO:tasks.ceph.osd.1:Stopped 2023-12-20T04:54:12.858 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2023-12-20T04:54:12.858 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:54:12.923 INFO:tasks.ceph.osd.2:Stopped 2023-12-20T04:54:12.923 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2023-12-20T04:54:12.923 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:54:12.982 INFO:tasks.ceph.osd.3:Stopped 2023-12-20T04:54:12.982 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2023-12-20T04:54:12.982 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:54:13.005 INFO:tasks.ceph.osd.4:Stopped 2023-12-20T04:54:13.005 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2023-12-20T04:54:13.005 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:54:13.067 INFO:tasks.ceph.osd.5:Stopped 2023-12-20T04:54:13.067 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2023-12-20T04:54:13.067 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:54:13.131 INFO:tasks.ceph.osd.6:Stopped 2023-12-20T04:54:13.132 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2023-12-20T04:54:13.132 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:54:13.192 INFO:tasks.ceph.osd.7:Stopped 2023-12-20T04:54:13.192 INFO:teuthology.misc:Shutting down mgr daemons... 2023-12-20T04:54:13.192 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2023-12-20T04:54:13.192 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:54:13.217 INFO:tasks.ceph.mgr.y:Stopped 2023-12-20T04:54:13.217 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2023-12-20T04:54:13.217 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:54:13.258 INFO:tasks.ceph.mgr.x:Stopped 2023-12-20T04:54:13.258 INFO:teuthology.misc:Shutting down mon daemons... 2023-12-20T04:54:13.258 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2023-12-20T04:54:13.258 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:54:13.270 INFO:tasks.ceph.mon.a:Stopped 2023-12-20T04:54:13.270 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2023-12-20T04:54:13.270 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:54:13.310 INFO:tasks.ceph.mon.b:Stopped 2023-12-20T04:54:13.311 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2023-12-20T04:54:13.311 INFO:teuthology.orchestra.run:waiting for 300 2023-12-20T04:54:13.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 is failed for ~0s 2023-12-20T04:54:13.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2023-12-20T04:54:13.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 is failed for ~0s 2023-12-20T04:54:13.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2023-12-20T04:54:13.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 is failed for ~0s 2023-12-20T04:54:13.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 is failed for ~0s 2023-12-20T04:54:13.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2023-12-20T04:54:13.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 is failed for ~0s 2023-12-20T04:54:13.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a is failed for ~0s 2023-12-20T04:54:13.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b is failed for ~0s 2023-12-20T04:54:13.363 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c is failed for ~0s 2023-12-20T04:54:13.363 INFO:tasks.ceph.mon.c:Stopped 2023-12-20T04:54:13.364 INFO:tasks.ceph:Checking cluster log for badness... 2023-12-20T04:54:13.364 DEBUG:teuthology.orchestra.run.smithi132:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-20T04:54:13.397 INFO:teuthology.orchestra.run.smithi132.stdout:2023-12-20T04:42:34.668201+0000 osd.4 (osd.4) 3 : cluster [WRN] OSD bench result of 233043.574721 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.4. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-12-20T04:54:13.397 WARNING:tasks.ceph:Found errors (ERR|WRN|SEC) in cluster log 2023-12-20T04:54:13.397 DEBUG:teuthology.orchestra.run.smithi132:> sudo egrep '\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-20T04:54:13.471 DEBUG:teuthology.orchestra.run.smithi132:> sudo egrep '\[ERR\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-20T04:54:13.545 DEBUG:teuthology.orchestra.run.smithi132:> sudo egrep '\[WRN\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v 'overall HEALTH_' | egrep -v '\(FS_DEGRADED\)' | egrep -v '\(MDS_FAILED\)' | egrep -v '\(MDS_DEGRADED\)' | egrep -v '\(FS_WITH_FAILED_MDS\)' | egrep -v '\(MDS_DAMAGE\)' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(FS_INLINE_DATA_DEPRECATED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v 'OSD full dropping all updates' | egrep -v 'OSD near full' | egrep -v 'pausewr flag' | egrep -v 'failsafe engaged, dropping updates' | egrep -v 'failsafe disengaged, no longer dropping' | egrep -v 'is full \(reached quota' | egrep -v POOL_FULL | egrep -v POOL_BACKFILLFULL | egrep -v PG_RECOVERY_FULL | egrep -v PG_DEGRADED | head -n 1 2023-12-20T04:54:13.618 INFO:teuthology.orchestra.run.smithi132.stdout:2023-12-20T04:42:34.668201+0000 osd.4 (osd.4) 3 : cluster [WRN] OSD bench result of 233043.574721 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.4. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd's IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]. 2023-12-20T04:54:13.618 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:54:13.618 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2023-12-20T04:54:13.883 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:54:13.883 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2023-12-20T04:54:13.973 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:54:13.973 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2023-12-20T04:54:14.030 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:54:14.031 DEBUG:teuthology.orchestra.run.smithi132:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2023-12-20T04:54:14.071 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:54:14.071 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2023-12-20T04:54:14.238 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:54:14.238 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2023-12-20T04:54:14.302 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:54:14.303 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2023-12-20T04:54:14.353 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:54:14.353 DEBUG:teuthology.orchestra.run.smithi187:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2023-12-20T04:54:14.401 INFO:tasks.ceph:Archiving mon data... 2023-12-20T04:54:14.402 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497454/data/mon.a.tgz 2023-12-20T04:54:14.402 DEBUG:teuthology.orchestra.run.smithi132:> mktemp 2023-12-20T04:54:14.418 INFO:teuthology.orchestra.run.smithi132.stdout:/tmp/tmp.Jb5k4TAvc4 2023-12-20T04:54:14.418 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.Jb5k4TAvc4 2023-12-20T04:54:14.571 DEBUG:teuthology.orchestra.run.smithi132:> sudo chmod 0666 /tmp/tmp.Jb5k4TAvc4 2023-12-20T04:54:14.656 DEBUG:teuthology.orchestra.remote:smithi132:/tmp/tmp.Jb5k4TAvc4 is 402KB 2023-12-20T04:54:14.754 DEBUG:teuthology.orchestra.run.smithi132:> rm -fr /tmp/tmp.Jb5k4TAvc4 2023-12-20T04:54:14.768 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497454/data/mon.b.tgz 2023-12-20T04:54:14.769 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2023-12-20T04:54:14.785 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.IarahhJdgd 2023-12-20T04:54:14.786 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.IarahhJdgd 2023-12-20T04:54:14.945 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.IarahhJdgd 2023-12-20T04:54:15.029 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.IarahhJdgd is 408KB 2023-12-20T04:54:15.127 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.IarahhJdgd 2023-12-20T04:54:15.141 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497454/data/mon.c.tgz 2023-12-20T04:54:15.142 DEBUG:teuthology.orchestra.run.smithi187:> mktemp 2023-12-20T04:54:15.195 INFO:teuthology.orchestra.run.smithi187.stdout:/tmp/tmp.Yo1kUfusfC 2023-12-20T04:54:15.195 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.Yo1kUfusfC 2023-12-20T04:54:15.336 DEBUG:teuthology.orchestra.run.smithi187:> sudo chmod 0666 /tmp/tmp.Yo1kUfusfC 2023-12-20T04:54:15.421 DEBUG:teuthology.orchestra.remote:smithi187:/tmp/tmp.Yo1kUfusfC is 408KB 2023-12-20T04:54:15.489 DEBUG:teuthology.orchestra.run.smithi187:> rm -fr /tmp/tmp.Yo1kUfusfC 2023-12-20T04:54:15.503 INFO:tasks.ceph:Cleaning ceph cluster... 2023-12-20T04:54:15.504 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-20T04:54:15.506 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2023-12-20T04:54:15.570 INFO:tasks.ceph:Checking for errors in any valgrind logs... 2023-12-20T04:54:15.570 DEBUG:teuthology.orchestra.run.smithi132:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-20T04:54:15.576 DEBUG:teuthology.orchestra.run.smithi187:> sudo zgrep '' /var/log/ceph/valgrind/* /dev/null | sort | uniq 2023-12-20T04:54:15.606 INFO:teuthology.orchestra.run.smithi132.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-20T04:54:15.639 INFO:teuthology.orchestra.run.smithi187.stderr:gzip: /var/log/ceph/valgrind/*.gz: No such file or directory 2023-12-20T04:54:15.644 INFO:tasks.ceph:Archiving crash dumps... 2023-12-20T04:54:15.645 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497454/remote/smithi132/crash 2023-12-20T04:54:15.646 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-20T04:54:15.679 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/lib/ceph/crash to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497454/remote/smithi187/crash 2023-12-20T04:54:15.680 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2023-12-20T04:54:15.709 INFO:tasks.ceph:Shutting down logrotate 2023-12-20T04:54:15.709 DEBUG:teuthology.orchestra.run.smithi132:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:54:15.723 DEBUG:teuthology.orchestra.run.smithi187:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2023-12-20T04:54:15.797 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-20T04:54:15.824 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm /etc/logrotate.d/ceph-test.conf 2023-12-20T04:54:15.851 INFO:tasks.ceph:Compressing logs... 2023-12-20T04:54:15.851 DEBUG:teuthology.orchestra.run.smithi132:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-20T04:54:15.867 DEBUG:teuthology.orchestra.run.smithi187:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-20T04:54:18.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.0 has been restored 2023-12-20T04:54:18.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2023-12-20T04:54:18.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.2 has been restored 2023-12-20T04:54:18.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2023-12-20T04:54:18.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.4 has been restored 2023-12-20T04:54:18.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.5 has been restored 2023-12-20T04:54:18.364 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2023-12-20T04:54:18.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.7 has been restored 2023-12-20T04:54:18.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.a has been restored 2023-12-20T04:54:18.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.b has been restored 2023-12-20T04:54:18.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mon.c has been restored 2023-12-20T04:54:21.628 INFO:tasks.ceph:Archiving logs... 2023-12-20T04:54:21.628 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497454/remote/smithi132/log 2023-12-20T04:54:21.629 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-20T04:54:22.908 DEBUG:teuthology.misc:Transferring archived files from smithi187:/var/log/ceph to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497454/remote/smithi187/log 2023-12-20T04:54:22.908 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /var/log/ceph -- . 2023-12-20T04:54:23.384 DEBUG:teuthology.run_tasks:Unwinding manager install 2023-12-20T04:54:23.393 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2023-12-20T04:54:23.393 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-20T04:54:23.396 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2023-12-20T04:54:23.496 DEBUG:teuthology.run_tasks:Unwinding manager clock 2023-12-20T04:54:23.505 INFO:teuthology.task.clock:Checking final clock skew... 2023-12-20T04:54:23.506 DEBUG:teuthology.orchestra.run.smithi132:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-20T04:54:23.508 DEBUG:teuthology.orchestra.run.smithi187:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2023-12-20T04:54:23.522 INFO:teuthology.orchestra.run.smithi132.stderr:bash: line 1: ntpq: command not found 2023-12-20T04:54:23.524 INFO:teuthology.orchestra.run.smithi187.stderr:bash: line 1: ntpq: command not found 2023-12-20T04:54:23.527 INFO:teuthology.orchestra.run.smithi132.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-20T04:54:23.527 INFO:teuthology.orchestra.run.smithi132.stdout:=============================================================================== 2023-12-20T04:54:23.527 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 53 +1013us[+1013us] +/- 69ms 2023-12-20T04:54:23.527 INFO:teuthology.orchestra.run.smithi132.stdout:^* hv02.front.sepia.ceph.com 3 6 377 54 +470us[ +477us] +/- 63ms 2023-12-20T04:54:23.527 INFO:teuthology.orchestra.run.smithi132.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 -1576us[-1576us] +/- 74ms 2023-12-20T04:54:23.527 INFO:teuthology.orchestra.run.smithi132.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:54:23.528 INFO:teuthology.orchestra.run.smithi187.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2023-12-20T04:54:23.528 INFO:teuthology.orchestra.run.smithi187.stdout:=============================================================================== 2023-12-20T04:54:23.528 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 52 +1014us[+1014us] +/- 69ms 2023-12-20T04:54:23.528 INFO:teuthology.orchestra.run.smithi187.stdout:^* hv02.front.sepia.ceph.com 3 6 377 52 +474us[ +486us] +/- 63ms 2023-12-20T04:54:23.528 INFO:teuthology.orchestra.run.smithi187.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 52 -1572us[-1572us] +/- 74ms 2023-12-20T04:54:23.528 INFO:teuthology.orchestra.run.smithi187.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2023-12-20T04:54:23.529 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2023-12-20T04:54:23.538 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2023-12-20T04:54:23.538 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2023-12-20T04:54:23.546 DEBUG:teuthology.orchestra.run.smithi132:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-20T04:54:23.615 DEBUG:teuthology.orchestra.run.smithi187:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2023-12-20T04:54:23.717 DEBUG:teuthology.orchestra.run.smithi132:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-20T04:54:23.748 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:54:23.749 DEBUG:teuthology.orchestra.run.smithi187:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2023-12-20T04:54:23.780 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:54:23.781 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2023-12-20T04:54:23.791 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2023-12-20T04:54:23.799 INFO:teuthology.task.internal:Duration was 1173.020790 seconds 2023-12-20T04:54:23.800 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2023-12-20T04:54:23.808 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2023-12-20T04:54:23.808 DEBUG:teuthology.orchestra.run.smithi132:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-20T04:54:23.811 DEBUG:teuthology.orchestra.run.smithi187:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2023-12-20T04:54:23.855 INFO:teuthology.orchestra.run.smithi132.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-20T04:54:23.864 INFO:teuthology.orchestra.run.smithi187.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2023-12-20T04:54:24.189 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2023-12-20T04:54:24.190 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi132.front.sepia.ceph.com 2023-12-20T04:54:24.190 DEBUG:teuthology.orchestra.run.smithi132:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-20T04:54:24.210 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi187.front.sepia.ceph.com 2023-12-20T04:54:24.210 DEBUG:teuthology.orchestra.run.smithi187:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2023-12-20T04:54:24.232 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2023-12-20T04:54:24.232 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-20T04:54:24.252 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2023-12-20T04:54:24.300 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2023-12-20T04:54:24.300 DEBUG:teuthology.orchestra.run.smithi132:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-20T04:54:24.322 DEBUG:teuthology.orchestra.run.smithi187:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2023-12-20T04:54:24.453 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2023-12-20T04:54:24.463 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2023-12-20T04:54:24.464 DEBUG:teuthology.orchestra.run.smithi132:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-20T04:54:24.490 DEBUG:teuthology.orchestra.run.smithi187:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2023-12-20T04:54:24.516 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2023-12-20T04:54:24.526 DEBUG:teuthology.orchestra.run.smithi132:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-20T04:54:24.532 DEBUG:teuthology.orchestra.run.smithi187:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2023-12-20T04:54:24.555 INFO:teuthology.orchestra.run.smithi132.stdout:kernel.core_pattern = core 2023-12-20T04:54:24.582 INFO:teuthology.orchestra.run.smithi187.stdout:kernel.core_pattern = core 2023-12-20T04:54:24.598 DEBUG:teuthology.orchestra.run.smithi132:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-20T04:54:24.625 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:54:24.625 DEBUG:teuthology.orchestra.run.smithi187:> test -e /home/ubuntu/cephtest/archive/coredump 2023-12-20T04:54:24.651 DEBUG:teuthology.orchestra.run:got remote process result: 1 2023-12-20T04:54:24.651 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2023-12-20T04:54:24.661 INFO:teuthology.task.internal:Transferring archived files... 2023-12-20T04:54:24.662 DEBUG:teuthology.misc:Transferring archived files from smithi132:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497454/remote/smithi132 2023-12-20T04:54:24.662 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-20T04:54:24.698 DEBUG:teuthology.misc:Transferring archived files from smithi187:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497454/remote/smithi187 2023-12-20T04:54:24.698 DEBUG:teuthology.orchestra.run.smithi187:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2023-12-20T04:54:24.734 INFO:teuthology.task.internal:Removing archive directory... 2023-12-20T04:54:24.734 DEBUG:teuthology.orchestra.run.smithi132:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-20T04:54:24.736 DEBUG:teuthology.orchestra.run.smithi187:> rm -rf -- /home/ubuntu/cephtest/archive 2023-12-20T04:54:24.784 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2023-12-20T04:54:24.795 INFO:teuthology.task.internal:Not uploading archives. 2023-12-20T04:54:24.795 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2023-12-20T04:54:24.804 INFO:teuthology.task.internal:Tidying up after the test... 2023-12-20T04:54:24.804 DEBUG:teuthology.orchestra.run.smithi132:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-20T04:54:24.806 DEBUG:teuthology.orchestra.run.smithi187:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2023-12-20T04:54:24.818 INFO:teuthology.orchestra.run.smithi132.stdout: 265244 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 20 04:54 /home/ubuntu/cephtest 2023-12-20T04:54:24.839 INFO:teuthology.orchestra.run.smithi187.stdout: 265757 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Dec 20 04:54 /home/ubuntu/cephtest 2023-12-20T04:54:24.840 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2023-12-20T04:54:24.850 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2023-12-20T04:54:24.873 INFO:teuthology.nuke:Checking targets against current locks 2023-12-20T04:54:24.897 DEBUG:teuthology.nuke:shortname: smithi132 2023-12-20T04:54:24.897 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-20T04:54:24.921 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi132.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497454', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 04:26:48.967249', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBMKMc5umu6dc3nMXSj2lIUQb6ER6Kmo4DIxohFL9Ar8mG+H8vCTkamCZ9pNoEhBZwOZzzX1stzAOIVTwpqmVh3c='} 2023-12-20T04:54:24.923 DEBUG:teuthology.nuke:shortname: smithi187 2023-12-20T04:54:24.924 INFO:teuthology.task.internal.check_lock:Checking locks... 2023-12-20T04:54:24.944 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi187.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/vshankar-2023-12-20_03:59:06-fs-wip-vshankar-testing1-2023-12-18-1207-reef-2-distro-default-smithi/7497454', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2023-12-20 04:26:48.969244', 'locked_by': 'scheduled_vshankar@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBA3Cn1Njhrsb/vrAGajuNArLIRdWHRk2mKkuO8v3HPZErdXbb7YlUoWwAjQkEilEad3OmuXojCaBUMHaWiUrP6I='} 2023-12-20T04:54:24.974 INFO:teuthology.orchestra.console.smithi132:Power off 2023-12-20T04:54:24.974 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-20T04:54:24.995 DEBUG:teuthology.orchestra.console.smithi132:power off output: Chassis Power Control: Down/Off 2023-12-20T04:54:24.996 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T04:54:25.009 INFO:teuthology.orchestra.console.smithi187:Power off 2023-12-20T04:54:25.009 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2023-12-20T04:54:25.017 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-12-20T04:54:25.029 DEBUG:teuthology.orchestra.console.smithi187:power off output: Chassis Power Control: Down/Off 2023-12-20T04:54:25.029 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T04:54:25.048 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-12-20T04:54:29.018 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T04:54:29.049 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T04:54:29.128 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-12-20T04:54:29.157 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is on 2023-12-20T04:54:33.133 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T04:54:33.158 DEBUG:teuthology.orchestra.console.smithi187:pexpect command: ipmitool -H smithi187.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T04:54:33.243 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is on 2023-12-20T04:54:33.266 DEBUG:teuthology.orchestra.console.smithi187:check power output: Chassis Power is off 2023-12-20T04:54:33.367 INFO:teuthology.orchestra.console.smithi187:Power off completed 2023-12-20T04:54:37.249 DEBUG:teuthology.orchestra.console.smithi132:pexpect command: ipmitool -H smithi132.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2023-12-20T04:54:37.358 DEBUG:teuthology.orchestra.console.smithi132:check power output: Chassis Power is off 2023-12-20T04:54:37.458 INFO:teuthology.orchestra.console.smithi132:Power off completed 2023-12-20T04:54:37.563 INFO:teuthology.run:Summary data: description: fs/functional/{begin/{0-install 1-ceph 2-logrotate} clusters/1a3s-mds-4c-client conf/{client mds mon osd} distro/{centos_latest} mount/fuse objectstore/bluestore-ec-root overrides/{ignorelist_health ignorelist_wrongly_marked_down no_client_pidfile} tasks/mds-full} duration: 1173.020789861679 failure_reason: '"2023-12-20T04:42:34.668201+0000 osd.4 (osd.4) 3 : cluster [WRN] OSD bench result of 233043.574721 IOPS exceeded the threshold limit of 500.000000 IOPS for osd.4. IOPS capacity is unchanged at 315.000000 IOPS. The recommendation is to establish the osd''s IOPS capacity using other benchmark tools (e.g. Fio) and then override osd_mclock_max_capacity_iops_[hdd|ssd]." in cluster log' flavor: default owner: scheduled_vshankar@teuthology success: false 2023-12-20T04:54:37.564 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2023-12-20T04:54:37.644 INFO:teuthology.run:FAIL